2024-09-19T09:03:21.038 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T09:03:21.061 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T09:03:21.170 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911897 branch: squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/mds-full} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911897' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd - disabled conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 client.0: debug client: 20 debug objectcacher: 20 debug objecter: 20 client.1: debug client: 20 debug objectcacher: 20 debug objecter: 20 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon osd backfillfull ratio: 0.6 mon osd full ratio: 0.7 mon osd nearfull ratio: 0.6 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 memstore device bytes: 200000000 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 1.0 osd mon report interval: 5 osd objectstore: memstore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL - PG_RECOVERY_FULL - PG_DEGRADED sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi018.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMLfer0HjLqmAUJv2xvGMDarzipFYy3TFvAgAYhWi6F1xVjzyQwlCLL8NrfdERO0WMvfGtzNCgzS2CwiFaXW+e8= smithi162.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLrPssrTIXE0p9OQbvaLqomwQXjU//djHcju17qjTPCKp1H3Cj7dchkg5T3N1EctJtb1HFHkUkM4AgmdFjzOunQ= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_full teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T09:03:21.170 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T09:03:21.171 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T09:03:21.171 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T09:03:21.173 INFO:teuthology.task.internal:Checking packages... 2024-09-19T09:03:21.197 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T09:03:21.198 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T09:03:21.198 INFO:teuthology.packaging:ref: None 2024-09-19T09:03:21.198 INFO:teuthology.packaging:tag: None 2024-09-19T09:03:21.198 INFO:teuthology.packaging:branch: squid 2024-09-19T09:03:21.198 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:03:21.198 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T09:03:21.430 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T09:03:21.432 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T09:03:21.441 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T09:03:21.441 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T09:03:21.510 INFO:teuthology.task.internal:Saving configuration 2024-09-19T09:03:21.529 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T09:03:21.632 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T09:03:21.658 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi018.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911897', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 08:58:16.858984', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMLfer0HjLqmAUJv2xvGMDarzipFYy3TFvAgAYhWi6F1xVjzyQwlCLL8NrfdERO0WMvfGtzNCgzS2CwiFaXW+e8='} 2024-09-19T09:03:21.681 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911897', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 08:58:16.860390', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLrPssrTIXE0p9OQbvaLqomwQXjU//djHcju17qjTPCKp1H3Cj7dchkg5T3N1EctJtb1HFHkUkM4AgmdFjzOunQ='} 2024-09-19T09:03:21.682 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T09:03:21.696 INFO:teuthology.task.internal:roles: ubuntu@smithi018.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-19T09:03:21.696 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-19T09:03:21.696 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T09:03:21.812 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4ae6f7fbe0>, signals=[15]) 2024-09-19T09:03:21.812 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T09:03:21.833 INFO:teuthology.task.internal:Opening connections... 2024-09-19T09:03:21.833 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T09:03:21.835 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:03:21.919 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi162.front.sepia.ceph.com 2024-09-19T09:03:21.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:03:22.003 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T09:03:22.009 DEBUG:teuthology.orchestra.run.smithi018:> uname -m 2024-09-19T09:03:22.028 INFO:teuthology.orchestra.run.smithi018.stdout:x86_64 2024-09-19T09:03:22.028 DEBUG:teuthology.orchestra.run.smithi018:> cat /etc/os-release 2024-09-19T09:03:22.086 INFO:teuthology.orchestra.run.smithi018.stdout:NAME="CentOS Stream" 2024-09-19T09:03:22.086 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION="9" 2024-09-19T09:03:22.086 INFO:teuthology.orchestra.run.smithi018.stdout:ID="centos" 2024-09-19T09:03:22.086 INFO:teuthology.orchestra.run.smithi018.stdout:ID_LIKE="rhel fedora" 2024-09-19T09:03:22.086 INFO:teuthology.orchestra.run.smithi018.stdout:VERSION_ID="9" 2024-09-19T09:03:22.086 INFO:teuthology.orchestra.run.smithi018.stdout:PLATFORM_ID="platform:el9" 2024-09-19T09:03:22.087 INFO:teuthology.orchestra.run.smithi018.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T09:03:22.087 INFO:teuthology.orchestra.run.smithi018.stdout:ANSI_COLOR="0;31" 2024-09-19T09:03:22.087 INFO:teuthology.orchestra.run.smithi018.stdout:LOGO="fedora-logo-icon" 2024-09-19T09:03:22.087 INFO:teuthology.orchestra.run.smithi018.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T09:03:22.087 INFO:teuthology.orchestra.run.smithi018.stdout:HOME_URL="https://centos.org/" 2024-09-19T09:03:22.087 INFO:teuthology.orchestra.run.smithi018.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T09:03:22.087 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T09:03:22.087 INFO:teuthology.orchestra.run.smithi018.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T09:03:22.088 INFO:teuthology.lock.ops:Updating smithi018.front.sepia.ceph.com on lock server 2024-09-19T09:03:22.108 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2024-09-19T09:03:22.126 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2024-09-19T09:03:22.127 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-09-19T09:03:22.184 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="CentOS Stream" 2024-09-19T09:03:22.184 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="9" 2024-09-19T09:03:22.185 INFO:teuthology.orchestra.run.smithi162.stdout:ID="centos" 2024-09-19T09:03:22.185 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE="rhel fedora" 2024-09-19T09:03:22.185 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="9" 2024-09-19T09:03:22.185 INFO:teuthology.orchestra.run.smithi162.stdout:PLATFORM_ID="platform:el9" 2024-09-19T09:03:22.185 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T09:03:22.185 INFO:teuthology.orchestra.run.smithi162.stdout:ANSI_COLOR="0;31" 2024-09-19T09:03:22.186 INFO:teuthology.orchestra.run.smithi162.stdout:LOGO="fedora-logo-icon" 2024-09-19T09:03:22.186 INFO:teuthology.orchestra.run.smithi162.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T09:03:22.186 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://centos.org/" 2024-09-19T09:03:22.186 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T09:03:22.186 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T09:03:22.186 INFO:teuthology.orchestra.run.smithi162.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T09:03:22.187 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-09-19T09:03:22.208 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T09:03:22.216 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T09:03:22.283 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T09:03:22.284 DEBUG:teuthology.orchestra.run.smithi018:> test '!' -e /home/ubuntu/cephtest 2024-09-19T09:03:22.286 DEBUG:teuthology.orchestra.run.smithi162:> test '!' -e /home/ubuntu/cephtest 2024-09-19T09:03:22.303 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T09:03:22.367 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T09:03:22.367 DEBUG:teuthology.orchestra.run.smithi018:> test -z $(ls -A /var/lib/ceph) 2024-09-19T09:03:22.369 DEBUG:teuthology.orchestra.run.smithi162:> test -z $(ls -A /var/lib/ceph) 2024-09-19T09:03:22.402 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T09:03:22.555 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T09:03:22.626 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-19T09:03:22.626 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-09-19T09:03:22.626 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-09-19T09:03:22.626 DEBUG:teuthology.orchestra.run.smithi018:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T09:03:22.627 DEBUG:teuthology.orchestra.run.smithi162:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T09:03:22.644 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:03:22.644 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-09-19T09:03:22.645 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:03:22.645 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2024-09-19T09:03:22.702 INFO:teuthology.orchestra.run.smithi018.stdout:5.14.0-503.el9.x86_64 2024-09-19T09:03:22.702 INFO:teuthology.task.kernel:Running kernel on smithi018: 5.14.0-503.el9.x86_64 2024-09-19T09:03:22.702 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum install -y kernel 2024-09-19T09:03:22.703 INFO:teuthology.orchestra.run.smithi162.stdout:5.14.0-503.el9.x86_64 2024-09-19T09:03:22.703 INFO:teuthology.task.kernel:Running kernel on smithi162: 5.14.0-503.el9.x86_64 2024-09-19T09:03:22.703 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum install -y kernel 2024-09-19T09:03:25.097 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-19T09:03:26.398 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.3 MB 00:01 2024-09-19T09:03:43.413 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - AppStream 1.3 MB/s | 20 MB 00:15 2024-09-19T09:03:45.070 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 20 MB 00:18 2024-09-19T09:03:49.288 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - CRB 3.1 MB/s | 6.5 MB 00:02 2024-09-19T09:03:51.113 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-19T09:03:51.495 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.5 MB 00:02 2024-09-19T09:03:51.942 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-19T09:03:53.221 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 19 kB 00:00 2024-09-19T09:03:54.200 INFO:teuthology.orchestra.run.smithi018.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-19T09:03:57.364 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-19T09:03:59.279 INFO:teuthology.orchestra.run.smithi162.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T09:03:59.279 INFO:teuthology.orchestra.run.smithi162.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T09:03:59.367 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-19T09:03:59.379 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-19T09:03:59.379 INFO:teuthology.orchestra.run.smithi162.stdout: Package Architecture Version Repository Size 2024-09-19T09:03:59.379 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-19T09:03:59.379 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-19T09:03:59.379 INFO:teuthology.orchestra.run.smithi162.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T09:03:59.379 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-19T09:03:59.379 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T09:03:59.379 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T09:03:59.379 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T09:03:59.379 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:03:59.379 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-19T09:03:59.380 INFO:teuthology.orchestra.run.smithi162.stdout:================================================================================ 2024-09-19T09:03:59.380 INFO:teuthology.orchestra.run.smithi162.stdout:Install 4 Packages 2024-09-19T09:03:59.380 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:03:59.380 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 79 M 2024-09-19T09:03:59.381 INFO:teuthology.orchestra.run.smithi162.stdout:Installed size: 126 M 2024-09-19T09:03:59.381 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-19T09:03:59.540 INFO:teuthology.orchestra.run.smithi162.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 348 kB/s | 36 kB 00:00 2024-09-19T09:03:59.839 INFO:teuthology.orchestra.run.smithi018.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-19T09:03:59.924 INFO:teuthology.orchestra.run.smithi162.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-19T09:04:00.324 INFO:teuthology.orchestra.run.smithi162.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 36 MB/s | 29 MB 00:00 2024-09-19T09:04:00.649 INFO:teuthology.orchestra.run.smithi162.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 28 MB/s | 35 MB 00:01 2024-09-19T09:04:00.650 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:04:00.650 INFO:teuthology.orchestra.run.smithi162.stdout:Total 62 MB/s | 79 MB 00:01 2024-09-19T09:04:01.334 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-19T09:04:01.707 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-19T09:04:01.707 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-19T09:04:01.837 INFO:teuthology.orchestra.run.smithi018.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T09:04:01.838 INFO:teuthology.orchestra.run.smithi018.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T09:04:01.937 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-19T09:04:01.942 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-19T09:04:01.942 INFO:teuthology.orchestra.run.smithi018.stdout: Package Architecture Version Repository Size 2024-09-19T09:04:01.942 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-19T09:04:01.942 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-09-19T09:04:01.942 INFO:teuthology.orchestra.run.smithi018.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T09:04:01.942 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-09-19T09:04:01.942 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T09:04:01.942 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T09:04:01.942 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T09:04:01.942 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:04:01.943 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-09-19T09:04:01.943 INFO:teuthology.orchestra.run.smithi018.stdout:================================================================================ 2024-09-19T09:04:01.943 INFO:teuthology.orchestra.run.smithi018.stdout:Install 4 Packages 2024-09-19T09:04:01.943 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:04:01.943 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 79 M 2024-09-19T09:04:01.943 INFO:teuthology.orchestra.run.smithi018.stdout:Installed size: 126 M 2024-09-19T09:04:01.944 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-09-19T09:04:02.540 INFO:teuthology.orchestra.run.smithi018.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 63 kB/s | 36 kB 00:00 2024-09-19T09:04:02.646 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-19T09:04:02.647 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-19T09:04:03.357 INFO:teuthology.orchestra.run.smithi018.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-19T09:04:04.341 INFO:teuthology.orchestra.run.smithi018.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 15 MB/s | 35 MB 00:02 2024-09-19T09:04:04.849 INFO:teuthology.orchestra.run.smithi018.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 12 MB/s | 29 MB 00:02 2024-09-19T09:04:04.849 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:04:04.850 INFO:teuthology.orchestra.run.smithi018.stdout:Total 27 MB/s | 79 MB 00:02 2024-09-19T09:04:05.083 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-19T09:04:05.560 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-09-19T09:04:05.716 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T09:04:05.841 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T09:04:05.954 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-09-19T09:04:05.955 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-09-19T09:04:06.965 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-09-19T09:04:06.965 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-09-19T09:04:08.600 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T09:04:08.733 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T09:04:09.528 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-09-19T09:04:10.161 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T09:04:10.242 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T09:04:13.016 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T09:04:13.145 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T09:04:13.563 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T09:04:13.608 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:04:18.265 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T09:04:18.311 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:04:18.435 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:04:23.455 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:04:56.339 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:04:56.381 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:04:56.747 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:04:56.747 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T09:04:56.747 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T09:04:56.747 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T09:04:57.632 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:04:57.632 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:04:57.632 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-19T09:04:57.632 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T09:04:57.633 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T09:04:57.633 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T09:04:57.633 INFO:teuthology.orchestra.run.smithi162.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T09:04:57.633 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:04:57.633 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-19T09:04:57.997 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T09:04:58.079 INFO:teuthology.orchestra.run.smithi162.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T09:04:58.079 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T09:04:58.079 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T09:04:58.080 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T09:04:58.080 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T09:04:58.080 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-09-19T09:04:58.080 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi162.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T09:04:58.080 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T09:04:58.138 INFO:teuthology.orchestra.run.smithi162.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T09:04:58.139 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T09:04:58.139 DEBUG:teuthology.orchestra.run.smithi162:> sudo rpm -qi grub2-tools 2024-09-19T09:04:58.171 INFO:teuthology.orchestra.run.smithi162.stdout:Name : grub2-tools 2024-09-19T09:04:58.171 INFO:teuthology.orchestra.run.smithi162.stdout:Epoch : 1 2024-09-19T09:04:58.171 INFO:teuthology.orchestra.run.smithi162.stdout:Version : 2.06 2024-09-19T09:04:58.171 INFO:teuthology.orchestra.run.smithi162.stdout:Release : 82.el9 2024-09-19T09:04:58.171 INFO:teuthology.orchestra.run.smithi162.stdout:Architecture: x86_64 2024-09-19T09:04:58.171 INFO:teuthology.orchestra.run.smithi162.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T09:04:58.171 INFO:teuthology.orchestra.run.smithi162.stdout:Group : Unspecified 2024-09-19T09:04:58.172 INFO:teuthology.orchestra.run.smithi162.stdout:Size : 8274670 2024-09-19T09:04:58.172 INFO:teuthology.orchestra.run.smithi162.stdout:License : GPLv3+ 2024-09-19T09:04:58.172 INFO:teuthology.orchestra.run.smithi162.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T09:04:58.172 INFO:teuthology.orchestra.run.smithi162.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T09:04:58.172 INFO:teuthology.orchestra.run.smithi162.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T09:04:58.172 INFO:teuthology.orchestra.run.smithi162.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T09:04:58.172 INFO:teuthology.orchestra.run.smithi162.stdout:Packager : builder@centos.org 2024-09-19T09:04:58.172 INFO:teuthology.orchestra.run.smithi162.stdout:Vendor : CentOS 2024-09-19T09:04:58.172 INFO:teuthology.orchestra.run.smithi162.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T09:04:58.172 INFO:teuthology.orchestra.run.smithi162.stdout:Summary : Support tools for GRUB. 2024-09-19T09:04:58.172 INFO:teuthology.orchestra.run.smithi162.stdout:Description : 2024-09-19T09:04:58.172 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:04:58.172 INFO:teuthology.orchestra.run.smithi162.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T09:04:58.172 INFO:teuthology.orchestra.run.smithi162.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T09:04:58.173 INFO:teuthology.orchestra.run.smithi162.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T09:04:58.173 INFO:teuthology.orchestra.run.smithi162.stdout:hardware devices. 2024-09-19T09:04:58.173 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:04:58.173 INFO:teuthology.orchestra.run.smithi162.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T09:04:58.174 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T09:04:58.174 INFO:teuthology.task.kernel:Updating grub on smithi162 to boot 5.14.0-508.el9.x86_64 2024-09-19T09:04:58.174 DEBUG:teuthology.orchestra.run.smithi162:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T09:04:58.814 INFO:teuthology.orchestra.run.smithi162.stderr:Generating grub configuration file ... 2024-09-19T09:05:00.057 INFO:teuthology.orchestra.run.smithi162.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T09:05:00.075 INFO:teuthology.orchestra.run.smithi162.stderr:done 2024-09-19T09:05:00.077 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-09-19T09:05:00.093 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.nXHmVPFPhE 2024-09-19T09:05:00.093 DEBUG:teuthology.orchestra.run.smithi162:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.nXHmVPFPhE 2024-09-19T09:05:00.160 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.nXHmVPFPhE 2024-09-19T09:05:00.310 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.nXHmVPFPhE is 6KB 2024-09-19T09:05:00.361 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.nXHmVPFPhE 2024-09-19T09:05:00.377 DEBUG:teuthology.orchestra.run.smithi162:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T09:05:00.439 INFO:teuthology.orchestra.run.smithi162.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T09:05:00.439 INFO:teuthology.orchestra.run.smithi162.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T09:05:00.439 INFO:teuthology.orchestra.run.smithi162.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T09:05:00.439 INFO:teuthology.orchestra.run.smithi162.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T09:05:00.441 DEBUG:teuthology.orchestra.run.smithi162:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T09:05:00.599 DEBUG:teuthology.orchestra.run.smithi162:> sudo shutdown -r now 2024-09-19T09:05:02.217 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:05:02.258 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:05:02.611 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:05:02.612 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T09:05:02.612 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T09:05:02.612 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T09:05:03.453 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T09:05:03.454 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:05:03.454 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-09-19T09:05:03.454 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T09:05:03.454 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T09:05:03.454 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T09:05:03.454 INFO:teuthology.orchestra.run.smithi018.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T09:05:03.454 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:05:03.454 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-19T09:05:03.780 DEBUG:teuthology.orchestra.run.smithi018:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T09:05:03.869 INFO:teuthology.orchestra.run.smithi018.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T09:05:03.870 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T09:05:03.870 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T09:05:03.870 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T09:05:03.870 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T09:05:03.870 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-19T09:05:03.870 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi018.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T09:05:03.870 DEBUG:teuthology.orchestra.run.smithi018:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T09:05:03.929 INFO:teuthology.orchestra.run.smithi018.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T09:05:03.929 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T09:05:03.930 DEBUG:teuthology.orchestra.run.smithi018:> sudo rpm -qi grub2-tools 2024-09-19T09:05:03.960 INFO:teuthology.orchestra.run.smithi018.stdout:Name : grub2-tools 2024-09-19T09:05:03.960 INFO:teuthology.orchestra.run.smithi018.stdout:Epoch : 1 2024-09-19T09:05:03.960 INFO:teuthology.orchestra.run.smithi018.stdout:Version : 2.06 2024-09-19T09:05:03.960 INFO:teuthology.orchestra.run.smithi018.stdout:Release : 82.el9 2024-09-19T09:05:03.961 INFO:teuthology.orchestra.run.smithi018.stdout:Architecture: x86_64 2024-09-19T09:05:03.961 INFO:teuthology.orchestra.run.smithi018.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T09:05:03.961 INFO:teuthology.orchestra.run.smithi018.stdout:Group : Unspecified 2024-09-19T09:05:03.961 INFO:teuthology.orchestra.run.smithi018.stdout:Size : 8274670 2024-09-19T09:05:03.961 INFO:teuthology.orchestra.run.smithi018.stdout:License : GPLv3+ 2024-09-19T09:05:03.961 INFO:teuthology.orchestra.run.smithi018.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T09:05:03.961 INFO:teuthology.orchestra.run.smithi018.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T09:05:03.961 INFO:teuthology.orchestra.run.smithi018.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T09:05:03.961 INFO:teuthology.orchestra.run.smithi018.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T09:05:03.961 INFO:teuthology.orchestra.run.smithi018.stdout:Packager : builder@centos.org 2024-09-19T09:05:03.961 INFO:teuthology.orchestra.run.smithi018.stdout:Vendor : CentOS 2024-09-19T09:05:03.961 INFO:teuthology.orchestra.run.smithi018.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T09:05:03.961 INFO:teuthology.orchestra.run.smithi018.stdout:Summary : Support tools for GRUB. 2024-09-19T09:05:03.961 INFO:teuthology.orchestra.run.smithi018.stdout:Description : 2024-09-19T09:05:03.962 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:05:03.962 INFO:teuthology.orchestra.run.smithi018.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T09:05:03.962 INFO:teuthology.orchestra.run.smithi018.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T09:05:03.962 INFO:teuthology.orchestra.run.smithi018.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T09:05:03.962 INFO:teuthology.orchestra.run.smithi018.stdout:hardware devices. 2024-09-19T09:05:03.962 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:05:03.962 INFO:teuthology.orchestra.run.smithi018.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T09:05:03.963 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T09:05:03.963 INFO:teuthology.task.kernel:Updating grub on smithi018 to boot 5.14.0-508.el9.x86_64 2024-09-19T09:05:03.963 DEBUG:teuthology.orchestra.run.smithi018:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T09:05:04.556 INFO:teuthology.orchestra.run.smithi018.stderr:Generating grub configuration file ... 2024-09-19T09:05:05.851 INFO:teuthology.orchestra.run.smithi018.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T09:05:05.888 INFO:teuthology.orchestra.run.smithi018.stderr:done 2024-09-19T09:05:05.890 DEBUG:teuthology.orchestra.run.smithi018:> mktemp 2024-09-19T09:05:05.905 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.7z1eAU9Dcc 2024-09-19T09:05:05.905 DEBUG:teuthology.orchestra.run.smithi018:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.7z1eAU9Dcc 2024-09-19T09:05:05.988 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0666 /tmp/tmp.7z1eAU9Dcc 2024-09-19T09:05:06.143 DEBUG:teuthology.orchestra.remote:smithi018:/tmp/tmp.7z1eAU9Dcc is 6KB 2024-09-19T09:05:06.192 DEBUG:teuthology.orchestra.run.smithi018:> rm -fr /tmp/tmp.7z1eAU9Dcc 2024-09-19T09:05:06.207 DEBUG:teuthology.orchestra.run.smithi018:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T09:05:06.270 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T09:05:06.270 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T09:05:06.271 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T09:05:06.271 INFO:teuthology.orchestra.run.smithi018.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T09:05:06.272 DEBUG:teuthology.orchestra.run.smithi018:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T09:05:06.418 DEBUG:teuthology.orchestra.run.smithi018:> sudo shutdown -r now 2024-09-19T09:05:30.625 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-19T09:05:30.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-19T09:05:30.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:05:36.427 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-19T09:05:36.427 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-19T09:05:36.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:05:49.117 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-09-19T09:05:54.753 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.18 2024-09-19T09:05:58.121 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-19T09:05:58.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:06:01.181 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-09-19T09:06:03.757 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-19T09:06:03.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:06:06.817 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.18 2024-09-19T09:06:13.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-19T09:06:13.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:06:18.824 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-19T09:06:18.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:06:50.764 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-09-19T09:06:51.263 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-19T09:06:51.264 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-19T09:06:51.264 DEBUG:teuthology.orchestra.run.smithi018:> uname -r 2024-09-19T09:06:51.281 INFO:teuthology.orchestra.run.smithi018.stdout:5.14.0-508.el9.x86_64 2024-09-19T09:06:51.281 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T09:06:51.281 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T09:06:51.281 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T09:06:52.282 DEBUG:teuthology.parallel:result is None 2024-09-19T09:07:13.189 DEBUG:teuthology.orchestra.remote:timed out 2024-09-19T09:07:28.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-19T09:07:28.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:07:28.639 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-09-19T09:07:29.052 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-19T09:07:29.052 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-508.el9.x86_64"... 2024-09-19T09:07:29.052 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2024-09-19T09:07:29.068 INFO:teuthology.orchestra.run.smithi162.stdout:5.14.0-508.el9.x86_64 2024-09-19T09:07:29.069 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T09:07:29.069 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T09:07:29.069 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T09:07:30.070 DEBUG:teuthology.parallel:result is None 2024-09-19T09:07:30.070 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T09:07:30.077 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T09:07:30.077 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T09:07:30.080 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T09:07:30.098 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T09:07:30.157 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T09:07:30.264 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T09:07:30.264 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T09:07:30.266 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T09:07:30.302 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T09:07:30.422 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T09:07:30.423 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T09:07:30.425 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T09:07:30.528 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:07:30.531 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:07:30.551 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:07:30.554 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T09:07:30.555 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T09:07:30.562 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T09:07:30.562 DEBUG:teuthology.orchestra.run.smithi018:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T09:07:30.564 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T09:07:30.594 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T09:07:30.700 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T09:07:30.700 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T09:07:30.702 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T09:07:30.721 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:07:30.799 DEBUG:teuthology.orchestra.run.smithi018:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:07:30.854 DEBUG:teuthology.orchestra.run.smithi018:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:07:30.933 DEBUG:teuthology.orchestra.run.smithi018:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:07:30.982 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:07:30.982 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T09:07:31.050 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:07:31.091 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T09:07:31.146 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:07:31.225 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T09:07:31.272 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:07:31.272 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T09:07:31.338 DEBUG:teuthology.orchestra.run.smithi018:> sudo service rsyslog restart 2024-09-19T09:07:31.341 DEBUG:teuthology.orchestra.run.smithi162:> sudo service rsyslog restart 2024-09-19T09:07:31.387 INFO:teuthology.orchestra.run.smithi018.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:07:31.427 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:07:31.874 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T09:07:31.881 INFO:teuthology.task.internal:Starting timer... 2024-09-19T09:07:31.881 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T09:07:31.977 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T09:07:32.061 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T09:07:32.061 DEBUG:teuthology.orchestra.run.smithi018:> sudo service auditd rotate 2024-09-19T09:07:32.126 INFO:teuthology.orchestra.run.smithi018.stdout:Rotating logs: 2024-09-19T09:07:32.128 DEBUG:teuthology.orchestra.run.smithi162:> sudo service auditd rotate 2024-09-19T09:07:32.180 INFO:teuthology.orchestra.run.smithi162.stdout:Rotating logs: 2024-09-19T09:07:32.182 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T09:07:32.182 DEBUG:teuthology.orchestra.run.smithi018:> /usr/sbin/getenforce 2024-09-19T09:07:32.204 INFO:teuthology.orchestra.run.smithi018.stdout:Permissive 2024-09-19T09:07:32.204 DEBUG:teuthology.orchestra.run.smithi162:> /usr/sbin/getenforce 2024-09-19T09:07:32.232 INFO:teuthology.orchestra.run.smithi162.stdout:Permissive 2024-09-19T09:07:32.232 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi018.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi162.front.sepia.ceph.com': 'permissive'} 2024-09-19T09:07:32.232 DEBUG:teuthology.orchestra.run.smithi018:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:07:32.272 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:07:32.273 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:07:32.300 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:07:32.301 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T09:07:32.301 DEBUG:teuthology.orchestra.run.smithi018:> sudo /usr/sbin/setenforce permissive 2024-09-19T09:07:32.345 DEBUG:teuthology.orchestra.run.smithi162:> sudo /usr/sbin/setenforce permissive 2024-09-19T09:07:32.387 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T09:07:32.397 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T09:07:32.408 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T09:07:32.409 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi018.front.sepia.ceph.com,smithi162.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T09:11:21.936 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi018.front.sepia.ceph.com'), Remote(name='ubuntu@smithi162.front.sepia.ceph.com')] 2024-09-19T09:11:21.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-19T09:11:21.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi018.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:11:22.016 DEBUG:teuthology.orchestra.run.smithi018:> true 2024-09-19T09:11:22.106 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi018.front.sepia.ceph.com' 2024-09-19T09:11:22.106 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-19T09:11:22.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T09:11:22.182 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-09-19T09:11:22.260 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-09-19T09:11:22.261 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T09:11:22.271 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T09:11:22.272 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T09:11:22.272 DEBUG:teuthology.orchestra.run.smithi018:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:11:22.275 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T09:11:22.275 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:11:22.304 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T09:11:22.320 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T09:11:22.331 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T09:11:22.346 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T09:11:22.347 INFO:teuthology.orchestra.run.smithi018.stderr:sudo: ntpd: command not found 2024-09-19T09:11:22.359 INFO:teuthology.orchestra.run.smithi018.stdout:506 Cannot talk to daemon 2024-09-19T09:11:22.371 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: ntpd: command not found 2024-09-19T09:11:22.374 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T09:11:22.382 INFO:teuthology.orchestra.run.smithi162.stdout:506 Cannot talk to daemon 2024-09-19T09:11:22.389 INFO:teuthology.orchestra.run.smithi018.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T09:11:22.396 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T09:11:22.410 INFO:teuthology.orchestra.run.smithi162.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T09:11:22.447 INFO:teuthology.orchestra.run.smithi018.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:11:22.450 INFO:teuthology.orchestra.run.smithi018.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:11:22.450 INFO:teuthology.orchestra.run.smithi018.stdout:=============================================================================== 2024-09-19T09:11:22.451 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:11:22.451 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:11:22.451 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:11:22.451 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:11:22.472 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:11:22.476 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:11:22.476 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-09-19T09:11:22.476 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:11:22.476 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:11:22.476 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:11:22.476 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:11:22.477 INFO:teuthology.run_tasks:Running task install... 2024-09-19T09:11:22.485 DEBUG:teuthology.task.install:project ceph 2024-09-19T09:11:22.485 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T09:11:22.485 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T09:11:22.485 INFO:teuthology.task.install:Using flavor: default 2024-09-19T09:11:22.491 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T09:11:22.491 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T09:11:22.491 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T09:11:22.492 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:11:22.494 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T09:11:22.494 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:11:22.642 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T09:11:22.642 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T09:11:22.651 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T09:11:22.652 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T09:11:22.756 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T09:11:22.756 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:11:22.756 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T09:11:22.760 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T09:11:22.760 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:11:22.760 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T09:11:22.783 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T09:11:22.783 DEBUG:teuthology.orchestra.run.smithi162:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T09:11:22.787 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T09:11:22.788 DEBUG:teuthology.orchestra.run.smithi018:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T09:11:22.849 DEBUG:teuthology.orchestra.run.smithi162:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T09:11:22.854 DEBUG:teuthology.orchestra.run.smithi018:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T09:11:22.924 DEBUG:teuthology.orchestra.run.smithi162:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T09:11:22.929 DEBUG:teuthology.orchestra.run.smithi018:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T09:11:22.989 INFO:teuthology.orchestra.run.smithi162.stdout:check_obsoletes = 1 2024-09-19T09:11:22.991 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum clean all 2024-09-19T09:11:22.995 INFO:teuthology.orchestra.run.smithi018.stdout:check_obsoletes = 1 2024-09-19T09:11:22.997 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum clean all 2024-09-19T09:11:23.225 INFO:teuthology.orchestra.run.smithi162.stdout:45 files removed 2024-09-19T09:11:23.239 INFO:teuthology.orchestra.run.smithi018.stdout:45 files removed 2024-09-19T09:11:23.253 DEBUG:teuthology.orchestra.run.smithi162:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T09:11:23.266 DEBUG:teuthology.orchestra.run.smithi018:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T09:11:23.818 INFO:teuthology.orchestra.run.smithi162.stdout:ceph packages for x86_64 303 kB/s | 84 kB 00:00 2024-09-19T09:11:23.841 INFO:teuthology.orchestra.run.smithi018.stdout:ceph packages for x86_64 304 kB/s | 84 kB 00:00 2024-09-19T09:11:24.110 INFO:teuthology.orchestra.run.smithi162.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-19T09:11:24.150 INFO:teuthology.orchestra.run.smithi018.stdout:ceph noarch packages 44 kB/s | 12 kB 00:00 2024-09-19T09:11:24.386 INFO:teuthology.orchestra.run.smithi162.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-19T09:11:24.434 INFO:teuthology.orchestra.run.smithi018.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-19T09:11:24.875 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.3 MB 00:00 2024-09-19T09:11:26.369 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.3 MB 00:01 2024-09-19T09:11:28.137 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-09-19T09:11:29.168 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - AppStream 6.5 MB/s | 20 MB 00:03 2024-09-19T09:11:33.552 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-19T09:11:35.161 INFO:teuthology.orchestra.run.smithi018.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 19 kB 00:00 2024-09-19T09:11:35.295 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - CRB 1.9 MB/s | 6.5 MB 00:03 2024-09-19T09:11:36.298 INFO:teuthology.orchestra.run.smithi018.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-19T09:11:37.237 INFO:teuthology.orchestra.run.smithi162.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 19 kB 00:00 2024-09-19T09:11:38.233 INFO:teuthology.orchestra.run.smithi162.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-19T09:11:41.887 INFO:teuthology.orchestra.run.smithi018.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-09-19T09:11:43.630 INFO:teuthology.orchestra.run.smithi162.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-19T09:11:44.150 INFO:teuthology.orchestra.run.smithi018.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:11:44.151 INFO:teuthology.orchestra.run.smithi018.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:11:44.166 INFO:teuthology.orchestra.run.smithi018.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T09:11:44.167 INFO:teuthology.orchestra.run.smithi018.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T09:11:44.168 INFO:teuthology.orchestra.run.smithi018.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T09:11:44.169 INFO:teuthology.orchestra.run.smithi018.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T09:11:44.171 INFO:teuthology.orchestra.run.smithi018.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T09:11:44.173 INFO:teuthology.orchestra.run.smithi018.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T09:11:44.175 INFO:teuthology.orchestra.run.smithi018.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T09:11:44.241 INFO:teuthology.orchestra.run.smithi018.stdout:Dependencies resolved. 2024-09-19T09:11:44.259 INFO:teuthology.orchestra.run.smithi018.stdout:====================================================================================== 2024-09-19T09:11:44.259 INFO:teuthology.orchestra.run.smithi018.stdout: Package Arch Version Repository Size 2024-09-19T09:11:44.259 INFO:teuthology.orchestra.run.smithi018.stdout:====================================================================================== 2024-09-19T09:11:44.259 INFO:teuthology.orchestra.run.smithi018.stdout:Installing: 2024-09-19T09:11:44.259 INFO:teuthology.orchestra.run.smithi018.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T09:11:44.259 INFO:teuthology.orchestra.run.smithi018.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T09:11:44.259 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T09:11:44.259 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T09:11:44.259 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T09:11:44.259 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T09:11:44.260 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T09:11:44.260 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T09:11:44.260 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T09:11:44.260 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T09:11:44.260 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T09:11:44.260 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T09:11:44.260 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T09:11:44.260 INFO:teuthology.orchestra.run.smithi018.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T09:11:44.260 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T09:11:44.260 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T09:11:44.260 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T09:11:44.261 INFO:teuthology.orchestra.run.smithi018.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T09:11:44.261 INFO:teuthology.orchestra.run.smithi018.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T09:11:44.261 INFO:teuthology.orchestra.run.smithi018.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T09:11:44.261 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T09:11:44.261 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T09:11:44.261 INFO:teuthology.orchestra.run.smithi018.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T09:11:44.261 INFO:teuthology.orchestra.run.smithi018.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T09:11:44.261 INFO:teuthology.orchestra.run.smithi018.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T09:11:44.261 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T09:11:44.261 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T09:11:44.261 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T09:11:44.261 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T09:11:44.261 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T09:11:44.262 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T09:11:44.262 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T09:11:44.262 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T09:11:44.262 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T09:11:44.262 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T09:11:44.262 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T09:11:44.262 INFO:teuthology.orchestra.run.smithi018.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T09:11:44.262 INFO:teuthology.orchestra.run.smithi018.stdout:Upgrading: 2024-09-19T09:11:44.262 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T09:11:44.262 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T09:11:44.262 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T09:11:44.263 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T09:11:44.263 INFO:teuthology.orchestra.run.smithi018.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T09:11:44.263 INFO:teuthology.orchestra.run.smithi018.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T09:11:44.263 INFO:teuthology.orchestra.run.smithi018.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T09:11:44.263 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T09:11:44.263 INFO:teuthology.orchestra.run.smithi018.stdout:Installing dependencies: 2024-09-19T09:11:44.263 INFO:teuthology.orchestra.run.smithi018.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T09:11:44.263 INFO:teuthology.orchestra.run.smithi018.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T09:11:44.263 INFO:teuthology.orchestra.run.smithi018.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T09:11:44.263 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T09:11:44.263 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T09:11:44.263 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T09:11:44.263 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T09:11:44.264 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T09:11:44.264 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T09:11:44.264 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T09:11:44.264 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T09:11:44.264 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T09:11:44.264 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T09:11:44.264 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T09:11:44.264 INFO:teuthology.orchestra.run.smithi018.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T09:11:44.264 INFO:teuthology.orchestra.run.smithi018.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T09:11:44.264 INFO:teuthology.orchestra.run.smithi018.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T09:11:44.264 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T09:11:44.264 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T09:11:44.265 INFO:teuthology.orchestra.run.smithi018.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T09:11:44.265 INFO:teuthology.orchestra.run.smithi018.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T09:11:44.265 INFO:teuthology.orchestra.run.smithi018.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T09:11:44.265 INFO:teuthology.orchestra.run.smithi018.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T09:11:44.265 INFO:teuthology.orchestra.run.smithi018.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T09:11:44.265 INFO:teuthology.orchestra.run.smithi018.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T09:11:44.265 INFO:teuthology.orchestra.run.smithi018.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T09:11:44.265 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T09:11:44.265 INFO:teuthology.orchestra.run.smithi018.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T09:11:44.265 INFO:teuthology.orchestra.run.smithi018.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T09:11:44.265 INFO:teuthology.orchestra.run.smithi018.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T09:11:44.265 INFO:teuthology.orchestra.run.smithi018.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T09:11:44.266 INFO:teuthology.orchestra.run.smithi018.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T09:11:44.266 INFO:teuthology.orchestra.run.smithi018.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T09:11:44.266 INFO:teuthology.orchestra.run.smithi018.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T09:11:44.266 INFO:teuthology.orchestra.run.smithi018.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T09:11:44.266 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T09:11:44.266 INFO:teuthology.orchestra.run.smithi018.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T09:11:44.266 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T09:11:44.266 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T09:11:44.266 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T09:11:44.266 INFO:teuthology.orchestra.run.smithi018.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T09:11:44.266 INFO:teuthology.orchestra.run.smithi018.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T09:11:44.266 INFO:teuthology.orchestra.run.smithi018.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T09:11:44.267 INFO:teuthology.orchestra.run.smithi018.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T09:11:44.267 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T09:11:44.267 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T09:11:44.267 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T09:11:44.267 INFO:teuthology.orchestra.run.smithi018.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T09:11:44.267 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T09:11:44.267 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T09:11:44.267 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T09:11:44.267 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T09:11:44.267 INFO:teuthology.orchestra.run.smithi018.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T09:11:44.267 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T09:11:44.267 INFO:teuthology.orchestra.run.smithi018.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T09:11:44.267 INFO:teuthology.orchestra.run.smithi018.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T09:11:44.268 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T09:11:44.268 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T09:11:44.268 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T09:11:44.268 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T09:11:44.268 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T09:11:44.268 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T09:11:44.268 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T09:11:44.268 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T09:11:44.268 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T09:11:44.268 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T09:11:44.268 INFO:teuthology.orchestra.run.smithi018.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T09:11:44.268 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T09:11:44.268 INFO:teuthology.orchestra.run.smithi018.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T09:11:44.269 INFO:teuthology.orchestra.run.smithi018.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T09:11:44.269 INFO:teuthology.orchestra.run.smithi018.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T09:11:44.269 INFO:teuthology.orchestra.run.smithi018.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T09:11:44.269 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T09:11:44.269 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T09:11:44.269 INFO:teuthology.orchestra.run.smithi018.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T09:11:44.269 INFO:teuthology.orchestra.run.smithi018.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T09:11:44.269 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T09:11:44.269 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T09:11:44.269 INFO:teuthology.orchestra.run.smithi018.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T09:11:44.269 INFO:teuthology.orchestra.run.smithi018.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T09:11:44.269 INFO:teuthology.orchestra.run.smithi018.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T09:11:44.269 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T09:11:44.270 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T09:11:44.270 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T09:11:44.270 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T09:11:44.270 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T09:11:44.270 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T09:11:44.270 INFO:teuthology.orchestra.run.smithi018.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T09:11:44.270 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T09:11:44.270 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T09:11:44.270 INFO:teuthology.orchestra.run.smithi018.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T09:11:44.270 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T09:11:44.270 INFO:teuthology.orchestra.run.smithi018.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T09:11:44.271 INFO:teuthology.orchestra.run.smithi018.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T09:11:44.271 INFO:teuthology.orchestra.run.smithi018.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T09:11:44.271 INFO:teuthology.orchestra.run.smithi018.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T09:11:44.271 INFO:teuthology.orchestra.run.smithi018.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T09:11:44.271 INFO:teuthology.orchestra.run.smithi018.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T09:11:44.271 INFO:teuthology.orchestra.run.smithi018.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T09:11:44.271 INFO:teuthology.orchestra.run.smithi018.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T09:11:44.271 INFO:teuthology.orchestra.run.smithi018.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T09:11:44.271 INFO:teuthology.orchestra.run.smithi018.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T09:11:44.271 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T09:11:44.272 INFO:teuthology.orchestra.run.smithi018.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T09:11:44.272 INFO:teuthology.orchestra.run.smithi018.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T09:11:44.272 INFO:teuthology.orchestra.run.smithi018.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T09:11:44.272 INFO:teuthology.orchestra.run.smithi018.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T09:11:44.272 INFO:teuthology.orchestra.run.smithi018.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T09:11:44.272 INFO:teuthology.orchestra.run.smithi018.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T09:11:44.272 INFO:teuthology.orchestra.run.smithi018.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T09:11:44.272 INFO:teuthology.orchestra.run.smithi018.stdout:Installing weak dependencies: 2024-09-19T09:11:44.272 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T09:11:44.272 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:11:44.272 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction Summary 2024-09-19T09:11:44.272 INFO:teuthology.orchestra.run.smithi018.stdout:====================================================================================== 2024-09-19T09:11:44.273 INFO:teuthology.orchestra.run.smithi018.stdout:Install 148 Packages 2024-09-19T09:11:44.273 INFO:teuthology.orchestra.run.smithi018.stdout:Upgrade 8 Packages 2024-09-19T09:11:44.273 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:11:44.273 INFO:teuthology.orchestra.run.smithi018.stdout:Total download size: 226 M 2024-09-19T09:11:44.273 INFO:teuthology.orchestra.run.smithi018.stdout:Downloading Packages: 2024-09-19T09:11:44.714 INFO:teuthology.orchestra.run.smithi018.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 53 kB/s | 6.6 kB 00:00 2024-09-19T09:11:44.931 INFO:teuthology.orchestra.run.smithi018.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 4.0 MB/s | 896 kB 00:00 2024-09-19T09:11:44.981 INFO:teuthology.orchestra.run.smithi018.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 2.8 MB/s | 145 kB 00:00 2024-09-19T09:11:45.273 INFO:teuthology.orchestra.run.smithi018.stdout:(4/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 8.2 MB/s | 2.4 MB 00:00 2024-09-19T09:11:45.409 INFO:teuthology.orchestra.run.smithi018.stdout:(5/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 6.6 MB/s | 5.4 MB 00:00 2024-09-19T09:11:45.474 INFO:teuthology.orchestra.run.smithi018.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 7.6 MB/s | 1.5 MB 00:00 2024-09-19T09:11:45.749 INFO:teuthology.orchestra.run.smithi018.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 14 MB/s | 4.7 MB 00:00 2024-09-19T09:11:45.826 INFO:teuthology.orchestra.run.smithi162.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:11:45.827 INFO:teuthology.orchestra.run.smithi162.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T09:11:45.840 INFO:teuthology.orchestra.run.smithi162.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T09:11:45.841 INFO:teuthology.orchestra.run.smithi162.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T09:11:45.842 INFO:teuthology.orchestra.run.smithi162.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T09:11:45.843 INFO:teuthology.orchestra.run.smithi162.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T09:11:45.845 INFO:teuthology.orchestra.run.smithi162.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T09:11:45.848 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T09:11:45.849 INFO:teuthology.orchestra.run.smithi162.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T09:11:45.912 INFO:teuthology.orchestra.run.smithi162.stdout:Dependencies resolved. 2024-09-19T09:11:45.927 INFO:teuthology.orchestra.run.smithi162.stdout:====================================================================================== 2024-09-19T09:11:45.927 INFO:teuthology.orchestra.run.smithi162.stdout: Package Arch Version Repository Size 2024-09-19T09:11:45.928 INFO:teuthology.orchestra.run.smithi162.stdout:====================================================================================== 2024-09-19T09:11:45.928 INFO:teuthology.orchestra.run.smithi162.stdout:Installing: 2024-09-19T09:11:45.928 INFO:teuthology.orchestra.run.smithi162.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T09:11:45.928 INFO:teuthology.orchestra.run.smithi162.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T09:11:45.928 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T09:11:45.928 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T09:11:45.928 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T09:11:45.928 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T09:11:45.928 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T09:11:45.929 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T09:11:45.929 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T09:11:45.929 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T09:11:45.929 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T09:11:45.929 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T09:11:45.929 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T09:11:45.929 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T09:11:45.929 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T09:11:45.929 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T09:11:45.929 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T09:11:45.930 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T09:11:45.930 INFO:teuthology.orchestra.run.smithi162.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T09:11:45.930 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T09:11:45.930 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T09:11:45.930 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T09:11:45.930 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T09:11:45.930 INFO:teuthology.orchestra.run.smithi162.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T09:11:45.930 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T09:11:45.930 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T09:11:45.930 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T09:11:45.931 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T09:11:45.931 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T09:11:45.931 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T09:11:45.931 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T09:11:45.931 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T09:11:45.931 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T09:11:45.931 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T09:11:45.931 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T09:11:45.931 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T09:11:45.931 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T09:11:45.931 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrading: 2024-09-19T09:11:45.932 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T09:11:45.932 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T09:11:45.932 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T09:11:45.932 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T09:11:45.932 INFO:teuthology.orchestra.run.smithi162.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T09:11:45.932 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T09:11:45.932 INFO:teuthology.orchestra.run.smithi162.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T09:11:45.932 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T09:11:45.932 INFO:teuthology.orchestra.run.smithi162.stdout:Installing dependencies: 2024-09-19T09:11:45.933 INFO:teuthology.orchestra.run.smithi162.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T09:11:45.933 INFO:teuthology.orchestra.run.smithi162.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T09:11:45.933 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T09:11:45.933 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T09:11:45.933 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T09:11:45.933 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T09:11:45.933 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T09:11:45.933 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T09:11:45.933 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T09:11:45.933 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T09:11:45.934 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T09:11:45.934 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T09:11:45.934 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T09:11:45.934 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T09:11:45.934 INFO:teuthology.orchestra.run.smithi162.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T09:11:45.934 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T09:11:45.934 INFO:teuthology.orchestra.run.smithi162.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T09:11:45.934 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T09:11:45.934 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T09:11:45.934 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T09:11:45.934 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T09:11:45.935 INFO:teuthology.orchestra.run.smithi162.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T09:11:45.935 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T09:11:45.935 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T09:11:45.935 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T09:11:45.935 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T09:11:45.935 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T09:11:45.935 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T09:11:45.935 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T09:11:45.935 INFO:teuthology.orchestra.run.smithi162.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T09:11:45.935 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T09:11:45.935 INFO:teuthology.orchestra.run.smithi162.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T09:11:45.936 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T09:11:45.936 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T09:11:45.936 INFO:teuthology.orchestra.run.smithi162.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T09:11:45.936 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T09:11:45.936 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T09:11:45.936 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T09:11:45.936 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T09:11:45.936 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T09:11:45.936 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T09:11:45.936 INFO:teuthology.orchestra.run.smithi162.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T09:11:45.937 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T09:11:45.937 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T09:11:45.937 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T09:11:45.937 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T09:11:45.937 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T09:11:45.937 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T09:11:45.937 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T09:11:45.937 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T09:11:45.937 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T09:11:45.938 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T09:11:45.938 INFO:teuthology.orchestra.run.smithi162.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T09:11:45.938 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T09:11:45.938 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T09:11:45.938 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T09:11:45.938 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T09:11:45.938 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T09:11:45.938 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T09:11:45.938 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T09:11:45.938 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T09:11:45.939 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T09:11:45.939 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T09:11:45.939 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T09:11:45.939 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T09:11:45.939 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T09:11:45.939 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T09:11:45.939 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T09:11:45.939 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T09:11:45.939 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T09:11:45.939 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T09:11:45.939 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T09:11:45.940 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T09:11:45.940 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T09:11:45.940 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T09:11:45.940 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T09:11:45.940 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T09:11:45.940 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T09:11:45.940 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T09:11:45.940 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T09:11:45.940 INFO:teuthology.orchestra.run.smithi162.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T09:11:45.941 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T09:11:45.941 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T09:11:45.941 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T09:11:45.941 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T09:11:45.941 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T09:11:45.941 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T09:11:45.941 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T09:11:45.941 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T09:11:45.941 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T09:11:45.941 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T09:11:45.941 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T09:11:45.942 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T09:11:45.942 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T09:11:45.942 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T09:11:45.942 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T09:11:45.942 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T09:11:45.942 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T09:11:45.942 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T09:11:45.942 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T09:11:45.942 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T09:11:45.942 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T09:11:45.942 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T09:11:45.943 INFO:teuthology.orchestra.run.smithi162.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T09:11:45.943 INFO:teuthology.orchestra.run.smithi162.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T09:11:45.943 INFO:teuthology.orchestra.run.smithi162.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T09:11:45.943 INFO:teuthology.orchestra.run.smithi162.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T09:11:45.943 INFO:teuthology.orchestra.run.smithi162.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T09:11:45.943 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T09:11:45.943 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T09:11:45.943 INFO:teuthology.orchestra.run.smithi162.stdout:Installing weak dependencies: 2024-09-19T09:11:45.943 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T09:11:45.943 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:11:45.943 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction Summary 2024-09-19T09:11:45.944 INFO:teuthology.orchestra.run.smithi162.stdout:====================================================================================== 2024-09-19T09:11:45.944 INFO:teuthology.orchestra.run.smithi162.stdout:Install 148 Packages 2024-09-19T09:11:45.944 INFO:teuthology.orchestra.run.smithi162.stdout:Upgrade 8 Packages 2024-09-19T09:11:45.944 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:11:45.944 INFO:teuthology.orchestra.run.smithi162.stdout:Total download size: 226 M 2024-09-19T09:11:45.945 INFO:teuthology.orchestra.run.smithi162.stdout:Downloading Packages: 2024-09-19T09:11:46.316 INFO:teuthology.orchestra.run.smithi018.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 12 MB/s | 21 MB 00:01 2024-09-19T09:11:46.366 INFO:teuthology.orchestra.run.smithi018.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 504 kB/s | 25 kB 00:00 2024-09-19T09:11:46.483 INFO:teuthology.orchestra.run.smithi018.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 14 MB/s | 11 MB 00:00 2024-09-19T09:11:46.683 INFO:teuthology.orchestra.run.smithi018.stdout:(11/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 14 MB/s | 17 MB 00:01 2024-09-19T09:11:46.708 INFO:teuthology.orchestra.run.smithi018.stdout:(12/156): cephfs-mirror-19.1.1-361.g2f599a46.el 1.0 MB/s | 228 kB 00:00 2024-09-19T09:11:46.734 INFO:teuthology.orchestra.run.smithi018.stdout:(13/156): cephfs-shell-19.1.1-361.g2f599a46.el9 539 kB/s | 27 kB 00:00 2024-09-19T09:11:46.759 INFO:teuthology.orchestra.run.smithi018.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 631 kB/s | 32 kB 00:00 2024-09-19T09:11:46.801 INFO:teuthology.orchestra.run.smithi018.stdout:(15/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 11 MB/s | 751 kB 00:00 2024-09-19T09:11:46.826 INFO:teuthology.orchestra.run.smithi018.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.4 MB/s | 163 kB 00:00 2024-09-19T09:11:46.851 INFO:teuthology.orchestra.run.smithi018.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 2.5 MB/s | 127 kB 00:00 2024-09-19T09:11:46.865 INFO:teuthology.orchestra.run.smithi162.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 52 kB/s | 6.6 kB 00:00 2024-09-19T09:11:46.893 INFO:teuthology.orchestra.run.smithi018.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 7.4 MB/s | 506 kB 00:00 2024-09-19T09:11:46.961 INFO:teuthology.orchestra.run.smithi018.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 676 kB/s | 45 kB 00:00 2024-09-19T09:11:47.036 INFO:teuthology.orchestra.run.smithi018.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.8 MB/s | 136 kB 00:00 2024-09-19T09:11:47.136 INFO:teuthology.orchestra.run.smithi018.stdout:(21/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 19 MB/s | 5.3 MB 00:00 2024-09-19T09:11:47.161 INFO:teuthology.orchestra.run.smithi018.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.3 MB/s | 161 kB 00:00 2024-09-19T09:11:47.195 INFO:teuthology.orchestra.run.smithi018.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 5.4 MB/s | 320 kB 00:00 2024-09-19T09:11:47.207 INFO:teuthology.orchestra.run.smithi162.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 2.6 MB/s | 896 kB 00:00 2024-09-19T09:11:47.220 INFO:teuthology.orchestra.run.smithi018.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.0 MB/s | 300 kB 00:00 2024-09-19T09:11:47.254 INFO:teuthology.orchestra.run.smithi018.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.7 MB/s | 99 kB 00:00 2024-09-19T09:11:47.257 INFO:teuthology.orchestra.run.smithi162.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 2.8 MB/s | 145 kB 00:00 2024-09-19T09:11:47.279 INFO:teuthology.orchestra.run.smithi018.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-19T09:11:47.354 INFO:teuthology.orchestra.run.smithi018.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.2 MB/s | 171 kB 00:00 2024-09-19T09:11:47.480 INFO:teuthology.orchestra.run.smithi018.stdout:(28/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 14 MB/s | 3.1 MB 00:00 2024-09-19T09:11:47.505 INFO:teuthology.orchestra.run.smithi018.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 212 kB/s | 32 kB 00:00 2024-09-19T09:11:47.555 INFO:teuthology.orchestra.run.smithi018.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.9 MB/s | 146 kB 00:00 2024-09-19T09:11:47.839 INFO:teuthology.orchestra.run.smithi018.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 11 MB/s | 3.6 MB 00:00 2024-09-19T09:11:47.857 INFO:teuthology.orchestra.run.smithi162.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 4.8 MB/s | 5.4 MB 00:01 2024-09-19T09:11:47.906 INFO:teuthology.orchestra.run.smithi018.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 3.7 MB/s | 249 kB 00:00 2024-09-19T09:11:47.941 INFO:teuthology.orchestra.run.smithi162.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 3.5 MB/s | 2.4 MB 00:00 2024-09-19T09:11:47.965 INFO:teuthology.orchestra.run.smithi018.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 845 kB/s | 49 kB 00:00 2024-09-19T09:11:48.040 INFO:teuthology.orchestra.run.smithi018.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 219 kB/s | 16 kB 00:00 2024-09-19T09:11:48.140 INFO:teuthology.orchestra.run.smithi018.stdout:(35/156): ceph-mgr-diskprediction-local-19.1.1- 13 MB/s | 7.4 MB 00:00 2024-09-19T09:11:48.158 INFO:teuthology.orchestra.run.smithi162.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 5.1 MB/s | 1.5 MB 00:00 2024-09-19T09:11:48.165 INFO:teuthology.orchestra.run.smithi018.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 2.2 MB/s | 285 kB 00:00 2024-09-19T09:11:48.224 INFO:teuthology.orchestra.run.smithi018.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 9.0 MB/s | 765 kB 00:00 2024-09-19T09:11:48.249 INFO:teuthology.orchestra.run.smithi018.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 219 kB/s | 18 kB 00:00 2024-09-19T09:11:48.358 INFO:teuthology.orchestra.run.smithi018.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 597 kB/s | 80 kB 00:00 2024-09-19T09:11:48.425 INFO:teuthology.orchestra.run.smithi018.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 191 kB 00:00 2024-09-19T09:11:48.458 INFO:teuthology.orchestra.run.smithi018.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.7 MB/s | 801 kB 00:00 2024-09-19T09:11:48.484 INFO:teuthology.orchestra.run.smithi018.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-19T09:11:48.534 INFO:teuthology.orchestra.run.smithi018.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 16 MB/s | 1.2 MB 00:00 2024-09-19T09:11:48.558 INFO:teuthology.orchestra.run.smithi162.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 7.6 MB/s | 4.7 MB 00:00 2024-09-19T09:11:48.559 INFO:teuthology.orchestra.run.smithi018.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-19T09:11:48.584 INFO:teuthology.orchestra.run.smithi018.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-19T09:11:48.610 INFO:teuthology.orchestra.run.smithi018.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-19T09:11:48.635 INFO:teuthology.orchestra.run.smithi018.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-19T09:11:48.881 INFO:teuthology.orchestra.run.smithi162.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 9.9 MB/s | 21 MB 00:02 2024-09-19T09:11:48.942 INFO:teuthology.orchestra.run.smithi162.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 407 kB/s | 25 kB 00:00 2024-09-19T09:11:49.186 INFO:teuthology.orchestra.run.smithi018.stdout:(48/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 17 MB/s | 49 MB 00:02 2024-09-19T09:11:49.294 INFO:teuthology.orchestra.run.smithi018.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 1.4 MB/s | 943 kB 00:00 2024-09-19T09:11:49.309 INFO:teuthology.orchestra.run.smithi162.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 14 MB/s | 11 MB 00:00 2024-09-19T09:11:49.319 INFO:teuthology.orchestra.run.smithi018.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 972 kB/s | 689 kB 00:00 2024-09-19T09:11:49.345 INFO:teuthology.orchestra.run.smithi018.stdout:(51/156): boost-program-options-1.75.0-8.el9.x8 674 kB/s | 107 kB 00:00 2024-09-19T09:11:49.359 INFO:teuthology.orchestra.run.smithi162.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 4.5 MB/s | 228 kB 00:00 2024-09-19T09:11:49.361 INFO:teuthology.orchestra.run.smithi018.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 324 kB/s | 22 kB 00:00 2024-09-19T09:11:49.403 INFO:teuthology.orchestra.run.smithi018.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 313 kB 00:00 2024-09-19T09:11:49.421 INFO:teuthology.orchestra.run.smithi018.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 558 kB/s | 33 kB 00:00 2024-09-19T09:11:49.426 INFO:teuthology.orchestra.run.smithi162.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 407 kB/s | 27 kB 00:00 2024-09-19T09:11:49.437 INFO:teuthology.orchestra.run.smithi018.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 543 kB/s | 18 kB 00:00 2024-09-19T09:11:49.454 INFO:teuthology.orchestra.run.smithi018.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 334 kB/s | 11 kB 00:00 2024-09-19T09:11:49.498 INFO:teuthology.orchestra.run.smithi162.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 475 kB/s | 32 kB 00:00 2024-09-19T09:11:49.498 INFO:teuthology.orchestra.run.smithi018.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-19T09:11:49.521 INFO:teuthology.orchestra.run.smithi018.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-09-19T09:11:49.585 INFO:teuthology.orchestra.run.smithi162.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 8.0 MB/s | 751 kB 00:00 2024-09-19T09:11:49.588 INFO:teuthology.orchestra.run.smithi018.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-09-19T09:11:49.630 INFO:teuthology.orchestra.run.smithi018.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.8 MB/s | 662 kB 00:00 2024-09-19T09:11:49.646 INFO:teuthology.orchestra.run.smithi162.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.6 MB/s | 163 kB 00:00 2024-09-19T09:11:49.656 INFO:teuthology.orchestra.run.smithi018.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 366 kB/s | 24 kB 00:00 2024-09-19T09:11:49.702 INFO:teuthology.orchestra.run.smithi018.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 3.2 MB/s | 581 kB 00:00 2024-09-19T09:11:49.721 INFO:teuthology.orchestra.run.smithi162.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 1.6 MB/s | 127 kB 00:00 2024-09-19T09:11:49.741 INFO:teuthology.orchestra.run.smithi018.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 431 kB/s | 47 kB 00:00 2024-09-19T09:11:49.796 INFO:teuthology.orchestra.run.smithi162.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 6.6 MB/s | 506 kB 00:00 2024-09-19T09:11:49.869 INFO:teuthology.orchestra.run.smithi018.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 1.1 MB/s | 188 kB 00:00 2024-09-19T09:11:49.899 INFO:teuthology.orchestra.run.smithi018.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 244 kB/s | 38 kB 00:00 2024-09-19T09:11:49.924 INFO:teuthology.orchestra.run.smithi018.stdout:(66/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.1 MB/s | 292 kB 00:00 2024-09-19T09:11:49.991 INFO:teuthology.orchestra.run.smithi018.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-09-19T09:11:50.066 INFO:teuthology.orchestra.run.smithi018.stdout:(68/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 27 MB/s | 4.4 MB 00:00 2024-09-19T09:11:50.108 INFO:teuthology.orchestra.run.smithi018.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 7.6 MB/s | 910 kB 00:00 2024-09-19T09:11:50.133 INFO:teuthology.orchestra.run.smithi018.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-19T09:11:50.192 INFO:teuthology.orchestra.run.smithi018.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-09-19T09:11:50.213 INFO:teuthology.orchestra.run.smithi162.stdout:(18/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 13 MB/s | 5.3 MB 00:00 2024-09-19T09:11:50.263 INFO:teuthology.orchestra.run.smithi162.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 905 kB/s | 45 kB 00:00 2024-09-19T09:11:50.275 INFO:teuthology.orchestra.run.smithi018.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 35 MB/s | 5.8 MB 00:00 2024-09-19T09:11:50.301 INFO:teuthology.orchestra.run.smithi018.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 807 kB/s | 87 kB 00:00 2024-09-19T09:11:50.376 INFO:teuthology.orchestra.run.smithi018.stdout:(74/156): openblas-openmp-0.3.26-2.el9.x86_64.r 9.8 MB/s | 4.9 MB 00:00 2024-09-19T09:11:50.401 INFO:teuthology.orchestra.run.smithi018.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 611 kB/s | 61 kB 00:00 2024-09-19T09:11:50.435 INFO:teuthology.orchestra.run.smithi018.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-19T09:11:50.460 INFO:teuthology.orchestra.run.smithi018.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-19T09:11:50.494 INFO:teuthology.orchestra.run.smithi018.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 439 kB/s | 26 kB 00:00 2024-09-19T09:11:50.519 INFO:teuthology.orchestra.run.smithi018.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 328 kB/s | 19 kB 00:00 2024-09-19T09:11:50.544 INFO:teuthology.orchestra.run.smithi018.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-19T09:11:50.570 INFO:teuthology.orchestra.run.smithi018.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 691 kB/s | 35 kB 00:00 2024-09-19T09:11:50.653 INFO:teuthology.orchestra.run.smithi018.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-19T09:11:50.678 INFO:teuthology.orchestra.run.smithi018.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-19T09:11:50.689 INFO:teuthology.orchestra.run.smithi162.stdout:(20/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 28 MB/s | 49 MB 00:01 2024-09-19T09:11:50.704 INFO:teuthology.orchestra.run.smithi018.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-19T09:11:50.714 INFO:teuthology.orchestra.run.smithi162.stdout:(21/156): python3-ceph-common-19.1.1-361.g2f599 302 kB/s | 136 kB 00:00 2024-09-19T09:11:50.730 INFO:teuthology.orchestra.run.smithi018.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-19T09:11:50.739 INFO:teuthology.orchestra.run.smithi162.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 3.2 MB/s | 161 kB 00:00 2024-09-19T09:11:50.754 INFO:teuthology.orchestra.run.smithi018.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 845 kB/s | 42 kB 00:00 2024-09-19T09:11:50.765 INFO:teuthology.orchestra.run.smithi162.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 6.2 MB/s | 320 kB 00:00 2024-09-19T09:11:50.779 INFO:teuthology.orchestra.run.smithi018.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-19T09:11:50.790 INFO:teuthology.orchestra.run.smithi162.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.8 MB/s | 300 kB 00:00 2024-09-19T09:11:50.805 INFO:teuthology.orchestra.run.smithi018.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-19T09:11:50.816 INFO:teuthology.orchestra.run.smithi162.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T09:11:50.830 INFO:teuthology.orchestra.run.smithi018.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 5.5 MB/s | 279 kB 00:00 2024-09-19T09:11:50.841 INFO:teuthology.orchestra.run.smithi162.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T09:11:50.847 INFO:teuthology.orchestra.run.smithi018.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-19T09:11:50.864 INFO:teuthology.orchestra.run.smithi018.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-09-19T09:11:50.939 INFO:teuthology.orchestra.run.smithi018.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 13 MB/s | 5.1 MB 00:00 2024-09-19T09:11:50.956 INFO:teuthology.orchestra.run.smithi018.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 451 kB/s | 42 kB 00:00 2024-09-19T09:11:50.973 INFO:teuthology.orchestra.run.smithi018.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-09-19T09:11:51.007 INFO:teuthology.orchestra.run.smithi018.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-19T09:11:51.008 INFO:teuthology.orchestra.run.smithi162.stdout:(27/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 5.9 MB/s | 17 MB 00:02 2024-09-19T09:11:51.032 INFO:teuthology.orchestra.run.smithi018.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 614 kB/s | 36 kB 00:00 2024-09-19T09:11:51.033 INFO:teuthology.orchestra.run.smithi162.stdout:(28/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 890 kB/s | 171 kB 00:00 2024-09-19T09:11:51.057 INFO:teuthology.orchestra.run.smithi018.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-19T09:11:51.058 INFO:teuthology.orchestra.run.smithi162.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 639 kB/s | 32 kB 00:00 2024-09-19T09:11:51.084 INFO:teuthology.orchestra.run.smithi162.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.9 MB/s | 146 kB 00:00 2024-09-19T09:11:51.108 INFO:teuthology.orchestra.run.smithi018.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 4.0 MB/s | 304 kB 00:00 2024-09-19T09:11:51.133 INFO:teuthology.orchestra.run.smithi018.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 768 kB/s | 58 kB 00:00 2024-09-19T09:11:51.158 INFO:teuthology.orchestra.run.smithi018.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-19T09:11:51.159 INFO:teuthology.orchestra.run.smithi162.stdout:(31/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 9.0 MB/s | 3.1 MB 00:00 2024-09-19T09:11:51.184 INFO:teuthology.orchestra.run.smithi018.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-19T09:11:51.209 INFO:teuthology.orchestra.run.smithi018.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-09-19T09:11:51.218 INFO:teuthology.orchestra.run.smithi162.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 4.2 MB/s | 249 kB 00:00 2024-09-19T09:11:51.276 INFO:teuthology.orchestra.run.smithi018.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-09-19T09:11:51.293 INFO:teuthology.orchestra.run.smithi162.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 661 kB/s | 49 kB 00:00 2024-09-19T09:11:51.326 INFO:teuthology.orchestra.run.smithi018.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-19T09:11:51.385 INFO:teuthology.orchestra.run.smithi162.stdout:(34/156): ceph-mgr-diskprediction-local-19.1.1- 25 MB/s | 7.4 MB 00:00 2024-09-19T09:11:51.410 INFO:teuthology.orchestra.run.smithi162.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 141 kB/s | 16 kB 00:00 2024-09-19T09:11:51.436 INFO:teuthology.orchestra.run.smithi162.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.6 MB/s | 285 kB 00:00 2024-09-19T09:11:51.477 INFO:teuthology.orchestra.run.smithi018.stdout:(105/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-09-19T09:11:51.477 INFO:teuthology.orchestra.run.smithi162.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 11 MB/s | 765 kB 00:00 2024-09-19T09:11:51.494 INFO:teuthology.orchestra.run.smithi162.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 312 kB/s | 18 kB 00:00 2024-09-19T09:11:51.510 INFO:teuthology.orchestra.run.smithi018.stdout:(106/156): gperftools-libs-2.9.1-3.el9.x86_64.r 1.6 MB/s | 308 kB 00:00 2024-09-19T09:11:51.545 INFO:teuthology.orchestra.run.smithi018.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.5 MB/s | 863 kB 00:00 2024-09-19T09:11:51.553 INFO:teuthology.orchestra.run.smithi162.stdout:(39/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 7.2 MB/s | 3.6 MB 00:00 2024-09-19T09:11:51.569 INFO:teuthology.orchestra.run.smithi018.stdout:(108/156): grpc-data-1.46.7-10.el9.noarch.rpm 212 kB/s | 19 kB 00:00 2024-09-19T09:11:51.602 INFO:teuthology.orchestra.run.smithi018.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T09:11:51.628 INFO:teuthology.orchestra.run.smithi018.stdout:(110/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 311 kB/s | 26 kB 00:00 2024-09-19T09:11:51.653 INFO:teuthology.orchestra.run.smithi018.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.4 MB/s | 67 kB 00:00 2024-09-19T09:11:51.670 INFO:teuthology.orchestra.run.smithi162.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 415 kB/s | 80 kB 00:00 2024-09-19T09:11:51.678 INFO:teuthology.orchestra.run.smithi018.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-19T09:11:51.721 INFO:teuthology.orchestra.run.smithi162.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-19T09:11:51.737 INFO:teuthology.orchestra.run.smithi018.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 9.2 MB/s | 548 kB 00:00 2024-09-19T09:11:51.762 INFO:teuthology.orchestra.run.smithi018.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T09:11:51.779 INFO:teuthology.orchestra.run.smithi162.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-19T09:11:51.796 INFO:teuthology.orchestra.run.smithi018.stdout:(115/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.8 MB/s | 839 kB 00:00 2024-09-19T09:11:51.821 INFO:teuthology.orchestra.run.smithi018.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 549 kB/s | 32 kB 00:00 2024-09-19T09:11:51.830 INFO:teuthology.orchestra.run.smithi162.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.3 MB/s | 801 kB 00:00 2024-09-19T09:11:51.846 INFO:teuthology.orchestra.run.smithi018.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-19T09:11:51.855 INFO:teuthology.orchestra.run.smithi162.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-19T09:11:51.871 INFO:teuthology.orchestra.run.smithi018.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-19T09:11:51.889 INFO:teuthology.orchestra.run.smithi162.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 7.3 MB/s | 1.2 MB 00:00 2024-09-19T09:11:51.905 INFO:teuthology.orchestra.run.smithi018.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-19T09:11:51.914 INFO:teuthology.orchestra.run.smithi162.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-09-19T09:11:51.930 INFO:teuthology.orchestra.run.smithi018.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-19T09:11:51.939 INFO:teuthology.orchestra.run.smithi162.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-19T09:11:51.955 INFO:teuthology.orchestra.run.smithi018.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T09:11:51.965 INFO:teuthology.orchestra.run.smithi162.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-19T09:11:51.981 INFO:teuthology.orchestra.run.smithi018.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-19T09:11:52.007 INFO:teuthology.orchestra.run.smithi018.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-09-19T09:11:52.032 INFO:teuthology.orchestra.run.smithi018.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 705 kB/s | 18 kB 00:00 2024-09-19T09:11:52.049 INFO:teuthology.orchestra.run.smithi018.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-19T09:11:52.066 INFO:teuthology.orchestra.run.smithi018.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 1.1 MB/s | 19 kB 00:00 2024-09-19T09:11:52.081 INFO:teuthology.orchestra.run.smithi162.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 919 kB/s | 107 kB 00:00 2024-09-19T09:11:52.082 INFO:teuthology.orchestra.run.smithi018.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-19T09:11:52.115 INFO:teuthology.orchestra.run.smithi162.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 3.4 MB/s | 689 kB 00:00 2024-09-19T09:11:52.141 INFO:teuthology.orchestra.run.smithi162.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 370 kB/s | 22 kB 00:00 2024-09-19T09:11:52.150 INFO:teuthology.orchestra.run.smithi018.stdout:(128/156): libarrow-9.0.0-11.el9.x86_64.rpm 6.9 MB/s | 4.4 MB 00:00 2024-09-19T09:11:52.166 INFO:teuthology.orchestra.run.smithi018.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 2.8 MB/s | 46 kB 00:00 2024-09-19T09:11:52.182 INFO:teuthology.orchestra.run.smithi162.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.8 MB/s | 943 kB 00:00 2024-09-19T09:11:52.192 INFO:teuthology.orchestra.run.smithi018.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T09:11:52.208 INFO:teuthology.orchestra.run.smithi162.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-09-19T09:11:52.233 INFO:teuthology.orchestra.run.smithi162.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 355 kB/s | 33 kB 00:00 2024-09-19T09:11:52.242 INFO:teuthology.orchestra.run.smithi018.stdout:(131/156): python3-grpcio-1.46.7-10.el9.x86_64. 6.5 MB/s | 2.0 MB 00:00 2024-09-19T09:11:52.267 INFO:teuthology.orchestra.run.smithi018.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 769 kB/s | 58 kB 00:00 2024-09-19T09:11:52.275 INFO:teuthology.orchestra.run.smithi162.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 440 kB/s | 18 kB 00:00 2024-09-19T09:11:52.300 INFO:teuthology.orchestra.run.smithi162.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 167 kB/s | 11 kB 00:00 2024-09-19T09:11:52.301 INFO:teuthology.orchestra.run.smithi018.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 4.7 MB/s | 1.0 MB 00:00 2024-09-19T09:11:52.326 INFO:teuthology.orchestra.run.smithi018.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 280 kB/s | 16 kB 00:00 2024-09-19T09:11:52.351 INFO:teuthology.orchestra.run.smithi162.stdout:(57/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 18 MB/s | 3.0 MB 00:00 2024-09-19T09:11:52.351 INFO:teuthology.orchestra.run.smithi018.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-09-19T09:11:52.376 INFO:teuthology.orchestra.run.smithi162.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-09-19T09:11:52.377 INFO:teuthology.orchestra.run.smithi018.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-09-19T09:11:52.401 INFO:teuthology.orchestra.run.smithi162.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 450 kB/s | 45 kB 00:00 2024-09-19T09:11:52.402 INFO:teuthology.orchestra.run.smithi018.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-19T09:11:52.427 INFO:teuthology.orchestra.run.smithi018.stdout:(138/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-09-19T09:11:52.434 INFO:teuthology.orchestra.run.smithi162.stdout:(60/156): libtool-2.4.6-46.el9.x86_64.rpm 9.7 MB/s | 581 kB 00:00 2024-09-19T09:11:52.453 INFO:teuthology.orchestra.run.smithi018.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-19T09:11:52.460 INFO:teuthology.orchestra.run.smithi162.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 417 kB/s | 24 kB 00:00 2024-09-19T09:11:52.478 INFO:teuthology.orchestra.run.smithi018.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-19T09:11:52.494 INFO:teuthology.orchestra.run.smithi162.stdout:(62/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.5 MB/s | 662 kB 00:00 2024-09-19T09:11:52.503 INFO:teuthology.orchestra.run.smithi018.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-19T09:11:52.519 INFO:teuthology.orchestra.run.smithi162.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 565 kB/s | 47 kB 00:00 2024-09-19T09:11:52.528 INFO:teuthology.orchestra.run.smithi018.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-19T09:11:52.545 INFO:teuthology.orchestra.run.smithi162.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-19T09:11:52.553 INFO:teuthology.orchestra.run.smithi018.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-19T09:11:52.569 INFO:teuthology.orchestra.run.smithi162.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 767 kB/s | 38 kB 00:00 2024-09-19T09:11:52.579 INFO:teuthology.orchestra.run.smithi018.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-19T09:11:52.594 INFO:teuthology.orchestra.run.smithi162.stdout:(66/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-19T09:11:52.604 INFO:teuthology.orchestra.run.smithi018.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-19T09:11:52.621 INFO:teuthology.orchestra.run.smithi018.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-19T09:11:52.646 INFO:teuthology.orchestra.run.smithi018.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-09-19T09:11:52.679 INFO:teuthology.orchestra.run.smithi162.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-19T09:11:52.730 INFO:teuthology.orchestra.run.smithi018.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-19T09:11:52.746 INFO:teuthology.orchestra.run.smithi162.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 25 MB/s | 4.9 MB 00:00 2024-09-19T09:11:52.779 INFO:teuthology.orchestra.run.smithi162.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 8.9 MB/s | 910 kB 00:00 2024-09-19T09:11:52.805 INFO:teuthology.orchestra.run.smithi162.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.3 MB/s | 137 kB 00:00 2024-09-19T09:11:52.847 INFO:teuthology.orchestra.run.smithi162.stdout:(71/156): postgresql-13.16-1.el9.x86_64.rpm 6.3 MB/s | 1.6 MB 00:00 2024-09-19T09:11:52.888 INFO:teuthology.orchestra.run.smithi162.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-09-19T09:11:52.905 INFO:teuthology.orchestra.run.smithi018.stdout:(149/156): librbd1-19.1.1-361.g2f599a46.el9.x86 12 MB/s | 3.2 MB 00:00 2024-09-19T09:11:52.914 INFO:teuthology.orchestra.run.smithi162.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-19T09:11:52.955 INFO:teuthology.orchestra.run.smithi018.stdout:(150/156): NetworkManager-1.51.0-1.el9.x86_64.r 10 MB/s | 2.3 MB 00:00 2024-09-19T09:11:52.956 INFO:teuthology.orchestra.run.smithi162.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-19T09:11:53.014 INFO:teuthology.orchestra.run.smithi018.stdout:(151/156): librados2-19.1.1-361.g2f599a46.el9.x 8.7 MB/s | 3.4 MB 00:00 2024-09-19T09:11:53.031 INFO:teuthology.orchestra.run.smithi018.stdout:(152/156): NetworkManager-team-1.51.0-1.el9.x86 545 kB/s | 41 kB 00:00 2024-09-19T09:11:53.031 INFO:teuthology.orchestra.run.smithi162.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-09-19T09:11:53.056 INFO:teuthology.orchestra.run.smithi162.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-19T09:11:53.082 INFO:teuthology.orchestra.run.smithi162.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-19T09:11:53.090 INFO:teuthology.orchestra.run.smithi018.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 23 MB/s | 1.4 MB 00:00 2024-09-19T09:11:53.107 INFO:teuthology.orchestra.run.smithi162.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 511 kB/s | 26 kB 00:00 2024-09-19T09:11:53.132 INFO:teuthology.orchestra.run.smithi018.stdout:(154/156): NetworkManager-libnm-1.51.0-1.el9.x8 8.0 MB/s | 1.8 MB 00:00 2024-09-19T09:11:53.132 INFO:teuthology.orchestra.run.smithi162.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-19T09:11:53.157 INFO:teuthology.orchestra.run.smithi018.stdout:(155/156): NetworkManager-tui-1.51.0-1.el9.x86_ 1.7 MB/s | 249 kB 00:00 2024-09-19T09:11:53.158 INFO:teuthology.orchestra.run.smithi162.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-19T09:11:53.183 INFO:teuthology.orchestra.run.smithi162.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-09-19T09:11:53.207 INFO:teuthology.orchestra.run.smithi018.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 20 MB/s | 2.4 MB 00:00 2024-09-19T09:11:53.214 INFO:teuthology.orchestra.run.smithi018.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:11:53.214 INFO:teuthology.orchestra.run.smithi018.stdout:Total 25 MB/s | 226 MB 00:08 2024-09-19T09:11:53.258 INFO:teuthology.orchestra.run.smithi162.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-19T09:11:53.283 INFO:teuthology.orchestra.run.smithi162.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-09-19T09:11:53.309 INFO:teuthology.orchestra.run.smithi162.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-19T09:11:53.334 INFO:teuthology.orchestra.run.smithi162.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-19T09:11:53.359 INFO:teuthology.orchestra.run.smithi162.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 840 kB/s | 42 kB 00:00 2024-09-19T09:11:53.385 INFO:teuthology.orchestra.run.smithi162.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-19T09:11:53.410 INFO:teuthology.orchestra.run.smithi162.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-19T09:11:53.444 INFO:teuthology.orchestra.run.smithi162.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.6 MB/s | 279 kB 00:00 2024-09-19T09:11:53.469 INFO:teuthology.orchestra.run.smithi162.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 872 kB/s | 51 kB 00:00 2024-09-19T09:11:53.494 INFO:teuthology.orchestra.run.smithi162.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-19T09:11:53.578 INFO:teuthology.orchestra.run.smithi162.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-19T09:11:53.603 INFO:teuthology.orchestra.run.smithi162.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 383 kB/s | 42 kB 00:00 2024-09-19T09:11:53.629 INFO:teuthology.orchestra.run.smithi162.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 878 kB/s | 44 kB 00:00 2024-09-19T09:11:53.654 INFO:teuthology.orchestra.run.smithi162.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-19T09:11:53.679 INFO:teuthology.orchestra.run.smithi162.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 714 kB/s | 36 kB 00:00 2024-09-19T09:11:53.705 INFO:teuthology.orchestra.run.smithi162.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-09-19T09:11:53.730 INFO:teuthology.orchestra.run.smithi162.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-19T09:11:53.772 INFO:teuthology.orchestra.run.smithi162.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 866 kB/s | 58 kB 00:00 2024-09-19T09:11:53.797 INFO:teuthology.orchestra.run.smithi162.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-09-19T09:11:53.822 INFO:teuthology.orchestra.run.smithi162.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-19T09:11:53.848 INFO:teuthology.orchestra.run.smithi162.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-09-19T09:11:54.065 INFO:teuthology.orchestra.run.smithi162.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 27 MB/s | 16 MB 00:00 2024-09-19T09:11:54.123 INFO:teuthology.orchestra.run.smithi162.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 9.3 MB/s | 548 kB 00:00 2024-09-19T09:11:54.165 INFO:teuthology.orchestra.run.smithi162.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 7.2 MB/s | 308 kB 00:00 2024-09-19T09:11:54.182 INFO:teuthology.orchestra.run.smithi162.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 1.2 MB/s | 19 kB 00:00 2024-09-19T09:11:54.308 INFO:teuthology.orchestra.run.smithi162.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-09-19T09:11:54.324 INFO:teuthology.orchestra.run.smithi162.stdout:(108/156): lua-devel-5.4.4-4.el9.x86_64.rpm 44 kB/s | 22 kB 00:00 2024-09-19T09:11:54.358 INFO:teuthology.orchestra.run.smithi162.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 519 kB/s | 26 kB 00:00 2024-09-19T09:11:54.384 INFO:teuthology.orchestra.run.smithi162.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.8 MB/s | 67 kB 00:00 2024-09-19T09:11:54.409 INFO:teuthology.orchestra.run.smithi162.stdout:(111/156): liboath-2.6.7-2.el9.x86_64.rpm 579 kB/s | 49 kB 00:00 2024-09-19T09:11:54.434 INFO:teuthology.orchestra.run.smithi162.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-19T09:11:54.454 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction check 2024-09-19T09:11:54.559 INFO:teuthology.orchestra.run.smithi162.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-09-19T09:11:54.585 INFO:teuthology.orchestra.run.smithi162.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T09:11:54.610 INFO:teuthology.orchestra.run.smithi162.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T09:11:54.622 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction check succeeded. 2024-09-19T09:11:54.622 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction test 2024-09-19T09:11:54.635 INFO:teuthology.orchestra.run.smithi162.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 567 kB/s | 14 kB 00:00 2024-09-19T09:11:54.661 INFO:teuthology.orchestra.run.smithi162.stdout:(117/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.3 MB/s | 839 kB 00:00 2024-09-19T09:11:54.686 INFO:teuthology.orchestra.run.smithi162.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-19T09:11:54.720 INFO:teuthology.orchestra.run.smithi162.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-19T09:11:54.753 INFO:teuthology.orchestra.run.smithi162.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-09-19T09:11:54.779 INFO:teuthology.orchestra.run.smithi162.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-19T09:11:54.804 INFO:teuthology.orchestra.run.smithi162.stdout:(122/156): protobuf-compiler-3.14.0-13.el9.x86_ 903 kB/s | 863 kB 00:00 2024-09-19T09:11:54.838 INFO:teuthology.orchestra.run.smithi162.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-09-19T09:11:54.863 INFO:teuthology.orchestra.run.smithi162.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 183 kB/s | 11 kB 00:00 2024-09-19T09:11:54.888 INFO:teuthology.orchestra.run.smithi162.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 368 kB/s | 18 kB 00:00 2024-09-19T09:11:54.913 INFO:teuthology.orchestra.run.smithi162.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 937 kB/s | 23 kB 00:00 2024-09-19T09:11:54.939 INFO:teuthology.orchestra.run.smithi162.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-19T09:11:54.964 INFO:teuthology.orchestra.run.smithi162.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-19T09:11:54.989 INFO:teuthology.orchestra.run.smithi162.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T09:11:55.015 INFO:teuthology.orchestra.run.smithi162.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T09:11:55.040 INFO:teuthology.orchestra.run.smithi162.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T09:11:55.074 INFO:teuthology.orchestra.run.smithi162.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-19T09:11:55.099 INFO:teuthology.orchestra.run.smithi162.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-19T09:11:55.124 INFO:teuthology.orchestra.run.smithi162.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-19T09:11:55.150 INFO:teuthology.orchestra.run.smithi162.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-19T09:11:55.183 INFO:teuthology.orchestra.run.smithi162.stdout:(136/156): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2024-09-19T09:11:55.209 INFO:teuthology.orchestra.run.smithi162.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 525 kB/s | 31 kB 00:00 2024-09-19T09:11:55.234 INFO:teuthology.orchestra.run.smithi162.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T09:11:55.259 INFO:teuthology.orchestra.run.smithi162.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-19T09:11:55.285 INFO:teuthology.orchestra.run.smithi162.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-19T09:11:55.310 INFO:teuthology.orchestra.run.smithi162.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-19T09:11:55.360 INFO:teuthology.orchestra.run.smithi162.stdout:(142/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.4 MB/s | 2.0 MB 00:00 2024-09-19T09:11:55.385 INFO:teuthology.orchestra.run.smithi162.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-09-19T09:11:55.411 INFO:teuthology.orchestra.run.smithi162.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-19T09:11:55.436 INFO:teuthology.orchestra.run.smithi162.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-19T09:11:55.467 INFO:teuthology.orchestra.run.smithi162.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.4 MB/s | 191 kB 00:00 2024-09-19T09:11:55.509 INFO:teuthology.orchestra.run.smithi162.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-19T09:11:55.559 INFO:teuthology.orchestra.run.smithi162.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-19T09:11:55.718 INFO:teuthology.orchestra.run.smithi162.stdout:(149/156): NetworkManager-1.51.0-1.el9.x86_64.r 15 MB/s | 2.3 MB 00:00 2024-09-19T09:11:55.785 INFO:teuthology.orchestra.run.smithi162.stdout:(150/156): NetworkManager-libnm-1.51.0-1.el9.x8 27 MB/s | 1.8 MB 00:00 2024-09-19T09:11:55.818 INFO:teuthology.orchestra.run.smithi162.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 1.2 MB/s | 41 kB 00:00 2024-09-19T09:11:55.877 INFO:teuthology.orchestra.run.smithi162.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 4.2 MB/s | 249 kB 00:00 2024-09-19T09:11:55.936 INFO:teuthology.orchestra.run.smithi162.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 23 MB/s | 1.4 MB 00:00 2024-09-19T09:11:55.986 INFO:teuthology.orchestra.run.smithi162.stdout:(154/156): librados2-19.1.1-361.g2f599a46.el9.x 6.6 MB/s | 3.4 MB 00:00 2024-09-19T09:11:56.045 INFO:teuthology.orchestra.run.smithi162.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 22 MB/s | 2.4 MB 00:00 2024-09-19T09:11:56.220 INFO:teuthology.orchestra.run.smithi162.stdout:(156/156): librbd1-19.1.1-361.g2f599a46.el9.x86 4.4 MB/s | 3.2 MB 00:00 2024-09-19T09:11:56.225 INFO:teuthology.orchestra.run.smithi162.stdout:-------------------------------------------------------------------------------- 2024-09-19T09:11:56.226 INFO:teuthology.orchestra.run.smithi162.stdout:Total 22 MB/s | 226 MB 00:10 2024-09-19T09:11:56.948 INFO:teuthology.orchestra.run.smithi018.stdout:Transaction test succeeded. 2024-09-19T09:11:56.948 INFO:teuthology.orchestra.run.smithi018.stdout:Running transaction 2024-09-19T09:11:57.471 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction check 2024-09-19T09:11:57.623 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction check succeeded. 2024-09-19T09:11:57.624 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction test 2024-09-19T09:11:59.915 INFO:teuthology.orchestra.run.smithi162.stdout:Transaction test succeeded. 2024-09-19T09:11:59.915 INFO:teuthology.orchestra.run.smithi162.stdout:Running transaction 2024-09-19T09:12:03.572 INFO:teuthology.orchestra.run.smithi018.stdout: Preparing : 1/1 2024-09-19T09:12:03.677 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T09:12:03.712 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T09:12:03.770 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T09:12:03.803 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T09:12:03.828 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T09:12:03.879 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T09:12:04.221 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T09:12:04.323 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:12:04.431 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:12:04.466 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:12:04.561 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:12:04.594 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:12:04.766 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T09:12:04.827 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T09:12:04.853 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:12:04.943 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:12:04.971 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:12:05.035 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:12:05.064 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:12:05.091 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:12:05.251 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:12:05.410 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:12:05.545 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T09:12:05.652 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:12:05.730 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:12:05.980 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:12:06.090 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T09:12:06.185 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T09:12:06.219 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T09:12:06.311 INFO:teuthology.orchestra.run.smithi162.stdout: Preparing : 1/1 2024-09-19T09:12:06.312 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T09:12:06.320 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T09:12:06.372 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T09:12:06.412 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T09:12:06.431 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T09:12:06.455 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T09:12:06.488 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T09:12:06.515 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T09:12:06.536 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T09:12:06.586 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T09:12:06.654 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T09:12:06.686 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T09:12:06.712 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T09:12:06.729 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T09:12:06.750 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T09:12:06.775 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T09:12:06.807 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T09:12:06.830 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T09:12:06.840 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T09:12:06.876 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T09:12:06.904 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T09:12:06.975 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T09:12:07.018 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T09:12:07.095 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T09:12:07.160 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T09:12:07.232 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T09:12:07.284 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:12:07.288 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T09:12:07.407 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:12:07.435 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:12:07.526 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:12:07.561 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:12:07.735 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T09:12:07.788 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T09:12:07.815 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:12:07.840 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T09:12:07.918 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:12:07.927 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T09:12:07.941 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:12:07.962 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T09:12:08.004 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T09:12:08.005 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T09:12:08.026 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:12:08.043 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T09:12:08.049 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T09:12:08.086 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T09:12:08.236 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:12:08.255 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T09:12:08.321 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T09:12:08.377 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T09:12:08.425 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T09:12:08.450 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T09:12:08.488 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T09:12:08.524 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T09:12:08.525 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T09:12:08.572 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T09:12:08.607 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T09:12:08.643 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:12:08.651 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T09:12:08.693 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T09:12:08.709 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:12:08.834 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T09:12:08.869 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T09:12:08.911 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T09:12:08.952 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T09:12:09.017 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T09:12:09.053 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T09:12:09.072 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T09:12:09.094 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T09:12:09.126 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T09:12:09.151 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T09:12:09.169 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T09:12:09.207 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T09:12:09.242 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T09:12:09.323 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T09:12:09.376 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T09:12:09.400 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T09:12:09.408 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T09:12:09.452 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T09:12:09.485 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T09:12:09.512 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T09:12:09.540 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T09:12:09.575 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T09:12:09.580 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T09:12:09.612 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T09:12:09.643 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T09:12:09.646 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T09:12:09.683 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T09:12:09.685 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T09:12:09.725 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T09:12:09.727 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T09:12:09.755 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T09:12:09.789 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T09:12:09.804 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T09:12:09.822 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T09:12:09.837 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T09:12:09.865 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T09:12:09.881 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T09:12:09.893 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T09:12:09.909 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T09:12:09.978 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T09:12:09.983 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T09:12:10.024 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T09:12:10.024 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T09:12:10.055 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T09:12:10.106 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T09:12:10.170 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T09:12:10.224 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T09:12:10.250 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T09:12:10.301 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T09:12:10.833 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T09:12:10.931 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T09:12:10.960 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T09:12:10.979 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T09:12:10.995 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T09:12:11.028 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T09:12:11.032 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T09:12:11.062 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T09:12:11.079 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T09:12:11.164 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T09:12:11.218 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T09:12:11.262 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T09:12:11.296 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T09:12:11.328 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T09:12:11.383 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T09:12:11.386 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T09:12:11.423 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T09:12:11.464 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T09:12:11.496 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T09:12:11.532 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T09:12:11.578 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T09:12:11.614 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T09:12:11.614 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T09:12:11.654 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T09:12:11.658 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T09:12:11.700 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T09:12:11.734 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T09:12:11.845 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T09:12:12.070 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T09:12:12.113 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T09:12:12.221 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T09:12:12.253 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T09:12:12.303 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T09:12:12.330 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T09:12:12.355 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T09:12:12.416 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T09:12:12.449 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T09:12:12.540 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T09:12:12.582 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T09:12:12.613 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T09:12:12.689 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T09:12:12.725 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T09:12:12.773 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T09:12:12.804 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T09:12:12.836 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T09:12:12.869 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T09:12:12.902 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T09:12:12.944 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T09:12:12.978 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T09:12:13.067 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T09:12:13.118 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T09:12:13.157 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T09:12:13.260 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T09:12:13.317 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T09:12:13.873 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T09:12:13.960 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T09:12:13.988 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T09:12:14.021 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T09:12:14.045 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T09:12:14.111 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T09:12:14.144 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T09:12:14.244 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T09:12:14.300 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T09:12:14.345 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T09:12:14.348 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T09:12:14.392 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:12:14.440 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T09:12:14.481 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T09:12:14.492 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:12:14.522 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T09:12:14.563 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T09:12:14.669 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T09:12:14.704 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T09:12:14.783 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T09:12:15.070 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T09:12:15.095 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:12:15.167 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:12:15.197 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T09:12:15.451 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T09:12:15.576 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T09:12:16.872 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T09:12:16.960 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T09:12:16.996 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T09:12:17.038 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T09:12:17.359 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T09:12:17.400 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:12:17.490 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T09:12:17.586 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:12:17.606 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T09:12:17.620 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:12:17.642 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T09:12:18.127 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T09:12:18.154 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:12:18.198 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:12:18.225 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T09:12:18.240 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:12:18.256 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T09:12:18.332 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:12:18.332 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T09:12:18.332 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T09:12:18.332 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:12:18.366 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:12:20.972 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:12:21.003 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:12:21.556 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T09:12:21.598 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:12:21.678 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T09:12:21.678 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T09:12:21.678 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T09:12:21.678 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:12:21.716 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:12:30.916 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:12:30.917 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /sys 2024-09-19T09:12:30.917 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /proc 2024-09-19T09:12:30.917 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /mnt 2024-09-19T09:12:30.917 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /var/tmp 2024-09-19T09:12:30.917 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /home 2024-09-19T09:12:30.917 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /root 2024-09-19T09:12:30.917 INFO:teuthology.orchestra.run.smithi018.stdout:skipping the directory /tmp 2024-09-19T09:12:30.917 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:12:31.095 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:12:31.113 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:12:31.113 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:12:31.114 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T09:12:31.114 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:12:32.690 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:12:32.718 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:12:32.718 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:12:32.718 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T09:12:32.718 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:12:32.718 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:12:32.719 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:12:32.965 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:12:32.991 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:12:32.991 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:12:32.991 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T09:12:32.991 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:12:32.991 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:12:32.991 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:12:33.450 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:12:33.474 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:12:33.474 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:12:33.475 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T09:12:33.475 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:12:33.475 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:12:33.475 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:12:33.581 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T09:12:33.639 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T09:12:33.702 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T09:12:33.869 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T09:12:33.869 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /sys 2024-09-19T09:12:33.870 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /proc 2024-09-19T09:12:33.870 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /mnt 2024-09-19T09:12:33.870 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /var/tmp 2024-09-19T09:12:33.870 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /home 2024-09-19T09:12:33.870 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /root 2024-09-19T09:12:33.870 INFO:teuthology.orchestra.run.smithi162.stdout:skipping the directory /tmp 2024-09-19T09:12:33.870 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:12:33.897 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T09:12:33.951 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T09:12:34.032 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T09:12:34.039 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:12:34.055 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T09:12:34.055 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:12:34.055 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T09:12:34.055 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:12:34.121 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T09:12:34.272 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T09:12:34.328 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T09:12:34.366 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T09:12:34.394 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T09:12:34.841 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:12:34.859 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:12:34.882 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T09:12:34.947 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T09:12:34.973 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:12:35.541 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:12:35.570 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T09:12:35.570 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:12:35.570 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T09:12:35.570 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:12:35.570 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T09:12:35.570 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:12:35.809 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:12:35.834 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T09:12:35.834 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:12:35.834 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T09:12:35.834 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:12:35.834 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T09:12:35.834 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:12:36.082 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:12:36.125 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:12:36.279 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:12:36.302 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T09:12:36.302 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:12:36.302 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T09:12:36.302 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:12:36.303 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T09:12:36.303 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:12:36.408 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T09:12:36.466 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T09:12:36.521 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T09:12:36.716 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T09:12:36.763 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T09:12:36.840 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T09:12:36.929 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T09:12:37.078 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T09:12:37.135 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T09:12:37.141 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:12:37.170 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T09:12:37.176 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:12:37.198 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T09:12:37.285 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:12:37.446 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T09:12:37.469 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:12:37.495 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:12:37.495 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:12:37.495 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T09:12:37.495 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:12:37.495 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:12:37.495 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:12:37.545 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:12:37.559 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:12:37.645 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:12:37.668 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T09:12:37.672 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T09:12:37.704 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T09:12:37.726 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T09:12:37.766 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T09:12:37.795 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:12:38.705 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T09:12:38.739 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:12:38.764 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:12:38.764 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:12:38.765 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T09:12:38.765 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:12:38.765 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:12:38.765 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:12:38.806 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:12:38.831 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:12:38.831 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:12:38.831 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T09:12:38.831 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:12:38.853 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T09:12:38.882 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:12:38.889 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:12:38.907 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:12:38.907 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:12:38.907 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T09:12:38.907 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:12:38.908 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:12:38.908 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:12:39.225 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:12:39.249 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:12:39.250 INFO:teuthology.orchestra.run.smithi018.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:12:39.250 INFO:teuthology.orchestra.run.smithi018.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T09:12:39.250 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:12:39.250 INFO:teuthology.orchestra.run.smithi018.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:12:39.250 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:12:39.853 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T09:12:39.881 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:12:39.983 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T09:12:40.144 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T09:12:40.175 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:12:40.199 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T09:12:40.200 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:12:40.200 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T09:12:40.200 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:12:40.200 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T09:12:40.200 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:12:40.251 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:12:40.264 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T09:12:40.363 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T09:12:40.432 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T09:12:41.358 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T09:12:41.387 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:12:41.411 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T09:12:41.411 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:12:41.412 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T09:12:41.412 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:12:41.412 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T09:12:41.412 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:12:41.454 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:12:41.478 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T09:12:41.478 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:12:41.478 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T09:12:41.478 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:12:41.538 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:12:41.563 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T09:12:41.563 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:12:41.563 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T09:12:41.563 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:12:41.563 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T09:12:41.563 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:12:41.873 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:12:41.897 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T09:12:41.900 INFO:teuthology.orchestra.run.smithi162.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T09:12:41.901 INFO:teuthology.orchestra.run.smithi162.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T09:12:41.901 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:12:41.901 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T09:12:41.901 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:12:44.104 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T09:12:44.145 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T09:12:44.195 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T09:12:44.226 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T09:12:44.253 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T09:12:44.453 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T09:12:44.533 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T09:12:44.564 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T09:12:44.600 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T09:12:44.648 INFO:teuthology.orchestra.run.smithi018.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T09:12:45.263 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:12:45.338 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:12:45.360 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:12:46.269 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T09:12:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T09:12:46.431 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T09:12:46.468 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T09:12:46.509 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T09:12:46.530 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T09:12:46.559 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T09:12:46.573 INFO:teuthology.orchestra.run.smithi018.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T09:12:46.591 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T09:12:46.596 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T09:12:46.618 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T09:12:46.639 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T09:12:46.639 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:12:46.739 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:12:46.740 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:12:46.824 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:12:46.826 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T09:12:46.849 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T09:12:46.854 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:12:46.855 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:12:46.873 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T09:12:46.904 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T09:12:46.934 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T09:12:46.980 INFO:teuthology.orchestra.run.smithi162.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T09:12:47.042 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:12:47.042 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:12:47.118 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:12:47.194 INFO:teuthology.orchestra.run.smithi018.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:12:47.560 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:12:47.603 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:12:47.624 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T09:12:48.474 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T09:12:48.568 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T09:12:48.612 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T09:12:48.716 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T09:12:48.746 INFO:teuthology.orchestra.run.smithi162.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T09:12:48.771 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T09:12:48.797 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T09:12:48.797 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:12:48.890 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T09:12:48.890 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:12:48.974 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T09:12:48.999 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T09:12:49.005 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:12:49.005 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:12:49.185 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T09:12:49.185 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:12:49.285 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T09:12:49.350 INFO:teuthology.orchestra.run.smithi162.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:12:52.730 INFO:teuthology.orchestra.run.smithi018.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:12:52.730 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T09:12:52.730 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T09:12:52.730 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T09:12:52.730 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T09:12:52.730 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T09:12:52.730 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T09:12:52.730 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T09:12:52.730 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:12:52.731 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:12:52.731 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:12:52.731 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T09:12:52.731 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T09:12:52.731 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:12:52.731 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T09:12:52.731 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T09:12:52.731 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T09:12:52.731 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T09:12:52.731 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T09:12:52.731 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T09:12:52.731 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T09:12:52.731 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T09:12:52.732 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T09:12:52.732 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T09:12:52.732 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T09:12:52.732 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T09:12:52.732 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T09:12:52.732 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T09:12:52.732 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T09:12:52.732 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T09:12:52.732 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T09:12:52.746 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T09:12:52.747 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T09:12:52.747 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T09:12:52.747 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T09:12:52.747 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T09:12:52.747 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T09:12:52.748 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T09:12:52.748 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T09:12:52.748 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T09:12:52.748 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T09:12:52.748 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T09:12:52.748 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T09:12:52.749 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T09:12:52.749 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T09:12:52.749 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T09:12:52.749 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T09:12:52.749 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T09:12:52.749 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T09:12:52.749 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T09:12:52.749 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T09:12:52.749 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T09:12:52.750 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T09:12:52.750 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T09:12:52.750 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T09:12:52.750 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T09:12:52.750 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T09:12:52.750 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T09:12:52.750 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T09:12:52.750 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T09:12:52.750 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T09:12:52.750 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T09:12:52.750 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T09:12:52.750 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T09:12:52.751 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T09:12:52.751 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T09:12:52.751 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T09:12:52.751 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T09:12:52.751 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T09:12:52.751 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T09:12:52.751 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T09:12:52.751 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T09:12:52.751 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T09:12:52.751 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T09:12:52.751 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T09:12:52.751 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T09:12:52.751 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T09:12:52.752 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T09:12:52.752 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T09:12:52.752 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T09:12:52.752 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T09:12:52.752 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T09:12:52.752 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T09:12:52.752 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T09:12:52.752 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T09:12:52.752 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T09:12:52.752 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T09:12:52.752 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T09:12:52.752 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T09:12:52.752 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T09:12:52.753 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T09:12:52.753 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T09:12:52.753 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T09:12:52.753 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T09:12:52.753 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T09:12:52.753 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T09:12:52.753 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T09:12:52.754 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T09:12:52.754 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T09:12:52.754 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T09:12:52.754 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T09:12:52.754 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T09:12:52.754 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T09:12:52.755 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T09:12:52.755 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T09:12:52.755 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T09:12:52.755 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T09:12:52.755 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T09:12:52.755 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T09:12:52.756 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T09:12:52.756 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T09:12:52.756 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T09:12:52.756 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T09:12:52.756 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T09:12:52.756 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T09:12:52.756 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T09:12:52.756 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T09:12:52.756 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T09:12:52.757 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T09:12:52.757 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T09:12:52.757 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T09:12:52.757 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T09:12:52.757 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T09:12:52.757 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T09:12:52.758 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T09:12:52.758 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T09:12:52.758 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T09:12:52.758 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T09:12:52.758 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T09:12:52.758 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T09:12:52.759 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T09:12:52.759 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T09:12:52.759 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T09:12:52.759 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T09:12:52.759 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T09:12:52.759 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T09:12:52.759 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T09:12:52.759 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T09:12:52.760 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T09:12:52.760 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T09:12:52.760 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T09:12:52.760 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T09:12:52.760 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T09:12:52.760 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T09:12:52.760 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T09:12:52.760 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T09:12:52.760 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T09:12:52.760 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T09:12:52.760 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T09:12:52.760 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T09:12:52.761 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T09:12:52.761 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T09:12:52.761 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T09:12:52.761 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T09:12:52.761 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T09:12:52.761 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T09:12:52.761 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T09:12:52.761 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T09:12:52.761 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T09:12:52.761 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T09:12:52.761 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T09:12:52.764 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T09:12:52.764 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T09:12:52.764 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T09:12:55.254 INFO:teuthology.orchestra.run.smithi162.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:12:55.254 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T09:12:55.254 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T09:12:55.255 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T09:12:55.255 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T09:12:55.255 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T09:12:55.255 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T09:12:55.255 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T09:12:55.255 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T09:12:55.255 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T09:12:55.255 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T09:12:55.255 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T09:12:55.255 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T09:12:55.255 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T09:12:55.255 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T09:12:55.255 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T09:12:55.256 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T09:12:55.256 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T09:12:55.256 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T09:12:55.256 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T09:12:55.256 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T09:12:55.256 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T09:12:55.256 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T09:12:55.256 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T09:12:55.256 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T09:12:55.256 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T09:12:55.256 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T09:12:55.256 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T09:12:55.256 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T09:12:55.257 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T09:12:55.257 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T09:12:55.257 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T09:12:55.257 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T09:12:55.269 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T09:12:55.269 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T09:12:55.269 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T09:12:55.269 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T09:12:55.269 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T09:12:55.269 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T09:12:55.270 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T09:12:55.270 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T09:12:55.270 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T09:12:55.270 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T09:12:55.270 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T09:12:55.270 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T09:12:55.270 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T09:12:55.270 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T09:12:55.270 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T09:12:55.270 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T09:12:55.270 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T09:12:55.270 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T09:12:55.270 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T09:12:55.270 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T09:12:55.271 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T09:12:55.271 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T09:12:55.271 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T09:12:55.271 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T09:12:55.271 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T09:12:55.271 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T09:12:55.271 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T09:12:55.271 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T09:12:55.271 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T09:12:55.271 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T09:12:55.271 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T09:12:55.271 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T09:12:55.271 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T09:12:55.272 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T09:12:55.272 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T09:12:55.272 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T09:12:55.272 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T09:12:55.272 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T09:12:55.272 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T09:12:55.272 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T09:12:55.272 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T09:12:55.273 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T09:12:55.273 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T09:12:55.273 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T09:12:55.273 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T09:12:55.273 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T09:12:55.273 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T09:12:55.273 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T09:12:55.273 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T09:12:55.273 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T09:12:55.273 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T09:12:55.273 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T09:12:55.273 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T09:12:55.273 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T09:12:55.274 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T09:12:55.274 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T09:12:55.274 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T09:12:55.274 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T09:12:55.274 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T09:12:55.274 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T09:12:55.274 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T09:12:55.274 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T09:12:55.274 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T09:12:55.274 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T09:12:55.274 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T09:12:55.274 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T09:12:55.274 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T09:12:55.274 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T09:12:55.275 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T09:12:55.275 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T09:12:55.275 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T09:12:55.275 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T09:12:55.275 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T09:12:55.275 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T09:12:55.275 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T09:12:55.275 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T09:12:55.275 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T09:12:55.275 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T09:12:55.275 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T09:12:55.275 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T09:12:55.275 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T09:12:55.275 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T09:12:55.276 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T09:12:55.276 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T09:12:55.276 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T09:12:55.276 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T09:12:55.276 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T09:12:55.276 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T09:12:55.276 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T09:12:55.276 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T09:12:55.276 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T09:12:55.276 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T09:12:55.276 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T09:12:55.276 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T09:12:55.276 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T09:12:55.277 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T09:12:55.277 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T09:12:55.277 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T09:12:55.277 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T09:12:55.277 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T09:12:55.277 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T09:12:55.277 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T09:12:55.277 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T09:12:55.277 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T09:12:55.277 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T09:12:55.277 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T09:12:55.277 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T09:12:55.277 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T09:12:55.278 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T09:12:55.278 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T09:12:55.278 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T09:12:55.278 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T09:12:55.278 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T09:12:55.278 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T09:12:55.278 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T09:12:55.278 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T09:12:55.278 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T09:12:55.278 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T09:12:55.278 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T09:12:55.278 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T09:12:55.278 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T09:12:55.278 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T09:12:55.279 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T09:12:55.279 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T09:12:55.279 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T09:12:55.279 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T09:12:55.279 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T09:12:55.279 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T09:12:55.279 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T09:12:55.279 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T09:12:55.279 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T09:12:55.287 INFO:teuthology.orchestra.run.smithi018.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:12:55.287 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:12:55.287 INFO:teuthology.orchestra.run.smithi018.stdout:Upgraded: 2024-09-19T09:12:55.287 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T09:12:55.287 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T09:12:55.287 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T09:12:55.288 INFO:teuthology.orchestra.run.smithi018.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T09:12:55.288 INFO:teuthology.orchestra.run.smithi018.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:55.288 INFO:teuthology.orchestra.run.smithi018.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:55.288 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T09:12:55.288 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T09:12:55.288 INFO:teuthology.orchestra.run.smithi018.stdout:Installed: 2024-09-19T09:12:55.288 INFO:teuthology.orchestra.run.smithi018.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T09:12:55.288 INFO:teuthology.orchestra.run.smithi018.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T09:12:55.288 INFO:teuthology.orchestra.run.smithi018.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T09:12:55.288 INFO:teuthology.orchestra.run.smithi018.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T09:12:55.288 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:55.288 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:55.289 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:55.289 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:55.289 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:12:55.289 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:55.289 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:55.289 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:55.289 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:12:55.289 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:12:55.289 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:12:55.289 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:12:55.289 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:12:55.289 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:55.289 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:55.289 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:12:55.290 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:55.290 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:55.290 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:55.290 INFO:teuthology.orchestra.run.smithi018.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:12:55.290 INFO:teuthology.orchestra.run.smithi018.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:12:55.290 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:55.290 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:55.290 INFO:teuthology.orchestra.run.smithi018.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:12:55.290 INFO:teuthology.orchestra.run.smithi018.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T09:12:55.290 INFO:teuthology.orchestra.run.smithi018.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T09:12:55.291 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T09:12:55.291 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T09:12:55.291 INFO:teuthology.orchestra.run.smithi018.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T09:12:55.291 INFO:teuthology.orchestra.run.smithi018.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T09:12:55.291 INFO:teuthology.orchestra.run.smithi018.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T09:12:55.291 INFO:teuthology.orchestra.run.smithi018.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T09:12:55.291 INFO:teuthology.orchestra.run.smithi018.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T09:12:55.291 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T09:12:55.291 INFO:teuthology.orchestra.run.smithi018.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T09:12:55.291 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:55.291 INFO:teuthology.orchestra.run.smithi018.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:55.291 INFO:teuthology.orchestra.run.smithi018.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:55.292 INFO:teuthology.orchestra.run.smithi018.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T09:12:55.292 INFO:teuthology.orchestra.run.smithi018.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T09:12:55.292 INFO:teuthology.orchestra.run.smithi018.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T09:12:55.292 INFO:teuthology.orchestra.run.smithi018.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T09:12:55.292 INFO:teuthology.orchestra.run.smithi018.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T09:12:55.292 INFO:teuthology.orchestra.run.smithi018.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:55.292 INFO:teuthology.orchestra.run.smithi018.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:55.292 INFO:teuthology.orchestra.run.smithi018.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T09:12:55.292 INFO:teuthology.orchestra.run.smithi018.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:55.292 INFO:teuthology.orchestra.run.smithi018.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T09:12:55.292 INFO:teuthology.orchestra.run.smithi018.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T09:12:55.292 INFO:teuthology.orchestra.run.smithi018.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T09:12:55.292 INFO:teuthology.orchestra.run.smithi018.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T09:12:55.293 INFO:teuthology.orchestra.run.smithi018.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T09:12:55.293 INFO:teuthology.orchestra.run.smithi018.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T09:12:55.293 INFO:teuthology.orchestra.run.smithi018.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T09:12:55.293 INFO:teuthology.orchestra.run.smithi018.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T09:12:55.293 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T09:12:55.293 INFO:teuthology.orchestra.run.smithi018.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T09:12:55.293 INFO:teuthology.orchestra.run.smithi018.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T09:12:55.293 INFO:teuthology.orchestra.run.smithi018.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T09:12:55.293 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T09:12:55.293 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T09:12:55.293 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T09:12:55.293 INFO:teuthology.orchestra.run.smithi018.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T09:12:55.294 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T09:12:55.294 INFO:teuthology.orchestra.run.smithi018.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T09:12:55.294 INFO:teuthology.orchestra.run.smithi018.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T09:12:55.294 INFO:teuthology.orchestra.run.smithi018.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T09:12:55.294 INFO:teuthology.orchestra.run.smithi018.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T09:12:55.294 INFO:teuthology.orchestra.run.smithi018.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T09:12:55.294 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T09:12:55.294 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:55.294 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:55.294 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:55.294 INFO:teuthology.orchestra.run.smithi018.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T09:12:55.294 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T09:12:55.295 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T09:12:55.295 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T09:12:55.295 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T09:12:55.295 INFO:teuthology.orchestra.run.smithi018.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T09:12:55.295 INFO:teuthology.orchestra.run.smithi018.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T09:12:55.295 INFO:teuthology.orchestra.run.smithi018.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T09:12:55.295 INFO:teuthology.orchestra.run.smithi018.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T09:12:55.295 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T09:12:55.295 INFO:teuthology.orchestra.run.smithi018.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T09:12:55.295 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T09:12:55.295 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T09:12:55.295 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T09:12:55.295 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T09:12:55.296 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T09:12:55.296 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T09:12:55.296 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T09:12:55.296 INFO:teuthology.orchestra.run.smithi018.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T09:12:55.296 INFO:teuthology.orchestra.run.smithi018.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T09:12:55.296 INFO:teuthology.orchestra.run.smithi018.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T09:12:55.296 INFO:teuthology.orchestra.run.smithi018.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T09:12:55.296 INFO:teuthology.orchestra.run.smithi018.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T09:12:55.296 INFO:teuthology.orchestra.run.smithi018.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T09:12:55.296 INFO:teuthology.orchestra.run.smithi018.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T09:12:55.296 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T09:12:55.296 INFO:teuthology.orchestra.run.smithi018.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T09:12:55.296 INFO:teuthology.orchestra.run.smithi018.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T09:12:55.296 INFO:teuthology.orchestra.run.smithi018.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T09:12:55.297 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T09:12:55.297 INFO:teuthology.orchestra.run.smithi018.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T09:12:55.297 INFO:teuthology.orchestra.run.smithi018.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T09:12:55.297 INFO:teuthology.orchestra.run.smithi018.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T09:12:55.297 INFO:teuthology.orchestra.run.smithi018.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T09:12:55.297 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T09:12:55.297 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T09:12:55.297 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T09:12:55.297 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T09:12:55.297 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T09:12:55.297 INFO:teuthology.orchestra.run.smithi018.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T09:12:55.297 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:55.297 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:55.298 INFO:teuthology.orchestra.run.smithi018.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T09:12:55.298 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T09:12:55.298 INFO:teuthology.orchestra.run.smithi018.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T09:12:55.298 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:55.298 INFO:teuthology.orchestra.run.smithi018.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T09:12:55.298 INFO:teuthology.orchestra.run.smithi018.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T09:12:55.298 INFO:teuthology.orchestra.run.smithi018.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T09:12:55.298 INFO:teuthology.orchestra.run.smithi018.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T09:12:55.298 INFO:teuthology.orchestra.run.smithi018.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T09:12:55.298 INFO:teuthology.orchestra.run.smithi018.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T09:12:55.298 INFO:teuthology.orchestra.run.smithi018.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T09:12:55.299 INFO:teuthology.orchestra.run.smithi018.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T09:12:55.299 INFO:teuthology.orchestra.run.smithi018.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T09:12:55.299 INFO:teuthology.orchestra.run.smithi018.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T09:12:55.299 INFO:teuthology.orchestra.run.smithi018.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T09:12:55.299 INFO:teuthology.orchestra.run.smithi018.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T09:12:55.299 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T09:12:55.299 INFO:teuthology.orchestra.run.smithi018.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T09:12:55.299 INFO:teuthology.orchestra.run.smithi018.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T09:12:55.299 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:55.299 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:55.299 INFO:teuthology.orchestra.run.smithi018.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:55.299 INFO:teuthology.orchestra.run.smithi018.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T09:12:55.299 INFO:teuthology.orchestra.run.smithi018.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T09:12:55.300 INFO:teuthology.orchestra.run.smithi018.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T09:12:55.300 INFO:teuthology.orchestra.run.smithi018.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T09:12:55.300 INFO:teuthology.orchestra.run.smithi018.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T09:12:55.300 INFO:teuthology.orchestra.run.smithi018.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T09:12:55.300 INFO:teuthology.orchestra.run.smithi018.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T09:12:55.301 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:12:55.301 INFO:teuthology.orchestra.run.smithi018.stdout:Complete! 2024-09-19T09:12:55.718 DEBUG:teuthology.parallel:result is None 2024-09-19T09:12:57.908 INFO:teuthology.orchestra.run.smithi162.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T09:12:57.908 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:12:57.908 INFO:teuthology.orchestra.run.smithi162.stdout:Upgraded: 2024-09-19T09:12:57.909 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T09:12:57.909 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T09:12:57.909 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T09:12:57.909 INFO:teuthology.orchestra.run.smithi162.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T09:12:57.909 INFO:teuthology.orchestra.run.smithi162.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:57.909 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:57.909 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T09:12:57.909 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T09:12:57.909 INFO:teuthology.orchestra.run.smithi162.stdout:Installed: 2024-09-19T09:12:57.909 INFO:teuthology.orchestra.run.smithi162.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T09:12:57.909 INFO:teuthology.orchestra.run.smithi162.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T09:12:57.909 INFO:teuthology.orchestra.run.smithi162.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T09:12:57.910 INFO:teuthology.orchestra.run.smithi162.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T09:12:57.910 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:57.910 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:57.910 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:57.910 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:57.910 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:12:57.910 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:57.910 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:57.910 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:57.910 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:12:57.910 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:12:57.910 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:12:57.911 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:12:57.911 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:12:57.911 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:57.911 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:57.911 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:12:57.911 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:57.911 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:57.911 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:57.911 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:12:57.911 INFO:teuthology.orchestra.run.smithi162.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:12:57.911 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:57.911 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:57.911 INFO:teuthology.orchestra.run.smithi162.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T09:12:57.911 INFO:teuthology.orchestra.run.smithi162.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T09:12:57.912 INFO:teuthology.orchestra.run.smithi162.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T09:12:57.912 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T09:12:57.912 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T09:12:57.912 INFO:teuthology.orchestra.run.smithi162.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T09:12:57.912 INFO:teuthology.orchestra.run.smithi162.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T09:12:57.912 INFO:teuthology.orchestra.run.smithi162.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T09:12:57.912 INFO:teuthology.orchestra.run.smithi162.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T09:12:57.912 INFO:teuthology.orchestra.run.smithi162.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T09:12:57.912 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T09:12:57.912 INFO:teuthology.orchestra.run.smithi162.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T09:12:57.912 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:57.912 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:57.913 INFO:teuthology.orchestra.run.smithi162.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:57.913 INFO:teuthology.orchestra.run.smithi162.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T09:12:57.913 INFO:teuthology.orchestra.run.smithi162.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T09:12:57.913 INFO:teuthology.orchestra.run.smithi162.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T09:12:57.913 INFO:teuthology.orchestra.run.smithi162.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T09:12:57.913 INFO:teuthology.orchestra.run.smithi162.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T09:12:57.913 INFO:teuthology.orchestra.run.smithi162.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:57.913 INFO:teuthology.orchestra.run.smithi162.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:57.913 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T09:12:57.913 INFO:teuthology.orchestra.run.smithi162.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:57.913 INFO:teuthology.orchestra.run.smithi162.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T09:12:57.913 INFO:teuthology.orchestra.run.smithi162.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T09:12:57.913 INFO:teuthology.orchestra.run.smithi162.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T09:12:57.913 INFO:teuthology.orchestra.run.smithi162.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T09:12:57.914 INFO:teuthology.orchestra.run.smithi162.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T09:12:57.914 INFO:teuthology.orchestra.run.smithi162.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T09:12:57.914 INFO:teuthology.orchestra.run.smithi162.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T09:12:57.914 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T09:12:57.914 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T09:12:57.914 INFO:teuthology.orchestra.run.smithi162.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T09:12:57.914 INFO:teuthology.orchestra.run.smithi162.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T09:12:57.914 INFO:teuthology.orchestra.run.smithi162.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T09:12:57.914 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T09:12:57.914 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T09:12:57.914 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T09:12:57.914 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T09:12:57.914 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T09:12:57.914 INFO:teuthology.orchestra.run.smithi162.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T09:12:57.915 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T09:12:57.915 INFO:teuthology.orchestra.run.smithi162.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T09:12:57.915 INFO:teuthology.orchestra.run.smithi162.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T09:12:57.915 INFO:teuthology.orchestra.run.smithi162.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T09:12:57.915 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T09:12:57.915 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:57.915 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:57.915 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:57.915 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T09:12:57.915 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T09:12:57.915 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T09:12:57.915 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T09:12:57.916 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T09:12:57.916 INFO:teuthology.orchestra.run.smithi162.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T09:12:57.916 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T09:12:57.916 INFO:teuthology.orchestra.run.smithi162.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T09:12:57.916 INFO:teuthology.orchestra.run.smithi162.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T09:12:57.916 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T09:12:57.916 INFO:teuthology.orchestra.run.smithi162.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T09:12:57.916 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T09:12:57.916 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T09:12:57.916 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T09:12:57.916 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T09:12:57.916 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T09:12:57.916 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T09:12:57.917 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T09:12:57.917 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T09:12:57.917 INFO:teuthology.orchestra.run.smithi162.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T09:12:57.917 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T09:12:57.917 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T09:12:57.917 INFO:teuthology.orchestra.run.smithi162.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T09:12:57.917 INFO:teuthology.orchestra.run.smithi162.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T09:12:57.917 INFO:teuthology.orchestra.run.smithi162.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T09:12:57.917 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T09:12:57.917 INFO:teuthology.orchestra.run.smithi162.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T09:12:57.917 INFO:teuthology.orchestra.run.smithi162.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T09:12:57.917 INFO:teuthology.orchestra.run.smithi162.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T09:12:57.918 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T09:12:57.918 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T09:12:57.918 INFO:teuthology.orchestra.run.smithi162.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T09:12:57.918 INFO:teuthology.orchestra.run.smithi162.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T09:12:57.918 INFO:teuthology.orchestra.run.smithi162.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T09:12:57.918 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T09:12:57.918 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T09:12:57.918 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T09:12:57.918 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T09:12:57.918 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T09:12:57.918 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T09:12:57.918 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:57.919 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:57.919 INFO:teuthology.orchestra.run.smithi162.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T09:12:57.919 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T09:12:57.919 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T09:12:57.919 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:57.919 INFO:teuthology.orchestra.run.smithi162.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T09:12:57.919 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T09:12:57.919 INFO:teuthology.orchestra.run.smithi162.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T09:12:57.919 INFO:teuthology.orchestra.run.smithi162.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T09:12:57.919 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T09:12:57.919 INFO:teuthology.orchestra.run.smithi162.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T09:12:57.919 INFO:teuthology.orchestra.run.smithi162.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T09:12:57.919 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T09:12:57.920 INFO:teuthology.orchestra.run.smithi162.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T09:12:57.920 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T09:12:57.920 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T09:12:57.920 INFO:teuthology.orchestra.run.smithi162.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T09:12:57.920 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T09:12:57.920 INFO:teuthology.orchestra.run.smithi162.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T09:12:57.920 INFO:teuthology.orchestra.run.smithi162.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T09:12:57.920 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:57.920 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:57.920 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T09:12:57.920 INFO:teuthology.orchestra.run.smithi162.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T09:12:57.920 INFO:teuthology.orchestra.run.smithi162.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T09:12:57.921 INFO:teuthology.orchestra.run.smithi162.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T09:12:57.921 INFO:teuthology.orchestra.run.smithi162.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T09:12:57.921 INFO:teuthology.orchestra.run.smithi162.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T09:12:57.921 INFO:teuthology.orchestra.run.smithi162.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T09:12:57.921 INFO:teuthology.orchestra.run.smithi162.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T09:12:57.921 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:12:57.921 INFO:teuthology.orchestra.run.smithi162.stdout:Complete! 2024-09-19T09:12:58.365 DEBUG:teuthology.parallel:result is None 2024-09-19T09:12:58.366 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:12:58.508 DEBUG:teuthology.orchestra.run.smithi018:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T09:12:58.536 INFO:teuthology.orchestra.run.smithi018.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T09:12:58.537 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T09:12:58.537 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T09:12:58.539 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T09:12:58.676 DEBUG:teuthology.orchestra.run.smithi162:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T09:12:58.702 INFO:teuthology.orchestra.run.smithi162.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T09:12:58.703 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T09:12:58.703 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T09:12:58.705 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T09:12:58.705 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:12:58.705 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T09:12:58.739 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:12:58.739 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T09:12:58.775 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T09:12:58.775 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:12:58.775 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T09:12:58.808 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T09:12:58.877 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:12:58.877 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T09:12:58.906 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T09:12:58.974 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T09:12:58.974 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:12:58.974 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T09:12:59.004 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T09:12:59.074 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:12:59.074 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T09:12:59.102 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T09:12:59.170 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T09:12:59.170 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:12:59.170 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T09:12:59.199 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T09:12:59.268 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:12:59.268 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T09:12:59.295 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T09:12:59.361 INFO:teuthology.run_tasks:Running task ceph... 2024-09-19T09:12:59.445 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-19T09:12:59.446 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 777 /var/log/ceph 2024-09-19T09:12:59.449 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 777 /var/log/ceph 2024-09-19T09:12:59.475 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-19T09:12:59.475 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-19T09:12:59.518 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-19T09:12:59.544 INFO:tasks.ceph:Creating extra log directories... 2024-09-19T09:12:59.544 DEBUG:teuthology.orchestra.run.smithi018:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-19T09:12:59.587 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-19T09:12:59.620 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-19T09:12:59.620 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-19T09:12:59.620 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-19T09:12:59.620 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:12:59.621 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-19T09:12:59.670 DEBUG:teuthology.orchestra.run.smithi018:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-19T09:12:59.786 DEBUG:teuthology.orchestra.run.smithi018:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-19T09:12:59.812 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:12:59.813 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-19T09:12:59.828 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-19T09:12:59.939 DEBUG:teuthology.orchestra.run.smithi162:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-19T09:12:59.969 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-19T09:12:59.969 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-19T09:12:59.969 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911897', 'branch': 'squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/mds-full}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7911897', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd', 'disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': '6fad5dd73c93545e52f57f681e140a9c3529c11e'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1747, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'sleep_before_teardown': 0, 'subset': '176/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '6fad5dd73c93545e52f57f681e140a9c3529c11e', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi018.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMLfer0HjLqmAUJv2xvGMDarzipFYy3TFvAgAYhWi6F1xVjzyQwlCLL8NrfdERO0WMvfGtzNCgzS2CwiFaXW+e8=', 'smithi162.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLrPssrTIXE0p9OQbvaLqomwQXjU//djHcju17qjTPCKp1H3Cj7dchkg5T3N1EctJtb1HFHkUkM4AgmdFjzOunQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd', 'disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_full']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-18_21:24:17', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-19T09:12:59.970 DEBUG:teuthology.orchestra.run.smithi018:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-19T09:12:59.973 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-19T09:13:00.019 DEBUG:teuthology.orchestra.run.smithi018:> sudo install -d -m0777 -- /var/run/ceph 2024-09-19T09:13:00.029 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m0777 -- /var/run/ceph 2024-09-19T09:13:00.085 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:13:00.085 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T09:13:00.110 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T09:13:00.110 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_1 2024-09-19T09:13:00.166 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T09:13:00.166 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:13:00.167 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-19T09:13:00.167 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:13:00.167 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:13:00.167 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-19 09:12:47.539942616 +0000 2024-09-19T09:13:00.167 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-19 09:11:02.330805055 +0000 2024-09-19T09:13:00.167 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-19 09:11:02.330805055 +0000 2024-09-19T09:13:00.167 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-19 09:11:02.330805055 +0000 2024-09-19T09:13:00.167 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T09:13:00.232 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-19T09:13:00.232 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-19T09:13:00.232 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 8.9111e-05 s, 5.7 MB/s 2024-09-19T09:13:00.233 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T09:13:00.290 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_2 2024-09-19T09:13:00.346 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T09:13:00.346 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:13:00.346 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-19T09:13:00.346 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:13:00.346 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:13:00.346 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-19 09:12:47.539942616 +0000 2024-09-19T09:13:00.346 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-19 09:11:02.654800959 +0000 2024-09-19T09:13:00.347 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-19 09:11:02.654800959 +0000 2024-09-19T09:13:00.347 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-19 09:11:02.654800959 +0000 2024-09-19T09:13:00.347 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T09:13:00.410 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-19T09:13:00.410 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-19T09:13:00.410 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 8.7741e-05 s, 5.8 MB/s 2024-09-19T09:13:00.411 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T09:13:00.467 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_3 2024-09-19T09:13:00.522 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T09:13:00.522 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:13:00.522 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T09:13:00.523 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:13:00.523 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:13:00.523 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-19 09:12:47.540942604 +0000 2024-09-19T09:13:00.523 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-19 09:11:02.993796673 +0000 2024-09-19T09:13:00.523 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-19 09:11:02.993796673 +0000 2024-09-19T09:13:00.523 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-19 09:11:02.993796673 +0000 2024-09-19T09:13:00.523 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T09:13:00.587 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-19T09:13:00.587 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-19T09:13:00.587 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 9.4049e-05 s, 5.4 MB/s 2024-09-19T09:13:00.588 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T09:13:00.645 DEBUG:teuthology.orchestra.run.smithi018:> stat /dev/vg_nvme/lv_4 2024-09-19T09:13:00.701 INFO:teuthology.orchestra.run.smithi018.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T09:13:00.701 INFO:teuthology.orchestra.run.smithi018.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:13:00.701 INFO:teuthology.orchestra.run.smithi018.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-19T09:13:00.701 INFO:teuthology.orchestra.run.smithi018.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:13:00.701 INFO:teuthology.orchestra.run.smithi018.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:13:00.701 INFO:teuthology.orchestra.run.smithi018.stdout:Access: 2024-09-19 09:12:47.540942604 +0000 2024-09-19T09:13:00.701 INFO:teuthology.orchestra.run.smithi018.stdout:Modify: 2024-09-19 09:11:03.311792652 +0000 2024-09-19T09:13:00.701 INFO:teuthology.orchestra.run.smithi018.stdout:Change: 2024-09-19 09:11:03.311792652 +0000 2024-09-19T09:13:00.701 INFO:teuthology.orchestra.run.smithi018.stdout: Birth: 2024-09-19 09:11:03.311792652 +0000 2024-09-19T09:13:00.702 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T09:13:00.765 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records in 2024-09-19T09:13:00.765 INFO:teuthology.orchestra.run.smithi018.stderr:1+0 records out 2024-09-19T09:13:00.765 INFO:teuthology.orchestra.run.smithi018.stderr:512 bytes copied, 0.000101189 s, 5.1 MB/s 2024-09-19T09:13:00.767 DEBUG:teuthology.orchestra.run.smithi018:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T09:13:00.823 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T09:13:00.824 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:13:00.824 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T09:13:00.840 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T09:13:00.841 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_1 2024-09-19T09:13:00.897 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T09:13:00.897 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:13:00.897 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-19T09:13:00.897 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:13:00.898 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:13:00.898 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-19 09:12:49.726558090 +0000 2024-09-19T09:13:00.898 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-19 09:10:57.764396031 +0000 2024-09-19T09:13:00.898 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-19 09:10:57.764396031 +0000 2024-09-19T09:13:00.898 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-19 09:10:57.764396031 +0000 2024-09-19T09:13:00.898 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T09:13:00.961 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-19T09:13:00.961 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-19T09:13:00.961 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000184157 s, 2.8 MB/s 2024-09-19T09:13:00.962 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T09:13:01.019 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_2 2024-09-19T09:13:01.075 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T09:13:01.075 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:13:01.075 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-19T09:13:01.075 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:13:01.075 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:13:01.075 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-19 09:12:49.726558090 +0000 2024-09-19T09:13:01.075 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-19 09:10:58.093389517 +0000 2024-09-19T09:13:01.075 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-19 09:10:58.093389517 +0000 2024-09-19T09:13:01.075 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-19 09:10:58.093389517 +0000 2024-09-19T09:13:01.076 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T09:13:01.138 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-19T09:13:01.139 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-19T09:13:01.139 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000185501 s, 2.8 MB/s 2024-09-19T09:13:01.140 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T09:13:01.196 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_3 2024-09-19T09:13:01.251 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T09:13:01.251 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:13:01.251 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T09:13:01.252 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:13:01.252 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:13:01.252 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-19 09:12:49.727558070 +0000 2024-09-19T09:13:01.252 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-19 09:10:58.434382765 +0000 2024-09-19T09:13:01.252 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-19 09:10:58.434382765 +0000 2024-09-19T09:13:01.252 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-19 09:10:58.434382765 +0000 2024-09-19T09:13:01.252 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T09:13:01.315 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-19T09:13:01.315 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-19T09:13:01.315 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000173106 s, 3.0 MB/s 2024-09-19T09:13:01.316 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T09:13:01.372 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_4 2024-09-19T09:13:01.427 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T09:13:01.427 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T09:13:01.427 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-19T09:13:01.427 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T09:13:01.427 INFO:teuthology.orchestra.run.smithi162.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T09:13:01.428 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-09-19 09:12:49.727558070 +0000 2024-09-19T09:13:01.428 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-09-19 09:10:58.774376033 +0000 2024-09-19T09:13:01.428 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-09-19 09:10:58.774376033 +0000 2024-09-19T09:13:01.428 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: 2024-09-19 09:10:58.774376033 +0000 2024-09-19T09:13:01.428 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T09:13:01.490 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-09-19T09:13:01.490 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-09-19T09:13:01.490 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000231421 s, 2.2 MB/s 2024-09-19T09:13:01.491 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T09:13:01.548 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T09:13:01.548 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi018.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi162.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-19T09:13:01.548 INFO:tasks.ceph:Generating config... 2024-09-19T09:13:01.550 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-19T09:13:01.550 INFO:tasks.ceph:[client] debug client = 20 2024-09-19T09:13:01.550 INFO:tasks.ceph:[client] debug ms = 1 2024-09-19T09:13:01.550 INFO:tasks.ceph:[client] pid file = 2024-09-19T09:13:01.550 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-19T09:13:01.550 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-19T09:13:01.550 INFO:tasks.ceph:[client.0] debug client = 20 2024-09-19T09:13:01.550 INFO:tasks.ceph:[client.0] debug objectcacher = 20 2024-09-19T09:13:01.550 INFO:tasks.ceph:[client.0] debug objecter = 20 2024-09-19T09:13:01.550 INFO:tasks.ceph:[client.1] debug client = 20 2024-09-19T09:13:01.550 INFO:tasks.ceph:[client.1] debug objectcacher = 20 2024-09-19T09:13:01.550 INFO:tasks.ceph:[client.1] debug objecter = 20 2024-09-19T09:13:01.551 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-19T09:13:01.551 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-19T09:13:01.551 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-19T09:13:01.551 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-19T09:13:01.551 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-19T09:13:01.551 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-19T09:13:01.551 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-19T09:13:01.551 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-19T09:13:01.551 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-19T09:13:01.551 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-19T09:13:01.551 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-19T09:13:01.551 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-19T09:13:01.551 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-19T09:13:01.551 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-19T09:13:01.551 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-19T09:13:01.552 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-19T09:13:01.552 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-19T09:13:01.552 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-19T09:13:01.552 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-19T09:13:01.552 INFO:tasks.ceph:[mon] mon osd backfillfull ratio = 0.6 2024-09-19T09:13:01.552 INFO:tasks.ceph:[mon] mon osd full ratio = 0.7 2024-09-19T09:13:01.552 INFO:tasks.ceph:[mon] mon osd nearfull ratio = 0.6 2024-09-19T09:13:01.552 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-19T09:13:01.552 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-19T09:13:01.552 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-19T09:13:01.552 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-19T09:13:01.552 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-19T09:13:01.552 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-19T09:13:01.553 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-19T09:13:01.553 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-19T09:13:01.553 INFO:tasks.ceph:[osd] memstore device bytes = 200000000 2024-09-19T09:13:01.553 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-19T09:13:01.553 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-19T09:13:01.553 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-19T09:13:01.553 INFO:tasks.ceph:[osd] osd failsafe full ratio = 1.0 2024-09-19T09:13:01.553 INFO:tasks.ceph:[osd] osd mon report interval = 5 2024-09-19T09:13:01.553 INFO:tasks.ceph:[osd] osd objectstore = memstore 2024-09-19T09:13:01.553 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-19T09:13:01.553 INFO:tasks.ceph:Setting up mon.a... 2024-09-19T09:13:01.554 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-19T09:13:01.603 INFO:teuthology.orchestra.run.smithi018.stdout:creating /etc/ceph/ceph.keyring 2024-09-19T09:13:01.606 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-19T09:13:01.651 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-19T09:13:01.677 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.18'), ('mon.b', '172.21.15.162'), ('mon.c', '[v2:172.21.15.162:3301,v1:172.21.15.162:6790]')] 2024-09-19T09:13:01.678 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.18,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-19T09:13:01.678 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:13:01.678 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-19T09:13:01.733 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.18 --add b 172.21.15.162 --addv c '[v2:172.21.15.162:3301,v1:172.21.15.162:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-19T09:13:01.822 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-19T09:13:01.822 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: generated fsid fec66d7e-50e5-42ed-81de-ad141a2f0f4e 2024-09-19T09:13:01.822 INFO:teuthology.orchestra.run.smithi018.stdout:setting min_mon_release = quincy 2024-09-19T09:13:01.823 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 0 2024-09-19T09:13:01.823 INFO:teuthology.orchestra.run.smithi018.stdout:fsid fec66d7e-50e5-42ed-81de-ad141a2f0f4e 2024-09-19T09:13:01.823 INFO:teuthology.orchestra.run.smithi018.stdout:last_changed 2024-09-19T09:13:01.823104+0000 2024-09-19T09:13:01.823 INFO:teuthology.orchestra.run.smithi018.stdout:created 2024-09-19T09:13:01.823104+0000 2024-09-19T09:13:01.823 INFO:teuthology.orchestra.run.smithi018.stdout:min_mon_release 17 (quincy) 2024-09-19T09:13:01.823 INFO:teuthology.orchestra.run.smithi018.stdout:election_strategy: 1 2024-09-19T09:13:01.823 INFO:teuthology.orchestra.run.smithi018.stdout:0: [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] mon.a 2024-09-19T09:13:01.823 INFO:teuthology.orchestra.run.smithi018.stdout:1: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.b 2024-09-19T09:13:01.823 INFO:teuthology.orchestra.run.smithi018.stdout:2: [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] mon.c 2024-09-19T09:13:01.823 INFO:teuthology.orchestra.run.smithi018.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-19T09:13:01.824 DEBUG:teuthology.orchestra.run.smithi018:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-19T09:13:01.840 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID fec66d7e-50e5-42ed-81de-ad141a2f0f4e... 2024-09-19T09:13:01.841 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-19T09:13:01.883 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-19T09:13:01.924 INFO:teuthology.orchestra.run.smithi018.stdout:[global] 2024-09-19T09:13:01.924 INFO:teuthology.orchestra.run.smithi018.stdout: chdir = "" 2024-09-19T09:13:01.925 INFO:teuthology.orchestra.run.smithi018.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-19T09:13:01.925 INFO:teuthology.orchestra.run.smithi018.stdout: auth supported = cephx 2024-09-19T09:13:01.925 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:01.925 INFO:teuthology.orchestra.run.smithi018.stdout: filestore xattr use omap = true 2024-09-19T09:13:01.925 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:01.925 INFO:teuthology.orchestra.run.smithi018.stdout: mon clock drift allowed = 1.000 2024-09-19T09:13:01.925 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:01.925 INFO:teuthology.orchestra.run.smithi018.stdout: osd crush chooseleaf type = 0 2024-09-19T09:13:01.925 INFO:teuthology.orchestra.run.smithi018.stdout: auth debug = true 2024-09-19T09:13:01.925 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:01.925 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on old message = true 2024-09-19T09:13:01.925 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on bug = true 2024-09-19T09:13:01.925 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:01.925 INFO:teuthology.orchestra.run.smithi018.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-19T09:13:01.925 INFO:teuthology.orchestra.run.smithi018.stdout: mon pg warn max object skew = 0 2024-09-19T09:13:01.926 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:01.926 INFO:teuthology.orchestra.run.smithi018.stdout: # disable pg_autoscaler by default for new pools 2024-09-19T09:13:01.926 INFO:teuthology.orchestra.run.smithi018.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-19T09:13:01.926 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:01.926 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default size = 2 2024-09-19T09:13:01.926 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:01.926 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow primary affinity = true 2024-09-19T09:13:01.926 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd allow pg remap = true 2024-09-19T09:13:01.926 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on legacy crush tunables = false 2024-09-19T09:13:01.926 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on crush straw calc version zero = false 2024-09-19T09:13:01.926 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on no sortbitwise = false 2024-09-19T09:13:01.926 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on osd down out interval zero = false 2024-09-19T09:13:01.926 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on too few osds = false 2024-09-19T09:13:01.926 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-19T09:13:01.927 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-19T09:13:01.927 INFO:teuthology.orchestra.run.smithi018.stdout: mon_allow_pool_size_one = true 2024-09-19T09:13:01.927 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:01.927 INFO:teuthology.orchestra.run.smithi018.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-19T09:13:01.927 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:01.927 INFO:teuthology.orchestra.run.smithi018.stdout: osd default data pool replay window = 5 2024-09-19T09:13:01.927 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:01.927 INFO:teuthology.orchestra.run.smithi018.stdout: mon allow pool delete = true 2024-09-19T09:13:01.927 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:01.927 INFO:teuthology.orchestra.run.smithi018.stdout: mon cluster log file level = debug 2024-09-19T09:13:01.927 INFO:teuthology.orchestra.run.smithi018.stdout: debug asserts on shutdown = true 2024-09-19T09:13:01.927 INFO:teuthology.orchestra.run.smithi018.stdout: mon health detail to clog = false 2024-09-19T09:13:01.927 INFO:teuthology.orchestra.run.smithi018.stdout: mon host = "172.21.15.18,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]" 2024-09-19T09:13:01.928 INFO:teuthology.orchestra.run.smithi018.stdout: ms die on skipped message = False 2024-09-19T09:13:01.928 INFO:teuthology.orchestra.run.smithi018.stdout: fsid = fec66d7e-50e5-42ed-81de-ad141a2f0f4e 2024-09-19T09:13:01.928 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:01.928 INFO:teuthology.orchestra.run.smithi018.stdout:[osd] 2024-09-19T09:13:01.928 INFO:teuthology.orchestra.run.smithi018.stdout: osd journal size = 100 2024-09-19T09:13:01.928 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:01.928 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub load threshold = 5.0 2024-09-19T09:13:01.928 INFO:teuthology.orchestra.run.smithi018.stdout: osd scrub max interval = 600 2024-09-19T09:13:01.928 INFO:teuthology.orchestra.run.smithi018.stdout: osd mclock profile = high_recovery_ops 2024-09-19T09:13:01.928 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:01.928 INFO:teuthology.orchestra.run.smithi018.stdout: osd recover clone overlap = true 2024-09-19T09:13:01.928 INFO:teuthology.orchestra.run.smithi018.stdout: osd recovery max chunk = 1048576 2024-09-19T09:13:01.928 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:01.929 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug shutdown = true 2024-09-19T09:13:01.929 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug op order = true 2024-09-19T09:13:01.929 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug verify stray on activate = true 2024-09-19T09:13:01.929 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug trim objects = true 2024-09-19T09:13:01.929 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:01.929 INFO:teuthology.orchestra.run.smithi018.stdout: osd open classes on start = true 2024-09-19T09:13:01.929 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug pg log writeout = true 2024-09-19T09:13:01.929 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:01.929 INFO:teuthology.orchestra.run.smithi018.stdout: osd deep scrub update digest min age = 30 2024-09-19T09:13:01.929 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:01.929 INFO:teuthology.orchestra.run.smithi018.stdout: osd map max advance = 10 2024-09-19T09:13:01.929 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:01.929 INFO:teuthology.orchestra.run.smithi018.stdout: journal zero on create = true 2024-09-19T09:13:01.930 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:01.930 INFO:teuthology.orchestra.run.smithi018.stdout: filestore ondisk finisher threads = 3 2024-09-19T09:13:01.930 INFO:teuthology.orchestra.run.smithi018.stdout: filestore apply finisher threads = 3 2024-09-19T09:13:01.930 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:01.930 INFO:teuthology.orchestra.run.smithi018.stdout: bdev debug aio = true 2024-09-19T09:13:01.930 INFO:teuthology.orchestra.run.smithi018.stdout: osd debug misdirected ops = true 2024-09-19T09:13:01.930 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore block size = 96636764160 2024-09-19T09:13:01.930 INFO:teuthology.orchestra.run.smithi018.stdout: bluestore fsck on mount = True 2024-09-19T09:13:01.930 INFO:teuthology.orchestra.run.smithi018.stdout: debug bluefs = 20 2024-09-19T09:13:01.930 INFO:teuthology.orchestra.run.smithi018.stdout: debug bluestore = 20 2024-09-19T09:13:01.930 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-09-19T09:13:01.930 INFO:teuthology.orchestra.run.smithi018.stdout: debug osd = 20 2024-09-19T09:13:01.931 INFO:teuthology.orchestra.run.smithi018.stdout: debug rocksdb = 10 2024-09-19T09:13:01.931 INFO:teuthology.orchestra.run.smithi018.stdout: memstore device bytes = 200000000 2024-09-19T09:13:01.931 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd backfillfull_ratio = 0.85 2024-09-19T09:13:01.931 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd full ratio = 0.9 2024-09-19T09:13:01.931 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd nearfull ratio = 0.8 2024-09-19T09:13:01.931 INFO:teuthology.orchestra.run.smithi018.stdout: osd failsafe full ratio = 1.0 2024-09-19T09:13:01.931 INFO:teuthology.orchestra.run.smithi018.stdout: osd mon report interval = 5 2024-09-19T09:13:01.931 INFO:teuthology.orchestra.run.smithi018.stdout: osd objectstore = memstore 2024-09-19T09:13:01.931 INFO:teuthology.orchestra.run.smithi018.stdout: osd op complaint time = 180 2024-09-19T09:13:01.931 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:01.931 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr] 2024-09-19T09:13:01.931 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-09-19T09:13:01.931 INFO:teuthology.orchestra.run.smithi018.stdout: debug mgr = 20 2024-09-19T09:13:01.931 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2024-09-19T09:13:01.932 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2024-09-19T09:13:01.932 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2024-09-19T09:13:01.932 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2024-09-19T09:13:01.932 INFO:teuthology.orchestra.run.smithi018.stdout: mgr/telemetry/nag = false 2024-09-19T09:13:01.932 INFO:teuthology.orchestra.run.smithi018.stdout: debug client = 20 2024-09-19T09:13:01.932 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:01.932 INFO:teuthology.orchestra.run.smithi018.stdout:[mon] 2024-09-19T09:13:01.932 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-09-19T09:13:01.932 INFO:teuthology.orchestra.run.smithi018.stdout: debug mon = 20 2024-09-19T09:13:01.932 INFO:teuthology.orchestra.run.smithi018.stdout: debug paxos = 20 2024-09-19T09:13:01.932 INFO:teuthology.orchestra.run.smithi018.stdout: debug auth = 20 2024-09-19T09:13:01.932 INFO:teuthology.orchestra.run.smithi018.stdout: mon data avail warn = 5 2024-09-19T09:13:01.932 INFO:teuthology.orchestra.run.smithi018.stdout: mon mgr mkfs grace = 240 2024-09-19T09:13:01.932 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min pgs per osd = 4 2024-09-19T09:13:01.933 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd reporter subtree level = osd 2024-09-19T09:13:01.933 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd prime pg temp = true 2024-09-19T09:13:01.933 INFO:teuthology.orchestra.run.smithi018.stdout: mon reweight min bytes per osd = 10 2024-09-19T09:13:01.933 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:01.933 INFO:teuthology.orchestra.run.smithi018.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-19T09:13:01.933 INFO:teuthology.orchestra.run.smithi018.stdout: auth mon ticket ttl = 660 # 11m 2024-09-19T09:13:01.933 INFO:teuthology.orchestra.run.smithi018.stdout: auth service ticket ttl = 240 # 4m 2024-09-19T09:13:01.933 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:01.933 INFO:teuthology.orchestra.run.smithi018.stdout: # don't complain about insecure global_id in the test suite 2024-09-19T09:13:01.933 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-19T09:13:01.933 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-19T09:13:01.933 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:01.933 INFO:teuthology.orchestra.run.smithi018.stdout: # 1m isn't quite enough 2024-09-19T09:13:01.933 INFO:teuthology.orchestra.run.smithi018.stdout: mon_down_mkfs_grace = 2m 2024-09-19T09:13:01.934 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:01.934 INFO:teuthology.orchestra.run.smithi018.stdout: mon_warn_on_filestore_osds = false 2024-09-19T09:13:01.934 INFO:teuthology.orchestra.run.smithi018.stdout: mon down mkfs grace = 300 2024-09-19T09:13:01.934 INFO:teuthology.orchestra.run.smithi018.stdout: mon op complaint time = 120 2024-09-19T09:13:01.934 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd backfillfull ratio = 0.6 2024-09-19T09:13:01.934 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd full ratio = 0.7 2024-09-19T09:13:01.934 INFO:teuthology.orchestra.run.smithi018.stdout: mon osd nearfull ratio = 0.6 2024-09-19T09:13:01.934 INFO:teuthology.orchestra.run.smithi018.stdout: mon warn on pool no app = False 2024-09-19T09:13:01.934 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:01.934 INFO:teuthology.orchestra.run.smithi018.stdout:[client] 2024-09-19T09:13:01.934 INFO:teuthology.orchestra.run.smithi018.stdout: rgw cache enabled = true 2024-09-19T09:13:01.934 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable ops log = true 2024-09-19T09:13:01.934 INFO:teuthology.orchestra.run.smithi018.stdout: rgw enable usage log = true 2024-09-19T09:13:01.934 INFO:teuthology.orchestra.run.smithi018.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-19T09:13:01.935 INFO:teuthology.orchestra.run.smithi018.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-19T09:13:01.935 INFO:teuthology.orchestra.run.smithi018.stdout: client mount timeout = 600 2024-09-19T09:13:01.935 INFO:teuthology.orchestra.run.smithi018.stdout: debug client = 20 2024-09-19T09:13:01.935 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-09-19T09:13:01.935 INFO:teuthology.orchestra.run.smithi018.stdout: pid file = "" 2024-09-19T09:13:01.935 INFO:teuthology.orchestra.run.smithi018.stdout: rados mon op timeout = 900 2024-09-19T09:13:01.935 INFO:teuthology.orchestra.run.smithi018.stdout: rados osd op timeout = 900 2024-09-19T09:13:01.935 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.a] 2024-09-19T09:13:01.935 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.b] 2024-09-19T09:13:01.935 INFO:teuthology.orchestra.run.smithi018.stdout:[mon.c] 2024-09-19T09:13:01.935 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.a] 2024-09-19T09:13:01.935 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.c] 2024-09-19T09:13:01.935 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.b] 2024-09-19T09:13:01.935 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.d] 2024-09-19T09:13:01.936 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-09-19T09:13:01.936 INFO:teuthology.orchestra.run.smithi018.stdout: debug client = 20 2024-09-19T09:13:01.936 INFO:teuthology.orchestra.run.smithi018.stdout: debug objectcacher = 20 2024-09-19T09:13:01.936 INFO:teuthology.orchestra.run.smithi018.stdout: debug objecter = 20 2024-09-19T09:13:01.936 INFO:teuthology.orchestra.run.smithi018.stdout:[client.1] 2024-09-19T09:13:01.936 INFO:teuthology.orchestra.run.smithi018.stdout: debug client = 20 2024-09-19T09:13:01.936 INFO:teuthology.orchestra.run.smithi018.stdout: debug objectcacher = 20 2024-09-19T09:13:01.936 INFO:teuthology.orchestra.run.smithi018.stdout: debug objecter = 20 2024-09-19T09:13:01.936 INFO:teuthology.orchestra.run.smithi018.stdout:[mds] 2024-09-19T09:13:01.936 INFO:teuthology.orchestra.run.smithi018.stdout: debug mds = 20 2024-09-19T09:13:01.936 INFO:teuthology.orchestra.run.smithi018.stdout: debug mds balancer = 20 2024-09-19T09:13:01.936 INFO:teuthology.orchestra.run.smithi018.stdout: debug ms = 1 2024-09-19T09:13:01.936 INFO:teuthology.orchestra.run.smithi018.stdout: mds debug frag = True 2024-09-19T09:13:01.936 INFO:teuthology.orchestra.run.smithi018.stdout: mds debug scatterstat = True 2024-09-19T09:13:01.937 INFO:teuthology.orchestra.run.smithi018.stdout: mds op complaint time = 180 2024-09-19T09:13:01.937 INFO:teuthology.orchestra.run.smithi018.stdout: mds verify scatter = True 2024-09-19T09:13:01.937 INFO:teuthology.orchestra.run.smithi018.stdout: osd op complaint time = 180 2024-09-19T09:13:01.937 INFO:teuthology.orchestra.run.smithi018.stdout: rados mon op timeout = 900 2024-09-19T09:13:01.937 INFO:teuthology.orchestra.run.smithi018.stdout: rados osd op timeout = 900 2024-09-19T09:13:01.937 INFO:teuthology.orchestra.run.smithi162.stdout:[global] 2024-09-19T09:13:01.937 INFO:teuthology.orchestra.run.smithi162.stdout: chdir = "" 2024-09-19T09:13:01.938 INFO:teuthology.orchestra.run.smithi162.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-19T09:13:01.938 INFO:teuthology.orchestra.run.smithi162.stdout: auth supported = cephx 2024-09-19T09:13:01.938 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:13:01.938 INFO:teuthology.orchestra.run.smithi162.stdout: filestore xattr use omap = true 2024-09-19T09:13:01.938 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:13:01.938 INFO:teuthology.orchestra.run.smithi162.stdout: mon clock drift allowed = 1.000 2024-09-19T09:13:01.938 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:13:01.938 INFO:teuthology.orchestra.run.smithi162.stdout: osd crush chooseleaf type = 0 2024-09-19T09:13:01.938 INFO:teuthology.orchestra.run.smithi162.stdout: auth debug = true 2024-09-19T09:13:01.938 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:13:01.938 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on old message = true 2024-09-19T09:13:01.938 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on bug = true 2024-09-19T09:13:01.938 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:13:01.939 INFO:teuthology.orchestra.run.smithi162.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-19T09:13:01.939 INFO:teuthology.orchestra.run.smithi162.stdout: mon pg warn max object skew = 0 2024-09-19T09:13:01.939 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:13:01.939 INFO:teuthology.orchestra.run.smithi162.stdout: # disable pg_autoscaler by default for new pools 2024-09-19T09:13:01.939 INFO:teuthology.orchestra.run.smithi162.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-19T09:13:01.939 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:13:01.939 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default size = 2 2024-09-19T09:13:01.939 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:13:01.939 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow primary affinity = true 2024-09-19T09:13:01.939 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow pg remap = true 2024-09-19T09:13:01.939 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on legacy crush tunables = false 2024-09-19T09:13:01.939 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on crush straw calc version zero = false 2024-09-19T09:13:01.939 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on no sortbitwise = false 2024-09-19T09:13:01.939 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on osd down out interval zero = false 2024-09-19T09:13:01.939 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on too few osds = false 2024-09-19T09:13:01.939 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-19T09:13:01.940 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-19T09:13:01.940 INFO:teuthology.orchestra.run.smithi162.stdout: mon_allow_pool_size_one = true 2024-09-19T09:13:01.940 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:13:01.940 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-19T09:13:01.940 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:13:01.940 INFO:teuthology.orchestra.run.smithi162.stdout: osd default data pool replay window = 5 2024-09-19T09:13:01.940 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:13:01.940 INFO:teuthology.orchestra.run.smithi162.stdout: mon allow pool delete = true 2024-09-19T09:13:01.940 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:13:01.940 INFO:teuthology.orchestra.run.smithi162.stdout: mon cluster log file level = debug 2024-09-19T09:13:01.940 INFO:teuthology.orchestra.run.smithi162.stdout: debug asserts on shutdown = true 2024-09-19T09:13:01.940 INFO:teuthology.orchestra.run.smithi162.stdout: mon health detail to clog = false 2024-09-19T09:13:01.940 INFO:teuthology.orchestra.run.smithi162.stdout: mon host = "172.21.15.18,172.21.15.162,[v2:172.21.15.162:3301,v1:172.21.15.162:6790]" 2024-09-19T09:13:01.941 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on skipped message = False 2024-09-19T09:13:01.941 INFO:teuthology.orchestra.run.smithi162.stdout: fsid = fec66d7e-50e5-42ed-81de-ad141a2f0f4e 2024-09-19T09:13:01.941 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:13:01.941 INFO:teuthology.orchestra.run.smithi162.stdout:[osd] 2024-09-19T09:13:01.941 INFO:teuthology.orchestra.run.smithi162.stdout: osd journal size = 100 2024-09-19T09:13:01.941 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:13:01.941 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub load threshold = 5.0 2024-09-19T09:13:01.941 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub max interval = 600 2024-09-19T09:13:01.941 INFO:teuthology.orchestra.run.smithi162.stdout: osd mclock profile = high_recovery_ops 2024-09-19T09:13:01.941 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:13:01.941 INFO:teuthology.orchestra.run.smithi162.stdout: osd recover clone overlap = true 2024-09-19T09:13:01.941 INFO:teuthology.orchestra.run.smithi162.stdout: osd recovery max chunk = 1048576 2024-09-19T09:13:01.941 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:13:01.941 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug shutdown = true 2024-09-19T09:13:01.941 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug op order = true 2024-09-19T09:13:01.941 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug verify stray on activate = true 2024-09-19T09:13:01.942 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug trim objects = true 2024-09-19T09:13:01.942 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:13:01.942 INFO:teuthology.orchestra.run.smithi162.stdout: osd open classes on start = true 2024-09-19T09:13:01.942 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug pg log writeout = true 2024-09-19T09:13:01.942 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:13:01.942 INFO:teuthology.orchestra.run.smithi162.stdout: osd deep scrub update digest min age = 30 2024-09-19T09:13:01.942 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:13:01.942 INFO:teuthology.orchestra.run.smithi162.stdout: osd map max advance = 10 2024-09-19T09:13:01.942 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:13:01.942 INFO:teuthology.orchestra.run.smithi162.stdout: journal zero on create = true 2024-09-19T09:13:01.942 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:13:01.942 INFO:teuthology.orchestra.run.smithi162.stdout: filestore ondisk finisher threads = 3 2024-09-19T09:13:01.942 INFO:teuthology.orchestra.run.smithi162.stdout: filestore apply finisher threads = 3 2024-09-19T09:13:01.942 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:13:01.942 INFO:teuthology.orchestra.run.smithi162.stdout: bdev debug aio = true 2024-09-19T09:13:01.943 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug misdirected ops = true 2024-09-19T09:13:01.943 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore block size = 96636764160 2024-09-19T09:13:01.943 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore fsck on mount = True 2024-09-19T09:13:01.943 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluefs = 20 2024-09-19T09:13:01.943 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluestore = 20 2024-09-19T09:13:01.943 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-09-19T09:13:01.943 INFO:teuthology.orchestra.run.smithi162.stdout: debug osd = 20 2024-09-19T09:13:01.943 INFO:teuthology.orchestra.run.smithi162.stdout: debug rocksdb = 10 2024-09-19T09:13:01.943 INFO:teuthology.orchestra.run.smithi162.stdout: memstore device bytes = 200000000 2024-09-19T09:13:01.943 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd backfillfull_ratio = 0.85 2024-09-19T09:13:01.943 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd full ratio = 0.9 2024-09-19T09:13:01.943 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd nearfull ratio = 0.8 2024-09-19T09:13:01.944 INFO:teuthology.orchestra.run.smithi162.stdout: osd failsafe full ratio = 1.0 2024-09-19T09:13:01.944 INFO:teuthology.orchestra.run.smithi162.stdout: osd mon report interval = 5 2024-09-19T09:13:01.944 INFO:teuthology.orchestra.run.smithi162.stdout: osd objectstore = memstore 2024-09-19T09:13:01.944 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2024-09-19T09:13:01.944 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:13:01.944 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr] 2024-09-19T09:13:01.944 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-09-19T09:13:01.944 INFO:teuthology.orchestra.run.smithi162.stdout: debug mgr = 20 2024-09-19T09:13:01.944 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2024-09-19T09:13:01.944 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2024-09-19T09:13:01.944 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2024-09-19T09:13:01.944 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2024-09-19T09:13:01.944 INFO:teuthology.orchestra.run.smithi162.stdout: mgr/telemetry/nag = false 2024-09-19T09:13:01.944 INFO:teuthology.orchestra.run.smithi162.stdout: debug client = 20 2024-09-19T09:13:01.944 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:13:01.944 INFO:teuthology.orchestra.run.smithi162.stdout:[mon] 2024-09-19T09:13:01.945 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-09-19T09:13:01.945 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2024-09-19T09:13:01.945 INFO:teuthology.orchestra.run.smithi162.stdout: debug paxos = 20 2024-09-19T09:13:01.945 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2024-09-19T09:13:01.945 INFO:teuthology.orchestra.run.smithi162.stdout: mon data avail warn = 5 2024-09-19T09:13:01.945 INFO:teuthology.orchestra.run.smithi162.stdout: mon mgr mkfs grace = 240 2024-09-19T09:13:01.945 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2024-09-19T09:13:01.945 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd reporter subtree level = osd 2024-09-19T09:13:01.945 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd prime pg temp = true 2024-09-19T09:13:01.945 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2024-09-19T09:13:01.945 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:13:01.945 INFO:teuthology.orchestra.run.smithi162.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-19T09:13:01.945 INFO:teuthology.orchestra.run.smithi162.stdout: auth mon ticket ttl = 660 # 11m 2024-09-19T09:13:01.945 INFO:teuthology.orchestra.run.smithi162.stdout: auth service ticket ttl = 240 # 4m 2024-09-19T09:13:01.946 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:13:01.946 INFO:teuthology.orchestra.run.smithi162.stdout: # don't complain about insecure global_id in the test suite 2024-09-19T09:13:01.946 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-19T09:13:01.946 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-19T09:13:01.946 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:13:01.946 INFO:teuthology.orchestra.run.smithi162.stdout: # 1m isn't quite enough 2024-09-19T09:13:01.946 INFO:teuthology.orchestra.run.smithi162.stdout: mon_down_mkfs_grace = 2m 2024-09-19T09:13:01.946 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:13:01.946 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_filestore_osds = false 2024-09-19T09:13:01.946 INFO:teuthology.orchestra.run.smithi162.stdout: mon down mkfs grace = 300 2024-09-19T09:13:01.946 INFO:teuthology.orchestra.run.smithi162.stdout: mon op complaint time = 120 2024-09-19T09:13:01.946 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd backfillfull ratio = 0.6 2024-09-19T09:13:01.946 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd full ratio = 0.7 2024-09-19T09:13:01.946 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd nearfull ratio = 0.6 2024-09-19T09:13:01.947 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on pool no app = False 2024-09-19T09:13:01.947 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-09-19T09:13:01.947 INFO:teuthology.orchestra.run.smithi162.stdout:[client] 2024-09-19T09:13:01.947 INFO:teuthology.orchestra.run.smithi162.stdout: rgw cache enabled = true 2024-09-19T09:13:01.947 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable ops log = true 2024-09-19T09:13:01.947 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable usage log = true 2024-09-19T09:13:01.947 INFO:teuthology.orchestra.run.smithi162.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-19T09:13:01.947 INFO:teuthology.orchestra.run.smithi162.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-19T09:13:01.947 INFO:teuthology.orchestra.run.smithi162.stdout: client mount timeout = 600 2024-09-19T09:13:01.947 INFO:teuthology.orchestra.run.smithi162.stdout: debug client = 20 2024-09-19T09:13:01.947 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-09-19T09:13:01.947 INFO:teuthology.orchestra.run.smithi162.stdout: pid file = "" 2024-09-19T09:13:01.947 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2024-09-19T09:13:01.947 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2024-09-19T09:13:01.948 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.a] 2024-09-19T09:13:01.948 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.b] 2024-09-19T09:13:01.948 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.c] 2024-09-19T09:13:01.948 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.a] 2024-09-19T09:13:01.948 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.c] 2024-09-19T09:13:01.948 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.b] 2024-09-19T09:13:01.948 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.d] 2024-09-19T09:13:01.948 INFO:teuthology.orchestra.run.smithi162.stdout:[client.0] 2024-09-19T09:13:01.948 INFO:teuthology.orchestra.run.smithi162.stdout: debug client = 20 2024-09-19T09:13:01.948 INFO:teuthology.orchestra.run.smithi162.stdout: debug objectcacher = 20 2024-09-19T09:13:01.948 INFO:teuthology.orchestra.run.smithi162.stdout: debug objecter = 20 2024-09-19T09:13:01.948 INFO:teuthology.orchestra.run.smithi162.stdout:[client.1] 2024-09-19T09:13:01.948 INFO:teuthology.orchestra.run.smithi162.stdout: debug client = 20 2024-09-19T09:13:01.948 INFO:teuthology.orchestra.run.smithi162.stdout: debug objectcacher = 20 2024-09-19T09:13:01.948 INFO:teuthology.orchestra.run.smithi162.stdout: debug objecter = 20 2024-09-19T09:13:01.949 INFO:teuthology.orchestra.run.smithi162.stdout:[mds] 2024-09-19T09:13:01.949 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds = 20 2024-09-19T09:13:01.949 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds balancer = 20 2024-09-19T09:13:01.949 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-09-19T09:13:01.949 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug frag = True 2024-09-19T09:13:01.949 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug scatterstat = True 2024-09-19T09:13:01.949 INFO:teuthology.orchestra.run.smithi162.stdout: mds op complaint time = 180 2024-09-19T09:13:01.949 INFO:teuthology.orchestra.run.smithi162.stdout: mds verify scatter = True 2024-09-19T09:13:01.949 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2024-09-19T09:13:01.949 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2024-09-19T09:13:01.949 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2024-09-19T09:13:01.951 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-19T09:13:01.951 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-19T09:13:02.046 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-19T09:13:02.046 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:13:02.046 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-19T09:13:02.062 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:13:02.062 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-19T09:13:02.117 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T09:13:02.118 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:13:02.118 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-19T09:13:02.118 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-19T09:13:02.193 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:13:02.193 DEBUG:teuthology.orchestra.run.smithi018:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-19T09:13:02.249 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi162.front.sepia.ceph.com 2024-09-19T09:13:02.249 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:13:02.249 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-19T09:13:02.249 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-19T09:13:02.286 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:13:02.286 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-19T09:13:02.342 INFO:tasks.ceph:Setting up mon nodes... 2024-09-19T09:13:02.342 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-19T09:13:02.342 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-19T09:13:02.395 INFO:teuthology.orchestra.run.smithi018.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-19T09:13:02.397 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-19T09:13:02.461 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-19T09:13:02.464 INFO:tasks.ceph:Setting up mds nodes... 2024-09-19T09:13:02.464 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-19T09:13:02.517 INFO:teuthology.orchestra.run.smithi018.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-19T09:13:02.519 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-19T09:13:02.545 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-19T09:13:02.637 INFO:teuthology.orchestra.run.smithi018.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-19T09:13:02.640 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-19T09:13:02.665 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-19T09:13:02.716 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-19T09:13:02.719 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-19T09:13:02.744 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-19T09:13:02.835 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-19T09:13:02.838 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-19T09:13:02.863 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-19T09:13:02.863 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T09:13:02.905 INFO:teuthology.orchestra.run.smithi018.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-19T09:13:02.918 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-19T09:13:03.001 INFO:teuthology.orchestra.run.smithi018.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-19T09:13:03.014 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-19T09:13:03.055 INFO:teuthology.orchestra.run.smithi162.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-19T09:13:03.068 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-19T09:13:03.149 INFO:teuthology.orchestra.run.smithi162.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-19T09:13:03.162 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-19T09:13:03.162 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi018.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi162.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-19T09:13:03.162 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-19T09:13:03.188 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T09:13:03.188 INFO:tasks.ceph:role: osd.0 2024-09-19T09:13:03.188 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T09:13:03.188 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-19T09:13:03.253 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T09:13:03.253 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T09:13:03.253 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T09:13:03.253 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T09:13:03.253 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T09:13:03.253 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-09-19T09:13:03.253 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T09:13:03.253 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T09:13:03.253 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T09:13:03.254 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T09:13:03.285 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-09-19T09:13:03.287 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-09-19T09:13:03.287 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-19T09:13:03.357 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-19T09:13:03.428 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-19T09:13:03.494 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T09:13:03.494 INFO:tasks.ceph:role: osd.1 2024-09-19T09:13:03.494 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T09:13:03.494 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-19T09:13:03.559 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T09:13:03.559 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T09:13:03.559 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T09:13:03.560 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T09:13:03.560 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T09:13:03.560 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-09-19T09:13:03.560 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T09:13:03.560 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T09:13:03.560 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T09:13:03.560 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T09:13:03.591 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-09-19T09:13:03.594 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-09-19T09:13:03.594 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-19T09:13:03.664 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-19T09:13:03.735 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-19T09:13:03.801 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T09:13:03.801 INFO:tasks.ceph:role: osd.2 2024-09-19T09:13:03.801 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T09:13:03.801 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-19T09:13:03.867 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T09:13:03.867 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T09:13:03.867 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T09:13:03.867 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T09:13:03.867 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T09:13:03.867 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-09-19T09:13:03.867 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T09:13:03.867 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T09:13:03.867 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T09:13:03.867 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T09:13:03.899 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-09-19T09:13:03.901 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-09-19T09:13:03.901 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-19T09:13:03.971 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-19T09:13:04.042 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-19T09:13:04.108 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-19T09:13:04.108 INFO:tasks.ceph:role: osd.3 2024-09-19T09:13:04.108 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T09:13:04.108 DEBUG:teuthology.orchestra.run.smithi018:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-19T09:13:04.173 INFO:teuthology.orchestra.run.smithi018.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T09:13:04.173 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T09:13:04.173 INFO:teuthology.orchestra.run.smithi018.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T09:13:04.173 INFO:teuthology.orchestra.run.smithi018.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T09:13:04.173 INFO:teuthology.orchestra.run.smithi018.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T09:13:04.173 INFO:teuthology.orchestra.run.smithi018.stdout: = sunit=0 swidth=0 blks 2024-09-19T09:13:04.173 INFO:teuthology.orchestra.run.smithi018.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T09:13:04.173 INFO:teuthology.orchestra.run.smithi018.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T09:13:04.173 INFO:teuthology.orchestra.run.smithi018.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T09:13:04.173 INFO:teuthology.orchestra.run.smithi018.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T09:13:04.205 INFO:teuthology.orchestra.run.smithi018.stdout:Discarding blocks...Done. 2024-09-19T09:13:04.208 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi018.front.sepia.ceph.com -o noatime 2024-09-19T09:13:04.208 DEBUG:teuthology.orchestra.run.smithi018:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-19T09:13:04.277 DEBUG:teuthology.orchestra.run.smithi018:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-19T09:13:04.348 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T09:13:04.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:04.441+0000 7f006bbbf640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-19T09:13:04.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:04.441+0000 7f006bbbf640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-19T09:13:04.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:04.442+0000 7f006bbbf640 -1 memstore(/var/lib/ceph/osd/ceph-0) /var/lib/ceph/osd/ceph-0 2024-09-19T09:13:04.448 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-19T09:13:04.474 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T09:13:04.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:04.560+0000 7fe5337c1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-19T09:13:04.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:04.560+0000 7fe5337c1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-19T09:13:04.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:04.560+0000 7fe5337c1640 -1 memstore(/var/lib/ceph/osd/ceph-1) /var/lib/ceph/osd/ceph-1 2024-09-19T09:13:04.566 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-19T09:13:04.592 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T09:13:04.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:04.678+0000 7fea06428640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-19T09:13:04.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:04.678+0000 7fea06428640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-19T09:13:04.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:04.678+0000 7fea06428640 -1 memstore(/var/lib/ceph/osd/ceph-2) /var/lib/ceph/osd/ceph-2 2024-09-19T09:13:04.685 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-19T09:13:04.710 DEBUG:teuthology.orchestra.run.smithi018:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T09:13:04.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:04.796+0000 7fb4d4c14640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-19T09:13:04.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:04.797+0000 7fb4d4c14640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-19T09:13:04.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:04.797+0000 7fb4d4c14640 -1 memstore(/var/lib/ceph/osd/ceph-3) /var/lib/ceph/osd/ceph-3 2024-09-19T09:13:04.803 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-19T09:13:04.828 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-19T09:13:04.858 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T09:13:04.858 INFO:tasks.ceph:role: osd.4 2024-09-19T09:13:04.858 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi162.front.sepia.ceph.com 2024-09-19T09:13:04.858 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-19T09:13:04.934 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T09:13:04.934 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T09:13:04.934 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T09:13:04.934 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T09:13:04.934 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T09:13:04.934 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-09-19T09:13:04.935 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T09:13:04.935 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T09:13:04.935 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T09:13:04.935 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T09:13:05.434 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-09-19T09:13:05.436 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-09-19T09:13:05.436 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-19T09:13:05.556 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-19T09:13:05.590 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-19T09:13:05.657 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T09:13:05.657 INFO:tasks.ceph:role: osd.5 2024-09-19T09:13:05.657 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi162.front.sepia.ceph.com 2024-09-19T09:13:05.657 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-19T09:13:05.732 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T09:13:05.732 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T09:13:05.732 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T09:13:05.732 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T09:13:05.732 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T09:13:05.732 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-09-19T09:13:05.732 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T09:13:05.732 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T09:13:05.732 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T09:13:05.732 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T09:13:06.191 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-09-19T09:13:06.193 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-09-19T09:13:06.193 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-19T09:13:06.279 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-19T09:13:06.307 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-19T09:13:06.373 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T09:13:06.373 INFO:tasks.ceph:role: osd.6 2024-09-19T09:13:06.374 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi162.front.sepia.ceph.com 2024-09-19T09:13:06.374 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-19T09:13:06.446 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T09:13:06.446 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T09:13:06.446 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T09:13:06.446 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T09:13:06.446 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T09:13:06.447 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-09-19T09:13:06.447 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T09:13:06.447 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T09:13:06.447 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T09:13:06.447 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T09:13:06.930 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-09-19T09:13:06.932 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-09-19T09:13:06.933 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-19T09:13:07.064 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-19T09:13:07.096 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-19T09:13:07.161 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-19T09:13:07.161 INFO:tasks.ceph:role: osd.7 2024-09-19T09:13:07.161 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi162.front.sepia.ceph.com 2024-09-19T09:13:07.161 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-19T09:13:07.233 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T09:13:07.233 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T09:13:07.233 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T09:13:07.234 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T09:13:07.234 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T09:13:07.234 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-09-19T09:13:07.234 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T09:13:07.234 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T09:13:07.234 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T09:13:07.234 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T09:13:07.754 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-09-19T09:13:07.756 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-09-19T09:13:07.756 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-19T09:13:07.893 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-19T09:13:07.926 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T09:13:08.033 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:08.033+0000 7fcefec18640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-19T09:13:08.033 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:08.033+0000 7fcefec18640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-19T09:13:08.033 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:08.033+0000 7fcefec18640 -1 memstore(/var/lib/ceph/osd/ceph-4) /var/lib/ceph/osd/ceph-4 2024-09-19T09:13:08.043 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-19T09:13:08.068 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T09:13:08.154 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:08.153+0000 7f474393e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-19T09:13:08.154 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:08.154+0000 7f474393e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-19T09:13:08.154 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:08.154+0000 7f474393e640 -1 memstore(/var/lib/ceph/osd/ceph-5) /var/lib/ceph/osd/ceph-5 2024-09-19T09:13:08.160 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-19T09:13:08.185 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T09:13:08.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:08.270+0000 7f0d7ec1d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-19T09:13:08.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:08.270+0000 7f0d7ec1d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-19T09:13:08.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:08.270+0000 7f0d7ec1d640 -1 memstore(/var/lib/ceph/osd/ceph-6) /var/lib/ceph/osd/ceph-6 2024-09-19T09:13:08.278 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-19T09:13:08.303 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T09:13:08.388 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:08.388+0000 7fe21360e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-19T09:13:08.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:08.388+0000 7fe21360e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-19T09:13:08.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:08.389+0000 7fe21360e640 -1 memstore(/var/lib/ceph/osd/ceph-7) /var/lib/ceph/osd/ceph-7 2024-09-19T09:13:08.395 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-19T09:13:08.420 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-19T09:13:08.420 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:13:08.420 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-19T09:13:08.452 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:13:08.452 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-19T09:13:08.522 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:13:08.522 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-19T09:13:08.591 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:13:08.591 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-19T09:13:08.659 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:13:08.659 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-19T09:13:08.726 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:13:08.726 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-19T09:13:08.793 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:13:08.793 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-19T09:13:08.859 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:13:08.859 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-19T09:13:08.884 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:13:08.885 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-19T09:13:08.949 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:13:08.949 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-19T09:13:09.013 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:13:09.014 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-19T09:13:09.078 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:13:09.078 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-19T09:13:09.142 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:13:09.143 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-19T09:13:09.207 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:13:09.208 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-19T09:13:09.273 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:13:09.273 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-19T09:13:09.292 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:13:09.292 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-19T09:13:09.350 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:13:09.350 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-19T09:13:09.365 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:13:09.366 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-19T09:13:09.421 INFO:tasks.ceph:Adding keys to all mons... 2024-09-19T09:13:09.421 DEBUG:teuthology.orchestra.run.smithi018:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-19T09:13:09.424 DEBUG:teuthology.orchestra.run.smithi162:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-19T09:13:09.465 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr.y] 2024-09-19T09:13:09.465 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAe6+tmBWOWFxAAEYKCroBhMcqoIe6WzXnNCg== 2024-09-19T09:13:09.465 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.a] 2024-09-19T09:13:09.465 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAe6+tmDY7cHhAALxtxGq6eR3A2QXYp+nW0FA== 2024-09-19T09:13:09.465 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.c] 2024-09-19T09:13:09.465 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAe6+tmwPkOJhAADt/0XVei2kl79pIw55wu1A== 2024-09-19T09:13:09.465 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.0] 2024-09-19T09:13:09.465 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAg6+tmkUBiGhAATWtnqNPWyZJ+tnQcZOtT5A== 2024-09-19T09:13:09.465 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.1] 2024-09-19T09:13:09.465 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAg6+tmir5wIRAA9QumyCr8yLHtNj/YqQ1d0A== 2024-09-19T09:13:09.465 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.2] 2024-09-19T09:13:09.466 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAg6+tmfQJ6KBAAfTerKv1zCzFf6UfAVUikxA== 2024-09-19T09:13:09.466 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.3] 2024-09-19T09:13:09.466 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAg6+tmSeSOLxAACqCpiIQO4cDyjXUmoGPKAQ== 2024-09-19T09:13:09.466 INFO:teuthology.orchestra.run.smithi018.stdout:[mgr.x] 2024-09-19T09:13:09.466 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAe6+tmwr6NGxAA3M5NZKkjc36L25teWJS7bQ== 2024-09-19T09:13:09.466 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.b] 2024-09-19T09:13:09.466 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAe6+tm9ILFKhAABEtgvzO5YBXqzYaeBZ0qZg== 2024-09-19T09:13:09.466 INFO:teuthology.orchestra.run.smithi018.stdout:[mds.d] 2024-09-19T09:13:09.466 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAe6+tm35XYMRAA/OSE5iv8M+TekEJVTARETw== 2024-09-19T09:13:09.467 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.4] 2024-09-19T09:13:09.467 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAk6+tmrsoFAhAArI7cRPVe/jrnSdmyE8jCsQ== 2024-09-19T09:13:09.467 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.5] 2024-09-19T09:13:09.467 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAk6+tmudM3CRAAXF3uI58SNJE6qtYX2wNQeQ== 2024-09-19T09:13:09.467 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.6] 2024-09-19T09:13:09.467 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAk6+tmqEQmEBAAm4h/8p91HwX84pl/U80Q9Q== 2024-09-19T09:13:09.467 INFO:teuthology.orchestra.run.smithi018.stdout:[osd.7] 2024-09-19T09:13:09.467 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAk6+tmhDs0FxAAxZvRVkBoWqsdmyifRZzgwg== 2024-09-19T09:13:09.467 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-09-19T09:13:09.467 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAe6+tmcbwDNhAAaG0+wu96Locwws+h0zeh8Q== 2024-09-19T09:13:09.467 INFO:teuthology.orchestra.run.smithi018.stdout:[client.2] 2024-09-19T09:13:09.467 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAf6+tmc34kABAAC5b4Kkm2dJvxxyXva6PT2g== 2024-09-19T09:13:09.467 INFO:teuthology.orchestra.run.smithi018.stdout:[client.1] 2024-09-19T09:13:09.467 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAf6+tmb4FeAxAAU+nZN/Vb33HrU0yfXmU9gA== 2024-09-19T09:13:09.467 INFO:teuthology.orchestra.run.smithi018.stdout:[client.3] 2024-09-19T09:13:09.468 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAf6+tmx4vzCBAAZ7ZrdGI2s8LqT0MjjzOCjw== 2024-09-19T09:13:09.484 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr.y] 2024-09-19T09:13:09.484 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAe6+tmBWOWFxAAEYKCroBhMcqoIe6WzXnNCg== 2024-09-19T09:13:09.485 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.a] 2024-09-19T09:13:09.485 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAe6+tmDY7cHhAALxtxGq6eR3A2QXYp+nW0FA== 2024-09-19T09:13:09.485 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.c] 2024-09-19T09:13:09.485 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAe6+tmwPkOJhAADt/0XVei2kl79pIw55wu1A== 2024-09-19T09:13:09.485 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.0] 2024-09-19T09:13:09.485 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAg6+tmkUBiGhAATWtnqNPWyZJ+tnQcZOtT5A== 2024-09-19T09:13:09.485 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.1] 2024-09-19T09:13:09.485 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAg6+tmir5wIRAA9QumyCr8yLHtNj/YqQ1d0A== 2024-09-19T09:13:09.485 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.2] 2024-09-19T09:13:09.485 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAg6+tmfQJ6KBAAfTerKv1zCzFf6UfAVUikxA== 2024-09-19T09:13:09.485 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.3] 2024-09-19T09:13:09.485 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAg6+tmSeSOLxAACqCpiIQO4cDyjXUmoGPKAQ== 2024-09-19T09:13:09.485 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr.x] 2024-09-19T09:13:09.486 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAe6+tmwr6NGxAA3M5NZKkjc36L25teWJS7bQ== 2024-09-19T09:13:09.486 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.b] 2024-09-19T09:13:09.486 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAe6+tm9ILFKhAABEtgvzO5YBXqzYaeBZ0qZg== 2024-09-19T09:13:09.486 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.d] 2024-09-19T09:13:09.486 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAe6+tm35XYMRAA/OSE5iv8M+TekEJVTARETw== 2024-09-19T09:13:09.486 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.4] 2024-09-19T09:13:09.486 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAk6+tmrsoFAhAArI7cRPVe/jrnSdmyE8jCsQ== 2024-09-19T09:13:09.486 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.5] 2024-09-19T09:13:09.486 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAk6+tmudM3CRAAXF3uI58SNJE6qtYX2wNQeQ== 2024-09-19T09:13:09.486 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.6] 2024-09-19T09:13:09.486 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAk6+tmqEQmEBAAm4h/8p91HwX84pl/U80Q9Q== 2024-09-19T09:13:09.486 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.7] 2024-09-19T09:13:09.486 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAk6+tmhDs0FxAAxZvRVkBoWqsdmyifRZzgwg== 2024-09-19T09:13:09.487 INFO:teuthology.orchestra.run.smithi162.stdout:[client.0] 2024-09-19T09:13:09.487 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAe6+tmcbwDNhAAaG0+wu96Locwws+h0zeh8Q== 2024-09-19T09:13:09.487 INFO:teuthology.orchestra.run.smithi162.stdout:[client.2] 2024-09-19T09:13:09.487 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAf6+tmc34kABAAC5b4Kkm2dJvxxyXva6PT2g== 2024-09-19T09:13:09.487 INFO:teuthology.orchestra.run.smithi162.stdout:[client.1] 2024-09-19T09:13:09.487 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAf6+tmb4FeAxAAU+nZN/Vb33HrU0yfXmU9gA== 2024-09-19T09:13:09.487 INFO:teuthology.orchestra.run.smithi162.stdout:[client.3] 2024-09-19T09:13:09.487 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQAf6+tmx4vzCBAAZ7ZrdGI2s8LqT0MjjzOCjw== 2024-09-19T09:13:09.488 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T09:13:09.512 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T09:13:09.579 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T09:13:09.581 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T09:13:09.637 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T09:13:09.639 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T09:13:09.693 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:13:09.695 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:13:09.746 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:13:09.748 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:13:09.799 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:13:09.801 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:13:09.852 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:13:09.854 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:13:09.906 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T09:13:09.908 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T09:13:09.959 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T09:13:09.962 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T09:13:10.017 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T09:13:10.019 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-19T09:13:10.072 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:13:10.075 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:13:10.125 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:13:10.128 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:13:10.179 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:13:10.181 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:13:10.232 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:13:10.235 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T09:13:10.285 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T09:13:10.287 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T09:13:10.341 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T09:13:10.343 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T09:13:10.397 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T09:13:10.400 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T09:13:10.454 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T09:13:10.457 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T09:13:10.510 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-19T09:13:10.510 DEBUG:teuthology.orchestra.run.smithi018:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-19T09:13:10.535 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-19T09:13:10.633 DEBUG:teuthology.orchestra.run.smithi018:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-19T09:13:10.658 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-19T09:13:10.683 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-19T09:13:10.782 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-19T09:13:10.806 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-19T09:13:10.871 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-19T09:13:10.966 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-19T09:13:10.991 DEBUG:teuthology.orchestra.run.smithi018:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-19T09:13:10.994 DEBUG:teuthology.orchestra.run.smithi162:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-19T09:13:11.046 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-19T09:13:11.046 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-19T09:13:11.046 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-19T09:13:11.049 INFO:tasks.ceph.mon.a:Started 2024-09-19T09:13:11.049 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-19T09:13:11.050 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-19T09:13:11.088 INFO:tasks.ceph.mon.b:Started 2024-09-19T09:13:11.089 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-19T09:13:11.089 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-19T09:13:11.091 INFO:tasks.ceph.mon.c:Started 2024-09-19T09:13:11.091 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-19T09:13:11.091 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-19T09:13:11.091 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-19T09:13:11.093 INFO:tasks.ceph.mgr.y:Started 2024-09-19T09:13:11.093 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-19T09:13:11.093 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-19T09:13:11.095 INFO:tasks.ceph.mgr.x:Started 2024-09-19T09:13:11.095 INFO:tasks.ceph:Setting crush tunables to default 2024-09-19T09:13:11.096 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph osd crush tunables default 2024-09-19T09:13:11.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.197+0000 7f2331d66640 1 Processor -- start 2024-09-19T09:13:11.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.198+0000 7f2331d66640 1 -- start start 2024-09-19T09:13:11.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.198+0000 7f2331d66640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f232c155f20 0x7f232c15cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:11.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.198+0000 7f2331d66640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f232c072640 0x7f232c072aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:11.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.198+0000 7f2331d66640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f232c156300 con 0x7f232c0b5530 2024-09-19T09:13:11.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.198+0000 7f2331d66640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f232c072fe0 con 0x7f232c072640 2024-09-19T09:13:11.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.198+0000 7f2331d66640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f232c0b62f0 con 0x7f232c155f20 2024-09-19T09:13:11.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.199+0000 7f232b7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f232c155f20 0x7f232c15cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:11.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.199+0000 7f232affd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f232c072640 0x7f232c072aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:11.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.199+0000 7f232b7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f232c155f20 0x7f232c15cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:48170/0 (socket says 172.21.15.18:48170) 2024-09-19T09:13:11.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.199+0000 7f232b7fe640 1 -- 172.21.15.18:0/2378459189 learned_addr learned my addr 172.21.15.18:0/2378459189 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:11.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.199+0000 7f232b7fe640 1 -- 172.21.15.18:0/2378459189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f232c155f20 msgr2=0x7f232c15cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-19T09:13:11.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.199+0000 7f232b7fe640 1 -- 172.21.15.18:0/2378459189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f232c155f20 msgr2=0x7f232c15cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:13:11.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.199+0000 7f232b7fe640 1 --2- 172.21.15.18:0/2378459189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f232c155f20 0x7f232c15cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:13:11.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.199+0000 7f232b7fe640 1 --2- 172.21.15.18:0/2378459189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f232c155f20 0x7f232c15cfd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:13:11.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.199+0000 7f232affd640 1 -- 172.21.15.18:0/2378459189 >> v2:172.21.15.162:3300/0 conn(0x7f232c072640 msgr2=0x7f232c072aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-19T09:13:11.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.199+0000 7f232affd640 1 -- 172.21.15.18:0/2378459189 >> v2:172.21.15.162:3300/0 conn(0x7f232c072640 msgr2=0x7f232c072aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-19T09:13:11.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.199+0000 7f232affd640 1 --2- 172.21.15.18:0/2378459189 >> v2:172.21.15.162:3300/0 conn(0x7f232c072640 0x7f232c072aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T09:13:11.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.199+0000 7f232affd640 1 --2- 172.21.15.18:0/2378459189 >> v2:172.21.15.162:3300/0 conn(0x7f232c072640 0x7f232c072aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T09:13:11.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.366+0000 7f232a7fc640 1 -- 172.21.15.18:0/2378459189 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2764289546 0 0) 0x7f232c156300 con 0x7f232c0b5530 2024-09-19T09:13:11.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.366+0000 7f232a7fc640 1 -- 172.21.15.18:0/2378459189 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2314003520 con 0x7f232c0b5530 2024-09-19T09:13:11.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.371+0000 7f232a7fc640 1 -- 172.21.15.18:0/2378459189 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 139415553 0 0) 0x7f2314003520 con 0x7f232c0b5530 2024-09-19T09:13:11.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.371+0000 7f232a7fc640 1 -- 172.21.15.18:0/2378459189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f232c155f20 msgr2=0x7f232c15cfd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:13:11.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.371+0000 7f232a7fc640 1 --2- 172.21.15.18:0/2378459189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f232c155f20 0x7f232c15cfd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:11.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.371+0000 7f232a7fc640 1 -- 172.21.15.18:0/2378459189 >> v2:172.21.15.162:3300/0 conn(0x7f232c072640 msgr2=0x7f232c072aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:13:11.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.371+0000 7f232a7fc640 1 --2- 172.21.15.18:0/2378459189 >> v2:172.21.15.162:3300/0 conn(0x7f232c072640 0x7f232c072aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:11.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.371+0000 7f232a7fc640 1 -- 172.21.15.18:0/2378459189 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f232c06ea00 con 0x7f232c0b5530 2024-09-19T09:13:11.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.371+0000 7f232a7fc640 1 -- 172.21.15.18:0/2378459189 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f23240019f0 con 0x7f232c0b5530 2024-09-19T09:13:11.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.371+0000 7f232a7fc640 1 -- 172.21.15.18:0/2378459189 >> v1:172.21.15.162:6789/0 conn(0x7f232c0b5530 legacy=0x7f232c0b59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:11.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.371+0000 7f232a7fc640 1 --2- 172.21.15.18:0/2378459189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23140039b0 0x7f2314003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:11.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.371+0000 7f232a7fc640 1 --2- 172.21.15.18:0/2378459189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f232c155f20 0x7f2314004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:11.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.371+0000 7f232a7fc640 1 --2- 172.21.15.18:0/2378459189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2314004d40 0x7f23140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:11.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.371+0000 7f232a7fc640 1 -- 172.21.15.18:0/2378459189 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f232c0b62f0 con 0x7f2314004d40 2024-09-19T09:13:11.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.371+0000 7f232a7fc640 1 -- 172.21.15.18:0/2378459189 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f231400ba70 con 0x7f23140039b0 2024-09-19T09:13:11.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.371+0000 7f232a7fc640 1 -- 172.21.15.18:0/2378459189 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f231400bc70 con 0x7f232c155f20 2024-09-19T09:13:11.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.371+0000 7f232bfff640 1 --2- 172.21.15.18:0/2378459189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2314004d40 0x7f23140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:11.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.371+0000 7f232b7fe640 1 --2- 172.21.15.18:0/2378459189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23140039b0 0x7f2314003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:11.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.371+0000 7f232affd640 1 --2- 172.21.15.18:0/2378459189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f232c155f20 0x7f2314004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:11.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.372+0000 7f232bfff640 1 -- 172.21.15.18:0/2378459189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f232c155f20 msgr2=0x7f2314004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:11.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.372+0000 7f232bfff640 1 --2- 172.21.15.18:0/2378459189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f232c155f20 0x7f2314004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:11.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.372+0000 7f232bfff640 1 -- 172.21.15.18:0/2378459189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23140039b0 msgr2=0x7f2314003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:11.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.372+0000 7f232bfff640 1 --2- 172.21.15.18:0/2378459189 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23140039b0 0x7f2314003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:11.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.372+0000 7f232bfff640 1 -- 172.21.15.18:0/2378459189 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2314003520 con 0x7f2314004d40 2024-09-19T09:13:11.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.372+0000 7f232bfff640 1 --2- 172.21.15.18:0/2378459189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2314004d40 0x7f23140051c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f232400c3e0 tx=0x7f2314005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1029e3059b47c252 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:11.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.373+0000 7f232a7fc640 1 -- 172.21.15.18:0/2378459189 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2324033070 con 0x7f2314004d40 2024-09-19T09:13:11.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.373+0000 7f232a7fc640 1 -- 172.21.15.18:0/2378459189 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f232402f6a0 con 0x7f2314004d40 2024-09-19T09:13:11.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.373+0000 7f232a7fc640 1 -- 172.21.15.18:0/2378459189 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232400c0e0 con 0x7f2314004d40 2024-09-19T09:13:11.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.374+0000 7f2331d66640 1 -- 172.21.15.18:0/2378459189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2314004d40 msgr2=0x7f23140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:11.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.374+0000 7f2331d66640 1 --2- 172.21.15.18:0/2378459189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2314004d40 0x7f23140051c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f232400c3e0 tx=0x7f2314005830 comp rx=0 tx=0).stop 2024-09-19T09:13:11.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.374+0000 7f232bfff640 1 -- 172.21.15.18:0/2378459189 reap_dead start 2024-09-19T09:13:11.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.374+0000 7f2331d66640 1 -- 172.21.15.18:0/2378459189 shutdown_connections 2024-09-19T09:13:11.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.374+0000 7f2331d66640 1 -- 172.21.15.18:0/2378459189 >> 172.21.15.18:0/2378459189 conn(0x7f232c06cd20 msgr2=0x7f232c06d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:11.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.374+0000 7f2331d66640 1 -- 172.21.15.18:0/2378459189 shutdown_connections 2024-09-19T09:13:11.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.374+0000 7f2331d66640 1 -- 172.21.15.18:0/2378459189 wait complete. 2024-09-19T09:13:11.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.375+0000 7f2331d66640 1 Processor -- start 2024-09-19T09:13:11.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.375+0000 7f2331d66640 1 -- start start 2024-09-19T09:13:11.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.376+0000 7f2331d66640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2314004d40 0x7f232c149000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:11.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.376+0000 7f2331d66640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f232c15ae90 0x7f232c15c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:11.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.376+0000 7f2331d66640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f232c15c6d0 0x7f232c158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:11.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.376+0000 7f2331d66640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f232c15cfd0 con 0x7f232c15ae90 2024-09-19T09:13:11.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.376+0000 7f2331d66640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f232c06efc0 con 0x7f232c15c6d0 2024-09-19T09:13:11.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.376+0000 7f2331d66640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f232c15d150 con 0x7f2314004d40 2024-09-19T09:13:11.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.376+0000 7f232affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f232c15ae90 0x7f232c15c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:11.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.376+0000 7f232b7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2314004d40 0x7f232c149000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:11.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.376+0000 7f232affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f232c15ae90 0x7f232c15c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41932/0 (socket says 172.21.15.18:41932) 2024-09-19T09:13:11.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.376+0000 7f232b7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2314004d40 0x7f232c149000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:48212/0 (socket says 172.21.15.18:48212) 2024-09-19T09:13:11.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.376+0000 7f232affd640 1 -- 172.21.15.18:0/2788401210 learned_addr learned my addr 172.21.15.18:0/2788401210 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:11.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.376+0000 7f232bfff640 1 --2- 172.21.15.18:0/2788401210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f232c15c6d0 0x7f232c158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:11.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.377+0000 7f232affd640 1 -- 172.21.15.18:0/2788401210 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2314004d40 msgr2=0x7f232c149000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:11.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.377+0000 7f232affd640 1 --2- 172.21.15.18:0/2788401210 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2314004d40 0x7f232c149000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:11.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.377+0000 7f232affd640 1 -- 172.21.15.18:0/2788401210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f232c15c6d0 msgr2=0x7f232c158420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:11.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.377+0000 7f232affd640 1 --2- 172.21.15.18:0/2788401210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f232c15c6d0 0x7f232c158420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:11.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.377+0000 7f232affd640 1 -- 172.21.15.18:0/2788401210 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f232c157da0 con 0x7f232c15ae90 2024-09-19T09:13:11.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.377+0000 7f232affd640 1 --2- 172.21.15.18:0/2788401210 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f232c15ae90 0x7f232c15c190 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f23200108f0 tx=0x7f2320010db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:11.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.377+0000 7f2313fff640 1 -- 172.21.15.18:0/2788401210 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232001a020 con 0x7f232c15ae90 2024-09-19T09:13:11.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.377+0000 7f2313fff640 1 -- 172.21.15.18:0/2788401210 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f232000e940 con 0x7f232c15ae90 2024-09-19T09:13:11.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.377+0000 7f2313fff640 1 -- 172.21.15.18:0/2788401210 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232000ed10 con 0x7f232c15ae90 2024-09-19T09:13:11.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.377+0000 7f2331d66640 1 -- 172.21.15.18:0/2788401210 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f232c158080 con 0x7f232c15ae90 2024-09-19T09:13:11.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.377+0000 7f2331d66640 1 -- 172.21.15.18:0/2788401210 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f232c15a970 con 0x7f232c15ae90 2024-09-19T09:13:11.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.377+0000 7f2313fff640 1 -- 172.21.15.18:0/2788401210 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f232001d020 con 0x7f232c15ae90 2024-09-19T09:13:11.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.377+0000 7f2313fff640 1 -- 172.21.15.18:0/2788401210 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f2320014910 con 0x7f232c15ae90 2024-09-19T09:13:11.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.378+0000 7f2331d66640 1 -- 172.21.15.18:0/2788401210 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f232c069700 con 0x7f232c15ae90 2024-09-19T09:13:11.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.380+0000 7f2313fff640 1 -- 172.21.15.18:0/2788401210 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f2320024020 con 0x7f232c15ae90 2024-09-19T09:13:11.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.444+0000 7f2331d66640 1 -- 172.21.15.18:0/2788401210 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f232c15d530 con 0x7f232c15ae90 2024-09-19T09:13:11.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.446+0000 7f2313fff640 1 -- 172.21.15.18:0/2788401210 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f2320014430 con 0x7f232c15ae90 2024-09-19T09:13:11.446 INFO:teuthology.orchestra.run.smithi018.stderr:adjusted tunables profile to default 2024-09-19T09:13:11.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.447+0000 7f2331d66640 1 -- 172.21.15.18:0/2788401210 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f232c15ae90 msgr2=0x7f232c15c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:11.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.447+0000 7f2331d66640 1 --2- 172.21.15.18:0/2788401210 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f232c15ae90 0x7f232c15c190 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f23200108f0 tx=0x7f2320010db0 comp rx=0 tx=0).stop 2024-09-19T09:13:11.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.447+0000 7f2331d66640 1 -- 172.21.15.18:0/2788401210 shutdown_connections 2024-09-19T09:13:11.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.447+0000 7f2331d66640 1 --2- 172.21.15.18:0/2788401210 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f232c15c6d0 0x7f232c158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:11.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.447+0000 7f2331d66640 1 --2- 172.21.15.18:0/2788401210 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f232c15ae90 0x7f232c15c190 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:11.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.447+0000 7f2331d66640 1 --2- 172.21.15.18:0/2788401210 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2314004d40 0x7f232c149000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:11.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.447+0000 7f2331d66640 1 -- 172.21.15.18:0/2788401210 >> 172.21.15.18:0/2788401210 conn(0x7f232c06cd20 msgr2=0x7f232c153710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:11.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.447+0000 7f2331d66640 1 -- 172.21.15.18:0/2788401210 shutdown_connections 2024-09-19T09:13:11.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:11.447+0000 7f2331d66640 1 -- 172.21.15.18:0/2788401210 wait complete. 2024-09-19T09:13:11.458 INFO:tasks.ceph:check_enable_crimson: False 2024-09-19T09:13:11.458 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-19T09:13:11.458 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:13:11.458 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-19T09:13:11.467 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-09-19T09:13:11.467+0000 7f924582d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T09:13:11.471 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-19T09:13:11.471+0000 7fc879732040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T09:13:11.483 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:13:11.483 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-19T09:13:11.507 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-09-19T09:13:11.507+0000 7f924582d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:13:11.514 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-19T09:13:11.514+0000 7fc879732040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T09:13:11.539 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:13:11.539 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-19T09:13:11.605 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:13:11.605 DEBUG:teuthology.orchestra.run.smithi018:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-19T09:13:11.650 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-09-19T09:13:11.650+0000 7f924582d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:13:11.671 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:13:11.671 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-19T09:13:11.675 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-19T09:13:11.675+0000 7fc879732040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T09:13:11.696 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:13:11.696 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-19T09:13:11.702 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-09-19T09:13:11.702+0000 7f924582d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:13:11.726 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:13:11.726 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-19T09:13:11.728 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-19T09:13:11.728+0000 7fc879732040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T09:13:11.791 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:13:11.791 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-19T09:13:11.856 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 0 2024-09-19T09:13:11.884 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-09-19T09:13:11.883+0000 7f924582d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:13:11.901 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-19T09:13:11.901+0000 7fc879732040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:13:11.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.982+0000 7f0255c8d640 1 Processor -- start 2024-09-19T09:13:11.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.983+0000 7f0255c8d640 1 -- start start 2024-09-19T09:13:11.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.983+0000 7f0255c8d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0250146440 0x7f02500b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:11.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.983+0000 7f0255c8d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f025015e200 con 0x7f02500b6c20 2024-09-19T09:13:11.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.983+0000 7f0255c8d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f025015e4e0 con 0x7f02500b5f40 2024-09-19T09:13:11.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.983+0000 7f0255c8d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f025015e7c0 con 0x7f0250146440 2024-09-19T09:13:11.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.984+0000 7f024effd640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f02500b5f40 0x7f02500b6510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:45258/0 (socket says 172.21.15.162:45258) 2024-09-19T09:13:11.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.984+0000 7f024f7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0250146440 0x7f02500b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:11.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.984+0000 7f024effd640 1 -- 172.21.15.162:0/486625881 learned_addr learned my addr 172.21.15.162:0/486625881 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-09-19T09:13:11.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.984+0000 7f024e7fc640 1 -- 172.21.15.162:0/486625881 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1405384777 0 0) 0x7f025015e4e0 con 0x7f02500b5f40 2024-09-19T09:13:11.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.984+0000 7f024f7fe640 1 -- 172.21.15.162:0/486625881 >> v1:172.21.15.162:6789/0 conn(0x7f02500b5f40 legacy=0x7f02500b6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:11.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.984+0000 7f024f7fe640 1 -- 172.21.15.162:0/486625881 >> v1:172.21.15.18:6789/0 conn(0x7f02500b6c20 legacy=0x7f025015f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:11.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.984+0000 7f024f7fe640 1 -- 172.21.15.162:0/486625881 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f025015eaa0 con 0x7f0250146440 2024-09-19T09:13:11.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.985+0000 7f024f7fe640 1 --2- 172.21.15.162:0/486625881 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0250146440 0x7f02500b5a00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f02440097d0 tx=0x7f024402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83f0d0085e128d31 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:11.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.985+0000 7f024e7fc640 1 -- 172.21.15.162:0/486625881 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244037070 con 0x7f0250146440 2024-09-19T09:13:11.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.985+0000 7f024e7fc640 1 -- 172.21.15.162:0/486625881 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0244032440 con 0x7f0250146440 2024-09-19T09:13:11.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.985+0000 7f024e7fc640 1 -- 172.21.15.162:0/486625881 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244032810 con 0x7f0250146440 2024-09-19T09:13:11.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.985+0000 7f0255c8d640 1 -- 172.21.15.162:0/486625881 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0250146440 msgr2=0x7f02500b5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:11.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.985+0000 7f0255c8d640 1 --2- 172.21.15.162:0/486625881 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0250146440 0x7f02500b5a00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f02440097d0 tx=0x7f024402a210 comp rx=0 tx=0).stop 2024-09-19T09:13:11.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.985+0000 7f0255c8d640 1 -- 172.21.15.162:0/486625881 shutdown_connections 2024-09-19T09:13:11.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.985+0000 7f0255c8d640 1 --2- 172.21.15.162:0/486625881 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0250146440 0x7f02500b5a00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:11.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.985+0000 7f0255c8d640 1 -- 172.21.15.162:0/486625881 >> 172.21.15.162:0/486625881 conn(0x7f0250073d60 msgr2=0x7f025009b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:11.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.985+0000 7f0255c8d640 1 -- 172.21.15.162:0/486625881 shutdown_connections 2024-09-19T09:13:11.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.985+0000 7f0255c8d640 1 -- 172.21.15.162:0/486625881 wait complete. 2024-09-19T09:13:11.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.987+0000 7f0255c8d640 1 Processor -- start 2024-09-19T09:13:11.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.988+0000 7f0255c8d640 1 -- start start 2024-09-19T09:13:11.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.989+0000 7f0255c8d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02500b5f40 0x7f0250140990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:11.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.989+0000 7f0255c8d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02500b6c20 0x7f02501e72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:11.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.989+0000 7f0255c8d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0250146440 0x7f02501f1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:11.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.989+0000 7f0255c8d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0250146820 con 0x7f02500b6c20 2024-09-19T09:13:11.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.989+0000 7f0255c8d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f025009cb60 con 0x7f0250146440 2024-09-19T09:13:11.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.989+0000 7f0255c8d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f02501469a0 con 0x7f02500b5f40 2024-09-19T09:13:11.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.989+0000 7f024f7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02500b5f40 0x7f0250140990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:11.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.989+0000 7f024f7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02500b5f40 0x7f0250140990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:46440/0 (socket says 172.21.15.162:46440) 2024-09-19T09:13:11.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.989+0000 7f024f7fe640 1 -- 172.21.15.162:0/2293115177 learned_addr learned my addr 172.21.15.162:0/2293115177 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T09:13:11.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.989+0000 7f024ffff640 1 --2- 172.21.15.162:0/2293115177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0250146440 0x7f02501f1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:11.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.989+0000 7f024effd640 1 --2- 172.21.15.162:0/2293115177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02500b6c20 0x7f02501e72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:11.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.989+0000 7f024f7fe640 1 -- 172.21.15.162:0/2293115177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0250146440 msgr2=0x7f02501f1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:11.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.989+0000 7f024f7fe640 1 --2- 172.21.15.162:0/2293115177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0250146440 0x7f02501f1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:11.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.989+0000 7f024f7fe640 1 -- 172.21.15.162:0/2293115177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02500b6c20 msgr2=0x7f02501e72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:11.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.989+0000 7f024f7fe640 1 --2- 172.21.15.162:0/2293115177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02500b6c20 0x7f02501e72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:11.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.989+0000 7f024f7fe640 1 -- 172.21.15.162:0/2293115177 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02501e7d40 con 0x7f02500b5f40 2024-09-19T09:13:11.992 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.989+0000 7f024f7fe640 1 --2- 172.21.15.162:0/2293115177 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02500b5f40 0x7f0250140990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0244035040 tx=0x7f02440046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:11.992 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.990+0000 7f0237fff640 1 -- 172.21.15.162:0/2293115177 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244042020 con 0x7f02500b5f40 2024-09-19T09:13:11.992 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.990+0000 7f0237fff640 1 -- 172.21.15.162:0/2293115177 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0244030990 con 0x7f02500b5f40 2024-09-19T09:13:11.992 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.990+0000 7f0255c8d640 1 -- 172.21.15.162:0/2293115177 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02501f2c90 con 0x7f02500b5f40 2024-09-19T09:13:11.992 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.990+0000 7f0237fff640 1 -- 172.21.15.162:0/2293115177 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244037040 con 0x7f02500b5f40 2024-09-19T09:13:11.992 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.990+0000 7f0255c8d640 1 -- 172.21.15.162:0/2293115177 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f02501e6590 con 0x7f02500b5f40 2024-09-19T09:13:11.992 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.990+0000 7f0237fff640 1 -- 172.21.15.162:0/2293115177 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0244045020 con 0x7f02500b5f40 2024-09-19T09:13:11.992 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.990+0000 7f0237fff640 1 -- 172.21.15.162:0/2293115177 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f024403e420 con 0x7f02500b5f40 2024-09-19T09:13:11.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.991+0000 7f0255c8d640 1 -- 172.21.15.162:0/2293115177 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f025015ddd0 con 0x7f02500b5f40 2024-09-19T09:13:11.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:11.995+0000 7f0237fff640 1 -- 172.21.15.162:0/2293115177 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f024404c030 con 0x7f02500b5f40 2024-09-19T09:13:12.003 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-09-19T09:13:12.003+0000 7f924582d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:13:12.016 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-19T09:13:12.016+0000 7fc879732040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T09:13:12.062 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.062+0000 7f0255c8d640 1 -- 172.21.15.162:0/2293115177 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0} v 0) -- 0x7f02500b70d0 con 0x7f02500b5f40 2024-09-19T09:13:12.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.066+0000 7f0237fff640 1 -- 172.21.15.162:0/2293115177 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f0244030e10 con 0x7f02500b5f40 2024-09-19T09:13:12.066 INFO:teuthology.orchestra.run.smithi162.stdout:0 2024-09-19T09:13:12.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.067+0000 7f0255c8d640 1 -- 172.21.15.162:0/2293115177 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02500b5f40 msgr2=0x7f0250140990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.067+0000 7f0255c8d640 1 --2- 172.21.15.162:0/2293115177 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02500b5f40 0x7f0250140990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0244035040 tx=0x7f02440046c0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.067+0000 7f0255c8d640 1 -- 172.21.15.162:0/2293115177 shutdown_connections 2024-09-19T09:13:12.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.067+0000 7f0255c8d640 1 --2- 172.21.15.162:0/2293115177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0250146440 0x7f02501f1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.067+0000 7f0255c8d640 1 --2- 172.21.15.162:0/2293115177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02500b6c20 0x7f02501e72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.067+0000 7f0255c8d640 1 --2- 172.21.15.162:0/2293115177 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02500b5f40 0x7f0250140990 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.067+0000 7f0255c8d640 1 -- 172.21.15.162:0/2293115177 >> 172.21.15.162:0/2293115177 conn(0x7f0250073d60 msgr2=0x7f025009cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:12.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.067+0000 7f0255c8d640 1 -- 172.21.15.162:0/2293115177 shutdown_connections 2024-09-19T09:13:12.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.067+0000 7f0255c8d640 1 -- 172.21.15.162:0/2293115177 wait complete. 2024-09-19T09:13:12.078 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 1 2024-09-19T09:13:12.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.177+0000 7f4428b78640 1 Processor -- start 2024-09-19T09:13:12.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.177+0000 7f4428b78640 1 -- start start 2024-09-19T09:13:12.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.178+0000 7f4428b78640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44240b22d0 0x7f44240b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:12.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.178+0000 7f4428b78640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4424163900 con 0x7f4424073960 2024-09-19T09:13:12.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.178+0000 7f4428b78640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44240b2bf0 con 0x7f442406c400 2024-09-19T09:13:12.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.178+0000 7f4428b78640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4424162b40 con 0x7f44240b22d0 2024-09-19T09:13:12.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.178+0000 7f4421d9b640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f442406c400 0x7f4424073250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:45260/0 (socket says 172.21.15.162:45260) 2024-09-19T09:13:12.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.178+0000 7f442259c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44240b22d0 0x7f44240b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:12.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.178+0000 7f4421d9b640 1 -- 172.21.15.162:0/3461027309 learned_addr learned my addr 172.21.15.162:0/3461027309 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-09-19T09:13:12.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.178+0000 7f442159a640 1 -- 172.21.15.162:0/3461027309 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4020553978 0 0) 0x7f44240b2bf0 con 0x7f442406c400 2024-09-19T09:13:12.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.178+0000 7f442159a640 1 -- 172.21.15.162:0/3461027309 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f440c003520 con 0x7f442406c400 2024-09-19T09:13:12.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.178+0000 7f442259c640 1 -- 172.21.15.162:0/3461027309 >> v1:172.21.15.162:6789/0 conn(0x7f442406c400 legacy=0x7f4424073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.178+0000 7f442259c640 1 -- 172.21.15.162:0/3461027309 >> v1:172.21.15.18:6789/0 conn(0x7f4424073960 legacy=0x7f4424169d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.178+0000 7f442259c640 1 -- 172.21.15.162:0/3461027309 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4424162e20 con 0x7f44240b22d0 2024-09-19T09:13:12.181 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.179+0000 7f442259c640 1 --2- 172.21.15.162:0/3461027309 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44240b22d0 0x7f44240b26b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f44140097d0 tx=0x7f441402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa89ca85ce7cecb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:12.181 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.180+0000 7f442159a640 1 -- 172.21.15.162:0/3461027309 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4414037070 con 0x7f44240b22d0 2024-09-19T09:13:12.181 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.180+0000 7f442159a640 1 -- 172.21.15.162:0/3461027309 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4414032440 con 0x7f44240b22d0 2024-09-19T09:13:12.181 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.180+0000 7f442159a640 1 -- 172.21.15.162:0/3461027309 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4414032810 con 0x7f44240b22d0 2024-09-19T09:13:12.181 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.180+0000 7f4428b78640 1 -- 172.21.15.162:0/3461027309 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44240b22d0 msgr2=0x7f44240b26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.181 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.180+0000 7f4428b78640 1 --2- 172.21.15.162:0/3461027309 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44240b22d0 0x7f44240b26b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f44140097d0 tx=0x7f441402a210 comp rx=0 tx=0).stop 2024-09-19T09:13:12.182 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.180+0000 7f4428b78640 1 -- 172.21.15.162:0/3461027309 shutdown_connections 2024-09-19T09:13:12.182 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.180+0000 7f4428b78640 1 --2- 172.21.15.162:0/3461027309 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44240b22d0 0x7f44240b26b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.182 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.180+0000 7f4428b78640 1 -- 172.21.15.162:0/3461027309 >> 172.21.15.162:0/3461027309 conn(0x7f44240b5fc0 msgr2=0x7f44240b6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:12.182 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.180+0000 7f4428b78640 1 -- 172.21.15.162:0/3461027309 shutdown_connections 2024-09-19T09:13:12.182 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.180+0000 7f4428b78640 1 -- 172.21.15.162:0/3461027309 wait complete. 2024-09-19T09:13:12.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.182+0000 7f4428b78640 1 Processor -- start 2024-09-19T09:13:12.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.182+0000 7f4428b78640 1 -- start start 2024-09-19T09:13:12.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.182+0000 7f4428b78640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f442406c400 0x7f44241f89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:12.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.182+0000 7f4428b78640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4424073960 0x7f44241f48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:12.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.182+0000 7f4428b78640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44240b22d0 0x7f442409b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:12.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.182+0000 7f4428b78640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f44240af150 con 0x7f442406c400 2024-09-19T09:13:12.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.182+0000 7f4428b78640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f44241633e0 con 0x7f44240b22d0 2024-09-19T09:13:12.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.182+0000 7f4428b78640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f44240af2d0 con 0x7f4424073960 2024-09-19T09:13:12.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.183+0000 7f4422d9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44240b22d0 0x7f442409b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:12.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.183+0000 7f4421d9b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4424073960 0x7f44241f48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:12.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.183+0000 7f4422d9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44240b22d0 0x7f442409b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51108/0 (socket says 172.21.15.162:51108) 2024-09-19T09:13:12.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.183+0000 7f4422d9d640 1 -- 172.21.15.162:0/3599049155 learned_addr learned my addr 172.21.15.162:0/3599049155 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T09:13:12.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.183+0000 7f442259c640 1 --2- 172.21.15.162:0/3599049155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f442406c400 0x7f44241f89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:12.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.183+0000 7f4422d9d640 1 -- 172.21.15.162:0/3599049155 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4424073960 msgr2=0x7f44241f48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.183+0000 7f4422d9d640 1 --2- 172.21.15.162:0/3599049155 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4424073960 0x7f44241f48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.183+0000 7f4422d9d640 1 -- 172.21.15.162:0/3599049155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f442406c400 msgr2=0x7f44241f89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.183+0000 7f4422d9d640 1 --2- 172.21.15.162:0/3599049155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f442406c400 0x7f44241f89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.183+0000 7f4422d9d640 1 -- 172.21.15.162:0/3599049155 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f442409b9f0 con 0x7f44240b22d0 2024-09-19T09:13:12.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.183+0000 7f4421d9b640 1 --2- 172.21.15.162:0/3599049155 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4424073960 0x7f44241f48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:13:12.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.183+0000 7f4422d9d640 1 --2- 172.21.15.162:0/3599049155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44240b22d0 0x7f442409b250 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f441c00c7a0 tx=0x7f441c00cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:12.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.183+0000 7f4412ffd640 1 -- 172.21.15.162:0/3599049155 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c003b70 con 0x7f44240b22d0 2024-09-19T09:13:12.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.183+0000 7f4412ffd640 1 -- 172.21.15.162:0/3599049155 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f441c003d30 con 0x7f44240b22d0 2024-09-19T09:13:12.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.183+0000 7f4428b78640 1 -- 172.21.15.162:0/3599049155 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f442409bcd0 con 0x7f44240b22d0 2024-09-19T09:13:12.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.183+0000 7f4412ffd640 1 -- 172.21.15.162:0/3599049155 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441c00aa90 con 0x7f44240b22d0 2024-09-19T09:13:12.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.183+0000 7f4428b78640 1 -- 172.21.15.162:0/3599049155 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f442409c290 con 0x7f44240b22d0 2024-09-19T09:13:12.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.183+0000 7f4412ffd640 1 -- 172.21.15.162:0/3599049155 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f441c00ac30 con 0x7f44240b22d0 2024-09-19T09:13:12.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.183+0000 7f4412ffd640 1 -- 172.21.15.162:0/3599049155 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f441c012650 con 0x7f44240b22d0 2024-09-19T09:13:12.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.184+0000 7f4428b78640 1 -- 172.21.15.162:0/3599049155 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44241601d0 con 0x7f44240b22d0 2024-09-19T09:13:12.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.187+0000 7f4412ffd640 1 -- 172.21.15.162:0/3599049155 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f441c0128a0 con 0x7f44240b22d0 2024-09-19T09:13:12.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.254+0000 7f4428b78640 1 -- 172.21.15.162:0/3599049155 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1} v 0) -- 0x7f44240d1eb0 con 0x7f44240b22d0 2024-09-19T09:13:12.257 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.257+0000 7f4412ffd640 1 -- 172.21.15.162:0/3599049155 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f441c012a80 con 0x7f44240b22d0 2024-09-19T09:13:12.258 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-09-19T09:13:12.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.258+0000 7f4428b78640 1 -- 172.21.15.162:0/3599049155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44240b22d0 msgr2=0x7f442409b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.258+0000 7f4428b78640 1 --2- 172.21.15.162:0/3599049155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44240b22d0 0x7f442409b250 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f441c00c7a0 tx=0x7f441c00cc60 comp rx=0 tx=0).stop 2024-09-19T09:13:12.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.258+0000 7f4428b78640 1 -- 172.21.15.162:0/3599049155 shutdown_connections 2024-09-19T09:13:12.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.258+0000 7f4428b78640 1 --2- 172.21.15.162:0/3599049155 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44240b22d0 0x7f442409b250 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.258+0000 7f4428b78640 1 --2- 172.21.15.162:0/3599049155 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4424073960 0x7f44241f48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.258+0000 7f4428b78640 1 --2- 172.21.15.162:0/3599049155 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f442406c400 0x7f44241f89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.258+0000 7f4428b78640 1 -- 172.21.15.162:0/3599049155 >> 172.21.15.162:0/3599049155 conn(0x7f44240b5fc0 msgr2=0x7f44240b65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:12.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.258+0000 7f4428b78640 1 -- 172.21.15.162:0/3599049155 shutdown_connections 2024-09-19T09:13:12.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.258+0000 7f4428b78640 1 -- 172.21.15.162:0/3599049155 wait complete. 2024-09-19T09:13:12.269 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 2 2024-09-19T09:13:12.339 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-09-19T09:13:12.339+0000 7f924582d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:13:12.354 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-19T09:13:12.353+0000 7fc879732040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T09:13:12.368 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.367+0000 7fb652cac640 1 Processor -- start 2024-09-19T09:13:12.368 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.368+0000 7fb652cac640 1 -- start start 2024-09-19T09:13:12.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.368+0000 7fb652cac640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb64c0b5a40 0x7fb64c166410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:12.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.368+0000 7fb652cac640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb64c06f9f0 con 0x7fb64c15ca50 2024-09-19T09:13:12.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.368+0000 7fb652cac640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb64c06fcd0 con 0x7fb64c156040 2024-09-19T09:13:12.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.368+0000 7fb652cac640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb64c06ffb0 con 0x7fb64c0b5a40 2024-09-19T09:13:12.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.368+0000 7fb650a48640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fb64c156040 0x7fb64c06f1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:45266/0 (socket says 172.21.15.162:45266) 2024-09-19T09:13:12.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.368+0000 7fb650a48640 1 -- 172.21.15.162:0/3305747716 learned_addr learned my addr 172.21.15.162:0/3305747716 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-09-19T09:13:12.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.368+0000 7fb651249640 1 --2- 172.21.15.162:0/3305747716 >> v2:172.21.15.162:3300/0 conn(0x7fb64c0b5a40 0x7fb64c166410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:12.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.369+0000 7fb64b7fe640 1 -- 172.21.15.162:0/3305747716 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1327894754 0 0) 0x7fb64c06fcd0 con 0x7fb64c156040 2024-09-19T09:13:12.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.369+0000 7fb64b7fe640 1 -- 172.21.15.162:0/3305747716 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb63c003520 con 0x7fb64c156040 2024-09-19T09:13:12.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.369+0000 7fb651249640 1 -- 172.21.15.162:0/3305747716 >> v1:172.21.15.162:6789/0 conn(0x7fb64c156040 legacy=0x7fb64c06f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.369+0000 7fb64b7fe640 1 -- 172.21.15.162:0/3305747716 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3715826690 0 0) 0x7fb64c06f9f0 con 0x7fb64c15ca50 2024-09-19T09:13:12.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.369+0000 7fb651249640 1 -- 172.21.15.162:0/3305747716 >> v1:172.21.15.18:6789/0 conn(0x7fb64c15ca50 legacy=0x7fb64c0b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.369+0000 7fb651249640 1 -- 172.21.15.162:0/3305747716 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb64c070290 con 0x7fb64c0b5a40 2024-09-19T09:13:12.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.370+0000 7fb651249640 1 --2- 172.21.15.162:0/3305747716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb64c0b5a40 0x7fb64c166410 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb644009d90 tx=0x7fb64402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca3b7c3ee5cb946 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:12.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.370+0000 7fb64b7fe640 1 -- 172.21.15.162:0/3305747716 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb644007740 con 0x7fb64c0b5a40 2024-09-19T09:13:12.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.370+0000 7fb64b7fe640 1 -- 172.21.15.162:0/3305747716 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6440078e0 con 0x7fb64c0b5a40 2024-09-19T09:13:12.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.370+0000 7fb64b7fe640 1 -- 172.21.15.162:0/3305747716 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb644007cb0 con 0x7fb64c0b5a40 2024-09-19T09:13:12.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.371+0000 7fb652cac640 1 -- 172.21.15.162:0/3305747716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb64c0b5a40 msgr2=0x7fb64c166410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.371+0000 7fb652cac640 1 --2- 172.21.15.162:0/3305747716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb64c0b5a40 0x7fb64c166410 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb644009d90 tx=0x7fb64402a660 comp rx=0 tx=0).stop 2024-09-19T09:13:12.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.371+0000 7fb652cac640 1 -- 172.21.15.162:0/3305747716 shutdown_connections 2024-09-19T09:13:12.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.371+0000 7fb652cac640 1 --2- 172.21.15.162:0/3305747716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb64c0b5a40 0x7fb64c166410 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.371+0000 7fb652cac640 1 -- 172.21.15.162:0/3305747716 >> 172.21.15.162:0/3305747716 conn(0x7fb64c06cd20 msgr2=0x7fb64c06d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:12.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.371+0000 7fb652cac640 1 -- 172.21.15.162:0/3305747716 shutdown_connections 2024-09-19T09:13:12.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.371+0000 7fb652cac640 1 -- 172.21.15.162:0/3305747716 wait complete. 2024-09-19T09:13:12.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.372+0000 7fb652cac640 1 Processor -- start 2024-09-19T09:13:12.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.372+0000 7fb652cac640 1 -- start start 2024-09-19T09:13:12.375 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.373+0000 7fb652cac640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb64c0b5a40 0x7fb64c1584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:12.375 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.373+0000 7fb652cac640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb64c156040 0x7fb64c158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:12.375 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.373+0000 7fb652cac640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb64c15ca50 0x7fb64c15ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:12.375 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.373+0000 7fb652cac640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb64c15e410 con 0x7fb64c15ca50 2024-09-19T09:13:12.375 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.373+0000 7fb652cac640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb64c15e290 con 0x7fb64c0b5a40 2024-09-19T09:13:12.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.373+0000 7fb652cac640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb64c15e590 con 0x7fb64c156040 2024-09-19T09:13:12.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.373+0000 7fb650a48640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb64c0b5a40 0x7fb64c1584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:12.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.373+0000 7fb64bfff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb64c156040 0x7fb64c158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:12.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.373+0000 7fb650a48640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb64c0b5a40 0x7fb64c1584c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51124/0 (socket says 172.21.15.162:51124) 2024-09-19T09:13:12.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.373+0000 7fb650a48640 1 -- 172.21.15.162:0/1571993807 learned_addr learned my addr 172.21.15.162:0/1571993807 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T09:13:12.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.373+0000 7fb651249640 1 --2- 172.21.15.162:0/1571993807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb64c15ca50 0x7fb64c15ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:12.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.373+0000 7fb64bfff640 1 -- 172.21.15.162:0/1571993807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb64c0b5a40 msgr2=0x7fb64c1584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.373+0000 7fb64bfff640 1 --2- 172.21.15.162:0/1571993807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb64c0b5a40 0x7fb64c1584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.373+0000 7fb64bfff640 1 -- 172.21.15.162:0/1571993807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb64c15ca50 msgr2=0x7fb64c15ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.373+0000 7fb64bfff640 1 --2- 172.21.15.162:0/1571993807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb64c15ca50 0x7fb64c15ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.373+0000 7fb64bfff640 1 -- 172.21.15.162:0/1571993807 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb64c15a800 con 0x7fb64c156040 2024-09-19T09:13:12.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.373+0000 7fb650a48640 1 --2- 172.21.15.162:0/1571993807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb64c0b5a40 0x7fb64c1584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:13:12.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.373+0000 7fb64bfff640 1 --2- 172.21.15.162:0/1571993807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb64c156040 0x7fb64c158a00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb63800c410 tx=0x7fb63800c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:12.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.374+0000 7fb6497fa640 1 -- 172.21.15.162:0/1571993807 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb638017070 con 0x7fb64c156040 2024-09-19T09:13:12.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.374+0000 7fb6497fa640 1 -- 172.21.15.162:0/1571993807 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6380035f0 con 0x7fb64c156040 2024-09-19T09:13:12.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.374+0000 7fb652cac640 1 -- 172.21.15.162:0/1571993807 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb64c159a40 con 0x7fb64c156040 2024-09-19T09:13:12.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.374+0000 7fb6497fa640 1 -- 172.21.15.162:0/1571993807 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb638003a20 con 0x7fb64c156040 2024-09-19T09:13:12.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.374+0000 7fb652cac640 1 -- 172.21.15.162:0/1571993807 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb64c15a000 con 0x7fb64c156040 2024-09-19T09:13:12.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.374+0000 7fb6497fa640 1 -- 172.21.15.162:0/1571993807 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb63801a070 con 0x7fb64c156040 2024-09-19T09:13:12.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.374+0000 7fb6497fa640 1 -- 172.21.15.162:0/1571993807 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fb638012820 con 0x7fb64c156040 2024-09-19T09:13:12.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.375+0000 7fb652cac640 1 -- 172.21.15.162:0/1571993807 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb64c150d80 con 0x7fb64c156040 2024-09-19T09:13:12.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.377+0000 7fb6497fa640 1 -- 172.21.15.162:0/1571993807 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fb638021070 con 0x7fb64c156040 2024-09-19T09:13:12.406 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-09-19T09:13:12.406+0000 7f924582d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:13:12.413 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-19T09:13:12.413+0000 7fc879732040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T09:13:12.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.445+0000 7fb652cac640 1 -- 172.21.15.162:0/1571993807 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2} v 0) -- 0x7fb64c0b2e50 con 0x7fb64c156040 2024-09-19T09:13:12.448 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.448+0000 7fb6497fa640 1 -- 172.21.15.162:0/1571993807 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fb638012400 con 0x7fb64c156040 2024-09-19T09:13:12.448 INFO:teuthology.orchestra.run.smithi162.stdout:2 2024-09-19T09:13:12.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.449+0000 7fb652cac640 1 -- 172.21.15.162:0/1571993807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb64c156040 msgr2=0x7fb64c158a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.449+0000 7fb652cac640 1 --2- 172.21.15.162:0/1571993807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb64c156040 0x7fb64c158a00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb63800c410 tx=0x7fb63800c810 comp rx=0 tx=0).stop 2024-09-19T09:13:12.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.449+0000 7fb652cac640 1 -- 172.21.15.162:0/1571993807 shutdown_connections 2024-09-19T09:13:12.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.449+0000 7fb652cac640 1 --2- 172.21.15.162:0/1571993807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb64c15ca50 0x7fb64c15ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.449+0000 7fb652cac640 1 --2- 172.21.15.162:0/1571993807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb64c156040 0x7fb64c158a00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.449+0000 7fb652cac640 1 --2- 172.21.15.162:0/1571993807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb64c0b5a40 0x7fb64c1584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.449+0000 7fb652cac640 1 -- 172.21.15.162:0/1571993807 >> 172.21.15.162:0/1571993807 conn(0x7fb64c06cd20 msgr2=0x7fb64c154640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:12.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.449+0000 7fb652cac640 1 -- 172.21.15.162:0/1571993807 shutdown_connections 2024-09-19T09:13:12.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.449+0000 7fb652cac640 1 -- 172.21.15.162:0/1571993807 wait complete. 2024-09-19T09:13:12.460 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 3 2024-09-19T09:13:12.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.558+0000 7f6eebbf8640 1 Processor -- start 2024-09-19T09:13:12.559 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.558+0000 7f6eebbf8640 1 -- start start 2024-09-19T09:13:12.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.559+0000 7f6eebbf8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6ee4072640 0x7f6ee4072aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:12.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.559+0000 7f6eebbf8640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ee4156300 con 0x7f6ee4155f20 2024-09-19T09:13:12.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.559+0000 7f6eebbf8640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ee40b62f0 con 0x7f6ee40b5530 2024-09-19T09:13:12.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.559+0000 7f6eebbf8640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6ee40b60d0 con 0x7f6ee4072640 2024-09-19T09:13:12.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.559+0000 7f6ee9193640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6ee4072640 0x7f6ee4072aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:12.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.559+0000 7f6eea195640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f6ee40b5530 0x7f6ee40b59c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:45270/0 (socket says 172.21.15.162:45270) 2024-09-19T09:13:12.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.559+0000 7f6eea195640 1 -- 172.21.15.162:0/4046673398 learned_addr learned my addr 172.21.15.162:0/4046673398 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-09-19T09:13:12.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.559+0000 7f6ee9193640 1 -- 172.21.15.162:0/4046673398 >> v1:172.21.15.162:6789/0 conn(0x7f6ee40b5530 legacy=0x7f6ee40b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.559+0000 7f6ee9193640 1 -- 172.21.15.162:0/4046673398 >> v1:172.21.15.18:6789/0 conn(0x7f6ee4155f20 legacy=0x7f6ee415cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.559+0000 7f6ee8992640 1 -- 172.21.15.162:0/4046673398 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2162774322 0 0) 0x7f6ee40b62f0 con 0x7f6ee40b5530 2024-09-19T09:13:12.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.559+0000 7f6ee9193640 1 -- 172.21.15.162:0/4046673398 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee406ea00 con 0x7f6ee4072640 2024-09-19T09:13:12.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.560+0000 7f6ee9193640 1 --2- 172.21.15.162:0/4046673398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ee4072640 0x7f6ee4072aa0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6ee00097a0 tx=0x7f6ee002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=505663e1ee16de55 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:12.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.560+0000 7f6ee8992640 1 -- 172.21.15.162:0/4046673398 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0037070 con 0x7f6ee4072640 2024-09-19T09:13:12.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.560+0000 7f6ee8992640 1 -- 172.21.15.162:0/4046673398 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ee0032440 con 0x7f6ee4072640 2024-09-19T09:13:12.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.560+0000 7f6ee8992640 1 -- 172.21.15.162:0/4046673398 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee0032810 con 0x7f6ee4072640 2024-09-19T09:13:12.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.561+0000 7f6eebbf8640 1 -- 172.21.15.162:0/4046673398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ee4072640 msgr2=0x7f6ee4072aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.561+0000 7f6eebbf8640 1 --2- 172.21.15.162:0/4046673398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ee4072640 0x7f6ee4072aa0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6ee00097a0 tx=0x7f6ee002a230 comp rx=0 tx=0).stop 2024-09-19T09:13:12.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.561+0000 7f6eebbf8640 1 -- 172.21.15.162:0/4046673398 shutdown_connections 2024-09-19T09:13:12.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.561+0000 7f6eebbf8640 1 --2- 172.21.15.162:0/4046673398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ee4072640 0x7f6ee4072aa0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.561+0000 7f6eebbf8640 1 -- 172.21.15.162:0/4046673398 >> 172.21.15.162:0/4046673398 conn(0x7f6ee406cd20 msgr2=0x7f6ee406d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:12.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.561+0000 7f6eebbf8640 1 -- 172.21.15.162:0/4046673398 shutdown_connections 2024-09-19T09:13:12.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.561+0000 7f6eebbf8640 1 -- 172.21.15.162:0/4046673398 wait complete. 2024-09-19T09:13:12.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.563+0000 7f6eebbf8640 1 Processor -- start 2024-09-19T09:13:12.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.563+0000 7f6eebbf8640 1 -- start start 2024-09-19T09:13:12.564 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-09-19T09:13:12.563+0000 7f924582d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:13:12.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.564+0000 7f6eebbf8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ee4072640 0x7f6ee4151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:12.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.564+0000 7f6eebbf8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee40b5530 0x7f6ee415aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:12.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.564+0000 7f6eebbf8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ee4155f20 0x7f6ee415c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:12.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.564+0000 7f6eebbf8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee406efc0 con 0x7f6ee40b5530 2024-09-19T09:13:12.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.564+0000 7f6eebbf8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee406f7c0 con 0x7f6ee4072640 2024-09-19T09:13:12.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.564+0000 7f6eebbf8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6ee406f940 con 0x7f6ee4155f20 2024-09-19T09:13:12.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.564+0000 7f6ee9994640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ee4072640 0x7f6ee4151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:12.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.564+0000 7f6ee9994640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ee4072640 0x7f6ee4151ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51140/0 (socket says 172.21.15.162:51140) 2024-09-19T09:13:12.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.564+0000 7f6ee9994640 1 -- 172.21.15.162:0/1484853181 learned_addr learned my addr 172.21.15.162:0/1484853181 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T09:13:12.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.564+0000 7f6eea195640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ee4155f20 0x7f6ee415c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:12.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.564+0000 7f6ee9193640 1 --2- 172.21.15.162:0/1484853181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee40b5530 0x7f6ee415aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:12.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.564+0000 7f6eea195640 1 -- 172.21.15.162:0/1484853181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ee4072640 msgr2=0x7f6ee4151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.564+0000 7f6eea195640 1 --2- 172.21.15.162:0/1484853181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ee4072640 0x7f6ee4151ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.564+0000 7f6eea195640 1 -- 172.21.15.162:0/1484853181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee40b5530 msgr2=0x7f6ee415aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.564+0000 7f6eea195640 1 --2- 172.21.15.162:0/1484853181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee40b5530 0x7f6ee415aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.565+0000 7f6eea195640 1 -- 172.21.15.162:0/1484853181 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee415b3e0 con 0x7f6ee4155f20 2024-09-19T09:13:12.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.565+0000 7f6ee9994640 1 --2- 172.21.15.162:0/1484853181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ee4072640 0x7f6ee4151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:13:12.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.565+0000 7f6eea195640 1 --2- 172.21.15.162:0/1484853181 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ee4155f20 0x7f6ee415c720 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6edc00c6d0 tx=0x7f6edc00cb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:12.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.565+0000 7f6eda7fc640 1 -- 172.21.15.162:0/1484853181 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6edc018070 con 0x7f6ee4155f20 2024-09-19T09:13:12.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.565+0000 7f6eda7fc640 1 -- 172.21.15.162:0/1484853181 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6edc004d60 con 0x7f6ee4155f20 2024-09-19T09:13:12.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.565+0000 7f6eebbf8640 1 -- 172.21.15.162:0/1484853181 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ee415b680 con 0x7f6ee4155f20 2024-09-19T09:13:12.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.565+0000 7f6eda7fc640 1 -- 172.21.15.162:0/1484853181 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6edc00a880 con 0x7f6ee4155f20 2024-09-19T09:13:12.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.565+0000 7f6eebbf8640 1 -- 172.21.15.162:0/1484853181 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ee415bc40 con 0x7f6ee4155f20 2024-09-19T09:13:12.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.565+0000 7f6eda7fc640 1 -- 172.21.15.162:0/1484853181 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6edc01b070 con 0x7f6ee4155f20 2024-09-19T09:13:12.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.565+0000 7f6eda7fc640 1 -- 172.21.15.162:0/1484853181 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f6edc007990 con 0x7f6ee4155f20 2024-09-19T09:13:12.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.566+0000 7f6eebbf8640 1 -- 172.21.15.162:0/1484853181 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ee40b4f00 con 0x7f6ee4155f20 2024-09-19T09:13:12.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.570+0000 7f6eda7fc640 1 -- 172.21.15.162:0/1484853181 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6ee40b4f00 con 0x7f6ee4155f20 2024-09-19T09:13:12.571 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-19T09:13:12.571+0000 7fc879732040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T09:13:12.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.637+0000 7f6eebbf8640 1 -- 172.21.15.162:0/1484853181 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3} v 0) -- 0x7f6ee4072aa0 con 0x7f6ee4155f20 2024-09-19T09:13:12.641 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.641+0000 7f6eda7fc640 1 -- 172.21.15.162:0/1484853181 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f6edc012400 con 0x7f6ee4155f20 2024-09-19T09:13:12.641 INFO:teuthology.orchestra.run.smithi162.stdout:3 2024-09-19T09:13:12.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.642+0000 7f6eebbf8640 1 -- 172.21.15.162:0/1484853181 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ee4155f20 msgr2=0x7f6ee415c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.642+0000 7f6eebbf8640 1 --2- 172.21.15.162:0/1484853181 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ee4155f20 0x7f6ee415c720 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6edc00c6d0 tx=0x7f6edc00cb90 comp rx=0 tx=0).stop 2024-09-19T09:13:12.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.642+0000 7f6eebbf8640 1 -- 172.21.15.162:0/1484853181 shutdown_connections 2024-09-19T09:13:12.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.642+0000 7f6eebbf8640 1 --2- 172.21.15.162:0/1484853181 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ee4155f20 0x7f6ee415c720 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.642+0000 7f6eebbf8640 1 --2- 172.21.15.162:0/1484853181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ee40b5530 0x7f6ee415aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.642+0000 7f6eebbf8640 1 --2- 172.21.15.162:0/1484853181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ee4072640 0x7f6ee4151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.642+0000 7f6eebbf8640 1 -- 172.21.15.162:0/1484853181 >> 172.21.15.162:0/1484853181 conn(0x7f6ee406cd20 msgr2=0x7f6ee40b59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:12.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.642+0000 7f6eebbf8640 1 -- 172.21.15.162:0/1484853181 shutdown_connections 2024-09-19T09:13:12.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.642+0000 7f6eebbf8640 1 -- 172.21.15.162:0/1484853181 wait complete. 2024-09-19T09:13:12.653 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 4 2024-09-19T09:13:12.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.750+0000 7fe70ff2c640 1 Processor -- start 2024-09-19T09:13:12.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.750+0000 7fe70ff2c640 1 -- start start 2024-09-19T09:13:12.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.751+0000 7fe70ff2c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe708073610 0x7fe70815f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:12.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.751+0000 7fe70ff2c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7080b4c50 con 0x7fe708159000 2024-09-19T09:13:12.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.751+0000 7fe70ff2c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe70815f740 con 0x7fe70806bc10 2024-09-19T09:13:12.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.751+0000 7fe70ff2c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe7080d1820 con 0x7fe708073610 2024-09-19T09:13:12.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.751+0000 7fe70d4c7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe708073610 0x7fe70815f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:12.753 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.751+0000 7fe70e4c9640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fe70806bc10 0x7fe70806c030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:45278/0 (socket says 172.21.15.162:45278) 2024-09-19T09:13:12.753 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.751+0000 7fe70e4c9640 1 -- 172.21.15.162:0/1600155172 learned_addr learned my addr 172.21.15.162:0/1600155172 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-09-19T09:13:12.753 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.752+0000 7fe70ccc6640 1 -- 172.21.15.162:0/1600155172 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2417493895 0 0) 0x7fe70815f740 con 0x7fe70806bc10 2024-09-19T09:13:12.753 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.752+0000 7fe70ccc6640 1 -- 172.21.15.162:0/1600155172 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6f4003520 con 0x7fe70806bc10 2024-09-19T09:13:12.753 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.752+0000 7fe70d4c7640 1 -- 172.21.15.162:0/1600155172 >> v1:172.21.15.162:6789/0 conn(0x7fe70806bc10 legacy=0x7fe70806c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.753 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.752+0000 7fe70ccc6640 1 -- 172.21.15.162:0/1600155172 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 249486036 0 0) 0x7fe7080b4c50 con 0x7fe708159000 2024-09-19T09:13:12.753 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.752+0000 7fe70d4c7640 1 -- 172.21.15.162:0/1600155172 >> v1:172.21.15.18:6789/0 conn(0x7fe708159000 legacy=0x7fe70806e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.753 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.752+0000 7fe70d4c7640 1 -- 172.21.15.162:0/1600155172 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe70815fa20 con 0x7fe708073610 2024-09-19T09:13:12.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.752+0000 7fe70d4c7640 1 --2- 172.21.15.162:0/1600155172 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe708073610 0x7fe70815f080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe7040097d0 tx=0x7fe70402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee4c3d7b6583bec5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:12.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.753+0000 7fe70ccc6640 1 -- 172.21.15.162:0/1600155172 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe704037070 con 0x7fe708073610 2024-09-19T09:13:12.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.753+0000 7fe70ccc6640 1 -- 172.21.15.162:0/1600155172 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe704032440 con 0x7fe708073610 2024-09-19T09:13:12.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.753+0000 7fe70ccc6640 1 -- 172.21.15.162:0/1600155172 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe704032810 con 0x7fe708073610 2024-09-19T09:13:12.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.753+0000 7fe70ff2c640 1 -- 172.21.15.162:0/1600155172 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe708073610 msgr2=0x7fe70815f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.753+0000 7fe70ff2c640 1 --2- 172.21.15.162:0/1600155172 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe708073610 0x7fe70815f080 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe7040097d0 tx=0x7fe70402a210 comp rx=0 tx=0).stop 2024-09-19T09:13:12.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.753+0000 7fe70ff2c640 1 -- 172.21.15.162:0/1600155172 shutdown_connections 2024-09-19T09:13:12.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.753+0000 7fe70ff2c640 1 --2- 172.21.15.162:0/1600155172 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe708073610 0x7fe70815f080 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.753+0000 7fe70ff2c640 1 -- 172.21.15.162:0/1600155172 >> 172.21.15.162:0/1600155172 conn(0x7fe70806cd20 msgr2=0x7fe70806d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:12.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.753+0000 7fe70ff2c640 1 -- 172.21.15.162:0/1600155172 shutdown_connections 2024-09-19T09:13:12.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.753+0000 7fe70ff2c640 1 -- 172.21.15.162:0/1600155172 wait complete. 2024-09-19T09:13:12.757 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.755+0000 7fe70ff2c640 1 Processor -- start 2024-09-19T09:13:12.757 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.755+0000 7fe70ff2c640 1 -- start start 2024-09-19T09:13:12.757 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.755+0000 7fe70ff2c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe70806bc10 0x7fe70815a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:12.757 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.755+0000 7fe70ff2c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe708073610 0x7fe7081584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:12.757 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.755+0000 7fe70ff2c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe708159000 0x7fe7081f56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:12.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.755+0000 7fe70ff2c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe70815ffe0 con 0x7fe708159000 2024-09-19T09:13:12.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.755+0000 7fe70ff2c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe70806ed90 con 0x7fe70806bc10 2024-09-19T09:13:12.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.755+0000 7fe70ff2c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe7081593e0 con 0x7fe708073610 2024-09-19T09:13:12.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.755+0000 7fe70d4c7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe708073610 0x7fe7081584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:12.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.755+0000 7fe70dcc8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe70806bc10 0x7fe70815a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:12.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.755+0000 7fe70d4c7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe708073610 0x7fe7081584b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:46480/0 (socket says 172.21.15.162:46480) 2024-09-19T09:13:12.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.755+0000 7fe70d4c7640 1 -- 172.21.15.162:0/3747478352 learned_addr learned my addr 172.21.15.162:0/3747478352 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T09:13:12.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.756+0000 7fe70e4c9640 1 --2- 172.21.15.162:0/3747478352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe708159000 0x7fe7081f56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:12.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.756+0000 7fe70d4c7640 1 -- 172.21.15.162:0/3747478352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe70806bc10 msgr2=0x7fe70815a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.756+0000 7fe70d4c7640 1 --2- 172.21.15.162:0/3747478352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe70806bc10 0x7fe70815a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.756+0000 7fe70d4c7640 1 -- 172.21.15.162:0/3747478352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe708159000 msgr2=0x7fe7081f56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.756+0000 7fe70d4c7640 1 --2- 172.21.15.162:0/3747478352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe708159000 0x7fe7081f56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.756+0000 7fe70d4c7640 1 -- 172.21.15.162:0/3747478352 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7081589f0 con 0x7fe708073610 2024-09-19T09:13:12.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.756+0000 7fe70d4c7640 1 --2- 172.21.15.162:0/3747478352 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe708073610 0x7fe7081584b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe704035040 tx=0x7fe7040046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:12.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.756+0000 7fe6fe7fc640 1 -- 172.21.15.162:0/3747478352 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe704041070 con 0x7fe708073610 2024-09-19T09:13:12.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.756+0000 7fe6fe7fc640 1 -- 172.21.15.162:0/3747478352 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe704004220 con 0x7fe708073610 2024-09-19T09:13:12.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.756+0000 7fe70ff2c640 1 -- 172.21.15.162:0/3747478352 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe70815ac30 con 0x7fe708073610 2024-09-19T09:13:12.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.756+0000 7fe6fe7fc640 1 -- 172.21.15.162:0/3747478352 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe704037040 con 0x7fe708073610 2024-09-19T09:13:12.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.756+0000 7fe70ff2c640 1 -- 172.21.15.162:0/3747478352 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7080cfa40 con 0x7fe708073610 2024-09-19T09:13:12.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.756+0000 7fe6fe7fc640 1 -- 172.21.15.162:0/3747478352 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe7040039a0 con 0x7fe708073610 2024-09-19T09:13:12.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.756+0000 7fe6fe7fc640 1 -- 172.21.15.162:0/3747478352 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fe704046450 con 0x7fe708073610 2024-09-19T09:13:12.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.757+0000 7fe70ff2c640 1 -- 172.21.15.162:0/3747478352 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe70815f080 con 0x7fe708073610 2024-09-19T09:13:12.761 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.761+0000 7fe6fe7fc640 1 -- 172.21.15.162:0/3747478352 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fe7081589f0 con 0x7fe708073610 2024-09-19T09:13:12.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.829+0000 7fe70ff2c640 1 -- 172.21.15.162:0/3747478352 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4} v 0) -- 0x7fe70806fd40 con 0x7fe708073610 2024-09-19T09:13:12.833 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.832+0000 7fe6fe7fc640 1 -- 172.21.15.162:0/3747478352 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fe704003dd0 con 0x7fe708073610 2024-09-19T09:13:12.833 INFO:teuthology.orchestra.run.smithi162.stdout:4 2024-09-19T09:13:12.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.833+0000 7fe70ff2c640 1 -- 172.21.15.162:0/3747478352 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe708073610 msgr2=0x7fe7081584b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.833+0000 7fe70ff2c640 1 --2- 172.21.15.162:0/3747478352 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe708073610 0x7fe7081584b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe704035040 tx=0x7fe7040046c0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.833+0000 7fe70ff2c640 1 -- 172.21.15.162:0/3747478352 shutdown_connections 2024-09-19T09:13:12.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.833+0000 7fe70ff2c640 1 --2- 172.21.15.162:0/3747478352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe708159000 0x7fe7081f56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.833+0000 7fe70ff2c640 1 --2- 172.21.15.162:0/3747478352 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe708073610 0x7fe7081584b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.833+0000 7fe70ff2c640 1 --2- 172.21.15.162:0/3747478352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe70806bc10 0x7fe70815a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.833+0000 7fe70ff2c640 1 -- 172.21.15.162:0/3747478352 >> 172.21.15.162:0/3747478352 conn(0x7fe70806cd20 msgr2=0x7fe7080b2db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:12.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.833+0000 7fe70ff2c640 1 -- 172.21.15.162:0/3747478352 shutdown_connections 2024-09-19T09:13:12.835 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.833+0000 7fe70ff2c640 1 -- 172.21.15.162:0/3747478352 wait complete. 2024-09-19T09:13:12.844 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 5 2024-09-19T09:13:12.953 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.952+0000 7f5dfdcac640 1 Processor -- start 2024-09-19T09:13:12.953 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.952+0000 7f5dfdcac640 1 -- start start 2024-09-19T09:13:12.954 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.953+0000 7f5dfdcac640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5df8073610 0x7f5df815f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:12.954 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.953+0000 7f5dfdcac640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5df80b4c50 con 0x7f5df8159000 2024-09-19T09:13:12.954 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.953+0000 7f5dfdcac640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5df815f740 con 0x7f5df806bc10 2024-09-19T09:13:12.954 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.953+0000 7f5dfdcac640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f5df80d1820 con 0x7f5df8073610 2024-09-19T09:13:12.955 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.953+0000 7f5df7fff640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f5df806bc10 0x7f5df80d1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:45290/0 (socket says 172.21.15.162:45290) 2024-09-19T09:13:12.955 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.953+0000 7f5df7fff640 1 -- 172.21.15.162:0/3430527594 learned_addr learned my addr 172.21.15.162:0/3430527594 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-09-19T09:13:12.955 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.953+0000 7f5deffff640 1 --2- 172.21.15.162:0/3430527594 >> v2:172.21.15.18:3300/0 conn(0x7f5df8073610 0x7f5df815f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:12.955 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.954+0000 7f5df6ffd640 1 -- 172.21.15.162:0/3430527594 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4133030600 0 0) 0x7f5df815f740 con 0x7f5df806bc10 2024-09-19T09:13:12.955 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.954+0000 7f5df6ffd640 1 -- 172.21.15.162:0/3430527594 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5de4003520 con 0x7f5df806bc10 2024-09-19T09:13:12.955 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.954+0000 7f5deffff640 1 -- 172.21.15.162:0/3430527594 >> v1:172.21.15.162:6789/0 conn(0x7f5df806bc10 legacy=0x7f5df80d1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.955 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.954+0000 7f5deffff640 1 -- 172.21.15.162:0/3430527594 >> v1:172.21.15.18:6789/0 conn(0x7f5df8159000 legacy=0x7f5df806e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.955 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.954+0000 7f5df6ffd640 1 -- 172.21.15.162:0/3430527594 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1346208586 0 0) 0x7f5df80b4c50 con 0x7f5df8159000 2024-09-19T09:13:12.955 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.954+0000 7f5deffff640 1 -- 172.21.15.162:0/3430527594 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df815fa20 con 0x7f5df8073610 2024-09-19T09:13:12.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.955+0000 7f5deffff640 1 --2- 172.21.15.162:0/3430527594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df8073610 0x7f5df815f080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5de00097a0 tx=0x7f5de002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0bb3aa945272881 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:12.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.955+0000 7f5df6ffd640 1 -- 172.21.15.162:0/3430527594 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de0037070 con 0x7f5df8073610 2024-09-19T09:13:12.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.955+0000 7f5df6ffd640 1 -- 172.21.15.162:0/3430527594 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5de0032440 con 0x7f5df8073610 2024-09-19T09:13:12.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.955+0000 7f5df6ffd640 1 -- 172.21.15.162:0/3430527594 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de0032810 con 0x7f5df8073610 2024-09-19T09:13:12.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.955+0000 7f5dfdcac640 1 -- 172.21.15.162:0/3430527594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df8073610 msgr2=0x7f5df815f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.955+0000 7f5dfdcac640 1 --2- 172.21.15.162:0/3430527594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df8073610 0x7f5df815f080 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5de00097a0 tx=0x7f5de002a230 comp rx=0 tx=0).stop 2024-09-19T09:13:12.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.955+0000 7f5dfdcac640 1 -- 172.21.15.162:0/3430527594 shutdown_connections 2024-09-19T09:13:12.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.955+0000 7f5dfdcac640 1 --2- 172.21.15.162:0/3430527594 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df8073610 0x7f5df815f080 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.956+0000 7f5dfdcac640 1 -- 172.21.15.162:0/3430527594 >> 172.21.15.162:0/3430527594 conn(0x7f5df806cd20 msgr2=0x7f5df806d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:12.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.956+0000 7f5dfdcac640 1 -- 172.21.15.162:0/3430527594 shutdown_connections 2024-09-19T09:13:12.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.956+0000 7f5dfdcac640 1 -- 172.21.15.162:0/3430527594 wait complete. 2024-09-19T09:13:12.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.957+0000 7f5dfdcac640 1 Processor -- start 2024-09-19T09:13:12.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.957+0000 7f5dfdcac640 1 -- start start 2024-09-19T09:13:12.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.957+0000 7f5dfdcac640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5df806bc10 0x7f5df8156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:12.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.957+0000 7f5dfdcac640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df8073610 0x7f5df81571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:12.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.957+0000 7f5dfdcac640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5df8159000 0x7f5df81e9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:12.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.957+0000 7f5dfdcac640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5df815ffe0 con 0x7f5df8073610 2024-09-19T09:13:12.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.957+0000 7f5dfdcac640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5df806ed90 con 0x7f5df8159000 2024-09-19T09:13:12.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.957+0000 7f5dfdcac640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5df81593e0 con 0x7f5df806bc10 2024-09-19T09:13:12.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.958+0000 7f5df7fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5df8159000 0x7f5df81e9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:12.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.958+0000 7f5df77fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5df806bc10 0x7f5df8156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:12.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.958+0000 7f5df7fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5df8159000 0x7f5df81e9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51166/0 (socket says 172.21.15.162:51166) 2024-09-19T09:13:12.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.958+0000 7f5df7fff640 1 -- 172.21.15.162:0/120390489 learned_addr learned my addr 172.21.15.162:0/120390489 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T09:13:12.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.958+0000 7f5deffff640 1 --2- 172.21.15.162:0/120390489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df8073610 0x7f5df81571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:12.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.958+0000 7f5deffff640 1 -- 172.21.15.162:0/120390489 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5df806bc10 msgr2=0x7f5df8156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.958+0000 7f5deffff640 1 --2- 172.21.15.162:0/120390489 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5df806bc10 0x7f5df8156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.958+0000 7f5deffff640 1 -- 172.21.15.162:0/120390489 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5df8159000 msgr2=0x7f5df81e9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:12.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.958+0000 7f5deffff640 1 --2- 172.21.15.162:0/120390489 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5df8159000 0x7f5df81e9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:12.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.958+0000 7f5deffff640 1 -- 172.21.15.162:0/120390489 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df80af780 con 0x7f5df8073610 2024-09-19T09:13:12.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.958+0000 7f5df77fe640 1 --2- 172.21.15.162:0/120390489 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5df806bc10 0x7f5df8156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:13:12.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.958+0000 7f5deffff640 1 --2- 172.21.15.162:0/120390489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df8073610 0x7f5df81571a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5de0031000 tx=0x7f5de00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:12.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.958+0000 7f5df4ff9640 1 -- 172.21.15.162:0/120390489 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de0041070 con 0x7f5df8073610 2024-09-19T09:13:12.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.958+0000 7f5df4ff9640 1 -- 172.21.15.162:0/120390489 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5de0004220 con 0x7f5df8073610 2024-09-19T09:13:12.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.958+0000 7f5dfdcac640 1 -- 172.21.15.162:0/120390489 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5df80ae9c0 con 0x7f5df8073610 2024-09-19T09:13:12.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.958+0000 7f5df4ff9640 1 -- 172.21.15.162:0/120390489 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de0037040 con 0x7f5df8073610 2024-09-19T09:13:12.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.958+0000 7f5dfdcac640 1 -- 172.21.15.162:0/120390489 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5df80aef80 con 0x7f5df8073610 2024-09-19T09:13:12.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.959+0000 7f5df4ff9640 1 -- 172.21.15.162:0/120390489 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5de00039a0 con 0x7f5df8073610 2024-09-19T09:13:12.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.959+0000 7f5df4ff9640 1 -- 172.21.15.162:0/120390489 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f5de003dad0 con 0x7f5df8073610 2024-09-19T09:13:12.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.959+0000 7f5dfdcac640 1 -- 172.21.15.162:0/120390489 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5df80b6040 con 0x7f5df8073610 2024-09-19T09:13:12.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:12.961+0000 7f5df4ff9640 1 -- 172.21.15.162:0/120390489 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f5df80b6040 con 0x7f5df8073610 2024-09-19T09:13:13.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.031+0000 7f5dfdcac640 1 -- 172.21.15.162:0/120390489 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5} v 0) -- 0x7f5df815f080 con 0x7f5df8073610 2024-09-19T09:13:13.033 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.033+0000 7f5df4ff9640 1 -- 172.21.15.162:0/120390489 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f5de0003dd0 con 0x7f5df8073610 2024-09-19T09:13:13.033 INFO:teuthology.orchestra.run.smithi162.stdout:5 2024-09-19T09:13:13.035 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.034+0000 7f5dfdcac640 1 -- 172.21.15.162:0/120390489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df8073610 msgr2=0x7f5df81571a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:13.035 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.034+0000 7f5dfdcac640 1 --2- 172.21.15.162:0/120390489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df8073610 0x7f5df81571a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5de0031000 tx=0x7f5de00046c0 comp rx=0 tx=0).stop 2024-09-19T09:13:13.035 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.034+0000 7f5dfdcac640 1 -- 172.21.15.162:0/120390489 shutdown_connections 2024-09-19T09:13:13.035 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.034+0000 7f5dfdcac640 1 --2- 172.21.15.162:0/120390489 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5df8159000 0x7f5df81e9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:13.035 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.034+0000 7f5dfdcac640 1 --2- 172.21.15.162:0/120390489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5df8073610 0x7f5df81571a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:13.035 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.034+0000 7f5dfdcac640 1 --2- 172.21.15.162:0/120390489 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5df806bc10 0x7f5df8156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:13.035 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.034+0000 7f5dfdcac640 1 -- 172.21.15.162:0/120390489 >> 172.21.15.162:0/120390489 conn(0x7f5df806cd20 msgr2=0x7f5df806ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:13.035 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.034+0000 7f5dfdcac640 1 -- 172.21.15.162:0/120390489 shutdown_connections 2024-09-19T09:13:13.035 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.034+0000 7f5dfdcac640 1 -- 172.21.15.162:0/120390489 wait complete. 2024-09-19T09:13:13.046 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 6 2024-09-19T09:13:13.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.144+0000 7f0ab24ba640 1 Processor -- start 2024-09-19T09:13:13.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.144+0000 7f0ab24ba640 1 -- start start 2024-09-19T09:13:13.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.145+0000 7f0ab24ba640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0aac06bc10 0x7f0aac163190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:13.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.145+0000 7f0ab24ba640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0aac06bff0 0x7f0aac0725b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:13.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.145+0000 7f0ab24ba640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0aac072af0 0x7f0aac072f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:13.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.145+0000 7f0ab24ba640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f0aac1636d0 con 0x7f0aac06bc10 2024-09-19T09:13:13.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.145+0000 7f0ab24ba640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f0aac0b6d20 con 0x7f0aac06bff0 2024-09-19T09:13:13.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.145+0000 7f0ab24ba640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0aac0ae840 con 0x7f0aac072af0 2024-09-19T09:13:13.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.145+0000 7f0aab7fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0aac06bff0 0x7f0aac0725b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:13.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.145+0000 7f0ab0a57640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0aac072af0 0x7f0aac072f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:13.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.145+0000 7f0aab7fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0aac06bff0 0x7f0aac0725b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51174/0 (socket says 172.21.15.162:51174) 2024-09-19T09:13:13.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.145+0000 7f0aab7fe640 1 -- 172.21.15.162:0/4216913174 learned_addr learned my addr 172.21.15.162:0/4216913174 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T09:13:13.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.145+0000 7f0aabfff640 1 --2- 172.21.15.162:0/4216913174 >> v2:172.21.15.18:3300/0 conn(0x7f0aac06bc10 0x7f0aac163190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:13.147 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.146+0000 7f0aab7fe640 1 -- 172.21.15.162:0/4216913174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0aac072af0 msgr2=0x7f0aac072f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:13.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.146+0000 7f0aab7fe640 1 --2- 172.21.15.162:0/4216913174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0aac072af0 0x7f0aac072f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:13.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.146+0000 7f0aab7fe640 1 -- 172.21.15.162:0/4216913174 >> v2:172.21.15.18:3300/0 conn(0x7f0aac06bc10 msgr2=0x7f0aac163190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:13.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.146+0000 7f0aab7fe640 1 --2- 172.21.15.162:0/4216913174 >> v2:172.21.15.18:3300/0 conn(0x7f0aac06bc10 0x7f0aac163190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:13.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.146+0000 7f0aab7fe640 1 -- 172.21.15.162:0/4216913174 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aac0b6a40 con 0x7f0aac06bff0 2024-09-19T09:13:13.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.146+0000 7f0ab0a57640 1 --2- 172.21.15.162:0/4216913174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0aac072af0 0x7f0aac072f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:13:13.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.146+0000 7f0aab7fe640 1 --2- 172.21.15.162:0/4216913174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0aac06bff0 0x7f0aac0725b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0aac0b60f0 tx=0x7f0a9402a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4401a66500a1148d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:13.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.146+0000 7f0aaaffd640 1 -- 172.21.15.162:0/4216913174 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a94037070 con 0x7f0aac06bff0 2024-09-19T09:13:13.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.146+0000 7f0aaaffd640 1 -- 172.21.15.162:0/4216913174 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a94032440 con 0x7f0aac06bff0 2024-09-19T09:13:13.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.146+0000 7f0aaaffd640 1 -- 172.21.15.162:0/4216913174 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a94032810 con 0x7f0aac06bff0 2024-09-19T09:13:13.151 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.147+0000 7f0ab24ba640 1 -- 172.21.15.162:0/4216913174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0aac06bff0 msgr2=0x7f0aac0725b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:13.151 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.147+0000 7f0ab24ba640 1 --2- 172.21.15.162:0/4216913174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0aac06bff0 0x7f0aac0725b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0aac0b60f0 tx=0x7f0a9402a1e0 comp rx=0 tx=0).stop 2024-09-19T09:13:13.151 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.147+0000 7f0ab24ba640 1 -- 172.21.15.162:0/4216913174 shutdown_connections 2024-09-19T09:13:13.151 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.147+0000 7f0ab24ba640 1 --2- 172.21.15.162:0/4216913174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0aac06bff0 0x7f0aac0725b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:13.151 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.147+0000 7f0ab24ba640 1 --2- 172.21.15.162:0/4216913174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0aac072af0 0x7f0aac072f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:13.151 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.147+0000 7f0ab24ba640 1 --2- 172.21.15.162:0/4216913174 >> v2:172.21.15.18:3300/0 conn(0x7f0aac06bc10 0x7f0aac163190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:13.151 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.147+0000 7f0ab24ba640 1 -- 172.21.15.162:0/4216913174 >> 172.21.15.162:0/4216913174 conn(0x7f0aac0d1970 msgr2=0x7f0aac0d1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:13.151 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.147+0000 7f0ab24ba640 1 -- 172.21.15.162:0/4216913174 shutdown_connections 2024-09-19T09:13:13.151 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.147+0000 7f0ab24ba640 1 -- 172.21.15.162:0/4216913174 wait complete. 2024-09-19T09:13:13.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.148+0000 7f0ab24ba640 1 Processor -- start 2024-09-19T09:13:13.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.149+0000 7f0ab24ba640 1 -- start start 2024-09-19T09:13:13.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.149+0000 7f0ab24ba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0aac06bc10 0x7f0aac146da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:13.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.149+0000 7f0ab24ba640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0aac06bff0 0x7f0aac1477e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:13.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.149+0000 7f0ab24ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0aac072af0 0x7f0aac13fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:13.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.149+0000 7f0ab24ba640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac0b5110 con 0x7f0aac06bc10 2024-09-19T09:13:13.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.149+0000 7f0ab24ba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac0b4e30 con 0x7f0aac072af0 2024-09-19T09:13:13.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.149+0000 7f0ab24ba640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0aac06c430 con 0x7f0aac06bff0 2024-09-19T09:13:13.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.149+0000 7f0aab7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0aac06bff0 0x7f0aac1477e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:13.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.149+0000 7f0ab0a57640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0aac072af0 0x7f0aac13fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:13.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.149+0000 7f0aab7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0aac06bff0 0x7f0aac1477e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:46520/0 (socket says 172.21.15.162:46520) 2024-09-19T09:13:13.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.149+0000 7f0aab7fe640 1 -- 172.21.15.162:0/519549844 learned_addr learned my addr 172.21.15.162:0/519549844 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T09:13:13.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.149+0000 7f0aabfff640 1 --2- 172.21.15.162:0/519549844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0aac06bc10 0x7f0aac146da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:13.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.150+0000 7f0aab7fe640 1 -- 172.21.15.162:0/519549844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0aac072af0 msgr2=0x7f0aac13fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:13.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.150+0000 7f0aab7fe640 1 --2- 172.21.15.162:0/519549844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0aac072af0 0x7f0aac13fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:13.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.150+0000 7f0aab7fe640 1 -- 172.21.15.162:0/519549844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0aac06bc10 msgr2=0x7f0aac146da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:13.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.150+0000 7f0aab7fe640 1 --2- 172.21.15.162:0/519549844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0aac06bc10 0x7f0aac146da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:13.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.150+0000 7f0aab7fe640 1 -- 172.21.15.162:0/519549844 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aac1410d0 con 0x7f0aac06bff0 2024-09-19T09:13:13.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.150+0000 7f0aabfff640 1 --2- 172.21.15.162:0/519549844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0aac06bc10 0x7f0aac146da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:13:13.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.150+0000 7f0aab7fe640 1 --2- 172.21.15.162:0/519549844 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0aac06bff0 0x7f0aac1477e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0a94000c00 tx=0x7f0a940046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:13.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.150+0000 7f0aa8ff9640 1 -- 172.21.15.162:0/519549844 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a94041020 con 0x7f0aac06bff0 2024-09-19T09:13:13.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.150+0000 7f0aa8ff9640 1 -- 172.21.15.162:0/519549844 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a9403d640 con 0x7f0aac06bff0 2024-09-19T09:13:13.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.150+0000 7f0ab24ba640 1 -- 172.21.15.162:0/519549844 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aac140830 con 0x7f0aac06bff0 2024-09-19T09:13:13.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.150+0000 7f0aa8ff9640 1 -- 172.21.15.162:0/519549844 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a94037040 con 0x7f0aac06bff0 2024-09-19T09:13:13.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.150+0000 7f0ab24ba640 1 -- 172.21.15.162:0/519549844 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aac140df0 con 0x7f0aac06bff0 2024-09-19T09:13:13.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.150+0000 7f0aa8ff9640 1 -- 172.21.15.162:0/519549844 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0a94044020 con 0x7f0aac06bff0 2024-09-19T09:13:13.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.150+0000 7f0aa8ff9640 1 -- 172.21.15.162:0/519549844 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f0a94046b30 con 0x7f0aac06bff0 2024-09-19T09:13:13.154 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.151+0000 7f0ab24ba640 1 -- 172.21.15.162:0/519549844 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aac0b6660 con 0x7f0aac06bff0 2024-09-19T09:13:13.154 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.153+0000 7f0aa8ff9640 1 -- 172.21.15.162:0/519549844 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f0a9404b030 con 0x7f0aac06bff0 2024-09-19T09:13:13.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.222+0000 7f0ab24ba640 1 -- 172.21.15.162:0/519549844 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6} v 0) -- 0x7f0aac06c9c0 con 0x7f0aac06bff0 2024-09-19T09:13:13.225 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.225+0000 7f0aa8ff9640 1 -- 172.21.15.162:0/519549844 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f0a94046400 con 0x7f0aac06bff0 2024-09-19T09:13:13.225 INFO:teuthology.orchestra.run.smithi162.stdout:6 2024-09-19T09:13:13.226 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.226+0000 7f0ab24ba640 1 -- 172.21.15.162:0/519549844 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0aac06bff0 msgr2=0x7f0aac1477e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:13.227 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.226+0000 7f0ab24ba640 1 --2- 172.21.15.162:0/519549844 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0aac06bff0 0x7f0aac1477e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0a94000c00 tx=0x7f0a940046c0 comp rx=0 tx=0).stop 2024-09-19T09:13:13.227 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.226+0000 7f0ab24ba640 1 -- 172.21.15.162:0/519549844 shutdown_connections 2024-09-19T09:13:13.227 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.226+0000 7f0ab24ba640 1 --2- 172.21.15.162:0/519549844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0aac072af0 0x7f0aac13fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:13.227 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.226+0000 7f0ab24ba640 1 --2- 172.21.15.162:0/519549844 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0aac06bff0 0x7f0aac1477e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:13.227 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.226+0000 7f0ab24ba640 1 --2- 172.21.15.162:0/519549844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0aac06bc10 0x7f0aac146da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:13.227 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.226+0000 7f0ab24ba640 1 -- 172.21.15.162:0/519549844 >> 172.21.15.162:0/519549844 conn(0x7f0aac0d1970 msgr2=0x7f0aac143900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:13.227 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.226+0000 7f0ab24ba640 1 -- 172.21.15.162:0/519549844 shutdown_connections 2024-09-19T09:13:13.227 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.226+0000 7f0ab24ba640 1 -- 172.21.15.162:0/519549844 wait complete. 2024-09-19T09:13:13.237 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 7 2024-09-19T09:13:13.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.335+0000 7f0c3c28b640 1 Processor -- start 2024-09-19T09:13:13.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.335+0000 7f0c3c28b640 1 -- start start 2024-09-19T09:13:13.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.336+0000 7f0c3c28b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0c34156040 0x7f0c3406f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:13.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.336+0000 7f0c3c28b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c340b5a40 0x7f0c3415d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:13.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.336+0000 7f0c3c28b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c3406f9f0 con 0x7f0c3415ca50 2024-09-19T09:13:13.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.336+0000 7f0c3c28b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f0c3406fcd0 con 0x7f0c34156040 2024-09-19T09:13:13.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.336+0000 7f0c3c28b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0c3406ffb0 con 0x7f0c340b5a40 2024-09-19T09:13:13.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.336+0000 7f0c3a828640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c340b5a40 0x7f0c3415d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:13.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.336+0000 7f0c3a828640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c340b5a40 0x7f0c3415d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:46536/0 (socket says 172.21.15.162:46536) 2024-09-19T09:13:13.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.336+0000 7f0c3a828640 1 -- 172.21.15.162:0/2025597229 learned_addr learned my addr 172.21.15.162:0/2025597229 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T09:13:13.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.336+0000 7f0c3a027640 1 --2- 172.21.15.162:0/2025597229 >> v2:172.21.15.18:3300/0 conn(0x7f0c34156040 0x7f0c3406f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:13.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.337+0000 7f0c3a828640 1 -- 172.21.15.162:0/2025597229 >> v2:172.21.15.18:3300/0 conn(0x7f0c34156040 msgr2=0x7f0c3406f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:13.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.337+0000 7f0c3a828640 1 --2- 172.21.15.162:0/2025597229 >> v2:172.21.15.18:3300/0 conn(0x7f0c34156040 0x7f0c3406f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:13.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.337+0000 7f0c3a828640 1 -- 172.21.15.162:0/2025597229 >> v1:172.21.15.18:6789/0 conn(0x7f0c3415ca50 legacy=0x7f0c340b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:13.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.337+0000 7f0c3a828640 1 -- 172.21.15.162:0/2025597229 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c34070290 con 0x7f0c340b5a40 2024-09-19T09:13:13.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.337+0000 7f0c3a828640 1 --2- 172.21.15.162:0/2025597229 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c340b5a40 0x7f0c3415d280 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c00d150 tx=0x7f0c2c02c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b97c06c11551823d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:13.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.337+0000 7f0c39025640 1 -- 172.21.15.162:0/2025597229 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c039070 con 0x7f0c340b5a40 2024-09-19T09:13:13.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.337+0000 7f0c39025640 1 -- 172.21.15.162:0/2025597229 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c2c009600 con 0x7f0c340b5a40 2024-09-19T09:13:13.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.337+0000 7f0c39025640 1 -- 172.21.15.162:0/2025597229 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c0099d0 con 0x7f0c340b5a40 2024-09-19T09:13:13.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.338+0000 7f0c3c28b640 1 -- 172.21.15.162:0/2025597229 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c340b5a40 msgr2=0x7f0c3415d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:13.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.338+0000 7f0c3c28b640 1 --2- 172.21.15.162:0/2025597229 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c340b5a40 0x7f0c3415d280 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c00d150 tx=0x7f0c2c02c890 comp rx=0 tx=0).stop 2024-09-19T09:13:13.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.338+0000 7f0c3c28b640 1 -- 172.21.15.162:0/2025597229 shutdown_connections 2024-09-19T09:13:13.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.338+0000 7f0c3c28b640 1 --2- 172.21.15.162:0/2025597229 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c340b5a40 0x7f0c3415d280 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:13.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.338+0000 7f0c3c28b640 1 --2- 172.21.15.162:0/2025597229 >> v2:172.21.15.18:3300/0 conn(0x7f0c34156040 0x7f0c3406f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:13.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.338+0000 7f0c3c28b640 1 -- 172.21.15.162:0/2025597229 >> 172.21.15.162:0/2025597229 conn(0x7f0c3406cd20 msgr2=0x7f0c3406d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:13.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.338+0000 7f0c3c28b640 1 -- 172.21.15.162:0/2025597229 shutdown_connections 2024-09-19T09:13:13.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.338+0000 7f0c3c28b640 1 -- 172.21.15.162:0/2025597229 wait complete. 2024-09-19T09:13:13.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.339+0000 7f0c3c28b640 1 Processor -- start 2024-09-19T09:13:13.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.339+0000 7f0c3c28b640 1 -- start start 2024-09-19T09:13:13.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.340+0000 7f0c3c28b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c340b5a40 0x7f0c341f0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:13.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.340+0000 7f0c3c28b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c34156040 0x7f0c341f3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:13.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.340+0000 7f0c3c28b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c3415ca50 0x7f0c34159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:13.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.340+0000 7f0c3c28b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3415d7c0 con 0x7f0c340b5a40 2024-09-19T09:13:13.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.340+0000 7f0c3c28b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3406f6e0 con 0x7f0c34156040 2024-09-19T09:13:13.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.340+0000 7f0c3c28b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0c3415d940 con 0x7f0c3415ca50 2024-09-19T09:13:13.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.340+0000 7f0c3a828640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c3415ca50 0x7f0c34159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:13.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.340+0000 7f0c3a828640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c3415ca50 0x7f0c34159b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.162:46538/0 (socket says 172.21.15.162:46538) 2024-09-19T09:13:13.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.340+0000 7f0c3a828640 1 -- 172.21.15.162:0/3364407337 learned_addr learned my addr 172.21.15.162:0/3364407337 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-09-19T09:13:13.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.340+0000 7f0c39826640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c34156040 0x7f0c341f3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:13.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.340+0000 7f0c3a027640 1 --2- 172.21.15.162:0/3364407337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c340b5a40 0x7f0c341f0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:13.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.340+0000 7f0c3a828640 1 -- 172.21.15.162:0/3364407337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c34156040 msgr2=0x7f0c341f3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:13.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.340+0000 7f0c3a828640 1 --2- 172.21.15.162:0/3364407337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c34156040 0x7f0c341f3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:13.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.340+0000 7f0c3a828640 1 -- 172.21.15.162:0/3364407337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c340b5a40 msgr2=0x7f0c341f0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:13.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.340+0000 7f0c3a828640 1 --2- 172.21.15.162:0/3364407337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c340b5a40 0x7f0c341f0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:13.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.340+0000 7f0c3a828640 1 -- 172.21.15.162:0/3364407337 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c34152870 con 0x7f0c3415ca50 2024-09-19T09:13:13.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.341+0000 7f0c3a828640 1 --2- 172.21.15.162:0/3364407337 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c3415ca50 0x7f0c34159b00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c037040 tx=0x7f0c2c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:13.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.341+0000 7f0c2affd640 1 -- 172.21.15.162:0/3364407337 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c039050 con 0x7f0c3415ca50 2024-09-19T09:13:13.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.341+0000 7f0c2affd640 1 -- 172.21.15.162:0/3364407337 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c2c045070 con 0x7f0c3415ca50 2024-09-19T09:13:13.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.341+0000 7f0c2affd640 1 -- 172.21.15.162:0/3364407337 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c0346c0 con 0x7f0c3415ca50 2024-09-19T09:13:13.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.341+0000 7f0c3c28b640 1 -- 172.21.15.162:0/3364407337 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c34156f50 con 0x7f0c3415ca50 2024-09-19T09:13:13.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.341+0000 7f0c3c28b640 1 -- 172.21.15.162:0/3364407337 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c3414a010 con 0x7f0c3415ca50 2024-09-19T09:13:13.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.341+0000 7f0c2affd640 1 -- 172.21.15.162:0/3364407337 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0c2c034860 con 0x7f0c3415ca50 2024-09-19T09:13:13.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.341+0000 7f0c2affd640 1 -- 172.21.15.162:0/3364407337 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f0c2c040450 con 0x7f0c3415ca50 2024-09-19T09:13:13.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.342+0000 7f0c3c28b640 1 -- 172.21.15.162:0/3364407337 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c3415d280 con 0x7f0c3415ca50 2024-09-19T09:13:13.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.344+0000 7f0c2affd640 1 -- 172.21.15.162:0/3364407337 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f0c2c009520 con 0x7f0c3415ca50 2024-09-19T09:13:13.415 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.415+0000 7f0c3c28b640 1 -- 172.21.15.162:0/3364407337 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7} v 0) -- 0x7f0c3414a240 con 0x7f0c3415ca50 2024-09-19T09:13:13.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.421+0000 7f0c2affd640 1 -- 172.21.15.162:0/3364407337 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f0c2c034ce0 con 0x7f0c3415ca50 2024-09-19T09:13:13.421 INFO:teuthology.orchestra.run.smithi162.stdout:7 2024-09-19T09:13:13.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.421+0000 7f0c3c28b640 1 -- 172.21.15.162:0/3364407337 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c3415ca50 msgr2=0x7f0c34159b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:13.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.421+0000 7f0c3c28b640 1 --2- 172.21.15.162:0/3364407337 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c3415ca50 0x7f0c34159b00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c037040 tx=0x7f0c2c004a40 comp rx=0 tx=0).stop 2024-09-19T09:13:13.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.421+0000 7f0c3c28b640 1 -- 172.21.15.162:0/3364407337 shutdown_connections 2024-09-19T09:13:13.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.421+0000 7f0c3c28b640 1 --2- 172.21.15.162:0/3364407337 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c3415ca50 0x7f0c34159b00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:13.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.421+0000 7f0c3c28b640 1 --2- 172.21.15.162:0/3364407337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c34156040 0x7f0c341f3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:13.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.422+0000 7f0c3c28b640 1 --2- 172.21.15.162:0/3364407337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c340b5a40 0x7f0c341f0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:13.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.422+0000 7f0c3c28b640 1 -- 172.21.15.162:0/3364407337 >> 172.21.15.162:0/3364407337 conn(0x7f0c3406cd20 msgr2=0x7f0c3415dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:13.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.422+0000 7f0c3c28b640 1 -- 172.21.15.162:0/3364407337 shutdown_connections 2024-09-19T09:13:13.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:13.422+0000 7f0c3c28b640 1 -- 172.21.15.162:0/3364407337 wait complete. 2024-09-19T09:13:13.433 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-19T09:13:13.433 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-19T09:13:13.435 INFO:tasks.ceph.osd.0:Started 2024-09-19T09:13:13.435 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-19T09:13:13.435 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-19T09:13:13.437 INFO:tasks.ceph.osd.1:Started 2024-09-19T09:13:13.437 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-19T09:13:13.438 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-19T09:13:13.440 INFO:tasks.ceph.osd.2:Started 2024-09-19T09:13:13.440 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-19T09:13:13.440 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-19T09:13:13.442 INFO:tasks.ceph.osd.3:Started 2024-09-19T09:13:13.442 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-19T09:13:13.442 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-19T09:13:13.444 INFO:tasks.ceph.osd.4:Started 2024-09-19T09:13:13.445 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-19T09:13:13.445 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-19T09:13:13.447 INFO:tasks.ceph.osd.5:Started 2024-09-19T09:13:13.447 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-19T09:13:13.447 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-19T09:13:13.449 INFO:tasks.ceph.osd.6:Started 2024-09-19T09:13:13.449 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-19T09:13:13.449 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-19T09:13:13.451 INFO:tasks.ceph.osd.7:Started 2024-09-19T09:13:13.452 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:13:13.526 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-19T09:13:13.525+0000 7f10b8345640 -1 Falling back to public interface 2024-09-19T09:13:13.526 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-09-19T09:13:13.525+0000 7fc482c1e640 -1 Falling back to public interface 2024-09-19T09:13:13.530 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-09-19T09:13:13.529+0000 7f74dc816640 -1 Falling back to public interface 2024-09-19T09:13:13.539 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-09-19T09:13:13.539+0000 7fc482c1e640 -1 osd.5 0 log_to_monitors true 2024-09-19T09:13:13.540 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-19T09:13:13.540+0000 7f6082212640 -1 Falling back to public interface 2024-09-19T09:13:13.545 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-09-19T09:13:13.545+0000 7f74dc816640 -1 osd.6 0 log_to_monitors true 2024-09-19T09:13:13.547 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-19T09:13:13.547+0000 7f10b8345640 -1 osd.2 0 log_to_monitors true 2024-09-19T09:13:13.550 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-09-19T09:13:13.550+0000 7f635a0fe640 -1 Falling back to public interface 2024-09-19T09:13:13.551 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-09-19T09:13:13.551+0000 7f5fb520b640 -1 Falling back to public interface 2024-09-19T09:13:13.552 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-09-19T09:13:13.552+0000 7f5fb3ab0640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6821/0: (98) Address already in use 2024-09-19T09:13:13.552 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-19T09:13:13.552+0000 7fd4d2e0b640 -1 Falling back to public interface 2024-09-19T09:13:13.552 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-19T09:13:13.552+0000 7f6082212640 -1 osd.0 0 log_to_monitors true 2024-09-19T09:13:13.556 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-19T09:13:13.556+0000 7f4ae1aed640 -1 Falling back to public interface 2024-09-19T09:13:13.563 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-09-19T09:13:13.563+0000 7f635a0fe640 -1 osd.7 0 log_to_monitors true 2024-09-19T09:13:13.568 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-09-19T09:13:13.568+0000 7f5fb520b640 -1 osd.4 0 log_to_monitors true 2024-09-19T09:13:13.572 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-19T09:13:13.572+0000 7fd4d2e0b640 -1 osd.1 0 log_to_monitors true 2024-09-19T09:13:13.572 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-19T09:13:13.572+0000 7f4ae1aed640 -1 osd.3 0 log_to_monitors true 2024-09-19T09:13:13.587 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-19T09:13:13.587+0000 7fc879732040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:13:13.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.592+0000 7f7952978640 1 Processor -- start 2024-09-19T09:13:13.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.592+0000 7f7952978640 1 -- start start 2024-09-19T09:13:13.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.593+0000 7f7952978640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f794c0d1b50 0x7f794c0cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:13.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.593+0000 7f7952978640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f794c0d3530 con 0x7f794c0b91d0 2024-09-19T09:13:13.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.593+0000 7f7952978640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f794c0d3810 con 0x7f794c162270 2024-09-19T09:13:13.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.593+0000 7f7952978640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f794c0b7a50 con 0x7f794c0d1b50 2024-09-19T09:13:13.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.593+0000 7f794b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f794c0d1b50 0x7f794c0cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:13.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.593+0000 7f794b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f794c0d1b50 0x7f794c0cf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:41998/0 (socket says 172.21.15.18:41998) 2024-09-19T09:13:13.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.593+0000 7f794b7fe640 1 -- 172.21.15.18:0/2582765294 learned_addr learned my addr 172.21.15.18:0/2582765294 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:13.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.594+0000 7f794b7fe640 1 -- 172.21.15.18:0/2582765294 >> v1:172.21.15.162:6789/0 conn(0x7f794c162270 legacy=0x7f794c0d1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:13.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.594+0000 7f794b7fe640 1 -- 172.21.15.18:0/2582765294 >> v1:172.21.15.18:6789/0 conn(0x7f794c0b91d0 legacy=0x7f794c0cfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:13.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.594+0000 7f794b7fe640 1 -- 172.21.15.18:0/2582765294 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f794c0d3af0 con 0x7f794c0d1b50 2024-09-19T09:13:13.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.594+0000 7f794affd640 1 -- 172.21.15.18:0/2582765294 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1430170570 0 0) 0x7f794c0d3530 con 0x7f794c0b91d0 2024-09-19T09:13:13.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.594+0000 7f794b7fe640 1 --2- 172.21.15.18:0/2582765294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f794c0d1b50 0x7f794c0cf810 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7940009870 tx=0x7f794002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596ed3d99072ebb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:13.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.595+0000 7f794affd640 1 -- 172.21.15.18:0/2582765294 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7940037070 con 0x7f794c0d1b50 2024-09-19T09:13:13.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.595+0000 7f794affd640 1 -- 172.21.15.18:0/2582765294 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f794002ae50 con 0x7f794c0d1b50 2024-09-19T09:13:13.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.595+0000 7f794affd640 1 -- 172.21.15.18:0/2582765294 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7940032860 con 0x7f794c0d1b50 2024-09-19T09:13:13.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.595+0000 7f7952978640 1 -- 172.21.15.18:0/2582765294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f794c0d1b50 msgr2=0x7f794c0cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:13.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.595+0000 7f7952978640 1 --2- 172.21.15.18:0/2582765294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f794c0d1b50 0x7f794c0cf810 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f7940009870 tx=0x7f794002a300 comp rx=0 tx=0).stop 2024-09-19T09:13:13.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.595+0000 7f7952978640 1 -- 172.21.15.18:0/2582765294 shutdown_connections 2024-09-19T09:13:13.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.595+0000 7f7952978640 1 --2- 172.21.15.18:0/2582765294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f794c0d1b50 0x7f794c0cf810 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:13.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.595+0000 7f7952978640 1 -- 172.21.15.18:0/2582765294 >> 172.21.15.18:0/2582765294 conn(0x7f794c0d4c00 msgr2=0x7f794c0d5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:13.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.595+0000 7f7952978640 1 -- 172.21.15.18:0/2582765294 shutdown_connections 2024-09-19T09:13:13.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.595+0000 7f7952978640 1 -- 172.21.15.18:0/2582765294 wait complete. 2024-09-19T09:13:13.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.597+0000 7f7952978640 1 Processor -- start 2024-09-19T09:13:13.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.597+0000 7f7952978640 1 -- start start 2024-09-19T09:13:13.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.598+0000 7f7952978640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f794c0b91d0 0x7f794c15f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:13.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.598+0000 7f7952978640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f794c0d1b50 0x7f794c14ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:13.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.598+0000 7f7952978640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f794c162270 0x7f794c15b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:13.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.598+0000 7f7952978640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f794c162650 con 0x7f794c0b91d0 2024-09-19T09:13:13.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.598+0000 7f7952978640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f794c0b7d30 con 0x7f794c162270 2024-09-19T09:13:13.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.598+0000 7f7952978640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f794c1627d0 con 0x7f794c0d1b50 2024-09-19T09:13:13.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.598+0000 7f794bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f794c0b91d0 0x7f794c15f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:13.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.598+0000 7f794bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f794c0b91d0 0x7f794c15f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42012/0 (socket says 172.21.15.18:42012) 2024-09-19T09:13:13.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.598+0000 7f794bfff640 1 -- 172.21.15.18:0/3227398556 learned_addr learned my addr 172.21.15.18:0/3227398556 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:13.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.598+0000 7f794b7fe640 1 --2- 172.21.15.18:0/3227398556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f794c0d1b50 0x7f794c14ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:13.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.598+0000 7f7950f15640 1 --2- 172.21.15.18:0/3227398556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f794c162270 0x7f794c15b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:13.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.599+0000 7f794bfff640 1 -- 172.21.15.18:0/3227398556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f794c0d1b50 msgr2=0x7f794c14ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:13.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.599+0000 7f794bfff640 1 --2- 172.21.15.18:0/3227398556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f794c0d1b50 0x7f794c14ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:13.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.599+0000 7f794bfff640 1 -- 172.21.15.18:0/3227398556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f794c162270 msgr2=0x7f794c15b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:13.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.599+0000 7f794bfff640 1 --2- 172.21.15.18:0/3227398556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f794c162270 0x7f794c15b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:13.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.599+0000 7f794bfff640 1 -- 172.21.15.18:0/3227398556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f794c15c7a0 con 0x7f794c0b91d0 2024-09-19T09:13:13.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.599+0000 7f794bfff640 1 --2- 172.21.15.18:0/3227398556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f794c0b91d0 0x7f794c15f3f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f793c00c400 tx=0x7f793c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:13.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.599+0000 7f7948ff9640 1 -- 172.21.15.18:0/3227398556 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793c017070 con 0x7f794c0b91d0 2024-09-19T09:13:13.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.599+0000 7f7948ff9640 1 -- 172.21.15.18:0/3227398556 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f793c0052d0 con 0x7f794c0b91d0 2024-09-19T09:13:13.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.599+0000 7f7952978640 1 -- 172.21.15.18:0/3227398556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f794c0d0c30 con 0x7f794c0b91d0 2024-09-19T09:13:13.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.599+0000 7f7948ff9640 1 -- 172.21.15.18:0/3227398556 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793c003830 con 0x7f794c0b91d0 2024-09-19T09:13:13.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.599+0000 7f7952978640 1 -- 172.21.15.18:0/3227398556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f794c15e910 con 0x7f794c0b91d0 2024-09-19T09:13:13.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.600+0000 7f7948ff9640 1 -- 172.21.15.18:0/3227398556 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f793c01a070 con 0x7f794c0b91d0 2024-09-19T09:13:13.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.600+0000 7f7948ff9640 1 -- 172.21.15.18:0/3227398556 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f793c011b30 con 0x7f794c0b91d0 2024-09-19T09:13:13.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.600+0000 7f7952978640 1 -- 172.21.15.18:0/3227398556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f794c0d5720 con 0x7f794c0b91d0 2024-09-19T09:13:13.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.602+0000 7f7948ff9640 1 -- 172.21.15.18:0/3227398556 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f793c021020 con 0x7f794c0b91d0 2024-09-19T09:13:13.629 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-09-19T09:13:13.629+0000 7f924582d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T09:13:13.645 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-19T09:13:13.645+0000 7fc879732040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:13:13.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.663+0000 7f7952978640 1 -- 172.21.15.18:0/3227398556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f794c06ddd0 con 0x7f794c0b91d0 2024-09-19T09:13:13.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.663+0000 7f7948ff9640 1 -- 172.21.15.18:0/3227398556 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f793c011d30 con 0x7f794c0b91d0 2024-09-19T09:13:13.664 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:13.664 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":10,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:13:13.417141+0000","last_up_change":"0.000000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:13:13.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.664+0000 7f7952978640 1 -- 172.21.15.18:0/3227398556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f794c0b91d0 msgr2=0x7f794c15f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:13.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.664+0000 7f7952978640 1 --2- 172.21.15.18:0/3227398556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f794c0b91d0 0x7f794c15f3f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f793c00c400 tx=0x7f793c00c8c0 comp rx=0 tx=0).stop 2024-09-19T09:13:13.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.664+0000 7f7952978640 1 -- 172.21.15.18:0/3227398556 shutdown_connections 2024-09-19T09:13:13.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.664+0000 7f7952978640 1 --2- 172.21.15.18:0/3227398556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f794c162270 0x7f794c15b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:13.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.664+0000 7f7952978640 1 --2- 172.21.15.18:0/3227398556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f794c0d1b50 0x7f794c14ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:13.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.664+0000 7f7952978640 1 --2- 172.21.15.18:0/3227398556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f794c0b91d0 0x7f794c15f3f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:13.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.664+0000 7f7952978640 1 -- 172.21.15.18:0/3227398556 >> 172.21.15.18:0/3227398556 conn(0x7f794c0d4c00 msgr2=0x7f794c0cf7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:13.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.664+0000 7f7952978640 1 -- 172.21.15.18:0/3227398556 shutdown_connections 2024-09-19T09:13:13.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:13.664+0000 7f7952978640 1 -- 172.21.15.18:0/3227398556 wait complete. 2024-09-19T09:13:13.679 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-19T09:13:13.679 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-19T09:13:13.683 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-09-19T09:13:13.682+0000 7f924582d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T09:13:14.035 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-19T09:13:14.035+0000 7fc879732040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:13:14.045 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-09-19T09:13:14.044+0000 7f924582d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T09:13:14.124 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-19T09:13:14.124+0000 7fc879732040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:13:14.129 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-09-19T09:13:14.129+0000 7f924582d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T09:13:14.235 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-09-19T09:13:14.235+0000 7f924582d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:13:14.237 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-19T09:13:14.237+0000 7fc879732040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T09:13:14.281 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-09-19T09:13:14.281+0000 7f924582d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:13:14.301 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-19T09:13:14.301+0000 7fc879732040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T09:13:14.394 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-09-19T09:13:14.393+0000 7f924582d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:13:14.421 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-19T09:13:14.421+0000 7fc879732040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T09:13:14.448 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-09-19T09:13:14.447+0000 7f924582d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:13:14.479 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-19T09:13:14.478+0000 7fc879732040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T09:13:14.483 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-19T09:13:14.491 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-09-19T09:13:14.491+0000 7f924582d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:13:14.527 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-19T09:13:14.526+0000 7fc879732040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T09:13:14.577 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.576+0000 7f6f35931640 1 Processor -- start 2024-09-19T09:13:14.577 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.576+0000 7f6f35931640 1 -- start start 2024-09-19T09:13:14.579 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.577+0000 7f6f35931640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6f3015b770 0x7f6f3006c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:14.579 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.577+0000 7f6f35931640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6f3015fd70 0x7f6f30071e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:14.579 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.577+0000 7f6f35931640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f30072370 0x7f6f300b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:14.579 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.577+0000 7f6f35931640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f6f300719a0 con 0x7f6f3015fd70 2024-09-19T09:13:14.579 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.577+0000 7f6f35931640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6f30071670 con 0x7f6f3015b770 2024-09-19T09:13:14.579 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.577+0000 7f6f35931640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6f300732b0 con 0x7f6f30072370 2024-09-19T09:13:14.579 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.577+0000 7f6f2e7fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6f3015fd70 0x7f6f30071e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:14.579 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.577+0000 7f6f2e7fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6f3015fd70 0x7f6f30071e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42024/0 (socket says 172.21.15.18:42024) 2024-09-19T09:13:14.579 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.577+0000 7f6f2e7fc640 1 -- 172.21.15.18:0/3535140929 learned_addr learned my addr 172.21.15.18:0/3535140929 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:14.579 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.577+0000 7f6f2effd640 1 --2- 172.21.15.18:0/3535140929 >> v2:172.21.15.162:3300/0 conn(0x7f6f3015b770 0x7f6f3006c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:14.579 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.577+0000 7f6f2f7fe640 1 --2- 172.21.15.18:0/3535140929 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f30072370 0x7f6f300b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:14.580 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.578+0000 7f6f2e7fc640 1 -- 172.21.15.18:0/3535140929 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f30072370 msgr2=0x7f6f300b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:14.580 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.578+0000 7f6f2e7fc640 1 --2- 172.21.15.18:0/3535140929 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f30072370 0x7f6f300b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:14.580 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.578+0000 7f6f2e7fc640 1 -- 172.21.15.18:0/3535140929 >> v2:172.21.15.162:3300/0 conn(0x7f6f3015b770 msgr2=0x7f6f3006c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:14.580 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.578+0000 7f6f2e7fc640 1 --2- 172.21.15.18:0/3535140929 >> v2:172.21.15.162:3300/0 conn(0x7f6f3015b770 0x7f6f3006c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:14.580 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.578+0000 7f6f2e7fc640 1 -- 172.21.15.18:0/3535140929 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f30073570 con 0x7f6f3015fd70 2024-09-19T09:13:14.580 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.578+0000 7f6f2f7fe640 1 --2- 172.21.15.18:0/3535140929 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f30072370 0x7f6f300b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:13:14.580 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.578+0000 7f6f2e7fc640 1 --2- 172.21.15.18:0/3535140929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f3015fd70 0x7f6f30071e30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6f30075cf0 tx=0x7f6f2402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1ce78334d5a337 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:14.580 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.578+0000 7f6f2dffb640 1 -- 172.21.15.18:0/3535140929 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f24037070 con 0x7f6f3015fd70 2024-09-19T09:13:14.580 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.578+0000 7f6f2dffb640 1 -- 172.21.15.18:0/3535140929 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f24032440 con 0x7f6f3015fd70 2024-09-19T09:13:14.581 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.578+0000 7f6f2dffb640 1 -- 172.21.15.18:0/3535140929 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f24032810 con 0x7f6f3015fd70 2024-09-19T09:13:14.582 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.579+0000 7f6f35931640 1 -- 172.21.15.18:0/3535140929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f3015fd70 msgr2=0x7f6f30071e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:14.582 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.579+0000 7f6f35931640 1 --2- 172.21.15.18:0/3535140929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f3015fd70 0x7f6f30071e30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6f30075cf0 tx=0x7f6f2402a1e0 comp rx=0 tx=0).stop 2024-09-19T09:13:14.582 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.579+0000 7f6f35931640 1 -- 172.21.15.18:0/3535140929 shutdown_connections 2024-09-19T09:13:14.582 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.579+0000 7f6f35931640 1 --2- 172.21.15.18:0/3535140929 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f30072370 0x7f6f300b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:14.582 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.579+0000 7f6f35931640 1 --2- 172.21.15.18:0/3535140929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f3015fd70 0x7f6f30071e30 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:14.582 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.579+0000 7f6f35931640 1 --2- 172.21.15.18:0/3535140929 >> v2:172.21.15.162:3300/0 conn(0x7f6f3015b770 0x7f6f3006c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:14.582 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.579+0000 7f6f35931640 1 -- 172.21.15.18:0/3535140929 >> 172.21.15.18:0/3535140929 conn(0x7f6f3006bb90 msgr2=0x7f6f3006bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:14.582 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.579+0000 7f6f35931640 1 -- 172.21.15.18:0/3535140929 shutdown_connections 2024-09-19T09:13:14.582 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.579+0000 7f6f35931640 1 -- 172.21.15.18:0/3535140929 wait complete. 2024-09-19T09:13:14.582 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.581+0000 7f6f35931640 1 Processor -- start 2024-09-19T09:13:14.582 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.581+0000 7f6f35931640 1 -- start start 2024-09-19T09:13:14.584 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.583+0000 7f6f35931640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f3015b770 0x7f6f301f1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:14.585 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.583+0000 7f6f35931640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f3015fd70 0x7f6f301441b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:14.585 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.583+0000 7f6f35931640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f3014f320 0x7f6f30158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:14.585 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.583+0000 7f6f35931640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6f3015bb50 con 0x7f6f3015b770 2024-09-19T09:13:14.585 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.583+0000 7f6f35931640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6f30073850 con 0x7f6f3014f320 2024-09-19T09:13:14.585 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.583+0000 7f6f35931640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6f300b5020 con 0x7f6f3015fd70 2024-09-19T09:13:14.585 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.583+0000 7f6f2effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f3015b770 0x7f6f301f1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:14.585 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.583+0000 7f6f2effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f3015b770 0x7f6f301f1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42040/0 (socket says 172.21.15.18:42040) 2024-09-19T09:13:14.585 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.583+0000 7f6f2effd640 1 -- 172.21.15.18:0/2851459397 learned_addr learned my addr 172.21.15.18:0/2851459397 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:14.585 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.583+0000 7f6f2f7fe640 1 --2- 172.21.15.18:0/2851459397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f3014f320 0x7f6f30158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:14.585 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.583+0000 7f6f2e7fc640 1 --2- 172.21.15.18:0/2851459397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f3015fd70 0x7f6f301441b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:14.586 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.583+0000 7f6f2effd640 1 -- 172.21.15.18:0/2851459397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f3015fd70 msgr2=0x7f6f301441b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:14.586 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.583+0000 7f6f2effd640 1 --2- 172.21.15.18:0/2851459397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f3015fd70 0x7f6f301441b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:14.586 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.583+0000 7f6f2effd640 1 -- 172.21.15.18:0/2851459397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f3014f320 msgr2=0x7f6f30158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:14.586 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.583+0000 7f6f2effd640 1 --2- 172.21.15.18:0/2851459397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f3014f320 0x7f6f30158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:14.586 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.583+0000 7f6f2effd640 1 -- 172.21.15.18:0/2851459397 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f30157ca0 con 0x7f6f3015b770 2024-09-19T09:13:14.586 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.583+0000 7f6f2effd640 1 --2- 172.21.15.18:0/2851459397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f3015b770 0x7f6f301f1400 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000e9e0 tx=0x7f6f2000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:14.586 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.583+0000 7f6f17fff640 1 -- 172.21.15.18:0/2851459397 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f20017070 con 0x7f6f3015b770 2024-09-19T09:13:14.586 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.583+0000 7f6f17fff640 1 -- 172.21.15.18:0/2851459397 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f2000c9d0 con 0x7f6f3015b770 2024-09-19T09:13:14.586 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.583+0000 7f6f35931640 1 -- 172.21.15.18:0/2851459397 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f30157f80 con 0x7f6f3015b770 2024-09-19T09:13:14.586 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.583+0000 7f6f17fff640 1 -- 172.21.15.18:0/2851459397 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f2000cdc0 con 0x7f6f3015b770 2024-09-19T09:13:14.586 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.583+0000 7f6f35931640 1 -- 172.21.15.18:0/2851459397 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f30158540 con 0x7f6f3015b770 2024-09-19T09:13:14.586 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.584+0000 7f6f17fff640 1 -- 172.21.15.18:0/2851459397 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6f2001a070 con 0x7f6f3015b770 2024-09-19T09:13:14.586 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.584+0000 7f6f17fff640 1 -- 172.21.15.18:0/2851459397 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(11..11 src has 1..11) ==== 1883+0+0 (secure 0 0 0) 0x7f6f2001ccb0 con 0x7f6f3015b770 2024-09-19T09:13:14.586 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.584+0000 7f6f35931640 1 -- 172.21.15.18:0/2851459397 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f30071e30 con 0x7f6f3015b770 2024-09-19T09:13:14.587 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.586+0000 7f6f17fff640 1 -- 172.21.15.18:0/2851459397 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6f2001c4f0 con 0x7f6f3015b770 2024-09-19T09:13:14.602 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-09-19T09:13:14.602+0000 7f924582d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:13:14.646 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.646+0000 7f6f35931640 1 -- 172.21.15.18:0/2851459397 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6f30157400 con 0x7f6f3015b770 2024-09-19T09:13:14.647 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.646+0000 7f6f17fff640 1 -- 172.21.15.18:0/2851459397 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) ==== 74+0+7058 (secure 0 0 0) 0x7f6f2001c730 con 0x7f6f3015b770 2024-09-19T09:13:14.647 INFO:teuthology.misc.health.smithi018.stdout: 2024-09-19T09:13:14.647 INFO:teuthology.misc.health.smithi018.stdout:{"epoch":11,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:13:14.418185+0000","last_up_change":"0.000000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:13:14.648 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.647+0000 7f6f35931640 1 -- 172.21.15.18:0/2851459397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f3015b770 msgr2=0x7f6f301f1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:14.648 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.647+0000 7f6f35931640 1 --2- 172.21.15.18:0/2851459397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f3015b770 0x7f6f301f1400 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f6f2000e9e0 tx=0x7f6f2000eea0 comp rx=0 tx=0).stop 2024-09-19T09:13:14.649 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.647+0000 7f6f35931640 1 -- 172.21.15.18:0/2851459397 shutdown_connections 2024-09-19T09:13:14.649 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.647+0000 7f6f35931640 1 --2- 172.21.15.18:0/2851459397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f3014f320 0x7f6f30158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:14.649 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.647+0000 7f6f35931640 1 --2- 172.21.15.18:0/2851459397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f3015fd70 0x7f6f301441b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:14.649 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.647+0000 7f6f35931640 1 --2- 172.21.15.18:0/2851459397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f3015b770 0x7f6f301f1400 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:14.649 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.647+0000 7f6f35931640 1 -- 172.21.15.18:0/2851459397 >> 172.21.15.18:0/2851459397 conn(0x7f6f3006bb90 msgr2=0x7f6f3015f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:14.649 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.647+0000 7f6f35931640 1 -- 172.21.15.18:0/2851459397 shutdown_connections 2024-09-19T09:13:14.649 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:14.648+0000 7f6f35931640 1 -- 172.21.15.18:0/2851459397 wait complete. 2024-09-19T09:13:14.649 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-19T09:13:14.648+0000 7fc879732040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T09:13:14.651 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-09-19T09:13:14.651+0000 7f924582d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:13:14.657 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-19T09:13:14.704 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-19T09:13:14.701+0000 7fc879732040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T09:13:14.705 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-09-19T09:13:14.701+0000 7f924582d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:13:14.755 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-19T09:13:14.755+0000 7fc879732040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T09:13:14.767 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-09-19T09:13:14.767+0000 7f924582d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:13:14.810 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-09-19T09:13:14.810+0000 7f924582d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:13:14.828 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-19T09:13:14.827+0000 7fc879732040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T09:13:14.853 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-09-19T09:13:14.853+0000 7f924582d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:13:14.877 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-19T09:13:14.876+0000 7fc879732040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T09:13:14.923 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-19T09:13:14.923+0000 7fc879732040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T09:13:15.427 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-09-19T09:13:15.427+0000 7fc47e65e640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T09:13:15.428 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-09-19T09:13:15.427+0000 7f74d817a640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T09:13:15.428 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-09-19T09:13:15.427+0000 7f5fb0a97640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T09:13:15.428 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-09-19T09:13:15.427+0000 7f635608d640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T09:13:15.428 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-19T09:13:15.427+0000 7f607dbe0640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T09:13:15.429 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-19T09:13:15.427+0000 7f10b42d4640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T09:13:15.429 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-19T09:13:15.427+0000 7f4adda7c640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T09:13:15.429 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-19T09:13:15.427+0000 7fd4ce7f9640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T09:13:15.430 INFO:tasks.ceph.osd.0.smithi018.stderr:2024-09-19T09:13:15.429+0000 7f6077214640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:13:15.430 INFO:tasks.ceph.osd.2.smithi018.stderr:2024-09-19T09:13:15.429+0000 7f10ad908640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:13:15.430 INFO:tasks.ceph.osd.3.smithi018.stderr:2024-09-19T09:13:15.429+0000 7f4ad70b0640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:13:15.430 INFO:tasks.ceph.osd.1.smithi018.stderr:2024-09-19T09:13:15.429+0000 7fd4c7e2d640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:13:15.431 INFO:tasks.ceph.osd.6.smithi162.stderr:2024-09-19T09:13:15.428+0000 7f74d17ae640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:13:15.431 INFO:tasks.ceph.osd.4.smithi162.stderr:2024-09-19T09:13:15.429+0000 7f5faa0cb640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:13:15.431 INFO:tasks.ceph.osd.7.smithi162.stderr:2024-09-19T09:13:15.429+0000 7f634f6c1640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:13:15.431 INFO:tasks.ceph.osd.5.smithi162.stderr:2024-09-19T09:13:15.429+0000 7fc477c92640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T09:13:15.509 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-09-19T09:13:15.509+0000 7f924582d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:13:15.618 INFO:tasks.ceph.mgr.y.smithi018.stderr:2024-09-19T09:13:15.618+0000 7fc879732040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T09:13:16.530 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-09-19T09:13:16.529+0000 7f91e5027640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-19T09:13:16.530 INFO:tasks.ceph.mgr.x.smithi162.stderr:2024-09-19T09:13:16.529+0000 7f91e5027640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-19T09:13:21.464 DEBUG:teuthology.orchestra.run.smithi018:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-19T09:13:21.568 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.568+0000 7f0c8884c640 1 Processor -- start 2024-09-19T09:13:21.568 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.568+0000 7f0c8884c640 1 -- start start 2024-09-19T09:13:21.569 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.569+0000 7f0c8884c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c8415cd90 0x7f0c840d0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:21.570 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.569+0000 7f0c8884c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0c840d0f60 0x7f0c840d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:21.570 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.569+0000 7f0c8884c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0c840cd470 0x7f0c840cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:21.570 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.569+0000 7f0c8884c640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f0c840cfa20 con 0x7f0c840cd470 2024-09-19T09:13:21.570 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.569+0000 7f0c8884c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f0c840b5340 con 0x7f0c840d0f60 2024-09-19T09:13:21.570 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.569+0000 7f0c8884c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0c840cfc70 con 0x7f0c8415cd90 2024-09-19T09:13:21.570 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.569+0000 7f0c82d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0c840cd470 0x7f0c840cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:21.570 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.569+0000 7f0c79d9b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0c840d0f60 0x7f0c840d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:21.570 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.569+0000 7f0c82d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0c840cd470 0x7f0c840cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59302/0 (socket says 172.21.15.18:59302) 2024-09-19T09:13:21.570 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.569+0000 7f0c8259c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c8415cd90 0x7f0c840d0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:21.570 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.569+0000 7f0c82d9d640 1 -- 172.21.15.18:0/2710644792 learned_addr learned my addr 172.21.15.18:0/2710644792 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:21.570 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.569+0000 7f0c82d9d640 1 -- 172.21.15.18:0/2710644792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c8415cd90 msgr2=0x7f0c840d0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:21.570 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.569+0000 7f0c82d9d640 1 --2- 172.21.15.18:0/2710644792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c8415cd90 0x7f0c840d0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:21.570 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.569+0000 7f0c82d9d640 1 -- 172.21.15.18:0/2710644792 >> v2:172.21.15.162:3300/0 conn(0x7f0c840d0f60 msgr2=0x7f0c840d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:21.571 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.569+0000 7f0c82d9d640 1 --2- 172.21.15.18:0/2710644792 >> v2:172.21.15.162:3300/0 conn(0x7f0c840d0f60 0x7f0c840d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:21.571 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.569+0000 7f0c82d9d640 1 -- 172.21.15.18:0/2710644792 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c840cff50 con 0x7f0c840cd470 2024-09-19T09:13:21.572 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.570+0000 7f0c82d9d640 1 --2- 172.21.15.18:0/2710644792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c840cd470 0x7f0c840cd920 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0c84072ff0 tx=0x7f0c7c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f213b63c0ff72bca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:21.572 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.570+0000 7f0c81d9b640 1 -- 172.21.15.18:0/2710644792 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c036070 con 0x7f0c840cd470 2024-09-19T09:13:21.572 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.570+0000 7f0c81d9b640 1 -- 172.21.15.18:0/2710644792 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c7c031600 con 0x7f0c840cd470 2024-09-19T09:13:21.572 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.570+0000 7f0c81d9b640 1 -- 172.21.15.18:0/2710644792 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c0319d0 con 0x7f0c840cd470 2024-09-19T09:13:21.572 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.571+0000 7f0c8884c640 1 -- 172.21.15.18:0/2710644792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c840cd470 msgr2=0x7f0c840cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:21.572 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.571+0000 7f0c8884c640 1 --2- 172.21.15.18:0/2710644792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c840cd470 0x7f0c840cd920 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0c84072ff0 tx=0x7f0c7c02a6a0 comp rx=0 tx=0).stop 2024-09-19T09:13:21.572 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.571+0000 7f0c8884c640 1 -- 172.21.15.18:0/2710644792 shutdown_connections 2024-09-19T09:13:21.572 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.571+0000 7f0c8884c640 1 --2- 172.21.15.18:0/2710644792 >> v2:172.21.15.162:3300/0 conn(0x7f0c840d0f60 0x7f0c840d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:21.572 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.571+0000 7f0c8884c640 1 --2- 172.21.15.18:0/2710644792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c840cd470 0x7f0c840cd920 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:21.573 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.571+0000 7f0c8884c640 1 --2- 172.21.15.18:0/2710644792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c8415cd90 0x7f0c840d0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:21.573 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.571+0000 7f0c8884c640 1 -- 172.21.15.18:0/2710644792 >> 172.21.15.18:0/2710644792 conn(0x7f0c840b4570 msgr2=0x7f0c840b4980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:21.573 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.571+0000 7f0c8884c640 1 -- 172.21.15.18:0/2710644792 shutdown_connections 2024-09-19T09:13:21.573 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.571+0000 7f0c8884c640 1 -- 172.21.15.18:0/2710644792 wait complete. 2024-09-19T09:13:21.575 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.572+0000 7f0c8884c640 1 Processor -- start 2024-09-19T09:13:21.575 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.572+0000 7f0c8884c640 1 -- start start 2024-09-19T09:13:21.575 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.573+0000 7f0c8884c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c840cd470 0x7f0c841f5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:21.575 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.573+0000 7f0c8884c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c840d0f60 0x7f0c840b7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:21.575 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.573+0000 7f0c8884c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c8406e590 0x7f0c840b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:21.575 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.573+0000 7f0c8884c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8406fbc0 con 0x7f0c840d0f60 2024-09-19T09:13:21.575 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.573+0000 7f0c8884c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8406f8e0 con 0x7f0c840cd470 2024-09-19T09:13:21.575 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.573+0000 7f0c8884c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0c840d18e0 con 0x7f0c8406e590 2024-09-19T09:13:21.575 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.573+0000 7f0c79d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c840d0f60 0x7f0c840b7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:21.576 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.573+0000 7f0c79d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c840d0f60 0x7f0c840b7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59318/0 (socket says 172.21.15.18:59318) 2024-09-19T09:13:21.576 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.573+0000 7f0c79d9b640 1 -- 172.21.15.18:0/3109589601 learned_addr learned my addr 172.21.15.18:0/3109589601 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:21.576 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.573+0000 7f0c8259c640 1 --2- 172.21.15.18:0/3109589601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c840cd470 0x7f0c841f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:21.576 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.573+0000 7f0c82d9d640 1 --2- 172.21.15.18:0/3109589601 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c8406e590 0x7f0c840b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:21.576 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.574+0000 7f0c79d9b640 1 -- 172.21.15.18:0/3109589601 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c8406e590 msgr2=0x7f0c840b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:21.576 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.574+0000 7f0c79d9b640 1 --2- 172.21.15.18:0/3109589601 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c8406e590 0x7f0c840b0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:21.576 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.574+0000 7f0c79d9b640 1 -- 172.21.15.18:0/3109589601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c840cd470 msgr2=0x7f0c841f5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:21.576 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.574+0000 7f0c79d9b640 1 --2- 172.21.15.18:0/3109589601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c840cd470 0x7f0c841f5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:21.576 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.574+0000 7f0c79d9b640 1 -- 172.21.15.18:0/3109589601 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c840b8380 con 0x7f0c840d0f60 2024-09-19T09:13:21.576 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.574+0000 7f0c79d9b640 1 --2- 172.21.15.18:0/3109589601 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c840d0f60 0x7f0c840b7e40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c00e860 tx=0x7f0c6c00ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:21.576 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.574+0000 7f0c7b7fe640 1 -- 172.21.15.18:0/3109589601 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c017070 con 0x7f0c840d0f60 2024-09-19T09:13:21.576 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.574+0000 7f0c7b7fe640 1 -- 172.21.15.18:0/3109589601 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c6c00c940 con 0x7f0c840d0f60 2024-09-19T09:13:21.576 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.574+0000 7f0c8884c640 1 -- 172.21.15.18:0/3109589601 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c840c78c0 con 0x7f0c840d0f60 2024-09-19T09:13:21.577 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.574+0000 7f0c7b7fe640 1 -- 172.21.15.18:0/3109589601 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c00cd10 con 0x7f0c840d0f60 2024-09-19T09:13:21.577 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.574+0000 7f0c8884c640 1 -- 172.21.15.18:0/3109589601 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c841f4e00 con 0x7f0c840d0f60 2024-09-19T09:13:21.578 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.575+0000 7f0c8884c640 1 -- 172.21.15.18:0/3109589601 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c840d13a0 con 0x7f0c840d0f60 2024-09-19T09:13:21.578 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.576+0000 7f0c7b7fe640 1 -- 172.21.15.18:0/3109589601 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 4) ==== 90790+0+0 (secure 0 0 0) 0x7f0c6c01a070 con 0x7f0c840d0f60 2024-09-19T09:13:21.578 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.576+0000 7f0c7b7fe640 1 --2- 172.21.15.18:0/3109589601 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0c6406c220 0x7f0c6406e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:21.578 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.576+0000 7f0c7b7fe640 1 -- 172.21.15.18:0/3109589601 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f0c6c08ad00 con 0x7f0c840d0f60 2024-09-19T09:13:21.578 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.577+0000 7f0c8259c640 1 --2- 172.21.15.18:0/3109589601 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0c6406c220 0x7f0c6406e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:21.578 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.577+0000 7f0c8259c640 1 --2- 172.21.15.18:0/3109589601 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0c6406c220 0x7f0c6406e6e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0c840c5a70 tx=0x7f0c74009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:21.581 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.581+0000 7f0c7b7fe640 1 -- 172.21.15.18:0/3109589601 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0c6c0591b0 con 0x7f0c840d0f60 2024-09-19T09:13:21.760 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.760+0000 7f0c8884c640 1 -- 172.21.15.18:0/3109589601 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c84071400 con 0x7f0c840d0f60 2024-09-19T09:13:21.761 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.761+0000 7f0c7b7fe640 1 -- 172.21.15.18:0/3109589601 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12908 (secure 0 0 0) 0x7f0c6c05d4b0 con 0x7f0c840d0f60 2024-09-19T09:13:21.761 INFO:teuthology.misc.health.smithi018.stdout: 2024-09-19T09:13:21.761 INFO:teuthology.misc.health.smithi018.stdout:{"epoch":17,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:13:20.455546+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:13:21.764 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.763+0000 7f0c8884c640 1 -- 172.21.15.18:0/3109589601 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0c6406c220 msgr2=0x7f0c6406e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:21.764 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.763+0000 7f0c8884c640 1 --2- 172.21.15.18:0/3109589601 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0c6406c220 0x7f0c6406e6e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0c840c5a70 tx=0x7f0c74009190 comp rx=0 tx=0).stop 2024-09-19T09:13:21.764 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.763+0000 7f0c8884c640 1 -- 172.21.15.18:0/3109589601 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c840d0f60 msgr2=0x7f0c840b7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:21.764 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.763+0000 7f0c8884c640 1 --2- 172.21.15.18:0/3109589601 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c840d0f60 0x7f0c840b7e40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c00e860 tx=0x7f0c6c00ed20 comp rx=0 tx=0).stop 2024-09-19T09:13:21.764 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.763+0000 7f0c8884c640 1 -- 172.21.15.18:0/3109589601 shutdown_connections 2024-09-19T09:13:21.764 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.763+0000 7f0c8884c640 1 --2- 172.21.15.18:0/3109589601 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0c6406c220 0x7f0c6406e6e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:21.764 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.763+0000 7f0c8884c640 1 --2- 172.21.15.18:0/3109589601 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c8406e590 0x7f0c840b0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:21.764 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.763+0000 7f0c8884c640 1 --2- 172.21.15.18:0/3109589601 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c840d0f60 0x7f0c840b7e40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:21.764 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.763+0000 7f0c8884c640 1 --2- 172.21.15.18:0/3109589601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c840cd470 0x7f0c841f5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:21.764 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.763+0000 7f0c8884c640 1 -- 172.21.15.18:0/3109589601 >> 172.21.15.18:0/3109589601 conn(0x7f0c840b4570 msgr2=0x7f0c840700e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:21.764 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.763+0000 7f0c8884c640 1 -- 172.21.15.18:0/3109589601 shutdown_connections 2024-09-19T09:13:21.764 INFO:teuthology.misc.health.smithi018.stderr:2024-09-19T09:13:21.763+0000 7f0c8884c640 1 -- 172.21.15.18:0/3109589601 wait complete. 2024-09-19T09:13:21.773 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-19T09:13:21.773 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-19T09:13:21.774 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T09:13:21.774 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T09:13:21.776 INFO:tasks.ceph.mds.a:Started 2024-09-19T09:13:21.776 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T09:13:21.776 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T09:13:21.778 INFO:tasks.ceph.mds.c:Started 2024-09-19T09:13:21.779 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T09:13:21.779 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T09:13:21.782 INFO:tasks.ceph.mds.b:Started 2024-09-19T09:13:21.782 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T09:13:21.782 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T09:13:21.784 INFO:tasks.ceph.mds.d:Started 2024-09-19T09:13:21.784 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-19T09:13:21.785 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:13:21.853 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-09-19T09:13:21.858 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2024-09-19T09:13:21.869 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-09-19T09:13:21.869 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-09-19T09:13:21.870 INFO:tasks.ceph.mds.b.smithi162.stderr:2024-09-19T09:13:21.869+0000 7fea194c3640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-19T09:13:21.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.891+0000 7f7b9ff52640 1 Processor -- start 2024-09-19T09:13:21.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.891+0000 7f7b9ff52640 1 -- start start 2024-09-19T09:13:21.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.892+0000 7f7b9ff52640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7b980d1ab0 0x7f7b980b8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:21.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.892+0000 7f7b9ff52640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7b980d3240 0x7f7b980b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:21.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.892+0000 7f7b9d4ed640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7b980d1ab0 0x7f7b980b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:21.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.892+0000 7f7b9d4ed640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7b980d1ab0 0x7f7b980b8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59364/0 (socket says 172.21.15.18:59364) 2024-09-19T09:13:21.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.892+0000 7f7b9dcee640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f7b9815ef50 0x7f7b980d13a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54758/0 (socket says 172.21.15.18:54758) 2024-09-19T09:13:21.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.892+0000 7f7b9d4ed640 1 -- 172.21.15.18:0/3766981870 learned_addr learned my addr 172.21.15.18:0/3766981870 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:21.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.892+0000 7f7b9ff52640 1 -- 172.21.15.18:0/3766981870 --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b980b7a90 con 0x7f7b9815ef50 2024-09-19T09:13:21.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.892+0000 7f7b9ff52640 1 -- 172.21.15.18:0/3766981870 --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f7b980d3740 con 0x7f7b980d1ab0 2024-09-19T09:13:21.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.892+0000 7f7b9ff52640 1 -- 172.21.15.18:0/3766981870 --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f7b980d3a20 con 0x7f7b980d3240 2024-09-19T09:13:21.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.893+0000 7f7b9e4ef640 1 --2- 172.21.15.18:0/3766981870 >> v2:172.21.15.162:3300/0 conn(0x7f7b980d3240 0x7f7b980b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:21.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.893+0000 7f7b9ccec640 1 -- 172.21.15.18:0/3766981870 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4042196174 0 0) 0x7f7b980b7a90 con 0x7f7b9815ef50 2024-09-19T09:13:21.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.893+0000 7f7b9ccec640 1 -- 172.21.15.18:0/3766981870 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b84003520 con 0x7f7b9815ef50 2024-09-19T09:13:21.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.893+0000 7f7b9d4ed640 1 -- 172.21.15.18:0/3766981870 >> v2:172.21.15.162:3300/0 conn(0x7f7b980d3240 msgr2=0x7f7b980b8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:21.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.893+0000 7f7b9d4ed640 1 --2- 172.21.15.18:0/3766981870 >> v2:172.21.15.162:3300/0 conn(0x7f7b980d3240 0x7f7b980b8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:21.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.893+0000 7f7b9d4ed640 1 -- 172.21.15.18:0/3766981870 >> v1:172.21.15.18:6789/0 conn(0x7f7b9815ef50 legacy=0x7f7b980d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:21.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.893+0000 7f7b9d4ed640 1 -- 172.21.15.18:0/3766981870 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b980b7d00 con 0x7f7b980d1ab0 2024-09-19T09:13:21.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.893+0000 7f7b9d4ed640 1 --2- 172.21.15.18:0/3766981870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b980d1ab0 0x7f7b980b8500 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7b980b7760 tx=0x7f7b9402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c9b09353a87795f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:21.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.894+0000 7f7b9ccec640 1 -- 172.21.15.18:0/3766981870 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b94037070 con 0x7f7b980d1ab0 2024-09-19T09:13:21.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.894+0000 7f7b9ccec640 1 -- 172.21.15.18:0/3766981870 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b94032440 con 0x7f7b980d1ab0 2024-09-19T09:13:21.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.894+0000 7f7b9ccec640 1 -- 172.21.15.18:0/3766981870 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b94032810 con 0x7f7b980d1ab0 2024-09-19T09:13:21.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.894+0000 7f7b9ff52640 1 -- 172.21.15.18:0/3766981870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b980d1ab0 msgr2=0x7f7b980b8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:21.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.894+0000 7f7b9ff52640 1 --2- 172.21.15.18:0/3766981870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b980d1ab0 0x7f7b980b8500 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7b980b7760 tx=0x7f7b9402a1e0 comp rx=0 tx=0).stop 2024-09-19T09:13:21.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.894+0000 7f7b9ff52640 1 -- 172.21.15.18:0/3766981870 shutdown_connections 2024-09-19T09:13:21.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.894+0000 7f7b9ff52640 1 --2- 172.21.15.18:0/3766981870 >> v2:172.21.15.162:3300/0 conn(0x7f7b980d3240 0x7f7b980b8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:21.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.894+0000 7f7b9ff52640 1 --2- 172.21.15.18:0/3766981870 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b980d1ab0 0x7f7b980b8500 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:21.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.894+0000 7f7b9ff52640 1 -- 172.21.15.18:0/3766981870 >> 172.21.15.18:0/3766981870 conn(0x7f7b980d4c60 msgr2=0x7f7b980d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:21.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.894+0000 7f7b9ff52640 1 -- 172.21.15.18:0/3766981870 shutdown_connections 2024-09-19T09:13:21.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.894+0000 7f7b9ff52640 1 -- 172.21.15.18:0/3766981870 wait complete. 2024-09-19T09:13:21.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.895+0000 7f7b9ff52640 1 Processor -- start 2024-09-19T09:13:21.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.895+0000 7f7b9ff52640 1 -- start start 2024-09-19T09:13:21.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.896+0000 7f7b9ff52640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b980d1ab0 0x7f7b981f5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:21.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.896+0000 7f7b9ff52640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b980d3240 0x7f7b9815bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:21.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.896+0000 7f7b9ff52640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b9815ef50 0x7f7b9815c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:21.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.896+0000 7f7b9ff52640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7b980d21a0 con 0x7f7b980d1ab0 2024-09-19T09:13:21.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.896+0000 7f7b9ff52640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7b980d2020 con 0x7f7b9815ef50 2024-09-19T09:13:21.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.896+0000 7f7b9dcee640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b980d1ab0 0x7f7b981f5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:21.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.896+0000 7f7b9ff52640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7b980d5780 con 0x7f7b980d3240 2024-09-19T09:13:21.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.896+0000 7f7b9dcee640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b980d1ab0 0x7f7b981f5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59368/0 (socket says 172.21.15.18:59368) 2024-09-19T09:13:21.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.896+0000 7f7b9dcee640 1 -- 172.21.15.18:0/1206407961 learned_addr learned my addr 172.21.15.18:0/1206407961 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:21.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.896+0000 7f7b9e4ef640 1 --2- 172.21.15.18:0/1206407961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b9815ef50 0x7f7b9815c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:21.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.896+0000 7f7b9d4ed640 1 --2- 172.21.15.18:0/1206407961 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b980d3240 0x7f7b9815bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:21.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.897+0000 7f7b9dcee640 1 -- 172.21.15.18:0/1206407961 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b980d3240 msgr2=0x7f7b9815bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:21.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.897+0000 7f7b9dcee640 1 --2- 172.21.15.18:0/1206407961 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b980d3240 0x7f7b9815bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:21.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.897+0000 7f7b9dcee640 1 -- 172.21.15.18:0/1206407961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b9815ef50 msgr2=0x7f7b9815c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:21.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.897+0000 7f7b9dcee640 1 --2- 172.21.15.18:0/1206407961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b9815ef50 0x7f7b9815c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:21.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.897+0000 7f7b9dcee640 1 -- 172.21.15.18:0/1206407961 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b9815bc10 con 0x7f7b980d1ab0 2024-09-19T09:13:21.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.897+0000 7f7b9dcee640 1 --2- 172.21.15.18:0/1206407961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b980d1ab0 0x7f7b981f5680 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7b8800c390 tx=0x7f7b8800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:21.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.897+0000 7f7b8e7fc640 1 -- 172.21.15.18:0/1206407961 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b880074e0 con 0x7f7b980d1ab0 2024-09-19T09:13:21.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.897+0000 7f7b8e7fc640 1 -- 172.21.15.18:0/1206407961 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b880047e0 con 0x7f7b980d1ab0 2024-09-19T09:13:21.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.897+0000 7f7b8e7fc640 1 -- 172.21.15.18:0/1206407961 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b88004bd0 con 0x7f7b980d1ab0 2024-09-19T09:13:21.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.897+0000 7f7b9ff52640 1 -- 172.21.15.18:0/1206407961 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b981f5f30 con 0x7f7b980d1ab0 2024-09-19T09:13:21.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.897+0000 7f7b9ff52640 1 -- 172.21.15.18:0/1206407961 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b981f64f0 con 0x7f7b980d1ab0 2024-09-19T09:13:21.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.898+0000 7f7b9ff52640 1 -- 172.21.15.18:0/1206407961 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b980d13a0 con 0x7f7b980d1ab0 2024-09-19T09:13:21.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.898+0000 7f7b8e7fc640 1 -- 172.21.15.18:0/1206407961 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 4) ==== 90790+0+0 (secure 0 0 0) 0x7f7b8801a020 con 0x7f7b980d1ab0 2024-09-19T09:13:21.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.899+0000 7f7b8e7fc640 1 --2- 172.21.15.18:0/1206407961 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7b7c06c220 0x7f7b7c06e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:21.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.899+0000 7f7b8e7fc640 1 -- 172.21.15.18:0/1206407961 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f7b8808a6a0 con 0x7f7b980d1ab0 2024-09-19T09:13:21.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.899+0000 7f7b9d4ed640 1 --2- 172.21.15.18:0/1206407961 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7b7c06c220 0x7f7b7c06e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:21.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.900+0000 7f7b9d4ed640 1 --2- 172.21.15.18:0/1206407961 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7b7c06c220 0x7f7b7c06e6e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7b94034000 tx=0x7f7b9402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:21.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:21.903+0000 7f7b8e7fc640 1 -- 172.21.15.18:0/1206407961 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7b88058cb0 con 0x7f7b980d1ab0 2024-09-19T09:13:22.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:22.114+0000 7f7b9ff52640 1 -- 172.21.15.18:0/1206407961 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b9806d1c0 con 0x7f7b980d1ab0 2024-09-19T09:13:22.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:22.115+0000 7f7b8e7fc640 1 -- 172.21.15.18:0/1206407961 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7f7b8805cfb0 con 0x7f7b980d1ab0 2024-09-19T09:13:22.115 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:22.115 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":2,"btime":"2024-09-19T09:13:21:858000+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/2341594474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2341594474},{"type":"v1","addr":"172.21.15.18:6833","nonce":2341594474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T09:13:22.115 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 2 2024-09-19T09:13:22.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:22.116+0000 7f7b9ff52640 1 -- 172.21.15.18:0/1206407961 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7b7c06c220 msgr2=0x7f7b7c06e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:22.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:22.116+0000 7f7b9ff52640 1 --2- 172.21.15.18:0/1206407961 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7b7c06c220 0x7f7b7c06e6e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7b94034000 tx=0x7f7b9402e000 comp rx=0 tx=0).stop 2024-09-19T09:13:22.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:22.117+0000 7f7b9ff52640 1 -- 172.21.15.18:0/1206407961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b980d1ab0 msgr2=0x7f7b981f5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:22.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:22.117+0000 7f7b9ff52640 1 --2- 172.21.15.18:0/1206407961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b980d1ab0 0x7f7b981f5680 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7b8800c390 tx=0x7f7b8800c850 comp rx=0 tx=0).stop 2024-09-19T09:13:22.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:22.117+0000 7f7b9ff52640 1 -- 172.21.15.18:0/1206407961 shutdown_connections 2024-09-19T09:13:22.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:22.117+0000 7f7b9ff52640 1 --2- 172.21.15.18:0/1206407961 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7b7c06c220 0x7f7b7c06e6e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:22.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:22.117+0000 7f7b9ff52640 1 --2- 172.21.15.18:0/1206407961 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b9815ef50 0x7f7b9815c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:22.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:22.117+0000 7f7b9ff52640 1 --2- 172.21.15.18:0/1206407961 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b980d3240 0x7f7b9815bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:22.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:22.117+0000 7f7b9ff52640 1 --2- 172.21.15.18:0/1206407961 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b980d1ab0 0x7f7b981f5680 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:22.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:22.117+0000 7f7b9ff52640 1 -- 172.21.15.18:0/1206407961 >> 172.21.15.18:0/1206407961 conn(0x7f7b980d4c60 msgr2=0x7f7b9806c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:22.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:22.117+0000 7f7b9ff52640 1 -- 172.21.15.18:0/1206407961 shutdown_connections 2024-09-19T09:13:22.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:22.117+0000 7f7b9ff52640 1 -- 172.21.15.18:0/1206407961 wait complete. 2024-09-19T09:13:24.129 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:13:24.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.244+0000 7f74ed04c640 1 Processor -- start 2024-09-19T09:13:24.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.244+0000 7f74ed04c640 1 -- start start 2024-09-19T09:13:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.245+0000 7f74ed04c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f74e815ecc0 0x7f74e80d3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.245+0000 7f74ed04c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74e80d3b20 con 0x7f74e80d1b60 2024-09-19T09:13:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.245+0000 7f74ed04c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74e80b42f0 con 0x7f74e80d57a0 2024-09-19T09:13:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.245+0000 7f74ed04c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f74e80b45d0 con 0x7f74e815ecc0 2024-09-19T09:13:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.245+0000 7f74e759e640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f74e80d1b60 0x7f74e80b50b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54770/0 (socket says 172.21.15.18:54770) 2024-09-19T09:13:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.245+0000 7f74e759e640 1 -- 172.21.15.18:0/2552479801 learned_addr learned my addr 172.21.15.18:0/2552479801 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.245+0000 7f74e6d9d640 1 --2- 172.21.15.18:0/2552479801 >> v2:172.21.15.162:3300/0 conn(0x7f74e815ecc0 0x7f74e80d3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:24.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.246+0000 7f74e5d9b640 1 -- 172.21.15.18:0/2552479801 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3131124339 0 0) 0x7f74e80d3b20 con 0x7f74e80d1b60 2024-09-19T09:13:24.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.246+0000 7f74e5d9b640 1 -- 172.21.15.18:0/2552479801 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74d0003520 con 0x7f74e80d1b60 2024-09-19T09:13:24.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.246+0000 7f74e6d9d640 1 -- 172.21.15.18:0/2552479801 >> v1:172.21.15.162:6789/0 conn(0x7f74e80d57a0 legacy=0x7f74e80d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:24.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.246+0000 7f74e5d9b640 1 -- 172.21.15.18:0/2552479801 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1979276704 0 0) 0x7f74d0003520 con 0x7f74e80d1b60 2024-09-19T09:13:24.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.246+0000 7f74e6d9d640 1 -- 172.21.15.18:0/2552479801 >> v1:172.21.15.18:6789/0 conn(0x7f74e80d1b60 legacy=0x7f74e80b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:24.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.246+0000 7f74e6d9d640 1 -- 172.21.15.18:0/2552479801 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e80b48b0 con 0x7f74e815ecc0 2024-09-19T09:13:24.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.247+0000 7f74e6d9d640 1 --2- 172.21.15.18:0/2552479801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74e815ecc0 0x7f74e80d3170 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f74d8009720 tx=0x7f74d8029fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3de45a4cbe38440b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:24.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.247+0000 7f74e5d9b640 1 -- 172.21.15.18:0/2552479801 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d8037070 con 0x7f74e815ecc0 2024-09-19T09:13:24.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.247+0000 7f74e5d9b640 1 -- 172.21.15.18:0/2552479801 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74d802aa60 con 0x7f74e815ecc0 2024-09-19T09:13:24.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.247+0000 7f74e5d9b640 1 -- 172.21.15.18:0/2552479801 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e00019f0 con 0x7f74e815ecc0 2024-09-19T09:13:24.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.247+0000 7f74ed04c640 1 -- 172.21.15.18:0/2552479801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74e815ecc0 msgr2=0x7f74e80d3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:24.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.247+0000 7f74ed04c640 1 --2- 172.21.15.18:0/2552479801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74e815ecc0 0x7f74e80d3170 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f74d8009720 tx=0x7f74d8029fd0 comp rx=0 tx=0).stop 2024-09-19T09:13:24.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.247+0000 7f74ed04c640 1 -- 172.21.15.18:0/2552479801 shutdown_connections 2024-09-19T09:13:24.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.247+0000 7f74ed04c640 1 --2- 172.21.15.18:0/2552479801 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74e815ecc0 0x7f74e80d3170 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:24.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.247+0000 7f74ed04c640 1 -- 172.21.15.18:0/2552479801 >> 172.21.15.18:0/2552479801 conn(0x7f74e80d4bd0 msgr2=0x7f74e80d4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:24.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.248+0000 7f74ed04c640 1 -- 172.21.15.18:0/2552479801 shutdown_connections 2024-09-19T09:13:24.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.248+0000 7f74ed04c640 1 -- 172.21.15.18:0/2552479801 wait complete. 2024-09-19T09:13:24.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.249+0000 7f74ed04c640 1 Processor -- start 2024-09-19T09:13:24.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.249+0000 7f74ed04c640 1 -- start start 2024-09-19T09:13:24.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.250+0000 7f74ed04c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74e80d1b60 0x7f74e80b7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:24.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.250+0000 7f74ed04c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f74e80d57a0 0x7f74e80b92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:24.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.250+0000 7f74ed04c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74e815ecc0 0x7f74e815db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:24.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.250+0000 7f74ed04c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f74e80d36b0 con 0x7f74e815ecc0 2024-09-19T09:13:24.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.250+0000 7f74ed04c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f74e80b4bf0 con 0x7f74e80d1b60 2024-09-19T09:13:24.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.250+0000 7f74ed04c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f74e80d3830 con 0x7f74e80d57a0 2024-09-19T09:13:24.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.250+0000 7f74e759e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74e815ecc0 0x7f74e815db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:24.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.250+0000 7f74e759e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74e815ecc0 0x7f74e815db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59370/0 (socket says 172.21.15.18:59370) 2024-09-19T09:13:24.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.250+0000 7f74e759e640 1 -- 172.21.15.18:0/207961171 learned_addr learned my addr 172.21.15.18:0/207961171 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:24.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.250+0000 7f74e6d9d640 1 --2- 172.21.15.18:0/207961171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74e80d1b60 0x7f74e80b7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:24.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.250+0000 7f74e659c640 1 --2- 172.21.15.18:0/207961171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f74e80d57a0 0x7f74e80b92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:24.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.250+0000 7f74e759e640 1 -- 172.21.15.18:0/207961171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f74e80d57a0 msgr2=0x7f74e80b92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:24.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.250+0000 7f74e759e640 1 --2- 172.21.15.18:0/207961171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f74e80d57a0 0x7f74e80b92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:24.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.250+0000 7f74e759e640 1 -- 172.21.15.18:0/207961171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74e80d1b60 msgr2=0x7f74e80b7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:24.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.250+0000 7f74e759e640 1 --2- 172.21.15.18:0/207961171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74e80d1b60 0x7f74e80b7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:24.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.250+0000 7f74e759e640 1 -- 172.21.15.18:0/207961171 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e80b8250 con 0x7f74e815ecc0 2024-09-19T09:13:24.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.251+0000 7f74e759e640 1 --2- 172.21.15.18:0/207961171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74e815ecc0 0x7f74e815db70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f74e000cb20 tx=0x7f74e0007e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:24.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.251+0000 7f74cf7fe640 1 -- 172.21.15.18:0/207961171 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e0018070 con 0x7f74e815ecc0 2024-09-19T09:13:24.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.251+0000 7f74cf7fe640 1 -- 172.21.15.18:0/207961171 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74e000a6a0 con 0x7f74e815ecc0 2024-09-19T09:13:24.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.251+0000 7f74cf7fe640 1 -- 172.21.15.18:0/207961171 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e000aa70 con 0x7f74e815ecc0 2024-09-19T09:13:24.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.251+0000 7f74ed04c640 1 -- 172.21.15.18:0/207961171 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74e80b8530 con 0x7f74e815ecc0 2024-09-19T09:13:24.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.251+0000 7f74ed04c640 1 -- 172.21.15.18:0/207961171 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74e80b8af0 con 0x7f74e815ecc0 2024-09-19T09:13:24.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.252+0000 7f74ed04c640 1 -- 172.21.15.18:0/207961171 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74e80d3170 con 0x7f74e815ecc0 2024-09-19T09:13:24.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.252+0000 7f74cf7fe640 1 -- 172.21.15.18:0/207961171 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f74e000ac10 con 0x7f74e815ecc0 2024-09-19T09:13:24.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.253+0000 7f74cf7fe640 1 --2- 172.21.15.18:0/207961171 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f74d406c2b0 0x7f74d406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:24.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.253+0000 7f74cf7fe640 1 -- 172.21.15.18:0/207961171 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f74e008a820 con 0x7f74e815ecc0 2024-09-19T09:13:24.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.253+0000 7f74e6d9d640 1 --2- 172.21.15.18:0/207961171 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f74d406c2b0 0x7f74d406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:24.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.254+0000 7f74e6d9d640 1 --2- 172.21.15.18:0/207961171 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f74d406c2b0 0x7f74d406e770 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f74d8034000 tx=0x7f74d802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:24.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.257+0000 7f74cf7fe640 1 -- 172.21.15.18:0/207961171 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f74e0058c10 con 0x7f74e815ecc0 2024-09-19T09:13:24.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.471+0000 7f74ed04c640 1 -- 172.21.15.18:0/207961171 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f74e80b3660 con 0x7f74e815ecc0 2024-09-19T09:13:24.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.473+0000 7f74cf7fe640 1 -- 172.21.15.18:0/207961171 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3906 (secure 0 0 0) 0x7f74e005cf10 con 0x7f74e815ecc0 2024-09-19T09:13:24.473 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:24.474 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":3,"btime":"2024-09-19T09:13:22:859070+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3070220651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3070220651},{"type":"v1","addr":"172.21.15.162:6836","nonce":3070220651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/2341594474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2341594474},{"type":"v1","addr":"172.21.15.18:6833","nonce":2341594474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/603326104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":603326104},{"type":"v1","addr":"172.21.15.18:6835","nonce":603326104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/727689889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":727689889},{"type":"v1","addr":"172.21.15.162:6837","nonce":727689889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-19T09:13:24.474 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 3 2024-09-19T09:13:24.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.475+0000 7f74ed04c640 1 -- 172.21.15.18:0/207961171 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f74d406c2b0 msgr2=0x7f74d406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:24.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.475+0000 7f74ed04c640 1 --2- 172.21.15.18:0/207961171 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f74d406c2b0 0x7f74d406e770 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f74d8034000 tx=0x7f74d802e000 comp rx=0 tx=0).stop 2024-09-19T09:13:24.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.475+0000 7f74ed04c640 1 -- 172.21.15.18:0/207961171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74e815ecc0 msgr2=0x7f74e815db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:24.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.475+0000 7f74ed04c640 1 --2- 172.21.15.18:0/207961171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74e815ecc0 0x7f74e815db70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f74e000cb20 tx=0x7f74e0007e70 comp rx=0 tx=0).stop 2024-09-19T09:13:24.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.475+0000 7f74ed04c640 1 -- 172.21.15.18:0/207961171 shutdown_connections 2024-09-19T09:13:24.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.475+0000 7f74ed04c640 1 --2- 172.21.15.18:0/207961171 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f74d406c2b0 0x7f74d406e770 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:24.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.475+0000 7f74ed04c640 1 --2- 172.21.15.18:0/207961171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74e815ecc0 0x7f74e815db70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:24.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.475+0000 7f74ed04c640 1 --2- 172.21.15.18:0/207961171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f74e80d57a0 0x7f74e80b92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:24.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.475+0000 7f74ed04c640 1 --2- 172.21.15.18:0/207961171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74e80d1b60 0x7f74e80b7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:24.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.475+0000 7f74ed04c640 1 -- 172.21.15.18:0/207961171 >> 172.21.15.18:0/207961171 conn(0x7f74e80d4bd0 msgr2=0x7f74e80b6380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:24.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.475+0000 7f74ed04c640 1 -- 172.21.15.18:0/207961171 shutdown_connections 2024-09-19T09:13:24.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.475+0000 7f74ed04c640 1 -- 172.21.15.18:0/207961171 wait complete. 2024-09-19T09:13:24.487 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-19T09:13:24.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.589+0000 7fd643554640 1 Processor -- start 2024-09-19T09:13:24.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.589+0000 7fd643554640 1 -- start start 2024-09-19T09:13:24.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.590+0000 7fd643554640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd63c0d3240 0x7fd63c0b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:24.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.590+0000 7fd643554640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd63c0b7a90 con 0x7fd63c0d1ab0 2024-09-19T09:13:24.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.590+0000 7fd643554640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd63c0d3740 con 0x7fd63c15ef50 2024-09-19T09:13:24.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.590+0000 7fd643554640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd63c0d3a20 con 0x7fd63c0d3240 2024-09-19T09:13:24.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.590+0000 7fd640aef640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd63c0d1ab0 0x7fd63c0b8500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54782/0 (socket says 172.21.15.18:54782) 2024-09-19T09:13:24.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.590+0000 7fd640aef640 1 -- 172.21.15.18:0/790047667 learned_addr learned my addr 172.21.15.18:0/790047667 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:24.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.590+0000 7fd641af1640 1 --2- 172.21.15.18:0/790047667 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd63c0d3240 0x7fd63c0b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:24.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.590+0000 7fd633fff640 1 -- 172.21.15.18:0/790047667 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4098039499 0 0) 0x7fd63c0b7a90 con 0x7fd63c0d1ab0 2024-09-19T09:13:24.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.590+0000 7fd633fff640 1 -- 172.21.15.18:0/790047667 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd628003520 con 0x7fd63c0d1ab0 2024-09-19T09:13:24.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.590+0000 7fd633fff640 1 -- 172.21.15.18:0/790047667 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1469392464 0 0) 0x7fd628003520 con 0x7fd63c0d1ab0 2024-09-19T09:13:24.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.590+0000 7fd633fff640 1 -- 172.21.15.18:0/790047667 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd63c0d3240 msgr2=0x7fd63c0b8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:24.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.590+0000 7fd633fff640 1 --2- 172.21.15.18:0/790047667 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd63c0d3240 0x7fd63c0b8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:24.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.590+0000 7fd633fff640 1 -- 172.21.15.18:0/790047667 >> v1:172.21.15.162:6789/0 conn(0x7fd63c15ef50 legacy=0x7fd63c0d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:24.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.590+0000 7fd633fff640 1 -- 172.21.15.18:0/790047667 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd63c0b7d00 con 0x7fd63c0d1ab0 2024-09-19T09:13:24.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.590+0000 7fd633fff640 1 -- 172.21.15.18:0/790047667 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fd62c001670 con 0x7fd63c0d1ab0 2024-09-19T09:13:24.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.590+0000 7fd633fff640 1 -- 172.21.15.18:0/790047667 >> v1:172.21.15.18:6789/0 conn(0x7fd63c0d1ab0 legacy=0x7fd63c0b8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:24.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.590+0000 7fd633fff640 1 --2- 172.21.15.18:0/790047667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6280039e0 0x7fd628003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:24.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.590+0000 7fd633fff640 1 --2- 172.21.15.18:0/790047667 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd63c0d3240 0x7fd628004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:24.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.590+0000 7fd633fff640 1 --2- 172.21.15.18:0/790047667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd628004d40 0x7fd6280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:24.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.590+0000 7fd633fff640 1 -- 172.21.15.18:0/790047667 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd63c0d3a20 con 0x7fd628004d40 2024-09-19T09:13:24.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.590+0000 7fd633fff640 1 -- 172.21.15.18:0/790047667 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd62800ba70 con 0x7fd6280039e0 2024-09-19T09:13:24.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.590+0000 7fd633fff640 1 -- 172.21.15.18:0/790047667 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd62800bc70 con 0x7fd63c0d3240 2024-09-19T09:13:24.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.591+0000 7fd641af1640 1 --2- 172.21.15.18:0/790047667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd628004d40 0x7fd6280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:24.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.591+0000 7fd6412f0640 1 --2- 172.21.15.18:0/790047667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6280039e0 0x7fd628003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:24.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.591+0000 7fd640aef640 1 --2- 172.21.15.18:0/790047667 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd63c0d3240 0x7fd628004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:24.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.591+0000 7fd641af1640 1 -- 172.21.15.18:0/790047667 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd63c0d3240 msgr2=0x7fd628004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:24.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.591+0000 7fd641af1640 1 --2- 172.21.15.18:0/790047667 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd63c0d3240 0x7fd628004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:24.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.591+0000 7fd641af1640 1 -- 172.21.15.18:0/790047667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6280039e0 msgr2=0x7fd628003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:24.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.591+0000 7fd641af1640 1 --2- 172.21.15.18:0/790047667 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6280039e0 0x7fd628003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:24.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.591+0000 7fd641af1640 1 -- 172.21.15.18:0/790047667 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd628003520 con 0x7fd628004d40 2024-09-19T09:13:24.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.592+0000 7fd641af1640 1 --2- 172.21.15.18:0/790047667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd628004d40 0x7fd6280051c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd634009f90 tx=0x7fd628005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c076dd3a759fc28 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:24.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.592+0000 7fd633fff640 1 -- 172.21.15.18:0/790047667 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd634009c10 con 0x7fd628004d40 2024-09-19T09:13:24.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.592+0000 7fd633fff640 1 -- 172.21.15.18:0/790047667 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd634036070 con 0x7fd628004d40 2024-09-19T09:13:24.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.592+0000 7fd633fff640 1 -- 172.21.15.18:0/790047667 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd634031850 con 0x7fd628004d40 2024-09-19T09:13:24.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.592+0000 7fd643554640 1 -- 172.21.15.18:0/790047667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd628004d40 msgr2=0x7fd6280051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:24.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.592+0000 7fd643554640 1 --2- 172.21.15.18:0/790047667 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd628004d40 0x7fd6280051c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd634009f90 tx=0x7fd628005830 comp rx=0 tx=0).stop 2024-09-19T09:13:24.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.592+0000 7fd641af1640 1 -- 172.21.15.18:0/790047667 reap_dead start 2024-09-19T09:13:24.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.592+0000 7fd643554640 1 -- 172.21.15.18:0/790047667 shutdown_connections 2024-09-19T09:13:24.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.592+0000 7fd643554640 1 -- 172.21.15.18:0/790047667 >> 172.21.15.18:0/790047667 conn(0x7fd63c0d4c60 msgr2=0x7fd63c0d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:24.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.592+0000 7fd643554640 1 -- 172.21.15.18:0/790047667 shutdown_connections 2024-09-19T09:13:24.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.592+0000 7fd643554640 1 -- 172.21.15.18:0/790047667 wait complete. 2024-09-19T09:13:24.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.593+0000 7fd643554640 1 Processor -- start 2024-09-19T09:13:24.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.594+0000 7fd643554640 1 -- start start 2024-09-19T09:13:24.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.594+0000 7fd643554640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd628004d40 0x7fd63c1546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:24.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.594+0000 7fd643554640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd63c0c9f60 0x7fd63c14ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:24.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.594+0000 7fd643554640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd63c15f3c0 0x7fd63c15f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:24.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.594+0000 7fd643554640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd63c0d21a0 con 0x7fd63c15f3c0 2024-09-19T09:13:24.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.594+0000 7fd643554640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd63c0d2020 con 0x7fd628004d40 2024-09-19T09:13:24.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.594+0000 7fd643554640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd63c0d5780 con 0x7fd63c0c9f60 2024-09-19T09:13:24.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.594+0000 7fd641af1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd63c15f3c0 0x7fd63c15f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:24.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.594+0000 7fd641af1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd63c15f3c0 0x7fd63c15f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59384/0 (socket says 172.21.15.18:59384) 2024-09-19T09:13:24.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.594+0000 7fd641af1640 1 -- 172.21.15.18:0/847171165 learned_addr learned my addr 172.21.15.18:0/847171165 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:24.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.594+0000 7fd6412f0640 1 --2- 172.21.15.18:0/847171165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd628004d40 0x7fd63c1546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:24.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.594+0000 7fd640aef640 1 --2- 172.21.15.18:0/847171165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd63c0c9f60 0x7fd63c14ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:24.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.595+0000 7fd641af1640 1 -- 172.21.15.18:0/847171165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd63c0c9f60 msgr2=0x7fd63c14ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:24.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.595+0000 7fd641af1640 1 --2- 172.21.15.18:0/847171165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd63c0c9f60 0x7fd63c14ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:24.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.595+0000 7fd641af1640 1 -- 172.21.15.18:0/847171165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd628004d40 msgr2=0x7fd63c1546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:24.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.595+0000 7fd641af1640 1 --2- 172.21.15.18:0/847171165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd628004d40 0x7fd63c1546e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:24.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.595+0000 7fd641af1640 1 -- 172.21.15.18:0/847171165 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd63c0ca500 con 0x7fd63c15f3c0 2024-09-19T09:13:24.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.595+0000 7fd641af1640 1 --2- 172.21.15.18:0/847171165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd63c15f3c0 0x7fd63c15f840 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd634033040 tx=0x7fd634009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:24.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.595+0000 7fd631ffb640 1 -- 172.21.15.18:0/847171165 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd634009c10 con 0x7fd63c15f3c0 2024-09-19T09:13:24.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.595+0000 7fd631ffb640 1 -- 172.21.15.18:0/847171165 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd634003990 con 0x7fd63c15f3c0 2024-09-19T09:13:24.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.595+0000 7fd643554640 1 -- 172.21.15.18:0/847171165 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd63c0ca7e0 con 0x7fd63c15f3c0 2024-09-19T09:13:24.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.595+0000 7fd631ffb640 1 -- 172.21.15.18:0/847171165 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd634003d80 con 0x7fd63c15f3c0 2024-09-19T09:13:24.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.595+0000 7fd643554640 1 -- 172.21.15.18:0/847171165 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd63c0cada0 con 0x7fd63c15f3c0 2024-09-19T09:13:24.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.596+0000 7fd643554640 1 -- 172.21.15.18:0/847171165 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd63c0d13a0 con 0x7fd63c15f3c0 2024-09-19T09:13:24.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.597+0000 7fd631ffb640 1 -- 172.21.15.18:0/847171165 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd634005d10 con 0x7fd63c15f3c0 2024-09-19T09:13:24.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.597+0000 7fd631ffb640 1 --2- 172.21.15.18:0/847171165 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd62006c2b0 0x7fd62006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:24.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.597+0000 7fd631ffb640 1 -- 172.21.15.18:0/847171165 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fd6340ac7a0 con 0x7fd63c15f3c0 2024-09-19T09:13:24.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.598+0000 7fd6412f0640 1 --2- 172.21.15.18:0/847171165 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd62006c2b0 0x7fd62006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:24.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.598+0000 7fd6412f0640 1 --2- 172.21.15.18:0/847171165 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd62006c2b0 0x7fd62006e770 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd6380019c0 tx=0x7fd638009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:24.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.602+0000 7fd631ffb640 1 -- 172.21.15.18:0/847171165 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd63404a060 con 0x7fd63c15f3c0 2024-09-19T09:13:24.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.778+0000 7fd643554640 1 -- 172.21.15.18:0/847171165 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd63c06ca50 con 0x7fd63c15f3c0 2024-09-19T09:13:24.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.778+0000 7fd631ffb640 1 -- 172.21.15.18:0/847171165 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7fd63402e050 con 0x7fd63c15f3c0 2024-09-19T09:13:24.779 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:24.779 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-09-19T09:13:24.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:13:24.779 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 1, 2024-09-19T09:13:24.779 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": ".mgr" 2024-09-19T09:13:24.779 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:13:24.779 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-09-19T09:13:24.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.780+0000 7fd643554640 1 -- 172.21.15.18:0/847171165 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd62006c2b0 msgr2=0x7fd62006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:24.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.780+0000 7fd643554640 1 --2- 172.21.15.18:0/847171165 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd62006c2b0 0x7fd62006e770 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fd6380019c0 tx=0x7fd638009040 comp rx=0 tx=0).stop 2024-09-19T09:13:24.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.780+0000 7fd643554640 1 -- 172.21.15.18:0/847171165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd63c15f3c0 msgr2=0x7fd63c15f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:24.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.780+0000 7fd643554640 1 --2- 172.21.15.18:0/847171165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd63c15f3c0 0x7fd63c15f840 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd634033040 tx=0x7fd634009750 comp rx=0 tx=0).stop 2024-09-19T09:13:24.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.780+0000 7fd643554640 1 -- 172.21.15.18:0/847171165 shutdown_connections 2024-09-19T09:13:24.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.780+0000 7fd643554640 1 --2- 172.21.15.18:0/847171165 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd62006c2b0 0x7fd62006e770 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:24.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.780+0000 7fd643554640 1 --2- 172.21.15.18:0/847171165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd63c15f3c0 0x7fd63c15f840 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:24.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.780+0000 7fd643554640 1 --2- 172.21.15.18:0/847171165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd63c0c9f60 0x7fd63c14ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:24.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.780+0000 7fd643554640 1 --2- 172.21.15.18:0/847171165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd628004d40 0x7fd63c1546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:24.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.780+0000 7fd643554640 1 -- 172.21.15.18:0/847171165 >> 172.21.15.18:0/847171165 conn(0x7fd63c0d4c60 msgr2=0x7fd63c0b8840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:24.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.780+0000 7fd643554640 1 -- 172.21.15.18:0/847171165 shutdown_connections 2024-09-19T09:13:24.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.780+0000 7fd643554640 1 -- 172.21.15.18:0/847171165 wait complete. 2024-09-19T09:13:24.791 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T09:13:24.791 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T09:13:24.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.898+0000 7f4561798640 1 Processor -- start 2024-09-19T09:13:24.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.899+0000 7f4561798640 1 -- start start 2024-09-19T09:13:24.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.899+0000 7f4561798640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f455c162410 0x7f455c0cf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:24.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.899+0000 7f4561798640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f455c0d1d00 0x7f455c0cf890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:24.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.899+0000 7f4561798640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f455c0b3bf0 con 0x7f455c0b5180 2024-09-19T09:13:24.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.899+0000 7f4561798640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f455c06df20 con 0x7f455c0d1d00 2024-09-19T09:13:24.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.899+0000 7f4561798640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f455c06d8d0 con 0x7f455c162410 2024-09-19T09:13:24.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.900+0000 7f455b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f455c0d1d00 0x7f455c0cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:24.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.900+0000 7f455a7fc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f455c0b5180 0x7f455c0b25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54798/0 (socket says 172.21.15.18:54798) 2024-09-19T09:13:24.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.900+0000 7f455a7fc640 1 -- 172.21.15.18:0/2024385740 learned_addr learned my addr 172.21.15.18:0/2024385740 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:24.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.900+0000 7f455affd640 1 --2- 172.21.15.18:0/2024385740 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f455c162410 0x7f455c0cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:24.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.900+0000 7f455b7fe640 1 -- 172.21.15.18:0/2024385740 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f455c162410 msgr2=0x7f455c0cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:24.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.900+0000 7f455b7fe640 1 --2- 172.21.15.18:0/2024385740 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f455c162410 0x7f455c0cf350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:24.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.900+0000 7f455b7fe640 1 -- 172.21.15.18:0/2024385740 >> v1:172.21.15.18:6789/0 conn(0x7f455c0b5180 legacy=0x7f455c0b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:24.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.900+0000 7f4559ffb640 1 -- 172.21.15.18:0/2024385740 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 340574286 0 0) 0x7f455c0b3bf0 con 0x7f455c0b5180 2024-09-19T09:13:24.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.900+0000 7f455b7fe640 1 -- 172.21.15.18:0/2024385740 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f455c06dbb0 con 0x7f455c0d1d00 2024-09-19T09:13:24.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.901+0000 7f455b7fe640 1 --2- 172.21.15.18:0/2024385740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f455c0d1d00 0x7f455c0cf890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f45540097a0 tx=0x7f455402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66ededa781902fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:24.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.901+0000 7f4559ffb640 1 -- 172.21.15.18:0/2024385740 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4554037070 con 0x7f455c0d1d00 2024-09-19T09:13:24.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.901+0000 7f4559ffb640 1 -- 172.21.15.18:0/2024385740 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4554032440 con 0x7f455c0d1d00 2024-09-19T09:13:24.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.901+0000 7f4559ffb640 1 -- 172.21.15.18:0/2024385740 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4554032810 con 0x7f455c0d1d00 2024-09-19T09:13:24.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.901+0000 7f4561798640 1 -- 172.21.15.18:0/2024385740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f455c0d1d00 msgr2=0x7f455c0cf890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:24.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.901+0000 7f4561798640 1 --2- 172.21.15.18:0/2024385740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f455c0d1d00 0x7f455c0cf890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f45540097a0 tx=0x7f455402a1a0 comp rx=0 tx=0).stop 2024-09-19T09:13:24.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.901+0000 7f4561798640 1 -- 172.21.15.18:0/2024385740 shutdown_connections 2024-09-19T09:13:24.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.901+0000 7f4561798640 1 --2- 172.21.15.18:0/2024385740 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f455c0d1d00 0x7f455c0cf890 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:24.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.901+0000 7f4561798640 1 --2- 172.21.15.18:0/2024385740 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f455c162410 0x7f455c0cf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:24.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.901+0000 7f4561798640 1 -- 172.21.15.18:0/2024385740 >> 172.21.15.18:0/2024385740 conn(0x7f455c0b4660 msgr2=0x7f455c0b4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:24.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.901+0000 7f4561798640 1 -- 172.21.15.18:0/2024385740 shutdown_connections 2024-09-19T09:13:24.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.901+0000 7f4561798640 1 -- 172.21.15.18:0/2024385740 wait complete. 2024-09-19T09:13:24.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.903+0000 7f4561798640 1 Processor -- start 2024-09-19T09:13:24.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.903+0000 7f4561798640 1 -- start start 2024-09-19T09:13:24.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.903+0000 7f4561798640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f455c0b5180 0x7f455c15e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:24.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.903+0000 7f4561798640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f455c0d1d00 0x7f455c0b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:24.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.903+0000 7f4561798640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f455c162410 0x7f455c0b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:24.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.903+0000 7f4561798640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f455c0d00e0 con 0x7f455c0b5180 2024-09-19T09:13:24.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.904+0000 7f4561798640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f455c0cff60 con 0x7f455c0d1d00 2024-09-19T09:13:24.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.904+0000 7f4561798640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f455c0b2ce0 con 0x7f455c162410 2024-09-19T09:13:24.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.904+0000 7f455affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f455c0b5180 0x7f455c15e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:24.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.904+0000 7f455affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f455c0b5180 0x7f455c15e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:59398/0 (socket says 172.21.15.18:59398) 2024-09-19T09:13:24.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.904+0000 7f455affd640 1 -- 172.21.15.18:0/3787468690 learned_addr learned my addr 172.21.15.18:0/3787468690 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:24.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.904+0000 7f455b7fe640 1 --2- 172.21.15.18:0/3787468690 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f455c162410 0x7f455c0b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:24.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.904+0000 7f455a7fc640 1 --2- 172.21.15.18:0/3787468690 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f455c0d1d00 0x7f455c0b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:24.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.904+0000 7f455affd640 1 -- 172.21.15.18:0/3787468690 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f455c162410 msgr2=0x7f455c0b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:24.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.904+0000 7f455affd640 1 --2- 172.21.15.18:0/3787468690 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f455c162410 0x7f455c0b1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:24.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.904+0000 7f455affd640 1 -- 172.21.15.18:0/3787468690 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f455c0d1d00 msgr2=0x7f455c0b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:24.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.904+0000 7f455affd640 1 --2- 172.21.15.18:0/3787468690 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f455c0d1d00 0x7f455c0b18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:24.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.904+0000 7f455affd640 1 -- 172.21.15.18:0/3787468690 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f455c071590 con 0x7f455c0b5180 2024-09-19T09:13:24.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.904+0000 7f455b7fe640 1 --2- 172.21.15.18:0/3787468690 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f455c162410 0x7f455c0b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:13:24.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.904+0000 7f455affd640 1 --2- 172.21.15.18:0/3787468690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f455c0b5180 0x7f455c15e4e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f454c007e40 tx=0x7f454c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:24.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.904+0000 7f45437fe640 1 -- 172.21.15.18:0/3787468690 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c014620 con 0x7f455c0b5180 2024-09-19T09:13:24.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.904+0000 7f45437fe640 1 -- 172.21.15.18:0/3787468690 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f454c019070 con 0x7f455c0b5180 2024-09-19T09:13:24.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.904+0000 7f4561798640 1 -- 172.21.15.18:0/3787468690 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f455c1f8480 con 0x7f455c0b5180 2024-09-19T09:13:24.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.904+0000 7f45437fe640 1 -- 172.21.15.18:0/3787468690 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f454c014a00 con 0x7f455c0b5180 2024-09-19T09:13:24.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.904+0000 7f4561798640 1 -- 172.21.15.18:0/3787468690 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f455c1f8a40 con 0x7f455c0b5180 2024-09-19T09:13:24.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.905+0000 7f4561798640 1 -- 172.21.15.18:0/3787468690 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f455c0b25d0 con 0x7f455c0b5180 2024-09-19T09:13:24.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.906+0000 7f45437fe640 1 -- 172.21.15.18:0/3787468690 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f454c014ba0 con 0x7f455c0b5180 2024-09-19T09:13:24.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.906+0000 7f45437fe640 1 --2- 172.21.15.18:0/3787468690 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f454806c2b0 0x7f454806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:24.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.906+0000 7f45437fe640 1 -- 172.21.15.18:0/3787468690 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f454c08b8e0 con 0x7f455c0b5180 2024-09-19T09:13:24.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.907+0000 7f455a7fc640 1 --2- 172.21.15.18:0/3787468690 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f454806c2b0 0x7f454806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:24.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.907+0000 7f455a7fc640 1 --2- 172.21.15.18:0/3787468690 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f454806c2b0 0x7f454806e770 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f455c0b2c80 tx=0x7f4550007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:24.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:24.911+0000 7f45437fe640 1 -- 172.21.15.18:0/3787468690 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f454c05a3a0 con 0x7f455c0b5180 2024-09-19T09:13:25.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.086+0000 7f4561798640 1 -- 172.21.15.18:0/3787468690 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f455c0d28b0 con 0x7f455c0b5180 2024-09-19T09:13:25.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.481+0000 7f45437fe640 1 -- 172.21.15.18:0/3787468690 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f454c059ca0 con 0x7f455c0b5180 2024-09-19T09:13:25.481 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' created 2024-09-19T09:13:25.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.484+0000 7f4561798640 1 -- 172.21.15.18:0/3787468690 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f454806c2b0 msgr2=0x7f454806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:25.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.484+0000 7f4561798640 1 --2- 172.21.15.18:0/3787468690 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f454806c2b0 0x7f454806e770 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f455c0b2c80 tx=0x7f4550007d50 comp rx=0 tx=0).stop 2024-09-19T09:13:25.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.484+0000 7f4561798640 1 -- 172.21.15.18:0/3787468690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f455c0b5180 msgr2=0x7f455c15e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:25.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.484+0000 7f4561798640 1 --2- 172.21.15.18:0/3787468690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f455c0b5180 0x7f455c15e4e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f454c007e40 tx=0x7f454c00e4b0 comp rx=0 tx=0).stop 2024-09-19T09:13:25.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.486+0000 7f4561798640 1 -- 172.21.15.18:0/3787468690 shutdown_connections 2024-09-19T09:13:25.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.486+0000 7f4561798640 1 --2- 172.21.15.18:0/3787468690 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f454806c2b0 0x7f454806e770 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:25.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.486+0000 7f4561798640 1 --2- 172.21.15.18:0/3787468690 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f455c162410 0x7f455c0b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:25.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.486+0000 7f4561798640 1 --2- 172.21.15.18:0/3787468690 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f455c0d1d00 0x7f455c0b18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:25.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.486+0000 7f4561798640 1 --2- 172.21.15.18:0/3787468690 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f455c0b5180 0x7f455c15e4e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:25.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.486+0000 7f4561798640 1 -- 172.21.15.18:0/3787468690 >> 172.21.15.18:0/3787468690 conn(0x7f455c0b4660 msgr2=0x7f455c0b4a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:25.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.487+0000 7f4561798640 1 -- 172.21.15.18:0/3787468690 shutdown_connections 2024-09-19T09:13:25.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.487+0000 7f4561798640 1 -- 172.21.15.18:0/3787468690 wait complete. 2024-09-19T09:13:25.500 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T09:13:25.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.612+0000 7fc39ead0640 1 Processor -- start 2024-09-19T09:13:25.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.612+0000 7fc39ead0640 1 -- start start 2024-09-19T09:13:25.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.613+0000 7fc39ead0640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc3981623c0 0x7fc3980b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:25.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.613+0000 7fc39ead0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3980d56b0 0x7fc3980d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:25.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.613+0000 7fc39ead0640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3980d3700 con 0x7fc3980d0a50 2024-09-19T09:13:25.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.613+0000 7fc39ead0640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc3980d21a0 con 0x7fc3981623c0 2024-09-19T09:13:25.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.613+0000 7fc39ead0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc3980d0080 con 0x7fc3980d56b0 2024-09-19T09:13:25.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.613+0000 7fc39d06d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc3980d0a50 0x7fc3980d1470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34584/0 (socket says 172.21.15.18:34584) 2024-09-19T09:13:25.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.613+0000 7fc39d06d640 1 -- 172.21.15.18:0/1813150812 learned_addr learned my addr 172.21.15.18:0/1813150812 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:25.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.614+0000 7fc397fff640 1 --2- 172.21.15.18:0/1813150812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3980d56b0 0x7fc3980d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:25.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.614+0000 7fc3977fe640 1 -- 172.21.15.18:0/1813150812 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 296362774 0 0) 0x7fc3980d3700 con 0x7fc3980d0a50 2024-09-19T09:13:25.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.614+0000 7fc39c86c640 1 --2- 172.21.15.18:0/1813150812 >> v2:172.21.15.162:3300/0 conn(0x7fc3981623c0 0x7fc3980b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:25.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.614+0000 7fc3977fe640 1 -- 172.21.15.18:0/1813150812 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc384003520 con 0x7fc3980d0a50 2024-09-19T09:13:25.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.614+0000 7fc3977fe640 1 -- 172.21.15.18:0/1813150812 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 489806004 0 0) 0x7fc384003520 con 0x7fc3980d0a50 2024-09-19T09:13:25.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.614+0000 7fc3977fe640 1 -- 172.21.15.18:0/1813150812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3980d56b0 msgr2=0x7fc3980d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:25.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.614+0000 7fc3977fe640 1 --2- 172.21.15.18:0/1813150812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3980d56b0 0x7fc3980d0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:25.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.614+0000 7fc3977fe640 1 -- 172.21.15.18:0/1813150812 >> v2:172.21.15.162:3300/0 conn(0x7fc3981623c0 msgr2=0x7fc3980b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:25.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.614+0000 7fc3977fe640 1 --2- 172.21.15.18:0/1813150812 >> v2:172.21.15.162:3300/0 conn(0x7fc3981623c0 0x7fc3980b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:25.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.614+0000 7fc3977fe640 1 -- 172.21.15.18:0/1813150812 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3980cfa70 con 0x7fc3980d0a50 2024-09-19T09:13:25.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.614+0000 7fc3977fe640 1 -- 172.21.15.18:0/1813150812 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fc390001670 con 0x7fc3980d0a50 2024-09-19T09:13:25.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.614+0000 7fc3977fe640 1 -- 172.21.15.18:0/1813150812 >> v1:172.21.15.18:6789/0 conn(0x7fc3980d0a50 legacy=0x7fc3980d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:25.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.614+0000 7fc3977fe640 1 --2- 172.21.15.18:0/1813150812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3840039b0 0x7fc384003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:25.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.614+0000 7fc3977fe640 1 --2- 172.21.15.18:0/1813150812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3980d56b0 0x7fc384004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:25.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.614+0000 7fc3977fe640 1 --2- 172.21.15.18:0/1813150812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc384004d40 0x7fc3840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:25.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.614+0000 7fc3977fe640 1 -- 172.21.15.18:0/1813150812 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc3980d21a0 con 0x7fc384004d40 2024-09-19T09:13:25.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.614+0000 7fc3977fe640 1 -- 172.21.15.18:0/1813150812 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc3980d0080 con 0x7fc3840039b0 2024-09-19T09:13:25.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.614+0000 7fc3977fe640 1 -- 172.21.15.18:0/1813150812 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc38400b9c0 con 0x7fc3980d56b0 2024-09-19T09:13:25.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.614+0000 7fc39d06d640 1 --2- 172.21.15.18:0/1813150812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc384004d40 0x7fc3840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:25.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.614+0000 7fc397fff640 1 --2- 172.21.15.18:0/1813150812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3980d56b0 0x7fc384004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:25.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.614+0000 7fc39c86c640 1 --2- 172.21.15.18:0/1813150812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3840039b0 0x7fc384003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:25.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.614+0000 7fc39d06d640 1 -- 172.21.15.18:0/1813150812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3980d56b0 msgr2=0x7fc384004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:25.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.614+0000 7fc39d06d640 1 --2- 172.21.15.18:0/1813150812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3980d56b0 0x7fc384004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:25.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.614+0000 7fc39d06d640 1 -- 172.21.15.18:0/1813150812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3840039b0 msgr2=0x7fc384003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:25.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.614+0000 7fc39d06d640 1 --2- 172.21.15.18:0/1813150812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3840039b0 0x7fc384003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:25.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.614+0000 7fc39d06d640 1 -- 172.21.15.18:0/1813150812 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc384003520 con 0x7fc384004d40 2024-09-19T09:13:25.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.615+0000 7fc39d06d640 1 --2- 172.21.15.18:0/1813150812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc384004d40 0x7fc3840051c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc3980cf3c0 tx=0x7fc384005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d874ffcff0bcd0a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:25.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.615+0000 7fc3977fe640 1 -- 172.21.15.18:0/1813150812 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc390007d70 con 0x7fc384004d40 2024-09-19T09:13:25.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.615+0000 7fc3977fe640 1 -- 172.21.15.18:0/1813150812 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3900058d0 con 0x7fc384004d40 2024-09-19T09:13:25.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.615+0000 7fc3977fe640 1 -- 172.21.15.18:0/1813150812 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc390005ca0 con 0x7fc384004d40 2024-09-19T09:13:25.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.616+0000 7fc39ead0640 1 -- 172.21.15.18:0/1813150812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc384004d40 msgr2=0x7fc3840051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:25.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.616+0000 7fc39ead0640 1 --2- 172.21.15.18:0/1813150812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc384004d40 0x7fc3840051c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc3980cf3c0 tx=0x7fc384005830 comp rx=0 tx=0).stop 2024-09-19T09:13:25.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.616+0000 7fc39d06d640 1 -- 172.21.15.18:0/1813150812 reap_dead start 2024-09-19T09:13:25.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.616+0000 7fc39ead0640 1 -- 172.21.15.18:0/1813150812 shutdown_connections 2024-09-19T09:13:25.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.616+0000 7fc39ead0640 1 -- 172.21.15.18:0/1813150812 >> 172.21.15.18:0/1813150812 conn(0x7fc39809df30 msgr2=0x7fc3980d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:25.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.616+0000 7fc39ead0640 1 -- 172.21.15.18:0/1813150812 shutdown_connections 2024-09-19T09:13:25.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.616+0000 7fc39ead0640 1 -- 172.21.15.18:0/1813150812 wait complete. 2024-09-19T09:13:25.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.617+0000 7fc39ead0640 1 Processor -- start 2024-09-19T09:13:25.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.617+0000 7fc39ead0640 1 -- start start 2024-09-19T09:13:25.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.618+0000 7fc39ead0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc398157b10 0x7fc3980b6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:25.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.618+0000 7fc39ead0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3980c9c40 0x7fc398157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:25.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.618+0000 7fc39ead0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3980b5a60 0x7fc3980cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:25.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.618+0000 7fc39ead0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc3981627a0 con 0x7fc3980b5a60 2024-09-19T09:13:25.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.618+0000 7fc39ead0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc3980cfd10 con 0x7fc398157b10 2024-09-19T09:13:25.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.618+0000 7fc39ead0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc3980d3c80 con 0x7fc3980c9c40 2024-09-19T09:13:25.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.618+0000 7fc39d06d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3980b5a60 0x7fc3980cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:25.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.618+0000 7fc39d06d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3980b5a60 0x7fc3980cd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56952/0 (socket says 172.21.15.18:56952) 2024-09-19T09:13:25.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.618+0000 7fc39d06d640 1 -- 172.21.15.18:0/4151929640 learned_addr learned my addr 172.21.15.18:0/4151929640 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:25.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.618+0000 7fc397fff640 1 --2- 172.21.15.18:0/4151929640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3980c9c40 0x7fc398157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:25.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.618+0000 7fc39c86c640 1 --2- 172.21.15.18:0/4151929640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc398157b10 0x7fc3980b6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:25.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.619+0000 7fc39d06d640 1 -- 172.21.15.18:0/4151929640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3980c9c40 msgr2=0x7fc398157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:25.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.619+0000 7fc39d06d640 1 --2- 172.21.15.18:0/4151929640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3980c9c40 0x7fc398157ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:25.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.619+0000 7fc39d06d640 1 -- 172.21.15.18:0/4151929640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc398157b10 msgr2=0x7fc3980b6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:25.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.619+0000 7fc39d06d640 1 --2- 172.21.15.18:0/4151929640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc398157b10 0x7fc3980b6f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:25.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.619+0000 7fc39d06d640 1 -- 172.21.15.18:0/4151929640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3981f86b0 con 0x7fc3980b5a60 2024-09-19T09:13:25.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.619+0000 7fc39d06d640 1 --2- 172.21.15.18:0/4151929640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3980b5a60 0x7fc3980cd2c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc390000c00 tx=0x7fc390000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:25.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.619+0000 7fc3957fa640 1 -- 172.21.15.18:0/4151929640 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc390001cc0 con 0x7fc3980b5a60 2024-09-19T09:13:25.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.619+0000 7fc3957fa640 1 -- 172.21.15.18:0/4151929640 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc390041070 con 0x7fc3980b5a60 2024-09-19T09:13:25.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.619+0000 7fc39ead0640 1 -- 172.21.15.18:0/4151929640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3980b75b0 con 0x7fc3980b5a60 2024-09-19T09:13:25.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.619+0000 7fc3957fa640 1 -- 172.21.15.18:0/4151929640 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc390007d50 con 0x7fc3980b5a60 2024-09-19T09:13:25.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.619+0000 7fc39ead0640 1 -- 172.21.15.18:0/4151929640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3980cb7b0 con 0x7fc3980b5a60 2024-09-19T09:13:25.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.620+0000 7fc39ead0640 1 -- 172.21.15.18:0/4151929640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3981f8880 con 0x7fc3980b5a60 2024-09-19T09:13:25.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.620+0000 7fc3957fa640 1 -- 172.21.15.18:0/4151929640 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc39003b070 con 0x7fc3980b5a60 2024-09-19T09:13:25.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.621+0000 7fc3957fa640 1 --2- 172.21.15.18:0/4151929640 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc37806c2b0 0x7fc37806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:25.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.621+0000 7fc3957fa640 1 -- 172.21.15.18:0/4151929640 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7fc3900aa920 con 0x7fc3980b5a60 2024-09-19T09:13:25.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.621+0000 7fc39c86c640 1 --2- 172.21.15.18:0/4151929640 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc37806c2b0 0x7fc37806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:25.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.622+0000 7fc39c86c640 1 --2- 172.21.15.18:0/4151929640 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc37806c2b0 0x7fc37806e770 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc3980c8a80 tx=0x7fc388009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:25.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.626+0000 7fc3957fa640 1 -- 172.21.15.18:0/4151929640 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc3900793c0 con 0x7fc3980b5a60 2024-09-19T09:13:25.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:25.807+0000 7fc39ead0640 1 -- 172.21.15.18:0/4151929640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc3980d0510 con 0x7fc3980b5a60 2024-09-19T09:13:26.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.486+0000 7fc3957fa640 1 -- 172.21.15.18:0/4151929640 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) ==== 170+0+0 (secure 0 0 0) 0x7fc390078cc0 con 0x7fc3980b5a60 2024-09-19T09:13:26.486 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' created 2024-09-19T09:13:26.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.489+0000 7fc39ead0640 1 -- 172.21.15.18:0/4151929640 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc37806c2b0 msgr2=0x7fc37806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:26.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.489+0000 7fc39ead0640 1 --2- 172.21.15.18:0/4151929640 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc37806c2b0 0x7fc37806e770 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc3980c8a80 tx=0x7fc388009190 comp rx=0 tx=0).stop 2024-09-19T09:13:26.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.489+0000 7fc39ead0640 1 -- 172.21.15.18:0/4151929640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3980b5a60 msgr2=0x7fc3980cd2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:26.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.489+0000 7fc39ead0640 1 --2- 172.21.15.18:0/4151929640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3980b5a60 0x7fc3980cd2c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fc390000c00 tx=0x7fc390000fe0 comp rx=0 tx=0).stop 2024-09-19T09:13:26.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.489+0000 7fc39ead0640 1 -- 172.21.15.18:0/4151929640 shutdown_connections 2024-09-19T09:13:26.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.489+0000 7fc39ead0640 1 --2- 172.21.15.18:0/4151929640 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc37806c2b0 0x7fc37806e770 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:26.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.489+0000 7fc39ead0640 1 --2- 172.21.15.18:0/4151929640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3980b5a60 0x7fc3980cd2c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:26.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.489+0000 7fc39ead0640 1 --2- 172.21.15.18:0/4151929640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3980c9c40 0x7fc398157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:26.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.489+0000 7fc39ead0640 1 --2- 172.21.15.18:0/4151929640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc398157b10 0x7fc3980b6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:26.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.489+0000 7fc39ead0640 1 -- 172.21.15.18:0/4151929640 >> 172.21.15.18:0/4151929640 conn(0x7fc39809df30 msgr2=0x7fc3980b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:26.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.489+0000 7fc39ead0640 1 -- 172.21.15.18:0/4151929640 shutdown_connections 2024-09-19T09:13:26.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.489+0000 7fc39ead0640 1 -- 172.21.15.18:0/4151929640 wait complete. 2024-09-19T09:13:26.515 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T09:13:26.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.626+0000 7fcb6138d640 1 Processor -- start 2024-09-19T09:13:26.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.626+0000 7fcb6138d640 1 -- start start 2024-09-19T09:13:26.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.627+0000 7fcb6138d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcb5c1623c0 0x7fcb5c0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:26.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.627+0000 7fcb6138d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcb5c0d56b0 0x7fcb5c0d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:26.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.627+0000 7fcb6138d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb5c0d0a50 0x7fcb5c0d1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:26.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.627+0000 7fcb6138d640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fcb5c0d21a0 con 0x7fcb5c0d56b0 2024-09-19T09:13:26.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.627+0000 7fcb6138d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fcb5c0d0080 con 0x7fcb5c1623c0 2024-09-19T09:13:26.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.627+0000 7fcb6138d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcb5c0d3700 con 0x7fcb5c0d0a50 2024-09-19T09:13:26.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.627+0000 7fcb5a7fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcb5c0d56b0 0x7fcb5c0d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:26.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.628+0000 7fcb5a7fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcb5c0d56b0 0x7fcb5c0d0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56954/0 (socket says 172.21.15.18:56954) 2024-09-19T09:13:26.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.628+0000 7fcb5a7fc640 1 -- 172.21.15.18:0/1037518669 learned_addr learned my addr 172.21.15.18:0/1037518669 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:26.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.628+0000 7fcb5affd640 1 --2- 172.21.15.18:0/1037518669 >> v2:172.21.15.162:3300/0 conn(0x7fcb5c1623c0 0x7fcb5c0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:26.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.628+0000 7fcb5b7fe640 1 --2- 172.21.15.18:0/1037518669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb5c0d0a50 0x7fcb5c0d1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:26.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.628+0000 7fcb5a7fc640 1 -- 172.21.15.18:0/1037518669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb5c0d0a50 msgr2=0x7fcb5c0d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:26.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.628+0000 7fcb5a7fc640 1 --2- 172.21.15.18:0/1037518669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb5c0d0a50 0x7fcb5c0d1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:26.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.628+0000 7fcb5a7fc640 1 -- 172.21.15.18:0/1037518669 >> v2:172.21.15.162:3300/0 conn(0x7fcb5c1623c0 msgr2=0x7fcb5c0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:26.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.628+0000 7fcb5a7fc640 1 --2- 172.21.15.18:0/1037518669 >> v2:172.21.15.162:3300/0 conn(0x7fcb5c1623c0 0x7fcb5c0b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:26.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.628+0000 7fcb5a7fc640 1 -- 172.21.15.18:0/1037518669 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb5c0cfa70 con 0x7fcb5c0d56b0 2024-09-19T09:13:26.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.628+0000 7fcb5b7fe640 1 --2- 172.21.15.18:0/1037518669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb5c0d0a50 0x7fcb5c0d1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:13:26.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.628+0000 7fcb5a7fc640 1 --2- 172.21.15.18:0/1037518669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb5c0d56b0 0x7fcb5c0d0510 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c08daf0 tx=0x7fcb4402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84ff93dcba8ce734 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:26.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.629+0000 7fcb59ffb640 1 -- 172.21.15.18:0/1037518669 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb44037070 con 0x7fcb5c0d56b0 2024-09-19T09:13:26.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.629+0000 7fcb59ffb640 1 -- 172.21.15.18:0/1037518669 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb44032440 con 0x7fcb5c0d56b0 2024-09-19T09:13:26.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.629+0000 7fcb59ffb640 1 -- 172.21.15.18:0/1037518669 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb44032810 con 0x7fcb5c0d56b0 2024-09-19T09:13:26.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.629+0000 7fcb6138d640 1 -- 172.21.15.18:0/1037518669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb5c0d56b0 msgr2=0x7fcb5c0d0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:26.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.629+0000 7fcb6138d640 1 --2- 172.21.15.18:0/1037518669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb5c0d56b0 0x7fcb5c0d0510 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c08daf0 tx=0x7fcb4402a1e0 comp rx=0 tx=0).stop 2024-09-19T09:13:26.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.629+0000 7fcb6138d640 1 -- 172.21.15.18:0/1037518669 shutdown_connections 2024-09-19T09:13:26.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.629+0000 7fcb6138d640 1 --2- 172.21.15.18:0/1037518669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb5c0d0a50 0x7fcb5c0d1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:26.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.629+0000 7fcb6138d640 1 --2- 172.21.15.18:0/1037518669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb5c0d56b0 0x7fcb5c0d0510 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:26.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.629+0000 7fcb6138d640 1 --2- 172.21.15.18:0/1037518669 >> v2:172.21.15.162:3300/0 conn(0x7fcb5c1623c0 0x7fcb5c0b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:26.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.629+0000 7fcb6138d640 1 -- 172.21.15.18:0/1037518669 >> 172.21.15.18:0/1037518669 conn(0x7fcb5c09df30 msgr2=0x7fcb5c0d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:26.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.629+0000 7fcb6138d640 1 -- 172.21.15.18:0/1037518669 shutdown_connections 2024-09-19T09:13:26.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.629+0000 7fcb6138d640 1 -- 172.21.15.18:0/1037518669 wait complete. 2024-09-19T09:13:26.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.631+0000 7fcb6138d640 1 Processor -- start 2024-09-19T09:13:26.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.631+0000 7fcb6138d640 1 -- start start 2024-09-19T09:13:26.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.631+0000 7fcb6138d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb5c0d56b0 0x7fcb5c156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:26.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.631+0000 7fcb6138d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb5c1623c0 0x7fcb5c0c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:26.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.631+0000 7fcb6138d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb5c0cb050 0x7fcb5c160da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:26.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.631+0000 7fcb6138d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5c1627a0 con 0x7fcb5c0cb050 2024-09-19T09:13:26.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.631+0000 7fcb6138d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcb5c0cfd10 con 0x7fcb5c0d56b0 2024-09-19T09:13:26.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.631+0000 7fcb6138d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcb5c0d3c80 con 0x7fcb5c1623c0 2024-09-19T09:13:26.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.632+0000 7fcb5b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb5c0cb050 0x7fcb5c160da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:26.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.632+0000 7fcb5b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb5c0cb050 0x7fcb5c160da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56970/0 (socket says 172.21.15.18:56970) 2024-09-19T09:13:26.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.632+0000 7fcb5b7fe640 1 -- 172.21.15.18:0/1421411672 learned_addr learned my addr 172.21.15.18:0/1421411672 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:26.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.632+0000 7fcb5affd640 1 --2- 172.21.15.18:0/1421411672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb5c0d56b0 0x7fcb5c156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:26.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.632+0000 7fcb5a7fc640 1 --2- 172.21.15.18:0/1421411672 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb5c1623c0 0x7fcb5c0c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:26.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.632+0000 7fcb5b7fe640 1 -- 172.21.15.18:0/1421411672 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb5c1623c0 msgr2=0x7fcb5c0c9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:26.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.632+0000 7fcb5b7fe640 1 --2- 172.21.15.18:0/1421411672 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb5c1623c0 0x7fcb5c0c9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:26.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.632+0000 7fcb5b7fe640 1 -- 172.21.15.18:0/1421411672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb5c0d56b0 msgr2=0x7fcb5c156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:26.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.632+0000 7fcb5b7fe640 1 --2- 172.21.15.18:0/1421411672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb5c0d56b0 0x7fcb5c156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:26.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.632+0000 7fcb5b7fe640 1 -- 172.21.15.18:0/1421411672 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb5c0c9fb0 con 0x7fcb5c0cb050 2024-09-19T09:13:26.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.632+0000 7fcb5b7fe640 1 --2- 172.21.15.18:0/1421411672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb5c0cb050 0x7fcb5c160da0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c007e10 tx=0x7fcb4c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:26.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.632+0000 7fcb537fe640 1 -- 172.21.15.18:0/1421411672 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c01a070 con 0x7fcb5c0cb050 2024-09-19T09:13:26.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.632+0000 7fcb537fe640 1 -- 172.21.15.18:0/1421411672 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb4c003b90 con 0x7fcb5c0cb050 2024-09-19T09:13:26.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.632+0000 7fcb6138d640 1 -- 172.21.15.18:0/1421411672 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb5c0ca290 con 0x7fcb5c0cb050 2024-09-19T09:13:26.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.632+0000 7fcb537fe640 1 -- 172.21.15.18:0/1421411672 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c00de80 con 0x7fcb5c0cb050 2024-09-19T09:13:26.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.632+0000 7fcb6138d640 1 -- 172.21.15.18:0/1421411672 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb5c0ca850 con 0x7fcb5c0cb050 2024-09-19T09:13:26.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.633+0000 7fcb6138d640 1 -- 172.21.15.18:0/1421411672 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb5c0d0510 con 0x7fcb5c0cb050 2024-09-19T09:13:26.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.634+0000 7fcb537fe640 1 -- 172.21.15.18:0/1421411672 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcb4c01d070 con 0x7fcb5c0cb050 2024-09-19T09:13:26.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.634+0000 7fcb537fe640 1 --2- 172.21.15.18:0/1421411672 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcb3c06c2b0 0x7fcb3c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:26.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.634+0000 7fcb537fe640 1 -- 172.21.15.18:0/1421411672 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7fcb4c08b660 con 0x7fcb5c0cb050 2024-09-19T09:13:26.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.634+0000 7fcb5affd640 1 --2- 172.21.15.18:0/1421411672 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcb3c06c2b0 0x7fcb3c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:26.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.635+0000 7fcb5affd640 1 --2- 172.21.15.18:0/1421411672 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcb3c06c2b0 0x7fcb3c06e770 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcb54009aa0 tx=0x7fcb54009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:26.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.639+0000 7fcb537fe640 1 -- 172.21.15.18:0/1421411672 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fcb4c010070 con 0x7fcb5c0cb050 2024-09-19T09:13:26.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:26.851+0000 7fcb6138d640 1 -- 172.21.15.18:0/1421411672 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fcb5c0d2340 con 0x7fcb5c0cb050 2024-09-19T09:13:27.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.487+0000 7fcb537fe640 1 -- 172.21.15.18:0/1421411672 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fcb4c059750 con 0x7fcb5c0cb050 2024-09-19T09:13:27.488 INFO:teuthology.orchestra.run.smithi018.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T09:13:27.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.490+0000 7fcb6138d640 1 -- 172.21.15.18:0/1421411672 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcb3c06c2b0 msgr2=0x7fcb3c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:27.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.490+0000 7fcb6138d640 1 --2- 172.21.15.18:0/1421411672 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcb3c06c2b0 0x7fcb3c06e770 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fcb54009aa0 tx=0x7fcb54009190 comp rx=0 tx=0).stop 2024-09-19T09:13:27.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.490+0000 7fcb6138d640 1 -- 172.21.15.18:0/1421411672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb5c0cb050 msgr2=0x7fcb5c160da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:27.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.490+0000 7fcb6138d640 1 --2- 172.21.15.18:0/1421411672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb5c0cb050 0x7fcb5c160da0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c007e10 tx=0x7fcb4c00d4a0 comp rx=0 tx=0).stop 2024-09-19T09:13:27.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.490+0000 7fcb6138d640 1 -- 172.21.15.18:0/1421411672 shutdown_connections 2024-09-19T09:13:27.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.490+0000 7fcb6138d640 1 --2- 172.21.15.18:0/1421411672 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcb3c06c2b0 0x7fcb3c06e770 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:27.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.490+0000 7fcb6138d640 1 --2- 172.21.15.18:0/1421411672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcb5c0cb050 0x7fcb5c160da0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:27.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.490+0000 7fcb6138d640 1 --2- 172.21.15.18:0/1421411672 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcb5c1623c0 0x7fcb5c0c9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:27.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.490+0000 7fcb6138d640 1 --2- 172.21.15.18:0/1421411672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb5c0d56b0 0x7fcb5c156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:27.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.490+0000 7fcb6138d640 1 -- 172.21.15.18:0/1421411672 >> 172.21.15.18:0/1421411672 conn(0x7fcb5c09df30 msgr2=0x7fcb5c0b7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:27.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.491+0000 7fcb6138d640 1 -- 172.21.15.18:0/1421411672 shutdown_connections 2024-09-19T09:13:27.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.491+0000 7fcb6138d640 1 -- 172.21.15.18:0/1421411672 wait complete. 2024-09-19T09:13:27.515 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:13:27.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.622+0000 7faaf029b640 1 Processor -- start 2024-09-19T09:13:27.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.622+0000 7faaf029b640 1 -- start start 2024-09-19T09:13:27.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.623+0000 7faaf029b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7faae815cc70 0x7faae80b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:27.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.623+0000 7faaf029b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faae806c3b0 0x7faae806c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:27.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.623+0000 7faaf029b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7faae806cd60 0x7faae80d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:27.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.623+0000 7faaf029b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7faae806d1b0 con 0x7faae806cd60 2024-09-19T09:13:27.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.623+0000 7faaf029b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7faae8067c80 con 0x7faae815cc70 2024-09-19T09:13:27.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.623+0000 7faaf029b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faae8067950 con 0x7faae806c3b0 2024-09-19T09:13:27.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.624+0000 7faaee838640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7faae806cd60 0x7faae80d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:27.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.624+0000 7faaee838640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7faae806cd60 0x7faae80d0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56972/0 (socket says 172.21.15.18:56972) 2024-09-19T09:13:27.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.624+0000 7faaee838640 1 -- 172.21.15.18:0/3611940366 learned_addr learned my addr 172.21.15.18:0/3611940366 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:27.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.624+0000 7faaed836640 1 --2- 172.21.15.18:0/3611940366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faae806c3b0 0x7faae806c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:27.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.624+0000 7faaee037640 1 --2- 172.21.15.18:0/3611940366 >> v2:172.21.15.162:3300/0 conn(0x7faae815cc70 0x7faae80b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:27.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.624+0000 7faaee838640 1 -- 172.21.15.18:0/3611940366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faae806c3b0 msgr2=0x7faae806c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:27.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.624+0000 7faaee838640 1 --2- 172.21.15.18:0/3611940366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faae806c3b0 0x7faae806c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:27.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.624+0000 7faaee838640 1 -- 172.21.15.18:0/3611940366 >> v2:172.21.15.162:3300/0 conn(0x7faae815cc70 msgr2=0x7faae80b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:27.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.624+0000 7faaee838640 1 --2- 172.21.15.18:0/3611940366 >> v2:172.21.15.162:3300/0 conn(0x7faae815cc70 0x7faae80b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:27.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.624+0000 7faaee838640 1 -- 172.21.15.18:0/3611940366 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae806bcb0 con 0x7faae806cd60 2024-09-19T09:13:27.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.625+0000 7faaee838640 1 --2- 172.21.15.18:0/3611940366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faae806cd60 0x7faae80d0fd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faae8070870 tx=0x7faae002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9093be8fe53b2578 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:27.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.625+0000 7faaed035640 1 -- 172.21.15.18:0/3611940366 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae0037070 con 0x7faae806cd60 2024-09-19T09:13:27.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.625+0000 7faaed035640 1 -- 172.21.15.18:0/3611940366 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faae0032440 con 0x7faae806cd60 2024-09-19T09:13:27.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.625+0000 7faaed035640 1 -- 172.21.15.18:0/3611940366 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae0032810 con 0x7faae806cd60 2024-09-19T09:13:27.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.625+0000 7faaf029b640 1 -- 172.21.15.18:0/3611940366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faae806cd60 msgr2=0x7faae80d0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:27.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.625+0000 7faaf029b640 1 --2- 172.21.15.18:0/3611940366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faae806cd60 0x7faae80d0fd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faae8070870 tx=0x7faae002a1e0 comp rx=0 tx=0).stop 2024-09-19T09:13:27.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.625+0000 7faaf029b640 1 -- 172.21.15.18:0/3611940366 shutdown_connections 2024-09-19T09:13:27.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.625+0000 7faaf029b640 1 --2- 172.21.15.18:0/3611940366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faae806cd60 0x7faae80d0fd0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:27.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.625+0000 7faaf029b640 1 --2- 172.21.15.18:0/3611940366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faae806c3b0 0x7faae806c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:27.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.625+0000 7faaf029b640 1 --2- 172.21.15.18:0/3611940366 >> v2:172.21.15.162:3300/0 conn(0x7faae815cc70 0x7faae80b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:27.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.625+0000 7faaf029b640 1 -- 172.21.15.18:0/3611940366 >> 172.21.15.18:0/3611940366 conn(0x7faae8072340 msgr2=0x7faae80b5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:27.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.625+0000 7faaf029b640 1 -- 172.21.15.18:0/3611940366 shutdown_connections 2024-09-19T09:13:27.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.626+0000 7faaf029b640 1 -- 172.21.15.18:0/3611940366 wait complete. 2024-09-19T09:13:27.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.627+0000 7faaf029b640 1 Processor -- start 2024-09-19T09:13:27.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.627+0000 7faaf029b640 1 -- start start 2024-09-19T09:13:27.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.627+0000 7faaf029b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faae806c3b0 0x7faae806fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:27.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.627+0000 7faaf029b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faae806cd60 0x7faae81e7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:27.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.627+0000 7faaf029b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faae815cc70 0x7faae81e7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:27.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.627+0000 7faaf029b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faae80b6660 con 0x7faae806cd60 2024-09-19T09:13:27.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.627+0000 7faaf029b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faae80b6a40 con 0x7faae815cc70 2024-09-19T09:13:27.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.627+0000 7faaf029b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faae80b67e0 con 0x7faae806c3b0 2024-09-19T09:13:27.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.628+0000 7faaed836640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faae806cd60 0x7faae81e7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:27.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.628+0000 7faaed836640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faae806cd60 0x7faae81e7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56988/0 (socket says 172.21.15.18:56988) 2024-09-19T09:13:27.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.628+0000 7faaed836640 1 -- 172.21.15.18:0/914366139 learned_addr learned my addr 172.21.15.18:0/914366139 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:27.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.628+0000 7faaee838640 1 --2- 172.21.15.18:0/914366139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faae815cc70 0x7faae81e7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:27.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.628+0000 7faaee037640 1 --2- 172.21.15.18:0/914366139 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faae806c3b0 0x7faae806fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:27.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.628+0000 7faaed836640 1 -- 172.21.15.18:0/914366139 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faae806c3b0 msgr2=0x7faae806fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:27.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.628+0000 7faaed836640 1 --2- 172.21.15.18:0/914366139 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faae806c3b0 0x7faae806fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:27.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.628+0000 7faaed836640 1 -- 172.21.15.18:0/914366139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faae815cc70 msgr2=0x7faae81e7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:27.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.628+0000 7faaed836640 1 --2- 172.21.15.18:0/914366139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faae815cc70 0x7faae81e7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:27.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.628+0000 7faaed836640 1 -- 172.21.15.18:0/914366139 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae80cb2f0 con 0x7faae806cd60 2024-09-19T09:13:27.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.628+0000 7faaee838640 1 --2- 172.21.15.18:0/914366139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faae815cc70 0x7faae81e7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:13:27.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.628+0000 7faaed836640 1 --2- 172.21.15.18:0/914366139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faae806cd60 0x7faae81e7860 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7faadc00e890 tx=0x7faadc00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:27.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.628+0000 7faae6ffd640 1 -- 172.21.15.18:0/914366139 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faadc017070 con 0x7faae806cd60 2024-09-19T09:13:27.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.628+0000 7faae6ffd640 1 -- 172.21.15.18:0/914366139 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faadc00c8e0 con 0x7faae806cd60 2024-09-19T09:13:27.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.628+0000 7faaf029b640 1 -- 172.21.15.18:0/914366139 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faae806ea50 con 0x7faae806cd60 2024-09-19T09:13:27.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.628+0000 7faae6ffd640 1 -- 172.21.15.18:0/914366139 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faadc00ccb0 con 0x7faae806cd60 2024-09-19T09:13:27.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.628+0000 7faaf029b640 1 -- 172.21.15.18:0/914366139 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faae806f010 con 0x7faae806cd60 2024-09-19T09:13:27.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.629+0000 7faaf029b640 1 -- 172.21.15.18:0/914366139 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faae80cd480 con 0x7faae806cd60 2024-09-19T09:13:27.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.630+0000 7faae6ffd640 1 -- 172.21.15.18:0/914366139 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7faadc01a070 con 0x7faae806cd60 2024-09-19T09:13:27.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.631+0000 7faae6ffd640 1 --2- 172.21.15.18:0/914366139 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faad406c2b0 0x7faad406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:27.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.631+0000 7faae6ffd640 1 -- 172.21.15.18:0/914366139 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7faadc08b600 con 0x7faae806cd60 2024-09-19T09:13:27.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.631+0000 7faaee037640 1 --2- 172.21.15.18:0/914366139 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faad406c2b0 0x7faad406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:27.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.631+0000 7faaee037640 1 --2- 172.21.15.18:0/914366139 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faad406c2b0 0x7faad406e770 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7faae80d0f20 tx=0x7faad800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:27.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.635+0000 7faae6ffd640 1 -- 172.21.15.18:0/914366139 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7faae80cd480 con 0x7faae806cd60 2024-09-19T09:13:27.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.810+0000 7faaf029b640 1 -- 172.21.15.18:0/914366139 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faae8160670 con 0x7faae806cd60 2024-09-19T09:13:27.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.811+0000 7faae6ffd640 1 -- 172.21.15.18:0/914366139 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16694 (secure 0 0 0) 0x7faadc059710 con 0x7faae806cd60 2024-09-19T09:13:27.811 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:27.812 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":20,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:13:26.853211+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:13:25.116784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:13:25.838110+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:13:27.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.813+0000 7faaf029b640 1 -- 172.21.15.18:0/914366139 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faad406c2b0 msgr2=0x7faad406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:27.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.813+0000 7faaf029b640 1 --2- 172.21.15.18:0/914366139 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faad406c2b0 0x7faad406e770 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7faae80d0f20 tx=0x7faad800b040 comp rx=0 tx=0).stop 2024-09-19T09:13:27.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.813+0000 7faaf029b640 1 -- 172.21.15.18:0/914366139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faae806cd60 msgr2=0x7faae81e7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:27.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.813+0000 7faaf029b640 1 --2- 172.21.15.18:0/914366139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faae806cd60 0x7faae81e7860 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7faadc00e890 tx=0x7faadc00ed50 comp rx=0 tx=0).stop 2024-09-19T09:13:27.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.813+0000 7faaf029b640 1 -- 172.21.15.18:0/914366139 shutdown_connections 2024-09-19T09:13:27.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.813+0000 7faaf029b640 1 --2- 172.21.15.18:0/914366139 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faad406c2b0 0x7faad406e770 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:27.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.813+0000 7faaf029b640 1 --2- 172.21.15.18:0/914366139 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faae815cc70 0x7faae81e7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:27.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.813+0000 7faaf029b640 1 --2- 172.21.15.18:0/914366139 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faae806cd60 0x7faae81e7860 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:27.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.813+0000 7faaf029b640 1 --2- 172.21.15.18:0/914366139 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faae806c3b0 0x7faae806fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:27.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.813+0000 7faaf029b640 1 -- 172.21.15.18:0/914366139 >> 172.21.15.18:0/914366139 conn(0x7faae8072340 msgr2=0x7faae80b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:27.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.813+0000 7faaf029b640 1 -- 172.21.15.18:0/914366139 shutdown_connections 2024-09-19T09:13:27.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.813+0000 7faaf029b640 1 -- 172.21.15.18:0/914366139 wait complete. 2024-09-19T09:13:27.824 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:13:27.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.926+0000 7f8c6d0b7640 1 Processor -- start 2024-09-19T09:13:27.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.926+0000 7f8c6d0b7640 1 -- start start 2024-09-19T09:13:27.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.927+0000 7f8c6d0b7640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8c6813fae0 0x7f8c6806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:27.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.927+0000 7f8c6d0b7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c68142150 0x7f8c68160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:27.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.927+0000 7f8c6d0b7640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c68142650 con 0x7f8c68160a80 2024-09-19T09:13:27.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.927+0000 7f8c6d0b7640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8c680ce780 con 0x7f8c6813fae0 2024-09-19T09:13:27.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.927+0000 7f8c6d0b7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8c68142930 con 0x7f8c68142150 2024-09-19T09:13:27.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.927+0000 7f8c6759e640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f8c68160a80 0x7f8c6815cf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34594/0 (socket says 172.21.15.18:34594) 2024-09-19T09:13:27.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.927+0000 7f8c6759e640 1 -- 172.21.15.18:0/2126835686 learned_addr learned my addr 172.21.15.18:0/2126835686 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:27.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.927+0000 7f8c66d9d640 1 --2- 172.21.15.18:0/2126835686 >> v2:172.21.15.162:3300/0 conn(0x7f8c6813fae0 0x7f8c6806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:27.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.927+0000 7f8c6659c640 1 --2- 172.21.15.18:0/2126835686 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c68142150 0x7f8c68160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:27.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.927+0000 7f8c65d9b640 1 -- 172.21.15.18:0/2126835686 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4095644230 0 0) 0x7f8c68142650 con 0x7f8c68160a80 2024-09-19T09:13:27.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.928+0000 7f8c65d9b640 1 -- 172.21.15.18:0/2126835686 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c54003520 con 0x7f8c68160a80 2024-09-19T09:13:27.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.928+0000 7f8c66d9d640 1 -- 172.21.15.18:0/2126835686 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c68142150 msgr2=0x7f8c68160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:27.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.928+0000 7f8c66d9d640 1 --2- 172.21.15.18:0/2126835686 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c68142150 0x7f8c68160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:27.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.928+0000 7f8c66d9d640 1 -- 172.21.15.18:0/2126835686 >> v1:172.21.15.18:6789/0 conn(0x7f8c68160a80 legacy=0x7f8c6815cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:27.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.928+0000 7f8c66d9d640 1 -- 172.21.15.18:0/2126835686 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c68142c10 con 0x7f8c6813fae0 2024-09-19T09:13:27.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.928+0000 7f8c66d9d640 1 --2- 172.21.15.18:0/2126835686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c6813fae0 0x7f8c6806f1b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8c600097a0 tx=0x7f8c6002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bc95f92b41f4ea7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:27.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.929+0000 7f8c65d9b640 1 -- 172.21.15.18:0/2126835686 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c60037070 con 0x7f8c6813fae0 2024-09-19T09:13:27.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.929+0000 7f8c65d9b640 1 -- 172.21.15.18:0/2126835686 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c6002ae50 con 0x7f8c6813fae0 2024-09-19T09:13:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.929+0000 7f8c65d9b640 1 -- 172.21.15.18:0/2126835686 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c60032640 con 0x7f8c6813fae0 2024-09-19T09:13:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.929+0000 7f8c6d0b7640 1 -- 172.21.15.18:0/2126835686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c6813fae0 msgr2=0x7f8c6806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.929+0000 7f8c6d0b7640 1 --2- 172.21.15.18:0/2126835686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c6813fae0 0x7f8c6806f1b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8c600097a0 tx=0x7f8c6002a100 comp rx=0 tx=0).stop 2024-09-19T09:13:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.929+0000 7f8c6d0b7640 1 -- 172.21.15.18:0/2126835686 shutdown_connections 2024-09-19T09:13:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.929+0000 7f8c6d0b7640 1 --2- 172.21.15.18:0/2126835686 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c68142150 0x7f8c68160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.929+0000 7f8c6d0b7640 1 --2- 172.21.15.18:0/2126835686 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c6813fae0 0x7f8c6806f1b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.929+0000 7f8c6d0b7640 1 -- 172.21.15.18:0/2126835686 >> 172.21.15.18:0/2126835686 conn(0x7f8c6806bc10 msgr2=0x7f8c6806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.929+0000 7f8c6d0b7640 1 -- 172.21.15.18:0/2126835686 shutdown_connections 2024-09-19T09:13:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.929+0000 7f8c6d0b7640 1 -- 172.21.15.18:0/2126835686 wait complete. 2024-09-19T09:13:27.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.931+0000 7f8c6d0b7640 1 Processor -- start 2024-09-19T09:13:27.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.931+0000 7f8c6d0b7640 1 -- start start 2024-09-19T09:13:27.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.931+0000 7f8c6d0b7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c6813fae0 0x7f8c68144180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:27.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.932+0000 7f8c6d0b7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c68142150 0x7f8c68145d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:27.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.932+0000 7f8c6d0b7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c68160a80 0x7f8c6813f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:27.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.932+0000 7f8c6d0b7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6806f870 con 0x7f8c6813fae0 2024-09-19T09:13:27.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.932+0000 7f8c6d0b7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6806f6f0 con 0x7f8c68160a80 2024-09-19T09:13:27.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.932+0000 7f8c6d0b7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8c680cfc20 con 0x7f8c68142150 2024-09-19T09:13:27.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.932+0000 7f8c66d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c6813fae0 0x7f8c68144180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:27.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.932+0000 7f8c66d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c6813fae0 0x7f8c68144180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56996/0 (socket says 172.21.15.18:56996) 2024-09-19T09:13:27.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.932+0000 7f8c66d9d640 1 -- 172.21.15.18:0/3240785950 learned_addr learned my addr 172.21.15.18:0/3240785950 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:27.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.932+0000 7f8c6759e640 1 --2- 172.21.15.18:0/3240785950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c68160a80 0x7f8c6813f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:27.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.932+0000 7f8c6659c640 1 --2- 172.21.15.18:0/3240785950 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c68142150 0x7f8c68145d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:27.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.932+0000 7f8c66d9d640 1 -- 172.21.15.18:0/3240785950 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c68142150 msgr2=0x7f8c68145d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:27.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.932+0000 7f8c66d9d640 1 --2- 172.21.15.18:0/3240785950 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c68142150 0x7f8c68145d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:27.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.932+0000 7f8c66d9d640 1 -- 172.21.15.18:0/3240785950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c68160a80 msgr2=0x7f8c6813f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:27.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.932+0000 7f8c66d9d640 1 --2- 172.21.15.18:0/3240785950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c68160a80 0x7f8c6813f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:27.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.932+0000 7f8c66d9d640 1 -- 172.21.15.18:0/3240785950 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c6813f600 con 0x7f8c6813fae0 2024-09-19T09:13:27.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.932+0000 7f8c6759e640 1 --2- 172.21.15.18:0/3240785950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c68160a80 0x7f8c6813f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:13:27.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.932+0000 7f8c66d9d640 1 --2- 172.21.15.18:0/3240785950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c6813fae0 0x7f8c68144180 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8c6002a140 tx=0x7f8c600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:27.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.932+0000 7f8c5f7fe640 1 -- 172.21.15.18:0/3240785950 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c60041070 con 0x7f8c6813fae0 2024-09-19T09:13:27.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.932+0000 7f8c5f7fe640 1 -- 172.21.15.18:0/3240785950 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c6003c460 con 0x7f8c6813fae0 2024-09-19T09:13:27.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.932+0000 7f8c6d0b7640 1 -- 172.21.15.18:0/3240785950 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c681450b0 con 0x7f8c6813fae0 2024-09-19T09:13:27.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.932+0000 7f8c5f7fe640 1 -- 172.21.15.18:0/3240785950 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c60037040 con 0x7f8c6813fae0 2024-09-19T09:13:27.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.932+0000 7f8c6d0b7640 1 -- 172.21.15.18:0/3240785950 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c68144af0 con 0x7f8c6813fae0 2024-09-19T09:13:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.934+0000 7f8c6d0b7640 1 -- 172.21.15.18:0/3240785950 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c6806c820 con 0x7f8c6813fae0 2024-09-19T09:13:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.934+0000 7f8c5f7fe640 1 -- 172.21.15.18:0/3240785950 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8c60044070 con 0x7f8c6813fae0 2024-09-19T09:13:27.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.934+0000 7f8c5f7fe640 1 --2- 172.21.15.18:0/3240785950 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8c4806c2b0 0x7f8c4806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:27.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.935+0000 7f8c5f7fe640 1 -- 172.21.15.18:0/3240785950 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8c600ab9d0 con 0x7f8c6813fae0 2024-09-19T09:13:27.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.935+0000 7f8c6659c640 1 --2- 172.21.15.18:0/3240785950 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8c4806c2b0 0x7f8c4806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:27.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.935+0000 7f8c6659c640 1 --2- 172.21.15.18:0/3240785950 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8c4806c2b0 0x7f8c4806e770 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8c680ce450 tx=0x7f8c50009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:27.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:27.939+0000 7f8c5f7fe640 1 -- 172.21.15.18:0/3240785950 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8c6806c820 con 0x7f8c6813fae0 2024-09-19T09:13:28.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.113+0000 7f8c6d0b7640 1 -- 172.21.15.18:0/3240785950 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8c68146470 con 0x7f8c6813fae0 2024-09-19T09:13:28.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.114+0000 7f8c5f7fe640 1 -- 172.21.15.18:0/3240785950 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16694 (secure 0 0 0) 0x7f8c60079a50 con 0x7f8c6813fae0 2024-09-19T09:13:28.115 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:28.115 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":20,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:13:26.853211+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:13:25.116784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:13:25.838110+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:13:28.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.116+0000 7f8c6d0b7640 1 -- 172.21.15.18:0/3240785950 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8c4806c2b0 msgr2=0x7f8c4806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:28.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.116+0000 7f8c6d0b7640 1 --2- 172.21.15.18:0/3240785950 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8c4806c2b0 0x7f8c4806e770 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8c680ce450 tx=0x7f8c50009190 comp rx=0 tx=0).stop 2024-09-19T09:13:28.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.116+0000 7f8c6d0b7640 1 -- 172.21.15.18:0/3240785950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c6813fae0 msgr2=0x7f8c68144180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:28.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.116+0000 7f8c6d0b7640 1 --2- 172.21.15.18:0/3240785950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c6813fae0 0x7f8c68144180 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8c6002a140 tx=0x7f8c600046c0 comp rx=0 tx=0).stop 2024-09-19T09:13:28.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.116+0000 7f8c6d0b7640 1 -- 172.21.15.18:0/3240785950 shutdown_connections 2024-09-19T09:13:28.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.116+0000 7f8c6d0b7640 1 --2- 172.21.15.18:0/3240785950 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8c4806c2b0 0x7f8c4806e770 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:28.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.116+0000 7f8c6d0b7640 1 --2- 172.21.15.18:0/3240785950 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c68160a80 0x7f8c6813f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:28.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.116+0000 7f8c6d0b7640 1 --2- 172.21.15.18:0/3240785950 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c68142150 0x7f8c68145d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:28.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.116+0000 7f8c6d0b7640 1 --2- 172.21.15.18:0/3240785950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c6813fae0 0x7f8c68144180 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:28.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.116+0000 7f8c6d0b7640 1 -- 172.21.15.18:0/3240785950 >> 172.21.15.18:0/3240785950 conn(0x7f8c6806bc10 msgr2=0x7f8c6806e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:28.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.116+0000 7f8c6d0b7640 1 -- 172.21.15.18:0/3240785950 shutdown_connections 2024-09-19T09:13:28.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.116+0000 7f8c6d0b7640 1 -- 172.21.15.18:0/3240785950 wait complete. 2024-09-19T09:13:28.127 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-19T09:13:28.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.233+0000 7f192bee6640 1 Processor -- start 2024-09-19T09:13:28.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.233+0000 7f192bee6640 1 -- start start 2024-09-19T09:13:28.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.234+0000 7f192bee6640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f19240d14e0 0x7f19240d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:28.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.234+0000 7f192bee6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f19240b47e0 0x7f19240b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:28.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.234+0000 7f192bee6640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19240d3270 con 0x7f192415ede0 2024-09-19T09:13:28.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.234+0000 7f192bee6640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f19240d1e60 con 0x7f19240b47e0 2024-09-19T09:13:28.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.234+0000 7f192bee6640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f19240d34e0 con 0x7f19240d14e0 2024-09-19T09:13:28.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.234+0000 7f192a483640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f19240b47e0 0x7f19240b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:28.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.234+0000 7f1929c82640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f192415ede0 0x7f19240d5300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34606/0 (socket says 172.21.15.18:34606) 2024-09-19T09:13:28.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.234+0000 7f1929c82640 1 -- 172.21.15.18:0/1097896901 learned_addr learned my addr 172.21.15.18:0/1097896901 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:28.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.234+0000 7f1929481640 1 --2- 172.21.15.18:0/1097896901 >> v2:172.21.15.162:3300/0 conn(0x7f19240d14e0 0x7f19240d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:28.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.234+0000 7f192a483640 1 -- 172.21.15.18:0/1097896901 >> v2:172.21.15.162:3300/0 conn(0x7f19240d14e0 msgr2=0x7f19240d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:28.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.234+0000 7f192a483640 1 --2- 172.21.15.18:0/1097896901 >> v2:172.21.15.162:3300/0 conn(0x7f19240d14e0 0x7f19240d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:28.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.234+0000 7f192a483640 1 -- 172.21.15.18:0/1097896901 >> v1:172.21.15.18:6789/0 conn(0x7f192415ede0 legacy=0x7f19240d5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:28.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.234+0000 7f192a483640 1 -- 172.21.15.18:0/1097896901 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19240d37c0 con 0x7f19240b47e0 2024-09-19T09:13:28.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.234+0000 7f1928c80640 1 -- 172.21.15.18:0/1097896901 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1066295267 0 0) 0x7f19240d3270 con 0x7f192415ede0 2024-09-19T09:13:28.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.234+0000 7f1929481640 1 --2- 172.21.15.18:0/1097896901 >> v2:172.21.15.162:3300/0 conn(0x7f19240d14e0 0x7f19240d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:13:28.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.235+0000 7f192a483640 1 --2- 172.21.15.18:0/1097896901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19240b47e0 0x7f19240b4c70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f19240c84e0 tx=0x7f191c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ecaeb991d53267 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:28.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.235+0000 7f1928c80640 1 -- 172.21.15.18:0/1097896901 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c007740 con 0x7f19240b47e0 2024-09-19T09:13:28.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.235+0000 7f1928c80640 1 -- 172.21.15.18:0/1097896901 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f191c0078e0 con 0x7f19240b47e0 2024-09-19T09:13:28.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.235+0000 7f1928c80640 1 -- 172.21.15.18:0/1097896901 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f191c007cb0 con 0x7f19240b47e0 2024-09-19T09:13:28.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.236+0000 7f192bee6640 1 -- 172.21.15.18:0/1097896901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19240b47e0 msgr2=0x7f19240b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:28.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.236+0000 7f192bee6640 1 --2- 172.21.15.18:0/1097896901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19240b47e0 0x7f19240b4c70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f19240c84e0 tx=0x7f191c02a710 comp rx=0 tx=0).stop 2024-09-19T09:13:28.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.236+0000 7f192bee6640 1 -- 172.21.15.18:0/1097896901 shutdown_connections 2024-09-19T09:13:28.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.236+0000 7f192bee6640 1 --2- 172.21.15.18:0/1097896901 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19240b47e0 0x7f19240b4c70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:28.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.236+0000 7f192bee6640 1 --2- 172.21.15.18:0/1097896901 >> v2:172.21.15.162:3300/0 conn(0x7f19240d14e0 0x7f19240d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:28.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.236+0000 7f192bee6640 1 -- 172.21.15.18:0/1097896901 >> 172.21.15.18:0/1097896901 conn(0x7f192409df30 msgr2=0x7f19240d4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:28.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.236+0000 7f192bee6640 1 -- 172.21.15.18:0/1097896901 shutdown_connections 2024-09-19T09:13:28.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.236+0000 7f192bee6640 1 -- 172.21.15.18:0/1097896901 wait complete. 2024-09-19T09:13:28.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.237+0000 7f192bee6640 1 Processor -- start 2024-09-19T09:13:28.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.237+0000 7f192bee6640 1 -- start start 2024-09-19T09:13:28.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.238+0000 7f192bee6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19240b47e0 0x7f19240cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:28.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.238+0000 7f192bee6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19240d14e0 0x7f19241544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:28.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.238+0000 7f192bee6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f192415ede0 0x7f19241f7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:28.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.238+0000 7f192bee6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f19240d5a10 con 0x7f19240b47e0 2024-09-19T09:13:28.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.238+0000 7f192bee6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f192415f1c0 con 0x7f192415ede0 2024-09-19T09:13:28.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.238+0000 7f192bee6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f19240b4020 con 0x7f19240d14e0 2024-09-19T09:13:28.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.238+0000 7f1929c82640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19240b47e0 0x7f19240cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:28.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.238+0000 7f1929c82640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19240b47e0 0x7f19240cbcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57016/0 (socket says 172.21.15.18:57016) 2024-09-19T09:13:28.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.238+0000 7f1929c82640 1 -- 172.21.15.18:0/2851420724 learned_addr learned my addr 172.21.15.18:0/2851420724 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:28.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.238+0000 7f192a483640 1 --2- 172.21.15.18:0/2851420724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f192415ede0 0x7f19241f7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:28.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.238+0000 7f1929481640 1 --2- 172.21.15.18:0/2851420724 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19240d14e0 0x7f19241544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:28.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.238+0000 7f1929c82640 1 -- 172.21.15.18:0/2851420724 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19240d14e0 msgr2=0x7f19241544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:28.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.238+0000 7f1929c82640 1 --2- 172.21.15.18:0/2851420724 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19240d14e0 0x7f19241544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:28.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.238+0000 7f1929c82640 1 -- 172.21.15.18:0/2851420724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f192415ede0 msgr2=0x7f19241f7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:28.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.238+0000 7f1929c82640 1 --2- 172.21.15.18:0/2851420724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f192415ede0 0x7f19241f7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:28.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.238+0000 7f1929c82640 1 -- 172.21.15.18:0/2851420724 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1924160390 con 0x7f19240b47e0 2024-09-19T09:13:28.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.238+0000 7f192a483640 1 --2- 172.21.15.18:0/2851420724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f192415ede0 0x7f19241f7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:13:28.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.238+0000 7f1929481640 1 --2- 172.21.15.18:0/2851420724 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19240d14e0 0x7f19241544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:13:28.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.238+0000 7f1929c82640 1 --2- 172.21.15.18:0/2851420724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19240b47e0 0x7f19240cbcc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f192000c4d0 tx=0x7f192000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:28.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.239+0000 7f191a7fc640 1 -- 172.21.15.18:0/2851420724 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1920018070 con 0x7f19240b47e0 2024-09-19T09:13:28.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.239+0000 7f191a7fc640 1 -- 172.21.15.18:0/2851420724 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1920007500 con 0x7f19240b47e0 2024-09-19T09:13:28.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.239+0000 7f192bee6640 1 -- 172.21.15.18:0/2851420724 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19240b9bb0 con 0x7f19240b47e0 2024-09-19T09:13:28.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.239+0000 7f191a7fc640 1 -- 172.21.15.18:0/2851420724 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1920004a20 con 0x7f19240b47e0 2024-09-19T09:13:28.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.239+0000 7f192bee6640 1 -- 172.21.15.18:0/2851420724 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19240ba9a0 con 0x7f19240b47e0 2024-09-19T09:13:28.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.239+0000 7f192bee6640 1 -- 172.21.15.18:0/2851420724 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19240d1920 con 0x7f19240b47e0 2024-09-19T09:13:28.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.240+0000 7f191a7fc640 1 -- 172.21.15.18:0/2851420724 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f192001b070 con 0x7f19240b47e0 2024-09-19T09:13:28.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.240+0000 7f191a7fc640 1 --2- 172.21.15.18:0/2851420724 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f190806c2b0 0x7f190806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:28.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.241+0000 7f191a7fc640 1 -- 172.21.15.18:0/2851420724 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f192008a760 con 0x7f19240b47e0 2024-09-19T09:13:28.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.241+0000 7f1929481640 1 --2- 172.21.15.18:0/2851420724 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f190806c2b0 0x7f190806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:28.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.241+0000 7f1929481640 1 --2- 172.21.15.18:0/2851420724 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f190806c2b0 0x7f190806e770 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f19240b5ee0 tx=0x7f1914008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:28.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.245+0000 7f191a7fc640 1 -- 172.21.15.18:0/2851420724 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1920058ed0 con 0x7f19240b47e0 2024-09-19T09:13:28.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.459+0000 7f192bee6640 1 -- 172.21.15.18:0/2851420724 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f19240a2b90 con 0x7f19240b47e0 2024-09-19T09:13:28.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.504+0000 7f191a7fc640 1 -- 172.21.15.18:0/2851420724 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7f19200587d0 con 0x7f19240b47e0 2024-09-19T09:13:28.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.506+0000 7f192bee6640 1 -- 172.21.15.18:0/2851420724 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f190806c2b0 msgr2=0x7f190806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:28.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.506+0000 7f192bee6640 1 --2- 172.21.15.18:0/2851420724 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f190806c2b0 0x7f190806e770 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f19240b5ee0 tx=0x7f1914008040 comp rx=0 tx=0).stop 2024-09-19T09:13:28.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.506+0000 7f192bee6640 1 -- 172.21.15.18:0/2851420724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19240b47e0 msgr2=0x7f19240cbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:28.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.506+0000 7f192bee6640 1 --2- 172.21.15.18:0/2851420724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19240b47e0 0x7f19240cbcc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f192000c4d0 tx=0x7f192000c990 comp rx=0 tx=0).stop 2024-09-19T09:13:28.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.507+0000 7f192bee6640 1 -- 172.21.15.18:0/2851420724 shutdown_connections 2024-09-19T09:13:28.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.507+0000 7f192bee6640 1 --2- 172.21.15.18:0/2851420724 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f190806c2b0 0x7f190806e770 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:28.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.507+0000 7f192bee6640 1 --2- 172.21.15.18:0/2851420724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f192415ede0 0x7f19241f7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:28.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.507+0000 7f192bee6640 1 --2- 172.21.15.18:0/2851420724 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19240d14e0 0x7f19241544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:28.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.507+0000 7f192bee6640 1 --2- 172.21.15.18:0/2851420724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19240b47e0 0x7f19240cbcc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:28.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.507+0000 7f192bee6640 1 -- 172.21.15.18:0/2851420724 >> 172.21.15.18:0/2851420724 conn(0x7f192409df30 msgr2=0x7f19240b6430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:28.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.507+0000 7f192bee6640 1 -- 172.21.15.18:0/2851420724 shutdown_connections 2024-09-19T09:13:28.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.507+0000 7f192bee6640 1 -- 172.21.15.18:0/2851420724 wait complete. 2024-09-19T09:13:28.518 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd', 'disabled']} 2024-09-19T09:13:28.518 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-19T09:13:28.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.622+0000 7f4fa5d9f640 1 Processor -- start 2024-09-19T09:13:28.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.623+0000 7f4fa5d9f640 1 -- start start 2024-09-19T09:13:28.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.623+0000 7f4fa5d9f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4fa006c320 0x7f4fa0162500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:28.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.623+0000 7f4fa5d9f640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fa01631c0 con 0x7f4fa015fbe0 2024-09-19T09:13:28.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.623+0000 7f4fa5d9f640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fa015f100 con 0x7f4fa0158d70 2024-09-19T09:13:28.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.623+0000 7f4fa5d9f640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f4fa015eec0 con 0x7f4fa006c320 2024-09-19T09:13:28.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.624+0000 7f4f9ffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4fa006c320 0x7f4fa0162500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:28.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.624+0000 7f4fa559e640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f4fa015fbe0 0x7f4fa00b5050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34614/0 (socket says 172.21.15.18:34614) 2024-09-19T09:13:28.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.624+0000 7f4fa559e640 1 -- 172.21.15.18:0/3366375481 learned_addr learned my addr 172.21.15.18:0/3366375481 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:28.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.624+0000 7f4f9ffff640 1 -- 172.21.15.18:0/3366375481 >> v1:172.21.15.162:6789/0 conn(0x7f4fa0158d70 legacy=0x7f4fa006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:28.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.624+0000 7f4f9ffff640 1 -- 172.21.15.18:0/3366375481 >> v1:172.21.15.18:6789/0 conn(0x7f4fa015fbe0 legacy=0x7f4fa00b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:28.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.624+0000 7f4f9ffff640 1 -- 172.21.15.18:0/3366375481 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fa015f3e0 con 0x7f4fa006c320 2024-09-19T09:13:28.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.624+0000 7f4f9f7fe640 1 -- 172.21.15.18:0/3366375481 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3855821726 0 0) 0x7f4fa01631c0 con 0x7f4fa015fbe0 2024-09-19T09:13:28.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.625+0000 7f4f9ffff640 1 --2- 172.21.15.18:0/3366375481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fa006c320 0x7f4fa0162500 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c0097a0 tx=0x7f4f8c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b467498a007fa621 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:28.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.625+0000 7f4f9f7fe640 1 -- 172.21.15.18:0/3366375481 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c037070 con 0x7f4fa006c320 2024-09-19T09:13:28.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.625+0000 7f4f9f7fe640 1 -- 172.21.15.18:0/3366375481 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f8c032440 con 0x7f4fa006c320 2024-09-19T09:13:28.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.625+0000 7f4f9f7fe640 1 -- 172.21.15.18:0/3366375481 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c032810 con 0x7f4fa006c320 2024-09-19T09:13:28.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.625+0000 7f4fa5d9f640 1 -- 172.21.15.18:0/3366375481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fa006c320 msgr2=0x7f4fa0162500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:28.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.625+0000 7f4fa5d9f640 1 --2- 172.21.15.18:0/3366375481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fa006c320 0x7f4fa0162500 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c0097a0 tx=0x7f4f8c02a1a0 comp rx=0 tx=0).stop 2024-09-19T09:13:28.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.625+0000 7f4fa5d9f640 1 -- 172.21.15.18:0/3366375481 shutdown_connections 2024-09-19T09:13:28.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.625+0000 7f4fa5d9f640 1 --2- 172.21.15.18:0/3366375481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fa006c320 0x7f4fa0162500 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:28.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.625+0000 7f4fa5d9f640 1 -- 172.21.15.18:0/3366375481 >> 172.21.15.18:0/3366375481 conn(0x7f4fa0067f80 msgr2=0x7f4fa006cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:28.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.625+0000 7f4fa5d9f640 1 -- 172.21.15.18:0/3366375481 shutdown_connections 2024-09-19T09:13:28.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.625+0000 7f4fa5d9f640 1 -- 172.21.15.18:0/3366375481 wait complete. 2024-09-19T09:13:28.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.626+0000 7f4fa5d9f640 1 Processor -- start 2024-09-19T09:13:28.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.627+0000 7f4fa5d9f640 1 -- start start 2024-09-19T09:13:28.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.627+0000 7f4fa5d9f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4fa006c320 0x7f4fa00ce160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:28.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.627+0000 7f4fa5d9f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fa0158d70 0x7f4fa00ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:28.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.627+0000 7f4fa5d9f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4fa015fbe0 0x7f4fa00d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:28.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.627+0000 7f4fa5d9f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa01592d0 con 0x7f4fa0158d70 2024-09-19T09:13:28.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.627+0000 7f4fa5d9f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4fa0159150 con 0x7f4fa015fbe0 2024-09-19T09:13:28.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.627+0000 7f4fa5d9f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4fa0159450 con 0x7f4fa006c320 2024-09-19T09:13:28.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.628+0000 7f4f9ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fa0158d70 0x7f4fa00ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:28.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.628+0000 7f4f9ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fa0158d70 0x7f4fa00ce6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57032/0 (socket says 172.21.15.18:57032) 2024-09-19T09:13:28.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.628+0000 7f4f9ffff640 1 -- 172.21.15.18:0/1419975676 learned_addr learned my addr 172.21.15.18:0/1419975676 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:28.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.628+0000 7f4fa559e640 1 --2- 172.21.15.18:0/1419975676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4fa015fbe0 0x7f4fa00d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:28.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.628+0000 7f4fa4d9d640 1 --2- 172.21.15.18:0/1419975676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4fa006c320 0x7f4fa00ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:28.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.628+0000 7f4f9ffff640 1 -- 172.21.15.18:0/1419975676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4fa006c320 msgr2=0x7f4fa00ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:28.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.628+0000 7f4f9ffff640 1 --2- 172.21.15.18:0/1419975676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4fa006c320 0x7f4fa00ce160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:28.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.628+0000 7f4f9ffff640 1 -- 172.21.15.18:0/1419975676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4fa015fbe0 msgr2=0x7f4fa00d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:28.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.628+0000 7f4f9ffff640 1 --2- 172.21.15.18:0/1419975676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4fa015fbe0 0x7f4fa00d07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:28.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.628+0000 7f4f9ffff640 1 -- 172.21.15.18:0/1419975676 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fa00b28b0 con 0x7f4fa0158d70 2024-09-19T09:13:28.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.628+0000 7f4f9ffff640 1 --2- 172.21.15.18:0/1419975676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fa0158d70 0x7f4fa00ce6a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c000c00 tx=0x7f4f8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:28.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.628+0000 7f4f9d7fa640 1 -- 172.21.15.18:0/1419975676 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c041070 con 0x7f4fa0158d70 2024-09-19T09:13:28.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.628+0000 7f4f9d7fa640 1 -- 172.21.15.18:0/1419975676 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f8c03c930 con 0x7f4fa0158d70 2024-09-19T09:13:28.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.628+0000 7f4fa5d9f640 1 -- 172.21.15.18:0/1419975676 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fa00b2b90 con 0x7f4fa0158d70 2024-09-19T09:13:28.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.628+0000 7f4f9d7fa640 1 -- 172.21.15.18:0/1419975676 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c037040 con 0x7f4fa0158d70 2024-09-19T09:13:28.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.628+0000 7f4fa5d9f640 1 -- 172.21.15.18:0/1419975676 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fa00b3150 con 0x7f4fa0158d70 2024-09-19T09:13:28.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.629+0000 7f4fa5d9f640 1 -- 172.21.15.18:0/1419975676 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fa0162500 con 0x7f4fa0158d70 2024-09-19T09:13:28.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.630+0000 7f4f9d7fa640 1 -- 172.21.15.18:0/1419975676 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4f8c044070 con 0x7f4fa0158d70 2024-09-19T09:13:28.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.630+0000 7f4f9d7fa640 1 --2- 172.21.15.18:0/1419975676 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4f8406c2e0 0x7f4f8406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:28.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.630+0000 7f4f9d7fa640 1 -- 172.21.15.18:0/1419975676 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f4f8c0ac200 con 0x7f4fa0158d70 2024-09-19T09:13:28.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.630+0000 7f4fa4d9d640 1 --2- 172.21.15.18:0/1419975676 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4f8406c2e0 0x7f4f8406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:28.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.631+0000 7f4fa4d9d640 1 --2- 172.21.15.18:0/1419975676 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4f8406c2e0 0x7f4f8406e7a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4f94000f60 tx=0x7f4f94009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:28.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.634+0000 7f4f9d7fa640 1 -- 172.21.15.18:0/1419975676 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f4f8c07a3b0 con 0x7f4fa0158d70 2024-09-19T09:13:28.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:28.846+0000 7f4fa5d9f640 1 -- 172.21.15.18:0/1419975676 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f4fa00b5540 con 0x7f4fa0158d70 2024-09-19T09:13:29.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.505+0000 7f4f9d7fa640 1 -- 172.21.15.18:0/1419975676 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7f4f8c07e6b0 con 0x7f4fa0158d70 2024-09-19T09:13:29.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.508+0000 7f4fa5d9f640 1 -- 172.21.15.18:0/1419975676 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4f8406c2e0 msgr2=0x7f4f8406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:29.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.508+0000 7f4fa5d9f640 1 --2- 172.21.15.18:0/1419975676 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4f8406c2e0 0x7f4f8406e7a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4f94000f60 tx=0x7f4f94009040 comp rx=0 tx=0).stop 2024-09-19T09:13:29.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.508+0000 7f4fa5d9f640 1 -- 172.21.15.18:0/1419975676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fa0158d70 msgr2=0x7f4fa00ce6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:29.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.508+0000 7f4fa5d9f640 1 --2- 172.21.15.18:0/1419975676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fa0158d70 0x7f4fa00ce6a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c000c00 tx=0x7f4f8c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:13:29.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.508+0000 7f4fa5d9f640 1 -- 172.21.15.18:0/1419975676 shutdown_connections 2024-09-19T09:13:29.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.508+0000 7f4fa5d9f640 1 --2- 172.21.15.18:0/1419975676 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4f8406c2e0 0x7f4f8406e7a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:29.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.508+0000 7f4fa5d9f640 1 --2- 172.21.15.18:0/1419975676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4fa015fbe0 0x7f4fa00d07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:29.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.508+0000 7f4fa5d9f640 1 --2- 172.21.15.18:0/1419975676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4fa0158d70 0x7f4fa00ce6a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:29.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.508+0000 7f4fa5d9f640 1 --2- 172.21.15.18:0/1419975676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4fa006c320 0x7f4fa00ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:29.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.508+0000 7f4fa5d9f640 1 -- 172.21.15.18:0/1419975676 >> 172.21.15.18:0/1419975676 conn(0x7f4fa0067f80 msgr2=0x7f4fa006cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:29.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.508+0000 7f4fa5d9f640 1 -- 172.21.15.18:0/1419975676 shutdown_connections 2024-09-19T09:13:29.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.508+0000 7f4fa5d9f640 1 -- 172.21.15.18:0/1419975676 wait complete. 2024-09-19T09:13:29.522 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-19T09:13:29.522 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:13:29.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.630+0000 7f51ed247640 1 Processor -- start 2024-09-19T09:13:29.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.630+0000 7f51ed247640 1 -- start start 2024-09-19T09:13:29.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.631+0000 7f51ed247640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51e80d2ea0 0x7f51e80d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:29.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.631+0000 7f51ed247640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f51e80d37c0 0x7f51e8161e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:29.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.631+0000 7f51ed247640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51e80d04e0 con 0x7f51e80d56d0 2024-09-19T09:13:29.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.631+0000 7f51ed247640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f51e80b45a0 con 0x7f51e80d37c0 2024-09-19T09:13:29.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.631+0000 7f51ed247640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f51e80d07c0 con 0x7f51e80d2ea0 2024-09-19T09:13:29.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.631+0000 7f51e659c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f51e80d37c0 0x7f51e8161e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:29.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.631+0000 7f51e6d9d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51e80d2ea0 0x7f51e80d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:29.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.631+0000 7f51e759e640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f51e80d56d0 0x7f51e80d1360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:59830/0 (socket says 172.21.15.18:59830) 2024-09-19T09:13:29.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.631+0000 7f51e759e640 1 -- 172.21.15.18:0/2975283140 learned_addr learned my addr 172.21.15.18:0/2975283140 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:29.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.632+0000 7f51e6d9d640 1 -- 172.21.15.18:0/2975283140 >> v2:172.21.15.162:3300/0 conn(0x7f51e80d37c0 msgr2=0x7f51e8161e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:29.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.632+0000 7f51e6d9d640 1 --2- 172.21.15.18:0/2975283140 >> v2:172.21.15.162:3300/0 conn(0x7f51e80d37c0 0x7f51e8161e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:29.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.632+0000 7f51e6d9d640 1 -- 172.21.15.18:0/2975283140 >> v1:172.21.15.162:6789/0 conn(0x7f51e80d56d0 legacy=0x7f51e80d1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:29.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.632+0000 7f51e6d9d640 1 -- 172.21.15.18:0/2975283140 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e80d0aa0 con 0x7f51e80d2ea0 2024-09-19T09:13:29.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.632+0000 7f51e659c640 1 --2- 172.21.15.18:0/2975283140 >> v2:172.21.15.162:3300/0 conn(0x7f51e80d37c0 0x7f51e8161e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:13:29.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.632+0000 7f51e6d9d640 1 --2- 172.21.15.18:0/2975283140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51e80d2ea0 0x7f51e80d3280 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f51d80097d0 tx=0x7f51d802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea14fcbce76987e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:29.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.633+0000 7f51e5d9b640 1 -- 172.21.15.18:0/2975283140 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d8037070 con 0x7f51e80d2ea0 2024-09-19T09:13:29.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.633+0000 7f51e5d9b640 1 -- 172.21.15.18:0/2975283140 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51d8032440 con 0x7f51e80d2ea0 2024-09-19T09:13:29.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.633+0000 7f51e5d9b640 1 -- 172.21.15.18:0/2975283140 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d8032810 con 0x7f51e80d2ea0 2024-09-19T09:13:29.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.633+0000 7f51ed247640 1 -- 172.21.15.18:0/2975283140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51e80d2ea0 msgr2=0x7f51e80d3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:29.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.633+0000 7f51ed247640 1 --2- 172.21.15.18:0/2975283140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51e80d2ea0 0x7f51e80d3280 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f51d80097d0 tx=0x7f51d802a1c0 comp rx=0 tx=0).stop 2024-09-19T09:13:29.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.633+0000 7f51ed247640 1 -- 172.21.15.18:0/2975283140 shutdown_connections 2024-09-19T09:13:29.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.633+0000 7f51ed247640 1 --2- 172.21.15.18:0/2975283140 >> v2:172.21.15.162:3300/0 conn(0x7f51e80d37c0 0x7f51e8161e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:29.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.633+0000 7f51ed247640 1 --2- 172.21.15.18:0/2975283140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51e80d2ea0 0x7f51e80d3280 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:29.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.633+0000 7f51ed247640 1 -- 172.21.15.18:0/2975283140 >> 172.21.15.18:0/2975283140 conn(0x7f51e80d4bb0 msgr2=0x7f51e80d4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:29.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.633+0000 7f51ed247640 1 -- 172.21.15.18:0/2975283140 shutdown_connections 2024-09-19T09:13:29.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.633+0000 7f51ed247640 1 -- 172.21.15.18:0/2975283140 wait complete. 2024-09-19T09:13:29.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.635+0000 7f51ed247640 1 Processor -- start 2024-09-19T09:13:29.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.635+0000 7f51ed247640 1 -- start start 2024-09-19T09:13:29.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.635+0000 7f51ed247640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51e80d2ea0 0x7f51e81603a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:29.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.635+0000 7f51ed247640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51e80d37c0 0x7f51e81608e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:29.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.635+0000 7f51ed247640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51e80d56d0 0x7f51e80c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:29.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.635+0000 7f51ed247640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f51e80b5bc0 con 0x7f51e80d2ea0 2024-09-19T09:13:29.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.635+0000 7f51ed247640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f51e80b5a40 con 0x7f51e80d37c0 2024-09-19T09:13:29.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.635+0000 7f51ed247640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f51e80b5d40 con 0x7f51e80d56d0 2024-09-19T09:13:29.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.635+0000 7f51e6d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51e80d2ea0 0x7f51e81603a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:29.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.636+0000 7f51e6d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51e80d2ea0 0x7f51e81603a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57040/0 (socket says 172.21.15.18:57040) 2024-09-19T09:13:29.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.636+0000 7f51e6d9d640 1 -- 172.21.15.18:0/3288796054 learned_addr learned my addr 172.21.15.18:0/3288796054 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:29.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.636+0000 7f51e759e640 1 --2- 172.21.15.18:0/3288796054 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51e80d56d0 0x7f51e80c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:29.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.636+0000 7f51e659c640 1 --2- 172.21.15.18:0/3288796054 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51e80d37c0 0x7f51e81608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:29.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.636+0000 7f51e6d9d640 1 -- 172.21.15.18:0/3288796054 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51e80d56d0 msgr2=0x7f51e80c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:29.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.636+0000 7f51e6d9d640 1 --2- 172.21.15.18:0/3288796054 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51e80d56d0 0x7f51e80c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:29.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.636+0000 7f51e6d9d640 1 -- 172.21.15.18:0/3288796054 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51e80d37c0 msgr2=0x7f51e81608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:29.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.636+0000 7f51e6d9d640 1 --2- 172.21.15.18:0/3288796054 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51e80d37c0 0x7f51e81608e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:29.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.636+0000 7f51e6d9d640 1 -- 172.21.15.18:0/3288796054 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e81f4f10 con 0x7f51e80d2ea0 2024-09-19T09:13:29.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.636+0000 7f51e6d9d640 1 --2- 172.21.15.18:0/3288796054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51e80d2ea0 0x7f51e81603a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f51d80098f0 tx=0x7f51d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:29.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.636+0000 7f51cf7fe640 1 -- 172.21.15.18:0/3288796054 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d8037040 con 0x7f51e80d2ea0 2024-09-19T09:13:29.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.636+0000 7f51cf7fe640 1 -- 172.21.15.18:0/3288796054 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51d8030500 con 0x7f51e80d2ea0 2024-09-19T09:13:29.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.636+0000 7f51ed247640 1 -- 172.21.15.18:0/3288796054 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51e81f51f0 con 0x7f51e80d2ea0 2024-09-19T09:13:29.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.636+0000 7f51cf7fe640 1 -- 172.21.15.18:0/3288796054 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d80308d0 con 0x7f51e80d2ea0 2024-09-19T09:13:29.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.636+0000 7f51ed247640 1 -- 172.21.15.18:0/3288796054 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51e81f57b0 con 0x7f51e80d2ea0 2024-09-19T09:13:29.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.637+0000 7f51ed247640 1 -- 172.21.15.18:0/3288796054 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51e80d3280 con 0x7f51e80d2ea0 2024-09-19T09:13:29.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.638+0000 7f51cf7fe640 1 -- 172.21.15.18:0/3288796054 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f51d8044020 con 0x7f51e80d2ea0 2024-09-19T09:13:29.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.638+0000 7f51cf7fe640 1 --2- 172.21.15.18:0/3288796054 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f51d406c2e0 0x7f51d406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:29.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.638+0000 7f51cf7fe640 1 -- 172.21.15.18:0/3288796054 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f51d80ab5d0 con 0x7f51e80d2ea0 2024-09-19T09:13:29.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.638+0000 7f51e659c640 1 --2- 172.21.15.18:0/3288796054 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f51d406c2e0 0x7f51d406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:29.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.639+0000 7f51e659c640 1 --2- 172.21.15.18:0/3288796054 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f51d406c2e0 0x7f51d406e7a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f51e80cb320 tx=0x7f51dc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:29.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.643+0000 7f51cf7fe640 1 -- 172.21.15.18:0/3288796054 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f51d8079670 con 0x7f51e80d2ea0 2024-09-19T09:13:29.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.854+0000 7f51ed247640 1 -- 172.21.15.18:0/3288796054 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51e80d2050 con 0x7f51e80d2ea0 2024-09-19T09:13:29.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.855+0000 7f51cf7fe640 1 -- 172.21.15.18:0/3288796054 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5217 (secure 0 0 0) 0x7f51d807d970 con 0x7f51e80d2ea0 2024-09-19T09:13:29.855 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:29.856 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":6,"btime":"2024-09-19T09:13:29:505412+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3070220651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3070220651},{"type":"v1","addr":"172.21.15.162:6836","nonce":3070220651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/2341594474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2341594474},{"type":"v1","addr":"172.21.15.18:6833","nonce":2341594474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/603326104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":603326104},{"type":"v1","addr":"172.21.15.18:6835","nonce":603326104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:13:26.853577+0000","modified":"2024-09-19T09:13:28.847901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6837/727689889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":727689889},{"type":"v1","addr":"172.21.15.162:6837","nonce":727689889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":1}]} 2024-09-19T09:13:29.856 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 6 2024-09-19T09:13:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.857+0000 7f51ed247640 1 -- 172.21.15.18:0/3288796054 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f51d406c2e0 msgr2=0x7f51d406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.857+0000 7f51ed247640 1 --2- 172.21.15.18:0/3288796054 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f51d406c2e0 0x7f51d406e7a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f51e80cb320 tx=0x7f51dc009190 comp rx=0 tx=0).stop 2024-09-19T09:13:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.857+0000 7f51ed247640 1 -- 172.21.15.18:0/3288796054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51e80d2ea0 msgr2=0x7f51e81603a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.857+0000 7f51ed247640 1 --2- 172.21.15.18:0/3288796054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51e80d2ea0 0x7f51e81603a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f51d80098f0 tx=0x7f51d80046c0 comp rx=0 tx=0).stop 2024-09-19T09:13:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.857+0000 7f51ed247640 1 -- 172.21.15.18:0/3288796054 shutdown_connections 2024-09-19T09:13:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.857+0000 7f51ed247640 1 --2- 172.21.15.18:0/3288796054 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f51d406c2e0 0x7f51d406e7a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.857+0000 7f51ed247640 1 --2- 172.21.15.18:0/3288796054 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51e80d56d0 0x7f51e80c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.857+0000 7f51ed247640 1 --2- 172.21.15.18:0/3288796054 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51e80d37c0 0x7f51e81608e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.857+0000 7f51ed247640 1 --2- 172.21.15.18:0/3288796054 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51e80d2ea0 0x7f51e81603a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.857+0000 7f51ed247640 1 -- 172.21.15.18:0/3288796054 >> 172.21.15.18:0/3288796054 conn(0x7f51e80d4bb0 msgr2=0x7f51e80b1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:29.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.857+0000 7f51ed247640 1 -- 172.21.15.18:0/3288796054 shutdown_connections 2024-09-19T09:13:29.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.857+0000 7f51ed247640 1 -- 172.21.15.18:0/3288796054 wait complete. 2024-09-19T09:13:29.868 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:13:29.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.970+0000 7ff9225bd640 1 Processor -- start 2024-09-19T09:13:29.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.970+0000 7ff9225bd640 1 -- start start 2024-09-19T09:13:29.971 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:13:29.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.971+0000 7ff9225bd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff91c0d57a0 0x7ff91c0d1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:29.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.971+0000 7ff9225bd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff91c0d1990 0x7ff91c0b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:29.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.971+0000 7ff9225bd640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff91c0d3880 con 0x7ff91c15ecc0 2024-09-19T09:13:29.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.971+0000 7ff9225bd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff91c0d3b20 con 0x7ff91c0d1990 2024-09-19T09:13:29.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.971+0000 7ff9225bd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff91c0b42f0 con 0x7ff91c0d57a0 2024-09-19T09:13:29.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.971+0000 7ff91bfff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff91c15ecc0 0x7ff91c0d3170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34616/0 (socket says 172.21.15.18:34616) 2024-09-19T09:13:29.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.971+0000 7ff91bfff640 1 -- 172.21.15.18:0/484239738 learned_addr learned my addr 172.21.15.18:0/484239738 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:29.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.971+0000 7ff920b5a640 1 --2- 172.21.15.18:0/484239738 >> v2:172.21.15.162:3300/0 conn(0x7ff91c0d1990 0x7ff91c0b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:29.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.971+0000 7ff91b7fe640 1 --2- 172.21.15.18:0/484239738 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff91c0d57a0 0x7ff91c0d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:29.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.971+0000 7ff91affd640 1 -- 172.21.15.18:0/484239738 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3582610533 0 0) 0x7ff91c0d3880 con 0x7ff91c15ecc0 2024-09-19T09:13:29.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.971+0000 7ff91affd640 1 -- 172.21.15.18:0/484239738 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff904003520 con 0x7ff91c15ecc0 2024-09-19T09:13:29.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.971+0000 7ff91affd640 1 -- 172.21.15.18:0/484239738 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3608200207 0 0) 0x7ff904003520 con 0x7ff91c15ecc0 2024-09-19T09:13:29.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.971+0000 7ff920b5a640 1 -- 172.21.15.18:0/484239738 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff91c0d57a0 msgr2=0x7ff91c0d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:29.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.971+0000 7ff920b5a640 1 --2- 172.21.15.18:0/484239738 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff91c0d57a0 0x7ff91c0d1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:29.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.971+0000 7ff920b5a640 1 -- 172.21.15.18:0/484239738 >> v1:172.21.15.18:6789/0 conn(0x7ff91c15ecc0 legacy=0x7ff91c0d3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:29.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.971+0000 7ff920b5a640 1 -- 172.21.15.18:0/484239738 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff91c0b45d0 con 0x7ff91c0d1990 2024-09-19T09:13:29.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.971+0000 7ff91b7fe640 1 --2- 172.21.15.18:0/484239738 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff91c0d57a0 0x7ff91c0d1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:13:29.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.972+0000 7ff920b5a640 1 --2- 172.21.15.18:0/484239738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff91c0d1990 0x7ff91c0b50b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff914009d90 tx=0x7ff91402a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48f0c2d5c94ce3a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:29.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.972+0000 7ff91affd640 1 -- 172.21.15.18:0/484239738 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff90c001690 con 0x7ff91c0d1990 2024-09-19T09:13:29.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.972+0000 7ff91affd640 1 -- 172.21.15.18:0/484239738 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff914007540 con 0x7ff91c0d1990 2024-09-19T09:13:29.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.972+0000 7ff91affd640 1 -- 172.21.15.18:0/484239738 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9140078f0 con 0x7ff91c0d1990 2024-09-19T09:13:29.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.973+0000 7ff9225bd640 1 -- 172.21.15.18:0/484239738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff91c0d1990 msgr2=0x7ff91c0b50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:29.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.973+0000 7ff9225bd640 1 --2- 172.21.15.18:0/484239738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff91c0d1990 0x7ff91c0b50b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff914009d90 tx=0x7ff91402a5f0 comp rx=0 tx=0).stop 2024-09-19T09:13:29.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.973+0000 7ff9225bd640 1 -- 172.21.15.18:0/484239738 shutdown_connections 2024-09-19T09:13:29.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.973+0000 7ff9225bd640 1 --2- 172.21.15.18:0/484239738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff91c0d1990 0x7ff91c0b50b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:29.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.973+0000 7ff9225bd640 1 --2- 172.21.15.18:0/484239738 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff91c0d57a0 0x7ff91c0d1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:29.976 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:13:29.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.973+0000 7ff9225bd640 1 -- 172.21.15.18:0/484239738 >> 172.21.15.18:0/484239738 conn(0x7ff91c0d4bd0 msgr2=0x7ff91c0d4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:29.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.973+0000 7ff9225bd640 1 -- 172.21.15.18:0/484239738 shutdown_connections 2024-09-19T09:13:29.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.973+0000 7ff9225bd640 1 -- 172.21.15.18:0/484239738 wait complete. 2024-09-19T09:13:29.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.974+0000 7ff9225bd640 1 Processor -- start 2024-09-19T09:13:29.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.975+0000 7ff9225bd640 1 -- start start 2024-09-19T09:13:29.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.975+0000 7ff9225bd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff91c0d1990 0x7ff91c0c9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:29.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.975+0000 7ff9225bd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff91c0d57a0 0x7ff91c1601e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:29.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.975+0000 7ff9225bd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff91c15ecc0 0x7ff91c0ba0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:29.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.975+0000 7ff9225bd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff91c15f0a0 con 0x7ff91c0d57a0 2024-09-19T09:13:29.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.975+0000 7ff9225bd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff91c0b4b90 con 0x7ff91c15ecc0 2024-09-19T09:13:29.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.975+0000 7ff9225bd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff91c15f220 con 0x7ff91c0d1990 2024-09-19T09:13:29.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.975+0000 7ff91b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff91c0d57a0 0x7ff91c1601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:29.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.975+0000 7ff91b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff91c0d57a0 0x7ff91c1601e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57042/0 (socket says 172.21.15.18:57042) 2024-09-19T09:13:29.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.975+0000 7ff91b7fe640 1 -- 172.21.15.18:0/3211611521 learned_addr learned my addr 172.21.15.18:0/3211611521 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:29.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.976+0000 7ff91bfff640 1 --2- 172.21.15.18:0/3211611521 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff91c0d1990 0x7ff91c0c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:29.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.976+0000 7ff920b5a640 1 --2- 172.21.15.18:0/3211611521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff91c15ecc0 0x7ff91c0ba0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:29.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.976+0000 7ff91b7fe640 1 -- 172.21.15.18:0/3211611521 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff91c0d1990 msgr2=0x7ff91c0c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:29.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.976+0000 7ff91b7fe640 1 --2- 172.21.15.18:0/3211611521 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff91c0d1990 0x7ff91c0c9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:29.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.976+0000 7ff91b7fe640 1 -- 172.21.15.18:0/3211611521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff91c15ecc0 msgr2=0x7ff91c0ba0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:29.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.976+0000 7ff91b7fe640 1 --2- 172.21.15.18:0/3211611521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff91c15ecc0 0x7ff91c0ba0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:29.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.976+0000 7ff91b7fe640 1 -- 172.21.15.18:0/3211611521 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff91c0b7b30 con 0x7ff91c0d57a0 2024-09-19T09:13:29.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.976+0000 7ff91bfff640 1 --2- 172.21.15.18:0/3211611521 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff91c0d1990 0x7ff91c0c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:13:29.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.976+0000 7ff920b5a640 1 --2- 172.21.15.18:0/3211611521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff91c15ecc0 0x7ff91c0ba0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:13:29.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.976+0000 7ff91b7fe640 1 --2- 172.21.15.18:0/3211611521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff91c0d57a0 0x7ff91c1601e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff91000ec10 tx=0x7ff91000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:29.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.976+0000 7ff918ff9640 1 -- 172.21.15.18:0/3211611521 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff910017070 con 0x7ff91c0d57a0 2024-09-19T09:13:29.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.976+0000 7ff918ff9640 1 -- 172.21.15.18:0/3211611521 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff91000cc30 con 0x7ff91c0d57a0 2024-09-19T09:13:29.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.976+0000 7ff918ff9640 1 -- 172.21.15.18:0/3211611521 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff910013470 con 0x7ff91c0d57a0 2024-09-19T09:13:29.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.976+0000 7ff9225bd640 1 -- 172.21.15.18:0/3211611521 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff91c0b7e10 con 0x7ff91c0d57a0 2024-09-19T09:13:29.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.976+0000 7ff9225bd640 1 -- 172.21.15.18:0/3211611521 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff91c0b83d0 con 0x7ff91c0d57a0 2024-09-19T09:13:29.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.977+0000 7ff9225bd640 1 -- 172.21.15.18:0/3211611521 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff91c0d1450 con 0x7ff91c0d57a0 2024-09-19T09:13:29.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.978+0000 7ff918ff9640 1 -- 172.21.15.18:0/3211611521 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff91001a070 con 0x7ff91c0d57a0 2024-09-19T09:13:29.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.978+0000 7ff918ff9640 1 --2- 172.21.15.18:0/3211611521 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff90806c2b0 0x7ff90806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:29.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.979+0000 7ff918ff9640 1 -- 172.21.15.18:0/3211611521 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff91008b6a0 con 0x7ff91c0d57a0 2024-09-19T09:13:29.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.979+0000 7ff91bfff640 1 --2- 172.21.15.18:0/3211611521 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff90806c2b0 0x7ff90806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:29.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.979+0000 7ff91bfff640 1 --2- 172.21.15.18:0/3211611521 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff90806c2b0 0x7ff90806e770 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff90c001eb0 tx=0x7ff90c001d00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:29.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:29.983+0000 7ff918ff9640 1 -- 172.21.15.18:0/3211611521 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff910059ea0 con 0x7ff91c0d57a0 2024-09-19T09:13:30.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.159+0000 7ff9225bd640 1 -- 172.21.15.18:0/3211611521 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff91c0b3f90 con 0x7ff91c0d57a0 2024-09-19T09:13:30.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.160+0000 7ff918ff9640 1 -- 172.21.15.18:0/3211611521 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16681 (secure 0 0 0) 0x7ff9100597a0 con 0x7ff91c0d57a0 2024-09-19T09:13:30.161 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:30.161 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:13:28.500103+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:13:25.116784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:13:25.838110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:13:30.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.162+0000 7ff9225bd640 1 -- 172.21.15.18:0/3211611521 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff90806c2b0 msgr2=0x7ff90806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:30.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.162+0000 7ff9225bd640 1 --2- 172.21.15.18:0/3211611521 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff90806c2b0 0x7ff90806e770 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff90c001eb0 tx=0x7ff90c001d00 comp rx=0 tx=0).stop 2024-09-19T09:13:30.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.162+0000 7ff9225bd640 1 -- 172.21.15.18:0/3211611521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff91c0d57a0 msgr2=0x7ff91c1601e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:30.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.162+0000 7ff9225bd640 1 --2- 172.21.15.18:0/3211611521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff91c0d57a0 0x7ff91c1601e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff91000ec10 tx=0x7ff91000c520 comp rx=0 tx=0).stop 2024-09-19T09:13:30.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.162+0000 7ff9225bd640 1 -- 172.21.15.18:0/3211611521 shutdown_connections 2024-09-19T09:13:30.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.162+0000 7ff9225bd640 1 --2- 172.21.15.18:0/3211611521 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff90806c2b0 0x7ff90806e770 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.162+0000 7ff9225bd640 1 --2- 172.21.15.18:0/3211611521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff91c15ecc0 0x7ff91c0ba0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.162+0000 7ff9225bd640 1 --2- 172.21.15.18:0/3211611521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff91c0d57a0 0x7ff91c1601e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.162+0000 7ff9225bd640 1 --2- 172.21.15.18:0/3211611521 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff91c0d1990 0x7ff91c0c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.162+0000 7ff9225bd640 1 -- 172.21.15.18:0/3211611521 >> 172.21.15.18:0/3211611521 conn(0x7ff91c0d4bd0 msgr2=0x7ff91c06cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:30.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.162+0000 7ff9225bd640 1 -- 172.21.15.18:0/3211611521 shutdown_connections 2024-09-19T09:13:30.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.162+0000 7ff9225bd640 1 -- 172.21.15.18:0/3211611521 wait complete. 2024-09-19T09:13:30.174 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T09:13:30.174 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:13:30.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.276+0000 7ffb6b41e640 1 Processor -- start 2024-09-19T09:13:30.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.276+0000 7ffb6b41e640 1 -- start start 2024-09-19T09:13:30.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.277+0000 7ffb6b41e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ffb64142150 0x7ffb64160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:30.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.277+0000 7ffb6b41e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb64160a80 0x7ffb640cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:30.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.277+0000 7ffb6b41e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb64142650 con 0x7ffb6413fae0 2024-09-19T09:13:30.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.277+0000 7ffb6b41e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7ffb640ce780 con 0x7ffb64142150 2024-09-19T09:13:30.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.277+0000 7ffb6b41e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ffb64142930 con 0x7ffb64160a80 2024-09-19T09:13:30.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.277+0000 7ffb689b9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ffb64142150 0x7ffb64160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:30.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.277+0000 7ffb691ba640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ffb6413fae0 0x7ffb6406f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34618/0 (socket says 172.21.15.18:34618) 2024-09-19T09:13:30.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.277+0000 7ffb689b9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ffb64142150 0x7ffb64160540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57048/0 (socket says 172.21.15.18:57048) 2024-09-19T09:13:30.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.277+0000 7ffb691ba640 1 -- 172.21.15.18:0/287216561 learned_addr learned my addr 172.21.15.18:0/287216561 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:30.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.277+0000 7ffb689b9640 1 -- 172.21.15.18:0/287216561 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb64160a80 msgr2=0x7ffb640cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:30.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.277+0000 7ffb689b9640 1 --2- 172.21.15.18:0/287216561 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb64160a80 0x7ffb640cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.277+0000 7ffb689b9640 1 -- 172.21.15.18:0/287216561 >> v1:172.21.15.18:6789/0 conn(0x7ffb6413fae0 legacy=0x7ffb6406f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:30.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.277+0000 7ffb5bfff640 1 -- 172.21.15.18:0/287216561 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3646540974 0 0) 0x7ffb64142650 con 0x7ffb6413fae0 2024-09-19T09:13:30.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.277+0000 7ffb689b9640 1 -- 172.21.15.18:0/287216561 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb64142c10 con 0x7ffb64142150 2024-09-19T09:13:30.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.278+0000 7ffb689b9640 1 --2- 172.21.15.18:0/287216561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb64142150 0x7ffb64160540 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffb540097a0 tx=0x7ffb5402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ed357adaf1c8cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:30.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.278+0000 7ffb5bfff640 1 -- 172.21.15.18:0/287216561 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb54037070 con 0x7ffb64142150 2024-09-19T09:13:30.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.278+0000 7ffb5bfff640 1 -- 172.21.15.18:0/287216561 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb5402ae50 con 0x7ffb64142150 2024-09-19T09:13:30.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.278+0000 7ffb5bfff640 1 -- 172.21.15.18:0/287216561 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb54032660 con 0x7ffb64142150 2024-09-19T09:13:30.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.279+0000 7ffb6b41e640 1 -- 172.21.15.18:0/287216561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb64142150 msgr2=0x7ffb64160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:30.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.279+0000 7ffb6b41e640 1 --2- 172.21.15.18:0/287216561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb64142150 0x7ffb64160540 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ffb540097a0 tx=0x7ffb5402a100 comp rx=0 tx=0).stop 2024-09-19T09:13:30.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.279+0000 7ffb6b41e640 1 -- 172.21.15.18:0/287216561 shutdown_connections 2024-09-19T09:13:30.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.279+0000 7ffb6b41e640 1 --2- 172.21.15.18:0/287216561 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb64160a80 0x7ffb640cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.279+0000 7ffb6b41e640 1 --2- 172.21.15.18:0/287216561 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb64142150 0x7ffb64160540 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.279+0000 7ffb6b41e640 1 -- 172.21.15.18:0/287216561 >> 172.21.15.18:0/287216561 conn(0x7ffb6406bc10 msgr2=0x7ffb6406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:30.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.279+0000 7ffb6b41e640 1 -- 172.21.15.18:0/287216561 shutdown_connections 2024-09-19T09:13:30.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.279+0000 7ffb6b41e640 1 -- 172.21.15.18:0/287216561 wait complete. 2024-09-19T09:13:30.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.280+0000 7ffb6b41e640 1 Processor -- start 2024-09-19T09:13:30.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.280+0000 7ffb6b41e640 1 -- start start 2024-09-19T09:13:30.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.281+0000 7ffb6b41e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb6413fae0 0x7ffb64157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:30.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.281+0000 7ffb6b41e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb64142150 0x7ffb6413eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:30.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.281+0000 7ffb6b41e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb64160a80 0x7ffb641412d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:30.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.281+0000 7ffb6b41e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffb640cf2d0 con 0x7ffb64142150 2024-09-19T09:13:30.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.281+0000 7ffb6b41e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffb640cf150 con 0x7ffb64160a80 2024-09-19T09:13:30.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.281+0000 7ffb6b41e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ffb640cf450 con 0x7ffb6413fae0 2024-09-19T09:13:30.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.281+0000 7ffb689b9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb64142150 0x7ffb6413eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:30.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.281+0000 7ffb689b9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb64142150 0x7ffb6413eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57064/0 (socket says 172.21.15.18:57064) 2024-09-19T09:13:30.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.281+0000 7ffb689b9640 1 -- 172.21.15.18:0/2773013913 learned_addr learned my addr 172.21.15.18:0/2773013913 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:30.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.281+0000 7ffb691ba640 1 --2- 172.21.15.18:0/2773013913 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb6413fae0 0x7ffb64157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:30.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.281+0000 7ffb699bb640 1 --2- 172.21.15.18:0/2773013913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb64160a80 0x7ffb641412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:30.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.281+0000 7ffb689b9640 1 -- 172.21.15.18:0/2773013913 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb6413fae0 msgr2=0x7ffb64157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:30.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.281+0000 7ffb689b9640 1 --2- 172.21.15.18:0/2773013913 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb6413fae0 0x7ffb64157f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.281+0000 7ffb689b9640 1 -- 172.21.15.18:0/2773013913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb64160a80 msgr2=0x7ffb641412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:30.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.281+0000 7ffb689b9640 1 --2- 172.21.15.18:0/2773013913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb64160a80 0x7ffb641412d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.281+0000 7ffb689b9640 1 -- 172.21.15.18:0/2773013913 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb64144320 con 0x7ffb64142150 2024-09-19T09:13:30.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.281+0000 7ffb689b9640 1 --2- 172.21.15.18:0/2773013913 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb64142150 0x7ffb6413eeb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffb54000c00 tx=0x7ffb540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:30.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.281+0000 7ffb59ffb640 1 -- 172.21.15.18:0/2773013913 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb54042070 con 0x7ffb64142150 2024-09-19T09:13:30.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.281+0000 7ffb59ffb640 1 -- 172.21.15.18:0/2773013913 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb5403e670 con 0x7ffb64142150 2024-09-19T09:13:30.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.281+0000 7ffb59ffb640 1 -- 172.21.15.18:0/2773013913 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb54037040 con 0x7ffb64142150 2024-09-19T09:13:30.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.281+0000 7ffb6b41e640 1 -- 172.21.15.18:0/2773013913 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb64144ee0 con 0x7ffb64142150 2024-09-19T09:13:30.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.282+0000 7ffb6b41e640 1 -- 172.21.15.18:0/2773013913 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb641454a0 con 0x7ffb64142150 2024-09-19T09:13:30.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.283+0000 7ffb6b41e640 1 -- 172.21.15.18:0/2773013913 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb64160540 con 0x7ffb64142150 2024-09-19T09:13:30.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.283+0000 7ffb59ffb640 1 -- 172.21.15.18:0/2773013913 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ffb54045070 con 0x7ffb64142150 2024-09-19T09:13:30.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.283+0000 7ffb59ffb640 1 --2- 172.21.15.18:0/2773013913 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ffb4806c2b0 0x7ffb4806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:30.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.284+0000 7ffb59ffb640 1 -- 172.21.15.18:0/2773013913 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ffb540abda0 con 0x7ffb64142150 2024-09-19T09:13:30.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.284+0000 7ffb691ba640 1 --2- 172.21.15.18:0/2773013913 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ffb4806c2b0 0x7ffb4806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:30.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.284+0000 7ffb691ba640 1 --2- 172.21.15.18:0/2773013913 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ffb4806c2b0 0x7ffb4806e770 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ffb60000f60 tx=0x7ffb60007b70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:30.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.288+0000 7ffb59ffb640 1 -- 172.21.15.18:0/2773013913 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ffb5407a630 con 0x7ffb64142150 2024-09-19T09:13:30.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.460+0000 7ffb6b41e640 1 -- 172.21.15.18:0/2773013913 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffb640b0f70 con 0x7ffb4806c2b0 2024-09-19T09:13:30.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.466+0000 7ffb59ffb640 1 -- 172.21.15.18:0/2773013913 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242209 (secure 0 0 0) 0x7ffb640b0f70 con 0x7ffb4806c2b0 2024-09-19T09:13:30.470 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:30.472 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:13:30.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.470+0000 7ffb6b41e640 1 -- 172.21.15.18:0/2773013913 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ffb4806c2b0 msgr2=0x7ffb4806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:30.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.470+0000 7ffb6b41e640 1 --2- 172.21.15.18:0/2773013913 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ffb4806c2b0 0x7ffb4806e770 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ffb60000f60 tx=0x7ffb60007b70 comp rx=0 tx=0).stop 2024-09-19T09:13:30.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.470+0000 7ffb6b41e640 1 -- 172.21.15.18:0/2773013913 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb64142150 msgr2=0x7ffb6413eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:30.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.470+0000 7ffb6b41e640 1 --2- 172.21.15.18:0/2773013913 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb64142150 0x7ffb6413eeb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffb54000c00 tx=0x7ffb540046c0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.470+0000 7ffb6b41e640 1 -- 172.21.15.18:0/2773013913 shutdown_connections 2024-09-19T09:13:30.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.470+0000 7ffb6b41e640 1 --2- 172.21.15.18:0/2773013913 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ffb4806c2b0 0x7ffb4806e770 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.470+0000 7ffb6b41e640 1 --2- 172.21.15.18:0/2773013913 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffb64160a80 0x7ffb641412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.470+0000 7ffb6b41e640 1 --2- 172.21.15.18:0/2773013913 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffb64142150 0x7ffb6413eeb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.470+0000 7ffb6b41e640 1 --2- 172.21.15.18:0/2773013913 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffb6413fae0 0x7ffb64157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.470+0000 7ffb6b41e640 1 -- 172.21.15.18:0/2773013913 >> 172.21.15.18:0/2773013913 conn(0x7ffb6406bc10 msgr2=0x7ffb640cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:30.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.470+0000 7ffb6b41e640 1 -- 172.21.15.18:0/2773013913 shutdown_connections 2024-09-19T09:13:30.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.470+0000 7ffb6b41e640 1 -- 172.21.15.18:0/2773013913 wait complete. 2024-09-19T09:13:30.481 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-19T09:13:29.522390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1603,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560896,"statfs":{"total":1600000000,"available":1598357954,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.039671"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493236+0000","last_change":"2024-09-19T09:13:26.493236+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493236+0000","last_undegraded":"2024-09-19T09:13:26.493236+0000","last_fullsized":"2024-09-19T09:13:26.493236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.496430+0000","last_change":"2024-09-19T09:13:26.496430+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.496430+0000","last_undegraded":"2024-09-19T09:13:26.496430+0000","last_fullsized":"2024-09-19T09:13:26.496430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495677+0000","last_change":"2024-09-19T09:13:26.495677+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495677+0000","last_undegraded":"2024-09-19T09:13:26.495677+0000","last_fullsized":"2024-09-19T09:13:26.495677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495028+0000","last_change":"2024-09-19T09:13:26.495028+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495028+0000","last_undegraded":"2024-09-19T09:13:26.495028+0000","last_fullsized":"2024-09-19T09:13:26.495028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493323+0000","last_change":"2024-09-19T09:13:26.493323+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493323+0000","last_undegraded":"2024-09-19T09:13:26.493323+0000","last_fullsized":"2024-09-19T09:13:26.493323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.498629+0000","last_change":"2024-09-19T09:13:26.498629+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.498629+0000","last_undegraded":"2024-09-19T09:13:26.498629+0000","last_fullsized":"2024-09-19T09:13:26.498629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493313+0000","last_change":"2024-09-19T09:13:26.493313+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493313+0000","last_undegraded":"2024-09-19T09:13:26.493313+0000","last_fullsized":"2024-09-19T09:13:26.493313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495284+0000","last_change":"2024-09-19T09:13:26.495284+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495284+0000","last_undegraded":"2024-09-19T09:13:26.495284+0000","last_fullsized":"2024-09-19T09:13:26.495284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493039+0000","last_change":"2024-09-19T09:13:26.493039+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493039+0000","last_undegraded":"2024-09-19T09:13:26.493039+0000","last_fullsized":"2024-09-19T09:13:26.493039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492910+0000","last_change":"2024-09-19T09:13:26.492910+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492910+0000","last_undegraded":"2024-09-19T09:13:26.492910+0000","last_fullsized":"2024-09-19T09:13:26.492910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492691+0000","last_change":"2024-09-19T09:13:26.492691+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492691+0000","last_undegraded":"2024-09-19T09:13:26.492691+0000","last_fullsized":"2024-09-19T09:13:26.492691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492910+0000","last_change":"2024-09-19T09:13:26.492910+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492910+0000","last_undegraded":"2024-09-19T09:13:26.492910+0000","last_fullsized":"2024-09-19T09:13:26.492910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494922+0000","last_change":"2024-09-19T09:13:26.494922+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494922+0000","last_undegraded":"2024-09-19T09:13:26.494922+0000","last_fullsized":"2024-09-19T09:13:26.494922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494340+0000","last_change":"2024-09-19T09:13:26.494340+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494340+0000","last_undegraded":"2024-09-19T09:13:26.494340+0000","last_fullsized":"2024-09-19T09:13:26.494340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.499204+0000","last_change":"2024-09-19T09:13:26.499204+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.499204+0000","last_undegraded":"2024-09-19T09:13:26.499204+0000","last_fullsized":"2024-09-19T09:13:26.499204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.499867+0000","last_change":"2024-09-19T09:13:26.499867+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.499867+0000","last_undegraded":"2024-09-19T09:13:26.499867+0000","last_fullsized":"2024-09-19T09:13:26.499867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.498092+0000","last_change":"2024-09-19T09:13:26.498092+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.498092+0000","last_undegraded":"2024-09-19T09:13:26.498092+0000","last_fullsized":"2024-09-19T09:13:26.498092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.496381+0000","last_change":"2024-09-19T09:13:26.496381+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.496381+0000","last_undegraded":"2024-09-19T09:13:26.496381+0000","last_fullsized":"2024-09-19T09:13:26.496381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494819+0000","last_change":"2024-09-19T09:13:26.494819+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494819+0000","last_undegraded":"2024-09-19T09:13:26.494819+0000","last_fullsized":"2024-09-19T09:13:26.494819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492532+0000","last_change":"2024-09-19T09:13:26.492532+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492532+0000","last_undegraded":"2024-09-19T09:13:26.492532+0000","last_fullsized":"2024-09-19T09:13:26.492532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.498133+0000","last_change":"2024-09-19T09:13:26.498133+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.498133+0000","last_undegraded":"2024-09-19T09:13:26.498133+0000","last_fullsized":"2024-09-19T09:13:26.498133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494421+0000","last_change":"2024-09-19T09:13:26.494421+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494421+0000","last_undegraded":"2024-09-19T09:13:26.494421+0000","last_fullsized":"2024-09-19T09:13:26.494421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494445+0000","last_change":"2024-09-19T09:13:26.494445+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494445+0000","last_undegraded":"2024-09-19T09:13:26.494445+0000","last_fullsized":"2024-09-19T09:13:26.494445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.496247+0000","last_change":"2024-09-19T09:13:26.496247+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.496247+0000","last_undegraded":"2024-09-19T09:13:26.496247+0000","last_fullsized":"2024-09-19T09:13:26.496247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.498759+0000","last_change":"2024-09-19T09:13:26.498759+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.498759+0000","last_undegraded":"2024-09-19T09:13:26.498759+0000","last_fullsized":"2024-09-19T09:13:26.498759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.497481+0000","last_change":"2024-09-19T09:13:26.497481+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.497481+0000","last_undegraded":"2024-09-19T09:13:26.497481+0000","last_fullsized":"2024-09-19T09:13:26.497481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494439+0000","last_change":"2024-09-19T09:13:26.494439+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494439+0000","last_undegraded":"2024-09-19T09:13:26.494439+0000","last_fullsized":"2024-09-19T09:13:26.494439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494550+0000","last_change":"2024-09-19T09:13:26.494550+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494550+0000","last_undegraded":"2024-09-19T09:13:26.494550+0000","last_fullsized":"2024-09-19T09:13:26.494550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.498239+0000","last_change":"2024-09-19T09:13:26.498239+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.498239+0000","last_undegraded":"2024-09-19T09:13:26.498239+0000","last_fullsized":"2024-09-19T09:13:26.498239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.503713+0000","last_change":"2024-09-19T09:13:26.503713+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.503713+0000","last_undegraded":"2024-09-19T09:13:26.503713+0000","last_fullsized":"2024-09-19T09:13:26.503713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493598+0000","last_change":"2024-09-19T09:13:26.493598+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493598+0000","last_undegraded":"2024-09-19T09:13:26.493598+0000","last_fullsized":"2024-09-19T09:13:26.493598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495036+0000","last_change":"2024-09-19T09:13:26.495036+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495036+0000","last_undegraded":"2024-09-19T09:13:26.495036+0000","last_fullsized":"2024-09-19T09:13:26.495036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494836+0000","last_change":"2024-09-19T09:13:26.494836+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494836+0000","last_undegraded":"2024-09-19T09:13:26.494836+0000","last_fullsized":"2024-09-19T09:13:26.494836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.503270+0000","last_change":"2024-09-19T09:13:26.503044+0000","last_active":"2024-09-19T09:13:26.503270+0000","last_peered":"2024-09-19T09:13:26.503270+0000","last_clean":"2024-09-19T09:13:26.503270+0000","last_became_active":"2024-09-19T09:13:26.502787+0000","last_became_peered":"2024-09-19T09:13:26.502787+0000","last_unstale":"2024-09-19T09:13:26.503270+0000","last_undegraded":"2024-09-19T09:13:26.503270+0000","last_fullsized":"2024-09-19T09:13:26.503270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:24.518221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494050+0000","last_change":"2024-09-19T09:13:26.494050+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494050+0000","last_undegraded":"2024-09-19T09:13:26.494050+0000","last_fullsized":"2024-09-19T09:13:26.494050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506840+0000","last_change":"2024-09-19T09:13:26.506712+0000","last_active":"2024-09-19T09:13:26.506840+0000","last_peered":"2024-09-19T09:13:26.506840+0000","last_clean":"2024-09-19T09:13:26.506840+0000","last_became_active":"2024-09-19T09:13:26.506244+0000","last_became_peered":"2024-09-19T09:13:26.506244+0000","last_unstale":"2024-09-19T09:13:26.506840+0000","last_undegraded":"2024-09-19T09:13:26.506840+0000","last_fullsized":"2024-09-19T09:13:26.506840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:22.213563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.505747+0000","last_change":"2024-09-19T09:13:26.505620+0000","last_active":"2024-09-19T09:13:26.505747+0000","last_peered":"2024-09-19T09:13:26.505747+0000","last_clean":"2024-09-19T09:13:26.505747+0000","last_became_active":"2024-09-19T09:13:26.505383+0000","last_became_peered":"2024-09-19T09:13:26.505383+0000","last_unstale":"2024-09-19T09:13:26.505747+0000","last_undegraded":"2024-09-19T09:13:26.505747+0000","last_fullsized":"2024-09-19T09:13:26.505747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:28.390700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.496738+0000","last_change":"2024-09-19T09:13:26.496738+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.496738+0000","last_undegraded":"2024-09-19T09:13:26.496738+0000","last_fullsized":"2024-09-19T09:13:26.496738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.507154+0000","last_change":"2024-09-19T09:13:26.507051+0000","last_active":"2024-09-19T09:13:26.507154+0000","last_peered":"2024-09-19T09:13:26.507154+0000","last_clean":"2024-09-19T09:13:26.507154+0000","last_became_active":"2024-09-19T09:13:26.506557+0000","last_became_peered":"2024-09-19T09:13:26.506557+0000","last_unstale":"2024-09-19T09:13:26.507154+0000","last_undegraded":"2024-09-19T09:13:26.507154+0000","last_fullsized":"2024-09-19T09:13:26.507154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:46.168867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495107+0000","last_change":"2024-09-19T09:13:26.495107+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495107+0000","last_undegraded":"2024-09-19T09:13:26.495107+0000","last_fullsized":"2024-09-19T09:13:26.495107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.501169+0000","last_change":"2024-09-19T09:13:26.501053+0000","last_active":"2024-09-19T09:13:26.501169+0000","last_peered":"2024-09-19T09:13:26.501169+0000","last_clean":"2024-09-19T09:13:26.501169+0000","last_became_active":"2024-09-19T09:13:26.500814+0000","last_became_peered":"2024-09-19T09:13:26.500814+0000","last_unstale":"2024-09-19T09:13:26.501169+0000","last_undegraded":"2024-09-19T09:13:26.501169+0000","last_fullsized":"2024-09-19T09:13:26.501169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:28.680916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494618+0000","last_change":"2024-09-19T09:13:26.494618+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494618+0000","last_undegraded":"2024-09-19T09:13:26.494618+0000","last_fullsized":"2024-09-19T09:13:26.494618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.499090+0000","last_change":"2024-09-19T09:13:26.498971+0000","last_active":"2024-09-19T09:13:26.499090+0000","last_peered":"2024-09-19T09:13:26.499090+0000","last_clean":"2024-09-19T09:13:26.499090+0000","last_became_active":"2024-09-19T09:13:26.498737+0000","last_became_peered":"2024-09-19T09:13:26.498737+0000","last_unstale":"2024-09-19T09:13:26.499090+0000","last_undegraded":"2024-09-19T09:13:26.499090+0000","last_fullsized":"2024-09-19T09:13:26.499090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:38.734255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.497312+0000","last_change":"2024-09-19T09:13:26.497312+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.497312+0000","last_undegraded":"2024-09-19T09:13:26.497312+0000","last_fullsized":"2024-09-19T09:13:26.497312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.500092+0000","last_change":"2024-09-19T09:13:26.499983+0000","last_active":"2024-09-19T09:13:26.500092+0000","last_peered":"2024-09-19T09:13:26.500092+0000","last_clean":"2024-09-19T09:13:26.500092+0000","last_became_active":"2024-09-19T09:13:26.499730+0000","last_became_peered":"2024-09-19T09:13:26.499730+0000","last_unstale":"2024-09-19T09:13:26.500092+0000","last_undegraded":"2024-09-19T09:13:26.500092+0000","last_fullsized":"2024-09-19T09:13:26.500092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:48.658839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495849+0000","last_change":"2024-09-19T09:13:26.495849+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495849+0000","last_undegraded":"2024-09-19T09:13:26.495849+0000","last_fullsized":"2024-09-19T09:13:26.495849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.502099+0000","last_change":"2024-09-19T09:13:26.501792+0000","last_active":"2024-09-19T09:13:26.502099+0000","last_peered":"2024-09-19T09:13:26.502099+0000","last_clean":"2024-09-19T09:13:26.502099+0000","last_became_active":"2024-09-19T09:13:26.501463+0000","last_became_peered":"2024-09-19T09:13:26.501463+0000","last_unstale":"2024-09-19T09:13:26.502099+0000","last_undegraded":"2024-09-19T09:13:26.502099+0000","last_fullsized":"2024-09-19T09:13:26.502099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:26.102412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492101+0000","last_change":"2024-09-19T09:13:26.492101+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492101+0000","last_undegraded":"2024-09-19T09:13:26.492101+0000","last_fullsized":"2024-09-19T09:13:26.492101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.498160+0000","last_change":"2024-09-19T09:13:26.498042+0000","last_active":"2024-09-19T09:13:26.498160+0000","last_peered":"2024-09-19T09:13:26.498160+0000","last_clean":"2024-09-19T09:13:26.498160+0000","last_became_active":"2024-09-19T09:13:26.497811+0000","last_became_peered":"2024-09-19T09:13:26.497811+0000","last_unstale":"2024-09-19T09:13:26.498160+0000","last_undegraded":"2024-09-19T09:13:26.498160+0000","last_fullsized":"2024-09-19T09:13:26.498160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:55.846136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493939+0000","last_change":"2024-09-19T09:13:26.493939+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493939+0000","last_undegraded":"2024-09-19T09:13:26.493939+0000","last_fullsized":"2024-09-19T09:13:26.493939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.507135+0000","last_change":"2024-09-19T09:13:26.507022+0000","last_active":"2024-09-19T09:13:26.507135+0000","last_peered":"2024-09-19T09:13:26.507135+0000","last_clean":"2024-09-19T09:13:26.507135+0000","last_became_active":"2024-09-19T09:13:26.506756+0000","last_became_peered":"2024-09-19T09:13:26.506756+0000","last_unstale":"2024-09-19T09:13:26.507135+0000","last_undegraded":"2024-09-19T09:13:26.507135+0000","last_fullsized":"2024-09-19T09:13:26.507135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:25.794251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.502889+0000","last_change":"2024-09-19T09:13:26.502889+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.502889+0000","last_undegraded":"2024-09-19T09:13:26.502889+0000","last_fullsized":"2024-09-19T09:13:26.502889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506922+0000","last_change":"2024-09-19T09:13:26.506703+0000","last_active":"2024-09-19T09:13:26.506922+0000","last_peered":"2024-09-19T09:13:26.506922+0000","last_clean":"2024-09-19T09:13:26.506922+0000","last_became_active":"2024-09-19T09:13:26.506378+0000","last_became_peered":"2024-09-19T09:13:26.506378+0000","last_unstale":"2024-09-19T09:13:26.506922+0000","last_undegraded":"2024-09-19T09:13:26.506922+0000","last_fullsized":"2024-09-19T09:13:26.506922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:22.859672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493080+0000","last_change":"2024-09-19T09:13:26.493080+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493080+0000","last_undegraded":"2024-09-19T09:13:26.493080+0000","last_fullsized":"2024-09-19T09:13:26.493080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.499680+0000","last_change":"2024-09-19T09:13:26.499537+0000","last_active":"2024-09-19T09:13:26.499680+0000","last_peered":"2024-09-19T09:13:26.499680+0000","last_clean":"2024-09-19T09:13:26.499680+0000","last_became_active":"2024-09-19T09:13:26.499042+0000","last_became_peered":"2024-09-19T09:13:26.499042+0000","last_unstale":"2024-09-19T09:13:26.499680+0000","last_undegraded":"2024-09-19T09:13:26.499680+0000","last_fullsized":"2024-09-19T09:13:26.499680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:11.427700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.497773+0000","last_change":"2024-09-19T09:13:26.497773+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.497773+0000","last_undegraded":"2024-09-19T09:13:26.497773+0000","last_fullsized":"2024-09-19T09:13:26.497773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.504489+0000","last_change":"2024-09-19T09:13:26.504376+0000","last_active":"2024-09-19T09:13:26.504489+0000","last_peered":"2024-09-19T09:13:26.504489+0000","last_clean":"2024-09-19T09:13:26.504489+0000","last_became_active":"2024-09-19T09:13:26.504121+0000","last_became_peered":"2024-09-19T09:13:26.504121+0000","last_unstale":"2024-09-19T09:13:26.504489+0000","last_undegraded":"2024-09-19T09:13:26.504489+0000","last_fullsized":"2024-09-19T09:13:26.504489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:57.507184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495623+0000","last_change":"2024-09-19T09:13:26.495623+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495623+0000","last_undegraded":"2024-09-19T09:13:26.495623+0000","last_fullsized":"2024-09-19T09:13:26.495623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.501794+0000","last_change":"2024-09-19T09:13:26.501637+0000","last_active":"2024-09-19T09:13:26.501794+0000","last_peered":"2024-09-19T09:13:26.501794+0000","last_clean":"2024-09-19T09:13:26.501794+0000","last_became_active":"2024-09-19T09:13:26.501409+0000","last_became_peered":"2024-09-19T09:13:26.501409+0000","last_unstale":"2024-09-19T09:13:26.501794+0000","last_undegraded":"2024-09-19T09:13:26.501794+0000","last_fullsized":"2024-09-19T09:13:26.501794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:27.977582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492137+0000","last_change":"2024-09-19T09:13:26.492137+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492137+0000","last_undegraded":"2024-09-19T09:13:26.492137+0000","last_fullsized":"2024-09-19T09:13:26.492137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.504001+0000","last_change":"2024-09-19T09:13:26.503898+0000","last_active":"2024-09-19T09:13:26.504001+0000","last_peered":"2024-09-19T09:13:26.504001+0000","last_clean":"2024-09-19T09:13:26.504001+0000","last_became_active":"2024-09-19T09:13:26.503631+0000","last_became_peered":"2024-09-19T09:13:26.503631+0000","last_unstale":"2024-09-19T09:13:26.504001+0000","last_undegraded":"2024-09-19T09:13:26.504001+0000","last_fullsized":"2024-09-19T09:13:26.504001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:27.273078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492451+0000","last_change":"2024-09-19T09:13:26.492451+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492451+0000","last_undegraded":"2024-09-19T09:13:26.492451+0000","last_fullsized":"2024-09-19T09:13:26.492451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.502574+0000","last_change":"2024-09-19T09:13:26.502447+0000","last_active":"2024-09-19T09:13:26.502574+0000","last_peered":"2024-09-19T09:13:26.502574+0000","last_clean":"2024-09-19T09:13:26.502574+0000","last_became_active":"2024-09-19T09:13:26.501912+0000","last_became_peered":"2024-09-19T09:13:26.501912+0000","last_unstale":"2024-09-19T09:13:26.502574+0000","last_undegraded":"2024-09-19T09:13:26.502574+0000","last_fullsized":"2024-09-19T09:13:26.502574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:00.635615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.499236+0000","last_change":"2024-09-19T09:13:26.499236+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.499236+0000","last_undegraded":"2024-09-19T09:13:26.499236+0000","last_fullsized":"2024-09-19T09:13:26.499236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":166,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.496760+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:13:26.496760+0000","last_peered":"2024-09-19T09:13:26.496760+0000","last_clean":"2024-09-19T09:13:26.496760+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:13:26.496760+0000","last_undegraded":"2024-09-19T09:13:26.496760+0000","last_fullsized":"2024-09-19T09:13:26.496760+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:22.478151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506817+0000","last_change":"2024-09-19T09:13:26.506369+0000","last_active":"2024-09-19T09:13:26.506817+0000","last_peered":"2024-09-19T09:13:26.506817+0000","last_clean":"2024-09-19T09:13:26.506817+0000","last_became_active":"2024-09-19T09:13:26.506065+0000","last_became_peered":"2024-09-19T09:13:26.506065+0000","last_unstale":"2024-09-19T09:13:26.506817+0000","last_undegraded":"2024-09-19T09:13:26.506817+0000","last_fullsized":"2024-09-19T09:13:26.506817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:00.898726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492386+0000","last_change":"2024-09-19T09:13:26.492386+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492386+0000","last_undegraded":"2024-09-19T09:13:26.492386+0000","last_fullsized":"2024-09-19T09:13:26.492386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506263+0000","last_change":"2024-09-19T09:13:26.504928+0000","last_active":"2024-09-19T09:13:26.506263+0000","last_peered":"2024-09-19T09:13:26.506263+0000","last_clean":"2024-09-19T09:13:26.506263+0000","last_became_active":"2024-09-19T09:13:26.504649+0000","last_became_peered":"2024-09-19T09:13:26.504649+0000","last_unstale":"2024-09-19T09:13:26.506263+0000","last_undegraded":"2024-09-19T09:13:26.506263+0000","last_fullsized":"2024-09-19T09:13:26.506263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:26:04.073618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493391+0000","last_change":"2024-09-19T09:13:26.493391+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493391+0000","last_undegraded":"2024-09-19T09:13:26.493391+0000","last_fullsized":"2024-09-19T09:13:26.493391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.501636+0000","last_change":"2024-09-19T09:13:26.501526+0000","last_active":"2024-09-19T09:13:26.501636+0000","last_peered":"2024-09-19T09:13:26.501636+0000","last_clean":"2024-09-19T09:13:26.501636+0000","last_became_active":"2024-09-19T09:13:26.501281+0000","last_became_peered":"2024-09-19T09:13:26.501281+0000","last_unstale":"2024-09-19T09:13:26.501636+0000","last_undegraded":"2024-09-19T09:13:26.501636+0000","last_fullsized":"2024-09-19T09:13:26.501636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:50.647697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.496742+0000","last_change":"2024-09-19T09:13:26.496742+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.496742+0000","last_undegraded":"2024-09-19T09:13:26.496742+0000","last_fullsized":"2024-09-19T09:13:26.496742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506318+0000","last_change":"2024-09-19T09:13:26.505847+0000","last_active":"2024-09-19T09:13:26.506318+0000","last_peered":"2024-09-19T09:13:26.506318+0000","last_clean":"2024-09-19T09:13:26.506318+0000","last_became_active":"2024-09-19T09:13:26.505245+0000","last_became_peered":"2024-09-19T09:13:26.505245+0000","last_unstale":"2024-09-19T09:13:26.506318+0000","last_undegraded":"2024-09-19T09:13:26.506318+0000","last_fullsized":"2024-09-19T09:13:26.506318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:15.613040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492202+0000","last_change":"2024-09-19T09:13:26.492202+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492202+0000","last_undegraded":"2024-09-19T09:13:26.492202+0000","last_fullsized":"2024-09-19T09:13:26.492202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.503252+0000","last_change":"2024-09-19T09:13:26.502978+0000","last_active":"2024-09-19T09:13:26.503252+0000","last_peered":"2024-09-19T09:13:26.503252+0000","last_clean":"2024-09-19T09:13:26.503252+0000","last_became_active":"2024-09-19T09:13:26.502537+0000","last_became_peered":"2024-09-19T09:13:26.502537+0000","last_unstale":"2024-09-19T09:13:26.503252+0000","last_undegraded":"2024-09-19T09:13:26.503252+0000","last_fullsized":"2024-09-19T09:13:26.503252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:53.132531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494697+0000","last_change":"2024-09-19T09:13:26.494697+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494697+0000","last_undegraded":"2024-09-19T09:13:26.494697+0000","last_fullsized":"2024-09-19T09:13:26.494697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506298+0000","last_change":"2024-09-19T09:13:26.505476+0000","last_active":"2024-09-19T09:13:26.506298+0000","last_peered":"2024-09-19T09:13:26.506298+0000","last_clean":"2024-09-19T09:13:26.506298+0000","last_became_active":"2024-09-19T09:13:26.505190+0000","last_became_peered":"2024-09-19T09:13:26.505190+0000","last_unstale":"2024-09-19T09:13:26.506298+0000","last_undegraded":"2024-09-19T09:13:26.506298+0000","last_fullsized":"2024-09-19T09:13:26.506298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:23.182076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493530+0000","last_change":"2024-09-19T09:13:26.493530+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493530+0000","last_undegraded":"2024-09-19T09:13:26.493530+0000","last_fullsized":"2024-09-19T09:13:26.493530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.498483+0000","last_change":"2024-09-19T09:13:26.497706+0000","last_active":"2024-09-19T09:13:26.498483+0000","last_peered":"2024-09-19T09:13:26.498483+0000","last_clean":"2024-09-19T09:13:26.498483+0000","last_became_active":"2024-09-19T09:13:26.497446+0000","last_became_peered":"2024-09-19T09:13:26.497446+0000","last_unstale":"2024-09-19T09:13:26.498483+0000","last_undegraded":"2024-09-19T09:13:26.498483+0000","last_fullsized":"2024-09-19T09:13:26.498483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:03.360103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493180+0000","last_change":"2024-09-19T09:13:26.493180+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493180+0000","last_undegraded":"2024-09-19T09:13:26.493180+0000","last_fullsized":"2024-09-19T09:13:26.493180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506749+0000","last_change":"2024-09-19T09:13:26.506097+0000","last_active":"2024-09-19T09:13:26.506749+0000","last_peered":"2024-09-19T09:13:26.506749+0000","last_clean":"2024-09-19T09:13:26.506749+0000","last_became_active":"2024-09-19T09:13:26.505562+0000","last_became_peered":"2024-09-19T09:13:26.505562+0000","last_unstale":"2024-09-19T09:13:26.506749+0000","last_undegraded":"2024-09-19T09:13:26.506749+0000","last_fullsized":"2024-09-19T09:13:26.506749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:43.368123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492377+0000","last_change":"2024-09-19T09:13:26.492377+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492377+0000","last_undegraded":"2024-09-19T09:13:26.492377+0000","last_fullsized":"2024-09-19T09:13:26.492377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.503099+0000","last_change":"2024-09-19T09:13:26.501858+0000","last_active":"2024-09-19T09:13:26.503099+0000","last_peered":"2024-09-19T09:13:26.503099+0000","last_clean":"2024-09-19T09:13:26.503099+0000","last_became_active":"2024-09-19T09:13:26.501606+0000","last_became_peered":"2024-09-19T09:13:26.501606+0000","last_unstale":"2024-09-19T09:13:26.503099+0000","last_undegraded":"2024-09-19T09:13:26.503099+0000","last_fullsized":"2024-09-19T09:13:26.503099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:30.757320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.500926+0000","last_change":"2024-09-19T09:13:26.500926+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.500926+0000","last_undegraded":"2024-09-19T09:13:26.500926+0000","last_fullsized":"2024-09-19T09:13:26.500926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.498836+0000","last_change":"2024-09-19T09:13:26.498599+0000","last_active":"2024-09-19T09:13:26.498836+0000","last_peered":"2024-09-19T09:13:26.498836+0000","last_clean":"2024-09-19T09:13:26.498836+0000","last_became_active":"2024-09-19T09:13:26.498160+0000","last_became_peered":"2024-09-19T09:13:26.498160+0000","last_unstale":"2024-09-19T09:13:26.498836+0000","last_undegraded":"2024-09-19T09:13:26.498836+0000","last_fullsized":"2024-09-19T09:13:26.498836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:21.922199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494868+0000","last_change":"2024-09-19T09:13:26.494868+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494868+0000","last_undegraded":"2024-09-19T09:13:26.494868+0000","last_fullsized":"2024-09-19T09:13:26.494868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.503580+0000","last_change":"2024-09-19T09:13:26.503468+0000","last_active":"2024-09-19T09:13:26.503580+0000","last_peered":"2024-09-19T09:13:26.503580+0000","last_clean":"2024-09-19T09:13:26.503580+0000","last_became_active":"2024-09-19T09:13:26.503239+0000","last_became_peered":"2024-09-19T09:13:26.503239+0000","last_unstale":"2024-09-19T09:13:26.503580+0000","last_undegraded":"2024-09-19T09:13:26.503580+0000","last_fullsized":"2024-09-19T09:13:26.503580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:29.822493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.496063+0000","last_change":"2024-09-19T09:13:26.496063+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.496063+0000","last_undegraded":"2024-09-19T09:13:26.496063+0000","last_fullsized":"2024-09-19T09:13:26.496063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506335+0000","last_change":"2024-09-19T09:13:26.505929+0000","last_active":"2024-09-19T09:13:26.506335+0000","last_peered":"2024-09-19T09:13:26.506335+0000","last_clean":"2024-09-19T09:13:26.506335+0000","last_became_active":"2024-09-19T09:13:26.505267+0000","last_became_peered":"2024-09-19T09:13:26.505267+0000","last_unstale":"2024-09-19T09:13:26.506335+0000","last_undegraded":"2024-09-19T09:13:26.506335+0000","last_fullsized":"2024-09-19T09:13:26.506335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:42.609549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495443+0000","last_change":"2024-09-19T09:13:26.495443+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495443+0000","last_undegraded":"2024-09-19T09:13:26.495443+0000","last_fullsized":"2024-09-19T09:13:26.495443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.503380+0000","last_change":"2024-09-19T09:13:26.503380+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.503380+0000","last_undegraded":"2024-09-19T09:13:26.503380+0000","last_fullsized":"2024-09-19T09:13:26.503380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.498504+0000","last_change":"2024-09-19T09:13:26.498383+0000","last_active":"2024-09-19T09:13:26.498504+0000","last_peered":"2024-09-19T09:13:26.498504+0000","last_clean":"2024-09-19T09:13:26.498504+0000","last_became_active":"2024-09-19T09:13:26.498142+0000","last_became_peered":"2024-09-19T09:13:26.498142+0000","last_unstale":"2024-09-19T09:13:26.498504+0000","last_undegraded":"2024-09-19T09:13:26.498504+0000","last_fullsized":"2024-09-19T09:13:26.498504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:43.668821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494803+0000","last_change":"2024-09-19T09:13:26.494803+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494803+0000","last_undegraded":"2024-09-19T09:13:26.494803+0000","last_fullsized":"2024-09-19T09:13:26.494803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.498086+0000","last_change":"2024-09-19T09:13:26.497950+0000","last_active":"2024-09-19T09:13:26.498086+0000","last_peered":"2024-09-19T09:13:26.498086+0000","last_clean":"2024-09-19T09:13:26.498086+0000","last_became_active":"2024-09-19T09:13:26.497689+0000","last_became_peered":"2024-09-19T09:13:26.497689+0000","last_unstale":"2024-09-19T09:13:26.498086+0000","last_undegraded":"2024-09-19T09:13:26.498086+0000","last_fullsized":"2024-09-19T09:13:26.498086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:20.181354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494931+0000","last_change":"2024-09-19T09:13:26.494931+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494931+0000","last_undegraded":"2024-09-19T09:13:26.494931+0000","last_fullsized":"2024-09-19T09:13:26.494931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.503229+0000","last_change":"2024-09-19T09:13:26.502836+0000","last_active":"2024-09-19T09:13:26.503229+0000","last_peered":"2024-09-19T09:13:26.503229+0000","last_clean":"2024-09-19T09:13:26.503229+0000","last_became_active":"2024-09-19T09:13:26.501995+0000","last_became_peered":"2024-09-19T09:13:26.501995+0000","last_unstale":"2024-09-19T09:13:26.503229+0000","last_undegraded":"2024-09-19T09:13:26.503229+0000","last_fullsized":"2024-09-19T09:13:26.503229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:18.350158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.497184+0000","last_change":"2024-09-19T09:13:26.497184+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.497184+0000","last_undegraded":"2024-09-19T09:13:26.497184+0000","last_fullsized":"2024-09-19T09:13:26.497184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506962+0000","last_change":"2024-09-19T09:13:26.506856+0000","last_active":"2024-09-19T09:13:26.506962+0000","last_peered":"2024-09-19T09:13:26.506962+0000","last_clean":"2024-09-19T09:13:26.506962+0000","last_became_active":"2024-09-19T09:13:26.506714+0000","last_became_peered":"2024-09-19T09:13:26.506714+0000","last_unstale":"2024-09-19T09:13:26.506962+0000","last_undegraded":"2024-09-19T09:13:26.506962+0000","last_fullsized":"2024-09-19T09:13:26.506962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:18.256167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":60,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195251,"statfs":{"total":200000000,"available":199937630,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194681,"statfs":{"total":200000000,"available":199353537,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":60,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195251,"statfs":{"total":200000000,"available":199937630,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194681,"statfs":{"total":200000000,"available":199353537,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:13:30.485 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:13:30.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.623+0000 7fb98a13b640 1 Processor -- start 2024-09-19T09:13:30.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.623+0000 7fb98a13b640 1 -- start start 2024-09-19T09:13:30.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.624+0000 7fb98a13b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb9840d1c70 0x7fb9840cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:30.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.624+0000 7fb98a13b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9840b5b00 0x7fb9840cff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:30.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.624+0000 7fb98a13b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9840d31b0 con 0x7fb98415ed50 2024-09-19T09:13:30.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.624+0000 7fb98a13b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb9840d3490 con 0x7fb9840d1c70 2024-09-19T09:13:30.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.624+0000 7fb98a13b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb9840d3770 con 0x7fb9840b5b00 2024-09-19T09:13:30.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.624+0000 7fb983fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9840b5b00 0x7fb9840cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:30.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.624+0000 7fb983fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9840b5b00 0x7fb9840cff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:49882/0 (socket says 172.21.15.18:49882) 2024-09-19T09:13:30.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.624+0000 7fb983fff640 1 -- 172.21.15.18:0/423485736 learned_addr learned my addr 172.21.15.18:0/423485736 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:30.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.624+0000 7fb982ffd640 1 --2- 172.21.15.18:0/423485736 >> v2:172.21.15.162:3300/0 conn(0x7fb9840d1c70 0x7fb9840cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:30.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.625+0000 7fb983fff640 1 -- 172.21.15.18:0/423485736 >> v2:172.21.15.162:3300/0 conn(0x7fb9840d1c70 msgr2=0x7fb9840cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:30.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.625+0000 7fb983fff640 1 --2- 172.21.15.18:0/423485736 >> v2:172.21.15.162:3300/0 conn(0x7fb9840d1c70 0x7fb9840cf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.625+0000 7fb983fff640 1 -- 172.21.15.18:0/423485736 >> v1:172.21.15.162:6789/0 conn(0x7fb98415ed50 legacy=0x7fb9840d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:30.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.625+0000 7fb9827fc640 1 -- 172.21.15.18:0/423485736 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1080608168 0 0) 0x7fb9840d31b0 con 0x7fb98415ed50 2024-09-19T09:13:30.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.625+0000 7fb983fff640 1 -- 172.21.15.18:0/423485736 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9840d3a50 con 0x7fb9840b5b00 2024-09-19T09:13:30.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.625+0000 7fb983fff640 1 --2- 172.21.15.18:0/423485736 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9840b5b00 0x7fb9840cff00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb97c009e50 tx=0x7fb97c02a7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fc747c649560730 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:30.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.626+0000 7fb9827fc640 1 -- 172.21.15.18:0/423485736 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c036070 con 0x7fb9840b5b00 2024-09-19T09:13:30.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.626+0000 7fb9827fc640 1 -- 172.21.15.18:0/423485736 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb97c031600 con 0x7fb9840b5b00 2024-09-19T09:13:30.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.626+0000 7fb9827fc640 1 -- 172.21.15.18:0/423485736 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97c0319d0 con 0x7fb9840b5b00 2024-09-19T09:13:30.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.626+0000 7fb98a13b640 1 -- 172.21.15.18:0/423485736 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9840b5b00 msgr2=0x7fb9840cff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:30.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.626+0000 7fb98a13b640 1 --2- 172.21.15.18:0/423485736 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9840b5b00 0x7fb9840cff00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb97c009e50 tx=0x7fb97c02a7a0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.626+0000 7fb98a13b640 1 -- 172.21.15.18:0/423485736 shutdown_connections 2024-09-19T09:13:30.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.626+0000 7fb98a13b640 1 --2- 172.21.15.18:0/423485736 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9840b5b00 0x7fb9840cff00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.626+0000 7fb98a13b640 1 --2- 172.21.15.18:0/423485736 >> v2:172.21.15.162:3300/0 conn(0x7fb9840d1c70 0x7fb9840cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.626+0000 7fb98a13b640 1 -- 172.21.15.18:0/423485736 >> 172.21.15.18:0/423485736 conn(0x7fb9840d4bd0 msgr2=0x7fb9840d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:30.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.626+0000 7fb98a13b640 1 -- 172.21.15.18:0/423485736 shutdown_connections 2024-09-19T09:13:30.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.626+0000 7fb98a13b640 1 -- 172.21.15.18:0/423485736 wait complete. 2024-09-19T09:13:30.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.627+0000 7fb98a13b640 1 Processor -- start 2024-09-19T09:13:30.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.628+0000 7fb98a13b640 1 -- start start 2024-09-19T09:13:30.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.628+0000 7fb98a13b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9840b5b00 0x7fb9841f3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:30.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.628+0000 7fb98a13b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9840d1c70 0x7fb9841617a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:30.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.628+0000 7fb98a13b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb98415ed50 0x7fb984161ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:30.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.628+0000 7fb98a13b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb98415f130 con 0x7fb9840d1c70 2024-09-19T09:13:30.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.628+0000 7fb98a13b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb9840d3d30 con 0x7fb98415ed50 2024-09-19T09:13:30.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.628+0000 7fb98a13b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb9841600c0 con 0x7fb9840b5b00 2024-09-19T09:13:30.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.628+0000 7fb982ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9840d1c70 0x7fb9841617a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:30.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.628+0000 7fb982ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9840d1c70 0x7fb9841617a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57076/0 (socket says 172.21.15.18:57076) 2024-09-19T09:13:30.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.628+0000 7fb982ffd640 1 -- 172.21.15.18:0/3407293651 learned_addr learned my addr 172.21.15.18:0/3407293651 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:30.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.628+0000 7fb983fff640 1 --2- 172.21.15.18:0/3407293651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb98415ed50 0x7fb984161ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:30.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.629+0000 7fb9837fe640 1 --2- 172.21.15.18:0/3407293651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9840b5b00 0x7fb9841f3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:30.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.629+0000 7fb982ffd640 1 -- 172.21.15.18:0/3407293651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9840b5b00 msgr2=0x7fb9841f3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:30.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.629+0000 7fb982ffd640 1 --2- 172.21.15.18:0/3407293651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9840b5b00 0x7fb9841f3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.629+0000 7fb982ffd640 1 -- 172.21.15.18:0/3407293651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb98415ed50 msgr2=0x7fb984161ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:30.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.629+0000 7fb982ffd640 1 --2- 172.21.15.18:0/3407293651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb98415ed50 0x7fb984161ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.629+0000 7fb982ffd640 1 -- 172.21.15.18:0/3407293651 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9841603a0 con 0x7fb9840d1c70 2024-09-19T09:13:30.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.629+0000 7fb982ffd640 1 --2- 172.21.15.18:0/3407293651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9840d1c70 0x7fb9841617a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb97800e9b0 tx=0x7fb97800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:30.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.629+0000 7fb96bfff640 1 -- 172.21.15.18:0/3407293651 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb978017070 con 0x7fb9840d1c70 2024-09-19T09:13:30.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.629+0000 7fb96bfff640 1 -- 172.21.15.18:0/3407293651 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb97800c9a0 con 0x7fb9840d1c70 2024-09-19T09:13:30.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.629+0000 7fb96bfff640 1 -- 172.21.15.18:0/3407293651 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97800cd90 con 0x7fb9840d1c70 2024-09-19T09:13:30.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.629+0000 7fb98a13b640 1 -- 172.21.15.18:0/3407293651 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb984160680 con 0x7fb9840d1c70 2024-09-19T09:13:30.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.629+0000 7fb98a13b640 1 -- 172.21.15.18:0/3407293651 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb984160c40 con 0x7fb9840d1c70 2024-09-19T09:13:30.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.630+0000 7fb98a13b640 1 -- 172.21.15.18:0/3407293651 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9840d2270 con 0x7fb9840d1c70 2024-09-19T09:13:30.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.631+0000 7fb96bfff640 1 -- 172.21.15.18:0/3407293651 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb97801a070 con 0x7fb9840d1c70 2024-09-19T09:13:30.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.631+0000 7fb96bfff640 1 --2- 172.21.15.18:0/3407293651 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb97006c2e0 0x7fb97006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:30.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.631+0000 7fb96bfff640 1 -- 172.21.15.18:0/3407293651 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb97808b670 con 0x7fb9840d1c70 2024-09-19T09:13:30.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.631+0000 7fb9837fe640 1 --2- 172.21.15.18:0/3407293651 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb97006c2e0 0x7fb97006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:30.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.632+0000 7fb9837fe640 1 --2- 172.21.15.18:0/3407293651 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb97006c2e0 0x7fb97006e7a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb974000f60 tx=0x7fb974009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:30.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.635+0000 7fb96bfff640 1 -- 172.21.15.18:0/3407293651 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb978059820 con 0x7fb9840d1c70 2024-09-19T09:13:30.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.806+0000 7fb98a13b640 1 -- 172.21.15.18:0/3407293651 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb984075500 con 0x7fb97006c2e0 2024-09-19T09:13:30.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.812+0000 7fb96bfff640 1 -- 172.21.15.18:0/3407293651 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242209 (secure 0 0 0) 0x7fb984075500 con 0x7fb97006c2e0 2024-09-19T09:13:30.815 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:30.816 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:13:30.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.815+0000 7fb98a13b640 1 -- 172.21.15.18:0/3407293651 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb97006c2e0 msgr2=0x7fb97006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:30.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.815+0000 7fb98a13b640 1 --2- 172.21.15.18:0/3407293651 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb97006c2e0 0x7fb97006e7a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb974000f60 tx=0x7fb974009040 comp rx=0 tx=0).stop 2024-09-19T09:13:30.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.815+0000 7fb98a13b640 1 -- 172.21.15.18:0/3407293651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9840d1c70 msgr2=0x7fb9841617a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:30.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.815+0000 7fb98a13b640 1 --2- 172.21.15.18:0/3407293651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9840d1c70 0x7fb9841617a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb97800e9b0 tx=0x7fb97800ee70 comp rx=0 tx=0).stop 2024-09-19T09:13:30.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.815+0000 7fb98a13b640 1 -- 172.21.15.18:0/3407293651 shutdown_connections 2024-09-19T09:13:30.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.815+0000 7fb98a13b640 1 --2- 172.21.15.18:0/3407293651 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb97006c2e0 0x7fb97006e7a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.815+0000 7fb98a13b640 1 --2- 172.21.15.18:0/3407293651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb98415ed50 0x7fb984161ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.815+0000 7fb98a13b640 1 --2- 172.21.15.18:0/3407293651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9840d1c70 0x7fb9841617a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.815+0000 7fb98a13b640 1 --2- 172.21.15.18:0/3407293651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9840b5b00 0x7fb9841f3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.815+0000 7fb98a13b640 1 -- 172.21.15.18:0/3407293651 >> 172.21.15.18:0/3407293651 conn(0x7fb9840d4bd0 msgr2=0x7fb98406c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:30.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.815+0000 7fb98a13b640 1 -- 172.21.15.18:0/3407293651 shutdown_connections 2024-09-19T09:13:30.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.815+0000 7fb98a13b640 1 -- 172.21.15.18:0/3407293651 wait complete. 2024-09-19T09:13:30.826 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-19T09:13:29.522390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1603,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560896,"statfs":{"total":1600000000,"available":1598357954,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.039671"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493236+0000","last_change":"2024-09-19T09:13:26.493236+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493236+0000","last_undegraded":"2024-09-19T09:13:26.493236+0000","last_fullsized":"2024-09-19T09:13:26.493236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.496430+0000","last_change":"2024-09-19T09:13:26.496430+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.496430+0000","last_undegraded":"2024-09-19T09:13:26.496430+0000","last_fullsized":"2024-09-19T09:13:26.496430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495677+0000","last_change":"2024-09-19T09:13:26.495677+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495677+0000","last_undegraded":"2024-09-19T09:13:26.495677+0000","last_fullsized":"2024-09-19T09:13:26.495677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495028+0000","last_change":"2024-09-19T09:13:26.495028+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495028+0000","last_undegraded":"2024-09-19T09:13:26.495028+0000","last_fullsized":"2024-09-19T09:13:26.495028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493323+0000","last_change":"2024-09-19T09:13:26.493323+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493323+0000","last_undegraded":"2024-09-19T09:13:26.493323+0000","last_fullsized":"2024-09-19T09:13:26.493323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.498629+0000","last_change":"2024-09-19T09:13:26.498629+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.498629+0000","last_undegraded":"2024-09-19T09:13:26.498629+0000","last_fullsized":"2024-09-19T09:13:26.498629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493313+0000","last_change":"2024-09-19T09:13:26.493313+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493313+0000","last_undegraded":"2024-09-19T09:13:26.493313+0000","last_fullsized":"2024-09-19T09:13:26.493313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495284+0000","last_change":"2024-09-19T09:13:26.495284+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495284+0000","last_undegraded":"2024-09-19T09:13:26.495284+0000","last_fullsized":"2024-09-19T09:13:26.495284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493039+0000","last_change":"2024-09-19T09:13:26.493039+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493039+0000","last_undegraded":"2024-09-19T09:13:26.493039+0000","last_fullsized":"2024-09-19T09:13:26.493039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492910+0000","last_change":"2024-09-19T09:13:26.492910+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492910+0000","last_undegraded":"2024-09-19T09:13:26.492910+0000","last_fullsized":"2024-09-19T09:13:26.492910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492691+0000","last_change":"2024-09-19T09:13:26.492691+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492691+0000","last_undegraded":"2024-09-19T09:13:26.492691+0000","last_fullsized":"2024-09-19T09:13:26.492691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492910+0000","last_change":"2024-09-19T09:13:26.492910+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492910+0000","last_undegraded":"2024-09-19T09:13:26.492910+0000","last_fullsized":"2024-09-19T09:13:26.492910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494922+0000","last_change":"2024-09-19T09:13:26.494922+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494922+0000","last_undegraded":"2024-09-19T09:13:26.494922+0000","last_fullsized":"2024-09-19T09:13:26.494922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494340+0000","last_change":"2024-09-19T09:13:26.494340+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494340+0000","last_undegraded":"2024-09-19T09:13:26.494340+0000","last_fullsized":"2024-09-19T09:13:26.494340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.499204+0000","last_change":"2024-09-19T09:13:26.499204+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.499204+0000","last_undegraded":"2024-09-19T09:13:26.499204+0000","last_fullsized":"2024-09-19T09:13:26.499204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.499867+0000","last_change":"2024-09-19T09:13:26.499867+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.499867+0000","last_undegraded":"2024-09-19T09:13:26.499867+0000","last_fullsized":"2024-09-19T09:13:26.499867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.498092+0000","last_change":"2024-09-19T09:13:26.498092+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.498092+0000","last_undegraded":"2024-09-19T09:13:26.498092+0000","last_fullsized":"2024-09-19T09:13:26.498092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.496381+0000","last_change":"2024-09-19T09:13:26.496381+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.496381+0000","last_undegraded":"2024-09-19T09:13:26.496381+0000","last_fullsized":"2024-09-19T09:13:26.496381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494819+0000","last_change":"2024-09-19T09:13:26.494819+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494819+0000","last_undegraded":"2024-09-19T09:13:26.494819+0000","last_fullsized":"2024-09-19T09:13:26.494819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492532+0000","last_change":"2024-09-19T09:13:26.492532+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492532+0000","last_undegraded":"2024-09-19T09:13:26.492532+0000","last_fullsized":"2024-09-19T09:13:26.492532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.498133+0000","last_change":"2024-09-19T09:13:26.498133+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.498133+0000","last_undegraded":"2024-09-19T09:13:26.498133+0000","last_fullsized":"2024-09-19T09:13:26.498133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494421+0000","last_change":"2024-09-19T09:13:26.494421+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494421+0000","last_undegraded":"2024-09-19T09:13:26.494421+0000","last_fullsized":"2024-09-19T09:13:26.494421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494445+0000","last_change":"2024-09-19T09:13:26.494445+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494445+0000","last_undegraded":"2024-09-19T09:13:26.494445+0000","last_fullsized":"2024-09-19T09:13:26.494445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.496247+0000","last_change":"2024-09-19T09:13:26.496247+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.496247+0000","last_undegraded":"2024-09-19T09:13:26.496247+0000","last_fullsized":"2024-09-19T09:13:26.496247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.498759+0000","last_change":"2024-09-19T09:13:26.498759+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.498759+0000","last_undegraded":"2024-09-19T09:13:26.498759+0000","last_fullsized":"2024-09-19T09:13:26.498759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.497481+0000","last_change":"2024-09-19T09:13:26.497481+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.497481+0000","last_undegraded":"2024-09-19T09:13:26.497481+0000","last_fullsized":"2024-09-19T09:13:26.497481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494439+0000","last_change":"2024-09-19T09:13:26.494439+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494439+0000","last_undegraded":"2024-09-19T09:13:26.494439+0000","last_fullsized":"2024-09-19T09:13:26.494439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494550+0000","last_change":"2024-09-19T09:13:26.494550+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494550+0000","last_undegraded":"2024-09-19T09:13:26.494550+0000","last_fullsized":"2024-09-19T09:13:26.494550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.498239+0000","last_change":"2024-09-19T09:13:26.498239+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.498239+0000","last_undegraded":"2024-09-19T09:13:26.498239+0000","last_fullsized":"2024-09-19T09:13:26.498239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.503713+0000","last_change":"2024-09-19T09:13:26.503713+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.503713+0000","last_undegraded":"2024-09-19T09:13:26.503713+0000","last_fullsized":"2024-09-19T09:13:26.503713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493598+0000","last_change":"2024-09-19T09:13:26.493598+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493598+0000","last_undegraded":"2024-09-19T09:13:26.493598+0000","last_fullsized":"2024-09-19T09:13:26.493598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495036+0000","last_change":"2024-09-19T09:13:26.495036+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495036+0000","last_undegraded":"2024-09-19T09:13:26.495036+0000","last_fullsized":"2024-09-19T09:13:26.495036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494836+0000","last_change":"2024-09-19T09:13:26.494836+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494836+0000","last_undegraded":"2024-09-19T09:13:26.494836+0000","last_fullsized":"2024-09-19T09:13:26.494836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.503270+0000","last_change":"2024-09-19T09:13:26.503044+0000","last_active":"2024-09-19T09:13:26.503270+0000","last_peered":"2024-09-19T09:13:26.503270+0000","last_clean":"2024-09-19T09:13:26.503270+0000","last_became_active":"2024-09-19T09:13:26.502787+0000","last_became_peered":"2024-09-19T09:13:26.502787+0000","last_unstale":"2024-09-19T09:13:26.503270+0000","last_undegraded":"2024-09-19T09:13:26.503270+0000","last_fullsized":"2024-09-19T09:13:26.503270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:24.518221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494050+0000","last_change":"2024-09-19T09:13:26.494050+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494050+0000","last_undegraded":"2024-09-19T09:13:26.494050+0000","last_fullsized":"2024-09-19T09:13:26.494050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506840+0000","last_change":"2024-09-19T09:13:26.506712+0000","last_active":"2024-09-19T09:13:26.506840+0000","last_peered":"2024-09-19T09:13:26.506840+0000","last_clean":"2024-09-19T09:13:26.506840+0000","last_became_active":"2024-09-19T09:13:26.506244+0000","last_became_peered":"2024-09-19T09:13:26.506244+0000","last_unstale":"2024-09-19T09:13:26.506840+0000","last_undegraded":"2024-09-19T09:13:26.506840+0000","last_fullsized":"2024-09-19T09:13:26.506840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:22.213563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.505747+0000","last_change":"2024-09-19T09:13:26.505620+0000","last_active":"2024-09-19T09:13:26.505747+0000","last_peered":"2024-09-19T09:13:26.505747+0000","last_clean":"2024-09-19T09:13:26.505747+0000","last_became_active":"2024-09-19T09:13:26.505383+0000","last_became_peered":"2024-09-19T09:13:26.505383+0000","last_unstale":"2024-09-19T09:13:26.505747+0000","last_undegraded":"2024-09-19T09:13:26.505747+0000","last_fullsized":"2024-09-19T09:13:26.505747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:28.390700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.496738+0000","last_change":"2024-09-19T09:13:26.496738+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.496738+0000","last_undegraded":"2024-09-19T09:13:26.496738+0000","last_fullsized":"2024-09-19T09:13:26.496738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.507154+0000","last_change":"2024-09-19T09:13:26.507051+0000","last_active":"2024-09-19T09:13:26.507154+0000","last_peered":"2024-09-19T09:13:26.507154+0000","last_clean":"2024-09-19T09:13:26.507154+0000","last_became_active":"2024-09-19T09:13:26.506557+0000","last_became_peered":"2024-09-19T09:13:26.506557+0000","last_unstale":"2024-09-19T09:13:26.507154+0000","last_undegraded":"2024-09-19T09:13:26.507154+0000","last_fullsized":"2024-09-19T09:13:26.507154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:46.168867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495107+0000","last_change":"2024-09-19T09:13:26.495107+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495107+0000","last_undegraded":"2024-09-19T09:13:26.495107+0000","last_fullsized":"2024-09-19T09:13:26.495107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.501169+0000","last_change":"2024-09-19T09:13:26.501053+0000","last_active":"2024-09-19T09:13:26.501169+0000","last_peered":"2024-09-19T09:13:26.501169+0000","last_clean":"2024-09-19T09:13:26.501169+0000","last_became_active":"2024-09-19T09:13:26.500814+0000","last_became_peered":"2024-09-19T09:13:26.500814+0000","last_unstale":"2024-09-19T09:13:26.501169+0000","last_undegraded":"2024-09-19T09:13:26.501169+0000","last_fullsized":"2024-09-19T09:13:26.501169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:28.680916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494618+0000","last_change":"2024-09-19T09:13:26.494618+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494618+0000","last_undegraded":"2024-09-19T09:13:26.494618+0000","last_fullsized":"2024-09-19T09:13:26.494618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.499090+0000","last_change":"2024-09-19T09:13:26.498971+0000","last_active":"2024-09-19T09:13:26.499090+0000","last_peered":"2024-09-19T09:13:26.499090+0000","last_clean":"2024-09-19T09:13:26.499090+0000","last_became_active":"2024-09-19T09:13:26.498737+0000","last_became_peered":"2024-09-19T09:13:26.498737+0000","last_unstale":"2024-09-19T09:13:26.499090+0000","last_undegraded":"2024-09-19T09:13:26.499090+0000","last_fullsized":"2024-09-19T09:13:26.499090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:38.734255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.497312+0000","last_change":"2024-09-19T09:13:26.497312+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.497312+0000","last_undegraded":"2024-09-19T09:13:26.497312+0000","last_fullsized":"2024-09-19T09:13:26.497312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.500092+0000","last_change":"2024-09-19T09:13:26.499983+0000","last_active":"2024-09-19T09:13:26.500092+0000","last_peered":"2024-09-19T09:13:26.500092+0000","last_clean":"2024-09-19T09:13:26.500092+0000","last_became_active":"2024-09-19T09:13:26.499730+0000","last_became_peered":"2024-09-19T09:13:26.499730+0000","last_unstale":"2024-09-19T09:13:26.500092+0000","last_undegraded":"2024-09-19T09:13:26.500092+0000","last_fullsized":"2024-09-19T09:13:26.500092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:48.658839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495849+0000","last_change":"2024-09-19T09:13:26.495849+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495849+0000","last_undegraded":"2024-09-19T09:13:26.495849+0000","last_fullsized":"2024-09-19T09:13:26.495849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.502099+0000","last_change":"2024-09-19T09:13:26.501792+0000","last_active":"2024-09-19T09:13:26.502099+0000","last_peered":"2024-09-19T09:13:26.502099+0000","last_clean":"2024-09-19T09:13:26.502099+0000","last_became_active":"2024-09-19T09:13:26.501463+0000","last_became_peered":"2024-09-19T09:13:26.501463+0000","last_unstale":"2024-09-19T09:13:26.502099+0000","last_undegraded":"2024-09-19T09:13:26.502099+0000","last_fullsized":"2024-09-19T09:13:26.502099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:26.102412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492101+0000","last_change":"2024-09-19T09:13:26.492101+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492101+0000","last_undegraded":"2024-09-19T09:13:26.492101+0000","last_fullsized":"2024-09-19T09:13:26.492101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.498160+0000","last_change":"2024-09-19T09:13:26.498042+0000","last_active":"2024-09-19T09:13:26.498160+0000","last_peered":"2024-09-19T09:13:26.498160+0000","last_clean":"2024-09-19T09:13:26.498160+0000","last_became_active":"2024-09-19T09:13:26.497811+0000","last_became_peered":"2024-09-19T09:13:26.497811+0000","last_unstale":"2024-09-19T09:13:26.498160+0000","last_undegraded":"2024-09-19T09:13:26.498160+0000","last_fullsized":"2024-09-19T09:13:26.498160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:55.846136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493939+0000","last_change":"2024-09-19T09:13:26.493939+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493939+0000","last_undegraded":"2024-09-19T09:13:26.493939+0000","last_fullsized":"2024-09-19T09:13:26.493939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.507135+0000","last_change":"2024-09-19T09:13:26.507022+0000","last_active":"2024-09-19T09:13:26.507135+0000","last_peered":"2024-09-19T09:13:26.507135+0000","last_clean":"2024-09-19T09:13:26.507135+0000","last_became_active":"2024-09-19T09:13:26.506756+0000","last_became_peered":"2024-09-19T09:13:26.506756+0000","last_unstale":"2024-09-19T09:13:26.507135+0000","last_undegraded":"2024-09-19T09:13:26.507135+0000","last_fullsized":"2024-09-19T09:13:26.507135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:25.794251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.502889+0000","last_change":"2024-09-19T09:13:26.502889+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.502889+0000","last_undegraded":"2024-09-19T09:13:26.502889+0000","last_fullsized":"2024-09-19T09:13:26.502889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506922+0000","last_change":"2024-09-19T09:13:26.506703+0000","last_active":"2024-09-19T09:13:26.506922+0000","last_peered":"2024-09-19T09:13:26.506922+0000","last_clean":"2024-09-19T09:13:26.506922+0000","last_became_active":"2024-09-19T09:13:26.506378+0000","last_became_peered":"2024-09-19T09:13:26.506378+0000","last_unstale":"2024-09-19T09:13:26.506922+0000","last_undegraded":"2024-09-19T09:13:26.506922+0000","last_fullsized":"2024-09-19T09:13:26.506922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:22.859672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493080+0000","last_change":"2024-09-19T09:13:26.493080+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493080+0000","last_undegraded":"2024-09-19T09:13:26.493080+0000","last_fullsized":"2024-09-19T09:13:26.493080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.499680+0000","last_change":"2024-09-19T09:13:26.499537+0000","last_active":"2024-09-19T09:13:26.499680+0000","last_peered":"2024-09-19T09:13:26.499680+0000","last_clean":"2024-09-19T09:13:26.499680+0000","last_became_active":"2024-09-19T09:13:26.499042+0000","last_became_peered":"2024-09-19T09:13:26.499042+0000","last_unstale":"2024-09-19T09:13:26.499680+0000","last_undegraded":"2024-09-19T09:13:26.499680+0000","last_fullsized":"2024-09-19T09:13:26.499680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:11.427700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.497773+0000","last_change":"2024-09-19T09:13:26.497773+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.497773+0000","last_undegraded":"2024-09-19T09:13:26.497773+0000","last_fullsized":"2024-09-19T09:13:26.497773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.504489+0000","last_change":"2024-09-19T09:13:26.504376+0000","last_active":"2024-09-19T09:13:26.504489+0000","last_peered":"2024-09-19T09:13:26.504489+0000","last_clean":"2024-09-19T09:13:26.504489+0000","last_became_active":"2024-09-19T09:13:26.504121+0000","last_became_peered":"2024-09-19T09:13:26.504121+0000","last_unstale":"2024-09-19T09:13:26.504489+0000","last_undegraded":"2024-09-19T09:13:26.504489+0000","last_fullsized":"2024-09-19T09:13:26.504489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:57.507184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495623+0000","last_change":"2024-09-19T09:13:26.495623+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495623+0000","last_undegraded":"2024-09-19T09:13:26.495623+0000","last_fullsized":"2024-09-19T09:13:26.495623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.501794+0000","last_change":"2024-09-19T09:13:26.501637+0000","last_active":"2024-09-19T09:13:26.501794+0000","last_peered":"2024-09-19T09:13:26.501794+0000","last_clean":"2024-09-19T09:13:26.501794+0000","last_became_active":"2024-09-19T09:13:26.501409+0000","last_became_peered":"2024-09-19T09:13:26.501409+0000","last_unstale":"2024-09-19T09:13:26.501794+0000","last_undegraded":"2024-09-19T09:13:26.501794+0000","last_fullsized":"2024-09-19T09:13:26.501794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:27.977582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492137+0000","last_change":"2024-09-19T09:13:26.492137+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492137+0000","last_undegraded":"2024-09-19T09:13:26.492137+0000","last_fullsized":"2024-09-19T09:13:26.492137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.504001+0000","last_change":"2024-09-19T09:13:26.503898+0000","last_active":"2024-09-19T09:13:26.504001+0000","last_peered":"2024-09-19T09:13:26.504001+0000","last_clean":"2024-09-19T09:13:26.504001+0000","last_became_active":"2024-09-19T09:13:26.503631+0000","last_became_peered":"2024-09-19T09:13:26.503631+0000","last_unstale":"2024-09-19T09:13:26.504001+0000","last_undegraded":"2024-09-19T09:13:26.504001+0000","last_fullsized":"2024-09-19T09:13:26.504001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:27.273078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492451+0000","last_change":"2024-09-19T09:13:26.492451+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492451+0000","last_undegraded":"2024-09-19T09:13:26.492451+0000","last_fullsized":"2024-09-19T09:13:26.492451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.502574+0000","last_change":"2024-09-19T09:13:26.502447+0000","last_active":"2024-09-19T09:13:26.502574+0000","last_peered":"2024-09-19T09:13:26.502574+0000","last_clean":"2024-09-19T09:13:26.502574+0000","last_became_active":"2024-09-19T09:13:26.501912+0000","last_became_peered":"2024-09-19T09:13:26.501912+0000","last_unstale":"2024-09-19T09:13:26.502574+0000","last_undegraded":"2024-09-19T09:13:26.502574+0000","last_fullsized":"2024-09-19T09:13:26.502574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:00.635615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.499236+0000","last_change":"2024-09-19T09:13:26.499236+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.499236+0000","last_undegraded":"2024-09-19T09:13:26.499236+0000","last_fullsized":"2024-09-19T09:13:26.499236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":166,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.496760+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:13:26.496760+0000","last_peered":"2024-09-19T09:13:26.496760+0000","last_clean":"2024-09-19T09:13:26.496760+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:13:26.496760+0000","last_undegraded":"2024-09-19T09:13:26.496760+0000","last_fullsized":"2024-09-19T09:13:26.496760+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:22.478151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506817+0000","last_change":"2024-09-19T09:13:26.506369+0000","last_active":"2024-09-19T09:13:26.506817+0000","last_peered":"2024-09-19T09:13:26.506817+0000","last_clean":"2024-09-19T09:13:26.506817+0000","last_became_active":"2024-09-19T09:13:26.506065+0000","last_became_peered":"2024-09-19T09:13:26.506065+0000","last_unstale":"2024-09-19T09:13:26.506817+0000","last_undegraded":"2024-09-19T09:13:26.506817+0000","last_fullsized":"2024-09-19T09:13:26.506817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:00.898726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492386+0000","last_change":"2024-09-19T09:13:26.492386+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492386+0000","last_undegraded":"2024-09-19T09:13:26.492386+0000","last_fullsized":"2024-09-19T09:13:26.492386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506263+0000","last_change":"2024-09-19T09:13:26.504928+0000","last_active":"2024-09-19T09:13:26.506263+0000","last_peered":"2024-09-19T09:13:26.506263+0000","last_clean":"2024-09-19T09:13:26.506263+0000","last_became_active":"2024-09-19T09:13:26.504649+0000","last_became_peered":"2024-09-19T09:13:26.504649+0000","last_unstale":"2024-09-19T09:13:26.506263+0000","last_undegraded":"2024-09-19T09:13:26.506263+0000","last_fullsized":"2024-09-19T09:13:26.506263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:26:04.073618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493391+0000","last_change":"2024-09-19T09:13:26.493391+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493391+0000","last_undegraded":"2024-09-19T09:13:26.493391+0000","last_fullsized":"2024-09-19T09:13:26.493391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.501636+0000","last_change":"2024-09-19T09:13:26.501526+0000","last_active":"2024-09-19T09:13:26.501636+0000","last_peered":"2024-09-19T09:13:26.501636+0000","last_clean":"2024-09-19T09:13:26.501636+0000","last_became_active":"2024-09-19T09:13:26.501281+0000","last_became_peered":"2024-09-19T09:13:26.501281+0000","last_unstale":"2024-09-19T09:13:26.501636+0000","last_undegraded":"2024-09-19T09:13:26.501636+0000","last_fullsized":"2024-09-19T09:13:26.501636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:50.647697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.496742+0000","last_change":"2024-09-19T09:13:26.496742+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.496742+0000","last_undegraded":"2024-09-19T09:13:26.496742+0000","last_fullsized":"2024-09-19T09:13:26.496742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506318+0000","last_change":"2024-09-19T09:13:26.505847+0000","last_active":"2024-09-19T09:13:26.506318+0000","last_peered":"2024-09-19T09:13:26.506318+0000","last_clean":"2024-09-19T09:13:26.506318+0000","last_became_active":"2024-09-19T09:13:26.505245+0000","last_became_peered":"2024-09-19T09:13:26.505245+0000","last_unstale":"2024-09-19T09:13:26.506318+0000","last_undegraded":"2024-09-19T09:13:26.506318+0000","last_fullsized":"2024-09-19T09:13:26.506318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:15.613040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492202+0000","last_change":"2024-09-19T09:13:26.492202+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492202+0000","last_undegraded":"2024-09-19T09:13:26.492202+0000","last_fullsized":"2024-09-19T09:13:26.492202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.503252+0000","last_change":"2024-09-19T09:13:26.502978+0000","last_active":"2024-09-19T09:13:26.503252+0000","last_peered":"2024-09-19T09:13:26.503252+0000","last_clean":"2024-09-19T09:13:26.503252+0000","last_became_active":"2024-09-19T09:13:26.502537+0000","last_became_peered":"2024-09-19T09:13:26.502537+0000","last_unstale":"2024-09-19T09:13:26.503252+0000","last_undegraded":"2024-09-19T09:13:26.503252+0000","last_fullsized":"2024-09-19T09:13:26.503252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:53.132531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494697+0000","last_change":"2024-09-19T09:13:26.494697+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494697+0000","last_undegraded":"2024-09-19T09:13:26.494697+0000","last_fullsized":"2024-09-19T09:13:26.494697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506298+0000","last_change":"2024-09-19T09:13:26.505476+0000","last_active":"2024-09-19T09:13:26.506298+0000","last_peered":"2024-09-19T09:13:26.506298+0000","last_clean":"2024-09-19T09:13:26.506298+0000","last_became_active":"2024-09-19T09:13:26.505190+0000","last_became_peered":"2024-09-19T09:13:26.505190+0000","last_unstale":"2024-09-19T09:13:26.506298+0000","last_undegraded":"2024-09-19T09:13:26.506298+0000","last_fullsized":"2024-09-19T09:13:26.506298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:23.182076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493530+0000","last_change":"2024-09-19T09:13:26.493530+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493530+0000","last_undegraded":"2024-09-19T09:13:26.493530+0000","last_fullsized":"2024-09-19T09:13:26.493530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.498483+0000","last_change":"2024-09-19T09:13:26.497706+0000","last_active":"2024-09-19T09:13:26.498483+0000","last_peered":"2024-09-19T09:13:26.498483+0000","last_clean":"2024-09-19T09:13:26.498483+0000","last_became_active":"2024-09-19T09:13:26.497446+0000","last_became_peered":"2024-09-19T09:13:26.497446+0000","last_unstale":"2024-09-19T09:13:26.498483+0000","last_undegraded":"2024-09-19T09:13:26.498483+0000","last_fullsized":"2024-09-19T09:13:26.498483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:03.360103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493180+0000","last_change":"2024-09-19T09:13:26.493180+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493180+0000","last_undegraded":"2024-09-19T09:13:26.493180+0000","last_fullsized":"2024-09-19T09:13:26.493180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506749+0000","last_change":"2024-09-19T09:13:26.506097+0000","last_active":"2024-09-19T09:13:26.506749+0000","last_peered":"2024-09-19T09:13:26.506749+0000","last_clean":"2024-09-19T09:13:26.506749+0000","last_became_active":"2024-09-19T09:13:26.505562+0000","last_became_peered":"2024-09-19T09:13:26.505562+0000","last_unstale":"2024-09-19T09:13:26.506749+0000","last_undegraded":"2024-09-19T09:13:26.506749+0000","last_fullsized":"2024-09-19T09:13:26.506749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:43.368123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492377+0000","last_change":"2024-09-19T09:13:26.492377+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492377+0000","last_undegraded":"2024-09-19T09:13:26.492377+0000","last_fullsized":"2024-09-19T09:13:26.492377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.503099+0000","last_change":"2024-09-19T09:13:26.501858+0000","last_active":"2024-09-19T09:13:26.503099+0000","last_peered":"2024-09-19T09:13:26.503099+0000","last_clean":"2024-09-19T09:13:26.503099+0000","last_became_active":"2024-09-19T09:13:26.501606+0000","last_became_peered":"2024-09-19T09:13:26.501606+0000","last_unstale":"2024-09-19T09:13:26.503099+0000","last_undegraded":"2024-09-19T09:13:26.503099+0000","last_fullsized":"2024-09-19T09:13:26.503099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:30.757320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.500926+0000","last_change":"2024-09-19T09:13:26.500926+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.500926+0000","last_undegraded":"2024-09-19T09:13:26.500926+0000","last_fullsized":"2024-09-19T09:13:26.500926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.498836+0000","last_change":"2024-09-19T09:13:26.498599+0000","last_active":"2024-09-19T09:13:26.498836+0000","last_peered":"2024-09-19T09:13:26.498836+0000","last_clean":"2024-09-19T09:13:26.498836+0000","last_became_active":"2024-09-19T09:13:26.498160+0000","last_became_peered":"2024-09-19T09:13:26.498160+0000","last_unstale":"2024-09-19T09:13:26.498836+0000","last_undegraded":"2024-09-19T09:13:26.498836+0000","last_fullsized":"2024-09-19T09:13:26.498836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:21.922199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494868+0000","last_change":"2024-09-19T09:13:26.494868+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494868+0000","last_undegraded":"2024-09-19T09:13:26.494868+0000","last_fullsized":"2024-09-19T09:13:26.494868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.503580+0000","last_change":"2024-09-19T09:13:26.503468+0000","last_active":"2024-09-19T09:13:26.503580+0000","last_peered":"2024-09-19T09:13:26.503580+0000","last_clean":"2024-09-19T09:13:26.503580+0000","last_became_active":"2024-09-19T09:13:26.503239+0000","last_became_peered":"2024-09-19T09:13:26.503239+0000","last_unstale":"2024-09-19T09:13:26.503580+0000","last_undegraded":"2024-09-19T09:13:26.503580+0000","last_fullsized":"2024-09-19T09:13:26.503580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:29.822493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.496063+0000","last_change":"2024-09-19T09:13:26.496063+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.496063+0000","last_undegraded":"2024-09-19T09:13:26.496063+0000","last_fullsized":"2024-09-19T09:13:26.496063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506335+0000","last_change":"2024-09-19T09:13:26.505929+0000","last_active":"2024-09-19T09:13:26.506335+0000","last_peered":"2024-09-19T09:13:26.506335+0000","last_clean":"2024-09-19T09:13:26.506335+0000","last_became_active":"2024-09-19T09:13:26.505267+0000","last_became_peered":"2024-09-19T09:13:26.505267+0000","last_unstale":"2024-09-19T09:13:26.506335+0000","last_undegraded":"2024-09-19T09:13:26.506335+0000","last_fullsized":"2024-09-19T09:13:26.506335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:42.609549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495443+0000","last_change":"2024-09-19T09:13:26.495443+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495443+0000","last_undegraded":"2024-09-19T09:13:26.495443+0000","last_fullsized":"2024-09-19T09:13:26.495443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.503380+0000","last_change":"2024-09-19T09:13:26.503380+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.503380+0000","last_undegraded":"2024-09-19T09:13:26.503380+0000","last_fullsized":"2024-09-19T09:13:26.503380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.498504+0000","last_change":"2024-09-19T09:13:26.498383+0000","last_active":"2024-09-19T09:13:26.498504+0000","last_peered":"2024-09-19T09:13:26.498504+0000","last_clean":"2024-09-19T09:13:26.498504+0000","last_became_active":"2024-09-19T09:13:26.498142+0000","last_became_peered":"2024-09-19T09:13:26.498142+0000","last_unstale":"2024-09-19T09:13:26.498504+0000","last_undegraded":"2024-09-19T09:13:26.498504+0000","last_fullsized":"2024-09-19T09:13:26.498504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:43.668821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494803+0000","last_change":"2024-09-19T09:13:26.494803+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494803+0000","last_undegraded":"2024-09-19T09:13:26.494803+0000","last_fullsized":"2024-09-19T09:13:26.494803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.498086+0000","last_change":"2024-09-19T09:13:26.497950+0000","last_active":"2024-09-19T09:13:26.498086+0000","last_peered":"2024-09-19T09:13:26.498086+0000","last_clean":"2024-09-19T09:13:26.498086+0000","last_became_active":"2024-09-19T09:13:26.497689+0000","last_became_peered":"2024-09-19T09:13:26.497689+0000","last_unstale":"2024-09-19T09:13:26.498086+0000","last_undegraded":"2024-09-19T09:13:26.498086+0000","last_fullsized":"2024-09-19T09:13:26.498086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:20.181354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494931+0000","last_change":"2024-09-19T09:13:26.494931+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494931+0000","last_undegraded":"2024-09-19T09:13:26.494931+0000","last_fullsized":"2024-09-19T09:13:26.494931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.503229+0000","last_change":"2024-09-19T09:13:26.502836+0000","last_active":"2024-09-19T09:13:26.503229+0000","last_peered":"2024-09-19T09:13:26.503229+0000","last_clean":"2024-09-19T09:13:26.503229+0000","last_became_active":"2024-09-19T09:13:26.501995+0000","last_became_peered":"2024-09-19T09:13:26.501995+0000","last_unstale":"2024-09-19T09:13:26.503229+0000","last_undegraded":"2024-09-19T09:13:26.503229+0000","last_fullsized":"2024-09-19T09:13:26.503229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:18.350158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.497184+0000","last_change":"2024-09-19T09:13:26.497184+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.497184+0000","last_undegraded":"2024-09-19T09:13:26.497184+0000","last_fullsized":"2024-09-19T09:13:26.497184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506962+0000","last_change":"2024-09-19T09:13:26.506856+0000","last_active":"2024-09-19T09:13:26.506962+0000","last_peered":"2024-09-19T09:13:26.506962+0000","last_clean":"2024-09-19T09:13:26.506962+0000","last_became_active":"2024-09-19T09:13:26.506714+0000","last_became_peered":"2024-09-19T09:13:26.506714+0000","last_unstale":"2024-09-19T09:13:26.506962+0000","last_undegraded":"2024-09-19T09:13:26.506962+0000","last_fullsized":"2024-09-19T09:13:26.506962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:18.256167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":60,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195251,"statfs":{"total":200000000,"available":199937630,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194681,"statfs":{"total":200000000,"available":199353537,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":60,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195251,"statfs":{"total":200000000,"available":199937630,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194681,"statfs":{"total":200000000,"available":199353537,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:13:30.830 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:13:30.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.968+0000 7f874ae27640 1 Processor -- start 2024-09-19T09:13:30.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.968+0000 7f874ae27640 1 -- start start 2024-09-19T09:13:30.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.969+0000 7f874ae27640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f874406bc10 0x7f874406bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:30.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.969+0000 7f874ae27640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8744145e80 0x7f874415d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:30.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.969+0000 7f874ae27640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87440d1500 0x7f87440d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:30.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.969+0000 7f874ae27640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f87440704e0 con 0x7f8744145e80 2024-09-19T09:13:30.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.969+0000 7f874ae27640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f874406c530 con 0x7f874406bc10 2024-09-19T09:13:30.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.969+0000 7f874ae27640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f874406e550 con 0x7f87440d1500 2024-09-19T09:13:30.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.969+0000 7f8743fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8744145e80 0x7f874415d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:30.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.969+0000 7f8743fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8744145e80 0x7f874415d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57086/0 (socket says 172.21.15.18:57086) 2024-09-19T09:13:30.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.969+0000 7f8743fff640 1 -- 172.21.15.18:0/4273566397 learned_addr learned my addr 172.21.15.18:0/4273566397 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:30.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.969+0000 7f8748bc3640 1 --2- 172.21.15.18:0/4273566397 >> v2:172.21.15.162:3300/0 conn(0x7f874406bc10 0x7f874406bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:30.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.969+0000 7f8743fff640 1 -- 172.21.15.18:0/4273566397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87440d1500 msgr2=0x7f87440d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:30.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.969+0000 7f87493c4640 1 --2- 172.21.15.18:0/4273566397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87440d1500 0x7f87440d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:30.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.969+0000 7f8743fff640 1 --2- 172.21.15.18:0/4273566397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87440d1500 0x7f87440d0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.969+0000 7f8743fff640 1 -- 172.21.15.18:0/4273566397 >> v2:172.21.15.162:3300/0 conn(0x7f874406bc10 msgr2=0x7f874406bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:30.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.969+0000 7f8743fff640 1 --2- 172.21.15.18:0/4273566397 >> v2:172.21.15.162:3300/0 conn(0x7f874406bc10 0x7f874406bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.969+0000 7f8743fff640 1 -- 172.21.15.18:0/4273566397 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f874406e830 con 0x7f8744145e80 2024-09-19T09:13:30.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.969+0000 7f8748bc3640 1 --2- 172.21.15.18:0/4273566397 >> v2:172.21.15.162:3300/0 conn(0x7f874406bc10 0x7f874406bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:13:30.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.970+0000 7f8743fff640 1 --2- 172.21.15.18:0/4273566397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8744145e80 0x7f874415d0f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8744075930 tx=0x7f873002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f69830212c5834 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:30.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.970+0000 7f87437fe640 1 -- 172.21.15.18:0/4273566397 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8730037070 con 0x7f8744145e80 2024-09-19T09:13:30.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.970+0000 7f87437fe640 1 -- 172.21.15.18:0/4273566397 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8730032440 con 0x7f8744145e80 2024-09-19T09:13:30.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.970+0000 7f87437fe640 1 -- 172.21.15.18:0/4273566397 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8730032810 con 0x7f8744145e80 2024-09-19T09:13:30.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.971+0000 7f874ae27640 1 -- 172.21.15.18:0/4273566397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8744145e80 msgr2=0x7f874415d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:30.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.971+0000 7f874ae27640 1 --2- 172.21.15.18:0/4273566397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8744145e80 0x7f874415d0f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8744075930 tx=0x7f873002a140 comp rx=0 tx=0).stop 2024-09-19T09:13:30.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.971+0000 7f874ae27640 1 -- 172.21.15.18:0/4273566397 shutdown_connections 2024-09-19T09:13:30.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.971+0000 7f874ae27640 1 --2- 172.21.15.18:0/4273566397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87440d1500 0x7f87440d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.971+0000 7f874ae27640 1 --2- 172.21.15.18:0/4273566397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8744145e80 0x7f874415d0f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.971+0000 7f874ae27640 1 --2- 172.21.15.18:0/4273566397 >> v2:172.21.15.162:3300/0 conn(0x7f874406bc10 0x7f874406bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.971+0000 7f874ae27640 1 -- 172.21.15.18:0/4273566397 >> 172.21.15.18:0/4273566397 conn(0x7f874406cd20 msgr2=0x7f874406d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:30.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.971+0000 7f874ae27640 1 -- 172.21.15.18:0/4273566397 shutdown_connections 2024-09-19T09:13:30.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.971+0000 7f874ae27640 1 -- 172.21.15.18:0/4273566397 wait complete. 2024-09-19T09:13:30.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.972+0000 7f874ae27640 1 Processor -- start 2024-09-19T09:13:30.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.972+0000 7f874ae27640 1 -- start start 2024-09-19T09:13:30.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.973+0000 7f874ae27640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f874406bc10 0x7f8744142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:30.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.973+0000 7f874ae27640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87440d1500 0x7f87441f5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:30.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.973+0000 7f874ae27640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8744145e80 0x7f874415c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:30.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.973+0000 7f874ae27640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f874406feb0 con 0x7f8744145e80 2024-09-19T09:13:30.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.973+0000 7f874ae27640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f87440b0f80 con 0x7f87440d1500 2024-09-19T09:13:30.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.973+0000 7f874ae27640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f874415d630 con 0x7f874406bc10 2024-09-19T09:13:30.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.973+0000 7f87493c4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8744145e80 0x7f874415c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:30.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.973+0000 7f87493c4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8744145e80 0x7f874415c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57088/0 (socket says 172.21.15.18:57088) 2024-09-19T09:13:30.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.973+0000 7f87493c4640 1 -- 172.21.15.18:0/654190082 learned_addr learned my addr 172.21.15.18:0/654190082 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:30.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.973+0000 7f8743fff640 1 --2- 172.21.15.18:0/654190082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87440d1500 0x7f87441f5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.973+0000 7f8748bc3640 1 --2- 172.21.15.18:0/654190082 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f874406bc10 0x7f8744142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.973+0000 7f87493c4640 1 -- 172.21.15.18:0/654190082 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f874406bc10 msgr2=0x7f8744142bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.973+0000 7f87493c4640 1 --2- 172.21.15.18:0/654190082 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f874406bc10 0x7f8744142bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.973+0000 7f87493c4640 1 -- 172.21.15.18:0/654190082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87440d1500 msgr2=0x7f87441f5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.973+0000 7f87493c4640 1 --2- 172.21.15.18:0/654190082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87440d1500 0x7f87441f5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.973+0000 7f87493c4640 1 -- 172.21.15.18:0/654190082 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87441f48c0 con 0x7f8744145e80 2024-09-19T09:13:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.973+0000 7f87493c4640 1 --2- 172.21.15.18:0/654190082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8744145e80 0x7f874415c020 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f873c00cc30 tx=0x7f873c00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.974+0000 7f87417fa640 1 -- 172.21.15.18:0/654190082 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c00ce40 con 0x7f8744145e80 2024-09-19T09:13:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.974+0000 7f87417fa640 1 -- 172.21.15.18:0/654190082 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f873c003990 con 0x7f8744145e80 2024-09-19T09:13:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.974+0000 7f874ae27640 1 -- 172.21.15.18:0/654190082 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87441f4ba0 con 0x7f8744145e80 2024-09-19T09:13:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.974+0000 7f87417fa640 1 -- 172.21.15.18:0/654190082 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c003d40 con 0x7f8744145e80 2024-09-19T09:13:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.974+0000 7f874ae27640 1 -- 172.21.15.18:0/654190082 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87441f5160 con 0x7f8744145e80 2024-09-19T09:13:30.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.975+0000 7f874ae27640 1 -- 172.21.15.18:0/654190082 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f874406d880 con 0x7f8744145e80 2024-09-19T09:13:30.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.975+0000 7f87417fa640 1 -- 172.21.15.18:0/654190082 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f873c004000 con 0x7f8744145e80 2024-09-19T09:13:30.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.976+0000 7f87417fa640 1 --2- 172.21.15.18:0/654190082 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f872806c2b0 0x7f872806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:30.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.976+0000 7f87417fa640 1 -- 172.21.15.18:0/654190082 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f873c08b7e0 con 0x7f8744145e80 2024-09-19T09:13:30.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.976+0000 7f8748bc3640 1 --2- 172.21.15.18:0/654190082 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f872806c2b0 0x7f872806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:30.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.976+0000 7f8748bc3640 1 --2- 172.21.15.18:0/654190082 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f872806c2b0 0x7f872806e770 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f87440b36c0 tx=0x7f8738008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:30.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:30.980+0000 7f87417fa640 1 -- 172.21.15.18:0/654190082 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f873c014030 con 0x7f8744145e80 2024-09-19T09:13:31.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.151+0000 7f874ae27640 1 -- 172.21.15.18:0/654190082 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8744073850 con 0x7f872806c2b0 2024-09-19T09:13:31.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.158+0000 7f87417fa640 1 -- 172.21.15.18:0/654190082 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242209 (secure 0 0 0) 0x7f8744073850 con 0x7f872806c2b0 2024-09-19T09:13:31.160 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:31.161 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:13:31.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.161+0000 7f874ae27640 1 -- 172.21.15.18:0/654190082 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f872806c2b0 msgr2=0x7f872806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:31.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.161+0000 7f874ae27640 1 --2- 172.21.15.18:0/654190082 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f872806c2b0 0x7f872806e770 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f87440b36c0 tx=0x7f8738008040 comp rx=0 tx=0).stop 2024-09-19T09:13:31.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.161+0000 7f874ae27640 1 -- 172.21.15.18:0/654190082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8744145e80 msgr2=0x7f874415c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:31.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.161+0000 7f874ae27640 1 --2- 172.21.15.18:0/654190082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8744145e80 0x7f874415c020 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f873c00cc30 tx=0x7f873c00a5c0 comp rx=0 tx=0).stop 2024-09-19T09:13:31.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.161+0000 7f874ae27640 1 -- 172.21.15.18:0/654190082 shutdown_connections 2024-09-19T09:13:31.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.161+0000 7f874ae27640 1 --2- 172.21.15.18:0/654190082 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f872806c2b0 0x7f872806e770 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:31.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.161+0000 7f874ae27640 1 --2- 172.21.15.18:0/654190082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8744145e80 0x7f874415c020 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:31.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.161+0000 7f874ae27640 1 --2- 172.21.15.18:0/654190082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87440d1500 0x7f87441f5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:31.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.161+0000 7f874ae27640 1 --2- 172.21.15.18:0/654190082 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f874406bc10 0x7f8744142bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:31.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.161+0000 7f874ae27640 1 -- 172.21.15.18:0/654190082 >> 172.21.15.18:0/654190082 conn(0x7f874406cd20 msgr2=0x7f874415f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:31.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.161+0000 7f874ae27640 1 -- 172.21.15.18:0/654190082 shutdown_connections 2024-09-19T09:13:31.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.161+0000 7f874ae27640 1 -- 172.21.15.18:0/654190082 wait complete. 2024-09-19T09:13:31.172 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-19T09:13:29.522390+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1603,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560896,"statfs":{"total":1600000000,"available":1598357954,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.039671"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493236+0000","last_change":"2024-09-19T09:13:26.493236+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493236+0000","last_undegraded":"2024-09-19T09:13:26.493236+0000","last_fullsized":"2024-09-19T09:13:26.493236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.496430+0000","last_change":"2024-09-19T09:13:26.496430+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.496430+0000","last_undegraded":"2024-09-19T09:13:26.496430+0000","last_fullsized":"2024-09-19T09:13:26.496430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495677+0000","last_change":"2024-09-19T09:13:26.495677+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495677+0000","last_undegraded":"2024-09-19T09:13:26.495677+0000","last_fullsized":"2024-09-19T09:13:26.495677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495028+0000","last_change":"2024-09-19T09:13:26.495028+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495028+0000","last_undegraded":"2024-09-19T09:13:26.495028+0000","last_fullsized":"2024-09-19T09:13:26.495028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493323+0000","last_change":"2024-09-19T09:13:26.493323+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493323+0000","last_undegraded":"2024-09-19T09:13:26.493323+0000","last_fullsized":"2024-09-19T09:13:26.493323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.498629+0000","last_change":"2024-09-19T09:13:26.498629+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.498629+0000","last_undegraded":"2024-09-19T09:13:26.498629+0000","last_fullsized":"2024-09-19T09:13:26.498629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493313+0000","last_change":"2024-09-19T09:13:26.493313+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493313+0000","last_undegraded":"2024-09-19T09:13:26.493313+0000","last_fullsized":"2024-09-19T09:13:26.493313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495284+0000","last_change":"2024-09-19T09:13:26.495284+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495284+0000","last_undegraded":"2024-09-19T09:13:26.495284+0000","last_fullsized":"2024-09-19T09:13:26.495284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493039+0000","last_change":"2024-09-19T09:13:26.493039+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493039+0000","last_undegraded":"2024-09-19T09:13:26.493039+0000","last_fullsized":"2024-09-19T09:13:26.493039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492910+0000","last_change":"2024-09-19T09:13:26.492910+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492910+0000","last_undegraded":"2024-09-19T09:13:26.492910+0000","last_fullsized":"2024-09-19T09:13:26.492910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492691+0000","last_change":"2024-09-19T09:13:26.492691+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492691+0000","last_undegraded":"2024-09-19T09:13:26.492691+0000","last_fullsized":"2024-09-19T09:13:26.492691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492910+0000","last_change":"2024-09-19T09:13:26.492910+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492910+0000","last_undegraded":"2024-09-19T09:13:26.492910+0000","last_fullsized":"2024-09-19T09:13:26.492910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494922+0000","last_change":"2024-09-19T09:13:26.494922+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494922+0000","last_undegraded":"2024-09-19T09:13:26.494922+0000","last_fullsized":"2024-09-19T09:13:26.494922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494340+0000","last_change":"2024-09-19T09:13:26.494340+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494340+0000","last_undegraded":"2024-09-19T09:13:26.494340+0000","last_fullsized":"2024-09-19T09:13:26.494340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.499204+0000","last_change":"2024-09-19T09:13:26.499204+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.499204+0000","last_undegraded":"2024-09-19T09:13:26.499204+0000","last_fullsized":"2024-09-19T09:13:26.499204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.499867+0000","last_change":"2024-09-19T09:13:26.499867+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.499867+0000","last_undegraded":"2024-09-19T09:13:26.499867+0000","last_fullsized":"2024-09-19T09:13:26.499867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.498092+0000","last_change":"2024-09-19T09:13:26.498092+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.498092+0000","last_undegraded":"2024-09-19T09:13:26.498092+0000","last_fullsized":"2024-09-19T09:13:26.498092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.496381+0000","last_change":"2024-09-19T09:13:26.496381+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.496381+0000","last_undegraded":"2024-09-19T09:13:26.496381+0000","last_fullsized":"2024-09-19T09:13:26.496381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494819+0000","last_change":"2024-09-19T09:13:26.494819+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494819+0000","last_undegraded":"2024-09-19T09:13:26.494819+0000","last_fullsized":"2024-09-19T09:13:26.494819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492532+0000","last_change":"2024-09-19T09:13:26.492532+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492532+0000","last_undegraded":"2024-09-19T09:13:26.492532+0000","last_fullsized":"2024-09-19T09:13:26.492532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.498133+0000","last_change":"2024-09-19T09:13:26.498133+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.498133+0000","last_undegraded":"2024-09-19T09:13:26.498133+0000","last_fullsized":"2024-09-19T09:13:26.498133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494421+0000","last_change":"2024-09-19T09:13:26.494421+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494421+0000","last_undegraded":"2024-09-19T09:13:26.494421+0000","last_fullsized":"2024-09-19T09:13:26.494421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494445+0000","last_change":"2024-09-19T09:13:26.494445+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494445+0000","last_undegraded":"2024-09-19T09:13:26.494445+0000","last_fullsized":"2024-09-19T09:13:26.494445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.496247+0000","last_change":"2024-09-19T09:13:26.496247+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.496247+0000","last_undegraded":"2024-09-19T09:13:26.496247+0000","last_fullsized":"2024-09-19T09:13:26.496247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.498759+0000","last_change":"2024-09-19T09:13:26.498759+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.498759+0000","last_undegraded":"2024-09-19T09:13:26.498759+0000","last_fullsized":"2024-09-19T09:13:26.498759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.497481+0000","last_change":"2024-09-19T09:13:26.497481+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.497481+0000","last_undegraded":"2024-09-19T09:13:26.497481+0000","last_fullsized":"2024-09-19T09:13:26.497481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494439+0000","last_change":"2024-09-19T09:13:26.494439+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494439+0000","last_undegraded":"2024-09-19T09:13:26.494439+0000","last_fullsized":"2024-09-19T09:13:26.494439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494550+0000","last_change":"2024-09-19T09:13:26.494550+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494550+0000","last_undegraded":"2024-09-19T09:13:26.494550+0000","last_fullsized":"2024-09-19T09:13:26.494550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.498239+0000","last_change":"2024-09-19T09:13:26.498239+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.498239+0000","last_undegraded":"2024-09-19T09:13:26.498239+0000","last_fullsized":"2024-09-19T09:13:26.498239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.503713+0000","last_change":"2024-09-19T09:13:26.503713+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.503713+0000","last_undegraded":"2024-09-19T09:13:26.503713+0000","last_fullsized":"2024-09-19T09:13:26.503713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493598+0000","last_change":"2024-09-19T09:13:26.493598+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493598+0000","last_undegraded":"2024-09-19T09:13:26.493598+0000","last_fullsized":"2024-09-19T09:13:26.493598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495036+0000","last_change":"2024-09-19T09:13:26.495036+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495036+0000","last_undegraded":"2024-09-19T09:13:26.495036+0000","last_fullsized":"2024-09-19T09:13:26.495036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494836+0000","last_change":"2024-09-19T09:13:26.494836+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494836+0000","last_undegraded":"2024-09-19T09:13:26.494836+0000","last_fullsized":"2024-09-19T09:13:26.494836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.503270+0000","last_change":"2024-09-19T09:13:26.503044+0000","last_active":"2024-09-19T09:13:26.503270+0000","last_peered":"2024-09-19T09:13:26.503270+0000","last_clean":"2024-09-19T09:13:26.503270+0000","last_became_active":"2024-09-19T09:13:26.502787+0000","last_became_peered":"2024-09-19T09:13:26.502787+0000","last_unstale":"2024-09-19T09:13:26.503270+0000","last_undegraded":"2024-09-19T09:13:26.503270+0000","last_fullsized":"2024-09-19T09:13:26.503270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:24.518221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494050+0000","last_change":"2024-09-19T09:13:26.494050+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494050+0000","last_undegraded":"2024-09-19T09:13:26.494050+0000","last_fullsized":"2024-09-19T09:13:26.494050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506840+0000","last_change":"2024-09-19T09:13:26.506712+0000","last_active":"2024-09-19T09:13:26.506840+0000","last_peered":"2024-09-19T09:13:26.506840+0000","last_clean":"2024-09-19T09:13:26.506840+0000","last_became_active":"2024-09-19T09:13:26.506244+0000","last_became_peered":"2024-09-19T09:13:26.506244+0000","last_unstale":"2024-09-19T09:13:26.506840+0000","last_undegraded":"2024-09-19T09:13:26.506840+0000","last_fullsized":"2024-09-19T09:13:26.506840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:22.213563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.505747+0000","last_change":"2024-09-19T09:13:26.505620+0000","last_active":"2024-09-19T09:13:26.505747+0000","last_peered":"2024-09-19T09:13:26.505747+0000","last_clean":"2024-09-19T09:13:26.505747+0000","last_became_active":"2024-09-19T09:13:26.505383+0000","last_became_peered":"2024-09-19T09:13:26.505383+0000","last_unstale":"2024-09-19T09:13:26.505747+0000","last_undegraded":"2024-09-19T09:13:26.505747+0000","last_fullsized":"2024-09-19T09:13:26.505747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:28.390700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.496738+0000","last_change":"2024-09-19T09:13:26.496738+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.496738+0000","last_undegraded":"2024-09-19T09:13:26.496738+0000","last_fullsized":"2024-09-19T09:13:26.496738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.507154+0000","last_change":"2024-09-19T09:13:26.507051+0000","last_active":"2024-09-19T09:13:26.507154+0000","last_peered":"2024-09-19T09:13:26.507154+0000","last_clean":"2024-09-19T09:13:26.507154+0000","last_became_active":"2024-09-19T09:13:26.506557+0000","last_became_peered":"2024-09-19T09:13:26.506557+0000","last_unstale":"2024-09-19T09:13:26.507154+0000","last_undegraded":"2024-09-19T09:13:26.507154+0000","last_fullsized":"2024-09-19T09:13:26.507154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:46.168867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495107+0000","last_change":"2024-09-19T09:13:26.495107+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495107+0000","last_undegraded":"2024-09-19T09:13:26.495107+0000","last_fullsized":"2024-09-19T09:13:26.495107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.501169+0000","last_change":"2024-09-19T09:13:26.501053+0000","last_active":"2024-09-19T09:13:26.501169+0000","last_peered":"2024-09-19T09:13:26.501169+0000","last_clean":"2024-09-19T09:13:26.501169+0000","last_became_active":"2024-09-19T09:13:26.500814+0000","last_became_peered":"2024-09-19T09:13:26.500814+0000","last_unstale":"2024-09-19T09:13:26.501169+0000","last_undegraded":"2024-09-19T09:13:26.501169+0000","last_fullsized":"2024-09-19T09:13:26.501169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:28.680916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494618+0000","last_change":"2024-09-19T09:13:26.494618+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494618+0000","last_undegraded":"2024-09-19T09:13:26.494618+0000","last_fullsized":"2024-09-19T09:13:26.494618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.499090+0000","last_change":"2024-09-19T09:13:26.498971+0000","last_active":"2024-09-19T09:13:26.499090+0000","last_peered":"2024-09-19T09:13:26.499090+0000","last_clean":"2024-09-19T09:13:26.499090+0000","last_became_active":"2024-09-19T09:13:26.498737+0000","last_became_peered":"2024-09-19T09:13:26.498737+0000","last_unstale":"2024-09-19T09:13:26.499090+0000","last_undegraded":"2024-09-19T09:13:26.499090+0000","last_fullsized":"2024-09-19T09:13:26.499090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:38.734255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.497312+0000","last_change":"2024-09-19T09:13:26.497312+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.497312+0000","last_undegraded":"2024-09-19T09:13:26.497312+0000","last_fullsized":"2024-09-19T09:13:26.497312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.500092+0000","last_change":"2024-09-19T09:13:26.499983+0000","last_active":"2024-09-19T09:13:26.500092+0000","last_peered":"2024-09-19T09:13:26.500092+0000","last_clean":"2024-09-19T09:13:26.500092+0000","last_became_active":"2024-09-19T09:13:26.499730+0000","last_became_peered":"2024-09-19T09:13:26.499730+0000","last_unstale":"2024-09-19T09:13:26.500092+0000","last_undegraded":"2024-09-19T09:13:26.500092+0000","last_fullsized":"2024-09-19T09:13:26.500092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:48.658839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495849+0000","last_change":"2024-09-19T09:13:26.495849+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495849+0000","last_undegraded":"2024-09-19T09:13:26.495849+0000","last_fullsized":"2024-09-19T09:13:26.495849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.502099+0000","last_change":"2024-09-19T09:13:26.501792+0000","last_active":"2024-09-19T09:13:26.502099+0000","last_peered":"2024-09-19T09:13:26.502099+0000","last_clean":"2024-09-19T09:13:26.502099+0000","last_became_active":"2024-09-19T09:13:26.501463+0000","last_became_peered":"2024-09-19T09:13:26.501463+0000","last_unstale":"2024-09-19T09:13:26.502099+0000","last_undegraded":"2024-09-19T09:13:26.502099+0000","last_fullsized":"2024-09-19T09:13:26.502099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:26.102412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492101+0000","last_change":"2024-09-19T09:13:26.492101+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492101+0000","last_undegraded":"2024-09-19T09:13:26.492101+0000","last_fullsized":"2024-09-19T09:13:26.492101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.498160+0000","last_change":"2024-09-19T09:13:26.498042+0000","last_active":"2024-09-19T09:13:26.498160+0000","last_peered":"2024-09-19T09:13:26.498160+0000","last_clean":"2024-09-19T09:13:26.498160+0000","last_became_active":"2024-09-19T09:13:26.497811+0000","last_became_peered":"2024-09-19T09:13:26.497811+0000","last_unstale":"2024-09-19T09:13:26.498160+0000","last_undegraded":"2024-09-19T09:13:26.498160+0000","last_fullsized":"2024-09-19T09:13:26.498160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:55.846136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493939+0000","last_change":"2024-09-19T09:13:26.493939+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493939+0000","last_undegraded":"2024-09-19T09:13:26.493939+0000","last_fullsized":"2024-09-19T09:13:26.493939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.507135+0000","last_change":"2024-09-19T09:13:26.507022+0000","last_active":"2024-09-19T09:13:26.507135+0000","last_peered":"2024-09-19T09:13:26.507135+0000","last_clean":"2024-09-19T09:13:26.507135+0000","last_became_active":"2024-09-19T09:13:26.506756+0000","last_became_peered":"2024-09-19T09:13:26.506756+0000","last_unstale":"2024-09-19T09:13:26.507135+0000","last_undegraded":"2024-09-19T09:13:26.507135+0000","last_fullsized":"2024-09-19T09:13:26.507135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:25.794251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.502889+0000","last_change":"2024-09-19T09:13:26.502889+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.502889+0000","last_undegraded":"2024-09-19T09:13:26.502889+0000","last_fullsized":"2024-09-19T09:13:26.502889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506922+0000","last_change":"2024-09-19T09:13:26.506703+0000","last_active":"2024-09-19T09:13:26.506922+0000","last_peered":"2024-09-19T09:13:26.506922+0000","last_clean":"2024-09-19T09:13:26.506922+0000","last_became_active":"2024-09-19T09:13:26.506378+0000","last_became_peered":"2024-09-19T09:13:26.506378+0000","last_unstale":"2024-09-19T09:13:26.506922+0000","last_undegraded":"2024-09-19T09:13:26.506922+0000","last_fullsized":"2024-09-19T09:13:26.506922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:22.859672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493080+0000","last_change":"2024-09-19T09:13:26.493080+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493080+0000","last_undegraded":"2024-09-19T09:13:26.493080+0000","last_fullsized":"2024-09-19T09:13:26.493080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.499680+0000","last_change":"2024-09-19T09:13:26.499537+0000","last_active":"2024-09-19T09:13:26.499680+0000","last_peered":"2024-09-19T09:13:26.499680+0000","last_clean":"2024-09-19T09:13:26.499680+0000","last_became_active":"2024-09-19T09:13:26.499042+0000","last_became_peered":"2024-09-19T09:13:26.499042+0000","last_unstale":"2024-09-19T09:13:26.499680+0000","last_undegraded":"2024-09-19T09:13:26.499680+0000","last_fullsized":"2024-09-19T09:13:26.499680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:11.427700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.497773+0000","last_change":"2024-09-19T09:13:26.497773+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.497773+0000","last_undegraded":"2024-09-19T09:13:26.497773+0000","last_fullsized":"2024-09-19T09:13:26.497773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.504489+0000","last_change":"2024-09-19T09:13:26.504376+0000","last_active":"2024-09-19T09:13:26.504489+0000","last_peered":"2024-09-19T09:13:26.504489+0000","last_clean":"2024-09-19T09:13:26.504489+0000","last_became_active":"2024-09-19T09:13:26.504121+0000","last_became_peered":"2024-09-19T09:13:26.504121+0000","last_unstale":"2024-09-19T09:13:26.504489+0000","last_undegraded":"2024-09-19T09:13:26.504489+0000","last_fullsized":"2024-09-19T09:13:26.504489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:57.507184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495623+0000","last_change":"2024-09-19T09:13:26.495623+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495623+0000","last_undegraded":"2024-09-19T09:13:26.495623+0000","last_fullsized":"2024-09-19T09:13:26.495623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.501794+0000","last_change":"2024-09-19T09:13:26.501637+0000","last_active":"2024-09-19T09:13:26.501794+0000","last_peered":"2024-09-19T09:13:26.501794+0000","last_clean":"2024-09-19T09:13:26.501794+0000","last_became_active":"2024-09-19T09:13:26.501409+0000","last_became_peered":"2024-09-19T09:13:26.501409+0000","last_unstale":"2024-09-19T09:13:26.501794+0000","last_undegraded":"2024-09-19T09:13:26.501794+0000","last_fullsized":"2024-09-19T09:13:26.501794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:27.977582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492137+0000","last_change":"2024-09-19T09:13:26.492137+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492137+0000","last_undegraded":"2024-09-19T09:13:26.492137+0000","last_fullsized":"2024-09-19T09:13:26.492137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.504001+0000","last_change":"2024-09-19T09:13:26.503898+0000","last_active":"2024-09-19T09:13:26.504001+0000","last_peered":"2024-09-19T09:13:26.504001+0000","last_clean":"2024-09-19T09:13:26.504001+0000","last_became_active":"2024-09-19T09:13:26.503631+0000","last_became_peered":"2024-09-19T09:13:26.503631+0000","last_unstale":"2024-09-19T09:13:26.504001+0000","last_undegraded":"2024-09-19T09:13:26.504001+0000","last_fullsized":"2024-09-19T09:13:26.504001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:27.273078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492451+0000","last_change":"2024-09-19T09:13:26.492451+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492451+0000","last_undegraded":"2024-09-19T09:13:26.492451+0000","last_fullsized":"2024-09-19T09:13:26.492451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.502574+0000","last_change":"2024-09-19T09:13:26.502447+0000","last_active":"2024-09-19T09:13:26.502574+0000","last_peered":"2024-09-19T09:13:26.502574+0000","last_clean":"2024-09-19T09:13:26.502574+0000","last_became_active":"2024-09-19T09:13:26.501912+0000","last_became_peered":"2024-09-19T09:13:26.501912+0000","last_unstale":"2024-09-19T09:13:26.502574+0000","last_undegraded":"2024-09-19T09:13:26.502574+0000","last_fullsized":"2024-09-19T09:13:26.502574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:00.635615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.499236+0000","last_change":"2024-09-19T09:13:26.499236+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.499236+0000","last_undegraded":"2024-09-19T09:13:26.499236+0000","last_fullsized":"2024-09-19T09:13:26.499236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":166,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.496760+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:13:26.496760+0000","last_peered":"2024-09-19T09:13:26.496760+0000","last_clean":"2024-09-19T09:13:26.496760+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:13:26.496760+0000","last_undegraded":"2024-09-19T09:13:26.496760+0000","last_fullsized":"2024-09-19T09:13:26.496760+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:22.478151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506817+0000","last_change":"2024-09-19T09:13:26.506369+0000","last_active":"2024-09-19T09:13:26.506817+0000","last_peered":"2024-09-19T09:13:26.506817+0000","last_clean":"2024-09-19T09:13:26.506817+0000","last_became_active":"2024-09-19T09:13:26.506065+0000","last_became_peered":"2024-09-19T09:13:26.506065+0000","last_unstale":"2024-09-19T09:13:26.506817+0000","last_undegraded":"2024-09-19T09:13:26.506817+0000","last_fullsized":"2024-09-19T09:13:26.506817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:00.898726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492386+0000","last_change":"2024-09-19T09:13:26.492386+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492386+0000","last_undegraded":"2024-09-19T09:13:26.492386+0000","last_fullsized":"2024-09-19T09:13:26.492386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506263+0000","last_change":"2024-09-19T09:13:26.504928+0000","last_active":"2024-09-19T09:13:26.506263+0000","last_peered":"2024-09-19T09:13:26.506263+0000","last_clean":"2024-09-19T09:13:26.506263+0000","last_became_active":"2024-09-19T09:13:26.504649+0000","last_became_peered":"2024-09-19T09:13:26.504649+0000","last_unstale":"2024-09-19T09:13:26.506263+0000","last_undegraded":"2024-09-19T09:13:26.506263+0000","last_fullsized":"2024-09-19T09:13:26.506263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:26:04.073618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493391+0000","last_change":"2024-09-19T09:13:26.493391+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493391+0000","last_undegraded":"2024-09-19T09:13:26.493391+0000","last_fullsized":"2024-09-19T09:13:26.493391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.501636+0000","last_change":"2024-09-19T09:13:26.501526+0000","last_active":"2024-09-19T09:13:26.501636+0000","last_peered":"2024-09-19T09:13:26.501636+0000","last_clean":"2024-09-19T09:13:26.501636+0000","last_became_active":"2024-09-19T09:13:26.501281+0000","last_became_peered":"2024-09-19T09:13:26.501281+0000","last_unstale":"2024-09-19T09:13:26.501636+0000","last_undegraded":"2024-09-19T09:13:26.501636+0000","last_fullsized":"2024-09-19T09:13:26.501636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:50.647697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.496742+0000","last_change":"2024-09-19T09:13:26.496742+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.496742+0000","last_undegraded":"2024-09-19T09:13:26.496742+0000","last_fullsized":"2024-09-19T09:13:26.496742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506318+0000","last_change":"2024-09-19T09:13:26.505847+0000","last_active":"2024-09-19T09:13:26.506318+0000","last_peered":"2024-09-19T09:13:26.506318+0000","last_clean":"2024-09-19T09:13:26.506318+0000","last_became_active":"2024-09-19T09:13:26.505245+0000","last_became_peered":"2024-09-19T09:13:26.505245+0000","last_unstale":"2024-09-19T09:13:26.506318+0000","last_undegraded":"2024-09-19T09:13:26.506318+0000","last_fullsized":"2024-09-19T09:13:26.506318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:15.613040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492202+0000","last_change":"2024-09-19T09:13:26.492202+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492202+0000","last_undegraded":"2024-09-19T09:13:26.492202+0000","last_fullsized":"2024-09-19T09:13:26.492202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.503252+0000","last_change":"2024-09-19T09:13:26.502978+0000","last_active":"2024-09-19T09:13:26.503252+0000","last_peered":"2024-09-19T09:13:26.503252+0000","last_clean":"2024-09-19T09:13:26.503252+0000","last_became_active":"2024-09-19T09:13:26.502537+0000","last_became_peered":"2024-09-19T09:13:26.502537+0000","last_unstale":"2024-09-19T09:13:26.503252+0000","last_undegraded":"2024-09-19T09:13:26.503252+0000","last_fullsized":"2024-09-19T09:13:26.503252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:53.132531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494697+0000","last_change":"2024-09-19T09:13:26.494697+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494697+0000","last_undegraded":"2024-09-19T09:13:26.494697+0000","last_fullsized":"2024-09-19T09:13:26.494697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506298+0000","last_change":"2024-09-19T09:13:26.505476+0000","last_active":"2024-09-19T09:13:26.506298+0000","last_peered":"2024-09-19T09:13:26.506298+0000","last_clean":"2024-09-19T09:13:26.506298+0000","last_became_active":"2024-09-19T09:13:26.505190+0000","last_became_peered":"2024-09-19T09:13:26.505190+0000","last_unstale":"2024-09-19T09:13:26.506298+0000","last_undegraded":"2024-09-19T09:13:26.506298+0000","last_fullsized":"2024-09-19T09:13:26.506298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:23.182076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493530+0000","last_change":"2024-09-19T09:13:26.493530+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493530+0000","last_undegraded":"2024-09-19T09:13:26.493530+0000","last_fullsized":"2024-09-19T09:13:26.493530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.498483+0000","last_change":"2024-09-19T09:13:26.497706+0000","last_active":"2024-09-19T09:13:26.498483+0000","last_peered":"2024-09-19T09:13:26.498483+0000","last_clean":"2024-09-19T09:13:26.498483+0000","last_became_active":"2024-09-19T09:13:26.497446+0000","last_became_peered":"2024-09-19T09:13:26.497446+0000","last_unstale":"2024-09-19T09:13:26.498483+0000","last_undegraded":"2024-09-19T09:13:26.498483+0000","last_fullsized":"2024-09-19T09:13:26.498483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:03.360103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493180+0000","last_change":"2024-09-19T09:13:26.493180+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493180+0000","last_undegraded":"2024-09-19T09:13:26.493180+0000","last_fullsized":"2024-09-19T09:13:26.493180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506749+0000","last_change":"2024-09-19T09:13:26.506097+0000","last_active":"2024-09-19T09:13:26.506749+0000","last_peered":"2024-09-19T09:13:26.506749+0000","last_clean":"2024-09-19T09:13:26.506749+0000","last_became_active":"2024-09-19T09:13:26.505562+0000","last_became_peered":"2024-09-19T09:13:26.505562+0000","last_unstale":"2024-09-19T09:13:26.506749+0000","last_undegraded":"2024-09-19T09:13:26.506749+0000","last_fullsized":"2024-09-19T09:13:26.506749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:43.368123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492377+0000","last_change":"2024-09-19T09:13:26.492377+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492377+0000","last_undegraded":"2024-09-19T09:13:26.492377+0000","last_fullsized":"2024-09-19T09:13:26.492377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.503099+0000","last_change":"2024-09-19T09:13:26.501858+0000","last_active":"2024-09-19T09:13:26.503099+0000","last_peered":"2024-09-19T09:13:26.503099+0000","last_clean":"2024-09-19T09:13:26.503099+0000","last_became_active":"2024-09-19T09:13:26.501606+0000","last_became_peered":"2024-09-19T09:13:26.501606+0000","last_unstale":"2024-09-19T09:13:26.503099+0000","last_undegraded":"2024-09-19T09:13:26.503099+0000","last_fullsized":"2024-09-19T09:13:26.503099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:30.757320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.500926+0000","last_change":"2024-09-19T09:13:26.500926+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.500926+0000","last_undegraded":"2024-09-19T09:13:26.500926+0000","last_fullsized":"2024-09-19T09:13:26.500926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.498836+0000","last_change":"2024-09-19T09:13:26.498599+0000","last_active":"2024-09-19T09:13:26.498836+0000","last_peered":"2024-09-19T09:13:26.498836+0000","last_clean":"2024-09-19T09:13:26.498836+0000","last_became_active":"2024-09-19T09:13:26.498160+0000","last_became_peered":"2024-09-19T09:13:26.498160+0000","last_unstale":"2024-09-19T09:13:26.498836+0000","last_undegraded":"2024-09-19T09:13:26.498836+0000","last_fullsized":"2024-09-19T09:13:26.498836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:21.922199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494868+0000","last_change":"2024-09-19T09:13:26.494868+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494868+0000","last_undegraded":"2024-09-19T09:13:26.494868+0000","last_fullsized":"2024-09-19T09:13:26.494868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.503580+0000","last_change":"2024-09-19T09:13:26.503468+0000","last_active":"2024-09-19T09:13:26.503580+0000","last_peered":"2024-09-19T09:13:26.503580+0000","last_clean":"2024-09-19T09:13:26.503580+0000","last_became_active":"2024-09-19T09:13:26.503239+0000","last_became_peered":"2024-09-19T09:13:26.503239+0000","last_unstale":"2024-09-19T09:13:26.503580+0000","last_undegraded":"2024-09-19T09:13:26.503580+0000","last_fullsized":"2024-09-19T09:13:26.503580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:29.822493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.496063+0000","last_change":"2024-09-19T09:13:26.496063+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.496063+0000","last_undegraded":"2024-09-19T09:13:26.496063+0000","last_fullsized":"2024-09-19T09:13:26.496063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506335+0000","last_change":"2024-09-19T09:13:26.505929+0000","last_active":"2024-09-19T09:13:26.506335+0000","last_peered":"2024-09-19T09:13:26.506335+0000","last_clean":"2024-09-19T09:13:26.506335+0000","last_became_active":"2024-09-19T09:13:26.505267+0000","last_became_peered":"2024-09-19T09:13:26.505267+0000","last_unstale":"2024-09-19T09:13:26.506335+0000","last_undegraded":"2024-09-19T09:13:26.506335+0000","last_fullsized":"2024-09-19T09:13:26.506335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:42.609549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495443+0000","last_change":"2024-09-19T09:13:26.495443+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495443+0000","last_undegraded":"2024-09-19T09:13:26.495443+0000","last_fullsized":"2024-09-19T09:13:26.495443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.503380+0000","last_change":"2024-09-19T09:13:26.503380+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.503380+0000","last_undegraded":"2024-09-19T09:13:26.503380+0000","last_fullsized":"2024-09-19T09:13:26.503380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.498504+0000","last_change":"2024-09-19T09:13:26.498383+0000","last_active":"2024-09-19T09:13:26.498504+0000","last_peered":"2024-09-19T09:13:26.498504+0000","last_clean":"2024-09-19T09:13:26.498504+0000","last_became_active":"2024-09-19T09:13:26.498142+0000","last_became_peered":"2024-09-19T09:13:26.498142+0000","last_unstale":"2024-09-19T09:13:26.498504+0000","last_undegraded":"2024-09-19T09:13:26.498504+0000","last_fullsized":"2024-09-19T09:13:26.498504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:43.668821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494803+0000","last_change":"2024-09-19T09:13:26.494803+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494803+0000","last_undegraded":"2024-09-19T09:13:26.494803+0000","last_fullsized":"2024-09-19T09:13:26.494803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.498086+0000","last_change":"2024-09-19T09:13:26.497950+0000","last_active":"2024-09-19T09:13:26.498086+0000","last_peered":"2024-09-19T09:13:26.498086+0000","last_clean":"2024-09-19T09:13:26.498086+0000","last_became_active":"2024-09-19T09:13:26.497689+0000","last_became_peered":"2024-09-19T09:13:26.497689+0000","last_unstale":"2024-09-19T09:13:26.498086+0000","last_undegraded":"2024-09-19T09:13:26.498086+0000","last_fullsized":"2024-09-19T09:13:26.498086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:20.181354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494931+0000","last_change":"2024-09-19T09:13:26.494931+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494931+0000","last_undegraded":"2024-09-19T09:13:26.494931+0000","last_fullsized":"2024-09-19T09:13:26.494931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.503229+0000","last_change":"2024-09-19T09:13:26.502836+0000","last_active":"2024-09-19T09:13:26.503229+0000","last_peered":"2024-09-19T09:13:26.503229+0000","last_clean":"2024-09-19T09:13:26.503229+0000","last_became_active":"2024-09-19T09:13:26.501995+0000","last_became_peered":"2024-09-19T09:13:26.501995+0000","last_unstale":"2024-09-19T09:13:26.503229+0000","last_undegraded":"2024-09-19T09:13:26.503229+0000","last_fullsized":"2024-09-19T09:13:26.503229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:18.350158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.497184+0000","last_change":"2024-09-19T09:13:26.497184+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.497184+0000","last_undegraded":"2024-09-19T09:13:26.497184+0000","last_fullsized":"2024-09-19T09:13:26.497184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506962+0000","last_change":"2024-09-19T09:13:26.506856+0000","last_active":"2024-09-19T09:13:26.506962+0000","last_peered":"2024-09-19T09:13:26.506962+0000","last_clean":"2024-09-19T09:13:26.506962+0000","last_became_active":"2024-09-19T09:13:26.506714+0000","last_became_peered":"2024-09-19T09:13:26.506714+0000","last_unstale":"2024-09-19T09:13:26.506962+0000","last_undegraded":"2024-09-19T09:13:26.506962+0000","last_fullsized":"2024-09-19T09:13:26.506962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:18.256167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":60,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195251,"statfs":{"total":200000000,"available":199937630,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194681,"statfs":{"total":200000000,"available":199353537,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":60,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195251,"statfs":{"total":200000000,"available":199937630,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194681,"statfs":{"total":200000000,"available":199353537,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:13:31.175 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3f is not active+clean 2024-09-19T09:13:31.175 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.493236+0000', 'last_change': '2024-09-19T09:13:26.493236+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.493236+0000', 'last_undegraded': '2024-09-19T09:13:26.493236+0000', 'last_fullsized': '2024-09-19T09:13:26.493236+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T09:13:31.175 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3e is not active+clean 2024-09-19T09:13:31.175 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.496430+0000', 'last_change': '2024-09-19T09:13:26.496430+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.496430+0000', 'last_undegraded': '2024-09-19T09:13:26.496430+0000', 'last_fullsized': '2024-09-19T09:13:26.496430+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T09:13:31.176 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3d is not active+clean 2024-09-19T09:13:31.176 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.495677+0000', 'last_change': '2024-09-19T09:13:26.495677+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.495677+0000', 'last_undegraded': '2024-09-19T09:13:26.495677+0000', 'last_fullsized': '2024-09-19T09:13:26.495677+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T09:13:31.176 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3c is not active+clean 2024-09-19T09:13:31.176 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.495028+0000', 'last_change': '2024-09-19T09:13:26.495028+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.495028+0000', 'last_undegraded': '2024-09-19T09:13:26.495028+0000', 'last_fullsized': '2024-09-19T09:13:26.495028+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:13:31.176 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3b is not active+clean 2024-09-19T09:13:31.176 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.493323+0000', 'last_change': '2024-09-19T09:13:26.493323+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.493323+0000', 'last_undegraded': '2024-09-19T09:13:26.493323+0000', 'last_fullsized': '2024-09-19T09:13:26.493323+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T09:13:31.176 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3a is not active+clean 2024-09-19T09:13:31.176 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.498629+0000', 'last_change': '2024-09-19T09:13:26.498629+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.498629+0000', 'last_undegraded': '2024-09-19T09:13:26.498629+0000', 'last_fullsized': '2024-09-19T09:13:26.498629+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:13:31.176 INFO:tasks.ceph.ceph_manager.ceph:PG 3.39 is not active+clean 2024-09-19T09:13:31.176 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.493313+0000', 'last_change': '2024-09-19T09:13:26.493313+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.493313+0000', 'last_undegraded': '2024-09-19T09:13:26.493313+0000', 'last_fullsized': '2024-09-19T09:13:26.493313+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T09:13:31.176 INFO:tasks.ceph.ceph_manager.ceph:PG 3.38 is not active+clean 2024-09-19T09:13:31.177 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.495284+0000', 'last_change': '2024-09-19T09:13:26.495284+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.495284+0000', 'last_undegraded': '2024-09-19T09:13:26.495284+0000', 'last_fullsized': '2024-09-19T09:13:26.495284+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T09:13:31.177 INFO:tasks.ceph.ceph_manager.ceph:PG 3.37 is not active+clean 2024-09-19T09:13:31.177 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.493039+0000', 'last_change': '2024-09-19T09:13:26.493039+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.493039+0000', 'last_undegraded': '2024-09-19T09:13:26.493039+0000', 'last_fullsized': '2024-09-19T09:13:26.493039+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T09:13:31.177 INFO:tasks.ceph.ceph_manager.ceph:PG 3.36 is not active+clean 2024-09-19T09:13:31.177 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.492910+0000', 'last_change': '2024-09-19T09:13:26.492910+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.492910+0000', 'last_undegraded': '2024-09-19T09:13:26.492910+0000', 'last_fullsized': '2024-09-19T09:13:26.492910+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T09:13:31.177 INFO:tasks.ceph.ceph_manager.ceph:PG 3.35 is not active+clean 2024-09-19T09:13:31.177 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.492691+0000', 'last_change': '2024-09-19T09:13:26.492691+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.492691+0000', 'last_undegraded': '2024-09-19T09:13:26.492691+0000', 'last_fullsized': '2024-09-19T09:13:26.492691+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T09:13:31.177 INFO:tasks.ceph.ceph_manager.ceph:PG 3.34 is not active+clean 2024-09-19T09:13:31.177 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.492910+0000', 'last_change': '2024-09-19T09:13:26.492910+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.492910+0000', 'last_undegraded': '2024-09-19T09:13:26.492910+0000', 'last_fullsized': '2024-09-19T09:13:26.492910+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T09:13:31.177 INFO:tasks.ceph.ceph_manager.ceph:PG 3.33 is not active+clean 2024-09-19T09:13:31.177 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.494922+0000', 'last_change': '2024-09-19T09:13:26.494922+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.494922+0000', 'last_undegraded': '2024-09-19T09:13:26.494922+0000', 'last_fullsized': '2024-09-19T09:13:26.494922+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T09:13:31.178 INFO:tasks.ceph.ceph_manager.ceph:PG 3.32 is not active+clean 2024-09-19T09:13:31.178 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.494340+0000', 'last_change': '2024-09-19T09:13:26.494340+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.494340+0000', 'last_undegraded': '2024-09-19T09:13:26.494340+0000', 'last_fullsized': '2024-09-19T09:13:26.494340+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T09:13:31.178 INFO:tasks.ceph.ceph_manager.ceph:PG 3.31 is not active+clean 2024-09-19T09:13:31.178 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.499204+0000', 'last_change': '2024-09-19T09:13:26.499204+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.499204+0000', 'last_undegraded': '2024-09-19T09:13:26.499204+0000', 'last_fullsized': '2024-09-19T09:13:26.499204+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T09:13:31.178 INFO:tasks.ceph.ceph_manager.ceph:PG 3.30 is not active+clean 2024-09-19T09:13:31.178 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.499867+0000', 'last_change': '2024-09-19T09:13:26.499867+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.499867+0000', 'last_undegraded': '2024-09-19T09:13:26.499867+0000', 'last_fullsized': '2024-09-19T09:13:26.499867+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T09:13:31.178 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2f is not active+clean 2024-09-19T09:13:31.178 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.498092+0000', 'last_change': '2024-09-19T09:13:26.498092+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.498092+0000', 'last_undegraded': '2024-09-19T09:13:26.498092+0000', 'last_fullsized': '2024-09-19T09:13:26.498092+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T09:13:31.178 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2e is not active+clean 2024-09-19T09:13:31.178 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.496381+0000', 'last_change': '2024-09-19T09:13:26.496381+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.496381+0000', 'last_undegraded': '2024-09-19T09:13:26.496381+0000', 'last_fullsized': '2024-09-19T09:13:26.496381+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T09:13:31.178 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2d is not active+clean 2024-09-19T09:13:31.179 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.494819+0000', 'last_change': '2024-09-19T09:13:26.494819+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.494819+0000', 'last_undegraded': '2024-09-19T09:13:26.494819+0000', 'last_fullsized': '2024-09-19T09:13:26.494819+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T09:13:31.179 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2c is not active+clean 2024-09-19T09:13:31.179 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.492532+0000', 'last_change': '2024-09-19T09:13:26.492532+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.492532+0000', 'last_undegraded': '2024-09-19T09:13:26.492532+0000', 'last_fullsized': '2024-09-19T09:13:26.492532+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T09:13:31.179 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2b is not active+clean 2024-09-19T09:13:31.179 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.498133+0000', 'last_change': '2024-09-19T09:13:26.498133+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.498133+0000', 'last_undegraded': '2024-09-19T09:13:26.498133+0000', 'last_fullsized': '2024-09-19T09:13:26.498133+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T09:13:31.179 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2a is not active+clean 2024-09-19T09:13:31.179 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.494421+0000', 'last_change': '2024-09-19T09:13:26.494421+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.494421+0000', 'last_undegraded': '2024-09-19T09:13:26.494421+0000', 'last_fullsized': '2024-09-19T09:13:26.494421+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T09:13:31.179 INFO:tasks.ceph.ceph_manager.ceph:PG 3.29 is not active+clean 2024-09-19T09:13:31.179 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.494445+0000', 'last_change': '2024-09-19T09:13:26.494445+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.494445+0000', 'last_undegraded': '2024-09-19T09:13:26.494445+0000', 'last_fullsized': '2024-09-19T09:13:26.494445+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T09:13:31.179 INFO:tasks.ceph.ceph_manager.ceph:PG 3.28 is not active+clean 2024-09-19T09:13:31.179 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.496247+0000', 'last_change': '2024-09-19T09:13:26.496247+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.496247+0000', 'last_undegraded': '2024-09-19T09:13:26.496247+0000', 'last_fullsized': '2024-09-19T09:13:26.496247+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T09:13:31.180 INFO:tasks.ceph.ceph_manager.ceph:PG 3.27 is not active+clean 2024-09-19T09:13:31.180 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.498759+0000', 'last_change': '2024-09-19T09:13:26.498759+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.498759+0000', 'last_undegraded': '2024-09-19T09:13:26.498759+0000', 'last_fullsized': '2024-09-19T09:13:26.498759+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T09:13:31.180 INFO:tasks.ceph.ceph_manager.ceph:PG 3.26 is not active+clean 2024-09-19T09:13:31.180 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.497481+0000', 'last_change': '2024-09-19T09:13:26.497481+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.497481+0000', 'last_undegraded': '2024-09-19T09:13:26.497481+0000', 'last_fullsized': '2024-09-19T09:13:26.497481+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:13:31.180 INFO:tasks.ceph.ceph_manager.ceph:PG 3.25 is not active+clean 2024-09-19T09:13:31.180 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.494439+0000', 'last_change': '2024-09-19T09:13:26.494439+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.494439+0000', 'last_undegraded': '2024-09-19T09:13:26.494439+0000', 'last_fullsized': '2024-09-19T09:13:26.494439+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T09:13:31.180 INFO:tasks.ceph.ceph_manager.ceph:PG 3.24 is not active+clean 2024-09-19T09:13:31.180 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.494550+0000', 'last_change': '2024-09-19T09:13:26.494550+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.494550+0000', 'last_undegraded': '2024-09-19T09:13:26.494550+0000', 'last_fullsized': '2024-09-19T09:13:26.494550+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T09:13:31.180 INFO:tasks.ceph.ceph_manager.ceph:PG 3.23 is not active+clean 2024-09-19T09:13:31.180 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.498239+0000', 'last_change': '2024-09-19T09:13:26.498239+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.498239+0000', 'last_undegraded': '2024-09-19T09:13:26.498239+0000', 'last_fullsized': '2024-09-19T09:13:26.498239+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T09:13:31.180 INFO:tasks.ceph.ceph_manager.ceph:PG 3.22 is not active+clean 2024-09-19T09:13:31.181 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.503713+0000', 'last_change': '2024-09-19T09:13:26.503713+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.503713+0000', 'last_undegraded': '2024-09-19T09:13:26.503713+0000', 'last_fullsized': '2024-09-19T09:13:26.503713+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T09:13:31.181 INFO:tasks.ceph.ceph_manager.ceph:PG 3.21 is not active+clean 2024-09-19T09:13:31.181 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.493598+0000', 'last_change': '2024-09-19T09:13:26.493598+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.493598+0000', 'last_undegraded': '2024-09-19T09:13:26.493598+0000', 'last_fullsized': '2024-09-19T09:13:26.493598+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T09:13:31.181 INFO:tasks.ceph.ceph_manager.ceph:PG 3.20 is not active+clean 2024-09-19T09:13:31.181 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.495036+0000', 'last_change': '2024-09-19T09:13:26.495036+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.495036+0000', 'last_undegraded': '2024-09-19T09:13:26.495036+0000', 'last_fullsized': '2024-09-19T09:13:26.495036+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:13:31.181 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-09-19T09:13:31.181 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.494836+0000', 'last_change': '2024-09-19T09:13:26.494836+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.494836+0000', 'last_undegraded': '2024-09-19T09:13:26.494836+0000', 'last_fullsized': '2024-09-19T09:13:26.494836+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T09:13:31.181 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1b is not active+clean 2024-09-19T09:13:31.181 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.494050+0000', 'last_change': '2024-09-19T09:13:26.494050+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.494050+0000', 'last_undegraded': '2024-09-19T09:13:26.494050+0000', 'last_fullsized': '2024-09-19T09:13:26.494050+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T09:13:31.181 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-09-19T09:13:31.181 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.496738+0000', 'last_change': '2024-09-19T09:13:26.496738+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.496738+0000', 'last_undegraded': '2024-09-19T09:13:26.496738+0000', 'last_fullsized': '2024-09-19T09:13:26.496738+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T09:13:31.181 INFO:tasks.ceph.ceph_manager.ceph:PG 3.19 is not active+clean 2024-09-19T09:13:31.182 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.495107+0000', 'last_change': '2024-09-19T09:13:26.495107+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.495107+0000', 'last_undegraded': '2024-09-19T09:13:26.495107+0000', 'last_fullsized': '2024-09-19T09:13:26.495107+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T09:13:31.182 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-09-19T09:13:31.182 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.494618+0000', 'last_change': '2024-09-19T09:13:26.494618+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.494618+0000', 'last_undegraded': '2024-09-19T09:13:26.494618+0000', 'last_fullsized': '2024-09-19T09:13:26.494618+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:13:31.182 INFO:tasks.ceph.ceph_manager.ceph:PG 3.17 is not active+clean 2024-09-19T09:13:31.182 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.497312+0000', 'last_change': '2024-09-19T09:13:26.497312+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.497312+0000', 'last_undegraded': '2024-09-19T09:13:26.497312+0000', 'last_fullsized': '2024-09-19T09:13:26.497312+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T09:13:31.182 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-09-19T09:13:31.182 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.495849+0000', 'last_change': '2024-09-19T09:13:26.495849+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.495849+0000', 'last_undegraded': '2024-09-19T09:13:26.495849+0000', 'last_fullsized': '2024-09-19T09:13:26.495849+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T09:13:31.182 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-09-19T09:13:31.182 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.492101+0000', 'last_change': '2024-09-19T09:13:26.492101+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.492101+0000', 'last_undegraded': '2024-09-19T09:13:26.492101+0000', 'last_fullsized': '2024-09-19T09:13:26.492101+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T09:13:31.182 INFO:tasks.ceph.ceph_manager.ceph:PG 3.12 is not active+clean 2024-09-19T09:13:31.182 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.493939+0000', 'last_change': '2024-09-19T09:13:26.493939+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.493939+0000', 'last_undegraded': '2024-09-19T09:13:26.493939+0000', 'last_fullsized': '2024-09-19T09:13:26.493939+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T09:13:31.182 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-09-19T09:13:31.183 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.502889+0000', 'last_change': '2024-09-19T09:13:26.502889+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.502889+0000', 'last_undegraded': '2024-09-19T09:13:26.502889+0000', 'last_fullsized': '2024-09-19T09:13:26.502889+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T09:13:31.183 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-09-19T09:13:31.183 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.493080+0000', 'last_change': '2024-09-19T09:13:26.493080+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.493080+0000', 'last_undegraded': '2024-09-19T09:13:26.493080+0000', 'last_fullsized': '2024-09-19T09:13:26.493080+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T09:13:31.183 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-09-19T09:13:31.183 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.497773+0000', 'last_change': '2024-09-19T09:13:26.497773+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.497773+0000', 'last_undegraded': '2024-09-19T09:13:26.497773+0000', 'last_fullsized': '2024-09-19T09:13:26.497773+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T09:13:31.183 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-09-19T09:13:31.183 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.495623+0000', 'last_change': '2024-09-19T09:13:26.495623+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.495623+0000', 'last_undegraded': '2024-09-19T09:13:26.495623+0000', 'last_fullsized': '2024-09-19T09:13:26.495623+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:13:31.183 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-09-19T09:13:31.183 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.492137+0000', 'last_change': '2024-09-19T09:13:26.492137+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.492137+0000', 'last_undegraded': '2024-09-19T09:13:26.492137+0000', 'last_fullsized': '2024-09-19T09:13:26.492137+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T09:13:31.183 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-09-19T09:13:31.183 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.492451+0000', 'last_change': '2024-09-19T09:13:26.492451+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.492451+0000', 'last_undegraded': '2024-09-19T09:13:26.492451+0000', 'last_fullsized': '2024-09-19T09:13:26.492451+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T09:13:31.183 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-09-19T09:13:31.184 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.499236+0000', 'last_change': '2024-09-19T09:13:26.499236+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.499236+0000', 'last_undegraded': '2024-09-19T09:13:26.499236+0000', 'last_fullsized': '2024-09-19T09:13:26.499236+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T09:13:31.184 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-09-19T09:13:31.184 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.492386+0000', 'last_change': '2024-09-19T09:13:26.492386+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.492386+0000', 'last_undegraded': '2024-09-19T09:13:26.492386+0000', 'last_fullsized': '2024-09-19T09:13:26.492386+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T09:13:31.184 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1 is not active+clean 2024-09-19T09:13:31.184 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.493391+0000', 'last_change': '2024-09-19T09:13:26.493391+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.493391+0000', 'last_undegraded': '2024-09-19T09:13:26.493391+0000', 'last_fullsized': '2024-09-19T09:13:26.493391+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T09:13:31.184 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-09-19T09:13:31.184 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.496742+0000', 'last_change': '2024-09-19T09:13:26.496742+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.496742+0000', 'last_undegraded': '2024-09-19T09:13:26.496742+0000', 'last_fullsized': '2024-09-19T09:13:26.496742+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T09:13:31.184 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-09-19T09:13:31.184 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.492202+0000', 'last_change': '2024-09-19T09:13:26.492202+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.492202+0000', 'last_undegraded': '2024-09-19T09:13:26.492202+0000', 'last_fullsized': '2024-09-19T09:13:26.492202+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T09:13:31.184 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-09-19T09:13:31.185 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.494697+0000', 'last_change': '2024-09-19T09:13:26.494697+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.494697+0000', 'last_undegraded': '2024-09-19T09:13:26.494697+0000', 'last_fullsized': '2024-09-19T09:13:26.494697+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:13:31.185 INFO:tasks.ceph.ceph_manager.ceph:PG 3.4 is not active+clean 2024-09-19T09:13:31.185 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.493530+0000', 'last_change': '2024-09-19T09:13:26.493530+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.493530+0000', 'last_undegraded': '2024-09-19T09:13:26.493530+0000', 'last_fullsized': '2024-09-19T09:13:26.493530+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T09:13:31.185 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-09-19T09:13:31.185 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.493180+0000', 'last_change': '2024-09-19T09:13:26.493180+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.493180+0000', 'last_undegraded': '2024-09-19T09:13:26.493180+0000', 'last_fullsized': '2024-09-19T09:13:26.493180+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T09:13:31.185 INFO:tasks.ceph.ceph_manager.ceph:PG 3.6 is not active+clean 2024-09-19T09:13:31.185 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.492377+0000', 'last_change': '2024-09-19T09:13:26.492377+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.492377+0000', 'last_undegraded': '2024-09-19T09:13:26.492377+0000', 'last_fullsized': '2024-09-19T09:13:26.492377+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T09:13:31.185 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-09-19T09:13:31.185 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.500926+0000', 'last_change': '2024-09-19T09:13:26.500926+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.500926+0000', 'last_undegraded': '2024-09-19T09:13:26.500926+0000', 'last_fullsized': '2024-09-19T09:13:26.500926+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T09:13:31.186 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-09-19T09:13:31.186 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.494868+0000', 'last_change': '2024-09-19T09:13:26.494868+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.494868+0000', 'last_undegraded': '2024-09-19T09:13:26.494868+0000', 'last_fullsized': '2024-09-19T09:13:26.494868+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T09:13:31.186 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-09-19T09:13:31.186 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.496063+0000', 'last_change': '2024-09-19T09:13:26.496063+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.496063+0000', 'last_undegraded': '2024-09-19T09:13:26.496063+0000', 'last_fullsized': '2024-09-19T09:13:26.496063+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T09:13:31.186 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-09-19T09:13:31.186 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.495443+0000', 'last_change': '2024-09-19T09:13:26.495443+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.495443+0000', 'last_undegraded': '2024-09-19T09:13:26.495443+0000', 'last_fullsized': '2024-09-19T09:13:26.495443+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T09:13:31.186 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-09-19T09:13:31.186 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.503380+0000', 'last_change': '2024-09-19T09:13:26.503380+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.503380+0000', 'last_undegraded': '2024-09-19T09:13:26.503380+0000', 'last_fullsized': '2024-09-19T09:13:26.503380+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T09:13:31.186 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-09-19T09:13:31.186 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.494803+0000', 'last_change': '2024-09-19T09:13:26.494803+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.494803+0000', 'last_undegraded': '2024-09-19T09:13:26.494803+0000', 'last_fullsized': '2024-09-19T09:13:26.494803+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T09:13:31.187 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1f is not active+clean 2024-09-19T09:13:31.187 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.494931+0000', 'last_change': '2024-09-19T09:13:26.494931+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.494931+0000', 'last_undegraded': '2024-09-19T09:13:26.494931+0000', 'last_fullsized': '2024-09-19T09:13:26.494931+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T09:13:31.187 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-09-19T09:13:31.187 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:13:26.497184+0000', 'last_change': '2024-09-19T09:13:26.497184+0000', 'last_active': '2024-09-19T09:13:26.482288+0000', 'last_peered': '2024-09-19T09:13:26.482288+0000', 'last_clean': '2024-09-19T09:13:26.482288+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:13:26.497184+0000', 'last_undegraded': '2024-09-19T09:13:26.497184+0000', 'last_fullsized': '2024-09-19T09:13:26.497184+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'last_clean_scrub_stamp': '2024-09-19T09:13:26.482288+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T09:13:31.187 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T09:13:31.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.312+0000 7f09e2dbe640 1 Processor -- start 2024-09-19T09:13:31.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.313+0000 7f09e2dbe640 1 -- start start 2024-09-19T09:13:31.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.313+0000 7f09e2dbe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09dc15ef50 0x7f09dc0d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:31.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.313+0000 7f09e2dbe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f09dc0d3240 0x7f09dc0d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:31.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.313+0000 7f09e2dbe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f09dc0d5780 0x7f09dc0cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:31.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.313+0000 7f09e2dbe640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f09dc0b7a90 con 0x7f09dc0d5780 2024-09-19T09:13:31.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.313+0000 7f09e2dbe640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f09dc0d3740 con 0x7f09dc0d3240 2024-09-19T09:13:31.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.313+0000 7f09e2dbe640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f09dc0d3a20 con 0x7f09dc15ef50 2024-09-19T09:13:31.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.314+0000 7f09e135b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f09dc0d5780 0x7f09dc0cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:31.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.314+0000 7f09e135b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f09dc0d5780 0x7f09dc0cf770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57096/0 (socket says 172.21.15.18:57096) 2024-09-19T09:13:31.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.314+0000 7f09e135b640 1 -- 172.21.15.18:0/3504355948 learned_addr learned my addr 172.21.15.18:0/3504355948 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:31.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.314+0000 7f09dbfff640 1 --2- 172.21.15.18:0/3504355948 >> v2:172.21.15.162:3300/0 conn(0x7f09dc0d3240 0x7f09dc0d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:31.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.314+0000 7f09e0b5a640 1 --2- 172.21.15.18:0/3504355948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09dc15ef50 0x7f09dc0d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:31.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.314+0000 7f09e135b640 1 -- 172.21.15.18:0/3504355948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09dc15ef50 msgr2=0x7f09dc0d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:31.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.314+0000 7f09e135b640 1 --2- 172.21.15.18:0/3504355948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09dc15ef50 0x7f09dc0d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:31.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.314+0000 7f09e135b640 1 -- 172.21.15.18:0/3504355948 >> v2:172.21.15.162:3300/0 conn(0x7f09dc0d3240 msgr2=0x7f09dc0d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:31.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.314+0000 7f09e135b640 1 --2- 172.21.15.18:0/3504355948 >> v2:172.21.15.162:3300/0 conn(0x7f09dc0d3240 0x7f09dc0d18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:31.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.314+0000 7f09e135b640 1 -- 172.21.15.18:0/3504355948 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09dc0b7d00 con 0x7f09dc0d5780 2024-09-19T09:13:31.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.315+0000 7f09e135b640 1 --2- 172.21.15.18:0/3504355948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09dc0d5780 0x7f09dc0cf770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f09dc08d920 tx=0x7f09cc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7e5d76a65ebe88 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:31.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.315+0000 7f09db7fe640 1 -- 172.21.15.18:0/3504355948 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc037070 con 0x7f09dc0d5780 2024-09-19T09:13:31.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.315+0000 7f09db7fe640 1 -- 172.21.15.18:0/3504355948 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09cc032440 con 0x7f09dc0d5780 2024-09-19T09:13:31.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.315+0000 7f09db7fe640 1 -- 172.21.15.18:0/3504355948 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc032810 con 0x7f09dc0d5780 2024-09-19T09:13:31.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.315+0000 7f09e2dbe640 1 -- 172.21.15.18:0/3504355948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09dc0d5780 msgr2=0x7f09dc0cf770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:31.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.315+0000 7f09e2dbe640 1 --2- 172.21.15.18:0/3504355948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09dc0d5780 0x7f09dc0cf770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f09dc08d920 tx=0x7f09cc02a140 comp rx=0 tx=0).stop 2024-09-19T09:13:31.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.315+0000 7f09e2dbe640 1 -- 172.21.15.18:0/3504355948 shutdown_connections 2024-09-19T09:13:31.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.315+0000 7f09e2dbe640 1 --2- 172.21.15.18:0/3504355948 >> v2:172.21.15.162:3300/0 conn(0x7f09dc0d3240 0x7f09dc0d18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:31.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.315+0000 7f09e2dbe640 1 --2- 172.21.15.18:0/3504355948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09dc0d5780 0x7f09dc0cf770 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:31.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.315+0000 7f09e2dbe640 1 --2- 172.21.15.18:0/3504355948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09dc15ef50 0x7f09dc0d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:31.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.315+0000 7f09e2dbe640 1 -- 172.21.15.18:0/3504355948 >> 172.21.15.18:0/3504355948 conn(0x7f09dc0d4c60 msgr2=0x7f09dc0d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:31.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.315+0000 7f09e2dbe640 1 -- 172.21.15.18:0/3504355948 shutdown_connections 2024-09-19T09:13:31.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.315+0000 7f09e2dbe640 1 -- 172.21.15.18:0/3504355948 wait complete. 2024-09-19T09:13:31.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.317+0000 7f09e2dbe640 1 Processor -- start 2024-09-19T09:13:31.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.317+0000 7f09e2dbe640 1 -- start start 2024-09-19T09:13:31.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.317+0000 7f09e2dbe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09dc0d3240 0x7f09dc15aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:31.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.317+0000 7f09e2dbe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09dc0d5780 0x7f09dc0cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:31.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.317+0000 7f09e2dbe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09dc15ef50 0x7f09dc0d04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:31.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.317+0000 7f09e2dbe640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f09dc0d21a0 con 0x7f09dc0d3240 2024-09-19T09:13:31.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.317+0000 7f09e2dbe640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f09dc0d2020 con 0x7f09dc0d5780 2024-09-19T09:13:31.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.317+0000 7f09e2dbe640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f09dc0cfcb0 con 0x7f09dc15ef50 2024-09-19T09:13:31.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.318+0000 7f09e0b5a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09dc0d3240 0x7f09dc15aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:31.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.318+0000 7f09e0b5a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09dc0d3240 0x7f09dc15aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57110/0 (socket says 172.21.15.18:57110) 2024-09-19T09:13:31.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.318+0000 7f09e0b5a640 1 -- 172.21.15.18:0/3952532291 learned_addr learned my addr 172.21.15.18:0/3952532291 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:31.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.318+0000 7f09e135b640 1 --2- 172.21.15.18:0/3952532291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09dc15ef50 0x7f09dc0d04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:31.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.318+0000 7f09dbfff640 1 --2- 172.21.15.18:0/3952532291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09dc0d5780 0x7f09dc0cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:31.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.318+0000 7f09e0b5a640 1 -- 172.21.15.18:0/3952532291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09dc15ef50 msgr2=0x7f09dc0d04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:31.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.318+0000 7f09e0b5a640 1 --2- 172.21.15.18:0/3952532291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09dc15ef50 0x7f09dc0d04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:31.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.318+0000 7f09e0b5a640 1 -- 172.21.15.18:0/3952532291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09dc0d5780 msgr2=0x7f09dc0cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:31.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.318+0000 7f09e0b5a640 1 --2- 172.21.15.18:0/3952532291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09dc0d5780 0x7f09dc0cffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:31.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.318+0000 7f09e0b5a640 1 -- 172.21.15.18:0/3952532291 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09dc15b430 con 0x7f09dc0d3240 2024-09-19T09:13:31.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.318+0000 7f09e0b5a640 1 --2- 172.21.15.18:0/3952532291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09dc0d3240 0x7f09dc15aef0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f09d4007e70 tx=0x7f09d400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:31.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.318+0000 7f09d97fa640 1 -- 172.21.15.18:0/3952532291 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d4014420 con 0x7f09dc0d3240 2024-09-19T09:13:31.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.318+0000 7f09d97fa640 1 -- 172.21.15.18:0/3952532291 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09d4019070 con 0x7f09dc0d3240 2024-09-19T09:13:31.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.318+0000 7f09e2dbe640 1 -- 172.21.15.18:0/3952532291 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09dc15a130 con 0x7f09dc0d3240 2024-09-19T09:13:31.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.318+0000 7f09d97fa640 1 -- 172.21.15.18:0/3952532291 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d4014800 con 0x7f09dc0d3240 2024-09-19T09:13:31.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.318+0000 7f09e2dbe640 1 -- 172.21.15.18:0/3952532291 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09dc15a6f0 con 0x7f09dc0d3240 2024-09-19T09:13:31.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.319+0000 7f09e2dbe640 1 -- 172.21.15.18:0/3952532291 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09dc0cf770 con 0x7f09dc0d3240 2024-09-19T09:13:31.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.320+0000 7f09d97fa640 1 -- 172.21.15.18:0/3952532291 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f09d40149a0 con 0x7f09dc0d3240 2024-09-19T09:13:31.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.320+0000 7f09d97fa640 1 --2- 172.21.15.18:0/3952532291 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f09bc06c2b0 0x7f09bc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:31.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.320+0000 7f09d97fa640 1 -- 172.21.15.18:0/3952532291 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f09d408ba90 con 0x7f09dc0d3240 2024-09-19T09:13:31.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.321+0000 7f09dbfff640 1 --2- 172.21.15.18:0/3952532291 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f09bc06c2b0 0x7f09bc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:31.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.321+0000 7f09dbfff640 1 --2- 172.21.15.18:0/3952532291 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f09bc06c2b0 0x7f09bc06e770 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f09dc15d300 tx=0x7f09c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:31.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.325+0000 7f09d97fa640 1 -- 172.21.15.18:0/3952532291 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f09dc15b430 con 0x7f09dc0d3240 2024-09-19T09:13:31.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.567+0000 7f09e2dbe640 1 -- 172.21.15.18:0/3952532291 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f09dc06d650 con 0x7f09dc0d3240 2024-09-19T09:13:31.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.568+0000 7f09d97fa640 1 -- 172.21.15.18:0/3952532291 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1068 (secure 0 0 0) 0x7f09d4059bb0 con 0x7f09dc0d3240 2024-09-19T09:13:31.568 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:31.568 INFO:teuthology.orchestra.run.smithi018.stdout:{"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":20,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1726737196,"num_in_osds":8,"osd_in_since":1726737193,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":1642046,"bytes_avail":1598357954,"bytes_total":1600000000,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":6,"btime":"2024-09-19T09:13:29:505412+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4275}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-19T09:13:11.349867+0000","services":{}},"progress_events":{}} 2024-09-19T09:13:31.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.570+0000 7f09e2dbe640 1 -- 172.21.15.18:0/3952532291 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f09bc06c2b0 msgr2=0x7f09bc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:31.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.570+0000 7f09e2dbe640 1 --2- 172.21.15.18:0/3952532291 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f09bc06c2b0 0x7f09bc06e770 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f09dc15d300 tx=0x7f09c4008040 comp rx=0 tx=0).stop 2024-09-19T09:13:31.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.570+0000 7f09e2dbe640 1 -- 172.21.15.18:0/3952532291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09dc0d3240 msgr2=0x7f09dc15aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:31.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.570+0000 7f09e2dbe640 1 --2- 172.21.15.18:0/3952532291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09dc0d3240 0x7f09dc15aef0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f09d4007e70 tx=0x7f09d400e4b0 comp rx=0 tx=0).stop 2024-09-19T09:13:31.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.570+0000 7f09e2dbe640 1 -- 172.21.15.18:0/3952532291 shutdown_connections 2024-09-19T09:13:31.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.570+0000 7f09e2dbe640 1 --2- 172.21.15.18:0/3952532291 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f09bc06c2b0 0x7f09bc06e770 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:31.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.570+0000 7f09e2dbe640 1 --2- 172.21.15.18:0/3952532291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f09dc15ef50 0x7f09dc0d04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:31.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.570+0000 7f09e2dbe640 1 --2- 172.21.15.18:0/3952532291 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09dc0d5780 0x7f09dc0cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:31.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.570+0000 7f09e2dbe640 1 --2- 172.21.15.18:0/3952532291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09dc0d3240 0x7f09dc15aef0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:31.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.570+0000 7f09e2dbe640 1 -- 172.21.15.18:0/3952532291 >> 172.21.15.18:0/3952532291 conn(0x7f09dc0d4c60 msgr2=0x7f09dc0b8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:31.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.570+0000 7f09e2dbe640 1 -- 172.21.15.18:0/3952532291 shutdown_connections 2024-09-19T09:13:31.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.570+0000 7f09e2dbe640 1 -- 172.21.15.18:0/3952532291 wait complete. 2024-09-19T09:13:31.581 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-19T09:13:31.581 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:13:31.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.683+0000 7f2b139be640 1 Processor -- start 2024-09-19T09:13:31.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.683+0000 7f2b139be640 1 -- start start 2024-09-19T09:13:31.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.684+0000 7f2b139be640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2b0c15ef80 0x7f2b0c0b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:31.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.684+0000 7f2b139be640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2b0c06d730 0x7f2b0c0cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:31.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.684+0000 7f2b139be640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b0c0cd1a0 con 0x7f2b0c0cf910 2024-09-19T09:13:31.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.684+0000 7f2b139be640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f2b0c0cd7d0 con 0x7f2b0c06d730 2024-09-19T09:13:31.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.684+0000 7f2b139be640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2b0c06dc30 con 0x7f2b0c15ef80 2024-09-19T09:13:31.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.684+0000 7f2b10f59640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2b0c06d730 0x7f2b0c0cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:31.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.684+0000 7f2b11f5b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f2b0c0cf910 0x7f2b0c0d0ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34630/0 (socket says 172.21.15.18:34630) 2024-09-19T09:13:31.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.684+0000 7f2b10f59640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2b0c06d730 0x7f2b0c0cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57114/0 (socket says 172.21.15.18:57114) 2024-09-19T09:13:31.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.684+0000 7f2b11f5b640 1 -- 172.21.15.18:0/737538572 learned_addr learned my addr 172.21.15.18:0/737538572 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:31.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.684+0000 7f2b1175a640 1 --2- 172.21.15.18:0/737538572 >> v2:172.21.15.162:3300/0 conn(0x7f2b0c15ef80 0x7f2b0c0b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:31.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.684+0000 7f2b10f59640 1 -- 172.21.15.18:0/737538572 >> v2:172.21.15.162:3300/0 conn(0x7f2b0c15ef80 msgr2=0x7f2b0c0b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:31.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.684+0000 7f2b10f59640 1 --2- 172.21.15.18:0/737538572 >> v2:172.21.15.162:3300/0 conn(0x7f2b0c15ef80 0x7f2b0c0b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:31.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.684+0000 7f2b10f59640 1 -- 172.21.15.18:0/737538572 >> v1:172.21.15.18:6789/0 conn(0x7f2b0c0cf910 legacy=0x7f2b0c0d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:31.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.684+0000 7f2b10f59640 1 -- 172.21.15.18:0/737538572 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b0c06df10 con 0x7f2b0c06d730 2024-09-19T09:13:31.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.685+0000 7f2b10f59640 1 --2- 172.21.15.18:0/737538572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b0c06d730 0x7f2b0c0cf3d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c06f6e0 tx=0x7f2afc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=768cd4fed5b5d08f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:31.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.685+0000 7f2b03fff640 1 -- 172.21.15.18:0/737538572 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc037070 con 0x7f2b0c06d730 2024-09-19T09:13:31.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.685+0000 7f2b03fff640 1 -- 172.21.15.18:0/737538572 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2afc032440 con 0x7f2b0c06d730 2024-09-19T09:13:31.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.685+0000 7f2b03fff640 1 -- 172.21.15.18:0/737538572 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2afc032810 con 0x7f2b0c06d730 2024-09-19T09:13:31.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.686+0000 7f2b139be640 1 -- 172.21.15.18:0/737538572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b0c06d730 msgr2=0x7f2b0c0cf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:31.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.686+0000 7f2b139be640 1 --2- 172.21.15.18:0/737538572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b0c06d730 0x7f2b0c0cf3d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c06f6e0 tx=0x7f2afc02a1a0 comp rx=0 tx=0).stop 2024-09-19T09:13:31.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.686+0000 7f2b139be640 1 -- 172.21.15.18:0/737538572 shutdown_connections 2024-09-19T09:13:31.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.686+0000 7f2b139be640 1 --2- 172.21.15.18:0/737538572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b0c06d730 0x7f2b0c0cf3d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:31.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.686+0000 7f2b139be640 1 --2- 172.21.15.18:0/737538572 >> v2:172.21.15.162:3300/0 conn(0x7f2b0c15ef80 0x7f2b0c0b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:31.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.686+0000 7f2b139be640 1 -- 172.21.15.18:0/737538572 >> 172.21.15.18:0/737538572 conn(0x7f2b0c0b4700 msgr2=0x7f2b0c0b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:31.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.686+0000 7f2b139be640 1 -- 172.21.15.18:0/737538572 shutdown_connections 2024-09-19T09:13:31.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.686+0000 7f2b139be640 1 -- 172.21.15.18:0/737538572 wait complete. 2024-09-19T09:13:31.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.687+0000 7f2b139be640 1 Processor -- start 2024-09-19T09:13:31.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.687+0000 7f2b139be640 1 -- start start 2024-09-19T09:13:31.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.688+0000 7f2b139be640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b0c06d730 0x7f2b0c158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:31.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.688+0000 7f2b139be640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b0c0cf910 0x7f2b0c0c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:31.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.688+0000 7f2b139be640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b0c15ef80 0x7f2b0c1579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:31.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.688+0000 7f2b139be640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0c0d0120 con 0x7f2b0c15ef80 2024-09-19T09:13:31.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.688+0000 7f2b139be640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0c15f360 con 0x7f2b0c0cf910 2024-09-19T09:13:31.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.688+0000 7f2b139be640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2b0c0cec70 con 0x7f2b0c06d730 2024-09-19T09:13:31.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.688+0000 7f2b11f5b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b0c15ef80 0x7f2b0c1579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:31.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.688+0000 7f2b11f5b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b0c15ef80 0x7f2b0c1579c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57122/0 (socket says 172.21.15.18:57122) 2024-09-19T09:13:31.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.688+0000 7f2b11f5b640 1 -- 172.21.15.18:0/3755627212 learned_addr learned my addr 172.21.15.18:0/3755627212 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:31.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.688+0000 7f2b10f59640 1 --2- 172.21.15.18:0/3755627212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b0c0cf910 0x7f2b0c0c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:31.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.688+0000 7f2b1175a640 1 --2- 172.21.15.18:0/3755627212 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b0c06d730 0x7f2b0c158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:31.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.688+0000 7f2b11f5b640 1 -- 172.21.15.18:0/3755627212 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b0c06d730 msgr2=0x7f2b0c158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:31.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.688+0000 7f2b11f5b640 1 --2- 172.21.15.18:0/3755627212 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b0c06d730 0x7f2b0c158080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:31.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.688+0000 7f2b11f5b640 1 -- 172.21.15.18:0/3755627212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b0c0cf910 msgr2=0x7f2b0c0c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:31.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.688+0000 7f2b11f5b640 1 --2- 172.21.15.18:0/3755627212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b0c0cf910 0x7f2b0c0c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:31.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.688+0000 7f2b11f5b640 1 -- 172.21.15.18:0/3755627212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b0c160110 con 0x7f2b0c15ef80 2024-09-19T09:13:31.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.688+0000 7f2b1175a640 1 --2- 172.21.15.18:0/3755627212 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b0c06d730 0x7f2b0c158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:13:31.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.688+0000 7f2b11f5b640 1 --2- 172.21.15.18:0/3755627212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b0c15ef80 0x7f2b0c1579c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400caa0 tx=0x7f2b0400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:31.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.688+0000 7f2b01ffb640 1 -- 172.21.15.18:0/3755627212 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b04017070 con 0x7f2b0c15ef80 2024-09-19T09:13:31.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.688+0000 7f2b01ffb640 1 -- 172.21.15.18:0/3755627212 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b0400ac00 con 0x7f2b0c15ef80 2024-09-19T09:13:31.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.688+0000 7f2b01ffb640 1 -- 172.21.15.18:0/3755627212 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b04012620 con 0x7f2b0c15ef80 2024-09-19T09:13:31.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.688+0000 7f2b139be640 1 -- 172.21.15.18:0/3755627212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b0c0ca320 con 0x7f2b0c15ef80 2024-09-19T09:13:31.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.689+0000 7f2b139be640 1 -- 172.21.15.18:0/3755627212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b0c0ccbc0 con 0x7f2b0c15ef80 2024-09-19T09:13:31.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.690+0000 7f2b139be640 1 -- 172.21.15.18:0/3755627212 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b0c0cf3d0 con 0x7f2b0c15ef80 2024-09-19T09:13:31.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.690+0000 7f2b01ffb640 1 -- 172.21.15.18:0/3755627212 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2b0401a070 con 0x7f2b0c15ef80 2024-09-19T09:13:31.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.691+0000 7f2b01ffb640 1 --2- 172.21.15.18:0/3755627212 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2af006c2b0 0x7f2af006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:31.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.691+0000 7f2b01ffb640 1 -- 172.21.15.18:0/3755627212 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2b0408b170 con 0x7f2b0c15ef80 2024-09-19T09:13:31.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.691+0000 7f2b1175a640 1 --2- 172.21.15.18:0/3755627212 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2af006c2b0 0x7f2af006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:31.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.691+0000 7f2b1175a640 1 --2- 172.21.15.18:0/3755627212 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2af006c2b0 0x7f2af006e770 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2b08006fd0 tx=0x7f2b08008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:31.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.695+0000 7f2b01ffb640 1 -- 172.21.15.18:0/3755627212 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2b040591f0 con 0x7f2b0c15ef80 2024-09-19T09:13:31.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.867+0000 7f2b139be640 1 -- 172.21.15.18:0/3755627212 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2b0c0cff00 con 0x7f2af006c2b0 2024-09-19T09:13:31.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.874+0000 7f2b01ffb640 1 -- 172.21.15.18:0/3755627212 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242209 (secure 0 0 0) 0x7f2b0c0cff00 con 0x7f2af006c2b0 2024-09-19T09:13:31.876 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:31.877 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:13:31.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.877+0000 7f2b139be640 1 -- 172.21.15.18:0/3755627212 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2af006c2b0 msgr2=0x7f2af006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:31.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.877+0000 7f2b139be640 1 --2- 172.21.15.18:0/3755627212 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2af006c2b0 0x7f2af006e770 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2b08006fd0 tx=0x7f2b08008040 comp rx=0 tx=0).stop 2024-09-19T09:13:31.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.877+0000 7f2b139be640 1 -- 172.21.15.18:0/3755627212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b0c15ef80 msgr2=0x7f2b0c1579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:31.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.877+0000 7f2b139be640 1 --2- 172.21.15.18:0/3755627212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b0c15ef80 0x7f2b0c1579c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2b0400caa0 tx=0x7f2b0400cf60 comp rx=0 tx=0).stop 2024-09-19T09:13:31.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.877+0000 7f2b139be640 1 -- 172.21.15.18:0/3755627212 shutdown_connections 2024-09-19T09:13:31.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.877+0000 7f2b139be640 1 --2- 172.21.15.18:0/3755627212 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2af006c2b0 0x7f2af006e770 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:31.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.877+0000 7f2b139be640 1 --2- 172.21.15.18:0/3755627212 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b0c15ef80 0x7f2b0c1579c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:31.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.877+0000 7f2b139be640 1 --2- 172.21.15.18:0/3755627212 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b0c0cf910 0x7f2b0c0c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:31.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.877+0000 7f2b139be640 1 --2- 172.21.15.18:0/3755627212 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b0c06d730 0x7f2b0c158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:31.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.877+0000 7f2b139be640 1 -- 172.21.15.18:0/3755627212 >> 172.21.15.18:0/3755627212 conn(0x7f2b0c0b4700 msgr2=0x7f2b0c070e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:31.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.877+0000 7f2b139be640 1 -- 172.21.15.18:0/3755627212 shutdown_connections 2024-09-19T09:13:31.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:31.877+0000 7f2b139be640 1 -- 172.21.15.18:0/3755627212 wait complete. 2024-09-19T09:13:31.888 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-19T09:13:31.522732+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1603,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560896,"statfs":{"total":1600000000,"available":1598357954,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001011"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493236+0000","last_change":"2024-09-19T09:13:26.493236+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493236+0000","last_undegraded":"2024-09-19T09:13:26.493236+0000","last_fullsized":"2024-09-19T09:13:26.493236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.496430+0000","last_change":"2024-09-19T09:13:26.496430+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.496430+0000","last_undegraded":"2024-09-19T09:13:26.496430+0000","last_fullsized":"2024-09-19T09:13:26.496430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495677+0000","last_change":"2024-09-19T09:13:26.495677+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495677+0000","last_undegraded":"2024-09-19T09:13:26.495677+0000","last_fullsized":"2024-09-19T09:13:26.495677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495028+0000","last_change":"2024-09-19T09:13:26.495028+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495028+0000","last_undegraded":"2024-09-19T09:13:26.495028+0000","last_fullsized":"2024-09-19T09:13:26.495028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493323+0000","last_change":"2024-09-19T09:13:26.493323+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493323+0000","last_undegraded":"2024-09-19T09:13:26.493323+0000","last_fullsized":"2024-09-19T09:13:26.493323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.498629+0000","last_change":"2024-09-19T09:13:26.498629+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.498629+0000","last_undegraded":"2024-09-19T09:13:26.498629+0000","last_fullsized":"2024-09-19T09:13:26.498629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493313+0000","last_change":"2024-09-19T09:13:26.493313+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493313+0000","last_undegraded":"2024-09-19T09:13:26.493313+0000","last_fullsized":"2024-09-19T09:13:26.493313+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495284+0000","last_change":"2024-09-19T09:13:26.495284+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495284+0000","last_undegraded":"2024-09-19T09:13:26.495284+0000","last_fullsized":"2024-09-19T09:13:26.495284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493039+0000","last_change":"2024-09-19T09:13:26.493039+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493039+0000","last_undegraded":"2024-09-19T09:13:26.493039+0000","last_fullsized":"2024-09-19T09:13:26.493039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492910+0000","last_change":"2024-09-19T09:13:26.492910+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492910+0000","last_undegraded":"2024-09-19T09:13:26.492910+0000","last_fullsized":"2024-09-19T09:13:26.492910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492691+0000","last_change":"2024-09-19T09:13:26.492691+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492691+0000","last_undegraded":"2024-09-19T09:13:26.492691+0000","last_fullsized":"2024-09-19T09:13:26.492691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492910+0000","last_change":"2024-09-19T09:13:26.492910+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492910+0000","last_undegraded":"2024-09-19T09:13:26.492910+0000","last_fullsized":"2024-09-19T09:13:26.492910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494922+0000","last_change":"2024-09-19T09:13:26.494922+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494922+0000","last_undegraded":"2024-09-19T09:13:26.494922+0000","last_fullsized":"2024-09-19T09:13:26.494922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494340+0000","last_change":"2024-09-19T09:13:26.494340+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494340+0000","last_undegraded":"2024-09-19T09:13:26.494340+0000","last_fullsized":"2024-09-19T09:13:26.494340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.499204+0000","last_change":"2024-09-19T09:13:26.499204+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.499204+0000","last_undegraded":"2024-09-19T09:13:26.499204+0000","last_fullsized":"2024-09-19T09:13:26.499204+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.499867+0000","last_change":"2024-09-19T09:13:26.499867+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.499867+0000","last_undegraded":"2024-09-19T09:13:26.499867+0000","last_fullsized":"2024-09-19T09:13:26.499867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.498092+0000","last_change":"2024-09-19T09:13:26.498092+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.498092+0000","last_undegraded":"2024-09-19T09:13:26.498092+0000","last_fullsized":"2024-09-19T09:13:26.498092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.496381+0000","last_change":"2024-09-19T09:13:26.496381+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.496381+0000","last_undegraded":"2024-09-19T09:13:26.496381+0000","last_fullsized":"2024-09-19T09:13:26.496381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494819+0000","last_change":"2024-09-19T09:13:26.494819+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494819+0000","last_undegraded":"2024-09-19T09:13:26.494819+0000","last_fullsized":"2024-09-19T09:13:26.494819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492532+0000","last_change":"2024-09-19T09:13:26.492532+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492532+0000","last_undegraded":"2024-09-19T09:13:26.492532+0000","last_fullsized":"2024-09-19T09:13:26.492532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.498133+0000","last_change":"2024-09-19T09:13:26.498133+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.498133+0000","last_undegraded":"2024-09-19T09:13:26.498133+0000","last_fullsized":"2024-09-19T09:13:26.498133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494421+0000","last_change":"2024-09-19T09:13:26.494421+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494421+0000","last_undegraded":"2024-09-19T09:13:26.494421+0000","last_fullsized":"2024-09-19T09:13:26.494421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494445+0000","last_change":"2024-09-19T09:13:26.494445+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494445+0000","last_undegraded":"2024-09-19T09:13:26.494445+0000","last_fullsized":"2024-09-19T09:13:26.494445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.496247+0000","last_change":"2024-09-19T09:13:26.496247+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.496247+0000","last_undegraded":"2024-09-19T09:13:26.496247+0000","last_fullsized":"2024-09-19T09:13:26.496247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.498759+0000","last_change":"2024-09-19T09:13:26.498759+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.498759+0000","last_undegraded":"2024-09-19T09:13:26.498759+0000","last_fullsized":"2024-09-19T09:13:26.498759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.497481+0000","last_change":"2024-09-19T09:13:26.497481+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.497481+0000","last_undegraded":"2024-09-19T09:13:26.497481+0000","last_fullsized":"2024-09-19T09:13:26.497481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494439+0000","last_change":"2024-09-19T09:13:26.494439+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494439+0000","last_undegraded":"2024-09-19T09:13:26.494439+0000","last_fullsized":"2024-09-19T09:13:26.494439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494550+0000","last_change":"2024-09-19T09:13:26.494550+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494550+0000","last_undegraded":"2024-09-19T09:13:26.494550+0000","last_fullsized":"2024-09-19T09:13:26.494550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.498239+0000","last_change":"2024-09-19T09:13:26.498239+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.498239+0000","last_undegraded":"2024-09-19T09:13:26.498239+0000","last_fullsized":"2024-09-19T09:13:26.498239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.503713+0000","last_change":"2024-09-19T09:13:26.503713+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.503713+0000","last_undegraded":"2024-09-19T09:13:26.503713+0000","last_fullsized":"2024-09-19T09:13:26.503713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493598+0000","last_change":"2024-09-19T09:13:26.493598+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493598+0000","last_undegraded":"2024-09-19T09:13:26.493598+0000","last_fullsized":"2024-09-19T09:13:26.493598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495036+0000","last_change":"2024-09-19T09:13:26.495036+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495036+0000","last_undegraded":"2024-09-19T09:13:26.495036+0000","last_fullsized":"2024-09-19T09:13:26.495036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494836+0000","last_change":"2024-09-19T09:13:26.494836+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494836+0000","last_undegraded":"2024-09-19T09:13:26.494836+0000","last_fullsized":"2024-09-19T09:13:26.494836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.503270+0000","last_change":"2024-09-19T09:13:26.503044+0000","last_active":"2024-09-19T09:13:26.503270+0000","last_peered":"2024-09-19T09:13:26.503270+0000","last_clean":"2024-09-19T09:13:26.503270+0000","last_became_active":"2024-09-19T09:13:26.502787+0000","last_became_peered":"2024-09-19T09:13:26.502787+0000","last_unstale":"2024-09-19T09:13:26.503270+0000","last_undegraded":"2024-09-19T09:13:26.503270+0000","last_fullsized":"2024-09-19T09:13:26.503270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:24.518221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494050+0000","last_change":"2024-09-19T09:13:26.494050+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494050+0000","last_undegraded":"2024-09-19T09:13:26.494050+0000","last_fullsized":"2024-09-19T09:13:26.494050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506840+0000","last_change":"2024-09-19T09:13:26.506712+0000","last_active":"2024-09-19T09:13:26.506840+0000","last_peered":"2024-09-19T09:13:26.506840+0000","last_clean":"2024-09-19T09:13:26.506840+0000","last_became_active":"2024-09-19T09:13:26.506244+0000","last_became_peered":"2024-09-19T09:13:26.506244+0000","last_unstale":"2024-09-19T09:13:26.506840+0000","last_undegraded":"2024-09-19T09:13:26.506840+0000","last_fullsized":"2024-09-19T09:13:26.506840+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:22.213563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.505747+0000","last_change":"2024-09-19T09:13:26.505620+0000","last_active":"2024-09-19T09:13:26.505747+0000","last_peered":"2024-09-19T09:13:26.505747+0000","last_clean":"2024-09-19T09:13:26.505747+0000","last_became_active":"2024-09-19T09:13:26.505383+0000","last_became_peered":"2024-09-19T09:13:26.505383+0000","last_unstale":"2024-09-19T09:13:26.505747+0000","last_undegraded":"2024-09-19T09:13:26.505747+0000","last_fullsized":"2024-09-19T09:13:26.505747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:28.390700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.496738+0000","last_change":"2024-09-19T09:13:26.496738+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.496738+0000","last_undegraded":"2024-09-19T09:13:26.496738+0000","last_fullsized":"2024-09-19T09:13:26.496738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.507154+0000","last_change":"2024-09-19T09:13:26.507051+0000","last_active":"2024-09-19T09:13:26.507154+0000","last_peered":"2024-09-19T09:13:26.507154+0000","last_clean":"2024-09-19T09:13:26.507154+0000","last_became_active":"2024-09-19T09:13:26.506557+0000","last_became_peered":"2024-09-19T09:13:26.506557+0000","last_unstale":"2024-09-19T09:13:26.507154+0000","last_undegraded":"2024-09-19T09:13:26.507154+0000","last_fullsized":"2024-09-19T09:13:26.507154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:46.168867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495107+0000","last_change":"2024-09-19T09:13:26.495107+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495107+0000","last_undegraded":"2024-09-19T09:13:26.495107+0000","last_fullsized":"2024-09-19T09:13:26.495107+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.501169+0000","last_change":"2024-09-19T09:13:26.501053+0000","last_active":"2024-09-19T09:13:26.501169+0000","last_peered":"2024-09-19T09:13:26.501169+0000","last_clean":"2024-09-19T09:13:26.501169+0000","last_became_active":"2024-09-19T09:13:26.500814+0000","last_became_peered":"2024-09-19T09:13:26.500814+0000","last_unstale":"2024-09-19T09:13:26.501169+0000","last_undegraded":"2024-09-19T09:13:26.501169+0000","last_fullsized":"2024-09-19T09:13:26.501169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:28.680916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494618+0000","last_change":"2024-09-19T09:13:26.494618+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494618+0000","last_undegraded":"2024-09-19T09:13:26.494618+0000","last_fullsized":"2024-09-19T09:13:26.494618+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.499090+0000","last_change":"2024-09-19T09:13:26.498971+0000","last_active":"2024-09-19T09:13:26.499090+0000","last_peered":"2024-09-19T09:13:26.499090+0000","last_clean":"2024-09-19T09:13:26.499090+0000","last_became_active":"2024-09-19T09:13:26.498737+0000","last_became_peered":"2024-09-19T09:13:26.498737+0000","last_unstale":"2024-09-19T09:13:26.499090+0000","last_undegraded":"2024-09-19T09:13:26.499090+0000","last_fullsized":"2024-09-19T09:13:26.499090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:38.734255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.497312+0000","last_change":"2024-09-19T09:13:26.497312+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.497312+0000","last_undegraded":"2024-09-19T09:13:26.497312+0000","last_fullsized":"2024-09-19T09:13:26.497312+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.500092+0000","last_change":"2024-09-19T09:13:26.499983+0000","last_active":"2024-09-19T09:13:26.500092+0000","last_peered":"2024-09-19T09:13:26.500092+0000","last_clean":"2024-09-19T09:13:26.500092+0000","last_became_active":"2024-09-19T09:13:26.499730+0000","last_became_peered":"2024-09-19T09:13:26.499730+0000","last_unstale":"2024-09-19T09:13:26.500092+0000","last_undegraded":"2024-09-19T09:13:26.500092+0000","last_fullsized":"2024-09-19T09:13:26.500092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:48.658839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495849+0000","last_change":"2024-09-19T09:13:26.495849+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495849+0000","last_undegraded":"2024-09-19T09:13:26.495849+0000","last_fullsized":"2024-09-19T09:13:26.495849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.502099+0000","last_change":"2024-09-19T09:13:26.501792+0000","last_active":"2024-09-19T09:13:26.502099+0000","last_peered":"2024-09-19T09:13:26.502099+0000","last_clean":"2024-09-19T09:13:26.502099+0000","last_became_active":"2024-09-19T09:13:26.501463+0000","last_became_peered":"2024-09-19T09:13:26.501463+0000","last_unstale":"2024-09-19T09:13:26.502099+0000","last_undegraded":"2024-09-19T09:13:26.502099+0000","last_fullsized":"2024-09-19T09:13:26.502099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:26.102412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492101+0000","last_change":"2024-09-19T09:13:26.492101+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492101+0000","last_undegraded":"2024-09-19T09:13:26.492101+0000","last_fullsized":"2024-09-19T09:13:26.492101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.498160+0000","last_change":"2024-09-19T09:13:26.498042+0000","last_active":"2024-09-19T09:13:26.498160+0000","last_peered":"2024-09-19T09:13:26.498160+0000","last_clean":"2024-09-19T09:13:26.498160+0000","last_became_active":"2024-09-19T09:13:26.497811+0000","last_became_peered":"2024-09-19T09:13:26.497811+0000","last_unstale":"2024-09-19T09:13:26.498160+0000","last_undegraded":"2024-09-19T09:13:26.498160+0000","last_fullsized":"2024-09-19T09:13:26.498160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:55.846136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493939+0000","last_change":"2024-09-19T09:13:26.493939+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493939+0000","last_undegraded":"2024-09-19T09:13:26.493939+0000","last_fullsized":"2024-09-19T09:13:26.493939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.507135+0000","last_change":"2024-09-19T09:13:26.507022+0000","last_active":"2024-09-19T09:13:26.507135+0000","last_peered":"2024-09-19T09:13:26.507135+0000","last_clean":"2024-09-19T09:13:26.507135+0000","last_became_active":"2024-09-19T09:13:26.506756+0000","last_became_peered":"2024-09-19T09:13:26.506756+0000","last_unstale":"2024-09-19T09:13:26.507135+0000","last_undegraded":"2024-09-19T09:13:26.507135+0000","last_fullsized":"2024-09-19T09:13:26.507135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:25.794251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.502889+0000","last_change":"2024-09-19T09:13:26.502889+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.502889+0000","last_undegraded":"2024-09-19T09:13:26.502889+0000","last_fullsized":"2024-09-19T09:13:26.502889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506922+0000","last_change":"2024-09-19T09:13:26.506703+0000","last_active":"2024-09-19T09:13:26.506922+0000","last_peered":"2024-09-19T09:13:26.506922+0000","last_clean":"2024-09-19T09:13:26.506922+0000","last_became_active":"2024-09-19T09:13:26.506378+0000","last_became_peered":"2024-09-19T09:13:26.506378+0000","last_unstale":"2024-09-19T09:13:26.506922+0000","last_undegraded":"2024-09-19T09:13:26.506922+0000","last_fullsized":"2024-09-19T09:13:26.506922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:22.859672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493080+0000","last_change":"2024-09-19T09:13:26.493080+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493080+0000","last_undegraded":"2024-09-19T09:13:26.493080+0000","last_fullsized":"2024-09-19T09:13:26.493080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.499680+0000","last_change":"2024-09-19T09:13:26.499537+0000","last_active":"2024-09-19T09:13:26.499680+0000","last_peered":"2024-09-19T09:13:26.499680+0000","last_clean":"2024-09-19T09:13:26.499680+0000","last_became_active":"2024-09-19T09:13:26.499042+0000","last_became_peered":"2024-09-19T09:13:26.499042+0000","last_unstale":"2024-09-19T09:13:26.499680+0000","last_undegraded":"2024-09-19T09:13:26.499680+0000","last_fullsized":"2024-09-19T09:13:26.499680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:11.427700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.497773+0000","last_change":"2024-09-19T09:13:26.497773+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.497773+0000","last_undegraded":"2024-09-19T09:13:26.497773+0000","last_fullsized":"2024-09-19T09:13:26.497773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.504489+0000","last_change":"2024-09-19T09:13:26.504376+0000","last_active":"2024-09-19T09:13:26.504489+0000","last_peered":"2024-09-19T09:13:26.504489+0000","last_clean":"2024-09-19T09:13:26.504489+0000","last_became_active":"2024-09-19T09:13:26.504121+0000","last_became_peered":"2024-09-19T09:13:26.504121+0000","last_unstale":"2024-09-19T09:13:26.504489+0000","last_undegraded":"2024-09-19T09:13:26.504489+0000","last_fullsized":"2024-09-19T09:13:26.504489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:57.507184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495623+0000","last_change":"2024-09-19T09:13:26.495623+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495623+0000","last_undegraded":"2024-09-19T09:13:26.495623+0000","last_fullsized":"2024-09-19T09:13:26.495623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.501794+0000","last_change":"2024-09-19T09:13:26.501637+0000","last_active":"2024-09-19T09:13:26.501794+0000","last_peered":"2024-09-19T09:13:26.501794+0000","last_clean":"2024-09-19T09:13:26.501794+0000","last_became_active":"2024-09-19T09:13:26.501409+0000","last_became_peered":"2024-09-19T09:13:26.501409+0000","last_unstale":"2024-09-19T09:13:26.501794+0000","last_undegraded":"2024-09-19T09:13:26.501794+0000","last_fullsized":"2024-09-19T09:13:26.501794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:27.977582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492137+0000","last_change":"2024-09-19T09:13:26.492137+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492137+0000","last_undegraded":"2024-09-19T09:13:26.492137+0000","last_fullsized":"2024-09-19T09:13:26.492137+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.504001+0000","last_change":"2024-09-19T09:13:26.503898+0000","last_active":"2024-09-19T09:13:26.504001+0000","last_peered":"2024-09-19T09:13:26.504001+0000","last_clean":"2024-09-19T09:13:26.504001+0000","last_became_active":"2024-09-19T09:13:26.503631+0000","last_became_peered":"2024-09-19T09:13:26.503631+0000","last_unstale":"2024-09-19T09:13:26.504001+0000","last_undegraded":"2024-09-19T09:13:26.504001+0000","last_fullsized":"2024-09-19T09:13:26.504001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:27.273078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492451+0000","last_change":"2024-09-19T09:13:26.492451+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492451+0000","last_undegraded":"2024-09-19T09:13:26.492451+0000","last_fullsized":"2024-09-19T09:13:26.492451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.502574+0000","last_change":"2024-09-19T09:13:26.502447+0000","last_active":"2024-09-19T09:13:26.502574+0000","last_peered":"2024-09-19T09:13:26.502574+0000","last_clean":"2024-09-19T09:13:26.502574+0000","last_became_active":"2024-09-19T09:13:26.501912+0000","last_became_peered":"2024-09-19T09:13:26.501912+0000","last_unstale":"2024-09-19T09:13:26.502574+0000","last_undegraded":"2024-09-19T09:13:26.502574+0000","last_fullsized":"2024-09-19T09:13:26.502574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:00.635615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.499236+0000","last_change":"2024-09-19T09:13:26.499236+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.499236+0000","last_undegraded":"2024-09-19T09:13:26.499236+0000","last_fullsized":"2024-09-19T09:13:26.499236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":166,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.496760+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:13:26.496760+0000","last_peered":"2024-09-19T09:13:26.496760+0000","last_clean":"2024-09-19T09:13:26.496760+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:13:26.496760+0000","last_undegraded":"2024-09-19T09:13:26.496760+0000","last_fullsized":"2024-09-19T09:13:26.496760+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:22.478151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506817+0000","last_change":"2024-09-19T09:13:26.506369+0000","last_active":"2024-09-19T09:13:26.506817+0000","last_peered":"2024-09-19T09:13:26.506817+0000","last_clean":"2024-09-19T09:13:26.506817+0000","last_became_active":"2024-09-19T09:13:26.506065+0000","last_became_peered":"2024-09-19T09:13:26.506065+0000","last_unstale":"2024-09-19T09:13:26.506817+0000","last_undegraded":"2024-09-19T09:13:26.506817+0000","last_fullsized":"2024-09-19T09:13:26.506817+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:00.898726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492386+0000","last_change":"2024-09-19T09:13:26.492386+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492386+0000","last_undegraded":"2024-09-19T09:13:26.492386+0000","last_fullsized":"2024-09-19T09:13:26.492386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506263+0000","last_change":"2024-09-19T09:13:26.504928+0000","last_active":"2024-09-19T09:13:26.506263+0000","last_peered":"2024-09-19T09:13:26.506263+0000","last_clean":"2024-09-19T09:13:26.506263+0000","last_became_active":"2024-09-19T09:13:26.504649+0000","last_became_peered":"2024-09-19T09:13:26.504649+0000","last_unstale":"2024-09-19T09:13:26.506263+0000","last_undegraded":"2024-09-19T09:13:26.506263+0000","last_fullsized":"2024-09-19T09:13:26.506263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:26:04.073618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493391+0000","last_change":"2024-09-19T09:13:26.493391+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493391+0000","last_undegraded":"2024-09-19T09:13:26.493391+0000","last_fullsized":"2024-09-19T09:13:26.493391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.501636+0000","last_change":"2024-09-19T09:13:26.501526+0000","last_active":"2024-09-19T09:13:26.501636+0000","last_peered":"2024-09-19T09:13:26.501636+0000","last_clean":"2024-09-19T09:13:26.501636+0000","last_became_active":"2024-09-19T09:13:26.501281+0000","last_became_peered":"2024-09-19T09:13:26.501281+0000","last_unstale":"2024-09-19T09:13:26.501636+0000","last_undegraded":"2024-09-19T09:13:26.501636+0000","last_fullsized":"2024-09-19T09:13:26.501636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:50.647697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.496742+0000","last_change":"2024-09-19T09:13:26.496742+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.496742+0000","last_undegraded":"2024-09-19T09:13:26.496742+0000","last_fullsized":"2024-09-19T09:13:26.496742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506318+0000","last_change":"2024-09-19T09:13:26.505847+0000","last_active":"2024-09-19T09:13:26.506318+0000","last_peered":"2024-09-19T09:13:26.506318+0000","last_clean":"2024-09-19T09:13:26.506318+0000","last_became_active":"2024-09-19T09:13:26.505245+0000","last_became_peered":"2024-09-19T09:13:26.505245+0000","last_unstale":"2024-09-19T09:13:26.506318+0000","last_undegraded":"2024-09-19T09:13:26.506318+0000","last_fullsized":"2024-09-19T09:13:26.506318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:15.613040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492202+0000","last_change":"2024-09-19T09:13:26.492202+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492202+0000","last_undegraded":"2024-09-19T09:13:26.492202+0000","last_fullsized":"2024-09-19T09:13:26.492202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.503252+0000","last_change":"2024-09-19T09:13:26.502978+0000","last_active":"2024-09-19T09:13:26.503252+0000","last_peered":"2024-09-19T09:13:26.503252+0000","last_clean":"2024-09-19T09:13:26.503252+0000","last_became_active":"2024-09-19T09:13:26.502537+0000","last_became_peered":"2024-09-19T09:13:26.502537+0000","last_unstale":"2024-09-19T09:13:26.503252+0000","last_undegraded":"2024-09-19T09:13:26.503252+0000","last_fullsized":"2024-09-19T09:13:26.503252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:53.132531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494697+0000","last_change":"2024-09-19T09:13:26.494697+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494697+0000","last_undegraded":"2024-09-19T09:13:26.494697+0000","last_fullsized":"2024-09-19T09:13:26.494697+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506298+0000","last_change":"2024-09-19T09:13:26.505476+0000","last_active":"2024-09-19T09:13:26.506298+0000","last_peered":"2024-09-19T09:13:26.506298+0000","last_clean":"2024-09-19T09:13:26.506298+0000","last_became_active":"2024-09-19T09:13:26.505190+0000","last_became_peered":"2024-09-19T09:13:26.505190+0000","last_unstale":"2024-09-19T09:13:26.506298+0000","last_undegraded":"2024-09-19T09:13:26.506298+0000","last_fullsized":"2024-09-19T09:13:26.506298+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:23.182076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493530+0000","last_change":"2024-09-19T09:13:26.493530+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493530+0000","last_undegraded":"2024-09-19T09:13:26.493530+0000","last_fullsized":"2024-09-19T09:13:26.493530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.498483+0000","last_change":"2024-09-19T09:13:26.497706+0000","last_active":"2024-09-19T09:13:26.498483+0000","last_peered":"2024-09-19T09:13:26.498483+0000","last_clean":"2024-09-19T09:13:26.498483+0000","last_became_active":"2024-09-19T09:13:26.497446+0000","last_became_peered":"2024-09-19T09:13:26.497446+0000","last_unstale":"2024-09-19T09:13:26.498483+0000","last_undegraded":"2024-09-19T09:13:26.498483+0000","last_fullsized":"2024-09-19T09:13:26.498483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:03.360103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.493180+0000","last_change":"2024-09-19T09:13:26.493180+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.493180+0000","last_undegraded":"2024-09-19T09:13:26.493180+0000","last_fullsized":"2024-09-19T09:13:26.493180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506749+0000","last_change":"2024-09-19T09:13:26.506097+0000","last_active":"2024-09-19T09:13:26.506749+0000","last_peered":"2024-09-19T09:13:26.506749+0000","last_clean":"2024-09-19T09:13:26.506749+0000","last_became_active":"2024-09-19T09:13:26.505562+0000","last_became_peered":"2024-09-19T09:13:26.505562+0000","last_unstale":"2024-09-19T09:13:26.506749+0000","last_undegraded":"2024-09-19T09:13:26.506749+0000","last_fullsized":"2024-09-19T09:13:26.506749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:43.368123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.492377+0000","last_change":"2024-09-19T09:13:26.492377+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.492377+0000","last_undegraded":"2024-09-19T09:13:26.492377+0000","last_fullsized":"2024-09-19T09:13:26.492377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.503099+0000","last_change":"2024-09-19T09:13:26.501858+0000","last_active":"2024-09-19T09:13:26.503099+0000","last_peered":"2024-09-19T09:13:26.503099+0000","last_clean":"2024-09-19T09:13:26.503099+0000","last_became_active":"2024-09-19T09:13:26.501606+0000","last_became_peered":"2024-09-19T09:13:26.501606+0000","last_unstale":"2024-09-19T09:13:26.503099+0000","last_undegraded":"2024-09-19T09:13:26.503099+0000","last_fullsized":"2024-09-19T09:13:26.503099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:30.757320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.500926+0000","last_change":"2024-09-19T09:13:26.500926+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.500926+0000","last_undegraded":"2024-09-19T09:13:26.500926+0000","last_fullsized":"2024-09-19T09:13:26.500926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.498836+0000","last_change":"2024-09-19T09:13:26.498599+0000","last_active":"2024-09-19T09:13:26.498836+0000","last_peered":"2024-09-19T09:13:26.498836+0000","last_clean":"2024-09-19T09:13:26.498836+0000","last_became_active":"2024-09-19T09:13:26.498160+0000","last_became_peered":"2024-09-19T09:13:26.498160+0000","last_unstale":"2024-09-19T09:13:26.498836+0000","last_undegraded":"2024-09-19T09:13:26.498836+0000","last_fullsized":"2024-09-19T09:13:26.498836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:21.922199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494868+0000","last_change":"2024-09-19T09:13:26.494868+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494868+0000","last_undegraded":"2024-09-19T09:13:26.494868+0000","last_fullsized":"2024-09-19T09:13:26.494868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.503580+0000","last_change":"2024-09-19T09:13:26.503468+0000","last_active":"2024-09-19T09:13:26.503580+0000","last_peered":"2024-09-19T09:13:26.503580+0000","last_clean":"2024-09-19T09:13:26.503580+0000","last_became_active":"2024-09-19T09:13:26.503239+0000","last_became_peered":"2024-09-19T09:13:26.503239+0000","last_unstale":"2024-09-19T09:13:26.503580+0000","last_undegraded":"2024-09-19T09:13:26.503580+0000","last_fullsized":"2024-09-19T09:13:26.503580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:29.822493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.496063+0000","last_change":"2024-09-19T09:13:26.496063+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.496063+0000","last_undegraded":"2024-09-19T09:13:26.496063+0000","last_fullsized":"2024-09-19T09:13:26.496063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506335+0000","last_change":"2024-09-19T09:13:26.505929+0000","last_active":"2024-09-19T09:13:26.506335+0000","last_peered":"2024-09-19T09:13:26.506335+0000","last_clean":"2024-09-19T09:13:26.506335+0000","last_became_active":"2024-09-19T09:13:26.505267+0000","last_became_peered":"2024-09-19T09:13:26.505267+0000","last_unstale":"2024-09-19T09:13:26.506335+0000","last_undegraded":"2024-09-19T09:13:26.506335+0000","last_fullsized":"2024-09-19T09:13:26.506335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:42.609549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.495443+0000","last_change":"2024-09-19T09:13:26.495443+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.495443+0000","last_undegraded":"2024-09-19T09:13:26.495443+0000","last_fullsized":"2024-09-19T09:13:26.495443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.503380+0000","last_change":"2024-09-19T09:13:26.503380+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.503380+0000","last_undegraded":"2024-09-19T09:13:26.503380+0000","last_fullsized":"2024-09-19T09:13:26.503380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.498504+0000","last_change":"2024-09-19T09:13:26.498383+0000","last_active":"2024-09-19T09:13:26.498504+0000","last_peered":"2024-09-19T09:13:26.498504+0000","last_clean":"2024-09-19T09:13:26.498504+0000","last_became_active":"2024-09-19T09:13:26.498142+0000","last_became_peered":"2024-09-19T09:13:26.498142+0000","last_unstale":"2024-09-19T09:13:26.498504+0000","last_undegraded":"2024-09-19T09:13:26.498504+0000","last_fullsized":"2024-09-19T09:13:26.498504+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:43.668821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494803+0000","last_change":"2024-09-19T09:13:26.494803+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494803+0000","last_undegraded":"2024-09-19T09:13:26.494803+0000","last_fullsized":"2024-09-19T09:13:26.494803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.498086+0000","last_change":"2024-09-19T09:13:26.497950+0000","last_active":"2024-09-19T09:13:26.498086+0000","last_peered":"2024-09-19T09:13:26.498086+0000","last_clean":"2024-09-19T09:13:26.498086+0000","last_became_active":"2024-09-19T09:13:26.497689+0000","last_became_peered":"2024-09-19T09:13:26.497689+0000","last_unstale":"2024-09-19T09:13:26.498086+0000","last_undegraded":"2024-09-19T09:13:26.498086+0000","last_fullsized":"2024-09-19T09:13:26.498086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:20.181354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.494931+0000","last_change":"2024-09-19T09:13:26.494931+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.494931+0000","last_undegraded":"2024-09-19T09:13:26.494931+0000","last_fullsized":"2024-09-19T09:13:26.494931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.503229+0000","last_change":"2024-09-19T09:13:26.502836+0000","last_active":"2024-09-19T09:13:26.503229+0000","last_peered":"2024-09-19T09:13:26.503229+0000","last_clean":"2024-09-19T09:13:26.503229+0000","last_became_active":"2024-09-19T09:13:26.501995+0000","last_became_peered":"2024-09-19T09:13:26.501995+0000","last_unstale":"2024-09-19T09:13:26.503229+0000","last_undegraded":"2024-09-19T09:13:26.503229+0000","last_fullsized":"2024-09-19T09:13:26.503229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:18.350158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-09-19T09:13:26.497184+0000","last_change":"2024-09-19T09:13:26.497184+0000","last_active":"2024-09-19T09:13:26.482288+0000","last_peered":"2024-09-19T09:13:26.482288+0000","last_clean":"2024-09-19T09:13:26.482288+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:13:26.497184+0000","last_undegraded":"2024-09-19T09:13:26.497184+0000","last_fullsized":"2024-09-19T09:13:26.497184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T09:13:26.506962+0000","last_change":"2024-09-19T09:13:26.506856+0000","last_active":"2024-09-19T09:13:26.506962+0000","last_peered":"2024-09-19T09:13:26.506962+0000","last_clean":"2024-09-19T09:13:26.506962+0000","last_became_active":"2024-09-19T09:13:26.506714+0000","last_became_peered":"2024-09-19T09:13:26.506714+0000","last_unstale":"2024-09-19T09:13:26.506962+0000","last_undegraded":"2024-09-19T09:13:26.506962+0000","last_fullsized":"2024-09-19T09:13:26.506962+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:18.256167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":60,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195251,"statfs":{"total":200000000,"available":199937630,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194681,"statfs":{"total":200000000,"available":199353537,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":60,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195251,"statfs":{"total":200000000,"available":199937630,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194681,"statfs":{"total":200000000,"available":199353537,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":54,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195257,"statfs":{"total":200000000,"available":199943905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:13:32.867 INFO:tasks.ceph.mds.b.smithi162.stderr:2024-09-19T09:13:32.867+0000 7fea134b7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T09:13:34.892 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:13:35.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.007+0000 7fd8afa27640 1 Processor -- start 2024-09-19T09:13:35.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.007+0000 7fd8afa27640 1 -- start start 2024-09-19T09:13:35.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.008+0000 7fd8afa27640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd8a80d57a0 0x7fd8a80d1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:35.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.008+0000 7fd8afa27640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8a80d3880 con 0x7fd8a815ecc0 2024-09-19T09:13:35.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.008+0000 7fd8afa27640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8a80d3b20 con 0x7fd8a80d1990 2024-09-19T09:13:35.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.008+0000 7fd8afa27640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fd8a80b42f0 con 0x7fd8a80d57a0 2024-09-19T09:13:35.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.008+0000 7fd8acfc2640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd8a80d57a0 0x7fd8a80d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:35.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.008+0000 7fd8ad7c3640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd8a815ecc0 0x7fd8a80d3170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34632/0 (socket says 172.21.15.18:34632) 2024-09-19T09:13:35.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.008+0000 7fd8acfc2640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd8a80d57a0 0x7fd8a80d1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57126/0 (socket says 172.21.15.18:57126) 2024-09-19T09:13:35.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.009+0000 7fd8ad7c3640 1 -- 172.21.15.18:0/3812704480 learned_addr learned my addr 172.21.15.18:0/3812704480 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:35.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.009+0000 7fd8acfc2640 1 -- 172.21.15.18:0/3812704480 >> v1:172.21.15.162:6789/0 conn(0x7fd8a80d1990 legacy=0x7fd8a80b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:35.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.009+0000 7fd8acfc2640 1 -- 172.21.15.18:0/3812704480 >> v1:172.21.15.18:6789/0 conn(0x7fd8a815ecc0 legacy=0x7fd8a80d3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:35.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.009+0000 7fd89ffff640 1 -- 172.21.15.18:0/3812704480 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 330765604 0 0) 0x7fd8a80d3880 con 0x7fd8a815ecc0 2024-09-19T09:13:35.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.009+0000 7fd8acfc2640 1 -- 172.21.15.18:0/3812704480 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a80b45d0 con 0x7fd8a80d57a0 2024-09-19T09:13:35.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.010+0000 7fd8acfc2640 1 --2- 172.21.15.18:0/3812704480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8a80d57a0 0x7fd8a80d1450 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd8980097a0 tx=0x7fd89802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32bd4eb089fdc7dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:35.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.010+0000 7fd89ffff640 1 -- 172.21.15.18:0/3812704480 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd898037070 con 0x7fd8a80d57a0 2024-09-19T09:13:35.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.010+0000 7fd89ffff640 1 -- 172.21.15.18:0/3812704480 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd898032440 con 0x7fd8a80d57a0 2024-09-19T09:13:35.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.010+0000 7fd89ffff640 1 -- 172.21.15.18:0/3812704480 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd898032810 con 0x7fd8a80d57a0 2024-09-19T09:13:35.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.010+0000 7fd8afa27640 1 -- 172.21.15.18:0/3812704480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8a80d57a0 msgr2=0x7fd8a80d1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:35.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.010+0000 7fd8afa27640 1 --2- 172.21.15.18:0/3812704480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8a80d57a0 0x7fd8a80d1450 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd8980097a0 tx=0x7fd89802a230 comp rx=0 tx=0).stop 2024-09-19T09:13:35.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.010+0000 7fd8afa27640 1 -- 172.21.15.18:0/3812704480 shutdown_connections 2024-09-19T09:13:35.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.010+0000 7fd8afa27640 1 --2- 172.21.15.18:0/3812704480 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8a80d57a0 0x7fd8a80d1450 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:35.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.010+0000 7fd8afa27640 1 -- 172.21.15.18:0/3812704480 >> 172.21.15.18:0/3812704480 conn(0x7fd8a80d4bd0 msgr2=0x7fd8a80d4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:35.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.010+0000 7fd8afa27640 1 -- 172.21.15.18:0/3812704480 shutdown_connections 2024-09-19T09:13:35.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.010+0000 7fd8afa27640 1 -- 172.21.15.18:0/3812704480 wait complete. 2024-09-19T09:13:35.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.012+0000 7fd8afa27640 1 Processor -- start 2024-09-19T09:13:35.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.012+0000 7fd8afa27640 1 -- start start 2024-09-19T09:13:35.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.012+0000 7fd8afa27640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd8a80d1990 0x7fd8a8155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:35.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.012+0000 7fd8afa27640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8a80d57a0 0x7fd8a80c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:35.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.012+0000 7fd8afa27640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8a815ecc0 0x7fd8a80b8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:35.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.012+0000 7fd8afa27640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a815f0a0 con 0x7fd8a80d57a0 2024-09-19T09:13:35.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.012+0000 7fd8afa27640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a80b4b90 con 0x7fd8a815ecc0 2024-09-19T09:13:35.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.012+0000 7fd8afa27640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd8a815f220 con 0x7fd8a80d1990 2024-09-19T09:13:35.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.012+0000 7fd8acfc2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8a80d57a0 0x7fd8a80c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:35.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.012+0000 7fd8acfc2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8a80d57a0 0x7fd8a80c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57128/0 (socket says 172.21.15.18:57128) 2024-09-19T09:13:35.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.013+0000 7fd8acfc2640 1 -- 172.21.15.18:0/8693 learned_addr learned my addr 172.21.15.18:0/8693 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:35.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.013+0000 7fd8ad7c3640 1 --2- 172.21.15.18:0/8693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd8a80d1990 0x7fd8a8155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:35.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.013+0000 7fd8adfc4640 1 --2- 172.21.15.18:0/8693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8a815ecc0 0x7fd8a80b8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:35.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.013+0000 7fd8acfc2640 1 -- 172.21.15.18:0/8693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd8a80d1990 msgr2=0x7fd8a8155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:35.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.013+0000 7fd8acfc2640 1 --2- 172.21.15.18:0/8693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd8a80d1990 0x7fd8a8155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:35.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.013+0000 7fd8acfc2640 1 -- 172.21.15.18:0/8693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8a815ecc0 msgr2=0x7fd8a80b8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:35.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.013+0000 7fd8acfc2640 1 --2- 172.21.15.18:0/8693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8a815ecc0 0x7fd8a80b8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:35.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.013+0000 7fd8acfc2640 1 -- 172.21.15.18:0/8693 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a81606f0 con 0x7fd8a80d57a0 2024-09-19T09:13:35.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.013+0000 7fd8adfc4640 1 --2- 172.21.15.18:0/8693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8a815ecc0 0x7fd8a80b8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:13:35.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.013+0000 7fd8acfc2640 1 --2- 172.21.15.18:0/8693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8a80d57a0 0x7fd8a80c8700 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd898000c00 tx=0x7fd8980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:35.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.013+0000 7fd89dffb640 1 -- 172.21.15.18:0/8693 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd898037040 con 0x7fd8a80d57a0 2024-09-19T09:13:35.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.013+0000 7fd89dffb640 1 -- 172.21.15.18:0/8693 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd898042070 con 0x7fd8a80d57a0 2024-09-19T09:13:35.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.013+0000 7fd8afa27640 1 -- 172.21.15.18:0/8693 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8a81609d0 con 0x7fd8a80d57a0 2024-09-19T09:13:35.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.013+0000 7fd89dffb640 1 -- 172.21.15.18:0/8693 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd898030a70 con 0x7fd8a80d57a0 2024-09-19T09:13:35.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.013+0000 7fd8afa27640 1 -- 172.21.15.18:0/8693 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8a8160f90 con 0x7fd8a80d57a0 2024-09-19T09:13:35.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.014+0000 7fd8afa27640 1 -- 172.21.15.18:0/8693 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8a80d1450 con 0x7fd8a80d57a0 2024-09-19T09:13:35.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.015+0000 7fd89dffb640 1 -- 172.21.15.18:0/8693 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd898030c10 con 0x7fd8a80d57a0 2024-09-19T09:13:35.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.015+0000 7fd89dffb640 1 --2- 172.21.15.18:0/8693 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd88c06c2b0 0x7fd88c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:35.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.015+0000 7fd89dffb640 1 -- 172.21.15.18:0/8693 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd8980abef0 con 0x7fd8a80d57a0 2024-09-19T09:13:35.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.016+0000 7fd8ad7c3640 1 --2- 172.21.15.18:0/8693 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd88c06c2b0 0x7fd88c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:35.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.016+0000 7fd8ad7c3640 1 --2- 172.21.15.18:0/8693 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd88c06c2b0 0x7fd88c06e770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4000f60 tx=0x7fd8a4007d00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:35.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.020+0000 7fd89dffb640 1 -- 172.21.15.18:0/8693 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd89807a660 con 0x7fd8a80d57a0 2024-09-19T09:13:35.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.191+0000 7fd8afa27640 1 -- 172.21.15.18:0/8693 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd8a80b81f0 con 0x7fd88c06c2b0 2024-09-19T09:13:35.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.197+0000 7fd89dffb640 1 -- 172.21.15.18:0/8693 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247485 (secure 0 0 0) 0x7fd8a80b81f0 con 0x7fd88c06c2b0 2024-09-19T09:13:35.200 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:35.201 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:13:35.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.200+0000 7fd8afa27640 1 -- 172.21.15.18:0/8693 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd88c06c2b0 msgr2=0x7fd88c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:35.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.200+0000 7fd8afa27640 1 --2- 172.21.15.18:0/8693 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd88c06c2b0 0x7fd88c06e770 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4000f60 tx=0x7fd8a4007d00 comp rx=0 tx=0).stop 2024-09-19T09:13:35.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.200+0000 7fd8afa27640 1 -- 172.21.15.18:0/8693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8a80d57a0 msgr2=0x7fd8a80c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:35.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.200+0000 7fd8afa27640 1 --2- 172.21.15.18:0/8693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8a80d57a0 0x7fd8a80c8700 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd898000c00 tx=0x7fd8980046c0 comp rx=0 tx=0).stop 2024-09-19T09:13:35.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.200+0000 7fd8afa27640 1 -- 172.21.15.18:0/8693 shutdown_connections 2024-09-19T09:13:35.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.200+0000 7fd8afa27640 1 --2- 172.21.15.18:0/8693 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd88c06c2b0 0x7fd88c06e770 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:35.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.200+0000 7fd8afa27640 1 --2- 172.21.15.18:0/8693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd8a815ecc0 0x7fd8a80b8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:35.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.200+0000 7fd8afa27640 1 --2- 172.21.15.18:0/8693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8a80d57a0 0x7fd8a80c8700 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:35.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.200+0000 7fd8afa27640 1 --2- 172.21.15.18:0/8693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd8a80d1990 0x7fd8a8155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:35.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.200+0000 7fd8afa27640 1 -- 172.21.15.18:0/8693 >> 172.21.15.18:0/8693 conn(0x7fd8a80d4bd0 msgr2=0x7fd8a80d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:35.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.200+0000 7fd8afa27640 1 -- 172.21.15.18:0/8693 shutdown_connections 2024-09-19T09:13:35.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.200+0000 7fd8afa27640 1 -- 172.21.15.18:0/8693 wait complete. 2024-09-19T09:13:35.211 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-19T09:13:33.523181+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1747,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560752,"statfs":{"total":1600000000,"available":1598210884,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.033081"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495042+0000","last_change":"2024-09-19T09:13:27.519028+0000","last_active":"2024-09-19T09:13:29.495042+0000","last_peered":"2024-09-19T09:13:29.495042+0000","last_clean":"2024-09-19T09:13:29.495042+0000","last_became_active":"2024-09-19T09:13:27.518073+0000","last_became_peered":"2024-09-19T09:13:27.518073+0000","last_unstale":"2024-09-19T09:13:29.495042+0000","last_undegraded":"2024-09-19T09:13:29.495042+0000","last_fullsized":"2024-09-19T09:13:29.495042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:46.115198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.743786+0000","last_change":"2024-09-19T09:13:27.503682+0000","last_active":"2024-09-19T09:13:28.743786+0000","last_peered":"2024-09-19T09:13:28.743786+0000","last_clean":"2024-09-19T09:13:28.743786+0000","last_became_active":"2024-09-19T09:13:27.503423+0000","last_became_peered":"2024-09-19T09:13:27.503423+0000","last_unstale":"2024-09-19T09:13:28.743786+0000","last_undegraded":"2024-09-19T09:13:28.743786+0000","last_fullsized":"2024-09-19T09:13:28.743786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:26.355358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.743981+0000","last_change":"2024-09-19T09:13:27.507108+0000","last_active":"2024-09-19T09:13:28.743981+0000","last_peered":"2024-09-19T09:13:28.743981+0000","last_clean":"2024-09-19T09:13:28.743981+0000","last_became_active":"2024-09-19T09:13:27.506849+0000","last_became_peered":"2024-09-19T09:13:27.506849+0000","last_unstale":"2024-09-19T09:13:28.743981+0000","last_undegraded":"2024-09-19T09:13:28.743981+0000","last_fullsized":"2024-09-19T09:13:28.743981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:04.199671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.507424+0000","last_change":"2024-09-19T09:13:27.513588+0000","last_active":"2024-09-19T09:13:28.507424+0000","last_peered":"2024-09-19T09:13:28.507424+0000","last_clean":"2024-09-19T09:13:28.507424+0000","last_became_active":"2024-09-19T09:13:27.512588+0000","last_became_peered":"2024-09-19T09:13:27.512588+0000","last_unstale":"2024-09-19T09:13:28.507424+0000","last_undegraded":"2024-09-19T09:13:28.507424+0000","last_fullsized":"2024-09-19T09:13:28.507424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:55.304446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495369+0000","last_change":"2024-09-19T09:13:27.515156+0000","last_active":"2024-09-19T09:13:29.495369+0000","last_peered":"2024-09-19T09:13:29.495369+0000","last_clean":"2024-09-19T09:13:29.495369+0000","last_became_active":"2024-09-19T09:13:27.513242+0000","last_became_peered":"2024-09-19T09:13:27.513242+0000","last_unstale":"2024-09-19T09:13:29.495369+0000","last_undegraded":"2024-09-19T09:13:29.495369+0000","last_fullsized":"2024-09-19T09:13:29.495369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:43.531169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.507982+0000","last_change":"2024-09-19T09:13:27.514651+0000","last_active":"2024-09-19T09:13:28.507982+0000","last_peered":"2024-09-19T09:13:28.507982+0000","last_clean":"2024-09-19T09:13:28.507982+0000","last_became_active":"2024-09-19T09:13:27.514234+0000","last_became_peered":"2024-09-19T09:13:27.514234+0000","last_unstale":"2024-09-19T09:13:28.507982+0000","last_undegraded":"2024-09-19T09:13:28.507982+0000","last_fullsized":"2024-09-19T09:13:28.507982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:09.761563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495773+0000","last_change":"2024-09-19T09:13:27.513315+0000","last_active":"2024-09-19T09:13:29.495773+0000","last_peered":"2024-09-19T09:13:29.495773+0000","last_clean":"2024-09-19T09:13:29.495773+0000","last_became_active":"2024-09-19T09:13:27.512682+0000","last_became_peered":"2024-09-19T09:13:27.512682+0000","last_unstale":"2024-09-19T09:13:29.495773+0000","last_undegraded":"2024-09-19T09:13:29.495773+0000","last_fullsized":"2024-09-19T09:13:29.495773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:56.998451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.744145+0000","last_change":"2024-09-19T09:13:27.508840+0000","last_active":"2024-09-19T09:13:28.744145+0000","last_peered":"2024-09-19T09:13:28.744145+0000","last_clean":"2024-09-19T09:13:28.744145+0000","last_became_active":"2024-09-19T09:13:27.508595+0000","last_became_peered":"2024-09-19T09:13:27.508595+0000","last_unstale":"2024-09-19T09:13:28.744145+0000","last_undegraded":"2024-09-19T09:13:28.744145+0000","last_fullsized":"2024-09-19T09:13:28.744145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:58.902836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.677725+0000","last_change":"2024-09-19T09:13:27.502831+0000","last_active":"2024-09-19T09:13:29.677725+0000","last_peered":"2024-09-19T09:13:29.677725+0000","last_clean":"2024-09-19T09:13:29.677725+0000","last_became_active":"2024-09-19T09:13:27.502594+0000","last_became_peered":"2024-09-19T09:13:27.502594+0000","last_unstale":"2024-09-19T09:13:29.677725+0000","last_undegraded":"2024-09-19T09:13:29.677725+0000","last_fullsized":"2024-09-19T09:13:29.677725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:02.836853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495469+0000","last_change":"2024-09-19T09:13:27.512903+0000","last_active":"2024-09-19T09:13:29.495469+0000","last_peered":"2024-09-19T09:13:29.495469+0000","last_clean":"2024-09-19T09:13:29.495469+0000","last_became_active":"2024-09-19T09:13:27.508431+0000","last_became_peered":"2024-09-19T09:13:27.508431+0000","last_unstale":"2024-09-19T09:13:29.495469+0000","last_undegraded":"2024-09-19T09:13:29.495469+0000","last_fullsized":"2024-09-19T09:13:29.495469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:43.740664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495238+0000","last_change":"2024-09-19T09:13:27.518369+0000","last_active":"2024-09-19T09:13:29.495238+0000","last_peered":"2024-09-19T09:13:29.495238+0000","last_clean":"2024-09-19T09:13:29.495238+0000","last_became_active":"2024-09-19T09:13:27.516932+0000","last_became_peered":"2024-09-19T09:13:27.516932+0000","last_unstale":"2024-09-19T09:13:29.495238+0000","last_undegraded":"2024-09-19T09:13:29.495238+0000","last_fullsized":"2024-09-19T09:13:29.495238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:36.626961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495237+0000","last_change":"2024-09-19T09:13:27.513595+0000","last_active":"2024-09-19T09:13:29.495237+0000","last_peered":"2024-09-19T09:13:29.495237+0000","last_clean":"2024-09-19T09:13:29.495237+0000","last_became_active":"2024-09-19T09:13:27.512993+0000","last_became_peered":"2024-09-19T09:13:27.512993+0000","last_unstale":"2024-09-19T09:13:29.495237+0000","last_undegraded":"2024-09-19T09:13:29.495237+0000","last_fullsized":"2024-09-19T09:13:29.495237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:16.961946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.507646+0000","last_change":"2024-09-19T09:13:27.510731+0000","last_active":"2024-09-19T09:13:28.507646+0000","last_peered":"2024-09-19T09:13:28.507646+0000","last_clean":"2024-09-19T09:13:28.507646+0000","last_became_active":"2024-09-19T09:13:27.509501+0000","last_became_peered":"2024-09-19T09:13:27.509501+0000","last_unstale":"2024-09-19T09:13:28.507646+0000","last_undegraded":"2024-09-19T09:13:28.507646+0000","last_fullsized":"2024-09-19T09:13:28.507646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:47.710342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.507657+0000","last_change":"2024-09-19T09:13:27.500908+0000","last_active":"2024-09-19T09:13:28.507657+0000","last_peered":"2024-09-19T09:13:28.507657+0000","last_clean":"2024-09-19T09:13:28.507657+0000","last_became_active":"2024-09-19T09:13:27.500685+0000","last_became_peered":"2024-09-19T09:13:27.500685+0000","last_unstale":"2024-09-19T09:13:28.507657+0000","last_undegraded":"2024-09-19T09:13:28.507657+0000","last_fullsized":"2024-09-19T09:13:28.507657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:27.101570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.744134+0000","last_change":"2024-09-19T09:13:27.510338+0000","last_active":"2024-09-19T09:13:28.744134+0000","last_peered":"2024-09-19T09:13:28.744134+0000","last_clean":"2024-09-19T09:13:28.744134+0000","last_became_active":"2024-09-19T09:13:27.509885+0000","last_became_peered":"2024-09-19T09:13:27.509885+0000","last_unstale":"2024-09-19T09:13:28.744134+0000","last_undegraded":"2024-09-19T09:13:28.744134+0000","last_fullsized":"2024-09-19T09:13:28.744134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:22.872883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844670+0000","last_change":"2024-09-19T09:13:27.510472+0000","last_active":"2024-09-19T09:13:29.844670+0000","last_peered":"2024-09-19T09:13:29.844670+0000","last_clean":"2024-09-19T09:13:29.844670+0000","last_became_active":"2024-09-19T09:13:27.509440+0000","last_became_peered":"2024-09-19T09:13:27.509440+0000","last_unstale":"2024-09-19T09:13:29.844670+0000","last_undegraded":"2024-09-19T09:13:29.844670+0000","last_fullsized":"2024-09-19T09:13:29.844670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:36.943128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844505+0000","last_change":"2024-09-19T09:13:27.515299+0000","last_active":"2024-09-19T09:13:29.844505+0000","last_peered":"2024-09-19T09:13:29.844505+0000","last_clean":"2024-09-19T09:13:29.844505+0000","last_became_active":"2024-09-19T09:13:27.515060+0000","last_became_peered":"2024-09-19T09:13:27.515060+0000","last_unstale":"2024-09-19T09:13:29.844505+0000","last_undegraded":"2024-09-19T09:13:29.844505+0000","last_fullsized":"2024-09-19T09:13:29.844505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:20.833006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.568445+0000","last_change":"2024-09-19T09:13:27.505357+0000","last_active":"2024-09-19T09:13:28.568445+0000","last_peered":"2024-09-19T09:13:28.568445+0000","last_clean":"2024-09-19T09:13:28.568445+0000","last_became_active":"2024-09-19T09:13:27.505132+0000","last_became_peered":"2024-09-19T09:13:27.505132+0000","last_unstale":"2024-09-19T09:13:28.568445+0000","last_undegraded":"2024-09-19T09:13:28.568445+0000","last_fullsized":"2024-09-19T09:13:28.568445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:53:29.605543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844733+0000","last_change":"2024-09-19T09:13:27.511545+0000","last_active":"2024-09-19T09:13:29.844733+0000","last_peered":"2024-09-19T09:13:29.844733+0000","last_clean":"2024-09-19T09:13:29.844733+0000","last_became_active":"2024-09-19T09:13:27.511285+0000","last_became_peered":"2024-09-19T09:13:27.511285+0000","last_unstale":"2024-09-19T09:13:29.844733+0000","last_undegraded":"2024-09-19T09:13:29.844733+0000","last_fullsized":"2024-09-19T09:13:29.844733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:55:16.947702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495579+0000","last_change":"2024-09-19T09:13:27.508681+0000","last_active":"2024-09-19T09:13:29.495579+0000","last_peered":"2024-09-19T09:13:29.495579+0000","last_clean":"2024-09-19T09:13:29.495579+0000","last_became_active":"2024-09-19T09:13:27.507612+0000","last_became_peered":"2024-09-19T09:13:27.507612+0000","last_unstale":"2024-09-19T09:13:29.495579+0000","last_undegraded":"2024-09-19T09:13:29.495579+0000","last_fullsized":"2024-09-19T09:13:29.495579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:36.069417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493350+0000","last_change":"2024-09-19T09:13:27.512295+0000","last_active":"2024-09-19T09:13:29.493350+0000","last_peered":"2024-09-19T09:13:29.493350+0000","last_clean":"2024-09-19T09:13:29.493350+0000","last_became_active":"2024-09-19T09:13:27.512007+0000","last_became_peered":"2024-09-19T09:13:27.512007+0000","last_unstale":"2024-09-19T09:13:29.493350+0000","last_undegraded":"2024-09-19T09:13:29.493350+0000","last_fullsized":"2024-09-19T09:13:29.493350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:56.832240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.677613+0000","last_change":"2024-09-19T09:13:27.516493+0000","last_active":"2024-09-19T09:13:29.677613+0000","last_peered":"2024-09-19T09:13:29.677613+0000","last_clean":"2024-09-19T09:13:29.677613+0000","last_became_active":"2024-09-19T09:13:27.516254+0000","last_became_peered":"2024-09-19T09:13:27.516254+0000","last_unstale":"2024-09-19T09:13:29.677613+0000","last_undegraded":"2024-09-19T09:13:29.677613+0000","last_fullsized":"2024-09-19T09:13:29.677613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:33.906886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.744536+0000","last_change":"2024-09-19T09:13:27.505900+0000","last_active":"2024-09-19T09:13:28.744536+0000","last_peered":"2024-09-19T09:13:28.744536+0000","last_clean":"2024-09-19T09:13:28.744536+0000","last_became_active":"2024-09-19T09:13:27.505663+0000","last_became_peered":"2024-09-19T09:13:27.505663+0000","last_unstale":"2024-09-19T09:13:28.744536+0000","last_undegraded":"2024-09-19T09:13:28.744536+0000","last_fullsized":"2024-09-19T09:13:28.744536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:15:42.898470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844391+0000","last_change":"2024-09-19T09:13:27.506571+0000","last_active":"2024-09-19T09:13:29.844391+0000","last_peered":"2024-09-19T09:13:29.844391+0000","last_clean":"2024-09-19T09:13:29.844391+0000","last_became_active":"2024-09-19T09:13:27.506184+0000","last_became_peered":"2024-09-19T09:13:27.506184+0000","last_unstale":"2024-09-19T09:13:29.844391+0000","last_undegraded":"2024-09-19T09:13:29.844391+0000","last_fullsized":"2024-09-19T09:13:29.844391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:23.072934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.744303+0000","last_change":"2024-09-19T09:13:27.506211+0000","last_active":"2024-09-19T09:13:28.744303+0000","last_peered":"2024-09-19T09:13:28.744303+0000","last_clean":"2024-09-19T09:13:28.744303+0000","last_became_active":"2024-09-19T09:13:27.504555+0000","last_became_peered":"2024-09-19T09:13:27.504555+0000","last_unstale":"2024-09-19T09:13:28.744303+0000","last_undegraded":"2024-09-19T09:13:28.744303+0000","last_fullsized":"2024-09-19T09:13:28.744303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:15.242387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.508101+0000","last_change":"2024-09-19T09:13:27.513189+0000","last_active":"2024-09-19T09:13:28.508101+0000","last_peered":"2024-09-19T09:13:28.508101+0000","last_clean":"2024-09-19T09:13:28.508101+0000","last_became_active":"2024-09-19T09:13:27.512960+0000","last_became_peered":"2024-09-19T09:13:27.512960+0000","last_unstale":"2024-09-19T09:13:28.508101+0000","last_undegraded":"2024-09-19T09:13:28.508101+0000","last_fullsized":"2024-09-19T09:13:28.508101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:15.787088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.508496+0000","last_change":"2024-09-19T09:13:27.502537+0000","last_active":"2024-09-19T09:13:28.508496+0000","last_peered":"2024-09-19T09:13:28.508496+0000","last_clean":"2024-09-19T09:13:28.508496+0000","last_became_active":"2024-09-19T09:13:27.501832+0000","last_became_peered":"2024-09-19T09:13:27.501832+0000","last_unstale":"2024-09-19T09:13:28.508496+0000","last_undegraded":"2024-09-19T09:13:28.508496+0000","last_fullsized":"2024-09-19T09:13:28.508496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:39.127110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.508032+0000","last_change":"2024-09-19T09:13:27.509123+0000","last_active":"2024-09-19T09:13:28.508032+0000","last_peered":"2024-09-19T09:13:28.508032+0000","last_clean":"2024-09-19T09:13:28.508032+0000","last_became_active":"2024-09-19T09:13:27.508901+0000","last_became_peered":"2024-09-19T09:13:27.508901+0000","last_unstale":"2024-09-19T09:13:28.508032+0000","last_undegraded":"2024-09-19T09:13:28.508032+0000","last_fullsized":"2024-09-19T09:13:28.508032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:24:04.327514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.743839+0000","last_change":"2024-09-19T09:13:27.501012+0000","last_active":"2024-09-19T09:13:28.743839+0000","last_peered":"2024-09-19T09:13:28.743839+0000","last_clean":"2024-09-19T09:13:28.743839+0000","last_became_active":"2024-09-19T09:13:27.497063+0000","last_became_peered":"2024-09-19T09:13:27.497063+0000","last_unstale":"2024-09-19T09:13:28.743839+0000","last_undegraded":"2024-09-19T09:13:28.743839+0000","last_fullsized":"2024-09-19T09:13:28.743839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:08.043528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844492+0000","last_change":"2024-09-19T09:13:27.509716+0000","last_active":"2024-09-19T09:13:29.844492+0000","last_peered":"2024-09-19T09:13:29.844492+0000","last_clean":"2024-09-19T09:13:29.844492+0000","last_became_active":"2024-09-19T09:13:27.509413+0000","last_became_peered":"2024-09-19T09:13:27.509413+0000","last_unstale":"2024-09-19T09:13:29.844492+0000","last_undegraded":"2024-09-19T09:13:29.844492+0000","last_fullsized":"2024-09-19T09:13:29.844492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:26.682977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.568641+0000","last_change":"2024-09-19T09:13:27.499551+0000","last_active":"2024-09-19T09:13:28.568641+0000","last_peered":"2024-09-19T09:13:28.568641+0000","last_clean":"2024-09-19T09:13:28.568641+0000","last_became_active":"2024-09-19T09:13:27.499310+0000","last_became_peered":"2024-09-19T09:13:27.499310+0000","last_unstale":"2024-09-19T09:13:28.568641+0000","last_undegraded":"2024-09-19T09:13:28.568641+0000","last_fullsized":"2024-09-19T09:13:28.568641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:24.161816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.507533+0000","last_change":"2024-09-19T09:13:27.504478+0000","last_active":"2024-09-19T09:13:28.507533+0000","last_peered":"2024-09-19T09:13:28.507533+0000","last_clean":"2024-09-19T09:13:28.507533+0000","last_became_active":"2024-09-19T09:13:27.504229+0000","last_became_peered":"2024-09-19T09:13:27.504229+0000","last_unstale":"2024-09-19T09:13:28.507533+0000","last_undegraded":"2024-09-19T09:13:28.507533+0000","last_fullsized":"2024-09-19T09:13:28.507533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:01:34.671234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.677596+0000","last_change":"2024-09-19T09:13:27.499496+0000","last_active":"2024-09-19T09:13:29.677596+0000","last_peered":"2024-09-19T09:13:29.677596+0000","last_clean":"2024-09-19T09:13:29.677596+0000","last_became_active":"2024-09-19T09:13:27.498761+0000","last_became_peered":"2024-09-19T09:13:27.498761+0000","last_unstale":"2024-09-19T09:13:29.677596+0000","last_undegraded":"2024-09-19T09:13:29.677596+0000","last_fullsized":"2024-09-19T09:13:29.677596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:37.512544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.743924+0000","last_change":"2024-09-19T09:13:26.503044+0000","last_active":"2024-09-19T09:13:28.743924+0000","last_peered":"2024-09-19T09:13:28.743924+0000","last_clean":"2024-09-19T09:13:28.743924+0000","last_became_active":"2024-09-19T09:13:26.502787+0000","last_became_peered":"2024-09-19T09:13:26.502787+0000","last_unstale":"2024-09-19T09:13:28.743924+0000","last_undegraded":"2024-09-19T09:13:28.743924+0000","last_fullsized":"2024-09-19T09:13:28.743924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:19.218001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493212+0000","last_change":"2024-09-19T09:13:27.510154+0000","last_active":"2024-09-19T09:13:29.493212+0000","last_peered":"2024-09-19T09:13:29.493212+0000","last_clean":"2024-09-19T09:13:29.493212+0000","last_became_active":"2024-09-19T09:13:27.509908+0000","last_became_peered":"2024-09-19T09:13:27.509908+0000","last_unstale":"2024-09-19T09:13:29.493212+0000","last_undegraded":"2024-09-19T09:13:29.493212+0000","last_fullsized":"2024-09-19T09:13:29.493212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:11.167828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844324+0000","last_change":"2024-09-19T09:13:26.506712+0000","last_active":"2024-09-19T09:13:29.844324+0000","last_peered":"2024-09-19T09:13:29.844324+0000","last_clean":"2024-09-19T09:13:29.844324+0000","last_became_active":"2024-09-19T09:13:26.506244+0000","last_became_peered":"2024-09-19T09:13:26.506244+0000","last_unstale":"2024-09-19T09:13:29.844324+0000","last_undegraded":"2024-09-19T09:13:29.844324+0000","last_fullsized":"2024-09-19T09:13:29.844324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:11.404705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.507759+0000","last_change":"2024-09-19T09:13:26.505620+0000","last_active":"2024-09-19T09:13:28.507759+0000","last_peered":"2024-09-19T09:13:28.507759+0000","last_clean":"2024-09-19T09:13:28.507759+0000","last_became_active":"2024-09-19T09:13:26.505383+0000","last_became_peered":"2024-09-19T09:13:26.505383+0000","last_unstale":"2024-09-19T09:13:28.507759+0000","last_undegraded":"2024-09-19T09:13:28.507759+0000","last_fullsized":"2024-09-19T09:13:28.507759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:32.720854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.744458+0000","last_change":"2024-09-19T09:13:27.506460+0000","last_active":"2024-09-19T09:13:28.744458+0000","last_peered":"2024-09-19T09:13:28.744458+0000","last_clean":"2024-09-19T09:13:28.744458+0000","last_became_active":"2024-09-19T09:13:27.505516+0000","last_became_peered":"2024-09-19T09:13:27.505516+0000","last_unstale":"2024-09-19T09:13:28.744458+0000","last_undegraded":"2024-09-19T09:13:28.744458+0000","last_fullsized":"2024-09-19T09:13:28.744458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:37.956145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.845064+0000","last_change":"2024-09-19T09:13:26.507051+0000","last_active":"2024-09-19T09:13:29.845064+0000","last_peered":"2024-09-19T09:13:29.845064+0000","last_clean":"2024-09-19T09:13:29.845064+0000","last_became_active":"2024-09-19T09:13:26.506557+0000","last_became_peered":"2024-09-19T09:13:26.506557+0000","last_unstale":"2024-09-19T09:13:29.845064+0000","last_undegraded":"2024-09-19T09:13:29.845064+0000","last_fullsized":"2024-09-19T09:13:29.845064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:06.034747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493381+0000","last_change":"2024-09-19T09:13:27.510098+0000","last_active":"2024-09-19T09:13:29.493381+0000","last_peered":"2024-09-19T09:13:29.493381+0000","last_clean":"2024-09-19T09:13:29.493381+0000","last_became_active":"2024-09-19T09:13:27.509844+0000","last_became_peered":"2024-09-19T09:13:27.509844+0000","last_unstale":"2024-09-19T09:13:29.493381+0000","last_undegraded":"2024-09-19T09:13:29.493381+0000","last_fullsized":"2024-09-19T09:13:29.493381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:09:31.853647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.677954+0000","last_change":"2024-09-19T09:13:26.501053+0000","last_active":"2024-09-19T09:13:29.677954+0000","last_peered":"2024-09-19T09:13:29.677954+0000","last_clean":"2024-09-19T09:13:29.677954+0000","last_became_active":"2024-09-19T09:13:26.500814+0000","last_became_peered":"2024-09-19T09:13:26.500814+0000","last_unstale":"2024-09-19T09:13:29.677954+0000","last_undegraded":"2024-09-19T09:13:29.677954+0000","last_fullsized":"2024-09-19T09:13:29.677954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:04.484574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.507967+0000","last_change":"2024-09-19T09:13:27.510096+0000","last_active":"2024-09-19T09:13:28.507967+0000","last_peered":"2024-09-19T09:13:28.507967+0000","last_clean":"2024-09-19T09:13:28.507967+0000","last_became_active":"2024-09-19T09:13:27.509812+0000","last_became_peered":"2024-09-19T09:13:27.509812+0000","last_unstale":"2024-09-19T09:13:28.507967+0000","last_undegraded":"2024-09-19T09:13:28.507967+0000","last_fullsized":"2024-09-19T09:13:28.507967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:16.817154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495626+0000","last_change":"2024-09-19T09:13:26.498971+0000","last_active":"2024-09-19T09:13:29.495626+0000","last_peered":"2024-09-19T09:13:29.495626+0000","last_clean":"2024-09-19T09:13:29.495626+0000","last_became_active":"2024-09-19T09:13:26.498737+0000","last_became_peered":"2024-09-19T09:13:26.498737+0000","last_unstale":"2024-09-19T09:13:29.495626+0000","last_undegraded":"2024-09-19T09:13:29.495626+0000","last_fullsized":"2024-09-19T09:13:29.495626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:32.747213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.743822+0000","last_change":"2024-09-19T09:13:27.508024+0000","last_active":"2024-09-19T09:13:28.743822+0000","last_peered":"2024-09-19T09:13:28.743822+0000","last_clean":"2024-09-19T09:13:28.743822+0000","last_became_active":"2024-09-19T09:13:27.507792+0000","last_became_peered":"2024-09-19T09:13:27.507792+0000","last_unstale":"2024-09-19T09:13:28.743822+0000","last_undegraded":"2024-09-19T09:13:28.743822+0000","last_fullsized":"2024-09-19T09:13:28.743822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:47.574882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.568756+0000","last_change":"2024-09-19T09:13:26.499983+0000","last_active":"2024-09-19T09:13:28.568756+0000","last_peered":"2024-09-19T09:13:28.568756+0000","last_clean":"2024-09-19T09:13:28.568756+0000","last_became_active":"2024-09-19T09:13:26.499730+0000","last_became_peered":"2024-09-19T09:13:26.499730+0000","last_unstale":"2024-09-19T09:13:28.568756+0000","last_undegraded":"2024-09-19T09:13:28.568756+0000","last_fullsized":"2024-09-19T09:13:28.568756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:03.238517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844555+0000","last_change":"2024-09-19T09:13:27.510849+0000","last_active":"2024-09-19T09:13:29.844555+0000","last_peered":"2024-09-19T09:13:29.844555+0000","last_clean":"2024-09-19T09:13:29.844555+0000","last_became_active":"2024-09-19T09:13:27.509292+0000","last_became_peered":"2024-09-19T09:13:27.509292+0000","last_unstale":"2024-09-19T09:13:29.844555+0000","last_undegraded":"2024-09-19T09:13:29.844555+0000","last_fullsized":"2024-09-19T09:13:29.844555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:40.206034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.508003+0000","last_change":"2024-09-19T09:13:26.501792+0000","last_active":"2024-09-19T09:13:28.508003+0000","last_peered":"2024-09-19T09:13:28.508003+0000","last_clean":"2024-09-19T09:13:28.508003+0000","last_became_active":"2024-09-19T09:13:26.501463+0000","last_became_peered":"2024-09-19T09:13:26.501463+0000","last_unstale":"2024-09-19T09:13:28.508003+0000","last_undegraded":"2024-09-19T09:13:28.508003+0000","last_fullsized":"2024-09-19T09:13:28.508003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:21.830229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495227+0000","last_change":"2024-09-19T09:13:27.507955+0000","last_active":"2024-09-19T09:13:29.495227+0000","last_peered":"2024-09-19T09:13:29.495227+0000","last_clean":"2024-09-19T09:13:29.495227+0000","last_became_active":"2024-09-19T09:13:27.506341+0000","last_became_peered":"2024-09-19T09:13:27.506341+0000","last_unstale":"2024-09-19T09:13:29.495227+0000","last_undegraded":"2024-09-19T09:13:29.495227+0000","last_fullsized":"2024-09-19T09:13:29.495227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:51.344378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.568494+0000","last_change":"2024-09-19T09:13:26.498042+0000","last_active":"2024-09-19T09:13:28.568494+0000","last_peered":"2024-09-19T09:13:28.568494+0000","last_clean":"2024-09-19T09:13:28.568494+0000","last_became_active":"2024-09-19T09:13:26.497811+0000","last_became_peered":"2024-09-19T09:13:26.497811+0000","last_unstale":"2024-09-19T09:13:28.568494+0000","last_undegraded":"2024-09-19T09:13:28.568494+0000","last_fullsized":"2024-09-19T09:13:28.568494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:43.720848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.508171+0000","last_change":"2024-09-19T09:13:27.510470+0000","last_active":"2024-09-19T09:13:28.508171+0000","last_peered":"2024-09-19T09:13:28.508171+0000","last_clean":"2024-09-19T09:13:28.508171+0000","last_became_active":"2024-09-19T09:13:27.510158+0000","last_became_peered":"2024-09-19T09:13:27.510158+0000","last_unstale":"2024-09-19T09:13:28.508171+0000","last_undegraded":"2024-09-19T09:13:28.508171+0000","last_fullsized":"2024-09-19T09:13:28.508171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:27.533437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844721+0000","last_change":"2024-09-19T09:13:26.507022+0000","last_active":"2024-09-19T09:13:29.844721+0000","last_peered":"2024-09-19T09:13:29.844721+0000","last_clean":"2024-09-19T09:13:29.844721+0000","last_became_active":"2024-09-19T09:13:26.506756+0000","last_became_peered":"2024-09-19T09:13:26.506756+0000","last_unstale":"2024-09-19T09:13:29.844721+0000","last_undegraded":"2024-09-19T09:13:29.844721+0000","last_fullsized":"2024-09-19T09:13:29.844721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:53.915299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844819+0000","last_change":"2024-09-19T09:13:27.515543+0000","last_active":"2024-09-19T09:13:29.844819+0000","last_peered":"2024-09-19T09:13:29.844819+0000","last_clean":"2024-09-19T09:13:29.844819+0000","last_became_active":"2024-09-19T09:13:27.514992+0000","last_became_peered":"2024-09-19T09:13:27.514992+0000","last_unstale":"2024-09-19T09:13:29.844819+0000","last_undegraded":"2024-09-19T09:13:29.844819+0000","last_fullsized":"2024-09-19T09:13:29.844819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:04.883876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495856+0000","last_change":"2024-09-19T09:13:26.506703+0000","last_active":"2024-09-19T09:13:29.495856+0000","last_peered":"2024-09-19T09:13:29.495856+0000","last_clean":"2024-09-19T09:13:29.495856+0000","last_became_active":"2024-09-19T09:13:26.506378+0000","last_became_peered":"2024-09-19T09:13:26.506378+0000","last_unstale":"2024-09-19T09:13:29.495856+0000","last_undegraded":"2024-09-19T09:13:29.495856+0000","last_fullsized":"2024-09-19T09:13:29.495856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:47:00.782277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.677791+0000","last_change":"2024-09-19T09:13:27.499731+0000","last_active":"2024-09-19T09:13:29.677791+0000","last_peered":"2024-09-19T09:13:29.677791+0000","last_clean":"2024-09-19T09:13:29.677791+0000","last_became_active":"2024-09-19T09:13:27.499258+0000","last_became_peered":"2024-09-19T09:13:27.499258+0000","last_unstale":"2024-09-19T09:13:29.677791+0000","last_undegraded":"2024-09-19T09:13:29.677791+0000","last_fullsized":"2024-09-19T09:13:29.677791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:20.482950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493528+0000","last_change":"2024-09-19T09:13:26.499537+0000","last_active":"2024-09-19T09:13:29.493528+0000","last_peered":"2024-09-19T09:13:29.493528+0000","last_clean":"2024-09-19T09:13:29.493528+0000","last_became_active":"2024-09-19T09:13:26.499042+0000","last_became_peered":"2024-09-19T09:13:26.499042+0000","last_unstale":"2024-09-19T09:13:29.493528+0000","last_undegraded":"2024-09-19T09:13:29.493528+0000","last_fullsized":"2024-09-19T09:13:29.493528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:44.351314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844654+0000","last_change":"2024-09-19T09:13:27.508811+0000","last_active":"2024-09-19T09:13:29.844654+0000","last_peered":"2024-09-19T09:13:29.844654+0000","last_clean":"2024-09-19T09:13:29.844654+0000","last_became_active":"2024-09-19T09:13:27.508529+0000","last_became_peered":"2024-09-19T09:13:27.508529+0000","last_unstale":"2024-09-19T09:13:29.844654+0000","last_undegraded":"2024-09-19T09:13:29.844654+0000","last_fullsized":"2024-09-19T09:13:29.844654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:56.255284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495032+0000","last_change":"2024-09-19T09:13:26.504376+0000","last_active":"2024-09-19T09:13:29.495032+0000","last_peered":"2024-09-19T09:13:29.495032+0000","last_clean":"2024-09-19T09:13:29.495032+0000","last_became_active":"2024-09-19T09:13:26.504121+0000","last_became_peered":"2024-09-19T09:13:26.504121+0000","last_unstale":"2024-09-19T09:13:29.495032+0000","last_undegraded":"2024-09-19T09:13:29.495032+0000","last_fullsized":"2024-09-19T09:13:29.495032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:10.129519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.507470+0000","last_change":"2024-09-19T09:13:27.510114+0000","last_active":"2024-09-19T09:13:28.507470+0000","last_peered":"2024-09-19T09:13:28.507470+0000","last_clean":"2024-09-19T09:13:28.507470+0000","last_became_active":"2024-09-19T09:13:27.509862+0000","last_became_peered":"2024-09-19T09:13:27.509862+0000","last_unstale":"2024-09-19T09:13:28.507470+0000","last_undegraded":"2024-09-19T09:13:28.507470+0000","last_fullsized":"2024-09-19T09:13:28.507470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:44.225098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493249+0000","last_change":"2024-09-19T09:13:26.501637+0000","last_active":"2024-09-19T09:13:29.493249+0000","last_peered":"2024-09-19T09:13:29.493249+0000","last_clean":"2024-09-19T09:13:29.493249+0000","last_became_active":"2024-09-19T09:13:26.501409+0000","last_became_peered":"2024-09-19T09:13:26.501409+0000","last_unstale":"2024-09-19T09:13:29.493249+0000","last_undegraded":"2024-09-19T09:13:29.493249+0000","last_fullsized":"2024-09-19T09:13:29.493249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:56.759101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.494899+0000","last_change":"2024-09-19T09:13:27.514969+0000","last_active":"2024-09-19T09:13:29.494899+0000","last_peered":"2024-09-19T09:13:29.494899+0000","last_clean":"2024-09-19T09:13:29.494899+0000","last_became_active":"2024-09-19T09:13:27.514243+0000","last_became_peered":"2024-09-19T09:13:27.514243+0000","last_unstale":"2024-09-19T09:13:29.494899+0000","last_undegraded":"2024-09-19T09:13:29.494899+0000","last_fullsized":"2024-09-19T09:13:29.494899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:19.521214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.743972+0000","last_change":"2024-09-19T09:13:26.503898+0000","last_active":"2024-09-19T09:13:28.743972+0000","last_peered":"2024-09-19T09:13:28.743972+0000","last_clean":"2024-09-19T09:13:28.743972+0000","last_became_active":"2024-09-19T09:13:26.503631+0000","last_became_peered":"2024-09-19T09:13:26.503631+0000","last_unstale":"2024-09-19T09:13:28.743972+0000","last_undegraded":"2024-09-19T09:13:28.743972+0000","last_fullsized":"2024-09-19T09:13:28.743972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:51.106585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495523+0000","last_change":"2024-09-19T09:13:27.508761+0000","last_active":"2024-09-19T09:13:29.495523+0000","last_peered":"2024-09-19T09:13:29.495523+0000","last_clean":"2024-09-19T09:13:29.495523+0000","last_became_active":"2024-09-19T09:13:27.508339+0000","last_became_peered":"2024-09-19T09:13:27.508339+0000","last_unstale":"2024-09-19T09:13:29.495523+0000","last_undegraded":"2024-09-19T09:13:29.495523+0000","last_fullsized":"2024-09-19T09:13:29.495523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:38.236054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.508592+0000","last_change":"2024-09-19T09:13:26.502447+0000","last_active":"2024-09-19T09:13:28.508592+0000","last_peered":"2024-09-19T09:13:28.508592+0000","last_clean":"2024-09-19T09:13:28.508592+0000","last_became_active":"2024-09-19T09:13:26.501912+0000","last_became_peered":"2024-09-19T09:13:26.501912+0000","last_unstale":"2024-09-19T09:13:28.508592+0000","last_undegraded":"2024-09-19T09:13:28.508592+0000","last_fullsized":"2024-09-19T09:13:28.508592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:43.690569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844799+0000","last_change":"2024-09-19T09:13:27.501572+0000","last_active":"2024-09-19T09:13:29.844799+0000","last_peered":"2024-09-19T09:13:29.844799+0000","last_clean":"2024-09-19T09:13:29.844799+0000","last_became_active":"2024-09-19T09:13:27.501275+0000","last_became_peered":"2024-09-19T09:13:27.501275+0000","last_unstale":"2024-09-19T09:13:29.844799+0000","last_undegraded":"2024-09-19T09:13:29.844799+0000","last_fullsized":"2024-09-19T09:13:29.844799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:43.790948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.677844+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:13:29.677844+0000","last_peered":"2024-09-19T09:13:29.677844+0000","last_clean":"2024-09-19T09:13:29.677844+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:13:29.677844+0000","last_undegraded":"2024-09-19T09:13:29.677844+0000","last_fullsized":"2024-09-19T09:13:29.677844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:22.478151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844853+0000","last_change":"2024-09-19T09:13:26.506369+0000","last_active":"2024-09-19T09:13:29.844853+0000","last_peered":"2024-09-19T09:13:29.844853+0000","last_clean":"2024-09-19T09:13:29.844853+0000","last_became_active":"2024-09-19T09:13:26.506065+0000","last_became_peered":"2024-09-19T09:13:26.506065+0000","last_unstale":"2024-09-19T09:13:29.844853+0000","last_undegraded":"2024-09-19T09:13:29.844853+0000","last_fullsized":"2024-09-19T09:13:29.844853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:18:38.002779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493456+0000","last_change":"2024-09-19T09:13:27.508661+0000","last_active":"2024-09-19T09:13:29.493456+0000","last_peered":"2024-09-19T09:13:29.493456+0000","last_clean":"2024-09-19T09:13:29.493456+0000","last_became_active":"2024-09-19T09:13:27.508377+0000","last_became_peered":"2024-09-19T09:13:27.508377+0000","last_unstale":"2024-09-19T09:13:29.493456+0000","last_undegraded":"2024-09-19T09:13:29.493456+0000","last_fullsized":"2024-09-19T09:13:29.493456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:57:28.264934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844831+0000","last_change":"2024-09-19T09:13:26.504928+0000","last_active":"2024-09-19T09:13:29.844831+0000","last_peered":"2024-09-19T09:13:29.844831+0000","last_clean":"2024-09-19T09:13:29.844831+0000","last_became_active":"2024-09-19T09:13:26.504649+0000","last_became_peered":"2024-09-19T09:13:26.504649+0000","last_unstale":"2024-09-19T09:13:29.844831+0000","last_undegraded":"2024-09-19T09:13:29.844831+0000","last_fullsized":"2024-09-19T09:13:29.844831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:25:24.798674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.508168+0000","last_change":"2024-09-19T09:13:27.507971+0000","last_active":"2024-09-19T09:13:28.508168+0000","last_peered":"2024-09-19T09:13:28.508168+0000","last_clean":"2024-09-19T09:13:28.508168+0000","last_became_active":"2024-09-19T09:13:27.507738+0000","last_became_peered":"2024-09-19T09:13:27.507738+0000","last_unstale":"2024-09-19T09:13:28.508168+0000","last_undegraded":"2024-09-19T09:13:28.508168+0000","last_fullsized":"2024-09-19T09:13:28.508168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:20.297920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.568810+0000","last_change":"2024-09-19T09:13:26.501526+0000","last_active":"2024-09-19T09:13:28.568810+0000","last_peered":"2024-09-19T09:13:28.568810+0000","last_clean":"2024-09-19T09:13:28.568810+0000","last_became_active":"2024-09-19T09:13:26.501281+0000","last_became_peered":"2024-09-19T09:13:26.501281+0000","last_unstale":"2024-09-19T09:13:28.568810+0000","last_undegraded":"2024-09-19T09:13:28.568810+0000","last_fullsized":"2024-09-19T09:13:28.568810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:44.450168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.744156+0000","last_change":"2024-09-19T09:13:27.501824+0000","last_active":"2024-09-19T09:13:28.744156+0000","last_peered":"2024-09-19T09:13:28.744156+0000","last_clean":"2024-09-19T09:13:28.744156+0000","last_became_active":"2024-09-19T09:13:27.500721+0000","last_became_peered":"2024-09-19T09:13:27.500721+0000","last_unstale":"2024-09-19T09:13:28.744156+0000","last_undegraded":"2024-09-19T09:13:28.744156+0000","last_fullsized":"2024-09-19T09:13:28.744156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:45.082435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844855+0000","last_change":"2024-09-19T09:13:26.505847+0000","last_active":"2024-09-19T09:13:29.844855+0000","last_peered":"2024-09-19T09:13:29.844855+0000","last_clean":"2024-09-19T09:13:29.844855+0000","last_became_active":"2024-09-19T09:13:26.505245+0000","last_became_peered":"2024-09-19T09:13:26.505245+0000","last_unstale":"2024-09-19T09:13:29.844855+0000","last_undegraded":"2024-09-19T09:13:29.844855+0000","last_fullsized":"2024-09-19T09:13:29.844855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:25:50.247996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495386+0000","last_change":"2024-09-19T09:13:27.508323+0000","last_active":"2024-09-19T09:13:29.495386+0000","last_peered":"2024-09-19T09:13:29.495386+0000","last_clean":"2024-09-19T09:13:29.495386+0000","last_became_active":"2024-09-19T09:13:27.508090+0000","last_became_peered":"2024-09-19T09:13:27.508090+0000","last_unstale":"2024-09-19T09:13:29.495386+0000","last_undegraded":"2024-09-19T09:13:29.495386+0000","last_fullsized":"2024-09-19T09:13:29.495386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:17.877065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.744638+0000","last_change":"2024-09-19T09:13:26.502978+0000","last_active":"2024-09-19T09:13:28.744638+0000","last_peered":"2024-09-19T09:13:28.744638+0000","last_clean":"2024-09-19T09:13:28.744638+0000","last_became_active":"2024-09-19T09:13:26.502537+0000","last_became_peered":"2024-09-19T09:13:26.502537+0000","last_unstale":"2024-09-19T09:13:28.744638+0000","last_undegraded":"2024-09-19T09:13:28.744638+0000","last_fullsized":"2024-09-19T09:13:28.744638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:10:29.871068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.507592+0000","last_change":"2024-09-19T09:13:27.502356+0000","last_active":"2024-09-19T09:13:28.507592+0000","last_peered":"2024-09-19T09:13:28.507592+0000","last_clean":"2024-09-19T09:13:28.507592+0000","last_became_active":"2024-09-19T09:13:27.502112+0000","last_became_peered":"2024-09-19T09:13:27.502112+0000","last_unstale":"2024-09-19T09:13:28.507592+0000","last_undegraded":"2024-09-19T09:13:28.507592+0000","last_fullsized":"2024-09-19T09:13:28.507592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:26:28.997393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844780+0000","last_change":"2024-09-19T09:13:26.505476+0000","last_active":"2024-09-19T09:13:29.844780+0000","last_peered":"2024-09-19T09:13:29.844780+0000","last_clean":"2024-09-19T09:13:29.844780+0000","last_became_active":"2024-09-19T09:13:26.505190+0000","last_became_peered":"2024-09-19T09:13:26.505190+0000","last_unstale":"2024-09-19T09:13:29.844780+0000","last_undegraded":"2024-09-19T09:13:29.844780+0000","last_fullsized":"2024-09-19T09:13:29.844780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:45.467871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.508345+0000","last_change":"2024-09-19T09:13:27.507787+0000","last_active":"2024-09-19T09:13:28.508345+0000","last_peered":"2024-09-19T09:13:28.508345+0000","last_clean":"2024-09-19T09:13:28.508345+0000","last_became_active":"2024-09-19T09:13:27.507515+0000","last_became_peered":"2024-09-19T09:13:27.507515+0000","last_unstale":"2024-09-19T09:13:28.508345+0000","last_undegraded":"2024-09-19T09:13:28.508345+0000","last_fullsized":"2024-09-19T09:13:28.508345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:59.050231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493662+0000","last_change":"2024-09-19T09:13:26.497706+0000","last_active":"2024-09-19T09:13:29.493662+0000","last_peered":"2024-09-19T09:13:29.493662+0000","last_clean":"2024-09-19T09:13:29.493662+0000","last_became_active":"2024-09-19T09:13:26.497446+0000","last_became_peered":"2024-09-19T09:13:26.497446+0000","last_unstale":"2024-09-19T09:13:29.493662+0000","last_undegraded":"2024-09-19T09:13:29.493662+0000","last_fullsized":"2024-09-19T09:13:29.493662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:10.881483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493342+0000","last_change":"2024-09-19T09:13:27.507619+0000","last_active":"2024-09-19T09:13:29.493342+0000","last_peered":"2024-09-19T09:13:29.493342+0000","last_clean":"2024-09-19T09:13:29.493342+0000","last_became_active":"2024-09-19T09:13:27.506922+0000","last_became_peered":"2024-09-19T09:13:27.506922+0000","last_unstale":"2024-09-19T09:13:29.493342+0000","last_undegraded":"2024-09-19T09:13:29.493342+0000","last_fullsized":"2024-09-19T09:13:29.493342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:19.978047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844756+0000","last_change":"2024-09-19T09:13:26.506097+0000","last_active":"2024-09-19T09:13:29.844756+0000","last_peered":"2024-09-19T09:13:29.844756+0000","last_clean":"2024-09-19T09:13:29.844756+0000","last_became_active":"2024-09-19T09:13:26.505562+0000","last_became_peered":"2024-09-19T09:13:26.505562+0000","last_unstale":"2024-09-19T09:13:29.844756+0000","last_undegraded":"2024-09-19T09:13:29.844756+0000","last_fullsized":"2024-09-19T09:13:29.844756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:31.643028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493424+0000","last_change":"2024-09-19T09:13:27.506209+0000","last_active":"2024-09-19T09:13:29.493424+0000","last_peered":"2024-09-19T09:13:29.493424+0000","last_clean":"2024-09-19T09:13:29.493424+0000","last_became_active":"2024-09-19T09:13:27.505712+0000","last_became_peered":"2024-09-19T09:13:27.505712+0000","last_unstale":"2024-09-19T09:13:29.493424+0000","last_undegraded":"2024-09-19T09:13:29.493424+0000","last_fullsized":"2024-09-19T09:13:29.493424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:45.068134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495531+0000","last_change":"2024-09-19T09:13:26.501858+0000","last_active":"2024-09-19T09:13:29.495531+0000","last_peered":"2024-09-19T09:13:29.495531+0000","last_clean":"2024-09-19T09:13:29.495531+0000","last_became_active":"2024-09-19T09:13:26.501606+0000","last_became_peered":"2024-09-19T09:13:26.501606+0000","last_unstale":"2024-09-19T09:13:29.495531+0000","last_undegraded":"2024-09-19T09:13:29.495531+0000","last_fullsized":"2024-09-19T09:13:29.495531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:12.082586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844974+0000","last_change":"2024-09-19T09:13:27.511660+0000","last_active":"2024-09-19T09:13:29.844974+0000","last_peered":"2024-09-19T09:13:29.844974+0000","last_clean":"2024-09-19T09:13:29.844974+0000","last_became_active":"2024-09-19T09:13:27.511409+0000","last_became_peered":"2024-09-19T09:13:27.511409+0000","last_unstale":"2024-09-19T09:13:29.844974+0000","last_undegraded":"2024-09-19T09:13:29.844974+0000","last_fullsized":"2024-09-19T09:13:29.844974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:16.269907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493355+0000","last_change":"2024-09-19T09:13:26.498599+0000","last_active":"2024-09-19T09:13:29.493355+0000","last_peered":"2024-09-19T09:13:29.493355+0000","last_clean":"2024-09-19T09:13:29.493355+0000","last_became_active":"2024-09-19T09:13:26.498160+0000","last_became_peered":"2024-09-19T09:13:26.498160+0000","last_unstale":"2024-09-19T09:13:29.493355+0000","last_undegraded":"2024-09-19T09:13:29.493355+0000","last_fullsized":"2024-09-19T09:13:29.493355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:42:23.434662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493504+0000","last_change":"2024-09-19T09:13:27.506298+0000","last_active":"2024-09-19T09:13:29.493504+0000","last_peered":"2024-09-19T09:13:29.493504+0000","last_clean":"2024-09-19T09:13:29.493504+0000","last_became_active":"2024-09-19T09:13:27.506029+0000","last_became_peered":"2024-09-19T09:13:27.506029+0000","last_unstale":"2024-09-19T09:13:29.493504+0000","last_undegraded":"2024-09-19T09:13:29.493504+0000","last_fullsized":"2024-09-19T09:13:29.493504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:15.465914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.507863+0000","last_change":"2024-09-19T09:13:26.503468+0000","last_active":"2024-09-19T09:13:28.507863+0000","last_peered":"2024-09-19T09:13:28.507863+0000","last_clean":"2024-09-19T09:13:28.507863+0000","last_became_active":"2024-09-19T09:13:26.503239+0000","last_became_peered":"2024-09-19T09:13:26.503239+0000","last_unstale":"2024-09-19T09:13:28.507863+0000","last_undegraded":"2024-09-19T09:13:28.507863+0000","last_fullsized":"2024-09-19T09:13:28.507863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:39:45.143267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.568617+0000","last_change":"2024-09-19T09:13:27.501631+0000","last_active":"2024-09-19T09:13:28.568617+0000","last_peered":"2024-09-19T09:13:28.568617+0000","last_clean":"2024-09-19T09:13:28.568617+0000","last_became_active":"2024-09-19T09:13:27.501413+0000","last_became_peered":"2024-09-19T09:13:27.501413+0000","last_unstale":"2024-09-19T09:13:28.568617+0000","last_undegraded":"2024-09-19T09:13:28.568617+0000","last_fullsized":"2024-09-19T09:13:28.568617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:49.379552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844436+0000","last_change":"2024-09-19T09:13:26.505929+0000","last_active":"2024-09-19T09:13:29.844436+0000","last_peered":"2024-09-19T09:13:29.844436+0000","last_clean":"2024-09-19T09:13:29.844436+0000","last_became_active":"2024-09-19T09:13:26.505267+0000","last_became_peered":"2024-09-19T09:13:26.505267+0000","last_unstale":"2024-09-19T09:13:29.844436+0000","last_undegraded":"2024-09-19T09:13:29.844436+0000","last_fullsized":"2024-09-19T09:13:29.844436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:12.236637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844651+0000","last_change":"2024-09-19T09:13:27.504679+0000","last_active":"2024-09-19T09:13:29.844651+0000","last_peered":"2024-09-19T09:13:29.844651+0000","last_clean":"2024-09-19T09:13:29.844651+0000","last_became_active":"2024-09-19T09:13:27.504448+0000","last_became_peered":"2024-09-19T09:13:27.504448+0000","last_unstale":"2024-09-19T09:13:29.844651+0000","last_undegraded":"2024-09-19T09:13:29.844651+0000","last_fullsized":"2024-09-19T09:13:29.844651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:44.574651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844665+0000","last_change":"2024-09-19T09:13:27.515732+0000","last_active":"2024-09-19T09:13:29.844665+0000","last_peered":"2024-09-19T09:13:29.844665+0000","last_clean":"2024-09-19T09:13:29.844665+0000","last_became_active":"2024-09-19T09:13:27.515302+0000","last_became_peered":"2024-09-19T09:13:27.515302+0000","last_unstale":"2024-09-19T09:13:29.844665+0000","last_undegraded":"2024-09-19T09:13:29.844665+0000","last_fullsized":"2024-09-19T09:13:29.844665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:44.892454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495453+0000","last_change":"2024-09-19T09:13:26.498383+0000","last_active":"2024-09-19T09:13:29.495453+0000","last_peered":"2024-09-19T09:13:29.495453+0000","last_clean":"2024-09-19T09:13:29.495453+0000","last_became_active":"2024-09-19T09:13:26.498142+0000","last_became_peered":"2024-09-19T09:13:26.498142+0000","last_unstale":"2024-09-19T09:13:29.495453+0000","last_undegraded":"2024-09-19T09:13:29.495453+0000","last_fullsized":"2024-09-19T09:13:29.495453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:46.179021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.677710+0000","last_change":"2024-09-19T09:13:27.515820+0000","last_active":"2024-09-19T09:13:29.677710+0000","last_peered":"2024-09-19T09:13:29.677710+0000","last_clean":"2024-09-19T09:13:29.677710+0000","last_became_active":"2024-09-19T09:13:27.515575+0000","last_became_peered":"2024-09-19T09:13:27.515575+0000","last_unstale":"2024-09-19T09:13:29.677710+0000","last_undegraded":"2024-09-19T09:13:29.677710+0000","last_fullsized":"2024-09-19T09:13:29.677710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:59:08.406348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495637+0000","last_change":"2024-09-19T09:13:26.497950+0000","last_active":"2024-09-19T09:13:29.495637+0000","last_peered":"2024-09-19T09:13:29.495637+0000","last_clean":"2024-09-19T09:13:29.495637+0000","last_became_active":"2024-09-19T09:13:26.497689+0000","last_became_peered":"2024-09-19T09:13:26.497689+0000","last_unstale":"2024-09-19T09:13:29.495637+0000","last_undegraded":"2024-09-19T09:13:29.495637+0000","last_fullsized":"2024-09-19T09:13:29.495637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:36:05.171954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.744307+0000","last_change":"2024-09-19T09:13:27.496465+0000","last_active":"2024-09-19T09:13:28.744307+0000","last_peered":"2024-09-19T09:13:28.744307+0000","last_clean":"2024-09-19T09:13:28.744307+0000","last_became_active":"2024-09-19T09:13:27.496138+0000","last_became_peered":"2024-09-19T09:13:27.496138+0000","last_unstale":"2024-09-19T09:13:28.744307+0000","last_undegraded":"2024-09-19T09:13:28.744307+0000","last_fullsized":"2024-09-19T09:13:28.744307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:44.657136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.744302+0000","last_change":"2024-09-19T09:13:26.502836+0000","last_active":"2024-09-19T09:13:28.744302+0000","last_peered":"2024-09-19T09:13:28.744302+0000","last_clean":"2024-09-19T09:13:28.744302+0000","last_became_active":"2024-09-19T09:13:26.501995+0000","last_became_peered":"2024-09-19T09:13:26.501995+0000","last_unstale":"2024-09-19T09:13:28.744302+0000","last_undegraded":"2024-09-19T09:13:28.744302+0000","last_fullsized":"2024-09-19T09:13:28.744302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:03.744301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.744023+0000","last_change":"2024-09-19T09:13:27.502428+0000","last_active":"2024-09-19T09:13:28.744023+0000","last_peered":"2024-09-19T09:13:28.744023+0000","last_clean":"2024-09-19T09:13:28.744023+0000","last_became_active":"2024-09-19T09:13:27.502152+0000","last_became_peered":"2024-09-19T09:13:27.502152+0000","last_unstale":"2024-09-19T09:13:28.744023+0000","last_undegraded":"2024-09-19T09:13:28.744023+0000","last_fullsized":"2024-09-19T09:13:28.744023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:58.866973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493222+0000","last_change":"2024-09-19T09:13:26.506856+0000","last_active":"2024-09-19T09:13:29.493222+0000","last_peered":"2024-09-19T09:13:29.493222+0000","last_clean":"2024-09-19T09:13:29.493222+0000","last_became_active":"2024-09-19T09:13:26.506714+0000","last_became_peered":"2024-09-19T09:13:26.506714+0000","last_unstale":"2024-09-19T09:13:29.493222+0000","last_undegraded":"2024-09-19T09:13:29.493222+0000","last_fullsized":"2024-09-19T09:13:29.493222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:16.001867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924431,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924555,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194662,"statfs":{"total":200000000,"available":199334095,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195236,"statfs":{"total":200000000,"available":199922271,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":74,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199923973,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":11,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199922943,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194662,"statfs":{"total":200000000,"available":199334117,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924499,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:13:35.217 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T09:13:35.217 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T09:13:35.217 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-19T09:13:35.218 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-19T09:13:35.218 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-19T09:13:35.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.352+0000 7f222e2e4640 1 Processor -- start 2024-09-19T09:13:35.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.352+0000 7f222e2e4640 1 -- start start 2024-09-19T09:13:35.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.353+0000 7f222e2e4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22280d1c70 0x7f22280cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:35.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.353+0000 7f222e2e4640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f22280b5b00 0x7f22280cff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:35.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.353+0000 7f222e2e4640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22280d31b0 con 0x7f222815ed50 2024-09-19T09:13:35.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.353+0000 7f222e2e4640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f22280d3490 con 0x7f22280b5b00 2024-09-19T09:13:35.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.353+0000 7f222e2e4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f22280d3770 con 0x7f22280d1c70 2024-09-19T09:13:35.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.353+0000 7f2227fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f222815ed50 0x7f22280d1560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:42320/0 (socket says 172.21.15.18:42320) 2024-09-19T09:13:35.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.353+0000 7f2227fff640 1 -- 172.21.15.18:0/1476259944 learned_addr learned my addr 172.21.15.18:0/1476259944 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:35.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.353+0000 7f222c881640 1 --2- 172.21.15.18:0/1476259944 >> v2:172.21.15.162:3300/0 conn(0x7f22280b5b00 0x7f22280cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:35.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.353+0000 7f22277fe640 1 --2- 172.21.15.18:0/1476259944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22280d1c70 0x7f22280cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:35.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.354+0000 7f2226ffd640 1 -- 172.21.15.18:0/1476259944 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2790205352 0 0) 0x7f22280d31b0 con 0x7f222815ed50 2024-09-19T09:13:35.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.354+0000 7f2226ffd640 1 -- 172.21.15.18:0/1476259944 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2210003520 con 0x7f222815ed50 2024-09-19T09:13:35.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.354+0000 7f2226ffd640 1 -- 172.21.15.18:0/1476259944 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2983565069 0 0) 0x7f2210003520 con 0x7f222815ed50 2024-09-19T09:13:35.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.354+0000 7f2226ffd640 1 -- 172.21.15.18:0/1476259944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22280d1c70 msgr2=0x7f22280cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:35.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.354+0000 7f2226ffd640 1 --2- 172.21.15.18:0/1476259944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22280d1c70 0x7f22280cf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:35.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.354+0000 7f2226ffd640 1 -- 172.21.15.18:0/1476259944 >> v2:172.21.15.162:3300/0 conn(0x7f22280b5b00 msgr2=0x7f22280cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:35.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.354+0000 7f2226ffd640 1 --2- 172.21.15.18:0/1476259944 >> v2:172.21.15.162:3300/0 conn(0x7f22280b5b00 0x7f22280cff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:35.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.354+0000 7f2226ffd640 1 -- 172.21.15.18:0/1476259944 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22280d3a50 con 0x7f222815ed50 2024-09-19T09:13:35.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.354+0000 7f2226ffd640 1 -- 172.21.15.18:0/1476259944 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f2218001670 con 0x7f222815ed50 2024-09-19T09:13:35.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.354+0000 7f2226ffd640 1 -- 172.21.15.18:0/1476259944 >> v1:172.21.15.18:6789/0 conn(0x7f222815ed50 legacy=0x7f22280d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:35.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.354+0000 7f2226ffd640 1 --2- 172.21.15.18:0/1476259944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22280d1c70 0x7f22100039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:35.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.354+0000 7f2226ffd640 1 --2- 172.21.15.18:0/1476259944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2210003f30 0x7f2210004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:35.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.354+0000 7f2226ffd640 1 --2- 172.21.15.18:0/1476259944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2210004d40 0x7f22100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:35.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.354+0000 7f2226ffd640 1 -- 172.21.15.18:0/1476259944 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f22280d3490 con 0x7f2210004d40 2024-09-19T09:13:35.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.354+0000 7f2226ffd640 1 -- 172.21.15.18:0/1476259944 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f22280d3770 con 0x7f2210003f30 2024-09-19T09:13:35.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.354+0000 7f2226ffd640 1 -- 172.21.15.18:0/1476259944 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f221000b9f0 con 0x7f22280d1c70 2024-09-19T09:13:35.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.354+0000 7f222c881640 1 --2- 172.21.15.18:0/1476259944 >> v2:172.21.15.162:3300/0 conn(0x7f22280b5b00 0x7f22280cff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:13:35.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.354+0000 7f2227fff640 1 --2- 172.21.15.18:0/1476259944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22280d1c70 0x7f22100039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:35.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.354+0000 7f222c881640 1 --2- 172.21.15.18:0/1476259944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2210004d40 0x7f22100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:35.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.354+0000 7f22277fe640 1 --2- 172.21.15.18:0/1476259944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2210003f30 0x7f2210004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:35.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.354+0000 7f222c881640 1 -- 172.21.15.18:0/1476259944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22280d1c70 msgr2=0x7f22100039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:35.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.354+0000 7f222c881640 1 --2- 172.21.15.18:0/1476259944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22280d1c70 0x7f22100039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:35.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.354+0000 7f222c881640 1 -- 172.21.15.18:0/1476259944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2210003f30 msgr2=0x7f2210004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:35.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.354+0000 7f222c881640 1 --2- 172.21.15.18:0/1476259944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2210003f30 0x7f2210004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:35.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.354+0000 7f222c881640 1 -- 172.21.15.18:0/1476259944 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2210003520 con 0x7f2210004d40 2024-09-19T09:13:35.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.355+0000 7f222c881640 1 --2- 172.21.15.18:0/1476259944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2210004d40 0x7f22100051c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f222000e320 tx=0x7f2210005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebedee9173df2eb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:35.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.355+0000 7f2226ffd640 1 -- 172.21.15.18:0/1476259944 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2220009dc0 con 0x7f2210004d40 2024-09-19T09:13:35.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.355+0000 7f2226ffd640 1 -- 172.21.15.18:0/1476259944 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2220003b90 con 0x7f2210004d40 2024-09-19T09:13:35.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.355+0000 7f2226ffd640 1 -- 172.21.15.18:0/1476259944 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2220004020 con 0x7f2210004d40 2024-09-19T09:13:35.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.356+0000 7f222e2e4640 1 -- 172.21.15.18:0/1476259944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2210004d40 msgr2=0x7f22100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:35.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.356+0000 7f222e2e4640 1 --2- 172.21.15.18:0/1476259944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2210004d40 0x7f22100051c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f222000e320 tx=0x7f2210005830 comp rx=0 tx=0).stop 2024-09-19T09:13:35.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.356+0000 7f222c881640 1 -- 172.21.15.18:0/1476259944 reap_dead start 2024-09-19T09:13:35.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.356+0000 7f222e2e4640 1 -- 172.21.15.18:0/1476259944 shutdown_connections 2024-09-19T09:13:35.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.356+0000 7f222e2e4640 1 -- 172.21.15.18:0/1476259944 >> 172.21.15.18:0/1476259944 conn(0x7f22280d4bd0 msgr2=0x7f22280d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:35.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.356+0000 7f222e2e4640 1 -- 172.21.15.18:0/1476259944 shutdown_connections 2024-09-19T09:13:35.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.356+0000 7f222e2e4640 1 -- 172.21.15.18:0/1476259944 wait complete. 2024-09-19T09:13:35.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.357+0000 7f222e2e4640 1 Processor -- start 2024-09-19T09:13:35.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.357+0000 7f222e2e4640 1 -- start start 2024-09-19T09:13:35.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.358+0000 7f222e2e4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2210004d40 0x7f222815ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:35.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.358+0000 7f222e2e4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22280b8a50 0x7f22280b9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:35.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.358+0000 7f222e2e4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22280cbca0 0x7f22280cc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:35.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.358+0000 7f222e2e4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f222815f130 con 0x7f22280cbca0 2024-09-19T09:13:35.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.358+0000 7f222e2e4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f22280d3d30 con 0x7f2210004d40 2024-09-19T09:13:35.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.358+0000 7f222e2e4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f22280ba410 con 0x7f22280b8a50 2024-09-19T09:13:35.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.358+0000 7f222c881640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22280cbca0 0x7f22280cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:35.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.358+0000 7f222c881640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22280cbca0 0x7f22280cc150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36220/0 (socket says 172.21.15.18:36220) 2024-09-19T09:13:35.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.358+0000 7f222c881640 1 -- 172.21.15.18:0/254543533 learned_addr learned my addr 172.21.15.18:0/254543533 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:35.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.358+0000 7f22277fe640 1 --2- 172.21.15.18:0/254543533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22280b8a50 0x7f22280b9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:35.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.358+0000 7f2227fff640 1 --2- 172.21.15.18:0/254543533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2210004d40 0x7f222815ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:35.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.358+0000 7f222c881640 1 -- 172.21.15.18:0/254543533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22280b8a50 msgr2=0x7f22280b9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:35.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.358+0000 7f222c881640 1 --2- 172.21.15.18:0/254543533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22280b8a50 0x7f22280b9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:35.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.358+0000 7f222c881640 1 -- 172.21.15.18:0/254543533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2210004d40 msgr2=0x7f222815ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:35.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.359+0000 7f222c881640 1 --2- 172.21.15.18:0/254543533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2210004d40 0x7f222815ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:35.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.359+0000 7f222c881640 1 -- 172.21.15.18:0/254543533 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f222815b370 con 0x7f22280cbca0 2024-09-19T09:13:35.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.359+0000 7f222c881640 1 --2- 172.21.15.18:0/254543533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22280cbca0 0x7f22280cc150 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f222000e440 tx=0x7f2220009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:35.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.359+0000 7f2224ff9640 1 -- 172.21.15.18:0/254543533 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2220046070 con 0x7f22280cbca0 2024-09-19T09:13:35.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.359+0000 7f2224ff9640 1 -- 172.21.15.18:0/254543533 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f222002ee10 con 0x7f22280cbca0 2024-09-19T09:13:35.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.359+0000 7f222e2e4640 1 -- 172.21.15.18:0/254543533 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f222815ffd0 con 0x7f22280cbca0 2024-09-19T09:13:35.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.359+0000 7f2224ff9640 1 -- 172.21.15.18:0/254543533 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2220009dc0 con 0x7f22280cbca0 2024-09-19T09:13:35.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.359+0000 7f222e2e4640 1 -- 172.21.15.18:0/254543533 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22280ba130 con 0x7f22280cbca0 2024-09-19T09:13:35.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.360+0000 7f222e2e4640 1 -- 172.21.15.18:0/254543533 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22280d21e0 con 0x7f22280cbca0 2024-09-19T09:13:35.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.360+0000 7f2224ff9640 1 -- 172.21.15.18:0/254543533 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2220036810 con 0x7f22280cbca0 2024-09-19T09:13:35.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.361+0000 7f2224ff9640 1 --2- 172.21.15.18:0/254543533 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f221406c2e0 0x7f221406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:35.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.361+0000 7f2224ff9640 1 -- 172.21.15.18:0/254543533 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f22200abe70 con 0x7f22280cbca0 2024-09-19T09:13:35.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.361+0000 7f2227fff640 1 --2- 172.21.15.18:0/254543533 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f221406c2e0 0x7f221406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:35.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.362+0000 7f2227fff640 1 --2- 172.21.15.18:0/254543533 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f221406c2e0 0x7f221406e7a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2218007d90 tx=0x7f22180078f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:35.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.365+0000 7f2224ff9640 1 -- 172.21.15.18:0/254543533 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2220032030 con 0x7f22280cbca0 2024-09-19T09:13:35.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.592+0000 7f222e2e4640 1 -- 172.21.15.18:0/254543533 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f22280cf2e0 con 0x7f22280cbca0 2024-09-19T09:13:35.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.595+0000 7f2224ff9640 1 -- 172.21.15.18:0/254543533 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+173509 (secure 0 0 0) 0x7f2220079f80 con 0x7f22280cbca0 2024-09-19T09:13:35.597 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:35.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.598+0000 7f222e2e4640 1 -- 172.21.15.18:0/254543533 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f221406c2e0 msgr2=0x7f221406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:35.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.598+0000 7f222e2e4640 1 --2- 172.21.15.18:0/254543533 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f221406c2e0 0x7f221406e7a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2218007d90 tx=0x7f22180078f0 comp rx=0 tx=0).stop 2024-09-19T09:13:35.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.598+0000 7f222e2e4640 1 -- 172.21.15.18:0/254543533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22280cbca0 msgr2=0x7f22280cc150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:35.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.598+0000 7f222e2e4640 1 --2- 172.21.15.18:0/254543533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22280cbca0 0x7f22280cc150 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f222000e440 tx=0x7f2220009750 comp rx=0 tx=0).stop 2024-09-19T09:13:35.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.598+0000 7f222e2e4640 1 -- 172.21.15.18:0/254543533 shutdown_connections 2024-09-19T09:13:35.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.598+0000 7f222e2e4640 1 --2- 172.21.15.18:0/254543533 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f221406c2e0 0x7f221406e7a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:35.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.598+0000 7f222e2e4640 1 --2- 172.21.15.18:0/254543533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22280cbca0 0x7f22280cc150 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:35.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.598+0000 7f222e2e4640 1 --2- 172.21.15.18:0/254543533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22280b8a50 0x7f22280b9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:35.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.598+0000 7f222e2e4640 1 --2- 172.21.15.18:0/254543533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2210004d40 0x7f222815ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:35.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.598+0000 7f222e2e4640 1 -- 172.21.15.18:0/254543533 >> 172.21.15.18:0/254543533 conn(0x7f22280d4bd0 msgr2=0x7f22280b5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:35.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.598+0000 7f222e2e4640 1 -- 172.21.15.18:0/254543533 shutdown_connections 2024-09-19T09:13:35.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.598+0000 7f222e2e4640 1 -- 172.21.15.18:0/254543533 wait complete. 2024-09-19T09:13:35.609 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":2027634341},{"type":"v1","addr":"172.21.15.162:6833","nonce":2027634341}]},"active_addr":"172.21.15.162:6833/2027634341","active_change":"2024-09-19T09:13:15.512343+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4101,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.162:0","nonce":877604283}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.162:0","nonce":57548937}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.162:0","nonce":2456104984}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.162:0","nonce":1128358556}]}]} 2024-09-19T09:13:35.612 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-19T09:13:35.613 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-19T09:13:35.613 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:13:35.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.714+0000 7fc2a072a640 1 Processor -- start 2024-09-19T09:13:35.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.714+0000 7fc2a072a640 1 -- start start 2024-09-19T09:13:35.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.715+0000 7fc2a072a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc298160300 0x7fc2980cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:35.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.715+0000 7fc2a072a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc2980d1ed0 0x7fc2980cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:35.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.715+0000 7fc2a072a640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2980d0050 con 0x7fc29806f8e0 2024-09-19T09:13:35.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.715+0000 7fc2a072a640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fc2980d0330 con 0x7fc298160300 2024-09-19T09:13:35.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.715+0000 7fc2a072a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc2980d1420 con 0x7fc2980d1ed0 2024-09-19T09:13:35.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.716+0000 7fc29e4c6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc298160300 0x7fc2980cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:35.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.716+0000 7fc29e4c6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc298160300 0x7fc2980cf2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36228/0 (socket says 172.21.15.18:36228) 2024-09-19T09:13:35.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.716+0000 7fc29e4c6640 1 -- 172.21.15.18:0/4283309429 learned_addr learned my addr 172.21.15.18:0/4283309429 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:35.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.716+0000 7fc29dcc5640 1 --2- 172.21.15.18:0/4283309429 >> v2:172.21.15.162:3300/0 conn(0x7fc2980d1ed0 0x7fc2980cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:35.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.716+0000 7fc29e4c6640 1 -- 172.21.15.18:0/4283309429 >> v2:172.21.15.162:3300/0 conn(0x7fc2980d1ed0 msgr2=0x7fc2980cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:35.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.716+0000 7fc29e4c6640 1 --2- 172.21.15.18:0/4283309429 >> v2:172.21.15.162:3300/0 conn(0x7fc2980d1ed0 0x7fc2980cf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:35.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.716+0000 7fc29e4c6640 1 -- 172.21.15.18:0/4283309429 >> v1:172.21.15.162:6789/0 conn(0x7fc29806f8e0 legacy=0x7fc29806fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:35.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.716+0000 7fc29e4c6640 1 -- 172.21.15.18:0/4283309429 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2980d1700 con 0x7fc298160300 2024-09-19T09:13:35.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.717+0000 7fc29e4c6640 1 --2- 172.21.15.18:0/4283309429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc298160300 0x7fc2980cf2d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc2980b4590 tx=0x7fc29002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa218821765e50e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:35.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.717+0000 7fc29d4c4640 1 -- 172.21.15.18:0/4283309429 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc290037070 con 0x7fc298160300 2024-09-19T09:13:35.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.717+0000 7fc29d4c4640 1 -- 172.21.15.18:0/4283309429 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc290032440 con 0x7fc298160300 2024-09-19T09:13:35.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.717+0000 7fc29d4c4640 1 -- 172.21.15.18:0/4283309429 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc290032810 con 0x7fc298160300 2024-09-19T09:13:35.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.717+0000 7fc2a072a640 1 -- 172.21.15.18:0/4283309429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc298160300 msgr2=0x7fc2980cf2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:35.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.717+0000 7fc2a072a640 1 --2- 172.21.15.18:0/4283309429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc298160300 0x7fc2980cf2d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc2980b4590 tx=0x7fc29002a230 comp rx=0 tx=0).stop 2024-09-19T09:13:35.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.717+0000 7fc2a072a640 1 -- 172.21.15.18:0/4283309429 shutdown_connections 2024-09-19T09:13:35.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.717+0000 7fc2a072a640 1 --2- 172.21.15.18:0/4283309429 >> v2:172.21.15.162:3300/0 conn(0x7fc2980d1ed0 0x7fc2980cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:35.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.717+0000 7fc2a072a640 1 --2- 172.21.15.18:0/4283309429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc298160300 0x7fc2980cf2d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:35.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.717+0000 7fc2a072a640 1 -- 172.21.15.18:0/4283309429 >> 172.21.15.18:0/4283309429 conn(0x7fc2980b4600 msgr2=0x7fc2980b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:35.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.717+0000 7fc2a072a640 1 -- 172.21.15.18:0/4283309429 shutdown_connections 2024-09-19T09:13:35.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.717+0000 7fc2a072a640 1 -- 172.21.15.18:0/4283309429 wait complete. 2024-09-19T09:13:35.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.719+0000 7fc2a072a640 1 Processor -- start 2024-09-19T09:13:35.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.719+0000 7fc2a072a640 1 -- start start 2024-09-19T09:13:35.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.719+0000 7fc2a072a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc29806f8e0 0x7fc2980c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:35.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.719+0000 7fc2a072a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2980d1ed0 0x7fc29814bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:35.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.719+0000 7fc2a072a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc298160300 0x7fc2980b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:35.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.719+0000 7fc2a072a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc2980cfd50 con 0x7fc298160300 2024-09-19T09:13:35.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.719+0000 7fc2a072a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc2980b54a0 con 0x7fc29806f8e0 2024-09-19T09:13:35.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.719+0000 7fc2a072a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc2981606e0 con 0x7fc2980d1ed0 2024-09-19T09:13:35.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.720+0000 7fc29ecc7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc298160300 0x7fc2980b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:35.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.720+0000 7fc29ecc7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc298160300 0x7fc2980b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36232/0 (socket says 172.21.15.18:36232) 2024-09-19T09:13:35.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.720+0000 7fc29ecc7640 1 -- 172.21.15.18:0/248520177 learned_addr learned my addr 172.21.15.18:0/248520177 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:35.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.720+0000 7fc29e4c6640 1 --2- 172.21.15.18:0/248520177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc29806f8e0 0x7fc2980c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:35.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.720+0000 7fc29dcc5640 1 --2- 172.21.15.18:0/248520177 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2980d1ed0 0x7fc29814bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:35.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.720+0000 7fc29ecc7640 1 -- 172.21.15.18:0/248520177 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2980d1ed0 msgr2=0x7fc29814bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:35.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.720+0000 7fc29ecc7640 1 --2- 172.21.15.18:0/248520177 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2980d1ed0 0x7fc29814bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:35.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.720+0000 7fc29ecc7640 1 -- 172.21.15.18:0/248520177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc29806f8e0 msgr2=0x7fc2980c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:35.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.720+0000 7fc29ecc7640 1 --2- 172.21.15.18:0/248520177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc29806f8e0 0x7fc2980c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:35.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.720+0000 7fc29ecc7640 1 -- 172.21.15.18:0/248520177 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2980c8110 con 0x7fc298160300 2024-09-19T09:13:35.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.720+0000 7fc29dcc5640 1 --2- 172.21.15.18:0/248520177 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2980d1ed0 0x7fc29814bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:13:35.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.720+0000 7fc29ecc7640 1 --2- 172.21.15.18:0/248520177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc298160300 0x7fc2980b1130 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc28800c780 tx=0x7fc28800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:35.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.720+0000 7fc296ffd640 1 -- 172.21.15.18:0/248520177 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc288004b60 con 0x7fc298160300 2024-09-19T09:13:35.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.720+0000 7fc296ffd640 1 -- 172.21.15.18:0/248520177 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc288004d00 con 0x7fc298160300 2024-09-19T09:13:35.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.720+0000 7fc2a072a640 1 -- 172.21.15.18:0/248520177 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2980c83f0 con 0x7fc298160300 2024-09-19T09:13:35.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.720+0000 7fc296ffd640 1 -- 172.21.15.18:0/248520177 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc28800aa90 con 0x7fc298160300 2024-09-19T09:13:35.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.720+0000 7fc2a072a640 1 -- 172.21.15.18:0/248520177 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2980c89b0 con 0x7fc298160300 2024-09-19T09:13:35.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.721+0000 7fc2a072a640 1 -- 172.21.15.18:0/248520177 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2980cf2d0 con 0x7fc298160300 2024-09-19T09:13:35.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.722+0000 7fc296ffd640 1 -- 172.21.15.18:0/248520177 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc28800ac30 con 0x7fc298160300 2024-09-19T09:13:35.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.722+0000 7fc296ffd640 1 --2- 172.21.15.18:0/248520177 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc28406c2b0 0x7fc28406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:35.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.722+0000 7fc296ffd640 1 -- 172.21.15.18:0/248520177 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc28808b5a0 con 0x7fc298160300 2024-09-19T09:13:35.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.722+0000 7fc29e4c6640 1 --2- 172.21.15.18:0/248520177 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc28406c2b0 0x7fc28406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:35.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.723+0000 7fc29e4c6640 1 --2- 172.21.15.18:0/248520177 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc28406c2b0 0x7fc28406e770 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc290034000 tx=0x7fc29002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:35.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.726+0000 7fc296ffd640 1 -- 172.21.15.18:0/248520177 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc288020070 con 0x7fc298160300 2024-09-19T09:13:35.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.903+0000 7fc2a072a640 1 -- 172.21.15.18:0/248520177 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc298068740 con 0x7fc298160300 2024-09-19T09:13:35.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.904+0000 7fc296ffd640 1 -- 172.21.15.18:0/248520177 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16681 (secure 0 0 0) 0x7fc288059da0 con 0x7fc298160300 2024-09-19T09:13:35.904 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:35.905 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:13:28.500103+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:13:25.116784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:13:25.838110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:13:35.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.906+0000 7fc2a072a640 1 -- 172.21.15.18:0/248520177 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc28406c2b0 msgr2=0x7fc28406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:35.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.906+0000 7fc2a072a640 1 --2- 172.21.15.18:0/248520177 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc28406c2b0 0x7fc28406e770 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc290034000 tx=0x7fc29002e000 comp rx=0 tx=0).stop 2024-09-19T09:13:35.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.906+0000 7fc2a072a640 1 -- 172.21.15.18:0/248520177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc298160300 msgr2=0x7fc2980b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:35.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.906+0000 7fc2a072a640 1 --2- 172.21.15.18:0/248520177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc298160300 0x7fc2980b1130 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc28800c780 tx=0x7fc28800cc40 comp rx=0 tx=0).stop 2024-09-19T09:13:35.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.906+0000 7fc2a072a640 1 -- 172.21.15.18:0/248520177 shutdown_connections 2024-09-19T09:13:35.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.906+0000 7fc2a072a640 1 --2- 172.21.15.18:0/248520177 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc28406c2b0 0x7fc28406e770 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:35.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.906+0000 7fc2a072a640 1 --2- 172.21.15.18:0/248520177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc298160300 0x7fc2980b1130 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:35.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.906+0000 7fc2a072a640 1 --2- 172.21.15.18:0/248520177 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc2980d1ed0 0x7fc29814bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:35.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.906+0000 7fc2a072a640 1 --2- 172.21.15.18:0/248520177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc29806f8e0 0x7fc2980c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:35.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.906+0000 7fc2a072a640 1 -- 172.21.15.18:0/248520177 >> 172.21.15.18:0/248520177 conn(0x7fc2980b4600 msgr2=0x7fc2980b3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:35.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.906+0000 7fc2a072a640 1 -- 172.21.15.18:0/248520177 shutdown_connections 2024-09-19T09:13:35.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:35.906+0000 7fc2a072a640 1 -- 172.21.15.18:0/248520177 wait complete. 2024-09-19T09:13:35.917 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-19T09:13:35.917 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:13:36.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.019+0000 7f8ebf5bd640 1 Processor -- start 2024-09-19T09:13:36.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.019+0000 7f8ebf5bd640 1 -- start start 2024-09-19T09:13:36.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.020+0000 7f8ebf5bd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8eb80b3ce0 0x7f8eb80cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.020+0000 7f8ebf5bd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8eb80d0050 0x7f8eb80cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.020+0000 7f8ebf5bd640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8eb80d0e10 con 0x7f8eb80cf560 2024-09-19T09:13:36.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.020+0000 7f8ebf5bd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8eb80d0850 con 0x7f8eb80b3ce0 2024-09-19T09:13:36.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.020+0000 7f8ebf5bd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8eb80d0b30 con 0x7f8eb80d0050 2024-09-19T09:13:36.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.020+0000 7f8ebcb58640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8eb80b3ce0 0x7f8eb80cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.020+0000 7f8ebdb5a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8eb80d0050 0x7f8eb80cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.020+0000 7f8ebd359640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f8eb80cf560 0x7f8eb80cf940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:55048/0 (socket says 172.21.15.18:55048) 2024-09-19T09:13:36.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.020+0000 7f8ebcb58640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8eb80b3ce0 0x7f8eb80cd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:57876/0 (socket says 172.21.15.18:57876) 2024-09-19T09:13:36.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.020+0000 7f8ebd359640 1 -- 172.21.15.18:0/17778749 learned_addr learned my addr 172.21.15.18:0/17778749 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:36.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.021+0000 7f8ebcb58640 1 -- 172.21.15.18:0/17778749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8eb80d0050 msgr2=0x7f8eb80cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:36.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.021+0000 7f8ebcb58640 1 --2- 172.21.15.18:0/17778749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8eb80d0050 0x7f8eb80cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.021+0000 7f8ebcb58640 1 -- 172.21.15.18:0/17778749 >> v1:172.21.15.162:6789/0 conn(0x7f8eb80cf560 legacy=0x7f8eb80cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.021+0000 7f8ebcb58640 1 -- 172.21.15.18:0/17778749 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb80b24d0 con 0x7f8eb80b3ce0 2024-09-19T09:13:36.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.021+0000 7f8ebcb58640 1 --2- 172.21.15.18:0/17778749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb80b3ce0 0x7f8eb80cd5f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80097a0 tx=0x7f8ea802a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e5a6cbd8bc909b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.022+0000 7f8eaffff640 1 -- 172.21.15.18:0/17778749 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8037070 con 0x7f8eb80b3ce0 2024-09-19T09:13:36.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.022+0000 7f8eaffff640 1 -- 172.21.15.18:0/17778749 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea802adb0 con 0x7f8eb80b3ce0 2024-09-19T09:13:36.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.022+0000 7f8eaffff640 1 -- 172.21.15.18:0/17778749 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8032660 con 0x7f8eb80b3ce0 2024-09-19T09:13:36.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.022+0000 7f8ebf5bd640 1 -- 172.21.15.18:0/17778749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb80b3ce0 msgr2=0x7f8eb80cd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.022+0000 7f8ebf5bd640 1 --2- 172.21.15.18:0/17778749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb80b3ce0 0x7f8eb80cd5f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8ea80097a0 tx=0x7f8ea802a060 comp rx=0 tx=0).stop 2024-09-19T09:13:36.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.022+0000 7f8ebf5bd640 1 -- 172.21.15.18:0/17778749 shutdown_connections 2024-09-19T09:13:36.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.022+0000 7f8ebf5bd640 1 --2- 172.21.15.18:0/17778749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8eb80d0050 0x7f8eb80cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.022+0000 7f8ebf5bd640 1 --2- 172.21.15.18:0/17778749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb80b3ce0 0x7f8eb80cd5f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.022+0000 7f8ebf5bd640 1 -- 172.21.15.18:0/17778749 >> 172.21.15.18:0/17778749 conn(0x7f8eb80b4700 msgr2=0x7f8eb80b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:36.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.022+0000 7f8ebf5bd640 1 -- 172.21.15.18:0/17778749 shutdown_connections 2024-09-19T09:13:36.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.022+0000 7f8ebf5bd640 1 -- 172.21.15.18:0/17778749 wait complete. 2024-09-19T09:13:36.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.023+0000 7f8ebf5bd640 1 Processor -- start 2024-09-19T09:13:36.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.024+0000 7f8ebf5bd640 1 -- start start 2024-09-19T09:13:36.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.024+0000 7f8ebf5bd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8eb80b3ce0 0x7f8eb81f84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.024+0000 7f8ebf5bd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8eb80cf560 0x7f8eb81f8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.024+0000 7f8ebf5bd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb80d0050 0x7f8eb81f4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.024+0000 7f8ebf5bd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb80b55a0 con 0x7f8eb80cf560 2024-09-19T09:13:36.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.024+0000 7f8ebf5bd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb80b5420 con 0x7f8eb80d0050 2024-09-19T09:13:36.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.024+0000 7f8ebf5bd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8eb815d090 con 0x7f8eb80b3ce0 2024-09-19T09:13:36.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.024+0000 7f8ebcb58640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8eb80cf560 0x7f8eb81f8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.024+0000 7f8ebcb58640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8eb80cf560 0x7f8eb81f8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36236/0 (socket says 172.21.15.18:36236) 2024-09-19T09:13:36.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.024+0000 7f8ebcb58640 1 -- 172.21.15.18:0/3887624878 learned_addr learned my addr 172.21.15.18:0/3887624878 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:36.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.024+0000 7f8ebd359640 1 --2- 172.21.15.18:0/3887624878 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8eb80b3ce0 0x7f8eb81f84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.024+0000 7f8ebdb5a640 1 --2- 172.21.15.18:0/3887624878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb80d0050 0x7f8eb81f4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.025+0000 7f8ebcb58640 1 -- 172.21.15.18:0/3887624878 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8eb80b3ce0 msgr2=0x7f8eb81f84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.025+0000 7f8ebcb58640 1 --2- 172.21.15.18:0/3887624878 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8eb80b3ce0 0x7f8eb81f84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.025+0000 7f8ebcb58640 1 -- 172.21.15.18:0/3887624878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb80d0050 msgr2=0x7f8eb81f4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.025+0000 7f8ebcb58640 1 --2- 172.21.15.18:0/3887624878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb80d0050 0x7f8eb81f4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.025+0000 7f8ebcb58640 1 -- 172.21.15.18:0/3887624878 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb815dc60 con 0x7f8eb80cf560 2024-09-19T09:13:36.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.025+0000 7f8ebcb58640 1 --2- 172.21.15.18:0/3887624878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8eb80cf560 0x7f8eb81f8a00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8035040 tx=0x7f8ea80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.025+0000 7f8eadffb640 1 -- 172.21.15.18:0/3887624878 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8041070 con 0x7f8eb80cf560 2024-09-19T09:13:36.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.025+0000 7f8eadffb640 1 -- 172.21.15.18:0/3887624878 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea803c460 con 0x7f8eb80cf560 2024-09-19T09:13:36.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.025+0000 7f8eadffb640 1 -- 172.21.15.18:0/3887624878 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8037040 con 0x7f8eb80cf560 2024-09-19T09:13:36.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.025+0000 7f8ebf5bd640 1 -- 172.21.15.18:0/3887624878 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eb815df40 con 0x7f8eb80cf560 2024-09-19T09:13:36.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.025+0000 7f8ebf5bd640 1 -- 172.21.15.18:0/3887624878 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eb815e500 con 0x7f8eb80cf560 2024-09-19T09:13:36.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.026+0000 7f8ebf5bd640 1 -- 172.21.15.18:0/3887624878 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8eb80cf940 con 0x7f8eb80cf560 2024-09-19T09:13:36.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.027+0000 7f8eadffb640 1 -- 172.21.15.18:0/3887624878 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8ea803a070 con 0x7f8eb80cf560 2024-09-19T09:13:36.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.027+0000 7f8eadffb640 1 --2- 172.21.15.18:0/3887624878 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8e9c06c2b0 0x7f8e9c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.027+0000 7f8eadffb640 1 -- 172.21.15.18:0/3887624878 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f8ea80ab6e0 con 0x7f8eb80cf560 2024-09-19T09:13:36.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.027+0000 7f8ebd359640 1 --2- 172.21.15.18:0/3887624878 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8e9c06c2b0 0x7f8e9c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.028+0000 7f8ebd359640 1 --2- 172.21.15.18:0/3887624878 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8e9c06c2b0 0x7f8e9c06e770 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4005880 tx=0x7f8eb4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.031+0000 7f8eadffb640 1 -- 172.21.15.18:0/3887624878 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8ea8079780 con 0x7f8eb80cf560 2024-09-19T09:13:36.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.207+0000 7f8ebf5bd640 1 -- 172.21.15.18:0/3887624878 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8eb80ce5c0 con 0x7f8eb80cf560 2024-09-19T09:13:36.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.208+0000 7f8eadffb640 1 -- 172.21.15.18:0/3887624878 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16681 (secure 0 0 0) 0x7f8ea807da80 con 0x7f8eb80cf560 2024-09-19T09:13:36.209 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:36.209 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:13:28.500103+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:13:25.116784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:13:25.838110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:13:36.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.211+0000 7f8ebf5bd640 1 -- 172.21.15.18:0/3887624878 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8e9c06c2b0 msgr2=0x7f8e9c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.211+0000 7f8ebf5bd640 1 --2- 172.21.15.18:0/3887624878 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8e9c06c2b0 0x7f8e9c06e770 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8eb4005880 tx=0x7f8eb4009040 comp rx=0 tx=0).stop 2024-09-19T09:13:36.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.211+0000 7f8ebf5bd640 1 -- 172.21.15.18:0/3887624878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8eb80cf560 msgr2=0x7f8eb81f8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.211+0000 7f8ebf5bd640 1 --2- 172.21.15.18:0/3887624878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8eb80cf560 0x7f8eb81f8a00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8035040 tx=0x7f8ea80046c0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.211+0000 7f8ebf5bd640 1 -- 172.21.15.18:0/3887624878 shutdown_connections 2024-09-19T09:13:36.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.211+0000 7f8ebf5bd640 1 --2- 172.21.15.18:0/3887624878 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8e9c06c2b0 0x7f8e9c06e770 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.211+0000 7f8ebf5bd640 1 --2- 172.21.15.18:0/3887624878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb80d0050 0x7f8eb81f4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.211+0000 7f8ebf5bd640 1 --2- 172.21.15.18:0/3887624878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8eb80cf560 0x7f8eb81f8a00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.211+0000 7f8ebf5bd640 1 --2- 172.21.15.18:0/3887624878 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8eb80b3ce0 0x7f8eb81f84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.211+0000 7f8ebf5bd640 1 -- 172.21.15.18:0/3887624878 >> 172.21.15.18:0/3887624878 conn(0x7f8eb80b4700 msgr2=0x7f8eb80afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:36.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.211+0000 7f8ebf5bd640 1 -- 172.21.15.18:0/3887624878 shutdown_connections 2024-09-19T09:13:36.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.211+0000 7f8ebf5bd640 1 -- 172.21.15.18:0/3887624878 wait complete. 2024-09-19T09:13:36.223 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-19T09:13:36.223 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-19T09:13:36.223 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-19T09:13:36.224 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-19T09:13:36.224 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-19T09:13:36.225 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-19T09:13:36.225 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-19T09:13:36.225 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-19T09:13:36.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.400+0000 7fa09e198640 1 Processor -- start 2024-09-19T09:13:36.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.401+0000 7fa09e198640 1 -- start start 2024-09-19T09:13:36.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.401+0000 7f2b7b362640 1 Processor -- start 2024-09-19T09:13:36.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.402+0000 7f2b7b362640 1 -- start start 2024-09-19T09:13:36.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.402+0000 7fa09e198640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0980c5a80 0x7fa0980c5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.402+0000 7f49822cf640 1 Processor -- start 2024-09-19T09:13:36.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.402+0000 7fa09e198640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa09806d4c0 con 0x7fa0980d1970 2024-09-19T09:13:36.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.402+0000 7fa09e198640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0980b3320 con 0x7fa09806cd20 2024-09-19T09:13:36.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.402+0000 7fa09e198640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa0980c63a0 con 0x7fa0980c5a80 2024-09-19T09:13:36.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.402+0000 7fa097fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa0980d1970 0x7fa09816cc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:42326/0 (socket says 172.21.15.18:42326) 2024-09-19T09:13:36.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.402+0000 7fa097fff640 1 -- 172.21.15.18:0/2939137697 learned_addr learned my addr 172.21.15.18:0/2939137697 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:36.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.402+0000 7ff52f586640 1 Processor -- start 2024-09-19T09:13:36.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.402+0000 7ff52f586640 1 -- start start 2024-09-19T09:13:36.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.402+0000 7fa0977fe640 1 --2- 172.21.15.18:0/2939137697 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0980c5a80 0x7fa0980c5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.403+0000 7fe04ffff640 1 Processor -- start 2024-09-19T09:13:36.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.403+0000 7fe04ffff640 1 -- start start 2024-09-19T09:13:36.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.403+0000 7fa0977fe640 1 -- 172.21.15.18:0/2939137697 >> v1:172.21.15.162:6789/0 conn(0x7fa09806cd20 legacy=0x7fa0980b3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.403+0000 7fa0977fe640 1 -- 172.21.15.18:0/2939137697 >> v1:172.21.15.18:6789/0 conn(0x7fa0980d1970 legacy=0x7fa09816cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.403+0000 7fa0977fe640 1 -- 172.21.15.18:0/2939137697 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa09806d1e0 con 0x7fa0980c5a80 2024-09-19T09:13:36.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.403+0000 7f2b7b362640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2b74148420 0x7f2b74072dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.403+0000 7f2b7b362640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2b7406e2f0 0x7f2b74162b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.403+0000 7f2b7b362640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b740715a0 con 0x7f2b7406dea0 2024-09-19T09:13:36.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.403+0000 7f2b7b362640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f2b74071880 con 0x7f2b74148420 2024-09-19T09:13:36.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.403+0000 7f2b7b362640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2b74071b60 con 0x7f2b7406e2f0 2024-09-19T09:13:36.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.404+0000 7ff52f586640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff52815b020 0x7ff5280d1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.404+0000 7ff52f586640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff52806d550 con 0x7ff52806cec0 2024-09-19T09:13:36.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.404+0000 7ff52f586640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5280d0d80 con 0x7ff52806c320 2024-09-19T09:13:36.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.402+0000 7f49822cf640 1 -- start start 2024-09-19T09:13:36.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.404+0000 7f49822cf640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f497400a4f0 0x7f4974036020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.404+0000 7f49822cf640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f497404ff50 0x7f4974036560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.404+0000 7f49822cf640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4974039630 con 0x7f49740551b0 2024-09-19T09:13:36.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.404+0000 7f49822cf640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f4974039910 con 0x7f497400a4f0 2024-09-19T09:13:36.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.404+0000 7f49822cf640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4974039bf0 con 0x7f497404ff50 2024-09-19T09:13:36.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.404+0000 7fa0977fe640 1 --2- 172.21.15.18:0/2939137697 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0980c5a80 0x7fa0980c5e60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa0880097d0 tx=0x7fa08802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ce6a75ce251572e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.404+0000 7f2b7a360640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2b74148420 0x7f2b74072dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.404+0000 7f2b7a360640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2b74148420 0x7f2b74072dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36250/0 (socket says 172.21.15.18:36250) 2024-09-19T09:13:36.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.404+0000 7f2b7a360640 1 -- 172.21.15.18:0/2622426935 learned_addr learned my addr 172.21.15.18:0/2622426935 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:36.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.404+0000 7faae90e7640 1 Processor -- start 2024-09-19T09:13:36.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.404+0000 7fcd220a6640 1 Processor -- start 2024-09-19T09:13:36.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.404+0000 7faae90e7640 1 -- start start 2024-09-19T09:13:36.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.404+0000 7ff52f586640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff52806d330 con 0x7ff52815b020 2024-09-19T09:13:36.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.404+0000 7ff52cb21640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff52806cec0 0x7ff52806bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:42342/0 (socket says 172.21.15.18:42342) 2024-09-19T09:13:36.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.404+0000 7ff52cb21640 1 -- 172.21.15.18:0/1975644769 learned_addr learned my addr 172.21.15.18:0/1975644769 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:36.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.404+0000 7ff52d322640 1 --2- 172.21.15.18:0/1975644769 >> v2:172.21.15.162:3300/0 conn(0x7ff52815b020 0x7ff5280d1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.404+0000 7f2b7ab61640 1 --2- 172.21.15.18:0/2622426935 >> v2:172.21.15.162:3300/0 conn(0x7f2b7406e2f0 0x7f2b74162b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.404+0000 7fcd220a6640 1 -- start start 2024-09-19T09:13:36.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.404+0000 7f0f0b1a6640 1 Processor -- start 2024-09-19T09:13:36.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.404+0000 7fe04ffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe048034c30 0x7fe048035b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.404+0000 7fe04ffff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe048048db0 0x7fe048053a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.404+0000 7fe04ffff640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe048052080 con 0x7fe048036080 2024-09-19T09:13:36.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.404+0000 7fe04ffff640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fe048052360 con 0x7fe048034c30 2024-09-19T09:13:36.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.404+0000 7fe04ffff640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe048052640 con 0x7fe048048db0 2024-09-19T09:13:36.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.404+0000 7f4980acc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f49740551b0 0x7f4974005a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:42350/0 (socket says 172.21.15.18:42350) 2024-09-19T09:13:36.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.404+0000 7f4980acc640 1 -- 172.21.15.18:0/2638624370 learned_addr learned my addr 172.21.15.18:0/2638624370 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:36.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.404+0000 7f4981ace640 1 --2- 172.21.15.18:0/2638624370 >> v2:172.21.15.162:3300/0 conn(0x7f497404ff50 0x7f4974036560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7f4981ace640 1 -- 172.21.15.18:0/2638624370 >> v2:172.21.15.18:3300/0 conn(0x7f497400a4f0 msgr2=0x7f4974036020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:36.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7f4981ace640 1 --2- 172.21.15.18:0/2638624370 >> v2:172.21.15.18:3300/0 conn(0x7f497400a4f0 0x7f4974036020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7f4981ace640 1 -- 172.21.15.18:0/2638624370 >> v1:172.21.15.18:6789/0 conn(0x7f49740551b0 legacy=0x7f4974005a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:36.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7f4981ace640 1 -- 172.21.15.18:0/2638624370 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4974039ed0 con 0x7f497404ff50 2024-09-19T09:13:36.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.405+0000 7fe04e7fc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe048036080 0x7fe0480486a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:42356/0 (socket says 172.21.15.18:42356) 2024-09-19T09:13:36.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.405+0000 7fe04e7fc640 1 -- 172.21.15.18:0/4176163572 learned_addr learned my addr 172.21.15.18:0/4176163572 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:36.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.405+0000 7fe04dffb640 1 -- 172.21.15.18:0/4176163572 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2382462540 0 0) 0x7fe048052080 con 0x7fe048036080 2024-09-19T09:13:36.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.405+0000 7fe04dffb640 1 -- 172.21.15.18:0/4176163572 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe038003520 con 0x7fe048036080 2024-09-19T09:13:36.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7fe04f7fe640 1 --2- 172.21.15.18:0/4176163572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe048048db0 0x7fe048053a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.405+0000 7f2b7a360640 1 -- 172.21.15.18:0/2622426935 >> v2:172.21.15.162:3300/0 conn(0x7f2b7406e2f0 msgr2=0x7f2b74162b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:36.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.405+0000 7f2b7a360640 1 --2- 172.21.15.18:0/2622426935 >> v2:172.21.15.162:3300/0 conn(0x7f2b7406e2f0 0x7f2b74162b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.405+0000 7f2b7a360640 1 -- 172.21.15.18:0/2622426935 >> v1:172.21.15.162:6789/0 conn(0x7f2b7406dea0 legacy=0x7f2b74162440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.405+0000 7f2b7a360640 1 -- 172.21.15.18:0/2622426935 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b74071e40 con 0x7f2b74148420 2024-09-19T09:13:36.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.405+0000 7fa0967fc640 1 -- 172.21.15.18:0/2939137697 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa088037070 con 0x7fa0980c5a80 2024-09-19T09:13:36.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.405+0000 7fa0967fc640 1 -- 172.21.15.18:0/2939137697 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa088032440 con 0x7fa0980c5a80 2024-09-19T09:13:36.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.405+0000 7fa0967fc640 1 -- 172.21.15.18:0/2939137697 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa088032810 con 0x7fa0980c5a80 2024-09-19T09:13:36.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7fa09e198640 1 -- 172.21.15.18:0/2939137697 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0980c5a80 msgr2=0x7fa0980c5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7fa09e198640 1 --2- 172.21.15.18:0/2939137697 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0980c5a80 0x7fa0980c5e60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa0880097d0 tx=0x7fa08802a210 comp rx=0 tx=0).stop 2024-09-19T09:13:36.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.405+0000 7ff51ffff640 1 -- 172.21.15.18:0/1975644769 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1665355250 0 0) 0x7ff52806d550 con 0x7ff52806cec0 2024-09-19T09:13:36.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.405+0000 7ff51ffff640 1 -- 172.21.15.18:0/1975644769 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff514003520 con 0x7ff52806cec0 2024-09-19T09:13:36.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.405+0000 7ff51ffff640 1 -- 172.21.15.18:0/1975644769 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 25035942 0 0) 0x7ff5280d0d80 con 0x7ff52806c320 2024-09-19T09:13:36.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.405+0000 7ff51ffff640 1 -- 172.21.15.18:0/1975644769 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff52806d550 con 0x7ff52806c320 2024-09-19T09:13:36.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.405+0000 7ff52d322640 1 -- 172.21.15.18:0/1975644769 >> v1:172.21.15.162:6789/0 conn(0x7ff52806c320 legacy=0x7ff5280cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.405+0000 7ff52d322640 1 -- 172.21.15.18:0/1975644769 >> v1:172.21.15.18:6789/0 conn(0x7ff52806cec0 legacy=0x7ff52806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.405+0000 7ff52d322640 1 -- 172.21.15.18:0/1975644769 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5280d1060 con 0x7ff52815b020 2024-09-19T09:13:36.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.405+0000 7f0f0b1a6640 1 -- start start 2024-09-19T09:13:36.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7f0f0b1a6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0efc034c30 0x7f0efc035b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7faae90e7640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7faae4148420 0x7faae4072dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7faae90e7640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faae4163260 con 0x7faae406e2f0 2024-09-19T09:13:36.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7faae90e7640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faae40715a0 con 0x7faae406dea0 2024-09-19T09:13:36.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7faae90e7640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7faae4071880 con 0x7faae4148420 2024-09-19T09:13:36.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7fcd220a6640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcd14035a70 0x7fcd14055690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7faae88e6640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7faae406e2f0 0x7faae4162b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:42364/0 (socket says 172.21.15.18:42364) 2024-09-19T09:13:36.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7faae88e6640 1 -- 172.21.15.18:0/2673063891 learned_addr learned my addr 172.21.15.18:0/2673063891 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:36.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7fcd1b7fe640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fcd140e09b0 0x7fcd14038220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:55084/0 (socket says 172.21.15.18:55084) 2024-09-19T09:13:36.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7f0f0b1a6640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0efc052080 con 0x7f0efc048db0 2024-09-19T09:13:36.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7f0f0b1a6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0efc052360 con 0x7f0efc036080 2024-09-19T09:13:36.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7f0f0b1a6640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f0efc052640 con 0x7f0efc034c30 2024-09-19T09:13:36.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7f0f03fff640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f0efc036080 0x7f0efc0486a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:55090/0 (socket says 172.21.15.18:55090) 2024-09-19T09:13:36.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7f0f03fff640 1 -- 172.21.15.18:0/624320429 learned_addr learned my addr 172.21.15.18:0/624320429 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:36.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7fcd220a6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcd140354b0 0x7fcd14038930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7f0f08f42640 1 --2- 172.21.15.18:0/624320429 >> v2:172.21.15.18:3300/0 conn(0x7f0efc034c30 0x7f0efc035b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7faae3fff640 1 --2- 172.21.15.18:0/2673063891 >> v2:172.21.15.18:3300/0 conn(0x7faae4148420 0x7faae4072dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7fe04dffb640 1 -- 172.21.15.18:0/4176163572 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2990030938 0 0) 0x7fe038003520 con 0x7fe048036080 2024-09-19T09:13:36.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7fe04dffb640 1 -- 172.21.15.18:0/4176163572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe048048db0 msgr2=0x7fe048053a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:36.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7fe04dffb640 1 --2- 172.21.15.18:0/4176163572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe048048db0 0x7fe048053a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7fe04dffb640 1 -- 172.21.15.18:0/4176163572 >> v2:172.21.15.18:3300/0 conn(0x7fe048034c30 msgr2=0x7fe048035b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:36.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7fe04dffb640 1 --2- 172.21.15.18:0/4176163572 >> v2:172.21.15.18:3300/0 conn(0x7fe048034c30 0x7fe048035b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7fe04dffb640 1 -- 172.21.15.18:0/4176163572 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe048052920 con 0x7fe048036080 2024-09-19T09:13:36.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7fe04dffb640 1 -- 172.21.15.18:0/4176163572 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fe050068d90 con 0x7fe048036080 2024-09-19T09:13:36.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7fe04dffb640 1 -- 172.21.15.18:0/4176163572 >> v1:172.21.15.18:6789/0 conn(0x7fe048036080 legacy=0x7fe0480486a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7fe04dffb640 1 --2- 172.21.15.18:0/4176163572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0380039d0 0x7fe038003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7fe04dffb640 1 --2- 172.21.15.18:0/4176163572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe048048db0 0x7fe038004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7fe04dffb640 1 --2- 172.21.15.18:0/4176163572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe038004d40 0x7fe0380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7fe04dffb640 1 -- 172.21.15.18:0/4176163572 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe048052360 con 0x7fe038004d40 2024-09-19T09:13:36.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7fe04dffb640 1 -- 172.21.15.18:0/4176163572 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe048052640 con 0x7fe0380039d0 2024-09-19T09:13:36.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7fe04dffb640 1 -- 172.21.15.18:0/4176163572 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe03800bac0 con 0x7fe048048db0 2024-09-19T09:13:36.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7fcd1b7fe640 1 -- 172.21.15.18:0/2620114814 learned_addr learned my addr 172.21.15.18:0/2620114814 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:36.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7fa09e198640 1 -- 172.21.15.18:0/2939137697 shutdown_connections 2024-09-19T09:13:36.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7fa09e198640 1 --2- 172.21.15.18:0/2939137697 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0980c5a80 0x7fa0980c5e60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7fa09e198640 1 -- 172.21.15.18:0/2939137697 >> 172.21.15.18:0/2939137697 conn(0x7fa0980d2ab0 msgr2=0x7fa0980d2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:36.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7fe04e7fc640 1 --2- 172.21.15.18:0/4176163572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe048048db0 0x7fe038004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7fcd220a6640 1 -- 172.21.15.18:0/2620114814 --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd14038e70 con 0x7fcd140e09b0 2024-09-19T09:13:36.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7fcd220a6640 1 -- 172.21.15.18:0/2620114814 --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fcd140390f0 con 0x7fcd140354b0 2024-09-19T09:13:36.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7f0f037fe640 1 -- 172.21.15.18:0/624320429 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2510151053 0 0) 0x7f0efc052360 con 0x7f0efc036080 2024-09-19T09:13:36.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7f0f037fe640 1 -- 172.21.15.18:0/624320429 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ef4003520 con 0x7f0efc036080 2024-09-19T09:13:36.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7fe04effd640 1 --2- 172.21.15.18:0/4176163572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0380039d0 0x7fe038003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7fcd220a6640 1 -- 172.21.15.18:0/2620114814 --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fcd140573f0 con 0x7fcd14035a70 2024-09-19T09:13:36.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.406+0000 7ff52d322640 1 --2- 172.21.15.18:0/1975644769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff52815b020 0x7ff5280d1b40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff5180097a0 tx=0x7ff51802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d27452805bdd51e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7ff51ffff640 1 -- 172.21.15.18:0/1975644769 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff518037070 con 0x7ff52815b020 2024-09-19T09:13:36.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7fcd1affd640 1 --2- 172.21.15.18:0/2620114814 >> v2:172.21.15.162:3300/0 conn(0x7fcd14035a70 0x7fcd14055690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7ff51ffff640 1 -- 172.21.15.18:0/1975644769 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff518032440 con 0x7ff52815b020 2024-09-19T09:13:36.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7ff51ffff640 1 -- 172.21.15.18:0/1975644769 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff518032810 con 0x7ff52815b020 2024-09-19T09:13:36.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7f4981ace640 1 --2- 172.21.15.18:0/2638624370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f497404ff50 0x7f4974036560 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f497c065710 tx=0x7f497c0a8cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=973ddc4b5f9eb701 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7fe04e7fc640 1 -- 172.21.15.18:0/4176163572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0380039d0 msgr2=0x7fe038003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:36.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7fe04e7fc640 1 --2- 172.21.15.18:0/4176163572 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0380039d0 0x7fe038003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7fe04e7fc640 1 -- 172.21.15.18:0/4176163572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe038004d40 msgr2=0x7fe0380051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:36.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7fe04e7fc640 1 --2- 172.21.15.18:0/4176163572 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe038004d40 0x7fe0380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7fe04e7fc640 1 -- 172.21.15.18:0/4176163572 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe048052920 con 0x7fe048048db0 2024-09-19T09:13:36.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7f2b7a360640 1 --2- 172.21.15.18:0/2622426935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b74148420 0x7f2b74072dc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2b7406c760 tx=0x7f2b7002a280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9f1070b964abe56 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7f4973fff640 1 -- 172.21.15.18:0/2638624370 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497c0af070 con 0x7f497404ff50 2024-09-19T09:13:36.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7f4973fff640 1 -- 172.21.15.18:0/2638624370 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f497c0a9b40 con 0x7f497404ff50 2024-09-19T09:13:36.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7f4973fff640 1 -- 172.21.15.18:0/2638624370 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f497c0b3400 con 0x7f497404ff50 2024-09-19T09:13:36.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7faae2ffd640 1 -- 172.21.15.18:0/2673063891 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 881387482 0 0) 0x7faae40715a0 con 0x7faae406dea0 2024-09-19T09:13:36.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7faae2ffd640 1 -- 172.21.15.18:0/2673063891 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faacc003520 con 0x7faae406dea0 2024-09-19T09:13:36.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7fcd1a7fc640 1 -- 172.21.15.18:0/2620114814 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1153687410 0 0) 0x7fcd0c004b30 con 0x7fcd140e09b0 2024-09-19T09:13:36.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7fcd1bfff640 1 --2- 172.21.15.18:0/2620114814 >> v2:172.21.15.18:3300/0 conn(0x7fcd140354b0 0x7fcd14038930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7fcd1a7fc640 1 -- 172.21.15.18:0/2620114814 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd04003520 con 0x7fcd140e09b0 2024-09-19T09:13:36.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7fcd1affd640 1 -- 172.21.15.18:0/2620114814 >> v2:172.21.15.18:3300/0 conn(0x7fcd140354b0 msgr2=0x7fcd14038930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:36.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7fcd1affd640 1 --2- 172.21.15.18:0/2620114814 >> v2:172.21.15.18:3300/0 conn(0x7fcd140354b0 0x7fcd14038930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7fcd1affd640 1 -- 172.21.15.18:0/2620114814 >> v1:172.21.15.162:6789/0 conn(0x7fcd140e09b0 legacy=0x7fcd14038220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7fcd1affd640 1 -- 172.21.15.18:0/2620114814 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd14054e90 con 0x7fcd14035a70 2024-09-19T09:13:36.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7f0f037fe640 1 -- 172.21.15.18:0/624320429 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2899764568 0 0) 0x7f0ef4003520 con 0x7f0efc036080 2024-09-19T09:13:36.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7f0f037fe640 1 -- 172.21.15.18:0/624320429 >> v2:172.21.15.18:3300/0 conn(0x7f0efc034c30 msgr2=0x7f0efc035b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:36.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7f0f037fe640 1 --2- 172.21.15.18:0/624320429 >> v2:172.21.15.18:3300/0 conn(0x7f0efc034c30 0x7f0efc035b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7f0f037fe640 1 -- 172.21.15.18:0/624320429 >> v1:172.21.15.18:6789/0 conn(0x7f0efc048db0 legacy=0x7f0efc053a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7f0f037fe640 1 -- 172.21.15.18:0/624320429 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0efc052920 con 0x7f0efc036080 2024-09-19T09:13:36.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7f0f037fe640 1 -- 172.21.15.18:0/624320429 <== mon.1 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f0ef8001670 con 0x7f0efc036080 2024-09-19T09:13:36.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7f0f037fe640 1 -- 172.21.15.18:0/624320429 >> v1:172.21.15.162:6789/0 conn(0x7f0efc036080 legacy=0x7f0efc0486a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7f0f037fe640 1 --2- 172.21.15.18:0/624320429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ef40039b0 0x7f0ef4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7f0f037fe640 1 --2- 172.21.15.18:0/624320429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ef4004800 0x7f0ef4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7f0f037fe640 1 --2- 172.21.15.18:0/624320429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ef40051c0 0x7f0ef400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7f0f037fe640 1 -- 172.21.15.18:0/624320429 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0efc052640 con 0x7f0ef4004800 2024-09-19T09:13:36.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7f0f037fe640 1 -- 172.21.15.18:0/624320429 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef400c110 con 0x7f0ef40051c0 2024-09-19T09:13:36.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7f0f037fe640 1 -- 172.21.15.18:0/624320429 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0ef400c310 con 0x7f0ef40039b0 2024-09-19T09:13:36.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7faae2ffd640 1 -- 172.21.15.18:0/2673063891 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 797256376 0 0) 0x7faae4163260 con 0x7faae406e2f0 2024-09-19T09:13:36.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7faae2ffd640 1 -- 172.21.15.18:0/2673063891 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faae40715a0 con 0x7faae406e2f0 2024-09-19T09:13:36.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7faae3fff640 1 -- 172.21.15.18:0/2673063891 >> v1:172.21.15.162:6789/0 conn(0x7faae406dea0 legacy=0x7faae4162440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.407+0000 7faae3fff640 1 -- 172.21.15.18:0/2673063891 >> v1:172.21.15.18:6789/0 conn(0x7faae406e2f0 legacy=0x7faae4162b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.408+0000 7faae3fff640 1 -- 172.21.15.18:0/2673063891 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae4071b60 con 0x7faae4148420 2024-09-19T09:13:36.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.408+0000 7fa09e198640 1 -- 172.21.15.18:0/2939137697 shutdown_connections 2024-09-19T09:13:36.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.408+0000 7ff52f586640 1 -- 172.21.15.18:0/1975644769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff52815b020 msgr2=0x7ff5280d1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.408+0000 7ff52f586640 1 --2- 172.21.15.18:0/1975644769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff52815b020 0x7ff5280d1b40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff5180097a0 tx=0x7ff51802a230 comp rx=0 tx=0).stop 2024-09-19T09:13:36.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.408+0000 7f2b7935e640 1 -- 172.21.15.18:0/2622426935 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b70037070 con 0x7f2b74148420 2024-09-19T09:13:36.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.408+0000 7fa09e198640 1 -- 172.21.15.18:0/2939137697 wait complete. 2024-09-19T09:13:36.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.408+0000 7ff52f586640 1 -- 172.21.15.18:0/1975644769 shutdown_connections 2024-09-19T09:13:36.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.408+0000 7f2b7935e640 1 -- 172.21.15.18:0/2622426935 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b70032440 con 0x7f2b74148420 2024-09-19T09:13:36.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.408+0000 7f0f09743640 1 --2- 172.21.15.18:0/624320429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ef40051c0 0x7f0ef400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.408+0000 7f0f09743640 1 -- 172.21.15.18:0/624320429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ef40039b0 msgr2=0x7f0ef4003dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:13:36.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.408+0000 7f0f09743640 1 --2- 172.21.15.18:0/624320429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ef40039b0 0x7f0ef4003dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.408+0000 7f0f09743640 1 -- 172.21.15.18:0/624320429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ef4004800 msgr2=0x7f0ef4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:36.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.408+0000 7f0f09743640 1 --2- 172.21.15.18:0/624320429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ef4004800 0x7f0ef4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.408+0000 7f0f09743640 1 -- 172.21.15.18:0/624320429 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0efc052920 con 0x7f0ef40051c0 2024-09-19T09:13:36.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.408+0000 7f49822cf640 1 -- 172.21.15.18:0/2638624370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f497404ff50 msgr2=0x7f4974036560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.408+0000 7f49822cf640 1 --2- 172.21.15.18:0/2638624370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f497404ff50 0x7f4974036560 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f497c065710 tx=0x7f497c0a8cf0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.408+0000 7ff52f586640 1 --2- 172.21.15.18:0/1975644769 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff52815b020 0x7ff5280d1b40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.408+0000 7fe04e7fc640 1 --2- 172.21.15.18:0/4176163572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe048048db0 0x7fe038004800 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe050051220 tx=0x7fe038005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c32913d8ef0adec1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.408+0000 7f49822cf640 1 -- 172.21.15.18:0/2638624370 shutdown_connections 2024-09-19T09:13:36.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.408+0000 7f49822cf640 1 --2- 172.21.15.18:0/2638624370 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f497404ff50 0x7f4974036560 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.408+0000 7f49822cf640 1 --2- 172.21.15.18:0/2638624370 >> v2:172.21.15.18:3300/0 conn(0x7f497400a4f0 0x7f4974036020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.408+0000 7f49822cf640 1 -- 172.21.15.18:0/2638624370 >> 172.21.15.18:0/2638624370 conn(0x7f497401d930 msgr2=0x7f49740545a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:36.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.408+0000 7ff52f586640 1 -- 172.21.15.18:0/1975644769 >> 172.21.15.18:0/1975644769 conn(0x7ff5280b5eb0 msgr2=0x7ff5280b6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:36.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.408+0000 7fe04dffb640 1 -- 172.21.15.18:0/4176163572 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0500b4070 con 0x7fe048048db0 2024-09-19T09:13:36.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.409+0000 7fe04dffb640 1 -- 172.21.15.18:0/4176163572 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0500a7d40 con 0x7fe048048db0 2024-09-19T09:13:36.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.409+0000 7fe04dffb640 1 -- 172.21.15.18:0/4176163572 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0500b4070 con 0x7fe048048db0 2024-09-19T09:13:36.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.409+0000 7f2b7935e640 1 -- 172.21.15.18:0/2622426935 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b70032810 con 0x7f2b74148420 2024-09-19T09:13:36.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.409+0000 7ff52f586640 1 -- 172.21.15.18:0/1975644769 shutdown_connections 2024-09-19T09:13:36.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.409+0000 7fcd1affd640 1 --2- 172.21.15.18:0/2620114814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd14035a70 0x7fcd14055690 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcd140531c0 tx=0x7fcd1002a0e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aad2f184d2935a36 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.409+0000 7f49822cf640 1 -- 172.21.15.18:0/2638624370 shutdown_connections 2024-09-19T09:13:36.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.409+0000 7f2b7b362640 1 -- 172.21.15.18:0/2622426935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b74148420 msgr2=0x7f2b74072dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.409+0000 7f2b7b362640 1 --2- 172.21.15.18:0/2622426935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b74148420 0x7f2b74072dc0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2b7406c760 tx=0x7f2b7002a280 comp rx=0 tx=0).stop 2024-09-19T09:13:36.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.409+0000 7f0f09743640 1 -- 172.21.15.18:0/624320429 reap_dead start 2024-09-19T09:13:36.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.409+0000 7fcd1a7fc640 1 -- 172.21.15.18:0/2620114814 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd10037070 con 0x7fcd14035a70 2024-09-19T09:13:36.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.409+0000 7ff52f586640 1 -- 172.21.15.18:0/1975644769 wait complete. 2024-09-19T09:13:36.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.409+0000 7fcd1a7fc640 1 -- 172.21.15.18:0/2620114814 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd1002adf0 con 0x7fcd14035a70 2024-09-19T09:13:36.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.409+0000 7fcd1a7fc640 1 -- 172.21.15.18:0/2620114814 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd10032660 con 0x7fcd14035a70 2024-09-19T09:13:36.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.409+0000 7faae3fff640 1 --2- 172.21.15.18:0/2673063891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faae4148420 0x7faae4072dc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faadc0097a0 tx=0x7faadc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9564d15bc685c41 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.409+0000 7fa09e198640 1 Processor -- start 2024-09-19T09:13:36.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.409+0000 7f0f09743640 1 --2- 172.21.15.18:0/624320429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ef40051c0 0x7f0ef400b9c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0001750 tx=0x7f0ef4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73b2d41ff43f702c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.410+0000 7f0f037fe640 1 -- 172.21.15.18:0/624320429 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0001370 con 0x7f0ef40051c0 2024-09-19T09:13:36.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.410+0000 7fa09e198640 1 -- start start 2024-09-19T09:13:36.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.410+0000 7f0f037fe640 1 -- 172.21.15.18:0/624320429 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ef00052d0 con 0x7f0ef40051c0 2024-09-19T09:13:36.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.410+0000 7f0f037fe640 1 -- 172.21.15.18:0/624320429 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0001370 con 0x7f0ef40051c0 2024-09-19T09:13:36.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.409+0000 7f49822cf640 1 -- 172.21.15.18:0/2638624370 wait complete. 2024-09-19T09:13:36.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.410+0000 7f2b7b362640 1 -- 172.21.15.18:0/2622426935 shutdown_connections 2024-09-19T09:13:36.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.410+0000 7f2b7b362640 1 --2- 172.21.15.18:0/2622426935 >> v2:172.21.15.162:3300/0 conn(0x7f2b7406e2f0 0x7f2b74162b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.410+0000 7f2b7b362640 1 --2- 172.21.15.18:0/2622426935 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b74148420 0x7f2b74072dc0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.410+0000 7f2b7b362640 1 -- 172.21.15.18:0/2622426935 >> 172.21.15.18:0/2622426935 conn(0x7f2b74068070 msgr2=0x7f2b7406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:36.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.410+0000 7fe04ffff640 1 -- 172.21.15.18:0/4176163572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe048048db0 msgr2=0x7fe038004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.410+0000 7fe04ffff640 1 --2- 172.21.15.18:0/4176163572 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe048048db0 0x7fe038004800 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe050051220 tx=0x7fe038005830 comp rx=0 tx=0).stop 2024-09-19T09:13:36.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.410+0000 7fe04f7fe640 1 -- 172.21.15.18:0/4176163572 reap_dead start 2024-09-19T09:13:36.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.410+0000 7fe04ffff640 1 -- 172.21.15.18:0/4176163572 shutdown_connections 2024-09-19T09:13:36.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.410+0000 7fe04ffff640 1 -- 172.21.15.18:0/4176163572 >> 172.21.15.18:0/4176163572 conn(0x7fe04801ea30 msgr2=0x7fe0480556d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:36.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.410+0000 7fe04ffff640 1 -- 172.21.15.18:0/4176163572 shutdown_connections 2024-09-19T09:13:36.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.410+0000 7faae2ffd640 1 -- 172.21.15.18:0/2673063891 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faadc037070 con 0x7faae4148420 2024-09-19T09:13:36.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.410+0000 7faae2ffd640 1 -- 172.21.15.18:0/2673063891 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faadc032440 con 0x7faae4148420 2024-09-19T09:13:36.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.410+0000 7fcd220a6640 1 -- 172.21.15.18:0/2620114814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd14035a70 msgr2=0x7fcd14055690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.410+0000 7fcd220a6640 1 --2- 172.21.15.18:0/2620114814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd14035a70 0x7fcd14055690 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fcd140531c0 tx=0x7fcd1002a0e0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.410+0000 7fcd220a6640 1 -- 172.21.15.18:0/2620114814 shutdown_connections 2024-09-19T09:13:36.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.410+0000 7fcd220a6640 1 --2- 172.21.15.18:0/2620114814 >> v2:172.21.15.18:3300/0 conn(0x7fcd140354b0 0x7fcd14038930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.410+0000 7fcd220a6640 1 --2- 172.21.15.18:0/2620114814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd14035a70 0x7fcd14055690 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.410+0000 7fcd220a6640 1 -- 172.21.15.18:0/2620114814 >> 172.21.15.18:0/2620114814 conn(0x7fcd140567a0 msgr2=0x7fcd14056bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:36.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.410+0000 7ff52f586640 1 Processor -- start 2024-09-19T09:13:36.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.411+0000 7fcd220a6640 1 -- 172.21.15.18:0/2620114814 shutdown_connections 2024-09-19T09:13:36.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.411+0000 7fcd220a6640 1 -- 172.21.15.18:0/2620114814 wait complete. 2024-09-19T09:13:36.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.411+0000 7f0f0b1a6640 1 -- 172.21.15.18:0/624320429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ef40051c0 msgr2=0x7f0ef400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.411+0000 7f0f0b1a6640 1 --2- 172.21.15.18:0/624320429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ef40051c0 0x7f0ef400b9c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0001750 tx=0x7f0ef4005830 comp rx=0 tx=0).stop 2024-09-19T09:13:36.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.411+0000 7ff52f586640 1 -- start start 2024-09-19T09:13:36.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.411+0000 7f0f0b1a6640 1 -- 172.21.15.18:0/624320429 shutdown_connections 2024-09-19T09:13:36.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.411+0000 7f0f0b1a6640 1 --2- 172.21.15.18:0/624320429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ef40051c0 0x7f0ef400b9c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.411+0000 7f0f0b1a6640 1 -- 172.21.15.18:0/624320429 >> 172.21.15.18:0/624320429 conn(0x7f0efc01ea30 msgr2=0x7f0efc0556d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:36.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.411+0000 7f0f0b1a6640 1 -- 172.21.15.18:0/624320429 shutdown_connections 2024-09-19T09:13:36.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.410+0000 7fe04ffff640 1 -- 172.21.15.18:0/4176163572 wait complete. 2024-09-19T09:13:36.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.411+0000 7faae2ffd640 1 -- 172.21.15.18:0/2673063891 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faadc032810 con 0x7faae4148420 2024-09-19T09:13:36.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.411+0000 7fa09e198640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa09806cd20 0x7fa098164d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.411+0000 7fa09e198640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0980c5a80 0x7fa098165b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.411+0000 7fa09e198640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0980d1970 0x7fa098166090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.411+0000 7fa09e198640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa0980d26f0 con 0x7fa0980d1970 2024-09-19T09:13:36.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.411+0000 7fa09e198640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa0980b2fb0 con 0x7fa09806cd20 2024-09-19T09:13:36.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.411+0000 7fa09e198640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa0980d2870 con 0x7fa0980c5a80 2024-09-19T09:13:36.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.411+0000 7faae90e7640 1 -- 172.21.15.18:0/2673063891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faae4148420 msgr2=0x7faae4072dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.411+0000 7faae90e7640 1 --2- 172.21.15.18:0/2673063891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faae4148420 0x7faae4072dc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faadc0097a0 tx=0x7faadc02a1e0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.411+0000 7faae90e7640 1 -- 172.21.15.18:0/2673063891 shutdown_connections 2024-09-19T09:13:36.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.411+0000 7faae90e7640 1 --2- 172.21.15.18:0/2673063891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faae4148420 0x7faae4072dc0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.411+0000 7faae90e7640 1 -- 172.21.15.18:0/2673063891 >> 172.21.15.18:0/2673063891 conn(0x7faae4068070 msgr2=0x7faae406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:36.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.411+0000 7f0f0b1a6640 1 -- 172.21.15.18:0/624320429 wait complete. 2024-09-19T09:13:36.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.412+0000 7fa097fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0980d1970 0x7fa098166090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.411+0000 7f49822cf640 1 Processor -- start 2024-09-19T09:13:36.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.411+0000 7f49822cf640 1 -- start start 2024-09-19T09:13:36.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.412+0000 7fa097fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0980d1970 0x7fa098166090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36324/0 (socket says 172.21.15.18:36324) 2024-09-19T09:13:36.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.412+0000 7fa097fff640 1 -- 172.21.15.18:0/441510614 learned_addr learned my addr 172.21.15.18:0/441510614 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:36.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.412+0000 7fa096ffd640 1 --2- 172.21.15.18:0/441510614 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0980c5a80 0x7fa098165b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.412+0000 7ff52f586640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff52806c320 0x7ff5281fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.412+0000 7ff52f586640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff52806cec0 0x7ff5280b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.412+0000 7ff52f586640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff52815b020 0x7ff5280b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.412+0000 7ff52f586640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff52815b400 con 0x7ff52806c320 2024-09-19T09:13:36.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.412+0000 7ff52f586640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff5280d1620 con 0x7ff52806cec0 2024-09-19T09:13:36.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.412+0000 7ff52f586640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff52815b580 con 0x7ff52815b020 2024-09-19T09:13:36.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.412+0000 7f49822cf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f497404ff50 0x7f497404a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.412+0000 7f49822cf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49740551b0 0x7f49740de550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.412+0000 7fa0977fe640 1 --2- 172.21.15.18:0/441510614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa09806cd20 0x7fa098164d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.412+0000 7f49822cf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4974035470 0x7f497404cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.412+0000 7faae90e7640 1 -- 172.21.15.18:0/2673063891 shutdown_connections 2024-09-19T09:13:36.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.412+0000 7ff52d322640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff52806c320 0x7ff5281fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.412+0000 7ff52d322640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff52806c320 0x7ff5281fcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36334/0 (socket says 172.21.15.18:36334) 2024-09-19T09:13:36.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.412+0000 7ff52d322640 1 -- 172.21.15.18:0/4104954626 learned_addr learned my addr 172.21.15.18:0/4104954626 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:36.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.412+0000 7ff52cb21640 1 --2- 172.21.15.18:0/4104954626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff52806cec0 0x7ff5280b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.412+0000 7fa097fff640 1 -- 172.21.15.18:0/441510614 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0980c5a80 msgr2=0x7fa098165b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.412+0000 7fa097fff640 1 --2- 172.21.15.18:0/441510614 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa0980c5a80 0x7fa098165b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.412+0000 7fa097fff640 1 -- 172.21.15.18:0/441510614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa09806cd20 msgr2=0x7fa098164d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.412+0000 7fa097fff640 1 --2- 172.21.15.18:0/441510614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa09806cd20 0x7fa098164d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.412+0000 7fa097fff640 1 -- 172.21.15.18:0/441510614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0980b5980 con 0x7fa0980d1970 2024-09-19T09:13:36.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.413+0000 7ff52d322640 1 -- 172.21.15.18:0/4104954626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff52815b020 msgr2=0x7ff5280b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.413+0000 7ff52db23640 1 --2- 172.21.15.18:0/4104954626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff52815b020 0x7ff5280b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.413+0000 7ff52d322640 1 --2- 172.21.15.18:0/4104954626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff52815b020 0x7ff5280b0ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.413+0000 7fa097fff640 1 --2- 172.21.15.18:0/441510614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0980d1970 0x7fa098166090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa09000caa0 tx=0x7fa09000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.413+0000 7ff52d322640 1 -- 172.21.15.18:0/4104954626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff52806cec0 msgr2=0x7ff5280b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.413+0000 7fcd220a6640 1 Processor -- start 2024-09-19T09:13:36.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.413+0000 7ff52d322640 1 --2- 172.21.15.18:0/4104954626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff52806cec0 0x7ff5280b05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.413+0000 7ff52d322640 1 -- 172.21.15.18:0/4104954626 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff528155a60 con 0x7ff52806c320 2024-09-19T09:13:36.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.413+0000 7ff52d322640 1 --2- 172.21.15.18:0/4104954626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff52806c320 0x7ff5281fcbd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff518009890 tx=0x7ff5180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.413+0000 7f0f0b1a6640 1 Processor -- start 2024-09-19T09:13:36.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.413+0000 7fcd220a6640 1 -- start start 2024-09-19T09:13:36.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.412+0000 7faae90e7640 1 -- 172.21.15.18:0/2673063891 wait complete. 2024-09-19T09:13:36.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.412+0000 7fe04ffff640 1 Processor -- start 2024-09-19T09:13:36.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.412+0000 7fe04ffff640 1 -- start start 2024-09-19T09:13:36.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.413+0000 7fe04ffff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe048048db0 0x7fe0480dcd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.413+0000 7fe04ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe04804c7a0 0x7fe0480e0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.413+0000 7fe04ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe04804cc00 0x7fe0480e0e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.414+0000 7fe04ffff640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe048053a00 con 0x7fe04804c7a0 2024-09-19T09:13:36.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.414+0000 7fe04ffff640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe048035560 con 0x7fe04804cc00 2024-09-19T09:13:36.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.414+0000 7fe04ffff640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe048053b80 con 0x7fe048048db0 2024-09-19T09:13:36.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.414+0000 7ff51dffb640 1 -- 172.21.15.18:0/4104954626 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff518037050 con 0x7ff52806c320 2024-09-19T09:13:36.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.414+0000 7ff51dffb640 1 -- 172.21.15.18:0/4104954626 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff518043070 con 0x7ff52806c320 2024-09-19T09:13:36.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.414+0000 7ff51dffb640 1 -- 172.21.15.18:0/4104954626 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51803cb30 con 0x7ff52806c320 2024-09-19T09:13:36.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.414+0000 7ff52f586640 1 -- 172.21.15.18:0/4104954626 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff528155d40 con 0x7ff52806c320 2024-09-19T09:13:36.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.414+0000 7ff52f586640 1 -- 172.21.15.18:0/4104954626 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff528156300 con 0x7ff52806c320 2024-09-19T09:13:36.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.413+0000 7fa07ffff640 1 -- 172.21.15.18:0/441510614 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa090017070 con 0x7fa0980d1970 2024-09-19T09:13:36.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.413+0000 7fa07ffff640 1 -- 172.21.15.18:0/441510614 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa09000ac00 con 0x7fa0980d1970 2024-09-19T09:13:36.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.414+0000 7fe04f7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe04804cc00 0x7fe0480e0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.414+0000 7fe04f7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe04804cc00 0x7fe0480e0e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:57978/0 (socket says 172.21.15.18:57978) 2024-09-19T09:13:36.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.414+0000 7fe04f7fe640 1 -- 172.21.15.18:0/200585454 learned_addr learned my addr 172.21.15.18:0/200585454 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:36.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.415+0000 7fcd220a6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd140354b0 0x7fcd140395d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.414+0000 7fe04effd640 1 --2- 172.21.15.18:0/200585454 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe048048db0 0x7fe0480dcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.414+0000 7fe04f7fe640 1 -- 172.21.15.18:0/200585454 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe048048db0 msgr2=0x7fe0480dcd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.414+0000 7fe04f7fe640 1 --2- 172.21.15.18:0/200585454 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe048048db0 0x7fe0480dcd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.414+0000 7fe04f7fe640 1 -- 172.21.15.18:0/200585454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe04804c7a0 msgr2=0x7fe0480e0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.414+0000 7fe04e7fc640 1 --2- 172.21.15.18:0/200585454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe04804c7a0 0x7fe0480e0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.414+0000 7fe04f7fe640 1 --2- 172.21.15.18:0/200585454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe04804c7a0 0x7fe0480e0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.414+0000 7fe04f7fe640 1 -- 172.21.15.18:0/200585454 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0480e4940 con 0x7fe04804cc00 2024-09-19T09:13:36.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.414+0000 7fe04e7fc640 1 --2- 172.21.15.18:0/200585454 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe04804c7a0 0x7fe0480e0910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:13:36.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.415+0000 7fe04f7fe640 1 --2- 172.21.15.18:0/200585454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe04804cc00 0x7fe0480e0e50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe04400d410 tx=0x7fe04400d8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.415+0000 7fcd220a6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd14035a70 0x7fcd1404cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.415+0000 7fe0377fe640 1 -- 172.21.15.18:0/200585454 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04401a070 con 0x7fe04804cc00 2024-09-19T09:13:36.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.415+0000 7fcd1b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd140354b0 0x7fcd140395d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.413+0000 7f0f0b1a6640 1 -- start start 2024-09-19T09:13:36.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.415+0000 7f0f0b1a6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ef40051c0 0x7f0efc0d8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.415+0000 7f0f0b1a6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0efc04eed0 0x7f0efc0508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.415+0000 7f0f0b1a6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0efc04f350 0x7f0efc050e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.415+0000 7f0f0b1a6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0efc035b40 con 0x7f0efc04f350 2024-09-19T09:13:36.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.415+0000 7f0f0b1a6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0efc035560 con 0x7f0efc04eed0 2024-09-19T09:13:36.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.415+0000 7f0f0b1a6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0efc035cc0 con 0x7f0ef40051c0 2024-09-19T09:13:36.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.415+0000 7f0f03fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0efc04eed0 0x7f0efc0508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.415+0000 7f0f08f42640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ef40051c0 0x7f0efc0d8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.415+0000 7f0f03fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0efc04eed0 0x7f0efc0508c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:57996/0 (socket says 172.21.15.18:57996) 2024-09-19T09:13:36.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.415+0000 7f0f03fff640 1 -- 172.21.15.18:0/229863357 learned_addr learned my addr 172.21.15.18:0/229863357 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:36.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.415+0000 7fcd1b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd140354b0 0x7fcd140395d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:57990/0 (socket says 172.21.15.18:57990) 2024-09-19T09:13:36.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.413+0000 7fa07ffff640 1 -- 172.21.15.18:0/441510614 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa090012400 con 0x7fa0980d1970 2024-09-19T09:13:36.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.415+0000 7fe04ffff640 1 -- 172.21.15.18:0/200585454 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0480e4be0 con 0x7fe04804cc00 2024-09-19T09:13:36.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.415+0000 7fe04ffff640 1 -- 172.21.15.18:0/200585454 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe048008270 con 0x7fe04804cc00 2024-09-19T09:13:36.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.415+0000 7fe0377fe640 1 -- 172.21.15.18:0/200585454 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe044004030 con 0x7fe04804cc00 2024-09-19T09:13:36.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.415+0000 7fe0377fe640 1 -- 172.21.15.18:0/200585454 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe044004400 con 0x7fe04804cc00 2024-09-19T09:13:36.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7fa09e198640 1 -- 172.21.15.18:0/441510614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0980b5c60 con 0x7fa0980d1970 2024-09-19T09:13:36.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7f0f09743640 1 --2- 172.21.15.18:0/229863357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0efc04f350 0x7f0efc050e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7ff52f586640 1 -- 172.21.15.18:0/4104954626 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff5280d1b40 con 0x7ff52806c320 2024-09-19T09:13:36.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7fa09e198640 1 -- 172.21.15.18:0/441510614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa098165280 con 0x7fa0980d1970 2024-09-19T09:13:36.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7fcd1b7fe640 1 -- 172.21.15.18:0/377113116 learned_addr learned my addr 172.21.15.18:0/377113116 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:36.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.414+0000 7faae90e7640 1 Processor -- start 2024-09-19T09:13:36.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.414+0000 7faae90e7640 1 -- start start 2024-09-19T09:13:36.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7faae90e7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faae406dea0 0x7faae413a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7fcd220a6640 1 --2- 172.21.15.18:0/377113116 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd140e09b0 0x7fcd140d1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7faae90e7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faae406e2f0 0x7faae40b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7faae90e7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faae4148420 0x7faae4144970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7faae90e7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faae406e720 con 0x7faae406dea0 2024-09-19T09:13:36.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7f4981ace640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4974035470 0x7f497404cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7f4980acc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49740551b0 0x7f49740de550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7f4980acc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49740551b0 0x7f49740de550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:57968/0 (socket says 172.21.15.18:57968) 2024-09-19T09:13:36.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7f4980acc640 1 -- 172.21.15.18:0/3579945569 learned_addr learned my addr 172.21.15.18:0/3579945569 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:36.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7f49822cf640 1 -- 172.21.15.18:0/3579945569 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4974054e30 con 0x7f4974035470 2024-09-19T09:13:36.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7f49822cf640 1 -- 172.21.15.18:0/3579945569 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4974054cb0 con 0x7f49740551b0 2024-09-19T09:13:36.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7f49822cf640 1 -- 172.21.15.18:0/3579945569 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4974007070 con 0x7f497404ff50 2024-09-19T09:13:36.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.412+0000 7f2b7b362640 1 -- 172.21.15.18:0/2622426935 shutdown_connections 2024-09-19T09:13:36.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.412+0000 7f2b7b362640 1 -- 172.21.15.18:0/2622426935 wait complete. 2024-09-19T09:13:36.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.414+0000 7f2b7b362640 1 Processor -- start 2024-09-19T09:13:36.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.414+0000 7f2b7b362640 1 -- start start 2024-09-19T09:13:36.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.415+0000 7f2b7b362640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b7406dea0 0x7f2b740b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.415+0000 7f2b7b362640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b7406e2f0 0x7f2b74145d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7f2b7b362640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b74148420 0x7f2b741376f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7f2b7b362640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2b740b5ba0 con 0x7f2b7406e2f0 2024-09-19T09:13:36.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7f2b7b362640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2b7406e720 con 0x7f2b74148420 2024-09-19T09:13:36.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7f2b7b362640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2b740b5d20 con 0x7f2b7406dea0 2024-09-19T09:13:36.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7f2b79b5f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b7406e2f0 0x7f2b74145d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7f2b79b5f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b7406e2f0 0x7f2b74145d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36380/0 (socket says 172.21.15.18:36380) 2024-09-19T09:13:36.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7f2b79b5f640 1 -- 172.21.15.18:0/3907407972 learned_addr learned my addr 172.21.15.18:0/3907407972 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:36.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7f2b7ab61640 1 --2- 172.21.15.18:0/3907407972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b74148420 0x7f2b741376f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7f2b7a360640 1 --2- 172.21.15.18:0/3907407972 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b7406dea0 0x7f2b740b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7fcd220a6640 1 -- 172.21.15.18:0/377113116 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcd14051610 con 0x7fcd14035a70 2024-09-19T09:13:36.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7fcd220a6640 1 -- 172.21.15.18:0/377113116 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcd14051490 con 0x7fcd140354b0 2024-09-19T09:13:36.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7fcd220a6640 1 -- 172.21.15.18:0/377113116 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcd14051790 con 0x7fcd140e09b0 2024-09-19T09:13:36.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7faae90e7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faae4072120 con 0x7faae406e2f0 2024-09-19T09:13:36.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7faae90e7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faae40b5ba0 con 0x7faae4148420 2024-09-19T09:13:36.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7faae88e6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faae4148420 0x7faae4144970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7faae88e6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faae4148420 0x7faae4144970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:42250/0 (socket says 172.21.15.18:42250) 2024-09-19T09:13:36.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7faae88e6640 1 -- 172.21.15.18:0/1207146957 learned_addr learned my addr 172.21.15.18:0/1207146957 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:36.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7faae37fe640 1 --2- 172.21.15.18:0/1207146957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faae406e2f0 0x7faae40b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7fe04ffff640 1 -- 172.21.15.18:0/200585454 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe030001030 con 0x7fe04804cc00 2024-09-19T09:13:36.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7f2b79b5f640 1 -- 172.21.15.18:0/3907407972 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b7406dea0 msgr2=0x7f2b740b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7f2b79b5f640 1 --2- 172.21.15.18:0/3907407972 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b7406dea0 0x7f2b740b0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7f2b79b5f640 1 -- 172.21.15.18:0/3907407972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b74148420 msgr2=0x7f2b741376f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.416+0000 7f2b79b5f640 1 --2- 172.21.15.18:0/3907407972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b74148420 0x7f2b741376f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.417+0000 7f2b79b5f640 1 -- 172.21.15.18:0/3907407972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b741466b0 con 0x7f2b7406e2f0 2024-09-19T09:13:36.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.417+0000 7faae3fff640 1 --2- 172.21.15.18:0/1207146957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faae406dea0 0x7faae413a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.417+0000 7f49812cd640 1 --2- 172.21.15.18:0/3579945569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f497404ff50 0x7f497404a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.417+0000 7faae88e6640 1 -- 172.21.15.18:0/1207146957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faae406e2f0 msgr2=0x7faae40b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.417+0000 7faae88e6640 1 --2- 172.21.15.18:0/1207146957 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faae406e2f0 0x7faae40b11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.417+0000 7faae88e6640 1 -- 172.21.15.18:0/1207146957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faae406dea0 msgr2=0x7faae413a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.417+0000 7faae88e6640 1 --2- 172.21.15.18:0/1207146957 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faae406dea0 0x7faae413a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.417+0000 7faae88e6640 1 -- 172.21.15.18:0/1207146957 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae4145ed0 con 0x7faae4148420 2024-09-19T09:13:36.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.417+0000 7fcd1bfff640 1 --2- 172.21.15.18:0/377113116 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd140e09b0 0x7fcd140d1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.417+0000 7fcd1b7fe640 1 -- 172.21.15.18:0/377113116 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd140e09b0 msgr2=0x7fcd140d1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.467 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.417+0000 7fcd1b7fe640 1 --2- 172.21.15.18:0/377113116 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd140e09b0 0x7fcd140d1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.417+0000 7fcd1b7fe640 1 -- 172.21.15.18:0/377113116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd14035a70 msgr2=0x7fcd1404cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.417+0000 7fcd1b7fe640 1 --2- 172.21.15.18:0/377113116 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd14035a70 0x7fcd1404cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.417+0000 7fcd1b7fe640 1 -- 172.21.15.18:0/377113116 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd1404d090 con 0x7fcd140354b0 2024-09-19T09:13:36.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.417+0000 7f0f08f42640 1 -- 172.21.15.18:0/229863357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0efc04eed0 msgr2=0x7f0efc0508c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.417+0000 7f0f08f42640 1 --2- 172.21.15.18:0/229863357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0efc04eed0 0x7f0efc0508c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.417+0000 7f0f08f42640 1 -- 172.21.15.18:0/229863357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0efc04f350 msgr2=0x7f0efc050e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.417+0000 7f0f08f42640 1 --2- 172.21.15.18:0/229863357 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0efc04f350 0x7f0efc050e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.417+0000 7f0f08f42640 1 -- 172.21.15.18:0/229863357 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0efc04cb40 con 0x7f0ef40051c0 2024-09-19T09:13:36.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.417+0000 7f2b79b5f640 1 --2- 172.21.15.18:0/3907407972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b7406e2f0 0x7f2b74145d40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c00c730 tx=0x7f2b6c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.417+0000 7f4980acc640 1 -- 172.21.15.18:0/3579945569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f497404ff50 msgr2=0x7f497404a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.417+0000 7f4980acc640 1 --2- 172.21.15.18:0/3579945569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f497404ff50 0x7f497404a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.417+0000 7f4980acc640 1 -- 172.21.15.18:0/3579945569 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4974035470 msgr2=0x7f497404cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.417+0000 7f4980acc640 1 --2- 172.21.15.18:0/3579945569 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4974035470 0x7f497404cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.417+0000 7f4980acc640 1 -- 172.21.15.18:0/3579945569 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f497404b060 con 0x7f49740551b0 2024-09-19T09:13:36.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.417+0000 7f2b6affd640 1 -- 172.21.15.18:0/3907407972 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c003b70 con 0x7f2b7406e2f0 2024-09-19T09:13:36.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.417+0000 7f2b6affd640 1 -- 172.21.15.18:0/3907407972 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b6c003d30 con 0x7f2b7406e2f0 2024-09-19T09:13:36.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.417+0000 7f2b6affd640 1 -- 172.21.15.18:0/3907407972 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c00aa90 con 0x7f2b7406e2f0 2024-09-19T09:13:36.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.418+0000 7f2b7b362640 1 -- 172.21.15.18:0/3907407972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b74146990 con 0x7f2b7406e2f0 2024-09-19T09:13:36.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.418+0000 7f2b7b362640 1 -- 172.21.15.18:0/3907407972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b74146f50 con 0x7f2b7406e2f0 2024-09-19T09:13:36.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.418+0000 7fa09e198640 1 -- 172.21.15.18:0/441510614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa0980b6740 con 0x7fa0980d1970 2024-09-19T09:13:36.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.418+0000 7ff51dffb640 1 -- 172.21.15.18:0/4104954626 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff51803ccd0 con 0x7ff52806c320 2024-09-19T09:13:36.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.417+0000 7f0f08f42640 1 --2- 172.21.15.18:0/229863357 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ef40051c0 0x7f0efc0d8a50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0f04050d60 tx=0x7f0f04076560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.418+0000 7f0f017fa640 1 -- 172.21.15.18:0/229863357 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f04099070 con 0x7f0ef40051c0 2024-09-19T09:13:36.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.418+0000 7f0f017fa640 1 -- 172.21.15.18:0/229863357 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f04071780 con 0x7f0ef40051c0 2024-09-19T09:13:36.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.418+0000 7faae88e6640 1 --2- 172.21.15.18:0/1207146957 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faae4148420 0x7faae4144970 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faad400cb10 tx=0x7faad400a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.418+0000 7fcd1b7fe640 1 --2- 172.21.15.18:0/377113116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd140354b0 0x7fcd140395d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c00b8d0 tx=0x7fcd0c00bd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.418+0000 7faae0ff9640 1 -- 172.21.15.18:0/1207146957 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad4017070 con 0x7faae4148420 2024-09-19T09:13:36.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.418+0000 7f4980acc640 1 --2- 172.21.15.18:0/3579945569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49740551b0 0x7f49740de550 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f497800c6a0 tx=0x7f497800cb60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.418+0000 7fe0377fe640 1 -- 172.21.15.18:0/200585454 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe04401d070 con 0x7fe04804cc00 2024-09-19T09:13:36.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.419+0000 7fe0377fe640 1 --2- 172.21.15.18:0/200585454 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe03c06c2b0 0x7fe03c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.419+0000 7fe0377fe640 1 -- 172.21.15.18:0/200585454 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe04408ad40 con 0x7fe04804cc00 2024-09-19T09:13:36.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.419+0000 7fe0377fe640 1 --2- 172.21.15.18:0/200585454 >> [v2:172.21.15.18:6816/3672199638,v1:172.21.15.18:6817/3672199638] conn(0x7fe03c074530 0x7fe03c076950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.419+0000 7fe0377fe640 1 -- 172.21.15.18:0/200585454 --> [v2:172.21.15.18:6816/3672199638,v1:172.21.15.18:6817/3672199638] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe03c077000 con 0x7fe03c074530 2024-09-19T09:13:36.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.419+0000 7fe0377fe640 1 -- 172.21.15.18:0/200585454 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fe04408b130 con 0x7fe04804cc00 2024-09-19T09:13:36.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.419+0000 7f2b7b362640 1 -- 172.21.15.18:0/3907407972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2b74072910 con 0x7f2b7406e2f0 2024-09-19T09:13:36.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.419+0000 7fa07ffff640 1 -- 172.21.15.18:0/441510614 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa09001a070 con 0x7fa0980d1970 2024-09-19T09:13:36.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.419+0000 7ff51dffb640 1 --2- 172.21.15.18:0/4104954626 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff50c06c2b0 0x7ff50c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.419+0000 7ff51dffb640 1 -- 172.21.15.18:0/4104954626 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff5180ac080 con 0x7ff52806c320 2024-09-19T09:13:36.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.419+0000 7ff51dffb640 1 --2- 172.21.15.18:0/4104954626 >> [v2:172.21.15.162:6822/3538482215,v1:172.21.15.162:6824/3538482215] conn(0x7ff50c0744d0 0x7ff50c0768f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.419+0000 7ff51dffb640 1 -- 172.21.15.18:0/4104954626 --> [v2:172.21.15.162:6822/3538482215,v1:172.21.15.162:6824/3538482215] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff518046e80 con 0x7ff50c0744d0 2024-09-19T09:13:36.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.419+0000 7ff51dffb640 1 -- 172.21.15.18:0/4104954626 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7ff5180b3050 con 0x7ff52806c320 2024-09-19T09:13:36.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.418+0000 7fcd03fff640 1 -- 172.21.15.18:0/377113116 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c00cc40 con 0x7fcd140354b0 2024-09-19T09:13:36.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.419+0000 7fcd03fff640 1 -- 172.21.15.18:0/377113116 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd0c010070 con 0x7fcd140354b0 2024-09-19T09:13:36.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.419+0000 7fcd03fff640 1 -- 172.21.15.18:0/377113116 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c015470 con 0x7fcd140354b0 2024-09-19T09:13:36.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.419+0000 7fcd220a6640 1 -- 172.21.15.18:0/377113116 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd1404bad0 con 0x7fcd140354b0 2024-09-19T09:13:36.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.419+0000 7fcd220a6640 1 -- 172.21.15.18:0/377113116 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd1404c350 con 0x7fcd140354b0 2024-09-19T09:13:36.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.419+0000 7f0f017fa640 1 -- 172.21.15.18:0/229863357 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f04071970 con 0x7f0ef40051c0 2024-09-19T09:13:36.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.419+0000 7f0f0b1a6640 1 -- 172.21.15.18:0/229863357 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0efc0e26a0 con 0x7f0ef40051c0 2024-09-19T09:13:36.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.419+0000 7f0f0b1a6640 1 -- 172.21.15.18:0/229863357 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0efc0e2c60 con 0x7f0ef40051c0 2024-09-19T09:13:36.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.419+0000 7fa07ffff640 1 --2- 172.21.15.18:0/441510614 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa08406c380 0x7fa08406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.420+0000 7fa07ffff640 1 -- 172.21.15.18:0/441510614 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa09008b120 con 0x7fa0980d1970 2024-09-19T09:13:36.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.420+0000 7ff52db23640 1 --2- 172.21.15.18:0/4104954626 >> [v2:172.21.15.162:6822/3538482215,v1:172.21.15.162:6824/3538482215] conn(0x7ff50c0744d0 0x7ff50c0768f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.420+0000 7fe04effd640 1 --2- 172.21.15.18:0/200585454 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe03c06c2b0 0x7fe03c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.420+0000 7fa07ffff640 1 --2- 172.21.15.18:0/441510614 >> [v2:172.21.15.18:6824/4163178582,v1:172.21.15.18:6825/4163178582] conn(0x7fa084074520 0x7fa084076940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.420+0000 7fa07ffff640 1 -- 172.21.15.18:0/441510614 --> [v2:172.21.15.18:6824/4163178582,v1:172.21.15.18:6825/4163178582] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa084076ff0 con 0x7fa084074520 2024-09-19T09:13:36.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.420+0000 7fa07ffff640 1 -- 172.21.15.18:0/441510614 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fa090092050 con 0x7fa0980d1970 2024-09-19T09:13:36.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.420+0000 7fe04e7fc640 1 --2- 172.21.15.18:0/200585454 >> [v2:172.21.15.18:6816/3672199638,v1:172.21.15.18:6817/3672199638] conn(0x7fe03c074530 0x7fe03c076950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.420+0000 7f0f0b1a6640 1 -- 172.21.15.18:0/229863357 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0efc00b820 con 0x7f0ef40051c0 2024-09-19T09:13:36.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.420+0000 7fa096ffd640 1 --2- 172.21.15.18:0/441510614 >> [v2:172.21.15.18:6824/4163178582,v1:172.21.15.18:6825/4163178582] conn(0x7fa084074520 0x7fa084076940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.420+0000 7f2b6affd640 1 -- 172.21.15.18:0/3907407972 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2b6c00ac30 con 0x7f2b7406e2f0 2024-09-19T09:13:36.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.420+0000 7fcd01ffb640 1 -- 172.21.15.18:0/377113116 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fccf4001030 con 0x7fcd140354b0 2024-09-19T09:13:36.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.421+0000 7ff52cb21640 1 --2- 172.21.15.18:0/4104954626 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff50c06c2b0 0x7ff50c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.421+0000 7ff52db23640 1 --2- 172.21.15.18:0/4104954626 >> [v2:172.21.15.162:6822/3538482215,v1:172.21.15.162:6824/3538482215] conn(0x7ff50c0744d0 0x7ff50c0768f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.421+0000 7fe04e7fc640 1 --2- 172.21.15.18:0/200585454 >> [v2:172.21.15.18:6816/3672199638,v1:172.21.15.18:6817/3672199638] conn(0x7fe03c074530 0x7fe03c076950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.421+0000 7fe04effd640 1 --2- 172.21.15.18:0/200585454 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe03c06c2b0 0x7fe03c06e770 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe040004700 tx=0x7fe040009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.421+0000 7fa096ffd640 1 --2- 172.21.15.18:0/441510614 >> [v2:172.21.15.18:6824/4163178582,v1:172.21.15.18:6825/4163178582] conn(0x7fa084074520 0x7fa084076940 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.421+0000 7fa07ffff640 1 -- 172.21.15.18:0/441510614 <== osd.3 v2:172.21.15.18:6824/4163178582 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7fa084076ff0 con 0x7fa084074520 2024-09-19T09:13:36.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.421+0000 7fe0377fe640 1 -- 172.21.15.18:0/200585454 <== osd.1 v2:172.21.15.18:6816/3672199638 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7fe03c077000 con 0x7fe03c074530 2024-09-19T09:13:36.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.421+0000 7f2b6affd640 1 --2- 172.21.15.18:0/3907407972 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2b5806c3b0 0x7f2b5806e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.421+0000 7f0f017fa640 1 -- 172.21.15.18:0/229863357 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0f04071b10 con 0x7f0ef40051c0 2024-09-19T09:13:36.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.418+0000 7faae90e7640 1 -- 172.21.15.18:0/1207146957 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faae4161950 con 0x7faae4148420 2024-09-19T09:13:36.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.419+0000 7faae90e7640 1 -- 172.21.15.18:0/1207146957 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faae4161f10 con 0x7faae4148420 2024-09-19T09:13:36.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.420+0000 7faae90e7640 1 -- 172.21.15.18:0/1207146957 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faae4072910 con 0x7faae4148420 2024-09-19T09:13:36.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.420+0000 7faae0ff9640 1 -- 172.21.15.18:0/1207146957 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faad400ac10 con 0x7faae4148420 2024-09-19T09:13:36.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.420+0000 7faae0ff9640 1 -- 172.21.15.18:0/1207146957 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad4012400 con 0x7faae4148420 2024-09-19T09:13:36.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.422+0000 7f2b7a360640 1 --2- 172.21.15.18:0/3907407972 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2b5806c3b0 0x7f2b5806e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.422+0000 7fcd03fff640 1 -- 172.21.15.18:0/377113116 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcd0c01e3f0 con 0x7fcd140354b0 2024-09-19T09:13:36.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.422+0000 7f2b6affd640 1 -- 172.21.15.18:0/3907407972 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f2b6c08b290 con 0x7f2b7406e2f0 2024-09-19T09:13:36.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.422+0000 7ff51dffb640 1 -- 172.21.15.18:0/4104954626 <== osd.4 v2:172.21.15.162:6822/3538482215 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7ff518046e80 con 0x7ff50c0744d0 2024-09-19T09:13:36.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.422+0000 7fcd03fff640 1 --2- 172.21.15.18:0/377113116 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcd0806c380 0x7fcd0806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.422+0000 7f4971ffb640 1 -- 172.21.15.18:0/3579945569 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4978008040 con 0x7f49740551b0 2024-09-19T09:13:36.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.422+0000 7f4971ffb640 1 -- 172.21.15.18:0/3579945569 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4978007750 con 0x7f49740551b0 2024-09-19T09:13:36.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.422+0000 7f4971ffb640 1 -- 172.21.15.18:0/3579945569 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4978007b40 con 0x7f49740551b0 2024-09-19T09:13:36.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.422+0000 7f49822cf640 1 -- 172.21.15.18:0/3579945569 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49740480f0 con 0x7f49740551b0 2024-09-19T09:13:36.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.422+0000 7f2b7a360640 1 --2- 172.21.15.18:0/3907407972 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2b5806c3b0 0x7f2b5806e870 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2b70034000 tx=0x7f2b7002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.422+0000 7f49822cf640 1 -- 172.21.15.18:0/3579945569 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49740486b0 con 0x7f49740551b0 2024-09-19T09:13:36.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.422+0000 7f0f017fa640 1 --2- 172.21.15.18:0/229863357 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0ee806c300 0x7f0ee806e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.422+0000 7f0f017fa640 1 -- 172.21.15.18:0/229863357 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0f041081e0 con 0x7f0ef40051c0 2024-09-19T09:13:36.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.422+0000 7f0f017fa640 1 --2- 172.21.15.18:0/229863357 >> [v2:172.21.15.162:6808/2596207948,v1:172.21.15.162:6809/2596207948] conn(0x7f0ee80744a0 0x7f0ee80768c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.422+0000 7f0f017fa640 1 -- 172.21.15.18:0/229863357 --> [v2:172.21.15.162:6808/2596207948,v1:172.21.15.162:6809/2596207948] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0f04075b60 con 0x7f0ee80744a0 2024-09-19T09:13:36.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.422+0000 7f0f017fa640 1 -- 172.21.15.18:0/229863357 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f0f04108590 con 0x7f0ef40051c0 2024-09-19T09:13:36.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.423+0000 7f2b6affd640 1 --2- 172.21.15.18:0/3907407972 >> [v2:172.21.15.18:6800/3463367841,v1:172.21.15.18:6801/3463367841] conn(0x7f2b580745d0 0x7f2b580769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.423+0000 7f2b6affd640 1 -- 172.21.15.18:0/3907407972 --> [v2:172.21.15.18:6800/3463367841,v1:172.21.15.18:6801/3463367841] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2b6c010e50 con 0x7f2b580745d0 2024-09-19T09:13:36.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.423+0000 7fa0977fe640 1 --2- 172.21.15.18:0/441510614 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa08406c380 0x7fa08406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.423+0000 7f2b6affd640 1 -- 172.21.15.18:0/3907407972 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f2b6c092050 con 0x7f2b7406e2f0 2024-09-19T09:13:36.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.423+0000 7f0f09743640 1 --2- 172.21.15.18:0/229863357 >> [v2:172.21.15.162:6808/2596207948,v1:172.21.15.162:6809/2596207948] conn(0x7f0ee80744a0 0x7f0ee80768c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.423+0000 7ff52cb21640 1 --2- 172.21.15.18:0/4104954626 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff50c06c2b0 0x7ff50c06e770 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff52815bab0 tx=0x7ff520009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.423+0000 7f2b7ab61640 1 --2- 172.21.15.18:0/3907407972 >> [v2:172.21.15.18:6800/3463367841,v1:172.21.15.18:6801/3463367841] conn(0x7f2b580745d0 0x7f2b580769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.423+0000 7f0f03fff640 1 --2- 172.21.15.18:0/229863357 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0ee806c300 0x7f0ee806e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.424+0000 7f49822cf640 1 -- 172.21.15.18:0/3579945569 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4974007310 con 0x7f49740551b0 2024-09-19T09:13:36.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.424+0000 7f2b7ab61640 1 --2- 172.21.15.18:0/3907407972 >> [v2:172.21.15.18:6800/3463367841,v1:172.21.15.18:6801/3463367841] conn(0x7f2b580745d0 0x7f2b580769f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.423+0000 7fcd03fff640 1 -- 172.21.15.18:0/377113116 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fcd0c08b420 con 0x7fcd140354b0 2024-09-19T09:13:36.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.423+0000 7fcd03fff640 1 --2- 172.21.15.18:0/377113116 >> [v2:172.21.15.162:6800/2408698413,v1:172.21.15.162:6801/2408698413] conn(0x7fcd080745a0 0x7fcd080769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.424+0000 7fcd03fff640 1 -- 172.21.15.18:0/377113116 --> [v2:172.21.15.162:6800/2408698413,v1:172.21.15.162:6801/2408698413] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcd0c011e50 con 0x7fcd080745a0 2024-09-19T09:13:36.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.424+0000 7fcd03fff640 1 -- 172.21.15.18:0/377113116 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7fcd0c092050 con 0x7fcd140354b0 2024-09-19T09:13:36.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.424+0000 7f0f09743640 1 --2- 172.21.15.18:0/229863357 >> [v2:172.21.15.162:6808/2596207948,v1:172.21.15.162:6809/2596207948] conn(0x7f0ee80744a0 0x7f0ee80768c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.425+0000 7fcd1affd640 1 --2- 172.21.15.18:0/377113116 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcd0806c380 0x7fcd0806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.425+0000 7fcd1bfff640 1 --2- 172.21.15.18:0/377113116 >> [v2:172.21.15.162:6800/2408698413,v1:172.21.15.162:6801/2408698413] conn(0x7fcd080745a0 0x7fcd080769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.425+0000 7f4971ffb640 1 -- 172.21.15.18:0/3579945569 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4978007ce0 con 0x7f49740551b0 2024-09-19T09:13:36.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.425+0000 7faae0ff9640 1 -- 172.21.15.18:0/1207146957 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7faad401a070 con 0x7faae4148420 2024-09-19T09:13:36.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.425+0000 7f0f03fff640 1 --2- 172.21.15.18:0/229863357 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0ee806c300 0x7f0ee806e7c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80011e0 tx=0x7f0ef8001aa0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.425+0000 7faae0ff9640 1 --2- 172.21.15.18:0/1207146957 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faad006c380 0x7faad006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.426+0000 7f4971ffb640 1 --2- 172.21.15.18:0/3579945569 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f496006c3b0 0x7f496006e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.426+0000 7faae0ff9640 1 -- 172.21.15.18:0/1207146957 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7faad408b8f0 con 0x7faae4148420 2024-09-19T09:13:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.426+0000 7faae3fff640 1 --2- 172.21.15.18:0/1207146957 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faad006c380 0x7faad006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.426+0000 7f4971ffb640 1 -- 172.21.15.18:0/3579945569 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f497808b460 con 0x7f49740551b0 2024-09-19T09:13:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.426+0000 7f4971ffb640 1 --2- 172.21.15.18:0/3579945569 >> [v2:172.21.15.18:6808/128722874,v1:172.21.15.18:6809/128722874] conn(0x7f49600745d0 0x7f49600769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.426+0000 7f4971ffb640 1 -- 172.21.15.18:0/3579945569 --> [v2:172.21.15.18:6808/128722874,v1:172.21.15.18:6809/128722874] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f497801fec0 con 0x7f49600745d0 2024-09-19T09:13:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.426+0000 7f4971ffb640 1 -- 172.21.15.18:0/3579945569 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f4978092050 con 0x7f49740551b0 2024-09-19T09:13:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.426+0000 7f4981ace640 1 --2- 172.21.15.18:0/3579945569 >> [v2:172.21.15.18:6808/128722874,v1:172.21.15.18:6809/128722874] conn(0x7f49600745d0 0x7f49600769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.425+0000 7f2b6affd640 1 -- 172.21.15.18:0/3907407972 <== osd.2 v2:172.21.15.18:6800/3463367841 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f2b6c010e50 con 0x7f2b580745d0 2024-09-19T09:13:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.426+0000 7fa0977fe640 1 --2- 172.21.15.18:0/441510614 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa08406c380 0x7fa08406e840 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa088034000 tx=0x7fa08802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.426+0000 7fcd1affd640 1 --2- 172.21.15.18:0/377113116 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcd0806c380 0x7fcd0806e840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcd10034000 tx=0x7fcd1002c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.426+0000 7f0f017fa640 1 -- 172.21.15.18:0/229863357 <== osd.6 v2:172.21.15.162:6808/2596207948 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f0f04075b60 con 0x7f0ee80744a0 2024-09-19T09:13:36.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.426+0000 7fcd1bfff640 1 --2- 172.21.15.18:0/377113116 >> [v2:172.21.15.162:6800/2408698413,v1:172.21.15.162:6801/2408698413] conn(0x7fcd080745a0 0x7fcd080769c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.426+0000 7faae0ff9640 1 --2- 172.21.15.18:0/1207146957 >> [v2:172.21.15.162:6816/1334618296,v1:172.21.15.162:6817/1334618296] conn(0x7faad00745a0 0x7faad00769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.426+0000 7faae0ff9640 1 -- 172.21.15.18:0/1207146957 --> [v2:172.21.15.162:6816/1334618296,v1:172.21.15.162:6817/1334618296] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faad4020ec0 con 0x7faad00745a0 2024-09-19T09:13:36.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.426+0000 7faae0ff9640 1 -- 172.21.15.18:0/1207146957 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7faad408bce0 con 0x7faae4148420 2024-09-19T09:13:36.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.426+0000 7faae37fe640 1 --2- 172.21.15.18:0/1207146957 >> [v2:172.21.15.162:6816/1334618296,v1:172.21.15.162:6817/1334618296] conn(0x7faad00745a0 0x7faad00769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.427+0000 7faae37fe640 1 --2- 172.21.15.18:0/1207146957 >> [v2:172.21.15.162:6816/1334618296,v1:172.21.15.162:6817/1334618296] conn(0x7faad00745a0 0x7faad00769c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.427+0000 7f49812cd640 1 --2- 172.21.15.18:0/3579945569 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f496006c3b0 0x7f496006e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.427+0000 7f4981ace640 1 --2- 172.21.15.18:0/3579945569 >> [v2:172.21.15.18:6808/128722874,v1:172.21.15.18:6809/128722874] conn(0x7f49600745d0 0x7f49600769f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.427+0000 7faae3fff640 1 --2- 172.21.15.18:0/1207146957 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faad006c380 0x7faad006e840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faadc034000 tx=0x7faadc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.427+0000 7f49812cd640 1 --2- 172.21.15.18:0/3579945569 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f496006c3b0 0x7f496006e870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f496c006fd0 tx=0x7f496c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.427+0000 7fcd03fff640 1 -- 172.21.15.18:0/377113116 <== osd.5 v2:172.21.15.162:6800/2408698413 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7fcd0c011e50 con 0x7fcd080745a0 2024-09-19T09:13:36.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.428+0000 7faae0ff9640 1 -- 172.21.15.18:0/1207146957 <== osd.7 v2:172.21.15.162:6816/1334618296 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7faad4020ec0 con 0x7faad00745a0 2024-09-19T09:13:36.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.428+0000 7f4971ffb640 1 -- 172.21.15.18:0/3579945569 <== osd.0 v2:172.21.15.18:6808/128722874 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f497801fec0 con 0x7f49600745d0 2024-09-19T09:13:36.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.448+0000 7fa09e198640 1 -- 172.21.15.18:0/441510614 --> [v2:172.21.15.18:6824/4163178582,v1:172.21.15.18:6825/4163178582] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa0980c5e60 con 0x7fa084074520 2024-09-19T09:13:36.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.448+0000 7fe04ffff640 1 -- 172.21.15.18:0/200585454 --> [v2:172.21.15.18:6816/3672199638,v1:172.21.15.18:6817/3672199638] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe030002d50 con 0x7fe03c074530 2024-09-19T09:13:36.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.449+0000 7fe0377fe640 1 -- 172.21.15.18:0/200585454 <== osd.1 v2:172.21.15.18:6816/3672199638 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe030002d50 con 0x7fe03c074530 2024-09-19T09:13:36.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.449+0000 7fa07ffff640 1 -- 172.21.15.18:0/441510614 <== osd.3 v2:172.21.15.18:6824/4163178582 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa0980c5e60 con 0x7fa084074520 2024-09-19T09:13:36.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.449+0000 7fe0357fa640 1 -- 172.21.15.18:0/200585454 >> [v2:172.21.15.18:6816/3672199638,v1:172.21.15.18:6817/3672199638] conn(0x7fe03c074530 msgr2=0x7fe03c076950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.449+0000 7fe0357fa640 1 --2- 172.21.15.18:0/200585454 >> [v2:172.21.15.18:6816/3672199638,v1:172.21.15.18:6817/3672199638] conn(0x7fe03c074530 0x7fe03c076950 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.449+0000 7fa07dffb640 1 -- 172.21.15.18:0/441510614 >> [v2:172.21.15.18:6824/4163178582,v1:172.21.15.18:6825/4163178582] conn(0x7fa084074520 msgr2=0x7fa084076940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.449+0000 7fa07dffb640 1 --2- 172.21.15.18:0/441510614 >> [v2:172.21.15.18:6824/4163178582,v1:172.21.15.18:6825/4163178582] conn(0x7fa084074520 0x7fa084076940 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.450+0000 7fa07dffb640 1 -- 172.21.15.18:0/441510614 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa08406c380 msgr2=0x7fa08406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.450+0000 7fa07dffb640 1 --2- 172.21.15.18:0/441510614 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa08406c380 0x7fa08406e840 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa088034000 tx=0x7fa08802e000 comp rx=0 tx=0).stop 2024-09-19T09:13:36.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.450+0000 7ff52f586640 1 -- 172.21.15.18:0/4104954626 --> [v2:172.21.15.162:6822/3538482215,v1:172.21.15.162:6824/3538482215] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff52806d950 con 0x7ff50c0744d0 2024-09-19T09:13:36.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.450+0000 7fa07dffb640 1 -- 172.21.15.18:0/441510614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0980d1970 msgr2=0x7fa098166090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.450+0000 7fa07dffb640 1 --2- 172.21.15.18:0/441510614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa0980d1970 0x7fa098166090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa09000caa0 tx=0x7fa09000cf60 comp rx=0 tx=0).stop 2024-09-19T09:13:36.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.450+0000 7fe0357fa640 1 -- 172.21.15.18:0/200585454 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe03c06c2b0 msgr2=0x7fe03c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.450+0000 7fe0357fa640 1 --2- 172.21.15.18:0/200585454 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe03c06c2b0 0x7fe03c06e770 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe040004700 tx=0x7fe040009060 comp rx=0 tx=0).stop 2024-09-19T09:13:36.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.450+0000 7fa097fff640 1 -- 172.21.15.18:0/441510614 reap_dead start 2024-09-19T09:13:36.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.450+0000 7fe0357fa640 1 -- 172.21.15.18:0/200585454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe04804cc00 msgr2=0x7fe0480e0e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.450+0000 7fa07dffb640 1 -- 172.21.15.18:0/441510614 shutdown_connections 2024-09-19T09:13:36.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.450+0000 7fa07dffb640 1 -- 172.21.15.18:0/441510614 >> 172.21.15.18:0/441510614 conn(0x7fa0980d2ab0 msgr2=0x7fa0980cb320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:36.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.450+0000 7fe0357fa640 1 --2- 172.21.15.18:0/200585454 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe04804cc00 0x7fe0480e0e50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe04400d410 tx=0x7fe04400d8d0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.450+0000 7fe04f7fe640 1 -- 172.21.15.18:0/200585454 reap_dead start 2024-09-19T09:13:36.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.450+0000 7fe0357fa640 1 -- 172.21.15.18:0/200585454 shutdown_connections 2024-09-19T09:13:36.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.450+0000 7fe0357fa640 1 -- 172.21.15.18:0/200585454 >> 172.21.15.18:0/200585454 conn(0x7fe04801ea30 msgr2=0x7fe0480323b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:36.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.451+0000 7fe0357fa640 1 -- 172.21.15.18:0/200585454 shutdown_connections 2024-09-19T09:13:36.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.451+0000 7fe0357fa640 1 -- 172.21.15.18:0/200585454 wait complete. 2024-09-19T09:13:36.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.450+0000 7fa07dffb640 1 -- 172.21.15.18:0/441510614 shutdown_connections 2024-09-19T09:13:36.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.450+0000 7fa07dffb640 1 -- 172.21.15.18:0/441510614 wait complete. 2024-09-19T09:13:36.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.450+0000 7ff51dffb640 1 -- 172.21.15.18:0/4104954626 <== osd.4 v2:172.21.15.162:6822/3538482215 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff52806d950 con 0x7ff50c0744d0 2024-09-19T09:13:36.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.451+0000 7ff50b7fe640 1 -- 172.21.15.18:0/4104954626 >> [v2:172.21.15.162:6822/3538482215,v1:172.21.15.162:6824/3538482215] conn(0x7ff50c0744d0 msgr2=0x7ff50c0768f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.451+0000 7ff50b7fe640 1 --2- 172.21.15.18:0/4104954626 >> [v2:172.21.15.162:6822/3538482215,v1:172.21.15.162:6824/3538482215] conn(0x7ff50c0744d0 0x7ff50c0768f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.451+0000 7ff50b7fe640 1 -- 172.21.15.18:0/4104954626 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff50c06c2b0 msgr2=0x7ff50c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.451+0000 7ff50b7fe640 1 --2- 172.21.15.18:0/4104954626 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff50c06c2b0 0x7ff50c06e770 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff52815bab0 tx=0x7ff520009040 comp rx=0 tx=0).stop 2024-09-19T09:13:36.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.451+0000 7ff50b7fe640 1 -- 172.21.15.18:0/4104954626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff52806c320 msgr2=0x7ff5281fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.451+0000 7ff50b7fe640 1 --2- 172.21.15.18:0/4104954626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff52806c320 0x7ff5281fcbd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff518009890 tx=0x7ff5180046c0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.451+0000 7ff52db23640 1 -- 172.21.15.18:0/4104954626 reap_dead start 2024-09-19T09:13:36.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.452+0000 7ff50b7fe640 1 -- 172.21.15.18:0/4104954626 shutdown_connections 2024-09-19T09:13:36.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.452+0000 7ff50b7fe640 1 -- 172.21.15.18:0/4104954626 >> 172.21.15.18:0/4104954626 conn(0x7ff5280b5eb0 msgr2=0x7ff5280b64c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:36.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.452+0000 7ff50b7fe640 1 -- 172.21.15.18:0/4104954626 shutdown_connections 2024-09-19T09:13:36.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.452+0000 7ff50b7fe640 1 -- 172.21.15.18:0/4104954626 wait complete. 2024-09-19T09:13:36.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.453+0000 7f2b7b362640 1 -- 172.21.15.18:0/3907407972 --> [v2:172.21.15.18:6800/3463367841,v1:172.21.15.18:6801/3463367841] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2b741592a0 con 0x7f2b580745d0 2024-09-19T09:13:36.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.453+0000 7f0f0b1a6640 1 -- 172.21.15.18:0/229863357 --> [v2:172.21.15.162:6808/2596207948,v1:172.21.15.162:6809/2596207948] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0efc00b540 con 0x7f0ee80744a0 2024-09-19T09:13:36.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.454+0000 7f2b6affd640 1 -- 172.21.15.18:0/3907407972 <== osd.2 v2:172.21.15.18:6800/3463367841 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2b741592a0 con 0x7f2b580745d0 2024-09-19T09:13:36.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.454+0000 7f0f017fa640 1 -- 172.21.15.18:0/229863357 <== osd.6 v2:172.21.15.162:6808/2596207948 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0efc00b540 con 0x7f0ee80744a0 2024-09-19T09:13:36.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.454+0000 7f0f0b1a6640 1 -- 172.21.15.18:0/229863357 >> [v2:172.21.15.162:6808/2596207948,v1:172.21.15.162:6809/2596207948] conn(0x7f0ee80744a0 msgr2=0x7f0ee80768c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.454+0000 7f0f0b1a6640 1 --2- 172.21.15.18:0/229863357 >> [v2:172.21.15.162:6808/2596207948,v1:172.21.15.162:6809/2596207948] conn(0x7f0ee80744a0 0x7f0ee80768c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.454+0000 7f0f0b1a6640 1 -- 172.21.15.18:0/229863357 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0ee806c300 msgr2=0x7f0ee806e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.454+0000 7f0f0b1a6640 1 --2- 172.21.15.18:0/229863357 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0ee806c300 0x7f0ee806e7c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80011e0 tx=0x7f0ef8001aa0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.455+0000 7f0f0b1a6640 1 -- 172.21.15.18:0/229863357 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ef40051c0 msgr2=0x7f0efc0d8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.455+0000 7f0f0b1a6640 1 --2- 172.21.15.18:0/229863357 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ef40051c0 0x7f0efc0d8a50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0f04050d60 tx=0x7f0f04076560 comp rx=0 tx=0).stop 2024-09-19T09:13:36.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.455+0000 7f0f09743640 1 -- 172.21.15.18:0/229863357 reap_dead start 2024-09-19T09:13:36.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.455+0000 7f0f0b1a6640 1 -- 172.21.15.18:0/229863357 shutdown_connections 2024-09-19T09:13:36.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.455+0000 7f0f0b1a6640 1 -- 172.21.15.18:0/229863357 >> 172.21.15.18:0/229863357 conn(0x7f0efc01ea30 msgr2=0x7f0efc00bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:36.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.456+0000 7f49822cf640 1 -- 172.21.15.18:0/3579945569 --> [v2:172.21.15.18:6808/128722874,v1:172.21.15.18:6809/128722874] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f49740e2010 con 0x7f49600745d0 2024-09-19T09:13:36.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.456+0000 7f2b7b362640 1 -- 172.21.15.18:0/3907407972 >> [v2:172.21.15.18:6800/3463367841,v1:172.21.15.18:6801/3463367841] conn(0x7f2b580745d0 msgr2=0x7f2b580769f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.456+0000 7f2b7b362640 1 --2- 172.21.15.18:0/3907407972 >> [v2:172.21.15.18:6800/3463367841,v1:172.21.15.18:6801/3463367841] conn(0x7f2b580745d0 0x7f2b580769f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.456+0000 7f2b7b362640 1 -- 172.21.15.18:0/3907407972 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2b5806c3b0 msgr2=0x7f2b5806e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.456+0000 7f2b7b362640 1 --2- 172.21.15.18:0/3907407972 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2b5806c3b0 0x7f2b5806e870 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2b70034000 tx=0x7f2b7002e000 comp rx=0 tx=0).stop 2024-09-19T09:13:36.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.456+0000 7f0f0b1a6640 1 -- 172.21.15.18:0/229863357 shutdown_connections 2024-09-19T09:13:36.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.456+0000 7f0f0b1a6640 1 -- 172.21.15.18:0/229863357 wait complete. 2024-09-19T09:13:36.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.456+0000 7f2b7b362640 1 -- 172.21.15.18:0/3907407972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b7406e2f0 msgr2=0x7f2b74145d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.456+0000 7f2b7b362640 1 --2- 172.21.15.18:0/3907407972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b7406e2f0 0x7f2b74145d40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c00c730 tx=0x7f2b6c00cbf0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.456+0000 7f4971ffb640 1 -- 172.21.15.18:0/3579945569 <== osd.0 v2:172.21.15.18:6808/128722874 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f49740e2010 con 0x7f49600745d0 2024-09-19T09:13:36.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.456+0000 7f2b7ab61640 1 -- 172.21.15.18:0/3907407972 reap_dead start 2024-09-19T09:13:36.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.456+0000 7f2b7b362640 1 -- 172.21.15.18:0/3907407972 shutdown_connections 2024-09-19T09:13:36.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.456+0000 7f2b7b362640 1 -- 172.21.15.18:0/3907407972 >> 172.21.15.18:0/3907407972 conn(0x7f2b74068070 msgr2=0x7f2b741435e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:36.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.457+0000 7f2b7b362640 1 -- 172.21.15.18:0/3907407972 shutdown_connections 2024-09-19T09:13:36.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.457+0000 7f2b7b362640 1 -- 172.21.15.18:0/3907407972 wait complete. 2024-09-19T09:13:36.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.457+0000 7fcd01ffb640 1 -- 172.21.15.18:0/377113116 --> [v2:172.21.15.162:6800/2408698413,v1:172.21.15.162:6801/2408698413] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fccf4002dd0 con 0x7fcd080745a0 2024-09-19T09:13:36.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.457+0000 7faae90e7640 1 -- 172.21.15.18:0/1207146957 --> [v2:172.21.15.162:6816/1334618296,v1:172.21.15.162:6817/1334618296] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faae41616e0 con 0x7faad00745a0 2024-09-19T09:13:36.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.457+0000 7fcd03fff640 1 -- 172.21.15.18:0/377113116 <== osd.5 v2:172.21.15.162:6800/2408698413 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fccf4002dd0 con 0x7fcd080745a0 2024-09-19T09:13:36.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.457+0000 7f49822cf640 1 -- 172.21.15.18:0/3579945569 >> [v2:172.21.15.18:6808/128722874,v1:172.21.15.18:6809/128722874] conn(0x7f49600745d0 msgr2=0x7f49600769f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.457+0000 7f49822cf640 1 --2- 172.21.15.18:0/3579945569 >> [v2:172.21.15.18:6808/128722874,v1:172.21.15.18:6809/128722874] conn(0x7f49600745d0 0x7f49600769f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.457+0000 7faae0ff9640 1 -- 172.21.15.18:0/1207146957 <== osd.7 v2:172.21.15.162:6816/1334618296 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7faae41616e0 con 0x7faad00745a0 2024-09-19T09:13:36.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.458+0000 7faae90e7640 1 -- 172.21.15.18:0/1207146957 >> [v2:172.21.15.162:6816/1334618296,v1:172.21.15.162:6817/1334618296] conn(0x7faad00745a0 msgr2=0x7faad00769c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.458+0000 7faae90e7640 1 --2- 172.21.15.18:0/1207146957 >> [v2:172.21.15.162:6816/1334618296,v1:172.21.15.162:6817/1334618296] conn(0x7faad00745a0 0x7faad00769c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.458+0000 7f49822cf640 1 -- 172.21.15.18:0/3579945569 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f496006c3b0 msgr2=0x7f496006e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.458+0000 7f49822cf640 1 --2- 172.21.15.18:0/3579945569 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f496006c3b0 0x7f496006e870 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f496c006fd0 tx=0x7f496c008040 comp rx=0 tx=0).stop 2024-09-19T09:13:36.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.458+0000 7f49822cf640 1 -- 172.21.15.18:0/3579945569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49740551b0 msgr2=0x7f49740de550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.458+0000 7f49822cf640 1 --2- 172.21.15.18:0/3579945569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49740551b0 0x7f49740de550 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f497800c6a0 tx=0x7f497800cb60 comp rx=0 tx=0).stop 2024-09-19T09:13:36.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.458+0000 7f4981ace640 1 -- 172.21.15.18:0/3579945569 reap_dead start 2024-09-19T09:13:36.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.458+0000 7faae90e7640 1 -- 172.21.15.18:0/1207146957 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faad006c380 msgr2=0x7faad006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.458+0000 7faae90e7640 1 --2- 172.21.15.18:0/1207146957 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faad006c380 0x7faad006e840 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7faadc034000 tx=0x7faadc02e000 comp rx=0 tx=0).stop 2024-09-19T09:13:36.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.458+0000 7faae90e7640 1 -- 172.21.15.18:0/1207146957 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faae4148420 msgr2=0x7faae4144970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.458+0000 7faae90e7640 1 --2- 172.21.15.18:0/1207146957 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faae4148420 0x7faae4144970 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faad400cb10 tx=0x7faad400a060 comp rx=0 tx=0).stop 2024-09-19T09:13:36.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.458+0000 7faae88e6640 1 -- 172.21.15.18:0/1207146957 reap_dead start 2024-09-19T09:13:36.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.459+0000 7f49822cf640 1 -- 172.21.15.18:0/3579945569 shutdown_connections 2024-09-19T09:13:36.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.459+0000 7f49822cf640 1 -- 172.21.15.18:0/3579945569 >> 172.21.15.18:0/3579945569 conn(0x7f497401d930 msgr2=0x7f49740543b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:36.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.459+0000 7fcd01ffb640 1 -- 172.21.15.18:0/377113116 >> [v2:172.21.15.162:6800/2408698413,v1:172.21.15.162:6801/2408698413] conn(0x7fcd080745a0 msgr2=0x7fcd080769c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.459+0000 7fcd01ffb640 1 --2- 172.21.15.18:0/377113116 >> [v2:172.21.15.162:6800/2408698413,v1:172.21.15.162:6801/2408698413] conn(0x7fcd080745a0 0x7fcd080769c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.459+0000 7faae90e7640 1 -- 172.21.15.18:0/1207146957 shutdown_connections 2024-09-19T09:13:36.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.459+0000 7faae90e7640 1 -- 172.21.15.18:0/1207146957 >> 172.21.15.18:0/1207146957 conn(0x7faae4068070 msgr2=0x7faae4143ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:36.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.459+0000 7faae90e7640 1 -- 172.21.15.18:0/1207146957 shutdown_connections 2024-09-19T09:13:36.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.459+0000 7faae90e7640 1 -- 172.21.15.18:0/1207146957 wait complete. 2024-09-19T09:13:36.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.459+0000 7fcd01ffb640 1 -- 172.21.15.18:0/377113116 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcd0806c380 msgr2=0x7fcd0806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.459+0000 7fcd01ffb640 1 --2- 172.21.15.18:0/377113116 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcd0806c380 0x7fcd0806e840 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcd10034000 tx=0x7fcd1002c000 comp rx=0 tx=0).stop 2024-09-19T09:13:36.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.459+0000 7fcd01ffb640 1 -- 172.21.15.18:0/377113116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd140354b0 msgr2=0x7fcd140395d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.459+0000 7fcd01ffb640 1 --2- 172.21.15.18:0/377113116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd140354b0 0x7fcd140395d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c00b8d0 tx=0x7fcd0c00bd90 comp rx=0 tx=0).stop 2024-09-19T09:13:36.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.459+0000 7fcd1bfff640 1 -- 172.21.15.18:0/377113116 reap_dead start 2024-09-19T09:13:36.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.459+0000 7f49822cf640 1 -- 172.21.15.18:0/3579945569 shutdown_connections 2024-09-19T09:13:36.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.459+0000 7f49822cf640 1 -- 172.21.15.18:0/3579945569 wait complete. 2024-09-19T09:13:36.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.459+0000 7fcd01ffb640 1 -- 172.21.15.18:0/377113116 shutdown_connections 2024-09-19T09:13:36.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.459+0000 7fcd01ffb640 1 -- 172.21.15.18:0/377113116 >> 172.21.15.18:0/377113116 conn(0x7fcd140567a0 msgr2=0x7fcd14033390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:36.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.460+0000 7fcd01ffb640 1 -- 172.21.15.18:0/377113116 shutdown_connections 2024-09-19T09:13:36.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.462+0000 7fcd01ffb640 1 -- 172.21.15.18:0/377113116 wait complete. 2024-09-19T09:13:36.514 INFO:teuthology.orchestra.run.smithi018.stdout:55834574853 2024-09-19T09:13:36.514 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-19T09:13:36.515 INFO:teuthology.orchestra.run.smithi018.stdout:55834574853 2024-09-19T09:13:36.515 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-19T09:13:36.516 INFO:teuthology.orchestra.run.smithi018.stdout:55834574853 2024-09-19T09:13:36.516 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-19T09:13:36.517 INFO:teuthology.orchestra.run.smithi018.stdout:55834574853 2024-09-19T09:13:36.517 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-19T09:13:36.518 INFO:teuthology.orchestra.run.smithi018.stdout:55834574853 2024-09-19T09:13:36.518 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-19T09:13:36.519 INFO:teuthology.orchestra.run.smithi018.stdout:55834574853 2024-09-19T09:13:36.519 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-19T09:13:36.520 INFO:teuthology.orchestra.run.smithi018.stdout:55834574853 2024-09-19T09:13:36.520 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-19T09:13:36.521 INFO:teuthology.orchestra.run.smithi018.stdout:55834574853 2024-09-19T09:13:36.521 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-19T09:13:36.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.729+0000 7fd2f15a2640 1 Processor -- start 2024-09-19T09:13:36.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.729+0000 7fd2f15a2640 1 -- start start 2024-09-19T09:13:36.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.730+0000 7fae21f28640 1 Processor -- start 2024-09-19T09:13:36.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.730+0000 7fae21f28640 1 -- start start 2024-09-19T09:13:36.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.730+0000 7fd2f15a2640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd2ec15aa20 0x7fd2ec06d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.730+0000 7fd2f15a2640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd2ec15b510 0x7fd2ec0afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.730+0000 7fd2f15a2640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2ec06d680 con 0x7fd2ec0af690 2024-09-19T09:13:36.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.730+0000 7fd2f15a2640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fd2ec15b980 con 0x7fd2ec15b510 2024-09-19T09:13:36.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.730+0000 7fd2f15a2640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd2ec0b0030 con 0x7fd2ec15aa20 2024-09-19T09:13:36.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.731+0000 7fd2f0da1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd2ec15b510 0x7fd2ec0afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.731+0000 7fd2f0da1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd2ec15b510 0x7fd2ec0afaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36408/0 (socket says 172.21.15.18:36408) 2024-09-19T09:13:36.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.731+0000 7fd2f0da1640 1 -- 172.21.15.18:0/4259936239 learned_addr learned my addr 172.21.15.18:0/4259936239 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:36.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.732+0000 7fae21f28640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fae1c0b5b30 0x7fae1c0b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.732+0000 7fae21f28640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae1c0cfd10 0x7fae1c0d1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.732+0000 7fae21f28640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae1c0d01c0 con 0x7fae1c0b7860 2024-09-19T09:13:36.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.732+0000 7fae21f28640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fae1c0d2830 con 0x7fae1c0b5b30 2024-09-19T09:13:36.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.732+0000 7fae21f28640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fae1c0d04a0 con 0x7fae1c0cfd10 2024-09-19T09:13:36.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.730+0000 7fa88b8d9640 1 Processor -- start 2024-09-19T09:13:36.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.731+0000 7fa88b8d9640 1 -- start start 2024-09-19T09:13:36.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.731+0000 7f44acc53640 1 Processor -- start 2024-09-19T09:13:36.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.732+0000 7fd2ebfff640 1 --2- 172.21.15.18:0/4259936239 >> v2:172.21.15.162:3300/0 conn(0x7fd2ec15aa20 0x7fd2ec06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.732+0000 7fae12ffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fae1c0b7860 0x7fae1c0cf600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:42384/0 (socket says 172.21.15.18:42384) 2024-09-19T09:13:36.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.732+0000 7fae12ffd640 1 -- 172.21.15.18:0/696450651 learned_addr learned my addr 172.21.15.18:0/696450651 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:36.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.732+0000 7f44acc53640 1 -- start start 2024-09-19T09:13:36.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.732+0000 7fae1bfff640 1 --2- 172.21.15.18:0/696450651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae1c0cfd10 0x7fae1c0d1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.732+0000 7fa88b8d9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa8841664f0 0x7fa8840cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.732+0000 7fa88b8d9640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa88406d0e0 0x7fa8840b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.732+0000 7fa88b8d9640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8840b3630 con 0x7fa8840b3220 2024-09-19T09:13:36.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.732+0000 7fa88b8d9640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fa88406c620 con 0x7fa8841664f0 2024-09-19T09:13:36.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.732+0000 7fa88b8d9640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa8840b2680 con 0x7fa88406d0e0 2024-09-19T09:13:36.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.732+0000 7fa888e74640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa88406d0e0 0x7fa8840b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.733+0000 7fa889675640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa8841664f0 0x7fa8840cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.733+0000 7fa888e74640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa88406d0e0 0x7fa8840b2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:58034/0 (socket says 172.21.15.18:58034) 2024-09-19T09:13:36.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.733+0000 7fa888e74640 1 -- 172.21.15.18:0/3985504467 learned_addr learned my addr 172.21.15.18:0/3985504467 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:36.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.732+0000 7fd2f0da1640 1 -- 172.21.15.18:0/4259936239 >> v2:172.21.15.162:3300/0 conn(0x7fd2ec15aa20 msgr2=0x7fd2ec06d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:36.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.732+0000 7fd2f0da1640 1 --2- 172.21.15.18:0/4259936239 >> v2:172.21.15.162:3300/0 conn(0x7fd2ec15aa20 0x7fd2ec06d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.732+0000 7fd2f0da1640 1 -- 172.21.15.18:0/4259936239 >> v1:172.21.15.18:6789/0 conn(0x7fd2ec0af690 legacy=0x7fd2ec15ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.732+0000 7fd2f0da1640 1 -- 172.21.15.18:0/4259936239 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ec15bbb0 con 0x7fd2ec15b510 2024-09-19T09:13:36.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.733+0000 7fae1affd640 1 -- 172.21.15.18:0/696450651 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 137247703 0 0) 0x7fae1c0d01c0 con 0x7fae1c0b7860 2024-09-19T09:13:36.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.733+0000 7fae1affd640 1 -- 172.21.15.18:0/696450651 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae08003520 con 0x7fae1c0b7860 2024-09-19T09:13:36.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.733+0000 7fae1bfff640 1 -- 172.21.15.18:0/696450651 >> v2:172.21.15.162:3300/0 conn(0x7fae1c0b5b30 msgr2=0x7fae1c0b5f10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:13:36.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.733+0000 7fae1bfff640 1 --2- 172.21.15.18:0/696450651 >> v2:172.21.15.162:3300/0 conn(0x7fae1c0b5b30 0x7fae1c0b5f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.733+0000 7fae1bfff640 1 -- 172.21.15.18:0/696450651 >> v1:172.21.15.18:6789/0 conn(0x7fae1c0b7860 legacy=0x7fae1c0cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.733+0000 7fae1bfff640 1 -- 172.21.15.18:0/696450651 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae1c0d0780 con 0x7fae1c0cfd10 2024-09-19T09:13:36.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.733+0000 7fe9fa0dd640 1 Processor -- start 2024-09-19T09:13:36.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.734+0000 7fe9fa0dd640 1 -- start start 2024-09-19T09:13:36.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.733+0000 7fa888e74640 1 -- 172.21.15.18:0/3985504467 >> v2:172.21.15.18:3300/0 conn(0x7fa8841664f0 msgr2=0x7fa8840cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:36.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.733+0000 7fa888e74640 1 --2- 172.21.15.18:0/3985504467 >> v2:172.21.15.18:3300/0 conn(0x7fa8841664f0 0x7fa8840cd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.733+0000 7fa888e74640 1 -- 172.21.15.18:0/3985504467 >> v1:172.21.15.162:6789/0 conn(0x7fa8840b3220 legacy=0x7fa8840adfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.733+0000 7fa888e74640 1 -- 172.21.15.18:0/3985504467 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8840b2960 con 0x7fa88406d0e0 2024-09-19T09:13:36.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.733+0000 7f44acc53640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f44a00497f0 0x7f44a00eb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.733+0000 7f44acc53640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f44a0034c60 0x7f44a0053940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.733+0000 7f44acc53640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44a00eb8d0 con 0x7f44a0049bd0 2024-09-19T09:13:36.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.733+0000 7f44acc53640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f44a000c730 con 0x7f44a00497f0 2024-09-19T09:13:36.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.733+0000 7f44acc53640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f44a000c170 con 0x7f44a0034c60 2024-09-19T09:13:36.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.734+0000 7f44a6d9d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f44a0034c60 0x7f44a0053940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.734+0000 7f44a6d9d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f44a0034c60 0x7f44a0053940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:58056/0 (socket says 172.21.15.18:58056) 2024-09-19T09:13:36.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.734+0000 7f44a6d9d640 1 -- 172.21.15.18:0/2842478100 learned_addr learned my addr 172.21.15.18:0/2842478100 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:36.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.734+0000 7fd2f0da1640 1 --2- 172.21.15.18:0/4259936239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2ec15b510 0x7fd2ec0afaf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec071670 tx=0x7fd2e402cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff959810ee128037 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.734+0000 7fae1bfff640 1 --2- 172.21.15.18:0/696450651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae1c0cfd10 0x7fae1c0d1330 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fae140097a0 tx=0x7fae1402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d597ae565c121416 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.734+0000 7f44a6d9d640 1 -- 172.21.15.18:0/2842478100 >> v2:172.21.15.18:3300/0 conn(0x7f44a00497f0 msgr2=0x7f44a00eb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:36.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.734+0000 7f44a6d9d640 1 --2- 172.21.15.18:0/2842478100 >> v2:172.21.15.18:3300/0 conn(0x7f44a00497f0 0x7f44a00eb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.734+0000 7f44a6d9d640 1 -- 172.21.15.18:0/2842478100 >> v1:172.21.15.162:6789/0 conn(0x7f44a0049bd0 legacy=0x7f44a0053230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:36.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.734+0000 7f44a6d9d640 1 -- 172.21.15.18:0/2842478100 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a000c450 con 0x7f44a0034c60 2024-09-19T09:13:36.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.735+0000 7fa888e74640 1 --2- 172.21.15.18:0/3985504467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa88406d0e0 0x7fa8840b2ce0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa8840681b0 tx=0x7fa87c02a740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f977ce77eb4ce8b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.735+0000 7eff2036d640 1 Processor -- start 2024-09-19T09:13:36.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.735+0000 7fd2eaffd640 1 -- 172.21.15.18:0/4259936239 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4036070 con 0x7fd2ec15b510 2024-09-19T09:13:36.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.735+0000 7f9a7a453640 1 Processor -- start 2024-09-19T09:13:36.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.735+0000 7eff2036d640 1 -- start start 2024-09-19T09:13:36.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.735+0000 7fd2eaffd640 1 -- 172.21.15.18:0/4259936239 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2e402e860 con 0x7fd2ec15b510 2024-09-19T09:13:36.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.735+0000 7f9a7a453640 1 -- start start 2024-09-19T09:13:36.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.735+0000 7fe9fa0dd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe9ec0eb3a0 0x7fe9ec04eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.735+0000 7fa87bfff640 1 -- 172.21.15.18:0/3985504467 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa87c036070 con 0x7fa88406d0e0 2024-09-19T09:13:36.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.735+0000 7fa87bfff640 1 -- 172.21.15.18:0/3985504467 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa87c031600 con 0x7fa88406d0e0 2024-09-19T09:13:36.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.735+0000 7fa87bfff640 1 -- 172.21.15.18:0/3985504467 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa87c0319d0 con 0x7fa88406d0e0 2024-09-19T09:13:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.735+0000 7fe9fa0dd640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9ec01c5f0 con 0x7fe9ec0071e0 2024-09-19T09:13:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.735+0000 7fe9fa0dd640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9ec01c8d0 con 0x7fe9ec033a40 2024-09-19T09:13:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.735+0000 7fae1affd640 1 -- 172.21.15.18:0/696450651 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae14037070 con 0x7fae1c0cfd10 2024-09-19T09:13:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.735+0000 7fae1affd640 1 -- 172.21.15.18:0/696450651 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae14032440 con 0x7fae1c0cfd10 2024-09-19T09:13:36.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.735+0000 7fae1affd640 1 -- 172.21.15.18:0/696450651 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae14032810 con 0x7fae1c0cfd10 2024-09-19T09:13:36.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.735+0000 7f44a6d9d640 1 --2- 172.21.15.18:0/2842478100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44a0034c60 0x7f44a0053940 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f44a802dd50 tx=0x7f44a8065a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a398f70690a27061 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.735+0000 7fe9fa0dd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe9ec01cf20 con 0x7fe9ec0eb3a0 2024-09-19T09:13:36.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7f44a559a640 1 -- 172.21.15.18:0/2842478100 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a80af070 con 0x7f44a0034c60 2024-09-19T09:13:36.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.735+0000 7fd2eaffd640 1 -- 172.21.15.18:0/4259936239 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e400be60 con 0x7fd2ec15b510 2024-09-19T09:13:36.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7fd2f15a2640 1 -- 172.21.15.18:0/4259936239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2ec15b510 msgr2=0x7fd2ec0afaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7fd2f15a2640 1 --2- 172.21.15.18:0/4259936239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2ec15b510 0x7fd2ec0afaf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec071670 tx=0x7fd2e402cb00 comp rx=0 tx=0).stop 2024-09-19T09:13:36.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7fd2f15a2640 1 -- 172.21.15.18:0/4259936239 shutdown_connections 2024-09-19T09:13:36.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7fd2f15a2640 1 --2- 172.21.15.18:0/4259936239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2ec15b510 0x7fd2ec0afaf0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7fd2f15a2640 1 --2- 172.21.15.18:0/4259936239 >> v2:172.21.15.162:3300/0 conn(0x7fd2ec15aa20 0x7fd2ec06d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7fd2f15a2640 1 -- 172.21.15.18:0/4259936239 >> 172.21.15.18:0/4259936239 conn(0x7fd2ec068070 msgr2=0x7fd2ec06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:36.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7fa88b8d9640 1 -- 172.21.15.18:0/3985504467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa88406d0e0 msgr2=0x7fa8840b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7fa88b8d9640 1 --2- 172.21.15.18:0/3985504467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa88406d0e0 0x7fa8840b2ce0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa8840681b0 tx=0x7fa87c02a740 comp rx=0 tx=0).stop 2024-09-19T09:13:36.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.735+0000 7fe9f37fe640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fe9ec033a40 0x7fe9ec009b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:55124/0 (socket says 172.21.15.18:55124) 2024-09-19T09:13:36.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.735+0000 7fe9f37fe640 1 -- 172.21.15.18:0/2723283780 learned_addr learned my addr 172.21.15.18:0/2723283780 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:36.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.735+0000 7fe9f2ffd640 1 --2- 172.21.15.18:0/2723283780 >> v2:172.21.15.162:3300/0 conn(0x7fe9ec0eb3a0 0x7fe9ec04eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7fe9f27fc640 1 -- 172.21.15.18:0/2723283780 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3683574594 0 0) 0x7fe9ec01c8d0 con 0x7fe9ec033a40 2024-09-19T09:13:36.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7fe9f27fc640 1 -- 172.21.15.18:0/2723283780 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9e4003520 con 0x7fe9ec033a40 2024-09-19T09:13:36.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7fe9f2ffd640 1 -- 172.21.15.18:0/2723283780 >> v1:172.21.15.162:6789/0 conn(0x7fe9ec033a40 legacy=0x7fe9ec009b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7fe9f2ffd640 1 -- 172.21.15.18:0/2723283780 >> v1:172.21.15.18:6789/0 conn(0x7fe9ec0071e0 legacy=0x7fe9ec01d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:36.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7fe9f2ffd640 1 -- 172.21.15.18:0/2723283780 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ec01cbb0 con 0x7fe9ec0eb3a0 2024-09-19T09:13:36.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7f9a7a453640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9a7415bd90 0x7f9a7406f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7f9a7a453640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9a7406f680 0x7f9a7406fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7eff2036d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff10009af0 0x7eff10009f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7eff2036d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff1001c5c0 con 0x7eff100323c0 2024-09-19T09:13:36.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7eff2036d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff1001c830 con 0x7eff100dec70 2024-09-19T09:13:36.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7eff2036d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7eff1000a480 con 0x7eff10009af0 2024-09-19T09:13:36.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7f9a7a453640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a7415c3d0 con 0x7f9a74158b00 2024-09-19T09:13:36.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7f9a7a453640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f9a7406e660 con 0x7f9a7415bd90 2024-09-19T09:13:36.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7f9a7a453640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9a7406e940 con 0x7f9a7406f680 2024-09-19T09:13:36.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7f44a559a640 1 -- 172.21.15.18:0/2842478100 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44a80ab900 con 0x7f44a0034c60 2024-09-19T09:13:36.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7f44acc53640 1 -- 172.21.15.18:0/2842478100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44a0034c60 msgr2=0x7f44a0053940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7eff1e109640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7eff100dec70 0x7eff10006500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:55126/0 (socket says 172.21.15.18:55126) 2024-09-19T09:13:36.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7eff1e109640 1 -- 172.21.15.18:0/1365023359 learned_addr learned my addr 172.21.15.18:0/1365023359 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:36.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7f9a73fff640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f9a74158b00 0x7f9a7415b680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:55142/0 (socket says 172.21.15.18:55142) 2024-09-19T09:13:36.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7eff1e90a640 1 --2- 172.21.15.18:0/1365023359 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff10009af0 0x7eff10009f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7f9a789f0640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9a7406f680 0x7f9a7406fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7fae21f28640 1 -- 172.21.15.18:0/696450651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae1c0cfd10 msgr2=0x7fae1c0d1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7fae21f28640 1 --2- 172.21.15.18:0/696450651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae1c0cfd10 0x7fae1c0d1330 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fae140097a0 tx=0x7fae1402a1a0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7f9a737fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9a7415bd90 0x7f9a7406f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7f9a73fff640 1 -- 172.21.15.18:0/3738938684 learned_addr learned my addr 172.21.15.18:0/3738938684 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:36.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7fa88b8d9640 1 -- 172.21.15.18:0/3985504467 shutdown_connections 2024-09-19T09:13:36.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7fa88b8d9640 1 --2- 172.21.15.18:0/3985504467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa88406d0e0 0x7fa8840b2ce0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7fa88b8d9640 1 --2- 172.21.15.18:0/3985504467 >> v2:172.21.15.18:3300/0 conn(0x7fa8841664f0 0x7fa8840cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7fa88b8d9640 1 -- 172.21.15.18:0/3985504467 >> 172.21.15.18:0/3985504467 conn(0x7fa8840b5eb0 msgr2=0x7fa8840b6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:36.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7fa88b8d9640 1 -- 172.21.15.18:0/3985504467 shutdown_connections 2024-09-19T09:13:36.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.736+0000 7fa88b8d9640 1 -- 172.21.15.18:0/3985504467 wait complete. 2024-09-19T09:13:36.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7fd2f15a2640 1 -- 172.21.15.18:0/4259936239 shutdown_connections 2024-09-19T09:13:36.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7f44a559a640 1 -- 172.21.15.18:0/2842478100 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44a80af070 con 0x7f44a0034c60 2024-09-19T09:13:36.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7f44acc53640 1 --2- 172.21.15.18:0/2842478100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44a0034c60 0x7f44a0053940 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f44a802dd50 tx=0x7f44a8065a90 comp rx=0 tx=0).stop 2024-09-19T09:13:36.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7fbb9130b640 1 Processor -- start 2024-09-19T09:13:36.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7fae21f28640 1 -- 172.21.15.18:0/696450651 shutdown_connections 2024-09-19T09:13:36.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7fae21f28640 1 --2- 172.21.15.18:0/696450651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae1c0cfd10 0x7fae1c0d1330 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7fae21f28640 1 --2- 172.21.15.18:0/696450651 >> v2:172.21.15.162:3300/0 conn(0x7fae1c0b5b30 0x7fae1c0b5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7fae21f28640 1 -- 172.21.15.18:0/696450651 >> 172.21.15.18:0/696450651 conn(0x7fae1c09dda0 msgr2=0x7fae1c0d4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:36.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7eff1e90a640 1 -- 172.21.15.18:0/1365023359 >> v1:172.21.15.162:6789/0 conn(0x7eff100dec70 legacy=0x7eff10006500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7eff1e90a640 1 -- 172.21.15.18:0/1365023359 >> v1:172.21.15.18:6789/0 conn(0x7eff100323c0 legacy=0x7eff10052350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:36.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7eff1e90a640 1 -- 172.21.15.18:0/1365023359 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1001cb10 con 0x7eff10009af0 2024-09-19T09:13:36.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7f9a72ffd640 1 -- 172.21.15.18:0/3738938684 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1999015097 0 0) 0x7f9a7415c3d0 con 0x7f9a74158b00 2024-09-19T09:13:36.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7f9a72ffd640 1 -- 172.21.15.18:0/3738938684 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a60003520 con 0x7f9a74158b00 2024-09-19T09:13:36.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7f44acc53640 1 -- 172.21.15.18:0/2842478100 shutdown_connections 2024-09-19T09:13:36.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7f44acc53640 1 --2- 172.21.15.18:0/2842478100 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44a0034c60 0x7f44a0053940 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7f44acc53640 1 --2- 172.21.15.18:0/2842478100 >> v2:172.21.15.18:3300/0 conn(0x7f44a00497f0 0x7f44a00eb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7f44acc53640 1 -- 172.21.15.18:0/2842478100 >> 172.21.15.18:0/2842478100 conn(0x7f44a001fb50 msgr2=0x7f44a0056820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:36.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7fae21f28640 1 -- 172.21.15.18:0/696450651 shutdown_connections 2024-09-19T09:13:36.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7fae21f28640 1 -- 172.21.15.18:0/696450651 wait complete. 2024-09-19T09:13:36.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7fe9f2ffd640 1 --2- 172.21.15.18:0/2723283780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9ec0eb3a0 0x7fe9ec04eb90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe9e00097a0 tx=0x7fe9e002a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fcc4f36dd99c5d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7fbb9130b640 1 -- start start 2024-09-19T09:13:36.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7f9a789f0640 1 -- 172.21.15.18:0/3738938684 >> v2:172.21.15.18:3300/0 conn(0x7f9a7415bd90 msgr2=0x7f9a7406f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:36.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7f9a789f0640 1 --2- 172.21.15.18:0/3738938684 >> v2:172.21.15.18:3300/0 conn(0x7f9a7415bd90 0x7f9a7406f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7f9a789f0640 1 -- 172.21.15.18:0/3738938684 >> v1:172.21.15.162:6789/0 conn(0x7f9a74158b00 legacy=0x7f9a7415b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.738+0000 7f9a789f0640 1 -- 172.21.15.18:0/3738938684 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a7406ec20 con 0x7f9a7406f680 2024-09-19T09:13:36.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.738+0000 7f9a737fe640 1 --2- 172.21.15.18:0/3738938684 >> v2:172.21.15.18:3300/0 conn(0x7f9a7415bd90 0x7f9a7406f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:13:36.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.737+0000 7fd2f15a2640 1 -- 172.21.15.18:0/4259936239 wait complete. 2024-09-19T09:13:36.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.738+0000 7f44acc53640 1 -- 172.21.15.18:0/2842478100 shutdown_connections 2024-09-19T09:13:36.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.738+0000 7eff1e90a640 1 --2- 172.21.15.18:0/1365023359 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff10009af0 0x7eff10009f40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7eff18000b60 tx=0x7eff18065a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d998c5a21364845 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.738+0000 7fe9f27fc640 1 -- 172.21.15.18:0/2723283780 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e0037070 con 0x7fe9ec0eb3a0 2024-09-19T09:13:36.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.738+0000 7fe9f27fc640 1 -- 172.21.15.18:0/2723283780 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9e0032440 con 0x7fe9ec0eb3a0 2024-09-19T09:13:36.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.738+0000 7fa88b8d9640 1 Processor -- start 2024-09-19T09:13:36.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.738+0000 7fbb9130b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbb8c162c10 0x7fbb8c1673c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.738+0000 7f44acc53640 1 -- 172.21.15.18:0/2842478100 wait complete. 2024-09-19T09:13:36.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.739+0000 7eff1d107640 1 -- 172.21.15.18:0/1365023359 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff180ac640 con 0x7eff10009af0 2024-09-19T09:13:36.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.739+0000 7fbb9130b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb8c0b3a10 0x7fbb8c0d0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.739+0000 7fbb9130b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbb8c0b3e80 0x7fbb8c0d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.739+0000 7fbb9130b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fbb8c073460 con 0x7fbb8c162c10 2024-09-19T09:13:36.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.739+0000 7fd2f15a2640 1 Processor -- start 2024-09-19T09:13:36.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.739+0000 7eff1d107640 1 -- 172.21.15.18:0/1365023359 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff180ac820 con 0x7eff10009af0 2024-09-19T09:13:36.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.739+0000 7eff1d107640 1 -- 172.21.15.18:0/1365023359 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff180acc90 con 0x7eff10009af0 2024-09-19T09:13:36.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.739+0000 7fbb8bfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbb8c162c10 0x7fbb8c1673c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.739+0000 7f9a789f0640 1 --2- 172.21.15.18:0/3738938684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a7406f680 0x7f9a7406fad0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9a740733c0 tx=0x7f9a5c02a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffe1141e245f44ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.739+0000 7fbb8bfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbb8c162c10 0x7fbb8c1673c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36442/0 (socket says 172.21.15.18:36442) 2024-09-19T09:13:36.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.739+0000 7fbb8bfff640 1 -- 172.21.15.18:0/336868866 learned_addr learned my addr 172.21.15.18:0/336868866 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:36.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.739+0000 7fe9fa0dd640 1 -- 172.21.15.18:0/2723283780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9ec0eb3a0 msgr2=0x7fe9ec04eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.739+0000 7fe9fa0dd640 1 --2- 172.21.15.18:0/2723283780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9ec0eb3a0 0x7fe9ec04eb90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe9e00097a0 tx=0x7fe9e002a1e0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.739+0000 7fbb90b0a640 1 --2- 172.21.15.18:0/336868866 >> v2:172.21.15.162:3300/0 conn(0x7fbb8c0b3e80 0x7fbb8c0d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.739+0000 7fbb9130b640 1 -- 172.21.15.18:0/336868866 --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fbb8c073740 con 0x7fbb8c0b3e80 2024-09-19T09:13:36.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.739+0000 7fbb9130b640 1 -- 172.21.15.18:0/336868866 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbb8c1668e0 con 0x7fbb8c0b3a10 2024-09-19T09:13:36.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.739+0000 7f9a72ffd640 1 -- 172.21.15.18:0/3738938684 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c037070 con 0x7f9a7406f680 2024-09-19T09:13:36.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.739+0000 7f9a72ffd640 1 -- 172.21.15.18:0/3738938684 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a5c032440 con 0x7f9a7406f680 2024-09-19T09:13:36.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.739+0000 7fbb8b7fe640 1 --2- 172.21.15.18:0/336868866 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb8c0b3a10 0x7fbb8c0d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.739+0000 7fe9fa0dd640 1 -- 172.21.15.18:0/2723283780 shutdown_connections 2024-09-19T09:13:36.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.740+0000 7fae21f28640 1 Processor -- start 2024-09-19T09:13:36.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.739+0000 7fe9fa0dd640 1 --2- 172.21.15.18:0/2723283780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9ec0eb3a0 0x7fe9ec04eb90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.740+0000 7fe9fa0dd640 1 -- 172.21.15.18:0/2723283780 >> 172.21.15.18:0/2723283780 conn(0x7fe9ec0360c0 msgr2=0x7fe9ec0364d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:36.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.740+0000 7fae21f28640 1 -- start start 2024-09-19T09:13:36.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.739+0000 7fa88b8d9640 1 -- start start 2024-09-19T09:13:36.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.740+0000 7fa88b8d9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa88406d0e0 0x7fa8841fc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.740+0000 7eff2036d640 1 -- 172.21.15.18:0/1365023359 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff10009af0 msgr2=0x7eff10009f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.740+0000 7eff2036d640 1 --2- 172.21.15.18:0/1365023359 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff10009af0 0x7eff10009f40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7eff18000b60 tx=0x7eff18065a90 comp rx=0 tx=0).stop 2024-09-19T09:13:36.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.740+0000 7fa88b8d9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8840b3220 0x7fa88415c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.740+0000 7f44acc53640 1 Processor -- start 2024-09-19T09:13:36.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.740+0000 7fbb8bfff640 1 -- 172.21.15.18:0/336868866 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb8c0b3a10 msgr2=0x7fbb8c0d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:36.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.740+0000 7fbb8bfff640 1 --2- 172.21.15.18:0/336868866 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb8c0b3a10 0x7fbb8c0d0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.740+0000 7fbb8bfff640 1 -- 172.21.15.18:0/336868866 >> v2:172.21.15.162:3300/0 conn(0x7fbb8c0b3e80 msgr2=0x7fbb8c0d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:36.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.740+0000 7fbb8bfff640 1 --2- 172.21.15.18:0/336868866 >> v2:172.21.15.162:3300/0 conn(0x7fbb8c0b3e80 0x7fbb8c0d0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.740+0000 7fbb8bfff640 1 -- 172.21.15.18:0/336868866 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb8c166bc0 con 0x7fbb8c162c10 2024-09-19T09:13:36.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.740+0000 7f44acc53640 1 -- start start 2024-09-19T09:13:36.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.740+0000 7fbb8b7fe640 1 --2- 172.21.15.18:0/336868866 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb8c0b3a10 0x7fbb8c0d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:13:36.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.740+0000 7fbb90b0a640 1 --2- 172.21.15.18:0/336868866 >> v2:172.21.15.162:3300/0 conn(0x7fbb8c0b3e80 0x7fbb8c0d0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:13:36.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.740+0000 7eff2036d640 1 -- 172.21.15.18:0/1365023359 shutdown_connections 2024-09-19T09:13:36.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.740+0000 7eff2036d640 1 --2- 172.21.15.18:0/1365023359 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff10009af0 0x7eff10009f40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.739+0000 7fd2f15a2640 1 -- start start 2024-09-19T09:13:36.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.740+0000 7fd2f15a2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2ec0af690 0x7fd2ec0b1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.740+0000 7fd2f15a2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2ec15aa20 0x7fd2ec0b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.740+0000 7fd2f15a2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2ec15b510 0x7fd2ec06dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.740+0000 7fd2f15a2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ec072510 con 0x7fd2ec0af690 2024-09-19T09:13:36.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.740+0000 7fd2f15a2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd2ec072230 con 0x7fd2ec15b510 2024-09-19T09:13:36.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.740+0000 7eff2036d640 1 -- 172.21.15.18:0/1365023359 >> 172.21.15.18:0/1365023359 conn(0x7eff10036090 msgr2=0x7eff100364a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:36.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.740+0000 7fd2f15a2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd2ec06c3c0 con 0x7fd2ec15aa20 2024-09-19T09:13:36.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.740+0000 7f9a7a453640 1 -- 172.21.15.18:0/3738938684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a7406f680 msgr2=0x7f9a7406fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.740+0000 7fe9fa0dd640 1 -- 172.21.15.18:0/2723283780 shutdown_connections 2024-09-19T09:13:36.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.740+0000 7f9a72ffd640 1 -- 172.21.15.18:0/3738938684 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c037070 con 0x7f9a7406f680 2024-09-19T09:13:36.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.740+0000 7fd2eb7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2ec15aa20 0x7fd2ec0b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7eff2036d640 1 -- 172.21.15.18:0/1365023359 shutdown_connections 2024-09-19T09:13:36.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7fd2eb7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2ec15aa20 0x7fd2ec0b04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:42316/0 (socket says 172.21.15.18:42316) 2024-09-19T09:13:36.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7fd2eb7fe640 1 -- 172.21.15.18:0/2336965856 learned_addr learned my addr 172.21.15.18:0/2336965856 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:36.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7fd2f0da1640 1 --2- 172.21.15.18:0/2336965856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2ec15b510 0x7fd2ec06dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7fa889675640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa88406d0e0 0x7fa8841fc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7fa889675640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa88406d0e0 0x7fa8841fc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:42306/0 (socket says 172.21.15.18:42306) 2024-09-19T09:13:36.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7fa88b8d9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8841664f0 0x7fa8840cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7fa889675640 1 -- 172.21.15.18:0/1353909430 learned_addr learned my addr 172.21.15.18:0/1353909430 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:36.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7fd2ebfff640 1 --2- 172.21.15.18:0/2336965856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2ec0af690 0x7fd2ec0b1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7fa888e74640 1 --2- 172.21.15.18:0/1353909430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8840b3220 0x7fa88415c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7fa88b8d9640 1 -- 172.21.15.18:0/1353909430 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa8840cd780 con 0x7fa8841664f0 2024-09-19T09:13:36.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7fa88b8d9640 1 -- 172.21.15.18:0/1353909430 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa88406cbc0 con 0x7fa8840b3220 2024-09-19T09:13:36.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7fa88b8d9640 1 -- 172.21.15.18:0/1353909430 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa8840b2380 con 0x7fa88406d0e0 2024-09-19T09:13:36.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7f9a7a453640 1 --2- 172.21.15.18:0/3738938684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a7406f680 0x7f9a7406fad0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9a740733c0 tx=0x7f9a5c02a110 comp rx=0 tx=0).stop 2024-09-19T09:13:36.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7eff2036d640 1 -- 172.21.15.18:0/1365023359 wait complete. 2024-09-19T09:13:36.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7fe9fa0dd640 1 -- 172.21.15.18:0/2723283780 wait complete. 2024-09-19T09:13:36.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7f9a7a453640 1 -- 172.21.15.18:0/3738938684 shutdown_connections 2024-09-19T09:13:36.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7f9a7a453640 1 --2- 172.21.15.18:0/3738938684 >> v2:172.21.15.18:3300/0 conn(0x7f9a7415bd90 0x7f9a7406f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7f44acc53640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44a0034c60 0x7f44a004a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7fae21f28640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae1c0b5b30 0x7fae1c15f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7fd2f0da1640 1 -- 172.21.15.18:0/2336965856 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2ec15aa20 msgr2=0x7fd2ec0b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7fd2f0da1640 1 --2- 172.21.15.18:0/2336965856 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2ec15aa20 0x7fd2ec0b04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7fd2f0da1640 1 -- 172.21.15.18:0/2336965856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2ec0af690 msgr2=0x7fd2ec0b1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7fa889e76640 1 --2- 172.21.15.18:0/1353909430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8841664f0 0x7fa8840cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7f44acc53640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44a00497f0 0x7f44a00e06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7f44acc53640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44a0049bd0 0x7f44a00e0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7f44acc53640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f44a0035ec0 con 0x7f44a0049bd0 2024-09-19T09:13:36.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7f44acc53640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f44a0033730 con 0x7f44a00497f0 2024-09-19T09:13:36.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7f44acc53640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f44a004a040 con 0x7f44a0034c60 2024-09-19T09:13:36.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7fae21f28640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae1c0b7860 0x7fae1c14fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7f9a7a453640 1 --2- 172.21.15.18:0/3738938684 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a7406f680 0x7f9a7406fad0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7fd2f0da1640 1 --2- 172.21.15.18:0/2336965856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2ec0af690 0x7fd2ec0b1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7f9a7a453640 1 -- 172.21.15.18:0/3738938684 >> 172.21.15.18:0/3738938684 conn(0x7f9a740b2bc0 msgr2=0x7f9a740b2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:36.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7fae21f28640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae1c0cfd10 0x7fae1c14c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7f44a5d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44a00497f0 0x7f44a00e06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7f44a5d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44a00497f0 0x7f44a00e06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:58130/0 (socket says 172.21.15.18:58130) 2024-09-19T09:13:36.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7f44a5d9b640 1 -- 172.21.15.18:0/678626120 learned_addr learned my addr 172.21.15.18:0/678626120 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:36.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7f9a7a453640 1 -- 172.21.15.18:0/3738938684 shutdown_connections 2024-09-19T09:13:36.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7f44a6d9d640 1 --2- 172.21.15.18:0/678626120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44a0049bd0 0x7f44a00e0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7fae1b7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae1c0b5b30 0x7fae1c15f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7fae1b7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae1c0b5b30 0x7fae1c15f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:42332/0 (socket says 172.21.15.18:42332) 2024-09-19T09:13:36.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7fae21f28640 1 -- 172.21.15.18:0/494215655 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fae1c0d19f0 con 0x7fae1c0b7860 2024-09-19T09:13:36.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7f44a5d9b640 1 -- 172.21.15.18:0/678626120 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44a0034c60 msgr2=0x7f44a004a2f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:13:36.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7f44a5d9b640 1 --2- 172.21.15.18:0/678626120 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44a0034c60 0x7f44a004a2f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7f44a5d9b640 1 -- 172.21.15.18:0/678626120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44a0049bd0 msgr2=0x7f44a00e0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7f44a5d9b640 1 --2- 172.21.15.18:0/678626120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44a0049bd0 0x7f44a00e0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7f44a5d9b640 1 -- 172.21.15.18:0/678626120 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a004a830 con 0x7f44a00497f0 2024-09-19T09:13:36.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7fae21f28640 1 -- 172.21.15.18:0/494215655 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fae1c0d1870 con 0x7fae1c0cfd10 2024-09-19T09:13:36.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7fae21f28640 1 -- 172.21.15.18:0/494215655 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fae1c0d1b70 con 0x7fae1c0b5b30 2024-09-19T09:13:36.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7fae1b7fe640 1 -- 172.21.15.18:0/494215655 learned_addr learned my addr 172.21.15.18:0/494215655 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:36.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7fae1bfff640 1 --2- 172.21.15.18:0/494215655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae1c0cfd10 0x7fae1c14c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.741+0000 7fd2f0da1640 1 -- 172.21.15.18:0/2336965856 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ec0cf630 con 0x7fd2ec15b510 2024-09-19T09:13:36.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7fd2ebfff640 1 --2- 172.21.15.18:0/2336965856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2ec0af690 0x7fd2ec0b1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:13:36.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7f9a7a453640 1 -- 172.21.15.18:0/3738938684 wait complete. 2024-09-19T09:13:36.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7fae1b7fe640 1 -- 172.21.15.18:0/494215655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae1c0cfd10 msgr2=0x7fae1c14c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7fae1b7fe640 1 --2- 172.21.15.18:0/494215655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae1c0cfd10 0x7fae1c14c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7fae1b7fe640 1 -- 172.21.15.18:0/494215655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae1c0b7860 msgr2=0x7fae1c14fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7fae1b7fe640 1 --2- 172.21.15.18:0/494215655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae1c0b7860 0x7fae1c14fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7fae1b7fe640 1 -- 172.21.15.18:0/494215655 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae1c15f7e0 con 0x7fae1c0b5b30 2024-09-19T09:13:36.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7f44a5d9b640 1 --2- 172.21.15.18:0/678626120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44a00497f0 0x7f44a00e06a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f449c00c430 tx=0x7f449c00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7fe9fa0dd640 1 Processor -- start 2024-09-19T09:13:36.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7fa889675640 1 -- 172.21.15.18:0/1353909430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8840b3220 msgr2=0x7fa88415c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7fa889675640 1 --2- 172.21.15.18:0/1353909430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8840b3220 0x7fa88415c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7fa889675640 1 -- 172.21.15.18:0/1353909430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8841664f0 msgr2=0x7fa8840cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7fa889675640 1 --2- 172.21.15.18:0/1353909430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8841664f0 0x7fa8840cdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7fa889675640 1 -- 172.21.15.18:0/1353909430 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8841fce30 con 0x7fa88406d0e0 2024-09-19T09:13:36.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7fd2f0da1640 1 --2- 172.21.15.18:0/2336965856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2ec15b510 0x7fd2ec06dfe0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4035000 tx=0x7fd2e4004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.742+0000 7fa889675640 1 --2- 172.21.15.18:0/1353909430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa88406d0e0 0x7fa8841fc8f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa88000d830 tx=0x7fa88000dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.743+0000 7f4496ffd640 1 -- 172.21.15.18:0/678626120 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449c011790 con 0x7f44a00497f0 2024-09-19T09:13:36.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.743+0000 7f4496ffd640 1 -- 172.21.15.18:0/678626120 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f449c017070 con 0x7f44a00497f0 2024-09-19T09:13:36.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.743+0000 7f4496ffd640 1 -- 172.21.15.18:0/678626120 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449c011b50 con 0x7f44a00497f0 2024-09-19T09:13:36.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.743+0000 7fe9fa0dd640 1 -- start start 2024-09-19T09:13:36.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.743+0000 7f44acc53640 1 -- 172.21.15.18:0/678626120 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44a00e4aa0 con 0x7f44a00497f0 2024-09-19T09:13:36.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.743+0000 7f44acc53640 1 -- 172.21.15.18:0/678626120 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44a00e5060 con 0x7f44a00497f0 2024-09-19T09:13:36.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.743+0000 7eff2036d640 1 Processor -- start 2024-09-19T09:13:36.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.743+0000 7fae1b7fe640 1 --2- 172.21.15.18:0/494215655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae1c0b5b30 0x7fae1c15f2a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fae0400b3e0 tx=0x7fae0400b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.743+0000 7fd2e8ff9640 1 -- 172.21.15.18:0/2336965856 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4036070 con 0x7fd2ec15b510 2024-09-19T09:13:36.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.743+0000 7fd2f15a2640 1 -- 172.21.15.18:0/2336965856 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2ec0cf910 con 0x7fd2ec15b510 2024-09-19T09:13:36.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.743+0000 7fd2f15a2640 1 -- 172.21.15.18:0/2336965856 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2ec0cfed0 con 0x7fd2ec15b510 2024-09-19T09:13:36.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.743+0000 7fa879ffb640 1 -- 172.21.15.18:0/1353909430 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88000b6c0 con 0x7fa88406d0e0 2024-09-19T09:13:36.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.743+0000 7fa879ffb640 1 -- 172.21.15.18:0/1353909430 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa880019070 con 0x7fa88406d0e0 2024-09-19T09:13:36.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.743+0000 7fa879ffb640 1 -- 172.21.15.18:0/1353909430 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88000ba60 con 0x7fa88406d0e0 2024-09-19T09:13:36.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.743+0000 7fbb8bfff640 1 --2- 172.21.15.18:0/336868866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb8c162c10 0x7fbb8c1673c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c068e20 tx=0x7fbb7c02a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c33d41b8c85b09e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.743+0000 7eff2036d640 1 -- start start 2024-09-19T09:13:36.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7eff2036d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff10009af0 0x7eff10052580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.743+0000 7fd2e8ff9640 1 -- 172.21.15.18:0/2336965856 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2e4008450 con 0x7fd2ec15b510 2024-09-19T09:13:36.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.744+0000 7fd2e8ff9640 1 -- 172.21.15.18:0/2336965856 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4008840 con 0x7fd2ec15b510 2024-09-19T09:13:36.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7fd2f15a2640 1 -- 172.21.15.18:0/2336965856 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2ec06d140 con 0x7fd2ec15b510 2024-09-19T09:13:36.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.744+0000 7fe9fa0dd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9ec0071e0 0x7fe9ec0df980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.744+0000 7fe9fa0dd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9ec033a40 0x7fe9ec1711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.744+0000 7fe9fa0dd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9ec039620 0x7fe9ec04a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.744+0000 7fe9fa0dd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ec047720 con 0x7fe9ec033a40 2024-09-19T09:13:36.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.744+0000 7fe9fa0dd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe9ec0475a0 con 0x7fe9ec039620 2024-09-19T09:13:36.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.744+0000 7fe9fa0dd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe9ec0478a0 con 0x7fe9ec0071e0 2024-09-19T09:13:36.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.744+0000 7fe9f2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9ec033a40 0x7fe9ec1711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.744+0000 7fe9f2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9ec033a40 0x7fe9ec1711e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36488/0 (socket says 172.21.15.18:36488) 2024-09-19T09:13:36.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.744+0000 7fe9f2ffd640 1 -- 172.21.15.18:0/202797928 learned_addr learned my addr 172.21.15.18:0/202797928 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:36.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.744+0000 7fe9f37fe640 1 --2- 172.21.15.18:0/202797928 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9ec0071e0 0x7fe9ec0df980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7fe9f2ffd640 1 -- 172.21.15.18:0/202797928 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9ec0071e0 msgr2=0x7fe9ec0df980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7fe9f2ffd640 1 --2- 172.21.15.18:0/202797928 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9ec0071e0 0x7fe9ec0df980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7fe9f2ffd640 1 -- 172.21.15.18:0/202797928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9ec039620 msgr2=0x7fe9ec04a2b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:13:36.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7fe9f2ffd640 1 --2- 172.21.15.18:0/202797928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9ec039620 0x7fe9ec04a2b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7fe9f2ffd640 1 -- 172.21.15.18:0/202797928 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9ec171b50 con 0x7fe9ec033a40 2024-09-19T09:13:36.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7fe9f2ffd640 1 --2- 172.21.15.18:0/202797928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9ec033a40 0x7fe9ec1711e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe9e002a7d0 tx=0x7fe9e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.744+0000 7fbb8affd640 1 -- 172.21.15.18:0/336868866 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c031440 con 0x7fbb8c162c10 2024-09-19T09:13:36.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.744+0000 7fbb8affd640 1 -- 172.21.15.18:0/336868866 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb7c02d070 con 0x7fbb8c162c10 2024-09-19T09:13:36.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.744+0000 7fbb8affd640 1 -- 172.21.15.18:0/336868866 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c031800 con 0x7fbb8c162c10 2024-09-19T09:13:36.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7fbb9130b640 1 -- 172.21.15.18:0/336868866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb8c162c10 msgr2=0x7fbb8c1673c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7fbb9130b640 1 --2- 172.21.15.18:0/336868866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb8c162c10 0x7fbb8c1673c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c068e20 tx=0x7fbb7c02a8f0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.743+0000 7f9a7a453640 1 Processor -- start 2024-09-19T09:13:36.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7fae18ff9640 1 -- 172.21.15.18:0/494215655 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae04015020 con 0x7fae1c0b5b30 2024-09-19T09:13:36.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7fae18ff9640 1 -- 172.21.15.18:0/494215655 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae04011850 con 0x7fae1c0b5b30 2024-09-19T09:13:36.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7fe9dffff640 1 -- 172.21.15.18:0/202797928 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e0040020 con 0x7fe9ec033a40 2024-09-19T09:13:36.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.744+0000 7f9a7a453640 1 -- start start 2024-09-19T09:13:36.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7f9a7a453640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a7406f680 0x7f9a741f8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7f9a7a453640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a74158b00 0x7f9a74156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7f9a7a453640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a7415bd90 0x7f9a74156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7f9a7a453640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9a74070010 con 0x7f9a74158b00 2024-09-19T09:13:36.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7f9a7a453640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9a74158ee0 con 0x7f9a7415bd90 2024-09-19T09:13:36.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7f9a7a453640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9a74070190 con 0x7f9a7406f680 2024-09-19T09:13:36.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7fe9fa0dd640 1 -- 172.21.15.18:0/202797928 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9ec171e30 con 0x7fe9ec033a40 2024-09-19T09:13:36.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7fe9fa0dd640 1 -- 172.21.15.18:0/202797928 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9ec048480 con 0x7fe9ec033a40 2024-09-19T09:13:36.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7fe9dffff640 1 -- 172.21.15.18:0/202797928 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9e0038040 con 0x7fe9ec033a40 2024-09-19T09:13:36.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7fe9dffff640 1 -- 172.21.15.18:0/202797928 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9e0037070 con 0x7fe9ec033a40 2024-09-19T09:13:36.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7eff1e109640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff10009af0 0x7eff10052580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7eff1e109640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff10009af0 0x7eff10052580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36500/0 (socket says 172.21.15.18:36500) 2024-09-19T09:13:36.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.746+0000 7fd2e8ff9640 1 -- 172.21.15.18:0/2336965856 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd2e4039070 con 0x7fd2ec15b510 2024-09-19T09:13:36.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.746+0000 7f4496ffd640 1 -- 172.21.15.18:0/678626120 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f449c011cf0 con 0x7f44a00497f0 2024-09-19T09:13:36.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.746+0000 7f4496ffd640 1 --2- 172.21.15.18:0/678626120 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f448806c380 0x7f448806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.746+0000 7f4496ffd640 1 -- 172.21.15.18:0/678626120 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f449c08b1d0 con 0x7f44a00497f0 2024-09-19T09:13:36.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.746+0000 7f44acc53640 1 -- 172.21.15.18:0/678626120 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44a000bdb0 con 0x7f44a00497f0 2024-09-19T09:13:36.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.746+0000 7fae18ff9640 1 -- 172.21.15.18:0/494215655 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae04011c40 con 0x7fae1c0b5b30 2024-09-19T09:13:36.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.746+0000 7fae21f28640 1 -- 172.21.15.18:0/494215655 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae1c14ffd0 con 0x7fae1c0b5b30 2024-09-19T09:13:36.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.746+0000 7fae21f28640 1 -- 172.21.15.18:0/494215655 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fae1c15fd70 con 0x7fae1c0b5b30 2024-09-19T09:13:36.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.746+0000 7fd2e8ff9640 1 --2- 172.21.15.18:0/2336965856 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd2d806c380 0x7fd2d806e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.746+0000 7fd2e8ff9640 1 -- 172.21.15.18:0/2336965856 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd2e40abcd0 con 0x7fd2ec15b510 2024-09-19T09:13:36.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.747+0000 7fa88b8d9640 1 -- 172.21.15.18:0/1353909430 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8841fd0b0 con 0x7fa88406d0e0 2024-09-19T09:13:36.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7fbb9130b640 1 -- 172.21.15.18:0/336868866 shutdown_connections 2024-09-19T09:13:36.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7fbb9130b640 1 --2- 172.21.15.18:0/336868866 >> v2:172.21.15.162:3300/0 conn(0x7fbb8c0b3e80 0x7fbb8c0d0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7fbb9130b640 1 --2- 172.21.15.18:0/336868866 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb8c0b3a10 0x7fbb8c0d0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7fbb9130b640 1 --2- 172.21.15.18:0/336868866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb8c162c10 0x7fbb8c1673c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7fbb9130b640 1 -- 172.21.15.18:0/336868866 >> 172.21.15.18:0/336868866 conn(0x7fbb8c06bc10 msgr2=0x7fbb8c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:36.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.747+0000 7fbb9130b640 1 -- 172.21.15.18:0/336868866 shutdown_connections 2024-09-19T09:13:36.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7f9a73fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a7406f680 0x7f9a741f8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7f9a73fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a7406f680 0x7f9a741f8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:42354/0 (socket says 172.21.15.18:42354) 2024-09-19T09:13:36.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.745+0000 7f9a73fff640 1 -- 172.21.15.18:0/1984338597 learned_addr learned my addr 172.21.15.18:0/1984338597 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:36.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.746+0000 7f9a789f0640 1 --2- 172.21.15.18:0/1984338597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a7415bd90 0x7f9a74156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.746+0000 7f9a789f0640 1 -- 172.21.15.18:0/1984338597 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a7406f680 msgr2=0x7f9a741f8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.746+0000 7f9a789f0640 1 --2- 172.21.15.18:0/1984338597 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a7406f680 0x7f9a741f8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.746+0000 7f9a789f0640 1 -- 172.21.15.18:0/1984338597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a74158b00 msgr2=0x7f9a74156a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.746+0000 7f9a789f0640 1 --2- 172.21.15.18:0/1984338597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a74158b00 0x7f9a74156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.746+0000 7f9a789f0640 1 -- 172.21.15.18:0/1984338597 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a74155e50 con 0x7f9a7415bd90 2024-09-19T09:13:36.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.746+0000 7f9a789f0640 1 --2- 172.21.15.18:0/1984338597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a7415bd90 0x7f9a74156f70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c031000 tx=0x7f9a5c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.747+0000 7fe9fa0dd640 1 -- 172.21.15.18:0/202797928 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9ec009b20 con 0x7fe9ec033a40 2024-09-19T09:13:36.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.747+0000 7f44a659c640 1 --2- 172.21.15.18:0/678626120 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f448806c380 0x7f448806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.747+0000 7fa88b8d9640 1 -- 172.21.15.18:0/1353909430 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8841fd670 con 0x7fa88406d0e0 2024-09-19T09:13:36.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.747+0000 7fbb9130b640 1 -- 172.21.15.18:0/336868866 wait complete. 2024-09-19T09:13:36.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.747+0000 7fd2ebfff640 1 --2- 172.21.15.18:0/2336965856 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd2d806c380 0x7fd2d806e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.747+0000 7eff1e109640 1 -- 172.21.15.18:0/673608743 learned_addr learned my addr 172.21.15.18:0/673608743 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:36.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.747+0000 7eff2036d640 1 --2- 172.21.15.18:0/673608743 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff100323c0 0x7eff100449f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.747+0000 7eff2036d640 1 --2- 172.21.15.18:0/673608743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff100dec70 0x7eff10044f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.747+0000 7eff2036d640 1 -- 172.21.15.18:0/673608743 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7eff10032980 con 0x7eff10009af0 2024-09-19T09:13:36.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.747+0000 7eff2036d640 1 -- 172.21.15.18:0/673608743 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7eff100df050 con 0x7eff100dec70 2024-09-19T09:13:36.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.747+0000 7eff2036d640 1 -- 172.21.15.18:0/673608743 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7eff1000bb70 con 0x7eff100323c0 2024-09-19T09:13:36.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.747+0000 7eff1d908640 1 --2- 172.21.15.18:0/673608743 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff100323c0 0x7eff100449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.747+0000 7eff1d908640 1 -- 172.21.15.18:0/673608743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff100dec70 msgr2=0x7eff10044f30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:13:36.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.747+0000 7eff1d908640 1 --2- 172.21.15.18:0/673608743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff100dec70 0x7eff10044f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.747+0000 7eff1d908640 1 -- 172.21.15.18:0/673608743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff10009af0 msgr2=0x7eff10052580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.747+0000 7eff1d908640 1 --2- 172.21.15.18:0/673608743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff10009af0 0x7eff10052580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.747+0000 7eff1d908640 1 -- 172.21.15.18:0/673608743 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff100e20a0 con 0x7eff100323c0 2024-09-19T09:13:36.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.747+0000 7eff1e109640 1 --2- 172.21.15.18:0/673608743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff10009af0 0x7eff10052580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:13:36.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.748+0000 7f44a659c640 1 --2- 172.21.15.18:0/678626120 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f448806c380 0x7f448806e840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f44980095f0 tx=0x7f4498006b70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.748+0000 7eff1d908640 1 --2- 172.21.15.18:0/673608743 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff100323c0 0x7eff100449f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7eff0800c410 tx=0x7eff0800c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.748+0000 7fae21f28640 1 -- 172.21.15.18:0/494215655 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae1c0b5f10 con 0x7fae1c0b5b30 2024-09-19T09:13:36.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.748+0000 7fa88b8d9640 1 -- 172.21.15.18:0/1353909430 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa88415f2f0 con 0x7fa88406d0e0 2024-09-19T09:13:36.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.748+0000 7fe9dffff640 1 -- 172.21.15.18:0/202797928 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe9e0043020 con 0x7fe9ec033a40 2024-09-19T09:13:36.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.748+0000 7eff0effd640 1 -- 172.21.15.18:0/673608743 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff08017070 con 0x7eff100323c0 2024-09-19T09:13:36.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.748+0000 7eff0effd640 1 -- 172.21.15.18:0/673608743 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff08005230 con 0x7eff100323c0 2024-09-19T09:13:36.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.748+0000 7eff0effd640 1 -- 172.21.15.18:0/673608743 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff08011590 con 0x7eff100323c0 2024-09-19T09:13:36.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.748+0000 7eff2036d640 1 -- 172.21.15.18:0/673608743 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff100e1040 con 0x7eff100323c0 2024-09-19T09:13:36.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.748+0000 7eff2036d640 1 -- 172.21.15.18:0/673608743 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7eff100e15c0 con 0x7eff100323c0 2024-09-19T09:13:36.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.749+0000 7fbb9130b640 1 Processor -- start 2024-09-19T09:13:36.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.749+0000 7fd2ebfff640 1 --2- 172.21.15.18:0/2336965856 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd2d806c380 0x7fd2d806e840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc006fd0 tx=0x7fd2dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.749+0000 7fe9dffff640 1 --2- 172.21.15.18:0/202797928 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe9d806c2b0 0x7fe9d806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.749+0000 7fbb9130b640 1 -- start start 2024-09-19T09:13:36.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.749+0000 7fae18ff9640 1 -- 172.21.15.18:0/494215655 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fae04018020 con 0x7fae1c0b5b30 2024-09-19T09:13:36.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.749+0000 7fe9dffff640 1 -- 172.21.15.18:0/202797928 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe9e00aba40 con 0x7fe9ec033a40 2024-09-19T09:13:36.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.749+0000 7fa879ffb640 1 -- 172.21.15.18:0/1353909430 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa88001e460 con 0x7fa88406d0e0 2024-09-19T09:13:36.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.749+0000 7fe9f37fe640 1 --2- 172.21.15.18:0/202797928 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe9d806c2b0 0x7fe9d806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.750+0000 7fa879ffb640 1 --2- 172.21.15.18:0/1353909430 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa86806c300 0x7fa86806e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.750+0000 7fae18ff9640 1 --2- 172.21.15.18:0/494215655 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fadfc06c380 0x7fadfc06e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.750+0000 7fa879ffb640 1 -- 172.21.15.18:0/1353909430 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa88008b9c0 con 0x7fa88406d0e0 2024-09-19T09:13:36.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.750+0000 7fae12ffd640 1 --2- 172.21.15.18:0/494215655 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fadfc06c380 0x7fadfc06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.750+0000 7fae18ff9640 1 -- 172.21.15.18:0/494215655 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fae0408b2f0 con 0x7fae1c0b5b30 2024-09-19T09:13:36.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.750+0000 7fe9f37fe640 1 --2- 172.21.15.18:0/202797928 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe9d806c2b0 0x7fe9d806e770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8005880 tx=0x7fe9e8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.750+0000 7eff2036d640 1 -- 172.21.15.18:0/673608743 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff10009f40 con 0x7eff100323c0 2024-09-19T09:13:36.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.750+0000 7fa888e74640 1 --2- 172.21.15.18:0/1353909430 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa86806c300 0x7fa86806e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.750+0000 7fbb9130b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb8c0b3a10 0x7fbb8c14e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.750+0000 7fbb9130b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb8c0b3e80 0x7fbb8c163170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.751+0000 7fae12ffd640 1 --2- 172.21.15.18:0/494215655 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fadfc06c380 0x7fadfc06e840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0c8810 tx=0x7fae0c001690 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.751+0000 7fbb8bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb8c0b3a10 0x7fbb8c14e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.751+0000 7fbb8bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb8c0b3a10 0x7fbb8c14e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:58160/0 (socket says 172.21.15.18:58160) 2024-09-19T09:13:36.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.751+0000 7fbb9130b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb8c162c10 0x7fbb8c165860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.751+0000 7fbb8b7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb8c0b3e80 0x7fbb8c163170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.751+0000 7fbb8b7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb8c0b3e80 0x7fbb8c163170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:42376/0 (socket says 172.21.15.18:42376) 2024-09-19T09:13:36.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.751+0000 7fbb90b0a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb8c162c10 0x7fbb8c165860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.751+0000 7eff0effd640 1 -- 172.21.15.18:0/673608743 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7eff0801a070 con 0x7eff100323c0 2024-09-19T09:13:36.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.751+0000 7fa888e74640 1 --2- 172.21.15.18:0/1353909430 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa86806c300 0x7fa86806e7c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa87c033000 tx=0x7fa87c009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.751+0000 7fbb90b0a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb8c162c10 0x7fbb8c165860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36530/0 (socket says 172.21.15.18:36530) 2024-09-19T09:13:36.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.751+0000 7fbb8bfff640 1 -- 172.21.15.18:0/2691610614 learned_addr learned my addr 172.21.15.18:0/2691610614 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:36.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.751+0000 7fbb9130b640 1 -- 172.21.15.18:0/2691610614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8c073a20 con 0x7fbb8c162c10 2024-09-19T09:13:36.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.751+0000 7fbb9130b640 1 -- 172.21.15.18:0/2691610614 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8c162ff0 con 0x7fbb8c0b3a10 2024-09-19T09:13:36.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.751+0000 7fbb9130b640 1 -- 172.21.15.18:0/2691610614 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbb8c06f5a0 con 0x7fbb8c0b3e80 2024-09-19T09:13:36.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.752+0000 7eff0effd640 1 --2- 172.21.15.18:0/673608743 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7efefc06c380 0x7efefc06e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.752+0000 7fbb8b7fe640 1 -- 172.21.15.18:0/2691610614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb8c0b3a10 msgr2=0x7fbb8c14e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.752+0000 7fbb8b7fe640 1 --2- 172.21.15.18:0/2691610614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb8c0b3a10 0x7fbb8c14e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.752+0000 7fbb8b7fe640 1 -- 172.21.15.18:0/2691610614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb8c162c10 msgr2=0x7fbb8c165860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:36.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.752+0000 7fbb8b7fe640 1 --2- 172.21.15.18:0/2691610614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb8c162c10 0x7fbb8c165860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:36.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.752+0000 7eff0effd640 1 -- 172.21.15.18:0/673608743 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7eff0808a5b0 con 0x7eff100323c0 2024-09-19T09:13:36.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.752+0000 7eff1e109640 1 --2- 172.21.15.18:0/673608743 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7efefc06c380 0x7efefc06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.752+0000 7fbb8b7fe640 1 -- 172.21.15.18:0/2691610614 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb8c1572d0 con 0x7fbb8c0b3e80 2024-09-19T09:13:36.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.752+0000 7fbb8bfff640 1 --2- 172.21.15.18:0/2691610614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb8c0b3a10 0x7fbb8c14e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:13:36.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.752+0000 7fbb8b7fe640 1 --2- 172.21.15.18:0/2691610614 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb8c0b3e80 0x7fbb8c163170 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbb7400c7c0 tx=0x7fbb7400cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.752+0000 7eff1e109640 1 --2- 172.21.15.18:0/673608743 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7efefc06c380 0x7efefc06e840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7eff14012fd0 tx=0x7eff14007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.753+0000 7f9a70ff9640 1 -- 172.21.15.18:0/1984338597 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c037040 con 0x7f9a7415bd90 2024-09-19T09:13:36.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.753+0000 7f9a7a453640 1 -- 172.21.15.18:0/1984338597 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a741575e0 con 0x7f9a7415bd90 2024-09-19T09:13:36.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.754+0000 7fd2e8ff9640 1 -- 172.21.15.18:0/2336965856 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd2e40b1020 con 0x7fd2ec15b510 2024-09-19T09:13:36.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.754+0000 7f9a7a453640 1 -- 172.21.15.18:0/1984338597 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a74160f80 con 0x7f9a7415bd90 2024-09-19T09:13:36.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.755+0000 7f9a7a453640 1 -- 172.21.15.18:0/1984338597 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a7406fad0 con 0x7f9a7415bd90 2024-09-19T09:13:36.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.755+0000 7fe9dffff640 1 -- 172.21.15.18:0/202797928 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe9e004a030 con 0x7fe9ec033a40 2024-09-19T09:13:36.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.760+0000 7fae18ff9640 1 -- 172.21.15.18:0/494215655 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fae0401f020 con 0x7fae1c0b5b30 2024-09-19T09:13:36.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.764+0000 7f9a70ff9640 1 -- 172.21.15.18:0/1984338597 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a5c042070 con 0x7f9a7415bd90 2024-09-19T09:13:36.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.764+0000 7f9a70ff9640 1 -- 172.21.15.18:0/1984338597 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a5c006e10 con 0x7f9a7415bd90 2024-09-19T09:13:36.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.764+0000 7f4496ffd640 1 -- 172.21.15.18:0/678626120 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f449c0599b0 con 0x7f44a00497f0 2024-09-19T09:13:36.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.766+0000 7f9a70ff9640 1 -- 172.21.15.18:0/1984338597 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9a5c047660 con 0x7f9a7415bd90 2024-09-19T09:13:36.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.766+0000 7f9a70ff9640 1 --2- 172.21.15.18:0/1984338597 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9a5406c2b0 0x7f9a5406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.766+0000 7f9a70ff9640 1 -- 172.21.15.18:0/1984338597 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f9a5c0ac850 con 0x7f9a7415bd90 2024-09-19T09:13:36.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.767+0000 7f9a73fff640 1 --2- 172.21.15.18:0/1984338597 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9a5406c2b0 0x7f9a5406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.768+0000 7f9a73fff640 1 --2- 172.21.15.18:0/1984338597 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9a5406c2b0 0x7f9a5406e770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c007eb0 tx=0x7f9a6c007e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.769+0000 7fa879ffb640 1 -- 172.21.15.18:0/1353909430 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa88415f2f0 con 0x7fa88406d0e0 2024-09-19T09:13:36.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.774+0000 7f9a70ff9640 1 -- 172.21.15.18:0/1984338597 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9a5c07afb0 con 0x7f9a7415bd90 2024-09-19T09:13:36.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.776+0000 7fbb88ff9640 1 -- 172.21.15.18:0/2691610614 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb74015070 con 0x7fbb8c0b3e80 2024-09-19T09:13:36.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.776+0000 7fbb88ff9640 1 -- 172.21.15.18:0/2691610614 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb74007820 con 0x7fbb8c0b3e80 2024-09-19T09:13:36.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.778+0000 7eff0effd640 1 -- 172.21.15.18:0/673608743 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7eff080586b0 con 0x7eff100323c0 2024-09-19T09:13:36.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.777+0000 7fbb9130b640 1 -- 172.21.15.18:0/2691610614 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb8c1575b0 con 0x7fbb8c0b3e80 2024-09-19T09:13:36.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.778+0000 7fbb9130b640 1 -- 172.21.15.18:0/2691610614 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb8c14edc0 con 0x7fbb8c0b3e80 2024-09-19T09:13:36.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.777+0000 7fbb88ff9640 1 -- 172.21.15.18:0/2691610614 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb74007bf0 con 0x7fbb8c0b3e80 2024-09-19T09:13:36.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.779+0000 7fbb9130b640 1 -- 172.21.15.18:0/2691610614 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb8c14f110 con 0x7fbb8c0b3e80 2024-09-19T09:13:36.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.780+0000 7fbb88ff9640 1 -- 172.21.15.18:0/2691610614 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbb74018070 con 0x7fbb8c0b3e80 2024-09-19T09:13:36.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.781+0000 7fbb88ff9640 1 --2- 172.21.15.18:0/2691610614 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbb6c06c2b0 0x7fbb6c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:36.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.781+0000 7fbb88ff9640 1 -- 172.21.15.18:0/2691610614 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbb7408b210 con 0x7fbb8c0b3e80 2024-09-19T09:13:36.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.782+0000 7fbb8bfff640 1 --2- 172.21.15.18:0/2691610614 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbb6c06c2b0 0x7fbb6c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:36.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.782+0000 7fbb8bfff640 1 --2- 172.21.15.18:0/2691610614 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbb6c06c2b0 0x7fbb6c06e770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c009f30 tx=0x7fbb7c009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:36.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:36.785+0000 7fbb88ff9640 1 -- 172.21.15.18:0/2691610614 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fbb74059320 con 0x7fbb8c0b3e80 2024-09-19T09:13:37.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.129+0000 7fd2f15a2640 1 -- 172.21.15.18:0/2336965856 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fd2ec0b4360 con 0x7fd2ec15b510 2024-09-19T09:13:37.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.130+0000 7fd2e8ff9640 1 -- 172.21.15.18:0/2336965856 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd2e403f030 con 0x7fd2ec15b510 2024-09-19T09:13:37.130 INFO:teuthology.orchestra.run.smithi018.stdout:55834574852 2024-09-19T09:13:37.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.133+0000 7fd2f15a2640 1 -- 172.21.15.18:0/2336965856 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd2d806c380 msgr2=0x7fd2d806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:37.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.133+0000 7fd2f15a2640 1 --2- 172.21.15.18:0/2336965856 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd2d806c380 0x7fd2d806e840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc006fd0 tx=0x7fd2dc008040 comp rx=0 tx=0).stop 2024-09-19T09:13:37.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.133+0000 7fd2f15a2640 1 -- 172.21.15.18:0/2336965856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2ec15b510 msgr2=0x7fd2ec06dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:37.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.133+0000 7fd2f15a2640 1 --2- 172.21.15.18:0/2336965856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2ec15b510 0x7fd2ec06dfe0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4035000 tx=0x7fd2e4004a40 comp rx=0 tx=0).stop 2024-09-19T09:13:37.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.133+0000 7fd2f15a2640 1 -- 172.21.15.18:0/2336965856 shutdown_connections 2024-09-19T09:13:37.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.133+0000 7fd2f15a2640 1 --2- 172.21.15.18:0/2336965856 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd2d806c380 0x7fd2d806e840 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.133+0000 7fd2f15a2640 1 --2- 172.21.15.18:0/2336965856 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2ec15b510 0x7fd2ec06dfe0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.133+0000 7fd2f15a2640 1 --2- 172.21.15.18:0/2336965856 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2ec15aa20 0x7fd2ec0b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.133+0000 7fd2f15a2640 1 --2- 172.21.15.18:0/2336965856 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2ec0af690 0x7fd2ec0b1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.134+0000 7fd2f15a2640 1 -- 172.21.15.18:0/2336965856 >> 172.21.15.18:0/2336965856 conn(0x7fd2ec068070 msgr2=0x7fd2ec15c280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:37.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.134+0000 7fd2f15a2640 1 -- 172.21.15.18:0/2336965856 shutdown_connections 2024-09-19T09:13:37.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.136+0000 7fd2f15a2640 1 -- 172.21.15.18:0/2336965856 wait complete. 2024-09-19T09:13:37.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.143+0000 7fe9fa0dd640 1 -- 172.21.15.18:0/202797928 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe9ec01ddb0 con 0x7fe9ec033a40 2024-09-19T09:13:37.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.144+0000 7fe9dffff640 1 -- 172.21.15.18:0/202797928 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe9e004b2b0 con 0x7fe9ec033a40 2024-09-19T09:13:37.147 INFO:teuthology.orchestra.run.smithi018.stdout:55834574852 2024-09-19T09:13:37.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.148+0000 7fe9fa0dd640 1 -- 172.21.15.18:0/202797928 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe9d806c2b0 msgr2=0x7fe9d806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:37.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.148+0000 7fe9fa0dd640 1 --2- 172.21.15.18:0/202797928 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe9d806c2b0 0x7fe9d806e770 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8005880 tx=0x7fe9e8009040 comp rx=0 tx=0).stop 2024-09-19T09:13:37.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.148+0000 7fe9fa0dd640 1 -- 172.21.15.18:0/202797928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9ec033a40 msgr2=0x7fe9ec1711e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:37.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.148+0000 7fe9fa0dd640 1 --2- 172.21.15.18:0/202797928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9ec033a40 0x7fe9ec1711e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fe9e002a7d0 tx=0x7fe9e00046c0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.148+0000 7fe9fa0dd640 1 -- 172.21.15.18:0/202797928 shutdown_connections 2024-09-19T09:13:37.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.148+0000 7fe9fa0dd640 1 --2- 172.21.15.18:0/202797928 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe9d806c2b0 0x7fe9d806e770 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.148+0000 7fe9fa0dd640 1 --2- 172.21.15.18:0/202797928 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe9ec039620 0x7fe9ec04a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.148+0000 7fe9fa0dd640 1 --2- 172.21.15.18:0/202797928 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9ec033a40 0x7fe9ec1711e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.149+0000 7fe9fa0dd640 1 --2- 172.21.15.18:0/202797928 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9ec0071e0 0x7fe9ec0df980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.149+0000 7fe9fa0dd640 1 -- 172.21.15.18:0/202797928 >> 172.21.15.18:0/202797928 conn(0x7fe9ec0360c0 msgr2=0x7fe9ec032c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:37.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.149+0000 7fe9fa0dd640 1 -- 172.21.15.18:0/202797928 shutdown_connections 2024-09-19T09:13:37.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.149+0000 7fe9fa0dd640 1 -- 172.21.15.18:0/202797928 wait complete. 2024-09-19T09:13:37.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.151+0000 7fae21f28640 1 -- 172.21.15.18:0/494215655 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fae1c08eb70 con 0x7fae1c0b5b30 2024-09-19T09:13:37.152 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2024-09-19T09:13:37.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.152+0000 7fae18ff9640 1 -- 172.21.15.18:0/494215655 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fae04059ad0 con 0x7fae1c0b5b30 2024-09-19T09:13:37.153 INFO:teuthology.orchestra.run.smithi018.stdout:55834574852 2024-09-19T09:13:37.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.154+0000 7fae21f28640 1 -- 172.21.15.18:0/494215655 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fadfc06c380 msgr2=0x7fadfc06e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:37.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.154+0000 7fae21f28640 1 --2- 172.21.15.18:0/494215655 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fadfc06c380 0x7fadfc06e840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fae1c0c8810 tx=0x7fae0c001690 comp rx=0 tx=0).stop 2024-09-19T09:13:37.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.154+0000 7fae21f28640 1 -- 172.21.15.18:0/494215655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae1c0b5b30 msgr2=0x7fae1c15f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:37.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.154+0000 7fae21f28640 1 --2- 172.21.15.18:0/494215655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae1c0b5b30 0x7fae1c15f2a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fae0400b3e0 tx=0x7fae0400b8a0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.154+0000 7fae21f28640 1 -- 172.21.15.18:0/494215655 shutdown_connections 2024-09-19T09:13:37.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.154+0000 7fae21f28640 1 --2- 172.21.15.18:0/494215655 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fadfc06c380 0x7fadfc06e840 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.154+0000 7fae21f28640 1 --2- 172.21.15.18:0/494215655 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae1c0cfd10 0x7fae1c14c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.155+0000 7fae21f28640 1 --2- 172.21.15.18:0/494215655 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae1c0b7860 0x7fae1c14fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.155+0000 7fae21f28640 1 --2- 172.21.15.18:0/494215655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae1c0b5b30 0x7fae1c15f2a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.155+0000 7fae21f28640 1 -- 172.21.15.18:0/494215655 >> 172.21.15.18:0/494215655 conn(0x7fae1c09dda0 msgr2=0x7fae1c06c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:37.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.155+0000 7fae21f28640 1 -- 172.21.15.18:0/494215655 shutdown_connections 2024-09-19T09:13:37.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.155+0000 7fae21f28640 1 -- 172.21.15.18:0/494215655 wait complete. 2024-09-19T09:13:37.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.162+0000 7f44acc53640 1 -- 172.21.15.18:0/678626120 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f44a0057420 con 0x7f44a00497f0 2024-09-19T09:13:37.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.163+0000 7f4496ffd640 1 -- 172.21.15.18:0/678626120 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f449c0592b0 con 0x7f44a00497f0 2024-09-19T09:13:37.164 INFO:teuthology.orchestra.run.smithi018.stdout:55834574852 2024-09-19T09:13:37.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.166+0000 7f44acc53640 1 -- 172.21.15.18:0/678626120 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f448806c380 msgr2=0x7f448806e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:37.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.166+0000 7f44acc53640 1 --2- 172.21.15.18:0/678626120 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f448806c380 0x7f448806e840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f44980095f0 tx=0x7f4498006b70 comp rx=0 tx=0).stop 2024-09-19T09:13:37.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.166+0000 7f44acc53640 1 -- 172.21.15.18:0/678626120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44a00497f0 msgr2=0x7f44a00e06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:37.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.166+0000 7f44acc53640 1 --2- 172.21.15.18:0/678626120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44a00497f0 0x7f44a00e06a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f449c00c430 tx=0x7f449c00c8f0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.167+0000 7f44acc53640 1 -- 172.21.15.18:0/678626120 shutdown_connections 2024-09-19T09:13:37.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.167+0000 7f44acc53640 1 --2- 172.21.15.18:0/678626120 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f448806c380 0x7f448806e840 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.167+0000 7f44acc53640 1 --2- 172.21.15.18:0/678626120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44a0049bd0 0x7f44a00e0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.167+0000 7f44acc53640 1 --2- 172.21.15.18:0/678626120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44a00497f0 0x7f44a00e06a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.167+0000 7f44acc53640 1 --2- 172.21.15.18:0/678626120 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44a0034c60 0x7f44a004a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.167+0000 7f44acc53640 1 -- 172.21.15.18:0/678626120 >> 172.21.15.18:0/678626120 conn(0x7f44a001fb50 msgr2=0x7f44a0037080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:37.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.167+0000 7f44acc53640 1 -- 172.21.15.18:0/678626120 shutdown_connections 2024-09-19T09:13:37.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.167+0000 7f44acc53640 1 -- 172.21.15.18:0/678626120 wait complete. 2024-09-19T09:13:37.169 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2024-09-19T09:13:37.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2024-09-19T09:13:37.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.174+0000 7f9a7a453640 1 -- 172.21.15.18:0/1984338597 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f9a7415ad60 con 0x7f9a7415bd90 2024-09-19T09:13:37.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.174+0000 7f9a70ff9640 1 -- 172.21.15.18:0/1984338597 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9a5c07a8b0 con 0x7f9a7415bd90 2024-09-19T09:13:37.175 INFO:teuthology.orchestra.run.smithi018.stdout:55834574852 2024-09-19T09:13:37.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.175+0000 7eff2036d640 1 -- 172.21.15.18:0/673608743 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7eff100321a0 con 0x7eff100323c0 2024-09-19T09:13:37.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.176+0000 7eff0effd640 1 -- 172.21.15.18:0/673608743 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7eff0805c9b0 con 0x7eff100323c0 2024-09-19T09:13:37.176 INFO:teuthology.orchestra.run.smithi018.stdout:55834574852 2024-09-19T09:13:37.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.176+0000 7fbb9130b640 1 -- 172.21.15.18:0/2691610614 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fbb8c1eeb10 con 0x7fbb8c0b3e80 2024-09-19T09:13:37.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.176+0000 7f9a7a453640 1 -- 172.21.15.18:0/1984338597 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9a5406c2b0 msgr2=0x7f9a5406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:37.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.176+0000 7f9a7a453640 1 --2- 172.21.15.18:0/1984338597 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9a5406c2b0 0x7f9a5406e770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c007eb0 tx=0x7f9a6c007e40 comp rx=0 tx=0).stop 2024-09-19T09:13:37.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.176+0000 7f9a7a453640 1 -- 172.21.15.18:0/1984338597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a7415bd90 msgr2=0x7f9a74156f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:37.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.176+0000 7f9a7a453640 1 --2- 172.21.15.18:0/1984338597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a7415bd90 0x7f9a74156f70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c031000 tx=0x7f9a5c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.176+0000 7fbb88ff9640 1 -- 172.21.15.18:0/2691610614 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbb7405d620 con 0x7fbb8c0b3e80 2024-09-19T09:13:37.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.177+0000 7f9a7a453640 1 -- 172.21.15.18:0/1984338597 shutdown_connections 2024-09-19T09:13:37.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.177+0000 7f9a7a453640 1 --2- 172.21.15.18:0/1984338597 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9a5406c2b0 0x7f9a5406e770 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.177+0000 7f9a7a453640 1 --2- 172.21.15.18:0/1984338597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a7415bd90 0x7f9a74156f70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.177+0000 7f9a7a453640 1 --2- 172.21.15.18:0/1984338597 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a74158b00 0x7f9a74156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.177+0000 7f9a7a453640 1 --2- 172.21.15.18:0/1984338597 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a7406f680 0x7f9a741f8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.177+0000 7f9a7a453640 1 -- 172.21.15.18:0/1984338597 >> 172.21.15.18:0/1984338597 conn(0x7f9a740b2bc0 msgr2=0x7f9a74157dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:37.178 INFO:teuthology.orchestra.run.smithi018.stdout:55834574852 2024-09-19T09:13:37.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.177+0000 7f9a7a453640 1 -- 172.21.15.18:0/1984338597 shutdown_connections 2024-09-19T09:13:37.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.177+0000 7f9a7a453640 1 -- 172.21.15.18:0/1984338597 wait complete. 2024-09-19T09:13:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.178+0000 7eff2036d640 1 -- 172.21.15.18:0/673608743 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7efefc06c380 msgr2=0x7efefc06e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.178+0000 7eff2036d640 1 --2- 172.21.15.18:0/673608743 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7efefc06c380 0x7efefc06e840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7eff14012fd0 tx=0x7eff14007ec0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.178+0000 7eff2036d640 1 -- 172.21.15.18:0/673608743 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff100323c0 msgr2=0x7eff100449f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.178+0000 7eff2036d640 1 --2- 172.21.15.18:0/673608743 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff100323c0 0x7eff100449f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7eff0800c410 tx=0x7eff0800c8d0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.179+0000 7eff2036d640 1 -- 172.21.15.18:0/673608743 shutdown_connections 2024-09-19T09:13:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.179+0000 7eff2036d640 1 --2- 172.21.15.18:0/673608743 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7efefc06c380 0x7efefc06e840 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.179+0000 7eff2036d640 1 --2- 172.21.15.18:0/673608743 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7eff100dec70 0x7eff10044f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.179+0000 7eff2036d640 1 --2- 172.21.15.18:0/673608743 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7eff100323c0 0x7eff100449f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.179+0000 7eff2036d640 1 --2- 172.21.15.18:0/673608743 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7eff10009af0 0x7eff10052580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.179+0000 7eff2036d640 1 -- 172.21.15.18:0/673608743 >> 172.21.15.18:0/673608743 conn(0x7eff10036090 msgr2=0x7eff100d0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:37.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.179+0000 7eff2036d640 1 -- 172.21.15.18:0/673608743 shutdown_connections 2024-09-19T09:13:37.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.179+0000 7eff2036d640 1 -- 172.21.15.18:0/673608743 wait complete. 2024-09-19T09:13:37.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.179+0000 7fbb9130b640 1 -- 172.21.15.18:0/2691610614 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbb6c06c2b0 msgr2=0x7fbb6c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:37.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.179+0000 7fbb9130b640 1 --2- 172.21.15.18:0/2691610614 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbb6c06c2b0 0x7fbb6c06e770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c009f30 tx=0x7fbb7c009000 comp rx=0 tx=0).stop 2024-09-19T09:13:37.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.179+0000 7fbb9130b640 1 -- 172.21.15.18:0/2691610614 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb8c0b3e80 msgr2=0x7fbb8c163170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:37.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.179+0000 7fbb9130b640 1 --2- 172.21.15.18:0/2691610614 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb8c0b3e80 0x7fbb8c163170 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbb7400c7c0 tx=0x7fbb7400cc80 comp rx=0 tx=0).stop 2024-09-19T09:13:37.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.179+0000 7fbb9130b640 1 -- 172.21.15.18:0/2691610614 shutdown_connections 2024-09-19T09:13:37.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.179+0000 7fbb9130b640 1 --2- 172.21.15.18:0/2691610614 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbb6c06c2b0 0x7fbb6c06e770 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.179+0000 7fbb9130b640 1 --2- 172.21.15.18:0/2691610614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbb8c162c10 0x7fbb8c165860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.179+0000 7fbb9130b640 1 --2- 172.21.15.18:0/2691610614 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbb8c0b3e80 0x7fbb8c163170 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.179+0000 7fbb9130b640 1 --2- 172.21.15.18:0/2691610614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbb8c0b3a10 0x7fbb8c14e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.179+0000 7fbb9130b640 1 -- 172.21.15.18:0/2691610614 >> 172.21.15.18:0/2691610614 conn(0x7fbb8c06bc10 msgr2=0x7fbb8c160cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:37.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.180+0000 7fbb9130b640 1 -- 172.21.15.18:0/2691610614 shutdown_connections 2024-09-19T09:13:37.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.180+0000 7fbb9130b640 1 -- 172.21.15.18:0/2691610614 wait complete. 2024-09-19T09:13:37.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.180+0000 7fa88b8d9640 1 -- 172.21.15.18:0/1353909430 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fa884167090 con 0x7fa88406d0e0 2024-09-19T09:13:37.183 INFO:teuthology.orchestra.run.smithi018.stdout:55834574852 2024-09-19T09:13:37.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.181+0000 7fa879ffb640 1 -- 172.21.15.18:0/1353909430 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa8841fce30 con 0x7fa88406d0e0 2024-09-19T09:13:37.184 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2024-09-19T09:13:37.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.184+0000 7fa88b8d9640 1 -- 172.21.15.18:0/1353909430 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa86806c300 msgr2=0x7fa86806e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:37.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.184+0000 7fa88b8d9640 1 --2- 172.21.15.18:0/1353909430 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa86806c300 0x7fa86806e7c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa87c033000 tx=0x7fa87c009000 comp rx=0 tx=0).stop 2024-09-19T09:13:37.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.184+0000 7fa88b8d9640 1 -- 172.21.15.18:0/1353909430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa88406d0e0 msgr2=0x7fa8841fc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:37.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.184+0000 7fa88b8d9640 1 --2- 172.21.15.18:0/1353909430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa88406d0e0 0x7fa8841fc8f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa88000d830 tx=0x7fa88000dcf0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.184+0000 7fa88b8d9640 1 -- 172.21.15.18:0/1353909430 shutdown_connections 2024-09-19T09:13:37.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.184+0000 7fa88b8d9640 1 --2- 172.21.15.18:0/1353909430 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa86806c300 0x7fa86806e7c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.184+0000 7fa88b8d9640 1 --2- 172.21.15.18:0/1353909430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa8841664f0 0x7fa8840cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.184+0000 7fa88b8d9640 1 --2- 172.21.15.18:0/1353909430 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8840b3220 0x7fa88415c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.184+0000 7fa88b8d9640 1 --2- 172.21.15.18:0/1353909430 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa88406d0e0 0x7fa8841fc8f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:37.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.184+0000 7fa88b8d9640 1 -- 172.21.15.18:0/1353909430 >> 172.21.15.18:0/1353909430 conn(0x7fa8840b5eb0 msgr2=0x7fa884163ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:37.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.184+0000 7fa88b8d9640 1 -- 172.21.15.18:0/1353909430 shutdown_connections 2024-09-19T09:13:37.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:37.184+0000 7fa88b8d9640 1 -- 172.21.15.18:0/1353909430 wait complete. 2024-09-19T09:13:37.196 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2024-09-19T09:13:37.197 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2024-09-19T09:13:37.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2024-09-19T09:13:37.200 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.6 2024-09-19T09:13:38.153 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-19T09:13:38.170 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-19T09:13:38.170 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-19T09:13:38.185 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-19T09:13:38.196 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-19T09:13:38.198 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-19T09:13:38.199 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-19T09:13:38.200 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-19T09:13:38.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.322+0000 7fb1a8d2b640 1 Processor -- start 2024-09-19T09:13:38.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.323+0000 7fb1a8d2b640 1 -- start start 2024-09-19T09:13:38.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.324+0000 7fb1a8d2b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb1a415aa20 0x7fb1a406d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.324+0000 7fb1a8d2b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1a40af690 0x7fb1a40afaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.324+0000 7fb1a8d2b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1a406d680 con 0x7fb1a415ae00 2024-09-19T09:13:38.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.324+0000 7fb1a8d2b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb1a40b0030 con 0x7fb1a415aa20 2024-09-19T09:13:38.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.324+0000 7fb1a8d2b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb1a415bbb0 con 0x7fb1a40af690 2024-09-19T09:13:38.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.325+0000 7fb1a37fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb1a415aa20 0x7fb1a406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.325+0000 7fb1a37fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb1a415aa20 0x7fb1a406d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:58170/0 (socket says 172.21.15.18:58170) 2024-09-19T09:13:38.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.325+0000 7fb1a37fe640 1 -- 172.21.15.18:0/1187691971 learned_addr learned my addr 172.21.15.18:0/1187691971 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:38.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.326+0000 7fb1a2ffd640 1 --2- 172.21.15.18:0/1187691971 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1a40af690 0x7fb1a40afaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.326+0000 7fb1a37fe640 1 -- 172.21.15.18:0/1187691971 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1a40af690 msgr2=0x7fb1a40afaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:38.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.326+0000 7fb1a37fe640 1 --2- 172.21.15.18:0/1187691971 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1a40af690 0x7fb1a40afaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.326+0000 7fb1a37fe640 1 -- 172.21.15.18:0/1187691971 >> v1:172.21.15.162:6789/0 conn(0x7fb1a415ae00 legacy=0x7fb1a415b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:38.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.326+0000 7fb1a37fe640 1 -- 172.21.15.18:0/1187691971 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a4071f50 con 0x7fb1a415aa20 2024-09-19T09:13:38.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.328+0000 7fb1a37fe640 1 --2- 172.21.15.18:0/1187691971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1a415aa20 0x7fb1a406d140 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb194009870 tx=0x7fb19402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18050801048d2d94 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:38.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.328+0000 7fb1a27fc640 1 -- 172.21.15.18:0/1187691971 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb194037070 con 0x7fb1a415aa20 2024-09-19T09:13:38.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.328+0000 7fb1a27fc640 1 -- 172.21.15.18:0/1187691971 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb194032440 con 0x7fb1a415aa20 2024-09-19T09:13:38.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.329+0000 7fb1a8d2b640 1 -- 172.21.15.18:0/1187691971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1a415aa20 msgr2=0x7fb1a406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.329+0000 7fb1a8d2b640 1 --2- 172.21.15.18:0/1187691971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1a415aa20 0x7fb1a406d140 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb194009870 tx=0x7fb19402a230 comp rx=0 tx=0).stop 2024-09-19T09:13:38.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.330+0000 7fb1a8d2b640 1 -- 172.21.15.18:0/1187691971 shutdown_connections 2024-09-19T09:13:38.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.330+0000 7fb1a8d2b640 1 --2- 172.21.15.18:0/1187691971 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1a40af690 0x7fb1a40afaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.330+0000 7fb1a8d2b640 1 --2- 172.21.15.18:0/1187691971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1a415aa20 0x7fb1a406d140 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb194009870 tx=0x7fb19402a230 comp rx=0 tx=0).stop 2024-09-19T09:13:38.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.330+0000 7fb1a8d2b640 1 -- 172.21.15.18:0/1187691971 >> 172.21.15.18:0/1187691971 conn(0x7fb1a4068070 msgr2=0x7fb1a406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:38.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.330+0000 7fb1a8d2b640 1 -- 172.21.15.18:0/1187691971 shutdown_connections 2024-09-19T09:13:38.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.330+0000 7fb1a8d2b640 1 -- 172.21.15.18:0/1187691971 wait complete. 2024-09-19T09:13:38.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.332+0000 7fb1a8d2b640 1 Processor -- start 2024-09-19T09:13:38.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.333+0000 7fb1a8d2b640 1 -- start start 2024-09-19T09:13:38.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.334+0000 7fb1a8d2b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1a40af690 0x7fb1a40b1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.334+0000 7fb1a8d2b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1a415ae00 0x7fb1a40cf330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.334+0000 7fb1a8d2b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1a4148500 0x7fb1a4167d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.334+0000 7fb1a8d2b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a406c3c0 con 0x7fb1a40af690 2024-09-19T09:13:38.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.334+0000 7fb1a8d2b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a4072510 con 0x7fb1a415ae00 2024-09-19T09:13:38.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.334+0000 7fb1a8d2b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb1a406c540 con 0x7fb1a4148500 2024-09-19T09:13:38.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.335+0000 7fb1a37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1a40af690 0x7fb1a40b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.335+0000 7fb1a37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1a40af690 0x7fb1a40b1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36546/0 (socket says 172.21.15.18:36546) 2024-09-19T09:13:38.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.335+0000 7fb1a37fe640 1 -- 172.21.15.18:0/320174985 learned_addr learned my addr 172.21.15.18:0/320174985 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:38.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.336+0000 7fb1a37fe640 1 -- 172.21.15.18:0/320174985 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1a4148500 msgr2=0x7fb1a4167d90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:13:38.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.336+0000 7fb1a37fe640 1 --2- 172.21.15.18:0/320174985 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1a4148500 0x7fb1a4167d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.336+0000 7fb1a37fe640 1 -- 172.21.15.18:0/320174985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1a415ae00 msgr2=0x7fb1a40cf330 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:13:38.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.336+0000 7fb1a37fe640 1 --2- 172.21.15.18:0/320174985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1a415ae00 0x7fb1a40cf330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.336+0000 7fb1a37fe640 1 -- 172.21.15.18:0/320174985 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a40b0410 con 0x7fb1a40af690 2024-09-19T09:13:38.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.336+0000 7fb1a37fe640 1 --2- 172.21.15.18:0/320174985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1a40af690 0x7fb1a40b1440 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb19402a7a0 tx=0x7fb1940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:38.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.337+0000 7fb18bfff640 1 -- 172.21.15.18:0/320174985 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb194037040 con 0x7fb1a40af690 2024-09-19T09:13:38.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.337+0000 7fb1a8d2b640 1 -- 172.21.15.18:0/320174985 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1a40cf870 con 0x7fb1a40af690 2024-09-19T09:13:38.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.337+0000 7fb1a8d2b640 1 -- 172.21.15.18:0/320174985 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1a40b0960 con 0x7fb1a40af690 2024-09-19T09:13:38.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.340+0000 7fb18bfff640 1 -- 172.21.15.18:0/320174985 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb194003c70 con 0x7fb1a40af690 2024-09-19T09:13:38.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.340+0000 7fb18bfff640 1 -- 172.21.15.18:0/320174985 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb194032680 con 0x7fb1a40af690 2024-09-19T09:13:38.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.341+0000 7fb18bfff640 1 -- 172.21.15.18:0/320174985 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb194032860 con 0x7fb1a40af690 2024-09-19T09:13:38.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.342+0000 7fb18bfff640 1 --2- 172.21.15.18:0/320174985 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb18c06c520 0x7fb18c06e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.342+0000 7fb18bfff640 1 -- 172.21.15.18:0/320174985 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb1940abab0 con 0x7fb1a40af690 2024-09-19T09:13:38.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.343+0000 7fb1a2ffd640 1 --2- 172.21.15.18:0/320174985 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb18c06c520 0x7fb18c06e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.344+0000 7fb1a2ffd640 1 --2- 172.21.15.18:0/320174985 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb18c06c520 0x7fb18c06e9e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb1a414eef0 tx=0x7fb198009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:38.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.345+0000 7fb1a8d2b640 1 -- 172.21.15.18:0/320174985 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb184005290 con 0x7fb1a40af690 2024-09-19T09:13:38.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.353+0000 7fb18bfff640 1 -- 172.21.15.18:0/320174985 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb194003e20 con 0x7fb1a40af690 2024-09-19T09:13:38.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.372+0000 7f639ced9640 1 Processor -- start 2024-09-19T09:13:38.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.372+0000 7f639ced9640 1 -- start start 2024-09-19T09:13:38.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.374+0000 7f639ced9640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f63980af690 0x7f63980afb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.374+0000 7f639ced9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6398072a30 0x7f6398072e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.374+0000 7f639ced9640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6398071f50 con 0x7f639806c3c0 2024-09-19T09:13:38.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.374+0000 7f639ced9640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f6398072230 con 0x7f6398072a30 2024-09-19T09:13:38.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.374+0000 7f639ced9640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6398072510 con 0x7f63980af690 2024-09-19T09:13:38.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.375+0000 7f6396ffd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f63980af690 0x7f63980afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.375+0000 7f6396ffd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f63980af690 0x7f63980afb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:58180/0 (socket says 172.21.15.18:58180) 2024-09-19T09:13:38.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.375+0000 7f6396ffd640 1 -- 172.21.15.18:0/4068107805 learned_addr learned my addr 172.21.15.18:0/4068107805 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:38.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.376+0000 7f6396ffd640 1 -- 172.21.15.18:0/4068107805 >> v2:172.21.15.18:3300/0 conn(0x7f6398072a30 msgr2=0x7f6398072e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:38.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.376+0000 7f6396ffd640 1 --2- 172.21.15.18:0/4068107805 >> v2:172.21.15.18:3300/0 conn(0x7f6398072a30 0x7f6398072e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.375+0000 7f3605544640 1 Processor -- start 2024-09-19T09:13:38.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.375+0000 7f3605544640 1 -- start start 2024-09-19T09:13:38.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.376+0000 7f6396ffd640 1 -- 172.21.15.18:0/4068107805 >> v1:172.21.15.18:6789/0 conn(0x7f639806c3c0 legacy=0x7f639806d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:38.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.376+0000 7f6396ffd640 1 -- 172.21.15.18:0/4068107805 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f639815b7c0 con 0x7f63980af690 2024-09-19T09:13:38.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.377+0000 7efcd3af1640 1 Processor -- start 2024-09-19T09:13:38.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.376+0000 7f3605544640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3600073280 0x7f36000b4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.376+0000 7f3605544640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f36000b49d0 0x7f360016c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.376+0000 7f3605544640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f360006d920 con 0x7f36000b40b0 2024-09-19T09:13:38.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.376+0000 7f3605544640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f360006dc00 con 0x7f36000b49d0 2024-09-19T09:13:38.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.376+0000 7f3605544640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f360006dee0 con 0x7f3600073280 2024-09-19T09:13:38.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.377+0000 7f35fffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f36000b40b0 0x7f360006d140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:42428/0 (socket says 172.21.15.18:42428) 2024-09-19T09:13:38.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.377+0000 7f35fffff640 1 -- 172.21.15.18:0/1264809880 learned_addr learned my addr 172.21.15.18:0/1264809880 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:38.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.377+0000 7f3604d43640 1 --2- 172.21.15.18:0/1264809880 >> v2:172.21.15.18:3300/0 conn(0x7f36000b49d0 0x7f360016c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.377+0000 7f35f7fff640 1 --2- 172.21.15.18:0/1264809880 >> v2:172.21.15.162:3300/0 conn(0x7f3600073280 0x7f36000b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.377+0000 7f9555e7b640 1 Processor -- start 2024-09-19T09:13:38.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.377+0000 7f9555e7b640 1 -- start start 2024-09-19T09:13:38.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.377+0000 7f35ff7fe640 1 -- 172.21.15.18:0/1264809880 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1225844838 0 0) 0x7f360006d920 con 0x7f36000b40b0 2024-09-19T09:13:38.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.377+0000 7f35ff7fe640 1 -- 172.21.15.18:0/1264809880 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35ec003520 con 0x7f36000b40b0 2024-09-19T09:13:38.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.377+0000 7efcd3af1640 1 -- start start 2024-09-19T09:13:38.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.377+0000 7f6396ffd640 1 --2- 172.21.15.18:0/4068107805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63980af690 0x7f63980afb20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f639806ed90 tx=0x7f639002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b5ed3d0afcded9d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:38.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.378+0000 7f9555e7b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9550072e10 0x7f9550163730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.378+0000 7efcd3af1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7efccc14cc40 0x7efccc0ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.378+0000 7efcd3af1640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7efccc0b47d0 0x7efccc0b5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.378+0000 7efcd3af1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efccc06e180 0x7efccc06e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.378+0000 7f9555e7b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95500b4660 0x7f955006e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.379+0000 7f954effd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95500b4660 0x7f955006e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.379+0000 7f954effd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95500b4660 0x7f955006e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:42402/0 (socket says 172.21.15.18:42402) 2024-09-19T09:13:38.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.379+0000 7f954effd640 1 -- 172.21.15.18:0/1558720926 learned_addr learned my addr 172.21.15.18:0/1558720926 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:38.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.379+0000 7f9555e7b640 1 -- 172.21.15.18:0/1558720926 --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95500b4aa0 con 0x7f955006e7c0 2024-09-19T09:13:38.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.379+0000 7efcd3af1640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7efccc06eb30 con 0x7efccc14cc40 2024-09-19T09:13:38.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.379+0000 7efcd3af1640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7efccc0cecc0 con 0x7efccc0b47d0 2024-09-19T09:13:38.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.379+0000 7efcd3af1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efccc0716b0 con 0x7efccc06e180 2024-09-19T09:13:38.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.379+0000 7efcd108c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7efccc0b47d0 0x7efccc0b5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.379+0000 7efcd108c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7efccc0b47d0 0x7efccc0b5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:58214/0 (socket says 172.21.15.18:58214) 2024-09-19T09:13:38.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.379+0000 7efcd108c640 1 -- 172.21.15.18:0/2331119088 learned_addr learned my addr 172.21.15.18:0/2331119088 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:38.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.379+0000 7efcd208e640 1 --2- 172.21.15.18:0/2331119088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efccc06e180 0x7efccc06e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.378+0000 7f3604d43640 1 -- 172.21.15.18:0/1264809880 >> v2:172.21.15.162:3300/0 conn(0x7f3600073280 msgr2=0x7f36000b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:38.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.378+0000 7f3604d43640 1 --2- 172.21.15.18:0/1264809880 >> v2:172.21.15.162:3300/0 conn(0x7f3600073280 0x7f36000b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.378+0000 7f3604d43640 1 -- 172.21.15.18:0/1264809880 >> v1:172.21.15.18:6789/0 conn(0x7f36000b40b0 legacy=0x7f360006d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.378+0000 7f3604d43640 1 -- 172.21.15.18:0/1264809880 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f360006e1c0 con 0x7f36000b49d0 2024-09-19T09:13:38.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.379+0000 7f9555e7b640 1 -- 172.21.15.18:0/1558720926 --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f95500b4d20 con 0x7f9550072e10 2024-09-19T09:13:38.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.379+0000 7f9555e7b640 1 -- 172.21.15.18:0/1558720926 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f95500b5000 con 0x7f95500b4660 2024-09-19T09:13:38.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.379+0000 7f63967fc640 1 -- 172.21.15.18:0/4068107805 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6390037070 con 0x7f63980af690 2024-09-19T09:13:38.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.379+0000 7f63967fc640 1 -- 172.21.15.18:0/4068107805 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6390032440 con 0x7f63980af690 2024-09-19T09:13:38.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.379+0000 7f954f7fe640 1 --2- 172.21.15.18:0/1558720926 >> v2:172.21.15.162:3300/0 conn(0x7f9550072e10 0x7f9550163730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.379+0000 7f954e7fc640 1 -- 172.21.15.18:0/1558720926 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 973170567 0 0) 0x7f9548001490 con 0x7f955006e7c0 2024-09-19T09:13:38.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.379+0000 7f954e7fc640 1 -- 172.21.15.18:0/1558720926 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9538003520 con 0x7f955006e7c0 2024-09-19T09:13:38.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.379+0000 7f3604d43640 1 --2- 172.21.15.18:0/1264809880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36000b49d0 0x7f360016c8f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f360006d850 tx=0x7f35f802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adbc3b378ab943f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:38.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.380+0000 7f35ff7fe640 1 -- 172.21.15.18:0/1264809880 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f8007740 con 0x7f36000b49d0 2024-09-19T09:13:38.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.380+0000 7f35ff7fe640 1 -- 172.21.15.18:0/1264809880 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35f80078e0 con 0x7f36000b49d0 2024-09-19T09:13:38.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.379+0000 7efcd208e640 1 -- 172.21.15.18:0/2331119088 >> v2:172.21.15.162:3300/0 conn(0x7efccc0b47d0 msgr2=0x7efccc0b5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:38.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.379+0000 7efcd208e640 1 --2- 172.21.15.18:0/2331119088 >> v2:172.21.15.162:3300/0 conn(0x7efccc0b47d0 0x7efccc0b5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.379+0000 7efcd208e640 1 -- 172.21.15.18:0/2331119088 >> v2:172.21.15.18:3300/0 conn(0x7efccc14cc40 msgr2=0x7efccc0ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:38.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.379+0000 7efcd208e640 1 --2- 172.21.15.18:0/2331119088 >> v2:172.21.15.18:3300/0 conn(0x7efccc14cc40 0x7efccc0ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.379+0000 7efcd208e640 1 -- 172.21.15.18:0/2331119088 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efccc071990 con 0x7efccc06e180 2024-09-19T09:13:38.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.380+0000 7f63967fc640 1 -- 172.21.15.18:0/4068107805 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6390032810 con 0x7f63980af690 2024-09-19T09:13:38.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.380+0000 7f35ff7fe640 1 -- 172.21.15.18:0/1264809880 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f8007cf0 con 0x7f36000b49d0 2024-09-19T09:13:38.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.380+0000 7f954e7fc640 1 -- 172.21.15.18:0/1558720926 <== mon.1 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3379639827 0 0) 0x7f9538003520 con 0x7f955006e7c0 2024-09-19T09:13:38.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.380+0000 7f954f7fe640 1 -- 172.21.15.18:0/1558720926 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95500b4660 msgr2=0x7f955006e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:38.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.380+0000 7f954f7fe640 1 --2- 172.21.15.18:0/1558720926 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95500b4660 0x7f955006e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.380+0000 7f954f7fe640 1 -- 172.21.15.18:0/1558720926 >> v1:172.21.15.162:6789/0 conn(0x7f955006e7c0 legacy=0x7f9550166d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.380+0000 7f954f7fe640 1 -- 172.21.15.18:0/1558720926 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95500b52e0 con 0x7f9550072e10 2024-09-19T09:13:38.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.381+0000 7f954f7fe640 1 --2- 172.21.15.18:0/1558720926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9550072e10 0x7f9550163730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f95400097a0 tx=0x7f954002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2d166e15830ece4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:38.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.381+0000 7f639ced9640 1 -- 172.21.15.18:0/4068107805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63980af690 msgr2=0x7f63980afb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.381+0000 7f3605544640 1 -- 172.21.15.18:0/1264809880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36000b49d0 msgr2=0x7f360016c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.381+0000 7f3605544640 1 --2- 172.21.15.18:0/1264809880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36000b49d0 0x7f360016c8f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f360006d850 tx=0x7f35f802a6a0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.381+0000 7efcd208e640 1 --2- 172.21.15.18:0/2331119088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efccc06e180 0x7efccc06e5f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efccc071360 tx=0x7efcc402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ecf8fc57e93fd9f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:38.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.381+0000 7efcd088b640 1 -- 172.21.15.18:0/2331119088 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc4031600 con 0x7efccc06e180 2024-09-19T09:13:38.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.381+0000 7efcd088b640 1 -- 172.21.15.18:0/2331119088 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcc40317a0 con 0x7efccc06e180 2024-09-19T09:13:38.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.381+0000 7f3605544640 1 -- 172.21.15.18:0/1264809880 shutdown_connections 2024-09-19T09:13:38.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.381+0000 7f3605544640 1 --2- 172.21.15.18:0/1264809880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36000b49d0 0x7f360016c8f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.381+0000 7f3605544640 1 --2- 172.21.15.18:0/1264809880 >> v2:172.21.15.162:3300/0 conn(0x7f3600073280 0x7f36000b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.381+0000 7f3605544640 1 -- 172.21.15.18:0/1264809880 >> 172.21.15.18:0/1264809880 conn(0x7f3600068070 msgr2=0x7f360006bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:38.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.381+0000 7efcd088b640 1 -- 172.21.15.18:0/2331119088 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc4031b70 con 0x7efccc06e180 2024-09-19T09:13:38.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.381+0000 7f639ced9640 1 --2- 172.21.15.18:0/4068107805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63980af690 0x7f63980afb20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f639806ed90 tx=0x7f639002a230 comp rx=0 tx=0).stop 2024-09-19T09:13:38.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.381+0000 7f954e7fc640 1 -- 172.21.15.18:0/1558720926 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9540037070 con 0x7f9550072e10 2024-09-19T09:13:38.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.381+0000 7f954e7fc640 1 -- 172.21.15.18:0/1558720926 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f954002aba0 con 0x7f9550072e10 2024-09-19T09:13:38.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.381+0000 7f954e7fc640 1 -- 172.21.15.18:0/1558720926 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9548001bc0 con 0x7f9550072e10 2024-09-19T09:13:38.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.382+0000 7f3605544640 1 -- 172.21.15.18:0/1264809880 shutdown_connections 2024-09-19T09:13:38.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.381+0000 7f639ced9640 1 -- 172.21.15.18:0/4068107805 shutdown_connections 2024-09-19T09:13:38.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.382+0000 7f639ced9640 1 --2- 172.21.15.18:0/4068107805 >> v2:172.21.15.18:3300/0 conn(0x7f6398072a30 0x7f6398072e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.382+0000 7f639ced9640 1 --2- 172.21.15.18:0/4068107805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63980af690 0x7f63980afb20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.382+0000 7f639ced9640 1 -- 172.21.15.18:0/4068107805 >> 172.21.15.18:0/4068107805 conn(0x7f6398068070 msgr2=0x7f639806bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:38.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.382+0000 7f3605544640 1 -- 172.21.15.18:0/1264809880 wait complete. 2024-09-19T09:13:38.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.382+0000 7f639ced9640 1 -- 172.21.15.18:0/4068107805 shutdown_connections 2024-09-19T09:13:38.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.382+0000 7efcd3af1640 1 -- 172.21.15.18:0/2331119088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efccc06e180 msgr2=0x7efccc06e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.382+0000 7efcd3af1640 1 --2- 172.21.15.18:0/2331119088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efccc06e180 0x7efccc06e5f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efccc071360 tx=0x7efcc402a5d0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.382+0000 7efcd3af1640 1 -- 172.21.15.18:0/2331119088 shutdown_connections 2024-09-19T09:13:38.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.382+0000 7efcd3af1640 1 --2- 172.21.15.18:0/2331119088 >> v2:172.21.15.162:3300/0 conn(0x7efccc0b47d0 0x7efccc0b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.382+0000 7efcd3af1640 1 --2- 172.21.15.18:0/2331119088 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efccc06e180 0x7efccc06e5f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.382+0000 7efcd3af1640 1 --2- 172.21.15.18:0/2331119088 >> v2:172.21.15.18:3300/0 conn(0x7efccc14cc40 0x7efccc0ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.382+0000 7efcd3af1640 1 -- 172.21.15.18:0/2331119088 >> 172.21.15.18:0/2331119088 conn(0x7efccc0b2630 msgr2=0x7efccc0b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:38.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.383+0000 7efcd3af1640 1 -- 172.21.15.18:0/2331119088 shutdown_connections 2024-09-19T09:13:38.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.382+0000 7f9555e7b640 1 -- 172.21.15.18:0/1558720926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9550072e10 msgr2=0x7f9550163730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.382+0000 7f9555e7b640 1 --2- 172.21.15.18:0/1558720926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9550072e10 0x7f9550163730 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f95400097a0 tx=0x7f954002a110 comp rx=0 tx=0).stop 2024-09-19T09:13:38.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.382+0000 7f9555e7b640 1 -- 172.21.15.18:0/1558720926 shutdown_connections 2024-09-19T09:13:38.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.382+0000 7f9555e7b640 1 --2- 172.21.15.18:0/1558720926 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95500b4660 0x7f955006e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.382+0000 7f9555e7b640 1 --2- 172.21.15.18:0/1558720926 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9550072e10 0x7f9550163730 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f95400097a0 tx=0x7f954002a110 comp rx=0 tx=0).stop 2024-09-19T09:13:38.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.382+0000 7f9555e7b640 1 -- 172.21.15.18:0/1558720926 >> 172.21.15.18:0/1558720926 conn(0x7f95500b2630 msgr2=0x7f95500b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:38.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.383+0000 7f9555e7b640 1 -- 172.21.15.18:0/1558720926 shutdown_connections 2024-09-19T09:13:38.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.382+0000 7f639ced9640 1 -- 172.21.15.18:0/4068107805 wait complete. 2024-09-19T09:13:38.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.383+0000 7f639ced9640 1 Processor -- start 2024-09-19T09:13:38.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.384+0000 7f3605544640 1 Processor -- start 2024-09-19T09:13:38.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.384+0000 7f3605544640 1 -- start start 2024-09-19T09:13:38.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.383+0000 7efcd3af1640 1 -- 172.21.15.18:0/2331119088 wait complete. 2024-09-19T09:13:38.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.384+0000 7efcd3af1640 1 Processor -- start 2024-09-19T09:13:38.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.384+0000 7f639ced9640 1 -- start start 2024-09-19T09:13:38.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.385+0000 7f639ced9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f639806c3c0 0x7f6398155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.385+0000 7efcd3af1640 1 -- start start 2024-09-19T09:13:38.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.385+0000 7f639ced9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6398072a30 0x7f63980aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.385+0000 7f639ced9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63980af690 0x7f639806df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.385+0000 7f639ced9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f639815a7b0 con 0x7f6398072a30 2024-09-19T09:13:38.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.385+0000 7f639ced9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f63980735a0 con 0x7f63980af690 2024-09-19T09:13:38.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.385+0000 7f639ced9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f639815a930 con 0x7f639806c3c0 2024-09-19T09:13:38.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.386+0000 7f63977fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f639806c3c0 0x7f6398155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.386+0000 7f63977fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f639806c3c0 0x7f6398155610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:42414/0 (socket says 172.21.15.18:42414) 2024-09-19T09:13:38.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.386+0000 7f63977fe640 1 -- 172.21.15.18:0/306402747 learned_addr learned my addr 172.21.15.18:0/306402747 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:38.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.386+0000 7f6396ffd640 1 --2- 172.21.15.18:0/306402747 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6398072a30 0x7f63980aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.386+0000 7f3605544640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3600073280 0x7f3600153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.386+0000 7f3605544640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36000b40b0 0x7f36000ae130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.386+0000 7f3605544640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36000b49d0 0x7f3600165920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.386+0000 7f3605544640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f360006e9c0 con 0x7f36000b40b0 2024-09-19T09:13:38.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.386+0000 7efcd3af1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efccc06e180 0x7efccc145af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.386+0000 7f3605544640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f36000b4e20 con 0x7f36000b49d0 2024-09-19T09:13:38.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.386+0000 7f3605544640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f36000ce8b0 con 0x7f3600073280 2024-09-19T09:13:38.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.386+0000 7f35f7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36000b40b0 0x7f36000ae130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.386+0000 7efcd3af1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efccc0b47d0 0x7efccc1599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.386+0000 7f35f7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36000b40b0 0x7f36000ae130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36584/0 (socket says 172.21.15.18:36584) 2024-09-19T09:13:38.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.386+0000 7f35f7fff640 1 -- 172.21.15.18:0/2870773528 learned_addr learned my addr 172.21.15.18:0/2870773528 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:38.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.386+0000 7efcd188d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efccc06e180 0x7efccc145af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.387+0000 7efcd188d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efccc06e180 0x7efccc145af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:58240/0 (socket says 172.21.15.18:58240) 2024-09-19T09:13:38.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.386+0000 7f3604d43640 1 --2- 172.21.15.18:0/2870773528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36000b49d0 0x7f3600165920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.387+0000 7efcd188d640 1 -- 172.21.15.18:0/4282584231 learned_addr learned my addr 172.21.15.18:0/4282584231 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:38.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.387+0000 7efcd3af1640 1 --2- 172.21.15.18:0/4282584231 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efccc14cc40 0x7efccc0abb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.387+0000 7efcd3af1640 1 -- 172.21.15.18:0/4282584231 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efccc0b5bc0 con 0x7efccc0b47d0 2024-09-19T09:13:38.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.387+0000 7efcd3af1640 1 -- 172.21.15.18:0/4282584231 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efccc071f50 con 0x7efccc06e180 2024-09-19T09:13:38.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.387+0000 7efcd3af1640 1 -- 172.21.15.18:0/4282584231 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efccc072750 con 0x7efccc14cc40 2024-09-19T09:13:38.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.387+0000 7f6397fff640 1 --2- 172.21.15.18:0/306402747 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63980af690 0x7f639806df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.384+0000 7f9555e7b640 1 -- 172.21.15.18:0/1558720926 wait complete. 2024-09-19T09:13:38.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.387+0000 7efcd208e640 1 --2- 172.21.15.18:0/4282584231 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efccc14cc40 0x7efccc0abb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.385+0000 7f9555e7b640 1 Processor -- start 2024-09-19T09:13:38.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.386+0000 7f9555e7b640 1 -- start start 2024-09-19T09:13:38.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.387+0000 7f35fffff640 1 --2- 172.21.15.18:0/2870773528 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3600073280 0x7f3600153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.387+0000 7f9555e7b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f955006e7c0 0x7f9550159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.387+0000 7f9555e7b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95500b4660 0x7f9550206fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.387+0000 7f9555e7b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9550207500 0x7f955020d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.387+0000 7f9555e7b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f95500731f0 con 0x7f95500b4660 2024-09-19T09:13:38.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.387+0000 7f9555e7b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f955006d660 con 0x7f9550207500 2024-09-19T09:13:38.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.387+0000 7f9555e7b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9550073370 con 0x7f955006e7c0 2024-09-19T09:13:38.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.387+0000 7f954effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95500b4660 0x7f9550206fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7f954effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95500b4660 0x7f9550206fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36600/0 (socket says 172.21.15.18:36600) 2024-09-19T09:13:38.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7f954effd640 1 -- 172.21.15.18:0/955533224 learned_addr learned my addr 172.21.15.18:0/955533224 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:38.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7f954f7fe640 1 --2- 172.21.15.18:0/955533224 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f955006e7c0 0x7f9550159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7f6396ffd640 1 -- 172.21.15.18:0/306402747 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f639806c3c0 msgr2=0x7f6398155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7f6396ffd640 1 --2- 172.21.15.18:0/306402747 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f639806c3c0 0x7f6398155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7f6396ffd640 1 -- 172.21.15.18:0/306402747 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63980af690 msgr2=0x7f639806df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7f6396ffd640 1 --2- 172.21.15.18:0/306402747 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63980af690 0x7f639806df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7f6396ffd640 1 -- 172.21.15.18:0/306402747 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63981569c0 con 0x7f6398072a30 2024-09-19T09:13:38.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7efcd108c640 1 --2- 172.21.15.18:0/4282584231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efccc0b47d0 0x7efccc1599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7efcd208e640 1 -- 172.21.15.18:0/4282584231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efccc06e180 msgr2=0x7efccc145af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7efcd208e640 1 --2- 172.21.15.18:0/4282584231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efccc06e180 0x7efccc145af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7efcd208e640 1 -- 172.21.15.18:0/4282584231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efccc0b47d0 msgr2=0x7efccc1599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7efcd208e640 1 --2- 172.21.15.18:0/4282584231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efccc0b47d0 0x7efccc1599f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7efcd208e640 1 -- 172.21.15.18:0/4282584231 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efccc144a50 con 0x7efccc14cc40 2024-09-19T09:13:38.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.386+0000 7fbe35865640 1 Processor -- start 2024-09-19T09:13:38.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.386+0000 7fbe35865640 1 -- start start 2024-09-19T09:13:38.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7f954ffff640 1 --2- 172.21.15.18:0/955533224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9550207500 0x7f955020d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7f3604d43640 1 -- 172.21.15.18:0/2870773528 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3600073280 msgr2=0x7f3600153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7f3604d43640 1 --2- 172.21.15.18:0/2870773528 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3600073280 0x7f3600153810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7f3604d43640 1 -- 172.21.15.18:0/2870773528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36000b40b0 msgr2=0x7f36000ae130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7f3604d43640 1 --2- 172.21.15.18:0/2870773528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36000b40b0 0x7f36000ae130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7f3604d43640 1 -- 172.21.15.18:0/2870773528 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36000aeba0 con 0x7f36000b49d0 2024-09-19T09:13:38.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7f3604d43640 1 --2- 172.21.15.18:0/2870773528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36000b49d0 0x7f3600165920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f360006c770 tx=0x7f35f8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:38.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7fbe35865640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe280e6fb0 0x7fbe28006230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7fbe35865640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbe28047c40 0x7fbe28006770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7fbe35865640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe2800b6f0 con 0x7fbe28033a30 2024-09-19T09:13:38.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7fbe35865640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fbe280477b0 con 0x7fbe28047c40 2024-09-19T09:13:38.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7fbe35865640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbe2800b9d0 con 0x7fbe280e6fb0 2024-09-19T09:13:38.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7fbe2effd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe280e6fb0 0x7fbe28006230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7efcd208e640 1 --2- 172.21.15.18:0/4282584231 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efccc14cc40 0x7efccc0abb30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efcc4031000 tx=0x7efcc4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:38.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7fbe2e7fc640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbe28047c40 0x7fbe28006770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7f35fd7fa640 1 -- 172.21.15.18:0/2870773528 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f8040070 con 0x7f36000b49d0 2024-09-19T09:13:38.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7fbe2e7fc640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbe28047c40 0x7fbe28006770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:58258/0 (socket says 172.21.15.18:58258) 2024-09-19T09:13:38.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7f954f7fe640 1 -- 172.21.15.18:0/955533224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9550207500 msgr2=0x7f955020d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7f954f7fe640 1 --2- 172.21.15.18:0/955533224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9550207500 0x7f955020d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7f954f7fe640 1 -- 172.21.15.18:0/955533224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95500b4660 msgr2=0x7f9550206fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7f954f7fe640 1 --2- 172.21.15.18:0/955533224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95500b4660 0x7f9550206fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7f954f7fe640 1 -- 172.21.15.18:0/955533224 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9550154c90 con 0x7f955006e7c0 2024-09-19T09:13:38.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7f954ffff640 1 --2- 172.21.15.18:0/955533224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9550207500 0x7f955020d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:13:38.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.389+0000 7f35fd7fa640 1 -- 172.21.15.18:0/2870773528 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35f8031bc0 con 0x7f36000b49d0 2024-09-19T09:13:38.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.389+0000 7f3605544640 1 -- 172.21.15.18:0/2870773528 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36000aee80 con 0x7f36000b49d0 2024-09-19T09:13:38.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.388+0000 7fbe2e7fc640 1 -- 172.21.15.18:0/3803111040 learned_addr learned my addr 172.21.15.18:0/3803111040 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:38.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.389+0000 7fbe2e7fc640 1 -- 172.21.15.18:0/3803111040 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe280e6fb0 msgr2=0x7fbe28006230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:38.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.389+0000 7f6396ffd640 1 --2- 172.21.15.18:0/306402747 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6398072a30 0x7f63980aecb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6398071640 tx=0x7f63900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:38.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.389+0000 7fbe2e7fc640 1 --2- 172.21.15.18:0/3803111040 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe280e6fb0 0x7fbe28006230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.389+0000 7efcc27fc640 1 -- 172.21.15.18:0/4282584231 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc4040070 con 0x7efccc14cc40 2024-09-19T09:13:38.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.389+0000 7fbe2e7fc640 1 -- 172.21.15.18:0/3803111040 >> v1:172.21.15.162:6789/0 conn(0x7fbe28033a30 legacy=0x7fbe280eaba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.389+0000 7fbe2e7fc640 1 -- 172.21.15.18:0/3803111040 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe28005bd0 con 0x7fbe28047c40 2024-09-19T09:13:38.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.389+0000 7efcc27fc640 1 -- 172.21.15.18:0/4282584231 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcc4030b60 con 0x7efccc14cc40 2024-09-19T09:13:38.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.389+0000 7efcd3af1640 1 -- 172.21.15.18:0/4282584231 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efccc144d30 con 0x7efccc14cc40 2024-09-19T09:13:38.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.389+0000 7f638ffff640 1 -- 172.21.15.18:0/306402747 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6390041070 con 0x7f6398072a30 2024-09-19T09:13:38.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.389+0000 7f638ffff640 1 -- 172.21.15.18:0/306402747 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f639003c970 con 0x7f6398072a30 2024-09-19T09:13:38.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.389+0000 7f639ced9640 1 -- 172.21.15.18:0/306402747 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6398156ca0 con 0x7f6398072a30 2024-09-19T09:13:38.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.389+0000 7f639ced9640 1 -- 172.21.15.18:0/306402747 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6398154e10 con 0x7f6398072a30 2024-09-19T09:13:38.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.390+0000 7f35fd7fa640 1 -- 172.21.15.18:0/2870773528 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f8009450 con 0x7f36000b49d0 2024-09-19T09:13:38.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.390+0000 7f954f7fe640 1 --2- 172.21.15.18:0/955533224 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f955006e7c0 0x7f9550159550 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9540031000 tx=0x7f95400046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:38.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.390+0000 7efcc27fc640 1 -- 172.21.15.18:0/4282584231 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc4009450 con 0x7efccc14cc40 2024-09-19T09:13:38.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.390+0000 7efcd3af1640 1 -- 172.21.15.18:0/4282584231 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efccc1452f0 con 0x7efccc14cc40 2024-09-19T09:13:38.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.390+0000 7f3605544640 1 -- 172.21.15.18:0/2870773528 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36000af440 con 0x7f36000b49d0 2024-09-19T09:13:38.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.391+0000 7f35fd7fa640 1 -- 172.21.15.18:0/2870773528 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f35f8039040 con 0x7f36000b49d0 2024-09-19T09:13:38.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.392+0000 7f35fd7fa640 1 --2- 172.21.15.18:0/2870773528 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f35e006c300 0x7f35e006e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.390+0000 7f638ffff640 1 -- 172.21.15.18:0/306402747 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6390037040 con 0x7f6398072a30 2024-09-19T09:13:38.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.392+0000 7f639ced9640 1 -- 172.21.15.18:0/306402747 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6398072e50 con 0x7f6398072a30 2024-09-19T09:13:38.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.392+0000 7f35f67fc640 1 -- 172.21.15.18:0/2870773528 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36000b2300 con 0x7f36000b49d0 2024-09-19T09:13:38.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.393+0000 7f35fd7fa640 1 -- 172.21.15.18:0/2870773528 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f35f80b1060 con 0x7f36000b49d0 2024-09-19T09:13:38.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.393+0000 7fbe2e7fc640 1 --2- 172.21.15.18:0/3803111040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe28047c40 0x7fbe28006770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbe30000b60 tx=0x7fbe300a6a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9f1203a233512ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:38.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.393+0000 7f35fffff640 1 --2- 172.21.15.18:0/2870773528 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f35e006c300 0x7f35e006e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.390+0000 7f9537fff640 1 -- 172.21.15.18:0/955533224 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9540041020 con 0x7f955006e7c0 2024-09-19T09:13:38.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.390+0000 7f9537fff640 1 -- 172.21.15.18:0/955533224 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f954003d620 con 0x7f955006e7c0 2024-09-19T09:13:38.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.390+0000 7f9537fff640 1 -- 172.21.15.18:0/955533224 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9540037040 con 0x7f955006e7c0 2024-09-19T09:13:38.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.390+0000 7f9555e7b640 1 -- 172.21.15.18:0/955533224 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9550154f70 con 0x7f955006e7c0 2024-09-19T09:13:38.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.390+0000 7f9555e7b640 1 -- 172.21.15.18:0/955533224 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9550155530 con 0x7f955006e7c0 2024-09-19T09:13:38.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.392+0000 7f9535ffb640 1 -- 172.21.15.18:0/955533224 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9528005290 con 0x7f955006e7c0 2024-09-19T09:13:38.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.393+0000 7efcd3af1640 1 -- 172.21.15.18:0/4282584231 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efccc0b5680 con 0x7efccc14cc40 2024-09-19T09:13:38.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.393+0000 7f9537fff640 1 -- 172.21.15.18:0/955533224 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9540044020 con 0x7f955006e7c0 2024-09-19T09:13:38.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.393+0000 7efcc27fc640 1 -- 172.21.15.18:0/4282584231 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efcc4039040 con 0x7efccc14cc40 2024-09-19T09:13:38.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.393+0000 7f638ffff640 1 -- 172.21.15.18:0/306402747 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6390044070 con 0x7f6398072a30 2024-09-19T09:13:38.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.394+0000 7f9537fff640 1 --2- 172.21.15.18:0/955533224 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f953c06c380 0x7f953c06e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.394+0000 7efcc27fc640 1 --2- 172.21.15.18:0/4282584231 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7efcb006c380 0x7efcb006e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.394+0000 7f9537fff640 1 -- 172.21.15.18:0/955533224 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f95400ab750 con 0x7f955006e7c0 2024-09-19T09:13:38.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.394+0000 7efcc27fc640 1 -- 172.21.15.18:0/4282584231 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7efcc40ac3c0 con 0x7efccc14cc40 2024-09-19T09:13:38.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.394+0000 7f638ffff640 1 --2- 172.21.15.18:0/306402747 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f637806c4b0 0x7f637806e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.394+0000 7f638ffff640 1 -- 172.21.15.18:0/306402747 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f639003cb20 con 0x7f6398072a30 2024-09-19T09:13:38.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.394+0000 7efcd188d640 1 --2- 172.21.15.18:0/4282584231 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7efcb006c380 0x7efcb006e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.394+0000 7f63977fe640 1 --2- 172.21.15.18:0/306402747 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f637806c4b0 0x7f637806e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.394+0000 7f35fffff640 1 --2- 172.21.15.18:0/2870773528 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f35e006c300 0x7f35e006e7c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f35e8000f60 tx=0x7f35e8007b50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:38.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.394+0000 7f954effd640 1 --2- 172.21.15.18:0/955533224 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f953c06c380 0x7f953c06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.395+0000 7efcd188d640 1 --2- 172.21.15.18:0/4282584231 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7efcb006c380 0x7efcb006e840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0099a0 tx=0x7efcbc006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:38.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.395+0000 7f63977fe640 1 --2- 172.21.15.18:0/306402747 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f637806c4b0 0x7f637806e970 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6388007fd0 tx=0x7f6388009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:38.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.395+0000 7f954effd640 1 --2- 172.21.15.18:0/955533224 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f953c06c380 0x7f953c06e840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9550163190 tx=0x7f9544009240 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:38.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.398+0000 7fbe2dffb640 1 -- 172.21.15.18:0/3803111040 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe300af070 con 0x7fbe28047c40 2024-09-19T09:13:38.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.398+0000 7fbe2dffb640 1 -- 172.21.15.18:0/3803111040 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe300ab920 con 0x7fbe28047c40 2024-09-19T09:13:38.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.398+0000 7f35fd7fa640 1 -- 172.21.15.18:0/2870773528 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f36000b2300 con 0x7f36000b49d0 2024-09-19T09:13:38.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.398+0000 7f9537fff640 1 -- 172.21.15.18:0/955533224 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f954004b030 con 0x7f955006e7c0 2024-09-19T09:13:38.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.399+0000 7fbe35865640 1 -- 172.21.15.18:0/3803111040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe28047c40 msgr2=0x7fbe28006770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.399+0000 7fbe35865640 1 --2- 172.21.15.18:0/3803111040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe28047c40 0x7fbe28006770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbe30000b60 tx=0x7fbe300a6a00 comp rx=0 tx=0).stop 2024-09-19T09:13:38.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.399+0000 7fbe35865640 1 -- 172.21.15.18:0/3803111040 shutdown_connections 2024-09-19T09:13:38.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.399+0000 7fbe35865640 1 --2- 172.21.15.18:0/3803111040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe28047c40 0x7fbe28006770 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.399+0000 7fbe35865640 1 --2- 172.21.15.18:0/3803111040 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe280e6fb0 0x7fbe28006230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.399+0000 7fbe35865640 1 -- 172.21.15.18:0/3803111040 >> 172.21.15.18:0/3803111040 conn(0x7fbe2801d960 msgr2=0x7fbe280545d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:38.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.399+0000 7fbe35865640 1 -- 172.21.15.18:0/3803111040 shutdown_connections 2024-09-19T09:13:38.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.400+0000 7f638ffff640 1 -- 172.21.15.18:0/306402747 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6390079ef0 con 0x7f6398072a30 2024-09-19T09:13:38.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.399+0000 7fbe35865640 1 -- 172.21.15.18:0/3803111040 wait complete. 2024-09-19T09:13:38.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.401+0000 7fbe35865640 1 Processor -- start 2024-09-19T09:13:38.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.402+0000 7fbe35865640 1 -- start start 2024-09-19T09:13:38.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.403+0000 7fbe35865640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe28033a30 0x7fbe280cd950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.404+0000 7fbe35865640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe28047c40 0x7fbe280cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.404+0000 7efcc27fc640 1 -- 172.21.15.18:0/4282584231 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7efcc407ac30 con 0x7efccc14cc40 2024-09-19T09:13:38.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.404+0000 7fbe2effd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe28033a30 0x7fbe280cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.404+0000 7fbe2effd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe28033a30 0x7fbe280cd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:42470/0 (socket says 172.21.15.18:42470) 2024-09-19T09:13:38.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.404+0000 7fbe2effd640 1 -- 172.21.15.18:0/3651294757 learned_addr learned my addr 172.21.15.18:0/3651294757 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:38.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.404+0000 7fbe35865640 1 --2- 172.21.15.18:0/3651294757 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe280e6fb0 0x7fbe280cfa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.404+0000 7fbe2e7fc640 1 --2- 172.21.15.18:0/3651294757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe28047c40 0x7fbe280cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.405+0000 7fbe2f7fe640 1 --2- 172.21.15.18:0/3651294757 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe280e6fb0 0x7fbe280cfa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.405+0000 7fbe35865640 1 -- 172.21.15.18:0/3651294757 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbe280e7390 con 0x7fbe280e6fb0 2024-09-19T09:13:38.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.405+0000 7fbe35865640 1 -- 172.21.15.18:0/3651294757 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbe28006cb0 con 0x7fbe28047c40 2024-09-19T09:13:38.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.405+0000 7fbe35865640 1 -- 172.21.15.18:0/3651294757 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbe28050530 con 0x7fbe28033a30 2024-09-19T09:13:38.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.406+0000 7fbe2effd640 1 -- 172.21.15.18:0/3651294757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe28047c40 msgr2=0x7fbe280cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.406+0000 7fbe2effd640 1 --2- 172.21.15.18:0/3651294757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe28047c40 0x7fbe280cf4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.406+0000 7fbe2effd640 1 -- 172.21.15.18:0/3651294757 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe280e6fb0 msgr2=0x7fbe280cfa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.406+0000 7fbe2effd640 1 --2- 172.21.15.18:0/3651294757 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe280e6fb0 0x7fbe280cfa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.406+0000 7fbe2effd640 1 -- 172.21.15.18:0/3651294757 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe2804f770 con 0x7fbe28033a30 2024-09-19T09:13:38.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.406+0000 7fbe2effd640 1 --2- 172.21.15.18:0/3651294757 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe28033a30 0x7fbe280cd950 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400d800 tx=0x7fbe2400dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:38.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.406+0000 7fbe17fff640 1 -- 172.21.15.18:0/3651294757 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe240096a0 con 0x7fbe28033a30 2024-09-19T09:13:38.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.406+0000 7fbe17fff640 1 -- 172.21.15.18:0/3651294757 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe24019070 con 0x7fbe28033a30 2024-09-19T09:13:38.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.406+0000 7fbe17fff640 1 -- 172.21.15.18:0/3651294757 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe24009a40 con 0x7fbe28033a30 2024-09-19T09:13:38.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.407+0000 7fbe35865640 1 -- 172.21.15.18:0/3651294757 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe2804fa50 con 0x7fbe28033a30 2024-09-19T09:13:38.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.407+0000 7fbe35865640 1 -- 172.21.15.18:0/3651294757 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe28050010 con 0x7fbe28033a30 2024-09-19T09:13:38.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.408+0000 7fbe35865640 1 -- 172.21.15.18:0/3651294757 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe28006230 con 0x7fbe28033a30 2024-09-19T09:13:38.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.410+0000 7fbe17fff640 1 -- 172.21.15.18:0/3651294757 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbe24009be0 con 0x7fbe28033a30 2024-09-19T09:13:38.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.411+0000 7fbe17fff640 1 --2- 172.21.15.18:0/3651294757 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbe1c06c380 0x7fbe1c06e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.411+0000 7fbe17fff640 1 -- 172.21.15.18:0/3651294757 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fbe2408b9f0 con 0x7fbe28033a30 2024-09-19T09:13:38.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.411+0000 7fbe2e7fc640 1 --2- 172.21.15.18:0/3651294757 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbe1c06c380 0x7fbe1c06e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.412+0000 7fbe2e7fc640 1 --2- 172.21.15.18:0/3651294757 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbe1c06c380 0x7fbe1c06e840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbe2800bdf0 tx=0x7fbe3006e030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:38.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.414+0000 7fbe17fff640 1 -- 172.21.15.18:0/3651294757 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fbe24059af0 con 0x7fbe28033a30 2024-09-19T09:13:38.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.419+0000 7ff26e9f8640 1 Processor -- start 2024-09-19T09:13:38.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.420+0000 7ff26e9f8640 1 -- start start 2024-09-19T09:13:38.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.421+0000 7ff26e9f8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff26815c840 0x7ff2680b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.421+0000 7ff26e9f8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff2680725b0 0x7ff268072a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.421+0000 7ff26e9f8640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2681626b0 con 0x7ff26815f340 2024-09-19T09:13:38.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.421+0000 7ff26e9f8640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7ff268072f60 con 0x7ff2680725b0 2024-09-19T09:13:38.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.421+0000 7ff26e9f8640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff2680b5eb0 con 0x7ff26815c840 2024-09-19T09:13:38.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.421+0000 7ff26cf95640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff26815f340 0x7ff26815f770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:42434/0 (socket says 172.21.15.18:42434) 2024-09-19T09:13:38.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.422+0000 7ff26cf95640 1 -- 172.21.15.18:0/1480268167 learned_addr learned my addr 172.21.15.18:0/1480268167 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:38.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.422+0000 7ff267fff640 1 --2- 172.21.15.18:0/1480268167 >> v2:172.21.15.162:3300/0 conn(0x7ff26815c840 0x7ff2680b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.422+0000 7ff2677fe640 1 --2- 172.21.15.18:0/1480268167 >> v2:172.21.15.18:3300/0 conn(0x7ff2680725b0 0x7ff268072a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.422+0000 7ff267fff640 1 -- 172.21.15.18:0/1480268167 >> v2:172.21.15.18:3300/0 conn(0x7ff2680725b0 msgr2=0x7ff268072a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:38.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.422+0000 7ff267fff640 1 --2- 172.21.15.18:0/1480268167 >> v2:172.21.15.18:3300/0 conn(0x7ff2680725b0 0x7ff268072a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.422+0000 7ff267fff640 1 -- 172.21.15.18:0/1480268167 >> v1:172.21.15.18:6789/0 conn(0x7ff26815f340 legacy=0x7ff26815f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.422+0000 7ff267fff640 1 -- 172.21.15.18:0/1480268167 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2680b6190 con 0x7ff26815c840 2024-09-19T09:13:38.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.422+0000 7fd756d98640 1 Processor -- start 2024-09-19T09:13:38.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.422+0000 7fd756d98640 1 -- start start 2024-09-19T09:13:38.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.424+0000 7ff267fff640 1 --2- 172.21.15.18:0/1480268167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff26815c840 0x7ff2680b55d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff268050020 tx=0x7ff25c02a0b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ff85840b2f4e35d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:38.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.424+0000 7ff266ffd640 1 -- 172.21.15.18:0/1480268167 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25c037070 con 0x7ff26815c840 2024-09-19T09:13:38.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.424+0000 7ff266ffd640 1 -- 172.21.15.18:0/1480268167 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff25c02ad40 con 0x7ff26815c840 2024-09-19T09:13:38.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.424+0000 7fd756d98640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd75015b020 0x7fd7500d1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.424+0000 7fd756d98640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd75006cec0 0x7fd7500b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.425+0000 7fd74ffff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd75006cec0 0x7fd7500b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.425+0000 7fd74ffff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd75006cec0 0x7fd7500b3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:58290/0 (socket says 172.21.15.18:58290) 2024-09-19T09:13:38.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.425+0000 7fd755335640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd75006bc10 0x7fd75006c020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:42444/0 (socket says 172.21.15.18:42444) 2024-09-19T09:13:38.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.425+0000 7fd74ffff640 1 -- 172.21.15.18:0/2976375477 learned_addr learned my addr 172.21.15.18:0/2976375477 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:38.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.425+0000 7ff26e9f8640 1 -- 172.21.15.18:0/1480268167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff26815c840 msgr2=0x7ff2680b55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.425+0000 7ff26e9f8640 1 --2- 172.21.15.18:0/1480268167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff26815c840 0x7ff2680b55d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff268050020 tx=0x7ff25c02a0b0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.425+0000 7ff26e9f8640 1 -- 172.21.15.18:0/1480268167 shutdown_connections 2024-09-19T09:13:38.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.425+0000 7ff26e9f8640 1 --2- 172.21.15.18:0/1480268167 >> v2:172.21.15.18:3300/0 conn(0x7ff2680725b0 0x7ff268072a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.425+0000 7ff26e9f8640 1 --2- 172.21.15.18:0/1480268167 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff26815c840 0x7ff2680b55d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.425+0000 7ff26e9f8640 1 -- 172.21.15.18:0/1480268167 >> 172.21.15.18:0/1480268167 conn(0x7ff2680d1970 msgr2=0x7ff2680d1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:38.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.426+0000 7fd754b34640 1 --2- 172.21.15.18:0/2976375477 >> v2:172.21.15.18:3300/0 conn(0x7fd75015b020 0x7fd7500d1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.426+0000 7ff26e9f8640 1 -- 172.21.15.18:0/1480268167 shutdown_connections 2024-09-19T09:13:38.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.426+0000 7ff26e9f8640 1 -- 172.21.15.18:0/1480268167 wait complete. 2024-09-19T09:13:38.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.426+0000 7fd756d98640 1 -- 172.21.15.18:0/2976375477 --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd75006d550 con 0x7fd75006bc10 2024-09-19T09:13:38.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.426+0000 7fd756d98640 1 -- 172.21.15.18:0/2976375477 --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fd75006d330 con 0x7fd75015b020 2024-09-19T09:13:38.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.426+0000 7fd756d98640 1 -- 172.21.15.18:0/2976375477 --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd7500b3ca0 con 0x7fd75006cec0 2024-09-19T09:13:38.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.426+0000 7fd74f7fe640 1 -- 172.21.15.18:0/2976375477 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1364683486 0 0) 0x7fd75006d550 con 0x7fd75006bc10 2024-09-19T09:13:38.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.426+0000 7fd74f7fe640 1 -- 172.21.15.18:0/2976375477 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd740003520 con 0x7fd75006bc10 2024-09-19T09:13:38.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.426+0000 7fd74f7fe640 1 -- 172.21.15.18:0/2976375477 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3690802938 0 0) 0x7fd740003520 con 0x7fd75006bc10 2024-09-19T09:13:38.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.426+0000 7fd74f7fe640 1 -- 172.21.15.18:0/2976375477 >> v2:172.21.15.162:3300/0 conn(0x7fd75006cec0 msgr2=0x7fd7500b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:38.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.426+0000 7fd74f7fe640 1 --2- 172.21.15.18:0/2976375477 >> v2:172.21.15.162:3300/0 conn(0x7fd75006cec0 0x7fd7500b3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.427+0000 7fd74f7fe640 1 -- 172.21.15.18:0/2976375477 >> v2:172.21.15.18:3300/0 conn(0x7fd75015b020 msgr2=0x7fd7500d1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:38.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.427+0000 7fd74f7fe640 1 --2- 172.21.15.18:0/2976375477 >> v2:172.21.15.18:3300/0 conn(0x7fd75015b020 0x7fd7500d1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.427+0000 7fd74f7fe640 1 -- 172.21.15.18:0/2976375477 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7500d0d80 con 0x7fd75006bc10 2024-09-19T09:13:38.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.427+0000 7fd74f7fe640 1 -- 172.21.15.18:0/2976375477 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fd7480019f0 con 0x7fd75006bc10 2024-09-19T09:13:38.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.427+0000 7fd74f7fe640 1 -- 172.21.15.18:0/2976375477 >> v1:172.21.15.18:6789/0 conn(0x7fd75006bc10 legacy=0x7fd75006c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.427+0000 7fd74f7fe640 1 --2- 172.21.15.18:0/2976375477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7400039b0 0x7fd740003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.427+0000 7fd74f7fe640 1 --2- 172.21.15.18:0/2976375477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd740004800 0x7fd740004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.427+0000 7fd74f7fe640 1 --2- 172.21.15.18:0/2976375477 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7400051c0 0x7fd74000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.427+0000 7fd74f7fe640 1 -- 172.21.15.18:0/2976375477 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd75006d330 con 0x7fd740004800 2024-09-19T09:13:38.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.427+0000 7fd74f7fe640 1 -- 172.21.15.18:0/2976375477 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd7500b3ca0 con 0x7fd7400039b0 2024-09-19T09:13:38.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.427+0000 7fd74f7fe640 1 -- 172.21.15.18:0/2976375477 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd74000c000 con 0x7fd7400051c0 2024-09-19T09:13:38.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.427+0000 7fd74ffff640 1 --2- 172.21.15.18:0/2976375477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd740004800 0x7fd740004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.427+0000 7fd74ffff640 1 -- 172.21.15.18:0/2976375477 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7400051c0 msgr2=0x7fd74000b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:13:38.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.427+0000 7fd74ffff640 1 --2- 172.21.15.18:0/2976375477 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7400051c0 0x7fd74000b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.428+0000 7fd74ffff640 1 -- 172.21.15.18:0/2976375477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7400039b0 msgr2=0x7fd740003dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:13:38.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.428+0000 7fd74ffff640 1 --2- 172.21.15.18:0/2976375477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd7400039b0 0x7fd740003dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.428+0000 7fd74ffff640 1 -- 172.21.15.18:0/2976375477 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7500d0d80 con 0x7fd740004800 2024-09-19T09:13:38.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.428+0000 7fd755335640 1 -- 172.21.15.18:0/2976375477 reap_dead start 2024-09-19T09:13:38.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.428+0000 7ff26e9f8640 1 Processor -- start 2024-09-19T09:13:38.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.428+0000 7ff26e9f8640 1 -- start start 2024-09-19T09:13:38.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.429+0000 7ff26e9f8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2680725b0 0x7ff26815de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.429+0000 7ff26e9f8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff26815c840 0x7ff268201470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.430+0000 7ff26e9f8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff26815f340 0x7ff26806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.430+0000 7ff2677fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff26815c840 0x7ff268201470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.430+0000 7ff2677fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff26815c840 0x7ff268201470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:58296/0 (socket says 172.21.15.18:58296) 2024-09-19T09:13:38.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.429+0000 7fd74ffff640 1 --2- 172.21.15.18:0/2976375477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd740004800 0x7fd740004c80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd744006ef0 tx=0x7fd740005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d65470932a2802e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:38.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.429+0000 7fd74f7fe640 1 -- 172.21.15.18:0/2976375477 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd744041070 con 0x7fd740004800 2024-09-19T09:13:38.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.429+0000 7fd74f7fe640 1 -- 172.21.15.18:0/2976375477 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd74403c600 con 0x7fd740004800 2024-09-19T09:13:38.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.429+0000 7fd74f7fe640 1 -- 172.21.15.18:0/2976375477 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd74400e850 con 0x7fd740004800 2024-09-19T09:13:38.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.430+0000 7ff26cf95640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff26815f340 0x7ff26806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.430+0000 7ff26cf95640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff26815f340 0x7ff26806bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36646/0 (socket says 172.21.15.18:36646) 2024-09-19T09:13:38.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.430+0000 7ff2677fe640 1 -- 172.21.15.18:0/4231094692 learned_addr learned my addr 172.21.15.18:0/4231094692 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:38.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.430+0000 7ff26e9f8640 1 -- 172.21.15.18:0/4231094692 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff26806ea10 con 0x7ff26815f340 2024-09-19T09:13:38.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.430+0000 7ff26e9f8640 1 -- 172.21.15.18:0/4231094692 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff26806e730 con 0x7ff26815c840 2024-09-19T09:13:38.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.431+0000 7ff26e9f8640 1 -- 172.21.15.18:0/4231094692 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff26815cc20 con 0x7ff2680725b0 2024-09-19T09:13:38.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.431+0000 7fd756d98640 1 -- 172.21.15.18:0/2976375477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd740004800 msgr2=0x7fd740004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.431+0000 7fd756d98640 1 --2- 172.21.15.18:0/2976375477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd740004800 0x7fd740004c80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd744006ef0 tx=0x7fd740005830 comp rx=0 tx=0).stop 2024-09-19T09:13:38.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.431+0000 7fd756d98640 1 -- 172.21.15.18:0/2976375477 shutdown_connections 2024-09-19T09:13:38.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.431+0000 7fd756d98640 1 --2- 172.21.15.18:0/2976375477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd740004800 0x7fd740004c80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.431+0000 7fd756d98640 1 -- 172.21.15.18:0/2976375477 >> 172.21.15.18:0/2976375477 conn(0x7fd7500b5eb0 msgr2=0x7fd7500b6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:38.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.431+0000 7fd756d98640 1 -- 172.21.15.18:0/2976375477 shutdown_connections 2024-09-19T09:13:38.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.431+0000 7ff26cf95640 1 -- 172.21.15.18:0/4231094692 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2680725b0 msgr2=0x7ff26815de10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T09:13:38.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.431+0000 7ff26cf95640 1 --2- 172.21.15.18:0/4231094692 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2680725b0 0x7ff26815de10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.431+0000 7ff26cf95640 1 -- 172.21.15.18:0/4231094692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff26815c840 msgr2=0x7ff268201470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.431+0000 7ff26cf95640 1 --2- 172.21.15.18:0/4231094692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff26815c840 0x7ff268201470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.431+0000 7ff26cf95640 1 -- 172.21.15.18:0/4231094692 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff268155970 con 0x7ff26815f340 2024-09-19T09:13:38.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.432+0000 7ff26cf95640 1 --2- 172.21.15.18:0/4231094692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff26815f340 0x7ff26806bc10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff26000ced0 tx=0x7ff26000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:38.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.432+0000 7ff264ff9640 1 -- 172.21.15.18:0/4231094692 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff260017070 con 0x7ff26815f340 2024-09-19T09:13:38.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.433+0000 7ff26e9f8640 1 -- 172.21.15.18:0/4231094692 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff268155c50 con 0x7ff26815f340 2024-09-19T09:13:38.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.431+0000 7fd756d98640 1 -- 172.21.15.18:0/2976375477 wait complete. 2024-09-19T09:13:38.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.433+0000 7fd756d98640 1 Processor -- start 2024-09-19T09:13:38.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.434+0000 7fd756d98640 1 -- start start 2024-09-19T09:13:38.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.435+0000 7fd756d98640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd740004800 0x7fd75015c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.435+0000 7fd756d98640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd750201ae0 0x7fd7500ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.435+0000 7ff26e9f8640 1 -- 172.21.15.18:0/4231094692 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff26815e350 con 0x7ff26815f340 2024-09-19T09:13:38.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.436+0000 7fd74ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd750201ae0 0x7fd7500ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.436+0000 7fd74ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd750201ae0 0x7fd7500ce060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36650/0 (socket says 172.21.15.18:36650) 2024-09-19T09:13:38.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.436+0000 7fd754b34640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd740004800 0x7fd75015c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.436+0000 7fd754b34640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd740004800 0x7fd75015c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:58306/0 (socket says 172.21.15.18:58306) 2024-09-19T09:13:38.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.436+0000 7fd74ffff640 1 -- 172.21.15.18:0/4257909154 learned_addr learned my addr 172.21.15.18:0/4257909154 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:38.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.436+0000 7fd756d98640 1 --2- 172.21.15.18:0/4257909154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7502008a0 0x7fd75015e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.436+0000 7fd756d98640 1 -- 172.21.15.18:0/4257909154 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd7500d1620 con 0x7fd750201ae0 2024-09-19T09:13:38.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.436+0000 7fd756d98640 1 -- 172.21.15.18:0/4257909154 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd7500d1340 con 0x7fd740004800 2024-09-19T09:13:38.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.436+0000 7fd756d98640 1 -- 172.21.15.18:0/4257909154 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd75015b400 con 0x7fd7502008a0 2024-09-19T09:13:38.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.436+0000 7fd755335640 1 --2- 172.21.15.18:0/4257909154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7502008a0 0x7fd75015e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.437+0000 7ff264ff9640 1 -- 172.21.15.18:0/4231094692 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff260012400 con 0x7ff26815f340 2024-09-19T09:13:38.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.437+0000 7fd74ffff640 1 -- 172.21.15.18:0/4257909154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7502008a0 msgr2=0x7fd75015e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.437+0000 7fd74ffff640 1 --2- 172.21.15.18:0/4257909154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7502008a0 0x7fd75015e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.437+0000 7fd74ffff640 1 -- 172.21.15.18:0/4257909154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd740004800 msgr2=0x7fd75015c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.437+0000 7fd74ffff640 1 --2- 172.21.15.18:0/4257909154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd740004800 0x7fd75015c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.437+0000 7fd74ffff640 1 -- 172.21.15.18:0/4257909154 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7500ce5a0 con 0x7fd750201ae0 2024-09-19T09:13:38.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.437+0000 7fd74ffff640 1 --2- 172.21.15.18:0/4257909154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd750201ae0 0x7fd7500ce060 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd744032e30 tx=0x7fd744004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:38.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.438+0000 7fd755335640 1 --2- 172.21.15.18:0/4257909154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7502008a0 0x7fd75015e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:13:38.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.438+0000 7fd754b34640 1 --2- 172.21.15.18:0/4257909154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd740004800 0x7fd75015c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:13:38.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.438+0000 7fd74d7fa640 1 -- 172.21.15.18:0/4257909154 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd744041070 con 0x7fd750201ae0 2024-09-19T09:13:38.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.438+0000 7ff264ff9640 1 -- 172.21.15.18:0/4231094692 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2600127f0 con 0x7ff26815f340 2024-09-19T09:13:38.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.439+0000 7ff264ff9640 1 -- 172.21.15.18:0/4231094692 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff26001a070 con 0x7ff26815f340 2024-09-19T09:13:38.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.439+0000 7fd74d7fa640 1 -- 172.21.15.18:0/4257909154 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd74400e830 con 0x7fd750201ae0 2024-09-19T09:13:38.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.439+0000 7fd74d7fa640 1 -- 172.21.15.18:0/4257909154 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd744016d30 con 0x7fd750201ae0 2024-09-19T09:13:38.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.439+0000 7fd756d98640 1 -- 172.21.15.18:0/4257909154 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd75015ca70 con 0x7fd750201ae0 2024-09-19T09:13:38.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.439+0000 7ff264ff9640 1 --2- 172.21.15.18:0/4231094692 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff25406c3b0 0x7ff25406e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.440+0000 7ff264ff9640 1 -- 172.21.15.18:0/4231094692 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff260090060 con 0x7ff26815f340 2024-09-19T09:13:38.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.439+0000 7fd756d98640 1 -- 172.21.15.18:0/4257909154 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7500cd860 con 0x7fd750201ae0 2024-09-19T09:13:38.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.441+0000 7ff24e7fc640 1 -- 172.21.15.18:0/4231094692 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff248005290 con 0x7ff26815f340 2024-09-19T09:13:38.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.441+0000 7ff267fff640 1 --2- 172.21.15.18:0/4231094692 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff25406c3b0 0x7ff25406e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.442+0000 7fd756d98640 1 -- 172.21.15.18:0/4257909154 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd730005290 con 0x7fd750201ae0 2024-09-19T09:13:38.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.444+0000 7fd74d7fa640 1 -- 172.21.15.18:0/4257909154 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd74401d280 con 0x7fd750201ae0 2024-09-19T09:13:38.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.444+0000 7ff267fff640 1 --2- 172.21.15.18:0/4231094692 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff25406c3b0 0x7ff25406e870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff25c034000 tx=0x7ff25c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:38.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.445+0000 7fd74d7fa640 1 --2- 172.21.15.18:0/4257909154 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd73406c3b0 0x7fd73406e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.445+0000 7fd74d7fa640 1 -- 172.21.15.18:0/4257909154 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fd7440ab490 con 0x7fd750201ae0 2024-09-19T09:13:38.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.445+0000 7fd754b34640 1 --2- 172.21.15.18:0/4257909154 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd73406c3b0 0x7fd73406e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.446+0000 7fd754b34640 1 --2- 172.21.15.18:0/4257909154 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd73406c3b0 0x7fd73406e870 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd7501532f0 tx=0x7fd73c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:38.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.450+0000 7ff264ff9640 1 -- 172.21.15.18:0/4231094692 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff2600599f0 con 0x7ff26815f340 2024-09-19T09:13:38.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.459+0000 7fd74d7fa640 1 -- 172.21.15.18:0/4257909154 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd74401b070 con 0x7fd750201ae0 2024-09-19T09:13:38.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.749+0000 7fb1a8d2b640 1 -- 172.21.15.18:0/320174985 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb184005580 con 0x7fb1a40af690 2024-09-19T09:13:38.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.750+0000 7fb18bfff640 1 -- 172.21.15.18:0/320174985 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb19407a290 con 0x7fb1a40af690 2024-09-19T09:13:38.750 INFO:teuthology.orchestra.run.smithi018.stdout:55834574854 2024-09-19T09:13:38.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.754+0000 7fb189ffb640 1 -- 172.21.15.18:0/320174985 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb18c06c520 msgr2=0x7fb18c06e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.754+0000 7fb189ffb640 1 --2- 172.21.15.18:0/320174985 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb18c06c520 0x7fb18c06e9e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb1a414eef0 tx=0x7fb198009190 comp rx=0 tx=0).stop 2024-09-19T09:13:38.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.754+0000 7fb189ffb640 1 -- 172.21.15.18:0/320174985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1a40af690 msgr2=0x7fb1a40b1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.754+0000 7fb189ffb640 1 --2- 172.21.15.18:0/320174985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1a40af690 0x7fb1a40b1440 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb19402a7a0 tx=0x7fb1940046c0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.754+0000 7fb189ffb640 1 -- 172.21.15.18:0/320174985 shutdown_connections 2024-09-19T09:13:38.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.754+0000 7fb189ffb640 1 --2- 172.21.15.18:0/320174985 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb18c06c520 0x7fb18c06e9e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.754+0000 7fb189ffb640 1 --2- 172.21.15.18:0/320174985 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1a4148500 0x7fb1a4167d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.755+0000 7fb189ffb640 1 --2- 172.21.15.18:0/320174985 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1a415ae00 0x7fb1a40cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.755+0000 7fb189ffb640 1 --2- 172.21.15.18:0/320174985 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1a40af690 0x7fb1a40b1440 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.755+0000 7fb189ffb640 1 -- 172.21.15.18:0/320174985 >> 172.21.15.18:0/320174985 conn(0x7fb1a4068070 msgr2=0x7fb1a4072a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:38.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.755+0000 7fb189ffb640 1 -- 172.21.15.18:0/320174985 shutdown_connections 2024-09-19T09:13:38.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.755+0000 7fb189ffb640 1 -- 172.21.15.18:0/320174985 wait complete. 2024-09-19T09:13:38.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.2 2024-09-19T09:13:38.772 DEBUG:teuthology.parallel:result is None 2024-09-19T09:13:38.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.789+0000 7efcd3af1640 1 -- 172.21.15.18:0/4282584231 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7efccc06e700 con 0x7efccc14cc40 2024-09-19T09:13:38.790 INFO:teuthology.orchestra.run.smithi018.stdout:55834574854 2024-09-19T09:13:38.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.790+0000 7efcc27fc640 1 -- 172.21.15.18:0/4282584231 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efcc407a530 con 0x7efccc14cc40 2024-09-19T09:13:38.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.792+0000 7efcd3af1640 1 -- 172.21.15.18:0/4282584231 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7efcb006c380 msgr2=0x7efcb006e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.792+0000 7efcd3af1640 1 --2- 172.21.15.18:0/4282584231 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7efcb006c380 0x7efcb006e840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efcbc0099a0 tx=0x7efcbc006f90 comp rx=0 tx=0).stop 2024-09-19T09:13:38.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.792+0000 7efcd3af1640 1 -- 172.21.15.18:0/4282584231 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efccc14cc40 msgr2=0x7efccc0abb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.792+0000 7efcd3af1640 1 --2- 172.21.15.18:0/4282584231 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efccc14cc40 0x7efccc0abb30 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efcc4031000 tx=0x7efcc4004a40 comp rx=0 tx=0).stop 2024-09-19T09:13:38.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.792+0000 7efcd3af1640 1 -- 172.21.15.18:0/4282584231 shutdown_connections 2024-09-19T09:13:38.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.792+0000 7efcd3af1640 1 --2- 172.21.15.18:0/4282584231 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7efcb006c380 0x7efcb006e840 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.792+0000 7efcd3af1640 1 --2- 172.21.15.18:0/4282584231 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efccc14cc40 0x7efccc0abb30 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.792+0000 7efcd3af1640 1 --2- 172.21.15.18:0/4282584231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efccc0b47d0 0x7efccc1599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.792+0000 7efcd3af1640 1 --2- 172.21.15.18:0/4282584231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efccc06e180 0x7efccc145af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.792+0000 7efcd3af1640 1 -- 172.21.15.18:0/4282584231 >> 172.21.15.18:0/4282584231 conn(0x7efccc0b2630 msgr2=0x7efccc0cee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:38.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.792+0000 7f639ced9640 1 -- 172.21.15.18:0/306402747 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f63980b2380 con 0x7f6398072a30 2024-09-19T09:13:38.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.792+0000 7efcd3af1640 1 -- 172.21.15.18:0/4282584231 shutdown_connections 2024-09-19T09:13:38.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.792+0000 7efcd3af1640 1 -- 172.21.15.18:0/4282584231 wait complete. 2024-09-19T09:13:38.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.792+0000 7f638ffff640 1 -- 172.21.15.18:0/306402747 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f639007e1f0 con 0x7f6398072a30 2024-09-19T09:13:38.794 INFO:teuthology.orchestra.run.smithi018.stdout:55834574854 2024-09-19T09:13:38.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.796+0000 7f639ced9640 1 -- 172.21.15.18:0/306402747 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f637806c4b0 msgr2=0x7f637806e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.796+0000 7f639ced9640 1 --2- 172.21.15.18:0/306402747 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f637806c4b0 0x7f637806e970 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6388007fd0 tx=0x7f6388009040 comp rx=0 tx=0).stop 2024-09-19T09:13:38.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.796+0000 7f639ced9640 1 -- 172.21.15.18:0/306402747 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6398072a30 msgr2=0x7f63980aecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.796+0000 7f639ced9640 1 --2- 172.21.15.18:0/306402747 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6398072a30 0x7f63980aecb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f6398071640 tx=0x7f63900046c0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.796+0000 7f639ced9640 1 -- 172.21.15.18:0/306402747 shutdown_connections 2024-09-19T09:13:38.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.796+0000 7f639ced9640 1 --2- 172.21.15.18:0/306402747 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f637806c4b0 0x7f637806e970 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.796+0000 7f639ced9640 1 --2- 172.21.15.18:0/306402747 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63980af690 0x7f639806df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.796+0000 7f639ced9640 1 --2- 172.21.15.18:0/306402747 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6398072a30 0x7f63980aecb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.797+0000 7f639ced9640 1 --2- 172.21.15.18:0/306402747 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f639806c3c0 0x7f6398155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.797+0000 7f639ced9640 1 -- 172.21.15.18:0/306402747 >> 172.21.15.18:0/306402747 conn(0x7f6398068070 msgr2=0x7f639815bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:38.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.797+0000 7f639ced9640 1 -- 172.21.15.18:0/306402747 shutdown_connections 2024-09-19T09:13:38.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.797+0000 7f639ced9640 1 -- 172.21.15.18:0/306402747 wait complete. 2024-09-19T09:13:38.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.800+0000 7f9535ffb640 1 -- 172.21.15.18:0/955533224 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f9528005580 con 0x7f955006e7c0 2024-09-19T09:13:38.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.801+0000 7f9537fff640 1 -- 172.21.15.18:0/955533224 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9540079850 con 0x7f955006e7c0 2024-09-19T09:13:38.804 INFO:teuthology.orchestra.run.smithi018.stdout:55834574854 2024-09-19T09:13:38.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.804+0000 7f35f67fc640 1 -- 172.21.15.18:0/2870773528 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f36000b4490 con 0x7f36000b49d0 2024-09-19T09:13:38.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.804+0000 7f9535ffb640 1 -- 172.21.15.18:0/955533224 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f953c06c380 msgr2=0x7f953c06e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.804+0000 7f9535ffb640 1 --2- 172.21.15.18:0/955533224 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f953c06c380 0x7f953c06e840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9550163190 tx=0x7f9544009240 comp rx=0 tx=0).stop 2024-09-19T09:13:38.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.804+0000 7f9535ffb640 1 -- 172.21.15.18:0/955533224 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f955006e7c0 msgr2=0x7f9550159550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.804+0000 7f9535ffb640 1 --2- 172.21.15.18:0/955533224 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f955006e7c0 0x7f9550159550 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9540031000 tx=0x7f95400046c0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.804+0000 7f9535ffb640 1 -- 172.21.15.18:0/955533224 shutdown_connections 2024-09-19T09:13:38.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.804+0000 7f9535ffb640 1 --2- 172.21.15.18:0/955533224 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f953c06c380 0x7f953c06e840 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.804+0000 7f9535ffb640 1 --2- 172.21.15.18:0/955533224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9550207500 0x7f955020d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.804+0000 7f9535ffb640 1 --2- 172.21.15.18:0/955533224 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95500b4660 0x7f9550206fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.804+0000 7f9535ffb640 1 --2- 172.21.15.18:0/955533224 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f955006e7c0 0x7f9550159550 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.804+0000 7f9535ffb640 1 -- 172.21.15.18:0/955533224 >> 172.21.15.18:0/955533224 conn(0x7f95500b2630 msgr2=0x7f9550071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:38.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.804+0000 7f9535ffb640 1 -- 172.21.15.18:0/955533224 shutdown_connections 2024-09-19T09:13:38.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.804+0000 7f35fd7fa640 1 -- 172.21.15.18:0/2870773528 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f35f807ad30 con 0x7f36000b49d0 2024-09-19T09:13:38.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.804+0000 7f9535ffb640 1 -- 172.21.15.18:0/955533224 wait complete. 2024-09-19T09:13:38.806 INFO:teuthology.orchestra.run.smithi018.stdout:55834574854 2024-09-19T09:13:38.807 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.3 2024-09-19T09:13:38.807 DEBUG:teuthology.parallel:result is None 2024-09-19T09:13:38.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.808+0000 7f35f67fc640 1 -- 172.21.15.18:0/2870773528 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f35e006c300 msgr2=0x7f35e006e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.808+0000 7f35f67fc640 1 --2- 172.21.15.18:0/2870773528 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f35e006c300 0x7f35e006e7c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f35e8000f60 tx=0x7f35e8007b50 comp rx=0 tx=0).stop 2024-09-19T09:13:38.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.808+0000 7f35f67fc640 1 -- 172.21.15.18:0/2870773528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36000b49d0 msgr2=0x7f3600165920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.808+0000 7f35f67fc640 1 --2- 172.21.15.18:0/2870773528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36000b49d0 0x7f3600165920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f360006c770 tx=0x7f35f8004a40 comp rx=0 tx=0).stop 2024-09-19T09:13:38.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.808+0000 7f35f67fc640 1 -- 172.21.15.18:0/2870773528 shutdown_connections 2024-09-19T09:13:38.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.808+0000 7f35f67fc640 1 --2- 172.21.15.18:0/2870773528 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f35e006c300 0x7f35e006e7c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.808+0000 7f35f67fc640 1 --2- 172.21.15.18:0/2870773528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36000b49d0 0x7f3600165920 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.808+0000 7f35f67fc640 1 --2- 172.21.15.18:0/2870773528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36000b40b0 0x7f36000ae130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.808+0000 7f35f67fc640 1 --2- 172.21.15.18:0/2870773528 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3600073280 0x7f3600153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.808+0000 7f35f67fc640 1 -- 172.21.15.18:0/2870773528 >> 172.21.15.18:0/2870773528 conn(0x7f3600068070 msgr2=0x7f3600072610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:38.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.809+0000 7f35f67fc640 1 -- 172.21.15.18:0/2870773528 shutdown_connections 2024-09-19T09:13:38.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.809+0000 7f35f67fc640 1 -- 172.21.15.18:0/2870773528 wait complete. 2024-09-19T09:13:38.815 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.1 2024-09-19T09:13:38.815 DEBUG:teuthology.parallel:result is None 2024-09-19T09:13:38.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.817+0000 7fbe35865640 1 -- 172.21.15.18:0/3651294757 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fbe2803a470 con 0x7fbe28033a30 2024-09-19T09:13:38.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.817+0000 7fbe17fff640 1 -- 172.21.15.18:0/3651294757 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbe2405ddf0 con 0x7fbe28033a30 2024-09-19T09:13:38.818 INFO:teuthology.orchestra.run.smithi018.stdout:55834574854 2024-09-19T09:13:38.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.819+0000 7fbe35865640 1 -- 172.21.15.18:0/3651294757 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbe1c06c380 msgr2=0x7fbe1c06e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.819+0000 7fbe35865640 1 --2- 172.21.15.18:0/3651294757 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbe1c06c380 0x7fbe1c06e840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbe2800bdf0 tx=0x7fbe3006e030 comp rx=0 tx=0).stop 2024-09-19T09:13:38.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.819+0000 7fbe35865640 1 -- 172.21.15.18:0/3651294757 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe28033a30 msgr2=0x7fbe280cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.819+0000 7fbe35865640 1 --2- 172.21.15.18:0/3651294757 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe28033a30 0x7fbe280cd950 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400d800 tx=0x7fbe2400dcc0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.820+0000 7fbe35865640 1 -- 172.21.15.18:0/3651294757 shutdown_connections 2024-09-19T09:13:38.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.820+0000 7fbe35865640 1 --2- 172.21.15.18:0/3651294757 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbe1c06c380 0x7fbe1c06e840 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.820+0000 7fbe35865640 1 --2- 172.21.15.18:0/3651294757 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe280e6fb0 0x7fbe280cfa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.820+0000 7fbe35865640 1 --2- 172.21.15.18:0/3651294757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe28047c40 0x7fbe280cf4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.820+0000 7fbe35865640 1 --2- 172.21.15.18:0/3651294757 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe28033a30 0x7fbe280cd950 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.820+0000 7fbe35865640 1 -- 172.21.15.18:0/3651294757 >> 172.21.15.18:0/3651294757 conn(0x7fbe2801d960 msgr2=0x7fbe28039660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:38.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.820+0000 7fbe35865640 1 -- 172.21.15.18:0/3651294757 shutdown_connections 2024-09-19T09:13:38.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.820+0000 7fbe35865640 1 -- 172.21.15.18:0/3651294757 wait complete. 2024-09-19T09:13:38.822 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.0 2024-09-19T09:13:38.822 DEBUG:teuthology.parallel:result is None 2024-09-19T09:13:38.825 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.7 2024-09-19T09:13:38.825 DEBUG:teuthology.parallel:result is None 2024-09-19T09:13:38.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.830+0000 7ff24e7fc640 1 -- 172.21.15.18:0/4231094692 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7ff248005850 con 0x7ff26815f340 2024-09-19T09:13:38.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.830+0000 7ff264ff9640 1 -- 172.21.15.18:0/4231094692 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff2600592f0 con 0x7ff26815f340 2024-09-19T09:13:38.831 INFO:teuthology.orchestra.run.smithi018.stdout:55834574854 2024-09-19T09:13:38.831 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.4 2024-09-19T09:13:38.832 DEBUG:teuthology.parallel:result is None 2024-09-19T09:13:38.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.832+0000 7ff24e7fc640 1 -- 172.21.15.18:0/4231094692 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff25406c3b0 msgr2=0x7ff25406e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.832+0000 7ff24e7fc640 1 --2- 172.21.15.18:0/4231094692 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff25406c3b0 0x7ff25406e870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff25c034000 tx=0x7ff25c02e000 comp rx=0 tx=0).stop 2024-09-19T09:13:38.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.832+0000 7ff24e7fc640 1 -- 172.21.15.18:0/4231094692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff26815f340 msgr2=0x7ff26806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.832+0000 7ff24e7fc640 1 --2- 172.21.15.18:0/4231094692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff26815f340 0x7ff26806bc10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff26000ced0 tx=0x7ff26000a430 comp rx=0 tx=0).stop 2024-09-19T09:13:38.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.832+0000 7ff24e7fc640 1 -- 172.21.15.18:0/4231094692 shutdown_connections 2024-09-19T09:13:38.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.832+0000 7ff24e7fc640 1 --2- 172.21.15.18:0/4231094692 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff25406c3b0 0x7ff25406e870 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.832+0000 7ff24e7fc640 1 --2- 172.21.15.18:0/4231094692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff26815f340 0x7ff26806bc10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.832+0000 7ff24e7fc640 1 --2- 172.21.15.18:0/4231094692 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff26815c840 0x7ff268201470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.832+0000 7ff24e7fc640 1 --2- 172.21.15.18:0/4231094692 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2680725b0 0x7ff26815de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.832+0000 7ff24e7fc640 1 -- 172.21.15.18:0/4231094692 >> 172.21.15.18:0/4231094692 conn(0x7ff2680d1970 msgr2=0x7ff2680b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:38.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.833+0000 7ff24e7fc640 1 -- 172.21.15.18:0/4231094692 shutdown_connections 2024-09-19T09:13:38.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.833+0000 7ff24e7fc640 1 -- 172.21.15.18:0/4231094692 wait complete. 2024-09-19T09:13:38.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.835+0000 7fd756d98640 1 -- 172.21.15.18:0/4257909154 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fd730005580 con 0x7fd750201ae0 2024-09-19T09:13:38.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.835+0000 7fd74d7fa640 1 -- 172.21.15.18:0/4257909154 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd744079d00 con 0x7fd750201ae0 2024-09-19T09:13:38.835 INFO:teuthology.orchestra.run.smithi018.stdout:55834574854 2024-09-19T09:13:38.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.837+0000 7fd756d98640 1 -- 172.21.15.18:0/4257909154 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd73406c3b0 msgr2=0x7fd73406e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.837+0000 7fd756d98640 1 --2- 172.21.15.18:0/4257909154 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd73406c3b0 0x7fd73406e870 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd7501532f0 tx=0x7fd73c008040 comp rx=0 tx=0).stop 2024-09-19T09:13:38.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.837+0000 7fd756d98640 1 -- 172.21.15.18:0/4257909154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd750201ae0 msgr2=0x7fd7500ce060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.837+0000 7fd756d98640 1 --2- 172.21.15.18:0/4257909154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd750201ae0 0x7fd7500ce060 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd744032e30 tx=0x7fd744004730 comp rx=0 tx=0).stop 2024-09-19T09:13:38.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.837+0000 7fd756d98640 1 -- 172.21.15.18:0/4257909154 shutdown_connections 2024-09-19T09:13:38.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.837+0000 7fd756d98640 1 --2- 172.21.15.18:0/4257909154 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd73406c3b0 0x7fd73406e870 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.837+0000 7fd756d98640 1 --2- 172.21.15.18:0/4257909154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd7502008a0 0x7fd75015e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.837+0000 7fd756d98640 1 --2- 172.21.15.18:0/4257909154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd750201ae0 0x7fd7500ce060 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.837+0000 7fd756d98640 1 --2- 172.21.15.18:0/4257909154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd740004800 0x7fd75015c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.837+0000 7fd756d98640 1 -- 172.21.15.18:0/4257909154 >> 172.21.15.18:0/4257909154 conn(0x7fd7500b5eb0 msgr2=0x7fd75006e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:38.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.837+0000 7fd756d98640 1 -- 172.21.15.18:0/4257909154 shutdown_connections 2024-09-19T09:13:38.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.837+0000 7fd756d98640 1 -- 172.21.15.18:0/4257909154 wait complete. 2024-09-19T09:13:38.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.5 2024-09-19T09:13:38.845 DEBUG:teuthology.parallel:result is None 2024-09-19T09:13:38.849 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574854 for osd.6 2024-09-19T09:13:38.849 DEBUG:teuthology.parallel:result is None 2024-09-19T09:13:38.850 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T09:13:38.850 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:13:38.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.992+0000 7f5ad0265640 1 Processor -- start 2024-09-19T09:13:38.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.992+0000 7f5ad0265640 1 -- start start 2024-09-19T09:13:38.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.993+0000 7f5ad0265640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ac80d1c70 0x7f5ac80cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.993+0000 7f5ad0265640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5ac80b5b00 0x7f5ac80cff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.993+0000 7f5ad0265640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ac80d31b0 con 0x7f5ac815ed50 2024-09-19T09:13:38.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.993+0000 7f5ad0265640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f5ac80d3490 con 0x7f5ac80b5b00 2024-09-19T09:13:38.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.993+0000 7f5ad0265640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5ac80d3770 con 0x7f5ac80d1c70 2024-09-19T09:13:38.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.993+0000 7f5ace001640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f5ac815ed50 0x7f5ac80d1560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:42448/0 (socket says 172.21.15.18:42448) 2024-09-19T09:13:38.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.993+0000 7f5ace001640 1 -- 172.21.15.18:0/1369387275 learned_addr learned my addr 172.21.15.18:0/1369387275 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:38.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.993+0000 7f5ace802640 1 --2- 172.21.15.18:0/1369387275 >> v2:172.21.15.18:3300/0 conn(0x7f5ac80b5b00 0x7f5ac80cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.993+0000 7f5acd800640 1 --2- 172.21.15.18:0/1369387275 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ac80d1c70 0x7f5ac80cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:38.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.994+0000 7f5ace802640 1 -- 172.21.15.18:0/1369387275 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ac80d1c70 msgr2=0x7f5ac80cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:38.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.994+0000 7f5ace802640 1 --2- 172.21.15.18:0/1369387275 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ac80d1c70 0x7f5ac80cf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.994+0000 7f5ace802640 1 -- 172.21.15.18:0/1369387275 >> v1:172.21.15.18:6789/0 conn(0x7f5ac815ed50 legacy=0x7f5ac80d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.994+0000 7f5accfff640 1 -- 172.21.15.18:0/1369387275 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1139703921 0 0) 0x7f5ac80d31b0 con 0x7f5ac815ed50 2024-09-19T09:13:38.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.994+0000 7f5ace802640 1 -- 172.21.15.18:0/1369387275 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac80d3a50 con 0x7f5ac80b5b00 2024-09-19T09:13:38.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.994+0000 7f5ace802640 1 --2- 172.21.15.18:0/1369387275 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ac80b5b00 0x7f5ac80cff00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0009d90 tx=0x7f5ac002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45fd06d5b5a4889a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:38.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.994+0000 7f5accfff640 1 -- 172.21.15.18:0/1369387275 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac0007740 con 0x7f5ac80b5b00 2024-09-19T09:13:38.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.994+0000 7f5accfff640 1 -- 172.21.15.18:0/1369387275 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ac00078e0 con 0x7f5ac80b5b00 2024-09-19T09:13:38.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.995+0000 7f5accfff640 1 -- 172.21.15.18:0/1369387275 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac0007cb0 con 0x7f5ac80b5b00 2024-09-19T09:13:38.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.995+0000 7f5ad0265640 1 -- 172.21.15.18:0/1369387275 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ac80b5b00 msgr2=0x7f5ac80cff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:38.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.995+0000 7f5ad0265640 1 --2- 172.21.15.18:0/1369387275 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ac80b5b00 0x7f5ac80cff00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0009d90 tx=0x7f5ac002a6f0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.995+0000 7f5ad0265640 1 -- 172.21.15.18:0/1369387275 shutdown_connections 2024-09-19T09:13:38.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.995+0000 7f5ad0265640 1 --2- 172.21.15.18:0/1369387275 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ac80b5b00 0x7f5ac80cff00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.995+0000 7f5ad0265640 1 --2- 172.21.15.18:0/1369387275 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ac80d1c70 0x7f5ac80cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:38.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.995+0000 7f5ad0265640 1 -- 172.21.15.18:0/1369387275 >> 172.21.15.18:0/1369387275 conn(0x7f5ac80d4bd0 msgr2=0x7f5ac80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:38.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.995+0000 7f5ad0265640 1 -- 172.21.15.18:0/1369387275 shutdown_connections 2024-09-19T09:13:38.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.995+0000 7f5ad0265640 1 -- 172.21.15.18:0/1369387275 wait complete. 2024-09-19T09:13:38.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.996+0000 7f5ad0265640 1 Processor -- start 2024-09-19T09:13:38.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.997+0000 7f5ad0265640 1 -- start start 2024-09-19T09:13:38.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.997+0000 7f5ad0265640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ac80b5b00 0x7f5ac80b8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.997+0000 7f5ad0265640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ac80d1c70 0x7f5ac80b9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.997+0000 7f5ad0265640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ac815ed50 0x7f5ac815f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:38.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.997+0000 7f5ad0265640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac815f130 con 0x7f5ac815ed50 2024-09-19T09:13:38.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.997+0000 7f5ad0265640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5ac80d3d30 con 0x7f5ac80d1c70 2024-09-19T09:13:39.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.997+0000 7f5ad0265640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5ac80ba350 con 0x7f5ac80b5b00 2024-09-19T09:13:39.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.997+0000 7f5ace802640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ac815ed50 0x7f5ac815f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:39.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.997+0000 7f5ace802640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ac815ed50 0x7f5ac815f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36670/0 (socket says 172.21.15.18:36670) 2024-09-19T09:13:39.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.997+0000 7f5ace802640 1 -- 172.21.15.18:0/2689777039 learned_addr learned my addr 172.21.15.18:0/2689777039 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:39.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.998+0000 7f5acd800640 1 --2- 172.21.15.18:0/2689777039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ac80d1c70 0x7f5ac80b9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:39.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.997+0000 7f5ace001640 1 --2- 172.21.15.18:0/2689777039 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ac80b5b00 0x7f5ac80b8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:39.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.998+0000 7f5ace802640 1 -- 172.21.15.18:0/2689777039 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ac80b5b00 msgr2=0x7f5ac80b8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:39.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.998+0000 7f5ace802640 1 --2- 172.21.15.18:0/2689777039 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ac80b5b00 0x7f5ac80b8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:39.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.998+0000 7f5ace802640 1 -- 172.21.15.18:0/2689777039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ac80d1c70 msgr2=0x7f5ac80b9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:39.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.998+0000 7f5ace802640 1 --2- 172.21.15.18:0/2689777039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ac80d1c70 0x7f5ac80b9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:39.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.998+0000 7f5ace802640 1 -- 172.21.15.18:0/2689777039 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac8160540 con 0x7f5ac815ed50 2024-09-19T09:13:39.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.998+0000 7f5ace802640 1 --2- 172.21.15.18:0/2689777039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ac815ed50 0x7f5ac815f860 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0009d90 tx=0x7f5ac0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:39.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.998+0000 7f5abe7fc640 1 -- 172.21.15.18:0/2689777039 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac0040070 con 0x7f5ac815ed50 2024-09-19T09:13:39.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.998+0000 7f5abe7fc640 1 -- 172.21.15.18:0/2689777039 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ac0031bc0 con 0x7f5ac815ed50 2024-09-19T09:13:39.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.998+0000 7f5ad0265640 1 -- 172.21.15.18:0/2689777039 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac80ba5a0 con 0x7f5ac815ed50 2024-09-19T09:13:39.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.998+0000 7f5abe7fc640 1 -- 172.21.15.18:0/2689777039 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac003c420 con 0x7f5ac815ed50 2024-09-19T09:13:39.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.998+0000 7f5ad0265640 1 -- 172.21.15.18:0/2689777039 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ac80b85b0 con 0x7f5ac815ed50 2024-09-19T09:13:39.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:38.999+0000 7f5ad0265640 1 -- 172.21.15.18:0/2689777039 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ac80baac0 con 0x7f5ac815ed50 2024-09-19T09:13:39.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.000+0000 7f5abe7fc640 1 -- 172.21.15.18:0/2689777039 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5ac0039040 con 0x7f5ac815ed50 2024-09-19T09:13:39.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.000+0000 7f5abe7fc640 1 --2- 172.21.15.18:0/2689777039 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5aac06c2b0 0x7f5aac06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:39.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.000+0000 7f5abe7fc640 1 -- 172.21.15.18:0/2689777039 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5ac00ac730 con 0x7f5ac815ed50 2024-09-19T09:13:39.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.000+0000 7f5ace001640 1 --2- 172.21.15.18:0/2689777039 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5aac06c2b0 0x7f5aac06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:39.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.001+0000 7f5ace001640 1 --2- 172.21.15.18:0/2689777039 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5aac06c2b0 0x7f5aac06e770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4007fd0 tx=0x7f5ac4007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:39.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.004+0000 7f5abe7fc640 1 -- 172.21.15.18:0/2689777039 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5ac0007790 con 0x7f5ac815ed50 2024-09-19T09:13:39.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.175+0000 7f5ad0265640 1 -- 172.21.15.18:0/2689777039 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5ac80c82f0 con 0x7f5aac06c2b0 2024-09-19T09:13:39.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.181+0000 7f5abe7fc640 1 -- 172.21.15.18:0/2689777039 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247486 (secure 0 0 0) 0x7f5ac80c82f0 con 0x7f5aac06c2b0 2024-09-19T09:13:39.184 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:39.185 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:13:39.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.184+0000 7f5ad0265640 1 -- 172.21.15.18:0/2689777039 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5aac06c2b0 msgr2=0x7f5aac06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:39.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.184+0000 7f5ad0265640 1 --2- 172.21.15.18:0/2689777039 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5aac06c2b0 0x7f5aac06e770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4007fd0 tx=0x7f5ac4007de0 comp rx=0 tx=0).stop 2024-09-19T09:13:39.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.184+0000 7f5ad0265640 1 -- 172.21.15.18:0/2689777039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ac815ed50 msgr2=0x7f5ac815f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:39.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.184+0000 7f5ad0265640 1 --2- 172.21.15.18:0/2689777039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ac815ed50 0x7f5ac815f860 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5ac0009d90 tx=0x7f5ac0004a40 comp rx=0 tx=0).stop 2024-09-19T09:13:39.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.184+0000 7f5ad0265640 1 -- 172.21.15.18:0/2689777039 shutdown_connections 2024-09-19T09:13:39.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.184+0000 7f5ad0265640 1 --2- 172.21.15.18:0/2689777039 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5aac06c2b0 0x7f5aac06e770 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:39.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.184+0000 7f5ad0265640 1 --2- 172.21.15.18:0/2689777039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ac815ed50 0x7f5ac815f860 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:39.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.184+0000 7f5ad0265640 1 --2- 172.21.15.18:0/2689777039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ac80d1c70 0x7f5ac80b9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:39.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.184+0000 7f5ad0265640 1 --2- 172.21.15.18:0/2689777039 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ac80b5b00 0x7f5ac80b8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:39.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.184+0000 7f5ad0265640 1 -- 172.21.15.18:0/2689777039 >> 172.21.15.18:0/2689777039 conn(0x7f5ac80d4bd0 msgr2=0x7f5ac806d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:39.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.184+0000 7f5ad0265640 1 -- 172.21.15.18:0/2689777039 shutdown_connections 2024-09-19T09:13:39.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.184+0000 7f5ad0265640 1 -- 172.21.15.18:0/2689777039 wait complete. 2024-09-19T09:13:39.195 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-19T09:13:37.524309+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1747,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560752,"statfs":{"total":1600000000,"available":1598210884,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002246"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495042+0000","last_change":"2024-09-19T09:13:27.519028+0000","last_active":"2024-09-19T09:13:29.495042+0000","last_peered":"2024-09-19T09:13:29.495042+0000","last_clean":"2024-09-19T09:13:29.495042+0000","last_became_active":"2024-09-19T09:13:27.518073+0000","last_became_peered":"2024-09-19T09:13:27.518073+0000","last_unstale":"2024-09-19T09:13:29.495042+0000","last_undegraded":"2024-09-19T09:13:29.495042+0000","last_fullsized":"2024-09-19T09:13:29.495042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:46.115198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.743786+0000","last_change":"2024-09-19T09:13:27.503682+0000","last_active":"2024-09-19T09:13:28.743786+0000","last_peered":"2024-09-19T09:13:28.743786+0000","last_clean":"2024-09-19T09:13:28.743786+0000","last_became_active":"2024-09-19T09:13:27.503423+0000","last_became_peered":"2024-09-19T09:13:27.503423+0000","last_unstale":"2024-09-19T09:13:28.743786+0000","last_undegraded":"2024-09-19T09:13:28.743786+0000","last_fullsized":"2024-09-19T09:13:28.743786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:26.355358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.743981+0000","last_change":"2024-09-19T09:13:27.507108+0000","last_active":"2024-09-19T09:13:28.743981+0000","last_peered":"2024-09-19T09:13:28.743981+0000","last_clean":"2024-09-19T09:13:28.743981+0000","last_became_active":"2024-09-19T09:13:27.506849+0000","last_became_peered":"2024-09-19T09:13:27.506849+0000","last_unstale":"2024-09-19T09:13:28.743981+0000","last_undegraded":"2024-09-19T09:13:28.743981+0000","last_fullsized":"2024-09-19T09:13:28.743981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:04.199671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.507424+0000","last_change":"2024-09-19T09:13:27.513588+0000","last_active":"2024-09-19T09:13:28.507424+0000","last_peered":"2024-09-19T09:13:28.507424+0000","last_clean":"2024-09-19T09:13:28.507424+0000","last_became_active":"2024-09-19T09:13:27.512588+0000","last_became_peered":"2024-09-19T09:13:27.512588+0000","last_unstale":"2024-09-19T09:13:28.507424+0000","last_undegraded":"2024-09-19T09:13:28.507424+0000","last_fullsized":"2024-09-19T09:13:28.507424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:55.304446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495369+0000","last_change":"2024-09-19T09:13:27.515156+0000","last_active":"2024-09-19T09:13:29.495369+0000","last_peered":"2024-09-19T09:13:29.495369+0000","last_clean":"2024-09-19T09:13:29.495369+0000","last_became_active":"2024-09-19T09:13:27.513242+0000","last_became_peered":"2024-09-19T09:13:27.513242+0000","last_unstale":"2024-09-19T09:13:29.495369+0000","last_undegraded":"2024-09-19T09:13:29.495369+0000","last_fullsized":"2024-09-19T09:13:29.495369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:43.531169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.507982+0000","last_change":"2024-09-19T09:13:27.514651+0000","last_active":"2024-09-19T09:13:28.507982+0000","last_peered":"2024-09-19T09:13:28.507982+0000","last_clean":"2024-09-19T09:13:28.507982+0000","last_became_active":"2024-09-19T09:13:27.514234+0000","last_became_peered":"2024-09-19T09:13:27.514234+0000","last_unstale":"2024-09-19T09:13:28.507982+0000","last_undegraded":"2024-09-19T09:13:28.507982+0000","last_fullsized":"2024-09-19T09:13:28.507982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:09.761563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495773+0000","last_change":"2024-09-19T09:13:27.513315+0000","last_active":"2024-09-19T09:13:29.495773+0000","last_peered":"2024-09-19T09:13:29.495773+0000","last_clean":"2024-09-19T09:13:29.495773+0000","last_became_active":"2024-09-19T09:13:27.512682+0000","last_became_peered":"2024-09-19T09:13:27.512682+0000","last_unstale":"2024-09-19T09:13:29.495773+0000","last_undegraded":"2024-09-19T09:13:29.495773+0000","last_fullsized":"2024-09-19T09:13:29.495773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:56.998451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.744145+0000","last_change":"2024-09-19T09:13:27.508840+0000","last_active":"2024-09-19T09:13:28.744145+0000","last_peered":"2024-09-19T09:13:28.744145+0000","last_clean":"2024-09-19T09:13:28.744145+0000","last_became_active":"2024-09-19T09:13:27.508595+0000","last_became_peered":"2024-09-19T09:13:27.508595+0000","last_unstale":"2024-09-19T09:13:28.744145+0000","last_undegraded":"2024-09-19T09:13:28.744145+0000","last_fullsized":"2024-09-19T09:13:28.744145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:58.902836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.677725+0000","last_change":"2024-09-19T09:13:27.502831+0000","last_active":"2024-09-19T09:13:29.677725+0000","last_peered":"2024-09-19T09:13:29.677725+0000","last_clean":"2024-09-19T09:13:29.677725+0000","last_became_active":"2024-09-19T09:13:27.502594+0000","last_became_peered":"2024-09-19T09:13:27.502594+0000","last_unstale":"2024-09-19T09:13:29.677725+0000","last_undegraded":"2024-09-19T09:13:29.677725+0000","last_fullsized":"2024-09-19T09:13:29.677725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:02.836853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495469+0000","last_change":"2024-09-19T09:13:27.512903+0000","last_active":"2024-09-19T09:13:29.495469+0000","last_peered":"2024-09-19T09:13:29.495469+0000","last_clean":"2024-09-19T09:13:29.495469+0000","last_became_active":"2024-09-19T09:13:27.508431+0000","last_became_peered":"2024-09-19T09:13:27.508431+0000","last_unstale":"2024-09-19T09:13:29.495469+0000","last_undegraded":"2024-09-19T09:13:29.495469+0000","last_fullsized":"2024-09-19T09:13:29.495469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:43.740664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495238+0000","last_change":"2024-09-19T09:13:27.518369+0000","last_active":"2024-09-19T09:13:29.495238+0000","last_peered":"2024-09-19T09:13:29.495238+0000","last_clean":"2024-09-19T09:13:29.495238+0000","last_became_active":"2024-09-19T09:13:27.516932+0000","last_became_peered":"2024-09-19T09:13:27.516932+0000","last_unstale":"2024-09-19T09:13:29.495238+0000","last_undegraded":"2024-09-19T09:13:29.495238+0000","last_fullsized":"2024-09-19T09:13:29.495238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:36.626961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495237+0000","last_change":"2024-09-19T09:13:27.513595+0000","last_active":"2024-09-19T09:13:29.495237+0000","last_peered":"2024-09-19T09:13:29.495237+0000","last_clean":"2024-09-19T09:13:29.495237+0000","last_became_active":"2024-09-19T09:13:27.512993+0000","last_became_peered":"2024-09-19T09:13:27.512993+0000","last_unstale":"2024-09-19T09:13:29.495237+0000","last_undegraded":"2024-09-19T09:13:29.495237+0000","last_fullsized":"2024-09-19T09:13:29.495237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:16.961946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.507646+0000","last_change":"2024-09-19T09:13:27.510731+0000","last_active":"2024-09-19T09:13:28.507646+0000","last_peered":"2024-09-19T09:13:28.507646+0000","last_clean":"2024-09-19T09:13:28.507646+0000","last_became_active":"2024-09-19T09:13:27.509501+0000","last_became_peered":"2024-09-19T09:13:27.509501+0000","last_unstale":"2024-09-19T09:13:28.507646+0000","last_undegraded":"2024-09-19T09:13:28.507646+0000","last_fullsized":"2024-09-19T09:13:28.507646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:47.710342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.507657+0000","last_change":"2024-09-19T09:13:27.500908+0000","last_active":"2024-09-19T09:13:28.507657+0000","last_peered":"2024-09-19T09:13:28.507657+0000","last_clean":"2024-09-19T09:13:28.507657+0000","last_became_active":"2024-09-19T09:13:27.500685+0000","last_became_peered":"2024-09-19T09:13:27.500685+0000","last_unstale":"2024-09-19T09:13:28.507657+0000","last_undegraded":"2024-09-19T09:13:28.507657+0000","last_fullsized":"2024-09-19T09:13:28.507657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:27.101570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.744134+0000","last_change":"2024-09-19T09:13:27.510338+0000","last_active":"2024-09-19T09:13:28.744134+0000","last_peered":"2024-09-19T09:13:28.744134+0000","last_clean":"2024-09-19T09:13:28.744134+0000","last_became_active":"2024-09-19T09:13:27.509885+0000","last_became_peered":"2024-09-19T09:13:27.509885+0000","last_unstale":"2024-09-19T09:13:28.744134+0000","last_undegraded":"2024-09-19T09:13:28.744134+0000","last_fullsized":"2024-09-19T09:13:28.744134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:22.872883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844670+0000","last_change":"2024-09-19T09:13:27.510472+0000","last_active":"2024-09-19T09:13:29.844670+0000","last_peered":"2024-09-19T09:13:29.844670+0000","last_clean":"2024-09-19T09:13:29.844670+0000","last_became_active":"2024-09-19T09:13:27.509440+0000","last_became_peered":"2024-09-19T09:13:27.509440+0000","last_unstale":"2024-09-19T09:13:29.844670+0000","last_undegraded":"2024-09-19T09:13:29.844670+0000","last_fullsized":"2024-09-19T09:13:29.844670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:36.943128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844505+0000","last_change":"2024-09-19T09:13:27.515299+0000","last_active":"2024-09-19T09:13:29.844505+0000","last_peered":"2024-09-19T09:13:29.844505+0000","last_clean":"2024-09-19T09:13:29.844505+0000","last_became_active":"2024-09-19T09:13:27.515060+0000","last_became_peered":"2024-09-19T09:13:27.515060+0000","last_unstale":"2024-09-19T09:13:29.844505+0000","last_undegraded":"2024-09-19T09:13:29.844505+0000","last_fullsized":"2024-09-19T09:13:29.844505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:20.833006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.568445+0000","last_change":"2024-09-19T09:13:27.505357+0000","last_active":"2024-09-19T09:13:28.568445+0000","last_peered":"2024-09-19T09:13:28.568445+0000","last_clean":"2024-09-19T09:13:28.568445+0000","last_became_active":"2024-09-19T09:13:27.505132+0000","last_became_peered":"2024-09-19T09:13:27.505132+0000","last_unstale":"2024-09-19T09:13:28.568445+0000","last_undegraded":"2024-09-19T09:13:28.568445+0000","last_fullsized":"2024-09-19T09:13:28.568445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:53:29.605543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844733+0000","last_change":"2024-09-19T09:13:27.511545+0000","last_active":"2024-09-19T09:13:29.844733+0000","last_peered":"2024-09-19T09:13:29.844733+0000","last_clean":"2024-09-19T09:13:29.844733+0000","last_became_active":"2024-09-19T09:13:27.511285+0000","last_became_peered":"2024-09-19T09:13:27.511285+0000","last_unstale":"2024-09-19T09:13:29.844733+0000","last_undegraded":"2024-09-19T09:13:29.844733+0000","last_fullsized":"2024-09-19T09:13:29.844733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:55:16.947702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495579+0000","last_change":"2024-09-19T09:13:27.508681+0000","last_active":"2024-09-19T09:13:29.495579+0000","last_peered":"2024-09-19T09:13:29.495579+0000","last_clean":"2024-09-19T09:13:29.495579+0000","last_became_active":"2024-09-19T09:13:27.507612+0000","last_became_peered":"2024-09-19T09:13:27.507612+0000","last_unstale":"2024-09-19T09:13:29.495579+0000","last_undegraded":"2024-09-19T09:13:29.495579+0000","last_fullsized":"2024-09-19T09:13:29.495579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:36.069417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493350+0000","last_change":"2024-09-19T09:13:27.512295+0000","last_active":"2024-09-19T09:13:29.493350+0000","last_peered":"2024-09-19T09:13:29.493350+0000","last_clean":"2024-09-19T09:13:29.493350+0000","last_became_active":"2024-09-19T09:13:27.512007+0000","last_became_peered":"2024-09-19T09:13:27.512007+0000","last_unstale":"2024-09-19T09:13:29.493350+0000","last_undegraded":"2024-09-19T09:13:29.493350+0000","last_fullsized":"2024-09-19T09:13:29.493350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:56.832240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.677613+0000","last_change":"2024-09-19T09:13:27.516493+0000","last_active":"2024-09-19T09:13:29.677613+0000","last_peered":"2024-09-19T09:13:29.677613+0000","last_clean":"2024-09-19T09:13:29.677613+0000","last_became_active":"2024-09-19T09:13:27.516254+0000","last_became_peered":"2024-09-19T09:13:27.516254+0000","last_unstale":"2024-09-19T09:13:29.677613+0000","last_undegraded":"2024-09-19T09:13:29.677613+0000","last_fullsized":"2024-09-19T09:13:29.677613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:33.906886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.744536+0000","last_change":"2024-09-19T09:13:27.505900+0000","last_active":"2024-09-19T09:13:28.744536+0000","last_peered":"2024-09-19T09:13:28.744536+0000","last_clean":"2024-09-19T09:13:28.744536+0000","last_became_active":"2024-09-19T09:13:27.505663+0000","last_became_peered":"2024-09-19T09:13:27.505663+0000","last_unstale":"2024-09-19T09:13:28.744536+0000","last_undegraded":"2024-09-19T09:13:28.744536+0000","last_fullsized":"2024-09-19T09:13:28.744536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:15:42.898470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844391+0000","last_change":"2024-09-19T09:13:27.506571+0000","last_active":"2024-09-19T09:13:29.844391+0000","last_peered":"2024-09-19T09:13:29.844391+0000","last_clean":"2024-09-19T09:13:29.844391+0000","last_became_active":"2024-09-19T09:13:27.506184+0000","last_became_peered":"2024-09-19T09:13:27.506184+0000","last_unstale":"2024-09-19T09:13:29.844391+0000","last_undegraded":"2024-09-19T09:13:29.844391+0000","last_fullsized":"2024-09-19T09:13:29.844391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:23.072934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.744303+0000","last_change":"2024-09-19T09:13:27.506211+0000","last_active":"2024-09-19T09:13:28.744303+0000","last_peered":"2024-09-19T09:13:28.744303+0000","last_clean":"2024-09-19T09:13:28.744303+0000","last_became_active":"2024-09-19T09:13:27.504555+0000","last_became_peered":"2024-09-19T09:13:27.504555+0000","last_unstale":"2024-09-19T09:13:28.744303+0000","last_undegraded":"2024-09-19T09:13:28.744303+0000","last_fullsized":"2024-09-19T09:13:28.744303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:15.242387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.508101+0000","last_change":"2024-09-19T09:13:27.513189+0000","last_active":"2024-09-19T09:13:28.508101+0000","last_peered":"2024-09-19T09:13:28.508101+0000","last_clean":"2024-09-19T09:13:28.508101+0000","last_became_active":"2024-09-19T09:13:27.512960+0000","last_became_peered":"2024-09-19T09:13:27.512960+0000","last_unstale":"2024-09-19T09:13:28.508101+0000","last_undegraded":"2024-09-19T09:13:28.508101+0000","last_fullsized":"2024-09-19T09:13:28.508101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:15.787088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.508496+0000","last_change":"2024-09-19T09:13:27.502537+0000","last_active":"2024-09-19T09:13:28.508496+0000","last_peered":"2024-09-19T09:13:28.508496+0000","last_clean":"2024-09-19T09:13:28.508496+0000","last_became_active":"2024-09-19T09:13:27.501832+0000","last_became_peered":"2024-09-19T09:13:27.501832+0000","last_unstale":"2024-09-19T09:13:28.508496+0000","last_undegraded":"2024-09-19T09:13:28.508496+0000","last_fullsized":"2024-09-19T09:13:28.508496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:39.127110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.508032+0000","last_change":"2024-09-19T09:13:27.509123+0000","last_active":"2024-09-19T09:13:28.508032+0000","last_peered":"2024-09-19T09:13:28.508032+0000","last_clean":"2024-09-19T09:13:28.508032+0000","last_became_active":"2024-09-19T09:13:27.508901+0000","last_became_peered":"2024-09-19T09:13:27.508901+0000","last_unstale":"2024-09-19T09:13:28.508032+0000","last_undegraded":"2024-09-19T09:13:28.508032+0000","last_fullsized":"2024-09-19T09:13:28.508032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:24:04.327514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.743839+0000","last_change":"2024-09-19T09:13:27.501012+0000","last_active":"2024-09-19T09:13:28.743839+0000","last_peered":"2024-09-19T09:13:28.743839+0000","last_clean":"2024-09-19T09:13:28.743839+0000","last_became_active":"2024-09-19T09:13:27.497063+0000","last_became_peered":"2024-09-19T09:13:27.497063+0000","last_unstale":"2024-09-19T09:13:28.743839+0000","last_undegraded":"2024-09-19T09:13:28.743839+0000","last_fullsized":"2024-09-19T09:13:28.743839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:08.043528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844492+0000","last_change":"2024-09-19T09:13:27.509716+0000","last_active":"2024-09-19T09:13:29.844492+0000","last_peered":"2024-09-19T09:13:29.844492+0000","last_clean":"2024-09-19T09:13:29.844492+0000","last_became_active":"2024-09-19T09:13:27.509413+0000","last_became_peered":"2024-09-19T09:13:27.509413+0000","last_unstale":"2024-09-19T09:13:29.844492+0000","last_undegraded":"2024-09-19T09:13:29.844492+0000","last_fullsized":"2024-09-19T09:13:29.844492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:26.682977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.568641+0000","last_change":"2024-09-19T09:13:27.499551+0000","last_active":"2024-09-19T09:13:28.568641+0000","last_peered":"2024-09-19T09:13:28.568641+0000","last_clean":"2024-09-19T09:13:28.568641+0000","last_became_active":"2024-09-19T09:13:27.499310+0000","last_became_peered":"2024-09-19T09:13:27.499310+0000","last_unstale":"2024-09-19T09:13:28.568641+0000","last_undegraded":"2024-09-19T09:13:28.568641+0000","last_fullsized":"2024-09-19T09:13:28.568641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:24.161816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.507533+0000","last_change":"2024-09-19T09:13:27.504478+0000","last_active":"2024-09-19T09:13:28.507533+0000","last_peered":"2024-09-19T09:13:28.507533+0000","last_clean":"2024-09-19T09:13:28.507533+0000","last_became_active":"2024-09-19T09:13:27.504229+0000","last_became_peered":"2024-09-19T09:13:27.504229+0000","last_unstale":"2024-09-19T09:13:28.507533+0000","last_undegraded":"2024-09-19T09:13:28.507533+0000","last_fullsized":"2024-09-19T09:13:28.507533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:01:34.671234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.677596+0000","last_change":"2024-09-19T09:13:27.499496+0000","last_active":"2024-09-19T09:13:29.677596+0000","last_peered":"2024-09-19T09:13:29.677596+0000","last_clean":"2024-09-19T09:13:29.677596+0000","last_became_active":"2024-09-19T09:13:27.498761+0000","last_became_peered":"2024-09-19T09:13:27.498761+0000","last_unstale":"2024-09-19T09:13:29.677596+0000","last_undegraded":"2024-09-19T09:13:29.677596+0000","last_fullsized":"2024-09-19T09:13:29.677596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:37.512544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.743924+0000","last_change":"2024-09-19T09:13:26.503044+0000","last_active":"2024-09-19T09:13:28.743924+0000","last_peered":"2024-09-19T09:13:28.743924+0000","last_clean":"2024-09-19T09:13:28.743924+0000","last_became_active":"2024-09-19T09:13:26.502787+0000","last_became_peered":"2024-09-19T09:13:26.502787+0000","last_unstale":"2024-09-19T09:13:28.743924+0000","last_undegraded":"2024-09-19T09:13:28.743924+0000","last_fullsized":"2024-09-19T09:13:28.743924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:19.218001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493212+0000","last_change":"2024-09-19T09:13:27.510154+0000","last_active":"2024-09-19T09:13:29.493212+0000","last_peered":"2024-09-19T09:13:29.493212+0000","last_clean":"2024-09-19T09:13:29.493212+0000","last_became_active":"2024-09-19T09:13:27.509908+0000","last_became_peered":"2024-09-19T09:13:27.509908+0000","last_unstale":"2024-09-19T09:13:29.493212+0000","last_undegraded":"2024-09-19T09:13:29.493212+0000","last_fullsized":"2024-09-19T09:13:29.493212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:11.167828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844324+0000","last_change":"2024-09-19T09:13:26.506712+0000","last_active":"2024-09-19T09:13:29.844324+0000","last_peered":"2024-09-19T09:13:29.844324+0000","last_clean":"2024-09-19T09:13:29.844324+0000","last_became_active":"2024-09-19T09:13:26.506244+0000","last_became_peered":"2024-09-19T09:13:26.506244+0000","last_unstale":"2024-09-19T09:13:29.844324+0000","last_undegraded":"2024-09-19T09:13:29.844324+0000","last_fullsized":"2024-09-19T09:13:29.844324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:11.404705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.507759+0000","last_change":"2024-09-19T09:13:26.505620+0000","last_active":"2024-09-19T09:13:28.507759+0000","last_peered":"2024-09-19T09:13:28.507759+0000","last_clean":"2024-09-19T09:13:28.507759+0000","last_became_active":"2024-09-19T09:13:26.505383+0000","last_became_peered":"2024-09-19T09:13:26.505383+0000","last_unstale":"2024-09-19T09:13:28.507759+0000","last_undegraded":"2024-09-19T09:13:28.507759+0000","last_fullsized":"2024-09-19T09:13:28.507759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:32.720854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.744458+0000","last_change":"2024-09-19T09:13:27.506460+0000","last_active":"2024-09-19T09:13:28.744458+0000","last_peered":"2024-09-19T09:13:28.744458+0000","last_clean":"2024-09-19T09:13:28.744458+0000","last_became_active":"2024-09-19T09:13:27.505516+0000","last_became_peered":"2024-09-19T09:13:27.505516+0000","last_unstale":"2024-09-19T09:13:28.744458+0000","last_undegraded":"2024-09-19T09:13:28.744458+0000","last_fullsized":"2024-09-19T09:13:28.744458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:37.956145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.845064+0000","last_change":"2024-09-19T09:13:26.507051+0000","last_active":"2024-09-19T09:13:29.845064+0000","last_peered":"2024-09-19T09:13:29.845064+0000","last_clean":"2024-09-19T09:13:29.845064+0000","last_became_active":"2024-09-19T09:13:26.506557+0000","last_became_peered":"2024-09-19T09:13:26.506557+0000","last_unstale":"2024-09-19T09:13:29.845064+0000","last_undegraded":"2024-09-19T09:13:29.845064+0000","last_fullsized":"2024-09-19T09:13:29.845064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:06.034747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493381+0000","last_change":"2024-09-19T09:13:27.510098+0000","last_active":"2024-09-19T09:13:29.493381+0000","last_peered":"2024-09-19T09:13:29.493381+0000","last_clean":"2024-09-19T09:13:29.493381+0000","last_became_active":"2024-09-19T09:13:27.509844+0000","last_became_peered":"2024-09-19T09:13:27.509844+0000","last_unstale":"2024-09-19T09:13:29.493381+0000","last_undegraded":"2024-09-19T09:13:29.493381+0000","last_fullsized":"2024-09-19T09:13:29.493381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:09:31.853647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.677954+0000","last_change":"2024-09-19T09:13:26.501053+0000","last_active":"2024-09-19T09:13:29.677954+0000","last_peered":"2024-09-19T09:13:29.677954+0000","last_clean":"2024-09-19T09:13:29.677954+0000","last_became_active":"2024-09-19T09:13:26.500814+0000","last_became_peered":"2024-09-19T09:13:26.500814+0000","last_unstale":"2024-09-19T09:13:29.677954+0000","last_undegraded":"2024-09-19T09:13:29.677954+0000","last_fullsized":"2024-09-19T09:13:29.677954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:04.484574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.507967+0000","last_change":"2024-09-19T09:13:27.510096+0000","last_active":"2024-09-19T09:13:28.507967+0000","last_peered":"2024-09-19T09:13:28.507967+0000","last_clean":"2024-09-19T09:13:28.507967+0000","last_became_active":"2024-09-19T09:13:27.509812+0000","last_became_peered":"2024-09-19T09:13:27.509812+0000","last_unstale":"2024-09-19T09:13:28.507967+0000","last_undegraded":"2024-09-19T09:13:28.507967+0000","last_fullsized":"2024-09-19T09:13:28.507967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:16.817154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495626+0000","last_change":"2024-09-19T09:13:26.498971+0000","last_active":"2024-09-19T09:13:29.495626+0000","last_peered":"2024-09-19T09:13:29.495626+0000","last_clean":"2024-09-19T09:13:29.495626+0000","last_became_active":"2024-09-19T09:13:26.498737+0000","last_became_peered":"2024-09-19T09:13:26.498737+0000","last_unstale":"2024-09-19T09:13:29.495626+0000","last_undegraded":"2024-09-19T09:13:29.495626+0000","last_fullsized":"2024-09-19T09:13:29.495626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:32.747213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.743822+0000","last_change":"2024-09-19T09:13:27.508024+0000","last_active":"2024-09-19T09:13:28.743822+0000","last_peered":"2024-09-19T09:13:28.743822+0000","last_clean":"2024-09-19T09:13:28.743822+0000","last_became_active":"2024-09-19T09:13:27.507792+0000","last_became_peered":"2024-09-19T09:13:27.507792+0000","last_unstale":"2024-09-19T09:13:28.743822+0000","last_undegraded":"2024-09-19T09:13:28.743822+0000","last_fullsized":"2024-09-19T09:13:28.743822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:47.574882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.568756+0000","last_change":"2024-09-19T09:13:26.499983+0000","last_active":"2024-09-19T09:13:28.568756+0000","last_peered":"2024-09-19T09:13:28.568756+0000","last_clean":"2024-09-19T09:13:28.568756+0000","last_became_active":"2024-09-19T09:13:26.499730+0000","last_became_peered":"2024-09-19T09:13:26.499730+0000","last_unstale":"2024-09-19T09:13:28.568756+0000","last_undegraded":"2024-09-19T09:13:28.568756+0000","last_fullsized":"2024-09-19T09:13:28.568756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:03.238517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844555+0000","last_change":"2024-09-19T09:13:27.510849+0000","last_active":"2024-09-19T09:13:29.844555+0000","last_peered":"2024-09-19T09:13:29.844555+0000","last_clean":"2024-09-19T09:13:29.844555+0000","last_became_active":"2024-09-19T09:13:27.509292+0000","last_became_peered":"2024-09-19T09:13:27.509292+0000","last_unstale":"2024-09-19T09:13:29.844555+0000","last_undegraded":"2024-09-19T09:13:29.844555+0000","last_fullsized":"2024-09-19T09:13:29.844555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:40.206034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.508003+0000","last_change":"2024-09-19T09:13:26.501792+0000","last_active":"2024-09-19T09:13:28.508003+0000","last_peered":"2024-09-19T09:13:28.508003+0000","last_clean":"2024-09-19T09:13:28.508003+0000","last_became_active":"2024-09-19T09:13:26.501463+0000","last_became_peered":"2024-09-19T09:13:26.501463+0000","last_unstale":"2024-09-19T09:13:28.508003+0000","last_undegraded":"2024-09-19T09:13:28.508003+0000","last_fullsized":"2024-09-19T09:13:28.508003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:21.830229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495227+0000","last_change":"2024-09-19T09:13:27.507955+0000","last_active":"2024-09-19T09:13:29.495227+0000","last_peered":"2024-09-19T09:13:29.495227+0000","last_clean":"2024-09-19T09:13:29.495227+0000","last_became_active":"2024-09-19T09:13:27.506341+0000","last_became_peered":"2024-09-19T09:13:27.506341+0000","last_unstale":"2024-09-19T09:13:29.495227+0000","last_undegraded":"2024-09-19T09:13:29.495227+0000","last_fullsized":"2024-09-19T09:13:29.495227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:51.344378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.568494+0000","last_change":"2024-09-19T09:13:26.498042+0000","last_active":"2024-09-19T09:13:28.568494+0000","last_peered":"2024-09-19T09:13:28.568494+0000","last_clean":"2024-09-19T09:13:28.568494+0000","last_became_active":"2024-09-19T09:13:26.497811+0000","last_became_peered":"2024-09-19T09:13:26.497811+0000","last_unstale":"2024-09-19T09:13:28.568494+0000","last_undegraded":"2024-09-19T09:13:28.568494+0000","last_fullsized":"2024-09-19T09:13:28.568494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:43.720848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.508171+0000","last_change":"2024-09-19T09:13:27.510470+0000","last_active":"2024-09-19T09:13:28.508171+0000","last_peered":"2024-09-19T09:13:28.508171+0000","last_clean":"2024-09-19T09:13:28.508171+0000","last_became_active":"2024-09-19T09:13:27.510158+0000","last_became_peered":"2024-09-19T09:13:27.510158+0000","last_unstale":"2024-09-19T09:13:28.508171+0000","last_undegraded":"2024-09-19T09:13:28.508171+0000","last_fullsized":"2024-09-19T09:13:28.508171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:27.533437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844721+0000","last_change":"2024-09-19T09:13:26.507022+0000","last_active":"2024-09-19T09:13:29.844721+0000","last_peered":"2024-09-19T09:13:29.844721+0000","last_clean":"2024-09-19T09:13:29.844721+0000","last_became_active":"2024-09-19T09:13:26.506756+0000","last_became_peered":"2024-09-19T09:13:26.506756+0000","last_unstale":"2024-09-19T09:13:29.844721+0000","last_undegraded":"2024-09-19T09:13:29.844721+0000","last_fullsized":"2024-09-19T09:13:29.844721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:53.915299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844819+0000","last_change":"2024-09-19T09:13:27.515543+0000","last_active":"2024-09-19T09:13:29.844819+0000","last_peered":"2024-09-19T09:13:29.844819+0000","last_clean":"2024-09-19T09:13:29.844819+0000","last_became_active":"2024-09-19T09:13:27.514992+0000","last_became_peered":"2024-09-19T09:13:27.514992+0000","last_unstale":"2024-09-19T09:13:29.844819+0000","last_undegraded":"2024-09-19T09:13:29.844819+0000","last_fullsized":"2024-09-19T09:13:29.844819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:04.883876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495856+0000","last_change":"2024-09-19T09:13:26.506703+0000","last_active":"2024-09-19T09:13:29.495856+0000","last_peered":"2024-09-19T09:13:29.495856+0000","last_clean":"2024-09-19T09:13:29.495856+0000","last_became_active":"2024-09-19T09:13:26.506378+0000","last_became_peered":"2024-09-19T09:13:26.506378+0000","last_unstale":"2024-09-19T09:13:29.495856+0000","last_undegraded":"2024-09-19T09:13:29.495856+0000","last_fullsized":"2024-09-19T09:13:29.495856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:47:00.782277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.677791+0000","last_change":"2024-09-19T09:13:27.499731+0000","last_active":"2024-09-19T09:13:29.677791+0000","last_peered":"2024-09-19T09:13:29.677791+0000","last_clean":"2024-09-19T09:13:29.677791+0000","last_became_active":"2024-09-19T09:13:27.499258+0000","last_became_peered":"2024-09-19T09:13:27.499258+0000","last_unstale":"2024-09-19T09:13:29.677791+0000","last_undegraded":"2024-09-19T09:13:29.677791+0000","last_fullsized":"2024-09-19T09:13:29.677791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:20.482950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493528+0000","last_change":"2024-09-19T09:13:26.499537+0000","last_active":"2024-09-19T09:13:29.493528+0000","last_peered":"2024-09-19T09:13:29.493528+0000","last_clean":"2024-09-19T09:13:29.493528+0000","last_became_active":"2024-09-19T09:13:26.499042+0000","last_became_peered":"2024-09-19T09:13:26.499042+0000","last_unstale":"2024-09-19T09:13:29.493528+0000","last_undegraded":"2024-09-19T09:13:29.493528+0000","last_fullsized":"2024-09-19T09:13:29.493528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:44.351314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844654+0000","last_change":"2024-09-19T09:13:27.508811+0000","last_active":"2024-09-19T09:13:29.844654+0000","last_peered":"2024-09-19T09:13:29.844654+0000","last_clean":"2024-09-19T09:13:29.844654+0000","last_became_active":"2024-09-19T09:13:27.508529+0000","last_became_peered":"2024-09-19T09:13:27.508529+0000","last_unstale":"2024-09-19T09:13:29.844654+0000","last_undegraded":"2024-09-19T09:13:29.844654+0000","last_fullsized":"2024-09-19T09:13:29.844654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:56.255284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495032+0000","last_change":"2024-09-19T09:13:26.504376+0000","last_active":"2024-09-19T09:13:29.495032+0000","last_peered":"2024-09-19T09:13:29.495032+0000","last_clean":"2024-09-19T09:13:29.495032+0000","last_became_active":"2024-09-19T09:13:26.504121+0000","last_became_peered":"2024-09-19T09:13:26.504121+0000","last_unstale":"2024-09-19T09:13:29.495032+0000","last_undegraded":"2024-09-19T09:13:29.495032+0000","last_fullsized":"2024-09-19T09:13:29.495032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:10.129519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.507470+0000","last_change":"2024-09-19T09:13:27.510114+0000","last_active":"2024-09-19T09:13:28.507470+0000","last_peered":"2024-09-19T09:13:28.507470+0000","last_clean":"2024-09-19T09:13:28.507470+0000","last_became_active":"2024-09-19T09:13:27.509862+0000","last_became_peered":"2024-09-19T09:13:27.509862+0000","last_unstale":"2024-09-19T09:13:28.507470+0000","last_undegraded":"2024-09-19T09:13:28.507470+0000","last_fullsized":"2024-09-19T09:13:28.507470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:44.225098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493249+0000","last_change":"2024-09-19T09:13:26.501637+0000","last_active":"2024-09-19T09:13:29.493249+0000","last_peered":"2024-09-19T09:13:29.493249+0000","last_clean":"2024-09-19T09:13:29.493249+0000","last_became_active":"2024-09-19T09:13:26.501409+0000","last_became_peered":"2024-09-19T09:13:26.501409+0000","last_unstale":"2024-09-19T09:13:29.493249+0000","last_undegraded":"2024-09-19T09:13:29.493249+0000","last_fullsized":"2024-09-19T09:13:29.493249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:56.759101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.494899+0000","last_change":"2024-09-19T09:13:27.514969+0000","last_active":"2024-09-19T09:13:29.494899+0000","last_peered":"2024-09-19T09:13:29.494899+0000","last_clean":"2024-09-19T09:13:29.494899+0000","last_became_active":"2024-09-19T09:13:27.514243+0000","last_became_peered":"2024-09-19T09:13:27.514243+0000","last_unstale":"2024-09-19T09:13:29.494899+0000","last_undegraded":"2024-09-19T09:13:29.494899+0000","last_fullsized":"2024-09-19T09:13:29.494899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:19.521214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.743972+0000","last_change":"2024-09-19T09:13:26.503898+0000","last_active":"2024-09-19T09:13:28.743972+0000","last_peered":"2024-09-19T09:13:28.743972+0000","last_clean":"2024-09-19T09:13:28.743972+0000","last_became_active":"2024-09-19T09:13:26.503631+0000","last_became_peered":"2024-09-19T09:13:26.503631+0000","last_unstale":"2024-09-19T09:13:28.743972+0000","last_undegraded":"2024-09-19T09:13:28.743972+0000","last_fullsized":"2024-09-19T09:13:28.743972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:51.106585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495523+0000","last_change":"2024-09-19T09:13:27.508761+0000","last_active":"2024-09-19T09:13:29.495523+0000","last_peered":"2024-09-19T09:13:29.495523+0000","last_clean":"2024-09-19T09:13:29.495523+0000","last_became_active":"2024-09-19T09:13:27.508339+0000","last_became_peered":"2024-09-19T09:13:27.508339+0000","last_unstale":"2024-09-19T09:13:29.495523+0000","last_undegraded":"2024-09-19T09:13:29.495523+0000","last_fullsized":"2024-09-19T09:13:29.495523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:38.236054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.508592+0000","last_change":"2024-09-19T09:13:26.502447+0000","last_active":"2024-09-19T09:13:28.508592+0000","last_peered":"2024-09-19T09:13:28.508592+0000","last_clean":"2024-09-19T09:13:28.508592+0000","last_became_active":"2024-09-19T09:13:26.501912+0000","last_became_peered":"2024-09-19T09:13:26.501912+0000","last_unstale":"2024-09-19T09:13:28.508592+0000","last_undegraded":"2024-09-19T09:13:28.508592+0000","last_fullsized":"2024-09-19T09:13:28.508592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:43.690569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844799+0000","last_change":"2024-09-19T09:13:27.501572+0000","last_active":"2024-09-19T09:13:29.844799+0000","last_peered":"2024-09-19T09:13:29.844799+0000","last_clean":"2024-09-19T09:13:29.844799+0000","last_became_active":"2024-09-19T09:13:27.501275+0000","last_became_peered":"2024-09-19T09:13:27.501275+0000","last_unstale":"2024-09-19T09:13:29.844799+0000","last_undegraded":"2024-09-19T09:13:29.844799+0000","last_fullsized":"2024-09-19T09:13:29.844799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:43.790948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.677844+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:13:29.677844+0000","last_peered":"2024-09-19T09:13:29.677844+0000","last_clean":"2024-09-19T09:13:29.677844+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:13:29.677844+0000","last_undegraded":"2024-09-19T09:13:29.677844+0000","last_fullsized":"2024-09-19T09:13:29.677844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:22.478151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844853+0000","last_change":"2024-09-19T09:13:26.506369+0000","last_active":"2024-09-19T09:13:29.844853+0000","last_peered":"2024-09-19T09:13:29.844853+0000","last_clean":"2024-09-19T09:13:29.844853+0000","last_became_active":"2024-09-19T09:13:26.506065+0000","last_became_peered":"2024-09-19T09:13:26.506065+0000","last_unstale":"2024-09-19T09:13:29.844853+0000","last_undegraded":"2024-09-19T09:13:29.844853+0000","last_fullsized":"2024-09-19T09:13:29.844853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:18:38.002779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493456+0000","last_change":"2024-09-19T09:13:27.508661+0000","last_active":"2024-09-19T09:13:29.493456+0000","last_peered":"2024-09-19T09:13:29.493456+0000","last_clean":"2024-09-19T09:13:29.493456+0000","last_became_active":"2024-09-19T09:13:27.508377+0000","last_became_peered":"2024-09-19T09:13:27.508377+0000","last_unstale":"2024-09-19T09:13:29.493456+0000","last_undegraded":"2024-09-19T09:13:29.493456+0000","last_fullsized":"2024-09-19T09:13:29.493456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:57:28.264934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844831+0000","last_change":"2024-09-19T09:13:26.504928+0000","last_active":"2024-09-19T09:13:29.844831+0000","last_peered":"2024-09-19T09:13:29.844831+0000","last_clean":"2024-09-19T09:13:29.844831+0000","last_became_active":"2024-09-19T09:13:26.504649+0000","last_became_peered":"2024-09-19T09:13:26.504649+0000","last_unstale":"2024-09-19T09:13:29.844831+0000","last_undegraded":"2024-09-19T09:13:29.844831+0000","last_fullsized":"2024-09-19T09:13:29.844831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:25:24.798674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.508168+0000","last_change":"2024-09-19T09:13:27.507971+0000","last_active":"2024-09-19T09:13:28.508168+0000","last_peered":"2024-09-19T09:13:28.508168+0000","last_clean":"2024-09-19T09:13:28.508168+0000","last_became_active":"2024-09-19T09:13:27.507738+0000","last_became_peered":"2024-09-19T09:13:27.507738+0000","last_unstale":"2024-09-19T09:13:28.508168+0000","last_undegraded":"2024-09-19T09:13:28.508168+0000","last_fullsized":"2024-09-19T09:13:28.508168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:20.297920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.568810+0000","last_change":"2024-09-19T09:13:26.501526+0000","last_active":"2024-09-19T09:13:28.568810+0000","last_peered":"2024-09-19T09:13:28.568810+0000","last_clean":"2024-09-19T09:13:28.568810+0000","last_became_active":"2024-09-19T09:13:26.501281+0000","last_became_peered":"2024-09-19T09:13:26.501281+0000","last_unstale":"2024-09-19T09:13:28.568810+0000","last_undegraded":"2024-09-19T09:13:28.568810+0000","last_fullsized":"2024-09-19T09:13:28.568810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:44.450168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.744156+0000","last_change":"2024-09-19T09:13:27.501824+0000","last_active":"2024-09-19T09:13:28.744156+0000","last_peered":"2024-09-19T09:13:28.744156+0000","last_clean":"2024-09-19T09:13:28.744156+0000","last_became_active":"2024-09-19T09:13:27.500721+0000","last_became_peered":"2024-09-19T09:13:27.500721+0000","last_unstale":"2024-09-19T09:13:28.744156+0000","last_undegraded":"2024-09-19T09:13:28.744156+0000","last_fullsized":"2024-09-19T09:13:28.744156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:45.082435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844855+0000","last_change":"2024-09-19T09:13:26.505847+0000","last_active":"2024-09-19T09:13:29.844855+0000","last_peered":"2024-09-19T09:13:29.844855+0000","last_clean":"2024-09-19T09:13:29.844855+0000","last_became_active":"2024-09-19T09:13:26.505245+0000","last_became_peered":"2024-09-19T09:13:26.505245+0000","last_unstale":"2024-09-19T09:13:29.844855+0000","last_undegraded":"2024-09-19T09:13:29.844855+0000","last_fullsized":"2024-09-19T09:13:29.844855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:25:50.247996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495386+0000","last_change":"2024-09-19T09:13:27.508323+0000","last_active":"2024-09-19T09:13:29.495386+0000","last_peered":"2024-09-19T09:13:29.495386+0000","last_clean":"2024-09-19T09:13:29.495386+0000","last_became_active":"2024-09-19T09:13:27.508090+0000","last_became_peered":"2024-09-19T09:13:27.508090+0000","last_unstale":"2024-09-19T09:13:29.495386+0000","last_undegraded":"2024-09-19T09:13:29.495386+0000","last_fullsized":"2024-09-19T09:13:29.495386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:17.877065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.744638+0000","last_change":"2024-09-19T09:13:26.502978+0000","last_active":"2024-09-19T09:13:28.744638+0000","last_peered":"2024-09-19T09:13:28.744638+0000","last_clean":"2024-09-19T09:13:28.744638+0000","last_became_active":"2024-09-19T09:13:26.502537+0000","last_became_peered":"2024-09-19T09:13:26.502537+0000","last_unstale":"2024-09-19T09:13:28.744638+0000","last_undegraded":"2024-09-19T09:13:28.744638+0000","last_fullsized":"2024-09-19T09:13:28.744638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:10:29.871068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.507592+0000","last_change":"2024-09-19T09:13:27.502356+0000","last_active":"2024-09-19T09:13:28.507592+0000","last_peered":"2024-09-19T09:13:28.507592+0000","last_clean":"2024-09-19T09:13:28.507592+0000","last_became_active":"2024-09-19T09:13:27.502112+0000","last_became_peered":"2024-09-19T09:13:27.502112+0000","last_unstale":"2024-09-19T09:13:28.507592+0000","last_undegraded":"2024-09-19T09:13:28.507592+0000","last_fullsized":"2024-09-19T09:13:28.507592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:26:28.997393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844780+0000","last_change":"2024-09-19T09:13:26.505476+0000","last_active":"2024-09-19T09:13:29.844780+0000","last_peered":"2024-09-19T09:13:29.844780+0000","last_clean":"2024-09-19T09:13:29.844780+0000","last_became_active":"2024-09-19T09:13:26.505190+0000","last_became_peered":"2024-09-19T09:13:26.505190+0000","last_unstale":"2024-09-19T09:13:29.844780+0000","last_undegraded":"2024-09-19T09:13:29.844780+0000","last_fullsized":"2024-09-19T09:13:29.844780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:45.467871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.508345+0000","last_change":"2024-09-19T09:13:27.507787+0000","last_active":"2024-09-19T09:13:28.508345+0000","last_peered":"2024-09-19T09:13:28.508345+0000","last_clean":"2024-09-19T09:13:28.508345+0000","last_became_active":"2024-09-19T09:13:27.507515+0000","last_became_peered":"2024-09-19T09:13:27.507515+0000","last_unstale":"2024-09-19T09:13:28.508345+0000","last_undegraded":"2024-09-19T09:13:28.508345+0000","last_fullsized":"2024-09-19T09:13:28.508345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:59.050231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493662+0000","last_change":"2024-09-19T09:13:26.497706+0000","last_active":"2024-09-19T09:13:29.493662+0000","last_peered":"2024-09-19T09:13:29.493662+0000","last_clean":"2024-09-19T09:13:29.493662+0000","last_became_active":"2024-09-19T09:13:26.497446+0000","last_became_peered":"2024-09-19T09:13:26.497446+0000","last_unstale":"2024-09-19T09:13:29.493662+0000","last_undegraded":"2024-09-19T09:13:29.493662+0000","last_fullsized":"2024-09-19T09:13:29.493662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:10.881483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493342+0000","last_change":"2024-09-19T09:13:27.507619+0000","last_active":"2024-09-19T09:13:29.493342+0000","last_peered":"2024-09-19T09:13:29.493342+0000","last_clean":"2024-09-19T09:13:29.493342+0000","last_became_active":"2024-09-19T09:13:27.506922+0000","last_became_peered":"2024-09-19T09:13:27.506922+0000","last_unstale":"2024-09-19T09:13:29.493342+0000","last_undegraded":"2024-09-19T09:13:29.493342+0000","last_fullsized":"2024-09-19T09:13:29.493342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:19.978047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844756+0000","last_change":"2024-09-19T09:13:26.506097+0000","last_active":"2024-09-19T09:13:29.844756+0000","last_peered":"2024-09-19T09:13:29.844756+0000","last_clean":"2024-09-19T09:13:29.844756+0000","last_became_active":"2024-09-19T09:13:26.505562+0000","last_became_peered":"2024-09-19T09:13:26.505562+0000","last_unstale":"2024-09-19T09:13:29.844756+0000","last_undegraded":"2024-09-19T09:13:29.844756+0000","last_fullsized":"2024-09-19T09:13:29.844756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:31.643028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493424+0000","last_change":"2024-09-19T09:13:27.506209+0000","last_active":"2024-09-19T09:13:29.493424+0000","last_peered":"2024-09-19T09:13:29.493424+0000","last_clean":"2024-09-19T09:13:29.493424+0000","last_became_active":"2024-09-19T09:13:27.505712+0000","last_became_peered":"2024-09-19T09:13:27.505712+0000","last_unstale":"2024-09-19T09:13:29.493424+0000","last_undegraded":"2024-09-19T09:13:29.493424+0000","last_fullsized":"2024-09-19T09:13:29.493424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:45.068134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495531+0000","last_change":"2024-09-19T09:13:26.501858+0000","last_active":"2024-09-19T09:13:29.495531+0000","last_peered":"2024-09-19T09:13:29.495531+0000","last_clean":"2024-09-19T09:13:29.495531+0000","last_became_active":"2024-09-19T09:13:26.501606+0000","last_became_peered":"2024-09-19T09:13:26.501606+0000","last_unstale":"2024-09-19T09:13:29.495531+0000","last_undegraded":"2024-09-19T09:13:29.495531+0000","last_fullsized":"2024-09-19T09:13:29.495531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:12.082586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844974+0000","last_change":"2024-09-19T09:13:27.511660+0000","last_active":"2024-09-19T09:13:29.844974+0000","last_peered":"2024-09-19T09:13:29.844974+0000","last_clean":"2024-09-19T09:13:29.844974+0000","last_became_active":"2024-09-19T09:13:27.511409+0000","last_became_peered":"2024-09-19T09:13:27.511409+0000","last_unstale":"2024-09-19T09:13:29.844974+0000","last_undegraded":"2024-09-19T09:13:29.844974+0000","last_fullsized":"2024-09-19T09:13:29.844974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:16.269907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493355+0000","last_change":"2024-09-19T09:13:26.498599+0000","last_active":"2024-09-19T09:13:29.493355+0000","last_peered":"2024-09-19T09:13:29.493355+0000","last_clean":"2024-09-19T09:13:29.493355+0000","last_became_active":"2024-09-19T09:13:26.498160+0000","last_became_peered":"2024-09-19T09:13:26.498160+0000","last_unstale":"2024-09-19T09:13:29.493355+0000","last_undegraded":"2024-09-19T09:13:29.493355+0000","last_fullsized":"2024-09-19T09:13:29.493355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:42:23.434662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493504+0000","last_change":"2024-09-19T09:13:27.506298+0000","last_active":"2024-09-19T09:13:29.493504+0000","last_peered":"2024-09-19T09:13:29.493504+0000","last_clean":"2024-09-19T09:13:29.493504+0000","last_became_active":"2024-09-19T09:13:27.506029+0000","last_became_peered":"2024-09-19T09:13:27.506029+0000","last_unstale":"2024-09-19T09:13:29.493504+0000","last_undegraded":"2024-09-19T09:13:29.493504+0000","last_fullsized":"2024-09-19T09:13:29.493504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:15.465914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.507863+0000","last_change":"2024-09-19T09:13:26.503468+0000","last_active":"2024-09-19T09:13:28.507863+0000","last_peered":"2024-09-19T09:13:28.507863+0000","last_clean":"2024-09-19T09:13:28.507863+0000","last_became_active":"2024-09-19T09:13:26.503239+0000","last_became_peered":"2024-09-19T09:13:26.503239+0000","last_unstale":"2024-09-19T09:13:28.507863+0000","last_undegraded":"2024-09-19T09:13:28.507863+0000","last_fullsized":"2024-09-19T09:13:28.507863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:39:45.143267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.568617+0000","last_change":"2024-09-19T09:13:27.501631+0000","last_active":"2024-09-19T09:13:28.568617+0000","last_peered":"2024-09-19T09:13:28.568617+0000","last_clean":"2024-09-19T09:13:28.568617+0000","last_became_active":"2024-09-19T09:13:27.501413+0000","last_became_peered":"2024-09-19T09:13:27.501413+0000","last_unstale":"2024-09-19T09:13:28.568617+0000","last_undegraded":"2024-09-19T09:13:28.568617+0000","last_fullsized":"2024-09-19T09:13:28.568617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:49.379552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844436+0000","last_change":"2024-09-19T09:13:26.505929+0000","last_active":"2024-09-19T09:13:29.844436+0000","last_peered":"2024-09-19T09:13:29.844436+0000","last_clean":"2024-09-19T09:13:29.844436+0000","last_became_active":"2024-09-19T09:13:26.505267+0000","last_became_peered":"2024-09-19T09:13:26.505267+0000","last_unstale":"2024-09-19T09:13:29.844436+0000","last_undegraded":"2024-09-19T09:13:29.844436+0000","last_fullsized":"2024-09-19T09:13:29.844436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:12.236637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844651+0000","last_change":"2024-09-19T09:13:27.504679+0000","last_active":"2024-09-19T09:13:29.844651+0000","last_peered":"2024-09-19T09:13:29.844651+0000","last_clean":"2024-09-19T09:13:29.844651+0000","last_became_active":"2024-09-19T09:13:27.504448+0000","last_became_peered":"2024-09-19T09:13:27.504448+0000","last_unstale":"2024-09-19T09:13:29.844651+0000","last_undegraded":"2024-09-19T09:13:29.844651+0000","last_fullsized":"2024-09-19T09:13:29.844651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:44.574651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844665+0000","last_change":"2024-09-19T09:13:27.515732+0000","last_active":"2024-09-19T09:13:29.844665+0000","last_peered":"2024-09-19T09:13:29.844665+0000","last_clean":"2024-09-19T09:13:29.844665+0000","last_became_active":"2024-09-19T09:13:27.515302+0000","last_became_peered":"2024-09-19T09:13:27.515302+0000","last_unstale":"2024-09-19T09:13:29.844665+0000","last_undegraded":"2024-09-19T09:13:29.844665+0000","last_fullsized":"2024-09-19T09:13:29.844665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:44.892454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495453+0000","last_change":"2024-09-19T09:13:26.498383+0000","last_active":"2024-09-19T09:13:29.495453+0000","last_peered":"2024-09-19T09:13:29.495453+0000","last_clean":"2024-09-19T09:13:29.495453+0000","last_became_active":"2024-09-19T09:13:26.498142+0000","last_became_peered":"2024-09-19T09:13:26.498142+0000","last_unstale":"2024-09-19T09:13:29.495453+0000","last_undegraded":"2024-09-19T09:13:29.495453+0000","last_fullsized":"2024-09-19T09:13:29.495453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:46.179021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.677710+0000","last_change":"2024-09-19T09:13:27.515820+0000","last_active":"2024-09-19T09:13:29.677710+0000","last_peered":"2024-09-19T09:13:29.677710+0000","last_clean":"2024-09-19T09:13:29.677710+0000","last_became_active":"2024-09-19T09:13:27.515575+0000","last_became_peered":"2024-09-19T09:13:27.515575+0000","last_unstale":"2024-09-19T09:13:29.677710+0000","last_undegraded":"2024-09-19T09:13:29.677710+0000","last_fullsized":"2024-09-19T09:13:29.677710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:59:08.406348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495637+0000","last_change":"2024-09-19T09:13:26.497950+0000","last_active":"2024-09-19T09:13:29.495637+0000","last_peered":"2024-09-19T09:13:29.495637+0000","last_clean":"2024-09-19T09:13:29.495637+0000","last_became_active":"2024-09-19T09:13:26.497689+0000","last_became_peered":"2024-09-19T09:13:26.497689+0000","last_unstale":"2024-09-19T09:13:29.495637+0000","last_undegraded":"2024-09-19T09:13:29.495637+0000","last_fullsized":"2024-09-19T09:13:29.495637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:36:05.171954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.744307+0000","last_change":"2024-09-19T09:13:27.496465+0000","last_active":"2024-09-19T09:13:28.744307+0000","last_peered":"2024-09-19T09:13:28.744307+0000","last_clean":"2024-09-19T09:13:28.744307+0000","last_became_active":"2024-09-19T09:13:27.496138+0000","last_became_peered":"2024-09-19T09:13:27.496138+0000","last_unstale":"2024-09-19T09:13:28.744307+0000","last_undegraded":"2024-09-19T09:13:28.744307+0000","last_fullsized":"2024-09-19T09:13:28.744307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:44.657136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.744302+0000","last_change":"2024-09-19T09:13:26.502836+0000","last_active":"2024-09-19T09:13:28.744302+0000","last_peered":"2024-09-19T09:13:28.744302+0000","last_clean":"2024-09-19T09:13:28.744302+0000","last_became_active":"2024-09-19T09:13:26.501995+0000","last_became_peered":"2024-09-19T09:13:26.501995+0000","last_unstale":"2024-09-19T09:13:28.744302+0000","last_undegraded":"2024-09-19T09:13:28.744302+0000","last_fullsized":"2024-09-19T09:13:28.744302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:03.744301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.744023+0000","last_change":"2024-09-19T09:13:27.502428+0000","last_active":"2024-09-19T09:13:28.744023+0000","last_peered":"2024-09-19T09:13:28.744023+0000","last_clean":"2024-09-19T09:13:28.744023+0000","last_became_active":"2024-09-19T09:13:27.502152+0000","last_became_peered":"2024-09-19T09:13:27.502152+0000","last_unstale":"2024-09-19T09:13:28.744023+0000","last_undegraded":"2024-09-19T09:13:28.744023+0000","last_fullsized":"2024-09-19T09:13:28.744023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:58.866973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493222+0000","last_change":"2024-09-19T09:13:26.506856+0000","last_active":"2024-09-19T09:13:29.493222+0000","last_peered":"2024-09-19T09:13:29.493222+0000","last_clean":"2024-09-19T09:13:29.493222+0000","last_became_active":"2024-09-19T09:13:26.506714+0000","last_became_peered":"2024-09-19T09:13:26.506714+0000","last_unstale":"2024-09-19T09:13:29.493222+0000","last_undegraded":"2024-09-19T09:13:29.493222+0000","last_fullsized":"2024-09-19T09:13:29.493222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:16.001867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924431,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924555,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194662,"statfs":{"total":200000000,"available":199334095,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195236,"statfs":{"total":200000000,"available":199922271,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":74,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199923973,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199922943,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194662,"statfs":{"total":200000000,"available":199334117,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924499,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:13:39.199 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:13:39.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.337+0000 7f3e9a5c4640 1 Processor -- start 2024-09-19T09:13:39.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.337+0000 7f3e9a5c4640 1 -- start start 2024-09-19T09:13:39.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.338+0000 7f3e9a5c4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3e940d57a0 0x7f3e940d1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:39.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.338+0000 7f3e9a5c4640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e940d3880 con 0x7f3e940d1990 2024-09-19T09:13:39.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.338+0000 7f3e9a5c4640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e940d3b20 con 0x7f3e9415ecc0 2024-09-19T09:13:39.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.338+0000 7f3e9a5c4640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f3e940b42f0 con 0x7f3e940d57a0 2024-09-19T09:13:39.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.338+0000 7f3e937fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3e940d57a0 0x7f3e940d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:39.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.338+0000 7f3e98b61640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3e940d1990 0x7f3e940b50b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:42462/0 (socket says 172.21.15.18:42462) 2024-09-19T09:13:39.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.338+0000 7f3e98b61640 1 -- 172.21.15.18:0/1977983711 learned_addr learned my addr 172.21.15.18:0/1977983711 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:39.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.339+0000 7f3e92ffd640 1 -- 172.21.15.18:0/1977983711 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4104443331 0 0) 0x7f3e940d3880 con 0x7f3e940d1990 2024-09-19T09:13:39.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.339+0000 7f3e92ffd640 1 -- 172.21.15.18:0/1977983711 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e7c003520 con 0x7f3e940d1990 2024-09-19T09:13:39.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.339+0000 7f3e937fe640 1 -- 172.21.15.18:0/1977983711 >> v1:172.21.15.162:6789/0 conn(0x7f3e9415ecc0 legacy=0x7f3e940d3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:39.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.339+0000 7f3e937fe640 1 -- 172.21.15.18:0/1977983711 >> v1:172.21.15.18:6789/0 conn(0x7f3e940d1990 legacy=0x7f3e940b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:39.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.339+0000 7f3e937fe640 1 -- 172.21.15.18:0/1977983711 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e940b45d0 con 0x7f3e940d57a0 2024-09-19T09:13:39.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.339+0000 7f3e937fe640 1 --2- 172.21.15.18:0/1977983711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e940d57a0 0x7f3e940d1450 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3e880097a0 tx=0x7f3e8802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7dc6240ec38682 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:39.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.340+0000 7f3e92ffd640 1 -- 172.21.15.18:0/1977983711 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e88037070 con 0x7f3e940d57a0 2024-09-19T09:13:39.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.340+0000 7f3e92ffd640 1 -- 172.21.15.18:0/1977983711 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e88032440 con 0x7f3e940d57a0 2024-09-19T09:13:39.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.340+0000 7f3e92ffd640 1 -- 172.21.15.18:0/1977983711 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e880327f0 con 0x7f3e940d57a0 2024-09-19T09:13:39.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.340+0000 7f3e9a5c4640 1 -- 172.21.15.18:0/1977983711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e940d57a0 msgr2=0x7f3e940d1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:39.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.340+0000 7f3e9a5c4640 1 --2- 172.21.15.18:0/1977983711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e940d57a0 0x7f3e940d1450 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3e880097a0 tx=0x7f3e8802a230 comp rx=0 tx=0).stop 2024-09-19T09:13:39.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.340+0000 7f3e9a5c4640 1 -- 172.21.15.18:0/1977983711 shutdown_connections 2024-09-19T09:13:39.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.340+0000 7f3e9a5c4640 1 --2- 172.21.15.18:0/1977983711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e940d57a0 0x7f3e940d1450 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:39.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.340+0000 7f3e9a5c4640 1 -- 172.21.15.18:0/1977983711 >> 172.21.15.18:0/1977983711 conn(0x7f3e940d4bd0 msgr2=0x7f3e940d4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:39.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.340+0000 7f3e9a5c4640 1 -- 172.21.15.18:0/1977983711 shutdown_connections 2024-09-19T09:13:39.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.340+0000 7f3e9a5c4640 1 -- 172.21.15.18:0/1977983711 wait complete. 2024-09-19T09:13:39.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.341+0000 7f3e9a5c4640 1 Processor -- start 2024-09-19T09:13:39.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.342+0000 7f3e9a5c4640 1 -- start start 2024-09-19T09:13:39.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.342+0000 7f3e9a5c4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e940d1990 0x7f3e940b9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:39.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.342+0000 7f3e9a5c4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e940d57a0 0x7f3e94155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:39.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.342+0000 7f3e9a5c4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e9415ecc0 0x7f3e94156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:39.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.342+0000 7f3e9a5c4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3e9415f0a0 con 0x7f3e9415ecc0 2024-09-19T09:13:39.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.342+0000 7f3e9a5c4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3e940b4b90 con 0x7f3e940d57a0 2024-09-19T09:13:39.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.342+0000 7f3e9a5c4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3e9415f220 con 0x7f3e940d1990 2024-09-19T09:13:39.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.342+0000 7f3e98b61640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e9415ecc0 0x7f3e94156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:39.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.342+0000 7f3e98b61640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e9415ecc0 0x7f3e94156170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36698/0 (socket says 172.21.15.18:36698) 2024-09-19T09:13:39.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.342+0000 7f3e98b61640 1 -- 172.21.15.18:0/1483115062 learned_addr learned my addr 172.21.15.18:0/1483115062 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:39.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.343+0000 7f3e937fe640 1 --2- 172.21.15.18:0/1483115062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e940d57a0 0x7f3e94155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:39.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.343+0000 7f3e93fff640 1 --2- 172.21.15.18:0/1483115062 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e940d1990 0x7f3e940b9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:39.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.343+0000 7f3e98b61640 1 -- 172.21.15.18:0/1483115062 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e940d1990 msgr2=0x7f3e940b9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:39.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.343+0000 7f3e98b61640 1 --2- 172.21.15.18:0/1483115062 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e940d1990 0x7f3e940b9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:39.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.343+0000 7f3e98b61640 1 -- 172.21.15.18:0/1483115062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e940d57a0 msgr2=0x7f3e94155c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:39.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.343+0000 7f3e98b61640 1 --2- 172.21.15.18:0/1483115062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e940d57a0 0x7f3e94155c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:39.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.343+0000 7f3e98b61640 1 -- 172.21.15.18:0/1483115062 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e941566b0 con 0x7f3e9415ecc0 2024-09-19T09:13:39.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.343+0000 7f3e937fe640 1 --2- 172.21.15.18:0/1483115062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e940d57a0 0x7f3e94155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:13:39.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.343+0000 7f3e93fff640 1 --2- 172.21.15.18:0/1483115062 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e940d1990 0x7f3e940b9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:13:39.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.343+0000 7f3e98b61640 1 --2- 172.21.15.18:0/1483115062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e9415ecc0 0x7f3e94156170 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c00cb40 tx=0x7f3e8c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:39.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.343+0000 7f3e90ff9640 1 -- 172.21.15.18:0/1483115062 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c017070 con 0x7f3e9415ecc0 2024-09-19T09:13:39.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.343+0000 7f3e90ff9640 1 -- 172.21.15.18:0/1483115062 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e8c00aca0 con 0x7f3e9415ecc0 2024-09-19T09:13:39.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.343+0000 7f3e9a5c4640 1 -- 172.21.15.18:0/1483115062 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e940c89e0 con 0x7f3e9415ecc0 2024-09-19T09:13:39.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.343+0000 7f3e90ff9640 1 -- 172.21.15.18:0/1483115062 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c012620 con 0x7f3e9415ecc0 2024-09-19T09:13:39.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.343+0000 7f3e9a5c4640 1 -- 172.21.15.18:0/1483115062 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e940c8fa0 con 0x7f3e9415ecc0 2024-09-19T09:13:39.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.344+0000 7f3e9a5c4640 1 -- 172.21.15.18:0/1483115062 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e940d1450 con 0x7f3e9415ecc0 2024-09-19T09:13:39.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.345+0000 7f3e90ff9640 1 -- 172.21.15.18:0/1483115062 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3e8c01a070 con 0x7f3e9415ecc0 2024-09-19T09:13:39.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.345+0000 7f3e90ff9640 1 --2- 172.21.15.18:0/1483115062 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3e8006c2e0 0x7f3e8006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:39.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.345+0000 7f3e90ff9640 1 -- 172.21.15.18:0/1483115062 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3e8c08b1e0 con 0x7f3e9415ecc0 2024-09-19T09:13:39.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.345+0000 7f3e93fff640 1 --2- 172.21.15.18:0/1483115062 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3e8006c2e0 0x7f3e8006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:39.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.346+0000 7f3e93fff640 1 --2- 172.21.15.18:0/1483115062 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3e8006c2e0 0x7f3e8006e7a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3e84007fd0 tx=0x7f3e84009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:39.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.349+0000 7f3e90ff9640 1 -- 172.21.15.18:0/1483115062 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3e8c0599e0 con 0x7f3e9415ecc0 2024-09-19T09:13:39.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.521+0000 7f3e9a5c4640 1 -- 172.21.15.18:0/1483115062 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3e9408e3c0 con 0x7f3e8006c2e0 2024-09-19T09:13:39.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.528+0000 7f3e90ff9640 1 -- 172.21.15.18:0/1483115062 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247486 (secure 0 0 0) 0x7f3e9408e3c0 con 0x7f3e8006c2e0 2024-09-19T09:13:39.532 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:39.534 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:13:39.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.530+0000 7f3e9a5c4640 1 -- 172.21.15.18:0/1483115062 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3e8006c2e0 msgr2=0x7f3e8006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:39.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.530+0000 7f3e9a5c4640 1 --2- 172.21.15.18:0/1483115062 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3e8006c2e0 0x7f3e8006e7a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3e84007fd0 tx=0x7f3e84009040 comp rx=0 tx=0).stop 2024-09-19T09:13:39.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.530+0000 7f3e9a5c4640 1 -- 172.21.15.18:0/1483115062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e9415ecc0 msgr2=0x7f3e94156170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:39.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.530+0000 7f3e9a5c4640 1 --2- 172.21.15.18:0/1483115062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e9415ecc0 0x7f3e94156170 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c00cb40 tx=0x7f3e8c00a060 comp rx=0 tx=0).stop 2024-09-19T09:13:39.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.530+0000 7f3e9a5c4640 1 -- 172.21.15.18:0/1483115062 shutdown_connections 2024-09-19T09:13:39.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.530+0000 7f3e9a5c4640 1 --2- 172.21.15.18:0/1483115062 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3e8006c2e0 0x7f3e8006e7a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:39.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.530+0000 7f3e9a5c4640 1 --2- 172.21.15.18:0/1483115062 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e9415ecc0 0x7f3e94156170 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:39.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.530+0000 7f3e9a5c4640 1 --2- 172.21.15.18:0/1483115062 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e940d57a0 0x7f3e94155c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:39.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.530+0000 7f3e9a5c4640 1 --2- 172.21.15.18:0/1483115062 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e940d1990 0x7f3e940b9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:39.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.530+0000 7f3e9a5c4640 1 -- 172.21.15.18:0/1483115062 >> 172.21.15.18:0/1483115062 conn(0x7f3e940d4bd0 msgr2=0x7f3e940b31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:39.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.531+0000 7f3e9a5c4640 1 -- 172.21.15.18:0/1483115062 shutdown_connections 2024-09-19T09:13:39.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.531+0000 7f3e9a5c4640 1 -- 172.21.15.18:0/1483115062 wait complete. 2024-09-19T09:13:39.542 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-19T09:13:37.524309+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1747,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560752,"statfs":{"total":1600000000,"available":1598210884,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002246"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495042+0000","last_change":"2024-09-19T09:13:27.519028+0000","last_active":"2024-09-19T09:13:29.495042+0000","last_peered":"2024-09-19T09:13:29.495042+0000","last_clean":"2024-09-19T09:13:29.495042+0000","last_became_active":"2024-09-19T09:13:27.518073+0000","last_became_peered":"2024-09-19T09:13:27.518073+0000","last_unstale":"2024-09-19T09:13:29.495042+0000","last_undegraded":"2024-09-19T09:13:29.495042+0000","last_fullsized":"2024-09-19T09:13:29.495042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:46.115198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.743786+0000","last_change":"2024-09-19T09:13:27.503682+0000","last_active":"2024-09-19T09:13:28.743786+0000","last_peered":"2024-09-19T09:13:28.743786+0000","last_clean":"2024-09-19T09:13:28.743786+0000","last_became_active":"2024-09-19T09:13:27.503423+0000","last_became_peered":"2024-09-19T09:13:27.503423+0000","last_unstale":"2024-09-19T09:13:28.743786+0000","last_undegraded":"2024-09-19T09:13:28.743786+0000","last_fullsized":"2024-09-19T09:13:28.743786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:26.355358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.743981+0000","last_change":"2024-09-19T09:13:27.507108+0000","last_active":"2024-09-19T09:13:28.743981+0000","last_peered":"2024-09-19T09:13:28.743981+0000","last_clean":"2024-09-19T09:13:28.743981+0000","last_became_active":"2024-09-19T09:13:27.506849+0000","last_became_peered":"2024-09-19T09:13:27.506849+0000","last_unstale":"2024-09-19T09:13:28.743981+0000","last_undegraded":"2024-09-19T09:13:28.743981+0000","last_fullsized":"2024-09-19T09:13:28.743981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:04.199671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.507424+0000","last_change":"2024-09-19T09:13:27.513588+0000","last_active":"2024-09-19T09:13:28.507424+0000","last_peered":"2024-09-19T09:13:28.507424+0000","last_clean":"2024-09-19T09:13:28.507424+0000","last_became_active":"2024-09-19T09:13:27.512588+0000","last_became_peered":"2024-09-19T09:13:27.512588+0000","last_unstale":"2024-09-19T09:13:28.507424+0000","last_undegraded":"2024-09-19T09:13:28.507424+0000","last_fullsized":"2024-09-19T09:13:28.507424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:55.304446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495369+0000","last_change":"2024-09-19T09:13:27.515156+0000","last_active":"2024-09-19T09:13:29.495369+0000","last_peered":"2024-09-19T09:13:29.495369+0000","last_clean":"2024-09-19T09:13:29.495369+0000","last_became_active":"2024-09-19T09:13:27.513242+0000","last_became_peered":"2024-09-19T09:13:27.513242+0000","last_unstale":"2024-09-19T09:13:29.495369+0000","last_undegraded":"2024-09-19T09:13:29.495369+0000","last_fullsized":"2024-09-19T09:13:29.495369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:43.531169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.507982+0000","last_change":"2024-09-19T09:13:27.514651+0000","last_active":"2024-09-19T09:13:28.507982+0000","last_peered":"2024-09-19T09:13:28.507982+0000","last_clean":"2024-09-19T09:13:28.507982+0000","last_became_active":"2024-09-19T09:13:27.514234+0000","last_became_peered":"2024-09-19T09:13:27.514234+0000","last_unstale":"2024-09-19T09:13:28.507982+0000","last_undegraded":"2024-09-19T09:13:28.507982+0000","last_fullsized":"2024-09-19T09:13:28.507982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:09.761563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495773+0000","last_change":"2024-09-19T09:13:27.513315+0000","last_active":"2024-09-19T09:13:29.495773+0000","last_peered":"2024-09-19T09:13:29.495773+0000","last_clean":"2024-09-19T09:13:29.495773+0000","last_became_active":"2024-09-19T09:13:27.512682+0000","last_became_peered":"2024-09-19T09:13:27.512682+0000","last_unstale":"2024-09-19T09:13:29.495773+0000","last_undegraded":"2024-09-19T09:13:29.495773+0000","last_fullsized":"2024-09-19T09:13:29.495773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:12:56.998451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.744145+0000","last_change":"2024-09-19T09:13:27.508840+0000","last_active":"2024-09-19T09:13:28.744145+0000","last_peered":"2024-09-19T09:13:28.744145+0000","last_clean":"2024-09-19T09:13:28.744145+0000","last_became_active":"2024-09-19T09:13:27.508595+0000","last_became_peered":"2024-09-19T09:13:27.508595+0000","last_unstale":"2024-09-19T09:13:28.744145+0000","last_undegraded":"2024-09-19T09:13:28.744145+0000","last_fullsized":"2024-09-19T09:13:28.744145+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:58.902836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.677725+0000","last_change":"2024-09-19T09:13:27.502831+0000","last_active":"2024-09-19T09:13:29.677725+0000","last_peered":"2024-09-19T09:13:29.677725+0000","last_clean":"2024-09-19T09:13:29.677725+0000","last_became_active":"2024-09-19T09:13:27.502594+0000","last_became_peered":"2024-09-19T09:13:27.502594+0000","last_unstale":"2024-09-19T09:13:29.677725+0000","last_undegraded":"2024-09-19T09:13:29.677725+0000","last_fullsized":"2024-09-19T09:13:29.677725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:26:02.836853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495469+0000","last_change":"2024-09-19T09:13:27.512903+0000","last_active":"2024-09-19T09:13:29.495469+0000","last_peered":"2024-09-19T09:13:29.495469+0000","last_clean":"2024-09-19T09:13:29.495469+0000","last_became_active":"2024-09-19T09:13:27.508431+0000","last_became_peered":"2024-09-19T09:13:27.508431+0000","last_unstale":"2024-09-19T09:13:29.495469+0000","last_undegraded":"2024-09-19T09:13:29.495469+0000","last_fullsized":"2024-09-19T09:13:29.495469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:43.740664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495238+0000","last_change":"2024-09-19T09:13:27.518369+0000","last_active":"2024-09-19T09:13:29.495238+0000","last_peered":"2024-09-19T09:13:29.495238+0000","last_clean":"2024-09-19T09:13:29.495238+0000","last_became_active":"2024-09-19T09:13:27.516932+0000","last_became_peered":"2024-09-19T09:13:27.516932+0000","last_unstale":"2024-09-19T09:13:29.495238+0000","last_undegraded":"2024-09-19T09:13:29.495238+0000","last_fullsized":"2024-09-19T09:13:29.495238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:36.626961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495237+0000","last_change":"2024-09-19T09:13:27.513595+0000","last_active":"2024-09-19T09:13:29.495237+0000","last_peered":"2024-09-19T09:13:29.495237+0000","last_clean":"2024-09-19T09:13:29.495237+0000","last_became_active":"2024-09-19T09:13:27.512993+0000","last_became_peered":"2024-09-19T09:13:27.512993+0000","last_unstale":"2024-09-19T09:13:29.495237+0000","last_undegraded":"2024-09-19T09:13:29.495237+0000","last_fullsized":"2024-09-19T09:13:29.495237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:16.961946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.507646+0000","last_change":"2024-09-19T09:13:27.510731+0000","last_active":"2024-09-19T09:13:28.507646+0000","last_peered":"2024-09-19T09:13:28.507646+0000","last_clean":"2024-09-19T09:13:28.507646+0000","last_became_active":"2024-09-19T09:13:27.509501+0000","last_became_peered":"2024-09-19T09:13:27.509501+0000","last_unstale":"2024-09-19T09:13:28.507646+0000","last_undegraded":"2024-09-19T09:13:28.507646+0000","last_fullsized":"2024-09-19T09:13:28.507646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:47.710342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.507657+0000","last_change":"2024-09-19T09:13:27.500908+0000","last_active":"2024-09-19T09:13:28.507657+0000","last_peered":"2024-09-19T09:13:28.507657+0000","last_clean":"2024-09-19T09:13:28.507657+0000","last_became_active":"2024-09-19T09:13:27.500685+0000","last_became_peered":"2024-09-19T09:13:27.500685+0000","last_unstale":"2024-09-19T09:13:28.507657+0000","last_undegraded":"2024-09-19T09:13:28.507657+0000","last_fullsized":"2024-09-19T09:13:28.507657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:27.101570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.744134+0000","last_change":"2024-09-19T09:13:27.510338+0000","last_active":"2024-09-19T09:13:28.744134+0000","last_peered":"2024-09-19T09:13:28.744134+0000","last_clean":"2024-09-19T09:13:28.744134+0000","last_became_active":"2024-09-19T09:13:27.509885+0000","last_became_peered":"2024-09-19T09:13:27.509885+0000","last_unstale":"2024-09-19T09:13:28.744134+0000","last_undegraded":"2024-09-19T09:13:28.744134+0000","last_fullsized":"2024-09-19T09:13:28.744134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:22.872883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844670+0000","last_change":"2024-09-19T09:13:27.510472+0000","last_active":"2024-09-19T09:13:29.844670+0000","last_peered":"2024-09-19T09:13:29.844670+0000","last_clean":"2024-09-19T09:13:29.844670+0000","last_became_active":"2024-09-19T09:13:27.509440+0000","last_became_peered":"2024-09-19T09:13:27.509440+0000","last_unstale":"2024-09-19T09:13:29.844670+0000","last_undegraded":"2024-09-19T09:13:29.844670+0000","last_fullsized":"2024-09-19T09:13:29.844670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:36.943128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844505+0000","last_change":"2024-09-19T09:13:27.515299+0000","last_active":"2024-09-19T09:13:29.844505+0000","last_peered":"2024-09-19T09:13:29.844505+0000","last_clean":"2024-09-19T09:13:29.844505+0000","last_became_active":"2024-09-19T09:13:27.515060+0000","last_became_peered":"2024-09-19T09:13:27.515060+0000","last_unstale":"2024-09-19T09:13:29.844505+0000","last_undegraded":"2024-09-19T09:13:29.844505+0000","last_fullsized":"2024-09-19T09:13:29.844505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:20.833006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.568445+0000","last_change":"2024-09-19T09:13:27.505357+0000","last_active":"2024-09-19T09:13:28.568445+0000","last_peered":"2024-09-19T09:13:28.568445+0000","last_clean":"2024-09-19T09:13:28.568445+0000","last_became_active":"2024-09-19T09:13:27.505132+0000","last_became_peered":"2024-09-19T09:13:27.505132+0000","last_unstale":"2024-09-19T09:13:28.568445+0000","last_undegraded":"2024-09-19T09:13:28.568445+0000","last_fullsized":"2024-09-19T09:13:28.568445+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:53:29.605543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844733+0000","last_change":"2024-09-19T09:13:27.511545+0000","last_active":"2024-09-19T09:13:29.844733+0000","last_peered":"2024-09-19T09:13:29.844733+0000","last_clean":"2024-09-19T09:13:29.844733+0000","last_became_active":"2024-09-19T09:13:27.511285+0000","last_became_peered":"2024-09-19T09:13:27.511285+0000","last_unstale":"2024-09-19T09:13:29.844733+0000","last_undegraded":"2024-09-19T09:13:29.844733+0000","last_fullsized":"2024-09-19T09:13:29.844733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:55:16.947702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495579+0000","last_change":"2024-09-19T09:13:27.508681+0000","last_active":"2024-09-19T09:13:29.495579+0000","last_peered":"2024-09-19T09:13:29.495579+0000","last_clean":"2024-09-19T09:13:29.495579+0000","last_became_active":"2024-09-19T09:13:27.507612+0000","last_became_peered":"2024-09-19T09:13:27.507612+0000","last_unstale":"2024-09-19T09:13:29.495579+0000","last_undegraded":"2024-09-19T09:13:29.495579+0000","last_fullsized":"2024-09-19T09:13:29.495579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:36.069417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493350+0000","last_change":"2024-09-19T09:13:27.512295+0000","last_active":"2024-09-19T09:13:29.493350+0000","last_peered":"2024-09-19T09:13:29.493350+0000","last_clean":"2024-09-19T09:13:29.493350+0000","last_became_active":"2024-09-19T09:13:27.512007+0000","last_became_peered":"2024-09-19T09:13:27.512007+0000","last_unstale":"2024-09-19T09:13:29.493350+0000","last_undegraded":"2024-09-19T09:13:29.493350+0000","last_fullsized":"2024-09-19T09:13:29.493350+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:56.832240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.677613+0000","last_change":"2024-09-19T09:13:27.516493+0000","last_active":"2024-09-19T09:13:29.677613+0000","last_peered":"2024-09-19T09:13:29.677613+0000","last_clean":"2024-09-19T09:13:29.677613+0000","last_became_active":"2024-09-19T09:13:27.516254+0000","last_became_peered":"2024-09-19T09:13:27.516254+0000","last_unstale":"2024-09-19T09:13:29.677613+0000","last_undegraded":"2024-09-19T09:13:29.677613+0000","last_fullsized":"2024-09-19T09:13:29.677613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:47:33.906886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.744536+0000","last_change":"2024-09-19T09:13:27.505900+0000","last_active":"2024-09-19T09:13:28.744536+0000","last_peered":"2024-09-19T09:13:28.744536+0000","last_clean":"2024-09-19T09:13:28.744536+0000","last_became_active":"2024-09-19T09:13:27.505663+0000","last_became_peered":"2024-09-19T09:13:27.505663+0000","last_unstale":"2024-09-19T09:13:28.744536+0000","last_undegraded":"2024-09-19T09:13:28.744536+0000","last_fullsized":"2024-09-19T09:13:28.744536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:15:42.898470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844391+0000","last_change":"2024-09-19T09:13:27.506571+0000","last_active":"2024-09-19T09:13:29.844391+0000","last_peered":"2024-09-19T09:13:29.844391+0000","last_clean":"2024-09-19T09:13:29.844391+0000","last_became_active":"2024-09-19T09:13:27.506184+0000","last_became_peered":"2024-09-19T09:13:27.506184+0000","last_unstale":"2024-09-19T09:13:29.844391+0000","last_undegraded":"2024-09-19T09:13:29.844391+0000","last_fullsized":"2024-09-19T09:13:29.844391+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:23.072934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.744303+0000","last_change":"2024-09-19T09:13:27.506211+0000","last_active":"2024-09-19T09:13:28.744303+0000","last_peered":"2024-09-19T09:13:28.744303+0000","last_clean":"2024-09-19T09:13:28.744303+0000","last_became_active":"2024-09-19T09:13:27.504555+0000","last_became_peered":"2024-09-19T09:13:27.504555+0000","last_unstale":"2024-09-19T09:13:28.744303+0000","last_undegraded":"2024-09-19T09:13:28.744303+0000","last_fullsized":"2024-09-19T09:13:28.744303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:15.242387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.508101+0000","last_change":"2024-09-19T09:13:27.513189+0000","last_active":"2024-09-19T09:13:28.508101+0000","last_peered":"2024-09-19T09:13:28.508101+0000","last_clean":"2024-09-19T09:13:28.508101+0000","last_became_active":"2024-09-19T09:13:27.512960+0000","last_became_peered":"2024-09-19T09:13:27.512960+0000","last_unstale":"2024-09-19T09:13:28.508101+0000","last_undegraded":"2024-09-19T09:13:28.508101+0000","last_fullsized":"2024-09-19T09:13:28.508101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:34:15.787088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.508496+0000","last_change":"2024-09-19T09:13:27.502537+0000","last_active":"2024-09-19T09:13:28.508496+0000","last_peered":"2024-09-19T09:13:28.508496+0000","last_clean":"2024-09-19T09:13:28.508496+0000","last_became_active":"2024-09-19T09:13:27.501832+0000","last_became_peered":"2024-09-19T09:13:27.501832+0000","last_unstale":"2024-09-19T09:13:28.508496+0000","last_undegraded":"2024-09-19T09:13:28.508496+0000","last_fullsized":"2024-09-19T09:13:28.508496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:39.127110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.508032+0000","last_change":"2024-09-19T09:13:27.509123+0000","last_active":"2024-09-19T09:13:28.508032+0000","last_peered":"2024-09-19T09:13:28.508032+0000","last_clean":"2024-09-19T09:13:28.508032+0000","last_became_active":"2024-09-19T09:13:27.508901+0000","last_became_peered":"2024-09-19T09:13:27.508901+0000","last_unstale":"2024-09-19T09:13:28.508032+0000","last_undegraded":"2024-09-19T09:13:28.508032+0000","last_fullsized":"2024-09-19T09:13:28.508032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:24:04.327514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.743839+0000","last_change":"2024-09-19T09:13:27.501012+0000","last_active":"2024-09-19T09:13:28.743839+0000","last_peered":"2024-09-19T09:13:28.743839+0000","last_clean":"2024-09-19T09:13:28.743839+0000","last_became_active":"2024-09-19T09:13:27.497063+0000","last_became_peered":"2024-09-19T09:13:27.497063+0000","last_unstale":"2024-09-19T09:13:28.743839+0000","last_undegraded":"2024-09-19T09:13:28.743839+0000","last_fullsized":"2024-09-19T09:13:28.743839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:08.043528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844492+0000","last_change":"2024-09-19T09:13:27.509716+0000","last_active":"2024-09-19T09:13:29.844492+0000","last_peered":"2024-09-19T09:13:29.844492+0000","last_clean":"2024-09-19T09:13:29.844492+0000","last_became_active":"2024-09-19T09:13:27.509413+0000","last_became_peered":"2024-09-19T09:13:27.509413+0000","last_unstale":"2024-09-19T09:13:29.844492+0000","last_undegraded":"2024-09-19T09:13:29.844492+0000","last_fullsized":"2024-09-19T09:13:29.844492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:26.682977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.568641+0000","last_change":"2024-09-19T09:13:27.499551+0000","last_active":"2024-09-19T09:13:28.568641+0000","last_peered":"2024-09-19T09:13:28.568641+0000","last_clean":"2024-09-19T09:13:28.568641+0000","last_became_active":"2024-09-19T09:13:27.499310+0000","last_became_peered":"2024-09-19T09:13:27.499310+0000","last_unstale":"2024-09-19T09:13:28.568641+0000","last_undegraded":"2024-09-19T09:13:28.568641+0000","last_fullsized":"2024-09-19T09:13:28.568641+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:24.161816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.507533+0000","last_change":"2024-09-19T09:13:27.504478+0000","last_active":"2024-09-19T09:13:28.507533+0000","last_peered":"2024-09-19T09:13:28.507533+0000","last_clean":"2024-09-19T09:13:28.507533+0000","last_became_active":"2024-09-19T09:13:27.504229+0000","last_became_peered":"2024-09-19T09:13:27.504229+0000","last_unstale":"2024-09-19T09:13:28.507533+0000","last_undegraded":"2024-09-19T09:13:28.507533+0000","last_fullsized":"2024-09-19T09:13:28.507533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:01:34.671234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.677596+0000","last_change":"2024-09-19T09:13:27.499496+0000","last_active":"2024-09-19T09:13:29.677596+0000","last_peered":"2024-09-19T09:13:29.677596+0000","last_clean":"2024-09-19T09:13:29.677596+0000","last_became_active":"2024-09-19T09:13:27.498761+0000","last_became_peered":"2024-09-19T09:13:27.498761+0000","last_unstale":"2024-09-19T09:13:29.677596+0000","last_undegraded":"2024-09-19T09:13:29.677596+0000","last_fullsized":"2024-09-19T09:13:29.677596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:37.512544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.743924+0000","last_change":"2024-09-19T09:13:26.503044+0000","last_active":"2024-09-19T09:13:28.743924+0000","last_peered":"2024-09-19T09:13:28.743924+0000","last_clean":"2024-09-19T09:13:28.743924+0000","last_became_active":"2024-09-19T09:13:26.502787+0000","last_became_peered":"2024-09-19T09:13:26.502787+0000","last_unstale":"2024-09-19T09:13:28.743924+0000","last_undegraded":"2024-09-19T09:13:28.743924+0000","last_fullsized":"2024-09-19T09:13:28.743924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:19.218001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493212+0000","last_change":"2024-09-19T09:13:27.510154+0000","last_active":"2024-09-19T09:13:29.493212+0000","last_peered":"2024-09-19T09:13:29.493212+0000","last_clean":"2024-09-19T09:13:29.493212+0000","last_became_active":"2024-09-19T09:13:27.509908+0000","last_became_peered":"2024-09-19T09:13:27.509908+0000","last_unstale":"2024-09-19T09:13:29.493212+0000","last_undegraded":"2024-09-19T09:13:29.493212+0000","last_fullsized":"2024-09-19T09:13:29.493212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:11.167828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844324+0000","last_change":"2024-09-19T09:13:26.506712+0000","last_active":"2024-09-19T09:13:29.844324+0000","last_peered":"2024-09-19T09:13:29.844324+0000","last_clean":"2024-09-19T09:13:29.844324+0000","last_became_active":"2024-09-19T09:13:26.506244+0000","last_became_peered":"2024-09-19T09:13:26.506244+0000","last_unstale":"2024-09-19T09:13:29.844324+0000","last_undegraded":"2024-09-19T09:13:29.844324+0000","last_fullsized":"2024-09-19T09:13:29.844324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:11.404705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.507759+0000","last_change":"2024-09-19T09:13:26.505620+0000","last_active":"2024-09-19T09:13:28.507759+0000","last_peered":"2024-09-19T09:13:28.507759+0000","last_clean":"2024-09-19T09:13:28.507759+0000","last_became_active":"2024-09-19T09:13:26.505383+0000","last_became_peered":"2024-09-19T09:13:26.505383+0000","last_unstale":"2024-09-19T09:13:28.507759+0000","last_undegraded":"2024-09-19T09:13:28.507759+0000","last_fullsized":"2024-09-19T09:13:28.507759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:32.720854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.744458+0000","last_change":"2024-09-19T09:13:27.506460+0000","last_active":"2024-09-19T09:13:28.744458+0000","last_peered":"2024-09-19T09:13:28.744458+0000","last_clean":"2024-09-19T09:13:28.744458+0000","last_became_active":"2024-09-19T09:13:27.505516+0000","last_became_peered":"2024-09-19T09:13:27.505516+0000","last_unstale":"2024-09-19T09:13:28.744458+0000","last_undegraded":"2024-09-19T09:13:28.744458+0000","last_fullsized":"2024-09-19T09:13:28.744458+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:37.956145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.845064+0000","last_change":"2024-09-19T09:13:26.507051+0000","last_active":"2024-09-19T09:13:29.845064+0000","last_peered":"2024-09-19T09:13:29.845064+0000","last_clean":"2024-09-19T09:13:29.845064+0000","last_became_active":"2024-09-19T09:13:26.506557+0000","last_became_peered":"2024-09-19T09:13:26.506557+0000","last_unstale":"2024-09-19T09:13:29.845064+0000","last_undegraded":"2024-09-19T09:13:29.845064+0000","last_fullsized":"2024-09-19T09:13:29.845064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:19:06.034747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493381+0000","last_change":"2024-09-19T09:13:27.510098+0000","last_active":"2024-09-19T09:13:29.493381+0000","last_peered":"2024-09-19T09:13:29.493381+0000","last_clean":"2024-09-19T09:13:29.493381+0000","last_became_active":"2024-09-19T09:13:27.509844+0000","last_became_peered":"2024-09-19T09:13:27.509844+0000","last_unstale":"2024-09-19T09:13:29.493381+0000","last_undegraded":"2024-09-19T09:13:29.493381+0000","last_fullsized":"2024-09-19T09:13:29.493381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:09:31.853647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.677954+0000","last_change":"2024-09-19T09:13:26.501053+0000","last_active":"2024-09-19T09:13:29.677954+0000","last_peered":"2024-09-19T09:13:29.677954+0000","last_clean":"2024-09-19T09:13:29.677954+0000","last_became_active":"2024-09-19T09:13:26.500814+0000","last_became_peered":"2024-09-19T09:13:26.500814+0000","last_unstale":"2024-09-19T09:13:29.677954+0000","last_undegraded":"2024-09-19T09:13:29.677954+0000","last_fullsized":"2024-09-19T09:13:29.677954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:04.484574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.507967+0000","last_change":"2024-09-19T09:13:27.510096+0000","last_active":"2024-09-19T09:13:28.507967+0000","last_peered":"2024-09-19T09:13:28.507967+0000","last_clean":"2024-09-19T09:13:28.507967+0000","last_became_active":"2024-09-19T09:13:27.509812+0000","last_became_peered":"2024-09-19T09:13:27.509812+0000","last_unstale":"2024-09-19T09:13:28.507967+0000","last_undegraded":"2024-09-19T09:13:28.507967+0000","last_fullsized":"2024-09-19T09:13:28.507967+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:29:16.817154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495626+0000","last_change":"2024-09-19T09:13:26.498971+0000","last_active":"2024-09-19T09:13:29.495626+0000","last_peered":"2024-09-19T09:13:29.495626+0000","last_clean":"2024-09-19T09:13:29.495626+0000","last_became_active":"2024-09-19T09:13:26.498737+0000","last_became_peered":"2024-09-19T09:13:26.498737+0000","last_unstale":"2024-09-19T09:13:29.495626+0000","last_undegraded":"2024-09-19T09:13:29.495626+0000","last_fullsized":"2024-09-19T09:13:29.495626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:57:32.747213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.743822+0000","last_change":"2024-09-19T09:13:27.508024+0000","last_active":"2024-09-19T09:13:28.743822+0000","last_peered":"2024-09-19T09:13:28.743822+0000","last_clean":"2024-09-19T09:13:28.743822+0000","last_became_active":"2024-09-19T09:13:27.507792+0000","last_became_peered":"2024-09-19T09:13:27.507792+0000","last_unstale":"2024-09-19T09:13:28.743822+0000","last_undegraded":"2024-09-19T09:13:28.743822+0000","last_fullsized":"2024-09-19T09:13:28.743822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:47.574882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.568756+0000","last_change":"2024-09-19T09:13:26.499983+0000","last_active":"2024-09-19T09:13:28.568756+0000","last_peered":"2024-09-19T09:13:28.568756+0000","last_clean":"2024-09-19T09:13:28.568756+0000","last_became_active":"2024-09-19T09:13:26.499730+0000","last_became_peered":"2024-09-19T09:13:26.499730+0000","last_unstale":"2024-09-19T09:13:28.568756+0000","last_undegraded":"2024-09-19T09:13:28.568756+0000","last_fullsized":"2024-09-19T09:13:28.568756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:03.238517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844555+0000","last_change":"2024-09-19T09:13:27.510849+0000","last_active":"2024-09-19T09:13:29.844555+0000","last_peered":"2024-09-19T09:13:29.844555+0000","last_clean":"2024-09-19T09:13:29.844555+0000","last_became_active":"2024-09-19T09:13:27.509292+0000","last_became_peered":"2024-09-19T09:13:27.509292+0000","last_unstale":"2024-09-19T09:13:29.844555+0000","last_undegraded":"2024-09-19T09:13:29.844555+0000","last_fullsized":"2024-09-19T09:13:29.844555+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:40.206034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.508003+0000","last_change":"2024-09-19T09:13:26.501792+0000","last_active":"2024-09-19T09:13:28.508003+0000","last_peered":"2024-09-19T09:13:28.508003+0000","last_clean":"2024-09-19T09:13:28.508003+0000","last_became_active":"2024-09-19T09:13:26.501463+0000","last_became_peered":"2024-09-19T09:13:26.501463+0000","last_unstale":"2024-09-19T09:13:28.508003+0000","last_undegraded":"2024-09-19T09:13:28.508003+0000","last_fullsized":"2024-09-19T09:13:28.508003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:21.830229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495227+0000","last_change":"2024-09-19T09:13:27.507955+0000","last_active":"2024-09-19T09:13:29.495227+0000","last_peered":"2024-09-19T09:13:29.495227+0000","last_clean":"2024-09-19T09:13:29.495227+0000","last_became_active":"2024-09-19T09:13:27.506341+0000","last_became_peered":"2024-09-19T09:13:27.506341+0000","last_unstale":"2024-09-19T09:13:29.495227+0000","last_undegraded":"2024-09-19T09:13:29.495227+0000","last_fullsized":"2024-09-19T09:13:29.495227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:51.344378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.568494+0000","last_change":"2024-09-19T09:13:26.498042+0000","last_active":"2024-09-19T09:13:28.568494+0000","last_peered":"2024-09-19T09:13:28.568494+0000","last_clean":"2024-09-19T09:13:28.568494+0000","last_became_active":"2024-09-19T09:13:26.497811+0000","last_became_peered":"2024-09-19T09:13:26.497811+0000","last_unstale":"2024-09-19T09:13:28.568494+0000","last_undegraded":"2024-09-19T09:13:28.568494+0000","last_fullsized":"2024-09-19T09:13:28.568494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:43.720848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.508171+0000","last_change":"2024-09-19T09:13:27.510470+0000","last_active":"2024-09-19T09:13:28.508171+0000","last_peered":"2024-09-19T09:13:28.508171+0000","last_clean":"2024-09-19T09:13:28.508171+0000","last_became_active":"2024-09-19T09:13:27.510158+0000","last_became_peered":"2024-09-19T09:13:27.510158+0000","last_unstale":"2024-09-19T09:13:28.508171+0000","last_undegraded":"2024-09-19T09:13:28.508171+0000","last_fullsized":"2024-09-19T09:13:28.508171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:27.533437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844721+0000","last_change":"2024-09-19T09:13:26.507022+0000","last_active":"2024-09-19T09:13:29.844721+0000","last_peered":"2024-09-19T09:13:29.844721+0000","last_clean":"2024-09-19T09:13:29.844721+0000","last_became_active":"2024-09-19T09:13:26.506756+0000","last_became_peered":"2024-09-19T09:13:26.506756+0000","last_unstale":"2024-09-19T09:13:29.844721+0000","last_undegraded":"2024-09-19T09:13:29.844721+0000","last_fullsized":"2024-09-19T09:13:29.844721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:53.915299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844819+0000","last_change":"2024-09-19T09:13:27.515543+0000","last_active":"2024-09-19T09:13:29.844819+0000","last_peered":"2024-09-19T09:13:29.844819+0000","last_clean":"2024-09-19T09:13:29.844819+0000","last_became_active":"2024-09-19T09:13:27.514992+0000","last_became_peered":"2024-09-19T09:13:27.514992+0000","last_unstale":"2024-09-19T09:13:29.844819+0000","last_undegraded":"2024-09-19T09:13:29.844819+0000","last_fullsized":"2024-09-19T09:13:29.844819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:04.883876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495856+0000","last_change":"2024-09-19T09:13:26.506703+0000","last_active":"2024-09-19T09:13:29.495856+0000","last_peered":"2024-09-19T09:13:29.495856+0000","last_clean":"2024-09-19T09:13:29.495856+0000","last_became_active":"2024-09-19T09:13:26.506378+0000","last_became_peered":"2024-09-19T09:13:26.506378+0000","last_unstale":"2024-09-19T09:13:29.495856+0000","last_undegraded":"2024-09-19T09:13:29.495856+0000","last_fullsized":"2024-09-19T09:13:29.495856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:47:00.782277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.677791+0000","last_change":"2024-09-19T09:13:27.499731+0000","last_active":"2024-09-19T09:13:29.677791+0000","last_peered":"2024-09-19T09:13:29.677791+0000","last_clean":"2024-09-19T09:13:29.677791+0000","last_became_active":"2024-09-19T09:13:27.499258+0000","last_became_peered":"2024-09-19T09:13:27.499258+0000","last_unstale":"2024-09-19T09:13:29.677791+0000","last_undegraded":"2024-09-19T09:13:29.677791+0000","last_fullsized":"2024-09-19T09:13:29.677791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:20.482950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493528+0000","last_change":"2024-09-19T09:13:26.499537+0000","last_active":"2024-09-19T09:13:29.493528+0000","last_peered":"2024-09-19T09:13:29.493528+0000","last_clean":"2024-09-19T09:13:29.493528+0000","last_became_active":"2024-09-19T09:13:26.499042+0000","last_became_peered":"2024-09-19T09:13:26.499042+0000","last_unstale":"2024-09-19T09:13:29.493528+0000","last_undegraded":"2024-09-19T09:13:29.493528+0000","last_fullsized":"2024-09-19T09:13:29.493528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:44.351314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844654+0000","last_change":"2024-09-19T09:13:27.508811+0000","last_active":"2024-09-19T09:13:29.844654+0000","last_peered":"2024-09-19T09:13:29.844654+0000","last_clean":"2024-09-19T09:13:29.844654+0000","last_became_active":"2024-09-19T09:13:27.508529+0000","last_became_peered":"2024-09-19T09:13:27.508529+0000","last_unstale":"2024-09-19T09:13:29.844654+0000","last_undegraded":"2024-09-19T09:13:29.844654+0000","last_fullsized":"2024-09-19T09:13:29.844654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:56.255284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495032+0000","last_change":"2024-09-19T09:13:26.504376+0000","last_active":"2024-09-19T09:13:29.495032+0000","last_peered":"2024-09-19T09:13:29.495032+0000","last_clean":"2024-09-19T09:13:29.495032+0000","last_became_active":"2024-09-19T09:13:26.504121+0000","last_became_peered":"2024-09-19T09:13:26.504121+0000","last_unstale":"2024-09-19T09:13:29.495032+0000","last_undegraded":"2024-09-19T09:13:29.495032+0000","last_fullsized":"2024-09-19T09:13:29.495032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:10.129519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.507470+0000","last_change":"2024-09-19T09:13:27.510114+0000","last_active":"2024-09-19T09:13:28.507470+0000","last_peered":"2024-09-19T09:13:28.507470+0000","last_clean":"2024-09-19T09:13:28.507470+0000","last_became_active":"2024-09-19T09:13:27.509862+0000","last_became_peered":"2024-09-19T09:13:27.509862+0000","last_unstale":"2024-09-19T09:13:28.507470+0000","last_undegraded":"2024-09-19T09:13:28.507470+0000","last_fullsized":"2024-09-19T09:13:28.507470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:44.225098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493249+0000","last_change":"2024-09-19T09:13:26.501637+0000","last_active":"2024-09-19T09:13:29.493249+0000","last_peered":"2024-09-19T09:13:29.493249+0000","last_clean":"2024-09-19T09:13:29.493249+0000","last_became_active":"2024-09-19T09:13:26.501409+0000","last_became_peered":"2024-09-19T09:13:26.501409+0000","last_unstale":"2024-09-19T09:13:29.493249+0000","last_undegraded":"2024-09-19T09:13:29.493249+0000","last_fullsized":"2024-09-19T09:13:29.493249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:56.759101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.494899+0000","last_change":"2024-09-19T09:13:27.514969+0000","last_active":"2024-09-19T09:13:29.494899+0000","last_peered":"2024-09-19T09:13:29.494899+0000","last_clean":"2024-09-19T09:13:29.494899+0000","last_became_active":"2024-09-19T09:13:27.514243+0000","last_became_peered":"2024-09-19T09:13:27.514243+0000","last_unstale":"2024-09-19T09:13:29.494899+0000","last_undegraded":"2024-09-19T09:13:29.494899+0000","last_fullsized":"2024-09-19T09:13:29.494899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:19.521214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.743972+0000","last_change":"2024-09-19T09:13:26.503898+0000","last_active":"2024-09-19T09:13:28.743972+0000","last_peered":"2024-09-19T09:13:28.743972+0000","last_clean":"2024-09-19T09:13:28.743972+0000","last_became_active":"2024-09-19T09:13:26.503631+0000","last_became_peered":"2024-09-19T09:13:26.503631+0000","last_unstale":"2024-09-19T09:13:28.743972+0000","last_undegraded":"2024-09-19T09:13:28.743972+0000","last_fullsized":"2024-09-19T09:13:28.743972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:51.106585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495523+0000","last_change":"2024-09-19T09:13:27.508761+0000","last_active":"2024-09-19T09:13:29.495523+0000","last_peered":"2024-09-19T09:13:29.495523+0000","last_clean":"2024-09-19T09:13:29.495523+0000","last_became_active":"2024-09-19T09:13:27.508339+0000","last_became_peered":"2024-09-19T09:13:27.508339+0000","last_unstale":"2024-09-19T09:13:29.495523+0000","last_undegraded":"2024-09-19T09:13:29.495523+0000","last_fullsized":"2024-09-19T09:13:29.495523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:38.236054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.508592+0000","last_change":"2024-09-19T09:13:26.502447+0000","last_active":"2024-09-19T09:13:28.508592+0000","last_peered":"2024-09-19T09:13:28.508592+0000","last_clean":"2024-09-19T09:13:28.508592+0000","last_became_active":"2024-09-19T09:13:26.501912+0000","last_became_peered":"2024-09-19T09:13:26.501912+0000","last_unstale":"2024-09-19T09:13:28.508592+0000","last_undegraded":"2024-09-19T09:13:28.508592+0000","last_fullsized":"2024-09-19T09:13:28.508592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:30:43.690569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844799+0000","last_change":"2024-09-19T09:13:27.501572+0000","last_active":"2024-09-19T09:13:29.844799+0000","last_peered":"2024-09-19T09:13:29.844799+0000","last_clean":"2024-09-19T09:13:29.844799+0000","last_became_active":"2024-09-19T09:13:27.501275+0000","last_became_peered":"2024-09-19T09:13:27.501275+0000","last_unstale":"2024-09-19T09:13:29.844799+0000","last_undegraded":"2024-09-19T09:13:29.844799+0000","last_fullsized":"2024-09-19T09:13:29.844799+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:43.790948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.677844+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:13:29.677844+0000","last_peered":"2024-09-19T09:13:29.677844+0000","last_clean":"2024-09-19T09:13:29.677844+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:13:29.677844+0000","last_undegraded":"2024-09-19T09:13:29.677844+0000","last_fullsized":"2024-09-19T09:13:29.677844+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:22.478151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844853+0000","last_change":"2024-09-19T09:13:26.506369+0000","last_active":"2024-09-19T09:13:29.844853+0000","last_peered":"2024-09-19T09:13:29.844853+0000","last_clean":"2024-09-19T09:13:29.844853+0000","last_became_active":"2024-09-19T09:13:26.506065+0000","last_became_peered":"2024-09-19T09:13:26.506065+0000","last_unstale":"2024-09-19T09:13:29.844853+0000","last_undegraded":"2024-09-19T09:13:29.844853+0000","last_fullsized":"2024-09-19T09:13:29.844853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:18:38.002779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493456+0000","last_change":"2024-09-19T09:13:27.508661+0000","last_active":"2024-09-19T09:13:29.493456+0000","last_peered":"2024-09-19T09:13:29.493456+0000","last_clean":"2024-09-19T09:13:29.493456+0000","last_became_active":"2024-09-19T09:13:27.508377+0000","last_became_peered":"2024-09-19T09:13:27.508377+0000","last_unstale":"2024-09-19T09:13:29.493456+0000","last_undegraded":"2024-09-19T09:13:29.493456+0000","last_fullsized":"2024-09-19T09:13:29.493456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:57:28.264934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844831+0000","last_change":"2024-09-19T09:13:26.504928+0000","last_active":"2024-09-19T09:13:29.844831+0000","last_peered":"2024-09-19T09:13:29.844831+0000","last_clean":"2024-09-19T09:13:29.844831+0000","last_became_active":"2024-09-19T09:13:26.504649+0000","last_became_peered":"2024-09-19T09:13:26.504649+0000","last_unstale":"2024-09-19T09:13:29.844831+0000","last_undegraded":"2024-09-19T09:13:29.844831+0000","last_fullsized":"2024-09-19T09:13:29.844831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:25:24.798674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.508168+0000","last_change":"2024-09-19T09:13:27.507971+0000","last_active":"2024-09-19T09:13:28.508168+0000","last_peered":"2024-09-19T09:13:28.508168+0000","last_clean":"2024-09-19T09:13:28.508168+0000","last_became_active":"2024-09-19T09:13:27.507738+0000","last_became_peered":"2024-09-19T09:13:27.507738+0000","last_unstale":"2024-09-19T09:13:28.508168+0000","last_undegraded":"2024-09-19T09:13:28.508168+0000","last_fullsized":"2024-09-19T09:13:28.508168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:20.297920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.568810+0000","last_change":"2024-09-19T09:13:26.501526+0000","last_active":"2024-09-19T09:13:28.568810+0000","last_peered":"2024-09-19T09:13:28.568810+0000","last_clean":"2024-09-19T09:13:28.568810+0000","last_became_active":"2024-09-19T09:13:26.501281+0000","last_became_peered":"2024-09-19T09:13:26.501281+0000","last_unstale":"2024-09-19T09:13:28.568810+0000","last_undegraded":"2024-09-19T09:13:28.568810+0000","last_fullsized":"2024-09-19T09:13:28.568810+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:00:44.450168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.744156+0000","last_change":"2024-09-19T09:13:27.501824+0000","last_active":"2024-09-19T09:13:28.744156+0000","last_peered":"2024-09-19T09:13:28.744156+0000","last_clean":"2024-09-19T09:13:28.744156+0000","last_became_active":"2024-09-19T09:13:27.500721+0000","last_became_peered":"2024-09-19T09:13:27.500721+0000","last_unstale":"2024-09-19T09:13:28.744156+0000","last_undegraded":"2024-09-19T09:13:28.744156+0000","last_fullsized":"2024-09-19T09:13:28.744156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:45.082435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844855+0000","last_change":"2024-09-19T09:13:26.505847+0000","last_active":"2024-09-19T09:13:29.844855+0000","last_peered":"2024-09-19T09:13:29.844855+0000","last_clean":"2024-09-19T09:13:29.844855+0000","last_became_active":"2024-09-19T09:13:26.505245+0000","last_became_peered":"2024-09-19T09:13:26.505245+0000","last_unstale":"2024-09-19T09:13:29.844855+0000","last_undegraded":"2024-09-19T09:13:29.844855+0000","last_fullsized":"2024-09-19T09:13:29.844855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:25:50.247996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495386+0000","last_change":"2024-09-19T09:13:27.508323+0000","last_active":"2024-09-19T09:13:29.495386+0000","last_peered":"2024-09-19T09:13:29.495386+0000","last_clean":"2024-09-19T09:13:29.495386+0000","last_became_active":"2024-09-19T09:13:27.508090+0000","last_became_peered":"2024-09-19T09:13:27.508090+0000","last_unstale":"2024-09-19T09:13:29.495386+0000","last_undegraded":"2024-09-19T09:13:29.495386+0000","last_fullsized":"2024-09-19T09:13:29.495386+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:17.877065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.744638+0000","last_change":"2024-09-19T09:13:26.502978+0000","last_active":"2024-09-19T09:13:28.744638+0000","last_peered":"2024-09-19T09:13:28.744638+0000","last_clean":"2024-09-19T09:13:28.744638+0000","last_became_active":"2024-09-19T09:13:26.502537+0000","last_became_peered":"2024-09-19T09:13:26.502537+0000","last_unstale":"2024-09-19T09:13:28.744638+0000","last_undegraded":"2024-09-19T09:13:28.744638+0000","last_fullsized":"2024-09-19T09:13:28.744638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:10:29.871068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.507592+0000","last_change":"2024-09-19T09:13:27.502356+0000","last_active":"2024-09-19T09:13:28.507592+0000","last_peered":"2024-09-19T09:13:28.507592+0000","last_clean":"2024-09-19T09:13:28.507592+0000","last_became_active":"2024-09-19T09:13:27.502112+0000","last_became_peered":"2024-09-19T09:13:27.502112+0000","last_unstale":"2024-09-19T09:13:28.507592+0000","last_undegraded":"2024-09-19T09:13:28.507592+0000","last_fullsized":"2024-09-19T09:13:28.507592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:26:28.997393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844780+0000","last_change":"2024-09-19T09:13:26.505476+0000","last_active":"2024-09-19T09:13:29.844780+0000","last_peered":"2024-09-19T09:13:29.844780+0000","last_clean":"2024-09-19T09:13:29.844780+0000","last_became_active":"2024-09-19T09:13:26.505190+0000","last_became_peered":"2024-09-19T09:13:26.505190+0000","last_unstale":"2024-09-19T09:13:29.844780+0000","last_undegraded":"2024-09-19T09:13:29.844780+0000","last_fullsized":"2024-09-19T09:13:29.844780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:45.467871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.508345+0000","last_change":"2024-09-19T09:13:27.507787+0000","last_active":"2024-09-19T09:13:28.508345+0000","last_peered":"2024-09-19T09:13:28.508345+0000","last_clean":"2024-09-19T09:13:28.508345+0000","last_became_active":"2024-09-19T09:13:27.507515+0000","last_became_peered":"2024-09-19T09:13:27.507515+0000","last_unstale":"2024-09-19T09:13:28.508345+0000","last_undegraded":"2024-09-19T09:13:28.508345+0000","last_fullsized":"2024-09-19T09:13:28.508345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:59.050231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493662+0000","last_change":"2024-09-19T09:13:26.497706+0000","last_active":"2024-09-19T09:13:29.493662+0000","last_peered":"2024-09-19T09:13:29.493662+0000","last_clean":"2024-09-19T09:13:29.493662+0000","last_became_active":"2024-09-19T09:13:26.497446+0000","last_became_peered":"2024-09-19T09:13:26.497446+0000","last_unstale":"2024-09-19T09:13:29.493662+0000","last_undegraded":"2024-09-19T09:13:29.493662+0000","last_fullsized":"2024-09-19T09:13:29.493662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:10.881483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493342+0000","last_change":"2024-09-19T09:13:27.507619+0000","last_active":"2024-09-19T09:13:29.493342+0000","last_peered":"2024-09-19T09:13:29.493342+0000","last_clean":"2024-09-19T09:13:29.493342+0000","last_became_active":"2024-09-19T09:13:27.506922+0000","last_became_peered":"2024-09-19T09:13:27.506922+0000","last_unstale":"2024-09-19T09:13:29.493342+0000","last_undegraded":"2024-09-19T09:13:29.493342+0000","last_fullsized":"2024-09-19T09:13:29.493342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:19.978047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844756+0000","last_change":"2024-09-19T09:13:26.506097+0000","last_active":"2024-09-19T09:13:29.844756+0000","last_peered":"2024-09-19T09:13:29.844756+0000","last_clean":"2024-09-19T09:13:29.844756+0000","last_became_active":"2024-09-19T09:13:26.505562+0000","last_became_peered":"2024-09-19T09:13:26.505562+0000","last_unstale":"2024-09-19T09:13:29.844756+0000","last_undegraded":"2024-09-19T09:13:29.844756+0000","last_fullsized":"2024-09-19T09:13:29.844756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:31.643028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493424+0000","last_change":"2024-09-19T09:13:27.506209+0000","last_active":"2024-09-19T09:13:29.493424+0000","last_peered":"2024-09-19T09:13:29.493424+0000","last_clean":"2024-09-19T09:13:29.493424+0000","last_became_active":"2024-09-19T09:13:27.505712+0000","last_became_peered":"2024-09-19T09:13:27.505712+0000","last_unstale":"2024-09-19T09:13:29.493424+0000","last_undegraded":"2024-09-19T09:13:29.493424+0000","last_fullsized":"2024-09-19T09:13:29.493424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:45.068134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495531+0000","last_change":"2024-09-19T09:13:26.501858+0000","last_active":"2024-09-19T09:13:29.495531+0000","last_peered":"2024-09-19T09:13:29.495531+0000","last_clean":"2024-09-19T09:13:29.495531+0000","last_became_active":"2024-09-19T09:13:26.501606+0000","last_became_peered":"2024-09-19T09:13:26.501606+0000","last_unstale":"2024-09-19T09:13:29.495531+0000","last_undegraded":"2024-09-19T09:13:29.495531+0000","last_fullsized":"2024-09-19T09:13:29.495531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:12.082586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844974+0000","last_change":"2024-09-19T09:13:27.511660+0000","last_active":"2024-09-19T09:13:29.844974+0000","last_peered":"2024-09-19T09:13:29.844974+0000","last_clean":"2024-09-19T09:13:29.844974+0000","last_became_active":"2024-09-19T09:13:27.511409+0000","last_became_peered":"2024-09-19T09:13:27.511409+0000","last_unstale":"2024-09-19T09:13:29.844974+0000","last_undegraded":"2024-09-19T09:13:29.844974+0000","last_fullsized":"2024-09-19T09:13:29.844974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:16.269907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493355+0000","last_change":"2024-09-19T09:13:26.498599+0000","last_active":"2024-09-19T09:13:29.493355+0000","last_peered":"2024-09-19T09:13:29.493355+0000","last_clean":"2024-09-19T09:13:29.493355+0000","last_became_active":"2024-09-19T09:13:26.498160+0000","last_became_peered":"2024-09-19T09:13:26.498160+0000","last_unstale":"2024-09-19T09:13:29.493355+0000","last_undegraded":"2024-09-19T09:13:29.493355+0000","last_fullsized":"2024-09-19T09:13:29.493355+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:42:23.434662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493504+0000","last_change":"2024-09-19T09:13:27.506298+0000","last_active":"2024-09-19T09:13:29.493504+0000","last_peered":"2024-09-19T09:13:29.493504+0000","last_clean":"2024-09-19T09:13:29.493504+0000","last_became_active":"2024-09-19T09:13:27.506029+0000","last_became_peered":"2024-09-19T09:13:27.506029+0000","last_unstale":"2024-09-19T09:13:29.493504+0000","last_undegraded":"2024-09-19T09:13:29.493504+0000","last_fullsized":"2024-09-19T09:13:29.493504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:15.465914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.507863+0000","last_change":"2024-09-19T09:13:26.503468+0000","last_active":"2024-09-19T09:13:28.507863+0000","last_peered":"2024-09-19T09:13:28.507863+0000","last_clean":"2024-09-19T09:13:28.507863+0000","last_became_active":"2024-09-19T09:13:26.503239+0000","last_became_peered":"2024-09-19T09:13:26.503239+0000","last_unstale":"2024-09-19T09:13:28.507863+0000","last_undegraded":"2024-09-19T09:13:28.507863+0000","last_fullsized":"2024-09-19T09:13:28.507863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:39:45.143267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.568617+0000","last_change":"2024-09-19T09:13:27.501631+0000","last_active":"2024-09-19T09:13:28.568617+0000","last_peered":"2024-09-19T09:13:28.568617+0000","last_clean":"2024-09-19T09:13:28.568617+0000","last_became_active":"2024-09-19T09:13:27.501413+0000","last_became_peered":"2024-09-19T09:13:27.501413+0000","last_unstale":"2024-09-19T09:13:28.568617+0000","last_undegraded":"2024-09-19T09:13:28.568617+0000","last_fullsized":"2024-09-19T09:13:28.568617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:37:49.379552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844436+0000","last_change":"2024-09-19T09:13:26.505929+0000","last_active":"2024-09-19T09:13:29.844436+0000","last_peered":"2024-09-19T09:13:29.844436+0000","last_clean":"2024-09-19T09:13:29.844436+0000","last_became_active":"2024-09-19T09:13:26.505267+0000","last_became_peered":"2024-09-19T09:13:26.505267+0000","last_unstale":"2024-09-19T09:13:29.844436+0000","last_undegraded":"2024-09-19T09:13:29.844436+0000","last_fullsized":"2024-09-19T09:13:29.844436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:12.236637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844651+0000","last_change":"2024-09-19T09:13:27.504679+0000","last_active":"2024-09-19T09:13:29.844651+0000","last_peered":"2024-09-19T09:13:29.844651+0000","last_clean":"2024-09-19T09:13:29.844651+0000","last_became_active":"2024-09-19T09:13:27.504448+0000","last_became_peered":"2024-09-19T09:13:27.504448+0000","last_unstale":"2024-09-19T09:13:29.844651+0000","last_undegraded":"2024-09-19T09:13:29.844651+0000","last_fullsized":"2024-09-19T09:13:29.844651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:55:44.574651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.844665+0000","last_change":"2024-09-19T09:13:27.515732+0000","last_active":"2024-09-19T09:13:29.844665+0000","last_peered":"2024-09-19T09:13:29.844665+0000","last_clean":"2024-09-19T09:13:29.844665+0000","last_became_active":"2024-09-19T09:13:27.515302+0000","last_became_peered":"2024-09-19T09:13:27.515302+0000","last_unstale":"2024-09-19T09:13:29.844665+0000","last_undegraded":"2024-09-19T09:13:29.844665+0000","last_fullsized":"2024-09-19T09:13:29.844665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:44.892454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495453+0000","last_change":"2024-09-19T09:13:26.498383+0000","last_active":"2024-09-19T09:13:29.495453+0000","last_peered":"2024-09-19T09:13:29.495453+0000","last_clean":"2024-09-19T09:13:29.495453+0000","last_became_active":"2024-09-19T09:13:26.498142+0000","last_became_peered":"2024-09-19T09:13:26.498142+0000","last_unstale":"2024-09-19T09:13:29.495453+0000","last_undegraded":"2024-09-19T09:13:29.495453+0000","last_fullsized":"2024-09-19T09:13:29.495453+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:46.179021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.677710+0000","last_change":"2024-09-19T09:13:27.515820+0000","last_active":"2024-09-19T09:13:29.677710+0000","last_peered":"2024-09-19T09:13:29.677710+0000","last_clean":"2024-09-19T09:13:29.677710+0000","last_became_active":"2024-09-19T09:13:27.515575+0000","last_became_peered":"2024-09-19T09:13:27.515575+0000","last_unstale":"2024-09-19T09:13:29.677710+0000","last_undegraded":"2024-09-19T09:13:29.677710+0000","last_fullsized":"2024-09-19T09:13:29.677710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:59:08.406348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.495637+0000","last_change":"2024-09-19T09:13:26.497950+0000","last_active":"2024-09-19T09:13:29.495637+0000","last_peered":"2024-09-19T09:13:29.495637+0000","last_clean":"2024-09-19T09:13:29.495637+0000","last_became_active":"2024-09-19T09:13:26.497689+0000","last_became_peered":"2024-09-19T09:13:26.497689+0000","last_unstale":"2024-09-19T09:13:29.495637+0000","last_undegraded":"2024-09-19T09:13:29.495637+0000","last_fullsized":"2024-09-19T09:13:29.495637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:36:05.171954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.744307+0000","last_change":"2024-09-19T09:13:27.496465+0000","last_active":"2024-09-19T09:13:28.744307+0000","last_peered":"2024-09-19T09:13:28.744307+0000","last_clean":"2024-09-19T09:13:28.744307+0000","last_became_active":"2024-09-19T09:13:27.496138+0000","last_became_peered":"2024-09-19T09:13:27.496138+0000","last_unstale":"2024-09-19T09:13:28.744307+0000","last_undegraded":"2024-09-19T09:13:28.744307+0000","last_fullsized":"2024-09-19T09:13:28.744307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:44.657136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.744302+0000","last_change":"2024-09-19T09:13:26.502836+0000","last_active":"2024-09-19T09:13:28.744302+0000","last_peered":"2024-09-19T09:13:28.744302+0000","last_clean":"2024-09-19T09:13:28.744302+0000","last_became_active":"2024-09-19T09:13:26.501995+0000","last_became_peered":"2024-09-19T09:13:26.501995+0000","last_unstale":"2024-09-19T09:13:28.744302+0000","last_undegraded":"2024-09-19T09:13:28.744302+0000","last_fullsized":"2024-09-19T09:13:28.744302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:03.744301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:28.744023+0000","last_change":"2024-09-19T09:13:27.502428+0000","last_active":"2024-09-19T09:13:28.744023+0000","last_peered":"2024-09-19T09:13:28.744023+0000","last_clean":"2024-09-19T09:13:28.744023+0000","last_became_active":"2024-09-19T09:13:27.502152+0000","last_became_peered":"2024-09-19T09:13:27.502152+0000","last_unstale":"2024-09-19T09:13:28.744023+0000","last_undegraded":"2024-09-19T09:13:28.744023+0000","last_fullsized":"2024-09-19T09:13:28.744023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:26.482288+0000","last_clean_scrub_stamp":"2024-09-19T09:13:26.482288+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:47:58.866973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-19T09:13:29.493222+0000","last_change":"2024-09-19T09:13:26.506856+0000","last_active":"2024-09-19T09:13:29.493222+0000","last_peered":"2024-09-19T09:13:29.493222+0000","last_clean":"2024-09-19T09:13:29.493222+0000","last_became_active":"2024-09-19T09:13:26.506714+0000","last_became_peered":"2024-09-19T09:13:26.506714+0000","last_unstale":"2024-09-19T09:13:29.493222+0000","last_undegraded":"2024-09-19T09:13:29.493222+0000","last_fullsized":"2024-09-19T09:13:29.493222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:25.476449+0000","last_clean_scrub_stamp":"2024-09-19T09:13:25.476449+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:16.001867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924431,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924555,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194662,"statfs":{"total":200000000,"available":199334095,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195236,"statfs":{"total":200000000,"available":199922271,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":74,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199923973,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199922943,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194662,"statfs":{"total":200000000,"available":199334117,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924499,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:13:39.547 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T09:13:39.547 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T09:13:39.548 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-19T09:13:39.549 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-19T09:13:39.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.684+0000 7f97552d9640 1 Processor -- start 2024-09-19T09:13:39.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.684+0000 7f97552d9640 1 -- start start 2024-09-19T09:13:39.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.684+0000 7f97552d9640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f975015ed30 0x7f9750070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:39.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.684+0000 7f97552d9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f97500b5200 0x7f97501629e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:39.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.684+0000 7f97552d9640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97500d0a10 con 0x7f9750162f20 2024-09-19T09:13:39.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.684+0000 7f97552d9640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f9750070ab0 con 0x7f97500b5200 2024-09-19T09:13:39.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.684+0000 7f97552d9640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f97500d0cb0 con 0x7f975015ed30 2024-09-19T09:13:39.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.685+0000 7f974e7fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f97500b5200 0x7f97501629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:39.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.685+0000 7f974e7fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f97500b5200 0x7f97501629e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36706/0 (socket says 172.21.15.18:36706) 2024-09-19T09:13:39.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.685+0000 7f974e7fc640 1 -- 172.21.15.18:0/3130214633 learned_addr learned my addr 172.21.15.18:0/3130214633 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:39.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.685+0000 7f974effd640 1 --2- 172.21.15.18:0/3130214633 >> v2:172.21.15.162:3300/0 conn(0x7f975015ed30 0x7f9750070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:39.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.685+0000 7f974e7fc640 1 -- 172.21.15.18:0/3130214633 >> v2:172.21.15.162:3300/0 conn(0x7f975015ed30 msgr2=0x7f9750070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:39.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.685+0000 7f974e7fc640 1 --2- 172.21.15.18:0/3130214633 >> v2:172.21.15.162:3300/0 conn(0x7f975015ed30 0x7f9750070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:39.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.685+0000 7f974e7fc640 1 -- 172.21.15.18:0/3130214633 >> v1:172.21.15.162:6789/0 conn(0x7f9750162f20 legacy=0x7f97500cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:39.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.685+0000 7f974e7fc640 1 -- 172.21.15.18:0/3130214633 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97500d0f90 con 0x7f97500b5200 2024-09-19T09:13:39.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.685+0000 7f974effd640 1 --2- 172.21.15.18:0/3130214633 >> v2:172.21.15.162:3300/0 conn(0x7f975015ed30 0x7f9750070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:13:39.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.686+0000 7f974e7fc640 1 --2- 172.21.15.18:0/3130214633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97500b5200 0x7f97501629e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f975006cbf0 tx=0x7f974402a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f9d1f65ca7d0a09 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:39.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.686+0000 7f974dffb640 1 -- 172.21.15.18:0/3130214633 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9744037070 con 0x7f97500b5200 2024-09-19T09:13:39.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.686+0000 7f974dffb640 1 -- 172.21.15.18:0/3130214633 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9744032440 con 0x7f97500b5200 2024-09-19T09:13:39.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.686+0000 7f974dffb640 1 -- 172.21.15.18:0/3130214633 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9744032810 con 0x7f97500b5200 2024-09-19T09:13:39.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.686+0000 7f97552d9640 1 -- 172.21.15.18:0/3130214633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97500b5200 msgr2=0x7f97501629e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:39.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.686+0000 7f97552d9640 1 --2- 172.21.15.18:0/3130214633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97500b5200 0x7f97501629e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f975006cbf0 tx=0x7f974402a2c0 comp rx=0 tx=0).stop 2024-09-19T09:13:39.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.686+0000 7f97552d9640 1 -- 172.21.15.18:0/3130214633 shutdown_connections 2024-09-19T09:13:39.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.686+0000 7f97552d9640 1 --2- 172.21.15.18:0/3130214633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97500b5200 0x7f97501629e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:39.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.686+0000 7f97552d9640 1 --2- 172.21.15.18:0/3130214633 >> v2:172.21.15.162:3300/0 conn(0x7f975015ed30 0x7f9750070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:39.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.686+0000 7f97552d9640 1 -- 172.21.15.18:0/3130214633 >> 172.21.15.18:0/3130214633 conn(0x7f97500b4600 msgr2=0x7f97500b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:39.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.686+0000 7f97552d9640 1 -- 172.21.15.18:0/3130214633 shutdown_connections 2024-09-19T09:13:39.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.686+0000 7f97552d9640 1 -- 172.21.15.18:0/3130214633 wait complete. 2024-09-19T09:13:39.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.688+0000 7f97552d9640 1 Processor -- start 2024-09-19T09:13:39.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.688+0000 7f97552d9640 1 -- start start 2024-09-19T09:13:39.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.688+0000 7f97552d9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97500b5200 0x7f975015f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:39.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.688+0000 7f97552d9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f975015ed30 0x7f97501f4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:39.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.688+0000 7f97552d9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9750162f20 0x7f97501f4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:39.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.688+0000 7f97552d9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9750070f10 con 0x7f9750162f20 2024-09-19T09:13:39.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.688+0000 7f97552d9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9750070d90 con 0x7f97500b5200 2024-09-19T09:13:39.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.688+0000 7f97552d9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f975015f110 con 0x7f975015ed30 2024-09-19T09:13:39.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.689+0000 7f974f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9750162f20 0x7f97501f4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:39.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.689+0000 7f974f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9750162f20 0x7f97501f4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36716/0 (socket says 172.21.15.18:36716) 2024-09-19T09:13:39.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.689+0000 7f974f7fe640 1 -- 172.21.15.18:0/1103630824 learned_addr learned my addr 172.21.15.18:0/1103630824 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:39.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.689+0000 7f974effd640 1 --2- 172.21.15.18:0/1103630824 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97500b5200 0x7f975015f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:39.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.689+0000 7f974e7fc640 1 --2- 172.21.15.18:0/1103630824 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f975015ed30 0x7f97501f4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:39.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.689+0000 7f974f7fe640 1 -- 172.21.15.18:0/1103630824 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f975015ed30 msgr2=0x7f97501f4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:39.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.689+0000 7f974f7fe640 1 --2- 172.21.15.18:0/1103630824 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f975015ed30 0x7f97501f4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:39.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.689+0000 7f974f7fe640 1 -- 172.21.15.18:0/1103630824 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97500b5200 msgr2=0x7f975015f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:39.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.689+0000 7f974f7fe640 1 --2- 172.21.15.18:0/1103630824 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97500b5200 0x7f975015f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:39.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.689+0000 7f974f7fe640 1 -- 172.21.15.18:0/1103630824 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97500c8d90 con 0x7f9750162f20 2024-09-19T09:13:39.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.689+0000 7f974e7fc640 1 --2- 172.21.15.18:0/1103630824 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f975015ed30 0x7f97501f4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:13:39.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.689+0000 7f974f7fe640 1 --2- 172.21.15.18:0/1103630824 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9750162f20 0x7f97501f4f80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f974800b970 tx=0x7f974800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:39.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.689+0000 7f97377fe640 1 -- 172.21.15.18:0/1103630824 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9748019070 con 0x7f9750162f20 2024-09-19T09:13:39.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.689+0000 7f97377fe640 1 -- 172.21.15.18:0/1103630824 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f974800cb40 con 0x7f9750162f20 2024-09-19T09:13:39.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.689+0000 7f97552d9640 1 -- 172.21.15.18:0/1103630824 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97500c9070 con 0x7f9750162f20 2024-09-19T09:13:39.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.689+0000 7f97377fe640 1 -- 172.21.15.18:0/1103630824 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9748014440 con 0x7f9750162f20 2024-09-19T09:13:39.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.689+0000 7f97552d9640 1 -- 172.21.15.18:0/1103630824 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97500b6040 con 0x7f9750162f20 2024-09-19T09:13:39.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.690+0000 7f97552d9640 1 -- 172.21.15.18:0/1103630824 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9750069040 con 0x7f9750162f20 2024-09-19T09:13:39.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.691+0000 7f97377fe640 1 -- 172.21.15.18:0/1103630824 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f974801c070 con 0x7f9750162f20 2024-09-19T09:13:39.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.691+0000 7f97377fe640 1 --2- 172.21.15.18:0/1103630824 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f973c06c2b0 0x7f973c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:39.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.691+0000 7f97377fe640 1 -- 172.21.15.18:0/1103630824 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f974808afe0 con 0x7f9750162f20 2024-09-19T09:13:39.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.691+0000 7f974effd640 1 --2- 172.21.15.18:0/1103630824 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f973c06c2b0 0x7f973c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:39.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.692+0000 7f974effd640 1 --2- 172.21.15.18:0/1103630824 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f973c06c2b0 0x7f973c06e770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f975006c170 tx=0x7f9740008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:39.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.696+0000 7f97377fe640 1 -- 172.21.15.18:0/1103630824 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9750069040 con 0x7f9750162f20 2024-09-19T09:13:39.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.908+0000 7f97552d9640 1 -- 172.21.15.18:0/1103630824 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f97501629e0 con 0x7f9750162f20 2024-09-19T09:13:39.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.908+0000 7f97377fe640 1 -- 172.21.15.18:0/1103630824 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f9748059100 con 0x7f9750162f20 2024-09-19T09:13:39.908 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:39.909 INFO:teuthology.orchestra.run.smithi018.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T09:13:39.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.910+0000 7f97552d9640 1 -- 172.21.15.18:0/1103630824 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f973c06c2b0 msgr2=0x7f973c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:39.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.910+0000 7f97552d9640 1 --2- 172.21.15.18:0/1103630824 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f973c06c2b0 0x7f973c06e770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f975006c170 tx=0x7f9740008040 comp rx=0 tx=0).stop 2024-09-19T09:13:39.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.910+0000 7f97552d9640 1 -- 172.21.15.18:0/1103630824 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9750162f20 msgr2=0x7f97501f4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:39.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.910+0000 7f97552d9640 1 --2- 172.21.15.18:0/1103630824 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9750162f20 0x7f97501f4f80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f974800b970 tx=0x7f974800be30 comp rx=0 tx=0).stop 2024-09-19T09:13:39.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.910+0000 7f97552d9640 1 -- 172.21.15.18:0/1103630824 shutdown_connections 2024-09-19T09:13:39.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.910+0000 7f97552d9640 1 --2- 172.21.15.18:0/1103630824 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f973c06c2b0 0x7f973c06e770 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:39.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.910+0000 7f97552d9640 1 --2- 172.21.15.18:0/1103630824 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9750162f20 0x7f97501f4f80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:39.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.910+0000 7f97552d9640 1 --2- 172.21.15.18:0/1103630824 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f975015ed30 0x7f97501f4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:39.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.910+0000 7f97552d9640 1 --2- 172.21.15.18:0/1103630824 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97500b5200 0x7f975015f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:39.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.910+0000 7f97552d9640 1 -- 172.21.15.18:0/1103630824 >> 172.21.15.18:0/1103630824 conn(0x7f97500b4600 msgr2=0x7f97500d1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:39.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.910+0000 7f97552d9640 1 -- 172.21.15.18:0/1103630824 shutdown_connections 2024-09-19T09:13:39.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:39.910+0000 7f97552d9640 1 -- 172.21.15.18:0/1103630824 wait complete. 2024-09-19T09:13:39.921 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-19T09:13:39.921 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:13:40.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.023+0000 7fa78b59e640 1 Processor -- start 2024-09-19T09:13:40.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.023+0000 7fa78b59e640 1 -- start start 2024-09-19T09:13:40.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.024+0000 7fa78b59e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa78c0d2680 0x7fa78c0cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:40.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.024+0000 7fa78b59e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa78c0cfac0 0x7fa78c0c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:40.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.024+0000 7fa78b59e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa78c0d2bd0 con 0x7fa78c15e970 2024-09-19T09:13:40.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.024+0000 7fa78b59e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fa78c0d37e0 con 0x7fa78c0cfac0 2024-09-19T09:13:40.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.024+0000 7fa78b59e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa78c0d2eb0 con 0x7fa78c0d2680 2024-09-19T09:13:40.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.024+0000 7fa78ad9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa78c0cfac0 0x7fa78c0c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:40.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.024+0000 7fa78ad9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa78c0cfac0 0x7fa78c0c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36722/0 (socket says 172.21.15.18:36722) 2024-09-19T09:13:40.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.024+0000 7fa78ad9d640 1 -- 172.21.15.18:0/1280891746 learned_addr learned my addr 172.21.15.18:0/1280891746 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:40.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.024+0000 7fa789d9b640 1 --2- 172.21.15.18:0/1280891746 >> v2:172.21.15.162:3300/0 conn(0x7fa78c0d2680 0x7fa78c0cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:40.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.024+0000 7fa78ad9d640 1 -- 172.21.15.18:0/1280891746 >> v2:172.21.15.162:3300/0 conn(0x7fa78c0d2680 msgr2=0x7fa78c0cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:40.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.025+0000 7fa78ad9d640 1 --2- 172.21.15.18:0/1280891746 >> v2:172.21.15.162:3300/0 conn(0x7fa78c0d2680 0x7fa78c0cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:40.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.025+0000 7fa78ad9d640 1 -- 172.21.15.18:0/1280891746 >> v1:172.21.15.162:6789/0 conn(0x7fa78c15e970 legacy=0x7fa78c0d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:40.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.025+0000 7fa78ad9d640 1 -- 172.21.15.18:0/1280891746 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78c0d3190 con 0x7fa78c0cfac0 2024-09-19T09:13:40.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.025+0000 7fa78ad9d640 1 --2- 172.21.15.18:0/1280891746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa78c0cfac0 0x7fa78c0c8700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa78c09e530 tx=0x7fa78402a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2037f1e070f22f18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:40.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.025+0000 7fa78959a640 1 -- 172.21.15.18:0/1280891746 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa784036070 con 0x7fa78c0cfac0 2024-09-19T09:13:40.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.025+0000 7fa78959a640 1 -- 172.21.15.18:0/1280891746 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa784031600 con 0x7fa78c0cfac0 2024-09-19T09:13:40.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.025+0000 7fa78959a640 1 -- 172.21.15.18:0/1280891746 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7840319d0 con 0x7fa78c0cfac0 2024-09-19T09:13:40.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.026+0000 7fa78b59e640 1 -- 172.21.15.18:0/1280891746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa78c0cfac0 msgr2=0x7fa78c0c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:40.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.026+0000 7fa78b59e640 1 --2- 172.21.15.18:0/1280891746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa78c0cfac0 0x7fa78c0c8700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa78c09e530 tx=0x7fa78402a780 comp rx=0 tx=0).stop 2024-09-19T09:13:40.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.026+0000 7fa78b59e640 1 -- 172.21.15.18:0/1280891746 shutdown_connections 2024-09-19T09:13:40.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.026+0000 7fa78b59e640 1 --2- 172.21.15.18:0/1280891746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa78c0cfac0 0x7fa78c0c8700 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:40.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.026+0000 7fa78b59e640 1 --2- 172.21.15.18:0/1280891746 >> v2:172.21.15.162:3300/0 conn(0x7fa78c0d2680 0x7fa78c0cf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:40.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.026+0000 7fa78b59e640 1 -- 172.21.15.18:0/1280891746 >> 172.21.15.18:0/1280891746 conn(0x7fa78c09de00 msgr2=0x7fa78c0d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:40.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.026+0000 7fa78b59e640 1 -- 172.21.15.18:0/1280891746 shutdown_connections 2024-09-19T09:13:40.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.026+0000 7fa78b59e640 1 -- 172.21.15.18:0/1280891746 wait complete. 2024-09-19T09:13:40.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.027+0000 7fa78b59e640 1 Processor -- start 2024-09-19T09:13:40.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.027+0000 7fa78b59e640 1 -- start start 2024-09-19T09:13:40.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.028+0000 7fa78b59e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa78c0cfac0 0x7fa78c0ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:40.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.028+0000 7fa78b59e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa78c0d2680 0x7fa78c157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:40.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.028+0000 7fa78b59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa78c15e970 0x7fa78c15cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:40.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.028+0000 7fa78b59e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa78c15ed50 con 0x7fa78c15e970 2024-09-19T09:13:40.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.028+0000 7fa78b59e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa78c0cff10 con 0x7fa78c0d2680 2024-09-19T09:13:40.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.028+0000 7fa78b59e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa78c15eed0 con 0x7fa78c0cfac0 2024-09-19T09:13:40.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.028+0000 7fa78ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa78c15e970 0x7fa78c15cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:40.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.028+0000 7fa78ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa78c15e970 0x7fa78c15cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36728/0 (socket says 172.21.15.18:36728) 2024-09-19T09:13:40.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.028+0000 7fa78ad9d640 1 -- 172.21.15.18:0/1883848767 learned_addr learned my addr 172.21.15.18:0/1883848767 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:40.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.029+0000 7fa789d9b640 1 --2- 172.21.15.18:0/1883848767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa78c0d2680 0x7fa78c157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:40.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.029+0000 7fa78a59c640 1 --2- 172.21.15.18:0/1883848767 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa78c0cfac0 0x7fa78c0ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:40.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.029+0000 7fa78ad9d640 1 -- 172.21.15.18:0/1883848767 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa78c0cfac0 msgr2=0x7fa78c0ce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:40.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.029+0000 7fa78ad9d640 1 --2- 172.21.15.18:0/1883848767 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa78c0cfac0 0x7fa78c0ce8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:40.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.029+0000 7fa78ad9d640 1 -- 172.21.15.18:0/1883848767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa78c0d2680 msgr2=0x7fa78c157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:40.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.029+0000 7fa78ad9d640 1 --2- 172.21.15.18:0/1883848767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa78c0d2680 0x7fa78c157c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:40.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.029+0000 7fa78ad9d640 1 -- 172.21.15.18:0/1883848767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78c1581b0 con 0x7fa78c15e970 2024-09-19T09:13:40.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.029+0000 7fa78a59c640 1 --2- 172.21.15.18:0/1883848767 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa78c0cfac0 0x7fa78c0ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:13:40.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.029+0000 7fa78ad9d640 1 --2- 172.21.15.18:0/1883848767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa78c15e970 0x7fa78c15cff0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa784009f40 tx=0x7fa784004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:40.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.029+0000 7fa77affd640 1 -- 172.21.15.18:0/1883848767 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa784036050 con 0x7fa78c15e970 2024-09-19T09:13:40.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.029+0000 7fa77affd640 1 -- 172.21.15.18:0/1883848767 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa784042070 con 0x7fa78c15e970 2024-09-19T09:13:40.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.029+0000 7fa77affd640 1 -- 172.21.15.18:0/1883848767 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa784009510 con 0x7fa78c15e970 2024-09-19T09:13:40.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.029+0000 7fa78b59e640 1 -- 172.21.15.18:0/1883848767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa78c1f8dc0 con 0x7fa78c15e970 2024-09-19T09:13:40.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.029+0000 7fa78b59e640 1 -- 172.21.15.18:0/1883848767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa78c0cdbc0 con 0x7fa78c15e970 2024-09-19T09:13:40.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.030+0000 7fa78b59e640 1 -- 172.21.15.18:0/1883848767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa78c0c97d0 con 0x7fa78c15e970 2024-09-19T09:13:40.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.031+0000 7fa77affd640 1 -- 172.21.15.18:0/1883848767 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa784007bd0 con 0x7fa78c15e970 2024-09-19T09:13:40.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.031+0000 7fa77affd640 1 --2- 172.21.15.18:0/1883848767 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa76c06c2e0 0x7fa76c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:40.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.031+0000 7fa77affd640 1 -- 172.21.15.18:0/1883848767 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fa7840ac300 con 0x7fa78c15e970 2024-09-19T09:13:40.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.031+0000 7fa78a59c640 1 --2- 172.21.15.18:0/1883848767 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa76c06c2e0 0x7fa76c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:40.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.032+0000 7fa78a59c640 1 --2- 172.21.15.18:0/1883848767 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa76c06c2e0 0x7fa76c06e7a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa78c0b5ac0 tx=0x7fa77c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:40.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.035+0000 7fa77affd640 1 -- 172.21.15.18:0/1883848767 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa78c0c97d0 con 0x7fa78c15e970 2024-09-19T09:13:40.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.246+0000 7fa78b59e640 1 -- 172.21.15.18:0/1883848767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa78c0cf580 con 0x7fa78c15e970 2024-09-19T09:13:40.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.247+0000 7fa77affd640 1 -- 172.21.15.18:0/1883848767 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5217 (secure 0 0 0) 0x7fa784045360 con 0x7fa78c15e970 2024-09-19T09:13:40.247 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:40.248 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":6,"btime":"2024-09-19T09:13:29:505412+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3070220651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3070220651},{"type":"v1","addr":"172.21.15.162:6836","nonce":3070220651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/2341594474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2341594474},{"type":"v1","addr":"172.21.15.18:6833","nonce":2341594474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/603326104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":603326104},{"type":"v1","addr":"172.21.15.18:6835","nonce":603326104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:13:26.853577+0000","modified":"2024-09-19T09:13:28.847901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6837/727689889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":727689889},{"type":"v1","addr":"172.21.15.162:6837","nonce":727689889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":1}]} 2024-09-19T09:13:40.248 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 6 2024-09-19T09:13:40.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.249+0000 7fa78b59e640 1 -- 172.21.15.18:0/1883848767 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa76c06c2e0 msgr2=0x7fa76c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:40.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.249+0000 7fa78b59e640 1 --2- 172.21.15.18:0/1883848767 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa76c06c2e0 0x7fa76c06e7a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa78c0b5ac0 tx=0x7fa77c008040 comp rx=0 tx=0).stop 2024-09-19T09:13:40.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.249+0000 7fa78b59e640 1 -- 172.21.15.18:0/1883848767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa78c15e970 msgr2=0x7fa78c15cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:40.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.249+0000 7fa78b59e640 1 --2- 172.21.15.18:0/1883848767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa78c15e970 0x7fa78c15cff0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa784009f40 tx=0x7fa784004a40 comp rx=0 tx=0).stop 2024-09-19T09:13:40.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.249+0000 7fa78b59e640 1 -- 172.21.15.18:0/1883848767 shutdown_connections 2024-09-19T09:13:40.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.249+0000 7fa78b59e640 1 --2- 172.21.15.18:0/1883848767 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa76c06c2e0 0x7fa76c06e7a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:40.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.249+0000 7fa78b59e640 1 --2- 172.21.15.18:0/1883848767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa78c15e970 0x7fa78c15cff0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:40.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.249+0000 7fa78b59e640 1 --2- 172.21.15.18:0/1883848767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa78c0d2680 0x7fa78c157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:40.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.249+0000 7fa78b59e640 1 --2- 172.21.15.18:0/1883848767 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa78c0cfac0 0x7fa78c0ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:40.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.249+0000 7fa78b59e640 1 -- 172.21.15.18:0/1883848767 >> 172.21.15.18:0/1883848767 conn(0x7fa78c09de00 msgr2=0x7fa78c0c8700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:40.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.249+0000 7fa78b59e640 1 -- 172.21.15.18:0/1883848767 shutdown_connections 2024-09-19T09:13:40.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.249+0000 7fa78b59e640 1 -- 172.21.15.18:0/1883848767 wait complete. 2024-09-19T09:13:40.260 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:13:40.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.362+0000 7f10b6e3c640 1 Processor -- start 2024-09-19T09:13:40.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.362+0000 7f10b6e3c640 1 -- start start 2024-09-19T09:13:40.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.363+0000 7f10b6e3c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f10b015ed30 0x7f10b0070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:40.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.363+0000 7f10b6e3c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f10b00b5200 0x7f10b01629e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:40.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.363+0000 7f10b6e3c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10b00d0a10 con 0x7f10b0162f20 2024-09-19T09:13:40.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.363+0000 7f10b6e3c640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f10b0070ab0 con 0x7f10b015ed30 2024-09-19T09:13:40.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.363+0000 7f10b6e3c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f10b00d0cb0 con 0x7f10b00b5200 2024-09-19T09:13:40.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.363+0000 7f10b4bd8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f10b015ed30 0x7f10b0070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:40.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.363+0000 7f10b53d9640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f10b0162f20 0x7f10b00cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:42474/0 (socket says 172.21.15.18:42474) 2024-09-19T09:13:40.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.363+0000 7f10b53d9640 1 -- 172.21.15.18:0/977782367 learned_addr learned my addr 172.21.15.18:0/977782367 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:40.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.363+0000 7f10affff640 1 --2- 172.21.15.18:0/977782367 >> v2:172.21.15.162:3300/0 conn(0x7f10b00b5200 0x7f10b01629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:40.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.364+0000 7f10b4bd8640 1 -- 172.21.15.18:0/977782367 >> v2:172.21.15.162:3300/0 conn(0x7f10b00b5200 msgr2=0x7f10b01629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:40.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.364+0000 7f10b4bd8640 1 --2- 172.21.15.18:0/977782367 >> v2:172.21.15.162:3300/0 conn(0x7f10b00b5200 0x7f10b01629e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:40.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.364+0000 7f10b4bd8640 1 -- 172.21.15.18:0/977782367 >> v1:172.21.15.18:6789/0 conn(0x7f10b0162f20 legacy=0x7f10b00cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:40.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.364+0000 7f10b4bd8640 1 -- 172.21.15.18:0/977782367 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b00d0f90 con 0x7f10b015ed30 2024-09-19T09:13:40.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.364+0000 7f10af7fe640 1 -- 172.21.15.18:0/977782367 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3219200092 0 0) 0x7f10b00d0a10 con 0x7f10b0162f20 2024-09-19T09:13:40.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.364+0000 7f10affff640 1 --2- 172.21.15.18:0/977782367 >> v2:172.21.15.162:3300/0 conn(0x7f10b00b5200 0x7f10b01629e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:13:40.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.364+0000 7f10b4bd8640 1 --2- 172.21.15.18:0/977782367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10b015ed30 0x7f10b0070260 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f10b00b2540 tx=0x7f10a002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84de38f81f8efcf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:40.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.364+0000 7f10af7fe640 1 -- 172.21.15.18:0/977782367 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a0037070 con 0x7f10b015ed30 2024-09-19T09:13:40.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.364+0000 7f10af7fe640 1 -- 172.21.15.18:0/977782367 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10a0032440 con 0x7f10b015ed30 2024-09-19T09:13:40.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.364+0000 7f10af7fe640 1 -- 172.21.15.18:0/977782367 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a0032810 con 0x7f10b015ed30 2024-09-19T09:13:40.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.365+0000 7f10b6e3c640 1 -- 172.21.15.18:0/977782367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10b015ed30 msgr2=0x7f10b0070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:40.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.365+0000 7f10b6e3c640 1 --2- 172.21.15.18:0/977782367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10b015ed30 0x7f10b0070260 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f10b00b2540 tx=0x7f10a002a230 comp rx=0 tx=0).stop 2024-09-19T09:13:40.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.365+0000 7f10b6e3c640 1 -- 172.21.15.18:0/977782367 shutdown_connections 2024-09-19T09:13:40.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.365+0000 7f10b6e3c640 1 --2- 172.21.15.18:0/977782367 >> v2:172.21.15.162:3300/0 conn(0x7f10b00b5200 0x7f10b01629e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:40.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.365+0000 7f10b6e3c640 1 --2- 172.21.15.18:0/977782367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10b015ed30 0x7f10b0070260 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:40.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.365+0000 7f10b6e3c640 1 -- 172.21.15.18:0/977782367 >> 172.21.15.18:0/977782367 conn(0x7f10b00b4600 msgr2=0x7f10b00b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:40.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.365+0000 7f10b6e3c640 1 -- 172.21.15.18:0/977782367 shutdown_connections 2024-09-19T09:13:40.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.365+0000 7f10b6e3c640 1 -- 172.21.15.18:0/977782367 wait complete. 2024-09-19T09:13:40.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.366+0000 7f10b6e3c640 1 Processor -- start 2024-09-19T09:13:40.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.366+0000 7f10b6e3c640 1 -- start start 2024-09-19T09:13:40.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.367+0000 7f10b6e3c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10b00b5200 0x7f10b015a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:40.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.367+0000 7f10b6e3c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10b015ed30 0x7f10b00b6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:40.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.367+0000 7f10b6e3c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10b0162f20 0x7f10b00b8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:40.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.367+0000 7f10b6e3c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f10b0070f10 con 0x7f10b00b5200 2024-09-19T09:13:40.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.367+0000 7f10b6e3c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f10b0070d90 con 0x7f10b0162f20 2024-09-19T09:13:40.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.367+0000 7f10b6e3c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f10b015f110 con 0x7f10b015ed30 2024-09-19T09:13:40.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.367+0000 7f10b4bd8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10b00b5200 0x7f10b015a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:40.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.367+0000 7f10b4bd8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10b00b5200 0x7f10b015a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36752/0 (socket says 172.21.15.18:36752) 2024-09-19T09:13:40.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.367+0000 7f10b4bd8640 1 -- 172.21.15.18:0/4026924220 learned_addr learned my addr 172.21.15.18:0/4026924220 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:40.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.368+0000 7f10b4bd8640 1 -- 172.21.15.18:0/4026924220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10b015ed30 msgr2=0x7f10b00b6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:40.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.368+0000 7f10b4bd8640 1 --2- 172.21.15.18:0/4026924220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10b015ed30 0x7f10b00b6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:40.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.368+0000 7f10b4bd8640 1 -- 172.21.15.18:0/4026924220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10b0162f20 msgr2=0x7f10b00b8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:40.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.368+0000 7f10b53d9640 1 --2- 172.21.15.18:0/4026924220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10b0162f20 0x7f10b00b8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:40.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.368+0000 7f10b4bd8640 1 --2- 172.21.15.18:0/4026924220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10b0162f20 0x7f10b00b8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:40.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.368+0000 7f10b4bd8640 1 -- 172.21.15.18:0/4026924220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10b00b5e70 con 0x7f10b00b5200 2024-09-19T09:13:40.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.368+0000 7f10b53d9640 1 --2- 172.21.15.18:0/4026924220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10b0162f20 0x7f10b00b8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:13:40.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.368+0000 7f10b4bd8640 1 --2- 172.21.15.18:0/4026924220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10b00b5200 0x7f10b015a2b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f10a0035040 tx=0x7f10a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:40.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.368+0000 7f10ad7fa640 1 -- 172.21.15.18:0/4026924220 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a0037040 con 0x7f10b00b5200 2024-09-19T09:13:40.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.368+0000 7f10ad7fa640 1 -- 172.21.15.18:0/4026924220 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10a0004250 con 0x7f10b00b5200 2024-09-19T09:13:40.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.368+0000 7f10b6e3c640 1 -- 172.21.15.18:0/4026924220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10b00b6150 con 0x7f10b00b5200 2024-09-19T09:13:40.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.368+0000 7f10ad7fa640 1 -- 172.21.15.18:0/4026924220 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a0006e10 con 0x7f10b00b5200 2024-09-19T09:13:40.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.368+0000 7f10b6e3c640 1 -- 172.21.15.18:0/4026924220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10b00b6710 con 0x7f10b00b5200 2024-09-19T09:13:40.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.369+0000 7f10b6e3c640 1 -- 172.21.15.18:0/4026924220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10b01629e0 con 0x7f10b00b5200 2024-09-19T09:13:40.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.370+0000 7f10ad7fa640 1 -- 172.21.15.18:0/4026924220 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f10a0030770 con 0x7f10b00b5200 2024-09-19T09:13:40.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.370+0000 7f10ad7fa640 1 --2- 172.21.15.18:0/4026924220 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f109c06c2e0 0x7f109c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:40.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.370+0000 7f10ad7fa640 1 -- 172.21.15.18:0/4026924220 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f10a00ac5e0 con 0x7f10b00b5200 2024-09-19T09:13:40.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.370+0000 7f10affff640 1 --2- 172.21.15.18:0/4026924220 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f109c06c2e0 0x7f109c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:40.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.371+0000 7f10affff640 1 --2- 172.21.15.18:0/4026924220 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f109c06c2e0 0x7f109c06e7a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f10a4006fd0 tx=0x7f10a4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:40.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.374+0000 7f10ad7fa640 1 -- 172.21.15.18:0/4026924220 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f10a007af00 con 0x7f10b00b5200 2024-09-19T09:13:40.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.586+0000 7f10b6e3c640 1 -- 172.21.15.18:0/4026924220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10b00686d0 con 0x7f10b00b5200 2024-09-19T09:13:40.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.586+0000 7f10ad7fa640 1 -- 172.21.15.18:0/4026924220 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5217 (secure 0 0 0) 0x7f10a00810d0 con 0x7f10b00b5200 2024-09-19T09:13:40.587 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:40.587 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":6,"btime":"2024-09-19T09:13:29:505412+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3070220651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3070220651},{"type":"v1","addr":"172.21.15.162:6836","nonce":3070220651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/2341594474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2341594474},{"type":"v1","addr":"172.21.15.18:6833","nonce":2341594474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/603326104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":603326104},{"type":"v1","addr":"172.21.15.18:6835","nonce":603326104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:13:26.853577+0000","modified":"2024-09-19T09:13:28.847901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6837/727689889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":727689889},{"type":"v1","addr":"172.21.15.162:6837","nonce":727689889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":1}]} 2024-09-19T09:13:40.587 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 6 2024-09-19T09:13:40.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.588+0000 7f10b6e3c640 1 -- 172.21.15.18:0/4026924220 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f109c06c2e0 msgr2=0x7f109c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:40.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.588+0000 7f10b6e3c640 1 --2- 172.21.15.18:0/4026924220 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f109c06c2e0 0x7f109c06e7a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f10a4006fd0 tx=0x7f10a4008040 comp rx=0 tx=0).stop 2024-09-19T09:13:40.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.588+0000 7f10b6e3c640 1 -- 172.21.15.18:0/4026924220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10b00b5200 msgr2=0x7f10b015a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:40.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.588+0000 7f10b6e3c640 1 --2- 172.21.15.18:0/4026924220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10b00b5200 0x7f10b015a2b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f10a0035040 tx=0x7f10a00046c0 comp rx=0 tx=0).stop 2024-09-19T09:13:40.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.588+0000 7f10b6e3c640 1 -- 172.21.15.18:0/4026924220 shutdown_connections 2024-09-19T09:13:40.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.588+0000 7f10b6e3c640 1 --2- 172.21.15.18:0/4026924220 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f109c06c2e0 0x7f109c06e7a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:40.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.588+0000 7f10b6e3c640 1 --2- 172.21.15.18:0/4026924220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10b0162f20 0x7f10b00b8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:40.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.588+0000 7f10b6e3c640 1 --2- 172.21.15.18:0/4026924220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10b015ed30 0x7f10b00b6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:40.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.588+0000 7f10b6e3c640 1 --2- 172.21.15.18:0/4026924220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10b00b5200 0x7f10b015a2b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:40.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.589+0000 7f10b6e3c640 1 -- 172.21.15.18:0/4026924220 >> 172.21.15.18:0/4026924220 conn(0x7f10b00b4600 msgr2=0x7f10b00b3200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:40.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.589+0000 7f10b6e3c640 1 -- 172.21.15.18:0/4026924220 shutdown_connections 2024-09-19T09:13:40.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.589+0000 7f10b6e3c640 1 -- 172.21.15.18:0/4026924220 wait complete. 2024-09-19T09:13:40.600 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:13:40.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.701+0000 7f3faf277640 1 Processor -- start 2024-09-19T09:13:40.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.701+0000 7f3faf277640 1 -- start start 2024-09-19T09:13:40.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.702+0000 7f3faf277640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3fa80b5200 0x7f3fa81629e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:40.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.702+0000 7f3faf277640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fa8162f20 0x7f3fa80cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:40.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.702+0000 7f3faf277640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fa80d0a10 con 0x7f3fa815ed30 2024-09-19T09:13:40.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.702+0000 7f3faf277640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f3fa8070ab0 con 0x7f3fa80b5200 2024-09-19T09:13:40.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.702+0000 7f3faf277640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3fa80d0cb0 con 0x7f3fa8162f20 2024-09-19T09:13:40.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.702+0000 7f3fac812640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3fa80b5200 0x7f3fa81629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:40.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.702+0000 7f3fad013640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3fa815ed30 0x7f3fa8070260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:42490/0 (socket says 172.21.15.18:42490) 2024-09-19T09:13:40.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.702+0000 7f3fad013640 1 -- 172.21.15.18:0/1617179969 learned_addr learned my addr 172.21.15.18:0/1617179969 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:40.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.702+0000 7f3fac812640 1 -- 172.21.15.18:0/1617179969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fa8162f20 msgr2=0x7f3fa80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:40.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.702+0000 7f3fad814640 1 --2- 172.21.15.18:0/1617179969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fa8162f20 0x7f3fa80cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:40.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.703+0000 7f3fac812640 1 --2- 172.21.15.18:0/1617179969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fa8162f20 0x7f3fa80cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:40.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.703+0000 7f3fac812640 1 -- 172.21.15.18:0/1617179969 >> v1:172.21.15.18:6789/0 conn(0x7f3fa815ed30 legacy=0x7f3fa8070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:40.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.703+0000 7f3f9ffff640 1 -- 172.21.15.18:0/1617179969 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1320328953 0 0) 0x7f3fa80d0a10 con 0x7f3fa815ed30 2024-09-19T09:13:40.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.703+0000 7f3fac812640 1 -- 172.21.15.18:0/1617179969 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa80d0f90 con 0x7f3fa80b5200 2024-09-19T09:13:40.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.703+0000 7f3fad814640 1 --2- 172.21.15.18:0/1617179969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fa8162f20 0x7f3fa80cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:13:40.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.703+0000 7f3fac812640 1 --2- 172.21.15.18:0/1617179969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fa80b5200 0x7f3fa81629e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3f980097a0 tx=0x7f3f9802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaca1c0ccac93d7d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:40.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.703+0000 7f3f9ffff640 1 -- 172.21.15.18:0/1617179969 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f98037070 con 0x7f3fa80b5200 2024-09-19T09:13:40.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.703+0000 7f3f9ffff640 1 -- 172.21.15.18:0/1617179969 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f98032440 con 0x7f3fa80b5200 2024-09-19T09:13:40.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.703+0000 7f3f9ffff640 1 -- 172.21.15.18:0/1617179969 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f98032810 con 0x7f3fa80b5200 2024-09-19T09:13:40.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.704+0000 7f3faf277640 1 -- 172.21.15.18:0/1617179969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fa80b5200 msgr2=0x7f3fa81629e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:40.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.704+0000 7f3faf277640 1 --2- 172.21.15.18:0/1617179969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fa80b5200 0x7f3fa81629e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3f980097a0 tx=0x7f3f9802a210 comp rx=0 tx=0).stop 2024-09-19T09:13:40.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.704+0000 7f3faf277640 1 -- 172.21.15.18:0/1617179969 shutdown_connections 2024-09-19T09:13:40.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.704+0000 7f3faf277640 1 --2- 172.21.15.18:0/1617179969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fa8162f20 0x7f3fa80cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:40.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.704+0000 7f3faf277640 1 --2- 172.21.15.18:0/1617179969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fa80b5200 0x7f3fa81629e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:40.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.704+0000 7f3faf277640 1 -- 172.21.15.18:0/1617179969 >> 172.21.15.18:0/1617179969 conn(0x7f3fa80b4600 msgr2=0x7f3fa80b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:40.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.704+0000 7f3faf277640 1 -- 172.21.15.18:0/1617179969 shutdown_connections 2024-09-19T09:13:40.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.704+0000 7f3faf277640 1 -- 172.21.15.18:0/1617179969 wait complete. 2024-09-19T09:13:40.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.705+0000 7f3faf277640 1 Processor -- start 2024-09-19T09:13:40.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.705+0000 7f3faf277640 1 -- start start 2024-09-19T09:13:40.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.706+0000 7f3faf277640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fa80b5200 0x7f3fa80b8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:40.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.706+0000 7f3faf277640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fa815ed30 0x7f3fa80b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:40.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.706+0000 7f3faf277640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fa8162f20 0x7f3fa80b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:40.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.706+0000 7f3faf277640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa815f290 con 0x7f3fa815ed30 2024-09-19T09:13:40.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.706+0000 7f3faf277640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa815f110 con 0x7f3fa80b5200 2024-09-19T09:13:40.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.706+0000 7f3faf277640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3fa80cf720 con 0x7f3fa8162f20 2024-09-19T09:13:40.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.706+0000 7f3fac812640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fa815ed30 0x7f3fa80b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:40.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.706+0000 7f3fac812640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fa815ed30 0x7f3fa80b39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36774/0 (socket says 172.21.15.18:36774) 2024-09-19T09:13:40.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.706+0000 7f3fac812640 1 -- 172.21.15.18:0/2029639065 learned_addr learned my addr 172.21.15.18:0/2029639065 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:40.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.706+0000 7f3fad814640 1 --2- 172.21.15.18:0/2029639065 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fa8162f20 0x7f3fa80b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:40.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.706+0000 7f3fad013640 1 --2- 172.21.15.18:0/2029639065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fa80b5200 0x7f3fa80b8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:40.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.706+0000 7f3fac812640 1 -- 172.21.15.18:0/2029639065 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fa8162f20 msgr2=0x7f3fa80b3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:40.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.706+0000 7f3fac812640 1 --2- 172.21.15.18:0/2029639065 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fa8162f20 0x7f3fa80b3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:40.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.706+0000 7f3fac812640 1 -- 172.21.15.18:0/2029639065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fa80b5200 msgr2=0x7f3fa80b8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:40.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.706+0000 7f3fac812640 1 --2- 172.21.15.18:0/2029639065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fa80b5200 0x7f3fa80b8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:40.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.706+0000 7f3fac812640 1 -- 172.21.15.18:0/2029639065 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa80c8260 con 0x7f3fa815ed30 2024-09-19T09:13:40.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.706+0000 7f3fad013640 1 --2- 172.21.15.18:0/2029639065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fa80b5200 0x7f3fa80b8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:13:40.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.707+0000 7f3fac812640 1 --2- 172.21.15.18:0/2029639065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fa815ed30 0x7f3fa80b39a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3f980096f0 tx=0x7f3f980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:40.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.707+0000 7f3f9dffb640 1 -- 172.21.15.18:0/2029639065 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f98037040 con 0x7f3fa815ed30 2024-09-19T09:13:40.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.707+0000 7f3f9dffb640 1 -- 172.21.15.18:0/2029639065 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f980307b0 con 0x7f3fa815ed30 2024-09-19T09:13:40.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.707+0000 7f3faf277640 1 -- 172.21.15.18:0/2029639065 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fa80c8540 con 0x7f3fa815ed30 2024-09-19T09:13:40.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.707+0000 7f3f9dffb640 1 -- 172.21.15.18:0/2029639065 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f98030b80 con 0x7f3fa815ed30 2024-09-19T09:13:40.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.707+0000 7f3faf277640 1 -- 172.21.15.18:0/2029639065 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fa80c8b00 con 0x7f3fa815ed30 2024-09-19T09:13:40.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.708+0000 7f3faf277640 1 -- 172.21.15.18:0/2029639065 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fa80cf1e0 con 0x7f3fa815ed30 2024-09-19T09:13:40.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.708+0000 7f3f9dffb640 1 -- 172.21.15.18:0/2029639065 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3f98044020 con 0x7f3fa815ed30 2024-09-19T09:13:40.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.709+0000 7f3f9dffb640 1 --2- 172.21.15.18:0/2029639065 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3f8c06c2e0 0x7f3f8c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:40.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.709+0000 7f3f9dffb640 1 -- 172.21.15.18:0/2029639065 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3f980ab750 con 0x7f3fa815ed30 2024-09-19T09:13:40.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.709+0000 7f3fad013640 1 --2- 172.21.15.18:0/2029639065 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3f8c06c2e0 0x7f3f8c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:40.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.710+0000 7f3fad013640 1 --2- 172.21.15.18:0/2029639065 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3f8c06c2e0 0x7f3f8c06e7a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4000f60 tx=0x7f3fa4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:40.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.713+0000 7f3f9dffb640 1 -- 172.21.15.18:0/2029639065 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3f9804b020 con 0x7f3fa815ed30 2024-09-19T09:13:40.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.889+0000 7f3faf277640 1 -- 172.21.15.18:0/2029639065 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3fa815e370 con 0x7f3fa815ed30 2024-09-19T09:13:40.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.891+0000 7f3f9dffb640 1 -- 172.21.15.18:0/2029639065 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16681 (secure 0 0 0) 0x7f3f98032e20 con 0x7f3fa815ed30 2024-09-19T09:13:40.891 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:40.891 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:13:28.500103+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:13:25.116784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:13:25.838110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:13:40.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.892+0000 7f3faf277640 1 -- 172.21.15.18:0/2029639065 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3f8c06c2e0 msgr2=0x7f3f8c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:40.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.892+0000 7f3faf277640 1 --2- 172.21.15.18:0/2029639065 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3f8c06c2e0 0x7f3f8c06e7a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4000f60 tx=0x7f3fa4009040 comp rx=0 tx=0).stop 2024-09-19T09:13:40.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.892+0000 7f3faf277640 1 -- 172.21.15.18:0/2029639065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fa815ed30 msgr2=0x7f3fa80b39a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:40.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.892+0000 7f3faf277640 1 --2- 172.21.15.18:0/2029639065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fa815ed30 0x7f3fa80b39a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3f980096f0 tx=0x7f3f980046c0 comp rx=0 tx=0).stop 2024-09-19T09:13:40.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.893+0000 7f3faf277640 1 -- 172.21.15.18:0/2029639065 shutdown_connections 2024-09-19T09:13:40.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.893+0000 7f3faf277640 1 --2- 172.21.15.18:0/2029639065 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3f8c06c2e0 0x7f3f8c06e7a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:40.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.893+0000 7f3faf277640 1 --2- 172.21.15.18:0/2029639065 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fa8162f20 0x7f3fa80b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:40.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.893+0000 7f3faf277640 1 --2- 172.21.15.18:0/2029639065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fa815ed30 0x7f3fa80b39a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:40.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.893+0000 7f3faf277640 1 --2- 172.21.15.18:0/2029639065 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fa80b5200 0x7f3fa80b8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:40.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.893+0000 7f3faf277640 1 -- 172.21.15.18:0/2029639065 >> 172.21.15.18:0/2029639065 conn(0x7f3fa80b4600 msgr2=0x7f3fa80cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:40.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.893+0000 7f3faf277640 1 -- 172.21.15.18:0/2029639065 shutdown_connections 2024-09-19T09:13:40.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:40.893+0000 7f3faf277640 1 -- 172.21.15.18:0/2029639065 wait complete. 2024-09-19T09:13:40.904 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:13:41.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.005+0000 7f0713c3c640 1 Processor -- start 2024-09-19T09:13:41.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.005+0000 7f0713c3c640 1 -- start start 2024-09-19T09:13:41.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.006+0000 7f0713c3c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f070c15ed30 0x7f070c070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:41.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.006+0000 7f0713c3c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f070c1630f0 0x7f070c0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:41.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.006+0000 7f0713c3c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f070c0d0a10 con 0x7f070c0b5200 2024-09-19T09:13:41.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.006+0000 7f0713c3c640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f070c070ab0 con 0x7f070c15ed30 2024-09-19T09:13:41.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.006+0000 7f0713c3c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f070c0d0cb0 con 0x7f070c1630f0 2024-09-19T09:13:41.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.006+0000 7f07119d8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f070c15ed30 0x7f070c070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:41.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.006+0000 7f07119d8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f070c15ed30 0x7f070c070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36788/0 (socket says 172.21.15.18:36788) 2024-09-19T09:13:41.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.006+0000 7f07119d8640 1 -- 172.21.15.18:0/3159370297 learned_addr learned my addr 172.21.15.18:0/3159370297 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:41.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.007+0000 7f07121d9640 1 --2- 172.21.15.18:0/3159370297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f070c1630f0 0x7f070c0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:41.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.007+0000 7f07119d8640 1 -- 172.21.15.18:0/3159370297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f070c1630f0 msgr2=0x7f070c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:41.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.007+0000 7f07119d8640 1 --2- 172.21.15.18:0/3159370297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f070c1630f0 0x7f070c0cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.007+0000 7f07119d8640 1 -- 172.21.15.18:0/3159370297 >> v1:172.21.15.162:6789/0 conn(0x7f070c0b5200 legacy=0x7f070c1629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:41.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.007+0000 7f07119d8640 1 -- 172.21.15.18:0/3159370297 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f070c0d0f90 con 0x7f070c15ed30 2024-09-19T09:13:41.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.007+0000 7f07119d8640 1 --2- 172.21.15.18:0/3159370297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f070c15ed30 0x7f070c070260 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0708009870 tx=0x7f070802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef1c94973e50000d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:41.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.008+0000 7f07109d6640 1 -- 172.21.15.18:0/3159370297 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0708037070 con 0x7f070c15ed30 2024-09-19T09:13:41.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.008+0000 7f07109d6640 1 -- 172.21.15.18:0/3159370297 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f070802ae50 con 0x7f070c15ed30 2024-09-19T09:13:41.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.008+0000 7f07109d6640 1 -- 172.21.15.18:0/3159370297 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0708032860 con 0x7f070c15ed30 2024-09-19T09:13:41.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.008+0000 7f0713c3c640 1 -- 172.21.15.18:0/3159370297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f070c15ed30 msgr2=0x7f070c070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:41.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.008+0000 7f0713c3c640 1 --2- 172.21.15.18:0/3159370297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f070c15ed30 0x7f070c070260 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0708009870 tx=0x7f070802a300 comp rx=0 tx=0).stop 2024-09-19T09:13:41.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.008+0000 7f0713c3c640 1 -- 172.21.15.18:0/3159370297 shutdown_connections 2024-09-19T09:13:41.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.008+0000 7f0713c3c640 1 --2- 172.21.15.18:0/3159370297 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f070c1630f0 0x7f070c0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.008+0000 7f0713c3c640 1 --2- 172.21.15.18:0/3159370297 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f070c15ed30 0x7f070c070260 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.008+0000 7f0713c3c640 1 -- 172.21.15.18:0/3159370297 >> 172.21.15.18:0/3159370297 conn(0x7f070c0b4600 msgr2=0x7f070c0b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:41.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.008+0000 7f0713c3c640 1 -- 172.21.15.18:0/3159370297 shutdown_connections 2024-09-19T09:13:41.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.008+0000 7f0713c3c640 1 -- 172.21.15.18:0/3159370297 wait complete. 2024-09-19T09:13:41.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.009+0000 7f0713c3c640 1 Processor -- start 2024-09-19T09:13:41.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.009+0000 7f0713c3c640 1 -- start start 2024-09-19T09:13:41.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.010+0000 7f0713c3c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f070c0b5200 0x7f070c0d1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:41.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.010+0000 7f0713c3c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f070c15ed30 0x7f070c155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:41.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.010+0000 7f0713c3c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f070c1630f0 0x7f070c1560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:41.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.010+0000 7f0713c3c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f070c070f10 con 0x7f070c15ed30 2024-09-19T09:13:41.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.010+0000 7f0713c3c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f070c070d90 con 0x7f070c1630f0 2024-09-19T09:13:41.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.010+0000 7f0713c3c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f070c15f110 con 0x7f070c0b5200 2024-09-19T09:13:41.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.010+0000 7f07111d7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f070c15ed30 0x7f070c155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:41.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.010+0000 7f07111d7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f070c15ed30 0x7f070c155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36792/0 (socket says 172.21.15.18:36792) 2024-09-19T09:13:41.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.010+0000 7f07111d7640 1 -- 172.21.15.18:0/4051108247 learned_addr learned my addr 172.21.15.18:0/4051108247 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:41.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.010+0000 7f07121d9640 1 --2- 172.21.15.18:0/4051108247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f070c1630f0 0x7f070c1560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:41.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.010+0000 7f07119d8640 1 --2- 172.21.15.18:0/4051108247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f070c0b5200 0x7f070c0d1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:41.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.011+0000 7f07111d7640 1 -- 172.21.15.18:0/4051108247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f070c0b5200 msgr2=0x7f070c0d1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:41.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.011+0000 7f07111d7640 1 --2- 172.21.15.18:0/4051108247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f070c0b5200 0x7f070c0d1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.011+0000 7f07111d7640 1 -- 172.21.15.18:0/4051108247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f070c1630f0 msgr2=0x7f070c1560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:41.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.011+0000 7f07111d7640 1 --2- 172.21.15.18:0/4051108247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f070c1630f0 0x7f070c1560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.011+0000 7f07111d7640 1 -- 172.21.15.18:0/4051108247 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f070c0cddf0 con 0x7f070c15ed30 2024-09-19T09:13:41.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.011+0000 7f07121d9640 1 --2- 172.21.15.18:0/4051108247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f070c1630f0 0x7f070c1560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:13:41.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.011+0000 7f07111d7640 1 --2- 172.21.15.18:0/4051108247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f070c15ed30 0x7f070c155b80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00c430 tx=0x7f06fc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:41.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.011+0000 7f07027fc640 1 -- 172.21.15.18:0/4051108247 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06fc0052d0 con 0x7f070c15ed30 2024-09-19T09:13:41.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.011+0000 7f07027fc640 1 -- 172.21.15.18:0/4051108247 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06fc005490 con 0x7f070c15ed30 2024-09-19T09:13:41.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.011+0000 7f0713c3c640 1 -- 172.21.15.18:0/4051108247 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f070c0ce0d0 con 0x7f070c15ed30 2024-09-19T09:13:41.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.011+0000 7f07027fc640 1 -- 172.21.15.18:0/4051108247 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06fc007260 con 0x7f070c15ed30 2024-09-19T09:13:41.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.011+0000 7f0713c3c640 1 -- 172.21.15.18:0/4051108247 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f070c0ce690 con 0x7f070c15ed30 2024-09-19T09:13:41.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.012+0000 7f0713c3c640 1 -- 172.21.15.18:0/4051108247 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f070c070260 con 0x7f070c15ed30 2024-09-19T09:13:41.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.013+0000 7f07027fc640 1 -- 172.21.15.18:0/4051108247 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f06fc007400 con 0x7f070c15ed30 2024-09-19T09:13:41.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.013+0000 7f07027fc640 1 --2- 172.21.15.18:0/4051108247 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f06f006c2b0 0x7f06f006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:41.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.013+0000 7f07027fc640 1 -- 172.21.15.18:0/4051108247 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f06fc08a8c0 con 0x7f070c15ed30 2024-09-19T09:13:41.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.013+0000 7f07119d8640 1 --2- 172.21.15.18:0/4051108247 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f06f006c2b0 0x7f06f006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:41.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.014+0000 7f07119d8640 1 --2- 172.21.15.18:0/4051108247 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f06f006c2b0 0x7f06f006e770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0708034000 tx=0x7f070802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:41.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.017+0000 7f07027fc640 1 -- 172.21.15.18:0/4051108247 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f06fc0590c0 con 0x7f070c15ed30 2024-09-19T09:13:41.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.233+0000 7f0713c3c640 1 -- 172.21.15.18:0/4051108247 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f070c0686d0 con 0x7f070c15ed30 2024-09-19T09:13:41.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.234+0000 7f07027fc640 1 -- 172.21.15.18:0/4051108247 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5217 (secure 0 0 0) 0x7f06fc0589c0 con 0x7f070c15ed30 2024-09-19T09:13:41.234 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:41.234 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":6,"btime":"2024-09-19T09:13:29:505412+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3070220651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3070220651},{"type":"v1","addr":"172.21.15.162:6836","nonce":3070220651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/2341594474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2341594474},{"type":"v1","addr":"172.21.15.18:6833","nonce":2341594474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/603326104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":603326104},{"type":"v1","addr":"172.21.15.18:6835","nonce":603326104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:13:26.853577+0000","modified":"2024-09-19T09:13:28.847901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6837/727689889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":727689889},{"type":"v1","addr":"172.21.15.162:6837","nonce":727689889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":1}]} 2024-09-19T09:13:41.235 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 6 2024-09-19T09:13:41.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.236+0000 7f0713c3c640 1 -- 172.21.15.18:0/4051108247 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f06f006c2b0 msgr2=0x7f06f006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:41.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.236+0000 7f0713c3c640 1 --2- 172.21.15.18:0/4051108247 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f06f006c2b0 0x7f06f006e770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0708034000 tx=0x7f070802e000 comp rx=0 tx=0).stop 2024-09-19T09:13:41.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.236+0000 7f0713c3c640 1 -- 172.21.15.18:0/4051108247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f070c15ed30 msgr2=0x7f070c155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:41.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.236+0000 7f0713c3c640 1 --2- 172.21.15.18:0/4051108247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f070c15ed30 0x7f070c155b80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f06fc00c430 tx=0x7f06fc00c8f0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.236+0000 7f0713c3c640 1 -- 172.21.15.18:0/4051108247 shutdown_connections 2024-09-19T09:13:41.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.236+0000 7f0713c3c640 1 --2- 172.21.15.18:0/4051108247 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f06f006c2b0 0x7f06f006e770 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.236+0000 7f0713c3c640 1 --2- 172.21.15.18:0/4051108247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f070c1630f0 0x7f070c1560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.236+0000 7f0713c3c640 1 --2- 172.21.15.18:0/4051108247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f070c15ed30 0x7f070c155b80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.236+0000 7f0713c3c640 1 --2- 172.21.15.18:0/4051108247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f070c0b5200 0x7f070c0d1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.236+0000 7f0713c3c640 1 -- 172.21.15.18:0/4051108247 >> 172.21.15.18:0/4051108247 conn(0x7f070c0b4600 msgr2=0x7f070c06f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:41.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.236+0000 7f0713c3c640 1 -- 172.21.15.18:0/4051108247 shutdown_connections 2024-09-19T09:13:41.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.236+0000 7f0713c3c640 1 -- 172.21.15.18:0/4051108247 wait complete. 2024-09-19T09:13:41.649 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T09:13:26.853577+0000', 'modified': '2024-09-19T09:13:28.847901+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4275}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4275': {'gid': 4275, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.162:6837/727689889', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6835', 'nonce': 727689889}, {'type': 'v1', 'addr': '172.21.15.162:6837', 'nonce': 727689889}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4275, 'qdb_cluster': [4275]} 2024-09-19T09:13:41.649 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T09:13:41.649 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-19T09:13:41.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.758+0000 7f33c721e640 1 Processor -- start 2024-09-19T09:13:41.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.758+0000 7f33c721e640 1 -- start start 2024-09-19T09:13:41.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.759+0000 7f33c721e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f33c00ba7e0 0x7f33c00d0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:41.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.759+0000 7f33c721e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f33c00d5870 0x7f33c00d2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:41.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.759+0000 7f33c721e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33c00d3640 con 0x7f33c00d3230 2024-09-19T09:13:41.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.759+0000 7f33c721e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f33c00babc0 con 0x7f33c00d5870 2024-09-19T09:13:41.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.759+0000 7f33c721e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f33c00d0aa0 con 0x7f33c00ba7e0 2024-09-19T09:13:41.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.759+0000 7f33bffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f33c00d5870 0x7f33c00d2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:41.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.759+0000 7f33bffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f33c00d5870 0x7f33c00d2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36796/0 (socket says 172.21.15.18:36796) 2024-09-19T09:13:41.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.759+0000 7f33bffff640 1 -- 172.21.15.18:0/4085582274 learned_addr learned my addr 172.21.15.18:0/4085582274 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:41.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.759+0000 7f33bffff640 1 -- 172.21.15.18:0/4085582274 >> v2:172.21.15.162:3300/0 conn(0x7f33c00ba7e0 msgr2=0x7f33c00d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:41.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.759+0000 7f33bffff640 1 --2- 172.21.15.18:0/4085582274 >> v2:172.21.15.162:3300/0 conn(0x7f33c00ba7e0 0x7f33c00d0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.759+0000 7f33bffff640 1 -- 172.21.15.18:0/4085582274 >> v1:172.21.15.162:6789/0 conn(0x7f33c00d3230 legacy=0x7f33c01618f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:41.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.759+0000 7f33bffff640 1 -- 172.21.15.18:0/4085582274 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c00b7b60 con 0x7f33c00d5870 2024-09-19T09:13:41.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.760+0000 7f33bffff640 1 --2- 172.21.15.18:0/4085582274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33c00d5870 0x7f33c00d2cf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f33c008e0b0 tx=0x7f33ac02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef75a1d66a089d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:41.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.760+0000 7f33bf7fe640 1 -- 172.21.15.18:0/4085582274 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac037070 con 0x7f33c00d5870 2024-09-19T09:13:41.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.760+0000 7f33bf7fe640 1 -- 172.21.15.18:0/4085582274 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33ac032440 con 0x7f33c00d5870 2024-09-19T09:13:41.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.760+0000 7f33bf7fe640 1 -- 172.21.15.18:0/4085582274 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac032810 con 0x7f33c00d5870 2024-09-19T09:13:41.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.761+0000 7f33c721e640 1 -- 172.21.15.18:0/4085582274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33c00d5870 msgr2=0x7f33c00d2cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:41.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.761+0000 7f33c721e640 1 --2- 172.21.15.18:0/4085582274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33c00d5870 0x7f33c00d2cf0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f33c008e0b0 tx=0x7f33ac02a230 comp rx=0 tx=0).stop 2024-09-19T09:13:41.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.761+0000 7f33c721e640 1 -- 172.21.15.18:0/4085582274 shutdown_connections 2024-09-19T09:13:41.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.761+0000 7f33c721e640 1 --2- 172.21.15.18:0/4085582274 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33c00d5870 0x7f33c00d2cf0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.761+0000 7f33c721e640 1 --2- 172.21.15.18:0/4085582274 >> v2:172.21.15.162:3300/0 conn(0x7f33c00ba7e0 0x7f33c00d0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.761+0000 7f33c721e640 1 -- 172.21.15.18:0/4085582274 >> 172.21.15.18:0/4085582274 conn(0x7f33c00d4c70 msgr2=0x7f33c00d5080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:41.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.761+0000 7f33c721e640 1 -- 172.21.15.18:0/4085582274 shutdown_connections 2024-09-19T09:13:41.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.761+0000 7f33c721e640 1 -- 172.21.15.18:0/4085582274 wait complete. 2024-09-19T09:13:41.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.762+0000 7f33c721e640 1 Processor -- start 2024-09-19T09:13:41.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.762+0000 7f33c721e640 1 -- start start 2024-09-19T09:13:41.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.763+0000 7f33c721e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33c00ba7e0 0x7f33c01d99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:41.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.763+0000 7f33c721e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33c00d3230 0x7f33c00c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:41.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.763+0000 7f33c721e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33c00d5870 0x7f33c00c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:41.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.763+0000 7f33c721e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f33c00b8400 con 0x7f33c00ba7e0 2024-09-19T09:13:41.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.763+0000 7f33c721e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f33c00b8120 con 0x7f33c00d3230 2024-09-19T09:13:41.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.763+0000 7f33c721e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f33c00d0760 con 0x7f33c00d5870 2024-09-19T09:13:41.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.763+0000 7f33c4fba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33c00ba7e0 0x7f33c01d99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:41.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.763+0000 7f33c4fba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33c00ba7e0 0x7f33c01d99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36812/0 (socket says 172.21.15.18:36812) 2024-09-19T09:13:41.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.763+0000 7f33c4fba640 1 -- 172.21.15.18:0/3028813891 learned_addr learned my addr 172.21.15.18:0/3028813891 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:41.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.763+0000 7f33bffff640 1 --2- 172.21.15.18:0/3028813891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33c00d3230 0x7f33c00c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:41.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.763+0000 7f33c57bb640 1 --2- 172.21.15.18:0/3028813891 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33c00d5870 0x7f33c00c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.763+0000 7f33c4fba640 1 -- 172.21.15.18:0/3028813891 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33c00d5870 msgr2=0x7f33c00c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.763+0000 7f33c4fba640 1 --2- 172.21.15.18:0/3028813891 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33c00d5870 0x7f33c00c87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.763+0000 7f33c4fba640 1 -- 172.21.15.18:0/3028813891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33c00d3230 msgr2=0x7f33c00c9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.763+0000 7f33c4fba640 1 --2- 172.21.15.18:0/3028813891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33c00d3230 0x7f33c00c9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.763+0000 7f33c4fba640 1 -- 172.21.15.18:0/3028813891 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c00ca500 con 0x7f33c00ba7e0 2024-09-19T09:13:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.763+0000 7f33c4fba640 1 --2- 172.21.15.18:0/3028813891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33c00ba7e0 0x7f33c01d99d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f33b400b410 tx=0x7f33b400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.764+0000 7f33bd7fa640 1 -- 172.21.15.18:0/3028813891 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b4015020 con 0x7f33c00ba7e0 2024-09-19T09:13:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.764+0000 7f33bd7fa640 1 -- 172.21.15.18:0/3028813891 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33b4011850 con 0x7f33c00ba7e0 2024-09-19T09:13:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.764+0000 7f33c721e640 1 -- 172.21.15.18:0/3028813891 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33c00ca7e0 con 0x7f33c00ba7e0 2024-09-19T09:13:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.764+0000 7f33bd7fa640 1 -- 172.21.15.18:0/3028813891 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b4011c40 con 0x7f33c00ba7e0 2024-09-19T09:13:41.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.764+0000 7f33c721e640 1 -- 172.21.15.18:0/3028813891 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33c00cada0 con 0x7f33c00ba7e0 2024-09-19T09:13:41.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.765+0000 7f33bd7fa640 1 -- 172.21.15.18:0/3028813891 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f33b4018020 con 0x7f33c00ba7e0 2024-09-19T09:13:41.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.766+0000 7f33bd7fa640 1 --2- 172.21.15.18:0/3028813891 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f33a406c2b0 0x7f33a406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:41.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.766+0000 7f33bd7fa640 1 -- 172.21.15.18:0/3028813891 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f33b408b4a0 con 0x7f33c00ba7e0 2024-09-19T09:13:41.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.766+0000 7f33bffff640 1 --2- 172.21.15.18:0/3028813891 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f33a406c2b0 0x7f33a406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:41.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.767+0000 7f33bffff640 1 --2- 172.21.15.18:0/3028813891 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f33a406c2b0 0x7f33a406e770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f33ac034000 tx=0x7f33ac02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:41.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.767+0000 7f33ca08d740 1 Processor -- start 2024-09-19T09:13:41.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.767+0000 7f33ca08d740 1 -- start start 2024-09-19T09:13:41.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.767+0000 7f33ca08d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648775fd2c0 0x564877642a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:41.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.767+0000 7f33ca08d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648775faa80 0x5648775fd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:41.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.767+0000 7f33ca08d740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5648775fea50 0x5648775f78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:41.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.767+0000 7f33ca08d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x56487755f520 con 0x5648775faa80 2024-09-19T09:13:41.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.767+0000 7f33ca08d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5648775073e0 con 0x5648775fd2c0 2024-09-19T09:13:41.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.767+0000 7f33ca08d740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56487755b4e0 con 0x5648775fea50 2024-09-19T09:13:41.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.768+0000 7f33bffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648775faa80 0x5648775fd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:41.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.768+0000 7f33bffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648775faa80 0x5648775fd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36820/0 (socket says 172.21.15.18:36820) 2024-09-19T09:13:41.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.768+0000 7f33bffff640 1 -- 172.21.15.18:0/1052217849 learned_addr learned my addr 172.21.15.18:0/1052217849 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:41.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.768+0000 7f33c4fba640 1 --2- 172.21.15.18:0/1052217849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648775fd2c0 0x564877642a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:41.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.768+0000 7f33c57bb640 1 --2- 172.21.15.18:0/1052217849 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5648775fea50 0x5648775f78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:41.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.768+0000 7f33bffff640 1 -- 172.21.15.18:0/1052217849 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5648775fea50 msgr2=0x5648775f78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:41.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.768+0000 7f33bffff640 1 --2- 172.21.15.18:0/1052217849 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5648775fea50 0x5648775f78b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.768+0000 7f33bffff640 1 -- 172.21.15.18:0/1052217849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648775fd2c0 msgr2=0x564877642a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:41.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.768+0000 7f33bffff640 1 --2- 172.21.15.18:0/1052217849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648775fd2c0 0x564877642a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.768+0000 7f33bffff640 1 -- 172.21.15.18:0/1052217849 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648775222f0 con 0x5648775faa80 2024-09-19T09:13:41.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.768+0000 7f33c57bb640 1 --2- 172.21.15.18:0/1052217849 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5648775fea50 0x5648775f78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:13:41.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.768+0000 7f33bffff640 1 --2- 172.21.15.18:0/1052217849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648775faa80 0x5648775fd6a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f33ac006da0 tx=0x7f33ac02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26dbd00cb7013445 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:41.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.768+0000 7f33aa7fc640 1 -- 172.21.15.18:0/1052217849 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac04c070 con 0x5648775faa80 2024-09-19T09:13:41.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.768+0000 7f33aa7fc640 1 -- 172.21.15.18:0/1052217849 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33ac03e460 con 0x5648775faa80 2024-09-19T09:13:41.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.768+0000 7f33aa7fc640 1 -- 172.21.15.18:0/1052217849 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac037040 con 0x5648775faa80 2024-09-19T09:13:41.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.769+0000 7f33ca08d740 1 -- 172.21.15.18:0/1052217849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648775faa80 msgr2=0x5648775fd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:41.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.769+0000 7f33ca08d740 1 --2- 172.21.15.18:0/1052217849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648775faa80 0x5648775fd6a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f33ac006da0 tx=0x7f33ac02c000 comp rx=0 tx=0).stop 2024-09-19T09:13:41.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.769+0000 7f33ca08d740 1 -- 172.21.15.18:0/1052217849 shutdown_connections 2024-09-19T09:13:41.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.769+0000 7f33ca08d740 1 --2- 172.21.15.18:0/1052217849 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5648775fea50 0x5648775f78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.769+0000 7f33ca08d740 1 --2- 172.21.15.18:0/1052217849 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648775faa80 0x5648775fd6a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.769+0000 7f33ca08d740 1 --2- 172.21.15.18:0/1052217849 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648775fd2c0 0x564877642a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.769+0000 7f33ca08d740 1 -- 172.21.15.18:0/1052217849 >> 172.21.15.18:0/1052217849 conn(0x5648775f9a80 msgr2=0x564877641f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:41.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.769+0000 7f33ca08d740 1 -- 172.21.15.18:0/1052217849 shutdown_connections 2024-09-19T09:13:41.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.769+0000 7f33ca08d740 1 -- 172.21.15.18:0/1052217849 wait complete. 2024-09-19T09:13:41.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.769+0000 7f33ca08d740 1 -- start start 2024-09-19T09:13:41.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.770+0000 7f33ca08d740 1 Processor -- start 2024-09-19T09:13:41.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.770+0000 7f33ca08d740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5648775fd2c0 0x564877626580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:41.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.771+0000 7f33ca08d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648775fea50 0x56487761b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:41.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.771+0000 7f33ca08d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56487761d370 0x56487761bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:41.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.771+0000 7f33ca08d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5648775f8f20 con 0x5648775fea50 2024-09-19T09:13:41.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.771+0000 7f33ca08d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5648774e8450 con 0x56487761d370 2024-09-19T09:13:41.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.771+0000 7f33ca08d740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x564877643290 con 0x5648775fd2c0 2024-09-19T09:13:41.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.771+0000 7f33ca08d740 10 client.0 _ll_register_callbacks cb 0x564877271ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:13:41.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.771+0000 7f33bffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648775fea50 0x56487761b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:41.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.771+0000 7f33bffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648775fea50 0x56487761b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36822/0 (socket says 172.21.15.18:36822) 2024-09-19T09:13:41.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.771+0000 7f33bffff640 1 -- 172.21.15.18:0/2699293749 learned_addr learned my addr 172.21.15.18:0/2699293749 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:41.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.771+0000 7f33c4fba640 1 --2- 172.21.15.18:0/2699293749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5648775fd2c0 0x564877626580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:41.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.771+0000 7f33c57bb640 1 --2- 172.21.15.18:0/2699293749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56487761d370 0x56487761bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:41.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.771+0000 7f33bffff640 1 -- 172.21.15.18:0/2699293749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5648775fd2c0 msgr2=0x564877626580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:41.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.771+0000 7f33bffff640 1 --2- 172.21.15.18:0/2699293749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5648775fd2c0 0x564877626580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.771+0000 7f33bffff640 1 -- 172.21.15.18:0/2699293749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56487761d370 msgr2=0x56487761bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:41.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.771+0000 7f33bffff640 1 --2- 172.21.15.18:0/2699293749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56487761d370 0x56487761bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.771+0000 7f33bffff640 1 -- 172.21.15.18:0/2699293749 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648772722d0 con 0x5648775fea50 2024-09-19T09:13:41.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.771+0000 7f33bffff640 1 --2- 172.21.15.18:0/2699293749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648775fea50 0x56487761b700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f33ac009630 tx=0x7f33ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb933c27d083d1c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:41.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.771+0000 7f339f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:13:41.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.771+0000 7f339f7fe640 1 -- 172.21.15.18:0/2699293749 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac04c070 con 0x5648775fea50 2024-09-19T09:13:41.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.771+0000 7f339f7fe640 1 -- 172.21.15.18:0/2699293749 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f33ac03ea20 con 0x5648775fea50 2024-09-19T09:13:41.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.771+0000 7f33ca08d740 1 -- 172.21.15.18:0/2699293749 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33ac03e460 con 0x5648775fea50 2024-09-19T09:13:41.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.771+0000 7f339f7fe640 1 -- 172.21.15.18:0/2699293749 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f33ac037070 con 0x5648775fea50 2024-09-19T09:13:41.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.771+0000 7f33ca08d740 10 client.4596 fetch_fsmap learned FSMap version 6 2024-09-19T09:13:41.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.771+0000 7f33ca08d740 1 -- 172.21.15.18:0/2699293749 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x56487733c6b0 con 0x5648775fea50 2024-09-19T09:13:41.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.772+0000 7f339f7fe640 1 -- 172.21.15.18:0/2699293749 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33ac03e460 con 0x5648775fea50 2024-09-19T09:13:41.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.772+0000 7f339f7fe640 1 -- 172.21.15.18:0/2699293749 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7f33ac046070 con 0x5648775fea50 2024-09-19T09:13:41.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.772+0000 7f33ca08d740 10 client.4596 fetch_fsmap finished waiting for FSMap version 6 2024-09-19T09:13:41.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.772+0000 7f33ca08d740 10 client.4596 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:13:41.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.772+0000 7f33ca08d740 20 client.4596 populate_metadata read hostname 'smithi018' 2024-09-19T09:13:41.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.772+0000 7f33ca08d740 1 --2- 172.21.15.18:0/2699293749 >> [v2:172.21.15.162:6835/727689889,v1:172.21.15.162:6837/727689889] conn(0x5648775f67d0 0x5648775f6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:41.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.772+0000 7f33ca08d740 4 client.4596 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:13:41.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.772+0000 7f33ca08d740 1 -- 172.21.15.18:0/2699293749 --> [v2:172.21.15.162:6835/727689889,v1:172.21.15.162:6837/727689889] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56487756cc50 con 0x5648775f67d0 2024-09-19T09:13:41.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.772+0000 7f33c4fba640 1 --2- 172.21.15.18:0/2699293749 >> [v2:172.21.15.162:6835/727689889,v1:172.21.15.162:6837/727689889] conn(0x5648775f67d0 0x5648775f6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:41.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.772+0000 7f339f7fe640 10 client.4596 ms_handle_connect on v2:172.21.15.162:6835/727689889 2024-09-19T09:13:41.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.772+0000 7f33c4fba640 1 --2- 172.21.15.18:0/2699293749 >> [v2:172.21.15.162:6835/727689889,v1:172.21.15.162:6837/727689889] conn(0x5648775f67d0 0x5648775f6bb0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e6bfe37ee4f7b3a server_cookie=d61c4bfe5f16ee1 in_seq=0 out_seq=0 2024-09-19T09:13:41.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.773+0000 7f339f7fe640 1 -- 172.21.15.18:0/2699293749 <== mds.0 v2:172.21.15.162:6835/727689889 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56487756cc50 con 0x5648775f67d0 2024-09-19T09:13:41.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.773+0000 7f339f7fe640 10 client.4596 handle_command_reply: tid=0 2024-09-19T09:13:41.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.773+0000 7f33ca08d740 1 client.4596 shutdown 2024-09-19T09:13:41.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.773+0000 7f33ca08d740 1 -- 172.21.15.18:0/2699293749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648775fea50 msgr2=0x56487761b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:41.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.773+0000 7f33ca08d740 1 --2- 172.21.15.18:0/2699293749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648775fea50 0x56487761b700 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f33ac009630 tx=0x7f33ac004730 comp rx=0 tx=0).stop 2024-09-19T09:13:41.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.774+0000 7f33ca08d740 1 -- 172.21.15.18:0/2699293749 shutdown_connections 2024-09-19T09:13:41.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.774+0000 7f33ca08d740 1 --2- 172.21.15.18:0/2699293749 >> [v2:172.21.15.162:6835/727689889,v1:172.21.15.162:6837/727689889] conn(0x5648775f67d0 0x5648775f6bb0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.774+0000 7f33ca08d740 1 --2- 172.21.15.18:0/2699293749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56487761d370 0x56487761bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.774+0000 7f33ca08d740 1 --2- 172.21.15.18:0/2699293749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648775fea50 0x56487761b700 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.774+0000 7f33ca08d740 1 --2- 172.21.15.18:0/2699293749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5648775fd2c0 0x564877626580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.774+0000 7f339f7fe640 0 client.4596 ms_handle_reset on v2:172.21.15.162:6835/727689889 2024-09-19T09:13:41.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.774+0000 7f33ca08d740 1 -- 172.21.15.18:0/2699293749 >> 172.21.15.18:0/2699293749 conn(0x5648775faa80 msgr2=0x56487763ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:41.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.774+0000 7f33ca08d740 1 -- 172.21.15.18:0/2699293749 shutdown_connections 2024-09-19T09:13:41.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.774+0000 7f33ca08d740 1 -- 172.21.15.18:0/2699293749 wait complete. 2024-09-19T09:13:41.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.774+0000 7f33ca08d740 20 client.4596 trim_cache size 0 max 16384 2024-09-19T09:13:41.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.792+0000 7f33ca08d740 1 Processor -- start 2024-09-19T09:13:41.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.792+0000 7f33ca08d740 1 -- start start 2024-09-19T09:13:41.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.792+0000 7f33ca08d740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5648775fd2c0 0x5648776277e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:41.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.792+0000 7f33ca08d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648775fea50 0x5648776ba200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:41.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.792+0000 7f33ca08d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56487761d370 0x56487763ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:41.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.792+0000 7f33ca08d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f33c00cd220 con 0x5648775fea50 2024-09-19T09:13:41.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.792+0000 7f33ca08d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f33c01f8e50 con 0x56487761d370 2024-09-19T09:13:41.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.792+0000 7f33ca08d740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f33c00ccbd0 con 0x5648775fd2c0 2024-09-19T09:13:41.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.792+0000 7f33bffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648775fea50 0x5648776ba200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:41.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.792+0000 7f33bffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648775fea50 0x5648776ba200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36824/0 (socket says 172.21.15.18:36824) 2024-09-19T09:13:41.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.792+0000 7f33bffff640 1 -- 172.21.15.18:0/2913124749 learned_addr learned my addr 172.21.15.18:0/2913124749 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:41.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.792+0000 7f33c57bb640 1 --2- 172.21.15.18:0/2913124749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56487761d370 0x56487763ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:41.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.792+0000 7f33c4fba640 1 --2- 172.21.15.18:0/2913124749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5648775fd2c0 0x5648776277e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:41.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.793+0000 7f33bffff640 1 -- 172.21.15.18:0/2913124749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5648775fd2c0 msgr2=0x5648776277e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:41.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.793+0000 7f33bffff640 1 --2- 172.21.15.18:0/2913124749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5648775fd2c0 0x5648776277e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.793+0000 7f33bffff640 1 -- 172.21.15.18:0/2913124749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56487761d370 msgr2=0x56487763ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:41.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.793+0000 7f33bffff640 1 --2- 172.21.15.18:0/2913124749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56487761d370 0x56487763ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.793+0000 7f33bffff640 1 -- 172.21.15.18:0/2913124749 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564877626340 con 0x5648775fea50 2024-09-19T09:13:41.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.793+0000 7f33c57bb640 1 --2- 172.21.15.18:0/2913124749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56487761d370 0x56487763ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:13:41.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.793+0000 7f33bffff640 1 --2- 172.21.15.18:0/2913124749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648775fea50 0x5648776ba200 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f33ac032f80 tx=0x7f33ac037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81784d007c2fd3fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:41.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.793+0000 7f33a9ffb640 1 -- 172.21.15.18:0/2913124749 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac04c070 con 0x5648775fea50 2024-09-19T09:13:41.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.793+0000 7f33a9ffb640 1 -- 172.21.15.18:0/2913124749 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33ac03e460 con 0x5648775fea50 2024-09-19T09:13:41.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.793+0000 7f33a9ffb640 1 -- 172.21.15.18:0/2913124749 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ac0044e0 con 0x5648775fea50 2024-09-19T09:13:41.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.793+0000 7f33ca08d740 1 -- 172.21.15.18:0/2913124749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648775fea50 msgr2=0x5648776ba200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:41.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.793+0000 7f33ca08d740 1 --2- 172.21.15.18:0/2913124749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648775fea50 0x5648776ba200 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f33ac032f80 tx=0x7f33ac037000 comp rx=0 tx=0).stop 2024-09-19T09:13:41.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.793+0000 7f33ca08d740 1 -- 172.21.15.18:0/2913124749 shutdown_connections 2024-09-19T09:13:41.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.793+0000 7f33ca08d740 1 --2- 172.21.15.18:0/2913124749 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x56487761d370 0x56487763ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.793+0000 7f33ca08d740 1 --2- 172.21.15.18:0/2913124749 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648775fea50 0x5648776ba200 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.793+0000 7f33ca08d740 1 --2- 172.21.15.18:0/2913124749 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5648775fd2c0 0x5648776277e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.794+0000 7f33ca08d740 1 -- 172.21.15.18:0/2913124749 >> 172.21.15.18:0/2913124749 conn(0x5648775faa80 msgr2=0x5648776270d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:41.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.794+0000 7f33ca08d740 1 -- 172.21.15.18:0/2913124749 shutdown_connections 2024-09-19T09:13:41.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.794+0000 7f33ca08d740 1 -- 172.21.15.18:0/2913124749 wait complete. 2024-09-19T09:13:41.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.794+0000 7f33ca08d740 1 -- start start 2024-09-19T09:13:41.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.794+0000 7f33ca08d740 1 Processor -- start 2024-09-19T09:13:41.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.795+0000 7f33ca08d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648775fd2c0 0x564877622960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:41.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.795+0000 7f33ca08d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648775fea50 0x5648775f6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:41.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.795+0000 7f33ca08d740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56487761d370 0x564877645350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:41.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.795+0000 7f33ca08d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x564877626ac0 con 0x5648775fd2c0 2024-09-19T09:13:41.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.795+0000 7f33ca08d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x56487761cbd0 con 0x5648775fea50 2024-09-19T09:13:41.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.795+0000 7f33ca08d740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56487761c4c0 con 0x56487761d370 2024-09-19T09:13:41.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.795+0000 7f33ca08d740 10 client.0 _ll_register_callbacks cb 0x7f33ac04a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:13:41.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.795+0000 7f33c4fba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648775fd2c0 0x564877622960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:41.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.795+0000 7f33c4fba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648775fd2c0 0x564877622960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36840/0 (socket says 172.21.15.18:36840) 2024-09-19T09:13:41.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.795+0000 7f33c4fba640 1 -- 172.21.15.18:0/490464793 learned_addr learned my addr 172.21.15.18:0/490464793 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:41.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.795+0000 7f33bffff640 1 --2- 172.21.15.18:0/490464793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648775fea50 0x5648775f6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:41.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.795+0000 7f33c57bb640 1 --2- 172.21.15.18:0/490464793 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56487761d370 0x564877645350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:41.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.795+0000 7f33c4fba640 1 -- 172.21.15.18:0/490464793 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56487761d370 msgr2=0x564877645350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:41.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.795+0000 7f33c4fba640 1 --2- 172.21.15.18:0/490464793 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56487761d370 0x564877645350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.795+0000 7f33c4fba640 1 -- 172.21.15.18:0/490464793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648775fea50 msgr2=0x5648775f6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:41.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.795+0000 7f33c4fba640 1 --2- 172.21.15.18:0/490464793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648775fea50 0x5648775f6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.795+0000 7f33c4fba640 1 -- 172.21.15.18:0/490464793 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648775f2470 con 0x5648775fd2c0 2024-09-19T09:13:41.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.795+0000 7f33bffff640 1 --2- 172.21.15.18:0/490464793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648775fea50 0x5648775f6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:13:41.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.796+0000 7f33c4fba640 1 --2- 172.21.15.18:0/490464793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648775fd2c0 0x564877622960 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f33b4061b20 tx=0x7f33b408b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e942c7749c1877 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:41.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.796+0000 7f339f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:13:41.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.796+0000 7f339f7fe640 1 -- 172.21.15.18:0/490464793 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33b4055ae0 con 0x5648775fd2c0 2024-09-19T09:13:41.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.796+0000 7f339f7fe640 1 -- 172.21.15.18:0/490464793 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f33b4072d80 con 0x5648775fd2c0 2024-09-19T09:13:41.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.796+0000 7f33ca08d740 1 -- 172.21.15.18:0/490464793 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33ac03e460 con 0x5648775fd2c0 2024-09-19T09:13:41.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.796+0000 7f339f7fe640 1 -- 172.21.15.18:0/490464793 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f33b4055c80 con 0x5648775fd2c0 2024-09-19T09:13:41.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.796+0000 7f33ca08d740 10 client.4602 fetch_fsmap learned FSMap version 6 2024-09-19T09:13:41.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.796+0000 7f33ca08d740 1 -- 172.21.15.18:0/490464793 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x56487763f500 con 0x5648775fd2c0 2024-09-19T09:13:41.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.796+0000 7f339f7fe640 1 -- 172.21.15.18:0/490464793 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33ac03e460 con 0x5648775fd2c0 2024-09-19T09:13:41.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.796+0000 7f339f7fe640 1 -- 172.21.15.18:0/490464793 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7f33b4078300 con 0x5648775fd2c0 2024-09-19T09:13:41.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.796+0000 7f33ca08d740 10 client.4602 fetch_fsmap finished waiting for FSMap version 6 2024-09-19T09:13:41.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.796+0000 7f33ca08d740 10 client.4602 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T09:13:41.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.796+0000 7f33ca08d740 20 client.4602 populate_metadata read hostname 'smithi018' 2024-09-19T09:13:41.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.796+0000 7f33ca08d740 1 --2- 172.21.15.18:0/490464793 >> [v2:172.21.15.162:6835/727689889,v1:172.21.15.162:6837/727689889] conn(0x5648776b8c20 0x5648776649a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:41.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.796+0000 7f33ca08d740 4 client.4602 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:13:41.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.796+0000 7f33ca08d740 1 -- 172.21.15.18:0/490464793 --> [v2:172.21.15.162:6835/727689889,v1:172.21.15.162:6837/727689889] -- command(tid 0: {"prefix": "status"}) -- 0x564877566fa0 con 0x5648776b8c20 2024-09-19T09:13:41.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.796+0000 7f33bffff640 1 --2- 172.21.15.18:0/490464793 >> [v2:172.21.15.162:6835/727689889,v1:172.21.15.162:6837/727689889] conn(0x5648776b8c20 0x5648776649a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:41.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.797+0000 7f339f7fe640 10 client.4602 ms_handle_connect on v2:172.21.15.162:6835/727689889 2024-09-19T09:13:41.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.797+0000 7f33bffff640 1 --2- 172.21.15.18:0/490464793 >> [v2:172.21.15.162:6835/727689889,v1:172.21.15.162:6837/727689889] conn(0x5648776b8c20 0x5648776649a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4267faf8e77d000b server_cookie=27c92494eddd7e2e in_seq=0 out_seq=0 2024-09-19T09:13:41.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.797+0000 7f339f7fe640 1 -- 172.21.15.18:0/490464793 <== mds.0 v2:172.21.15.162:6835/727689889 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x564877566fa0 con 0x5648776b8c20 2024-09-19T09:13:41.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.797+0000 7f339f7fe640 10 client.4602 handle_command_reply: tid=0 2024-09-19T09:13:41.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.797+0000 7f33ca08d740 1 client.4602 shutdown 2024-09-19T09:13:41.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.797+0000 7f33ca08d740 1 -- 172.21.15.18:0/490464793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648775fd2c0 msgr2=0x564877622960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:41.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.797+0000 7f33ca08d740 1 --2- 172.21.15.18:0/490464793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648775fd2c0 0x564877622960 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f33b4061b20 tx=0x7f33b408b040 comp rx=0 tx=0).stop 2024-09-19T09:13:41.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.797+0000 7f33ca08d740 1 -- 172.21.15.18:0/490464793 shutdown_connections 2024-09-19T09:13:41.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.797+0000 7f33ca08d740 1 --2- 172.21.15.18:0/490464793 >> [v2:172.21.15.162:6835/727689889,v1:172.21.15.162:6837/727689889] conn(0x5648776b8c20 0x5648776649a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.797+0000 7f33ca08d740 1 --2- 172.21.15.18:0/490464793 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x56487761d370 0x564877645350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.797+0000 7f33ca08d740 1 --2- 172.21.15.18:0/490464793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5648775fea50 0x5648775f6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.797+0000 7f339f7fe640 0 client.4602 ms_handle_reset on v2:172.21.15.162:6835/727689889 2024-09-19T09:13:41.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.797+0000 7f33ca08d740 1 --2- 172.21.15.18:0/490464793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5648775fd2c0 0x564877622960 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.797+0000 7f33ca08d740 1 -- 172.21.15.18:0/490464793 >> 172.21.15.18:0/490464793 conn(0x5648775faa80 msgr2=0x56487763ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:41.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.797+0000 7f33ca08d740 1 -- 172.21.15.18:0/490464793 shutdown_connections 2024-09-19T09:13:41.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.797+0000 7f33ca08d740 1 -- 172.21.15.18:0/490464793 wait complete. 2024-09-19T09:13:41.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.797+0000 7f33ca08d740 20 client.4602 trim_cache size 0 max 16384 2024-09-19T09:13:41.805 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:13:41.805 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:13:41.805 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-09-19T09:13:41.805 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 4275, 2024-09-19T09:13:41.805 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-19T09:13:41.805 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-19T09:13:41.805 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-19T09:13:41.805 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 14.308925665, 2024-09-19T09:13:41.806 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 6, 2024-09-19T09:13:41.806 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 21, 2024-09-19T09:13:41.806 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 21, 2024-09-19T09:13:41.806 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 19.926356271 2024-09-19T09:13:41.806 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:13:41.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.798+0000 7f33c721e640 1 -- 172.21.15.18:0/3028813891 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f33a406c2b0 msgr2=0x7f33a406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:41.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.798+0000 7f33c721e640 1 --2- 172.21.15.18:0/3028813891 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f33a406c2b0 0x7f33a406e770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f33ac034000 tx=0x7f33ac02e000 comp rx=0 tx=0).stop 2024-09-19T09:13:41.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.798+0000 7f33c721e640 1 -- 172.21.15.18:0/3028813891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33c00ba7e0 msgr2=0x7f33c01d99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:41.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.798+0000 7f33c721e640 1 --2- 172.21.15.18:0/3028813891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33c00ba7e0 0x7f33c01d99d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f33b400b410 tx=0x7f33b400b8d0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.798+0000 7f33c721e640 1 -- 172.21.15.18:0/3028813891 shutdown_connections 2024-09-19T09:13:41.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.798+0000 7f33c721e640 1 --2- 172.21.15.18:0/3028813891 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f33a406c2b0 0x7f33a406e770 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.798+0000 7f33c721e640 1 --2- 172.21.15.18:0/3028813891 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33c00d5870 0x7f33c00c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.798+0000 7f33c721e640 1 --2- 172.21.15.18:0/3028813891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33c00d3230 0x7f33c00c9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.798+0000 7f33c721e640 1 --2- 172.21.15.18:0/3028813891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33c00ba7e0 0x7f33c01d99d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:41.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.798+0000 7f33c721e640 1 -- 172.21.15.18:0/3028813891 >> 172.21.15.18:0/3028813891 conn(0x7f33c00d4c70 msgr2=0x7f33c00b9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:41.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.798+0000 7f33c721e640 1 -- 172.21.15.18:0/3028813891 shutdown_connections 2024-09-19T09:13:41.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:41.798+0000 7f33c721e640 1 -- 172.21.15.18:0/3028813891 wait complete. 2024-09-19T09:13:41.809 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T09:13:41.819 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T09:13:41.819 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T09:13:41.819 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T09:13:41.819 INFO:teuthology.run_tasks:Running task kclient... 2024-09-19T09:13:41.850 INFO:tasks.kclient:Mounting kernel clients... 2024-09-19T09:13:41.850 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-19T09:13:41.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:41.850 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-19T09:13:41.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:41.867 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link delete ceph-brx 2024-09-19T09:13:41.935 INFO:teuthology.orchestra.run.smithi018.stderr:Cannot find device "ceph-brx" 2024-09-19T09:13:41.936 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:13:41.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:41.937 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-19T09:13:41.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:41.993 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link delete ceph-brx 2024-09-19T09:13:42.059 INFO:teuthology.orchestra.run.smithi018.stderr:Cannot find device "ceph-brx" 2024-09-19T09:13:42.061 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:13:42.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:42.062 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-19T09:13:42.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:42.082 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2024-09-19T09:13:42.155 INFO:teuthology.orchestra.run.smithi162.stderr:Cannot find device "ceph-brx" 2024-09-19T09:13:42.156 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:13:42.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:42.157 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-19T09:13:42.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:42.216 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2024-09-19T09:13:42.286 INFO:teuthology.orchestra.run.smithi162.stderr:Cannot find device "ceph-brx" 2024-09-19T09:13:42.287 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:13:42.288 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-19T09:13:42.288 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T09:13:42.288 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:13:42.288 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T09:13:42.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.392+0000 7ff9fb798640 1 Processor -- start 2024-09-19T09:13:42.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.392+0000 7ff9fb798640 1 -- start start 2024-09-19T09:13:42.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.393+0000 7ff9fb798640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff9f40b5b00 0x7ff9f4169980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:42.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.393+0000 7ff9fb798640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9f40d31b0 con 0x7ff9f40d1c70 2024-09-19T09:13:42.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.393+0000 7ff9fb798640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9f40d3490 con 0x7ff9f415ed50 2024-09-19T09:13:42.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.393+0000 7ff9fb798640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7ff9f40d3770 con 0x7ff9f40b5b00 2024-09-19T09:13:42.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.393+0000 7ff9f9d35640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff9f40b5b00 0x7ff9f4169980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:42.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.393+0000 7ff9f8d33640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff9f40d1c70 0x7ff9f40cf9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:42496/0 (socket says 172.21.15.18:42496) 2024-09-19T09:13:42.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.393+0000 7ff9f8d33640 1 -- 172.21.15.18:0/673889186 learned_addr learned my addr 172.21.15.18:0/673889186 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:42.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.393+0000 7ff9f9d35640 1 -- 172.21.15.18:0/673889186 >> v1:172.21.15.162:6789/0 conn(0x7ff9f415ed50 legacy=0x7ff9f40d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:42.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.393+0000 7ff9f9d35640 1 -- 172.21.15.18:0/673889186 >> v1:172.21.15.18:6789/0 conn(0x7ff9f40d1c70 legacy=0x7ff9f40cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:42.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.393+0000 7ff9f9d35640 1 -- 172.21.15.18:0/673889186 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f40d3a50 con 0x7ff9f40b5b00 2024-09-19T09:13:42.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.393+0000 7ff9f3fff640 1 -- 172.21.15.18:0/673889186 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 345565446 0 0) 0x7ff9f40d31b0 con 0x7ff9f40d1c70 2024-09-19T09:13:42.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.394+0000 7ff9f9d35640 1 --2- 172.21.15.18:0/673889186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9f40b5b00 0x7ff9f4169980 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0097a0 tx=0x7ff9ec02a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=696107dd9d1452dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:42.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.394+0000 7ff9f3fff640 1 -- 172.21.15.18:0/673889186 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec037070 con 0x7ff9f40b5b00 2024-09-19T09:13:42.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.394+0000 7ff9f3fff640 1 -- 172.21.15.18:0/673889186 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9ec032640 con 0x7ff9f40b5b00 2024-09-19T09:13:42.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.394+0000 7ff9f3fff640 1 -- 172.21.15.18:0/673889186 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec032a10 con 0x7ff9f40b5b00 2024-09-19T09:13:42.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.395+0000 7ff9fb798640 1 -- 172.21.15.18:0/673889186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9f40b5b00 msgr2=0x7ff9f4169980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:42.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.395+0000 7ff9fb798640 1 --2- 172.21.15.18:0/673889186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9f40b5b00 0x7ff9f4169980 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0097a0 tx=0x7ff9ec02a2c0 comp rx=0 tx=0).stop 2024-09-19T09:13:42.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.395+0000 7ff9fb798640 1 -- 172.21.15.18:0/673889186 shutdown_connections 2024-09-19T09:13:42.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.395+0000 7ff9fb798640 1 --2- 172.21.15.18:0/673889186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9f40b5b00 0x7ff9f4169980 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:42.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.395+0000 7ff9fb798640 1 -- 172.21.15.18:0/673889186 >> 172.21.15.18:0/673889186 conn(0x7ff9f40d4bd0 msgr2=0x7ff9f40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:42.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.395+0000 7ff9fb798640 1 -- 172.21.15.18:0/673889186 shutdown_connections 2024-09-19T09:13:42.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.395+0000 7ff9fb798640 1 -- 172.21.15.18:0/673889186 wait complete. 2024-09-19T09:13:42.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.396+0000 7ff9fb798640 1 Processor -- start 2024-09-19T09:13:42.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.396+0000 7ff9fb798640 1 -- start start 2024-09-19T09:13:42.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.397+0000 7ff9fb798640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9f40b5b00 0x7ff9f41f8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:42.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.397+0000 7ff9fb798640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9f40d1c70 0x7ff9f4161700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:42.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.397+0000 7ff9fb798640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9f415ed50 0x7ff9f4153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:42.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.397+0000 7ff9fb798640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f415f130 con 0x7ff9f415ed50 2024-09-19T09:13:42.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.397+0000 7ff9fb798640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f40d3d30 con 0x7ff9f40d1c70 2024-09-19T09:13:42.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.397+0000 7ff9fb798640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff9f40cd070 con 0x7ff9f40b5b00 2024-09-19T09:13:42.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.397+0000 7ff9f9d35640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9f415ed50 0x7ff9f4153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:42.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.397+0000 7ff9f9d35640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9f415ed50 0x7ff9f4153ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36856/0 (socket says 172.21.15.18:36856) 2024-09-19T09:13:42.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.397+0000 7ff9f9d35640 1 -- 172.21.15.18:0/1478348129 learned_addr learned my addr 172.21.15.18:0/1478348129 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:42.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.397+0000 7ff9f8d33640 1 --2- 172.21.15.18:0/1478348129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9f40d1c70 0x7ff9f4161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:42.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.397+0000 7ff9f9d35640 1 -- 172.21.15.18:0/1478348129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9f40b5b00 msgr2=0x7ff9f41f8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:42.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.397+0000 7ff9f9d35640 1 --2- 172.21.15.18:0/1478348129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9f40b5b00 0x7ff9f41f8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:42.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.397+0000 7ff9f9d35640 1 -- 172.21.15.18:0/1478348129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9f40d1c70 msgr2=0x7ff9f4161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:42.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.397+0000 7ff9f9d35640 1 --2- 172.21.15.18:0/1478348129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9f40d1c70 0x7ff9f4161700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:42.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.397+0000 7ff9f9d35640 1 -- 172.21.15.18:0/1478348129 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f40cd350 con 0x7ff9f415ed50 2024-09-19T09:13:42.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.397+0000 7ff9f9d35640 1 --2- 172.21.15.18:0/1478348129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9f415ed50 0x7ff9f4153ed0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0097a0 tx=0x7ff9ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:42.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.398+0000 7ff9f1ffb640 1 -- 172.21.15.18:0/1478348129 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec041020 con 0x7ff9f415ed50 2024-09-19T09:13:42.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.398+0000 7ff9f1ffb640 1 -- 172.21.15.18:0/1478348129 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9ec0308f0 con 0x7ff9f415ed50 2024-09-19T09:13:42.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.398+0000 7ff9f1ffb640 1 -- 172.21.15.18:0/1478348129 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec037040 con 0x7ff9f415ed50 2024-09-19T09:13:42.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.398+0000 7ff9fb798640 1 -- 172.21.15.18:0/1478348129 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9f40cd630 con 0x7ff9f415ed50 2024-09-19T09:13:42.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.398+0000 7ff9fb798640 1 -- 172.21.15.18:0/1478348129 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9f40cdbf0 con 0x7ff9f415ed50 2024-09-19T09:13:42.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.399+0000 7ff9fb798640 1 -- 172.21.15.18:0/1478348129 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9f40d21e0 con 0x7ff9f415ed50 2024-09-19T09:13:42.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.399+0000 7ff9f1ffb640 1 -- 172.21.15.18:0/1478348129 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff9ec044020 con 0x7ff9f415ed50 2024-09-19T09:13:42.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.400+0000 7ff9f1ffb640 1 --2- 172.21.15.18:0/1478348129 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff9e006c2b0 0x7ff9e006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:42.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.400+0000 7ff9f1ffb640 1 -- 172.21.15.18:0/1478348129 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff9ec0abe30 con 0x7ff9f415ed50 2024-09-19T09:13:42.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.400+0000 7ff9f9534640 1 --2- 172.21.15.18:0/1478348129 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff9e006c2b0 0x7ff9e006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:42.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.401+0000 7ff9f9534640 1 --2- 172.21.15.18:0/1478348129 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff9e006c2b0 0x7ff9e006e770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff9e40012e0 tx=0x7ff9e4007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:42.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.404+0000 7ff9f1ffb640 1 -- 172.21.15.18:0/1478348129 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff9ec04b030 con 0x7ff9f415ed50 2024-09-19T09:13:42.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.617+0000 7ff9fb798640 1 -- 172.21.15.18:0/1478348129 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff9f40ce170 con 0x7ff9f415ed50 2024-09-19T09:13:42.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.617+0000 7ff9f1ffb640 1 -- 172.21.15.18:0/1478348129 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7ff9ec030ce0 con 0x7ff9f415ed50 2024-09-19T09:13:42.618 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T09:13:42.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.619+0000 7ff9fb798640 1 -- 172.21.15.18:0/1478348129 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff9e006c2b0 msgr2=0x7ff9e006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:42.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.619+0000 7ff9fb798640 1 --2- 172.21.15.18:0/1478348129 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff9e006c2b0 0x7ff9e006e770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff9e40012e0 tx=0x7ff9e4007d30 comp rx=0 tx=0).stop 2024-09-19T09:13:42.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.619+0000 7ff9fb798640 1 -- 172.21.15.18:0/1478348129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9f415ed50 msgr2=0x7ff9f4153ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:42.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.619+0000 7ff9fb798640 1 --2- 172.21.15.18:0/1478348129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9f415ed50 0x7ff9f4153ed0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0097a0 tx=0x7ff9ec0046c0 comp rx=0 tx=0).stop 2024-09-19T09:13:42.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.619+0000 7ff9fb798640 1 -- 172.21.15.18:0/1478348129 shutdown_connections 2024-09-19T09:13:42.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.619+0000 7ff9fb798640 1 --2- 172.21.15.18:0/1478348129 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff9e006c2b0 0x7ff9e006e770 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:42.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.619+0000 7ff9fb798640 1 --2- 172.21.15.18:0/1478348129 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9f415ed50 0x7ff9f4153ed0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:42.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.619+0000 7ff9fb798640 1 --2- 172.21.15.18:0/1478348129 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9f40d1c70 0x7ff9f4161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:42.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.619+0000 7ff9fb798640 1 --2- 172.21.15.18:0/1478348129 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9f40b5b00 0x7ff9f41f8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:42.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.619+0000 7ff9fb798640 1 -- 172.21.15.18:0/1478348129 >> 172.21.15.18:0/1478348129 conn(0x7ff9f40d4bd0 msgr2=0x7ff9f406c740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:42.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.619+0000 7ff9fb798640 1 -- 172.21.15.18:0/1478348129 shutdown_connections 2024-09-19T09:13:42.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42.619+0000 7ff9fb798640 1 -- 172.21.15.18:0/1478348129 wait complete. 2024-09-19T09:13:42.630 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T09:13:42.631 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:13:42.631 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-09-19T09:13:42.631 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T09:13:42.631 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:13:42.631 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T09:13:42.631 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T09:13:42.631 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:13:42.631 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:13:42.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:42.631 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-09-19T09:13:42.647 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:13:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:13:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:13:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-09-19T09:13:42.647 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:42.648 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:13:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:13:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-09-19T09:13:42.648 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:13:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:13:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-09-19T09:13:42.648 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:13:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:13:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-09-19T09:13:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T09:13:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42775sec preferred_lft 42775sec 2024-09-19T09:13:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-09-19T09:13:42.648 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:42.648 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:13:42.649 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:13:42.649 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-09-19T09:13:42.649 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T09:13:42.649 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:13:42.649 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T09:13:42.649 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add name ceph-brx type bridge 2024-09-19T09:13:42.649 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr flush dev ceph-brx 2024-09-19T09:13:42.649 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set ceph-brx up 2024-09-19T09:13:42.650 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T09:13:42.650 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T09:13:42.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:13:42.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:42.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:42.863 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:13:42.889 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-09-19T09:13:42.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:42.891 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-09-19T09:13:42.955 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-09-19T09:13:42.955 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:13:42.955 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T09:13:42.955 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T09:13:42.955 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:13:42.956 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:13:42.956 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T09:13:42.956 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T09:13:42.956 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T09:13:42.956 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T09:13:42.956 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T09:13:43.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:13:43.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:43.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:43.242 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-19T09:13:43.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:43.258 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list-id 2024-09-19T09:13:43.314 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:13:43.314 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T09:13:43.315 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:13:43.315 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T09:13:43.315 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T09:13:43.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:13:43.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:43.437 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T09:13:43.438 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:13:43.438 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T09:13:43.438 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T09:13:43.438 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T09:13:43.438 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T09:13:43.438 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T09:13:43.438 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T09:13:43.438 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T09:13:43.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:13:43.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:43.575 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:13:43.575 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T09:13:43.575 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-09-19T09:13:43.575 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T09:13:43.575 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T09:13:43.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:13:43.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:43.655 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:13:43.655 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T09:13:43.684 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:13:43.685 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:13:43.685 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:13:43.741 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-19T09:13:43.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:43.741 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:13:43.864 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:13:43.864 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:13:43.864 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:13:44.016 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:13:44.017 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:13:44.017 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:13:44.017 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:13:44.017 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:13:44.021 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:13:44.021 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:13:44.021 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:13:44.021 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:13:44.021 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:13:44.021 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-19T09:13:44.021 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-19T09:13:44.021 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fec66d7e-50e5-42ed-81de-ad141a2f0f4e" will pass to kernel 2024-09-19T09:13:44.022 INFO:teuthology.orchestra.run.smithi018.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-19T09:13:44.022 INFO:teuthology.orchestra.run.smithi018.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:13:44.022 INFO:teuthology.orchestra.run.smithi018.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:13:44.022 INFO:teuthology.orchestra.run.smithi018.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:13:44.022 INFO:teuthology.orchestra.run.smithi018.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:13:44.024 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:13:44.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:44.024 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:13:44.050 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:13:44.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:13:44.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:44.153 INFO:teuthology.orchestra.run.smithi018.stdout:client4614 2024-09-19T09:13:44.153 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:13:44.153 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:13:44.170 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:13:44.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:13:44.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:44.274 INFO:teuthology.orchestra.run.smithi018.stdout:client4614 2024-09-19T09:13:44.275 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:13:44.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:13:44.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:44.338 INFO:teuthology.orchestra.run.smithi018.stdout:client4614 2024-09-19T09:13:44.338 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/fec66d7e-50e5-42ed-81de-ad141a2f0f4e.client4614/status') 2024-09-19T09:13:44.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:13:44.403 INFO:teuthology.orchestra.run.smithi018.stdout:instance: client.4614 (3)192.168.0.1:0/2871942645 2024-09-19T09:13:44.403 INFO:teuthology.orchestra.run.smithi018.stdout:blocklisted: false 2024-09-19T09:13:44.404 INFO:teuthology.orchestra.run.smithi018.stderr:0+1 records in 2024-09-19T09:13:44.404 INFO:teuthology.orchestra.run.smithi018.stderr:0+1 records out 2024-09-19T09:13:44.404 INFO:teuthology.orchestra.run.smithi018.stderr:69 bytes copied, 2.3311e-05 s, 3.0 MB/s 2024-09-19T09:13:44.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:44.411 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-09-19T09:13:44.411 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T09:13:44.411 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-19T09:13:44.411 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T09:13:44.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.513+0000 7f3f70fb0640 1 Processor -- start 2024-09-19T09:13:44.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.513+0000 7f3f70fb0640 1 -- start start 2024-09-19T09:13:44.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.514+0000 7f3f70fb0640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3f6c13fae0 0x7f3f6c06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:44.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.514+0000 7f3f70fb0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3f6c160c50 0x7f3f6c0cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:44.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.514+0000 7f3f70fb0640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f6c142650 con 0x7f3f6c142150 2024-09-19T09:13:44.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.514+0000 7f3f70fb0640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f3f6c0ce780 con 0x7f3f6c160c50 2024-09-19T09:13:44.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.514+0000 7f3f70fb0640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f3f6c142930 con 0x7f3f6c13fae0 2024-09-19T09:13:44.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.514+0000 7f3f6ad9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3f6c160c50 0x7f3f6c0cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:44.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.514+0000 7f3f6ad9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3f6c160c50 0x7f3f6c0cec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36860/0 (socket says 172.21.15.18:36860) 2024-09-19T09:13:44.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.514+0000 7f3f6ad9d640 1 -- 172.21.15.18:0/1493914995 learned_addr learned my addr 172.21.15.18:0/1493914995 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:44.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.514+0000 7f3f6a59c640 1 --2- 172.21.15.18:0/1493914995 >> v2:172.21.15.162:3300/0 conn(0x7f3f6c13fae0 0x7f3f6c06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:44.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.515+0000 7f3f6ad9d640 1 -- 172.21.15.18:0/1493914995 >> v2:172.21.15.162:3300/0 conn(0x7f3f6c13fae0 msgr2=0x7f3f6c06f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:44.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.515+0000 7f3f6ad9d640 1 --2- 172.21.15.18:0/1493914995 >> v2:172.21.15.162:3300/0 conn(0x7f3f6c13fae0 0x7f3f6c06f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:44.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.515+0000 7f3f6ad9d640 1 -- 172.21.15.18:0/1493914995 >> v1:172.21.15.162:6789/0 conn(0x7f3f6c142150 legacy=0x7f3f6c160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:44.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.515+0000 7f3f6ad9d640 1 -- 172.21.15.18:0/1493914995 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f6c142c10 con 0x7f3f6c160c50 2024-09-19T09:13:44.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.515+0000 7f3f6ad9d640 1 --2- 172.21.15.18:0/1493914995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6c160c50 0x7f3f6c0cec10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c050590 tx=0x7f3f6402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca1b7760fa0a84d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:44.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.516+0000 7f3f6959a640 1 -- 172.21.15.18:0/1493914995 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f64037070 con 0x7f3f6c160c50 2024-09-19T09:13:44.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.516+0000 7f3f6959a640 1 -- 172.21.15.18:0/1493914995 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f64032440 con 0x7f3f6c160c50 2024-09-19T09:13:44.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.516+0000 7f3f6959a640 1 -- 172.21.15.18:0/1493914995 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f64032810 con 0x7f3f6c160c50 2024-09-19T09:13:44.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.516+0000 7f3f70fb0640 1 -- 172.21.15.18:0/1493914995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6c160c50 msgr2=0x7f3f6c0cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:44.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.516+0000 7f3f70fb0640 1 --2- 172.21.15.18:0/1493914995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6c160c50 0x7f3f6c0cec10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3f6c050590 tx=0x7f3f6402a1e0 comp rx=0 tx=0).stop 2024-09-19T09:13:44.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.516+0000 7f3f70fb0640 1 -- 172.21.15.18:0/1493914995 shutdown_connections 2024-09-19T09:13:44.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.516+0000 7f3f70fb0640 1 --2- 172.21.15.18:0/1493914995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6c160c50 0x7f3f6c0cec10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:44.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.516+0000 7f3f70fb0640 1 --2- 172.21.15.18:0/1493914995 >> v2:172.21.15.162:3300/0 conn(0x7f3f6c13fae0 0x7f3f6c06f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:44.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.516+0000 7f3f70fb0640 1 -- 172.21.15.18:0/1493914995 >> 172.21.15.18:0/1493914995 conn(0x7f3f6c06bc10 msgr2=0x7f3f6c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:44.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.516+0000 7f3f70fb0640 1 -- 172.21.15.18:0/1493914995 shutdown_connections 2024-09-19T09:13:44.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.516+0000 7f3f70fb0640 1 -- 172.21.15.18:0/1493914995 wait complete. 2024-09-19T09:13:44.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.518+0000 7f3f70fb0640 1 Processor -- start 2024-09-19T09:13:44.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.518+0000 7f3f70fb0640 1 -- start start 2024-09-19T09:13:44.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.518+0000 7f3f70fb0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f6c13fae0 0x7f3f6c139310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:44.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.518+0000 7f3f70fb0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f6c142150 0x7f3f6c13e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:44.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.518+0000 7f3f70fb0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6c160c50 0x7f3f6c1433d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:44.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.518+0000 7f3f70fb0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6c06f870 con 0x7f3f6c160c50 2024-09-19T09:13:44.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.518+0000 7f3f70fb0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3f6c06f6f0 con 0x7f3f6c142150 2024-09-19T09:13:44.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.518+0000 7f3f70fb0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3f6c0cf150 con 0x7f3f6c13fae0 2024-09-19T09:13:44.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.519+0000 7f3f6ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6c160c50 0x7f3f6c1433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:44.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.519+0000 7f3f6ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6c160c50 0x7f3f6c1433d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36872/0 (socket says 172.21.15.18:36872) 2024-09-19T09:13:44.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.519+0000 7f3f6ad9d640 1 -- 172.21.15.18:0/3998937729 learned_addr learned my addr 172.21.15.18:0/3998937729 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:44.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.519+0000 7f3f6a59c640 1 --2- 172.21.15.18:0/3998937729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f6c13fae0 0x7f3f6c139310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:44.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.519+0000 7f3f69d9b640 1 --2- 172.21.15.18:0/3998937729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f6c142150 0x7f3f6c13e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:44.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.519+0000 7f3f6ad9d640 1 -- 172.21.15.18:0/3998937729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f6c13fae0 msgr2=0x7f3f6c139310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:44.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.519+0000 7f3f6ad9d640 1 --2- 172.21.15.18:0/3998937729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f6c13fae0 0x7f3f6c139310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:44.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.519+0000 7f3f6ad9d640 1 -- 172.21.15.18:0/3998937729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f6c142150 msgr2=0x7f3f6c13e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:44.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.519+0000 7f3f6ad9d640 1 --2- 172.21.15.18:0/3998937729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f6c142150 0x7f3f6c13e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:44.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.519+0000 7f3f6ad9d640 1 -- 172.21.15.18:0/3998937729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f6c13eb10 con 0x7f3f6c160c50 2024-09-19T09:13:44.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.519+0000 7f3f6ad9d640 1 --2- 172.21.15.18:0/3998937729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6c160c50 0x7f3f6c1433d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3f640090b0 tx=0x7f3f640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:44.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.519+0000 7f3f62ffd640 1 -- 172.21.15.18:0/3998937729 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f64037040 con 0x7f3f6c160c50 2024-09-19T09:13:44.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.519+0000 7f3f62ffd640 1 -- 172.21.15.18:0/3998937729 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f64042070 con 0x7f3f6c160c50 2024-09-19T09:13:44.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.519+0000 7f3f70fb0640 1 -- 172.21.15.18:0/3998937729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f6c13d530 con 0x7f3f6c160c50 2024-09-19T09:13:44.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.519+0000 7f3f62ffd640 1 -- 172.21.15.18:0/3998937729 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f640308a0 con 0x7f3f6c160c50 2024-09-19T09:13:44.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.519+0000 7f3f70fb0640 1 -- 172.21.15.18:0/3998937729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f6c13daf0 con 0x7f3f6c160c50 2024-09-19T09:13:44.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.520+0000 7f3f70fb0640 1 -- 172.21.15.18:0/3998937729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f6c13e2c0 con 0x7f3f6c160c50 2024-09-19T09:13:44.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.521+0000 7f3f62ffd640 1 -- 172.21.15.18:0/3998937729 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3f64030a40 con 0x7f3f6c160c50 2024-09-19T09:13:44.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.521+0000 7f3f62ffd640 1 --2- 172.21.15.18:0/3998937729 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3f4c06c2b0 0x7f3f4c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:44.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.522+0000 7f3f62ffd640 1 -- 172.21.15.18:0/3998937729 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3f640abd10 con 0x7f3f6c160c50 2024-09-19T09:13:44.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.522+0000 7f3f6a59c640 1 --2- 172.21.15.18:0/3998937729 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3f4c06c2b0 0x7f3f4c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:44.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.522+0000 7f3f6a59c640 1 --2- 172.21.15.18:0/3998937729 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3f4c06c2b0 0x7f3f4c06e770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0074a0 tx=0x7f3f5c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:44.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.526+0000 7f3f62ffd640 1 -- 172.21.15.18:0/3998937729 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3f640b1020 con 0x7f3f6c160c50 2024-09-19T09:13:44.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.736+0000 7f3f70fb0640 1 -- 172.21.15.18:0/3998937729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3f6c06c820 con 0x7f3f6c160c50 2024-09-19T09:13:44.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.737+0000 7f3f62ffd640 1 -- 172.21.15.18:0/3998937729 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f3f6c06c820 con 0x7f3f6c160c50 2024-09-19T09:13:44.737 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T09:13:44.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.739+0000 7f3f70fb0640 1 -- 172.21.15.18:0/3998937729 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3f4c06c2b0 msgr2=0x7f3f4c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:44.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.739+0000 7f3f70fb0640 1 --2- 172.21.15.18:0/3998937729 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3f4c06c2b0 0x7f3f4c06e770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c0074a0 tx=0x7f3f5c00b040 comp rx=0 tx=0).stop 2024-09-19T09:13:44.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.739+0000 7f3f70fb0640 1 -- 172.21.15.18:0/3998937729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6c160c50 msgr2=0x7f3f6c1433d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:44.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.739+0000 7f3f70fb0640 1 --2- 172.21.15.18:0/3998937729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6c160c50 0x7f3f6c1433d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3f640090b0 tx=0x7f3f640046c0 comp rx=0 tx=0).stop 2024-09-19T09:13:44.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.739+0000 7f3f70fb0640 1 -- 172.21.15.18:0/3998937729 shutdown_connections 2024-09-19T09:13:44.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.739+0000 7f3f70fb0640 1 --2- 172.21.15.18:0/3998937729 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3f4c06c2b0 0x7f3f4c06e770 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:44.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.739+0000 7f3f70fb0640 1 --2- 172.21.15.18:0/3998937729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f6c160c50 0x7f3f6c1433d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:44.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.739+0000 7f3f70fb0640 1 --2- 172.21.15.18:0/3998937729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f6c142150 0x7f3f6c13e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:44.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.739+0000 7f3f70fb0640 1 --2- 172.21.15.18:0/3998937729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f6c13fae0 0x7f3f6c139310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:44.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.739+0000 7f3f70fb0640 1 -- 172.21.15.18:0/3998937729 >> 172.21.15.18:0/3998937729 conn(0x7f3f6c06bc10 msgr2=0x7f3f6c06e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:44.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.739+0000 7f3f70fb0640 1 -- 172.21.15.18:0/3998937729 shutdown_connections 2024-09-19T09:13:44.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44.739+0000 7f3f70fb0640 1 -- 172.21.15.18:0/3998937729 wait complete. 2024-09-19T09:13:44.750 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T09:13:44.750 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:13:44.750 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-09-19T09:13:44.750 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-19T09:13:44.750 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-19T09:13:44.750 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T09:13:44.750 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T09:13:44.750 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:13:44.750 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-19T09:13:44.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:44.751 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-09-19T09:13:44.767 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:13:44.767 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:13:44.767 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:13:44.767 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:44.767 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-09-19T09:13:44.767 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:44.767 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:13:44.767 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:13:44.768 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-09-19T09:13:44.768 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:13:44.768 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:13:44.768 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-09-19T09:13:44.768 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:13:44.768 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:13:44.768 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-09-19T09:13:44.768 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T09:13:44.768 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42772sec preferred_lft 42772sec 2024-09-19T09:13:44.768 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-09-19T09:13:44.768 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:44.768 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:13:44.768 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:13:44.769 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-09-19T09:13:44.769 INFO:teuthology.orchestra.run.smithi018.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T09:13:44.769 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:44:1b:02:86:87 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:13:44.769 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T09:13:44.769 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:44.769 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::a0ce:faff:feaa:13ec/64 scope link 2024-09-19T09:13:44.769 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:44.769 INFO:teuthology.orchestra.run.smithi018.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:13:44.769 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:44:1b:02:86:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:13:44.769 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::44:1bff:fe02:8687/64 scope link tentative 2024-09-19T09:13:44.769 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:44.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:44.770 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:13:44.832 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-09-19T09:13:44.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:44.834 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-09-19T09:13:44.891 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-09-19T09:13:44.891 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:13:44.891 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T09:13:44.891 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T09:13:44.892 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:13:44.892 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:13:44.892 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T09:13:44.892 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T09:13:44.892 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T09:13:44.892 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T09:13:44.892 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T09:13:44.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:13:45.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:45.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:45.021 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-19T09:13:45.036 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T09:13:45.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:45.037 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list-id 2024-09-19T09:13:45.092 INFO:teuthology.orchestra.run.smithi018.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-19T09:13:45.092 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:13:45.093 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T09:13:45.093 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T09:13:45.093 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-19T09:13:45.093 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T09:13:45.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:13:45.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:45.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:45.212 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-19T09:13:45.237 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:13:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:13:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:13:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-09-19T09:13:45.237 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:45.237 INFO:teuthology.orchestra.run.smithi018.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T09:13:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether ae:cd:63:f5:7d:e5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-19T09:13:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-19T09:13:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::accd:63ff:fef5:7de5/64 scope link 2024-09-19T09:13:45.238 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:45.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:45.239 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-19T09:13:45.305 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:13:45.305 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:13:45.305 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:13:45.305 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:45.305 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-09-19T09:13:45.305 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:45.305 INFO:teuthology.orchestra.run.smithi018.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T09:13:45.305 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether ae:cd:63:f5:7d:e5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-19T09:13:45.305 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-19T09:13:45.305 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:45.305 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::accd:63ff:fef5:7de5/64 scope link 2024-09-19T09:13:45.306 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:45.307 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-19T09:13:45.307 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:13:45.307 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T09:13:45.307 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-19T09:13:45.307 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-19T09:13:45.307 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-19T09:13:45.307 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-19T09:13:45.307 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-19T09:13:45.307 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T09:13:45.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:13:45.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:45.463 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:13:45.463 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T09:13:45.463 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.1 up 2024-09-19T09:13:45.463 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set dev brx.1 master ceph-brx 2024-09-19T09:13:45.464 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T09:13:45.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:13:45.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:45.542 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:13:45.543 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-19T09:13:45.558 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-19T09:13:45.558 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:13:45.558 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-19T09:13:45.614 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-19T09:13:45.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:45.614 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-19T09:13:45.699 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-19T09:13:45.699 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-19T09:13:45.699 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:13:45.708 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-19T09:13:45.708 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-19T09:13:45.708 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:13:45.708 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:13:45.708 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:13:45.714 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-19T09:13:45.714 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-19T09:13:45.714 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:13:45.714 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:13:45.714 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:13:45.714 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-19T09:13:45.714 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-19T09:13:45.715 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=fec66d7e-50e5-42ed-81de-ad141a2f0f4e" will pass to kernel 2024-09-19T09:13:45.715 INFO:teuthology.orchestra.run.smithi018.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-19T09:13:45.715 INFO:teuthology.orchestra.run.smithi018.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:13:45.716 INFO:teuthology.orchestra.run.smithi018.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:13:45.716 INFO:teuthology.orchestra.run.smithi018.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:13:45.716 INFO:teuthology.orchestra.run.smithi018.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:13:45.717 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:13:45.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:45.717 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-19T09:13:45.743 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:13:45.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:13:45.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:45.841 INFO:teuthology.orchestra.run.smithi018.stdout:client4623 2024-09-19T09:13:45.841 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:13:45.841 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:13:45.858 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:13:45.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:13:45.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:45.955 INFO:teuthology.orchestra.run.smithi018.stdout:client4623 2024-09-19T09:13:45.955 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:13:46.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:13:46.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:46.012 INFO:teuthology.orchestra.run.smithi018.stdout:client4623 2024-09-19T09:13:46.012 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/fec66d7e-50e5-42ed-81de-ad141a2f0f4e.client4623/status') 2024-09-19T09:13:46.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:13:46.071 INFO:teuthology.orchestra.run.smithi018.stdout:instance: client.4623 (3)192.168.0.2:0/1019723520 2024-09-19T09:13:46.072 INFO:teuthology.orchestra.run.smithi018.stdout:blocklisted: false 2024-09-19T09:13:46.072 INFO:teuthology.orchestra.run.smithi018.stderr:0+1 records in 2024-09-19T09:13:46.072 INFO:teuthology.orchestra.run.smithi018.stderr:0+1 records out 2024-09-19T09:13:46.072 INFO:teuthology.orchestra.run.smithi018.stderr:69 bytes copied, 2.3552e-05 s, 2.9 MB/s 2024-09-19T09:13:46.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:46.079 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-19T09:13:46.079 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T09:13:46.079 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-19T09:13:46.079 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T09:13:46.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.180+0000 7f7bebe0e640 1 Processor -- start 2024-09-19T09:13:46.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.181+0000 7f7bebe0e640 1 -- start start 2024-09-19T09:13:46.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.181+0000 7f7bebe0e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7be415ef50 0x7f7be40d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:46.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.181+0000 7f7bebe0e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7be40b9510 0x7f7be40d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:46.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.181+0000 7f7bebe0e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7be40b7a90 con 0x7f7be40d3240 2024-09-19T09:13:46.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.181+0000 7f7bebe0e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f7be40d3740 con 0x7f7be415ef50 2024-09-19T09:13:46.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.181+0000 7f7bebe0e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7be40d3a20 con 0x7f7be40b9510 2024-09-19T09:13:46.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.182+0000 7f7bea3ab640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7be40b9510 0x7f7be40d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:46.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.182+0000 7f7be9baa640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7be415ef50 0x7f7be40d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:46.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.182+0000 7f7be93a9640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f7be40d3240 0x7f7be40cf770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:58094/0 (socket says 172.21.15.18:58094) 2024-09-19T09:13:46.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.182+0000 7f7be93a9640 1 -- 172.21.15.18:0/164895117 learned_addr learned my addr 172.21.15.18:0/164895117 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:46.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.182+0000 7f7be8ba8640 1 -- 172.21.15.18:0/164895117 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2990778819 0 0) 0x7f7be40b7a90 con 0x7f7be40d3240 2024-09-19T09:13:46.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.182+0000 7f7be8ba8640 1 -- 172.21.15.18:0/164895117 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bcc003520 con 0x7f7be40d3240 2024-09-19T09:13:46.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.182+0000 7f7bea3ab640 1 -- 172.21.15.18:0/164895117 >> v2:172.21.15.162:3300/0 conn(0x7f7be415ef50 msgr2=0x7f7be40d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:46.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.182+0000 7f7bea3ab640 1 --2- 172.21.15.18:0/164895117 >> v2:172.21.15.162:3300/0 conn(0x7f7be415ef50 0x7f7be40d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:46.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.182+0000 7f7bea3ab640 1 -- 172.21.15.18:0/164895117 >> v1:172.21.15.162:6789/0 conn(0x7f7be40d3240 legacy=0x7f7be40cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:46.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.182+0000 7f7bea3ab640 1 -- 172.21.15.18:0/164895117 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be40b7d00 con 0x7f7be40b9510 2024-09-19T09:13:46.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.182+0000 7f7be9baa640 1 --2- 172.21.15.18:0/164895117 >> v2:172.21.15.162:3300/0 conn(0x7f7be415ef50 0x7f7be40d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:13:46.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.183+0000 7f7bea3ab640 1 --2- 172.21.15.18:0/164895117 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7be40b9510 0x7f7be40d18e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4009d90 tx=0x7f7bd402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=730bc79f489010dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:46.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.183+0000 7f7be8ba8640 1 -- 172.21.15.18:0/164895117 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4031600 con 0x7f7be40b9510 2024-09-19T09:13:46.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.183+0000 7f7be8ba8640 1 -- 172.21.15.18:0/164895117 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bd40317a0 con 0x7f7be40b9510 2024-09-19T09:13:46.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.183+0000 7f7be8ba8640 1 -- 172.21.15.18:0/164895117 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4031b50 con 0x7f7be40b9510 2024-09-19T09:13:46.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.184+0000 7f7bebe0e640 1 -- 172.21.15.18:0/164895117 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7be40b9510 msgr2=0x7f7be40d18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:46.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.184+0000 7f7bebe0e640 1 --2- 172.21.15.18:0/164895117 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7be40b9510 0x7f7be40d18e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4009d90 tx=0x7f7bd402a5d0 comp rx=0 tx=0).stop 2024-09-19T09:13:46.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.184+0000 7f7bebe0e640 1 -- 172.21.15.18:0/164895117 shutdown_connections 2024-09-19T09:13:46.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.184+0000 7f7bebe0e640 1 --2- 172.21.15.18:0/164895117 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7be40b9510 0x7f7be40d18e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:46.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.184+0000 7f7bebe0e640 1 --2- 172.21.15.18:0/164895117 >> v2:172.21.15.162:3300/0 conn(0x7f7be415ef50 0x7f7be40d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:46.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.184+0000 7f7bebe0e640 1 -- 172.21.15.18:0/164895117 >> 172.21.15.18:0/164895117 conn(0x7f7be40d4c60 msgr2=0x7f7be40d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:46.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.184+0000 7f7bebe0e640 1 -- 172.21.15.18:0/164895117 shutdown_connections 2024-09-19T09:13:46.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.184+0000 7f7bebe0e640 1 -- 172.21.15.18:0/164895117 wait complete. 2024-09-19T09:13:46.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.185+0000 7f7bebe0e640 1 Processor -- start 2024-09-19T09:13:46.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.185+0000 7f7bebe0e640 1 -- start start 2024-09-19T09:13:46.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.186+0000 7f7bebe0e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7be40b9510 0x7f7be41508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:46.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.186+0000 7f7bebe0e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7be40d3240 0x7f7be41f7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:46.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.186+0000 7f7bebe0e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7be415ef50 0x7f7be40c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:46.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.186+0000 7f7bebe0e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7be40d21a0 con 0x7f7be40d3240 2024-09-19T09:13:46.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.186+0000 7f7bebe0e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7be40d2020 con 0x7f7be40b9510 2024-09-19T09:13:46.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.186+0000 7f7bebe0e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7be40d5780 con 0x7f7be415ef50 2024-09-19T09:13:46.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.186+0000 7f7be93a9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7be40d3240 0x7f7be41f7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:46.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.186+0000 7f7be93a9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7be40d3240 0x7f7be41f7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36096/0 (socket says 172.21.15.18:36096) 2024-09-19T09:13:46.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.186+0000 7f7be93a9640 1 -- 172.21.15.18:0/2643866103 learned_addr learned my addr 172.21.15.18:0/2643866103 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:46.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.186+0000 7f7bea3ab640 1 --2- 172.21.15.18:0/2643866103 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7be415ef50 0x7f7be40c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:46.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.186+0000 7f7be9baa640 1 --2- 172.21.15.18:0/2643866103 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7be40b9510 0x7f7be41508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:46.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.186+0000 7f7be93a9640 1 -- 172.21.15.18:0/2643866103 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7be415ef50 msgr2=0x7f7be40c97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:46.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.186+0000 7f7be93a9640 1 --2- 172.21.15.18:0/2643866103 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7be415ef50 0x7f7be40c97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:46.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.186+0000 7f7be93a9640 1 -- 172.21.15.18:0/2643866103 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7be40b9510 msgr2=0x7f7be41508d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:46.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.186+0000 7f7be93a9640 1 --2- 172.21.15.18:0/2643866103 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7be40b9510 0x7f7be41508d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:46.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.186+0000 7f7be93a9640 1 -- 172.21.15.18:0/2643866103 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be40c9d30 con 0x7f7be40d3240 2024-09-19T09:13:46.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.186+0000 7f7be93a9640 1 --2- 172.21.15.18:0/2643866103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7be40d3240 0x7f7be41f7b80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800c430 tx=0x7f7bd800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:46.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.187+0000 7f7be27fc640 1 -- 172.21.15.18:0/2643866103 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd8017070 con 0x7f7be40d3240 2024-09-19T09:13:46.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.187+0000 7f7be27fc640 1 -- 172.21.15.18:0/2643866103 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bd8005ce0 con 0x7f7be40d3240 2024-09-19T09:13:46.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.187+0000 7f7be27fc640 1 -- 172.21.15.18:0/2643866103 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd80072f0 con 0x7f7be40d3240 2024-09-19T09:13:46.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.187+0000 7f7bebe0e640 1 -- 172.21.15.18:0/2643866103 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be40c9fd0 con 0x7f7be40d3240 2024-09-19T09:13:46.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.187+0000 7f7bebe0e640 1 -- 172.21.15.18:0/2643866103 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be40ca590 con 0x7f7be40d3240 2024-09-19T09:13:46.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.187+0000 7f7bebe0e640 1 -- 172.21.15.18:0/2643866103 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7be40d13a0 con 0x7f7be40d3240 2024-09-19T09:13:46.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.188+0000 7f7be27fc640 1 -- 172.21.15.18:0/2643866103 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7bd801a070 con 0x7f7be40d3240 2024-09-19T09:13:46.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.188+0000 7f7be27fc640 1 --2- 172.21.15.18:0/2643866103 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7bd006c2b0 0x7f7bd006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:46.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.189+0000 7f7be27fc640 1 -- 172.21.15.18:0/2643866103 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7bd808a7f0 con 0x7f7be40d3240 2024-09-19T09:13:46.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.189+0000 7f7be9baa640 1 --2- 172.21.15.18:0/2643866103 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7bd006c2b0 0x7f7bd006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:46.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.189+0000 7f7be9baa640 1 --2- 172.21.15.18:0/2643866103 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7bd006c2b0 0x7f7bd006e770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc009560 tx=0x7f7bdc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:46.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.193+0000 7f7be27fc640 1 -- 172.21.15.18:0/2643866103 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7bd80589a0 con 0x7f7be40d3240 2024-09-19T09:13:46.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.405+0000 7f7bebe0e640 1 -- 172.21.15.18:0/2643866103 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7be40ba230 con 0x7f7be40d3240 2024-09-19T09:13:46.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.406+0000 7f7be27fc640 1 -- 172.21.15.18:0/2643866103 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f7bd805cca0 con 0x7f7be40d3240 2024-09-19T09:13:46.406 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T09:13:46.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.408+0000 7f7bebe0e640 1 -- 172.21.15.18:0/2643866103 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7bd006c2b0 msgr2=0x7f7bd006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:46.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.408+0000 7f7bebe0e640 1 --2- 172.21.15.18:0/2643866103 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7bd006c2b0 0x7f7bd006e770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc009560 tx=0x7f7bdc009190 comp rx=0 tx=0).stop 2024-09-19T09:13:46.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.408+0000 7f7bebe0e640 1 -- 172.21.15.18:0/2643866103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7be40d3240 msgr2=0x7f7be41f7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:46.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.408+0000 7f7bebe0e640 1 --2- 172.21.15.18:0/2643866103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7be40d3240 0x7f7be41f7b80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800c430 tx=0x7f7bd800c8f0 comp rx=0 tx=0).stop 2024-09-19T09:13:46.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.408+0000 7f7bebe0e640 1 -- 172.21.15.18:0/2643866103 shutdown_connections 2024-09-19T09:13:46.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.408+0000 7f7bebe0e640 1 --2- 172.21.15.18:0/2643866103 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7bd006c2b0 0x7f7bd006e770 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:46.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.408+0000 7f7bebe0e640 1 --2- 172.21.15.18:0/2643866103 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7be415ef50 0x7f7be40c97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:46.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.408+0000 7f7bebe0e640 1 --2- 172.21.15.18:0/2643866103 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7be40d3240 0x7f7be41f7b80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:46.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.408+0000 7f7bebe0e640 1 --2- 172.21.15.18:0/2643866103 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7be40b9510 0x7f7be41508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:46.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.408+0000 7f7bebe0e640 1 -- 172.21.15.18:0/2643866103 >> 172.21.15.18:0/2643866103 conn(0x7f7be40d4c60 msgr2=0x7f7be415da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:46.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.408+0000 7f7bebe0e640 1 -- 172.21.15.18:0/2643866103 shutdown_connections 2024-09-19T09:13:46.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:46.408+0000 7f7bebe0e640 1 -- 172.21.15.18:0/2643866103 wait complete. 2024-09-19T09:13:46.418 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T09:13:46.419 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:13:46.419 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-09-19T09:13:46.419 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-19T09:13:46.419 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-19T09:13:46.419 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T09:13:46.419 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T09:13:46.419 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:13:46.419 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:13:46.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:46.419 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-09-19T09:13:46.439 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:13:46.439 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:13:46.439 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:13:46.439 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:46.439 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-09-19T09:13:46.440 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:46.440 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:13:46.440 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:13:46.440 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-09-19T09:13:46.440 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:13:46.440 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:13:46.440 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-09-19T09:13:46.440 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:13:46.440 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:13:46.441 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:13:46.441 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:13:46.441 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T09:13:46.441 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42782sec preferred_lft 42782sec 2024-09-19T09:13:46.441 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link noprefixroute 2024-09-19T09:13:46.441 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:46.441 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T09:13:46.441 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:13:46.441 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-19T09:13:46.442 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link add name ceph-brx type bridge 2024-09-19T09:13:46.442 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip addr flush dev ceph-brx 2024-09-19T09:13:46.442 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set ceph-brx up 2024-09-19T09:13:46.442 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T09:13:46.442 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-19T09:13:46.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:13:46.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:46.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:46.866 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:13:46.891 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-09-19T09:13:46.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:46.892 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-09-19T09:13:46.959 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-09-19T09:13:46.959 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:13:46.960 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T09:13:46.960 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T09:13:46.960 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:13:46.960 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:13:46.960 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-19T09:13:46.960 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T09:13:46.960 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T09:13:46.960 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T09:13:46.960 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-19T09:13:47.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:13:47.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:47.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:47.251 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-19T09:13:47.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:47.266 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list-id 2024-09-19T09:13:47.321 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:13:47.322 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-19T09:13:47.322 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T09:13:47.322 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-19T09:13:47.322 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-19T09:13:47.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:13:47.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:47.439 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-19T09:13:47.440 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:13:47.440 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-19T09:13:47.440 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-19T09:13:47.440 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T09:13:47.440 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-19T09:13:47.440 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-19T09:13:47.440 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-19T09:13:47.440 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-19T09:13:47.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:13:47.607 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:47.613 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:13:47.613 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-19T09:13:47.613 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2024-09-19T09:13:47.613 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T09:13:47.613 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-19T09:13:47.662 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:13:47.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:47.691 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:13:47.691 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-19T09:13:47.706 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:13:47.706 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:13:47.706 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-19T09:13:47.761 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-19T09:13:47.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:47.761 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:13:47.854 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:13:47.855 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:13:47.855 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:13:47.978 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:13:47.979 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:13:47.979 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:13:47.979 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:13:47.979 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:13:47.983 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:13:47.983 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:13:47.983 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:13:47.983 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:13:47.984 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:13:47.984 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-19T09:13:47.984 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-19T09:13:47.984 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=fec66d7e-50e5-42ed-81de-ad141a2f0f4e" will pass to kernel 2024-09-19T09:13:47.984 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-19T09:13:47.984 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:13:47.984 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:13:47.984 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:13:47.985 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:13:47.986 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:13:47.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:47.986 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-19T09:13:48.011 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:13:48.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:13:48.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:48.107 INFO:teuthology.orchestra.run.smithi162.stdout:client4629 2024-09-19T09:13:48.108 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:13:48.108 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:13:48.124 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:13:48.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:13:48.213 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:48.219 INFO:teuthology.orchestra.run.smithi162.stdout:client4629 2024-09-19T09:13:48.219 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:13:48.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:13:48.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:48.274 INFO:teuthology.orchestra.run.smithi162.stdout:client4629 2024-09-19T09:13:48.275 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/fec66d7e-50e5-42ed-81de-ad141a2f0f4e.client4629/status') 2024-09-19T09:13:48.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:13:48.333 INFO:teuthology.orchestra.run.smithi162.stdout:instance: client.4629 (3)172.21.15.162:0/3303707456 2024-09-19T09:13:48.333 INFO:teuthology.orchestra.run.smithi162.stdout:blocklisted: false 2024-09-19T09:13:48.333 INFO:teuthology.orchestra.run.smithi162.stderr:0+1 records in 2024-09-19T09:13:48.333 INFO:teuthology.orchestra.run.smithi162.stderr:0+1 records out 2024-09-19T09:13:48.333 INFO:teuthology.orchestra.run.smithi162.stderr:71 bytes copied, 2.2594e-05 s, 3.1 MB/s 2024-09-19T09:13:48.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:48.340 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-09-19T09:13:48.340 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T09:13:48.340 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-19T09:13:48.341 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T09:13:48.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.456+0000 7fee83df8640 1 Processor -- start 2024-09-19T09:13:48.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.456+0000 7fee83df8640 1 -- start start 2024-09-19T09:13:48.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.457+0000 7fee83df8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee7c0b3f80 0x7fee7c1635d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:48.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.457+0000 7fee83df8640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee7c0b4560 con 0x7fee7c071510 2024-09-19T09:13:48.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.457+0000 7fee83df8640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee7c0b4840 con 0x7fee7c0cf890 2024-09-19T09:13:48.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.457+0000 7fee83df8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fee7c0b5170 con 0x7fee7c0b3f80 2024-09-19T09:13:48.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.457+0000 7fee81b94640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fee7c071510 0x7fee7c0718f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:45384/0 (socket says 172.21.15.18:45384) 2024-09-19T09:13:48.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.457+0000 7fee81b94640 1 -- 172.21.15.18:0/2457775381 learned_addr learned my addr 172.21.15.18:0/2457775381 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:48.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.457+0000 7fee82395640 1 --2- 172.21.15.18:0/2457775381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee7c0b3f80 0x7fee7c1635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:48.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.457+0000 7fee80b92640 1 -- 172.21.15.18:0/2457775381 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2898323500 0 0) 0x7fee7c0b4560 con 0x7fee7c071510 2024-09-19T09:13:48.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.457+0000 7fee80b92640 1 -- 172.21.15.18:0/2457775381 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee68003520 con 0x7fee7c071510 2024-09-19T09:13:48.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.457+0000 7fee80b92640 1 -- 172.21.15.18:0/2457775381 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1317128194 0 0) 0x7fee7c0b4840 con 0x7fee7c0cf890 2024-09-19T09:13:48.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.458+0000 7fee80b92640 1 -- 172.21.15.18:0/2457775381 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee7c0b4560 con 0x7fee7c0cf890 2024-09-19T09:13:48.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.458+0000 7fee82395640 1 -- 172.21.15.18:0/2457775381 >> v1:172.21.15.162:6789/0 conn(0x7fee7c0cf890 legacy=0x7fee7c16abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:48.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.458+0000 7fee82395640 1 -- 172.21.15.18:0/2457775381 >> v1:172.21.15.18:6789/0 conn(0x7fee7c071510 legacy=0x7fee7c0718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:48.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.458+0000 7fee82395640 1 -- 172.21.15.18:0/2457775381 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee7c0b4b20 con 0x7fee7c0b3f80 2024-09-19T09:13:48.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.458+0000 7fee82395640 1 --2- 172.21.15.18:0/2457775381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee7c0b3f80 0x7fee7c1635d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fee74009dc0 tx=0x7fee7402a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7c869b24e0800de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:48.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.459+0000 7fee80b92640 1 -- 172.21.15.18:0/2457775381 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee7402ae60 con 0x7fee7c0b3f80 2024-09-19T09:13:48.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.459+0000 7fee80b92640 1 -- 172.21.15.18:0/2457775381 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee74007740 con 0x7fee7c0b3f80 2024-09-19T09:13:48.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.459+0000 7fee80b92640 1 -- 172.21.15.18:0/2457775381 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee74007b10 con 0x7fee7c0b3f80 2024-09-19T09:13:48.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.459+0000 7fee83df8640 1 -- 172.21.15.18:0/2457775381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee7c0b3f80 msgr2=0x7fee7c1635d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:48.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.459+0000 7fee83df8640 1 --2- 172.21.15.18:0/2457775381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee7c0b3f80 0x7fee7c1635d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fee74009dc0 tx=0x7fee7402a640 comp rx=0 tx=0).stop 2024-09-19T09:13:48.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.459+0000 7fee83df8640 1 -- 172.21.15.18:0/2457775381 shutdown_connections 2024-09-19T09:13:48.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.459+0000 7fee83df8640 1 --2- 172.21.15.18:0/2457775381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee7c0b3f80 0x7fee7c1635d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:48.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.459+0000 7fee83df8640 1 -- 172.21.15.18:0/2457775381 >> 172.21.15.18:0/2457775381 conn(0x7fee7c06bc10 msgr2=0x7fee7c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:48.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.459+0000 7fee83df8640 1 -- 172.21.15.18:0/2457775381 shutdown_connections 2024-09-19T09:13:48.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.459+0000 7fee83df8640 1 -- 172.21.15.18:0/2457775381 wait complete. 2024-09-19T09:13:48.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.460+0000 7fee83df8640 1 Processor -- start 2024-09-19T09:13:48.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.460+0000 7fee83df8640 1 -- start start 2024-09-19T09:13:48.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.461+0000 7fee83df8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee7c071510 0x7fee7c145260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:48.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.461+0000 7fee83df8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee7c0b3f80 0x7fee7c15fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:48.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.461+0000 7fee83df8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee7c0cf890 0x7fee7c15e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:48.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.461+0000 7fee83df8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fee7c164480 con 0x7fee7c071510 2024-09-19T09:13:48.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.461+0000 7fee83df8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fee7c06cb40 con 0x7fee7c0cf890 2024-09-19T09:13:48.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.461+0000 7fee83df8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fee7c16e310 con 0x7fee7c0b3f80 2024-09-19T09:13:48.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.461+0000 7fee81b94640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee7c071510 0x7fee7c145260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:48.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.461+0000 7fee81b94640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee7c071510 0x7fee7c145260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36100/0 (socket says 172.21.15.18:36100) 2024-09-19T09:13:48.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.461+0000 7fee81b94640 1 -- 172.21.15.18:0/2298046424 learned_addr learned my addr 172.21.15.18:0/2298046424 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:48.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.461+0000 7fee82395640 1 --2- 172.21.15.18:0/2298046424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee7c0cf890 0x7fee7c15e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:48.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.461+0000 7fee81393640 1 --2- 172.21.15.18:0/2298046424 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee7c0b3f80 0x7fee7c15fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:48.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.462+0000 7fee81b94640 1 -- 172.21.15.18:0/2298046424 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee7c0b3f80 msgr2=0x7fee7c15fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:48.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.462+0000 7fee81b94640 1 --2- 172.21.15.18:0/2298046424 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee7c0b3f80 0x7fee7c15fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:48.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.462+0000 7fee81b94640 1 -- 172.21.15.18:0/2298046424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee7c0cf890 msgr2=0x7fee7c15e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:48.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.462+0000 7fee81b94640 1 --2- 172.21.15.18:0/2298046424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee7c0cf890 0x7fee7c15e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:48.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.462+0000 7fee81b94640 1 -- 172.21.15.18:0/2298046424 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee7c15dae0 con 0x7fee7c071510 2024-09-19T09:13:48.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.462+0000 7fee81b94640 1 --2- 172.21.15.18:0/2298046424 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee7c071510 0x7fee7c145260 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fee7800c500 tx=0x7fee7800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:48.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.462+0000 7fee727fc640 1 -- 172.21.15.18:0/2298046424 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee78017070 con 0x7fee7c071510 2024-09-19T09:13:48.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.462+0000 7fee727fc640 1 -- 172.21.15.18:0/2298046424 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee78005ce0 con 0x7fee7c071510 2024-09-19T09:13:48.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.462+0000 7fee83df8640 1 -- 172.21.15.18:0/2298046424 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee7c15ddc0 con 0x7fee7c071510 2024-09-19T09:13:48.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.462+0000 7fee727fc640 1 -- 172.21.15.18:0/2298046424 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee780072f0 con 0x7fee7c071510 2024-09-19T09:13:48.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.462+0000 7fee83df8640 1 -- 172.21.15.18:0/2298046424 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee7c15e380 con 0x7fee7c071510 2024-09-19T09:13:48.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.463+0000 7fee83df8640 1 -- 172.21.15.18:0/2298046424 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee7c15e580 con 0x7fee7c071510 2024-09-19T09:13:48.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.464+0000 7fee727fc640 1 -- 172.21.15.18:0/2298046424 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fee7801a070 con 0x7fee7c071510 2024-09-19T09:13:48.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.464+0000 7fee727fc640 1 --2- 172.21.15.18:0/2298046424 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fee6006c2b0 0x7fee6006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:48.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.464+0000 7fee727fc640 1 -- 172.21.15.18:0/2298046424 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fee7808a7a0 con 0x7fee7c071510 2024-09-19T09:13:48.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.464+0000 7fee81393640 1 --2- 172.21.15.18:0/2298046424 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fee6006c2b0 0x7fee6006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:48.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.465+0000 7fee81393640 1 --2- 172.21.15.18:0/2298046424 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fee6006c2b0 0x7fee6006e770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fee6c007fd0 tx=0x7fee6c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:48.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.468+0000 7fee727fc640 1 -- 172.21.15.18:0/2298046424 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fee780588d0 con 0x7fee7c071510 2024-09-19T09:13:48.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.681+0000 7fee83df8640 1 -- 172.21.15.18:0/2298046424 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fee7c1635d0 con 0x7fee7c071510 2024-09-19T09:13:48.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.681+0000 7fee727fc640 1 -- 172.21.15.18:0/2298046424 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7fee7805cbd0 con 0x7fee7c071510 2024-09-19T09:13:48.682 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T09:13:48.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.683+0000 7fee83df8640 1 -- 172.21.15.18:0/2298046424 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fee6006c2b0 msgr2=0x7fee6006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:48.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.683+0000 7fee83df8640 1 --2- 172.21.15.18:0/2298046424 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fee6006c2b0 0x7fee6006e770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fee6c007fd0 tx=0x7fee6c009040 comp rx=0 tx=0).stop 2024-09-19T09:13:48.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.683+0000 7fee83df8640 1 -- 172.21.15.18:0/2298046424 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee7c071510 msgr2=0x7fee7c145260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:48.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.683+0000 7fee83df8640 1 --2- 172.21.15.18:0/2298046424 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee7c071510 0x7fee7c145260 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fee7800c500 tx=0x7fee7800c9c0 comp rx=0 tx=0).stop 2024-09-19T09:13:48.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.683+0000 7fee83df8640 1 -- 172.21.15.18:0/2298046424 shutdown_connections 2024-09-19T09:13:48.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.683+0000 7fee83df8640 1 --2- 172.21.15.18:0/2298046424 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fee6006c2b0 0x7fee6006e770 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:48.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.683+0000 7fee83df8640 1 --2- 172.21.15.18:0/2298046424 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee7c0cf890 0x7fee7c15e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:48.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.683+0000 7fee83df8640 1 --2- 172.21.15.18:0/2298046424 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee7c0b3f80 0x7fee7c15fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:48.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.683+0000 7fee83df8640 1 --2- 172.21.15.18:0/2298046424 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee7c071510 0x7fee7c145260 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:48.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.683+0000 7fee83df8640 1 -- 172.21.15.18:0/2298046424 >> 172.21.15.18:0/2298046424 conn(0x7fee7c06bc10 msgr2=0x7fee7c0b05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:48.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.683+0000 7fee83df8640 1 -- 172.21.15.18:0/2298046424 shutdown_connections 2024-09-19T09:13:48.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:48.683+0000 7fee83df8640 1 -- 172.21.15.18:0/2298046424 wait complete. 2024-09-19T09:13:48.695 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T09:13:48.695 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:13:48.695 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-09-19T09:13:48.696 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-19T09:13:48.696 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-19T09:13:48.696 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T09:13:48.696 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T09:13:48.696 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:13:48.696 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-19T09:13:48.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:48.696 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-09-19T09:13:48.713 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:13:48.713 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:13:48.713 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:13:48.713 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:48.713 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-09-19T09:13:48.713 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:48.713 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:13:48.713 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:13:48.713 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-09-19T09:13:48.713 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:13:48.713 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:13:48.713 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-09-19T09:13:48.714 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:13:48.714 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:13:48.714 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:13:48.714 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:13:48.714 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T09:13:48.714 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42780sec preferred_lft 42780sec 2024-09-19T09:13:48.714 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link noprefixroute 2024-09-19T09:13:48.714 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:48.714 INFO:teuthology.orchestra.run.smithi162.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T09:13:48.714 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 86:86:3e:32:67:c5 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:13:48.714 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T09:13:48.714 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:48.714 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::5829:65ff:fe01:6bc7/64 scope link 2024-09-19T09:13:48.714 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:48.715 INFO:teuthology.orchestra.run.smithi162.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:13:48.715 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 86:86:3e:32:67:c5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T09:13:48.715 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::8486:3eff:fe32:67c5/64 scope link tentative 2024-09-19T09:13:48.715 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:48.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:48.715 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:13:48.777 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-09-19T09:13:48.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:48.778 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-09-19T09:13:48.835 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-09-19T09:13:48.835 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:13:48.835 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T09:13:48.836 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T09:13:48.836 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:13:48.836 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:13:48.836 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-19T09:13:48.836 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T09:13:48.836 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T09:13:48.836 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T09:13:48.836 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-19T09:13:48.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:13:48.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:48.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:48.962 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-19T09:13:48.977 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-19T09:13:48.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:48.978 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list-id 2024-09-19T09:13:49.032 INFO:teuthology.orchestra.run.smithi162.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-19T09:13:49.032 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:13:49.032 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-19T09:13:49.033 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-19T09:13:49.033 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-19T09:13:49.033 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-19T09:13:49.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:13:49.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:49.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:49.148 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-19T09:13:49.173 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:13:49.173 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:13:49.173 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:13:49.173 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:49.173 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-09-19T09:13:49.173 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:49.173 INFO:teuthology.orchestra.run.smithi162.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T09:13:49.173 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether ba:0a:80:6e:a3:59 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-19T09:13:49.173 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-19T09:13:49.173 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:49.173 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::b80a:80ff:fe6e:a359/64 scope link 2024-09-19T09:13:49.173 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:49.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:49.174 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-19T09:13:49.239 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:13:49.239 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:13:49.239 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:13:49.239 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:49.239 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-09-19T09:13:49.239 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:49.239 INFO:teuthology.orchestra.run.smithi162.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T09:13:49.239 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether ba:0a:80:6e:a3:59 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-19T09:13:49.239 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-19T09:13:49.239 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:49.239 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::b80a:80ff:fe6e:a359/64 scope link 2024-09-19T09:13:49.239 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:13:49.240 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-19T09:13:49.241 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:13:49.241 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-19T09:13:49.241 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-19T09:13:49.241 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-19T09:13:49.241 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-19T09:13:49.241 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-19T09:13:49.241 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-19T09:13:49.241 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-19T09:13:49.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:13:49.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:49.392 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:13:49.392 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-19T09:13:49.392 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.1 up 2024-09-19T09:13:49.393 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set dev brx.1 master ceph-brx 2024-09-19T09:13:49.393 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-19T09:13:49.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:13:49.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:49.469 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:13:49.469 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-19T09:13:49.484 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-19T09:13:49.484 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:13:49.484 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-19T09:13:49.539 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-19T09:13:49.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:49.539 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-19T09:13:49.624 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-19T09:13:49.624 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-19T09:13:49.624 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:13:49.633 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-19T09:13:49.633 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-19T09:13:49.633 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:13:49.633 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:13:49.633 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:13:49.638 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-19T09:13:49.638 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-19T09:13:49.638 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:13:49.638 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:13:49.638 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:13:49.638 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-19T09:13:49.638 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-19T09:13:49.638 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=fec66d7e-50e5-42ed-81de-ad141a2f0f4e" will pass to kernel 2024-09-19T09:13:49.638 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-19T09:13:49.639 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:13:49.639 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:13:49.639 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:13:49.639 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:13:49.640 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:13:49.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:49.640 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-19T09:13:49.664 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:13:49.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:13:49.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:49.760 INFO:teuthology.orchestra.run.smithi162.stdout:client4638 2024-09-19T09:13:49.760 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:13:49.760 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:13:49.775 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:13:49.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:13:49.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:49.871 INFO:teuthology.orchestra.run.smithi162.stdout:client4638 2024-09-19T09:13:49.871 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:13:49.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:49 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:13:49.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:49.926 INFO:teuthology.orchestra.run.smithi162.stdout:client4638 2024-09-19T09:13:49.927 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/fec66d7e-50e5-42ed-81de-ad141a2f0f4e.client4638/status') 2024-09-19T09:13:49.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:13:49.985 INFO:teuthology.orchestra.run.smithi162.stdout:instance: client.4638 (3)172.21.15.162:0/4241814482 2024-09-19T09:13:49.985 INFO:teuthology.orchestra.run.smithi162.stdout:blocklisted: false 2024-09-19T09:13:49.986 INFO:teuthology.orchestra.run.smithi162.stderr:0+1 records in 2024-09-19T09:13:49.986 INFO:teuthology.orchestra.run.smithi162.stderr:0+1 records out 2024-09-19T09:13:49.986 INFO:teuthology.orchestra.run.smithi162.stderr:71 bytes copied, 3.7545e-05 s, 1.9 MB/s 2024-09-19T09:13:49.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:13:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:13:49.993 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-19T09:13:50.060 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestClusterFull) That when an OSD epoch barrier is set on an MDS, subsequently 2024-09-19T09:13:50.060 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestClusterFull) 2024-09-19T09:13:50.060 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:13:50.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.175+0000 7f7dfc20a640 1 Processor -- start 2024-09-19T09:13:50.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.175+0000 7f7dfc20a640 1 -- start start 2024-09-19T09:13:50.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.176+0000 7f7dfc20a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7df4152210 0x7f7df4071e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.176+0000 7f7dfc20a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7df40723d0 0x7f7df40ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.176+0000 7f7dfc20a640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7df415c4f0 con 0x7f7df40cecc0 2024-09-19T09:13:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.176+0000 7f7dfc20a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f7df415b730 con 0x7f7df4152210 2024-09-19T09:13:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.176+0000 7f7dfc20a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7df415ba10 con 0x7f7df40723d0 2024-09-19T09:13:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.177+0000 7f7dfa7a7640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f7df40cecc0 0x7f7df40cf170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:45388/0 (socket says 172.21.15.18:45388) 2024-09-19T09:13:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.177+0000 7f7dfa7a7640 1 -- 172.21.15.18:0/3247724655 learned_addr learned my addr 172.21.15.18:0/3247724655 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.177+0000 7f7df9fa6640 1 --2- 172.21.15.18:0/3247724655 >> v2:172.21.15.162:3300/0 conn(0x7f7df4152210 0x7f7df4071e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.177+0000 7f7df97a5640 1 --2- 172.21.15.18:0/3247724655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7df40723d0 0x7f7df40ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.177+0000 7f7df8fa4640 1 -- 172.21.15.18:0/3247724655 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 318831675 0 0) 0x7f7df415c4f0 con 0x7f7df40cecc0 2024-09-19T09:13:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.177+0000 7f7df8fa4640 1 -- 172.21.15.18:0/3247724655 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ddc003520 con 0x7f7df40cecc0 2024-09-19T09:13:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.177+0000 7f7df97a5640 1 -- 172.21.15.18:0/3247724655 >> v2:172.21.15.162:3300/0 conn(0x7f7df4152210 msgr2=0x7f7df4071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:50.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.177+0000 7f7df97a5640 1 --2- 172.21.15.18:0/3247724655 >> v2:172.21.15.162:3300/0 conn(0x7f7df4152210 0x7f7df4071e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.177+0000 7f7df97a5640 1 -- 172.21.15.18:0/3247724655 >> v1:172.21.15.18:6789/0 conn(0x7f7df40cecc0 legacy=0x7f7df40cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:50.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.177+0000 7f7df97a5640 1 -- 172.21.15.18:0/3247724655 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7df415bcf0 con 0x7f7df40723d0 2024-09-19T09:13:50.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.177+0000 7f7df9fa6640 1 --2- 172.21.15.18:0/3247724655 >> v2:172.21.15.162:3300/0 conn(0x7f7df4152210 0x7f7df4071e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:13:50.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.178+0000 7f7df97a5640 1 --2- 172.21.15.18:0/3247724655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7df40723d0 0x7f7df40ce780 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7de80097a0 tx=0x7f7de802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c67ad62f3b1f52aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:50.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.178+0000 7f7df8fa4640 1 -- 172.21.15.18:0/3247724655 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de8037070 con 0x7f7df40723d0 2024-09-19T09:13:50.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.178+0000 7f7df8fa4640 1 -- 172.21.15.18:0/3247724655 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7de8032440 con 0x7f7df40723d0 2024-09-19T09:13:50.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.178+0000 7f7df8fa4640 1 -- 172.21.15.18:0/3247724655 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de80327f0 con 0x7f7df40723d0 2024-09-19T09:13:50.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.179+0000 7f7dfc20a640 1 -- 172.21.15.18:0/3247724655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7df40723d0 msgr2=0x7f7df40ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:50.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.179+0000 7f7dfc20a640 1 --2- 172.21.15.18:0/3247724655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7df40723d0 0x7f7df40ce780 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7de80097a0 tx=0x7f7de802a180 comp rx=0 tx=0).stop 2024-09-19T09:13:50.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.179+0000 7f7dfc20a640 1 -- 172.21.15.18:0/3247724655 shutdown_connections 2024-09-19T09:13:50.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.179+0000 7f7dfc20a640 1 --2- 172.21.15.18:0/3247724655 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7df40723d0 0x7f7df40ce780 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.179+0000 7f7dfc20a640 1 --2- 172.21.15.18:0/3247724655 >> v2:172.21.15.162:3300/0 conn(0x7f7df4152210 0x7f7df4071e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.179+0000 7f7dfc20a640 1 -- 172.21.15.18:0/3247724655 >> 172.21.15.18:0/3247724655 conn(0x7f7df406bc10 msgr2=0x7f7df406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:50.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.179+0000 7f7dfc20a640 1 -- 172.21.15.18:0/3247724655 shutdown_connections 2024-09-19T09:13:50.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.179+0000 7f7dfc20a640 1 -- 172.21.15.18:0/3247724655 wait complete. 2024-09-19T09:13:50.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.180+0000 7f7dfc20a640 1 Processor -- start 2024-09-19T09:13:50.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.180+0000 7f7dfc20a640 1 -- start start 2024-09-19T09:13:50.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.181+0000 7f7dfc20a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7df40723d0 0x7f7df4145240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:50.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.181+0000 7f7dfc20a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7df40cecc0 0x7f7df41f08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:50.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.181+0000 7f7dfc20a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7df4152210 0x7f7df414d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:50.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.181+0000 7f7dfc20a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7df40cf880 con 0x7f7df40723d0 2024-09-19T09:13:50.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.181+0000 7f7dfc20a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7df406f380 con 0x7f7df4152210 2024-09-19T09:13:50.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.181+0000 7f7dfc20a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7df406d6b0 con 0x7f7df40cecc0 2024-09-19T09:13:50.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.181+0000 7f7df9fa6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7df40723d0 0x7f7df4145240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:50.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.181+0000 7f7df97a5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7df40cecc0 0x7f7df41f08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:50.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.181+0000 7f7df9fa6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7df40723d0 0x7f7df4145240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36112/0 (socket says 172.21.15.18:36112) 2024-09-19T09:13:50.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.181+0000 7f7df9fa6640 1 -- 172.21.15.18:0/65218196 learned_addr learned my addr 172.21.15.18:0/65218196 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:50.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.181+0000 7f7dfa7a7640 1 --2- 172.21.15.18:0/65218196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7df4152210 0x7f7df414d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:50.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.181+0000 7f7df97a5640 1 -- 172.21.15.18:0/65218196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7df4152210 msgr2=0x7f7df414d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:50.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.181+0000 7f7df97a5640 1 --2- 172.21.15.18:0/65218196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7df4152210 0x7f7df414d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.181+0000 7f7df97a5640 1 -- 172.21.15.18:0/65218196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7df40723d0 msgr2=0x7f7df4145240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:50.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.181+0000 7f7df97a5640 1 --2- 172.21.15.18:0/65218196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7df40723d0 0x7f7df4145240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.181+0000 7f7df97a5640 1 -- 172.21.15.18:0/65218196 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7df4147e20 con 0x7f7df40cecc0 2024-09-19T09:13:50.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.181+0000 7f7df9fa6640 1 --2- 172.21.15.18:0/65218196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7df40723d0 0x7f7df4145240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:13:50.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.181+0000 7f7df97a5640 1 --2- 172.21.15.18:0/65218196 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7df40cecc0 0x7f7df41f08f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7de8031000 tx=0x7f7de80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:50.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.182+0000 7f7df27fc640 1 -- 172.21.15.18:0/65218196 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de8041030 con 0x7f7df40cecc0 2024-09-19T09:13:50.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.182+0000 7f7df27fc640 1 -- 172.21.15.18:0/65218196 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7de803d420 con 0x7f7df40cecc0 2024-09-19T09:13:50.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.182+0000 7f7df27fc640 1 -- 172.21.15.18:0/65218196 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7de8037040 con 0x7f7df40cecc0 2024-09-19T09:13:50.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.182+0000 7f7dfc20a640 1 -- 172.21.15.18:0/65218196 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7df4148100 con 0x7f7df40cecc0 2024-09-19T09:13:50.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.182+0000 7f7dfc20a640 1 -- 172.21.15.18:0/65218196 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7df41486c0 con 0x7f7df40cecc0 2024-09-19T09:13:50.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.183+0000 7f7dfc20a640 1 -- 172.21.15.18:0/65218196 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7df40ce780 con 0x7f7df40cecc0 2024-09-19T09:13:50.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.183+0000 7f7df27fc640 1 -- 172.21.15.18:0/65218196 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7de8044070 con 0x7f7df40cecc0 2024-09-19T09:13:50.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.184+0000 7f7df27fc640 1 --2- 172.21.15.18:0/65218196 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7de006c2e0 0x7f7de006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:50.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.184+0000 7f7df27fc640 1 -- 172.21.15.18:0/65218196 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f7de80ab8b0 con 0x7f7df40cecc0 2024-09-19T09:13:50.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.184+0000 7f7df9fa6640 1 --2- 172.21.15.18:0/65218196 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7de006c2e0 0x7f7de006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:50.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.184+0000 7f7df9fa6640 1 --2- 172.21.15.18:0/65218196 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7de006c2e0 0x7f7de006e7a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7dec009fd0 tx=0x7f7dec009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:50.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.188+0000 7f7df27fc640 1 -- 172.21.15.18:0/65218196 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7de80799c0 con 0x7f7df40cecc0 2024-09-19T09:13:50.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.365+0000 7f7dfc20a640 1 -- 172.21.15.18:0/65218196 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7df414cf50 con 0x7f7df40cecc0 2024-09-19T09:13:50.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.366+0000 7f7df27fc640 1 -- 172.21.15.18:0/65218196 <== mon.2 v2:172.21.15.162:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16681 (secure 0 0 0) 0x7f7de807dcc0 con 0x7f7df40cecc0 2024-09-19T09:13:50.366 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:50.367 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:13:28.500103+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:13:25.116784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:13:25.838110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:13:50.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.368+0000 7f7dfc20a640 1 -- 172.21.15.18:0/65218196 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7de006c2e0 msgr2=0x7f7de006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:50.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.368+0000 7f7dfc20a640 1 --2- 172.21.15.18:0/65218196 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7de006c2e0 0x7f7de006e7a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7dec009fd0 tx=0x7f7dec009190 comp rx=0 tx=0).stop 2024-09-19T09:13:50.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.368+0000 7f7dfc20a640 1 -- 172.21.15.18:0/65218196 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7df40cecc0 msgr2=0x7f7df41f08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:50.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.368+0000 7f7dfc20a640 1 --2- 172.21.15.18:0/65218196 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7df40cecc0 0x7f7df41f08f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7de8031000 tx=0x7f7de80046c0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.368+0000 7f7dfc20a640 1 -- 172.21.15.18:0/65218196 shutdown_connections 2024-09-19T09:13:50.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.368+0000 7f7dfc20a640 1 --2- 172.21.15.18:0/65218196 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7de006c2e0 0x7f7de006e7a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.368+0000 7f7dfc20a640 1 --2- 172.21.15.18:0/65218196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7df4152210 0x7f7df414d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.368+0000 7f7dfc20a640 1 --2- 172.21.15.18:0/65218196 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7df40cecc0 0x7f7df41f08f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.368+0000 7f7dfc20a640 1 --2- 172.21.15.18:0/65218196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7df40723d0 0x7f7df4145240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.368+0000 7f7dfc20a640 1 -- 172.21.15.18:0/65218196 >> 172.21.15.18:0/65218196 conn(0x7f7df406bc10 msgr2=0x7f7df4074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:50.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.368+0000 7f7dfc20a640 1 -- 172.21.15.18:0/65218196 shutdown_connections 2024-09-19T09:13:50.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.368+0000 7f7dfc20a640 1 -- 172.21.15.18:0/65218196 wait complete. 2024-09-19T09:13:50.379 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T09:13:17.564717+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T09:13:25.116784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T09:13:25.838110+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T09:13:50.380 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T09:13:50.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.485+0000 7ff5001cd640 1 Processor -- start 2024-09-19T09:13:50.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.485+0000 7ff5001cd640 1 -- start start 2024-09-19T09:13:50.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.486+0000 7ff5001cd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff4f80ae840 0x7ff4f8073170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:50.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.486+0000 7ff5001cd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff4f80aecb0 0x7ff4f806f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:50.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.486+0000 7ff5001cd640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4f806bff0 con 0x7ff4f80b0000 2024-09-19T09:13:50.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.486+0000 7ff5001cd640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7ff4f806c2d0 con 0x7ff4f80aecb0 2024-09-19T09:13:50.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.486+0000 7ff5001cd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff4f806ef40 con 0x7ff4f80ae840 2024-09-19T09:13:50.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.486+0000 7ff4fe76a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff4f80aecb0 0x7ff4f806f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:50.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.487+0000 7ff4fe76a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff4f80aecb0 0x7ff4f806f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36116/0 (socket says 172.21.15.18:36116) 2024-09-19T09:13:50.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.487+0000 7ff4fe76a640 1 -- 172.21.15.18:0/832203009 learned_addr learned my addr 172.21.15.18:0/832203009 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:50.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.487+0000 7ff4fd768640 1 --2- 172.21.15.18:0/832203009 >> v2:172.21.15.162:3300/0 conn(0x7ff4f80ae840 0x7ff4f8073170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:50.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.487+0000 7ff4fe76a640 1 -- 172.21.15.18:0/832203009 >> v2:172.21.15.162:3300/0 conn(0x7ff4f80ae840 msgr2=0x7ff4f8073170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:50.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.487+0000 7ff4fe76a640 1 --2- 172.21.15.18:0/832203009 >> v2:172.21.15.162:3300/0 conn(0x7ff4f80ae840 0x7ff4f8073170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.487+0000 7ff4fe76a640 1 -- 172.21.15.18:0/832203009 >> v1:172.21.15.162:6789/0 conn(0x7ff4f80b0000 legacy=0x7ff4f80b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:50.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.487+0000 7ff4fe76a640 1 -- 172.21.15.18:0/832203009 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f806f220 con 0x7ff4f80aecb0 2024-09-19T09:13:50.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.487+0000 7ff4fe76a640 1 --2- 172.21.15.18:0/832203009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4f80aecb0 0x7ff4f806f740 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff4f80cdc00 tx=0x7ff4e802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4462b145453ed9b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:50.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.488+0000 7ff4fcf67640 1 -- 172.21.15.18:0/832203009 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e8036070 con 0x7ff4f80aecb0 2024-09-19T09:13:50.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.488+0000 7ff4fcf67640 1 -- 172.21.15.18:0/832203009 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4e8031600 con 0x7ff4f80aecb0 2024-09-19T09:13:50.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.488+0000 7ff4fcf67640 1 -- 172.21.15.18:0/832203009 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e80319d0 con 0x7ff4f80aecb0 2024-09-19T09:13:50.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.488+0000 7ff5001cd640 1 -- 172.21.15.18:0/832203009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4f80aecb0 msgr2=0x7ff4f806f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:50.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.488+0000 7ff5001cd640 1 --2- 172.21.15.18:0/832203009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4f80aecb0 0x7ff4f806f740 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff4f80cdc00 tx=0x7ff4e802a610 comp rx=0 tx=0).stop 2024-09-19T09:13:50.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.488+0000 7ff5001cd640 1 -- 172.21.15.18:0/832203009 shutdown_connections 2024-09-19T09:13:50.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.488+0000 7ff5001cd640 1 --2- 172.21.15.18:0/832203009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4f80aecb0 0x7ff4f806f740 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.488+0000 7ff5001cd640 1 --2- 172.21.15.18:0/832203009 >> v2:172.21.15.162:3300/0 conn(0x7ff4f80ae840 0x7ff4f8073170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.488+0000 7ff5001cd640 1 -- 172.21.15.18:0/832203009 >> 172.21.15.18:0/832203009 conn(0x7ff4f8072680 msgr2=0x7ff4f8072a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:50.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.488+0000 7ff5001cd640 1 -- 172.21.15.18:0/832203009 shutdown_connections 2024-09-19T09:13:50.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.488+0000 7ff5001cd640 1 -- 172.21.15.18:0/832203009 wait complete. 2024-09-19T09:13:50.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.490+0000 7ff5001cd640 1 Processor -- start 2024-09-19T09:13:50.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.490+0000 7ff5001cd640 1 -- start start 2024-09-19T09:13:50.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.490+0000 7ff5001cd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4f80ae840 0x7ff4f80ce270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:50.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.490+0000 7ff5001cd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4f80aecb0 0x7ff4f8151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:50.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.490+0000 7ff5001cd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4f80b0000 0x7ff4f81611c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:50.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.490+0000 7ff5001cd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f806bd90 con 0x7ff4f80ae840 2024-09-19T09:13:50.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.490+0000 7ff5001cd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f806bc10 con 0x7ff4f80aecb0 2024-09-19T09:13:50.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.490+0000 7ff5001cd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff4f815ee30 con 0x7ff4f80b0000 2024-09-19T09:13:50.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.490+0000 7ff4fdf69640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4f80ae840 0x7ff4f80ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:50.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.490+0000 7ff4fdf69640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4f80ae840 0x7ff4f80ce270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36118/0 (socket says 172.21.15.18:36118) 2024-09-19T09:13:50.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.490+0000 7ff4fdf69640 1 -- 172.21.15.18:0/506613934 learned_addr learned my addr 172.21.15.18:0/506613934 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:50.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.491+0000 7ff4fd768640 1 --2- 172.21.15.18:0/506613934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4f80aecb0 0x7ff4f8151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:50.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.491+0000 7ff4fe76a640 1 --2- 172.21.15.18:0/506613934 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4f80b0000 0x7ff4f81611c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:50.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.491+0000 7ff4fdf69640 1 -- 172.21.15.18:0/506613934 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4f80b0000 msgr2=0x7ff4f81611c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:50.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.491+0000 7ff4fdf69640 1 --2- 172.21.15.18:0/506613934 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4f80b0000 0x7ff4f81611c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.491+0000 7ff4fdf69640 1 -- 172.21.15.18:0/506613934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4f80aecb0 msgr2=0x7ff4f8151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:50.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.491+0000 7ff4fdf69640 1 --2- 172.21.15.18:0/506613934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4f80aecb0 0x7ff4f8151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.491+0000 7ff4fdf69640 1 -- 172.21.15.18:0/506613934 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f815f360 con 0x7ff4f80ae840 2024-09-19T09:13:50.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.491+0000 7ff4fdf69640 1 --2- 172.21.15.18:0/506613934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4f80ae840 0x7ff4f80ce270 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff4f000c3c0 tx=0x7ff4f000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:50.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.491+0000 7ff4f67fc640 1 -- 172.21.15.18:0/506613934 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f00052d0 con 0x7ff4f80ae840 2024-09-19T09:13:50.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.491+0000 7ff4f67fc640 1 -- 172.21.15.18:0/506613934 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4f0005490 con 0x7ff4f80ae840 2024-09-19T09:13:50.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.491+0000 7ff5001cd640 1 -- 172.21.15.18:0/506613934 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4f80cfc20 con 0x7ff4f80ae840 2024-09-19T09:13:50.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.491+0000 7ff4f67fc640 1 -- 172.21.15.18:0/506613934 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4f0007260 con 0x7ff4f80ae840 2024-09-19T09:13:50.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.491+0000 7ff5001cd640 1 -- 172.21.15.18:0/506613934 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4f8161ed0 con 0x7ff4f80ae840 2024-09-19T09:13:50.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.492+0000 7ff5001cd640 1 -- 172.21.15.18:0/506613934 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4f80b03e0 con 0x7ff4f80ae840 2024-09-19T09:13:50.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.493+0000 7ff4f67fc640 1 -- 172.21.15.18:0/506613934 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff4f0007400 con 0x7ff4f80ae840 2024-09-19T09:13:50.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.493+0000 7ff4f67fc640 1 --2- 172.21.15.18:0/506613934 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff4e406c2b0 0x7ff4e406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:50.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.493+0000 7ff4f67fc640 1 -- 172.21.15.18:0/506613934 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff4f008a8d0 con 0x7ff4f80ae840 2024-09-19T09:13:50.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.493+0000 7ff4fd768640 1 --2- 172.21.15.18:0/506613934 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff4e406c2b0 0x7ff4e406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:50.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.494+0000 7ff4fd768640 1 --2- 172.21.15.18:0/506613934 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff4e406c2b0 0x7ff4e406e770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff4f80b0a80 tx=0x7ff4ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:50.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.498+0000 7ff4f67fc640 1 -- 172.21.15.18:0/506613934 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff4f0058950 con 0x7ff4f80ae840 2024-09-19T09:13:50.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.673+0000 7ff5001cd640 1 -- 172.21.15.18:0/506613934 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff4f815a570 con 0x7ff4f80ae840 2024-09-19T09:13:50.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.674+0000 7ff4f67fc640 1 -- 172.21.15.18:0/506613934 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7ff4f005cc50 con 0x7ff4f80ae840 2024-09-19T09:13:50.674 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-09-19T09:13:50.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.676+0000 7ff5001cd640 1 -- 172.21.15.18:0/506613934 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff4e406c2b0 msgr2=0x7ff4e406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:50.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.676+0000 7ff5001cd640 1 --2- 172.21.15.18:0/506613934 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff4e406c2b0 0x7ff4e406e770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff4f80b0a80 tx=0x7ff4ec008040 comp rx=0 tx=0).stop 2024-09-19T09:13:50.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.676+0000 7ff5001cd640 1 -- 172.21.15.18:0/506613934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4f80ae840 msgr2=0x7ff4f80ce270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:50.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.676+0000 7ff5001cd640 1 --2- 172.21.15.18:0/506613934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4f80ae840 0x7ff4f80ce270 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff4f000c3c0 tx=0x7ff4f000c880 comp rx=0 tx=0).stop 2024-09-19T09:13:50.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.676+0000 7ff5001cd640 1 -- 172.21.15.18:0/506613934 shutdown_connections 2024-09-19T09:13:50.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.676+0000 7ff5001cd640 1 --2- 172.21.15.18:0/506613934 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff4e406c2b0 0x7ff4e406e770 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.676+0000 7ff5001cd640 1 --2- 172.21.15.18:0/506613934 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4f80b0000 0x7ff4f81611c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.676+0000 7ff5001cd640 1 --2- 172.21.15.18:0/506613934 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4f80aecb0 0x7ff4f8151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.676+0000 7ff5001cd640 1 --2- 172.21.15.18:0/506613934 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4f80ae840 0x7ff4f80ce270 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.676+0000 7ff5001cd640 1 -- 172.21.15.18:0/506613934 >> 172.21.15.18:0/506613934 conn(0x7ff4f8072680 msgr2=0x7ff4f8072a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:50.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.676+0000 7ff5001cd640 1 -- 172.21.15.18:0/506613934 shutdown_connections 2024-09-19T09:13:50.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.676+0000 7ff5001cd640 1 -- 172.21.15.18:0/506613934 wait complete. 2024-09-19T09:13:50.687 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T09:13:50.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.792+0000 7f24366e6640 1 Processor -- start 2024-09-19T09:13:50.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.792+0000 7f24366e6640 1 -- start start 2024-09-19T09:13:50.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.793+0000 7f24366e6640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f243015ef00 0x7f24300cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:50.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.793+0000 7f24366e6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f24300d3240 0x7f24300cfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:50.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.793+0000 7f24366e6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24300d01f0 0x7f24300d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:50.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.793+0000 7f24366e6640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f24300d5ad0 con 0x7f24300d3240 2024-09-19T09:13:50.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.793+0000 7f24366e6640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f24300d3c90 con 0x7f243015ef00 2024-09-19T09:13:50.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.793+0000 7f24366e6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f24300b7fc0 con 0x7f24300d01f0 2024-09-19T09:13:50.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.793+0000 7f242f7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f24300d3240 0x7f24300cfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:50.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.793+0000 7f242f7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f24300d3240 0x7f24300cfcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36130/0 (socket says 172.21.15.18:36130) 2024-09-19T09:13:50.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.793+0000 7f242f7fe640 1 -- 172.21.15.18:0/33934150 learned_addr learned my addr 172.21.15.18:0/33934150 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:50.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.793+0000 7f242ffff640 1 --2- 172.21.15.18:0/33934150 >> v2:172.21.15.162:3300/0 conn(0x7f243015ef00 0x7f24300cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:50.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.793+0000 7f2434c83640 1 --2- 172.21.15.18:0/33934150 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24300d01f0 0x7f24300d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:50.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.793+0000 7f242f7fe640 1 -- 172.21.15.18:0/33934150 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24300d01f0 msgr2=0x7f24300d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:50.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.793+0000 7f242f7fe640 1 --2- 172.21.15.18:0/33934150 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24300d01f0 0x7f24300d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.793+0000 7f242f7fe640 1 -- 172.21.15.18:0/33934150 >> v2:172.21.15.162:3300/0 conn(0x7f243015ef00 msgr2=0x7f24300cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:50.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.793+0000 7f242f7fe640 1 --2- 172.21.15.18:0/33934150 >> v2:172.21.15.162:3300/0 conn(0x7f243015ef00 0x7f24300cf770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.793+0000 7f242f7fe640 1 -- 172.21.15.18:0/33934150 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24300d0660 con 0x7f24300d3240 2024-09-19T09:13:50.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.793+0000 7f242ffff640 1 --2- 172.21.15.18:0/33934150 >> v2:172.21.15.162:3300/0 conn(0x7f243015ef00 0x7f24300cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:13:50.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.794+0000 7f242f7fe640 1 --2- 172.21.15.18:0/33934150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24300d3240 0x7f24300cfcb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f24300b77f0 tx=0x7f242402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41c5b6eb2fc3f4f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:50.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.794+0000 7f242effd640 1 -- 172.21.15.18:0/33934150 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2424037070 con 0x7f24300d3240 2024-09-19T09:13:50.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.794+0000 7f242effd640 1 -- 172.21.15.18:0/33934150 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2424032440 con 0x7f24300d3240 2024-09-19T09:13:50.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.794+0000 7f242effd640 1 -- 172.21.15.18:0/33934150 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2424032810 con 0x7f24300d3240 2024-09-19T09:13:50.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.795+0000 7f24366e6640 1 -- 172.21.15.18:0/33934150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24300d3240 msgr2=0x7f24300cfcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:50.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.795+0000 7f24366e6640 1 --2- 172.21.15.18:0/33934150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24300d3240 0x7f24300cfcb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f24300b77f0 tx=0x7f242402a1e0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.795+0000 7f24366e6640 1 -- 172.21.15.18:0/33934150 shutdown_connections 2024-09-19T09:13:50.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.795+0000 7f24366e6640 1 --2- 172.21.15.18:0/33934150 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24300d01f0 0x7f24300d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.795+0000 7f24366e6640 1 --2- 172.21.15.18:0/33934150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24300d3240 0x7f24300cfcb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.795+0000 7f24366e6640 1 --2- 172.21.15.18:0/33934150 >> v2:172.21.15.162:3300/0 conn(0x7f243015ef00 0x7f24300cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.795+0000 7f24366e6640 1 -- 172.21.15.18:0/33934150 >> 172.21.15.18:0/33934150 conn(0x7f24300d4c60 msgr2=0x7f24300d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:50.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.795+0000 7f24366e6640 1 -- 172.21.15.18:0/33934150 shutdown_connections 2024-09-19T09:13:50.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.795+0000 7f24366e6640 1 -- 172.21.15.18:0/33934150 wait complete. 2024-09-19T09:13:50.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.796+0000 7f24366e6640 1 Processor -- start 2024-09-19T09:13:50.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.796+0000 7f24366e6640 1 -- start start 2024-09-19T09:13:50.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.797+0000 7f24366e6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24300d01f0 0x7f2430152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:50.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.797+0000 7f24366e6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f243015ef00 0x7f24300cb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:50.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.797+0000 7f24366e6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24300cb860 0x7f24300c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:50.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.797+0000 7f24366e6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f24300b7c50 con 0x7f243015ef00 2024-09-19T09:13:50.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.797+0000 7f24366e6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f24300d39b0 con 0x7f24300d01f0 2024-09-19T09:13:50.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.797+0000 7f24366e6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f24300d18e0 con 0x7f24300cb860 2024-09-19T09:13:50.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.797+0000 7f242f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f243015ef00 0x7f24300cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:50.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.797+0000 7f242f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f243015ef00 0x7f24300cb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36136/0 (socket says 172.21.15.18:36136) 2024-09-19T09:13:50.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.797+0000 7f242f7fe640 1 -- 172.21.15.18:0/1692456271 learned_addr learned my addr 172.21.15.18:0/1692456271 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:50.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.797+0000 7f242ffff640 1 --2- 172.21.15.18:0/1692456271 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24300d01f0 0x7f2430152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:50.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.798+0000 7f2434c83640 1 --2- 172.21.15.18:0/1692456271 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24300cb860 0x7f24300c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:50.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.798+0000 7f242f7fe640 1 -- 172.21.15.18:0/1692456271 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24300cb860 msgr2=0x7f24300c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:50.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.798+0000 7f242f7fe640 1 --2- 172.21.15.18:0/1692456271 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24300cb860 0x7f24300c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.798+0000 7f242f7fe640 1 -- 172.21.15.18:0/1692456271 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24300d01f0 msgr2=0x7f2430152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:50.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.798+0000 7f242f7fe640 1 --2- 172.21.15.18:0/1692456271 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24300d01f0 0x7f2430152260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.798+0000 7f242f7fe640 1 -- 172.21.15.18:0/1692456271 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24300cbdd0 con 0x7f243015ef00 2024-09-19T09:13:50.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.798+0000 7f242f7fe640 1 --2- 172.21.15.18:0/1692456271 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f243015ef00 0x7f24300cb320 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f242402a220 tx=0x7f24240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:50.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.798+0000 7f242cff9640 1 -- 172.21.15.18:0/1692456271 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2424037040 con 0x7f243015ef00 2024-09-19T09:13:50.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.798+0000 7f242cff9640 1 -- 172.21.15.18:0/1692456271 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2424042070 con 0x7f243015ef00 2024-09-19T09:13:50.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.798+0000 7f242cff9640 1 -- 172.21.15.18:0/1692456271 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2424030880 con 0x7f243015ef00 2024-09-19T09:13:50.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.798+0000 7f24366e6640 1 -- 172.21.15.18:0/1692456271 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24300ce750 con 0x7f243015ef00 2024-09-19T09:13:50.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.798+0000 7f24366e6640 1 -- 172.21.15.18:0/1692456271 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24300ced10 con 0x7f243015ef00 2024-09-19T09:13:50.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.799+0000 7f24366e6640 1 -- 172.21.15.18:0/1692456271 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24300cbfa0 con 0x7f243015ef00 2024-09-19T09:13:50.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.800+0000 7f242cff9640 1 -- 172.21.15.18:0/1692456271 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2424030a20 con 0x7f243015ef00 2024-09-19T09:13:50.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.800+0000 7f242cff9640 1 --2- 172.21.15.18:0/1692456271 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f241c06c2b0 0x7f241c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:50.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.800+0000 7f242cff9640 1 -- 172.21.15.18:0/1692456271 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f24240abcb0 con 0x7f243015ef00 2024-09-19T09:13:50.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.800+0000 7f242ffff640 1 --2- 172.21.15.18:0/1692456271 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f241c06c2b0 0x7f241c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:50.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.801+0000 7f242ffff640 1 --2- 172.21.15.18:0/1692456271 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f241c06c2b0 0x7f241c06e770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2420006fd0 tx=0x7f2420008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:50.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.804+0000 7f242cff9640 1 -- 172.21.15.18:0/1692456271 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f242407a420 con 0x7f243015ef00 2024-09-19T09:13:50.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.984+0000 7f24366e6640 1 -- 172.21.15.18:0/1692456271 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f24300d13a0 con 0x7f243015ef00 2024-09-19T09:13:50.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.984+0000 7f242cff9640 1 -- 172.21.15.18:0/1692456271 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) ==== 104+0+11 (secure 0 0 0) 0x7f2424079d20 con 0x7f243015ef00 2024-09-19T09:13:50.985 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 32 2024-09-19T09:13:50.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.986+0000 7f24366e6640 1 -- 172.21.15.18:0/1692456271 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f241c06c2b0 msgr2=0x7f241c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:50.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.986+0000 7f24366e6640 1 --2- 172.21.15.18:0/1692456271 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f241c06c2b0 0x7f241c06e770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2420006fd0 tx=0x7f2420008040 comp rx=0 tx=0).stop 2024-09-19T09:13:50.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.986+0000 7f24366e6640 1 -- 172.21.15.18:0/1692456271 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f243015ef00 msgr2=0x7f24300cb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:50.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.986+0000 7f24366e6640 1 --2- 172.21.15.18:0/1692456271 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f243015ef00 0x7f24300cb320 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f242402a220 tx=0x7f24240046c0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.987+0000 7f24366e6640 1 -- 172.21.15.18:0/1692456271 shutdown_connections 2024-09-19T09:13:50.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.987+0000 7f24366e6640 1 --2- 172.21.15.18:0/1692456271 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f241c06c2b0 0x7f241c06e770 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.987+0000 7f24366e6640 1 --2- 172.21.15.18:0/1692456271 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24300cb860 0x7f24300c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.987+0000 7f24366e6640 1 --2- 172.21.15.18:0/1692456271 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f243015ef00 0x7f24300cb320 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.987+0000 7f24366e6640 1 --2- 172.21.15.18:0/1692456271 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24300d01f0 0x7f2430152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:50.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.987+0000 7f24366e6640 1 -- 172.21.15.18:0/1692456271 >> 172.21.15.18:0/1692456271 conn(0x7f24300d4c60 msgr2=0x7f24300b9170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:50.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.987+0000 7f24366e6640 1 -- 172.21.15.18:0/1692456271 shutdown_connections 2024-09-19T09:13:50.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:50.987+0000 7f24366e6640 1 -- 172.21.15.18:0/1692456271 wait complete. 2024-09-19T09:13:50.998 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T09:13:51.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.102+0000 7fb958e27640 1 Processor -- start 2024-09-19T09:13:51.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.102+0000 7fb958e27640 1 -- start start 2024-09-19T09:13:51.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.103+0000 7fb958e27640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb9541623c0 0x7fb9540b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:51.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.103+0000 7fb958e27640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9540d3700 con 0x7fb9540d56b0 2024-09-19T09:13:51.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.103+0000 7fb958e27640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9540cfa70 con 0x7fb9540d1470 2024-09-19T09:13:51.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.103+0000 7fb958e27640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fb9540d21a0 con 0x7fb9541623c0 2024-09-19T09:13:51.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.104+0000 7fb95259c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb9541623c0 0x7fb9540b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:51.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.104+0000 7fb95259c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb9541623c0 0x7fb9540b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36142/0 (socket says 172.21.15.18:36142) 2024-09-19T09:13:51.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.104+0000 7fb951d9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb9540d56b0 0x7fb9540d0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:45400/0 (socket says 172.21.15.18:45400) 2024-09-19T09:13:51.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.104+0000 7fb95259c640 1 -- 172.21.15.18:0/985354706 learned_addr learned my addr 172.21.15.18:0/985354706 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:51.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.104+0000 7fb95259c640 1 -- 172.21.15.18:0/985354706 >> v1:172.21.15.162:6789/0 conn(0x7fb9540d1470 legacy=0x7fb9540b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:51.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.104+0000 7fb95259c640 1 -- 172.21.15.18:0/985354706 >> v1:172.21.15.18:6789/0 conn(0x7fb9540d56b0 legacy=0x7fb9540d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:51.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.104+0000 7fb95259c640 1 -- 172.21.15.18:0/985354706 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9540d0c20 con 0x7fb9541623c0 2024-09-19T09:13:51.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.105+0000 7fb95259c640 1 --2- 172.21.15.18:0/985354706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9541623c0 0x7fb9540b6260 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb95408daf0 tx=0x7fb94c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb64e4f34c61622 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:51.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.105+0000 7fb95159a640 1 -- 172.21.15.18:0/985354706 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c036070 con 0x7fb9541623c0 2024-09-19T09:13:51.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.105+0000 7fb95159a640 1 -- 172.21.15.18:0/985354706 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb94c031600 con 0x7fb9541623c0 2024-09-19T09:13:51.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.105+0000 7fb95159a640 1 -- 172.21.15.18:0/985354706 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c0319d0 con 0x7fb9541623c0 2024-09-19T09:13:51.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.105+0000 7fb958e27640 1 -- 172.21.15.18:0/985354706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9541623c0 msgr2=0x7fb9540b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:51.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.105+0000 7fb958e27640 1 --2- 172.21.15.18:0/985354706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9541623c0 0x7fb9540b6260 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb95408daf0 tx=0x7fb94c02a730 comp rx=0 tx=0).stop 2024-09-19T09:13:51.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.105+0000 7fb958e27640 1 -- 172.21.15.18:0/985354706 shutdown_connections 2024-09-19T09:13:51.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.105+0000 7fb958e27640 1 --2- 172.21.15.18:0/985354706 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9541623c0 0x7fb9540b6260 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:51.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.105+0000 7fb958e27640 1 -- 172.21.15.18:0/985354706 >> 172.21.15.18:0/985354706 conn(0x7fb95409df30 msgr2=0x7fb9540d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:51.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.105+0000 7fb958e27640 1 -- 172.21.15.18:0/985354706 shutdown_connections 2024-09-19T09:13:51.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.105+0000 7fb958e27640 1 -- 172.21.15.18:0/985354706 wait complete. 2024-09-19T09:13:51.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.107+0000 7fb958e27640 1 Processor -- start 2024-09-19T09:13:51.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.107+0000 7fb958e27640 1 -- start start 2024-09-19T09:13:51.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.107+0000 7fb958e27640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9540d1470 0x7fb954158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:51.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.107+0000 7fb958e27640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9540d56b0 0x7fb9541591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:51.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.107+0000 7fb958e27640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9541623c0 0x7fb9540b9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:51.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.107+0000 7fb958e27640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb9540cfd10 con 0x7fb9540d1470 2024-09-19T09:13:51.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.107+0000 7fb958e27640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb9540d0080 con 0x7fb9540d56b0 2024-09-19T09:13:51.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.107+0000 7fb958e27640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb9541627a0 con 0x7fb9541623c0 2024-09-19T09:13:51.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.108+0000 7fb95259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9540d1470 0x7fb954158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:51.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.108+0000 7fb95259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9540d1470 0x7fb954158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36154/0 (socket says 172.21.15.18:36154) 2024-09-19T09:13:51.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.108+0000 7fb95259c640 1 -- 172.21.15.18:0/1175680778 learned_addr learned my addr 172.21.15.18:0/1175680778 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:51.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.108+0000 7fb951d9b640 1 --2- 172.21.15.18:0/1175680778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9540d56b0 0x7fb9541591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:51.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.108+0000 7fb952d9d640 1 --2- 172.21.15.18:0/1175680778 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9541623c0 0x7fb9540b9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:51.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.108+0000 7fb95259c640 1 -- 172.21.15.18:0/1175680778 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9541623c0 msgr2=0x7fb9540b9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:51.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.108+0000 7fb95259c640 1 --2- 172.21.15.18:0/1175680778 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9541623c0 0x7fb9540b9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:51.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.108+0000 7fb95259c640 1 -- 172.21.15.18:0/1175680778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9540d56b0 msgr2=0x7fb9541591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:51.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.108+0000 7fb95259c640 1 --2- 172.21.15.18:0/1175680778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9540d56b0 0x7fb9541591c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:51.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.108+0000 7fb95259c640 1 -- 172.21.15.18:0/1175680778 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb954159ac0 con 0x7fb9540d1470 2024-09-19T09:13:51.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.108+0000 7fb952d9d640 1 --2- 172.21.15.18:0/1175680778 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9541623c0 0x7fb9540b9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:13:51.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.108+0000 7fb95259c640 1 --2- 172.21.15.18:0/1175680778 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9540d1470 0x7fb954158200 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb94c000f80 tx=0x7fb94c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:51.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.108+0000 7fb94affd640 1 -- 172.21.15.18:0/1175680778 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c041020 con 0x7fb9540d1470 2024-09-19T09:13:51.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.108+0000 7fb94affd640 1 -- 172.21.15.18:0/1175680778 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb94c007820 con 0x7fb9540d1470 2024-09-19T09:13:51.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.108+0000 7fb958e27640 1 -- 172.21.15.18:0/1175680778 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9540c9b10 con 0x7fb9540d1470 2024-09-19T09:13:51.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.108+0000 7fb94affd640 1 -- 172.21.15.18:0/1175680778 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c036040 con 0x7fb9540d1470 2024-09-19T09:13:51.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.108+0000 7fb958e27640 1 -- 172.21.15.18:0/1175680778 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9540ca0d0 con 0x7fb9540d1470 2024-09-19T09:13:51.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.109+0000 7fb958e27640 1 -- 172.21.15.18:0/1175680778 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9540d3c80 con 0x7fb9540d1470 2024-09-19T09:13:51.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.110+0000 7fb94affd640 1 -- 172.21.15.18:0/1175680778 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb94c044020 con 0x7fb9540d1470 2024-09-19T09:13:51.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.110+0000 7fb94affd640 1 --2- 172.21.15.18:0/1175680778 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb93406c2b0 0x7fb93406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:51.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.111+0000 7fb94affd640 1 -- 172.21.15.18:0/1175680778 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fb94c0ac1c0 con 0x7fb9540d1470 2024-09-19T09:13:51.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.111+0000 7fb951d9b640 1 --2- 172.21.15.18:0/1175680778 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb93406c2b0 0x7fb93406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:51.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.111+0000 7fb951d9b640 1 --2- 172.21.15.18:0/1175680778 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb93406c2b0 0x7fb93406e770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb95415bf70 tx=0x7fb93c007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:51.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.115+0000 7fb94affd640 1 -- 172.21.15.18:0/1175680778 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb94c04b030 con 0x7fb9540d1470 2024-09-19T09:13:51.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.292+0000 7fb958e27640 1 -- 172.21.15.18:0/1175680778 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb95415fd30 con 0x7fb9540d1470 2024-09-19T09:13:51.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.292+0000 7fb94affd640 1 -- 172.21.15.18:0/1175680778 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) ==== 100+0+11 (secure 0 0 0) 0x7fb94c07a930 con 0x7fb9540d1470 2024-09-19T09:13:51.293 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 64 2024-09-19T09:13:51.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.294+0000 7fb958e27640 1 -- 172.21.15.18:0/1175680778 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb93406c2b0 msgr2=0x7fb93406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:51.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.294+0000 7fb958e27640 1 --2- 172.21.15.18:0/1175680778 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb93406c2b0 0x7fb93406e770 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb95415bf70 tx=0x7fb93c007e80 comp rx=0 tx=0).stop 2024-09-19T09:13:51.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.295+0000 7fb958e27640 1 -- 172.21.15.18:0/1175680778 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9540d1470 msgr2=0x7fb954158200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:51.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.295+0000 7fb958e27640 1 --2- 172.21.15.18:0/1175680778 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9540d1470 0x7fb954158200 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb94c000f80 tx=0x7fb94c004a40 comp rx=0 tx=0).stop 2024-09-19T09:13:51.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.295+0000 7fb958e27640 1 -- 172.21.15.18:0/1175680778 shutdown_connections 2024-09-19T09:13:51.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.295+0000 7fb958e27640 1 --2- 172.21.15.18:0/1175680778 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb93406c2b0 0x7fb93406e770 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:51.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.295+0000 7fb958e27640 1 --2- 172.21.15.18:0/1175680778 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9541623c0 0x7fb9540b9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:51.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.295+0000 7fb958e27640 1 --2- 172.21.15.18:0/1175680778 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9540d56b0 0x7fb9541591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:51.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.295+0000 7fb958e27640 1 --2- 172.21.15.18:0/1175680778 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9540d1470 0x7fb954158200 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:51.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.295+0000 7fb958e27640 1 -- 172.21.15.18:0/1175680778 >> 172.21.15.18:0/1175680778 conn(0x7fb95409df30 msgr2=0x7fb9540b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:51.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.295+0000 7fb958e27640 1 -- 172.21.15.18:0/1175680778 shutdown_connections 2024-09-19T09:13:51.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.295+0000 7fb958e27640 1 -- 172.21.15.18:0/1175680778 wait complete. 2024-09-19T09:13:51.306 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2024-09-19T09:13:51.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.407+0000 7f5b8be65640 1 Processor -- start 2024-09-19T09:13:51.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.408+0000 7f5b8be65640 1 -- start start 2024-09-19T09:13:51.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.408+0000 7f5b8be65640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b8415ecc0 0x7f5b840d3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:51.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.408+0000 7f5b8be65640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5b840d1b60 0x7f5b840b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:51.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.408+0000 7f5b8be65640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b840d3b20 con 0x7f5b840d57a0 2024-09-19T09:13:51.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.408+0000 7f5b8be65640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f5b840b42f0 con 0x7f5b840d1b60 2024-09-19T09:13:51.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.408+0000 7f5b8be65640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5b840b45d0 con 0x7f5b8415ecc0 2024-09-19T09:13:51.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.409+0000 7f5b89400640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f5b840d57a0 0x7f5b840d1450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:58124/0 (socket says 172.21.15.18:58124) 2024-09-19T09:13:51.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.409+0000 7f5b89400640 1 -- 172.21.15.18:0/1079215539 learned_addr learned my addr 172.21.15.18:0/1079215539 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:51.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.409+0000 7f5b89c01640 1 --2- 172.21.15.18:0/1079215539 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b8415ecc0 0x7f5b840d3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:51.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.409+0000 7f5b8a402640 1 --2- 172.21.15.18:0/1079215539 >> v2:172.21.15.162:3300/0 conn(0x7f5b840d1b60 0x7f5b840b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:51.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.409+0000 7f5b88bff640 1 -- 172.21.15.18:0/1079215539 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1338633000 0 0) 0x7f5b840d3b20 con 0x7f5b840d57a0 2024-09-19T09:13:51.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.409+0000 7f5b88bff640 1 -- 172.21.15.18:0/1079215539 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b6c003520 con 0x7f5b840d57a0 2024-09-19T09:13:51.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.409+0000 7f5b89c01640 1 -- 172.21.15.18:0/1079215539 >> v2:172.21.15.162:3300/0 conn(0x7f5b840d1b60 msgr2=0x7f5b840b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:51.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.409+0000 7f5b89c01640 1 --2- 172.21.15.18:0/1079215539 >> v2:172.21.15.162:3300/0 conn(0x7f5b840d1b60 0x7f5b840b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:51.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.409+0000 7f5b89c01640 1 -- 172.21.15.18:0/1079215539 >> v1:172.21.15.162:6789/0 conn(0x7f5b840d57a0 legacy=0x7f5b840d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:51.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.409+0000 7f5b89c01640 1 -- 172.21.15.18:0/1079215539 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b840b48b0 con 0x7f5b8415ecc0 2024-09-19T09:13:51.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.409+0000 7f5b8a402640 1 --2- 172.21.15.18:0/1079215539 >> v2:172.21.15.162:3300/0 conn(0x7f5b840d1b60 0x7f5b840b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:13:51.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.410+0000 7f5b89c01640 1 --2- 172.21.15.18:0/1079215539 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b8415ecc0 0x7f5b840d3170 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0097a0 tx=0x7f5b7c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c10f37f2980adbd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:51.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.410+0000 7f5b88bff640 1 -- 172.21.15.18:0/1079215539 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c037070 con 0x7f5b8415ecc0 2024-09-19T09:13:51.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.410+0000 7f5b88bff640 1 -- 172.21.15.18:0/1079215539 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b7c032440 con 0x7f5b8415ecc0 2024-09-19T09:13:51.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.410+0000 7f5b88bff640 1 -- 172.21.15.18:0/1079215539 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c0327f0 con 0x7f5b8415ecc0 2024-09-19T09:13:51.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.411+0000 7f5b8be65640 1 -- 172.21.15.18:0/1079215539 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b8415ecc0 msgr2=0x7f5b840d3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:51.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.411+0000 7f5b8be65640 1 --2- 172.21.15.18:0/1079215539 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b8415ecc0 0x7f5b840d3170 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0097a0 tx=0x7f5b7c02a180 comp rx=0 tx=0).stop 2024-09-19T09:13:51.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.411+0000 7f5b8be65640 1 -- 172.21.15.18:0/1079215539 shutdown_connections 2024-09-19T09:13:51.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.411+0000 7f5b8be65640 1 --2- 172.21.15.18:0/1079215539 >> v2:172.21.15.162:3300/0 conn(0x7f5b840d1b60 0x7f5b840b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:51.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.411+0000 7f5b8be65640 1 --2- 172.21.15.18:0/1079215539 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b8415ecc0 0x7f5b840d3170 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:51.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.411+0000 7f5b8be65640 1 -- 172.21.15.18:0/1079215539 >> 172.21.15.18:0/1079215539 conn(0x7f5b840d4bd0 msgr2=0x7f5b840d4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:51.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.411+0000 7f5b8be65640 1 -- 172.21.15.18:0/1079215539 shutdown_connections 2024-09-19T09:13:51.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.411+0000 7f5b8be65640 1 -- 172.21.15.18:0/1079215539 wait complete. 2024-09-19T09:13:51.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.412+0000 7f5b8be65640 1 Processor -- start 2024-09-19T09:13:51.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.412+0000 7f5b8be65640 1 -- start start 2024-09-19T09:13:51.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.413+0000 7f5b8be65640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b840d1b60 0x7f5b840ce790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:51.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.413+0000 7f5b8be65640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b840d57a0 0x7f5b841550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:51.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.413+0000 7f5b8be65640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b8415ecc0 0x7f5b840cace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:51.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.413+0000 7f5b8be65640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8415f220 con 0x7f5b8415ecc0 2024-09-19T09:13:51.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.413+0000 7f5b8be65640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8415f0a0 con 0x7f5b840d1b60 2024-09-19T09:13:51.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.413+0000 7f5b8be65640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5b840d36b0 con 0x7f5b840d57a0 2024-09-19T09:13:51.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.413+0000 7f5b8a402640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b8415ecc0 0x7f5b840cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:51.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.413+0000 7f5b8a402640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b8415ecc0 0x7f5b840cace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36156/0 (socket says 172.21.15.18:36156) 2024-09-19T09:13:51.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.413+0000 7f5b8a402640 1 -- 172.21.15.18:0/2665268290 learned_addr learned my addr 172.21.15.18:0/2665268290 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:51.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.413+0000 7f5b89c01640 1 --2- 172.21.15.18:0/2665268290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b840d1b60 0x7f5b840ce790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:51.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.413+0000 7f5b89400640 1 --2- 172.21.15.18:0/2665268290 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b840d57a0 0x7f5b841550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:51.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.414+0000 7f5b8a402640 1 -- 172.21.15.18:0/2665268290 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b840d57a0 msgr2=0x7f5b841550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:51.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.414+0000 7f5b8a402640 1 --2- 172.21.15.18:0/2665268290 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b840d57a0 0x7f5b841550e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:51.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.414+0000 7f5b8a402640 1 -- 172.21.15.18:0/2665268290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b840d1b60 msgr2=0x7f5b840ce790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:51.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.414+0000 7f5b8a402640 1 --2- 172.21.15.18:0/2665268290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b840d1b60 0x7f5b840ce790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:51.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.414+0000 7f5b8a402640 1 -- 172.21.15.18:0/2665268290 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b84155620 con 0x7f5b8415ecc0 2024-09-19T09:13:51.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.414+0000 7f5b8a402640 1 --2- 172.21.15.18:0/2665268290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b8415ecc0 0x7f5b840cace0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5b7400efb0 tx=0x7f5b7400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:51.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.414+0000 7f5b827fc640 1 -- 172.21.15.18:0/2665268290 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b74018020 con 0x7f5b8415ecc0 2024-09-19T09:13:51.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.414+0000 7f5b827fc640 1 -- 172.21.15.18:0/2665268290 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b74014480 con 0x7f5b8415ecc0 2024-09-19T09:13:51.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.414+0000 7f5b827fc640 1 -- 172.21.15.18:0/2665268290 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b74014850 con 0x7f5b8415ecc0 2024-09-19T09:13:51.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.414+0000 7f5b8be65640 1 -- 172.21.15.18:0/2665268290 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b840cde00 con 0x7f5b8415ecc0 2024-09-19T09:13:51.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.414+0000 7f5b8be65640 1 -- 172.21.15.18:0/2665268290 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b840b8bf0 con 0x7f5b8415ecc0 2024-09-19T09:13:51.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.415+0000 7f5b8be65640 1 -- 172.21.15.18:0/2665268290 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b840cd010 con 0x7f5b8415ecc0 2024-09-19T09:13:51.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.416+0000 7f5b827fc640 1 -- 172.21.15.18:0/2665268290 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5b74005d10 con 0x7f5b8415ecc0 2024-09-19T09:13:51.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.416+0000 7f5b827fc640 1 --2- 172.21.15.18:0/2665268290 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5b7006c2e0 0x7f5b7006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:51.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.416+0000 7f5b827fc640 1 -- 172.21.15.18:0/2665268290 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f5b7408c030 con 0x7f5b8415ecc0 2024-09-19T09:13:51.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.416+0000 7f5b89c01640 1 --2- 172.21.15.18:0/2665268290 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5b7006c2e0 0x7f5b7006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:51.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.417+0000 7f5b89c01640 1 --2- 172.21.15.18:0/2665268290 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5b7006c2e0 0x7f5b7006e7a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c034000 tx=0x7f5b7c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:51.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.421+0000 7f5b827fc640 1 -- 172.21.15.18:0/2665268290 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5b74022030 con 0x7f5b8415ecc0 2024-09-19T09:13:51.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:51.666+0000 7f5b8be65640 1 -- 172.21.15.18:0/2665268290 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) -- 0x7f5b840ce320 con 0x7f5b8415ecc0 2024-09-19T09:13:52.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.632+0000 7f5b827fc640 1 -- 172.21.15.18:0/2665268290 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v41) ==== 133+0+0 (secure 0 0 0) 0x7f5b840ce320 con 0x7f5b8415ecc0 2024-09-19T09:13:52.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.635+0000 7f5b8be65640 1 -- 172.21.15.18:0/2665268290 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5b7006c2e0 msgr2=0x7f5b7006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:52.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.635+0000 7f5b8be65640 1 --2- 172.21.15.18:0/2665268290 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5b7006c2e0 0x7f5b7006e7a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c034000 tx=0x7f5b7c02e000 comp rx=0 tx=0).stop 2024-09-19T09:13:52.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.635+0000 7f5b8be65640 1 -- 172.21.15.18:0/2665268290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b8415ecc0 msgr2=0x7f5b840cace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:52.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.635+0000 7f5b8be65640 1 --2- 172.21.15.18:0/2665268290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b8415ecc0 0x7f5b840cace0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5b7400efb0 tx=0x7f5b7400c490 comp rx=0 tx=0).stop 2024-09-19T09:13:52.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.635+0000 7f5b8be65640 1 -- 172.21.15.18:0/2665268290 shutdown_connections 2024-09-19T09:13:52.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.635+0000 7f5b8be65640 1 --2- 172.21.15.18:0/2665268290 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5b7006c2e0 0x7f5b7006e7a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:52.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.635+0000 7f5b8be65640 1 --2- 172.21.15.18:0/2665268290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b8415ecc0 0x7f5b840cace0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:52.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.635+0000 7f5b8be65640 1 --2- 172.21.15.18:0/2665268290 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b840d57a0 0x7f5b841550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:52.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.635+0000 7f5b8be65640 1 --2- 172.21.15.18:0/2665268290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b840d1b60 0x7f5b840ce790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:52.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.635+0000 7f5b8be65640 1 -- 172.21.15.18:0/2665268290 >> 172.21.15.18:0/2665268290 conn(0x7f5b840d4bd0 msgr2=0x7f5b840b3170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:52.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.635+0000 7f5b8be65640 1 -- 172.21.15.18:0/2665268290 shutdown_connections 2024-09-19T09:13:52.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.635+0000 7f5b8be65640 1 -- 172.21.15.18:0/2665268290 wait complete. 2024-09-19T09:13:52.649 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2024-09-19T09:13:52.770 INFO:teuthology.orchestra.run.smithi018.stdout:{"osd_objectstore":"memstore"} 2024-09-19T09:13:52.771 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2024-09-19T09:13:52.771 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-19T09:13:52.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.878+0000 7f817f5cf640 1 Processor -- start 2024-09-19T09:13:52.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.878+0000 7f817f5cf640 1 -- start start 2024-09-19T09:13:52.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.879+0000 7f817f5cf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81780d1920 0x7f81780b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:52.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.879+0000 7f817f5cf640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81780d3270 con 0x7f81780d14e0 2024-09-19T09:13:52.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.879+0000 7f817f5cf640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81780d34e0 con 0x7f817815ede0 2024-09-19T09:13:52.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.879+0000 7f817f5cf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f81780d37c0 con 0x7f81780d1920 2024-09-19T09:13:52.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.879+0000 7f817cb6a640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f81780d14e0 0x7f81780b47e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:45410/0 (socket says 172.21.15.18:45410) 2024-09-19T09:13:52.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.879+0000 7f817cb6a640 1 -- 172.21.15.18:0/3607833347 learned_addr learned my addr 172.21.15.18:0/3607833347 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:52.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.879+0000 7f817db6c640 1 --2- 172.21.15.18:0/3607833347 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81780d1920 0x7f81780b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:52.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.879+0000 7f816ffff640 1 -- 172.21.15.18:0/3607833347 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2550178813 0 0) 0x7f81780d3270 con 0x7f81780d14e0 2024-09-19T09:13:52.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.879+0000 7f816ffff640 1 -- 172.21.15.18:0/3607833347 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8164003520 con 0x7f81780d14e0 2024-09-19T09:13:52.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.879+0000 7f816ffff640 1 -- 172.21.15.18:0/3607833347 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3491054286 0 0) 0x7f81780d34e0 con 0x7f817815ede0 2024-09-19T09:13:52.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.879+0000 7f816ffff640 1 -- 172.21.15.18:0/3607833347 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81780d3270 con 0x7f817815ede0 2024-09-19T09:13:52.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.879+0000 7f817db6c640 1 -- 172.21.15.18:0/3607833347 >> v1:172.21.15.162:6789/0 conn(0x7f817815ede0 legacy=0x7f81780d5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:52.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.879+0000 7f817db6c640 1 -- 172.21.15.18:0/3607833347 >> v1:172.21.15.18:6789/0 conn(0x7f81780d14e0 legacy=0x7f81780b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:52.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.879+0000 7f817db6c640 1 -- 172.21.15.18:0/3607833347 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81780d3aa0 con 0x7f81780d1920 2024-09-19T09:13:52.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.880+0000 7f817db6c640 1 --2- 172.21.15.18:0/3607833347 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81780d1920 0x7f81780b4ef0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8170009dc0 tx=0x7f817002a760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fe5a6299c6ba3a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:52.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.880+0000 7f816ffff640 1 -- 172.21.15.18:0/3607833347 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8170007740 con 0x7f81780d1920 2024-09-19T09:13:52.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.880+0000 7f816ffff640 1 -- 172.21.15.18:0/3607833347 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81700078e0 con 0x7f81780d1920 2024-09-19T09:13:52.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.880+0000 7f816ffff640 1 -- 172.21.15.18:0/3607833347 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8170007c90 con 0x7f81780d1920 2024-09-19T09:13:52.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.881+0000 7f817f5cf640 1 -- 172.21.15.18:0/3607833347 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81780d1920 msgr2=0x7f81780b4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:52.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.881+0000 7f817f5cf640 1 --2- 172.21.15.18:0/3607833347 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81780d1920 0x7f81780b4ef0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8170009dc0 tx=0x7f817002a760 comp rx=0 tx=0).stop 2024-09-19T09:13:52.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.881+0000 7f817f5cf640 1 -- 172.21.15.18:0/3607833347 shutdown_connections 2024-09-19T09:13:52.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.881+0000 7f817f5cf640 1 --2- 172.21.15.18:0/3607833347 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81780d1920 0x7f81780b4ef0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:52.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.881+0000 7f817f5cf640 1 -- 172.21.15.18:0/3607833347 >> 172.21.15.18:0/3607833347 conn(0x7f817809df30 msgr2=0x7f81780d4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:52.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.881+0000 7f817f5cf640 1 -- 172.21.15.18:0/3607833347 shutdown_connections 2024-09-19T09:13:52.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.881+0000 7f817f5cf640 1 -- 172.21.15.18:0/3607833347 wait complete. 2024-09-19T09:13:52.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.882+0000 7f817f5cf640 1 Processor -- start 2024-09-19T09:13:52.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.882+0000 7f817f5cf640 1 -- start start 2024-09-19T09:13:52.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.883+0000 7f817f5cf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81780d14e0 0x7f81780b8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:52.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.883+0000 7f817f5cf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81780d1920 0x7f8178155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:52.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.883+0000 7f817f5cf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f817815ede0 0x7f81781609c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:52.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.883+0000 7f817f5cf640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f81780d5a10 con 0x7f81780d1920 2024-09-19T09:13:52.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.883+0000 7f817f5cf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f817815f1c0 con 0x7f81780d14e0 2024-09-19T09:13:52.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.883+0000 7f817f5cf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f81780b4020 con 0x7f817815ede0 2024-09-19T09:13:52.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.883+0000 7f817cb6a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81780d1920 0x7f8178155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:52.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.883+0000 7f817cb6a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81780d1920 0x7f8178155ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36160/0 (socket says 172.21.15.18:36160) 2024-09-19T09:13:52.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.883+0000 7f817cb6a640 1 -- 172.21.15.18:0/2784605242 learned_addr learned my addr 172.21.15.18:0/2784605242 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:52.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.883+0000 7f817cb6a640 1 -- 172.21.15.18:0/2784605242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f817815ede0 msgr2=0x7f81781609c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:52.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.883+0000 7f817db6c640 1 --2- 172.21.15.18:0/2784605242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f817815ede0 0x7f81781609c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:52.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.883+0000 7f817cb6a640 1 --2- 172.21.15.18:0/2784605242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f817815ede0 0x7f81781609c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:52.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.883+0000 7f817d36b640 1 --2- 172.21.15.18:0/2784605242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81780d14e0 0x7f81780b8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:52.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.883+0000 7f817cb6a640 1 -- 172.21.15.18:0/2784605242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81780d14e0 msgr2=0x7f81780b8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:52.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.883+0000 7f817cb6a640 1 --2- 172.21.15.18:0/2784605242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81780d14e0 0x7f81780b8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:52.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.883+0000 7f817cb6a640 1 -- 172.21.15.18:0/2784605242 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81780b8970 con 0x7f81780d1920 2024-09-19T09:13:52.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.883+0000 7f817db6c640 1 --2- 172.21.15.18:0/2784605242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f817815ede0 0x7f81781609c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:13:52.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.883+0000 7f817d36b640 1 --2- 172.21.15.18:0/2784605242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81780d14e0 0x7f81780b8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:13:52.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.884+0000 7f817cb6a640 1 --2- 172.21.15.18:0/2784605242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81780d1920 0x7f8178155ce0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f816800c4d0 tx=0x7f816800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:52.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.884+0000 7f816dffb640 1 -- 172.21.15.18:0/2784605242 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8168017070 con 0x7f81780d1920 2024-09-19T09:13:52.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.884+0000 7f816dffb640 1 -- 172.21.15.18:0/2784605242 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8168005ce0 con 0x7f81780d1920 2024-09-19T09:13:52.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.884+0000 7f817f5cf640 1 -- 172.21.15.18:0/2784605242 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81780b8c10 con 0x7f81780d1920 2024-09-19T09:13:52.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.884+0000 7f816dffb640 1 -- 172.21.15.18:0/2784605242 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8168007270 con 0x7f81780d1920 2024-09-19T09:13:52.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.884+0000 7f817f5cf640 1 -- 172.21.15.18:0/2784605242 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81780b91d0 con 0x7f81780d1920 2024-09-19T09:13:52.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.885+0000 7f817f5cf640 1 -- 172.21.15.18:0/2784605242 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f817815f340 con 0x7f81780d1920 2024-09-19T09:13:52.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.885+0000 7f816dffb640 1 -- 172.21.15.18:0/2784605242 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f816801a070 con 0x7f81780d1920 2024-09-19T09:13:52.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.886+0000 7f816dffb640 1 --2- 172.21.15.18:0/2784605242 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f815c06c2b0 0x7f815c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:52.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.886+0000 7f816dffb640 1 -- 172.21.15.18:0/2784605242 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f816808a640 con 0x7f81780d1920 2024-09-19T09:13:52.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.886+0000 7f817d36b640 1 --2- 172.21.15.18:0/2784605242 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f815c06c2b0 0x7f815c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:52.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.887+0000 7f817d36b640 1 --2- 172.21.15.18:0/2784605242 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f815c06c2b0 0x7f815c06e770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f817815e6d0 tx=0x7f8174009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:52.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:52.890+0000 7f816dffb640 1 -- 172.21.15.18:0/2784605242 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f81680587f0 con 0x7f81780d1920 2024-09-19T09:13:53.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.066+0000 7f817f5cf640 1 -- 172.21.15.18:0/2784605242 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f81780d5300 con 0x7f81780d1920 2024-09-19T09:13:53.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.069+0000 7f816dffb640 1 -- 172.21.15.18:0/2784605242 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) ==== 122+0+0 (secure 0 0 0) 0x7f816805caf0 con 0x7f81780d1920 2024-09-19T09:13:53.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.071+0000 7f817f5cf640 1 -- 172.21.15.18:0/2784605242 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f815c06c2b0 msgr2=0x7f815c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:53.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.071+0000 7f817f5cf640 1 --2- 172.21.15.18:0/2784605242 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f815c06c2b0 0x7f815c06e770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f817815e6d0 tx=0x7f8174009040 comp rx=0 tx=0).stop 2024-09-19T09:13:53.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.071+0000 7f817f5cf640 1 -- 172.21.15.18:0/2784605242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81780d1920 msgr2=0x7f8178155ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:53.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.071+0000 7f817f5cf640 1 --2- 172.21.15.18:0/2784605242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81780d1920 0x7f8178155ce0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f816800c4d0 tx=0x7f816800c990 comp rx=0 tx=0).stop 2024-09-19T09:13:53.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.071+0000 7f817f5cf640 1 -- 172.21.15.18:0/2784605242 shutdown_connections 2024-09-19T09:13:53.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.071+0000 7f817f5cf640 1 --2- 172.21.15.18:0/2784605242 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f815c06c2b0 0x7f815c06e770 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:53.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.071+0000 7f817f5cf640 1 --2- 172.21.15.18:0/2784605242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f817815ede0 0x7f81781609c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:53.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.071+0000 7f817f5cf640 1 --2- 172.21.15.18:0/2784605242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81780d1920 0x7f8178155ce0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:53.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.071+0000 7f817f5cf640 1 --2- 172.21.15.18:0/2784605242 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81780d14e0 0x7f81780b8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:53.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.071+0000 7f817f5cf640 1 -- 172.21.15.18:0/2784605242 >> 172.21.15.18:0/2784605242 conn(0x7f817809df30 msgr2=0x7f81780b4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:53.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.071+0000 7f817f5cf640 1 -- 172.21.15.18:0/2784605242 shutdown_connections 2024-09-19T09:13:53.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.071+0000 7f817f5cf640 1 -- 172.21.15.18:0/2784605242 wait complete. 2024-09-19T09:13:53.083 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T09:13:53.083 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:13:53.128 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:13:53.175 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T09:13:53.176 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:13:53.176 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:13:53.192 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:13:53.192 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:13:53.249 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:13:53.249 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:13:53.306 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T09:13:53.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.449+0000 7f246c3fd640 1 Processor -- start 2024-09-19T09:13:53.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.449+0000 7f246c3fd640 1 -- start start 2024-09-19T09:13:53.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.450+0000 7f246c3fd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f24640ba7e0 0x7f24640d0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:53.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.450+0000 7f246c3fd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f24640d3400 0x7f24641618f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:53.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.450+0000 7f246c3fd640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24640d0aa0 con 0x7f24640d5870 2024-09-19T09:13:53.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.450+0000 7f246c3fd640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f24640babc0 con 0x7f24640d3400 2024-09-19T09:13:53.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.450+0000 7f246c3fd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f24640b7b60 con 0x7f24640ba7e0 2024-09-19T09:13:53.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.451+0000 7f246a99a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f24640d3400 0x7f24641618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:53.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.451+0000 7f246a99a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f24640d3400 0x7f24641618f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36162/0 (socket says 172.21.15.18:36162) 2024-09-19T09:13:53.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.451+0000 7f246a99a640 1 -- 172.21.15.18:0/3663986427 learned_addr learned my addr 172.21.15.18:0/3663986427 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:53.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.451+0000 7f2469998640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f24640d5870 0x7f24640d2cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:45416/0 (socket says 172.21.15.18:45416) 2024-09-19T09:13:53.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.451+0000 7f246a199640 1 --2- 172.21.15.18:0/3663986427 >> v2:172.21.15.162:3300/0 conn(0x7f24640ba7e0 0x7f24640d0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:53.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.451+0000 7f246a99a640 1 -- 172.21.15.18:0/3663986427 >> v2:172.21.15.162:3300/0 conn(0x7f24640ba7e0 msgr2=0x7f24640d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:53.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.451+0000 7f246a99a640 1 --2- 172.21.15.18:0/3663986427 >> v2:172.21.15.162:3300/0 conn(0x7f24640ba7e0 0x7f24640d0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:53.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.451+0000 7f246a99a640 1 -- 172.21.15.18:0/3663986427 >> v1:172.21.15.18:6789/0 conn(0x7f24640d5870 legacy=0x7f24640d2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:53.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.451+0000 7f246a99a640 1 -- 172.21.15.18:0/3663986427 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24640b7e40 con 0x7f24640d3400 2024-09-19T09:13:53.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.451+0000 7f246a199640 1 --2- 172.21.15.18:0/3663986427 >> v2:172.21.15.162:3300/0 conn(0x7f24640ba7e0 0x7f24640d0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:13:53.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.452+0000 7f246a99a640 1 --2- 172.21.15.18:0/3663986427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24640d3400 0x7f24641618f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f246408e0b0 tx=0x7f245c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ef241a2e99eca1b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:53.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.452+0000 7f2469197640 1 -- 172.21.15.18:0/3663986427 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f245c036070 con 0x7f24640d3400 2024-09-19T09:13:53.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.452+0000 7f2469197640 1 -- 172.21.15.18:0/3663986427 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f245c031600 con 0x7f24640d3400 2024-09-19T09:13:53.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.452+0000 7f2469197640 1 -- 172.21.15.18:0/3663986427 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f245c0319d0 con 0x7f24640d3400 2024-09-19T09:13:53.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.452+0000 7f246c3fd640 1 -- 172.21.15.18:0/3663986427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24640d3400 msgr2=0x7f24641618f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:53.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.452+0000 7f246c3fd640 1 --2- 172.21.15.18:0/3663986427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24640d3400 0x7f24641618f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f246408e0b0 tx=0x7f245c02a730 comp rx=0 tx=0).stop 2024-09-19T09:13:53.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.452+0000 7f246c3fd640 1 -- 172.21.15.18:0/3663986427 shutdown_connections 2024-09-19T09:13:53.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.452+0000 7f246c3fd640 1 --2- 172.21.15.18:0/3663986427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24640d3400 0x7f24641618f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:53.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.452+0000 7f246c3fd640 1 --2- 172.21.15.18:0/3663986427 >> v2:172.21.15.162:3300/0 conn(0x7f24640ba7e0 0x7f24640d0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:53.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.452+0000 7f246c3fd640 1 -- 172.21.15.18:0/3663986427 >> 172.21.15.18:0/3663986427 conn(0x7f24640d4c70 msgr2=0x7f24640d5080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:53.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.452+0000 7f246c3fd640 1 -- 172.21.15.18:0/3663986427 shutdown_connections 2024-09-19T09:13:53.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.452+0000 7f246c3fd640 1 -- 172.21.15.18:0/3663986427 wait complete. 2024-09-19T09:13:53.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.454+0000 7f246c3fd640 1 Processor -- start 2024-09-19T09:13:53.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.454+0000 7f246c3fd640 1 -- start start 2024-09-19T09:13:53.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.454+0000 7f246c3fd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24640ba7e0 0x7f24640c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:53.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.454+0000 7f246c3fd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24640d3400 0x7f2464155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:53.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.454+0000 7f246c3fd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24640d5870 0x7f24640cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:53.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.454+0000 7f246c3fd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f24640d0760 con 0x7f24640d5870 2024-09-19T09:13:53.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.454+0000 7f246c3fd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f24640b8400 con 0x7f24640d3400 2024-09-19T09:13:53.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.454+0000 7f246c3fd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2464161e30 con 0x7f24640ba7e0 2024-09-19T09:13:53.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.454+0000 7f246a99a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24640d5870 0x7f24640cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:53.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.454+0000 7f246a99a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24640d5870 0x7f24640cdcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36174/0 (socket says 172.21.15.18:36174) 2024-09-19T09:13:53.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.454+0000 7f246a99a640 1 -- 172.21.15.18:0/3265436636 learned_addr learned my addr 172.21.15.18:0/3265436636 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:53.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.455+0000 7f2469998640 1 --2- 172.21.15.18:0/3265436636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24640d3400 0x7f2464155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:53.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.455+0000 7f246a199640 1 --2- 172.21.15.18:0/3265436636 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24640ba7e0 0x7f24640c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:53.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.455+0000 7f246a99a640 1 -- 172.21.15.18:0/3265436636 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24640ba7e0 msgr2=0x7f24640c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:53.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.455+0000 7f246a99a640 1 --2- 172.21.15.18:0/3265436636 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24640ba7e0 0x7f24640c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:53.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.455+0000 7f246a99a640 1 -- 172.21.15.18:0/3265436636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24640d3400 msgr2=0x7f2464155df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:53.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.455+0000 7f246a99a640 1 --2- 172.21.15.18:0/3265436636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24640d3400 0x7f2464155df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:53.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.455+0000 7f246a99a640 1 -- 172.21.15.18:0/3265436636 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24640ccc70 con 0x7f24640d5870 2024-09-19T09:13:53.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.455+0000 7f246a99a640 1 --2- 172.21.15.18:0/3265436636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24640d5870 0x7f24640cdcb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f245c009f40 tx=0x7f245c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:53.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.455+0000 7f245affd640 1 -- 172.21.15.18:0/3265436636 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f245c03f020 con 0x7f24640d5870 2024-09-19T09:13:53.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.455+0000 7f245affd640 1 -- 172.21.15.18:0/3265436636 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f245c037040 con 0x7f24640d5870 2024-09-19T09:13:53.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.455+0000 7f246c3fd640 1 -- 172.21.15.18:0/3265436636 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24640c8db0 con 0x7f24640d5870 2024-09-19T09:13:53.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.455+0000 7f245affd640 1 -- 172.21.15.18:0/3265436636 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f245c036070 con 0x7f24640d5870 2024-09-19T09:13:53.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.455+0000 7f246c3fd640 1 -- 172.21.15.18:0/3265436636 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24640cd1f0 con 0x7f24640d5870 2024-09-19T09:13:53.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.456+0000 7f246c3fd640 1 -- 172.21.15.18:0/3265436636 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24640d0220 con 0x7f24640d5870 2024-09-19T09:13:53.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.457+0000 7f245affd640 1 -- 172.21.15.18:0/3265436636 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f245c042020 con 0x7f24640d5870 2024-09-19T09:13:53.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.457+0000 7f245affd640 1 --2- 172.21.15.18:0/3265436636 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f244806c2b0 0x7f244806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:53.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.457+0000 7f245affd640 1 -- 172.21.15.18:0/3265436636 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f245c0ab920 con 0x7f24640d5870 2024-09-19T09:13:53.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.457+0000 7f246a199640 1 --2- 172.21.15.18:0/3265436636 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f244806c2b0 0x7f244806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:53.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.458+0000 7f246a199640 1 --2- 172.21.15.18:0/3265436636 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f244806c2b0 0x7f244806e770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f24640b5b70 tx=0x7f2460008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:53.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.461+0000 7f245affd640 1 -- 172.21.15.18:0/3265436636 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f245c049030 con 0x7f24640d5870 2024-09-19T09:13:53.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.648+0000 7f246c3fd640 1 -- 172.21.15.18:0/3265436636 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f24640b9670 con 0x7f24640d5870 2024-09-19T09:13:53.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.649+0000 7f245affd640 1 -- 172.21.15.18:0/3265436636 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f245c079a50 con 0x7f24640d5870 2024-09-19T09:13:53.649 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-09-19T09:13:53.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.651+0000 7f246c3fd640 1 -- 172.21.15.18:0/3265436636 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f244806c2b0 msgr2=0x7f244806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:53.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.651+0000 7f246c3fd640 1 --2- 172.21.15.18:0/3265436636 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f244806c2b0 0x7f244806e770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f24640b5b70 tx=0x7f2460008040 comp rx=0 tx=0).stop 2024-09-19T09:13:53.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.651+0000 7f246c3fd640 1 -- 172.21.15.18:0/3265436636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24640d5870 msgr2=0x7f24640cdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:53.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.651+0000 7f246c3fd640 1 --2- 172.21.15.18:0/3265436636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24640d5870 0x7f24640cdcb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f245c009f40 tx=0x7f245c004a40 comp rx=0 tx=0).stop 2024-09-19T09:13:53.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.651+0000 7f246c3fd640 1 -- 172.21.15.18:0/3265436636 shutdown_connections 2024-09-19T09:13:53.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.651+0000 7f246c3fd640 1 --2- 172.21.15.18:0/3265436636 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f244806c2b0 0x7f244806e770 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:53.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.651+0000 7f246c3fd640 1 --2- 172.21.15.18:0/3265436636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24640d5870 0x7f24640cdcb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:53.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.651+0000 7f246c3fd640 1 --2- 172.21.15.18:0/3265436636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f24640d3400 0x7f2464155df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:53.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.651+0000 7f246c3fd640 1 --2- 172.21.15.18:0/3265436636 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24640ba7e0 0x7f24640c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:53.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.651+0000 7f246c3fd640 1 -- 172.21.15.18:0/3265436636 >> 172.21.15.18:0/3265436636 conn(0x7f24640d4c70 msgr2=0x7f246406d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:53.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.651+0000 7f246c3fd640 1 -- 172.21.15.18:0/3265436636 shutdown_connections 2024-09-19T09:13:53.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:53.651+0000 7f246c3fd640 1 -- 172.21.15.18:0/3265436636 wait complete. 2024-09-19T09:13:53.664 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T09:13:53.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:53.664 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-19T09:13:53.699 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T09:13:53.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:53.699 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T09:13:53.764 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:13:53.764 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:13:53.785 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:13:53.785 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:13:53.844 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:13:53.844 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:13:53.904 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T09:13:54.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.008+0000 7f743cc7b640 1 Processor -- start 2024-09-19T09:13:54.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.008+0000 7f743cc7b640 1 -- start start 2024-09-19T09:13:54.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.009+0000 7f743cc7b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f743806d730 0x7f74380b7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:54.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.009+0000 7f743cc7b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f74380b6290 0x7f743806db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:54.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.009+0000 7f743cc7b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f743806e050 con 0x7f74381627a0 2024-09-19T09:13:54.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.009+0000 7f743cc7b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f74380b7890 con 0x7f743806d730 2024-09-19T09:13:54.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.009+0000 7f743cc7b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f74380b7b70 con 0x7f74380b6290 2024-09-19T09:13:54.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.009+0000 7f743659c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f743806d730 0x7f74380b7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:54.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.009+0000 7f743659c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f743806d730 0x7f74380b7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36180/0 (socket says 172.21.15.18:36180) 2024-09-19T09:13:54.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.009+0000 7f743659c640 1 -- 172.21.15.18:0/3120552648 learned_addr learned my addr 172.21.15.18:0/3120552648 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:54.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.009+0000 7f743659c640 1 -- 172.21.15.18:0/3120552648 >> v2:172.21.15.162:3300/0 conn(0x7f74380b6290 msgr2=0x7f743806db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:54.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.009+0000 7f742ffff640 1 --2- 172.21.15.18:0/3120552648 >> v2:172.21.15.162:3300/0 conn(0x7f74380b6290 0x7f743806db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:54.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.009+0000 7f743659c640 1 --2- 172.21.15.18:0/3120552648 >> v2:172.21.15.162:3300/0 conn(0x7f74380b6290 0x7f743806db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:54.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.009+0000 7f743659c640 1 -- 172.21.15.18:0/3120552648 >> v1:172.21.15.162:6789/0 conn(0x7f74381627a0 legacy=0x7f7438162c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:54.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.009+0000 7f743659c640 1 -- 172.21.15.18:0/3120552648 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74380cbd10 con 0x7f743806d730 2024-09-19T09:13:54.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.009+0000 7f742ffff640 1 --2- 172.21.15.18:0/3120552648 >> v2:172.21.15.162:3300/0 conn(0x7f74380b6290 0x7f743806db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:13:54.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.010+0000 7f743659c640 1 --2- 172.21.15.18:0/3120552648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f743806d730 0x7f74380b7270 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7428009870 tx=0x7f742802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b50290eea2ee901 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:54.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.010+0000 7f7435d9b640 1 -- 172.21.15.18:0/3120552648 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7428037070 con 0x7f743806d730 2024-09-19T09:13:54.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.010+0000 7f7435d9b640 1 -- 172.21.15.18:0/3120552648 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7428032440 con 0x7f743806d730 2024-09-19T09:13:54.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.010+0000 7f7435d9b640 1 -- 172.21.15.18:0/3120552648 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7428032810 con 0x7f743806d730 2024-09-19T09:13:54.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.011+0000 7f743cc7b640 1 -- 172.21.15.18:0/3120552648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f743806d730 msgr2=0x7f74380b7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:54.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.011+0000 7f743cc7b640 1 --2- 172.21.15.18:0/3120552648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f743806d730 0x7f74380b7270 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7428009870 tx=0x7f742802a250 comp rx=0 tx=0).stop 2024-09-19T09:13:54.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.011+0000 7f743cc7b640 1 -- 172.21.15.18:0/3120552648 shutdown_connections 2024-09-19T09:13:54.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.011+0000 7f743cc7b640 1 --2- 172.21.15.18:0/3120552648 >> v2:172.21.15.162:3300/0 conn(0x7f74380b6290 0x7f743806db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:54.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.011+0000 7f743cc7b640 1 --2- 172.21.15.18:0/3120552648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f743806d730 0x7f74380b7270 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:54.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.011+0000 7f743cc7b640 1 -- 172.21.15.18:0/3120552648 >> 172.21.15.18:0/3120552648 conn(0x7f74380b7e10 msgr2=0x7f74380b8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:54.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.011+0000 7f743cc7b640 1 -- 172.21.15.18:0/3120552648 shutdown_connections 2024-09-19T09:13:54.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.011+0000 7f743cc7b640 1 -- 172.21.15.18:0/3120552648 wait complete. 2024-09-19T09:13:54.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.012+0000 7f743cc7b640 1 Processor -- start 2024-09-19T09:13:54.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.012+0000 7f743cc7b640 1 -- start start 2024-09-19T09:13:54.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.013+0000 7f743cc7b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f743806d730 0x7f7438157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:54.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.013+0000 7f743cc7b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74380b6290 0x7f743815d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:54.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.013+0000 7f743cc7b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f74381627a0 0x7f743815ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:54.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.013+0000 7f743cc7b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f74380b4310 con 0x7f74380b6290 2024-09-19T09:13:54.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.013+0000 7f743cc7b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f74380cc2d0 con 0x7f743806d730 2024-09-19T09:13:54.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.013+0000 7f743cc7b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f743815efe0 con 0x7f74381627a0 2024-09-19T09:13:54.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.013+0000 7f742ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74380b6290 0x7f743815d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:54.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.013+0000 7f742ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74380b6290 0x7f743815d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36184/0 (socket says 172.21.15.18:36184) 2024-09-19T09:13:54.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.013+0000 7f742ffff640 1 -- 172.21.15.18:0/3617488348 learned_addr learned my addr 172.21.15.18:0/3617488348 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:54.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.013+0000 7f743659c640 1 --2- 172.21.15.18:0/3617488348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f743806d730 0x7f7438157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:54.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.013+0000 7f7436d9d640 1 --2- 172.21.15.18:0/3617488348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f74381627a0 0x7f743815ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:54.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.013+0000 7f742ffff640 1 -- 172.21.15.18:0/3617488348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f74381627a0 msgr2=0x7f743815ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:54.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.013+0000 7f742ffff640 1 --2- 172.21.15.18:0/3617488348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f74381627a0 0x7f743815ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:54.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.013+0000 7f742ffff640 1 -- 172.21.15.18:0/3617488348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f743806d730 msgr2=0x7f7438157660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:54.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.013+0000 7f742ffff640 1 --2- 172.21.15.18:0/3617488348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f743806d730 0x7f7438157660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:54.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.013+0000 7f742ffff640 1 -- 172.21.15.18:0/3617488348 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74381e8720 con 0x7f74380b6290 2024-09-19T09:13:54.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.013+0000 7f743659c640 1 --2- 172.21.15.18:0/3617488348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f743806d730 0x7f7438157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:13:54.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.013+0000 7f7436d9d640 1 --2- 172.21.15.18:0/3617488348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f74381627a0 0x7f743815ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:13:54.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.013+0000 7f742ffff640 1 --2- 172.21.15.18:0/3617488348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74380b6290 0x7f743815d870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f742000c820 tx=0x7f742000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:54.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.014+0000 7f742effd640 1 -- 172.21.15.18:0/3617488348 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7420015070 con 0x7f74380b6290 2024-09-19T09:13:54.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.014+0000 7f742effd640 1 -- 172.21.15.18:0/3617488348 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7420007a30 con 0x7f74380b6290 2024-09-19T09:13:54.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.014+0000 7f743cc7b640 1 -- 172.21.15.18:0/3617488348 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74381e8a00 con 0x7f74380b6290 2024-09-19T09:13:54.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.014+0000 7f742effd640 1 -- 172.21.15.18:0/3617488348 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7420007de0 con 0x7f74380b6290 2024-09-19T09:13:54.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.014+0000 7f743cc7b640 1 -- 172.21.15.18:0/3617488348 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74381e8fc0 con 0x7f74380b6290 2024-09-19T09:13:54.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.015+0000 7f743cc7b640 1 -- 172.21.15.18:0/3617488348 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74380b7270 con 0x7f74380b6290 2024-09-19T09:13:54.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.015+0000 7f742effd640 1 -- 172.21.15.18:0/3617488348 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7420018070 con 0x7f74380b6290 2024-09-19T09:13:54.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.016+0000 7f742effd640 1 --2- 172.21.15.18:0/3617488348 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f741806c2b0 0x7f741806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:54.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.016+0000 7f742effd640 1 -- 172.21.15.18:0/3617488348 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f742008b2c0 con 0x7f74380b6290 2024-09-19T09:13:54.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.016+0000 7f743659c640 1 --2- 172.21.15.18:0/3617488348 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f741806c2b0 0x7f741806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:54.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.016+0000 7f743659c640 1 --2- 172.21.15.18:0/3617488348 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f741806c2b0 0x7f741806e770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7428034000 tx=0x7f742802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:54.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.020+0000 7f742effd640 1 -- 172.21.15.18:0/3617488348 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7420059ac0 con 0x7f74380b6290 2024-09-19T09:13:54.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.210+0000 7f743cc7b640 1 -- 172.21.15.18:0/3617488348 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f74380b3ff0 con 0x7f74380b6290 2024-09-19T09:13:54.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.210+0000 7f742effd640 1 -- 172.21.15.18:0/3617488348 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f74200593c0 con 0x7f74380b6290 2024-09-19T09:13:54.211 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-09-19T09:13:54.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.212+0000 7f743cc7b640 1 -- 172.21.15.18:0/3617488348 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f741806c2b0 msgr2=0x7f741806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:54.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.212+0000 7f743cc7b640 1 --2- 172.21.15.18:0/3617488348 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f741806c2b0 0x7f741806e770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7428034000 tx=0x7f742802e000 comp rx=0 tx=0).stop 2024-09-19T09:13:54.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.212+0000 7f743cc7b640 1 -- 172.21.15.18:0/3617488348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74380b6290 msgr2=0x7f743815d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:54.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.212+0000 7f743cc7b640 1 --2- 172.21.15.18:0/3617488348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74380b6290 0x7f743815d870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f742000c820 tx=0x7f742000cce0 comp rx=0 tx=0).stop 2024-09-19T09:13:54.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.212+0000 7f743cc7b640 1 -- 172.21.15.18:0/3617488348 shutdown_connections 2024-09-19T09:13:54.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.212+0000 7f743cc7b640 1 --2- 172.21.15.18:0/3617488348 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f741806c2b0 0x7f741806e770 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:54.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.212+0000 7f743cc7b640 1 --2- 172.21.15.18:0/3617488348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f74381627a0 0x7f743815ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:54.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.212+0000 7f743cc7b640 1 --2- 172.21.15.18:0/3617488348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74380b6290 0x7f743815d870 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:54.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.212+0000 7f743cc7b640 1 --2- 172.21.15.18:0/3617488348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f743806d730 0x7f7438157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:54.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.213+0000 7f743cc7b640 1 -- 172.21.15.18:0/3617488348 >> 172.21.15.18:0/3617488348 conn(0x7f74380b7e10 msgr2=0x7f74380ce170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:54.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.213+0000 7f743cc7b640 1 -- 172.21.15.18:0/3617488348 shutdown_connections 2024-09-19T09:13:54.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.213+0000 7f743cc7b640 1 -- 172.21.15.18:0/3617488348 wait complete. 2024-09-19T09:13:54.224 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-19T09:13:54.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:54.225 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-19T09:13:54.257 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-09-19T09:13:54.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:54.257 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-19T09:13:54.319 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:13:54.320 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:13:54.336 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:13:54.336 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:13:54.392 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:13:54.392 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:13:54.448 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T09:13:54.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.590+0000 7f30c4349640 1 Processor -- start 2024-09-19T09:13:54.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.590+0000 7f30c4349640 1 -- start start 2024-09-19T09:13:54.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.591+0000 7f30c4349640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f30bc15eda0 0x7f30bc0d5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:54.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.591+0000 7f30c4349640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f30bc0d0480 0x7f30bc0d35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:54.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.591+0000 7f30c4349640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30bc0d0bf0 con 0x7f30bc0d3af0 2024-09-19T09:13:54.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.591+0000 7f30c4349640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f30bc0d2880 con 0x7f30bc0d0480 2024-09-19T09:13:54.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.591+0000 7f30c4349640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f30bc0d3120 con 0x7f30bc15eda0 2024-09-19T09:13:54.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.592+0000 7f30c18e4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f30bc0d0480 0x7f30bc0d35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:54.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.592+0000 7f30c18e4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f30bc0d0480 0x7f30bc0d35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36192/0 (socket says 172.21.15.18:36192) 2024-09-19T09:13:54.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.592+0000 7f30c18e4640 1 -- 172.21.15.18:0/3014281057 learned_addr learned my addr 172.21.15.18:0/3014281057 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:54.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.592+0000 7f30c20e5640 1 --2- 172.21.15.18:0/3014281057 >> v2:172.21.15.162:3300/0 conn(0x7f30bc15eda0 0x7f30bc0d5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:54.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.592+0000 7f30c18e4640 1 -- 172.21.15.18:0/3014281057 >> v2:172.21.15.162:3300/0 conn(0x7f30bc15eda0 msgr2=0x7f30bc0d5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:54.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.592+0000 7f30c18e4640 1 --2- 172.21.15.18:0/3014281057 >> v2:172.21.15.162:3300/0 conn(0x7f30bc15eda0 0x7f30bc0d5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:54.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.592+0000 7f30c18e4640 1 -- 172.21.15.18:0/3014281057 >> v1:172.21.15.18:6789/0 conn(0x7f30bc0d3af0 legacy=0x7f30bc0d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:54.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.592+0000 7f30c18e4640 1 -- 172.21.15.18:0/3014281057 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30bc0d2ad0 con 0x7f30bc0d0480 2024-09-19T09:13:54.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.592+0000 7f30c20e5640 1 --2- 172.21.15.18:0/3014281057 >> v2:172.21.15.162:3300/0 conn(0x7f30bc15eda0 0x7f30bc0d5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:13:54.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.593+0000 7f30c18e4640 1 --2- 172.21.15.18:0/3014281057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30bc0d0480 0x7f30bc0d35b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f30bc06ec20 tx=0x7f30b002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3745def03b483f04 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:54.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.593+0000 7f30c10e3640 1 -- 172.21.15.18:0/3014281057 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b0037070 con 0x7f30bc0d0480 2024-09-19T09:13:54.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.593+0000 7f30c10e3640 1 -- 172.21.15.18:0/3014281057 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b0032440 con 0x7f30bc0d0480 2024-09-19T09:13:54.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.593+0000 7f30c10e3640 1 -- 172.21.15.18:0/3014281057 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b0032810 con 0x7f30bc0d0480 2024-09-19T09:13:54.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.593+0000 7f30c4349640 1 -- 172.21.15.18:0/3014281057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30bc0d0480 msgr2=0x7f30bc0d35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:54.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.593+0000 7f30c4349640 1 --2- 172.21.15.18:0/3014281057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30bc0d0480 0x7f30bc0d35b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f30bc06ec20 tx=0x7f30b002a270 comp rx=0 tx=0).stop 2024-09-19T09:13:54.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.593+0000 7f30c4349640 1 -- 172.21.15.18:0/3014281057 shutdown_connections 2024-09-19T09:13:54.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.593+0000 7f30c4349640 1 --2- 172.21.15.18:0/3014281057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30bc0d0480 0x7f30bc0d35b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:54.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.593+0000 7f30c4349640 1 --2- 172.21.15.18:0/3014281057 >> v2:172.21.15.162:3300/0 conn(0x7f30bc15eda0 0x7f30bc0d5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:54.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.593+0000 7f30c4349640 1 -- 172.21.15.18:0/3014281057 >> 172.21.15.18:0/3014281057 conn(0x7f30bc09df40 msgr2=0x7f30bc0d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:54.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.593+0000 7f30c4349640 1 -- 172.21.15.18:0/3014281057 shutdown_connections 2024-09-19T09:13:54.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.593+0000 7f30c4349640 1 -- 172.21.15.18:0/3014281057 wait complete. 2024-09-19T09:13:54.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.595+0000 7f30c4349640 1 Processor -- start 2024-09-19T09:13:54.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.595+0000 7f30c4349640 1 -- start start 2024-09-19T09:13:54.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.595+0000 7f30c4349640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30bc0d0480 0x7f30bc15f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.595+0000 7f30c4349640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30bc15eda0 0x7f30bc15fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.595+0000 7f30c4349640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30bc1f48a0 0x7f30bc1f4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.595+0000 7f30c4349640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc15f180 con 0x7f30bc0d0480 2024-09-19T09:13:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.595+0000 7f30c4349640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f30bc0d08f0 con 0x7f30bc15eda0 2024-09-19T09:13:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.595+0000 7f30c4349640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f30bc15f300 con 0x7f30bc1f48a0 2024-09-19T09:13:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.595+0000 7f30c20e5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30bc0d0480 0x7f30bc15f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.595+0000 7f30c20e5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30bc0d0480 0x7f30bc15f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36206/0 (socket says 172.21.15.18:36206) 2024-09-19T09:13:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.595+0000 7f30c20e5640 1 -- 172.21.15.18:0/2086566111 learned_addr learned my addr 172.21.15.18:0/2086566111 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.596+0000 7f30c18e4640 1 --2- 172.21.15.18:0/2086566111 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30bc15eda0 0x7f30bc15fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.596+0000 7f30c28e6640 1 --2- 172.21.15.18:0/2086566111 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30bc1f48a0 0x7f30bc1f4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.596+0000 7f30c20e5640 1 -- 172.21.15.18:0/2086566111 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30bc1f48a0 msgr2=0x7f30bc1f4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.596+0000 7f30c20e5640 1 --2- 172.21.15.18:0/2086566111 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30bc1f48a0 0x7f30bc1f4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.596+0000 7f30c20e5640 1 -- 172.21.15.18:0/2086566111 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30bc15eda0 msgr2=0x7f30bc15fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:54.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.596+0000 7f30c20e5640 1 --2- 172.21.15.18:0/2086566111 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30bc15eda0 0x7f30bc15fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:54.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.596+0000 7f30c20e5640 1 -- 172.21.15.18:0/2086566111 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30bc15ff70 con 0x7f30bc0d0480 2024-09-19T09:13:54.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.596+0000 7f30c18e4640 1 --2- 172.21.15.18:0/2086566111 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30bc15eda0 0x7f30bc15fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:13:54.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.596+0000 7f30c28e6640 1 --2- 172.21.15.18:0/2086566111 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30bc1f48a0 0x7f30bc1f4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:13:54.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.596+0000 7f30c20e5640 1 --2- 172.21.15.18:0/2086566111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30bc0d0480 0x7f30bc15f4f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f30b400c7f0 tx=0x7f30b400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:54.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.596+0000 7f30baffd640 1 -- 172.21.15.18:0/2086566111 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b4015070 con 0x7f30bc0d0480 2024-09-19T09:13:54.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.596+0000 7f30baffd640 1 -- 172.21.15.18:0/2086566111 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30b40077c0 con 0x7f30bc0d0480 2024-09-19T09:13:54.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.596+0000 7f30c4349640 1 -- 172.21.15.18:0/2086566111 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30bc160200 con 0x7f30bc0d0480 2024-09-19T09:13:54.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.596+0000 7f30baffd640 1 -- 172.21.15.18:0/2086566111 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30b4007bb0 con 0x7f30bc0d0480 2024-09-19T09:13:54.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.596+0000 7f30c4349640 1 -- 172.21.15.18:0/2086566111 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30bc1607c0 con 0x7f30bc0d0480 2024-09-19T09:13:54.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.597+0000 7f30c4349640 1 -- 172.21.15.18:0/2086566111 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30bc0d35b0 con 0x7f30bc0d0480 2024-09-19T09:13:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.598+0000 7f30baffd640 1 -- 172.21.15.18:0/2086566111 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f30b4018070 con 0x7f30bc0d0480 2024-09-19T09:13:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.598+0000 7f30baffd640 1 --2- 172.21.15.18:0/2086566111 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f30a806c2b0 0x7f30a806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.598+0000 7f30baffd640 1 -- 172.21.15.18:0/2086566111 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f30b408b290 con 0x7f30bc0d0480 2024-09-19T09:13:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.598+0000 7f30c18e4640 1 --2- 172.21.15.18:0/2086566111 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f30a806c2b0 0x7f30a806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:54.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.599+0000 7f30c18e4640 1 --2- 172.21.15.18:0/2086566111 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f30a806c2b0 0x7f30a806e770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f30b0034000 tx=0x7f30b002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:54.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.602+0000 7f30baffd640 1 -- 172.21.15.18:0/2086566111 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f30b4059a00 con 0x7f30bc0d0480 2024-09-19T09:13:54.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.796+0000 7f30c4349640 1 -- 172.21.15.18:0/2086566111 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f30bc0d2330 con 0x7f30bc0d0480 2024-09-19T09:13:54.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.796+0000 7f30baffd640 1 -- 172.21.15.18:0/2086566111 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f30b4059300 con 0x7f30bc0d0480 2024-09-19T09:13:54.797 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-09-19T09:13:54.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.799+0000 7f30c4349640 1 -- 172.21.15.18:0/2086566111 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f30a806c2b0 msgr2=0x7f30a806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:54.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.799+0000 7f30c4349640 1 --2- 172.21.15.18:0/2086566111 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f30a806c2b0 0x7f30a806e770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f30b0034000 tx=0x7f30b002e000 comp rx=0 tx=0).stop 2024-09-19T09:13:54.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.799+0000 7f30c4349640 1 -- 172.21.15.18:0/2086566111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30bc0d0480 msgr2=0x7f30bc15f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:54.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.799+0000 7f30c4349640 1 --2- 172.21.15.18:0/2086566111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30bc0d0480 0x7f30bc15f4f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f30b400c7f0 tx=0x7f30b400ccb0 comp rx=0 tx=0).stop 2024-09-19T09:13:54.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.799+0000 7f30c4349640 1 -- 172.21.15.18:0/2086566111 shutdown_connections 2024-09-19T09:13:54.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.799+0000 7f30c4349640 1 --2- 172.21.15.18:0/2086566111 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f30a806c2b0 0x7f30a806e770 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:54.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.799+0000 7f30c4349640 1 --2- 172.21.15.18:0/2086566111 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30bc1f48a0 0x7f30bc1f4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:54.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.799+0000 7f30c4349640 1 --2- 172.21.15.18:0/2086566111 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30bc15eda0 0x7f30bc15fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:54.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.799+0000 7f30c4349640 1 --2- 172.21.15.18:0/2086566111 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30bc0d0480 0x7f30bc15f4f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:54.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.799+0000 7f30c4349640 1 -- 172.21.15.18:0/2086566111 >> 172.21.15.18:0/2086566111 conn(0x7f30bc09df40 msgr2=0x7f30bc0cf930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:54.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.799+0000 7f30c4349640 1 -- 172.21.15.18:0/2086566111 shutdown_connections 2024-09-19T09:13:54.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:54.799+0000 7f30c4349640 1 -- 172.21.15.18:0/2086566111 wait complete. 2024-09-19T09:13:54.810 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-19T09:13:54.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:54.811 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-19T09:13:54.838 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T09:13:54.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:54.838 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-19T09:13:54.895 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:13:54.895 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:13:54.914 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:13:54.914 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:13:54.973 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:13:54.973 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:13:55.031 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T09:13:55.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.134+0000 7f0d4c5e4640 1 Processor -- start 2024-09-19T09:13:55.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.134+0000 7f0d4c5e4640 1 -- start start 2024-09-19T09:13:55.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.135+0000 7f0d4c5e4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0d440b6290 0x7f0d440ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:55.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.135+0000 7f0d4c5e4640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d440b7890 con 0x7f0d4406d730 2024-09-19T09:13:55.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.135+0000 7f0d4c5e4640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d440b7b70 con 0x7f0d440b7270 2024-09-19T09:13:55.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.135+0000 7f0d4c5e4640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f0d440cbd10 con 0x7f0d440b6290 2024-09-19T09:13:55.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.135+0000 7f0d4ab81640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0d440b6290 0x7f0d440ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:55.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.135+0000 7f0d4ab81640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0d440b6290 0x7f0d440ccf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36212/0 (socket says 172.21.15.18:36212) 2024-09-19T09:13:55.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.135+0000 7f0d4ab81640 1 -- 172.21.15.18:0/1480233725 learned_addr learned my addr 172.21.15.18:0/1480233725 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:55.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.135+0000 7f0d4a380640 1 --1- 172.21.15.18:0/1480233725 >> v1:172.21.15.18:6789/0 conn(0x7f0d4406d730 0x7f0d4406db10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:45424/0 (socket says 172.21.15.18:45424) 2024-09-19T09:13:55.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.136+0000 7f0d4ab81640 1 -- 172.21.15.18:0/1480233725 >> v1:172.21.15.162:6789/0 conn(0x7f0d440b7270 legacy=0x7f0d440cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:55.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.136+0000 7f0d4ab81640 1 -- 172.21.15.18:0/1480233725 >> v1:172.21.15.18:6789/0 conn(0x7f0d4406d730 legacy=0x7f0d4406db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:55.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.136+0000 7f0d4937e640 1 -- 172.21.15.18:0/1480233725 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2459776134 0 0) 0x7f0d440b7890 con 0x7f0d4406d730 2024-09-19T09:13:55.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.136+0000 7f0d4ab81640 1 -- 172.21.15.18:0/1480233725 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d440cbff0 con 0x7f0d440b6290 2024-09-19T09:13:55.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.136+0000 7f0d4ab81640 1 --2- 172.21.15.18:0/1480233725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d440b6290 0x7f0d440ccf00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0098a0 tx=0x7f0d3c02a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1270e35598f6cbc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:55.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.137+0000 7f0d4937e640 1 -- 172.21.15.18:0/1480233725 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c037070 con 0x7f0d440b6290 2024-09-19T09:13:55.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.137+0000 7f0d4937e640 1 -- 172.21.15.18:0/1480233725 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d3c032440 con 0x7f0d440b6290 2024-09-19T09:13:55.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.137+0000 7f0d4937e640 1 -- 172.21.15.18:0/1480233725 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c032810 con 0x7f0d440b6290 2024-09-19T09:13:55.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.137+0000 7f0d4c5e4640 1 -- 172.21.15.18:0/1480233725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d440b6290 msgr2=0x7f0d440ccf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:55.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.137+0000 7f0d4c5e4640 1 --2- 172.21.15.18:0/1480233725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d440b6290 0x7f0d440ccf00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0098a0 tx=0x7f0d3c02a2e0 comp rx=0 tx=0).stop 2024-09-19T09:13:55.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.137+0000 7f0d4c5e4640 1 -- 172.21.15.18:0/1480233725 shutdown_connections 2024-09-19T09:13:55.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.137+0000 7f0d4c5e4640 1 --2- 172.21.15.18:0/1480233725 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d440b6290 0x7f0d440ccf00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:55.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.137+0000 7f0d4c5e4640 1 -- 172.21.15.18:0/1480233725 >> 172.21.15.18:0/1480233725 conn(0x7f0d440b7e10 msgr2=0x7f0d440b8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:55.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.137+0000 7f0d4c5e4640 1 -- 172.21.15.18:0/1480233725 shutdown_connections 2024-09-19T09:13:55.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.137+0000 7f0d4c5e4640 1 -- 172.21.15.18:0/1480233725 wait complete. 2024-09-19T09:13:55.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.138+0000 7f0d4c5e4640 1 Processor -- start 2024-09-19T09:13:55.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.139+0000 7f0d4c5e4640 1 -- start start 2024-09-19T09:13:55.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.139+0000 7f0d4c5e4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d4406d730 0x7f0d441f4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:55.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.139+0000 7f0d4c5e4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d440b6290 0x7f0d44160a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:55.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.139+0000 7f0d4c5e4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d440b7270 0x7f0d44160f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:55.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.139+0000 7f0d4c5e4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0d4415efe0 con 0x7f0d4406d730 2024-09-19T09:13:55.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.139+0000 7f0d4c5e4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0d440b4310 con 0x7f0d440b7270 2024-09-19T09:13:55.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.139+0000 7f0d4c5e4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0d440cd440 con 0x7f0d440b6290 2024-09-19T09:13:55.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.139+0000 7f0d4a380640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d4406d730 0x7f0d441f4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:55.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.139+0000 7f0d4a380640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d4406d730 0x7f0d441f4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36216/0 (socket says 172.21.15.18:36216) 2024-09-19T09:13:55.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.139+0000 7f0d4a380640 1 -- 172.21.15.18:0/935794453 learned_addr learned my addr 172.21.15.18:0/935794453 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:55.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.140+0000 7f0d49b7f640 1 --2- 172.21.15.18:0/935794453 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d440b6290 0x7f0d44160a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:55.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.140+0000 7f0d4a380640 1 -- 172.21.15.18:0/935794453 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d440b6290 msgr2=0x7f0d44160a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:55.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.140+0000 7f0d4ab81640 1 --2- 172.21.15.18:0/935794453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d440b7270 0x7f0d44160f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:55.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.140+0000 7f0d4a380640 1 --2- 172.21.15.18:0/935794453 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d440b6290 0x7f0d44160a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:55.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.140+0000 7f0d4a380640 1 -- 172.21.15.18:0/935794453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d440b7270 msgr2=0x7f0d44160f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:55.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.140+0000 7f0d4a380640 1 --2- 172.21.15.18:0/935794453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d440b7270 0x7f0d44160f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:55.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.140+0000 7f0d4a380640 1 -- 172.21.15.18:0/935794453 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d441e94d0 con 0x7f0d4406d730 2024-09-19T09:13:55.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.140+0000 7f0d4a380640 1 --2- 172.21.15.18:0/935794453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d4406d730 0x7f0d441f4850 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0d4000c890 tx=0x7f0d4000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:55.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.140+0000 7f0d3affd640 1 -- 172.21.15.18:0/935794453 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d40018070 con 0x7f0d4406d730 2024-09-19T09:13:55.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.140+0000 7f0d3affd640 1 -- 172.21.15.18:0/935794453 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d4000a640 con 0x7f0d4406d730 2024-09-19T09:13:55.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.140+0000 7f0d4c5e4640 1 -- 172.21.15.18:0/935794453 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d441e97b0 con 0x7f0d4406d730 2024-09-19T09:13:55.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.140+0000 7f0d3affd640 1 -- 172.21.15.18:0/935794453 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4000aa30 con 0x7f0d4406d730 2024-09-19T09:13:55.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.140+0000 7f0d4c5e4640 1 -- 172.21.15.18:0/935794453 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d441e9d70 con 0x7f0d4406d730 2024-09-19T09:13:55.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.141+0000 7f0d4c5e4640 1 -- 172.21.15.18:0/935794453 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d440cd820 con 0x7f0d4406d730 2024-09-19T09:13:55.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.142+0000 7f0d3affd640 1 -- 172.21.15.18:0/935794453 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0d4001b070 con 0x7f0d4406d730 2024-09-19T09:13:55.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.142+0000 7f0d3affd640 1 --2- 172.21.15.18:0/935794453 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0d2806c2b0 0x7f0d2806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:55.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.142+0000 7f0d3affd640 1 -- 172.21.15.18:0/935794453 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f0d4008ab70 con 0x7f0d4406d730 2024-09-19T09:13:55.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.142+0000 7f0d49b7f640 1 --2- 172.21.15.18:0/935794453 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0d2806c2b0 0x7f0d2806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:55.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.143+0000 7f0d49b7f640 1 --2- 172.21.15.18:0/935794453 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0d2806c2b0 0x7f0d2806e770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0d440a0540 tx=0x7f0d34008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:55.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.147+0000 7f0d3affd640 1 -- 172.21.15.18:0/935794453 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0d400592e0 con 0x7f0d4406d730 2024-09-19T09:13:55.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.334+0000 7f0d4c5e4640 1 -- 172.21.15.18:0/935794453 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f0d440b3ff0 con 0x7f0d4406d730 2024-09-19T09:13:55.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.334+0000 7f0d3affd640 1 -- 172.21.15.18:0/935794453 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) ==== 80+0+0 (secure 0 0 0) 0x7f0d40058be0 con 0x7f0d4406d730 2024-09-19T09:13:55.335 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-09-19T09:13:55.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.336+0000 7f0d4c5e4640 1 -- 172.21.15.18:0/935794453 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0d2806c2b0 msgr2=0x7f0d2806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:55.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.336+0000 7f0d4c5e4640 1 --2- 172.21.15.18:0/935794453 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0d2806c2b0 0x7f0d2806e770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0d440a0540 tx=0x7f0d34008040 comp rx=0 tx=0).stop 2024-09-19T09:13:55.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.336+0000 7f0d4c5e4640 1 -- 172.21.15.18:0/935794453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d4406d730 msgr2=0x7f0d441f4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:55.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.336+0000 7f0d4c5e4640 1 --2- 172.21.15.18:0/935794453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d4406d730 0x7f0d441f4850 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0d4000c890 tx=0x7f0d4000cd50 comp rx=0 tx=0).stop 2024-09-19T09:13:55.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.336+0000 7f0d4c5e4640 1 -- 172.21.15.18:0/935794453 shutdown_connections 2024-09-19T09:13:55.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.336+0000 7f0d4c5e4640 1 --2- 172.21.15.18:0/935794453 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0d2806c2b0 0x7f0d2806e770 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:55.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.336+0000 7f0d4c5e4640 1 --2- 172.21.15.18:0/935794453 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d440b7270 0x7f0d44160f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:55.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.336+0000 7f0d4c5e4640 1 --2- 172.21.15.18:0/935794453 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d440b6290 0x7f0d44160a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:55.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.336+0000 7f0d4c5e4640 1 --2- 172.21.15.18:0/935794453 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d4406d730 0x7f0d441f4850 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:55.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.336+0000 7f0d4c5e4640 1 -- 172.21.15.18:0/935794453 >> 172.21.15.18:0/935794453 conn(0x7f0d440b7e10 msgr2=0x7f0d440b81f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:55.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.336+0000 7f0d4c5e4640 1 -- 172.21.15.18:0/935794453 shutdown_connections 2024-09-19T09:13:55.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.336+0000 7f0d4c5e4640 1 -- 172.21.15.18:0/935794453 wait complete. 2024-09-19T09:13:55.348 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-19T09:13:55.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:55.348 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-19T09:13:55.380 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-09-19T09:13:55.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:13:55.380 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-19T09:13:55.438 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-19T09:13:55.438 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:13:55.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.540+0000 7fe72e047640 1 Processor -- start 2024-09-19T09:13:55.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.540+0000 7fe72e047640 1 -- start start 2024-09-19T09:13:55.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.541+0000 7fe72e047640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe7280b5200 0x7fe7281629e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:55.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.541+0000 7fe72e047640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7280d0a10 con 0x7fe728162f20 2024-09-19T09:13:55.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.541+0000 7fe72e047640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe728070ab0 con 0x7fe72815ed30 2024-09-19T09:13:55.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.541+0000 7fe72e047640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe7280d0cb0 con 0x7fe7280b5200 2024-09-19T09:13:55.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.541+0000 7fe727fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe728162f20 0x7fe7280cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:47286/0 (socket says 172.21.15.18:47286) 2024-09-19T09:13:55.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.541+0000 7fe727fff640 1 -- 172.21.15.18:0/3692487974 learned_addr learned my addr 172.21.15.18:0/3692487974 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:55.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.541+0000 7fe7267fc640 1 -- 172.21.15.18:0/3692487974 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3159193420 0 0) 0x7fe7280d0a10 con 0x7fe728162f20 2024-09-19T09:13:55.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.541+0000 7fe726ffd640 1 --2- 172.21.15.18:0/3692487974 >> v2:172.21.15.162:3300/0 conn(0x7fe7280b5200 0x7fe7281629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:55.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.541+0000 7fe7267fc640 1 -- 172.21.15.18:0/3692487974 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe710003520 con 0x7fe728162f20 2024-09-19T09:13:55.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.541+0000 7fe7267fc640 1 -- 172.21.15.18:0/3692487974 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 291329786 0 0) 0x7fe710003520 con 0x7fe728162f20 2024-09-19T09:13:55.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.542+0000 7fe7267fc640 1 -- 172.21.15.18:0/3692487974 >> v2:172.21.15.162:3300/0 conn(0x7fe7280b5200 msgr2=0x7fe7281629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:55.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.542+0000 7fe7267fc640 1 --2- 172.21.15.18:0/3692487974 >> v2:172.21.15.162:3300/0 conn(0x7fe7280b5200 0x7fe7281629e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:55.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.542+0000 7fe7267fc640 1 -- 172.21.15.18:0/3692487974 >> v1:172.21.15.162:6789/0 conn(0x7fe72815ed30 legacy=0x7fe728070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:55.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.542+0000 7fe7267fc640 1 -- 172.21.15.18:0/3692487974 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7280d0f90 con 0x7fe728162f20 2024-09-19T09:13:55.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.542+0000 7fe7267fc640 1 -- 172.21.15.18:0/3692487974 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fe7200019f0 con 0x7fe728162f20 2024-09-19T09:13:55.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.542+0000 7fe7267fc640 1 -- 172.21.15.18:0/3692487974 >> v1:172.21.15.18:6789/0 conn(0x7fe728162f20 legacy=0x7fe7280cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:55.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.542+0000 7fe7267fc640 1 --2- 172.21.15.18:0/3692487974 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7100039b0 0x7fe710003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:55.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.542+0000 7fe7267fc640 1 --2- 172.21.15.18:0/3692487974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe710004800 0x7fe710004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:55.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.542+0000 7fe7267fc640 1 --2- 172.21.15.18:0/3692487974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7100051c0 0x7fe71000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:55.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.542+0000 7fe7267fc640 1 -- 172.21.15.18:0/3692487974 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe7280d0cb0 con 0x7fe710004800 2024-09-19T09:13:55.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.542+0000 7fe7267fc640 1 -- 172.21.15.18:0/3692487974 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe71000c070 con 0x7fe7100051c0 2024-09-19T09:13:55.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.542+0000 7fe7267fc640 1 -- 172.21.15.18:0/3692487974 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe71000c270 con 0x7fe7100039b0 2024-09-19T09:13:55.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.542+0000 7fe726ffd640 1 --2- 172.21.15.18:0/3692487974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe710004800 0x7fe710004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:55.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.542+0000 7fe7277fe640 1 --2- 172.21.15.18:0/3692487974 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7100039b0 0x7fe710003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:55.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.542+0000 7fe727fff640 1 --2- 172.21.15.18:0/3692487974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7100051c0 0x7fe71000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:55.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.542+0000 7fe726ffd640 1 -- 172.21.15.18:0/3692487974 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7100039b0 msgr2=0x7fe710003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:55.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.542+0000 7fe726ffd640 1 --2- 172.21.15.18:0/3692487974 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7100039b0 0x7fe710003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:55.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.542+0000 7fe726ffd640 1 -- 172.21.15.18:0/3692487974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7100051c0 msgr2=0x7fe71000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:55.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.542+0000 7fe726ffd640 1 --2- 172.21.15.18:0/3692487974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7100051c0 0x7fe71000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:55.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.542+0000 7fe726ffd640 1 -- 172.21.15.18:0/3692487974 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe710003520 con 0x7fe710004800 2024-09-19T09:13:55.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.542+0000 7fe727fff640 1 --2- 172.21.15.18:0/3692487974 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7100051c0 0x7fe71000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:13:55.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.542+0000 7fe727fff640 1 -- 172.21.15.18:0/3692487974 reap_dead start 2024-09-19T09:13:55.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.543+0000 7fe726ffd640 1 --2- 172.21.15.18:0/3692487974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe710004800 0x7fe710004c80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe71c009ac0 tx=0x7fe710005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=626afd9c32b5d04a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:55.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.543+0000 7fe7267fc640 1 -- 172.21.15.18:0/3692487974 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71c036070 con 0x7fe710004800 2024-09-19T09:13:55.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.543+0000 7fe7267fc640 1 -- 172.21.15.18:0/3692487974 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe71c031400 con 0x7fe710004800 2024-09-19T09:13:55.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.543+0000 7fe7267fc640 1 -- 172.21.15.18:0/3692487974 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71c009690 con 0x7fe710004800 2024-09-19T09:13:55.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.544+0000 7fe72e047640 1 -- 172.21.15.18:0/3692487974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe710004800 msgr2=0x7fe710004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:55.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.544+0000 7fe72e047640 1 --2- 172.21.15.18:0/3692487974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe710004800 0x7fe710004c80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe71c009ac0 tx=0x7fe710005830 comp rx=0 tx=0).stop 2024-09-19T09:13:55.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.544+0000 7fe72e047640 1 -- 172.21.15.18:0/3692487974 shutdown_connections 2024-09-19T09:13:55.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.544+0000 7fe72e047640 1 --2- 172.21.15.18:0/3692487974 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe710004800 0x7fe710004c80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:55.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.544+0000 7fe72e047640 1 -- 172.21.15.18:0/3692487974 >> 172.21.15.18:0/3692487974 conn(0x7fe7280b4600 msgr2=0x7fe7280b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:55.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.544+0000 7fe72e047640 1 -- 172.21.15.18:0/3692487974 shutdown_connections 2024-09-19T09:13:55.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.544+0000 7fe72e047640 1 -- 172.21.15.18:0/3692487974 wait complete. 2024-09-19T09:13:55.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.545+0000 7fe72e047640 1 Processor -- start 2024-09-19T09:13:55.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.545+0000 7fe72e047640 1 -- start start 2024-09-19T09:13:55.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.546+0000 7fe72e047640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe710004800 0x7fe728152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:55.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.546+0000 7fe72e047640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7281610f0 0x7fe7280b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:55.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.546+0000 7fe72e047640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe728161570 0x7fe7280b3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:55.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.546+0000 7fe72e047640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe72815f290 con 0x7fe728161570 2024-09-19T09:13:55.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.546+0000 7fe72e047640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe72815f110 con 0x7fe7281610f0 2024-09-19T09:13:55.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.546+0000 7fe72e047640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe7281629e0 con 0x7fe710004800 2024-09-19T09:13:55.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.546+0000 7fe727fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe728161570 0x7fe7280b3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:55.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.546+0000 7fe727fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe728161570 0x7fe7280b3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33524/0 (socket says 172.21.15.18:33524) 2024-09-19T09:13:55.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.546+0000 7fe7277fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe710004800 0x7fe728152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:55.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.546+0000 7fe727fff640 1 -- 172.21.15.18:0/538401848 learned_addr learned my addr 172.21.15.18:0/538401848 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:55.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.546+0000 7fe726ffd640 1 --2- 172.21.15.18:0/538401848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7281610f0 0x7fe7280b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:55.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.546+0000 7fe727fff640 1 -- 172.21.15.18:0/538401848 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe710004800 msgr2=0x7fe728152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:55.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.546+0000 7fe727fff640 1 --2- 172.21.15.18:0/538401848 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe710004800 0x7fe728152e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:55.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.546+0000 7fe727fff640 1 -- 172.21.15.18:0/538401848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7281610f0 msgr2=0x7fe7280b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:55.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.546+0000 7fe727fff640 1 --2- 172.21.15.18:0/538401848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7281610f0 0x7fe7280b39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:55.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.546+0000 7fe727fff640 1 -- 172.21.15.18:0/538401848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe72815f7f0 con 0x7fe728161570 2024-09-19T09:13:55.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.546+0000 7fe7277fe640 1 --2- 172.21.15.18:0/538401848 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe710004800 0x7fe728152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:13:55.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.546+0000 7fe727fff640 1 --2- 172.21.15.18:0/538401848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe728161570 0x7fe7280b3f10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe728163300 tx=0x7fe72000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:55.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.546+0000 7fe70ffff640 1 -- 172.21.15.18:0/538401848 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72000eb30 con 0x7fe728161570 2024-09-19T09:13:55.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.547+0000 7fe70ffff640 1 -- 172.21.15.18:0/538401848 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe720018070 con 0x7fe728161570 2024-09-19T09:13:55.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.547+0000 7fe72e047640 1 -- 172.21.15.18:0/538401848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe72815fad0 con 0x7fe728161570 2024-09-19T09:13:55.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.547+0000 7fe70ffff640 1 -- 172.21.15.18:0/538401848 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe720013420 con 0x7fe728161570 2024-09-19T09:13:55.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.547+0000 7fe72e047640 1 -- 172.21.15.18:0/538401848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe728160090 con 0x7fe728161570 2024-09-19T09:13:55.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.548+0000 7fe72e047640 1 -- 172.21.15.18:0/538401848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7280694a0 con 0x7fe728161570 2024-09-19T09:13:55.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.548+0000 7fe70ffff640 1 -- 172.21.15.18:0/538401848 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe7200135c0 con 0x7fe728161570 2024-09-19T09:13:55.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.548+0000 7fe70ffff640 1 --2- 172.21.15.18:0/538401848 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe71406c2b0 0x7fe71406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:55.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.549+0000 7fe70ffff640 1 -- 172.21.15.18:0/538401848 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fe72008b5c0 con 0x7fe728161570 2024-09-19T09:13:55.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.549+0000 7fe7277fe640 1 --2- 172.21.15.18:0/538401848 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe71406c2b0 0x7fe71406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:55.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.549+0000 7fe7277fe640 1 --2- 172.21.15.18:0/538401848 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe71406c2b0 0x7fe71406e770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe718000c00 tx=0x7fe718009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:55.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.553+0000 7fe70ffff640 1 -- 172.21.15.18:0/538401848 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe7280694a0 con 0x7fe728161570 2024-09-19T09:13:55.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.767+0000 7fe72e047640 1 -- 172.21.15.18:0/538401848 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe728070260 con 0x7fe728161570 2024-09-19T09:13:55.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.767+0000 7fe70ffff640 1 -- 172.21.15.18:0/538401848 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5217 (secure 0 0 0) 0x7fe720059770 con 0x7fe728161570 2024-09-19T09:13:55.768 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:55.768 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":6,"btime":"2024-09-19T09:13:29:505412+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3070220651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3070220651},{"type":"v1","addr":"172.21.15.162:6836","nonce":3070220651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/2341594474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2341594474},{"type":"v1","addr":"172.21.15.18:6833","nonce":2341594474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/603326104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":603326104},{"type":"v1","addr":"172.21.15.18:6835","nonce":603326104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:13:26.853577+0000","modified":"2024-09-19T09:13:28.847901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6837/727689889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":727689889},{"type":"v1","addr":"172.21.15.162:6837","nonce":727689889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":1}]} 2024-09-19T09:13:55.768 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 6 2024-09-19T09:13:55.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.769+0000 7fe72e047640 1 -- 172.21.15.18:0/538401848 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe71406c2b0 msgr2=0x7fe71406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:55.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.769+0000 7fe72e047640 1 --2- 172.21.15.18:0/538401848 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe71406c2b0 0x7fe71406e770 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe718000c00 tx=0x7fe718009040 comp rx=0 tx=0).stop 2024-09-19T09:13:55.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.769+0000 7fe72e047640 1 -- 172.21.15.18:0/538401848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe728161570 msgr2=0x7fe7280b3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:55.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.769+0000 7fe72e047640 1 --2- 172.21.15.18:0/538401848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe728161570 0x7fe7280b3f10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe728163300 tx=0x7fe72000e530 comp rx=0 tx=0).stop 2024-09-19T09:13:55.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.769+0000 7fe72e047640 1 -- 172.21.15.18:0/538401848 shutdown_connections 2024-09-19T09:13:55.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.769+0000 7fe72e047640 1 --2- 172.21.15.18:0/538401848 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe71406c2b0 0x7fe71406e770 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:55.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.769+0000 7fe72e047640 1 --2- 172.21.15.18:0/538401848 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe728161570 0x7fe7280b3f10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:55.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.769+0000 7fe72e047640 1 --2- 172.21.15.18:0/538401848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7281610f0 0x7fe7280b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:55.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.769+0000 7fe72e047640 1 --2- 172.21.15.18:0/538401848 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe710004800 0x7fe728152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:55.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.769+0000 7fe72e047640 1 -- 172.21.15.18:0/538401848 >> 172.21.15.18:0/538401848 conn(0x7fe7280b4600 msgr2=0x7fe7280b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:55.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.769+0000 7fe72e047640 1 -- 172.21.15.18:0/538401848 shutdown_connections 2024-09-19T09:13:55.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.769+0000 7fe72e047640 1 -- 172.21.15.18:0/538401848 wait complete. 2024-09-19T09:13:55.781 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:13:55.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.883+0000 7f429deba640 1 Processor -- start 2024-09-19T09:13:55.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.883+0000 7f429deba640 1 -- start start 2024-09-19T09:13:55.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.884+0000 7f429deba640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42980cfae0 0x7f42980b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:55.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.884+0000 7f429deba640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42980cd1a0 con 0x7f429815ef80 2024-09-19T09:13:55.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.884+0000 7f429deba640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f429806dc30 con 0x7f429806d730 2024-09-19T09:13:55.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.884+0000 7f429deba640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f42980cd7d0 con 0x7f42980cfae0 2024-09-19T09:13:55.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.884+0000 7f42977fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f429815ef80 0x7f42980cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:47288/0 (socket says 172.21.15.18:47288) 2024-09-19T09:13:55.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.884+0000 7f42977fe640 1 -- 172.21.15.18:0/2252020080 learned_addr learned my addr 172.21.15.18:0/2252020080 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:55.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.885+0000 7f4296ffd640 1 --2- 172.21.15.18:0/2252020080 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42980cfae0 0x7f42980b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:55.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.885+0000 7f42967fc640 1 -- 172.21.15.18:0/2252020080 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 18548650 0 0) 0x7f42980cd1a0 con 0x7f429815ef80 2024-09-19T09:13:55.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.885+0000 7f42967fc640 1 -- 172.21.15.18:0/2252020080 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4280003520 con 0x7f429815ef80 2024-09-19T09:13:55.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.885+0000 7f42967fc640 1 -- 172.21.15.18:0/2252020080 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2151836309 0 0) 0x7f429806dc30 con 0x7f429806d730 2024-09-19T09:13:55.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.885+0000 7f42967fc640 1 -- 172.21.15.18:0/2252020080 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42980cd1a0 con 0x7f429806d730 2024-09-19T09:13:55.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.885+0000 7f42967fc640 1 -- 172.21.15.18:0/2252020080 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2064846483 0 0) 0x7f4280003520 con 0x7f429815ef80 2024-09-19T09:13:55.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.885+0000 7f42967fc640 1 -- 172.21.15.18:0/2252020080 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42980cfae0 msgr2=0x7f42980b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:55.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.885+0000 7f42967fc640 1 --2- 172.21.15.18:0/2252020080 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42980cfae0 0x7f42980b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:55.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.885+0000 7f42967fc640 1 -- 172.21.15.18:0/2252020080 >> v1:172.21.15.162:6789/0 conn(0x7f429806d730 legacy=0x7f42980cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:55.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.885+0000 7f42967fc640 1 -- 172.21.15.18:0/2252020080 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f429806df10 con 0x7f429815ef80 2024-09-19T09:13:55.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.885+0000 7f42967fc640 1 -- 172.21.15.18:0/2252020080 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f4288001670 con 0x7f429815ef80 2024-09-19T09:13:55.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.885+0000 7f42967fc640 1 -- 172.21.15.18:0/2252020080 >> v1:172.21.15.18:6789/0 conn(0x7f429815ef80 legacy=0x7f42980cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:55.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.885+0000 7f42967fc640 1 --2- 172.21.15.18:0/2252020080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4280003b70 0x7f4280003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:55.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.885+0000 7f42967fc640 1 --2- 172.21.15.18:0/2252020080 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42980cfae0 0x7f4280004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:55.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.885+0000 7f42967fc640 1 --2- 172.21.15.18:0/2252020080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4280004d40 0x7f42800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:55.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.885+0000 7f42967fc640 1 -- 172.21.15.18:0/2252020080 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f42980cd7d0 con 0x7f4280003b70 2024-09-19T09:13:55.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.885+0000 7f42967fc640 1 -- 172.21.15.18:0/2252020080 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f428000baa0 con 0x7f4280004d40 2024-09-19T09:13:55.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.885+0000 7f42967fc640 1 -- 172.21.15.18:0/2252020080 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f428000bca0 con 0x7f42980cfae0 2024-09-19T09:13:55.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.885+0000 7f42977fe640 1 --2- 172.21.15.18:0/2252020080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4280003b70 0x7f4280003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:55.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.885+0000 7f4296ffd640 1 --2- 172.21.15.18:0/2252020080 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42980cfae0 0x7f4280004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:55.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.885+0000 7f4297fff640 1 --2- 172.21.15.18:0/2252020080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4280004d40 0x7f42800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:55.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.885+0000 7f42977fe640 1 -- 172.21.15.18:0/2252020080 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42980cfae0 msgr2=0x7f4280004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:55.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.885+0000 7f42977fe640 1 --2- 172.21.15.18:0/2252020080 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42980cfae0 0x7f4280004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:55.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.885+0000 7f42977fe640 1 -- 172.21.15.18:0/2252020080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4280004d40 msgr2=0x7f42800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:55.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.885+0000 7f42977fe640 1 --2- 172.21.15.18:0/2252020080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4280004d40 0x7f42800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:55.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.885+0000 7f42977fe640 1 -- 172.21.15.18:0/2252020080 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4280003520 con 0x7f4280003b70 2024-09-19T09:13:55.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.886+0000 7f42977fe640 1 --2- 172.21.15.18:0/2252020080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4280003b70 0x7f4280003f70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f428800c0e0 tx=0x7f4280005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2562d8ea63bdacf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:55.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.886+0000 7f42967fc640 1 -- 172.21.15.18:0/2252020080 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4288007c40 con 0x7f4280003b70 2024-09-19T09:13:55.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.886+0000 7f42967fc640 1 -- 172.21.15.18:0/2252020080 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4288005ad0 con 0x7f4280003b70 2024-09-19T09:13:55.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.886+0000 7f42967fc640 1 -- 172.21.15.18:0/2252020080 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4288007070 con 0x7f4280003b70 2024-09-19T09:13:55.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.887+0000 7f429deba640 1 -- 172.21.15.18:0/2252020080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4280003b70 msgr2=0x7f4280003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:55.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.887+0000 7f429deba640 1 --2- 172.21.15.18:0/2252020080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4280003b70 0x7f4280003f70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f428800c0e0 tx=0x7f4280005830 comp rx=0 tx=0).stop 2024-09-19T09:13:55.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.887+0000 7f4297fff640 1 -- 172.21.15.18:0/2252020080 reap_dead start 2024-09-19T09:13:55.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.887+0000 7f429deba640 1 -- 172.21.15.18:0/2252020080 shutdown_connections 2024-09-19T09:13:55.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.887+0000 7f429deba640 1 -- 172.21.15.18:0/2252020080 >> 172.21.15.18:0/2252020080 conn(0x7f42980b4700 msgr2=0x7f42980b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:55.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.887+0000 7f429deba640 1 -- 172.21.15.18:0/2252020080 shutdown_connections 2024-09-19T09:13:55.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.887+0000 7f429deba640 1 -- 172.21.15.18:0/2252020080 wait complete. 2024-09-19T09:13:55.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.888+0000 7f429deba640 1 Processor -- start 2024-09-19T09:13:55.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.888+0000 7f429deba640 1 -- start start 2024-09-19T09:13:55.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.889+0000 7f429deba640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4280003b70 0x7f42980b84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:55.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.889+0000 7f429deba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42980b5a00 0x7f42980b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:55.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.889+0000 7f429deba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42980b63c0 0x7f42980c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:55.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.889+0000 7f429deba640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f42980d0120 con 0x7f42980b5a00 2024-09-19T09:13:55.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.889+0000 7f429deba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f429815f360 con 0x7f42980b63c0 2024-09-19T09:13:55.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.889+0000 7f429deba640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f42980b5220 con 0x7f4280003b70 2024-09-19T09:13:55.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.889+0000 7f4296ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42980b5a00 0x7f42980b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:55.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.889+0000 7f4296ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42980b5a00 0x7f42980b5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33536/0 (socket says 172.21.15.18:33536) 2024-09-19T09:13:55.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.889+0000 7f4296ffd640 1 -- 172.21.15.18:0/3970369243 learned_addr learned my addr 172.21.15.18:0/3970369243 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:55.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.889+0000 7f42977fe640 1 --2- 172.21.15.18:0/3970369243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4280003b70 0x7f42980b84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:55.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.889+0000 7f4297fff640 1 --2- 172.21.15.18:0/3970369243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42980b63c0 0x7f42980c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:55.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.889+0000 7f4296ffd640 1 -- 172.21.15.18:0/3970369243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4280003b70 msgr2=0x7f42980b84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:55.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.889+0000 7f4296ffd640 1 --2- 172.21.15.18:0/3970369243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4280003b70 0x7f42980b84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:55.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.889+0000 7f4296ffd640 1 -- 172.21.15.18:0/3970369243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42980b63c0 msgr2=0x7f42980c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:55.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.889+0000 7f4296ffd640 1 --2- 172.21.15.18:0/3970369243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42980b63c0 0x7f42980c79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:55.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.889+0000 7f4296ffd640 1 -- 172.21.15.18:0/3970369243 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42980b6840 con 0x7f42980b5a00 2024-09-19T09:13:55.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.889+0000 7f4297fff640 1 --2- 172.21.15.18:0/3970369243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42980b63c0 0x7f42980c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:13:55.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.890+0000 7f4296ffd640 1 --2- 172.21.15.18:0/3970369243 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42980b5a00 0x7f42980b5e80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f428c011990 tx=0x7f428c011e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:55.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.890+0000 7f427ffff640 1 -- 172.21.15.18:0/3970369243 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428c019070 con 0x7f42980b5a00 2024-09-19T09:13:55.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.890+0000 7f427ffff640 1 -- 172.21.15.18:0/3970369243 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f428c004300 con 0x7f42980b5a00 2024-09-19T09:13:55.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.890+0000 7f427ffff640 1 -- 172.21.15.18:0/3970369243 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428c00fa80 con 0x7f42980b5a00 2024-09-19T09:13:55.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.890+0000 7f429deba640 1 -- 172.21.15.18:0/3970369243 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42980c6640 con 0x7f42980b5a00 2024-09-19T09:13:55.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.890+0000 7f429deba640 1 -- 172.21.15.18:0/3970369243 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42980c6c00 con 0x7f42980b5a00 2024-09-19T09:13:55.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.891+0000 7f429deba640 1 -- 172.21.15.18:0/3970369243 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42980b5550 con 0x7f42980b5a00 2024-09-19T09:13:55.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.892+0000 7f427ffff640 1 -- 172.21.15.18:0/3970369243 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f428c01c070 con 0x7f42980b5a00 2024-09-19T09:13:55.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.892+0000 7f427ffff640 1 --2- 172.21.15.18:0/3970369243 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f428406c2e0 0x7f428406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:55.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.892+0000 7f427ffff640 1 -- 172.21.15.18:0/3970369243 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f428c08b780 con 0x7f42980b5a00 2024-09-19T09:13:55.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.892+0000 7f42977fe640 1 --2- 172.21.15.18:0/3970369243 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f428406c2e0 0x7f428406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:55.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.893+0000 7f42977fe640 1 --2- 172.21.15.18:0/3970369243 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f428406c2e0 0x7f428406e7a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4288032000 tx=0x7f4288034040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:55.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:55.896+0000 7f427ffff640 1 -- 172.21.15.18:0/3970369243 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f428c0598a0 con 0x7f42980b5a00 2024-09-19T09:13:56.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.109+0000 7f429deba640 1 -- 172.21.15.18:0/3970369243 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42980cff00 con 0x7f42980b5a00 2024-09-19T09:13:56.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.110+0000 7f427ffff640 1 -- 172.21.15.18:0/3970369243 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5217 (secure 0 0 0) 0x7f428c0600c0 con 0x7f42980b5a00 2024-09-19T09:13:56.111 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:56.111 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":6,"btime":"2024-09-19T09:13:29:505412+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3070220651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3070220651},{"type":"v1","addr":"172.21.15.162:6836","nonce":3070220651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/2341594474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2341594474},{"type":"v1","addr":"172.21.15.18:6833","nonce":2341594474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/603326104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":603326104},{"type":"v1","addr":"172.21.15.18:6835","nonce":603326104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:13:26.853577+0000","modified":"2024-09-19T09:13:28.847901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6837/727689889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":727689889},{"type":"v1","addr":"172.21.15.162:6837","nonce":727689889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":1}]} 2024-09-19T09:13:56.111 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 6 2024-09-19T09:13:56.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.112+0000 7f429deba640 1 -- 172.21.15.18:0/3970369243 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f428406c2e0 msgr2=0x7f428406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:56.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.112+0000 7f429deba640 1 --2- 172.21.15.18:0/3970369243 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f428406c2e0 0x7f428406e7a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4288032000 tx=0x7f4288034040 comp rx=0 tx=0).stop 2024-09-19T09:13:56.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.112+0000 7f429deba640 1 -- 172.21.15.18:0/3970369243 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42980b5a00 msgr2=0x7f42980b5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:56.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.112+0000 7f429deba640 1 --2- 172.21.15.18:0/3970369243 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42980b5a00 0x7f42980b5e80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f428c011990 tx=0x7f428c011e50 comp rx=0 tx=0).stop 2024-09-19T09:13:56.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.112+0000 7f429deba640 1 -- 172.21.15.18:0/3970369243 shutdown_connections 2024-09-19T09:13:56.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.112+0000 7f429deba640 1 --2- 172.21.15.18:0/3970369243 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f428406c2e0 0x7f428406e7a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.112+0000 7f429deba640 1 --2- 172.21.15.18:0/3970369243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42980b63c0 0x7f42980c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.112+0000 7f429deba640 1 --2- 172.21.15.18:0/3970369243 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f42980b5a00 0x7f42980b5e80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.112+0000 7f429deba640 1 --2- 172.21.15.18:0/3970369243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4280003b70 0x7f42980b84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.112+0000 7f429deba640 1 -- 172.21.15.18:0/3970369243 >> 172.21.15.18:0/3970369243 conn(0x7f42980b4700 msgr2=0x7f4298162020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:56.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.112+0000 7f429deba640 1 -- 172.21.15.18:0/3970369243 shutdown_connections 2024-09-19T09:13:56.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.112+0000 7f429deba640 1 -- 172.21.15.18:0/3970369243 wait complete. 2024-09-19T09:13:56.124 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:13:56.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.225+0000 7f84c1d5b640 1 Processor -- start 2024-09-19T09:13:56.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.225+0000 7f84c1d5b640 1 -- start start 2024-09-19T09:13:56.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.226+0000 7f84c1d5b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f84bc0b3ce0 0x7f84bc0cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:56.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.226+0000 7f84c1d5b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84bc0d0e10 con 0x7f84bc0cf560 2024-09-19T09:13:56.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.226+0000 7f84c1d5b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84bc0d0850 con 0x7f84bc0d0050 2024-09-19T09:13:56.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.226+0000 7f84c1d5b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f84bc0d0b30 con 0x7f84bc0b3ce0 2024-09-19T09:13:56.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.226+0000 7f84bb7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f84bc0cf560 0x7f84bc0cf940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:47290/0 (socket says 172.21.15.18:47290) 2024-09-19T09:13:56.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.226+0000 7f84bb7fe640 1 -- 172.21.15.18:0/1408496367 learned_addr learned my addr 172.21.15.18:0/1408496367 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:56.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.227+0000 7f84baffd640 1 --2- 172.21.15.18:0/1408496367 >> v2:172.21.15.162:3300/0 conn(0x7f84bc0b3ce0 0x7f84bc0cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:56.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.227+0000 7f84ba7fc640 1 -- 172.21.15.18:0/1408496367 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2543673758 0 0) 0x7f84bc0d0e10 con 0x7f84bc0cf560 2024-09-19T09:13:56.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.227+0000 7f84ba7fc640 1 -- 172.21.15.18:0/1408496367 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84a4003520 con 0x7f84bc0cf560 2024-09-19T09:13:56.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.227+0000 7f84ba7fc640 1 -- 172.21.15.18:0/1408496367 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2697959129 0 0) 0x7f84a4003520 con 0x7f84bc0cf560 2024-09-19T09:13:56.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.227+0000 7f84ba7fc640 1 -- 172.21.15.18:0/1408496367 >> v2:172.21.15.162:3300/0 conn(0x7f84bc0b3ce0 msgr2=0x7f84bc0cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:56.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.227+0000 7f84ba7fc640 1 --2- 172.21.15.18:0/1408496367 >> v2:172.21.15.162:3300/0 conn(0x7f84bc0b3ce0 0x7f84bc0cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.227+0000 7f84ba7fc640 1 -- 172.21.15.18:0/1408496367 >> v1:172.21.15.162:6789/0 conn(0x7f84bc0d0050 legacy=0x7f84bc0cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:56.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.227+0000 7f84ba7fc640 1 -- 172.21.15.18:0/1408496367 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84bc0b24d0 con 0x7f84bc0cf560 2024-09-19T09:13:56.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.227+0000 7f84ba7fc640 1 -- 172.21.15.18:0/1408496367 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f84ac001670 con 0x7f84bc0cf560 2024-09-19T09:13:56.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.227+0000 7f84ba7fc640 1 -- 172.21.15.18:0/1408496367 >> v1:172.21.15.18:6789/0 conn(0x7f84bc0cf560 legacy=0x7f84bc0cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:56.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.227+0000 7f84ba7fc640 1 --2- 172.21.15.18:0/1408496367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84a40039b0 0x7f84a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:56.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.227+0000 7f84ba7fc640 1 --2- 172.21.15.18:0/1408496367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84a4004800 0x7f84a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:56.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.227+0000 7f84ba7fc640 1 --2- 172.21.15.18:0/1408496367 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84a40052e0 0x7f84a400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:56.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.227+0000 7f84ba7fc640 1 -- 172.21.15.18:0/1408496367 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f84bc0d0b30 con 0x7f84a40039b0 2024-09-19T09:13:56.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.227+0000 7f84ba7fc640 1 -- 172.21.15.18:0/1408496367 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f84a400c1b0 con 0x7f84a4004800 2024-09-19T09:13:56.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.227+0000 7f84ba7fc640 1 -- 172.21.15.18:0/1408496367 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f84a400c3b0 con 0x7f84a40052e0 2024-09-19T09:13:56.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.227+0000 7f84bb7fe640 1 --2- 172.21.15.18:0/1408496367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84a40039b0 0x7f84a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:56.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.227+0000 7f84baffd640 1 --2- 172.21.15.18:0/1408496367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84a4004800 0x7f84a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:56.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.227+0000 7f84bbfff640 1 --2- 172.21.15.18:0/1408496367 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84a40052e0 0x7f84a400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:56.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.227+0000 7f84bb7fe640 1 -- 172.21.15.18:0/1408496367 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84a40052e0 msgr2=0x7f84a400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:56.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.227+0000 7f84bb7fe640 1 --2- 172.21.15.18:0/1408496367 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84a40052e0 0x7f84a400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.227+0000 7f84bb7fe640 1 -- 172.21.15.18:0/1408496367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84a4004800 msgr2=0x7f84a4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:56.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.227+0000 7f84bb7fe640 1 --2- 172.21.15.18:0/1408496367 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84a4004800 0x7f84a4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.227+0000 7f84bbfff640 1 -- 172.21.15.18:0/1408496367 reap_dead start 2024-09-19T09:13:56.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.227+0000 7f84bb7fe640 1 -- 172.21.15.18:0/1408496367 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84a4003520 con 0x7f84a40039b0 2024-09-19T09:13:56.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.228+0000 7f84bb7fe640 1 --2- 172.21.15.18:0/1408496367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84a40039b0 0x7f84a4003dd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f84ac001eb0 tx=0x7f84a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8789b15aa3c32d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:56.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.228+0000 7f84ba7fc640 1 -- 172.21.15.18:0/1408496367 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac007d30 con 0x7f84a40039b0 2024-09-19T09:13:56.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.228+0000 7f84ba7fc640 1 -- 172.21.15.18:0/1408496367 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84ac005af0 con 0x7f84a40039b0 2024-09-19T09:13:56.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.228+0000 7f84ba7fc640 1 -- 172.21.15.18:0/1408496367 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac007070 con 0x7f84a40039b0 2024-09-19T09:13:56.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.229+0000 7f84c1d5b640 1 -- 172.21.15.18:0/1408496367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84a40039b0 msgr2=0x7f84a4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:56.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.229+0000 7f84c1d5b640 1 --2- 172.21.15.18:0/1408496367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84a40039b0 0x7f84a4003dd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f84ac001eb0 tx=0x7f84a4005830 comp rx=0 tx=0).stop 2024-09-19T09:13:56.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.229+0000 7f84c1d5b640 1 -- 172.21.15.18:0/1408496367 shutdown_connections 2024-09-19T09:13:56.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.229+0000 7f84c1d5b640 1 --2- 172.21.15.18:0/1408496367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84a40039b0 0x7f84a4003dd0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.229+0000 7f84c1d5b640 1 -- 172.21.15.18:0/1408496367 >> 172.21.15.18:0/1408496367 conn(0x7f84bc0b4700 msgr2=0x7f84bc0b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:56.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.229+0000 7f84c1d5b640 1 -- 172.21.15.18:0/1408496367 shutdown_connections 2024-09-19T09:13:56.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.229+0000 7f84c1d5b640 1 -- 172.21.15.18:0/1408496367 wait complete. 2024-09-19T09:13:56.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.230+0000 7f84c1d5b640 1 Processor -- start 2024-09-19T09:13:56.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.230+0000 7f84c1d5b640 1 -- start start 2024-09-19T09:13:56.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.231+0000 7f84c1d5b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84a40039b0 0x7f84bc0b7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:56.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.231+0000 7f84c1d5b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84bc0b8030 0x7f84bc06e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:56.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.231+0000 7f84c1d5b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84bc06e960 0x7f84bc15bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:56.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.231+0000 7f84c1d5b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f84bc0b55a0 con 0x7f84bc0b8030 2024-09-19T09:13:56.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.231+0000 7f84c1d5b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f84bc0b5420 con 0x7f84a40039b0 2024-09-19T09:13:56.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.231+0000 7f84c1d5b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f84bc15d090 con 0x7f84bc06e960 2024-09-19T09:13:56.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.231+0000 7f84baffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84bc0b8030 0x7f84bc06e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:56.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.231+0000 7f84baffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84bc0b8030 0x7f84bc06e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33546/0 (socket says 172.21.15.18:33546) 2024-09-19T09:13:56.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.231+0000 7f84baffd640 1 -- 172.21.15.18:0/3476978451 learned_addr learned my addr 172.21.15.18:0/3476978451 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:56.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.231+0000 7f84bb7fe640 1 --2- 172.21.15.18:0/3476978451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84a40039b0 0x7f84bc0b7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:56.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.231+0000 7f84bbfff640 1 --2- 172.21.15.18:0/3476978451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84bc06e960 0x7f84bc15bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:56.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.232+0000 7f84baffd640 1 -- 172.21.15.18:0/3476978451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84bc06e960 msgr2=0x7f84bc15bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:56.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.232+0000 7f84baffd640 1 --2- 172.21.15.18:0/3476978451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84bc06e960 0x7f84bc15bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.232+0000 7f84baffd640 1 -- 172.21.15.18:0/3476978451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84a40039b0 msgr2=0x7f84bc0b7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:56.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.232+0000 7f84baffd640 1 --2- 172.21.15.18:0/3476978451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84a40039b0 0x7f84bc0b7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.232+0000 7f84baffd640 1 -- 172.21.15.18:0/3476978451 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84bc0b5ba0 con 0x7f84bc0b8030 2024-09-19T09:13:56.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.232+0000 7f84baffd640 1 --2- 172.21.15.18:0/3476978451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84bc0b8030 0x7f84bc06e420 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f84b00118c0 tx=0x7f84b0011d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:56.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.232+0000 7f84a3fff640 1 -- 172.21.15.18:0/3476978451 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b0019070 con 0x7f84bc0b8030 2024-09-19T09:13:56.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.232+0000 7f84a3fff640 1 -- 172.21.15.18:0/3476978451 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84b0004240 con 0x7f84bc0b8030 2024-09-19T09:13:56.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.232+0000 7f84c1d5b640 1 -- 172.21.15.18:0/3476978451 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84bc0b5e80 con 0x7f84bc0b8030 2024-09-19T09:13:56.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.232+0000 7f84a3fff640 1 -- 172.21.15.18:0/3476978451 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84b000f7c0 con 0x7f84bc0b8030 2024-09-19T09:13:56.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.232+0000 7f84c1d5b640 1 -- 172.21.15.18:0/3476978451 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84bc0b6440 con 0x7f84bc0b8030 2024-09-19T09:13:56.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.233+0000 7f84c1d5b640 1 -- 172.21.15.18:0/3476978451 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84bc06ed40 con 0x7f84bc0b8030 2024-09-19T09:13:56.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.233+0000 7f84a3fff640 1 -- 172.21.15.18:0/3476978451 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f84b001c070 con 0x7f84bc0b8030 2024-09-19T09:13:56.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.234+0000 7f84a3fff640 1 --2- 172.21.15.18:0/3476978451 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f84a806c2e0 0x7f84a806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:56.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.234+0000 7f84a3fff640 1 -- 172.21.15.18:0/3476978451 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f84b008b6e0 con 0x7f84bc0b8030 2024-09-19T09:13:56.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.234+0000 7f84bb7fe640 1 --2- 172.21.15.18:0/3476978451 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f84a806c2e0 0x7f84a806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:56.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.235+0000 7f84bb7fe640 1 --2- 172.21.15.18:0/3476978451 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f84a806c2e0 0x7f84a806e7a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f84a40057e0 tx=0x7f84ac02d000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:56.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.238+0000 7f84a3fff640 1 -- 172.21.15.18:0/3476978451 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f84b0059800 con 0x7f84bc0b8030 2024-09-19T09:13:56.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.415+0000 7f84c1d5b640 1 -- 172.21.15.18:0/3476978451 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f84bc0cf940 con 0x7f84bc0b8030 2024-09-19T09:13:56.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.416+0000 7f84a3fff640 1 -- 172.21.15.18:0/3476978451 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16681 (secure 0 0 0) 0x7f84b005db00 con 0x7f84bc0b8030 2024-09-19T09:13:56.417 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:56.417 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:13:28.500103+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:13:25.116784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:13:25.838110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:13:56.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.419+0000 7f84c1d5b640 1 -- 172.21.15.18:0/3476978451 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f84a806c2e0 msgr2=0x7f84a806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:56.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.419+0000 7f84c1d5b640 1 --2- 172.21.15.18:0/3476978451 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f84a806c2e0 0x7f84a806e7a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f84a40057e0 tx=0x7f84ac02d000 comp rx=0 tx=0).stop 2024-09-19T09:13:56.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.419+0000 7f84c1d5b640 1 -- 172.21.15.18:0/3476978451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84bc0b8030 msgr2=0x7f84bc06e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:56.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.419+0000 7f84c1d5b640 1 --2- 172.21.15.18:0/3476978451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84bc0b8030 0x7f84bc06e420 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f84b00118c0 tx=0x7f84b0011d80 comp rx=0 tx=0).stop 2024-09-19T09:13:56.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.419+0000 7f84c1d5b640 1 -- 172.21.15.18:0/3476978451 shutdown_connections 2024-09-19T09:13:56.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.419+0000 7f84c1d5b640 1 --2- 172.21.15.18:0/3476978451 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f84a806c2e0 0x7f84a806e7a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.419+0000 7f84c1d5b640 1 --2- 172.21.15.18:0/3476978451 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84bc06e960 0x7f84bc15bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.419+0000 7f84c1d5b640 1 --2- 172.21.15.18:0/3476978451 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84bc0b8030 0x7f84bc06e420 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.419+0000 7f84c1d5b640 1 --2- 172.21.15.18:0/3476978451 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84a40039b0 0x7f84bc0b7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.419+0000 7f84c1d5b640 1 -- 172.21.15.18:0/3476978451 >> 172.21.15.18:0/3476978451 conn(0x7f84bc0b4700 msgr2=0x7f84bc0d2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:56.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.419+0000 7f84c1d5b640 1 -- 172.21.15.18:0/3476978451 shutdown_connections 2024-09-19T09:13:56.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.419+0000 7f84c1d5b640 1 -- 172.21.15.18:0/3476978451 wait complete. 2024-09-19T09:13:56.431 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T09:13:56.431 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:13:56.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.532+0000 7fc8c05a8640 1 Processor -- start 2024-09-19T09:13:56.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.532+0000 7fc8c05a8640 1 -- start start 2024-09-19T09:13:56.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.533+0000 7fc8c05a8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8b8145290 0x7fc8b806f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:56.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.533+0000 7fc8c05a8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc8b80ce780 0x7fc8b8072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:56.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.533+0000 7fc8c05a8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc8b8071510 0x7fc8b8072d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:56.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.533+0000 7fc8c05a8640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fc8b806efe0 con 0x7fc8b8071510 2024-09-19T09:13:56.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.533+0000 7fc8c05a8640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc8b806e3d0 con 0x7fc8b80ce780 2024-09-19T09:13:56.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.533+0000 7fc8c05a8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc8b806e6b0 con 0x7fc8b8145290 2024-09-19T09:13:56.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.533+0000 7fc8beb45640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc8b8071510 0x7fc8b8072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:56.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.533+0000 7fc8beb45640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc8b8071510 0x7fc8b8072d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33554/0 (socket says 172.21.15.18:33554) 2024-09-19T09:13:56.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.533+0000 7fc8beb45640 1 -- 172.21.15.18:0/4182645565 learned_addr learned my addr 172.21.15.18:0/4182645565 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:56.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.533+0000 7fc8be344640 1 --2- 172.21.15.18:0/4182645565 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8b8145290 0x7fc8b806f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:56.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.533+0000 7fc8bdb43640 1 --2- 172.21.15.18:0/4182645565 >> v2:172.21.15.162:3300/0 conn(0x7fc8b80ce780 0x7fc8b8072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:56.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.533+0000 7fc8beb45640 1 -- 172.21.15.18:0/4182645565 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8b8145290 msgr2=0x7fc8b806f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:56.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.533+0000 7fc8beb45640 1 --2- 172.21.15.18:0/4182645565 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8b8145290 0x7fc8b806f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.533+0000 7fc8beb45640 1 -- 172.21.15.18:0/4182645565 >> v2:172.21.15.162:3300/0 conn(0x7fc8b80ce780 msgr2=0x7fc8b8072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:56.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.533+0000 7fc8beb45640 1 --2- 172.21.15.18:0/4182645565 >> v2:172.21.15.162:3300/0 conn(0x7fc8b80ce780 0x7fc8b8072830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.533+0000 7fc8beb45640 1 -- 172.21.15.18:0/4182645565 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b806e990 con 0x7fc8b8071510 2024-09-19T09:13:56.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.533+0000 7fc8be344640 1 --2- 172.21.15.18:0/4182645565 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8b8145290 0x7fc8b806f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:13:56.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.534+0000 7fc8beb45640 1 --2- 172.21.15.18:0/4182645565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8b8071510 0x7fc8b8072d70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc8b80759a0 tx=0x7fc8b002c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee822075083d079b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:56.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.534+0000 7fc8bd342640 1 -- 172.21.15.18:0/4182645565 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b000b2e0 con 0x7fc8b8071510 2024-09-19T09:13:56.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.534+0000 7fc8bd342640 1 -- 172.21.15.18:0/4182645565 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8b0009600 con 0x7fc8b8071510 2024-09-19T09:13:56.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.534+0000 7fc8bd342640 1 -- 172.21.15.18:0/4182645565 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8b000b480 con 0x7fc8b8071510 2024-09-19T09:13:56.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.535+0000 7fc8c05a8640 1 -- 172.21.15.18:0/4182645565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8b8071510 msgr2=0x7fc8b8072d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:56.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.535+0000 7fc8c05a8640 1 --2- 172.21.15.18:0/4182645565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8b8071510 0x7fc8b8072d70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc8b80759a0 tx=0x7fc8b002c8a0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.535+0000 7fc8c05a8640 1 -- 172.21.15.18:0/4182645565 shutdown_connections 2024-09-19T09:13:56.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.535+0000 7fc8c05a8640 1 --2- 172.21.15.18:0/4182645565 >> v2:172.21.15.162:3300/0 conn(0x7fc8b80ce780 0x7fc8b8072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.535+0000 7fc8c05a8640 1 --2- 172.21.15.18:0/4182645565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8b8071510 0x7fc8b8072d70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.535+0000 7fc8c05a8640 1 --2- 172.21.15.18:0/4182645565 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8b8145290 0x7fc8b806f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.535+0000 7fc8c05a8640 1 -- 172.21.15.18:0/4182645565 >> 172.21.15.18:0/4182645565 conn(0x7fc8b806bc10 msgr2=0x7fc8b806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:56.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.535+0000 7fc8c05a8640 1 -- 172.21.15.18:0/4182645565 shutdown_connections 2024-09-19T09:13:56.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.535+0000 7fc8c05a8640 1 -- 172.21.15.18:0/4182645565 wait complete. 2024-09-19T09:13:56.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.536+0000 7fc8c05a8640 1 Processor -- start 2024-09-19T09:13:56.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.536+0000 7fc8c05a8640 1 -- start start 2024-09-19T09:13:56.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.537+0000 7fc8c05a8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8b8071510 0x7fc8b815e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:56.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.537+0000 7fc8c05a8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8b80ce780 0x7fc8b815bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:56.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.537+0000 7fc8c05a8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8b8145290 0x7fc8b813c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:56.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.537+0000 7fc8c05a8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b806df80 con 0x7fc8b80ce780 2024-09-19T09:13:56.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.537+0000 7fc8c05a8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b8145670 con 0x7fc8b8071510 2024-09-19T09:13:56.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.537+0000 7fc8c05a8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc8b806e100 con 0x7fc8b8145290 2024-09-19T09:13:56.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.537+0000 7fc8bdb43640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8b80ce780 0x7fc8b815bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:56.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.537+0000 7fc8bdb43640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8b80ce780 0x7fc8b815bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33558/0 (socket says 172.21.15.18:33558) 2024-09-19T09:13:56.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.537+0000 7fc8bdb43640 1 -- 172.21.15.18:0/2609269670 learned_addr learned my addr 172.21.15.18:0/2609269670 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:56.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.537+0000 7fc8be344640 1 --2- 172.21.15.18:0/2609269670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8b8071510 0x7fc8b815e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:56.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.537+0000 7fc8beb45640 1 --2- 172.21.15.18:0/2609269670 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8b8145290 0x7fc8b813c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:56.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.537+0000 7fc8bdb43640 1 -- 172.21.15.18:0/2609269670 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8b8145290 msgr2=0x7fc8b813c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:56.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.537+0000 7fc8bdb43640 1 --2- 172.21.15.18:0/2609269670 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8b8145290 0x7fc8b813c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.537+0000 7fc8bdb43640 1 -- 172.21.15.18:0/2609269670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8b8071510 msgr2=0x7fc8b815e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:56.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.537+0000 7fc8bdb43640 1 --2- 172.21.15.18:0/2609269670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8b8071510 0x7fc8b815e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.537+0000 7fc8bdb43640 1 -- 172.21.15.18:0/2609269670 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b81416b0 con 0x7fc8b80ce780 2024-09-19T09:13:56.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.538+0000 7fc8bdb43640 1 --2- 172.21.15.18:0/2609269670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8b80ce780 0x7fc8b815bf00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc8a800d7d0 tx=0x7fc8a800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:56.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.538+0000 7fc8aeffd640 1 -- 172.21.15.18:0/2609269670 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8018030 con 0x7fc8b80ce780 2024-09-19T09:13:56.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.538+0000 7fc8aeffd640 1 -- 172.21.15.18:0/2609269670 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8a8004020 con 0x7fc8b80ce780 2024-09-19T09:13:56.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.538+0000 7fc8c05a8640 1 -- 172.21.15.18:0/2609269670 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b815c630 con 0x7fc8b80ce780 2024-09-19T09:13:56.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.538+0000 7fc8aeffd640 1 -- 172.21.15.18:0/2609269670 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8a8004230 con 0x7fc8b80ce780 2024-09-19T09:13:56.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.538+0000 7fc8c05a8640 1 -- 172.21.15.18:0/2609269670 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b815cbf0 con 0x7fc8b80ce780 2024-09-19T09:13:56.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.539+0000 7fc8c05a8640 1 -- 172.21.15.18:0/2609269670 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8b806f470 con 0x7fc8b80ce780 2024-09-19T09:13:56.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.539+0000 7fc8aeffd640 1 -- 172.21.15.18:0/2609269670 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc8a801b070 con 0x7fc8b80ce780 2024-09-19T09:13:56.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.540+0000 7fc8aeffd640 1 --2- 172.21.15.18:0/2609269670 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc89c06c2b0 0x7fc89c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:56.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.540+0000 7fc8aeffd640 1 -- 172.21.15.18:0/2609269670 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fc8a808b360 con 0x7fc8b80ce780 2024-09-19T09:13:56.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.540+0000 7fc8be344640 1 --2- 172.21.15.18:0/2609269670 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc89c06c2b0 0x7fc89c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:56.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.540+0000 7fc8be344640 1 --2- 172.21.15.18:0/2609269670 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc89c06c2b0 0x7fc89c06e770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4006e80 tx=0x7fc8b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:56.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.544+0000 7fc8aeffd640 1 -- 172.21.15.18:0/2609269670 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc8a8059510 con 0x7fc8b80ce780 2024-09-19T09:13:56.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.758+0000 7fc8c05a8640 1 -- 172.21.15.18:0/2609269670 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8b81405d0 con 0x7fc8b80ce780 2024-09-19T09:13:56.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.759+0000 7fc8aeffd640 1 -- 172.21.15.18:0/2609269670 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5217 (secure 0 0 0) 0x7fc8a805d810 con 0x7fc8b80ce780 2024-09-19T09:13:56.760 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:56.760 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":6,"btime":"2024-09-19T09:13:29:505412+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3070220651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3070220651},{"type":"v1","addr":"172.21.15.162:6836","nonce":3070220651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/2341594474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2341594474},{"type":"v1","addr":"172.21.15.18:6833","nonce":2341594474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/603326104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":603326104},{"type":"v1","addr":"172.21.15.18:6835","nonce":603326104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:13:26.853577+0000","modified":"2024-09-19T09:13:28.847901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6837/727689889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":727689889},{"type":"v1","addr":"172.21.15.162:6837","nonce":727689889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":1}]} 2024-09-19T09:13:56.760 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 6 2024-09-19T09:13:56.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.761+0000 7fc8c05a8640 1 -- 172.21.15.18:0/2609269670 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc89c06c2b0 msgr2=0x7fc89c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:56.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.761+0000 7fc8c05a8640 1 --2- 172.21.15.18:0/2609269670 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc89c06c2b0 0x7fc89c06e770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc8b4006e80 tx=0x7fc8b4008040 comp rx=0 tx=0).stop 2024-09-19T09:13:56.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.761+0000 7fc8c05a8640 1 -- 172.21.15.18:0/2609269670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8b80ce780 msgr2=0x7fc8b815bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:56.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.761+0000 7fc8c05a8640 1 --2- 172.21.15.18:0/2609269670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8b80ce780 0x7fc8b815bf00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc8a800d7d0 tx=0x7fc8a800dc90 comp rx=0 tx=0).stop 2024-09-19T09:13:56.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.761+0000 7fc8c05a8640 1 -- 172.21.15.18:0/2609269670 shutdown_connections 2024-09-19T09:13:56.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.761+0000 7fc8c05a8640 1 --2- 172.21.15.18:0/2609269670 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc89c06c2b0 0x7fc89c06e770 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.761+0000 7fc8c05a8640 1 --2- 172.21.15.18:0/2609269670 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8b8145290 0x7fc8b813c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.761+0000 7fc8c05a8640 1 --2- 172.21.15.18:0/2609269670 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8b80ce780 0x7fc8b815bf00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.761+0000 7fc8c05a8640 1 --2- 172.21.15.18:0/2609269670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8b8071510 0x7fc8b815e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.761+0000 7fc8c05a8640 1 -- 172.21.15.18:0/2609269670 >> 172.21.15.18:0/2609269670 conn(0x7fc8b806bc10 msgr2=0x7fc8b80b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:56.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.761+0000 7fc8c05a8640 1 -- 172.21.15.18:0/2609269670 shutdown_connections 2024-09-19T09:13:56.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.761+0000 7fc8c05a8640 1 -- 172.21.15.18:0/2609269670 wait complete. 2024-09-19T09:13:56.773 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:13:56.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.876+0000 7f6a4e88d640 1 Processor -- start 2024-09-19T09:13:56.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.876+0000 7f6a4e88d640 1 -- start start 2024-09-19T09:13:56.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.877+0000 7f6a4e88d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6a4815ef80 0x7f6a480b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:56.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.877+0000 7f6a4e88d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a4806d730 0x7f6a480cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:56.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.877+0000 7f6a4e88d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a480cd1a0 con 0x7f6a480cf910 2024-09-19T09:13:56.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.877+0000 7f6a4e88d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6a480cd7d0 con 0x7f6a4815ef80 2024-09-19T09:13:56.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.877+0000 7f6a4e88d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6a4806dc30 con 0x7f6a4806d730 2024-09-19T09:13:56.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.877+0000 7f6a477fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a4806d730 0x7f6a480cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:56.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.877+0000 7f6a47fff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6a4815ef80 0x7f6a480b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:56.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.877+0000 7f6a477fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a4806d730 0x7f6a480cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:38670/0 (socket says 172.21.15.18:38670) 2024-09-19T09:13:56.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.877+0000 7f6a477fe640 1 -- 172.21.15.18:0/1916346519 learned_addr learned my addr 172.21.15.18:0/1916346519 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:56.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.877+0000 7f6a4ce2a640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f6a480cf910 0x7f6a480d0ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:51292/0 (socket says 172.21.15.18:51292) 2024-09-19T09:13:56.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.878+0000 7f6a477fe640 1 -- 172.21.15.18:0/1916346519 >> v2:172.21.15.162:3300/0 conn(0x7f6a4815ef80 msgr2=0x7f6a480b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:56.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.878+0000 7f6a477fe640 1 --2- 172.21.15.18:0/1916346519 >> v2:172.21.15.162:3300/0 conn(0x7f6a4815ef80 0x7f6a480b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.878+0000 7f6a477fe640 1 -- 172.21.15.18:0/1916346519 >> v1:172.21.15.162:6789/0 conn(0x7f6a480cf910 legacy=0x7f6a480d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:56.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.878+0000 7f6a477fe640 1 -- 172.21.15.18:0/1916346519 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a4806df10 con 0x7f6a4806d730 2024-09-19T09:13:56.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.878+0000 7f6a46ffd640 1 -- 172.21.15.18:0/1916346519 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 460276232 0 0) 0x7f6a480cd1a0 con 0x7f6a480cf910 2024-09-19T09:13:56.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.878+0000 7f6a47fff640 1 --2- 172.21.15.18:0/1916346519 >> v2:172.21.15.162:3300/0 conn(0x7f6a4815ef80 0x7f6a480b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:13:56.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.878+0000 7f6a477fe640 1 --2- 172.21.15.18:0/1916346519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a4806d730 0x7f6a480cf3d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c009870 tx=0x7f6a3c02a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=401e57ab8fa36271 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:56.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.879+0000 7f6a46ffd640 1 -- 172.21.15.18:0/1916346519 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c037070 con 0x7f6a4806d730 2024-09-19T09:13:56.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.879+0000 7f6a46ffd640 1 -- 172.21.15.18:0/1916346519 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a3c032440 con 0x7f6a4806d730 2024-09-19T09:13:56.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.879+0000 7f6a46ffd640 1 -- 172.21.15.18:0/1916346519 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c032810 con 0x7f6a4806d730 2024-09-19T09:13:56.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.879+0000 7f6a4e88d640 1 -- 172.21.15.18:0/1916346519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a4806d730 msgr2=0x7f6a480cf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:56.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.879+0000 7f6a4e88d640 1 --2- 172.21.15.18:0/1916346519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a4806d730 0x7f6a480cf3d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c009870 tx=0x7f6a3c02a250 comp rx=0 tx=0).stop 2024-09-19T09:13:56.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.879+0000 7f6a4e88d640 1 -- 172.21.15.18:0/1916346519 shutdown_connections 2024-09-19T09:13:56.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.879+0000 7f6a4e88d640 1 --2- 172.21.15.18:0/1916346519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a4806d730 0x7f6a480cf3d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.879+0000 7f6a4e88d640 1 --2- 172.21.15.18:0/1916346519 >> v2:172.21.15.162:3300/0 conn(0x7f6a4815ef80 0x7f6a480b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.879+0000 7f6a4e88d640 1 -- 172.21.15.18:0/1916346519 >> 172.21.15.18:0/1916346519 conn(0x7f6a480b4700 msgr2=0x7f6a480b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:56.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.879+0000 7f6a4e88d640 1 -- 172.21.15.18:0/1916346519 shutdown_connections 2024-09-19T09:13:56.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.879+0000 7f6a4e88d640 1 -- 172.21.15.18:0/1916346519 wait complete. 2024-09-19T09:13:56.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.880+0000 7f6a4e88d640 1 Processor -- start 2024-09-19T09:13:56.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.881+0000 7f6a4e88d640 1 -- start start 2024-09-19T09:13:56.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.881+0000 7f6a4e88d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a4806d730 0x7f6a480b8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:56.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.881+0000 7f6a4e88d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a480cf910 0x7f6a481f42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:56.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.881+0000 7f6a4e88d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a4815ef80 0x7f6a480cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:56.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.881+0000 7f6a4e88d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6a480d0120 con 0x7f6a4815ef80 2024-09-19T09:13:56.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.881+0000 7f6a4e88d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6a4815f360 con 0x7f6a480cf910 2024-09-19T09:13:56.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.881+0000 7f6a4e88d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6a480cec70 con 0x7f6a4806d730 2024-09-19T09:13:56.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.881+0000 7f6a4ce2a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a4815ef80 0x7f6a480cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:56.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.881+0000 7f6a4ce2a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a4815ef80 0x7f6a480cb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33560/0 (socket says 172.21.15.18:33560) 2024-09-19T09:13:56.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.881+0000 7f6a4ce2a640 1 -- 172.21.15.18:0/3419321254 learned_addr learned my addr 172.21.15.18:0/3419321254 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:56.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.882+0000 7f6a477fe640 1 --2- 172.21.15.18:0/3419321254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a480cf910 0x7f6a481f42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:56.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.882+0000 7f6a47fff640 1 --2- 172.21.15.18:0/3419321254 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a4806d730 0x7f6a480b8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:56.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.882+0000 7f6a4ce2a640 1 -- 172.21.15.18:0/3419321254 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a4806d730 msgr2=0x7f6a480b8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:56.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.882+0000 7f6a4ce2a640 1 --2- 172.21.15.18:0/3419321254 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a4806d730 0x7f6a480b8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.882+0000 7f6a4ce2a640 1 -- 172.21.15.18:0/3419321254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a480cf910 msgr2=0x7f6a481f42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:56.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.882+0000 7f6a4ce2a640 1 --2- 172.21.15.18:0/3419321254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a480cf910 0x7f6a481f42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:56.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.882+0000 7f6a4ce2a640 1 -- 172.21.15.18:0/3419321254 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a480ca100 con 0x7f6a4815ef80 2024-09-19T09:13:56.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.882+0000 7f6a4ce2a640 1 --2- 172.21.15.18:0/3419321254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a4815ef80 0x7f6a480cb530 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000c7a0 tx=0x7f6a4000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:56.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.882+0000 7f6a44ff9640 1 -- 172.21.15.18:0/3419321254 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a40018070 con 0x7f6a4815ef80 2024-09-19T09:13:56.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.882+0000 7f6a4e88d640 1 -- 172.21.15.18:0/3419321254 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a480ca3e0 con 0x7f6a4815ef80 2024-09-19T09:13:56.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.882+0000 7f6a44ff9640 1 -- 172.21.15.18:0/3419321254 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a4000a640 con 0x7f6a4815ef80 2024-09-19T09:13:56.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.882+0000 7f6a44ff9640 1 -- 172.21.15.18:0/3419321254 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4000aa70 con 0x7f6a4815ef80 2024-09-19T09:13:56.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.882+0000 7f6a4e88d640 1 -- 172.21.15.18:0/3419321254 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a480ca9a0 con 0x7f6a4815ef80 2024-09-19T09:13:56.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.883+0000 7f6a4e88d640 1 -- 172.21.15.18:0/3419321254 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a480cff00 con 0x7f6a4815ef80 2024-09-19T09:13:56.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.884+0000 7f6a44ff9640 1 -- 172.21.15.18:0/3419321254 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6a4000ac10 con 0x7f6a4815ef80 2024-09-19T09:13:56.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.884+0000 7f6a44ff9640 1 --2- 172.21.15.18:0/3419321254 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6a3406c2b0 0x7f6a3406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:56.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.884+0000 7f6a44ff9640 1 -- 172.21.15.18:0/3419321254 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f6a4008aa10 con 0x7f6a4815ef80 2024-09-19T09:13:56.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.885+0000 7f6a47fff640 1 --2- 172.21.15.18:0/3419321254 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6a3406c2b0 0x7f6a3406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:56.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.885+0000 7f6a47fff640 1 --2- 172.21.15.18:0/3419321254 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6a3406c2b0 0x7f6a3406e770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6a38009560 tx=0x7f6a38009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:56.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:56.888+0000 7f6a44ff9640 1 -- 172.21.15.18:0/3419321254 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6a40058b40 con 0x7f6a4815ef80 2024-09-19T09:13:57.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.100+0000 7f6a4e88d640 1 -- 172.21.15.18:0/3419321254 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a481605d0 con 0x7f6a4815ef80 2024-09-19T09:13:57.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.101+0000 7f6a44ff9640 1 -- 172.21.15.18:0/3419321254 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5217 (secure 0 0 0) 0x7f6a4005ce40 con 0x7f6a4815ef80 2024-09-19T09:13:57.101 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:57.101 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":6,"btime":"2024-09-19T09:13:29:505412+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3070220651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3070220651},{"type":"v1","addr":"172.21.15.162:6836","nonce":3070220651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/2341594474","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2341594474},{"type":"v1","addr":"172.21.15.18:6833","nonce":2341594474}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/603326104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":603326104},{"type":"v1","addr":"172.21.15.18:6835","nonce":603326104}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:13:26.853577+0000","modified":"2024-09-19T09:13:28.847901+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4275},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4275":{"gid":4275,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6837/727689889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":727689889},{"type":"v1","addr":"172.21.15.162:6837","nonce":727689889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4275,"qdb_cluster":[4275]},"id":1}]} 2024-09-19T09:13:57.101 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 6 2024-09-19T09:13:57.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.102+0000 7f6a4e88d640 1 -- 172.21.15.18:0/3419321254 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6a3406c2b0 msgr2=0x7f6a3406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:57.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.102+0000 7f6a4e88d640 1 --2- 172.21.15.18:0/3419321254 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6a3406c2b0 0x7f6a3406e770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6a38009560 tx=0x7f6a38009190 comp rx=0 tx=0).stop 2024-09-19T09:13:57.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.102+0000 7f6a4e88d640 1 -- 172.21.15.18:0/3419321254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a4815ef80 msgr2=0x7f6a480cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:57.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.102+0000 7f6a4e88d640 1 --2- 172.21.15.18:0/3419321254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a4815ef80 0x7f6a480cb530 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000c7a0 tx=0x7f6a4000cc60 comp rx=0 tx=0).stop 2024-09-19T09:13:57.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.102+0000 7f6a4e88d640 1 -- 172.21.15.18:0/3419321254 shutdown_connections 2024-09-19T09:13:57.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.102+0000 7f6a4e88d640 1 --2- 172.21.15.18:0/3419321254 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6a3406c2b0 0x7f6a3406e770 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.102+0000 7f6a4e88d640 1 --2- 172.21.15.18:0/3419321254 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6a4815ef80 0x7f6a480cb530 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.102+0000 7f6a4e88d640 1 --2- 172.21.15.18:0/3419321254 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6a480cf910 0x7f6a481f42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.102+0000 7f6a4e88d640 1 --2- 172.21.15.18:0/3419321254 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6a4806d730 0x7f6a480b8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.102+0000 7f6a4e88d640 1 -- 172.21.15.18:0/3419321254 >> 172.21.15.18:0/3419321254 conn(0x7f6a480b4700 msgr2=0x7f6a480d3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:57.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.103+0000 7f6a4e88d640 1 -- 172.21.15.18:0/3419321254 shutdown_connections 2024-09-19T09:13:57.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.103+0000 7f6a4e88d640 1 -- 172.21.15.18:0/3419321254 wait complete. 2024-09-19T09:13:57.114 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:13:57.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.215+0000 7f163c71a640 1 Processor -- start 2024-09-19T09:13:57.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.215+0000 7f163c71a640 1 -- start start 2024-09-19T09:13:57.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.216+0000 7f163c71a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16340d1c70 0x7f16340cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:57.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.216+0000 7f163c71a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f16340b5b00 0x7f16340cff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:57.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.216+0000 7f163c71a640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16340d31b0 con 0x7f163415ed50 2024-09-19T09:13:57.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.216+0000 7f163c71a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f16340d3490 con 0x7f16340b5b00 2024-09-19T09:13:57.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.216+0000 7f163c71a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f16340d3770 con 0x7f16340d1c70 2024-09-19T09:13:57.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.216+0000 7f1639cb5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16340d1c70 0x7f16340cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:57.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.216+0000 7f163acb7640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f16340b5b00 0x7f16340cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:57.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.216+0000 7f163a4b6640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f163415ed50 0x7f16340d1560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:51298/0 (socket says 172.21.15.18:51298) 2024-09-19T09:13:57.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.216+0000 7f1639cb5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16340d1c70 0x7f16340cf9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:38696/0 (socket says 172.21.15.18:38696) 2024-09-19T09:13:57.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.217+0000 7f163a4b6640 1 -- 172.21.15.18:0/170806412 learned_addr learned my addr 172.21.15.18:0/170806412 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:57.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.216+0000 7f163acb7640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f16340b5b00 0x7f16340cff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:45634/0 (socket says 172.21.15.18:45634) 2024-09-19T09:13:57.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.217+0000 7f163acb7640 1 -- 172.21.15.18:0/170806412 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16340d1c70 msgr2=0x7f16340cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:57.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.217+0000 7f163acb7640 1 --2- 172.21.15.18:0/170806412 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16340d1c70 0x7f16340cf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.217+0000 7f163acb7640 1 -- 172.21.15.18:0/170806412 >> v1:172.21.15.162:6789/0 conn(0x7f163415ed50 legacy=0x7f16340d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:57.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.217+0000 7f163acb7640 1 -- 172.21.15.18:0/170806412 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16340d3a50 con 0x7f16340b5b00 2024-09-19T09:13:57.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.217+0000 7f1639cb5640 1 --2- 172.21.15.18:0/170806412 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16340d1c70 0x7f16340cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:13:57.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.217+0000 7f16394b4640 1 -- 172.21.15.18:0/170806412 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4186230855 0 0) 0x7f16340d31b0 con 0x7f163415ed50 2024-09-19T09:13:57.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.218+0000 7f163acb7640 1 --2- 172.21.15.18:0/170806412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16340b5b00 0x7f16340cff00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f162c009d90 tx=0x7f162c02a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=887e15f179af43dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:57.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.218+0000 7f16394b4640 1 -- 172.21.15.18:0/170806412 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162c007740 con 0x7f16340b5b00 2024-09-19T09:13:57.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.218+0000 7f16394b4640 1 -- 172.21.15.18:0/170806412 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f162c0078e0 con 0x7f16340b5b00 2024-09-19T09:13:57.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.218+0000 7f16394b4640 1 -- 172.21.15.18:0/170806412 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162c007cb0 con 0x7f16340b5b00 2024-09-19T09:13:57.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.218+0000 7f163c71a640 1 -- 172.21.15.18:0/170806412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16340b5b00 msgr2=0x7f16340cff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:57.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.218+0000 7f163c71a640 1 --2- 172.21.15.18:0/170806412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16340b5b00 0x7f16340cff00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f162c009d90 tx=0x7f162c02a6f0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.218+0000 7f163c71a640 1 -- 172.21.15.18:0/170806412 shutdown_connections 2024-09-19T09:13:57.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.218+0000 7f163c71a640 1 --2- 172.21.15.18:0/170806412 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16340d1c70 0x7f16340cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.218+0000 7f163c71a640 1 --2- 172.21.15.18:0/170806412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16340b5b00 0x7f16340cff00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.218+0000 7f163c71a640 1 -- 172.21.15.18:0/170806412 >> 172.21.15.18:0/170806412 conn(0x7f16340d4bd0 msgr2=0x7f16340d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:57.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.219+0000 7f163c71a640 1 -- 172.21.15.18:0/170806412 shutdown_connections 2024-09-19T09:13:57.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.219+0000 7f163c71a640 1 -- 172.21.15.18:0/170806412 wait complete. 2024-09-19T09:13:57.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.220+0000 7f163c71a640 1 Processor -- start 2024-09-19T09:13:57.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.220+0000 7f163c71a640 1 -- start start 2024-09-19T09:13:57.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.220+0000 7f163c71a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16340b5b00 0x7f1634154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:57.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.220+0000 7f163c71a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16340d1c70 0x7f16340b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:57.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.220+0000 7f163c71a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f163415ed50 0x7f16340b1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:57.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.220+0000 7f163c71a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f163415f130 con 0x7f163415ed50 2024-09-19T09:13:57.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.220+0000 7f163c71a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f16340d3d30 con 0x7f16340b5b00 2024-09-19T09:13:57.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.220+0000 7f163c71a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f16341f7e20 con 0x7f16340d1c70 2024-09-19T09:13:57.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.221+0000 7f163acb7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f163415ed50 0x7f16340b1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:57.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.221+0000 7f163acb7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f163415ed50 0x7f16340b1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33562/0 (socket says 172.21.15.18:33562) 2024-09-19T09:13:57.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.221+0000 7f163acb7640 1 -- 172.21.15.18:0/417064907 learned_addr learned my addr 172.21.15.18:0/417064907 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:57.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.221+0000 7f1639cb5640 1 --2- 172.21.15.18:0/417064907 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16340d1c70 0x7f16340b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:57.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.221+0000 7f163a4b6640 1 --2- 172.21.15.18:0/417064907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16340b5b00 0x7f1634154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:57.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.221+0000 7f163acb7640 1 -- 172.21.15.18:0/417064907 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16340d1c70 msgr2=0x7f16340b17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:57.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.221+0000 7f163acb7640 1 --2- 172.21.15.18:0/417064907 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16340d1c70 0x7f16340b17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.221+0000 7f163acb7640 1 -- 172.21.15.18:0/417064907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16340b5b00 msgr2=0x7f1634154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:57.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.221+0000 7f163acb7640 1 --2- 172.21.15.18:0/417064907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16340b5b00 0x7f1634154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.221+0000 7f163acb7640 1 -- 172.21.15.18:0/417064907 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16340cecc0 con 0x7f163415ed50 2024-09-19T09:13:57.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.221+0000 7f163acb7640 1 --2- 172.21.15.18:0/417064907 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f163415ed50 0x7f16340b1ce0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f162c009d90 tx=0x7f162c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:57.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.221+0000 7f162affd640 1 -- 172.21.15.18:0/417064907 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162c040070 con 0x7f163415ed50 2024-09-19T09:13:57.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.221+0000 7f162affd640 1 -- 172.21.15.18:0/417064907 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f162c031bc0 con 0x7f163415ed50 2024-09-19T09:13:57.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.221+0000 7f163c71a640 1 -- 172.21.15.18:0/417064907 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16341f8070 con 0x7f163415ed50 2024-09-19T09:13:57.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.221+0000 7f162affd640 1 -- 172.21.15.18:0/417064907 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f162c009450 con 0x7f163415ed50 2024-09-19T09:13:57.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.222+0000 7f163c71a640 1 -- 172.21.15.18:0/417064907 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16341f8630 con 0x7f163415ed50 2024-09-19T09:13:57.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.222+0000 7f163c71a640 1 -- 172.21.15.18:0/417064907 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16341f8cf0 con 0x7f163415ed50 2024-09-19T09:13:57.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.223+0000 7f162affd640 1 -- 172.21.15.18:0/417064907 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f162c039040 con 0x7f163415ed50 2024-09-19T09:13:57.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.223+0000 7f162affd640 1 --2- 172.21.15.18:0/417064907 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f161806c2b0 0x7f161806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:57.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.223+0000 7f162affd640 1 -- 172.21.15.18:0/417064907 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f162c0ac700 con 0x7f163415ed50 2024-09-19T09:13:57.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.224+0000 7f163a4b6640 1 --2- 172.21.15.18:0/417064907 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f161806c2b0 0x7f161806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:57.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.224+0000 7f163a4b6640 1 --2- 172.21.15.18:0/417064907 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f161806c2b0 0x7f161806e770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1630007fd0 tx=0x7f1630007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:57.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.228+0000 7f162affd640 1 -- 172.21.15.18:0/417064907 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f16341f8cf0 con 0x7f163415ed50 2024-09-19T09:13:57.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.406+0000 7f163c71a640 1 -- 172.21.15.18:0/417064907 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f16340d21e0 con 0x7f163415ed50 2024-09-19T09:13:57.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.407+0000 7f162affd640 1 -- 172.21.15.18:0/417064907 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16681 (secure 0 0 0) 0x7f162c07a8b0 con 0x7f163415ed50 2024-09-19T09:13:57.408 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:13:57.408 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:13:28.500103+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:13:25.116784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T09:13:25.838110+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:13:57.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.409+0000 7f163c71a640 1 -- 172.21.15.18:0/417064907 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f161806c2b0 msgr2=0x7f161806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:57.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.409+0000 7f163c71a640 1 --2- 172.21.15.18:0/417064907 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f161806c2b0 0x7f161806e770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1630007fd0 tx=0x7f1630007de0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.409+0000 7f163c71a640 1 -- 172.21.15.18:0/417064907 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f163415ed50 msgr2=0x7f16340b1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:57.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.409+0000 7f163c71a640 1 --2- 172.21.15.18:0/417064907 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f163415ed50 0x7f16340b1ce0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f162c009d90 tx=0x7f162c004a40 comp rx=0 tx=0).stop 2024-09-19T09:13:57.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.409+0000 7f163c71a640 1 -- 172.21.15.18:0/417064907 shutdown_connections 2024-09-19T09:13:57.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.409+0000 7f163c71a640 1 --2- 172.21.15.18:0/417064907 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f161806c2b0 0x7f161806e770 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.409+0000 7f163c71a640 1 --2- 172.21.15.18:0/417064907 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f163415ed50 0x7f16340b1ce0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.409+0000 7f163c71a640 1 --2- 172.21.15.18:0/417064907 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f16340d1c70 0x7f16340b17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.409+0000 7f163c71a640 1 --2- 172.21.15.18:0/417064907 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f16340b5b00 0x7f1634154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.409+0000 7f163c71a640 1 -- 172.21.15.18:0/417064907 >> 172.21.15.18:0/417064907 conn(0x7f16340d4bd0 msgr2=0x7f163406c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:57.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.409+0000 7f163c71a640 1 -- 172.21.15.18:0/417064907 shutdown_connections 2024-09-19T09:13:57.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.409+0000 7f163c71a640 1 -- 172.21.15.18:0/417064907 wait complete. 2024-09-19T09:13:57.421 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-19T09:13:57.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.524+0000 7fde354d0640 1 Processor -- start 2024-09-19T09:13:57.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.524+0000 7fde354d0640 1 -- start start 2024-09-19T09:13:57.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.525+0000 7fde354d0640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fde300ce170 0x7fde3015c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:57.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.525+0000 7fde354d0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde30072190 0x7fde30072620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:57.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.525+0000 7fde354d0640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde300730f0 con 0x7fde300b4fe0 2024-09-19T09:13:57.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.525+0000 7fde354d0640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fde3015c660 con 0x7fde300ce170 2024-09-19T09:13:57.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.525+0000 7fde354d0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fde30073390 con 0x7fde30072190 2024-09-19T09:13:57.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.525+0000 7fde2effd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fde300b4fe0 0x7fde300b53c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:47304/0 (socket says 172.21.15.18:47304) 2024-09-19T09:13:57.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.525+0000 7fde2effd640 1 -- 172.21.15.18:0/125904030 learned_addr learned my addr 172.21.15.18:0/125904030 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:57.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.525+0000 7fde2e7fc640 1 --2- 172.21.15.18:0/125904030 >> v2:172.21.15.162:3300/0 conn(0x7fde300ce170 0x7fde3015c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:57.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.525+0000 7fde2f7fe640 1 --2- 172.21.15.18:0/125904030 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde30072190 0x7fde30072620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:57.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.525+0000 7fde2dffb640 1 -- 172.21.15.18:0/125904030 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 264462434 0 0) 0x7fde300730f0 con 0x7fde300b4fe0 2024-09-19T09:13:57.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.525+0000 7fde2dffb640 1 -- 172.21.15.18:0/125904030 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde18003520 con 0x7fde300b4fe0 2024-09-19T09:13:57.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.525+0000 7fde2e7fc640 1 -- 172.21.15.18:0/125904030 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde30072190 msgr2=0x7fde30072620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:57.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.525+0000 7fde2e7fc640 1 --2- 172.21.15.18:0/125904030 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde30072190 0x7fde30072620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.525+0000 7fde2e7fc640 1 -- 172.21.15.18:0/125904030 >> v1:172.21.15.18:6789/0 conn(0x7fde300b4fe0 legacy=0x7fde300b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:57.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.525+0000 7fde2e7fc640 1 -- 172.21.15.18:0/125904030 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde300716b0 con 0x7fde300ce170 2024-09-19T09:13:57.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.526+0000 7fde2e7fc640 1 --2- 172.21.15.18:0/125904030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde300ce170 0x7fde3015c120 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fde240097d0 tx=0x7fde2402b2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e84aa1bbd659731b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:57.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.526+0000 7fde2dffb640 1 -- 172.21.15.18:0/125904030 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde24038070 con 0x7fde300ce170 2024-09-19T09:13:57.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.526+0000 7fde2dffb640 1 -- 172.21.15.18:0/125904030 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde24033440 con 0x7fde300ce170 2024-09-19T09:13:57.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.526+0000 7fde2dffb640 1 -- 172.21.15.18:0/125904030 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde240337f0 con 0x7fde300ce170 2024-09-19T09:13:57.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.527+0000 7fde354d0640 1 -- 172.21.15.18:0/125904030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde300ce170 msgr2=0x7fde3015c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:57.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.527+0000 7fde354d0640 1 --2- 172.21.15.18:0/125904030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde300ce170 0x7fde3015c120 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fde240097d0 tx=0x7fde2402b2d0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.527+0000 7fde354d0640 1 -- 172.21.15.18:0/125904030 shutdown_connections 2024-09-19T09:13:57.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.527+0000 7fde354d0640 1 --2- 172.21.15.18:0/125904030 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde30072190 0x7fde30072620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.527+0000 7fde354d0640 1 --2- 172.21.15.18:0/125904030 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde300ce170 0x7fde3015c120 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.527+0000 7fde354d0640 1 -- 172.21.15.18:0/125904030 >> 172.21.15.18:0/125904030 conn(0x7fde300b2630 msgr2=0x7fde300b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:57.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.527+0000 7fde354d0640 1 -- 172.21.15.18:0/125904030 shutdown_connections 2024-09-19T09:13:57.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.527+0000 7fde354d0640 1 -- 172.21.15.18:0/125904030 wait complete. 2024-09-19T09:13:57.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.528+0000 7fde354d0640 1 Processor -- start 2024-09-19T09:13:57.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.528+0000 7fde354d0640 1 -- start start 2024-09-19T09:13:57.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.529+0000 7fde354d0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde30072190 0x7fde301489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:57.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.529+0000 7fde354d0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde300b4fe0 0x7fde30155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:57.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.529+0000 7fde354d0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde300ce170 0x7fde3015a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:57.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.529+0000 7fde354d0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fde300cd380 con 0x7fde300b4fe0 2024-09-19T09:13:57.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.529+0000 7fde354d0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fde30071c70 con 0x7fde30072190 2024-09-19T09:13:57.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.529+0000 7fde354d0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fde300cd500 con 0x7fde300ce170 2024-09-19T09:13:57.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.529+0000 7fde2e7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde300b4fe0 0x7fde30155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:57.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.529+0000 7fde2e7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde300b4fe0 0x7fde30155280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33564/0 (socket says 172.21.15.18:33564) 2024-09-19T09:13:57.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.529+0000 7fde2e7fc640 1 -- 172.21.15.18:0/3107953750 learned_addr learned my addr 172.21.15.18:0/3107953750 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:57.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.529+0000 7fde2effd640 1 --2- 172.21.15.18:0/3107953750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde30072190 0x7fde301489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:57.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.529+0000 7fde2f7fe640 1 --2- 172.21.15.18:0/3107953750 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde300ce170 0x7fde3015a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:57.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.529+0000 7fde2e7fc640 1 -- 172.21.15.18:0/3107953750 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde300ce170 msgr2=0x7fde3015a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:57.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.529+0000 7fde2e7fc640 1 --2- 172.21.15.18:0/3107953750 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde300ce170 0x7fde3015a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.529+0000 7fde2e7fc640 1 -- 172.21.15.18:0/3107953750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde30072190 msgr2=0x7fde301489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:57.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.529+0000 7fde2e7fc640 1 --2- 172.21.15.18:0/3107953750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde30072190 0x7fde301489e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.529+0000 7fde2e7fc640 1 -- 172.21.15.18:0/3107953750 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde3006e240 con 0x7fde300b4fe0 2024-09-19T09:13:57.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.529+0000 7fde2e7fc640 1 --2- 172.21.15.18:0/3107953750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde300b4fe0 0x7fde30155280 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fde240098f0 tx=0x7fde240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:57.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.530+0000 7fde177fe640 1 -- 172.21.15.18:0/3107953750 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde24038040 con 0x7fde300b4fe0 2024-09-19T09:13:57.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.530+0000 7fde177fe640 1 -- 172.21.15.18:0/3107953750 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde24043070 con 0x7fde300b4fe0 2024-09-19T09:13:57.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.530+0000 7fde354d0640 1 -- 172.21.15.18:0/3107953750 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde3006e520 con 0x7fde300b4fe0 2024-09-19T09:13:57.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.530+0000 7fde177fe640 1 -- 172.21.15.18:0/3107953750 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2403d8d0 con 0x7fde300b4fe0 2024-09-19T09:13:57.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.530+0000 7fde354d0640 1 -- 172.21.15.18:0/3107953750 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde3006eae0 con 0x7fde300b4fe0 2024-09-19T09:13:57.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.531+0000 7fde354d0640 1 -- 172.21.15.18:0/3107953750 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde300c6c00 con 0x7fde300b4fe0 2024-09-19T09:13:57.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.531+0000 7fde177fe640 1 -- 172.21.15.18:0/3107953750 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fde2403da70 con 0x7fde300b4fe0 2024-09-19T09:13:57.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.532+0000 7fde177fe640 1 --2- 172.21.15.18:0/3107953750 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fde1c06c2b0 0x7fde1c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:57.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.532+0000 7fde177fe640 1 -- 172.21.15.18:0/3107953750 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7fde240abca0 con 0x7fde300b4fe0 2024-09-19T09:13:57.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.532+0000 7fde2effd640 1 --2- 172.21.15.18:0/3107953750 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fde1c06c2b0 0x7fde1c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:57.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.532+0000 7fde2effd640 1 --2- 172.21.15.18:0/3107953750 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fde1c06c2b0 0x7fde1c06e770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fde20000f60 tx=0x7fde20009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:57.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.536+0000 7fde177fe640 1 -- 172.21.15.18:0/3107953750 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fde300c6c00 con 0x7fde300b4fe0 2024-09-19T09:13:57.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.749+0000 7fde354d0640 1 -- 172.21.15.18:0/3107953750 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fde300cd860 con 0x7fde300b4fe0 2024-09-19T09:13:57.750 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-19T09:13:57.749+0000 7fca8a79c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:13:57.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.751+0000 7fde177fe640 1 -- 172.21.15.18:0/3107953750 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) ==== 161+0+0 (secure 0 0 0) 0x7fde2407a420 con 0x7fde300b4fe0 2024-09-19T09:13:57.751 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T09:13:57.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.753+0000 7fde354d0640 1 -- 172.21.15.18:0/3107953750 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fde1c06c2b0 msgr2=0x7fde1c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:57.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.753+0000 7fde354d0640 1 --2- 172.21.15.18:0/3107953750 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fde1c06c2b0 0x7fde1c06e770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fde20000f60 tx=0x7fde20009040 comp rx=0 tx=0).stop 2024-09-19T09:13:57.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.753+0000 7fde354d0640 1 -- 172.21.15.18:0/3107953750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde300b4fe0 msgr2=0x7fde30155280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:57.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.753+0000 7fde354d0640 1 --2- 172.21.15.18:0/3107953750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde300b4fe0 0x7fde30155280 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fde240098f0 tx=0x7fde240046c0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.753+0000 7fde354d0640 1 -- 172.21.15.18:0/3107953750 shutdown_connections 2024-09-19T09:13:57.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.753+0000 7fde354d0640 1 --2- 172.21.15.18:0/3107953750 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fde1c06c2b0 0x7fde1c06e770 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.753+0000 7fde354d0640 1 --2- 172.21.15.18:0/3107953750 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde300ce170 0x7fde3015a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.753+0000 7fde354d0640 1 --2- 172.21.15.18:0/3107953750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde300b4fe0 0x7fde30155280 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.753+0000 7fde354d0640 1 --2- 172.21.15.18:0/3107953750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde30072190 0x7fde301489e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.753+0000 7fde354d0640 1 -- 172.21.15.18:0/3107953750 >> 172.21.15.18:0/3107953750 conn(0x7fde300b2630 msgr2=0x7fde3015ec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:57.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.753+0000 7fde354d0640 1 -- 172.21.15.18:0/3107953750 shutdown_connections 2024-09-19T09:13:57.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.753+0000 7fde354d0640 1 -- 172.21.15.18:0/3107953750 wait complete. 2024-09-19T09:13:57.756 INFO:tasks.ceph.mds.b.smithi162.stderr: -7944> 2024-09-19T09:13:21.869+0000 7fea194c3640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-19T09:13:57.758 INFO:tasks.ceph.mds.b.smithi162.stderr: -6664> 2024-09-19T09:13:32.867+0000 7fea134b7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T09:13:57.765 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T09:13:57.795 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-09-19T09:13:57.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.869+0000 7f6e8d617640 1 Processor -- start 2024-09-19T09:13:57.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.869+0000 7f6e8d617640 1 -- start start 2024-09-19T09:13:57.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.870+0000 7f6e8d617640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6e880b46f0 0x7f6e880af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:57.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.870+0000 7f6e8d617640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6e880af600 0x7f6e880afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:57.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.870+0000 7f6e8d617640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e88072790 con 0x7f6e880b4f90 2024-09-19T09:13:57.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.870+0000 7f6e8d617640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f6e880d0a80 con 0x7f6e880b46f0 2024-09-19T09:13:57.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.870+0000 7f6e8d617640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6e88073640 con 0x7f6e880af600 2024-09-19T09:13:57.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.870+0000 7f6e7e7fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6e880b46f0 0x7f6e880af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:57.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.870+0000 7f6e86ffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6e880b4f90 0x7f6e880b5370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:47320/0 (socket says 172.21.15.18:47320) 2024-09-19T09:13:57.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.870+0000 7f6e7e7fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6e880b46f0 0x7f6e880af0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33578/0 (socket says 172.21.15.18:33578) 2024-09-19T09:13:57.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.870+0000 7f6e86ffd640 1 -- 172.21.15.18:0/3116749365 learned_addr learned my addr 172.21.15.18:0/3116749365 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:57.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.870+0000 7f6e877fe640 1 --2- 172.21.15.18:0/3116749365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6e880af600 0x7f6e880afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:57.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.870+0000 7f6e7e7fc640 1 -- 172.21.15.18:0/3116749365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6e880af600 msgr2=0x7f6e880afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:57.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.870+0000 7f6e7e7fc640 1 --2- 172.21.15.18:0/3116749365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6e880af600 0x7f6e880afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.870+0000 7f6e7e7fc640 1 -- 172.21.15.18:0/3116749365 >> v1:172.21.15.18:6789/0 conn(0x7f6e880b4f90 legacy=0x7f6e880b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:57.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.870+0000 7f6e7e7fc640 1 -- 172.21.15.18:0/3116749365 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e880affd0 con 0x7f6e880b46f0 2024-09-19T09:13:57.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.870+0000 7f6e867fc640 1 -- 172.21.15.18:0/3116749365 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2180143703 0 0) 0x7f6e88072790 con 0x7f6e880b4f90 2024-09-19T09:13:57.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.870+0000 7f6e877fe640 1 --2- 172.21.15.18:0/3116749365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6e880af600 0x7f6e880afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:13:57.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.871+0000 7f6e7e7fc640 1 --2- 172.21.15.18:0/3116749365 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e880b46f0 0x7f6e880af0c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6e700097d0 tx=0x7f6e7002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cdb187c54df2584 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:57.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.871+0000 7f6e867fc640 1 -- 172.21.15.18:0/3116749365 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e70037070 con 0x7f6e880b46f0 2024-09-19T09:13:57.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.871+0000 7f6e867fc640 1 -- 172.21.15.18:0/3116749365 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e70032440 con 0x7f6e880b46f0 2024-09-19T09:13:57.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.871+0000 7f6e867fc640 1 -- 172.21.15.18:0/3116749365 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e70032810 con 0x7f6e880b46f0 2024-09-19T09:13:57.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.871+0000 7f6e8d617640 1 -- 172.21.15.18:0/3116749365 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e880b46f0 msgr2=0x7f6e880af0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:57.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.871+0000 7f6e8d617640 1 --2- 172.21.15.18:0/3116749365 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e880b46f0 0x7f6e880af0c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6e700097d0 tx=0x7f6e7002a1c0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.872+0000 7f6e8d617640 1 -- 172.21.15.18:0/3116749365 shutdown_connections 2024-09-19T09:13:57.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.872+0000 7f6e8d617640 1 --2- 172.21.15.18:0/3116749365 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6e880af600 0x7f6e880afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.872+0000 7f6e8d617640 1 --2- 172.21.15.18:0/3116749365 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e880b46f0 0x7f6e880af0c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.872+0000 7f6e8d617640 1 -- 172.21.15.18:0/3116749365 >> 172.21.15.18:0/3116749365 conn(0x7f6e8806bc10 msgr2=0x7f6e8806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:57.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.872+0000 7f6e8d617640 1 -- 172.21.15.18:0/3116749365 shutdown_connections 2024-09-19T09:13:57.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.872+0000 7f6e8d617640 1 -- 172.21.15.18:0/3116749365 wait complete. 2024-09-19T09:13:57.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.873+0000 7f6e8d617640 1 Processor -- start 2024-09-19T09:13:57.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.873+0000 7f6e8d617640 1 -- start start 2024-09-19T09:13:57.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.874+0000 7f6e8d617640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e880af600 0x7f6e8815c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:57.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.874+0000 7f6e8d617640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6e880b46f0 0x7f6e88138040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:57.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.874+0000 7f6e8d617640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e880b4f90 0x7f6e88138580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:57.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.874+0000 7f6e8d617640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6e88072ff0 con 0x7f6e880af600 2024-09-19T09:13:57.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.874+0000 7f6e8d617640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6e88072d10 con 0x7f6e880b4f90 2024-09-19T09:13:57.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.874+0000 7f6e8d617640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6e880732d0 con 0x7f6e880b46f0 2024-09-19T09:13:57.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.874+0000 7f6e86ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e880af600 0x7f6e8815c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:57.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.874+0000 7f6e86ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e880af600 0x7f6e8815c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33586/0 (socket says 172.21.15.18:33586) 2024-09-19T09:13:57.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.874+0000 7f6e86ffd640 1 -- 172.21.15.18:0/1879422398 learned_addr learned my addr 172.21.15.18:0/1879422398 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:57.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.874+0000 7f6e7e7fc640 1 --2- 172.21.15.18:0/1879422398 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6e880b46f0 0x7f6e88138040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:57.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.874+0000 7f6e877fe640 1 --2- 172.21.15.18:0/1879422398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e880b4f90 0x7f6e88138580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:57.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.874+0000 7f6e86ffd640 1 -- 172.21.15.18:0/1879422398 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6e880b46f0 msgr2=0x7f6e88138040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:57.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.874+0000 7f6e86ffd640 1 --2- 172.21.15.18:0/1879422398 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6e880b46f0 0x7f6e88138040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.874+0000 7f6e86ffd640 1 -- 172.21.15.18:0/1879422398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e880b4f90 msgr2=0x7f6e88138580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:57.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.874+0000 7f6e86ffd640 1 --2- 172.21.15.18:0/1879422398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e880b4f90 0x7f6e88138580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:57.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.874+0000 7f6e86ffd640 1 -- 172.21.15.18:0/1879422398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e88156370 con 0x7f6e880af600 2024-09-19T09:13:57.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.874+0000 7f6e877fe640 1 --2- 172.21.15.18:0/1879422398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e880b4f90 0x7f6e88138580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:13:57.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.874+0000 7f6e86ffd640 1 --2- 172.21.15.18:0/1879422398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e880af600 0x7f6e8815c310 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6e7800c430 tx=0x7f6e7800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:57.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.874+0000 7f6e7ffff640 1 -- 172.21.15.18:0/1879422398 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e780074e0 con 0x7f6e880af600 2024-09-19T09:13:57.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.874+0000 7f6e7ffff640 1 -- 172.21.15.18:0/1879422398 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e780047e0 con 0x7f6e880af600 2024-09-19T09:13:57.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.874+0000 7f6e8d617640 1 -- 172.21.15.18:0/1879422398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e88156650 con 0x7f6e880af600 2024-09-19T09:13:57.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.874+0000 7f6e7ffff640 1 -- 172.21.15.18:0/1879422398 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e78004bd0 con 0x7f6e880af600 2024-09-19T09:13:57.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.875+0000 7f6e8d617640 1 -- 172.21.15.18:0/1879422398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e88158220 con 0x7f6e880af600 2024-09-19T09:13:57.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.875+0000 7f6e8d617640 1 -- 172.21.15.18:0/1879422398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e880b3fa0 con 0x7f6e880af600 2024-09-19T09:13:57.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.876+0000 7f6e7ffff640 1 -- 172.21.15.18:0/1879422398 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6e78011070 con 0x7f6e880af600 2024-09-19T09:13:57.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.877+0000 7f6e7ffff640 1 --2- 172.21.15.18:0/1879422398 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6e6806c2b0 0x7f6e6806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:57.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.877+0000 7f6e7ffff640 1 -- 172.21.15.18:0/1879422398 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7f6e7808b0c0 con 0x7f6e880af600 2024-09-19T09:13:57.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.877+0000 7f6e7e7fc640 1 --2- 172.21.15.18:0/1879422398 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6e6806c2b0 0x7f6e6806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:57.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.877+0000 7f6e7e7fc640 1 --2- 172.21.15.18:0/1879422398 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6e6806c2b0 0x7f6e6806e770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6e70034000 tx=0x7f6e7002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:57.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:57.881+0000 7f6e7ffff640 1 -- 172.21.15.18:0/1879422398 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6e78059730 con 0x7f6e880af600 2024-09-19T09:13:58.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.091+0000 7f6e8d617640 1 -- 172.21.15.18:0/1879422398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f6e8806c120 con 0x7f6e880af600 2024-09-19T09:13:58.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.752+0000 7f6e7ffff640 1 -- 172.21.15.18:0/1879422398 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) ==== 104+0+0 (secure 0 0 0) 0x7f6e78059030 con 0x7f6e880af600 2024-09-19T09:13:58.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.755+0000 7f6e8d617640 1 -- 172.21.15.18:0/1879422398 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6e6806c2b0 msgr2=0x7f6e6806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:58.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.755+0000 7f6e8d617640 1 --2- 172.21.15.18:0/1879422398 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6e6806c2b0 0x7f6e6806e770 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6e70034000 tx=0x7f6e7002e000 comp rx=0 tx=0).stop 2024-09-19T09:13:58.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.755+0000 7f6e8d617640 1 -- 172.21.15.18:0/1879422398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e880af600 msgr2=0x7f6e8815c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:58.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.755+0000 7f6e8d617640 1 --2- 172.21.15.18:0/1879422398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e880af600 0x7f6e8815c310 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6e7800c430 tx=0x7f6e7800c8f0 comp rx=0 tx=0).stop 2024-09-19T09:13:58.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.755+0000 7f6e8d617640 1 -- 172.21.15.18:0/1879422398 shutdown_connections 2024-09-19T09:13:58.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.755+0000 7f6e8d617640 1 --2- 172.21.15.18:0/1879422398 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6e6806c2b0 0x7f6e6806e770 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:58.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.755+0000 7f6e8d617640 1 --2- 172.21.15.18:0/1879422398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6e880b4f90 0x7f6e88138580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:58.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.755+0000 7f6e8d617640 1 --2- 172.21.15.18:0/1879422398 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6e880b46f0 0x7f6e88138040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:58.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.755+0000 7f6e8d617640 1 --2- 172.21.15.18:0/1879422398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6e880af600 0x7f6e8815c310 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:58.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.755+0000 7f6e8d617640 1 -- 172.21.15.18:0/1879422398 >> 172.21.15.18:0/1879422398 conn(0x7f6e8806bc10 msgr2=0x7f6e880b32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:58.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.755+0000 7f6e8d617640 1 -- 172.21.15.18:0/1879422398 shutdown_connections 2024-09-19T09:13:58.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.755+0000 7f6e8d617640 1 -- 172.21.15.18:0/1879422398 wait complete. 2024-09-19T09:13:58.769 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T09:13:58.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.881+0000 7fb87ffb7640 1 Processor -- start 2024-09-19T09:13:58.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.882+0000 7fb87ffb7640 1 -- start start 2024-09-19T09:13:58.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.882+0000 7fb87ffb7640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb8780d3790 0x7fb8780b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:58.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.882+0000 7fb87ffb7640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8780d0310 con 0x7fb8780b3c90 2024-09-19T09:13:58.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.882+0000 7fb87ffb7640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8780d05d0 con 0x7fb87815edc0 2024-09-19T09:13:58.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.883+0000 7fb87ffb7640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb8780d08b0 con 0x7fb8780d3790 2024-09-19T09:13:58.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.883+0000 7fb87d552640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb8780b3c90 0x7fb8780d3080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:47328/0 (socket says 172.21.15.18:47328) 2024-09-19T09:13:58.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.883+0000 7fb87d552640 1 -- 172.21.15.18:0/3824345231 learned_addr learned my addr 172.21.15.18:0/3824345231 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:13:58.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.883+0000 7fb87e554640 1 --2- 172.21.15.18:0/3824345231 >> v2:172.21.15.162:3300/0 conn(0x7fb8780d3790 0x7fb8780b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:58.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.883+0000 7fb87cd51640 1 -- 172.21.15.18:0/3824345231 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1616600866 0 0) 0x7fb8780d0310 con 0x7fb8780b3c90 2024-09-19T09:13:58.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.883+0000 7fb87cd51640 1 -- 172.21.15.18:0/3824345231 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb864003520 con 0x7fb8780b3c90 2024-09-19T09:13:58.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.883+0000 7fb87cd51640 1 -- 172.21.15.18:0/3824345231 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1701981843 0 0) 0x7fb864003520 con 0x7fb8780b3c90 2024-09-19T09:13:58.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.883+0000 7fb87cd51640 1 -- 172.21.15.18:0/3824345231 >> v2:172.21.15.162:3300/0 conn(0x7fb8780d3790 msgr2=0x7fb8780b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:58.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.883+0000 7fb87cd51640 1 --2- 172.21.15.18:0/3824345231 >> v2:172.21.15.162:3300/0 conn(0x7fb8780d3790 0x7fb8780b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:58.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.883+0000 7fb87cd51640 1 -- 172.21.15.18:0/3824345231 >> v1:172.21.15.162:6789/0 conn(0x7fb87815edc0 legacy=0x7fb8780d2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:58.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.883+0000 7fb87cd51640 1 -- 172.21.15.18:0/3824345231 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8780d0b90 con 0x7fb8780b3c90 2024-09-19T09:13:58.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.883+0000 7fb87cd51640 1 -- 172.21.15.18:0/3824345231 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fb868001670 con 0x7fb8780b3c90 2024-09-19T09:13:58.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.883+0000 7fb87cd51640 1 -- 172.21.15.18:0/3824345231 >> v1:172.21.15.18:6789/0 conn(0x7fb8780b3c90 legacy=0x7fb8780d3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:58.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.883+0000 7fb87cd51640 1 --2- 172.21.15.18:0/3824345231 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8640039b0 0x7fb864003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:58.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.883+0000 7fb87cd51640 1 --2- 172.21.15.18:0/3824345231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb864004800 0x7fb864004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:58.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.883+0000 7fb87cd51640 1 --2- 172.21.15.18:0/3824345231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8640051c0 0x7fb86400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:58.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.883+0000 7fb87cd51640 1 -- 172.21.15.18:0/3824345231 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb8780d08b0 con 0x7fb8640051c0 2024-09-19T09:13:58.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.883+0000 7fb87cd51640 1 -- 172.21.15.18:0/3824345231 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb86400c060 con 0x7fb864004800 2024-09-19T09:13:58.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.883+0000 7fb87cd51640 1 -- 172.21.15.18:0/3824345231 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb86400c260 con 0x7fb8640039b0 2024-09-19T09:13:58.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.883+0000 7fb87e554640 1 --2- 172.21.15.18:0/3824345231 >> v2:172.21.15.162:3300/0 conn(0x7fb8780d3790 0x7fb8780b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:13:58.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.883+0000 7fb87e554640 1 --2- 172.21.15.18:0/3824345231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8640051c0 0x7fb86400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:58.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.884+0000 7fb87d552640 1 --2- 172.21.15.18:0/3824345231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb864004800 0x7fb864004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:58.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.884+0000 7fb87dd53640 1 --2- 172.21.15.18:0/3824345231 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8640039b0 0x7fb864003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:58.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.884+0000 7fb87e554640 1 -- 172.21.15.18:0/3824345231 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8640039b0 msgr2=0x7fb864003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:58.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.884+0000 7fb87e554640 1 --2- 172.21.15.18:0/3824345231 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8640039b0 0x7fb864003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:58.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.884+0000 7fb87e554640 1 -- 172.21.15.18:0/3824345231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb864004800 msgr2=0x7fb864004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:58.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.884+0000 7fb87e554640 1 --2- 172.21.15.18:0/3824345231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb864004800 0x7fb864004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:58.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.884+0000 7fb87e554640 1 -- 172.21.15.18:0/3824345231 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb864003520 con 0x7fb8640051c0 2024-09-19T09:13:58.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.884+0000 7fb87e554640 1 -- 172.21.15.18:0/3824345231 reap_dead start 2024-09-19T09:13:58.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.885+0000 7fb87e554640 1 --2- 172.21.15.18:0/3824345231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8640051c0 0x7fb86400b9c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb87000e350 tx=0x7fb864005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0950d0530c2045a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:58.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.885+0000 7fb87cd51640 1 -- 172.21.15.18:0/3824345231 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb870009dc0 con 0x7fb8640051c0 2024-09-19T09:13:58.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.885+0000 7fb87cd51640 1 -- 172.21.15.18:0/3824345231 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb870003bb0 con 0x7fb8640051c0 2024-09-19T09:13:58.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.885+0000 7fb87cd51640 1 -- 172.21.15.18:0/3824345231 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb870004020 con 0x7fb8640051c0 2024-09-19T09:13:58.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.885+0000 7fb87ffb7640 1 -- 172.21.15.18:0/3824345231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8640051c0 msgr2=0x7fb86400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:58.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.885+0000 7fb87ffb7640 1 --2- 172.21.15.18:0/3824345231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8640051c0 0x7fb86400b9c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb87000e350 tx=0x7fb864005830 comp rx=0 tx=0).stop 2024-09-19T09:13:58.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.885+0000 7fb87ffb7640 1 -- 172.21.15.18:0/3824345231 shutdown_connections 2024-09-19T09:13:58.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.885+0000 7fb87ffb7640 1 --2- 172.21.15.18:0/3824345231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8640051c0 0x7fb86400b9c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:58.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.885+0000 7fb87ffb7640 1 -- 172.21.15.18:0/3824345231 >> 172.21.15.18:0/3824345231 conn(0x7fb8780d4c60 msgr2=0x7fb8780d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:58.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.885+0000 7fb87ffb7640 1 -- 172.21.15.18:0/3824345231 shutdown_connections 2024-09-19T09:13:58.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.885+0000 7fb87ffb7640 1 -- 172.21.15.18:0/3824345231 wait complete. 2024-09-19T09:13:58.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.887+0000 7fb87ffb7640 1 Processor -- start 2024-09-19T09:13:58.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.887+0000 7fb87ffb7640 1 -- start start 2024-09-19T09:13:58.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.887+0000 7fb87ffb7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8640051c0 0x7fb87815d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:58.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.887+0000 7fb87ffb7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8781e4080 0x7fb8781e4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:58.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.887+0000 7fb87ffb7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8781e7300 0x7fb8781e6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:58.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.887+0000 7fb87ffb7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb8780b1a10 con 0x7fb8640051c0 2024-09-19T09:13:58.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.887+0000 7fb87ffb7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb8780b1890 con 0x7fb8781e4080 2024-09-19T09:13:58.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.887+0000 7fb87ffb7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb8780b1b90 con 0x7fb8781e7300 2024-09-19T09:13:58.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.887+0000 7fb87dd53640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8640051c0 0x7fb87815d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:58.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.888+0000 7fb87dd53640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8640051c0 0x7fb87815d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33610/0 (socket says 172.21.15.18:33610) 2024-09-19T09:13:58.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.888+0000 7fb87dd53640 1 -- 172.21.15.18:0/509098132 learned_addr learned my addr 172.21.15.18:0/509098132 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:58.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.888+0000 7fb87d552640 1 --2- 172.21.15.18:0/509098132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8781e4080 0x7fb8781e4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:58.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.888+0000 7fb87e554640 1 --2- 172.21.15.18:0/509098132 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8781e7300 0x7fb8781e6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:58.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.888+0000 7fb87dd53640 1 -- 172.21.15.18:0/509098132 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8781e7300 msgr2=0x7fb8781e6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:58.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.888+0000 7fb87dd53640 1 --2- 172.21.15.18:0/509098132 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8781e7300 0x7fb8781e6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:58.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.888+0000 7fb87dd53640 1 -- 172.21.15.18:0/509098132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8781e4080 msgr2=0x7fb8781e4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:58.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.888+0000 7fb87dd53640 1 --2- 172.21.15.18:0/509098132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8781e4080 0x7fb8781e4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:58.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.888+0000 7fb87dd53640 1 -- 172.21.15.18:0/509098132 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8781e56d0 con 0x7fb8640051c0 2024-09-19T09:13:58.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.888+0000 7fb87d552640 1 --2- 172.21.15.18:0/509098132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8781e4080 0x7fb8781e4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:13:58.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.888+0000 7fb87dd53640 1 --2- 172.21.15.18:0/509098132 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8640051c0 0x7fb87815d5a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb87400f5f0 tx=0x7fb87400fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:58.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.888+0000 7fb86e7fc640 1 -- 172.21.15.18:0/509098132 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8740052e0 con 0x7fb8640051c0 2024-09-19T09:13:58.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.888+0000 7fb86e7fc640 1 -- 172.21.15.18:0/509098132 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb874018070 con 0x7fb8640051c0 2024-09-19T09:13:58.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.888+0000 7fb87ffb7640 1 -- 172.21.15.18:0/509098132 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8780b5b10 con 0x7fb8640051c0 2024-09-19T09:13:58.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.888+0000 7fb86e7fc640 1 -- 172.21.15.18:0/509098132 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb874003810 con 0x7fb8640051c0 2024-09-19T09:13:58.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.888+0000 7fb87ffb7640 1 -- 172.21.15.18:0/509098132 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8780b60d0 con 0x7fb8640051c0 2024-09-19T09:13:58.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.889+0000 7fb87ffb7640 1 -- 172.21.15.18:0/509098132 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb878069760 con 0x7fb8640051c0 2024-09-19T09:13:58.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.890+0000 7fb86e7fc640 1 -- 172.21.15.18:0/509098132 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb8740039b0 con 0x7fb8640051c0 2024-09-19T09:13:58.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.890+0000 7fb86e7fc640 1 --2- 172.21.15.18:0/509098132 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb85c06c2b0 0x7fb85c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:58.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.890+0000 7fb86e7fc640 1 -- 172.21.15.18:0/509098132 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5795+0+0 (secure 0 0 0) 0x7fb87408b230 con 0x7fb8640051c0 2024-09-19T09:13:58.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.890+0000 7fb87d552640 1 --2- 172.21.15.18:0/509098132 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb85c06c2b0 0x7fb85c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:58.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.891+0000 7fb87d552640 1 --2- 172.21.15.18:0/509098132 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb85c06c2b0 0x7fb85c06e770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb8780d50b0 tx=0x7fb868009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:58.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:58.894+0000 7fb86e7fc640 1 -- 172.21.15.18:0/509098132 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb8740599d0 con 0x7fb8640051c0 2024-09-19T09:13:59.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.067+0000 7fb87ffb7640 1 -- 172.21.15.18:0/509098132 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb8780d3330 con 0x7fb8640051c0 2024-09-19T09:13:59.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.756+0000 7fb86e7fc640 1 -- 172.21.15.18:0/509098132 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) ==== 181+0+0 (secure 0 0 0) 0x7fb8740592d0 con 0x7fb8640051c0 2024-09-19T09:13:59.757 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' removed 2024-09-19T09:13:59.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.759+0000 7fb87ffb7640 1 -- 172.21.15.18:0/509098132 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb85c06c2b0 msgr2=0x7fb85c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:59.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.759+0000 7fb87ffb7640 1 --2- 172.21.15.18:0/509098132 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb85c06c2b0 0x7fb85c06e770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb8780d50b0 tx=0x7fb868009040 comp rx=0 tx=0).stop 2024-09-19T09:13:59.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.759+0000 7fb87ffb7640 1 -- 172.21.15.18:0/509098132 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8640051c0 msgr2=0x7fb87815d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:59.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.759+0000 7fb87ffb7640 1 --2- 172.21.15.18:0/509098132 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8640051c0 0x7fb87815d5a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb87400f5f0 tx=0x7fb87400fab0 comp rx=0 tx=0).stop 2024-09-19T09:13:59.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.760+0000 7fb87ffb7640 1 -- 172.21.15.18:0/509098132 shutdown_connections 2024-09-19T09:13:59.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.760+0000 7fb87ffb7640 1 --2- 172.21.15.18:0/509098132 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb85c06c2b0 0x7fb85c06e770 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:59.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.760+0000 7fb87ffb7640 1 --2- 172.21.15.18:0/509098132 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8781e7300 0x7fb8781e6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:59.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.760+0000 7fb87ffb7640 1 --2- 172.21.15.18:0/509098132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8781e4080 0x7fb8781e4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:59.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.760+0000 7fb87ffb7640 1 --2- 172.21.15.18:0/509098132 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb8640051c0 0x7fb87815d5a0 secure :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb87400f5f0 tx=0x7fb87400fab0 comp rx=0 tx=0).stop 2024-09-19T09:13:59.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.760+0000 7fb87ffb7640 1 -- 172.21.15.18:0/509098132 >> 172.21.15.18:0/509098132 conn(0x7fb8780d4c60 msgr2=0x7fb8780ba5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:59.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.761+0000 7fb87ffb7640 1 -- 172.21.15.18:0/509098132 shutdown_connections 2024-09-19T09:13:59.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.761+0000 7fb87ffb7640 1 -- 172.21.15.18:0/509098132 wait complete. 2024-09-19T09:13:59.774 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T09:13:59.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.886+0000 7ff46da53640 1 Processor -- start 2024-09-19T09:13:59.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.886+0000 7ff46da53640 1 -- start start 2024-09-19T09:13:59.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.887+0000 7ff46da53640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff46815edc0 0x7ff4680b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:59.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.887+0000 7ff46da53640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff4680b3c90 0x7ff4680d2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:59.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.887+0000 7ff46da53640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4680d0310 con 0x7ff4680d3080 2024-09-19T09:13:59.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.887+0000 7ff46da53640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7ff4680d05d0 con 0x7ff46815edc0 2024-09-19T09:13:59.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.887+0000 7ff46da53640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff4680d08b0 con 0x7ff4680b3c90 2024-09-19T09:13:59.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.887+0000 7ff466ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff46815edc0 0x7ff4680b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:59.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.887+0000 7ff466ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff46815edc0 0x7ff4680b1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33618/0 (socket says 172.21.15.18:33618) 2024-09-19T09:13:59.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.887+0000 7ff466ffd640 1 -- 172.21.15.18:0/4086901865 learned_addr learned my addr 172.21.15.18:0/4086901865 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:59.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.887+0000 7ff466ffd640 1 -- 172.21.15.18:0/4086901865 >> v2:172.21.15.162:3300/0 conn(0x7ff4680b3c90 msgr2=0x7ff4680d2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:59.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.887+0000 7ff4667fc640 1 --2- 172.21.15.18:0/4086901865 >> v2:172.21.15.162:3300/0 conn(0x7ff4680b3c90 0x7ff4680d2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:59.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.887+0000 7ff466ffd640 1 --2- 172.21.15.18:0/4086901865 >> v2:172.21.15.162:3300/0 conn(0x7ff4680b3c90 0x7ff4680d2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:59.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.887+0000 7ff466ffd640 1 -- 172.21.15.18:0/4086901865 >> v1:172.21.15.162:6789/0 conn(0x7ff4680d3080 legacy=0x7ff4680d3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:13:59.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.887+0000 7ff466ffd640 1 -- 172.21.15.18:0/4086901865 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4680d0b90 con 0x7ff46815edc0 2024-09-19T09:13:59.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.888+0000 7ff466ffd640 1 --2- 172.21.15.18:0/4086901865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff46815edc0 0x7ff4680b1890 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff46808df40 tx=0x7ff45802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e216ab3cf45203 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:59.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.888+0000 7ff465ffb640 1 -- 172.21.15.18:0/4086901865 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff458037070 con 0x7ff46815edc0 2024-09-19T09:13:59.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.888+0000 7ff465ffb640 1 -- 172.21.15.18:0/4086901865 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff458032440 con 0x7ff46815edc0 2024-09-19T09:13:59.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.888+0000 7ff465ffb640 1 -- 172.21.15.18:0/4086901865 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff458032810 con 0x7ff46815edc0 2024-09-19T09:13:59.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.889+0000 7ff46da53640 1 -- 172.21.15.18:0/4086901865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff46815edc0 msgr2=0x7ff4680b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:59.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.889+0000 7ff46da53640 1 --2- 172.21.15.18:0/4086901865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff46815edc0 0x7ff4680b1890 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff46808df40 tx=0x7ff45802a230 comp rx=0 tx=0).stop 2024-09-19T09:13:59.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.889+0000 7ff46da53640 1 -- 172.21.15.18:0/4086901865 shutdown_connections 2024-09-19T09:13:59.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.889+0000 7ff46da53640 1 --2- 172.21.15.18:0/4086901865 >> v2:172.21.15.162:3300/0 conn(0x7ff4680b3c90 0x7ff4680d2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:59.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.889+0000 7ff46da53640 1 --2- 172.21.15.18:0/4086901865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff46815edc0 0x7ff4680b1890 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:59.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.889+0000 7ff46da53640 1 -- 172.21.15.18:0/4086901865 >> 172.21.15.18:0/4086901865 conn(0x7ff4680d4c60 msgr2=0x7ff4680d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:13:59.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.889+0000 7ff46da53640 1 -- 172.21.15.18:0/4086901865 shutdown_connections 2024-09-19T09:13:59.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.889+0000 7ff46da53640 1 -- 172.21.15.18:0/4086901865 wait complete. 2024-09-19T09:13:59.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.890+0000 7ff46da53640 1 Processor -- start 2024-09-19T09:13:59.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.890+0000 7ff46da53640 1 -- start start 2024-09-19T09:13:59.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.891+0000 7ff46da53640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4680b3c90 0x7ff4680b56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:59.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.891+0000 7ff46da53640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4680d3080 0x7ff4681f4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:59.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.891+0000 7ff46da53640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff46815edc0 0x7ff4681e9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:59.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.891+0000 7ff46da53640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff4680d1810 con 0x7ff4680b3c90 2024-09-19T09:13:59.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.891+0000 7ff46da53640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff4680d2d70 con 0x7ff46815edc0 2024-09-19T09:13:59.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.891+0000 7ff46da53640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff4680d1990 con 0x7ff4680d3080 2024-09-19T09:13:59.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.891+0000 7ff466ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4680b3c90 0x7ff4680b56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:59.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.891+0000 7ff466ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4680b3c90 0x7ff4680b56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33632/0 (socket says 172.21.15.18:33632) 2024-09-19T09:13:59.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.891+0000 7ff466ffd640 1 -- 172.21.15.18:0/988671196 learned_addr learned my addr 172.21.15.18:0/988671196 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:13:59.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.891+0000 7ff4677fe640 1 --2- 172.21.15.18:0/988671196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff46815edc0 0x7ff4681e9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:59.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.891+0000 7ff4667fc640 1 --2- 172.21.15.18:0/988671196 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4680d3080 0x7ff4681f4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:59.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.891+0000 7ff466ffd640 1 -- 172.21.15.18:0/988671196 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4680d3080 msgr2=0x7ff4681f4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:59.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.891+0000 7ff466ffd640 1 --2- 172.21.15.18:0/988671196 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4680d3080 0x7ff4681f4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:59.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.891+0000 7ff466ffd640 1 -- 172.21.15.18:0/988671196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff46815edc0 msgr2=0x7ff4681e9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:13:59.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.891+0000 7ff466ffd640 1 --2- 172.21.15.18:0/988671196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff46815edc0 0x7ff4681e9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:13:59.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.891+0000 7ff466ffd640 1 -- 172.21.15.18:0/988671196 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4681f5820 con 0x7ff4680b3c90 2024-09-19T09:13:59.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.891+0000 7ff4677fe640 1 --2- 172.21.15.18:0/988671196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff46815edc0 0x7ff4681e9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:13:59.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.891+0000 7ff4667fc640 1 --2- 172.21.15.18:0/988671196 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4680d3080 0x7ff4681f4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:13:59.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.892+0000 7ff466ffd640 1 --2- 172.21.15.18:0/988671196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4680b3c90 0x7ff4680b56a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff458000c00 tx=0x7ff4580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:59.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.892+0000 7ff44ffff640 1 -- 172.21.15.18:0/988671196 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff458041020 con 0x7ff4680b3c90 2024-09-19T09:13:59.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.892+0000 7ff44ffff640 1 -- 172.21.15.18:0/988671196 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff458030970 con 0x7ff4680b3c90 2024-09-19T09:13:59.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.892+0000 7ff46da53640 1 -- 172.21.15.18:0/988671196 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4681f5b00 con 0x7ff4680b3c90 2024-09-19T09:13:59.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.892+0000 7ff44ffff640 1 -- 172.21.15.18:0/988671196 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff458037040 con 0x7ff4680b3c90 2024-09-19T09:13:59.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.892+0000 7ff46da53640 1 -- 172.21.15.18:0/988671196 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4680cde00 con 0x7ff4680b3c90 2024-09-19T09:13:59.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.893+0000 7ff46da53640 1 -- 172.21.15.18:0/988671196 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4680cbd80 con 0x7ff4680b3c90 2024-09-19T09:13:59.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.893+0000 7ff44ffff640 1 -- 172.21.15.18:0/988671196 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff458044020 con 0x7ff4680b3c90 2024-09-19T09:13:59.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.894+0000 7ff44ffff640 1 --2- 172.21.15.18:0/988671196 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff45406c2e0 0x7ff45406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:13:59.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.894+0000 7ff44ffff640 1 -- 172.21.15.18:0/988671196 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5357+0+0 (secure 0 0 0) 0x7ff4580abb90 con 0x7ff4680b3c90 2024-09-19T09:13:59.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.894+0000 7ff4667fc640 1 --2- 172.21.15.18:0/988671196 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff45406c2e0 0x7ff45406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:13:59.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.895+0000 7ff4667fc640 1 --2- 172.21.15.18:0/988671196 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff45406c2e0 0x7ff45406e7a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff468161960 tx=0x7ff45c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:13:59.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:13:59.898+0000 7ff44ffff640 1 -- 172.21.15.18:0/988671196 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff45804b030 con 0x7ff4680b3c90 2024-09-19T09:14:00.068 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:14:00.070 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:14:00.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.074+0000 7ff46da53640 1 -- 172.21.15.18:0/988671196 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff4681f5cd0 con 0x7ff4680b3c90 2024-09-19T09:14:00.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.758+0000 7ff44ffff640 1 -- 172.21.15.18:0/988671196 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) ==== 169+0+0 (secure 0 0 0) 0x7ff45807a4f0 con 0x7ff4680b3c90 2024-09-19T09:14:00.758 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' removed 2024-09-19T09:14:00.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.763+0000 7ff46da53640 1 -- 172.21.15.18:0/988671196 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff45406c2e0 msgr2=0x7ff45406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:00.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.763+0000 7ff46da53640 1 --2- 172.21.15.18:0/988671196 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff45406c2e0 0x7ff45406e7a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff468161960 tx=0x7ff45c008040 comp rx=0 tx=0).stop 2024-09-19T09:14:00.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.763+0000 7ff46da53640 1 -- 172.21.15.18:0/988671196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4680b3c90 msgr2=0x7ff4680b56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:00.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.763+0000 7ff46da53640 1 --2- 172.21.15.18:0/988671196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4680b3c90 0x7ff4680b56a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff458000c00 tx=0x7ff4580046c0 comp rx=0 tx=0).stop 2024-09-19T09:14:00.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.763+0000 7ff46da53640 1 -- 172.21.15.18:0/988671196 shutdown_connections 2024-09-19T09:14:00.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.763+0000 7ff46da53640 1 --2- 172.21.15.18:0/988671196 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff45406c2e0 0x7ff45406e7a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:00.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.763+0000 7ff46da53640 1 --2- 172.21.15.18:0/988671196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff46815edc0 0x7ff4681e9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:00.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.763+0000 7ff46da53640 1 --2- 172.21.15.18:0/988671196 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4680d3080 0x7ff4681f4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:00.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.763+0000 7ff46da53640 1 --2- 172.21.15.18:0/988671196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4680b3c90 0x7ff4680b56a0 secure :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff458000c00 tx=0x7ff4580046c0 comp rx=0 tx=0).stop 2024-09-19T09:14:00.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.763+0000 7ff46da53640 1 -- 172.21.15.18:0/988671196 >> 172.21.15.18:0/988671196 conn(0x7ff4680d4c60 msgr2=0x7ff4680cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:00.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.764+0000 7ff46da53640 1 -- 172.21.15.18:0/988671196 shutdown_connections 2024-09-19T09:14:00.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.764+0000 7ff46da53640 1 -- 172.21.15.18:0/988671196 wait complete. 2024-09-19T09:14:00.779 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T09:14:00.779 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-19T09:14:00.780 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T09:14:00.780 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:14:00.780 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T09:14:00.780 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-19T09:14:00.780 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T09:14:00.780 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:14:00.780 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T09:14:00.780 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-19T09:14:00.781 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T09:14:00.781 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:14:00.781 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T09:14:00.781 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-19T09:14:00.781 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T09:14:00.781 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:14:00.795 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T09:14:00.795 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T09:14:00.796 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T09:14:00.796 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T09:14:00.797 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T09:14:00.797 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T09:14:00.798 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T09:14:00.798 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T09:14:00.838 INFO:tasks.ceph.mds.c:Started 2024-09-19T09:14:00.838 DEBUG:teuthology.parallel:result is None 2024-09-19T09:14:00.839 INFO:tasks.ceph.mds.a:Started 2024-09-19T09:14:00.839 DEBUG:teuthology.parallel:result is None 2024-09-19T09:14:00.840 INFO:tasks.ceph.mds.b:Started 2024-09-19T09:14:00.840 DEBUG:teuthology.parallel:result is None 2024-09-19T09:14:00.841 INFO:tasks.ceph.mds.d:Started 2024-09-19T09:14:00.841 DEBUG:teuthology.parallel:result is None 2024-09-19T09:14:00.842 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-19T09:14:00.922 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-09-19T09:14:00.922 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2024-09-19T09:14:00.925 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-09-19T09:14:00.925 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-09-19T09:14:00.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.955+0000 7f61cc96d640 1 Processor -- start 2024-09-19T09:14:00.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.955+0000 7f61cc96d640 1 -- start start 2024-09-19T09:14:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.956+0000 7f61cc96d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f61c815c720 0x7f61c806f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.956+0000 7f61cc96d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f61c8073c70 0x7f61c81626a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.956+0000 7f61cc96d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61c80b6fa0 con 0x7f61c8073140 2024-09-19T09:14:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.956+0000 7f61cc96d640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f61c8160480 con 0x7f61c8073c70 2024-09-19T09:14:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.956+0000 7f61cc96d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f61c815fa50 con 0x7f61c815c720 2024-09-19T09:14:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.956+0000 7f61c6d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f61c8073c70 0x7f61c81626a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.956+0000 7f61c6d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f61c8073c70 0x7f61c81626a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33680/0 (socket says 172.21.15.18:33680) 2024-09-19T09:14:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.956+0000 7f61c6d9d640 1 -- 172.21.15.18:0/637928078 learned_addr learned my addr 172.21.15.18:0/637928078 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.956+0000 7f61c659c640 1 --2- 172.21.15.18:0/637928078 >> v2:172.21.15.162:3300/0 conn(0x7f61c815c720 0x7f61c806f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:00.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.956+0000 7f61c6d9d640 1 -- 172.21.15.18:0/637928078 >> v2:172.21.15.162:3300/0 conn(0x7f61c815c720 msgr2=0x7f61c806f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:00.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.956+0000 7f61c6d9d640 1 --2- 172.21.15.18:0/637928078 >> v2:172.21.15.162:3300/0 conn(0x7f61c815c720 0x7f61c806f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:00.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.956+0000 7f61c6d9d640 1 -- 172.21.15.18:0/637928078 >> v1:172.21.15.162:6789/0 conn(0x7f61c8073140 legacy=0x7f61c8073560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:00.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.956+0000 7f61c6d9d640 1 -- 172.21.15.18:0/637928078 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c806fd00 con 0x7f61c8073c70 2024-09-19T09:14:00.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.957+0000 7f61c6d9d640 1 --2- 172.21.15.18:0/637928078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61c8073c70 0x7f61c81626a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f61c8071a20 tx=0x7f61c002a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a172dc3cf1e951c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:00.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.957+0000 7f61c559a640 1 -- 172.21.15.18:0/637928078 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c0036070 con 0x7f61c8073c70 2024-09-19T09:14:00.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.957+0000 7f61c559a640 1 -- 172.21.15.18:0/637928078 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c0031600 con 0x7f61c8073c70 2024-09-19T09:14:00.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.957+0000 7f61c559a640 1 -- 172.21.15.18:0/637928078 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c00319f0 con 0x7f61c8073c70 2024-09-19T09:14:00.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.958+0000 7f61cc96d640 1 -- 172.21.15.18:0/637928078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61c8073c70 msgr2=0x7f61c81626a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:00.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.958+0000 7f61cc96d640 1 --2- 172.21.15.18:0/637928078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61c8073c70 0x7f61c81626a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f61c8071a20 tx=0x7f61c002a7c0 comp rx=0 tx=0).stop 2024-09-19T09:14:00.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.958+0000 7f61cc96d640 1 -- 172.21.15.18:0/637928078 shutdown_connections 2024-09-19T09:14:00.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.958+0000 7f61cc96d640 1 --2- 172.21.15.18:0/637928078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61c8073c70 0x7f61c81626a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:00.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.958+0000 7f61cc96d640 1 --2- 172.21.15.18:0/637928078 >> v2:172.21.15.162:3300/0 conn(0x7f61c815c720 0x7f61c806f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:00.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.958+0000 7f61cc96d640 1 -- 172.21.15.18:0/637928078 >> 172.21.15.18:0/637928078 conn(0x7f61c80b5eb0 msgr2=0x7f61c80b6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:00.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.958+0000 7f61cc96d640 1 -- 172.21.15.18:0/637928078 shutdown_connections 2024-09-19T09:14:00.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.958+0000 7f61cc96d640 1 -- 172.21.15.18:0/637928078 wait complete. 2024-09-19T09:14:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.959+0000 7f61cc96d640 1 Processor -- start 2024-09-19T09:14:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.959+0000 7f61cc96d640 1 -- start start 2024-09-19T09:14:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.960+0000 7f61cc96d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61c8073140 0x7f61c80ae180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.960+0000 7f61cc96d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61c8073c70 0x7f61c80b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.960+0000 7f61cc96d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61c815c720 0x7f61c80b0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.960+0000 7f61cc96d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f61c815f0b0 con 0x7f61c8073c70 2024-09-19T09:14:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.960+0000 7f61cc96d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f61c815f6e0 con 0x7f61c815c720 2024-09-19T09:14:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.960+0000 7f61cc96d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f61c815fee0 con 0x7f61c8073140 2024-09-19T09:14:00.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.960+0000 7f61c5d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61c8073c70 0x7f61c80b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:00.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.960+0000 7f61c5d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61c8073c70 0x7f61c80b0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33688/0 (socket says 172.21.15.18:33688) 2024-09-19T09:14:00.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.960+0000 7f61c5d9b640 1 -- 172.21.15.18:0/341112678 learned_addr learned my addr 172.21.15.18:0/341112678 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:00.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.960+0000 7f61c659c640 1 --2- 172.21.15.18:0/341112678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61c8073140 0x7f61c80ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:00.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.960+0000 7f61c6d9d640 1 --2- 172.21.15.18:0/341112678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61c815c720 0x7f61c80b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:00.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.961+0000 7f61c5d9b640 1 -- 172.21.15.18:0/341112678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61c8073140 msgr2=0x7f61c80ae180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:00.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.961+0000 7f61c5d9b640 1 --2- 172.21.15.18:0/341112678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61c8073140 0x7f61c80ae180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:00.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.961+0000 7f61c5d9b640 1 -- 172.21.15.18:0/341112678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61c815c720 msgr2=0x7f61c80b0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:00.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.961+0000 7f61c5d9b640 1 --2- 172.21.15.18:0/341112678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61c815c720 0x7f61c80b0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:00.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.961+0000 7f61c5d9b640 1 -- 172.21.15.18:0/341112678 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c80ae9b0 con 0x7f61c8073c70 2024-09-19T09:14:00.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.961+0000 7f61c659c640 1 --2- 172.21.15.18:0/341112678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61c8073140 0x7f61c80ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:14:00.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.961+0000 7f61c6d9d640 1 --2- 172.21.15.18:0/341112678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61c815c720 0x7f61c80b0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:14:00.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.961+0000 7f61c5d9b640 1 --2- 172.21.15.18:0/341112678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61c8073c70 0x7f61c80b0200 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00c450 tx=0x7f61bc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:00.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.961+0000 7f61b6ffd640 1 -- 172.21.15.18:0/341112678 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61bc017070 con 0x7f61c8073c70 2024-09-19T09:14:00.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.961+0000 7f61b6ffd640 1 -- 172.21.15.18:0/341112678 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61bc0052d0 con 0x7f61c8073c70 2024-09-19T09:14:00.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.961+0000 7f61cc96d640 1 -- 172.21.15.18:0/341112678 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61c80aec90 con 0x7f61c8073c70 2024-09-19T09:14:00.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.961+0000 7f61b6ffd640 1 -- 172.21.15.18:0/341112678 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61bc003830 con 0x7f61c8073c70 2024-09-19T09:14:00.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.961+0000 7f61cc96d640 1 -- 172.21.15.18:0/341112678 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61c80af530 con 0x7f61c8073c70 2024-09-19T09:14:00.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.962+0000 7f61cc96d640 1 -- 172.21.15.18:0/341112678 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61c806f620 con 0x7f61c8073c70 2024-09-19T09:14:00.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.963+0000 7f61b6ffd640 1 -- 172.21.15.18:0/341112678 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f61bc01a070 con 0x7f61c8073c70 2024-09-19T09:14:00.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.963+0000 7f61b6ffd640 1 --2- 172.21.15.18:0/341112678 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f61a806c2e0 0x7f61a806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:00.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.964+0000 7f61b6ffd640 1 -- 172.21.15.18:0/341112678 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 4943+0+0 (secure 0 0 0) 0x7f61bc08a400 con 0x7f61c8073c70 2024-09-19T09:14:00.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.964+0000 7f61c659c640 1 --2- 172.21.15.18:0/341112678 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f61a806c2e0 0x7f61a806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:00.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.964+0000 7f61c659c640 1 --2- 172.21.15.18:0/341112678 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f61a806c2e0 0x7f61a806e7a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f61b8009e90 tx=0x7f61b8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:00.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:00.968+0000 7f61b6ffd640 1 -- 172.21.15.18:0/341112678 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f61c80b6fa0 con 0x7f61c8073c70 2024-09-19T09:14:01.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.155+0000 7f61cc96d640 1 -- 172.21.15.18:0/341112678 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f61c80af700 con 0x7f61c8073c70 2024-09-19T09:14:01.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.777+0000 7f61b6ffd640 1 -- 172.21.15.18:0/341112678 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) ==== 97+0+0 (secure 0 0 0) 0x7f61bc058830 con 0x7f61c8073c70 2024-09-19T09:14:01.779 INFO:teuthology.orchestra.run.smithi018.stderr: removed all blocklist entries 2024-09-19T09:14:01.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.780+0000 7f61cc96d640 1 -- 172.21.15.18:0/341112678 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f61a806c2e0 msgr2=0x7f61a806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:01.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.780+0000 7f61cc96d640 1 --2- 172.21.15.18:0/341112678 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f61a806c2e0 0x7f61a806e7a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f61b8009e90 tx=0x7f61b8009190 comp rx=0 tx=0).stop 2024-09-19T09:14:01.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.780+0000 7f61cc96d640 1 -- 172.21.15.18:0/341112678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61c8073c70 msgr2=0x7f61c80b0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:01.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.780+0000 7f61cc96d640 1 --2- 172.21.15.18:0/341112678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61c8073c70 0x7f61c80b0200 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00c450 tx=0x7f61bc00c910 comp rx=0 tx=0).stop 2024-09-19T09:14:01.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.780+0000 7f61cc96d640 1 -- 172.21.15.18:0/341112678 shutdown_connections 2024-09-19T09:14:01.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.780+0000 7f61cc96d640 1 --2- 172.21.15.18:0/341112678 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f61a806c2e0 0x7f61a806e7a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:01.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.780+0000 7f61cc96d640 1 --2- 172.21.15.18:0/341112678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61c815c720 0x7f61c80b0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:01.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.780+0000 7f61cc96d640 1 --2- 172.21.15.18:0/341112678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61c8073c70 0x7f61c80b0200 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:01.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.780+0000 7f61cc96d640 1 --2- 172.21.15.18:0/341112678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61c8073140 0x7f61c80ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:01.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.780+0000 7f61cc96d640 1 -- 172.21.15.18:0/341112678 >> 172.21.15.18:0/341112678 conn(0x7f61c80b5eb0 msgr2=0x7f61c81622e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:01.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.780+0000 7f61cc96d640 1 -- 172.21.15.18:0/341112678 shutdown_connections 2024-09-19T09:14:01.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.780+0000 7f61cc96d640 1 -- 172.21.15.18:0/341112678 wait complete. 2024-09-19T09:14:01.795 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-19T09:14:01.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.899+0000 7f49f4b31640 1 Processor -- start 2024-09-19T09:14:01.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.899+0000 7f49f4b31640 1 -- start start 2024-09-19T09:14:01.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.900+0000 7f49f4b31640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49f0160300 0x7f49f00cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:01.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.900+0000 7f49f4b31640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f49f00708f0 0x7f49f00cd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:01.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.900+0000 7f49f4b31640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49f00d0050 con 0x7f49f00d1ed0 2024-09-19T09:14:01.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.900+0000 7f49f4b31640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f49f00d0330 con 0x7f49f00708f0 2024-09-19T09:14:01.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.900+0000 7f49f4b31640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f49f00d1420 con 0x7f49f0160300 2024-09-19T09:14:01.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.900+0000 7f49eed9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f49f00708f0 0x7f49f00cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:01.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.900+0000 7f49eed9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f49f00708f0 0x7f49f00cd730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33702/0 (socket says 172.21.15.18:33702) 2024-09-19T09:14:01.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.900+0000 7f49eed9d640 1 -- 172.21.15.18:0/2047479148 learned_addr learned my addr 172.21.15.18:0/2047479148 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:01.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.900+0000 7f49ee59c640 1 --2- 172.21.15.18:0/2047479148 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49f0160300 0x7f49f00cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:01.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.900+0000 7f49eed9d640 1 -- 172.21.15.18:0/2047479148 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49f0160300 msgr2=0x7f49f00cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:01.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.900+0000 7f49eed9d640 1 --2- 172.21.15.18:0/2047479148 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49f0160300 0x7f49f00cf2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:01.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.900+0000 7f49eed9d640 1 -- 172.21.15.18:0/2047479148 >> v1:172.21.15.162:6789/0 conn(0x7f49f00d1ed0 legacy=0x7f49f00cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:01.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.900+0000 7f49eed9d640 1 -- 172.21.15.18:0/2047479148 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f00d1700 con 0x7f49f00708f0 2024-09-19T09:14:01.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.901+0000 7f49eed9d640 1 --2- 172.21.15.18:0/2047479148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49f00708f0 0x7f49f00cd730 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009e50 tx=0x7f49e802a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b556ba774c7fd43e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:01.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.901+0000 7f49ed59a640 1 -- 172.21.15.18:0/2047479148 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e8036070 con 0x7f49f00708f0 2024-09-19T09:14:01.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.901+0000 7f49ed59a640 1 -- 172.21.15.18:0/2047479148 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49e8031600 con 0x7f49f00708f0 2024-09-19T09:14:01.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.901+0000 7f49ed59a640 1 -- 172.21.15.18:0/2047479148 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e80319d0 con 0x7f49f00708f0 2024-09-19T09:14:01.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.902+0000 7f49f4b31640 1 -- 172.21.15.18:0/2047479148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49f00708f0 msgr2=0x7f49f00cd730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:01.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.902+0000 7f49f4b31640 1 --2- 172.21.15.18:0/2047479148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49f00708f0 0x7f49f00cd730 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f49e8009e50 tx=0x7f49e802a630 comp rx=0 tx=0).stop 2024-09-19T09:14:01.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.902+0000 7f49f4b31640 1 -- 172.21.15.18:0/2047479148 shutdown_connections 2024-09-19T09:14:01.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.902+0000 7f49f4b31640 1 --2- 172.21.15.18:0/2047479148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49f00708f0 0x7f49f00cd730 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:01.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.902+0000 7f49f4b31640 1 --2- 172.21.15.18:0/2047479148 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49f0160300 0x7f49f00cf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:01.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.902+0000 7f49f4b31640 1 -- 172.21.15.18:0/2047479148 >> 172.21.15.18:0/2047479148 conn(0x7f49f00b4600 msgr2=0x7f49f00b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:01.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.902+0000 7f49f4b31640 1 -- 172.21.15.18:0/2047479148 shutdown_connections 2024-09-19T09:14:01.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.902+0000 7f49f4b31640 1 -- 172.21.15.18:0/2047479148 wait complete. 2024-09-19T09:14:01.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.903+0000 7f49f4b31640 1 Processor -- start 2024-09-19T09:14:01.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.903+0000 7f49f4b31640 1 -- start start 2024-09-19T09:14:01.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.904+0000 7f49f4b31640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49f00708f0 0x7f49f01552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:01.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.904+0000 7f49f4b31640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49f00d1ed0 0x7f49f00ca7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:01.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.904+0000 7f49f4b31640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49f0160300 0x7f49f00b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:01.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.904+0000 7f49f4b31640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f49f01606e0 con 0x7f49f00d1ed0 2024-09-19T09:14:01.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.904+0000 7f49f4b31640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f49f00b54a0 con 0x7f49f00708f0 2024-09-19T09:14:01.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.904+0000 7f49f4b31640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f49f0160860 con 0x7f49f0160300 2024-09-19T09:14:01.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.904+0000 7f49edd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49f00d1ed0 0x7f49f00ca7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:01.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.904+0000 7f49edd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49f00d1ed0 0x7f49f00ca7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33706/0 (socket says 172.21.15.18:33706) 2024-09-19T09:14:01.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.904+0000 7f49edd9b640 1 -- 172.21.15.18:0/2893677105 learned_addr learned my addr 172.21.15.18:0/2893677105 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:01.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.904+0000 7f49ee59c640 1 --2- 172.21.15.18:0/2893677105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49f00708f0 0x7f49f01552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:01.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.905+0000 7f49eed9d640 1 --2- 172.21.15.18:0/2893677105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49f0160300 0x7f49f00b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:01.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.905+0000 7f49edd9b640 1 -- 172.21.15.18:0/2893677105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49f0160300 msgr2=0x7f49f00b11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:01.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.905+0000 7f49edd9b640 1 --2- 172.21.15.18:0/2893677105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49f0160300 0x7f49f00b11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:01.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.905+0000 7f49edd9b640 1 -- 172.21.15.18:0/2893677105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49f00708f0 msgr2=0x7f49f01552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:01.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.905+0000 7f49edd9b640 1 --2- 172.21.15.18:0/2893677105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49f00708f0 0x7f49f01552c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:01.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.905+0000 7f49edd9b640 1 -- 172.21.15.18:0/2893677105 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f00b03e0 con 0x7f49f00d1ed0 2024-09-19T09:14:01.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.905+0000 7f49edd9b640 1 --2- 172.21.15.18:0/2893677105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49f00d1ed0 0x7f49f00ca7a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f49e400b3c0 tx=0x7f49e400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:01.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.905+0000 7f49deffd640 1 -- 172.21.15.18:0/2893677105 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e4011830 con 0x7f49f00d1ed0 2024-09-19T09:14:01.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.905+0000 7f49deffd640 1 -- 172.21.15.18:0/2893677105 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49e4016070 con 0x7f49f00d1ed0 2024-09-19T09:14:01.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.905+0000 7f49deffd640 1 -- 172.21.15.18:0/2893677105 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e4011c50 con 0x7f49f00d1ed0 2024-09-19T09:14:01.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.905+0000 7f49f4b31640 1 -- 172.21.15.18:0/2893677105 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49f00b06c0 con 0x7f49f00d1ed0 2024-09-19T09:14:01.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.905+0000 7f49f4b31640 1 -- 172.21.15.18:0/2893677105 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49f00b0c80 con 0x7f49f00d1ed0 2024-09-19T09:14:01.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.906+0000 7f49f4b31640 1 -- 172.21.15.18:0/2893677105 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49f00b0e80 con 0x7f49f00d1ed0 2024-09-19T09:14:01.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.907+0000 7f49deffd640 1 -- 172.21.15.18:0/2893677105 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f49e401b460 con 0x7f49f00d1ed0 2024-09-19T09:14:01.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.907+0000 7f49deffd640 1 --2- 172.21.15.18:0/2893677105 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f49d006c2e0 0x7f49d006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:01.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.907+0000 7f49deffd640 1 -- 172.21.15.18:0/2893677105 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f49e408ab90 con 0x7f49f00d1ed0 2024-09-19T09:14:01.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.907+0000 7f49ee59c640 1 --2- 172.21.15.18:0/2893677105 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f49d006c2e0 0x7f49d006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:01.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.908+0000 7f49ee59c640 1 --2- 172.21.15.18:0/2893677105 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f49d006c2e0 0x7f49d006e7a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f49e0006fd0 tx=0x7f49e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:01.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:01.911+0000 7f49deffd640 1 -- 172.21.15.18:0/2893677105 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f49f00b0e80 con 0x7f49f00d1ed0 2024-09-19T09:14:02.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.151+0000 7f49f4b31640 1 -- 172.21.15.18:0/2893677105 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f49f00cf2d0 con 0x7f49f00d1ed0 2024-09-19T09:14:02.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.152+0000 7f49deffd640 1 -- 172.21.15.18:0/2893677105 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7f49e4020020 con 0x7f49f00d1ed0 2024-09-19T09:14:02.153 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:02.154 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:14:02.154 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_dump": [ 2024-09-19T09:14:02.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:02.154 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.a", 2024-09-19T09:14:02.154 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmDY7cHhAALxtxGq6eR3A2QXYp+nW0FA==", 2024-09-19T09:14:02.154 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:02.154 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:14:02.155 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:14:02.155 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:14:02.155 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:14:02.155 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:02.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:02.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:02.155 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.b", 2024-09-19T09:14:02.155 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tm9ILFKhAABEtgvzO5YBXqzYaeBZ0qZg==", 2024-09-19T09:14:02.155 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:02.155 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:14:02.155 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:14:02.155 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:14:02.155 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:14:02.156 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:02.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:02.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:02.156 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.c", 2024-09-19T09:14:02.156 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmwPkOJhAADt/0XVei2kl79pIw55wu1A==", 2024-09-19T09:14:02.156 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:02.156 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:14:02.156 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:14:02.156 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:14:02.156 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:14:02.156 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:02.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:02.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:02.157 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.d", 2024-09-19T09:14:02.157 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tm35XYMRAA/OSE5iv8M+TekEJVTARETw==", 2024-09-19T09:14:02.157 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:02.157 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:14:02.157 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:14:02.157 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:14:02.157 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:14:02.157 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:02.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:02.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:02.157 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.0", 2024-09-19T09:14:02.157 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmkUBiGhAATWtnqNPWyZJ+tnQcZOtT5A==", 2024-09-19T09:14:02.157 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:02.158 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:14:02.158 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:14:02.158 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:14:02.158 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:02.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:02.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:02.158 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.1", 2024-09-19T09:14:02.158 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmir5wIRAA9QumyCr8yLHtNj/YqQ1d0A==", 2024-09-19T09:14:02.158 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:02.158 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:14:02.158 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:14:02.159 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:14:02.159 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:02.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:02.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:02.159 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.2", 2024-09-19T09:14:02.159 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmfQJ6KBAAfTerKv1zCzFf6UfAVUikxA==", 2024-09-19T09:14:02.159 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:02.159 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:14:02.159 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:14:02.159 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:14:02.159 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:02.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:02.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:02.160 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.3", 2024-09-19T09:14:02.160 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmSeSOLxAACqCpiIQO4cDyjXUmoGPKAQ==", 2024-09-19T09:14:02.160 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:02.160 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:14:02.160 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:14:02.160 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:14:02.160 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:02.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:02.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:02.160 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.4", 2024-09-19T09:14:02.160 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmrsoFAhAArI7cRPVe/jrnSdmyE8jCsQ==", 2024-09-19T09:14:02.160 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:02.160 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:14:02.160 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:14:02.161 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:14:02.161 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:02.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:02.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:02.161 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.5", 2024-09-19T09:14:02.161 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmudM3CRAAXF3uI58SNJE6qtYX2wNQeQ==", 2024-09-19T09:14:02.161 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:02.161 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:14:02.161 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:14:02.161 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:14:02.161 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:02.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:02.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:02.161 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.6", 2024-09-19T09:14:02.162 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmqEQmEBAAm4h/8p91HwX84pl/U80Q9Q==", 2024-09-19T09:14:02.162 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:02.162 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:14:02.162 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:14:02.162 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:14:02.162 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:02.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:02.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:02.162 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.7", 2024-09-19T09:14:02.162 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmhDs0FxAAxZvRVkBoWqsdmyifRZzgwg==", 2024-09-19T09:14:02.162 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:02.162 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:14:02.162 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:14:02.162 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:14:02.162 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:02.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:02.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:02.163 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.0", 2024-09-19T09:14:02.163 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmcbwDNhAAaG0+wu96Locwws+h0zeh8Q==", 2024-09-19T09:14:02.163 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:02.163 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:14:02.163 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-19T09:14:02.163 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-19T09:14:02.163 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-19T09:14:02.163 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:02.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:02.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:02.163 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.1", 2024-09-19T09:14:02.163 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAf6+tmb4FeAxAAU+nZN/Vb33HrU0yfXmU9gA==", 2024-09-19T09:14:02.164 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:02.164 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:14:02.164 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-19T09:14:02.164 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-19T09:14:02.164 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-19T09:14:02.164 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:02.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:02.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:02.164 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.2", 2024-09-19T09:14:02.164 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAf6+tmc34kABAAC5b4Kkm2dJvxxyXva6PT2g==", 2024-09-19T09:14:02.164 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:02.164 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:14:02.164 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-19T09:14:02.164 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-19T09:14:02.165 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-19T09:14:02.165 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:02.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:02.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:02.165 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.3", 2024-09-19T09:14:02.165 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAf6+tmx4vzCBAAZ7ZrdGI2s8LqT0MjjzOCjw==", 2024-09-19T09:14:02.165 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:02.165 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:14:02.165 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-19T09:14:02.165 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-19T09:14:02.165 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-19T09:14:02.165 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:02.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:02.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:02.166 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.admin", 2024-09-19T09:14:02.166 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmZaWgAhAAx7MUazt6rS+wa/ZMSGC97Q==", 2024-09-19T09:14:02.166 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:02.166 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-19T09:14:02.166 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:14:02.166 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:14:02.166 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:14:02.166 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:02.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:02.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:02.166 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.bootstrap-mds", 2024-09-19T09:14:02.166 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAn6+tmyLbQFBAAUVOmWzNZv/h3CF5SPG8Yzw==", 2024-09-19T09:14:02.166 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:02.167 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile bootstrap-mds" 2024-09-19T09:14:02.167 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:02.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:02.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:02.167 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.bootstrap-mgr", 2024-09-19T09:14:02.167 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAn6+tm0r/QFBAAjqNVn1sg0+MIrAM+WMy32w==", 2024-09-19T09:14:02.167 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:02.167 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-19T09:14:02.167 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:02.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:02.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:02.167 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.bootstrap-osd", 2024-09-19T09:14:02.168 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAn6+tmlsfQFBAAYR1NLh80b+epK+W8POeDaw==", 2024-09-19T09:14:02.168 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:02.168 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile bootstrap-osd" 2024-09-19T09:14:02.168 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:02.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:02.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:02.168 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.bootstrap-rbd", 2024-09-19T09:14:02.169 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAn6+tmx87QFBAATIydiatKz4pVJtMEvSvpnw==", 2024-09-19T09:14:02.169 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:02.169 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-19T09:14:02.169 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:02.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:02.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:02.169 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-19T09:14:02.169 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAn6+tmO9bQFBAA9iZfT5AWZOwOgtRpiI7RkA==", 2024-09-19T09:14:02.169 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:02.169 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-19T09:14:02.169 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:02.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:02.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:02.170 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.bootstrap-rgw", 2024-09-19T09:14:02.170 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAn6+tmzt3QFBAAEY5Dsc7g9N8fOTNG68wvNA==", 2024-09-19T09:14:02.170 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:02.170 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-19T09:14:02.170 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:02.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:02.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:02.170 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.x", 2024-09-19T09:14:02.170 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmwr6NGxAA3M5NZKkjc36L25teWJS7bQ==", 2024-09-19T09:14:02.170 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:02.170 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-19T09:14:02.170 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-09-19T09:14:02.171 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:14:02.171 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:02.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:02.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:02.171 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.y", 2024-09-19T09:14:02.171 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmBWOWFxAAEYKCroBhMcqoIe6WzXnNCg==", 2024-09-19T09:14:02.171 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:02.171 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-19T09:14:02.171 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-09-19T09:14:02.171 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:14:02.171 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:02.171 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:02.171 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:02.172 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:14:02.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.154+0000 7f49f4b31640 1 -- 172.21.15.18:0/2893677105 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f49d006c2e0 msgr2=0x7f49d006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:02.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.154+0000 7f49f4b31640 1 --2- 172.21.15.18:0/2893677105 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f49d006c2e0 0x7f49d006e7a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f49e0006fd0 tx=0x7f49e0008040 comp rx=0 tx=0).stop 2024-09-19T09:14:02.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.154+0000 7f49f4b31640 1 -- 172.21.15.18:0/2893677105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49f00d1ed0 msgr2=0x7f49f00ca7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:02.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.154+0000 7f49f4b31640 1 --2- 172.21.15.18:0/2893677105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49f00d1ed0 0x7f49f00ca7a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f49e400b3c0 tx=0x7f49e400b880 comp rx=0 tx=0).stop 2024-09-19T09:14:02.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.154+0000 7f49f4b31640 1 -- 172.21.15.18:0/2893677105 shutdown_connections 2024-09-19T09:14:02.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.154+0000 7f49f4b31640 1 --2- 172.21.15.18:0/2893677105 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f49d006c2e0 0x7f49d006e7a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:02.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.154+0000 7f49f4b31640 1 --2- 172.21.15.18:0/2893677105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f49f0160300 0x7f49f00b11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:02.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.154+0000 7f49f4b31640 1 --2- 172.21.15.18:0/2893677105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f49f00d1ed0 0x7f49f00ca7a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:02.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.154+0000 7f49f4b31640 1 --2- 172.21.15.18:0/2893677105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49f00708f0 0x7f49f01552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:02.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.154+0000 7f49f4b31640 1 -- 172.21.15.18:0/2893677105 >> 172.21.15.18:0/2893677105 conn(0x7f49f00b4600 msgr2=0x7f49f00cdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:02.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.154+0000 7f49f4b31640 1 -- 172.21.15.18:0/2893677105 shutdown_connections 2024-09-19T09:14:02.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.154+0000 7f49f4b31640 1 -- 172.21.15.18:0/2893677105 wait complete. 2024-09-19T09:14:02.174 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-19T09:14:02.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.277+0000 7f69eb749640 1 Processor -- start 2024-09-19T09:14:02.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.277+0000 7f69eb749640 1 -- start start 2024-09-19T09:14:02.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.278+0000 7f69eb749640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69e40b7270 0x7f69e40b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:02.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.278+0000 7f69eb749640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f69e40cc7f0 0x7f69e40ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:02.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.278+0000 7f69eb749640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69e40b7890 con 0x7f69e406d730 2024-09-19T09:14:02.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.278+0000 7f69eb749640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f69e40b7b70 con 0x7f69e40cc7f0 2024-09-19T09:14:02.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.278+0000 7f69eb749640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f69e40cbd10 con 0x7f69e40b7270 2024-09-19T09:14:02.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.278+0000 7f69e8ce4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69e40b7270 0x7f69e40b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:02.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.278+0000 7f69e8ce4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69e40b7270 0x7f69e40b6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:38846/0 (socket says 172.21.15.18:38846) 2024-09-19T09:14:02.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.278+0000 7f69e9ce6640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f69e40cc7f0 0x7f69e40ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:02.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.278+0000 7f69e8ce4640 1 -- 172.21.15.18:0/1823638130 learned_addr learned my addr 172.21.15.18:0/1823638130 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:02.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.278+0000 7f69e94e5640 1 --1- 172.21.15.18:0/1823638130 >> v1:172.21.15.162:6789/0 conn(0x7f69e406d730 0x7f69e406db10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:51352/0 (socket says 172.21.15.18:51352) 2024-09-19T09:14:02.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.278+0000 7f69dbfff640 1 -- 172.21.15.18:0/1823638130 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3877021663 0 0) 0x7f69e40b7890 con 0x7f69e406d730 2024-09-19T09:14:02.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.279+0000 7f69dbfff640 1 -- 172.21.15.18:0/1823638130 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69d0003520 con 0x7f69e406d730 2024-09-19T09:14:02.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.279+0000 7f69e8ce4640 1 -- 172.21.15.18:0/1823638130 >> v2:172.21.15.162:3300/0 conn(0x7f69e40cc7f0 msgr2=0x7f69e40ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:02.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.279+0000 7f69e8ce4640 1 --2- 172.21.15.18:0/1823638130 >> v2:172.21.15.162:3300/0 conn(0x7f69e40cc7f0 0x7f69e40ccc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:02.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.279+0000 7f69e8ce4640 1 -- 172.21.15.18:0/1823638130 >> v1:172.21.15.162:6789/0 conn(0x7f69e406d730 legacy=0x7f69e406db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:02.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.279+0000 7f69e8ce4640 1 -- 172.21.15.18:0/1823638130 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e40cbff0 con 0x7f69e40b7270 2024-09-19T09:14:02.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.279+0000 7f69e9ce6640 1 --2- 172.21.15.18:0/1823638130 >> v2:172.21.15.162:3300/0 conn(0x7f69e40cc7f0 0x7f69e40ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:14:02.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.279+0000 7f69e8ce4640 1 --2- 172.21.15.18:0/1823638130 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69e40b7270 0x7f69e40b6290 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f69d4009870 tx=0x7f69d402a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=381f019696c735de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:02.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.280+0000 7f69dbfff640 1 -- 172.21.15.18:0/1823638130 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d4037070 con 0x7f69e40b7270 2024-09-19T09:14:02.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.280+0000 7f69dbfff640 1 -- 172.21.15.18:0/1823638130 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d4032440 con 0x7f69e40b7270 2024-09-19T09:14:02.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.280+0000 7f69dbfff640 1 -- 172.21.15.18:0/1823638130 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d4032810 con 0x7f69e40b7270 2024-09-19T09:14:02.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.280+0000 7f69eb749640 1 -- 172.21.15.18:0/1823638130 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69e40b7270 msgr2=0x7f69e40b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:02.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.280+0000 7f69eb749640 1 --2- 172.21.15.18:0/1823638130 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69e40b7270 0x7f69e40b6290 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f69d4009870 tx=0x7f69d402a250 comp rx=0 tx=0).stop 2024-09-19T09:14:02.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.280+0000 7f69eb749640 1 -- 172.21.15.18:0/1823638130 shutdown_connections 2024-09-19T09:14:02.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.280+0000 7f69eb749640 1 --2- 172.21.15.18:0/1823638130 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69e40b7270 0x7f69e40b6290 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:02.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.280+0000 7f69eb749640 1 --2- 172.21.15.18:0/1823638130 >> v2:172.21.15.162:3300/0 conn(0x7f69e40cc7f0 0x7f69e40ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:02.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.280+0000 7f69eb749640 1 -- 172.21.15.18:0/1823638130 >> 172.21.15.18:0/1823638130 conn(0x7f69e40b7e10 msgr2=0x7f69e40b8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:02.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.280+0000 7f69eb749640 1 -- 172.21.15.18:0/1823638130 shutdown_connections 2024-09-19T09:14:02.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.280+0000 7f69eb749640 1 -- 172.21.15.18:0/1823638130 wait complete. 2024-09-19T09:14:02.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.281+0000 7f69eb749640 1 Processor -- start 2024-09-19T09:14:02.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.281+0000 7f69eb749640 1 -- start start 2024-09-19T09:14:02.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.282+0000 7f69eb749640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69e406d730 0x7f69e4159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:02.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.282+0000 7f69eb749640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69e40b7270 0x7f69e415d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:02.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.282+0000 7f69eb749640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69e40cc7f0 0x7f69e415dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:02.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.282+0000 7f69eb749640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f69e415efe0 con 0x7f69e40cc7f0 2024-09-19T09:14:02.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.282+0000 7f69eb749640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f69e40b4310 con 0x7f69e40b7270 2024-09-19T09:14:02.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.282+0000 7f69eb749640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f69e40cd1c0 con 0x7f69e406d730 2024-09-19T09:14:02.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.282+0000 7f69e9ce6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69e40cc7f0 0x7f69e415dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:02.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.282+0000 7f69e9ce6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69e40cc7f0 0x7f69e415dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33718/0 (socket says 172.21.15.18:33718) 2024-09-19T09:14:02.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.282+0000 7f69e9ce6640 1 -- 172.21.15.18:0/3165690154 learned_addr learned my addr 172.21.15.18:0/3165690154 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:02.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.282+0000 7f69e94e5640 1 --2- 172.21.15.18:0/3165690154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69e406d730 0x7f69e4159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:02.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.283+0000 7f69e8ce4640 1 --2- 172.21.15.18:0/3165690154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69e40b7270 0x7f69e415d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:02.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.283+0000 7f69e9ce6640 1 -- 172.21.15.18:0/3165690154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69e406d730 msgr2=0x7f69e4159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:02.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.283+0000 7f69e9ce6640 1 --2- 172.21.15.18:0/3165690154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69e406d730 0x7f69e4159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:02.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.283+0000 7f69e9ce6640 1 -- 172.21.15.18:0/3165690154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69e40b7270 msgr2=0x7f69e415d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:02.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.283+0000 7f69e9ce6640 1 --2- 172.21.15.18:0/3165690154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69e40b7270 0x7f69e415d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:02.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.283+0000 7f69e9ce6640 1 -- 172.21.15.18:0/3165690154 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e415e250 con 0x7f69e40cc7f0 2024-09-19T09:14:02.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.283+0000 7f69e9ce6640 1 --2- 172.21.15.18:0/3165690154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69e40cc7f0 0x7f69e415dc20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f69dc00efc0 tx=0x7f69dc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:02.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.283+0000 7f69d9ffb640 1 -- 172.21.15.18:0/3165690154 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc018030 con 0x7f69e40cc7f0 2024-09-19T09:14:02.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.283+0000 7f69d9ffb640 1 -- 172.21.15.18:0/3165690154 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69dc00cdf0 con 0x7f69e40cc7f0 2024-09-19T09:14:02.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.283+0000 7f69eb749640 1 -- 172.21.15.18:0/3165690154 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69e41f8a90 con 0x7f69e40cc7f0 2024-09-19T09:14:02.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.283+0000 7f69d9ffb640 1 -- 172.21.15.18:0/3165690154 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc003bb0 con 0x7f69e40cc7f0 2024-09-19T09:14:02.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.283+0000 7f69eb749640 1 -- 172.21.15.18:0/3165690154 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69e41f9050 con 0x7f69e40cc7f0 2024-09-19T09:14:02.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.284+0000 7f69eb749640 1 -- 172.21.15.18:0/3165690154 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69e40ccc80 con 0x7f69e40cc7f0 2024-09-19T09:14:02.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.285+0000 7f69d9ffb640 1 -- 172.21.15.18:0/3165690154 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f69dc01b070 con 0x7f69e40cc7f0 2024-09-19T09:14:02.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.285+0000 7f69d9ffb640 1 --2- 172.21.15.18:0/3165690154 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f69c806c2b0 0x7f69c806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:02.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.285+0000 7f69d9ffb640 1 -- 172.21.15.18:0/3165690154 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f69dc08bb20 con 0x7f69e40cc7f0 2024-09-19T09:14:02.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.286+0000 7f69e94e5640 1 --2- 172.21.15.18:0/3165690154 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f69c806c2b0 0x7f69c806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:02.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.286+0000 7f69e94e5640 1 --2- 172.21.15.18:0/3165690154 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f69c806c2b0 0x7f69c806e770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f69e0000f60 tx=0x7f69e0007b10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:02.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.290+0000 7f69d9ffb640 1 -- 172.21.15.18:0/3165690154 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f69dc010040 con 0x7f69e40cc7f0 2024-09-19T09:14:02.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.533+0000 7f69eb749640 1 -- 172.21.15.18:0/3165690154 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f69e4073970 con 0x7f69e40cc7f0 2024-09-19T09:14:02.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.535+0000 7f69d9ffb640 1 -- 172.21.15.18:0/3165690154 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f69dc05a5e0 con 0x7f69e40cc7f0 2024-09-19T09:14:02.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.537+0000 7f69eb749640 1 -- 172.21.15.18:0/3165690154 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f69c806c2b0 msgr2=0x7f69c806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:02.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.537+0000 7f69eb749640 1 --2- 172.21.15.18:0/3165690154 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f69c806c2b0 0x7f69c806e770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f69e0000f60 tx=0x7f69e0007b10 comp rx=0 tx=0).stop 2024-09-19T09:14:02.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.537+0000 7f69eb749640 1 -- 172.21.15.18:0/3165690154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69e40cc7f0 msgr2=0x7f69e415dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:02.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.537+0000 7f69eb749640 1 --2- 172.21.15.18:0/3165690154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69e40cc7f0 0x7f69e415dc20 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f69dc00efc0 tx=0x7f69dc00c490 comp rx=0 tx=0).stop 2024-09-19T09:14:02.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.537+0000 7f69eb749640 1 -- 172.21.15.18:0/3165690154 shutdown_connections 2024-09-19T09:14:02.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.537+0000 7f69eb749640 1 --2- 172.21.15.18:0/3165690154 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f69c806c2b0 0x7f69c806e770 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:02.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.537+0000 7f69eb749640 1 --2- 172.21.15.18:0/3165690154 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69e40cc7f0 0x7f69e415dc20 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:02.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.537+0000 7f69eb749640 1 --2- 172.21.15.18:0/3165690154 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69e40b7270 0x7f69e415d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:02.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.537+0000 7f69eb749640 1 --2- 172.21.15.18:0/3165690154 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69e406d730 0x7f69e4159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:02.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.537+0000 7f69eb749640 1 -- 172.21.15.18:0/3165690154 >> 172.21.15.18:0/3165690154 conn(0x7f69e40b7e10 msgr2=0x7f69e40b6250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:02.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.537+0000 7f69eb749640 1 -- 172.21.15.18:0/3165690154 shutdown_connections 2024-09-19T09:14:02.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.537+0000 7f69eb749640 1 -- 172.21.15.18:0/3165690154 wait complete. 2024-09-19T09:14:02.549 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-19T09:14:02.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.650+0000 7f33af87b640 1 Processor -- start 2024-09-19T09:14:02.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.651+0000 7f33af87b640 1 -- start start 2024-09-19T09:14:02.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.651+0000 7f33af87b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33a815eda0 0x7f33a80d5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:02.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.651+0000 7f33af87b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33a80d3cc0 con 0x7f33a80d1630 2024-09-19T09:14:02.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.651+0000 7f33af87b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33a80d0bf0 con 0x7f33a80d0480 2024-09-19T09:14:02.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.651+0000 7f33af87b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f33a80d2880 con 0x7f33a815eda0 2024-09-19T09:14:02.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.652+0000 7f33ade18640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f33a80d1630 0x7f33a80b7b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:47358/0 (socket says 172.21.15.18:47358) 2024-09-19T09:14:02.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.652+0000 7f33ade18640 1 -- 172.21.15.18:0/3679652323 learned_addr learned my addr 172.21.15.18:0/3679652323 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:02.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.652+0000 7f33ad617640 1 --2- 172.21.15.18:0/3679652323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33a815eda0 0x7f33a80d5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:02.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.652+0000 7f339ffff640 1 -- 172.21.15.18:0/3679652323 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4246670404 0 0) 0x7f33a80d3cc0 con 0x7f33a80d1630 2024-09-19T09:14:02.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.652+0000 7f339ffff640 1 -- 172.21.15.18:0/3679652323 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3394003520 con 0x7f33a80d1630 2024-09-19T09:14:02.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.652+0000 7f339ffff640 1 -- 172.21.15.18:0/3679652323 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3344928758 0 0) 0x7f33a80d0bf0 con 0x7f33a80d0480 2024-09-19T09:14:02.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.652+0000 7f339ffff640 1 -- 172.21.15.18:0/3679652323 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33a80d3cc0 con 0x7f33a80d0480 2024-09-19T09:14:02.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.652+0000 7f339ffff640 1 -- 172.21.15.18:0/3679652323 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 49556040 0 0) 0x7f3394003520 con 0x7f33a80d1630 2024-09-19T09:14:02.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.652+0000 7f33ad617640 1 -- 172.21.15.18:0/3679652323 >> v1:172.21.15.162:6789/0 conn(0x7f33a80d0480 legacy=0x7f33a80d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:02.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.652+0000 7f33ad617640 1 -- 172.21.15.18:0/3679652323 >> v1:172.21.15.18:6789/0 conn(0x7f33a80d1630 legacy=0x7f33a80b7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:02.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.652+0000 7f33ad617640 1 -- 172.21.15.18:0/3679652323 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a80d2ad0 con 0x7f33a815eda0 2024-09-19T09:14:02.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.653+0000 7f33ad617640 1 --2- 172.21.15.18:0/3679652323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33a815eda0 0x7f33a80d5790 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f33a40097d0 tx=0x7f33a402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a40207ea72c275b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:02.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.653+0000 7f339ffff640 1 -- 172.21.15.18:0/3679652323 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a4037070 con 0x7f33a815eda0 2024-09-19T09:14:02.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.653+0000 7f339ffff640 1 -- 172.21.15.18:0/3679652323 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33a402ac30 con 0x7f33a815eda0 2024-09-19T09:14:02.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.653+0000 7f339ffff640 1 -- 172.21.15.18:0/3679652323 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a00019f0 con 0x7f33a815eda0 2024-09-19T09:14:02.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.654+0000 7f33af87b640 1 -- 172.21.15.18:0/3679652323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33a815eda0 msgr2=0x7f33a80d5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:02.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.654+0000 7f33af87b640 1 --2- 172.21.15.18:0/3679652323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33a815eda0 0x7f33a80d5790 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f33a40097d0 tx=0x7f33a402a1a0 comp rx=0 tx=0).stop 2024-09-19T09:14:02.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.654+0000 7f33af87b640 1 -- 172.21.15.18:0/3679652323 shutdown_connections 2024-09-19T09:14:02.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.654+0000 7f33af87b640 1 --2- 172.21.15.18:0/3679652323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33a815eda0 0x7f33a80d5790 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:02.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.654+0000 7f33af87b640 1 -- 172.21.15.18:0/3679652323 >> 172.21.15.18:0/3679652323 conn(0x7f33a809df40 msgr2=0x7f33a80d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:02.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.654+0000 7f33af87b640 1 -- 172.21.15.18:0/3679652323 shutdown_connections 2024-09-19T09:14:02.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.654+0000 7f33af87b640 1 -- 172.21.15.18:0/3679652323 wait complete. 2024-09-19T09:14:02.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.655+0000 7f33af87b640 1 Processor -- start 2024-09-19T09:14:02.657 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.655+0000 7f33af87b640 1 -- start start 2024-09-19T09:14:02.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.656+0000 7f33af87b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33a80d0480 0x7f33a8157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:02.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.656+0000 7f33af87b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33a80d1630 0x7f33a80cdea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:02.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.656+0000 7f33af87b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33a815eda0 0x7f33a80cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:02.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.656+0000 7f33af87b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f33a80d08c0 con 0x7f33a80d0480 2024-09-19T09:14:02.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.656+0000 7f33af87b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f33a80d3120 con 0x7f33a80d1630 2024-09-19T09:14:02.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.656+0000 7f33af87b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f33a815f180 con 0x7f33a815eda0 2024-09-19T09:14:02.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.656+0000 7f33ad617640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33a80d0480 0x7f33a8157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:02.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.656+0000 7f33ad617640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33a80d0480 0x7f33a8157ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33732/0 (socket says 172.21.15.18:33732) 2024-09-19T09:14:02.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.656+0000 7f33ad617640 1 -- 172.21.15.18:0/1663137895 learned_addr learned my addr 172.21.15.18:0/1663137895 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:02.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.656+0000 7f33ade18640 1 --2- 172.21.15.18:0/1663137895 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33a815eda0 0x7f33a80cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:02.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.656+0000 7f33ace16640 1 --2- 172.21.15.18:0/1663137895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33a80d1630 0x7f33a80cdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:02.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.656+0000 7f33ad617640 1 -- 172.21.15.18:0/1663137895 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33a815eda0 msgr2=0x7f33a80cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:02.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.656+0000 7f33ad617640 1 --2- 172.21.15.18:0/1663137895 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33a815eda0 0x7f33a80cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:02.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.656+0000 7f33ad617640 1 -- 172.21.15.18:0/1663137895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33a80d1630 msgr2=0x7f33a80cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:02.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.656+0000 7f33ad617640 1 --2- 172.21.15.18:0/1663137895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33a80d1630 0x7f33a80cdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:02.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.656+0000 7f33ad617640 1 -- 172.21.15.18:0/1663137895 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33a8158400 con 0x7f33a80d0480 2024-09-19T09:14:02.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.656+0000 7f33ad617640 1 --2- 172.21.15.18:0/1663137895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33a80d0480 0x7f33a8157ec0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f33a40098f0 tx=0x7f33a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:02.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.656+0000 7f339dffb640 1 -- 172.21.15.18:0/1663137895 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a4042020 con 0x7f33a80d0480 2024-09-19T09:14:02.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.657+0000 7f339dffb640 1 -- 172.21.15.18:0/1663137895 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33a403d670 con 0x7f33a80d0480 2024-09-19T09:14:02.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.657+0000 7f339dffb640 1 -- 172.21.15.18:0/1663137895 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a4037040 con 0x7f33a80d0480 2024-09-19T09:14:02.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.657+0000 7f33af87b640 1 -- 172.21.15.18:0/1663137895 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33a8158af0 con 0x7f33a80d0480 2024-09-19T09:14:02.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.657+0000 7f33af87b640 1 -- 172.21.15.18:0/1663137895 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33a81590b0 con 0x7f33a80d0480 2024-09-19T09:14:02.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.658+0000 7f33af87b640 1 -- 172.21.15.18:0/1663137895 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33a80d5790 con 0x7f33a80d0480 2024-09-19T09:14:02.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.658+0000 7f339dffb640 1 -- 172.21.15.18:0/1663137895 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f33a4045020 con 0x7f33a80d0480 2024-09-19T09:14:02.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.659+0000 7f339dffb640 1 --2- 172.21.15.18:0/1663137895 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f338c06c2b0 0x7f338c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:02.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.659+0000 7f339dffb640 1 -- 172.21.15.18:0/1663137895 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f33a40ab4f0 con 0x7f33a80d0480 2024-09-19T09:14:02.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.659+0000 7f33ace16640 1 --2- 172.21.15.18:0/1663137895 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f338c06c2b0 0x7f338c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:02.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.660+0000 7f33ace16640 1 --2- 172.21.15.18:0/1663137895 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f338c06c2b0 0x7f338c06e770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f33a8163830 tx=0x7f3398009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:02.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.663+0000 7f339dffb640 1 -- 172.21.15.18:0/1663137895 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f33a404c070 con 0x7f33a80d0480 2024-09-19T09:14:02.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.909+0000 7f33af87b640 1 -- 172.21.15.18:0/1663137895 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f33a8163880 con 0x7f33a80d0480 2024-09-19T09:14:02.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.911+0000 7f339dffb640 1 -- 172.21.15.18:0/1663137895 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f33a4079950 con 0x7f33a80d0480 2024-09-19T09:14:02.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.913+0000 7f33af87b640 1 -- 172.21.15.18:0/1663137895 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f338c06c2b0 msgr2=0x7f338c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:02.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.913+0000 7f33af87b640 1 --2- 172.21.15.18:0/1663137895 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f338c06c2b0 0x7f338c06e770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f33a8163830 tx=0x7f3398009040 comp rx=0 tx=0).stop 2024-09-19T09:14:02.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.913+0000 7f33af87b640 1 -- 172.21.15.18:0/1663137895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33a80d0480 msgr2=0x7f33a8157ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:02.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.913+0000 7f33af87b640 1 --2- 172.21.15.18:0/1663137895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33a80d0480 0x7f33a8157ec0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f33a40098f0 tx=0x7f33a40046c0 comp rx=0 tx=0).stop 2024-09-19T09:14:02.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.913+0000 7f33af87b640 1 -- 172.21.15.18:0/1663137895 shutdown_connections 2024-09-19T09:14:02.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.913+0000 7f33af87b640 1 --2- 172.21.15.18:0/1663137895 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f338c06c2b0 0x7f338c06e770 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:02.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.913+0000 7f33af87b640 1 --2- 172.21.15.18:0/1663137895 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33a815eda0 0x7f33a80cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:02.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.913+0000 7f33af87b640 1 --2- 172.21.15.18:0/1663137895 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33a80d1630 0x7f33a80cdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:02.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.913+0000 7f33af87b640 1 --2- 172.21.15.18:0/1663137895 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33a80d0480 0x7f33a8157ec0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:02.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.913+0000 7f33af87b640 1 -- 172.21.15.18:0/1663137895 >> 172.21.15.18:0/1663137895 conn(0x7f33a809df40 msgr2=0x7f33a80b8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:02.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.913+0000 7f33af87b640 1 -- 172.21.15.18:0/1663137895 shutdown_connections 2024-09-19T09:14:02.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:02.913+0000 7f33af87b640 1 -- 172.21.15.18:0/1663137895 wait complete. 2024-09-19T09:14:02.925 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-19T09:14:03.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.027+0000 7f45f948c640 1 Processor -- start 2024-09-19T09:14:03.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.027+0000 7f45f948c640 1 -- start start 2024-09-19T09:14:03.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.028+0000 7f45f948c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f45f415cc70 0x7f45f40b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:03.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.028+0000 7f45f948c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f45f406c3b0 0x7f45f406c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:03.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.028+0000 7f45f948c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45f415e060 con 0x7f45f406cd60 2024-09-19T09:14:03.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.028+0000 7f45f948c640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f45f406d1b0 con 0x7f45f415cc70 2024-09-19T09:14:03.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.028+0000 7f45f948c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f45f4067c80 con 0x7f45f406c3b0 2024-09-19T09:14:03.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.028+0000 7f45f2ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f45f415cc70 0x7f45f40b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:03.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.028+0000 7f45f2ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f45f415cc70 0x7f45f40b3790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33740/0 (socket says 172.21.15.18:33740) 2024-09-19T09:14:03.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.028+0000 7f45f2ffd640 1 -- 172.21.15.18:0/3737935115 learned_addr learned my addr 172.21.15.18:0/3737935115 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:03.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.028+0000 7f45f37fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f45f406cd60 0x7f45f40d0fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:47362/0 (socket says 172.21.15.18:47362) 2024-09-19T09:14:03.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.029+0000 7f45f2ffd640 1 -- 172.21.15.18:0/3737935115 >> v2:172.21.15.162:3300/0 conn(0x7f45f406c3b0 msgr2=0x7f45f406c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:03.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.029+0000 7f45f27fc640 1 --2- 172.21.15.18:0/3737935115 >> v2:172.21.15.162:3300/0 conn(0x7f45f406c3b0 0x7f45f406c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:03.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.029+0000 7f45f1ffb640 1 -- 172.21.15.18:0/3737935115 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1256263599 0 0) 0x7f45e4001490 con 0x7f45f406cd60 2024-09-19T09:14:03.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.029+0000 7f45f2ffd640 1 --2- 172.21.15.18:0/3737935115 >> v2:172.21.15.162:3300/0 conn(0x7f45f406c3b0 0x7f45f406c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:03.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.029+0000 7f45f2ffd640 1 -- 172.21.15.18:0/3737935115 >> v1:172.21.15.18:6789/0 conn(0x7f45f406cd60 legacy=0x7f45f40d0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:03.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.029+0000 7f45f2ffd640 1 -- 172.21.15.18:0/3737935115 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f4067950 con 0x7f45f415cc70 2024-09-19T09:14:03.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.029+0000 7f45f2ffd640 1 --2- 172.21.15.18:0/3737935115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f415cc70 0x7f45f40b3790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f45f406d720 tx=0x7f45ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d64d71d193cb405 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:03.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.030+0000 7f45f1ffb640 1 -- 172.21.15.18:0/3737935115 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec037070 con 0x7f45f415cc70 2024-09-19T09:14:03.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.030+0000 7f45f1ffb640 1 -- 172.21.15.18:0/3737935115 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45ec032440 con 0x7f45f415cc70 2024-09-19T09:14:03.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.030+0000 7f45f1ffb640 1 -- 172.21.15.18:0/3737935115 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec032810 con 0x7f45f415cc70 2024-09-19T09:14:03.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.030+0000 7f45f948c640 1 -- 172.21.15.18:0/3737935115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f415cc70 msgr2=0x7f45f40b3790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:03.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.030+0000 7f45f948c640 1 --2- 172.21.15.18:0/3737935115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f415cc70 0x7f45f40b3790 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f45f406d720 tx=0x7f45ec02a270 comp rx=0 tx=0).stop 2024-09-19T09:14:03.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.030+0000 7f45f948c640 1 -- 172.21.15.18:0/3737935115 shutdown_connections 2024-09-19T09:14:03.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.030+0000 7f45f948c640 1 --2- 172.21.15.18:0/3737935115 >> v2:172.21.15.162:3300/0 conn(0x7f45f406c3b0 0x7f45f406c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:03.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.030+0000 7f45f948c640 1 --2- 172.21.15.18:0/3737935115 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f415cc70 0x7f45f40b3790 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:03.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.030+0000 7f45f948c640 1 -- 172.21.15.18:0/3737935115 >> 172.21.15.18:0/3737935115 conn(0x7f45f4072340 msgr2=0x7f45f40b5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:03.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.030+0000 7f45f948c640 1 -- 172.21.15.18:0/3737935115 shutdown_connections 2024-09-19T09:14:03.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.030+0000 7f45f948c640 1 -- 172.21.15.18:0/3737935115 wait complete. 2024-09-19T09:14:03.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.032+0000 7f45f948c640 1 Processor -- start 2024-09-19T09:14:03.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.032+0000 7f45f948c640 1 -- start start 2024-09-19T09:14:03.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.032+0000 7f45f948c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f406c3b0 0x7f45f41e8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:03.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.032+0000 7f45f948c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45f406cd60 0x7f45f4157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:03.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.032+0000 7f45f948c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45f415cc70 0x7f45f4157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:03.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.032+0000 7f45f948c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f45f40b6a40 con 0x7f45f406c3b0 2024-09-19T09:14:03.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.032+0000 7f45f948c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f45f406bf90 con 0x7f45f406cd60 2024-09-19T09:14:03.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.032+0000 7f45f948c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f45f40b6660 con 0x7f45f415cc70 2024-09-19T09:14:03.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.032+0000 7f45f2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f406c3b0 0x7f45f41e8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:03.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.033+0000 7f45f2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f406c3b0 0x7f45f41e8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33750/0 (socket says 172.21.15.18:33750) 2024-09-19T09:14:03.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.033+0000 7f45f2ffd640 1 -- 172.21.15.18:0/2394698535 learned_addr learned my addr 172.21.15.18:0/2394698535 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:03.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.033+0000 7f45f27fc640 1 --2- 172.21.15.18:0/2394698535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45f406cd60 0x7f45f4157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:03.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.033+0000 7f45f37fe640 1 --2- 172.21.15.18:0/2394698535 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45f415cc70 0x7f45f4157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:03.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.033+0000 7f45f2ffd640 1 -- 172.21.15.18:0/2394698535 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45f415cc70 msgr2=0x7f45f4157570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:03.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.033+0000 7f45f2ffd640 1 --2- 172.21.15.18:0/2394698535 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45f415cc70 0x7f45f4157570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:03.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.033+0000 7f45f2ffd640 1 -- 172.21.15.18:0/2394698535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45f406cd60 msgr2=0x7f45f4157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:03.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.033+0000 7f45f2ffd640 1 --2- 172.21.15.18:0/2394698535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45f406cd60 0x7f45f4157030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:03.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.033+0000 7f45f2ffd640 1 -- 172.21.15.18:0/2394698535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f40cdc70 con 0x7f45f406c3b0 2024-09-19T09:14:03.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.033+0000 7f45f37fe640 1 --2- 172.21.15.18:0/2394698535 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45f415cc70 0x7f45f4157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:14:03.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.033+0000 7f45f2ffd640 1 --2- 172.21.15.18:0/2394698535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f406c3b0 0x7f45f41e8850 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f45ec000c00 tx=0x7f45ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:03.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.033+0000 7f45eb7fe640 1 -- 172.21.15.18:0/2394698535 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec037040 con 0x7f45f406c3b0 2024-09-19T09:14:03.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.033+0000 7f45eb7fe640 1 -- 172.21.15.18:0/2394698535 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45ec004230 con 0x7f45f406c3b0 2024-09-19T09:14:03.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.033+0000 7f45eb7fe640 1 -- 172.21.15.18:0/2394698535 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ec03c670 con 0x7f45f406c3b0 2024-09-19T09:14:03.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.033+0000 7f45f948c640 1 -- 172.21.15.18:0/2394698535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45f40cdf50 con 0x7f45f406c3b0 2024-09-19T09:14:03.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.033+0000 7f45f948c640 1 -- 172.21.15.18:0/2394698535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45f40ce510 con 0x7f45f406c3b0 2024-09-19T09:14:03.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.034+0000 7f45f948c640 1 -- 172.21.15.18:0/2394698535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45f4160670 con 0x7f45f406c3b0 2024-09-19T09:14:03.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.035+0000 7f45eb7fe640 1 -- 172.21.15.18:0/2394698535 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f45ec03a070 con 0x7f45f406c3b0 2024-09-19T09:14:03.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.035+0000 7f45eb7fe640 1 --2- 172.21.15.18:0/2394698535 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f45d406c2b0 0x7f45d406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:03.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.035+0000 7f45eb7fe640 1 -- 172.21.15.18:0/2394698535 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f45ec0ab910 con 0x7f45f406c3b0 2024-09-19T09:14:03.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.035+0000 7f45f27fc640 1 --2- 172.21.15.18:0/2394698535 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f45d406c2b0 0x7f45d406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:03.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.036+0000 7f45f27fc640 1 --2- 172.21.15.18:0/2394698535 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f45d406c2b0 0x7f45d406e770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f45dc006fd0 tx=0x7f45dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:03.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.039+0000 7f45eb7fe640 1 -- 172.21.15.18:0/2394698535 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f45ec041020 con 0x7f45f406c3b0 2024-09-19T09:14:03.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.286+0000 7f45f948c640 1 -- 172.21.15.18:0/2394698535 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f45f40af8e0 con 0x7f45f406c3b0 2024-09-19T09:14:03.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.288+0000 7f45eb7fe640 1 -- 172.21.15.18:0/2394698535 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f45ec07a3d0 con 0x7f45f406c3b0 2024-09-19T09:14:03.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.290+0000 7f45f948c640 1 -- 172.21.15.18:0/2394698535 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f45d406c2b0 msgr2=0x7f45d406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:03.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.290+0000 7f45f948c640 1 --2- 172.21.15.18:0/2394698535 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f45d406c2b0 0x7f45d406e770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f45dc006fd0 tx=0x7f45dc008040 comp rx=0 tx=0).stop 2024-09-19T09:14:03.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.290+0000 7f45f948c640 1 -- 172.21.15.18:0/2394698535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f406c3b0 msgr2=0x7f45f41e8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:03.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.290+0000 7f45f948c640 1 --2- 172.21.15.18:0/2394698535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f406c3b0 0x7f45f41e8850 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f45ec000c00 tx=0x7f45ec0046c0 comp rx=0 tx=0).stop 2024-09-19T09:14:03.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.291+0000 7f45f948c640 1 -- 172.21.15.18:0/2394698535 shutdown_connections 2024-09-19T09:14:03.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.291+0000 7f45f948c640 1 --2- 172.21.15.18:0/2394698535 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f45d406c2b0 0x7f45d406e770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:03.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.291+0000 7f45f948c640 1 --2- 172.21.15.18:0/2394698535 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f45f415cc70 0x7f45f4157570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:03.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.291+0000 7f45f948c640 1 --2- 172.21.15.18:0/2394698535 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f45f406cd60 0x7f45f4157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:03.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.291+0000 7f45f948c640 1 --2- 172.21.15.18:0/2394698535 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45f406c3b0 0x7f45f41e8850 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:03.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.291+0000 7f45f948c640 1 -- 172.21.15.18:0/2394698535 >> 172.21.15.18:0/2394698535 conn(0x7f45f4072340 msgr2=0x7f45f41582c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:03.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.291+0000 7f45f948c640 1 -- 172.21.15.18:0/2394698535 shutdown_connections 2024-09-19T09:14:03.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.291+0000 7f45f948c640 1 -- 172.21.15.18:0/2394698535 wait complete. 2024-09-19T09:14:03.303 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-19T09:14:03.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.405+0000 7fa3c0f66640 1 Processor -- start 2024-09-19T09:14:03.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.406+0000 7fa3c0f66640 1 -- start start 2024-09-19T09:14:03.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.406+0000 7fa3c0f66640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3bc0b7270 0x7fa3bc0b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:03.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.407+0000 7fa3c0f66640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3bc0b7890 con 0x7fa3bc06d730 2024-09-19T09:14:03.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.407+0000 7fa3c0f66640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3bc0b7b70 con 0x7fa3bc0cc7f0 2024-09-19T09:14:03.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.407+0000 7fa3c0f66640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa3bc0cbd10 con 0x7fa3bc0b7270 2024-09-19T09:14:03.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.407+0000 7fa3ba59c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa3bc06d730 0x7fa3bc06db10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:47378/0 (socket says 172.21.15.18:47378) 2024-09-19T09:14:03.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.407+0000 7fa3ba59c640 1 -- 172.21.15.18:0/182422791 learned_addr learned my addr 172.21.15.18:0/182422791 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:03.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.407+0000 7fa3b9d9b640 1 --2- 172.21.15.18:0/182422791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3bc0b7270 0x7fa3bc0b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:03.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.407+0000 7fa3b959a640 1 -- 172.21.15.18:0/182422791 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1888255385 0 0) 0x7fa3bc0b7890 con 0x7fa3bc06d730 2024-09-19T09:14:03.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.407+0000 7fa3b959a640 1 -- 172.21.15.18:0/182422791 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3a4003520 con 0x7fa3bc06d730 2024-09-19T09:14:03.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.407+0000 7fa3b959a640 1 -- 172.21.15.18:0/182422791 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 483411568 0 0) 0x7fa3a4003520 con 0x7fa3bc06d730 2024-09-19T09:14:03.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.407+0000 7fa3b959a640 1 -- 172.21.15.18:0/182422791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3bc0b7270 msgr2=0x7fa3bc0b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:03.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.407+0000 7fa3b959a640 1 --2- 172.21.15.18:0/182422791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3bc0b7270 0x7fa3bc0b6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:03.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.407+0000 7fa3b959a640 1 -- 172.21.15.18:0/182422791 >> v1:172.21.15.162:6789/0 conn(0x7fa3bc0cc7f0 legacy=0x7fa3bc0ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:03.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.407+0000 7fa3b959a640 1 -- 172.21.15.18:0/182422791 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3bc0cbff0 con 0x7fa3bc06d730 2024-09-19T09:14:03.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.407+0000 7fa3b959a640 1 -- 172.21.15.18:0/182422791 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fa3ac001670 con 0x7fa3bc06d730 2024-09-19T09:14:03.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.407+0000 7fa3b959a640 1 -- 172.21.15.18:0/182422791 >> v1:172.21.15.18:6789/0 conn(0x7fa3bc06d730 legacy=0x7fa3bc06db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:03.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.407+0000 7fa3b959a640 1 --2- 172.21.15.18:0/182422791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3a40039e0 0x7fa3a4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:03.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.407+0000 7fa3b959a640 1 --2- 172.21.15.18:0/182422791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3a4004390 0x7fa3a4004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:03.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.407+0000 7fa3b959a640 1 --2- 172.21.15.18:0/182422791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3bc0b7270 0x7fa3a40050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:03.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.407+0000 7fa3b959a640 1 -- 172.21.15.18:0/182422791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa3bc0cbd10 con 0x7fa3a4004390 2024-09-19T09:14:03.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.407+0000 7fa3b959a640 1 -- 172.21.15.18:0/182422791 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a400b9f0 con 0x7fa3a40039e0 2024-09-19T09:14:03.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.407+0000 7fa3b959a640 1 -- 172.21.15.18:0/182422791 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa3a400bbf0 con 0x7fa3bc0b7270 2024-09-19T09:14:03.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.408+0000 7fa3b9d9b640 1 --2- 172.21.15.18:0/182422791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3a4004390 0x7fa3a4004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:03.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.408+0000 7fa3ba59c640 1 --2- 172.21.15.18:0/182422791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3a40039e0 0x7fa3a4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:03.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.408+0000 7fa3bad9d640 1 --2- 172.21.15.18:0/182422791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3bc0b7270 0x7fa3a40050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:03.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.408+0000 7fa3b9d9b640 1 -- 172.21.15.18:0/182422791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3bc0b7270 msgr2=0x7fa3a40050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:03.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.408+0000 7fa3b9d9b640 1 --2- 172.21.15.18:0/182422791 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3bc0b7270 0x7fa3a40050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:03.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.408+0000 7fa3b9d9b640 1 -- 172.21.15.18:0/182422791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3a40039e0 msgr2=0x7fa3a4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:03.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.408+0000 7fa3b9d9b640 1 --2- 172.21.15.18:0/182422791 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3a40039e0 0x7fa3a4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:03.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.408+0000 7fa3b9d9b640 1 -- 172.21.15.18:0/182422791 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a4003520 con 0x7fa3a4004390 2024-09-19T09:14:03.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.409+0000 7fa3b9d9b640 1 --2- 172.21.15.18:0/182422791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3a4004390 0x7fa3a4004860 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0009ac0 tx=0x7fa3a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2035f365eb25f02d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:03.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.409+0000 7fa3b959a640 1 -- 172.21.15.18:0/182422791 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b0036070 con 0x7fa3a4004390 2024-09-19T09:14:03.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.409+0000 7fa3b959a640 1 -- 172.21.15.18:0/182422791 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3b0031400 con 0x7fa3a4004390 2024-09-19T09:14:03.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.409+0000 7fa3b959a640 1 -- 172.21.15.18:0/182422791 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3b0009690 con 0x7fa3a4004390 2024-09-19T09:14:03.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.409+0000 7fa3c0f66640 1 -- 172.21.15.18:0/182422791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3a4004390 msgr2=0x7fa3a4004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:03.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.409+0000 7fa3c0f66640 1 --2- 172.21.15.18:0/182422791 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3a4004390 0x7fa3a4004860 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0009ac0 tx=0x7fa3a4005830 comp rx=0 tx=0).stop 2024-09-19T09:14:03.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.409+0000 7fa3bad9d640 1 -- 172.21.15.18:0/182422791 reap_dead start 2024-09-19T09:14:03.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.409+0000 7fa3c0f66640 1 -- 172.21.15.18:0/182422791 shutdown_connections 2024-09-19T09:14:03.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.409+0000 7fa3c0f66640 1 -- 172.21.15.18:0/182422791 >> 172.21.15.18:0/182422791 conn(0x7fa3bc0b7e10 msgr2=0x7fa3bc0b8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:03.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.409+0000 7fa3c0f66640 1 -- 172.21.15.18:0/182422791 shutdown_connections 2024-09-19T09:14:03.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.409+0000 7fa3c0f66640 1 -- 172.21.15.18:0/182422791 wait complete. 2024-09-19T09:14:03.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.411+0000 7fa3c0f66640 1 Processor -- start 2024-09-19T09:14:03.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.411+0000 7fa3c0f66640 1 -- start start 2024-09-19T09:14:03.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.411+0000 7fa3c0f66640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3a4004390 0x7fa3bc1510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:03.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.411+0000 7fa3c0f66640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3bc150470 0x7fa3bc153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:03.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.412+0000 7fa3c0f66640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3bc0cd9d0 0x7fa3bc0cde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:03.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.412+0000 7fa3c0f66640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa3bc15efe0 con 0x7fa3a4004390 2024-09-19T09:14:03.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.412+0000 7fa3c0f66640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa3bc0b4310 con 0x7fa3bc150470 2024-09-19T09:14:03.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.412+0000 7fa3c0f66640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa3bc0b6290 con 0x7fa3bc0cd9d0 2024-09-19T09:14:03.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.412+0000 7fa3ba59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3a4004390 0x7fa3bc1510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:03.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.412+0000 7fa3ba59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3a4004390 0x7fa3bc1510d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33774/0 (socket says 172.21.15.18:33774) 2024-09-19T09:14:03.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.412+0000 7fa3ba59c640 1 -- 172.21.15.18:0/506033651 learned_addr learned my addr 172.21.15.18:0/506033651 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:03.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.412+0000 7fa3b9d9b640 1 --2- 172.21.15.18:0/506033651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3bc150470 0x7fa3bc153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:03.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.412+0000 7fa3bad9d640 1 --2- 172.21.15.18:0/506033651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3bc0cd9d0 0x7fa3bc0cde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:03.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.412+0000 7fa3ba59c640 1 -- 172.21.15.18:0/506033651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3bc0cd9d0 msgr2=0x7fa3bc0cde50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:03.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.412+0000 7fa3ba59c640 1 --2- 172.21.15.18:0/506033651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3bc0cd9d0 0x7fa3bc0cde50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:03.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.412+0000 7fa3ba59c640 1 -- 172.21.15.18:0/506033651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3bc150470 msgr2=0x7fa3bc153e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:03.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.412+0000 7fa3ba59c640 1 --2- 172.21.15.18:0/506033651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3bc150470 0x7fa3bc153e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:03.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.412+0000 7fa3ba59c640 1 -- 172.21.15.18:0/506033651 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3bc1543a0 con 0x7fa3a4004390 2024-09-19T09:14:03.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.412+0000 7fa3ba59c640 1 --2- 172.21.15.18:0/506033651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3a4004390 0x7fa3bc1510d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac000f60 tx=0x7fa3ac007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:03.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.412+0000 7fa3aaffd640 1 -- 172.21.15.18:0/506033651 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac00f9c0 con 0x7fa3a4004390 2024-09-19T09:14:03.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.412+0000 7fa3aaffd640 1 -- 172.21.15.18:0/506033651 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3ac018070 con 0x7fa3a4004390 2024-09-19T09:14:03.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.412+0000 7fa3aaffd640 1 -- 172.21.15.18:0/506033651 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac00fde0 con 0x7fa3a4004390 2024-09-19T09:14:03.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.412+0000 7fa3c0f66640 1 -- 172.21.15.18:0/506033651 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3bc151b70 con 0x7fa3a4004390 2024-09-19T09:14:03.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.412+0000 7fa3c0f66640 1 -- 172.21.15.18:0/506033651 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3bc157380 con 0x7fa3a4004390 2024-09-19T09:14:03.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.413+0000 7fa3c0f66640 1 -- 172.21.15.18:0/506033651 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3bc0ce390 con 0x7fa3a4004390 2024-09-19T09:14:03.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.414+0000 7fa3aaffd640 1 -- 172.21.15.18:0/506033651 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa3ac01d460 con 0x7fa3a4004390 2024-09-19T09:14:03.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.414+0000 7fa3aaffd640 1 --2- 172.21.15.18:0/506033651 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa39c06c2b0 0x7fa39c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:03.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.414+0000 7fa3aaffd640 1 -- 172.21.15.18:0/506033651 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fa3ac08b110 con 0x7fa3a4004390 2024-09-19T09:14:03.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.415+0000 7fa3b9d9b640 1 --2- 172.21.15.18:0/506033651 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa39c06c2b0 0x7fa39c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:03.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.415+0000 7fa3b9d9b640 1 --2- 172.21.15.18:0/506033651 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa39c06c2b0 0x7fa39c06e770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0033000 tx=0x7fa3b0008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:03.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.419+0000 7fa3aaffd640 1 -- 172.21.15.18:0/506033651 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa3ac059570 con 0x7fa3a4004390 2024-09-19T09:14:03.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.669+0000 7fa3c0f66640 1 -- 172.21.15.18:0/506033651 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fa3bc069720 con 0x7fa3a4004390 2024-09-19T09:14:03.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.671+0000 7fa3aaffd640 1 -- 172.21.15.18:0/506033651 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7fa3ac05d870 con 0x7fa3a4004390 2024-09-19T09:14:03.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.673+0000 7fa3c0f66640 1 -- 172.21.15.18:0/506033651 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa39c06c2b0 msgr2=0x7fa39c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:03.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.673+0000 7fa3c0f66640 1 --2- 172.21.15.18:0/506033651 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa39c06c2b0 0x7fa39c06e770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0033000 tx=0x7fa3b0008030 comp rx=0 tx=0).stop 2024-09-19T09:14:03.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.673+0000 7fa3c0f66640 1 -- 172.21.15.18:0/506033651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3a4004390 msgr2=0x7fa3bc1510d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:03.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.673+0000 7fa3c0f66640 1 --2- 172.21.15.18:0/506033651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3a4004390 0x7fa3bc1510d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac000f60 tx=0x7fa3ac007720 comp rx=0 tx=0).stop 2024-09-19T09:14:03.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.673+0000 7fa3c0f66640 1 -- 172.21.15.18:0/506033651 shutdown_connections 2024-09-19T09:14:03.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.673+0000 7fa3c0f66640 1 --2- 172.21.15.18:0/506033651 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa39c06c2b0 0x7fa39c06e770 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:03.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.673+0000 7fa3c0f66640 1 --2- 172.21.15.18:0/506033651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3bc0cd9d0 0x7fa3bc0cde50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:03.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.673+0000 7fa3c0f66640 1 --2- 172.21.15.18:0/506033651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3bc150470 0x7fa3bc153e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:03.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.673+0000 7fa3c0f66640 1 --2- 172.21.15.18:0/506033651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3a4004390 0x7fa3bc1510d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:03.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.673+0000 7fa3c0f66640 1 -- 172.21.15.18:0/506033651 >> 172.21.15.18:0/506033651 conn(0x7fa3bc0b7e10 msgr2=0x7fa3bc070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:03.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.674+0000 7fa3c0f66640 1 -- 172.21.15.18:0/506033651 shutdown_connections 2024-09-19T09:14:03.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.674+0000 7fa3c0f66640 1 -- 172.21.15.18:0/506033651 wait complete. 2024-09-19T09:14:03.686 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-19T09:14:03.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.788+0000 7fd160e1e640 1 Processor -- start 2024-09-19T09:14:03.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.788+0000 7fd160e1e640 1 -- start start 2024-09-19T09:14:03.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.789+0000 7fd160e1e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd15c15eda0 0x7fd15c0d5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:03.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.789+0000 7fd160e1e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd15c0d1630 0x7fd15c0d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:03.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.789+0000 7fd160e1e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd15c0d3cc0 con 0x7fd15c0d0480 2024-09-19T09:14:03.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.789+0000 7fd160e1e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fd15c0d2880 con 0x7fd15c15eda0 2024-09-19T09:14:03.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.789+0000 7fd160e1e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd15c0d3120 con 0x7fd15c0d1630 2024-09-19T09:14:03.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.789+0000 7fd15a59c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd15c15eda0 0x7fd15c0d5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:03.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.789+0000 7fd15a59c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd15c15eda0 0x7fd15c0d5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33790/0 (socket says 172.21.15.18:33790) 2024-09-19T09:14:03.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.789+0000 7fd15a59c640 1 -- 172.21.15.18:0/3709117138 learned_addr learned my addr 172.21.15.18:0/3709117138 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:03.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.789+0000 7fd15ad9d640 1 --2- 172.21.15.18:0/3709117138 >> v2:172.21.15.162:3300/0 conn(0x7fd15c0d1630 0x7fd15c0d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:03.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.789+0000 7fd15a59c640 1 -- 172.21.15.18:0/3709117138 >> v2:172.21.15.162:3300/0 conn(0x7fd15c0d1630 msgr2=0x7fd15c0d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:03.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.789+0000 7fd15a59c640 1 --2- 172.21.15.18:0/3709117138 >> v2:172.21.15.162:3300/0 conn(0x7fd15c0d1630 0x7fd15c0d1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:03.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.789+0000 7fd15a59c640 1 -- 172.21.15.18:0/3709117138 >> v1:172.21.15.162:6789/0 conn(0x7fd15c0d0480 legacy=0x7fd15c0d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:03.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.789+0000 7fd15a59c640 1 -- 172.21.15.18:0/3709117138 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd15c0d0bf0 con 0x7fd15c15eda0 2024-09-19T09:14:03.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.789+0000 7fd15ad9d640 1 --2- 172.21.15.18:0/3709117138 >> v2:172.21.15.162:3300/0 conn(0x7fd15c0d1630 0x7fd15c0d1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:14:03.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.790+0000 7fd15a59c640 1 --2- 172.21.15.18:0/3709117138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd15c15eda0 0x7fd15c0d5790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd15c163ac0 tx=0x7fd14c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4014b0149c16abc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:03.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.790+0000 7fd15959a640 1 -- 172.21.15.18:0/3709117138 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14c037070 con 0x7fd15c15eda0 2024-09-19T09:14:03.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.790+0000 7fd15959a640 1 -- 172.21.15.18:0/3709117138 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd14c032440 con 0x7fd15c15eda0 2024-09-19T09:14:03.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.790+0000 7fd15959a640 1 -- 172.21.15.18:0/3709117138 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14c032810 con 0x7fd15c15eda0 2024-09-19T09:14:03.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.790+0000 7fd160e1e640 1 -- 172.21.15.18:0/3709117138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd15c15eda0 msgr2=0x7fd15c0d5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:03.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.790+0000 7fd160e1e640 1 --2- 172.21.15.18:0/3709117138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd15c15eda0 0x7fd15c0d5790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd15c163ac0 tx=0x7fd14c02a230 comp rx=0 tx=0).stop 2024-09-19T09:14:03.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.791+0000 7fd160e1e640 1 -- 172.21.15.18:0/3709117138 shutdown_connections 2024-09-19T09:14:03.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.791+0000 7fd160e1e640 1 --2- 172.21.15.18:0/3709117138 >> v2:172.21.15.162:3300/0 conn(0x7fd15c0d1630 0x7fd15c0d1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:03.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.791+0000 7fd160e1e640 1 --2- 172.21.15.18:0/3709117138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd15c15eda0 0x7fd15c0d5790 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:03.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.791+0000 7fd160e1e640 1 -- 172.21.15.18:0/3709117138 >> 172.21.15.18:0/3709117138 conn(0x7fd15c09df40 msgr2=0x7fd15c0d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:03.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.791+0000 7fd160e1e640 1 -- 172.21.15.18:0/3709117138 shutdown_connections 2024-09-19T09:14:03.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.791+0000 7fd160e1e640 1 -- 172.21.15.18:0/3709117138 wait complete. 2024-09-19T09:14:03.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.792+0000 7fd160e1e640 1 Processor -- start 2024-09-19T09:14:03.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.792+0000 7fd160e1e640 1 -- start start 2024-09-19T09:14:03.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.793+0000 7fd160e1e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd15c0d0480 0x7fd15c0ce040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:03.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.793+0000 7fd160e1e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd15c0d1630 0x7fd15c15a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:03.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.793+0000 7fd160e1e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd15c15eda0 0x7fd15c0ccba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:03.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.793+0000 7fd160e1e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd15c0d08f0 con 0x7fd15c15eda0 2024-09-19T09:14:03.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.793+0000 7fd160e1e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd15c0d2db0 con 0x7fd15c0d0480 2024-09-19T09:14:03.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.793+0000 7fd160e1e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd15c15f180 con 0x7fd15c0d1630 2024-09-19T09:14:03.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.793+0000 7fd15ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd15c15eda0 0x7fd15c0ccba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:03.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.793+0000 7fd15ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd15c15eda0 0x7fd15c0ccba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33798/0 (socket says 172.21.15.18:33798) 2024-09-19T09:14:03.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.793+0000 7fd15ad9d640 1 -- 172.21.15.18:0/695163192 learned_addr learned my addr 172.21.15.18:0/695163192 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:03.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.793+0000 7fd15a59c640 1 --2- 172.21.15.18:0/695163192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd15c0d0480 0x7fd15c0ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:03.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.793+0000 7fd159d9b640 1 --2- 172.21.15.18:0/695163192 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd15c0d1630 0x7fd15c15a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:03.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.793+0000 7fd15ad9d640 1 -- 172.21.15.18:0/695163192 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd15c0d1630 msgr2=0x7fd15c15a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:03.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.793+0000 7fd15ad9d640 1 --2- 172.21.15.18:0/695163192 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd15c0d1630 0x7fd15c15a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:03.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.793+0000 7fd15ad9d640 1 -- 172.21.15.18:0/695163192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd15c0d0480 msgr2=0x7fd15c0ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:03.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.793+0000 7fd15ad9d640 1 --2- 172.21.15.18:0/695163192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd15c0d0480 0x7fd15c0ce040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:03.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.793+0000 7fd15ad9d640 1 -- 172.21.15.18:0/695163192 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd15c0cd5d0 con 0x7fd15c15eda0 2024-09-19T09:14:03.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.793+0000 7fd15a59c640 1 --2- 172.21.15.18:0/695163192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd15c0d0480 0x7fd15c0ce040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:03.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.793+0000 7fd15ad9d640 1 --2- 172.21.15.18:0/695163192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd15c15eda0 0x7fd15c0ccba0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd15400cef0 tx=0x7fd15400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:03.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.793+0000 7fd14affd640 1 -- 172.21.15.18:0/695163192 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15401a070 con 0x7fd15c15eda0 2024-09-19T09:14:03.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.794+0000 7fd14affd640 1 -- 172.21.15.18:0/695163192 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd15400d860 con 0x7fd15c15eda0 2024-09-19T09:14:03.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.794+0000 7fd160e1e640 1 -- 172.21.15.18:0/695163192 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd15c0cefc0 con 0x7fd15c15eda0 2024-09-19T09:14:03.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.794+0000 7fd14affd640 1 -- 172.21.15.18:0/695163192 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15400dc50 con 0x7fd15c15eda0 2024-09-19T09:14:03.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.794+0000 7fd160e1e640 1 -- 172.21.15.18:0/695163192 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd15c15ae00 con 0x7fd15c15eda0 2024-09-19T09:14:03.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.795+0000 7fd160e1e640 1 -- 172.21.15.18:0/695163192 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd15c0d5790 con 0x7fd15c15eda0 2024-09-19T09:14:03.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.795+0000 7fd14affd640 1 -- 172.21.15.18:0/695163192 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd15401d070 con 0x7fd15c15eda0 2024-09-19T09:14:03.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.796+0000 7fd14affd640 1 --2- 172.21.15.18:0/695163192 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd13c06c2b0 0x7fd13c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:03.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.796+0000 7fd14affd640 1 -- 172.21.15.18:0/695163192 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fd15408b9c0 con 0x7fd15c15eda0 2024-09-19T09:14:03.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.796+0000 7fd15a59c640 1 --2- 172.21.15.18:0/695163192 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd13c06c2b0 0x7fd13c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:03.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.796+0000 7fd15a59c640 1 --2- 172.21.15.18:0/695163192 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd13c06c2b0 0x7fd13c06e770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd14c034000 tx=0x7fd14c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:03.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:03.800+0000 7fd14affd640 1 -- 172.21.15.18:0/695163192 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd15408de20 con 0x7fd15c15eda0 2024-09-19T09:14:04.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.041+0000 7fd160e1e640 1 -- 172.21.15.18:0/695163192 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fd15c0c83f0 con 0x7fd15c15eda0 2024-09-19T09:14:04.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.044+0000 7fd14affd640 1 -- 172.21.15.18:0/695163192 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7fd15405a540 con 0x7fd15c15eda0 2024-09-19T09:14:04.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.045+0000 7fd160e1e640 1 -- 172.21.15.18:0/695163192 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd13c06c2b0 msgr2=0x7fd13c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:04.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.045+0000 7fd160e1e640 1 --2- 172.21.15.18:0/695163192 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd13c06c2b0 0x7fd13c06e770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd14c034000 tx=0x7fd14c02e000 comp rx=0 tx=0).stop 2024-09-19T09:14:04.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.045+0000 7fd160e1e640 1 -- 172.21.15.18:0/695163192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd15c15eda0 msgr2=0x7fd15c0ccba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:04.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.045+0000 7fd160e1e640 1 --2- 172.21.15.18:0/695163192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd15c15eda0 0x7fd15c0ccba0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd15400cef0 tx=0x7fd15400a710 comp rx=0 tx=0).stop 2024-09-19T09:14:04.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.045+0000 7fd160e1e640 1 -- 172.21.15.18:0/695163192 shutdown_connections 2024-09-19T09:14:04.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.045+0000 7fd160e1e640 1 --2- 172.21.15.18:0/695163192 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd13c06c2b0 0x7fd13c06e770 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:04.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.045+0000 7fd160e1e640 1 --2- 172.21.15.18:0/695163192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd15c15eda0 0x7fd15c0ccba0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.045+0000 7fd160e1e640 1 --2- 172.21.15.18:0/695163192 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd15c0d1630 0x7fd15c15a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.045+0000 7fd160e1e640 1 --2- 172.21.15.18:0/695163192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd15c0d0480 0x7fd15c0ce040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.045+0000 7fd160e1e640 1 -- 172.21.15.18:0/695163192 >> 172.21.15.18:0/695163192 conn(0x7fd15c09df40 msgr2=0x7fd15c0b84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.045+0000 7fd160e1e640 1 -- 172.21.15.18:0/695163192 shutdown_connections 2024-09-19T09:14:04.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.045+0000 7fd160e1e640 1 -- 172.21.15.18:0/695163192 wait complete. 2024-09-19T09:14:04.057 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-19T09:14:04.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.159+0000 7f611827b640 1 Processor -- start 2024-09-19T09:14:04.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.159+0000 7f611827b640 1 -- start start 2024-09-19T09:14:04.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.160+0000 7f611827b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6110162460 0x7f61100d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:04.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.160+0000 7f611827b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f61100d1ac0 0x7f61100d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:04.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.160+0000 7f611827b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61100b50a0 con 0x7f61100d56f0 2024-09-19T09:14:04.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.160+0000 7f611827b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f61100b5940 con 0x7f61100d1ac0 2024-09-19T09:14:04.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.160+0000 7f611827b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f61100b5380 con 0x7f6110162460 2024-09-19T09:14:04.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.160+0000 7f6116818640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f61100d1ac0 0x7f61100d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:04.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.160+0000 7f6115816640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f61100d56f0 0x7f61100d2b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:47390/0 (socket says 172.21.15.18:47390) 2024-09-19T09:14:04.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.160+0000 7f6115816640 1 -- 172.21.15.18:0/1187908688 learned_addr learned my addr 172.21.15.18:0/1187908688 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:04.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.160+0000 7f6116818640 1 -- 172.21.15.18:0/1187908688 >> v2:172.21.15.162:3300/0 conn(0x7f6110162460 msgr2=0x7f61100d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:04.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.160+0000 7f6116017640 1 --2- 172.21.15.18:0/1187908688 >> v2:172.21.15.162:3300/0 conn(0x7f6110162460 0x7f61100d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:04.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.160+0000 7f6116818640 1 --2- 172.21.15.18:0/1187908688 >> v2:172.21.15.162:3300/0 conn(0x7f6110162460 0x7f61100d1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:04.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.160+0000 7f6115015640 1 -- 172.21.15.18:0/1187908688 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 27827588 0 0) 0x7f61100b50a0 con 0x7f61100d56f0 2024-09-19T09:14:04.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.160+0000 7f6116818640 1 -- 172.21.15.18:0/1187908688 >> v1:172.21.15.18:6789/0 conn(0x7f61100d56f0 legacy=0x7f61100d2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:04.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.160+0000 7f6116818640 1 -- 172.21.15.18:0/1187908688 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61100b5660 con 0x7f61100d1ac0 2024-09-19T09:14:04.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.161+0000 7f6116017640 1 --2- 172.21.15.18:0/1187908688 >> v2:172.21.15.162:3300/0 conn(0x7f6110162460 0x7f61100d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:14:04.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.161+0000 7f6116818640 1 --2- 172.21.15.18:0/1187908688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61100d1ac0 0x7f61100d07f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f611008ed60 tx=0x7f610802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b6112a0969929df server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:04.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.161+0000 7f6115015640 1 -- 172.21.15.18:0/1187908688 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6108037070 con 0x7f61100d1ac0 2024-09-19T09:14:04.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.161+0000 7f6115015640 1 -- 172.21.15.18:0/1187908688 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6108032440 con 0x7f61100d1ac0 2024-09-19T09:14:04.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.161+0000 7f6115015640 1 -- 172.21.15.18:0/1187908688 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6108032810 con 0x7f61100d1ac0 2024-09-19T09:14:04.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.162+0000 7f611827b640 1 -- 172.21.15.18:0/1187908688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61100d1ac0 msgr2=0x7f61100d07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:04.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.162+0000 7f611827b640 1 --2- 172.21.15.18:0/1187908688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61100d1ac0 0x7f61100d07f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f611008ed60 tx=0x7f610802a1a0 comp rx=0 tx=0).stop 2024-09-19T09:14:04.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.162+0000 7f611827b640 1 -- 172.21.15.18:0/1187908688 shutdown_connections 2024-09-19T09:14:04.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.162+0000 7f611827b640 1 --2- 172.21.15.18:0/1187908688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61100d1ac0 0x7f61100d07f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:04.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.162+0000 7f611827b640 1 --2- 172.21.15.18:0/1187908688 >> v2:172.21.15.162:3300/0 conn(0x7f6110162460 0x7f61100d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:04.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.162+0000 7f611827b640 1 -- 172.21.15.18:0/1187908688 >> 172.21.15.18:0/1187908688 conn(0x7f61100d4bd0 msgr2=0x7f61100d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:04.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.162+0000 7f611827b640 1 -- 172.21.15.18:0/1187908688 shutdown_connections 2024-09-19T09:14:04.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.162+0000 7f611827b640 1 -- 172.21.15.18:0/1187908688 wait complete. 2024-09-19T09:14:04.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.163+0000 7f611827b640 1 Processor -- start 2024-09-19T09:14:04.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.163+0000 7f611827b640 1 -- start start 2024-09-19T09:14:04.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.164+0000 7f611827b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61100d1ac0 0x7f61101f7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:04.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.164+0000 7f611827b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61100d56f0 0x7f61100ca950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:04.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.164+0000 7f611827b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6110162460 0x7f61100cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:04.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.164+0000 7f611827b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f61100b5e40 con 0x7f61100d1ac0 2024-09-19T09:14:04.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.164+0000 7f611827b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f61100b5cc0 con 0x7f61100d56f0 2024-09-19T09:14:04.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.164+0000 7f611827b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6110162840 con 0x7f6110162460 2024-09-19T09:14:04.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.164+0000 7f6116017640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61100d1ac0 0x7f61101f7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:04.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.164+0000 7f6116017640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61100d1ac0 0x7f61101f7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33810/0 (socket says 172.21.15.18:33810) 2024-09-19T09:14:04.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.164+0000 7f6116017640 1 -- 172.21.15.18:0/2960233150 learned_addr learned my addr 172.21.15.18:0/2960233150 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:04.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.164+0000 7f6116818640 1 --2- 172.21.15.18:0/2960233150 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6110162460 0x7f61100cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:04.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.164+0000 7f6115816640 1 --2- 172.21.15.18:0/2960233150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61100d56f0 0x7f61100ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:04.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.164+0000 7f6116017640 1 -- 172.21.15.18:0/2960233150 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6110162460 msgr2=0x7f61100cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:04.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.164+0000 7f6116017640 1 --2- 172.21.15.18:0/2960233150 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6110162460 0x7f61100cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:04.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.164+0000 7f6116017640 1 -- 172.21.15.18:0/2960233150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61100d56f0 msgr2=0x7f61100ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:04.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.164+0000 7f6116017640 1 --2- 172.21.15.18:0/2960233150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61100d56f0 0x7f61100ca950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:04.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.164+0000 7f6116017640 1 -- 172.21.15.18:0/2960233150 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61100cd610 con 0x7f61100d1ac0 2024-09-19T09:14:04.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.165+0000 7f6116017640 1 --2- 172.21.15.18:0/2960233150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61100d1ac0 0x7f61101f7460 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f610000ce00 tx=0x7f610000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:04.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.165+0000 7f610effd640 1 -- 172.21.15.18:0/2960233150 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610000f890 con 0x7f61100d1ac0 2024-09-19T09:14:04.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.165+0000 7f610effd640 1 -- 172.21.15.18:0/2960233150 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f610000fa30 con 0x7f61100d1ac0 2024-09-19T09:14:04.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.165+0000 7f611827b640 1 -- 172.21.15.18:0/2960233150 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61100cd330 con 0x7f61100d1ac0 2024-09-19T09:14:04.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.165+0000 7f610effd640 1 -- 172.21.15.18:0/2960233150 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610000fe40 con 0x7f61100d1ac0 2024-09-19T09:14:04.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.165+0000 7f611827b640 1 -- 172.21.15.18:0/2960233150 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61100c8fc0 con 0x7f61100d1ac0 2024-09-19T09:14:04.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.166+0000 7f611827b640 1 -- 172.21.15.18:0/2960233150 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61100b50a0 con 0x7f61100d1ac0 2024-09-19T09:14:04.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.166+0000 7f610effd640 1 -- 172.21.15.18:0/2960233150 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6100018400 con 0x7f61100d1ac0 2024-09-19T09:14:04.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.167+0000 7f610effd640 1 --2- 172.21.15.18:0/2960233150 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f60fc06c2b0 0x7f60fc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:04.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.167+0000 7f610effd640 1 -- 172.21.15.18:0/2960233150 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f610008be30 con 0x7f61100d1ac0 2024-09-19T09:14:04.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.167+0000 7f6115816640 1 --2- 172.21.15.18:0/2960233150 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f60fc06c2b0 0x7f60fc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:04.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.168+0000 7f6115816640 1 --2- 172.21.15.18:0/2960233150 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f60fc06c2b0 0x7f60fc06e770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f611015e8f0 tx=0x7f6104007b50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:04.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.171+0000 7f610effd640 1 -- 172.21.15.18:0/2960233150 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6100014030 con 0x7f61100d1ac0 2024-09-19T09:14:04.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.415+0000 7f611827b640 1 -- 172.21.15.18:0/2960233150 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f61100ba240 con 0x7f61100d1ac0 2024-09-19T09:14:04.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.417+0000 7f610effd640 1 -- 172.21.15.18:0/2960233150 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f610000ae20 con 0x7f61100d1ac0 2024-09-19T09:14:04.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.420+0000 7f611827b640 1 -- 172.21.15.18:0/2960233150 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f60fc06c2b0 msgr2=0x7f60fc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:04.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.420+0000 7f611827b640 1 --2- 172.21.15.18:0/2960233150 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f60fc06c2b0 0x7f60fc06e770 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f611015e8f0 tx=0x7f6104007b50 comp rx=0 tx=0).stop 2024-09-19T09:14:04.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.420+0000 7f611827b640 1 -- 172.21.15.18:0/2960233150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61100d1ac0 msgr2=0x7f61101f7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:04.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.420+0000 7f611827b640 1 --2- 172.21.15.18:0/2960233150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61100d1ac0 0x7f61101f7460 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f610000ce00 tx=0x7f610000a650 comp rx=0 tx=0).stop 2024-09-19T09:14:04.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.420+0000 7f611827b640 1 -- 172.21.15.18:0/2960233150 shutdown_connections 2024-09-19T09:14:04.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.420+0000 7f611827b640 1 --2- 172.21.15.18:0/2960233150 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f60fc06c2b0 0x7f60fc06e770 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:04.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.420+0000 7f611827b640 1 --2- 172.21.15.18:0/2960233150 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6110162460 0x7f61100cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:04.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.420+0000 7f611827b640 1 --2- 172.21.15.18:0/2960233150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61100d56f0 0x7f61100ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:04.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.420+0000 7f611827b640 1 --2- 172.21.15.18:0/2960233150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61100d1ac0 0x7f61101f7460 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:04.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.420+0000 7f611827b640 1 -- 172.21.15.18:0/2960233150 >> 172.21.15.18:0/2960233150 conn(0x7f61100d4bd0 msgr2=0x7f611015f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:04.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.420+0000 7f611827b640 1 -- 172.21.15.18:0/2960233150 shutdown_connections 2024-09-19T09:14:04.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.420+0000 7f611827b640 1 -- 172.21.15.18:0/2960233150 wait complete. 2024-09-19T09:14:04.432 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-19T09:14:04.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.532+0000 7f240d8f1640 1 Processor -- start 2024-09-19T09:14:04.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.532+0000 7f240d8f1640 1 -- start start 2024-09-19T09:14:04.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.533+0000 7f240d8f1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2408162850 0x7f2408162c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:04.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.533+0000 7f240d8f1640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f24080b5160 0x7f2408070620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:04.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.533+0000 7f240d8f1640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2408163170 con 0x7f24080d1660 2024-09-19T09:14:04.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.533+0000 7f240d8f1640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f24080d1f00 con 0x7f24080b5160 2024-09-19T09:14:04.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.533+0000 7f240d8f1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f240806f860 con 0x7f2408162850 2024-09-19T09:14:04.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.533+0000 7f24077fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f24080d1660 0x7f2408160650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:47406/0 (socket says 172.21.15.18:47406) 2024-09-19T09:14:04.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.533+0000 7f24077fe640 1 -- 172.21.15.18:0/534655174 learned_addr learned my addr 172.21.15.18:0/534655174 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:04.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.533+0000 7f24067fc640 1 --2- 172.21.15.18:0/534655174 >> v2:172.21.15.162:3300/0 conn(0x7f24080b5160 0x7f2408070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:04.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.533+0000 7f2406ffd640 1 --2- 172.21.15.18:0/534655174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2408162850 0x7f2408162c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:04.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.534+0000 7f2405ffb640 1 -- 172.21.15.18:0/534655174 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2004425078 0 0) 0x7f2408163170 con 0x7f24080d1660 2024-09-19T09:14:04.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.534+0000 7f2405ffb640 1 -- 172.21.15.18:0/534655174 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23f4003520 con 0x7f24080d1660 2024-09-19T09:14:04.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.534+0000 7f2405ffb640 1 -- 172.21.15.18:0/534655174 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 9996546 0 0) 0x7f23f4003520 con 0x7f24080d1660 2024-09-19T09:14:04.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.534+0000 7f2405ffb640 1 -- 172.21.15.18:0/534655174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2408162850 msgr2=0x7f2408162c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:04.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.534+0000 7f2405ffb640 1 --2- 172.21.15.18:0/534655174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2408162850 0x7f2408162c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:04.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.534+0000 7f2405ffb640 1 -- 172.21.15.18:0/534655174 >> v2:172.21.15.162:3300/0 conn(0x7f24080b5160 msgr2=0x7f2408070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:04.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.534+0000 7f2405ffb640 1 --2- 172.21.15.18:0/534655174 >> v2:172.21.15.162:3300/0 conn(0x7f24080b5160 0x7f2408070620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:04.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.534+0000 7f2405ffb640 1 -- 172.21.15.18:0/534655174 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240806fb40 con 0x7f24080d1660 2024-09-19T09:14:04.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.534+0000 7f2405ffb640 1 -- 172.21.15.18:0/534655174 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f23f80019f0 con 0x7f24080d1660 2024-09-19T09:14:04.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.534+0000 7f24067fc640 1 --2- 172.21.15.18:0/534655174 >> v2:172.21.15.162:3300/0 conn(0x7f24080b5160 0x7f2408070620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:14:04.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.534+0000 7f2406ffd640 1 --2- 172.21.15.18:0/534655174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2408162850 0x7f2408162c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:14:04.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.534+0000 7f2405ffb640 1 -- 172.21.15.18:0/534655174 >> v1:172.21.15.18:6789/0 conn(0x7f24080d1660 legacy=0x7f2408160650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:04.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.534+0000 7f2405ffb640 1 --2- 172.21.15.18:0/534655174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2408162850 0x7f23f40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:04.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.534+0000 7f2405ffb640 1 --2- 172.21.15.18:0/534655174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23f4003ef0 0x7f23f4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:04.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.534+0000 7f2405ffb640 1 --2- 172.21.15.18:0/534655174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23f4004d40 0x7f23f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:04.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.534+0000 7f2405ffb640 1 -- 172.21.15.18:0/534655174 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f24080d1f00 con 0x7f23f4004d40 2024-09-19T09:14:04.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.534+0000 7f2405ffb640 1 -- 172.21.15.18:0/534655174 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f240806f860 con 0x7f23f4003ef0 2024-09-19T09:14:04.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.534+0000 7f2405ffb640 1 -- 172.21.15.18:0/534655174 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f23f400b9c0 con 0x7f2408162850 2024-09-19T09:14:04.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.534+0000 7f24077fe640 1 --2- 172.21.15.18:0/534655174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23f4004d40 0x7f23f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:04.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.534+0000 7f2406ffd640 1 --2- 172.21.15.18:0/534655174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2408162850 0x7f23f40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:04.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.534+0000 7f24067fc640 1 --2- 172.21.15.18:0/534655174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23f4003ef0 0x7f23f4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:04.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.534+0000 7f24077fe640 1 -- 172.21.15.18:0/534655174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2408162850 msgr2=0x7f23f40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:04.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.534+0000 7f24077fe640 1 --2- 172.21.15.18:0/534655174 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2408162850 0x7f23f40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:04.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.534+0000 7f24077fe640 1 -- 172.21.15.18:0/534655174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23f4003ef0 msgr2=0x7f23f4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:04.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.534+0000 7f24077fe640 1 --2- 172.21.15.18:0/534655174 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23f4003ef0 0x7f23f4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:04.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.534+0000 7f24077fe640 1 -- 172.21.15.18:0/534655174 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23f4003520 con 0x7f23f4004d40 2024-09-19T09:14:04.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.535+0000 7f24077fe640 1 --2- 172.21.15.18:0/534655174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23f4004d40 0x7f23f40051c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f23f800a8a0 tx=0x7f23f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a0c3628275958a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:04.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.535+0000 7f2405ffb640 1 -- 172.21.15.18:0/534655174 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f800a4c0 con 0x7f23f4004d40 2024-09-19T09:14:04.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.535+0000 7f2405ffb640 1 -- 172.21.15.18:0/534655174 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23f802f070 con 0x7f23f4004d40 2024-09-19T09:14:04.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.535+0000 7f2405ffb640 1 -- 172.21.15.18:0/534655174 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f802bd70 con 0x7f23f4004d40 2024-09-19T09:14:04.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.536+0000 7f240d8f1640 1 -- 172.21.15.18:0/534655174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23f4004d40 msgr2=0x7f23f40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:04.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.536+0000 7f240d8f1640 1 --2- 172.21.15.18:0/534655174 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23f4004d40 0x7f23f40051c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f23f800a8a0 tx=0x7f23f4005830 comp rx=0 tx=0).stop 2024-09-19T09:14:04.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.536+0000 7f24077fe640 1 -- 172.21.15.18:0/534655174 reap_dead start 2024-09-19T09:14:04.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.536+0000 7f240d8f1640 1 -- 172.21.15.18:0/534655174 shutdown_connections 2024-09-19T09:14:04.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.536+0000 7f240d8f1640 1 -- 172.21.15.18:0/534655174 >> 172.21.15.18:0/534655174 conn(0x7f24080b4560 msgr2=0x7f24080b4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:04.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.536+0000 7f240d8f1640 1 -- 172.21.15.18:0/534655174 shutdown_connections 2024-09-19T09:14:04.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.536+0000 7f240d8f1640 1 -- 172.21.15.18:0/534655174 wait complete. 2024-09-19T09:14:04.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.537+0000 7f240d8f1640 1 Processor -- start 2024-09-19T09:14:04.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.537+0000 7f240d8f1640 1 -- start start 2024-09-19T09:14:04.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.538+0000 7f240d8f1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23f4004d40 0x7f24080c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:04.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.538+0000 7f240d8f1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24080c93a0 0x7f24080d2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:04.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.538+0000 7f240d8f1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2408156f30 0x7f24080d31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:04.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.538+0000 7f240d8f1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2408160030 con 0x7f24080c93a0 2024-09-19T09:14:04.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.538+0000 7f240d8f1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2408070b60 con 0x7f2408156f30 2024-09-19T09:14:04.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.538+0000 7f240d8f1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f24081601b0 con 0x7f23f4004d40 2024-09-19T09:14:04.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.538+0000 7f24067fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24080c93a0 0x7f24080d2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:04.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.538+0000 7f24067fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24080c93a0 0x7f24080d2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33830/0 (socket says 172.21.15.18:33830) 2024-09-19T09:14:04.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.538+0000 7f24067fc640 1 -- 172.21.15.18:0/409401364 learned_addr learned my addr 172.21.15.18:0/409401364 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:04.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.538+0000 7f24077fe640 1 --2- 172.21.15.18:0/409401364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2408156f30 0x7f24080d31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:04.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.538+0000 7f2406ffd640 1 --2- 172.21.15.18:0/409401364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23f4004d40 0x7f24080c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:04.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.538+0000 7f24067fc640 1 -- 172.21.15.18:0/409401364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23f4004d40 msgr2=0x7f24080c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:04.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.538+0000 7f24067fc640 1 --2- 172.21.15.18:0/409401364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23f4004d40 0x7f24080c8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:04.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.538+0000 7f24067fc640 1 -- 172.21.15.18:0/409401364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2408156f30 msgr2=0x7f24080d31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:04.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.538+0000 7f24067fc640 1 --2- 172.21.15.18:0/409401364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2408156f30 0x7f24080d31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:04.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.538+0000 7f24067fc640 1 -- 172.21.15.18:0/409401364 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24080b0f00 con 0x7f24080c93a0 2024-09-19T09:14:04.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.538+0000 7f24077fe640 1 --2- 172.21.15.18:0/409401364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2408156f30 0x7f24080d31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:04.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.538+0000 7f2406ffd640 1 --2- 172.21.15.18:0/409401364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23f4004d40 0x7f24080c8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:04.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.539+0000 7f24067fc640 1 --2- 172.21.15.18:0/409401364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24080c93a0 0x7f24080d2c70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f23f0011d00 tx=0x7f23f000f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:04.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.539+0000 7f23fffff640 1 -- 172.21.15.18:0/409401364 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f000fd20 con 0x7f24080c93a0 2024-09-19T09:14:04.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.539+0000 7f23fffff640 1 -- 172.21.15.18:0/409401364 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23f0014440 con 0x7f24080c93a0 2024-09-19T09:14:04.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.539+0000 7f23fffff640 1 -- 172.21.15.18:0/409401364 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f0014830 con 0x7f24080c93a0 2024-09-19T09:14:04.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.539+0000 7f240d8f1640 1 -- 172.21.15.18:0/409401364 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24080b11a0 con 0x7f24080c93a0 2024-09-19T09:14:04.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.539+0000 7f240d8f1640 1 -- 172.21.15.18:0/409401364 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24080b1760 con 0x7f24080c93a0 2024-09-19T09:14:04.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.540+0000 7f240d8f1640 1 -- 172.21.15.18:0/409401364 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24080d1b10 con 0x7f24080c93a0 2024-09-19T09:14:04.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.540+0000 7f23fffff640 1 -- 172.21.15.18:0/409401364 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f23f0012040 con 0x7f24080c93a0 2024-09-19T09:14:04.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.541+0000 7f23fffff640 1 --2- 172.21.15.18:0/409401364 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f23e806c2b0 0x7f23e806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:04.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.541+0000 7f23fffff640 1 -- 172.21.15.18:0/409401364 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f23f008b8f0 con 0x7f24080c93a0 2024-09-19T09:14:04.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.541+0000 7f2406ffd640 1 --2- 172.21.15.18:0/409401364 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f23e806c2b0 0x7f23e806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:04.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.541+0000 7f2406ffd640 1 --2- 172.21.15.18:0/409401364 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f23e806c2b0 0x7f23e806e770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f24081f8390 tx=0x7f2400008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:04.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.545+0000 7f23fffff640 1 -- 172.21.15.18:0/409401364 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f23f0019030 con 0x7f24080c93a0 2024-09-19T09:14:04.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.721+0000 7f240d8f1640 1 -- 172.21.15.18:0/409401364 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f24080c8c40 con 0x7f24080c93a0 2024-09-19T09:14:04.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.722+0000 7f23fffff640 1 -- 172.21.15.18:0/409401364 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) ==== 84+0+65 (secure 0 0 0) 0x7f23f005a440 con 0x7f24080c93a0 2024-09-19T09:14:04.723 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:04.724 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-09-19T09:14:04.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:04.724 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 1, 2024-09-19T09:14:04.724 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": ".mgr" 2024-09-19T09:14:04.724 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:04.724 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-09-19T09:14:04.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.724+0000 7f240d8f1640 1 -- 172.21.15.18:0/409401364 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f23e806c2b0 msgr2=0x7f23e806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:04.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.724+0000 7f240d8f1640 1 --2- 172.21.15.18:0/409401364 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f23e806c2b0 0x7f23e806e770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f24081f8390 tx=0x7f2400008040 comp rx=0 tx=0).stop 2024-09-19T09:14:04.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.724+0000 7f240d8f1640 1 -- 172.21.15.18:0/409401364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24080c93a0 msgr2=0x7f24080d2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:04.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.724+0000 7f240d8f1640 1 --2- 172.21.15.18:0/409401364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24080c93a0 0x7f24080d2c70 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f23f0011d00 tx=0x7f23f000f610 comp rx=0 tx=0).stop 2024-09-19T09:14:04.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.724+0000 7f240d8f1640 1 -- 172.21.15.18:0/409401364 shutdown_connections 2024-09-19T09:14:04.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.724+0000 7f240d8f1640 1 --2- 172.21.15.18:0/409401364 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f23e806c2b0 0x7f23e806e770 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:04.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.724+0000 7f240d8f1640 1 --2- 172.21.15.18:0/409401364 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2408156f30 0x7f24080d31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:04.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.724+0000 7f240d8f1640 1 --2- 172.21.15.18:0/409401364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24080c93a0 0x7f24080d2c70 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:04.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.724+0000 7f240d8f1640 1 --2- 172.21.15.18:0/409401364 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23f4004d40 0x7f24080c8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:04.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.724+0000 7f240d8f1640 1 -- 172.21.15.18:0/409401364 >> 172.21.15.18:0/409401364 conn(0x7f24080b4560 msgr2=0x7f240806e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:04.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.724+0000 7f240d8f1640 1 -- 172.21.15.18:0/409401364 shutdown_connections 2024-09-19T09:14:04.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.724+0000 7f240d8f1640 1 -- 172.21.15.18:0/409401364 wait complete. 2024-09-19T09:14:04.736 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T09:14:04.736 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T09:14:04.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.842+0000 7f9f4ee77640 1 Processor -- start 2024-09-19T09:14:04.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.842+0000 7f9f4ee77640 1 -- start start 2024-09-19T09:14:04.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.843+0000 7f9f4ee77640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9f480b3c90 0x7f9f480b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:04.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.843+0000 7f9f4ee77640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f480d0310 con 0x7f9f480d3080 2024-09-19T09:14:04.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.843+0000 7f9f4ee77640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f480d05d0 con 0x7f9f4815edc0 2024-09-19T09:14:04.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.843+0000 7f9f4ee77640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9f480d08b0 con 0x7f9f480b3c90 2024-09-19T09:14:04.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.843+0000 7f9f4d414640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f9f480d3080 0x7f9f480d3490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:47414/0 (socket says 172.21.15.18:47414) 2024-09-19T09:14:04.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.843+0000 7f9f4d414640 1 -- 172.21.15.18:0/1815485421 learned_addr learned my addr 172.21.15.18:0/1815485421 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:04.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.843+0000 7f9f47fff640 1 --2- 172.21.15.18:0/1815485421 >> v2:172.21.15.162:3300/0 conn(0x7f9f480b3c90 0x7f9f480b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:04.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.843+0000 7f9f477fe640 1 -- 172.21.15.18:0/1815485421 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3337360902 0 0) 0x7f9f480d0310 con 0x7f9f480d3080 2024-09-19T09:14:04.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.843+0000 7f9f477fe640 1 -- 172.21.15.18:0/1815485421 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f30003520 con 0x7f9f480d3080 2024-09-19T09:14:04.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.844+0000 7f9f477fe640 1 -- 172.21.15.18:0/1815485421 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2992056867 0 0) 0x7f9f480d05d0 con 0x7f9f4815edc0 2024-09-19T09:14:04.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.844+0000 7f9f477fe640 1 -- 172.21.15.18:0/1815485421 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f480d0310 con 0x7f9f4815edc0 2024-09-19T09:14:04.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.844+0000 7f9f477fe640 1 -- 172.21.15.18:0/1815485421 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3880330944 0 0) 0x7f9f30003520 con 0x7f9f480d3080 2024-09-19T09:14:04.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.844+0000 7f9f477fe640 1 -- 172.21.15.18:0/1815485421 >> v2:172.21.15.162:3300/0 conn(0x7f9f480b3c90 msgr2=0x7f9f480b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:04.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.844+0000 7f9f477fe640 1 --2- 172.21.15.18:0/1815485421 >> v2:172.21.15.162:3300/0 conn(0x7f9f480b3c90 0x7f9f480b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:04.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.844+0000 7f9f477fe640 1 -- 172.21.15.18:0/1815485421 >> v1:172.21.15.162:6789/0 conn(0x7f9f4815edc0 legacy=0x7f9f480d2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:04.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.844+0000 7f9f477fe640 1 -- 172.21.15.18:0/1815485421 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f480d0b90 con 0x7f9f480d3080 2024-09-19T09:14:04.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.844+0000 7f9f477fe640 1 -- 172.21.15.18:0/1815485421 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f9f400019f0 con 0x7f9f480d3080 2024-09-19T09:14:04.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.844+0000 7f9f477fe640 1 -- 172.21.15.18:0/1815485421 >> v1:172.21.15.18:6789/0 conn(0x7f9f480d3080 legacy=0x7f9f480d3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:04.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.844+0000 7f9f477fe640 1 --2- 172.21.15.18:0/1815485421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f30003b40 0x7f9f30003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:04.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.844+0000 7f9f477fe640 1 --2- 172.21.15.18:0/1815485421 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f30004800 0x7f9f30004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:04.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.844+0000 7f9f477fe640 1 --2- 172.21.15.18:0/1815485421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f300051c0 0x7f9f3000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:04.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.844+0000 7f9f477fe640 1 -- 172.21.15.18:0/1815485421 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9f480d08b0 con 0x7f9f300051c0 2024-09-19T09:14:04.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.844+0000 7f9f477fe640 1 -- 172.21.15.18:0/1815485421 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3000c040 con 0x7f9f30003b40 2024-09-19T09:14:04.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.844+0000 7f9f477fe640 1 -- 172.21.15.18:0/1815485421 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9f3000c240 con 0x7f9f30004800 2024-09-19T09:14:04.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.844+0000 7f9f4d414640 1 --2- 172.21.15.18:0/1815485421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f300051c0 0x7f9f3000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:04.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.844+0000 7f9f4cc13640 1 --2- 172.21.15.18:0/1815485421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f30003b40 0x7f9f30003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:04.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.844+0000 7f9f47fff640 1 --2- 172.21.15.18:0/1815485421 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f30004800 0x7f9f30004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:04.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.844+0000 7f9f4d414640 1 -- 172.21.15.18:0/1815485421 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f30004800 msgr2=0x7f9f30004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:04.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.844+0000 7f9f4d414640 1 --2- 172.21.15.18:0/1815485421 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f30004800 0x7f9f30004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:04.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.844+0000 7f9f4d414640 1 -- 172.21.15.18:0/1815485421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f30003b40 msgr2=0x7f9f30003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:04.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.844+0000 7f9f4d414640 1 --2- 172.21.15.18:0/1815485421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f30003b40 0x7f9f30003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:04.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.844+0000 7f9f4d414640 1 -- 172.21.15.18:0/1815485421 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f30003520 con 0x7f9f300051c0 2024-09-19T09:14:04.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.845+0000 7f9f4d414640 1 -- 172.21.15.18:0/1815485421 reap_dead start 2024-09-19T09:14:04.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.845+0000 7f9f4d414640 1 --2- 172.21.15.18:0/1815485421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f300051c0 0x7f9f3000b9c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9f4000a7c0 tx=0x7f9f30005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=787c1496d268fc7b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:04.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.845+0000 7f9f477fe640 1 -- 172.21.15.18:0/1815485421 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4000a410 con 0x7f9f300051c0 2024-09-19T09:14:04.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.845+0000 7f9f477fe640 1 -- 172.21.15.18:0/1815485421 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f4002f070 con 0x7f9f300051c0 2024-09-19T09:14:04.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.845+0000 7f9f477fe640 1 -- 172.21.15.18:0/1815485421 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4002bc20 con 0x7f9f300051c0 2024-09-19T09:14:04.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.845+0000 7f9f4ee77640 1 -- 172.21.15.18:0/1815485421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f300051c0 msgr2=0x7f9f3000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:04.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.845+0000 7f9f4ee77640 1 --2- 172.21.15.18:0/1815485421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f300051c0 0x7f9f3000b9c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9f4000a7c0 tx=0x7f9f30005830 comp rx=0 tx=0).stop 2024-09-19T09:14:04.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.846+0000 7f9f4ee77640 1 -- 172.21.15.18:0/1815485421 shutdown_connections 2024-09-19T09:14:04.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.846+0000 7f9f4ee77640 1 --2- 172.21.15.18:0/1815485421 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f300051c0 0x7f9f3000b9c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:04.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.846+0000 7f9f4ee77640 1 -- 172.21.15.18:0/1815485421 >> 172.21.15.18:0/1815485421 conn(0x7f9f480d4c60 msgr2=0x7f9f480d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:04.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.846+0000 7f9f4ee77640 1 -- 172.21.15.18:0/1815485421 shutdown_connections 2024-09-19T09:14:04.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.846+0000 7f9f4ee77640 1 -- 172.21.15.18:0/1815485421 wait complete. 2024-09-19T09:14:04.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.847+0000 7f9f4ee77640 1 Processor -- start 2024-09-19T09:14:04.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.847+0000 7f9f4ee77640 1 -- start start 2024-09-19T09:14:04.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.848+0000 7f9f4ee77640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f300051c0 0x7f9f48157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:04.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.848+0000 7f9f4ee77640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f4815b420 0x7f9f4815b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:04.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.848+0000 7f9f4ee77640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f481617e0 0x7f9f48161c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:04.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.848+0000 7f9f4ee77640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9f480b1a10 con 0x7f9f481617e0 2024-09-19T09:14:04.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.848+0000 7f9f4ee77640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9f480b1890 con 0x7f9f4815b420 2024-09-19T09:14:04.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.848+0000 7f9f4ee77640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9f480b1b90 con 0x7f9f300051c0 2024-09-19T09:14:04.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.848+0000 7f9f4d414640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f481617e0 0x7f9f48161c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:04.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.848+0000 7f9f4d414640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f481617e0 0x7f9f48161c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33846/0 (socket says 172.21.15.18:33846) 2024-09-19T09:14:04.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.848+0000 7f9f4d414640 1 -- 172.21.15.18:0/4217399969 learned_addr learned my addr 172.21.15.18:0/4217399969 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:04.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.848+0000 7f9f4cc13640 1 --2- 172.21.15.18:0/4217399969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f300051c0 0x7f9f48157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:04.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.848+0000 7f9f47fff640 1 --2- 172.21.15.18:0/4217399969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f4815b420 0x7f9f4815b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:04.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.848+0000 7f9f4d414640 1 -- 172.21.15.18:0/4217399969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f300051c0 msgr2=0x7f9f48157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:04.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.848+0000 7f9f4d414640 1 --2- 172.21.15.18:0/4217399969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f300051c0 0x7f9f48157a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:04.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.848+0000 7f9f4d414640 1 -- 172.21.15.18:0/4217399969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f4815b420 msgr2=0x7f9f4815b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:04.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.848+0000 7f9f4d414640 1 --2- 172.21.15.18:0/4217399969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f4815b420 0x7f9f4815b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:04.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.848+0000 7f9f4d414640 1 -- 172.21.15.18:0/4217399969 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f481624c0 con 0x7f9f481617e0 2024-09-19T09:14:04.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.848+0000 7f9f4d414640 1 --2- 172.21.15.18:0/4217399969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f481617e0 0x7f9f48161c60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9f4000a7c0 tx=0x7f9f480d07a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:04.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.849+0000 7f9f457fa640 1 -- 172.21.15.18:0/4217399969 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f40001f70 con 0x7f9f481617e0 2024-09-19T09:14:04.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.849+0000 7f9f457fa640 1 -- 172.21.15.18:0/4217399969 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f4000a3f0 con 0x7f9f481617e0 2024-09-19T09:14:04.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.849+0000 7f9f4ee77640 1 -- 172.21.15.18:0/4217399969 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f481f4d90 con 0x7f9f481617e0 2024-09-19T09:14:04.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.849+0000 7f9f457fa640 1 -- 172.21.15.18:0/4217399969 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f40004da0 con 0x7f9f481617e0 2024-09-19T09:14:04.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.849+0000 7f9f4ee77640 1 -- 172.21.15.18:0/4217399969 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f481f5030 con 0x7f9f481617e0 2024-09-19T09:14:04.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.850+0000 7f9f4ee77640 1 -- 172.21.15.18:0/4217399969 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f480d3490 con 0x7f9f481617e0 2024-09-19T09:14:04.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.850+0000 7f9f457fa640 1 -- 172.21.15.18:0/4217399969 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9f40034470 con 0x7f9f481617e0 2024-09-19T09:14:04.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.851+0000 7f9f457fa640 1 --2- 172.21.15.18:0/4217399969 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9f3406c2b0 0x7f9f3406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:04.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.851+0000 7f9f457fa640 1 -- 172.21.15.18:0/4217399969 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f9f400ab240 con 0x7f9f481617e0 2024-09-19T09:14:04.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.851+0000 7f9f4cc13640 1 --2- 172.21.15.18:0/4217399969 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9f3406c2b0 0x7f9f3406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:04.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.851+0000 7f9f4cc13640 1 --2- 172.21.15.18:0/4217399969 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9f3406c2b0 0x7f9f3406e770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9f38000c00 tx=0x7f9f38009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:04.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:04.855+0000 7f9f457fa640 1 -- 172.21.15.18:0/4217399969 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9f40033e90 con 0x7f9f481617e0 2024-09-19T09:14:05.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.032+0000 7f9f4ee77640 1 -- 172.21.15.18:0/4217399969 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f9f480b31b0 con 0x7f9f481617e0 2024-09-19T09:14:05.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.784+0000 7f9f457fa640 1 -- 172.21.15.18:0/4217399969 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) ==== 138+0+0 (secure 0 0 0) 0x7f9f40079db0 con 0x7f9f481617e0 2024-09-19T09:14:05.786 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' created 2024-09-19T09:14:05.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.787+0000 7f9f4ee77640 1 -- 172.21.15.18:0/4217399969 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9f3406c2b0 msgr2=0x7f9f3406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:05.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.787+0000 7f9f4ee77640 1 --2- 172.21.15.18:0/4217399969 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9f3406c2b0 0x7f9f3406e770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9f38000c00 tx=0x7f9f38009040 comp rx=0 tx=0).stop 2024-09-19T09:14:05.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.787+0000 7f9f4ee77640 1 -- 172.21.15.18:0/4217399969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f481617e0 msgr2=0x7f9f48161c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:05.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.787+0000 7f9f4ee77640 1 --2- 172.21.15.18:0/4217399969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f481617e0 0x7f9f48161c60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9f4000a7c0 tx=0x7f9f480d07a0 comp rx=0 tx=0).stop 2024-09-19T09:14:05.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.788+0000 7f9f4ee77640 1 -- 172.21.15.18:0/4217399969 shutdown_connections 2024-09-19T09:14:05.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.788+0000 7f9f4ee77640 1 --2- 172.21.15.18:0/4217399969 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9f3406c2b0 0x7f9f3406e770 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:05.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.788+0000 7f9f4ee77640 1 --2- 172.21.15.18:0/4217399969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9f481617e0 0x7f9f48161c60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:05.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.788+0000 7f9f4ee77640 1 --2- 172.21.15.18:0/4217399969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f4815b420 0x7f9f4815b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:05.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.788+0000 7f9f4ee77640 1 --2- 172.21.15.18:0/4217399969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9f300051c0 0x7f9f48157a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:05.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.788+0000 7f9f4ee77640 1 -- 172.21.15.18:0/4217399969 >> 172.21.15.18:0/4217399969 conn(0x7f9f480d4c60 msgr2=0x7f9f480b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:05.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.788+0000 7f9f4ee77640 1 -- 172.21.15.18:0/4217399969 shutdown_connections 2024-09-19T09:14:05.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.788+0000 7f9f4ee77640 1 -- 172.21.15.18:0/4217399969 wait complete. 2024-09-19T09:14:05.804 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T09:14:05.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.919+0000 7fc9157bd640 1 Processor -- start 2024-09-19T09:14:05.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.919+0000 7fc9157bd640 1 -- start start 2024-09-19T09:14:05.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.920+0000 7fc9157bd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9100ce000 0x7fc9100ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:05.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.920+0000 7fc9157bd640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9100cd560 con 0x7fc91015d1b0 2024-09-19T09:14:05.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.920+0000 7fc9157bd640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9100b53b0 con 0x7fc9100b1b80 2024-09-19T09:14:05.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.920+0000 7fc9157bd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc91015d000 con 0x7fc9100ce000 2024-09-19T09:14:05.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.920+0000 7fc90effd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc91015d1b0 0x7fc91015d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38428/0 (socket says 172.21.15.18:38428) 2024-09-19T09:14:05.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.920+0000 7fc90effd640 1 -- 172.21.15.18:0/3505736175 learned_addr learned my addr 172.21.15.18:0/3505736175 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:05.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.921+0000 7fc90dffb640 1 -- 172.21.15.18:0/3505736175 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1687088364 0 0) 0x7fc9100cd560 con 0x7fc91015d1b0 2024-09-19T09:14:05.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.921+0000 7fc90f7fe640 1 --2- 172.21.15.18:0/3505736175 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9100ce000 0x7fc9100ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:05.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.921+0000 7fc90dffb640 1 -- 172.21.15.18:0/3505736175 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8f8003520 con 0x7fc91015d1b0 2024-09-19T09:14:05.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.921+0000 7fc90dffb640 1 -- 172.21.15.18:0/3505736175 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 928751984 0 0) 0x7fc8f8003520 con 0x7fc91015d1b0 2024-09-19T09:14:05.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.921+0000 7fc90dffb640 1 -- 172.21.15.18:0/3505736175 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9100ce000 msgr2=0x7fc9100ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:05.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.921+0000 7fc90dffb640 1 --2- 172.21.15.18:0/3505736175 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9100ce000 0x7fc9100ce490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:05.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.921+0000 7fc90dffb640 1 -- 172.21.15.18:0/3505736175 >> v1:172.21.15.162:6789/0 conn(0x7fc9100b1b80 legacy=0x7fc9100d0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:05.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.921+0000 7fc90dffb640 1 -- 172.21.15.18:0/3505736175 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9100cfd50 con 0x7fc91015d1b0 2024-09-19T09:14:05.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.921+0000 7fc90dffb640 1 -- 172.21.15.18:0/3505736175 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fc908001670 con 0x7fc91015d1b0 2024-09-19T09:14:05.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.921+0000 7fc90dffb640 1 -- 172.21.15.18:0/3505736175 >> v1:172.21.15.18:6789/0 conn(0x7fc91015d1b0 legacy=0x7fc91015d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:05.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.921+0000 7fc90dffb640 1 --2- 172.21.15.18:0/3505736175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8f80039e0 0x7fc8f8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:05.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.921+0000 7fc90dffb640 1 --2- 172.21.15.18:0/3505736175 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9100ce000 0x7fc8f8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:05.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.921+0000 7fc90dffb640 1 --2- 172.21.15.18:0/3505736175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8f8004d40 0x7fc8f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:05.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.921+0000 7fc90dffb640 1 -- 172.21.15.18:0/3505736175 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc91015d000 con 0x7fc8f80039e0 2024-09-19T09:14:05.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.921+0000 7fc90dffb640 1 -- 172.21.15.18:0/3505736175 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f800bb20 con 0x7fc8f8004d40 2024-09-19T09:14:05.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.921+0000 7fc90dffb640 1 -- 172.21.15.18:0/3505736175 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc8f800bd20 con 0x7fc9100ce000 2024-09-19T09:14:05.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.921+0000 7fc90effd640 1 --2- 172.21.15.18:0/3505736175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8f80039e0 0x7fc8f8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:05.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.921+0000 7fc90e7fc640 1 --2- 172.21.15.18:0/3505736175 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9100ce000 0x7fc8f8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:05.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.921+0000 7fc90f7fe640 1 --2- 172.21.15.18:0/3505736175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8f8004d40 0x7fc8f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:05.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.922+0000 7fc90effd640 1 -- 172.21.15.18:0/3505736175 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9100ce000 msgr2=0x7fc8f8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:05.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.922+0000 7fc90effd640 1 --2- 172.21.15.18:0/3505736175 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9100ce000 0x7fc8f8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:05.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.922+0000 7fc90effd640 1 -- 172.21.15.18:0/3505736175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8f8004d40 msgr2=0x7fc8f80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:05.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.922+0000 7fc90effd640 1 --2- 172.21.15.18:0/3505736175 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8f8004d40 0x7fc8f80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:05.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.922+0000 7fc90effd640 1 -- 172.21.15.18:0/3505736175 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f8003520 con 0x7fc8f80039e0 2024-09-19T09:14:05.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.922+0000 7fc90e7fc640 1 --2- 172.21.15.18:0/3505736175 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9100ce000 0x7fc8f8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:05.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.922+0000 7fc90effd640 1 --2- 172.21.15.18:0/3505736175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8f80039e0 0x7fc8f8003e00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc90800c210 tx=0x7fc8f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f74ee4d35bea2f73 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:05.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.922+0000 7fc90dffb640 1 -- 172.21.15.18:0/3505736175 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc908007d30 con 0x7fc8f80039e0 2024-09-19T09:14:05.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.922+0000 7fc90dffb640 1 -- 172.21.15.18:0/3505736175 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc908005af0 con 0x7fc8f80039e0 2024-09-19T09:14:05.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.922+0000 7fc90dffb640 1 -- 172.21.15.18:0/3505736175 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc908007070 con 0x7fc8f80039e0 2024-09-19T09:14:05.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.923+0000 7fc9157bd640 1 -- 172.21.15.18:0/3505736175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8f80039e0 msgr2=0x7fc8f8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:05.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.923+0000 7fc9157bd640 1 --2- 172.21.15.18:0/3505736175 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8f80039e0 0x7fc8f8003e00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc90800c210 tx=0x7fc8f8005830 comp rx=0 tx=0).stop 2024-09-19T09:14:05.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.923+0000 7fc90f7fe640 1 -- 172.21.15.18:0/3505736175 reap_dead start 2024-09-19T09:14:05.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.923+0000 7fc9157bd640 1 -- 172.21.15.18:0/3505736175 shutdown_connections 2024-09-19T09:14:05.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.923+0000 7fc9157bd640 1 -- 172.21.15.18:0/3505736175 >> 172.21.15.18:0/3505736175 conn(0x7fc9100b4560 msgr2=0x7fc9100b4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:05.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.923+0000 7fc9157bd640 1 -- 172.21.15.18:0/3505736175 shutdown_connections 2024-09-19T09:14:05.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.923+0000 7fc9157bd640 1 -- 172.21.15.18:0/3505736175 wait complete. 2024-09-19T09:14:05.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.924+0000 7fc9157bd640 1 Processor -- start 2024-09-19T09:14:05.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.924+0000 7fc9157bd640 1 -- start start 2024-09-19T09:14:05.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.925+0000 7fc9157bd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8f80039e0 0x7fc9100b8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:05.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.925+0000 7fc9157bd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc910160c70 0x7fc9100c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:05.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.925+0000 7fc9157bd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9100cb330 0x7fc910159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:05.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.925+0000 7fc9157bd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc9100cd800 con 0x7fc910160c70 2024-09-19T09:14:05.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.925+0000 7fc9157bd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc9100cdb70 con 0x7fc8f80039e0 2024-09-19T09:14:05.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.925+0000 7fc9157bd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc9100d0d30 con 0x7fc9100cb330 2024-09-19T09:14:05.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.925+0000 7fc90e7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc910160c70 0x7fc9100c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:05.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.925+0000 7fc90e7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc910160c70 0x7fc9100c9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53690/0 (socket says 172.21.15.18:53690) 2024-09-19T09:14:05.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.925+0000 7fc90e7fc640 1 -- 172.21.15.18:0/3763295745 learned_addr learned my addr 172.21.15.18:0/3763295745 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:05.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.925+0000 7fc90f7fe640 1 --2- 172.21.15.18:0/3763295745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9100cb330 0x7fc910159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:05.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.925+0000 7fc90effd640 1 --2- 172.21.15.18:0/3763295745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8f80039e0 0x7fc9100b8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:05.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.926+0000 7fc90e7fc640 1 -- 172.21.15.18:0/3763295745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9100cb330 msgr2=0x7fc910159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:05.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.926+0000 7fc90e7fc640 1 --2- 172.21.15.18:0/3763295745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9100cb330 0x7fc910159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:05.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.926+0000 7fc90e7fc640 1 -- 172.21.15.18:0/3763295745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8f80039e0 msgr2=0x7fc9100b8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:05.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.926+0000 7fc90e7fc640 1 --2- 172.21.15.18:0/3763295745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8f80039e0 0x7fc9100b8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:05.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.926+0000 7fc90e7fc640 1 -- 172.21.15.18:0/3763295745 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9100ca290 con 0x7fc910160c70 2024-09-19T09:14:05.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.926+0000 7fc90f7fe640 1 --2- 172.21.15.18:0/3763295745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9100cb330 0x7fc910159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:05.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.926+0000 7fc90effd640 1 --2- 172.21.15.18:0/3763295745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8f80039e0 0x7fc9100b8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:05.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.926+0000 7fc90e7fc640 1 --2- 172.21.15.18:0/3763295745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc910160c70 0x7fc9100c9b20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc90400e550 tx=0x7fc90400ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:05.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.926+0000 7fc8f77fe640 1 -- 172.21.15.18:0/3763295745 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9040052e0 con 0x7fc910160c70 2024-09-19T09:14:05.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.926+0000 7fc8f77fe640 1 -- 172.21.15.18:0/3763295745 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc904018070 con 0x7fc910160c70 2024-09-19T09:14:05.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.926+0000 7fc9157bd640 1 -- 172.21.15.18:0/3763295745 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9100ca570 con 0x7fc910160c70 2024-09-19T09:14:05.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.926+0000 7fc8f77fe640 1 -- 172.21.15.18:0/3763295745 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc904003830 con 0x7fc910160c70 2024-09-19T09:14:05.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.926+0000 7fc9157bd640 1 -- 172.21.15.18:0/3763295745 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9100cab30 con 0x7fc910160c70 2024-09-19T09:14:05.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.927+0000 7fc9157bd640 1 -- 172.21.15.18:0/3763295745 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9100cf9e0 con 0x7fc910160c70 2024-09-19T09:14:05.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.928+0000 7fc8f77fe640 1 -- 172.21.15.18:0/3763295745 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc9040039d0 con 0x7fc910160c70 2024-09-19T09:14:05.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.928+0000 7fc8f77fe640 1 --2- 172.21.15.18:0/3763295745 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc8fc06c2e0 0x7fc8fc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:05.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.928+0000 7fc8f77fe640 1 -- 172.21.15.18:0/3763295745 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5227+0+0 (secure 0 0 0) 0x7fc90408aeb0 con 0x7fc910160c70 2024-09-19T09:14:05.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.928+0000 7fc90effd640 1 --2- 172.21.15.18:0/3763295745 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc8fc06c2e0 0x7fc8fc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:05.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.929+0000 7fc90effd640 1 --2- 172.21.15.18:0/3763295745 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc8fc06c2e0 0x7fc8fc06e7a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc908032000 tx=0x7fc908009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:05.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:05.933+0000 7fc8f77fe640 1 -- 172.21.15.18:0/3763295745 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc904059890 con 0x7fc910160c70 2024-09-19T09:14:06.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.113+0000 7fc9157bd640 1 -- 172.21.15.18:0/3763295745 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc9100c5f60 con 0x7fc910160c70 2024-09-19T09:14:06.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.789+0000 7fc8f77fe640 1 -- 172.21.15.18:0/3763295745 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) ==== 170+0+0 (secure 0 0 0) 0x7fc904059190 con 0x7fc910160c70 2024-09-19T09:14:06.791 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' created 2024-09-19T09:14:06.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.792+0000 7fc9157bd640 1 -- 172.21.15.18:0/3763295745 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc8fc06c2e0 msgr2=0x7fc8fc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:06.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.792+0000 7fc9157bd640 1 --2- 172.21.15.18:0/3763295745 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc8fc06c2e0 0x7fc8fc06e7a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc908032000 tx=0x7fc908009030 comp rx=0 tx=0).stop 2024-09-19T09:14:06.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.792+0000 7fc9157bd640 1 -- 172.21.15.18:0/3763295745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc910160c70 msgr2=0x7fc9100c9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:06.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.792+0000 7fc9157bd640 1 --2- 172.21.15.18:0/3763295745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc910160c70 0x7fc9100c9b20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc90400e550 tx=0x7fc90400ea10 comp rx=0 tx=0).stop 2024-09-19T09:14:06.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.792+0000 7fc9157bd640 1 -- 172.21.15.18:0/3763295745 shutdown_connections 2024-09-19T09:14:06.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.792+0000 7fc9157bd640 1 --2- 172.21.15.18:0/3763295745 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc8fc06c2e0 0x7fc8fc06e7a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:06.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.792+0000 7fc9157bd640 1 --2- 172.21.15.18:0/3763295745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9100cb330 0x7fc910159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:06.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.792+0000 7fc9157bd640 1 --2- 172.21.15.18:0/3763295745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc910160c70 0x7fc9100c9b20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:06.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.792+0000 7fc9157bd640 1 --2- 172.21.15.18:0/3763295745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8f80039e0 0x7fc9100b8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:06.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.792+0000 7fc9157bd640 1 -- 172.21.15.18:0/3763295745 >> 172.21.15.18:0/3763295745 conn(0x7fc9100b4560 msgr2=0x7fc9100b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:06.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.792+0000 7fc9157bd640 1 -- 172.21.15.18:0/3763295745 shutdown_connections 2024-09-19T09:14:06.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.793+0000 7fc9157bd640 1 -- 172.21.15.18:0/3763295745 wait complete. 2024-09-19T09:14:06.814 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T09:14:06.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.923+0000 7f7603423640 1 Processor -- start 2024-09-19T09:14:06.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.924+0000 7f7603423640 1 -- start start 2024-09-19T09:14:06.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.924+0000 7f7603423640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75fc1623c0 0x7f75fc0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:06.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.924+0000 7f7603423640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f75fc0d56b0 0x7f75fc0d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:06.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.924+0000 7f7603423640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f75fc0d0a50 0x7f75fc0d1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:06.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.924+0000 7f7603423640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f75fc0d21a0 con 0x7f75fc0d56b0 2024-09-19T09:14:06.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.924+0000 7f7603423640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f75fc0d0080 con 0x7f75fc0d0a50 2024-09-19T09:14:06.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.924+0000 7f7603423640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f75fc0d3700 con 0x7f75fc1623c0 2024-09-19T09:14:06.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.925+0000 7f76009be640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f75fc0d56b0 0x7f75fc0d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:06.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.925+0000 7f76009be640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f75fc0d56b0 0x7f75fc0d0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53702/0 (socket says 172.21.15.18:53702) 2024-09-19T09:14:06.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.925+0000 7f76009be640 1 -- 172.21.15.18:0/85587218 learned_addr learned my addr 172.21.15.18:0/85587218 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:06.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.925+0000 7f76011bf640 1 --2- 172.21.15.18:0/85587218 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75fc1623c0 0x7f75fc0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:06.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.925+0000 7f76019c0640 1 --2- 172.21.15.18:0/85587218 >> v2:172.21.15.162:3300/0 conn(0x7f75fc0d0a50 0x7f75fc0d1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:06.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.925+0000 7f76009be640 1 -- 172.21.15.18:0/85587218 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75fc1623c0 msgr2=0x7f75fc0b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:06.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.925+0000 7f76009be640 1 --2- 172.21.15.18:0/85587218 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75fc1623c0 0x7f75fc0b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:06.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.925+0000 7f76009be640 1 -- 172.21.15.18:0/85587218 >> v2:172.21.15.162:3300/0 conn(0x7f75fc0d0a50 msgr2=0x7f75fc0d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:06.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.925+0000 7f76009be640 1 --2- 172.21.15.18:0/85587218 >> v2:172.21.15.162:3300/0 conn(0x7f75fc0d0a50 0x7f75fc0d1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:06.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.925+0000 7f76009be640 1 -- 172.21.15.18:0/85587218 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75fc0cfa70 con 0x7f75fc0d56b0 2024-09-19T09:14:06.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.926+0000 7f76009be640 1 --2- 172.21.15.18:0/85587218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75fc0d56b0 0x7f75fc0d0510 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0cfff0 tx=0x7f75ec02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed80b92d860e8f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:06.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.926+0000 7f75f3fff640 1 -- 172.21.15.18:0/85587218 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ec037070 con 0x7f75fc0d56b0 2024-09-19T09:14:06.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.926+0000 7f75f3fff640 1 -- 172.21.15.18:0/85587218 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75ec032440 con 0x7f75fc0d56b0 2024-09-19T09:14:06.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.926+0000 7f75f3fff640 1 -- 172.21.15.18:0/85587218 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75ec032810 con 0x7f75fc0d56b0 2024-09-19T09:14:06.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.926+0000 7f7603423640 1 -- 172.21.15.18:0/85587218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75fc0d56b0 msgr2=0x7f75fc0d0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:06.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.926+0000 7f7603423640 1 --2- 172.21.15.18:0/85587218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75fc0d56b0 0x7f75fc0d0510 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f75fc0cfff0 tx=0x7f75ec02a1e0 comp rx=0 tx=0).stop 2024-09-19T09:14:06.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.926+0000 7f7603423640 1 -- 172.21.15.18:0/85587218 shutdown_connections 2024-09-19T09:14:06.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.926+0000 7f7603423640 1 --2- 172.21.15.18:0/85587218 >> v2:172.21.15.162:3300/0 conn(0x7f75fc0d0a50 0x7f75fc0d1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:06.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.926+0000 7f7603423640 1 --2- 172.21.15.18:0/85587218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75fc0d56b0 0x7f75fc0d0510 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:06.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.926+0000 7f7603423640 1 --2- 172.21.15.18:0/85587218 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75fc1623c0 0x7f75fc0b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:06.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.926+0000 7f7603423640 1 -- 172.21.15.18:0/85587218 >> 172.21.15.18:0/85587218 conn(0x7f75fc09df30 msgr2=0x7f75fc0d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:06.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.927+0000 7f7603423640 1 -- 172.21.15.18:0/85587218 shutdown_connections 2024-09-19T09:14:06.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.927+0000 7f7603423640 1 -- 172.21.15.18:0/85587218 wait complete. 2024-09-19T09:14:06.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.928+0000 7f7603423640 1 Processor -- start 2024-09-19T09:14:06.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.928+0000 7f7603423640 1 -- start start 2024-09-19T09:14:06.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.929+0000 7f7603423640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75fc0d56b0 0x7f75fc0ca720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:06.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.929+0000 7f7603423640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75fc1623c0 0x7f75fc14b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:06.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.929+0000 7f7603423640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75fc0c9840 0x7f75fc1588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:06.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.929+0000 7f7603423640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f75fc1627a0 con 0x7f75fc0c9840 2024-09-19T09:14:06.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.929+0000 7f7603423640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f75fc0cfd10 con 0x7f75fc1623c0 2024-09-19T09:14:06.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.929+0000 7f7603423640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f75fc0d3c80 con 0x7f75fc0d56b0 2024-09-19T09:14:06.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.929+0000 7f76019c0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75fc0c9840 0x7f75fc1588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:06.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.929+0000 7f76019c0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75fc0c9840 0x7f75fc1588d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53712/0 (socket says 172.21.15.18:53712) 2024-09-19T09:14:06.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.929+0000 7f76019c0640 1 -- 172.21.15.18:0/1925751564 learned_addr learned my addr 172.21.15.18:0/1925751564 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:06.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.929+0000 7f76009be640 1 --2- 172.21.15.18:0/1925751564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75fc1623c0 0x7f75fc14b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:06.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.929+0000 7f76011bf640 1 --2- 172.21.15.18:0/1925751564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75fc0d56b0 0x7f75fc0ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:06.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.929+0000 7f76019c0640 1 -- 172.21.15.18:0/1925751564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75fc0d56b0 msgr2=0x7f75fc0ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:06.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.929+0000 7f76019c0640 1 --2- 172.21.15.18:0/1925751564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75fc0d56b0 0x7f75fc0ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:06.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.929+0000 7f76019c0640 1 -- 172.21.15.18:0/1925751564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75fc1623c0 msgr2=0x7f75fc14b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:06.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.929+0000 7f76019c0640 1 --2- 172.21.15.18:0/1925751564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75fc1623c0 0x7f75fc14b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:06.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.929+0000 7f76019c0640 1 -- 172.21.15.18:0/1925751564 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75fc0b8750 con 0x7f75fc0c9840 2024-09-19T09:14:06.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.929+0000 7f76019c0640 1 --2- 172.21.15.18:0/1925751564 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75fc0c9840 0x7f75fc1588d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f75f4007e30 tx=0x7f75f400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:06.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.929+0000 7f75f1ffb640 1 -- 172.21.15.18:0/1925751564 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f4014420 con 0x7f75fc0c9840 2024-09-19T09:14:06.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.929+0000 7f75f1ffb640 1 -- 172.21.15.18:0/1925751564 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75f4019070 con 0x7f75fc0c9840 2024-09-19T09:14:06.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.929+0000 7f75f1ffb640 1 -- 172.21.15.18:0/1925751564 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75f4014800 con 0x7f75fc0c9840 2024-09-19T09:14:06.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.929+0000 7f7603423640 1 -- 172.21.15.18:0/1925751564 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75fc0b7d90 con 0x7f75fc0c9840 2024-09-19T09:14:06.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.930+0000 7f7603423640 1 -- 172.21.15.18:0/1925751564 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75fc0cadf0 con 0x7f75fc0c9840 2024-09-19T09:14:06.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.931+0000 7f7603423640 1 -- 172.21.15.18:0/1925751564 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75fc0d0510 con 0x7f75fc0c9840 2024-09-19T09:14:06.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.931+0000 7f75f1ffb640 1 -- 172.21.15.18:0/1925751564 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f75f40149a0 con 0x7f75fc0c9840 2024-09-19T09:14:06.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.931+0000 7f75f1ffb640 1 --2- 172.21.15.18:0/1925751564 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f75e006c2e0 0x7f75e006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:06.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.932+0000 7f75f1ffb640 1 -- 172.21.15.18:0/1925751564 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5609+0+0 (secure 0 0 0) 0x7f75f408bb00 con 0x7f75fc0c9840 2024-09-19T09:14:06.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.932+0000 7f76011bf640 1 --2- 172.21.15.18:0/1925751564 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f75e006c2e0 0x7f75e006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:06.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.933+0000 7f76011bf640 1 --2- 172.21.15.18:0/1925751564 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f75e006c2e0 0x7f75e006e7a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f75f80079a0 tx=0x7f75f8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:06.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:06.936+0000 7f75f1ffb640 1 -- 172.21.15.18:0/1925751564 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f75f4059be0 con 0x7f75fc0c9840 2024-09-19T09:14:07.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.152+0000 7f7603423640 1 -- 172.21.15.18:0/1925751564 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f75fc15fbe0 con 0x7f75fc0c9840 2024-09-19T09:14:07.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.815+0000 7f75f1ffb640 1 -- 172.21.15.18:0/1925751564 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) ==== 172+0+0 (secure 0 0 0) 0x7f75f408be20 con 0x7f75fc0c9840 2024-09-19T09:14:07.818 INFO:teuthology.orchestra.run.smithi018.stderr:new fs with metadata pool 4 and data pool 5 2024-09-19T09:14:07.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.825+0000 7f7603423640 1 -- 172.21.15.18:0/1925751564 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f75e006c2e0 msgr2=0x7f75e006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:07.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.825+0000 7f7603423640 1 --2- 172.21.15.18:0/1925751564 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f75e006c2e0 0x7f75e006e7a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f75f80079a0 tx=0x7f75f8008040 comp rx=0 tx=0).stop 2024-09-19T09:14:07.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.825+0000 7f7603423640 1 -- 172.21.15.18:0/1925751564 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75fc0c9840 msgr2=0x7f75fc1588d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:07.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.825+0000 7f7603423640 1 --2- 172.21.15.18:0/1925751564 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75fc0c9840 0x7f75fc1588d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f75f4007e30 tx=0x7f75f400e4b0 comp rx=0 tx=0).stop 2024-09-19T09:14:07.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.825+0000 7f7603423640 1 -- 172.21.15.18:0/1925751564 shutdown_connections 2024-09-19T09:14:07.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.825+0000 7f7603423640 1 --2- 172.21.15.18:0/1925751564 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f75e006c2e0 0x7f75e006e7a0 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f75f80079a0 tx=0x7f75f8008040 comp rx=0 tx=0).stop 2024-09-19T09:14:07.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.825+0000 7f7603423640 1 --2- 172.21.15.18:0/1925751564 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f75fc0c9840 0x7f75fc1588d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:07.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.825+0000 7f7603423640 1 --2- 172.21.15.18:0/1925751564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f75fc1623c0 0x7f75fc14b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:07.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.825+0000 7f7603423640 1 --2- 172.21.15.18:0/1925751564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75fc0d56b0 0x7f75fc0ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:07.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.825+0000 7f7603423640 1 -- 172.21.15.18:0/1925751564 >> 172.21.15.18:0/1925751564 conn(0x7f75fc09df30 msgr2=0x7f75fc0b4e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:07.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.826+0000 7f7603423640 1 -- 172.21.15.18:0/1925751564 shutdown_connections 2024-09-19T09:14:07.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.829+0000 7f7603423640 1 -- 172.21.15.18:0/1925751564 wait complete. 2024-09-19T09:14:07.847 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:14:07.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.952+0000 7f29dfd18640 1 Processor -- start 2024-09-19T09:14:07.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.952+0000 7f29dfd18640 1 -- start start 2024-09-19T09:14:07.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.953+0000 7f29dfd18640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f29d815ef80 0x7f29d80b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:07.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.953+0000 7f29dfd18640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29d80cfae0 0x7f29d80cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:07.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.953+0000 7f29dfd18640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29d80cd1a0 con 0x7f29d806d730 2024-09-19T09:14:07.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.953+0000 7f29dfd18640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f29d80cd7d0 con 0x7f29d815ef80 2024-09-19T09:14:07.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.953+0000 7f29dfd18640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f29d806dc30 con 0x7f29d80cfae0 2024-09-19T09:14:07.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.953+0000 7f29dd2b3640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f29d806d730 0x7f29d80cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38434/0 (socket says 172.21.15.18:38434) 2024-09-19T09:14:07.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.953+0000 7f29dd2b3640 1 -- 172.21.15.18:0/331100945 learned_addr learned my addr 172.21.15.18:0/331100945 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:07.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.953+0000 7f29ddab4640 1 --2- 172.21.15.18:0/331100945 >> v2:172.21.15.162:3300/0 conn(0x7f29d815ef80 0x7f29d80b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:07.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.953+0000 7f29de2b5640 1 --2- 172.21.15.18:0/331100945 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29d80cfae0 0x7f29d80cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:07.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.953+0000 7f29dcab2640 1 -- 172.21.15.18:0/331100945 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2960745949 0 0) 0x7f29d80cd1a0 con 0x7f29d806d730 2024-09-19T09:14:07.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.953+0000 7f29dcab2640 1 -- 172.21.15.18:0/331100945 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29c4003520 con 0x7f29d806d730 2024-09-19T09:14:07.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.953+0000 7f29dcab2640 1 -- 172.21.15.18:0/331100945 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3100654680 0 0) 0x7f29c4003520 con 0x7f29d806d730 2024-09-19T09:14:07.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.953+0000 7f29ddab4640 1 -- 172.21.15.18:0/331100945 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29d80cfae0 msgr2=0x7f29d80cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:07.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.953+0000 7f29ddab4640 1 --2- 172.21.15.18:0/331100945 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29d80cfae0 0x7f29d80cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:07.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.953+0000 7f29ddab4640 1 -- 172.21.15.18:0/331100945 >> v1:172.21.15.18:6789/0 conn(0x7f29d806d730 legacy=0x7f29d80cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:07.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.953+0000 7f29ddab4640 1 -- 172.21.15.18:0/331100945 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d806df10 con 0x7f29d815ef80 2024-09-19T09:14:07.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.953+0000 7f29de2b5640 1 --2- 172.21.15.18:0/331100945 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29d80cfae0 0x7f29d80cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:14:07.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.954+0000 7f29ddab4640 1 --2- 172.21.15.18:0/331100945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29d815ef80 0x7f29d80b5220 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f29d40097a0 tx=0x7f29d402a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=18701209e9a0af9c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:07.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.954+0000 7f29dcab2640 1 -- 172.21.15.18:0/331100945 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d4037070 con 0x7f29d815ef80 2024-09-19T09:14:07.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.954+0000 7f29dcab2640 1 -- 172.21.15.18:0/331100945 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d402aba0 con 0x7f29d815ef80 2024-09-19T09:14:07.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.954+0000 7f29dcab2640 1 -- 172.21.15.18:0/331100945 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c8001670 con 0x7f29d815ef80 2024-09-19T09:14:07.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.955+0000 7f29dfd18640 1 -- 172.21.15.18:0/331100945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29d815ef80 msgr2=0x7f29d80b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:07.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.955+0000 7f29dfd18640 1 --2- 172.21.15.18:0/331100945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29d815ef80 0x7f29d80b5220 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f29d40097a0 tx=0x7f29d402a110 comp rx=0 tx=0).stop 2024-09-19T09:14:07.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.955+0000 7f29dfd18640 1 -- 172.21.15.18:0/331100945 shutdown_connections 2024-09-19T09:14:07.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.955+0000 7f29dfd18640 1 --2- 172.21.15.18:0/331100945 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29d80cfae0 0x7f29d80cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:07.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.955+0000 7f29dfd18640 1 --2- 172.21.15.18:0/331100945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29d815ef80 0x7f29d80b5220 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:07.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.955+0000 7f29dfd18640 1 -- 172.21.15.18:0/331100945 >> 172.21.15.18:0/331100945 conn(0x7f29d80b4700 msgr2=0x7f29d80b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:07.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.955+0000 7f29dfd18640 1 -- 172.21.15.18:0/331100945 shutdown_connections 2024-09-19T09:14:07.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.955+0000 7f29dfd18640 1 -- 172.21.15.18:0/331100945 wait complete. 2024-09-19T09:14:07.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.956+0000 7f29dfd18640 1 Processor -- start 2024-09-19T09:14:07.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.956+0000 7f29dfd18640 1 -- start start 2024-09-19T09:14:07.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.957+0000 7f29dfd18640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29d806d730 0x7f29d81f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:07.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.957+0000 7f29dfd18640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29d80cfae0 0x7f29d8157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:07.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.957+0000 7f29dfd18640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29d815ef80 0x7f29d80b8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:07.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.957+0000 7f29dfd18640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f29d80d0120 con 0x7f29d806d730 2024-09-19T09:14:07.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.957+0000 7f29dfd18640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f29d815f360 con 0x7f29d815ef80 2024-09-19T09:14:07.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.957+0000 7f29dfd18640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f29d80ce1a0 con 0x7f29d80cfae0 2024-09-19T09:14:07.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.957+0000 7f29ddab4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29d806d730 0x7f29d81f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:07.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.957+0000 7f29ddab4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29d806d730 0x7f29d81f5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53728/0 (socket says 172.21.15.18:53728) 2024-09-19T09:14:07.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.957+0000 7f29ddab4640 1 -- 172.21.15.18:0/4110598171 learned_addr learned my addr 172.21.15.18:0/4110598171 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:07.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.957+0000 7f29dd2b3640 1 --2- 172.21.15.18:0/4110598171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29d80cfae0 0x7f29d8157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:07.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.957+0000 7f29de2b5640 1 --2- 172.21.15.18:0/4110598171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29d815ef80 0x7f29d80b8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:07.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.958+0000 7f29ddab4640 1 -- 172.21.15.18:0/4110598171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29d80cfae0 msgr2=0x7f29d8157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:07.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.958+0000 7f29ddab4640 1 --2- 172.21.15.18:0/4110598171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29d80cfae0 0x7f29d8157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:07.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.958+0000 7f29ddab4640 1 -- 172.21.15.18:0/4110598171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29d815ef80 msgr2=0x7f29d80b8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:07.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.958+0000 7f29ddab4640 1 --2- 172.21.15.18:0/4110598171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29d815ef80 0x7f29d80b8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:07.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.958+0000 7f29ddab4640 1 -- 172.21.15.18:0/4110598171 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d81f60c0 con 0x7f29d806d730 2024-09-19T09:14:07.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.958+0000 7f29ddab4640 1 --2- 172.21.15.18:0/4110598171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29d806d730 0x7f29d81f5b80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f29d4035040 tx=0x7f29d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:07.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.958+0000 7f29ce7fc640 1 -- 172.21.15.18:0/4110598171 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d4037050 con 0x7f29d806d730 2024-09-19T09:14:07.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.958+0000 7f29ce7fc640 1 -- 172.21.15.18:0/4110598171 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d4043070 con 0x7f29d806d730 2024-09-19T09:14:07.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.958+0000 7f29dfd18640 1 -- 172.21.15.18:0/4110598171 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29d80ca490 con 0x7f29d806d730 2024-09-19T09:14:07.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.958+0000 7f29ce7fc640 1 -- 172.21.15.18:0/4110598171 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d4006e10 con 0x7f29d806d730 2024-09-19T09:14:07.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.958+0000 7f29dfd18640 1 -- 172.21.15.18:0/4110598171 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29d80ca1b0 con 0x7f29d806d730 2024-09-19T09:14:07.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.959+0000 7f29dfd18640 1 -- 172.21.15.18:0/4110598171 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29d80cff00 con 0x7f29d806d730 2024-09-19T09:14:07.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.959+0000 7f29ce7fc640 1 -- 172.21.15.18:0/4110598171 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f29d403ca50 con 0x7f29d806d730 2024-09-19T09:14:07.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.960+0000 7f29ce7fc640 1 --2- 172.21.15.18:0/4110598171 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f29bc06c2b0 0x7f29bc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:07.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.960+0000 7f29ce7fc640 1 -- 172.21.15.18:0/4110598171 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f29d40ac090 con 0x7f29d806d730 2024-09-19T09:14:07.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.960+0000 7f29dd2b3640 1 --2- 172.21.15.18:0/4110598171 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f29bc06c2b0 0x7f29bc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:07.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.961+0000 7f29dd2b3640 1 --2- 172.21.15.18:0/4110598171 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f29bc06c2b0 0x7f29bc06e770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f29d815c0c0 tx=0x7f29c80057f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:07.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:07.964+0000 7f29ce7fc640 1 -- 172.21.15.18:0/4110598171 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f29d407a920 con 0x7f29d806d730 2024-09-19T09:14:08.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.140+0000 7f29dfd18640 1 -- 172.21.15.18:0/4110598171 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29d80cd1a0 con 0x7f29d806d730 2024-09-19T09:14:08.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.141+0000 7f29ce7fc640 1 -- 172.21.15.18:0/4110598171 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16694 (secure 0 0 0) 0x7f29d407a220 con 0x7f29d806d730 2024-09-19T09:14:08.143 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:08.143 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":31,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:14:07.154333+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:14:05.064029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-19T09:14:06.144818+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:14:08.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.143+0000 7f29dfd18640 1 -- 172.21.15.18:0/4110598171 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f29bc06c2b0 msgr2=0x7f29bc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:08.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.143+0000 7f29dfd18640 1 --2- 172.21.15.18:0/4110598171 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f29bc06c2b0 0x7f29bc06e770 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f29d815c0c0 tx=0x7f29c80057f0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.143+0000 7f29dfd18640 1 -- 172.21.15.18:0/4110598171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29d806d730 msgr2=0x7f29d81f5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:08.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.143+0000 7f29dfd18640 1 --2- 172.21.15.18:0/4110598171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29d806d730 0x7f29d81f5b80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f29d4035040 tx=0x7f29d40046c0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.143+0000 7f29dfd18640 1 -- 172.21.15.18:0/4110598171 shutdown_connections 2024-09-19T09:14:08.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.143+0000 7f29dfd18640 1 --2- 172.21.15.18:0/4110598171 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f29bc06c2b0 0x7f29bc06e770 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.143+0000 7f29dfd18640 1 --2- 172.21.15.18:0/4110598171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29d815ef80 0x7f29d80b8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.143+0000 7f29dfd18640 1 --2- 172.21.15.18:0/4110598171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f29d80cfae0 0x7f29d8157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.143+0000 7f29dfd18640 1 --2- 172.21.15.18:0/4110598171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f29d806d730 0x7f29d81f5b80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.143+0000 7f29dfd18640 1 -- 172.21.15.18:0/4110598171 >> 172.21.15.18:0/4110598171 conn(0x7f29d80b4700 msgr2=0x7f29d80d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:08.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.143+0000 7f29dfd18640 1 -- 172.21.15.18:0/4110598171 shutdown_connections 2024-09-19T09:14:08.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.143+0000 7f29dfd18640 1 -- 172.21.15.18:0/4110598171 wait complete. 2024-09-19T09:14:08.156 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:14:08.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.257+0000 7fbd2e682640 1 Processor -- start 2024-09-19T09:14:08.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.257+0000 7fbd2e682640 1 -- start start 2024-09-19T09:14:08.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.258+0000 7fbd2e682640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd2806d730 0x7fbd280b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:08.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.258+0000 7fbd2e682640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd280cd1a0 con 0x7fbd280cfae0 2024-09-19T09:14:08.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.258+0000 7fbd2e682640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd2806dc30 con 0x7fbd2815ef80 2024-09-19T09:14:08.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.258+0000 7fbd2e682640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbd280cd7d0 con 0x7fbd2806d730 2024-09-19T09:14:08.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.258+0000 7fbd277fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fbd280cfae0 0x7fbd280cdc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38436/0 (socket says 172.21.15.18:38436) 2024-09-19T09:14:08.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.258+0000 7fbd277fe640 1 -- 172.21.15.18:0/4225737663 learned_addr learned my addr 172.21.15.18:0/4225737663 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:08.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.258+0000 7fbd2cc1f640 1 --2- 172.21.15.18:0/4225737663 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd2806d730 0x7fbd280b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:08.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.259+0000 7fbd26ffd640 1 -- 172.21.15.18:0/4225737663 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3377318762 0 0) 0x7fbd280cd1a0 con 0x7fbd280cfae0 2024-09-19T09:14:08.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.259+0000 7fbd26ffd640 1 -- 172.21.15.18:0/4225737663 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd10003520 con 0x7fbd280cfae0 2024-09-19T09:14:08.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.259+0000 7fbd26ffd640 1 -- 172.21.15.18:0/4225737663 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1345698532 0 0) 0x7fbd2806dc30 con 0x7fbd2815ef80 2024-09-19T09:14:08.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.259+0000 7fbd26ffd640 1 -- 172.21.15.18:0/4225737663 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd280cd1a0 con 0x7fbd2815ef80 2024-09-19T09:14:08.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.259+0000 7fbd2cc1f640 1 -- 172.21.15.18:0/4225737663 >> v1:172.21.15.162:6789/0 conn(0x7fbd2815ef80 legacy=0x7fbd280cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:08.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.259+0000 7fbd26ffd640 1 -- 172.21.15.18:0/4225737663 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 605813159 0 0) 0x7fbd10003520 con 0x7fbd280cfae0 2024-09-19T09:14:08.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.259+0000 7fbd2cc1f640 1 -- 172.21.15.18:0/4225737663 >> v1:172.21.15.18:6789/0 conn(0x7fbd280cfae0 legacy=0x7fbd280cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:08.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.259+0000 7fbd2cc1f640 1 -- 172.21.15.18:0/4225737663 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd2806df10 con 0x7fbd2806d730 2024-09-19T09:14:08.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.260+0000 7fbd2cc1f640 1 --2- 172.21.15.18:0/4225737663 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd2806d730 0x7fbd280b5220 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbd20009dc0 tx=0x7fbd2002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44296c76667b089f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:08.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.260+0000 7fbd26ffd640 1 -- 172.21.15.18:0/4225737663 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c001670 con 0x7fbd2806d730 2024-09-19T09:14:08.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.260+0000 7fbd26ffd640 1 -- 172.21.15.18:0/4225737663 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd20007540 con 0x7fbd2806d730 2024-09-19T09:14:08.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.260+0000 7fbd26ffd640 1 -- 172.21.15.18:0/4225737663 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd20007910 con 0x7fbd2806d730 2024-09-19T09:14:08.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.260+0000 7fbd2e682640 1 -- 172.21.15.18:0/4225737663 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd2806d730 msgr2=0x7fbd280b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:08.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.260+0000 7fbd2e682640 1 --2- 172.21.15.18:0/4225737663 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd2806d730 0x7fbd280b5220 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbd20009dc0 tx=0x7fbd2002a660 comp rx=0 tx=0).stop 2024-09-19T09:14:08.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.260+0000 7fbd2e682640 1 -- 172.21.15.18:0/4225737663 shutdown_connections 2024-09-19T09:14:08.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.260+0000 7fbd2e682640 1 --2- 172.21.15.18:0/4225737663 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd2806d730 0x7fbd280b5220 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.260+0000 7fbd2e682640 1 -- 172.21.15.18:0/4225737663 >> 172.21.15.18:0/4225737663 conn(0x7fbd280b4700 msgr2=0x7fbd280b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:08.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.261+0000 7fbd2e682640 1 -- 172.21.15.18:0/4225737663 shutdown_connections 2024-09-19T09:14:08.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.261+0000 7fbd2e682640 1 -- 172.21.15.18:0/4225737663 wait complete. 2024-09-19T09:14:08.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.262+0000 7fbd2e682640 1 Processor -- start 2024-09-19T09:14:08.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.262+0000 7fbd2e682640 1 -- start start 2024-09-19T09:14:08.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.263+0000 7fbd2e682640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd2806d730 0x7fbd2815b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:08.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.263+0000 7fbd2e682640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd280cfae0 0x7fbd281f7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:08.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.263+0000 7fbd2e682640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd2815ef80 0x7fbd280ca980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:08.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.263+0000 7fbd2e682640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbd280d0120 con 0x7fbd2806d730 2024-09-19T09:14:08.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.263+0000 7fbd2e682640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2815f360 con 0x7fbd280cfae0 2024-09-19T09:14:08.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.263+0000 7fbd2e682640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbd280ce370 con 0x7fbd2815ef80 2024-09-19T09:14:08.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.263+0000 7fbd27fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd2806d730 0x7fbd2815b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:08.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.263+0000 7fbd27fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd2806d730 0x7fbd2815b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53742/0 (socket says 172.21.15.18:53742) 2024-09-19T09:14:08.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.263+0000 7fbd27fff640 1 -- 172.21.15.18:0/2782146411 learned_addr learned my addr 172.21.15.18:0/2782146411 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:08.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.263+0000 7fbd2cc1f640 1 --2- 172.21.15.18:0/2782146411 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd2815ef80 0x7fbd280ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:08.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.263+0000 7fbd277fe640 1 --2- 172.21.15.18:0/2782146411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd280cfae0 0x7fbd281f7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:08.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.263+0000 7fbd27fff640 1 -- 172.21.15.18:0/2782146411 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd2815ef80 msgr2=0x7fbd280ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:08.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.263+0000 7fbd27fff640 1 --2- 172.21.15.18:0/2782146411 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd2815ef80 0x7fbd280ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.263+0000 7fbd27fff640 1 -- 172.21.15.18:0/2782146411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd280cfae0 msgr2=0x7fbd281f7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:08.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.263+0000 7fbd27fff640 1 --2- 172.21.15.18:0/2782146411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd280cfae0 0x7fbd281f7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.263+0000 7fbd27fff640 1 -- 172.21.15.18:0/2782146411 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd280c7710 con 0x7fbd2806d730 2024-09-19T09:14:08.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.263+0000 7fbd27fff640 1 --2- 172.21.15.18:0/2782146411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd2806d730 0x7fbd2815b310 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbd1800c460 tx=0x7fbd1800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:08.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.263+0000 7fbd24ff9640 1 -- 172.21.15.18:0/2782146411 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd18017070 con 0x7fbd2806d730 2024-09-19T09:14:08.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.264+0000 7fbd24ff9640 1 -- 172.21.15.18:0/2782146411 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd180052f0 con 0x7fbd2806d730 2024-09-19T09:14:08.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.264+0000 7fbd2e682640 1 -- 172.21.15.18:0/2782146411 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd280c79f0 con 0x7fbd2806d730 2024-09-19T09:14:08.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.264+0000 7fbd24ff9640 1 -- 172.21.15.18:0/2782146411 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd18003830 con 0x7fbd2806d730 2024-09-19T09:14:08.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.264+0000 7fbd2e682640 1 -- 172.21.15.18:0/2782146411 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd28160fe0 con 0x7fbd2806d730 2024-09-19T09:14:08.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.265+0000 7fbd2e682640 1 -- 172.21.15.18:0/2782146411 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd2806dc30 con 0x7fbd2806d730 2024-09-19T09:14:08.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.265+0000 7fbd24ff9640 1 -- 172.21.15.18:0/2782146411 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbd1801a070 con 0x7fbd2806d730 2024-09-19T09:14:08.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.265+0000 7fbd24ff9640 1 --2- 172.21.15.18:0/2782146411 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbd1406c2b0 0x7fbd1406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:08.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.266+0000 7fbd24ff9640 1 -- 172.21.15.18:0/2782146411 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7fbd1808a710 con 0x7fbd2806d730 2024-09-19T09:14:08.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.266+0000 7fbd277fe640 1 --2- 172.21.15.18:0/2782146411 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbd1406c2b0 0x7fbd1406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:08.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.266+0000 7fbd277fe640 1 --2- 172.21.15.18:0/2782146411 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbd1406c2b0 0x7fbd1406e770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbd2806cf90 tx=0x7fbd1c001610 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:08.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.270+0000 7fbd24ff9640 1 -- 172.21.15.18:0/2782146411 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fbd180588c0 con 0x7fbd2806d730 2024-09-19T09:14:08.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.447+0000 7fbd2e682640 1 -- 172.21.15.18:0/2782146411 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbd280cff00 con 0x7fbd2806d730 2024-09-19T09:14:08.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.448+0000 7fbd24ff9640 1 -- 172.21.15.18:0/2782146411 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16694 (secure 0 0 0) 0x7fbd1805cbc0 con 0x7fbd2806d730 2024-09-19T09:14:08.450 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:08.450 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":31,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:14:07.154333+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:14:05.064029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-19T09:14:06.144818+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:14:08.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.450+0000 7fbd2e682640 1 -- 172.21.15.18:0/2782146411 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbd1406c2b0 msgr2=0x7fbd1406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:08.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.450+0000 7fbd2e682640 1 --2- 172.21.15.18:0/2782146411 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbd1406c2b0 0x7fbd1406e770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbd2806cf90 tx=0x7fbd1c001610 comp rx=0 tx=0).stop 2024-09-19T09:14:08.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.450+0000 7fbd2e682640 1 -- 172.21.15.18:0/2782146411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd2806d730 msgr2=0x7fbd2815b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:08.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.450+0000 7fbd2e682640 1 --2- 172.21.15.18:0/2782146411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd2806d730 0x7fbd2815b310 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbd1800c460 tx=0x7fbd1800c920 comp rx=0 tx=0).stop 2024-09-19T09:14:08.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.451+0000 7fbd2e682640 1 -- 172.21.15.18:0/2782146411 shutdown_connections 2024-09-19T09:14:08.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.451+0000 7fbd2e682640 1 --2- 172.21.15.18:0/2782146411 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbd1406c2b0 0x7fbd1406e770 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.451+0000 7fbd2e682640 1 --2- 172.21.15.18:0/2782146411 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd2815ef80 0x7fbd280ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.451+0000 7fbd2e682640 1 --2- 172.21.15.18:0/2782146411 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd280cfae0 0x7fbd281f7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.451+0000 7fbd2e682640 1 --2- 172.21.15.18:0/2782146411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd2806d730 0x7fbd2815b310 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.451+0000 7fbd2e682640 1 -- 172.21.15.18:0/2782146411 >> 172.21.15.18:0/2782146411 conn(0x7fbd280b4700 msgr2=0x7fbd280d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:08.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.451+0000 7fbd2e682640 1 -- 172.21.15.18:0/2782146411 shutdown_connections 2024-09-19T09:14:08.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.451+0000 7fbd2e682640 1 -- 172.21.15.18:0/2782146411 wait complete. 2024-09-19T09:14:08.463 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-19T09:14:08.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.569+0000 7f850af5f640 1 Processor -- start 2024-09-19T09:14:08.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.569+0000 7f850af5f640 1 -- start start 2024-09-19T09:14:08.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.569+0000 7f850af5f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f850415ca40 0x7f850406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:08.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.569+0000 7f850af5f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f85040b6d90 0x7f85040d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:08.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.569+0000 7f850af5f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f85040d1650 0x7f8504073250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:08.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.569+0000 7f850af5f640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f85041607b0 con 0x7f85040b6d90 2024-09-19T09:14:08.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.569+0000 7f850af5f640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8504161610 con 0x7f850415ca40 2024-09-19T09:14:08.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.569+0000 7f850af5f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8504160a00 con 0x7f85040d1650 2024-09-19T09:14:08.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.570+0000 7f8503fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f85040b6d90 0x7f85040d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:08.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.570+0000 7f8503fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f85040b6d90 0x7f85040d1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53756/0 (socket says 172.21.15.18:53756) 2024-09-19T09:14:08.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.570+0000 7f8503fff640 1 -- 172.21.15.18:0/86736529 learned_addr learned my addr 172.21.15.18:0/86736529 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:08.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.570+0000 7f8508cfb640 1 --2- 172.21.15.18:0/86736529 >> v2:172.21.15.162:3300/0 conn(0x7f850415ca40 0x7f850406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:08.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.570+0000 7f85094fc640 1 --2- 172.21.15.18:0/86736529 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f85040d1650 0x7f8504073250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:08.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.570+0000 7f8503fff640 1 -- 172.21.15.18:0/86736529 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f85040d1650 msgr2=0x7f8504073250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:08.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.570+0000 7f8503fff640 1 --2- 172.21.15.18:0/86736529 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f85040d1650 0x7f8504073250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.570+0000 7f8503fff640 1 -- 172.21.15.18:0/86736529 >> v2:172.21.15.162:3300/0 conn(0x7f850415ca40 msgr2=0x7f850406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:08.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.570+0000 7f8503fff640 1 --2- 172.21.15.18:0/86736529 >> v2:172.21.15.162:3300/0 conn(0x7f850415ca40 0x7f850406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.570+0000 7f8503fff640 1 -- 172.21.15.18:0/86736529 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8504160ce0 con 0x7f85040b6d90 2024-09-19T09:14:08.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.570+0000 7f85094fc640 1 --2- 172.21.15.18:0/86736529 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f85040d1650 0x7f8504073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:14:08.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.570+0000 7f8508cfb640 1 --2- 172.21.15.18:0/86736529 >> v2:172.21.15.162:3300/0 conn(0x7f850415ca40 0x7f850406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:14:08.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.571+0000 7f8503fff640 1 --2- 172.21.15.18:0/86736529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85040b6d90 0x7f85040d1110 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8504071680 tx=0x7f84f002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aac7f233aecaa3f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:08.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.571+0000 7f85037fe640 1 -- 172.21.15.18:0/86736529 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f0037070 con 0x7f85040b6d90 2024-09-19T09:14:08.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.571+0000 7f85037fe640 1 -- 172.21.15.18:0/86736529 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84f0032440 con 0x7f85040b6d90 2024-09-19T09:14:08.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.571+0000 7f85037fe640 1 -- 172.21.15.18:0/86736529 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f0032810 con 0x7f85040b6d90 2024-09-19T09:14:08.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.571+0000 7f850af5f640 1 -- 172.21.15.18:0/86736529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85040b6d90 msgr2=0x7f85040d1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:08.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.571+0000 7f850af5f640 1 --2- 172.21.15.18:0/86736529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85040b6d90 0x7f85040d1110 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8504071680 tx=0x7f84f002a1e0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.572+0000 7f850af5f640 1 -- 172.21.15.18:0/86736529 shutdown_connections 2024-09-19T09:14:08.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.572+0000 7f850af5f640 1 --2- 172.21.15.18:0/86736529 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f85040d1650 0x7f8504073250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.572+0000 7f850af5f640 1 --2- 172.21.15.18:0/86736529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f85040b6d90 0x7f85040d1110 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.572+0000 7f850af5f640 1 --2- 172.21.15.18:0/86736529 >> v2:172.21.15.162:3300/0 conn(0x7f850415ca40 0x7f850406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.572+0000 7f850af5f640 1 -- 172.21.15.18:0/86736529 >> 172.21.15.18:0/86736529 conn(0x7f85040b5fc0 msgr2=0x7f85040b6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:08.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.572+0000 7f850af5f640 1 -- 172.21.15.18:0/86736529 shutdown_connections 2024-09-19T09:14:08.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.572+0000 7f850af5f640 1 -- 172.21.15.18:0/86736529 wait complete. 2024-09-19T09:14:08.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.573+0000 7f850af5f640 1 Processor -- start 2024-09-19T09:14:08.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.573+0000 7f850af5f640 1 -- start start 2024-09-19T09:14:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.574+0000 7f850af5f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f85040b6d90 0x7f850409ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.574+0000 7f850af5f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85040d1650 0x7f85041f8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.574+0000 7f850af5f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f850415ca40 0x7f850415e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.574+0000 7f850af5f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f85040d1ae0 con 0x7f850415ca40 2024-09-19T09:14:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.574+0000 7f850af5f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f85041612a0 con 0x7f85040d1650 2024-09-19T09:14:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.574+0000 7f850af5f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f85040d1c60 con 0x7f85040b6d90 2024-09-19T09:14:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.574+0000 7f85094fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f850415ca40 0x7f850415e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.574+0000 7f85094fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f850415ca40 0x7f850415e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53760/0 (socket says 172.21.15.18:53760) 2024-09-19T09:14:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.574+0000 7f85094fc640 1 -- 172.21.15.18:0/826932863 learned_addr learned my addr 172.21.15.18:0/826932863 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.574+0000 7f8503fff640 1 --2- 172.21.15.18:0/826932863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85040d1650 0x7f85041f8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.574+0000 7f8508cfb640 1 --2- 172.21.15.18:0/826932863 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f85040b6d90 0x7f850409ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:08.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.574+0000 7f85094fc640 1 -- 172.21.15.18:0/826932863 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f85040b6d90 msgr2=0x7f850409ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:08.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.574+0000 7f85094fc640 1 --2- 172.21.15.18:0/826932863 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f85040b6d90 0x7f850409ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.574+0000 7f85094fc640 1 -- 172.21.15.18:0/826932863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85040d1650 msgr2=0x7f85041f8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:08.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.574+0000 7f85094fc640 1 --2- 172.21.15.18:0/826932863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85040d1650 0x7f85041f8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.574+0000 7f85094fc640 1 -- 172.21.15.18:0/826932863 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85041f5be0 con 0x7f850415ca40 2024-09-19T09:14:08.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.574+0000 7f85094fc640 1 --2- 172.21.15.18:0/826932863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f850415ca40 0x7f850415e560 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f84fc00cef0 tx=0x7f84fc00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:08.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.574+0000 7f85017fa640 1 -- 172.21.15.18:0/826932863 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84fc01a070 con 0x7f850415ca40 2024-09-19T09:14:08.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.575+0000 7f85017fa640 1 -- 172.21.15.18:0/826932863 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84fc00d840 con 0x7f850415ca40 2024-09-19T09:14:08.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.575+0000 7f850af5f640 1 -- 172.21.15.18:0/826932863 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85041f5e50 con 0x7f850415ca40 2024-09-19T09:14:08.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.575+0000 7f85017fa640 1 -- 172.21.15.18:0/826932863 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84fc00dc30 con 0x7f850415ca40 2024-09-19T09:14:08.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.575+0000 7f850af5f640 1 -- 172.21.15.18:0/826932863 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85041f6410 con 0x7f850415ca40 2024-09-19T09:14:08.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.576+0000 7f850af5f640 1 -- 172.21.15.18:0/826932863 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85040b14c0 con 0x7f850415ca40 2024-09-19T09:14:08.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.576+0000 7f85017fa640 1 -- 172.21.15.18:0/826932863 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f84fc01d070 con 0x7f850415ca40 2024-09-19T09:14:08.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.577+0000 7f85017fa640 1 --2- 172.21.15.18:0/826932863 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f84e806c2b0 0x7f84e806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:08.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.577+0000 7f85017fa640 1 -- 172.21.15.18:0/826932863 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f84fc08bc40 con 0x7f850415ca40 2024-09-19T09:14:08.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.577+0000 7f8508cfb640 1 --2- 172.21.15.18:0/826932863 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f84e806c2b0 0x7f84e806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:08.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.577+0000 7f8508cfb640 1 --2- 172.21.15.18:0/826932863 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f84e806c2b0 0x7f84e806e770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f84f800ab60 tx=0x7f84f8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:08.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.585+0000 7f85017fa640 1 -- 172.21.15.18:0/826932863 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f85040b14c0 con 0x7f850415ca40 2024-09-19T09:14:08.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.798+0000 7f850af5f640 1 -- 172.21.15.18:0/826932863 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f85040d1110 con 0x7f850415ca40 2024-09-19T09:14:08.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.816+0000 7f85017fa640 1 -- 172.21.15.18:0/826932863 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) ==== 118+0+0 (secure 0 0 0) 0x7f84fc059cc0 con 0x7f850415ca40 2024-09-19T09:14:08.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.819+0000 7f850af5f640 1 -- 172.21.15.18:0/826932863 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f84e806c2b0 msgr2=0x7f84e806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:08.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.819+0000 7f850af5f640 1 --2- 172.21.15.18:0/826932863 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f84e806c2b0 0x7f84e806e770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f84f800ab60 tx=0x7f84f8008040 comp rx=0 tx=0).stop 2024-09-19T09:14:08.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.819+0000 7f850af5f640 1 -- 172.21.15.18:0/826932863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f850415ca40 msgr2=0x7f850415e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:08.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.819+0000 7f850af5f640 1 --2- 172.21.15.18:0/826932863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f850415ca40 0x7f850415e560 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f84fc00cef0 tx=0x7f84fc00a710 comp rx=0 tx=0).stop 2024-09-19T09:14:08.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.819+0000 7f850af5f640 1 -- 172.21.15.18:0/826932863 shutdown_connections 2024-09-19T09:14:08.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.819+0000 7f850af5f640 1 --2- 172.21.15.18:0/826932863 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f84e806c2b0 0x7f84e806e770 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.819+0000 7f850af5f640 1 --2- 172.21.15.18:0/826932863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f850415ca40 0x7f850415e560 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.819+0000 7f850af5f640 1 --2- 172.21.15.18:0/826932863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85040d1650 0x7f85041f8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.819+0000 7f850af5f640 1 --2- 172.21.15.18:0/826932863 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f85040b6d90 0x7f850409ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.819+0000 7f850af5f640 1 -- 172.21.15.18:0/826932863 >> 172.21.15.18:0/826932863 conn(0x7f85040b5fc0 msgr2=0x7f85040b0150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:08.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.820+0000 7f850af5f640 1 -- 172.21.15.18:0/826932863 shutdown_connections 2024-09-19T09:14:08.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.820+0000 7f850af5f640 1 -- 172.21.15.18:0/826932863 wait complete. 2024-09-19T09:14:08.832 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-19T09:14:08.833 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-19T09:14:08.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.938+0000 7f7f50e82640 1 Processor -- start 2024-09-19T09:14:08.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.938+0000 7f7f50e82640 1 -- start start 2024-09-19T09:14:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.939+0000 7f7f50e82640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7f4c1623c0 0x7f7f4c0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.939+0000 7f7f50e82640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7f4c0d1470 0x7f7f4c0d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.939+0000 7f7f50e82640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f4c0d3700 con 0x7f7f4c0d56b0 2024-09-19T09:14:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.939+0000 7f7f50e82640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f7f4c0d21a0 con 0x7f7f4c1623c0 2024-09-19T09:14:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.939+0000 7f7f50e82640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f7f4c0d0080 con 0x7f7f4c0d1470 2024-09-19T09:14:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.939+0000 7f7f4a59c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7f4c1623c0 0x7f7f4c0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.939+0000 7f7f4a59c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7f4c1623c0 0x7f7f4c0b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53776/0 (socket says 172.21.15.18:53776) 2024-09-19T09:14:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.939+0000 7f7f4a59c640 1 -- 172.21.15.18:0/223725210 learned_addr learned my addr 172.21.15.18:0/223725210 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.940+0000 7f7f4a59c640 1 -- 172.21.15.18:0/223725210 >> v2:172.21.15.162:3300/0 conn(0x7f7f4c0d1470 msgr2=0x7f7f4c0d1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.940+0000 7f7f4ad9d640 1 --2- 172.21.15.18:0/223725210 >> v2:172.21.15.162:3300/0 conn(0x7f7f4c0d1470 0x7f7f4c0d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.940+0000 7f7f4a59c640 1 --2- 172.21.15.18:0/223725210 >> v2:172.21.15.162:3300/0 conn(0x7f7f4c0d1470 0x7f7f4c0d1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.940+0000 7f7f4a59c640 1 -- 172.21.15.18:0/223725210 >> v1:172.21.15.162:6789/0 conn(0x7f7f4c0d56b0 legacy=0x7f7f4c0d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:08.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.940+0000 7f7f4a59c640 1 -- 172.21.15.18:0/223725210 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f4c0cfa70 con 0x7f7f4c1623c0 2024-09-19T09:14:08.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.940+0000 7f7f4ad9d640 1 --2- 172.21.15.18:0/223725210 >> v2:172.21.15.162:3300/0 conn(0x7f7f4c0d1470 0x7f7f4c0d1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:14:08.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.940+0000 7f7f4a59c640 1 --2- 172.21.15.18:0/223725210 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f4c1623c0 0x7f7f4c0b6260 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c0cbcc0 tx=0x7f7f3c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11e77a9aa0e0c8c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:08.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.941+0000 7f7f4959a640 1 -- 172.21.15.18:0/223725210 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c037070 con 0x7f7f4c1623c0 2024-09-19T09:14:08.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.941+0000 7f7f4959a640 1 -- 172.21.15.18:0/223725210 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f3c032440 con 0x7f7f4c1623c0 2024-09-19T09:14:08.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.941+0000 7f7f4959a640 1 -- 172.21.15.18:0/223725210 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f3c032810 con 0x7f7f4c1623c0 2024-09-19T09:14:08.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.941+0000 7f7f50e82640 1 -- 172.21.15.18:0/223725210 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f4c1623c0 msgr2=0x7f7f4c0b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:08.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.941+0000 7f7f50e82640 1 --2- 172.21.15.18:0/223725210 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f4c1623c0 0x7f7f4c0b6260 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7f4c0cbcc0 tx=0x7f7f3c02a230 comp rx=0 tx=0).stop 2024-09-19T09:14:08.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.941+0000 7f7f50e82640 1 -- 172.21.15.18:0/223725210 shutdown_connections 2024-09-19T09:14:08.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.941+0000 7f7f50e82640 1 --2- 172.21.15.18:0/223725210 >> v2:172.21.15.162:3300/0 conn(0x7f7f4c0d1470 0x7f7f4c0d1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.941+0000 7f7f50e82640 1 --2- 172.21.15.18:0/223725210 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f4c1623c0 0x7f7f4c0b6260 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.941+0000 7f7f50e82640 1 -- 172.21.15.18:0/223725210 >> 172.21.15.18:0/223725210 conn(0x7f7f4c09df30 msgr2=0x7f7f4c0d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:08.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.941+0000 7f7f50e82640 1 -- 172.21.15.18:0/223725210 shutdown_connections 2024-09-19T09:14:08.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.941+0000 7f7f50e82640 1 -- 172.21.15.18:0/223725210 wait complete. 2024-09-19T09:14:08.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.943+0000 7f7f50e82640 1 Processor -- start 2024-09-19T09:14:08.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.943+0000 7f7f50e82640 1 -- start start 2024-09-19T09:14:08.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.944+0000 7f7f50e82640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f4c0d1470 0x7f7f4c0cac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:08.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.944+0000 7f7f50e82640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f4c0d56b0 0x7f7f4c158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:08.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.944+0000 7f7f50e82640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f4c1623c0 0x7f7f4c0c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:08.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.944+0000 7f7f50e82640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4c0cfd10 con 0x7f7f4c0d56b0 2024-09-19T09:14:08.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.944+0000 7f7f50e82640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7f4c0d39a0 con 0x7f7f4c0d1470 2024-09-19T09:14:08.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.944+0000 7f7f50e82640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7f4c1627a0 con 0x7f7f4c1623c0 2024-09-19T09:14:08.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.944+0000 7f7f49d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f4c0d56b0 0x7f7f4c158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:08.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.944+0000 7f7f49d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f4c0d56b0 0x7f7f4c158120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53782/0 (socket says 172.21.15.18:53782) 2024-09-19T09:14:08.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.944+0000 7f7f49d9b640 1 -- 172.21.15.18:0/3355083039 learned_addr learned my addr 172.21.15.18:0/3355083039 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:08.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.945+0000 7f7f4a59c640 1 --2- 172.21.15.18:0/3355083039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f4c0d1470 0x7f7f4c0cac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:08.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.945+0000 7f7f4ad9d640 1 --2- 172.21.15.18:0/3355083039 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f4c1623c0 0x7f7f4c0c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:08.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.945+0000 7f7f49d9b640 1 -- 172.21.15.18:0/3355083039 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f4c1623c0 msgr2=0x7f7f4c0c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:08.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.945+0000 7f7f49d9b640 1 --2- 172.21.15.18:0/3355083039 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f4c1623c0 0x7f7f4c0c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.945+0000 7f7f49d9b640 1 -- 172.21.15.18:0/3355083039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f4c0d1470 msgr2=0x7f7f4c0cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:08.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.945+0000 7f7f49d9b640 1 --2- 172.21.15.18:0/3355083039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f4c0d1470 0x7f7f4c0cac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:08.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.945+0000 7f7f49d9b640 1 -- 172.21.15.18:0/3355083039 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f4c0cb360 con 0x7f7f4c0d56b0 2024-09-19T09:14:08.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.945+0000 7f7f49d9b640 1 --2- 172.21.15.18:0/3355083039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f4c0d56b0 0x7f7f4c158120 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7f3400c460 tx=0x7f7f3400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:08.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.945+0000 7f7f42ffd640 1 -- 172.21.15.18:0/3355083039 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f34016020 con 0x7f7f4c0d56b0 2024-09-19T09:14:08.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.945+0000 7f7f42ffd640 1 -- 172.21.15.18:0/3355083039 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f34012870 con 0x7f7f4c0d56b0 2024-09-19T09:14:08.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.945+0000 7f7f50e82640 1 -- 172.21.15.18:0/3355083039 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f4c0cb640 con 0x7f7f4c0d56b0 2024-09-19T09:14:08.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.945+0000 7f7f42ffd640 1 -- 172.21.15.18:0/3355083039 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f34012c60 con 0x7f7f4c0d56b0 2024-09-19T09:14:08.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.945+0000 7f7f50e82640 1 -- 172.21.15.18:0/3355083039 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f4c0cca20 con 0x7f7f4c0d56b0 2024-09-19T09:14:08.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.946+0000 7f7f50e82640 1 -- 172.21.15.18:0/3355083039 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f4c0d3c80 con 0x7f7f4c0d56b0 2024-09-19T09:14:08.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.947+0000 7f7f42ffd640 1 -- 172.21.15.18:0/3355083039 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7f34019020 con 0x7f7f4c0d56b0 2024-09-19T09:14:08.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.947+0000 7f7f42ffd640 1 --2- 172.21.15.18:0/3355083039 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7f2c06c2b0 0x7f7f2c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:08.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.947+0000 7f7f42ffd640 1 -- 172.21.15.18:0/3355083039 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f7f3408b020 con 0x7f7f4c0d56b0 2024-09-19T09:14:08.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.948+0000 7f7f4a59c640 1 --2- 172.21.15.18:0/3355083039 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7f2c06c2b0 0x7f7f2c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:08.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.948+0000 7f7f4a59c640 1 --2- 172.21.15.18:0/3355083039 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7f2c06c2b0 0x7f7f2c06e770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c034000 tx=0x7f7f3c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:08.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:08.952+0000 7f7f42ffd640 1 -- 172.21.15.18:0/3355083039 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7f34020030 con 0x7f7f4c0d56b0 2024-09-19T09:14:09.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.167+0000 7f7f50e82640 1 -- 172.21.15.18:0/3355083039 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f7f4c0d2340 con 0x7f7f4c0d56b0 2024-09-19T09:14:09.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.827+0000 7f7f42ffd640 1 -- 172.21.15.18:0/3355083039 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) ==== 122+0+0 (secure 0 0 0) 0x7f7f34059150 con 0x7f7f4c0d56b0 2024-09-19T09:14:09.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.829+0000 7f7f50e82640 1 -- 172.21.15.18:0/3355083039 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7f2c06c2b0 msgr2=0x7f7f2c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:09.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.829+0000 7f7f50e82640 1 --2- 172.21.15.18:0/3355083039 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7f2c06c2b0 0x7f7f2c06e770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c034000 tx=0x7f7f3c02e000 comp rx=0 tx=0).stop 2024-09-19T09:14:09.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.829+0000 7f7f50e82640 1 -- 172.21.15.18:0/3355083039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f4c0d56b0 msgr2=0x7f7f4c158120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:09.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.829+0000 7f7f50e82640 1 --2- 172.21.15.18:0/3355083039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f4c0d56b0 0x7f7f4c158120 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7f3400c460 tx=0x7f7f3400c920 comp rx=0 tx=0).stop 2024-09-19T09:14:09.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.829+0000 7f7f50e82640 1 -- 172.21.15.18:0/3355083039 shutdown_connections 2024-09-19T09:14:09.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.829+0000 7f7f50e82640 1 --2- 172.21.15.18:0/3355083039 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7f2c06c2b0 0x7f7f2c06e770 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:09.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.829+0000 7f7f50e82640 1 --2- 172.21.15.18:0/3355083039 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f4c1623c0 0x7f7f4c0c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:09.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.829+0000 7f7f50e82640 1 --2- 172.21.15.18:0/3355083039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f4c0d56b0 0x7f7f4c158120 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:09.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.829+0000 7f7f50e82640 1 --2- 172.21.15.18:0/3355083039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f4c0d1470 0x7f7f4c0cac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:09.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.829+0000 7f7f50e82640 1 -- 172.21.15.18:0/3355083039 >> 172.21.15.18:0/3355083039 conn(0x7f7f4c09df30 msgr2=0x7f7f4c0b5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:09.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.830+0000 7f7f50e82640 1 -- 172.21.15.18:0/3355083039 shutdown_connections 2024-09-19T09:14:09.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.830+0000 7f7f50e82640 1 -- 172.21.15.18:0/3355083039 wait complete. 2024-09-19T09:14:09.841 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-19T09:14:09.842 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:14:09.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.943+0000 7fc87d20e640 1 Processor -- start 2024-09-19T09:14:09.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.943+0000 7fc87d20e640 1 -- start start 2024-09-19T09:14:09.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.943+0000 7fc87d20e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc87815ed30 0x7fc878070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:09.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.943+0000 7fc87d20e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8780d0a10 con 0x7fc8780b5200 2024-09-19T09:14:09.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.943+0000 7fc87d20e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc878070ab0 con 0x7fc8781630f0 2024-09-19T09:14:09.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.943+0000 7fc87d20e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc8780d0cb0 con 0x7fc87815ed30 2024-09-19T09:14:09.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.944+0000 7fc87659c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc8780b5200 0x7fc8781629e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38452/0 (socket says 172.21.15.18:38452) 2024-09-19T09:14:09.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.944+0000 7fc87659c640 1 -- 172.21.15.18:0/2430124569 learned_addr learned my addr 172.21.15.18:0/2430124569 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:09.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.944+0000 7fc876d9d640 1 --2- 172.21.15.18:0/2430124569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc87815ed30 0x7fc878070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:09.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.944+0000 7fc875d9b640 1 -- 172.21.15.18:0/2430124569 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1501219671 0 0) 0x7fc8780d0a10 con 0x7fc8780b5200 2024-09-19T09:14:09.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.944+0000 7fc875d9b640 1 -- 172.21.15.18:0/2430124569 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc860003520 con 0x7fc8780b5200 2024-09-19T09:14:09.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.944+0000 7fc875d9b640 1 -- 172.21.15.18:0/2430124569 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2186919257 0 0) 0x7fc860003520 con 0x7fc8780b5200 2024-09-19T09:14:09.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.944+0000 7fc875d9b640 1 -- 172.21.15.18:0/2430124569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc87815ed30 msgr2=0x7fc878070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:09.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.944+0000 7fc875d9b640 1 --2- 172.21.15.18:0/2430124569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc87815ed30 0x7fc878070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:09.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.944+0000 7fc875d9b640 1 -- 172.21.15.18:0/2430124569 >> v1:172.21.15.162:6789/0 conn(0x7fc8781630f0 legacy=0x7fc8780cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:09.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.944+0000 7fc875d9b640 1 -- 172.21.15.18:0/2430124569 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8780d0f90 con 0x7fc8780b5200 2024-09-19T09:14:09.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.944+0000 7fc875d9b640 1 -- 172.21.15.18:0/2430124569 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fc86c001670 con 0x7fc8780b5200 2024-09-19T09:14:09.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.944+0000 7fc875d9b640 1 -- 172.21.15.18:0/2430124569 >> v1:172.21.15.18:6789/0 conn(0x7fc8780b5200 legacy=0x7fc8781629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:09.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.944+0000 7fc875d9b640 1 --2- 172.21.15.18:0/2430124569 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8600039e0 0x7fc860003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:09.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.944+0000 7fc875d9b640 1 --2- 172.21.15.18:0/2430124569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc87815ed30 0x7fc860004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:09.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.944+0000 7fc875d9b640 1 --2- 172.21.15.18:0/2430124569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc860004d40 0x7fc8600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:09.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.944+0000 7fc875d9b640 1 -- 172.21.15.18:0/2430124569 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc8780d0cb0 con 0x7fc8600039e0 2024-09-19T09:14:09.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.944+0000 7fc875d9b640 1 -- 172.21.15.18:0/2430124569 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc86000b9c0 con 0x7fc860004d40 2024-09-19T09:14:09.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.944+0000 7fc875d9b640 1 -- 172.21.15.18:0/2430124569 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc86000bbc0 con 0x7fc87815ed30 2024-09-19T09:14:09.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.944+0000 7fc876d9d640 1 --2- 172.21.15.18:0/2430124569 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8600039e0 0x7fc860003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:09.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.944+0000 7fc87659c640 1 --2- 172.21.15.18:0/2430124569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc87815ed30 0x7fc860004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:09.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.945+0000 7fc87759e640 1 --2- 172.21.15.18:0/2430124569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc860004d40 0x7fc8600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:09.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.945+0000 7fc876d9d640 1 -- 172.21.15.18:0/2430124569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc87815ed30 msgr2=0x7fc860004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:09.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.945+0000 7fc876d9d640 1 --2- 172.21.15.18:0/2430124569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc87815ed30 0x7fc860004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:09.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.945+0000 7fc876d9d640 1 -- 172.21.15.18:0/2430124569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc860004d40 msgr2=0x7fc8600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:09.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.945+0000 7fc876d9d640 1 --2- 172.21.15.18:0/2430124569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc860004d40 0x7fc8600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:09.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.945+0000 7fc876d9d640 1 -- 172.21.15.18:0/2430124569 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc860003520 con 0x7fc8600039e0 2024-09-19T09:14:09.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.945+0000 7fc876d9d640 1 --2- 172.21.15.18:0/2430124569 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8600039e0 0x7fc860003dc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc868009ac0 tx=0x7fc860005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb0595eb6b58ac32 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:09.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.946+0000 7fc875d9b640 1 -- 172.21.15.18:0/2430124569 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc868036070 con 0x7fc8600039e0 2024-09-19T09:14:09.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.946+0000 7fc875d9b640 1 -- 172.21.15.18:0/2430124569 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc868031400 con 0x7fc8600039e0 2024-09-19T09:14:09.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.946+0000 7fc875d9b640 1 -- 172.21.15.18:0/2430124569 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc868009690 con 0x7fc8600039e0 2024-09-19T09:14:09.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.946+0000 7fc87d20e640 1 -- 172.21.15.18:0/2430124569 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8600039e0 msgr2=0x7fc860003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:09.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.946+0000 7fc87d20e640 1 --2- 172.21.15.18:0/2430124569 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8600039e0 0x7fc860003dc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fc868009ac0 tx=0x7fc860005830 comp rx=0 tx=0).stop 2024-09-19T09:14:09.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.946+0000 7fc87759e640 1 -- 172.21.15.18:0/2430124569 reap_dead start 2024-09-19T09:14:09.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.946+0000 7fc87d20e640 1 -- 172.21.15.18:0/2430124569 shutdown_connections 2024-09-19T09:14:09.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.946+0000 7fc87d20e640 1 -- 172.21.15.18:0/2430124569 >> 172.21.15.18:0/2430124569 conn(0x7fc8780b4600 msgr2=0x7fc8780b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:09.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.946+0000 7fc87d20e640 1 -- 172.21.15.18:0/2430124569 shutdown_connections 2024-09-19T09:14:09.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.946+0000 7fc87d20e640 1 -- 172.21.15.18:0/2430124569 wait complete. 2024-09-19T09:14:09.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.948+0000 7fc87d20e640 1 Processor -- start 2024-09-19T09:14:09.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.948+0000 7fc87d20e640 1 -- start start 2024-09-19T09:14:09.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.948+0000 7fc87d20e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8600039e0 0x7fc8780c9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:09.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.948+0000 7fc87d20e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc878152d00 0x7fc8780c7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:09.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.948+0000 7fc87d20e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8780c7590 0x7fc8780b5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:09.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.948+0000 7fc87d20e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc87815f290 con 0x7fc878152d00 2024-09-19T09:14:09.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.948+0000 7fc87d20e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc87815f110 con 0x7fc8600039e0 2024-09-19T09:14:09.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.948+0000 7fc87d20e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc8780d24c0 con 0x7fc8780c7590 2024-09-19T09:14:09.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.948+0000 7fc87659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc878152d00 0x7fc8780c7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:09.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.949+0000 7fc87659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc878152d00 0x7fc8780c7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53796/0 (socket says 172.21.15.18:53796) 2024-09-19T09:14:09.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.949+0000 7fc87659c640 1 -- 172.21.15.18:0/2957639112 learned_addr learned my addr 172.21.15.18:0/2957639112 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:09.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.949+0000 7fc876d9d640 1 --2- 172.21.15.18:0/2957639112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8600039e0 0x7fc8780c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:09.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.949+0000 7fc87759e640 1 --2- 172.21.15.18:0/2957639112 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8780c7590 0x7fc8780b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:09.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.949+0000 7fc87659c640 1 -- 172.21.15.18:0/2957639112 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8780c7590 msgr2=0x7fc8780b5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:09.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.949+0000 7fc87659c640 1 --2- 172.21.15.18:0/2957639112 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8780c7590 0x7fc8780b5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:09.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.949+0000 7fc87659c640 1 -- 172.21.15.18:0/2957639112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8600039e0 msgr2=0x7fc8780c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:09.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.949+0000 7fc87659c640 1 --2- 172.21.15.18:0/2957639112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8600039e0 0x7fc8780c9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:09.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.949+0000 7fc87659c640 1 -- 172.21.15.18:0/2957639112 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8780b7cd0 con 0x7fc878152d00 2024-09-19T09:14:09.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.949+0000 7fc87659c640 1 --2- 172.21.15.18:0/2957639112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc878152d00 0x7fc8780c7050 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc86c007340 tx=0x7fc86c007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:09.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.949+0000 7fc85f7fe640 1 -- 172.21.15.18:0/2957639112 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86c00f8e0 con 0x7fc878152d00 2024-09-19T09:14:09.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.949+0000 7fc85f7fe640 1 -- 172.21.15.18:0/2957639112 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc86c018070 con 0x7fc878152d00 2024-09-19T09:14:09.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.949+0000 7fc87d20e640 1 -- 172.21.15.18:0/2957639112 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8780b7fb0 con 0x7fc878152d00 2024-09-19T09:14:09.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.949+0000 7fc85f7fe640 1 -- 172.21.15.18:0/2957639112 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc86c00fd00 con 0x7fc878152d00 2024-09-19T09:14:09.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.949+0000 7fc87d20e640 1 -- 172.21.15.18:0/2957639112 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8781534c0 con 0x7fc878152d00 2024-09-19T09:14:09.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.950+0000 7fc87d20e640 1 -- 172.21.15.18:0/2957639112 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8780b8180 con 0x7fc878152d00 2024-09-19T09:14:09.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.951+0000 7fc85f7fe640 1 -- 172.21.15.18:0/2957639112 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc86c01d460 con 0x7fc878152d00 2024-09-19T09:14:09.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.951+0000 7fc85f7fe640 1 --2- 172.21.15.18:0/2957639112 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc86406c2b0 0x7fc86406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:09.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.952+0000 7fc85f7fe640 1 -- 172.21.15.18:0/2957639112 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fc86c08b3c0 con 0x7fc878152d00 2024-09-19T09:14:09.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.952+0000 7fc876d9d640 1 --2- 172.21.15.18:0/2957639112 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc86406c2b0 0x7fc86406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:09.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.952+0000 7fc876d9d640 1 --2- 172.21.15.18:0/2957639112 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc86406c2b0 0x7fc86406e770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc868033000 tx=0x7fc868008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:09.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:09.956+0000 7fc85f7fe640 1 -- 172.21.15.18:0/2957639112 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc86c0594e0 con 0x7fc878152d00 2024-09-19T09:14:10.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.167+0000 7fc87d20e640 1 -- 172.21.15.18:0/2957639112 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc878070ab0 con 0x7fc878152d00 2024-09-19T09:14:10.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.168+0000 7fc85f7fe640 1 -- 172.21.15.18:0/2957639112 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5229 (secure 0 0 0) 0x7fc86c05d7e0 con 0x7fc878152d00 2024-09-19T09:14:10.169 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:10.170 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":13,"btime":"2024-09-19T09:14:09:822716+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1369179501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1369179501},{"type":"v1","addr":"172.21.15.18:6835","nonce":1369179501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4762,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2677647932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2677647932},{"type":"v1","addr":"172.21.15.162:6836","nonce":2677647932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4765,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3427373581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3427373581},{"type":"v1","addr":"172.21.15.162:6837","nonce":3427373581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:14:07.154707+0000","modified":"2024-09-19T09:14:09.169555+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4785},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4785":{"gid":4785,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6834/2895835717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2895835717},{"type":"v1","addr":"172.21.15.18:6834","nonce":2895835717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4785,"qdb_cluster":[4785]},"id":2}]} 2024-09-19T09:14:10.170 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 13 2024-09-19T09:14:10.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.170+0000 7fc87d20e640 1 -- 172.21.15.18:0/2957639112 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc86406c2b0 msgr2=0x7fc86406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:10.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.170+0000 7fc87d20e640 1 --2- 172.21.15.18:0/2957639112 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc86406c2b0 0x7fc86406e770 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc868033000 tx=0x7fc868008030 comp rx=0 tx=0).stop 2024-09-19T09:14:10.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.170+0000 7fc87d20e640 1 -- 172.21.15.18:0/2957639112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc878152d00 msgr2=0x7fc8780c7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:10.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.170+0000 7fc87d20e640 1 --2- 172.21.15.18:0/2957639112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc878152d00 0x7fc8780c7050 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc86c007340 tx=0x7fc86c007800 comp rx=0 tx=0).stop 2024-09-19T09:14:10.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.170+0000 7fc87d20e640 1 -- 172.21.15.18:0/2957639112 shutdown_connections 2024-09-19T09:14:10.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.170+0000 7fc87d20e640 1 --2- 172.21.15.18:0/2957639112 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc86406c2b0 0x7fc86406e770 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.170+0000 7fc87d20e640 1 --2- 172.21.15.18:0/2957639112 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8780c7590 0x7fc8780b5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.170+0000 7fc87d20e640 1 --2- 172.21.15.18:0/2957639112 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc878152d00 0x7fc8780c7050 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.170+0000 7fc87d20e640 1 --2- 172.21.15.18:0/2957639112 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8600039e0 0x7fc8780c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.170+0000 7fc87d20e640 1 -- 172.21.15.18:0/2957639112 >> 172.21.15.18:0/2957639112 conn(0x7fc8780b4600 msgr2=0x7fc87815d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:10.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.170+0000 7fc87d20e640 1 -- 172.21.15.18:0/2957639112 shutdown_connections 2024-09-19T09:14:10.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.170+0000 7fc87d20e640 1 -- 172.21.15.18:0/2957639112 wait complete. 2024-09-19T09:14:10.182 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:14:10.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.283+0000 7feb3a61e640 1 Processor -- start 2024-09-19T09:14:10.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.283+0000 7feb3a61e640 1 -- start start 2024-09-19T09:14:10.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.284+0000 7feb3a61e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7feb3415fef0 0x7feb340b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:10.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.284+0000 7feb3a61e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7feb3406d810 0x7feb340b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:10.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.284+0000 7feb3a61e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb3406e730 con 0x7feb3415eb00 2024-09-19T09:14:10.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.284+0000 7feb3a61e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7feb341637e0 con 0x7feb3415fef0 2024-09-19T09:14:10.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.284+0000 7feb3a61e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7feb3406ea10 con 0x7feb3406d810 2024-09-19T09:14:10.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.284+0000 7feb337fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7feb3415fef0 0x7feb340b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:10.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.284+0000 7feb337fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7feb3415fef0 0x7feb340b0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53808/0 (socket says 172.21.15.18:53808) 2024-09-19T09:14:10.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.284+0000 7feb33fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7feb3415eb00 0x7feb341630d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38464/0 (socket says 172.21.15.18:38464) 2024-09-19T09:14:10.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.284+0000 7feb337fe640 1 -- 172.21.15.18:0/1508042379 learned_addr learned my addr 172.21.15.18:0/1508042379 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:10.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.284+0000 7feb38bbb640 1 --2- 172.21.15.18:0/1508042379 >> v2:172.21.15.162:3300/0 conn(0x7feb3406d810 0x7feb340b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:10.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.284+0000 7feb337fe640 1 -- 172.21.15.18:0/1508042379 >> v2:172.21.15.162:3300/0 conn(0x7feb3406d810 msgr2=0x7feb340b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:10.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.284+0000 7feb337fe640 1 --2- 172.21.15.18:0/1508042379 >> v2:172.21.15.162:3300/0 conn(0x7feb3406d810 0x7feb340b0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.284+0000 7feb337fe640 1 -- 172.21.15.18:0/1508042379 >> v1:172.21.15.18:6789/0 conn(0x7feb3415eb00 legacy=0x7feb341630d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:10.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.284+0000 7feb337fe640 1 -- 172.21.15.18:0/1508042379 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb341628d0 con 0x7feb3415fef0 2024-09-19T09:14:10.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.284+0000 7feb32ffd640 1 -- 172.21.15.18:0/1508042379 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2849329361 0 0) 0x7feb3406e730 con 0x7feb3415eb00 2024-09-19T09:14:10.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.285+0000 7feb337fe640 1 --2- 172.21.15.18:0/1508042379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb3415fef0 0x7feb340b0a70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7feb3406f830 tx=0x7feb2802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6cd35c739e1d0e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:10.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.285+0000 7feb32ffd640 1 -- 172.21.15.18:0/1508042379 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb28037070 con 0x7feb3415fef0 2024-09-19T09:14:10.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.285+0000 7feb32ffd640 1 -- 172.21.15.18:0/1508042379 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb28032440 con 0x7feb3415fef0 2024-09-19T09:14:10.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.285+0000 7feb32ffd640 1 -- 172.21.15.18:0/1508042379 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb28032810 con 0x7feb3415fef0 2024-09-19T09:14:10.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.286+0000 7feb3a61e640 1 -- 172.21.15.18:0/1508042379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb3415fef0 msgr2=0x7feb340b0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:10.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.286+0000 7feb3a61e640 1 --2- 172.21.15.18:0/1508042379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb3415fef0 0x7feb340b0a70 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7feb3406f830 tx=0x7feb2802a1e0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.286+0000 7feb3a61e640 1 -- 172.21.15.18:0/1508042379 shutdown_connections 2024-09-19T09:14:10.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.286+0000 7feb3a61e640 1 --2- 172.21.15.18:0/1508042379 >> v2:172.21.15.162:3300/0 conn(0x7feb3406d810 0x7feb340b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.286+0000 7feb3a61e640 1 --2- 172.21.15.18:0/1508042379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb3415fef0 0x7feb340b0a70 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.286+0000 7feb3a61e640 1 -- 172.21.15.18:0/1508042379 >> 172.21.15.18:0/1508042379 conn(0x7feb3406cd20 msgr2=0x7feb3406d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:10.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.286+0000 7feb3a61e640 1 -- 172.21.15.18:0/1508042379 shutdown_connections 2024-09-19T09:14:10.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.286+0000 7feb3a61e640 1 -- 172.21.15.18:0/1508042379 wait complete. 2024-09-19T09:14:10.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.287+0000 7feb3a61e640 1 Processor -- start 2024-09-19T09:14:10.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.287+0000 7feb3a61e640 1 -- start start 2024-09-19T09:14:10.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.288+0000 7feb3a61e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb3406d810 0x7feb341f5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:10.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.288+0000 7feb3a61e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb3415eb00 0x7feb341f51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:10.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.288+0000 7feb3a61e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb340cdda0 0x7feb34072840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:10.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.288+0000 7feb3a61e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feb34070150 con 0x7feb340cdda0 2024-09-19T09:14:10.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.288+0000 7feb3a61e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feb3406ffd0 con 0x7feb3415eb00 2024-09-19T09:14:10.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.288+0000 7feb3a61e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7feb340d1460 con 0x7feb3406d810 2024-09-19T09:14:10.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.288+0000 7feb38bbb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb340cdda0 0x7feb34072840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:10.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.288+0000 7feb38bbb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb340cdda0 0x7feb34072840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53814/0 (socket says 172.21.15.18:53814) 2024-09-19T09:14:10.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.288+0000 7feb38bbb640 1 -- 172.21.15.18:0/336830173 learned_addr learned my addr 172.21.15.18:0/336830173 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:10.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.288+0000 7feb337fe640 1 --2- 172.21.15.18:0/336830173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb3415eb00 0x7feb341f51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:10.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.288+0000 7feb33fff640 1 --2- 172.21.15.18:0/336830173 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb3406d810 0x7feb341f5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:10.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.288+0000 7feb38bbb640 1 -- 172.21.15.18:0/336830173 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb3406d810 msgr2=0x7feb341f5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:10.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.288+0000 7feb38bbb640 1 --2- 172.21.15.18:0/336830173 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb3406d810 0x7feb341f5940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.288+0000 7feb38bbb640 1 -- 172.21.15.18:0/336830173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb3415eb00 msgr2=0x7feb341f51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:10.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.288+0000 7feb38bbb640 1 --2- 172.21.15.18:0/336830173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb3415eb00 0x7feb341f51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.288+0000 7feb38bbb640 1 -- 172.21.15.18:0/336830173 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb340ae970 con 0x7feb340cdda0 2024-09-19T09:14:10.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.289+0000 7feb38bbb640 1 --2- 172.21.15.18:0/336830173 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb340cdda0 0x7feb34072840 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7feb2c007e40 tx=0x7feb2c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:10.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.289+0000 7feb30ff9640 1 -- 172.21.15.18:0/336830173 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c014620 con 0x7feb340cdda0 2024-09-19T09:14:10.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.289+0000 7feb30ff9640 1 -- 172.21.15.18:0/336830173 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb2c019070 con 0x7feb340cdda0 2024-09-19T09:14:10.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.289+0000 7feb3a61e640 1 -- 172.21.15.18:0/336830173 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb341f5700 con 0x7feb340cdda0 2024-09-19T09:14:10.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.289+0000 7feb30ff9640 1 -- 172.21.15.18:0/336830173 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c014a20 con 0x7feb340cdda0 2024-09-19T09:14:10.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.289+0000 7feb3a61e640 1 -- 172.21.15.18:0/336830173 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb340aeef0 con 0x7feb340cdda0 2024-09-19T09:14:10.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.290+0000 7feb3a61e640 1 -- 172.21.15.18:0/336830173 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb341617b0 con 0x7feb340cdda0 2024-09-19T09:14:10.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.290+0000 7feb30ff9640 1 -- 172.21.15.18:0/336830173 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7feb2c014bc0 con 0x7feb340cdda0 2024-09-19T09:14:10.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.291+0000 7feb30ff9640 1 --2- 172.21.15.18:0/336830173 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7feb2006c2b0 0x7feb2006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:10.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.291+0000 7feb30ff9640 1 -- 172.21.15.18:0/336830173 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7feb2c08bbb0 con 0x7feb340cdda0 2024-09-19T09:14:10.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.291+0000 7feb33fff640 1 --2- 172.21.15.18:0/336830173 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7feb2006c2b0 0x7feb2006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:10.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.291+0000 7feb33fff640 1 --2- 172.21.15.18:0/336830173 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7feb2006c2b0 0x7feb2006e770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7feb24000f60 tx=0x7feb24007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:10.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.295+0000 7feb30ff9640 1 -- 172.21.15.18:0/336830173 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7feb2c059cc0 con 0x7feb340cdda0 2024-09-19T09:14:10.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.470+0000 7feb3a61e640 1 -- 172.21.15.18:0/336830173 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb3406c8f0 con 0x7feb340cdda0 2024-09-19T09:14:10.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.471+0000 7feb30ff9640 1 -- 172.21.15.18:0/336830173 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16681 (secure 0 0 0) 0x7feb2c05dfc0 con 0x7feb340cdda0 2024-09-19T09:14:10.473 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:10.473 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":32,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:14:08.817496+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:14:05.064029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-19T09:14:06.144818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:14:10.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.474+0000 7feb3a61e640 1 -- 172.21.15.18:0/336830173 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7feb2006c2b0 msgr2=0x7feb2006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:10.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.474+0000 7feb3a61e640 1 --2- 172.21.15.18:0/336830173 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7feb2006c2b0 0x7feb2006e770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7feb24000f60 tx=0x7feb24007d50 comp rx=0 tx=0).stop 2024-09-19T09:14:10.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.474+0000 7feb3a61e640 1 -- 172.21.15.18:0/336830173 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb340cdda0 msgr2=0x7feb34072840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:10.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.474+0000 7feb3a61e640 1 --2- 172.21.15.18:0/336830173 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb340cdda0 0x7feb34072840 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7feb2c007e40 tx=0x7feb2c00e4b0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.474+0000 7feb3a61e640 1 -- 172.21.15.18:0/336830173 shutdown_connections 2024-09-19T09:14:10.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.474+0000 7feb3a61e640 1 --2- 172.21.15.18:0/336830173 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7feb2006c2b0 0x7feb2006e770 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.474+0000 7feb3a61e640 1 --2- 172.21.15.18:0/336830173 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb340cdda0 0x7feb34072840 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.474+0000 7feb3a61e640 1 --2- 172.21.15.18:0/336830173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb3415eb00 0x7feb341f51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.474+0000 7feb3a61e640 1 --2- 172.21.15.18:0/336830173 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb3406d810 0x7feb341f5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.474+0000 7feb3a61e640 1 -- 172.21.15.18:0/336830173 >> 172.21.15.18:0/336830173 conn(0x7feb3406cd20 msgr2=0x7feb340cf870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:10.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.474+0000 7feb3a61e640 1 -- 172.21.15.18:0/336830173 shutdown_connections 2024-09-19T09:14:10.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.474+0000 7feb3a61e640 1 -- 172.21.15.18:0/336830173 wait complete. 2024-09-19T09:14:10.486 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T09:14:10.486 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:14:10.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.587+0000 7fe0a6a5e640 1 Processor -- start 2024-09-19T09:14:10.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.587+0000 7fe0a6a5e640 1 -- start start 2024-09-19T09:14:10.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.588+0000 7fe0a6a5e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0a015ef50 0x7fe0a00d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:10.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.588+0000 7fe0a6a5e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe0a00b9510 0x7fe0a00d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:10.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.588+0000 7fe0a6a5e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0a00b7a90 con 0x7fe0a00d3240 2024-09-19T09:14:10.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.588+0000 7fe0a6a5e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe0a00d3740 con 0x7fe0a00b9510 2024-09-19T09:14:10.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.588+0000 7fe0a6a5e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe0a00d3a20 con 0x7fe0a015ef50 2024-09-19T09:14:10.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.588+0000 7fe097fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe0a00d3240 0x7fe0a00cf770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38470/0 (socket says 172.21.15.18:38470) 2024-09-19T09:14:10.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.588+0000 7fe097fff640 1 -- 172.21.15.18:0/3161686796 learned_addr learned my addr 172.21.15.18:0/3161686796 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:10.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.589+0000 7fe09ffff640 1 --2- 172.21.15.18:0/3161686796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0a015ef50 0x7fe0a00d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:10.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.589+0000 7fe0a4ffb640 1 --2- 172.21.15.18:0/3161686796 >> v2:172.21.15.162:3300/0 conn(0x7fe0a00b9510 0x7fe0a00d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:10.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.589+0000 7fe09f7fe640 1 -- 172.21.15.18:0/3161686796 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3913403180 0 0) 0x7fe0a00b7a90 con 0x7fe0a00d3240 2024-09-19T09:14:10.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.589+0000 7fe09f7fe640 1 -- 172.21.15.18:0/3161686796 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe08c003520 con 0x7fe0a00d3240 2024-09-19T09:14:10.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.589+0000 7fe09f7fe640 1 -- 172.21.15.18:0/3161686796 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3061533866 0 0) 0x7fe08c003520 con 0x7fe0a00d3240 2024-09-19T09:14:10.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.589+0000 7fe09f7fe640 1 -- 172.21.15.18:0/3161686796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0a015ef50 msgr2=0x7fe0a00d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:10.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.589+0000 7fe09f7fe640 1 --2- 172.21.15.18:0/3161686796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0a015ef50 0x7fe0a00d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.589+0000 7fe09f7fe640 1 -- 172.21.15.18:0/3161686796 >> v2:172.21.15.162:3300/0 conn(0x7fe0a00b9510 msgr2=0x7fe0a00d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:10.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.589+0000 7fe09f7fe640 1 --2- 172.21.15.18:0/3161686796 >> v2:172.21.15.162:3300/0 conn(0x7fe0a00b9510 0x7fe0a00d18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.589+0000 7fe09f7fe640 1 -- 172.21.15.18:0/3161686796 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a00b7d00 con 0x7fe0a00d3240 2024-09-19T09:14:10.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.589+0000 7fe09f7fe640 1 -- 172.21.15.18:0/3161686796 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fe088001670 con 0x7fe0a00d3240 2024-09-19T09:14:10.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.589+0000 7fe09f7fe640 1 -- 172.21.15.18:0/3161686796 >> v1:172.21.15.18:6789/0 conn(0x7fe0a00d3240 legacy=0x7fe0a00cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:10.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.589+0000 7fe09f7fe640 1 --2- 172.21.15.18:0/3161686796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe08c0039b0 0x7fe08c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:10.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.589+0000 7fe09f7fe640 1 --2- 172.21.15.18:0/3161686796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe08c004800 0x7fe08c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:10.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.589+0000 7fe09f7fe640 1 --2- 172.21.15.18:0/3161686796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0a015ef50 0x7fe08c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:10.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.589+0000 7fe09f7fe640 1 -- 172.21.15.18:0/3161686796 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a00d3740 con 0x7fe08c0039b0 2024-09-19T09:14:10.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.589+0000 7fe09f7fe640 1 -- 172.21.15.18:0/3161686796 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a00d3a20 con 0x7fe08c004800 2024-09-19T09:14:10.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.589+0000 7fe09f7fe640 1 -- 172.21.15.18:0/3161686796 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe08c00b9c0 con 0x7fe0a015ef50 2024-09-19T09:14:10.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.589+0000 7fe09ffff640 1 --2- 172.21.15.18:0/3161686796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe08c0039b0 0x7fe08c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:10.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.589+0000 7fe097fff640 1 --2- 172.21.15.18:0/3161686796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe08c004800 0x7fe08c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:10.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.589+0000 7fe0a4ffb640 1 --2- 172.21.15.18:0/3161686796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0a015ef50 0x7fe08c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:10.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.589+0000 7fe09ffff640 1 -- 172.21.15.18:0/3161686796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0a015ef50 msgr2=0x7fe08c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:10.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.589+0000 7fe09ffff640 1 --2- 172.21.15.18:0/3161686796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0a015ef50 0x7fe08c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.589+0000 7fe09ffff640 1 -- 172.21.15.18:0/3161686796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe08c004800 msgr2=0x7fe08c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:10.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.589+0000 7fe09ffff640 1 --2- 172.21.15.18:0/3161686796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe08c004800 0x7fe08c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.589+0000 7fe09ffff640 1 -- 172.21.15.18:0/3161686796 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08c003520 con 0x7fe08c0039b0 2024-09-19T09:14:10.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.589+0000 7fe0a4ffb640 1 --2- 172.21.15.18:0/3161686796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0a015ef50 0x7fe08c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:10.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.590+0000 7fe09ffff640 1 --2- 172.21.15.18:0/3161686796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe08c0039b0 0x7fe08c003dd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe090009af0 tx=0x7fe08c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ac5d1de5795dfb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:10.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.590+0000 7fe09f7fe640 1 -- 172.21.15.18:0/3161686796 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe090036070 con 0x7fe08c0039b0 2024-09-19T09:14:10.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.590+0000 7fe09f7fe640 1 -- 172.21.15.18:0/3161686796 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe090031400 con 0x7fe08c0039b0 2024-09-19T09:14:10.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.590+0000 7fe09f7fe640 1 -- 172.21.15.18:0/3161686796 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe090009690 con 0x7fe08c0039b0 2024-09-19T09:14:10.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.591+0000 7fe0a6a5e640 1 -- 172.21.15.18:0/3161686796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe08c0039b0 msgr2=0x7fe08c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:10.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.591+0000 7fe0a6a5e640 1 --2- 172.21.15.18:0/3161686796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe08c0039b0 0x7fe08c003dd0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe090009af0 tx=0x7fe08c005830 comp rx=0 tx=0).stop 2024-09-19T09:14:10.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.591+0000 7fe0a4ffb640 1 -- 172.21.15.18:0/3161686796 reap_dead start 2024-09-19T09:14:10.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.591+0000 7fe0a6a5e640 1 -- 172.21.15.18:0/3161686796 shutdown_connections 2024-09-19T09:14:10.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.591+0000 7fe0a6a5e640 1 -- 172.21.15.18:0/3161686796 >> 172.21.15.18:0/3161686796 conn(0x7fe0a00d4c60 msgr2=0x7fe0a00d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:10.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.591+0000 7fe0a6a5e640 1 -- 172.21.15.18:0/3161686796 shutdown_connections 2024-09-19T09:14:10.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.591+0000 7fe0a6a5e640 1 -- 172.21.15.18:0/3161686796 wait complete. 2024-09-19T09:14:10.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.592+0000 7fe0a6a5e640 1 Processor -- start 2024-09-19T09:14:10.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.592+0000 7fe0a6a5e640 1 -- start start 2024-09-19T09:14:10.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.593+0000 7fe0a6a5e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe08c0039b0 0x7fe0a00cd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:10.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.593+0000 7fe0a6a5e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0a0150040 0x7fe0a00ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:10.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.593+0000 7fe0a6a5e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0a00ca7e0 0x7fe0a015a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:10.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.593+0000 7fe0a6a5e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a00d21a0 con 0x7fe08c0039b0 2024-09-19T09:14:10.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.593+0000 7fe0a6a5e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a00d2020 con 0x7fe0a00ca7e0 2024-09-19T09:14:10.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.593+0000 7fe0a6a5e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe0a00d5780 con 0x7fe0a0150040 2024-09-19T09:14:10.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.593+0000 7fe09ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe08c0039b0 0x7fe0a00cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:10.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.593+0000 7fe09ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe08c0039b0 0x7fe0a00cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53832/0 (socket says 172.21.15.18:53832) 2024-09-19T09:14:10.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.593+0000 7fe09ffff640 1 -- 172.21.15.18:0/3945534037 learned_addr learned my addr 172.21.15.18:0/3945534037 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:10.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.593+0000 7fe097fff640 1 --2- 172.21.15.18:0/3945534037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0a0150040 0x7fe0a00ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:10.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.593+0000 7fe0a4ffb640 1 --2- 172.21.15.18:0/3945534037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0a00ca7e0 0x7fe0a015a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:10.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.593+0000 7fe09ffff640 1 -- 172.21.15.18:0/3945534037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0a0150040 msgr2=0x7fe0a00ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:10.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.593+0000 7fe09ffff640 1 --2- 172.21.15.18:0/3945534037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0a0150040 0x7fe0a00ca2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.593+0000 7fe09ffff640 1 -- 172.21.15.18:0/3945534037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0a00ca7e0 msgr2=0x7fe0a015a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:10.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.594+0000 7fe09ffff640 1 --2- 172.21.15.18:0/3945534037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0a00ca7e0 0x7fe0a015a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.594+0000 7fe09ffff640 1 -- 172.21.15.18:0/3945534037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a00ce870 con 0x7fe08c0039b0 2024-09-19T09:14:10.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.594+0000 7fe0a4ffb640 1 --2- 172.21.15.18:0/3945534037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0a00ca7e0 0x7fe0a015a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:10.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.594+0000 7fe09ffff640 1 --2- 172.21.15.18:0/3945534037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe08c0039b0 0x7fe0a00cd220 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe090034040 tx=0x7fe090004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:10.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.594+0000 7fe09d7fa640 1 -- 172.21.15.18:0/3945534037 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe090040020 con 0x7fe08c0039b0 2024-09-19T09:14:10.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.594+0000 7fe09d7fa640 1 -- 172.21.15.18:0/3945534037 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe090003b40 con 0x7fe08c0039b0 2024-09-19T09:14:10.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.594+0000 7fe09d7fa640 1 -- 172.21.15.18:0/3945534037 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe090036040 con 0x7fe08c0039b0 2024-09-19T09:14:10.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.594+0000 7fe0a6a5e640 1 -- 172.21.15.18:0/3945534037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0a00ceb50 con 0x7fe08c0039b0 2024-09-19T09:14:10.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.594+0000 7fe0a6a5e640 1 -- 172.21.15.18:0/3945534037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0a00ccd00 con 0x7fe08c0039b0 2024-09-19T09:14:10.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.595+0000 7fe0a6a5e640 1 -- 172.21.15.18:0/3945534037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0a00d13a0 con 0x7fe08c0039b0 2024-09-19T09:14:10.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.596+0000 7fe09d7fa640 1 -- 172.21.15.18:0/3945534037 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe090043020 con 0x7fe08c0039b0 2024-09-19T09:14:10.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.596+0000 7fe09d7fa640 1 --2- 172.21.15.18:0/3945534037 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe08006c2e0 0x7fe08006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:10.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.596+0000 7fe09d7fa640 1 -- 172.21.15.18:0/3945534037 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fe0900ab560 con 0x7fe08c0039b0 2024-09-19T09:14:10.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.597+0000 7fe097fff640 1 --2- 172.21.15.18:0/3945534037 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe08006c2e0 0x7fe08006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:10.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.597+0000 7fe097fff640 1 --2- 172.21.15.18:0/3945534037 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe08006c2e0 0x7fe08006e7a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe088007fd0 tx=0x7fe088007970 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:10.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.601+0000 7fe09d7fa640 1 -- 172.21.15.18:0/3945534037 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe09004a070 con 0x7fe08c0039b0 2024-09-19T09:14:10.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.771+0000 7fe0a6a5e640 1 -- 172.21.15.18:0/3945534037 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe0a00cabc0 con 0x7fe08006c2e0 2024-09-19T09:14:10.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.778+0000 7fe09d7fa640 1 -- 172.21.15.18:0/3945534037 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237409 (secure 0 0 0) 0x7fe0a00cabc0 con 0x7fe08006c2e0 2024-09-19T09:14:10.783 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:10.784 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:14:10.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.781+0000 7fe0a6a5e640 1 -- 172.21.15.18:0/3945534037 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe08006c2e0 msgr2=0x7fe08006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:10.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.781+0000 7fe0a6a5e640 1 --2- 172.21.15.18:0/3945534037 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe08006c2e0 0x7fe08006e7a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe088007fd0 tx=0x7fe088007970 comp rx=0 tx=0).stop 2024-09-19T09:14:10.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.781+0000 7fe0a6a5e640 1 -- 172.21.15.18:0/3945534037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe08c0039b0 msgr2=0x7fe0a00cd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:10.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.781+0000 7fe0a6a5e640 1 --2- 172.21.15.18:0/3945534037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe08c0039b0 0x7fe0a00cd220 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe090034040 tx=0x7fe090004730 comp rx=0 tx=0).stop 2024-09-19T09:14:10.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.781+0000 7fe0a6a5e640 1 -- 172.21.15.18:0/3945534037 shutdown_connections 2024-09-19T09:14:10.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.781+0000 7fe0a6a5e640 1 --2- 172.21.15.18:0/3945534037 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe08006c2e0 0x7fe08006e7a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.781+0000 7fe0a6a5e640 1 --2- 172.21.15.18:0/3945534037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0a00ca7e0 0x7fe0a015a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.781+0000 7fe0a6a5e640 1 --2- 172.21.15.18:0/3945534037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0a0150040 0x7fe0a00ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.781+0000 7fe0a6a5e640 1 --2- 172.21.15.18:0/3945534037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe08c0039b0 0x7fe0a00cd220 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.781+0000 7fe0a6a5e640 1 -- 172.21.15.18:0/3945534037 >> 172.21.15.18:0/3945534037 conn(0x7fe0a00d4c60 msgr2=0x7fe0a00d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:10.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.781+0000 7fe0a6a5e640 1 -- 172.21.15.18:0/3945534037 shutdown_connections 2024-09-19T09:14:10.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.781+0000 7fe0a6a5e640 1 -- 172.21.15.18:0/3945534037 wait complete. 2024-09-19T09:14:10.793 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-09-19T09:14:09.534889+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2062,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560437,"statfs":{"total":1600000000,"available":1597888172,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000834"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.790988+0000","last_change":"2024-09-19T09:14:05.790988+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.790988+0000","last_undegraded":"2024-09-19T09:14:05.790988+0000","last_fullsized":"2024-09-19T09:14:05.790988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.790441+0000","last_change":"2024-09-19T09:14:05.790441+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.790441+0000","last_undegraded":"2024-09-19T09:14:05.790441+0000","last_fullsized":"2024-09-19T09:14:05.790441+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.792612+0000","last_change":"2024-09-19T09:14:05.792612+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.792612+0000","last_undegraded":"2024-09-19T09:14:05.792612+0000","last_fullsized":"2024-09-19T09:14:05.792612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.790450+0000","last_change":"2024-09-19T09:14:05.790450+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.790450+0000","last_undegraded":"2024-09-19T09:14:05.790450+0000","last_fullsized":"2024-09-19T09:14:05.790450+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:06.056748+0000","last_change":"2024-09-19T09:14:06.056748+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.056748+0000","last_undegraded":"2024-09-19T09:14:06.056748+0000","last_fullsized":"2024-09-19T09:14:06.056748+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:06.057054+0000","last_change":"2024-09-19T09:14:06.057054+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.057054+0000","last_undegraded":"2024-09-19T09:14:06.057054+0000","last_fullsized":"2024-09-19T09:14:06.057054+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.793343+0000","last_change":"2024-09-19T09:14:05.793343+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.793343+0000","last_undegraded":"2024-09-19T09:14:05.793343+0000","last_fullsized":"2024-09-19T09:14:05.793343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:06.057360+0000","last_change":"2024-09-19T09:14:06.057360+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.057360+0000","last_undegraded":"2024-09-19T09:14:06.057360+0000","last_fullsized":"2024-09-19T09:14:06.057360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.792011+0000","last_change":"2024-09-19T09:14:05.792011+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.792011+0000","last_undegraded":"2024-09-19T09:14:05.792011+0000","last_fullsized":"2024-09-19T09:14:05.792011+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.791940+0000","last_change":"2024-09-19T09:14:05.791940+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.791940+0000","last_undegraded":"2024-09-19T09:14:05.791940+0000","last_fullsized":"2024-09-19T09:14:05.791940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.790603+0000","last_change":"2024-09-19T09:14:05.790603+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.790603+0000","last_undegraded":"2024-09-19T09:14:05.790603+0000","last_fullsized":"2024-09-19T09:14:05.790603+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.791335+0000","last_change":"2024-09-19T09:14:05.791335+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.791335+0000","last_undegraded":"2024-09-19T09:14:05.791335+0000","last_fullsized":"2024-09-19T09:14:05.791335+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:06.057068+0000","last_change":"2024-09-19T09:14:06.057068+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.057068+0000","last_undegraded":"2024-09-19T09:14:06.057068+0000","last_fullsized":"2024-09-19T09:14:06.057068+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.790034+0000","last_change":"2024-09-19T09:14:05.790034+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.790034+0000","last_undegraded":"2024-09-19T09:14:05.790034+0000","last_fullsized":"2024-09-19T09:14:05.790034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.789989+0000","last_change":"2024-09-19T09:14:05.789989+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.789989+0000","last_undegraded":"2024-09-19T09:14:05.789989+0000","last_fullsized":"2024-09-19T09:14:05.789989+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.792897+0000","last_change":"2024-09-19T09:14:05.792897+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.792897+0000","last_undegraded":"2024-09-19T09:14:05.792897+0000","last_fullsized":"2024-09-19T09:14:05.792897+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.792636+0000","last_change":"2024-09-19T09:14:05.792636+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.792636+0000","last_undegraded":"2024-09-19T09:14:05.792636+0000","last_fullsized":"2024-09-19T09:14:05.792636+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:06.056797+0000","last_change":"2024-09-19T09:14:06.056797+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.056797+0000","last_undegraded":"2024-09-19T09:14:06.056797+0000","last_fullsized":"2024-09-19T09:14:06.056797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.790451+0000","last_change":"2024-09-19T09:14:05.790451+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.790451+0000","last_undegraded":"2024-09-19T09:14:05.790451+0000","last_fullsized":"2024-09-19T09:14:05.790451+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.787667+0000","last_change":"2024-09-19T09:14:05.787667+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.787667+0000","last_undegraded":"2024-09-19T09:14:05.787667+0000","last_fullsized":"2024-09-19T09:14:05.787667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.792830+0000","last_change":"2024-09-19T09:14:05.792830+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.792830+0000","last_undegraded":"2024-09-19T09:14:05.792830+0000","last_fullsized":"2024-09-19T09:14:05.792830+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:06.056699+0000","last_change":"2024-09-19T09:14:06.056699+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.056699+0000","last_undegraded":"2024-09-19T09:14:06.056699+0000","last_fullsized":"2024-09-19T09:14:06.056699+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.791009+0000","last_change":"2024-09-19T09:14:05.791009+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.791009+0000","last_undegraded":"2024-09-19T09:14:05.791009+0000","last_fullsized":"2024-09-19T09:14:05.791009+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.790048+0000","last_change":"2024-09-19T09:14:05.790048+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.790048+0000","last_undegraded":"2024-09-19T09:14:05.790048+0000","last_fullsized":"2024-09-19T09:14:05.790048+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.791685+0000","last_change":"2024-09-19T09:14:05.791685+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.791685+0000","last_undegraded":"2024-09-19T09:14:05.791685+0000","last_fullsized":"2024-09-19T09:14:05.791685+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.792421+0000","last_change":"2024-09-19T09:14:05.792421+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.792421+0000","last_undegraded":"2024-09-19T09:14:05.792421+0000","last_fullsized":"2024-09-19T09:14:05.792421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.791291+0000","last_change":"2024-09-19T09:14:05.791291+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.791291+0000","last_undegraded":"2024-09-19T09:14:05.791291+0000","last_fullsized":"2024-09-19T09:14:05.791291+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.791264+0000","last_change":"2024-09-19T09:14:05.791264+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.791264+0000","last_undegraded":"2024-09-19T09:14:05.791264+0000","last_fullsized":"2024-09-19T09:14:05.791264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.791308+0000","last_change":"2024-09-19T09:14:05.791308+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.791308+0000","last_undegraded":"2024-09-19T09:14:05.791308+0000","last_fullsized":"2024-09-19T09:14:05.791308+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:06.056724+0000","last_change":"2024-09-19T09:14:06.056724+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.056724+0000","last_undegraded":"2024-09-19T09:14:06.056724+0000","last_fullsized":"2024-09-19T09:14:06.056724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.790031+0000","last_change":"2024-09-19T09:14:05.790031+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.790031+0000","last_undegraded":"2024-09-19T09:14:05.790031+0000","last_fullsized":"2024-09-19T09:14:05.790031+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.790040+0000","last_change":"2024-09-19T09:14:05.790040+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.790040+0000","last_undegraded":"2024-09-19T09:14:05.790040+0000","last_fullsized":"2024-09-19T09:14:05.790040+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":184,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-19T09:14:05.790918+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:14:05.790918+0000","last_peered":"2024-09-19T09:14:05.790918+0000","last_clean":"2024-09-19T09:14:05.790918+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:14:05.790918+0000","last_undegraded":"2024-09-19T09:14:05.790918+0000","last_fullsized":"2024-09-19T09:14:05.790918+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:22.478151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":110,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195201,"statfs":{"total":200000000,"available":199886522,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":110,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195201,"statfs":{"total":200000000,"available":199886522,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":693,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194619,"statfs":{"total":200000000,"available":199290337,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":110,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195201,"statfs":{"total":200000000,"available":199886522,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":116,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195196,"statfs":{"total":200000000,"available":199880705,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":116,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195196,"statfs":{"total":200000000,"available":199880705,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":687,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194625,"statfs":{"total":200000000,"available":199296154,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":116,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195196,"statfs":{"total":200000000,"available":199880705,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:14:10.797 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:14:10.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.936+0000 7f5d2ad6d640 1 Processor -- start 2024-09-19T09:14:10.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.936+0000 7f5d2ad6d640 1 -- start start 2024-09-19T09:14:10.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.937+0000 7f5d2ad6d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d240cf830 0x7f5d240b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:10.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.937+0000 7f5d2ad6d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5d240cfc50 0x7f5d240b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:10.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.937+0000 7f5d2ad6d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d240aec20 con 0x7f5d2415ede0 2024-09-19T09:14:10.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.937+0000 7f5d2ad6d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f5d240aef00 con 0x7f5d240cfc50 2024-09-19T09:14:10.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.937+0000 7f5d2ad6d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5d240af1e0 con 0x7f5d240cf830 2024-09-19T09:14:10.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.937+0000 7f5d23fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d240cf830 0x7f5d240b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:10.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.937+0000 7f5d2930a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5d240cfc50 0x7f5d240b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:10.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.937+0000 7f5d28b09640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f5d2415ede0 0x7f5d240afcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:55936/0 (socket says 172.21.15.18:55936) 2024-09-19T09:14:10.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.937+0000 7f5d23fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d240cf830 0x7f5d240b43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:55154/0 (socket says 172.21.15.18:55154) 2024-09-19T09:14:10.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.937+0000 7f5d28b09640 1 -- 172.21.15.18:0/3826454021 learned_addr learned my addr 172.21.15.18:0/3826454021 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:10.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.938+0000 7f5d23fff640 1 -- 172.21.15.18:0/3826454021 >> v2:172.21.15.162:3300/0 conn(0x7f5d240cfc50 msgr2=0x7f5d240b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:10.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.938+0000 7f5d23fff640 1 --2- 172.21.15.18:0/3826454021 >> v2:172.21.15.162:3300/0 conn(0x7f5d240cfc50 0x7f5d240b48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.938+0000 7f5d23fff640 1 -- 172.21.15.18:0/3826454021 >> v1:172.21.15.162:6789/0 conn(0x7f5d2415ede0 legacy=0x7f5d240afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:10.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.938+0000 7f5d23fff640 1 -- 172.21.15.18:0/3826454021 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d240af4c0 con 0x7f5d240cf830 2024-09-19T09:14:10.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.938+0000 7f5d23fff640 1 --2- 172.21.15.18:0/3826454021 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d240cf830 0x7f5d240b43b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5d100097a0 tx=0x7f5d1002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=910fa4666fa85978 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:10.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.939+0000 7f5d237fe640 1 -- 172.21.15.18:0/3826454021 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d10037070 con 0x7f5d240cf830 2024-09-19T09:14:10.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.939+0000 7f5d237fe640 1 -- 172.21.15.18:0/3826454021 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d10032440 con 0x7f5d240cf830 2024-09-19T09:14:10.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.939+0000 7f5d237fe640 1 -- 172.21.15.18:0/3826454021 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d10032810 con 0x7f5d240cf830 2024-09-19T09:14:10.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.939+0000 7f5d2ad6d640 1 -- 172.21.15.18:0/3826454021 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d240cf830 msgr2=0x7f5d240b43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:10.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.939+0000 7f5d2ad6d640 1 --2- 172.21.15.18:0/3826454021 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d240cf830 0x7f5d240b43b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5d100097a0 tx=0x7f5d1002a180 comp rx=0 tx=0).stop 2024-09-19T09:14:10.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.939+0000 7f5d2ad6d640 1 -- 172.21.15.18:0/3826454021 shutdown_connections 2024-09-19T09:14:10.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.939+0000 7f5d2ad6d640 1 --2- 172.21.15.18:0/3826454021 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d240cf830 0x7f5d240b43b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.939+0000 7f5d2ad6d640 1 --2- 172.21.15.18:0/3826454021 >> v2:172.21.15.162:3300/0 conn(0x7f5d240cfc50 0x7f5d240b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.939+0000 7f5d2ad6d640 1 -- 172.21.15.18:0/3826454021 >> 172.21.15.18:0/3826454021 conn(0x7f5d2406bc10 msgr2=0x7f5d2406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:10.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.939+0000 7f5d2ad6d640 1 -- 172.21.15.18:0/3826454021 shutdown_connections 2024-09-19T09:14:10.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.939+0000 7f5d2ad6d640 1 -- 172.21.15.18:0/3826454021 wait complete. 2024-09-19T09:14:10.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.940+0000 7f5d2ad6d640 1 Processor -- start 2024-09-19T09:14:10.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.940+0000 7f5d2ad6d640 1 -- start start 2024-09-19T09:14:10.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.941+0000 7f5d2ad6d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d240cf830 0x7f5d241e9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:10.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.941+0000 7f5d2ad6d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d240cfc50 0x7f5d2414a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:10.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.941+0000 7f5d2ad6d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d2415ede0 0x7f5d240727e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:10.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.941+0000 7f5d2ad6d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5d240ae9c0 con 0x7f5d240cfc50 2024-09-19T09:14:10.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.941+0000 7f5d2ad6d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5d240ae840 con 0x7f5d240cf830 2024-09-19T09:14:10.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.941+0000 7f5d2ad6d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5d24071960 con 0x7f5d2415ede0 2024-09-19T09:14:10.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.941+0000 7f5d23fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d240cfc50 0x7f5d2414a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:10.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.941+0000 7f5d23fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d240cfc50 0x7f5d2414a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53834/0 (socket says 172.21.15.18:53834) 2024-09-19T09:14:10.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.941+0000 7f5d23fff640 1 -- 172.21.15.18:0/2963020955 learned_addr learned my addr 172.21.15.18:0/2963020955 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:10.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.941+0000 7f5d2930a640 1 --2- 172.21.15.18:0/2963020955 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d2415ede0 0x7f5d240727e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:10.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.941+0000 7f5d28b09640 1 --2- 172.21.15.18:0/2963020955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d240cf830 0x7f5d241e9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:10.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.942+0000 7f5d23fff640 1 -- 172.21.15.18:0/2963020955 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d2415ede0 msgr2=0x7f5d240727e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:10.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.942+0000 7f5d23fff640 1 --2- 172.21.15.18:0/2963020955 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d2415ede0 0x7f5d240727e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.942+0000 7f5d23fff640 1 -- 172.21.15.18:0/2963020955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d240cf830 msgr2=0x7f5d241e9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:10.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.942+0000 7f5d23fff640 1 --2- 172.21.15.18:0/2963020955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d240cf830 0x7f5d241e9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:10.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.942+0000 7f5d23fff640 1 -- 172.21.15.18:0/2963020955 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d241e8970 con 0x7f5d240cfc50 2024-09-19T09:14:10.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.942+0000 7f5d23fff640 1 --2- 172.21.15.18:0/2963020955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d240cfc50 0x7f5d2414a190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5d100098c0 tx=0x7f5d100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:10.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.942+0000 7f5d217fa640 1 -- 172.21.15.18:0/2963020955 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d10041070 con 0x7f5d240cfc50 2024-09-19T09:14:10.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.942+0000 7f5d217fa640 1 -- 172.21.15.18:0/2963020955 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d1003c870 con 0x7f5d240cfc50 2024-09-19T09:14:10.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.942+0000 7f5d2ad6d640 1 -- 172.21.15.18:0/2963020955 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d241e8c50 con 0x7f5d240cfc50 2024-09-19T09:14:10.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.942+0000 7f5d217fa640 1 -- 172.21.15.18:0/2963020955 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d10037040 con 0x7f5d240cfc50 2024-09-19T09:14:10.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.942+0000 7f5d2ad6d640 1 -- 172.21.15.18:0/2963020955 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d241e9210 con 0x7f5d240cfc50 2024-09-19T09:14:10.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.943+0000 7f5d2ad6d640 1 -- 172.21.15.18:0/2963020955 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d240afcc0 con 0x7f5d240cfc50 2024-09-19T09:14:10.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.944+0000 7f5d217fa640 1 -- 172.21.15.18:0/2963020955 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5d10044070 con 0x7f5d240cfc50 2024-09-19T09:14:10.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.944+0000 7f5d217fa640 1 --2- 172.21.15.18:0/2963020955 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5d0806c2b0 0x7f5d0806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:10.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.944+0000 7f5d217fa640 1 -- 172.21.15.18:0/2963020955 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f5d100ac0e0 con 0x7f5d240cfc50 2024-09-19T09:14:10.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.945+0000 7f5d28b09640 1 --2- 172.21.15.18:0/2963020955 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5d0806c2b0 0x7f5d0806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:10.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.945+0000 7f5d28b09640 1 --2- 172.21.15.18:0/2963020955 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5d0806c2b0 0x7f5d0806e770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5d241eb4d0 tx=0x7f5d18007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:10.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:10.949+0000 7f5d217fa640 1 -- 172.21.15.18:0/2963020955 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5d1007a3b0 con 0x7f5d240cfc50 2024-09-19T09:14:11.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.124+0000 7f5d2ad6d640 1 -- 172.21.15.18:0/2963020955 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5d24071dc0 con 0x7f5d0806c2b0 2024-09-19T09:14:11.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.131+0000 7f5d217fa640 1 -- 172.21.15.18:0/2963020955 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237409 (secure 0 0 0) 0x7f5d24071dc0 con 0x7f5d0806c2b0 2024-09-19T09:14:11.134 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:11.135 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:14:11.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.133+0000 7f5d2ad6d640 1 -- 172.21.15.18:0/2963020955 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5d0806c2b0 msgr2=0x7f5d0806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:11.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.133+0000 7f5d2ad6d640 1 --2- 172.21.15.18:0/2963020955 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5d0806c2b0 0x7f5d0806e770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5d241eb4d0 tx=0x7f5d18007e80 comp rx=0 tx=0).stop 2024-09-19T09:14:11.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.134+0000 7f5d2ad6d640 1 -- 172.21.15.18:0/2963020955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d240cfc50 msgr2=0x7f5d2414a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:11.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.134+0000 7f5d2ad6d640 1 --2- 172.21.15.18:0/2963020955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d240cfc50 0x7f5d2414a190 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5d100098c0 tx=0x7f5d100046c0 comp rx=0 tx=0).stop 2024-09-19T09:14:11.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.134+0000 7f5d2ad6d640 1 -- 172.21.15.18:0/2963020955 shutdown_connections 2024-09-19T09:14:11.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.134+0000 7f5d2ad6d640 1 --2- 172.21.15.18:0/2963020955 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5d0806c2b0 0x7f5d0806e770 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:11.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.134+0000 7f5d2ad6d640 1 --2- 172.21.15.18:0/2963020955 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d2415ede0 0x7f5d240727e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:11.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.134+0000 7f5d2ad6d640 1 --2- 172.21.15.18:0/2963020955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d240cfc50 0x7f5d2414a190 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:11.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.134+0000 7f5d2ad6d640 1 --2- 172.21.15.18:0/2963020955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d240cf830 0x7f5d241e9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:11.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.134+0000 7f5d2ad6d640 1 -- 172.21.15.18:0/2963020955 >> 172.21.15.18:0/2963020955 conn(0x7f5d2406bc10 msgr2=0x7f5d2415c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:11.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.134+0000 7f5d2ad6d640 1 -- 172.21.15.18:0/2963020955 shutdown_connections 2024-09-19T09:14:11.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.134+0000 7f5d2ad6d640 1 -- 172.21.15.18:0/2963020955 wait complete. 2024-09-19T09:14:11.146 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-09-19T09:14:09.534889+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2062,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560437,"statfs":{"total":1600000000,"available":1597888172,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000834"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.790988+0000","last_change":"2024-09-19T09:14:05.790988+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.790988+0000","last_undegraded":"2024-09-19T09:14:05.790988+0000","last_fullsized":"2024-09-19T09:14:05.790988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.790441+0000","last_change":"2024-09-19T09:14:05.790441+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.790441+0000","last_undegraded":"2024-09-19T09:14:05.790441+0000","last_fullsized":"2024-09-19T09:14:05.790441+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.792612+0000","last_change":"2024-09-19T09:14:05.792612+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.792612+0000","last_undegraded":"2024-09-19T09:14:05.792612+0000","last_fullsized":"2024-09-19T09:14:05.792612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.790450+0000","last_change":"2024-09-19T09:14:05.790450+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.790450+0000","last_undegraded":"2024-09-19T09:14:05.790450+0000","last_fullsized":"2024-09-19T09:14:05.790450+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:06.056748+0000","last_change":"2024-09-19T09:14:06.056748+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.056748+0000","last_undegraded":"2024-09-19T09:14:06.056748+0000","last_fullsized":"2024-09-19T09:14:06.056748+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:06.057054+0000","last_change":"2024-09-19T09:14:06.057054+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.057054+0000","last_undegraded":"2024-09-19T09:14:06.057054+0000","last_fullsized":"2024-09-19T09:14:06.057054+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.793343+0000","last_change":"2024-09-19T09:14:05.793343+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.793343+0000","last_undegraded":"2024-09-19T09:14:05.793343+0000","last_fullsized":"2024-09-19T09:14:05.793343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:06.057360+0000","last_change":"2024-09-19T09:14:06.057360+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.057360+0000","last_undegraded":"2024-09-19T09:14:06.057360+0000","last_fullsized":"2024-09-19T09:14:06.057360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.792011+0000","last_change":"2024-09-19T09:14:05.792011+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.792011+0000","last_undegraded":"2024-09-19T09:14:05.792011+0000","last_fullsized":"2024-09-19T09:14:05.792011+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.791940+0000","last_change":"2024-09-19T09:14:05.791940+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.791940+0000","last_undegraded":"2024-09-19T09:14:05.791940+0000","last_fullsized":"2024-09-19T09:14:05.791940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.790603+0000","last_change":"2024-09-19T09:14:05.790603+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.790603+0000","last_undegraded":"2024-09-19T09:14:05.790603+0000","last_fullsized":"2024-09-19T09:14:05.790603+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.791335+0000","last_change":"2024-09-19T09:14:05.791335+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.791335+0000","last_undegraded":"2024-09-19T09:14:05.791335+0000","last_fullsized":"2024-09-19T09:14:05.791335+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:06.057068+0000","last_change":"2024-09-19T09:14:06.057068+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.057068+0000","last_undegraded":"2024-09-19T09:14:06.057068+0000","last_fullsized":"2024-09-19T09:14:06.057068+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.790034+0000","last_change":"2024-09-19T09:14:05.790034+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.790034+0000","last_undegraded":"2024-09-19T09:14:05.790034+0000","last_fullsized":"2024-09-19T09:14:05.790034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.789989+0000","last_change":"2024-09-19T09:14:05.789989+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.789989+0000","last_undegraded":"2024-09-19T09:14:05.789989+0000","last_fullsized":"2024-09-19T09:14:05.789989+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.792897+0000","last_change":"2024-09-19T09:14:05.792897+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.792897+0000","last_undegraded":"2024-09-19T09:14:05.792897+0000","last_fullsized":"2024-09-19T09:14:05.792897+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.792636+0000","last_change":"2024-09-19T09:14:05.792636+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.792636+0000","last_undegraded":"2024-09-19T09:14:05.792636+0000","last_fullsized":"2024-09-19T09:14:05.792636+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:06.056797+0000","last_change":"2024-09-19T09:14:06.056797+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.056797+0000","last_undegraded":"2024-09-19T09:14:06.056797+0000","last_fullsized":"2024-09-19T09:14:06.056797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.790451+0000","last_change":"2024-09-19T09:14:05.790451+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.790451+0000","last_undegraded":"2024-09-19T09:14:05.790451+0000","last_fullsized":"2024-09-19T09:14:05.790451+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.787667+0000","last_change":"2024-09-19T09:14:05.787667+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.787667+0000","last_undegraded":"2024-09-19T09:14:05.787667+0000","last_fullsized":"2024-09-19T09:14:05.787667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.792830+0000","last_change":"2024-09-19T09:14:05.792830+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.792830+0000","last_undegraded":"2024-09-19T09:14:05.792830+0000","last_fullsized":"2024-09-19T09:14:05.792830+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:06.056699+0000","last_change":"2024-09-19T09:14:06.056699+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.056699+0000","last_undegraded":"2024-09-19T09:14:06.056699+0000","last_fullsized":"2024-09-19T09:14:06.056699+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.791009+0000","last_change":"2024-09-19T09:14:05.791009+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.791009+0000","last_undegraded":"2024-09-19T09:14:05.791009+0000","last_fullsized":"2024-09-19T09:14:05.791009+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.790048+0000","last_change":"2024-09-19T09:14:05.790048+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.790048+0000","last_undegraded":"2024-09-19T09:14:05.790048+0000","last_fullsized":"2024-09-19T09:14:05.790048+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.791685+0000","last_change":"2024-09-19T09:14:05.791685+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.791685+0000","last_undegraded":"2024-09-19T09:14:05.791685+0000","last_fullsized":"2024-09-19T09:14:05.791685+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.792421+0000","last_change":"2024-09-19T09:14:05.792421+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.792421+0000","last_undegraded":"2024-09-19T09:14:05.792421+0000","last_fullsized":"2024-09-19T09:14:05.792421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.791291+0000","last_change":"2024-09-19T09:14:05.791291+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.791291+0000","last_undegraded":"2024-09-19T09:14:05.791291+0000","last_fullsized":"2024-09-19T09:14:05.791291+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.791264+0000","last_change":"2024-09-19T09:14:05.791264+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.791264+0000","last_undegraded":"2024-09-19T09:14:05.791264+0000","last_fullsized":"2024-09-19T09:14:05.791264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.791308+0000","last_change":"2024-09-19T09:14:05.791308+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.791308+0000","last_undegraded":"2024-09-19T09:14:05.791308+0000","last_fullsized":"2024-09-19T09:14:05.791308+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:06.056724+0000","last_change":"2024-09-19T09:14:06.056724+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.056724+0000","last_undegraded":"2024-09-19T09:14:06.056724+0000","last_fullsized":"2024-09-19T09:14:06.056724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.790031+0000","last_change":"2024-09-19T09:14:05.790031+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.790031+0000","last_undegraded":"2024-09-19T09:14:05.790031+0000","last_fullsized":"2024-09-19T09:14:05.790031+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.790040+0000","last_change":"2024-09-19T09:14:05.790040+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.790040+0000","last_undegraded":"2024-09-19T09:14:05.790040+0000","last_fullsized":"2024-09-19T09:14:05.790040+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":184,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-19T09:14:05.790918+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:14:05.790918+0000","last_peered":"2024-09-19T09:14:05.790918+0000","last_clean":"2024-09-19T09:14:05.790918+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:14:05.790918+0000","last_undegraded":"2024-09-19T09:14:05.790918+0000","last_fullsized":"2024-09-19T09:14:05.790918+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:22.478151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":110,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195201,"statfs":{"total":200000000,"available":199886522,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":110,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195201,"statfs":{"total":200000000,"available":199886522,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":693,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194619,"statfs":{"total":200000000,"available":199290337,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":110,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195201,"statfs":{"total":200000000,"available":199886522,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":116,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195196,"statfs":{"total":200000000,"available":199880705,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":116,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195196,"statfs":{"total":200000000,"available":199880705,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":687,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194625,"statfs":{"total":200000000,"available":199296154,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":116,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195196,"statfs":{"total":200000000,"available":199880705,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:14:11.150 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:14:11.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.288+0000 7fcda8f8d640 1 Processor -- start 2024-09-19T09:14:11.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.288+0000 7fcda8f8d640 1 -- start start 2024-09-19T09:14:11.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.288+0000 7fcda8f8d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcda415ef80 0x7fcda40b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:11.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.288+0000 7fcda8f8d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda40cfae0 0x7fcda40cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:11.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.288+0000 7fcda8f8d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcda40cd1a0 con 0x7fcda406d730 2024-09-19T09:14:11.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.288+0000 7fcda8f8d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fcda40cd7d0 con 0x7fcda415ef80 2024-09-19T09:14:11.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.288+0000 7fcda8f8d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcda406dc30 con 0x7fcda40cfae0 2024-09-19T09:14:11.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.288+0000 7fcda2d9d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda40cfae0 0x7fcda40cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:11.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.288+0000 7fcda259c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcda415ef80 0x7fcda40b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:11.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.288+0000 7fcda259c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcda415ef80 0x7fcda40b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:47922/0 (socket says 172.21.15.18:47922) 2024-09-19T09:14:11.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.288+0000 7fcda2d9d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda40cfae0 0x7fcda40cdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:55178/0 (socket says 172.21.15.18:55178) 2024-09-19T09:14:11.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.288+0000 7fcda1d9b640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fcda406d730 0x7fcda40cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:55952/0 (socket says 172.21.15.18:55952) 2024-09-19T09:14:11.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.288+0000 7fcda259c640 1 -- 172.21.15.18:0/1720686201 learned_addr learned my addr 172.21.15.18:0/1720686201 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:11.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.288+0000 7fcda2d9d640 1 -- 172.21.15.18:0/1720686201 >> v2:172.21.15.162:3300/0 conn(0x7fcda415ef80 msgr2=0x7fcda40b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:11.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.288+0000 7fcda2d9d640 1 --2- 172.21.15.18:0/1720686201 >> v2:172.21.15.162:3300/0 conn(0x7fcda415ef80 0x7fcda40b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:11.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.288+0000 7fcda2d9d640 1 -- 172.21.15.18:0/1720686201 >> v1:172.21.15.162:6789/0 conn(0x7fcda406d730 legacy=0x7fcda40cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:11.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.289+0000 7fcda2d9d640 1 -- 172.21.15.18:0/1720686201 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcda406df10 con 0x7fcda40cfae0 2024-09-19T09:14:11.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.289+0000 7fcda259c640 1 --2- 172.21.15.18:0/1720686201 >> v2:172.21.15.162:3300/0 conn(0x7fcda415ef80 0x7fcda40b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:14:11.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.289+0000 7fcda2d9d640 1 --2- 172.21.15.18:0/1720686201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda40cfae0 0x7fcda40cdc60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c009d90 tx=0x7fcd9c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec5d89dcb09973d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:11.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.289+0000 7fcda159a640 1 -- 172.21.15.18:0/1720686201 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c007740 con 0x7fcda40cfae0 2024-09-19T09:14:11.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.290+0000 7fcda159a640 1 -- 172.21.15.18:0/1720686201 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd9c0078e0 con 0x7fcda40cfae0 2024-09-19T09:14:11.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.290+0000 7fcda159a640 1 -- 172.21.15.18:0/1720686201 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c007cb0 con 0x7fcda40cfae0 2024-09-19T09:14:11.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.290+0000 7fcda8f8d640 1 -- 172.21.15.18:0/1720686201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda40cfae0 msgr2=0x7fcda40cdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:11.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.290+0000 7fcda8f8d640 1 --2- 172.21.15.18:0/1720686201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda40cfae0 0x7fcda40cdc60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c009d90 tx=0x7fcd9c02a660 comp rx=0 tx=0).stop 2024-09-19T09:14:11.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.290+0000 7fcda8f8d640 1 -- 172.21.15.18:0/1720686201 shutdown_connections 2024-09-19T09:14:11.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.290+0000 7fcda8f8d640 1 --2- 172.21.15.18:0/1720686201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda40cfae0 0x7fcda40cdc60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:11.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.290+0000 7fcda8f8d640 1 --2- 172.21.15.18:0/1720686201 >> v2:172.21.15.162:3300/0 conn(0x7fcda415ef80 0x7fcda40b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:11.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.290+0000 7fcda8f8d640 1 -- 172.21.15.18:0/1720686201 >> 172.21.15.18:0/1720686201 conn(0x7fcda40b4700 msgr2=0x7fcda40b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:11.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.290+0000 7fcda8f8d640 1 -- 172.21.15.18:0/1720686201 shutdown_connections 2024-09-19T09:14:11.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.290+0000 7fcda8f8d640 1 -- 172.21.15.18:0/1720686201 wait complete. 2024-09-19T09:14:11.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.291+0000 7fcda8f8d640 1 Processor -- start 2024-09-19T09:14:11.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.292+0000 7fcda8f8d640 1 -- start start 2024-09-19T09:14:11.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.292+0000 7fcda8f8d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda406d730 0x7fcda40b82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:11.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.292+0000 7fcda8f8d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcda40cfae0 0x7fcda4156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:11.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.292+0000 7fcda8f8d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda415ef80 0x7fcda40cac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:11.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.292+0000 7fcda8f8d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcda40d0120 con 0x7fcda40cfae0 2024-09-19T09:14:11.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.292+0000 7fcda8f8d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcda415f360 con 0x7fcda415ef80 2024-09-19T09:14:11.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.292+0000 7fcda8f8d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcda40ce1a0 con 0x7fcda406d730 2024-09-19T09:14:11.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.292+0000 7fcda1d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcda40cfae0 0x7fcda4156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:11.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.292+0000 7fcda259c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda406d730 0x7fcda40b82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:11.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.292+0000 7fcda259c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda406d730 0x7fcda40b82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:55182/0 (socket says 172.21.15.18:55182) 2024-09-19T09:14:11.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.292+0000 7fcda1d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcda40cfae0 0x7fcda4156240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53842/0 (socket says 172.21.15.18:53842) 2024-09-19T09:14:11.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.292+0000 7fcda259c640 1 -- 172.21.15.18:0/4276701159 learned_addr learned my addr 172.21.15.18:0/4276701159 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:11.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.292+0000 7fcda2d9d640 1 --2- 172.21.15.18:0/4276701159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda415ef80 0x7fcda40cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:11.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.293+0000 7fcda259c640 1 -- 172.21.15.18:0/4276701159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda415ef80 msgr2=0x7fcda40cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:11.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.293+0000 7fcda259c640 1 --2- 172.21.15.18:0/4276701159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda415ef80 0x7fcda40cac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:11.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.293+0000 7fcda259c640 1 -- 172.21.15.18:0/4276701159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcda40cfae0 msgr2=0x7fcda4156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:11.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.293+0000 7fcda259c640 1 --2- 172.21.15.18:0/4276701159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcda40cfae0 0x7fcda4156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:11.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.293+0000 7fcda259c640 1 -- 172.21.15.18:0/4276701159 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcda40b87e0 con 0x7fcda406d730 2024-09-19T09:14:11.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.293+0000 7fcda1d9b640 1 --2- 172.21.15.18:0/4276701159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcda40cfae0 0x7fcda4156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:14:11.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.293+0000 7fcda259c640 1 --2- 172.21.15.18:0/4276701159 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda406d730 0x7fcda40b82a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcd9400e9b0 tx=0x7fcd9400ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:11.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.293+0000 7fcd92ffd640 1 -- 172.21.15.18:0/4276701159 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd94017070 con 0x7fcda406d730 2024-09-19T09:14:11.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.293+0000 7fcd92ffd640 1 -- 172.21.15.18:0/4276701159 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd9400c9a0 con 0x7fcda406d730 2024-09-19T09:14:11.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.293+0000 7fcda8f8d640 1 -- 172.21.15.18:0/4276701159 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcda40b7200 con 0x7fcda406d730 2024-09-19T09:14:11.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.293+0000 7fcd92ffd640 1 -- 172.21.15.18:0/4276701159 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd9400cd50 con 0x7fcda406d730 2024-09-19T09:14:11.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.293+0000 7fcda8f8d640 1 -- 172.21.15.18:0/4276701159 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcda40b77c0 con 0x7fcda406d730 2024-09-19T09:14:11.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.294+0000 7fcda8f8d640 1 -- 172.21.15.18:0/4276701159 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcda40cdc60 con 0x7fcda406d730 2024-09-19T09:14:11.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.295+0000 7fcd92ffd640 1 -- 172.21.15.18:0/4276701159 <== mon.2 v2:172.21.15.162:3301/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcd9401a070 con 0x7fcda406d730 2024-09-19T09:14:11.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.295+0000 7fcd92ffd640 1 --2- 172.21.15.18:0/4276701159 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcd8406c2e0 0x7fcd8406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:11.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.296+0000 7fcd92ffd640 1 -- 172.21.15.18:0/4276701159 <== mon.2 v2:172.21.15.162:3301/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fcd9408b280 con 0x7fcda406d730 2024-09-19T09:14:11.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.296+0000 7fcda1d9b640 1 --2- 172.21.15.18:0/4276701159 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcd8406c2e0 0x7fcd8406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:11.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.296+0000 7fcda1d9b640 1 --2- 172.21.15.18:0/4276701159 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcd8406c2e0 0x7fcd8406e7a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcda4161a40 tx=0x7fcd98007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:11.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.299+0000 7fcd92ffd640 1 -- 172.21.15.18:0/4276701159 <== mon.2 v2:172.21.15.162:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fcd94059410 con 0x7fcda406d730 2024-09-19T09:14:11.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.471+0000 7fcda8f8d640 1 -- 172.21.15.18:0/4276701159 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcda40d21a0 con 0x7fcd8406c2e0 2024-09-19T09:14:11.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.477+0000 7fcd92ffd640 1 -- 172.21.15.18:0/4276701159 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237409 (secure 0 0 0) 0x7fcda40d21a0 con 0x7fcd8406c2e0 2024-09-19T09:14:11.481 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:11.482 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:14:11.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.481+0000 7fcda8f8d640 1 -- 172.21.15.18:0/4276701159 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcd8406c2e0 msgr2=0x7fcd8406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:11.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.481+0000 7fcda8f8d640 1 --2- 172.21.15.18:0/4276701159 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcd8406c2e0 0x7fcd8406e7a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcda4161a40 tx=0x7fcd98007e80 comp rx=0 tx=0).stop 2024-09-19T09:14:11.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.481+0000 7fcda8f8d640 1 -- 172.21.15.18:0/4276701159 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda406d730 msgr2=0x7fcda40b82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:11.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.481+0000 7fcda8f8d640 1 --2- 172.21.15.18:0/4276701159 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda406d730 0x7fcda40b82a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcd9400e9b0 tx=0x7fcd9400ee70 comp rx=0 tx=0).stop 2024-09-19T09:14:11.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.481+0000 7fcda8f8d640 1 -- 172.21.15.18:0/4276701159 shutdown_connections 2024-09-19T09:14:11.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.481+0000 7fcda8f8d640 1 --2- 172.21.15.18:0/4276701159 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcd8406c2e0 0x7fcd8406e7a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:11.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.481+0000 7fcda8f8d640 1 --2- 172.21.15.18:0/4276701159 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcda415ef80 0x7fcda40cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:11.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.481+0000 7fcda8f8d640 1 --2- 172.21.15.18:0/4276701159 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcda40cfae0 0x7fcda4156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:11.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.481+0000 7fcda8f8d640 1 --2- 172.21.15.18:0/4276701159 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcda406d730 0x7fcda40b82a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:11.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.481+0000 7fcda8f8d640 1 -- 172.21.15.18:0/4276701159 >> 172.21.15.18:0/4276701159 conn(0x7fcda40b4700 msgr2=0x7fcda40d3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:11.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.481+0000 7fcda8f8d640 1 -- 172.21.15.18:0/4276701159 shutdown_connections 2024-09-19T09:14:11.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.481+0000 7fcda8f8d640 1 -- 172.21.15.18:0/4276701159 wait complete. 2024-09-19T09:14:11.492 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-09-19T09:14:09.534889+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2062,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560437,"statfs":{"total":1600000000,"available":1597888172,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000834"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.790988+0000","last_change":"2024-09-19T09:14:05.790988+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.790988+0000","last_undegraded":"2024-09-19T09:14:05.790988+0000","last_fullsized":"2024-09-19T09:14:05.790988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.790441+0000","last_change":"2024-09-19T09:14:05.790441+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.790441+0000","last_undegraded":"2024-09-19T09:14:05.790441+0000","last_fullsized":"2024-09-19T09:14:05.790441+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.792612+0000","last_change":"2024-09-19T09:14:05.792612+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.792612+0000","last_undegraded":"2024-09-19T09:14:05.792612+0000","last_fullsized":"2024-09-19T09:14:05.792612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.790450+0000","last_change":"2024-09-19T09:14:05.790450+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.790450+0000","last_undegraded":"2024-09-19T09:14:05.790450+0000","last_fullsized":"2024-09-19T09:14:05.790450+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:06.056748+0000","last_change":"2024-09-19T09:14:06.056748+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.056748+0000","last_undegraded":"2024-09-19T09:14:06.056748+0000","last_fullsized":"2024-09-19T09:14:06.056748+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:06.057054+0000","last_change":"2024-09-19T09:14:06.057054+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.057054+0000","last_undegraded":"2024-09-19T09:14:06.057054+0000","last_fullsized":"2024-09-19T09:14:06.057054+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.793343+0000","last_change":"2024-09-19T09:14:05.793343+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.793343+0000","last_undegraded":"2024-09-19T09:14:05.793343+0000","last_fullsized":"2024-09-19T09:14:05.793343+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:06.057360+0000","last_change":"2024-09-19T09:14:06.057360+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.057360+0000","last_undegraded":"2024-09-19T09:14:06.057360+0000","last_fullsized":"2024-09-19T09:14:06.057360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.792011+0000","last_change":"2024-09-19T09:14:05.792011+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.792011+0000","last_undegraded":"2024-09-19T09:14:05.792011+0000","last_fullsized":"2024-09-19T09:14:05.792011+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.791940+0000","last_change":"2024-09-19T09:14:05.791940+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.791940+0000","last_undegraded":"2024-09-19T09:14:05.791940+0000","last_fullsized":"2024-09-19T09:14:05.791940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.790603+0000","last_change":"2024-09-19T09:14:05.790603+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.790603+0000","last_undegraded":"2024-09-19T09:14:05.790603+0000","last_fullsized":"2024-09-19T09:14:05.790603+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.791335+0000","last_change":"2024-09-19T09:14:05.791335+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.791335+0000","last_undegraded":"2024-09-19T09:14:05.791335+0000","last_fullsized":"2024-09-19T09:14:05.791335+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:06.057068+0000","last_change":"2024-09-19T09:14:06.057068+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.057068+0000","last_undegraded":"2024-09-19T09:14:06.057068+0000","last_fullsized":"2024-09-19T09:14:06.057068+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.790034+0000","last_change":"2024-09-19T09:14:05.790034+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.790034+0000","last_undegraded":"2024-09-19T09:14:05.790034+0000","last_fullsized":"2024-09-19T09:14:05.790034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.789989+0000","last_change":"2024-09-19T09:14:05.789989+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.789989+0000","last_undegraded":"2024-09-19T09:14:05.789989+0000","last_fullsized":"2024-09-19T09:14:05.789989+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.792897+0000","last_change":"2024-09-19T09:14:05.792897+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.792897+0000","last_undegraded":"2024-09-19T09:14:05.792897+0000","last_fullsized":"2024-09-19T09:14:05.792897+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.792636+0000","last_change":"2024-09-19T09:14:05.792636+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.792636+0000","last_undegraded":"2024-09-19T09:14:05.792636+0000","last_fullsized":"2024-09-19T09:14:05.792636+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:06.056797+0000","last_change":"2024-09-19T09:14:06.056797+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.056797+0000","last_undegraded":"2024-09-19T09:14:06.056797+0000","last_fullsized":"2024-09-19T09:14:06.056797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.790451+0000","last_change":"2024-09-19T09:14:05.790451+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.790451+0000","last_undegraded":"2024-09-19T09:14:05.790451+0000","last_fullsized":"2024-09-19T09:14:05.790451+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.787667+0000","last_change":"2024-09-19T09:14:05.787667+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.787667+0000","last_undegraded":"2024-09-19T09:14:05.787667+0000","last_fullsized":"2024-09-19T09:14:05.787667+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.792830+0000","last_change":"2024-09-19T09:14:05.792830+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.792830+0000","last_undegraded":"2024-09-19T09:14:05.792830+0000","last_fullsized":"2024-09-19T09:14:05.792830+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:06.056699+0000","last_change":"2024-09-19T09:14:06.056699+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.056699+0000","last_undegraded":"2024-09-19T09:14:06.056699+0000","last_fullsized":"2024-09-19T09:14:06.056699+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.791009+0000","last_change":"2024-09-19T09:14:05.791009+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.791009+0000","last_undegraded":"2024-09-19T09:14:05.791009+0000","last_fullsized":"2024-09-19T09:14:05.791009+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.790048+0000","last_change":"2024-09-19T09:14:05.790048+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.790048+0000","last_undegraded":"2024-09-19T09:14:05.790048+0000","last_fullsized":"2024-09-19T09:14:05.790048+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.791685+0000","last_change":"2024-09-19T09:14:05.791685+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.791685+0000","last_undegraded":"2024-09-19T09:14:05.791685+0000","last_fullsized":"2024-09-19T09:14:05.791685+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.792421+0000","last_change":"2024-09-19T09:14:05.792421+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.792421+0000","last_undegraded":"2024-09-19T09:14:05.792421+0000","last_fullsized":"2024-09-19T09:14:05.792421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.791291+0000","last_change":"2024-09-19T09:14:05.791291+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.791291+0000","last_undegraded":"2024-09-19T09:14:05.791291+0000","last_fullsized":"2024-09-19T09:14:05.791291+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.791264+0000","last_change":"2024-09-19T09:14:05.791264+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.791264+0000","last_undegraded":"2024-09-19T09:14:05.791264+0000","last_fullsized":"2024-09-19T09:14:05.791264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.791308+0000","last_change":"2024-09-19T09:14:05.791308+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.791308+0000","last_undegraded":"2024-09-19T09:14:05.791308+0000","last_fullsized":"2024-09-19T09:14:05.791308+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:06.056724+0000","last_change":"2024-09-19T09:14:06.056724+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.056724+0000","last_undegraded":"2024-09-19T09:14:06.056724+0000","last_fullsized":"2024-09-19T09:14:06.056724+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.790031+0000","last_change":"2024-09-19T09:14:05.790031+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.790031+0000","last_undegraded":"2024-09-19T09:14:05.790031+0000","last_fullsized":"2024-09-19T09:14:05.790031+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:06.786297+0000","last_change":"2024-09-19T09:14:06.786297+0000","last_active":"2024-09-19T09:14:06.786297+0000","last_peered":"2024-09-19T09:14:06.786297+0000","last_clean":"2024-09-19T09:14:06.786297+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:06.786297+0000","last_undegraded":"2024-09-19T09:14:06.786297+0000","last_fullsized":"2024-09-19T09:14:06.786297+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2024-09-19T09:14:05.790040+0000","last_change":"2024-09-19T09:14:05.790040+0000","last_active":"2024-09-19T09:14:05.781502+0000","last_peered":"2024-09-19T09:14:05.781502+0000","last_clean":"2024-09-19T09:14:05.781502+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:05.790040+0000","last_undegraded":"2024-09-19T09:14:05.790040+0000","last_fullsized":"2024-09-19T09:14:05.790040+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":184,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-09-19T09:14:05.790918+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:14:05.790918+0000","last_peered":"2024-09-19T09:14:05.790918+0000","last_clean":"2024-09-19T09:14:05.790918+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:14:05.790918+0000","last_undegraded":"2024-09-19T09:14:05.790918+0000","last_fullsized":"2024-09-19T09:14:05.790918+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:22.478151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":110,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195201,"statfs":{"total":200000000,"available":199886522,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":110,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195201,"statfs":{"total":200000000,"available":199886522,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":693,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194619,"statfs":{"total":200000000,"available":199290337,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":110,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195201,"statfs":{"total":200000000,"available":199886522,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":116,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195196,"statfs":{"total":200000000,"available":199880705,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":116,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195196,"statfs":{"total":200000000,"available":199880705,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":687,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194625,"statfs":{"total":200000000,"available":199296154,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":116,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195196,"statfs":{"total":200000000,"available":199880705,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:14:11.496 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3f is not active+clean 2024-09-19T09:14:11.496 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.496 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3e is not active+clean 2024-09-19T09:14:11.496 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.496 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3d is not active+clean 2024-09-19T09:14:11.496 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.497 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3c is not active+clean 2024-09-19T09:14:11.497 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.497 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3b is not active+clean 2024-09-19T09:14:11.497 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.497 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3a is not active+clean 2024-09-19T09:14:11.497 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.497 INFO:tasks.ceph.ceph_manager.ceph:PG 5.39 is not active+clean 2024-09-19T09:14:11.497 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.497 INFO:tasks.ceph.ceph_manager.ceph:PG 5.38 is not active+clean 2024-09-19T09:14:11.497 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.498 INFO:tasks.ceph.ceph_manager.ceph:PG 5.37 is not active+clean 2024-09-19T09:14:11.498 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.498 INFO:tasks.ceph.ceph_manager.ceph:PG 5.36 is not active+clean 2024-09-19T09:14:11.498 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.498 INFO:tasks.ceph.ceph_manager.ceph:PG 5.35 is not active+clean 2024-09-19T09:14:11.498 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.498 INFO:tasks.ceph.ceph_manager.ceph:PG 5.34 is not active+clean 2024-09-19T09:14:11.498 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.498 INFO:tasks.ceph.ceph_manager.ceph:PG 5.33 is not active+clean 2024-09-19T09:14:11.498 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.498 INFO:tasks.ceph.ceph_manager.ceph:PG 5.32 is not active+clean 2024-09-19T09:14:11.498 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.499 INFO:tasks.ceph.ceph_manager.ceph:PG 5.31 is not active+clean 2024-09-19T09:14:11.499 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.499 INFO:tasks.ceph.ceph_manager.ceph:PG 5.30 is not active+clean 2024-09-19T09:14:11.499 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.499 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2f is not active+clean 2024-09-19T09:14:11.499 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.499 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2e is not active+clean 2024-09-19T09:14:11.499 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.499 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2d is not active+clean 2024-09-19T09:14:11.499 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.499 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2c is not active+clean 2024-09-19T09:14:11.500 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.500 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2b is not active+clean 2024-09-19T09:14:11.500 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.500 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2a is not active+clean 2024-09-19T09:14:11.500 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.500 INFO:tasks.ceph.ceph_manager.ceph:PG 5.29 is not active+clean 2024-09-19T09:14:11.500 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.500 INFO:tasks.ceph.ceph_manager.ceph:PG 5.28 is not active+clean 2024-09-19T09:14:11.500 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.500 INFO:tasks.ceph.ceph_manager.ceph:PG 5.27 is not active+clean 2024-09-19T09:14:11.500 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.501 INFO:tasks.ceph.ceph_manager.ceph:PG 5.26 is not active+clean 2024-09-19T09:14:11.501 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.501 INFO:tasks.ceph.ceph_manager.ceph:PG 5.25 is not active+clean 2024-09-19T09:14:11.501 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.501 INFO:tasks.ceph.ceph_manager.ceph:PG 5.24 is not active+clean 2024-09-19T09:14:11.501 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.501 INFO:tasks.ceph.ceph_manager.ceph:PG 5.23 is not active+clean 2024-09-19T09:14:11.501 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.501 INFO:tasks.ceph.ceph_manager.ceph:PG 5.22 is not active+clean 2024-09-19T09:14:11.501 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.501 INFO:tasks.ceph.ceph_manager.ceph:PG 5.21 is not active+clean 2024-09-19T09:14:11.501 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.502 INFO:tasks.ceph.ceph_manager.ceph:PG 5.20 is not active+clean 2024-09-19T09:14:11.502 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.502 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1e is not active+clean 2024-09-19T09:14:11.502 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.502 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1f is not active+clean 2024-09-19T09:14:11.502 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:05.790988+0000', 'last_change': '2024-09-19T09:14:05.790988+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:05.790988+0000', 'last_undegraded': '2024-09-19T09:14:05.790988+0000', 'last_fullsized': '2024-09-19T09:14:05.790988+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T09:14:11.502 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1f is not active+clean 2024-09-19T09:14:11.502 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.502 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1e is not active+clean 2024-09-19T09:14:11.502 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:05.790441+0000', 'last_change': '2024-09-19T09:14:05.790441+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:05.790441+0000', 'last_undegraded': '2024-09-19T09:14:05.790441+0000', 'last_fullsized': '2024-09-19T09:14:05.790441+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T09:14:11.502 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1c is not active+clean 2024-09-19T09:14:11.503 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.503 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1d is not active+clean 2024-09-19T09:14:11.503 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:05.792612+0000', 'last_change': '2024-09-19T09:14:05.792612+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:05.792612+0000', 'last_undegraded': '2024-09-19T09:14:05.792612+0000', 'last_fullsized': '2024-09-19T09:14:05.792612+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T09:14:11.503 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1d is not active+clean 2024-09-19T09:14:11.503 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.503 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1c is not active+clean 2024-09-19T09:14:11.503 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:05.790450+0000', 'last_change': '2024-09-19T09:14:05.790450+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:05.790450+0000', 'last_undegraded': '2024-09-19T09:14:05.790450+0000', 'last_fullsized': '2024-09-19T09:14:05.790450+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T09:14:11.503 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1a is not active+clean 2024-09-19T09:14:11.503 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.503 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1b is not active+clean 2024-09-19T09:14:11.503 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:06.056748+0000', 'last_change': '2024-09-19T09:14:06.056748+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.056748+0000', 'last_undegraded': '2024-09-19T09:14:06.056748+0000', 'last_fullsized': '2024-09-19T09:14:06.056748+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:14:11.504 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1b is not active+clean 2024-09-19T09:14:11.504 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.504 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1a is not active+clean 2024-09-19T09:14:11.504 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:06.057054+0000', 'last_change': '2024-09-19T09:14:06.057054+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.057054+0000', 'last_undegraded': '2024-09-19T09:14:06.057054+0000', 'last_fullsized': '2024-09-19T09:14:06.057054+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:14:11.504 INFO:tasks.ceph.ceph_manager.ceph:PG 5.18 is not active+clean 2024-09-19T09:14:11.504 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.504 INFO:tasks.ceph.ceph_manager.ceph:PG 4.19 is not active+clean 2024-09-19T09:14:11.504 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:05.793343+0000', 'last_change': '2024-09-19T09:14:05.793343+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:05.793343+0000', 'last_undegraded': '2024-09-19T09:14:05.793343+0000', 'last_fullsized': '2024-09-19T09:14:05.793343+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T09:14:11.504 INFO:tasks.ceph.ceph_manager.ceph:PG 5.19 is not active+clean 2024-09-19T09:14:11.504 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.504 INFO:tasks.ceph.ceph_manager.ceph:PG 4.18 is not active+clean 2024-09-19T09:14:11.505 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:06.057360+0000', 'last_change': '2024-09-19T09:14:06.057360+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.057360+0000', 'last_undegraded': '2024-09-19T09:14:06.057360+0000', 'last_fullsized': '2024-09-19T09:14:06.057360+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:14:11.505 INFO:tasks.ceph.ceph_manager.ceph:PG 5.16 is not active+clean 2024-09-19T09:14:11.505 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.505 INFO:tasks.ceph.ceph_manager.ceph:PG 4.17 is not active+clean 2024-09-19T09:14:11.505 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:05.792011+0000', 'last_change': '2024-09-19T09:14:05.792011+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:05.792011+0000', 'last_undegraded': '2024-09-19T09:14:05.792011+0000', 'last_fullsized': '2024-09-19T09:14:05.792011+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T09:14:11.505 INFO:tasks.ceph.ceph_manager.ceph:PG 5.17 is not active+clean 2024-09-19T09:14:11.505 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.505 INFO:tasks.ceph.ceph_manager.ceph:PG 4.16 is not active+clean 2024-09-19T09:14:11.505 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:05.791940+0000', 'last_change': '2024-09-19T09:14:05.791940+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:05.791940+0000', 'last_undegraded': '2024-09-19T09:14:05.791940+0000', 'last_fullsized': '2024-09-19T09:14:05.791940+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T09:14:11.505 INFO:tasks.ceph.ceph_manager.ceph:PG 5.14 is not active+clean 2024-09-19T09:14:11.505 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.506 INFO:tasks.ceph.ceph_manager.ceph:PG 4.15 is not active+clean 2024-09-19T09:14:11.506 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:05.790603+0000', 'last_change': '2024-09-19T09:14:05.790603+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:05.790603+0000', 'last_undegraded': '2024-09-19T09:14:05.790603+0000', 'last_fullsized': '2024-09-19T09:14:05.790603+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T09:14:11.506 INFO:tasks.ceph.ceph_manager.ceph:PG 5.15 is not active+clean 2024-09-19T09:14:11.506 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.506 INFO:tasks.ceph.ceph_manager.ceph:PG 4.14 is not active+clean 2024-09-19T09:14:11.506 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:05.791335+0000', 'last_change': '2024-09-19T09:14:05.791335+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:05.791335+0000', 'last_undegraded': '2024-09-19T09:14:05.791335+0000', 'last_fullsized': '2024-09-19T09:14:05.791335+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T09:14:11.506 INFO:tasks.ceph.ceph_manager.ceph:PG 5.12 is not active+clean 2024-09-19T09:14:11.506 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.506 INFO:tasks.ceph.ceph_manager.ceph:PG 4.13 is not active+clean 2024-09-19T09:14:11.506 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:06.057068+0000', 'last_change': '2024-09-19T09:14:06.057068+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.057068+0000', 'last_undegraded': '2024-09-19T09:14:06.057068+0000', 'last_fullsized': '2024-09-19T09:14:06.057068+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:14:11.506 INFO:tasks.ceph.ceph_manager.ceph:PG 5.13 is not active+clean 2024-09-19T09:14:11.506 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.507 INFO:tasks.ceph.ceph_manager.ceph:PG 4.12 is not active+clean 2024-09-19T09:14:11.507 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:05.790034+0000', 'last_change': '2024-09-19T09:14:05.790034+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:05.790034+0000', 'last_undegraded': '2024-09-19T09:14:05.790034+0000', 'last_fullsized': '2024-09-19T09:14:05.790034+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T09:14:11.507 INFO:tasks.ceph.ceph_manager.ceph:PG 5.10 is not active+clean 2024-09-19T09:14:11.507 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.507 INFO:tasks.ceph.ceph_manager.ceph:PG 4.11 is not active+clean 2024-09-19T09:14:11.507 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:05.789989+0000', 'last_change': '2024-09-19T09:14:05.789989+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:05.789989+0000', 'last_undegraded': '2024-09-19T09:14:05.789989+0000', 'last_fullsized': '2024-09-19T09:14:05.789989+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T09:14:11.507 INFO:tasks.ceph.ceph_manager.ceph:PG 5.11 is not active+clean 2024-09-19T09:14:11.507 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.507 INFO:tasks.ceph.ceph_manager.ceph:PG 4.10 is not active+clean 2024-09-19T09:14:11.507 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:05.792897+0000', 'last_change': '2024-09-19T09:14:05.792897+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:05.792897+0000', 'last_undegraded': '2024-09-19T09:14:05.792897+0000', 'last_fullsized': '2024-09-19T09:14:05.792897+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T09:14:11.507 INFO:tasks.ceph.ceph_manager.ceph:PG 5.e is not active+clean 2024-09-19T09:14:11.508 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.508 INFO:tasks.ceph.ceph_manager.ceph:PG 4.f is not active+clean 2024-09-19T09:14:11.508 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:05.792636+0000', 'last_change': '2024-09-19T09:14:05.792636+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:05.792636+0000', 'last_undegraded': '2024-09-19T09:14:05.792636+0000', 'last_fullsized': '2024-09-19T09:14:05.792636+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T09:14:11.508 INFO:tasks.ceph.ceph_manager.ceph:PG 5.f is not active+clean 2024-09-19T09:14:11.508 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.508 INFO:tasks.ceph.ceph_manager.ceph:PG 4.e is not active+clean 2024-09-19T09:14:11.508 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:06.056797+0000', 'last_change': '2024-09-19T09:14:06.056797+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.056797+0000', 'last_undegraded': '2024-09-19T09:14:06.056797+0000', 'last_fullsized': '2024-09-19T09:14:06.056797+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:14:11.508 INFO:tasks.ceph.ceph_manager.ceph:PG 5.c is not active+clean 2024-09-19T09:14:11.508 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.508 INFO:tasks.ceph.ceph_manager.ceph:PG 4.d is not active+clean 2024-09-19T09:14:11.508 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:05.790451+0000', 'last_change': '2024-09-19T09:14:05.790451+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:05.790451+0000', 'last_undegraded': '2024-09-19T09:14:05.790451+0000', 'last_fullsized': '2024-09-19T09:14:05.790451+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T09:14:11.509 INFO:tasks.ceph.ceph_manager.ceph:PG 5.d is not active+clean 2024-09-19T09:14:11.509 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.509 INFO:tasks.ceph.ceph_manager.ceph:PG 4.c is not active+clean 2024-09-19T09:14:11.509 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:05.787667+0000', 'last_change': '2024-09-19T09:14:05.787667+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:05.787667+0000', 'last_undegraded': '2024-09-19T09:14:05.787667+0000', 'last_fullsized': '2024-09-19T09:14:05.787667+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T09:14:11.509 INFO:tasks.ceph.ceph_manager.ceph:PG 5.a is not active+clean 2024-09-19T09:14:11.509 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.509 INFO:tasks.ceph.ceph_manager.ceph:PG 4.b is not active+clean 2024-09-19T09:14:11.509 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:05.792830+0000', 'last_change': '2024-09-19T09:14:05.792830+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:05.792830+0000', 'last_undegraded': '2024-09-19T09:14:05.792830+0000', 'last_fullsized': '2024-09-19T09:14:05.792830+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T09:14:11.509 INFO:tasks.ceph.ceph_manager.ceph:PG 5.b is not active+clean 2024-09-19T09:14:11.509 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.509 INFO:tasks.ceph.ceph_manager.ceph:PG 4.a is not active+clean 2024-09-19T09:14:11.509 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:06.056699+0000', 'last_change': '2024-09-19T09:14:06.056699+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.056699+0000', 'last_undegraded': '2024-09-19T09:14:06.056699+0000', 'last_fullsized': '2024-09-19T09:14:06.056699+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:14:11.510 INFO:tasks.ceph.ceph_manager.ceph:PG 5.8 is not active+clean 2024-09-19T09:14:11.510 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.510 INFO:tasks.ceph.ceph_manager.ceph:PG 4.9 is not active+clean 2024-09-19T09:14:11.510 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:05.791009+0000', 'last_change': '2024-09-19T09:14:05.791009+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:05.791009+0000', 'last_undegraded': '2024-09-19T09:14:05.791009+0000', 'last_fullsized': '2024-09-19T09:14:05.791009+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T09:14:11.510 INFO:tasks.ceph.ceph_manager.ceph:PG 5.9 is not active+clean 2024-09-19T09:14:11.510 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.510 INFO:tasks.ceph.ceph_manager.ceph:PG 4.8 is not active+clean 2024-09-19T09:14:11.510 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:05.790048+0000', 'last_change': '2024-09-19T09:14:05.790048+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:05.790048+0000', 'last_undegraded': '2024-09-19T09:14:05.790048+0000', 'last_fullsized': '2024-09-19T09:14:05.790048+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T09:14:11.510 INFO:tasks.ceph.ceph_manager.ceph:PG 5.6 is not active+clean 2024-09-19T09:14:11.510 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.510 INFO:tasks.ceph.ceph_manager.ceph:PG 4.7 is not active+clean 2024-09-19T09:14:11.511 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:05.791685+0000', 'last_change': '2024-09-19T09:14:05.791685+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:05.791685+0000', 'last_undegraded': '2024-09-19T09:14:05.791685+0000', 'last_fullsized': '2024-09-19T09:14:05.791685+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T09:14:11.511 INFO:tasks.ceph.ceph_manager.ceph:PG 5.7 is not active+clean 2024-09-19T09:14:11.511 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.511 INFO:tasks.ceph.ceph_manager.ceph:PG 4.6 is not active+clean 2024-09-19T09:14:11.511 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:05.792421+0000', 'last_change': '2024-09-19T09:14:05.792421+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:05.792421+0000', 'last_undegraded': '2024-09-19T09:14:05.792421+0000', 'last_fullsized': '2024-09-19T09:14:05.792421+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T09:14:11.511 INFO:tasks.ceph.ceph_manager.ceph:PG 5.5 is not active+clean 2024-09-19T09:14:11.511 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.511 INFO:tasks.ceph.ceph_manager.ceph:PG 4.4 is not active+clean 2024-09-19T09:14:11.511 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:05.791291+0000', 'last_change': '2024-09-19T09:14:05.791291+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:05.791291+0000', 'last_undegraded': '2024-09-19T09:14:05.791291+0000', 'last_fullsized': '2024-09-19T09:14:05.791291+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T09:14:11.511 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2 is not active+clean 2024-09-19T09:14:11.511 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.512 INFO:tasks.ceph.ceph_manager.ceph:PG 4.3 is not active+clean 2024-09-19T09:14:11.512 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:05.791264+0000', 'last_change': '2024-09-19T09:14:05.791264+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:05.791264+0000', 'last_undegraded': '2024-09-19T09:14:05.791264+0000', 'last_fullsized': '2024-09-19T09:14:05.791264+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T09:14:11.512 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3 is not active+clean 2024-09-19T09:14:11.512 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.512 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2 is not active+clean 2024-09-19T09:14:11.512 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:05.791308+0000', 'last_change': '2024-09-19T09:14:05.791308+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:05.791308+0000', 'last_undegraded': '2024-09-19T09:14:05.791308+0000', 'last_fullsized': '2024-09-19T09:14:05.791308+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T09:14:11.512 INFO:tasks.ceph.ceph_manager.ceph:PG 5.0 is not active+clean 2024-09-19T09:14:11.512 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.512 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1 is not active+clean 2024-09-19T09:14:11.512 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:06.056724+0000', 'last_change': '2024-09-19T09:14:06.056724+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.056724+0000', 'last_undegraded': '2024-09-19T09:14:06.056724+0000', 'last_fullsized': '2024-09-19T09:14:06.056724+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:14:11.512 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1 is not active+clean 2024-09-19T09:14:11.513 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.513 INFO:tasks.ceph.ceph_manager.ceph:PG 4.0 is not active+clean 2024-09-19T09:14:11.513 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:05.790031+0000', 'last_change': '2024-09-19T09:14:05.790031+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:05.790031+0000', 'last_undegraded': '2024-09-19T09:14:05.790031+0000', 'last_fullsized': '2024-09-19T09:14:05.790031+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T09:14:11.513 INFO:tasks.ceph.ceph_manager.ceph:PG 5.4 is not active+clean 2024-09-19T09:14:11.513 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:14:06.786297+0000', 'last_change': '2024-09-19T09:14:06.786297+0000', 'last_active': '2024-09-19T09:14:06.786297+0000', 'last_peered': '2024-09-19T09:14:06.786297+0000', 'last_clean': '2024-09-19T09:14:06.786297+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:06.786297+0000', 'last_undegraded': '2024-09-19T09:14:06.786297+0000', 'last_fullsized': '2024-09-19T09:14:06.786297+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:06.786297+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:14:11.513 INFO:tasks.ceph.ceph_manager.ceph:PG 4.5 is not active+clean 2024-09-19T09:14:11.513 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:14:05.790040+0000', 'last_change': '2024-09-19T09:14:05.790040+0000', 'last_active': '2024-09-19T09:14:05.781502+0000', 'last_peered': '2024-09-19T09:14:05.781502+0000', 'last_clean': '2024-09-19T09:14:05.781502+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:14:05.790040+0000', 'last_undegraded': '2024-09-19T09:14:05.790040+0000', 'last_fullsized': '2024-09-19T09:14:05.790040+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'last_clean_scrub_stamp': '2024-09-19T09:14:05.781502+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T09:14:11.514 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T09:14:11.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.632+0000 7ff5afe0a640 1 Processor -- start 2024-09-19T09:14:11.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.632+0000 7ff5afe0a640 1 -- start start 2024-09-19T09:14:11.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.633+0000 7ff5afe0a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff5a8072f40 0x7ff5a806f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:11.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.633+0000 7ff5afe0a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff5a80ce780 0x7ff5a80b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:11.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.633+0000 7ff5afe0a640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5a806e3d0 con 0x7ff5a8145290 2024-09-19T09:14:11.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.633+0000 7ff5afe0a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff5a806efe0 con 0x7ff5a8072f40 2024-09-19T09:14:11.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.633+0000 7ff5afe0a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff5a806e6b0 con 0x7ff5a80ce780 2024-09-19T09:14:11.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.633+0000 7ff5adba6640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff5a8145290 0x7ff5a8072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:38478/0 (socket says 172.21.15.18:38478) 2024-09-19T09:14:11.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.633+0000 7ff5adba6640 1 -- 172.21.15.18:0/4245667323 learned_addr learned my addr 172.21.15.18:0/4245667323 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:11.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.633+0000 7ff5ad3a5640 1 --2- 172.21.15.18:0/4245667323 >> v2:172.21.15.162:3300/0 conn(0x7ff5a8072f40 0x7ff5a806f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:11.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.633+0000 7ff5acba4640 1 -- 172.21.15.18:0/4245667323 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 238158636 0 0) 0x7ff5a806e3d0 con 0x7ff5a8145290 2024-09-19T09:14:11.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.633+0000 7ff5ae3a7640 1 --2- 172.21.15.18:0/4245667323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff5a80ce780 0x7ff5a80b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:11.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.633+0000 7ff5acba4640 1 -- 172.21.15.18:0/4245667323 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff594003520 con 0x7ff5a8145290 2024-09-19T09:14:11.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.633+0000 7ff5acba4640 1 -- 172.21.15.18:0/4245667323 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 278240176 0 0) 0x7ff594003520 con 0x7ff5a8145290 2024-09-19T09:14:11.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.633+0000 7ff5acba4640 1 -- 172.21.15.18:0/4245667323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff5a80ce780 msgr2=0x7ff5a80b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:11.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.634+0000 7ff5acba4640 1 --2- 172.21.15.18:0/4245667323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff5a80ce780 0x7ff5a80b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:11.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.634+0000 7ff5acba4640 1 -- 172.21.15.18:0/4245667323 >> v2:172.21.15.162:3300/0 conn(0x7ff5a8072f40 msgr2=0x7ff5a806f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:11.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.634+0000 7ff5acba4640 1 --2- 172.21.15.18:0/4245667323 >> v2:172.21.15.162:3300/0 conn(0x7ff5a8072f40 0x7ff5a806f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:11.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.634+0000 7ff5acba4640 1 -- 172.21.15.18:0/4245667323 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a806e990 con 0x7ff5a8145290 2024-09-19T09:14:11.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.634+0000 7ff5acba4640 1 -- 172.21.15.18:0/4245667323 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7ff5a4001670 con 0x7ff5a8145290 2024-09-19T09:14:11.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.634+0000 7ff5acba4640 1 -- 172.21.15.18:0/4245667323 >> v1:172.21.15.18:6789/0 conn(0x7ff5a8145290 legacy=0x7ff5a8072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:11.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.634+0000 7ff5acba4640 1 --2- 172.21.15.18:0/4245667323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff5a80ce780 0x7ff5940039d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:11.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.634+0000 7ff5acba4640 1 --2- 172.21.15.18:0/4245667323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff594003f50 0x7ff594004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:11.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.634+0000 7ff5acba4640 1 --2- 172.21.15.18:0/4245667323 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff594004d40 0x7ff5940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:11.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.634+0000 7ff5acba4640 1 -- 172.21.15.18:0/4245667323 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a806efe0 con 0x7ff594004d40 2024-09-19T09:14:11.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.634+0000 7ff5acba4640 1 -- 172.21.15.18:0/4245667323 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a806e6b0 con 0x7ff594003f50 2024-09-19T09:14:11.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.634+0000 7ff5acba4640 1 -- 172.21.15.18:0/4245667323 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff59400b9c0 con 0x7ff5a80ce780 2024-09-19T09:14:11.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.634+0000 7ff5ae3a7640 1 --2- 172.21.15.18:0/4245667323 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff594004d40 0x7ff5940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:11.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.634+0000 7ff5ad3a5640 1 --2- 172.21.15.18:0/4245667323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff594003f50 0x7ff594004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:11.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.634+0000 7ff5adba6640 1 --2- 172.21.15.18:0/4245667323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff5a80ce780 0x7ff5940039d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:11.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.634+0000 7ff5ae3a7640 1 -- 172.21.15.18:0/4245667323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff5a80ce780 msgr2=0x7ff5940039d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:11.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.634+0000 7ff5ae3a7640 1 --2- 172.21.15.18:0/4245667323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff5a80ce780 0x7ff5940039d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:11.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.634+0000 7ff5ae3a7640 1 -- 172.21.15.18:0/4245667323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff594003f50 msgr2=0x7ff594004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:11.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.634+0000 7ff5ae3a7640 1 --2- 172.21.15.18:0/4245667323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff594003f50 0x7ff594004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:11.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.634+0000 7ff5ae3a7640 1 -- 172.21.15.18:0/4245667323 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff594003520 con 0x7ff594004d40 2024-09-19T09:14:11.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.635+0000 7ff5ae3a7640 1 --2- 172.21.15.18:0/4245667323 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff594004d40 0x7ff5940051c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0009fc0 tx=0x7ff594005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234359c7a869b1a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:11.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.635+0000 7ff5acba4640 1 -- 172.21.15.18:0/4245667323 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0009c10 con 0x7ff594004d40 2024-09-19T09:14:11.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.635+0000 7ff5acba4640 1 -- 172.21.15.18:0/4245667323 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5a002e610 con 0x7ff594004d40 2024-09-19T09:14:11.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.635+0000 7ff5acba4640 1 -- 172.21.15.18:0/4245667323 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a002e9c0 con 0x7ff594004d40 2024-09-19T09:14:11.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.635+0000 7ff5afe0a640 1 -- 172.21.15.18:0/4245667323 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff594004d40 msgr2=0x7ff5940051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:11.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.635+0000 7ff5afe0a640 1 --2- 172.21.15.18:0/4245667323 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff594004d40 0x7ff5940051c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0009fc0 tx=0x7ff594005830 comp rx=0 tx=0).stop 2024-09-19T09:14:11.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.635+0000 7ff5ae3a7640 1 -- 172.21.15.18:0/4245667323 reap_dead start 2024-09-19T09:14:11.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.636+0000 7ff5afe0a640 1 -- 172.21.15.18:0/4245667323 shutdown_connections 2024-09-19T09:14:11.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.636+0000 7ff5afe0a640 1 -- 172.21.15.18:0/4245667323 >> 172.21.15.18:0/4245667323 conn(0x7ff5a806bc10 msgr2=0x7ff5a806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:11.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.636+0000 7ff5afe0a640 1 -- 172.21.15.18:0/4245667323 shutdown_connections 2024-09-19T09:14:11.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.636+0000 7ff5afe0a640 1 -- 172.21.15.18:0/4245667323 wait complete. 2024-09-19T09:14:11.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.637+0000 7ff5afe0a640 1 Processor -- start 2024-09-19T09:14:11.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.637+0000 7ff5afe0a640 1 -- start start 2024-09-19T09:14:11.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.638+0000 7ff5afe0a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff5a8151ff0 0x7ff5a80af170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:11.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.638+0000 7ff5afe0a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5a815bfa0 0x7ff5a80b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:11.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.638+0000 7ff5afe0a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5a815b720 0x7ff5a80b5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:11.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.638+0000 7ff5afe0a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a806df80 con 0x7ff5a815bfa0 2024-09-19T09:14:11.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.638+0000 7ff5afe0a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a8145670 con 0x7ff5a815b720 2024-09-19T09:14:11.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.638+0000 7ff5afe0a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff5a806e100 con 0x7ff5a8151ff0 2024-09-19T09:14:11.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.638+0000 7ff5ad3a5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5a815bfa0 0x7ff5a80b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:11.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.638+0000 7ff5ad3a5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5a815bfa0 0x7ff5a80b50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53862/0 (socket says 172.21.15.18:53862) 2024-09-19T09:14:11.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.638+0000 7ff5ad3a5640 1 -- 172.21.15.18:0/1968081332 learned_addr learned my addr 172.21.15.18:0/1968081332 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:11.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.638+0000 7ff5ae3a7640 1 --2- 172.21.15.18:0/1968081332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5a815b720 0x7ff5a80b5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:11.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.638+0000 7ff5adba6640 1 --2- 172.21.15.18:0/1968081332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff5a8151ff0 0x7ff5a80af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:11.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.638+0000 7ff5ad3a5640 1 -- 172.21.15.18:0/1968081332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff5a8151ff0 msgr2=0x7ff5a80af170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:11.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.638+0000 7ff5ad3a5640 1 --2- 172.21.15.18:0/1968081332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff5a8151ff0 0x7ff5a80af170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:11.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.638+0000 7ff5ad3a5640 1 -- 172.21.15.18:0/1968081332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5a815b720 msgr2=0x7ff5a80b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:11.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.638+0000 7ff5ad3a5640 1 --2- 172.21.15.18:0/1968081332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5a815b720 0x7ff5a80b5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:11.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.638+0000 7ff5ad3a5640 1 -- 172.21.15.18:0/1968081332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a80af6b0 con 0x7ff5a815bfa0 2024-09-19T09:14:11.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.638+0000 7ff5ad3a5640 1 --2- 172.21.15.18:0/1968081332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5a815bfa0 0x7ff5a80b50f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff598011960 tx=0x7ff598011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:11.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.638+0000 7ff59e7fc640 1 -- 172.21.15.18:0/1968081332 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59800fa90 con 0x7ff5a815bfa0 2024-09-19T09:14:11.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.638+0000 7ff59e7fc640 1 -- 172.21.15.18:0/1968081332 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff59800fc30 con 0x7ff5a815bfa0 2024-09-19T09:14:11.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.638+0000 7ff5afe0a640 1 -- 172.21.15.18:0/1968081332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5a815e7b0 con 0x7ff5a815bfa0 2024-09-19T09:14:11.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.638+0000 7ff59e7fc640 1 -- 172.21.15.18:0/1968081332 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff598014440 con 0x7ff5a815bfa0 2024-09-19T09:14:11.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.638+0000 7ff5afe0a640 1 -- 172.21.15.18:0/1968081332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5a815ed40 con 0x7ff5a815bfa0 2024-09-19T09:14:11.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.639+0000 7ff5afe0a640 1 -- 172.21.15.18:0/1968081332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5a8071510 con 0x7ff5a815bfa0 2024-09-19T09:14:11.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.640+0000 7ff59e7fc640 1 -- 172.21.15.18:0/1968081332 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff598012040 con 0x7ff5a815bfa0 2024-09-19T09:14:11.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.640+0000 7ff59e7fc640 1 --2- 172.21.15.18:0/1968081332 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff58c06c2e0 0x7ff58c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:11.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.640+0000 7ff59e7fc640 1 -- 172.21.15.18:0/1968081332 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ff59808bae0 con 0x7ff5a815bfa0 2024-09-19T09:14:11.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.641+0000 7ff5adba6640 1 --2- 172.21.15.18:0/1968081332 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff58c06c2e0 0x7ff58c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:11.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.641+0000 7ff5adba6640 1 --2- 172.21.15.18:0/1968081332 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff58c06c2e0 0x7ff58c06e7a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4004840 tx=0x7ff5a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:11.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.645+0000 7ff59e7fc640 1 -- 172.21.15.18:0/1968081332 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff598019030 con 0x7ff5a815bfa0 2024-09-19T09:14:11.779 INFO:tasks.ceph.mds.a.smithi018.stderr:2024-09-19T09:14:11.778+0000 7f5811e05640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T09:14:11.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.890+0000 7ff5afe0a640 1 -- 172.21.15.18:0/1968081332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7ff5a80b08f0 con 0x7ff5a815bfa0 2024-09-19T09:14:11.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.890+0000 7ff59e7fc640 1 -- 172.21.15.18:0/1968081332 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1048 (secure 0 0 0) 0x7ff59805a1c0 con 0x7ff5a815bfa0 2024-09-19T09:14:11.891 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:11.891 INFO:teuthology.orchestra.run.smithi018.stdout:{"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":60,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":32,"num_osds":8,"num_up_osds":8,"osd_up_since":1726737196,"num_in_osds":8,"osd_in_since":1726737193,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":2294716,"bytes_avail":1597705284,"bytes_total":1600000000,"write_bytes_sec":2495,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":13,"btime":"2024-09-19T09:14:09:822716+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4785}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-19T09:13:11.349867+0000","services":{}},"progress_events":{}} 2024-09-19T09:14:11.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.892+0000 7ff5afe0a640 1 -- 172.21.15.18:0/1968081332 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff58c06c2e0 msgr2=0x7ff58c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.892+0000 7ff5afe0a640 1 --2- 172.21.15.18:0/1968081332 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff58c06c2e0 0x7ff58c06e7a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4004840 tx=0x7ff5a4009040 comp rx=0 tx=0).stop 2024-09-19T09:14:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.892+0000 7ff5afe0a640 1 -- 172.21.15.18:0/1968081332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5a815bfa0 msgr2=0x7ff5a80b50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.892+0000 7ff5afe0a640 1 --2- 172.21.15.18:0/1968081332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5a815bfa0 0x7ff5a80b50f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff598011960 tx=0x7ff598011e20 comp rx=0 tx=0).stop 2024-09-19T09:14:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.892+0000 7ff5afe0a640 1 -- 172.21.15.18:0/1968081332 shutdown_connections 2024-09-19T09:14:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.892+0000 7ff5afe0a640 1 --2- 172.21.15.18:0/1968081332 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff58c06c2e0 0x7ff58c06e7a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.892+0000 7ff5afe0a640 1 --2- 172.21.15.18:0/1968081332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5a815b720 0x7ff5a80b5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.892+0000 7ff5afe0a640 1 --2- 172.21.15.18:0/1968081332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5a815bfa0 0x7ff5a80b50f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.892+0000 7ff5afe0a640 1 --2- 172.21.15.18:0/1968081332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff5a8151ff0 0x7ff5a80af170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.892+0000 7ff5afe0a640 1 -- 172.21.15.18:0/1968081332 >> 172.21.15.18:0/1968081332 conn(0x7ff5a806bc10 msgr2=0x7ff5a80cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.892+0000 7ff5afe0a640 1 -- 172.21.15.18:0/1968081332 shutdown_connections 2024-09-19T09:14:11.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:11.892+0000 7ff5afe0a640 1 -- 172.21.15.18:0/1968081332 wait complete. 2024-09-19T09:14:11.903 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-19T09:14:11.903 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:14:12.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.005+0000 7f41bdb9f640 1 Processor -- start 2024-09-19T09:14:12.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.005+0000 7f41bdb9f640 1 -- start start 2024-09-19T09:14:12.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.006+0000 7f41bdb9f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f41b80d2680 0x7f41b80cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:12.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.006+0000 7f41bdb9f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41b80cfac0 0x7f41b80c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:12.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.006+0000 7f41bdb9f640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41b80d2bd0 con 0x7f41b815e970 2024-09-19T09:14:12.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.006+0000 7f41bdb9f640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f41b80d37e0 con 0x7f41b80d2680 2024-09-19T09:14:12.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.006+0000 7f41bdb9f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f41b80d2eb0 con 0x7f41b80cfac0 2024-09-19T09:14:12.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.006+0000 7f41b7fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f41b80d2680 0x7f41b80cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:12.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.006+0000 7f41b7fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f41b80d2680 0x7f41b80cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53876/0 (socket says 172.21.15.18:53876) 2024-09-19T09:14:12.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.006+0000 7f41b7fff640 1 -- 172.21.15.18:0/2058251239 learned_addr learned my addr 172.21.15.18:0/2058251239 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:12.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.006+0000 7f41bd39e640 1 --2- 172.21.15.18:0/2058251239 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41b80cfac0 0x7f41b80c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:12.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.006+0000 7f41b7fff640 1 -- 172.21.15.18:0/2058251239 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41b80cfac0 msgr2=0x7f41b80c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:12.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.006+0000 7f41b7fff640 1 --2- 172.21.15.18:0/2058251239 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41b80cfac0 0x7f41b80c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:12.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.006+0000 7f41b7fff640 1 -- 172.21.15.18:0/2058251239 >> v1:172.21.15.162:6789/0 conn(0x7f41b815e970 legacy=0x7f41b80d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:12.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.006+0000 7f41b7fff640 1 -- 172.21.15.18:0/2058251239 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41b80d3190 con 0x7f41b80d2680 2024-09-19T09:14:12.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.007+0000 7f41b7fff640 1 --2- 172.21.15.18:0/2058251239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41b80d2680 0x7f41b80cf580 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f41ac009870 tx=0x7f41ac02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cd2cbf973516ae7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:12.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.007+0000 7f41b77fe640 1 -- 172.21.15.18:0/2058251239 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ac037070 con 0x7f41b80d2680 2024-09-19T09:14:12.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.007+0000 7f41b77fe640 1 -- 172.21.15.18:0/2058251239 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41ac02ae50 con 0x7f41b80d2680 2024-09-19T09:14:12.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.007+0000 7f41b77fe640 1 -- 172.21.15.18:0/2058251239 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ac032860 con 0x7f41b80d2680 2024-09-19T09:14:12.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.008+0000 7f41bdb9f640 1 -- 172.21.15.18:0/2058251239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41b80d2680 msgr2=0x7f41b80cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:12.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.008+0000 7f41bdb9f640 1 --2- 172.21.15.18:0/2058251239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41b80d2680 0x7f41b80cf580 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f41ac009870 tx=0x7f41ac02a300 comp rx=0 tx=0).stop 2024-09-19T09:14:12.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.008+0000 7f41bdb9f640 1 -- 172.21.15.18:0/2058251239 shutdown_connections 2024-09-19T09:14:12.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.008+0000 7f41bdb9f640 1 --2- 172.21.15.18:0/2058251239 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41b80cfac0 0x7f41b80c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:12.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.008+0000 7f41bdb9f640 1 --2- 172.21.15.18:0/2058251239 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41b80d2680 0x7f41b80cf580 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:12.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.008+0000 7f41bdb9f640 1 -- 172.21.15.18:0/2058251239 >> 172.21.15.18:0/2058251239 conn(0x7f41b809de00 msgr2=0x7f41b80d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:12.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.008+0000 7f41bdb9f640 1 -- 172.21.15.18:0/2058251239 shutdown_connections 2024-09-19T09:14:12.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.008+0000 7f41bdb9f640 1 -- 172.21.15.18:0/2058251239 wait complete. 2024-09-19T09:14:12.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.009+0000 7f41bdb9f640 1 Processor -- start 2024-09-19T09:14:12.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.009+0000 7f41bdb9f640 1 -- start start 2024-09-19T09:14:12.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.010+0000 7f41bdb9f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41b80cfac0 0x7f41b815f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:12.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.010+0000 7f41bdb9f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41b80d2680 0x7f41b8147f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:12.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.010+0000 7f41bdb9f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41b815e970 0x7f41b8160130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:12.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.010+0000 7f41bdb9f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f41b815ed50 con 0x7f41b815e970 2024-09-19T09:14:12.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.010+0000 7f41bdb9f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f41b80cff50 con 0x7f41b80d2680 2024-09-19T09:14:12.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.010+0000 7f41bdb9f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f41b815eed0 con 0x7f41b80cfac0 2024-09-19T09:14:12.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.010+0000 7f41bd39e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41b815e970 0x7f41b8160130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:12.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.010+0000 7f41bd39e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41b815e970 0x7f41b8160130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53878/0 (socket says 172.21.15.18:53878) 2024-09-19T09:14:12.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.010+0000 7f41bd39e640 1 -- 172.21.15.18:0/2869264442 learned_addr learned my addr 172.21.15.18:0/2869264442 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:12.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.010+0000 7f41b7fff640 1 --2- 172.21.15.18:0/2869264442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41b80d2680 0x7f41b8147f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:12.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.010+0000 7f41bcb9d640 1 --2- 172.21.15.18:0/2869264442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41b80cfac0 0x7f41b815f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:12.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.011+0000 7f41bd39e640 1 -- 172.21.15.18:0/2869264442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41b80cfac0 msgr2=0x7f41b815f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:12.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.011+0000 7f41bd39e640 1 --2- 172.21.15.18:0/2869264442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41b80cfac0 0x7f41b815f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:12.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.011+0000 7f41bd39e640 1 -- 172.21.15.18:0/2869264442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41b80d2680 msgr2=0x7f41b8147f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:12.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.011+0000 7f41bd39e640 1 --2- 172.21.15.18:0/2869264442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41b80d2680 0x7f41b8147f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:12.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.011+0000 7f41bd39e640 1 -- 172.21.15.18:0/2869264442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41b815fc50 con 0x7f41b815e970 2024-09-19T09:14:12.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.011+0000 7f41bd39e640 1 --2- 172.21.15.18:0/2869264442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41b815e970 0x7f41b8160130 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f41b0007e40 tx=0x7f41b000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:12.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.011+0000 7f41b57fa640 1 -- 172.21.15.18:0/2869264442 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b0014620 con 0x7f41b815e970 2024-09-19T09:14:12.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.011+0000 7f41b57fa640 1 -- 172.21.15.18:0/2869264442 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41b0019070 con 0x7f41b815e970 2024-09-19T09:14:12.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.011+0000 7f41bdb9f640 1 -- 172.21.15.18:0/2869264442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41b81f4380 con 0x7f41b815e970 2024-09-19T09:14:12.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.011+0000 7f41b57fa640 1 -- 172.21.15.18:0/2869264442 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41b0014a20 con 0x7f41b815e970 2024-09-19T09:14:12.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.011+0000 7f41bdb9f640 1 -- 172.21.15.18:0/2869264442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41b80cc000 con 0x7f41b815e970 2024-09-19T09:14:12.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.012+0000 7f41bdb9f640 1 -- 172.21.15.18:0/2869264442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41b815fe20 con 0x7f41b815e970 2024-09-19T09:14:12.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.012+0000 7f41b57fa640 1 -- 172.21.15.18:0/2869264442 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f41b0014bc0 con 0x7f41b815e970 2024-09-19T09:14:12.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.013+0000 7f41b57fa640 1 --2- 172.21.15.18:0/2869264442 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f41a406c2b0 0x7f41a406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:12.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.013+0000 7f41b57fa640 1 -- 172.21.15.18:0/2869264442 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f41b008bbc0 con 0x7f41b815e970 2024-09-19T09:14:12.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.013+0000 7f41bcb9d640 1 --2- 172.21.15.18:0/2869264442 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f41a406c2b0 0x7f41a406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:12.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.014+0000 7f41bcb9d640 1 --2- 172.21.15.18:0/2869264442 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f41a406c2b0 0x7f41a406e770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f41a80016e0 tx=0x7f41a8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:12.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.017+0000 7f41b57fa640 1 -- 172.21.15.18:0/2869264442 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f41b0059ce0 con 0x7f41b815e970 2024-09-19T09:14:12.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.188+0000 7f41bdb9f640 1 -- 172.21.15.18:0/2869264442 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f41b80cf580 con 0x7f41a406c2b0 2024-09-19T09:14:12.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.194+0000 7f41b57fa640 1 -- 172.21.15.18:0/2869264442 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247491 (secure 0 0 0) 0x7f41b80cf580 con 0x7f41a406c2b0 2024-09-19T09:14:12.197 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:12.198 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:14:12.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.197+0000 7f41bdb9f640 1 -- 172.21.15.18:0/2869264442 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f41a406c2b0 msgr2=0x7f41a406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:12.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.197+0000 7f41bdb9f640 1 --2- 172.21.15.18:0/2869264442 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f41a406c2b0 0x7f41a406e770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f41a80016e0 tx=0x7f41a8009040 comp rx=0 tx=0).stop 2024-09-19T09:14:12.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.197+0000 7f41bdb9f640 1 -- 172.21.15.18:0/2869264442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41b815e970 msgr2=0x7f41b8160130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:12.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.197+0000 7f41bdb9f640 1 --2- 172.21.15.18:0/2869264442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41b815e970 0x7f41b8160130 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f41b0007e40 tx=0x7f41b000e4b0 comp rx=0 tx=0).stop 2024-09-19T09:14:12.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.197+0000 7f41bdb9f640 1 -- 172.21.15.18:0/2869264442 shutdown_connections 2024-09-19T09:14:12.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.197+0000 7f41bdb9f640 1 --2- 172.21.15.18:0/2869264442 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f41a406c2b0 0x7f41a406e770 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:12.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.197+0000 7f41bdb9f640 1 --2- 172.21.15.18:0/2869264442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41b815e970 0x7f41b8160130 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:12.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.197+0000 7f41bdb9f640 1 --2- 172.21.15.18:0/2869264442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41b80d2680 0x7f41b8147f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:12.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.197+0000 7f41bdb9f640 1 --2- 172.21.15.18:0/2869264442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41b80cfac0 0x7f41b815f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:12.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.197+0000 7f41bdb9f640 1 -- 172.21.15.18:0/2869264442 >> 172.21.15.18:0/2869264442 conn(0x7f41b809de00 msgr2=0x7f41b80d0640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:12.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.197+0000 7f41bdb9f640 1 -- 172.21.15.18:0/2869264442 shutdown_connections 2024-09-19T09:14:12.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:12.197+0000 7f41bdb9f640 1 -- 172.21.15.18:0/2869264442 wait complete. 2024-09-19T09:14:12.208 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-09-19T09:14:11.535206+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2240,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560259,"statfs":{"total":1600000000,"available":1597705284,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.745846"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.252036+0000","last_change":"2024-09-19T09:14:07.826853+0000","last_active":"2024-09-19T09:14:09.252036+0000","last_peered":"2024-09-19T09:14:09.252036+0000","last_clean":"2024-09-19T09:14:09.252036+0000","last_became_active":"2024-09-19T09:14:07.822878+0000","last_became_peered":"2024-09-19T09:14:07.822878+0000","last_unstale":"2024-09-19T09:14:09.252036+0000","last_undegraded":"2024-09-19T09:14:09.252036+0000","last_fullsized":"2024-09-19T09:14:09.252036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:14.026470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.830887+0000","last_change":"2024-09-19T09:14:07.820258+0000","last_active":"2024-09-19T09:14:08.830887+0000","last_peered":"2024-09-19T09:14:08.830887+0000","last_clean":"2024-09-19T09:14:08.830887+0000","last_became_active":"2024-09-19T09:14:07.819713+0000","last_became_peered":"2024-09-19T09:14:07.819713+0000","last_unstale":"2024-09-19T09:14:08.830887+0000","last_undegraded":"2024-09-19T09:14:08.830887+0000","last_fullsized":"2024-09-19T09:14:08.830887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:32:48.027249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.252350+0000","last_change":"2024-09-19T09:14:07.818310+0000","last_active":"2024-09-19T09:14:09.252350+0000","last_peered":"2024-09-19T09:14:09.252350+0000","last_clean":"2024-09-19T09:14:09.252350+0000","last_became_active":"2024-09-19T09:14:07.817960+0000","last_became_peered":"2024-09-19T09:14:07.817960+0000","last_unstale":"2024-09-19T09:14:09.252350+0000","last_undegraded":"2024-09-19T09:14:09.252350+0000","last_fullsized":"2024-09-19T09:14:09.252350+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:47:35.316847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251055+0000","last_change":"2024-09-19T09:14:07.832864+0000","last_active":"2024-09-19T09:14:09.251055+0000","last_peered":"2024-09-19T09:14:09.251055+0000","last_clean":"2024-09-19T09:14:09.251055+0000","last_became_active":"2024-09-19T09:14:07.831762+0000","last_became_peered":"2024-09-19T09:14:07.831762+0000","last_unstale":"2024-09-19T09:14:09.251055+0000","last_undegraded":"2024-09-19T09:14:09.251055+0000","last_fullsized":"2024-09-19T09:14:09.251055+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:51.404199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.831243+0000","last_change":"2024-09-19T09:14:07.824929+0000","last_active":"2024-09-19T09:14:08.831243+0000","last_peered":"2024-09-19T09:14:08.831243+0000","last_clean":"2024-09-19T09:14:08.831243+0000","last_became_active":"2024-09-19T09:14:07.824676+0000","last_became_peered":"2024-09-19T09:14:07.824676+0000","last_unstale":"2024-09-19T09:14:08.831243+0000","last_undegraded":"2024-09-19T09:14:08.831243+0000","last_fullsized":"2024-09-19T09:14:08.831243+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:30.410652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.832580+0000","last_change":"2024-09-19T09:14:07.823074+0000","last_active":"2024-09-19T09:14:08.832580+0000","last_peered":"2024-09-19T09:14:08.832580+0000","last_clean":"2024-09-19T09:14:08.832580+0000","last_became_active":"2024-09-19T09:14:07.822835+0000","last_became_peered":"2024-09-19T09:14:07.822835+0000","last_unstale":"2024-09-19T09:14:08.832580+0000","last_undegraded":"2024-09-19T09:14:08.832580+0000","last_fullsized":"2024-09-19T09:14:08.832580+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:49.485902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251640+0000","last_change":"2024-09-19T09:14:07.818492+0000","last_active":"2024-09-19T09:14:09.251640+0000","last_peered":"2024-09-19T09:14:09.251640+0000","last_clean":"2024-09-19T09:14:09.251640+0000","last_became_active":"2024-09-19T09:14:07.818242+0000","last_became_peered":"2024-09-19T09:14:07.818242+0000","last_unstale":"2024-09-19T09:14:09.251640+0000","last_undegraded":"2024-09-19T09:14:09.251640+0000","last_fullsized":"2024-09-19T09:14:09.251640+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:52.966279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251574+0000","last_change":"2024-09-19T09:14:07.825641+0000","last_active":"2024-09-19T09:14:09.251574+0000","last_peered":"2024-09-19T09:14:09.251574+0000","last_clean":"2024-09-19T09:14:09.251574+0000","last_became_active":"2024-09-19T09:14:07.825004+0000","last_became_peered":"2024-09-19T09:14:07.825004+0000","last_unstale":"2024-09-19T09:14:09.251574+0000","last_undegraded":"2024-09-19T09:14:09.251574+0000","last_fullsized":"2024-09-19T09:14:09.251574+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:10:44.129227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251949+0000","last_change":"2024-09-19T09:14:07.826199+0000","last_active":"2024-09-19T09:14:09.251949+0000","last_peered":"2024-09-19T09:14:09.251949+0000","last_clean":"2024-09-19T09:14:09.251949+0000","last_became_active":"2024-09-19T09:14:07.825947+0000","last_became_peered":"2024-09-19T09:14:07.825947+0000","last_unstale":"2024-09-19T09:14:09.251949+0000","last_undegraded":"2024-09-19T09:14:09.251949+0000","last_fullsized":"2024-09-19T09:14:09.251949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:37:38.986839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.250699+0000","last_change":"2024-09-19T09:14:07.822826+0000","last_active":"2024-09-19T09:14:09.250699+0000","last_peered":"2024-09-19T09:14:09.250699+0000","last_clean":"2024-09-19T09:14:09.250699+0000","last_became_active":"2024-09-19T09:14:07.822247+0000","last_became_peered":"2024-09-19T09:14:07.822247+0000","last_unstale":"2024-09-19T09:14:09.250699+0000","last_undegraded":"2024-09-19T09:14:09.250699+0000","last_fullsized":"2024-09-19T09:14:09.250699+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:40.960015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.828384+0000","last_change":"2024-09-19T09:14:07.827604+0000","last_active":"2024-09-19T09:14:08.828384+0000","last_peered":"2024-09-19T09:14:08.828384+0000","last_clean":"2024-09-19T09:14:08.828384+0000","last_became_active":"2024-09-19T09:14:07.827309+0000","last_became_peered":"2024-09-19T09:14:07.827309+0000","last_unstale":"2024-09-19T09:14:08.828384+0000","last_undegraded":"2024-09-19T09:14:08.828384+0000","last_fullsized":"2024-09-19T09:14:08.828384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:48.381855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251054+0000","last_change":"2024-09-19T09:14:07.825040+0000","last_active":"2024-09-19T09:14:09.251054+0000","last_peered":"2024-09-19T09:14:09.251054+0000","last_clean":"2024-09-19T09:14:09.251054+0000","last_became_active":"2024-09-19T09:14:07.824788+0000","last_became_peered":"2024-09-19T09:14:07.824788+0000","last_unstale":"2024-09-19T09:14:09.251054+0000","last_undegraded":"2024-09-19T09:14:09.251054+0000","last_fullsized":"2024-09-19T09:14:09.251054+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:26.895589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.956053+0000","last_change":"2024-09-19T09:14:07.828167+0000","last_active":"2024-09-19T09:14:08.956053+0000","last_peered":"2024-09-19T09:14:08.956053+0000","last_clean":"2024-09-19T09:14:08.956053+0000","last_became_active":"2024-09-19T09:14:07.826514+0000","last_became_peered":"2024-09-19T09:14:07.826514+0000","last_unstale":"2024-09-19T09:14:08.956053+0000","last_undegraded":"2024-09-19T09:14:08.956053+0000","last_fullsized":"2024-09-19T09:14:08.956053+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:04.432628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251431+0000","last_change":"2024-09-19T09:14:07.821427+0000","last_active":"2024-09-19T09:14:09.251431+0000","last_peered":"2024-09-19T09:14:09.251431+0000","last_clean":"2024-09-19T09:14:09.251431+0000","last_became_active":"2024-09-19T09:14:07.821110+0000","last_became_peered":"2024-09-19T09:14:07.821110+0000","last_unstale":"2024-09-19T09:14:09.251431+0000","last_undegraded":"2024-09-19T09:14:09.251431+0000","last_fullsized":"2024-09-19T09:14:09.251431+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:13.811469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251103+0000","last_change":"2024-09-19T09:14:07.821046+0000","last_active":"2024-09-19T09:14:09.251103+0000","last_peered":"2024-09-19T09:14:09.251103+0000","last_clean":"2024-09-19T09:14:09.251103+0000","last_became_active":"2024-09-19T09:14:07.819453+0000","last_became_peered":"2024-09-19T09:14:07.819453+0000","last_unstale":"2024-09-19T09:14:09.251103+0000","last_undegraded":"2024-09-19T09:14:09.251103+0000","last_fullsized":"2024-09-19T09:14:09.251103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:35.793669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251089+0000","last_change":"2024-09-19T09:14:07.820339+0000","last_active":"2024-09-19T09:14:09.251089+0000","last_peered":"2024-09-19T09:14:09.251089+0000","last_clean":"2024-09-19T09:14:09.251089+0000","last_became_active":"2024-09-19T09:14:07.820027+0000","last_became_peered":"2024-09-19T09:14:07.820027+0000","last_unstale":"2024-09-19T09:14:09.251089+0000","last_undegraded":"2024-09-19T09:14:09.251089+0000","last_fullsized":"2024-09-19T09:14:09.251089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:50.498213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.828818+0000","last_change":"2024-09-19T09:14:07.833460+0000","last_active":"2024-09-19T09:14:08.828818+0000","last_peered":"2024-09-19T09:14:08.828818+0000","last_clean":"2024-09-19T09:14:08.828818+0000","last_became_active":"2024-09-19T09:14:07.829405+0000","last_became_peered":"2024-09-19T09:14:07.829405+0000","last_unstale":"2024-09-19T09:14:08.828818+0000","last_undegraded":"2024-09-19T09:14:08.828818+0000","last_fullsized":"2024-09-19T09:14:08.828818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:53.720752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.832462+0000","last_change":"2024-09-19T09:14:07.824055+0000","last_active":"2024-09-19T09:14:08.832462+0000","last_peered":"2024-09-19T09:14:08.832462+0000","last_clean":"2024-09-19T09:14:08.832462+0000","last_became_active":"2024-09-19T09:14:07.823526+0000","last_became_peered":"2024-09-19T09:14:07.823526+0000","last_unstale":"2024-09-19T09:14:08.832462+0000","last_undegraded":"2024-09-19T09:14:08.832462+0000","last_fullsized":"2024-09-19T09:14:08.832462+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:19.891139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.832327+0000","last_change":"2024-09-19T09:14:07.824475+0000","last_active":"2024-09-19T09:14:08.832327+0000","last_peered":"2024-09-19T09:14:08.832327+0000","last_clean":"2024-09-19T09:14:08.832327+0000","last_became_active":"2024-09-19T09:14:07.824231+0000","last_became_peered":"2024-09-19T09:14:07.824231+0000","last_unstale":"2024-09-19T09:14:08.832327+0000","last_undegraded":"2024-09-19T09:14:08.832327+0000","last_fullsized":"2024-09-19T09:14:08.832327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:23:51.806394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.956299+0000","last_change":"2024-09-19T09:14:07.827001+0000","last_active":"2024-09-19T09:14:08.956299+0000","last_peered":"2024-09-19T09:14:08.956299+0000","last_clean":"2024-09-19T09:14:08.956299+0000","last_became_active":"2024-09-19T09:14:07.826526+0000","last_became_peered":"2024-09-19T09:14:07.826526+0000","last_unstale":"2024-09-19T09:14:08.956299+0000","last_undegraded":"2024-09-19T09:14:08.956299+0000","last_fullsized":"2024-09-19T09:14:08.956299+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:24:33.683598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251343+0000","last_change":"2024-09-19T09:14:07.824607+0000","last_active":"2024-09-19T09:14:09.251343+0000","last_peered":"2024-09-19T09:14:09.251343+0000","last_clean":"2024-09-19T09:14:09.251343+0000","last_became_active":"2024-09-19T09:14:07.824160+0000","last_became_peered":"2024-09-19T09:14:07.824160+0000","last_unstale":"2024-09-19T09:14:09.251343+0000","last_undegraded":"2024-09-19T09:14:09.251343+0000","last_fullsized":"2024-09-19T09:14:09.251343+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:09.387654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251719+0000","last_change":"2024-09-19T09:14:07.821781+0000","last_active":"2024-09-19T09:14:09.251719+0000","last_peered":"2024-09-19T09:14:09.251719+0000","last_clean":"2024-09-19T09:14:09.251719+0000","last_became_active":"2024-09-19T09:14:07.821547+0000","last_became_peered":"2024-09-19T09:14:07.821547+0000","last_unstale":"2024-09-19T09:14:09.251719+0000","last_undegraded":"2024-09-19T09:14:09.251719+0000","last_fullsized":"2024-09-19T09:14:09.251719+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:22.182039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.956185+0000","last_change":"2024-09-19T09:14:07.827265+0000","last_active":"2024-09-19T09:14:08.956185+0000","last_peered":"2024-09-19T09:14:08.956185+0000","last_clean":"2024-09-19T09:14:08.956185+0000","last_became_active":"2024-09-19T09:14:07.825746+0000","last_became_peered":"2024-09-19T09:14:07.825746+0000","last_unstale":"2024-09-19T09:14:08.956185+0000","last_undegraded":"2024-09-19T09:14:08.956185+0000","last_fullsized":"2024-09-19T09:14:08.956185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:37.921663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251377+0000","last_change":"2024-09-19T09:14:07.829462+0000","last_active":"2024-09-19T09:14:09.251377+0000","last_peered":"2024-09-19T09:14:09.251377+0000","last_clean":"2024-09-19T09:14:09.251377+0000","last_became_active":"2024-09-19T09:14:07.829090+0000","last_became_peered":"2024-09-19T09:14:07.829090+0000","last_unstale":"2024-09-19T09:14:09.251377+0000","last_undegraded":"2024-09-19T09:14:09.251377+0000","last_fullsized":"2024-09-19T09:14:09.251377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:57.903976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.250804+0000","last_change":"2024-09-19T09:14:07.829300+0000","last_active":"2024-09-19T09:14:09.250804+0000","last_peered":"2024-09-19T09:14:09.250804+0000","last_clean":"2024-09-19T09:14:09.250804+0000","last_became_active":"2024-09-19T09:14:07.828961+0000","last_became_peered":"2024-09-19T09:14:07.828961+0000","last_unstale":"2024-09-19T09:14:09.250804+0000","last_undegraded":"2024-09-19T09:14:09.250804+0000","last_fullsized":"2024-09-19T09:14:09.250804+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:43.929037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251107+0000","last_change":"2024-09-19T09:14:07.825391+0000","last_active":"2024-09-19T09:14:09.251107+0000","last_peered":"2024-09-19T09:14:09.251107+0000","last_clean":"2024-09-19T09:14:09.251107+0000","last_became_active":"2024-09-19T09:14:07.824719+0000","last_became_peered":"2024-09-19T09:14:07.824719+0000","last_unstale":"2024-09-19T09:14:09.251107+0000","last_undegraded":"2024-09-19T09:14:09.251107+0000","last_fullsized":"2024-09-19T09:14:09.251107+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:00.832046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.831045+0000","last_change":"2024-09-19T09:14:07.820445+0000","last_active":"2024-09-19T09:14:08.831045+0000","last_peered":"2024-09-19T09:14:08.831045+0000","last_clean":"2024-09-19T09:14:08.831045+0000","last_became_active":"2024-09-19T09:14:07.820037+0000","last_became_peered":"2024-09-19T09:14:07.820037+0000","last_unstale":"2024-09-19T09:14:08.831045+0000","last_undegraded":"2024-09-19T09:14:08.831045+0000","last_fullsized":"2024-09-19T09:14:08.831045+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:46.275001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251715+0000","last_change":"2024-09-19T09:14:07.825365+0000","last_active":"2024-09-19T09:14:09.251715+0000","last_peered":"2024-09-19T09:14:09.251715+0000","last_clean":"2024-09-19T09:14:09.251715+0000","last_became_active":"2024-09-19T09:14:07.824651+0000","last_became_peered":"2024-09-19T09:14:07.824651+0000","last_unstale":"2024-09-19T09:14:09.251715+0000","last_undegraded":"2024-09-19T09:14:09.251715+0000","last_fullsized":"2024-09-19T09:14:09.251715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:28:23.226024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251206+0000","last_change":"2024-09-19T09:14:07.822079+0000","last_active":"2024-09-19T09:14:09.251206+0000","last_peered":"2024-09-19T09:14:09.251206+0000","last_clean":"2024-09-19T09:14:09.251206+0000","last_became_active":"2024-09-19T09:14:07.821807+0000","last_became_peered":"2024-09-19T09:14:07.821807+0000","last_unstale":"2024-09-19T09:14:09.251206+0000","last_undegraded":"2024-09-19T09:14:09.251206+0000","last_fullsized":"2024-09-19T09:14:09.251206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:02.251979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251250+0000","last_change":"2024-09-19T09:14:07.831039+0000","last_active":"2024-09-19T09:14:09.251250+0000","last_peered":"2024-09-19T09:14:09.251250+0000","last_clean":"2024-09-19T09:14:09.251250+0000","last_became_active":"2024-09-19T09:14:07.830605+0000","last_became_peered":"2024-09-19T09:14:07.830605+0000","last_unstale":"2024-09-19T09:14:09.251250+0000","last_undegraded":"2024-09-19T09:14:09.251250+0000","last_fullsized":"2024-09-19T09:14:09.251250+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:45.380798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.252178+0000","last_change":"2024-09-19T09:14:07.823108+0000","last_active":"2024-09-19T09:14:09.252178+0000","last_peered":"2024-09-19T09:14:09.252178+0000","last_clean":"2024-09-19T09:14:09.252178+0000","last_became_active":"2024-09-19T09:14:07.822182+0000","last_became_peered":"2024-09-19T09:14:07.822182+0000","last_unstale":"2024-09-19T09:14:09.252178+0000","last_undegraded":"2024-09-19T09:14:09.252178+0000","last_fullsized":"2024-09-19T09:14:09.252178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:59:47.490567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.828958+0000","last_change":"2024-09-19T09:14:07.832637+0000","last_active":"2024-09-19T09:14:08.828958+0000","last_peered":"2024-09-19T09:14:08.828958+0000","last_clean":"2024-09-19T09:14:08.828958+0000","last_became_active":"2024-09-19T09:14:07.829095+0000","last_became_peered":"2024-09-19T09:14:07.829095+0000","last_unstale":"2024-09-19T09:14:08.828958+0000","last_undegraded":"2024-09-19T09:14:08.828958+0000","last_fullsized":"2024-09-19T09:14:08.828958+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:47:57.887886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.955949+0000","last_change":"2024-09-19T09:14:07.823956+0000","last_active":"2024-09-19T09:14:08.955949+0000","last_peered":"2024-09-19T09:14:08.955949+0000","last_clean":"2024-09-19T09:14:08.955949+0000","last_became_active":"2024-09-19T09:14:07.823645+0000","last_became_peered":"2024-09-19T09:14:07.823645+0000","last_unstale":"2024-09-19T09:14:08.955949+0000","last_undegraded":"2024-09-19T09:14:08.955949+0000","last_fullsized":"2024-09-19T09:14:08.955949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:41.808292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.828530+0000","last_change":"2024-09-19T09:14:06.808795+0000","last_active":"2024-09-19T09:14:08.828530+0000","last_peered":"2024-09-19T09:14:08.828530+0000","last_clean":"2024-09-19T09:14:08.828530+0000","last_became_active":"2024-09-19T09:14:06.808600+0000","last_became_peered":"2024-09-19T09:14:06.808600+0000","last_unstale":"2024-09-19T09:14:08.828530+0000","last_undegraded":"2024-09-19T09:14:08.828530+0000","last_fullsized":"2024-09-19T09:14:08.828530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:28.548321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251849+0000","last_change":"2024-09-19T09:14:07.823697+0000","last_active":"2024-09-19T09:14:09.251849+0000","last_peered":"2024-09-19T09:14:09.251849+0000","last_clean":"2024-09-19T09:14:09.251849+0000","last_became_active":"2024-09-19T09:14:07.823471+0000","last_became_peered":"2024-09-19T09:14:07.823471+0000","last_unstale":"2024-09-19T09:14:09.251849+0000","last_undegraded":"2024-09-19T09:14:09.251849+0000","last_fullsized":"2024-09-19T09:14:09.251849+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:40:04.864558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251252+0000","last_change":"2024-09-19T09:14:06.808463+0000","last_active":"2024-09-19T09:14:09.251252+0000","last_peered":"2024-09-19T09:14:09.251252+0000","last_clean":"2024-09-19T09:14:09.251252+0000","last_became_active":"2024-09-19T09:14:06.807903+0000","last_became_peered":"2024-09-19T09:14:06.807903+0000","last_unstale":"2024-09-19T09:14:09.251252+0000","last_undegraded":"2024-09-19T09:14:09.251252+0000","last_fullsized":"2024-09-19T09:14:09.251252+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:14.579464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.252315+0000","last_change":"2024-09-19T09:14:07.827953+0000","last_active":"2024-09-19T09:14:09.252315+0000","last_peered":"2024-09-19T09:14:09.252315+0000","last_clean":"2024-09-19T09:14:09.252315+0000","last_became_active":"2024-09-19T09:14:07.827684+0000","last_became_peered":"2024-09-19T09:14:07.827684+0000","last_unstale":"2024-09-19T09:14:09.252315+0000","last_undegraded":"2024-09-19T09:14:09.252315+0000","last_fullsized":"2024-09-19T09:14:09.252315+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:58.879241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.832610+0000","last_change":"2024-09-19T09:14:06.805444+0000","last_active":"2024-09-19T09:14:08.832610+0000","last_peered":"2024-09-19T09:14:08.832610+0000","last_clean":"2024-09-19T09:14:08.832610+0000","last_became_active":"2024-09-19T09:14:06.805086+0000","last_became_peered":"2024-09-19T09:14:06.805086+0000","last_unstale":"2024-09-19T09:14:08.832610+0000","last_undegraded":"2024-09-19T09:14:08.832610+0000","last_fullsized":"2024-09-19T09:14:08.832610+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:12.912740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.250967+0000","last_change":"2024-09-19T09:14:07.825679+0000","last_active":"2024-09-19T09:14:09.250967+0000","last_peered":"2024-09-19T09:14:09.250967+0000","last_clean":"2024-09-19T09:14:09.250967+0000","last_became_active":"2024-09-19T09:14:07.825017+0000","last_became_peered":"2024-09-19T09:14:07.825017+0000","last_unstale":"2024-09-19T09:14:09.250967+0000","last_undegraded":"2024-09-19T09:14:09.250967+0000","last_fullsized":"2024-09-19T09:14:09.250967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:55.990712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.250918+0000","last_change":"2024-09-19T09:14:06.806271+0000","last_active":"2024-09-19T09:14:09.250918+0000","last_peered":"2024-09-19T09:14:09.250918+0000","last_clean":"2024-09-19T09:14:09.250918+0000","last_became_active":"2024-09-19T09:14:06.805596+0000","last_became_peered":"2024-09-19T09:14:06.805596+0000","last_unstale":"2024-09-19T09:14:09.250918+0000","last_undegraded":"2024-09-19T09:14:09.250918+0000","last_fullsized":"2024-09-19T09:14:09.250918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:24.462955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.252535+0000","last_change":"2024-09-19T09:14:07.820988+0000","last_active":"2024-09-19T09:14:09.252535+0000","last_peered":"2024-09-19T09:14:09.252535+0000","last_clean":"2024-09-19T09:14:09.252535+0000","last_became_active":"2024-09-19T09:14:07.820709+0000","last_became_peered":"2024-09-19T09:14:07.820709+0000","last_unstale":"2024-09-19T09:14:09.252535+0000","last_undegraded":"2024-09-19T09:14:09.252535+0000","last_fullsized":"2024-09-19T09:14:09.252535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:55.744436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251817+0000","last_change":"2024-09-19T09:14:06.809456+0000","last_active":"2024-09-19T09:14:09.251817+0000","last_peered":"2024-09-19T09:14:09.251817+0000","last_clean":"2024-09-19T09:14:09.251817+0000","last_became_active":"2024-09-19T09:14:06.808374+0000","last_became_peered":"2024-09-19T09:14:06.808374+0000","last_unstale":"2024-09-19T09:14:09.251817+0000","last_undegraded":"2024-09-19T09:14:09.251817+0000","last_fullsized":"2024-09-19T09:14:09.251817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:38.923466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251789+0000","last_change":"2024-09-19T09:14:07.820765+0000","last_active":"2024-09-19T09:14:09.251789+0000","last_peered":"2024-09-19T09:14:09.251789+0000","last_clean":"2024-09-19T09:14:09.251789+0000","last_became_active":"2024-09-19T09:14:07.820538+0000","last_became_peered":"2024-09-19T09:14:07.820538+0000","last_unstale":"2024-09-19T09:14:09.251789+0000","last_undegraded":"2024-09-19T09:14:09.251789+0000","last_fullsized":"2024-09-19T09:14:09.251789+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:03.183403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.252099+0000","last_change":"2024-09-19T09:14:06.807230+0000","last_active":"2024-09-19T09:14:09.252099+0000","last_peered":"2024-09-19T09:14:09.252099+0000","last_clean":"2024-09-19T09:14:09.252099+0000","last_became_active":"2024-09-19T09:14:06.806996+0000","last_became_peered":"2024-09-19T09:14:06.806996+0000","last_unstale":"2024-09-19T09:14:09.252099+0000","last_undegraded":"2024-09-19T09:14:09.252099+0000","last_fullsized":"2024-09-19T09:14:09.252099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:44.624976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251201+0000","last_change":"2024-09-19T09:14:07.823519+0000","last_active":"2024-09-19T09:14:09.251201+0000","last_peered":"2024-09-19T09:14:09.251201+0000","last_clean":"2024-09-19T09:14:09.251201+0000","last_became_active":"2024-09-19T09:14:07.823117+0000","last_became_peered":"2024-09-19T09:14:07.823117+0000","last_unstale":"2024-09-19T09:14:09.251201+0000","last_undegraded":"2024-09-19T09:14:09.251201+0000","last_fullsized":"2024-09-19T09:14:09.251201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:52.223642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.832556+0000","last_change":"2024-09-19T09:14:06.805757+0000","last_active":"2024-09-19T09:14:08.832556+0000","last_peered":"2024-09-19T09:14:08.832556+0000","last_clean":"2024-09-19T09:14:08.832556+0000","last_became_active":"2024-09-19T09:14:06.805470+0000","last_became_peered":"2024-09-19T09:14:06.805470+0000","last_unstale":"2024-09-19T09:14:08.832556+0000","last_undegraded":"2024-09-19T09:14:08.832556+0000","last_fullsized":"2024-09-19T09:14:08.832556+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:08.522092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251201+0000","last_change":"2024-09-19T09:14:07.824555+0000","last_active":"2024-09-19T09:14:09.251201+0000","last_peered":"2024-09-19T09:14:09.251201+0000","last_clean":"2024-09-19T09:14:09.251201+0000","last_became_active":"2024-09-19T09:14:07.824308+0000","last_became_peered":"2024-09-19T09:14:07.824308+0000","last_unstale":"2024-09-19T09:14:09.251201+0000","last_undegraded":"2024-09-19T09:14:09.251201+0000","last_fullsized":"2024-09-19T09:14:09.251201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:25:40.127305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251561+0000","last_change":"2024-09-19T09:14:06.808879+0000","last_active":"2024-09-19T09:14:09.251561+0000","last_peered":"2024-09-19T09:14:09.251561+0000","last_clean":"2024-09-19T09:14:09.251561+0000","last_became_active":"2024-09-19T09:14:06.808107+0000","last_became_peered":"2024-09-19T09:14:06.808107+0000","last_unstale":"2024-09-19T09:14:09.251561+0000","last_undegraded":"2024-09-19T09:14:09.251561+0000","last_fullsized":"2024-09-19T09:14:09.251561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:18.458544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.829404+0000","last_change":"2024-09-19T09:14:07.833766+0000","last_active":"2024-09-19T09:14:08.829404+0000","last_peered":"2024-09-19T09:14:08.829404+0000","last_clean":"2024-09-19T09:14:08.829404+0000","last_became_active":"2024-09-19T09:14:07.829712+0000","last_became_peered":"2024-09-19T09:14:07.829712+0000","last_unstale":"2024-09-19T09:14:08.829404+0000","last_undegraded":"2024-09-19T09:14:08.829404+0000","last_fullsized":"2024-09-19T09:14:08.829404+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:26.688351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.830878+0000","last_change":"2024-09-19T09:14:06.802278+0000","last_active":"2024-09-19T09:14:08.830878+0000","last_peered":"2024-09-19T09:14:08.830878+0000","last_clean":"2024-09-19T09:14:08.830878+0000","last_became_active":"2024-09-19T09:14:06.802047+0000","last_became_peered":"2024-09-19T09:14:06.802047+0000","last_unstale":"2024-09-19T09:14:08.830878+0000","last_undegraded":"2024-09-19T09:14:08.830878+0000","last_fullsized":"2024-09-19T09:14:08.830878+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:42.811517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.250739+0000","last_change":"2024-09-19T09:14:07.823638+0000","last_active":"2024-09-19T09:14:09.250739+0000","last_peered":"2024-09-19T09:14:09.250739+0000","last_clean":"2024-09-19T09:14:09.250739+0000","last_became_active":"2024-09-19T09:14:07.823217+0000","last_became_peered":"2024-09-19T09:14:07.823217+0000","last_unstale":"2024-09-19T09:14:09.250739+0000","last_undegraded":"2024-09-19T09:14:09.250739+0000","last_fullsized":"2024-09-19T09:14:09.250739+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:56:51.892575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.831227+0000","last_change":"2024-09-19T09:14:06.803987+0000","last_active":"2024-09-19T09:14:08.831227+0000","last_peered":"2024-09-19T09:14:08.831227+0000","last_clean":"2024-09-19T09:14:08.831227+0000","last_became_active":"2024-09-19T09:14:06.803735+0000","last_became_peered":"2024-09-19T09:14:06.803735+0000","last_unstale":"2024-09-19T09:14:08.831227+0000","last_undegraded":"2024-09-19T09:14:08.831227+0000","last_fullsized":"2024-09-19T09:14:08.831227+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:01.871800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.250684+0000","last_change":"2024-09-19T09:14:07.834930+0000","last_active":"2024-09-19T09:14:09.250684+0000","last_peered":"2024-09-19T09:14:09.250684+0000","last_clean":"2024-09-19T09:14:09.250684+0000","last_became_active":"2024-09-19T09:14:07.832556+0000","last_became_peered":"2024-09-19T09:14:07.832556+0000","last_unstale":"2024-09-19T09:14:09.250684+0000","last_undegraded":"2024-09-19T09:14:09.250684+0000","last_fullsized":"2024-09-19T09:14:09.250684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:28.313132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.828723+0000","last_change":"2024-09-19T09:14:06.810245+0000","last_active":"2024-09-19T09:14:08.828723+0000","last_peered":"2024-09-19T09:14:08.828723+0000","last_clean":"2024-09-19T09:14:08.828723+0000","last_became_active":"2024-09-19T09:14:06.810015+0000","last_became_peered":"2024-09-19T09:14:06.810015+0000","last_unstale":"2024-09-19T09:14:08.828723+0000","last_undegraded":"2024-09-19T09:14:08.828723+0000","last_fullsized":"2024-09-19T09:14:08.828723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:42.408595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.828478+0000","last_change":"2024-09-19T09:14:07.826142+0000","last_active":"2024-09-19T09:14:08.828478+0000","last_peered":"2024-09-19T09:14:08.828478+0000","last_clean":"2024-09-19T09:14:08.828478+0000","last_became_active":"2024-09-19T09:14:07.825926+0000","last_became_peered":"2024-09-19T09:14:07.825926+0000","last_unstale":"2024-09-19T09:14:08.828478+0000","last_undegraded":"2024-09-19T09:14:08.828478+0000","last_fullsized":"2024-09-19T09:14:08.828478+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:51:22.108766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.956085+0000","last_change":"2024-09-19T09:14:06.809784+0000","last_active":"2024-09-19T09:14:08.956085+0000","last_peered":"2024-09-19T09:14:08.956085+0000","last_clean":"2024-09-19T09:14:08.956085+0000","last_became_active":"2024-09-19T09:14:06.809557+0000","last_became_peered":"2024-09-19T09:14:06.809557+0000","last_unstale":"2024-09-19T09:14:08.956085+0000","last_undegraded":"2024-09-19T09:14:08.956085+0000","last_fullsized":"2024-09-19T09:14:08.956085+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:30.909289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.955977+0000","last_change":"2024-09-19T09:14:07.827783+0000","last_active":"2024-09-19T09:14:08.955977+0000","last_peered":"2024-09-19T09:14:08.955977+0000","last_clean":"2024-09-19T09:14:08.955977+0000","last_became_active":"2024-09-19T09:14:07.826980+0000","last_became_peered":"2024-09-19T09:14:07.826980+0000","last_unstale":"2024-09-19T09:14:08.955977+0000","last_undegraded":"2024-09-19T09:14:08.955977+0000","last_fullsized":"2024-09-19T09:14:08.955977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:12:06.424258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251651+0000","last_change":"2024-09-19T09:14:06.812812+0000","last_active":"2024-09-19T09:14:09.251651+0000","last_peered":"2024-09-19T09:14:09.251651+0000","last_clean":"2024-09-19T09:14:09.251651+0000","last_became_active":"2024-09-19T09:14:06.812250+0000","last_became_peered":"2024-09-19T09:14:06.812250+0000","last_unstale":"2024-09-19T09:14:09.251651+0000","last_undegraded":"2024-09-19T09:14:09.251651+0000","last_fullsized":"2024-09-19T09:14:09.251651+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:48.258565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251087+0000","last_change":"2024-09-19T09:14:07.823047+0000","last_active":"2024-09-19T09:14:09.251087+0000","last_peered":"2024-09-19T09:14:09.251087+0000","last_clean":"2024-09-19T09:14:09.251087+0000","last_became_active":"2024-09-19T09:14:07.822604+0000","last_became_peered":"2024-09-19T09:14:07.822604+0000","last_unstale":"2024-09-19T09:14:09.251087+0000","last_undegraded":"2024-09-19T09:14:09.251087+0000","last_fullsized":"2024-09-19T09:14:09.251087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:53.088230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251137+0000","last_change":"2024-09-19T09:14:06.808995+0000","last_active":"2024-09-19T09:14:09.251137+0000","last_peered":"2024-09-19T09:14:09.251137+0000","last_clean":"2024-09-19T09:14:09.251137+0000","last_became_active":"2024-09-19T09:14:06.808738+0000","last_became_peered":"2024-09-19T09:14:06.808738+0000","last_unstale":"2024-09-19T09:14:09.251137+0000","last_undegraded":"2024-09-19T09:14:09.251137+0000","last_fullsized":"2024-09-19T09:14:09.251137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:19.289941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251989+0000","last_change":"2024-09-19T09:14:07.822615+0000","last_active":"2024-09-19T09:14:09.251989+0000","last_peered":"2024-09-19T09:14:09.251989+0000","last_clean":"2024-09-19T09:14:09.251989+0000","last_became_active":"2024-09-19T09:14:07.822371+0000","last_became_peered":"2024-09-19T09:14:07.822371+0000","last_unstale":"2024-09-19T09:14:09.251989+0000","last_undegraded":"2024-09-19T09:14:09.251989+0000","last_fullsized":"2024-09-19T09:14:09.251989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:42.353760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.250625+0000","last_change":"2024-09-19T09:14:06.807754+0000","last_active":"2024-09-19T09:14:09.250625+0000","last_peered":"2024-09-19T09:14:09.250625+0000","last_clean":"2024-09-19T09:14:09.250625+0000","last_became_active":"2024-09-19T09:14:06.807486+0000","last_became_peered":"2024-09-19T09:14:06.807486+0000","last_unstale":"2024-09-19T09:14:09.250625+0000","last_undegraded":"2024-09-19T09:14:09.250625+0000","last_fullsized":"2024-09-19T09:14:09.250625+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:25.787281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.829081+0000","last_change":"2024-09-19T09:14:07.831279+0000","last_active":"2024-09-19T09:14:08.829081+0000","last_peered":"2024-09-19T09:14:08.829081+0000","last_clean":"2024-09-19T09:14:08.829081+0000","last_became_active":"2024-09-19T09:14:07.828774+0000","last_became_peered":"2024-09-19T09:14:07.828774+0000","last_unstale":"2024-09-19T09:14:08.829081+0000","last_undegraded":"2024-09-19T09:14:08.829081+0000","last_fullsized":"2024-09-19T09:14:08.829081+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:09.824867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.832991+0000","last_change":"2024-09-19T09:14:06.808807+0000","last_active":"2024-09-19T09:14:08.832991+0000","last_peered":"2024-09-19T09:14:08.832991+0000","last_clean":"2024-09-19T09:14:08.832991+0000","last_became_active":"2024-09-19T09:14:06.808563+0000","last_became_peered":"2024-09-19T09:14:06.808563+0000","last_unstale":"2024-09-19T09:14:08.832991+0000","last_undegraded":"2024-09-19T09:14:08.832991+0000","last_fullsized":"2024-09-19T09:14:08.832991+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:32:33.693361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.828777+0000","last_change":"2024-09-19T09:14:07.831434+0000","last_active":"2024-09-19T09:14:08.828777+0000","last_peered":"2024-09-19T09:14:08.828777+0000","last_clean":"2024-09-19T09:14:08.828777+0000","last_became_active":"2024-09-19T09:14:07.828274+0000","last_became_peered":"2024-09-19T09:14:07.828274+0000","last_unstale":"2024-09-19T09:14:08.828777+0000","last_undegraded":"2024-09-19T09:14:08.828777+0000","last_fullsized":"2024-09-19T09:14:08.828777+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:58.617264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.832670+0000","last_change":"2024-09-19T09:14:06.809460+0000","last_active":"2024-09-19T09:14:08.832670+0000","last_peered":"2024-09-19T09:14:08.832670+0000","last_clean":"2024-09-19T09:14:08.832670+0000","last_became_active":"2024-09-19T09:14:06.809207+0000","last_became_peered":"2024-09-19T09:14:06.809207+0000","last_unstale":"2024-09-19T09:14:08.832670+0000","last_undegraded":"2024-09-19T09:14:08.832670+0000","last_fullsized":"2024-09-19T09:14:08.832670+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:07.656798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.252100+0000","last_change":"2024-09-19T09:14:07.816003+0000","last_active":"2024-09-19T09:14:09.252100+0000","last_peered":"2024-09-19T09:14:09.252100+0000","last_clean":"2024-09-19T09:14:09.252100+0000","last_became_active":"2024-09-19T09:14:07.815735+0000","last_became_peered":"2024-09-19T09:14:07.815735+0000","last_unstale":"2024-09-19T09:14:09.252100+0000","last_undegraded":"2024-09-19T09:14:09.252100+0000","last_fullsized":"2024-09-19T09:14:09.252100+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:46.347104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251754+0000","last_change":"2024-09-19T09:14:06.812576+0000","last_active":"2024-09-19T09:14:09.251754+0000","last_peered":"2024-09-19T09:14:09.251754+0000","last_clean":"2024-09-19T09:14:09.251754+0000","last_became_active":"2024-09-19T09:14:06.811919+0000","last_became_peered":"2024-09-19T09:14:06.811919+0000","last_unstale":"2024-09-19T09:14:09.251754+0000","last_undegraded":"2024-09-19T09:14:09.251754+0000","last_fullsized":"2024-09-19T09:14:09.251754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:19:16.388518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.831146+0000","last_change":"2024-09-19T09:14:07.813765+0000","last_active":"2024-09-19T09:14:08.831146+0000","last_peered":"2024-09-19T09:14:08.831146+0000","last_clean":"2024-09-19T09:14:08.831146+0000","last_became_active":"2024-09-19T09:14:07.813503+0000","last_became_peered":"2024-09-19T09:14:07.813503+0000","last_unstale":"2024-09-19T09:14:08.831146+0000","last_undegraded":"2024-09-19T09:14:08.831146+0000","last_fullsized":"2024-09-19T09:14:08.831146+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:04.443430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.828494+0000","last_change":"2024-09-19T09:14:06.811623+0000","last_active":"2024-09-19T09:14:08.828494+0000","last_peered":"2024-09-19T09:14:08.828494+0000","last_clean":"2024-09-19T09:14:08.828494+0000","last_became_active":"2024-09-19T09:14:06.811238+0000","last_became_peered":"2024-09-19T09:14:06.811238+0000","last_unstale":"2024-09-19T09:14:08.828494+0000","last_undegraded":"2024-09-19T09:14:08.828494+0000","last_fullsized":"2024-09-19T09:14:08.828494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:03.026718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.832822+0000","last_change":"2024-09-19T09:14:07.820464+0000","last_active":"2024-09-19T09:14:08.832822+0000","last_peered":"2024-09-19T09:14:08.832822+0000","last_clean":"2024-09-19T09:14:08.832822+0000","last_became_active":"2024-09-19T09:14:07.820234+0000","last_became_peered":"2024-09-19T09:14:07.820234+0000","last_unstale":"2024-09-19T09:14:08.832822+0000","last_undegraded":"2024-09-19T09:14:08.832822+0000","last_fullsized":"2024-09-19T09:14:08.832822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:02.653012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251248+0000","last_change":"2024-09-19T09:14:06.810134+0000","last_active":"2024-09-19T09:14:09.251248+0000","last_peered":"2024-09-19T09:14:09.251248+0000","last_clean":"2024-09-19T09:14:09.251248+0000","last_became_active":"2024-09-19T09:14:06.809399+0000","last_became_peered":"2024-09-19T09:14:06.809399+0000","last_unstale":"2024-09-19T09:14:09.251248+0000","last_undegraded":"2024-09-19T09:14:09.251248+0000","last_fullsized":"2024-09-19T09:14:09.251248+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:59:59.875534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.955738+0000","last_change":"2024-09-19T09:14:07.826110+0000","last_active":"2024-09-19T09:14:08.955738+0000","last_peered":"2024-09-19T09:14:08.955738+0000","last_clean":"2024-09-19T09:14:08.955738+0000","last_became_active":"2024-09-19T09:14:07.825791+0000","last_became_peered":"2024-09-19T09:14:07.825791+0000","last_unstale":"2024-09-19T09:14:08.955738+0000","last_undegraded":"2024-09-19T09:14:08.955738+0000","last_fullsized":"2024-09-19T09:14:08.955738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:55.770469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.831046+0000","last_change":"2024-09-19T09:14:06.798984+0000","last_active":"2024-09-19T09:14:08.831046+0000","last_peered":"2024-09-19T09:14:08.831046+0000","last_clean":"2024-09-19T09:14:08.831046+0000","last_became_active":"2024-09-19T09:14:06.798718+0000","last_became_peered":"2024-09-19T09:14:06.798718+0000","last_unstale":"2024-09-19T09:14:08.831046+0000","last_undegraded":"2024-09-19T09:14:08.831046+0000","last_fullsized":"2024-09-19T09:14:08.831046+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:20.310559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.830981+0000","last_change":"2024-09-19T09:14:07.822165+0000","last_active":"2024-09-19T09:14:08.830981+0000","last_peered":"2024-09-19T09:14:08.830981+0000","last_clean":"2024-09-19T09:14:08.830981+0000","last_became_active":"2024-09-19T09:14:07.821932+0000","last_became_peered":"2024-09-19T09:14:07.821932+0000","last_unstale":"2024-09-19T09:14:08.830981+0000","last_undegraded":"2024-09-19T09:14:08.830981+0000","last_fullsized":"2024-09-19T09:14:08.830981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:13.194071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251429+0000","last_change":"2024-09-19T09:14:06.812609+0000","last_active":"2024-09-19T09:14:09.251429+0000","last_peered":"2024-09-19T09:14:09.251429+0000","last_clean":"2024-09-19T09:14:09.251429+0000","last_became_active":"2024-09-19T09:14:06.812013+0000","last_became_peered":"2024-09-19T09:14:06.812013+0000","last_unstale":"2024-09-19T09:14:09.251429+0000","last_undegraded":"2024-09-19T09:14:09.251429+0000","last_fullsized":"2024-09-19T09:14:09.251429+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:56.666296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.956104+0000","last_change":"2024-09-19T09:14:07.826525+0000","last_active":"2024-09-19T09:14:08.956104+0000","last_peered":"2024-09-19T09:14:08.956104+0000","last_clean":"2024-09-19T09:14:08.956104+0000","last_became_active":"2024-09-19T09:14:07.826066+0000","last_became_peered":"2024-09-19T09:14:07.826066+0000","last_unstale":"2024-09-19T09:14:08.956104+0000","last_undegraded":"2024-09-19T09:14:08.956104+0000","last_fullsized":"2024-09-19T09:14:08.956104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:18.326041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251401+0000","last_change":"2024-09-19T09:14:06.805561+0000","last_active":"2024-09-19T09:14:09.251401+0000","last_peered":"2024-09-19T09:14:09.251401+0000","last_clean":"2024-09-19T09:14:09.251401+0000","last_became_active":"2024-09-19T09:14:06.805316+0000","last_became_peered":"2024-09-19T09:14:06.805316+0000","last_unstale":"2024-09-19T09:14:09.251401+0000","last_undegraded":"2024-09-19T09:14:09.251401+0000","last_fullsized":"2024-09-19T09:14:09.251401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:07.720184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251347+0000","last_change":"2024-09-19T09:14:07.823337+0000","last_active":"2024-09-19T09:14:09.251347+0000","last_peered":"2024-09-19T09:14:09.251347+0000","last_clean":"2024-09-19T09:14:09.251347+0000","last_became_active":"2024-09-19T09:14:07.822777+0000","last_became_peered":"2024-09-19T09:14:07.822777+0000","last_unstale":"2024-09-19T09:14:09.251347+0000","last_undegraded":"2024-09-19T09:14:09.251347+0000","last_fullsized":"2024-09-19T09:14:09.251347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:20:48.319858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.828594+0000","last_change":"2024-09-19T09:14:06.811449+0000","last_active":"2024-09-19T09:14:08.828594+0000","last_peered":"2024-09-19T09:14:08.828594+0000","last_clean":"2024-09-19T09:14:08.828594+0000","last_became_active":"2024-09-19T09:14:06.810962+0000","last_became_peered":"2024-09-19T09:14:06.810962+0000","last_unstale":"2024-09-19T09:14:08.828594+0000","last_undegraded":"2024-09-19T09:14:08.828594+0000","last_fullsized":"2024-09-19T09:14:08.828594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:22.899039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.832846+0000","last_change":"2024-09-19T09:14:07.821586+0000","last_active":"2024-09-19T09:14:08.832846+0000","last_peered":"2024-09-19T09:14:08.832846+0000","last_clean":"2024-09-19T09:14:08.832846+0000","last_became_active":"2024-09-19T09:14:07.821363+0000","last_became_peered":"2024-09-19T09:14:07.821363+0000","last_unstale":"2024-09-19T09:14:08.832846+0000","last_undegraded":"2024-09-19T09:14:08.832846+0000","last_fullsized":"2024-09-19T09:14:08.832846+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:54.403467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.955800+0000","last_change":"2024-09-19T09:14:06.808499+0000","last_active":"2024-09-19T09:14:08.955800+0000","last_peered":"2024-09-19T09:14:08.955800+0000","last_clean":"2024-09-19T09:14:08.955800+0000","last_became_active":"2024-09-19T09:14:06.807889+0000","last_became_peered":"2024-09-19T09:14:06.807889+0000","last_unstale":"2024-09-19T09:14:08.955800+0000","last_undegraded":"2024-09-19T09:14:08.955800+0000","last_fullsized":"2024-09-19T09:14:08.955800+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:59.499261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.829206+0000","last_change":"2024-09-19T09:14:07.829957+0000","last_active":"2024-09-19T09:14:08.829206+0000","last_peered":"2024-09-19T09:14:08.829206+0000","last_clean":"2024-09-19T09:14:08.829206+0000","last_became_active":"2024-09-19T09:14:07.828445+0000","last_became_peered":"2024-09-19T09:14:07.828445+0000","last_unstale":"2024-09-19T09:14:08.829206+0000","last_undegraded":"2024-09-19T09:14:08.829206+0000","last_fullsized":"2024-09-19T09:14:08.829206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:52.342331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.831209+0000","last_change":"2024-09-19T09:14:06.806806+0000","last_active":"2024-09-19T09:14:08.831209+0000","last_peered":"2024-09-19T09:14:08.831209+0000","last_clean":"2024-09-19T09:14:08.831209+0000","last_became_active":"2024-09-19T09:14:06.806090+0000","last_became_peered":"2024-09-19T09:14:06.806090+0000","last_unstale":"2024-09-19T09:14:08.831209+0000","last_undegraded":"2024-09-19T09:14:08.831209+0000","last_fullsized":"2024-09-19T09:14:08.831209+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:43.876497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.832495+0000","last_change":"2024-09-19T09:14:07.823341+0000","last_active":"2024-09-19T09:14:08.832495+0000","last_peered":"2024-09-19T09:14:08.832495+0000","last_clean":"2024-09-19T09:14:08.832495+0000","last_became_active":"2024-09-19T09:14:07.822773+0000","last_became_peered":"2024-09-19T09:14:07.822773+0000","last_unstale":"2024-09-19T09:14:08.832495+0000","last_undegraded":"2024-09-19T09:14:08.832495+0000","last_fullsized":"2024-09-19T09:14:08.832495+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:23.336457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.956350+0000","last_change":"2024-09-19T09:14:06.804565+0000","last_active":"2024-09-19T09:14:08.956350+0000","last_peered":"2024-09-19T09:14:08.956350+0000","last_clean":"2024-09-19T09:14:08.956350+0000","last_became_active":"2024-09-19T09:14:06.804310+0000","last_became_peered":"2024-09-19T09:14:06.804310+0000","last_unstale":"2024-09-19T09:14:08.956350+0000","last_undegraded":"2024-09-19T09:14:08.956350+0000","last_fullsized":"2024-09-19T09:14:08.956350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:42.594623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251145+0000","last_change":"2024-09-19T09:14:07.819402+0000","last_active":"2024-09-19T09:14:09.251145+0000","last_peered":"2024-09-19T09:14:09.251145+0000","last_clean":"2024-09-19T09:14:09.251145+0000","last_became_active":"2024-09-19T09:14:07.819037+0000","last_became_peered":"2024-09-19T09:14:07.819037+0000","last_unstale":"2024-09-19T09:14:09.251145+0000","last_undegraded":"2024-09-19T09:14:09.251145+0000","last_fullsized":"2024-09-19T09:14:09.251145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:30:38.871492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.956257+0000","last_change":"2024-09-19T09:14:06.807555+0000","last_active":"2024-09-19T09:14:08.956257+0000","last_peered":"2024-09-19T09:14:08.956257+0000","last_clean":"2024-09-19T09:14:08.956257+0000","last_became_active":"2024-09-19T09:14:06.807295+0000","last_became_peered":"2024-09-19T09:14:06.807295+0000","last_unstale":"2024-09-19T09:14:08.956257+0000","last_undegraded":"2024-09-19T09:14:08.956257+0000","last_fullsized":"2024-09-19T09:14:08.956257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:51.491798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.250862+0000","last_change":"2024-09-19T09:14:07.823444+0000","last_active":"2024-09-19T09:14:09.250862+0000","last_peered":"2024-09-19T09:14:09.250862+0000","last_clean":"2024-09-19T09:14:09.250862+0000","last_became_active":"2024-09-19T09:14:07.822925+0000","last_became_peered":"2024-09-19T09:14:07.822925+0000","last_unstale":"2024-09-19T09:14:09.250862+0000","last_undegraded":"2024-09-19T09:14:09.250862+0000","last_fullsized":"2024-09-19T09:14:09.250862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:53.206471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.956030+0000","last_change":"2024-09-19T09:14:06.808729+0000","last_active":"2024-09-19T09:14:08.956030+0000","last_peered":"2024-09-19T09:14:08.956030+0000","last_clean":"2024-09-19T09:14:08.956030+0000","last_became_active":"2024-09-19T09:14:06.808213+0000","last_became_peered":"2024-09-19T09:14:06.808213+0000","last_unstale":"2024-09-19T09:14:08.956030+0000","last_undegraded":"2024-09-19T09:14:08.956030+0000","last_fullsized":"2024-09-19T09:14:08.956030+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:03.268583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.250860+0000","last_change":"2024-09-19T09:14:07.833209+0000","last_active":"2024-09-19T09:14:09.250860+0000","last_peered":"2024-09-19T09:14:09.250860+0000","last_clean":"2024-09-19T09:14:09.250860+0000","last_became_active":"2024-09-19T09:14:07.832153+0000","last_became_peered":"2024-09-19T09:14:07.832153+0000","last_unstale":"2024-09-19T09:14:09.250860+0000","last_undegraded":"2024-09-19T09:14:09.250860+0000","last_fullsized":"2024-09-19T09:14:09.250860+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:51.239836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.252193+0000","last_change":"2024-09-19T09:14:06.811567+0000","last_active":"2024-09-19T09:14:09.252193+0000","last_peered":"2024-09-19T09:14:09.252193+0000","last_clean":"2024-09-19T09:14:09.252193+0000","last_became_active":"2024-09-19T09:14:06.811325+0000","last_became_peered":"2024-09-19T09:14:06.811325+0000","last_unstale":"2024-09-19T09:14:09.252193+0000","last_undegraded":"2024-09-19T09:14:09.252193+0000","last_fullsized":"2024-09-19T09:14:09.252193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:45.210697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.828695+0000","last_change":"2024-09-19T09:14:07.822191+0000","last_active":"2024-09-19T09:14:08.828695+0000","last_peered":"2024-09-19T09:14:08.828695+0000","last_clean":"2024-09-19T09:14:08.828695+0000","last_became_active":"2024-09-19T09:14:07.821968+0000","last_became_peered":"2024-09-19T09:14:07.821968+0000","last_unstale":"2024-09-19T09:14:08.828695+0000","last_undegraded":"2024-09-19T09:14:08.828695+0000","last_fullsized":"2024-09-19T09:14:08.828695+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:09.645679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.250415+0000","last_change":"2024-09-19T09:14:06.808268+0000","last_active":"2024-09-19T09:14:09.250415+0000","last_peered":"2024-09-19T09:14:09.250415+0000","last_clean":"2024-09-19T09:14:09.250415+0000","last_became_active":"2024-09-19T09:14:06.807603+0000","last_became_peered":"2024-09-19T09:14:06.807603+0000","last_unstale":"2024-09-19T09:14:09.250415+0000","last_undegraded":"2024-09-19T09:14:09.250415+0000","last_fullsized":"2024-09-19T09:14:09.250415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:59.239510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251388+0000","last_change":"2024-09-19T09:14:07.821257+0000","last_active":"2024-09-19T09:14:09.251388+0000","last_peered":"2024-09-19T09:14:09.251388+0000","last_clean":"2024-09-19T09:14:09.251388+0000","last_became_active":"2024-09-19T09:14:07.820510+0000","last_became_peered":"2024-09-19T09:14:07.820510+0000","last_unstale":"2024-09-19T09:14:09.251388+0000","last_undegraded":"2024-09-19T09:14:09.251388+0000","last_fullsized":"2024-09-19T09:14:09.251388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:19.286617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.828451+0000","last_change":"2024-09-19T09:14:06.810137+0000","last_active":"2024-09-19T09:14:08.828451+0000","last_peered":"2024-09-19T09:14:08.828451+0000","last_clean":"2024-09-19T09:14:08.828451+0000","last_became_active":"2024-09-19T09:14:06.809791+0000","last_became_peered":"2024-09-19T09:14:06.809791+0000","last_unstale":"2024-09-19T09:14:08.828451+0000","last_undegraded":"2024-09-19T09:14:08.828451+0000","last_fullsized":"2024-09-19T09:14:08.828451+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:02.826028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":190,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.252413+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:14:09.252413+0000","last_peered":"2024-09-19T09:14:09.252413+0000","last_clean":"2024-09-19T09:14:09.252413+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:14:09.252413+0000","last_undegraded":"2024-09-19T09:14:09.252413+0000","last_fullsized":"2024-09-19T09:14:09.252413+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:22.478151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195177,"statfs":{"total":200000000,"available":199861333,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":136,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195175,"statfs":{"total":200000000,"available":199859743,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":712,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194600,"statfs":{"total":200000000,"available":199270405,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":136,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195175,"statfs":{"total":200000000,"available":199859721,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":136,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199860579,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195177,"statfs":{"total":200000000,"available":199861321,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":711,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194600,"statfs":{"total":200000000,"available":199270917,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195177,"statfs":{"total":200000000,"available":199861265,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:14:15.213 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:14:15.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.329+0000 7f782d331640 1 Processor -- start 2024-09-19T09:14:15.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.329+0000 7f782d331640 1 -- start start 2024-09-19T09:14:15.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.330+0000 7f782d331640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f78280d0050 0x7f78280cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:15.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.330+0000 7f782d331640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78280d0e10 con 0x7f78280b3ce0 2024-09-19T09:14:15.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.330+0000 7f782d331640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78280d0850 con 0x7f78280cf560 2024-09-19T09:14:15.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.330+0000 7f782d331640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f78280d0b30 con 0x7f78280d0050 2024-09-19T09:14:15.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.330+0000 7f78277fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f78280d0050 0x7f78280cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:15.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.330+0000 7f78267fc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f78280b3ce0 0x7f78280cd5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50716/0 (socket says 172.21.15.18:50716) 2024-09-19T09:14:15.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.330+0000 7f78267fc640 1 -- 172.21.15.18:0/659496020 learned_addr learned my addr 172.21.15.18:0/659496020 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:15.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.331+0000 7f78277fe640 1 -- 172.21.15.18:0/659496020 >> v1:172.21.15.162:6789/0 conn(0x7f78280cf560 legacy=0x7f78280cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:15.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.331+0000 7f78277fe640 1 -- 172.21.15.18:0/659496020 >> v1:172.21.15.18:6789/0 conn(0x7f78280b3ce0 legacy=0x7f78280cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:15.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.331+0000 7f7825ffb640 1 -- 172.21.15.18:0/659496020 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2798278075 0 0) 0x7f78280d0e10 con 0x7f78280b3ce0 2024-09-19T09:14:15.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.331+0000 7f78277fe640 1 -- 172.21.15.18:0/659496020 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78280b24d0 con 0x7f78280d0050 2024-09-19T09:14:15.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.331+0000 7f78277fe640 1 --2- 172.21.15.18:0/659496020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78280d0050 0x7f78280cdd00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7820009d90 tx=0x7f782002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=993e361221a98195 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:15.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.331+0000 7f7825ffb640 1 -- 172.21.15.18:0/659496020 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7820031600 con 0x7f78280d0050 2024-09-19T09:14:15.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.332+0000 7f7825ffb640 1 -- 172.21.15.18:0/659496020 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78200317a0 con 0x7f78280d0050 2024-09-19T09:14:15.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.332+0000 7f7825ffb640 1 -- 172.21.15.18:0/659496020 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7820031b70 con 0x7f78280d0050 2024-09-19T09:14:15.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.332+0000 7f782d331640 1 -- 172.21.15.18:0/659496020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78280d0050 msgr2=0x7f78280cdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:15.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.332+0000 7f782d331640 1 --2- 172.21.15.18:0/659496020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78280d0050 0x7f78280cdd00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7820009d90 tx=0x7f782002a5d0 comp rx=0 tx=0).stop 2024-09-19T09:14:15.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.332+0000 7f782d331640 1 -- 172.21.15.18:0/659496020 shutdown_connections 2024-09-19T09:14:15.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.332+0000 7f782d331640 1 --2- 172.21.15.18:0/659496020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78280d0050 0x7f78280cdd00 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:15.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.332+0000 7f782d331640 1 -- 172.21.15.18:0/659496020 >> 172.21.15.18:0/659496020 conn(0x7f78280b4700 msgr2=0x7f78280b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:15.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.332+0000 7f782d331640 1 -- 172.21.15.18:0/659496020 shutdown_connections 2024-09-19T09:14:15.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.332+0000 7f782d331640 1 -- 172.21.15.18:0/659496020 wait complete. 2024-09-19T09:14:15.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.334+0000 7f782d331640 1 Processor -- start 2024-09-19T09:14:15.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.334+0000 7f782d331640 1 -- start start 2024-09-19T09:14:15.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.334+0000 7f782d331640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f78280b3ce0 0x7f78281f8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:15.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.334+0000 7f782d331640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78280cf560 0x7f78280c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:15.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.334+0000 7f782d331640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78280d0050 0x7f78280c7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:15.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.334+0000 7f782d331640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f78280b55a0 con 0x7f78280d0050 2024-09-19T09:14:15.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.334+0000 7f782d331640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f78280b5420 con 0x7f78280cf560 2024-09-19T09:14:15.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.334+0000 7f782d331640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f782815d090 con 0x7f78280b3ce0 2024-09-19T09:14:15.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.334+0000 7f78277fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78280d0050 0x7f78280c7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:15.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.334+0000 7f78277fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78280d0050 0x7f78280c7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55758/0 (socket says 172.21.15.18:55758) 2024-09-19T09:14:15.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.334+0000 7f78277fe640 1 -- 172.21.15.18:0/3984812441 learned_addr learned my addr 172.21.15.18:0/3984812441 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:15.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.335+0000 7f7826ffd640 1 --2- 172.21.15.18:0/3984812441 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f78280b3ce0 0x7f78281f8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:15.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.335+0000 7f78267fc640 1 --2- 172.21.15.18:0/3984812441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78280cf560 0x7f78280c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:15.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.335+0000 7f78277fe640 1 -- 172.21.15.18:0/3984812441 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f78280b3ce0 msgr2=0x7f78281f8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:15.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.335+0000 7f78277fe640 1 --2- 172.21.15.18:0/3984812441 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f78280b3ce0 0x7f78281f8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:15.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.335+0000 7f78277fe640 1 -- 172.21.15.18:0/3984812441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78280cf560 msgr2=0x7f78280c7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:15.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.335+0000 7f78277fe640 1 --2- 172.21.15.18:0/3984812441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78280cf560 0x7f78280c7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:15.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.335+0000 7f78277fe640 1 -- 172.21.15.18:0/3984812441 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78281f8fb0 con 0x7f78280d0050 2024-09-19T09:14:15.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.335+0000 7f78267fc640 1 --2- 172.21.15.18:0/3984812441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78280cf560 0x7f78280c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:15.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.335+0000 7f7826ffd640 1 --2- 172.21.15.18:0/3984812441 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f78280b3ce0 0x7f78281f8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:15.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.335+0000 7f78277fe640 1 --2- 172.21.15.18:0/3984812441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78280d0050 0x7f78280c7f70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7820009d90 tx=0x7f7820004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:15.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.335+0000 7f780f7fe640 1 -- 172.21.15.18:0/3984812441 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782003f070 con 0x7f78280d0050 2024-09-19T09:14:15.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.335+0000 7f780f7fe640 1 -- 172.21.15.18:0/3984812441 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7820030be0 con 0x7f78280d0050 2024-09-19T09:14:15.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.335+0000 7f782d331640 1 -- 172.21.15.18:0/3984812441 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78280c8d70 con 0x7f78280d0050 2024-09-19T09:14:15.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.335+0000 7f780f7fe640 1 -- 172.21.15.18:0/3984812441 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7820003990 con 0x7f78280d0050 2024-09-19T09:14:15.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.335+0000 7f782d331640 1 -- 172.21.15.18:0/3984812441 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78280c9330 con 0x7f78280d0050 2024-09-19T09:14:15.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.336+0000 7f782d331640 1 -- 172.21.15.18:0/3984812441 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78280c8b90 con 0x7f78280d0050 2024-09-19T09:14:15.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.337+0000 7f780f7fe640 1 -- 172.21.15.18:0/3984812441 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7820003b30 con 0x7f78280d0050 2024-09-19T09:14:15.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.337+0000 7f780f7fe640 1 --2- 172.21.15.18:0/3984812441 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f781406c2b0 0x7f781406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:15.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.338+0000 7f780f7fe640 1 -- 172.21.15.18:0/3984812441 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f78200ac500 con 0x7f78280d0050 2024-09-19T09:14:15.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.338+0000 7f7826ffd640 1 --2- 172.21.15.18:0/3984812441 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f781406c2b0 0x7f781406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:15.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.338+0000 7f7826ffd640 1 --2- 172.21.15.18:0/3984812441 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f781406c2b0 0x7f781406e770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7818007fd0 tx=0x7f7818009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:15.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.342+0000 7f780f7fe640 1 -- 172.21.15.18:0/3984812441 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f78280c8b90 con 0x7f78280d0050 2024-09-19T09:14:15.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.514+0000 7f782d331640 1 -- 172.21.15.18:0/3984812441 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f78280cf940 con 0x7f781406c2b0 2024-09-19T09:14:15.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.520+0000 7f780f7fe640 1 -- 172.21.15.18:0/3984812441 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247491 (secure 0 0 0) 0x7f78280cf940 con 0x7f781406c2b0 2024-09-19T09:14:15.523 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:15.524 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:14:15.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.523+0000 7f782d331640 1 -- 172.21.15.18:0/3984812441 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f781406c2b0 msgr2=0x7f781406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:15.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.523+0000 7f782d331640 1 --2- 172.21.15.18:0/3984812441 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f781406c2b0 0x7f781406e770 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7818007fd0 tx=0x7f7818009040 comp rx=0 tx=0).stop 2024-09-19T09:14:15.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.523+0000 7f782d331640 1 -- 172.21.15.18:0/3984812441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78280d0050 msgr2=0x7f78280c7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:15.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.523+0000 7f782d331640 1 --2- 172.21.15.18:0/3984812441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78280d0050 0x7f78280c7f70 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7820009d90 tx=0x7f7820004a40 comp rx=0 tx=0).stop 2024-09-19T09:14:15.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.523+0000 7f782d331640 1 -- 172.21.15.18:0/3984812441 shutdown_connections 2024-09-19T09:14:15.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.523+0000 7f782d331640 1 --2- 172.21.15.18:0/3984812441 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f781406c2b0 0x7f781406e770 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:15.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.523+0000 7f782d331640 1 --2- 172.21.15.18:0/3984812441 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f78280d0050 0x7f78280c7f70 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:15.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.523+0000 7f782d331640 1 --2- 172.21.15.18:0/3984812441 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f78280cf560 0x7f78280c7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:15.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.523+0000 7f782d331640 1 --2- 172.21.15.18:0/3984812441 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f78280b3ce0 0x7f78281f8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:15.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.523+0000 7f782d331640 1 -- 172.21.15.18:0/3984812441 >> 172.21.15.18:0/3984812441 conn(0x7f78280b4700 msgr2=0x7f78280d3370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:15.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.523+0000 7f782d331640 1 -- 172.21.15.18:0/3984812441 shutdown_connections 2024-09-19T09:14:15.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.523+0000 7f782d331640 1 -- 172.21.15.18:0/3984812441 wait complete. 2024-09-19T09:14:15.535 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-09-19T09:14:13.535650+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2240,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560259,"statfs":{"total":1600000000,"available":1597705284,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.739464"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.252036+0000","last_change":"2024-09-19T09:14:07.826853+0000","last_active":"2024-09-19T09:14:09.252036+0000","last_peered":"2024-09-19T09:14:09.252036+0000","last_clean":"2024-09-19T09:14:09.252036+0000","last_became_active":"2024-09-19T09:14:07.822878+0000","last_became_peered":"2024-09-19T09:14:07.822878+0000","last_unstale":"2024-09-19T09:14:09.252036+0000","last_undegraded":"2024-09-19T09:14:09.252036+0000","last_fullsized":"2024-09-19T09:14:09.252036+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:14.026470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.830887+0000","last_change":"2024-09-19T09:14:07.820258+0000","last_active":"2024-09-19T09:14:08.830887+0000","last_peered":"2024-09-19T09:14:08.830887+0000","last_clean":"2024-09-19T09:14:08.830887+0000","last_became_active":"2024-09-19T09:14:07.819713+0000","last_became_peered":"2024-09-19T09:14:07.819713+0000","last_unstale":"2024-09-19T09:14:08.830887+0000","last_undegraded":"2024-09-19T09:14:08.830887+0000","last_fullsized":"2024-09-19T09:14:08.830887+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:32:48.027249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.252350+0000","last_change":"2024-09-19T09:14:07.818310+0000","last_active":"2024-09-19T09:14:09.252350+0000","last_peered":"2024-09-19T09:14:09.252350+0000","last_clean":"2024-09-19T09:14:09.252350+0000","last_became_active":"2024-09-19T09:14:07.817960+0000","last_became_peered":"2024-09-19T09:14:07.817960+0000","last_unstale":"2024-09-19T09:14:09.252350+0000","last_undegraded":"2024-09-19T09:14:09.252350+0000","last_fullsized":"2024-09-19T09:14:09.252350+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:47:35.316847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251055+0000","last_change":"2024-09-19T09:14:07.832864+0000","last_active":"2024-09-19T09:14:09.251055+0000","last_peered":"2024-09-19T09:14:09.251055+0000","last_clean":"2024-09-19T09:14:09.251055+0000","last_became_active":"2024-09-19T09:14:07.831762+0000","last_became_peered":"2024-09-19T09:14:07.831762+0000","last_unstale":"2024-09-19T09:14:09.251055+0000","last_undegraded":"2024-09-19T09:14:09.251055+0000","last_fullsized":"2024-09-19T09:14:09.251055+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:51.404199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.831243+0000","last_change":"2024-09-19T09:14:07.824929+0000","last_active":"2024-09-19T09:14:08.831243+0000","last_peered":"2024-09-19T09:14:08.831243+0000","last_clean":"2024-09-19T09:14:08.831243+0000","last_became_active":"2024-09-19T09:14:07.824676+0000","last_became_peered":"2024-09-19T09:14:07.824676+0000","last_unstale":"2024-09-19T09:14:08.831243+0000","last_undegraded":"2024-09-19T09:14:08.831243+0000","last_fullsized":"2024-09-19T09:14:08.831243+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:30.410652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.832580+0000","last_change":"2024-09-19T09:14:07.823074+0000","last_active":"2024-09-19T09:14:08.832580+0000","last_peered":"2024-09-19T09:14:08.832580+0000","last_clean":"2024-09-19T09:14:08.832580+0000","last_became_active":"2024-09-19T09:14:07.822835+0000","last_became_peered":"2024-09-19T09:14:07.822835+0000","last_unstale":"2024-09-19T09:14:08.832580+0000","last_undegraded":"2024-09-19T09:14:08.832580+0000","last_fullsized":"2024-09-19T09:14:08.832580+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:49.485902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251640+0000","last_change":"2024-09-19T09:14:07.818492+0000","last_active":"2024-09-19T09:14:09.251640+0000","last_peered":"2024-09-19T09:14:09.251640+0000","last_clean":"2024-09-19T09:14:09.251640+0000","last_became_active":"2024-09-19T09:14:07.818242+0000","last_became_peered":"2024-09-19T09:14:07.818242+0000","last_unstale":"2024-09-19T09:14:09.251640+0000","last_undegraded":"2024-09-19T09:14:09.251640+0000","last_fullsized":"2024-09-19T09:14:09.251640+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:30:52.966279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251574+0000","last_change":"2024-09-19T09:14:07.825641+0000","last_active":"2024-09-19T09:14:09.251574+0000","last_peered":"2024-09-19T09:14:09.251574+0000","last_clean":"2024-09-19T09:14:09.251574+0000","last_became_active":"2024-09-19T09:14:07.825004+0000","last_became_peered":"2024-09-19T09:14:07.825004+0000","last_unstale":"2024-09-19T09:14:09.251574+0000","last_undegraded":"2024-09-19T09:14:09.251574+0000","last_fullsized":"2024-09-19T09:14:09.251574+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:10:44.129227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251949+0000","last_change":"2024-09-19T09:14:07.826199+0000","last_active":"2024-09-19T09:14:09.251949+0000","last_peered":"2024-09-19T09:14:09.251949+0000","last_clean":"2024-09-19T09:14:09.251949+0000","last_became_active":"2024-09-19T09:14:07.825947+0000","last_became_peered":"2024-09-19T09:14:07.825947+0000","last_unstale":"2024-09-19T09:14:09.251949+0000","last_undegraded":"2024-09-19T09:14:09.251949+0000","last_fullsized":"2024-09-19T09:14:09.251949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:37:38.986839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.250699+0000","last_change":"2024-09-19T09:14:07.822826+0000","last_active":"2024-09-19T09:14:09.250699+0000","last_peered":"2024-09-19T09:14:09.250699+0000","last_clean":"2024-09-19T09:14:09.250699+0000","last_became_active":"2024-09-19T09:14:07.822247+0000","last_became_peered":"2024-09-19T09:14:07.822247+0000","last_unstale":"2024-09-19T09:14:09.250699+0000","last_undegraded":"2024-09-19T09:14:09.250699+0000","last_fullsized":"2024-09-19T09:14:09.250699+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:40.960015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.828384+0000","last_change":"2024-09-19T09:14:07.827604+0000","last_active":"2024-09-19T09:14:08.828384+0000","last_peered":"2024-09-19T09:14:08.828384+0000","last_clean":"2024-09-19T09:14:08.828384+0000","last_became_active":"2024-09-19T09:14:07.827309+0000","last_became_peered":"2024-09-19T09:14:07.827309+0000","last_unstale":"2024-09-19T09:14:08.828384+0000","last_undegraded":"2024-09-19T09:14:08.828384+0000","last_fullsized":"2024-09-19T09:14:08.828384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:48.381855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251054+0000","last_change":"2024-09-19T09:14:07.825040+0000","last_active":"2024-09-19T09:14:09.251054+0000","last_peered":"2024-09-19T09:14:09.251054+0000","last_clean":"2024-09-19T09:14:09.251054+0000","last_became_active":"2024-09-19T09:14:07.824788+0000","last_became_peered":"2024-09-19T09:14:07.824788+0000","last_unstale":"2024-09-19T09:14:09.251054+0000","last_undegraded":"2024-09-19T09:14:09.251054+0000","last_fullsized":"2024-09-19T09:14:09.251054+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:26.895589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.956053+0000","last_change":"2024-09-19T09:14:07.828167+0000","last_active":"2024-09-19T09:14:08.956053+0000","last_peered":"2024-09-19T09:14:08.956053+0000","last_clean":"2024-09-19T09:14:08.956053+0000","last_became_active":"2024-09-19T09:14:07.826514+0000","last_became_peered":"2024-09-19T09:14:07.826514+0000","last_unstale":"2024-09-19T09:14:08.956053+0000","last_undegraded":"2024-09-19T09:14:08.956053+0000","last_fullsized":"2024-09-19T09:14:08.956053+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:50:04.432628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251431+0000","last_change":"2024-09-19T09:14:07.821427+0000","last_active":"2024-09-19T09:14:09.251431+0000","last_peered":"2024-09-19T09:14:09.251431+0000","last_clean":"2024-09-19T09:14:09.251431+0000","last_became_active":"2024-09-19T09:14:07.821110+0000","last_became_peered":"2024-09-19T09:14:07.821110+0000","last_unstale":"2024-09-19T09:14:09.251431+0000","last_undegraded":"2024-09-19T09:14:09.251431+0000","last_fullsized":"2024-09-19T09:14:09.251431+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:19:13.811469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251103+0000","last_change":"2024-09-19T09:14:07.821046+0000","last_active":"2024-09-19T09:14:09.251103+0000","last_peered":"2024-09-19T09:14:09.251103+0000","last_clean":"2024-09-19T09:14:09.251103+0000","last_became_active":"2024-09-19T09:14:07.819453+0000","last_became_peered":"2024-09-19T09:14:07.819453+0000","last_unstale":"2024-09-19T09:14:09.251103+0000","last_undegraded":"2024-09-19T09:14:09.251103+0000","last_fullsized":"2024-09-19T09:14:09.251103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:20:35.793669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251089+0000","last_change":"2024-09-19T09:14:07.820339+0000","last_active":"2024-09-19T09:14:09.251089+0000","last_peered":"2024-09-19T09:14:09.251089+0000","last_clean":"2024-09-19T09:14:09.251089+0000","last_became_active":"2024-09-19T09:14:07.820027+0000","last_became_peered":"2024-09-19T09:14:07.820027+0000","last_unstale":"2024-09-19T09:14:09.251089+0000","last_undegraded":"2024-09-19T09:14:09.251089+0000","last_fullsized":"2024-09-19T09:14:09.251089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:50.498213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.828818+0000","last_change":"2024-09-19T09:14:07.833460+0000","last_active":"2024-09-19T09:14:08.828818+0000","last_peered":"2024-09-19T09:14:08.828818+0000","last_clean":"2024-09-19T09:14:08.828818+0000","last_became_active":"2024-09-19T09:14:07.829405+0000","last_became_peered":"2024-09-19T09:14:07.829405+0000","last_unstale":"2024-09-19T09:14:08.828818+0000","last_undegraded":"2024-09-19T09:14:08.828818+0000","last_fullsized":"2024-09-19T09:14:08.828818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:53.720752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.832462+0000","last_change":"2024-09-19T09:14:07.824055+0000","last_active":"2024-09-19T09:14:08.832462+0000","last_peered":"2024-09-19T09:14:08.832462+0000","last_clean":"2024-09-19T09:14:08.832462+0000","last_became_active":"2024-09-19T09:14:07.823526+0000","last_became_peered":"2024-09-19T09:14:07.823526+0000","last_unstale":"2024-09-19T09:14:08.832462+0000","last_undegraded":"2024-09-19T09:14:08.832462+0000","last_fullsized":"2024-09-19T09:14:08.832462+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:19.891139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.832327+0000","last_change":"2024-09-19T09:14:07.824475+0000","last_active":"2024-09-19T09:14:08.832327+0000","last_peered":"2024-09-19T09:14:08.832327+0000","last_clean":"2024-09-19T09:14:08.832327+0000","last_became_active":"2024-09-19T09:14:07.824231+0000","last_became_peered":"2024-09-19T09:14:07.824231+0000","last_unstale":"2024-09-19T09:14:08.832327+0000","last_undegraded":"2024-09-19T09:14:08.832327+0000","last_fullsized":"2024-09-19T09:14:08.832327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:23:51.806394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.956299+0000","last_change":"2024-09-19T09:14:07.827001+0000","last_active":"2024-09-19T09:14:08.956299+0000","last_peered":"2024-09-19T09:14:08.956299+0000","last_clean":"2024-09-19T09:14:08.956299+0000","last_became_active":"2024-09-19T09:14:07.826526+0000","last_became_peered":"2024-09-19T09:14:07.826526+0000","last_unstale":"2024-09-19T09:14:08.956299+0000","last_undegraded":"2024-09-19T09:14:08.956299+0000","last_fullsized":"2024-09-19T09:14:08.956299+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:24:33.683598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251343+0000","last_change":"2024-09-19T09:14:07.824607+0000","last_active":"2024-09-19T09:14:09.251343+0000","last_peered":"2024-09-19T09:14:09.251343+0000","last_clean":"2024-09-19T09:14:09.251343+0000","last_became_active":"2024-09-19T09:14:07.824160+0000","last_became_peered":"2024-09-19T09:14:07.824160+0000","last_unstale":"2024-09-19T09:14:09.251343+0000","last_undegraded":"2024-09-19T09:14:09.251343+0000","last_fullsized":"2024-09-19T09:14:09.251343+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:09.387654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251719+0000","last_change":"2024-09-19T09:14:07.821781+0000","last_active":"2024-09-19T09:14:09.251719+0000","last_peered":"2024-09-19T09:14:09.251719+0000","last_clean":"2024-09-19T09:14:09.251719+0000","last_became_active":"2024-09-19T09:14:07.821547+0000","last_became_peered":"2024-09-19T09:14:07.821547+0000","last_unstale":"2024-09-19T09:14:09.251719+0000","last_undegraded":"2024-09-19T09:14:09.251719+0000","last_fullsized":"2024-09-19T09:14:09.251719+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:22.182039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.956185+0000","last_change":"2024-09-19T09:14:07.827265+0000","last_active":"2024-09-19T09:14:08.956185+0000","last_peered":"2024-09-19T09:14:08.956185+0000","last_clean":"2024-09-19T09:14:08.956185+0000","last_became_active":"2024-09-19T09:14:07.825746+0000","last_became_peered":"2024-09-19T09:14:07.825746+0000","last_unstale":"2024-09-19T09:14:08.956185+0000","last_undegraded":"2024-09-19T09:14:08.956185+0000","last_fullsized":"2024-09-19T09:14:08.956185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:40:37.921663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251377+0000","last_change":"2024-09-19T09:14:07.829462+0000","last_active":"2024-09-19T09:14:09.251377+0000","last_peered":"2024-09-19T09:14:09.251377+0000","last_clean":"2024-09-19T09:14:09.251377+0000","last_became_active":"2024-09-19T09:14:07.829090+0000","last_became_peered":"2024-09-19T09:14:07.829090+0000","last_unstale":"2024-09-19T09:14:09.251377+0000","last_undegraded":"2024-09-19T09:14:09.251377+0000","last_fullsized":"2024-09-19T09:14:09.251377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:39:57.903976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.250804+0000","last_change":"2024-09-19T09:14:07.829300+0000","last_active":"2024-09-19T09:14:09.250804+0000","last_peered":"2024-09-19T09:14:09.250804+0000","last_clean":"2024-09-19T09:14:09.250804+0000","last_became_active":"2024-09-19T09:14:07.828961+0000","last_became_peered":"2024-09-19T09:14:07.828961+0000","last_unstale":"2024-09-19T09:14:09.250804+0000","last_undegraded":"2024-09-19T09:14:09.250804+0000","last_fullsized":"2024-09-19T09:14:09.250804+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:43.929037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251107+0000","last_change":"2024-09-19T09:14:07.825391+0000","last_active":"2024-09-19T09:14:09.251107+0000","last_peered":"2024-09-19T09:14:09.251107+0000","last_clean":"2024-09-19T09:14:09.251107+0000","last_became_active":"2024-09-19T09:14:07.824719+0000","last_became_peered":"2024-09-19T09:14:07.824719+0000","last_unstale":"2024-09-19T09:14:09.251107+0000","last_undegraded":"2024-09-19T09:14:09.251107+0000","last_fullsized":"2024-09-19T09:14:09.251107+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:00.832046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.831045+0000","last_change":"2024-09-19T09:14:07.820445+0000","last_active":"2024-09-19T09:14:08.831045+0000","last_peered":"2024-09-19T09:14:08.831045+0000","last_clean":"2024-09-19T09:14:08.831045+0000","last_became_active":"2024-09-19T09:14:07.820037+0000","last_became_peered":"2024-09-19T09:14:07.820037+0000","last_unstale":"2024-09-19T09:14:08.831045+0000","last_undegraded":"2024-09-19T09:14:08.831045+0000","last_fullsized":"2024-09-19T09:14:08.831045+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:46.275001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251715+0000","last_change":"2024-09-19T09:14:07.825365+0000","last_active":"2024-09-19T09:14:09.251715+0000","last_peered":"2024-09-19T09:14:09.251715+0000","last_clean":"2024-09-19T09:14:09.251715+0000","last_became_active":"2024-09-19T09:14:07.824651+0000","last_became_peered":"2024-09-19T09:14:07.824651+0000","last_unstale":"2024-09-19T09:14:09.251715+0000","last_undegraded":"2024-09-19T09:14:09.251715+0000","last_fullsized":"2024-09-19T09:14:09.251715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:28:23.226024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251206+0000","last_change":"2024-09-19T09:14:07.822079+0000","last_active":"2024-09-19T09:14:09.251206+0000","last_peered":"2024-09-19T09:14:09.251206+0000","last_clean":"2024-09-19T09:14:09.251206+0000","last_became_active":"2024-09-19T09:14:07.821807+0000","last_became_peered":"2024-09-19T09:14:07.821807+0000","last_unstale":"2024-09-19T09:14:09.251206+0000","last_undegraded":"2024-09-19T09:14:09.251206+0000","last_fullsized":"2024-09-19T09:14:09.251206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:02.251979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251250+0000","last_change":"2024-09-19T09:14:07.831039+0000","last_active":"2024-09-19T09:14:09.251250+0000","last_peered":"2024-09-19T09:14:09.251250+0000","last_clean":"2024-09-19T09:14:09.251250+0000","last_became_active":"2024-09-19T09:14:07.830605+0000","last_became_peered":"2024-09-19T09:14:07.830605+0000","last_unstale":"2024-09-19T09:14:09.251250+0000","last_undegraded":"2024-09-19T09:14:09.251250+0000","last_fullsized":"2024-09-19T09:14:09.251250+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:45.380798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.252178+0000","last_change":"2024-09-19T09:14:07.823108+0000","last_active":"2024-09-19T09:14:09.252178+0000","last_peered":"2024-09-19T09:14:09.252178+0000","last_clean":"2024-09-19T09:14:09.252178+0000","last_became_active":"2024-09-19T09:14:07.822182+0000","last_became_peered":"2024-09-19T09:14:07.822182+0000","last_unstale":"2024-09-19T09:14:09.252178+0000","last_undegraded":"2024-09-19T09:14:09.252178+0000","last_fullsized":"2024-09-19T09:14:09.252178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:59:47.490567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.828958+0000","last_change":"2024-09-19T09:14:07.832637+0000","last_active":"2024-09-19T09:14:08.828958+0000","last_peered":"2024-09-19T09:14:08.828958+0000","last_clean":"2024-09-19T09:14:08.828958+0000","last_became_active":"2024-09-19T09:14:07.829095+0000","last_became_peered":"2024-09-19T09:14:07.829095+0000","last_unstale":"2024-09-19T09:14:08.828958+0000","last_undegraded":"2024-09-19T09:14:08.828958+0000","last_fullsized":"2024-09-19T09:14:08.828958+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:47:57.887886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.955949+0000","last_change":"2024-09-19T09:14:07.823956+0000","last_active":"2024-09-19T09:14:08.955949+0000","last_peered":"2024-09-19T09:14:08.955949+0000","last_clean":"2024-09-19T09:14:08.955949+0000","last_became_active":"2024-09-19T09:14:07.823645+0000","last_became_peered":"2024-09-19T09:14:07.823645+0000","last_unstale":"2024-09-19T09:14:08.955949+0000","last_undegraded":"2024-09-19T09:14:08.955949+0000","last_fullsized":"2024-09-19T09:14:08.955949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:41.808292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.828530+0000","last_change":"2024-09-19T09:14:06.808795+0000","last_active":"2024-09-19T09:14:08.828530+0000","last_peered":"2024-09-19T09:14:08.828530+0000","last_clean":"2024-09-19T09:14:08.828530+0000","last_became_active":"2024-09-19T09:14:06.808600+0000","last_became_peered":"2024-09-19T09:14:06.808600+0000","last_unstale":"2024-09-19T09:14:08.828530+0000","last_undegraded":"2024-09-19T09:14:08.828530+0000","last_fullsized":"2024-09-19T09:14:08.828530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:28.548321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251849+0000","last_change":"2024-09-19T09:14:07.823697+0000","last_active":"2024-09-19T09:14:09.251849+0000","last_peered":"2024-09-19T09:14:09.251849+0000","last_clean":"2024-09-19T09:14:09.251849+0000","last_became_active":"2024-09-19T09:14:07.823471+0000","last_became_peered":"2024-09-19T09:14:07.823471+0000","last_unstale":"2024-09-19T09:14:09.251849+0000","last_undegraded":"2024-09-19T09:14:09.251849+0000","last_fullsized":"2024-09-19T09:14:09.251849+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:40:04.864558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251252+0000","last_change":"2024-09-19T09:14:06.808463+0000","last_active":"2024-09-19T09:14:09.251252+0000","last_peered":"2024-09-19T09:14:09.251252+0000","last_clean":"2024-09-19T09:14:09.251252+0000","last_became_active":"2024-09-19T09:14:06.807903+0000","last_became_peered":"2024-09-19T09:14:06.807903+0000","last_unstale":"2024-09-19T09:14:09.251252+0000","last_undegraded":"2024-09-19T09:14:09.251252+0000","last_fullsized":"2024-09-19T09:14:09.251252+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:14.579464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.252315+0000","last_change":"2024-09-19T09:14:07.827953+0000","last_active":"2024-09-19T09:14:09.252315+0000","last_peered":"2024-09-19T09:14:09.252315+0000","last_clean":"2024-09-19T09:14:09.252315+0000","last_became_active":"2024-09-19T09:14:07.827684+0000","last_became_peered":"2024-09-19T09:14:07.827684+0000","last_unstale":"2024-09-19T09:14:09.252315+0000","last_undegraded":"2024-09-19T09:14:09.252315+0000","last_fullsized":"2024-09-19T09:14:09.252315+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:58.879241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.832610+0000","last_change":"2024-09-19T09:14:06.805444+0000","last_active":"2024-09-19T09:14:08.832610+0000","last_peered":"2024-09-19T09:14:08.832610+0000","last_clean":"2024-09-19T09:14:08.832610+0000","last_became_active":"2024-09-19T09:14:06.805086+0000","last_became_peered":"2024-09-19T09:14:06.805086+0000","last_unstale":"2024-09-19T09:14:08.832610+0000","last_undegraded":"2024-09-19T09:14:08.832610+0000","last_fullsized":"2024-09-19T09:14:08.832610+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:12.912740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.250967+0000","last_change":"2024-09-19T09:14:07.825679+0000","last_active":"2024-09-19T09:14:09.250967+0000","last_peered":"2024-09-19T09:14:09.250967+0000","last_clean":"2024-09-19T09:14:09.250967+0000","last_became_active":"2024-09-19T09:14:07.825017+0000","last_became_peered":"2024-09-19T09:14:07.825017+0000","last_unstale":"2024-09-19T09:14:09.250967+0000","last_undegraded":"2024-09-19T09:14:09.250967+0000","last_fullsized":"2024-09-19T09:14:09.250967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:55.990712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.250918+0000","last_change":"2024-09-19T09:14:06.806271+0000","last_active":"2024-09-19T09:14:09.250918+0000","last_peered":"2024-09-19T09:14:09.250918+0000","last_clean":"2024-09-19T09:14:09.250918+0000","last_became_active":"2024-09-19T09:14:06.805596+0000","last_became_peered":"2024-09-19T09:14:06.805596+0000","last_unstale":"2024-09-19T09:14:09.250918+0000","last_undegraded":"2024-09-19T09:14:09.250918+0000","last_fullsized":"2024-09-19T09:14:09.250918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:24.462955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.252535+0000","last_change":"2024-09-19T09:14:07.820988+0000","last_active":"2024-09-19T09:14:09.252535+0000","last_peered":"2024-09-19T09:14:09.252535+0000","last_clean":"2024-09-19T09:14:09.252535+0000","last_became_active":"2024-09-19T09:14:07.820709+0000","last_became_peered":"2024-09-19T09:14:07.820709+0000","last_unstale":"2024-09-19T09:14:09.252535+0000","last_undegraded":"2024-09-19T09:14:09.252535+0000","last_fullsized":"2024-09-19T09:14:09.252535+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:54:55.744436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251817+0000","last_change":"2024-09-19T09:14:06.809456+0000","last_active":"2024-09-19T09:14:09.251817+0000","last_peered":"2024-09-19T09:14:09.251817+0000","last_clean":"2024-09-19T09:14:09.251817+0000","last_became_active":"2024-09-19T09:14:06.808374+0000","last_became_peered":"2024-09-19T09:14:06.808374+0000","last_unstale":"2024-09-19T09:14:09.251817+0000","last_undegraded":"2024-09-19T09:14:09.251817+0000","last_fullsized":"2024-09-19T09:14:09.251817+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:38.923466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251789+0000","last_change":"2024-09-19T09:14:07.820765+0000","last_active":"2024-09-19T09:14:09.251789+0000","last_peered":"2024-09-19T09:14:09.251789+0000","last_clean":"2024-09-19T09:14:09.251789+0000","last_became_active":"2024-09-19T09:14:07.820538+0000","last_became_peered":"2024-09-19T09:14:07.820538+0000","last_unstale":"2024-09-19T09:14:09.251789+0000","last_undegraded":"2024-09-19T09:14:09.251789+0000","last_fullsized":"2024-09-19T09:14:09.251789+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:03.183403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.252099+0000","last_change":"2024-09-19T09:14:06.807230+0000","last_active":"2024-09-19T09:14:09.252099+0000","last_peered":"2024-09-19T09:14:09.252099+0000","last_clean":"2024-09-19T09:14:09.252099+0000","last_became_active":"2024-09-19T09:14:06.806996+0000","last_became_peered":"2024-09-19T09:14:06.806996+0000","last_unstale":"2024-09-19T09:14:09.252099+0000","last_undegraded":"2024-09-19T09:14:09.252099+0000","last_fullsized":"2024-09-19T09:14:09.252099+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:35:44.624976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251201+0000","last_change":"2024-09-19T09:14:07.823519+0000","last_active":"2024-09-19T09:14:09.251201+0000","last_peered":"2024-09-19T09:14:09.251201+0000","last_clean":"2024-09-19T09:14:09.251201+0000","last_became_active":"2024-09-19T09:14:07.823117+0000","last_became_peered":"2024-09-19T09:14:07.823117+0000","last_unstale":"2024-09-19T09:14:09.251201+0000","last_undegraded":"2024-09-19T09:14:09.251201+0000","last_fullsized":"2024-09-19T09:14:09.251201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:52.223642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.832556+0000","last_change":"2024-09-19T09:14:06.805757+0000","last_active":"2024-09-19T09:14:08.832556+0000","last_peered":"2024-09-19T09:14:08.832556+0000","last_clean":"2024-09-19T09:14:08.832556+0000","last_became_active":"2024-09-19T09:14:06.805470+0000","last_became_peered":"2024-09-19T09:14:06.805470+0000","last_unstale":"2024-09-19T09:14:08.832556+0000","last_undegraded":"2024-09-19T09:14:08.832556+0000","last_fullsized":"2024-09-19T09:14:08.832556+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:45:08.522092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251201+0000","last_change":"2024-09-19T09:14:07.824555+0000","last_active":"2024-09-19T09:14:09.251201+0000","last_peered":"2024-09-19T09:14:09.251201+0000","last_clean":"2024-09-19T09:14:09.251201+0000","last_became_active":"2024-09-19T09:14:07.824308+0000","last_became_peered":"2024-09-19T09:14:07.824308+0000","last_unstale":"2024-09-19T09:14:09.251201+0000","last_undegraded":"2024-09-19T09:14:09.251201+0000","last_fullsized":"2024-09-19T09:14:09.251201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:25:40.127305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251561+0000","last_change":"2024-09-19T09:14:06.808879+0000","last_active":"2024-09-19T09:14:09.251561+0000","last_peered":"2024-09-19T09:14:09.251561+0000","last_clean":"2024-09-19T09:14:09.251561+0000","last_became_active":"2024-09-19T09:14:06.808107+0000","last_became_peered":"2024-09-19T09:14:06.808107+0000","last_unstale":"2024-09-19T09:14:09.251561+0000","last_undegraded":"2024-09-19T09:14:09.251561+0000","last_fullsized":"2024-09-19T09:14:09.251561+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:18.458544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.829404+0000","last_change":"2024-09-19T09:14:07.833766+0000","last_active":"2024-09-19T09:14:08.829404+0000","last_peered":"2024-09-19T09:14:08.829404+0000","last_clean":"2024-09-19T09:14:08.829404+0000","last_became_active":"2024-09-19T09:14:07.829712+0000","last_became_peered":"2024-09-19T09:14:07.829712+0000","last_unstale":"2024-09-19T09:14:08.829404+0000","last_undegraded":"2024-09-19T09:14:08.829404+0000","last_fullsized":"2024-09-19T09:14:08.829404+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:26.688351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.830878+0000","last_change":"2024-09-19T09:14:06.802278+0000","last_active":"2024-09-19T09:14:08.830878+0000","last_peered":"2024-09-19T09:14:08.830878+0000","last_clean":"2024-09-19T09:14:08.830878+0000","last_became_active":"2024-09-19T09:14:06.802047+0000","last_became_peered":"2024-09-19T09:14:06.802047+0000","last_unstale":"2024-09-19T09:14:08.830878+0000","last_undegraded":"2024-09-19T09:14:08.830878+0000","last_fullsized":"2024-09-19T09:14:08.830878+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:42.811517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.250739+0000","last_change":"2024-09-19T09:14:07.823638+0000","last_active":"2024-09-19T09:14:09.250739+0000","last_peered":"2024-09-19T09:14:09.250739+0000","last_clean":"2024-09-19T09:14:09.250739+0000","last_became_active":"2024-09-19T09:14:07.823217+0000","last_became_peered":"2024-09-19T09:14:07.823217+0000","last_unstale":"2024-09-19T09:14:09.250739+0000","last_undegraded":"2024-09-19T09:14:09.250739+0000","last_fullsized":"2024-09-19T09:14:09.250739+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:56:51.892575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.831227+0000","last_change":"2024-09-19T09:14:06.803987+0000","last_active":"2024-09-19T09:14:08.831227+0000","last_peered":"2024-09-19T09:14:08.831227+0000","last_clean":"2024-09-19T09:14:08.831227+0000","last_became_active":"2024-09-19T09:14:06.803735+0000","last_became_peered":"2024-09-19T09:14:06.803735+0000","last_unstale":"2024-09-19T09:14:08.831227+0000","last_undegraded":"2024-09-19T09:14:08.831227+0000","last_fullsized":"2024-09-19T09:14:08.831227+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:01.871800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.250684+0000","last_change":"2024-09-19T09:14:07.834930+0000","last_active":"2024-09-19T09:14:09.250684+0000","last_peered":"2024-09-19T09:14:09.250684+0000","last_clean":"2024-09-19T09:14:09.250684+0000","last_became_active":"2024-09-19T09:14:07.832556+0000","last_became_peered":"2024-09-19T09:14:07.832556+0000","last_unstale":"2024-09-19T09:14:09.250684+0000","last_undegraded":"2024-09-19T09:14:09.250684+0000","last_fullsized":"2024-09-19T09:14:09.250684+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:28.313132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.828723+0000","last_change":"2024-09-19T09:14:06.810245+0000","last_active":"2024-09-19T09:14:08.828723+0000","last_peered":"2024-09-19T09:14:08.828723+0000","last_clean":"2024-09-19T09:14:08.828723+0000","last_became_active":"2024-09-19T09:14:06.810015+0000","last_became_peered":"2024-09-19T09:14:06.810015+0000","last_unstale":"2024-09-19T09:14:08.828723+0000","last_undegraded":"2024-09-19T09:14:08.828723+0000","last_fullsized":"2024-09-19T09:14:08.828723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:42.408595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.828478+0000","last_change":"2024-09-19T09:14:07.826142+0000","last_active":"2024-09-19T09:14:08.828478+0000","last_peered":"2024-09-19T09:14:08.828478+0000","last_clean":"2024-09-19T09:14:08.828478+0000","last_became_active":"2024-09-19T09:14:07.825926+0000","last_became_peered":"2024-09-19T09:14:07.825926+0000","last_unstale":"2024-09-19T09:14:08.828478+0000","last_undegraded":"2024-09-19T09:14:08.828478+0000","last_fullsized":"2024-09-19T09:14:08.828478+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:51:22.108766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.956085+0000","last_change":"2024-09-19T09:14:06.809784+0000","last_active":"2024-09-19T09:14:08.956085+0000","last_peered":"2024-09-19T09:14:08.956085+0000","last_clean":"2024-09-19T09:14:08.956085+0000","last_became_active":"2024-09-19T09:14:06.809557+0000","last_became_peered":"2024-09-19T09:14:06.809557+0000","last_unstale":"2024-09-19T09:14:08.956085+0000","last_undegraded":"2024-09-19T09:14:08.956085+0000","last_fullsized":"2024-09-19T09:14:08.956085+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:30.909289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.955977+0000","last_change":"2024-09-19T09:14:07.827783+0000","last_active":"2024-09-19T09:14:08.955977+0000","last_peered":"2024-09-19T09:14:08.955977+0000","last_clean":"2024-09-19T09:14:08.955977+0000","last_became_active":"2024-09-19T09:14:07.826980+0000","last_became_peered":"2024-09-19T09:14:07.826980+0000","last_unstale":"2024-09-19T09:14:08.955977+0000","last_undegraded":"2024-09-19T09:14:08.955977+0000","last_fullsized":"2024-09-19T09:14:08.955977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:12:06.424258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251651+0000","last_change":"2024-09-19T09:14:06.812812+0000","last_active":"2024-09-19T09:14:09.251651+0000","last_peered":"2024-09-19T09:14:09.251651+0000","last_clean":"2024-09-19T09:14:09.251651+0000","last_became_active":"2024-09-19T09:14:06.812250+0000","last_became_peered":"2024-09-19T09:14:06.812250+0000","last_unstale":"2024-09-19T09:14:09.251651+0000","last_undegraded":"2024-09-19T09:14:09.251651+0000","last_fullsized":"2024-09-19T09:14:09.251651+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:48.258565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251087+0000","last_change":"2024-09-19T09:14:07.823047+0000","last_active":"2024-09-19T09:14:09.251087+0000","last_peered":"2024-09-19T09:14:09.251087+0000","last_clean":"2024-09-19T09:14:09.251087+0000","last_became_active":"2024-09-19T09:14:07.822604+0000","last_became_peered":"2024-09-19T09:14:07.822604+0000","last_unstale":"2024-09-19T09:14:09.251087+0000","last_undegraded":"2024-09-19T09:14:09.251087+0000","last_fullsized":"2024-09-19T09:14:09.251087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:53.088230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251137+0000","last_change":"2024-09-19T09:14:06.808995+0000","last_active":"2024-09-19T09:14:09.251137+0000","last_peered":"2024-09-19T09:14:09.251137+0000","last_clean":"2024-09-19T09:14:09.251137+0000","last_became_active":"2024-09-19T09:14:06.808738+0000","last_became_peered":"2024-09-19T09:14:06.808738+0000","last_unstale":"2024-09-19T09:14:09.251137+0000","last_undegraded":"2024-09-19T09:14:09.251137+0000","last_fullsized":"2024-09-19T09:14:09.251137+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:19.289941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251989+0000","last_change":"2024-09-19T09:14:07.822615+0000","last_active":"2024-09-19T09:14:09.251989+0000","last_peered":"2024-09-19T09:14:09.251989+0000","last_clean":"2024-09-19T09:14:09.251989+0000","last_became_active":"2024-09-19T09:14:07.822371+0000","last_became_peered":"2024-09-19T09:14:07.822371+0000","last_unstale":"2024-09-19T09:14:09.251989+0000","last_undegraded":"2024-09-19T09:14:09.251989+0000","last_fullsized":"2024-09-19T09:14:09.251989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:42.353760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.250625+0000","last_change":"2024-09-19T09:14:06.807754+0000","last_active":"2024-09-19T09:14:09.250625+0000","last_peered":"2024-09-19T09:14:09.250625+0000","last_clean":"2024-09-19T09:14:09.250625+0000","last_became_active":"2024-09-19T09:14:06.807486+0000","last_became_peered":"2024-09-19T09:14:06.807486+0000","last_unstale":"2024-09-19T09:14:09.250625+0000","last_undegraded":"2024-09-19T09:14:09.250625+0000","last_fullsized":"2024-09-19T09:14:09.250625+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:25.787281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.829081+0000","last_change":"2024-09-19T09:14:07.831279+0000","last_active":"2024-09-19T09:14:08.829081+0000","last_peered":"2024-09-19T09:14:08.829081+0000","last_clean":"2024-09-19T09:14:08.829081+0000","last_became_active":"2024-09-19T09:14:07.828774+0000","last_became_peered":"2024-09-19T09:14:07.828774+0000","last_unstale":"2024-09-19T09:14:08.829081+0000","last_undegraded":"2024-09-19T09:14:08.829081+0000","last_fullsized":"2024-09-19T09:14:08.829081+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:09.824867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.832991+0000","last_change":"2024-09-19T09:14:06.808807+0000","last_active":"2024-09-19T09:14:08.832991+0000","last_peered":"2024-09-19T09:14:08.832991+0000","last_clean":"2024-09-19T09:14:08.832991+0000","last_became_active":"2024-09-19T09:14:06.808563+0000","last_became_peered":"2024-09-19T09:14:06.808563+0000","last_unstale":"2024-09-19T09:14:08.832991+0000","last_undegraded":"2024-09-19T09:14:08.832991+0000","last_fullsized":"2024-09-19T09:14:08.832991+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:32:33.693361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.828777+0000","last_change":"2024-09-19T09:14:07.831434+0000","last_active":"2024-09-19T09:14:08.828777+0000","last_peered":"2024-09-19T09:14:08.828777+0000","last_clean":"2024-09-19T09:14:08.828777+0000","last_became_active":"2024-09-19T09:14:07.828274+0000","last_became_peered":"2024-09-19T09:14:07.828274+0000","last_unstale":"2024-09-19T09:14:08.828777+0000","last_undegraded":"2024-09-19T09:14:08.828777+0000","last_fullsized":"2024-09-19T09:14:08.828777+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:58.617264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.832670+0000","last_change":"2024-09-19T09:14:06.809460+0000","last_active":"2024-09-19T09:14:08.832670+0000","last_peered":"2024-09-19T09:14:08.832670+0000","last_clean":"2024-09-19T09:14:08.832670+0000","last_became_active":"2024-09-19T09:14:06.809207+0000","last_became_peered":"2024-09-19T09:14:06.809207+0000","last_unstale":"2024-09-19T09:14:08.832670+0000","last_undegraded":"2024-09-19T09:14:08.832670+0000","last_fullsized":"2024-09-19T09:14:08.832670+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:07.656798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.252100+0000","last_change":"2024-09-19T09:14:07.816003+0000","last_active":"2024-09-19T09:14:09.252100+0000","last_peered":"2024-09-19T09:14:09.252100+0000","last_clean":"2024-09-19T09:14:09.252100+0000","last_became_active":"2024-09-19T09:14:07.815735+0000","last_became_peered":"2024-09-19T09:14:07.815735+0000","last_unstale":"2024-09-19T09:14:09.252100+0000","last_undegraded":"2024-09-19T09:14:09.252100+0000","last_fullsized":"2024-09-19T09:14:09.252100+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:46.347104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251754+0000","last_change":"2024-09-19T09:14:06.812576+0000","last_active":"2024-09-19T09:14:09.251754+0000","last_peered":"2024-09-19T09:14:09.251754+0000","last_clean":"2024-09-19T09:14:09.251754+0000","last_became_active":"2024-09-19T09:14:06.811919+0000","last_became_peered":"2024-09-19T09:14:06.811919+0000","last_unstale":"2024-09-19T09:14:09.251754+0000","last_undegraded":"2024-09-19T09:14:09.251754+0000","last_fullsized":"2024-09-19T09:14:09.251754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:19:16.388518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.831146+0000","last_change":"2024-09-19T09:14:07.813765+0000","last_active":"2024-09-19T09:14:08.831146+0000","last_peered":"2024-09-19T09:14:08.831146+0000","last_clean":"2024-09-19T09:14:08.831146+0000","last_became_active":"2024-09-19T09:14:07.813503+0000","last_became_peered":"2024-09-19T09:14:07.813503+0000","last_unstale":"2024-09-19T09:14:08.831146+0000","last_undegraded":"2024-09-19T09:14:08.831146+0000","last_fullsized":"2024-09-19T09:14:08.831146+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:04.443430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.828494+0000","last_change":"2024-09-19T09:14:06.811623+0000","last_active":"2024-09-19T09:14:08.828494+0000","last_peered":"2024-09-19T09:14:08.828494+0000","last_clean":"2024-09-19T09:14:08.828494+0000","last_became_active":"2024-09-19T09:14:06.811238+0000","last_became_peered":"2024-09-19T09:14:06.811238+0000","last_unstale":"2024-09-19T09:14:08.828494+0000","last_undegraded":"2024-09-19T09:14:08.828494+0000","last_fullsized":"2024-09-19T09:14:08.828494+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:03.026718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.832822+0000","last_change":"2024-09-19T09:14:07.820464+0000","last_active":"2024-09-19T09:14:08.832822+0000","last_peered":"2024-09-19T09:14:08.832822+0000","last_clean":"2024-09-19T09:14:08.832822+0000","last_became_active":"2024-09-19T09:14:07.820234+0000","last_became_peered":"2024-09-19T09:14:07.820234+0000","last_unstale":"2024-09-19T09:14:08.832822+0000","last_undegraded":"2024-09-19T09:14:08.832822+0000","last_fullsized":"2024-09-19T09:14:08.832822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:02.653012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251248+0000","last_change":"2024-09-19T09:14:06.810134+0000","last_active":"2024-09-19T09:14:09.251248+0000","last_peered":"2024-09-19T09:14:09.251248+0000","last_clean":"2024-09-19T09:14:09.251248+0000","last_became_active":"2024-09-19T09:14:06.809399+0000","last_became_peered":"2024-09-19T09:14:06.809399+0000","last_unstale":"2024-09-19T09:14:09.251248+0000","last_undegraded":"2024-09-19T09:14:09.251248+0000","last_fullsized":"2024-09-19T09:14:09.251248+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:59:59.875534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.955738+0000","last_change":"2024-09-19T09:14:07.826110+0000","last_active":"2024-09-19T09:14:08.955738+0000","last_peered":"2024-09-19T09:14:08.955738+0000","last_clean":"2024-09-19T09:14:08.955738+0000","last_became_active":"2024-09-19T09:14:07.825791+0000","last_became_peered":"2024-09-19T09:14:07.825791+0000","last_unstale":"2024-09-19T09:14:08.955738+0000","last_undegraded":"2024-09-19T09:14:08.955738+0000","last_fullsized":"2024-09-19T09:14:08.955738+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:55.770469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.831046+0000","last_change":"2024-09-19T09:14:06.798984+0000","last_active":"2024-09-19T09:14:08.831046+0000","last_peered":"2024-09-19T09:14:08.831046+0000","last_clean":"2024-09-19T09:14:08.831046+0000","last_became_active":"2024-09-19T09:14:06.798718+0000","last_became_peered":"2024-09-19T09:14:06.798718+0000","last_unstale":"2024-09-19T09:14:08.831046+0000","last_undegraded":"2024-09-19T09:14:08.831046+0000","last_fullsized":"2024-09-19T09:14:08.831046+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:20.310559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.830981+0000","last_change":"2024-09-19T09:14:07.822165+0000","last_active":"2024-09-19T09:14:08.830981+0000","last_peered":"2024-09-19T09:14:08.830981+0000","last_clean":"2024-09-19T09:14:08.830981+0000","last_became_active":"2024-09-19T09:14:07.821932+0000","last_became_peered":"2024-09-19T09:14:07.821932+0000","last_unstale":"2024-09-19T09:14:08.830981+0000","last_undegraded":"2024-09-19T09:14:08.830981+0000","last_fullsized":"2024-09-19T09:14:08.830981+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:13.194071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251429+0000","last_change":"2024-09-19T09:14:06.812609+0000","last_active":"2024-09-19T09:14:09.251429+0000","last_peered":"2024-09-19T09:14:09.251429+0000","last_clean":"2024-09-19T09:14:09.251429+0000","last_became_active":"2024-09-19T09:14:06.812013+0000","last_became_peered":"2024-09-19T09:14:06.812013+0000","last_unstale":"2024-09-19T09:14:09.251429+0000","last_undegraded":"2024-09-19T09:14:09.251429+0000","last_fullsized":"2024-09-19T09:14:09.251429+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:56.666296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.956104+0000","last_change":"2024-09-19T09:14:07.826525+0000","last_active":"2024-09-19T09:14:08.956104+0000","last_peered":"2024-09-19T09:14:08.956104+0000","last_clean":"2024-09-19T09:14:08.956104+0000","last_became_active":"2024-09-19T09:14:07.826066+0000","last_became_peered":"2024-09-19T09:14:07.826066+0000","last_unstale":"2024-09-19T09:14:08.956104+0000","last_undegraded":"2024-09-19T09:14:08.956104+0000","last_fullsized":"2024-09-19T09:14:08.956104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:01:18.326041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251401+0000","last_change":"2024-09-19T09:14:06.805561+0000","last_active":"2024-09-19T09:14:09.251401+0000","last_peered":"2024-09-19T09:14:09.251401+0000","last_clean":"2024-09-19T09:14:09.251401+0000","last_became_active":"2024-09-19T09:14:06.805316+0000","last_became_peered":"2024-09-19T09:14:06.805316+0000","last_unstale":"2024-09-19T09:14:09.251401+0000","last_undegraded":"2024-09-19T09:14:09.251401+0000","last_fullsized":"2024-09-19T09:14:09.251401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:07.720184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251347+0000","last_change":"2024-09-19T09:14:07.823337+0000","last_active":"2024-09-19T09:14:09.251347+0000","last_peered":"2024-09-19T09:14:09.251347+0000","last_clean":"2024-09-19T09:14:09.251347+0000","last_became_active":"2024-09-19T09:14:07.822777+0000","last_became_peered":"2024-09-19T09:14:07.822777+0000","last_unstale":"2024-09-19T09:14:09.251347+0000","last_undegraded":"2024-09-19T09:14:09.251347+0000","last_fullsized":"2024-09-19T09:14:09.251347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:20:48.319858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.828594+0000","last_change":"2024-09-19T09:14:06.811449+0000","last_active":"2024-09-19T09:14:08.828594+0000","last_peered":"2024-09-19T09:14:08.828594+0000","last_clean":"2024-09-19T09:14:08.828594+0000","last_became_active":"2024-09-19T09:14:06.810962+0000","last_became_peered":"2024-09-19T09:14:06.810962+0000","last_unstale":"2024-09-19T09:14:08.828594+0000","last_undegraded":"2024-09-19T09:14:08.828594+0000","last_fullsized":"2024-09-19T09:14:08.828594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:22.899039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.832846+0000","last_change":"2024-09-19T09:14:07.821586+0000","last_active":"2024-09-19T09:14:08.832846+0000","last_peered":"2024-09-19T09:14:08.832846+0000","last_clean":"2024-09-19T09:14:08.832846+0000","last_became_active":"2024-09-19T09:14:07.821363+0000","last_became_peered":"2024-09-19T09:14:07.821363+0000","last_unstale":"2024-09-19T09:14:08.832846+0000","last_undegraded":"2024-09-19T09:14:08.832846+0000","last_fullsized":"2024-09-19T09:14:08.832846+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:54.403467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.955800+0000","last_change":"2024-09-19T09:14:06.808499+0000","last_active":"2024-09-19T09:14:08.955800+0000","last_peered":"2024-09-19T09:14:08.955800+0000","last_clean":"2024-09-19T09:14:08.955800+0000","last_became_active":"2024-09-19T09:14:06.807889+0000","last_became_peered":"2024-09-19T09:14:06.807889+0000","last_unstale":"2024-09-19T09:14:08.955800+0000","last_undegraded":"2024-09-19T09:14:08.955800+0000","last_fullsized":"2024-09-19T09:14:08.955800+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:21:59.499261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.829206+0000","last_change":"2024-09-19T09:14:07.829957+0000","last_active":"2024-09-19T09:14:08.829206+0000","last_peered":"2024-09-19T09:14:08.829206+0000","last_clean":"2024-09-19T09:14:08.829206+0000","last_became_active":"2024-09-19T09:14:07.828445+0000","last_became_peered":"2024-09-19T09:14:07.828445+0000","last_unstale":"2024-09-19T09:14:08.829206+0000","last_undegraded":"2024-09-19T09:14:08.829206+0000","last_fullsized":"2024-09-19T09:14:08.829206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:52.342331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.831209+0000","last_change":"2024-09-19T09:14:06.806806+0000","last_active":"2024-09-19T09:14:08.831209+0000","last_peered":"2024-09-19T09:14:08.831209+0000","last_clean":"2024-09-19T09:14:08.831209+0000","last_became_active":"2024-09-19T09:14:06.806090+0000","last_became_peered":"2024-09-19T09:14:06.806090+0000","last_unstale":"2024-09-19T09:14:08.831209+0000","last_undegraded":"2024-09-19T09:14:08.831209+0000","last_fullsized":"2024-09-19T09:14:08.831209+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:43.876497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.832495+0000","last_change":"2024-09-19T09:14:07.823341+0000","last_active":"2024-09-19T09:14:08.832495+0000","last_peered":"2024-09-19T09:14:08.832495+0000","last_clean":"2024-09-19T09:14:08.832495+0000","last_became_active":"2024-09-19T09:14:07.822773+0000","last_became_peered":"2024-09-19T09:14:07.822773+0000","last_unstale":"2024-09-19T09:14:08.832495+0000","last_undegraded":"2024-09-19T09:14:08.832495+0000","last_fullsized":"2024-09-19T09:14:08.832495+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:23.336457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.956350+0000","last_change":"2024-09-19T09:14:06.804565+0000","last_active":"2024-09-19T09:14:08.956350+0000","last_peered":"2024-09-19T09:14:08.956350+0000","last_clean":"2024-09-19T09:14:08.956350+0000","last_became_active":"2024-09-19T09:14:06.804310+0000","last_became_peered":"2024-09-19T09:14:06.804310+0000","last_unstale":"2024-09-19T09:14:08.956350+0000","last_undegraded":"2024-09-19T09:14:08.956350+0000","last_fullsized":"2024-09-19T09:14:08.956350+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:42.594623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251145+0000","last_change":"2024-09-19T09:14:07.819402+0000","last_active":"2024-09-19T09:14:09.251145+0000","last_peered":"2024-09-19T09:14:09.251145+0000","last_clean":"2024-09-19T09:14:09.251145+0000","last_became_active":"2024-09-19T09:14:07.819037+0000","last_became_peered":"2024-09-19T09:14:07.819037+0000","last_unstale":"2024-09-19T09:14:09.251145+0000","last_undegraded":"2024-09-19T09:14:09.251145+0000","last_fullsized":"2024-09-19T09:14:09.251145+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:30:38.871492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.956257+0000","last_change":"2024-09-19T09:14:06.807555+0000","last_active":"2024-09-19T09:14:08.956257+0000","last_peered":"2024-09-19T09:14:08.956257+0000","last_clean":"2024-09-19T09:14:08.956257+0000","last_became_active":"2024-09-19T09:14:06.807295+0000","last_became_peered":"2024-09-19T09:14:06.807295+0000","last_unstale":"2024-09-19T09:14:08.956257+0000","last_undegraded":"2024-09-19T09:14:08.956257+0000","last_fullsized":"2024-09-19T09:14:08.956257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:51.491798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.250862+0000","last_change":"2024-09-19T09:14:07.823444+0000","last_active":"2024-09-19T09:14:09.250862+0000","last_peered":"2024-09-19T09:14:09.250862+0000","last_clean":"2024-09-19T09:14:09.250862+0000","last_became_active":"2024-09-19T09:14:07.822925+0000","last_became_peered":"2024-09-19T09:14:07.822925+0000","last_unstale":"2024-09-19T09:14:09.250862+0000","last_undegraded":"2024-09-19T09:14:09.250862+0000","last_fullsized":"2024-09-19T09:14:09.250862+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:53.206471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.956030+0000","last_change":"2024-09-19T09:14:06.808729+0000","last_active":"2024-09-19T09:14:08.956030+0000","last_peered":"2024-09-19T09:14:08.956030+0000","last_clean":"2024-09-19T09:14:08.956030+0000","last_became_active":"2024-09-19T09:14:06.808213+0000","last_became_peered":"2024-09-19T09:14:06.808213+0000","last_unstale":"2024-09-19T09:14:08.956030+0000","last_undegraded":"2024-09-19T09:14:08.956030+0000","last_fullsized":"2024-09-19T09:14:08.956030+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:54:03.268583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.250860+0000","last_change":"2024-09-19T09:14:07.833209+0000","last_active":"2024-09-19T09:14:09.250860+0000","last_peered":"2024-09-19T09:14:09.250860+0000","last_clean":"2024-09-19T09:14:09.250860+0000","last_became_active":"2024-09-19T09:14:07.832153+0000","last_became_peered":"2024-09-19T09:14:07.832153+0000","last_unstale":"2024-09-19T09:14:09.250860+0000","last_undegraded":"2024-09-19T09:14:09.250860+0000","last_fullsized":"2024-09-19T09:14:09.250860+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:51.239836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.252193+0000","last_change":"2024-09-19T09:14:06.811567+0000","last_active":"2024-09-19T09:14:09.252193+0000","last_peered":"2024-09-19T09:14:09.252193+0000","last_clean":"2024-09-19T09:14:09.252193+0000","last_became_active":"2024-09-19T09:14:06.811325+0000","last_became_peered":"2024-09-19T09:14:06.811325+0000","last_unstale":"2024-09-19T09:14:09.252193+0000","last_undegraded":"2024-09-19T09:14:09.252193+0000","last_fullsized":"2024-09-19T09:14:09.252193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:45.210697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.828695+0000","last_change":"2024-09-19T09:14:07.822191+0000","last_active":"2024-09-19T09:14:08.828695+0000","last_peered":"2024-09-19T09:14:08.828695+0000","last_clean":"2024-09-19T09:14:08.828695+0000","last_became_active":"2024-09-19T09:14:07.821968+0000","last_became_peered":"2024-09-19T09:14:07.821968+0000","last_unstale":"2024-09-19T09:14:08.828695+0000","last_undegraded":"2024-09-19T09:14:08.828695+0000","last_fullsized":"2024-09-19T09:14:08.828695+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:09.645679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.250415+0000","last_change":"2024-09-19T09:14:06.808268+0000","last_active":"2024-09-19T09:14:09.250415+0000","last_peered":"2024-09-19T09:14:09.250415+0000","last_clean":"2024-09-19T09:14:09.250415+0000","last_became_active":"2024-09-19T09:14:06.807603+0000","last_became_peered":"2024-09-19T09:14:06.807603+0000","last_unstale":"2024-09-19T09:14:09.250415+0000","last_undegraded":"2024-09-19T09:14:09.250415+0000","last_fullsized":"2024-09-19T09:14:09.250415+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:59.239510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.251388+0000","last_change":"2024-09-19T09:14:07.821257+0000","last_active":"2024-09-19T09:14:09.251388+0000","last_peered":"2024-09-19T09:14:09.251388+0000","last_clean":"2024-09-19T09:14:09.251388+0000","last_became_active":"2024-09-19T09:14:07.820510+0000","last_became_peered":"2024-09-19T09:14:07.820510+0000","last_unstale":"2024-09-19T09:14:09.251388+0000","last_undegraded":"2024-09-19T09:14:09.251388+0000","last_fullsized":"2024-09-19T09:14:09.251388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:06.786297+0000","last_clean_scrub_stamp":"2024-09-19T09:14:06.786297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:19.286617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:08.828451+0000","last_change":"2024-09-19T09:14:06.810137+0000","last_active":"2024-09-19T09:14:08.828451+0000","last_peered":"2024-09-19T09:14:08.828451+0000","last_clean":"2024-09-19T09:14:08.828451+0000","last_became_active":"2024-09-19T09:14:06.809791+0000","last_became_peered":"2024-09-19T09:14:06.809791+0000","last_unstale":"2024-09-19T09:14:08.828451+0000","last_undegraded":"2024-09-19T09:14:08.828451+0000","last_fullsized":"2024-09-19T09:14:08.828451+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:05.781502+0000","last_clean_scrub_stamp":"2024-09-19T09:14:05.781502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:30:02.826028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":190,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-19T09:14:09.252413+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:14:09.252413+0000","last_peered":"2024-09-19T09:14:09.252413+0000","last_clean":"2024-09-19T09:14:09.252413+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:14:09.252413+0000","last_undegraded":"2024-09-19T09:14:09.252413+0000","last_fullsized":"2024-09-19T09:14:09.252413+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:22.478151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195177,"statfs":{"total":200000000,"available":199861333,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":136,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195175,"statfs":{"total":200000000,"available":199859743,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":712,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194600,"statfs":{"total":200000000,"available":199270405,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":136,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195175,"statfs":{"total":200000000,"available":199859721,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":136,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199860579,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195177,"statfs":{"total":200000000,"available":199861321,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":711,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194600,"statfs":{"total":200000000,"available":199270917,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574861,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":135,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195177,"statfs":{"total":200000000,"available":199861265,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:14:15.539 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T09:14:15.539 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-19T09:14:15.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.685+0000 7fe7d5ac9640 1 Processor -- start 2024-09-19T09:14:15.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.685+0000 7fe7d5ac9640 1 -- start start 2024-09-19T09:14:15.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.685+0000 7fe7d5ac9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe7d00d17f0 0x7fe7d00b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:15.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.685+0000 7fe7d5ac9640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe7d00d1bd0 0x7fe7d00b5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:15.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.685+0000 7fe7d5ac9640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7d00d5c20 con 0x7fe7d0161fb0 2024-09-19T09:14:15.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.685+0000 7fe7d5ac9640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fe7d00b5020 con 0x7fe7d00d17f0 2024-09-19T09:14:15.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.685+0000 7fe7d5ac9640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe7d00d2150 con 0x7fe7d00d1bd0 2024-09-19T09:14:15.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.686+0000 7fe7cf7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe7d00d17f0 0x7fe7d00b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:15.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.686+0000 7fe7cf7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe7d00d17f0 0x7fe7d00b54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55774/0 (socket says 172.21.15.18:55774) 2024-09-19T09:14:15.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.686+0000 7fe7cf7fe640 1 -- 172.21.15.18:0/974909323 learned_addr learned my addr 172.21.15.18:0/974909323 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:15.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.686+0000 7fe7cffff640 1 --1- 172.21.15.18:0/974909323 >> v1:172.21.15.18:6789/0 conn(0x7fe7d0161fb0 0x7fe7d0162400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50718/0 (socket says 172.21.15.18:50718) 2024-09-19T09:14:15.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.686+0000 7fe7ceffd640 1 --2- 172.21.15.18:0/974909323 >> v2:172.21.15.162:3300/0 conn(0x7fe7d00d1bd0 0x7fe7d00b5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:15.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.686+0000 7fe7cf7fe640 1 -- 172.21.15.18:0/974909323 >> v2:172.21.15.162:3300/0 conn(0x7fe7d00d1bd0 msgr2=0x7fe7d00b5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:15.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.686+0000 7fe7cf7fe640 1 --2- 172.21.15.18:0/974909323 >> v2:172.21.15.162:3300/0 conn(0x7fe7d00d1bd0 0x7fe7d00b5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:15.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.686+0000 7fe7cf7fe640 1 -- 172.21.15.18:0/974909323 >> v1:172.21.15.18:6789/0 conn(0x7fe7d0161fb0 legacy=0x7fe7d0162400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:15.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.686+0000 7fe7ce7fc640 1 -- 172.21.15.18:0/974909323 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3567507160 0 0) 0x7fe7d00d5c20 con 0x7fe7d0161fb0 2024-09-19T09:14:15.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.686+0000 7fe7cf7fe640 1 -- 172.21.15.18:0/974909323 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d00d2430 con 0x7fe7d00d17f0 2024-09-19T09:14:15.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.686+0000 7fe7ceffd640 1 --2- 172.21.15.18:0/974909323 >> v2:172.21.15.162:3300/0 conn(0x7fe7d00d1bd0 0x7fe7d00b5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:14:15.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.687+0000 7fe7cf7fe640 1 --2- 172.21.15.18:0/974909323 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7d00d17f0 0x7fe7d00b54b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe7d00d47a0 tx=0x7fe7c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=813cd56f7cd2a16 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:15.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.687+0000 7fe7ce7fc640 1 -- 172.21.15.18:0/974909323 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0037070 con 0x7fe7d00d17f0 2024-09-19T09:14:15.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.687+0000 7fe7ce7fc640 1 -- 172.21.15.18:0/974909323 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7c0032440 con 0x7fe7d00d17f0 2024-09-19T09:14:15.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.687+0000 7fe7ce7fc640 1 -- 172.21.15.18:0/974909323 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0032810 con 0x7fe7d00d17f0 2024-09-19T09:14:15.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.687+0000 7fe7d5ac9640 1 -- 172.21.15.18:0/974909323 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7d00d17f0 msgr2=0x7fe7d00b54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:15.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.687+0000 7fe7d5ac9640 1 --2- 172.21.15.18:0/974909323 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7d00d17f0 0x7fe7d00b54b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe7d00d47a0 tx=0x7fe7c002a270 comp rx=0 tx=0).stop 2024-09-19T09:14:15.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.687+0000 7fe7d5ac9640 1 -- 172.21.15.18:0/974909323 shutdown_connections 2024-09-19T09:14:15.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.687+0000 7fe7d5ac9640 1 --2- 172.21.15.18:0/974909323 >> v2:172.21.15.162:3300/0 conn(0x7fe7d00d1bd0 0x7fe7d00b5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:15.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.687+0000 7fe7d5ac9640 1 --2- 172.21.15.18:0/974909323 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7d00d17f0 0x7fe7d00b54b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:15.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.687+0000 7fe7d5ac9640 1 -- 172.21.15.18:0/974909323 >> 172.21.15.18:0/974909323 conn(0x7fe7d00d4d20 msgr2=0x7fe7d00d5130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:15.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.687+0000 7fe7d5ac9640 1 -- 172.21.15.18:0/974909323 shutdown_connections 2024-09-19T09:14:15.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.688+0000 7fe7d5ac9640 1 -- 172.21.15.18:0/974909323 wait complete. 2024-09-19T09:14:15.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.689+0000 7fe7d5ac9640 1 Processor -- start 2024-09-19T09:14:15.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.689+0000 7fe7d5ac9640 1 -- start start 2024-09-19T09:14:15.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.690+0000 7fe7d5ac9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7d00d17f0 0x7fe7d00b9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:15.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.690+0000 7fe7d5ac9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7d00d1bd0 0x7fe7d014ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:15.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.690+0000 7fe7d5ac9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7d0161fb0 0x7fe7d00cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:15.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.690+0000 7fe7d5ac9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d00d0b70 con 0x7fe7d0161fb0 2024-09-19T09:14:15.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.690+0000 7fe7d5ac9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d00d09f0 con 0x7fe7d00d1bd0 2024-09-19T09:14:15.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.690+0000 7fe7d5ac9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe7d00d0cf0 con 0x7fe7d00d17f0 2024-09-19T09:14:15.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.690+0000 7fe7cffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7d0161fb0 0x7fe7d00cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:15.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.690+0000 7fe7cffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7d0161fb0 0x7fe7d00cab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55790/0 (socket says 172.21.15.18:55790) 2024-09-19T09:14:15.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.690+0000 7fe7cffff640 1 -- 172.21.15.18:0/4181522256 learned_addr learned my addr 172.21.15.18:0/4181522256 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:15.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.690+0000 7fe7ceffd640 1 --2- 172.21.15.18:0/4181522256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7d00d1bd0 0x7fe7d014ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:15.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.690+0000 7fe7cf7fe640 1 --2- 172.21.15.18:0/4181522256 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7d00d17f0 0x7fe7d00b9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:15.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.690+0000 7fe7cffff640 1 -- 172.21.15.18:0/4181522256 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7d00d17f0 msgr2=0x7fe7d00b9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:15.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.690+0000 7fe7cffff640 1 --2- 172.21.15.18:0/4181522256 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7d00d17f0 0x7fe7d00b9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:15.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.690+0000 7fe7cffff640 1 -- 172.21.15.18:0/4181522256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7d00d1bd0 msgr2=0x7fe7d014ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:15.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.690+0000 7fe7cffff640 1 --2- 172.21.15.18:0/4181522256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7d00d1bd0 0x7fe7d014ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:15.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.690+0000 7fe7cffff640 1 -- 172.21.15.18:0/4181522256 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d00b9dc0 con 0x7fe7d0161fb0 2024-09-19T09:14:15.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.690+0000 7fe7cf7fe640 1 --2- 172.21.15.18:0/4181522256 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7d00d17f0 0x7fe7d00b9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:14:15.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.690+0000 7fe7cffff640 1 --2- 172.21.15.18:0/4181522256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7d0161fb0 0x7fe7d00cab90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe7c800c7a0 tx=0x7fe7c800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:15.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.690+0000 7fe7b7fff640 1 -- 172.21.15.18:0/4181522256 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c8018070 con 0x7fe7d0161fb0 2024-09-19T09:14:15.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.690+0000 7fe7b7fff640 1 -- 172.21.15.18:0/4181522256 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7c800a640 con 0x7fe7d0161fb0 2024-09-19T09:14:15.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.690+0000 7fe7d5ac9640 1 -- 172.21.15.18:0/4181522256 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7d00ba0a0 con 0x7fe7d0161fb0 2024-09-19T09:14:15.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.690+0000 7fe7b7fff640 1 -- 172.21.15.18:0/4181522256 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7c800aab0 con 0x7fe7d0161fb0 2024-09-19T09:14:15.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.690+0000 7fe7d5ac9640 1 -- 172.21.15.18:0/4181522256 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7d00b9ab0 con 0x7fe7d0161fb0 2024-09-19T09:14:15.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.691+0000 7fe7d5ac9640 1 -- 172.21.15.18:0/4181522256 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7d0068f50 con 0x7fe7d0161fb0 2024-09-19T09:14:15.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.692+0000 7fe7b7fff640 1 -- 172.21.15.18:0/4181522256 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe7c801b070 con 0x7fe7d0161fb0 2024-09-19T09:14:15.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.692+0000 7fe7b7fff640 1 --2- 172.21.15.18:0/4181522256 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe7bc06c2b0 0x7fe7bc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:15.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.692+0000 7fe7b7fff640 1 -- 172.21.15.18:0/4181522256 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fe7c808ab10 con 0x7fe7d0161fb0 2024-09-19T09:14:15.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.693+0000 7fe7cf7fe640 1 --2- 172.21.15.18:0/4181522256 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe7bc06c2b0 0x7fe7bc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:15.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.693+0000 7fe7cf7fe640 1 --2- 172.21.15.18:0/4181522256 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe7bc06c2b0 0x7fe7bc06e770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0034000 tx=0x7fe7c002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:15.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.696+0000 7fe7b7fff640 1 -- 172.21.15.18:0/4181522256 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe7c80591e0 con 0x7fe7d0161fb0 2024-09-19T09:14:15.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.945+0000 7fe7d5ac9640 1 -- 172.21.15.18:0/4181522256 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fe7d006c1a0 con 0x7fe7d0161fb0 2024-09-19T09:14:15.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.947+0000 7fe7b7fff640 1 -- 172.21.15.18:0/4181522256 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7fe7c8058ae0 con 0x7fe7d0161fb0 2024-09-19T09:14:15.948 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-09-19T09:14:15.948 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAe6+tmcbwDNhAAaG0+wu96Locwws+h0zeh8Q== 2024-09-19T09:14:15.948 INFO:teuthology.orchestra.run.smithi018.stdout: caps mds = "allow" 2024-09-19T09:14:15.948 INFO:teuthology.orchestra.run.smithi018.stdout: caps mon = "allow r" 2024-09-19T09:14:15.948 INFO:teuthology.orchestra.run.smithi018.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-19T09:14:15.948 INFO:teuthology.orchestra.run.smithi018.stderr:updated caps for client.0 2024-09-19T09:14:15.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.949+0000 7fe7d5ac9640 1 -- 172.21.15.18:0/4181522256 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe7bc06c2b0 msgr2=0x7fe7bc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:15.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.949+0000 7fe7d5ac9640 1 --2- 172.21.15.18:0/4181522256 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe7bc06c2b0 0x7fe7bc06e770 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0034000 tx=0x7fe7c002e000 comp rx=0 tx=0).stop 2024-09-19T09:14:15.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.949+0000 7fe7d5ac9640 1 -- 172.21.15.18:0/4181522256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7d0161fb0 msgr2=0x7fe7d00cab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:15.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.949+0000 7fe7d5ac9640 1 --2- 172.21.15.18:0/4181522256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7d0161fb0 0x7fe7d00cab90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe7c800c7a0 tx=0x7fe7c800cc60 comp rx=0 tx=0).stop 2024-09-19T09:14:15.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.949+0000 7fe7d5ac9640 1 -- 172.21.15.18:0/4181522256 shutdown_connections 2024-09-19T09:14:15.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.949+0000 7fe7d5ac9640 1 --2- 172.21.15.18:0/4181522256 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe7bc06c2b0 0x7fe7bc06e770 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:15.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.949+0000 7fe7d5ac9640 1 --2- 172.21.15.18:0/4181522256 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe7d0161fb0 0x7fe7d00cab90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:15.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.949+0000 7fe7d5ac9640 1 --2- 172.21.15.18:0/4181522256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7d00d1bd0 0x7fe7d014ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:15.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.949+0000 7fe7d5ac9640 1 --2- 172.21.15.18:0/4181522256 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe7d00d17f0 0x7fe7d00b9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:15.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.949+0000 7fe7d5ac9640 1 -- 172.21.15.18:0/4181522256 >> 172.21.15.18:0/4181522256 conn(0x7fe7d00d4d20 msgr2=0x7fe7d006c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:15.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.950+0000 7fe7d5ac9640 1 -- 172.21.15.18:0/4181522256 shutdown_connections 2024-09-19T09:14:15.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:15.950+0000 7fe7d5ac9640 1 -- 172.21.15.18:0/4181522256 wait complete. 2024-09-19T09:14:15.961 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:14:16.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.062+0000 7f7505149640 1 Processor -- start 2024-09-19T09:14:16.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.062+0000 7f7505149640 1 -- start start 2024-09-19T09:14:16.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.063+0000 7f7505149640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f750015ed30 0x7f7500070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.063+0000 7f7505149640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f75000b5200 0x7f75001629e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.063+0000 7f7505149640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75000d0a10 con 0x7f7500162f20 2024-09-19T09:14:16.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.063+0000 7f7505149640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f7500070ab0 con 0x7f750015ed30 2024-09-19T09:14:16.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.063+0000 7f7505149640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f75000d0cb0 con 0x7f75000b5200 2024-09-19T09:14:16.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.063+0000 7f74fed9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f750015ed30 0x7f7500070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.063+0000 7f74fed9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f750015ed30 0x7f7500070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55806/0 (socket says 172.21.15.18:55806) 2024-09-19T09:14:16.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.063+0000 7f74fed9d640 1 -- 172.21.15.18:0/3646623134 learned_addr learned my addr 172.21.15.18:0/3646623134 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:16.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.063+0000 7f74fe59c640 1 --2- 172.21.15.18:0/3646623134 >> v2:172.21.15.162:3300/0 conn(0x7f75000b5200 0x7f75001629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.063+0000 7f74fed9d640 1 -- 172.21.15.18:0/3646623134 >> v2:172.21.15.162:3300/0 conn(0x7f75000b5200 msgr2=0x7f75001629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:16.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.063+0000 7f74fed9d640 1 --2- 172.21.15.18:0/3646623134 >> v2:172.21.15.162:3300/0 conn(0x7f75000b5200 0x7f75001629e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.063+0000 7f74fed9d640 1 -- 172.21.15.18:0/3646623134 >> v1:172.21.15.162:6789/0 conn(0x7f7500162f20 legacy=0x7f75000cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:16.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.064+0000 7f74fed9d640 1 -- 172.21.15.18:0/3646623134 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75000d0f90 con 0x7f750015ed30 2024-09-19T09:14:16.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.064+0000 7f74fed9d640 1 --2- 172.21.15.18:0/3646623134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f750015ed30 0x7f7500070260 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f75000b2540 tx=0x7f74f002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5dd69af5f192990 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:16.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.064+0000 7f74fdd9b640 1 -- 172.21.15.18:0/3646623134 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f0037070 con 0x7f750015ed30 2024-09-19T09:14:16.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.064+0000 7f74fdd9b640 1 -- 172.21.15.18:0/3646623134 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f0032440 con 0x7f750015ed30 2024-09-19T09:14:16.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.064+0000 7f74fdd9b640 1 -- 172.21.15.18:0/3646623134 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f0032810 con 0x7f750015ed30 2024-09-19T09:14:16.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.065+0000 7f7505149640 1 -- 172.21.15.18:0/3646623134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f750015ed30 msgr2=0x7f7500070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:16.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.065+0000 7f7505149640 1 --2- 172.21.15.18:0/3646623134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f750015ed30 0x7f7500070260 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f75000b2540 tx=0x7f74f002a2c0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.065+0000 7f7505149640 1 -- 172.21.15.18:0/3646623134 shutdown_connections 2024-09-19T09:14:16.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.065+0000 7f7505149640 1 --2- 172.21.15.18:0/3646623134 >> v2:172.21.15.162:3300/0 conn(0x7f75000b5200 0x7f75001629e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.065+0000 7f7505149640 1 --2- 172.21.15.18:0/3646623134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f750015ed30 0x7f7500070260 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.065+0000 7f7505149640 1 -- 172.21.15.18:0/3646623134 >> 172.21.15.18:0/3646623134 conn(0x7f75000b4600 msgr2=0x7f75000b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:16.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.065+0000 7f7505149640 1 -- 172.21.15.18:0/3646623134 shutdown_connections 2024-09-19T09:14:16.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.065+0000 7f7505149640 1 -- 172.21.15.18:0/3646623134 wait complete. 2024-09-19T09:14:16.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.066+0000 7f7505149640 1 Processor -- start 2024-09-19T09:14:16.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.066+0000 7f7505149640 1 -- start start 2024-09-19T09:14:16.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.067+0000 7f7505149640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75000b5200 0x7f75000b8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.067+0000 7f7505149640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f750015ed30 0x7f75000c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.067+0000 7f7505149640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7500162f20 0x7f7500161700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.067+0000 7f7505149640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7500070f10 con 0x7f750015ed30 2024-09-19T09:14:16.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.067+0000 7f7505149640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7500070d90 con 0x7f7500162f20 2024-09-19T09:14:16.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.067+0000 7f7505149640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f750015f110 con 0x7f75000b5200 2024-09-19T09:14:16.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.067+0000 7f74fe59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f750015ed30 0x7f75000c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.067+0000 7f74fe59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f750015ed30 0x7f75000c8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55820/0 (socket says 172.21.15.18:55820) 2024-09-19T09:14:16.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.067+0000 7f74fe59c640 1 -- 172.21.15.18:0/3866962147 learned_addr learned my addr 172.21.15.18:0/3866962147 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:16.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.068+0000 7f74fed9d640 1 --2- 172.21.15.18:0/3866962147 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75000b5200 0x7f75000b8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.068+0000 7f74ff59e640 1 --2- 172.21.15.18:0/3866962147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7500162f20 0x7f7500161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.068+0000 7f74fe59c640 1 -- 172.21.15.18:0/3866962147 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75000b5200 msgr2=0x7f75000b8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:16.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.068+0000 7f74fe59c640 1 --2- 172.21.15.18:0/3866962147 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75000b5200 0x7f75000b8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.068+0000 7f74fe59c640 1 -- 172.21.15.18:0/3866962147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7500162f20 msgr2=0x7f7500161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:16.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.068+0000 7f74fe59c640 1 --2- 172.21.15.18:0/3866962147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7500162f20 0x7f7500161700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.068+0000 7f74fe59c640 1 -- 172.21.15.18:0/3866962147 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7500160660 con 0x7f750015ed30 2024-09-19T09:14:16.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.068+0000 7f74fe59c640 1 --2- 172.21.15.18:0/3866962147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f750015ed30 0x7f75000c8ef0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f74f400c820 tx=0x7f74f400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:16.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.068+0000 7f74e77fe640 1 -- 172.21.15.18:0/3866962147 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f4015070 con 0x7f750015ed30 2024-09-19T09:14:16.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.068+0000 7f74e77fe640 1 -- 172.21.15.18:0/3866962147 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74f4004240 con 0x7f750015ed30 2024-09-19T09:14:16.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.068+0000 7f7505149640 1 -- 172.21.15.18:0/3866962147 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7500160940 con 0x7f750015ed30 2024-09-19T09:14:16.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.068+0000 7f74e77fe640 1 -- 172.21.15.18:0/3866962147 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74f400ce10 con 0x7f750015ed30 2024-09-19T09:14:16.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.068+0000 7f7505149640 1 -- 172.21.15.18:0/3866962147 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7500160f00 con 0x7f750015ed30 2024-09-19T09:14:16.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.069+0000 7f7505149640 1 -- 172.21.15.18:0/3866962147 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75001629e0 con 0x7f750015ed30 2024-09-19T09:14:16.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.070+0000 7f74e77fe640 1 -- 172.21.15.18:0/3866962147 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f74f4007830 con 0x7f750015ed30 2024-09-19T09:14:16.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.070+0000 7f74e77fe640 1 --2- 172.21.15.18:0/3866962147 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f74ec06c2b0 0x7f74ec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.070+0000 7f74e77fe640 1 -- 172.21.15.18:0/3866962147 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5825+0+0 (secure 0 0 0) 0x7f74f408b340 con 0x7f750015ed30 2024-09-19T09:14:16.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.070+0000 7f74fed9d640 1 --2- 172.21.15.18:0/3866962147 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f74ec06c2b0 0x7f74ec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.071+0000 7f74fed9d640 1 --2- 172.21.15.18:0/3866962147 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f74ec06c2b0 0x7f74ec06e770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f74f0034000 tx=0x7f74f002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:16.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.074+0000 7f74e77fe640 1 -- 172.21.15.18:0/3866962147 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f74f4059a30 con 0x7f750015ed30 2024-09-19T09:14:16.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.286+0000 7f7505149640 1 -- 172.21.15.18:0/3866962147 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75000686d0 con 0x7f750015ed30 2024-09-19T09:14:16.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.287+0000 7f74e77fe640 1 -- 172.21.15.18:0/3866962147 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5229 (secure 0 0 0) 0x7f74f4059330 con 0x7f750015ed30 2024-09-19T09:14:16.288 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:16.288 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":13,"btime":"2024-09-19T09:14:09:822716+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1369179501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1369179501},{"type":"v1","addr":"172.21.15.18:6835","nonce":1369179501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4762,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2677647932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2677647932},{"type":"v1","addr":"172.21.15.162:6836","nonce":2677647932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4765,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3427373581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3427373581},{"type":"v1","addr":"172.21.15.162:6837","nonce":3427373581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:14:07.154707+0000","modified":"2024-09-19T09:14:09.169555+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4785},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4785":{"gid":4785,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6834/2895835717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2895835717},{"type":"v1","addr":"172.21.15.18:6834","nonce":2895835717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4785,"qdb_cluster":[4785]},"id":2}]} 2024-09-19T09:14:16.288 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 13 2024-09-19T09:14:16.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.289+0000 7f7505149640 1 -- 172.21.15.18:0/3866962147 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f74ec06c2b0 msgr2=0x7f74ec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:16.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.289+0000 7f7505149640 1 --2- 172.21.15.18:0/3866962147 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f74ec06c2b0 0x7f74ec06e770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f74f0034000 tx=0x7f74f002e000 comp rx=0 tx=0).stop 2024-09-19T09:14:16.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.289+0000 7f7505149640 1 -- 172.21.15.18:0/3866962147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f750015ed30 msgr2=0x7f75000c8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:16.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.289+0000 7f7505149640 1 --2- 172.21.15.18:0/3866962147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f750015ed30 0x7f75000c8ef0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f74f400c820 tx=0x7f74f400cce0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.289+0000 7f7505149640 1 -- 172.21.15.18:0/3866962147 shutdown_connections 2024-09-19T09:14:16.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.289+0000 7f7505149640 1 --2- 172.21.15.18:0/3866962147 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f74ec06c2b0 0x7f74ec06e770 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.289+0000 7f7505149640 1 --2- 172.21.15.18:0/3866962147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7500162f20 0x7f7500161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.289+0000 7f7505149640 1 --2- 172.21.15.18:0/3866962147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f750015ed30 0x7f75000c8ef0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.289+0000 7f7505149640 1 --2- 172.21.15.18:0/3866962147 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f75000b5200 0x7f75000b8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.289+0000 7f7505149640 1 -- 172.21.15.18:0/3866962147 >> 172.21.15.18:0/3866962147 conn(0x7f75000b4600 msgr2=0x7f75000b3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:16.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.289+0000 7f7505149640 1 -- 172.21.15.18:0/3866962147 shutdown_connections 2024-09-19T09:14:16.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.289+0000 7f7505149640 1 -- 172.21.15.18:0/3866962147 wait complete. 2024-09-19T09:14:16.703 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T09:14:07.154707+0000', 'modified': '2024-09-19T09:14:09.169555+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4785}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4785': {'gid': 4785, 'name': 'a', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.18:6834/2895835717', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6832', 'nonce': 2895835717}, {'type': 'v1', 'addr': '172.21.15.18:6834', 'nonce': 2895835717}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4785, 'qdb_cluster': [4785]} 2024-09-19T09:14:16.704 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T09:14:16.704 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-19T09:14:16.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.810+0000 7f83aaef1640 1 Processor -- start 2024-09-19T09:14:16.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.810+0000 7f83aaef1640 1 -- start start 2024-09-19T09:14:16.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.811+0000 7f83aaef1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f83a40d3400 0x7f83a41618f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.811+0000 7f83aaef1640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83a40d0aa0 con 0x7f83a40ba7e0 2024-09-19T09:14:16.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.811+0000 7f83aaef1640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83a40b7b60 con 0x7f83a40d5870 2024-09-19T09:14:16.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.811+0000 7f83aaef1640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f83a40babc0 con 0x7f83a40d3400 2024-09-19T09:14:16.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.811+0000 7f83a948e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f83a40d3400 0x7f83a41618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.811+0000 7f83a8c8d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f83a40ba7e0 0x7f83a40d0220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50722/0 (socket says 172.21.15.18:50722) 2024-09-19T09:14:16.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.811+0000 7f83a8c8d640 1 -- 172.21.15.18:0/4038588726 learned_addr learned my addr 172.21.15.18:0/4038588726 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:16.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.811+0000 7f83a948e640 1 -- 172.21.15.18:0/4038588726 >> v1:172.21.15.162:6789/0 conn(0x7f83a40d5870 legacy=0x7f83a40d2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:16.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.811+0000 7f83a948e640 1 -- 172.21.15.18:0/4038588726 >> v1:172.21.15.18:6789/0 conn(0x7f83a40ba7e0 legacy=0x7f83a40d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:16.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.811+0000 7f83a948e640 1 -- 172.21.15.18:0/4038588726 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a40b7e40 con 0x7f83a40d3400 2024-09-19T09:14:16.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.812+0000 7f83a948e640 1 --2- 172.21.15.18:0/4038588726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83a40d3400 0x7f83a41618f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f839c009d90 tx=0x7f839c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecad306289d628e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:16.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.812+0000 7f83a37fe640 1 -- 172.21.15.18:0/4038588726 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c007740 con 0x7f83a40d3400 2024-09-19T09:14:16.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.812+0000 7f83a37fe640 1 -- 172.21.15.18:0/4038588726 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f839c0078e0 con 0x7f83a40d3400 2024-09-19T09:14:16.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.812+0000 7f83a37fe640 1 -- 172.21.15.18:0/4038588726 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c007cb0 con 0x7f83a40d3400 2024-09-19T09:14:16.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.813+0000 7f83aaef1640 1 -- 172.21.15.18:0/4038588726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83a40d3400 msgr2=0x7f83a41618f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:16.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.813+0000 7f83aaef1640 1 --2- 172.21.15.18:0/4038588726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83a40d3400 0x7f83a41618f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f839c009d90 tx=0x7f839c02a6a0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.813+0000 7f83aaef1640 1 -- 172.21.15.18:0/4038588726 shutdown_connections 2024-09-19T09:14:16.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.813+0000 7f83aaef1640 1 --2- 172.21.15.18:0/4038588726 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83a40d3400 0x7f83a41618f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.813+0000 7f83aaef1640 1 -- 172.21.15.18:0/4038588726 >> 172.21.15.18:0/4038588726 conn(0x7f83a40d4c70 msgr2=0x7f83a40d5080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:16.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.813+0000 7f83aaef1640 1 -- 172.21.15.18:0/4038588726 shutdown_connections 2024-09-19T09:14:16.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.813+0000 7f83aaef1640 1 -- 172.21.15.18:0/4038588726 wait complete. 2024-09-19T09:14:16.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.814+0000 7f83aaef1640 1 Processor -- start 2024-09-19T09:14:16.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.814+0000 7f83aaef1640 1 -- start start 2024-09-19T09:14:16.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.815+0000 7f83aaef1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83a40ba7e0 0x7f83a41d3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.815+0000 7f83aaef1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83a40d3400 0x7f83a40d1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.815+0000 7f83aaef1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83a40d5870 0x7f83a40d1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.815+0000 7f83aaef1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f83a40b9930 con 0x7f83a40d5870 2024-09-19T09:14:16.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.815+0000 7f83aaef1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f83a40b8400 con 0x7f83a40ba7e0 2024-09-19T09:14:16.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.815+0000 7f83aaef1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f83a40b9ab0 con 0x7f83a40d3400 2024-09-19T09:14:16.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.815+0000 7f83a948e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83a40d5870 0x7f83a40d1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.815+0000 7f83a948e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83a40d5870 0x7f83a40d1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55838/0 (socket says 172.21.15.18:55838) 2024-09-19T09:14:16.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.815+0000 7f83a948e640 1 -- 172.21.15.18:0/452690039 learned_addr learned my addr 172.21.15.18:0/452690039 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:16.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.816+0000 7f83a8c8d640 1 --2- 172.21.15.18:0/452690039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83a40ba7e0 0x7f83a41d3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.816+0000 7f83a3fff640 1 --2- 172.21.15.18:0/452690039 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83a40d3400 0x7f83a40d1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.816+0000 7f83a948e640 1 -- 172.21.15.18:0/452690039 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83a40d3400 msgr2=0x7f83a40d1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:16.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.816+0000 7f83a948e640 1 --2- 172.21.15.18:0/452690039 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83a40d3400 0x7f83a40d1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.816+0000 7f83a948e640 1 -- 172.21.15.18:0/452690039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83a40ba7e0 msgr2=0x7f83a41d3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:16.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.816+0000 7f83a948e640 1 --2- 172.21.15.18:0/452690039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83a40ba7e0 0x7f83a41d3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.816+0000 7f83a948e640 1 -- 172.21.15.18:0/452690039 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a40c8800 con 0x7f83a40d5870 2024-09-19T09:14:16.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.816+0000 7f83a948e640 1 --2- 172.21.15.18:0/452690039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83a40d5870 0x7f83a40d1870 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f839c009eb0 tx=0x7f839c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:16.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.816+0000 7f83a17fa640 1 -- 172.21.15.18:0/452690039 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c040070 con 0x7f83a40d5870 2024-09-19T09:14:16.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.816+0000 7f83a17fa640 1 -- 172.21.15.18:0/452690039 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f839c031c90 con 0x7f83a40d5870 2024-09-19T09:14:16.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.816+0000 7f83a17fa640 1 -- 172.21.15.18:0/452690039 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c03c640 con 0x7f83a40d5870 2024-09-19T09:14:16.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.816+0000 7f83aaef1640 1 -- 172.21.15.18:0/452690039 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83a40c9830 con 0x7f83a40d5870 2024-09-19T09:14:16.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.816+0000 7f83aaef1640 1 -- 172.21.15.18:0/452690039 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83a40c8d50 con 0x7f83a40d5870 2024-09-19T09:14:16.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.818+0000 7f83a17fa640 1 -- 172.21.15.18:0/452690039 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f839c039040 con 0x7f83a40d5870 2024-09-19T09:14:16.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.818+0000 7f83a17fa640 1 --2- 172.21.15.18:0/452690039 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f838806c300 0x7f838806e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.818+0000 7f83a17fa640 1 -- 172.21.15.18:0/452690039 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5825+0+0 (secure 0 0 0) 0x7f839c0aca00 con 0x7f83a40d5870 2024-09-19T09:14:16.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.818+0000 7f83a8c8d640 1 --2- 172.21.15.18:0/452690039 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f838806c300 0x7f838806e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.819+0000 7f83a8c8d640 1 --2- 172.21.15.18:0/452690039 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f838806c300 0x7f838806e7c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f83a40c9c50 tx=0x7f8398009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:16.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.819+0000 7f83adc92740 1 Processor -- start 2024-09-19T09:14:16.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.819+0000 7f83adc92740 1 -- start start 2024-09-19T09:14:16.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.820+0000 7f83adc92740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c66ad72c0 0x557c66b1ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.820+0000 7f83adc92740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c66ad4a80 0x557c66ad76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.820+0000 7f83adc92740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557c66ad8a50 0x557c66ad18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.820+0000 7f83adc92740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557c66a39520 con 0x557c66ad4a80 2024-09-19T09:14:16.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.820+0000 7f83adc92740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557c669e13e0 con 0x557c66ad72c0 2024-09-19T09:14:16.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.820+0000 7f83adc92740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x557c66a354e0 con 0x557c66ad8a50 2024-09-19T09:14:16.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.820+0000 7f83a3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c66ad4a80 0x557c66ad76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.820+0000 7f83a3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c66ad4a80 0x557c66ad76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55850/0 (socket says 172.21.15.18:55850) 2024-09-19T09:14:16.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.820+0000 7f83a3fff640 1 -- 172.21.15.18:0/1341287771 learned_addr learned my addr 172.21.15.18:0/1341287771 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:16.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.820+0000 7f83a8c8d640 1 --2- 172.21.15.18:0/1341287771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c66ad72c0 0x557c66b1ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.820+0000 7f83a948e640 1 --2- 172.21.15.18:0/1341287771 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557c66ad8a50 0x557c66ad18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.820+0000 7f83a3fff640 1 -- 172.21.15.18:0/1341287771 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557c66ad8a50 msgr2=0x557c66ad18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:16.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.820+0000 7f83a3fff640 1 --2- 172.21.15.18:0/1341287771 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557c66ad8a50 0x557c66ad18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.820+0000 7f83a3fff640 1 -- 172.21.15.18:0/1341287771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c66ad72c0 msgr2=0x557c66b1ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:16.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.820+0000 7f83a3fff640 1 --2- 172.21.15.18:0/1341287771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c66ad72c0 0x557c66b1ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.820+0000 7f83a3fff640 1 -- 172.21.15.18:0/1341287771 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c669fc2f0 con 0x557c66ad4a80 2024-09-19T09:14:16.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.820+0000 7f83a3fff640 1 --2- 172.21.15.18:0/1341287771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c66ad4a80 0x557c66ad76a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8390001700 tx=0x7f8390001bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db2d251df50e85fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:16.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.821+0000 7f838e7fc640 1 -- 172.21.15.18:0/1341287771 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8390018070 con 0x557c66ad4a80 2024-09-19T09:14:16.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.821+0000 7f838e7fc640 1 -- 172.21.15.18:0/1341287771 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f839000d730 con 0x557c66ad4a80 2024-09-19T09:14:16.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.821+0000 7f838e7fc640 1 -- 172.21.15.18:0/1341287771 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839000db00 con 0x557c66ad4a80 2024-09-19T09:14:16.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.821+0000 7f83adc92740 1 -- 172.21.15.18:0/1341287771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c66ad4a80 msgr2=0x557c66ad76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:16.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.821+0000 7f83adc92740 1 --2- 172.21.15.18:0/1341287771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c66ad4a80 0x557c66ad76a0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8390001700 tx=0x7f8390001bc0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.821+0000 7f83adc92740 1 -- 172.21.15.18:0/1341287771 shutdown_connections 2024-09-19T09:14:16.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.821+0000 7f83adc92740 1 --2- 172.21.15.18:0/1341287771 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557c66ad8a50 0x557c66ad18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.821+0000 7f83adc92740 1 --2- 172.21.15.18:0/1341287771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c66ad4a80 0x557c66ad76a0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.821+0000 7f83adc92740 1 --2- 172.21.15.18:0/1341287771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c66ad72c0 0x557c66b1ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.821+0000 7f83adc92740 1 -- 172.21.15.18:0/1341287771 >> 172.21.15.18:0/1341287771 conn(0x557c66ad3a80 msgr2=0x557c66b1bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:16.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.821+0000 7f83adc92740 1 -- 172.21.15.18:0/1341287771 shutdown_connections 2024-09-19T09:14:16.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.821+0000 7f83adc92740 1 -- 172.21.15.18:0/1341287771 wait complete. 2024-09-19T09:14:16.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.822+0000 7f83adc92740 1 -- start start 2024-09-19T09:14:16.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.822+0000 7f83adc92740 1 Processor -- start 2024-09-19T09:14:16.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.823+0000 7f83adc92740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c66ad72c0 0x557c66af59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.823+0000 7f83adc92740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c66ad8a50 0x557c66ad07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.823+0000 7f83adc92740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557c66b01930 0x557c66b00ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.823+0000 7f83adc92740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557c66ad2f20 con 0x557c66ad72c0 2024-09-19T09:14:16.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.823+0000 7f83adc92740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557c669c2450 con 0x557c66ad8a50 2024-09-19T09:14:16.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.823+0000 7f83adc92740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x557c66b1d290 con 0x557c66b01930 2024-09-19T09:14:16.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.823+0000 7f83adc92740 10 client.0 _ll_register_callbacks cb 0x557c6674bac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:14:16.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.823+0000 7f83a8c8d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c66ad72c0 0x557c66af59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.823+0000 7f83a8c8d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c66ad72c0 0x557c66af59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55856/0 (socket says 172.21.15.18:55856) 2024-09-19T09:14:16.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.823+0000 7f83a8c8d640 1 -- 172.21.15.18:0/1780437925 learned_addr learned my addr 172.21.15.18:0/1780437925 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:16.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.823+0000 7f83a3fff640 1 --2- 172.21.15.18:0/1780437925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c66ad8a50 0x557c66ad07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.823+0000 7f83a948e640 1 --2- 172.21.15.18:0/1780437925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557c66b01930 0x557c66b00ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.823+0000 7f83a8c8d640 1 -- 172.21.15.18:0/1780437925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557c66b01930 msgr2=0x557c66b00ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:16.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.823+0000 7f83a8c8d640 1 --2- 172.21.15.18:0/1780437925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557c66b01930 0x557c66b00ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.823+0000 7f83a8c8d640 1 -- 172.21.15.18:0/1780437925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c66ad8a50 msgr2=0x557c66ad07d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:16.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.823+0000 7f83a8c8d640 1 --2- 172.21.15.18:0/1780437925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c66ad8a50 0x557c66ad07d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.823+0000 7f83a8c8d640 1 -- 172.21.15.18:0/1780437925 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c6674c2d0 con 0x557c66ad72c0 2024-09-19T09:14:16.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.823+0000 7f83a3fff640 1 --2- 172.21.15.18:0/1780437925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c66ad8a50 0x557c66ad07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:16.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.823+0000 7f83a8c8d640 1 --2- 172.21.15.18:0/1780437925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c66ad72c0 0x557c66af59d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f83980076e0 tx=0x7f8398000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5ca0e6031ffa18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:16.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.823+0000 7f83837fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:14:16.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.823+0000 7f83837fe640 1 -- 172.21.15.18:0/1780437925 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8398026060 con 0x557c66ad72c0 2024-09-19T09:14:16.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.824+0000 7f83837fe640 1 -- 172.21.15.18:0/1780437925 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(33..33 src has 1..33) ==== 5825+0+0 (secure 0 0 0) 0x7f8398007710 con 0x557c66ad72c0 2024-09-19T09:14:16.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.824+0000 7f83adc92740 1 -- 172.21.15.18:0/1780437925 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f839000d730 con 0x557c66ad72c0 2024-09-19T09:14:16.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.824+0000 7f83837fe640 1 -- 172.21.15.18:0/1780437925 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f839802c050 con 0x557c66ad72c0 2024-09-19T09:14:16.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.824+0000 7f83adc92740 10 client.4971 fetch_fsmap learned FSMap version 13 2024-09-19T09:14:16.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.824+0000 7f83adc92740 1 -- 172.21.15.18:0/1780437925 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x557c668166b0 con 0x557c66ad72c0 2024-09-19T09:14:16.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.824+0000 7f83837fe640 1 -- 172.21.15.18:0/1780437925 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f839000d730 con 0x557c66ad72c0 2024-09-19T09:14:16.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.824+0000 7f83837fe640 1 -- 172.21.15.18:0/1780437925 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 13) ==== 3502+0+0 (secure 0 0 0) 0x7f839802f020 con 0x557c66ad72c0 2024-09-19T09:14:16.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.824+0000 7f83adc92740 10 client.4971 fetch_fsmap finished waiting for FSMap version 13 2024-09-19T09:14:16.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.824+0000 7f83adc92740 10 client.4971 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T09:14:16.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.824+0000 7f83adc92740 20 client.4971 populate_metadata read hostname 'smithi018' 2024-09-19T09:14:16.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.824+0000 7f83adc92740 1 --2- 172.21.15.18:0/1780437925 >> [v2:172.21.15.18:6832/2895835717,v1:172.21.15.18:6834/2895835717] conn(0x557c66af66b0 0x557c66af6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.824+0000 7f83adc92740 4 client.4971 mds_command: new command op to 4785 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:14:16.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.824+0000 7f83adc92740 1 -- 172.21.15.18:0/1780437925 --> [v2:172.21.15.18:6832/2895835717,v1:172.21.15.18:6834/2895835717] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c66a46c50 con 0x557c66af66b0 2024-09-19T09:14:16.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.824+0000 7f83a3fff640 1 --2- 172.21.15.18:0/1780437925 >> [v2:172.21.15.18:6832/2895835717,v1:172.21.15.18:6834/2895835717] conn(0x557c66af66b0 0x557c66af6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.824+0000 7f83837fe640 10 client.4971 ms_handle_connect on v2:172.21.15.18:6832/2895835717 2024-09-19T09:14:16.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.824+0000 7f83a3fff640 1 --2- 172.21.15.18:0/1780437925 >> [v2:172.21.15.18:6832/2895835717,v1:172.21.15.18:6834/2895835717] conn(0x557c66af66b0 0x557c66af6a90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efd95d028f70f262 server_cookie=cff8ca7fed8d6ed1 in_seq=0 out_seq=0 2024-09-19T09:14:16.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.825+0000 7f83837fe640 1 -- 172.21.15.18:0/1780437925 <== mds.0 v2:172.21.15.18:6832/2895835717 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557c66a46c50 con 0x557c66af66b0 2024-09-19T09:14:16.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.825+0000 7f83837fe640 10 client.4971 handle_command_reply: tid=0 2024-09-19T09:14:16.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.825+0000 7f83adc92740 1 client.4971 shutdown 2024-09-19T09:14:16.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.825+0000 7f83adc92740 1 -- 172.21.15.18:0/1780437925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c66ad72c0 msgr2=0x557c66af59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:16.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.825+0000 7f83adc92740 1 --2- 172.21.15.18:0/1780437925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c66ad72c0 0x557c66af59d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f83980076e0 tx=0x7f8398000ed0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.825+0000 7f83adc92740 1 -- 172.21.15.18:0/1780437925 shutdown_connections 2024-09-19T09:14:16.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.825+0000 7f83adc92740 1 --2- 172.21.15.18:0/1780437925 >> [v2:172.21.15.18:6832/2895835717,v1:172.21.15.18:6834/2895835717] conn(0x557c66af66b0 0x557c66af6a90 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.825+0000 7f83adc92740 1 --2- 172.21.15.18:0/1780437925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557c66b01930 0x557c66b00ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.825+0000 7f83adc92740 1 --2- 172.21.15.18:0/1780437925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c66ad8a50 0x557c66ad07d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.825+0000 7f83837fe640 0 client.4971 ms_handle_reset on v2:172.21.15.18:6832/2895835717 2024-09-19T09:14:16.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.825+0000 7f83adc92740 1 --2- 172.21.15.18:0/1780437925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c66ad72c0 0x557c66af59d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.825+0000 7f83adc92740 1 -- 172.21.15.18:0/1780437925 >> 172.21.15.18:0/1780437925 conn(0x557c66ad4a80 msgr2=0x557c66b19fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:16.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.825+0000 7f83adc92740 1 -- 172.21.15.18:0/1780437925 shutdown_connections 2024-09-19T09:14:16.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.825+0000 7f83adc92740 1 -- 172.21.15.18:0/1780437925 wait complete. 2024-09-19T09:14:16.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.826+0000 7f83adc92740 20 client.4971 trim_cache size 0 max 16384 2024-09-19T09:14:16.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.843+0000 7f83adc92740 1 Processor -- start 2024-09-19T09:14:16.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.843+0000 7f83adc92740 1 -- start start 2024-09-19T09:14:16.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.844+0000 7f83adc92740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557c66ad72c0 0x557c66b1dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.844+0000 7f83adc92740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c66ad8a50 0x557c66b94a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.844+0000 7f83adc92740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c66b01930 0x557c66b94fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.844+0000 7f83adc92740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f83a42004c0 con 0x557c66b01930 2024-09-19T09:14:16.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.844+0000 7f83adc92740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f83a41f5470 con 0x557c66ad8a50 2024-09-19T09:14:16.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.844+0000 7f83adc92740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f83a41f5ac0 con 0x557c66ad72c0 2024-09-19T09:14:16.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.844+0000 7f83a948e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c66b01930 0x557c66b94fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.844+0000 7f83a948e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c66b01930 0x557c66b94fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55864/0 (socket says 172.21.15.18:55864) 2024-09-19T09:14:16.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.844+0000 7f83a948e640 1 -- 172.21.15.18:0/3556711518 learned_addr learned my addr 172.21.15.18:0/3556711518 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:16.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.844+0000 7f83a8c8d640 1 --2- 172.21.15.18:0/3556711518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557c66ad72c0 0x557c66b1dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.845+0000 7f83a948e640 1 -- 172.21.15.18:0/3556711518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557c66ad72c0 msgr2=0x557c66b1dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:16.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.845+0000 7f83a948e640 1 --2- 172.21.15.18:0/3556711518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557c66ad72c0 0x557c66b1dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.845+0000 7f83a948e640 1 -- 172.21.15.18:0/3556711518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c66ad8a50 msgr2=0x557c66b94a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:16.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.845+0000 7f83a948e640 1 --2- 172.21.15.18:0/3556711518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c66ad8a50 0x557c66b94a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.845+0000 7f83a948e640 1 -- 172.21.15.18:0/3556711518 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c66ad0b40 con 0x557c66b01930 2024-09-19T09:14:16.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.845+0000 7f83a948e640 1 --2- 172.21.15.18:0/3556711518 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c66b01930 0x557c66b94fa0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f839c009d90 tx=0x7f839c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a2876d26480bee4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:16.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.845+0000 7f838dffb640 1 -- 172.21.15.18:0/3556711518 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c07ac20 con 0x557c66b01930 2024-09-19T09:14:16.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.845+0000 7f838dffb640 1 -- 172.21.15.18:0/3556711518 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f839c0a8070 con 0x557c66b01930 2024-09-19T09:14:16.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.845+0000 7f838dffb640 1 -- 172.21.15.18:0/3556711518 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c07efd0 con 0x557c66b01930 2024-09-19T09:14:16.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.846+0000 7f83adc92740 1 -- 172.21.15.18:0/3556711518 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c66b01930 msgr2=0x557c66b94fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:16.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.846+0000 7f83adc92740 1 --2- 172.21.15.18:0/3556711518 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c66b01930 0x557c66b94fa0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f839c009d90 tx=0x7f839c009750 comp rx=0 tx=0).stop 2024-09-19T09:14:16.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.846+0000 7f83adc92740 1 -- 172.21.15.18:0/3556711518 shutdown_connections 2024-09-19T09:14:16.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.846+0000 7f83adc92740 1 --2- 172.21.15.18:0/3556711518 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c66b01930 0x557c66b94fa0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.846+0000 7f83adc92740 1 --2- 172.21.15.18:0/3556711518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c66ad8a50 0x557c66b94a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.846+0000 7f83adc92740 1 --2- 172.21.15.18:0/3556711518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557c66ad72c0 0x557c66b1dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.846+0000 7f83adc92740 1 -- 172.21.15.18:0/3556711518 >> 172.21.15.18:0/3556711518 conn(0x557c66ad4a80 msgr2=0x557c66acd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:16.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.846+0000 7f83adc92740 1 -- 172.21.15.18:0/3556711518 shutdown_connections 2024-09-19T09:14:16.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.846+0000 7f83adc92740 1 -- 172.21.15.18:0/3556711518 wait complete. 2024-09-19T09:14:16.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.847+0000 7f83adc92740 1 -- start start 2024-09-19T09:14:16.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.847+0000 7f83adc92740 1 Processor -- start 2024-09-19T09:14:16.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.848+0000 7f83adc92740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557c66ad72c0 0x557c66acd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.848+0000 7f83adc92740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c66ad8a50 0x557c66b3e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.848+0000 7f83adc92740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c66b01930 0x557c66b3ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.848+0000 7f83adc92740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x557c66ad0d10 con 0x557c66b01930 2024-09-19T09:14:16.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.848+0000 7f83adc92740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x557c66ad10c0 con 0x557c66ad8a50 2024-09-19T09:14:16.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.848+0000 7f83adc92740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x557c66b01410 con 0x557c66ad72c0 2024-09-19T09:14:16.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.849+0000 7f83adc92740 10 client.0 _ll_register_callbacks cb 0x7f8398005970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:14:16.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.849+0000 7f83a948e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c66b01930 0x557c66b3ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.849+0000 7f83a948e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c66b01930 0x557c66b3ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55878/0 (socket says 172.21.15.18:55878) 2024-09-19T09:14:16.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.849+0000 7f83a948e640 1 -- 172.21.15.18:0/4202888567 learned_addr learned my addr 172.21.15.18:0/4202888567 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:16.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.849+0000 7f83a3fff640 1 --2- 172.21.15.18:0/4202888567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c66ad8a50 0x557c66b3e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.849+0000 7f83a8c8d640 1 --2- 172.21.15.18:0/4202888567 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557c66ad72c0 0x557c66acd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.849+0000 7f83a948e640 1 -- 172.21.15.18:0/4202888567 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557c66ad72c0 msgr2=0x557c66acd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:16.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.849+0000 7f83a948e640 1 --2- 172.21.15.18:0/4202888567 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557c66ad72c0 0x557c66acd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.849+0000 7f83a948e640 1 -- 172.21.15.18:0/4202888567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c66ad8a50 msgr2=0x557c66b3e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:16.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.849+0000 7f83a948e640 1 --2- 172.21.15.18:0/4202888567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c66ad8a50 0x557c66b3e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.849+0000 7f83a948e640 1 -- 172.21.15.18:0/4202888567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c66af7780 con 0x557c66b01930 2024-09-19T09:14:16.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.849+0000 7f83a948e640 1 --2- 172.21.15.18:0/4202888567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c66b01930 0x557c66b3ee70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f839c07a920 tx=0x7f839c007840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58fd0c2bb6616a99 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:16.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.849+0000 7f83837fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:14:16.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.851+0000 7f83837fe640 1 -- 172.21.15.18:0/4202888567 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c07efd0 con 0x557c66b01930 2024-09-19T09:14:16.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.851+0000 7f83837fe640 1 -- 172.21.15.18:0/4202888567 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5825+0+0 (secure 0 0 0) 0x7f839c07b090 con 0x557c66b01930 2024-09-19T09:14:16.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.851+0000 7f83adc92740 1 -- 172.21.15.18:0/4202888567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f839c0a8070 con 0x557c66b01930 2024-09-19T09:14:16.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.851+0000 7f83837fe640 1 -- 172.21.15.18:0/4202888567 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f839c088050 con 0x557c66b01930 2024-09-19T09:14:16.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.851+0000 7f83adc92740 10 client.4977 fetch_fsmap learned FSMap version 13 2024-09-19T09:14:16.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.851+0000 7f83adc92740 1 -- 172.21.15.18:0/4202888567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x557c66b9aae0 con 0x557c66b01930 2024-09-19T09:14:16.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.851+0000 7f83837fe640 1 -- 172.21.15.18:0/4202888567 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f839c0a8070 con 0x557c66b01930 2024-09-19T09:14:16.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.851+0000 7f83837fe640 1 -- 172.21.15.18:0/4202888567 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 13) ==== 3502+0+0 (secure 0 0 0) 0x7f839c083370 con 0x557c66b01930 2024-09-19T09:14:16.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.851+0000 7f83adc92740 10 client.4977 fetch_fsmap finished waiting for FSMap version 13 2024-09-19T09:14:16.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.851+0000 7f83adc92740 10 client.4977 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T09:14:16.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.851+0000 7f83adc92740 20 client.4977 populate_metadata read hostname 'smithi018' 2024-09-19T09:14:16.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.851+0000 7f83adc92740 1 --2- 172.21.15.18:0/4202888567 >> [v2:172.21.15.18:6832/2895835717,v1:172.21.15.18:6834/2895835717] conn(0x557c66b1fbe0 0x557c66b995a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.851+0000 7f83adc92740 4 client.4977 mds_command: new command op to 4785 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:14:16.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.851+0000 7f83adc92740 1 -- 172.21.15.18:0/4202888567 --> [v2:172.21.15.18:6832/2895835717,v1:172.21.15.18:6834/2895835717] -- command(tid 0: {"prefix": "status"}) -- 0x557c66a40fa0 con 0x557c66b1fbe0 2024-09-19T09:14:16.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.851+0000 7f83a8c8d640 1 --2- 172.21.15.18:0/4202888567 >> [v2:172.21.15.18:6832/2895835717,v1:172.21.15.18:6834/2895835717] conn(0x557c66b1fbe0 0x557c66b995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.852+0000 7f83837fe640 10 client.4977 ms_handle_connect on v2:172.21.15.18:6832/2895835717 2024-09-19T09:14:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.852+0000 7f83a8c8d640 1 --2- 172.21.15.18:0/4202888567 >> [v2:172.21.15.18:6832/2895835717,v1:172.21.15.18:6834/2895835717] conn(0x557c66b1fbe0 0x557c66b995a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ce43c3784cc2a9b server_cookie=b42d0d2522c281b3 in_seq=0 out_seq=0 2024-09-19T09:14:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.852+0000 7f83837fe640 1 -- 172.21.15.18:0/4202888567 <== mds.0 v2:172.21.15.18:6832/2895835717 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x557c66a40fa0 con 0x557c66b1fbe0 2024-09-19T09:14:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.852+0000 7f83837fe640 10 client.4977 handle_command_reply: tid=0 2024-09-19T09:14:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.852+0000 7f83adc92740 1 client.4977 shutdown 2024-09-19T09:14:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.852+0000 7f83adc92740 1 -- 172.21.15.18:0/4202888567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c66b01930 msgr2=0x557c66b3ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.852+0000 7f83adc92740 1 --2- 172.21.15.18:0/4202888567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c66b01930 0x557c66b3ee70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f839c07a920 tx=0x7f839c007840 comp rx=0 tx=0).stop 2024-09-19T09:14:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.852+0000 7f83adc92740 1 -- 172.21.15.18:0/4202888567 shutdown_connections 2024-09-19T09:14:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.852+0000 7f83adc92740 1 --2- 172.21.15.18:0/4202888567 >> [v2:172.21.15.18:6832/2895835717,v1:172.21.15.18:6834/2895835717] conn(0x557c66b1fbe0 0x557c66b995a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.852+0000 7f83837fe640 0 client.4977 ms_handle_reset on v2:172.21.15.18:6832/2895835717 2024-09-19T09:14:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.852+0000 7f83adc92740 1 --2- 172.21.15.18:0/4202888567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x557c66b01930 0x557c66b3ee70 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.852+0000 7f83adc92740 1 --2- 172.21.15.18:0/4202888567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x557c66ad8a50 0x557c66b3e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.852+0000 7f83adc92740 1 --2- 172.21.15.18:0/4202888567 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x557c66ad72c0 0x557c66acd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.852+0000 7f83adc92740 1 -- 172.21.15.18:0/4202888567 >> 172.21.15.18:0/4202888567 conn(0x557c66ad4a80 msgr2=0x557c66b2e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:16.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.852+0000 7f83adc92740 1 -- 172.21.15.18:0/4202888567 shutdown_connections 2024-09-19T09:14:16.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.852+0000 7f83adc92740 1 -- 172.21.15.18:0/4202888567 wait complete. 2024-09-19T09:14:16.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.852+0000 7f83adc92740 20 client.4977 trim_cache size 0 max 16384 2024-09-19T09:14:16.856 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:14:16.856 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:14:16.856 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-09-19T09:14:16.856 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 4785, 2024-09-19T09:14:16.856 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-19T09:14:16.856 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-19T09:14:16.856 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-19T09:14:16.856 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 9.0348705690000006, 2024-09-19T09:14:16.857 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 13, 2024-09-19T09:14:16.857 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 34, 2024-09-19T09:14:16.857 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 32, 2024-09-19T09:14:16.857 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 15.928814883999999 2024-09-19T09:14:16.857 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:14:16.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.853+0000 7f83aaef1640 1 -- 172.21.15.18:0/452690039 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f838806c300 msgr2=0x7f838806e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:16.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.853+0000 7f83aaef1640 1 --2- 172.21.15.18:0/452690039 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f838806c300 0x7f838806e7c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f83a40c9c50 tx=0x7f8398009040 comp rx=0 tx=0).stop 2024-09-19T09:14:16.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.853+0000 7f83aaef1640 1 -- 172.21.15.18:0/452690039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83a40d5870 msgr2=0x7f83a40d1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:16.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.853+0000 7f83aaef1640 1 --2- 172.21.15.18:0/452690039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83a40d5870 0x7f83a40d1870 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f839c009eb0 tx=0x7f839c004a40 comp rx=0 tx=0).stop 2024-09-19T09:14:16.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.853+0000 7f83aaef1640 1 -- 172.21.15.18:0/452690039 shutdown_connections 2024-09-19T09:14:16.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.853+0000 7f83aaef1640 1 --2- 172.21.15.18:0/452690039 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f838806c300 0x7f838806e7c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.853+0000 7f83aaef1640 1 --2- 172.21.15.18:0/452690039 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f83a40d5870 0x7f83a40d1870 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.853+0000 7f83aaef1640 1 --2- 172.21.15.18:0/452690039 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f83a40d3400 0x7f83a40d1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.853+0000 7f83aaef1640 1 --2- 172.21.15.18:0/452690039 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f83a40ba7e0 0x7f83a41d3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.853+0000 7f83aaef1640 1 -- 172.21.15.18:0/452690039 >> 172.21.15.18:0/452690039 conn(0x7f83a40d4c70 msgr2=0x7f83a40cf700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:16.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.853+0000 7f83aaef1640 1 -- 172.21.15.18:0/452690039 shutdown_connections 2024-09-19T09:14:16.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.853+0000 7f83aaef1640 1 -- 172.21.15.18:0/452690039 wait complete. 2024-09-19T09:14:16.864 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T09:14:16.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.965+0000 7f4170a7b640 1 Processor -- start 2024-09-19T09:14:16.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.966+0000 7f4170a7b640 1 -- start start 2024-09-19T09:14:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.966+0000 7f4170a7b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f416c0b5200 0x7f416c1629e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.967+0000 7f4170a7b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f416c0d0a10 con 0x7f416c162f20 2024-09-19T09:14:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.967+0000 7f4170a7b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f416c070ab0 con 0x7f416c15ed30 2024-09-19T09:14:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.967+0000 7f4170a7b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f416c0d0cb0 con 0x7f416c0b5200 2024-09-19T09:14:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.967+0000 7f416ad9d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f416c162f20 0x7f416c0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50726/0 (socket says 172.21.15.18:50726) 2024-09-19T09:14:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.967+0000 7f416ad9d640 1 -- 172.21.15.18:0/524968056 learned_addr learned my addr 172.21.15.18:0/524968056 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.967+0000 7f416959a640 1 -- 172.21.15.18:0/524968056 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3363543708 0 0) 0x7f416c0d0a10 con 0x7f416c162f20 2024-09-19T09:14:16.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.967+0000 7f416959a640 1 -- 172.21.15.18:0/524968056 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4154003520 con 0x7f416c162f20 2024-09-19T09:14:16.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.967+0000 7f4169d9b640 1 --2- 172.21.15.18:0/524968056 >> v2:172.21.15.162:3300/0 conn(0x7f416c0b5200 0x7f416c1629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.967+0000 7f416959a640 1 -- 172.21.15.18:0/524968056 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1825568010 0 0) 0x7f4154003520 con 0x7f416c162f20 2024-09-19T09:14:16.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.967+0000 7f416959a640 1 -- 172.21.15.18:0/524968056 >> v2:172.21.15.162:3300/0 conn(0x7f416c0b5200 msgr2=0x7f416c1629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:16.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.967+0000 7f416959a640 1 --2- 172.21.15.18:0/524968056 >> v2:172.21.15.162:3300/0 conn(0x7f416c0b5200 0x7f416c1629e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.967+0000 7f416959a640 1 -- 172.21.15.18:0/524968056 >> v1:172.21.15.162:6789/0 conn(0x7f416c15ed30 legacy=0x7f416c070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:16.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.967+0000 7f416959a640 1 -- 172.21.15.18:0/524968056 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416c0d0f90 con 0x7f416c162f20 2024-09-19T09:14:16.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.967+0000 7f416959a640 1 -- 172.21.15.18:0/524968056 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f41640019f0 con 0x7f416c162f20 2024-09-19T09:14:16.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.967+0000 7f416959a640 1 -- 172.21.15.18:0/524968056 >> v1:172.21.15.18:6789/0 conn(0x7f416c162f20 legacy=0x7f416c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:16.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.967+0000 7f416959a640 1 --2- 172.21.15.18:0/524968056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41540039b0 0x7f4154003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.967+0000 7f416959a640 1 --2- 172.21.15.18:0/524968056 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4154004800 0x7f4154004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.967+0000 7f416959a640 1 --2- 172.21.15.18:0/524968056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41540051c0 0x7f415400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.967+0000 7f416959a640 1 -- 172.21.15.18:0/524968056 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f416c0d0cb0 con 0x7f41540039b0 2024-09-19T09:14:16.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.967+0000 7f416959a640 1 -- 172.21.15.18:0/524968056 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f415400c070 con 0x7f41540051c0 2024-09-19T09:14:16.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.967+0000 7f416959a640 1 -- 172.21.15.18:0/524968056 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f415400c270 con 0x7f4154004800 2024-09-19T09:14:16.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.967+0000 7f416a59c640 1 --2- 172.21.15.18:0/524968056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41540039b0 0x7f4154003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.968+0000 7f4169d9b640 1 --2- 172.21.15.18:0/524968056 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4154004800 0x7f4154004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.968+0000 7f416ad9d640 1 --2- 172.21.15.18:0/524968056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41540051c0 0x7f415400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.968+0000 7f416a59c640 1 -- 172.21.15.18:0/524968056 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4154004800 msgr2=0x7f4154004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:16.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.968+0000 7f416a59c640 1 --2- 172.21.15.18:0/524968056 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4154004800 0x7f4154004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.968+0000 7f416a59c640 1 -- 172.21.15.18:0/524968056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41540051c0 msgr2=0x7f415400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:16.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.968+0000 7f416a59c640 1 --2- 172.21.15.18:0/524968056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41540051c0 0x7f415400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.968+0000 7f416ad9d640 1 -- 172.21.15.18:0/524968056 reap_dead start 2024-09-19T09:14:16.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.968+0000 7f416a59c640 1 -- 172.21.15.18:0/524968056 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4154003520 con 0x7f41540039b0 2024-09-19T09:14:16.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.969+0000 7f416a59c640 1 --2- 172.21.15.18:0/524968056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41540039b0 0x7f4154003dd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f415c001750 tx=0x7f4154005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93903af375de07cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:16.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.969+0000 7f416959a640 1 -- 172.21.15.18:0/524968056 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415c001370 con 0x7f41540039b0 2024-09-19T09:14:16.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.969+0000 7f416959a640 1 -- 172.21.15.18:0/524968056 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f415c0052d0 con 0x7f41540039b0 2024-09-19T09:14:16.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.969+0000 7f416959a640 1 -- 172.21.15.18:0/524968056 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f415c02abc0 con 0x7f41540039b0 2024-09-19T09:14:16.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.969+0000 7f4170a7b640 1 -- 172.21.15.18:0/524968056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41540039b0 msgr2=0x7f4154003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:16.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.969+0000 7f4170a7b640 1 --2- 172.21.15.18:0/524968056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41540039b0 0x7f4154003dd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f415c001750 tx=0x7f4154005830 comp rx=0 tx=0).stop 2024-09-19T09:14:16.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.969+0000 7f4170a7b640 1 -- 172.21.15.18:0/524968056 shutdown_connections 2024-09-19T09:14:16.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.969+0000 7f4170a7b640 1 --2- 172.21.15.18:0/524968056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41540039b0 0x7f4154003dd0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.969+0000 7f4170a7b640 1 -- 172.21.15.18:0/524968056 >> 172.21.15.18:0/524968056 conn(0x7f416c0b4600 msgr2=0x7f416c0b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:16.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.969+0000 7f4170a7b640 1 -- 172.21.15.18:0/524968056 shutdown_connections 2024-09-19T09:14:16.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.969+0000 7f4170a7b640 1 -- 172.21.15.18:0/524968056 wait complete. 2024-09-19T09:14:16.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.971+0000 7f4170a7b640 1 Processor -- start 2024-09-19T09:14:16.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.971+0000 7f4170a7b640 1 -- start start 2024-09-19T09:14:16.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.971+0000 7f4170a7b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41540039b0 0x7f416c1f8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.971+0000 7f4170a7b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f416c159690 0x7f416c0d2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.971+0000 7f4170a7b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f416c0d2fb0 0x7f416c15f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.971+0000 7f4170a7b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f416c15f290 con 0x7f416c159690 2024-09-19T09:14:16.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.971+0000 7f4170a7b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f416c15f110 con 0x7f416c0d2fb0 2024-09-19T09:14:16.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.971+0000 7f4170a7b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f416c1629e0 con 0x7f41540039b0 2024-09-19T09:14:16.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.972+0000 7f4169d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f416c159690 0x7f416c0d2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.972+0000 7f4169d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f416c159690 0x7f416c0d2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55898/0 (socket says 172.21.15.18:55898) 2024-09-19T09:14:16.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.972+0000 7f4169d9b640 1 -- 172.21.15.18:0/3403266811 learned_addr learned my addr 172.21.15.18:0/3403266811 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:16.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.972+0000 7f416ad9d640 1 --2- 172.21.15.18:0/3403266811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f416c0d2fb0 0x7f416c15f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.972+0000 7f416a59c640 1 --2- 172.21.15.18:0/3403266811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41540039b0 0x7f416c1f8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.972+0000 7f4169d9b640 1 -- 172.21.15.18:0/3403266811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41540039b0 msgr2=0x7f416c1f8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:16.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.972+0000 7f4169d9b640 1 --2- 172.21.15.18:0/3403266811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41540039b0 0x7f416c1f8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.972+0000 7f4169d9b640 1 -- 172.21.15.18:0/3403266811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f416c0d2fb0 msgr2=0x7f416c15f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:16.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.972+0000 7f4169d9b640 1 --2- 172.21.15.18:0/3403266811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f416c0d2fb0 0x7f416c15f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:16.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.972+0000 7f4169d9b640 1 -- 172.21.15.18:0/3403266811 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f416c1f4d80 con 0x7f416c159690 2024-09-19T09:14:16.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.972+0000 7f416a59c640 1 --2- 172.21.15.18:0/3403266811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41540039b0 0x7f416c1f8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:14:16.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.972+0000 7f4169d9b640 1 --2- 172.21.15.18:0/3403266811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f416c159690 0x7f416c0d2a70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4160011960 tx=0x7f4160011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:16.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.972+0000 7f415affd640 1 -- 172.21.15.18:0/3403266811 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416000faf0 con 0x7f416c159690 2024-09-19T09:14:16.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.972+0000 7f415affd640 1 -- 172.21.15.18:0/3403266811 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f416000fc90 con 0x7f416c159690 2024-09-19T09:14:16.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.972+0000 7f4170a7b640 1 -- 172.21.15.18:0/3403266811 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f416c15c670 con 0x7f416c159690 2024-09-19T09:14:16.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.972+0000 7f415affd640 1 -- 172.21.15.18:0/3403266811 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4160014440 con 0x7f416c159690 2024-09-19T09:14:16.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.972+0000 7f4170a7b640 1 -- 172.21.15.18:0/3403266811 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f416c161600 con 0x7f416c159690 2024-09-19T09:14:16.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.973+0000 7f4170a7b640 1 -- 172.21.15.18:0/3403266811 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f416c161940 con 0x7f416c159690 2024-09-19T09:14:16.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.974+0000 7f415affd640 1 -- 172.21.15.18:0/3403266811 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4160012040 con 0x7f416c159690 2024-09-19T09:14:16.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.974+0000 7f415affd640 1 --2- 172.21.15.18:0/3403266811 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f414c06c2e0 0x7f414c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:16.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.974+0000 7f415affd640 1 -- 172.21.15.18:0/3403266811 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5825+0+0 (secure 0 0 0) 0x7f416008ba80 con 0x7f416c159690 2024-09-19T09:14:16.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.974+0000 7f416a59c640 1 --2- 172.21.15.18:0/3403266811 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f414c06c2e0 0x7f414c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:16.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.975+0000 7f416a59c640 1 --2- 172.21.15.18:0/3403266811 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f414c06c2e0 0x7f414c06e7a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f415c032000 tx=0x7f415c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:16.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:16.978+0000 7f415affd640 1 -- 172.21.15.18:0/3403266811 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f416c161940 con 0x7f416c159690 2024-09-19T09:14:17.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:17.192+0000 7f4170a7b640 1 -- 172.21.15.18:0/3403266811 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f416c0686d0 con 0x7f416c159690 2024-09-19T09:14:17.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:17.193+0000 7f415affd640 1 -- 172.21.15.18:0/3403266811 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) ==== 53+0+73 (secure 0 0 0) 0x7f4160019030 con 0x7f416c159690 2024-09-19T09:14:17.193 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T09:14:17.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:17.195+0000 7f4170a7b640 1 -- 172.21.15.18:0/3403266811 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f414c06c2e0 msgr2=0x7f414c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:17.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:17.195+0000 7f4170a7b640 1 --2- 172.21.15.18:0/3403266811 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f414c06c2e0 0x7f414c06e7a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f415c032000 tx=0x7f415c02e000 comp rx=0 tx=0).stop 2024-09-19T09:14:17.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:17.195+0000 7f4170a7b640 1 -- 172.21.15.18:0/3403266811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f416c159690 msgr2=0x7f416c0d2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:17.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:17.195+0000 7f4170a7b640 1 --2- 172.21.15.18:0/3403266811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f416c159690 0x7f416c0d2a70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4160011960 tx=0x7f4160011e20 comp rx=0 tx=0).stop 2024-09-19T09:14:17.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:17.195+0000 7f4170a7b640 1 -- 172.21.15.18:0/3403266811 shutdown_connections 2024-09-19T09:14:17.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:17.195+0000 7f4170a7b640 1 --2- 172.21.15.18:0/3403266811 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f414c06c2e0 0x7f414c06e7a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:17.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:17.195+0000 7f4170a7b640 1 --2- 172.21.15.18:0/3403266811 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f416c0d2fb0 0x7f416c15f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:17.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:17.195+0000 7f4170a7b640 1 --2- 172.21.15.18:0/3403266811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f416c159690 0x7f416c0d2a70 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:17.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:17.195+0000 7f4170a7b640 1 --2- 172.21.15.18:0/3403266811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41540039b0 0x7f416c1f8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:17.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:17.195+0000 7f4170a7b640 1 -- 172.21.15.18:0/3403266811 >> 172.21.15.18:0/3403266811 conn(0x7f416c0b4600 msgr2=0x7f416c0b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:17.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:17.195+0000 7f4170a7b640 1 -- 172.21.15.18:0/3403266811 shutdown_connections 2024-09-19T09:14:17.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:17.195+0000 7f4170a7b640 1 -- 172.21.15.18:0/3403266811 wait complete. 2024-09-19T09:14:17.207 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-19T09:14:17.207 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:14:17.207 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-09-19T09:14:17.207 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T09:14:17.207 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:14:17.207 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-19T09:14:17.207 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-19T09:14:17.207 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:14:17.207 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:14:17.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:17.208 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-09-19T09:14:17.224 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:14:17.224 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:14:17.224 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:14:17.225 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:14:17.225 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-09-19T09:14:17.225 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:14:17.225 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:14:17.225 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:14:17.225 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-09-19T09:14:17.225 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:14:17.225 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:14:17.225 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-09-19T09:14:17.225 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:14:17.225 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:14:17.225 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-09-19T09:14:17.225 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T09:14:17.226 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42740sec preferred_lft 42740sec 2024-09-19T09:14:17.226 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-09-19T09:14:17.226 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:14:17.226 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:14:17.226 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:14:17.226 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-09-19T09:14:17.226 INFO:teuthology.orchestra.run.smithi018.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T09:14:17.226 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:44:1b:02:86:87 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:14:17.226 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T09:14:17.226 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:14:17.226 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::a0ce:faff:feaa:13ec/64 scope link 2024-09-19T09:14:17.226 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:14:17.226 INFO:teuthology.orchestra.run.smithi018.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:14:17.227 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:44:1b:02:86:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:14:17.227 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::44:1bff:fe02:8687/64 scope link 2024-09-19T09:14:17.227 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:14:17.227 INFO:teuthology.orchestra.run.smithi018.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:14:17.227 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether e2:6d:c4:af:6a:8b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T09:14:17.227 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::e06d:c4ff:feaf:6a8b/64 scope link 2024-09-19T09:14:17.227 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:14:17.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:17.227 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:14:17.288 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-09-19T09:14:17.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:17.290 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-09-19T09:14:17.347 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-09-19T09:14:17.347 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:14:17.347 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T09:14:17.347 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T09:14:17.347 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:14:17.348 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:14:17.348 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T09:14:17.348 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T09:14:17.348 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T09:14:17.348 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T09:14:17.348 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T09:14:17.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:14:17.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:14:17.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:17.476 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-19T09:14:17.492 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-19T09:14:17.492 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T09:14:17.492 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:14:17.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:17.493 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-09-19T09:14:17.558 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:14:17.559 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T09:14:17.614 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:14:17.614 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:14:17.614 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:14:17.671 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-19T09:14:17.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:17.671 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:14:17.756 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:14:17.757 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:14:17.757 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:14:17.766 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:14:17.766 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:14:17.766 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:14:17.766 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:14:17.766 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:14:17.772 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:14:17.772 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:14:17.772 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:14:17.772 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:14:17.772 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:14:17.772 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-19T09:14:17.773 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-19T09:14:17.773 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fec66d7e-50e5-42ed-81de-ad141a2f0f4e" will pass to kernel 2024-09-19T09:14:17.773 INFO:teuthology.orchestra.run.smithi018.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-19T09:14:17.773 INFO:teuthology.orchestra.run.smithi018.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:14:17.773 INFO:teuthology.orchestra.run.smithi018.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:14:17.773 INFO:teuthology.orchestra.run.smithi018.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:14:17.773 INFO:teuthology.orchestra.run.smithi018.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:14:17.775 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:14:17.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:17.775 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:14:17.801 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:14:17.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:14:17.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:14:17.902 INFO:teuthology.orchestra.run.smithi018.stdout:client4679 2024-09-19T09:14:17.903 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:14:17.903 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:14:17.919 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T09:14:18.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.061+0000 7f41ec43c640 1 Processor -- start 2024-09-19T09:14:18.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.061+0000 7f41ec43c640 1 -- start start 2024-09-19T09:14:18.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.062+0000 7f41ec43c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f41e4145290 0x7f41e406f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:18.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.062+0000 7f41ec43c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f41e4072f40 0x7f41e40b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:18.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.062+0000 7f41ec43c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41e406e3d0 con 0x7f41e40ce780 2024-09-19T09:14:18.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.062+0000 7f41ec43c640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f41e406efe0 con 0x7f41e4145290 2024-09-19T09:14:18.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.062+0000 7f41ec43c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f41e406e6b0 con 0x7f41e4072f40 2024-09-19T09:14:18.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.062+0000 7f41ea1d8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f41e4145290 0x7f41e406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:18.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.062+0000 7f41ea1d8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f41e4145290 0x7f41e406f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55902/0 (socket says 172.21.15.18:55902) 2024-09-19T09:14:18.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.062+0000 7f41ea1d8640 1 -- 172.21.15.18:0/77458119 learned_addr learned my addr 172.21.15.18:0/77458119 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:18.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.063+0000 7f41ea9d9640 1 --2- 172.21.15.18:0/77458119 >> v2:172.21.15.162:3300/0 conn(0x7f41e4072f40 0x7f41e40b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:18.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.063+0000 7f41ea1d8640 1 -- 172.21.15.18:0/77458119 >> v2:172.21.15.162:3300/0 conn(0x7f41e4072f40 msgr2=0x7f41e40b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:18.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.063+0000 7f41ea1d8640 1 --2- 172.21.15.18:0/77458119 >> v2:172.21.15.162:3300/0 conn(0x7f41e4072f40 0x7f41e40b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:18.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.063+0000 7f41ea1d8640 1 -- 172.21.15.18:0/77458119 >> v1:172.21.15.162:6789/0 conn(0x7f41e40ce780 legacy=0x7f41e4072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:18.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.063+0000 7f41ea1d8640 1 -- 172.21.15.18:0/77458119 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e406e990 con 0x7f41e4145290 2024-09-19T09:14:18.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.064+0000 7f41ea1d8640 1 --2- 172.21.15.18:0/77458119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41e4145290 0x7f41e406f470 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f41e4160560 tx=0x7f41d402c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364ea3f9f0a79fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:18.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.064+0000 7f41e91d6640 1 -- 172.21.15.18:0/77458119 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d400b2e0 con 0x7f41e4145290 2024-09-19T09:14:18.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.064+0000 7f41e91d6640 1 -- 172.21.15.18:0/77458119 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d4037070 con 0x7f41e4145290 2024-09-19T09:14:18.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.064+0000 7f41e91d6640 1 -- 172.21.15.18:0/77458119 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d400b480 con 0x7f41e4145290 2024-09-19T09:14:18.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.064+0000 7f41ec43c640 1 -- 172.21.15.18:0/77458119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41e4145290 msgr2=0x7f41e406f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:18.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.064+0000 7f41ec43c640 1 --2- 172.21.15.18:0/77458119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41e4145290 0x7f41e406f470 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f41e4160560 tx=0x7f41d402c940 comp rx=0 tx=0).stop 2024-09-19T09:14:18.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.064+0000 7f41ec43c640 1 -- 172.21.15.18:0/77458119 shutdown_connections 2024-09-19T09:14:18.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.064+0000 7f41ec43c640 1 --2- 172.21.15.18:0/77458119 >> v2:172.21.15.162:3300/0 conn(0x7f41e4072f40 0x7f41e40b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:18.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.064+0000 7f41ec43c640 1 --2- 172.21.15.18:0/77458119 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41e4145290 0x7f41e406f470 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:18.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.064+0000 7f41ec43c640 1 -- 172.21.15.18:0/77458119 >> 172.21.15.18:0/77458119 conn(0x7f41e406bc10 msgr2=0x7f41e406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:18.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.064+0000 7f41ec43c640 1 -- 172.21.15.18:0/77458119 shutdown_connections 2024-09-19T09:14:18.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.064+0000 7f41ec43c640 1 -- 172.21.15.18:0/77458119 wait complete. 2024-09-19T09:14:18.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.066+0000 7f41ec43c640 1 Processor -- start 2024-09-19T09:14:18.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.066+0000 7f41ec43c640 1 -- start start 2024-09-19T09:14:18.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.066+0000 7f41ec43c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41e4072f40 0x7f41e415b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:18.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.066+0000 7f41ec43c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41e40ce780 0x7f41e415e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:18.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.066+0000 7f41ec43c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41e4145290 0x7f41e41382b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:18.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.066+0000 7f41ec43c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f41e406df80 con 0x7f41e4145290 2024-09-19T09:14:18.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.066+0000 7f41ec43c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f41e4145670 con 0x7f41e40ce780 2024-09-19T09:14:18.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.066+0000 7f41ec43c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f41e406e100 con 0x7f41e4072f40 2024-09-19T09:14:18.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.066+0000 7f41ea9d9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41e4145290 0x7f41e41382b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:18.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.066+0000 7f41ea9d9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41e4145290 0x7f41e41382b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55914/0 (socket says 172.21.15.18:55914) 2024-09-19T09:14:18.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.066+0000 7f41ea9d9640 1 -- 172.21.15.18:0/2497884971 learned_addr learned my addr 172.21.15.18:0/2497884971 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:18.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.066+0000 7f41e99d7640 1 --2- 172.21.15.18:0/2497884971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41e40ce780 0x7f41e415e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:18.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.067+0000 7f41ea1d8640 1 --2- 172.21.15.18:0/2497884971 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41e4072f40 0x7f41e415b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:18.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.067+0000 7f41ea9d9640 1 -- 172.21.15.18:0/2497884971 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41e4072f40 msgr2=0x7f41e415b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:18.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.067+0000 7f41ea9d9640 1 --2- 172.21.15.18:0/2497884971 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41e4072f40 0x7f41e415b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:18.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.067+0000 7f41ea9d9640 1 -- 172.21.15.18:0/2497884971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41e40ce780 msgr2=0x7f41e415e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:18.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.067+0000 7f41ea9d9640 1 --2- 172.21.15.18:0/2497884971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41e40ce780 0x7f41e415e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:18.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.067+0000 7f41ea9d9640 1 -- 172.21.15.18:0/2497884971 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e415f290 con 0x7f41e4145290 2024-09-19T09:14:18.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.067+0000 7f41ea9d9640 1 --2- 172.21.15.18:0/2497884971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41e4145290 0x7f41e41382b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00d5d0 tx=0x7f41dc00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:18.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.067+0000 7f41e2ffd640 1 -- 172.21.15.18:0/2497884971 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41dc0125f0 con 0x7f41e4145290 2024-09-19T09:14:18.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.067+0000 7f41e2ffd640 1 -- 172.21.15.18:0/2497884971 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41dc019070 con 0x7f41e4145290 2024-09-19T09:14:18.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.067+0000 7f41ec43c640 1 -- 172.21.15.18:0/2497884971 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41e415f570 con 0x7f41e4145290 2024-09-19T09:14:18.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.067+0000 7f41e2ffd640 1 -- 172.21.15.18:0/2497884971 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41dc0129d0 con 0x7f41e4145290 2024-09-19T09:14:18.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.067+0000 7f41ec43c640 1 -- 172.21.15.18:0/2497884971 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41e415fb30 con 0x7f41e4145290 2024-09-19T09:14:18.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.068+0000 7f41ec43c640 1 -- 172.21.15.18:0/2497884971 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41e4071510 con 0x7f41e4145290 2024-09-19T09:14:18.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.069+0000 7f41e2ffd640 1 -- 172.21.15.18:0/2497884971 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f41dc012b70 con 0x7f41e4145290 2024-09-19T09:14:18.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.069+0000 7f41e2ffd640 1 --2- 172.21.15.18:0/2497884971 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f41d006c2b0 0x7f41d006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:18.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.069+0000 7f41e2ffd640 1 -- 172.21.15.18:0/2497884971 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5825+0+0 (secure 0 0 0) 0x7f41dc08b7f0 con 0x7f41e4145290 2024-09-19T09:14:18.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.070+0000 7f41ea1d8640 1 --2- 172.21.15.18:0/2497884971 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f41d006c2b0 0x7f41d006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:18.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.070+0000 7f41ea1d8640 1 --2- 172.21.15.18:0/2497884971 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f41d006c2b0 0x7f41d006e770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f41d4036000 tx=0x7f41d400b000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:18.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.074+0000 7f41e2ffd640 1 -- 172.21.15.18:0/2497884971 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f41dc059800 con 0x7f41e4145290 2024-09-19T09:14:18.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.283+0000 7f41ec43c640 1 -- 172.21.15.18:0/2497884971 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f41e40cd750 con 0x7f41e4145290 2024-09-19T09:14:18.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.284+0000 7f41e2ffd640 1 -- 172.21.15.18:0/2497884971 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) ==== 53+0+73 (secure 0 0 0) 0x7f41dc05db00 con 0x7f41e4145290 2024-09-19T09:14:18.284 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T09:14:18.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.286+0000 7f41ec43c640 1 -- 172.21.15.18:0/2497884971 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f41d006c2b0 msgr2=0x7f41d006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:18.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.286+0000 7f41ec43c640 1 --2- 172.21.15.18:0/2497884971 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f41d006c2b0 0x7f41d006e770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f41d4036000 tx=0x7f41d400b000 comp rx=0 tx=0).stop 2024-09-19T09:14:18.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.286+0000 7f41ec43c640 1 -- 172.21.15.18:0/2497884971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41e4145290 msgr2=0x7f41e41382b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:18.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.286+0000 7f41ec43c640 1 --2- 172.21.15.18:0/2497884971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41e4145290 0x7f41e41382b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f41dc00d5d0 tx=0x7f41dc00da90 comp rx=0 tx=0).stop 2024-09-19T09:14:18.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.286+0000 7f41ec43c640 1 -- 172.21.15.18:0/2497884971 shutdown_connections 2024-09-19T09:14:18.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.286+0000 7f41ec43c640 1 --2- 172.21.15.18:0/2497884971 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f41d006c2b0 0x7f41d006e770 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:18.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.286+0000 7f41ec43c640 1 --2- 172.21.15.18:0/2497884971 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f41e4145290 0x7f41e41382b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:18.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.286+0000 7f41ec43c640 1 --2- 172.21.15.18:0/2497884971 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f41e40ce780 0x7f41e415e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:18.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.286+0000 7f41ec43c640 1 --2- 172.21.15.18:0/2497884971 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f41e4072f40 0x7f41e415b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:18.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.286+0000 7f41ec43c640 1 -- 172.21.15.18:0/2497884971 >> 172.21.15.18:0/2497884971 conn(0x7f41e406bc10 msgr2=0x7f41e40b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:18.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.286+0000 7f41ec43c640 1 -- 172.21.15.18:0/2497884971 shutdown_connections 2024-09-19T09:14:18.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:18.286+0000 7f41ec43c640 1 -- 172.21.15.18:0/2497884971 wait complete. 2024-09-19T09:14:18.297 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-19T09:14:18.297 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:14:18.297 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-09-19T09:14:18.297 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-19T09:14:18.297 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-19T09:14:18.297 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-19T09:14:18.297 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-19T09:14:18.297 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:14:18.298 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:14:18.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:18.298 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-09-19T09:14:18.318 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:14:18.318 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:14:18.318 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:14:18.318 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:14:18.318 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-09-19T09:14:18.318 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:14:18.318 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:14:18.318 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:14:18.318 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-09-19T09:14:18.318 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:14:18.319 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:14:18.319 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-09-19T09:14:18.319 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:14:18.319 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:14:18.319 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:14:18.319 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:14:18.319 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T09:14:18.319 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42750sec preferred_lft 42750sec 2024-09-19T09:14:18.319 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link noprefixroute 2024-09-19T09:14:18.319 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:14:18.319 INFO:teuthology.orchestra.run.smithi162.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T09:14:18.319 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 5e:4d:7e:1d:19:f9 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:14:18.319 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T09:14:18.320 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:14:18.320 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::5829:65ff:fe01:6bc7/64 scope link 2024-09-19T09:14:18.320 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:14:18.320 INFO:teuthology.orchestra.run.smithi162.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:14:18.320 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 86:86:3e:32:67:c5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T09:14:18.320 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::8486:3eff:fe32:67c5/64 scope link 2024-09-19T09:14:18.320 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:14:18.320 INFO:teuthology.orchestra.run.smithi162.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:14:18.320 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 5e:4d:7e:1d:19:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-19T09:14:18.320 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::5c4d:7eff:fe1d:19f9/64 scope link 2024-09-19T09:14:18.320 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:14:18.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:18.321 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:14:18.386 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-09-19T09:14:18.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:18.388 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-09-19T09:14:18.446 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-09-19T09:14:18.447 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:14:18.447 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T09:14:18.447 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T09:14:18.447 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:14:18.447 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:14:18.447 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-19T09:14:18.447 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T09:14:18.447 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T09:14:18.448 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T09:14:18.448 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-19T09:14:18.540 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:14:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:14:18.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:14:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:14:18.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:18.580 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-19T09:14:18.596 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-19T09:14:18.596 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-19T09:14:18.596 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:14:18.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:18.596 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2024-09-19T09:14:18.661 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:14:18.662 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-19T09:14:18.717 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:14:18.717 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:14:18.717 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-19T09:14:18.772 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-19T09:14:18.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:18.772 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:14:18.857 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:14:18.857 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:14:18.857 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:14:18.866 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:14:18.867 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:14:18.867 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:14:18.867 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:14:18.867 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:14:18.871 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:14:18.871 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:14:18.871 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:14:18.871 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:14:18.871 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:14:18.872 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-19T09:14:18.872 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-19T09:14:18.872 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=fec66d7e-50e5-42ed-81de-ad141a2f0f4e" will pass to kernel 2024-09-19T09:14:18.872 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-19T09:14:18.872 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:14:18.872 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:14:18.872 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:14:18.872 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:14:18.874 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:14:18.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:18.874 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-19T09:14:18.898 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:14:18.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:14:18 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:14:18.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:14:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:14:18.995 INFO:teuthology.orchestra.run.smithi162.stdout:client4685 2024-09-19T09:14:18.996 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:14:18.996 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:14:19.012 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:14:19.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.128+0000 7f9188c5e640 1 Processor -- start 2024-09-19T09:14:19.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.128+0000 7f9188c5e640 1 -- start start 2024-09-19T09:14:19.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.129+0000 7f9188c5e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9184145290 0x7f918406f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:19.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.129+0000 7f9188c5e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f91840ce780 0x7f9184072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:19.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.129+0000 7f9188c5e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f918406e3d0 con 0x7f9184071510 2024-09-19T09:14:19.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.129+0000 7f9188c5e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f918406efe0 con 0x7f91840ce780 2024-09-19T09:14:19.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.129+0000 7f9188c5e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f918406e6b0 con 0x7f9184145290 2024-09-19T09:14:19.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.129+0000 7f9181d9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f91840ce780 0x7f9184072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:19.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.129+0000 7f9181d9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f91840ce780 0x7f9184072830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55922/0 (socket says 172.21.15.18:55922) 2024-09-19T09:14:19.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.129+0000 7f9181d9b640 1 -- 172.21.15.18:0/2020440607 learned_addr learned my addr 172.21.15.18:0/2020440607 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:19.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.129+0000 7f918259c640 1 --2- 172.21.15.18:0/2020440607 >> v2:172.21.15.162:3300/0 conn(0x7f9184145290 0x7f918406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:19.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.129+0000 7f9181d9b640 1 -- 172.21.15.18:0/2020440607 >> v2:172.21.15.162:3300/0 conn(0x7f9184145290 msgr2=0x7f918406f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:19.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.129+0000 7f9181d9b640 1 --2- 172.21.15.18:0/2020440607 >> v2:172.21.15.162:3300/0 conn(0x7f9184145290 0x7f918406f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:19.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.129+0000 7f9181d9b640 1 -- 172.21.15.18:0/2020440607 >> v1:172.21.15.162:6789/0 conn(0x7f9184071510 legacy=0x7f91840b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:19.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.129+0000 7f9181d9b640 1 -- 172.21.15.18:0/2020440607 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f918406e990 con 0x7f91840ce780 2024-09-19T09:14:19.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.130+0000 7f9181d9b640 1 --2- 172.21.15.18:0/2020440607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91840ce780 0x7f9184072830 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9184075940 tx=0x7f917802c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=710f78a599374c8e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:19.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.130+0000 7f918159a640 1 -- 172.21.15.18:0/2020440607 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9178036020 con 0x7f91840ce780 2024-09-19T09:14:19.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.130+0000 7f918159a640 1 -- 172.21.15.18:0/2020440607 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9178032640 con 0x7f91840ce780 2024-09-19T09:14:19.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.130+0000 7f918159a640 1 -- 172.21.15.18:0/2020440607 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9178032a10 con 0x7f91840ce780 2024-09-19T09:14:19.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.131+0000 7f9188c5e640 1 -- 172.21.15.18:0/2020440607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91840ce780 msgr2=0x7f9184072830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:19.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.131+0000 7f9188c5e640 1 --2- 172.21.15.18:0/2020440607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91840ce780 0x7f9184072830 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9184075940 tx=0x7f917802c940 comp rx=0 tx=0).stop 2024-09-19T09:14:19.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.131+0000 7f9188c5e640 1 -- 172.21.15.18:0/2020440607 shutdown_connections 2024-09-19T09:14:19.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.131+0000 7f9188c5e640 1 --2- 172.21.15.18:0/2020440607 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f91840ce780 0x7f9184072830 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:19.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.131+0000 7f9188c5e640 1 --2- 172.21.15.18:0/2020440607 >> v2:172.21.15.162:3300/0 conn(0x7f9184145290 0x7f918406f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:19.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.131+0000 7f9188c5e640 1 -- 172.21.15.18:0/2020440607 >> 172.21.15.18:0/2020440607 conn(0x7f918406bc10 msgr2=0x7f918406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:19.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.131+0000 7f9188c5e640 1 -- 172.21.15.18:0/2020440607 shutdown_connections 2024-09-19T09:14:19.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.131+0000 7f9188c5e640 1 -- 172.21.15.18:0/2020440607 wait complete. 2024-09-19T09:14:19.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.132+0000 7f9188c5e640 1 Processor -- start 2024-09-19T09:14:19.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.132+0000 7f9188c5e640 1 -- start start 2024-09-19T09:14:19.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.133+0000 7f9188c5e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9184071510 0x7f918415aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:19.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.133+0000 7f9188c5e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91840ce780 0x7f918415e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:19.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.133+0000 7f9188c5e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9184145290 0x7f918415a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:19.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.133+0000 7f9188c5e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f918406df80 con 0x7f9184145290 2024-09-19T09:14:19.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.133+0000 7f9188c5e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9184145670 con 0x7f9184071510 2024-09-19T09:14:19.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.133+0000 7f9188c5e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f918406e100 con 0x7f91840ce780 2024-09-19T09:14:19.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.133+0000 7f9182d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9184145290 0x7f918415a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:19.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.133+0000 7f9182d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9184145290 0x7f918415a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55932/0 (socket says 172.21.15.18:55932) 2024-09-19T09:14:19.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.133+0000 7f9182d9d640 1 -- 172.21.15.18:0/1192385425 learned_addr learned my addr 172.21.15.18:0/1192385425 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:19.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.133+0000 7f9181d9b640 1 --2- 172.21.15.18:0/1192385425 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91840ce780 0x7f918415e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:19.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.133+0000 7f918259c640 1 --2- 172.21.15.18:0/1192385425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9184071510 0x7f918415aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:19.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.133+0000 7f9182d9d640 1 -- 172.21.15.18:0/1192385425 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91840ce780 msgr2=0x7f918415e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:19.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.134+0000 7f9182d9d640 1 --2- 172.21.15.18:0/1192385425 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91840ce780 0x7f918415e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:19.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.134+0000 7f9182d9d640 1 -- 172.21.15.18:0/1192385425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9184071510 msgr2=0x7f918415aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:19.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.134+0000 7f9182d9d640 1 --2- 172.21.15.18:0/1192385425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9184071510 0x7f918415aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:19.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.134+0000 7f9182d9d640 1 -- 172.21.15.18:0/1192385425 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91841420f0 con 0x7f9184145290 2024-09-19T09:14:19.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.134+0000 7f9182d9d640 1 --2- 172.21.15.18:0/1192385425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9184145290 0x7f918415a660 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f917c00c6b0 tx=0x7f917c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:19.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.134+0000 7f9172ffd640 1 -- 172.21.15.18:0/1192385425 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917c003b70 con 0x7f9184145290 2024-09-19T09:14:19.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.134+0000 7f9172ffd640 1 -- 172.21.15.18:0/1192385425 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f917c003d30 con 0x7f9184145290 2024-09-19T09:14:19.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.134+0000 7f9188c5e640 1 -- 172.21.15.18:0/1192385425 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9184142390 con 0x7f9184145290 2024-09-19T09:14:19.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.134+0000 7f9172ffd640 1 -- 172.21.15.18:0/1192385425 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f917c005310 con 0x7f9184145290 2024-09-19T09:14:19.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.134+0000 7f9188c5e640 1 -- 172.21.15.18:0/1192385425 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9184142950 con 0x7f9184145290 2024-09-19T09:14:19.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.135+0000 7f9188c5e640 1 -- 172.21.15.18:0/1192385425 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f918406f470 con 0x7f9184145290 2024-09-19T09:14:19.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.136+0000 7f9172ffd640 1 -- 172.21.15.18:0/1192385425 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f917c0054b0 con 0x7f9184145290 2024-09-19T09:14:19.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.136+0000 7f9172ffd640 1 --2- 172.21.15.18:0/1192385425 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f916406c2b0 0x7f916406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:19.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.136+0000 7f9172ffd640 1 -- 172.21.15.18:0/1192385425 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5825+0+0 (secure 0 0 0) 0x7f917c08b170 con 0x7f9184145290 2024-09-19T09:14:19.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.136+0000 7f918259c640 1 --2- 172.21.15.18:0/1192385425 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f916406c2b0 0x7f916406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:19.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.137+0000 7f918259c640 1 --2- 172.21.15.18:0/1192385425 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f916406c2b0 0x7f916406e770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f918406cd90 tx=0x7f9174009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:19.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.141+0000 7f9172ffd640 1 -- 172.21.15.18:0/1192385425 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f917c0592a0 con 0x7f9184145290 2024-09-19T09:14:19.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.373+0000 7f9188c5e640 1 -- 172.21.15.18:0/1192385425 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9184140180 con 0x7f9184145290 2024-09-19T09:14:19.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.374+0000 7f9172ffd640 1 -- 172.21.15.18:0/1192385425 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5229 (secure 0 0 0) 0x7f917c05d5a0 con 0x7f9184145290 2024-09-19T09:14:19.375 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:19.375 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":13,"btime":"2024-09-19T09:14:09:822716+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1369179501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1369179501},{"type":"v1","addr":"172.21.15.18:6835","nonce":1369179501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4762,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2677647932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2677647932},{"type":"v1","addr":"172.21.15.162:6836","nonce":2677647932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4765,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3427373581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3427373581},{"type":"v1","addr":"172.21.15.162:6837","nonce":3427373581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:14:07.154707+0000","modified":"2024-09-19T09:14:09.169555+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4785},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4785":{"gid":4785,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6834/2895835717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2895835717},{"type":"v1","addr":"172.21.15.18:6834","nonce":2895835717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4785,"qdb_cluster":[4785]},"id":2}]} 2024-09-19T09:14:19.375 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 13 2024-09-19T09:14:19.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.376+0000 7f9188c5e640 1 -- 172.21.15.18:0/1192385425 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f916406c2b0 msgr2=0x7f916406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:19.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.376+0000 7f9188c5e640 1 --2- 172.21.15.18:0/1192385425 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f916406c2b0 0x7f916406e770 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f918406cd90 tx=0x7f9174009190 comp rx=0 tx=0).stop 2024-09-19T09:14:19.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.376+0000 7f9188c5e640 1 -- 172.21.15.18:0/1192385425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9184145290 msgr2=0x7f918415a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:19.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.376+0000 7f9188c5e640 1 --2- 172.21.15.18:0/1192385425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9184145290 0x7f918415a660 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f917c00c6b0 tx=0x7f917c00cb70 comp rx=0 tx=0).stop 2024-09-19T09:14:19.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.376+0000 7f9188c5e640 1 -- 172.21.15.18:0/1192385425 shutdown_connections 2024-09-19T09:14:19.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.376+0000 7f9188c5e640 1 --2- 172.21.15.18:0/1192385425 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f916406c2b0 0x7f916406e770 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:19.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.376+0000 7f9188c5e640 1 --2- 172.21.15.18:0/1192385425 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9184145290 0x7f918415a660 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:19.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.376+0000 7f9188c5e640 1 --2- 172.21.15.18:0/1192385425 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f91840ce780 0x7f918415e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:19.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.376+0000 7f9188c5e640 1 --2- 172.21.15.18:0/1192385425 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9184071510 0x7f918415aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:19.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.376+0000 7f9188c5e640 1 -- 172.21.15.18:0/1192385425 >> 172.21.15.18:0/1192385425 conn(0x7f918406bc10 msgr2=0x7f918413f950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:19.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.376+0000 7f9188c5e640 1 -- 172.21.15.18:0/1192385425 shutdown_connections 2024-09-19T09:14:19.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.376+0000 7f9188c5e640 1 -- 172.21.15.18:0/1192385425 wait complete. 2024-09-19T09:14:19.391 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-19T09:14:19.511 INFO:teuthology.orchestra.run.smithi018.stdout:{"cluster_fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","whoami":0,"id":4785,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":11.685334304,"mdsmap_epoch":13,"osdmap_epoch":34,"osdmap_epoch_barrier":32,"uptime":18.579281632000001} 2024-09-19T09:14:19.512 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", "fs_name": "cephfs", "id": 4785, "mdsmap_epoch": 13, "osdmap_epoch": 34, "osdmap_epoch_barrier": 32, "rank_uptime": 11.685334304, "state": "up:active", "uptime": 18.579281632, "want_state": "up:active", "whoami": 0 } 2024-09-19T09:14:19.512 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2024-09-19T09:14:19.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.613+0000 7f041105e640 1 Processor -- start 2024-09-19T09:14:19.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.613+0000 7f041105e640 1 -- start start 2024-09-19T09:14:19.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.614+0000 7f041105e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f040c0cfae0 0x7f040c0b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:19.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.614+0000 7f041105e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f040c06d730 0x7f040c0cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:19.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.614+0000 7f041105e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f040c0cd1a0 con 0x7f040c15ef80 2024-09-19T09:14:19.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.614+0000 7f041105e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f040c0cd7d0 con 0x7f040c0cfae0 2024-09-19T09:14:19.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.614+0000 7f041105e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f040c06dc30 con 0x7f040c06d730 2024-09-19T09:14:19.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.614+0000 7f040ad9d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f040c15ef80 0x7f040c0cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50732/0 (socket says 172.21.15.18:50732) 2024-09-19T09:14:19.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.614+0000 7f040ad9d640 1 -- 172.21.15.18:0/3043579291 learned_addr learned my addr 172.21.15.18:0/3043579291 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:19.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.614+0000 7f040a59c640 1 --2- 172.21.15.18:0/3043579291 >> v2:172.21.15.18:3300/0 conn(0x7f040c0cfae0 0x7f040c0b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:19.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.614+0000 7f040b59e640 1 --2- 172.21.15.18:0/3043579291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f040c06d730 0x7f040c0cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:19.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.614+0000 7f040a59c640 1 -- 172.21.15.18:0/3043579291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f040c06d730 msgr2=0x7f040c0cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:19.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.614+0000 7f040a59c640 1 --2- 172.21.15.18:0/3043579291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f040c06d730 0x7f040c0cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:19.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.614+0000 7f040a59c640 1 -- 172.21.15.18:0/3043579291 >> v1:172.21.15.18:6789/0 conn(0x7f040c15ef80 legacy=0x7f040c0cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:19.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.614+0000 7f0409d9b640 1 -- 172.21.15.18:0/3043579291 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2178995389 0 0) 0x7f040c0cd1a0 con 0x7f040c15ef80 2024-09-19T09:14:19.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.614+0000 7f040a59c640 1 -- 172.21.15.18:0/3043579291 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f040c06df10 con 0x7f040c0cfae0 2024-09-19T09:14:19.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.615+0000 7f040a59c640 1 --2- 172.21.15.18:0/3043579291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f040c0cfae0 0x7f040c0b5220 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f04000097a0 tx=0x7f040002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223b6dd1ce609978 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:19.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.615+0000 7f0409d9b640 1 -- 172.21.15.18:0/3043579291 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0400037070 con 0x7f040c0cfae0 2024-09-19T09:14:19.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.615+0000 7f0409d9b640 1 -- 172.21.15.18:0/3043579291 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0400032440 con 0x7f040c0cfae0 2024-09-19T09:14:19.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.615+0000 7f0409d9b640 1 -- 172.21.15.18:0/3043579291 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0400032810 con 0x7f040c0cfae0 2024-09-19T09:14:19.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.616+0000 7f041105e640 1 -- 172.21.15.18:0/3043579291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f040c0cfae0 msgr2=0x7f040c0b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:19.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.616+0000 7f041105e640 1 --2- 172.21.15.18:0/3043579291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f040c0cfae0 0x7f040c0b5220 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f04000097a0 tx=0x7f040002a180 comp rx=0 tx=0).stop 2024-09-19T09:14:19.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.616+0000 7f041105e640 1 -- 172.21.15.18:0/3043579291 shutdown_connections 2024-09-19T09:14:19.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.616+0000 7f041105e640 1 --2- 172.21.15.18:0/3043579291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f040c06d730 0x7f040c0cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:19.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.616+0000 7f041105e640 1 --2- 172.21.15.18:0/3043579291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f040c0cfae0 0x7f040c0b5220 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:19.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.616+0000 7f041105e640 1 -- 172.21.15.18:0/3043579291 >> 172.21.15.18:0/3043579291 conn(0x7f040c0b4700 msgr2=0x7f040c0b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:19.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.616+0000 7f041105e640 1 -- 172.21.15.18:0/3043579291 shutdown_connections 2024-09-19T09:14:19.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.616+0000 7f041105e640 1 -- 172.21.15.18:0/3043579291 wait complete. 2024-09-19T09:14:19.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.617+0000 7f041105e640 1 Processor -- start 2024-09-19T09:14:19.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.618+0000 7f041105e640 1 -- start start 2024-09-19T09:14:19.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.618+0000 7f041105e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f040c06d730 0x7f040c0cad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:19.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.618+0000 7f041105e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f040c0cfae0 0x7f040c157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:19.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.618+0000 7f041105e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f040c15ef80 0x7f040c0c7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:19.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.618+0000 7f041105e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f040c0d0120 con 0x7f040c15ef80 2024-09-19T09:14:19.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.618+0000 7f041105e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f040c15f360 con 0x7f040c0cfae0 2024-09-19T09:14:19.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.618+0000 7f041105e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f040c0ce1a0 con 0x7f040c06d730 2024-09-19T09:14:19.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.618+0000 7f040b59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f040c15ef80 0x7f040c0c7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:19.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.618+0000 7f040b59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f040c15ef80 0x7f040c0c7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55950/0 (socket says 172.21.15.18:55950) 2024-09-19T09:14:19.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.618+0000 7f040b59e640 1 -- 172.21.15.18:0/3677567123 learned_addr learned my addr 172.21.15.18:0/3677567123 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:19.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.618+0000 7f040a59c640 1 --2- 172.21.15.18:0/3677567123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f040c0cfae0 0x7f040c157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:19.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.619+0000 7f040ad9d640 1 --2- 172.21.15.18:0/3677567123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f040c06d730 0x7f040c0cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:19.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.619+0000 7f040b59e640 1 -- 172.21.15.18:0/3677567123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f040c06d730 msgr2=0x7f040c0cad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:19.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.619+0000 7f040b59e640 1 --2- 172.21.15.18:0/3677567123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f040c06d730 0x7f040c0cad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:19.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.619+0000 7f040b59e640 1 -- 172.21.15.18:0/3677567123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f040c0cfae0 msgr2=0x7f040c157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:19.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.619+0000 7f040b59e640 1 --2- 172.21.15.18:0/3677567123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f040c0cfae0 0x7f040c157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:19.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.619+0000 7f040b59e640 1 -- 172.21.15.18:0/3677567123 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f040c1584f0 con 0x7f040c15ef80 2024-09-19T09:14:19.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.619+0000 7f040b59e640 1 --2- 172.21.15.18:0/3677567123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f040c15ef80 0x7f040c0c7b30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0404009e30 tx=0x7f040400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:19.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.619+0000 7f03f37fe640 1 -- 172.21.15.18:0/3677567123 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0404018020 con 0x7f040c15ef80 2024-09-19T09:14:19.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.619+0000 7f03f37fe640 1 -- 172.21.15.18:0/3677567123 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0404014480 con 0x7f040c15ef80 2024-09-19T09:14:19.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.619+0000 7f041105e640 1 -- 172.21.15.18:0/3677567123 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f040c0c83a0 con 0x7f040c15ef80 2024-09-19T09:14:19.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.619+0000 7f03f37fe640 1 -- 172.21.15.18:0/3677567123 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0404014870 con 0x7f040c15ef80 2024-09-19T09:14:19.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.619+0000 7f041105e640 1 -- 172.21.15.18:0/3677567123 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f040c0c8960 con 0x7f040c15ef80 2024-09-19T09:14:19.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.620+0000 7f041105e640 1 -- 172.21.15.18:0/3677567123 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f040c0cdc40 con 0x7f040c15ef80 2024-09-19T09:14:19.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.621+0000 7f03f37fe640 1 -- 172.21.15.18:0/3677567123 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0404005d10 con 0x7f040c15ef80 2024-09-19T09:14:19.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.621+0000 7f03f37fe640 1 --2- 172.21.15.18:0/3677567123 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f03f806c2b0 0x7f03f806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:19.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.621+0000 7f03f37fe640 1 -- 172.21.15.18:0/3677567123 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5825+0+0 (secure 0 0 0) 0x7f040408c320 con 0x7f040c15ef80 2024-09-19T09:14:19.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.621+0000 7f040ad9d640 1 --2- 172.21.15.18:0/3677567123 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f03f806c2b0 0x7f03f806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:19.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.622+0000 7f040ad9d640 1 --2- 172.21.15.18:0/3677567123 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f03f806c2b0 0x7f03f806e770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f03fc007fd0 tx=0x7f03fc007de0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:19.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.626+0000 7f03f37fe640 1 -- 172.21.15.18:0/3677567123 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0404022030 con 0x7f040c15ef80 2024-09-19T09:14:19.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.870+0000 7f041105e640 1 -- 172.21.15.18:0/3677567123 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) -- 0x7f040c15c4d0 con 0x7f040c15ef80 2024-09-19T09:14:19.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.871+0000 7f03f37fe640 1 -- 172.21.15.18:0/3677567123 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) ==== 75+0+1620 (secure 0 0 0) 0x7f0404010040 con 0x7f040c15ef80 2024-09-19T09:14:19.871 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:19.871 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:14:19.871 INFO:teuthology.orchestra.run.smithi018.stdout: "stats": { 2024-09-19T09:14:19.871 INFO:teuthology.orchestra.run.smithi018.stdout: "total_bytes": 1600000000, 2024-09-19T09:14:19.872 INFO:teuthology.orchestra.run.smithi018.stdout: "total_avail_bytes": 1597686861, 2024-09-19T09:14:19.872 INFO:teuthology.orchestra.run.smithi018.stdout: "total_used_bytes": 2313139, 2024-09-19T09:14:19.872 INFO:teuthology.orchestra.run.smithi018.stdout: "total_used_raw_bytes": 2313139, 2024-09-19T09:14:19.872 INFO:teuthology.orchestra.run.smithi018.stdout: "total_used_raw_ratio": 0.0014457118231803179, 2024-09-19T09:14:19.872 INFO:teuthology.orchestra.run.smithi018.stdout: "num_osds": 8, 2024-09-19T09:14:19.872 INFO:teuthology.orchestra.run.smithi018.stdout: "num_per_pool_osds": 0, 2024-09-19T09:14:19.872 INFO:teuthology.orchestra.run.smithi018.stdout: "num_per_pool_omap_osds": 0 2024-09-19T09:14:19.872 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:19.872 INFO:teuthology.orchestra.run.smithi018.stdout: "stats_by_class": { 2024-09-19T09:14:19.872 INFO:teuthology.orchestra.run.smithi018.stdout: "hdd": { 2024-09-19T09:14:19.872 INFO:teuthology.orchestra.run.smithi018.stdout: "total_bytes": 1600000000, 2024-09-19T09:14:19.872 INFO:teuthology.orchestra.run.smithi018.stdout: "total_avail_bytes": 1597686861, 2024-09-19T09:14:19.873 INFO:teuthology.orchestra.run.smithi018.stdout: "total_used_bytes": 2313139, 2024-09-19T09:14:19.873 INFO:teuthology.orchestra.run.smithi018.stdout: "total_used_raw_bytes": 2313139, 2024-09-19T09:14:19.873 INFO:teuthology.orchestra.run.smithi018.stdout: "total_used_raw_ratio": 0.0014457118231803179 2024-09-19T09:14:19.873 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:19.873 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:19.873 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-19T09:14:19.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:19.873 INFO:teuthology.orchestra.run.smithi018.stdout: "name": ".mgr", 2024-09-19T09:14:19.873 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 1, 2024-09-19T09:14:19.873 INFO:teuthology.orchestra.run.smithi018.stdout: "stats": { 2024-09-19T09:14:19.873 INFO:teuthology.orchestra.run.smithi018.stdout: "stored": 590368, 2024-09-19T09:14:19.873 INFO:teuthology.orchestra.run.smithi018.stdout: "objects": 2, 2024-09-19T09:14:19.873 INFO:teuthology.orchestra.run.smithi018.stdout: "kb_used": 577, 2024-09-19T09:14:19.874 INFO:teuthology.orchestra.run.smithi018.stdout: "bytes_used": 590368, 2024-09-19T09:14:19.874 INFO:teuthology.orchestra.run.smithi018.stdout: "percent_used": 0.00052961788605898619, 2024-09-19T09:14:19.874 INFO:teuthology.orchestra.run.smithi018.stdout: "max_avail": 557057600 2024-09-19T09:14:19.874 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:19.874 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:19.874 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:19.874 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephfs_metadata", 2024-09-19T09:14:19.874 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 4, 2024-09-19T09:14:19.874 INFO:teuthology.orchestra.run.smithi018.stdout: "stats": { 2024-09-19T09:14:19.874 INFO:teuthology.orchestra.run.smithi018.stdout: "stored": 2410, 2024-09-19T09:14:19.874 INFO:teuthology.orchestra.run.smithi018.stdout: "objects": 22, 2024-09-19T09:14:19.874 INFO:teuthology.orchestra.run.smithi018.stdout: "kb_used": 3, 2024-09-19T09:14:19.874 INFO:teuthology.orchestra.run.smithi018.stdout: "bytes_used": 2410, 2024-09-19T09:14:19.874 INFO:teuthology.orchestra.run.smithi018.stdout: "percent_used": 2.1631467461702414e-06, 2024-09-19T09:14:19.875 INFO:teuthology.orchestra.run.smithi018.stdout: "max_avail": 557057600 2024-09-19T09:14:19.875 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:19.875 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:19.875 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:19.875 INFO:teuthology.orchestra.run.smithi018.stdout: "name": "cephfs_data", 2024-09-19T09:14:19.875 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 5, 2024-09-19T09:14:19.875 INFO:teuthology.orchestra.run.smithi018.stdout: "stats": { 2024-09-19T09:14:19.875 INFO:teuthology.orchestra.run.smithi018.stdout: "stored": 0, 2024-09-19T09:14:19.875 INFO:teuthology.orchestra.run.smithi018.stdout: "objects": 0, 2024-09-19T09:14:19.875 INFO:teuthology.orchestra.run.smithi018.stdout: "kb_used": 0, 2024-09-19T09:14:19.875 INFO:teuthology.orchestra.run.smithi018.stdout: "bytes_used": 0, 2024-09-19T09:14:19.875 INFO:teuthology.orchestra.run.smithi018.stdout: "percent_used": 0, 2024-09-19T09:14:19.875 INFO:teuthology.orchestra.run.smithi018.stdout: "max_avail": 557057600 2024-09-19T09:14:19.875 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:19.876 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:19.876 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:19.876 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:14:19.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.873+0000 7f041105e640 1 -- 172.21.15.18:0/3677567123 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f03f806c2b0 msgr2=0x7f03f806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:19.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.873+0000 7f041105e640 1 --2- 172.21.15.18:0/3677567123 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f03f806c2b0 0x7f03f806e770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f03fc007fd0 tx=0x7f03fc007de0 comp rx=0 tx=0).stop 2024-09-19T09:14:19.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.873+0000 7f041105e640 1 -- 172.21.15.18:0/3677567123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f040c15ef80 msgr2=0x7f040c0c7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:19.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.873+0000 7f041105e640 1 --2- 172.21.15.18:0/3677567123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f040c15ef80 0x7f040c0c7b30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0404009e30 tx=0x7f040400c490 comp rx=0 tx=0).stop 2024-09-19T09:14:19.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.873+0000 7f041105e640 1 -- 172.21.15.18:0/3677567123 shutdown_connections 2024-09-19T09:14:19.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.873+0000 7f041105e640 1 --2- 172.21.15.18:0/3677567123 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f03f806c2b0 0x7f03f806e770 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:19.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.873+0000 7f041105e640 1 --2- 172.21.15.18:0/3677567123 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f040c15ef80 0x7f040c0c7b30 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:19.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.873+0000 7f041105e640 1 --2- 172.21.15.18:0/3677567123 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f040c0cfae0 0x7f040c157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:19.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.873+0000 7f041105e640 1 --2- 172.21.15.18:0/3677567123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f040c06d730 0x7f040c0cad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:19.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.873+0000 7f041105e640 1 -- 172.21.15.18:0/3677567123 >> 172.21.15.18:0/3677567123 conn(0x7f040c0b4700 msgr2=0x7f040c0d3350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:19.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.873+0000 7f041105e640 1 -- 172.21.15.18:0/3677567123 shutdown_connections 2024-09-19T09:14:19.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19.873+0000 7f041105e640 1 -- 172.21.15.18:0/3677567123 wait complete. 2024-09-19T09:14:19.884 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-09-19T09:14:19.884 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-09-19T09:14:19.885 DEBUG:teuthology.orchestra.run.smithi018:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-19T09:14:19.885 DEBUG:teuthology.orchestra.run.smithi018:> os.fchmod(fd, 0O666) 2024-09-19T09:14:19.885 DEBUG:teuthology.orchestra.run.smithi018:> os.fsync(fd) 2024-09-19T09:14:19.885 DEBUG:teuthology.orchestra.run.smithi018:> os.close(fd) 2024-09-19T09:14:19.885 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-09-19T09:14:19.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:14:19.965 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:14:20.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:14:20.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:14:20.063 INFO:teuthology.orchestra.run.smithi018.stdout:client4679 2024-09-19T09:14:20.063 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/fec66d7e-50e5-42ed-81de-ad141a2f0f4e.client4679/osdmap') 2024-09-19T09:14:20.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:14:20.123 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 34 barrier 32 flags 0x588000 2024-09-19T09:14:20.123 INFO:teuthology.orchestra.run.smithi018.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-19T09:14:20.123 INFO:teuthology.orchestra.run.smithi018.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-19T09:14:20.123 INFO:teuthology.orchestra.run.smithi018.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-19T09:14:20.123 INFO:teuthology.orchestra.run.smithi018.stdout:osd0 (1)172.21.15.18:6809 100% (exists, up) 100% -1 2024-09-19T09:14:20.123 INFO:teuthology.orchestra.run.smithi018.stdout:osd1 (1)172.21.15.18:6817 100% (exists, up) 100% -1 2024-09-19T09:14:20.124 INFO:teuthology.orchestra.run.smithi018.stdout:osd2 (1)172.21.15.18:6801 100% (exists, up) 100% -1 2024-09-19T09:14:20.124 INFO:teuthology.orchestra.run.smithi018.stdout:osd3 (1)172.21.15.18:6825 100% (exists, up) 100% -1 2024-09-19T09:14:20.124 INFO:teuthology.orchestra.run.smithi018.stdout:osd4 (1)172.21.15.162:6824 100% (exists, up) 100% -1 2024-09-19T09:14:20.124 INFO:teuthology.orchestra.run.smithi018.stdout:osd5 (1)172.21.15.162:6801 100% (exists, up) 100% -1 2024-09-19T09:14:20.124 INFO:teuthology.orchestra.run.smithi018.stdout:osd6 (1)172.21.15.162:6809 100% (exists, up) 100% -1 2024-09-19T09:14:20.124 INFO:teuthology.orchestra.run.smithi018.stdout:osd7 (1)172.21.15.162:6817 100% (exists, up) 100% -1 2024-09-19T09:14:20.124 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 5.0 [4->5] 2024-09-19T09:14:20.124 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 5.28 [4->5] 2024-09-19T09:14:20.124 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 5.33 [4->5] 2024-09-19T09:14:20.124 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 5.37 [4->5] 2024-09-19T09:14:20.125 INFO:teuthology.orchestra.run.smithi018.stderr:1+1 records in 2024-09-19T09:14:20.125 INFO:teuthology.orchestra.run.smithi018.stderr:1+1 records out 2024-09-19T09:14:20.125 INFO:teuthology.orchestra.run.smithi018.stderr:902 bytes copied, 3.8093e-05 s, 23.7 MB/s 2024-09-19T09:14:20.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:14:20.131 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2024-09-19T09:14:20.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.235+0000 7fef16b4b640 1 Processor -- start 2024-09-19T09:14:20.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.235+0000 7fef16b4b640 1 -- start start 2024-09-19T09:14:20.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.236+0000 7fef16b4b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fef10162460 0x7fef100d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:20.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.236+0000 7fef16b4b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef100d56f0 0x7fef100d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:20.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.236+0000 7fef16b4b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef100b50a0 con 0x7fef100d2b80 2024-09-19T09:14:20.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.236+0000 7fef16b4b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fef100b5940 con 0x7fef10162460 2024-09-19T09:14:20.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.236+0000 7fef16b4b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fef100b5380 con 0x7fef100d56f0 2024-09-19T09:14:20.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.236+0000 7fef150e8640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fef100d2b80 0x7fef100d3010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50748/0 (socket says 172.21.15.18:50748) 2024-09-19T09:14:20.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.236+0000 7fef150e8640 1 -- 172.21.15.18:0/1617368233 learned_addr learned my addr 172.21.15.18:0/1617368233 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:20.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.236+0000 7fef148e7640 1 --2- 172.21.15.18:0/1617368233 >> v2:172.21.15.162:3300/0 conn(0x7fef10162460 0x7fef100d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:20.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.236+0000 7fef0ffff640 1 --2- 172.21.15.18:0/1617368233 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef100d56f0 0x7fef100d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:20.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.236+0000 7fef0f7fe640 1 -- 172.21.15.18:0/1617368233 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3880183485 0 0) 0x7fef100b50a0 con 0x7fef100d2b80 2024-09-19T09:14:20.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.236+0000 7fef0f7fe640 1 -- 172.21.15.18:0/1617368233 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feef8003520 con 0x7fef100d2b80 2024-09-19T09:14:20.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.237+0000 7fef0f7fe640 1 -- 172.21.15.18:0/1617368233 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1444845 0 0) 0x7feef8003520 con 0x7fef100d2b80 2024-09-19T09:14:20.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.237+0000 7fef0f7fe640 1 -- 172.21.15.18:0/1617368233 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef100d56f0 msgr2=0x7fef100d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:20.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.237+0000 7fef0f7fe640 1 --2- 172.21.15.18:0/1617368233 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef100d56f0 0x7fef100d1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:20.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.237+0000 7fef0f7fe640 1 -- 172.21.15.18:0/1617368233 >> v2:172.21.15.162:3300/0 conn(0x7fef10162460 msgr2=0x7fef100d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:20.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.237+0000 7fef0f7fe640 1 --2- 172.21.15.18:0/1617368233 >> v2:172.21.15.162:3300/0 conn(0x7fef10162460 0x7fef100d1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:20.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.237+0000 7fef0f7fe640 1 -- 172.21.15.18:0/1617368233 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef100b5660 con 0x7fef100d2b80 2024-09-19T09:14:20.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.237+0000 7fef0f7fe640 1 -- 172.21.15.18:0/1617368233 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fef080019f0 con 0x7fef100d2b80 2024-09-19T09:14:20.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.237+0000 7fef0f7fe640 1 -- 172.21.15.18:0/1617368233 >> v1:172.21.15.18:6789/0 conn(0x7fef100d2b80 legacy=0x7fef100d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:20.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.237+0000 7fef0f7fe640 1 --2- 172.21.15.18:0/1617368233 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef100d56f0 0x7feef80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:20.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.237+0000 7fef0f7fe640 1 --2- 172.21.15.18:0/1617368233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feef8003f30 0x7feef8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:20.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.237+0000 7fef0f7fe640 1 --2- 172.21.15.18:0/1617368233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feef8004d40 0x7feef80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:20.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.237+0000 7fef0f7fe640 1 -- 172.21.15.18:0/1617368233 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fef100b5940 con 0x7feef8004d40 2024-09-19T09:14:20.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.237+0000 7fef0f7fe640 1 -- 172.21.15.18:0/1617368233 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fef100b5380 con 0x7feef8003f30 2024-09-19T09:14:20.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.237+0000 7fef0f7fe640 1 -- 172.21.15.18:0/1617368233 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7feef800b9c0 con 0x7fef100d56f0 2024-09-19T09:14:20.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.237+0000 7fef150e8640 1 --2- 172.21.15.18:0/1617368233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feef8004d40 0x7feef80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:20.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.237+0000 7fef148e7640 1 --2- 172.21.15.18:0/1617368233 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef100d56f0 0x7feef80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:20.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.237+0000 7fef0ffff640 1 --2- 172.21.15.18:0/1617368233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feef8003f30 0x7feef8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:20.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.237+0000 7fef150e8640 1 -- 172.21.15.18:0/1617368233 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef100d56f0 msgr2=0x7feef80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:20.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.237+0000 7fef150e8640 1 --2- 172.21.15.18:0/1617368233 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef100d56f0 0x7feef80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:20.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.237+0000 7fef150e8640 1 -- 172.21.15.18:0/1617368233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feef8003f30 msgr2=0x7feef8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:20.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.237+0000 7fef150e8640 1 --2- 172.21.15.18:0/1617368233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feef8003f30 0x7feef8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:20.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.237+0000 7fef150e8640 1 -- 172.21.15.18:0/1617368233 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feef8003520 con 0x7feef8004d40 2024-09-19T09:14:20.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.238+0000 7fef150e8640 1 --2- 172.21.15.18:0/1617368233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feef8004d40 0x7feef80051c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fef0800a850 tx=0x7feef8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43b4734fe92c4f86 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:20.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.238+0000 7fef0f7fe640 1 -- 172.21.15.18:0/1617368233 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0800a4a0 con 0x7feef8004d40 2024-09-19T09:14:20.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.238+0000 7fef0f7fe640 1 -- 172.21.15.18:0/1617368233 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef0802f070 con 0x7feef8004d40 2024-09-19T09:14:20.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.238+0000 7fef0f7fe640 1 -- 172.21.15.18:0/1617368233 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef0802bd10 con 0x7feef8004d40 2024-09-19T09:14:20.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.239+0000 7fef16b4b640 1 -- 172.21.15.18:0/1617368233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feef8004d40 msgr2=0x7feef80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:20.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.239+0000 7fef16b4b640 1 --2- 172.21.15.18:0/1617368233 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feef8004d40 0x7feef80051c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fef0800a850 tx=0x7feef8005830 comp rx=0 tx=0).stop 2024-09-19T09:14:20.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.239+0000 7fef150e8640 1 -- 172.21.15.18:0/1617368233 reap_dead start 2024-09-19T09:14:20.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.239+0000 7fef16b4b640 1 -- 172.21.15.18:0/1617368233 shutdown_connections 2024-09-19T09:14:20.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.239+0000 7fef16b4b640 1 -- 172.21.15.18:0/1617368233 >> 172.21.15.18:0/1617368233 conn(0x7fef100d4bd0 msgr2=0x7fef100d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:20.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.239+0000 7fef16b4b640 1 -- 172.21.15.18:0/1617368233 shutdown_connections 2024-09-19T09:14:20.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.239+0000 7fef16b4b640 1 -- 172.21.15.18:0/1617368233 wait complete. 2024-09-19T09:14:20.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.240+0000 7fef16b4b640 1 Processor -- start 2024-09-19T09:14:20.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.240+0000 7fef16b4b640 1 -- start start 2024-09-19T09:14:20.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.241+0000 7fef16b4b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef1015c070 0x7fef100c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:20.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.241+0000 7fef16b4b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef1015c450 0x7fef101f8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:20.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.241+0000 7fef16b4b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef100b8a50 0x7fef100b8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:20.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.241+0000 7fef16b4b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fef100b5e40 con 0x7fef100b8a50 2024-09-19T09:14:20.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.241+0000 7fef16b4b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fef100b5cc0 con 0x7fef1015c450 2024-09-19T09:14:20.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.241+0000 7fef16b4b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fef10162840 con 0x7fef1015c070 2024-09-19T09:14:20.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.241+0000 7fef150e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef100b8a50 0x7fef100b8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:20.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.241+0000 7fef150e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef100b8a50 0x7fef100b8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55972/0 (socket says 172.21.15.18:55972) 2024-09-19T09:14:20.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.241+0000 7fef150e8640 1 -- 172.21.15.18:0/580560697 learned_addr learned my addr 172.21.15.18:0/580560697 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:20.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.241+0000 7fef148e7640 1 --2- 172.21.15.18:0/580560697 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef1015c070 0x7fef100c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:20.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.241+0000 7fef0ffff640 1 --2- 172.21.15.18:0/580560697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef1015c450 0x7fef101f8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:20.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.241+0000 7fef150e8640 1 -- 172.21.15.18:0/580560697 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef1015c070 msgr2=0x7fef100c8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:20.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.241+0000 7fef150e8640 1 --2- 172.21.15.18:0/580560697 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef1015c070 0x7fef100c8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:20.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.241+0000 7fef150e8640 1 -- 172.21.15.18:0/580560697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef1015c450 msgr2=0x7fef101f8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:20.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.241+0000 7fef150e8640 1 --2- 172.21.15.18:0/580560697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef1015c450 0x7fef101f8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:20.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.241+0000 7fef150e8640 1 -- 172.21.15.18:0/580560697 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef100c9510 con 0x7fef100b8a50 2024-09-19T09:14:20.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.242+0000 7fef150e8640 1 --2- 172.21.15.18:0/580560697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef100b8a50 0x7fef100b8f00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fef0802b520 tx=0x7fef0802d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:20.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.242+0000 7fef0d7fa640 1 -- 172.21.15.18:0/580560697 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef080019e0 con 0x7fef100b8a50 2024-09-19T09:14:20.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.242+0000 7fef0d7fa640 1 -- 172.21.15.18:0/580560697 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef0800a480 con 0x7fef100b8a50 2024-09-19T09:14:20.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.242+0000 7fef0d7fa640 1 -- 172.21.15.18:0/580560697 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef080346b0 con 0x7fef100b8a50 2024-09-19T09:14:20.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.242+0000 7fef16b4b640 1 -- 172.21.15.18:0/580560697 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef100c97f0 con 0x7fef100b8a50 2024-09-19T09:14:20.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.242+0000 7fef16b4b640 1 -- 172.21.15.18:0/580560697 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef100c9db0 con 0x7fef100b8a50 2024-09-19T09:14:20.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.243+0000 7fef16b4b640 1 -- 172.21.15.18:0/580560697 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef100b50a0 con 0x7fef100b8a50 2024-09-19T09:14:20.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.243+0000 7fef0d7fa640 1 -- 172.21.15.18:0/580560697 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fef08034850 con 0x7fef100b8a50 2024-09-19T09:14:20.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.244+0000 7fef0d7fa640 1 --2- 172.21.15.18:0/580560697 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7feefc06c450 0x7feefc06e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:20.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.244+0000 7fef0d7fa640 1 -- 172.21.15.18:0/580560697 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5825+0+0 (secure 0 0 0) 0x7fef080ab0a0 con 0x7fef100b8a50 2024-09-19T09:14:20.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.244+0000 7fef148e7640 1 --2- 172.21.15.18:0/580560697 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7feefc06c450 0x7feefc06e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:20.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.244+0000 7fef148e7640 1 --2- 172.21.15.18:0/580560697 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7feefc06c450 0x7feefc06e910 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fef00009c40 tx=0x7fef00009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:20.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.248+0000 7fef0d7fa640 1 -- 172.21.15.18:0/580560697 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fef08047030 con 0x7fef100b8a50 2024-09-19T09:14:20.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.431+0000 7fef16b4b640 1 -- 172.21.15.18:0/580560697 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) -- 0x7fef1006de50 con 0x7fef100b8a50 2024-09-19T09:14:20.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.861+0000 7fef0d7fa640 1 -- 172.21.15.18:0/580560697 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v35) ==== 93+0+0 (secure 0 0 0) 0x7fef08079720 con 0x7fef100b8a50 2024-09-19T09:14:20.862 INFO:teuthology.orchestra.run.smithi018.stderr:pauserd,pausewr is set 2024-09-19T09:14:20.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.864+0000 7fef16b4b640 1 -- 172.21.15.18:0/580560697 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7feefc06c450 msgr2=0x7feefc06e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:20.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.864+0000 7fef16b4b640 1 --2- 172.21.15.18:0/580560697 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7feefc06c450 0x7feefc06e910 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fef00009c40 tx=0x7fef00009190 comp rx=0 tx=0).stop 2024-09-19T09:14:20.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.864+0000 7fef16b4b640 1 -- 172.21.15.18:0/580560697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef100b8a50 msgr2=0x7fef100b8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:20.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.864+0000 7fef16b4b640 1 --2- 172.21.15.18:0/580560697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef100b8a50 0x7fef100b8f00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fef0802b520 tx=0x7fef0802d070 comp rx=0 tx=0).stop 2024-09-19T09:14:20.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.864+0000 7fef16b4b640 1 -- 172.21.15.18:0/580560697 shutdown_connections 2024-09-19T09:14:20.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.864+0000 7fef16b4b640 1 --2- 172.21.15.18:0/580560697 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7feefc06c450 0x7feefc06e910 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:20.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.864+0000 7fef16b4b640 1 --2- 172.21.15.18:0/580560697 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef100b8a50 0x7fef100b8f00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:20.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.864+0000 7fef16b4b640 1 --2- 172.21.15.18:0/580560697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef1015c450 0x7fef101f8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:20.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.864+0000 7fef16b4b640 1 --2- 172.21.15.18:0/580560697 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef1015c070 0x7fef100c8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:20.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.864+0000 7fef16b4b640 1 -- 172.21.15.18:0/580560697 >> 172.21.15.18:0/580560697 conn(0x7fef100d4bd0 msgr2=0x7fef10161460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:20.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.864+0000 7fef16b4b640 1 -- 172.21.15.18:0/580560697 shutdown_connections 2024-09-19T09:14:20.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.864+0000 7fef16b4b640 1 -- 172.21.15.18:0/580560697 wait complete. 2024-09-19T09:14:20.877 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2024-09-19T09:14:20.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.982+0000 7f4cfac9b640 1 Processor -- start 2024-09-19T09:14:20.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.982+0000 7f4cfac9b640 1 -- start start 2024-09-19T09:14:20.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.983+0000 7f4cfac9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4cf40ba7e0 0x7f4cf40d0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:20.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.983+0000 7f4cfac9b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4cf40d5870 0x7f4cf40d2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:20.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.983+0000 7f4cfac9b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cf40d3640 con 0x7f4cf40d3230 2024-09-19T09:14:20.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.983+0000 7f4cfac9b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f4cf40babc0 con 0x7f4cf40ba7e0 2024-09-19T09:14:20.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.983+0000 7f4cfac9b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4cf40d0aa0 con 0x7f4cf40d5870 2024-09-19T09:14:20.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.983+0000 7f4cf8a37640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4cf40ba7e0 0x7f4cf40d0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:20.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.983+0000 7f4cf9238640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f4cf40d3230 0x7f4cf41618f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50756/0 (socket says 172.21.15.18:50756) 2024-09-19T09:14:20.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.983+0000 7f4cf9238640 1 -- 172.21.15.18:0/2391454696 learned_addr learned my addr 172.21.15.18:0/2391454696 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:20.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.983+0000 7f4cf8a37640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4cf40ba7e0 0x7f4cf40d0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55976/0 (socket says 172.21.15.18:55976) 2024-09-19T09:14:20.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.983+0000 7f4cf8a37640 1 -- 172.21.15.18:0/2391454696 >> v2:172.21.15.162:3300/0 conn(0x7f4cf40d5870 msgr2=0x7f4cf40d2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:20.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.983+0000 7f4cf8a37640 1 --2- 172.21.15.18:0/2391454696 >> v2:172.21.15.162:3300/0 conn(0x7f4cf40d5870 0x7f4cf40d2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:20.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.983+0000 7f4cf8a37640 1 -- 172.21.15.18:0/2391454696 >> v1:172.21.15.18:6789/0 conn(0x7f4cf40d3230 legacy=0x7f4cf41618f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:20.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.983+0000 7f4cf8a37640 1 -- 172.21.15.18:0/2391454696 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf40b7b60 con 0x7f4cf40ba7e0 2024-09-19T09:14:20.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.984+0000 7f4cf8a37640 1 --2- 172.21.15.18:0/2391454696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4cf40ba7e0 0x7f4cf40d0220 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4cf408eec0 tx=0x7f4ce402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7099de9b4965a732 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:20.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.984+0000 7f4cf37fe640 1 -- 172.21.15.18:0/2391454696 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4037070 con 0x7f4cf40ba7e0 2024-09-19T09:14:20.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.984+0000 7f4cf37fe640 1 -- 172.21.15.18:0/2391454696 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ce4032440 con 0x7f4cf40ba7e0 2024-09-19T09:14:20.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.984+0000 7f4cf37fe640 1 -- 172.21.15.18:0/2391454696 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4032810 con 0x7f4cf40ba7e0 2024-09-19T09:14:20.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.985+0000 7f4cfac9b640 1 -- 172.21.15.18:0/2391454696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4cf40ba7e0 msgr2=0x7f4cf40d0220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:20.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.985+0000 7f4cfac9b640 1 --2- 172.21.15.18:0/2391454696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4cf40ba7e0 0x7f4cf40d0220 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f4cf408eec0 tx=0x7f4ce402a1a0 comp rx=0 tx=0).stop 2024-09-19T09:14:20.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.985+0000 7f4cfac9b640 1 -- 172.21.15.18:0/2391454696 shutdown_connections 2024-09-19T09:14:20.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.985+0000 7f4cfac9b640 1 --2- 172.21.15.18:0/2391454696 >> v2:172.21.15.162:3300/0 conn(0x7f4cf40d5870 0x7f4cf40d2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:20.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.985+0000 7f4cfac9b640 1 --2- 172.21.15.18:0/2391454696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4cf40ba7e0 0x7f4cf40d0220 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:20.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.985+0000 7f4cfac9b640 1 -- 172.21.15.18:0/2391454696 >> 172.21.15.18:0/2391454696 conn(0x7f4cf40d4c70 msgr2=0x7f4cf40d5080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:20.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.985+0000 7f4cfac9b640 1 -- 172.21.15.18:0/2391454696 shutdown_connections 2024-09-19T09:14:20.987 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.985+0000 7f4cfac9b640 1 -- 172.21.15.18:0/2391454696 wait complete. 2024-09-19T09:14:20.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.986+0000 7f4cfac9b640 1 Processor -- start 2024-09-19T09:14:20.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.986+0000 7f4cfac9b640 1 -- start start 2024-09-19T09:14:20.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.987+0000 7f4cfac9b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cf40ba7e0 0x7f4cf41e2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:20.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.987+0000 7f4cfac9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cf40d3230 0x7f4cf40c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:20.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.987+0000 7f4cfac9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4cf40d5870 0x7f4cf41e6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:20.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.987+0000 7f4cfac9b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf40b8400 con 0x7f4cf40d5870 2024-09-19T09:14:20.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.987+0000 7f4cfac9b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf40b8120 con 0x7f4cf40d3230 2024-09-19T09:14:20.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.987+0000 7f4cfac9b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4cf40d0760 con 0x7f4cf40ba7e0 2024-09-19T09:14:20.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.987+0000 7f4cf9238640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4cf40d5870 0x7f4cf41e6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:20.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.987+0000 7f4cf9238640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4cf40d5870 0x7f4cf41e6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55980/0 (socket says 172.21.15.18:55980) 2024-09-19T09:14:20.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.987+0000 7f4cf9238640 1 -- 172.21.15.18:0/2283814407 learned_addr learned my addr 172.21.15.18:0/2283814407 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:20.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.987+0000 7f4cf9238640 1 -- 172.21.15.18:0/2283814407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cf40ba7e0 msgr2=0x7f4cf41e2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:20.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.987+0000 7f4cf9238640 1 --2- 172.21.15.18:0/2283814407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cf40ba7e0 0x7f4cf41e2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:20.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.987+0000 7f4cf9238640 1 -- 172.21.15.18:0/2283814407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cf40d3230 msgr2=0x7f4cf40c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:20.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.987+0000 7f4cf9238640 1 --2- 172.21.15.18:0/2283814407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cf40d3230 0x7f4cf40c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:20.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.987+0000 7f4cf9238640 1 -- 172.21.15.18:0/2283814407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf40c93b0 con 0x7f4cf40d5870 2024-09-19T09:14:20.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.988+0000 7f4cf9238640 1 --2- 172.21.15.18:0/2283814407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4cf40d5870 0x7f4cf41e6e50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4cec00cbf0 tx=0x7f4cec00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:20.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.988+0000 7f4cf17fa640 1 -- 172.21.15.18:0/2283814407 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cec017070 con 0x7f4cf40d5870 2024-09-19T09:14:20.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.988+0000 7f4cf17fa640 1 -- 172.21.15.18:0/2283814407 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cec00ad40 con 0x7f4cf40d5870 2024-09-19T09:14:20.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.988+0000 7f4cfac9b640 1 -- 172.21.15.18:0/2283814407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cf40c9690 con 0x7f4cf40d5870 2024-09-19T09:14:20.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.988+0000 7f4cf17fa640 1 -- 172.21.15.18:0/2283814407 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cec012600 con 0x7f4cf40d5870 2024-09-19T09:14:20.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.988+0000 7f4cfac9b640 1 -- 172.21.15.18:0/2283814407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cf40c9c50 con 0x7f4cf40d5870 2024-09-19T09:14:20.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.989+0000 7f4cfac9b640 1 -- 172.21.15.18:0/2283814407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cf41e4950 con 0x7f4cf40d5870 2024-09-19T09:14:20.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.989+0000 7f4cf17fa640 1 -- 172.21.15.18:0/2283814407 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4cec01a070 con 0x7f4cf40d5870 2024-09-19T09:14:20.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.990+0000 7f4cf17fa640 1 --2- 172.21.15.18:0/2283814407 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4ce006c2b0 0x7f4ce006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:20.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.990+0000 7f4cf17fa640 1 -- 172.21.15.18:0/2283814407 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5825+0+0 (secure 0 0 0) 0x7f4cec08b0e0 con 0x7f4cf40d5870 2024-09-19T09:14:20.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.990+0000 7f4cf17fa640 1 -- 172.21.15.18:0/2283814407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=36+}) -- 0x7f4ce0073f60 con 0x7f4cf40d5870 2024-09-19T09:14:20.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.990+0000 7f4cf8a37640 1 --2- 172.21.15.18:0/2283814407 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4ce006c2b0 0x7f4ce006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:20.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.991+0000 7f4cf8a37640 1 --2- 172.21.15.18:0/2283814407 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4ce006c2b0 0x7f4ce006e770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4034000 tx=0x7f4ce402c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:20.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:20.994+0000 7f4cf17fa640 1 -- 172.21.15.18:0/2283814407 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f4cf41e4950 con 0x7f4cf40d5870 2024-09-19T09:14:21.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.175+0000 7f4cfac9b640 1 -- 172.21.15.18:0/2283814407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) -- 0x7f4cf4069290 con 0x7f4cf40d5870 2024-09-19T09:14:21.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.865+0000 7f4cf17fa640 1 -- 172.21.15.18:0/2283814407 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v36) ==== 97+0+0 (secure 0 0 0) 0x7f4cf4069290 con 0x7f4cf40d5870 2024-09-19T09:14:21.866 INFO:teuthology.orchestra.run.smithi018.stderr:pauserd,pausewr is unset 2024-09-19T09:14:21.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.865+0000 7f4cf17fa640 1 -- 172.21.15.18:0/2283814407 <== mon.0 v2:172.21.15.18:3300/0 8 ==== osd_map(36..36 src has 1..36) ==== 288+0+0 (secure 0 0 0) 0x7f4cec0bfda0 con 0x7f4cf40d5870 2024-09-19T09:14:21.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.865+0000 7f4cf17fa640 1 -- 172.21.15.18:0/2283814407 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=37}) -- 0x7f4ce0074950 con 0x7f4cf40d5870 2024-09-19T09:14:21.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.868+0000 7f4cfac9b640 1 -- 172.21.15.18:0/2283814407 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4ce006c2b0 msgr2=0x7f4ce006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:21.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.868+0000 7f4cfac9b640 1 --2- 172.21.15.18:0/2283814407 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4ce006c2b0 0x7f4ce006e770 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4034000 tx=0x7f4ce402c000 comp rx=0 tx=0).stop 2024-09-19T09:14:21.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.868+0000 7f4cfac9b640 1 -- 172.21.15.18:0/2283814407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4cf40d5870 msgr2=0x7f4cf41e6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:21.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.868+0000 7f4cfac9b640 1 --2- 172.21.15.18:0/2283814407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4cf40d5870 0x7f4cf41e6e50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4cec00cbf0 tx=0x7f4cec00a430 comp rx=0 tx=0).stop 2024-09-19T09:14:21.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.869+0000 7f4cfac9b640 1 -- 172.21.15.18:0/2283814407 shutdown_connections 2024-09-19T09:14:21.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.869+0000 7f4cfac9b640 1 --2- 172.21.15.18:0/2283814407 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4ce006c2b0 0x7f4ce006e770 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:21.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.869+0000 7f4cfac9b640 1 --2- 172.21.15.18:0/2283814407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4cf40d5870 0x7f4cf41e6e50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:21.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.869+0000 7f4cfac9b640 1 --2- 172.21.15.18:0/2283814407 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4cf40d3230 0x7f4cf40c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:21.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.869+0000 7f4cfac9b640 1 --2- 172.21.15.18:0/2283814407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4cf40ba7e0 0x7f4cf41e2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:21.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.869+0000 7f4cfac9b640 1 -- 172.21.15.18:0/2283814407 >> 172.21.15.18:0/2283814407 conn(0x7f4cf40d4c70 msgr2=0x7f4cf406c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:21.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.869+0000 7f4cfac9b640 1 -- 172.21.15.18:0/2283814407 shutdown_connections 2024-09-19T09:14:21.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.869+0000 7f4cfac9b640 1 -- 172.21.15.18:0/2283814407 wait complete. 2024-09-19T09:14:21.882 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:14:21.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.989+0000 7fb69fee6640 1 Processor -- start 2024-09-19T09:14:21.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.990+0000 7fb69fee6640 1 -- start start 2024-09-19T09:14:21.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.990+0000 7fb69fee6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb69815ef50 0x7fb6980d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:21.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.990+0000 7fb69fee6640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb6980d3240 0x7fb6980d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:21.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.990+0000 7fb69fee6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6980b7a90 con 0x7fb6980d5780 2024-09-19T09:14:21.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.991+0000 7fb69fee6640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb6980d3740 con 0x7fb6980d3240 2024-09-19T09:14:21.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.991+0000 7fb69fee6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb6980d3a20 con 0x7fb69815ef50 2024-09-19T09:14:21.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.991+0000 7fb69d481640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb6980d3240 0x7fb6980d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:21.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.991+0000 7fb69e483640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fb6980d5780 0x7fb6980cf770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:46688/0 (socket says 172.21.15.18:46688) 2024-09-19T09:14:21.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.991+0000 7fb69e483640 1 -- 172.21.15.18:0/2319817721 learned_addr learned my addr 172.21.15.18:0/2319817721 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:21.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.991+0000 7fb69dc82640 1 --2- 172.21.15.18:0/2319817721 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb69815ef50 0x7fb6980d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:21.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.991+0000 7fb69d481640 1 -- 172.21.15.18:0/2319817721 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb69815ef50 msgr2=0x7fb6980d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:21.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.991+0000 7fb69d481640 1 --2- 172.21.15.18:0/2319817721 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb69815ef50 0x7fb6980d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:21.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.991+0000 7fb69d481640 1 -- 172.21.15.18:0/2319817721 >> v1:172.21.15.162:6789/0 conn(0x7fb6980d5780 legacy=0x7fb6980cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:21.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.991+0000 7fb69d481640 1 -- 172.21.15.18:0/2319817721 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6980b7d00 con 0x7fb6980d3240 2024-09-19T09:14:21.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.991+0000 7fb69cc80640 1 -- 172.21.15.18:0/2319817721 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3307832943 0 0) 0x7fb6980b7a90 con 0x7fb6980d5780 2024-09-19T09:14:21.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.991+0000 7fb69dc82640 1 --2- 172.21.15.18:0/2319817721 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb69815ef50 0x7fb6980d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:14:21.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.992+0000 7fb69d481640 1 --2- 172.21.15.18:0/2319817721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6980d3240 0x7fb6980d18e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb6880097a0 tx=0x7fb68802a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4806f3aee0b64e11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:21.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.992+0000 7fb69cc80640 1 -- 172.21.15.18:0/2319817721 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb688037070 con 0x7fb6980d3240 2024-09-19T09:14:21.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.992+0000 7fb69cc80640 1 -- 172.21.15.18:0/2319817721 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb68802ae50 con 0x7fb6980d3240 2024-09-19T09:14:21.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.992+0000 7fb69cc80640 1 -- 172.21.15.18:0/2319817721 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb688032660 con 0x7fb6980d3240 2024-09-19T09:14:21.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.993+0000 7fb69fee6640 1 -- 172.21.15.18:0/2319817721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6980d3240 msgr2=0x7fb6980d18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:21.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.993+0000 7fb69fee6640 1 --2- 172.21.15.18:0/2319817721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6980d3240 0x7fb6980d18e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb6880097a0 tx=0x7fb68802a100 comp rx=0 tx=0).stop 2024-09-19T09:14:21.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.993+0000 7fb69fee6640 1 -- 172.21.15.18:0/2319817721 shutdown_connections 2024-09-19T09:14:21.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.993+0000 7fb69fee6640 1 --2- 172.21.15.18:0/2319817721 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6980d3240 0x7fb6980d18e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:21.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.993+0000 7fb69fee6640 1 --2- 172.21.15.18:0/2319817721 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb69815ef50 0x7fb6980d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:21.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.993+0000 7fb69fee6640 1 -- 172.21.15.18:0/2319817721 >> 172.21.15.18:0/2319817721 conn(0x7fb6980d4c60 msgr2=0x7fb6980d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:21.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.993+0000 7fb69fee6640 1 -- 172.21.15.18:0/2319817721 shutdown_connections 2024-09-19T09:14:21.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.993+0000 7fb69fee6640 1 -- 172.21.15.18:0/2319817721 wait complete. 2024-09-19T09:14:21.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.994+0000 7fb69fee6640 1 Processor -- start 2024-09-19T09:14:21.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.994+0000 7fb69fee6640 1 -- start start 2024-09-19T09:14:21.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.995+0000 7fb69fee6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6980d3240 0x7fb69815d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:21.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.995+0000 7fb69fee6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6980d5780 0x7fb6981f44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:21.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.995+0000 7fb69fee6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb69815ef50 0x7fb698158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:21.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.995+0000 7fb69fee6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb6980d21a0 con 0x7fb6980d5780 2024-09-19T09:14:21.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.995+0000 7fb69fee6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb6980d2020 con 0x7fb6980d3240 2024-09-19T09:14:21.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.995+0000 7fb69fee6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb6980b9510 con 0x7fb69815ef50 2024-09-19T09:14:21.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.995+0000 7fb69d481640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6980d5780 0x7fb6981f44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:21.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.995+0000 7fb69d481640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6980d5780 0x7fb6981f44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55992/0 (socket says 172.21.15.18:55992) 2024-09-19T09:14:21.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.995+0000 7fb69d481640 1 -- 172.21.15.18:0/2144782240 learned_addr learned my addr 172.21.15.18:0/2144782240 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:21.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.995+0000 7fb69e483640 1 --2- 172.21.15.18:0/2144782240 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb69815ef50 0x7fb698158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:21.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.995+0000 7fb69dc82640 1 --2- 172.21.15.18:0/2144782240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6980d3240 0x7fb69815d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:21.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.995+0000 7fb69d481640 1 -- 172.21.15.18:0/2144782240 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb69815ef50 msgr2=0x7fb698158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:21.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.995+0000 7fb69d481640 1 --2- 172.21.15.18:0/2144782240 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb69815ef50 0x7fb698158970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:21.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.995+0000 7fb69d481640 1 -- 172.21.15.18:0/2144782240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6980d3240 msgr2=0x7fb69815d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:21.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.995+0000 7fb69d481640 1 --2- 172.21.15.18:0/2144782240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6980d3240 0x7fb69815d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:21.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.995+0000 7fb69d481640 1 -- 172.21.15.18:0/2144782240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb69815ad40 con 0x7fb6980d5780 2024-09-19T09:14:21.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.995+0000 7fb69e483640 1 --2- 172.21.15.18:0/2144782240 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb69815ef50 0x7fb698158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:21.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.996+0000 7fb69d481640 1 --2- 172.21.15.18:0/2144782240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6980d5780 0x7fb6981f44e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb688000c00 tx=0x7fb6880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:21.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.996+0000 7fb68e7fc640 1 -- 172.21.15.18:0/2144782240 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb688037040 con 0x7fb6980d5780 2024-09-19T09:14:21.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.996+0000 7fb69fee6640 1 -- 172.21.15.18:0/2144782240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb69815b020 con 0x7fb6980d5780 2024-09-19T09:14:21.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.996+0000 7fb68e7fc640 1 -- 172.21.15.18:0/2144782240 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb688004030 con 0x7fb6980d5780 2024-09-19T09:14:22.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.996+0000 7fb68e7fc640 1 -- 172.21.15.18:0/2144782240 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb688004400 con 0x7fb6980d5780 2024-09-19T09:14:22.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.996+0000 7fb69fee6640 1 -- 172.21.15.18:0/2144782240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb69815b5e0 con 0x7fb6980d5780 2024-09-19T09:14:22.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.997+0000 7fb69fee6640 1 -- 172.21.15.18:0/2144782240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6980d13a0 con 0x7fb6980d5780 2024-09-19T09:14:22.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.997+0000 7fb68e7fc640 1 -- 172.21.15.18:0/2144782240 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb688003610 con 0x7fb6980d5780 2024-09-19T09:14:22.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.998+0000 7fb68e7fc640 1 --2- 172.21.15.18:0/2144782240 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb67c06c2b0 0x7fb67c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:22.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.998+0000 7fb68e7fc640 1 -- 172.21.15.18:0/2144782240 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5825+0+0 (secure 0 0 0) 0x7fb6880ac240 con 0x7fb6980d5780 2024-09-19T09:14:22.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.998+0000 7fb69dc82640 1 --2- 172.21.15.18:0/2144782240 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb67c06c2b0 0x7fb67c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:22.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:21.998+0000 7fb69dc82640 1 --2- 172.21.15.18:0/2144782240 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb67c06c2b0 0x7fb67c06e770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb694009a30 tx=0x7fb694008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:22.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.002+0000 7fb68e7fc640 1 -- 172.21.15.18:0/2144782240 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb68807a8b0 con 0x7fb6980d5780 2024-09-19T09:14:22.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.177+0000 7fb69fee6640 1 -- 172.21.15.18:0/2144782240 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb6980b9940 con 0x7fb6980d5780 2024-09-19T09:14:22.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.178+0000 7fb68e7fc640 1 -- 172.21.15.18:0/2144782240 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+16930 (secure 0 0 0) 0x7fb68807a1b0 con 0x7fb6980d5780 2024-09-19T09:14:22.179 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:22.179 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":36,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:14:21.862743+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:14:05.064029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-19T09:14:06.144818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.0","mappings":[{"from":4,"to":5}]},{"pgid":"5.28","mappings":[{"from":4,"to":5}]},{"pgid":"5.33","mappings":[{"from":4,"to":5}]},{"pgid":"5.37","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:14:22.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.180+0000 7fb69fee6640 1 -- 172.21.15.18:0/2144782240 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb67c06c2b0 msgr2=0x7fb67c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:22.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.180+0000 7fb69fee6640 1 --2- 172.21.15.18:0/2144782240 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb67c06c2b0 0x7fb67c06e770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb694009a30 tx=0x7fb694008040 comp rx=0 tx=0).stop 2024-09-19T09:14:22.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.180+0000 7fb69fee6640 1 -- 172.21.15.18:0/2144782240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6980d5780 msgr2=0x7fb6981f44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:22.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.180+0000 7fb69fee6640 1 --2- 172.21.15.18:0/2144782240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6980d5780 0x7fb6981f44e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb688000c00 tx=0x7fb6880046c0 comp rx=0 tx=0).stop 2024-09-19T09:14:22.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.180+0000 7fb69fee6640 1 -- 172.21.15.18:0/2144782240 shutdown_connections 2024-09-19T09:14:22.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.180+0000 7fb69fee6640 1 --2- 172.21.15.18:0/2144782240 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb67c06c2b0 0x7fb67c06e770 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:22.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.180+0000 7fb69fee6640 1 --2- 172.21.15.18:0/2144782240 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb69815ef50 0x7fb698158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:22.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.180+0000 7fb69fee6640 1 --2- 172.21.15.18:0/2144782240 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6980d5780 0x7fb6981f44e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:22.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.180+0000 7fb69fee6640 1 --2- 172.21.15.18:0/2144782240 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6980d3240 0x7fb69815d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:22.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.180+0000 7fb69fee6640 1 -- 172.21.15.18:0/2144782240 >> 172.21.15.18:0/2144782240 conn(0x7fb6980d4c60 msgr2=0x7fb6980d15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:22.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.180+0000 7fb69fee6640 1 -- 172.21.15.18:0/2144782240 shutdown_connections 2024-09-19T09:14:22.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.180+0000 7fb69fee6640 1 -- 172.21.15.18:0/2144782240 wait complete. 2024-09-19T09:14:22.192 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-09-19T09:14:22.192 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-09-19T09:14:22.192 DEBUG:teuthology.orchestra.run.smithi018:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-19T09:14:22.192 DEBUG:teuthology.orchestra.run.smithi018:> os.fchmod(fd, 0O666) 2024-09-19T09:14:22.192 DEBUG:teuthology.orchestra.run.smithi018:> os.fsync(fd) 2024-09-19T09:14:22.192 DEBUG:teuthology.orchestra.run.smithi018:> os.close(fd) 2024-09-19T09:14:22.193 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-09-19T09:14:22.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:14:22.270 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:14:22.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:14:22.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:14:22.367 INFO:teuthology.orchestra.run.smithi018.stdout:client4679 2024-09-19T09:14:22.367 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/fec66d7e-50e5-42ed-81de-ad141a2f0f4e.client4679/osdmap') 2024-09-19T09:14:22.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:14:22.427 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 34 barrier 32 flags 0x588000 2024-09-19T09:14:22.427 INFO:teuthology.orchestra.run.smithi018.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-19T09:14:22.427 INFO:teuthology.orchestra.run.smithi018.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-19T09:14:22.427 INFO:teuthology.orchestra.run.smithi018.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-19T09:14:22.428 INFO:teuthology.orchestra.run.smithi018.stdout:osd0 (1)172.21.15.18:6809 100% (exists, up) 100% -1 2024-09-19T09:14:22.428 INFO:teuthology.orchestra.run.smithi018.stdout:osd1 (1)172.21.15.18:6817 100% (exists, up) 100% -1 2024-09-19T09:14:22.428 INFO:teuthology.orchestra.run.smithi018.stdout:osd2 (1)172.21.15.18:6801 100% (exists, up) 100% -1 2024-09-19T09:14:22.428 INFO:teuthology.orchestra.run.smithi018.stdout:osd3 (1)172.21.15.18:6825 100% (exists, up) 100% -1 2024-09-19T09:14:22.428 INFO:teuthology.orchestra.run.smithi018.stdout:osd4 (1)172.21.15.162:6824 100% (exists, up) 100% -1 2024-09-19T09:14:22.428 INFO:teuthology.orchestra.run.smithi018.stdout:osd5 (1)172.21.15.162:6801 100% (exists, up) 100% -1 2024-09-19T09:14:22.428 INFO:teuthology.orchestra.run.smithi018.stdout:osd6 (1)172.21.15.162:6809 100% (exists, up) 100% -1 2024-09-19T09:14:22.428 INFO:teuthology.orchestra.run.smithi018.stdout:osd7 (1)172.21.15.162:6817 100% (exists, up) 100% -1 2024-09-19T09:14:22.428 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 5.0 [4->5] 2024-09-19T09:14:22.428 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 5.28 [4->5] 2024-09-19T09:14:22.428 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 5.33 [4->5] 2024-09-19T09:14:22.428 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 5.37 [4->5] 2024-09-19T09:14:22.429 INFO:teuthology.orchestra.run.smithi018.stderr:1+1 records in 2024-09-19T09:14:22.429 INFO:teuthology.orchestra.run.smithi018.stderr:1+1 records out 2024-09-19T09:14:22.429 INFO:teuthology.orchestra.run.smithi018.stderr:902 bytes copied, 3.849e-05 s, 23.4 MB/s 2024-09-19T09:14:22.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:14:22.435 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:14:22.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.537+0000 7fbf05caf640 1 Processor -- start 2024-09-19T09:14:22.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.537+0000 7fbf05caf640 1 -- start start 2024-09-19T09:14:22.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.537+0000 7fbf05caf640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbf0015ef50 0x7fbf000d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:22.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.537+0000 7fbf05caf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf000d3240 0x7fbf000d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:22.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.537+0000 7fbf05caf640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf000b7a90 con 0x7fbf000d5780 2024-09-19T09:14:22.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.537+0000 7fbf05caf640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fbf000d3740 con 0x7fbf0015ef50 2024-09-19T09:14:22.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.537+0000 7fbf05caf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbf000d3a20 con 0x7fbf000d3240 2024-09-19T09:14:22.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.538+0000 7fbeff7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbf0015ef50 0x7fbf000d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:22.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.538+0000 7fbefffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fbf000d5780 0x7fbf000cf770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50760/0 (socket says 172.21.15.18:50760) 2024-09-19T09:14:22.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.538+0000 7fbefffff640 1 -- 172.21.15.18:0/3258941232 learned_addr learned my addr 172.21.15.18:0/3258941232 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:22.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.538+0000 7fbeff7fe640 1 -- 172.21.15.18:0/3258941232 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf000d3240 msgr2=0x7fbf000d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:22.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.538+0000 7fbefeffd640 1 --2- 172.21.15.18:0/3258941232 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf000d3240 0x7fbf000d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:22.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.538+0000 7fbeff7fe640 1 --2- 172.21.15.18:0/3258941232 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf000d3240 0x7fbf000d18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:22.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.538+0000 7fbeff7fe640 1 -- 172.21.15.18:0/3258941232 >> v1:172.21.15.18:6789/0 conn(0x7fbf000d5780 legacy=0x7fbf000cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:22.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.538+0000 7fbefe7fc640 1 -- 172.21.15.18:0/3258941232 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2360948679 0 0) 0x7fbf000b7a90 con 0x7fbf000d5780 2024-09-19T09:14:22.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.538+0000 7fbeff7fe640 1 -- 172.21.15.18:0/3258941232 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf000b7d00 con 0x7fbf0015ef50 2024-09-19T09:14:22.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.538+0000 7fbefeffd640 1 --2- 172.21.15.18:0/3258941232 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf000d3240 0x7fbf000d18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:14:22.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.539+0000 7fbeff7fe640 1 --2- 172.21.15.18:0/3258941232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf0015ef50 0x7fbf000d13a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbef00097a0 tx=0x7fbef002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b5be2a92d8fd3e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:22.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.539+0000 7fbefe7fc640 1 -- 172.21.15.18:0/3258941232 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef0037070 con 0x7fbf0015ef50 2024-09-19T09:14:22.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.539+0000 7fbefe7fc640 1 -- 172.21.15.18:0/3258941232 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbef002ae50 con 0x7fbf0015ef50 2024-09-19T09:14:22.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.539+0000 7fbefe7fc640 1 -- 172.21.15.18:0/3258941232 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef0032660 con 0x7fbf0015ef50 2024-09-19T09:14:22.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.539+0000 7fbf05caf640 1 -- 172.21.15.18:0/3258941232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf0015ef50 msgr2=0x7fbf000d13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:22.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.539+0000 7fbf05caf640 1 --2- 172.21.15.18:0/3258941232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf0015ef50 0x7fbf000d13a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbef00097a0 tx=0x7fbef002a100 comp rx=0 tx=0).stop 2024-09-19T09:14:22.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.539+0000 7fbf05caf640 1 -- 172.21.15.18:0/3258941232 shutdown_connections 2024-09-19T09:14:22.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.539+0000 7fbf05caf640 1 --2- 172.21.15.18:0/3258941232 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf000d3240 0x7fbf000d18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:22.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.539+0000 7fbf05caf640 1 --2- 172.21.15.18:0/3258941232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf0015ef50 0x7fbf000d13a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:22.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.539+0000 7fbf05caf640 1 -- 172.21.15.18:0/3258941232 >> 172.21.15.18:0/3258941232 conn(0x7fbf000d4c60 msgr2=0x7fbf000d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:22.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.539+0000 7fbf05caf640 1 -- 172.21.15.18:0/3258941232 shutdown_connections 2024-09-19T09:14:22.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.539+0000 7fbf05caf640 1 -- 172.21.15.18:0/3258941232 wait complete. 2024-09-19T09:14:22.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.541+0000 7fbf05caf640 1 Processor -- start 2024-09-19T09:14:22.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.541+0000 7fbf05caf640 1 -- start start 2024-09-19T09:14:22.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.541+0000 7fbf05caf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf000d3240 0x7fbf000cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:22.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.541+0000 7fbf05caf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf000d5780 0x7fbf0014f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:22.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.541+0000 7fbf05caf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf0015ef50 0x7fbf000cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:22.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.541+0000 7fbf05caf640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbf000d21a0 con 0x7fbf0015ef50 2024-09-19T09:14:22.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.541+0000 7fbf05caf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbf000d2020 con 0x7fbf000d5780 2024-09-19T09:14:22.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.542+0000 7fbf05caf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbf000b9510 con 0x7fbf000d3240 2024-09-19T09:14:22.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.542+0000 7fbefffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf0015ef50 0x7fbf000cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:22.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.542+0000 7fbefffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf0015ef50 0x7fbf000cdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56004/0 (socket says 172.21.15.18:56004) 2024-09-19T09:14:22.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.542+0000 7fbefffff640 1 -- 172.21.15.18:0/1856817079 learned_addr learned my addr 172.21.15.18:0/1856817079 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:22.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.542+0000 7fbeff7fe640 1 --2- 172.21.15.18:0/1856817079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf000d3240 0x7fbf000cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:22.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.542+0000 7fbefeffd640 1 --2- 172.21.15.18:0/1856817079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf000d5780 0x7fbf0014f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:22.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.542+0000 7fbefffff640 1 -- 172.21.15.18:0/1856817079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf000d3240 msgr2=0x7fbf000cb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:22.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.542+0000 7fbefffff640 1 --2- 172.21.15.18:0/1856817079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf000d3240 0x7fbf000cb3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:22.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.542+0000 7fbefffff640 1 -- 172.21.15.18:0/1856817079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf000d5780 msgr2=0x7fbf0014f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:22.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.542+0000 7fbefffff640 1 --2- 172.21.15.18:0/1856817079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf000d5780 0x7fbf0014f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:22.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.542+0000 7fbefffff640 1 -- 172.21.15.18:0/1856817079 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf000cb9c0 con 0x7fbf0015ef50 2024-09-19T09:14:22.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.542+0000 7fbefffff640 1 --2- 172.21.15.18:0/1856817079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf0015ef50 0x7fbf000cdd40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbef800c7d0 tx=0x7fbef800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:22.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.542+0000 7fbee7fff640 1 -- 172.21.15.18:0/1856817079 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef8018070 con 0x7fbf0015ef50 2024-09-19T09:14:22.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.542+0000 7fbee7fff640 1 -- 172.21.15.18:0/1856817079 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbef800a5e0 con 0x7fbf0015ef50 2024-09-19T09:14:22.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.542+0000 7fbf05caf640 1 -- 172.21.15.18:0/1856817079 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf00159c80 con 0x7fbf0015ef50 2024-09-19T09:14:22.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.542+0000 7fbee7fff640 1 -- 172.21.15.18:0/1856817079 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef800aa10 con 0x7fbf0015ef50 2024-09-19T09:14:22.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.542+0000 7fbf05caf640 1 -- 172.21.15.18:0/1856817079 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf0015a240 con 0x7fbf0015ef50 2024-09-19T09:14:22.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.543+0000 7fbf05caf640 1 -- 172.21.15.18:0/1856817079 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf0015a440 con 0x7fbf0015ef50 2024-09-19T09:14:22.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.544+0000 7fbee7fff640 1 -- 172.21.15.18:0/1856817079 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbef801b070 con 0x7fbf0015ef50 2024-09-19T09:14:22.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.544+0000 7fbee7fff640 1 --2- 172.21.15.18:0/1856817079 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbeec06c2e0 0x7fbeec06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:22.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.545+0000 7fbee7fff640 1 -- 172.21.15.18:0/1856817079 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5825+0+0 (secure 0 0 0) 0x7fbef808a9a0 con 0x7fbf0015ef50 2024-09-19T09:14:22.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.545+0000 7fbeff7fe640 1 --2- 172.21.15.18:0/1856817079 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbeec06c2e0 0x7fbeec06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:22.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.545+0000 7fbeff7fe640 1 --2- 172.21.15.18:0/1856817079 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbeec06c2e0 0x7fbeec06e7a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbef0034000 tx=0x7fbef002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:22.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.549+0000 7fbee7fff640 1 -- 172.21.15.18:0/1856817079 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fbf0015a440 con 0x7fbf0015ef50 2024-09-19T09:14:22.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.760+0000 7fbf05caf640 1 -- 172.21.15.18:0/1856817079 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf000d13a0 con 0x7fbf0015ef50 2024-09-19T09:14:22.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.761+0000 7fbee7fff640 1 -- 172.21.15.18:0/1856817079 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5229 (secure 0 0 0) 0x7fbef8059120 con 0x7fbf0015ef50 2024-09-19T09:14:22.761 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:22.761 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":13,"btime":"2024-09-19T09:14:09:822716+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1369179501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1369179501},{"type":"v1","addr":"172.21.15.18:6835","nonce":1369179501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4762,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2677647932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2677647932},{"type":"v1","addr":"172.21.15.162:6836","nonce":2677647932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4765,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3427373581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3427373581},{"type":"v1","addr":"172.21.15.162:6837","nonce":3427373581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:14:07.154707+0000","modified":"2024-09-19T09:14:09.169555+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4785},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4785":{"gid":4785,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6834/2895835717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2895835717},{"type":"v1","addr":"172.21.15.18:6834","nonce":2895835717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4785,"qdb_cluster":[4785]},"id":2}]} 2024-09-19T09:14:22.762 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 13 2024-09-19T09:14:22.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.763+0000 7fbf05caf640 1 -- 172.21.15.18:0/1856817079 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbeec06c2e0 msgr2=0x7fbeec06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:22.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.763+0000 7fbf05caf640 1 --2- 172.21.15.18:0/1856817079 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbeec06c2e0 0x7fbeec06e7a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbef0034000 tx=0x7fbef002e000 comp rx=0 tx=0).stop 2024-09-19T09:14:22.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.763+0000 7fbf05caf640 1 -- 172.21.15.18:0/1856817079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf0015ef50 msgr2=0x7fbf000cdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:22.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.763+0000 7fbf05caf640 1 --2- 172.21.15.18:0/1856817079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf0015ef50 0x7fbf000cdd40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbef800c7d0 tx=0x7fbef800cc90 comp rx=0 tx=0).stop 2024-09-19T09:14:22.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.763+0000 7fbf05caf640 1 -- 172.21.15.18:0/1856817079 shutdown_connections 2024-09-19T09:14:22.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.763+0000 7fbf05caf640 1 --2- 172.21.15.18:0/1856817079 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbeec06c2e0 0x7fbeec06e7a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:22.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.763+0000 7fbf05caf640 1 --2- 172.21.15.18:0/1856817079 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbf0015ef50 0x7fbf000cdd40 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:22.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.763+0000 7fbf05caf640 1 --2- 172.21.15.18:0/1856817079 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbf000d5780 0x7fbf0014f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:22.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.763+0000 7fbf05caf640 1 --2- 172.21.15.18:0/1856817079 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbf000d3240 0x7fbf000cb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:22.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.763+0000 7fbf05caf640 1 -- 172.21.15.18:0/1856817079 >> 172.21.15.18:0/1856817079 conn(0x7fbf000d4c60 msgr2=0x7fbf0006d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:22.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.763+0000 7fbf05caf640 1 -- 172.21.15.18:0/1856817079 shutdown_connections 2024-09-19T09:14:22.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22.763+0000 7fbf05caf640 1 -- 172.21.15.18:0/1856817079 wait complete. 2024-09-19T09:14:22.775 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json osdmap barrier 36 2024-09-19T09:14:22.895 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2024-09-19T09:14:22.895 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-09-19T09:14:22.896 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-09-19T09:14:22.896 DEBUG:teuthology.orchestra.run.smithi018:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-19T09:14:22.896 DEBUG:teuthology.orchestra.run.smithi018:> os.fchmod(fd, 0O666) 2024-09-19T09:14:22.896 DEBUG:teuthology.orchestra.run.smithi018:> os.fsync(fd) 2024-09-19T09:14:22.896 DEBUG:teuthology.orchestra.run.smithi018:> os.close(fd) 2024-09-19T09:14:22.896 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-09-19T09:14:22.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:14:22.975 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:14:23.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:14:23.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:14:23.073 INFO:teuthology.orchestra.run.smithi018.stdout:client4679 2024-09-19T09:14:23.073 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/fec66d7e-50e5-42ed-81de-ad141a2f0f4e.client4679/osdmap') 2024-09-19T09:14:23.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:14:23.133 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 36 barrier 36 flags 0x588000 2024-09-19T09:14:23.133 INFO:teuthology.orchestra.run.smithi018.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-19T09:14:23.133 INFO:teuthology.orchestra.run.smithi018.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-19T09:14:23.133 INFO:teuthology.orchestra.run.smithi018.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-19T09:14:23.133 INFO:teuthology.orchestra.run.smithi018.stdout:osd0 (1)172.21.15.18:6809 100% (exists, up) 100% -1 2024-09-19T09:14:23.133 INFO:teuthology.orchestra.run.smithi018.stdout:osd1 (1)172.21.15.18:6817 100% (exists, up) 100% -1 2024-09-19T09:14:23.133 INFO:teuthology.orchestra.run.smithi018.stdout:osd2 (1)172.21.15.18:6801 100% (exists, up) 100% -1 2024-09-19T09:14:23.133 INFO:teuthology.orchestra.run.smithi018.stdout:osd3 (1)172.21.15.18:6825 100% (exists, up) 100% -1 2024-09-19T09:14:23.133 INFO:teuthology.orchestra.run.smithi018.stdout:osd4 (1)172.21.15.162:6824 100% (exists, up) 100% -1 2024-09-19T09:14:23.133 INFO:teuthology.orchestra.run.smithi018.stdout:osd5 (1)172.21.15.162:6801 100% (exists, up) 100% -1 2024-09-19T09:14:23.134 INFO:teuthology.orchestra.run.smithi018.stdout:osd6 (1)172.21.15.162:6809 100% (exists, up) 100% -1 2024-09-19T09:14:23.134 INFO:teuthology.orchestra.run.smithi018.stdout:osd7 (1)172.21.15.162:6817 100% (exists, up) 100% -1 2024-09-19T09:14:23.134 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 5.0 [4->5] 2024-09-19T09:14:23.134 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 5.28 [4->5] 2024-09-19T09:14:23.134 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 5.33 [4->5] 2024-09-19T09:14:23.134 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 5.37 [4->5] 2024-09-19T09:14:23.134 INFO:teuthology.orchestra.run.smithi018.stderr:1+1 records in 2024-09-19T09:14:23.134 INFO:teuthology.orchestra.run.smithi018.stderr:1+1 records out 2024-09-19T09:14:23.134 INFO:teuthology.orchestra.run.smithi018.stderr:902 bytes copied, 3.7405e-05 s, 24.1 MB/s 2024-09-19T09:14:23.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:14:23.140 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:14:23.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:14:23.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:14:23.197 INFO:teuthology.orchestra.run.smithi018.stdout:client4679 2024-09-19T09:14:23.197 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/fec66d7e-50e5-42ed-81de-ad141a2f0f4e.client4679/osdmap') 2024-09-19T09:14:23.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:14:23.257 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 36 barrier 36 flags 0x588000 2024-09-19T09:14:23.257 INFO:teuthology.orchestra.run.smithi018.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-19T09:14:23.257 INFO:teuthology.orchestra.run.smithi018.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-19T09:14:23.257 INFO:teuthology.orchestra.run.smithi018.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-19T09:14:23.257 INFO:teuthology.orchestra.run.smithi018.stdout:osd0 (1)172.21.15.18:6809 100% (exists, up) 100% -1 2024-09-19T09:14:23.257 INFO:teuthology.orchestra.run.smithi018.stdout:osd1 (1)172.21.15.18:6817 100% (exists, up) 100% -1 2024-09-19T09:14:23.257 INFO:teuthology.orchestra.run.smithi018.stdout:osd2 (1)172.21.15.18:6801 100% (exists, up) 100% -1 2024-09-19T09:14:23.257 INFO:teuthology.orchestra.run.smithi018.stdout:osd3 (1)172.21.15.18:6825 100% (exists, up) 100% -1 2024-09-19T09:14:23.258 INFO:teuthology.orchestra.run.smithi018.stdout:osd4 (1)172.21.15.162:6824 100% (exists, up) 100% -1 2024-09-19T09:14:23.258 INFO:teuthology.orchestra.run.smithi018.stdout:osd5 (1)172.21.15.162:6801 100% (exists, up) 100% -1 2024-09-19T09:14:23.258 INFO:teuthology.orchestra.run.smithi018.stdout:osd6 (1)172.21.15.162:6809 100% (exists, up) 100% -1 2024-09-19T09:14:23.258 INFO:teuthology.orchestra.run.smithi018.stdout:osd7 (1)172.21.15.162:6817 100% (exists, up) 100% -1 2024-09-19T09:14:23.258 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 5.0 [4->5] 2024-09-19T09:14:23.258 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 5.28 [4->5] 2024-09-19T09:14:23.258 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 5.33 [4->5] 2024-09-19T09:14:23.258 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 5.37 [4->5] 2024-09-19T09:14:23.258 INFO:teuthology.orchestra.run.smithi018.stderr:1+1 records in 2024-09-19T09:14:23.258 INFO:teuthology.orchestra.run.smithi018.stderr:1+1 records out 2024-09-19T09:14:23.259 INFO:teuthology.orchestra.run.smithi018.stderr:902 bytes copied, 4.1865e-05 s, 21.5 MB/s 2024-09-19T09:14:23.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:14:23.264 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-19T09:14:23.264 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T09:14:23.265 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:14:23.309 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:14:23.357 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T09:14:23.357 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:14:23.357 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:14:23.358 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:14:23.374 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:14:23.374 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:14:23.431 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T09:14:23.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.574+0000 7f3a8030a640 1 Processor -- start 2024-09-19T09:14:23.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.574+0000 7f3a8030a640 1 -- start start 2024-09-19T09:14:23.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.575+0000 7f3a8030a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a7815ee60 0x7f3a7806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:23.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.575+0000 7f3a8030a640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a780d19b0 con 0x7f3a780b5180 2024-09-19T09:14:23.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.575+0000 7f3a8030a640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a780d1c90 con 0x7f3a7806de10 2024-09-19T09:14:23.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.575+0000 7f3a8030a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3a7815f240 con 0x7f3a7815ee60 2024-09-19T09:14:23.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.575+0000 7f3a7d8a5640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3a780b5180 0x7f3a7806d700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50764/0 (socket says 172.21.15.18:50764) 2024-09-19T09:14:23.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.575+0000 7f3a7d8a5640 1 -- 172.21.15.18:0/3260398320 learned_addr learned my addr 172.21.15.18:0/3260398320 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:23.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.576+0000 7f3a7e0a6640 1 --2- 172.21.15.18:0/3260398320 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a7815ee60 0x7f3a7806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:23.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.576+0000 7f3a7d0a4640 1 -- 172.21.15.18:0/3260398320 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2628011019 0 0) 0x7f3a780d19b0 con 0x7f3a780b5180 2024-09-19T09:14:23.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.576+0000 7f3a7d0a4640 1 -- 172.21.15.18:0/3260398320 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a60003520 con 0x7f3a780b5180 2024-09-19T09:14:23.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.576+0000 7f3a7d0a4640 1 -- 172.21.15.18:0/3260398320 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2009054256 0 0) 0x7f3a60003520 con 0x7f3a780b5180 2024-09-19T09:14:23.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.576+0000 7f3a7d0a4640 1 -- 172.21.15.18:0/3260398320 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a7815ee60 msgr2=0x7f3a7806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:23.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.576+0000 7f3a7d0a4640 1 --2- 172.21.15.18:0/3260398320 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a7815ee60 0x7f3a7806cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:23.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.576+0000 7f3a7d0a4640 1 -- 172.21.15.18:0/3260398320 >> v1:172.21.15.162:6789/0 conn(0x7f3a7806de10 legacy=0x7f3a780b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:23.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.576+0000 7f3a7d0a4640 1 -- 172.21.15.18:0/3260398320 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a780d1f70 con 0x7f3a780b5180 2024-09-19T09:14:23.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.576+0000 7f3a7d0a4640 1 -- 172.21.15.18:0/3260398320 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f3a6c001670 con 0x7f3a780b5180 2024-09-19T09:14:23.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.576+0000 7f3a7d0a4640 1 -- 172.21.15.18:0/3260398320 >> v1:172.21.15.18:6789/0 conn(0x7f3a780b5180 legacy=0x7f3a7806d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:23.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.576+0000 7f3a7d0a4640 1 --2- 172.21.15.18:0/3260398320 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a7815ee60 0x7f3a600039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:23.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.576+0000 7f3a7d0a4640 1 --2- 172.21.15.18:0/3260398320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a60003f20 0x7f3a60004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:23.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.576+0000 7f3a7d0a4640 1 --2- 172.21.15.18:0/3260398320 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a60004d40 0x7f3a600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:23.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.576+0000 7f3a7d0a4640 1 -- 172.21.15.18:0/3260398320 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3a7815f240 con 0x7f3a60003f20 2024-09-19T09:14:23.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.576+0000 7f3a7d0a4640 1 -- 172.21.15.18:0/3260398320 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6000ba20 con 0x7f3a60004d40 2024-09-19T09:14:23.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.576+0000 7f3a7d0a4640 1 -- 172.21.15.18:0/3260398320 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3a6000bc20 con 0x7f3a7815ee60 2024-09-19T09:14:23.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.576+0000 7f3a7d8a5640 1 --2- 172.21.15.18:0/3260398320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a60003f20 0x7f3a60004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:23.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.576+0000 7f3a7e0a6640 1 --2- 172.21.15.18:0/3260398320 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a7815ee60 0x7f3a600039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:23.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.576+0000 7f3a7e8a7640 1 --2- 172.21.15.18:0/3260398320 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a60004d40 0x7f3a600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:23.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.576+0000 7f3a7d8a5640 1 -- 172.21.15.18:0/3260398320 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a7815ee60 msgr2=0x7f3a600039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:23.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.576+0000 7f3a7d8a5640 1 --2- 172.21.15.18:0/3260398320 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a7815ee60 0x7f3a600039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:23.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.576+0000 7f3a7d8a5640 1 -- 172.21.15.18:0/3260398320 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a60004d40 msgr2=0x7f3a600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:23.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.576+0000 7f3a7d8a5640 1 --2- 172.21.15.18:0/3260398320 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a60004d40 0x7f3a600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:23.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.576+0000 7f3a7d8a5640 1 -- 172.21.15.18:0/3260398320 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a60003520 con 0x7f3a60003f20 2024-09-19T09:14:23.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.576+0000 7f3a7e8a7640 1 --2- 172.21.15.18:0/3260398320 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a60004d40 0x7f3a600051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:23.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.577+0000 7f3a7d8a5640 1 --2- 172.21.15.18:0/3260398320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a60003f20 0x7f3a60004800 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00c190 tx=0x7f3a60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a02c5d9600b980d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:23.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.577+0000 7f3a7d0a4640 1 -- 172.21.15.18:0/3260398320 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c007cc0 con 0x7f3a60003f20 2024-09-19T09:14:23.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.577+0000 7f3a7d0a4640 1 -- 172.21.15.18:0/3260398320 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a6c005ad0 con 0x7f3a60003f20 2024-09-19T09:14:23.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.577+0000 7f3a7d0a4640 1 -- 172.21.15.18:0/3260398320 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c02ae60 con 0x7f3a60003f20 2024-09-19T09:14:23.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.578+0000 7f3a8030a640 1 -- 172.21.15.18:0/3260398320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a60003f20 msgr2=0x7f3a60004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:23.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.578+0000 7f3a8030a640 1 --2- 172.21.15.18:0/3260398320 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a60003f20 0x7f3a60004800 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c00c190 tx=0x7f3a60005830 comp rx=0 tx=0).stop 2024-09-19T09:14:23.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.578+0000 7f3a7e8a7640 1 -- 172.21.15.18:0/3260398320 reap_dead start 2024-09-19T09:14:23.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.578+0000 7f3a8030a640 1 -- 172.21.15.18:0/3260398320 shutdown_connections 2024-09-19T09:14:23.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.578+0000 7f3a8030a640 1 -- 172.21.15.18:0/3260398320 >> 172.21.15.18:0/3260398320 conn(0x7f3a780b45f0 msgr2=0x7f3a780b4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:23.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.578+0000 7f3a8030a640 1 -- 172.21.15.18:0/3260398320 shutdown_connections 2024-09-19T09:14:23.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.578+0000 7f3a8030a640 1 -- 172.21.15.18:0/3260398320 wait complete. 2024-09-19T09:14:23.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.579+0000 7f3a8030a640 1 Processor -- start 2024-09-19T09:14:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.579+0000 7f3a8030a640 1 -- start start 2024-09-19T09:14:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.580+0000 7f3a8030a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a60003f20 0x7f3a781f8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.580+0000 7f3a8030a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a781f7b90 0x7f3a780b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.580+0000 7f3a8030a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a780b1e60 0x7f3a780c9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.580+0000 7f3a8030a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3a7806d0b0 con 0x7f3a780b1e60 2024-09-19T09:14:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.580+0000 7f3a8030a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3a7806cf30 con 0x7f3a60003f20 2024-09-19T09:14:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.580+0000 7f3a8030a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3a7806d230 con 0x7f3a781f7b90 2024-09-19T09:14:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.580+0000 7f3a7e8a7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a780b1e60 0x7f3a780c9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.580+0000 7f3a7e8a7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a780b1e60 0x7f3a780c9b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56012/0 (socket says 172.21.15.18:56012) 2024-09-19T09:14:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.580+0000 7f3a7e8a7640 1 -- 172.21.15.18:0/49182682 learned_addr learned my addr 172.21.15.18:0/49182682 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.580+0000 7f3a7e0a6640 1 --2- 172.21.15.18:0/49182682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a60003f20 0x7f3a781f8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.580+0000 7f3a7e8a7640 1 -- 172.21.15.18:0/49182682 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a781f7b90 msgr2=0x7f3a780b1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.580+0000 7f3a7e8a7640 1 --2- 172.21.15.18:0/49182682 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a781f7b90 0x7f3a780b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.580+0000 7f3a7e8a7640 1 -- 172.21.15.18:0/49182682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a60003f20 msgr2=0x7f3a781f8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.580+0000 7f3a7e8a7640 1 --2- 172.21.15.18:0/49182682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a60003f20 0x7f3a781f8a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.580+0000 7f3a7e8a7640 1 -- 172.21.15.18:0/49182682 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a781f5f90 con 0x7f3a780b1e60 2024-09-19T09:14:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.581+0000 7f3a7e8a7640 1 --2- 172.21.15.18:0/49182682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a780b1e60 0x7f3a780c9b90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3a78072aa0 tx=0x7f3a7000e890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.581+0000 7f3a76ffd640 1 -- 172.21.15.18:0/49182682 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a70019070 con 0x7f3a780b1e60 2024-09-19T09:14:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.581+0000 7f3a76ffd640 1 -- 172.21.15.18:0/49182682 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a700052e0 con 0x7f3a780b1e60 2024-09-19T09:14:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.581+0000 7f3a8030a640 1 -- 172.21.15.18:0/49182682 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a781f8fb0 con 0x7f3a780b1e60 2024-09-19T09:14:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.581+0000 7f3a76ffd640 1 -- 172.21.15.18:0/49182682 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a70003850 con 0x7f3a780b1e60 2024-09-19T09:14:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.581+0000 7f3a8030a640 1 -- 172.21.15.18:0/49182682 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a78160a80 con 0x7f3a780b1e60 2024-09-19T09:14:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.582+0000 7f3a8030a640 1 -- 172.21.15.18:0/49182682 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a780d1c90 con 0x7f3a780b1e60 2024-09-19T09:14:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.582+0000 7f3a76ffd640 1 -- 172.21.15.18:0/49182682 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3a7001c070 con 0x7f3a780b1e60 2024-09-19T09:14:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.583+0000 7f3a76ffd640 1 --2- 172.21.15.18:0/49182682 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3a6406c2e0 0x7f3a6406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.583+0000 7f3a76ffd640 1 -- 172.21.15.18:0/49182682 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5825+0+0 (secure 0 0 0) 0x7f3a7008a920 con 0x7f3a780b1e60 2024-09-19T09:14:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.583+0000 7f3a7e0a6640 1 --2- 172.21.15.18:0/49182682 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3a6406c2e0 0x7f3a6406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.583+0000 7f3a7e0a6640 1 --2- 172.21.15.18:0/49182682 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3a6406c2e0 0x7f3a6406e7a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3a68007440 tx=0x7f3a6800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.587+0000 7f3a76ffd640 1 -- 172.21.15.18:0/49182682 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3a781f5f90 con 0x7f3a780b1e60 2024-09-19T09:14:23.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.777+0000 7f3a8030a640 1 -- 172.21.15.18:0/49182682 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3a780cc360 con 0x7f3a780b1e60 2024-09-19T09:14:23.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.777+0000 7f3a76ffd640 1 -- 172.21.15.18:0/49182682 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) ==== 80+0+0 (secure 0 0 0) 0x7f3a700590a0 con 0x7f3a780b1e60 2024-09-19T09:14:23.778 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-09-19T09:14:23.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.779+0000 7f3a8030a640 1 -- 172.21.15.18:0/49182682 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3a6406c2e0 msgr2=0x7f3a6406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:23.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.779+0000 7f3a8030a640 1 --2- 172.21.15.18:0/49182682 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3a6406c2e0 0x7f3a6406e7a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3a68007440 tx=0x7f3a6800b040 comp rx=0 tx=0).stop 2024-09-19T09:14:23.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.779+0000 7f3a8030a640 1 -- 172.21.15.18:0/49182682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a780b1e60 msgr2=0x7f3a780c9b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:23.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.780+0000 7f3a8030a640 1 --2- 172.21.15.18:0/49182682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a780b1e60 0x7f3a780c9b90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3a78072aa0 tx=0x7f3a7000e890 comp rx=0 tx=0).stop 2024-09-19T09:14:23.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.780+0000 7f3a8030a640 1 -- 172.21.15.18:0/49182682 shutdown_connections 2024-09-19T09:14:23.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.780+0000 7f3a8030a640 1 --2- 172.21.15.18:0/49182682 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3a6406c2e0 0x7f3a6406e7a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:23.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.780+0000 7f3a8030a640 1 --2- 172.21.15.18:0/49182682 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a780b1e60 0x7f3a780c9b90 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:23.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.780+0000 7f3a8030a640 1 --2- 172.21.15.18:0/49182682 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a781f7b90 0x7f3a780b1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:23.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.780+0000 7f3a8030a640 1 --2- 172.21.15.18:0/49182682 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a60003f20 0x7f3a781f8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:23.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.780+0000 7f3a8030a640 1 -- 172.21.15.18:0/49182682 >> 172.21.15.18:0/49182682 conn(0x7f3a780b45f0 msgr2=0x7f3a780d2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:23.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.780+0000 7f3a8030a640 1 -- 172.21.15.18:0/49182682 shutdown_connections 2024-09-19T09:14:23.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:23.780+0000 7f3a8030a640 1 -- 172.21.15.18:0/49182682 wait complete. 2024-09-19T09:14:23.791 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T09:14:23.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:23.791 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-19T09:14:23.841 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T09:14:23.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:23.841 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T09:14:23.863 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:14:23.864 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:14:23.864 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:14:23.881 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:14:23.881 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:14:23.939 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T09:14:24.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.042+0000 7fb4d69f8640 1 Processor -- start 2024-09-19T09:14:24.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.042+0000 7fb4d69f8640 1 -- start start 2024-09-19T09:14:24.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.043+0000 7fb4d69f8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4d00d3400 0x7fb4d01618f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:24.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.043+0000 7fb4d69f8640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4d00d0aa0 con 0x7fb4d00ba7e0 2024-09-19T09:14:24.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.043+0000 7fb4d69f8640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4d00b7b60 con 0x7fb4d00d5870 2024-09-19T09:14:24.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.043+0000 7fb4d69f8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb4d00babc0 con 0x7fb4d00d3400 2024-09-19T09:14:24.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.043+0000 7fb4cffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb4d00ba7e0 0x7fb4d00d0220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50766/0 (socket says 172.21.15.18:50766) 2024-09-19T09:14:24.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.043+0000 7fb4cffff640 1 -- 172.21.15.18:0/730968235 learned_addr learned my addr 172.21.15.18:0/730968235 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:24.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.044+0000 7fb4d4f95640 1 --2- 172.21.15.18:0/730968235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4d00d3400 0x7fb4d01618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:24.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.044+0000 7fb4ceffd640 1 -- 172.21.15.18:0/730968235 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2087539778 0 0) 0x7fb4d00d0aa0 con 0x7fb4d00ba7e0 2024-09-19T09:14:24.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.044+0000 7fb4ceffd640 1 -- 172.21.15.18:0/730968235 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4b8003520 con 0x7fb4d00ba7e0 2024-09-19T09:14:24.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.044+0000 7fb4ceffd640 1 -- 172.21.15.18:0/730968235 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1706695943 0 0) 0x7fb4d00b7b60 con 0x7fb4d00d5870 2024-09-19T09:14:24.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.044+0000 7fb4ceffd640 1 -- 172.21.15.18:0/730968235 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4d00d0aa0 con 0x7fb4d00d5870 2024-09-19T09:14:24.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.044+0000 7fb4ceffd640 1 -- 172.21.15.18:0/730968235 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2501891463 0 0) 0x7fb4b8003520 con 0x7fb4d00ba7e0 2024-09-19T09:14:24.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.044+0000 7fb4d4f95640 1 -- 172.21.15.18:0/730968235 >> v1:172.21.15.162:6789/0 conn(0x7fb4d00d5870 legacy=0x7fb4d00d2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:24.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.044+0000 7fb4d4f95640 1 -- 172.21.15.18:0/730968235 >> v1:172.21.15.18:6789/0 conn(0x7fb4d00ba7e0 legacy=0x7fb4d00d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:24.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.044+0000 7fb4d4f95640 1 -- 172.21.15.18:0/730968235 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d00b7e40 con 0x7fb4d00d3400 2024-09-19T09:14:24.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.045+0000 7fb4d4f95640 1 --2- 172.21.15.18:0/730968235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4d00d3400 0x7fb4d01618f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8009dc0 tx=0x7fb4c802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97b0584d162b5465 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:24.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.045+0000 7fb4ceffd640 1 -- 172.21.15.18:0/730968235 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c0001670 con 0x7fb4d00d3400 2024-09-19T09:14:24.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.045+0000 7fb4ceffd640 1 -- 172.21.15.18:0/730968235 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4c8007540 con 0x7fb4d00d3400 2024-09-19T09:14:24.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.045+0000 7fb4ceffd640 1 -- 172.21.15.18:0/730968235 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8007910 con 0x7fb4d00d3400 2024-09-19T09:14:24.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.046+0000 7fb4d69f8640 1 -- 172.21.15.18:0/730968235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4d00d3400 msgr2=0x7fb4d01618f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:24.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.046+0000 7fb4d69f8640 1 --2- 172.21.15.18:0/730968235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4d00d3400 0x7fb4d01618f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8009dc0 tx=0x7fb4c802a660 comp rx=0 tx=0).stop 2024-09-19T09:14:24.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.046+0000 7fb4d69f8640 1 -- 172.21.15.18:0/730968235 shutdown_connections 2024-09-19T09:14:24.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.046+0000 7fb4d69f8640 1 --2- 172.21.15.18:0/730968235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4d00d3400 0x7fb4d01618f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:24.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.046+0000 7fb4d69f8640 1 -- 172.21.15.18:0/730968235 >> 172.21.15.18:0/730968235 conn(0x7fb4d00d4c70 msgr2=0x7fb4d00d5080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:24.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.046+0000 7fb4d69f8640 1 -- 172.21.15.18:0/730968235 shutdown_connections 2024-09-19T09:14:24.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.046+0000 7fb4d69f8640 1 -- 172.21.15.18:0/730968235 wait complete. 2024-09-19T09:14:24.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.047+0000 7fb4d69f8640 1 Processor -- start 2024-09-19T09:14:24.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.047+0000 7fb4d69f8640 1 -- start start 2024-09-19T09:14:24.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.048+0000 7fb4d69f8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4d00ba7e0 0x7fb4d01d5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:24.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.048+0000 7fb4d69f8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4d00d3400 0x7fb4d00b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:24.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.048+0000 7fb4d69f8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4d00d5870 0x7fb4d00c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:24.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.048+0000 7fb4d69f8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d00b9930 con 0x7fb4d00d5870 2024-09-19T09:14:24.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.048+0000 7fb4d69f8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb4d00b8400 con 0x7fb4d00d3400 2024-09-19T09:14:24.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.048+0000 7fb4d69f8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb4d00b9ab0 con 0x7fb4d00ba7e0 2024-09-19T09:14:24.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.048+0000 7fb4d4f95640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4d00d5870 0x7fb4d00c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:24.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.048+0000 7fb4d4f95640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4d00d5870 0x7fb4d00c9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56018/0 (socket says 172.21.15.18:56018) 2024-09-19T09:14:24.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.048+0000 7fb4d4f95640 1 -- 172.21.15.18:0/880148799 learned_addr learned my addr 172.21.15.18:0/880148799 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:24.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.048+0000 7fb4cffff640 1 --2- 172.21.15.18:0/880148799 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4d00ba7e0 0x7fb4d01d5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:24.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.048+0000 7fb4cf7fe640 1 --2- 172.21.15.18:0/880148799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4d00d3400 0x7fb4d00b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:24.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.048+0000 7fb4d4f95640 1 -- 172.21.15.18:0/880148799 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4d00ba7e0 msgr2=0x7fb4d01d5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:24.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.048+0000 7fb4d4f95640 1 --2- 172.21.15.18:0/880148799 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4d00ba7e0 0x7fb4d01d5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:24.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.048+0000 7fb4d4f95640 1 -- 172.21.15.18:0/880148799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4d00d3400 msgr2=0x7fb4d00b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:24.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.048+0000 7fb4d4f95640 1 --2- 172.21.15.18:0/880148799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4d00d3400 0x7fb4d00b42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:24.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.048+0000 7fb4d4f95640 1 -- 172.21.15.18:0/880148799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4d01d6320 con 0x7fb4d00d5870 2024-09-19T09:14:24.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.048+0000 7fb4d4f95640 1 --2- 172.21.15.18:0/880148799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4d00d5870 0x7fb4d00c9720 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8009dc0 tx=0x7fb4c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:24.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.049+0000 7fb4ccff9640 1 -- 172.21.15.18:0/880148799 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8040070 con 0x7fb4d00d5870 2024-09-19T09:14:24.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.049+0000 7fb4ccff9640 1 -- 172.21.15.18:0/880148799 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4c8031bc0 con 0x7fb4d00d5870 2024-09-19T09:14:24.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.049+0000 7fb4d69f8640 1 -- 172.21.15.18:0/880148799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4d00b4da0 con 0x7fb4d00d5870 2024-09-19T09:14:24.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.049+0000 7fb4ccff9640 1 -- 172.21.15.18:0/880148799 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8007e90 con 0x7fb4d00d5870 2024-09-19T09:14:24.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.049+0000 7fb4d69f8640 1 -- 172.21.15.18:0/880148799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4d00b5360 con 0x7fb4d00d5870 2024-09-19T09:14:24.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.050+0000 7fb4d69f8640 1 -- 172.21.15.18:0/880148799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4d00b56a0 con 0x7fb4d00d5870 2024-09-19T09:14:24.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.050+0000 7fb4ccff9640 1 -- 172.21.15.18:0/880148799 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb4c8039040 con 0x7fb4d00d5870 2024-09-19T09:14:24.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.050+0000 7fb4ccff9640 1 --2- 172.21.15.18:0/880148799 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb4bc06c2b0 0x7fb4bc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:24.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.051+0000 7fb4ccff9640 1 -- 172.21.15.18:0/880148799 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5825+0+0 (secure 0 0 0) 0x7fb4c80ac830 con 0x7fb4d00d5870 2024-09-19T09:14:24.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.051+0000 7fb4cffff640 1 --2- 172.21.15.18:0/880148799 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb4bc06c2b0 0x7fb4bc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:24.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.051+0000 7fb4cffff640 1 --2- 172.21.15.18:0/880148799 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb4bc06c2b0 0x7fb4bc06e770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb4c00017e0 tx=0x7fb4c0001610 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:24.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.055+0000 7fb4ccff9640 1 -- 172.21.15.18:0/880148799 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb4d00b56a0 con 0x7fb4d00d5870 2024-09-19T09:14:24.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.243+0000 7fb4d69f8640 1 -- 172.21.15.18:0/880148799 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb4d00d20c0 con 0x7fb4d00d5870 2024-09-19T09:14:24.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.243+0000 7fb4ccff9640 1 -- 172.21.15.18:0/880148799 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v36) ==== 80+0+0 (secure 0 0 0) 0x7fb4d01d6320 con 0x7fb4d00d5870 2024-09-19T09:14:24.243 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-09-19T09:14:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.245+0000 7fb4d69f8640 1 -- 172.21.15.18:0/880148799 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb4bc06c2b0 msgr2=0x7fb4bc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.245+0000 7fb4d69f8640 1 --2- 172.21.15.18:0/880148799 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb4bc06c2b0 0x7fb4bc06e770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb4c00017e0 tx=0x7fb4c0001610 comp rx=0 tx=0).stop 2024-09-19T09:14:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.245+0000 7fb4d69f8640 1 -- 172.21.15.18:0/880148799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4d00d5870 msgr2=0x7fb4d00c9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.245+0000 7fb4d69f8640 1 --2- 172.21.15.18:0/880148799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4d00d5870 0x7fb4d00c9720 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8009dc0 tx=0x7fb4c8004a40 comp rx=0 tx=0).stop 2024-09-19T09:14:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.245+0000 7fb4d69f8640 1 -- 172.21.15.18:0/880148799 shutdown_connections 2024-09-19T09:14:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.245+0000 7fb4d69f8640 1 --2- 172.21.15.18:0/880148799 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb4bc06c2b0 0x7fb4bc06e770 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.245+0000 7fb4d69f8640 1 --2- 172.21.15.18:0/880148799 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4d00d5870 0x7fb4d00c9720 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.245+0000 7fb4d69f8640 1 --2- 172.21.15.18:0/880148799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4d00d3400 0x7fb4d00b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.245+0000 7fb4d69f8640 1 --2- 172.21.15.18:0/880148799 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4d00ba7e0 0x7fb4d01d5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.245+0000 7fb4d69f8640 1 -- 172.21.15.18:0/880148799 >> 172.21.15.18:0/880148799 conn(0x7fb4d00d4c70 msgr2=0x7fb4d00d0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:24.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.245+0000 7fb4d69f8640 1 -- 172.21.15.18:0/880148799 shutdown_connections 2024-09-19T09:14:24.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.245+0000 7fb4d69f8640 1 -- 172.21.15.18:0/880148799 wait complete. 2024-09-19T09:14:24.257 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-19T09:14:24.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:24.257 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-19T09:14:24.288 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-09-19T09:14:24.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:24.288 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-19T09:14:24.345 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:14:24.346 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:14:24.346 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:14:24.362 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17075 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T09:14:24.362 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:14:24.363 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:14:24.363 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:14:24.403 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3252 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T09:14:24.403 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:14:24.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.506+0000 7f19a0ed0640 1 Processor -- start 2024-09-19T09:14:24.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.506+0000 7f19a0ed0640 1 -- start start 2024-09-19T09:14:24.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.506+0000 7f19a0ed0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f199c15ef80 0x7f199c0b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:24.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.507+0000 7f19a0ed0640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f199c0cd1a0 con 0x7f199c06d730 2024-09-19T09:14:24.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.507+0000 7f19a0ed0640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f199c06dc30 con 0x7f199c0cfae0 2024-09-19T09:14:24.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.507+0000 7f19a0ed0640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f199c0cd7d0 con 0x7f199c15ef80 2024-09-19T09:14:24.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.507+0000 7f199a59c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f199c15ef80 0x7f199c0b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:24.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.507+0000 7f1991d9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f199c06d730 0x7f199c0cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50780/0 (socket says 172.21.15.18:50780) 2024-09-19T09:14:24.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.507+0000 7f1991d9b640 1 -- 172.21.15.18:0/1581630660 learned_addr learned my addr 172.21.15.18:0/1581630660 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:24.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.507+0000 7f199a59c640 1 -- 172.21.15.18:0/1581630660 >> v1:172.21.15.162:6789/0 conn(0x7f199c0cfae0 legacy=0x7f199c0cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:24.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.507+0000 7f199a59c640 1 -- 172.21.15.18:0/1581630660 >> v1:172.21.15.18:6789/0 conn(0x7f199c06d730 legacy=0x7f199c0cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:24.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.507+0000 7f199a59c640 1 -- 172.21.15.18:0/1581630660 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f199c06df10 con 0x7f199c15ef80 2024-09-19T09:14:24.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.508+0000 7f199a59c640 1 --2- 172.21.15.18:0/1581630660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f199c15ef80 0x7f199c0b5220 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f198c0097a0 tx=0x7f198c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f418085bdb3d4b1c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:24.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.508+0000 7f1999d9b640 1 -- 172.21.15.18:0/1581630660 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198c037070 con 0x7f199c15ef80 2024-09-19T09:14:24.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.508+0000 7f1999d9b640 1 -- 172.21.15.18:0/1581630660 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f198c032440 con 0x7f199c15ef80 2024-09-19T09:14:24.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.508+0000 7f1999d9b640 1 -- 172.21.15.18:0/1581630660 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198c032810 con 0x7f199c15ef80 2024-09-19T09:14:24.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.508+0000 7f19a0ed0640 1 -- 172.21.15.18:0/1581630660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f199c15ef80 msgr2=0x7f199c0b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:24.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.508+0000 7f19a0ed0640 1 --2- 172.21.15.18:0/1581630660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f199c15ef80 0x7f199c0b5220 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f198c0097a0 tx=0x7f198c02a1e0 comp rx=0 tx=0).stop 2024-09-19T09:14:24.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.508+0000 7f19a0ed0640 1 -- 172.21.15.18:0/1581630660 shutdown_connections 2024-09-19T09:14:24.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.508+0000 7f19a0ed0640 1 --2- 172.21.15.18:0/1581630660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f199c15ef80 0x7f199c0b5220 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:24.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.508+0000 7f19a0ed0640 1 -- 172.21.15.18:0/1581630660 >> 172.21.15.18:0/1581630660 conn(0x7f199c0b4700 msgr2=0x7f199c0b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:24.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.508+0000 7f19a0ed0640 1 -- 172.21.15.18:0/1581630660 shutdown_connections 2024-09-19T09:14:24.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.508+0000 7f19a0ed0640 1 -- 172.21.15.18:0/1581630660 wait complete. 2024-09-19T09:14:24.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.510+0000 7f19a0ed0640 1 Processor -- start 2024-09-19T09:14:24.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.510+0000 7f19a0ed0640 1 -- start start 2024-09-19T09:14:24.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.511+0000 7f19a0ed0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f199c06d730 0x7f199c0a07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:24.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.511+0000 7f19a0ed0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f199c0cfae0 0x7f199c1f6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:24.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.511+0000 7f19a0ed0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f199c15ef80 0x7f199c1f58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:24.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.511+0000 7f19a0ed0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f199c0d0120 con 0x7f199c0cfae0 2024-09-19T09:14:24.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.511+0000 7f19a0ed0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f199c15f360 con 0x7f199c15ef80 2024-09-19T09:14:24.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.511+0000 7f19a0ed0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f199c0ce370 con 0x7f199c06d730 2024-09-19T09:14:24.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.511+0000 7f1991d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f199c0cfae0 0x7f199c1f6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:24.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.511+0000 7f1991d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f199c0cfae0 0x7f199c1f6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56042/0 (socket says 172.21.15.18:56042) 2024-09-19T09:14:24.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.511+0000 7f1991d9b640 1 -- 172.21.15.18:0/1581158248 learned_addr learned my addr 172.21.15.18:0/1581158248 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:24.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.511+0000 7f199a59c640 1 --2- 172.21.15.18:0/1581158248 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f199c06d730 0x7f199c0a07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:24.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.511+0000 7f199ad9d640 1 --2- 172.21.15.18:0/1581158248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f199c15ef80 0x7f199c1f58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:24.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.511+0000 7f1991d9b640 1 -- 172.21.15.18:0/1581158248 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f199c06d730 msgr2=0x7f199c0a07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:24.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.511+0000 7f1991d9b640 1 --2- 172.21.15.18:0/1581158248 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f199c06d730 0x7f199c0a07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:24.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.511+0000 7f1991d9b640 1 -- 172.21.15.18:0/1581158248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f199c15ef80 msgr2=0x7f199c1f58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:24.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.511+0000 7f1991d9b640 1 --2- 172.21.15.18:0/1581158248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f199c15ef80 0x7f199c1f58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:24.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.511+0000 7f1991d9b640 1 -- 172.21.15.18:0/1581158248 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f199c0c8b30 con 0x7f199c0cfae0 2024-09-19T09:14:24.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.511+0000 7f1991d9b640 1 --2- 172.21.15.18:0/1581158248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f199c0cfae0 0x7f199c1f6010 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f198400c400 tx=0x7f198400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:24.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.511+0000 7f19937fe640 1 -- 172.21.15.18:0/1581158248 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1984017070 con 0x7f199c0cfae0 2024-09-19T09:14:24.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.512+0000 7f19937fe640 1 -- 172.21.15.18:0/1581158248 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1984005ce0 con 0x7f199c0cfae0 2024-09-19T09:14:24.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.512+0000 7f19a0ed0640 1 -- 172.21.15.18:0/1581158248 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f199c1f6550 con 0x7f199c0cfae0 2024-09-19T09:14:24.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.512+0000 7f19937fe640 1 -- 172.21.15.18:0/1581158248 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19840072f0 con 0x7f199c0cfae0 2024-09-19T09:14:24.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.512+0000 7f19a0ed0640 1 -- 172.21.15.18:0/1581158248 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f199c0ca0e0 con 0x7f199c0cfae0 2024-09-19T09:14:24.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.513+0000 7f19a0ed0640 1 -- 172.21.15.18:0/1581158248 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f199c0cff00 con 0x7f199c0cfae0 2024-09-19T09:14:24.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.513+0000 7f19937fe640 1 -- 172.21.15.18:0/1581158248 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f198401a070 con 0x7f199c0cfae0 2024-09-19T09:14:24.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.514+0000 7f19937fe640 1 --2- 172.21.15.18:0/1581158248 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f197c06c2b0 0x7f197c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:24.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.514+0000 7f19937fe640 1 -- 172.21.15.18:0/1581158248 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5825+0+0 (secure 0 0 0) 0x7f198408a830 con 0x7f199c0cfae0 2024-09-19T09:14:24.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.514+0000 7f199a59c640 1 --2- 172.21.15.18:0/1581158248 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f197c06c2b0 0x7f197c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:24.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.514+0000 7f199a59c640 1 --2- 172.21.15.18:0/1581158248 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f197c06c2b0 0x7f197c06e770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f198c034000 tx=0x7f198c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:24.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.518+0000 7f19937fe640 1 -- 172.21.15.18:0/1581158248 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f19840588d0 con 0x7f199c0cfae0 2024-09-19T09:14:24.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.732+0000 7f19a0ed0640 1 -- 172.21.15.18:0/1581158248 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f199c0b4c80 con 0x7f199c0cfae0 2024-09-19T09:14:24.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.732+0000 7f19937fe640 1 -- 172.21.15.18:0/1581158248 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5229 (secure 0 0 0) 0x7f198405cbd0 con 0x7f199c0cfae0 2024-09-19T09:14:24.733 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:24.733 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":13,"btime":"2024-09-19T09:14:09:822716+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1369179501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1369179501},{"type":"v1","addr":"172.21.15.18:6835","nonce":1369179501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4762,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2677647932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2677647932},{"type":"v1","addr":"172.21.15.162:6836","nonce":2677647932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4765,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3427373581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3427373581},{"type":"v1","addr":"172.21.15.162:6837","nonce":3427373581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:14:07.154707+0000","modified":"2024-09-19T09:14:09.169555+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4785},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4785":{"gid":4785,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6834/2895835717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2895835717},{"type":"v1","addr":"172.21.15.18:6834","nonce":2895835717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4785,"qdb_cluster":[4785]},"id":2}]} 2024-09-19T09:14:24.733 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 13 2024-09-19T09:14:24.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.734+0000 7f19a0ed0640 1 -- 172.21.15.18:0/1581158248 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f197c06c2b0 msgr2=0x7f197c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:24.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.734+0000 7f19a0ed0640 1 --2- 172.21.15.18:0/1581158248 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f197c06c2b0 0x7f197c06e770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f198c034000 tx=0x7f198c02e000 comp rx=0 tx=0).stop 2024-09-19T09:14:24.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.734+0000 7f19a0ed0640 1 -- 172.21.15.18:0/1581158248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f199c0cfae0 msgr2=0x7f199c1f6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:24.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.734+0000 7f19a0ed0640 1 --2- 172.21.15.18:0/1581158248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f199c0cfae0 0x7f199c1f6010 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f198400c400 tx=0x7f198400c8c0 comp rx=0 tx=0).stop 2024-09-19T09:14:24.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.734+0000 7f19a0ed0640 1 -- 172.21.15.18:0/1581158248 shutdown_connections 2024-09-19T09:14:24.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.734+0000 7f19a0ed0640 1 --2- 172.21.15.18:0/1581158248 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f197c06c2b0 0x7f197c06e770 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:24.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.734+0000 7f19a0ed0640 1 --2- 172.21.15.18:0/1581158248 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f199c15ef80 0x7f199c1f58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:24.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.734+0000 7f19a0ed0640 1 --2- 172.21.15.18:0/1581158248 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f199c0cfae0 0x7f199c1f6010 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:24.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.734+0000 7f19a0ed0640 1 --2- 172.21.15.18:0/1581158248 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f199c06d730 0x7f199c0a07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:24.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.734+0000 7f19a0ed0640 1 -- 172.21.15.18:0/1581158248 >> 172.21.15.18:0/1581158248 conn(0x7f199c0b4700 msgr2=0x7f199c0cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:24.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.734+0000 7f19a0ed0640 1 -- 172.21.15.18:0/1581158248 shutdown_connections 2024-09-19T09:14:24.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.734+0000 7f19a0ed0640 1 -- 172.21.15.18:0/1581158248 wait complete. 2024-09-19T09:14:24.746 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:14:24.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.848+0000 7ffab79c4640 1 Processor -- start 2024-09-19T09:14:24.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.848+0000 7ffab79c4640 1 -- start start 2024-09-19T09:14:24.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.849+0000 7ffab79c4640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ffab0160300 0x7ffab00cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:24.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.849+0000 7ffab79c4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ffab00708f0 0x7ffab00cd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:24.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.849+0000 7ffab79c4640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffab00d0050 con 0x7ffab00d1ed0 2024-09-19T09:14:24.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.849+0000 7ffab79c4640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7ffab00d0330 con 0x7ffab00708f0 2024-09-19T09:14:24.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.849+0000 7ffab79c4640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ffab00d1420 con 0x7ffab0160300 2024-09-19T09:14:24.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.849+0000 7ffab5f61640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ffab00708f0 0x7ffab00cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:24.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.849+0000 7ffab4f5f640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ffab00d1ed0 0x7ffab00cf810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50788/0 (socket says 172.21.15.18:50788) 2024-09-19T09:14:24.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.849+0000 7ffab4f5f640 1 -- 172.21.15.18:0/3406275779 learned_addr learned my addr 172.21.15.18:0/3406275779 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:24.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.849+0000 7ffab5f61640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ffab00708f0 0x7ffab00cd730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56044/0 (socket says 172.21.15.18:56044) 2024-09-19T09:14:24.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.849+0000 7ffab5760640 1 --2- 172.21.15.18:0/3406275779 >> v2:172.21.15.162:3300/0 conn(0x7ffab0160300 0x7ffab00cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:24.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.849+0000 7ffab5f61640 1 -- 172.21.15.18:0/3406275779 >> v2:172.21.15.162:3300/0 conn(0x7ffab0160300 msgr2=0x7ffab00cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:24.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.849+0000 7ffab5f61640 1 --2- 172.21.15.18:0/3406275779 >> v2:172.21.15.162:3300/0 conn(0x7ffab0160300 0x7ffab00cf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:24.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.849+0000 7ffab5f61640 1 -- 172.21.15.18:0/3406275779 >> v1:172.21.15.18:6789/0 conn(0x7ffab00d1ed0 legacy=0x7ffab00cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:24.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.849+0000 7ffab5f61640 1 -- 172.21.15.18:0/3406275779 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab00d1700 con 0x7ffab00708f0 2024-09-19T09:14:24.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.849+0000 7ffab5760640 1 --2- 172.21.15.18:0/3406275779 >> v2:172.21.15.162:3300/0 conn(0x7ffab0160300 0x7ffab00cf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:24.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.850+0000 7ffab5f61640 1 --2- 172.21.15.18:0/3406275779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffab00708f0 0x7ffab00cd730 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ffab0072570 tx=0x7ffaa802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd8cfe36f0da7085 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:24.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.850+0000 7ffaa3fff640 1 -- 172.21.15.18:0/3406275779 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8007740 con 0x7ffab00708f0 2024-09-19T09:14:24.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.850+0000 7ffaa3fff640 1 -- 172.21.15.18:0/3406275779 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaa80078e0 con 0x7ffab00708f0 2024-09-19T09:14:24.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.850+0000 7ffaa3fff640 1 -- 172.21.15.18:0/3406275779 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa8007cb0 con 0x7ffab00708f0 2024-09-19T09:14:24.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.851+0000 7ffab79c4640 1 -- 172.21.15.18:0/3406275779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffab00708f0 msgr2=0x7ffab00cd730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:24.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.851+0000 7ffab79c4640 1 --2- 172.21.15.18:0/3406275779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffab00708f0 0x7ffab00cd730 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ffab0072570 tx=0x7ffaa802a5f0 comp rx=0 tx=0).stop 2024-09-19T09:14:24.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.851+0000 7ffab79c4640 1 -- 172.21.15.18:0/3406275779 shutdown_connections 2024-09-19T09:14:24.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.851+0000 7ffab79c4640 1 --2- 172.21.15.18:0/3406275779 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffab00708f0 0x7ffab00cd730 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:24.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.851+0000 7ffab79c4640 1 --2- 172.21.15.18:0/3406275779 >> v2:172.21.15.162:3300/0 conn(0x7ffab0160300 0x7ffab00cf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:24.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.851+0000 7ffab79c4640 1 -- 172.21.15.18:0/3406275779 >> 172.21.15.18:0/3406275779 conn(0x7ffab00b4600 msgr2=0x7ffab00b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:24.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.851+0000 7ffab79c4640 1 -- 172.21.15.18:0/3406275779 shutdown_connections 2024-09-19T09:14:24.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.851+0000 7ffab79c4640 1 -- 172.21.15.18:0/3406275779 wait complete. 2024-09-19T09:14:24.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.852+0000 7ffab79c4640 1 Processor -- start 2024-09-19T09:14:24.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.852+0000 7ffab79c4640 1 -- start start 2024-09-19T09:14:24.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.853+0000 7ffab79c4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffab00708f0 0x7ffab014bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:24.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.853+0000 7ffab79c4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffab00d1ed0 0x7ffab00b3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:24.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.853+0000 7ffab79c4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffab0160300 0x7ffab00b3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:24.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.853+0000 7ffab79c4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ffab01606e0 con 0x7ffab00708f0 2024-09-19T09:14:24.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.853+0000 7ffab79c4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffab00b54a0 con 0x7ffab0160300 2024-09-19T09:14:24.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.853+0000 7ffab79c4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ffab0160860 con 0x7ffab00d1ed0 2024-09-19T09:14:24.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.853+0000 7ffab5760640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffab00708f0 0x7ffab014bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:24.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.853+0000 7ffab5760640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffab00708f0 0x7ffab014bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56054/0 (socket says 172.21.15.18:56054) 2024-09-19T09:14:24.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.853+0000 7ffab5760640 1 -- 172.21.15.18:0/1928350747 learned_addr learned my addr 172.21.15.18:0/1928350747 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:24.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.853+0000 7ffab5f61640 1 --2- 172.21.15.18:0/1928350747 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffab0160300 0x7ffab00b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:24.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.853+0000 7ffab4f5f640 1 --2- 172.21.15.18:0/1928350747 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffab00d1ed0 0x7ffab00b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:24.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.853+0000 7ffab5760640 1 -- 172.21.15.18:0/1928350747 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffab00d1ed0 msgr2=0x7ffab00b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:24.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.853+0000 7ffab5760640 1 --2- 172.21.15.18:0/1928350747 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffab00d1ed0 0x7ffab00b3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:24.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.853+0000 7ffab5760640 1 -- 172.21.15.18:0/1928350747 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffab0160300 msgr2=0x7ffab00b3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:24.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.853+0000 7ffab5760640 1 --2- 172.21.15.18:0/1928350747 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffab0160300 0x7ffab00b3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:24.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.853+0000 7ffab5760640 1 -- 172.21.15.18:0/1928350747 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab014c3e0 con 0x7ffab00708f0 2024-09-19T09:14:24.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.853+0000 7ffab5f61640 1 --2- 172.21.15.18:0/1928350747 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffab0160300 0x7ffab00b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:24.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.854+0000 7ffab5760640 1 --2- 172.21.15.18:0/1928350747 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffab00708f0 0x7ffab014bea0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400d7d0 tx=0x7ffaa400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:24.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.854+0000 7ffaa1ffb640 1 -- 172.21.15.18:0/1928350747 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa4004030 con 0x7ffab00708f0 2024-09-19T09:14:24.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.854+0000 7ffaa1ffb640 1 -- 172.21.15.18:0/1928350747 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaa40041d0 con 0x7ffab00708f0 2024-09-19T09:14:24.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.854+0000 7ffab79c4640 1 -- 172.21.15.18:0/1928350747 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffab00c6720 con 0x7ffab00708f0 2024-09-19T09:14:24.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.854+0000 7ffaa1ffb640 1 -- 172.21.15.18:0/1928350747 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaa40096a0 con 0x7ffab00708f0 2024-09-19T09:14:24.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.854+0000 7ffab79c4640 1 -- 172.21.15.18:0/1928350747 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffab00c6ce0 con 0x7ffab00708f0 2024-09-19T09:14:24.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.855+0000 7ffab79c4640 1 -- 172.21.15.18:0/1928350747 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffab00cf2d0 con 0x7ffab00708f0 2024-09-19T09:14:24.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.855+0000 7ffaa1ffb640 1 -- 172.21.15.18:0/1928350747 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ffaa4009840 con 0x7ffab00708f0 2024-09-19T09:14:24.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.856+0000 7ffaa1ffb640 1 --2- 172.21.15.18:0/1928350747 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ffa9406c2b0 0x7ffa9406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:24.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.856+0000 7ffaa1ffb640 1 -- 172.21.15.18:0/1928350747 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5825+0+0 (secure 0 0 0) 0x7ffaa408b770 con 0x7ffab00708f0 2024-09-19T09:14:24.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.856+0000 7ffab4f5f640 1 --2- 172.21.15.18:0/1928350747 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ffa9406c2b0 0x7ffa9406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:24.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.856+0000 7ffab4f5f640 1 --2- 172.21.15.18:0/1928350747 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ffa9406c2b0 0x7ffa9406e770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffab014f850 tx=0x7ffaac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:24.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:24.860+0000 7ffaa1ffb640 1 -- 172.21.15.18:0/1928350747 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ffab014c3e0 con 0x7ffab00708f0 2024-09-19T09:14:25.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.075+0000 7ffab79c4640 1 -- 172.21.15.18:0/1928350747 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffab0068740 con 0x7ffab00708f0 2024-09-19T09:14:25.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.075+0000 7ffaa1ffb640 1 -- 172.21.15.18:0/1928350747 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5229 (secure 0 0 0) 0x7ffaa4059e60 con 0x7ffab00708f0 2024-09-19T09:14:25.076 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:25.076 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":13,"btime":"2024-09-19T09:14:09:822716+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1369179501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1369179501},{"type":"v1","addr":"172.21.15.18:6835","nonce":1369179501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4762,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2677647932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2677647932},{"type":"v1","addr":"172.21.15.162:6836","nonce":2677647932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4765,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3427373581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3427373581},{"type":"v1","addr":"172.21.15.162:6837","nonce":3427373581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:14:07.154707+0000","modified":"2024-09-19T09:14:09.169555+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4785},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4785":{"gid":4785,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6834/2895835717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2895835717},{"type":"v1","addr":"172.21.15.18:6834","nonce":2895835717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4785,"qdb_cluster":[4785]},"id":2}]} 2024-09-19T09:14:25.076 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 13 2024-09-19T09:14:25.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.078+0000 7ffab79c4640 1 -- 172.21.15.18:0/1928350747 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ffa9406c2b0 msgr2=0x7ffa9406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:25.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.078+0000 7ffab79c4640 1 --2- 172.21.15.18:0/1928350747 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ffa9406c2b0 0x7ffa9406e770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ffab014f850 tx=0x7ffaac009040 comp rx=0 tx=0).stop 2024-09-19T09:14:25.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.078+0000 7ffab79c4640 1 -- 172.21.15.18:0/1928350747 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffab00708f0 msgr2=0x7ffab014bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:25.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.078+0000 7ffab79c4640 1 --2- 172.21.15.18:0/1928350747 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffab00708f0 0x7ffab014bea0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ffaa400d7d0 tx=0x7ffaa400dc90 comp rx=0 tx=0).stop 2024-09-19T09:14:25.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.078+0000 7ffab79c4640 1 -- 172.21.15.18:0/1928350747 shutdown_connections 2024-09-19T09:14:25.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.078+0000 7ffab79c4640 1 --2- 172.21.15.18:0/1928350747 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ffa9406c2b0 0x7ffa9406e770 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.078+0000 7ffab79c4640 1 --2- 172.21.15.18:0/1928350747 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffab0160300 0x7ffab00b3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.078+0000 7ffab79c4640 1 --2- 172.21.15.18:0/1928350747 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ffab00d1ed0 0x7ffab00b3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.078+0000 7ffab79c4640 1 --2- 172.21.15.18:0/1928350747 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ffab00708f0 0x7ffab014bea0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.078+0000 7ffab79c4640 1 -- 172.21.15.18:0/1928350747 >> 172.21.15.18:0/1928350747 conn(0x7ffab00b4600 msgr2=0x7ffab00cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:25.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.078+0000 7ffab79c4640 1 -- 172.21.15.18:0/1928350747 shutdown_connections 2024-09-19T09:14:25.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.078+0000 7ffab79c4640 1 -- 172.21.15.18:0/1928350747 wait complete. 2024-09-19T09:14:25.089 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:14:25.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.191+0000 7f8d4259f640 1 Processor -- start 2024-09-19T09:14:25.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.191+0000 7f8d4259f640 1 -- start start 2024-09-19T09:14:25.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.192+0000 7f8d4259f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8d3c0b3ce0 0x7f8d3c0cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:25.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.192+0000 7f8d4259f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8d3c0d0050 0x7f8d3c0cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:25.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.192+0000 7f8d4259f640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d3c0d0e10 con 0x7f8d3c0cf560 2024-09-19T09:14:25.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.192+0000 7f8d4259f640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f8d3c0d0850 con 0x7f8d3c0d0050 2024-09-19T09:14:25.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.192+0000 7f8d4259f640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8d3c0d0b30 con 0x7f8d3c0b3ce0 2024-09-19T09:14:25.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.192+0000 7f8d40b3c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8d3c0d0050 0x7f8d3c0cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:25.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.192+0000 7f8d40b3c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8d3c0d0050 0x7f8d3c0cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56070/0 (socket says 172.21.15.18:56070) 2024-09-19T09:14:25.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.192+0000 7f8d40b3c640 1 -- 172.21.15.18:0/268141493 learned_addr learned my addr 172.21.15.18:0/268141493 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:25.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.192+0000 7f8d3b7fe640 1 --2- 172.21.15.18:0/268141493 >> v2:172.21.15.162:3300/0 conn(0x7f8d3c0b3ce0 0x7f8d3c0cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:25.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.192+0000 7f8d40b3c640 1 -- 172.21.15.18:0/268141493 >> v2:172.21.15.162:3300/0 conn(0x7f8d3c0b3ce0 msgr2=0x7f8d3c0cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:25.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.192+0000 7f8d40b3c640 1 --2- 172.21.15.18:0/268141493 >> v2:172.21.15.162:3300/0 conn(0x7f8d3c0b3ce0 0x7f8d3c0cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.192+0000 7f8d40b3c640 1 -- 172.21.15.18:0/268141493 >> v1:172.21.15.162:6789/0 conn(0x7f8d3c0cf560 legacy=0x7f8d3c0cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:25.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.192+0000 7f8d40b3c640 1 -- 172.21.15.18:0/268141493 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d3c0b24d0 con 0x7f8d3c0d0050 2024-09-19T09:14:25.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.193+0000 7f8d40b3c640 1 --2- 172.21.15.18:0/268141493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d3c0d0050 0x7f8d3c0cdb30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c0b52b0 tx=0x7f8d3402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74f633fb4bc6796b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:25.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.193+0000 7f8d3affd640 1 -- 172.21.15.18:0/268141493 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d34036070 con 0x7f8d3c0d0050 2024-09-19T09:14:25.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.193+0000 7f8d3affd640 1 -- 172.21.15.18:0/268141493 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d34031600 con 0x7f8d3c0d0050 2024-09-19T09:14:25.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.193+0000 7f8d3affd640 1 -- 172.21.15.18:0/268141493 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d340319d0 con 0x7f8d3c0d0050 2024-09-19T09:14:25.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.194+0000 7f8d4259f640 1 -- 172.21.15.18:0/268141493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d3c0d0050 msgr2=0x7f8d3c0cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:25.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.194+0000 7f8d4259f640 1 --2- 172.21.15.18:0/268141493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d3c0d0050 0x7f8d3c0cdb30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c0b52b0 tx=0x7f8d3402a5d0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.194+0000 7f8d4259f640 1 -- 172.21.15.18:0/268141493 shutdown_connections 2024-09-19T09:14:25.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.194+0000 7f8d4259f640 1 --2- 172.21.15.18:0/268141493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d3c0d0050 0x7f8d3c0cdb30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.194+0000 7f8d4259f640 1 --2- 172.21.15.18:0/268141493 >> v2:172.21.15.162:3300/0 conn(0x7f8d3c0b3ce0 0x7f8d3c0cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.194+0000 7f8d4259f640 1 -- 172.21.15.18:0/268141493 >> 172.21.15.18:0/268141493 conn(0x7f8d3c0b4700 msgr2=0x7f8d3c0b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:25.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.194+0000 7f8d4259f640 1 -- 172.21.15.18:0/268141493 shutdown_connections 2024-09-19T09:14:25.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.194+0000 7f8d4259f640 1 -- 172.21.15.18:0/268141493 wait complete. 2024-09-19T09:14:25.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.195+0000 7f8d4259f640 1 Processor -- start 2024-09-19T09:14:25.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.195+0000 7f8d4259f640 1 -- start start 2024-09-19T09:14:25.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.196+0000 7f8d4259f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d3c0b3ce0 0x7f8d3c15c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:25.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.196+0000 7f8d4259f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d3c0cf560 0x7f8d3c0c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:25.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.196+0000 7f8d4259f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d3c0d0050 0x7f8d3c0c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:25.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.196+0000 7f8d4259f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3c0b55a0 con 0x7f8d3c0cf560 2024-09-19T09:14:25.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.196+0000 7f8d4259f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3c0b5420 con 0x7f8d3c0d0050 2024-09-19T09:14:25.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.196+0000 7f8d4259f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8d3c15d090 con 0x7f8d3c0b3ce0 2024-09-19T09:14:25.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.196+0000 7f8d3b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d3c0cf560 0x7f8d3c0c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:25.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.196+0000 7f8d3b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d3c0cf560 0x7f8d3c0c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56072/0 (socket says 172.21.15.18:56072) 2024-09-19T09:14:25.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.196+0000 7f8d3b7fe640 1 -- 172.21.15.18:0/1457046854 learned_addr learned my addr 172.21.15.18:0/1457046854 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:25.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.196+0000 7f8d40b3c640 1 --2- 172.21.15.18:0/1457046854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d3c0d0050 0x7f8d3c0c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:25.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.196+0000 7f8d3bfff640 1 --2- 172.21.15.18:0/1457046854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d3c0b3ce0 0x7f8d3c15c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:25.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.196+0000 7f8d3b7fe640 1 -- 172.21.15.18:0/1457046854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d3c0b3ce0 msgr2=0x7f8d3c15c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:25.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.196+0000 7f8d3b7fe640 1 --2- 172.21.15.18:0/1457046854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d3c0b3ce0 0x7f8d3c15c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.196+0000 7f8d3b7fe640 1 -- 172.21.15.18:0/1457046854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d3c0d0050 msgr2=0x7f8d3c0c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:25.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.196+0000 7f8d3b7fe640 1 --2- 172.21.15.18:0/1457046854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d3c0d0050 0x7f8d3c0c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.196+0000 7f8d3b7fe640 1 -- 172.21.15.18:0/1457046854 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d3c0b0ff0 con 0x7f8d3c0cf560 2024-09-19T09:14:25.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.196+0000 7f8d3b7fe640 1 --2- 172.21.15.18:0/1457046854 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d3c0cf560 0x7f8d3c0c8850 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8d3000d7d0 tx=0x7f8d3000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:25.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.197+0000 7f8d38ff9640 1 -- 172.21.15.18:0/1457046854 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d30004020 con 0x7f8d3c0cf560 2024-09-19T09:14:25.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.197+0000 7f8d38ff9640 1 -- 172.21.15.18:0/1457046854 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d300041e0 con 0x7f8d3c0cf560 2024-09-19T09:14:25.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.197+0000 7f8d4259f640 1 -- 172.21.15.18:0/1457046854 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d3c15e140 con 0x7f8d3c0cf560 2024-09-19T09:14:25.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.197+0000 7f8d38ff9640 1 -- 172.21.15.18:0/1457046854 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d300043d0 con 0x7f8d3c0cf560 2024-09-19T09:14:25.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.197+0000 7f8d4259f640 1 -- 172.21.15.18:0/1457046854 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d3c15e6c0 con 0x7f8d3c0cf560 2024-09-19T09:14:25.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.197+0000 7f8d4259f640 1 -- 172.21.15.18:0/1457046854 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d3c0cf940 con 0x7f8d3c0cf560 2024-09-19T09:14:25.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.198+0000 7f8d38ff9640 1 -- 172.21.15.18:0/1457046854 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8d3001b020 con 0x7f8d3c0cf560 2024-09-19T09:14:25.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.198+0000 7f8d38ff9640 1 --2- 172.21.15.18:0/1457046854 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8d2806c2b0 0x7f8d2806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:25.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.199+0000 7f8d38ff9640 1 -- 172.21.15.18:0/1457046854 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5825+0+0 (secure 0 0 0) 0x7f8d3008b230 con 0x7f8d3c0cf560 2024-09-19T09:14:25.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.199+0000 7f8d3bfff640 1 --2- 172.21.15.18:0/1457046854 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8d2806c2b0 0x7f8d2806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:25.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.199+0000 7f8d3bfff640 1 --2- 172.21.15.18:0/1457046854 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8d2806c2b0 0x7f8d2806e770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c004f60 tx=0x7f8d2c007e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:25.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.203+0000 7f8d38ff9640 1 -- 172.21.15.18:0/1457046854 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8d30059230 con 0x7f8d3c0cf560 2024-09-19T09:14:25.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.381+0000 7f8d4259f640 1 -- 172.21.15.18:0/1457046854 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8d3c070210 con 0x7f8d3c0cf560 2024-09-19T09:14:25.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.382+0000 7f8d38ff9640 1 -- 172.21.15.18:0/1457046854 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+16930 (secure 0 0 0) 0x7f8d3005d530 con 0x7f8d3c0cf560 2024-09-19T09:14:25.382 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:25.382 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":36,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:14:21.862743+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:14:05.064029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-19T09:14:06.144818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.0","mappings":[{"from":4,"to":5}]},{"pgid":"5.28","mappings":[{"from":4,"to":5}]},{"pgid":"5.33","mappings":[{"from":4,"to":5}]},{"pgid":"5.37","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:14:25.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.384+0000 7f8d4259f640 1 -- 172.21.15.18:0/1457046854 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8d2806c2b0 msgr2=0x7f8d2806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:25.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.384+0000 7f8d4259f640 1 --2- 172.21.15.18:0/1457046854 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8d2806c2b0 0x7f8d2806e770 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c004f60 tx=0x7f8d2c007e30 comp rx=0 tx=0).stop 2024-09-19T09:14:25.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.384+0000 7f8d4259f640 1 -- 172.21.15.18:0/1457046854 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d3c0cf560 msgr2=0x7f8d3c0c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:25.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.384+0000 7f8d4259f640 1 --2- 172.21.15.18:0/1457046854 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d3c0cf560 0x7f8d3c0c8850 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8d3000d7d0 tx=0x7f8d3000dc90 comp rx=0 tx=0).stop 2024-09-19T09:14:25.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.384+0000 7f8d4259f640 1 -- 172.21.15.18:0/1457046854 shutdown_connections 2024-09-19T09:14:25.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.384+0000 7f8d4259f640 1 --2- 172.21.15.18:0/1457046854 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8d2806c2b0 0x7f8d2806e770 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.384+0000 7f8d4259f640 1 --2- 172.21.15.18:0/1457046854 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d3c0d0050 0x7f8d3c0c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.384+0000 7f8d4259f640 1 --2- 172.21.15.18:0/1457046854 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d3c0cf560 0x7f8d3c0c8850 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.384+0000 7f8d4259f640 1 --2- 172.21.15.18:0/1457046854 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d3c0b3ce0 0x7f8d3c15c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.384+0000 7f8d4259f640 1 -- 172.21.15.18:0/1457046854 >> 172.21.15.18:0/1457046854 conn(0x7f8d3c0b4700 msgr2=0x7f8d3c0cd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:25.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.384+0000 7f8d4259f640 1 -- 172.21.15.18:0/1457046854 shutdown_connections 2024-09-19T09:14:25.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.384+0000 7f8d4259f640 1 -- 172.21.15.18:0/1457046854 wait complete. 2024-09-19T09:14:25.395 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T09:14:25.395 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:14:25.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.497+0000 7f512b223640 1 Processor -- start 2024-09-19T09:14:25.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.498+0000 7f512b223640 1 -- start start 2024-09-19T09:14:25.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.498+0000 7f512b223640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f512415ef50 0x7f51240d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:25.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.498+0000 7f512b223640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f51240b9510 0x7f51240d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:25.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.498+0000 7f512b223640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51240b7a90 con 0x7f51240d3240 2024-09-19T09:14:25.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.498+0000 7f512b223640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f51240d3740 con 0x7f512415ef50 2024-09-19T09:14:25.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.498+0000 7f512b223640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f51240d3a20 con 0x7f51240b9510 2024-09-19T09:14:25.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.498+0000 7f5128fbf640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f512415ef50 0x7f51240d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:25.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.498+0000 7f5123fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f51240d3240 0x7f51240cf770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49970/0 (socket says 172.21.15.18:49970) 2024-09-19T09:14:25.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.498+0000 7f5128fbf640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f512415ef50 0x7f51240d13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45762/0 (socket says 172.21.15.18:45762) 2024-09-19T09:14:25.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.499+0000 7f5123fff640 1 -- 172.21.15.18:0/760998883 learned_addr learned my addr 172.21.15.18:0/760998883 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:25.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.499+0000 7f51297c0640 1 --2- 172.21.15.18:0/760998883 >> v2:172.21.15.162:3300/0 conn(0x7f51240b9510 0x7f51240d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:25.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.499+0000 7f5128fbf640 1 -- 172.21.15.18:0/760998883 >> v2:172.21.15.162:3300/0 conn(0x7f51240b9510 msgr2=0x7f51240d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:25.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.499+0000 7f5128fbf640 1 --2- 172.21.15.18:0/760998883 >> v2:172.21.15.162:3300/0 conn(0x7f51240b9510 0x7f51240d18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.499+0000 7f5128fbf640 1 -- 172.21.15.18:0/760998883 >> v1:172.21.15.18:6789/0 conn(0x7f51240d3240 legacy=0x7f51240cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:25.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.499+0000 7f5128fbf640 1 -- 172.21.15.18:0/760998883 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51240b7d00 con 0x7f512415ef50 2024-09-19T09:14:25.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.499+0000 7f5128fbf640 1 --2- 172.21.15.18:0/760998883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f512415ef50 0x7f51240d13a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f512408ea60 tx=0x7f511402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39c27d01b830e720 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:25.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.500+0000 7f51237fe640 1 -- 172.21.15.18:0/760998883 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5114037070 con 0x7f512415ef50 2024-09-19T09:14:25.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.500+0000 7f51237fe640 1 -- 172.21.15.18:0/760998883 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5114032440 con 0x7f512415ef50 2024-09-19T09:14:25.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.500+0000 7f51237fe640 1 -- 172.21.15.18:0/760998883 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511402ae60 con 0x7f512415ef50 2024-09-19T09:14:25.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.500+0000 7f512b223640 1 -- 172.21.15.18:0/760998883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f512415ef50 msgr2=0x7f51240d13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:25.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.500+0000 7f512b223640 1 --2- 172.21.15.18:0/760998883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f512415ef50 0x7f51240d13a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f512408ea60 tx=0x7f511402a110 comp rx=0 tx=0).stop 2024-09-19T09:14:25.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.500+0000 7f512b223640 1 -- 172.21.15.18:0/760998883 shutdown_connections 2024-09-19T09:14:25.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.500+0000 7f512b223640 1 --2- 172.21.15.18:0/760998883 >> v2:172.21.15.162:3300/0 conn(0x7f51240b9510 0x7f51240d18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.500+0000 7f512b223640 1 --2- 172.21.15.18:0/760998883 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f512415ef50 0x7f51240d13a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.500+0000 7f512b223640 1 -- 172.21.15.18:0/760998883 >> 172.21.15.18:0/760998883 conn(0x7f51240d4c60 msgr2=0x7f51240d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:25.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.500+0000 7f512b223640 1 -- 172.21.15.18:0/760998883 shutdown_connections 2024-09-19T09:14:25.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.500+0000 7f512b223640 1 -- 172.21.15.18:0/760998883 wait complete. 2024-09-19T09:14:25.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.501+0000 7f512b223640 1 Processor -- start 2024-09-19T09:14:25.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.502+0000 7f512b223640 1 -- start start 2024-09-19T09:14:25.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.502+0000 7f512b223640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51240b9510 0x7f51240c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:25.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.502+0000 7f512b223640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51240d3240 0x7f5124159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:25.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.502+0000 7f512b223640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f512415ef50 0x7f51240ce180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:25.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.502+0000 7f512b223640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f51240d21a0 con 0x7f51240d3240 2024-09-19T09:14:25.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.502+0000 7f512b223640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f51240d2020 con 0x7f51240b9510 2024-09-19T09:14:25.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.502+0000 7f512b223640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f51240d5780 con 0x7f512415ef50 2024-09-19T09:14:25.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.502+0000 7f5123fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51240d3240 0x7f5124159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:25.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.503+0000 7f5123fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51240d3240 0x7f5124159440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45774/0 (socket says 172.21.15.18:45774) 2024-09-19T09:14:25.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.503+0000 7f5123fff640 1 -- 172.21.15.18:0/2912860153 learned_addr learned my addr 172.21.15.18:0/2912860153 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:25.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.503+0000 7f5128fbf640 1 --2- 172.21.15.18:0/2912860153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51240b9510 0x7f51240c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:25.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.503+0000 7f51297c0640 1 --2- 172.21.15.18:0/2912860153 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f512415ef50 0x7f51240ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:25.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.503+0000 7f5123fff640 1 -- 172.21.15.18:0/2912860153 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f512415ef50 msgr2=0x7f51240ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:25.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.503+0000 7f5123fff640 1 --2- 172.21.15.18:0/2912860153 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f512415ef50 0x7f51240ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.503+0000 7f5123fff640 1 -- 172.21.15.18:0/2912860153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51240b9510 msgr2=0x7f51240c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:25.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.503+0000 7f5123fff640 1 --2- 172.21.15.18:0/2912860153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51240b9510 0x7f51240c9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.503+0000 7f5123fff640 1 -- 172.21.15.18:0/2912860153 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51240cd550 con 0x7f51240d3240 2024-09-19T09:14:25.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.503+0000 7f5128fbf640 1 --2- 172.21.15.18:0/2912860153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51240b9510 0x7f51240c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:25.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.503+0000 7f51297c0640 1 --2- 172.21.15.18:0/2912860153 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f512415ef50 0x7f51240ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:25.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.503+0000 7f5123fff640 1 --2- 172.21.15.18:0/2912860153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51240d3240 0x7f5124159440 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f511800c4d0 tx=0x7f511800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:25.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.503+0000 7f51217fa640 1 -- 172.21.15.18:0/2912860153 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5118017070 con 0x7f51240d3240 2024-09-19T09:14:25.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.503+0000 7f51217fa640 1 -- 172.21.15.18:0/2912860153 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5118005ce0 con 0x7f51240d3240 2024-09-19T09:14:25.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.503+0000 7f512b223640 1 -- 172.21.15.18:0/2912860153 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f512415f3c0 con 0x7f51240d3240 2024-09-19T09:14:25.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.503+0000 7f51217fa640 1 -- 172.21.15.18:0/2912860153 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5118007270 con 0x7f51240d3240 2024-09-19T09:14:25.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.503+0000 7f512b223640 1 -- 172.21.15.18:0/2912860153 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f512415f980 con 0x7f51240d3240 2024-09-19T09:14:25.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.504+0000 7f512b223640 1 -- 172.21.15.18:0/2912860153 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51240d1b60 con 0x7f51240d3240 2024-09-19T09:14:25.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.505+0000 7f51217fa640 1 -- 172.21.15.18:0/2912860153 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f511801a070 con 0x7f51240d3240 2024-09-19T09:14:25.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.505+0000 7f51217fa640 1 --2- 172.21.15.18:0/2912860153 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f511006c2b0 0x7f511006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:25.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.505+0000 7f51217fa640 1 -- 172.21.15.18:0/2912860153 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5825+0+0 (secure 0 0 0) 0x7f511808a7a0 con 0x7f51240d3240 2024-09-19T09:14:25.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.506+0000 7f5128fbf640 1 --2- 172.21.15.18:0/2912860153 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f511006c2b0 0x7f511006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:25.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.506+0000 7f5128fbf640 1 --2- 172.21.15.18:0/2912860153 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f511006c2b0 0x7f511006e770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5114034000 tx=0x7f511402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:25.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.510+0000 7f51217fa640 1 -- 172.21.15.18:0/2912860153 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f51180587a0 con 0x7f51240d3240 2024-09-19T09:14:25.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.718+0000 7f512b223640 1 -- 172.21.15.18:0/2912860153 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f512406c430 con 0x7f51240d3240 2024-09-19T09:14:25.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.719+0000 7f51217fa640 1 -- 172.21.15.18:0/2912860153 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5229 (secure 0 0 0) 0x7f511805caa0 con 0x7f51240d3240 2024-09-19T09:14:25.720 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:25.720 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":13,"btime":"2024-09-19T09:14:09:822716+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1369179501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1369179501},{"type":"v1","addr":"172.21.15.18:6835","nonce":1369179501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4762,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2677647932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2677647932},{"type":"v1","addr":"172.21.15.162:6836","nonce":2677647932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4765,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3427373581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3427373581},{"type":"v1","addr":"172.21.15.162:6837","nonce":3427373581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:14:07.154707+0000","modified":"2024-09-19T09:14:09.169555+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4785},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4785":{"gid":4785,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6834/2895835717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2895835717},{"type":"v1","addr":"172.21.15.18:6834","nonce":2895835717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4785,"qdb_cluster":[4785]},"id":2}]} 2024-09-19T09:14:25.720 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 13 2024-09-19T09:14:25.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.721+0000 7f512b223640 1 -- 172.21.15.18:0/2912860153 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f511006c2b0 msgr2=0x7f511006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:25.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.721+0000 7f512b223640 1 --2- 172.21.15.18:0/2912860153 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f511006c2b0 0x7f511006e770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5114034000 tx=0x7f511402e000 comp rx=0 tx=0).stop 2024-09-19T09:14:25.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.721+0000 7f512b223640 1 -- 172.21.15.18:0/2912860153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51240d3240 msgr2=0x7f5124159440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:25.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.721+0000 7f512b223640 1 --2- 172.21.15.18:0/2912860153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51240d3240 0x7f5124159440 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f511800c4d0 tx=0x7f511800c990 comp rx=0 tx=0).stop 2024-09-19T09:14:25.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.721+0000 7f512b223640 1 -- 172.21.15.18:0/2912860153 shutdown_connections 2024-09-19T09:14:25.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.721+0000 7f512b223640 1 --2- 172.21.15.18:0/2912860153 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f511006c2b0 0x7f511006e770 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.721+0000 7f512b223640 1 --2- 172.21.15.18:0/2912860153 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f512415ef50 0x7f51240ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.721+0000 7f512b223640 1 --2- 172.21.15.18:0/2912860153 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51240d3240 0x7f5124159440 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.721+0000 7f512b223640 1 --2- 172.21.15.18:0/2912860153 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51240b9510 0x7f51240c9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.721+0000 7f512b223640 1 -- 172.21.15.18:0/2912860153 >> 172.21.15.18:0/2912860153 conn(0x7f51240d4c60 msgr2=0x7f512406c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:25.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.721+0000 7f512b223640 1 -- 172.21.15.18:0/2912860153 shutdown_connections 2024-09-19T09:14:25.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.721+0000 7f512b223640 1 -- 172.21.15.18:0/2912860153 wait complete. 2024-09-19T09:14:25.733 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:14:25.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.834+0000 7f875d2a4640 1 Processor -- start 2024-09-19T09:14:25.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.834+0000 7f875d2a4640 1 -- start start 2024-09-19T09:14:25.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.835+0000 7f875d2a4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f875815ed50 0x7f87580d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:25.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.835+0000 7f875d2a4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87580d1aa0 0x7f87580b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:25.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.835+0000 7f875d2a4640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87580d31b0 con 0x7f87580b5030 2024-09-19T09:14:25.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.835+0000 7f875d2a4640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f87580d1ee0 con 0x7f875815ed50 2024-09-19T09:14:25.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.835+0000 7f875d2a4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f87580d3490 con 0x7f87580d1aa0 2024-09-19T09:14:25.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.835+0000 7f8756ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f875815ed50 0x7f87580d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:25.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.835+0000 7f87577fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f87580b5030 0x7f87580b54e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49972/0 (socket says 172.21.15.18:49972) 2024-09-19T09:14:25.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.835+0000 7f87577fe640 1 -- 172.21.15.18:0/849517261 learned_addr learned my addr 172.21.15.18:0/849517261 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:25.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.836+0000 7f87567fc640 1 --2- 172.21.15.18:0/849517261 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87580d1aa0 0x7f87580b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:25.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.836+0000 7f8756ffd640 1 -- 172.21.15.18:0/849517261 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87580d1aa0 msgr2=0x7f87580b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:25.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.836+0000 7f8756ffd640 1 --2- 172.21.15.18:0/849517261 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87580d1aa0 0x7f87580b4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.836+0000 7f8756ffd640 1 -- 172.21.15.18:0/849517261 >> v1:172.21.15.18:6789/0 conn(0x7f87580b5030 legacy=0x7f87580b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:25.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.836+0000 7f8756ffd640 1 -- 172.21.15.18:0/849517261 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87580d3770 con 0x7f875815ed50 2024-09-19T09:14:25.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.836+0000 7f8755ffb640 1 -- 172.21.15.18:0/849517261 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3745451759 0 0) 0x7f87580d31b0 con 0x7f87580b5030 2024-09-19T09:14:25.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.836+0000 7f8756ffd640 1 --2- 172.21.15.18:0/849517261 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f875815ed50 0x7f87580d1560 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f87500097a0 tx=0x7f875002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd18762a2d8dbd89 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:25.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.837+0000 7f8755ffb640 1 -- 172.21.15.18:0/849517261 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8750037070 con 0x7f875815ed50 2024-09-19T09:14:25.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.837+0000 7f8755ffb640 1 -- 172.21.15.18:0/849517261 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8750032440 con 0x7f875815ed50 2024-09-19T09:14:25.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.837+0000 7f8755ffb640 1 -- 172.21.15.18:0/849517261 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8750032810 con 0x7f875815ed50 2024-09-19T09:14:25.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.837+0000 7f875d2a4640 1 -- 172.21.15.18:0/849517261 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f875815ed50 msgr2=0x7f87580d1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:25.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.837+0000 7f875d2a4640 1 --2- 172.21.15.18:0/849517261 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f875815ed50 0x7f87580d1560 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f87500097a0 tx=0x7f875002a210 comp rx=0 tx=0).stop 2024-09-19T09:14:25.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.837+0000 7f875d2a4640 1 -- 172.21.15.18:0/849517261 shutdown_connections 2024-09-19T09:14:25.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.837+0000 7f875d2a4640 1 --2- 172.21.15.18:0/849517261 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87580d1aa0 0x7f87580b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.837+0000 7f875d2a4640 1 --2- 172.21.15.18:0/849517261 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f875815ed50 0x7f87580d1560 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.837+0000 7f875d2a4640 1 -- 172.21.15.18:0/849517261 >> 172.21.15.18:0/849517261 conn(0x7f87580d4bd0 msgr2=0x7f87580d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:25.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.837+0000 7f875d2a4640 1 -- 172.21.15.18:0/849517261 shutdown_connections 2024-09-19T09:14:25.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.837+0000 7f875d2a4640 1 -- 172.21.15.18:0/849517261 wait complete. 2024-09-19T09:14:25.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.839+0000 7f875d2a4640 1 Processor -- start 2024-09-19T09:14:25.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.839+0000 7f875d2a4640 1 -- start start 2024-09-19T09:14:25.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.839+0000 7f875d2a4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87580b5030 0x7f87580ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:25.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.839+0000 7f875d2a4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87580d1aa0 0x7f8758154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:25.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.839+0000 7f875d2a4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f875815ed50 0x7f875815d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:25.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.839+0000 7f875d2a4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f87580d3d30 con 0x7f875815ed50 2024-09-19T09:14:25.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.839+0000 7f875d2a4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f87580b45d0 con 0x7f87580b5030 2024-09-19T09:14:25.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.839+0000 7f875d2a4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f875815f130 con 0x7f87580d1aa0 2024-09-19T09:14:25.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.839+0000 7f87577fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f875815ed50 0x7f875815d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:25.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.840+0000 7f87577fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f875815ed50 0x7f875815d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45780/0 (socket says 172.21.15.18:45780) 2024-09-19T09:14:25.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.840+0000 7f87577fe640 1 -- 172.21.15.18:0/3323342751 learned_addr learned my addr 172.21.15.18:0/3323342751 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:25.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.840+0000 7f8756ffd640 1 --2- 172.21.15.18:0/3323342751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87580b5030 0x7f87580ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:25.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.840+0000 7f87567fc640 1 --2- 172.21.15.18:0/3323342751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87580d1aa0 0x7f8758154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:25.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.840+0000 7f87577fe640 1 -- 172.21.15.18:0/3323342751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87580d1aa0 msgr2=0x7f8758154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:25.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.840+0000 7f87577fe640 1 --2- 172.21.15.18:0/3323342751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87580d1aa0 0x7f8758154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.840+0000 7f87577fe640 1 -- 172.21.15.18:0/3323342751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87580b5030 msgr2=0x7f87580ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:25.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.840+0000 7f87577fe640 1 --2- 172.21.15.18:0/3323342751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87580b5030 0x7f87580ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:25.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.840+0000 7f87577fe640 1 -- 172.21.15.18:0/3323342751 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8758160480 con 0x7f875815ed50 2024-09-19T09:14:25.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.840+0000 7f87577fe640 1 --2- 172.21.15.18:0/3323342751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f875815ed50 0x7f875815d1c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f874800c730 tx=0x7f874800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:25.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.840+0000 7f874f7fe640 1 -- 172.21.15.18:0/3323342751 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8748018070 con 0x7f875815ed50 2024-09-19T09:14:25.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.840+0000 7f874f7fe640 1 -- 172.21.15.18:0/3323342751 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f874800ce40 con 0x7f875815ed50 2024-09-19T09:14:25.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.840+0000 7f874f7fe640 1 -- 172.21.15.18:0/3323342751 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f874800a860 con 0x7f875815ed50 2024-09-19T09:14:25.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.840+0000 7f875d2a4640 1 -- 172.21.15.18:0/3323342751 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8758160700 con 0x7f875815ed50 2024-09-19T09:14:25.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.840+0000 7f875d2a4640 1 -- 172.21.15.18:0/3323342751 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8758160cc0 con 0x7f875815ed50 2024-09-19T09:14:25.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.841+0000 7f875d2a4640 1 -- 172.21.15.18:0/3323342751 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87580d21e0 con 0x7f875815ed50 2024-09-19T09:14:25.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.842+0000 7f874f7fe640 1 -- 172.21.15.18:0/3323342751 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f874801b070 con 0x7f875815ed50 2024-09-19T09:14:25.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.842+0000 7f874f7fe640 1 --2- 172.21.15.18:0/3323342751 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f873806c2b0 0x7f873806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:25.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.843+0000 7f874f7fe640 1 -- 172.21.15.18:0/3323342751 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5825+0+0 (secure 0 0 0) 0x7f874808a8f0 con 0x7f875815ed50 2024-09-19T09:14:25.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.843+0000 7f8756ffd640 1 --2- 172.21.15.18:0/3323342751 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f873806c2b0 0x7f873806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:25.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.843+0000 7f8756ffd640 1 --2- 172.21.15.18:0/3323342751 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f873806c2b0 0x7f873806e770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8750034000 tx=0x7f875002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:25.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:25.847+0000 7f874f7fe640 1 -- 172.21.15.18:0/3323342751 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8758160480 con 0x7f875815ed50 2024-09-19T09:14:26.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.057+0000 7f875d2a4640 1 -- 172.21.15.18:0/3323342751 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f875806d9c0 con 0x7f875815ed50 2024-09-19T09:14:26.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.058+0000 7f874f7fe640 1 -- 172.21.15.18:0/3323342751 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5229 (secure 0 0 0) 0x7f8748058a20 con 0x7f875815ed50 2024-09-19T09:14:26.058 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:26.058 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":13,"btime":"2024-09-19T09:14:09:822716+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1369179501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1369179501},{"type":"v1","addr":"172.21.15.18:6835","nonce":1369179501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4762,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2677647932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2677647932},{"type":"v1","addr":"172.21.15.162:6836","nonce":2677647932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4765,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3427373581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3427373581},{"type":"v1","addr":"172.21.15.162:6837","nonce":3427373581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:14:07.154707+0000","modified":"2024-09-19T09:14:09.169555+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4785},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4785":{"gid":4785,"name":"a","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6834/2895835717","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2895835717},{"type":"v1","addr":"172.21.15.18:6834","nonce":2895835717}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4785,"qdb_cluster":[4785]},"id":2}]} 2024-09-19T09:14:26.059 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 13 2024-09-19T09:14:26.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.060+0000 7f875d2a4640 1 -- 172.21.15.18:0/3323342751 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f873806c2b0 msgr2=0x7f873806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:26.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.060+0000 7f875d2a4640 1 --2- 172.21.15.18:0/3323342751 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f873806c2b0 0x7f873806e770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8750034000 tx=0x7f875002e000 comp rx=0 tx=0).stop 2024-09-19T09:14:26.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.060+0000 7f875d2a4640 1 -- 172.21.15.18:0/3323342751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f875815ed50 msgr2=0x7f875815d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:26.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.060+0000 7f875d2a4640 1 --2- 172.21.15.18:0/3323342751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f875815ed50 0x7f875815d1c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f874800c730 tx=0x7f874800cbf0 comp rx=0 tx=0).stop 2024-09-19T09:14:26.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.060+0000 7f875d2a4640 1 -- 172.21.15.18:0/3323342751 shutdown_connections 2024-09-19T09:14:26.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.060+0000 7f875d2a4640 1 --2- 172.21.15.18:0/3323342751 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f873806c2b0 0x7f873806e770 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:26.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.060+0000 7f875d2a4640 1 --2- 172.21.15.18:0/3323342751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f875815ed50 0x7f875815d1c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:26.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.060+0000 7f875d2a4640 1 --2- 172.21.15.18:0/3323342751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87580d1aa0 0x7f8758154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:26.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.060+0000 7f875d2a4640 1 --2- 172.21.15.18:0/3323342751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87580b5030 0x7f87580ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:26.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.060+0000 7f875d2a4640 1 -- 172.21.15.18:0/3323342751 >> 172.21.15.18:0/3323342751 conn(0x7f87580d4bd0 msgr2=0x7f87580b37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:26.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.060+0000 7f875d2a4640 1 -- 172.21.15.18:0/3323342751 shutdown_connections 2024-09-19T09:14:26.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.060+0000 7f875d2a4640 1 -- 172.21.15.18:0/3323342751 wait complete. 2024-09-19T09:14:26.071 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:14:26.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.173+0000 7fefa4703640 1 Processor -- start 2024-09-19T09:14:26.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.173+0000 7fefa4703640 1 -- start start 2024-09-19T09:14:26.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.174+0000 7fefa4703640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fef9c15fef0 0x7fef9c0b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:26.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.174+0000 7fefa4703640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef9c06e730 con 0x7fef9c06d810 2024-09-19T09:14:26.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.174+0000 7fefa4703640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef9c06ea10 con 0x7fef9c15eb00 2024-09-19T09:14:26.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.174+0000 7fefa4703640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fef9c1637e0 con 0x7fef9c15fef0 2024-09-19T09:14:26.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.174+0000 7fefa2ca0640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fef9c06d810 0x7fef9c0cf870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49976/0 (socket says 172.21.15.18:49976) 2024-09-19T09:14:26.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.174+0000 7fefa2ca0640 1 -- 172.21.15.18:0/1806838003 learned_addr learned my addr 172.21.15.18:0/1806838003 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:26.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.174+0000 7fefa149d640 1 -- 172.21.15.18:0/1806838003 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1488818072 0 0) 0x7fef9c06e730 con 0x7fef9c06d810 2024-09-19T09:14:26.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.174+0000 7fefa1c9e640 1 --2- 172.21.15.18:0/1806838003 >> v2:172.21.15.162:3300/0 conn(0x7fef9c15fef0 0x7fef9c0b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:26.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.174+0000 7fefa149d640 1 -- 172.21.15.18:0/1806838003 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef88003520 con 0x7fef9c06d810 2024-09-19T09:14:26.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.175+0000 7fefa149d640 1 -- 172.21.15.18:0/1806838003 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3931928716 0 0) 0x7fef88003520 con 0x7fef9c06d810 2024-09-19T09:14:26.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.175+0000 7fefa149d640 1 -- 172.21.15.18:0/1806838003 >> v2:172.21.15.162:3300/0 conn(0x7fef9c15fef0 msgr2=0x7fef9c0b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:26.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.175+0000 7fefa149d640 1 --2- 172.21.15.18:0/1806838003 >> v2:172.21.15.162:3300/0 conn(0x7fef9c15fef0 0x7fef9c0b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:26.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.175+0000 7fefa149d640 1 -- 172.21.15.18:0/1806838003 >> v1:172.21.15.162:6789/0 conn(0x7fef9c15eb00 legacy=0x7fef9c1630d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:26.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.175+0000 7fefa149d640 1 -- 172.21.15.18:0/1806838003 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef9c1628d0 con 0x7fef9c06d810 2024-09-19T09:14:26.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.175+0000 7fefa149d640 1 -- 172.21.15.18:0/1806838003 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fef980019f0 con 0x7fef9c06d810 2024-09-19T09:14:26.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.175+0000 7fefa149d640 1 -- 172.21.15.18:0/1806838003 >> v1:172.21.15.18:6789/0 conn(0x7fef9c06d810 legacy=0x7fef9c0cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:26.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.175+0000 7fefa149d640 1 --2- 172.21.15.18:0/1806838003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef880039b0 0x7fef88003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:26.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.175+0000 7fefa149d640 1 --2- 172.21.15.18:0/1806838003 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef88004800 0x7fef88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:26.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.175+0000 7fefa149d640 1 --2- 172.21.15.18:0/1806838003 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef880051c0 0x7fef8800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:26.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.175+0000 7fefa149d640 1 -- 172.21.15.18:0/1806838003 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fef9c1637e0 con 0x7fef880039b0 2024-09-19T09:14:26.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.175+0000 7fefa149d640 1 -- 172.21.15.18:0/1806838003 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fef8800c160 con 0x7fef880051c0 2024-09-19T09:14:26.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.175+0000 7fefa149d640 1 -- 172.21.15.18:0/1806838003 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fef8800c360 con 0x7fef88004800 2024-09-19T09:14:26.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.175+0000 7fefa249f640 1 --2- 172.21.15.18:0/1806838003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef880039b0 0x7fef88003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:26.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.175+0000 7fefa2ca0640 1 --2- 172.21.15.18:0/1806838003 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef880051c0 0x7fef8800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:26.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.175+0000 7fefa1c9e640 1 --2- 172.21.15.18:0/1806838003 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef88004800 0x7fef88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:26.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.175+0000 7fefa249f640 1 -- 172.21.15.18:0/1806838003 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef88004800 msgr2=0x7fef88004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:26.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.175+0000 7fefa249f640 1 --2- 172.21.15.18:0/1806838003 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef88004800 0x7fef88004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:26.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.175+0000 7fefa249f640 1 -- 172.21.15.18:0/1806838003 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef880051c0 msgr2=0x7fef8800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:26.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.175+0000 7fefa249f640 1 --2- 172.21.15.18:0/1806838003 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef880051c0 0x7fef8800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:26.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.175+0000 7fefa249f640 1 -- 172.21.15.18:0/1806838003 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef88003520 con 0x7fef880039b0 2024-09-19T09:14:26.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.175+0000 7fefa2ca0640 1 --2- 172.21.15.18:0/1806838003 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef880051c0 0x7fef8800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:26.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.175+0000 7fefa1c9e640 1 --2- 172.21.15.18:0/1806838003 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef88004800 0x7fef88004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:26.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.175+0000 7fefa2ca0640 1 -- 172.21.15.18:0/1806838003 reap_dead start 2024-09-19T09:14:26.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.176+0000 7fefa249f640 1 --2- 172.21.15.18:0/1806838003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef880039b0 0x7fef88003dd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fef94001750 tx=0x7fef88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e73eabd1ea23ac3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:26.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.176+0000 7fefa149d640 1 -- 172.21.15.18:0/1806838003 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef94001370 con 0x7fef880039b0 2024-09-19T09:14:26.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.176+0000 7fefa149d640 1 -- 172.21.15.18:0/1806838003 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef940052d0 con 0x7fef880039b0 2024-09-19T09:14:26.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.176+0000 7fefa149d640 1 -- 172.21.15.18:0/1806838003 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9402abc0 con 0x7fef880039b0 2024-09-19T09:14:26.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.176+0000 7fefa4703640 1 -- 172.21.15.18:0/1806838003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef880039b0 msgr2=0x7fef88003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:26.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.176+0000 7fefa4703640 1 --2- 172.21.15.18:0/1806838003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef880039b0 0x7fef88003dd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fef94001750 tx=0x7fef88005830 comp rx=0 tx=0).stop 2024-09-19T09:14:26.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.177+0000 7fefa4703640 1 -- 172.21.15.18:0/1806838003 shutdown_connections 2024-09-19T09:14:26.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.177+0000 7fefa4703640 1 --2- 172.21.15.18:0/1806838003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef880039b0 0x7fef88003dd0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:26.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.177+0000 7fefa4703640 1 -- 172.21.15.18:0/1806838003 >> 172.21.15.18:0/1806838003 conn(0x7fef9c06cd20 msgr2=0x7fef9c06d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:26.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.177+0000 7fefa4703640 1 -- 172.21.15.18:0/1806838003 shutdown_connections 2024-09-19T09:14:26.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.177+0000 7fefa4703640 1 -- 172.21.15.18:0/1806838003 wait complete. 2024-09-19T09:14:26.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.178+0000 7fefa4703640 1 Processor -- start 2024-09-19T09:14:26.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.178+0000 7fefa4703640 1 -- start start 2024-09-19T09:14:26.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.179+0000 7fefa4703640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef880039b0 0x7fef9c1539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:26.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.179+0000 7fefa4703640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef9c0aadb0 0x7fef9c0ab230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:26.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.179+0000 7fefa4703640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef9c0ad830 0x7fef9c0adce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:26.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.179+0000 7fefa4703640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fef9c070150 con 0x7fef880039b0 2024-09-19T09:14:26.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.179+0000 7fefa4703640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fef9c06ffd0 con 0x7fef9c0aadb0 2024-09-19T09:14:26.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.179+0000 7fefa4703640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fef9c0d1460 con 0x7fef9c0ad830 2024-09-19T09:14:26.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.179+0000 7fefa249f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef880039b0 0x7fef9c1539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:26.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.179+0000 7fefa249f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef880039b0 0x7fef9c1539b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45790/0 (socket says 172.21.15.18:45790) 2024-09-19T09:14:26.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.179+0000 7fefa249f640 1 -- 172.21.15.18:0/309730383 learned_addr learned my addr 172.21.15.18:0/309730383 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:26.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.179+0000 7fefa1c9e640 1 --2- 172.21.15.18:0/309730383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef9c0aadb0 0x7fef9c0ab230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.179+0000 7fefa2ca0640 1 --2- 172.21.15.18:0/309730383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef9c0ad830 0x7fef9c0adce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.179+0000 7fefa249f640 1 -- 172.21.15.18:0/309730383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef9c0ad830 msgr2=0x7fef9c0adce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.179+0000 7fefa249f640 1 --2- 172.21.15.18:0/309730383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef9c0ad830 0x7fef9c0adce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.179+0000 7fefa249f640 1 -- 172.21.15.18:0/309730383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef9c0aadb0 msgr2=0x7fef9c0ab230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.179+0000 7fefa249f640 1 --2- 172.21.15.18:0/309730383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef9c0aadb0 0x7fef9c0ab230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.179+0000 7fefa249f640 1 -- 172.21.15.18:0/309730383 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef9c1fa430 con 0x7fef880039b0 2024-09-19T09:14:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.179+0000 7fefa249f640 1 --2- 172.21.15.18:0/309730383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef880039b0 0x7fef9c1539b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fef94000c00 tx=0x7fef94001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.179+0000 7fef92ffd640 1 -- 172.21.15.18:0/309730383 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef9403f030 con 0x7fef880039b0 2024-09-19T09:14:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.179+0000 7fef92ffd640 1 -- 172.21.15.18:0/309730383 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef94005480 con 0x7fef880039b0 2024-09-19T09:14:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.179+0000 7fef92ffd640 1 -- 172.21.15.18:0/309730383 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef94037040 con 0x7fef880039b0 2024-09-19T09:14:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.179+0000 7fefa4703640 1 -- 172.21.15.18:0/309730383 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef9c1fa710 con 0x7fef880039b0 2024-09-19T09:14:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.179+0000 7fefa4703640 1 -- 172.21.15.18:0/309730383 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef9c0ae560 con 0x7fef880039b0 2024-09-19T09:14:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.180+0000 7fefa4703640 1 -- 172.21.15.18:0/309730383 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef9c1630d0 con 0x7fef880039b0 2024-09-19T09:14:26.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.181+0000 7fef92ffd640 1 -- 172.21.15.18:0/309730383 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fef94042070 con 0x7fef880039b0 2024-09-19T09:14:26.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.181+0000 7fef92ffd640 1 --2- 172.21.15.18:0/309730383 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fef8006c2b0 0x7fef8006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:26.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.181+0000 7fef92ffd640 1 -- 172.21.15.18:0/309730383 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5825+0+0 (secure 0 0 0) 0x7fef940aae00 con 0x7fef880039b0 2024-09-19T09:14:26.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.182+0000 7fefa1c9e640 1 --2- 172.21.15.18:0/309730383 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fef8006c2b0 0x7fef8006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:26.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.182+0000 7fefa1c9e640 1 --2- 172.21.15.18:0/309730383 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fef8006c2b0 0x7fef8006e770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fef9c159f30 tx=0x7fef8c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:26.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.186+0000 7fef92ffd640 1 -- 172.21.15.18:0/309730383 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fef94079450 con 0x7fef880039b0 2024-09-19T09:14:26.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.365+0000 7fefa4703640 1 -- 172.21.15.18:0/309730383 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fef9c1630d0 con 0x7fef880039b0 2024-09-19T09:14:26.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.366+0000 7fef92ffd640 1 -- 172.21.15.18:0/309730383 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+16930 (secure 0 0 0) 0x7fef94078d50 con 0x7fef880039b0 2024-09-19T09:14:26.366 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:26.366 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":36,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:14:21.862743+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:14:05.064029+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-19T09:14:06.144818+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"5.0","mappings":[{"from":4,"to":5}]},{"pgid":"5.28","mappings":[{"from":4,"to":5}]},{"pgid":"5.33","mappings":[{"from":4,"to":5}]},{"pgid":"5.37","mappings":[{"from":4,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:14:26.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.368+0000 7fefa4703640 1 -- 172.21.15.18:0/309730383 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fef8006c2b0 msgr2=0x7fef8006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:26.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.368+0000 7fefa4703640 1 --2- 172.21.15.18:0/309730383 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fef8006c2b0 0x7fef8006e770 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fef9c159f30 tx=0x7fef8c008040 comp rx=0 tx=0).stop 2024-09-19T09:14:26.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.368+0000 7fefa4703640 1 -- 172.21.15.18:0/309730383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef880039b0 msgr2=0x7fef9c1539b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:26.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.368+0000 7fefa4703640 1 --2- 172.21.15.18:0/309730383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef880039b0 0x7fef9c1539b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fef94000c00 tx=0x7fef94001120 comp rx=0 tx=0).stop 2024-09-19T09:14:26.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.368+0000 7fefa4703640 1 -- 172.21.15.18:0/309730383 shutdown_connections 2024-09-19T09:14:26.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.368+0000 7fefa4703640 1 --2- 172.21.15.18:0/309730383 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fef8006c2b0 0x7fef8006e770 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:26.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.368+0000 7fefa4703640 1 --2- 172.21.15.18:0/309730383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef9c0ad830 0x7fef9c0adce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:26.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.368+0000 7fefa4703640 1 --2- 172.21.15.18:0/309730383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef9c0aadb0 0x7fef9c0ab230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:26.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.368+0000 7fefa4703640 1 --2- 172.21.15.18:0/309730383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef880039b0 0x7fef9c1539b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:26.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.368+0000 7fefa4703640 1 -- 172.21.15.18:0/309730383 >> 172.21.15.18:0/309730383 conn(0x7fef9c06cd20 msgr2=0x7fef9c0b1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:26.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.368+0000 7fefa4703640 1 -- 172.21.15.18:0/309730383 shutdown_connections 2024-09-19T09:14:26.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.368+0000 7fefa4703640 1 -- 172.21.15.18:0/309730383 wait complete. 2024-09-19T09:14:26.380 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-19T09:14:26.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.483+0000 7f5a8c8af640 1 Processor -- start 2024-09-19T09:14:26.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.483+0000 7f5a8c8af640 1 -- start start 2024-09-19T09:14:26.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.484+0000 7f5a8c8af640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5a880b5180 0x7f5a8806d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:26.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.484+0000 7f5a8c8af640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5a8806dc40 0x7f5a880b27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:26.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.484+0000 7f5a8c8af640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a880d19b0 con 0x7f5a8815ee60 2024-09-19T09:14:26.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.484+0000 7f5a8c8af640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f5a8815f240 con 0x7f5a880b5180 2024-09-19T09:14:26.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.484+0000 7f5a8c8af640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f5a8806e090 con 0x7f5a8806dc40 2024-09-19T09:14:26.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.484+0000 7f5a7dd9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5a880b5180 0x7f5a8806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:26.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.484+0000 7f5a7dd9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5a880b5180 0x7f5a8806d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45804/0 (socket says 172.21.15.18:45804) 2024-09-19T09:14:26.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.484+0000 7f5a7dd9b640 1 -- 172.21.15.18:0/176396493 learned_addr learned my addr 172.21.15.18:0/176396493 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:26.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.484+0000 7f5a8659c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f5a8815ee60 0x7f5a8806cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49992/0 (socket says 172.21.15.18:49992) 2024-09-19T09:14:26.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.484+0000 7f5a7dd9b640 1 -- 172.21.15.18:0/176396493 >> v2:172.21.15.162:3300/0 conn(0x7f5a8806dc40 msgr2=0x7f5a880b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:26.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.484+0000 7f5a7dd9b640 1 --2- 172.21.15.18:0/176396493 >> v2:172.21.15.162:3300/0 conn(0x7f5a8806dc40 0x7f5a880b27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:26.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.484+0000 7f5a7dd9b640 1 -- 172.21.15.18:0/176396493 >> v1:172.21.15.18:6789/0 conn(0x7f5a8815ee60 legacy=0x7f5a8806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:26.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.484+0000 7f5a7dd9b640 1 -- 172.21.15.18:0/176396493 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a880d1c90 con 0x7f5a880b5180 2024-09-19T09:14:26.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.485+0000 7f5a7dd9b640 1 --2- 172.21.15.18:0/176396493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a880b5180 0x7f5a8806d700 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5a70009870 tx=0x7f5a7002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb64a0a1e989ceb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:26.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.485+0000 7f5a85d9b640 1 -- 172.21.15.18:0/176396493 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a70037070 con 0x7f5a880b5180 2024-09-19T09:14:26.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.485+0000 7f5a85d9b640 1 -- 172.21.15.18:0/176396493 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a70032440 con 0x7f5a880b5180 2024-09-19T09:14:26.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.485+0000 7f5a85d9b640 1 -- 172.21.15.18:0/176396493 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a70032810 con 0x7f5a880b5180 2024-09-19T09:14:26.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.485+0000 7f5a8c8af640 1 -- 172.21.15.18:0/176396493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a880b5180 msgr2=0x7f5a8806d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:26.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.485+0000 7f5a8c8af640 1 --2- 172.21.15.18:0/176396493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a880b5180 0x7f5a8806d700 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5a70009870 tx=0x7f5a7002a2a0 comp rx=0 tx=0).stop 2024-09-19T09:14:26.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.485+0000 7f5a8c8af640 1 -- 172.21.15.18:0/176396493 shutdown_connections 2024-09-19T09:14:26.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.485+0000 7f5a8c8af640 1 --2- 172.21.15.18:0/176396493 >> v2:172.21.15.162:3300/0 conn(0x7f5a8806dc40 0x7f5a880b27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:26.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.485+0000 7f5a8c8af640 1 --2- 172.21.15.18:0/176396493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a880b5180 0x7f5a8806d700 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:26.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.486+0000 7f5a8c8af640 1 -- 172.21.15.18:0/176396493 >> 172.21.15.18:0/176396493 conn(0x7f5a880b45f0 msgr2=0x7f5a880b4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:26.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.486+0000 7f5a8c8af640 1 -- 172.21.15.18:0/176396493 shutdown_connections 2024-09-19T09:14:26.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.486+0000 7f5a8c8af640 1 -- 172.21.15.18:0/176396493 wait complete. 2024-09-19T09:14:26.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.487+0000 7f5a8c8af640 1 Processor -- start 2024-09-19T09:14:26.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.487+0000 7f5a8c8af640 1 -- start start 2024-09-19T09:14:26.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.488+0000 7f5a8c8af640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a8806dc40 0x7f5a88153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:26.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.488+0000 7f5a8c8af640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a880b5180 0x7f5a8815b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:26.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.488+0000 7f5a8c8af640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a8815ee60 0x7f5a880cc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:26.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.488+0000 7f5a8c8af640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5a880b2e70 con 0x7f5a8806dc40 2024-09-19T09:14:26.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.488+0000 7f5a8c8af640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5a880b2cf0 con 0x7f5a880b5180 2024-09-19T09:14:26.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.488+0000 7f5a8c8af640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5a880b2ff0 con 0x7f5a8815ee60 2024-09-19T09:14:26.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.488+0000 7f5a8659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a8806dc40 0x7f5a88153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:26.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.488+0000 7f5a8659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a8806dc40 0x7f5a88153d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45816/0 (socket says 172.21.15.18:45816) 2024-09-19T09:14:26.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.488+0000 7f5a8659c640 1 -- 172.21.15.18:0/1009102376 learned_addr learned my addr 172.21.15.18:0/1009102376 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:26.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.488+0000 7f5a7dd9b640 1 --2- 172.21.15.18:0/1009102376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a880b5180 0x7f5a8815b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:26.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.488+0000 7f5a86d9d640 1 --2- 172.21.15.18:0/1009102376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a8815ee60 0x7f5a880cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:26.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.488+0000 7f5a8659c640 1 -- 172.21.15.18:0/1009102376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a8815ee60 msgr2=0x7f5a880cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:26.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.488+0000 7f5a8659c640 1 --2- 172.21.15.18:0/1009102376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a8815ee60 0x7f5a880cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:26.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.488+0000 7f5a8659c640 1 -- 172.21.15.18:0/1009102376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a880b5180 msgr2=0x7f5a8815b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:26.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.488+0000 7f5a8659c640 1 --2- 172.21.15.18:0/1009102376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a880b5180 0x7f5a8815b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:26.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.488+0000 7f5a8659c640 1 -- 172.21.15.18:0/1009102376 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a880b8370 con 0x7f5a8806dc40 2024-09-19T09:14:26.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.488+0000 7f5a7dd9b640 1 --2- 172.21.15.18:0/1009102376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a880b5180 0x7f5a8815b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:14:26.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.488+0000 7f5a86d9d640 1 --2- 172.21.15.18:0/1009102376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a8815ee60 0x7f5a880cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:14:26.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.489+0000 7f5a8659c640 1 --2- 172.21.15.18:0/1009102376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a8806dc40 0x7f5a88153d60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5a7800c3c0 tx=0x7f5a7800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:26.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.489+0000 7f5a7f7fe640 1 -- 172.21.15.18:0/1009102376 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a780074e0 con 0x7f5a8806dc40 2024-09-19T09:14:26.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.489+0000 7f5a7f7fe640 1 -- 172.21.15.18:0/1009102376 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a78007680 con 0x7f5a8806dc40 2024-09-19T09:14:26.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.489+0000 7f5a8c8af640 1 -- 172.21.15.18:0/1009102376 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a880b8650 con 0x7f5a8806dc40 2024-09-19T09:14:26.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.489+0000 7f5a7f7fe640 1 -- 172.21.15.18:0/1009102376 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a78004a00 con 0x7f5a8806dc40 2024-09-19T09:14:26.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.489+0000 7f5a8c8af640 1 -- 172.21.15.18:0/1009102376 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a880b5e40 con 0x7f5a8806dc40 2024-09-19T09:14:26.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.490+0000 7f5a8c8af640 1 -- 172.21.15.18:0/1009102376 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a8806bfe0 con 0x7f5a8806dc40 2024-09-19T09:14:26.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.490+0000 7f5a7f7fe640 1 -- 172.21.15.18:0/1009102376 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5a7801a020 con 0x7f5a8806dc40 2024-09-19T09:14:26.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.491+0000 7f5a7f7fe640 1 --2- 172.21.15.18:0/1009102376 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5a6806c2b0 0x7f5a6806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:26.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.491+0000 7f5a7f7fe640 1 -- 172.21.15.18:0/1009102376 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5825+0+0 (secure 0 0 0) 0x7f5a7808aba0 con 0x7f5a8806dc40 2024-09-19T09:14:26.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.491+0000 7f5a7dd9b640 1 --2- 172.21.15.18:0/1009102376 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5a6806c2b0 0x7f5a6806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:26.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.491+0000 7f5a7dd9b640 1 --2- 172.21.15.18:0/1009102376 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5a6806c2b0 0x7f5a6806e770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5a70034000 tx=0x7f5a7002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:26.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.495+0000 7f5a7f7fe640 1 -- 172.21.15.18:0/1009102376 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5a8806bfe0 con 0x7f5a8806dc40 2024-09-19T09:14:26.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.710+0000 7f5a8c8af640 1 -- 172.21.15.18:0/1009102376 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f5a880b27b0 con 0x7f5a8806dc40 2024-09-19T09:14:26.711 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-19T09:14:26.711+0000 7fca8a79c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:14:26.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.712+0000 7f5a7f7fe640 1 -- 172.21.15.18:0/1009102376 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v14) ==== 161+0+0 (secure 0 0 0) 0x7f5a78059320 con 0x7f5a8806dc40 2024-09-19T09:14:26.712 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T09:14:26.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.716+0000 7f5a8c8af640 1 -- 172.21.15.18:0/1009102376 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5a6806c2b0 msgr2=0x7f5a6806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:26.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.716+0000 7f5a8c8af640 1 --2- 172.21.15.18:0/1009102376 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5a6806c2b0 0x7f5a6806e770 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5a70034000 tx=0x7f5a7002e000 comp rx=0 tx=0).stop 2024-09-19T09:14:26.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.716+0000 7f5a8c8af640 1 -- 172.21.15.18:0/1009102376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a8806dc40 msgr2=0x7f5a88153d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:26.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.716+0000 7f5a8c8af640 1 --2- 172.21.15.18:0/1009102376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a8806dc40 0x7f5a88153d60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5a7800c3c0 tx=0x7f5a7800c880 comp rx=0 tx=0).stop 2024-09-19T09:14:26.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.717+0000 7f5a8c8af640 1 -- 172.21.15.18:0/1009102376 shutdown_connections 2024-09-19T09:14:26.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.717+0000 7f5a8c8af640 1 --2- 172.21.15.18:0/1009102376 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5a6806c2b0 0x7f5a6806e770 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:26.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.717+0000 7f5a8c8af640 1 --2- 172.21.15.18:0/1009102376 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5a8815ee60 0x7f5a880cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:26.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.717+0000 7f5a8c8af640 1 --2- 172.21.15.18:0/1009102376 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5a880b5180 0x7f5a8815b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:26.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.717+0000 7f5a8c8af640 1 --2- 172.21.15.18:0/1009102376 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5a8806dc40 0x7f5a88153d60 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:26.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.717+0000 7f5a8c8af640 1 -- 172.21.15.18:0/1009102376 >> 172.21.15.18:0/1009102376 conn(0x7f5a880b45f0 msgr2=0x7f5a88070e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:26.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.717+0000 7f5a8c8af640 1 -- 172.21.15.18:0/1009102376 shutdown_connections 2024-09-19T09:14:26.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.717+0000 7f5a8c8af640 1 -- 172.21.15.18:0/1009102376 wait complete. 2024-09-19T09:14:26.719 INFO:tasks.ceph.mds.a.smithi018.stderr: -4963> 2024-09-19T09:14:11.778+0000 7f5811e05640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T09:14:26.729 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T09:14:26.753 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-09-19T09:14:26.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.835+0000 7f4509a5e640 1 Processor -- start 2024-09-19T09:14:26.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.835+0000 7f4509a5e640 1 -- start start 2024-09-19T09:14:26.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.835+0000 7f4509a5e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f450415ede0 0x7f45040d5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:26.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.835+0000 7f4509a5e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f45040d5840 0x7f45040d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:26.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.835+0000 7f4509a5e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45040d3270 con 0x7f45040d1a20 2024-09-19T09:14:26.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.835+0000 7f4509a5e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f45040d34e0 con 0x7f45040d5840 2024-09-19T09:14:26.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.835+0000 7f4509a5e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f45040d37c0 con 0x7f450415ede0 2024-09-19T09:14:26.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.836+0000 7f45037fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f45040d1a20 0x7f45040cf8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50012/0 (socket says 172.21.15.18:50012) 2024-09-19T09:14:26.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.836+0000 7f45037fe640 1 -- 172.21.15.18:0/2792579904 learned_addr learned my addr 172.21.15.18:0/2792579904 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:26.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.836+0000 7f4502ffd640 1 --2- 172.21.15.18:0/2792579904 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f450415ede0 0x7f45040d5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:26.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.836+0000 7f45027fc640 1 --2- 172.21.15.18:0/2792579904 >> v2:172.21.15.162:3300/0 conn(0x7f45040d5840 0x7f45040d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:26.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.836+0000 7f4501ffb640 1 -- 172.21.15.18:0/2792579904 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3530912397 0 0) 0x7f45040d3270 con 0x7f45040d1a20 2024-09-19T09:14:26.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.836+0000 7f4501ffb640 1 -- 172.21.15.18:0/2792579904 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44ec003520 con 0x7f45040d1a20 2024-09-19T09:14:26.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.836+0000 7f4501ffb640 1 -- 172.21.15.18:0/2792579904 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2647627417 0 0) 0x7f44ec003520 con 0x7f45040d1a20 2024-09-19T09:14:26.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.836+0000 7f4501ffb640 1 -- 172.21.15.18:0/2792579904 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f450415ede0 msgr2=0x7f45040d5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:26.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.836+0000 7f4501ffb640 1 --2- 172.21.15.18:0/2792579904 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f450415ede0 0x7f45040d5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:26.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.836+0000 7f4501ffb640 1 -- 172.21.15.18:0/2792579904 >> v2:172.21.15.162:3300/0 conn(0x7f45040d5840 msgr2=0x7f45040d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:26.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.836+0000 7f4501ffb640 1 --2- 172.21.15.18:0/2792579904 >> v2:172.21.15.162:3300/0 conn(0x7f45040d5840 0x7f45040d14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:26.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.836+0000 7f4501ffb640 1 -- 172.21.15.18:0/2792579904 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45040d3aa0 con 0x7f45040d1a20 2024-09-19T09:14:26.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.836+0000 7f4501ffb640 1 -- 172.21.15.18:0/2792579904 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f44fc001670 con 0x7f45040d1a20 2024-09-19T09:14:26.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.836+0000 7f4501ffb640 1 -- 172.21.15.18:0/2792579904 >> v1:172.21.15.18:6789/0 conn(0x7f45040d1a20 legacy=0x7f45040cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:26.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.836+0000 7f4501ffb640 1 --2- 172.21.15.18:0/2792579904 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f450415ede0 0x7f44ec0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:26.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.836+0000 7f4501ffb640 1 --2- 172.21.15.18:0/2792579904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44ec003f30 0x7f44ec004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:26.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.836+0000 7f4501ffb640 1 --2- 172.21.15.18:0/2792579904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44ec004d40 0x7f44ec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:26.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.836+0000 7f4501ffb640 1 -- 172.21.15.18:0/2792579904 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f45040d34e0 con 0x7f44ec004d40 2024-09-19T09:14:26.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.836+0000 7f4501ffb640 1 -- 172.21.15.18:0/2792579904 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f45040d37c0 con 0x7f44ec003f30 2024-09-19T09:14:26.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.836+0000 7f4501ffb640 1 -- 172.21.15.18:0/2792579904 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f44ec00b9f0 con 0x7f450415ede0 2024-09-19T09:14:26.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.836+0000 7f45037fe640 1 --2- 172.21.15.18:0/2792579904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44ec004d40 0x7f44ec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:26.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.836+0000 7f4502ffd640 1 --2- 172.21.15.18:0/2792579904 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f450415ede0 0x7f44ec0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:26.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.836+0000 7f45027fc640 1 --2- 172.21.15.18:0/2792579904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44ec003f30 0x7f44ec004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:26.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.837+0000 7f45037fe640 1 -- 172.21.15.18:0/2792579904 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f450415ede0 msgr2=0x7f44ec0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:26.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.837+0000 7f45037fe640 1 --2- 172.21.15.18:0/2792579904 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f450415ede0 0x7f44ec0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:26.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.837+0000 7f45037fe640 1 -- 172.21.15.18:0/2792579904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44ec003f30 msgr2=0x7f44ec004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:26.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.837+0000 7f45037fe640 1 --2- 172.21.15.18:0/2792579904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44ec003f30 0x7f44ec004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:26.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.837+0000 7f45037fe640 1 -- 172.21.15.18:0/2792579904 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44ec003520 con 0x7f44ec004d40 2024-09-19T09:14:26.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.837+0000 7f45037fe640 1 --2- 172.21.15.18:0/2792579904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44ec004d40 0x7f44ec0051c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f44fc001050 tx=0x7f44ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e46fc8673be22ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:26.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.838+0000 7f4501ffb640 1 -- 172.21.15.18:0/2792579904 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44fc02e070 con 0x7f44ec004d40 2024-09-19T09:14:26.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.838+0000 7f4501ffb640 1 -- 172.21.15.18:0/2792579904 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44fc005af0 con 0x7f44ec004d40 2024-09-19T09:14:26.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.838+0000 7f4501ffb640 1 -- 172.21.15.18:0/2792579904 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44fc007d70 con 0x7f44ec004d40 2024-09-19T09:14:26.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.838+0000 7f4509a5e640 1 -- 172.21.15.18:0/2792579904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44ec004d40 msgr2=0x7f44ec0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:26.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.838+0000 7f4509a5e640 1 --2- 172.21.15.18:0/2792579904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44ec004d40 0x7f44ec0051c0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f44fc001050 tx=0x7f44ec005830 comp rx=0 tx=0).stop 2024-09-19T09:14:26.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.838+0000 7f45037fe640 1 -- 172.21.15.18:0/2792579904 reap_dead start 2024-09-19T09:14:26.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.838+0000 7f4509a5e640 1 -- 172.21.15.18:0/2792579904 shutdown_connections 2024-09-19T09:14:26.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.838+0000 7f4509a5e640 1 -- 172.21.15.18:0/2792579904 >> 172.21.15.18:0/2792579904 conn(0x7f450409df30 msgr2=0x7f45040d4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:26.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.838+0000 7f4509a5e640 1 -- 172.21.15.18:0/2792579904 shutdown_connections 2024-09-19T09:14:26.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.838+0000 7f4509a5e640 1 -- 172.21.15.18:0/2792579904 wait complete. 2024-09-19T09:14:26.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.839+0000 7f4509a5e640 1 Processor -- start 2024-09-19T09:14:26.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.840+0000 7f4509a5e640 1 -- start start 2024-09-19T09:14:26.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.840+0000 7f4509a5e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44ec004d40 0x7f4504160ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:26.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.840+0000 7f4509a5e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4504161400 0x7f45040b3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:26.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.840+0000 7f4509a5e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45040b8c10 0x7f45040b36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:26.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.840+0000 7f4509a5e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f45040b41a0 con 0x7f45040b8c10 2024-09-19T09:14:26.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.840+0000 7f4509a5e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f45040b4020 con 0x7f4504161400 2024-09-19T09:14:26.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.840+0000 7f4509a5e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f45040b57f0 con 0x7f44ec004d40 2024-09-19T09:14:26.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.840+0000 7f45037fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45040b8c10 0x7f45040b36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:26.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.840+0000 7f45037fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45040b8c10 0x7f45040b36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45844/0 (socket says 172.21.15.18:45844) 2024-09-19T09:14:26.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.840+0000 7f45037fe640 1 -- 172.21.15.18:0/3304591763 learned_addr learned my addr 172.21.15.18:0/3304591763 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:26.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.841+0000 7f45037fe640 1 -- 172.21.15.18:0/3304591763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44ec004d40 msgr2=0x7f4504160ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:26.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.841+0000 7f45037fe640 1 --2- 172.21.15.18:0/3304591763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44ec004d40 0x7f4504160ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:26.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.841+0000 7f45037fe640 1 -- 172.21.15.18:0/3304591763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4504161400 msgr2=0x7f45040b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:26.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.841+0000 7f45037fe640 1 --2- 172.21.15.18:0/3304591763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4504161400 0x7f45040b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:26.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.841+0000 7f45037fe640 1 -- 172.21.15.18:0/3304591763 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45040b90d0 con 0x7f45040b8c10 2024-09-19T09:14:26.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.841+0000 7f45037fe640 1 --2- 172.21.15.18:0/3304591763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45040b8c10 0x7f45040b36a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f44fc000c00 tx=0x7f44fc000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:26.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.841+0000 7f44ebfff640 1 -- 172.21.15.18:0/3304591763 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44fc007480 con 0x7f45040b8c10 2024-09-19T09:14:26.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.841+0000 7f44ebfff640 1 -- 172.21.15.18:0/3304591763 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44fc044070 con 0x7f45040b8c10 2024-09-19T09:14:26.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.841+0000 7f44ebfff640 1 -- 172.21.15.18:0/3304591763 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44fc007d50 con 0x7f45040b8c10 2024-09-19T09:14:26.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.841+0000 7f4509a5e640 1 -- 172.21.15.18:0/3304591763 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45040b93b0 con 0x7f45040b8c10 2024-09-19T09:14:26.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.841+0000 7f4509a5e640 1 -- 172.21.15.18:0/3304591763 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45040b9970 con 0x7f45040b8c10 2024-09-19T09:14:26.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.842+0000 7f4509a5e640 1 -- 172.21.15.18:0/3304591763 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45040d14e0 con 0x7f45040b8c10 2024-09-19T09:14:26.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.843+0000 7f44ebfff640 1 -- 172.21.15.18:0/3304591763 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f44fc03e480 con 0x7f45040b8c10 2024-09-19T09:14:26.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.843+0000 7f44ebfff640 1 --2- 172.21.15.18:0/3304591763 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f44f006c2b0 0x7f44f006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:26.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.843+0000 7f44ebfff640 1 -- 172.21.15.18:0/3304591763 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5911+0+0 (secure 0 0 0) 0x7f44fc0abd10 con 0x7f45040b8c10 2024-09-19T09:14:26.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.843+0000 7f4502ffd640 1 --2- 172.21.15.18:0/3304591763 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f44f006c2b0 0x7f44f006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:26.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.844+0000 7f4502ffd640 1 --2- 172.21.15.18:0/3304591763 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f44f006c2b0 0x7f44f006e770 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f44f4009fc0 tx=0x7f44f4009750 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:26.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:26.847+0000 7f44ebfff640 1 -- 172.21.15.18:0/3304591763 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f44fc07a3b0 con 0x7f45040b8c10 2024-09-19T09:14:27.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.060+0000 7f4509a5e640 1 -- 172.21.15.18:0/3304591763 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f45040d0ad0 con 0x7f45040b8c10 2024-09-19T09:14:27.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.714+0000 7f44ebfff640 1 -- 172.21.15.18:0/3304591763 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v15) ==== 104+0+0 (secure 0 0 0) 0x7f44fc079cb0 con 0x7f45040b8c10 2024-09-19T09:14:27.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.716+0000 7f4509a5e640 1 -- 172.21.15.18:0/3304591763 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f44f006c2b0 msgr2=0x7f44f006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:27.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.716+0000 7f4509a5e640 1 --2- 172.21.15.18:0/3304591763 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f44f006c2b0 0x7f44f006e770 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f44f4009fc0 tx=0x7f44f4009750 comp rx=0 tx=0).stop 2024-09-19T09:14:27.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.716+0000 7f4509a5e640 1 -- 172.21.15.18:0/3304591763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45040b8c10 msgr2=0x7f45040b36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:27.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.716+0000 7f4509a5e640 1 --2- 172.21.15.18:0/3304591763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45040b8c10 0x7f45040b36a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f44fc000c00 tx=0x7f44fc000fe0 comp rx=0 tx=0).stop 2024-09-19T09:14:27.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.716+0000 7f4509a5e640 1 -- 172.21.15.18:0/3304591763 shutdown_connections 2024-09-19T09:14:27.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.716+0000 7f4509a5e640 1 --2- 172.21.15.18:0/3304591763 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f44f006c2b0 0x7f44f006e770 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:27.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.716+0000 7f4509a5e640 1 --2- 172.21.15.18:0/3304591763 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f45040b8c10 0x7f45040b36a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:27.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.716+0000 7f4509a5e640 1 --2- 172.21.15.18:0/3304591763 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4504161400 0x7f45040b3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:27.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.716+0000 7f4509a5e640 1 --2- 172.21.15.18:0/3304591763 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44ec004d40 0x7f4504160ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:27.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.716+0000 7f4509a5e640 1 -- 172.21.15.18:0/3304591763 >> 172.21.15.18:0/3304591763 conn(0x7f450409df30 msgr2=0x7f45040d4ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:27.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.717+0000 7f4509a5e640 1 -- 172.21.15.18:0/3304591763 shutdown_connections 2024-09-19T09:14:27.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.717+0000 7f4509a5e640 1 -- 172.21.15.18:0/3304591763 wait complete. 2024-09-19T09:14:27.730 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T09:14:27.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.882+0000 7fe1de981640 1 Processor -- start 2024-09-19T09:14:27.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.882+0000 7fe1de981640 1 -- start start 2024-09-19T09:14:27.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.883+0000 7fe1de981640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1d815edb0 0x7fe1d80d29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:27.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.883+0000 7fe1de981640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe1d80d0370 0x7fe1d80d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:27.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.883+0000 7fe1de981640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe1d80d37c0 0x7fe1d80d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:27.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.883+0000 7fe1de981640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fe1d80b4400 con 0x7fe1d80d37c0 2024-09-19T09:14:27.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.883+0000 7fe1de981640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe1d80d0870 con 0x7fe1d80d0370 2024-09-19T09:14:27.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.883+0000 7fe1de981640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe1d80d0b50 con 0x7fe1d815edb0 2024-09-19T09:14:27.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.883+0000 7fe1dcf1e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe1d80d37c0 0x7fe1d80d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:27.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.883+0000 7fe1dcf1e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe1d80d37c0 0x7fe1d80d1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45850/0 (socket says 172.21.15.18:45850) 2024-09-19T09:14:27.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.883+0000 7fe1dcf1e640 1 -- 172.21.15.18:0/2721595016 learned_addr learned my addr 172.21.15.18:0/2721595016 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:27.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.884+0000 7fe1d7fff640 1 --2- 172.21.15.18:0/2721595016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1d815edb0 0x7fe1d80d29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:27.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.884+0000 7fe1d77fe640 1 --2- 172.21.15.18:0/2721595016 >> v2:172.21.15.162:3300/0 conn(0x7fe1d80d0370 0x7fe1d80d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:27.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.884+0000 7fe1dcf1e640 1 -- 172.21.15.18:0/2721595016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1d815edb0 msgr2=0x7fe1d80d29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:27.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.884+0000 7fe1dcf1e640 1 --2- 172.21.15.18:0/2721595016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1d815edb0 0x7fe1d80d29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:27.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.884+0000 7fe1dcf1e640 1 -- 172.21.15.18:0/2721595016 >> v2:172.21.15.162:3300/0 conn(0x7fe1d80d0370 msgr2=0x7fe1d80d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:27.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.884+0000 7fe1dcf1e640 1 --2- 172.21.15.18:0/2721595016 >> v2:172.21.15.162:3300/0 conn(0x7fe1d80d0370 0x7fe1d80d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:27.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.884+0000 7fe1dcf1e640 1 -- 172.21.15.18:0/2721595016 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d80b4620 con 0x7fe1d80d37c0 2024-09-19T09:14:27.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.884+0000 7fe1dcf1e640 1 --2- 172.21.15.18:0/2721595016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1d80d37c0 0x7fe1d80d1520 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe1d806c360 tx=0x7fe1d002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8ed0ed2231f7fc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:27.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.885+0000 7fe1d6ffd640 1 -- 172.21.15.18:0/2721595016 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0036070 con 0x7fe1d80d37c0 2024-09-19T09:14:27.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.885+0000 7fe1d6ffd640 1 -- 172.21.15.18:0/2721595016 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1d0031600 con 0x7fe1d80d37c0 2024-09-19T09:14:27.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.885+0000 7fe1d6ffd640 1 -- 172.21.15.18:0/2721595016 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d00319d0 con 0x7fe1d80d37c0 2024-09-19T09:14:27.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.885+0000 7fe1de981640 1 -- 172.21.15.18:0/2721595016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1d80d37c0 msgr2=0x7fe1d80d1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:27.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.885+0000 7fe1de981640 1 --2- 172.21.15.18:0/2721595016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1d80d37c0 0x7fe1d80d1520 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe1d806c360 tx=0x7fe1d002a6a0 comp rx=0 tx=0).stop 2024-09-19T09:14:27.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.885+0000 7fe1de981640 1 -- 172.21.15.18:0/2721595016 shutdown_connections 2024-09-19T09:14:27.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.885+0000 7fe1de981640 1 --2- 172.21.15.18:0/2721595016 >> v2:172.21.15.162:3300/0 conn(0x7fe1d80d0370 0x7fe1d80d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:27.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.885+0000 7fe1de981640 1 --2- 172.21.15.18:0/2721595016 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1d80d37c0 0x7fe1d80d1520 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:27.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.885+0000 7fe1de981640 1 --2- 172.21.15.18:0/2721595016 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1d815edb0 0x7fe1d80d29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:27.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.885+0000 7fe1de981640 1 -- 172.21.15.18:0/2721595016 >> 172.21.15.18:0/2721595016 conn(0x7fe1d809df30 msgr2=0x7fe1d80d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:27.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.885+0000 7fe1de981640 1 -- 172.21.15.18:0/2721595016 shutdown_connections 2024-09-19T09:14:27.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.885+0000 7fe1de981640 1 -- 172.21.15.18:0/2721595016 wait complete. 2024-09-19T09:14:27.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.886+0000 7fe1de981640 1 Processor -- start 2024-09-19T09:14:27.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.887+0000 7fe1de981640 1 -- start start 2024-09-19T09:14:27.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.887+0000 7fe1de981640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1d80d0370 0x7fe1d814ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:27.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.887+0000 7fe1de981640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1d80d37c0 0x7fe1d8151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:27.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.887+0000 7fe1de981640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1d815edb0 0x7fe1d8154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:27.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.887+0000 7fe1de981640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d815f190 con 0x7fe1d815edb0 2024-09-19T09:14:27.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.887+0000 7fe1de981640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe1d80b4be0 con 0x7fe1d80d0370 2024-09-19T09:14:27.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.887+0000 7fe1de981640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe1d80d2f20 con 0x7fe1d80d37c0 2024-09-19T09:14:27.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.887+0000 7fe1dcf1e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1d815edb0 0x7fe1d8154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:27.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.888+0000 7fe1dcf1e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1d815edb0 0x7fe1d8154720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45858/0 (socket says 172.21.15.18:45858) 2024-09-19T09:14:27.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.888+0000 7fe1dcf1e640 1 -- 172.21.15.18:0/3564477880 learned_addr learned my addr 172.21.15.18:0/3564477880 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:27.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.888+0000 7fe1dcf1e640 1 -- 172.21.15.18:0/3564477880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1d80d37c0 msgr2=0x7fe1d8151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:27.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.888+0000 7fe1d77fe640 1 --2- 172.21.15.18:0/3564477880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1d80d37c0 0x7fe1d8151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:27.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.888+0000 7fe1d7fff640 1 --2- 172.21.15.18:0/3564477880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1d80d0370 0x7fe1d814ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:27.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.888+0000 7fe1dcf1e640 1 --2- 172.21.15.18:0/3564477880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1d80d37c0 0x7fe1d8151720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:27.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.888+0000 7fe1dcf1e640 1 -- 172.21.15.18:0/3564477880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1d80d0370 msgr2=0x7fe1d814ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:27.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.888+0000 7fe1dcf1e640 1 --2- 172.21.15.18:0/3564477880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1d80d0370 0x7fe1d814ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:27.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.888+0000 7fe1dcf1e640 1 -- 172.21.15.18:0/3564477880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1d8154e50 con 0x7fe1d815edb0 2024-09-19T09:14:27.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.888+0000 7fe1d77fe640 1 --2- 172.21.15.18:0/3564477880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1d80d37c0 0x7fe1d8151720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:14:27.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.888+0000 7fe1d7fff640 1 --2- 172.21.15.18:0/3564477880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1d80d0370 0x7fe1d814ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:14:27.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.888+0000 7fe1dcf1e640 1 --2- 172.21.15.18:0/3564477880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1d815edb0 0x7fe1d8154720 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0009f40 tx=0x7fe1d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:27.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.888+0000 7fe1d4ff9640 1 -- 172.21.15.18:0/3564477880 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0036050 con 0x7fe1d815edb0 2024-09-19T09:14:27.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.888+0000 7fe1d4ff9640 1 -- 172.21.15.18:0/3564477880 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1d0042070 con 0x7fe1d815edb0 2024-09-19T09:14:27.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.888+0000 7fe1de981640 1 -- 172.21.15.18:0/3564477880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1d80ca100 con 0x7fe1d815edb0 2024-09-19T09:14:27.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.888+0000 7fe1d4ff9640 1 -- 172.21.15.18:0/3564477880 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d0009510 con 0x7fe1d815edb0 2024-09-19T09:14:27.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.888+0000 7fe1de981640 1 -- 172.21.15.18:0/3564477880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1d80ca6c0 con 0x7fe1d815edb0 2024-09-19T09:14:27.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.889+0000 7fe1de981640 1 -- 172.21.15.18:0/3564477880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1d80d3280 con 0x7fe1d815edb0 2024-09-19T09:14:27.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.890+0000 7fe1d4ff9640 1 -- 172.21.15.18:0/3564477880 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe1d0007bf0 con 0x7fe1d815edb0 2024-09-19T09:14:27.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.890+0000 7fe1d4ff9640 1 --2- 172.21.15.18:0/3564477880 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe1b806c2b0 0x7fe1b806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:27.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.890+0000 7fe1d4ff9640 1 -- 172.21.15.18:0/3564477880 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5911+0+0 (secure 0 0 0) 0x7fe1d00ac2e0 con 0x7fe1d815edb0 2024-09-19T09:14:27.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.890+0000 7fe1d7fff640 1 --2- 172.21.15.18:0/3564477880 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe1b806c2b0 0x7fe1b806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:27.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.891+0000 7fe1d7fff640 1 --2- 172.21.15.18:0/3564477880 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe1b806c2b0 0x7fe1b806e770 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8009a20 tx=0x7fe1c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:27.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:27.895+0000 7fe1d4ff9640 1 -- 172.21.15.18:0/3564477880 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe1d007a980 con 0x7fe1d815edb0 2024-09-19T09:14:28.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:28.071+0000 7fe1de981640 1 -- 172.21.15.18:0/3564477880 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe1d80b1d90 con 0x7fe1d815edb0 2024-09-19T09:14:28.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:28.884+0000 7fe1d4ff9640 1 -- 172.21.15.18:0/3564477880 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v38) ==== 181+0+0 (secure 0 0 0) 0x7fe1d007a280 con 0x7fe1d815edb0 2024-09-19T09:14:28.885 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' removed 2024-09-19T09:14:28.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:28.887+0000 7fe1de981640 1 -- 172.21.15.18:0/3564477880 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe1b806c2b0 msgr2=0x7fe1b806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:28.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:28.887+0000 7fe1de981640 1 --2- 172.21.15.18:0/3564477880 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe1b806c2b0 0x7fe1b806e770 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fe1c8009a20 tx=0x7fe1c8008040 comp rx=0 tx=0).stop 2024-09-19T09:14:28.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:28.887+0000 7fe1de981640 1 -- 172.21.15.18:0/3564477880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1d815edb0 msgr2=0x7fe1d8154720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:28.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:28.887+0000 7fe1de981640 1 --2- 172.21.15.18:0/3564477880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1d815edb0 0x7fe1d8154720 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0009f40 tx=0x7fe1d0004a40 comp rx=0 tx=0).stop 2024-09-19T09:14:28.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:28.887+0000 7fe1de981640 1 -- 172.21.15.18:0/3564477880 shutdown_connections 2024-09-19T09:14:28.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:28.887+0000 7fe1de981640 1 --2- 172.21.15.18:0/3564477880 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe1b806c2b0 0x7fe1b806e770 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:28.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:28.887+0000 7fe1de981640 1 --2- 172.21.15.18:0/3564477880 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1d815edb0 0x7fe1d8154720 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:28.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:28.887+0000 7fe1de981640 1 --2- 172.21.15.18:0/3564477880 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1d80d37c0 0x7fe1d8151720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:28.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:28.887+0000 7fe1de981640 1 --2- 172.21.15.18:0/3564477880 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1d80d0370 0x7fe1d814ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:28.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:28.887+0000 7fe1de981640 1 -- 172.21.15.18:0/3564477880 >> 172.21.15.18:0/3564477880 conn(0x7fe1d809df30 msgr2=0x7fe1d80b9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:28.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:28.887+0000 7fe1de981640 1 -- 172.21.15.18:0/3564477880 shutdown_connections 2024-09-19T09:14:28.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:28.887+0000 7fe1de981640 1 -- 172.21.15.18:0/3564477880 wait complete. 2024-09-19T09:14:28.902 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T09:14:29.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.016+0000 7fcd8d39f640 1 Processor -- start 2024-09-19T09:14:29.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.016+0000 7fcd8d39f640 1 -- start start 2024-09-19T09:14:29.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.017+0000 7fcd8d39f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcd880c90f0 0x7fcd880d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:29.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.017+0000 7fcd8d39f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd880d17c0 0x7fcd880cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:29.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.017+0000 7fcd8d39f640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd880d0be0 con 0x7fcd880d01a0 2024-09-19T09:14:29.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.017+0000 7fcd8d39f640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fcd880c94d0 con 0x7fcd880c90f0 2024-09-19T09:14:29.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.017+0000 7fcd8d39f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcd880b5420 con 0x7fcd880d17c0 2024-09-19T09:14:29.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.017+0000 7fcd86ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcd880c90f0 0x7fcd880d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:29.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.017+0000 7fcd86ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcd880c90f0 0x7fcd880d06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45866/0 (socket says 172.21.15.18:45866) 2024-09-19T09:14:29.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.017+0000 7fcd86ffd640 1 -- 172.21.15.18:0/410393784 learned_addr learned my addr 172.21.15.18:0/410393784 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:29.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.017+0000 7fcd86ffd640 1 -- 172.21.15.18:0/410393784 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd880d17c0 msgr2=0x7fcd880cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:29.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.017+0000 7fcd86ffd640 1 --2- 172.21.15.18:0/410393784 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd880d17c0 0x7fcd880cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:29.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.017+0000 7fcd86ffd640 1 -- 172.21.15.18:0/410393784 >> v1:172.21.15.162:6789/0 conn(0x7fcd880d01a0 legacy=0x7fcd880d10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:29.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.017+0000 7fcd86ffd640 1 -- 172.21.15.18:0/410393784 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd880b3a80 con 0x7fcd880c90f0 2024-09-19T09:14:29.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.018+0000 7fcd86ffd640 1 --2- 172.21.15.18:0/410393784 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd880c90f0 0x7fcd880d06a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcd88072400 tx=0x7fcd7802a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eae0af00de8ac8e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:29.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.018+0000 7fcd85ffb640 1 -- 172.21.15.18:0/410393784 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78037070 con 0x7fcd880c90f0 2024-09-19T09:14:29.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.018+0000 7fcd85ffb640 1 -- 172.21.15.18:0/410393784 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd78032440 con 0x7fcd880c90f0 2024-09-19T09:14:29.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.018+0000 7fcd85ffb640 1 -- 172.21.15.18:0/410393784 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78032810 con 0x7fcd880c90f0 2024-09-19T09:14:29.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.018+0000 7fcd8d39f640 1 -- 172.21.15.18:0/410393784 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd880c90f0 msgr2=0x7fcd880d06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:29.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.018+0000 7fcd8d39f640 1 --2- 172.21.15.18:0/410393784 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd880c90f0 0x7fcd880d06a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fcd88072400 tx=0x7fcd7802a160 comp rx=0 tx=0).stop 2024-09-19T09:14:29.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.019+0000 7fcd8d39f640 1 -- 172.21.15.18:0/410393784 shutdown_connections 2024-09-19T09:14:29.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.019+0000 7fcd8d39f640 1 --2- 172.21.15.18:0/410393784 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd880d17c0 0x7fcd880cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:29.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.019+0000 7fcd8d39f640 1 --2- 172.21.15.18:0/410393784 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd880c90f0 0x7fcd880d06a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:29.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.019+0000 7fcd8d39f640 1 -- 172.21.15.18:0/410393784 >> 172.21.15.18:0/410393784 conn(0x7fcd880b4660 msgr2=0x7fcd880b4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:29.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.019+0000 7fcd8d39f640 1 -- 172.21.15.18:0/410393784 shutdown_connections 2024-09-19T09:14:29.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.019+0000 7fcd8d39f640 1 -- 172.21.15.18:0/410393784 wait complete. 2024-09-19T09:14:29.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.020+0000 7fcd8d39f640 1 Processor -- start 2024-09-19T09:14:29.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.020+0000 7fcd8d39f640 1 -- start start 2024-09-19T09:14:29.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.021+0000 7fcd8d39f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd880c90f0 0x7fcd8815a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:29.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.021+0000 7fcd8d39f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd880d01a0 0x7fcd8815b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:29.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.021+0000 7fcd8d39f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd880d17c0 0x7fcd8806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:29.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.021+0000 7fcd8d39f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcd880cfc80 con 0x7fcd880c90f0 2024-09-19T09:14:29.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.021+0000 7fcd8d39f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcd880b4040 con 0x7fcd880d17c0 2024-09-19T09:14:29.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.021+0000 7fcd8d39f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcd880cdb00 con 0x7fcd880d01a0 2024-09-19T09:14:29.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.021+0000 7fcd86ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd880c90f0 0x7fcd8815a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:29.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.021+0000 7fcd86ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd880c90f0 0x7fcd8815a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45878/0 (socket says 172.21.15.18:45878) 2024-09-19T09:14:29.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.021+0000 7fcd86ffd640 1 -- 172.21.15.18:0/3978271319 learned_addr learned my addr 172.21.15.18:0/3978271319 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:29.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.021+0000 7fcd867fc640 1 --2- 172.21.15.18:0/3978271319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd880d01a0 0x7fcd8815b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:29.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.021+0000 7fcd877fe640 1 --2- 172.21.15.18:0/3978271319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd880d17c0 0x7fcd8806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:29.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.021+0000 7fcd86ffd640 1 -- 172.21.15.18:0/3978271319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd880d01a0 msgr2=0x7fcd8815b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:29.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.021+0000 7fcd86ffd640 1 --2- 172.21.15.18:0/3978271319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd880d01a0 0x7fcd8815b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:29.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.021+0000 7fcd86ffd640 1 -- 172.21.15.18:0/3978271319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd880d17c0 msgr2=0x7fcd8806cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:29.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.021+0000 7fcd86ffd640 1 --2- 172.21.15.18:0/3978271319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd880d17c0 0x7fcd8806cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:29.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.021+0000 7fcd86ffd640 1 -- 172.21.15.18:0/3978271319 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd8806d700 con 0x7fcd880c90f0 2024-09-19T09:14:29.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.021+0000 7fcd86ffd640 1 --2- 172.21.15.18:0/3978271319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd880c90f0 0x7fcd8815a530 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcd78000c00 tx=0x7fcd780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:29.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.021+0000 7fcd6f7fe640 1 -- 172.21.15.18:0/3978271319 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78041070 con 0x7fcd880c90f0 2024-09-19T09:14:29.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.022+0000 7fcd6f7fe640 1 -- 172.21.15.18:0/3978271319 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd7803c890 con 0x7fcd880c90f0 2024-09-19T09:14:29.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.022+0000 7fcd8d39f640 1 -- 172.21.15.18:0/3978271319 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd8806d9e0 con 0x7fcd880c90f0 2024-09-19T09:14:29.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.022+0000 7fcd6f7fe640 1 -- 172.21.15.18:0/3978271319 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78037040 con 0x7fcd880c90f0 2024-09-19T09:14:29.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.022+0000 7fcd8d39f640 1 -- 172.21.15.18:0/3978271319 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd8806e8e0 con 0x7fcd880c90f0 2024-09-19T09:14:29.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.023+0000 7fcd8d39f640 1 -- 172.21.15.18:0/3978271319 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd880d06a0 con 0x7fcd880c90f0 2024-09-19T09:14:29.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.023+0000 7fcd6f7fe640 1 -- 172.21.15.18:0/3978271319 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcd78044070 con 0x7fcd880c90f0 2024-09-19T09:14:29.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.024+0000 7fcd6f7fe640 1 --2- 172.21.15.18:0/3978271319 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcd7406c2b0 0x7fcd7406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:29.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.024+0000 7fcd6f7fe640 1 -- 172.21.15.18:0/3978271319 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 5473+0+0 (secure 0 0 0) 0x7fcd780ac310 con 0x7fcd880c90f0 2024-09-19T09:14:29.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.024+0000 7fcd867fc640 1 --2- 172.21.15.18:0/3978271319 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcd7406c2b0 0x7fcd7406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:29.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.025+0000 7fcd867fc640 1 --2- 172.21.15.18:0/3978271319 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcd7406c2b0 0x7fcd7406e770 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c007fd0 tx=0x7fcd7c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:29.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.028+0000 7fcd6f7fe640 1 -- 172.21.15.18:0/3978271319 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fcd7807ad10 con 0x7fcd880c90f0 2024-09-19T09:14:29.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.206+0000 7fcd8d39f640 1 -- 172.21.15.18:0/3978271319 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcd880cd1c0 con 0x7fcd880c90f0 2024-09-19T09:14:29.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.889+0000 7fcd6f7fe640 1 -- 172.21.15.18:0/3978271319 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v39) ==== 169+0+0 (secure 0 0 0) 0x7fcd7807a610 con 0x7fcd880c90f0 2024-09-19T09:14:29.890 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' removed 2024-09-19T09:14:29.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.892+0000 7fcd8d39f640 1 -- 172.21.15.18:0/3978271319 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcd7406c2b0 msgr2=0x7fcd7406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:29.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.892+0000 7fcd8d39f640 1 --2- 172.21.15.18:0/3978271319 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcd7406c2b0 0x7fcd7406e770 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c007fd0 tx=0x7fcd7c009040 comp rx=0 tx=0).stop 2024-09-19T09:14:29.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.892+0000 7fcd8d39f640 1 -- 172.21.15.18:0/3978271319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd880c90f0 msgr2=0x7fcd8815a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:29.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.892+0000 7fcd8d39f640 1 --2- 172.21.15.18:0/3978271319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd880c90f0 0x7fcd8815a530 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcd78000c00 tx=0x7fcd780046c0 comp rx=0 tx=0).stop 2024-09-19T09:14:29.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.892+0000 7fcd8d39f640 1 -- 172.21.15.18:0/3978271319 shutdown_connections 2024-09-19T09:14:29.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.892+0000 7fcd8d39f640 1 --2- 172.21.15.18:0/3978271319 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcd7406c2b0 0x7fcd7406e770 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:29.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.892+0000 7fcd8d39f640 1 --2- 172.21.15.18:0/3978271319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcd880d17c0 0x7fcd8806cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:29.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.892+0000 7fcd8d39f640 1 --2- 172.21.15.18:0/3978271319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcd880d01a0 0x7fcd8815b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:29.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.892+0000 7fcd8d39f640 1 --2- 172.21.15.18:0/3978271319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcd880c90f0 0x7fcd8815a530 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:29.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.892+0000 7fcd8d39f640 1 -- 172.21.15.18:0/3978271319 >> 172.21.15.18:0/3978271319 conn(0x7fcd880b4660 msgr2=0x7fcd8815f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:29.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.892+0000 7fcd8d39f640 1 -- 172.21.15.18:0/3978271319 shutdown_connections 2024-09-19T09:14:29.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:29.892+0000 7fcd8d39f640 1 -- 172.21.15.18:0/3978271319 wait complete. 2024-09-19T09:14:29.909 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-19T09:14:30.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.019+0000 7f2dcdd31640 1 Processor -- start 2024-09-19T09:14:30.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.019+0000 7f2dcdd31640 1 -- start start 2024-09-19T09:14:30.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.020+0000 7f2dcdd31640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2dc815a670 0x7f2dc815dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:30.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.020+0000 7f2dcdd31640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2dc80b5970 0x7f2dc80b6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:30.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.020+0000 7f2dcdd31640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2dc80b69c0 0x7f2dc8160610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:30.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.020+0000 7f2dcdd31640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f2dc80b6150 con 0x7f2dc80b69c0 2024-09-19T09:14:30.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.020+0000 7f2dcdd31640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2dc815aa50 con 0x7f2dc815a670 2024-09-19T09:14:30.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.020+0000 7f2dcdd31640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2dc815e310 con 0x7f2dc80b5970 2024-09-19T09:14:30.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.020+0000 7f2dc7fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2dc80b69c0 0x7f2dc8160610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:30.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.021+0000 7f2dc7fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2dc80b69c0 0x7f2dc8160610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45882/0 (socket says 172.21.15.18:45882) 2024-09-19T09:14:30.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.021+0000 7f2dc7fff640 1 -- 172.21.15.18:0/2474024438 learned_addr learned my addr 172.21.15.18:0/2474024438 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:30.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.021+0000 7f2dc77fe640 1 --2- 172.21.15.18:0/2474024438 >> v2:172.21.15.162:3300/0 conn(0x7f2dc815a670 0x7f2dc815dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:30.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.021+0000 7f2dc6ffd640 1 --2- 172.21.15.18:0/2474024438 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2dc80b5970 0x7f2dc80b6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:30.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.021+0000 7f2dc7fff640 1 -- 172.21.15.18:0/2474024438 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2dc80b5970 msgr2=0x7f2dc80b6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:30.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.021+0000 7f2dc7fff640 1 --2- 172.21.15.18:0/2474024438 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2dc80b5970 0x7f2dc80b6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:30.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.021+0000 7f2dc7fff640 1 -- 172.21.15.18:0/2474024438 >> v2:172.21.15.162:3300/0 conn(0x7f2dc815a670 msgr2=0x7f2dc815dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:30.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.021+0000 7f2dc7fff640 1 --2- 172.21.15.18:0/2474024438 >> v2:172.21.15.162:3300/0 conn(0x7f2dc815a670 0x7f2dc815dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:30.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.021+0000 7f2dc7fff640 1 -- 172.21.15.18:0/2474024438 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc815e5f0 con 0x7f2dc80b69c0 2024-09-19T09:14:30.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.021+0000 7f2dc77fe640 1 --2- 172.21.15.18:0/2474024438 >> v2:172.21.15.162:3300/0 conn(0x7f2dc815a670 0x7f2dc815dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:30.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.022+0000 7f2dc7fff640 1 --2- 172.21.15.18:0/2474024438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dc80b69c0 0x7f2dc8160610 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2dc80728c0 tx=0x7f2dc002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f91f75b19c55ed21 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:30.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.022+0000 7f2dc67fc640 1 -- 172.21.15.18:0/2474024438 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0036070 con 0x7f2dc80b69c0 2024-09-19T09:14:30.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.022+0000 7f2dc67fc640 1 -- 172.21.15.18:0/2474024438 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc0031600 con 0x7f2dc80b69c0 2024-09-19T09:14:30.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.022+0000 7f2dc67fc640 1 -- 172.21.15.18:0/2474024438 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc00319d0 con 0x7f2dc80b69c0 2024-09-19T09:14:30.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.022+0000 7f2dcdd31640 1 -- 172.21.15.18:0/2474024438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dc80b69c0 msgr2=0x7f2dc8160610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:30.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.022+0000 7f2dcdd31640 1 --2- 172.21.15.18:0/2474024438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dc80b69c0 0x7f2dc8160610 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f2dc80728c0 tx=0x7f2dc002a610 comp rx=0 tx=0).stop 2024-09-19T09:14:30.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.022+0000 7f2dcdd31640 1 -- 172.21.15.18:0/2474024438 shutdown_connections 2024-09-19T09:14:30.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.022+0000 7f2dcdd31640 1 --2- 172.21.15.18:0/2474024438 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dc80b69c0 0x7f2dc8160610 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:30.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.022+0000 7f2dcdd31640 1 --2- 172.21.15.18:0/2474024438 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2dc80b5970 0x7f2dc80b6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:30.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.022+0000 7f2dcdd31640 1 --2- 172.21.15.18:0/2474024438 >> v2:172.21.15.162:3300/0 conn(0x7f2dc815a670 0x7f2dc815dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:30.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.022+0000 7f2dcdd31640 1 -- 172.21.15.18:0/2474024438 >> 172.21.15.18:0/2474024438 conn(0x7f2dc809b9d0 msgr2=0x7f2dc809bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:30.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.022+0000 7f2dcdd31640 1 -- 172.21.15.18:0/2474024438 shutdown_connections 2024-09-19T09:14:30.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.022+0000 7f2dcdd31640 1 -- 172.21.15.18:0/2474024438 wait complete. 2024-09-19T09:14:30.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.024+0000 7f2dcdd31640 1 Processor -- start 2024-09-19T09:14:30.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.024+0000 7f2dcdd31640 1 -- start start 2024-09-19T09:14:30.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.025+0000 7f2dcdd31640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dc80b5970 0x7f2dc8146ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:30.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.025+0000 7f2dcdd31640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2dc80b69c0 0x7f2dc80b00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:30.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.025+0000 7f2dcdd31640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dc815a670 0x7f2dc8148d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:30.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.025+0000 7f2dcdd31640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc8160b50 con 0x7f2dc815a670 2024-09-19T09:14:30.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.025+0000 7f2dcdd31640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2dc80b5dd0 con 0x7f2dc80b5970 2024-09-19T09:14:30.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.025+0000 7f2dcdd31640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2dc8160cd0 con 0x7f2dc80b69c0 2024-09-19T09:14:30.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.025+0000 7f2dc7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dc815a670 0x7f2dc8148d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:30.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.025+0000 7f2dc7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dc815a670 0x7f2dc8148d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45894/0 (socket says 172.21.15.18:45894) 2024-09-19T09:14:30.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.025+0000 7f2dc7fff640 1 -- 172.21.15.18:0/2430835470 learned_addr learned my addr 172.21.15.18:0/2430835470 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:30.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.025+0000 7f2dc6ffd640 1 --2- 172.21.15.18:0/2430835470 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2dc80b69c0 0x7f2dc80b00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:30.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.025+0000 7f2dc77fe640 1 --2- 172.21.15.18:0/2430835470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dc80b5970 0x7f2dc8146ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:30.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.025+0000 7f2dc7fff640 1 -- 172.21.15.18:0/2430835470 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2dc80b69c0 msgr2=0x7f2dc80b00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:30.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.025+0000 7f2dc7fff640 1 --2- 172.21.15.18:0/2430835470 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2dc80b69c0 0x7f2dc80b00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:30.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.025+0000 7f2dc7fff640 1 -- 172.21.15.18:0/2430835470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dc80b5970 msgr2=0x7f2dc8146ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:30.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.025+0000 7f2dc7fff640 1 --2- 172.21.15.18:0/2430835470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dc80b5970 0x7f2dc8146ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:30.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.025+0000 7f2dc7fff640 1 -- 172.21.15.18:0/2430835470 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc8147ca0 con 0x7f2dc815a670 2024-09-19T09:14:30.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.025+0000 7f2dc77fe640 1 --2- 172.21.15.18:0/2430835470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dc80b5970 0x7f2dc8146ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:30.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.025+0000 7f2dc7fff640 1 --2- 172.21.15.18:0/2430835470 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dc815a670 0x7f2dc8148d40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009f40 tx=0x7f2dc0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:30.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.025+0000 7f2daffff640 1 -- 172.21.15.18:0/2430835470 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0041020 con 0x7f2dc815a670 2024-09-19T09:14:30.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.025+0000 7f2daffff640 1 -- 172.21.15.18:0/2430835470 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dc00077a0 con 0x7f2dc815a670 2024-09-19T09:14:30.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.025+0000 7f2dcdd31640 1 -- 172.21.15.18:0/2430835470 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dc8147f80 con 0x7f2dc815a670 2024-09-19T09:14:30.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.025+0000 7f2daffff640 1 -- 172.21.15.18:0/2430835470 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0036040 con 0x7f2dc815a670 2024-09-19T09:14:30.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.025+0000 7f2dcdd31640 1 -- 172.21.15.18:0/2430835470 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dc8148540 con 0x7f2dc815a670 2024-09-19T09:14:30.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.026+0000 7f2dcdd31640 1 -- 172.21.15.18:0/2430835470 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dc8160610 con 0x7f2dc815a670 2024-09-19T09:14:30.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.027+0000 7f2daffff640 1 -- 172.21.15.18:0/2430835470 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2dc0044020 con 0x7f2dc815a670 2024-09-19T09:14:30.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.027+0000 7f2daffff640 1 --2- 172.21.15.18:0/2430835470 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2db406c2b0 0x7f2db406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:30.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.027+0000 7f2daffff640 1 -- 172.21.15.18:0/2430835470 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7f2dc00abd90 con 0x7f2dc815a670 2024-09-19T09:14:30.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.028+0000 7f2dc77fe640 1 --2- 172.21.15.18:0/2430835470 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2db406c2b0 0x7f2db406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:30.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.028+0000 7f2dc77fe640 1 --2- 172.21.15.18:0/2430835470 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2db406c2b0 0x7f2db406e770 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2db8006fd0 tx=0x7f2db8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:30.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.032+0000 7f2daffff640 1 -- 172.21.15.18:0/2430835470 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2dc004b030 con 0x7f2dc815a670 2024-09-19T09:14:30.134 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:14:30.136 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:14:30.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.211+0000 7f2dcdd31640 1 -- 172.21.15.18:0/2430835470 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f2dc809c5f0 con 0x7f2dc815a670 2024-09-19T09:14:30.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.214+0000 7f2daffff640 1 -- 172.21.15.18:0/2430835470 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) ==== 104+0+0 (secure 0 0 0) 0x7f2dc007a770 con 0x7f2dc815a670 2024-09-19T09:14:30.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.216+0000 7f2dcdd31640 1 -- 172.21.15.18:0/2430835470 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2db406c2b0 msgr2=0x7f2db406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:30.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.216+0000 7f2dcdd31640 1 --2- 172.21.15.18:0/2430835470 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2db406c2b0 0x7f2db406e770 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2db8006fd0 tx=0x7f2db8008040 comp rx=0 tx=0).stop 2024-09-19T09:14:30.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.216+0000 7f2dcdd31640 1 -- 172.21.15.18:0/2430835470 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dc815a670 msgr2=0x7f2dc8148d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:30.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.216+0000 7f2dcdd31640 1 --2- 172.21.15.18:0/2430835470 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dc815a670 0x7f2dc8148d40 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0009f40 tx=0x7f2dc0004a40 comp rx=0 tx=0).stop 2024-09-19T09:14:30.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.216+0000 7f2dcdd31640 1 -- 172.21.15.18:0/2430835470 shutdown_connections 2024-09-19T09:14:30.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.216+0000 7f2dcdd31640 1 --2- 172.21.15.18:0/2430835470 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2db406c2b0 0x7f2db406e770 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:30.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.216+0000 7f2dcdd31640 1 --2- 172.21.15.18:0/2430835470 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2dc815a670 0x7f2dc8148d40 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:30.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.216+0000 7f2dcdd31640 1 --2- 172.21.15.18:0/2430835470 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2dc80b69c0 0x7f2dc80b00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:30.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.216+0000 7f2dcdd31640 1 --2- 172.21.15.18:0/2430835470 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2dc80b5970 0x7f2dc8146ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:30.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.216+0000 7f2dcdd31640 1 -- 172.21.15.18:0/2430835470 >> 172.21.15.18:0/2430835470 conn(0x7f2dc809b9d0 msgr2=0x7f2dc815fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:30.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.216+0000 7f2dcdd31640 1 -- 172.21.15.18:0/2430835470 shutdown_connections 2024-09-19T09:14:30.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.216+0000 7f2dcdd31640 1 -- 172.21.15.18:0/2430835470 wait complete. 2024-09-19T09:14:30.227 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2024-09-19T09:14:30.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.369+0000 7fe571f54640 1 Processor -- start 2024-09-19T09:14:30.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.369+0000 7fe571f54640 1 -- start start 2024-09-19T09:14:30.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.370+0000 7fe571f54640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe56c0cfae0 0x7fe56c0b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:30.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.370+0000 7fe571f54640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe56c06d730 0x7fe56c0cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:30.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.370+0000 7fe571f54640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe56c0cd1a0 con 0x7fe56c15ef80 2024-09-19T09:14:30.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.370+0000 7fe571f54640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fe56c0cd7d0 con 0x7fe56c0cfae0 2024-09-19T09:14:30.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.370+0000 7fe571f54640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe56c06dc30 con 0x7fe56c06d730 2024-09-19T09:14:30.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.370+0000 7fe56b7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe56c15ef80 0x7fe56c0cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50016/0 (socket says 172.21.15.18:50016) 2024-09-19T09:14:30.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.370+0000 7fe56b7fe640 1 -- 172.21.15.18:0/842456380 learned_addr learned my addr 172.21.15.18:0/842456380 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:30.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.370+0000 7fe56affd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe56c0cfae0 0x7fe56c0b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:30.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.370+0000 7fe56bfff640 1 --2- 172.21.15.18:0/842456380 >> v2:172.21.15.162:3300/0 conn(0x7fe56c06d730 0x7fe56c0cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:30.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.370+0000 7fe56affd640 1 -- 172.21.15.18:0/842456380 >> v2:172.21.15.162:3300/0 conn(0x7fe56c06d730 msgr2=0x7fe56c0cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:30.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.370+0000 7fe56affd640 1 --2- 172.21.15.18:0/842456380 >> v2:172.21.15.162:3300/0 conn(0x7fe56c06d730 0x7fe56c0cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:30.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.371+0000 7fe56affd640 1 -- 172.21.15.18:0/842456380 >> v1:172.21.15.18:6789/0 conn(0x7fe56c15ef80 legacy=0x7fe56c0cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:30.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.371+0000 7fe56a7fc640 1 -- 172.21.15.18:0/842456380 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 105704716 0 0) 0x7fe56c0cd1a0 con 0x7fe56c15ef80 2024-09-19T09:14:30.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.371+0000 7fe56affd640 1 -- 172.21.15.18:0/842456380 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe56c06df10 con 0x7fe56c0cfae0 2024-09-19T09:14:30.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.371+0000 7fe56affd640 1 --2- 172.21.15.18:0/842456380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe56c0cfae0 0x7fe56c0b5220 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe56c06f360 tx=0x7fe56002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c45b857197dd783 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:30.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.371+0000 7fe56a7fc640 1 -- 172.21.15.18:0/842456380 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe560037070 con 0x7fe56c0cfae0 2024-09-19T09:14:30.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.371+0000 7fe56a7fc640 1 -- 172.21.15.18:0/842456380 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe560032440 con 0x7fe56c0cfae0 2024-09-19T09:14:30.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.371+0000 7fe56a7fc640 1 -- 172.21.15.18:0/842456380 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe560032810 con 0x7fe56c0cfae0 2024-09-19T09:14:30.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.372+0000 7fe571f54640 1 -- 172.21.15.18:0/842456380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe56c0cfae0 msgr2=0x7fe56c0b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:30.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.372+0000 7fe571f54640 1 --2- 172.21.15.18:0/842456380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe56c0cfae0 0x7fe56c0b5220 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe56c06f360 tx=0x7fe56002a1a0 comp rx=0 tx=0).stop 2024-09-19T09:14:30.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.372+0000 7fe571f54640 1 -- 172.21.15.18:0/842456380 shutdown_connections 2024-09-19T09:14:30.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.372+0000 7fe571f54640 1 --2- 172.21.15.18:0/842456380 >> v2:172.21.15.162:3300/0 conn(0x7fe56c06d730 0x7fe56c0cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:30.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.372+0000 7fe571f54640 1 --2- 172.21.15.18:0/842456380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe56c0cfae0 0x7fe56c0b5220 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:30.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.372+0000 7fe571f54640 1 -- 172.21.15.18:0/842456380 >> 172.21.15.18:0/842456380 conn(0x7fe56c0b4700 msgr2=0x7fe56c0b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:30.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.372+0000 7fe571f54640 1 -- 172.21.15.18:0/842456380 shutdown_connections 2024-09-19T09:14:30.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.372+0000 7fe571f54640 1 -- 172.21.15.18:0/842456380 wait complete. 2024-09-19T09:14:30.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.373+0000 7fe571f54640 1 Processor -- start 2024-09-19T09:14:30.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.373+0000 7fe571f54640 1 -- start start 2024-09-19T09:14:30.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.374+0000 7fe571f54640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe56c06d730 0x7fe56c15dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:30.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.374+0000 7fe571f54640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe56c0cfae0 0x7fe56c0cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:30.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.374+0000 7fe571f54640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe56c15ef80 0x7fe56c0ca630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:30.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.374+0000 7fe571f54640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe56c0d0120 con 0x7fe56c06d730 2024-09-19T09:14:30.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.374+0000 7fe571f54640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe56c15f360 con 0x7fe56c0cfae0 2024-09-19T09:14:30.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.374+0000 7fe571f54640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe56c0ce1a0 con 0x7fe56c15ef80 2024-09-19T09:14:30.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.374+0000 7fe56b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe56c06d730 0x7fe56c15dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:30.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.374+0000 7fe56b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe56c06d730 0x7fe56c15dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45906/0 (socket says 172.21.15.18:45906) 2024-09-19T09:14:30.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.374+0000 7fe56b7fe640 1 -- 172.21.15.18:0/3607964554 learned_addr learned my addr 172.21.15.18:0/3607964554 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:30.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.374+0000 7fe56affd640 1 --2- 172.21.15.18:0/3607964554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe56c0cfae0 0x7fe56c0cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:30.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.374+0000 7fe56bfff640 1 --2- 172.21.15.18:0/3607964554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe56c15ef80 0x7fe56c0ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:30.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.375+0000 7fe56b7fe640 1 -- 172.21.15.18:0/3607964554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe56c15ef80 msgr2=0x7fe56c0ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:30.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.375+0000 7fe56b7fe640 1 --2- 172.21.15.18:0/3607964554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe56c15ef80 0x7fe56c0ca630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:30.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.375+0000 7fe56b7fe640 1 -- 172.21.15.18:0/3607964554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe56c0cfae0 msgr2=0x7fe56c0cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:30.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.375+0000 7fe56b7fe640 1 --2- 172.21.15.18:0/3607964554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe56c0cfae0 0x7fe56c0cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:30.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.375+0000 7fe56b7fe640 1 -- 172.21.15.18:0/3607964554 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe56c0cb850 con 0x7fe56c06d730 2024-09-19T09:14:30.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.375+0000 7fe56b7fe640 1 --2- 172.21.15.18:0/3607964554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe56c06d730 0x7fe56c15dc50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe55c00c460 tx=0x7fe55c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:30.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.375+0000 7fe553fff640 1 -- 172.21.15.18:0/3607964554 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c018070 con 0x7fe56c06d730 2024-09-19T09:14:30.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.375+0000 7fe553fff640 1 -- 172.21.15.18:0/3607964554 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe55c007500 con 0x7fe56c06d730 2024-09-19T09:14:30.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.375+0000 7fe571f54640 1 -- 172.21.15.18:0/3607964554 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe56c0cbb30 con 0x7fe56c06d730 2024-09-19T09:14:30.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.375+0000 7fe553fff640 1 -- 172.21.15.18:0/3607964554 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c004a20 con 0x7fe56c06d730 2024-09-19T09:14:30.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.375+0000 7fe571f54640 1 -- 172.21.15.18:0/3607964554 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe56c0cc0f0 con 0x7fe56c06d730 2024-09-19T09:14:30.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.376+0000 7fe571f54640 1 -- 172.21.15.18:0/3607964554 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe56c0cff00 con 0x7fe56c06d730 2024-09-19T09:14:30.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.377+0000 7fe553fff640 1 -- 172.21.15.18:0/3607964554 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe55c01b070 con 0x7fe56c06d730 2024-09-19T09:14:30.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.377+0000 7fe553fff640 1 --2- 172.21.15.18:0/3607964554 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe55806c2b0 0x7fe55806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:30.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.377+0000 7fe553fff640 1 -- 172.21.15.18:0/3607964554 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7fe55c08a2a0 con 0x7fe56c06d730 2024-09-19T09:14:30.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.377+0000 7fe56affd640 1 --2- 172.21.15.18:0/3607964554 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe55806c2b0 0x7fe55806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:30.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.378+0000 7fe56affd640 1 --2- 172.21.15.18:0/3607964554 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe55806c2b0 0x7fe55806e770 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe560034000 tx=0x7fe56002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:30.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.381+0000 7fe553fff640 1 -- 172.21.15.18:0/3607964554 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe55c058750 con 0x7fe56c06d730 2024-09-19T09:14:30.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.623+0000 7fe571f54640 1 -- 172.21.15.18:0/3607964554 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) -- 0x7fe56c0cc330 con 0x7fe56c06d730 2024-09-19T09:14:30.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.890+0000 7fe553fff640 1 -- 172.21.15.18:0/3607964554 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v78) ==== 130+0+0 (secure 0 0 0) 0x7fe56c0cc330 con 0x7fe56c06d730 2024-09-19T09:14:30.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.893+0000 7fe571f54640 1 -- 172.21.15.18:0/3607964554 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe55806c2b0 msgr2=0x7fe55806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:30.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.893+0000 7fe571f54640 1 --2- 172.21.15.18:0/3607964554 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe55806c2b0 0x7fe55806e770 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe560034000 tx=0x7fe56002e000 comp rx=0 tx=0).stop 2024-09-19T09:14:30.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.893+0000 7fe571f54640 1 -- 172.21.15.18:0/3607964554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe56c06d730 msgr2=0x7fe56c15dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:30.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.893+0000 7fe571f54640 1 --2- 172.21.15.18:0/3607964554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe56c06d730 0x7fe56c15dc50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe55c00c460 tx=0x7fe55c00c920 comp rx=0 tx=0).stop 2024-09-19T09:14:30.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.893+0000 7fe571f54640 1 -- 172.21.15.18:0/3607964554 shutdown_connections 2024-09-19T09:14:30.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.893+0000 7fe571f54640 1 --2- 172.21.15.18:0/3607964554 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe55806c2b0 0x7fe55806e770 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:30.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.893+0000 7fe571f54640 1 --2- 172.21.15.18:0/3607964554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe56c15ef80 0x7fe56c0ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:30.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.893+0000 7fe571f54640 1 --2- 172.21.15.18:0/3607964554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe56c0cfae0 0x7fe56c0cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:30.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.893+0000 7fe571f54640 1 --2- 172.21.15.18:0/3607964554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe56c06d730 0x7fe56c15dc50 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:30.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.893+0000 7fe571f54640 1 -- 172.21.15.18:0/3607964554 >> 172.21.15.18:0/3607964554 conn(0x7fe56c0b4700 msgr2=0x7fe56c070e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:30.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.893+0000 7fe571f54640 1 -- 172.21.15.18:0/3607964554 shutdown_connections 2024-09-19T09:14:30.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:30.893+0000 7fe571f54640 1 -- 172.21.15.18:0/3607964554 wait complete. 2024-09-19T09:14:30.905 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2024-09-19T09:14:30.905 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestClusterFull) 2024-09-19T09:14:30.905 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:14:31.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.008+0000 7fc58dfd6640 1 Processor -- start 2024-09-19T09:14:31.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.008+0000 7fc58dfd6640 1 -- start start 2024-09-19T09:14:31.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.009+0000 7fc58dfd6640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc58815ef80 0x7fc5880b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:31.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.009+0000 7fc58dfd6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc58806d730 0x7fc5880cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:31.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.009+0000 7fc58dfd6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc5880cf910 0x7fc5880d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:31.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.009+0000 7fc58dfd6640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fc5880cd7d0 con 0x7fc5880cf910 2024-09-19T09:14:31.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.009+0000 7fc58dfd6640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc5880cd1a0 con 0x7fc58815ef80 2024-09-19T09:14:31.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.009+0000 7fc58dfd6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc58806dc30 con 0x7fc58806d730 2024-09-19T09:14:31.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.009+0000 7fc587fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc5880cf910 0x7fc5880d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:31.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.009+0000 7fc587fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc5880cf910 0x7fc5880d0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45920/0 (socket says 172.21.15.18:45920) 2024-09-19T09:14:31.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.009+0000 7fc587fff640 1 -- 172.21.15.18:0/3376191227 learned_addr learned my addr 172.21.15.18:0/3376191227 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:31.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.009+0000 7fc586ffd640 1 --2- 172.21.15.18:0/3376191227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc58806d730 0x7fc5880cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:31.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.009+0000 7fc5877fe640 1 --2- 172.21.15.18:0/3376191227 >> v2:172.21.15.162:3300/0 conn(0x7fc58815ef80 0x7fc5880b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:31.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.009+0000 7fc587fff640 1 -- 172.21.15.18:0/3376191227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc58806d730 msgr2=0x7fc5880cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:31.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.009+0000 7fc587fff640 1 --2- 172.21.15.18:0/3376191227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc58806d730 0x7fc5880cf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.009+0000 7fc587fff640 1 -- 172.21.15.18:0/3376191227 >> v2:172.21.15.162:3300/0 conn(0x7fc58815ef80 msgr2=0x7fc5880b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:31.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.009+0000 7fc587fff640 1 --2- 172.21.15.18:0/3376191227 >> v2:172.21.15.162:3300/0 conn(0x7fc58815ef80 0x7fc5880b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.009+0000 7fc587fff640 1 -- 172.21.15.18:0/3376191227 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc58806df10 con 0x7fc5880cf910 2024-09-19T09:14:31.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.010+0000 7fc587fff640 1 --2- 172.21.15.18:0/3376191227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5880cf910 0x7fc5880d0ce0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc58806f6e0 tx=0x7fc58002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aba4c75aefae997 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:31.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.010+0000 7fc5867fc640 1 -- 172.21.15.18:0/3376191227 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc580036070 con 0x7fc5880cf910 2024-09-19T09:14:31.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.010+0000 7fc5867fc640 1 -- 172.21.15.18:0/3376191227 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc580031600 con 0x7fc5880cf910 2024-09-19T09:14:31.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.010+0000 7fc5867fc640 1 -- 172.21.15.18:0/3376191227 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5800319d0 con 0x7fc5880cf910 2024-09-19T09:14:31.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.011+0000 7fc58dfd6640 1 -- 172.21.15.18:0/3376191227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5880cf910 msgr2=0x7fc5880d0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:31.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.011+0000 7fc58dfd6640 1 --2- 172.21.15.18:0/3376191227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5880cf910 0x7fc5880d0ce0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc58806f6e0 tx=0x7fc58002a6a0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.011+0000 7fc58dfd6640 1 -- 172.21.15.18:0/3376191227 shutdown_connections 2024-09-19T09:14:31.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.011+0000 7fc58dfd6640 1 --2- 172.21.15.18:0/3376191227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc5880cf910 0x7fc5880d0ce0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.011+0000 7fc58dfd6640 1 --2- 172.21.15.18:0/3376191227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc58806d730 0x7fc5880cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.011+0000 7fc58dfd6640 1 --2- 172.21.15.18:0/3376191227 >> v2:172.21.15.162:3300/0 conn(0x7fc58815ef80 0x7fc5880b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.011+0000 7fc58dfd6640 1 -- 172.21.15.18:0/3376191227 >> 172.21.15.18:0/3376191227 conn(0x7fc5880b4700 msgr2=0x7fc5880b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:31.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.011+0000 7fc58dfd6640 1 -- 172.21.15.18:0/3376191227 shutdown_connections 2024-09-19T09:14:31.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.011+0000 7fc58dfd6640 1 -- 172.21.15.18:0/3376191227 wait complete. 2024-09-19T09:14:31.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.012+0000 7fc58dfd6640 1 Processor -- start 2024-09-19T09:14:31.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.012+0000 7fc58dfd6640 1 -- start start 2024-09-19T09:14:31.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.013+0000 7fc58dfd6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc58806d730 0x7fc5880cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:31.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.013+0000 7fc58dfd6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5880cf910 0x7fc5880c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:31.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.013+0000 7fc58dfd6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc58815ef80 0x7fc58815d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:31.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.013+0000 7fc58dfd6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc5880d0120 con 0x7fc58815ef80 2024-09-19T09:14:31.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.013+0000 7fc58dfd6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc58815f360 con 0x7fc58806d730 2024-09-19T09:14:31.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.013+0000 7fc58dfd6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc5880d1220 con 0x7fc5880cf910 2024-09-19T09:14:31.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.013+0000 7fc587fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc58815ef80 0x7fc58815d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:31.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.013+0000 7fc587fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc58815ef80 0x7fc58815d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45934/0 (socket says 172.21.15.18:45934) 2024-09-19T09:14:31.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.013+0000 7fc587fff640 1 -- 172.21.15.18:0/3345180428 learned_addr learned my addr 172.21.15.18:0/3345180428 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:31.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.013+0000 7fc5877fe640 1 --2- 172.21.15.18:0/3345180428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc58806d730 0x7fc5880cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:31.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.013+0000 7fc586ffd640 1 --2- 172.21.15.18:0/3345180428 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5880cf910 0x7fc5880c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:31.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.014+0000 7fc587fff640 1 -- 172.21.15.18:0/3345180428 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5880cf910 msgr2=0x7fc5880c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:31.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.014+0000 7fc587fff640 1 --2- 172.21.15.18:0/3345180428 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5880cf910 0x7fc5880c8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.014+0000 7fc587fff640 1 -- 172.21.15.18:0/3345180428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc58806d730 msgr2=0x7fc5880cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:31.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.014+0000 7fc587fff640 1 --2- 172.21.15.18:0/3345180428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc58806d730 0x7fc5880cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.014+0000 7fc587fff640 1 -- 172.21.15.18:0/3345180428 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5880c8f40 con 0x7fc58815ef80 2024-09-19T09:14:31.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.014+0000 7fc586ffd640 1 --2- 172.21.15.18:0/3345180428 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5880cf910 0x7fc5880c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:31.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.014+0000 7fc587fff640 1 --2- 172.21.15.18:0/3345180428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc58815ef80 0x7fc58815d440 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc580009f40 tx=0x7fc580004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:31.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.014+0000 7fc56ffff640 1 -- 172.21.15.18:0/3345180428 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc580036050 con 0x7fc58815ef80 2024-09-19T09:14:31.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.014+0000 7fc56ffff640 1 -- 172.21.15.18:0/3345180428 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc580042070 con 0x7fc58815ef80 2024-09-19T09:14:31.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.014+0000 7fc58dfd6640 1 -- 172.21.15.18:0/3345180428 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5880cb520 con 0x7fc58815ef80 2024-09-19T09:14:31.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.014+0000 7fc56ffff640 1 -- 172.21.15.18:0/3345180428 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc580009510 con 0x7fc58815ef80 2024-09-19T09:14:31.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.014+0000 7fc58dfd6640 1 -- 172.21.15.18:0/3345180428 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5880c9e70 con 0x7fc58815ef80 2024-09-19T09:14:31.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.015+0000 7fc58dfd6640 1 -- 172.21.15.18:0/3345180428 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5880d0ce0 con 0x7fc58815ef80 2024-09-19T09:14:31.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.016+0000 7fc56ffff640 1 -- 172.21.15.18:0/3345180428 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc580007c50 con 0x7fc58815ef80 2024-09-19T09:14:31.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.016+0000 7fc56ffff640 1 --2- 172.21.15.18:0/3345180428 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc57406c2e0 0x7fc57406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:31.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.016+0000 7fc56ffff640 1 -- 172.21.15.18:0/3345180428 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7fc5800abf70 con 0x7fc58815ef80 2024-09-19T09:14:31.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.016+0000 7fc5877fe640 1 --2- 172.21.15.18:0/3345180428 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc57406c2e0 0x7fc57406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:31.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.017+0000 7fc5877fe640 1 --2- 172.21.15.18:0/3345180428 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc57406c2e0 0x7fc57406e7a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc578007920 tx=0x7fc578008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:31.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.020+0000 7fc56ffff640 1 -- 172.21.15.18:0/3345180428 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc58007a9e0 con 0x7fc58815ef80 2024-09-19T09:14:31.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.197+0000 7fc58dfd6640 1 -- 172.21.15.18:0/3345180428 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc58806d4b0 con 0x7fc58815ef80 2024-09-19T09:14:31.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.198+0000 7fc56ffff640 1 -- 172.21.15.18:0/3345180428 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+13044 (secure 0 0 0) 0x7fc58007a2e0 con 0x7fc58815ef80 2024-09-19T09:14:31.198 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:31.198 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":39,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:14:29.885649+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6834/2895835717":"2024-09-20T09:14:26.711819+0000","172.21.15.18:6832/2895835717":"2024-09-20T09:14:26.711819+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:14:31.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.200+0000 7fc58dfd6640 1 -- 172.21.15.18:0/3345180428 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc57406c2e0 msgr2=0x7fc57406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:31.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.200+0000 7fc58dfd6640 1 --2- 172.21.15.18:0/3345180428 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc57406c2e0 0x7fc57406e7a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc578007920 tx=0x7fc578008040 comp rx=0 tx=0).stop 2024-09-19T09:14:31.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.200+0000 7fc58dfd6640 1 -- 172.21.15.18:0/3345180428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc58815ef80 msgr2=0x7fc58815d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:31.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.200+0000 7fc58dfd6640 1 --2- 172.21.15.18:0/3345180428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc58815ef80 0x7fc58815d440 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc580009f40 tx=0x7fc580004a40 comp rx=0 tx=0).stop 2024-09-19T09:14:31.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.200+0000 7fc58dfd6640 1 -- 172.21.15.18:0/3345180428 shutdown_connections 2024-09-19T09:14:31.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.200+0000 7fc58dfd6640 1 --2- 172.21.15.18:0/3345180428 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc57406c2e0 0x7fc57406e7a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.200+0000 7fc58dfd6640 1 --2- 172.21.15.18:0/3345180428 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc58815ef80 0x7fc58815d440 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.200+0000 7fc58dfd6640 1 --2- 172.21.15.18:0/3345180428 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc5880cf910 0x7fc5880c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.200+0000 7fc58dfd6640 1 --2- 172.21.15.18:0/3345180428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc58806d730 0x7fc5880cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.200+0000 7fc58dfd6640 1 -- 172.21.15.18:0/3345180428 >> 172.21.15.18:0/3345180428 conn(0x7fc5880b4700 msgr2=0x7fc5880d24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:31.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.200+0000 7fc58dfd6640 1 -- 172.21.15.18:0/3345180428 shutdown_connections 2024-09-19T09:14:31.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.200+0000 7fc58dfd6640 1 -- 172.21.15.18:0/3345180428 wait complete. 2024-09-19T09:14:31.211 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T09:13:17.564717+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T09:14:31.212 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T09:14:31.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.317+0000 7f34c6a77640 1 Processor -- start 2024-09-19T09:14:31.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.317+0000 7f34c6a77640 1 -- start start 2024-09-19T09:14:31.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.318+0000 7f34c6a77640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f34c006deb0 0x7f34c00b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:31.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.318+0000 7f34c6a77640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34c00b6a60 con 0x7f34c015c670 2024-09-19T09:14:31.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.318+0000 7f34c6a77640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34c00b6d40 con 0x7f34c015f1a0 2024-09-19T09:14:31.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.318+0000 7f34c6a77640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f34c00b7020 con 0x7f34c006deb0 2024-09-19T09:14:31.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.318+0000 7f34c4813640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f34c015c670 0x7f34c006d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50018/0 (socket says 172.21.15.18:50018) 2024-09-19T09:14:31.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.318+0000 7f34c4813640 1 -- 172.21.15.18:0/1613463020 learned_addr learned my addr 172.21.15.18:0/1613463020 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:31.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.318+0000 7f34bffff640 1 --2- 172.21.15.18:0/1613463020 >> v2:172.21.15.162:3300/0 conn(0x7f34c006deb0 0x7f34c00b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:31.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.318+0000 7f34bf7fe640 1 -- 172.21.15.18:0/1613463020 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1840954678 0 0) 0x7f34c00b6a60 con 0x7f34c015c670 2024-09-19T09:14:31.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.318+0000 7f34bf7fe640 1 -- 172.21.15.18:0/1613463020 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34b0003520 con 0x7f34c015c670 2024-09-19T09:14:31.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.318+0000 7f34bf7fe640 1 -- 172.21.15.18:0/1613463020 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3920377990 0 0) 0x7f34b0003520 con 0x7f34c015c670 2024-09-19T09:14:31.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.318+0000 7f34bf7fe640 1 -- 172.21.15.18:0/1613463020 >> v2:172.21.15.162:3300/0 conn(0x7f34c006deb0 msgr2=0x7f34c00b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:31.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.318+0000 7f34bf7fe640 1 --2- 172.21.15.18:0/1613463020 >> v2:172.21.15.162:3300/0 conn(0x7f34c006deb0 0x7f34c00b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.318+0000 7f34bf7fe640 1 -- 172.21.15.18:0/1613463020 >> v1:172.21.15.162:6789/0 conn(0x7f34c015f1a0 legacy=0x7f34c0160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:31.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.318+0000 7f34bf7fe640 1 -- 172.21.15.18:0/1613463020 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c00b7300 con 0x7f34c015c670 2024-09-19T09:14:31.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.318+0000 7f34bf7fe640 1 -- 172.21.15.18:0/1613463020 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f34b4001670 con 0x7f34c015c670 2024-09-19T09:14:31.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.318+0000 7f34bf7fe640 1 -- 172.21.15.18:0/1613463020 >> v1:172.21.15.18:6789/0 conn(0x7f34c015c670 legacy=0x7f34c006d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:31.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.318+0000 7f34bf7fe640 1 --2- 172.21.15.18:0/1613463020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34b00039e0 0x7f34b0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:31.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.318+0000 7f34bf7fe640 1 --2- 172.21.15.18:0/1613463020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34b0004800 0x7f34b0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:31.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.318+0000 7f34bf7fe640 1 --2- 172.21.15.18:0/1613463020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34b00051c0 0x7f34b000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:31.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.318+0000 7f34bf7fe640 1 -- 172.21.15.18:0/1613463020 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f34c00b7020 con 0x7f34b0004800 2024-09-19T09:14:31.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.318+0000 7f34bf7fe640 1 -- 172.21.15.18:0/1613463020 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f34b000c010 con 0x7f34b00039e0 2024-09-19T09:14:31.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.318+0000 7f34bf7fe640 1 -- 172.21.15.18:0/1613463020 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f34b000c210 con 0x7f34b00051c0 2024-09-19T09:14:31.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.318+0000 7f34bffff640 1 --2- 172.21.15.18:0/1613463020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34b0004800 0x7f34b0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:31.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.319+0000 7f34c4813640 1 --2- 172.21.15.18:0/1613463020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34b00039e0 0x7f34b0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:31.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.319+0000 7f34c5014640 1 --2- 172.21.15.18:0/1613463020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34b00051c0 0x7f34b000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:31.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.319+0000 7f34bffff640 1 -- 172.21.15.18:0/1613463020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34b00051c0 msgr2=0x7f34b000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:31.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.319+0000 7f34bffff640 1 --2- 172.21.15.18:0/1613463020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34b00051c0 0x7f34b000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.319+0000 7f34bffff640 1 -- 172.21.15.18:0/1613463020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34b00039e0 msgr2=0x7f34b0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:31.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.319+0000 7f34bffff640 1 --2- 172.21.15.18:0/1613463020 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34b00039e0 0x7f34b0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.319+0000 7f34bffff640 1 -- 172.21.15.18:0/1613463020 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34b0003520 con 0x7f34b0004800 2024-09-19T09:14:31.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.319+0000 7f34c5014640 1 --2- 172.21.15.18:0/1613463020 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34b00051c0 0x7f34b000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:31.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.319+0000 7f34c5014640 1 -- 172.21.15.18:0/1613463020 reap_dead start 2024-09-19T09:14:31.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.319+0000 7f34bffff640 1 --2- 172.21.15.18:0/1613463020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34b0004800 0x7f34b0004c80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f34ac009ac0 tx=0x7f34b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=532037ec03ef4a15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:31.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.320+0000 7f34bf7fe640 1 -- 172.21.15.18:0/1613463020 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ac036070 con 0x7f34b0004800 2024-09-19T09:14:31.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.320+0000 7f34bf7fe640 1 -- 172.21.15.18:0/1613463020 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34ac031400 con 0x7f34b0004800 2024-09-19T09:14:31.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.320+0000 7f34bf7fe640 1 -- 172.21.15.18:0/1613463020 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ac009690 con 0x7f34b0004800 2024-09-19T09:14:31.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.320+0000 7f34c6a77640 1 -- 172.21.15.18:0/1613463020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34b0004800 msgr2=0x7f34b0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:31.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.320+0000 7f34c6a77640 1 --2- 172.21.15.18:0/1613463020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34b0004800 0x7f34b0004c80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f34ac009ac0 tx=0x7f34b0005830 comp rx=0 tx=0).stop 2024-09-19T09:14:31.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.320+0000 7f34c6a77640 1 -- 172.21.15.18:0/1613463020 shutdown_connections 2024-09-19T09:14:31.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.320+0000 7f34c6a77640 1 --2- 172.21.15.18:0/1613463020 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34b0004800 0x7f34b0004c80 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.320+0000 7f34c6a77640 1 -- 172.21.15.18:0/1613463020 >> 172.21.15.18:0/1613463020 conn(0x7f34c009b9d0 msgr2=0x7f34c009bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:31.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.320+0000 7f34c6a77640 1 -- 172.21.15.18:0/1613463020 shutdown_connections 2024-09-19T09:14:31.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.320+0000 7f34c6a77640 1 -- 172.21.15.18:0/1613463020 wait complete. 2024-09-19T09:14:31.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.321+0000 7f34c6a77640 1 Processor -- start 2024-09-19T09:14:31.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.321+0000 7f34c6a77640 1 -- start start 2024-09-19T09:14:31.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.322+0000 7f34c6a77640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34b0004800 0x7f34c01597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:31.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.322+0000 7f34c6a77640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34c009e880 0x7f34c00b3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:31.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.322+0000 7f34c6a77640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34c0160300 0x7f34c0160780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:31.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.322+0000 7f34c6a77640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f34c00b7b00 con 0x7f34c0160300 2024-09-19T09:14:31.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.322+0000 7f34c6a77640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f34c009c560 con 0x7f34c009e880 2024-09-19T09:14:31.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.322+0000 7f34c6a77640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f34c00b0370 con 0x7f34b0004800 2024-09-19T09:14:31.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.322+0000 7f34c5014640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34c0160300 0x7f34c0160780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:31.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.322+0000 7f34c5014640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34c0160300 0x7f34c0160780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45966/0 (socket says 172.21.15.18:45966) 2024-09-19T09:14:31.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.322+0000 7f34c5014640 1 -- 172.21.15.18:0/689913525 learned_addr learned my addr 172.21.15.18:0/689913525 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:31.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.323+0000 7f34c4813640 1 --2- 172.21.15.18:0/689913525 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34b0004800 0x7f34c01597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:31.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.323+0000 7f34bffff640 1 --2- 172.21.15.18:0/689913525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34c009e880 0x7f34c00b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:31.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.323+0000 7f34c5014640 1 -- 172.21.15.18:0/689913525 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34b0004800 msgr2=0x7f34c01597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:31.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.323+0000 7f34c5014640 1 --2- 172.21.15.18:0/689913525 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34b0004800 0x7f34c01597f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.323+0000 7f34c5014640 1 -- 172.21.15.18:0/689913525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34c009e880 msgr2=0x7f34c00b3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:31.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.323+0000 7f34c5014640 1 --2- 172.21.15.18:0/689913525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34c009e880 0x7f34c00b3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.323+0000 7f34c5014640 1 -- 172.21.15.18:0/689913525 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c00afa80 con 0x7f34c0160300 2024-09-19T09:14:31.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.323+0000 7f34c5014640 1 --2- 172.21.15.18:0/689913525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34c0160300 0x7f34c0160780 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f34c006eac0 tx=0x7f34b800ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:31.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.323+0000 7f34bd7fa640 1 -- 172.21.15.18:0/689913525 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b8019070 con 0x7f34c0160300 2024-09-19T09:14:31.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.323+0000 7f34bd7fa640 1 -- 172.21.15.18:0/689913525 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b8006b50 con 0x7f34c0160300 2024-09-19T09:14:31.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.323+0000 7f34bd7fa640 1 -- 172.21.15.18:0/689913525 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34b8003970 con 0x7f34c0160300 2024-09-19T09:14:31.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.323+0000 7f34c6a77640 1 -- 172.21.15.18:0/689913525 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34c00b3970 con 0x7f34c0160300 2024-09-19T09:14:31.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.323+0000 7f34c6a77640 1 -- 172.21.15.18:0/689913525 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34c00b0000 con 0x7f34c0160300 2024-09-19T09:14:31.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.324+0000 7f34c6a77640 1 -- 172.21.15.18:0/689913525 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34c015ca50 con 0x7f34c0160300 2024-09-19T09:14:31.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.325+0000 7f34bd7fa640 1 -- 172.21.15.18:0/689913525 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f34b801c070 con 0x7f34c0160300 2024-09-19T09:14:31.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.325+0000 7f34bd7fa640 1 --2- 172.21.15.18:0/689913525 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f34a406c2e0 0x7f34a406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:31.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.325+0000 7f34bd7fa640 1 -- 172.21.15.18:0/689913525 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7f34b808a3f0 con 0x7f34c0160300 2024-09-19T09:14:31.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.325+0000 7f34c4813640 1 --2- 172.21.15.18:0/689913525 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f34a406c2e0 0x7f34a406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:31.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.326+0000 7f34c4813640 1 --2- 172.21.15.18:0/689913525 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f34a406c2e0 0x7f34a406e7a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f34b4007d90 tx=0x7f34b4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:31.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.329+0000 7f34bd7fa640 1 -- 172.21.15.18:0/689913525 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f34b8058ef0 con 0x7f34c0160300 2024-09-19T09:14:31.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.508+0000 7f34c6a77640 1 -- 172.21.15.18:0/689913525 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f34c006d1c0 con 0x7f34c0160300 2024-09-19T09:14:31.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.508+0000 7f34bd7fa640 1 -- 172.21.15.18:0/689913525 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) ==== 93+0+10 (secure 0 0 0) 0x7f34b80587f0 con 0x7f34c0160300 2024-09-19T09:14:31.509 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-09-19T09:14:31.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.510+0000 7f34c6a77640 1 -- 172.21.15.18:0/689913525 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f34a406c2e0 msgr2=0x7f34a406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:31.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.510+0000 7f34c6a77640 1 --2- 172.21.15.18:0/689913525 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f34a406c2e0 0x7f34a406e7a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f34b4007d90 tx=0x7f34b4009040 comp rx=0 tx=0).stop 2024-09-19T09:14:31.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.510+0000 7f34c6a77640 1 -- 172.21.15.18:0/689913525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34c0160300 msgr2=0x7f34c0160780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:31.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.510+0000 7f34c6a77640 1 --2- 172.21.15.18:0/689913525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34c0160300 0x7f34c0160780 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f34c006eac0 tx=0x7f34b800ebe0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.511+0000 7f34c6a77640 1 -- 172.21.15.18:0/689913525 shutdown_connections 2024-09-19T09:14:31.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.511+0000 7f34c6a77640 1 --2- 172.21.15.18:0/689913525 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f34a406c2e0 0x7f34a406e7a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.511+0000 7f34c6a77640 1 --2- 172.21.15.18:0/689913525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34c0160300 0x7f34c0160780 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.511+0000 7f34c6a77640 1 --2- 172.21.15.18:0/689913525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34c009e880 0x7f34c00b3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.511+0000 7f34c6a77640 1 --2- 172.21.15.18:0/689913525 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34b0004800 0x7f34c01597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.511+0000 7f34c6a77640 1 -- 172.21.15.18:0/689913525 >> 172.21.15.18:0/689913525 conn(0x7f34c009b9d0 msgr2=0x7f34c015b400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:31.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.511+0000 7f34c6a77640 1 -- 172.21.15.18:0/689913525 shutdown_connections 2024-09-19T09:14:31.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.511+0000 7f34c6a77640 1 -- 172.21.15.18:0/689913525 wait complete. 2024-09-19T09:14:31.522 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2024-09-19T09:14:31.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.623+0000 7fa2b0cdd640 1 Processor -- start 2024-09-19T09:14:31.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.624+0000 7fa2b0cdd640 1 -- start start 2024-09-19T09:14:31.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.624+0000 7fa2b0cdd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa2ac15ef50 0x7fa2ac0d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:31.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.624+0000 7fa2b0cdd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa2ac0b9510 0x7fa2ac0d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:31.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.624+0000 7fa2b0cdd640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2ac0b7a90 con 0x7fa2ac0d3240 2024-09-19T09:14:31.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.624+0000 7fa2b0cdd640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fa2ac0d3740 con 0x7fa2ac0b9510 2024-09-19T09:14:31.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.624+0000 7fa2b0cdd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa2ac0d3a20 con 0x7fa2ac15ef50 2024-09-19T09:14:31.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.625+0000 7fa2aad9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa2ac0b9510 0x7fa2ac0d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:31.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.625+0000 7fa2aad9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa2ac0b9510 0x7fa2ac0d18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45982/0 (socket says 172.21.15.18:45982) 2024-09-19T09:14:31.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.625+0000 7fa2aad9d640 1 -- 172.21.15.18:0/394765458 learned_addr learned my addr 172.21.15.18:0/394765458 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:31.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.625+0000 7fa2aa59c640 1 --2- 172.21.15.18:0/394765458 >> v2:172.21.15.162:3300/0 conn(0x7fa2ac15ef50 0x7fa2ac0d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:31.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.625+0000 7fa2aad9d640 1 -- 172.21.15.18:0/394765458 >> v2:172.21.15.162:3300/0 conn(0x7fa2ac15ef50 msgr2=0x7fa2ac0d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:31.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.625+0000 7fa2aad9d640 1 --2- 172.21.15.18:0/394765458 >> v2:172.21.15.162:3300/0 conn(0x7fa2ac15ef50 0x7fa2ac0d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.625+0000 7fa2aad9d640 1 -- 172.21.15.18:0/394765458 >> v1:172.21.15.162:6789/0 conn(0x7fa2ac0d3240 legacy=0x7fa2ac0cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:31.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.625+0000 7fa2aad9d640 1 -- 172.21.15.18:0/394765458 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2ac0b7d00 con 0x7fa2ac0b9510 2024-09-19T09:14:31.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.626+0000 7fa2aad9d640 1 --2- 172.21.15.18:0/394765458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2ac0b9510 0x7fa2ac0d18e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0b7850 tx=0x7fa2a402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e009b0afb968b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:31.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.626+0000 7fa2a959a640 1 -- 172.21.15.18:0/394765458 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a4037070 con 0x7fa2ac0b9510 2024-09-19T09:14:31.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.626+0000 7fa2a959a640 1 -- 172.21.15.18:0/394765458 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2a4032440 con 0x7fa2ac0b9510 2024-09-19T09:14:31.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.626+0000 7fa2a959a640 1 -- 172.21.15.18:0/394765458 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a4032810 con 0x7fa2ac0b9510 2024-09-19T09:14:31.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.626+0000 7fa2b0cdd640 1 -- 172.21.15.18:0/394765458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2ac0b9510 msgr2=0x7fa2ac0d18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:31.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.626+0000 7fa2b0cdd640 1 --2- 172.21.15.18:0/394765458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2ac0b9510 0x7fa2ac0d18e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac0b7850 tx=0x7fa2a402a1e0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.627+0000 7fa2b0cdd640 1 -- 172.21.15.18:0/394765458 shutdown_connections 2024-09-19T09:14:31.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.627+0000 7fa2b0cdd640 1 --2- 172.21.15.18:0/394765458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2ac0b9510 0x7fa2ac0d18e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.627+0000 7fa2b0cdd640 1 --2- 172.21.15.18:0/394765458 >> v2:172.21.15.162:3300/0 conn(0x7fa2ac15ef50 0x7fa2ac0d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.627+0000 7fa2b0cdd640 1 -- 172.21.15.18:0/394765458 >> 172.21.15.18:0/394765458 conn(0x7fa2ac0d4c60 msgr2=0x7fa2ac0d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:31.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.627+0000 7fa2b0cdd640 1 -- 172.21.15.18:0/394765458 shutdown_connections 2024-09-19T09:14:31.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.627+0000 7fa2b0cdd640 1 -- 172.21.15.18:0/394765458 wait complete. 2024-09-19T09:14:31.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.628+0000 7fa2b0cdd640 1 Processor -- start 2024-09-19T09:14:31.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.628+0000 7fa2b0cdd640 1 -- start start 2024-09-19T09:14:31.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.629+0000 7fa2b0cdd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2ac0b9510 0x7fa2ac15a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:31.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.629+0000 7fa2b0cdd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2ac0d3240 0x7fa2ac15aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:31.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.629+0000 7fa2b0cdd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2ac15ef50 0x7fa2ac0b6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:31.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.629+0000 7fa2b0cdd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa2ac0d21a0 con 0x7fa2ac0b9510 2024-09-19T09:14:31.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.629+0000 7fa2b0cdd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa2ac0d2020 con 0x7fa2ac15ef50 2024-09-19T09:14:31.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.629+0000 7fa2b0cdd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa2ac0d5780 con 0x7fa2ac0d3240 2024-09-19T09:14:31.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.629+0000 7fa2aa59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2ac0b9510 0x7fa2ac15a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:31.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.629+0000 7fa2aa59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2ac0b9510 0x7fa2ac15a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:45984/0 (socket says 172.21.15.18:45984) 2024-09-19T09:14:31.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.629+0000 7fa2aa59c640 1 -- 172.21.15.18:0/704277007 learned_addr learned my addr 172.21.15.18:0/704277007 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:31.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.629+0000 7fa2aad9d640 1 --2- 172.21.15.18:0/704277007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2ac15ef50 0x7fa2ac0b6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:31.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.629+0000 7fa2a9d9b640 1 --2- 172.21.15.18:0/704277007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2ac0d3240 0x7fa2ac15aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:31.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.629+0000 7fa2aa59c640 1 -- 172.21.15.18:0/704277007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2ac0d3240 msgr2=0x7fa2ac15aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:31.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.629+0000 7fa2aa59c640 1 --2- 172.21.15.18:0/704277007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2ac0d3240 0x7fa2ac15aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.629+0000 7fa2aa59c640 1 -- 172.21.15.18:0/704277007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2ac15ef50 msgr2=0x7fa2ac0b6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:31.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.629+0000 7fa2aa59c640 1 --2- 172.21.15.18:0/704277007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2ac15ef50 0x7fa2ac0b6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.629+0000 7fa2aa59c640 1 -- 172.21.15.18:0/704277007 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2ac1f4850 con 0x7fa2ac0b9510 2024-09-19T09:14:31.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.629+0000 7fa2a9d9b640 1 --2- 172.21.15.18:0/704277007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2ac0d3240 0x7fa2ac15aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:31.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.629+0000 7fa2aad9d640 1 --2- 172.21.15.18:0/704277007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2ac15ef50 0x7fa2ac0b6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:31.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.629+0000 7fa2aa59c640 1 --2- 172.21.15.18:0/704277007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2ac0b9510 0x7fa2ac15a970 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa29c007e90 tx=0x7fa29c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:31.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.630+0000 7fa2a2ffd640 1 -- 172.21.15.18:0/704277007 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29c014620 con 0x7fa2ac0b9510 2024-09-19T09:14:31.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.630+0000 7fa2a2ffd640 1 -- 172.21.15.18:0/704277007 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa29c019070 con 0x7fa2ac0b9510 2024-09-19T09:14:31.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.630+0000 7fa2a2ffd640 1 -- 172.21.15.18:0/704277007 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29c014a20 con 0x7fa2ac0b9510 2024-09-19T09:14:31.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.630+0000 7fa2b0cdd640 1 -- 172.21.15.18:0/704277007 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2ac147db0 con 0x7fa2ac0b9510 2024-09-19T09:14:31.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.630+0000 7fa2b0cdd640 1 -- 172.21.15.18:0/704277007 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2ac15b810 con 0x7fa2ac0b9510 2024-09-19T09:14:31.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.631+0000 7fa2b0cdd640 1 -- 172.21.15.18:0/704277007 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2ac0d13a0 con 0x7fa2ac0b9510 2024-09-19T09:14:31.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.631+0000 7fa2a2ffd640 1 -- 172.21.15.18:0/704277007 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa29c014bc0 con 0x7fa2ac0b9510 2024-09-19T09:14:31.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.632+0000 7fa2a2ffd640 1 --2- 172.21.15.18:0/704277007 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa28c06c2b0 0x7fa28c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:31.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.632+0000 7fa2a2ffd640 1 -- 172.21.15.18:0/704277007 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7fa29c08ba20 con 0x7fa2ac0b9510 2024-09-19T09:14:31.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.632+0000 7fa2a9d9b640 1 --2- 172.21.15.18:0/704277007 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa28c06c2b0 0x7fa28c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:31.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.632+0000 7fa2a9d9b640 1 --2- 172.21.15.18:0/704277007 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa28c06c2b0 0x7fa28c06e770 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac15a760 tx=0x7fa294009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:31.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.636+0000 7fa2a2ffd640 1 -- 172.21.15.18:0/704277007 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa29c05a490 con 0x7fa2ac0b9510 2024-09-19T09:14:31.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.879+0000 7fa2b0cdd640 1 -- 172.21.15.18:0/704277007 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) -- 0x7fa2ac0d29b0 con 0x7fa2ac0b9510 2024-09-19T09:14:31.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.894+0000 7fa2a2ffd640 1 -- 172.21.15.18:0/704277007 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v79) ==== 145+0+0 (secure 0 0 0) 0x7fa29c059d90 con 0x7fa2ac0b9510 2024-09-19T09:14:31.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.897+0000 7fa2b0cdd640 1 -- 172.21.15.18:0/704277007 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa28c06c2b0 msgr2=0x7fa28c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:31.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.897+0000 7fa2b0cdd640 1 --2- 172.21.15.18:0/704277007 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa28c06c2b0 0x7fa28c06e770 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac15a760 tx=0x7fa294009040 comp rx=0 tx=0).stop 2024-09-19T09:14:31.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.897+0000 7fa2b0cdd640 1 -- 172.21.15.18:0/704277007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2ac0b9510 msgr2=0x7fa2ac15a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:31.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.897+0000 7fa2b0cdd640 1 --2- 172.21.15.18:0/704277007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2ac0b9510 0x7fa2ac15a970 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa29c007e90 tx=0x7fa29c00e4b0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.897+0000 7fa2b0cdd640 1 -- 172.21.15.18:0/704277007 shutdown_connections 2024-09-19T09:14:31.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.897+0000 7fa2b0cdd640 1 --2- 172.21.15.18:0/704277007 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa28c06c2b0 0x7fa28c06e770 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.897+0000 7fa2b0cdd640 1 --2- 172.21.15.18:0/704277007 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2ac15ef50 0x7fa2ac0b6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.897+0000 7fa2b0cdd640 1 --2- 172.21.15.18:0/704277007 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2ac0d3240 0x7fa2ac15aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.897+0000 7fa2b0cdd640 1 --2- 172.21.15.18:0/704277007 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2ac0b9510 0x7fa2ac15a970 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:31.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.897+0000 7fa2b0cdd640 1 -- 172.21.15.18:0/704277007 >> 172.21.15.18:0/704277007 conn(0x7fa2ac0d4c60 msgr2=0x7fa2ac0d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:31.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.897+0000 7fa2b0cdd640 1 -- 172.21.15.18:0/704277007 shutdown_connections 2024-09-19T09:14:31.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:31.897+0000 7fa2b0cdd640 1 -- 172.21.15.18:0/704277007 wait complete. 2024-09-19T09:14:31.909 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2024-09-19T09:14:32.023 INFO:teuthology.orchestra.run.smithi018.stdout:{"osd_objectstore":"memstore"} 2024-09-19T09:14:32.023 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2024-09-19T09:14:32.023 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-19T09:14:32.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.128+0000 7f715e726640 1 Processor -- start 2024-09-19T09:14:32.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.128+0000 7f715e726640 1 -- start start 2024-09-19T09:14:32.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.129+0000 7f715e726640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f715806deb0 0x7f71580b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:32.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.129+0000 7f715e726640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f715815f1a0 0x7f7158160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:32.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.129+0000 7f715e726640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71580b6a60 con 0x7f715815c670 2024-09-19T09:14:32.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.129+0000 7f715e726640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f71580b6d40 con 0x7f715806deb0 2024-09-19T09:14:32.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.129+0000 7f715e726640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f71580b7020 con 0x7f715815f1a0 2024-09-19T09:14:32.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.129+0000 7f71577fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f715806deb0 0x7f71580b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:32.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.129+0000 7f7157fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f715815c670 0x7f715806d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50030/0 (socket says 172.21.15.18:50030) 2024-09-19T09:14:32.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.129+0000 7f7157fff640 1 -- 172.21.15.18:0/3262358379 learned_addr learned my addr 172.21.15.18:0/3262358379 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:32.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.129+0000 7f715ccc3640 1 --2- 172.21.15.18:0/3262358379 >> v2:172.21.15.162:3300/0 conn(0x7f715815f1a0 0x7f7158160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:32.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.129+0000 7f71577fe640 1 -- 172.21.15.18:0/3262358379 >> v2:172.21.15.162:3300/0 conn(0x7f715815f1a0 msgr2=0x7f7158160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:32.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.129+0000 7f71577fe640 1 --2- 172.21.15.18:0/3262358379 >> v2:172.21.15.162:3300/0 conn(0x7f715815f1a0 0x7f7158160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:32.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.129+0000 7f71577fe640 1 -- 172.21.15.18:0/3262358379 >> v1:172.21.15.18:6789/0 conn(0x7f715815c670 legacy=0x7f715806d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:32.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.129+0000 7f71577fe640 1 -- 172.21.15.18:0/3262358379 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71580b7300 con 0x7f715806deb0 2024-09-19T09:14:32.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.130+0000 7f71577fe640 1 --2- 172.21.15.18:0/3262358379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f715806deb0 0x7f71580b6410 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f714c0097a0 tx=0x7f714c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca2a009b6e771f4f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:32.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.130+0000 7f7156ffd640 1 -- 172.21.15.18:0/3262358379 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c037070 con 0x7f715806deb0 2024-09-19T09:14:32.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.130+0000 7f7156ffd640 1 -- 172.21.15.18:0/3262358379 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f714c032440 con 0x7f715806deb0 2024-09-19T09:14:32.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.130+0000 7f7156ffd640 1 -- 172.21.15.18:0/3262358379 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c032810 con 0x7f715806deb0 2024-09-19T09:14:32.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.131+0000 7f715e726640 1 -- 172.21.15.18:0/3262358379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f715806deb0 msgr2=0x7f71580b6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:32.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.131+0000 7f715e726640 1 --2- 172.21.15.18:0/3262358379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f715806deb0 0x7f71580b6410 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f714c0097a0 tx=0x7f714c02a1e0 comp rx=0 tx=0).stop 2024-09-19T09:14:32.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.131+0000 7f715e726640 1 -- 172.21.15.18:0/3262358379 shutdown_connections 2024-09-19T09:14:32.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.131+0000 7f715e726640 1 --2- 172.21.15.18:0/3262358379 >> v2:172.21.15.162:3300/0 conn(0x7f715815f1a0 0x7f7158160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:32.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.131+0000 7f715e726640 1 --2- 172.21.15.18:0/3262358379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f715806deb0 0x7f71580b6410 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:32.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.131+0000 7f715e726640 1 -- 172.21.15.18:0/3262358379 >> 172.21.15.18:0/3262358379 conn(0x7f715809b9d0 msgr2=0x7f715809bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:32.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.131+0000 7f715e726640 1 -- 172.21.15.18:0/3262358379 shutdown_connections 2024-09-19T09:14:32.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.131+0000 7f715e726640 1 -- 172.21.15.18:0/3262358379 wait complete. 2024-09-19T09:14:32.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.132+0000 7f715e726640 1 Processor -- start 2024-09-19T09:14:32.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.132+0000 7f715e726640 1 -- start start 2024-09-19T09:14:32.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.133+0000 7f715e726640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f715806deb0 0x7f7158150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:32.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.133+0000 7f715e726640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f715815c670 0x7f71581623f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:32.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.133+0000 7f715e726640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f715815f1a0 0x7f71581547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:32.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.133+0000 7f715e726640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f71580b7b00 con 0x7f715806deb0 2024-09-19T09:14:32.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.133+0000 7f715e726640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f715809c560 con 0x7f715815c670 2024-09-19T09:14:32.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.133+0000 7f715e726640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7158161350 con 0x7f715815f1a0 2024-09-19T09:14:32.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.133+0000 7f7157fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f715806deb0 0x7f7158150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:32.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.133+0000 7f7157fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f715806deb0 0x7f7158150440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46008/0 (socket says 172.21.15.18:46008) 2024-09-19T09:14:32.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.133+0000 7f7157fff640 1 -- 172.21.15.18:0/3272567729 learned_addr learned my addr 172.21.15.18:0/3272567729 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:32.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.133+0000 7f71577fe640 1 --2- 172.21.15.18:0/3272567729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f715815c670 0x7f71581623f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:32.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.133+0000 7f715ccc3640 1 --2- 172.21.15.18:0/3272567729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f715815f1a0 0x7f71581547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:32.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.133+0000 7f7157fff640 1 -- 172.21.15.18:0/3272567729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f715815f1a0 msgr2=0x7f71581547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:32.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.133+0000 7f7157fff640 1 --2- 172.21.15.18:0/3272567729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f715815f1a0 0x7f71581547d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:32.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.133+0000 7f7157fff640 1 -- 172.21.15.18:0/3272567729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f715815c670 msgr2=0x7f71581623f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:32.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.133+0000 7f7157fff640 1 --2- 172.21.15.18:0/3272567729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f715815c670 0x7f71581623f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:32.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.133+0000 7f7157fff640 1 -- 172.21.15.18:0/3272567729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7158161630 con 0x7f715806deb0 2024-09-19T09:14:32.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.133+0000 7f7157fff640 1 --2- 172.21.15.18:0/3272567729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f715806deb0 0x7f7158150440 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f714800c400 tx=0x7f714800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:32.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.134+0000 7f7154ff9640 1 -- 172.21.15.18:0/3272567729 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7148017070 con 0x7f715806deb0 2024-09-19T09:14:32.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.134+0000 7f7154ff9640 1 -- 172.21.15.18:0/3272567729 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7148005ce0 con 0x7f715806deb0 2024-09-19T09:14:32.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.134+0000 7f7154ff9640 1 -- 172.21.15.18:0/3272567729 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71480072f0 con 0x7f715806deb0 2024-09-19T09:14:32.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.134+0000 7f715e726640 1 -- 172.21.15.18:0/3272567729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7158161910 con 0x7f715806deb0 2024-09-19T09:14:32.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.134+0000 7f715e726640 1 -- 172.21.15.18:0/3272567729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71580ccee0 con 0x7f715806deb0 2024-09-19T09:14:32.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.135+0000 7f715e726640 1 -- 172.21.15.18:0/3272567729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7158161d00 con 0x7f715806deb0 2024-09-19T09:14:32.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.135+0000 7f7154ff9640 1 -- 172.21.15.18:0/3272567729 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f714801a070 con 0x7f715806deb0 2024-09-19T09:14:32.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.136+0000 7f7154ff9640 1 --2- 172.21.15.18:0/3272567729 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f714406c2b0 0x7f714406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:32.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.136+0000 7f7154ff9640 1 -- 172.21.15.18:0/3272567729 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7f714808a4c0 con 0x7f715806deb0 2024-09-19T09:14:32.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.136+0000 7f71577fe640 1 --2- 172.21.15.18:0/3272567729 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f714406c2b0 0x7f714406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:32.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.136+0000 7f71577fe640 1 --2- 172.21.15.18:0/3272567729 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f714406c2b0 0x7f714406e770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f714c034000 tx=0x7f714c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:32.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.140+0000 7f7154ff9640 1 -- 172.21.15.18:0/3272567729 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f71480588d0 con 0x7f715806deb0 2024-09-19T09:14:32.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.317+0000 7f715e726640 1 -- 172.21.15.18:0/3272567729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f7158161ae0 con 0x7f715806deb0 2024-09-19T09:14:32.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.321+0000 7f7154ff9640 1 -- 172.21.15.18:0/3272567729 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) ==== 122+0+0 (secure 0 0 0) 0x7f714805cbd0 con 0x7f715806deb0 2024-09-19T09:14:32.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.323+0000 7f715e726640 1 -- 172.21.15.18:0/3272567729 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f714406c2b0 msgr2=0x7f714406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:32.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.323+0000 7f715e726640 1 --2- 172.21.15.18:0/3272567729 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f714406c2b0 0x7f714406e770 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f714c034000 tx=0x7f714c02e000 comp rx=0 tx=0).stop 2024-09-19T09:14:32.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.323+0000 7f715e726640 1 -- 172.21.15.18:0/3272567729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f715806deb0 msgr2=0x7f7158150440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:32.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.323+0000 7f715e726640 1 --2- 172.21.15.18:0/3272567729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f715806deb0 0x7f7158150440 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f714800c400 tx=0x7f714800c8c0 comp rx=0 tx=0).stop 2024-09-19T09:14:32.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.323+0000 7f715e726640 1 -- 172.21.15.18:0/3272567729 shutdown_connections 2024-09-19T09:14:32.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.323+0000 7f715e726640 1 --2- 172.21.15.18:0/3272567729 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f714406c2b0 0x7f714406e770 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:32.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.323+0000 7f715e726640 1 --2- 172.21.15.18:0/3272567729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f715815f1a0 0x7f71581547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:32.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.323+0000 7f715e726640 1 --2- 172.21.15.18:0/3272567729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f715815c670 0x7f71581623f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:32.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.323+0000 7f715e726640 1 --2- 172.21.15.18:0/3272567729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f715806deb0 0x7f7158150440 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:32.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.323+0000 7f715e726640 1 -- 172.21.15.18:0/3272567729 >> 172.21.15.18:0/3272567729 conn(0x7f715809b9d0 msgr2=0x7f715815df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:32.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.323+0000 7f715e726640 1 -- 172.21.15.18:0/3272567729 shutdown_connections 2024-09-19T09:14:32.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.323+0000 7f715e726640 1 -- 172.21.15.18:0/3272567729 wait complete. 2024-09-19T09:14:32.335 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T09:14:32.336 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:14:32.383 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:14:32.434 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T09:14:32.435 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:14:32.435 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:14:32.451 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17075 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T09:14:32.451 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:14:32.451 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:14:32.469 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3252 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T09:14:32.469 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:14:32.470 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:14:32.508 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17075 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T09:14:32.508 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:14:32.508 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:14:32.527 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3252 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T09:14:32.527 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-19T09:14:32.527 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:14:32.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.650+0000 7f510dedd640 1 Processor -- start 2024-09-19T09:14:32.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.650+0000 7f510dedd640 1 -- start start 2024-09-19T09:14:32.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.651+0000 7f510dedd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51080d0050 0x7f51080cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:32.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.651+0000 7f510dedd640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51080d0e10 con 0x7f51080cf560 2024-09-19T09:14:32.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.651+0000 7f510dedd640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51080d0850 con 0x7f51080b3ce0 2024-09-19T09:14:32.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.651+0000 7f510dedd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f51080d0b30 con 0x7f51080d0050 2024-09-19T09:14:32.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.651+0000 7f51077fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f51080cf560 0x7f51080cf940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50036/0 (socket says 172.21.15.18:50036) 2024-09-19T09:14:32.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.651+0000 7f51077fe640 1 -- 172.21.15.18:0/3333034184 learned_addr learned my addr 172.21.15.18:0/3333034184 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:32.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.651+0000 7f51067fc640 1 -- 172.21.15.18:0/3333034184 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3069546621 0 0) 0x7f51080d0e10 con 0x7f51080cf560 2024-09-19T09:14:32.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.651+0000 7f5107fff640 1 --2- 172.21.15.18:0/3333034184 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51080d0050 0x7f51080cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:32.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.651+0000 7f51067fc640 1 -- 172.21.15.18:0/3333034184 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50f0003520 con 0x7f51080cf560 2024-09-19T09:14:32.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.651+0000 7f51067fc640 1 -- 172.21.15.18:0/3333034184 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1233300140 0 0) 0x7f50f0003520 con 0x7f51080cf560 2024-09-19T09:14:32.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.651+0000 7f51067fc640 1 -- 172.21.15.18:0/3333034184 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51080d0050 msgr2=0x7f51080cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:32.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.651+0000 7f51067fc640 1 --2- 172.21.15.18:0/3333034184 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51080d0050 0x7f51080cdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:32.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.651+0000 7f51067fc640 1 -- 172.21.15.18:0/3333034184 >> v1:172.21.15.162:6789/0 conn(0x7f51080b3ce0 legacy=0x7f51080cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:32.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.651+0000 7f51067fc640 1 -- 172.21.15.18:0/3333034184 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51080b24d0 con 0x7f51080cf560 2024-09-19T09:14:32.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.651+0000 7f51067fc640 1 -- 172.21.15.18:0/3333034184 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f50f8001670 con 0x7f51080cf560 2024-09-19T09:14:32.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.651+0000 7f51067fc640 1 -- 172.21.15.18:0/3333034184 >> v1:172.21.15.18:6789/0 conn(0x7f51080cf560 legacy=0x7f51080cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:32.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.651+0000 7f51067fc640 1 --2- 172.21.15.18:0/3333034184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50f00039e0 0x7f50f0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:32.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.651+0000 7f51067fc640 1 --2- 172.21.15.18:0/3333034184 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51080d0050 0x7f50f0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:32.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.651+0000 7f51067fc640 1 --2- 172.21.15.18:0/3333034184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50f0004d40 0x7f50f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:32.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.651+0000 7f51067fc640 1 -- 172.21.15.18:0/3333034184 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f51080d0b30 con 0x7f50f00039e0 2024-09-19T09:14:32.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.651+0000 7f51067fc640 1 -- 172.21.15.18:0/3333034184 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f50f000bb80 con 0x7f50f0004d40 2024-09-19T09:14:32.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.651+0000 7f51067fc640 1 -- 172.21.15.18:0/3333034184 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f50f000bd80 con 0x7f51080d0050 2024-09-19T09:14:32.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.651+0000 7f51077fe640 1 --2- 172.21.15.18:0/3333034184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50f00039e0 0x7f50f0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:32.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.652+0000 7f5106ffd640 1 --2- 172.21.15.18:0/3333034184 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51080d0050 0x7f50f0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:32.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.652+0000 7f5107fff640 1 --2- 172.21.15.18:0/3333034184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50f0004d40 0x7f50f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:32.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.652+0000 7f51077fe640 1 -- 172.21.15.18:0/3333034184 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51080d0050 msgr2=0x7f50f0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:32.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.652+0000 7f51077fe640 1 --2- 172.21.15.18:0/3333034184 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51080d0050 0x7f50f0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:32.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.652+0000 7f51077fe640 1 -- 172.21.15.18:0/3333034184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50f0004d40 msgr2=0x7f50f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:32.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.652+0000 7f51077fe640 1 --2- 172.21.15.18:0/3333034184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50f0004d40 0x7f50f00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:32.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.652+0000 7f51077fe640 1 -- 172.21.15.18:0/3333034184 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50f0003520 con 0x7f50f00039e0 2024-09-19T09:14:32.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.652+0000 7f51077fe640 1 --2- 172.21.15.18:0/3333034184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50f00039e0 0x7f50f0003e00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f50f800c210 tx=0x7f50f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=959f223fae890b85 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:32.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.653+0000 7f51067fc640 1 -- 172.21.15.18:0/3333034184 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f8007d30 con 0x7f50f00039e0 2024-09-19T09:14:32.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.653+0000 7f51067fc640 1 -- 172.21.15.18:0/3333034184 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f8005af0 con 0x7f50f00039e0 2024-09-19T09:14:32.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.653+0000 7f51067fc640 1 -- 172.21.15.18:0/3333034184 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f8007070 con 0x7f50f00039e0 2024-09-19T09:14:32.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.653+0000 7f510dedd640 1 -- 172.21.15.18:0/3333034184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50f00039e0 msgr2=0x7f50f0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:32.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.653+0000 7f510dedd640 1 --2- 172.21.15.18:0/3333034184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50f00039e0 0x7f50f0003e00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f50f800c210 tx=0x7f50f0005830 comp rx=0 tx=0).stop 2024-09-19T09:14:32.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.653+0000 7f5107fff640 1 -- 172.21.15.18:0/3333034184 reap_dead start 2024-09-19T09:14:32.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.653+0000 7f510dedd640 1 -- 172.21.15.18:0/3333034184 shutdown_connections 2024-09-19T09:14:32.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.653+0000 7f510dedd640 1 -- 172.21.15.18:0/3333034184 >> 172.21.15.18:0/3333034184 conn(0x7f51080b4700 msgr2=0x7f51080b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:32.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.653+0000 7f510dedd640 1 -- 172.21.15.18:0/3333034184 shutdown_connections 2024-09-19T09:14:32.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.653+0000 7f510dedd640 1 -- 172.21.15.18:0/3333034184 wait complete. 2024-09-19T09:14:32.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.654+0000 7f510dedd640 1 Processor -- start 2024-09-19T09:14:32.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.655+0000 7f510dedd640 1 -- start start 2024-09-19T09:14:32.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.655+0000 7f510dedd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50f00039e0 0x7f51080c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:32.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.655+0000 7f510dedd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51080c8fe0 0x7f510815ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:32.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.655+0000 7f510dedd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51080b7640 0x7f51080b0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:32.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.655+0000 7f510dedd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f51080b55a0 con 0x7f50f00039e0 2024-09-19T09:14:32.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.655+0000 7f510dedd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f51080b5420 con 0x7f51080b7640 2024-09-19T09:14:32.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.655+0000 7f510dedd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f510815d090 con 0x7f51080c8fe0 2024-09-19T09:14:32.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.656+0000 7f51077fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50f00039e0 0x7f51080c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:32.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.656+0000 7f51077fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50f00039e0 0x7f51080c80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46022/0 (socket says 172.21.15.18:46022) 2024-09-19T09:14:32.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.656+0000 7f51077fe640 1 -- 172.21.15.18:0/2478840008 learned_addr learned my addr 172.21.15.18:0/2478840008 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:32.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.656+0000 7f5106ffd640 1 --2- 172.21.15.18:0/2478840008 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51080c8fe0 0x7f510815ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:32.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.656+0000 7f5107fff640 1 --2- 172.21.15.18:0/2478840008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51080b7640 0x7f51080b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:32.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.656+0000 7f51077fe640 1 -- 172.21.15.18:0/2478840008 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51080c8fe0 msgr2=0x7f510815ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:32.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.656+0000 7f51077fe640 1 --2- 172.21.15.18:0/2478840008 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51080c8fe0 0x7f510815ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:32.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.656+0000 7f51077fe640 1 -- 172.21.15.18:0/2478840008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51080b7640 msgr2=0x7f51080b0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:32.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.656+0000 7f51077fe640 1 --2- 172.21.15.18:0/2478840008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51080b7640 0x7f51080b0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:32.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.656+0000 7f51077fe640 1 -- 172.21.15.18:0/2478840008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51080c7340 con 0x7f50f00039e0 2024-09-19T09:14:32.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.656+0000 7f5107fff640 1 --2- 172.21.15.18:0/2478840008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51080b7640 0x7f51080b0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:32.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.656+0000 7f51077fe640 1 --2- 172.21.15.18:0/2478840008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50f00039e0 0x7f51080c80a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f50f8034040 tx=0x7f50f8001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:32.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.656+0000 7f50effff640 1 -- 172.21.15.18:0/2478840008 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f80049e0 con 0x7f50f00039e0 2024-09-19T09:14:32.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.656+0000 7f50effff640 1 -- 172.21.15.18:0/2478840008 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50f8043070 con 0x7f50f00039e0 2024-09-19T09:14:32.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.656+0000 7f510dedd640 1 -- 172.21.15.18:0/2478840008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51080b7f50 con 0x7f50f00039e0 2024-09-19T09:14:32.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.656+0000 7f50effff640 1 -- 172.21.15.18:0/2478840008 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50f8004d80 con 0x7f50f00039e0 2024-09-19T09:14:32.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.656+0000 7f510dedd640 1 -- 172.21.15.18:0/2478840008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51080c78a0 con 0x7f50f00039e0 2024-09-19T09:14:32.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.657+0000 7f510dedd640 1 -- 172.21.15.18:0/2478840008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51080cf940 con 0x7f50f00039e0 2024-09-19T09:14:32.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.658+0000 7f50effff640 1 -- 172.21.15.18:0/2478840008 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f50f8007070 con 0x7f50f00039e0 2024-09-19T09:14:32.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.658+0000 7f50effff640 1 --2- 172.21.15.18:0/2478840008 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f50f406c2e0 0x7f50f406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:32.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.658+0000 7f50effff640 1 -- 172.21.15.18:0/2478840008 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4943+0+0 (secure 0 0 0) 0x7f50f80ab530 con 0x7f50f00039e0 2024-09-19T09:14:32.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.658+0000 7f5106ffd640 1 --2- 172.21.15.18:0/2478840008 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f50f406c2e0 0x7f50f406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:32.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.659+0000 7f5106ffd640 1 --2- 172.21.15.18:0/2478840008 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f50f406c2e0 0x7f50f406e7a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f51080b1190 tx=0x7f50fc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:32.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.663+0000 7f50effff640 1 -- 172.21.15.18:0/2478840008 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f51080c7340 con 0x7f50f00039e0 2024-09-19T09:14:32.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.878+0000 7f510dedd640 1 -- 172.21.15.18:0/2478840008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51080b5110 con 0x7f50f00039e0 2024-09-19T09:14:32.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.879+0000 7f50effff640 1 -- 172.21.15.18:0/2478840008 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+3917 (secure 0 0 0) 0x7f50f8079fa0 con 0x7f50f00039e0 2024-09-19T09:14:32.879 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:32.879 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":15,"btime":"2024-09-19T09:14:27:713414+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1369179501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1369179501},{"type":"v1","addr":"172.21.15.18:6835","nonce":1369179501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4762,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2677647932","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2677647932},{"type":"v1","addr":"172.21.15.162:6836","nonce":2677647932}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4765,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3427373581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3427373581},{"type":"v1","addr":"172.21.15.162:6837","nonce":3427373581}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5106,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1458972436","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1458972436},{"type":"v1","addr":"172.21.15.18:6834","nonce":1458972436}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15}],"filesystems":[]} 2024-09-19T09:14:32.880 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 15 2024-09-19T09:14:32.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.881+0000 7f510dedd640 1 -- 172.21.15.18:0/2478840008 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f50f406c2e0 msgr2=0x7f50f406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:32.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.881+0000 7f510dedd640 1 --2- 172.21.15.18:0/2478840008 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f50f406c2e0 0x7f50f406e7a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f51080b1190 tx=0x7f50fc009040 comp rx=0 tx=0).stop 2024-09-19T09:14:32.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.881+0000 7f510dedd640 1 -- 172.21.15.18:0/2478840008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50f00039e0 msgr2=0x7f51080c80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:32.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.881+0000 7f510dedd640 1 --2- 172.21.15.18:0/2478840008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50f00039e0 0x7f51080c80a0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f50f8034040 tx=0x7f50f8001a40 comp rx=0 tx=0).stop 2024-09-19T09:14:32.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.881+0000 7f510dedd640 1 -- 172.21.15.18:0/2478840008 shutdown_connections 2024-09-19T09:14:32.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.881+0000 7f510dedd640 1 --2- 172.21.15.18:0/2478840008 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f50f406c2e0 0x7f50f406e7a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:32.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.881+0000 7f510dedd640 1 --2- 172.21.15.18:0/2478840008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51080b7640 0x7f51080b0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:32.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.881+0000 7f510dedd640 1 --2- 172.21.15.18:0/2478840008 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51080c8fe0 0x7f510815ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:32.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.881+0000 7f510dedd640 1 --2- 172.21.15.18:0/2478840008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50f00039e0 0x7f51080c80a0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:32.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.881+0000 7f510dedd640 1 -- 172.21.15.18:0/2478840008 >> 172.21.15.18:0/2478840008 conn(0x7f51080b4700 msgr2=0x7f51080ce500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:32.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.881+0000 7f510dedd640 1 -- 172.21.15.18:0/2478840008 shutdown_connections 2024-09-19T09:14:32.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:32.881+0000 7f510dedd640 1 -- 172.21.15.18:0/2478840008 wait complete. 2024-09-19T09:14:32.893 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T09:14:32.893 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-19T09:14:32.893 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T09:14:32.893 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:14:32.893 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T09:14:32.893 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-19T09:14:32.894 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T09:14:32.894 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:14:32.894 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T09:14:32.894 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-19T09:14:32.894 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T09:14:32.894 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:14:32.894 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T09:14:32.895 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-19T09:14:32.895 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T09:14:32.895 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:14:32.903 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T09:14:32.904 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T09:14:32.904 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T09:14:32.904 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T09:14:32.907 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T09:14:32.908 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T09:14:32.947 INFO:tasks.ceph.mds.c:Started 2024-09-19T09:14:32.947 DEBUG:teuthology.parallel:result is None 2024-09-19T09:14:32.948 INFO:tasks.ceph.mds.a:Started 2024-09-19T09:14:32.948 DEBUG:teuthology.parallel:result is None 2024-09-19T09:14:32.951 INFO:tasks.ceph.mds.d:Started 2024-09-19T09:14:32.951 DEBUG:teuthology.parallel:result is None 2024-09-19T09:14:33.024 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2024-09-19T09:14:33.024 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-09-19T09:14:33.034 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-09-19T09:14:37.255 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-19T09:14:38.908 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T09:14:38.908 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T09:14:38.911 INFO:tasks.ceph.mds.b:Started 2024-09-19T09:14:38.911 DEBUG:teuthology.parallel:result is None 2024-09-19T09:14:38.912 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-19T09:14:38.996 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-09-19T09:14:39.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.029+0000 7f141d76d640 1 Processor -- start 2024-09-19T09:14:39.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.029+0000 7f141d76d640 1 -- start start 2024-09-19T09:14:39.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.030+0000 7f141d76d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f141815eda0 0x7f14180d5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:39.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.030+0000 7f141d76d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f14180d0480 0x7f14180d35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:39.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.030+0000 7f141d76d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14180d0bf0 con 0x7f14180d3af0 2024-09-19T09:14:39.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.030+0000 7f141d76d640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f14180d2880 con 0x7f141815eda0 2024-09-19T09:14:39.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.030+0000 7f141d76d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f14180d3120 con 0x7f14180d0480 2024-09-19T09:14:39.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.030+0000 7f1416ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f141815eda0 0x7f14180d5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:39.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.030+0000 7f1416ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f141815eda0 0x7f14180d5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56228/0 (socket says 172.21.15.18:56228) 2024-09-19T09:14:39.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.030+0000 7f1416ffd640 1 -- 172.21.15.18:0/3251595788 learned_addr learned my addr 172.21.15.18:0/3251595788 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:39.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.030+0000 7f140e7fc640 1 --2- 172.21.15.18:0/3251595788 >> v2:172.21.15.162:3300/0 conn(0x7f14180d0480 0x7f14180d35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:39.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.030+0000 7f1416ffd640 1 -- 172.21.15.18:0/3251595788 >> v2:172.21.15.162:3300/0 conn(0x7f14180d0480 msgr2=0x7f14180d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:39.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.030+0000 7f1416ffd640 1 --2- 172.21.15.18:0/3251595788 >> v2:172.21.15.162:3300/0 conn(0x7f14180d0480 0x7f14180d35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:39.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.030+0000 7f1416ffd640 1 -- 172.21.15.18:0/3251595788 >> v1:172.21.15.162:6789/0 conn(0x7f14180d3af0 legacy=0x7f14180d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:39.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.030+0000 7f1416ffd640 1 -- 172.21.15.18:0/3251595788 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14180d2ad0 con 0x7f141815eda0 2024-09-19T09:14:39.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.031+0000 7f1416ffd640 1 --2- 172.21.15.18:0/3251595788 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f141815eda0 0x7f14180d5790 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f14180b7870 tx=0x7f140802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5365f9e74c3110 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:39.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.031+0000 7f14167fc640 1 -- 172.21.15.18:0/3251595788 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1408037070 con 0x7f141815eda0 2024-09-19T09:14:39.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.031+0000 7f14167fc640 1 -- 172.21.15.18:0/3251595788 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1408032440 con 0x7f141815eda0 2024-09-19T09:14:39.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.031+0000 7f14167fc640 1 -- 172.21.15.18:0/3251595788 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1408032810 con 0x7f141815eda0 2024-09-19T09:14:39.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.032+0000 7f141d76d640 1 -- 172.21.15.18:0/3251595788 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f141815eda0 msgr2=0x7f14180d5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:39.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.032+0000 7f141d76d640 1 --2- 172.21.15.18:0/3251595788 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f141815eda0 0x7f14180d5790 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f14180b7870 tx=0x7f140802a270 comp rx=0 tx=0).stop 2024-09-19T09:14:39.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.032+0000 7f141d76d640 1 -- 172.21.15.18:0/3251595788 shutdown_connections 2024-09-19T09:14:39.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.032+0000 7f141d76d640 1 --2- 172.21.15.18:0/3251595788 >> v2:172.21.15.162:3300/0 conn(0x7f14180d0480 0x7f14180d35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:39.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.032+0000 7f141d76d640 1 --2- 172.21.15.18:0/3251595788 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f141815eda0 0x7f14180d5790 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:39.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.032+0000 7f141d76d640 1 -- 172.21.15.18:0/3251595788 >> 172.21.15.18:0/3251595788 conn(0x7f141809df40 msgr2=0x7f14180d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:39.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.032+0000 7f141d76d640 1 -- 172.21.15.18:0/3251595788 shutdown_connections 2024-09-19T09:14:39.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.032+0000 7f141d76d640 1 -- 172.21.15.18:0/3251595788 wait complete. 2024-09-19T09:14:39.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.033+0000 7f141d76d640 1 Processor -- start 2024-09-19T09:14:39.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.033+0000 7f141d76d640 1 -- start start 2024-09-19T09:14:39.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.034+0000 7f141d76d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14180d0480 0x7f1418157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:39.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.034+0000 7f141d76d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f141815eda0 0x7f1418158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:39.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.034+0000 7f141d76d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f141815f9e0 0x7f1418158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:39.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.034+0000 7f141d76d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f141815f180 con 0x7f14180d0480 2024-09-19T09:14:39.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.034+0000 7f141d76d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f14180d08f0 con 0x7f141815eda0 2024-09-19T09:14:39.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.034+0000 7f141d76d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f141815f300 con 0x7f141815f9e0 2024-09-19T09:14:39.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.034+0000 7f1416ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14180d0480 0x7f1418157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:39.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.034+0000 7f1416ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14180d0480 0x7f1418157270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56244/0 (socket says 172.21.15.18:56244) 2024-09-19T09:14:39.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.034+0000 7f1416ffd640 1 -- 172.21.15.18:0/1563570853 learned_addr learned my addr 172.21.15.18:0/1563570853 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:39.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.034+0000 7f140e7fc640 1 --2- 172.21.15.18:0/1563570853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f141815eda0 0x7f1418158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:39.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.034+0000 7f14177fe640 1 --2- 172.21.15.18:0/1563570853 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f141815f9e0 0x7f1418158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:39.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.034+0000 7f1416ffd640 1 -- 172.21.15.18:0/1563570853 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f141815f9e0 msgr2=0x7f1418158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:39.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.034+0000 7f1416ffd640 1 --2- 172.21.15.18:0/1563570853 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f141815f9e0 0x7f1418158eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:39.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.034+0000 7f1416ffd640 1 -- 172.21.15.18:0/1563570853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f141815eda0 msgr2=0x7f1418158970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:39.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.034+0000 7f1416ffd640 1 --2- 172.21.15.18:0/1563570853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f141815eda0 0x7f1418158970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:39.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.034+0000 7f1416ffd640 1 -- 172.21.15.18:0/1563570853 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1418162730 con 0x7f14180d0480 2024-09-19T09:14:39.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.035+0000 7f1416ffd640 1 --2- 172.21.15.18:0/1563570853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14180d0480 0x7f1418157270 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f140802a2b0 tx=0x7f14080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:39.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.035+0000 7f140ffff640 1 -- 172.21.15.18:0/1563570853 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1408041020 con 0x7f14180d0480 2024-09-19T09:14:39.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.035+0000 7f140ffff640 1 -- 172.21.15.18:0/1563570853 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14080306c0 con 0x7f14180d0480 2024-09-19T09:14:39.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.035+0000 7f140ffff640 1 -- 172.21.15.18:0/1563570853 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1408037040 con 0x7f14180d0480 2024-09-19T09:14:39.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.035+0000 7f141d76d640 1 -- 172.21.15.18:0/1563570853 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14180cc530 con 0x7f14180d0480 2024-09-19T09:14:39.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.035+0000 7f141d76d640 1 -- 172.21.15.18:0/1563570853 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14180ccaf0 con 0x7f14180d0480 2024-09-19T09:14:39.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.036+0000 7f141d76d640 1 -- 172.21.15.18:0/1563570853 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14180d35b0 con 0x7f14180d0480 2024-09-19T09:14:39.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.036+0000 7f140ffff640 1 -- 172.21.15.18:0/1563570853 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1408044020 con 0x7f14180d0480 2024-09-19T09:14:39.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.037+0000 7f140ffff640 1 --2- 172.21.15.18:0/1563570853 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f13f806c2e0 0x7f13f806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:39.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.037+0000 7f140ffff640 1 -- 172.21.15.18:0/1563570853 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4943+0+0 (secure 0 0 0) 0x7f14080ab760 con 0x7f14180d0480 2024-09-19T09:14:39.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.037+0000 7f140e7fc640 1 --2- 172.21.15.18:0/1563570853 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f13f806c2e0 0x7f13f806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:39.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.038+0000 7f140e7fc640 1 --2- 172.21.15.18:0/1563570853 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f13f806c2e0 0x7f13f806e7a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f14180cf260 tx=0x7f1400008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:39.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.041+0000 7f140ffff640 1 -- 172.21.15.18:0/1563570853 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f140804b030 con 0x7f14180d0480 2024-09-19T09:14:39.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:39.230+0000 7f141d76d640 1 -- 172.21.15.18:0/1563570853 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f14180d2330 con 0x7f14180d0480 2024-09-19T09:14:40.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:40.917+0000 7f140ffff640 1 -- 172.21.15.18:0/1563570853 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v44) ==== 97+0+0 (secure 0 0 0) 0x7f1408079b60 con 0x7f14180d0480 2024-09-19T09:14:40.918 INFO:teuthology.orchestra.run.smithi018.stderr: removed all blocklist entries 2024-09-19T09:14:40.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:40.921+0000 7f141d76d640 1 -- 172.21.15.18:0/1563570853 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f13f806c2e0 msgr2=0x7f13f806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:40.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:40.921+0000 7f141d76d640 1 --2- 172.21.15.18:0/1563570853 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f13f806c2e0 0x7f13f806e7a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f14180cf260 tx=0x7f1400008040 comp rx=0 tx=0).stop 2024-09-19T09:14:40.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:40.921+0000 7f141d76d640 1 -- 172.21.15.18:0/1563570853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14180d0480 msgr2=0x7f1418157270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:40.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:40.921+0000 7f141d76d640 1 --2- 172.21.15.18:0/1563570853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14180d0480 0x7f1418157270 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f140802a2b0 tx=0x7f14080046c0 comp rx=0 tx=0).stop 2024-09-19T09:14:40.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:40.921+0000 7f141d76d640 1 -- 172.21.15.18:0/1563570853 shutdown_connections 2024-09-19T09:14:40.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:40.921+0000 7f141d76d640 1 --2- 172.21.15.18:0/1563570853 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f13f806c2e0 0x7f13f806e7a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:40.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:40.921+0000 7f141d76d640 1 --2- 172.21.15.18:0/1563570853 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f141815f9e0 0x7f1418158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:40.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:40.921+0000 7f141d76d640 1 --2- 172.21.15.18:0/1563570853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f141815eda0 0x7f1418158970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:40.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:40.921+0000 7f141d76d640 1 --2- 172.21.15.18:0/1563570853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14180d0480 0x7f1418157270 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:40.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:40.921+0000 7f141d76d640 1 -- 172.21.15.18:0/1563570853 >> 172.21.15.18:0/1563570853 conn(0x7f141809df40 msgr2=0x7f14180b8740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:40.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:40.921+0000 7f141d76d640 1 -- 172.21.15.18:0/1563570853 shutdown_connections 2024-09-19T09:14:40.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:40.921+0000 7f141d76d640 1 -- 172.21.15.18:0/1563570853 wait complete. 2024-09-19T09:14:40.936 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-19T09:14:41.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.045+0000 7f7d6842e640 1 Processor -- start 2024-09-19T09:14:41.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.045+0000 7f7d6842e640 1 -- start start 2024-09-19T09:14:41.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.046+0000 7f7d6842e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7d600cfae0 0x7f7d600b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:41.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.046+0000 7f7d6842e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d6006d730 0x7f7d600cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:41.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.046+0000 7f7d6842e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d600cd1a0 con 0x7f7d6015ef80 2024-09-19T09:14:41.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.046+0000 7f7d6842e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f7d600cd7d0 con 0x7f7d600cfae0 2024-09-19T09:14:41.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.046+0000 7f7d6842e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7d6006dc30 con 0x7f7d6006d730 2024-09-19T09:14:41.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.046+0000 7f7d669cb640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d6006d730 0x7f7d600cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:41.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.046+0000 7f7d669cb640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d6006d730 0x7f7d600cdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:59660/0 (socket says 172.21.15.18:59660) 2024-09-19T09:14:41.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.046+0000 7f7d669cb640 1 -- 172.21.15.18:0/2435752353 learned_addr learned my addr 172.21.15.18:0/2435752353 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:41.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.046+0000 7f7d659c9640 1 --2- 172.21.15.18:0/2435752353 >> v2:172.21.15.162:3300/0 conn(0x7f7d600cfae0 0x7f7d600b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:41.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.046+0000 7f7d651c8640 1 -- 172.21.15.18:0/2435752353 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2515122512 0 0) 0x7f7d600cd1a0 con 0x7f7d6015ef80 2024-09-19T09:14:41.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.046+0000 7f7d669cb640 1 -- 172.21.15.18:0/2435752353 >> v2:172.21.15.162:3300/0 conn(0x7f7d600cfae0 msgr2=0x7f7d600b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:41.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.046+0000 7f7d669cb640 1 --2- 172.21.15.18:0/2435752353 >> v2:172.21.15.162:3300/0 conn(0x7f7d600cfae0 0x7f7d600b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:41.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.047+0000 7f7d669cb640 1 -- 172.21.15.18:0/2435752353 >> v1:172.21.15.162:6789/0 conn(0x7f7d6015ef80 legacy=0x7f7d600cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:41.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.047+0000 7f7d669cb640 1 -- 172.21.15.18:0/2435752353 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d6006df10 con 0x7f7d6006d730 2024-09-19T09:14:41.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.047+0000 7f7d669cb640 1 --2- 172.21.15.18:0/2435752353 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d6006d730 0x7f7d600cdc60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7d58009e50 tx=0x7f7d5802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ace45cdad589a6d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:41.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.047+0000 7f7d651c8640 1 -- 172.21.15.18:0/2435752353 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d58036070 con 0x7f7d6006d730 2024-09-19T09:14:41.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.048+0000 7f7d651c8640 1 -- 172.21.15.18:0/2435752353 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d58031600 con 0x7f7d6006d730 2024-09-19T09:14:41.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.048+0000 7f7d651c8640 1 -- 172.21.15.18:0/2435752353 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d580319d0 con 0x7f7d6006d730 2024-09-19T09:14:41.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.048+0000 7f7d6842e640 1 -- 172.21.15.18:0/2435752353 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d6006d730 msgr2=0x7f7d600cdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:41.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.048+0000 7f7d6842e640 1 --2- 172.21.15.18:0/2435752353 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d6006d730 0x7f7d600cdc60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7d58009e50 tx=0x7f7d5802a710 comp rx=0 tx=0).stop 2024-09-19T09:14:41.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.048+0000 7f7d6842e640 1 -- 172.21.15.18:0/2435752353 shutdown_connections 2024-09-19T09:14:41.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.048+0000 7f7d6842e640 1 --2- 172.21.15.18:0/2435752353 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d6006d730 0x7f7d600cdc60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:41.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.048+0000 7f7d6842e640 1 --2- 172.21.15.18:0/2435752353 >> v2:172.21.15.162:3300/0 conn(0x7f7d600cfae0 0x7f7d600b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:41.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.048+0000 7f7d6842e640 1 -- 172.21.15.18:0/2435752353 >> 172.21.15.18:0/2435752353 conn(0x7f7d600b4700 msgr2=0x7f7d600b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:41.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.048+0000 7f7d6842e640 1 -- 172.21.15.18:0/2435752353 shutdown_connections 2024-09-19T09:14:41.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.048+0000 7f7d6842e640 1 -- 172.21.15.18:0/2435752353 wait complete. 2024-09-19T09:14:41.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.049+0000 7f7d6842e640 1 Processor -- start 2024-09-19T09:14:41.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.049+0000 7f7d6842e640 1 -- start start 2024-09-19T09:14:41.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.050+0000 7f7d6842e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d6006d730 0x7f7d600cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:41.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.050+0000 7f7d6842e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d600cfae0 0x7f7d600ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:41.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.050+0000 7f7d6842e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d6015ef80 0x7f7d600cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:41.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.050+0000 7f7d6842e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7d600d0120 con 0x7f7d6015ef80 2024-09-19T09:14:41.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.050+0000 7f7d6842e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7d6015f360 con 0x7f7d600cfae0 2024-09-19T09:14:41.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.050+0000 7f7d6842e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7d600ce1a0 con 0x7f7d6006d730 2024-09-19T09:14:41.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.050+0000 7f7d669cb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d6015ef80 0x7f7d600cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:41.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.050+0000 7f7d669cb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d6015ef80 0x7f7d600cba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56254/0 (socket says 172.21.15.18:56254) 2024-09-19T09:14:41.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.050+0000 7f7d669cb640 1 -- 172.21.15.18:0/293114886 learned_addr learned my addr 172.21.15.18:0/293114886 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:41.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.051+0000 7f7d659c9640 1 --2- 172.21.15.18:0/293114886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d600cfae0 0x7f7d600ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:41.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.051+0000 7f7d661ca640 1 --2- 172.21.15.18:0/293114886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d6006d730 0x7f7d600cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:41.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.051+0000 7f7d669cb640 1 -- 172.21.15.18:0/293114886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d6006d730 msgr2=0x7f7d600cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:41.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.051+0000 7f7d669cb640 1 --2- 172.21.15.18:0/293114886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d6006d730 0x7f7d600cca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:41.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.051+0000 7f7d669cb640 1 -- 172.21.15.18:0/293114886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d600cfae0 msgr2=0x7f7d600ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:41.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.051+0000 7f7d669cb640 1 --2- 172.21.15.18:0/293114886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d600cfae0 0x7f7d600ca0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:41.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.051+0000 7f7d669cb640 1 -- 172.21.15.18:0/293114886 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d600c8e60 con 0x7f7d6015ef80 2024-09-19T09:14:41.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.051+0000 7f7d661ca640 1 --2- 172.21.15.18:0/293114886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d6006d730 0x7f7d600cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:14:41.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.051+0000 7f7d669cb640 1 --2- 172.21.15.18:0/293114886 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d6015ef80 0x7f7d600cba20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7d58034040 tx=0x7f7d58004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:41.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.051+0000 7f7d56ffd640 1 -- 172.21.15.18:0/293114886 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d58036050 con 0x7f7d6015ef80 2024-09-19T09:14:41.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.051+0000 7f7d56ffd640 1 -- 172.21.15.18:0/293114886 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d58042070 con 0x7f7d6015ef80 2024-09-19T09:14:41.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.051+0000 7f7d6842e640 1 -- 172.21.15.18:0/293114886 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d6015fe70 con 0x7f7d6015ef80 2024-09-19T09:14:41.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.051+0000 7f7d56ffd640 1 -- 172.21.15.18:0/293114886 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d58009510 con 0x7f7d6015ef80 2024-09-19T09:14:41.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.051+0000 7f7d6842e640 1 -- 172.21.15.18:0/293114886 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d600cbf60 con 0x7f7d6015ef80 2024-09-19T09:14:41.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.052+0000 7f7d6842e640 1 -- 172.21.15.18:0/293114886 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d6015fc60 con 0x7f7d6015ef80 2024-09-19T09:14:41.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.052+0000 7f7d56ffd640 1 -- 172.21.15.18:0/293114886 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7d58007b70 con 0x7f7d6015ef80 2024-09-19T09:14:41.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.053+0000 7f7d56ffd640 1 --2- 172.21.15.18:0/293114886 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7d4406c2b0 0x7f7d4406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:41.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.053+0000 7f7d56ffd640 1 -- 172.21.15.18:0/293114886 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4857+0+0 (secure 0 0 0) 0x7f7d580abf40 con 0x7f7d6015ef80 2024-09-19T09:14:41.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.053+0000 7f7d661ca640 1 --2- 172.21.15.18:0/293114886 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7d4406c2b0 0x7f7d4406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:41.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.054+0000 7f7d661ca640 1 --2- 172.21.15.18:0/293114886 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7d4406c2b0 0x7f7d4406e770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c000f60 tx=0x7f7d5c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:41.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.057+0000 7f7d56ffd640 1 -- 172.21.15.18:0/293114886 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7d58045360 con 0x7f7d6015ef80 2024-09-19T09:14:41.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.300+0000 7f7d6842e640 1 -- 172.21.15.18:0/293114886 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f7d600cdc60 con 0x7f7d6015ef80 2024-09-19T09:14:41.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.301+0000 7f7d56ffd640 1 -- 172.21.15.18:0/293114886 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) ==== 80+0+5304 (secure 0 0 0) 0x7f7d5807aab0 con 0x7f7d6015ef80 2024-09-19T09:14:41.301 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:41.302 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:14:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_dump": [ 2024-09-19T09:14:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.a", 2024-09-19T09:14:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmDY7cHhAALxtxGq6eR3A2QXYp+nW0FA==", 2024-09-19T09:14:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:14:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:14:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:14:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:14:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.b", 2024-09-19T09:14:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tm9ILFKhAABEtgvzO5YBXqzYaeBZ0qZg==", 2024-09-19T09:14:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:14:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:14:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:14:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:14:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.c", 2024-09-19T09:14:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmwPkOJhAADt/0XVei2kl79pIw55wu1A==", 2024-09-19T09:14:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:14:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:14:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:14:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:14:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.d", 2024-09-19T09:14:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tm35XYMRAA/OSE5iv8M+TekEJVTARETw==", 2024-09-19T09:14:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:14:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:14:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:14:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:14:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.0", 2024-09-19T09:14:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmkUBiGhAATWtnqNPWyZJ+tnQcZOtT5A==", 2024-09-19T09:14:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:14:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:14:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:14:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.1", 2024-09-19T09:14:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmir5wIRAA9QumyCr8yLHtNj/YqQ1d0A==", 2024-09-19T09:14:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:14:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:14:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:14:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.2", 2024-09-19T09:14:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmfQJ6KBAAfTerKv1zCzFf6UfAVUikxA==", 2024-09-19T09:14:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:14:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:14:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:14:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.3", 2024-09-19T09:14:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmSeSOLxAACqCpiIQO4cDyjXUmoGPKAQ==", 2024-09-19T09:14:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:14:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:14:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:14:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.4", 2024-09-19T09:14:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmrsoFAhAArI7cRPVe/jrnSdmyE8jCsQ==", 2024-09-19T09:14:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:14:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:14:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:14:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.5", 2024-09-19T09:14:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmudM3CRAAXF3uI58SNJE6qtYX2wNQeQ==", 2024-09-19T09:14:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:14:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:14:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:14:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.6", 2024-09-19T09:14:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmqEQmEBAAm4h/8p91HwX84pl/U80Q9Q==", 2024-09-19T09:14:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:14:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:14:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:14:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.7", 2024-09-19T09:14:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmhDs0FxAAxZvRVkBoWqsdmyifRZzgwg==", 2024-09-19T09:14:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:14:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:14:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:14:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.0", 2024-09-19T09:14:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmcbwDNhAAaG0+wu96Locwws+h0zeh8Q==", 2024-09-19T09:14:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:14:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow r", 2024-09-19T09:14:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-19T09:14:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.1", 2024-09-19T09:14:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAf6+tmb4FeAxAAU+nZN/Vb33HrU0yfXmU9gA==", 2024-09-19T09:14:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:14:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-19T09:14:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-19T09:14:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-19T09:14:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.2", 2024-09-19T09:14:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAf6+tmc34kABAAC5b4Kkm2dJvxxyXva6PT2g==", 2024-09-19T09:14:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:14:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-19T09:14:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-19T09:14:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-19T09:14:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.3", 2024-09-19T09:14:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAf6+tmx4vzCBAAZ7ZrdGI2s8LqT0MjjzOCjw==", 2024-09-19T09:14:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:14:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-19T09:14:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-19T09:14:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-19T09:14:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.admin", 2024-09-19T09:14:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmZaWgAhAAx7MUazt6rS+wa/ZMSGC97Q==", 2024-09-19T09:14:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-19T09:14:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:14:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:14:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:14:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.x", 2024-09-19T09:14:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmwr6NGxAA3M5NZKkjc36L25teWJS7bQ==", 2024-09-19T09:14:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-19T09:14:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-09-19T09:14:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:14:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.y", 2024-09-19T09:14:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmBWOWFxAAEYKCroBhMcqoIe6WzXnNCg==", 2024-09-19T09:14:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:14:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-19T09:14:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-09-19T09:14:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:14:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:41.314 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:14:41.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.303+0000 7f7d6842e640 1 -- 172.21.15.18:0/293114886 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7d4406c2b0 msgr2=0x7f7d4406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:41.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.303+0000 7f7d6842e640 1 --2- 172.21.15.18:0/293114886 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7d4406c2b0 0x7f7d4406e770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c000f60 tx=0x7f7d5c009040 comp rx=0 tx=0).stop 2024-09-19T09:14:41.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.303+0000 7f7d6842e640 1 -- 172.21.15.18:0/293114886 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d6015ef80 msgr2=0x7f7d600cba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:41.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.303+0000 7f7d6842e640 1 --2- 172.21.15.18:0/293114886 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d6015ef80 0x7f7d600cba20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7d58034040 tx=0x7f7d58004a40 comp rx=0 tx=0).stop 2024-09-19T09:14:41.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.303+0000 7f7d6842e640 1 -- 172.21.15.18:0/293114886 shutdown_connections 2024-09-19T09:14:41.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.303+0000 7f7d6842e640 1 --2- 172.21.15.18:0/293114886 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7d4406c2b0 0x7f7d4406e770 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:41.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.303+0000 7f7d6842e640 1 --2- 172.21.15.18:0/293114886 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7d6015ef80 0x7f7d600cba20 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:41.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.303+0000 7f7d6842e640 1 --2- 172.21.15.18:0/293114886 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7d600cfae0 0x7f7d600ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:41.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.303+0000 7f7d6842e640 1 --2- 172.21.15.18:0/293114886 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7d6006d730 0x7f7d600cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:41.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.303+0000 7f7d6842e640 1 -- 172.21.15.18:0/293114886 >> 172.21.15.18:0/293114886 conn(0x7f7d600b4700 msgr2=0x7f7d6015c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:41.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.303+0000 7f7d6842e640 1 -- 172.21.15.18:0/293114886 shutdown_connections 2024-09-19T09:14:41.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.303+0000 7f7d6842e640 1 -- 172.21.15.18:0/293114886 wait complete. 2024-09-19T09:14:41.317 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-19T09:14:41.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.419+0000 7f7027933640 1 Processor -- start 2024-09-19T09:14:41.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.419+0000 7f7027933640 1 -- start start 2024-09-19T09:14:41.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.420+0000 7f7027933640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f702015ef80 0x7f70200b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:41.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.420+0000 7f7027933640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f70200cfae0 0x7f70200cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:41.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.420+0000 7f7027933640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70200cd1a0 con 0x7f702006d730 2024-09-19T09:14:41.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.420+0000 7f7027933640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f70200cd7d0 con 0x7f70200cfae0 2024-09-19T09:14:41.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.420+0000 7f7027933640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f702006dc30 con 0x7f702015ef80 2024-09-19T09:14:41.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.420+0000 7f7025ed0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f70200cfae0 0x7f70200cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:41.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.420+0000 7f7024ece640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f702006d730 0x7f70200cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51392/0 (socket says 172.21.15.18:51392) 2024-09-19T09:14:41.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.420+0000 7f7024ece640 1 -- 172.21.15.18:0/2803221702 learned_addr learned my addr 172.21.15.18:0/2803221702 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:41.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.420+0000 7f70256cf640 1 --2- 172.21.15.18:0/2803221702 >> v2:172.21.15.162:3300/0 conn(0x7f702015ef80 0x7f70200b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:41.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.420+0000 7f7025ed0640 1 -- 172.21.15.18:0/2803221702 >> v2:172.21.15.162:3300/0 conn(0x7f702015ef80 msgr2=0x7f70200b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:41.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.420+0000 7f7025ed0640 1 --2- 172.21.15.18:0/2803221702 >> v2:172.21.15.162:3300/0 conn(0x7f702015ef80 0x7f70200b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:41.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.420+0000 7f7025ed0640 1 -- 172.21.15.18:0/2803221702 >> v1:172.21.15.18:6789/0 conn(0x7f702006d730 legacy=0x7f70200cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:41.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.420+0000 7f7025ed0640 1 -- 172.21.15.18:0/2803221702 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f702006df10 con 0x7f70200cfae0 2024-09-19T09:14:41.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.420+0000 7f7017fff640 1 -- 172.21.15.18:0/2803221702 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4259377835 0 0) 0x7f70200cd1a0 con 0x7f702006d730 2024-09-19T09:14:41.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.421+0000 7f7025ed0640 1 --2- 172.21.15.18:0/2803221702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70200cfae0 0x7f70200cdc60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f702006f6e0 tx=0x7f701802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=894a8420d12b388 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:41.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.421+0000 7f7017fff640 1 -- 172.21.15.18:0/2803221702 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7018007740 con 0x7f70200cfae0 2024-09-19T09:14:41.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.421+0000 7f7017fff640 1 -- 172.21.15.18:0/2803221702 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70180078e0 con 0x7f70200cfae0 2024-09-19T09:14:41.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.421+0000 7f7017fff640 1 -- 172.21.15.18:0/2803221702 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7018007cb0 con 0x7f70200cfae0 2024-09-19T09:14:41.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.422+0000 7f7027933640 1 -- 172.21.15.18:0/2803221702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70200cfae0 msgr2=0x7f70200cdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:41.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.422+0000 7f7027933640 1 --2- 172.21.15.18:0/2803221702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70200cfae0 0x7f70200cdc60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f702006f6e0 tx=0x7f701802a680 comp rx=0 tx=0).stop 2024-09-19T09:14:41.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.422+0000 7f7027933640 1 -- 172.21.15.18:0/2803221702 shutdown_connections 2024-09-19T09:14:41.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.422+0000 7f7027933640 1 --2- 172.21.15.18:0/2803221702 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70200cfae0 0x7f70200cdc60 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:41.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.422+0000 7f7027933640 1 --2- 172.21.15.18:0/2803221702 >> v2:172.21.15.162:3300/0 conn(0x7f702015ef80 0x7f70200b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:41.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.422+0000 7f7027933640 1 -- 172.21.15.18:0/2803221702 >> 172.21.15.18:0/2803221702 conn(0x7f70200b4700 msgr2=0x7f70200b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:41.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.422+0000 7f7027933640 1 -- 172.21.15.18:0/2803221702 shutdown_connections 2024-09-19T09:14:41.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.422+0000 7f7027933640 1 -- 172.21.15.18:0/2803221702 wait complete. 2024-09-19T09:14:41.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.423+0000 7f7027933640 1 Processor -- start 2024-09-19T09:14:41.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.423+0000 7f7027933640 1 -- start start 2024-09-19T09:14:41.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.424+0000 7f7027933640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f702006d730 0x7f70200b81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:41.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.424+0000 7f7027933640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70200cfae0 0x7f702015b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:41.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.424+0000 7f7027933640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f702015ef80 0x7f702015d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:41.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.424+0000 7f7027933640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f70200d0120 con 0x7f70200cfae0 2024-09-19T09:14:41.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.424+0000 7f7027933640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f702015f360 con 0x7f702015ef80 2024-09-19T09:14:41.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.424+0000 7f7027933640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f70200ce1a0 con 0x7f702006d730 2024-09-19T09:14:41.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.424+0000 7f7024ece640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70200cfae0 0x7f702015b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:41.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.424+0000 7f7024ece640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70200cfae0 0x7f702015b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56278/0 (socket says 172.21.15.18:56278) 2024-09-19T09:14:41.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.424+0000 7f7024ece640 1 -- 172.21.15.18:0/2789599346 learned_addr learned my addr 172.21.15.18:0/2789599346 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:41.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.424+0000 7f70256cf640 1 --2- 172.21.15.18:0/2789599346 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f702006d730 0x7f70200b81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:41.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.424+0000 7f7025ed0640 1 --2- 172.21.15.18:0/2789599346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f702015ef80 0x7f702015d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:41.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.424+0000 7f7024ece640 1 -- 172.21.15.18:0/2789599346 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f702006d730 msgr2=0x7f70200b81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:41.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.424+0000 7f7024ece640 1 --2- 172.21.15.18:0/2789599346 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f702006d730 0x7f70200b81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:41.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.424+0000 7f7024ece640 1 -- 172.21.15.18:0/2789599346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f702015ef80 msgr2=0x7f702015d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:41.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.424+0000 7f7024ece640 1 --2- 172.21.15.18:0/2789599346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f702015ef80 0x7f702015d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:41.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.424+0000 7f7024ece640 1 -- 172.21.15.18:0/2789599346 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70200b8720 con 0x7f70200cfae0 2024-09-19T09:14:41.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.424+0000 7f7025ed0640 1 --2- 172.21.15.18:0/2789599346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f702015ef80 0x7f702015d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:41.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.424+0000 7f70256cf640 1 --2- 172.21.15.18:0/2789599346 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f702006d730 0x7f70200b81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:41.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.424+0000 7f7024ece640 1 --2- 172.21.15.18:0/2789599346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70200cfae0 0x7f702015b340 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f701000c4d0 tx=0x7f701000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:41.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.425+0000 7f7015ffb640 1 -- 172.21.15.18:0/2789599346 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7010018070 con 0x7f70200cfae0 2024-09-19T09:14:41.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.425+0000 7f7015ffb640 1 -- 172.21.15.18:0/2789599346 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7010007500 con 0x7f70200cfae0 2024-09-19T09:14:41.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.425+0000 7f7027933640 1 -- 172.21.15.18:0/2789599346 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f702015bd70 con 0x7f70200cfae0 2024-09-19T09:14:41.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.425+0000 7f7015ffb640 1 -- 172.21.15.18:0/2789599346 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7010004a20 con 0x7f70200cfae0 2024-09-19T09:14:41.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.425+0000 7f7027933640 1 -- 172.21.15.18:0/2789599346 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70200caf50 con 0x7f70200cfae0 2024-09-19T09:14:41.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.426+0000 7f7027933640 1 -- 172.21.15.18:0/2789599346 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70200cff00 con 0x7f70200cfae0 2024-09-19T09:14:41.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.426+0000 7f7015ffb640 1 -- 172.21.15.18:0/2789599346 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f701001b070 con 0x7f70200cfae0 2024-09-19T09:14:41.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.427+0000 7f7015ffb640 1 --2- 172.21.15.18:0/2789599346 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f700406c2b0 0x7f700406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:41.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.427+0000 7f7015ffb640 1 -- 172.21.15.18:0/2789599346 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4857+0+0 (secure 0 0 0) 0x7f701008a460 con 0x7f70200cfae0 2024-09-19T09:14:41.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.427+0000 7f70256cf640 1 --2- 172.21.15.18:0/2789599346 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f700406c2b0 0x7f700406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:41.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.428+0000 7f70256cf640 1 --2- 172.21.15.18:0/2789599346 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f700406c2b0 0x7f700406e770 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f701c006fd0 tx=0x7f701c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:41.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.431+0000 7f7015ffb640 1 -- 172.21.15.18:0/2789599346 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7010058f20 con 0x7f70200cfae0 2024-09-19T09:14:41.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.607+0000 7f7027933640 1 -- 172.21.15.18:0/2789599346 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f70200cd1a0 con 0x7f70200cfae0 2024-09-19T09:14:41.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.608+0000 7f7015ffb640 1 -- 172.21.15.18:0/2789599346 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v44) ==== 84+0+65 (secure 0 0 0) 0x7f7010058820 con 0x7f70200cfae0 2024-09-19T09:14:41.608 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:41.608 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-09-19T09:14:41.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:41.608 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 1, 2024-09-19T09:14:41.609 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": ".mgr" 2024-09-19T09:14:41.609 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:41.609 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-09-19T09:14:41.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.609+0000 7f7027933640 1 -- 172.21.15.18:0/2789599346 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f700406c2b0 msgr2=0x7f700406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:41.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.609+0000 7f7027933640 1 --2- 172.21.15.18:0/2789599346 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f700406c2b0 0x7f700406e770 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f701c006fd0 tx=0x7f701c008040 comp rx=0 tx=0).stop 2024-09-19T09:14:41.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.609+0000 7f7027933640 1 -- 172.21.15.18:0/2789599346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70200cfae0 msgr2=0x7f702015b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:41.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.609+0000 7f7027933640 1 --2- 172.21.15.18:0/2789599346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70200cfae0 0x7f702015b340 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f701000c4d0 tx=0x7f701000c990 comp rx=0 tx=0).stop 2024-09-19T09:14:41.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.610+0000 7f7027933640 1 -- 172.21.15.18:0/2789599346 shutdown_connections 2024-09-19T09:14:41.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.610+0000 7f7027933640 1 --2- 172.21.15.18:0/2789599346 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f700406c2b0 0x7f700406e770 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:41.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.610+0000 7f7027933640 1 --2- 172.21.15.18:0/2789599346 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f702015ef80 0x7f702015d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:41.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.610+0000 7f7027933640 1 --2- 172.21.15.18:0/2789599346 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70200cfae0 0x7f702015b340 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:41.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.610+0000 7f7027933640 1 --2- 172.21.15.18:0/2789599346 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f702006d730 0x7f70200b81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:41.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.610+0000 7f7027933640 1 -- 172.21.15.18:0/2789599346 >> 172.21.15.18:0/2789599346 conn(0x7f70200b4700 msgr2=0x7f70200d2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:41.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.610+0000 7f7027933640 1 -- 172.21.15.18:0/2789599346 shutdown_connections 2024-09-19T09:14:41.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.610+0000 7f7027933640 1 -- 172.21.15.18:0/2789599346 wait complete. 2024-09-19T09:14:41.621 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T09:14:41.621 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T09:14:41.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.728+0000 7f8bac800640 1 Processor -- start 2024-09-19T09:14:41.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.728+0000 7f8bac800640 1 -- start start 2024-09-19T09:14:41.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.729+0000 7f8bac800640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8ba80d3760 0x7f8ba80cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:41.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.729+0000 7f8bac800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ba80cfd30 0x7f8ba80b8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:41.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.729+0000 7f8bac800640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ba80d0520 con 0x7f8ba815eb60 2024-09-19T09:14:41.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.729+0000 7f8bac800640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f8ba80d0800 con 0x7f8ba80d3760 2024-09-19T09:14:41.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.729+0000 7f8bac800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8ba80b7a60 con 0x7f8ba80cfd30 2024-09-19T09:14:41.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.729+0000 7f8ba659c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8ba80d3760 0x7f8ba80cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:41.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.729+0000 7f8ba659c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8ba80d3760 0x7f8ba80cf7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56280/0 (socket says 172.21.15.18:56280) 2024-09-19T09:14:41.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.729+0000 7f8ba659c640 1 -- 172.21.15.18:0/304628554 learned_addr learned my addr 172.21.15.18:0/304628554 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:41.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.729+0000 7f8ba759e640 1 --2- 172.21.15.18:0/304628554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ba80cfd30 0x7f8ba80b8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:41.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.729+0000 7f8ba659c640 1 -- 172.21.15.18:0/304628554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ba80cfd30 msgr2=0x7f8ba80b8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:41.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.729+0000 7f8ba659c640 1 --2- 172.21.15.18:0/304628554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ba80cfd30 0x7f8ba80b8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:41.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.729+0000 7f8ba659c640 1 -- 172.21.15.18:0/304628554 >> v1:172.21.15.162:6789/0 conn(0x7f8ba815eb60 legacy=0x7f8ba80d3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:41.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.729+0000 7f8ba659c640 1 -- 172.21.15.18:0/304628554 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba80b7d40 con 0x7f8ba80d3760 2024-09-19T09:14:41.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.729+0000 7f8ba759e640 1 --2- 172.21.15.18:0/304628554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ba80cfd30 0x7f8ba80b8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:41.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.730+0000 7f8ba659c640 1 --2- 172.21.15.18:0/304628554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ba80d3760 0x7f8ba80cf7f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c009870 tx=0x7f8b9c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7287d7e99ec2a3b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:41.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.730+0000 7f8ba5d9b640 1 -- 172.21.15.18:0/304628554 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c037070 con 0x7f8ba80d3760 2024-09-19T09:14:41.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.730+0000 7f8ba5d9b640 1 -- 172.21.15.18:0/304628554 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b9c02ae50 con 0x7f8ba80d3760 2024-09-19T09:14:41.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.730+0000 7f8ba5d9b640 1 -- 172.21.15.18:0/304628554 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c032860 con 0x7f8ba80d3760 2024-09-19T09:14:41.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.730+0000 7f8bac800640 1 -- 172.21.15.18:0/304628554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ba80d3760 msgr2=0x7f8ba80cf7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:41.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.730+0000 7f8bac800640 1 --2- 172.21.15.18:0/304628554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ba80d3760 0x7f8ba80cf7f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c009870 tx=0x7f8b9c02a300 comp rx=0 tx=0).stop 2024-09-19T09:14:41.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.731+0000 7f8bac800640 1 -- 172.21.15.18:0/304628554 shutdown_connections 2024-09-19T09:14:41.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.731+0000 7f8bac800640 1 --2- 172.21.15.18:0/304628554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ba80cfd30 0x7f8ba80b8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:41.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.731+0000 7f8bac800640 1 --2- 172.21.15.18:0/304628554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ba80d3760 0x7f8ba80cf7f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:41.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.731+0000 7f8bac800640 1 -- 172.21.15.18:0/304628554 >> 172.21.15.18:0/304628554 conn(0x7f8ba80d4a70 msgr2=0x7f8ba80d4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:41.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.731+0000 7f8bac800640 1 -- 172.21.15.18:0/304628554 shutdown_connections 2024-09-19T09:14:41.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.731+0000 7f8bac800640 1 -- 172.21.15.18:0/304628554 wait complete. 2024-09-19T09:14:41.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.732+0000 7f8bac800640 1 Processor -- start 2024-09-19T09:14:41.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.732+0000 7f8bac800640 1 -- start start 2024-09-19T09:14:41.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.733+0000 7f8bac800640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ba80cfd30 0x7f8ba8147650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:41.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.733+0000 7f8bac800640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ba80d3760 0x7f8ba81f42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:41.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.733+0000 7f8bac800640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ba815eb60 0x7f8ba80c91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:41.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.733+0000 7f8bac800640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba815f0c0 con 0x7f8ba815eb60 2024-09-19T09:14:41.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.733+0000 7f8bac800640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba815ef40 con 0x7f8ba80d3760 2024-09-19T09:14:41.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.733+0000 7f8bac800640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8ba80b87a0 con 0x7f8ba80cfd30 2024-09-19T09:14:41.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.733+0000 7f8ba759e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ba815eb60 0x7f8ba80c91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:41.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.733+0000 7f8ba759e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ba815eb60 0x7f8ba80c91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56290/0 (socket says 172.21.15.18:56290) 2024-09-19T09:14:41.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.733+0000 7f8ba759e640 1 -- 172.21.15.18:0/2493969710 learned_addr learned my addr 172.21.15.18:0/2493969710 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:41.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.733+0000 7f8ba6d9d640 1 --2- 172.21.15.18:0/2493969710 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ba80cfd30 0x7f8ba8147650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:41.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.733+0000 7f8ba659c640 1 --2- 172.21.15.18:0/2493969710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ba80d3760 0x7f8ba81f42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:41.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.733+0000 7f8ba759e640 1 -- 172.21.15.18:0/2493969710 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ba80cfd30 msgr2=0x7f8ba8147650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:41.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.733+0000 7f8ba759e640 1 --2- 172.21.15.18:0/2493969710 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ba80cfd30 0x7f8ba8147650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:41.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.733+0000 7f8ba759e640 1 -- 172.21.15.18:0/2493969710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ba80d3760 msgr2=0x7f8ba81f42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:41.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.733+0000 7f8ba759e640 1 --2- 172.21.15.18:0/2493969710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ba80d3760 0x7f8ba81f42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:41.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.733+0000 7f8ba759e640 1 -- 172.21.15.18:0/2493969710 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba81f4800 con 0x7f8ba815eb60 2024-09-19T09:14:41.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.733+0000 7f8ba759e640 1 --2- 172.21.15.18:0/2493969710 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ba815eb60 0x7f8ba80c91e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0007ef0 tx=0x7f8ba000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:41.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.734+0000 7f8b8f7fe640 1 -- 172.21.15.18:0/2493969710 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba001a070 con 0x7f8ba815eb60 2024-09-19T09:14:41.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.734+0000 7f8b8f7fe640 1 -- 172.21.15.18:0/2493969710 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba0003b90 con 0x7f8ba815eb60 2024-09-19T09:14:41.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.734+0000 7f8bac800640 1 -- 172.21.15.18:0/2493969710 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ba80c9c80 con 0x7f8ba815eb60 2024-09-19T09:14:41.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.734+0000 7f8b8f7fe640 1 -- 172.21.15.18:0/2493969710 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0004030 con 0x7f8ba815eb60 2024-09-19T09:14:41.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.734+0000 7f8bac800640 1 -- 172.21.15.18:0/2493969710 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ba80ca240 con 0x7f8ba815eb60 2024-09-19T09:14:41.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.735+0000 7f8bac800640 1 -- 172.21.15.18:0/2493969710 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ba80ba470 con 0x7f8ba815eb60 2024-09-19T09:14:41.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.735+0000 7f8b8f7fe640 1 -- 172.21.15.18:0/2493969710 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8ba001d070 con 0x7f8ba815eb60 2024-09-19T09:14:41.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.736+0000 7f8b8f7fe640 1 --2- 172.21.15.18:0/2493969710 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8b9406c2b0 0x7f8b9406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:41.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.736+0000 7f8b8f7fe640 1 -- 172.21.15.18:0/2493969710 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4857+0+0 (secure 0 0 0) 0x7f8ba008b2a0 con 0x7f8ba815eb60 2024-09-19T09:14:41.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.736+0000 7f8ba6d9d640 1 --2- 172.21.15.18:0/2493969710 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8b9406c2b0 0x7f8b9406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:41.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.736+0000 7f8ba6d9d640 1 --2- 172.21.15.18:0/2493969710 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8b9406c2b0 0x7f8b9406e770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8b980016e0 tx=0x7f8b98009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:41.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.740+0000 7f8b8f7fe640 1 -- 172.21.15.18:0/2493969710 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8ba80ba470 con 0x7f8ba815eb60 2024-09-19T09:14:41.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.917+0000 7f8bac800640 1 -- 172.21.15.18:0/2493969710 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f8ba80b8260 con 0x7f8ba815eb60 2024-09-19T09:14:41.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:41.998+0000 7f8b8f7fe640 1 -- 172.21.15.18:0/2493969710 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v45) ==== 138+0+0 (secure 0 0 0) 0x7f8ba0010070 con 0x7f8ba815eb60 2024-09-19T09:14:41.999 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' created 2024-09-19T09:14:42.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.002+0000 7f8bac800640 1 -- 172.21.15.18:0/2493969710 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8b9406c2b0 msgr2=0x7f8b9406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:42.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.002+0000 7f8bac800640 1 --2- 172.21.15.18:0/2493969710 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8b9406c2b0 0x7f8b9406e770 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f8b980016e0 tx=0x7f8b98009040 comp rx=0 tx=0).stop 2024-09-19T09:14:42.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.002+0000 7f8bac800640 1 -- 172.21.15.18:0/2493969710 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ba815eb60 msgr2=0x7f8ba80c91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:42.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.002+0000 7f8bac800640 1 --2- 172.21.15.18:0/2493969710 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ba815eb60 0x7f8ba80c91e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0007ef0 tx=0x7f8ba000d4a0 comp rx=0 tx=0).stop 2024-09-19T09:14:42.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.002+0000 7f8bac800640 1 -- 172.21.15.18:0/2493969710 shutdown_connections 2024-09-19T09:14:42.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.002+0000 7f8bac800640 1 --2- 172.21.15.18:0/2493969710 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8b9406c2b0 0x7f8b9406e770 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:42.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.002+0000 7f8bac800640 1 --2- 172.21.15.18:0/2493969710 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8ba815eb60 0x7f8ba80c91e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:42.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.002+0000 7f8bac800640 1 --2- 172.21.15.18:0/2493969710 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ba80d3760 0x7f8ba81f42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:42.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.002+0000 7f8bac800640 1 --2- 172.21.15.18:0/2493969710 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8ba80cfd30 0x7f8ba8147650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:42.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.002+0000 7f8bac800640 1 -- 172.21.15.18:0/2493969710 >> 172.21.15.18:0/2493969710 conn(0x7f8ba80d4a70 msgr2=0x7f8ba80b9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:42.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.002+0000 7f8bac800640 1 -- 172.21.15.18:0/2493969710 shutdown_connections 2024-09-19T09:14:42.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.002+0000 7f8bac800640 1 -- 172.21.15.18:0/2493969710 wait complete. 2024-09-19T09:14:42.014 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T09:14:42.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.122+0000 7f441571a640 1 Processor -- start 2024-09-19T09:14:42.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.123+0000 7f441571a640 1 -- start start 2024-09-19T09:14:42.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.123+0000 7f441571a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f441015a670 0x7f441015dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:42.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.123+0000 7f441571a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44100b6b90 0x7f441015f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:42.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.123+0000 7f441571a640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f441015aa50 con 0x7f44100b5970 2024-09-19T09:14:42.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.123+0000 7f441571a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f44100b6150 con 0x7f441015a670 2024-09-19T09:14:42.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.123+0000 7f441571a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f441015e310 con 0x7f44100b6b90 2024-09-19T09:14:42.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.124+0000 7f440e7fc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f44100b5970 0x7f44100b6480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51404/0 (socket says 172.21.15.18:51404) 2024-09-19T09:14:42.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.124+0000 7f440e7fc640 1 -- 172.21.15.18:0/2594755052 learned_addr learned my addr 172.21.15.18:0/2594755052 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:42.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.124+0000 7f440f7fe640 1 --2- 172.21.15.18:0/2594755052 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44100b6b90 0x7f441015f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:42.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.124+0000 7f440effd640 1 --2- 172.21.15.18:0/2594755052 >> v2:172.21.15.162:3300/0 conn(0x7f441015a670 0x7f441015dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:42.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.124+0000 7f440dffb640 1 -- 172.21.15.18:0/2594755052 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1850292321 0 0) 0x7f441015aa50 con 0x7f44100b5970 2024-09-19T09:14:42.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.124+0000 7f440dffb640 1 -- 172.21.15.18:0/2594755052 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43f8003520 con 0x7f44100b5970 2024-09-19T09:14:42.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.124+0000 7f440effd640 1 -- 172.21.15.18:0/2594755052 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44100b6b90 msgr2=0x7f441015f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:42.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.124+0000 7f440effd640 1 --2- 172.21.15.18:0/2594755052 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44100b6b90 0x7f441015f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:42.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.124+0000 7f440effd640 1 -- 172.21.15.18:0/2594755052 >> v1:172.21.15.18:6789/0 conn(0x7f44100b5970 legacy=0x7f44100b6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:42.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.124+0000 7f440effd640 1 -- 172.21.15.18:0/2594755052 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f441015e5f0 con 0x7f441015a670 2024-09-19T09:14:42.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.124+0000 7f440f7fe640 1 --2- 172.21.15.18:0/2594755052 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44100b6b90 0x7f441015f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:14:42.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.125+0000 7f440effd640 1 --2- 172.21.15.18:0/2594755052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f441015a670 0x7f441015dc30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f44000097a0 tx=0x7f440002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70a2fedf778bc6e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:42.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.125+0000 7f440dffb640 1 -- 172.21.15.18:0/2594755052 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4400037070 con 0x7f441015a670 2024-09-19T09:14:42.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.125+0000 7f440dffb640 1 -- 172.21.15.18:0/2594755052 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f440002ae50 con 0x7f441015a670 2024-09-19T09:14:42.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.125+0000 7f440dffb640 1 -- 172.21.15.18:0/2594755052 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4400032640 con 0x7f441015a670 2024-09-19T09:14:42.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.126+0000 7f441571a640 1 -- 172.21.15.18:0/2594755052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f441015a670 msgr2=0x7f441015dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:42.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.126+0000 7f441571a640 1 --2- 172.21.15.18:0/2594755052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f441015a670 0x7f441015dc30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f44000097a0 tx=0x7f440002a100 comp rx=0 tx=0).stop 2024-09-19T09:14:42.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.126+0000 7f441571a640 1 -- 172.21.15.18:0/2594755052 shutdown_connections 2024-09-19T09:14:42.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.126+0000 7f441571a640 1 --2- 172.21.15.18:0/2594755052 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44100b6b90 0x7f441015f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:42.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.126+0000 7f441571a640 1 --2- 172.21.15.18:0/2594755052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f441015a670 0x7f441015dc30 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:42.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.126+0000 7f441571a640 1 -- 172.21.15.18:0/2594755052 >> 172.21.15.18:0/2594755052 conn(0x7f441009b9d0 msgr2=0x7f441009bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:42.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.126+0000 7f441571a640 1 -- 172.21.15.18:0/2594755052 shutdown_connections 2024-09-19T09:14:42.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.126+0000 7f441571a640 1 -- 172.21.15.18:0/2594755052 wait complete. 2024-09-19T09:14:42.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.127+0000 7f441571a640 1 Processor -- start 2024-09-19T09:14:42.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.127+0000 7f441571a640 1 -- start start 2024-09-19T09:14:42.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.128+0000 7f441571a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44100b5970 0x7f441009d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:42.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.128+0000 7f441571a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44100b6b90 0x7f4410154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:42.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.128+0000 7f441571a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f441015a670 0x7f4410149f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:42.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.128+0000 7f441571a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f441015f610 con 0x7f44100b6b90 2024-09-19T09:14:42.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.128+0000 7f441571a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f44100b5dd0 con 0x7f441015a670 2024-09-19T09:14:42.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.128+0000 7f441571a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f441015f790 con 0x7f44100b5970 2024-09-19T09:14:42.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.128+0000 7f440e7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44100b6b90 0x7f4410154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:42.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.128+0000 7f440e7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44100b6b90 0x7f4410154a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56300/0 (socket says 172.21.15.18:56300) 2024-09-19T09:14:42.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.128+0000 7f440e7fc640 1 -- 172.21.15.18:0/1084856524 learned_addr learned my addr 172.21.15.18:0/1084856524 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:42.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.128+0000 7f440effd640 1 --2- 172.21.15.18:0/1084856524 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44100b5970 0x7f441009d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:42.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.128+0000 7f440f7fe640 1 --2- 172.21.15.18:0/1084856524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f441015a670 0x7f4410149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:42.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.128+0000 7f440e7fc640 1 -- 172.21.15.18:0/1084856524 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44100b5970 msgr2=0x7f441009d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:42.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.128+0000 7f440e7fc640 1 --2- 172.21.15.18:0/1084856524 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44100b5970 0x7f441009d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:42.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.128+0000 7f440e7fc640 1 -- 172.21.15.18:0/1084856524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f441015a670 msgr2=0x7f4410149f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:42.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.128+0000 7f440e7fc640 1 --2- 172.21.15.18:0/1084856524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f441015a670 0x7f4410149f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:42.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.128+0000 7f440e7fc640 1 -- 172.21.15.18:0/1084856524 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4410155480 con 0x7f44100b6b90 2024-09-19T09:14:42.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.128+0000 7f440f7fe640 1 --2- 172.21.15.18:0/1084856524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f441015a670 0x7f4410149f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:14:42.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.128+0000 7f440e7fc640 1 --2- 172.21.15.18:0/1084856524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44100b6b90 0x7f4410154a30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f440400c430 tx=0x7f440400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:42.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.129+0000 7f43f77fe640 1 -- 172.21.15.18:0/1084856524 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4404017070 con 0x7f44100b6b90 2024-09-19T09:14:42.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.129+0000 7f43f77fe640 1 -- 172.21.15.18:0/1084856524 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4404005ce0 con 0x7f44100b6b90 2024-09-19T09:14:42.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.129+0000 7f441571a640 1 -- 172.21.15.18:0/1084856524 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4410155760 con 0x7f44100b6b90 2024-09-19T09:14:42.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.129+0000 7f43f77fe640 1 -- 172.21.15.18:0/1084856524 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44040072f0 con 0x7f44100b6b90 2024-09-19T09:14:42.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.129+0000 7f441571a640 1 -- 172.21.15.18:0/1084856524 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f441006d310 con 0x7f44100b6b90 2024-09-19T09:14:42.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.130+0000 7f441571a640 1 -- 172.21.15.18:0/1084856524 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f441006d510 con 0x7f44100b6b90 2024-09-19T09:14:42.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.131+0000 7f43f77fe640 1 -- 172.21.15.18:0/1084856524 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f440401a070 con 0x7f44100b6b90 2024-09-19T09:14:42.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.131+0000 7f43f77fe640 1 --2- 172.21.15.18:0/1084856524 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f43fc06c2e0 0x7f43fc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:42.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.131+0000 7f43f77fe640 1 -- 172.21.15.18:0/1084856524 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5227+0+0 (secure 0 0 0) 0x7f440408a6e0 con 0x7f44100b6b90 2024-09-19T09:14:42.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.131+0000 7f440effd640 1 --2- 172.21.15.18:0/1084856524 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f43fc06c2e0 0x7f43fc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:42.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.132+0000 7f440effd640 1 --2- 172.21.15.18:0/1084856524 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f43fc06c2e0 0x7f43fc06e7a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4400034000 tx=0x7f440002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:42.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.136+0000 7f43f77fe640 1 -- 172.21.15.18:0/1084856524 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f441006d510 con 0x7f44100b6b90 2024-09-19T09:14:42.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:42.311+0000 7f441571a640 1 -- 172.21.15.18:0/1084856524 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f441015f0d0 con 0x7f44100b6b90 2024-09-19T09:14:43.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.004+0000 7f43f77fe640 1 -- 172.21.15.18:0/1084856524 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v46) ==== 170+0+0 (secure 0 0 0) 0x7f4404059030 con 0x7f44100b6b90 2024-09-19T09:14:43.005 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' created 2024-09-19T09:14:43.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.008+0000 7f441571a640 1 -- 172.21.15.18:0/1084856524 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f43fc06c2e0 msgr2=0x7f43fc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:43.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.008+0000 7f441571a640 1 --2- 172.21.15.18:0/1084856524 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f43fc06c2e0 0x7f43fc06e7a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4400034000 tx=0x7f440002e000 comp rx=0 tx=0).stop 2024-09-19T09:14:43.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.008+0000 7f441571a640 1 -- 172.21.15.18:0/1084856524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44100b6b90 msgr2=0x7f4410154a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:43.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.008+0000 7f441571a640 1 --2- 172.21.15.18:0/1084856524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44100b6b90 0x7f4410154a30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f440400c430 tx=0x7f440400c8f0 comp rx=0 tx=0).stop 2024-09-19T09:14:43.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.009+0000 7f441571a640 1 -- 172.21.15.18:0/1084856524 shutdown_connections 2024-09-19T09:14:43.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.009+0000 7f441571a640 1 --2- 172.21.15.18:0/1084856524 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f43fc06c2e0 0x7f43fc06e7a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:43.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.009+0000 7f441571a640 1 --2- 172.21.15.18:0/1084856524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f441015a670 0x7f4410149f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:43.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.009+0000 7f441571a640 1 --2- 172.21.15.18:0/1084856524 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44100b6b90 0x7f4410154a30 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:43.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.009+0000 7f441571a640 1 --2- 172.21.15.18:0/1084856524 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44100b5970 0x7f441009d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:43.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.009+0000 7f441571a640 1 -- 172.21.15.18:0/1084856524 >> 172.21.15.18:0/1084856524 conn(0x7f441009b9d0 msgr2=0x7f44100b6440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:43.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.013+0000 7f441571a640 1 -- 172.21.15.18:0/1084856524 shutdown_connections 2024-09-19T09:14:43.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.015+0000 7f441571a640 1 -- 172.21.15.18:0/1084856524 wait complete. 2024-09-19T09:14:43.033 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T09:14:43.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.142+0000 7f431959f640 1 Processor -- start 2024-09-19T09:14:43.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.142+0000 7f431959f640 1 -- start start 2024-09-19T09:14:43.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.143+0000 7f431959f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f431415e970 0x7f43140d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:43.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.143+0000 7f431959f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f43140d2680 0x7f43140cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:43.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.143+0000 7f431959f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43140cfac0 0x7f43140d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:43.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.143+0000 7f431959f640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f43140d37e0 con 0x7f43140d2680 2024-09-19T09:14:43.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.143+0000 7f431959f640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f43140d2bd0 con 0x7f431415e970 2024-09-19T09:14:43.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.143+0000 7f431959f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f43140d2eb0 con 0x7f43140cfac0 2024-09-19T09:14:43.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.143+0000 7f43137fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f43140d2680 0x7f43140cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:43.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.143+0000 7f43137fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f43140d2680 0x7f43140cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56312/0 (socket says 172.21.15.18:56312) 2024-09-19T09:14:43.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.143+0000 7f43137fe640 1 -- 172.21.15.18:0/759051724 learned_addr learned my addr 172.21.15.18:0/759051724 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:43.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.144+0000 7f4313fff640 1 --2- 172.21.15.18:0/759051724 >> v2:172.21.15.162:3300/0 conn(0x7f431415e970 0x7f43140d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:43.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.144+0000 7f4318d9e640 1 --2- 172.21.15.18:0/759051724 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43140cfac0 0x7f43140d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:43.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.144+0000 7f43137fe640 1 -- 172.21.15.18:0/759051724 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43140cfac0 msgr2=0x7f43140d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:43.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.144+0000 7f43137fe640 1 --2- 172.21.15.18:0/759051724 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43140cfac0 0x7f43140d0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:43.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.144+0000 7f43137fe640 1 -- 172.21.15.18:0/759051724 >> v2:172.21.15.162:3300/0 conn(0x7f431415e970 msgr2=0x7f43140d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:43.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.144+0000 7f43137fe640 1 --2- 172.21.15.18:0/759051724 >> v2:172.21.15.162:3300/0 conn(0x7f431415e970 0x7f43140d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:43.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.144+0000 7f43137fe640 1 -- 172.21.15.18:0/759051724 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43140d3190 con 0x7f43140d2680 2024-09-19T09:14:43.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.144+0000 7f4313fff640 1 --2- 172.21.15.18:0/759051724 >> v2:172.21.15.162:3300/0 conn(0x7f431415e970 0x7f43140d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:14:43.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.144+0000 7f43137fe640 1 --2- 172.21.15.18:0/759051724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43140d2680 0x7f43140cf580 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f431406c1c0 tx=0x7f430802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f209cafefccd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:43.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.145+0000 7f4312ffd640 1 -- 172.21.15.18:0/759051724 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4308037070 con 0x7f43140d2680 2024-09-19T09:14:43.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.145+0000 7f4312ffd640 1 -- 172.21.15.18:0/759051724 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4308032440 con 0x7f43140d2680 2024-09-19T09:14:43.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.145+0000 7f4312ffd640 1 -- 172.21.15.18:0/759051724 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4308032810 con 0x7f43140d2680 2024-09-19T09:14:43.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.145+0000 7f431959f640 1 -- 172.21.15.18:0/759051724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43140d2680 msgr2=0x7f43140cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:43.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.145+0000 7f431959f640 1 --2- 172.21.15.18:0/759051724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43140d2680 0x7f43140cf580 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f431406c1c0 tx=0x7f430802a270 comp rx=0 tx=0).stop 2024-09-19T09:14:43.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.145+0000 7f431959f640 1 -- 172.21.15.18:0/759051724 shutdown_connections 2024-09-19T09:14:43.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.145+0000 7f431959f640 1 --2- 172.21.15.18:0/759051724 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43140cfac0 0x7f43140d0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:43.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.145+0000 7f431959f640 1 --2- 172.21.15.18:0/759051724 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43140d2680 0x7f43140cf580 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:43.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.145+0000 7f431959f640 1 --2- 172.21.15.18:0/759051724 >> v2:172.21.15.162:3300/0 conn(0x7f431415e970 0x7f43140d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:43.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.145+0000 7f431959f640 1 -- 172.21.15.18:0/759051724 >> 172.21.15.18:0/759051724 conn(0x7f431409de00 msgr2=0x7f43140d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:43.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.145+0000 7f431959f640 1 -- 172.21.15.18:0/759051724 shutdown_connections 2024-09-19T09:14:43.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.145+0000 7f431959f640 1 -- 172.21.15.18:0/759051724 wait complete. 2024-09-19T09:14:43.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.146+0000 7f431959f640 1 Processor -- start 2024-09-19T09:14:43.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.147+0000 7f431959f640 1 -- start start 2024-09-19T09:14:43.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.147+0000 7f431959f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43140cfac0 0x7f43140ce700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:43.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.147+0000 7f431959f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43140d2680 0x7f431414bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:43.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.147+0000 7f431959f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f431415e970 0x7f43141602d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:43.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.147+0000 7f431959f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f43140d0840 con 0x7f43140cfac0 2024-09-19T09:14:43.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.147+0000 7f431959f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f43140cff50 con 0x7f43140d2680 2024-09-19T09:14:43.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.147+0000 7f431959f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f431415ed50 con 0x7f431415e970 2024-09-19T09:14:43.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.147+0000 7f4313fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43140cfac0 0x7f43140ce700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:43.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.148+0000 7f4313fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43140cfac0 0x7f43140ce700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56328/0 (socket says 172.21.15.18:56328) 2024-09-19T09:14:43.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.148+0000 7f4313fff640 1 -- 172.21.15.18:0/2451643793 learned_addr learned my addr 172.21.15.18:0/2451643793 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:43.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.148+0000 7f4318d9e640 1 --2- 172.21.15.18:0/2451643793 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f431415e970 0x7f43141602d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:43.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.148+0000 7f43137fe640 1 --2- 172.21.15.18:0/2451643793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43140d2680 0x7f431414bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:43.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.148+0000 7f4313fff640 1 -- 172.21.15.18:0/2451643793 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f431415e970 msgr2=0x7f43141602d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:43.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.148+0000 7f4313fff640 1 --2- 172.21.15.18:0/2451643793 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f431415e970 0x7f43141602d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:43.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.148+0000 7f4313fff640 1 -- 172.21.15.18:0/2451643793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43140d2680 msgr2=0x7f431414bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:43.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.148+0000 7f4313fff640 1 --2- 172.21.15.18:0/2451643793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43140d2680 0x7f431414bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:43.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.148+0000 7f4313fff640 1 -- 172.21.15.18:0/2451643793 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43140cd6a0 con 0x7f43140cfac0 2024-09-19T09:14:43.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.148+0000 7f4313fff640 1 --2- 172.21.15.18:0/2451643793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43140cfac0 0x7f43140ce700 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f430400c7f0 tx=0x7f430400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:43.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.148+0000 7f4310ff9640 1 -- 172.21.15.18:0/2451643793 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4304015070 con 0x7f43140cfac0 2024-09-19T09:14:43.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.148+0000 7f4310ff9640 1 -- 172.21.15.18:0/2451643793 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4304007a30 con 0x7f43140cfac0 2024-09-19T09:14:43.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.148+0000 7f431959f640 1 -- 172.21.15.18:0/2451643793 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43140cd940 con 0x7f43140cfac0 2024-09-19T09:14:43.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.148+0000 7f4310ff9640 1 -- 172.21.15.18:0/2451643793 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4304007e00 con 0x7f43140cfac0 2024-09-19T09:14:43.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.148+0000 7f431959f640 1 -- 172.21.15.18:0/2451643793 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43140cdf00 con 0x7f43140cfac0 2024-09-19T09:14:43.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.149+0000 7f431959f640 1 -- 172.21.15.18:0/2451643793 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43140d1af0 con 0x7f43140cfac0 2024-09-19T09:14:43.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.150+0000 7f4310ff9640 1 -- 172.21.15.18:0/2451643793 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4304018070 con 0x7f43140cfac0 2024-09-19T09:14:43.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.151+0000 7f4310ff9640 1 --2- 172.21.15.18:0/2451643793 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f430006c2b0 0x7f430006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:43.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.151+0000 7f4310ff9640 1 -- 172.21.15.18:0/2451643793 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5609+0+0 (secure 0 0 0) 0x7f430408b2e0 con 0x7f43140cfac0 2024-09-19T09:14:43.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.151+0000 7f43137fe640 1 --2- 172.21.15.18:0/2451643793 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f430006c2b0 0x7f430006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:43.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.151+0000 7f43137fe640 1 --2- 172.21.15.18:0/2451643793 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f430006c2b0 0x7f430006e770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4308034000 tx=0x7f430802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:43.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.155+0000 7f4310ff9640 1 -- 172.21.15.18:0/2451643793 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f43140d1af0 con 0x7f43140cfac0 2024-09-19T09:14:43.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:43.365+0000 7f431959f640 1 -- 172.21.15.18:0/2451643793 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f43140cf580 con 0x7f43140cfac0 2024-09-19T09:14:43.968 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-19T09:14:44.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.016+0000 7f4310ff9640 1 -- 172.21.15.18:0/2451643793 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v19) ==== 172+0+0 (secure 0 0 0) 0x7f430408b0c0 con 0x7f43140cfac0 2024-09-19T09:14:44.017 INFO:teuthology.orchestra.run.smithi018.stderr:new fs with metadata pool 6 and data pool 7 2024-09-19T09:14:44.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.027+0000 7f431959f640 1 -- 172.21.15.18:0/2451643793 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f430006c2b0 msgr2=0x7f430006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:44.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.027+0000 7f431959f640 1 --2- 172.21.15.18:0/2451643793 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f430006c2b0 0x7f430006e770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4308034000 tx=0x7f430802e000 comp rx=0 tx=0).stop 2024-09-19T09:14:44.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.027+0000 7f431959f640 1 -- 172.21.15.18:0/2451643793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43140cfac0 msgr2=0x7f43140ce700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:44.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.027+0000 7f431959f640 1 --2- 172.21.15.18:0/2451643793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43140cfac0 0x7f43140ce700 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f430400c7f0 tx=0x7f430400cbf0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.027+0000 7f431959f640 1 -- 172.21.15.18:0/2451643793 shutdown_connections 2024-09-19T09:14:44.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.027+0000 7f431959f640 1 --2- 172.21.15.18:0/2451643793 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f430006c2b0 0x7f430006e770 secure :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4308034000 tx=0x7f430802e000 comp rx=0 tx=0).stop 2024-09-19T09:14:44.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.027+0000 7f431959f640 1 --2- 172.21.15.18:0/2451643793 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f431415e970 0x7f43141602d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.027+0000 7f431959f640 1 --2- 172.21.15.18:0/2451643793 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43140d2680 0x7f431414bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.027+0000 7f431959f640 1 --2- 172.21.15.18:0/2451643793 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43140cfac0 0x7f43140ce700 secure :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f430400c7f0 tx=0x7f430400cbf0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.027+0000 7f431959f640 1 -- 172.21.15.18:0/2451643793 >> 172.21.15.18:0/2451643793 conn(0x7f431409de00 msgr2=0x7f43140c9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:44.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.028+0000 7f431959f640 1 -- 172.21.15.18:0/2451643793 shutdown_connections 2024-09-19T09:14:44.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.028+0000 7f431959f640 1 -- 172.21.15.18:0/2451643793 wait complete. 2024-09-19T09:14:44.045 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:14:44.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.149+0000 7fa9d70f1640 1 Processor -- start 2024-09-19T09:14:44.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.149+0000 7fa9d70f1640 1 -- start start 2024-09-19T09:14:44.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.150+0000 7fa9d70f1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa9d015ed50 0x7fa9d00d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:44.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.150+0000 7fa9d70f1640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa9d00d1aa0 0x7fa9d00b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:44.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.150+0000 7fa9d70f1640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9d00d31b0 con 0x7fa9d00b5030 2024-09-19T09:14:44.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.150+0000 7fa9d70f1640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fa9d00d1ee0 con 0x7fa9d015ed50 2024-09-19T09:14:44.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.150+0000 7fa9d70f1640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa9d00d3490 con 0x7fa9d00d1aa0 2024-09-19T09:14:44.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.150+0000 7fa9d4e8d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa9d015ed50 0x7fa9d00d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:44.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.150+0000 7fa9d4e8d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa9d015ed50 0x7fa9d00d1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56334/0 (socket says 172.21.15.18:56334) 2024-09-19T09:14:44.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.150+0000 7fa9d4e8d640 1 -- 172.21.15.18:0/2227520365 learned_addr learned my addr 172.21.15.18:0/2227520365 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:44.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.150+0000 7fa9cffff640 1 --2- 172.21.15.18:0/2227520365 >> v2:172.21.15.162:3300/0 conn(0x7fa9d00d1aa0 0x7fa9d00b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:44.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.150+0000 7fa9d4e8d640 1 -- 172.21.15.18:0/2227520365 >> v2:172.21.15.162:3300/0 conn(0x7fa9d00d1aa0 msgr2=0x7fa9d00b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:44.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.150+0000 7fa9d4e8d640 1 --2- 172.21.15.18:0/2227520365 >> v2:172.21.15.162:3300/0 conn(0x7fa9d00d1aa0 0x7fa9d00b4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.150+0000 7fa9d4e8d640 1 -- 172.21.15.18:0/2227520365 >> v1:172.21.15.162:6789/0 conn(0x7fa9d00b5030 legacy=0x7fa9d00b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:44.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.150+0000 7fa9d4e8d640 1 -- 172.21.15.18:0/2227520365 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9d00d3770 con 0x7fa9d015ed50 2024-09-19T09:14:44.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.150+0000 7fa9cffff640 1 --2- 172.21.15.18:0/2227520365 >> v2:172.21.15.162:3300/0 conn(0x7fa9d00d1aa0 0x7fa9d00b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:14:44.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.151+0000 7fa9d4e8d640 1 --2- 172.21.15.18:0/2227520365 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d015ed50 0x7fa9d00d1560 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa9d01628a0 tx=0x7fa9c002a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec4821f0363b63e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:44.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.151+0000 7fa9cf7fe640 1 -- 172.21.15.18:0/2227520365 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0037070 con 0x7fa9d015ed50 2024-09-19T09:14:44.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.151+0000 7fa9cf7fe640 1 -- 172.21.15.18:0/2227520365 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9c0032440 con 0x7fa9d015ed50 2024-09-19T09:14:44.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.151+0000 7fa9cf7fe640 1 -- 172.21.15.18:0/2227520365 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0032810 con 0x7fa9d015ed50 2024-09-19T09:14:44.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.152+0000 7fa9d70f1640 1 -- 172.21.15.18:0/2227520365 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d015ed50 msgr2=0x7fa9d00d1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:44.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.152+0000 7fa9d70f1640 1 --2- 172.21.15.18:0/2227520365 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d015ed50 0x7fa9d00d1560 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa9d01628a0 tx=0x7fa9c002a2c0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.152+0000 7fa9d70f1640 1 -- 172.21.15.18:0/2227520365 shutdown_connections 2024-09-19T09:14:44.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.152+0000 7fa9d70f1640 1 --2- 172.21.15.18:0/2227520365 >> v2:172.21.15.162:3300/0 conn(0x7fa9d00d1aa0 0x7fa9d00b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.152+0000 7fa9d70f1640 1 --2- 172.21.15.18:0/2227520365 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d015ed50 0x7fa9d00d1560 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.152+0000 7fa9d70f1640 1 -- 172.21.15.18:0/2227520365 >> 172.21.15.18:0/2227520365 conn(0x7fa9d00d4bd0 msgr2=0x7fa9d00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:44.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.152+0000 7fa9d70f1640 1 -- 172.21.15.18:0/2227520365 shutdown_connections 2024-09-19T09:14:44.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.152+0000 7fa9d70f1640 1 -- 172.21.15.18:0/2227520365 wait complete. 2024-09-19T09:14:44.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.153+0000 7fa9d70f1640 1 Processor -- start 2024-09-19T09:14:44.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.153+0000 7fa9d70f1640 1 -- start start 2024-09-19T09:14:44.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.154+0000 7fa9d70f1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9d00b5030 0x7fa9d00b7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:44.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.154+0000 7fa9d70f1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9d00d1aa0 0x7fa9d00b97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:44.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.154+0000 7fa9d70f1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d015ed50 0x7fa9d00b9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:44.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.154+0000 7fa9d70f1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d00d3d30 con 0x7fa9d015ed50 2024-09-19T09:14:44.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.154+0000 7fa9d70f1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa9d00b45d0 con 0x7fa9d00d1aa0 2024-09-19T09:14:44.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.154+0000 7fa9d70f1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa9d015f130 con 0x7fa9d00b5030 2024-09-19T09:14:44.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.154+0000 7fa9d568e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d015ed50 0x7fa9d00b9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:44.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.154+0000 7fa9d568e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d015ed50 0x7fa9d00b9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56346/0 (socket says 172.21.15.18:56346) 2024-09-19T09:14:44.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.154+0000 7fa9d568e640 1 -- 172.21.15.18:0/3394339230 learned_addr learned my addr 172.21.15.18:0/3394339230 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:44.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.154+0000 7fa9d4e8d640 1 --2- 172.21.15.18:0/3394339230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9d00b5030 0x7fa9d00b7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:44.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.154+0000 7fa9cffff640 1 --2- 172.21.15.18:0/3394339230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9d00d1aa0 0x7fa9d00b97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:44.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.155+0000 7fa9d568e640 1 -- 172.21.15.18:0/3394339230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9d00b5030 msgr2=0x7fa9d00b7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:44.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.155+0000 7fa9d568e640 1 --2- 172.21.15.18:0/3394339230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9d00b5030 0x7fa9d00b7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.155+0000 7fa9d568e640 1 -- 172.21.15.18:0/3394339230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9d00d1aa0 msgr2=0x7fa9d00b97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:44.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.155+0000 7fa9d568e640 1 --2- 172.21.15.18:0/3394339230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9d00d1aa0 0x7fa9d00b97b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.155+0000 7fa9d568e640 1 -- 172.21.15.18:0/3394339230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9d0154d10 con 0x7fa9d015ed50 2024-09-19T09:14:44.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.155+0000 7fa9d568e640 1 --2- 172.21.15.18:0/3394339230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d015ed50 0x7fa9d00b9cf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800b970 tx=0x7fa9c800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:44.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.155+0000 7fa9cd7fa640 1 -- 172.21.15.18:0/3394339230 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8019070 con 0x7fa9d015ed50 2024-09-19T09:14:44.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.155+0000 7fa9cd7fa640 1 -- 172.21.15.18:0/3394339230 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9c800cb40 con 0x7fa9d015ed50 2024-09-19T09:14:44.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.155+0000 7fa9d70f1640 1 -- 172.21.15.18:0/3394339230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9d00cdc00 con 0x7fa9d015ed50 2024-09-19T09:14:44.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.155+0000 7fa9cd7fa640 1 -- 172.21.15.18:0/3394339230 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8014440 con 0x7fa9d015ed50 2024-09-19T09:14:44.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.155+0000 7fa9d70f1640 1 -- 172.21.15.18:0/3394339230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9d00ce1c0 con 0x7fa9d015ed50 2024-09-19T09:14:44.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.156+0000 7fa9d70f1640 1 -- 172.21.15.18:0/3394339230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9d00d21e0 con 0x7fa9d015ed50 2024-09-19T09:14:44.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.157+0000 7fa9cd7fa640 1 -- 172.21.15.18:0/3394339230 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa9c801c070 con 0x7fa9d015ed50 2024-09-19T09:14:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.157+0000 7fa9cd7fa640 1 --2- 172.21.15.18:0/3394339230 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa9bc06c2b0 0x7fa9bc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.157+0000 7fa9cd7fa640 1 -- 172.21.15.18:0/3394339230 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7fa9c808afa0 con 0x7fa9d015ed50 2024-09-19T09:14:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.157+0000 7fa9d4e8d640 1 --2- 172.21.15.18:0/3394339230 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa9bc06c2b0 0x7fa9bc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.158+0000 7fa9d4e8d640 1 --2- 172.21.15.18:0/3394339230 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa9bc06c2b0 0x7fa9bc06e770 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0034000 tx=0x7fa9c002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:44.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.161+0000 7fa9cd7fa640 1 -- 172.21.15.18:0/3394339230 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa9c80590c0 con 0x7fa9d015ed50 2024-09-19T09:14:44.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.336+0000 7fa9d70f1640 1 -- 172.21.15.18:0/3394339230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa9d00ce560 con 0x7fa9d015ed50 2024-09-19T09:14:44.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.337+0000 7fa9cd7fa640 1 -- 172.21.15.18:0/3394339230 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+16694 (secure 0 0 0) 0x7fa9c805d3c0 con 0x7fa9d015ed50 2024-09-19T09:14:44.338 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:44.338 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":47,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:14:43.366966+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:14:41.948276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-19T09:14:42.341949+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:14:44.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.340+0000 7fa9d70f1640 1 -- 172.21.15.18:0/3394339230 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa9bc06c2b0 msgr2=0x7fa9bc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:44.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.340+0000 7fa9d70f1640 1 --2- 172.21.15.18:0/3394339230 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa9bc06c2b0 0x7fa9bc06e770 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa9c0034000 tx=0x7fa9c002e000 comp rx=0 tx=0).stop 2024-09-19T09:14:44.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.340+0000 7fa9d70f1640 1 -- 172.21.15.18:0/3394339230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d015ed50 msgr2=0x7fa9d00b9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:44.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.340+0000 7fa9d70f1640 1 --2- 172.21.15.18:0/3394339230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d015ed50 0x7fa9d00b9cf0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800b970 tx=0x7fa9c800be30 comp rx=0 tx=0).stop 2024-09-19T09:14:44.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.340+0000 7fa9d70f1640 1 -- 172.21.15.18:0/3394339230 shutdown_connections 2024-09-19T09:14:44.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.340+0000 7fa9d70f1640 1 --2- 172.21.15.18:0/3394339230 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa9bc06c2b0 0x7fa9bc06e770 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.340+0000 7fa9d70f1640 1 --2- 172.21.15.18:0/3394339230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9d015ed50 0x7fa9d00b9cf0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.340+0000 7fa9d70f1640 1 --2- 172.21.15.18:0/3394339230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9d00d1aa0 0x7fa9d00b97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.340+0000 7fa9d70f1640 1 --2- 172.21.15.18:0/3394339230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9d00b5030 0x7fa9d00b7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.340+0000 7fa9d70f1640 1 -- 172.21.15.18:0/3394339230 >> 172.21.15.18:0/3394339230 conn(0x7fa9d00d4bd0 msgr2=0x7fa9d00b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:44.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.340+0000 7fa9d70f1640 1 -- 172.21.15.18:0/3394339230 shutdown_connections 2024-09-19T09:14:44.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.340+0000 7fa9d70f1640 1 -- 172.21.15.18:0/3394339230 wait complete. 2024-09-19T09:14:44.352 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:14:44.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.453+0000 7f1895874640 1 Processor -- start 2024-09-19T09:14:44.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.454+0000 7f1895874640 1 -- start start 2024-09-19T09:14:44.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.454+0000 7f1895874640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1890072f40 0x7f189006f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:44.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.454+0000 7f1895874640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f189006e3d0 con 0x7f1890145290 2024-09-19T09:14:44.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.454+0000 7f1895874640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f189006e6b0 con 0x7f18900ce780 2024-09-19T09:14:44.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.454+0000 7f1895874640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f189006efe0 con 0x7f1890072f40 2024-09-19T09:14:44.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.454+0000 7f188effd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f1890145290 0x7f1890072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51414/0 (socket says 172.21.15.18:51414) 2024-09-19T09:14:44.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.455+0000 7f188effd640 1 -- 172.21.15.18:0/1827049397 learned_addr learned my addr 172.21.15.18:0/1827049397 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:44.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.455+0000 7f188e7fc640 1 --2- 172.21.15.18:0/1827049397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1890072f40 0x7f189006f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:44.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.455+0000 7f188dffb640 1 -- 172.21.15.18:0/1827049397 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1673398662 0 0) 0x7f189006e3d0 con 0x7f1890145290 2024-09-19T09:14:44.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.455+0000 7f188dffb640 1 -- 172.21.15.18:0/1827049397 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f187c003520 con 0x7f1890145290 2024-09-19T09:14:44.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.455+0000 7f188dffb640 1 -- 172.21.15.18:0/1827049397 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1508907673 0 0) 0x7f189006e6b0 con 0x7f18900ce780 2024-09-19T09:14:44.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.455+0000 7f188dffb640 1 -- 172.21.15.18:0/1827049397 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f189006e3d0 con 0x7f18900ce780 2024-09-19T09:14:44.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.455+0000 7f188dffb640 1 -- 172.21.15.18:0/1827049397 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 838780709 0 0) 0x7f187c003520 con 0x7f1890145290 2024-09-19T09:14:44.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.455+0000 7f188e7fc640 1 -- 172.21.15.18:0/1827049397 >> v1:172.21.15.162:6789/0 conn(0x7f18900ce780 legacy=0x7f18900b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:44.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.455+0000 7f188e7fc640 1 -- 172.21.15.18:0/1827049397 >> v1:172.21.15.18:6789/0 conn(0x7f1890145290 legacy=0x7f1890072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:44.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.455+0000 7f188e7fc640 1 -- 172.21.15.18:0/1827049397 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f189006e990 con 0x7f1890072f40 2024-09-19T09:14:44.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.456+0000 7f188e7fc640 1 --2- 172.21.15.18:0/1827049397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1890072f40 0x7f189006f470 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f18780097d0 tx=0x7f187802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e32d2d0ac91f1fb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:44.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.456+0000 7f188dffb640 1 -- 172.21.15.18:0/1827049397 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1878037070 con 0x7f1890072f40 2024-09-19T09:14:44.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.456+0000 7f188dffb640 1 -- 172.21.15.18:0/1827049397 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f187802ac30 con 0x7f1890072f40 2024-09-19T09:14:44.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.456+0000 7f188dffb640 1 -- 172.21.15.18:0/1827049397 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1888001670 con 0x7f1890072f40 2024-09-19T09:14:44.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.457+0000 7f1895874640 1 -- 172.21.15.18:0/1827049397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1890072f40 msgr2=0x7f189006f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:44.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.457+0000 7f1895874640 1 --2- 172.21.15.18:0/1827049397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1890072f40 0x7f189006f470 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f18780097d0 tx=0x7f187802a1a0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.457+0000 7f1895874640 1 -- 172.21.15.18:0/1827049397 shutdown_connections 2024-09-19T09:14:44.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.457+0000 7f1895874640 1 --2- 172.21.15.18:0/1827049397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1890072f40 0x7f189006f470 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.457+0000 7f1895874640 1 -- 172.21.15.18:0/1827049397 >> 172.21.15.18:0/1827049397 conn(0x7f189006bc10 msgr2=0x7f189006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:44.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.457+0000 7f1895874640 1 -- 172.21.15.18:0/1827049397 shutdown_connections 2024-09-19T09:14:44.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.457+0000 7f1895874640 1 -- 172.21.15.18:0/1827049397 wait complete. 2024-09-19T09:14:44.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.458+0000 7f1895874640 1 Processor -- start 2024-09-19T09:14:44.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.458+0000 7f1895874640 1 -- start start 2024-09-19T09:14:44.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.459+0000 7f1895874640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1890072f40 0x7f189013b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:44.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.459+0000 7f1895874640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18900ce780 0x7f189013cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:44.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.459+0000 7f1895874640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1890145290 0x7f18900b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:44.462 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.459+0000 7f1895874640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f189006df80 con 0x7f1890072f40 2024-09-19T09:14:44.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.459+0000 7f1895874640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1890145670 con 0x7f18900ce780 2024-09-19T09:14:44.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.459+0000 7f1895874640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f189006e100 con 0x7f1890145290 2024-09-19T09:14:44.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.459+0000 7f188effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1890072f40 0x7f189013b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:44.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.459+0000 7f188effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1890072f40 0x7f189013b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56358/0 (socket says 172.21.15.18:56358) 2024-09-19T09:14:44.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.459+0000 7f188effd640 1 -- 172.21.15.18:0/2141446902 learned_addr learned my addr 172.21.15.18:0/2141446902 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:44.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.459+0000 7f188e7fc640 1 --2- 172.21.15.18:0/2141446902 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18900ce780 0x7f189013cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:44.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.459+0000 7f188f7fe640 1 --2- 172.21.15.18:0/2141446902 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1890145290 0x7f18900b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:44.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.459+0000 7f188effd640 1 -- 172.21.15.18:0/2141446902 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1890145290 msgr2=0x7f18900b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:44.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.459+0000 7f188effd640 1 --2- 172.21.15.18:0/2141446902 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1890145290 0x7f18900b3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.459+0000 7f188effd640 1 -- 172.21.15.18:0/2141446902 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18900ce780 msgr2=0x7f189013cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:44.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.459+0000 7f188effd640 1 --2- 172.21.15.18:0/2141446902 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18900ce780 0x7f189013cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.459+0000 7f188effd640 1 -- 172.21.15.18:0/2141446902 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f189013d7e0 con 0x7f1890072f40 2024-09-19T09:14:44.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.459+0000 7f188effd640 1 --2- 172.21.15.18:0/2141446902 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1890072f40 0x7f189013b2a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f188800c5d0 tx=0x7f188800ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:44.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.459+0000 7f1887fff640 1 -- 172.21.15.18:0/2141446902 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1888017070 con 0x7f1890072f40 2024-09-19T09:14:44.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.460+0000 7f1895874640 1 -- 172.21.15.18:0/2141446902 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18901419c0 con 0x7f1890072f40 2024-09-19T09:14:44.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.460+0000 7f1887fff640 1 -- 172.21.15.18:0/2141446902 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1888005d00 con 0x7f1890072f40 2024-09-19T09:14:44.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.460+0000 7f1887fff640 1 -- 172.21.15.18:0/2141446902 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18880072b0 con 0x7f1890072f40 2024-09-19T09:14:44.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.460+0000 7f1895874640 1 -- 172.21.15.18:0/2141446902 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1890141f80 con 0x7f1890072f40 2024-09-19T09:14:44.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.461+0000 7f1895874640 1 -- 172.21.15.18:0/2141446902 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18900715a0 con 0x7f1890072f40 2024-09-19T09:14:44.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.461+0000 7f1887fff640 1 -- 172.21.15.18:0/2141446902 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f188801a070 con 0x7f1890072f40 2024-09-19T09:14:44.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.462+0000 7f1887fff640 1 --2- 172.21.15.18:0/2141446902 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f187006c2e0 0x7f187006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:44.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.462+0000 7f1887fff640 1 -- 172.21.15.18:0/2141446902 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7f188808a900 con 0x7f1890072f40 2024-09-19T09:14:44.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.462+0000 7f188e7fc640 1 --2- 172.21.15.18:0/2141446902 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f187006c2e0 0x7f187006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:44.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.463+0000 7f188e7fc640 1 --2- 172.21.15.18:0/2141446902 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f187006c2e0 0x7f187006e7a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1878034000 tx=0x7f187802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:44.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.466+0000 7f1887fff640 1 -- 172.21.15.18:0/2141446902 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f18880589a0 con 0x7f1890072f40 2024-09-19T09:14:44.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.644+0000 7f1895874640 1 -- 172.21.15.18:0/2141446902 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1890075620 con 0x7f1890072f40 2024-09-19T09:14:44.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.645+0000 7f1887fff640 1 -- 172.21.15.18:0/2141446902 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+16694 (secure 0 0 0) 0x7f188805cca0 con 0x7f1890072f40 2024-09-19T09:14:44.646 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:44.646 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":47,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:14:43.366966+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:14:41.948276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-19T09:14:42.341949+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:14:44.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.647+0000 7f1895874640 1 -- 172.21.15.18:0/2141446902 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f187006c2e0 msgr2=0x7f187006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:44.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.647+0000 7f1895874640 1 --2- 172.21.15.18:0/2141446902 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f187006c2e0 0x7f187006e7a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1878034000 tx=0x7f187802e000 comp rx=0 tx=0).stop 2024-09-19T09:14:44.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.647+0000 7f1895874640 1 -- 172.21.15.18:0/2141446902 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1890072f40 msgr2=0x7f189013b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:44.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.647+0000 7f1895874640 1 --2- 172.21.15.18:0/2141446902 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1890072f40 0x7f189013b2a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f188800c5d0 tx=0x7f188800ca90 comp rx=0 tx=0).stop 2024-09-19T09:14:44.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.647+0000 7f1895874640 1 -- 172.21.15.18:0/2141446902 shutdown_connections 2024-09-19T09:14:44.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.647+0000 7f1895874640 1 --2- 172.21.15.18:0/2141446902 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f187006c2e0 0x7f187006e7a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.647+0000 7f1895874640 1 --2- 172.21.15.18:0/2141446902 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1890145290 0x7f18900b3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.647+0000 7f1895874640 1 --2- 172.21.15.18:0/2141446902 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f18900ce780 0x7f189013cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.647+0000 7f1895874640 1 --2- 172.21.15.18:0/2141446902 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1890072f40 0x7f189013b2a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.647+0000 7f1895874640 1 -- 172.21.15.18:0/2141446902 >> 172.21.15.18:0/2141446902 conn(0x7f189006bc10 msgr2=0x7f18900b0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:44.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.647+0000 7f1895874640 1 -- 172.21.15.18:0/2141446902 shutdown_connections 2024-09-19T09:14:44.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.647+0000 7f1895874640 1 -- 172.21.15.18:0/2141446902 wait complete. 2024-09-19T09:14:44.659 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-19T09:14:44.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.763+0000 7fc3afaaf640 1 Processor -- start 2024-09-19T09:14:44.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.763+0000 7fc3afaaf640 1 -- start start 2024-09-19T09:14:44.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.764+0000 7fc3afaaf640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc3a8156f90 0x7fc3a8071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:44.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.764+0000 7fc3afaaf640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc3a80b6450 0x7fc3a80b6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:44.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.764+0000 7fc3afaaf640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3a806fef0 con 0x7fc3a80b7080 2024-09-19T09:14:44.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.764+0000 7fc3afaaf640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fc3a8070db0 con 0x7fc3a8156f90 2024-09-19T09:14:44.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.764+0000 7fc3afaaf640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc3a80b6dc0 con 0x7fc3a80b6450 2024-09-19T09:14:44.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.764+0000 7fc3ad84b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc3a8156f90 0x7fc3a8071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:44.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.764+0000 7fc3ad84b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc3a8156f90 0x7fc3a8071240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56368/0 (socket says 172.21.15.18:56368) 2024-09-19T09:14:44.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.764+0000 7fc3ad84b640 1 -- 172.21.15.18:0/1880294525 learned_addr learned my addr 172.21.15.18:0/1880294525 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:44.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.765+0000 7fc3ae04c640 1 --2- 172.21.15.18:0/1880294525 >> v2:172.21.15.162:3300/0 conn(0x7fc3a80b6450 0x7fc3a80b6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:44.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.765+0000 7fc3ad84b640 1 -- 172.21.15.18:0/1880294525 >> v2:172.21.15.162:3300/0 conn(0x7fc3a80b6450 msgr2=0x7fc3a80b6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:44.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.765+0000 7fc3ad84b640 1 --2- 172.21.15.18:0/1880294525 >> v2:172.21.15.162:3300/0 conn(0x7fc3a80b6450 0x7fc3a80b6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.765+0000 7fc3ad84b640 1 -- 172.21.15.18:0/1880294525 >> v1:172.21.15.162:6789/0 conn(0x7fc3a80b7080 legacy=0x7fc3a806f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:44.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.765+0000 7fc3ad84b640 1 -- 172.21.15.18:0/1880294525 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a80701a0 con 0x7fc3a8156f90 2024-09-19T09:14:44.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.765+0000 7fc3ae04c640 1 --2- 172.21.15.18:0/1880294525 >> v2:172.21.15.162:3300/0 conn(0x7fc3a80b6450 0x7fc3a80b6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:14:44.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.765+0000 7fc3ad84b640 1 --2- 172.21.15.18:0/1880294525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a8156f90 0x7fc3a8071240 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc3a80af900 tx=0x7fc39802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa99d9de2af9a902 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:44.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.765+0000 7fc3ac849640 1 -- 172.21.15.18:0/1880294525 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc398036070 con 0x7fc3a8156f90 2024-09-19T09:14:44.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.765+0000 7fc3ac849640 1 -- 172.21.15.18:0/1880294525 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc398031600 con 0x7fc3a8156f90 2024-09-19T09:14:44.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.765+0000 7fc3ac849640 1 -- 172.21.15.18:0/1880294525 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3980319d0 con 0x7fc3a8156f90 2024-09-19T09:14:44.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.766+0000 7fc3afaaf640 1 -- 172.21.15.18:0/1880294525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a8156f90 msgr2=0x7fc3a8071240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:44.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.766+0000 7fc3afaaf640 1 --2- 172.21.15.18:0/1880294525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a8156f90 0x7fc3a8071240 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc3a80af900 tx=0x7fc39802a6f0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.766+0000 7fc3afaaf640 1 -- 172.21.15.18:0/1880294525 shutdown_connections 2024-09-19T09:14:44.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.766+0000 7fc3afaaf640 1 --2- 172.21.15.18:0/1880294525 >> v2:172.21.15.162:3300/0 conn(0x7fc3a80b6450 0x7fc3a80b6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.766+0000 7fc3afaaf640 1 --2- 172.21.15.18:0/1880294525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a8156f90 0x7fc3a8071240 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.766+0000 7fc3afaaf640 1 -- 172.21.15.18:0/1880294525 >> 172.21.15.18:0/1880294525 conn(0x7fc3a8073c80 msgr2=0x7fc3a809b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:44.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.766+0000 7fc3afaaf640 1 -- 172.21.15.18:0/1880294525 shutdown_connections 2024-09-19T09:14:44.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.766+0000 7fc3afaaf640 1 -- 172.21.15.18:0/1880294525 wait complete. 2024-09-19T09:14:44.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.767+0000 7fc3afaaf640 1 Processor -- start 2024-09-19T09:14:44.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.767+0000 7fc3afaaf640 1 -- start start 2024-09-19T09:14:44.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.768+0000 7fc3afaaf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3a80b6450 0x7fc3a8159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:44.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.768+0000 7fc3afaaf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a80b7080 0x7fc3a8158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:44.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.768+0000 7fc3afaaf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3a8156f90 0x7fc3a8148010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:44.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.768+0000 7fc3afaaf640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a8070a40 con 0x7fc3a80b7080 2024-09-19T09:14:44.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.768+0000 7fc3afaaf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc3a8070760 con 0x7fc3a80b6450 2024-09-19T09:14:44.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.768+0000 7fc3afaaf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc3a8157370 con 0x7fc3a8156f90 2024-09-19T09:14:44.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.768+0000 7fc3ad04a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a80b7080 0x7fc3a8158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:44.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.768+0000 7fc3ad04a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a80b7080 0x7fc3a8158da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56382/0 (socket says 172.21.15.18:56382) 2024-09-19T09:14:44.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.768+0000 7fc3ad04a640 1 -- 172.21.15.18:0/878049232 learned_addr learned my addr 172.21.15.18:0/878049232 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:44.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.768+0000 7fc3ae04c640 1 --2- 172.21.15.18:0/878049232 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3a8156f90 0x7fc3a8148010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:44.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.768+0000 7fc3ad84b640 1 --2- 172.21.15.18:0/878049232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3a80b6450 0x7fc3a8159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:44.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.768+0000 7fc3ad04a640 1 -- 172.21.15.18:0/878049232 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3a8156f90 msgr2=0x7fc3a8148010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:44.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.768+0000 7fc3ad04a640 1 --2- 172.21.15.18:0/878049232 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3a8156f90 0x7fc3a8148010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.768+0000 7fc3ad04a640 1 -- 172.21.15.18:0/878049232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3a80b6450 msgr2=0x7fc3a8159760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:44.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.768+0000 7fc3ad04a640 1 --2- 172.21.15.18:0/878049232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3a80b6450 0x7fc3a8159760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:44.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.768+0000 7fc3ad04a640 1 -- 172.21.15.18:0/878049232 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3a80b2a60 con 0x7fc3a80b7080 2024-09-19T09:14:44.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.769+0000 7fc3ad04a640 1 --2- 172.21.15.18:0/878049232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a80b7080 0x7fc3a8158da0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc39c00c400 tx=0x7fc39c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:44.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.769+0000 7fc3a67fc640 1 -- 172.21.15.18:0/878049232 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39c011790 con 0x7fc3a80b7080 2024-09-19T09:14:44.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.769+0000 7fc3a67fc640 1 -- 172.21.15.18:0/878049232 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc39c017070 con 0x7fc3a80b7080 2024-09-19T09:14:44.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.769+0000 7fc3a67fc640 1 -- 172.21.15.18:0/878049232 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc39c011bb0 con 0x7fc3a80b7080 2024-09-19T09:14:44.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.769+0000 7fc3afaaf640 1 -- 172.21.15.18:0/878049232 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3a80b2d40 con 0x7fc3a80b7080 2024-09-19T09:14:44.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.769+0000 7fc3afaaf640 1 -- 172.21.15.18:0/878049232 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3a80b35e0 con 0x7fc3a80b7080 2024-09-19T09:14:44.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.770+0000 7fc3afaaf640 1 -- 172.21.15.18:0/878049232 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3a80b37e0 con 0x7fc3a80b7080 2024-09-19T09:14:44.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.770+0000 7fc3a67fc640 1 -- 172.21.15.18:0/878049232 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc39c01c460 con 0x7fc3a80b7080 2024-09-19T09:14:44.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.771+0000 7fc3a67fc640 1 --2- 172.21.15.18:0/878049232 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc39406c2b0 0x7fc39406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:44.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.771+0000 7fc3a67fc640 1 -- 172.21.15.18:0/878049232 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5709+0+0 (secure 0 0 0) 0x7fc39c08b300 con 0x7fc3a80b7080 2024-09-19T09:14:44.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.771+0000 7fc3ad84b640 1 --2- 172.21.15.18:0/878049232 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc39406c2b0 0x7fc39406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:44.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.772+0000 7fc3ad84b640 1 --2- 172.21.15.18:0/878049232 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc39406c2b0 0x7fc39406e770 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc398033000 tx=0x7fc398009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:44.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.776+0000 7fc3a67fc640 1 -- 172.21.15.18:0/878049232 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc3a80b37e0 con 0x7fc3a80b7080 2024-09-19T09:14:44.988 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:44.988+0000 7fc3afaaf640 1 -- 172.21.15.18:0/878049232 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc3a80b2f10 con 0x7fc3a80b7080 2024-09-19T09:14:45.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.020+0000 7fc3a67fc640 1 -- 172.21.15.18:0/878049232 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v20) ==== 118+0+0 (secure 0 0 0) 0x7fc39c059a70 con 0x7fc3a80b7080 2024-09-19T09:14:45.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.023+0000 7fc3afaaf640 1 -- 172.21.15.18:0/878049232 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc39406c2b0 msgr2=0x7fc39406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:45.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.023+0000 7fc3afaaf640 1 --2- 172.21.15.18:0/878049232 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc39406c2b0 0x7fc39406e770 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc398033000 tx=0x7fc398009000 comp rx=0 tx=0).stop 2024-09-19T09:14:45.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.023+0000 7fc3afaaf640 1 -- 172.21.15.18:0/878049232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a80b7080 msgr2=0x7fc3a8158da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:45.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.023+0000 7fc3afaaf640 1 --2- 172.21.15.18:0/878049232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a80b7080 0x7fc3a8158da0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fc39c00c400 tx=0x7fc39c00c8c0 comp rx=0 tx=0).stop 2024-09-19T09:14:45.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.023+0000 7fc3afaaf640 1 -- 172.21.15.18:0/878049232 shutdown_connections 2024-09-19T09:14:45.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.023+0000 7fc3afaaf640 1 --2- 172.21.15.18:0/878049232 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc39406c2b0 0x7fc39406e770 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:45.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.023+0000 7fc3afaaf640 1 --2- 172.21.15.18:0/878049232 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3a8156f90 0x7fc3a8148010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:45.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.023+0000 7fc3afaaf640 1 --2- 172.21.15.18:0/878049232 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc3a80b7080 0x7fc3a8158da0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:45.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.023+0000 7fc3afaaf640 1 --2- 172.21.15.18:0/878049232 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3a80b6450 0x7fc3a8159760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:45.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.023+0000 7fc3afaaf640 1 -- 172.21.15.18:0/878049232 >> 172.21.15.18:0/878049232 conn(0x7fc3a8073c80 msgr2=0x7fc3a8151d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:45.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.023+0000 7fc3afaaf640 1 -- 172.21.15.18:0/878049232 shutdown_connections 2024-09-19T09:14:45.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.023+0000 7fc3afaaf640 1 -- 172.21.15.18:0/878049232 wait complete. 2024-09-19T09:14:45.035 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-19T09:14:45.035 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-19T09:14:45.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.139+0000 7fc9ae0e6640 1 Processor -- start 2024-09-19T09:14:45.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.139+0000 7fc9ae0e6640 1 -- start start 2024-09-19T09:14:45.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.140+0000 7fc9ae0e6640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc9a81623c0 0x7fc9a80b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:45.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.140+0000 7fc9ae0e6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9a80d1470 0x7fc9a80d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:45.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.140+0000 7fc9ae0e6640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9a80d3700 con 0x7fc9a80d56b0 2024-09-19T09:14:45.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.140+0000 7fc9ae0e6640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc9a80d21a0 con 0x7fc9a81623c0 2024-09-19T09:14:45.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.140+0000 7fc9ae0e6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc9a80d0080 con 0x7fc9a80d1470 2024-09-19T09:14:45.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.140+0000 7fc9a6ffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc9a80d56b0 0x7fc9a80d0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:51418/0 (socket says 172.21.15.18:51418) 2024-09-19T09:14:45.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.140+0000 7fc9a6ffd640 1 -- 172.21.15.18:0/947162401 learned_addr learned my addr 172.21.15.18:0/947162401 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:45.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.140+0000 7fc9a67fc640 1 -- 172.21.15.18:0/947162401 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2208349045 0 0) 0x7fc9a80d3700 con 0x7fc9a80d56b0 2024-09-19T09:14:45.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.140+0000 7fc9a77fe640 1 --2- 172.21.15.18:0/947162401 >> v2:172.21.15.162:3300/0 conn(0x7fc9a81623c0 0x7fc9a80b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:45.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.140+0000 7fc9a7fff640 1 --2- 172.21.15.18:0/947162401 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9a80d1470 0x7fc9a80d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:45.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.140+0000 7fc9a67fc640 1 -- 172.21.15.18:0/947162401 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc990003520 con 0x7fc9a80d56b0 2024-09-19T09:14:45.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.141+0000 7fc9a67fc640 1 -- 172.21.15.18:0/947162401 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1189628617 0 0) 0x7fc990003520 con 0x7fc9a80d56b0 2024-09-19T09:14:45.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.141+0000 7fc9a67fc640 1 -- 172.21.15.18:0/947162401 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9a80d1470 msgr2=0x7fc9a80d1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:45.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.141+0000 7fc9a67fc640 1 --2- 172.21.15.18:0/947162401 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9a80d1470 0x7fc9a80d1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:45.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.141+0000 7fc9a67fc640 1 -- 172.21.15.18:0/947162401 >> v2:172.21.15.162:3300/0 conn(0x7fc9a81623c0 msgr2=0x7fc9a80b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:45.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.141+0000 7fc9a67fc640 1 --2- 172.21.15.18:0/947162401 >> v2:172.21.15.162:3300/0 conn(0x7fc9a81623c0 0x7fc9a80b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:45.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.141+0000 7fc9a67fc640 1 -- 172.21.15.18:0/947162401 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a80cfa70 con 0x7fc9a80d56b0 2024-09-19T09:14:45.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.141+0000 7fc9a67fc640 1 -- 172.21.15.18:0/947162401 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fc99c001670 con 0x7fc9a80d56b0 2024-09-19T09:14:45.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.141+0000 7fc9a67fc640 1 -- 172.21.15.18:0/947162401 >> v1:172.21.15.18:6789/0 conn(0x7fc9a80d56b0 legacy=0x7fc9a80d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:45.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.141+0000 7fc9a67fc640 1 --2- 172.21.15.18:0/947162401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9900039b0 0x7fc990003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:45.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.141+0000 7fc9a67fc640 1 --2- 172.21.15.18:0/947162401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc990004800 0x7fc990004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:45.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.141+0000 7fc9a67fc640 1 --2- 172.21.15.18:0/947162401 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9a80d1470 0x7fc9900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:45.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.141+0000 7fc9a67fc640 1 -- 172.21.15.18:0/947162401 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a80d21a0 con 0x7fc990004800 2024-09-19T09:14:45.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.141+0000 7fc9a67fc640 1 -- 172.21.15.18:0/947162401 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a80d0080 con 0x7fc9900039b0 2024-09-19T09:14:45.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.141+0000 7fc9a67fc640 1 -- 172.21.15.18:0/947162401 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc99000b9c0 con 0x7fc9a80d1470 2024-09-19T09:14:45.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.141+0000 7fc9a6ffd640 1 --2- 172.21.15.18:0/947162401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc990004800 0x7fc990004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:45.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.141+0000 7fc9a77fe640 1 --2- 172.21.15.18:0/947162401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9900039b0 0x7fc990003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:45.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.141+0000 7fc9a7fff640 1 --2- 172.21.15.18:0/947162401 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9a80d1470 0x7fc9900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:45.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.141+0000 7fc9a6ffd640 1 -- 172.21.15.18:0/947162401 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9a80d1470 msgr2=0x7fc9900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:45.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.141+0000 7fc9a6ffd640 1 --2- 172.21.15.18:0/947162401 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9a80d1470 0x7fc9900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:45.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.141+0000 7fc9a6ffd640 1 -- 172.21.15.18:0/947162401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9900039b0 msgr2=0x7fc990003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:45.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.141+0000 7fc9a6ffd640 1 --2- 172.21.15.18:0/947162401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9900039b0 0x7fc990003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:45.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.141+0000 7fc9a6ffd640 1 -- 172.21.15.18:0/947162401 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc990003520 con 0x7fc990004800 2024-09-19T09:14:45.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.142+0000 7fc9a6ffd640 1 --2- 172.21.15.18:0/947162401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc990004800 0x7fc990004c80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc99c001050 tx=0x7fc990005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ba11d88ced5214 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:45.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.142+0000 7fc9a67fc640 1 -- 172.21.15.18:0/947162401 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c02e070 con 0x7fc990004800 2024-09-19T09:14:45.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.142+0000 7fc9a67fc640 1 -- 172.21.15.18:0/947162401 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc99c005af0 con 0x7fc990004800 2024-09-19T09:14:45.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.142+0000 7fc9a67fc640 1 -- 172.21.15.18:0/947162401 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc99c007d70 con 0x7fc990004800 2024-09-19T09:14:45.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.142+0000 7fc9ae0e6640 1 -- 172.21.15.18:0/947162401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc990004800 msgr2=0x7fc990004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:45.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.142+0000 7fc9ae0e6640 1 --2- 172.21.15.18:0/947162401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc990004800 0x7fc990004c80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc99c001050 tx=0x7fc990005830 comp rx=0 tx=0).stop 2024-09-19T09:14:45.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.143+0000 7fc9a7fff640 1 -- 172.21.15.18:0/947162401 reap_dead start 2024-09-19T09:14:45.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.143+0000 7fc9ae0e6640 1 -- 172.21.15.18:0/947162401 shutdown_connections 2024-09-19T09:14:45.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.143+0000 7fc9ae0e6640 1 -- 172.21.15.18:0/947162401 >> 172.21.15.18:0/947162401 conn(0x7fc9a809df30 msgr2=0x7fc9a80d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:45.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.143+0000 7fc9ae0e6640 1 -- 172.21.15.18:0/947162401 shutdown_connections 2024-09-19T09:14:45.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.143+0000 7fc9ae0e6640 1 -- 172.21.15.18:0/947162401 wait complete. 2024-09-19T09:14:45.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.144+0000 7fc9ae0e6640 1 Processor -- start 2024-09-19T09:14:45.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.144+0000 7fc9ae0e6640 1 -- start start 2024-09-19T09:14:45.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.145+0000 7fc9ae0e6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc990004800 0x7fc9a815bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:45.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.145+0000 7fc9ae0e6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9a80cea20 0x7fc9a815ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:45.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.145+0000 7fc9ae0e6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9a815e3b0 0x7fc9a815e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:45.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.145+0000 7fc9ae0e6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a80cfd10 con 0x7fc9a815e3b0 2024-09-19T09:14:45.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.145+0000 7fc9ae0e6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc9a80d39a0 con 0x7fc990004800 2024-09-19T09:14:45.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.145+0000 7fc9ae0e6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc9a81627a0 con 0x7fc9a80cea20 2024-09-19T09:14:45.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.145+0000 7fc9a7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9a815e3b0 0x7fc9a815e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:45.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.145+0000 7fc9a7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9a815e3b0 0x7fc9a815e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56406/0 (socket says 172.21.15.18:56406) 2024-09-19T09:14:45.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.145+0000 7fc9a7fff640 1 -- 172.21.15.18:0/3007764857 learned_addr learned my addr 172.21.15.18:0/3007764857 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:45.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.145+0000 7fc9a77fe640 1 --2- 172.21.15.18:0/3007764857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc990004800 0x7fc9a815bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:45.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.145+0000 7fc9a6ffd640 1 --2- 172.21.15.18:0/3007764857 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9a80cea20 0x7fc9a815ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:45.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.145+0000 7fc9a7fff640 1 -- 172.21.15.18:0/3007764857 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9a80cea20 msgr2=0x7fc9a815ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:45.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.145+0000 7fc9a7fff640 1 --2- 172.21.15.18:0/3007764857 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9a80cea20 0x7fc9a815ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:45.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.145+0000 7fc9a7fff640 1 -- 172.21.15.18:0/3007764857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc990004800 msgr2=0x7fc9a815bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:45.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.145+0000 7fc9a7fff640 1 --2- 172.21.15.18:0/3007764857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc990004800 0x7fc9a815bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:45.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.145+0000 7fc9a7fff640 1 -- 172.21.15.18:0/3007764857 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9a815b3d0 con 0x7fc9a815e3b0 2024-09-19T09:14:45.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.145+0000 7fc9a77fe640 1 --2- 172.21.15.18:0/3007764857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc990004800 0x7fc9a815bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:45.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.145+0000 7fc9a7fff640 1 --2- 172.21.15.18:0/3007764857 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9a815e3b0 0x7fc9a815e830 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc9a808f190 tx=0x7fc9a000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:45.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.146+0000 7fc98ffff640 1 -- 172.21.15.18:0/3007764857 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a000fde0 con 0x7fc9a815e3b0 2024-09-19T09:14:45.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.146+0000 7fc98ffff640 1 -- 172.21.15.18:0/3007764857 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9a001d070 con 0x7fc9a815e3b0 2024-09-19T09:14:45.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.146+0000 7fc9ae0e6640 1 -- 172.21.15.18:0/3007764857 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9a815c7b0 con 0x7fc9a815e3b0 2024-09-19T09:14:45.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.146+0000 7fc98ffff640 1 -- 172.21.15.18:0/3007764857 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9a0015670 con 0x7fc9a815e3b0 2024-09-19T09:14:45.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.146+0000 7fc9ae0e6640 1 -- 172.21.15.18:0/3007764857 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9a815cd70 con 0x7fc9a815e3b0 2024-09-19T09:14:45.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.146+0000 7fc9ae0e6640 1 -- 172.21.15.18:0/3007764857 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9a80babc0 con 0x7fc9a815e3b0 2024-09-19T09:14:45.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.147+0000 7fc98ffff640 1 -- 172.21.15.18:0/3007764857 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc9a0015810 con 0x7fc9a815e3b0 2024-09-19T09:14:45.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.148+0000 7fc98ffff640 1 --2- 172.21.15.18:0/3007764857 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc99406c2e0 0x7fc99406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:45.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.148+0000 7fc98ffff640 1 -- 172.21.15.18:0/3007764857 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7fc9a008bd00 con 0x7fc9a815e3b0 2024-09-19T09:14:45.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.148+0000 7fc9a77fe640 1 --2- 172.21.15.18:0/3007764857 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc99406c2e0 0x7fc99406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:45.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.148+0000 7fc9a77fe640 1 --2- 172.21.15.18:0/3007764857 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc99406c2e0 0x7fc99406e7a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc998009bc0 tx=0x7fc998008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:45.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.152+0000 7fc98ffff640 1 -- 172.21.15.18:0/3007764857 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc9a80babc0 con 0x7fc9a815e3b0 2024-09-19T09:14:45.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:45.361+0000 7fc9ae0e6640 1 -- 172.21.15.18:0/3007764857 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fc9a80d2340 con 0x7fc9a815e3b0 2024-09-19T09:14:46.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.025+0000 7fc98ffff640 1 -- 172.21.15.18:0/3007764857 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v21) ==== 122+0+0 (secure 0 0 0) 0x7fc9a0010040 con 0x7fc9a815e3b0 2024-09-19T09:14:46.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.028+0000 7fc9ae0e6640 1 -- 172.21.15.18:0/3007764857 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc99406c2e0 msgr2=0x7fc99406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:46.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.028+0000 7fc9ae0e6640 1 --2- 172.21.15.18:0/3007764857 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc99406c2e0 0x7fc99406e7a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc998009bc0 tx=0x7fc998008040 comp rx=0 tx=0).stop 2024-09-19T09:14:46.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.028+0000 7fc9ae0e6640 1 -- 172.21.15.18:0/3007764857 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9a815e3b0 msgr2=0x7fc9a815e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:46.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.028+0000 7fc9ae0e6640 1 --2- 172.21.15.18:0/3007764857 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9a815e3b0 0x7fc9a815e830 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc9a808f190 tx=0x7fc9a000f580 comp rx=0 tx=0).stop 2024-09-19T09:14:46.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.028+0000 7fc9ae0e6640 1 -- 172.21.15.18:0/3007764857 shutdown_connections 2024-09-19T09:14:46.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.028+0000 7fc9ae0e6640 1 --2- 172.21.15.18:0/3007764857 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc99406c2e0 0x7fc99406e7a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.028+0000 7fc9ae0e6640 1 --2- 172.21.15.18:0/3007764857 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9a815e3b0 0x7fc9a815e830 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.028+0000 7fc9ae0e6640 1 --2- 172.21.15.18:0/3007764857 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9a80cea20 0x7fc9a815ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.028+0000 7fc9ae0e6640 1 --2- 172.21.15.18:0/3007764857 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc990004800 0x7fc9a815bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.028+0000 7fc9ae0e6640 1 -- 172.21.15.18:0/3007764857 >> 172.21.15.18:0/3007764857 conn(0x7fc9a809df30 msgr2=0x7fc9a80b7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:46.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.028+0000 7fc9ae0e6640 1 -- 172.21.15.18:0/3007764857 shutdown_connections 2024-09-19T09:14:46.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.028+0000 7fc9ae0e6640 1 -- 172.21.15.18:0/3007764857 wait complete. 2024-09-19T09:14:46.042 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-19T09:14:46.042 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:14:46.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.150+0000 7f3480096640 1 Processor -- start 2024-09-19T09:14:46.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.150+0000 7f3480096640 1 -- start start 2024-09-19T09:14:46.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.151+0000 7f3480096640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f347815ec40 0x7f34780d1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:46.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.151+0000 7f3480096640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f347815fe50 0x7f347806d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:46.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.151+0000 7f3480096640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f347815fb40 con 0x7f347815f020 2024-09-19T09:14:46.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.151+0000 7f3480096640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f347806e0a0 con 0x7f347815ec40 2024-09-19T09:14:46.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.151+0000 7f3480096640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f34780d0f10 con 0x7f347815fe50 2024-09-19T09:14:46.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.151+0000 7f347de32640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f347815ec40 0x7f34780d1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:46.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.151+0000 7f347e633640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f347815f020 0x7f347815f430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59836/0 (socket says 172.21.15.18:59836) 2024-09-19T09:14:46.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.151+0000 7f347e633640 1 -- 172.21.15.18:0/1283295511 learned_addr learned my addr 172.21.15.18:0/1283295511 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:46.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.151+0000 7f347d631640 1 --2- 172.21.15.18:0/1283295511 >> v2:172.21.15.162:3300/0 conn(0x7f347815fe50 0x7f347806d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:46.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.152+0000 7f347de32640 1 -- 172.21.15.18:0/1283295511 >> v2:172.21.15.162:3300/0 conn(0x7f347815fe50 msgr2=0x7f347806d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:46.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.152+0000 7f347de32640 1 --2- 172.21.15.18:0/1283295511 >> v2:172.21.15.162:3300/0 conn(0x7f347815fe50 0x7f347806d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.152+0000 7f347de32640 1 -- 172.21.15.18:0/1283295511 >> v1:172.21.15.18:6789/0 conn(0x7f347815f020 legacy=0x7f347815f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:46.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.152+0000 7f347ce30640 1 -- 172.21.15.18:0/1283295511 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 669604790 0 0) 0x7f347815fb40 con 0x7f347815f020 2024-09-19T09:14:46.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.152+0000 7f347de32640 1 -- 172.21.15.18:0/1283295511 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34780d11f0 con 0x7f347815ec40 2024-09-19T09:14:46.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.152+0000 7f347de32640 1 --2- 172.21.15.18:0/1283295511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f347815ec40 0x7f34780d1cb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f34780d0220 tx=0x7f347402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d9945465ce75d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.152+0000 7f347ce30640 1 -- 172.21.15.18:0/1283295511 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3474037070 con 0x7f347815ec40 2024-09-19T09:14:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.153+0000 7f347ce30640 1 -- 172.21.15.18:0/1283295511 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3474032440 con 0x7f347815ec40 2024-09-19T09:14:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.153+0000 7f347ce30640 1 -- 172.21.15.18:0/1283295511 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3474032810 con 0x7f347815ec40 2024-09-19T09:14:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.153+0000 7f3480096640 1 -- 172.21.15.18:0/1283295511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f347815ec40 msgr2=0x7f34780d1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.153+0000 7f3480096640 1 --2- 172.21.15.18:0/1283295511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f347815ec40 0x7f34780d1cb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f34780d0220 tx=0x7f347402a1a0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.153+0000 7f3480096640 1 -- 172.21.15.18:0/1283295511 shutdown_connections 2024-09-19T09:14:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.153+0000 7f3480096640 1 --2- 172.21.15.18:0/1283295511 >> v2:172.21.15.162:3300/0 conn(0x7f347815fe50 0x7f347806d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.153+0000 7f3480096640 1 --2- 172.21.15.18:0/1283295511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f347815ec40 0x7f34780d1cb0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.153+0000 7f3480096640 1 -- 172.21.15.18:0/1283295511 >> 172.21.15.18:0/1283295511 conn(0x7f34780b45f0 msgr2=0x7f34780b4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.153+0000 7f3480096640 1 -- 172.21.15.18:0/1283295511 shutdown_connections 2024-09-19T09:14:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.153+0000 7f3480096640 1 -- 172.21.15.18:0/1283295511 wait complete. 2024-09-19T09:14:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.154+0000 7f3480096640 1 Processor -- start 2024-09-19T09:14:46.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.154+0000 7f3480096640 1 -- start start 2024-09-19T09:14:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.155+0000 7f3480096640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f347815ec40 0x7f34780b6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.155+0000 7f3480096640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f347815f020 0x7f34780b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.155+0000 7f3480096640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f347815fe50 0x7f34780b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.155+0000 7f3480096640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f34780d21f0 con 0x7f347815f020 2024-09-19T09:14:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.155+0000 7f3480096640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f34780d17b0 con 0x7f347815ec40 2024-09-19T09:14:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.155+0000 7f3480096640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f347806dc30 con 0x7f347815fe50 2024-09-19T09:14:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.155+0000 7f347d631640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f347815f020 0x7f34780b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.155+0000 7f347d631640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f347815f020 0x7f34780b34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53540/0 (socket says 172.21.15.18:53540) 2024-09-19T09:14:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.155+0000 7f347d631640 1 -- 172.21.15.18:0/1179793511 learned_addr learned my addr 172.21.15.18:0/1179793511 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.155+0000 7f347de32640 1 --2- 172.21.15.18:0/1179793511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f347815ec40 0x7f34780b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.155+0000 7f347e633640 1 --2- 172.21.15.18:0/1179793511 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f347815fe50 0x7f34780b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.156+0000 7f347d631640 1 -- 172.21.15.18:0/1179793511 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f347815fe50 msgr2=0x7f34780b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.156+0000 7f347d631640 1 --2- 172.21.15.18:0/1179793511 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f347815fe50 0x7f34780b3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.156+0000 7f347d631640 1 -- 172.21.15.18:0/1179793511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f347815ec40 msgr2=0x7f34780b6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:46.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.156+0000 7f347d631640 1 --2- 172.21.15.18:0/1179793511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f347815ec40 0x7f34780b6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.156+0000 7f347d631640 1 -- 172.21.15.18:0/1179793511 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f347815a2d0 con 0x7f347815f020 2024-09-19T09:14:46.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.156+0000 7f347d631640 1 --2- 172.21.15.18:0/1179793511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f347815f020 0x7f34780b34e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f346800d5f0 tx=0x7f346800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:46.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.156+0000 7f346e7fc640 1 -- 172.21.15.18:0/1179793511 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34680125f0 con 0x7f347815f020 2024-09-19T09:14:46.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.156+0000 7f346e7fc640 1 -- 172.21.15.18:0/1179793511 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3468019070 con 0x7f347815f020 2024-09-19T09:14:46.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.156+0000 7f3480096640 1 -- 172.21.15.18:0/1179793511 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34780b7060 con 0x7f347815f020 2024-09-19T09:14:46.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.156+0000 7f346e7fc640 1 -- 172.21.15.18:0/1179793511 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34680129d0 con 0x7f347815f020 2024-09-19T09:14:46.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.156+0000 7f3480096640 1 -- 172.21.15.18:0/1179793511 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34780b7620 con 0x7f347815f020 2024-09-19T09:14:46.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.157+0000 7f3480096640 1 -- 172.21.15.18:0/1179793511 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34780d1cb0 con 0x7f347815f020 2024-09-19T09:14:46.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.158+0000 7f346e7fc640 1 -- 172.21.15.18:0/1179793511 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3468012b70 con 0x7f347815f020 2024-09-19T09:14:46.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.158+0000 7f346e7fc640 1 --2- 172.21.15.18:0/1179793511 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f345c06c2b0 0x7f345c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:46.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.158+0000 7f346e7fc640 1 -- 172.21.15.18:0/1179793511 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f346808b640 con 0x7f347815f020 2024-09-19T09:14:46.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.158+0000 7f347de32640 1 --2- 172.21.15.18:0/1179793511 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f345c06c2b0 0x7f345c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:46.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.159+0000 7f347de32640 1 --2- 172.21.15.18:0/1179793511 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f345c06c2b0 0x7f345c06e770 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3474034000 tx=0x7f347402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:46.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.162+0000 7f346e7fc640 1 -- 172.21.15.18:0/1179793511 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3468059760 con 0x7f347815f020 2024-09-19T09:14:46.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.373+0000 7f3480096640 1 -- 172.21.15.18:0/1179793511 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f34781624c0 con 0x7f347815f020 2024-09-19T09:14:46.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.374+0000 7f346e7fc640 1 -- 172.21.15.18:0/1179793511 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5223 (secure 0 0 0) 0x7f346805da60 con 0x7f347815f020 2024-09-19T09:14:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:46.374 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"btime":"2024-09-19T09:14:46:022043+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4793,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/113686001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":113686001},{"type":"v1","addr":"172.21.15.162:6835","nonce":113686001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":4799,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3269042030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3269042030},{"type":"v1","addr":"172.21.15.162:6837","nonce":3269042030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/3996030837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3996030837},{"type":"v1","addr":"172.21.15.18:6834","nonce":3996030837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:14:43.367290+0000","modified":"2024-09-19T09:14:45.363192+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5187":{"gid":5187,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/295967875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":295967875},{"type":"v1","addr":"172.21.15.18:6835","nonce":295967875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5187,"qdb_cluster":[5187]},"id":3}]} 2024-09-19T09:14:46.375 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 21 2024-09-19T09:14:46.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.376+0000 7f3480096640 1 -- 172.21.15.18:0/1179793511 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f345c06c2b0 msgr2=0x7f345c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:46.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.376+0000 7f3480096640 1 --2- 172.21.15.18:0/1179793511 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f345c06c2b0 0x7f345c06e770 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3474034000 tx=0x7f347402e000 comp rx=0 tx=0).stop 2024-09-19T09:14:46.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.376+0000 7f3480096640 1 -- 172.21.15.18:0/1179793511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f347815f020 msgr2=0x7f34780b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:46.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.376+0000 7f3480096640 1 --2- 172.21.15.18:0/1179793511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f347815f020 0x7f34780b34e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f346800d5f0 tx=0x7f346800dab0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.376+0000 7f3480096640 1 -- 172.21.15.18:0/1179793511 shutdown_connections 2024-09-19T09:14:46.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.376+0000 7f3480096640 1 --2- 172.21.15.18:0/1179793511 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f345c06c2b0 0x7f345c06e770 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.376+0000 7f3480096640 1 --2- 172.21.15.18:0/1179793511 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f347815fe50 0x7f34780b3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.376+0000 7f3480096640 1 --2- 172.21.15.18:0/1179793511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f347815f020 0x7f34780b34e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.376+0000 7f3480096640 1 --2- 172.21.15.18:0/1179793511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f347815ec40 0x7f34780b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.376+0000 7f3480096640 1 -- 172.21.15.18:0/1179793511 >> 172.21.15.18:0/1179793511 conn(0x7f34780b45f0 msgr2=0x7f34780b00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:46.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.376+0000 7f3480096640 1 -- 172.21.15.18:0/1179793511 shutdown_connections 2024-09-19T09:14:46.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.376+0000 7f3480096640 1 -- 172.21.15.18:0/1179793511 wait complete. 2024-09-19T09:14:46.387 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:14:46.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.488+0000 7f6ae36ba640 1 Processor -- start 2024-09-19T09:14:46.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.489+0000 7f6ae36ba640 1 -- start start 2024-09-19T09:14:46.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.489+0000 7f6ae36ba640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6adc0d1ab0 0x7f6adc0b8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:46.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.489+0000 7f6ae36ba640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6adc0d3240 0x7f6adc0b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:46.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.489+0000 7f6ae36ba640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6adc0b7a90 con 0x7f6adc15ef50 2024-09-19T09:14:46.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.489+0000 7f6ae36ba640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f6adc0d3740 con 0x7f6adc0d1ab0 2024-09-19T09:14:46.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.489+0000 7f6ae36ba640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6adc0d3a20 con 0x7f6adc0d3240 2024-09-19T09:14:46.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.490+0000 7f6ae0c55640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6adc0d1ab0 0x7f6adc0b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:46.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.490+0000 7f6ae1456640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6adc15ef50 0x7f6adc0d13a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59840/0 (socket says 172.21.15.18:59840) 2024-09-19T09:14:46.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.490+0000 7f6ae1456640 1 -- 172.21.15.18:0/3429588001 learned_addr learned my addr 172.21.15.18:0/3429588001 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:46.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.490+0000 7f6ae1c57640 1 --2- 172.21.15.18:0/3429588001 >> v2:172.21.15.162:3300/0 conn(0x7f6adc0d3240 0x7f6adc0b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:46.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.490+0000 7f6ae0c55640 1 -- 172.21.15.18:0/3429588001 >> v2:172.21.15.162:3300/0 conn(0x7f6adc0d3240 msgr2=0x7f6adc0b8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:46.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.490+0000 7f6ae0c55640 1 --2- 172.21.15.18:0/3429588001 >> v2:172.21.15.162:3300/0 conn(0x7f6adc0d3240 0x7f6adc0b8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.490+0000 7f6ae0c55640 1 -- 172.21.15.18:0/3429588001 >> v1:172.21.15.18:6789/0 conn(0x7f6adc15ef50 legacy=0x7f6adc0d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:46.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.490+0000 7f6ad3fff640 1 -- 172.21.15.18:0/3429588001 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4223748039 0 0) 0x7f6adc0b7a90 con 0x7f6adc15ef50 2024-09-19T09:14:46.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.490+0000 7f6ae0c55640 1 -- 172.21.15.18:0/3429588001 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6adc0b7d00 con 0x7f6adc0d1ab0 2024-09-19T09:14:46.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.490+0000 7f6ae1c57640 1 --2- 172.21.15.18:0/3429588001 >> v2:172.21.15.162:3300/0 conn(0x7f6adc0d3240 0x7f6adc0b8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:46.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.491+0000 7f6ae0c55640 1 --2- 172.21.15.18:0/3429588001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc0d1ab0 0x7f6adc0b8500 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6adc0b7760 tx=0x7f6acc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25afa56ac66bfa3d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:46.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.491+0000 7f6ad3fff640 1 -- 172.21.15.18:0/3429588001 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6acc037070 con 0x7f6adc0d1ab0 2024-09-19T09:14:46.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.491+0000 7f6ad3fff640 1 -- 172.21.15.18:0/3429588001 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6acc032440 con 0x7f6adc0d1ab0 2024-09-19T09:14:46.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.491+0000 7f6ad3fff640 1 -- 172.21.15.18:0/3429588001 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6acc02ae60 con 0x7f6adc0d1ab0 2024-09-19T09:14:46.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.491+0000 7f6ae36ba640 1 -- 172.21.15.18:0/3429588001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc0d1ab0 msgr2=0x7f6adc0b8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:46.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.491+0000 7f6ae36ba640 1 --2- 172.21.15.18:0/3429588001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc0d1ab0 0x7f6adc0b8500 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6adc0b7760 tx=0x7f6acc02a110 comp rx=0 tx=0).stop 2024-09-19T09:14:46.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.491+0000 7f6ae36ba640 1 -- 172.21.15.18:0/3429588001 shutdown_connections 2024-09-19T09:14:46.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.491+0000 7f6ae36ba640 1 --2- 172.21.15.18:0/3429588001 >> v2:172.21.15.162:3300/0 conn(0x7f6adc0d3240 0x7f6adc0b8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.491+0000 7f6ae36ba640 1 --2- 172.21.15.18:0/3429588001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc0d1ab0 0x7f6adc0b8500 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.491+0000 7f6ae36ba640 1 -- 172.21.15.18:0/3429588001 >> 172.21.15.18:0/3429588001 conn(0x7f6adc0d4c60 msgr2=0x7f6adc0d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:46.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.492+0000 7f6ae36ba640 1 -- 172.21.15.18:0/3429588001 shutdown_connections 2024-09-19T09:14:46.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.492+0000 7f6ae36ba640 1 -- 172.21.15.18:0/3429588001 wait complete. 2024-09-19T09:14:46.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.493+0000 7f6ae36ba640 1 Processor -- start 2024-09-19T09:14:46.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.493+0000 7f6ae36ba640 1 -- start start 2024-09-19T09:14:46.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.494+0000 7f6ae36ba640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6adc0d1ab0 0x7f6adc1f56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:46.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.494+0000 7f6ae36ba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc0d3240 0x7f6adc1521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:46.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.494+0000 7f6ae36ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6adc15ef50 0x7f6adc1f81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:46.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.494+0000 7f6ae36ba640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6adc0d21a0 con 0x7f6adc0d3240 2024-09-19T09:14:46.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.494+0000 7f6ae36ba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6adc0d2020 con 0x7f6adc15ef50 2024-09-19T09:14:46.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.494+0000 7f6ae36ba640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6adc0d5780 con 0x7f6adc0d1ab0 2024-09-19T09:14:46.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.494+0000 7f6ae0c55640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc0d3240 0x7f6adc1521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:46.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.494+0000 7f6ae0c55640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc0d3240 0x7f6adc1521d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53562/0 (socket says 172.21.15.18:53562) 2024-09-19T09:14:46.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.494+0000 7f6ae0c55640 1 -- 172.21.15.18:0/2043415201 learned_addr learned my addr 172.21.15.18:0/2043415201 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:46.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.494+0000 7f6ae1c57640 1 --2- 172.21.15.18:0/2043415201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6adc15ef50 0x7f6adc1f81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:46.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.494+0000 7f6ae1456640 1 --2- 172.21.15.18:0/2043415201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6adc0d1ab0 0x7f6adc1f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:46.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.494+0000 7f6ae0c55640 1 -- 172.21.15.18:0/2043415201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6adc0d1ab0 msgr2=0x7f6adc1f56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:46.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.494+0000 7f6ae0c55640 1 --2- 172.21.15.18:0/2043415201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6adc0d1ab0 0x7f6adc1f56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.494+0000 7f6ae0c55640 1 -- 172.21.15.18:0/2043415201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6adc15ef50 msgr2=0x7f6adc1f81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:46.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.494+0000 7f6ae0c55640 1 --2- 172.21.15.18:0/2043415201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6adc15ef50 0x7f6adc1f81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.494+0000 7f6ae0c55640 1 -- 172.21.15.18:0/2043415201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6adc1f4be0 con 0x7f6adc0d3240 2024-09-19T09:14:46.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.494+0000 7f6ae1c57640 1 --2- 172.21.15.18:0/2043415201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6adc15ef50 0x7f6adc1f81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:46.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.494+0000 7f6ae0c55640 1 --2- 172.21.15.18:0/2043415201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc0d3240 0x7f6adc1521d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6acc009890 tx=0x7f6acc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:46.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.494+0000 7f6ad1ffb640 1 -- 172.21.15.18:0/2043415201 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6acc037040 con 0x7f6adc0d3240 2024-09-19T09:14:46.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.494+0000 7f6ad1ffb640 1 -- 172.21.15.18:0/2043415201 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6acc042070 con 0x7f6adc0d3240 2024-09-19T09:14:46.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.494+0000 7f6ae36ba640 1 -- 172.21.15.18:0/2043415201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6adc1f8cd0 con 0x7f6adc0d3240 2024-09-19T09:14:46.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.494+0000 7f6ad1ffb640 1 -- 172.21.15.18:0/2043415201 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6acc030bd0 con 0x7f6adc0d3240 2024-09-19T09:14:46.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.495+0000 7f6ae36ba640 1 -- 172.21.15.18:0/2043415201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6adc1f4ea0 con 0x7f6adc0d3240 2024-09-19T09:14:46.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.495+0000 7f6ae36ba640 1 -- 172.21.15.18:0/2043415201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6adc0d13a0 con 0x7f6adc0d3240 2024-09-19T09:14:46.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.496+0000 7f6ad1ffb640 1 -- 172.21.15.18:0/2043415201 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6acc047460 con 0x7f6adc0d3240 2024-09-19T09:14:46.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.496+0000 7f6ad1ffb640 1 --2- 172.21.15.18:0/2043415201 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6ac006c2b0 0x7f6ac006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:46.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.497+0000 7f6ad1ffb640 1 -- 172.21.15.18:0/2043415201 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f6acc0ac020 con 0x7f6adc0d3240 2024-09-19T09:14:46.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.497+0000 7f6ae1456640 1 --2- 172.21.15.18:0/2043415201 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6ac006c2b0 0x7f6ac006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:46.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.497+0000 7f6ae1456640 1 --2- 172.21.15.18:0/2043415201 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6ac006c2b0 0x7f6ac006e770 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8000f60 tx=0x7f6ad8007c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:46.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.501+0000 7f6ad1ffb640 1 -- 172.21.15.18:0/2043415201 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6acc032e20 con 0x7f6adc0d3240 2024-09-19T09:14:46.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.677+0000 7f6ae36ba640 1 -- 172.21.15.18:0/2043415201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6adc06cd70 con 0x7f6adc0d3240 2024-09-19T09:14:46.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.678+0000 7f6ad1ffb640 1 -- 172.21.15.18:0/2043415201 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+16681 (secure 0 0 0) 0x7f6acc045360 con 0x7f6adc0d3240 2024-09-19T09:14:46.679 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:46.679 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":48,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:14:45.016527+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:14:41.948276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-19T09:14:42.341949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:14:46.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.680+0000 7f6ae36ba640 1 -- 172.21.15.18:0/2043415201 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6ac006c2b0 msgr2=0x7f6ac006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:46.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.680+0000 7f6ae36ba640 1 --2- 172.21.15.18:0/2043415201 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6ac006c2b0 0x7f6ac006e770 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8000f60 tx=0x7f6ad8007c00 comp rx=0 tx=0).stop 2024-09-19T09:14:46.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.680+0000 7f6ae36ba640 1 -- 172.21.15.18:0/2043415201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc0d3240 msgr2=0x7f6adc1521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:46.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.680+0000 7f6ae36ba640 1 --2- 172.21.15.18:0/2043415201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc0d3240 0x7f6adc1521d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6acc009890 tx=0x7f6acc0046c0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.680+0000 7f6ae36ba640 1 -- 172.21.15.18:0/2043415201 shutdown_connections 2024-09-19T09:14:46.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.680+0000 7f6ae36ba640 1 --2- 172.21.15.18:0/2043415201 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6ac006c2b0 0x7f6ac006e770 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.680+0000 7f6ae36ba640 1 --2- 172.21.15.18:0/2043415201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6adc15ef50 0x7f6adc1f81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.680+0000 7f6ae36ba640 1 --2- 172.21.15.18:0/2043415201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6adc0d3240 0x7f6adc1521d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.680+0000 7f6ae36ba640 1 --2- 172.21.15.18:0/2043415201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6adc0d1ab0 0x7f6adc1f56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.680+0000 7f6ae36ba640 1 -- 172.21.15.18:0/2043415201 >> 172.21.15.18:0/2043415201 conn(0x7f6adc0d4c60 msgr2=0x7f6adc0d5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:46.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.680+0000 7f6ae36ba640 1 -- 172.21.15.18:0/2043415201 shutdown_connections 2024-09-19T09:14:46.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.680+0000 7f6ae36ba640 1 -- 172.21.15.18:0/2043415201 wait complete. 2024-09-19T09:14:46.692 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T09:14:46.692 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:14:46.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.793+0000 7fcf00884640 1 Processor -- start 2024-09-19T09:14:46.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.793+0000 7fcf00884640 1 -- start start 2024-09-19T09:14:46.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.794+0000 7fcf00884640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcefc0d1ab0 0x7fcefc0b8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:46.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.794+0000 7fcf00884640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcefc0d3240 0x7fcefc0b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:46.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.794+0000 7fcf00884640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcefc0b7a90 con 0x7fcefc15ef50 2024-09-19T09:14:46.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.794+0000 7fcf00884640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fcefc0d3740 con 0x7fcefc0d1ab0 2024-09-19T09:14:46.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.794+0000 7fcf00884640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fcefc0d3a20 con 0x7fcefc0d3240 2024-09-19T09:14:46.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.794+0000 7fcef9d9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcefc0d1ab0 0x7fcefc0b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:46.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.794+0000 7fcef9d9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcefc0d1ab0 0x7fcefc0b8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53576/0 (socket says 172.21.15.18:53576) 2024-09-19T09:14:46.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.794+0000 7fcef9d9b640 1 -- 172.21.15.18:0/961728280 learned_addr learned my addr 172.21.15.18:0/961728280 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:46.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.795+0000 7fcefad9d640 1 --2- 172.21.15.18:0/961728280 >> v2:172.21.15.162:3300/0 conn(0x7fcefc0d3240 0x7fcefc0b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:46.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.795+0000 7fcef9d9b640 1 -- 172.21.15.18:0/961728280 >> v2:172.21.15.162:3300/0 conn(0x7fcefc0d3240 msgr2=0x7fcefc0b8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:46.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.795+0000 7fcef9d9b640 1 --2- 172.21.15.18:0/961728280 >> v2:172.21.15.162:3300/0 conn(0x7fcefc0d3240 0x7fcefc0b8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.795+0000 7fcef9d9b640 1 -- 172.21.15.18:0/961728280 >> v1:172.21.15.162:6789/0 conn(0x7fcefc15ef50 legacy=0x7fcefc0d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:46.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.795+0000 7fcef9d9b640 1 -- 172.21.15.18:0/961728280 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcefc0b7d00 con 0x7fcefc0d1ab0 2024-09-19T09:14:46.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.796+0000 7fcef9d9b640 1 --2- 172.21.15.18:0/961728280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcefc0d1ab0 0x7fcefc0b8500 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fcefc0b7760 tx=0x7fcee402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=690f0e8f12cf1658 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:46.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.796+0000 7fcef959a640 1 -- 172.21.15.18:0/961728280 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee4037070 con 0x7fcefc0d1ab0 2024-09-19T09:14:46.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.796+0000 7fcef959a640 1 -- 172.21.15.18:0/961728280 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcee4032440 con 0x7fcefc0d1ab0 2024-09-19T09:14:46.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.796+0000 7fcef959a640 1 -- 172.21.15.18:0/961728280 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee4032810 con 0x7fcefc0d1ab0 2024-09-19T09:14:46.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.796+0000 7fcf00884640 1 -- 172.21.15.18:0/961728280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcefc0d1ab0 msgr2=0x7fcefc0b8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:46.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.796+0000 7fcf00884640 1 --2- 172.21.15.18:0/961728280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcefc0d1ab0 0x7fcefc0b8500 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fcefc0b7760 tx=0x7fcee402a1a0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.796+0000 7fcf00884640 1 -- 172.21.15.18:0/961728280 shutdown_connections 2024-09-19T09:14:46.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.796+0000 7fcf00884640 1 --2- 172.21.15.18:0/961728280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcefc0d1ab0 0x7fcefc0b8500 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.796+0000 7fcf00884640 1 --2- 172.21.15.18:0/961728280 >> v2:172.21.15.162:3300/0 conn(0x7fcefc0d3240 0x7fcefc0b8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.796+0000 7fcf00884640 1 -- 172.21.15.18:0/961728280 >> 172.21.15.18:0/961728280 conn(0x7fcefc0d4c60 msgr2=0x7fcefc0d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:46.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.796+0000 7fcf00884640 1 -- 172.21.15.18:0/961728280 shutdown_connections 2024-09-19T09:14:46.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.796+0000 7fcf00884640 1 -- 172.21.15.18:0/961728280 wait complete. 2024-09-19T09:14:46.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.798+0000 7fcf00884640 1 Processor -- start 2024-09-19T09:14:46.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.798+0000 7fcf00884640 1 -- start start 2024-09-19T09:14:46.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.798+0000 7fcf00884640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcefc0d1ab0 0x7fcefc0c9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:46.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.798+0000 7fcf00884640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcefc0d3240 0x7fcefc14e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:46.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.798+0000 7fcf00884640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcefc15ef50 0x7fcefc0cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:46.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.798+0000 7fcf00884640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcefc0d21a0 con 0x7fcefc0d1ab0 2024-09-19T09:14:46.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.798+0000 7fcf00884640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcefc0d2020 con 0x7fcefc15ef50 2024-09-19T09:14:46.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.798+0000 7fcf00884640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcefc0d5780 con 0x7fcefc0d3240 2024-09-19T09:14:46.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.799+0000 7fcefa59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcefc0d1ab0 0x7fcefc0c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:46.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.799+0000 7fcefa59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcefc0d1ab0 0x7fcefc0c9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53578/0 (socket says 172.21.15.18:53578) 2024-09-19T09:14:46.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.799+0000 7fcefa59c640 1 -- 172.21.15.18:0/777957061 learned_addr learned my addr 172.21.15.18:0/777957061 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:46.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.799+0000 7fcef9d9b640 1 --2- 172.21.15.18:0/777957061 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcefc0d3240 0x7fcefc14e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:46.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.799+0000 7fcefad9d640 1 --2- 172.21.15.18:0/777957061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcefc15ef50 0x7fcefc0cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:46.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.799+0000 7fcefa59c640 1 -- 172.21.15.18:0/777957061 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcefc0d3240 msgr2=0x7fcefc14e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:46.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.799+0000 7fcefa59c640 1 --2- 172.21.15.18:0/777957061 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcefc0d3240 0x7fcefc14e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.799+0000 7fcefa59c640 1 -- 172.21.15.18:0/777957061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcefc15ef50 msgr2=0x7fcefc0cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:46.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.799+0000 7fcefa59c640 1 --2- 172.21.15.18:0/777957061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcefc15ef50 0x7fcefc0cbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.799+0000 7fcefa59c640 1 -- 172.21.15.18:0/777957061 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcefc0c9a00 con 0x7fcefc0d1ab0 2024-09-19T09:14:46.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.799+0000 7fcefa59c640 1 --2- 172.21.15.18:0/777957061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcefc0d1ab0 0x7fcefc0c9340 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fceec00ba50 tx=0x7fceec00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:46.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.799+0000 7fcef2ffd640 1 -- 172.21.15.18:0/777957061 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceec019070 con 0x7fcefc0d1ab0 2024-09-19T09:14:46.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.799+0000 7fcef2ffd640 1 -- 172.21.15.18:0/777957061 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceec00cc20 con 0x7fcefc0d1ab0 2024-09-19T09:14:46.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.799+0000 7fcf00884640 1 -- 172.21.15.18:0/777957061 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcefc0c9ce0 con 0x7fcefc0d1ab0 2024-09-19T09:14:46.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.799+0000 7fcef2ffd640 1 -- 172.21.15.18:0/777957061 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceec014680 con 0x7fcefc0d1ab0 2024-09-19T09:14:46.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.799+0000 7fcf00884640 1 -- 172.21.15.18:0/777957061 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcefc0ca2a0 con 0x7fcefc0d1ab0 2024-09-19T09:14:46.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.800+0000 7fcf00884640 1 -- 172.21.15.18:0/777957061 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcefc0d13a0 con 0x7fcefc0d1ab0 2024-09-19T09:14:46.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.801+0000 7fcef2ffd640 1 -- 172.21.15.18:0/777957061 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fceec01c070 con 0x7fcefc0d1ab0 2024-09-19T09:14:46.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.801+0000 7fcef2ffd640 1 --2- 172.21.15.18:0/777957061 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcedc06c2b0 0x7fcedc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:46.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.801+0000 7fcef2ffd640 1 -- 172.21.15.18:0/777957061 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7fceec08b2a0 con 0x7fcefc0d1ab0 2024-09-19T09:14:46.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.802+0000 7fcef9d9b640 1 --2- 172.21.15.18:0/777957061 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcedc06c2b0 0x7fcedc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:46.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.802+0000 7fcef9d9b640 1 --2- 172.21.15.18:0/777957061 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcedc06c2b0 0x7fcedc06e770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcee4034000 tx=0x7fcee402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:46.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.806+0000 7fcef2ffd640 1 -- 172.21.15.18:0/777957061 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fceec059290 con 0x7fcefc0d1ab0 2024-09-19T09:14:46.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.976+0000 7fcf00884640 1 -- 172.21.15.18:0/777957061 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcefc0d44a0 con 0x7fcedc06c2b0 2024-09-19T09:14:46.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.982+0000 7fcef2ffd640 1 -- 172.21.15.18:0/777957061 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+236285 (secure 0 0 0) 0x7fcee40326a0 con 0x7fcedc06c2b0 2024-09-19T09:14:46.986 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:46.988 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:14:46.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.985+0000 7fcf00884640 1 -- 172.21.15.18:0/777957061 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcedc06c2b0 msgr2=0x7fcedc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:46.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.985+0000 7fcf00884640 1 --2- 172.21.15.18:0/777957061 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcedc06c2b0 0x7fcedc06e770 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcee4034000 tx=0x7fcee402e000 comp rx=0 tx=0).stop 2024-09-19T09:14:46.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.985+0000 7fcf00884640 1 -- 172.21.15.18:0/777957061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcefc0d1ab0 msgr2=0x7fcefc0c9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:46.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.985+0000 7fcf00884640 1 --2- 172.21.15.18:0/777957061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcefc0d1ab0 0x7fcefc0c9340 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fceec00ba50 tx=0x7fceec00bf10 comp rx=0 tx=0).stop 2024-09-19T09:14:46.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.985+0000 7fcf00884640 1 -- 172.21.15.18:0/777957061 shutdown_connections 2024-09-19T09:14:46.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.985+0000 7fcf00884640 1 --2- 172.21.15.18:0/777957061 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcedc06c2b0 0x7fcedc06e770 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.985+0000 7fcf00884640 1 --2- 172.21.15.18:0/777957061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcefc15ef50 0x7fcefc0cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.985+0000 7fcf00884640 1 --2- 172.21.15.18:0/777957061 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcefc0d3240 0x7fcefc14e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.985+0000 7fcf00884640 1 --2- 172.21.15.18:0/777957061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcefc0d1ab0 0x7fcefc0c9340 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:46.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.985+0000 7fcf00884640 1 -- 172.21.15.18:0/777957061 >> 172.21.15.18:0/777957061 conn(0x7fcefc0d4c60 msgr2=0x7fcefc0cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:46.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.985+0000 7fcf00884640 1 -- 172.21.15.18:0/777957061 shutdown_connections 2024-09-19T09:14:46.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:46.985+0000 7fcf00884640 1 -- 172.21.15.18:0/777957061 wait complete. 2024-09-19T09:14:46.997 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2024-09-19T09:14:45.541248+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2746,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559753,"statfs":{"total":1600000000,"available":1597187444,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000765"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":212,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-19T09:14:40.987366+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:14:40.987366+0000","last_peered":"2024-09-19T09:14:40.987366+0000","last_clean":"2024-09-19T09:14:40.987366+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:14:40.987366+0000","last_undegraded":"2024-09-19T09:14:40.987366+0000","last_fullsized":"2024-09-19T09:14:40.987366+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:22.478151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195115,"statfs":{"total":200000000,"available":199798586,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":201,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195110,"statfs":{"total":200000000,"available":199793459,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":778,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194534,"statfs":{"total":200000000,"available":199203091,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195115,"statfs":{"total":200000000,"available":199798586,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195115,"statfs":{"total":200000000,"available":199798586,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":201,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195110,"statfs":{"total":200000000,"available":199793459,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":778,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194534,"statfs":{"total":200000000,"available":199203091,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195115,"statfs":{"total":200000000,"available":199798586,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:14:47.002 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:14:47.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.139+0000 7f768a0a4640 1 Processor -- start 2024-09-19T09:14:47.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.139+0000 7f768a0a4640 1 -- start start 2024-09-19T09:14:47.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.140+0000 7f768a0a4640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f768415ed50 0x7f76840d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:47.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.140+0000 7f768a0a4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f76840d09d0 0x7f76840b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:47.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.140+0000 7f768a0a4640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76840d31b0 con 0x7f76840d1aa0 2024-09-19T09:14:47.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.140+0000 7f768a0a4640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f76840d1ee0 con 0x7f76840d09d0 2024-09-19T09:14:47.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.140+0000 7f768a0a4640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f76840d3490 con 0x7f768415ed50 2024-09-19T09:14:47.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.140+0000 7f7683fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f76840d09d0 0x7f76840b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:47.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.140+0000 7f7683fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f76840d09d0 0x7f76840b5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53588/0 (socket says 172.21.15.18:53588) 2024-09-19T09:14:47.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.140+0000 7f7683fff640 1 -- 172.21.15.18:0/2783166904 learned_addr learned my addr 172.21.15.18:0/2783166904 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:47.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.140+0000 7f76837fe640 1 --2- 172.21.15.18:0/2783166904 >> v2:172.21.15.162:3300/0 conn(0x7f768415ed50 0x7f76840d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:47.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.140+0000 7f7683fff640 1 -- 172.21.15.18:0/2783166904 >> v2:172.21.15.162:3300/0 conn(0x7f768415ed50 msgr2=0x7f76840d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:47.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.140+0000 7f7683fff640 1 --2- 172.21.15.18:0/2783166904 >> v2:172.21.15.162:3300/0 conn(0x7f768415ed50 0x7f76840d1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.140+0000 7f7683fff640 1 -- 172.21.15.18:0/2783166904 >> v1:172.21.15.162:6789/0 conn(0x7f76840d1aa0 legacy=0x7f76840b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:47.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.140+0000 7f7683fff640 1 -- 172.21.15.18:0/2783166904 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76840d3770 con 0x7f76840d09d0 2024-09-19T09:14:47.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.140+0000 7f76837fe640 1 --2- 172.21.15.18:0/2783166904 >> v2:172.21.15.162:3300/0 conn(0x7f768415ed50 0x7f76840d1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:47.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.141+0000 7f7683fff640 1 --2- 172.21.15.18:0/2783166904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76840d09d0 0x7f76840b5200 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f76840d5cd0 tx=0x7f767c02a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd5296c7fd0cca7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:47.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.141+0000 7f76827fc640 1 -- 172.21.15.18:0/2783166904 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c036070 con 0x7f76840d09d0 2024-09-19T09:14:47.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.141+0000 7f76827fc640 1 -- 172.21.15.18:0/2783166904 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f767c031600 con 0x7f76840d09d0 2024-09-19T09:14:47.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.141+0000 7f76827fc640 1 -- 172.21.15.18:0/2783166904 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c0319f0 con 0x7f76840d09d0 2024-09-19T09:14:47.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.142+0000 7f768a0a4640 1 -- 172.21.15.18:0/2783166904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76840d09d0 msgr2=0x7f76840b5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:47.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.142+0000 7f768a0a4640 1 --2- 172.21.15.18:0/2783166904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76840d09d0 0x7f76840b5200 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f76840d5cd0 tx=0x7f767c02a7c0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.142+0000 7f768a0a4640 1 -- 172.21.15.18:0/2783166904 shutdown_connections 2024-09-19T09:14:47.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.142+0000 7f768a0a4640 1 --2- 172.21.15.18:0/2783166904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f76840d09d0 0x7f76840b5200 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.142+0000 7f768a0a4640 1 --2- 172.21.15.18:0/2783166904 >> v2:172.21.15.162:3300/0 conn(0x7f768415ed50 0x7f76840d1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.142+0000 7f768a0a4640 1 -- 172.21.15.18:0/2783166904 >> 172.21.15.18:0/2783166904 conn(0x7f76840d4bd0 msgr2=0x7f76840d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:47.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.142+0000 7f768a0a4640 1 -- 172.21.15.18:0/2783166904 shutdown_connections 2024-09-19T09:14:47.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.142+0000 7f768a0a4640 1 -- 172.21.15.18:0/2783166904 wait complete. 2024-09-19T09:14:47.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.143+0000 7f768a0a4640 1 Processor -- start 2024-09-19T09:14:47.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.143+0000 7f768a0a4640 1 -- start start 2024-09-19T09:14:47.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.144+0000 7f768a0a4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76840d09d0 0x7f76840ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:47.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.144+0000 7f768a0a4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76840d1aa0 0x7f768415fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:47.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.144+0000 7f768a0a4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f768415ed50 0x7f76841f7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:47.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.144+0000 7f768a0a4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f76840d3d30 con 0x7f768415ed50 2024-09-19T09:14:47.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.144+0000 7f768a0a4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f76840b45d0 con 0x7f76840d1aa0 2024-09-19T09:14:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.144+0000 7f768a0a4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f768415f130 con 0x7f76840d09d0 2024-09-19T09:14:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.144+0000 7f7683fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f768415ed50 0x7f76841f7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.144+0000 7f7683fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f768415ed50 0x7f76841f7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53600/0 (socket says 172.21.15.18:53600) 2024-09-19T09:14:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.144+0000 7f7683fff640 1 -- 172.21.15.18:0/4097000592 learned_addr learned my addr 172.21.15.18:0/4097000592 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.144+0000 7f76837fe640 1 --2- 172.21.15.18:0/4097000592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76840d09d0 0x7f76840ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.144+0000 7f7682ffd640 1 --2- 172.21.15.18:0/4097000592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76840d1aa0 0x7f768415fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.144+0000 7f7683fff640 1 -- 172.21.15.18:0/4097000592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76840d09d0 msgr2=0x7f76840ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.144+0000 7f7683fff640 1 --2- 172.21.15.18:0/4097000592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76840d09d0 0x7f76840ccc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.144+0000 7f7683fff640 1 -- 172.21.15.18:0/4097000592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76840d1aa0 msgr2=0x7f768415fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.144+0000 7f7683fff640 1 --2- 172.21.15.18:0/4097000592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76840d1aa0 0x7f768415fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.144+0000 7f7683fff640 1 -- 172.21.15.18:0/4097000592 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76841605e0 con 0x7f768415ed50 2024-09-19T09:14:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.144+0000 7f76837fe640 1 --2- 172.21.15.18:0/4097000592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76840d09d0 0x7f76840ccc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:47.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.144+0000 7f7683fff640 1 --2- 172.21.15.18:0/4097000592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f768415ed50 0x7f76841f7fb0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f767c02a800 tx=0x7f767c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:47.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.145+0000 7f766bfff640 1 -- 172.21.15.18:0/4097000592 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c036050 con 0x7f768415ed50 2024-09-19T09:14:47.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.145+0000 7f766bfff640 1 -- 172.21.15.18:0/4097000592 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f767c042070 con 0x7f768415ed50 2024-09-19T09:14:47.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.145+0000 7f768a0a4640 1 -- 172.21.15.18:0/4097000592 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76840b7a80 con 0x7f768415ed50 2024-09-19T09:14:47.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.145+0000 7f766bfff640 1 -- 172.21.15.18:0/4097000592 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c009510 con 0x7f768415ed50 2024-09-19T09:14:47.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.145+0000 7f768a0a4640 1 -- 172.21.15.18:0/4097000592 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76840b82c0 con 0x7f768415ed50 2024-09-19T09:14:47.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.146+0000 7f768a0a4640 1 -- 172.21.15.18:0/4097000592 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76840d1100 con 0x7f768415ed50 2024-09-19T09:14:47.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.146+0000 7f766bfff640 1 -- 172.21.15.18:0/4097000592 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f767c004450 con 0x7f768415ed50 2024-09-19T09:14:47.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.147+0000 7f766bfff640 1 --2- 172.21.15.18:0/4097000592 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f767006c2b0 0x7f767006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:47.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.147+0000 7f766bfff640 1 -- 172.21.15.18:0/4097000592 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f767c0ac310 con 0x7f768415ed50 2024-09-19T09:14:47.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.147+0000 7f76837fe640 1 --2- 172.21.15.18:0/4097000592 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f767006c2b0 0x7f767006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:47.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.147+0000 7f76837fe640 1 --2- 172.21.15.18:0/4097000592 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f767006c2b0 0x7f767006e770 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7674006fd0 tx=0x7f7674008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:47.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.151+0000 7f766bfff640 1 -- 172.21.15.18:0/4097000592 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f76840d1100 con 0x7f768415ed50 2024-09-19T09:14:47.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.322+0000 7f768a0a4640 1 -- 172.21.15.18:0/4097000592 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7684160350 con 0x7f767006c2b0 2024-09-19T09:14:47.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.329+0000 7f766bfff640 1 -- 172.21.15.18:0/4097000592 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+236285 (secure 0 0 0) 0x7f7684160350 con 0x7f767006c2b0 2024-09-19T09:14:47.331 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:47.333 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:14:47.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.331+0000 7f768a0a4640 1 -- 172.21.15.18:0/4097000592 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f767006c2b0 msgr2=0x7f767006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:47.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.331+0000 7f768a0a4640 1 --2- 172.21.15.18:0/4097000592 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f767006c2b0 0x7f767006e770 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7674006fd0 tx=0x7f7674008040 comp rx=0 tx=0).stop 2024-09-19T09:14:47.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.331+0000 7f768a0a4640 1 -- 172.21.15.18:0/4097000592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f768415ed50 msgr2=0x7f76841f7fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:47.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.331+0000 7f768a0a4640 1 --2- 172.21.15.18:0/4097000592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f768415ed50 0x7f76841f7fb0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f767c02a800 tx=0x7f767c004a40 comp rx=0 tx=0).stop 2024-09-19T09:14:47.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.331+0000 7f768a0a4640 1 -- 172.21.15.18:0/4097000592 shutdown_connections 2024-09-19T09:14:47.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.331+0000 7f768a0a4640 1 --2- 172.21.15.18:0/4097000592 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f767006c2b0 0x7f767006e770 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.331+0000 7f768a0a4640 1 --2- 172.21.15.18:0/4097000592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f768415ed50 0x7f76841f7fb0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.331+0000 7f768a0a4640 1 --2- 172.21.15.18:0/4097000592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f76840d1aa0 0x7f768415fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.331+0000 7f768a0a4640 1 --2- 172.21.15.18:0/4097000592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f76840d09d0 0x7f76840ccc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.331+0000 7f768a0a4640 1 -- 172.21.15.18:0/4097000592 >> 172.21.15.18:0/4097000592 conn(0x7f76840d4bd0 msgr2=0x7f76840b2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:47.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.331+0000 7f768a0a4640 1 -- 172.21.15.18:0/4097000592 shutdown_connections 2024-09-19T09:14:47.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.331+0000 7f768a0a4640 1 -- 172.21.15.18:0/4097000592 wait complete. 2024-09-19T09:14:47.343 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2024-09-19T09:14:45.541248+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2746,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559753,"statfs":{"total":1600000000,"available":1597187444,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000765"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:43.000294+0000","last_change":"2024-09-19T09:14:43.000294+0000","last_active":"2024-09-19T09:14:43.000294+0000","last_peered":"2024-09-19T09:14:43.000294+0000","last_clean":"2024-09-19T09:14:43.000294+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:43.000294+0000","last_undegraded":"2024-09-19T09:14:43.000294+0000","last_fullsized":"2024-09-19T09:14:43.000294+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:14:41.998448+0000","last_change":"2024-09-19T09:14:41.998448+0000","last_active":"2024-09-19T09:14:41.998448+0000","last_peered":"2024-09-19T09:14:41.998448+0000","last_clean":"2024-09-19T09:14:41.998448+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:14:41.998448+0000","last_undegraded":"2024-09-19T09:14:41.998448+0000","last_fullsized":"2024-09-19T09:14:41.998448+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":212,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-19T09:14:40.987366+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:14:40.987366+0000","last_peered":"2024-09-19T09:14:40.987366+0000","last_clean":"2024-09-19T09:14:40.987366+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:14:40.987366+0000","last_undegraded":"2024-09-19T09:14:40.987366+0000","last_fullsized":"2024-09-19T09:14:40.987366+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:22.478151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195115,"statfs":{"total":200000000,"available":199798586,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":201,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195110,"statfs":{"total":200000000,"available":199793459,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":778,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194534,"statfs":{"total":200000000,"available":199203091,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195115,"statfs":{"total":200000000,"available":199798586,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195115,"statfs":{"total":200000000,"available":199798586,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":201,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195110,"statfs":{"total":200000000,"available":199793459,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":778,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194534,"statfs":{"total":200000000,"available":199203091,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195115,"statfs":{"total":200000000,"available":199798586,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:14:47.346 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:14:47.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.486+0000 7ff40932a640 1 Processor -- start 2024-09-19T09:14:47.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.486+0000 7ff40932a640 1 -- start start 2024-09-19T09:14:47.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.486+0000 7ff40932a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff40415ef80 0x7ff4040b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:47.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.486+0000 7ff40932a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff40406d730 0x7ff4040cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:47.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.486+0000 7ff40932a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4040cf910 0x7ff4040d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:47.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.486+0000 7ff40932a640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7ff4040cd7d0 con 0x7ff40415ef80 2024-09-19T09:14:47.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.486+0000 7ff40932a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff4040cd1a0 con 0x7ff40406d730 2024-09-19T09:14:47.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.486+0000 7ff40932a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff40406dc30 con 0x7ff4040cf910 2024-09-19T09:14:47.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.487+0000 7ff402ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff40415ef80 0x7ff4040b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:47.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.487+0000 7ff402ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff40415ef80 0x7ff4040b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53606/0 (socket says 172.21.15.18:53606) 2024-09-19T09:14:47.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.487+0000 7ff402ffd640 1 -- 172.21.15.18:0/1645872427 learned_addr learned my addr 172.21.15.18:0/1645872427 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:47.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.487+0000 7ff4037fe640 1 --2- 172.21.15.18:0/1645872427 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4040cf910 0x7ff4040d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:47.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.487+0000 7ff4027fc640 1 --2- 172.21.15.18:0/1645872427 >> v2:172.21.15.162:3300/0 conn(0x7ff40406d730 0x7ff4040cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:47.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.487+0000 7ff402ffd640 1 -- 172.21.15.18:0/1645872427 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4040cf910 msgr2=0x7ff4040d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:47.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.487+0000 7ff402ffd640 1 --2- 172.21.15.18:0/1645872427 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4040cf910 0x7ff4040d0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.487+0000 7ff402ffd640 1 -- 172.21.15.18:0/1645872427 >> v2:172.21.15.162:3300/0 conn(0x7ff40406d730 msgr2=0x7ff4040cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:47.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.487+0000 7ff402ffd640 1 --2- 172.21.15.18:0/1645872427 >> v2:172.21.15.162:3300/0 conn(0x7ff40406d730 0x7ff4040cf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.487+0000 7ff402ffd640 1 -- 172.21.15.18:0/1645872427 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff40406df10 con 0x7ff40415ef80 2024-09-19T09:14:47.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.488+0000 7ff402ffd640 1 --2- 172.21.15.18:0/1645872427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff40415ef80 0x7ff4040b5220 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff4040b57c0 tx=0x7ff3fc02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5671db57c028ceb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:47.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.488+0000 7ff401ffb640 1 -- 172.21.15.18:0/1645872427 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc036070 con 0x7ff40415ef80 2024-09-19T09:14:47.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.488+0000 7ff401ffb640 1 -- 172.21.15.18:0/1645872427 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3fc031600 con 0x7ff40415ef80 2024-09-19T09:14:47.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.488+0000 7ff401ffb640 1 -- 172.21.15.18:0/1645872427 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc0319d0 con 0x7ff40415ef80 2024-09-19T09:14:47.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.488+0000 7ff40932a640 1 -- 172.21.15.18:0/1645872427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff40415ef80 msgr2=0x7ff4040b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:47.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.488+0000 7ff40932a640 1 --2- 172.21.15.18:0/1645872427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff40415ef80 0x7ff4040b5220 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff4040b57c0 tx=0x7ff3fc02a6a0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.488+0000 7ff40932a640 1 -- 172.21.15.18:0/1645872427 shutdown_connections 2024-09-19T09:14:47.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.488+0000 7ff40932a640 1 --2- 172.21.15.18:0/1645872427 >> v2:172.21.15.162:3300/0 conn(0x7ff40406d730 0x7ff4040cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.488+0000 7ff40932a640 1 --2- 172.21.15.18:0/1645872427 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4040cf910 0x7ff4040d0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.488+0000 7ff40932a640 1 --2- 172.21.15.18:0/1645872427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff40415ef80 0x7ff4040b5220 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.488+0000 7ff40932a640 1 -- 172.21.15.18:0/1645872427 >> 172.21.15.18:0/1645872427 conn(0x7ff4040b4700 msgr2=0x7ff4040b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:47.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.488+0000 7ff40932a640 1 -- 172.21.15.18:0/1645872427 shutdown_connections 2024-09-19T09:14:47.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.488+0000 7ff40932a640 1 -- 172.21.15.18:0/1645872427 wait complete. 2024-09-19T09:14:47.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.490+0000 7ff40932a640 1 Processor -- start 2024-09-19T09:14:47.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.490+0000 7ff40932a640 1 -- start start 2024-09-19T09:14:47.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.491+0000 7ff40932a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff40406d730 0x7ff404158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:47.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.491+0000 7ff40932a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4040cf910 0x7ff40415c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:47.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.491+0000 7ff40932a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff40415ef80 0x7ff4040b7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:47.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.491+0000 7ff40932a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff4040d0120 con 0x7ff40406d730 2024-09-19T09:14:47.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.491+0000 7ff40932a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff40415f360 con 0x7ff40415ef80 2024-09-19T09:14:47.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.491+0000 7ff40932a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff4040d1220 con 0x7ff4040cf910 2024-09-19T09:14:47.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.491+0000 7ff402ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff40406d730 0x7ff404158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:47.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.491+0000 7ff402ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff40406d730 0x7ff404158be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53612/0 (socket says 172.21.15.18:53612) 2024-09-19T09:14:47.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.491+0000 7ff402ffd640 1 -- 172.21.15.18:0/2016923264 learned_addr learned my addr 172.21.15.18:0/2016923264 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:47.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.491+0000 7ff4027fc640 1 --2- 172.21.15.18:0/2016923264 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4040cf910 0x7ff40415c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:47.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.491+0000 7ff4037fe640 1 --2- 172.21.15.18:0/2016923264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff40415ef80 0x7ff4040b7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:47.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.491+0000 7ff402ffd640 1 -- 172.21.15.18:0/2016923264 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4040cf910 msgr2=0x7ff40415c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:47.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.491+0000 7ff402ffd640 1 --2- 172.21.15.18:0/2016923264 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4040cf910 0x7ff40415c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.491+0000 7ff402ffd640 1 -- 172.21.15.18:0/2016923264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff40415ef80 msgr2=0x7ff4040b7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:47.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.491+0000 7ff402ffd640 1 --2- 172.21.15.18:0/2016923264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff40415ef80 0x7ff4040b7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.491+0000 7ff402ffd640 1 -- 172.21.15.18:0/2016923264 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff40415ad80 con 0x7ff40406d730 2024-09-19T09:14:47.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.491+0000 7ff4027fc640 1 --2- 172.21.15.18:0/2016923264 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4040cf910 0x7ff40415c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:47.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.491+0000 7ff4037fe640 1 --2- 172.21.15.18:0/2016923264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff40415ef80 0x7ff4040b7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:47.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.491+0000 7ff402ffd640 1 --2- 172.21.15.18:0/2016923264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff40406d730 0x7ff404158be0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc009e20 tx=0x7ff3fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:47.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.491+0000 7ff3fb7fe640 1 -- 172.21.15.18:0/2016923264 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc036050 con 0x7ff40406d730 2024-09-19T09:14:47.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.491+0000 7ff3fb7fe640 1 -- 172.21.15.18:0/2016923264 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3fc042070 con 0x7ff40406d730 2024-09-19T09:14:47.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.491+0000 7ff40932a640 1 -- 172.21.15.18:0/2016923264 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff40415b060 con 0x7ff40406d730 2024-09-19T09:14:47.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.491+0000 7ff3fb7fe640 1 -- 172.21.15.18:0/2016923264 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc009510 con 0x7ff40406d730 2024-09-19T09:14:47.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.491+0000 7ff40932a640 1 -- 172.21.15.18:0/2016923264 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4040cb4c0 con 0x7ff40406d730 2024-09-19T09:14:47.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.492+0000 7ff40932a640 1 -- 172.21.15.18:0/2016923264 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4040d0ce0 con 0x7ff40406d730 2024-09-19T09:14:47.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.493+0000 7ff3fb7fe640 1 -- 172.21.15.18:0/2016923264 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff3fc007c30 con 0x7ff40406d730 2024-09-19T09:14:47.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.493+0000 7ff3fb7fe640 1 --2- 172.21.15.18:0/2016923264 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff3e406c2b0 0x7ff3e406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:47.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.494+0000 7ff3fb7fe640 1 -- 172.21.15.18:0/2016923264 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7ff3fc0ac310 con 0x7ff40406d730 2024-09-19T09:14:47.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.494+0000 7ff4027fc640 1 --2- 172.21.15.18:0/2016923264 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff3e406c2b0 0x7ff3e406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:47.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.494+0000 7ff4027fc640 1 --2- 172.21.15.18:0/2016923264 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff3e406c2b0 0x7ff3e406e770 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff4041626a0 tx=0x7ff3ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:47.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.498+0000 7ff3fb7fe640 1 -- 172.21.15.18:0/2016923264 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff3fc045360 con 0x7ff40406d730 2024-09-19T09:14:47.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.670+0000 7ff40932a640 1 -- 172.21.15.18:0/2016923264 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff4040cff00 con 0x7ff3e406c2b0 2024-09-19T09:14:47.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.676+0000 7ff3fb7fe640 1 -- 172.21.15.18:0/2016923264 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247491 (secure 0 0 0) 0x7ff4040cff00 con 0x7ff3e406c2b0 2024-09-19T09:14:47.679 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:47.681 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:14:47.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.679+0000 7ff40932a640 1 -- 172.21.15.18:0/2016923264 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff3e406c2b0 msgr2=0x7ff3e406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:47.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.679+0000 7ff40932a640 1 --2- 172.21.15.18:0/2016923264 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff3e406c2b0 0x7ff3e406e770 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff4041626a0 tx=0x7ff3ec008040 comp rx=0 tx=0).stop 2024-09-19T09:14:47.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.679+0000 7ff40932a640 1 -- 172.21.15.18:0/2016923264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff40406d730 msgr2=0x7ff404158be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:47.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.679+0000 7ff40932a640 1 --2- 172.21.15.18:0/2016923264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff40406d730 0x7ff404158be0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc009e20 tx=0x7ff3fc004a40 comp rx=0 tx=0).stop 2024-09-19T09:14:47.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.680+0000 7ff40932a640 1 -- 172.21.15.18:0/2016923264 shutdown_connections 2024-09-19T09:14:47.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.680+0000 7ff40932a640 1 --2- 172.21.15.18:0/2016923264 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff3e406c2b0 0x7ff3e406e770 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.680+0000 7ff40932a640 1 --2- 172.21.15.18:0/2016923264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff40415ef80 0x7ff4040b7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.680+0000 7ff40932a640 1 --2- 172.21.15.18:0/2016923264 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4040cf910 0x7ff40415c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.680+0000 7ff40932a640 1 --2- 172.21.15.18:0/2016923264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff40406d730 0x7ff404158be0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.680+0000 7ff40932a640 1 -- 172.21.15.18:0/2016923264 >> 172.21.15.18:0/2016923264 conn(0x7ff4040b4700 msgr2=0x7ff4040b4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:47.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.680+0000 7ff40932a640 1 -- 172.21.15.18:0/2016923264 shutdown_connections 2024-09-19T09:14:47.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.680+0000 7ff40932a640 1 -- 172.21.15.18:0/2016923264 wait complete. 2024-09-19T09:14:47.691 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2024-09-19T09:14:47.541567+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2961,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559538,"statfs":{"total":1600000000,"available":1596967080,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.541156"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.855751+0000","last_change":"2024-09-19T09:14:44.029278+0000","last_active":"2024-09-19T09:14:45.855751+0000","last_peered":"2024-09-19T09:14:45.855751+0000","last_clean":"2024-09-19T09:14:45.855751+0000","last_became_active":"2024-09-19T09:14:44.028929+0000","last_became_peered":"2024-09-19T09:14:44.028929+0000","last_unstale":"2024-09-19T09:14:45.855751+0000","last_undegraded":"2024-09-19T09:14:45.855751+0000","last_fullsized":"2024-09-19T09:14:45.855751+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:09.289159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023364+0000","last_change":"2024-09-19T09:14:44.023434+0000","last_active":"2024-09-19T09:14:45.023364+0000","last_peered":"2024-09-19T09:14:45.023364+0000","last_clean":"2024-09-19T09:14:45.023364+0000","last_became_active":"2024-09-19T09:14:44.023158+0000","last_became_peered":"2024-09-19T09:14:44.023158+0000","last_unstale":"2024-09-19T09:14:45.023364+0000","last_undegraded":"2024-09-19T09:14:45.023364+0000","last_fullsized":"2024-09-19T09:14:45.023364+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:23.119386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023818+0000","last_change":"2024-09-19T09:14:44.026325+0000","last_active":"2024-09-19T09:14:45.023818+0000","last_peered":"2024-09-19T09:14:45.023818+0000","last_clean":"2024-09-19T09:14:45.023818+0000","last_became_active":"2024-09-19T09:14:44.026012+0000","last_became_peered":"2024-09-19T09:14:44.026012+0000","last_unstale":"2024-09-19T09:14:45.023818+0000","last_undegraded":"2024-09-19T09:14:45.023818+0000","last_fullsized":"2024-09-19T09:14:45.023818+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:13.259685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025616+0000","last_change":"2024-09-19T09:14:44.019374+0000","last_active":"2024-09-19T09:14:45.025616+0000","last_peered":"2024-09-19T09:14:45.025616+0000","last_clean":"2024-09-19T09:14:45.025616+0000","last_became_active":"2024-09-19T09:14:44.018900+0000","last_became_peered":"2024-09-19T09:14:44.018900+0000","last_unstale":"2024-09-19T09:14:45.025616+0000","last_undegraded":"2024-09-19T09:14:45.025616+0000","last_fullsized":"2024-09-19T09:14:45.025616+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:10:19.362096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.855697+0000","last_change":"2024-09-19T09:14:44.016835+0000","last_active":"2024-09-19T09:14:45.855697+0000","last_peered":"2024-09-19T09:14:45.855697+0000","last_clean":"2024-09-19T09:14:45.855697+0000","last_became_active":"2024-09-19T09:14:44.016574+0000","last_became_peered":"2024-09-19T09:14:44.016574+0000","last_unstale":"2024-09-19T09:14:45.855697+0000","last_undegraded":"2024-09-19T09:14:45.855697+0000","last_fullsized":"2024-09-19T09:14:45.855697+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:47.901790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579564+0000","last_change":"2024-09-19T09:14:44.015759+0000","last_active":"2024-09-19T09:14:45.579564+0000","last_peered":"2024-09-19T09:14:45.579564+0000","last_clean":"2024-09-19T09:14:45.579564+0000","last_became_active":"2024-09-19T09:14:44.015212+0000","last_became_peered":"2024-09-19T09:14:44.015212+0000","last_unstale":"2024-09-19T09:14:45.579564+0000","last_undegraded":"2024-09-19T09:14:45.579564+0000","last_fullsized":"2024-09-19T09:14:45.579564+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:08.971150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.026921+0000","last_change":"2024-09-19T09:14:44.021729+0000","last_active":"2024-09-19T09:14:45.026921+0000","last_peered":"2024-09-19T09:14:45.026921+0000","last_clean":"2024-09-19T09:14:45.026921+0000","last_became_active":"2024-09-19T09:14:44.020854+0000","last_became_peered":"2024-09-19T09:14:44.020854+0000","last_unstale":"2024-09-19T09:14:45.026921+0000","last_undegraded":"2024-09-19T09:14:45.026921+0000","last_fullsized":"2024-09-19T09:14:45.026921+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:57.512333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025457+0000","last_change":"2024-09-19T09:14:44.019723+0000","last_active":"2024-09-19T09:14:45.025457+0000","last_peered":"2024-09-19T09:14:45.025457+0000","last_clean":"2024-09-19T09:14:45.025457+0000","last_became_active":"2024-09-19T09:14:44.018191+0000","last_became_peered":"2024-09-19T09:14:44.018191+0000","last_unstale":"2024-09-19T09:14:45.025457+0000","last_undegraded":"2024-09-19T09:14:45.025457+0000","last_fullsized":"2024-09-19T09:14:45.025457+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:16.158285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579413+0000","last_change":"2024-09-19T09:14:44.026530+0000","last_active":"2024-09-19T09:14:45.579413+0000","last_peered":"2024-09-19T09:14:45.579413+0000","last_clean":"2024-09-19T09:14:45.579413+0000","last_became_active":"2024-09-19T09:14:44.026301+0000","last_became_peered":"2024-09-19T09:14:44.026301+0000","last_unstale":"2024-09-19T09:14:45.579413+0000","last_undegraded":"2024-09-19T09:14:45.579413+0000","last_fullsized":"2024-09-19T09:14:45.579413+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:46.873170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.380606+0000","last_change":"2024-09-19T09:14:44.023745+0000","last_active":"2024-09-19T09:14:45.380606+0000","last_peered":"2024-09-19T09:14:45.380606+0000","last_clean":"2024-09-19T09:14:45.380606+0000","last_became_active":"2024-09-19T09:14:44.022892+0000","last_became_peered":"2024-09-19T09:14:44.022892+0000","last_unstale":"2024-09-19T09:14:45.380606+0000","last_undegraded":"2024-09-19T09:14:45.380606+0000","last_fullsized":"2024-09-19T09:14:45.380606+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:36.520416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025550+0000","last_change":"2024-09-19T09:14:44.016533+0000","last_active":"2024-09-19T09:14:45.025550+0000","last_peered":"2024-09-19T09:14:45.025550+0000","last_clean":"2024-09-19T09:14:45.025550+0000","last_became_active":"2024-09-19T09:14:44.016289+0000","last_became_peered":"2024-09-19T09:14:44.016289+0000","last_unstale":"2024-09-19T09:14:45.025550+0000","last_undegraded":"2024-09-19T09:14:45.025550+0000","last_fullsized":"2024-09-19T09:14:45.025550+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:05.136039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023495+0000","last_change":"2024-09-19T09:14:44.021440+0000","last_active":"2024-09-19T09:14:45.023495+0000","last_peered":"2024-09-19T09:14:45.023495+0000","last_clean":"2024-09-19T09:14:45.023495+0000","last_became_active":"2024-09-19T09:14:44.020755+0000","last_became_peered":"2024-09-19T09:14:44.020755+0000","last_unstale":"2024-09-19T09:14:45.023495+0000","last_undegraded":"2024-09-19T09:14:45.023495+0000","last_fullsized":"2024-09-19T09:14:45.023495+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:21.918635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579411+0000","last_change":"2024-09-19T09:14:44.019410+0000","last_active":"2024-09-19T09:14:45.579411+0000","last_peered":"2024-09-19T09:14:45.579411+0000","last_clean":"2024-09-19T09:14:45.579411+0000","last_became_active":"2024-09-19T09:14:44.019176+0000","last_became_peered":"2024-09-19T09:14:44.019176+0000","last_unstale":"2024-09-19T09:14:45.579411+0000","last_undegraded":"2024-09-19T09:14:45.579411+0000","last_fullsized":"2024-09-19T09:14:45.579411+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:56:42.073869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.026100+0000","last_change":"2024-09-19T09:14:44.026653+0000","last_active":"2024-09-19T09:14:45.026100+0000","last_peered":"2024-09-19T09:14:45.026100+0000","last_clean":"2024-09-19T09:14:45.026100+0000","last_became_active":"2024-09-19T09:14:44.025208+0000","last_became_peered":"2024-09-19T09:14:44.025208+0000","last_unstale":"2024-09-19T09:14:45.026100+0000","last_undegraded":"2024-09-19T09:14:45.026100+0000","last_fullsized":"2024-09-19T09:14:45.026100+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:31.011663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025521+0000","last_change":"2024-09-19T09:14:44.022107+0000","last_active":"2024-09-19T09:14:45.025521+0000","last_peered":"2024-09-19T09:14:45.025521+0000","last_clean":"2024-09-19T09:14:45.025521+0000","last_became_active":"2024-09-19T09:14:44.021857+0000","last_became_peered":"2024-09-19T09:14:44.021857+0000","last_unstale":"2024-09-19T09:14:45.025521+0000","last_undegraded":"2024-09-19T09:14:45.025521+0000","last_fullsized":"2024-09-19T09:14:45.025521+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:18.924610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.855991+0000","last_change":"2024-09-19T09:14:44.028561+0000","last_active":"2024-09-19T09:14:45.855991+0000","last_peered":"2024-09-19T09:14:45.855991+0000","last_clean":"2024-09-19T09:14:45.855991+0000","last_became_active":"2024-09-19T09:14:44.027606+0000","last_became_peered":"2024-09-19T09:14:44.027606+0000","last_unstale":"2024-09-19T09:14:45.855991+0000","last_undegraded":"2024-09-19T09:14:45.855991+0000","last_fullsized":"2024-09-19T09:14:45.855991+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:55:01.394733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023637+0000","last_change":"2024-09-19T09:14:44.024576+0000","last_active":"2024-09-19T09:14:45.023637+0000","last_peered":"2024-09-19T09:14:45.023637+0000","last_clean":"2024-09-19T09:14:45.023637+0000","last_became_active":"2024-09-19T09:14:44.024110+0000","last_became_peered":"2024-09-19T09:14:44.024110+0000","last_unstale":"2024-09-19T09:14:45.023637+0000","last_undegraded":"2024-09-19T09:14:45.023637+0000","last_fullsized":"2024-09-19T09:14:45.023637+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:38.515108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023956+0000","last_change":"2024-09-19T09:14:44.025103+0000","last_active":"2024-09-19T09:14:45.023956+0000","last_peered":"2024-09-19T09:14:45.023956+0000","last_clean":"2024-09-19T09:14:45.023956+0000","last_became_active":"2024-09-19T09:14:44.024726+0000","last_became_peered":"2024-09-19T09:14:44.024726+0000","last_unstale":"2024-09-19T09:14:45.023956+0000","last_undegraded":"2024-09-19T09:14:45.023956+0000","last_fullsized":"2024-09-19T09:14:45.023956+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:47.017256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.855784+0000","last_change":"2024-09-19T09:14:44.016090+0000","last_active":"2024-09-19T09:14:45.855784+0000","last_peered":"2024-09-19T09:14:45.855784+0000","last_clean":"2024-09-19T09:14:45.855784+0000","last_became_active":"2024-09-19T09:14:44.015791+0000","last_became_peered":"2024-09-19T09:14:44.015791+0000","last_unstale":"2024-09-19T09:14:45.855784+0000","last_undegraded":"2024-09-19T09:14:45.855784+0000","last_fullsized":"2024-09-19T09:14:45.855784+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:30.893989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.380958+0000","last_change":"2024-09-19T09:14:44.018780+0000","last_active":"2024-09-19T09:14:45.380958+0000","last_peered":"2024-09-19T09:14:45.380958+0000","last_clean":"2024-09-19T09:14:45.380958+0000","last_became_active":"2024-09-19T09:14:44.018547+0000","last_became_peered":"2024-09-19T09:14:44.018547+0000","last_unstale":"2024-09-19T09:14:45.380958+0000","last_undegraded":"2024-09-19T09:14:45.380958+0000","last_fullsized":"2024-09-19T09:14:45.380958+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:22:18.613092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025746+0000","last_change":"2024-09-19T09:14:44.023129+0000","last_active":"2024-09-19T09:14:45.025746+0000","last_peered":"2024-09-19T09:14:45.025746+0000","last_clean":"2024-09-19T09:14:45.025746+0000","last_became_active":"2024-09-19T09:14:44.022338+0000","last_became_peered":"2024-09-19T09:14:44.022338+0000","last_unstale":"2024-09-19T09:14:45.025746+0000","last_undegraded":"2024-09-19T09:14:45.025746+0000","last_fullsized":"2024-09-19T09:14:45.025746+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:20.131137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579033+0000","last_change":"2024-09-19T09:14:44.020481+0000","last_active":"2024-09-19T09:14:45.579033+0000","last_peered":"2024-09-19T09:14:45.579033+0000","last_clean":"2024-09-19T09:14:45.579033+0000","last_became_active":"2024-09-19T09:14:44.020243+0000","last_became_peered":"2024-09-19T09:14:44.020243+0000","last_unstale":"2024-09-19T09:14:45.579033+0000","last_undegraded":"2024-09-19T09:14:45.579033+0000","last_fullsized":"2024-09-19T09:14:45.579033+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:44.313933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027308+0000","last_change":"2024-09-19T09:14:44.016953+0000","last_active":"2024-09-19T09:14:45.027308+0000","last_peered":"2024-09-19T09:14:45.027308+0000","last_clean":"2024-09-19T09:14:45.027308+0000","last_became_active":"2024-09-19T09:14:44.016719+0000","last_became_peered":"2024-09-19T09:14:44.016719+0000","last_unstale":"2024-09-19T09:14:45.027308+0000","last_undegraded":"2024-09-19T09:14:45.027308+0000","last_fullsized":"2024-09-19T09:14:45.027308+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:50.777345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023984+0000","last_change":"2024-09-19T09:14:44.014815+0000","last_active":"2024-09-19T09:14:45.023984+0000","last_peered":"2024-09-19T09:14:45.023984+0000","last_clean":"2024-09-19T09:14:45.023984+0000","last_became_active":"2024-09-19T09:14:44.014572+0000","last_became_peered":"2024-09-19T09:14:44.014572+0000","last_unstale":"2024-09-19T09:14:45.023984+0000","last_undegraded":"2024-09-19T09:14:45.023984+0000","last_fullsized":"2024-09-19T09:14:45.023984+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:14.082571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.855858+0000","last_change":"2024-09-19T09:14:44.022461+0000","last_active":"2024-09-19T09:14:45.855858+0000","last_peered":"2024-09-19T09:14:45.855858+0000","last_clean":"2024-09-19T09:14:45.855858+0000","last_became_active":"2024-09-19T09:14:44.022163+0000","last_became_peered":"2024-09-19T09:14:44.022163+0000","last_unstale":"2024-09-19T09:14:45.855858+0000","last_undegraded":"2024-09-19T09:14:45.855858+0000","last_fullsized":"2024-09-19T09:14:45.855858+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:04:00.402110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025848+0000","last_change":"2024-09-19T09:14:44.018197+0000","last_active":"2024-09-19T09:14:45.025848+0000","last_peered":"2024-09-19T09:14:45.025848+0000","last_clean":"2024-09-19T09:14:45.025848+0000","last_became_active":"2024-09-19T09:14:44.016868+0000","last_became_peered":"2024-09-19T09:14:44.016868+0000","last_unstale":"2024-09-19T09:14:45.025848+0000","last_undegraded":"2024-09-19T09:14:45.025848+0000","last_fullsized":"2024-09-19T09:14:45.025848+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:00.498567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027069+0000","last_change":"2024-09-19T09:14:44.026325+0000","last_active":"2024-09-19T09:14:45.027069+0000","last_peered":"2024-09-19T09:14:45.027069+0000","last_clean":"2024-09-19T09:14:45.027069+0000","last_became_active":"2024-09-19T09:14:44.026047+0000","last_became_peered":"2024-09-19T09:14:44.026047+0000","last_unstale":"2024-09-19T09:14:45.027069+0000","last_undegraded":"2024-09-19T09:14:45.027069+0000","last_fullsized":"2024-09-19T09:14:45.027069+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:00:09.035109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.026917+0000","last_change":"2024-09-19T09:14:44.016015+0000","last_active":"2024-09-19T09:14:45.026917+0000","last_peered":"2024-09-19T09:14:45.026917+0000","last_clean":"2024-09-19T09:14:45.026917+0000","last_became_active":"2024-09-19T09:14:44.015604+0000","last_became_peered":"2024-09-19T09:14:44.015604+0000","last_unstale":"2024-09-19T09:14:45.026917+0000","last_undegraded":"2024-09-19T09:14:45.026917+0000","last_fullsized":"2024-09-19T09:14:45.026917+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:45.500407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.855548+0000","last_change":"2024-09-19T09:14:44.025696+0000","last_active":"2024-09-19T09:14:45.855548+0000","last_peered":"2024-09-19T09:14:45.855548+0000","last_clean":"2024-09-19T09:14:45.855548+0000","last_became_active":"2024-09-19T09:14:44.025462+0000","last_became_peered":"2024-09-19T09:14:44.025462+0000","last_unstale":"2024-09-19T09:14:45.855548+0000","last_undegraded":"2024-09-19T09:14:45.855548+0000","last_fullsized":"2024-09-19T09:14:45.855548+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:28.292632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023589+0000","last_change":"2024-09-19T09:14:44.019656+0000","last_active":"2024-09-19T09:14:45.023589+0000","last_peered":"2024-09-19T09:14:45.023589+0000","last_clean":"2024-09-19T09:14:45.023589+0000","last_became_active":"2024-09-19T09:14:44.019426+0000","last_became_peered":"2024-09-19T09:14:44.019426+0000","last_unstale":"2024-09-19T09:14:45.023589+0000","last_undegraded":"2024-09-19T09:14:45.023589+0000","last_fullsized":"2024-09-19T09:14:45.023589+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:08.366531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579714+0000","last_change":"2024-09-19T09:14:44.029037+0000","last_active":"2024-09-19T09:14:45.579714+0000","last_peered":"2024-09-19T09:14:45.579714+0000","last_clean":"2024-09-19T09:14:45.579714+0000","last_became_active":"2024-09-19T09:14:44.028740+0000","last_became_peered":"2024-09-19T09:14:44.028740+0000","last_unstale":"2024-09-19T09:14:45.579714+0000","last_undegraded":"2024-09-19T09:14:45.579714+0000","last_fullsized":"2024-09-19T09:14:45.579714+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:13.673571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025691+0000","last_change":"2024-09-19T09:14:44.013682+0000","last_active":"2024-09-19T09:14:45.025691+0000","last_peered":"2024-09-19T09:14:45.025691+0000","last_clean":"2024-09-19T09:14:45.025691+0000","last_became_active":"2024-09-19T09:14:44.012991+0000","last_became_peered":"2024-09-19T09:14:44.012991+0000","last_unstale":"2024-09-19T09:14:45.025691+0000","last_undegraded":"2024-09-19T09:14:45.025691+0000","last_fullsized":"2024-09-19T09:14:45.025691+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:32.721701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.578807+0000","last_change":"2024-09-19T09:14:44.025357+0000","last_active":"2024-09-19T09:14:45.578807+0000","last_peered":"2024-09-19T09:14:45.578807+0000","last_clean":"2024-09-19T09:14:45.578807+0000","last_became_active":"2024-09-19T09:14:44.024786+0000","last_became_peered":"2024-09-19T09:14:44.024786+0000","last_unstale":"2024-09-19T09:14:45.578807+0000","last_undegraded":"2024-09-19T09:14:45.578807+0000","last_fullsized":"2024-09-19T09:14:45.578807+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:59.293856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"47'4","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579623+0000","last_change":"2024-09-19T09:14:43.020742+0000","last_active":"2024-09-19T09:14:45.579623+0000","last_peered":"2024-09-19T09:14:45.579623+0000","last_clean":"2024-09-19T09:14:45.579623+0000","last_became_active":"2024-09-19T09:14:43.020526+0000","last_became_peered":"2024-09-19T09:14:43.020526+0000","last_unstale":"2024-09-19T09:14:45.579623+0000","last_undegraded":"2024-09-19T09:14:45.579623+0000","last_fullsized":"2024-09-19T09:14:45.579623+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:38.025292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.855925+0000","last_change":"2024-09-19T09:14:44.016202+0000","last_active":"2024-09-19T09:14:45.855925+0000","last_peered":"2024-09-19T09:14:45.855925+0000","last_clean":"2024-09-19T09:14:45.855925+0000","last_became_active":"2024-09-19T09:14:44.015862+0000","last_became_peered":"2024-09-19T09:14:44.015862+0000","last_unstale":"2024-09-19T09:14:45.855925+0000","last_undegraded":"2024-09-19T09:14:45.855925+0000","last_fullsized":"2024-09-19T09:14:45.855925+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:29.501504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027213+0000","last_change":"2024-09-19T09:14:43.017838+0000","last_active":"2024-09-19T09:14:45.027213+0000","last_peered":"2024-09-19T09:14:45.027213+0000","last_clean":"2024-09-19T09:14:45.027213+0000","last_became_active":"2024-09-19T09:14:43.017558+0000","last_became_peered":"2024-09-19T09:14:43.017558+0000","last_unstale":"2024-09-19T09:14:45.027213+0000","last_undegraded":"2024-09-19T09:14:45.027213+0000","last_fullsized":"2024-09-19T09:14:45.027213+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:43.090331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.024009+0000","last_change":"2024-09-19T09:14:44.027442+0000","last_active":"2024-09-19T09:14:45.024009+0000","last_peered":"2024-09-19T09:14:45.024009+0000","last_clean":"2024-09-19T09:14:45.024009+0000","last_became_active":"2024-09-19T09:14:44.025126+0000","last_became_peered":"2024-09-19T09:14:44.025126+0000","last_unstale":"2024-09-19T09:14:45.024009+0000","last_undegraded":"2024-09-19T09:14:45.024009+0000","last_fullsized":"2024-09-19T09:14:45.024009+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:09:25.555913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579479+0000","last_change":"2024-09-19T09:14:43.021795+0000","last_active":"2024-09-19T09:14:45.579479+0000","last_peered":"2024-09-19T09:14:45.579479+0000","last_clean":"2024-09-19T09:14:45.579479+0000","last_became_active":"2024-09-19T09:14:43.021581+0000","last_became_peered":"2024-09-19T09:14:43.021581+0000","last_unstale":"2024-09-19T09:14:45.579479+0000","last_undegraded":"2024-09-19T09:14:45.579479+0000","last_fullsized":"2024-09-19T09:14:45.579479+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:21.982112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025688+0000","last_change":"2024-09-19T09:14:44.014607+0000","last_active":"2024-09-19T09:14:45.025688+0000","last_peered":"2024-09-19T09:14:45.025688+0000","last_clean":"2024-09-19T09:14:45.025688+0000","last_became_active":"2024-09-19T09:14:44.014243+0000","last_became_peered":"2024-09-19T09:14:44.014243+0000","last_unstale":"2024-09-19T09:14:45.025688+0000","last_undegraded":"2024-09-19T09:14:45.025688+0000","last_fullsized":"2024-09-19T09:14:45.025688+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:13.783290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.026910+0000","last_change":"2024-09-19T09:14:43.017408+0000","last_active":"2024-09-19T09:14:45.026910+0000","last_peered":"2024-09-19T09:14:45.026910+0000","last_clean":"2024-09-19T09:14:45.026910+0000","last_became_active":"2024-09-19T09:14:43.017170+0000","last_became_peered":"2024-09-19T09:14:43.017170+0000","last_unstale":"2024-09-19T09:14:45.026910+0000","last_undegraded":"2024-09-19T09:14:45.026910+0000","last_fullsized":"2024-09-19T09:14:45.026910+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:27.767882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027081+0000","last_change":"2024-09-19T09:14:44.027900+0000","last_active":"2024-09-19T09:14:45.027081+0000","last_peered":"2024-09-19T09:14:45.027081+0000","last_clean":"2024-09-19T09:14:45.027081+0000","last_became_active":"2024-09-19T09:14:44.027657+0000","last_became_peered":"2024-09-19T09:14:44.027657+0000","last_unstale":"2024-09-19T09:14:45.027081+0000","last_undegraded":"2024-09-19T09:14:45.027081+0000","last_fullsized":"2024-09-19T09:14:45.027081+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:32.789950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579409+0000","last_change":"2024-09-19T09:14:43.011945+0000","last_active":"2024-09-19T09:14:45.579409+0000","last_peered":"2024-09-19T09:14:45.579409+0000","last_clean":"2024-09-19T09:14:45.579409+0000","last_became_active":"2024-09-19T09:14:43.011669+0000","last_became_peered":"2024-09-19T09:14:43.011669+0000","last_unstale":"2024-09-19T09:14:45.579409+0000","last_undegraded":"2024-09-19T09:14:45.579409+0000","last_fullsized":"2024-09-19T09:14:45.579409+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:59:08.370808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.380644+0000","last_change":"2024-09-19T09:14:44.023315+0000","last_active":"2024-09-19T09:14:45.380644+0000","last_peered":"2024-09-19T09:14:45.380644+0000","last_clean":"2024-09-19T09:14:45.380644+0000","last_became_active":"2024-09-19T09:14:44.023070+0000","last_became_peered":"2024-09-19T09:14:44.023070+0000","last_unstale":"2024-09-19T09:14:45.380644+0000","last_undegraded":"2024-09-19T09:14:45.380644+0000","last_fullsized":"2024-09-19T09:14:45.380644+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:40:42.067393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027386+0000","last_change":"2024-09-19T09:14:43.022002+0000","last_active":"2024-09-19T09:14:45.027386+0000","last_peered":"2024-09-19T09:14:45.027386+0000","last_clean":"2024-09-19T09:14:45.027386+0000","last_became_active":"2024-09-19T09:14:43.021747+0000","last_became_peered":"2024-09-19T09:14:43.021747+0000","last_unstale":"2024-09-19T09:14:45.027386+0000","last_undegraded":"2024-09-19T09:14:45.027386+0000","last_fullsized":"2024-09-19T09:14:45.027386+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:21.026772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.380737+0000","last_change":"2024-09-19T09:14:44.024204+0000","last_active":"2024-09-19T09:14:45.380737+0000","last_peered":"2024-09-19T09:14:45.380737+0000","last_clean":"2024-09-19T09:14:45.380737+0000","last_became_active":"2024-09-19T09:14:44.023505+0000","last_became_peered":"2024-09-19T09:14:44.023505+0000","last_unstale":"2024-09-19T09:14:45.380737+0000","last_undegraded":"2024-09-19T09:14:45.380737+0000","last_fullsized":"2024-09-19T09:14:45.380737+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:54.166840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.855635+0000","last_change":"2024-09-19T09:14:43.021982+0000","last_active":"2024-09-19T09:14:45.855635+0000","last_peered":"2024-09-19T09:14:45.855635+0000","last_clean":"2024-09-19T09:14:45.855635+0000","last_became_active":"2024-09-19T09:14:43.021375+0000","last_became_peered":"2024-09-19T09:14:43.021375+0000","last_unstale":"2024-09-19T09:14:45.855635+0000","last_undegraded":"2024-09-19T09:14:45.855635+0000","last_fullsized":"2024-09-19T09:14:45.855635+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:41.845835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.026960+0000","last_change":"2024-09-19T09:14:44.022900+0000","last_active":"2024-09-19T09:14:45.026960+0000","last_peered":"2024-09-19T09:14:45.026960+0000","last_clean":"2024-09-19T09:14:45.026960+0000","last_became_active":"2024-09-19T09:14:44.022655+0000","last_became_peered":"2024-09-19T09:14:44.022655+0000","last_unstale":"2024-09-19T09:14:45.026960+0000","last_undegraded":"2024-09-19T09:14:45.026960+0000","last_fullsized":"2024-09-19T09:14:45.026960+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:45.281756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.381019+0000","last_change":"2024-09-19T09:14:43.019253+0000","last_active":"2024-09-19T09:14:45.381019+0000","last_peered":"2024-09-19T09:14:45.381019+0000","last_clean":"2024-09-19T09:14:45.381019+0000","last_became_active":"2024-09-19T09:14:43.018841+0000","last_became_peered":"2024-09-19T09:14:43.018841+0000","last_unstale":"2024-09-19T09:14:45.381019+0000","last_undegraded":"2024-09-19T09:14:45.381019+0000","last_fullsized":"2024-09-19T09:14:45.381019+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:02.512785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023549+0000","last_change":"2024-09-19T09:14:44.022473+0000","last_active":"2024-09-19T09:14:45.023549+0000","last_peered":"2024-09-19T09:14:45.023549+0000","last_clean":"2024-09-19T09:14:45.023549+0000","last_became_active":"2024-09-19T09:14:44.020917+0000","last_became_peered":"2024-09-19T09:14:44.020917+0000","last_unstale":"2024-09-19T09:14:45.023549+0000","last_undegraded":"2024-09-19T09:14:45.023549+0000","last_fullsized":"2024-09-19T09:14:45.023549+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:10:02.210631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.024460+0000","last_change":"2024-09-19T09:14:43.015721+0000","last_active":"2024-09-19T09:14:45.024460+0000","last_peered":"2024-09-19T09:14:45.024460+0000","last_clean":"2024-09-19T09:14:45.024460+0000","last_became_active":"2024-09-19T09:14:43.015423+0000","last_became_peered":"2024-09-19T09:14:43.015423+0000","last_unstale":"2024-09-19T09:14:45.024460+0000","last_undegraded":"2024-09-19T09:14:45.024460+0000","last_fullsized":"2024-09-19T09:14:45.024460+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:27.122536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.024099+0000","last_change":"2024-09-19T09:14:44.029393+0000","last_active":"2024-09-19T09:14:45.024099+0000","last_peered":"2024-09-19T09:14:45.024099+0000","last_clean":"2024-09-19T09:14:45.024099+0000","last_became_active":"2024-09-19T09:14:44.029136+0000","last_became_peered":"2024-09-19T09:14:44.029136+0000","last_unstale":"2024-09-19T09:14:45.024099+0000","last_undegraded":"2024-09-19T09:14:45.024099+0000","last_fullsized":"2024-09-19T09:14:45.024099+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:19:16.335233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.381048+0000","last_change":"2024-09-19T09:14:43.018969+0000","last_active":"2024-09-19T09:14:45.381048+0000","last_peered":"2024-09-19T09:14:45.381048+0000","last_clean":"2024-09-19T09:14:45.381048+0000","last_became_active":"2024-09-19T09:14:43.018389+0000","last_became_peered":"2024-09-19T09:14:43.018389+0000","last_unstale":"2024-09-19T09:14:45.381048+0000","last_undegraded":"2024-09-19T09:14:45.381048+0000","last_fullsized":"2024-09-19T09:14:45.381048+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:53.598810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025822+0000","last_change":"2024-09-19T09:14:44.025437+0000","last_active":"2024-09-19T09:14:45.025822+0000","last_peered":"2024-09-19T09:14:45.025822+0000","last_clean":"2024-09-19T09:14:45.025822+0000","last_became_active":"2024-09-19T09:14:44.024770+0000","last_became_peered":"2024-09-19T09:14:44.024770+0000","last_unstale":"2024-09-19T09:14:45.025822+0000","last_undegraded":"2024-09-19T09:14:45.025822+0000","last_fullsized":"2024-09-19T09:14:45.025822+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:36.790289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"47'3","reported_seq":17,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.024442+0000","last_change":"2024-09-19T09:14:43.021320+0000","last_active":"2024-09-19T09:14:45.024442+0000","last_peered":"2024-09-19T09:14:45.024442+0000","last_clean":"2024-09-19T09:14:45.024442+0000","last_became_active":"2024-09-19T09:14:43.020968+0000","last_became_peered":"2024-09-19T09:14:43.020968+0000","last_unstale":"2024-09-19T09:14:45.024442+0000","last_undegraded":"2024-09-19T09:14:45.024442+0000","last_fullsized":"2024-09-19T09:14:45.024442+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:40:45.301062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027221+0000","last_change":"2024-09-19T09:14:44.019006+0000","last_active":"2024-09-19T09:14:45.027221+0000","last_peered":"2024-09-19T09:14:45.027221+0000","last_clean":"2024-09-19T09:14:45.027221+0000","last_became_active":"2024-09-19T09:14:44.018713+0000","last_became_peered":"2024-09-19T09:14:44.018713+0000","last_unstale":"2024-09-19T09:14:45.027221+0000","last_undegraded":"2024-09-19T09:14:45.027221+0000","last_fullsized":"2024-09-19T09:14:45.027221+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:17.324728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"47'6","reported_seq":20,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.380900+0000","last_change":"2024-09-19T09:14:43.018818+0000","last_active":"2024-09-19T09:14:45.380900+0000","last_peered":"2024-09-19T09:14:45.380900+0000","last_clean":"2024-09-19T09:14:45.380900+0000","last_became_active":"2024-09-19T09:14:43.018404+0000","last_became_peered":"2024-09-19T09:14:43.018404+0000","last_unstale":"2024-09-19T09:14:45.380900+0000","last_undegraded":"2024-09-19T09:14:45.380900+0000","last_fullsized":"2024-09-19T09:14:45.380900+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:15.384351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.024230+0000","last_change":"2024-09-19T09:14:44.026006+0000","last_active":"2024-09-19T09:14:45.024230+0000","last_peered":"2024-09-19T09:14:45.024230+0000","last_clean":"2024-09-19T09:14:45.024230+0000","last_became_active":"2024-09-19T09:14:44.025744+0000","last_became_peered":"2024-09-19T09:14:44.025744+0000","last_unstale":"2024-09-19T09:14:45.024230+0000","last_undegraded":"2024-09-19T09:14:45.024230+0000","last_fullsized":"2024-09-19T09:14:45.024230+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:29.175037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579200+0000","last_change":"2024-09-19T09:14:43.012153+0000","last_active":"2024-09-19T09:14:45.579200+0000","last_peered":"2024-09-19T09:14:45.579200+0000","last_clean":"2024-09-19T09:14:45.579200+0000","last_became_active":"2024-09-19T09:14:43.011918+0000","last_became_peered":"2024-09-19T09:14:43.011918+0000","last_unstale":"2024-09-19T09:14:45.579200+0000","last_undegraded":"2024-09-19T09:14:45.579200+0000","last_fullsized":"2024-09-19T09:14:45.579200+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:40.088791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.578945+0000","last_change":"2024-09-19T09:14:44.017690+0000","last_active":"2024-09-19T09:14:45.578945+0000","last_peered":"2024-09-19T09:14:45.578945+0000","last_clean":"2024-09-19T09:14:45.578945+0000","last_became_active":"2024-09-19T09:14:44.017382+0000","last_became_peered":"2024-09-19T09:14:44.017382+0000","last_unstale":"2024-09-19T09:14:45.578945+0000","last_undegraded":"2024-09-19T09:14:45.578945+0000","last_fullsized":"2024-09-19T09:14:45.578945+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:27.398579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.856047+0000","last_change":"2024-09-19T09:14:43.016145+0000","last_active":"2024-09-19T09:14:45.856047+0000","last_peered":"2024-09-19T09:14:45.856047+0000","last_clean":"2024-09-19T09:14:45.856047+0000","last_became_active":"2024-09-19T09:14:43.015822+0000","last_became_peered":"2024-09-19T09:14:43.015822+0000","last_unstale":"2024-09-19T09:14:45.856047+0000","last_undegraded":"2024-09-19T09:14:45.856047+0000","last_fullsized":"2024-09-19T09:14:45.856047+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:23:23.072844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.578781+0000","last_change":"2024-09-19T09:14:44.019220+0000","last_active":"2024-09-19T09:14:45.578781+0000","last_peered":"2024-09-19T09:14:45.578781+0000","last_clean":"2024-09-19T09:14:45.578781+0000","last_became_active":"2024-09-19T09:14:44.018980+0000","last_became_peered":"2024-09-19T09:14:44.018980+0000","last_unstale":"2024-09-19T09:14:45.578781+0000","last_undegraded":"2024-09-19T09:14:45.578781+0000","last_fullsized":"2024-09-19T09:14:45.578781+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:49.951747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579493+0000","last_change":"2024-09-19T09:14:43.014274+0000","last_active":"2024-09-19T09:14:45.579493+0000","last_peered":"2024-09-19T09:14:45.579493+0000","last_clean":"2024-09-19T09:14:45.579493+0000","last_became_active":"2024-09-19T09:14:43.013722+0000","last_became_peered":"2024-09-19T09:14:43.013722+0000","last_unstale":"2024-09-19T09:14:45.579493+0000","last_undegraded":"2024-09-19T09:14:45.579493+0000","last_fullsized":"2024-09-19T09:14:45.579493+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:23.292449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023763+0000","last_change":"2024-09-19T09:14:44.024354+0000","last_active":"2024-09-19T09:14:45.023763+0000","last_peered":"2024-09-19T09:14:45.023763+0000","last_clean":"2024-09-19T09:14:45.023763+0000","last_became_active":"2024-09-19T09:14:44.023780+0000","last_became_peered":"2024-09-19T09:14:44.023780+0000","last_unstale":"2024-09-19T09:14:45.023763+0000","last_undegraded":"2024-09-19T09:14:45.023763+0000","last_fullsized":"2024-09-19T09:14:45.023763+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:18.315720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"47'8","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.380576+0000","last_change":"2024-09-19T09:14:43.014824+0000","last_active":"2024-09-19T09:14:45.380576+0000","last_peered":"2024-09-19T09:14:45.380576+0000","last_clean":"2024-09-19T09:14:45.380576+0000","last_became_active":"2024-09-19T09:14:43.014570+0000","last_became_peered":"2024-09-19T09:14:43.014570+0000","last_unstale":"2024-09-19T09:14:45.380576+0000","last_undegraded":"2024-09-19T09:14:45.380576+0000","last_fullsized":"2024-09-19T09:14:45.380576+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:54.061691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579089+0000","last_change":"2024-09-19T09:14:44.020992+0000","last_active":"2024-09-19T09:14:45.579089+0000","last_peered":"2024-09-19T09:14:45.579089+0000","last_clean":"2024-09-19T09:14:45.579089+0000","last_became_active":"2024-09-19T09:14:44.020724+0000","last_became_peered":"2024-09-19T09:14:44.020724+0000","last_unstale":"2024-09-19T09:14:45.579089+0000","last_undegraded":"2024-09-19T09:14:45.579089+0000","last_fullsized":"2024-09-19T09:14:45.579089+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:40.503421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025950+0000","last_change":"2024-09-19T09:14:43.018292+0000","last_active":"2024-09-19T09:14:45.025950+0000","last_peered":"2024-09-19T09:14:45.025950+0000","last_clean":"2024-09-19T09:14:45.025950+0000","last_became_active":"2024-09-19T09:14:43.017848+0000","last_became_peered":"2024-09-19T09:14:43.017848+0000","last_unstale":"2024-09-19T09:14:45.025950+0000","last_undegraded":"2024-09-19T09:14:45.025950+0000","last_fullsized":"2024-09-19T09:14:45.025950+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:45.490695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.578958+0000","last_change":"2024-09-19T09:14:44.025089+0000","last_active":"2024-09-19T09:14:45.578958+0000","last_peered":"2024-09-19T09:14:45.578958+0000","last_clean":"2024-09-19T09:14:45.578958+0000","last_became_active":"2024-09-19T09:14:44.024431+0000","last_became_peered":"2024-09-19T09:14:44.024431+0000","last_unstale":"2024-09-19T09:14:45.578958+0000","last_undegraded":"2024-09-19T09:14:45.578958+0000","last_fullsized":"2024-09-19T09:14:45.578958+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:43.604622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023990+0000","last_change":"2024-09-19T09:14:43.015986+0000","last_active":"2024-09-19T09:14:45.023990+0000","last_peered":"2024-09-19T09:14:45.023990+0000","last_clean":"2024-09-19T09:14:45.023990+0000","last_became_active":"2024-09-19T09:14:43.015707+0000","last_became_peered":"2024-09-19T09:14:43.015707+0000","last_unstale":"2024-09-19T09:14:45.023990+0000","last_undegraded":"2024-09-19T09:14:45.023990+0000","last_fullsized":"2024-09-19T09:14:45.023990+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:55.935855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023906+0000","last_change":"2024-09-19T09:14:44.020439+0000","last_active":"2024-09-19T09:14:45.023906+0000","last_peered":"2024-09-19T09:14:45.023906+0000","last_clean":"2024-09-19T09:14:45.023906+0000","last_became_active":"2024-09-19T09:14:44.020161+0000","last_became_peered":"2024-09-19T09:14:44.020161+0000","last_unstale":"2024-09-19T09:14:45.023906+0000","last_undegraded":"2024-09-19T09:14:45.023906+0000","last_fullsized":"2024-09-19T09:14:45.023906+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:06.444772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.024560+0000","last_change":"2024-09-19T09:14:43.018432+0000","last_active":"2024-09-19T09:14:45.024560+0000","last_peered":"2024-09-19T09:14:45.024560+0000","last_clean":"2024-09-19T09:14:45.024560+0000","last_became_active":"2024-09-19T09:14:43.018185+0000","last_became_peered":"2024-09-19T09:14:43.018185+0000","last_unstale":"2024-09-19T09:14:45.024560+0000","last_undegraded":"2024-09-19T09:14:45.024560+0000","last_fullsized":"2024-09-19T09:14:45.024560+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:01.201460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.024367+0000","last_change":"2024-09-19T09:14:44.028325+0000","last_active":"2024-09-19T09:14:45.024367+0000","last_peered":"2024-09-19T09:14:45.024367+0000","last_clean":"2024-09-19T09:14:45.024367+0000","last_became_active":"2024-09-19T09:14:44.027940+0000","last_became_peered":"2024-09-19T09:14:44.027940+0000","last_unstale":"2024-09-19T09:14:45.024367+0000","last_undegraded":"2024-09-19T09:14:45.024367+0000","last_fullsized":"2024-09-19T09:14:45.024367+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:29.976057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579575+0000","last_change":"2024-09-19T09:14:43.013969+0000","last_active":"2024-09-19T09:14:45.579575+0000","last_peered":"2024-09-19T09:14:45.579575+0000","last_clean":"2024-09-19T09:14:45.579575+0000","last_became_active":"2024-09-19T09:14:43.013370+0000","last_became_peered":"2024-09-19T09:14:43.013370+0000","last_unstale":"2024-09-19T09:14:45.579575+0000","last_undegraded":"2024-09-19T09:14:45.579575+0000","last_fullsized":"2024-09-19T09:14:45.579575+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:54.441500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.380746+0000","last_change":"2024-09-19T09:14:44.023568+0000","last_active":"2024-09-19T09:14:45.380746+0000","last_peered":"2024-09-19T09:14:45.380746+0000","last_clean":"2024-09-19T09:14:45.380746+0000","last_became_active":"2024-09-19T09:14:44.023139+0000","last_became_peered":"2024-09-19T09:14:44.023139+0000","last_unstale":"2024-09-19T09:14:45.380746+0000","last_undegraded":"2024-09-19T09:14:45.380746+0000","last_fullsized":"2024-09-19T09:14:45.380746+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:20.812534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.380672+0000","last_change":"2024-09-19T09:14:43.016302+0000","last_active":"2024-09-19T09:14:45.380672+0000","last_peered":"2024-09-19T09:14:45.380672+0000","last_clean":"2024-09-19T09:14:45.380672+0000","last_became_active":"2024-09-19T09:14:43.016051+0000","last_became_peered":"2024-09-19T09:14:43.016051+0000","last_unstale":"2024-09-19T09:14:45.380672+0000","last_undegraded":"2024-09-19T09:14:45.380672+0000","last_fullsized":"2024-09-19T09:14:45.380672+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:06.635440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579546+0000","last_change":"2024-09-19T09:14:44.018465+0000","last_active":"2024-09-19T09:14:45.579546+0000","last_peered":"2024-09-19T09:14:45.579546+0000","last_clean":"2024-09-19T09:14:45.579546+0000","last_became_active":"2024-09-19T09:14:44.018236+0000","last_became_peered":"2024-09-19T09:14:44.018236+0000","last_unstale":"2024-09-19T09:14:45.579546+0000","last_undegraded":"2024-09-19T09:14:45.579546+0000","last_fullsized":"2024-09-19T09:14:45.579546+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:57.429129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.855696+0000","last_change":"2024-09-19T09:14:43.021698+0000","last_active":"2024-09-19T09:14:45.855696+0000","last_peered":"2024-09-19T09:14:45.855696+0000","last_clean":"2024-09-19T09:14:45.855696+0000","last_became_active":"2024-09-19T09:14:43.021031+0000","last_became_peered":"2024-09-19T09:14:43.021031+0000","last_unstale":"2024-09-19T09:14:45.855696+0000","last_undegraded":"2024-09-19T09:14:45.855696+0000","last_fullsized":"2024-09-19T09:14:45.855696+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:50.647331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025969+0000","last_change":"2024-09-19T09:14:44.026463+0000","last_active":"2024-09-19T09:14:45.025969+0000","last_peered":"2024-09-19T09:14:45.025969+0000","last_clean":"2024-09-19T09:14:45.025969+0000","last_became_active":"2024-09-19T09:14:44.026205+0000","last_became_peered":"2024-09-19T09:14:44.026205+0000","last_unstale":"2024-09-19T09:14:45.025969+0000","last_undegraded":"2024-09-19T09:14:45.025969+0000","last_fullsized":"2024-09-19T09:14:45.025969+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:07.055231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.381078+0000","last_change":"2024-09-19T09:14:43.016647+0000","last_active":"2024-09-19T09:14:45.381078+0000","last_peered":"2024-09-19T09:14:45.381078+0000","last_clean":"2024-09-19T09:14:45.381078+0000","last_became_active":"2024-09-19T09:14:43.016390+0000","last_became_peered":"2024-09-19T09:14:43.016390+0000","last_unstale":"2024-09-19T09:14:45.381078+0000","last_undegraded":"2024-09-19T09:14:45.381078+0000","last_fullsized":"2024-09-19T09:14:45.381078+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:30.278092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025836+0000","last_change":"2024-09-19T09:14:44.024826+0000","last_active":"2024-09-19T09:14:45.025836+0000","last_peered":"2024-09-19T09:14:45.025836+0000","last_clean":"2024-09-19T09:14:45.025836+0000","last_became_active":"2024-09-19T09:14:44.024589+0000","last_became_peered":"2024-09-19T09:14:44.024589+0000","last_unstale":"2024-09-19T09:14:45.025836+0000","last_undegraded":"2024-09-19T09:14:45.025836+0000","last_fullsized":"2024-09-19T09:14:45.025836+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:10.102105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027031+0000","last_change":"2024-09-19T09:14:43.014182+0000","last_active":"2024-09-19T09:14:45.027031+0000","last_peered":"2024-09-19T09:14:45.027031+0000","last_clean":"2024-09-19T09:14:45.027031+0000","last_became_active":"2024-09-19T09:14:43.013926+0000","last_became_peered":"2024-09-19T09:14:43.013926+0000","last_unstale":"2024-09-19T09:14:45.027031+0000","last_undegraded":"2024-09-19T09:14:45.027031+0000","last_fullsized":"2024-09-19T09:14:45.027031+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:44.694987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027182+0000","last_change":"2024-09-19T09:14:44.022263+0000","last_active":"2024-09-19T09:14:45.027182+0000","last_peered":"2024-09-19T09:14:45.027182+0000","last_clean":"2024-09-19T09:14:45.027182+0000","last_became_active":"2024-09-19T09:14:44.022029+0000","last_became_peered":"2024-09-19T09:14:44.022029+0000","last_unstale":"2024-09-19T09:14:45.027182+0000","last_undegraded":"2024-09-19T09:14:45.027182+0000","last_fullsized":"2024-09-19T09:14:45.027182+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:57.184977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"48'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027025+0000","last_change":"2024-09-19T09:14:43.016043+0000","last_active":"2024-09-19T09:14:45.027025+0000","last_peered":"2024-09-19T09:14:45.027025+0000","last_clean":"2024-09-19T09:14:45.027025+0000","last_became_active":"2024-09-19T09:14:43.015756+0000","last_became_peered":"2024-09-19T09:14:43.015756+0000","last_unstale":"2024-09-19T09:14:45.027025+0000","last_undegraded":"2024-09-19T09:14:45.027025+0000","last_fullsized":"2024-09-19T09:14:45.027025+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.109665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.380852+0000","last_change":"2024-09-19T09:14:44.023981+0000","last_active":"2024-09-19T09:14:45.380852+0000","last_peered":"2024-09-19T09:14:45.380852+0000","last_clean":"2024-09-19T09:14:45.380852+0000","last_became_active":"2024-09-19T09:14:44.023225+0000","last_became_peered":"2024-09-19T09:14:44.023225+0000","last_unstale":"2024-09-19T09:14:45.380852+0000","last_undegraded":"2024-09-19T09:14:45.380852+0000","last_fullsized":"2024-09-19T09:14:45.380852+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:35.414159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.855843+0000","last_change":"2024-09-19T09:14:43.019756+0000","last_active":"2024-09-19T09:14:45.855843+0000","last_peered":"2024-09-19T09:14:45.855843+0000","last_clean":"2024-09-19T09:14:45.855843+0000","last_became_active":"2024-09-19T09:14:43.019064+0000","last_became_peered":"2024-09-19T09:14:43.019064+0000","last_unstale":"2024-09-19T09:14:45.855843+0000","last_undegraded":"2024-09-19T09:14:45.855843+0000","last_fullsized":"2024-09-19T09:14:45.855843+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:39.258366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027112+0000","last_change":"2024-09-19T09:14:44.016509+0000","last_active":"2024-09-19T09:14:45.027112+0000","last_peered":"2024-09-19T09:14:45.027112+0000","last_clean":"2024-09-19T09:14:45.027112+0000","last_became_active":"2024-09-19T09:14:44.016185+0000","last_became_peered":"2024-09-19T09:14:44.016185+0000","last_unstale":"2024-09-19T09:14:45.027112+0000","last_undegraded":"2024-09-19T09:14:45.027112+0000","last_fullsized":"2024-09-19T09:14:45.027112+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:39.470792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579299+0000","last_change":"2024-09-19T09:14:43.016982+0000","last_active":"2024-09-19T09:14:45.579299+0000","last_peered":"2024-09-19T09:14:45.579299+0000","last_clean":"2024-09-19T09:14:45.579299+0000","last_became_active":"2024-09-19T09:14:43.016668+0000","last_became_peered":"2024-09-19T09:14:43.016668+0000","last_unstale":"2024-09-19T09:14:45.579299+0000","last_undegraded":"2024-09-19T09:14:45.579299+0000","last_fullsized":"2024-09-19T09:14:45.579299+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:36.837917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.380936+0000","last_change":"2024-09-19T09:14:44.018411+0000","last_active":"2024-09-19T09:14:45.380936+0000","last_peered":"2024-09-19T09:14:45.380936+0000","last_clean":"2024-09-19T09:14:45.380936+0000","last_became_active":"2024-09-19T09:14:44.018176+0000","last_became_peered":"2024-09-19T09:14:44.018176+0000","last_unstale":"2024-09-19T09:14:45.380936+0000","last_undegraded":"2024-09-19T09:14:45.380936+0000","last_fullsized":"2024-09-19T09:14:45.380936+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:19.873465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.856095+0000","last_change":"2024-09-19T09:14:43.019534+0000","last_active":"2024-09-19T09:14:45.856095+0000","last_peered":"2024-09-19T09:14:45.856095+0000","last_clean":"2024-09-19T09:14:45.856095+0000","last_became_active":"2024-09-19T09:14:43.019162+0000","last_became_peered":"2024-09-19T09:14:43.019162+0000","last_unstale":"2024-09-19T09:14:45.856095+0000","last_undegraded":"2024-09-19T09:14:45.856095+0000","last_fullsized":"2024-09-19T09:14:45.856095+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:00.685460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.026064+0000","last_change":"2024-09-19T09:14:44.022559+0000","last_active":"2024-09-19T09:14:45.026064+0000","last_peered":"2024-09-19T09:14:45.026064+0000","last_clean":"2024-09-19T09:14:45.026064+0000","last_became_active":"2024-09-19T09:14:44.021953+0000","last_became_peered":"2024-09-19T09:14:44.021953+0000","last_unstale":"2024-09-19T09:14:45.026064+0000","last_undegraded":"2024-09-19T09:14:45.026064+0000","last_fullsized":"2024-09-19T09:14:45.026064+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:35.372428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027314+0000","last_change":"2024-09-19T09:14:43.019601+0000","last_active":"2024-09-19T09:14:45.027314+0000","last_peered":"2024-09-19T09:14:45.027314+0000","last_clean":"2024-09-19T09:14:45.027314+0000","last_became_active":"2024-09-19T09:14:43.019364+0000","last_became_peered":"2024-09-19T09:14:43.019364+0000","last_unstale":"2024-09-19T09:14:45.027314+0000","last_undegraded":"2024-09-19T09:14:45.027314+0000","last_fullsized":"2024-09-19T09:14:45.027314+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:12.857718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023389+0000","last_change":"2024-09-19T09:14:44.027346+0000","last_active":"2024-09-19T09:14:45.023389+0000","last_peered":"2024-09-19T09:14:45.023389+0000","last_clean":"2024-09-19T09:14:45.023389+0000","last_became_active":"2024-09-19T09:14:44.027123+0000","last_became_peered":"2024-09-19T09:14:44.027123+0000","last_unstale":"2024-09-19T09:14:45.023389+0000","last_undegraded":"2024-09-19T09:14:45.023389+0000","last_fullsized":"2024-09-19T09:14:45.023389+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:58.059137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579677+0000","last_change":"2024-09-19T09:14:43.014442+0000","last_active":"2024-09-19T09:14:45.579677+0000","last_peered":"2024-09-19T09:14:45.579677+0000","last_clean":"2024-09-19T09:14:45.579677+0000","last_became_active":"2024-09-19T09:14:43.013919+0000","last_became_peered":"2024-09-19T09:14:43.013919+0000","last_unstale":"2024-09-19T09:14:45.579677+0000","last_undegraded":"2024-09-19T09:14:45.579677+0000","last_fullsized":"2024-09-19T09:14:45.579677+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:36.932370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.024327+0000","last_change":"2024-09-19T09:14:44.021301+0000","last_active":"2024-09-19T09:14:45.024327+0000","last_peered":"2024-09-19T09:14:45.024327+0000","last_clean":"2024-09-19T09:14:45.024327+0000","last_became_active":"2024-09-19T09:14:44.020180+0000","last_became_peered":"2024-09-19T09:14:44.020180+0000","last_unstale":"2024-09-19T09:14:45.024327+0000","last_undegraded":"2024-09-19T09:14:45.024327+0000","last_fullsized":"2024-09-19T09:14:45.024327+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:47.149041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579088+0000","last_change":"2024-09-19T09:14:43.017264+0000","last_active":"2024-09-19T09:14:45.579088+0000","last_peered":"2024-09-19T09:14:45.579088+0000","last_clean":"2024-09-19T09:14:45.579088+0000","last_became_active":"2024-09-19T09:14:43.017011+0000","last_became_peered":"2024-09-19T09:14:43.017011+0000","last_unstale":"2024-09-19T09:14:45.579088+0000","last_undegraded":"2024-09-19T09:14:45.579088+0000","last_fullsized":"2024-09-19T09:14:45.579088+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:39:25.578459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025620+0000","last_change":"2024-09-19T09:14:44.019925+0000","last_active":"2024-09-19T09:14:45.025620+0000","last_peered":"2024-09-19T09:14:45.025620+0000","last_clean":"2024-09-19T09:14:45.025620+0000","last_became_active":"2024-09-19T09:14:44.018603+0000","last_became_peered":"2024-09-19T09:14:44.018603+0000","last_unstale":"2024-09-19T09:14:45.025620+0000","last_undegraded":"2024-09-19T09:14:45.025620+0000","last_fullsized":"2024-09-19T09:14:45.025620+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:26.582541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027263+0000","last_change":"2024-09-19T09:14:43.018492+0000","last_active":"2024-09-19T09:14:45.027263+0000","last_peered":"2024-09-19T09:14:45.027263+0000","last_clean":"2024-09-19T09:14:45.027263+0000","last_became_active":"2024-09-19T09:14:43.018239+0000","last_became_peered":"2024-09-19T09:14:43.018239+0000","last_unstale":"2024-09-19T09:14:45.027263+0000","last_undegraded":"2024-09-19T09:14:45.027263+0000","last_fullsized":"2024-09-19T09:14:45.027263+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:47.554369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":220,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023438+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:14:45.023438+0000","last_peered":"2024-09-19T09:14:45.023438+0000","last_clean":"2024-09-19T09:14:45.023438+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:14:45.023438+0000","last_undegraded":"2024-09-19T09:14:45.023438+0000","last_fullsized":"2024-09-19T09:14:45.023438+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:22.478151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195086,"statfs":{"total":200000000,"available":199768258,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195085,"statfs":{"total":200000000,"available":199767676,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199177902,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":227,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195084,"statfs":{"total":200000000,"available":199766588,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":227,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195084,"statfs":{"total":200000000,"available":199766680,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195086,"statfs":{"total":200000000,"available":199768202,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199177854,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":220,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195091,"statfs":{"total":200000000,"available":199773920,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:14:47.698 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T09:14:47.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.833+0000 7f9438a1e640 1 Processor -- start 2024-09-19T09:14:47.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.833+0000 7f9438a1e640 1 -- start start 2024-09-19T09:14:47.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.834+0000 7f9438a1e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f94340d1b60 0x7f94341698e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:47.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.834+0000 7f9438a1e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94340d3880 con 0x7f94340d57a0 2024-09-19T09:14:47.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.834+0000 7f9438a1e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94340d3b20 con 0x7f943415ecc0 2024-09-19T09:14:47.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.834+0000 7f9438a1e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f94340b42f0 con 0x7f94340d1b60 2024-09-19T09:14:47.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.834+0000 7f9431d9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f94340d57a0 0x7f94340d1450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59854/0 (socket says 172.21.15.18:59854) 2024-09-19T09:14:47.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.834+0000 7f9431d9b640 1 -- 172.21.15.18:0/3725983924 learned_addr learned my addr 172.21.15.18:0/3725983924 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:47.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.834+0000 7f9432d9d640 1 --2- 172.21.15.18:0/3725983924 >> v2:172.21.15.162:3300/0 conn(0x7f94340d1b60 0x7f94341698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:47.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.834+0000 7f943159a640 1 -- 172.21.15.18:0/3725983924 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2146599732 0 0) 0x7f94340d3880 con 0x7f94340d57a0 2024-09-19T09:14:47.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.834+0000 7f943159a640 1 -- 172.21.15.18:0/3725983924 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f941c003520 con 0x7f94340d57a0 2024-09-19T09:14:47.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.834+0000 7f943159a640 1 -- 172.21.15.18:0/3725983924 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3894305912 0 0) 0x7f941c003520 con 0x7f94340d57a0 2024-09-19T09:14:47.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.834+0000 7f943159a640 1 -- 172.21.15.18:0/3725983924 >> v2:172.21.15.162:3300/0 conn(0x7f94340d1b60 msgr2=0x7f94341698e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:47.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.834+0000 7f943159a640 1 --2- 172.21.15.18:0/3725983924 >> v2:172.21.15.162:3300/0 conn(0x7f94340d1b60 0x7f94341698e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.834+0000 7f943159a640 1 -- 172.21.15.18:0/3725983924 >> v1:172.21.15.162:6789/0 conn(0x7f943415ecc0 legacy=0x7f94340d3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:47.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.834+0000 7f943159a640 1 -- 172.21.15.18:0/3725983924 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94340b45d0 con 0x7f94340d57a0 2024-09-19T09:14:47.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.834+0000 7f943159a640 1 -- 172.21.15.18:0/3725983924 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f9428001670 con 0x7f94340d57a0 2024-09-19T09:14:47.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.834+0000 7f943159a640 1 -- 172.21.15.18:0/3725983924 >> v1:172.21.15.18:6789/0 conn(0x7f94340d57a0 legacy=0x7f94340d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:47.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.834+0000 7f943159a640 1 --2- 172.21.15.18:0/3725983924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f941c0039b0 0x7f941c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:47.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.834+0000 7f943159a640 1 --2- 172.21.15.18:0/3725983924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f941c004800 0x7f941c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:47.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.834+0000 7f943159a640 1 --2- 172.21.15.18:0/3725983924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f941c0051c0 0x7f941c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:47.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.834+0000 7f943159a640 1 -- 172.21.15.18:0/3725983924 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f94340b42f0 con 0x7f941c0039b0 2024-09-19T09:14:47.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.834+0000 7f943159a640 1 -- 172.21.15.18:0/3725983924 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f941c00c160 con 0x7f941c0051c0 2024-09-19T09:14:47.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.834+0000 7f943159a640 1 -- 172.21.15.18:0/3725983924 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f941c00c360 con 0x7f941c004800 2024-09-19T09:14:47.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.835+0000 7f943259c640 1 --2- 172.21.15.18:0/3725983924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f941c0039b0 0x7f941c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:47.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.835+0000 7f9431d9b640 1 --2- 172.21.15.18:0/3725983924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f941c004800 0x7f941c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:47.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.835+0000 7f9432d9d640 1 --2- 172.21.15.18:0/3725983924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f941c0051c0 0x7f941c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:47.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.835+0000 7f943259c640 1 -- 172.21.15.18:0/3725983924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f941c004800 msgr2=0x7f941c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:47.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.835+0000 7f943259c640 1 --2- 172.21.15.18:0/3725983924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f941c004800 0x7f941c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.835+0000 7f943259c640 1 -- 172.21.15.18:0/3725983924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f941c0051c0 msgr2=0x7f941c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:47.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.835+0000 7f943259c640 1 --2- 172.21.15.18:0/3725983924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f941c0051c0 0x7f941c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.835+0000 7f943259c640 1 -- 172.21.15.18:0/3725983924 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f941c003520 con 0x7f941c0039b0 2024-09-19T09:14:47.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.835+0000 7f9432d9d640 1 --2- 172.21.15.18:0/3725983924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f941c0051c0 0x7f941c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:47.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.835+0000 7f9432d9d640 1 -- 172.21.15.18:0/3725983924 reap_dead start 2024-09-19T09:14:47.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.835+0000 7f943259c640 1 --2- 172.21.15.18:0/3725983924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f941c0039b0 0x7f941c003dd0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9424001750 tx=0x7f941c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cda1a9332a5eadb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:47.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.836+0000 7f943159a640 1 -- 172.21.15.18:0/3725983924 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9424001370 con 0x7f941c0039b0 2024-09-19T09:14:47.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.836+0000 7f943159a640 1 -- 172.21.15.18:0/3725983924 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94240052d0 con 0x7f941c0039b0 2024-09-19T09:14:47.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.836+0000 7f943159a640 1 -- 172.21.15.18:0/3725983924 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942402abc0 con 0x7f941c0039b0 2024-09-19T09:14:47.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.836+0000 7f9438a1e640 1 -- 172.21.15.18:0/3725983924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f941c0039b0 msgr2=0x7f941c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:47.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.836+0000 7f9438a1e640 1 --2- 172.21.15.18:0/3725983924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f941c0039b0 0x7f941c003dd0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9424001750 tx=0x7f941c005830 comp rx=0 tx=0).stop 2024-09-19T09:14:47.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.836+0000 7f9438a1e640 1 -- 172.21.15.18:0/3725983924 shutdown_connections 2024-09-19T09:14:47.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.836+0000 7f9438a1e640 1 --2- 172.21.15.18:0/3725983924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f941c0039b0 0x7f941c003dd0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.836+0000 7f9438a1e640 1 -- 172.21.15.18:0/3725983924 >> 172.21.15.18:0/3725983924 conn(0x7f94340d4bd0 msgr2=0x7f94340d4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:47.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.836+0000 7f9438a1e640 1 -- 172.21.15.18:0/3725983924 shutdown_connections 2024-09-19T09:14:47.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.836+0000 7f9438a1e640 1 -- 172.21.15.18:0/3725983924 wait complete. 2024-09-19T09:14:47.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.838+0000 7f9438a1e640 1 Processor -- start 2024-09-19T09:14:47.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.838+0000 7f9438a1e640 1 -- start start 2024-09-19T09:14:47.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.838+0000 7f9438a1e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f941c0039b0 0x7f94340ba3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:47.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.838+0000 7f9438a1e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9434156000 0x7f9434154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:47.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.838+0000 7f9438a1e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9434154e50 0x7f94341552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:47.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.838+0000 7f9438a1e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f943415f0a0 con 0x7f9434154e50 2024-09-19T09:14:47.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.838+0000 7f9438a1e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f94340b4b90 con 0x7f9434156000 2024-09-19T09:14:47.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.838+0000 7f9438a1e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f943415f220 con 0x7f941c0039b0 2024-09-19T09:14:47.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.839+0000 7f9432d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9434154e50 0x7f94341552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:47.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.839+0000 7f9432d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9434154e50 0x7f94341552d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53632/0 (socket says 172.21.15.18:53632) 2024-09-19T09:14:47.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.839+0000 7f9432d9d640 1 -- 172.21.15.18:0/2358574737 learned_addr learned my addr 172.21.15.18:0/2358574737 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:47.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.839+0000 7f943259c640 1 --2- 172.21.15.18:0/2358574737 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f941c0039b0 0x7f94340ba3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:47.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.839+0000 7f9431d9b640 1 --2- 172.21.15.18:0/2358574737 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9434156000 0x7f9434154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:47.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.839+0000 7f9432d9d640 1 -- 172.21.15.18:0/2358574737 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f941c0039b0 msgr2=0x7f94340ba3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:47.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.839+0000 7f9432d9d640 1 --2- 172.21.15.18:0/2358574737 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f941c0039b0 0x7f94340ba3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.839+0000 7f9432d9d640 1 -- 172.21.15.18:0/2358574737 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9434156000 msgr2=0x7f9434154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:47.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.839+0000 7f9432d9d640 1 --2- 172.21.15.18:0/2358574737 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9434156000 0x7f9434154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:47.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.839+0000 7f9432d9d640 1 -- 172.21.15.18:0/2358574737 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94340ba900 con 0x7f9434154e50 2024-09-19T09:14:47.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.839+0000 7f9432d9d640 1 --2- 172.21.15.18:0/2358574737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9434154e50 0x7f94341552d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f94340d40f0 tx=0x7f942c010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:47.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.839+0000 7f9422ffd640 1 -- 172.21.15.18:0/2358574737 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942c010da0 con 0x7f9434154e50 2024-09-19T09:14:47.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.839+0000 7f9422ffd640 1 -- 172.21.15.18:0/2358574737 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f942c003990 con 0x7f9434154e50 2024-09-19T09:14:47.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.839+0000 7f9438a1e640 1 -- 172.21.15.18:0/2358574737 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9434161850 con 0x7f9434154e50 2024-09-19T09:14:47.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.839+0000 7f9422ffd640 1 -- 172.21.15.18:0/2358574737 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942c003d80 con 0x7f9434154e50 2024-09-19T09:14:47.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.839+0000 7f9438a1e640 1 -- 172.21.15.18:0/2358574737 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9434161e10 con 0x7f9434154e50 2024-09-19T09:14:47.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.840+0000 7f9438a1e640 1 -- 172.21.15.18:0/2358574737 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94340d1600 con 0x7f9434154e50 2024-09-19T09:14:47.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.841+0000 7f9422ffd640 1 -- 172.21.15.18:0/2358574737 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f942c01e020 con 0x7f9434154e50 2024-09-19T09:14:47.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.841+0000 7f9422ffd640 1 --2- 172.21.15.18:0/2358574737 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f941406c2e0 0x7f941406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:47.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.841+0000 7f9422ffd640 1 -- 172.21.15.18:0/2358574737 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f942c08b840 con 0x7f9434154e50 2024-09-19T09:14:47.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.841+0000 7f943259c640 1 --2- 172.21.15.18:0/2358574737 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f941406c2e0 0x7f941406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:47.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.842+0000 7f943259c640 1 --2- 172.21.15.18:0/2358574737 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f941406c2e0 0x7f941406e7a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9424032000 tx=0x7f942402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:47.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:47.846+0000 7f9422ffd640 1 -- 172.21.15.18:0/2358574737 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f94340ba900 con 0x7f9434154e50 2024-09-19T09:14:48.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.087+0000 7f9438a1e640 1 -- 172.21.15.18:0/2358574737 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f94340b31d0 con 0x7f9434154e50 2024-09-19T09:14:48.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.088+0000 7f9422ffd640 1 -- 172.21.15.18:0/2358574737 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1467 (secure 0 0 0) 0x7f942c0599f0 con 0x7f9434154e50 2024-09-19T09:14:48.089 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:48.089 INFO:teuthology.orchestra.run.smithi018.stdout:{"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":96,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":48,"num_osds":8,"num_up_osds":8,"osd_up_since":1726737196,"num_in_osds":8,"osd_in_since":1726737193,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":3032920,"bytes_avail":1596967080,"bytes_total":1600000000,"write_bytes_sec":2587,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":21,"btime":"2024-09-19T09:14:46:022043+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5187}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-09-19T09:14:27.538010+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T09:14:48.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.090+0000 7f9438a1e640 1 -- 172.21.15.18:0/2358574737 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f941406c2e0 msgr2=0x7f941406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:48.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.090+0000 7f9438a1e640 1 --2- 172.21.15.18:0/2358574737 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f941406c2e0 0x7f941406e7a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9424032000 tx=0x7f942402e000 comp rx=0 tx=0).stop 2024-09-19T09:14:48.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.090+0000 7f9438a1e640 1 -- 172.21.15.18:0/2358574737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9434154e50 msgr2=0x7f94341552d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:48.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.090+0000 7f9438a1e640 1 --2- 172.21.15.18:0/2358574737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9434154e50 0x7f94341552d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f94340d40f0 tx=0x7f942c010590 comp rx=0 tx=0).stop 2024-09-19T09:14:48.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.090+0000 7f9438a1e640 1 -- 172.21.15.18:0/2358574737 shutdown_connections 2024-09-19T09:14:48.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.090+0000 7f9438a1e640 1 --2- 172.21.15.18:0/2358574737 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f941406c2e0 0x7f941406e7a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:48.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.090+0000 7f9438a1e640 1 --2- 172.21.15.18:0/2358574737 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9434154e50 0x7f94341552d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:48.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.090+0000 7f9438a1e640 1 --2- 172.21.15.18:0/2358574737 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9434156000 0x7f9434154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:48.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.090+0000 7f9438a1e640 1 --2- 172.21.15.18:0/2358574737 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f941c0039b0 0x7f94340ba3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:48.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.090+0000 7f9438a1e640 1 -- 172.21.15.18:0/2358574737 >> 172.21.15.18:0/2358574737 conn(0x7f94340d4bd0 msgr2=0x7f94340b52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:48.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.090+0000 7f9438a1e640 1 -- 172.21.15.18:0/2358574737 shutdown_connections 2024-09-19T09:14:48.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.090+0000 7f9438a1e640 1 -- 172.21.15.18:0/2358574737 wait complete. 2024-09-19T09:14:48.101 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-19T09:14:48.102 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:14:48.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.203+0000 7f65ea2c9640 1 Processor -- start 2024-09-19T09:14:48.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.203+0000 7f65ea2c9640 1 -- start start 2024-09-19T09:14:48.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.204+0000 7f65ea2c9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65e40d10a0 0x7f65e40d1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:48.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.204+0000 7f65ea2c9640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65e40b1f20 con 0x7f65e40ce7b0 2024-09-19T09:14:48.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.204+0000 7f65ea2c9640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65e40cd710 con 0x7f65e415cd60 2024-09-19T09:14:48.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.204+0000 7f65ea2c9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f65e40cd9f0 con 0x7f65e40d10a0 2024-09-19T09:14:48.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.204+0000 7f65e8866640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f65e40ce7b0 0x7f65e4067950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59870/0 (socket says 172.21.15.18:59870) 2024-09-19T09:14:48.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.204+0000 7f65e8866640 1 -- 172.21.15.18:0/2626192138 learned_addr learned my addr 172.21.15.18:0/2626192138 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:48.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.204+0000 7f65e2ffd640 1 -- 172.21.15.18:0/2626192138 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3363697909 0 0) 0x7f65e40b1f20 con 0x7f65e40ce7b0 2024-09-19T09:14:48.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.204+0000 7f65e3fff640 1 --2- 172.21.15.18:0/2626192138 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65e40d10a0 0x7f65e40d1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:48.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.204+0000 7f65e2ffd640 1 -- 172.21.15.18:0/2626192138 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65cc003520 con 0x7f65e40ce7b0 2024-09-19T09:14:48.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.205+0000 7f65e2ffd640 1 -- 172.21.15.18:0/2626192138 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3914352078 0 0) 0x7f65cc003520 con 0x7f65e40ce7b0 2024-09-19T09:14:48.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.205+0000 7f65e2ffd640 1 -- 172.21.15.18:0/2626192138 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65e40d10a0 msgr2=0x7f65e40d1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:48.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.205+0000 7f65e2ffd640 1 --2- 172.21.15.18:0/2626192138 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65e40d10a0 0x7f65e40d1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:48.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.205+0000 7f65e2ffd640 1 -- 172.21.15.18:0/2626192138 >> v1:172.21.15.162:6789/0 conn(0x7f65e415cd60 legacy=0x7f65e40d1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:48.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.205+0000 7f65e2ffd640 1 -- 172.21.15.18:0/2626192138 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65e40cdcd0 con 0x7f65e40ce7b0 2024-09-19T09:14:48.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.205+0000 7f65e2ffd640 1 -- 172.21.15.18:0/2626192138 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f65dc0019f0 con 0x7f65e40ce7b0 2024-09-19T09:14:48.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.205+0000 7f65e2ffd640 1 -- 172.21.15.18:0/2626192138 >> v1:172.21.15.18:6789/0 conn(0x7f65e40ce7b0 legacy=0x7f65e4067950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:48.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.205+0000 7f65e2ffd640 1 --2- 172.21.15.18:0/2626192138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65cc0039e0 0x7f65cc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:48.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.205+0000 7f65e2ffd640 1 --2- 172.21.15.18:0/2626192138 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65e40d10a0 0x7f65cc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:48.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.205+0000 7f65e2ffd640 1 --2- 172.21.15.18:0/2626192138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65cc004d40 0x7f65cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:48.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.205+0000 7f65e2ffd640 1 -- 172.21.15.18:0/2626192138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f65e40cd9f0 con 0x7f65cc004d40 2024-09-19T09:14:48.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.205+0000 7f65e2ffd640 1 -- 172.21.15.18:0/2626192138 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc00ba70 con 0x7f65cc0039e0 2024-09-19T09:14:48.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.205+0000 7f65e2ffd640 1 -- 172.21.15.18:0/2626192138 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f65cc00bc70 con 0x7f65e40d10a0 2024-09-19T09:14:48.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.205+0000 7f65e8866640 1 --2- 172.21.15.18:0/2626192138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65cc004d40 0x7f65cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:48.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.205+0000 7f65e3fff640 1 --2- 172.21.15.18:0/2626192138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65cc0039e0 0x7f65cc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:48.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.205+0000 7f65e37fe640 1 --2- 172.21.15.18:0/2626192138 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65e40d10a0 0x7f65cc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:48.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.205+0000 7f65e8866640 1 -- 172.21.15.18:0/2626192138 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65e40d10a0 msgr2=0x7f65cc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:48.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.205+0000 7f65e8866640 1 --2- 172.21.15.18:0/2626192138 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65e40d10a0 0x7f65cc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:48.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.205+0000 7f65e8866640 1 -- 172.21.15.18:0/2626192138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65cc0039e0 msgr2=0x7f65cc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:48.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.205+0000 7f65e8866640 1 --2- 172.21.15.18:0/2626192138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65cc0039e0 0x7f65cc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:48.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.205+0000 7f65e8866640 1 -- 172.21.15.18:0/2626192138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65cc003520 con 0x7f65cc004d40 2024-09-19T09:14:48.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.206+0000 7f65e8866640 1 --2- 172.21.15.18:0/2626192138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65cc004d40 0x7f65cc0051c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f65e4072290 tx=0x7f65cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5146797e0e8bf263 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:48.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.206+0000 7f65e2ffd640 1 -- 172.21.15.18:0/2626192138 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65dc00a4c0 con 0x7f65cc004d40 2024-09-19T09:14:48.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.206+0000 7f65e2ffd640 1 -- 172.21.15.18:0/2626192138 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65dc02f070 con 0x7f65cc004d40 2024-09-19T09:14:48.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.206+0000 7f65e2ffd640 1 -- 172.21.15.18:0/2626192138 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65dc02bc30 con 0x7f65cc004d40 2024-09-19T09:14:48.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.206+0000 7f65ea2c9640 1 -- 172.21.15.18:0/2626192138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65cc004d40 msgr2=0x7f65cc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:48.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.206+0000 7f65ea2c9640 1 --2- 172.21.15.18:0/2626192138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65cc004d40 0x7f65cc0051c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f65e4072290 tx=0x7f65cc005830 comp rx=0 tx=0).stop 2024-09-19T09:14:48.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.206+0000 7f65e8866640 1 -- 172.21.15.18:0/2626192138 reap_dead start 2024-09-19T09:14:48.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.206+0000 7f65ea2c9640 1 -- 172.21.15.18:0/2626192138 shutdown_connections 2024-09-19T09:14:48.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.206+0000 7f65ea2c9640 1 -- 172.21.15.18:0/2626192138 >> 172.21.15.18:0/2626192138 conn(0x7f65e40731b0 msgr2=0x7f65e40735c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:48.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.206+0000 7f65ea2c9640 1 -- 172.21.15.18:0/2626192138 shutdown_connections 2024-09-19T09:14:48.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.207+0000 7f65ea2c9640 1 -- 172.21.15.18:0/2626192138 wait complete. 2024-09-19T09:14:48.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.208+0000 7f65ea2c9640 1 Processor -- start 2024-09-19T09:14:48.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.208+0000 7f65ea2c9640 1 -- start start 2024-09-19T09:14:48.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.209+0000 7f65ea2c9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65e415fa50 0x7f65e40ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:48.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.209+0000 7f65ea2c9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65e41e7f00 0x7f65e41e6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:48.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.209+0000 7f65ea2c9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65e406e3c0 0x7f65e406e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:48.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.209+0000 7f65ea2c9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f65e40d1d20 con 0x7f65e41e7f00 2024-09-19T09:14:48.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.209+0000 7f65ea2c9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f65e40ce290 con 0x7f65e406e3c0 2024-09-19T09:14:48.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.209+0000 7f65ea2c9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f65e40d1ea0 con 0x7f65e415fa50 2024-09-19T09:14:48.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.209+0000 7f65e37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65e41e7f00 0x7f65e41e6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:48.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.209+0000 7f65e37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65e41e7f00 0x7f65e41e6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53642/0 (socket says 172.21.15.18:53642) 2024-09-19T09:14:48.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.209+0000 7f65e37fe640 1 -- 172.21.15.18:0/2246098741 learned_addr learned my addr 172.21.15.18:0/2246098741 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:48.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.209+0000 7f65e3fff640 1 --2- 172.21.15.18:0/2246098741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65e415fa50 0x7f65e40ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:48.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.209+0000 7f65e8866640 1 --2- 172.21.15.18:0/2246098741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65e406e3c0 0x7f65e406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:48.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.209+0000 7f65e37fe640 1 -- 172.21.15.18:0/2246098741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65e415fa50 msgr2=0x7f65e40ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:48.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.209+0000 7f65e37fe640 1 --2- 172.21.15.18:0/2246098741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65e415fa50 0x7f65e40ca4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:48.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.209+0000 7f65e37fe640 1 -- 172.21.15.18:0/2246098741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65e406e3c0 msgr2=0x7f65e406e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:48.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.209+0000 7f65e37fe640 1 --2- 172.21.15.18:0/2246098741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65e406e3c0 0x7f65e406e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:48.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.209+0000 7f65e37fe640 1 -- 172.21.15.18:0/2246098741 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65e415fe30 con 0x7f65e41e7f00 2024-09-19T09:14:48.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.209+0000 7f65e37fe640 1 --2- 172.21.15.18:0/2246098741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65e41e7f00 0x7f65e41e6e90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f65d800e5b0 tx=0x7f65d800e9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:48.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.209+0000 7f65e0ff9640 1 -- 172.21.15.18:0/2246098741 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d80052e0 con 0x7f65e41e7f00 2024-09-19T09:14:48.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.209+0000 7f65e0ff9640 1 -- 172.21.15.18:0/2246098741 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d8018070 con 0x7f65e41e7f00 2024-09-19T09:14:48.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.209+0000 7f65e0ff9640 1 -- 172.21.15.18:0/2246098741 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d8003810 con 0x7f65e41e7f00 2024-09-19T09:14:48.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.209+0000 7f65ea2c9640 1 -- 172.21.15.18:0/2246098741 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65e40cad10 con 0x7f65e41e7f00 2024-09-19T09:14:48.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.209+0000 7f65ea2c9640 1 -- 172.21.15.18:0/2246098741 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65e41e63b0 con 0x7f65e41e7f00 2024-09-19T09:14:48.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.210+0000 7f65ea2c9640 1 -- 172.21.15.18:0/2246098741 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65e406ed80 con 0x7f65e41e7f00 2024-09-19T09:14:48.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.211+0000 7f65e0ff9640 1 -- 172.21.15.18:0/2246098741 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f65d80039b0 con 0x7f65e41e7f00 2024-09-19T09:14:48.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.211+0000 7f65e0ff9640 1 --2- 172.21.15.18:0/2246098741 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f65d006c2b0 0x7f65d006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:48.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.211+0000 7f65e0ff9640 1 -- 172.21.15.18:0/2246098741 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f65d808aeb0 con 0x7f65e41e7f00 2024-09-19T09:14:48.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.211+0000 7f65e3fff640 1 --2- 172.21.15.18:0/2246098741 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f65d006c2b0 0x7f65d006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:48.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.212+0000 7f65e3fff640 1 --2- 172.21.15.18:0/2246098741 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f65d006c2b0 0x7f65d006e770 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f65d4009bc0 tx=0x7f65d4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:48.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.216+0000 7f65e0ff9640 1 -- 172.21.15.18:0/2246098741 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f65d8059620 con 0x7f65e41e7f00 2024-09-19T09:14:48.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.387+0000 7f65ea2c9640 1 -- 172.21.15.18:0/2246098741 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f65e4160430 con 0x7f65d006c2b0 2024-09-19T09:14:48.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.393+0000 7f65e0ff9640 1 -- 172.21.15.18:0/2246098741 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247491 (secure 0 0 0) 0x7f65e4160430 con 0x7f65d006c2b0 2024-09-19T09:14:48.396 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:48.397 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:14:48.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.396+0000 7f65ea2c9640 1 -- 172.21.15.18:0/2246098741 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f65d006c2b0 msgr2=0x7f65d006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:48.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.396+0000 7f65ea2c9640 1 --2- 172.21.15.18:0/2246098741 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f65d006c2b0 0x7f65d006e770 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f65d4009bc0 tx=0x7f65d4009190 comp rx=0 tx=0).stop 2024-09-19T09:14:48.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.396+0000 7f65ea2c9640 1 -- 172.21.15.18:0/2246098741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65e41e7f00 msgr2=0x7f65e41e6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:48.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.396+0000 7f65ea2c9640 1 --2- 172.21.15.18:0/2246098741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65e41e7f00 0x7f65e41e6e90 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f65d800e5b0 tx=0x7f65d800e9b0 comp rx=0 tx=0).stop 2024-09-19T09:14:48.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.396+0000 7f65ea2c9640 1 -- 172.21.15.18:0/2246098741 shutdown_connections 2024-09-19T09:14:48.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.396+0000 7f65ea2c9640 1 --2- 172.21.15.18:0/2246098741 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f65d006c2b0 0x7f65d006e770 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:48.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.396+0000 7f65ea2c9640 1 --2- 172.21.15.18:0/2246098741 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65e406e3c0 0x7f65e406e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:48.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.396+0000 7f65ea2c9640 1 --2- 172.21.15.18:0/2246098741 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65e41e7f00 0x7f65e41e6e90 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:48.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.396+0000 7f65ea2c9640 1 --2- 172.21.15.18:0/2246098741 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65e415fa50 0x7f65e40ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:48.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.396+0000 7f65ea2c9640 1 -- 172.21.15.18:0/2246098741 >> 172.21.15.18:0/2246098741 conn(0x7f65e40731b0 msgr2=0x7f65e40b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:48.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.396+0000 7f65ea2c9640 1 -- 172.21.15.18:0/2246098741 shutdown_connections 2024-09-19T09:14:48.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:48.396+0000 7f65ea2c9640 1 -- 172.21.15.18:0/2246098741 wait complete. 2024-09-19T09:14:48.408 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2024-09-19T09:14:47.541567+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":180,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2961,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559538,"statfs":{"total":1600000000,"available":1596967080,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.541156"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.855751+0000","last_change":"2024-09-19T09:14:44.029278+0000","last_active":"2024-09-19T09:14:45.855751+0000","last_peered":"2024-09-19T09:14:45.855751+0000","last_clean":"2024-09-19T09:14:45.855751+0000","last_became_active":"2024-09-19T09:14:44.028929+0000","last_became_peered":"2024-09-19T09:14:44.028929+0000","last_unstale":"2024-09-19T09:14:45.855751+0000","last_undegraded":"2024-09-19T09:14:45.855751+0000","last_fullsized":"2024-09-19T09:14:45.855751+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:09.289159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023364+0000","last_change":"2024-09-19T09:14:44.023434+0000","last_active":"2024-09-19T09:14:45.023364+0000","last_peered":"2024-09-19T09:14:45.023364+0000","last_clean":"2024-09-19T09:14:45.023364+0000","last_became_active":"2024-09-19T09:14:44.023158+0000","last_became_peered":"2024-09-19T09:14:44.023158+0000","last_unstale":"2024-09-19T09:14:45.023364+0000","last_undegraded":"2024-09-19T09:14:45.023364+0000","last_fullsized":"2024-09-19T09:14:45.023364+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:23.119386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023818+0000","last_change":"2024-09-19T09:14:44.026325+0000","last_active":"2024-09-19T09:14:45.023818+0000","last_peered":"2024-09-19T09:14:45.023818+0000","last_clean":"2024-09-19T09:14:45.023818+0000","last_became_active":"2024-09-19T09:14:44.026012+0000","last_became_peered":"2024-09-19T09:14:44.026012+0000","last_unstale":"2024-09-19T09:14:45.023818+0000","last_undegraded":"2024-09-19T09:14:45.023818+0000","last_fullsized":"2024-09-19T09:14:45.023818+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:13.259685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025616+0000","last_change":"2024-09-19T09:14:44.019374+0000","last_active":"2024-09-19T09:14:45.025616+0000","last_peered":"2024-09-19T09:14:45.025616+0000","last_clean":"2024-09-19T09:14:45.025616+0000","last_became_active":"2024-09-19T09:14:44.018900+0000","last_became_peered":"2024-09-19T09:14:44.018900+0000","last_unstale":"2024-09-19T09:14:45.025616+0000","last_undegraded":"2024-09-19T09:14:45.025616+0000","last_fullsized":"2024-09-19T09:14:45.025616+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:10:19.362096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.855697+0000","last_change":"2024-09-19T09:14:44.016835+0000","last_active":"2024-09-19T09:14:45.855697+0000","last_peered":"2024-09-19T09:14:45.855697+0000","last_clean":"2024-09-19T09:14:45.855697+0000","last_became_active":"2024-09-19T09:14:44.016574+0000","last_became_peered":"2024-09-19T09:14:44.016574+0000","last_unstale":"2024-09-19T09:14:45.855697+0000","last_undegraded":"2024-09-19T09:14:45.855697+0000","last_fullsized":"2024-09-19T09:14:45.855697+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:47.901790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579564+0000","last_change":"2024-09-19T09:14:44.015759+0000","last_active":"2024-09-19T09:14:45.579564+0000","last_peered":"2024-09-19T09:14:45.579564+0000","last_clean":"2024-09-19T09:14:45.579564+0000","last_became_active":"2024-09-19T09:14:44.015212+0000","last_became_peered":"2024-09-19T09:14:44.015212+0000","last_unstale":"2024-09-19T09:14:45.579564+0000","last_undegraded":"2024-09-19T09:14:45.579564+0000","last_fullsized":"2024-09-19T09:14:45.579564+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:08.971150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.026921+0000","last_change":"2024-09-19T09:14:44.021729+0000","last_active":"2024-09-19T09:14:45.026921+0000","last_peered":"2024-09-19T09:14:45.026921+0000","last_clean":"2024-09-19T09:14:45.026921+0000","last_became_active":"2024-09-19T09:14:44.020854+0000","last_became_peered":"2024-09-19T09:14:44.020854+0000","last_unstale":"2024-09-19T09:14:45.026921+0000","last_undegraded":"2024-09-19T09:14:45.026921+0000","last_fullsized":"2024-09-19T09:14:45.026921+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:57.512333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025457+0000","last_change":"2024-09-19T09:14:44.019723+0000","last_active":"2024-09-19T09:14:45.025457+0000","last_peered":"2024-09-19T09:14:45.025457+0000","last_clean":"2024-09-19T09:14:45.025457+0000","last_became_active":"2024-09-19T09:14:44.018191+0000","last_became_peered":"2024-09-19T09:14:44.018191+0000","last_unstale":"2024-09-19T09:14:45.025457+0000","last_undegraded":"2024-09-19T09:14:45.025457+0000","last_fullsized":"2024-09-19T09:14:45.025457+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:16.158285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579413+0000","last_change":"2024-09-19T09:14:44.026530+0000","last_active":"2024-09-19T09:14:45.579413+0000","last_peered":"2024-09-19T09:14:45.579413+0000","last_clean":"2024-09-19T09:14:45.579413+0000","last_became_active":"2024-09-19T09:14:44.026301+0000","last_became_peered":"2024-09-19T09:14:44.026301+0000","last_unstale":"2024-09-19T09:14:45.579413+0000","last_undegraded":"2024-09-19T09:14:45.579413+0000","last_fullsized":"2024-09-19T09:14:45.579413+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:46.873170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.380606+0000","last_change":"2024-09-19T09:14:44.023745+0000","last_active":"2024-09-19T09:14:45.380606+0000","last_peered":"2024-09-19T09:14:45.380606+0000","last_clean":"2024-09-19T09:14:45.380606+0000","last_became_active":"2024-09-19T09:14:44.022892+0000","last_became_peered":"2024-09-19T09:14:44.022892+0000","last_unstale":"2024-09-19T09:14:45.380606+0000","last_undegraded":"2024-09-19T09:14:45.380606+0000","last_fullsized":"2024-09-19T09:14:45.380606+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:36.520416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025550+0000","last_change":"2024-09-19T09:14:44.016533+0000","last_active":"2024-09-19T09:14:45.025550+0000","last_peered":"2024-09-19T09:14:45.025550+0000","last_clean":"2024-09-19T09:14:45.025550+0000","last_became_active":"2024-09-19T09:14:44.016289+0000","last_became_peered":"2024-09-19T09:14:44.016289+0000","last_unstale":"2024-09-19T09:14:45.025550+0000","last_undegraded":"2024-09-19T09:14:45.025550+0000","last_fullsized":"2024-09-19T09:14:45.025550+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:05.136039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023495+0000","last_change":"2024-09-19T09:14:44.021440+0000","last_active":"2024-09-19T09:14:45.023495+0000","last_peered":"2024-09-19T09:14:45.023495+0000","last_clean":"2024-09-19T09:14:45.023495+0000","last_became_active":"2024-09-19T09:14:44.020755+0000","last_became_peered":"2024-09-19T09:14:44.020755+0000","last_unstale":"2024-09-19T09:14:45.023495+0000","last_undegraded":"2024-09-19T09:14:45.023495+0000","last_fullsized":"2024-09-19T09:14:45.023495+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:21.918635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579411+0000","last_change":"2024-09-19T09:14:44.019410+0000","last_active":"2024-09-19T09:14:45.579411+0000","last_peered":"2024-09-19T09:14:45.579411+0000","last_clean":"2024-09-19T09:14:45.579411+0000","last_became_active":"2024-09-19T09:14:44.019176+0000","last_became_peered":"2024-09-19T09:14:44.019176+0000","last_unstale":"2024-09-19T09:14:45.579411+0000","last_undegraded":"2024-09-19T09:14:45.579411+0000","last_fullsized":"2024-09-19T09:14:45.579411+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:56:42.073869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.026100+0000","last_change":"2024-09-19T09:14:44.026653+0000","last_active":"2024-09-19T09:14:45.026100+0000","last_peered":"2024-09-19T09:14:45.026100+0000","last_clean":"2024-09-19T09:14:45.026100+0000","last_became_active":"2024-09-19T09:14:44.025208+0000","last_became_peered":"2024-09-19T09:14:44.025208+0000","last_unstale":"2024-09-19T09:14:45.026100+0000","last_undegraded":"2024-09-19T09:14:45.026100+0000","last_fullsized":"2024-09-19T09:14:45.026100+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:31.011663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025521+0000","last_change":"2024-09-19T09:14:44.022107+0000","last_active":"2024-09-19T09:14:45.025521+0000","last_peered":"2024-09-19T09:14:45.025521+0000","last_clean":"2024-09-19T09:14:45.025521+0000","last_became_active":"2024-09-19T09:14:44.021857+0000","last_became_peered":"2024-09-19T09:14:44.021857+0000","last_unstale":"2024-09-19T09:14:45.025521+0000","last_undegraded":"2024-09-19T09:14:45.025521+0000","last_fullsized":"2024-09-19T09:14:45.025521+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:18.924610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.855991+0000","last_change":"2024-09-19T09:14:44.028561+0000","last_active":"2024-09-19T09:14:45.855991+0000","last_peered":"2024-09-19T09:14:45.855991+0000","last_clean":"2024-09-19T09:14:45.855991+0000","last_became_active":"2024-09-19T09:14:44.027606+0000","last_became_peered":"2024-09-19T09:14:44.027606+0000","last_unstale":"2024-09-19T09:14:45.855991+0000","last_undegraded":"2024-09-19T09:14:45.855991+0000","last_fullsized":"2024-09-19T09:14:45.855991+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:55:01.394733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023637+0000","last_change":"2024-09-19T09:14:44.024576+0000","last_active":"2024-09-19T09:14:45.023637+0000","last_peered":"2024-09-19T09:14:45.023637+0000","last_clean":"2024-09-19T09:14:45.023637+0000","last_became_active":"2024-09-19T09:14:44.024110+0000","last_became_peered":"2024-09-19T09:14:44.024110+0000","last_unstale":"2024-09-19T09:14:45.023637+0000","last_undegraded":"2024-09-19T09:14:45.023637+0000","last_fullsized":"2024-09-19T09:14:45.023637+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:38.515108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023956+0000","last_change":"2024-09-19T09:14:44.025103+0000","last_active":"2024-09-19T09:14:45.023956+0000","last_peered":"2024-09-19T09:14:45.023956+0000","last_clean":"2024-09-19T09:14:45.023956+0000","last_became_active":"2024-09-19T09:14:44.024726+0000","last_became_peered":"2024-09-19T09:14:44.024726+0000","last_unstale":"2024-09-19T09:14:45.023956+0000","last_undegraded":"2024-09-19T09:14:45.023956+0000","last_fullsized":"2024-09-19T09:14:45.023956+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:47.017256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.855784+0000","last_change":"2024-09-19T09:14:44.016090+0000","last_active":"2024-09-19T09:14:45.855784+0000","last_peered":"2024-09-19T09:14:45.855784+0000","last_clean":"2024-09-19T09:14:45.855784+0000","last_became_active":"2024-09-19T09:14:44.015791+0000","last_became_peered":"2024-09-19T09:14:44.015791+0000","last_unstale":"2024-09-19T09:14:45.855784+0000","last_undegraded":"2024-09-19T09:14:45.855784+0000","last_fullsized":"2024-09-19T09:14:45.855784+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:30.893989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.380958+0000","last_change":"2024-09-19T09:14:44.018780+0000","last_active":"2024-09-19T09:14:45.380958+0000","last_peered":"2024-09-19T09:14:45.380958+0000","last_clean":"2024-09-19T09:14:45.380958+0000","last_became_active":"2024-09-19T09:14:44.018547+0000","last_became_peered":"2024-09-19T09:14:44.018547+0000","last_unstale":"2024-09-19T09:14:45.380958+0000","last_undegraded":"2024-09-19T09:14:45.380958+0000","last_fullsized":"2024-09-19T09:14:45.380958+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:22:18.613092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025746+0000","last_change":"2024-09-19T09:14:44.023129+0000","last_active":"2024-09-19T09:14:45.025746+0000","last_peered":"2024-09-19T09:14:45.025746+0000","last_clean":"2024-09-19T09:14:45.025746+0000","last_became_active":"2024-09-19T09:14:44.022338+0000","last_became_peered":"2024-09-19T09:14:44.022338+0000","last_unstale":"2024-09-19T09:14:45.025746+0000","last_undegraded":"2024-09-19T09:14:45.025746+0000","last_fullsized":"2024-09-19T09:14:45.025746+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:20.131137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579033+0000","last_change":"2024-09-19T09:14:44.020481+0000","last_active":"2024-09-19T09:14:45.579033+0000","last_peered":"2024-09-19T09:14:45.579033+0000","last_clean":"2024-09-19T09:14:45.579033+0000","last_became_active":"2024-09-19T09:14:44.020243+0000","last_became_peered":"2024-09-19T09:14:44.020243+0000","last_unstale":"2024-09-19T09:14:45.579033+0000","last_undegraded":"2024-09-19T09:14:45.579033+0000","last_fullsized":"2024-09-19T09:14:45.579033+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:44.313933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027308+0000","last_change":"2024-09-19T09:14:44.016953+0000","last_active":"2024-09-19T09:14:45.027308+0000","last_peered":"2024-09-19T09:14:45.027308+0000","last_clean":"2024-09-19T09:14:45.027308+0000","last_became_active":"2024-09-19T09:14:44.016719+0000","last_became_peered":"2024-09-19T09:14:44.016719+0000","last_unstale":"2024-09-19T09:14:45.027308+0000","last_undegraded":"2024-09-19T09:14:45.027308+0000","last_fullsized":"2024-09-19T09:14:45.027308+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:50.777345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023984+0000","last_change":"2024-09-19T09:14:44.014815+0000","last_active":"2024-09-19T09:14:45.023984+0000","last_peered":"2024-09-19T09:14:45.023984+0000","last_clean":"2024-09-19T09:14:45.023984+0000","last_became_active":"2024-09-19T09:14:44.014572+0000","last_became_peered":"2024-09-19T09:14:44.014572+0000","last_unstale":"2024-09-19T09:14:45.023984+0000","last_undegraded":"2024-09-19T09:14:45.023984+0000","last_fullsized":"2024-09-19T09:14:45.023984+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:14.082571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.855858+0000","last_change":"2024-09-19T09:14:44.022461+0000","last_active":"2024-09-19T09:14:45.855858+0000","last_peered":"2024-09-19T09:14:45.855858+0000","last_clean":"2024-09-19T09:14:45.855858+0000","last_became_active":"2024-09-19T09:14:44.022163+0000","last_became_peered":"2024-09-19T09:14:44.022163+0000","last_unstale":"2024-09-19T09:14:45.855858+0000","last_undegraded":"2024-09-19T09:14:45.855858+0000","last_fullsized":"2024-09-19T09:14:45.855858+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:04:00.402110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025848+0000","last_change":"2024-09-19T09:14:44.018197+0000","last_active":"2024-09-19T09:14:45.025848+0000","last_peered":"2024-09-19T09:14:45.025848+0000","last_clean":"2024-09-19T09:14:45.025848+0000","last_became_active":"2024-09-19T09:14:44.016868+0000","last_became_peered":"2024-09-19T09:14:44.016868+0000","last_unstale":"2024-09-19T09:14:45.025848+0000","last_undegraded":"2024-09-19T09:14:45.025848+0000","last_fullsized":"2024-09-19T09:14:45.025848+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:00.498567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027069+0000","last_change":"2024-09-19T09:14:44.026325+0000","last_active":"2024-09-19T09:14:45.027069+0000","last_peered":"2024-09-19T09:14:45.027069+0000","last_clean":"2024-09-19T09:14:45.027069+0000","last_became_active":"2024-09-19T09:14:44.026047+0000","last_became_peered":"2024-09-19T09:14:44.026047+0000","last_unstale":"2024-09-19T09:14:45.027069+0000","last_undegraded":"2024-09-19T09:14:45.027069+0000","last_fullsized":"2024-09-19T09:14:45.027069+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:00:09.035109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.026917+0000","last_change":"2024-09-19T09:14:44.016015+0000","last_active":"2024-09-19T09:14:45.026917+0000","last_peered":"2024-09-19T09:14:45.026917+0000","last_clean":"2024-09-19T09:14:45.026917+0000","last_became_active":"2024-09-19T09:14:44.015604+0000","last_became_peered":"2024-09-19T09:14:44.015604+0000","last_unstale":"2024-09-19T09:14:45.026917+0000","last_undegraded":"2024-09-19T09:14:45.026917+0000","last_fullsized":"2024-09-19T09:14:45.026917+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:45.500407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.855548+0000","last_change":"2024-09-19T09:14:44.025696+0000","last_active":"2024-09-19T09:14:45.855548+0000","last_peered":"2024-09-19T09:14:45.855548+0000","last_clean":"2024-09-19T09:14:45.855548+0000","last_became_active":"2024-09-19T09:14:44.025462+0000","last_became_peered":"2024-09-19T09:14:44.025462+0000","last_unstale":"2024-09-19T09:14:45.855548+0000","last_undegraded":"2024-09-19T09:14:45.855548+0000","last_fullsized":"2024-09-19T09:14:45.855548+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:28.292632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023589+0000","last_change":"2024-09-19T09:14:44.019656+0000","last_active":"2024-09-19T09:14:45.023589+0000","last_peered":"2024-09-19T09:14:45.023589+0000","last_clean":"2024-09-19T09:14:45.023589+0000","last_became_active":"2024-09-19T09:14:44.019426+0000","last_became_peered":"2024-09-19T09:14:44.019426+0000","last_unstale":"2024-09-19T09:14:45.023589+0000","last_undegraded":"2024-09-19T09:14:45.023589+0000","last_fullsized":"2024-09-19T09:14:45.023589+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:08.366531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579714+0000","last_change":"2024-09-19T09:14:44.029037+0000","last_active":"2024-09-19T09:14:45.579714+0000","last_peered":"2024-09-19T09:14:45.579714+0000","last_clean":"2024-09-19T09:14:45.579714+0000","last_became_active":"2024-09-19T09:14:44.028740+0000","last_became_peered":"2024-09-19T09:14:44.028740+0000","last_unstale":"2024-09-19T09:14:45.579714+0000","last_undegraded":"2024-09-19T09:14:45.579714+0000","last_fullsized":"2024-09-19T09:14:45.579714+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:13.673571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025691+0000","last_change":"2024-09-19T09:14:44.013682+0000","last_active":"2024-09-19T09:14:45.025691+0000","last_peered":"2024-09-19T09:14:45.025691+0000","last_clean":"2024-09-19T09:14:45.025691+0000","last_became_active":"2024-09-19T09:14:44.012991+0000","last_became_peered":"2024-09-19T09:14:44.012991+0000","last_unstale":"2024-09-19T09:14:45.025691+0000","last_undegraded":"2024-09-19T09:14:45.025691+0000","last_fullsized":"2024-09-19T09:14:45.025691+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:32.721701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.578807+0000","last_change":"2024-09-19T09:14:44.025357+0000","last_active":"2024-09-19T09:14:45.578807+0000","last_peered":"2024-09-19T09:14:45.578807+0000","last_clean":"2024-09-19T09:14:45.578807+0000","last_became_active":"2024-09-19T09:14:44.024786+0000","last_became_peered":"2024-09-19T09:14:44.024786+0000","last_unstale":"2024-09-19T09:14:45.578807+0000","last_undegraded":"2024-09-19T09:14:45.578807+0000","last_fullsized":"2024-09-19T09:14:45.578807+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:59.293856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"47'4","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579623+0000","last_change":"2024-09-19T09:14:43.020742+0000","last_active":"2024-09-19T09:14:45.579623+0000","last_peered":"2024-09-19T09:14:45.579623+0000","last_clean":"2024-09-19T09:14:45.579623+0000","last_became_active":"2024-09-19T09:14:43.020526+0000","last_became_peered":"2024-09-19T09:14:43.020526+0000","last_unstale":"2024-09-19T09:14:45.579623+0000","last_undegraded":"2024-09-19T09:14:45.579623+0000","last_fullsized":"2024-09-19T09:14:45.579623+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:38.025292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.855925+0000","last_change":"2024-09-19T09:14:44.016202+0000","last_active":"2024-09-19T09:14:45.855925+0000","last_peered":"2024-09-19T09:14:45.855925+0000","last_clean":"2024-09-19T09:14:45.855925+0000","last_became_active":"2024-09-19T09:14:44.015862+0000","last_became_peered":"2024-09-19T09:14:44.015862+0000","last_unstale":"2024-09-19T09:14:45.855925+0000","last_undegraded":"2024-09-19T09:14:45.855925+0000","last_fullsized":"2024-09-19T09:14:45.855925+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:29.501504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027213+0000","last_change":"2024-09-19T09:14:43.017838+0000","last_active":"2024-09-19T09:14:45.027213+0000","last_peered":"2024-09-19T09:14:45.027213+0000","last_clean":"2024-09-19T09:14:45.027213+0000","last_became_active":"2024-09-19T09:14:43.017558+0000","last_became_peered":"2024-09-19T09:14:43.017558+0000","last_unstale":"2024-09-19T09:14:45.027213+0000","last_undegraded":"2024-09-19T09:14:45.027213+0000","last_fullsized":"2024-09-19T09:14:45.027213+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:43.090331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.024009+0000","last_change":"2024-09-19T09:14:44.027442+0000","last_active":"2024-09-19T09:14:45.024009+0000","last_peered":"2024-09-19T09:14:45.024009+0000","last_clean":"2024-09-19T09:14:45.024009+0000","last_became_active":"2024-09-19T09:14:44.025126+0000","last_became_peered":"2024-09-19T09:14:44.025126+0000","last_unstale":"2024-09-19T09:14:45.024009+0000","last_undegraded":"2024-09-19T09:14:45.024009+0000","last_fullsized":"2024-09-19T09:14:45.024009+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:09:25.555913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579479+0000","last_change":"2024-09-19T09:14:43.021795+0000","last_active":"2024-09-19T09:14:45.579479+0000","last_peered":"2024-09-19T09:14:45.579479+0000","last_clean":"2024-09-19T09:14:45.579479+0000","last_became_active":"2024-09-19T09:14:43.021581+0000","last_became_peered":"2024-09-19T09:14:43.021581+0000","last_unstale":"2024-09-19T09:14:45.579479+0000","last_undegraded":"2024-09-19T09:14:45.579479+0000","last_fullsized":"2024-09-19T09:14:45.579479+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:21.982112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025688+0000","last_change":"2024-09-19T09:14:44.014607+0000","last_active":"2024-09-19T09:14:45.025688+0000","last_peered":"2024-09-19T09:14:45.025688+0000","last_clean":"2024-09-19T09:14:45.025688+0000","last_became_active":"2024-09-19T09:14:44.014243+0000","last_became_peered":"2024-09-19T09:14:44.014243+0000","last_unstale":"2024-09-19T09:14:45.025688+0000","last_undegraded":"2024-09-19T09:14:45.025688+0000","last_fullsized":"2024-09-19T09:14:45.025688+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:13.783290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.026910+0000","last_change":"2024-09-19T09:14:43.017408+0000","last_active":"2024-09-19T09:14:45.026910+0000","last_peered":"2024-09-19T09:14:45.026910+0000","last_clean":"2024-09-19T09:14:45.026910+0000","last_became_active":"2024-09-19T09:14:43.017170+0000","last_became_peered":"2024-09-19T09:14:43.017170+0000","last_unstale":"2024-09-19T09:14:45.026910+0000","last_undegraded":"2024-09-19T09:14:45.026910+0000","last_fullsized":"2024-09-19T09:14:45.026910+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:27.767882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027081+0000","last_change":"2024-09-19T09:14:44.027900+0000","last_active":"2024-09-19T09:14:45.027081+0000","last_peered":"2024-09-19T09:14:45.027081+0000","last_clean":"2024-09-19T09:14:45.027081+0000","last_became_active":"2024-09-19T09:14:44.027657+0000","last_became_peered":"2024-09-19T09:14:44.027657+0000","last_unstale":"2024-09-19T09:14:45.027081+0000","last_undegraded":"2024-09-19T09:14:45.027081+0000","last_fullsized":"2024-09-19T09:14:45.027081+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:32.789950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579409+0000","last_change":"2024-09-19T09:14:43.011945+0000","last_active":"2024-09-19T09:14:45.579409+0000","last_peered":"2024-09-19T09:14:45.579409+0000","last_clean":"2024-09-19T09:14:45.579409+0000","last_became_active":"2024-09-19T09:14:43.011669+0000","last_became_peered":"2024-09-19T09:14:43.011669+0000","last_unstale":"2024-09-19T09:14:45.579409+0000","last_undegraded":"2024-09-19T09:14:45.579409+0000","last_fullsized":"2024-09-19T09:14:45.579409+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:59:08.370808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.380644+0000","last_change":"2024-09-19T09:14:44.023315+0000","last_active":"2024-09-19T09:14:45.380644+0000","last_peered":"2024-09-19T09:14:45.380644+0000","last_clean":"2024-09-19T09:14:45.380644+0000","last_became_active":"2024-09-19T09:14:44.023070+0000","last_became_peered":"2024-09-19T09:14:44.023070+0000","last_unstale":"2024-09-19T09:14:45.380644+0000","last_undegraded":"2024-09-19T09:14:45.380644+0000","last_fullsized":"2024-09-19T09:14:45.380644+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:40:42.067393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027386+0000","last_change":"2024-09-19T09:14:43.022002+0000","last_active":"2024-09-19T09:14:45.027386+0000","last_peered":"2024-09-19T09:14:45.027386+0000","last_clean":"2024-09-19T09:14:45.027386+0000","last_became_active":"2024-09-19T09:14:43.021747+0000","last_became_peered":"2024-09-19T09:14:43.021747+0000","last_unstale":"2024-09-19T09:14:45.027386+0000","last_undegraded":"2024-09-19T09:14:45.027386+0000","last_fullsized":"2024-09-19T09:14:45.027386+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:21.026772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.380737+0000","last_change":"2024-09-19T09:14:44.024204+0000","last_active":"2024-09-19T09:14:45.380737+0000","last_peered":"2024-09-19T09:14:45.380737+0000","last_clean":"2024-09-19T09:14:45.380737+0000","last_became_active":"2024-09-19T09:14:44.023505+0000","last_became_peered":"2024-09-19T09:14:44.023505+0000","last_unstale":"2024-09-19T09:14:45.380737+0000","last_undegraded":"2024-09-19T09:14:45.380737+0000","last_fullsized":"2024-09-19T09:14:45.380737+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:54.166840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.855635+0000","last_change":"2024-09-19T09:14:43.021982+0000","last_active":"2024-09-19T09:14:45.855635+0000","last_peered":"2024-09-19T09:14:45.855635+0000","last_clean":"2024-09-19T09:14:45.855635+0000","last_became_active":"2024-09-19T09:14:43.021375+0000","last_became_peered":"2024-09-19T09:14:43.021375+0000","last_unstale":"2024-09-19T09:14:45.855635+0000","last_undegraded":"2024-09-19T09:14:45.855635+0000","last_fullsized":"2024-09-19T09:14:45.855635+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:41.845835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.026960+0000","last_change":"2024-09-19T09:14:44.022900+0000","last_active":"2024-09-19T09:14:45.026960+0000","last_peered":"2024-09-19T09:14:45.026960+0000","last_clean":"2024-09-19T09:14:45.026960+0000","last_became_active":"2024-09-19T09:14:44.022655+0000","last_became_peered":"2024-09-19T09:14:44.022655+0000","last_unstale":"2024-09-19T09:14:45.026960+0000","last_undegraded":"2024-09-19T09:14:45.026960+0000","last_fullsized":"2024-09-19T09:14:45.026960+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:45.281756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.381019+0000","last_change":"2024-09-19T09:14:43.019253+0000","last_active":"2024-09-19T09:14:45.381019+0000","last_peered":"2024-09-19T09:14:45.381019+0000","last_clean":"2024-09-19T09:14:45.381019+0000","last_became_active":"2024-09-19T09:14:43.018841+0000","last_became_peered":"2024-09-19T09:14:43.018841+0000","last_unstale":"2024-09-19T09:14:45.381019+0000","last_undegraded":"2024-09-19T09:14:45.381019+0000","last_fullsized":"2024-09-19T09:14:45.381019+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:02.512785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023549+0000","last_change":"2024-09-19T09:14:44.022473+0000","last_active":"2024-09-19T09:14:45.023549+0000","last_peered":"2024-09-19T09:14:45.023549+0000","last_clean":"2024-09-19T09:14:45.023549+0000","last_became_active":"2024-09-19T09:14:44.020917+0000","last_became_peered":"2024-09-19T09:14:44.020917+0000","last_unstale":"2024-09-19T09:14:45.023549+0000","last_undegraded":"2024-09-19T09:14:45.023549+0000","last_fullsized":"2024-09-19T09:14:45.023549+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:10:02.210631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.024460+0000","last_change":"2024-09-19T09:14:43.015721+0000","last_active":"2024-09-19T09:14:45.024460+0000","last_peered":"2024-09-19T09:14:45.024460+0000","last_clean":"2024-09-19T09:14:45.024460+0000","last_became_active":"2024-09-19T09:14:43.015423+0000","last_became_peered":"2024-09-19T09:14:43.015423+0000","last_unstale":"2024-09-19T09:14:45.024460+0000","last_undegraded":"2024-09-19T09:14:45.024460+0000","last_fullsized":"2024-09-19T09:14:45.024460+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:27.122536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.024099+0000","last_change":"2024-09-19T09:14:44.029393+0000","last_active":"2024-09-19T09:14:45.024099+0000","last_peered":"2024-09-19T09:14:45.024099+0000","last_clean":"2024-09-19T09:14:45.024099+0000","last_became_active":"2024-09-19T09:14:44.029136+0000","last_became_peered":"2024-09-19T09:14:44.029136+0000","last_unstale":"2024-09-19T09:14:45.024099+0000","last_undegraded":"2024-09-19T09:14:45.024099+0000","last_fullsized":"2024-09-19T09:14:45.024099+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:19:16.335233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.381048+0000","last_change":"2024-09-19T09:14:43.018969+0000","last_active":"2024-09-19T09:14:45.381048+0000","last_peered":"2024-09-19T09:14:45.381048+0000","last_clean":"2024-09-19T09:14:45.381048+0000","last_became_active":"2024-09-19T09:14:43.018389+0000","last_became_peered":"2024-09-19T09:14:43.018389+0000","last_unstale":"2024-09-19T09:14:45.381048+0000","last_undegraded":"2024-09-19T09:14:45.381048+0000","last_fullsized":"2024-09-19T09:14:45.381048+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:53.598810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025822+0000","last_change":"2024-09-19T09:14:44.025437+0000","last_active":"2024-09-19T09:14:45.025822+0000","last_peered":"2024-09-19T09:14:45.025822+0000","last_clean":"2024-09-19T09:14:45.025822+0000","last_became_active":"2024-09-19T09:14:44.024770+0000","last_became_peered":"2024-09-19T09:14:44.024770+0000","last_unstale":"2024-09-19T09:14:45.025822+0000","last_undegraded":"2024-09-19T09:14:45.025822+0000","last_fullsized":"2024-09-19T09:14:45.025822+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:36.790289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"47'3","reported_seq":17,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.024442+0000","last_change":"2024-09-19T09:14:43.021320+0000","last_active":"2024-09-19T09:14:45.024442+0000","last_peered":"2024-09-19T09:14:45.024442+0000","last_clean":"2024-09-19T09:14:45.024442+0000","last_became_active":"2024-09-19T09:14:43.020968+0000","last_became_peered":"2024-09-19T09:14:43.020968+0000","last_unstale":"2024-09-19T09:14:45.024442+0000","last_undegraded":"2024-09-19T09:14:45.024442+0000","last_fullsized":"2024-09-19T09:14:45.024442+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:40:45.301062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027221+0000","last_change":"2024-09-19T09:14:44.019006+0000","last_active":"2024-09-19T09:14:45.027221+0000","last_peered":"2024-09-19T09:14:45.027221+0000","last_clean":"2024-09-19T09:14:45.027221+0000","last_became_active":"2024-09-19T09:14:44.018713+0000","last_became_peered":"2024-09-19T09:14:44.018713+0000","last_unstale":"2024-09-19T09:14:45.027221+0000","last_undegraded":"2024-09-19T09:14:45.027221+0000","last_fullsized":"2024-09-19T09:14:45.027221+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:17.324728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"47'6","reported_seq":20,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.380900+0000","last_change":"2024-09-19T09:14:43.018818+0000","last_active":"2024-09-19T09:14:45.380900+0000","last_peered":"2024-09-19T09:14:45.380900+0000","last_clean":"2024-09-19T09:14:45.380900+0000","last_became_active":"2024-09-19T09:14:43.018404+0000","last_became_peered":"2024-09-19T09:14:43.018404+0000","last_unstale":"2024-09-19T09:14:45.380900+0000","last_undegraded":"2024-09-19T09:14:45.380900+0000","last_fullsized":"2024-09-19T09:14:45.380900+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:15.384351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.024230+0000","last_change":"2024-09-19T09:14:44.026006+0000","last_active":"2024-09-19T09:14:45.024230+0000","last_peered":"2024-09-19T09:14:45.024230+0000","last_clean":"2024-09-19T09:14:45.024230+0000","last_became_active":"2024-09-19T09:14:44.025744+0000","last_became_peered":"2024-09-19T09:14:44.025744+0000","last_unstale":"2024-09-19T09:14:45.024230+0000","last_undegraded":"2024-09-19T09:14:45.024230+0000","last_fullsized":"2024-09-19T09:14:45.024230+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:29.175037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579200+0000","last_change":"2024-09-19T09:14:43.012153+0000","last_active":"2024-09-19T09:14:45.579200+0000","last_peered":"2024-09-19T09:14:45.579200+0000","last_clean":"2024-09-19T09:14:45.579200+0000","last_became_active":"2024-09-19T09:14:43.011918+0000","last_became_peered":"2024-09-19T09:14:43.011918+0000","last_unstale":"2024-09-19T09:14:45.579200+0000","last_undegraded":"2024-09-19T09:14:45.579200+0000","last_fullsized":"2024-09-19T09:14:45.579200+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:40.088791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.578945+0000","last_change":"2024-09-19T09:14:44.017690+0000","last_active":"2024-09-19T09:14:45.578945+0000","last_peered":"2024-09-19T09:14:45.578945+0000","last_clean":"2024-09-19T09:14:45.578945+0000","last_became_active":"2024-09-19T09:14:44.017382+0000","last_became_peered":"2024-09-19T09:14:44.017382+0000","last_unstale":"2024-09-19T09:14:45.578945+0000","last_undegraded":"2024-09-19T09:14:45.578945+0000","last_fullsized":"2024-09-19T09:14:45.578945+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:27.398579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.856047+0000","last_change":"2024-09-19T09:14:43.016145+0000","last_active":"2024-09-19T09:14:45.856047+0000","last_peered":"2024-09-19T09:14:45.856047+0000","last_clean":"2024-09-19T09:14:45.856047+0000","last_became_active":"2024-09-19T09:14:43.015822+0000","last_became_peered":"2024-09-19T09:14:43.015822+0000","last_unstale":"2024-09-19T09:14:45.856047+0000","last_undegraded":"2024-09-19T09:14:45.856047+0000","last_fullsized":"2024-09-19T09:14:45.856047+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:23:23.072844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.578781+0000","last_change":"2024-09-19T09:14:44.019220+0000","last_active":"2024-09-19T09:14:45.578781+0000","last_peered":"2024-09-19T09:14:45.578781+0000","last_clean":"2024-09-19T09:14:45.578781+0000","last_became_active":"2024-09-19T09:14:44.018980+0000","last_became_peered":"2024-09-19T09:14:44.018980+0000","last_unstale":"2024-09-19T09:14:45.578781+0000","last_undegraded":"2024-09-19T09:14:45.578781+0000","last_fullsized":"2024-09-19T09:14:45.578781+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:49.951747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579493+0000","last_change":"2024-09-19T09:14:43.014274+0000","last_active":"2024-09-19T09:14:45.579493+0000","last_peered":"2024-09-19T09:14:45.579493+0000","last_clean":"2024-09-19T09:14:45.579493+0000","last_became_active":"2024-09-19T09:14:43.013722+0000","last_became_peered":"2024-09-19T09:14:43.013722+0000","last_unstale":"2024-09-19T09:14:45.579493+0000","last_undegraded":"2024-09-19T09:14:45.579493+0000","last_fullsized":"2024-09-19T09:14:45.579493+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:23.292449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023763+0000","last_change":"2024-09-19T09:14:44.024354+0000","last_active":"2024-09-19T09:14:45.023763+0000","last_peered":"2024-09-19T09:14:45.023763+0000","last_clean":"2024-09-19T09:14:45.023763+0000","last_became_active":"2024-09-19T09:14:44.023780+0000","last_became_peered":"2024-09-19T09:14:44.023780+0000","last_unstale":"2024-09-19T09:14:45.023763+0000","last_undegraded":"2024-09-19T09:14:45.023763+0000","last_fullsized":"2024-09-19T09:14:45.023763+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:18.315720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"47'8","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.380576+0000","last_change":"2024-09-19T09:14:43.014824+0000","last_active":"2024-09-19T09:14:45.380576+0000","last_peered":"2024-09-19T09:14:45.380576+0000","last_clean":"2024-09-19T09:14:45.380576+0000","last_became_active":"2024-09-19T09:14:43.014570+0000","last_became_peered":"2024-09-19T09:14:43.014570+0000","last_unstale":"2024-09-19T09:14:45.380576+0000","last_undegraded":"2024-09-19T09:14:45.380576+0000","last_fullsized":"2024-09-19T09:14:45.380576+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:54.061691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579089+0000","last_change":"2024-09-19T09:14:44.020992+0000","last_active":"2024-09-19T09:14:45.579089+0000","last_peered":"2024-09-19T09:14:45.579089+0000","last_clean":"2024-09-19T09:14:45.579089+0000","last_became_active":"2024-09-19T09:14:44.020724+0000","last_became_peered":"2024-09-19T09:14:44.020724+0000","last_unstale":"2024-09-19T09:14:45.579089+0000","last_undegraded":"2024-09-19T09:14:45.579089+0000","last_fullsized":"2024-09-19T09:14:45.579089+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:40.503421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025950+0000","last_change":"2024-09-19T09:14:43.018292+0000","last_active":"2024-09-19T09:14:45.025950+0000","last_peered":"2024-09-19T09:14:45.025950+0000","last_clean":"2024-09-19T09:14:45.025950+0000","last_became_active":"2024-09-19T09:14:43.017848+0000","last_became_peered":"2024-09-19T09:14:43.017848+0000","last_unstale":"2024-09-19T09:14:45.025950+0000","last_undegraded":"2024-09-19T09:14:45.025950+0000","last_fullsized":"2024-09-19T09:14:45.025950+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:45.490695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.578958+0000","last_change":"2024-09-19T09:14:44.025089+0000","last_active":"2024-09-19T09:14:45.578958+0000","last_peered":"2024-09-19T09:14:45.578958+0000","last_clean":"2024-09-19T09:14:45.578958+0000","last_became_active":"2024-09-19T09:14:44.024431+0000","last_became_peered":"2024-09-19T09:14:44.024431+0000","last_unstale":"2024-09-19T09:14:45.578958+0000","last_undegraded":"2024-09-19T09:14:45.578958+0000","last_fullsized":"2024-09-19T09:14:45.578958+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:43.604622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023990+0000","last_change":"2024-09-19T09:14:43.015986+0000","last_active":"2024-09-19T09:14:45.023990+0000","last_peered":"2024-09-19T09:14:45.023990+0000","last_clean":"2024-09-19T09:14:45.023990+0000","last_became_active":"2024-09-19T09:14:43.015707+0000","last_became_peered":"2024-09-19T09:14:43.015707+0000","last_unstale":"2024-09-19T09:14:45.023990+0000","last_undegraded":"2024-09-19T09:14:45.023990+0000","last_fullsized":"2024-09-19T09:14:45.023990+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:55.935855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023906+0000","last_change":"2024-09-19T09:14:44.020439+0000","last_active":"2024-09-19T09:14:45.023906+0000","last_peered":"2024-09-19T09:14:45.023906+0000","last_clean":"2024-09-19T09:14:45.023906+0000","last_became_active":"2024-09-19T09:14:44.020161+0000","last_became_peered":"2024-09-19T09:14:44.020161+0000","last_unstale":"2024-09-19T09:14:45.023906+0000","last_undegraded":"2024-09-19T09:14:45.023906+0000","last_fullsized":"2024-09-19T09:14:45.023906+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:06.444772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.024560+0000","last_change":"2024-09-19T09:14:43.018432+0000","last_active":"2024-09-19T09:14:45.024560+0000","last_peered":"2024-09-19T09:14:45.024560+0000","last_clean":"2024-09-19T09:14:45.024560+0000","last_became_active":"2024-09-19T09:14:43.018185+0000","last_became_peered":"2024-09-19T09:14:43.018185+0000","last_unstale":"2024-09-19T09:14:45.024560+0000","last_undegraded":"2024-09-19T09:14:45.024560+0000","last_fullsized":"2024-09-19T09:14:45.024560+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:01.201460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.024367+0000","last_change":"2024-09-19T09:14:44.028325+0000","last_active":"2024-09-19T09:14:45.024367+0000","last_peered":"2024-09-19T09:14:45.024367+0000","last_clean":"2024-09-19T09:14:45.024367+0000","last_became_active":"2024-09-19T09:14:44.027940+0000","last_became_peered":"2024-09-19T09:14:44.027940+0000","last_unstale":"2024-09-19T09:14:45.024367+0000","last_undegraded":"2024-09-19T09:14:45.024367+0000","last_fullsized":"2024-09-19T09:14:45.024367+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:29.976057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579575+0000","last_change":"2024-09-19T09:14:43.013969+0000","last_active":"2024-09-19T09:14:45.579575+0000","last_peered":"2024-09-19T09:14:45.579575+0000","last_clean":"2024-09-19T09:14:45.579575+0000","last_became_active":"2024-09-19T09:14:43.013370+0000","last_became_peered":"2024-09-19T09:14:43.013370+0000","last_unstale":"2024-09-19T09:14:45.579575+0000","last_undegraded":"2024-09-19T09:14:45.579575+0000","last_fullsized":"2024-09-19T09:14:45.579575+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:54.441500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.380746+0000","last_change":"2024-09-19T09:14:44.023568+0000","last_active":"2024-09-19T09:14:45.380746+0000","last_peered":"2024-09-19T09:14:45.380746+0000","last_clean":"2024-09-19T09:14:45.380746+0000","last_became_active":"2024-09-19T09:14:44.023139+0000","last_became_peered":"2024-09-19T09:14:44.023139+0000","last_unstale":"2024-09-19T09:14:45.380746+0000","last_undegraded":"2024-09-19T09:14:45.380746+0000","last_fullsized":"2024-09-19T09:14:45.380746+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:20.812534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.380672+0000","last_change":"2024-09-19T09:14:43.016302+0000","last_active":"2024-09-19T09:14:45.380672+0000","last_peered":"2024-09-19T09:14:45.380672+0000","last_clean":"2024-09-19T09:14:45.380672+0000","last_became_active":"2024-09-19T09:14:43.016051+0000","last_became_peered":"2024-09-19T09:14:43.016051+0000","last_unstale":"2024-09-19T09:14:45.380672+0000","last_undegraded":"2024-09-19T09:14:45.380672+0000","last_fullsized":"2024-09-19T09:14:45.380672+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:06.635440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579546+0000","last_change":"2024-09-19T09:14:44.018465+0000","last_active":"2024-09-19T09:14:45.579546+0000","last_peered":"2024-09-19T09:14:45.579546+0000","last_clean":"2024-09-19T09:14:45.579546+0000","last_became_active":"2024-09-19T09:14:44.018236+0000","last_became_peered":"2024-09-19T09:14:44.018236+0000","last_unstale":"2024-09-19T09:14:45.579546+0000","last_undegraded":"2024-09-19T09:14:45.579546+0000","last_fullsized":"2024-09-19T09:14:45.579546+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:57.429129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.855696+0000","last_change":"2024-09-19T09:14:43.021698+0000","last_active":"2024-09-19T09:14:45.855696+0000","last_peered":"2024-09-19T09:14:45.855696+0000","last_clean":"2024-09-19T09:14:45.855696+0000","last_became_active":"2024-09-19T09:14:43.021031+0000","last_became_peered":"2024-09-19T09:14:43.021031+0000","last_unstale":"2024-09-19T09:14:45.855696+0000","last_undegraded":"2024-09-19T09:14:45.855696+0000","last_fullsized":"2024-09-19T09:14:45.855696+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:50.647331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025969+0000","last_change":"2024-09-19T09:14:44.026463+0000","last_active":"2024-09-19T09:14:45.025969+0000","last_peered":"2024-09-19T09:14:45.025969+0000","last_clean":"2024-09-19T09:14:45.025969+0000","last_became_active":"2024-09-19T09:14:44.026205+0000","last_became_peered":"2024-09-19T09:14:44.026205+0000","last_unstale":"2024-09-19T09:14:45.025969+0000","last_undegraded":"2024-09-19T09:14:45.025969+0000","last_fullsized":"2024-09-19T09:14:45.025969+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:07.055231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.381078+0000","last_change":"2024-09-19T09:14:43.016647+0000","last_active":"2024-09-19T09:14:45.381078+0000","last_peered":"2024-09-19T09:14:45.381078+0000","last_clean":"2024-09-19T09:14:45.381078+0000","last_became_active":"2024-09-19T09:14:43.016390+0000","last_became_peered":"2024-09-19T09:14:43.016390+0000","last_unstale":"2024-09-19T09:14:45.381078+0000","last_undegraded":"2024-09-19T09:14:45.381078+0000","last_fullsized":"2024-09-19T09:14:45.381078+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:30.278092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025836+0000","last_change":"2024-09-19T09:14:44.024826+0000","last_active":"2024-09-19T09:14:45.025836+0000","last_peered":"2024-09-19T09:14:45.025836+0000","last_clean":"2024-09-19T09:14:45.025836+0000","last_became_active":"2024-09-19T09:14:44.024589+0000","last_became_peered":"2024-09-19T09:14:44.024589+0000","last_unstale":"2024-09-19T09:14:45.025836+0000","last_undegraded":"2024-09-19T09:14:45.025836+0000","last_fullsized":"2024-09-19T09:14:45.025836+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:10.102105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027031+0000","last_change":"2024-09-19T09:14:43.014182+0000","last_active":"2024-09-19T09:14:45.027031+0000","last_peered":"2024-09-19T09:14:45.027031+0000","last_clean":"2024-09-19T09:14:45.027031+0000","last_became_active":"2024-09-19T09:14:43.013926+0000","last_became_peered":"2024-09-19T09:14:43.013926+0000","last_unstale":"2024-09-19T09:14:45.027031+0000","last_undegraded":"2024-09-19T09:14:45.027031+0000","last_fullsized":"2024-09-19T09:14:45.027031+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:44.694987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027182+0000","last_change":"2024-09-19T09:14:44.022263+0000","last_active":"2024-09-19T09:14:45.027182+0000","last_peered":"2024-09-19T09:14:45.027182+0000","last_clean":"2024-09-19T09:14:45.027182+0000","last_became_active":"2024-09-19T09:14:44.022029+0000","last_became_peered":"2024-09-19T09:14:44.022029+0000","last_unstale":"2024-09-19T09:14:45.027182+0000","last_undegraded":"2024-09-19T09:14:45.027182+0000","last_fullsized":"2024-09-19T09:14:45.027182+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:57.184977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"48'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027025+0000","last_change":"2024-09-19T09:14:43.016043+0000","last_active":"2024-09-19T09:14:45.027025+0000","last_peered":"2024-09-19T09:14:45.027025+0000","last_clean":"2024-09-19T09:14:45.027025+0000","last_became_active":"2024-09-19T09:14:43.015756+0000","last_became_peered":"2024-09-19T09:14:43.015756+0000","last_unstale":"2024-09-19T09:14:45.027025+0000","last_undegraded":"2024-09-19T09:14:45.027025+0000","last_fullsized":"2024-09-19T09:14:45.027025+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.109665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.380852+0000","last_change":"2024-09-19T09:14:44.023981+0000","last_active":"2024-09-19T09:14:45.380852+0000","last_peered":"2024-09-19T09:14:45.380852+0000","last_clean":"2024-09-19T09:14:45.380852+0000","last_became_active":"2024-09-19T09:14:44.023225+0000","last_became_peered":"2024-09-19T09:14:44.023225+0000","last_unstale":"2024-09-19T09:14:45.380852+0000","last_undegraded":"2024-09-19T09:14:45.380852+0000","last_fullsized":"2024-09-19T09:14:45.380852+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:35.414159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.855843+0000","last_change":"2024-09-19T09:14:43.019756+0000","last_active":"2024-09-19T09:14:45.855843+0000","last_peered":"2024-09-19T09:14:45.855843+0000","last_clean":"2024-09-19T09:14:45.855843+0000","last_became_active":"2024-09-19T09:14:43.019064+0000","last_became_peered":"2024-09-19T09:14:43.019064+0000","last_unstale":"2024-09-19T09:14:45.855843+0000","last_undegraded":"2024-09-19T09:14:45.855843+0000","last_fullsized":"2024-09-19T09:14:45.855843+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:39.258366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027112+0000","last_change":"2024-09-19T09:14:44.016509+0000","last_active":"2024-09-19T09:14:45.027112+0000","last_peered":"2024-09-19T09:14:45.027112+0000","last_clean":"2024-09-19T09:14:45.027112+0000","last_became_active":"2024-09-19T09:14:44.016185+0000","last_became_peered":"2024-09-19T09:14:44.016185+0000","last_unstale":"2024-09-19T09:14:45.027112+0000","last_undegraded":"2024-09-19T09:14:45.027112+0000","last_fullsized":"2024-09-19T09:14:45.027112+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:39.470792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579299+0000","last_change":"2024-09-19T09:14:43.016982+0000","last_active":"2024-09-19T09:14:45.579299+0000","last_peered":"2024-09-19T09:14:45.579299+0000","last_clean":"2024-09-19T09:14:45.579299+0000","last_became_active":"2024-09-19T09:14:43.016668+0000","last_became_peered":"2024-09-19T09:14:43.016668+0000","last_unstale":"2024-09-19T09:14:45.579299+0000","last_undegraded":"2024-09-19T09:14:45.579299+0000","last_fullsized":"2024-09-19T09:14:45.579299+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:36.837917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.380936+0000","last_change":"2024-09-19T09:14:44.018411+0000","last_active":"2024-09-19T09:14:45.380936+0000","last_peered":"2024-09-19T09:14:45.380936+0000","last_clean":"2024-09-19T09:14:45.380936+0000","last_became_active":"2024-09-19T09:14:44.018176+0000","last_became_peered":"2024-09-19T09:14:44.018176+0000","last_unstale":"2024-09-19T09:14:45.380936+0000","last_undegraded":"2024-09-19T09:14:45.380936+0000","last_fullsized":"2024-09-19T09:14:45.380936+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:19.873465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.856095+0000","last_change":"2024-09-19T09:14:43.019534+0000","last_active":"2024-09-19T09:14:45.856095+0000","last_peered":"2024-09-19T09:14:45.856095+0000","last_clean":"2024-09-19T09:14:45.856095+0000","last_became_active":"2024-09-19T09:14:43.019162+0000","last_became_peered":"2024-09-19T09:14:43.019162+0000","last_unstale":"2024-09-19T09:14:45.856095+0000","last_undegraded":"2024-09-19T09:14:45.856095+0000","last_fullsized":"2024-09-19T09:14:45.856095+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:00.685460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.026064+0000","last_change":"2024-09-19T09:14:44.022559+0000","last_active":"2024-09-19T09:14:45.026064+0000","last_peered":"2024-09-19T09:14:45.026064+0000","last_clean":"2024-09-19T09:14:45.026064+0000","last_became_active":"2024-09-19T09:14:44.021953+0000","last_became_peered":"2024-09-19T09:14:44.021953+0000","last_unstale":"2024-09-19T09:14:45.026064+0000","last_undegraded":"2024-09-19T09:14:45.026064+0000","last_fullsized":"2024-09-19T09:14:45.026064+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:35.372428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027314+0000","last_change":"2024-09-19T09:14:43.019601+0000","last_active":"2024-09-19T09:14:45.027314+0000","last_peered":"2024-09-19T09:14:45.027314+0000","last_clean":"2024-09-19T09:14:45.027314+0000","last_became_active":"2024-09-19T09:14:43.019364+0000","last_became_peered":"2024-09-19T09:14:43.019364+0000","last_unstale":"2024-09-19T09:14:45.027314+0000","last_undegraded":"2024-09-19T09:14:45.027314+0000","last_fullsized":"2024-09-19T09:14:45.027314+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:12.857718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023389+0000","last_change":"2024-09-19T09:14:44.027346+0000","last_active":"2024-09-19T09:14:45.023389+0000","last_peered":"2024-09-19T09:14:45.023389+0000","last_clean":"2024-09-19T09:14:45.023389+0000","last_became_active":"2024-09-19T09:14:44.027123+0000","last_became_peered":"2024-09-19T09:14:44.027123+0000","last_unstale":"2024-09-19T09:14:45.023389+0000","last_undegraded":"2024-09-19T09:14:45.023389+0000","last_fullsized":"2024-09-19T09:14:45.023389+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:58.059137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579677+0000","last_change":"2024-09-19T09:14:43.014442+0000","last_active":"2024-09-19T09:14:45.579677+0000","last_peered":"2024-09-19T09:14:45.579677+0000","last_clean":"2024-09-19T09:14:45.579677+0000","last_became_active":"2024-09-19T09:14:43.013919+0000","last_became_peered":"2024-09-19T09:14:43.013919+0000","last_unstale":"2024-09-19T09:14:45.579677+0000","last_undegraded":"2024-09-19T09:14:45.579677+0000","last_fullsized":"2024-09-19T09:14:45.579677+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:36.932370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.024327+0000","last_change":"2024-09-19T09:14:44.021301+0000","last_active":"2024-09-19T09:14:45.024327+0000","last_peered":"2024-09-19T09:14:45.024327+0000","last_clean":"2024-09-19T09:14:45.024327+0000","last_became_active":"2024-09-19T09:14:44.020180+0000","last_became_peered":"2024-09-19T09:14:44.020180+0000","last_unstale":"2024-09-19T09:14:45.024327+0000","last_undegraded":"2024-09-19T09:14:45.024327+0000","last_fullsized":"2024-09-19T09:14:45.024327+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:47.149041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579088+0000","last_change":"2024-09-19T09:14:43.017264+0000","last_active":"2024-09-19T09:14:45.579088+0000","last_peered":"2024-09-19T09:14:45.579088+0000","last_clean":"2024-09-19T09:14:45.579088+0000","last_became_active":"2024-09-19T09:14:43.017011+0000","last_became_peered":"2024-09-19T09:14:43.017011+0000","last_unstale":"2024-09-19T09:14:45.579088+0000","last_undegraded":"2024-09-19T09:14:45.579088+0000","last_fullsized":"2024-09-19T09:14:45.579088+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:39:25.578459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025620+0000","last_change":"2024-09-19T09:14:44.019925+0000","last_active":"2024-09-19T09:14:45.025620+0000","last_peered":"2024-09-19T09:14:45.025620+0000","last_clean":"2024-09-19T09:14:45.025620+0000","last_became_active":"2024-09-19T09:14:44.018603+0000","last_became_peered":"2024-09-19T09:14:44.018603+0000","last_unstale":"2024-09-19T09:14:45.025620+0000","last_undegraded":"2024-09-19T09:14:45.025620+0000","last_fullsized":"2024-09-19T09:14:45.025620+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:26.582541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027263+0000","last_change":"2024-09-19T09:14:43.018492+0000","last_active":"2024-09-19T09:14:45.027263+0000","last_peered":"2024-09-19T09:14:45.027263+0000","last_clean":"2024-09-19T09:14:45.027263+0000","last_became_active":"2024-09-19T09:14:43.018239+0000","last_became_peered":"2024-09-19T09:14:43.018239+0000","last_unstale":"2024-09-19T09:14:45.027263+0000","last_undegraded":"2024-09-19T09:14:45.027263+0000","last_fullsized":"2024-09-19T09:14:45.027263+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:47.554369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":220,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023438+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:14:45.023438+0000","last_peered":"2024-09-19T09:14:45.023438+0000","last_clean":"2024-09-19T09:14:45.023438+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:14:45.023438+0000","last_undegraded":"2024-09-19T09:14:45.023438+0000","last_fullsized":"2024-09-19T09:14:45.023438+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:22.478151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574868,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195086,"statfs":{"total":200000000,"available":199768258,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195085,"statfs":{"total":200000000,"available":199767676,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199177902,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574868,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":227,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195084,"statfs":{"total":200000000,"available":199766588,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":227,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195084,"statfs":{"total":200000000,"available":199766680,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195086,"statfs":{"total":200000000,"available":199768202,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199177854,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":220,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195091,"statfs":{"total":200000000,"available":199773920,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:14:49.912 INFO:tasks.ceph.mds.c.smithi018.stderr:2024-09-19T09:14:49.911+0000 7f62329ec640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T09:14:51.413 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:14:51.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.528+0000 7f738068c640 1 Processor -- start 2024-09-19T09:14:51.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.528+0000 7f738068c640 1 -- start start 2024-09-19T09:14:51.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.529+0000 7f738068c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f73780cf560 0x7f73780cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:51.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.529+0000 7f738068c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73780d0e10 con 0x7f73780ce600 2024-09-19T09:14:51.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.529+0000 7f738068c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73780d0310 con 0x7f73780cfe80 2024-09-19T09:14:51.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.529+0000 7f738068c640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f73780d0850 con 0x7f73780cf560 2024-09-19T09:14:51.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.529+0000 7f737e428640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f73780cf560 0x7f73780cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:51.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.529+0000 7f737ec29640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f73780ce600 0x7f73780b33e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59874/0 (socket says 172.21.15.18:59874) 2024-09-19T09:14:51.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.529+0000 7f737ec29640 1 -- 172.21.15.18:0/3823888966 learned_addr learned my addr 172.21.15.18:0/3823888966 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:51.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.529+0000 7f737e428640 1 -- 172.21.15.18:0/3823888966 >> v1:172.21.15.162:6789/0 conn(0x7f73780cfe80 legacy=0x7f73780b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:51.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.529+0000 7f737e428640 1 -- 172.21.15.18:0/3823888966 >> v1:172.21.15.18:6789/0 conn(0x7f73780ce600 legacy=0x7f73780b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:51.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.529+0000 7f737e428640 1 -- 172.21.15.18:0/3823888966 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73780d0b30 con 0x7f73780cf560 2024-09-19T09:14:51.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.529+0000 7f737d426640 1 -- 172.21.15.18:0/3823888966 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 576953667 0 0) 0x7f73780d0e10 con 0x7f73780ce600 2024-09-19T09:14:51.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.530+0000 7f737e428640 1 --2- 172.21.15.18:0/3823888966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73780cf560 0x7f73780cf940 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f73740097a0 tx=0x7f737402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79cc7dbed976db64 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:51.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.530+0000 7f737d426640 1 -- 172.21.15.18:0/3823888966 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7374037070 con 0x7f73780cf560 2024-09-19T09:14:51.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.530+0000 7f737d426640 1 -- 172.21.15.18:0/3823888966 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7374032440 con 0x7f73780cf560 2024-09-19T09:14:51.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.530+0000 7f737d426640 1 -- 172.21.15.18:0/3823888966 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f737402ae60 con 0x7f73780cf560 2024-09-19T09:14:51.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.531+0000 7f738068c640 1 -- 172.21.15.18:0/3823888966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73780cf560 msgr2=0x7f73780cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:51.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.531+0000 7f738068c640 1 --2- 172.21.15.18:0/3823888966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73780cf560 0x7f73780cf940 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f73740097a0 tx=0x7f737402a110 comp rx=0 tx=0).stop 2024-09-19T09:14:51.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.531+0000 7f738068c640 1 -- 172.21.15.18:0/3823888966 shutdown_connections 2024-09-19T09:14:51.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.531+0000 7f738068c640 1 --2- 172.21.15.18:0/3823888966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73780cf560 0x7f73780cf940 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:51.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.531+0000 7f738068c640 1 -- 172.21.15.18:0/3823888966 >> 172.21.15.18:0/3823888966 conn(0x7f73780b4700 msgr2=0x7f73780b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:51.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.531+0000 7f738068c640 1 -- 172.21.15.18:0/3823888966 shutdown_connections 2024-09-19T09:14:51.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.531+0000 7f738068c640 1 -- 172.21.15.18:0/3823888966 wait complete. 2024-09-19T09:14:51.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.532+0000 7f738068c640 1 Processor -- start 2024-09-19T09:14:51.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.532+0000 7f738068c640 1 -- start start 2024-09-19T09:14:51.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.533+0000 7f738068c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73780ce600 0x7f737815c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:51.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.533+0000 7f738068c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73780cf560 0x7f73780c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:51.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.533+0000 7f738068c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73780cfe80 0x7f73780c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:51.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.533+0000 7f738068c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f73780b5420 con 0x7f73780cf560 2024-09-19T09:14:51.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.533+0000 7f738068c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f73780b27b0 con 0x7f73780ce600 2024-09-19T09:14:51.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.533+0000 7f738068c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f73780b55a0 con 0x7f73780cfe80 2024-09-19T09:14:51.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.533+0000 7f737dc27640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73780cf560 0x7f73780c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:51.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.533+0000 7f737dc27640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73780cf560 0x7f73780c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53654/0 (socket says 172.21.15.18:53654) 2024-09-19T09:14:51.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.533+0000 7f737dc27640 1 -- 172.21.15.18:0/2416345581 learned_addr learned my addr 172.21.15.18:0/2416345581 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:51.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.533+0000 7f737ec29640 1 --2- 172.21.15.18:0/2416345581 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73780cfe80 0x7f73780c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:51.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.533+0000 7f737e428640 1 --2- 172.21.15.18:0/2416345581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73780ce600 0x7f737815c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:51.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.534+0000 7f737dc27640 1 -- 172.21.15.18:0/2416345581 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73780cfe80 msgr2=0x7f73780c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:51.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.534+0000 7f737dc27640 1 --2- 172.21.15.18:0/2416345581 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73780cfe80 0x7f73780c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:51.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.534+0000 7f737dc27640 1 -- 172.21.15.18:0/2416345581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73780ce600 msgr2=0x7f737815c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:51.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.534+0000 7f737dc27640 1 --2- 172.21.15.18:0/2416345581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73780ce600 0x7f737815c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:51.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.534+0000 7f737dc27640 1 -- 172.21.15.18:0/2416345581 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73780c9e70 con 0x7f73780cf560 2024-09-19T09:14:51.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.534+0000 7f737dc27640 1 --2- 172.21.15.18:0/2416345581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73780cf560 0x7f73780c8850 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f736800c430 tx=0x7f736800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:51.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.534+0000 7f736effd640 1 -- 172.21.15.18:0/2416345581 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7368017070 con 0x7f73780cf560 2024-09-19T09:14:51.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.534+0000 7f736effd640 1 -- 172.21.15.18:0/2416345581 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73680052d0 con 0x7f73780cf560 2024-09-19T09:14:51.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.534+0000 7f738068c640 1 -- 172.21.15.18:0/2416345581 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73780ca150 con 0x7f73780cf560 2024-09-19T09:14:51.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.534+0000 7f736effd640 1 -- 172.21.15.18:0/2416345581 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7368003830 con 0x7f73780cf560 2024-09-19T09:14:51.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.534+0000 7f738068c640 1 -- 172.21.15.18:0/2416345581 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73780b3e70 con 0x7f73780cf560 2024-09-19T09:14:51.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.535+0000 7f738068c640 1 -- 172.21.15.18:0/2416345581 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73780c9c00 con 0x7f73780cf560 2024-09-19T09:14:51.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.536+0000 7f736effd640 1 -- 172.21.15.18:0/2416345581 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f736801a070 con 0x7f73780cf560 2024-09-19T09:14:51.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.536+0000 7f736effd640 1 --2- 172.21.15.18:0/2416345581 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f735c06c2b0 0x7f735c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:51.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.536+0000 7f736effd640 1 -- 172.21.15.18:0/2416345581 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f736808a660 con 0x7f73780cf560 2024-09-19T09:14:51.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.536+0000 7f737e428640 1 --2- 172.21.15.18:0/2416345581 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f735c06c2b0 0x7f735c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:51.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.537+0000 7f737e428640 1 --2- 172.21.15.18:0/2416345581 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f735c06c2b0 0x7f735c06e770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7374034000 tx=0x7f737402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:51.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.541+0000 7f736effd640 1 -- 172.21.15.18:0/2416345581 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7368058810 con 0x7f73780cf560 2024-09-19T09:14:51.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.713+0000 7f738068c640 1 -- 172.21.15.18:0/2416345581 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f737815dcb0 con 0x7f735c06c2b0 2024-09-19T09:14:51.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.719+0000 7f736effd640 1 -- 172.21.15.18:0/2416345581 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247491 (secure 0 0 0) 0x7f737815dcb0 con 0x7f735c06c2b0 2024-09-19T09:14:51.722 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:51.723 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:14:51.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.722+0000 7f738068c640 1 -- 172.21.15.18:0/2416345581 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f735c06c2b0 msgr2=0x7f735c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:51.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.722+0000 7f738068c640 1 --2- 172.21.15.18:0/2416345581 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f735c06c2b0 0x7f735c06e770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7374034000 tx=0x7f737402e000 comp rx=0 tx=0).stop 2024-09-19T09:14:51.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.722+0000 7f738068c640 1 -- 172.21.15.18:0/2416345581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73780cf560 msgr2=0x7f73780c8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:51.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.722+0000 7f738068c640 1 --2- 172.21.15.18:0/2416345581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73780cf560 0x7f73780c8850 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f736800c430 tx=0x7f736800c8f0 comp rx=0 tx=0).stop 2024-09-19T09:14:51.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.722+0000 7f738068c640 1 -- 172.21.15.18:0/2416345581 shutdown_connections 2024-09-19T09:14:51.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.722+0000 7f738068c640 1 --2- 172.21.15.18:0/2416345581 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f735c06c2b0 0x7f735c06e770 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:51.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.722+0000 7f738068c640 1 --2- 172.21.15.18:0/2416345581 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73780cfe80 0x7f73780c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:51.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.722+0000 7f738068c640 1 --2- 172.21.15.18:0/2416345581 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73780cf560 0x7f73780c8850 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:51.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.722+0000 7f738068c640 1 --2- 172.21.15.18:0/2416345581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73780ce600 0x7f737815c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:51.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.722+0000 7f738068c640 1 -- 172.21.15.18:0/2416345581 >> 172.21.15.18:0/2416345581 conn(0x7f73780b4700 msgr2=0x7f73780b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:51.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.722+0000 7f738068c640 1 -- 172.21.15.18:0/2416345581 shutdown_connections 2024-09-19T09:14:51.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.722+0000 7f738068c640 1 -- 172.21.15.18:0/2416345581 wait complete. 2024-09-19T09:14:51.733 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2024-09-19T09:14:51.542596+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2967,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559532,"statfs":{"total":1600000000,"available":1596960780,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001662"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.855751+0000","last_change":"2024-09-19T09:14:44.029278+0000","last_active":"2024-09-19T09:14:45.855751+0000","last_peered":"2024-09-19T09:14:45.855751+0000","last_clean":"2024-09-19T09:14:45.855751+0000","last_became_active":"2024-09-19T09:14:44.028929+0000","last_became_peered":"2024-09-19T09:14:44.028929+0000","last_unstale":"2024-09-19T09:14:45.855751+0000","last_undegraded":"2024-09-19T09:14:45.855751+0000","last_fullsized":"2024-09-19T09:14:45.855751+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:09.289159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023364+0000","last_change":"2024-09-19T09:14:44.023434+0000","last_active":"2024-09-19T09:14:45.023364+0000","last_peered":"2024-09-19T09:14:45.023364+0000","last_clean":"2024-09-19T09:14:45.023364+0000","last_became_active":"2024-09-19T09:14:44.023158+0000","last_became_peered":"2024-09-19T09:14:44.023158+0000","last_unstale":"2024-09-19T09:14:45.023364+0000","last_undegraded":"2024-09-19T09:14:45.023364+0000","last_fullsized":"2024-09-19T09:14:45.023364+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:23.119386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023818+0000","last_change":"2024-09-19T09:14:44.026325+0000","last_active":"2024-09-19T09:14:45.023818+0000","last_peered":"2024-09-19T09:14:45.023818+0000","last_clean":"2024-09-19T09:14:45.023818+0000","last_became_active":"2024-09-19T09:14:44.026012+0000","last_became_peered":"2024-09-19T09:14:44.026012+0000","last_unstale":"2024-09-19T09:14:45.023818+0000","last_undegraded":"2024-09-19T09:14:45.023818+0000","last_fullsized":"2024-09-19T09:14:45.023818+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:42:13.259685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025616+0000","last_change":"2024-09-19T09:14:44.019374+0000","last_active":"2024-09-19T09:14:45.025616+0000","last_peered":"2024-09-19T09:14:45.025616+0000","last_clean":"2024-09-19T09:14:45.025616+0000","last_became_active":"2024-09-19T09:14:44.018900+0000","last_became_peered":"2024-09-19T09:14:44.018900+0000","last_unstale":"2024-09-19T09:14:45.025616+0000","last_undegraded":"2024-09-19T09:14:45.025616+0000","last_fullsized":"2024-09-19T09:14:45.025616+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:10:19.362096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.855697+0000","last_change":"2024-09-19T09:14:44.016835+0000","last_active":"2024-09-19T09:14:45.855697+0000","last_peered":"2024-09-19T09:14:45.855697+0000","last_clean":"2024-09-19T09:14:45.855697+0000","last_became_active":"2024-09-19T09:14:44.016574+0000","last_became_peered":"2024-09-19T09:14:44.016574+0000","last_unstale":"2024-09-19T09:14:45.855697+0000","last_undegraded":"2024-09-19T09:14:45.855697+0000","last_fullsized":"2024-09-19T09:14:45.855697+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:47.901790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579564+0000","last_change":"2024-09-19T09:14:44.015759+0000","last_active":"2024-09-19T09:14:45.579564+0000","last_peered":"2024-09-19T09:14:45.579564+0000","last_clean":"2024-09-19T09:14:45.579564+0000","last_became_active":"2024-09-19T09:14:44.015212+0000","last_became_peered":"2024-09-19T09:14:44.015212+0000","last_unstale":"2024-09-19T09:14:45.579564+0000","last_undegraded":"2024-09-19T09:14:45.579564+0000","last_fullsized":"2024-09-19T09:14:45.579564+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:08.971150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.026921+0000","last_change":"2024-09-19T09:14:44.021729+0000","last_active":"2024-09-19T09:14:45.026921+0000","last_peered":"2024-09-19T09:14:45.026921+0000","last_clean":"2024-09-19T09:14:45.026921+0000","last_became_active":"2024-09-19T09:14:44.020854+0000","last_became_peered":"2024-09-19T09:14:44.020854+0000","last_unstale":"2024-09-19T09:14:45.026921+0000","last_undegraded":"2024-09-19T09:14:45.026921+0000","last_fullsized":"2024-09-19T09:14:45.026921+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:57.512333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025457+0000","last_change":"2024-09-19T09:14:44.019723+0000","last_active":"2024-09-19T09:14:45.025457+0000","last_peered":"2024-09-19T09:14:45.025457+0000","last_clean":"2024-09-19T09:14:45.025457+0000","last_became_active":"2024-09-19T09:14:44.018191+0000","last_became_peered":"2024-09-19T09:14:44.018191+0000","last_unstale":"2024-09-19T09:14:45.025457+0000","last_undegraded":"2024-09-19T09:14:45.025457+0000","last_fullsized":"2024-09-19T09:14:45.025457+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:16.158285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579413+0000","last_change":"2024-09-19T09:14:44.026530+0000","last_active":"2024-09-19T09:14:45.579413+0000","last_peered":"2024-09-19T09:14:45.579413+0000","last_clean":"2024-09-19T09:14:45.579413+0000","last_became_active":"2024-09-19T09:14:44.026301+0000","last_became_peered":"2024-09-19T09:14:44.026301+0000","last_unstale":"2024-09-19T09:14:45.579413+0000","last_undegraded":"2024-09-19T09:14:45.579413+0000","last_fullsized":"2024-09-19T09:14:45.579413+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:46.873170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.380606+0000","last_change":"2024-09-19T09:14:44.023745+0000","last_active":"2024-09-19T09:14:45.380606+0000","last_peered":"2024-09-19T09:14:45.380606+0000","last_clean":"2024-09-19T09:14:45.380606+0000","last_became_active":"2024-09-19T09:14:44.022892+0000","last_became_peered":"2024-09-19T09:14:44.022892+0000","last_unstale":"2024-09-19T09:14:45.380606+0000","last_undegraded":"2024-09-19T09:14:45.380606+0000","last_fullsized":"2024-09-19T09:14:45.380606+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:36.520416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025550+0000","last_change":"2024-09-19T09:14:44.016533+0000","last_active":"2024-09-19T09:14:45.025550+0000","last_peered":"2024-09-19T09:14:45.025550+0000","last_clean":"2024-09-19T09:14:45.025550+0000","last_became_active":"2024-09-19T09:14:44.016289+0000","last_became_peered":"2024-09-19T09:14:44.016289+0000","last_unstale":"2024-09-19T09:14:45.025550+0000","last_undegraded":"2024-09-19T09:14:45.025550+0000","last_fullsized":"2024-09-19T09:14:45.025550+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:05.136039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023495+0000","last_change":"2024-09-19T09:14:44.021440+0000","last_active":"2024-09-19T09:14:45.023495+0000","last_peered":"2024-09-19T09:14:45.023495+0000","last_clean":"2024-09-19T09:14:45.023495+0000","last_became_active":"2024-09-19T09:14:44.020755+0000","last_became_peered":"2024-09-19T09:14:44.020755+0000","last_unstale":"2024-09-19T09:14:45.023495+0000","last_undegraded":"2024-09-19T09:14:45.023495+0000","last_fullsized":"2024-09-19T09:14:45.023495+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:21.918635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579411+0000","last_change":"2024-09-19T09:14:44.019410+0000","last_active":"2024-09-19T09:14:45.579411+0000","last_peered":"2024-09-19T09:14:45.579411+0000","last_clean":"2024-09-19T09:14:45.579411+0000","last_became_active":"2024-09-19T09:14:44.019176+0000","last_became_peered":"2024-09-19T09:14:44.019176+0000","last_unstale":"2024-09-19T09:14:45.579411+0000","last_undegraded":"2024-09-19T09:14:45.579411+0000","last_fullsized":"2024-09-19T09:14:45.579411+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:56:42.073869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.026100+0000","last_change":"2024-09-19T09:14:44.026653+0000","last_active":"2024-09-19T09:14:45.026100+0000","last_peered":"2024-09-19T09:14:45.026100+0000","last_clean":"2024-09-19T09:14:45.026100+0000","last_became_active":"2024-09-19T09:14:44.025208+0000","last_became_peered":"2024-09-19T09:14:44.025208+0000","last_unstale":"2024-09-19T09:14:45.026100+0000","last_undegraded":"2024-09-19T09:14:45.026100+0000","last_fullsized":"2024-09-19T09:14:45.026100+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:31.011663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025521+0000","last_change":"2024-09-19T09:14:44.022107+0000","last_active":"2024-09-19T09:14:45.025521+0000","last_peered":"2024-09-19T09:14:45.025521+0000","last_clean":"2024-09-19T09:14:45.025521+0000","last_became_active":"2024-09-19T09:14:44.021857+0000","last_became_peered":"2024-09-19T09:14:44.021857+0000","last_unstale":"2024-09-19T09:14:45.025521+0000","last_undegraded":"2024-09-19T09:14:45.025521+0000","last_fullsized":"2024-09-19T09:14:45.025521+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:18.924610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.855991+0000","last_change":"2024-09-19T09:14:44.028561+0000","last_active":"2024-09-19T09:14:45.855991+0000","last_peered":"2024-09-19T09:14:45.855991+0000","last_clean":"2024-09-19T09:14:45.855991+0000","last_became_active":"2024-09-19T09:14:44.027606+0000","last_became_peered":"2024-09-19T09:14:44.027606+0000","last_unstale":"2024-09-19T09:14:45.855991+0000","last_undegraded":"2024-09-19T09:14:45.855991+0000","last_fullsized":"2024-09-19T09:14:45.855991+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:55:01.394733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023637+0000","last_change":"2024-09-19T09:14:44.024576+0000","last_active":"2024-09-19T09:14:45.023637+0000","last_peered":"2024-09-19T09:14:45.023637+0000","last_clean":"2024-09-19T09:14:45.023637+0000","last_became_active":"2024-09-19T09:14:44.024110+0000","last_became_peered":"2024-09-19T09:14:44.024110+0000","last_unstale":"2024-09-19T09:14:45.023637+0000","last_undegraded":"2024-09-19T09:14:45.023637+0000","last_fullsized":"2024-09-19T09:14:45.023637+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:38.515108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023956+0000","last_change":"2024-09-19T09:14:44.025103+0000","last_active":"2024-09-19T09:14:45.023956+0000","last_peered":"2024-09-19T09:14:45.023956+0000","last_clean":"2024-09-19T09:14:45.023956+0000","last_became_active":"2024-09-19T09:14:44.024726+0000","last_became_peered":"2024-09-19T09:14:44.024726+0000","last_unstale":"2024-09-19T09:14:45.023956+0000","last_undegraded":"2024-09-19T09:14:45.023956+0000","last_fullsized":"2024-09-19T09:14:45.023956+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:32:47.017256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.855784+0000","last_change":"2024-09-19T09:14:44.016090+0000","last_active":"2024-09-19T09:14:45.855784+0000","last_peered":"2024-09-19T09:14:45.855784+0000","last_clean":"2024-09-19T09:14:45.855784+0000","last_became_active":"2024-09-19T09:14:44.015791+0000","last_became_peered":"2024-09-19T09:14:44.015791+0000","last_unstale":"2024-09-19T09:14:45.855784+0000","last_undegraded":"2024-09-19T09:14:45.855784+0000","last_fullsized":"2024-09-19T09:14:45.855784+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:30.893989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.380958+0000","last_change":"2024-09-19T09:14:44.018780+0000","last_active":"2024-09-19T09:14:45.380958+0000","last_peered":"2024-09-19T09:14:45.380958+0000","last_clean":"2024-09-19T09:14:45.380958+0000","last_became_active":"2024-09-19T09:14:44.018547+0000","last_became_peered":"2024-09-19T09:14:44.018547+0000","last_unstale":"2024-09-19T09:14:45.380958+0000","last_undegraded":"2024-09-19T09:14:45.380958+0000","last_fullsized":"2024-09-19T09:14:45.380958+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:22:18.613092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025746+0000","last_change":"2024-09-19T09:14:44.023129+0000","last_active":"2024-09-19T09:14:45.025746+0000","last_peered":"2024-09-19T09:14:45.025746+0000","last_clean":"2024-09-19T09:14:45.025746+0000","last_became_active":"2024-09-19T09:14:44.022338+0000","last_became_peered":"2024-09-19T09:14:44.022338+0000","last_unstale":"2024-09-19T09:14:45.025746+0000","last_undegraded":"2024-09-19T09:14:45.025746+0000","last_fullsized":"2024-09-19T09:14:45.025746+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:20.131137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579033+0000","last_change":"2024-09-19T09:14:44.020481+0000","last_active":"2024-09-19T09:14:45.579033+0000","last_peered":"2024-09-19T09:14:45.579033+0000","last_clean":"2024-09-19T09:14:45.579033+0000","last_became_active":"2024-09-19T09:14:44.020243+0000","last_became_peered":"2024-09-19T09:14:44.020243+0000","last_unstale":"2024-09-19T09:14:45.579033+0000","last_undegraded":"2024-09-19T09:14:45.579033+0000","last_fullsized":"2024-09-19T09:14:45.579033+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:44.313933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027308+0000","last_change":"2024-09-19T09:14:44.016953+0000","last_active":"2024-09-19T09:14:45.027308+0000","last_peered":"2024-09-19T09:14:45.027308+0000","last_clean":"2024-09-19T09:14:45.027308+0000","last_became_active":"2024-09-19T09:14:44.016719+0000","last_became_peered":"2024-09-19T09:14:44.016719+0000","last_unstale":"2024-09-19T09:14:45.027308+0000","last_undegraded":"2024-09-19T09:14:45.027308+0000","last_fullsized":"2024-09-19T09:14:45.027308+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:50.777345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023984+0000","last_change":"2024-09-19T09:14:44.014815+0000","last_active":"2024-09-19T09:14:45.023984+0000","last_peered":"2024-09-19T09:14:45.023984+0000","last_clean":"2024-09-19T09:14:45.023984+0000","last_became_active":"2024-09-19T09:14:44.014572+0000","last_became_peered":"2024-09-19T09:14:44.014572+0000","last_unstale":"2024-09-19T09:14:45.023984+0000","last_undegraded":"2024-09-19T09:14:45.023984+0000","last_fullsized":"2024-09-19T09:14:45.023984+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:14.082571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.855858+0000","last_change":"2024-09-19T09:14:44.022461+0000","last_active":"2024-09-19T09:14:45.855858+0000","last_peered":"2024-09-19T09:14:45.855858+0000","last_clean":"2024-09-19T09:14:45.855858+0000","last_became_active":"2024-09-19T09:14:44.022163+0000","last_became_peered":"2024-09-19T09:14:44.022163+0000","last_unstale":"2024-09-19T09:14:45.855858+0000","last_undegraded":"2024-09-19T09:14:45.855858+0000","last_fullsized":"2024-09-19T09:14:45.855858+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:04:00.402110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025848+0000","last_change":"2024-09-19T09:14:44.018197+0000","last_active":"2024-09-19T09:14:45.025848+0000","last_peered":"2024-09-19T09:14:45.025848+0000","last_clean":"2024-09-19T09:14:45.025848+0000","last_became_active":"2024-09-19T09:14:44.016868+0000","last_became_peered":"2024-09-19T09:14:44.016868+0000","last_unstale":"2024-09-19T09:14:45.025848+0000","last_undegraded":"2024-09-19T09:14:45.025848+0000","last_fullsized":"2024-09-19T09:14:45.025848+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:00.498567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027069+0000","last_change":"2024-09-19T09:14:44.026325+0000","last_active":"2024-09-19T09:14:45.027069+0000","last_peered":"2024-09-19T09:14:45.027069+0000","last_clean":"2024-09-19T09:14:45.027069+0000","last_became_active":"2024-09-19T09:14:44.026047+0000","last_became_peered":"2024-09-19T09:14:44.026047+0000","last_unstale":"2024-09-19T09:14:45.027069+0000","last_undegraded":"2024-09-19T09:14:45.027069+0000","last_fullsized":"2024-09-19T09:14:45.027069+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:00:09.035109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.026917+0000","last_change":"2024-09-19T09:14:44.016015+0000","last_active":"2024-09-19T09:14:45.026917+0000","last_peered":"2024-09-19T09:14:45.026917+0000","last_clean":"2024-09-19T09:14:45.026917+0000","last_became_active":"2024-09-19T09:14:44.015604+0000","last_became_peered":"2024-09-19T09:14:44.015604+0000","last_unstale":"2024-09-19T09:14:45.026917+0000","last_undegraded":"2024-09-19T09:14:45.026917+0000","last_fullsized":"2024-09-19T09:14:45.026917+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:45.500407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.855548+0000","last_change":"2024-09-19T09:14:44.025696+0000","last_active":"2024-09-19T09:14:45.855548+0000","last_peered":"2024-09-19T09:14:45.855548+0000","last_clean":"2024-09-19T09:14:45.855548+0000","last_became_active":"2024-09-19T09:14:44.025462+0000","last_became_peered":"2024-09-19T09:14:44.025462+0000","last_unstale":"2024-09-19T09:14:45.855548+0000","last_undegraded":"2024-09-19T09:14:45.855548+0000","last_fullsized":"2024-09-19T09:14:45.855548+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:07:28.292632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023589+0000","last_change":"2024-09-19T09:14:44.019656+0000","last_active":"2024-09-19T09:14:45.023589+0000","last_peered":"2024-09-19T09:14:45.023589+0000","last_clean":"2024-09-19T09:14:45.023589+0000","last_became_active":"2024-09-19T09:14:44.019426+0000","last_became_peered":"2024-09-19T09:14:44.019426+0000","last_unstale":"2024-09-19T09:14:45.023589+0000","last_undegraded":"2024-09-19T09:14:45.023589+0000","last_fullsized":"2024-09-19T09:14:45.023589+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:08.366531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579714+0000","last_change":"2024-09-19T09:14:44.029037+0000","last_active":"2024-09-19T09:14:45.579714+0000","last_peered":"2024-09-19T09:14:45.579714+0000","last_clean":"2024-09-19T09:14:45.579714+0000","last_became_active":"2024-09-19T09:14:44.028740+0000","last_became_peered":"2024-09-19T09:14:44.028740+0000","last_unstale":"2024-09-19T09:14:45.579714+0000","last_undegraded":"2024-09-19T09:14:45.579714+0000","last_fullsized":"2024-09-19T09:14:45.579714+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:13.673571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025691+0000","last_change":"2024-09-19T09:14:44.013682+0000","last_active":"2024-09-19T09:14:45.025691+0000","last_peered":"2024-09-19T09:14:45.025691+0000","last_clean":"2024-09-19T09:14:45.025691+0000","last_became_active":"2024-09-19T09:14:44.012991+0000","last_became_peered":"2024-09-19T09:14:44.012991+0000","last_unstale":"2024-09-19T09:14:45.025691+0000","last_undegraded":"2024-09-19T09:14:45.025691+0000","last_fullsized":"2024-09-19T09:14:45.025691+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:32.721701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.578807+0000","last_change":"2024-09-19T09:14:44.025357+0000","last_active":"2024-09-19T09:14:45.578807+0000","last_peered":"2024-09-19T09:14:45.578807+0000","last_clean":"2024-09-19T09:14:45.578807+0000","last_became_active":"2024-09-19T09:14:44.024786+0000","last_became_peered":"2024-09-19T09:14:44.024786+0000","last_unstale":"2024-09-19T09:14:45.578807+0000","last_undegraded":"2024-09-19T09:14:45.578807+0000","last_fullsized":"2024-09-19T09:14:45.578807+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:59.293856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"47'4","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579623+0000","last_change":"2024-09-19T09:14:43.020742+0000","last_active":"2024-09-19T09:14:45.579623+0000","last_peered":"2024-09-19T09:14:45.579623+0000","last_clean":"2024-09-19T09:14:45.579623+0000","last_became_active":"2024-09-19T09:14:43.020526+0000","last_became_peered":"2024-09-19T09:14:43.020526+0000","last_unstale":"2024-09-19T09:14:45.579623+0000","last_undegraded":"2024-09-19T09:14:45.579623+0000","last_fullsized":"2024-09-19T09:14:45.579623+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:38.025292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.855925+0000","last_change":"2024-09-19T09:14:44.016202+0000","last_active":"2024-09-19T09:14:45.855925+0000","last_peered":"2024-09-19T09:14:45.855925+0000","last_clean":"2024-09-19T09:14:45.855925+0000","last_became_active":"2024-09-19T09:14:44.015862+0000","last_became_peered":"2024-09-19T09:14:44.015862+0000","last_unstale":"2024-09-19T09:14:45.855925+0000","last_undegraded":"2024-09-19T09:14:45.855925+0000","last_fullsized":"2024-09-19T09:14:45.855925+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:29.501504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027213+0000","last_change":"2024-09-19T09:14:43.017838+0000","last_active":"2024-09-19T09:14:45.027213+0000","last_peered":"2024-09-19T09:14:45.027213+0000","last_clean":"2024-09-19T09:14:45.027213+0000","last_became_active":"2024-09-19T09:14:43.017558+0000","last_became_peered":"2024-09-19T09:14:43.017558+0000","last_unstale":"2024-09-19T09:14:45.027213+0000","last_undegraded":"2024-09-19T09:14:45.027213+0000","last_fullsized":"2024-09-19T09:14:45.027213+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:43.090331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.024009+0000","last_change":"2024-09-19T09:14:44.027442+0000","last_active":"2024-09-19T09:14:45.024009+0000","last_peered":"2024-09-19T09:14:45.024009+0000","last_clean":"2024-09-19T09:14:45.024009+0000","last_became_active":"2024-09-19T09:14:44.025126+0000","last_became_peered":"2024-09-19T09:14:44.025126+0000","last_unstale":"2024-09-19T09:14:45.024009+0000","last_undegraded":"2024-09-19T09:14:45.024009+0000","last_fullsized":"2024-09-19T09:14:45.024009+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:09:25.555913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579479+0000","last_change":"2024-09-19T09:14:43.021795+0000","last_active":"2024-09-19T09:14:45.579479+0000","last_peered":"2024-09-19T09:14:45.579479+0000","last_clean":"2024-09-19T09:14:45.579479+0000","last_became_active":"2024-09-19T09:14:43.021581+0000","last_became_peered":"2024-09-19T09:14:43.021581+0000","last_unstale":"2024-09-19T09:14:45.579479+0000","last_undegraded":"2024-09-19T09:14:45.579479+0000","last_fullsized":"2024-09-19T09:14:45.579479+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:21.982112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025688+0000","last_change":"2024-09-19T09:14:44.014607+0000","last_active":"2024-09-19T09:14:45.025688+0000","last_peered":"2024-09-19T09:14:45.025688+0000","last_clean":"2024-09-19T09:14:45.025688+0000","last_became_active":"2024-09-19T09:14:44.014243+0000","last_became_peered":"2024-09-19T09:14:44.014243+0000","last_unstale":"2024-09-19T09:14:45.025688+0000","last_undegraded":"2024-09-19T09:14:45.025688+0000","last_fullsized":"2024-09-19T09:14:45.025688+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:13.783290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.026910+0000","last_change":"2024-09-19T09:14:43.017408+0000","last_active":"2024-09-19T09:14:45.026910+0000","last_peered":"2024-09-19T09:14:45.026910+0000","last_clean":"2024-09-19T09:14:45.026910+0000","last_became_active":"2024-09-19T09:14:43.017170+0000","last_became_peered":"2024-09-19T09:14:43.017170+0000","last_unstale":"2024-09-19T09:14:45.026910+0000","last_undegraded":"2024-09-19T09:14:45.026910+0000","last_fullsized":"2024-09-19T09:14:45.026910+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:27.767882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027081+0000","last_change":"2024-09-19T09:14:44.027900+0000","last_active":"2024-09-19T09:14:45.027081+0000","last_peered":"2024-09-19T09:14:45.027081+0000","last_clean":"2024-09-19T09:14:45.027081+0000","last_became_active":"2024-09-19T09:14:44.027657+0000","last_became_peered":"2024-09-19T09:14:44.027657+0000","last_unstale":"2024-09-19T09:14:45.027081+0000","last_undegraded":"2024-09-19T09:14:45.027081+0000","last_fullsized":"2024-09-19T09:14:45.027081+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:32.789950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579409+0000","last_change":"2024-09-19T09:14:43.011945+0000","last_active":"2024-09-19T09:14:45.579409+0000","last_peered":"2024-09-19T09:14:45.579409+0000","last_clean":"2024-09-19T09:14:45.579409+0000","last_became_active":"2024-09-19T09:14:43.011669+0000","last_became_peered":"2024-09-19T09:14:43.011669+0000","last_unstale":"2024-09-19T09:14:45.579409+0000","last_undegraded":"2024-09-19T09:14:45.579409+0000","last_fullsized":"2024-09-19T09:14:45.579409+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:59:08.370808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.380644+0000","last_change":"2024-09-19T09:14:44.023315+0000","last_active":"2024-09-19T09:14:45.380644+0000","last_peered":"2024-09-19T09:14:45.380644+0000","last_clean":"2024-09-19T09:14:45.380644+0000","last_became_active":"2024-09-19T09:14:44.023070+0000","last_became_peered":"2024-09-19T09:14:44.023070+0000","last_unstale":"2024-09-19T09:14:45.380644+0000","last_undegraded":"2024-09-19T09:14:45.380644+0000","last_fullsized":"2024-09-19T09:14:45.380644+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:40:42.067393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027386+0000","last_change":"2024-09-19T09:14:43.022002+0000","last_active":"2024-09-19T09:14:45.027386+0000","last_peered":"2024-09-19T09:14:45.027386+0000","last_clean":"2024-09-19T09:14:45.027386+0000","last_became_active":"2024-09-19T09:14:43.021747+0000","last_became_peered":"2024-09-19T09:14:43.021747+0000","last_unstale":"2024-09-19T09:14:45.027386+0000","last_undegraded":"2024-09-19T09:14:45.027386+0000","last_fullsized":"2024-09-19T09:14:45.027386+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:21.026772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.380737+0000","last_change":"2024-09-19T09:14:44.024204+0000","last_active":"2024-09-19T09:14:45.380737+0000","last_peered":"2024-09-19T09:14:45.380737+0000","last_clean":"2024-09-19T09:14:45.380737+0000","last_became_active":"2024-09-19T09:14:44.023505+0000","last_became_peered":"2024-09-19T09:14:44.023505+0000","last_unstale":"2024-09-19T09:14:45.380737+0000","last_undegraded":"2024-09-19T09:14:45.380737+0000","last_fullsized":"2024-09-19T09:14:45.380737+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:03:54.166840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.855635+0000","last_change":"2024-09-19T09:14:43.021982+0000","last_active":"2024-09-19T09:14:45.855635+0000","last_peered":"2024-09-19T09:14:45.855635+0000","last_clean":"2024-09-19T09:14:45.855635+0000","last_became_active":"2024-09-19T09:14:43.021375+0000","last_became_peered":"2024-09-19T09:14:43.021375+0000","last_unstale":"2024-09-19T09:14:45.855635+0000","last_undegraded":"2024-09-19T09:14:45.855635+0000","last_fullsized":"2024-09-19T09:14:45.855635+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:41.845835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.026960+0000","last_change":"2024-09-19T09:14:44.022900+0000","last_active":"2024-09-19T09:14:45.026960+0000","last_peered":"2024-09-19T09:14:45.026960+0000","last_clean":"2024-09-19T09:14:45.026960+0000","last_became_active":"2024-09-19T09:14:44.022655+0000","last_became_peered":"2024-09-19T09:14:44.022655+0000","last_unstale":"2024-09-19T09:14:45.026960+0000","last_undegraded":"2024-09-19T09:14:45.026960+0000","last_fullsized":"2024-09-19T09:14:45.026960+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:45.281756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.381019+0000","last_change":"2024-09-19T09:14:43.019253+0000","last_active":"2024-09-19T09:14:45.381019+0000","last_peered":"2024-09-19T09:14:45.381019+0000","last_clean":"2024-09-19T09:14:45.381019+0000","last_became_active":"2024-09-19T09:14:43.018841+0000","last_became_peered":"2024-09-19T09:14:43.018841+0000","last_unstale":"2024-09-19T09:14:45.381019+0000","last_undegraded":"2024-09-19T09:14:45.381019+0000","last_fullsized":"2024-09-19T09:14:45.381019+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:08:02.512785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023549+0000","last_change":"2024-09-19T09:14:44.022473+0000","last_active":"2024-09-19T09:14:45.023549+0000","last_peered":"2024-09-19T09:14:45.023549+0000","last_clean":"2024-09-19T09:14:45.023549+0000","last_became_active":"2024-09-19T09:14:44.020917+0000","last_became_peered":"2024-09-19T09:14:44.020917+0000","last_unstale":"2024-09-19T09:14:45.023549+0000","last_undegraded":"2024-09-19T09:14:45.023549+0000","last_fullsized":"2024-09-19T09:14:45.023549+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:10:02.210631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.024460+0000","last_change":"2024-09-19T09:14:43.015721+0000","last_active":"2024-09-19T09:14:45.024460+0000","last_peered":"2024-09-19T09:14:45.024460+0000","last_clean":"2024-09-19T09:14:45.024460+0000","last_became_active":"2024-09-19T09:14:43.015423+0000","last_became_peered":"2024-09-19T09:14:43.015423+0000","last_unstale":"2024-09-19T09:14:45.024460+0000","last_undegraded":"2024-09-19T09:14:45.024460+0000","last_fullsized":"2024-09-19T09:14:45.024460+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:27.122536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.024099+0000","last_change":"2024-09-19T09:14:44.029393+0000","last_active":"2024-09-19T09:14:45.024099+0000","last_peered":"2024-09-19T09:14:45.024099+0000","last_clean":"2024-09-19T09:14:45.024099+0000","last_became_active":"2024-09-19T09:14:44.029136+0000","last_became_peered":"2024-09-19T09:14:44.029136+0000","last_unstale":"2024-09-19T09:14:45.024099+0000","last_undegraded":"2024-09-19T09:14:45.024099+0000","last_fullsized":"2024-09-19T09:14:45.024099+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:19:16.335233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.381048+0000","last_change":"2024-09-19T09:14:43.018969+0000","last_active":"2024-09-19T09:14:45.381048+0000","last_peered":"2024-09-19T09:14:45.381048+0000","last_clean":"2024-09-19T09:14:45.381048+0000","last_became_active":"2024-09-19T09:14:43.018389+0000","last_became_peered":"2024-09-19T09:14:43.018389+0000","last_unstale":"2024-09-19T09:14:45.381048+0000","last_undegraded":"2024-09-19T09:14:45.381048+0000","last_fullsized":"2024-09-19T09:14:45.381048+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:53.598810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025822+0000","last_change":"2024-09-19T09:14:44.025437+0000","last_active":"2024-09-19T09:14:45.025822+0000","last_peered":"2024-09-19T09:14:45.025822+0000","last_clean":"2024-09-19T09:14:45.025822+0000","last_became_active":"2024-09-19T09:14:44.024770+0000","last_became_peered":"2024-09-19T09:14:44.024770+0000","last_unstale":"2024-09-19T09:14:45.025822+0000","last_undegraded":"2024-09-19T09:14:45.025822+0000","last_fullsized":"2024-09-19T09:14:45.025822+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:36.790289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"47'3","reported_seq":17,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.024442+0000","last_change":"2024-09-19T09:14:43.021320+0000","last_active":"2024-09-19T09:14:45.024442+0000","last_peered":"2024-09-19T09:14:45.024442+0000","last_clean":"2024-09-19T09:14:45.024442+0000","last_became_active":"2024-09-19T09:14:43.020968+0000","last_became_peered":"2024-09-19T09:14:43.020968+0000","last_unstale":"2024-09-19T09:14:45.024442+0000","last_undegraded":"2024-09-19T09:14:45.024442+0000","last_fullsized":"2024-09-19T09:14:45.024442+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:40:45.301062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027221+0000","last_change":"2024-09-19T09:14:44.019006+0000","last_active":"2024-09-19T09:14:45.027221+0000","last_peered":"2024-09-19T09:14:45.027221+0000","last_clean":"2024-09-19T09:14:45.027221+0000","last_became_active":"2024-09-19T09:14:44.018713+0000","last_became_peered":"2024-09-19T09:14:44.018713+0000","last_unstale":"2024-09-19T09:14:45.027221+0000","last_undegraded":"2024-09-19T09:14:45.027221+0000","last_fullsized":"2024-09-19T09:14:45.027221+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:17.324728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"47'6","reported_seq":20,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.380900+0000","last_change":"2024-09-19T09:14:43.018818+0000","last_active":"2024-09-19T09:14:45.380900+0000","last_peered":"2024-09-19T09:14:45.380900+0000","last_clean":"2024-09-19T09:14:45.380900+0000","last_became_active":"2024-09-19T09:14:43.018404+0000","last_became_peered":"2024-09-19T09:14:43.018404+0000","last_unstale":"2024-09-19T09:14:45.380900+0000","last_undegraded":"2024-09-19T09:14:45.380900+0000","last_fullsized":"2024-09-19T09:14:45.380900+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:15.384351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.024230+0000","last_change":"2024-09-19T09:14:44.026006+0000","last_active":"2024-09-19T09:14:45.024230+0000","last_peered":"2024-09-19T09:14:45.024230+0000","last_clean":"2024-09-19T09:14:45.024230+0000","last_became_active":"2024-09-19T09:14:44.025744+0000","last_became_peered":"2024-09-19T09:14:44.025744+0000","last_unstale":"2024-09-19T09:14:45.024230+0000","last_undegraded":"2024-09-19T09:14:45.024230+0000","last_fullsized":"2024-09-19T09:14:45.024230+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:29.175037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579200+0000","last_change":"2024-09-19T09:14:43.012153+0000","last_active":"2024-09-19T09:14:45.579200+0000","last_peered":"2024-09-19T09:14:45.579200+0000","last_clean":"2024-09-19T09:14:45.579200+0000","last_became_active":"2024-09-19T09:14:43.011918+0000","last_became_peered":"2024-09-19T09:14:43.011918+0000","last_unstale":"2024-09-19T09:14:45.579200+0000","last_undegraded":"2024-09-19T09:14:45.579200+0000","last_fullsized":"2024-09-19T09:14:45.579200+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:40.088791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.578945+0000","last_change":"2024-09-19T09:14:44.017690+0000","last_active":"2024-09-19T09:14:45.578945+0000","last_peered":"2024-09-19T09:14:45.578945+0000","last_clean":"2024-09-19T09:14:45.578945+0000","last_became_active":"2024-09-19T09:14:44.017382+0000","last_became_peered":"2024-09-19T09:14:44.017382+0000","last_unstale":"2024-09-19T09:14:45.578945+0000","last_undegraded":"2024-09-19T09:14:45.578945+0000","last_fullsized":"2024-09-19T09:14:45.578945+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:27.398579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.856047+0000","last_change":"2024-09-19T09:14:43.016145+0000","last_active":"2024-09-19T09:14:45.856047+0000","last_peered":"2024-09-19T09:14:45.856047+0000","last_clean":"2024-09-19T09:14:45.856047+0000","last_became_active":"2024-09-19T09:14:43.015822+0000","last_became_peered":"2024-09-19T09:14:43.015822+0000","last_unstale":"2024-09-19T09:14:45.856047+0000","last_undegraded":"2024-09-19T09:14:45.856047+0000","last_fullsized":"2024-09-19T09:14:45.856047+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:23:23.072844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.578781+0000","last_change":"2024-09-19T09:14:44.019220+0000","last_active":"2024-09-19T09:14:45.578781+0000","last_peered":"2024-09-19T09:14:45.578781+0000","last_clean":"2024-09-19T09:14:45.578781+0000","last_became_active":"2024-09-19T09:14:44.018980+0000","last_became_peered":"2024-09-19T09:14:44.018980+0000","last_unstale":"2024-09-19T09:14:45.578781+0000","last_undegraded":"2024-09-19T09:14:45.578781+0000","last_fullsized":"2024-09-19T09:14:45.578781+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:49.951747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579493+0000","last_change":"2024-09-19T09:14:43.014274+0000","last_active":"2024-09-19T09:14:45.579493+0000","last_peered":"2024-09-19T09:14:45.579493+0000","last_clean":"2024-09-19T09:14:45.579493+0000","last_became_active":"2024-09-19T09:14:43.013722+0000","last_became_peered":"2024-09-19T09:14:43.013722+0000","last_unstale":"2024-09-19T09:14:45.579493+0000","last_undegraded":"2024-09-19T09:14:45.579493+0000","last_fullsized":"2024-09-19T09:14:45.579493+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:23.292449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023763+0000","last_change":"2024-09-19T09:14:44.024354+0000","last_active":"2024-09-19T09:14:45.023763+0000","last_peered":"2024-09-19T09:14:45.023763+0000","last_clean":"2024-09-19T09:14:45.023763+0000","last_became_active":"2024-09-19T09:14:44.023780+0000","last_became_peered":"2024-09-19T09:14:44.023780+0000","last_unstale":"2024-09-19T09:14:45.023763+0000","last_undegraded":"2024-09-19T09:14:45.023763+0000","last_fullsized":"2024-09-19T09:14:45.023763+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:18.315720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"47'8","reported_seq":22,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.380576+0000","last_change":"2024-09-19T09:14:43.014824+0000","last_active":"2024-09-19T09:14:45.380576+0000","last_peered":"2024-09-19T09:14:45.380576+0000","last_clean":"2024-09-19T09:14:45.380576+0000","last_became_active":"2024-09-19T09:14:43.014570+0000","last_became_peered":"2024-09-19T09:14:43.014570+0000","last_unstale":"2024-09-19T09:14:45.380576+0000","last_undegraded":"2024-09-19T09:14:45.380576+0000","last_fullsized":"2024-09-19T09:14:45.380576+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:54.061691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579089+0000","last_change":"2024-09-19T09:14:44.020992+0000","last_active":"2024-09-19T09:14:45.579089+0000","last_peered":"2024-09-19T09:14:45.579089+0000","last_clean":"2024-09-19T09:14:45.579089+0000","last_became_active":"2024-09-19T09:14:44.020724+0000","last_became_peered":"2024-09-19T09:14:44.020724+0000","last_unstale":"2024-09-19T09:14:45.579089+0000","last_undegraded":"2024-09-19T09:14:45.579089+0000","last_fullsized":"2024-09-19T09:14:45.579089+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:30:40.503421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025950+0000","last_change":"2024-09-19T09:14:43.018292+0000","last_active":"2024-09-19T09:14:45.025950+0000","last_peered":"2024-09-19T09:14:45.025950+0000","last_clean":"2024-09-19T09:14:45.025950+0000","last_became_active":"2024-09-19T09:14:43.017848+0000","last_became_peered":"2024-09-19T09:14:43.017848+0000","last_unstale":"2024-09-19T09:14:45.025950+0000","last_undegraded":"2024-09-19T09:14:45.025950+0000","last_fullsized":"2024-09-19T09:14:45.025950+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:45.490695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.578958+0000","last_change":"2024-09-19T09:14:44.025089+0000","last_active":"2024-09-19T09:14:45.578958+0000","last_peered":"2024-09-19T09:14:45.578958+0000","last_clean":"2024-09-19T09:14:45.578958+0000","last_became_active":"2024-09-19T09:14:44.024431+0000","last_became_peered":"2024-09-19T09:14:44.024431+0000","last_unstale":"2024-09-19T09:14:45.578958+0000","last_undegraded":"2024-09-19T09:14:45.578958+0000","last_fullsized":"2024-09-19T09:14:45.578958+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:43.604622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023990+0000","last_change":"2024-09-19T09:14:43.015986+0000","last_active":"2024-09-19T09:14:45.023990+0000","last_peered":"2024-09-19T09:14:45.023990+0000","last_clean":"2024-09-19T09:14:45.023990+0000","last_became_active":"2024-09-19T09:14:43.015707+0000","last_became_peered":"2024-09-19T09:14:43.015707+0000","last_unstale":"2024-09-19T09:14:45.023990+0000","last_undegraded":"2024-09-19T09:14:45.023990+0000","last_fullsized":"2024-09-19T09:14:45.023990+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:55.935855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023906+0000","last_change":"2024-09-19T09:14:44.020439+0000","last_active":"2024-09-19T09:14:45.023906+0000","last_peered":"2024-09-19T09:14:45.023906+0000","last_clean":"2024-09-19T09:14:45.023906+0000","last_became_active":"2024-09-19T09:14:44.020161+0000","last_became_peered":"2024-09-19T09:14:44.020161+0000","last_unstale":"2024-09-19T09:14:45.023906+0000","last_undegraded":"2024-09-19T09:14:45.023906+0000","last_fullsized":"2024-09-19T09:14:45.023906+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:06.444772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"47'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.024560+0000","last_change":"2024-09-19T09:14:43.018432+0000","last_active":"2024-09-19T09:14:45.024560+0000","last_peered":"2024-09-19T09:14:45.024560+0000","last_clean":"2024-09-19T09:14:45.024560+0000","last_became_active":"2024-09-19T09:14:43.018185+0000","last_became_peered":"2024-09-19T09:14:43.018185+0000","last_unstale":"2024-09-19T09:14:45.024560+0000","last_undegraded":"2024-09-19T09:14:45.024560+0000","last_fullsized":"2024-09-19T09:14:45.024560+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:01.201460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.024367+0000","last_change":"2024-09-19T09:14:44.028325+0000","last_active":"2024-09-19T09:14:45.024367+0000","last_peered":"2024-09-19T09:14:45.024367+0000","last_clean":"2024-09-19T09:14:45.024367+0000","last_became_active":"2024-09-19T09:14:44.027940+0000","last_became_peered":"2024-09-19T09:14:44.027940+0000","last_unstale":"2024-09-19T09:14:45.024367+0000","last_undegraded":"2024-09-19T09:14:45.024367+0000","last_fullsized":"2024-09-19T09:14:45.024367+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:29.976057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579575+0000","last_change":"2024-09-19T09:14:43.013969+0000","last_active":"2024-09-19T09:14:45.579575+0000","last_peered":"2024-09-19T09:14:45.579575+0000","last_clean":"2024-09-19T09:14:45.579575+0000","last_became_active":"2024-09-19T09:14:43.013370+0000","last_became_peered":"2024-09-19T09:14:43.013370+0000","last_unstale":"2024-09-19T09:14:45.579575+0000","last_undegraded":"2024-09-19T09:14:45.579575+0000","last_fullsized":"2024-09-19T09:14:45.579575+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:54.441500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.380746+0000","last_change":"2024-09-19T09:14:44.023568+0000","last_active":"2024-09-19T09:14:45.380746+0000","last_peered":"2024-09-19T09:14:45.380746+0000","last_clean":"2024-09-19T09:14:45.380746+0000","last_became_active":"2024-09-19T09:14:44.023139+0000","last_became_peered":"2024-09-19T09:14:44.023139+0000","last_unstale":"2024-09-19T09:14:45.380746+0000","last_undegraded":"2024-09-19T09:14:45.380746+0000","last_fullsized":"2024-09-19T09:14:45.380746+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:20.812534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.380672+0000","last_change":"2024-09-19T09:14:43.016302+0000","last_active":"2024-09-19T09:14:45.380672+0000","last_peered":"2024-09-19T09:14:45.380672+0000","last_clean":"2024-09-19T09:14:45.380672+0000","last_became_active":"2024-09-19T09:14:43.016051+0000","last_became_peered":"2024-09-19T09:14:43.016051+0000","last_unstale":"2024-09-19T09:14:45.380672+0000","last_undegraded":"2024-09-19T09:14:45.380672+0000","last_fullsized":"2024-09-19T09:14:45.380672+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:06.635440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579546+0000","last_change":"2024-09-19T09:14:44.018465+0000","last_active":"2024-09-19T09:14:45.579546+0000","last_peered":"2024-09-19T09:14:45.579546+0000","last_clean":"2024-09-19T09:14:45.579546+0000","last_became_active":"2024-09-19T09:14:44.018236+0000","last_became_peered":"2024-09-19T09:14:44.018236+0000","last_unstale":"2024-09-19T09:14:45.579546+0000","last_undegraded":"2024-09-19T09:14:45.579546+0000","last_fullsized":"2024-09-19T09:14:45.579546+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:57.429129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.855696+0000","last_change":"2024-09-19T09:14:43.021698+0000","last_active":"2024-09-19T09:14:45.855696+0000","last_peered":"2024-09-19T09:14:45.855696+0000","last_clean":"2024-09-19T09:14:45.855696+0000","last_became_active":"2024-09-19T09:14:43.021031+0000","last_became_peered":"2024-09-19T09:14:43.021031+0000","last_unstale":"2024-09-19T09:14:45.855696+0000","last_undegraded":"2024-09-19T09:14:45.855696+0000","last_fullsized":"2024-09-19T09:14:45.855696+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:50.647331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025969+0000","last_change":"2024-09-19T09:14:44.026463+0000","last_active":"2024-09-19T09:14:45.025969+0000","last_peered":"2024-09-19T09:14:45.025969+0000","last_clean":"2024-09-19T09:14:45.025969+0000","last_became_active":"2024-09-19T09:14:44.026205+0000","last_became_peered":"2024-09-19T09:14:44.026205+0000","last_unstale":"2024-09-19T09:14:45.025969+0000","last_undegraded":"2024-09-19T09:14:45.025969+0000","last_fullsized":"2024-09-19T09:14:45.025969+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:07.055231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.381078+0000","last_change":"2024-09-19T09:14:43.016647+0000","last_active":"2024-09-19T09:14:45.381078+0000","last_peered":"2024-09-19T09:14:45.381078+0000","last_clean":"2024-09-19T09:14:45.381078+0000","last_became_active":"2024-09-19T09:14:43.016390+0000","last_became_peered":"2024-09-19T09:14:43.016390+0000","last_unstale":"2024-09-19T09:14:45.381078+0000","last_undegraded":"2024-09-19T09:14:45.381078+0000","last_fullsized":"2024-09-19T09:14:45.381078+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:30.278092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025836+0000","last_change":"2024-09-19T09:14:44.024826+0000","last_active":"2024-09-19T09:14:45.025836+0000","last_peered":"2024-09-19T09:14:45.025836+0000","last_clean":"2024-09-19T09:14:45.025836+0000","last_became_active":"2024-09-19T09:14:44.024589+0000","last_became_peered":"2024-09-19T09:14:44.024589+0000","last_unstale":"2024-09-19T09:14:45.025836+0000","last_undegraded":"2024-09-19T09:14:45.025836+0000","last_fullsized":"2024-09-19T09:14:45.025836+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:10.102105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027031+0000","last_change":"2024-09-19T09:14:43.014182+0000","last_active":"2024-09-19T09:14:45.027031+0000","last_peered":"2024-09-19T09:14:45.027031+0000","last_clean":"2024-09-19T09:14:45.027031+0000","last_became_active":"2024-09-19T09:14:43.013926+0000","last_became_peered":"2024-09-19T09:14:43.013926+0000","last_unstale":"2024-09-19T09:14:45.027031+0000","last_undegraded":"2024-09-19T09:14:45.027031+0000","last_fullsized":"2024-09-19T09:14:45.027031+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:44.694987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027182+0000","last_change":"2024-09-19T09:14:44.022263+0000","last_active":"2024-09-19T09:14:45.027182+0000","last_peered":"2024-09-19T09:14:45.027182+0000","last_clean":"2024-09-19T09:14:45.027182+0000","last_became_active":"2024-09-19T09:14:44.022029+0000","last_became_peered":"2024-09-19T09:14:44.022029+0000","last_unstale":"2024-09-19T09:14:45.027182+0000","last_undegraded":"2024-09-19T09:14:45.027182+0000","last_fullsized":"2024-09-19T09:14:45.027182+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:57.184977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"48'1","reported_seq":15,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027025+0000","last_change":"2024-09-19T09:14:43.016043+0000","last_active":"2024-09-19T09:14:45.027025+0000","last_peered":"2024-09-19T09:14:45.027025+0000","last_clean":"2024-09-19T09:14:45.027025+0000","last_became_active":"2024-09-19T09:14:43.015756+0000","last_became_peered":"2024-09-19T09:14:43.015756+0000","last_unstale":"2024-09-19T09:14:45.027025+0000","last_undegraded":"2024-09-19T09:14:45.027025+0000","last_fullsized":"2024-09-19T09:14:45.027025+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:28.109665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.380852+0000","last_change":"2024-09-19T09:14:44.023981+0000","last_active":"2024-09-19T09:14:45.380852+0000","last_peered":"2024-09-19T09:14:45.380852+0000","last_clean":"2024-09-19T09:14:45.380852+0000","last_became_active":"2024-09-19T09:14:44.023225+0000","last_became_peered":"2024-09-19T09:14:44.023225+0000","last_unstale":"2024-09-19T09:14:45.380852+0000","last_undegraded":"2024-09-19T09:14:45.380852+0000","last_fullsized":"2024-09-19T09:14:45.380852+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:35.414159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.855843+0000","last_change":"2024-09-19T09:14:43.019756+0000","last_active":"2024-09-19T09:14:45.855843+0000","last_peered":"2024-09-19T09:14:45.855843+0000","last_clean":"2024-09-19T09:14:45.855843+0000","last_became_active":"2024-09-19T09:14:43.019064+0000","last_became_peered":"2024-09-19T09:14:43.019064+0000","last_unstale":"2024-09-19T09:14:45.855843+0000","last_undegraded":"2024-09-19T09:14:45.855843+0000","last_fullsized":"2024-09-19T09:14:45.855843+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:39.258366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027112+0000","last_change":"2024-09-19T09:14:44.016509+0000","last_active":"2024-09-19T09:14:45.027112+0000","last_peered":"2024-09-19T09:14:45.027112+0000","last_clean":"2024-09-19T09:14:45.027112+0000","last_became_active":"2024-09-19T09:14:44.016185+0000","last_became_peered":"2024-09-19T09:14:44.016185+0000","last_unstale":"2024-09-19T09:14:45.027112+0000","last_undegraded":"2024-09-19T09:14:45.027112+0000","last_fullsized":"2024-09-19T09:14:45.027112+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:39.470792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579299+0000","last_change":"2024-09-19T09:14:43.016982+0000","last_active":"2024-09-19T09:14:45.579299+0000","last_peered":"2024-09-19T09:14:45.579299+0000","last_clean":"2024-09-19T09:14:45.579299+0000","last_became_active":"2024-09-19T09:14:43.016668+0000","last_became_peered":"2024-09-19T09:14:43.016668+0000","last_unstale":"2024-09-19T09:14:45.579299+0000","last_undegraded":"2024-09-19T09:14:45.579299+0000","last_fullsized":"2024-09-19T09:14:45.579299+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:36.837917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.380936+0000","last_change":"2024-09-19T09:14:44.018411+0000","last_active":"2024-09-19T09:14:45.380936+0000","last_peered":"2024-09-19T09:14:45.380936+0000","last_clean":"2024-09-19T09:14:45.380936+0000","last_became_active":"2024-09-19T09:14:44.018176+0000","last_became_peered":"2024-09-19T09:14:44.018176+0000","last_unstale":"2024-09-19T09:14:45.380936+0000","last_undegraded":"2024-09-19T09:14:45.380936+0000","last_fullsized":"2024-09-19T09:14:45.380936+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:19.873465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.856095+0000","last_change":"2024-09-19T09:14:43.019534+0000","last_active":"2024-09-19T09:14:45.856095+0000","last_peered":"2024-09-19T09:14:45.856095+0000","last_clean":"2024-09-19T09:14:45.856095+0000","last_became_active":"2024-09-19T09:14:43.019162+0000","last_became_peered":"2024-09-19T09:14:43.019162+0000","last_unstale":"2024-09-19T09:14:45.856095+0000","last_undegraded":"2024-09-19T09:14:45.856095+0000","last_fullsized":"2024-09-19T09:14:45.856095+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:00.685460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.026064+0000","last_change":"2024-09-19T09:14:44.022559+0000","last_active":"2024-09-19T09:14:45.026064+0000","last_peered":"2024-09-19T09:14:45.026064+0000","last_clean":"2024-09-19T09:14:45.026064+0000","last_became_active":"2024-09-19T09:14:44.021953+0000","last_became_peered":"2024-09-19T09:14:44.021953+0000","last_unstale":"2024-09-19T09:14:45.026064+0000","last_undegraded":"2024-09-19T09:14:45.026064+0000","last_fullsized":"2024-09-19T09:14:45.026064+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:35.372428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027314+0000","last_change":"2024-09-19T09:14:43.019601+0000","last_active":"2024-09-19T09:14:45.027314+0000","last_peered":"2024-09-19T09:14:45.027314+0000","last_clean":"2024-09-19T09:14:45.027314+0000","last_became_active":"2024-09-19T09:14:43.019364+0000","last_became_peered":"2024-09-19T09:14:43.019364+0000","last_unstale":"2024-09-19T09:14:45.027314+0000","last_undegraded":"2024-09-19T09:14:45.027314+0000","last_fullsized":"2024-09-19T09:14:45.027314+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:07:12.857718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023389+0000","last_change":"2024-09-19T09:14:44.027346+0000","last_active":"2024-09-19T09:14:45.023389+0000","last_peered":"2024-09-19T09:14:45.023389+0000","last_clean":"2024-09-19T09:14:45.023389+0000","last_became_active":"2024-09-19T09:14:44.027123+0000","last_became_peered":"2024-09-19T09:14:44.027123+0000","last_unstale":"2024-09-19T09:14:45.023389+0000","last_undegraded":"2024-09-19T09:14:45.023389+0000","last_fullsized":"2024-09-19T09:14:45.023389+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:58.059137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579677+0000","last_change":"2024-09-19T09:14:43.014442+0000","last_active":"2024-09-19T09:14:45.579677+0000","last_peered":"2024-09-19T09:14:45.579677+0000","last_clean":"2024-09-19T09:14:45.579677+0000","last_became_active":"2024-09-19T09:14:43.013919+0000","last_became_peered":"2024-09-19T09:14:43.013919+0000","last_unstale":"2024-09-19T09:14:45.579677+0000","last_undegraded":"2024-09-19T09:14:45.579677+0000","last_fullsized":"2024-09-19T09:14:45.579677+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:36.932370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.024327+0000","last_change":"2024-09-19T09:14:44.021301+0000","last_active":"2024-09-19T09:14:45.024327+0000","last_peered":"2024-09-19T09:14:45.024327+0000","last_clean":"2024-09-19T09:14:45.024327+0000","last_became_active":"2024-09-19T09:14:44.020180+0000","last_became_peered":"2024-09-19T09:14:44.020180+0000","last_unstale":"2024-09-19T09:14:45.024327+0000","last_undegraded":"2024-09-19T09:14:45.024327+0000","last_fullsized":"2024-09-19T09:14:45.024327+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:47.149041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.579088+0000","last_change":"2024-09-19T09:14:43.017264+0000","last_active":"2024-09-19T09:14:45.579088+0000","last_peered":"2024-09-19T09:14:45.579088+0000","last_clean":"2024-09-19T09:14:45.579088+0000","last_became_active":"2024-09-19T09:14:43.017011+0000","last_became_peered":"2024-09-19T09:14:43.017011+0000","last_unstale":"2024-09-19T09:14:45.579088+0000","last_undegraded":"2024-09-19T09:14:45.579088+0000","last_fullsized":"2024-09-19T09:14:45.579088+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:39:25.578459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.025620+0000","last_change":"2024-09-19T09:14:44.019925+0000","last_active":"2024-09-19T09:14:45.025620+0000","last_peered":"2024-09-19T09:14:45.025620+0000","last_clean":"2024-09-19T09:14:45.025620+0000","last_became_active":"2024-09-19T09:14:44.018603+0000","last_became_peered":"2024-09-19T09:14:44.018603+0000","last_unstale":"2024-09-19T09:14:45.025620+0000","last_undegraded":"2024-09-19T09:14:45.025620+0000","last_fullsized":"2024-09-19T09:14:45.025620+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:43.000294+0000","last_clean_scrub_stamp":"2024-09-19T09:14:43.000294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:26.582541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"47'2","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.027263+0000","last_change":"2024-09-19T09:14:43.018492+0000","last_active":"2024-09-19T09:14:45.027263+0000","last_peered":"2024-09-19T09:14:45.027263+0000","last_clean":"2024-09-19T09:14:45.027263+0000","last_became_active":"2024-09-19T09:14:43.018239+0000","last_became_peered":"2024-09-19T09:14:43.018239+0000","last_unstale":"2024-09-19T09:14:45.027263+0000","last_undegraded":"2024-09-19T09:14:45.027263+0000","last_fullsized":"2024-09-19T09:14:45.027263+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:14:41.998448+0000","last_clean_scrub_stamp":"2024-09-19T09:14:41.998448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:48:47.554369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":220,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-19T09:14:45.023438+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:14:45.023438+0000","last_peered":"2024-09-19T09:14:45.023438+0000","last_clean":"2024-09-19T09:14:45.023438+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:14:45.023438+0000","last_undegraded":"2024-09-19T09:14:45.023438+0000","last_fullsized":"2024-09-19T09:14:45.023438+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:22.478151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574869,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195086,"statfs":{"total":200000000,"available":199768258,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195085,"statfs":{"total":200000000,"available":199767676,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":33,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199177902,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":227,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195084,"statfs":{"total":200000000,"available":199766588,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":227,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195084,"statfs":{"total":200000000,"available":199766680,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195086,"statfs":{"total":200000000,"available":199768202,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":802,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194509,"statfs":{"total":200000000,"available":199177854,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195085,"statfs":{"total":200000000,"available":199767620,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:14:51.737 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T09:14:51.737 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-19T09:14:51.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.883+0000 7f929a2af640 1 Processor -- start 2024-09-19T09:14:51.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.884+0000 7f929a2af640 1 -- start start 2024-09-19T09:14:51.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.884+0000 7f929a2af640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f92941623c0 0x7f92940b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:51.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.884+0000 7f929a2af640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92940d56b0 0x7f92940d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:51.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.884+0000 7f929a2af640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92940d3700 con 0x7f92940d0a50 2024-09-19T09:14:51.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.884+0000 7f929a2af640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f92940d21a0 con 0x7f92941623c0 2024-09-19T09:14:51.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.884+0000 7f929a2af640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f92940d0080 con 0x7f92940d56b0 2024-09-19T09:14:51.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.885+0000 7f92937fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92940d56b0 0x7f92940d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:51.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.885+0000 7f92937fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92940d56b0 0x7f92940d0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:38416/0 (socket says 172.21.15.18:38416) 2024-09-19T09:14:51.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.885+0000 7f92937fe640 1 -- 172.21.15.18:0/707878825 learned_addr learned my addr 172.21.15.18:0/707878825 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:51.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.885+0000 7f9293fff640 1 --2- 172.21.15.18:0/707878825 >> v2:172.21.15.162:3300/0 conn(0x7f92941623c0 0x7f92940b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:51.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.885+0000 7f9292ffd640 1 -- 172.21.15.18:0/707878825 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1453841281 0 0) 0x7f92940d3700 con 0x7f92940d0a50 2024-09-19T09:14:51.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.885+0000 7f9292ffd640 1 -- 172.21.15.18:0/707878825 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f927c003520 con 0x7f92940d0a50 2024-09-19T09:14:51.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.885+0000 7f92937fe640 1 -- 172.21.15.18:0/707878825 >> v2:172.21.15.162:3300/0 conn(0x7f92941623c0 msgr2=0x7f92940b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:51.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.885+0000 7f92937fe640 1 --2- 172.21.15.18:0/707878825 >> v2:172.21.15.162:3300/0 conn(0x7f92941623c0 0x7f92940b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:51.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.885+0000 7f92937fe640 1 -- 172.21.15.18:0/707878825 >> v1:172.21.15.162:6789/0 conn(0x7f92940d0a50 legacy=0x7f92940d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:51.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.885+0000 7f92937fe640 1 -- 172.21.15.18:0/707878825 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92940cfa70 con 0x7f92940d56b0 2024-09-19T09:14:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.886+0000 7f92937fe640 1 --2- 172.21.15.18:0/707878825 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92940d56b0 0x7f92940d0510 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9288009870 tx=0x7f928802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab4ef258ead855a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.886+0000 7f9292ffd640 1 -- 172.21.15.18:0/707878825 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9288037070 con 0x7f92940d56b0 2024-09-19T09:14:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.886+0000 7f9292ffd640 1 -- 172.21.15.18:0/707878825 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9288032440 con 0x7f92940d56b0 2024-09-19T09:14:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.886+0000 7f9292ffd640 1 -- 172.21.15.18:0/707878825 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9288032810 con 0x7f92940d56b0 2024-09-19T09:14:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.887+0000 7f929a2af640 1 -- 172.21.15.18:0/707878825 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92940d56b0 msgr2=0x7f92940d0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.887+0000 7f929a2af640 1 --2- 172.21.15.18:0/707878825 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92940d56b0 0x7f92940d0510 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9288009870 tx=0x7f928802a270 comp rx=0 tx=0).stop 2024-09-19T09:14:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.887+0000 7f929a2af640 1 -- 172.21.15.18:0/707878825 shutdown_connections 2024-09-19T09:14:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.887+0000 7f929a2af640 1 --2- 172.21.15.18:0/707878825 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92940d56b0 0x7f92940d0510 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:51.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.887+0000 7f929a2af640 1 --2- 172.21.15.18:0/707878825 >> v2:172.21.15.162:3300/0 conn(0x7f92941623c0 0x7f92940b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:51.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.887+0000 7f929a2af640 1 -- 172.21.15.18:0/707878825 >> 172.21.15.18:0/707878825 conn(0x7f929409df30 msgr2=0x7f92940d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:51.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.887+0000 7f929a2af640 1 -- 172.21.15.18:0/707878825 shutdown_connections 2024-09-19T09:14:51.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.887+0000 7f929a2af640 1 -- 172.21.15.18:0/707878825 wait complete. 2024-09-19T09:14:51.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.888+0000 7f929a2af640 1 Processor -- start 2024-09-19T09:14:51.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.888+0000 7f929a2af640 1 -- start start 2024-09-19T09:14:51.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.889+0000 7f929a2af640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92940d56b0 0x7f929415c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:51.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.889+0000 7f929a2af640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92941623c0 0x7f92940b8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:51.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.889+0000 7f929a2af640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92940b8870 0x7f929414af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:51.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.889+0000 7f929a2af640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f92941627a0 con 0x7f92940b8870 2024-09-19T09:14:51.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.889+0000 7f929a2af640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f92940cfd10 con 0x7f92941623c0 2024-09-19T09:14:51.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.889+0000 7f929a2af640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f92940d3c80 con 0x7f92940d56b0 2024-09-19T09:14:51.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.889+0000 7f929884c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92940b8870 0x7f929414af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:51.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.889+0000 7f929884c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92940b8870 0x7f929414af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53670/0 (socket says 172.21.15.18:53670) 2024-09-19T09:14:51.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.889+0000 7f929884c640 1 -- 172.21.15.18:0/197242729 learned_addr learned my addr 172.21.15.18:0/197242729 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.889+0000 7f9293fff640 1 --2- 172.21.15.18:0/197242729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92940d56b0 0x7f929415c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.889+0000 7f92937fe640 1 --2- 172.21.15.18:0/197242729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92941623c0 0x7f92940b8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.889+0000 7f929884c640 1 -- 172.21.15.18:0/197242729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92940d56b0 msgr2=0x7f929415c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.889+0000 7f929884c640 1 --2- 172.21.15.18:0/197242729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92940d56b0 0x7f929415c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.889+0000 7f929884c640 1 -- 172.21.15.18:0/197242729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92941623c0 msgr2=0x7f92940b8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.889+0000 7f929884c640 1 --2- 172.21.15.18:0/197242729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92941623c0 0x7f92940b8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.889+0000 7f929884c640 1 -- 172.21.15.18:0/197242729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92940b8df0 con 0x7f92940b8870 2024-09-19T09:14:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.890+0000 7f929884c640 1 --2- 172.21.15.18:0/197242729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92940b8870 0x7f929414af60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f928c00c700 tx=0x7f928c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.890+0000 7f9290ff9640 1 -- 172.21.15.18:0/197242729 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928c003b70 con 0x7f92940b8870 2024-09-19T09:14:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.890+0000 7f9290ff9640 1 -- 172.21.15.18:0/197242729 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f928c003d30 con 0x7f92940b8870 2024-09-19T09:14:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.890+0000 7f9290ff9640 1 -- 172.21.15.18:0/197242729 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928c00aa90 con 0x7f92940b8870 2024-09-19T09:14:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.890+0000 7f929a2af640 1 -- 172.21.15.18:0/197242729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92940b90d0 con 0x7f92940b8870 2024-09-19T09:14:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.890+0000 7f929a2af640 1 -- 172.21.15.18:0/197242729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92940b9690 con 0x7f92940b8870 2024-09-19T09:14:51.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.891+0000 7f929a2af640 1 -- 172.21.15.18:0/197242729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92940d0510 con 0x7f92940b8870 2024-09-19T09:14:51.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.891+0000 7f9290ff9640 1 -- 172.21.15.18:0/197242729 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f928c00ac30 con 0x7f92940b8870 2024-09-19T09:14:51.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.892+0000 7f9290ff9640 1 --2- 172.21.15.18:0/197242729 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f928006c2b0 0x7f928006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:51.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.892+0000 7f9290ff9640 1 -- 172.21.15.18:0/197242729 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f928c08b2b0 con 0x7f92940b8870 2024-09-19T09:14:51.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.892+0000 7f9293fff640 1 --2- 172.21.15.18:0/197242729 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f928006c2b0 0x7f928006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:51.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.892+0000 7f9293fff640 1 --2- 172.21.15.18:0/197242729 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f928006c2b0 0x7f928006e770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9284009aa0 tx=0x7f9284009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:51.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:51.896+0000 7f9290ff9640 1 -- 172.21.15.18:0/197242729 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f928c059340 con 0x7f92940b8870 2024-09-19T09:14:52.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.146+0000 7f929a2af640 1 -- 172.21.15.18:0/197242729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f92940b6f00 con 0x7f92940b8870 2024-09-19T09:14:52.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.148+0000 7f9290ff9640 1 -- 172.21.15.18:0/197242729 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) ==== 190+0+147 (secure 0 0 0) 0x7f928c05d640 con 0x7f92940b8870 2024-09-19T09:14:52.149 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-09-19T09:14:52.149 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAe6+tmcbwDNhAAaG0+wu96Locwws+h0zeh8Q== 2024-09-19T09:14:52.149 INFO:teuthology.orchestra.run.smithi018.stdout: caps mds = "allow" 2024-09-19T09:14:52.149 INFO:teuthology.orchestra.run.smithi018.stdout: caps mon = "allow r" 2024-09-19T09:14:52.149 INFO:teuthology.orchestra.run.smithi018.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-19T09:14:52.149 INFO:teuthology.orchestra.run.smithi018.stderr:updated caps for client.0 2024-09-19T09:14:52.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.150+0000 7f929a2af640 1 -- 172.21.15.18:0/197242729 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f928006c2b0 msgr2=0x7f928006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:52.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.150+0000 7f929a2af640 1 --2- 172.21.15.18:0/197242729 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f928006c2b0 0x7f928006e770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9284009aa0 tx=0x7f9284009190 comp rx=0 tx=0).stop 2024-09-19T09:14:52.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.150+0000 7f929a2af640 1 -- 172.21.15.18:0/197242729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92940b8870 msgr2=0x7f929414af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:52.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.150+0000 7f929a2af640 1 --2- 172.21.15.18:0/197242729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92940b8870 0x7f929414af60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f928c00c700 tx=0x7f928c00cbc0 comp rx=0 tx=0).stop 2024-09-19T09:14:52.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.150+0000 7f929a2af640 1 -- 172.21.15.18:0/197242729 shutdown_connections 2024-09-19T09:14:52.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.150+0000 7f929a2af640 1 --2- 172.21.15.18:0/197242729 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f928006c2b0 0x7f928006e770 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:52.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.150+0000 7f929a2af640 1 --2- 172.21.15.18:0/197242729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92940b8870 0x7f929414af60 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:52.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.150+0000 7f929a2af640 1 --2- 172.21.15.18:0/197242729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92941623c0 0x7f92940b8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:52.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.150+0000 7f929a2af640 1 --2- 172.21.15.18:0/197242729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92940d56b0 0x7f929415c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:52.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.150+0000 7f929a2af640 1 -- 172.21.15.18:0/197242729 >> 172.21.15.18:0/197242729 conn(0x7f929409df30 msgr2=0x7f92940b57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:52.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.150+0000 7f929a2af640 1 -- 172.21.15.18:0/197242729 shutdown_connections 2024-09-19T09:14:52.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.150+0000 7f929a2af640 1 -- 172.21.15.18:0/197242729 wait complete. 2024-09-19T09:14:52.162 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:14:52.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.264+0000 7fc8ab85e640 1 Processor -- start 2024-09-19T09:14:52.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.264+0000 7fc8ab85e640 1 -- start start 2024-09-19T09:14:52.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.265+0000 7fc8ab85e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8a40708f0 0x7fc8a40cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:52.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.265+0000 7fc8ab85e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc8a40d1ed0 0x7fc8a40cd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:52.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.265+0000 7fc8ab85e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8a40d0050 con 0x7fc8a4160300 2024-09-19T09:14:52.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.265+0000 7fc8ab85e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fc8a40d0330 con 0x7fc8a40d1ed0 2024-09-19T09:14:52.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.265+0000 7fc8ab85e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc8a40d1420 con 0x7fc8a40708f0 2024-09-19T09:14:52.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.265+0000 7fc8a9dfb640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc8a40d1ed0 0x7fc8a40cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:52.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.265+0000 7fc8a95fa640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc8a4160300 0x7fc8a40cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59880/0 (socket says 172.21.15.18:59880) 2024-09-19T09:14:52.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.265+0000 7fc8a95fa640 1 -- 172.21.15.18:0/4160903403 learned_addr learned my addr 172.21.15.18:0/4160903403 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:52.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.265+0000 7fc8a8df9640 1 --2- 172.21.15.18:0/4160903403 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8a40708f0 0x7fc8a40cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:52.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.265+0000 7fc8a9dfb640 1 -- 172.21.15.18:0/4160903403 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8a40708f0 msgr2=0x7fc8a40cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:52.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.265+0000 7fc8a9dfb640 1 --2- 172.21.15.18:0/4160903403 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8a40708f0 0x7fc8a40cf9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:52.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.265+0000 7fc8a9dfb640 1 -- 172.21.15.18:0/4160903403 >> v1:172.21.15.18:6789/0 conn(0x7fc8a4160300 legacy=0x7fc8a40cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:52.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.265+0000 7fc8a9dfb640 1 -- 172.21.15.18:0/4160903403 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a40d1700 con 0x7fc8a40d1ed0 2024-09-19T09:14:52.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.265+0000 7fc8a8df9640 1 --2- 172.21.15.18:0/4160903403 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8a40708f0 0x7fc8a40cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:14:52.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.266+0000 7fc8a9dfb640 1 --2- 172.21.15.18:0/4160903403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8a40d1ed0 0x7fc8a40cd730 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc89c009d90 tx=0x7fc89c02a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c269469991924cc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:52.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.266+0000 7fc89bfff640 1 -- 172.21.15.18:0/4160903403 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89c031600 con 0x7fc8a40d1ed0 2024-09-19T09:14:52.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.266+0000 7fc89bfff640 1 -- 172.21.15.18:0/4160903403 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc89c0317a0 con 0x7fc8a40d1ed0 2024-09-19T09:14:52.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.266+0000 7fc89bfff640 1 -- 172.21.15.18:0/4160903403 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89c031b70 con 0x7fc8a40d1ed0 2024-09-19T09:14:52.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.267+0000 7fc8ab85e640 1 -- 172.21.15.18:0/4160903403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8a40d1ed0 msgr2=0x7fc8a40cd730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:52.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.267+0000 7fc8ab85e640 1 --2- 172.21.15.18:0/4160903403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8a40d1ed0 0x7fc8a40cd730 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fc89c009d90 tx=0x7fc89c02a5d0 comp rx=0 tx=0).stop 2024-09-19T09:14:52.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.267+0000 7fc8ab85e640 1 -- 172.21.15.18:0/4160903403 shutdown_connections 2024-09-19T09:14:52.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.267+0000 7fc8ab85e640 1 --2- 172.21.15.18:0/4160903403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8a40d1ed0 0x7fc8a40cd730 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:52.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.267+0000 7fc8ab85e640 1 --2- 172.21.15.18:0/4160903403 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8a40708f0 0x7fc8a40cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:52.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.267+0000 7fc8ab85e640 1 -- 172.21.15.18:0/4160903403 >> 172.21.15.18:0/4160903403 conn(0x7fc8a40b4600 msgr2=0x7fc8a40b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:52.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.267+0000 7fc8ab85e640 1 -- 172.21.15.18:0/4160903403 shutdown_connections 2024-09-19T09:14:52.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.267+0000 7fc8ab85e640 1 -- 172.21.15.18:0/4160903403 wait complete. 2024-09-19T09:14:52.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.268+0000 7fc8ab85e640 1 Processor -- start 2024-09-19T09:14:52.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.268+0000 7fc8ab85e640 1 -- start start 2024-09-19T09:14:52.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.269+0000 7fc8ab85e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8a40708f0 0x7fc8a40b7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:52.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.269+0000 7fc8ab85e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8a40d1ed0 0x7fc8a40b78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:52.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.269+0000 7fc8ab85e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8a4160300 0x7fc8a406d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:52.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.269+0000 7fc8ab85e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a41606e0 con 0x7fc8a4160300 2024-09-19T09:14:52.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.269+0000 7fc8ab85e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc8a40b54a0 con 0x7fc8a40708f0 2024-09-19T09:14:52.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.269+0000 7fc8ab85e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc8a4160860 con 0x7fc8a40d1ed0 2024-09-19T09:14:52.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.269+0000 7fc8a9dfb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8a4160300 0x7fc8a406d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:52.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.269+0000 7fc8a9dfb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8a4160300 0x7fc8a406d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53684/0 (socket says 172.21.15.18:53684) 2024-09-19T09:14:52.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.269+0000 7fc8a9dfb640 1 -- 172.21.15.18:0/2913147533 learned_addr learned my addr 172.21.15.18:0/2913147533 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:52.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.269+0000 7fc8a9dfb640 1 -- 172.21.15.18:0/2913147533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8a40d1ed0 msgr2=0x7fc8a40b78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:52.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.269+0000 7fc8a8df9640 1 --2- 172.21.15.18:0/2913147533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8a40d1ed0 0x7fc8a40b78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:52.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.269+0000 7fc8a9dfb640 1 --2- 172.21.15.18:0/2913147533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8a40d1ed0 0x7fc8a40b78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:52.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.269+0000 7fc8a9dfb640 1 -- 172.21.15.18:0/2913147533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8a40708f0 msgr2=0x7fc8a40b7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:52.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.269+0000 7fc8a9dfb640 1 --2- 172.21.15.18:0/2913147533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8a40708f0 0x7fc8a40b7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:52.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.269+0000 7fc8a9dfb640 1 -- 172.21.15.18:0/2913147533 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a40c6650 con 0x7fc8a4160300 2024-09-19T09:14:52.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.269+0000 7fc8a9dfb640 1 --2- 172.21.15.18:0/2913147533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8a4160300 0x7fc8a406d860 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc89c009eb0 tx=0x7fc89c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:52.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.270+0000 7fc899ffb640 1 -- 172.21.15.18:0/2913147533 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89c040070 con 0x7fc8a4160300 2024-09-19T09:14:52.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.270+0000 7fc899ffb640 1 -- 172.21.15.18:0/2913147533 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc89c030b60 con 0x7fc8a4160300 2024-09-19T09:14:52.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.270+0000 7fc8ab85e640 1 -- 172.21.15.18:0/2913147533 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8a415cbd0 con 0x7fc8a4160300 2024-09-19T09:14:52.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.270+0000 7fc899ffb640 1 -- 172.21.15.18:0/2913147533 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc89c045460 con 0x7fc8a4160300 2024-09-19T09:14:52.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.270+0000 7fc8ab85e640 1 -- 172.21.15.18:0/2913147533 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8a40c9be0 con 0x7fc8a4160300 2024-09-19T09:14:52.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.271+0000 7fc8ab85e640 1 -- 172.21.15.18:0/2913147533 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8a40b4080 con 0x7fc8a4160300 2024-09-19T09:14:52.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.271+0000 7fc899ffb640 1 -- 172.21.15.18:0/2913147533 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc89c039040 con 0x7fc8a4160300 2024-09-19T09:14:52.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.272+0000 7fc899ffb640 1 --2- 172.21.15.18:0/2913147533 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc88806c2e0 0x7fc88806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:52.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.272+0000 7fc899ffb640 1 -- 172.21.15.18:0/2913147533 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7fc89c0acc80 con 0x7fc8a4160300 2024-09-19T09:14:52.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.272+0000 7fc8a95fa640 1 --2- 172.21.15.18:0/2913147533 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc88806c2e0 0x7fc88806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:52.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.273+0000 7fc8a95fa640 1 --2- 172.21.15.18:0/2913147533 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc88806c2e0 0x7fc88806e7a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0000f60 tx=0x7fc8a0007a80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:52.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.276+0000 7fc899ffb640 1 -- 172.21.15.18:0/2913147533 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc8a40b4080 con 0x7fc8a4160300 2024-09-19T09:14:52.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.486+0000 7fc8ab85e640 1 -- 172.21.15.18:0/2913147533 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8a4068740 con 0x7fc8a4160300 2024-09-19T09:14:52.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.487+0000 7fc899ffb640 1 -- 172.21.15.18:0/2913147533 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5223 (secure 0 0 0) 0x7fc8a40c6650 con 0x7fc8a4160300 2024-09-19T09:14:52.488 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:52.488 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"btime":"2024-09-19T09:14:46:022043+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4793,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/113686001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":113686001},{"type":"v1","addr":"172.21.15.162:6835","nonce":113686001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":4799,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3269042030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3269042030},{"type":"v1","addr":"172.21.15.162:6837","nonce":3269042030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/3996030837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3996030837},{"type":"v1","addr":"172.21.15.18:6834","nonce":3996030837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:14:43.367290+0000","modified":"2024-09-19T09:14:45.363192+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5187":{"gid":5187,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/295967875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":295967875},{"type":"v1","addr":"172.21.15.18:6835","nonce":295967875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5187,"qdb_cluster":[5187]},"id":3}]} 2024-09-19T09:14:52.488 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 21 2024-09-19T09:14:52.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.489+0000 7fc8ab85e640 1 -- 172.21.15.18:0/2913147533 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc88806c2e0 msgr2=0x7fc88806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:52.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.489+0000 7fc8ab85e640 1 --2- 172.21.15.18:0/2913147533 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc88806c2e0 0x7fc88806e7a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0000f60 tx=0x7fc8a0007a80 comp rx=0 tx=0).stop 2024-09-19T09:14:52.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.489+0000 7fc8ab85e640 1 -- 172.21.15.18:0/2913147533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8a4160300 msgr2=0x7fc8a406d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:52.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.489+0000 7fc8ab85e640 1 --2- 172.21.15.18:0/2913147533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8a4160300 0x7fc8a406d860 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc89c009eb0 tx=0x7fc89c004a40 comp rx=0 tx=0).stop 2024-09-19T09:14:52.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.489+0000 7fc8ab85e640 1 -- 172.21.15.18:0/2913147533 shutdown_connections 2024-09-19T09:14:52.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.489+0000 7fc8ab85e640 1 --2- 172.21.15.18:0/2913147533 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc88806c2e0 0x7fc88806e7a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:52.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.489+0000 7fc8ab85e640 1 --2- 172.21.15.18:0/2913147533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8a4160300 0x7fc8a406d860 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:52.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.489+0000 7fc8ab85e640 1 --2- 172.21.15.18:0/2913147533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8a40d1ed0 0x7fc8a40b78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:52.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.489+0000 7fc8ab85e640 1 --2- 172.21.15.18:0/2913147533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8a40708f0 0x7fc8a40b7360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:52.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.489+0000 7fc8ab85e640 1 -- 172.21.15.18:0/2913147533 >> 172.21.15.18:0/2913147533 conn(0x7fc8a40b4600 msgr2=0x7fc8a40cf4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:52.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.489+0000 7fc8ab85e640 1 -- 172.21.15.18:0/2913147533 shutdown_connections 2024-09-19T09:14:52.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:52.489+0000 7fc8ab85e640 1 -- 172.21.15.18:0/2913147533 wait complete. 2024-09-19T09:14:52.904 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T09:14:43.367290+0000', 'modified': '2024-09-19T09:14:45.363192+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5187}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5187': {'gid': 5187, 'name': 'c', 'rank': 0, 'incarnation': 19, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.18:6835/295967875', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6833', 'nonce': 295967875}, {'type': 'v1', 'addr': '172.21.15.18:6835', 'nonce': 295967875}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5187, 'qdb_cluster': [5187]} 2024-09-19T09:14:52.904 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T09:14:52.904 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-19T09:14:53.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.010+0000 7f30ffb91640 1 Processor -- start 2024-09-19T09:14:53.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.010+0000 7f30ffb91640 1 -- start start 2024-09-19T09:14:53.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.011+0000 7f30ffb91640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f30f8162460 0x7f30f80d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:53.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.011+0000 7f30ffb91640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30f80d56f0 0x7f30f80d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:53.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.011+0000 7f30ffb91640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30f80b50a0 con 0x7f30f80d2b80 2024-09-19T09:14:53.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.011+0000 7f30ffb91640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f30f80b5940 con 0x7f30f8162460 2024-09-19T09:14:53.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.011+0000 7f30ffb91640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f30f80b5380 con 0x7f30f80d56f0 2024-09-19T09:14:53.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.012+0000 7f30fd92d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f30f8162460 0x7f30f80d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:53.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.012+0000 7f30fd12c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30f80d56f0 0x7f30f80d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:53.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.012+0000 7f30fe12e640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f30f80d2b80 0x7f30f80d3010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:50678/0 (socket says 172.21.15.18:50678) 2024-09-19T09:14:53.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.012+0000 7f30fe12e640 1 -- 172.21.15.18:0/1913060110 learned_addr learned my addr 172.21.15.18:0/1913060110 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:53.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.012+0000 7f30fc92b640 1 -- 172.21.15.18:0/1913060110 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1539767741 0 0) 0x7f30f80b50a0 con 0x7f30f80d2b80 2024-09-19T09:14:53.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.012+0000 7f30fc92b640 1 -- 172.21.15.18:0/1913060110 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30e0003520 con 0x7f30f80d2b80 2024-09-19T09:14:53.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.012+0000 7f30fd12c640 1 -- 172.21.15.18:0/1913060110 >> v2:172.21.15.162:3300/0 conn(0x7f30f8162460 msgr2=0x7f30f80d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:53.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.012+0000 7f30fd12c640 1 --2- 172.21.15.18:0/1913060110 >> v2:172.21.15.162:3300/0 conn(0x7f30f8162460 0x7f30f80d1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.012+0000 7f30fd12c640 1 -- 172.21.15.18:0/1913060110 >> v1:172.21.15.162:6789/0 conn(0x7f30f80d2b80 legacy=0x7f30f80d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:53.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.012+0000 7f30fd12c640 1 -- 172.21.15.18:0/1913060110 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f80b5660 con 0x7f30f80d56f0 2024-09-19T09:14:53.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.012+0000 7f30fd92d640 1 --2- 172.21.15.18:0/1913060110 >> v2:172.21.15.162:3300/0 conn(0x7f30f8162460 0x7f30f80d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:14:53.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.013+0000 7f30fd12c640 1 --2- 172.21.15.18:0/1913060110 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30f80d56f0 0x7f30f80d1ac0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f30ec0097d0 tx=0x7f30ec02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7f0336df5c3e7d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:53.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.013+0000 7f30fc92b640 1 -- 172.21.15.18:0/1913060110 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec037070 con 0x7f30f80d56f0 2024-09-19T09:14:53.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.013+0000 7f30fc92b640 1 -- 172.21.15.18:0/1913060110 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30ec032440 con 0x7f30f80d56f0 2024-09-19T09:14:53.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.013+0000 7f30fc92b640 1 -- 172.21.15.18:0/1913060110 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec0327f0 con 0x7f30f80d56f0 2024-09-19T09:14:53.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.013+0000 7f30ffb91640 1 -- 172.21.15.18:0/1913060110 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30f80d56f0 msgr2=0x7f30f80d1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:53.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.013+0000 7f30ffb91640 1 --2- 172.21.15.18:0/1913060110 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30f80d56f0 0x7f30f80d1ac0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f30ec0097d0 tx=0x7f30ec02a1c0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.014+0000 7f30ffb91640 1 -- 172.21.15.18:0/1913060110 shutdown_connections 2024-09-19T09:14:53.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.014+0000 7f30ffb91640 1 --2- 172.21.15.18:0/1913060110 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30f80d56f0 0x7f30f80d1ac0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.014+0000 7f30ffb91640 1 --2- 172.21.15.18:0/1913060110 >> v2:172.21.15.162:3300/0 conn(0x7f30f8162460 0x7f30f80d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.014+0000 7f30ffb91640 1 -- 172.21.15.18:0/1913060110 >> 172.21.15.18:0/1913060110 conn(0x7f30f80d4bd0 msgr2=0x7f30f80d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:53.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.014+0000 7f30ffb91640 1 -- 172.21.15.18:0/1913060110 shutdown_connections 2024-09-19T09:14:53.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.014+0000 7f30ffb91640 1 -- 172.21.15.18:0/1913060110 wait complete. 2024-09-19T09:14:53.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.015+0000 7f30ffb91640 1 Processor -- start 2024-09-19T09:14:53.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.015+0000 7f30ffb91640 1 -- start start 2024-09-19T09:14:53.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.016+0000 7f30ffb91640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30f80d2b80 0x7f30f81f3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:53.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.016+0000 7f30ffb91640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30f80d56f0 0x7f30f80cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:53.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.016+0000 7f30ffb91640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30f8162460 0x7f30f80b9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:53.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.016+0000 7f30ffb91640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f30f80b5e40 con 0x7f30f80d56f0 2024-09-19T09:14:53.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.016+0000 7f30ffb91640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f30f80b5cc0 con 0x7f30f80d2b80 2024-09-19T09:14:53.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.016+0000 7f30ffb91640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f30f8162840 con 0x7f30f8162460 2024-09-19T09:14:53.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.016+0000 7f30fd12c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30f80d56f0 0x7f30f80cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:53.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.016+0000 7f30fd12c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30f80d56f0 0x7f30f80cadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53694/0 (socket says 172.21.15.18:53694) 2024-09-19T09:14:53.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.016+0000 7f30fd12c640 1 -- 172.21.15.18:0/609466745 learned_addr learned my addr 172.21.15.18:0/609466745 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:53.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.016+0000 7f30fd92d640 1 --2- 172.21.15.18:0/609466745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30f80d2b80 0x7f30f81f3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:53.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.016+0000 7f30fe12e640 1 --2- 172.21.15.18:0/609466745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30f8162460 0x7f30f80b9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:53.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.016+0000 7f30fd12c640 1 -- 172.21.15.18:0/609466745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30f8162460 msgr2=0x7f30f80b9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:53.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.016+0000 7f30fd12c640 1 --2- 172.21.15.18:0/609466745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30f8162460 0x7f30f80b9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.016+0000 7f30fd12c640 1 -- 172.21.15.18:0/609466745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30f80d2b80 msgr2=0x7f30f81f3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:53.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.016+0000 7f30fd12c640 1 --2- 172.21.15.18:0/609466745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30f80d2b80 0x7f30f81f3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.016+0000 7f30fd12c640 1 -- 172.21.15.18:0/609466745 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f80b8780 con 0x7f30f80d56f0 2024-09-19T09:14:53.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.016+0000 7f30fd12c640 1 --2- 172.21.15.18:0/609466745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30f80d56f0 0x7f30f80cadf0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f30ec02a200 tx=0x7f30ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:53.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.017+0000 7f30f67fc640 1 -- 172.21.15.18:0/609466745 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec037040 con 0x7f30f80d56f0 2024-09-19T09:14:53.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.017+0000 7f30f67fc640 1 -- 172.21.15.18:0/609466745 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30ec042070 con 0x7f30f80d56f0 2024-09-19T09:14:53.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.017+0000 7f30ffb91640 1 -- 172.21.15.18:0/609466745 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30f80b8a60 con 0x7f30f80d56f0 2024-09-19T09:14:53.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.017+0000 7f30f67fc640 1 -- 172.21.15.18:0/609466745 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ec03b930 con 0x7f30f80d56f0 2024-09-19T09:14:53.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.017+0000 7f30ffb91640 1 -- 172.21.15.18:0/609466745 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30f80b9020 con 0x7f30f80d56f0 2024-09-19T09:14:53.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.018+0000 7f30f67fc640 1 -- 172.21.15.18:0/609466745 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f30ec03bad0 con 0x7f30f80d56f0 2024-09-19T09:14:53.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.019+0000 7f30f67fc640 1 --2- 172.21.15.18:0/609466745 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f30e406c2b0 0x7f30e406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:53.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.019+0000 7f30f67fc640 1 -- 172.21.15.18:0/609466745 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f30ec0abb00 con 0x7f30f80d56f0 2024-09-19T09:14:53.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.019+0000 7f30fd92d640 1 --2- 172.21.15.18:0/609466745 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f30e406c2b0 0x7f30e406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:53.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.019+0000 7f30fd92d640 1 --2- 172.21.15.18:0/609466745 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f30e406c2b0 0x7f30e406e770 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f30f0009560 tx=0x7f30f0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:53.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.020+0000 7f3102a0d740 1 Processor -- start 2024-09-19T09:14:53.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.020+0000 7f3102a0d740 1 -- start start 2024-09-19T09:14:53.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.020+0000 7f3102a0d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dcaccd42c0 0x55dcacd19a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:53.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.020+0000 7f3102a0d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcaccd1a80 0x55dcaccd46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:53.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.020+0000 7f3102a0d740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55dcaccd5a50 0x55dcaccce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:53.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.020+0000 7f3102a0d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55dcacc36520 con 0x55dcaccd42c0 2024-09-19T09:14:53.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.020+0000 7f3102a0d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55dcacbde3e0 con 0x55dcaccd1a80 2024-09-19T09:14:53.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.020+0000 7f3102a0d740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55dcacc324e0 con 0x55dcaccd5a50 2024-09-19T09:14:53.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.020+0000 7f30fd92d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dcaccd42c0 0x55dcacd19a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:53.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.020+0000 7f30fd92d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dcaccd42c0 0x55dcacd19a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53700/0 (socket says 172.21.15.18:53700) 2024-09-19T09:14:53.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.020+0000 7f30fd92d640 1 -- 172.21.15.18:0/2356039487 learned_addr learned my addr 172.21.15.18:0/2356039487 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:53.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.021+0000 7f30fd12c640 1 --2- 172.21.15.18:0/2356039487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcaccd1a80 0x55dcaccd46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:53.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.021+0000 7f30fe12e640 1 --2- 172.21.15.18:0/2356039487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55dcaccd5a50 0x55dcaccce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:53.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.021+0000 7f30fd92d640 1 -- 172.21.15.18:0/2356039487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55dcaccd5a50 msgr2=0x55dcaccce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:53.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.021+0000 7f30fd92d640 1 --2- 172.21.15.18:0/2356039487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55dcaccd5a50 0x55dcaccce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.021+0000 7f30fd92d640 1 -- 172.21.15.18:0/2356039487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcaccd1a80 msgr2=0x55dcaccd46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:53.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.021+0000 7f30fd92d640 1 --2- 172.21.15.18:0/2356039487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcaccd1a80 0x55dcaccd46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.021+0000 7f30fd92d640 1 -- 172.21.15.18:0/2356039487 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcacbf92f0 con 0x55dcaccd42c0 2024-09-19T09:14:53.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.021+0000 7f30fe12e640 1 --2- 172.21.15.18:0/2356039487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55dcaccd5a50 0x55dcaccce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:53.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.021+0000 7f30fd92d640 1 --2- 172.21.15.18:0/2356039487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dcaccd42c0 0x55dcacd19a60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f30f0011f20 tx=0x7f30f0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629633ec5bfe7396 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:53.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.021+0000 7f30df7fe640 1 -- 172.21.15.18:0/2356039487 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f001b070 con 0x55dcaccd42c0 2024-09-19T09:14:53.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.021+0000 7f30df7fe640 1 -- 172.21.15.18:0/2356039487 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f0027070 con 0x55dcaccd42c0 2024-09-19T09:14:53.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.021+0000 7f30df7fe640 1 -- 172.21.15.18:0/2356039487 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f0003a20 con 0x55dcaccd42c0 2024-09-19T09:14:53.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.022+0000 7f3102a0d740 1 -- 172.21.15.18:0/2356039487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dcaccd42c0 msgr2=0x55dcacd19a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:53.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.022+0000 7f3102a0d740 1 --2- 172.21.15.18:0/2356039487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dcaccd42c0 0x55dcacd19a60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f30f0011f20 tx=0x7f30f0014000 comp rx=0 tx=0).stop 2024-09-19T09:14:53.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.022+0000 7f3102a0d740 1 -- 172.21.15.18:0/2356039487 shutdown_connections 2024-09-19T09:14:53.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.022+0000 7f3102a0d740 1 --2- 172.21.15.18:0/2356039487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55dcaccd5a50 0x55dcaccce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.022+0000 7f3102a0d740 1 --2- 172.21.15.18:0/2356039487 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcaccd1a80 0x55dcaccd46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.022+0000 7f3102a0d740 1 --2- 172.21.15.18:0/2356039487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dcaccd42c0 0x55dcacd19a60 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.022+0000 7f3102a0d740 1 -- 172.21.15.18:0/2356039487 >> 172.21.15.18:0/2356039487 conn(0x55dcaccd0a80 msgr2=0x55dcacd18f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:53.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.022+0000 7f3102a0d740 1 -- 172.21.15.18:0/2356039487 shutdown_connections 2024-09-19T09:14:53.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.022+0000 7f3102a0d740 1 -- 172.21.15.18:0/2356039487 wait complete. 2024-09-19T09:14:53.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.022+0000 7f3102a0d740 1 -- start start 2024-09-19T09:14:53.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.022+0000 7f3102a0d740 1 Processor -- start 2024-09-19T09:14:53.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.023+0000 7f3102a0d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dcaccd42c0 0x55dcaccf3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:53.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.023+0000 7f3102a0d740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55dcaccd5a50 0x55dcaccf7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:53.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.023+0000 7f3102a0d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcacd29ad0 0x55dcaccf57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:53.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.023+0000 7f3102a0d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55dcacccff20 con 0x55dcaccd42c0 2024-09-19T09:14:53.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.023+0000 7f3102a0d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55dcacbbf450 con 0x55dcacd29ad0 2024-09-19T09:14:53.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.023+0000 7f3102a0d740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55dcacd1a290 con 0x55dcaccd5a50 2024-09-19T09:14:53.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.023+0000 7f3102a0d740 10 client.0 _ll_register_callbacks cb 0x55dcac948ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:14:53.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.023+0000 7f30fd92d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dcaccd42c0 0x55dcaccf3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:53.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.023+0000 7f30fd92d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dcaccd42c0 0x55dcaccf3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53716/0 (socket says 172.21.15.18:53716) 2024-09-19T09:14:53.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.023+0000 7f30fd92d640 1 -- 172.21.15.18:0/2887884409 learned_addr learned my addr 172.21.15.18:0/2887884409 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:53.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.024+0000 7f30fd12c640 1 --2- 172.21.15.18:0/2887884409 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55dcaccd5a50 0x55dcaccf7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:53.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.024+0000 7f30fe12e640 1 --2- 172.21.15.18:0/2887884409 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcacd29ad0 0x55dcaccf57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:53.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.024+0000 7f30fd92d640 1 -- 172.21.15.18:0/2887884409 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55dcaccd5a50 msgr2=0x55dcaccf7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:53.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.024+0000 7f30fd92d640 1 --2- 172.21.15.18:0/2887884409 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55dcaccd5a50 0x55dcaccf7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.024+0000 7f30fd92d640 1 -- 172.21.15.18:0/2887884409 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcacd29ad0 msgr2=0x55dcaccf57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:53.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.024+0000 7f30fd92d640 1 --2- 172.21.15.18:0/2887884409 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcacd29ad0 0x55dcaccf57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.024+0000 7f30fd92d640 1 -- 172.21.15.18:0/2887884409 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcac9492d0 con 0x55dcaccd42c0 2024-09-19T09:14:53.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.024+0000 7f30fd92d640 1 --2- 172.21.15.18:0/2887884409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dcaccd42c0 0x55dcaccf3c10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f30f0003ee0 tx=0x7f30f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af20bc6d5fe540fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:53.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.024+0000 7f30dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:14:53.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.024+0000 7f30dcff9640 1 -- 172.21.15.18:0/2887884409 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f001b040 con 0x55dcaccd42c0 2024-09-19T09:14:53.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.024+0000 7f30dcff9640 1 -- 172.21.15.18:0/2887884409 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f30f0036ae0 con 0x55dcaccd42c0 2024-09-19T09:14:53.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.024+0000 7f3102a0d740 1 -- 172.21.15.18:0/2887884409 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30f0027070 con 0x55dcaccd42c0 2024-09-19T09:14:53.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.024+0000 7f30dcff9640 1 -- 172.21.15.18:0/2887884409 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f30f003d050 con 0x55dcaccd42c0 2024-09-19T09:14:53.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.024+0000 7f3102a0d740 10 client.5337 fetch_fsmap learned FSMap version 21 2024-09-19T09:14:53.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.024+0000 7f3102a0d740 1 -- 172.21.15.18:0/2887884409 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55dcaca136b0 con 0x55dcaccd42c0 2024-09-19T09:14:53.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.024+0000 7f30dcff9640 1 -- 172.21.15.18:0/2887884409 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f0027070 con 0x55dcaccd42c0 2024-09-19T09:14:53.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.025+0000 7f30dcff9640 1 -- 172.21.15.18:0/2887884409 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f30f0040020 con 0x55dcaccd42c0 2024-09-19T09:14:53.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.025+0000 7f3102a0d740 10 client.5337 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T09:14:53.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.025+0000 7f3102a0d740 10 client.5337 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T09:14:53.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.025+0000 7f3102a0d740 20 client.5337 populate_metadata read hostname 'smithi018' 2024-09-19T09:14:53.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.025+0000 7f3102a0d740 1 --2- 172.21.15.18:0/2887884409 >> [v2:172.21.15.18:6833/295967875,v1:172.21.15.18:6835/295967875] conn(0x55dcaccf5d20 0x55dcaccf4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:53.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.025+0000 7f3102a0d740 4 client.5337 mds_command: new command op to 5187 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:14:53.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.025+0000 7f3102a0d740 1 -- 172.21.15.18:0/2887884409 --> [v2:172.21.15.18:6833/295967875,v1:172.21.15.18:6835/295967875] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dcacc43c50 con 0x55dcaccf5d20 2024-09-19T09:14:53.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.025+0000 7f30fd12c640 1 --2- 172.21.15.18:0/2887884409 >> [v2:172.21.15.18:6833/295967875,v1:172.21.15.18:6835/295967875] conn(0x55dcaccf5d20 0x55dcaccf4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:53.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.025+0000 7f30dcff9640 10 client.5337 ms_handle_connect on v2:172.21.15.18:6833/295967875 2024-09-19T09:14:53.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.025+0000 7f30fd12c640 1 --2- 172.21.15.18:0/2887884409 >> [v2:172.21.15.18:6833/295967875,v1:172.21.15.18:6835/295967875] conn(0x55dcaccf5d20 0x55dcaccf4570 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=358b060f1e4a278e server_cookie=87f44ab3ced9c962 in_seq=0 out_seq=0 2024-09-19T09:14:53.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.026+0000 7f30dcff9640 1 -- 172.21.15.18:0/2887884409 <== mds.0 v2:172.21.15.18:6833/295967875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dcacc43c50 con 0x55dcaccf5d20 2024-09-19T09:14:53.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.026+0000 7f30dcff9640 10 client.5337 handle_command_reply: tid=0 2024-09-19T09:14:53.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.026+0000 7f3102a0d740 1 client.5337 shutdown 2024-09-19T09:14:53.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.026+0000 7f3102a0d740 1 -- 172.21.15.18:0/2887884409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dcaccd42c0 msgr2=0x55dcaccf3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:53.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.026+0000 7f3102a0d740 1 --2- 172.21.15.18:0/2887884409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dcaccd42c0 0x55dcaccf3c10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f30f0003ee0 tx=0x7f30f0004730 comp rx=0 tx=0).stop 2024-09-19T09:14:53.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.026+0000 7f3102a0d740 1 -- 172.21.15.18:0/2887884409 shutdown_connections 2024-09-19T09:14:53.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.026+0000 7f3102a0d740 1 --2- 172.21.15.18:0/2887884409 >> [v2:172.21.15.18:6833/295967875,v1:172.21.15.18:6835/295967875] conn(0x55dcaccf5d20 0x55dcaccf4570 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.026+0000 7f3102a0d740 1 --2- 172.21.15.18:0/2887884409 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcacd29ad0 0x55dcaccf57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.026+0000 7f3102a0d740 1 --2- 172.21.15.18:0/2887884409 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55dcaccd5a50 0x55dcaccf7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.026+0000 7f30dcff9640 0 client.5337 ms_handle_reset on v2:172.21.15.18:6833/295967875 2024-09-19T09:14:53.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.026+0000 7f3102a0d740 1 --2- 172.21.15.18:0/2887884409 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dcaccd42c0 0x55dcaccf3c10 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.026+0000 7f3102a0d740 1 -- 172.21.15.18:0/2887884409 >> 172.21.15.18:0/2887884409 conn(0x55dcaccd1a80 msgr2=0x55dcacd16ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:53.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.026+0000 7f3102a0d740 1 -- 172.21.15.18:0/2887884409 shutdown_connections 2024-09-19T09:14:53.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.026+0000 7f3102a0d740 1 -- 172.21.15.18:0/2887884409 wait complete. 2024-09-19T09:14:53.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.026+0000 7f3102a0d740 20 client.5337 trim_cache size 0 max 16384 2024-09-19T09:14:53.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.045+0000 7f3102a0d740 1 Processor -- start 2024-09-19T09:14:53.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.045+0000 7f3102a0d740 1 -- start start 2024-09-19T09:14:53.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.045+0000 7f3102a0d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcaccd42c0 0x55dcaccf8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:53.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.045+0000 7f3102a0d740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55dcaccd5a50 0x55dcacd16ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:53.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.045+0000 7f3102a0d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dcacd29ad0 0x55dcacd17420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:53.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.045+0000 7f3102a0d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f30f80c9bb0 con 0x55dcacd29ad0 2024-09-19T09:14:53.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.045+0000 7f3102a0d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f30f81f8940 con 0x55dcaccd42c0 2024-09-19T09:14:53.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.045+0000 7f3102a0d740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f30f80c9560 con 0x55dcaccd5a50 2024-09-19T09:14:53.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.046+0000 7f30fe12e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dcacd29ad0 0x55dcacd17420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:53.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.046+0000 7f30fe12e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dcacd29ad0 0x55dcacd17420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53730/0 (socket says 172.21.15.18:53730) 2024-09-19T09:14:53.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.046+0000 7f30fe12e640 1 -- 172.21.15.18:0/1601987604 learned_addr learned my addr 172.21.15.18:0/1601987604 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:53.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.046+0000 7f30fd12c640 1 --2- 172.21.15.18:0/1601987604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55dcaccd5a50 0x55dcacd16ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:53.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.046+0000 7f30fe12e640 1 -- 172.21.15.18:0/1601987604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55dcaccd5a50 msgr2=0x55dcacd16ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:53.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.046+0000 7f30fd92d640 1 --2- 172.21.15.18:0/1601987604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcaccd42c0 0x55dcaccf8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:53.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.046+0000 7f30fe12e640 1 --2- 172.21.15.18:0/1601987604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55dcaccd5a50 0x55dcacd16ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.046+0000 7f30fe12e640 1 -- 172.21.15.18:0/1601987604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcaccd42c0 msgr2=0x55dcaccf8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:53.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.046+0000 7f30fe12e640 1 --2- 172.21.15.18:0/1601987604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcaccd42c0 0x55dcaccf8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.046+0000 7f30fe12e640 1 -- 172.21.15.18:0/1601987604 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcacd132e0 con 0x55dcacd29ad0 2024-09-19T09:14:53.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.046+0000 7f30fd12c640 1 --2- 172.21.15.18:0/1601987604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55dcaccd5a50 0x55dcacd16ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:14:53.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.046+0000 7f30fe12e640 1 --2- 172.21.15.18:0/1601987604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dcacd29ad0 0x55dcacd17420 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f30e8001d80 tx=0x7f30e8001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1793e66d7fd8202 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:53.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.046+0000 7f30deffd640 1 -- 172.21.15.18:0/1601987604 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e80079a0 con 0x55dcacd29ad0 2024-09-19T09:14:53.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.046+0000 7f30deffd640 1 -- 172.21.15.18:0/1601987604 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30e801b070 con 0x55dcacd29ad0 2024-09-19T09:14:53.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.046+0000 7f30deffd640 1 -- 172.21.15.18:0/1601987604 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e8016680 con 0x55dcacd29ad0 2024-09-19T09:14:53.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.047+0000 7f3102a0d740 1 -- 172.21.15.18:0/1601987604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dcacd29ad0 msgr2=0x55dcacd17420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:53.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.047+0000 7f3102a0d740 1 --2- 172.21.15.18:0/1601987604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dcacd29ad0 0x55dcacd17420 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f30e8001d80 tx=0x7f30e8001970 comp rx=0 tx=0).stop 2024-09-19T09:14:53.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.047+0000 7f3102a0d740 1 -- 172.21.15.18:0/1601987604 shutdown_connections 2024-09-19T09:14:53.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.047+0000 7f3102a0d740 1 --2- 172.21.15.18:0/1601987604 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dcacd29ad0 0x55dcacd17420 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.047+0000 7f3102a0d740 1 --2- 172.21.15.18:0/1601987604 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55dcaccd5a50 0x55dcacd16ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.047+0000 7f3102a0d740 1 --2- 172.21.15.18:0/1601987604 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcaccd42c0 0x55dcaccf8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.047+0000 7f3102a0d740 1 -- 172.21.15.18:0/1601987604 >> 172.21.15.18:0/1601987604 conn(0x55dcaccd1a80 msgr2=0x55dcacd1aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:53.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.047+0000 7f3102a0d740 1 -- 172.21.15.18:0/1601987604 shutdown_connections 2024-09-19T09:14:53.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.047+0000 7f3102a0d740 1 -- 172.21.15.18:0/1601987604 wait complete. 2024-09-19T09:14:53.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.047+0000 7f3102a0d740 1 -- start start 2024-09-19T09:14:53.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.048+0000 7f3102a0d740 1 Processor -- start 2024-09-19T09:14:53.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.048+0000 7f3102a0d740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55dcaccd42c0 0x55dcacd9aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:53.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.048+0000 7f3102a0d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcaccd5a50 0x55dcaccf4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:53.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.048+0000 7f3102a0d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dcacd29ad0 0x55dcaccf4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:53.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.049+0000 7f3102a0d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55dcacd29390 con 0x55dcacd29ad0 2024-09-19T09:14:53.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.049+0000 7f3102a0d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55dcaccf7e70 con 0x55dcaccd5a50 2024-09-19T09:14:53.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.049+0000 7f3102a0d740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55dcaccfd5d0 con 0x55dcaccd42c0 2024-09-19T09:14:53.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.049+0000 7f3102a0d740 10 client.0 _ll_register_callbacks cb 0x7f30ec009110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:14:53.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.049+0000 7f30fe12e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dcacd29ad0 0x55dcaccf4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:53.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.049+0000 7f30fe12e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dcacd29ad0 0x55dcaccf4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53732/0 (socket says 172.21.15.18:53732) 2024-09-19T09:14:53.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.049+0000 7f30fe12e640 1 -- 172.21.15.18:0/727544842 learned_addr learned my addr 172.21.15.18:0/727544842 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:53.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.049+0000 7f30fd92d640 1 --2- 172.21.15.18:0/727544842 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55dcaccd42c0 0x55dcacd9aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:53.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.049+0000 7f30fd12c640 1 --2- 172.21.15.18:0/727544842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcaccd5a50 0x55dcaccf4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:53.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.049+0000 7f30fe12e640 1 -- 172.21.15.18:0/727544842 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55dcaccd42c0 msgr2=0x55dcacd9aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:53.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.049+0000 7f30fe12e640 1 --2- 172.21.15.18:0/727544842 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55dcaccd42c0 0x55dcacd9aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.049+0000 7f30fe12e640 1 -- 172.21.15.18:0/727544842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcaccd5a50 msgr2=0x55dcaccf4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:53.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.049+0000 7f30fe12e640 1 --2- 172.21.15.18:0/727544842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcaccd5a50 0x55dcaccf4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.049+0000 7f30fe12e640 1 -- 172.21.15.18:0/727544842 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcacd3d690 con 0x55dcacd29ad0 2024-09-19T09:14:53.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.049+0000 7f30fe12e640 1 --2- 172.21.15.18:0/727544842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dcacd29ad0 0x55dcaccf4950 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f30e8009010 tx=0x7f30e8001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373de844a5c12ee9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:53.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.049+0000 7f30dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:14:53.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.049+0000 7f30dcff9640 1 -- 172.21.15.18:0/727544842 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e80064d0 con 0x55dcacd29ad0 2024-09-19T09:14:53.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.049+0000 7f30dcff9640 1 -- 172.21.15.18:0/727544842 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f30e8006670 con 0x55dcacd29ad0 2024-09-19T09:14:53.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.049+0000 7f3102a0d740 1 -- 172.21.15.18:0/727544842 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30e801b070 con 0x55dcacd29ad0 2024-09-19T09:14:53.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.049+0000 7f30dcff9640 1 -- 172.21.15.18:0/727544842 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=21) ==== 24+0+0 (secure 0 0 0) 0x7f30e8030050 con 0x55dcacd29ad0 2024-09-19T09:14:53.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.049+0000 7f3102a0d740 10 client.5343 fetch_fsmap learned FSMap version 21 2024-09-19T09:14:53.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.049+0000 7f3102a0d740 1 -- 172.21.15.18:0/727544842 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=21,monmap=2+}) -- 0x55dcaccfca90 con 0x55dcacd29ad0 2024-09-19T09:14:53.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.050+0000 7f30dcff9640 1 -- 172.21.15.18:0/727544842 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30e801b070 con 0x55dcacd29ad0 2024-09-19T09:14:53.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.050+0000 7f30dcff9640 1 -- 172.21.15.18:0/727544842 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 21) ==== 3502+0+0 (secure 0 0 0) 0x7f30e8033020 con 0x55dcacd29ad0 2024-09-19T09:14:53.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.050+0000 7f3102a0d740 10 client.5343 fetch_fsmap finished waiting for FSMap version 21 2024-09-19T09:14:53.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.050+0000 7f3102a0d740 10 client.5343 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T09:14:53.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.050+0000 7f3102a0d740 20 client.5343 populate_metadata read hostname 'smithi018' 2024-09-19T09:14:53.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.050+0000 7f3102a0d740 1 --2- 172.21.15.18:0/727544842 >> [v2:172.21.15.18:6833/295967875,v1:172.21.15.18:6835/295967875] conn(0x55dcacd28110 0x55dcaccf8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:53.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.050+0000 7f3102a0d740 4 client.5343 mds_command: new command op to 5187 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:14:53.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.050+0000 7f3102a0d740 1 -- 172.21.15.18:0/727544842 --> [v2:172.21.15.18:6833/295967875,v1:172.21.15.18:6835/295967875] -- command(tid 0: {"prefix": "status"}) -- 0x55dcacc3dfa0 con 0x55dcacd28110 2024-09-19T09:14:53.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.050+0000 7f30fd92d640 1 --2- 172.21.15.18:0/727544842 >> [v2:172.21.15.18:6833/295967875,v1:172.21.15.18:6835/295967875] conn(0x55dcacd28110 0x55dcaccf8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:53.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.050+0000 7f30dcff9640 10 client.5343 ms_handle_connect on v2:172.21.15.18:6833/295967875 2024-09-19T09:14:53.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.050+0000 7f30fd92d640 1 --2- 172.21.15.18:0/727544842 >> [v2:172.21.15.18:6833/295967875,v1:172.21.15.18:6835/295967875] conn(0x55dcacd28110 0x55dcaccf8050 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1285d2f655a37368 server_cookie=fd19801d35f4875 in_seq=0 out_seq=0 2024-09-19T09:14:53.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.050+0000 7f30dcff9640 1 -- 172.21.15.18:0/727544842 <== mds.0 v2:172.21.15.18:6833/295967875 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55dcacc3dfa0 con 0x55dcacd28110 2024-09-19T09:14:53.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.050+0000 7f30dcff9640 10 client.5343 handle_command_reply: tid=0 2024-09-19T09:14:53.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.050+0000 7f3102a0d740 1 client.5343 shutdown 2024-09-19T09:14:53.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.051+0000 7f3102a0d740 1 -- 172.21.15.18:0/727544842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dcacd29ad0 msgr2=0x55dcaccf4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:53.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.051+0000 7f3102a0d740 1 --2- 172.21.15.18:0/727544842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dcacd29ad0 0x55dcaccf4950 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f30e8009010 tx=0x7f30e8001250 comp rx=0 tx=0).stop 2024-09-19T09:14:53.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.051+0000 7f3102a0d740 1 -- 172.21.15.18:0/727544842 shutdown_connections 2024-09-19T09:14:53.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.051+0000 7f3102a0d740 1 --2- 172.21.15.18:0/727544842 >> [v2:172.21.15.18:6833/295967875,v1:172.21.15.18:6835/295967875] conn(0x55dcacd28110 0x55dcaccf8050 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.051+0000 7f3102a0d740 1 --2- 172.21.15.18:0/727544842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55dcacd29ad0 0x55dcaccf4950 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.051+0000 7f3102a0d740 1 --2- 172.21.15.18:0/727544842 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55dcaccd5a50 0x55dcaccf4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.051+0000 7f30dcff9640 0 client.5343 ms_handle_reset on v2:172.21.15.18:6833/295967875 2024-09-19T09:14:53.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.051+0000 7f3102a0d740 1 --2- 172.21.15.18:0/727544842 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55dcaccd42c0 0x55dcacd9aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.051+0000 7f3102a0d740 1 -- 172.21.15.18:0/727544842 >> 172.21.15.18:0/727544842 conn(0x55dcaccd1a80 msgr2=0x55dcacd16ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:53.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.051+0000 7f3102a0d740 1 -- 172.21.15.18:0/727544842 shutdown_connections 2024-09-19T09:14:53.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.051+0000 7f3102a0d740 1 -- 172.21.15.18:0/727544842 wait complete. 2024-09-19T09:14:53.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.051+0000 7f3102a0d740 20 client.5343 trim_cache size 0 max 16384 2024-09-19T09:14:53.074 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:14:53.074 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:14:53.074 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-09-19T09:14:53.074 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 5187, 2024-09-19T09:14:53.074 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-19T09:14:53.074 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-19T09:14:53.075 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-19T09:14:53.075 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 9.0343271089999995, 2024-09-19T09:14:53.075 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 21, 2024-09-19T09:14:53.075 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 48, 2024-09-19T09:14:53.075 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 48, 2024-09-19T09:14:53.075 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 20.025160152000002 2024-09-19T09:14:53.075 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:14:53.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.051+0000 7f30ffb91640 1 -- 172.21.15.18:0/609466745 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f30e406c2b0 msgr2=0x7f30e406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:53.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.051+0000 7f30ffb91640 1 --2- 172.21.15.18:0/609466745 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f30e406c2b0 0x7f30e406e770 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f30f0009560 tx=0x7f30f0009190 comp rx=0 tx=0).stop 2024-09-19T09:14:53.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.051+0000 7f30ffb91640 1 -- 172.21.15.18:0/609466745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30f80d56f0 msgr2=0x7f30f80cadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:53.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.051+0000 7f30ffb91640 1 --2- 172.21.15.18:0/609466745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30f80d56f0 0x7f30f80cadf0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f30ec02a200 tx=0x7f30ec0046c0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.051+0000 7f30ffb91640 1 -- 172.21.15.18:0/609466745 shutdown_connections 2024-09-19T09:14:53.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.051+0000 7f30ffb91640 1 --2- 172.21.15.18:0/609466745 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f30e406c2b0 0x7f30e406e770 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.051+0000 7f30ffb91640 1 --2- 172.21.15.18:0/609466745 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30f8162460 0x7f30f80b9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.051+0000 7f30ffb91640 1 --2- 172.21.15.18:0/609466745 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30f80d56f0 0x7f30f80cadf0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.051+0000 7f30ffb91640 1 --2- 172.21.15.18:0/609466745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30f80d2b80 0x7f30f81f3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.051+0000 7f30ffb91640 1 -- 172.21.15.18:0/609466745 >> 172.21.15.18:0/609466745 conn(0x7f30f80d4bd0 msgr2=0x7f30f80d0840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:53.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.052+0000 7f30ffb91640 1 -- 172.21.15.18:0/609466745 shutdown_connections 2024-09-19T09:14:53.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.052+0000 7f30ffb91640 1 -- 172.21.15.18:0/609466745 wait complete. 2024-09-19T09:14:53.078 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T09:14:53.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.180+0000 7f582e3a2640 1 Processor -- start 2024-09-19T09:14:53.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.180+0000 7f582e3a2640 1 -- start start 2024-09-19T09:14:53.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.181+0000 7f582e3a2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f582815e970 0x7f58280d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:53.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.181+0000 7f582e3a2640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f58280cfc90 0x7f58280c8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:53.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.181+0000 7f582e3a2640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58280d2bd0 con 0x7f58280d2680 2024-09-19T09:14:53.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.181+0000 7f582e3a2640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f58280d37e0 con 0x7f58280cfc90 2024-09-19T09:14:53.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.181+0000 7f582e3a2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f58280d2eb0 con 0x7f582815e970 2024-09-19T09:14:53.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.181+0000 7f582dba1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f58280cfc90 0x7f58280c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:53.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.181+0000 7f582dba1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f58280cfc90 0x7f58280c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53736/0 (socket says 172.21.15.18:53736) 2024-09-19T09:14:53.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.181+0000 7f582dba1640 1 -- 172.21.15.18:0/3863583035 learned_addr learned my addr 172.21.15.18:0/3863583035 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:53.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.182+0000 7f582d3a0640 1 --2- 172.21.15.18:0/3863583035 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f582815e970 0x7f58280d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:53.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.182+0000 7f582dba1640 1 -- 172.21.15.18:0/3863583035 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f582815e970 msgr2=0x7f58280d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:53.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.182+0000 7f582dba1640 1 --2- 172.21.15.18:0/3863583035 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f582815e970 0x7f58280d0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.182+0000 7f582dba1640 1 -- 172.21.15.18:0/3863583035 >> v1:172.21.15.162:6789/0 conn(0x7f58280d2680 legacy=0x7f58280cf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:53.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.182+0000 7f582dba1640 1 -- 172.21.15.18:0/3863583035 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58280d3190 con 0x7f58280cfc90 2024-09-19T09:14:53.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.182+0000 7f582dba1640 1 --2- 172.21.15.18:0/3863583035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58280cfc90 0x7f58280c8700 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5820009e50 tx=0x7f582002a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=598c1b249465ad8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:53.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.183+0000 7f581ffff640 1 -- 172.21.15.18:0/3863583035 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5820036070 con 0x7f58280cfc90 2024-09-19T09:14:53.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.183+0000 7f581ffff640 1 -- 172.21.15.18:0/3863583035 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5820031600 con 0x7f58280cfc90 2024-09-19T09:14:53.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.183+0000 7f581ffff640 1 -- 172.21.15.18:0/3863583035 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58200319d0 con 0x7f58280cfc90 2024-09-19T09:14:53.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.183+0000 7f582e3a2640 1 -- 172.21.15.18:0/3863583035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58280cfc90 msgr2=0x7f58280c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:53.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.183+0000 7f582e3a2640 1 --2- 172.21.15.18:0/3863583035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58280cfc90 0x7f58280c8700 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5820009e50 tx=0x7f582002a750 comp rx=0 tx=0).stop 2024-09-19T09:14:53.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.183+0000 7f582e3a2640 1 -- 172.21.15.18:0/3863583035 shutdown_connections 2024-09-19T09:14:53.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.183+0000 7f582e3a2640 1 --2- 172.21.15.18:0/3863583035 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58280cfc90 0x7f58280c8700 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.183+0000 7f582e3a2640 1 --2- 172.21.15.18:0/3863583035 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f582815e970 0x7f58280d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.183+0000 7f582e3a2640 1 -- 172.21.15.18:0/3863583035 >> 172.21.15.18:0/3863583035 conn(0x7f582809de00 msgr2=0x7f58280d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:53.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.183+0000 7f582e3a2640 1 -- 172.21.15.18:0/3863583035 shutdown_connections 2024-09-19T09:14:53.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.183+0000 7f582e3a2640 1 -- 172.21.15.18:0/3863583035 wait complete. 2024-09-19T09:14:53.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.184+0000 7f582e3a2640 1 Processor -- start 2024-09-19T09:14:53.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.184+0000 7f582e3a2640 1 -- start start 2024-09-19T09:14:53.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.185+0000 7f582e3a2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58280cfc90 0x7f58280cd980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:53.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.185+0000 7f582e3a2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58280d2680 0x7f58280ba2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:53.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.185+0000 7f582e3a2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f582815e970 0x7f5828154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:53.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.185+0000 7f582e3a2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f582815ed50 con 0x7f58280cfc90 2024-09-19T09:14:53.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.185+0000 7f582e3a2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f58280d0840 con 0x7f58280d2680 2024-09-19T09:14:53.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.185+0000 7f582e3a2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f582815eed0 con 0x7f582815e970 2024-09-19T09:14:53.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.185+0000 7f582d3a0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58280cfc90 0x7f58280cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:53.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.185+0000 7f582d3a0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58280cfc90 0x7f58280cd980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53748/0 (socket says 172.21.15.18:53748) 2024-09-19T09:14:53.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.185+0000 7f582d3a0640 1 -- 172.21.15.18:0/2074507977 learned_addr learned my addr 172.21.15.18:0/2074507977 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:53.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.186+0000 7f582d3a0640 1 -- 172.21.15.18:0/2074507977 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f582815e970 msgr2=0x7f5828154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:53.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.186+0000 7f582dba1640 1 --2- 172.21.15.18:0/2074507977 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f582815e970 0x7f5828154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:53.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.186+0000 7f582cb9f640 1 --2- 172.21.15.18:0/2074507977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58280d2680 0x7f58280ba2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:53.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.186+0000 7f582d3a0640 1 --2- 172.21.15.18:0/2074507977 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f582815e970 0x7f5828154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.186+0000 7f582d3a0640 1 -- 172.21.15.18:0/2074507977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58280d2680 msgr2=0x7f58280ba2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:53.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.186+0000 7f582d3a0640 1 --2- 172.21.15.18:0/2074507977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58280d2680 0x7f58280ba2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.186+0000 7f582d3a0640 1 -- 172.21.15.18:0/2074507977 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58280cc8e0 con 0x7f58280cfc90 2024-09-19T09:14:53.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.186+0000 7f582dba1640 1 --2- 172.21.15.18:0/2074507977 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f582815e970 0x7f5828154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:14:53.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.186+0000 7f582cb9f640 1 --2- 172.21.15.18:0/2074507977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58280d2680 0x7f58280ba2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:14:53.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.186+0000 7f582d3a0640 1 --2- 172.21.15.18:0/2074507977 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58280cfc90 0x7f58280cd980 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f582400c820 tx=0x7f582400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:53.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.186+0000 7f581dffb640 1 -- 172.21.15.18:0/2074507977 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5824015070 con 0x7f58280cfc90 2024-09-19T09:14:53.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.186+0000 7f581dffb640 1 -- 172.21.15.18:0/2074507977 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5824004020 con 0x7f58280cfc90 2024-09-19T09:14:53.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.186+0000 7f582e3a2640 1 -- 172.21.15.18:0/2074507977 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58280ccbc0 con 0x7f58280cfc90 2024-09-19T09:14:53.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.186+0000 7f581dffb640 1 -- 172.21.15.18:0/2074507977 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58240043f0 con 0x7f58280cfc90 2024-09-19T09:14:53.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.186+0000 7f582e3a2640 1 -- 172.21.15.18:0/2074507977 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58280cd180 con 0x7f58280cfc90 2024-09-19T09:14:53.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.187+0000 7f582e3a2640 1 -- 172.21.15.18:0/2074507977 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58280d0300 con 0x7f58280cfc90 2024-09-19T09:14:53.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.187+0000 7f581dffb640 1 -- 172.21.15.18:0/2074507977 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5824007830 con 0x7f58280cfc90 2024-09-19T09:14:53.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.188+0000 7f581dffb640 1 --2- 172.21.15.18:0/2074507977 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f580c06c2b0 0x7f580c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:53.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.188+0000 7f581dffb640 1 -- 172.21.15.18:0/2074507977 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f582408b270 con 0x7f58280cfc90 2024-09-19T09:14:53.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.188+0000 7f582cb9f640 1 --2- 172.21.15.18:0/2074507977 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f580c06c2b0 0x7f580c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:53.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.189+0000 7f582cb9f640 1 --2- 172.21.15.18:0/2074507977 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f580c06c2b0 0x7f580c06e770 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f582809e530 tx=0x7f5818009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:53.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.192+0000 7f581dffb640 1 -- 172.21.15.18:0/2074507977 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f58240599d0 con 0x7f58280cfc90 2024-09-19T09:14:53.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.402+0000 7f582e3a2640 1 -- 172.21.15.18:0/2074507977 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f58280c9ac0 con 0x7f58280cfc90 2024-09-19T09:14:53.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.403+0000 7f581dffb640 1 -- 172.21.15.18:0/2074507977 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) ==== 53+0+73 (secure 0 0 0) 0x7f58240592d0 con 0x7f58280cfc90 2024-09-19T09:14:53.403 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T09:14:53.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.404+0000 7f582e3a2640 1 -- 172.21.15.18:0/2074507977 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f580c06c2b0 msgr2=0x7f580c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:53.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.404+0000 7f582e3a2640 1 --2- 172.21.15.18:0/2074507977 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f580c06c2b0 0x7f580c06e770 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f582809e530 tx=0x7f5818009040 comp rx=0 tx=0).stop 2024-09-19T09:14:53.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.404+0000 7f582e3a2640 1 -- 172.21.15.18:0/2074507977 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58280cfc90 msgr2=0x7f58280cd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:53.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.404+0000 7f582e3a2640 1 --2- 172.21.15.18:0/2074507977 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58280cfc90 0x7f58280cd980 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f582400c820 tx=0x7f582400cce0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.405+0000 7f582e3a2640 1 -- 172.21.15.18:0/2074507977 shutdown_connections 2024-09-19T09:14:53.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.405+0000 7f582e3a2640 1 --2- 172.21.15.18:0/2074507977 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f580c06c2b0 0x7f580c06e770 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.405+0000 7f582e3a2640 1 --2- 172.21.15.18:0/2074507977 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f582815e970 0x7f5828154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.405+0000 7f582e3a2640 1 --2- 172.21.15.18:0/2074507977 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f58280d2680 0x7f58280ba2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.405+0000 7f582e3a2640 1 --2- 172.21.15.18:0/2074507977 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f58280cfc90 0x7f58280cd980 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:53.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.405+0000 7f582e3a2640 1 -- 172.21.15.18:0/2074507977 >> 172.21.15.18:0/2074507977 conn(0x7f582809de00 msgr2=0x7f58280d1250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:53.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.405+0000 7f582e3a2640 1 -- 172.21.15.18:0/2074507977 shutdown_connections 2024-09-19T09:14:53.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53.405+0000 7f582e3a2640 1 -- 172.21.15.18:0/2074507977 wait complete. 2024-09-19T09:14:53.416 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-19T09:14:53.416 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:14:53.416 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-09-19T09:14:53.416 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T09:14:53.416 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:14:53.416 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-19T09:14:53.416 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-19T09:14:53.416 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:14:53.417 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:14:53.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:53.417 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-09-19T09:14:53.433 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:14:53.434 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:14:53.434 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:14:53.434 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:14:53.434 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-09-19T09:14:53.434 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:14:53.434 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:14:53.434 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:14:53.434 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-09-19T09:14:53.434 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:14:53.434 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:14:53.434 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-09-19T09:14:53.434 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:14:53.434 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:14:53.435 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-09-19T09:14:53.435 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T09:14:53.435 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42704sec preferred_lft 42704sec 2024-09-19T09:14:53.435 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-09-19T09:14:53.435 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:14:53.435 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:14:53.435 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:14:53.435 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-09-19T09:14:53.435 INFO:teuthology.orchestra.run.smithi018.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T09:14:53.435 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:44:1b:02:86:87 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:14:53.435 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T09:14:53.435 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:14:53.435 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::a0ce:faff:feaa:13ec/64 scope link 2024-09-19T09:14:53.435 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:14:53.436 INFO:teuthology.orchestra.run.smithi018.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:14:53.436 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:44:1b:02:86:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:14:53.436 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::44:1bff:fe02:8687/64 scope link 2024-09-19T09:14:53.436 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:14:53.436 INFO:teuthology.orchestra.run.smithi018.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:14:53.436 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether e2:6d:c4:af:6a:8b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T09:14:53.436 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::e06d:c4ff:feaf:6a8b/64 scope link 2024-09-19T09:14:53.436 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:14:53.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:53.436 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:14:53.499 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-09-19T09:14:53.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:53.500 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-09-19T09:14:53.557 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-09-19T09:14:53.557 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:14:53.557 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T09:14:53.557 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T09:14:53.558 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:14:53.558 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:14:53.558 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T09:14:53.558 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T09:14:53.558 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T09:14:53.558 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T09:14:53.558 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T09:14:53.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:14:53.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:14:53.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:53.686 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-19T09:14:53.702 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-19T09:14:53.703 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T09:14:53.703 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:14:53.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:53.703 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-09-19T09:14:53.769 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:14:53.769 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T09:14:53.825 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:14:53.826 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:14:53.826 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:14:53.881 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-19T09:14:53.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:53.881 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:14:53.966 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:14:53.966 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:14:53.966 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:14:53.976 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:14:53.976 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:14:53.976 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:14:53.976 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:14:53.976 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:14:53.984 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:14:53.985 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:14:53.985 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:14:53.985 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:14:53.985 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:14:53.985 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-19T09:14:53.985 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-19T09:14:53.985 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fec66d7e-50e5-42ed-81de-ad141a2f0f4e" will pass to kernel 2024-09-19T09:14:53.985 INFO:teuthology.orchestra.run.smithi018.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-19T09:14:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:14:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:14:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:14:53.986 INFO:teuthology.orchestra.run.smithi018.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:14:53.987 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:14:53.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:53.987 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:14:54.013 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:14:54.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:14:54.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:14:54.115 INFO:teuthology.orchestra.run.smithi018.stdout:client4895 2024-09-19T09:14:54.115 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:14:54.115 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:14:54.131 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T09:14:54.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.272+0000 7fe16892c640 1 Processor -- start 2024-09-19T09:14:54.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.272+0000 7fe16892c640 1 -- start start 2024-09-19T09:14:54.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.273+0000 7fe16892c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe16415ef50 0x7fe1640d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:54.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.273+0000 7fe16892c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe1640b9510 0x7fe1640d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:54.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.273+0000 7fe16892c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1640b7a90 con 0x7fe1640d3240 2024-09-19T09:14:54.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.273+0000 7fe16892c640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fe1640d3740 con 0x7fe1640b9510 2024-09-19T09:14:54.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.273+0000 7fe16892c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe1640d3a20 con 0x7fe16415ef50 2024-09-19T09:14:54.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.273+0000 7fe162d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe1640b9510 0x7fe1640d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:54.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.273+0000 7fe162d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe1640b9510 0x7fe1640d18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53762/0 (socket says 172.21.15.18:53762) 2024-09-19T09:14:54.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.273+0000 7fe162d9d640 1 -- 172.21.15.18:0/3217659203 learned_addr learned my addr 172.21.15.18:0/3217659203 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:54.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.274+0000 7fe162d9d640 1 -- 172.21.15.18:0/3217659203 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe16415ef50 msgr2=0x7fe1640d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:54.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.274+0000 7fe162d9d640 1 --2- 172.21.15.18:0/3217659203 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe16415ef50 0x7fe1640d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:54.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.274+0000 7fe162d9d640 1 -- 172.21.15.18:0/3217659203 >> v1:172.21.15.162:6789/0 conn(0x7fe1640d3240 legacy=0x7fe1640cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:54.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.274+0000 7fe162d9d640 1 -- 172.21.15.18:0/3217659203 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1640b7d00 con 0x7fe1640b9510 2024-09-19T09:14:54.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.274+0000 7fe162d9d640 1 --2- 172.21.15.18:0/3217659203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1640b9510 0x7fe1640d18e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe154009e50 tx=0x7fe15402a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4491785842de9cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:54.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.275+0000 7fe16159a640 1 -- 172.21.15.18:0/3217659203 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe154036070 con 0x7fe1640b9510 2024-09-19T09:14:54.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.275+0000 7fe16159a640 1 -- 172.21.15.18:0/3217659203 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe154031600 con 0x7fe1640b9510 2024-09-19T09:14:54.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.275+0000 7fe16159a640 1 -- 172.21.15.18:0/3217659203 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1540319d0 con 0x7fe1640b9510 2024-09-19T09:14:54.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.275+0000 7fe16892c640 1 -- 172.21.15.18:0/3217659203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1640b9510 msgr2=0x7fe1640d18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:54.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.275+0000 7fe16892c640 1 --2- 172.21.15.18:0/3217659203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1640b9510 0x7fe1640d18e0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fe154009e50 tx=0x7fe15402a630 comp rx=0 tx=0).stop 2024-09-19T09:14:54.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.275+0000 7fe16892c640 1 -- 172.21.15.18:0/3217659203 shutdown_connections 2024-09-19T09:14:54.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.275+0000 7fe16892c640 1 --2- 172.21.15.18:0/3217659203 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1640b9510 0x7fe1640d18e0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:54.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.275+0000 7fe16892c640 1 --2- 172.21.15.18:0/3217659203 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe16415ef50 0x7fe1640d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:54.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.275+0000 7fe16892c640 1 -- 172.21.15.18:0/3217659203 >> 172.21.15.18:0/3217659203 conn(0x7fe1640d4c60 msgr2=0x7fe1640d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:54.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.275+0000 7fe16892c640 1 -- 172.21.15.18:0/3217659203 shutdown_connections 2024-09-19T09:14:54.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.275+0000 7fe16892c640 1 -- 172.21.15.18:0/3217659203 wait complete. 2024-09-19T09:14:54.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.277+0000 7fe16892c640 1 Processor -- start 2024-09-19T09:14:54.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.277+0000 7fe16892c640 1 -- start start 2024-09-19T09:14:54.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.277+0000 7fe16892c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1640b9510 0x7fe1641e9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:54.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.277+0000 7fe16892c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1640d3240 0x7fe164160600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:54.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.277+0000 7fe16892c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe16415ef50 0x7fe1641f6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:54.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.277+0000 7fe16892c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe1640d21a0 con 0x7fe1640b9510 2024-09-19T09:14:54.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.277+0000 7fe16892c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe1640d2020 con 0x7fe16415ef50 2024-09-19T09:14:54.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.277+0000 7fe16892c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe1640d5780 con 0x7fe1640d3240 2024-09-19T09:14:54.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.277+0000 7fe16259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1640b9510 0x7fe1641e9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:54.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.277+0000 7fe16259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1640b9510 0x7fe1641e9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53772/0 (socket says 172.21.15.18:53772) 2024-09-19T09:14:54.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.277+0000 7fe16259c640 1 -- 172.21.15.18:0/2760414527 learned_addr learned my addr 172.21.15.18:0/2760414527 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:54.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.278+0000 7fe162d9d640 1 --2- 172.21.15.18:0/2760414527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe16415ef50 0x7fe1641f6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:54.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.278+0000 7fe16259c640 1 -- 172.21.15.18:0/2760414527 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1640d3240 msgr2=0x7fe164160600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:54.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.278+0000 7fe161d9b640 1 --2- 172.21.15.18:0/2760414527 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1640d3240 0x7fe164160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:54.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.278+0000 7fe16259c640 1 --2- 172.21.15.18:0/2760414527 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1640d3240 0x7fe164160600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:54.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.278+0000 7fe16259c640 1 -- 172.21.15.18:0/2760414527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe16415ef50 msgr2=0x7fe1641f6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:54.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.278+0000 7fe16259c640 1 --2- 172.21.15.18:0/2760414527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe16415ef50 0x7fe1641f6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:54.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.278+0000 7fe16259c640 1 -- 172.21.15.18:0/2760414527 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1641ea3b0 con 0x7fe1640b9510 2024-09-19T09:14:54.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.278+0000 7fe162d9d640 1 --2- 172.21.15.18:0/2760414527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe16415ef50 0x7fe1641f6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:14:54.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.278+0000 7fe16259c640 1 --2- 172.21.15.18:0/2760414527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1640b9510 0x7fe1641e9e70 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe15c00b410 tx=0x7fe15c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:54.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.278+0000 7fe15affd640 1 -- 172.21.15.18:0/2760414527 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15c015020 con 0x7fe1640b9510 2024-09-19T09:14:54.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.278+0000 7fe15affd640 1 -- 172.21.15.18:0/2760414527 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe15c011850 con 0x7fe1640b9510 2024-09-19T09:14:54.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.278+0000 7fe16892c640 1 -- 172.21.15.18:0/2760414527 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe16415f5c0 con 0x7fe1640b9510 2024-09-19T09:14:54.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.278+0000 7fe15affd640 1 -- 172.21.15.18:0/2760414527 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15c011c40 con 0x7fe1640b9510 2024-09-19T09:14:54.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.278+0000 7fe16892c640 1 -- 172.21.15.18:0/2760414527 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe16415fe00 con 0x7fe1640b9510 2024-09-19T09:14:54.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.279+0000 7fe16892c640 1 -- 172.21.15.18:0/2760414527 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1640d13a0 con 0x7fe1640b9510 2024-09-19T09:14:54.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.280+0000 7fe15affd640 1 -- 172.21.15.18:0/2760414527 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe15c018020 con 0x7fe1640b9510 2024-09-19T09:14:54.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.280+0000 7fe15affd640 1 --2- 172.21.15.18:0/2760414527 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe14406c2e0 0x7fe14406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:54.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.280+0000 7fe15affd640 1 -- 172.21.15.18:0/2760414527 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7fe15c08b2c0 con 0x7fe1640b9510 2024-09-19T09:14:54.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.280+0000 7fe161d9b640 1 --2- 172.21.15.18:0/2760414527 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe14406c2e0 0x7fe14406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:54.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.281+0000 7fe161d9b640 1 --2- 172.21.15.18:0/2760414527 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe14406c2e0 0x7fe14406e7a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe164156520 tx=0x7fe14c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:54.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.284+0000 7fe15affd640 1 -- 172.21.15.18:0/2760414527 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe15c01f020 con 0x7fe1640b9510 2024-09-19T09:14:54.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.496+0000 7fe16892c640 1 -- 172.21.15.18:0/2760414527 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe164073710 con 0x7fe1640b9510 2024-09-19T09:14:54.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.496+0000 7fe15affd640 1 -- 172.21.15.18:0/2760414527 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) ==== 53+0+73 (secure 0 0 0) 0x7fe16415f5c0 con 0x7fe1640b9510 2024-09-19T09:14:54.496 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T09:14:54.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.498+0000 7fe16892c640 1 -- 172.21.15.18:0/2760414527 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe14406c2e0 msgr2=0x7fe14406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:54.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.498+0000 7fe16892c640 1 --2- 172.21.15.18:0/2760414527 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe14406c2e0 0x7fe14406e7a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe164156520 tx=0x7fe14c009040 comp rx=0 tx=0).stop 2024-09-19T09:14:54.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.498+0000 7fe16892c640 1 -- 172.21.15.18:0/2760414527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1640b9510 msgr2=0x7fe1641e9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:54.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.498+0000 7fe16892c640 1 --2- 172.21.15.18:0/2760414527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1640b9510 0x7fe1641e9e70 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fe15c00b410 tx=0x7fe15c00b8d0 comp rx=0 tx=0).stop 2024-09-19T09:14:54.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.498+0000 7fe16892c640 1 -- 172.21.15.18:0/2760414527 shutdown_connections 2024-09-19T09:14:54.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.498+0000 7fe16892c640 1 --2- 172.21.15.18:0/2760414527 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe14406c2e0 0x7fe14406e7a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:54.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.498+0000 7fe16892c640 1 --2- 172.21.15.18:0/2760414527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe16415ef50 0x7fe1641f6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:54.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.498+0000 7fe16892c640 1 --2- 172.21.15.18:0/2760414527 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1640d3240 0x7fe164160600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:54.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.498+0000 7fe16892c640 1 --2- 172.21.15.18:0/2760414527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1640b9510 0x7fe1641e9e70 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:54.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.498+0000 7fe16892c640 1 -- 172.21.15.18:0/2760414527 >> 172.21.15.18:0/2760414527 conn(0x7fe1640d4c60 msgr2=0x7fe1640b6400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:54.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.498+0000 7fe16892c640 1 -- 172.21.15.18:0/2760414527 shutdown_connections 2024-09-19T09:14:54.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:54.498+0000 7fe16892c640 1 -- 172.21.15.18:0/2760414527 wait complete. 2024-09-19T09:14:54.509 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-19T09:14:54.509 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:14:54.510 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-09-19T09:14:54.510 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-19T09:14:54.510 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-19T09:14:54.510 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-19T09:14:54.510 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-19T09:14:54.510 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:14:54.510 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:14:54.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:54.510 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-09-19T09:14:54.530 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:14:54.531 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:14:54.531 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:14:54.531 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:14:54.531 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-09-19T09:14:54.531 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:14:54.531 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:14:54.531 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:14:54.531 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-09-19T09:14:54.531 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:14:54.531 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:14:54.531 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-09-19T09:14:54.531 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:14:54.531 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:14:54.532 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:14:54.532 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:14:54.532 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T09:14:54.532 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42714sec preferred_lft 42714sec 2024-09-19T09:14:54.532 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link noprefixroute 2024-09-19T09:14:54.532 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:14:54.532 INFO:teuthology.orchestra.run.smithi162.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T09:14:54.532 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 5e:4d:7e:1d:19:f9 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:14:54.532 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T09:14:54.532 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:14:54.532 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::5829:65ff:fe01:6bc7/64 scope link 2024-09-19T09:14:54.532 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:14:54.532 INFO:teuthology.orchestra.run.smithi162.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:14:54.533 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 86:86:3e:32:67:c5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T09:14:54.533 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::8486:3eff:fe32:67c5/64 scope link 2024-09-19T09:14:54.533 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:14:54.533 INFO:teuthology.orchestra.run.smithi162.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:14:54.533 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 5e:4d:7e:1d:19:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-19T09:14:54.533 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::5c4d:7eff:fe1d:19f9/64 scope link 2024-09-19T09:14:54.533 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:14:54.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:54.533 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:14:54.600 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-09-19T09:14:54.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:54.602 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-09-19T09:14:54.661 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-09-19T09:14:54.662 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:14:54.662 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T09:14:54.662 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T09:14:54.662 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:14:54.662 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:14:54.662 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-19T09:14:54.662 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T09:14:54.662 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T09:14:54.662 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T09:14:54.662 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-19T09:14:54.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:14:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:14:54.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:14:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:14:54.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:54.797 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-19T09:14:54.813 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-19T09:14:54.813 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-19T09:14:54.813 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:14:54.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:54.813 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2024-09-19T09:14:54.878 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:14:54.878 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-19T09:14:54.934 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:14:54.934 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:14:54.934 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-19T09:14:54.990 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-19T09:14:54.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:54.990 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:14:55.075 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:14:55.075 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:14:55.075 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:14:55.084 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:14:55.084 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:14:55.084 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:14:55.084 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:14:55.084 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:14:55.089 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:14:55.089 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:14:55.089 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:14:55.089 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:14:55.089 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:14:55.089 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-19T09:14:55.089 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-19T09:14:55.089 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=fec66d7e-50e5-42ed-81de-ad141a2f0f4e" will pass to kernel 2024-09-19T09:14:55.090 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-19T09:14:55.090 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:14:55.090 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:14:55.090 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:14:55.090 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:14:55.092 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:14:55.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:55.092 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-19T09:14:55.117 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:14:55.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:14:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:14:55.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:14:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:14:55.214 INFO:teuthology.orchestra.run.smithi162.stdout:client4898 2024-09-19T09:14:55.214 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:14:55.215 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:14:55.230 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:14:55.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.344+0000 7f807d615640 1 Processor -- start 2024-09-19T09:14:55.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.344+0000 7f807d615640 1 -- start start 2024-09-19T09:14:55.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.344+0000 7f807d615640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f807815eb00 0x7f80781630d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:55.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.344+0000 7f807d615640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f807806d810 0x7f80780b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:55.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.344+0000 7f807d615640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f807806e730 con 0x7f807806ffd0 2024-09-19T09:14:55.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.344+0000 7f807d615640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f807806ea10 con 0x7f807815eb00 2024-09-19T09:14:55.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.344+0000 7f807d615640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f80781628d0 con 0x7f807806d810 2024-09-19T09:14:55.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.345+0000 7f8076ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f807815eb00 0x7f80781630d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:55.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.345+0000 7f8076ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f807815eb00 0x7f80781630d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43322/0 (socket says 172.21.15.18:43322) 2024-09-19T09:14:55.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.345+0000 7f8076ffd640 1 -- 172.21.15.18:0/2601026331 learned_addr learned my addr 172.21.15.18:0/2601026331 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:55.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.345+0000 7f80767fc640 1 --2- 172.21.15.18:0/2601026331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f807806d810 0x7f80780b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:55.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.345+0000 7f8076ffd640 1 -- 172.21.15.18:0/2601026331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f807806d810 msgr2=0x7f80780b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:55.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.345+0000 7f8076ffd640 1 --2- 172.21.15.18:0/2601026331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f807806d810 0x7f80780b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:55.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.345+0000 7f8076ffd640 1 -- 172.21.15.18:0/2601026331 >> v1:172.21.15.162:6789/0 conn(0x7f807806ffd0 legacy=0x7f80780cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:55.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.345+0000 7f8075ffb640 1 -- 172.21.15.18:0/2601026331 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2663263315 0 0) 0x7f807806e730 con 0x7f807806ffd0 2024-09-19T09:14:55.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.345+0000 7f8076ffd640 1 -- 172.21.15.18:0/2601026331 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8078162bb0 con 0x7f807815eb00 2024-09-19T09:14:55.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.346+0000 7f8076ffd640 1 --2- 172.21.15.18:0/2601026331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f807815eb00 0x7f80781630d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8068009870 tx=0x7f806802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1184f49f999ca83a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:55.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.346+0000 7f8075ffb640 1 -- 172.21.15.18:0/2601026331 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8068037070 con 0x7f807815eb00 2024-09-19T09:14:55.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.346+0000 7f8075ffb640 1 -- 172.21.15.18:0/2601026331 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8068032440 con 0x7f807815eb00 2024-09-19T09:14:55.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.346+0000 7f8075ffb640 1 -- 172.21.15.18:0/2601026331 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8068032810 con 0x7f807815eb00 2024-09-19T09:14:55.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.346+0000 7f807d615640 1 -- 172.21.15.18:0/2601026331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f807815eb00 msgr2=0x7f80781630d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:55.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.346+0000 7f807d615640 1 --2- 172.21.15.18:0/2601026331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f807815eb00 0x7f80781630d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8068009870 tx=0x7f806802a1c0 comp rx=0 tx=0).stop 2024-09-19T09:14:55.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.347+0000 7f807d615640 1 -- 172.21.15.18:0/2601026331 shutdown_connections 2024-09-19T09:14:55.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.347+0000 7f807d615640 1 --2- 172.21.15.18:0/2601026331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f807806d810 0x7f80780b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:55.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.347+0000 7f807d615640 1 --2- 172.21.15.18:0/2601026331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f807815eb00 0x7f80781630d0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:55.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.347+0000 7f807d615640 1 -- 172.21.15.18:0/2601026331 >> 172.21.15.18:0/2601026331 conn(0x7f807806cd20 msgr2=0x7f807806d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:55.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.347+0000 7f807d615640 1 -- 172.21.15.18:0/2601026331 shutdown_connections 2024-09-19T09:14:55.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.347+0000 7f807d615640 1 -- 172.21.15.18:0/2601026331 wait complete. 2024-09-19T09:14:55.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.348+0000 7f807d615640 1 Processor -- start 2024-09-19T09:14:55.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.348+0000 7f807d615640 1 -- start start 2024-09-19T09:14:55.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.349+0000 7f807d615640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f807806d810 0x7f80781f9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:55.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.349+0000 7f807d615640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f807806ffd0 0x7f80781561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:55.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.349+0000 7f807d615640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f807815eb00 0x7f80780b2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:55.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.349+0000 7f807d615640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8078160070 con 0x7f807806d810 2024-09-19T09:14:55.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.349+0000 7f807d615640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f807815fef0 con 0x7f807815eb00 2024-09-19T09:14:55.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.349+0000 7f807d615640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f80780d1460 con 0x7f807806ffd0 2024-09-19T09:14:55.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.349+0000 7f8076ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f807806d810 0x7f80781f9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:55.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.349+0000 7f8076ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f807806d810 0x7f80781f9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43330/0 (socket says 172.21.15.18:43330) 2024-09-19T09:14:55.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.349+0000 7f8076ffd640 1 -- 172.21.15.18:0/158505302 learned_addr learned my addr 172.21.15.18:0/158505302 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:55.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.349+0000 7f80777fe640 1 --2- 172.21.15.18:0/158505302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f807815eb00 0x7f80780b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:55.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.349+0000 7f80767fc640 1 --2- 172.21.15.18:0/158505302 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f807806ffd0 0x7f80781561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:55.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.349+0000 7f8076ffd640 1 -- 172.21.15.18:0/158505302 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f807806ffd0 msgr2=0x7f80781561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:55.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.349+0000 7f8076ffd640 1 --2- 172.21.15.18:0/158505302 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f807806ffd0 0x7f80781561e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:55.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.349+0000 7f8076ffd640 1 -- 172.21.15.18:0/158505302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f807815eb00 msgr2=0x7f80780b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:55.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.349+0000 7f8076ffd640 1 --2- 172.21.15.18:0/158505302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f807815eb00 0x7f80780b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:55.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.349+0000 7f8076ffd640 1 -- 172.21.15.18:0/158505302 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8078161060 con 0x7f807806d810 2024-09-19T09:14:55.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.349+0000 7f8076ffd640 1 --2- 172.21.15.18:0/158505302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f807806d810 0x7f80781f9110 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8068009870 tx=0x7f80680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:55.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.350+0000 7f805f7fe640 1 -- 172.21.15.18:0/158505302 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8068041070 con 0x7f807806d810 2024-09-19T09:14:55.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.350+0000 7f805f7fe640 1 -- 172.21.15.18:0/158505302 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f806803c870 con 0x7f807806d810 2024-09-19T09:14:55.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.350+0000 7f807d615640 1 -- 172.21.15.18:0/158505302 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8078161300 con 0x7f807806d810 2024-09-19T09:14:55.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.350+0000 7f805f7fe640 1 -- 172.21.15.18:0/158505302 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8068037040 con 0x7f807806d810 2024-09-19T09:14:55.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.350+0000 7f807d615640 1 -- 172.21.15.18:0/158505302 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8078156720 con 0x7f807806d810 2024-09-19T09:14:55.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.351+0000 7f807d615640 1 -- 172.21.15.18:0/158505302 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80781630d0 con 0x7f807806d810 2024-09-19T09:14:55.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.351+0000 7f805f7fe640 1 -- 172.21.15.18:0/158505302 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8068044070 con 0x7f807806d810 2024-09-19T09:14:55.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.352+0000 7f805f7fe640 1 --2- 172.21.15.18:0/158505302 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f806406c2b0 0x7f806406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:55.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.352+0000 7f805f7fe640 1 -- 172.21.15.18:0/158505302 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7f80680abe60 con 0x7f807806d810 2024-09-19T09:14:55.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.352+0000 7f80767fc640 1 --2- 172.21.15.18:0/158505302 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f806406c2b0 0x7f806406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:55.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.352+0000 7f80767fc640 1 --2- 172.21.15.18:0/158505302 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f806406c2b0 0x7f806406e770 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8078159d00 tx=0x7f806c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:55.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.356+0000 7f805f7fe640 1 -- 172.21.15.18:0/158505302 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f806807a130 con 0x7f807806d810 2024-09-19T09:14:55.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.571+0000 7f807d615640 1 -- 172.21.15.18:0/158505302 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80781f9650 con 0x7f807806d810 2024-09-19T09:14:55.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.572+0000 7f805f7fe640 1 -- 172.21.15.18:0/158505302 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5223 (secure 0 0 0) 0x7f806807e430 con 0x7f807806d810 2024-09-19T09:14:55.572 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:55.572 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"btime":"2024-09-19T09:14:46:022043+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4793,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/113686001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":113686001},{"type":"v1","addr":"172.21.15.162:6835","nonce":113686001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":4799,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3269042030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3269042030},{"type":"v1","addr":"172.21.15.162:6837","nonce":3269042030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/3996030837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3996030837},{"type":"v1","addr":"172.21.15.18:6834","nonce":3996030837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:14:43.367290+0000","modified":"2024-09-19T09:14:45.363192+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5187":{"gid":5187,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/295967875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":295967875},{"type":"v1","addr":"172.21.15.18:6835","nonce":295967875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5187,"qdb_cluster":[5187]},"id":3}]} 2024-09-19T09:14:55.573 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 21 2024-09-19T09:14:55.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.574+0000 7f807d615640 1 -- 172.21.15.18:0/158505302 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f806406c2b0 msgr2=0x7f806406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:55.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.574+0000 7f807d615640 1 --2- 172.21.15.18:0/158505302 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f806406c2b0 0x7f806406e770 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8078159d00 tx=0x7f806c009190 comp rx=0 tx=0).stop 2024-09-19T09:14:55.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.574+0000 7f807d615640 1 -- 172.21.15.18:0/158505302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f807806d810 msgr2=0x7f80781f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:55.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.574+0000 7f807d615640 1 --2- 172.21.15.18:0/158505302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f807806d810 0x7f80781f9110 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f8068009870 tx=0x7f80680046c0 comp rx=0 tx=0).stop 2024-09-19T09:14:55.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.574+0000 7f807d615640 1 -- 172.21.15.18:0/158505302 shutdown_connections 2024-09-19T09:14:55.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.574+0000 7f807d615640 1 --2- 172.21.15.18:0/158505302 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f806406c2b0 0x7f806406e770 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:55.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.574+0000 7f807d615640 1 --2- 172.21.15.18:0/158505302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f807815eb00 0x7f80780b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:55.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.574+0000 7f807d615640 1 --2- 172.21.15.18:0/158505302 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f807806ffd0 0x7f80781561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:55.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.574+0000 7f807d615640 1 --2- 172.21.15.18:0/158505302 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f807806d810 0x7f80781f9110 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:55.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.574+0000 7f807d615640 1 -- 172.21.15.18:0/158505302 >> 172.21.15.18:0/158505302 conn(0x7f807806cd20 msgr2=0x7f80780b19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:55.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.574+0000 7f807d615640 1 -- 172.21.15.18:0/158505302 shutdown_connections 2024-09-19T09:14:55.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:55.574+0000 7f807d615640 1 -- 172.21.15.18:0/158505302 wait complete. 2024-09-19T09:14:55.586 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-19T09:14:55.706 INFO:teuthology.orchestra.run.smithi018.stdout:{"cluster_fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","whoami":0,"id":5187,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":11.680490966000001,"mdsmap_epoch":21,"osdmap_epoch":48,"osdmap_epoch_barrier":48,"uptime":22.671326687000001} 2024-09-19T09:14:55.706 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", "fs_name": "cephfs", "id": 5187, "mdsmap_epoch": 21, "osdmap_epoch": 48, "osdmap_epoch_barrier": 48, "rank_uptime": 11.680490966, "state": "up:active", "uptime": 22.671326687, "want_state": "up:active", "whoami": 0 } 2024-09-19T09:14:55.707 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-19T09:14:55.820 INFO:teuthology.orchestra.run.smithi018.stdout:{"osd_mon_report_interval":"5"} 2024-09-19T09:14:55.821 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-19T09:14:55.821 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2024-09-19T09:14:55.821 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:14:55.821 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:14:55.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:55.838 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2024-09-19T09:14:56.797 INFO:teuthology.orchestra.run.smithi018.stderr:265+0 records in 2024-09-19T09:14:56.797 INFO:teuthology.orchestra.run.smithi018.stderr:265+0 records out 2024-09-19T09:14:56.797 INFO:teuthology.orchestra.run.smithi018.stderr:277872640 bytes (278 MB, 265 MiB) copied, 0.901026 s, 308 MB/s 2024-09-19T09:14:56.798 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:14:56.798 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:14:56.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:14:56.815 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2024-09-19T09:14:57.839 INFO:teuthology.orchestra.run.smithi018.stderr:292+0 records in 2024-09-19T09:14:57.839 INFO:teuthology.orchestra.run.smithi018.stderr:292+0 records out 2024-09-19T09:14:57.839 INFO:teuthology.orchestra.run.smithi018.stderr:306184192 bytes (306 MB, 292 MiB) copied, 0.966025 s, 317 MB/s 2024-09-19T09:14:57.839 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2024-09-19T09:14:57.839 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-19T09:14:57.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.941+0000 7ff7d10d7640 1 Processor -- start 2024-09-19T09:14:57.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.941+0000 7ff7d10d7640 1 -- start start 2024-09-19T09:14:57.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.942+0000 7ff7d10d7640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff7cc06bc10 0x7ff7cc06bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:57.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.942+0000 7ff7d10d7640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7cc06c530 con 0x7ff7cc145e80 2024-09-19T09:14:57.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.942+0000 7ff7d10d7640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7cc06e550 con 0x7ff7cc0d1500 2024-09-19T09:14:57.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.942+0000 7ff7d10d7640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff7cc0704e0 con 0x7ff7cc06bc10 2024-09-19T09:14:57.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.942+0000 7ff7ca59c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff7cc145e80 0x7ff7cc15d0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:47308/0 (socket says 172.21.15.18:47308) 2024-09-19T09:14:57.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.942+0000 7ff7ca59c640 1 -- 172.21.15.18:0/3811176033 learned_addr learned my addr 172.21.15.18:0/3811176033 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:14:57.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.942+0000 7ff7cad9d640 1 --2- 172.21.15.18:0/3811176033 >> v2:172.21.15.162:3300/0 conn(0x7ff7cc06bc10 0x7ff7cc06bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:57.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.942+0000 7ff7c9d9b640 1 -- 172.21.15.18:0/3811176033 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3904701891 0 0) 0x7ff7cc06c530 con 0x7ff7cc145e80 2024-09-19T09:14:57.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.942+0000 7ff7c9d9b640 1 -- 172.21.15.18:0/3811176033 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7b4003520 con 0x7ff7cc145e80 2024-09-19T09:14:57.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.942+0000 7ff7c9d9b640 1 -- 172.21.15.18:0/3811176033 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2432307230 0 0) 0x7ff7b4003520 con 0x7ff7cc145e80 2024-09-19T09:14:57.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.942+0000 7ff7c9d9b640 1 -- 172.21.15.18:0/3811176033 >> v2:172.21.15.162:3300/0 conn(0x7ff7cc06bc10 msgr2=0x7ff7cc06bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:57.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.942+0000 7ff7c9d9b640 1 --2- 172.21.15.18:0/3811176033 >> v2:172.21.15.162:3300/0 conn(0x7ff7cc06bc10 0x7ff7cc06bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:57.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.942+0000 7ff7c9d9b640 1 -- 172.21.15.18:0/3811176033 >> v1:172.21.15.162:6789/0 conn(0x7ff7cc0d1500 legacy=0x7ff7cc0d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:57.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.942+0000 7ff7c9d9b640 1 -- 172.21.15.18:0/3811176033 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7cc06e830 con 0x7ff7cc145e80 2024-09-19T09:14:57.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.942+0000 7ff7c9d9b640 1 -- 172.21.15.18:0/3811176033 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7ff7c0001670 con 0x7ff7cc145e80 2024-09-19T09:14:57.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.942+0000 7ff7cad9d640 1 --2- 172.21.15.18:0/3811176033 >> v2:172.21.15.162:3300/0 conn(0x7ff7cc06bc10 0x7ff7cc06bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:14:57.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.942+0000 7ff7c9d9b640 1 -- 172.21.15.18:0/3811176033 >> v1:172.21.15.18:6789/0 conn(0x7ff7cc145e80 legacy=0x7ff7cc15d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:57.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.943+0000 7ff7c9d9b640 1 --2- 172.21.15.18:0/3811176033 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7b40039b0 0x7ff7b4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:57.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.943+0000 7ff7c9d9b640 1 --2- 172.21.15.18:0/3811176033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7b4004800 0x7ff7b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:57.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.943+0000 7ff7c9d9b640 1 --2- 172.21.15.18:0/3811176033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7b40051c0 0x7ff7b400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:57.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.943+0000 7ff7c9d9b640 1 -- 172.21.15.18:0/3811176033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff7cc0704e0 con 0x7ff7b4004800 2024-09-19T09:14:57.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.943+0000 7ff7c9d9b640 1 -- 172.21.15.18:0/3811176033 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff7b400c160 con 0x7ff7b40051c0 2024-09-19T09:14:57.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.943+0000 7ff7c9d9b640 1 -- 172.21.15.18:0/3811176033 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff7b400c360 con 0x7ff7b40039b0 2024-09-19T09:14:57.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.943+0000 7ff7ca59c640 1 --2- 172.21.15.18:0/3811176033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7b4004800 0x7ff7b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:57.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.943+0000 7ff7cb59e640 1 --2- 172.21.15.18:0/3811176033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7b40051c0 0x7ff7b400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:57.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.943+0000 7ff7cad9d640 1 --2- 172.21.15.18:0/3811176033 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7b40039b0 0x7ff7b4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:57.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.943+0000 7ff7ca59c640 1 -- 172.21.15.18:0/3811176033 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7b40039b0 msgr2=0x7ff7b4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:57.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.943+0000 7ff7ca59c640 1 --2- 172.21.15.18:0/3811176033 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7b40039b0 0x7ff7b4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:57.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.943+0000 7ff7ca59c640 1 -- 172.21.15.18:0/3811176033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7b40051c0 msgr2=0x7ff7b400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:14:57.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.943+0000 7ff7ca59c640 1 --2- 172.21.15.18:0/3811176033 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7b40051c0 0x7ff7b400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:57.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.943+0000 7ff7ca59c640 1 -- 172.21.15.18:0/3811176033 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b4003520 con 0x7ff7b4004800 2024-09-19T09:14:57.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.943+0000 7ff7cb59e640 1 -- 172.21.15.18:0/3811176033 reap_dead start 2024-09-19T09:14:57.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.943+0000 7ff7cad9d640 1 --2- 172.21.15.18:0/3811176033 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7b40039b0 0x7ff7b4003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:14:57.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.944+0000 7ff7ca59c640 1 --2- 172.21.15.18:0/3811176033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7b4004800 0x7ff7b4004c80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000c210 tx=0x7ff7b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c8de68a3e32a5b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:57.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.944+0000 7ff7c9d9b640 1 -- 172.21.15.18:0/3811176033 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0007d30 con 0x7ff7b4004800 2024-09-19T09:14:57.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.944+0000 7ff7c9d9b640 1 -- 172.21.15.18:0/3811176033 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7c0005ad0 con 0x7ff7b4004800 2024-09-19T09:14:57.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.944+0000 7ff7c9d9b640 1 -- 172.21.15.18:0/3811176033 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0007070 con 0x7ff7b4004800 2024-09-19T09:14:57.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.944+0000 7ff7d10d7640 1 -- 172.21.15.18:0/3811176033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7b4004800 msgr2=0x7ff7b4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:57.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.944+0000 7ff7d10d7640 1 --2- 172.21.15.18:0/3811176033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7b4004800 0x7ff7b4004c80 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000c210 tx=0x7ff7b4005830 comp rx=0 tx=0).stop 2024-09-19T09:14:57.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.944+0000 7ff7d10d7640 1 -- 172.21.15.18:0/3811176033 shutdown_connections 2024-09-19T09:14:57.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.944+0000 7ff7d10d7640 1 --2- 172.21.15.18:0/3811176033 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7b4004800 0x7ff7b4004c80 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:57.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.944+0000 7ff7d10d7640 1 -- 172.21.15.18:0/3811176033 >> 172.21.15.18:0/3811176033 conn(0x7ff7cc06cd20 msgr2=0x7ff7cc06d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:57.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.944+0000 7ff7d10d7640 1 -- 172.21.15.18:0/3811176033 shutdown_connections 2024-09-19T09:14:57.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.944+0000 7ff7d10d7640 1 -- 172.21.15.18:0/3811176033 wait complete. 2024-09-19T09:14:57.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.946+0000 7ff7d10d7640 1 Processor -- start 2024-09-19T09:14:57.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.946+0000 7ff7d10d7640 1 -- start start 2024-09-19T09:14:57.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.947+0000 7ff7d10d7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7b4004800 0x7ff7cc1e1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:57.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.947+0000 7ff7d10d7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7cc1f5940 0x7ff7cc1e2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:57.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.947+0000 7ff7d10d7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7cc13ede0 0x7ff7cc0afa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:57.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.947+0000 7ff7d10d7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff7cc06feb0 con 0x7ff7b4004800 2024-09-19T09:14:57.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.947+0000 7ff7d10d7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff7cc0b0f80 con 0x7ff7cc1f5940 2024-09-19T09:14:57.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.947+0000 7ff7d10d7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff7cc06d880 con 0x7ff7cc13ede0 2024-09-19T09:14:57.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.947+0000 7ff7cad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7b4004800 0x7ff7cc1e1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:57.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.947+0000 7ff7cad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7b4004800 0x7ff7cc1e1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43352/0 (socket says 172.21.15.18:43352) 2024-09-19T09:14:57.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.947+0000 7ff7cad9d640 1 -- 172.21.15.18:0/1719920444 learned_addr learned my addr 172.21.15.18:0/1719920444 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:14:57.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.947+0000 7ff7ca59c640 1 --2- 172.21.15.18:0/1719920444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7cc1f5940 0x7ff7cc1e2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:57.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.947+0000 7ff7cb59e640 1 --2- 172.21.15.18:0/1719920444 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7cc13ede0 0x7ff7cc0afa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:57.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.947+0000 7ff7cad9d640 1 -- 172.21.15.18:0/1719920444 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7cc13ede0 msgr2=0x7ff7cc0afa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:57.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.947+0000 7ff7cad9d640 1 --2- 172.21.15.18:0/1719920444 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7cc13ede0 0x7ff7cc0afa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:57.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.947+0000 7ff7cad9d640 1 -- 172.21.15.18:0/1719920444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7cc1f5940 msgr2=0x7ff7cc1e2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:57.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.947+0000 7ff7cad9d640 1 --2- 172.21.15.18:0/1719920444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7cc1f5940 0x7ff7cc1e2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:57.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.947+0000 7ff7cad9d640 1 -- 172.21.15.18:0/1719920444 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7cc1f5dc0 con 0x7ff7b4004800 2024-09-19T09:14:57.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.947+0000 7ff7cad9d640 1 --2- 172.21.15.18:0/1719920444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7b4004800 0x7ff7cc1e1d50 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc011830 tx=0x7ff7bc011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:57.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.947+0000 7ff7b37fe640 1 -- 172.21.15.18:0/1719920444 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc00f9c0 con 0x7ff7b4004800 2024-09-19T09:14:57.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.948+0000 7ff7b37fe640 1 -- 172.21.15.18:0/1719920444 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7bc00fb60 con 0x7ff7b4004800 2024-09-19T09:14:57.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.948+0000 7ff7d10d7640 1 -- 172.21.15.18:0/1719920444 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7cc1e2410 con 0x7ff7b4004800 2024-09-19T09:14:57.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.948+0000 7ff7b37fe640 1 -- 172.21.15.18:0/1719920444 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7bc015460 con 0x7ff7b4004800 2024-09-19T09:14:57.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.948+0000 7ff7d10d7640 1 -- 172.21.15.18:0/1719920444 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7cc1e4ae0 con 0x7ff7b4004800 2024-09-19T09:14:57.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.949+0000 7ff7d10d7640 1 -- 172.21.15.18:0/1719920444 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7cc1463d0 con 0x7ff7b4004800 2024-09-19T09:14:57.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.949+0000 7ff7b37fe640 1 -- 172.21.15.18:0/1719920444 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff7bc015600 con 0x7ff7b4004800 2024-09-19T09:14:57.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.950+0000 7ff7b37fe640 1 --2- 172.21.15.18:0/1719920444 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff7b806c2b0 0x7ff7b806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:14:57.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.950+0000 7ff7b37fe640 1 -- 172.21.15.18:0/1719920444 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5709+0+0 (secure 0 0 0) 0x7ff7bc08bc90 con 0x7ff7b4004800 2024-09-19T09:14:57.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.950+0000 7ff7ca59c640 1 --2- 172.21.15.18:0/1719920444 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff7b806c2b0 0x7ff7b806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:14:57.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.950+0000 7ff7ca59c640 1 --2- 172.21.15.18:0/1719920444 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff7b806c2b0 0x7ff7b806e770 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0033000 tx=0x7ff7c002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:14:57.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:57.954+0000 7ff7b37fe640 1 -- 172.21.15.18:0/1719920444 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff7bc019030 con 0x7ff7b4004800 2024-09-19T09:14:58.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:58.131+0000 7ff7d10d7640 1 -- 172.21.15.18:0/1719920444 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7ff7cc1e2720 con 0x7ff7b4004800 2024-09-19T09:14:58.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:58.132+0000 7ff7b37fe640 1 -- 172.21.15.18:0/1719920444 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v48) ==== 81+0+34212 (secure 0 0 0) 0x7ff7bc059e40 con 0x7ff7b4004800 2024-09-19T09:14:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:14:58.133 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:14:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 48, 2024-09-19T09:14:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:14:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-19T09:13:11.348786+0000", 2024-09-19T09:14:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-19T09:14:45.016527+0000", 2024-09-19T09:14:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-19T09:13:16.423937+0000", 2024-09-19T09:14:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-19T09:13:13.417141+0000", 2024-09-19T09:14:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-19T09:14:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-09-19T09:14:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-19T09:14:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-19T09:14:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-19T09:14:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-19T09:14:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-19T09:14:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:14:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-19T09:14:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.69999998807907104, 2024-09-19T09:14:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-19T09:14:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-19T09:14:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-19T09:14:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 7, 2024-09-19T09:14:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-19T09:14:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-19T09:14:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "jewel", 2024-09-19T09:14:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-19T09:14:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-19T09:14:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-19T09:14:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-19T09:14:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-19T09:14:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:13:17.564717+0000", 2024-09-19T09:14:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:14:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:14:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:14:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:14:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:14:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:14:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:14:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:14:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:14:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:14:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:14:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:14:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:14:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-19T09:14:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-19T09:14:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-19T09:14:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-19T09:14:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-19T09:14:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:14:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:14:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:14:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:14:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:14:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:14:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:14:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "17", 2024-09-19T09:14:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:14:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:14:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:14:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:14:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:14:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:14:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:14:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:14:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:14:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:14:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:14:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:14:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:14:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:14:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:14:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:14:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:14:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:14:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:14:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:14:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:14:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:14:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:14:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:14:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:14:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:14:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:14:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:14:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:14:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:14:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:14:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:14:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:14:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:14:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:14:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:14:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:14:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:14:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-19T09:14:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-19T09:14:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:14:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-19T09:14:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:14:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:14:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-19T09:14:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-19T09:14:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-19T09:14:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-19T09:14:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-19T09:14:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:14:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:14:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:14:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 6, 2024-09-19T09:14:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_metadata", 2024-09-19T09:14:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:14:41.948276+0000", 2024-09-19T09:14:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:14:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:14:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:14:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:14:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:14:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:14:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:14:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:14:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:14:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:14:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:14:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:14:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:14:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-19T09:14:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-19T09:14:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-19T09:14:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-19T09:14:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-19T09:14:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:14:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:14:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:14:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:14:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:14:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:14:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:14:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "47", 2024-09-19T09:14:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:14:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:14:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:14:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:14:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:14:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:14:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:14:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:14:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:14:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:14:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:14:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:14:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:14:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:14:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:14:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:14:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:14:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:14:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:14:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:14:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:14:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:14:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:14:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:14:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:14:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:14:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:14:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:14:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:14:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:14:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:14:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:14:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:14:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:14:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:14:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:14:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:14:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:14:58.147 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4, 2024-09-19T09:14:58.147 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 16, 2024-09-19T09:14:58.147 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_priority": 5 2024-09-19T09:14:58.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.147 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:14:58.147 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:14:58.147 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": "cephfs" 2024-09-19T09:14:58.147 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.147 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:14:58.147 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:14:58.147 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.5, 2024-09-19T09:14:58.147 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.5, 2024-09-19T09:14:58.147 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:14:58.148 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.5, 2024-09-19T09:14:58.148 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.5, 2024-09-19T09:14:58.148 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:14:58.148 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:14:58.148 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:14:58.148 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.148 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 7, 2024-09-19T09:14:58.148 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_data", 2024-09-19T09:14:58.148 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:14:42.341949+0000", 2024-09-19T09:14:58.148 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:14:58.148 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:14:58.148 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:14:58.149 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:14:58.149 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:14:58.149 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:14:58.149 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:14:58.149 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:14:58.149 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:14:58.149 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:14:58.149 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:14:58.149 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:14:58.149 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:14:58.149 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 64, 2024-09-19T09:14:58.149 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 64, 2024-09-19T09:14:58.149 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 64, 2024-09-19T09:14:58.149 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 64, 2024-09-19T09:14:58.150 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 64, 2024-09-19T09:14:58.150 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:14:58.150 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:14:58.150 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:14:58.150 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:14:58.150 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:14:58.150 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:14:58.150 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:14:58.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.150 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "48", 2024-09-19T09:14:58.150 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:14:58.150 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:14:58.150 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:14:58.150 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:14:58.150 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:14:58.151 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:14:58.151 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:14:58.151 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:14:58.151 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:14:58.151 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:14:58.151 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:14:58.151 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:14:58.151 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:14:58.151 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:14:58.151 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:14:58.151 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:14:58.151 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:14:58.151 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:14:58.151 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:14:58.152 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:14:58.152 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:14:58.152 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:14:58.152 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:14:58.152 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:14:58.152 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:14:58.152 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:14:58.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.152 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:14:58.152 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:14:58.152 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:14:58.152 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:14:58.152 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:14:58.152 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:14:58.152 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:14:58.153 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:14:58.153 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:14:58.153 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:14:58.153 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:14:58.153 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:14:58.153 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 64, 2024-09-19T09:14:58.153 INFO:teuthology.orchestra.run.smithi018.stdout: "target_size_ratio": 0.89999997615814209 2024-09-19T09:14:58.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.153 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:14:58.153 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:14:58.153 INFO:teuthology.orchestra.run.smithi018.stdout: "data": "cephfs" 2024-09-19T09:14:58.153 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.153 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:14:58.154 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:14:58.154 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.75, 2024-09-19T09:14:58.154 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.75, 2024-09-19T09:14:58.154 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:14:58.154 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.75, 2024-09-19T09:14:58.154 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.75, 2024-09-19T09:14:58.154 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:14:58.154 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:14:58.154 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:14:58.154 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.154 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.154 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:14:58.154 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-19T09:14:58.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.155 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:14:58.155 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:14:58.155 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:14:58.155 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:14:58.155 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:14:58.155 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:14:58.155 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:14:58.155 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:14:58.155 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:14:58.155 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:14:58.155 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:14:58.155 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:14:58.155 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:14:58.155 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.156 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.156 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-19T09:14:58.156 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:14:58.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.156 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.156 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-19T09:14:58.156 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:14:58.156 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.156 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.156 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:14:58.157 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.157 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.157 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-19T09:14:58.157 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:14:58.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.157 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.157 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.157 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-19T09:14:58.157 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:14:58.157 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.157 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.158 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:14:58.158 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.158 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.158 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-19T09:14:58.158 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:14:58.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.158 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.158 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-19T09:14:58.158 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:14:58.158 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.158 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.159 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:14:58.159 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.159 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.159 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-19T09:14:58.159 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:14:58.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.159 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.159 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-19T09:14:58.159 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:14:58.159 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.159 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.160 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/128722874", 2024-09-19T09:14:58.160 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/128722874", 2024-09-19T09:14:58.160 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/128722874", 2024-09-19T09:14:58.160 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/128722874", 2024-09-19T09:14:58.160 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:14:58.160 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:14:58.160 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:14:58.160 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.160 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:14:58.160 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:14:58.160 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:14:58.161 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:14:58.161 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:14:58.161 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:14:58.161 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:14:58.161 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:14:58.161 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:14:58.161 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:14:58.161 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:14:58.161 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:14:58.161 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:14:58.161 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.161 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.162 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-19T09:14:58.162 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:14:58.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.162 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.162 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-19T09:14:58.162 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:14:58.162 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.162 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.162 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:14:58.162 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.162 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.162 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-19T09:14:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:14:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-19T09:14:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:14:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:14:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.163 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-19T09:14:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:14:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-19T09:14:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:14:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:14:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.164 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-19T09:14:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:14:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-19T09:14:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:14:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/3672199638", 2024-09-19T09:14:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/3672199638", 2024-09-19T09:14:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/3672199638", 2024-09-19T09:14:58.165 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/3672199638", 2024-09-19T09:14:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:14:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:14:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:14:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:14:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:14:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:14:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:14:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:14:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:14:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:14:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:14:58.166 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:14:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:14:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:14:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:14:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:14:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T09:14:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:14:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T09:14:58.167 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:14:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:14:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-19T09:14:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:14:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-19T09:14:58.168 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:14:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:14:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-19T09:14:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:14:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-19T09:14:58.169 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:14:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:14:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-19T09:14:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:14:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-19T09:14:58.170 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:14:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3463367841", 2024-09-19T09:14:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3463367841", 2024-09-19T09:14:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3463367841", 2024-09-19T09:14:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3463367841", 2024-09-19T09:14:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:14:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:14:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:14:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:14:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:14:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:14:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:14:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:14:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:14:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:14:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:14:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:14:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:14:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:14:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:14:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:14:58.172 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-19T09:14:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:14:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-19T09:14:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:14:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:14:58.173 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-19T09:14:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:14:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-19T09:14:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:14:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:14:58.174 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-19T09:14:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:14:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-19T09:14:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:14:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:14:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.175 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-19T09:14:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:14:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-19T09:14:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:14:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/4163178582", 2024-09-19T09:14:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/4163178582", 2024-09-19T09:14:58.176 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/4163178582", 2024-09-19T09:14:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/4163178582", 2024-09-19T09:14:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:14:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:14:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:14:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:14:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:14:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:14:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:14:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:14:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:14:58.177 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:14:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:14:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:14:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:14:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:14:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:14:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:14:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6822", 2024-09-19T09:14:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:14:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.178 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6824", 2024-09-19T09:14:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:14:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:14:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6826", 2024-09-19T09:14:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:14:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.179 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6827", 2024-09-19T09:14:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:14:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:14:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6830", 2024-09-19T09:14:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:14:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6831", 2024-09-19T09:14:58.180 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:14:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:14:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6828", 2024-09-19T09:14:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:14:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.181 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6829", 2024-09-19T09:14:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:14:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6824/3538482215", 2024-09-19T09:14:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6827/3538482215", 2024-09-19T09:14:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6831/3538482215", 2024-09-19T09:14:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6829/3538482215", 2024-09-19T09:14:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:14:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:14:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:14:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.182 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:14:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:14:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:14:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:14:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:14:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:14:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:14:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:14:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:14:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:14:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:14:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:14:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:14:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6800", 2024-09-19T09:14:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:14:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6801", 2024-09-19T09:14:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:14:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:14:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6802", 2024-09-19T09:14:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:14:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6803", 2024-09-19T09:14:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:14:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:14:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6806", 2024-09-19T09:14:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:14:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6807", 2024-09-19T09:14:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:14:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:14:58.186 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6804", 2024-09-19T09:14:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:14:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6805", 2024-09-19T09:14:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:14:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6801/2408698413", 2024-09-19T09:14:58.187 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6803/2408698413", 2024-09-19T09:14:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6807/2408698413", 2024-09-19T09:14:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6805/2408698413", 2024-09-19T09:14:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:14:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:14:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:14:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:14:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:14:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:14:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:14:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:14:58.188 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:14:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:14:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:14:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:14:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:14:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:14:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:14:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:14:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6808", 2024-09-19T09:14:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:14:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6809", 2024-09-19T09:14:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:14:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:14:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6810", 2024-09-19T09:14:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:14:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6811", 2024-09-19T09:14:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:14:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:14:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6814", 2024-09-19T09:14:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:14:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6815", 2024-09-19T09:14:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:14:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:14:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6812", 2024-09-19T09:14:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:14:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6813", 2024-09-19T09:14:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:14:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6809/2596207948", 2024-09-19T09:14:58.193 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6811/2596207948", 2024-09-19T09:14:58.194 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6815/2596207948", 2024-09-19T09:14:58.194 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6813/2596207948", 2024-09-19T09:14:58.194 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:14:58.194 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:14:58.194 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:14:58.194 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.194 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.194 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:14:58.194 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:14:58.194 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:14:58.194 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:14:58.194 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:14:58.194 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:14:58.195 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:14:58.195 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:14:58.195 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:14:58.195 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:14:58.195 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:14:58.195 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:14:58.195 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:14:58.195 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.195 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.195 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6816", 2024-09-19T09:14:58.195 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:14:58.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.196 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.196 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6817", 2024-09-19T09:14:58.196 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:14:58.196 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.196 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.196 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:14:58.196 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.196 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.196 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6818", 2024-09-19T09:14:58.196 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:14:58.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.197 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.197 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6819", 2024-09-19T09:14:58.197 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:14:58.197 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.197 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.197 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:14:58.197 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.197 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.197 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6823", 2024-09-19T09:14:58.197 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:14:58.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.198 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.198 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6825", 2024-09-19T09:14:58.198 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:14:58.198 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.198 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.198 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:14:58.198 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:14:58.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.198 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:14:58.198 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6820", 2024-09-19T09:14:58.198 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:14:58.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:14:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6821", 2024-09-19T09:14:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:14:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6817/1334618296", 2024-09-19T09:14:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6819/1334618296", 2024-09-19T09:14:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6825/1334618296", 2024-09-19T09:14:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6821/1334618296", 2024-09-19T09:14:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:14:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:14:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:14:58.199 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:14:58.200 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.200 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:14:58.200 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-19T09:14:58.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.200 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:14:58.200 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:14:58.200 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:14:58.200 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:14:58.200 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:14:58.200 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:14:58.200 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.580838+0000", 2024-09-19T09:14:58.200 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:14:58.200 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.201 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:14:58.201 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:14:58.201 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:14:58.201 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:14:58.201 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:14:58.201 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:14:58.201 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.599990+0000", 2024-09-19T09:14:58.201 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:14:58.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.201 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:14:58.201 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:14:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:14:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:14:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:14:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:14:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.503722+0000", 2024-09-19T09:14:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:14:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:14:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:14:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:14:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:14:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:14:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:14:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.607846+0000", 2024-09-19T09:14:58.202 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:14:58.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.203 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:14:58.203 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:14:58.203 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:14:58.203 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:14:58.203 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:14:58.203 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:14:58.203 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.616858+0000", 2024-09-19T09:14:58.203 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:14:58.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.203 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:14:58.203 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:14:58.204 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:14:58.204 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:14:58.204 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:14:58.204 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:14:58.204 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.542726+0000", 2024-09-19T09:14:58.204 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:14:58.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.204 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:14:58.204 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:14:58.204 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:14:58.204 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:14:58.204 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:14:58.204 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:14:58.205 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.534178+0000", 2024-09-19T09:14:58.205 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:14:58.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:14:58.205 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:14:58.205 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:14:58.205 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:14:58.205 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:14:58.205 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:14:58.205 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:14:58.205 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.612105+0000", 2024-09-19T09:14:58.205 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:14:58.205 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.206 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:14:58.206 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-19T09:14:58.206 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-19T09:14:58.206 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-19T09:14:58.206 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-19T09:14:58.206 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-19T09:14:58.206 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-19T09:14:58.206 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-19T09:14:58.206 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-19T09:14:58.206 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-19T09:14:58.206 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-19T09:14:58.206 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-19T09:14:58.206 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-19T09:14:58.206 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-19T09:14:58.207 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-19T09:14:58.207 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:14:58.207 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-19T09:14:58.207 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-19T09:14:58.207 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-19T09:14:58.207 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-19T09:14:58.207 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-19T09:14:58.207 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-19T09:14:58.207 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-19T09:14:58.207 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-19T09:14:58.207 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-19T09:14:58.207 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-19T09:14:58.208 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-19T09:14:58.208 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:14:58.208 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:14:58.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:58.134+0000 7ff7d10d7640 1 -- 172.21.15.18:0/1719920444 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff7b806c2b0 msgr2=0x7ff7b806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:58.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:58.134+0000 7ff7d10d7640 1 --2- 172.21.15.18:0/1719920444 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff7b806c2b0 0x7ff7b806e770 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0033000 tx=0x7ff7c002e000 comp rx=0 tx=0).stop 2024-09-19T09:14:58.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:58.134+0000 7ff7d10d7640 1 -- 172.21.15.18:0/1719920444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7b4004800 msgr2=0x7ff7cc1e1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:14:58.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:58.134+0000 7ff7d10d7640 1 --2- 172.21.15.18:0/1719920444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7b4004800 0x7ff7cc1e1d50 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc011830 tx=0x7ff7bc011cf0 comp rx=0 tx=0).stop 2024-09-19T09:14:58.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:58.134+0000 7ff7d10d7640 1 -- 172.21.15.18:0/1719920444 shutdown_connections 2024-09-19T09:14:58.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:58.134+0000 7ff7d10d7640 1 --2- 172.21.15.18:0/1719920444 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff7b806c2b0 0x7ff7b806e770 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:58.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:58.134+0000 7ff7d10d7640 1 --2- 172.21.15.18:0/1719920444 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7cc13ede0 0x7ff7cc0afa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:58.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:58.134+0000 7ff7d10d7640 1 --2- 172.21.15.18:0/1719920444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7cc1f5940 0x7ff7cc1e2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:58.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:58.134+0000 7ff7d10d7640 1 --2- 172.21.15.18:0/1719920444 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7b4004800 0x7ff7cc1e1d50 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:14:58.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:58.134+0000 7ff7d10d7640 1 -- 172.21.15.18:0/1719920444 >> 172.21.15.18:0/1719920444 conn(0x7ff7cc06cd20 msgr2=0x7ff7cc15c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:14:58.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:58.134+0000 7ff7d10d7640 1 -- 172.21.15.18:0/1719920444 shutdown_connections 2024-09-19T09:14:58.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:14:58.134+0000 7ff7d10d7640 1 -- 172.21.15.18:0/1719920444 wait complete. 2024-09-19T09:14:58.211 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-19T09:14:59.054 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-19T09:14:59.053+0000 7fca8cfa1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2024-09-19T09:15:00.187 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:15:00.189 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:15:03.212 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-19T09:15:03.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.326+0000 7fc0639c4640 1 Processor -- start 2024-09-19T09:15:03.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.326+0000 7fc0639c4640 1 -- start start 2024-09-19T09:15:03.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.327+0000 7fc0639c4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc05c15eb00 0x7fc05c1630d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:03.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.327+0000 7fc0639c4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc05c06d810 0x7fc05c0b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:03.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.327+0000 7fc0639c4640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc05c06ffd0 0x7fc05c0b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:03.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.327+0000 7fc0639c4640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fc05c06e730 con 0x7fc05c15eb00 2024-09-19T09:15:03.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.327+0000 7fc0639c4640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc05c06ea10 con 0x7fc05c06ffd0 2024-09-19T09:15:03.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.327+0000 7fc0639c4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc05c1628d0 con 0x7fc05c06d810 2024-09-19T09:15:03.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.327+0000 7fc061760640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc05c15eb00 0x7fc05c1630d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:03.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.327+0000 7fc061760640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc05c15eb00 0x7fc05c1630d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43366/0 (socket says 172.21.15.18:43366) 2024-09-19T09:15:03.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.327+0000 7fc061760640 1 -- 172.21.15.18:0/1561889393 learned_addr learned my addr 172.21.15.18:0/1561889393 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:03.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.327+0000 7fc061f61640 1 --2- 172.21.15.18:0/1561889393 >> v2:172.21.15.162:3300/0 conn(0x7fc05c06ffd0 0x7fc05c0b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:03.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.327+0000 7fc060f5f640 1 --2- 172.21.15.18:0/1561889393 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc05c06d810 0x7fc05c0b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:03.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.327+0000 7fc061760640 1 -- 172.21.15.18:0/1561889393 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc05c06d810 msgr2=0x7fc05c0b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:03.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.327+0000 7fc061760640 1 --2- 172.21.15.18:0/1561889393 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc05c06d810 0x7fc05c0b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:03.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.327+0000 7fc061760640 1 -- 172.21.15.18:0/1561889393 >> v2:172.21.15.162:3300/0 conn(0x7fc05c06ffd0 msgr2=0x7fc05c0b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:03.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.327+0000 7fc061760640 1 --2- 172.21.15.18:0/1561889393 >> v2:172.21.15.162:3300/0 conn(0x7fc05c06ffd0 0x7fc05c0b0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:03.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.327+0000 7fc061760640 1 -- 172.21.15.18:0/1561889393 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc05c162bb0 con 0x7fc05c15eb00 2024-09-19T09:15:03.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.327+0000 7fc060f5f640 1 --2- 172.21.15.18:0/1561889393 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc05c06d810 0x7fc05c0b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:15:03.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.328+0000 7fc061760640 1 --2- 172.21.15.18:0/1561889393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc05c15eb00 0x7fc05c1630d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc05c06f830 tx=0x7fc05802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ea48885adb407 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:03.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.328+0000 7fc053fff640 1 -- 172.21.15.18:0/1561889393 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc058037070 con 0x7fc05c15eb00 2024-09-19T09:15:03.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.328+0000 7fc053fff640 1 -- 172.21.15.18:0/1561889393 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc058032440 con 0x7fc05c15eb00 2024-09-19T09:15:03.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.328+0000 7fc053fff640 1 -- 172.21.15.18:0/1561889393 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc058032810 con 0x7fc05c15eb00 2024-09-19T09:15:03.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.329+0000 7fc0639c4640 1 -- 172.21.15.18:0/1561889393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc05c15eb00 msgr2=0x7fc05c1630d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:03.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.329+0000 7fc0639c4640 1 --2- 172.21.15.18:0/1561889393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc05c15eb00 0x7fc05c1630d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fc05c06f830 tx=0x7fc05802a140 comp rx=0 tx=0).stop 2024-09-19T09:15:03.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.329+0000 7fc0639c4640 1 -- 172.21.15.18:0/1561889393 shutdown_connections 2024-09-19T09:15:03.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.329+0000 7fc0639c4640 1 --2- 172.21.15.18:0/1561889393 >> v2:172.21.15.162:3300/0 conn(0x7fc05c06ffd0 0x7fc05c0b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:03.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.329+0000 7fc0639c4640 1 --2- 172.21.15.18:0/1561889393 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc05c06d810 0x7fc05c0b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:03.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.329+0000 7fc0639c4640 1 --2- 172.21.15.18:0/1561889393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc05c15eb00 0x7fc05c1630d0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:03.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.329+0000 7fc0639c4640 1 -- 172.21.15.18:0/1561889393 >> 172.21.15.18:0/1561889393 conn(0x7fc05c06cd20 msgr2=0x7fc05c06d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:03.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.329+0000 7fc0639c4640 1 -- 172.21.15.18:0/1561889393 shutdown_connections 2024-09-19T09:15:03.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.329+0000 7fc0639c4640 1 -- 172.21.15.18:0/1561889393 wait complete. 2024-09-19T09:15:03.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.330+0000 7fc0639c4640 1 Processor -- start 2024-09-19T09:15:03.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.330+0000 7fc0639c4640 1 -- start start 2024-09-19T09:15:03.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.331+0000 7fc0639c4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc05c06d810 0x7fc05c15d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:03.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.331+0000 7fc0639c4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc05c06ffd0 0x7fc05c14e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:03.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.331+0000 7fc0639c4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc05c15eb00 0x7fc05c15fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:03.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.331+0000 7fc0639c4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc05c0d15e0 con 0x7fc05c06d810 2024-09-19T09:15:03.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.331+0000 7fc0639c4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc05c0d1460 con 0x7fc05c15eb00 2024-09-19T09:15:03.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.331+0000 7fc0639c4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc05c0d1760 con 0x7fc05c06ffd0 2024-09-19T09:15:03.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.331+0000 7fc061760640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc05c06d810 0x7fc05c15d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:03.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.331+0000 7fc061760640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc05c06d810 0x7fc05c15d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43382/0 (socket says 172.21.15.18:43382) 2024-09-19T09:15:03.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.331+0000 7fc061760640 1 -- 172.21.15.18:0/1640578528 learned_addr learned my addr 172.21.15.18:0/1640578528 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:03.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.331+0000 7fc061760640 1 -- 172.21.15.18:0/1640578528 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc05c06ffd0 msgr2=0x7fc05c14e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:03.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.331+0000 7fc061760640 1 --2- 172.21.15.18:0/1640578528 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc05c06ffd0 0x7fc05c14e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:03.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.331+0000 7fc061760640 1 -- 172.21.15.18:0/1640578528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc05c15eb00 msgr2=0x7fc05c15fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:03.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.331+0000 7fc061f61640 1 --2- 172.21.15.18:0/1640578528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc05c15eb00 0x7fc05c15fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:03.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.331+0000 7fc061760640 1 --2- 172.21.15.18:0/1640578528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc05c15eb00 0x7fc05c15fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:03.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.331+0000 7fc061760640 1 -- 172.21.15.18:0/1640578528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc05c15cb40 con 0x7fc05c06d810 2024-09-19T09:15:03.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.331+0000 7fc061760640 1 --2- 172.21.15.18:0/1640578528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc05c06d810 0x7fc05c15d5e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc05802a180 tx=0x7fc0580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:03.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.332+0000 7fc051ffb640 1 -- 172.21.15.18:0/1640578528 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc058041020 con 0x7fc05c06d810 2024-09-19T09:15:03.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.332+0000 7fc051ffb640 1 -- 172.21.15.18:0/1640578528 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0580306c0 con 0x7fc05c06d810 2024-09-19T09:15:03.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.332+0000 7fc051ffb640 1 -- 172.21.15.18:0/1640578528 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc058037040 con 0x7fc05c06d810 2024-09-19T09:15:03.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.332+0000 7fc0639c4640 1 -- 172.21.15.18:0/1640578528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc05c0c6990 con 0x7fc05c06d810 2024-09-19T09:15:03.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.332+0000 7fc0639c4640 1 -- 172.21.15.18:0/1640578528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc05c15cde0 con 0x7fc05c06d810 2024-09-19T09:15:03.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.333+0000 7fc0639c4640 1 -- 172.21.15.18:0/1640578528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc05c1630d0 con 0x7fc05c06d810 2024-09-19T09:15:03.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.334+0000 7fc051ffb640 1 -- 172.21.15.18:0/1640578528 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc058044020 con 0x7fc05c06d810 2024-09-19T09:15:03.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.334+0000 7fc051ffb640 1 --2- 172.21.15.18:0/1640578528 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc04006c2b0 0x7fc04006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:03.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.334+0000 7fc051ffb640 1 -- 172.21.15.18:0/1640578528 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7fc0580abc30 con 0x7fc05c06d810 2024-09-19T09:15:03.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.334+0000 7fc051ffb640 1 -- 172.21.15.18:0/1640578528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=53}) -- 0x7fc040073de0 con 0x7fc05c06d810 2024-09-19T09:15:03.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.334+0000 7fc060f5f640 1 --2- 172.21.15.18:0/1640578528 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc04006c2b0 0x7fc04006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:03.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.335+0000 7fc060f5f640 1 --2- 172.21.15.18:0/1640578528 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc04006c2b0 0x7fc04006e770 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc05c15dd60 tx=0x7fc04c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:03.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.339+0000 7fc051ffb640 1 -- 172.21.15.18:0/1640578528 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc05804b030 con 0x7fc05c06d810 2024-09-19T09:15:03.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.513+0000 7fc0639c4640 1 -- 172.21.15.18:0/1640578528 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fc05c06c8f0 con 0x7fc05c06d810 2024-09-19T09:15:03.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.514+0000 7fc051ffb640 1 -- 172.21.15.18:0/1640578528 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v52) ==== 81+0+34395 (secure 0 0 0) 0x7fc05807a3a0 con 0x7fc05c06d810 2024-09-19T09:15:03.515 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:15:03.515 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:15:03.515 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 52, 2024-09-19T09:15:03.516 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:15:03.516 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-19T09:13:11.348786+0000", 2024-09-19T09:15:03.516 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-19T09:15:02.068577+0000", 2024-09-19T09:15:03.516 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-19T09:13:16.423937+0000", 2024-09-19T09:15:03.516 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-19T09:13:13.417141+0000", 2024-09-19T09:15:03.516 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-19T09:15:03.516 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-09-19T09:15:03.516 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-19T09:15:03.516 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-19T09:15:03.516 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-19T09:15:03.516 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-19T09:15:03.516 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-19T09:15:03.516 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:15:03.517 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-19T09:15:03.517 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.69999998807907104, 2024-09-19T09:15:03.517 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-19T09:15:03.517 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-19T09:15:03.517 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-19T09:15:03.517 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 7, 2024-09-19T09:15:03.517 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-19T09:15:03.517 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-19T09:15:03.517 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "jewel", 2024-09-19T09:15:03.517 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-19T09:15:03.517 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-19T09:15:03.517 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-19T09:15:03.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.518 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-19T09:15:03.518 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-19T09:15:03.518 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:13:17.564717+0000", 2024-09-19T09:15:03.518 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 3, 2024-09-19T09:15:03.518 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full", 2024-09-19T09:15:03.518 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:15:03.518 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:15:03.518 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:15:03.518 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:15:03.518 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:15:03.518 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:15:03.518 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:15:03.518 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:15:03.518 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:15:03.519 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:15:03.519 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:15:03.519 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-19T09:15:03.519 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-19T09:15:03.519 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-19T09:15:03.519 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-19T09:15:03.519 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-19T09:15:03.519 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:15:03.519 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:15:03.519 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:15:03.519 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:15:03.519 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:15:03.519 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:15:03.520 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:15:03.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.520 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "49", 2024-09-19T09:15:03.520 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:15:03.520 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:15:03.520 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:15:03.520 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:15:03.520 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:15:03.520 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:15:03.520 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:15:03.520 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:15:03.520 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:15:03.520 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:15:03.521 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:15:03.521 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:15:03.521 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:15:03.521 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:15:03.521 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:15:03.521 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:15:03.521 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:15:03.521 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:15:03.521 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:15:03.521 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:15:03.521 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:15:03.521 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:15:03.521 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:15:03.521 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:15:03.522 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:15:03.522 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:15:03.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.522 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:15:03.522 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:15:03.522 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:15:03.522 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:15:03.522 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:15:03.522 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:15:03.522 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:15:03.522 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:15:03.522 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:15:03.522 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:15:03.522 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:15:03.523 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:15:03.523 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-19T09:15:03.523 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-19T09:15:03.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.523 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:15:03.523 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-19T09:15:03.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.523 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:15:03.523 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:15:03.523 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-19T09:15:03.523 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-19T09:15:03.523 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-19T09:15:03.523 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-19T09:15:03.524 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-19T09:15:03.524 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:15:03.524 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:15:03.524 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:15:03.524 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.524 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 6, 2024-09-19T09:15:03.524 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_metadata", 2024-09-19T09:15:03.524 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:14:41.948276+0000", 2024-09-19T09:15:03.524 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 3, 2024-09-19T09:15:03.524 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full", 2024-09-19T09:15:03.524 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:15:03.525 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:15:03.525 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:15:03.525 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:15:03.525 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:15:03.525 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:15:03.525 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:15:03.525 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:15:03.525 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:15:03.525 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:15:03.525 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:15:03.525 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-19T09:15:03.525 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-19T09:15:03.525 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-19T09:15:03.525 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-19T09:15:03.526 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-19T09:15:03.526 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:15:03.526 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:15:03.526 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:15:03.526 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:15:03.526 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:15:03.526 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:15:03.526 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:15:03.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.526 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "49", 2024-09-19T09:15:03.526 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:15:03.526 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:15:03.526 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:15:03.527 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:15:03.527 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:15:03.527 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:15:03.527 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:15:03.527 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:15:03.527 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:15:03.527 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:15:03.527 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:15:03.527 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:15:03.527 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:15:03.527 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:15:03.527 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:15:03.527 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:15:03.527 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:15:03.528 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:15:03.528 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:15:03.528 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:15:03.528 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:15:03.528 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:15:03.528 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:15:03.528 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:15:03.528 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:15:03.528 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:15:03.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.528 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:15:03.528 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:15:03.528 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:15:03.528 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:15:03.529 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:15:03.529 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:15:03.529 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:15:03.529 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:15:03.529 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:15:03.529 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:15:03.529 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:15:03.529 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:15:03.529 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4, 2024-09-19T09:15:03.529 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 16, 2024-09-19T09:15:03.529 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_priority": 5 2024-09-19T09:15:03.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.529 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:15:03.530 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:15:03.530 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": "cephfs" 2024-09-19T09:15:03.530 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.530 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:15:03.530 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:15:03.530 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.5, 2024-09-19T09:15:03.530 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.5, 2024-09-19T09:15:03.530 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:15:03.530 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.5, 2024-09-19T09:15:03.530 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.5, 2024-09-19T09:15:03.530 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:15:03.530 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:15:03.530 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:15:03.530 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.531 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 7, 2024-09-19T09:15:03.531 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_data", 2024-09-19T09:15:03.531 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:14:42.341949+0000", 2024-09-19T09:15:03.531 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 3, 2024-09-19T09:15:03.531 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full", 2024-09-19T09:15:03.531 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:15:03.531 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:15:03.531 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:15:03.531 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:15:03.531 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:15:03.531 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:15:03.532 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:15:03.532 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:15:03.532 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:15:03.532 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:15:03.532 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:15:03.532 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 64, 2024-09-19T09:15:03.532 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 64, 2024-09-19T09:15:03.532 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 64, 2024-09-19T09:15:03.532 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 64, 2024-09-19T09:15:03.532 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 64, 2024-09-19T09:15:03.532 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:15:03.532 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:15:03.532 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:15:03.532 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:15:03.533 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:15:03.533 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:15:03.533 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:15:03.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.533 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "49", 2024-09-19T09:15:03.533 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:15:03.533 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:15:03.533 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:15:03.533 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:15:03.533 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:15:03.533 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:15:03.533 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:15:03.533 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:15:03.534 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:15:03.534 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:15:03.534 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:15:03.534 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:15:03.534 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:15:03.534 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:15:03.534 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:15:03.534 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:15:03.534 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:15:03.534 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:15:03.535 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:15:03.535 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:15:03.535 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:15:03.535 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:15:03.535 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:15:03.535 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:15:03.535 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:15:03.535 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:15:03.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.535 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:15:03.535 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:15:03.535 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:15:03.536 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:15:03.536 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:15:03.536 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:15:03.536 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:15:03.536 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:15:03.536 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:15:03.536 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:15:03.536 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:15:03.536 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:15:03.536 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 64, 2024-09-19T09:15:03.536 INFO:teuthology.orchestra.run.smithi018.stdout: "target_size_ratio": 0.89999997615814209 2024-09-19T09:15:03.536 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.536 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:15:03.537 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:15:03.537 INFO:teuthology.orchestra.run.smithi018.stdout: "data": "cephfs" 2024-09-19T09:15:03.537 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.537 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:15:03.537 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:15:03.537 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.75, 2024-09-19T09:15:03.537 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.75, 2024-09-19T09:15:03.537 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:15:03.537 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.75, 2024-09-19T09:15:03.537 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.75, 2024-09-19T09:15:03.537 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:15:03.537 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:15:03.537 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:15:03.538 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.538 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.538 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:15:03.538 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-19T09:15:03.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.538 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:15:03.538 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:03.538 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:03.538 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:03.538 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:03.538 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:03.538 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:03.538 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:03.538 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:03.539 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:03.539 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:03.539 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:03.539 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:03.539 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.539 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.539 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-19T09:15:03.539 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:03.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.539 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.539 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-19T09:15:03.540 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:03.540 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.540 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.540 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:03.540 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.540 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.540 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-19T09:15:03.540 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:03.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.540 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.541 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-19T09:15:03.541 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:03.541 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.541 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.541 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:03.541 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.541 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.541 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-19T09:15:03.541 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:03.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.542 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.542 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-19T09:15:03.542 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:03.542 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.542 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.542 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:03.542 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.542 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.542 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-19T09:15:03.542 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:03.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.543 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.543 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-19T09:15:03.543 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:03.543 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.543 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.543 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/128722874", 2024-09-19T09:15:03.543 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/128722874", 2024-09-19T09:15:03.543 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/128722874", 2024-09-19T09:15:03.543 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/128722874", 2024-09-19T09:15:03.543 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:03.543 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull", 2024-09-19T09:15:03.544 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:03.544 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:03.544 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.544 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:15:03.544 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:03.544 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:03.544 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:03.544 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:03.544 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:03.544 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:03.544 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:03.545 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:03.545 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:03.545 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:03.545 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:03.545 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:03.545 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.545 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.545 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-19T09:15:03.545 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:03.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.545 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.545 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-19T09:15:03.546 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:03.546 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.546 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.546 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:03.546 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.546 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.546 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-19T09:15:03.546 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:03.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.546 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.547 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-19T09:15:03.547 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:03.547 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.547 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.547 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:03.547 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.547 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.547 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-19T09:15:03.547 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:03.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.548 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.548 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-19T09:15:03.548 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:03.548 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.548 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.548 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:03.548 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.548 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.548 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-19T09:15:03.548 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:03.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.549 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.549 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-19T09:15:03.549 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:03.549 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.549 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.549 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/3672199638", 2024-09-19T09:15:03.549 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/3672199638", 2024-09-19T09:15:03.549 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/3672199638", 2024-09-19T09:15:03.549 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/3672199638", 2024-09-19T09:15:03.549 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:03.550 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull", 2024-09-19T09:15:03.550 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:03.550 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:03.550 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.550 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:15:03.550 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:03.550 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:03.550 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:03.550 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:03.550 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:03.550 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:03.550 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:03.551 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:03.551 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:03.551 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:03.551 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:03.551 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:03.551 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.551 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.551 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T09:15:03.551 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:03.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.551 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.551 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T09:15:03.551 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:03.552 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.552 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.552 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:03.552 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.552 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.552 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-19T09:15:03.552 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:03.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.552 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.552 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-19T09:15:03.553 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:03.553 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.553 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.553 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:03.553 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.553 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.553 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-19T09:15:03.553 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:03.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.553 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.554 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-19T09:15:03.554 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:03.554 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.554 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.554 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:03.554 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.554 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.554 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-19T09:15:03.554 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:03.554 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.554 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.555 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.555 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-19T09:15:03.555 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:03.555 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.555 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.555 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3463367841", 2024-09-19T09:15:03.555 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3463367841", 2024-09-19T09:15:03.555 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3463367841", 2024-09-19T09:15:03.555 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3463367841", 2024-09-19T09:15:03.555 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:03.555 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:03.555 INFO:teuthology.orchestra.run.smithi018.stdout: "full", 2024-09-19T09:15:03.555 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:03.555 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.556 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.556 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:15:03.556 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:03.556 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:03.556 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:03.556 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:03.556 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:03.556 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:03.556 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:03.556 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:03.556 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:03.556 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:03.557 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:03.557 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:03.557 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.557 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.557 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-19T09:15:03.557 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:03.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.557 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.557 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-19T09:15:03.557 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:03.557 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.557 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.558 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:03.558 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.558 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.558 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-19T09:15:03.558 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:03.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.558 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.558 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-19T09:15:03.558 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:03.558 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.558 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.559 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:03.559 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.559 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.559 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-19T09:15:03.559 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:03.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.559 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.559 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-19T09:15:03.559 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:03.559 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.560 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.560 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:03.560 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.560 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.560 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-19T09:15:03.560 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:03.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.560 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.560 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-19T09:15:03.560 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:03.561 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.561 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.561 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/4163178582", 2024-09-19T09:15:03.561 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/4163178582", 2024-09-19T09:15:03.561 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/4163178582", 2024-09-19T09:15:03.561 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/4163178582", 2024-09-19T09:15:03.561 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:03.561 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:03.561 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:03.561 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.561 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:15:03.562 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:03.562 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:03.562 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:03.562 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:03.562 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:03.562 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:03.562 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:03.562 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:03.562 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:03.562 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:03.562 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:03.562 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:03.562 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.562 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.563 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6822", 2024-09-19T09:15:03.563 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:03.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.563 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.563 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6824", 2024-09-19T09:15:03.563 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:03.563 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.563 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.563 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.563 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:03.563 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.563 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.563 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.564 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6826", 2024-09-19T09:15:03.564 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:03.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.564 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.564 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6827", 2024-09-19T09:15:03.564 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:03.564 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.564 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.565 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:03.565 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.565 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.565 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6830", 2024-09-19T09:15:03.565 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:03.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.565 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.565 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6831", 2024-09-19T09:15:03.565 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:03.565 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.565 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.566 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:03.566 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.566 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.566 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6828", 2024-09-19T09:15:03.566 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:03.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.566 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.566 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.566 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6829", 2024-09-19T09:15:03.566 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:03.566 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.566 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.567 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6824/3538482215", 2024-09-19T09:15:03.567 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6827/3538482215", 2024-09-19T09:15:03.567 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6831/3538482215", 2024-09-19T09:15:03.567 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6829/3538482215", 2024-09-19T09:15:03.567 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:03.567 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:03.567 INFO:teuthology.orchestra.run.smithi018.stdout: "full", 2024-09-19T09:15:03.567 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:03.567 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.567 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:15:03.568 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:03.568 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:03.568 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:03.568 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:03.568 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:03.568 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:03.568 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:03.568 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:03.568 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:03.568 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:03.568 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:03.568 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:03.568 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.569 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.569 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6800", 2024-09-19T09:15:03.569 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:03.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.569 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.569 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6801", 2024-09-19T09:15:03.569 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:03.569 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.569 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.569 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:03.569 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.570 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.570 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6802", 2024-09-19T09:15:03.570 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:03.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.570 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.570 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6803", 2024-09-19T09:15:03.570 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:03.570 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.570 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.570 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:03.570 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.571 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.571 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6806", 2024-09-19T09:15:03.571 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:03.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.571 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.571 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6807", 2024-09-19T09:15:03.571 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:03.571 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.571 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.571 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:03.571 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.572 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.572 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6804", 2024-09-19T09:15:03.572 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:03.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.572 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.572 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6805", 2024-09-19T09:15:03.572 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:03.572 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.572 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.572 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6801/2408698413", 2024-09-19T09:15:03.572 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6803/2408698413", 2024-09-19T09:15:03.573 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6807/2408698413", 2024-09-19T09:15:03.573 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6805/2408698413", 2024-09-19T09:15:03.573 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:03.573 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:03.573 INFO:teuthology.orchestra.run.smithi018.stdout: "full", 2024-09-19T09:15:03.573 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:03.573 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.573 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:15:03.573 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:03.573 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:03.573 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:03.574 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:03.574 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:03.574 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:03.574 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:03.574 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:03.574 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:03.574 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:03.574 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:03.574 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:03.574 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.574 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.574 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6808", 2024-09-19T09:15:03.574 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:03.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.575 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.575 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6809", 2024-09-19T09:15:03.575 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:03.575 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.575 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.575 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:03.575 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.575 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.575 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6810", 2024-09-19T09:15:03.576 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:03.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.576 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.576 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6811", 2024-09-19T09:15:03.576 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:03.576 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.576 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.576 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:03.576 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.576 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.576 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6814", 2024-09-19T09:15:03.576 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:03.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.577 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.577 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6815", 2024-09-19T09:15:03.577 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:03.577 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.577 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.577 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:03.577 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.577 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.577 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6812", 2024-09-19T09:15:03.578 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:03.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.578 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.578 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6813", 2024-09-19T09:15:03.578 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:03.578 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.578 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.578 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6809/2596207948", 2024-09-19T09:15:03.578 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6811/2596207948", 2024-09-19T09:15:03.578 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6815/2596207948", 2024-09-19T09:15:03.578 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6813/2596207948", 2024-09-19T09:15:03.579 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:03.579 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:03.579 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:03.579 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.579 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:15:03.579 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:03.579 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:03.579 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:03.579 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:03.579 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:03.579 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:03.580 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:03.580 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:03.580 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:03.580 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:03.580 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:03.580 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:03.580 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.580 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.580 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6816", 2024-09-19T09:15:03.580 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:03.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.581 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.581 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6817", 2024-09-19T09:15:03.581 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:03.581 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.581 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.581 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:03.581 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.581 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.581 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6818", 2024-09-19T09:15:03.581 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:03.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.582 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.582 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6819", 2024-09-19T09:15:03.582 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:03.582 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.582 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.582 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:03.582 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.582 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.582 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6823", 2024-09-19T09:15:03.582 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:03.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.583 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.583 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6825", 2024-09-19T09:15:03.583 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:03.583 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.583 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.583 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:03.583 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:03.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.583 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:03.583 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6820", 2024-09-19T09:15:03.583 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:03.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.584 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:03.584 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6821", 2024-09-19T09:15:03.584 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:03.584 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.584 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.584 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6817/1334618296", 2024-09-19T09:15:03.584 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6819/1334618296", 2024-09-19T09:15:03.584 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6825/1334618296", 2024-09-19T09:15:03.584 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6821/1334618296", 2024-09-19T09:15:03.584 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:03.584 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull", 2024-09-19T09:15:03.584 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:03.585 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:03.585 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:03.585 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.585 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:15:03.585 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-19T09:15:03.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.585 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:15:03.585 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:03.585 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:03.585 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:03.585 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:03.585 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:03.585 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.580838+0000", 2024-09-19T09:15:03.586 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:03.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.586 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:15:03.586 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:03.586 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:03.586 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:03.586 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:03.586 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:03.586 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.599990+0000", 2024-09-19T09:15:03.586 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:03.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.586 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:15:03.587 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:03.587 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:03.587 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:03.587 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:03.587 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:03.587 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.503722+0000", 2024-09-19T09:15:03.587 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:03.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.587 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:15:03.587 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:03.587 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:03.587 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:03.587 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:03.588 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:03.588 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.607846+0000", 2024-09-19T09:15:03.588 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:03.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.588 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:15:03.588 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:03.588 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:03.588 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:03.588 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:03.588 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:03.588 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.616858+0000", 2024-09-19T09:15:03.588 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:03.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.589 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:15:03.589 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:03.589 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:03.589 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:03.589 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:03.589 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:03.589 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.542726+0000", 2024-09-19T09:15:03.589 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:03.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.590 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:15:03.590 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:03.590 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:03.590 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:03.590 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:03.590 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:03.590 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.534178+0000", 2024-09-19T09:15:03.590 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:03.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:03.590 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:15:03.590 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:03.590 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:03.591 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:03.591 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:03.591 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:03.591 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.612105+0000", 2024-09-19T09:15:03.591 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:03.591 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.591 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:15:03.591 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-19T09:15:03.591 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-19T09:15:03.591 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-19T09:15:03.591 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-19T09:15:03.591 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-19T09:15:03.591 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-19T09:15:03.591 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-19T09:15:03.592 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-19T09:15:03.592 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-19T09:15:03.592 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-19T09:15:03.592 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-19T09:15:03.592 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-19T09:15:03.592 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-19T09:15:03.592 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-19T09:15:03.592 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:03.592 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-19T09:15:03.592 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-19T09:15:03.592 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-19T09:15:03.592 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-19T09:15:03.593 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-19T09:15:03.593 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-19T09:15:03.593 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-19T09:15:03.593 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-19T09:15:03.593 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-19T09:15:03.593 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-19T09:15:03.593 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-19T09:15:03.593 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:03.593 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:15:03.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.516+0000 7fc0639c4640 1 -- 172.21.15.18:0/1640578528 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc04006c2b0 msgr2=0x7fc04006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:03.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.516+0000 7fc0639c4640 1 --2- 172.21.15.18:0/1640578528 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc04006c2b0 0x7fc04006e770 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc05c15dd60 tx=0x7fc04c008040 comp rx=0 tx=0).stop 2024-09-19T09:15:03.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.516+0000 7fc0639c4640 1 -- 172.21.15.18:0/1640578528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc05c06d810 msgr2=0x7fc05c15d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:03.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.516+0000 7fc0639c4640 1 --2- 172.21.15.18:0/1640578528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc05c06d810 0x7fc05c15d5e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fc05802a180 tx=0x7fc0580046c0 comp rx=0 tx=0).stop 2024-09-19T09:15:03.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.516+0000 7fc0639c4640 1 -- 172.21.15.18:0/1640578528 shutdown_connections 2024-09-19T09:15:03.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.516+0000 7fc0639c4640 1 --2- 172.21.15.18:0/1640578528 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc04006c2b0 0x7fc04006e770 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:03.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.516+0000 7fc0639c4640 1 --2- 172.21.15.18:0/1640578528 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc05c15eb00 0x7fc05c15fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:03.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.516+0000 7fc0639c4640 1 --2- 172.21.15.18:0/1640578528 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc05c06ffd0 0x7fc05c14e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:03.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.516+0000 7fc0639c4640 1 --2- 172.21.15.18:0/1640578528 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc05c06d810 0x7fc05c15d5e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:03.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.516+0000 7fc0639c4640 1 -- 172.21.15.18:0/1640578528 >> 172.21.15.18:0/1640578528 conn(0x7fc05c06cd20 msgr2=0x7fc05c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:03.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.516+0000 7fc0639c4640 1 -- 172.21.15.18:0/1640578528 shutdown_connections 2024-09-19T09:15:03.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.516+0000 7fc0639c4640 1 -- 172.21.15.18:0/1640578528 wait complete. 2024-09-19T09:15:03.596 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-19T09:15:03.597 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:15:03.597 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:15:03.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:15:03.614 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2024-09-19T09:15:03.810 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:15:03.810 INFO:teuthology.orchestra.run.smithi018.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2024-09-19T09:15:03.810 INFO:teuthology.orchestra.run.smithi018.stderr:50+0 records in 2024-09-19T09:15:03.810 INFO:teuthology.orchestra.run.smithi018.stderr:50+0 records out 2024-09-19T09:15:03.810 INFO:teuthology.orchestra.run.smithi018.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.134755 s, 389 MB/s 2024-09-19T09:15:03.811 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-19T09:15:03.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.912+0000 7fc0861d6640 1 Processor -- start 2024-09-19T09:15:03.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.912+0000 7fc0861d6640 1 -- start start 2024-09-19T09:15:03.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.912+0000 7fc0861d6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc08015cc40 0x7fc080161070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:03.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.912+0000 7fc0861d6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0800b2440 0x7fc0800d0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:03.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.912+0000 7fc0861d6640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0800ce310 con 0x7fc080160580 2024-09-19T09:15:03.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.912+0000 7fc0861d6640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fc0800ce0c0 con 0x7fc08015cc40 2024-09-19T09:15:03.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.912+0000 7fc0861d6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc0800cf100 con 0x7fc0800b2440 2024-09-19T09:15:03.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.913+0000 7fc07effd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc08015cc40 0x7fc080161070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:03.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.913+0000 7fc07f7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc080160580 0x7fc080160960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:47318/0 (socket says 172.21.15.18:47318) 2024-09-19T09:15:03.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.913+0000 7fc07f7fe640 1 -- 172.21.15.18:0/1224406456 learned_addr learned my addr 172.21.15.18:0/1224406456 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:15:03.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.913+0000 7fc07ffff640 1 --2- 172.21.15.18:0/1224406456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0800b2440 0x7fc0800d0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:03.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.913+0000 7fc07effd640 1 -- 172.21.15.18:0/1224406456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0800b2440 msgr2=0x7fc0800d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:03.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.913+0000 7fc07effd640 1 --2- 172.21.15.18:0/1224406456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0800b2440 0x7fc0800d0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:03.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.913+0000 7fc07effd640 1 -- 172.21.15.18:0/1224406456 >> v1:172.21.15.18:6789/0 conn(0x7fc080160580 legacy=0x7fc080160960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:03.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.913+0000 7fc07effd640 1 -- 172.21.15.18:0/1224406456 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0800ce5f0 con 0x7fc08015cc40 2024-09-19T09:15:03.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.913+0000 7fc07e7fc640 1 -- 172.21.15.18:0/1224406456 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3814997831 0 0) 0x7fc0800ce310 con 0x7fc080160580 2024-09-19T09:15:03.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.914+0000 7fc07effd640 1 --2- 172.21.15.18:0/1224406456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc08015cc40 0x7fc080161070 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc0740097a0 tx=0x7fc07402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ddc36ecf1d54a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:03.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.914+0000 7fc07e7fc640 1 -- 172.21.15.18:0/1224406456 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc074037070 con 0x7fc08015cc40 2024-09-19T09:15:03.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.914+0000 7fc07e7fc640 1 -- 172.21.15.18:0/1224406456 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc07402ae50 con 0x7fc08015cc40 2024-09-19T09:15:03.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.914+0000 7fc07e7fc640 1 -- 172.21.15.18:0/1224406456 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc074032660 con 0x7fc08015cc40 2024-09-19T09:15:03.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.914+0000 7fc0861d6640 1 -- 172.21.15.18:0/1224406456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc08015cc40 msgr2=0x7fc080161070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:03.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.914+0000 7fc0861d6640 1 --2- 172.21.15.18:0/1224406456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc08015cc40 0x7fc080161070 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc0740097a0 tx=0x7fc07402a100 comp rx=0 tx=0).stop 2024-09-19T09:15:03.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.914+0000 7fc0861d6640 1 -- 172.21.15.18:0/1224406456 shutdown_connections 2024-09-19T09:15:03.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.914+0000 7fc0861d6640 1 --2- 172.21.15.18:0/1224406456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0800b2440 0x7fc0800d0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:03.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.914+0000 7fc0861d6640 1 --2- 172.21.15.18:0/1224406456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc08015cc40 0x7fc080161070 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:03.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.914+0000 7fc0861d6640 1 -- 172.21.15.18:0/1224406456 >> 172.21.15.18:0/1224406456 conn(0x7fc0800b45f0 msgr2=0x7fc0800b4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:03.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.914+0000 7fc0861d6640 1 -- 172.21.15.18:0/1224406456 shutdown_connections 2024-09-19T09:15:03.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.914+0000 7fc0861d6640 1 -- 172.21.15.18:0/1224406456 wait complete. 2024-09-19T09:15:03.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.916+0000 7fc0861d6640 1 Processor -- start 2024-09-19T09:15:03.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.916+0000 7fc0861d6640 1 -- start start 2024-09-19T09:15:03.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.916+0000 7fc0861d6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0800b2440 0x7fc080154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:03.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.916+0000 7fc0861d6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc08015cc40 0x7fc08015da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:03.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.916+0000 7fc0861d6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc080160580 0x7fc08015f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:03.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.916+0000 7fc0861d6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc0800d0d50 con 0x7fc0800b2440 2024-09-19T09:15:03.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.916+0000 7fc0861d6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc0800d0bd0 con 0x7fc080160580 2024-09-19T09:15:03.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.916+0000 7fc0861d6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc0800d0ed0 con 0x7fc08015cc40 2024-09-19T09:15:03.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.917+0000 7fc07f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0800b2440 0x7fc080154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:03.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.917+0000 7fc07f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0800b2440 0x7fc080154e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43406/0 (socket says 172.21.15.18:43406) 2024-09-19T09:15:03.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.917+0000 7fc07f7fe640 1 -- 172.21.15.18:0/370114796 learned_addr learned my addr 172.21.15.18:0/370114796 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:03.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.917+0000 7fc07ffff640 1 --2- 172.21.15.18:0/370114796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc080160580 0x7fc08015f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:03.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.917+0000 7fc07effd640 1 --2- 172.21.15.18:0/370114796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc08015cc40 0x7fc08015da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:03.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.917+0000 7fc07f7fe640 1 -- 172.21.15.18:0/370114796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc08015cc40 msgr2=0x7fc08015da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:03.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.917+0000 7fc07f7fe640 1 --2- 172.21.15.18:0/370114796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc08015cc40 0x7fc08015da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:03.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.917+0000 7fc07f7fe640 1 -- 172.21.15.18:0/370114796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc080160580 msgr2=0x7fc08015f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:03.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.917+0000 7fc07f7fe640 1 --2- 172.21.15.18:0/370114796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc080160580 0x7fc08015f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:03.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.917+0000 7fc07f7fe640 1 -- 172.21.15.18:0/370114796 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc08015df90 con 0x7fc0800b2440 2024-09-19T09:15:03.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.917+0000 7fc07f7fe640 1 --2- 172.21.15.18:0/370114796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0800b2440 0x7fc080154e50 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc07000c460 tx=0x7fc07000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:03.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.917+0000 7fc067fff640 1 -- 172.21.15.18:0/370114796 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc070018070 con 0x7fc0800b2440 2024-09-19T09:15:03.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.917+0000 7fc067fff640 1 -- 172.21.15.18:0/370114796 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc070007500 con 0x7fc0800b2440 2024-09-19T09:15:03.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.917+0000 7fc0861d6640 1 -- 172.21.15.18:0/370114796 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0800b7f50 con 0x7fc0800b2440 2024-09-19T09:15:03.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.917+0000 7fc067fff640 1 -- 172.21.15.18:0/370114796 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc070004a20 con 0x7fc0800b2440 2024-09-19T09:15:03.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.917+0000 7fc0861d6640 1 -- 172.21.15.18:0/370114796 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc08015e800 con 0x7fc0800b2440 2024-09-19T09:15:03.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.918+0000 7fc0861d6640 1 -- 172.21.15.18:0/370114796 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0800d0690 con 0x7fc0800b2440 2024-09-19T09:15:03.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.919+0000 7fc067fff640 1 -- 172.21.15.18:0/370114796 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc07001b070 con 0x7fc0800b2440 2024-09-19T09:15:03.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.919+0000 7fc067fff640 1 --2- 172.21.15.18:0/370114796 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc06c06c2b0 0x7fc06c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:03.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.919+0000 7fc067fff640 1 -- 172.21.15.18:0/370114796 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 5709+0+0 (secure 0 0 0) 0x7fc07008a6b0 con 0x7fc0800b2440 2024-09-19T09:15:03.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.919+0000 7fc067fff640 1 -- 172.21.15.18:0/370114796 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=53}) -- 0x7fc06c073de0 con 0x7fc0800b2440 2024-09-19T09:15:03.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.920+0000 7fc07effd640 1 --2- 172.21.15.18:0/370114796 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc06c06c2b0 0x7fc06c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:03.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.920+0000 7fc07effd640 1 --2- 172.21.15.18:0/370114796 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc06c06c2b0 0x7fc06c06e770 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc074034000 tx=0x7fc07402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:03.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:03.924+0000 7fc067fff640 1 -- 172.21.15.18:0/370114796 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc08015df90 con 0x7fc0800b2440 2024-09-19T09:15:04.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.078+0000 7fc067fff640 1 -- 172.21.15.18:0/370114796 <== mon.0 v2:172.21.15.18:3300/0 7 ==== osd_map(53..53 src has 1..53) ==== 296+0+0 (secure 0 0 0) 0x7fc0700beda0 con 0x7fc0800b2440 2024-09-19T09:15:04.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.078+0000 7fc067fff640 1 -- 172.21.15.18:0/370114796 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=54}) -- 0x7fc06c074660 con 0x7fc0800b2440 2024-09-19T09:15:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.102+0000 7fc0861d6640 1 -- 172.21.15.18:0/370114796 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fc0800d28a0 con 0x7fc0800b2440 2024-09-19T09:15:04.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.104+0000 7fc067fff640 1 -- 172.21.15.18:0/370114796 <== mon.0 v2:172.21.15.18:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v53) ==== 81+0+34427 (secure 0 0 0) 0x7fc070058e20 con 0x7fc0800b2440 2024-09-19T09:15:04.105 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:15:04.105 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:15:04.106 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 53, 2024-09-19T09:15:04.106 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:15:04.106 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-19T09:13:11.348786+0000", 2024-09-19T09:15:04.107 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-19T09:15:04.074837+0000", 2024-09-19T09:15:04.107 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-19T09:13:16.423937+0000", 2024-09-19T09:15:04.107 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-19T09:13:13.417141+0000", 2024-09-19T09:15:04.107 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-19T09:15:04.107 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-09-19T09:15:04.108 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-19T09:15:04.108 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-19T09:15:04.108 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-19T09:15:04.108 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-19T09:15:04.108 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-19T09:15:04.108 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:15:04.109 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-19T09:15:04.109 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.69999998807907104, 2024-09-19T09:15:04.109 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-19T09:15:04.109 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-19T09:15:04.109 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-19T09:15:04.110 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 7, 2024-09-19T09:15:04.110 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-19T09:15:04.110 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-19T09:15:04.110 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "jewel", 2024-09-19T09:15:04.110 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-19T09:15:04.111 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-19T09:15:04.111 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-19T09:15:04.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.111 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-19T09:15:04.111 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-19T09:15:04.111 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:13:17.564717+0000", 2024-09-19T09:15:04.112 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 3, 2024-09-19T09:15:04.112 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full", 2024-09-19T09:15:04.112 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:15:04.112 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:15:04.112 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:15:04.112 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:15:04.113 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:15:04.113 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:15:04.113 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:15:04.113 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:15:04.113 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:15:04.113 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:15:04.113 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:15:04.113 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-19T09:15:04.113 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-19T09:15:04.113 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-19T09:15:04.114 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-19T09:15:04.114 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-19T09:15:04.114 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:15:04.114 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:15:04.114 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:15:04.114 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:15:04.114 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:15:04.114 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:15:04.114 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:15:04.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.114 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "49", 2024-09-19T09:15:04.114 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:15:04.115 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:15:04.115 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:15:04.115 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:15:04.115 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:15:04.115 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:15:04.115 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:15:04.115 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:15:04.115 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:15:04.115 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:15:04.115 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:15:04.115 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:15:04.115 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:15:04.115 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:15:04.115 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:15:04.115 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:15:04.116 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:15:04.116 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:15:04.116 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:15:04.116 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:15:04.116 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:15:04.116 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:15:04.116 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:15:04.116 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:15:04.116 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:15:04.116 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:15:04.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.116 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:15:04.117 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:15:04.117 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:15:04.117 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:15:04.117 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:15:04.117 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:15:04.117 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:15:04.117 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:15:04.117 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:15:04.117 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:15:04.117 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:15:04.117 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:15:04.117 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-19T09:15:04.117 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-19T09:15:04.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.118 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:15:04.118 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-19T09:15:04.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.118 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:15:04.118 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:15:04.118 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-19T09:15:04.118 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-19T09:15:04.118 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-19T09:15:04.118 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-19T09:15:04.118 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-19T09:15:04.118 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:15:04.118 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:15:04.118 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:15:04.119 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.119 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 6, 2024-09-19T09:15:04.119 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_metadata", 2024-09-19T09:15:04.119 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:14:41.948276+0000", 2024-09-19T09:15:04.119 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 3, 2024-09-19T09:15:04.119 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full", 2024-09-19T09:15:04.119 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:15:04.119 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:15:04.119 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:15:04.119 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:15:04.120 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:15:04.120 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:15:04.120 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:15:04.120 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:15:04.120 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:15:04.120 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:15:04.120 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:15:04.120 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-19T09:15:04.120 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-19T09:15:04.120 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-19T09:15:04.120 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-19T09:15:04.120 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-19T09:15:04.120 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:15:04.120 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:15:04.121 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:15:04.121 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:15:04.121 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:15:04.121 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:15:04.121 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:15:04.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.121 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "49", 2024-09-19T09:15:04.121 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:15:04.121 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:15:04.121 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:15:04.121 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:15:04.121 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:15:04.121 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:15:04.121 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:15:04.122 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:15:04.122 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:15:04.122 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:15:04.122 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:15:04.122 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:15:04.122 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:15:04.122 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:15:04.122 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:15:04.122 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:15:04.122 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:15:04.122 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:15:04.122 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:15:04.122 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:15:04.122 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:15:04.122 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:15:04.122 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:15:04.123 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:15:04.123 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:15:04.123 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:15:04.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.123 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:15:04.123 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:15:04.123 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:15:04.123 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:15:04.123 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:15:04.123 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:15:04.123 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:15:04.123 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:15:04.123 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:15:04.123 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:15:04.123 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:15:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:15:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4, 2024-09-19T09:15:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 16, 2024-09-19T09:15:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_priority": 5 2024-09-19T09:15:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:15:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:15:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": "cephfs" 2024-09-19T09:15:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:15:04.124 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:15:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.5, 2024-09-19T09:15:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.5, 2024-09-19T09:15:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:15:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.5, 2024-09-19T09:15:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.5, 2024-09-19T09:15:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:15:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:15:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:15:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 7, 2024-09-19T09:15:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_data", 2024-09-19T09:15:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:14:42.341949+0000", 2024-09-19T09:15:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 3, 2024-09-19T09:15:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full", 2024-09-19T09:15:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:15:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:15:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:15:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:15:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:15:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:15:04.126 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:15:04.127 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:15:04.127 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:15:04.127 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:15:04.127 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:15:04.127 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 64, 2024-09-19T09:15:04.127 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 64, 2024-09-19T09:15:04.127 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 64, 2024-09-19T09:15:04.127 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 64, 2024-09-19T09:15:04.127 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 64, 2024-09-19T09:15:04.127 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:15:04.127 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:15:04.127 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:15:04.127 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:15:04.128 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:15:04.128 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:15:04.128 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:15:04.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.128 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "49", 2024-09-19T09:15:04.128 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:15:04.128 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:15:04.128 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:15:04.128 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:15:04.128 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:15:04.128 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:15:04.128 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:15:04.129 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:15:04.129 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:15:04.129 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:15:04.129 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:15:04.129 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:15:04.129 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:15:04.129 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:15:04.129 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:15:04.129 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:15:04.129 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:15:04.129 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:15:04.129 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:15:04.130 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:15:04.130 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:15:04.130 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:15:04.130 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:15:04.130 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:15:04.130 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:15:04.130 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:15:04.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.130 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:15:04.130 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:15:04.130 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:15:04.130 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:15:04.130 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:15:04.131 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:15:04.131 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:15:04.131 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:15:04.131 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:15:04.131 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:15:04.131 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:15:04.131 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:15:04.131 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 64, 2024-09-19T09:15:04.131 INFO:teuthology.orchestra.run.smithi018.stdout: "target_size_ratio": 0.89999997615814209 2024-09-19T09:15:04.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.131 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:15:04.131 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:15:04.131 INFO:teuthology.orchestra.run.smithi018.stdout: "data": "cephfs" 2024-09-19T09:15:04.131 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.132 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:15:04.132 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:15:04.132 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.75, 2024-09-19T09:15:04.132 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.75, 2024-09-19T09:15:04.132 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:15:04.132 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.75, 2024-09-19T09:15:04.132 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.75, 2024-09-19T09:15:04.132 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:15:04.132 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:15:04.132 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:15:04.132 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.132 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.132 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:15:04.132 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-19T09:15:04.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.133 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:15:04.133 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:04.133 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:04.133 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:04.133 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:04.133 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:04.133 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:04.133 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:04.133 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:04.133 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:04.133 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:04.133 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:04.134 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:04.134 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.134 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.134 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-19T09:15:04.134 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:04.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.134 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.134 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-19T09:15:04.134 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:04.135 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.135 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.135 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:04.135 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.135 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.135 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-19T09:15:04.135 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:04.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.135 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.136 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-19T09:15:04.136 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:04.136 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.136 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.136 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:04.136 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.136 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.136 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-19T09:15:04.136 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:04.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.137 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.137 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-19T09:15:04.137 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:04.137 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.137 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.137 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:04.137 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.137 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.137 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-19T09:15:04.137 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:04.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.138 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.138 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-19T09:15:04.138 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:04.138 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.138 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.138 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/128722874", 2024-09-19T09:15:04.138 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/128722874", 2024-09-19T09:15:04.138 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/128722874", 2024-09-19T09:15:04.138 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/128722874", 2024-09-19T09:15:04.139 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:04.139 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull", 2024-09-19T09:15:04.139 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:04.139 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:04.139 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.139 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:15:04.139 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:04.139 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:04.139 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:04.139 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:04.139 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:04.139 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:04.140 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:04.140 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:04.140 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:04.140 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:04.140 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:04.140 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:04.140 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.140 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.140 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-19T09:15:04.140 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:04.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.140 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.141 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-19T09:15:04.141 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:04.141 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.141 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.141 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:04.141 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.141 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.141 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-19T09:15:04.141 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:04.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.142 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.142 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-19T09:15:04.142 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:04.142 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.142 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.142 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:04.142 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.142 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.142 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-19T09:15:04.142 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:04.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.143 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.143 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-19T09:15:04.143 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:04.143 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.143 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.143 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:04.143 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.143 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.144 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-19T09:15:04.144 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:04.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.144 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.144 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-19T09:15:04.144 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:04.144 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.144 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.144 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/3672199638", 2024-09-19T09:15:04.145 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/3672199638", 2024-09-19T09:15:04.145 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/3672199638", 2024-09-19T09:15:04.145 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/3672199638", 2024-09-19T09:15:04.145 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:04.145 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull", 2024-09-19T09:15:04.145 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:04.145 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:04.145 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.146 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:15:04.146 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:04.146 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:04.146 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:04.146 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:04.146 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:04.146 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:04.146 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:04.146 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:04.146 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:04.146 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:04.146 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:04.147 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:04.147 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.147 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.147 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T09:15:04.147 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:04.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.147 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.147 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T09:15:04.147 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:04.147 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.148 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.148 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:04.148 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.148 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.148 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-19T09:15:04.148 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:04.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.148 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.148 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-19T09:15:04.148 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:04.149 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.149 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.149 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:04.149 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.149 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.149 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-19T09:15:04.149 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:04.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.149 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.149 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-19T09:15:04.150 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:04.150 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.150 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.150 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:04.150 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.150 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.150 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-19T09:15:04.150 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:04.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.150 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.150 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-19T09:15:04.151 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:04.151 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.151 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.151 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3463367841", 2024-09-19T09:15:04.151 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3463367841", 2024-09-19T09:15:04.151 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3463367841", 2024-09-19T09:15:04.151 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3463367841", 2024-09-19T09:15:04.151 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:04.151 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:04.151 INFO:teuthology.orchestra.run.smithi018.stdout: "full", 2024-09-19T09:15:04.151 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:04.151 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.152 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.152 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:15:04.152 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:04.152 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:04.152 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:04.152 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:04.152 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:04.152 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:04.152 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:04.152 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:04.152 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:04.152 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:04.153 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:04.153 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:04.153 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.153 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.153 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-19T09:15:04.153 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:04.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.153 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.154 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-19T09:15:04.154 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:04.154 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.154 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.154 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:04.154 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.154 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.154 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-19T09:15:04.154 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:04.154 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.154 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.154 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.155 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-19T09:15:04.155 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:04.155 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.155 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.155 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:04.155 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.155 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.155 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-19T09:15:04.155 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:04.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.155 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.155 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.156 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-19T09:15:04.156 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:04.156 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.156 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.156 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:04.156 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.156 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.156 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-19T09:15:04.156 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:04.156 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.156 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.157 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.157 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-19T09:15:04.157 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:04.157 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.157 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.157 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/4163178582", 2024-09-19T09:15:04.157 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/4163178582", 2024-09-19T09:15:04.157 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/4163178582", 2024-09-19T09:15:04.157 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/4163178582", 2024-09-19T09:15:04.157 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:04.157 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull", 2024-09-19T09:15:04.157 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:04.158 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:04.158 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.158 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.158 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:15:04.158 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:04.158 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:04.158 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:04.158 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:04.159 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:04.159 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:04.159 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:04.159 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:04.159 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:04.159 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:04.159 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:04.159 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:04.159 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.159 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.159 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6822", 2024-09-19T09:15:04.160 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:04.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.160 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.160 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.160 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6824", 2024-09-19T09:15:04.160 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:04.160 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.160 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.160 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.160 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:04.161 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.161 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.161 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6826", 2024-09-19T09:15:04.161 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:04.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.161 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.161 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.161 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6827", 2024-09-19T09:15:04.161 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:04.161 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.161 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.161 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.162 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:04.162 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.162 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.162 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6830", 2024-09-19T09:15:04.162 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:04.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.162 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.162 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.162 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6831", 2024-09-19T09:15:04.162 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:04.163 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.163 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.163 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:04.163 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.163 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.163 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6828", 2024-09-19T09:15:04.163 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:04.163 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.163 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.163 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.163 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6829", 2024-09-19T09:15:04.164 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:04.164 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.164 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.164 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6824/3538482215", 2024-09-19T09:15:04.164 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6827/3538482215", 2024-09-19T09:15:04.164 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6831/3538482215", 2024-09-19T09:15:04.164 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6829/3538482215", 2024-09-19T09:15:04.164 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:04.164 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:04.164 INFO:teuthology.orchestra.run.smithi018.stdout: "full", 2024-09-19T09:15:04.164 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:04.164 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.165 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.165 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.165 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:15:04.165 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:04.165 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:04.165 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:04.165 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:04.165 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:04.165 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:04.165 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:04.165 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:04.166 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:04.166 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:04.166 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:04.166 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:04.166 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.166 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.166 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6800", 2024-09-19T09:15:04.166 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:04.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.166 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.166 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.166 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6801", 2024-09-19T09:15:04.166 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:04.167 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.167 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.167 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:04.167 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.167 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.167 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6802", 2024-09-19T09:15:04.167 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:04.167 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.167 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.167 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6803", 2024-09-19T09:15:04.167 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:04.167 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.168 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.168 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:04.168 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.168 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.168 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6806", 2024-09-19T09:15:04.168 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:04.168 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.168 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.168 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.168 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6807", 2024-09-19T09:15:04.168 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:04.169 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.169 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.169 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:04.169 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.169 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.169 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6804", 2024-09-19T09:15:04.169 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:04.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.169 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.170 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6805", 2024-09-19T09:15:04.170 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:04.170 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.170 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.170 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6801/2408698413", 2024-09-19T09:15:04.170 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6803/2408698413", 2024-09-19T09:15:04.170 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6807/2408698413", 2024-09-19T09:15:04.170 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6805/2408698413", 2024-09-19T09:15:04.170 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:04.170 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:04.170 INFO:teuthology.orchestra.run.smithi018.stdout: "full", 2024-09-19T09:15:04.170 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:04.171 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.171 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:15:04.171 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:04.171 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:04.171 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:04.171 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:04.171 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:04.171 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:04.171 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:04.171 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:04.171 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:04.171 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:04.172 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:04.172 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:04.172 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.172 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.172 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6808", 2024-09-19T09:15:04.172 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:04.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.172 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.172 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6809", 2024-09-19T09:15:04.172 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:04.172 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.173 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.173 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:04.173 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.173 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.173 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6810", 2024-09-19T09:15:04.173 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:04.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.173 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.174 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.174 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6811", 2024-09-19T09:15:04.174 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:04.174 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.174 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.174 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:04.174 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.174 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.174 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6814", 2024-09-19T09:15:04.174 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:04.174 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.175 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.175 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6815", 2024-09-19T09:15:04.175 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:04.175 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.175 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.175 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:04.175 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.175 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.175 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6812", 2024-09-19T09:15:04.175 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:04.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.176 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.176 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6813", 2024-09-19T09:15:04.176 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:04.176 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.176 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.176 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6809/2596207948", 2024-09-19T09:15:04.176 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6811/2596207948", 2024-09-19T09:15:04.176 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6815/2596207948", 2024-09-19T09:15:04.176 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6813/2596207948", 2024-09-19T09:15:04.176 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:04.176 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:04.176 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:04.177 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.177 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:15:04.177 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:04.177 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:04.177 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:04.177 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:04.177 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:04.177 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:04.177 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:04.177 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:04.177 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:04.177 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:04.177 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:04.178 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:04.178 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.178 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.178 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6816", 2024-09-19T09:15:04.178 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:04.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.178 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.178 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6817", 2024-09-19T09:15:04.179 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:04.179 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.179 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.179 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:04.179 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.179 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.179 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6818", 2024-09-19T09:15:04.179 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:04.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.179 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.179 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.179 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6819", 2024-09-19T09:15:04.179 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:04.180 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.180 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.180 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:04.180 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.180 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.180 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6823", 2024-09-19T09:15:04.180 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:04.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.180 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.181 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6825", 2024-09-19T09:15:04.181 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:04.181 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.181 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.181 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:04.181 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:04.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.181 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:04.181 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6820", 2024-09-19T09:15:04.181 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:04.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.182 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:04.182 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6821", 2024-09-19T09:15:04.182 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:04.182 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.182 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.182 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6817/1334618296", 2024-09-19T09:15:04.182 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6819/1334618296", 2024-09-19T09:15:04.182 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6825/1334618296", 2024-09-19T09:15:04.182 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6821/1334618296", 2024-09-19T09:15:04.182 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:04.182 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull", 2024-09-19T09:15:04.182 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:04.182 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:04.183 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:04.183 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.183 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:15:04.183 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-19T09:15:04.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.183 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:15:04.183 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:04.183 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:04.183 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:04.183 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:04.183 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:04.183 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.580838+0000", 2024-09-19T09:15:04.183 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:04.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.184 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:15:04.184 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:04.184 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:04.184 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:04.184 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:04.184 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:04.184 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.599990+0000", 2024-09-19T09:15:04.184 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:04.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.184 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.184 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:15:04.185 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:04.185 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:04.185 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:04.185 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:04.185 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:04.185 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.503722+0000", 2024-09-19T09:15:04.185 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:04.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.185 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:15:04.185 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:04.186 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:04.186 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:04.186 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:04.186 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:04.186 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.607846+0000", 2024-09-19T09:15:04.186 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:04.186 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.186 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.186 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:15:04.186 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:04.186 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:04.186 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:04.186 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:04.187 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:04.187 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.616858+0000", 2024-09-19T09:15:04.187 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:04.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.187 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:15:04.187 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:04.187 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:04.187 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:04.187 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:04.187 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:04.187 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.542726+0000", 2024-09-19T09:15:04.187 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:04.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.188 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:15:04.188 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:04.188 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:04.188 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:04.188 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:04.188 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:04.188 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.534178+0000", 2024-09-19T09:15:04.188 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:04.188 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:04.188 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:15:04.189 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:04.189 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:04.189 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:04.189 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:04.189 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:04.189 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.612105+0000", 2024-09-19T09:15:04.189 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:04.189 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.189 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:15:04.189 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-19T09:15:04.189 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-19T09:15:04.189 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-19T09:15:04.189 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-19T09:15:04.189 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-19T09:15:04.190 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-19T09:15:04.190 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-19T09:15:04.190 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-19T09:15:04.190 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-19T09:15:04.190 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-19T09:15:04.190 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-19T09:15:04.190 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-19T09:15:04.190 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-19T09:15:04.190 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-19T09:15:04.190 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:04.190 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-19T09:15:04.190 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-19T09:15:04.190 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-19T09:15:04.190 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-19T09:15:04.191 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-19T09:15:04.191 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-19T09:15:04.191 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-19T09:15:04.191 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-19T09:15:04.191 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-19T09:15:04.191 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-19T09:15:04.191 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-19T09:15:04.191 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:04.191 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:15:04.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.106+0000 7fc0861d6640 1 -- 172.21.15.18:0/370114796 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc06c06c2b0 msgr2=0x7fc06c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:04.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.106+0000 7fc0861d6640 1 --2- 172.21.15.18:0/370114796 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc06c06c2b0 0x7fc06c06e770 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc074034000 tx=0x7fc07402e000 comp rx=0 tx=0).stop 2024-09-19T09:15:04.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.106+0000 7fc0861d6640 1 -- 172.21.15.18:0/370114796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0800b2440 msgr2=0x7fc080154e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:04.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.106+0000 7fc0861d6640 1 --2- 172.21.15.18:0/370114796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0800b2440 0x7fc080154e50 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc07000c460 tx=0x7fc07000c920 comp rx=0 tx=0).stop 2024-09-19T09:15:04.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.106+0000 7fc0861d6640 1 -- 172.21.15.18:0/370114796 shutdown_connections 2024-09-19T09:15:04.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.106+0000 7fc0861d6640 1 --2- 172.21.15.18:0/370114796 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc06c06c2b0 0x7fc06c06e770 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:04.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.106+0000 7fc0861d6640 1 --2- 172.21.15.18:0/370114796 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc080160580 0x7fc08015f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:04.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.106+0000 7fc0861d6640 1 --2- 172.21.15.18:0/370114796 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc08015cc40 0x7fc08015da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:04.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.106+0000 7fc0861d6640 1 --2- 172.21.15.18:0/370114796 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0800b2440 0x7fc080154e50 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:04.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.106+0000 7fc0861d6640 1 -- 172.21.15.18:0/370114796 >> 172.21.15.18:0/370114796 conn(0x7fc0800b45f0 msgr2=0x7fc0800d1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:04.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.106+0000 7fc0861d6640 1 -- 172.21.15.18:0/370114796 shutdown_connections 2024-09-19T09:15:04.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.106+0000 7fc0861d6640 1 -- 172.21.15.18:0/370114796 wait complete. 2024-09-19T09:15:04.195 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:15:04.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.296+0000 7f9d312dd640 1 Processor -- start 2024-09-19T09:15:04.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.296+0000 7f9d312dd640 1 -- start start 2024-09-19T09:15:04.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.297+0000 7f9d312dd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9d2c15d1b0 0x7f9d2c15d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:04.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.297+0000 7f9d312dd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d2c0b1b80 0x7f9d2c0d0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:04.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.297+0000 7f9d312dd640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d2c0cd560 con 0x7f9d2c0d0b60 2024-09-19T09:15:04.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.297+0000 7f9d312dd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9d2c15d000 con 0x7f9d2c15d1b0 2024-09-19T09:15:04.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.297+0000 7f9d312dd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9d2c0cdb70 con 0x7f9d2c0b1b80 2024-09-19T09:15:04.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.297+0000 7f9d2b7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f9d2c0d0b60 0x7f9d2c0ce000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:47332/0 (socket says 172.21.15.18:47332) 2024-09-19T09:15:04.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.297+0000 7f9d2b7fe640 1 -- 172.21.15.18:0/368062661 learned_addr learned my addr 172.21.15.18:0/368062661 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:15:04.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.298+0000 7f9d29ffb640 1 -- 172.21.15.18:0/368062661 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2915935750 0 0) 0x7f9d2c0cd560 con 0x7f9d2c0d0b60 2024-09-19T09:15:04.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.298+0000 7f9d2a7fc640 1 --2- 172.21.15.18:0/368062661 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d2c0b1b80 0x7f9d2c0d0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:04.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.298+0000 7f9d2affd640 1 --2- 172.21.15.18:0/368062661 >> v2:172.21.15.162:3300/0 conn(0x7f9d2c15d1b0 0x7f9d2c15d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:04.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.298+0000 7f9d29ffb640 1 -- 172.21.15.18:0/368062661 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d18003520 con 0x7f9d2c0d0b60 2024-09-19T09:15:04.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.298+0000 7f9d29ffb640 1 -- 172.21.15.18:0/368062661 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1734765753 0 0) 0x7f9d18003520 con 0x7f9d2c0d0b60 2024-09-19T09:15:04.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.298+0000 7f9d29ffb640 1 -- 172.21.15.18:0/368062661 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d2c0b1b80 msgr2=0x7f9d2c0d0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:04.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.298+0000 7f9d29ffb640 1 --2- 172.21.15.18:0/368062661 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d2c0b1b80 0x7f9d2c0d0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:04.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.298+0000 7f9d29ffb640 1 -- 172.21.15.18:0/368062661 >> v2:172.21.15.162:3300/0 conn(0x7f9d2c15d1b0 msgr2=0x7f9d2c15d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:04.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.298+0000 7f9d29ffb640 1 --2- 172.21.15.18:0/368062661 >> v2:172.21.15.162:3300/0 conn(0x7f9d2c15d1b0 0x7f9d2c15d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:04.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.298+0000 7f9d29ffb640 1 -- 172.21.15.18:0/368062661 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d2c15dad0 con 0x7f9d2c0d0b60 2024-09-19T09:15:04.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.298+0000 7f9d29ffb640 1 -- 172.21.15.18:0/368062661 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f9d24001670 con 0x7f9d2c0d0b60 2024-09-19T09:15:04.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.298+0000 7f9d29ffb640 1 -- 172.21.15.18:0/368062661 >> v1:172.21.15.18:6789/0 conn(0x7f9d2c0d0b60 legacy=0x7f9d2c0ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:04.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.298+0000 7f9d29ffb640 1 --2- 172.21.15.18:0/368062661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d180039b0 0x7f9d18003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:04.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.298+0000 7f9d29ffb640 1 --2- 172.21.15.18:0/368062661 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d2c0b1b80 0x7f9d18004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:04.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.298+0000 7f9d29ffb640 1 --2- 172.21.15.18:0/368062661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d18004d40 0x7f9d180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:04.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.298+0000 7f9d29ffb640 1 -- 172.21.15.18:0/368062661 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c15d000 con 0x7f9d18004d40 2024-09-19T09:15:04.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.298+0000 7f9d29ffb640 1 -- 172.21.15.18:0/368062661 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c0cdb70 con 0x7f9d180039b0 2024-09-19T09:15:04.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.298+0000 7f9d29ffb640 1 -- 172.21.15.18:0/368062661 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9d1800b9c0 con 0x7f9d2c0b1b80 2024-09-19T09:15:04.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.298+0000 7f9d2b7fe640 1 --2- 172.21.15.18:0/368062661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d18004d40 0x7f9d180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:04.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.298+0000 7f9d2affd640 1 --2- 172.21.15.18:0/368062661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d180039b0 0x7f9d18003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:04.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.298+0000 7f9d2a7fc640 1 --2- 172.21.15.18:0/368062661 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d2c0b1b80 0x7f9d18004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:04.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.299+0000 7f9d2b7fe640 1 -- 172.21.15.18:0/368062661 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d2c0b1b80 msgr2=0x7f9d18004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:04.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.299+0000 7f9d2b7fe640 1 --2- 172.21.15.18:0/368062661 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d2c0b1b80 0x7f9d18004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:04.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.299+0000 7f9d2b7fe640 1 -- 172.21.15.18:0/368062661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d180039b0 msgr2=0x7f9d18003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:04.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.299+0000 7f9d2b7fe640 1 --2- 172.21.15.18:0/368062661 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d180039b0 0x7f9d18003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:04.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.299+0000 7f9d2b7fe640 1 -- 172.21.15.18:0/368062661 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d18003520 con 0x7f9d18004d40 2024-09-19T09:15:04.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.299+0000 7f9d2b7fe640 1 --2- 172.21.15.18:0/368062661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d18004d40 0x7f9d180051c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9d24001050 tx=0x7f9d18005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f5b221212ec0c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:04.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.299+0000 7f9d29ffb640 1 -- 172.21.15.18:0/368062661 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2402e070 con 0x7f9d18004d40 2024-09-19T09:15:04.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.299+0000 7f9d29ffb640 1 -- 172.21.15.18:0/368062661 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d24005af0 con 0x7f9d18004d40 2024-09-19T09:15:04.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.299+0000 7f9d29ffb640 1 -- 172.21.15.18:0/368062661 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d24007d70 con 0x7f9d18004d40 2024-09-19T09:15:04.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.300+0000 7f9d312dd640 1 -- 172.21.15.18:0/368062661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d18004d40 msgr2=0x7f9d180051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:04.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.300+0000 7f9d312dd640 1 --2- 172.21.15.18:0/368062661 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d18004d40 0x7f9d180051c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9d24001050 tx=0x7f9d18005830 comp rx=0 tx=0).stop 2024-09-19T09:15:04.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.300+0000 7f9d2b7fe640 1 -- 172.21.15.18:0/368062661 reap_dead start 2024-09-19T09:15:04.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.300+0000 7f9d312dd640 1 -- 172.21.15.18:0/368062661 shutdown_connections 2024-09-19T09:15:04.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.300+0000 7f9d312dd640 1 -- 172.21.15.18:0/368062661 >> 172.21.15.18:0/368062661 conn(0x7f9d2c0b4560 msgr2=0x7f9d2c0b4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:04.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.300+0000 7f9d312dd640 1 -- 172.21.15.18:0/368062661 shutdown_connections 2024-09-19T09:15:04.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.300+0000 7f9d312dd640 1 -- 172.21.15.18:0/368062661 wait complete. 2024-09-19T09:15:04.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.301+0000 7f9d312dd640 1 Processor -- start 2024-09-19T09:15:04.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.301+0000 7f9d312dd640 1 -- start start 2024-09-19T09:15:04.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.302+0000 7f9d312dd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d18004d40 0x7f9d2c0b81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:04.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.302+0000 7f9d312dd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d2c15c1a0 0x7f9d2c0b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:04.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.302+0000 7f9d312dd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d2c0b6290 0x7f9d2c070df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:04.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.302+0000 7f9d312dd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c0d0030 con 0x7f9d18004d40 2024-09-19T09:15:04.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.302+0000 7f9d312dd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9d2c0cfd50 con 0x7f9d2c0b6290 2024-09-19T09:15:04.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.302+0000 7f9d312dd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9d2c0cd800 con 0x7f9d2c15c1a0 2024-09-19T09:15:04.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.302+0000 7f9d2affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d18004d40 0x7f9d2c0b81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:04.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.302+0000 7f9d2affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d18004d40 0x7f9d2c0b81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43416/0 (socket says 172.21.15.18:43416) 2024-09-19T09:15:04.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.302+0000 7f9d2affd640 1 -- 172.21.15.18:0/1615806197 learned_addr learned my addr 172.21.15.18:0/1615806197 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:04.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.302+0000 7f9d2a7fc640 1 --2- 172.21.15.18:0/1615806197 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d2c15c1a0 0x7f9d2c0b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:04.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.302+0000 7f9d2b7fe640 1 --2- 172.21.15.18:0/1615806197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d2c0b6290 0x7f9d2c070df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:04.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.303+0000 7f9d2affd640 1 -- 172.21.15.18:0/1615806197 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d2c15c1a0 msgr2=0x7f9d2c0b78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:04.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.303+0000 7f9d2affd640 1 --2- 172.21.15.18:0/1615806197 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d2c15c1a0 0x7f9d2c0b78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:04.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.303+0000 7f9d2affd640 1 -- 172.21.15.18:0/1615806197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d2c0b6290 msgr2=0x7f9d2c070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:04.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.303+0000 7f9d2affd640 1 --2- 172.21.15.18:0/1615806197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d2c0b6290 0x7f9d2c070df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:04.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.303+0000 7f9d2affd640 1 -- 172.21.15.18:0/1615806197 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d2c0b8710 con 0x7f9d18004d40 2024-09-19T09:15:04.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.303+0000 7f9d2affd640 1 --2- 172.21.15.18:0/1615806197 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d18004d40 0x7f9d2c0b81d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009fc0 tx=0x7f9d1c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:04.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.303+0000 7f9d237fe640 1 -- 172.21.15.18:0/1615806197 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c015430 con 0x7f9d18004d40 2024-09-19T09:15:04.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.303+0000 7f9d237fe640 1 -- 172.21.15.18:0/1615806197 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d1c0155d0 con 0x7f9d18004d40 2024-09-19T09:15:04.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.303+0000 7f9d312dd640 1 -- 172.21.15.18:0/1615806197 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d2c0b6830 con 0x7f9d18004d40 2024-09-19T09:15:04.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.303+0000 7f9d237fe640 1 -- 172.21.15.18:0/1615806197 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c0159c0 con 0x7f9d18004d40 2024-09-19T09:15:04.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.303+0000 7f9d312dd640 1 -- 172.21.15.18:0/1615806197 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d2c0b6df0 con 0x7f9d18004d40 2024-09-19T09:15:04.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.304+0000 7f9d312dd640 1 -- 172.21.15.18:0/1615806197 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d2c0cf9e0 con 0x7f9d18004d40 2024-09-19T09:15:04.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.304+0000 7f9d237fe640 1 -- 172.21.15.18:0/1615806197 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9d1c015b60 con 0x7f9d18004d40 2024-09-19T09:15:04.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.305+0000 7f9d237fe640 1 --2- 172.21.15.18:0/1615806197 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9d0c06c2e0 0x7f9d0c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:04.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.305+0000 7f9d237fe640 1 -- 172.21.15.18:0/1615806197 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5709+0+0 (secure 0 0 0) 0x7f9d1c08c330 con 0x7f9d18004d40 2024-09-19T09:15:04.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.305+0000 7f9d237fe640 1 -- 172.21.15.18:0/1615806197 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=54}) -- 0x7f9d0c073e70 con 0x7f9d18004d40 2024-09-19T09:15:04.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.305+0000 7f9d2a7fc640 1 --2- 172.21.15.18:0/1615806197 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9d0c06c2e0 0x7f9d0c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:04.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.306+0000 7f9d2a7fc640 1 --2- 172.21.15.18:0/1615806197 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9d0c06c2e0 0x7f9d0c06e7a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c1f7d70 tx=0x7f9d14009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:04.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.309+0000 7f9d237fe640 1 -- 172.21.15.18:0/1615806197 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9d1c019030 con 0x7f9d18004d40 2024-09-19T09:15:04.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.520+0000 7f9d312dd640 1 -- 172.21.15.18:0/1615806197 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d2c0686d0 con 0x7f9d18004d40 2024-09-19T09:15:04.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.521+0000 7f9d237fe640 1 -- 172.21.15.18:0/1615806197 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5223 (secure 0 0 0) 0x7f9d1c010040 con 0x7f9d18004d40 2024-09-19T09:15:04.521 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:15:04.521 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"btime":"2024-09-19T09:14:46:022043+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4793,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/113686001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":113686001},{"type":"v1","addr":"172.21.15.162:6835","nonce":113686001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":4799,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3269042030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3269042030},{"type":"v1","addr":"172.21.15.162:6837","nonce":3269042030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/3996030837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3996030837},{"type":"v1","addr":"172.21.15.18:6834","nonce":3996030837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:14:43.367290+0000","modified":"2024-09-19T09:14:45.363192+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5187":{"gid":5187,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/295967875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":295967875},{"type":"v1","addr":"172.21.15.18:6835","nonce":295967875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5187,"qdb_cluster":[5187]},"id":3}]} 2024-09-19T09:15:04.522 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 21 2024-09-19T09:15:04.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.523+0000 7f9d312dd640 1 -- 172.21.15.18:0/1615806197 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9d0c06c2e0 msgr2=0x7f9d0c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:04.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.523+0000 7f9d312dd640 1 --2- 172.21.15.18:0/1615806197 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9d0c06c2e0 0x7f9d0c06e7a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c1f7d70 tx=0x7f9d14009190 comp rx=0 tx=0).stop 2024-09-19T09:15:04.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.523+0000 7f9d312dd640 1 -- 172.21.15.18:0/1615806197 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d18004d40 msgr2=0x7f9d2c0b81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:04.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.523+0000 7f9d312dd640 1 --2- 172.21.15.18:0/1615806197 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d18004d40 0x7f9d2c0b81d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009fc0 tx=0x7f9d1c00f580 comp rx=0 tx=0).stop 2024-09-19T09:15:04.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.523+0000 7f9d312dd640 1 -- 172.21.15.18:0/1615806197 shutdown_connections 2024-09-19T09:15:04.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.523+0000 7f9d312dd640 1 --2- 172.21.15.18:0/1615806197 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9d0c06c2e0 0x7f9d0c06e7a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:04.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.523+0000 7f9d312dd640 1 --2- 172.21.15.18:0/1615806197 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9d2c0b6290 0x7f9d2c070df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:04.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.523+0000 7f9d312dd640 1 --2- 172.21.15.18:0/1615806197 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9d2c15c1a0 0x7f9d2c0b78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:04.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.523+0000 7f9d312dd640 1 --2- 172.21.15.18:0/1615806197 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9d18004d40 0x7f9d2c0b81d0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:04.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.523+0000 7f9d312dd640 1 -- 172.21.15.18:0/1615806197 >> 172.21.15.18:0/1615806197 conn(0x7f9d2c0b4560 msgr2=0x7f9d2c0d28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:04.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.523+0000 7f9d312dd640 1 -- 172.21.15.18:0/1615806197 shutdown_connections 2024-09-19T09:15:04.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:04.523+0000 7f9d312dd640 1 -- 172.21.15.18:0/1615806197 wait complete. 2024-09-19T09:15:04.534 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-19T09:15:04.654 INFO:teuthology.orchestra.run.smithi018.stdout:{"cluster_fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","whoami":0,"id":5187,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":20.629181517999999,"mdsmap_epoch":21,"osdmap_epoch":53,"osdmap_epoch_barrier":52,"uptime":31.620016973999999} 2024-09-19T09:15:04.655 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", "fs_name": "cephfs", "id": 5187, "mdsmap_epoch": 21, "osdmap_epoch": 53, "osdmap_epoch_barrier": 52, "rank_uptime": 20.629181518, "state": "up:active", "uptime": 31.620016974, "want_state": "up:active", "whoami": 0 } 2024-09-19T09:15:04.655 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-19T09:15:04.655 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:15:04.655 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:15:04.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:15:04.671 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2024-09-19T09:15:04.727 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:15:04.727 INFO:teuthology.orchestra.run.smithi018.stderr:dd: failed to open 'small_file_1': Permission denied 2024-09-19T09:15:04.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:15:04.728 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2024-09-19T09:15:04.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:15:04.786 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2024-09-19T09:15:04.861 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-19T09:15:05.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.004+0000 7f5229d91640 1 Processor -- start 2024-09-19T09:15:05.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.004+0000 7f5229d91640 1 -- start start 2024-09-19T09:15:05.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.004+0000 7f5229d91640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52241630f0 0x7f52240cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:05.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.004+0000 7f5229d91640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52240d0a10 con 0x7f522415ed30 2024-09-19T09:15:05.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.005+0000 7f5229d91640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5224070ab0 con 0x7f52240b5200 2024-09-19T09:15:05.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.005+0000 7f5229d91640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f52240d0cb0 con 0x7f52241630f0 2024-09-19T09:15:05.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.005+0000 7f52237fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f522415ed30 0x7f5224070260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:47336/0 (socket says 172.21.15.18:47336) 2024-09-19T09:15:05.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.005+0000 7f52237fe640 1 -- 172.21.15.18:0/735289732 learned_addr learned my addr 172.21.15.18:0/735289732 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:15:05.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.005+0000 7f5223fff640 1 --2- 172.21.15.18:0/735289732 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52241630f0 0x7f52240cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:05.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.005+0000 7f52227fc640 1 -- 172.21.15.18:0/735289732 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3741410601 0 0) 0x7f52240d0a10 con 0x7f522415ed30 2024-09-19T09:15:05.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.005+0000 7f52227fc640 1 -- 172.21.15.18:0/735289732 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5210003520 con 0x7f522415ed30 2024-09-19T09:15:05.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.005+0000 7f52227fc640 1 -- 172.21.15.18:0/735289732 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3491997759 0 0) 0x7f5224070ab0 con 0x7f52240b5200 2024-09-19T09:15:05.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.005+0000 7f52227fc640 1 -- 172.21.15.18:0/735289732 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52240d0a10 con 0x7f52240b5200 2024-09-19T09:15:05.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.005+0000 7f52227fc640 1 -- 172.21.15.18:0/735289732 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 39157813 0 0) 0x7f5210003520 con 0x7f522415ed30 2024-09-19T09:15:05.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.005+0000 7f52227fc640 1 -- 172.21.15.18:0/735289732 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52241630f0 msgr2=0x7f52240cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:05.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.005+0000 7f52227fc640 1 --2- 172.21.15.18:0/735289732 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52241630f0 0x7f52240cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:05.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.005+0000 7f52227fc640 1 -- 172.21.15.18:0/735289732 >> v1:172.21.15.162:6789/0 conn(0x7f52240b5200 legacy=0x7f52241629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:05.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.005+0000 7f52227fc640 1 -- 172.21.15.18:0/735289732 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52240d0f90 con 0x7f522415ed30 2024-09-19T09:15:05.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.005+0000 7f52227fc640 1 -- 172.21.15.18:0/735289732 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f5214001670 con 0x7f522415ed30 2024-09-19T09:15:05.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.005+0000 7f52227fc640 1 -- 172.21.15.18:0/735289732 >> v1:172.21.15.18:6789/0 conn(0x7f522415ed30 legacy=0x7f5224070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:05.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.005+0000 7f52227fc640 1 --2- 172.21.15.18:0/735289732 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5210003b70 0x7f5210003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:05.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.005+0000 7f52227fc640 1 --2- 172.21.15.18:0/735289732 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5210004800 0x7f5210004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:05.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.005+0000 7f52227fc640 1 --2- 172.21.15.18:0/735289732 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52100051c0 0x7f521000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:05.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.005+0000 7f52227fc640 1 -- 172.21.15.18:0/735289732 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f52240d0cb0 con 0x7f52100051c0 2024-09-19T09:15:05.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.005+0000 7f52227fc640 1 -- 172.21.15.18:0/735289732 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f521000bf30 con 0x7f5210003b70 2024-09-19T09:15:05.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.005+0000 7f52227fc640 1 -- 172.21.15.18:0/735289732 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f521000c130 con 0x7f5210004800 2024-09-19T09:15:05.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.005+0000 7f5223fff640 1 --2- 172.21.15.18:0/735289732 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52241630f0 0x7f52240cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:15:05.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.006+0000 7f52237fe640 1 --2- 172.21.15.18:0/735289732 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5210003b70 0x7f5210003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:05.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.006+0000 7f5223fff640 1 --2- 172.21.15.18:0/735289732 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52100051c0 0x7f521000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:05.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.006+0000 7f5222ffd640 1 --2- 172.21.15.18:0/735289732 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5210004800 0x7f5210004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:05.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.006+0000 7f5223fff640 1 -- 172.21.15.18:0/735289732 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5210004800 msgr2=0x7f5210004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:05.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.006+0000 7f5223fff640 1 --2- 172.21.15.18:0/735289732 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5210004800 0x7f5210004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:05.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.006+0000 7f5223fff640 1 -- 172.21.15.18:0/735289732 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5210003b70 msgr2=0x7f5210003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:05.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.006+0000 7f5223fff640 1 --2- 172.21.15.18:0/735289732 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5210003b70 0x7f5210003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:05.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.006+0000 7f5223fff640 1 -- 172.21.15.18:0/735289732 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5210003520 con 0x7f52100051c0 2024-09-19T09:15:05.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.006+0000 7f52237fe640 1 --2- 172.21.15.18:0/735289732 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5210003b70 0x7f5210003f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:15:05.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.007+0000 7f5223fff640 1 --2- 172.21.15.18:0/735289732 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52100051c0 0x7f521000b9c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f521c00e1f0 tx=0x7f5210005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f489f5fd4a0e63 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:05.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.007+0000 7f52227fc640 1 -- 172.21.15.18:0/735289732 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521c009d40 con 0x7f52100051c0 2024-09-19T09:15:05.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.007+0000 7f52227fc640 1 -- 172.21.15.18:0/735289732 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f521c035070 con 0x7f52100051c0 2024-09-19T09:15:05.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.007+0000 7f52227fc640 1 -- 172.21.15.18:0/735289732 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521c004030 con 0x7f52100051c0 2024-09-19T09:15:05.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.007+0000 7f5229d91640 1 -- 172.21.15.18:0/735289732 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52100051c0 msgr2=0x7f521000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:05.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.007+0000 7f5229d91640 1 --2- 172.21.15.18:0/735289732 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52100051c0 0x7f521000b9c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f521c00e1f0 tx=0x7f5210005830 comp rx=0 tx=0).stop 2024-09-19T09:15:05.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.007+0000 7f5223fff640 1 -- 172.21.15.18:0/735289732 reap_dead start 2024-09-19T09:15:05.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.007+0000 7f5229d91640 1 -- 172.21.15.18:0/735289732 shutdown_connections 2024-09-19T09:15:05.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.007+0000 7f5229d91640 1 -- 172.21.15.18:0/735289732 >> 172.21.15.18:0/735289732 conn(0x7f52240b4600 msgr2=0x7f52240b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:05.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.007+0000 7f5229d91640 1 -- 172.21.15.18:0/735289732 shutdown_connections 2024-09-19T09:15:05.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.007+0000 7f5229d91640 1 -- 172.21.15.18:0/735289732 wait complete. 2024-09-19T09:15:05.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.008+0000 7f5229d91640 1 Processor -- start 2024-09-19T09:15:05.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.009+0000 7f5229d91640 1 -- start start 2024-09-19T09:15:05.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.009+0000 7f5229d91640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52100051c0 0x7f52241f88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:05.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.009+0000 7f5229d91640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52240cebb0 0x7f522415a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:05.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.009+0000 7f5229d91640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52240cf290 0x7f52240cf710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:05.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.009+0000 7f5229d91640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f522415f290 con 0x7f52240cf290 2024-09-19T09:15:05.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.009+0000 7f5229d91640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f522415f110 con 0x7f52100051c0 2024-09-19T09:15:05.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.009+0000 7f5229d91640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f52240d24c0 con 0x7f52240cebb0 2024-09-19T09:15:05.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.010+0000 7f5223fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52240cf290 0x7f52240cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:05.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.010+0000 7f5223fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52240cf290 0x7f52240cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:43430/0 (socket says 172.21.15.18:43430) 2024-09-19T09:15:05.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.010+0000 7f5223fff640 1 -- 172.21.15.18:0/2788521290 learned_addr learned my addr 172.21.15.18:0/2788521290 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:05.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.010+0000 7f52237fe640 1 --2- 172.21.15.18:0/2788521290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52100051c0 0x7f52241f88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:05.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.010+0000 7f5222ffd640 1 --2- 172.21.15.18:0/2788521290 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52240cebb0 0x7f522415a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:05.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.010+0000 7f5223fff640 1 -- 172.21.15.18:0/2788521290 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52240cebb0 msgr2=0x7f522415a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:05.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.010+0000 7f5223fff640 1 --2- 172.21.15.18:0/2788521290 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52240cebb0 0x7f522415a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:05.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.010+0000 7f5223fff640 1 -- 172.21.15.18:0/2788521290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52100051c0 msgr2=0x7f52241f88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:05.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.010+0000 7f5223fff640 1 --2- 172.21.15.18:0/2788521290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52100051c0 0x7f52241f88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:05.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.010+0000 7f5223fff640 1 -- 172.21.15.18:0/2788521290 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52240c8dd0 con 0x7f52240cf290 2024-09-19T09:15:05.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.010+0000 7f5222ffd640 1 --2- 172.21.15.18:0/2788521290 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52240cebb0 0x7f522415a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:05.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.010+0000 7f5223fff640 1 --2- 172.21.15.18:0/2788521290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52240cf290 0x7f52240cf710 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f521c00e310 tx=0x7f521c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:05.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.010+0000 7f521bfff640 1 -- 172.21.15.18:0/2788521290 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5214007cc0 con 0x7f52240cf290 2024-09-19T09:15:05.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.010+0000 7f521bfff640 1 -- 172.21.15.18:0/2788521290 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f521c03c420 con 0x7f52240cf290 2024-09-19T09:15:05.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.010+0000 7f5229d91640 1 -- 172.21.15.18:0/2788521290 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52240c9350 con 0x7f52240cf290 2024-09-19T09:15:05.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.010+0000 7f521bfff640 1 -- 172.21.15.18:0/2788521290 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f521c009d40 con 0x7f52240cf290 2024-09-19T09:15:05.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.010+0000 7f5229d91640 1 -- 172.21.15.18:0/2788521290 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52240c9070 con 0x7f52240cf290 2024-09-19T09:15:05.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.011+0000 7f5229d91640 1 -- 172.21.15.18:0/2788521290 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5224070ab0 con 0x7f52240cf290 2024-09-19T09:15:05.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.012+0000 7f521bfff640 1 -- 172.21.15.18:0/2788521290 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f521c005d10 con 0x7f52240cf290 2024-09-19T09:15:05.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.012+0000 7f521bfff640 1 --2- 172.21.15.18:0/2788521290 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f520406c2b0 0x7f520406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:05.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.012+0000 7f521bfff640 1 -- 172.21.15.18:0/2788521290 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5709+0+0 (secure 0 0 0) 0x7f521c0ac6e0 con 0x7f52240cf290 2024-09-19T09:15:05.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.012+0000 7f521bfff640 1 -- 172.21.15.18:0/2788521290 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=54}) -- 0x7f5204073de0 con 0x7f52240cf290 2024-09-19T09:15:05.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.012+0000 7f52237fe640 1 --2- 172.21.15.18:0/2788521290 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f520406c2b0 0x7f520406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:05.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.013+0000 7f52237fe640 1 --2- 172.21.15.18:0/2788521290 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f520406c2b0 0x7f520406e770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5214001030 tx=0x7f5214007b80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:05.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.016+0000 7f521bfff640 1 -- 172.21.15.18:0/2788521290 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f521c07a770 con 0x7f52240cf290 2024-09-19T09:15:05.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.079+0000 7f521bfff640 1 -- 172.21.15.18:0/2788521290 <== mon.0 v2:172.21.15.18:3300/0 7 ==== osd_map(54..54 src has 1..54) ==== 296+0+0 (secure 0 0 0) 0x7f521c0e0da0 con 0x7f52240cf290 2024-09-19T09:15:05.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.079+0000 7f521bfff640 1 -- 172.21.15.18:0/2788521290 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=55}) -- 0x7f52040746d0 con 0x7f52240cf290 2024-09-19T09:15:05.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.196+0000 7f5229d91640 1 -- 172.21.15.18:0/2788521290 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f52240686d0 con 0x7f52240cf290 2024-09-19T09:15:05.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.198+0000 7f521bfff640 1 -- 172.21.15.18:0/2788521290 <== mon.0 v2:172.21.15.18:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v54) ==== 81+0+34395 (secure 0 0 0) 0x7f521c07ea70 con 0x7f52240cf290 2024-09-19T09:15:05.198 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:15:05.199 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:15:05.199 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 54, 2024-09-19T09:15:05.199 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:15:05.199 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-19T09:13:11.348786+0000", 2024-09-19T09:15:05.199 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-19T09:15:05.078800+0000", 2024-09-19T09:15:05.199 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-19T09:13:16.423937+0000", 2024-09-19T09:15:05.199 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-19T09:13:13.417141+0000", 2024-09-19T09:15:05.199 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-19T09:15:05.199 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-09-19T09:15:05.199 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-19T09:15:05.199 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-19T09:15:05.199 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-19T09:15:05.200 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-19T09:15:05.200 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-19T09:15:05.200 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:15:05.200 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-19T09:15:05.200 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.69999998807907104, 2024-09-19T09:15:05.200 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-19T09:15:05.200 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-19T09:15:05.200 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-19T09:15:05.200 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 7, 2024-09-19T09:15:05.200 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-19T09:15:05.200 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-19T09:15:05.200 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "jewel", 2024-09-19T09:15:05.200 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-19T09:15:05.201 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-19T09:15:05.201 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-19T09:15:05.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.201 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-19T09:15:05.201 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-19T09:15:05.201 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:13:17.564717+0000", 2024-09-19T09:15:05.201 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 3, 2024-09-19T09:15:05.201 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full", 2024-09-19T09:15:05.201 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:15:05.201 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:15:05.201 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:15:05.201 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:15:05.201 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:15:05.202 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:15:05.202 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:15:05.202 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:15:05.202 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:15:05.202 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:15:05.202 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:15:05.202 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-19T09:15:05.202 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-19T09:15:05.202 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-19T09:15:05.202 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-19T09:15:05.202 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-19T09:15:05.202 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:15:05.202 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:15:05.202 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:15:05.202 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:15:05.203 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:15:05.203 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:15:05.203 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:15:05.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.203 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "49", 2024-09-19T09:15:05.203 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:15:05.203 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:15:05.203 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:15:05.203 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:15:05.203 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:15:05.203 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:15:05.203 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:15:05.204 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:15:05.204 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:15:05.204 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:15:05.204 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:15:05.204 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:15:05.204 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:15:05.204 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:15:05.204 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:15:05.204 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:15:05.204 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:15:05.204 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:15:05.204 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:15:05.204 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:15:05.204 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:15:05.205 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:15:05.205 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:15:05.205 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:15:05.205 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:15:05.205 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:15:05.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.205 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:15:05.205 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:15:05.205 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:15:05.205 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:15:05.205 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:15:05.205 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:15:05.205 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:15:05.206 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:15:05.206 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:15:05.206 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:15:05.206 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:15:05.206 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:15:05.206 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-19T09:15:05.206 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-19T09:15:05.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.206 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:15:05.206 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-19T09:15:05.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.206 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:15:05.206 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:15:05.206 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-19T09:15:05.207 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-19T09:15:05.207 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-19T09:15:05.207 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-19T09:15:05.207 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-19T09:15:05.207 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:15:05.207 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:15:05.207 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:15:05.207 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.207 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.207 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 6, 2024-09-19T09:15:05.207 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_metadata", 2024-09-19T09:15:05.208 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:14:41.948276+0000", 2024-09-19T09:15:05.208 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 3, 2024-09-19T09:15:05.208 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full", 2024-09-19T09:15:05.208 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:15:05.208 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:15:05.208 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:15:05.208 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:15:05.208 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:15:05.208 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:15:05.208 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:15:05.208 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:15:05.208 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:15:05.208 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:15:05.208 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:15:05.209 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-19T09:15:05.209 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-19T09:15:05.209 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-19T09:15:05.209 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-19T09:15:05.209 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-19T09:15:05.209 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:15:05.209 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:15:05.209 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:15:05.209 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:15:05.209 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:15:05.209 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:15:05.209 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:15:05.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.210 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "49", 2024-09-19T09:15:05.210 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:15:05.210 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:15:05.210 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:15:05.210 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:15:05.210 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:15:05.210 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:15:05.210 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:15:05.210 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:15:05.210 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:15:05.210 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:15:05.210 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:15:05.210 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:15:05.211 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:15:05.211 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:15:05.211 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:15:05.211 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:15:05.211 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:15:05.211 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:15:05.211 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:15:05.211 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:15:05.211 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:15:05.211 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:15:05.211 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:15:05.211 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:15:05.211 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:15:05.211 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:15:05.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.212 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:15:05.212 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:15:05.212 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:15:05.212 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:15:05.212 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:15:05.212 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:15:05.212 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:15:05.212 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:15:05.212 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:15:05.212 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:15:05.212 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:15:05.212 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:15:05.212 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4, 2024-09-19T09:15:05.213 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 16, 2024-09-19T09:15:05.213 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_priority": 5 2024-09-19T09:15:05.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.213 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:15:05.213 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:15:05.213 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": "cephfs" 2024-09-19T09:15:05.213 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.213 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:15:05.213 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:15:05.213 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.5, 2024-09-19T09:15:05.213 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.5, 2024-09-19T09:15:05.213 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:15:05.214 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.5, 2024-09-19T09:15:05.214 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.5, 2024-09-19T09:15:05.214 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:15:05.214 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:15:05.214 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:15:05.214 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.214 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 7, 2024-09-19T09:15:05.214 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_data", 2024-09-19T09:15:05.214 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:14:42.341949+0000", 2024-09-19T09:15:05.214 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 3, 2024-09-19T09:15:05.214 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full", 2024-09-19T09:15:05.214 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:15:05.215 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:15:05.215 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:15:05.215 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:15:05.215 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:15:05.215 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:15:05.215 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:15:05.215 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:15:05.215 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:15:05.215 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:15:05.215 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:15:05.215 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 64, 2024-09-19T09:15:05.215 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 64, 2024-09-19T09:15:05.215 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 64, 2024-09-19T09:15:05.216 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 64, 2024-09-19T09:15:05.216 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 64, 2024-09-19T09:15:05.216 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:15:05.216 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:15:05.216 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:15:05.216 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:15:05.216 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:15:05.216 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:15:05.216 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:15:05.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.216 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "49", 2024-09-19T09:15:05.216 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:15:05.216 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:15:05.217 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:15:05.217 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:15:05.217 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:15:05.217 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:15:05.217 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:15:05.217 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:15:05.217 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:15:05.217 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:15:05.217 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:15:05.217 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:15:05.217 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:15:05.217 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:15:05.217 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:15:05.218 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:15:05.218 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:15:05.218 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:15:05.218 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:15:05.218 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:15:05.218 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:15:05.218 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:15:05.218 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:15:05.218 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:15:05.218 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:15:05.218 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:15:05.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.218 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:15:05.219 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:15:05.219 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:15:05.219 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:15:05.219 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:15:05.219 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:15:05.219 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:15:05.219 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:15:05.219 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:15:05.219 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:15:05.219 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:15:05.219 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:15:05.219 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 64, 2024-09-19T09:15:05.219 INFO:teuthology.orchestra.run.smithi018.stdout: "target_size_ratio": 0.89999997615814209 2024-09-19T09:15:05.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.220 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:15:05.220 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:15:05.220 INFO:teuthology.orchestra.run.smithi018.stdout: "data": "cephfs" 2024-09-19T09:15:05.220 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.220 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:15:05.220 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:15:05.220 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.75, 2024-09-19T09:15:05.220 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.75, 2024-09-19T09:15:05.220 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:15:05.220 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.75, 2024-09-19T09:15:05.220 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.75, 2024-09-19T09:15:05.220 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:15:05.221 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:15:05.221 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:15:05.221 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.221 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.221 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:15:05.221 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-19T09:15:05.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.221 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:15:05.221 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:05.221 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:05.221 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:05.221 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:05.221 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:05.222 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:05.222 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:05.222 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:05.222 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:05.222 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:05.222 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:05.222 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:05.222 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.222 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.222 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-19T09:15:05.222 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:05.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.223 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.223 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-19T09:15:05.223 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:05.223 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.223 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.223 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:05.223 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.223 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.223 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-19T09:15:05.223 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:05.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.224 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.224 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-19T09:15:05.224 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:05.224 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.224 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.224 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:05.224 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.224 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.224 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-19T09:15:05.224 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:05.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.225 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.225 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-19T09:15:05.225 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:05.225 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.225 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.225 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:05.225 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.225 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.225 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-19T09:15:05.225 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:05.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.226 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.226 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-19T09:15:05.226 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:05.226 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.226 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.226 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/128722874", 2024-09-19T09:15:05.226 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/128722874", 2024-09-19T09:15:05.226 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/128722874", 2024-09-19T09:15:05.226 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/128722874", 2024-09-19T09:15:05.226 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:05.226 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:05.227 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:05.227 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.227 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:15:05.227 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:05.227 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:05.227 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:05.227 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:05.227 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:05.227 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:05.227 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:05.227 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:05.227 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:05.228 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:05.228 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:05.228 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:05.228 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.228 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.228 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-19T09:15:05.228 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:05.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.228 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.228 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-19T09:15:05.228 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:05.229 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.229 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.229 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:05.229 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.229 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.229 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-19T09:15:05.229 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:05.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.229 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.229 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-19T09:15:05.229 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:05.230 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.230 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.230 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:05.230 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.230 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.230 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-19T09:15:05.230 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:05.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.230 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.230 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-19T09:15:05.230 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:05.231 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.231 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.231 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:05.231 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.231 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.231 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-19T09:15:05.231 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:05.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.231 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.231 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-19T09:15:05.231 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:05.232 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.232 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.232 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/3672199638", 2024-09-19T09:15:05.232 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/3672199638", 2024-09-19T09:15:05.232 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/3672199638", 2024-09-19T09:15:05.232 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/3672199638", 2024-09-19T09:15:05.232 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:05.232 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull", 2024-09-19T09:15:05.232 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:05.232 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:05.232 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.233 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:15:05.233 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:05.233 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:05.233 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:05.233 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:05.233 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:05.233 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:05.233 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:05.233 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:05.233 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:05.233 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:05.233 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:05.233 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:05.234 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.234 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.234 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T09:15:05.234 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:05.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.234 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.234 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T09:15:05.234 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:05.234 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.234 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.235 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:05.235 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.235 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.235 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-19T09:15:05.235 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:05.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.235 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.235 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-19T09:15:05.235 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:05.235 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.235 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.236 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:05.236 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.236 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.236 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-19T09:15:05.236 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:05.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.236 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.236 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-19T09:15:05.236 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:05.236 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.236 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.237 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:05.237 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.237 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.237 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-19T09:15:05.237 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:05.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.237 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.237 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-19T09:15:05.237 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:05.237 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.237 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.238 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3463367841", 2024-09-19T09:15:05.238 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3463367841", 2024-09-19T09:15:05.238 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3463367841", 2024-09-19T09:15:05.238 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3463367841", 2024-09-19T09:15:05.238 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:05.238 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:05.238 INFO:teuthology.orchestra.run.smithi018.stdout: "full", 2024-09-19T09:15:05.238 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:05.238 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.240 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:15:05.240 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:05.240 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:05.240 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:05.240 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:05.240 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:05.240 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:05.240 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:05.240 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:05.240 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:05.240 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:05.241 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:05.241 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:05.241 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.241 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.241 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-19T09:15:05.241 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:05.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.241 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.241 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-19T09:15:05.241 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:05.241 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.241 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.242 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:05.242 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.242 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.242 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-19T09:15:05.242 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:05.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.242 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.242 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-19T09:15:05.242 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:05.242 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.242 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.243 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:05.243 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.243 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.243 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-19T09:15:05.243 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:05.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.243 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.243 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-19T09:15:05.243 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:05.243 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.244 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.244 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:05.244 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.244 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.244 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-19T09:15:05.244 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:05.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.244 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.244 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-19T09:15:05.244 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:05.245 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.245 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.245 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/4163178582", 2024-09-19T09:15:05.245 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/4163178582", 2024-09-19T09:15:05.245 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/4163178582", 2024-09-19T09:15:05.245 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/4163178582", 2024-09-19T09:15:05.245 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:05.245 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull", 2024-09-19T09:15:05.245 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:05.245 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:05.245 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.246 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:15:05.246 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:05.246 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:05.246 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:05.246 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:05.246 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:05.246 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:05.246 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:05.246 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:05.246 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:05.246 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:05.246 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:05.246 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:05.247 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.247 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.247 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6822", 2024-09-19T09:15:05.247 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:05.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.247 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.247 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6824", 2024-09-19T09:15:05.247 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:05.247 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.247 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.247 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:05.248 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.248 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.248 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6826", 2024-09-19T09:15:05.248 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:05.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.248 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.248 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6827", 2024-09-19T09:15:05.248 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:05.248 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.248 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.249 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:05.249 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.249 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.249 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6830", 2024-09-19T09:15:05.249 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:05.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.249 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.249 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6831", 2024-09-19T09:15:05.249 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:05.249 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.249 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.250 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:05.250 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.250 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.250 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6828", 2024-09-19T09:15:05.250 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:05.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.250 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.250 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6829", 2024-09-19T09:15:05.250 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:05.250 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.251 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.251 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6824/3538482215", 2024-09-19T09:15:05.251 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6827/3538482215", 2024-09-19T09:15:05.251 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6831/3538482215", 2024-09-19T09:15:05.251 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6829/3538482215", 2024-09-19T09:15:05.251 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:05.251 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:05.251 INFO:teuthology.orchestra.run.smithi018.stdout: "full", 2024-09-19T09:15:05.251 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:05.251 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.251 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:15:05.252 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:05.252 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:05.252 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:05.252 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:05.252 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:05.252 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:05.252 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:05.252 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:05.252 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:05.252 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:05.252 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:05.252 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:05.252 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.253 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.253 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6800", 2024-09-19T09:15:05.253 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:05.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.253 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.253 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6801", 2024-09-19T09:15:05.253 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:05.253 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.253 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.253 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:05.253 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.254 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.254 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6802", 2024-09-19T09:15:05.254 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:05.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.254 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.254 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6803", 2024-09-19T09:15:05.254 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:05.254 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.254 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.254 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:05.254 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.255 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.255 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6806", 2024-09-19T09:15:05.255 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:05.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.255 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.255 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6807", 2024-09-19T09:15:05.255 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:05.255 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.255 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.255 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:05.256 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.256 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.256 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6804", 2024-09-19T09:15:05.256 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:05.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.256 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.256 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6805", 2024-09-19T09:15:05.256 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:05.256 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.256 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.256 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6801/2408698413", 2024-09-19T09:15:05.257 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6803/2408698413", 2024-09-19T09:15:05.257 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6807/2408698413", 2024-09-19T09:15:05.257 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6805/2408698413", 2024-09-19T09:15:05.257 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:05.257 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:05.257 INFO:teuthology.orchestra.run.smithi018.stdout: "full", 2024-09-19T09:15:05.257 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:05.257 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.257 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:15:05.257 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:05.257 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:05.257 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:05.258 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:05.258 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:05.258 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:05.258 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:05.258 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:05.258 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:05.258 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:05.258 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:05.258 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:05.258 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.258 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.258 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6808", 2024-09-19T09:15:05.259 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:05.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.259 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.259 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6809", 2024-09-19T09:15:05.259 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:05.259 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.259 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.259 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:05.259 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.259 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.259 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6810", 2024-09-19T09:15:05.260 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:05.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.260 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.260 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6811", 2024-09-19T09:15:05.260 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:05.260 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.260 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.260 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:05.260 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.260 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.261 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6814", 2024-09-19T09:15:05.261 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:05.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.261 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.261 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6815", 2024-09-19T09:15:05.261 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:05.261 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.261 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.261 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:05.261 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.261 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.262 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6812", 2024-09-19T09:15:05.262 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:05.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.262 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.262 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6813", 2024-09-19T09:15:05.262 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:05.262 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.262 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.262 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6809/2596207948", 2024-09-19T09:15:05.262 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6811/2596207948", 2024-09-19T09:15:05.262 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6815/2596207948", 2024-09-19T09:15:05.262 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6813/2596207948", 2024-09-19T09:15:05.263 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:05.263 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:05.263 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:05.263 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.263 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:15:05.263 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:05.263 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:05.263 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:05.264 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:05.264 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:05.264 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:05.264 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:05.264 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:05.264 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:05.264 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:05.264 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:05.264 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:05.264 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.264 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.264 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6816", 2024-09-19T09:15:05.265 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:05.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.265 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.265 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6817", 2024-09-19T09:15:05.265 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:05.265 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.265 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.265 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:05.265 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.265 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.265 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6818", 2024-09-19T09:15:05.266 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:05.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.266 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.266 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6819", 2024-09-19T09:15:05.266 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:05.266 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.266 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.266 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:05.266 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.266 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.267 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6823", 2024-09-19T09:15:05.267 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:05.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.267 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.267 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6825", 2024-09-19T09:15:05.267 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:05.267 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.267 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.267 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:05.267 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:05.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.268 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:05.268 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6820", 2024-09-19T09:15:05.268 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:05.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.268 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:05.268 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6821", 2024-09-19T09:15:05.268 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:05.268 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.268 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.268 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6817/1334618296", 2024-09-19T09:15:05.268 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6819/1334618296", 2024-09-19T09:15:05.268 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6825/1334618296", 2024-09-19T09:15:05.269 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6821/1334618296", 2024-09-19T09:15:05.269 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:05.269 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull", 2024-09-19T09:15:05.269 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:05.269 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:05.269 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:05.269 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.269 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:15:05.269 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-19T09:15:05.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.269 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:15:05.269 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:05.270 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:05.270 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:05.270 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:05.270 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:05.270 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.580838+0000", 2024-09-19T09:15:05.270 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:05.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.270 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:15:05.270 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:05.270 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:05.270 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:05.270 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:05.270 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:05.271 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.599990+0000", 2024-09-19T09:15:05.271 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:05.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.271 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:15:05.271 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:05.271 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:05.271 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:05.271 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:05.271 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:05.271 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.503722+0000", 2024-09-19T09:15:05.271 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:05.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.272 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:15:05.272 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:05.272 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:05.272 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:05.272 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:05.272 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:05.272 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.607846+0000", 2024-09-19T09:15:05.272 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:05.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.272 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.272 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:15:05.272 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:05.272 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:05.273 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:05.273 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:05.273 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:05.273 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.616858+0000", 2024-09-19T09:15:05.273 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:05.273 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.273 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:15:05.273 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:05.273 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:05.273 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:05.273 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:05.273 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:05.274 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.542726+0000", 2024-09-19T09:15:05.274 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:05.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.274 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:15:05.274 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:05.274 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:05.274 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:05.274 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:05.274 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:05.274 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.534178+0000", 2024-09-19T09:15:05.274 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:05.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:05.275 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:15:05.275 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:05.275 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:05.275 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:05.275 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:05.275 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:05.275 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.612105+0000", 2024-09-19T09:15:05.275 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:05.275 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.275 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:15:05.275 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-19T09:15:05.275 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-19T09:15:05.275 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-19T09:15:05.275 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-19T09:15:05.276 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-19T09:15:05.276 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-19T09:15:05.276 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-19T09:15:05.276 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-19T09:15:05.276 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-19T09:15:05.276 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-19T09:15:05.276 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-19T09:15:05.276 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-19T09:15:05.276 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-19T09:15:05.276 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-19T09:15:05.276 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:05.276 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-19T09:15:05.277 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-19T09:15:05.277 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-19T09:15:05.277 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-19T09:15:05.277 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-19T09:15:05.277 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-19T09:15:05.277 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-19T09:15:05.277 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-19T09:15:05.277 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-19T09:15:05.277 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-19T09:15:05.277 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-19T09:15:05.277 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:05.277 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:15:05.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.200+0000 7f5229d91640 1 -- 172.21.15.18:0/2788521290 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f520406c2b0 msgr2=0x7f520406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:05.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.200+0000 7f5229d91640 1 --2- 172.21.15.18:0/2788521290 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f520406c2b0 0x7f520406e770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f5214001030 tx=0x7f5214007b80 comp rx=0 tx=0).stop 2024-09-19T09:15:05.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.200+0000 7f5229d91640 1 -- 172.21.15.18:0/2788521290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52240cf290 msgr2=0x7f52240cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:05.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.200+0000 7f5229d91640 1 --2- 172.21.15.18:0/2788521290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52240cf290 0x7f52240cf710 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f521c00e310 tx=0x7f521c009750 comp rx=0 tx=0).stop 2024-09-19T09:15:05.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.200+0000 7f5229d91640 1 -- 172.21.15.18:0/2788521290 shutdown_connections 2024-09-19T09:15:05.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.200+0000 7f5229d91640 1 --2- 172.21.15.18:0/2788521290 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f520406c2b0 0x7f520406e770 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:05.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.200+0000 7f5229d91640 1 --2- 172.21.15.18:0/2788521290 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f52240cf290 0x7f52240cf710 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:05.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.200+0000 7f5229d91640 1 --2- 172.21.15.18:0/2788521290 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f52240cebb0 0x7f522415a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:05.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.200+0000 7f5229d91640 1 --2- 172.21.15.18:0/2788521290 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52100051c0 0x7f52241f88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:05.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.200+0000 7f5229d91640 1 -- 172.21.15.18:0/2788521290 >> 172.21.15.18:0/2788521290 conn(0x7f52240b4600 msgr2=0x7f52240b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:05.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.200+0000 7f5229d91640 1 -- 172.21.15.18:0/2788521290 shutdown_connections 2024-09-19T09:15:05.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:05.200+0000 7f5229d91640 1 -- 172.21.15.18:0/2788521290 wait complete. 2024-09-19T09:15:05.280 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-19T09:15:06.153 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-19T09:15:06.153+0000 7fca8cfa1640 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2024-09-19T09:15:10.281 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-19T09:15:10.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.396+0000 7f33a0eac640 1 Processor -- start 2024-09-19T09:15:10.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.397+0000 7f33a0eac640 1 -- start start 2024-09-19T09:15:10.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.398+0000 7f33a0eac640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f339c145290 0x7f339c06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:10.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.398+0000 7f33a0eac640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f339c0ce780 0x7f339c072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:10.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.398+0000 7f33a0eac640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f339c071510 0x7f339c072d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:10.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.398+0000 7f33a0eac640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f339c06efe0 con 0x7f339c145290 2024-09-19T09:15:10.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.398+0000 7f33a0eac640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f339c06e3d0 con 0x7f339c071510 2024-09-19T09:15:10.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.398+0000 7f33a0eac640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f339c06e6b0 con 0x7f339c0ce780 2024-09-19T09:15:10.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.398+0000 7f339a59c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f339c145290 0x7f339c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:10.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.398+0000 7f339a59c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f339c145290 0x7f339c06f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40464/0 (socket says 172.21.15.18:40464) 2024-09-19T09:15:10.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.398+0000 7f339a59c640 1 -- 172.21.15.18:0/1687910946 learned_addr learned my addr 172.21.15.18:0/1687910946 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:10.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.398+0000 7f339ad9d640 1 --2- 172.21.15.18:0/1687910946 >> v2:172.21.15.162:3300/0 conn(0x7f339c071510 0x7f339c072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:10.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.398+0000 7f339a59c640 1 -- 172.21.15.18:0/1687910946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f339c0ce780 msgr2=0x7f339c072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:10.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.398+0000 7f3399d9b640 1 --2- 172.21.15.18:0/1687910946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f339c0ce780 0x7f339c072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:10.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.398+0000 7f339a59c640 1 --2- 172.21.15.18:0/1687910946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f339c0ce780 0x7f339c072830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:10.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.398+0000 7f339a59c640 1 -- 172.21.15.18:0/1687910946 >> v2:172.21.15.162:3300/0 conn(0x7f339c071510 msgr2=0x7f339c072d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:10.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.398+0000 7f339a59c640 1 --2- 172.21.15.18:0/1687910946 >> v2:172.21.15.162:3300/0 conn(0x7f339c071510 0x7f339c072d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:10.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.398+0000 7f339a59c640 1 -- 172.21.15.18:0/1687910946 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f339c06e990 con 0x7f339c145290 2024-09-19T09:15:10.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.398+0000 7f339ad9d640 1 --2- 172.21.15.18:0/1687910946 >> v2:172.21.15.162:3300/0 conn(0x7f339c071510 0x7f339c072d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:15:10.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.398+0000 7f3399d9b640 1 --2- 172.21.15.18:0/1687910946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f339c0ce780 0x7f339c072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:15:10.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.399+0000 7f339a59c640 1 --2- 172.21.15.18:0/1687910946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f339c145290 0x7f339c06f470 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f339c0714a0 tx=0x7f339402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=843c1340f73a26f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:10.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.399+0000 7f339959a640 1 -- 172.21.15.18:0/1687910946 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3394036070 con 0x7f339c145290 2024-09-19T09:15:10.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.399+0000 7f339959a640 1 -- 172.21.15.18:0/1687910946 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3394031600 con 0x7f339c145290 2024-09-19T09:15:10.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.399+0000 7f339959a640 1 -- 172.21.15.18:0/1687910946 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33940319d0 con 0x7f339c145290 2024-09-19T09:15:10.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.400+0000 7f33a0eac640 1 -- 172.21.15.18:0/1687910946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f339c145290 msgr2=0x7f339c06f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:10.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.400+0000 7f33a0eac640 1 --2- 172.21.15.18:0/1687910946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f339c145290 0x7f339c06f470 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f339c0714a0 tx=0x7f339402a6a0 comp rx=0 tx=0).stop 2024-09-19T09:15:10.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.400+0000 7f33a0eac640 1 -- 172.21.15.18:0/1687910946 shutdown_connections 2024-09-19T09:15:10.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.400+0000 7f33a0eac640 1 --2- 172.21.15.18:0/1687910946 >> v2:172.21.15.162:3300/0 conn(0x7f339c071510 0x7f339c072d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:10.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.400+0000 7f33a0eac640 1 --2- 172.21.15.18:0/1687910946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f339c0ce780 0x7f339c072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:10.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.400+0000 7f33a0eac640 1 --2- 172.21.15.18:0/1687910946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f339c145290 0x7f339c06f470 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:10.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.400+0000 7f33a0eac640 1 -- 172.21.15.18:0/1687910946 >> 172.21.15.18:0/1687910946 conn(0x7f339c06bc10 msgr2=0x7f339c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:10.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.400+0000 7f33a0eac640 1 -- 172.21.15.18:0/1687910946 shutdown_connections 2024-09-19T09:15:10.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.400+0000 7f33a0eac640 1 -- 172.21.15.18:0/1687910946 wait complete. 2024-09-19T09:15:10.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.401+0000 7f33a0eac640 1 Processor -- start 2024-09-19T09:15:10.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.401+0000 7f33a0eac640 1 -- start start 2024-09-19T09:15:10.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.402+0000 7f33a0eac640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f339c071510 0x7f339c15f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:10.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.402+0000 7f33a0eac640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f339c0ce780 0x7f339c140860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.402+0000 7f33a0eac640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f339c145290 0x7f339c13cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.402+0000 7f33a0eac640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f339c06df80 con 0x7f339c071510 2024-09-19T09:15:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.402+0000 7f33a0eac640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f339c145670 con 0x7f339c0ce780 2024-09-19T09:15:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.402+0000 7f33a0eac640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f339c06e100 con 0x7f339c145290 2024-09-19T09:15:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.402+0000 7f339a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f339c071510 0x7f339c15f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.402+0000 7f339a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f339c071510 0x7f339c15f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40474/0 (socket says 172.21.15.18:40474) 2024-09-19T09:15:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.402+0000 7f339a59c640 1 -- 172.21.15.18:0/4031245122 learned_addr learned my addr 172.21.15.18:0/4031245122 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.402+0000 7f3399d9b640 1 --2- 172.21.15.18:0/4031245122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f339c0ce780 0x7f339c140860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.402+0000 7f339ad9d640 1 --2- 172.21.15.18:0/4031245122 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f339c145290 0x7f339c13cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.402+0000 7f339a59c640 1 -- 172.21.15.18:0/4031245122 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f339c145290 msgr2=0x7f339c13cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.402+0000 7f339a59c640 1 --2- 172.21.15.18:0/4031245122 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f339c145290 0x7f339c13cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:10.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.402+0000 7f339a59c640 1 -- 172.21.15.18:0/4031245122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f339c0ce780 msgr2=0x7f339c140860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:10.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.402+0000 7f339a59c640 1 --2- 172.21.15.18:0/4031245122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f339c0ce780 0x7f339c140860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:10.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.402+0000 7f339a59c640 1 -- 172.21.15.18:0/4031245122 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f339c15e220 con 0x7f339c071510 2024-09-19T09:15:10.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.403+0000 7f3399d9b640 1 --2- 172.21.15.18:0/4031245122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f339c0ce780 0x7f339c140860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:10.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.403+0000 7f339a59c640 1 --2- 172.21.15.18:0/4031245122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f339c071510 0x7f339c15f2c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3394034040 tx=0x7f3394004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:10.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.403+0000 7f3392ffd640 1 -- 172.21.15.18:0/4031245122 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3394009510 con 0x7f339c071510 2024-09-19T09:15:10.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.403+0000 7f3392ffd640 1 -- 172.21.15.18:0/4031245122 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3394007820 con 0x7f339c071510 2024-09-19T09:15:10.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.403+0000 7f33a0eac640 1 -- 172.21.15.18:0/4031245122 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f339c15e500 con 0x7f339c071510 2024-09-19T09:15:10.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.403+0000 7f3392ffd640 1 -- 172.21.15.18:0/4031245122 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3394007c10 con 0x7f339c071510 2024-09-19T09:15:10.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.403+0000 7f33a0eac640 1 -- 172.21.15.18:0/4031245122 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f339c15eac0 con 0x7f339c071510 2024-09-19T09:15:10.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.404+0000 7f33a0eac640 1 -- 172.21.15.18:0/4031245122 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f339c06f470 con 0x7f339c071510 2024-09-19T09:15:10.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.405+0000 7f3392ffd640 1 -- 172.21.15.18:0/4031245122 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f339404b440 con 0x7f339c071510 2024-09-19T09:15:10.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.405+0000 7f3392ffd640 1 --2- 172.21.15.18:0/4031245122 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f337c06c2e0 0x7f337c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:10.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.405+0000 7f3392ffd640 1 -- 172.21.15.18:0/4031245122 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5709+0+0 (secure 0 0 0) 0x7f33940ae160 con 0x7f339c071510 2024-09-19T09:15:10.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.405+0000 7f3392ffd640 1 -- 172.21.15.18:0/4031245122 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=57}) -- 0x7f337c073e10 con 0x7f339c071510 2024-09-19T09:15:10.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.405+0000 7f3399d9b640 1 --2- 172.21.15.18:0/4031245122 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f337c06c2e0 0x7f337c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:10.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.406+0000 7f3399d9b640 1 --2- 172.21.15.18:0/4031245122 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f337c06c2e0 0x7f337c06e7a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f339c141e00 tx=0x7f3384008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:10.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.410+0000 7f3392ffd640 1 -- 172.21.15.18:0/4031245122 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f339407c960 con 0x7f339c071510 2024-09-19T09:15:10.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.590+0000 7f33a0eac640 1 -- 172.21.15.18:0/4031245122 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f339c144460 con 0x7f339c071510 2024-09-19T09:15:10.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.592+0000 7f3392ffd640 1 -- 172.21.15.18:0/4031245122 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v56) ==== 81+0+34283 (secure 0 0 0) 0x7f339407c260 con 0x7f339c071510 2024-09-19T09:15:10.593 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:15:10.593 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:15:10.593 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 56, 2024-09-19T09:15:10.593 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:15:10.593 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-19T09:13:11.348786+0000", 2024-09-19T09:15:10.593 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-19T09:15:09.099498+0000", 2024-09-19T09:15:10.593 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-19T09:13:16.423937+0000", 2024-09-19T09:15:10.593 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-19T09:13:13.417141+0000", 2024-09-19T09:15:10.593 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-19T09:15:10.594 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-09-19T09:15:10.594 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-19T09:15:10.594 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-19T09:15:10.594 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-19T09:15:10.594 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-19T09:15:10.594 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-19T09:15:10.594 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:15:10.594 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-19T09:15:10.594 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.69999998807907104, 2024-09-19T09:15:10.594 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-19T09:15:10.594 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-19T09:15:10.594 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-19T09:15:10.595 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 7, 2024-09-19T09:15:10.595 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-19T09:15:10.595 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-19T09:15:10.595 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "jewel", 2024-09-19T09:15:10.595 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-19T09:15:10.595 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-19T09:15:10.595 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-19T09:15:10.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.595 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-19T09:15:10.595 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-19T09:15:10.595 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:13:17.564717+0000", 2024-09-19T09:15:10.596 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 3, 2024-09-19T09:15:10.596 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full", 2024-09-19T09:15:10.596 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:15:10.596 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:15:10.596 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:15:10.596 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:15:10.596 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:15:10.596 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:15:10.596 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:15:10.596 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:15:10.596 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:15:10.596 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:15:10.596 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:15:10.597 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-19T09:15:10.597 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-19T09:15:10.597 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-19T09:15:10.597 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-19T09:15:10.597 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-19T09:15:10.597 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:15:10.597 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:15:10.597 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:15:10.597 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:15:10.597 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:15:10.597 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:15:10.597 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:15:10.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.598 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "49", 2024-09-19T09:15:10.598 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:15:10.598 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:15:10.598 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:15:10.598 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:15:10.598 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:15:10.598 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:15:10.598 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:15:10.598 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:15:10.598 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:15:10.598 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:15:10.598 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:15:10.598 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:15:10.598 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:15:10.599 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:15:10.599 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:15:10.599 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:15:10.599 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:15:10.599 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:15:10.599 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:15:10.599 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:15:10.599 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:15:10.599 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:15:10.600 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:15:10.600 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:15:10.600 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:15:10.600 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:15:10.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.600 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:15:10.600 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:15:10.600 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:15:10.600 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:15:10.600 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:15:10.600 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:15:10.600 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:15:10.600 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:15:10.601 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:15:10.601 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:15:10.601 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:15:10.601 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:15:10.601 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-19T09:15:10.601 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-19T09:15:10.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.601 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:15:10.601 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-19T09:15:10.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.601 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:15:10.601 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:15:10.601 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-19T09:15:10.602 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-19T09:15:10.602 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-19T09:15:10.602 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-19T09:15:10.602 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-19T09:15:10.602 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:15:10.602 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:15:10.602 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:15:10.602 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.602 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 6, 2024-09-19T09:15:10.602 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_metadata", 2024-09-19T09:15:10.602 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:14:41.948276+0000", 2024-09-19T09:15:10.603 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 3, 2024-09-19T09:15:10.603 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full", 2024-09-19T09:15:10.603 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:15:10.603 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:15:10.603 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:15:10.603 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:15:10.603 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:15:10.603 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:15:10.603 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:15:10.603 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:15:10.603 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:15:10.603 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:15:10.603 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:15:10.604 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-19T09:15:10.604 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-19T09:15:10.604 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-19T09:15:10.604 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-19T09:15:10.604 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-19T09:15:10.604 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:15:10.604 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:15:10.604 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:15:10.604 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:15:10.604 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:15:10.604 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:15:10.604 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:15:10.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.605 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "49", 2024-09-19T09:15:10.605 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:15:10.605 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:15:10.605 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:15:10.605 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:15:10.605 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:15:10.605 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:15:10.605 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:15:10.605 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:15:10.605 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:15:10.605 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:15:10.605 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:15:10.605 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:15:10.605 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:15:10.606 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:15:10.606 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:15:10.606 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:15:10.606 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:15:10.606 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:15:10.606 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:15:10.606 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:15:10.606 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:15:10.606 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:15:10.606 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:15:10.606 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:15:10.606 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:15:10.607 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:15:10.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.607 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:15:10.607 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:15:10.607 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:15:10.607 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:15:10.607 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:15:10.607 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:15:10.607 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:15:10.607 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:15:10.607 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:15:10.607 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:15:10.607 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:15:10.608 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:15:10.608 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4, 2024-09-19T09:15:10.608 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 16, 2024-09-19T09:15:10.608 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_priority": 5 2024-09-19T09:15:10.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.608 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:15:10.608 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:15:10.608 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": "cephfs" 2024-09-19T09:15:10.608 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.608 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:15:10.608 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:15:10.609 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.5, 2024-09-19T09:15:10.609 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.5, 2024-09-19T09:15:10.609 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:15:10.609 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.5, 2024-09-19T09:15:10.609 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.5, 2024-09-19T09:15:10.609 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:15:10.609 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:15:10.609 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:15:10.609 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.609 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 7, 2024-09-19T09:15:10.609 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_data", 2024-09-19T09:15:10.610 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:14:42.341949+0000", 2024-09-19T09:15:10.610 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 3, 2024-09-19T09:15:10.610 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full", 2024-09-19T09:15:10.610 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:15:10.610 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:15:10.610 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:15:10.610 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:15:10.610 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:15:10.610 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:15:10.610 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:15:10.610 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:15:10.610 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:15:10.610 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:15:10.610 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:15:10.611 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 64, 2024-09-19T09:15:10.611 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 64, 2024-09-19T09:15:10.611 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 64, 2024-09-19T09:15:10.611 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 64, 2024-09-19T09:15:10.611 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 64, 2024-09-19T09:15:10.611 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:15:10.611 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:15:10.611 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:15:10.611 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:15:10.611 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:15:10.611 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:15:10.611 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:15:10.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.612 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "49", 2024-09-19T09:15:10.612 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:15:10.612 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:15:10.612 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:15:10.612 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:15:10.612 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:15:10.612 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:15:10.612 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:15:10.612 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:15:10.612 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:15:10.612 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:15:10.612 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:15:10.612 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:15:10.613 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:15:10.613 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:15:10.613 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:15:10.613 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:15:10.613 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:15:10.613 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:15:10.613 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:15:10.613 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:15:10.613 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:15:10.613 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:15:10.613 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:15:10.613 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:15:10.613 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:15:10.614 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:15:10.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.614 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:15:10.614 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:15:10.614 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:15:10.614 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:15:10.614 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:15:10.614 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:15:10.614 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:15:10.614 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:15:10.614 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:15:10.615 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:15:10.615 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:15:10.615 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:15:10.615 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 64, 2024-09-19T09:15:10.615 INFO:teuthology.orchestra.run.smithi018.stdout: "target_size_ratio": 0.89999997615814209 2024-09-19T09:15:10.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.615 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:15:10.615 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:15:10.615 INFO:teuthology.orchestra.run.smithi018.stdout: "data": "cephfs" 2024-09-19T09:15:10.615 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.615 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:15:10.615 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:15:10.615 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.75, 2024-09-19T09:15:10.616 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.75, 2024-09-19T09:15:10.616 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:15:10.616 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.75, 2024-09-19T09:15:10.616 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.75, 2024-09-19T09:15:10.616 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:15:10.616 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:15:10.616 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:15:10.616 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.616 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.616 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:15:10.616 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-19T09:15:10.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.616 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:15:10.617 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:10.617 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:10.617 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:10.617 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:10.617 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:10.617 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:10.617 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:10.617 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:10.617 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:10.617 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:10.617 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:10.617 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:10.617 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.618 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.618 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-19T09:15:10.618 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:10.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.618 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.618 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-19T09:15:10.618 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:10.618 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.618 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.618 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:10.618 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.619 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.619 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-19T09:15:10.619 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:10.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.619 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.619 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-19T09:15:10.619 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:10.619 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.619 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.619 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:10.620 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.620 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.620 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-19T09:15:10.620 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:10.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.620 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.620 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-19T09:15:10.620 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:10.620 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.620 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.621 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:10.621 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.621 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.621 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-19T09:15:10.621 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:10.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.621 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.621 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-19T09:15:10.621 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:10.621 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.622 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.622 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/128722874", 2024-09-19T09:15:10.622 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/128722874", 2024-09-19T09:15:10.622 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/128722874", 2024-09-19T09:15:10.622 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/128722874", 2024-09-19T09:15:10.622 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:10.622 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:10.622 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:10.622 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.622 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:15:10.623 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:10.623 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:10.623 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:10.623 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:10.623 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:10.623 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:10.623 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:10.623 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:10.623 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:10.623 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:10.623 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:10.623 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:10.623 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.624 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.624 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-19T09:15:10.624 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:10.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.624 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.624 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-19T09:15:10.624 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:10.624 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.624 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.624 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:10.624 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.625 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.625 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-19T09:15:10.625 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:10.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.625 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.625 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-19T09:15:10.625 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:10.625 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.625 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.625 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:10.626 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.626 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.626 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-19T09:15:10.626 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:10.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.626 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.626 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-19T09:15:10.626 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:10.626 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.626 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.627 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:10.627 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.627 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.627 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-19T09:15:10.627 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:10.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.627 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.627 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-19T09:15:10.627 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:10.627 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.628 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.628 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/3672199638", 2024-09-19T09:15:10.628 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/3672199638", 2024-09-19T09:15:10.628 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/3672199638", 2024-09-19T09:15:10.628 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/3672199638", 2024-09-19T09:15:10.628 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:10.628 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:10.628 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:10.628 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.628 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:15:10.629 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:10.629 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:10.629 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:10.629 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:10.629 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:10.629 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:10.629 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:10.629 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:10.629 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:10.629 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:10.629 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:10.629 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:10.629 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.630 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.630 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T09:15:10.630 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:10.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.630 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.630 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T09:15:10.630 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:10.630 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.630 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.630 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:10.630 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.631 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.631 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-19T09:15:10.631 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:10.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.631 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.631 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-19T09:15:10.631 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:10.631 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.631 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.631 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:10.632 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.632 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.632 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-19T09:15:10.632 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:10.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.632 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.632 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-19T09:15:10.632 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:10.632 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.633 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.633 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:10.633 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.633 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.633 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-19T09:15:10.633 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:10.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.633 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.633 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-19T09:15:10.633 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:10.633 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.634 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.634 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3463367841", 2024-09-19T09:15:10.634 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3463367841", 2024-09-19T09:15:10.634 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3463367841", 2024-09-19T09:15:10.634 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3463367841", 2024-09-19T09:15:10.634 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:10.634 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:10.634 INFO:teuthology.orchestra.run.smithi018.stdout: "full", 2024-09-19T09:15:10.634 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:10.634 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.635 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:15:10.635 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:10.635 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:10.635 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:10.635 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:10.635 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:10.635 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:10.635 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:10.635 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:10.635 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:10.635 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:10.635 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:10.635 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:10.635 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.636 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.636 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-19T09:15:10.636 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:10.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.636 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.636 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-19T09:15:10.636 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:10.636 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.636 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.637 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:10.637 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.637 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.637 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-19T09:15:10.637 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:10.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.637 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.637 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-19T09:15:10.637 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:10.637 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.637 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.638 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:10.638 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.638 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.638 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-19T09:15:10.638 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:10.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.638 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.638 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-19T09:15:10.638 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:10.638 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.638 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.639 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:10.639 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.639 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.639 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-19T09:15:10.639 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:10.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.639 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.639 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-19T09:15:10.639 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:10.639 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.639 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.640 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/4163178582", 2024-09-19T09:15:10.640 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/4163178582", 2024-09-19T09:15:10.640 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/4163178582", 2024-09-19T09:15:10.640 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/4163178582", 2024-09-19T09:15:10.640 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:10.640 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:10.640 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:10.640 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.640 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:15:10.640 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:10.641 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:10.641 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:10.641 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:10.641 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:10.641 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:10.641 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:10.641 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:10.641 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:10.641 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:10.641 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:10.641 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:10.641 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.642 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.642 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6822", 2024-09-19T09:15:10.642 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:10.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.642 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.642 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6824", 2024-09-19T09:15:10.642 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:10.642 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.642 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.642 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:10.642 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6826", 2024-09-19T09:15:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6827", 2024-09-19T09:15:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.644 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.644 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6830", 2024-09-19T09:15:10.644 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:10.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.644 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.644 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6831", 2024-09-19T09:15:10.644 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:10.644 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.644 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.644 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:10.644 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.645 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.645 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6828", 2024-09-19T09:15:10.645 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:10.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.645 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.645 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6829", 2024-09-19T09:15:10.645 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:10.645 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.645 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.645 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6824/3538482215", 2024-09-19T09:15:10.646 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6827/3538482215", 2024-09-19T09:15:10.646 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6831/3538482215", 2024-09-19T09:15:10.646 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6829/3538482215", 2024-09-19T09:15:10.646 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:10.646 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:10.646 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:10.646 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.646 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:15:10.646 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:10.646 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:10.646 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:10.647 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:10.647 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:10.647 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:10.647 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:10.647 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:10.647 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:10.647 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:10.647 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:10.647 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:10.647 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.647 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.647 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6800", 2024-09-19T09:15:10.647 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:10.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.648 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.648 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6801", 2024-09-19T09:15:10.648 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:10.648 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.648 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.648 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:10.648 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.648 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.648 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6802", 2024-09-19T09:15:10.648 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:10.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.649 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.649 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6803", 2024-09-19T09:15:10.649 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:10.649 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.649 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.649 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:10.649 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.649 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.650 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6806", 2024-09-19T09:15:10.650 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:10.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.650 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.650 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6807", 2024-09-19T09:15:10.650 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:10.650 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.650 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.650 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:10.650 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.650 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.651 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6804", 2024-09-19T09:15:10.651 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:10.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.651 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.651 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6805", 2024-09-19T09:15:10.651 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:10.651 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.651 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.651 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6801/2408698413", 2024-09-19T09:15:10.651 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6803/2408698413", 2024-09-19T09:15:10.651 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6807/2408698413", 2024-09-19T09:15:10.651 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6805/2408698413", 2024-09-19T09:15:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:15:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:10.652 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:10.653 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:10.653 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:10.653 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:10.653 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:10.653 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:10.653 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.653 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.653 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6808", 2024-09-19T09:15:10.653 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:10.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.653 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.654 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6809", 2024-09-19T09:15:10.654 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:10.654 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.654 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.654 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:10.654 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.654 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.654 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6810", 2024-09-19T09:15:10.654 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:10.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.654 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.655 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6811", 2024-09-19T09:15:10.655 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:10.655 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.655 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.655 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:10.655 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.655 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.655 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6814", 2024-09-19T09:15:10.655 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:10.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.655 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.656 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6815", 2024-09-19T09:15:10.656 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:10.656 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.656 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.656 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:10.656 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.656 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.656 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6812", 2024-09-19T09:15:10.656 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:10.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.656 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.657 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6813", 2024-09-19T09:15:10.657 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:10.657 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.657 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.657 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6809/2596207948", 2024-09-19T09:15:10.657 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6811/2596207948", 2024-09-19T09:15:10.658 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6815/2596207948", 2024-09-19T09:15:10.658 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6813/2596207948", 2024-09-19T09:15:10.658 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:10.658 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:10.659 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:10.659 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.659 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:15:10.659 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:10.659 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:10.659 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:10.659 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:10.659 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:10.660 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:10.660 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:10.660 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:10.660 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:10.660 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:10.660 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:10.660 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:10.660 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.660 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.660 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6816", 2024-09-19T09:15:10.660 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:10.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.661 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.661 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6817", 2024-09-19T09:15:10.661 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:10.661 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.661 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.661 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:10.661 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.661 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.661 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6818", 2024-09-19T09:15:10.661 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:10.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.662 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.662 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6819", 2024-09-19T09:15:10.662 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:10.662 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.662 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.662 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:10.662 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.662 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.662 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6823", 2024-09-19T09:15:10.662 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:10.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.663 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.663 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6825", 2024-09-19T09:15:10.663 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:10.663 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.663 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.663 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:10.663 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:10.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.664 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:10.664 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6820", 2024-09-19T09:15:10.664 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:10.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.664 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:10.664 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6821", 2024-09-19T09:15:10.664 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:10.664 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.664 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.664 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6817/1334618296", 2024-09-19T09:15:10.665 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6819/1334618296", 2024-09-19T09:15:10.665 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6825/1334618296", 2024-09-19T09:15:10.665 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6821/1334618296", 2024-09-19T09:15:10.665 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:10.665 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull", 2024-09-19T09:15:10.665 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:10.665 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:10.665 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:10.665 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.665 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:15:10.665 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-19T09:15:10.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.665 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:15:10.665 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:10.666 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:10.666 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:10.666 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:10.666 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:10.666 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.580838+0000", 2024-09-19T09:15:10.666 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:10.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.666 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:15:10.666 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:10.666 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:10.666 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:10.666 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:10.666 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:10.667 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.599990+0000", 2024-09-19T09:15:10.667 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:10.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.667 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:15:10.667 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:10.667 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:10.667 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:10.667 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:10.667 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:10.667 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.503722+0000", 2024-09-19T09:15:10.667 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:10.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.668 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:15:10.668 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:10.668 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:10.668 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:10.668 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:10.668 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:10.668 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.607846+0000", 2024-09-19T09:15:10.668 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:10.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.668 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:15:10.668 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:10.668 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:10.669 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:10.669 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:10.669 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:10.669 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.616858+0000", 2024-09-19T09:15:10.669 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:10.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.669 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:15:10.669 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:10.669 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:10.669 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:10.669 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:10.669 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:10.670 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.542726+0000", 2024-09-19T09:15:10.670 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:10.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.670 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:15:10.670 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:10.670 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:10.670 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:10.670 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:10.670 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:10.670 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.534178+0000", 2024-09-19T09:15:10.671 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:10.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:10.671 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:15:10.671 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:10.671 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:10.671 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:10.671 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:10.671 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:10.671 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.612105+0000", 2024-09-19T09:15:10.671 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:10.671 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.671 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:15:10.672 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-19T09:15:10.672 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-19T09:15:10.672 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-19T09:15:10.672 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-19T09:15:10.672 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-19T09:15:10.672 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-19T09:15:10.672 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-19T09:15:10.672 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-19T09:15:10.672 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-19T09:15:10.672 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-19T09:15:10.672 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-19T09:15:10.672 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-19T09:15:10.672 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-19T09:15:10.673 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-19T09:15:10.673 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:10.673 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-19T09:15:10.673 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-19T09:15:10.673 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-19T09:15:10.673 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-19T09:15:10.673 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-19T09:15:10.673 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-19T09:15:10.673 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-19T09:15:10.673 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-19T09:15:10.673 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-19T09:15:10.673 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-19T09:15:10.673 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-19T09:15:10.674 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:10.674 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:15:10.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.594+0000 7f33a0eac640 1 -- 172.21.15.18:0/4031245122 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f337c06c2e0 msgr2=0x7f337c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:10.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.594+0000 7f33a0eac640 1 --2- 172.21.15.18:0/4031245122 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f337c06c2e0 0x7f337c06e7a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f339c141e00 tx=0x7f3384008040 comp rx=0 tx=0).stop 2024-09-19T09:15:10.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.594+0000 7f33a0eac640 1 -- 172.21.15.18:0/4031245122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f339c071510 msgr2=0x7f339c15f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:10.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.594+0000 7f33a0eac640 1 --2- 172.21.15.18:0/4031245122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f339c071510 0x7f339c15f2c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3394034040 tx=0x7f3394004a40 comp rx=0 tx=0).stop 2024-09-19T09:15:10.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.594+0000 7f33a0eac640 1 -- 172.21.15.18:0/4031245122 shutdown_connections 2024-09-19T09:15:10.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.594+0000 7f33a0eac640 1 --2- 172.21.15.18:0/4031245122 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f337c06c2e0 0x7f337c06e7a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:10.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.594+0000 7f33a0eac640 1 --2- 172.21.15.18:0/4031245122 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f339c145290 0x7f339c13cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:10.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.594+0000 7f33a0eac640 1 --2- 172.21.15.18:0/4031245122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f339c0ce780 0x7f339c140860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:10.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.594+0000 7f33a0eac640 1 --2- 172.21.15.18:0/4031245122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f339c071510 0x7f339c15f2c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:10.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.594+0000 7f33a0eac640 1 -- 172.21.15.18:0/4031245122 >> 172.21.15.18:0/4031245122 conn(0x7f339c06bc10 msgr2=0x7f339c15f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:10.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.594+0000 7f33a0eac640 1 -- 172.21.15.18:0/4031245122 shutdown_connections 2024-09-19T09:15:10.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:10.594+0000 7f33a0eac640 1 -- 172.21.15.18:0/4031245122 wait complete. 2024-09-19T09:15:10.677 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-19T09:15:11.153 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-19T09:15:11.153+0000 7fca8cfa1640 -1 log_channel(cluster) log [ERR] : Health check update: 1 full osd(s) (OSD_FULL) 2024-09-19T09:15:15.678 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-19T09:15:15.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.793+0000 7fec27e27640 1 Processor -- start 2024-09-19T09:15:15.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.793+0000 7fec27e27640 1 -- start start 2024-09-19T09:15:15.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.794+0000 7fec27e27640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fec2015ef50 0x7fec200d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:15.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.794+0000 7fec27e27640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec200d3240 0x7fec200d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:15.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.794+0000 7fec27e27640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec200b7a90 con 0x7fec200d5780 2024-09-19T09:15:15.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.794+0000 7fec27e27640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fec200d3740 con 0x7fec2015ef50 2024-09-19T09:15:15.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.794+0000 7fec27e27640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fec200d3a20 con 0x7fec200d3240 2024-09-19T09:15:15.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.794+0000 7fec263c4640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fec200d5780 0x7fec200cf770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43582/0 (socket says 172.21.15.18:43582) 2024-09-19T09:15:15.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.794+0000 7fec263c4640 1 -- 172.21.15.18:0/1871663105 learned_addr learned my addr 172.21.15.18:0/1871663105 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:15:15.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.794+0000 7fec25bc3640 1 --2- 172.21.15.18:0/1871663105 >> v2:172.21.15.162:3300/0 conn(0x7fec2015ef50 0x7fec200d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:15.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.794+0000 7fec253c2640 1 --2- 172.21.15.18:0/1871663105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec200d3240 0x7fec200d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:15.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.794+0000 7fec24bc1640 1 -- 172.21.15.18:0/1871663105 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3310318561 0 0) 0x7fec200b7a90 con 0x7fec200d5780 2024-09-19T09:15:15.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.794+0000 7fec24bc1640 1 -- 172.21.15.18:0/1871663105 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fec0c003520 con 0x7fec200d5780 2024-09-19T09:15:15.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.794+0000 7fec24bc1640 1 -- 172.21.15.18:0/1871663105 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 453175157 0 0) 0x7fec0c003520 con 0x7fec200d5780 2024-09-19T09:15:15.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.794+0000 7fec24bc1640 1 -- 172.21.15.18:0/1871663105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec200d3240 msgr2=0x7fec200d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:15.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.794+0000 7fec24bc1640 1 --2- 172.21.15.18:0/1871663105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec200d3240 0x7fec200d18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:15.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.794+0000 7fec24bc1640 1 -- 172.21.15.18:0/1871663105 >> v2:172.21.15.162:3300/0 conn(0x7fec2015ef50 msgr2=0x7fec200d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:15.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.794+0000 7fec24bc1640 1 --2- 172.21.15.18:0/1871663105 >> v2:172.21.15.162:3300/0 conn(0x7fec2015ef50 0x7fec200d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:15.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.794+0000 7fec24bc1640 1 -- 172.21.15.18:0/1871663105 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec200b7d00 con 0x7fec200d5780 2024-09-19T09:15:15.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.794+0000 7fec24bc1640 1 -- 172.21.15.18:0/1871663105 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fec180019f0 con 0x7fec200d5780 2024-09-19T09:15:15.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.794+0000 7fec24bc1640 1 -- 172.21.15.18:0/1871663105 >> v1:172.21.15.18:6789/0 conn(0x7fec200d5780 legacy=0x7fec200cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:15.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.794+0000 7fec24bc1640 1 --2- 172.21.15.18:0/1871663105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec0c0039b0 0x7fec0c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:15.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.794+0000 7fec24bc1640 1 --2- 172.21.15.18:0/1871663105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec0c004800 0x7fec0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:15.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.794+0000 7fec24bc1640 1 --2- 172.21.15.18:0/1871663105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec200d3240 0x7fec0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:15.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.794+0000 7fec24bc1640 1 -- 172.21.15.18:0/1871663105 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fec200d3740 con 0x7fec0c004800 2024-09-19T09:15:15.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.794+0000 7fec24bc1640 1 -- 172.21.15.18:0/1871663105 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fec200d3a20 con 0x7fec0c0039b0 2024-09-19T09:15:15.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.795+0000 7fec24bc1640 1 -- 172.21.15.18:0/1871663105 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fec0c00b9c0 con 0x7fec200d3240 2024-09-19T09:15:15.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.795+0000 7fec253c2640 1 --2- 172.21.15.18:0/1871663105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec0c004800 0x7fec0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:15.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.795+0000 7fec25bc3640 1 --2- 172.21.15.18:0/1871663105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec0c0039b0 0x7fec0c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:15.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.795+0000 7fec263c4640 1 --2- 172.21.15.18:0/1871663105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec200d3240 0x7fec0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:15.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.795+0000 7fec253c2640 1 -- 172.21.15.18:0/1871663105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec200d3240 msgr2=0x7fec0c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:15.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.795+0000 7fec253c2640 1 --2- 172.21.15.18:0/1871663105 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec200d3240 0x7fec0c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:15.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.795+0000 7fec253c2640 1 -- 172.21.15.18:0/1871663105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec0c0039b0 msgr2=0x7fec0c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:15.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.795+0000 7fec253c2640 1 --2- 172.21.15.18:0/1871663105 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec0c0039b0 0x7fec0c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:15.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.795+0000 7fec253c2640 1 -- 172.21.15.18:0/1871663105 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec0c003520 con 0x7fec0c004800 2024-09-19T09:15:15.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.796+0000 7fec253c2640 1 --2- 172.21.15.18:0/1871663105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec0c004800 0x7fec0c004c80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fec10009af0 tx=0x7fec0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1fe725c0814d5f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:15.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.796+0000 7fec24bc1640 1 -- 172.21.15.18:0/1871663105 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec10036070 con 0x7fec0c004800 2024-09-19T09:15:15.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.796+0000 7fec24bc1640 1 -- 172.21.15.18:0/1871663105 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec10031400 con 0x7fec0c004800 2024-09-19T09:15:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.796+0000 7fec24bc1640 1 -- 172.21.15.18:0/1871663105 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec10009690 con 0x7fec0c004800 2024-09-19T09:15:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.796+0000 7fec27e27640 1 -- 172.21.15.18:0/1871663105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec0c004800 msgr2=0x7fec0c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.796+0000 7fec27e27640 1 --2- 172.21.15.18:0/1871663105 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec0c004800 0x7fec0c004c80 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fec10009af0 tx=0x7fec0c005830 comp rx=0 tx=0).stop 2024-09-19T09:15:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.796+0000 7fec263c4640 1 -- 172.21.15.18:0/1871663105 reap_dead start 2024-09-19T09:15:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.796+0000 7fec27e27640 1 -- 172.21.15.18:0/1871663105 shutdown_connections 2024-09-19T09:15:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.796+0000 7fec27e27640 1 -- 172.21.15.18:0/1871663105 >> 172.21.15.18:0/1871663105 conn(0x7fec200d4c60 msgr2=0x7fec200d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.796+0000 7fec27e27640 1 -- 172.21.15.18:0/1871663105 shutdown_connections 2024-09-19T09:15:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.796+0000 7fec27e27640 1 -- 172.21.15.18:0/1871663105 wait complete. 2024-09-19T09:15:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.798+0000 7fec27e27640 1 Processor -- start 2024-09-19T09:15:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.798+0000 7fec27e27640 1 -- start start 2024-09-19T09:15:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.798+0000 7fec27e27640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec0c004800 0x7fec2015c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.798+0000 7fec27e27640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec20154cd0 0x7fec2015cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:15.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.798+0000 7fec27e27640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec201f8300 0x7fec201f8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:15.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.798+0000 7fec27e27640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fec200d21a0 con 0x7fec0c004800 2024-09-19T09:15:15.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.798+0000 7fec27e27640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fec200d2020 con 0x7fec201f8300 2024-09-19T09:15:15.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.798+0000 7fec27e27640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fec200b9510 con 0x7fec20154cd0 2024-09-19T09:15:15.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.799+0000 7fec25bc3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec0c004800 0x7fec2015c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:15.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.799+0000 7fec25bc3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec0c004800 0x7fec2015c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57598/0 (socket says 172.21.15.18:57598) 2024-09-19T09:15:15.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.799+0000 7fec25bc3640 1 -- 172.21.15.18:0/439899257 learned_addr learned my addr 172.21.15.18:0/439899257 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:15.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.799+0000 7fec253c2640 1 --2- 172.21.15.18:0/439899257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec20154cd0 0x7fec2015cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:15.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.799+0000 7fec263c4640 1 --2- 172.21.15.18:0/439899257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec201f8300 0x7fec201f8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:15.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.799+0000 7fec25bc3640 1 -- 172.21.15.18:0/439899257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec20154cd0 msgr2=0x7fec2015cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:15.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.799+0000 7fec25bc3640 1 --2- 172.21.15.18:0/439899257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec20154cd0 0x7fec2015cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:15.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.799+0000 7fec25bc3640 1 -- 172.21.15.18:0/439899257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec201f8300 msgr2=0x7fec201f8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:15.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.799+0000 7fec25bc3640 1 --2- 172.21.15.18:0/439899257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec201f8300 0x7fec201f8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:15.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.799+0000 7fec25bc3640 1 -- 172.21.15.18:0/439899257 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec20155240 con 0x7fec0c004800 2024-09-19T09:15:15.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.799+0000 7fec25bc3640 1 --2- 172.21.15.18:0/439899257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec0c004800 0x7fec2015c760 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fec1c011ad0 tx=0x7fec1c011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:15.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.799+0000 7fec167fc640 1 -- 172.21.15.18:0/439899257 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1c00faf0 con 0x7fec0c004800 2024-09-19T09:15:15.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.799+0000 7fec167fc640 1 -- 172.21.15.18:0/439899257 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec1c00fc90 con 0x7fec0c004800 2024-09-19T09:15:15.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.799+0000 7fec27e27640 1 -- 172.21.15.18:0/439899257 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec20155520 con 0x7fec0c004800 2024-09-19T09:15:15.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.799+0000 7fec167fc640 1 -- 172.21.15.18:0/439899257 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1c014440 con 0x7fec0c004800 2024-09-19T09:15:15.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.799+0000 7fec27e27640 1 -- 172.21.15.18:0/439899257 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec20155ae0 con 0x7fec0c004800 2024-09-19T09:15:15.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.800+0000 7fec27e27640 1 -- 172.21.15.18:0/439899257 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec200d1b60 con 0x7fec0c004800 2024-09-19T09:15:15.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.801+0000 7fec167fc640 1 -- 172.21.15.18:0/439899257 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fec1c012040 con 0x7fec0c004800 2024-09-19T09:15:15.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.802+0000 7fec167fc640 1 --2- 172.21.15.18:0/439899257 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fec0406c2b0 0x7fec0406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:15.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.802+0000 7fec167fc640 1 -- 172.21.15.18:0/439899257 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7fec1c08ba00 con 0x7fec0c004800 2024-09-19T09:15:15.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.802+0000 7fec253c2640 1 --2- 172.21.15.18:0/439899257 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fec0406c2b0 0x7fec0406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:15.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.802+0000 7fec253c2640 1 --2- 172.21.15.18:0/439899257 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fec0406c2b0 0x7fec0406e770 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fec10033000 tx=0x7fec10008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:15.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.806+0000 7fec167fc640 1 -- 172.21.15.18:0/439899257 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fec1c019030 con 0x7fec0c004800 2024-09-19T09:15:15.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.984+0000 7fec27e27640 1 -- 172.21.15.18:0/439899257 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fec200d0df0 con 0x7fec0c004800 2024-09-19T09:15:15.986 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.985+0000 7fec167fc640 1 -- 172.21.15.18:0/439899257 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v57) ==== 81+0+34212 (secure 0 0 0) 0x7fec1c05a200 con 0x7fec0c004800 2024-09-19T09:15:15.986 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:15:15.987 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:15:15.987 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 57, 2024-09-19T09:15:15.987 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:15:15.987 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-19T09:13:11.348786+0000", 2024-09-19T09:15:15.987 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-19T09:15:12.112114+0000", 2024-09-19T09:15:15.987 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-19T09:13:16.423937+0000", 2024-09-19T09:15:15.987 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-19T09:13:13.417141+0000", 2024-09-19T09:15:15.987 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-19T09:15:15.987 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-09-19T09:15:15.987 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-19T09:15:15.987 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-19T09:15:15.987 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-19T09:15:15.987 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-19T09:15:15.988 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-19T09:15:15.988 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:15:15.988 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-19T09:15:15.988 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.69999998807907104, 2024-09-19T09:15:15.988 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-19T09:15:15.988 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-19T09:15:15.988 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-19T09:15:15.988 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 7, 2024-09-19T09:15:15.988 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-19T09:15:15.988 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-19T09:15:15.988 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "jewel", 2024-09-19T09:15:15.988 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-19T09:15:15.988 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-19T09:15:15.989 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-19T09:15:15.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:15.989 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-19T09:15:15.989 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-19T09:15:15.989 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:13:17.564717+0000", 2024-09-19T09:15:15.989 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:15:15.989 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:15:15.989 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:15:15.989 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:15:15.989 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:15:15.989 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:15:15.989 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:15:15.989 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:15:15.990 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:15:15.990 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:15:15.990 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:15:15.990 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:15:15.990 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:15:15.990 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-19T09:15:15.990 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-19T09:15:15.990 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-19T09:15:15.990 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-19T09:15:15.991 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-19T09:15:15.991 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:15:15.991 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:15:15.991 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:15:15.991 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:15:15.991 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:15:15.991 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:15:15.991 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:15:15.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:15.991 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "57", 2024-09-19T09:15:15.991 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:15:15.991 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:15:15.992 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:15:15.992 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:15:15.992 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:15:15.992 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:15:15.992 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:15:15.992 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:15:15.992 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:15:15.992 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:15:15.992 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:15:15.992 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:15:15.992 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:15:15.992 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:15:15.992 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:15:15.993 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:15:15.993 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:15:15.993 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:15:15.993 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:15:15.993 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:15:15.993 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:15:15.993 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:15:15.993 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:15:15.993 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:15:15.993 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:15:15.993 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:15:15.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:15.994 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:15:15.994 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:15:15.994 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:15:15.994 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:15:15.994 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:15:15.994 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:15:15.994 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:15:15.994 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:15:15.994 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:15:15.994 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:15:15.994 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:15:15.994 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:15:15.995 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-19T09:15:15.995 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-19T09:15:15.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:15.995 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:15:15.995 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-19T09:15:15.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:15.995 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:15:15.995 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:15:15.995 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-19T09:15:15.995 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-19T09:15:15.995 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-19T09:15:15.995 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-19T09:15:15.995 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-19T09:15:15.995 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:15:15.996 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:15:15.996 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:15:15.996 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:15.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:15.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:15.996 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 6, 2024-09-19T09:15:15.996 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_metadata", 2024-09-19T09:15:15.996 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:14:41.948276+0000", 2024-09-19T09:15:15.996 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:15:15.996 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:15:15.996 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:15:15.996 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:15:15.997 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:15:15.997 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:15:15.997 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:15:15.997 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:15:15.997 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:15:15.997 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:15:15.997 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:15:15.997 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:15:15.997 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:15:15.997 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-19T09:15:15.997 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-19T09:15:15.997 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-19T09:15:15.997 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-19T09:15:15.998 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-19T09:15:15.998 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:15:15.998 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:15:15.998 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:15:15.998 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:15:15.998 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:15:15.998 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:15:15.998 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:15:15.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:15.998 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "57", 2024-09-19T09:15:15.998 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:15:15.998 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:15:15.998 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:15:15.999 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:15:15.999 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:15:15.999 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:15:15.999 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:15:15.999 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:15:15.999 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:15:15.999 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:15:15.999 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:15:15.999 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:15:16.000 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:15:16.000 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:15:16.000 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:15:16.000 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:15:16.000 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:15:16.000 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:15:16.000 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:15:16.000 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:15:16.000 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:15:16.000 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:15:16.000 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:15:16.000 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:15:16.001 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:15:16.001 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:15:16.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.001 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:15:16.001 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:15:16.001 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:15:16.001 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:15:16.001 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:15:16.002 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:15:16.002 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:15:16.002 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:15:16.002 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:15:16.002 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:15:16.002 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:15:16.003 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:15:16.003 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4, 2024-09-19T09:15:16.003 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 16, 2024-09-19T09:15:16.003 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_priority": 5 2024-09-19T09:15:16.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.003 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:15:16.003 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:15:16.003 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": "cephfs" 2024-09-19T09:15:16.003 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.004 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:15:16.004 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:15:16.004 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.5, 2024-09-19T09:15:16.004 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.5, 2024-09-19T09:15:16.004 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:15:16.004 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.5, 2024-09-19T09:15:16.004 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.5, 2024-09-19T09:15:16.004 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:15:16.005 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:15:16.005 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:15:16.005 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.005 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 7, 2024-09-19T09:15:16.005 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_data", 2024-09-19T09:15:16.005 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:14:42.341949+0000", 2024-09-19T09:15:16.005 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:15:16.005 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:15:16.005 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:15:16.006 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:15:16.006 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:15:16.006 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:15:16.006 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:15:16.006 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:15:16.006 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:15:16.006 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:15:16.006 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:15:16.006 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:15:16.006 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:15:16.007 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 64, 2024-09-19T09:15:16.007 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 64, 2024-09-19T09:15:16.007 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 64, 2024-09-19T09:15:16.007 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 64, 2024-09-19T09:15:16.007 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 64, 2024-09-19T09:15:16.007 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:15:16.007 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:15:16.007 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:15:16.007 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:15:16.007 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:15:16.008 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:15:16.008 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:15:16.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.008 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "57", 2024-09-19T09:15:16.008 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:15:16.008 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:15:16.008 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:15:16.008 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:15:16.008 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:15:16.008 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:15:16.008 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:15:16.009 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:15:16.009 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:15:16.009 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:15:16.009 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:15:16.009 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:15:16.009 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:15:16.009 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:15:16.009 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:15:16.009 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:15:16.009 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:15:16.009 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:15:16.009 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:15:16.009 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:15:16.010 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:15:16.010 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:15:16.010 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:15:16.010 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:15:16.010 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:15:16.010 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:15:16.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.010 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:15:16.010 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:15:16.010 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:15:16.010 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:15:16.010 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:15:16.010 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:15:16.011 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:15:16.011 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:15:16.011 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:15:16.011 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:15:16.011 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:15:16.011 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:15:16.011 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 64, 2024-09-19T09:15:16.011 INFO:teuthology.orchestra.run.smithi018.stdout: "target_size_ratio": 0.89999997615814209 2024-09-19T09:15:16.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.011 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:15:16.011 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:15:16.011 INFO:teuthology.orchestra.run.smithi018.stdout: "data": "cephfs" 2024-09-19T09:15:16.011 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.012 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:15:16.012 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:15:16.012 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.75, 2024-09-19T09:15:16.012 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.75, 2024-09-19T09:15:16.012 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:15:16.012 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.75, 2024-09-19T09:15:16.012 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.75, 2024-09-19T09:15:16.012 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:15:16.012 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:15:16.012 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:15:16.012 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.012 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.012 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:15:16.013 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-19T09:15:16.013 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.013 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:15:16.013 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:16.013 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:16.013 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:16.013 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:16.013 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:16.013 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:16.013 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:16.013 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:16.013 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:16.013 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:16.014 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:16.014 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:16.014 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.014 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.014 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-19T09:15:16.014 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:16.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.014 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.014 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-19T09:15:16.014 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:16.014 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.015 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.015 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:16.015 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.015 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.015 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-19T09:15:16.015 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:16.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.015 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.015 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-19T09:15:16.015 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:16.015 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.016 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.016 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:16.016 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.016 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.016 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-19T09:15:16.016 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:16.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.016 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.016 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-19T09:15:16.016 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:16.016 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.017 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.017 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:16.017 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.017 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.017 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-19T09:15:16.017 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:16.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.017 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.017 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-19T09:15:16.017 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:16.017 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.018 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.018 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/128722874", 2024-09-19T09:15:16.018 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/128722874", 2024-09-19T09:15:16.018 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/128722874", 2024-09-19T09:15:16.018 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/128722874", 2024-09-19T09:15:16.018 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:16.018 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:16.018 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:16.018 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.018 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:15:16.019 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:16.019 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:16.019 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:16.019 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:16.019 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:16.019 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:16.019 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:16.019 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:16.019 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:16.019 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:16.019 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:16.019 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:16.019 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.020 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.020 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-19T09:15:16.020 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:16.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.020 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.020 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-19T09:15:16.020 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:16.020 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.020 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.020 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:16.021 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.021 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.021 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-19T09:15:16.021 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:16.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.021 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.021 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-19T09:15:16.021 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:16.021 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.021 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.021 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:16.022 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.022 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.022 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-19T09:15:16.022 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:16.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.022 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.022 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-19T09:15:16.022 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:16.022 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.022 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.022 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:16.023 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.023 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.023 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-19T09:15:16.023 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:16.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.023 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.023 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-19T09:15:16.023 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:16.023 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.023 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.023 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/3672199638", 2024-09-19T09:15:16.024 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/3672199638", 2024-09-19T09:15:16.024 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/3672199638", 2024-09-19T09:15:16.024 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/3672199638", 2024-09-19T09:15:16.024 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:16.024 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:16.024 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:16.024 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.024 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:15:16.024 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:16.024 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:16.024 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:16.025 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:16.025 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:16.025 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:16.025 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:16.025 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:16.025 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:16.025 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:16.025 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:16.025 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:16.025 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.025 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.025 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T09:15:16.025 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:16.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.026 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.026 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T09:15:16.026 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:16.026 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.026 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.026 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:16.026 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.026 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.026 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-19T09:15:16.027 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:16.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.027 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.027 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-19T09:15:16.027 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:16.027 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.027 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.027 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:16.027 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.027 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.028 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-19T09:15:16.028 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:16.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.028 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.028 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-19T09:15:16.028 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:16.028 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.028 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.028 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.028 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:16.028 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.028 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.028 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.029 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-19T09:15:16.029 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:16.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.029 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.029 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.029 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-19T09:15:16.029 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:16.029 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.029 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.029 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.029 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3463367841", 2024-09-19T09:15:16.029 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3463367841", 2024-09-19T09:15:16.029 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3463367841", 2024-09-19T09:15:16.029 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3463367841", 2024-09-19T09:15:16.030 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:16.030 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:16.030 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:16.030 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.030 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.030 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.030 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:15:16.030 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:16.030 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:16.030 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:16.030 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:16.030 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:16.030 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:16.031 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:16.031 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:16.031 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:16.031 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:16.031 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:16.031 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:16.031 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.031 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.031 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-19T09:15:16.031 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:16.031 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.031 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.031 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.032 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-19T09:15:16.032 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:16.032 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.032 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.032 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:16.032 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.032 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.032 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-19T09:15:16.032 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:16.032 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.032 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.032 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.033 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-19T09:15:16.033 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:16.033 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.033 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.033 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:16.033 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.033 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.033 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-19T09:15:16.033 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:16.033 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.033 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.034 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.034 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-19T09:15:16.034 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:16.034 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.034 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.034 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:16.034 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.034 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.034 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-19T09:15:16.034 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:16.034 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.034 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.035 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.035 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-19T09:15:16.035 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:16.035 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.035 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.035 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.035 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/4163178582", 2024-09-19T09:15:16.035 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/4163178582", 2024-09-19T09:15:16.035 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/4163178582", 2024-09-19T09:15:16.035 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/4163178582", 2024-09-19T09:15:16.035 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:16.035 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:16.035 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:16.035 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.036 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.036 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.036 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:15:16.036 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:16.036 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:16.036 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:16.036 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:16.036 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:16.036 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:16.036 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:16.036 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:16.036 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:16.036 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:16.036 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:16.037 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:16.037 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.037 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.037 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6822", 2024-09-19T09:15:16.037 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:16.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.037 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.037 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.037 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6824", 2024-09-19T09:15:16.037 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:16.037 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.037 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.037 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.038 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:16.038 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.038 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.038 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6826", 2024-09-19T09:15:16.038 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:16.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.038 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.038 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.038 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6827", 2024-09-19T09:15:16.038 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:16.038 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.038 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.038 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.039 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:16.039 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.039 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.039 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6830", 2024-09-19T09:15:16.039 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:16.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.039 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.039 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.039 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6831", 2024-09-19T09:15:16.039 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:16.039 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.039 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.039 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.040 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:16.040 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.040 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.040 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6828", 2024-09-19T09:15:16.040 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:16.040 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.040 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.040 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.040 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6829", 2024-09-19T09:15:16.040 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:16.040 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.040 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.041 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6824/3538482215", 2024-09-19T09:15:16.041 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6827/3538482215", 2024-09-19T09:15:16.041 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6831/3538482215", 2024-09-19T09:15:16.041 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6829/3538482215", 2024-09-19T09:15:16.041 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:16.041 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:16.041 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:16.041 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.041 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.041 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.041 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:15:16.041 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:16.042 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:16.042 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:16.042 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:16.042 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:16.042 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:16.042 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:16.042 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:16.042 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:16.042 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:16.042 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:16.042 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:16.042 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.042 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.042 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.043 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6800", 2024-09-19T09:15:16.043 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:16.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.043 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.043 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6801", 2024-09-19T09:15:16.043 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:16.043 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.043 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.043 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.043 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:16.043 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.043 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.044 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.044 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6802", 2024-09-19T09:15:16.044 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:16.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.044 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.044 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6803", 2024-09-19T09:15:16.044 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:16.044 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.044 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.044 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.044 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:16.044 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.044 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.045 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.045 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6806", 2024-09-19T09:15:16.045 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:16.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.045 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.045 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.045 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6807", 2024-09-19T09:15:16.045 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:16.045 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.045 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.045 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.045 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:16.046 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.046 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.046 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6804", 2024-09-19T09:15:16.046 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:16.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.046 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.046 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.046 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6805", 2024-09-19T09:15:16.046 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:16.046 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.046 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.046 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.046 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6801/2408698413", 2024-09-19T09:15:16.047 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6803/2408698413", 2024-09-19T09:15:16.047 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6807/2408698413", 2024-09-19T09:15:16.047 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6805/2408698413", 2024-09-19T09:15:16.047 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:16.047 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:16.047 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:16.047 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.047 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.047 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.047 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:15:16.047 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:16.047 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:16.047 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:16.047 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:16.048 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:16.048 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:16.048 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:16.048 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:16.048 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:16.048 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:16.048 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:16.048 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:16.048 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.048 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.048 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.048 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6808", 2024-09-19T09:15:16.048 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:16.048 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.049 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.049 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6809", 2024-09-19T09:15:16.049 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:16.049 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.049 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.049 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.049 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:16.049 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.049 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.049 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.049 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6810", 2024-09-19T09:15:16.049 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:16.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.050 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.050 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6811", 2024-09-19T09:15:16.050 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:16.050 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.050 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.050 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.050 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:16.050 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.050 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.050 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.050 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6814", 2024-09-19T09:15:16.051 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:16.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.051 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.051 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6815", 2024-09-19T09:15:16.051 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:16.051 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.051 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.051 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.051 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:16.051 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.051 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.051 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.052 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6812", 2024-09-19T09:15:16.052 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:16.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.052 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.052 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.052 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6813", 2024-09-19T09:15:16.052 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:16.052 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.052 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.052 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.052 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6809/2596207948", 2024-09-19T09:15:16.052 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6811/2596207948", 2024-09-19T09:15:16.052 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6815/2596207948", 2024-09-19T09:15:16.052 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6813/2596207948", 2024-09-19T09:15:16.053 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:16.053 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:16.053 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:16.053 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.053 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.053 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.053 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:15:16.053 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:16.053 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:16.053 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:16.053 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:16.053 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:16.053 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:16.054 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:16.054 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:16.054 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:16.054 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:16.054 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:16.054 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:16.054 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.054 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.054 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6816", 2024-09-19T09:15:16.054 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:16.054 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.054 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.054 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.055 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6817", 2024-09-19T09:15:16.055 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:16.055 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.055 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.055 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:16.055 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.055 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.055 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6818", 2024-09-19T09:15:16.055 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:16.055 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.055 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.056 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.056 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6819", 2024-09-19T09:15:16.056 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:16.056 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.056 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.056 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.056 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:16.056 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.056 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.056 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.056 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6823", 2024-09-19T09:15:16.057 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:16.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.057 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.057 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.057 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6825", 2024-09-19T09:15:16.057 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:16.057 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.057 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.057 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.057 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:16.058 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.058 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.058 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6820", 2024-09-19T09:15:16.058 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:16.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.058 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.058 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.058 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6821", 2024-09-19T09:15:16.058 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:16.058 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.058 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.058 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.059 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6817/1334618296", 2024-09-19T09:15:16.059 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6819/1334618296", 2024-09-19T09:15:16.059 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6825/1334618296", 2024-09-19T09:15:16.059 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6821/1334618296", 2024-09-19T09:15:16.059 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:16.059 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:16.059 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:16.059 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.059 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.059 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:15:16.059 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-19T09:15:16.059 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.059 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:15:16.060 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:16.060 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:16.060 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:16.060 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:16.060 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:16.060 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.580838+0000", 2024-09-19T09:15:16.060 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:16.060 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.060 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.060 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:15:16.060 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:16.060 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:16.060 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:16.060 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:16.061 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:16.061 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.599990+0000", 2024-09-19T09:15:16.061 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:16.061 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.061 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.061 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:15:16.061 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:16.061 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:16.061 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:16.061 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:16.061 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:16.061 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.503722+0000", 2024-09-19T09:15:16.061 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:16.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.062 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:15:16.062 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:16.062 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:16.062 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:16.062 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:16.062 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:16.062 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.607846+0000", 2024-09-19T09:15:16.062 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:16.062 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.062 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.062 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:15:16.062 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:16.062 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:16.063 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:16.063 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:16.063 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:16.063 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.616858+0000", 2024-09-19T09:15:16.063 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:16.063 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.063 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.063 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:15:16.063 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:16.063 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:16.063 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:16.063 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:16.063 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:16.064 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.542726+0000", 2024-09-19T09:15:16.064 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:16.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.064 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.064 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:15:16.064 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:16.064 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:16.064 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:16.064 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:16.064 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:16.064 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.534178+0000", 2024-09-19T09:15:16.064 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:16.064 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.065 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.065 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:15:16.065 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:16.065 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:16.065 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:16.065 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:16.065 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:16.065 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.612105+0000", 2024-09-19T09:15:16.065 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:16.065 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.065 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:15:16.065 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-19T09:15:16.065 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-19T09:15:16.065 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-19T09:15:16.066 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-19T09:15:16.066 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-19T09:15:16.066 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-19T09:15:16.066 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-19T09:15:16.066 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-19T09:15:16.066 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-19T09:15:16.066 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-19T09:15:16.066 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-19T09:15:16.066 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-19T09:15:16.066 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-19T09:15:16.066 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-19T09:15:16.066 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.066 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.066 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-19T09:15:16.067 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-19T09:15:16.067 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-19T09:15:16.067 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-19T09:15:16.067 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-19T09:15:16.067 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-19T09:15:16.067 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-19T09:15:16.067 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-19T09:15:16.067 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-19T09:15:16.067 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-19T09:15:16.067 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-19T09:15:16.067 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.067 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:15:16.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.988+0000 7fec27e27640 1 -- 172.21.15.18:0/439899257 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fec0406c2b0 msgr2=0x7fec0406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:16.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.988+0000 7fec27e27640 1 --2- 172.21.15.18:0/439899257 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fec0406c2b0 0x7fec0406e770 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fec10033000 tx=0x7fec10008030 comp rx=0 tx=0).stop 2024-09-19T09:15:16.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.988+0000 7fec27e27640 1 -- 172.21.15.18:0/439899257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec0c004800 msgr2=0x7fec2015c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:16.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.988+0000 7fec27e27640 1 --2- 172.21.15.18:0/439899257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec0c004800 0x7fec2015c760 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fec1c011ad0 tx=0x7fec1c011ed0 comp rx=0 tx=0).stop 2024-09-19T09:15:16.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.988+0000 7fec27e27640 1 -- 172.21.15.18:0/439899257 shutdown_connections 2024-09-19T09:15:16.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.988+0000 7fec27e27640 1 --2- 172.21.15.18:0/439899257 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fec0406c2b0 0x7fec0406e770 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:16.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.988+0000 7fec27e27640 1 --2- 172.21.15.18:0/439899257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fec201f8300 0x7fec201f8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:16.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.988+0000 7fec27e27640 1 --2- 172.21.15.18:0/439899257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fec20154cd0 0x7fec2015cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:16.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.988+0000 7fec27e27640 1 --2- 172.21.15.18:0/439899257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fec0c004800 0x7fec2015c760 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:16.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.988+0000 7fec27e27640 1 -- 172.21.15.18:0/439899257 >> 172.21.15.18:0/439899257 conn(0x7fec200d4c60 msgr2=0x7fec200d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:16.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.988+0000 7fec27e27640 1 -- 172.21.15.18:0/439899257 shutdown_connections 2024-09-19T09:15:16.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:15.988+0000 7fec27e27640 1 -- 172.21.15.18:0/439899257 wait complete. 2024-09-19T09:15:16.070 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-09-19T09:15:16.071 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-19T09:15:16.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.175+0000 7fce44dd6640 1 Processor -- start 2024-09-19T09:15:16.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.175+0000 7fce44dd6640 1 -- start start 2024-09-19T09:15:16.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.176+0000 7fce44dd6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fce4015ef50 0x7fce400d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:16.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.176+0000 7fce44dd6640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fce400b9510 0x7fce400d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:16.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.176+0000 7fce44dd6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce400b7a90 con 0x7fce400d3240 2024-09-19T09:15:16.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.176+0000 7fce44dd6640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fce400d3740 con 0x7fce4015ef50 2024-09-19T09:15:16.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.176+0000 7fce44dd6640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fce400d3a20 con 0x7fce400b9510 2024-09-19T09:15:16.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.176+0000 7fce3e59c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fce4015ef50 0x7fce400d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:16.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.176+0000 7fce3e59c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fce4015ef50 0x7fce400d13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57602/0 (socket says 172.21.15.18:57602) 2024-09-19T09:15:16.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.176+0000 7fce3e59c640 1 -- 172.21.15.18:0/1010963897 learned_addr learned my addr 172.21.15.18:0/1010963897 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:16.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.177+0000 7fce3e59c640 1 -- 172.21.15.18:0/1010963897 >> v2:172.21.15.162:3300/0 conn(0x7fce400b9510 msgr2=0x7fce400d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:16.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.177+0000 7fce3e59c640 1 --2- 172.21.15.18:0/1010963897 >> v2:172.21.15.162:3300/0 conn(0x7fce400b9510 0x7fce400d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:16.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.177+0000 7fce3e59c640 1 -- 172.21.15.18:0/1010963897 >> v1:172.21.15.162:6789/0 conn(0x7fce400d3240 legacy=0x7fce400cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:16.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.177+0000 7fce3e59c640 1 -- 172.21.15.18:0/1010963897 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce400b7d00 con 0x7fce4015ef50 2024-09-19T09:15:16.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.177+0000 7fce3e59c640 1 --2- 172.21.15.18:0/1010963897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce4015ef50 0x7fce400d13a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fce4008ea60 tx=0x7fce3802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d19a415e89e497 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:16.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.177+0000 7fce3d59a640 1 -- 172.21.15.18:0/1010963897 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce38037070 con 0x7fce4015ef50 2024-09-19T09:15:16.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.177+0000 7fce3d59a640 1 -- 172.21.15.18:0/1010963897 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce38032440 con 0x7fce4015ef50 2024-09-19T09:15:16.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.177+0000 7fce3d59a640 1 -- 172.21.15.18:0/1010963897 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce38032810 con 0x7fce4015ef50 2024-09-19T09:15:16.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.178+0000 7fce44dd6640 1 -- 172.21.15.18:0/1010963897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce4015ef50 msgr2=0x7fce400d13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:16.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.178+0000 7fce44dd6640 1 --2- 172.21.15.18:0/1010963897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce4015ef50 0x7fce400d13a0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fce4008ea60 tx=0x7fce3802a1a0 comp rx=0 tx=0).stop 2024-09-19T09:15:16.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.178+0000 7fce44dd6640 1 -- 172.21.15.18:0/1010963897 shutdown_connections 2024-09-19T09:15:16.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.178+0000 7fce44dd6640 1 --2- 172.21.15.18:0/1010963897 >> v2:172.21.15.162:3300/0 conn(0x7fce400b9510 0x7fce400d18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:16.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.178+0000 7fce44dd6640 1 --2- 172.21.15.18:0/1010963897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce4015ef50 0x7fce400d13a0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:16.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.178+0000 7fce44dd6640 1 -- 172.21.15.18:0/1010963897 >> 172.21.15.18:0/1010963897 conn(0x7fce400d4c60 msgr2=0x7fce400d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:16.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.178+0000 7fce44dd6640 1 -- 172.21.15.18:0/1010963897 shutdown_connections 2024-09-19T09:15:16.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.178+0000 7fce44dd6640 1 -- 172.21.15.18:0/1010963897 wait complete. 2024-09-19T09:15:16.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.179+0000 7fce44dd6640 1 Processor -- start 2024-09-19T09:15:16.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.179+0000 7fce44dd6640 1 -- start start 2024-09-19T09:15:16.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.180+0000 7fce44dd6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce400b9510 0x7fce4015c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:16.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.180+0000 7fce44dd6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce400d3240 0x7fce401e9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:16.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.180+0000 7fce44dd6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce4015ef50 0x7fce401e9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:16.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.180+0000 7fce44dd6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fce400d21a0 con 0x7fce400b9510 2024-09-19T09:15:16.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.180+0000 7fce44dd6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fce400d2020 con 0x7fce400d3240 2024-09-19T09:15:16.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.180+0000 7fce44dd6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fce400d5780 con 0x7fce4015ef50 2024-09-19T09:15:16.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.180+0000 7fce3e59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce400b9510 0x7fce4015c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:16.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.180+0000 7fce3e59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce400b9510 0x7fce4015c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57606/0 (socket says 172.21.15.18:57606) 2024-09-19T09:15:16.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.180+0000 7fce3e59c640 1 -- 172.21.15.18:0/1688247617 learned_addr learned my addr 172.21.15.18:0/1688247617 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:16.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.180+0000 7fce3dd9b640 1 --2- 172.21.15.18:0/1688247617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce400d3240 0x7fce401e9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:16.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.181+0000 7fce3ed9d640 1 --2- 172.21.15.18:0/1688247617 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce4015ef50 0x7fce401e9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:16.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.181+0000 7fce3e59c640 1 -- 172.21.15.18:0/1688247617 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce4015ef50 msgr2=0x7fce401e9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:16.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.181+0000 7fce3e59c640 1 --2- 172.21.15.18:0/1688247617 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce4015ef50 0x7fce401e9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:16.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.181+0000 7fce3e59c640 1 -- 172.21.15.18:0/1688247617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce400d3240 msgr2=0x7fce401e9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:16.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.181+0000 7fce3e59c640 1 --2- 172.21.15.18:0/1688247617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce400d3240 0x7fce401e9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:16.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.181+0000 7fce3e59c640 1 -- 172.21.15.18:0/1688247617 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce400c8ce0 con 0x7fce400b9510 2024-09-19T09:15:16.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.181+0000 7fce3ed9d640 1 --2- 172.21.15.18:0/1688247617 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce4015ef50 0x7fce401e9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:15:16.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.181+0000 7fce3dd9b640 1 --2- 172.21.15.18:0/1688247617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce400d3240 0x7fce401e9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:16.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.181+0000 7fce3e59c640 1 --2- 172.21.15.18:0/1688247617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce400b9510 0x7fce4015c020 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fce3802a1e0 tx=0x7fce380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:16.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.181+0000 7fce36ffd640 1 -- 172.21.15.18:0/1688247617 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce38041070 con 0x7fce400b9510 2024-09-19T09:15:16.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.181+0000 7fce36ffd640 1 -- 172.21.15.18:0/1688247617 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce3803c870 con 0x7fce400b9510 2024-09-19T09:15:16.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.181+0000 7fce44dd6640 1 -- 172.21.15.18:0/1688247617 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce40160ae0 con 0x7fce400b9510 2024-09-19T09:15:16.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.181+0000 7fce36ffd640 1 -- 172.21.15.18:0/1688247617 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce38037040 con 0x7fce400b9510 2024-09-19T09:15:16.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.181+0000 7fce44dd6640 1 -- 172.21.15.18:0/1688247617 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce401610a0 con 0x7fce400b9510 2024-09-19T09:15:16.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.182+0000 7fce44dd6640 1 -- 172.21.15.18:0/1688247617 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce400d13a0 con 0x7fce400b9510 2024-09-19T09:15:16.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.182+0000 7fce36ffd640 1 -- 172.21.15.18:0/1688247617 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fce38044070 con 0x7fce400b9510 2024-09-19T09:15:16.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.183+0000 7fce36ffd640 1 --2- 172.21.15.18:0/1688247617 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fce2006c2b0 0x7fce2006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:16.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.183+0000 7fce36ffd640 1 -- 172.21.15.18:0/1688247617 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5854+0+0 (secure 0 0 0) 0x7fce380ac020 con 0x7fce400b9510 2024-09-19T09:15:16.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.183+0000 7fce3dd9b640 1 --2- 172.21.15.18:0/1688247617 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fce2006c2b0 0x7fce2006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:16.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.184+0000 7fce3dd9b640 1 --2- 172.21.15.18:0/1688247617 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fce2006c2b0 0x7fce2006e770 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fce400cf240 tx=0x7fce28009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:16.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.188+0000 7fce36ffd640 1 -- 172.21.15.18:0/1688247617 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fce3807a8b0 con 0x7fce400b9510 2024-09-19T09:15:16.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.363+0000 7fce44dd6640 1 -- 172.21.15.18:0/1688247617 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fce40068ec0 con 0x7fce400b9510 2024-09-19T09:15:16.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.364+0000 7fce36ffd640 1 -- 172.21.15.18:0/1688247617 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v58) ==== 81+0+35137 (secure 0 0 0) 0x7fce3807a1b0 con 0x7fce400b9510 2024-09-19T09:15:16.365 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:15:16.366 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:15:16.366 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 58, 2024-09-19T09:15:16.366 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:15:16.366 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-19T09:13:11.348786+0000", 2024-09-19T09:15:16.366 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-19T09:15:16.120924+0000", 2024-09-19T09:15:16.366 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-19T09:13:16.423937+0000", 2024-09-19T09:15:16.366 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-19T09:13:13.417141+0000", 2024-09-19T09:15:16.366 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-19T09:15:16.366 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-09-19T09:15:16.366 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-19T09:15:16.366 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-19T09:15:16.366 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-19T09:15:16.366 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-19T09:15:16.367 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-19T09:15:16.367 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:15:16.367 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-19T09:15:16.367 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.69999998807907104, 2024-09-19T09:15:16.367 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-19T09:15:16.367 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-19T09:15:16.367 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-19T09:15:16.367 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 7, 2024-09-19T09:15:16.367 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-19T09:15:16.367 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-19T09:15:16.367 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "luminous", 2024-09-19T09:15:16.367 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-19T09:15:16.367 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-19T09:15:16.367 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-19T09:15:16.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.368 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-19T09:15:16.368 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-19T09:15:16.368 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:13:17.564717+0000", 2024-09-19T09:15:16.368 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:15:16.368 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:15:16.368 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:15:16.368 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:15:16.368 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:15:16.368 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:15:16.368 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:15:16.369 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:15:16.370 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:15:16.370 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:15:16.370 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:15:16.370 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:15:16.370 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:15:16.370 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-19T09:15:16.370 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-19T09:15:16.370 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-19T09:15:16.370 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-19T09:15:16.370 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-19T09:15:16.370 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:15:16.370 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:15:16.370 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:15:16.371 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:15:16.371 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:15:16.371 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:15:16.371 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:15:16.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.371 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "57", 2024-09-19T09:15:16.371 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:15:16.371 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:15:16.371 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:15:16.371 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:15:16.371 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:15:16.371 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:15:16.371 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:15:16.371 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:15:16.372 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:15:16.372 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:15:16.372 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:15:16.372 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:15:16.372 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:15:16.372 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:15:16.372 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:15:16.372 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:15:16.372 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:15:16.372 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:15:16.372 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:15:16.372 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:15:16.372 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:15:16.372 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:15:16.373 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:15:16.373 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:15:16.373 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:15:16.373 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:15:16.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.373 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:15:16.373 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:15:16.373 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:15:16.373 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:15:16.373 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:15:16.373 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:15:16.373 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:15:16.373 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:15:16.373 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:15:16.374 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:15:16.374 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:15:16.374 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:15:16.374 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-19T09:15:16.374 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-19T09:15:16.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.374 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:15:16.374 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-19T09:15:16.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.374 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:15:16.374 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:15:16.374 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-19T09:15:16.374 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-19T09:15:16.374 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-19T09:15:16.374 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-19T09:15:16.375 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-19T09:15:16.375 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:15:16.375 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:15:16.375 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:15:16.375 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.375 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 6, 2024-09-19T09:15:16.375 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_metadata", 2024-09-19T09:15:16.375 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:14:41.948276+0000", 2024-09-19T09:15:16.375 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:15:16.375 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:15:16.375 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:15:16.375 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:15:16.376 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:15:16.376 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:15:16.376 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:15:16.376 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:15:16.376 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:15:16.376 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:15:16.376 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:15:16.377 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:15:16.377 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:15:16.377 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-19T09:15:16.377 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-19T09:15:16.377 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-19T09:15:16.377 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-19T09:15:16.377 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-19T09:15:16.377 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:15:16.377 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:15:16.377 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:15:16.377 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:15:16.378 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:15:16.378 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:15:16.378 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:15:16.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.378 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "57", 2024-09-19T09:15:16.378 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:15:16.378 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:15:16.378 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:15:16.378 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:15:16.378 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:15:16.378 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:15:16.378 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:15:16.378 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:15:16.378 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:15:16.379 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:15:16.379 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:15:16.379 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:15:16.379 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:15:16.379 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:15:16.379 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:15:16.379 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:15:16.379 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:15:16.379 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:15:16.379 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:15:16.379 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:15:16.379 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:15:16.379 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:15:16.380 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:15:16.380 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:15:16.380 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:15:16.380 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:15:16.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.380 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:15:16.380 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:15:16.380 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:15:16.380 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:15:16.380 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:15:16.380 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:15:16.380 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:15:16.380 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:15:16.380 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:15:16.381 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:15:16.381 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:15:16.381 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:15:16.381 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4, 2024-09-19T09:15:16.381 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 16, 2024-09-19T09:15:16.381 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_priority": 5 2024-09-19T09:15:16.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.381 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:15:16.381 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:15:16.381 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": "cephfs" 2024-09-19T09:15:16.381 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.381 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:15:16.382 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:15:16.382 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.5, 2024-09-19T09:15:16.382 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.5, 2024-09-19T09:15:16.382 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:15:16.382 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.5, 2024-09-19T09:15:16.382 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.5, 2024-09-19T09:15:16.382 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:15:16.382 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:15:16.382 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:15:16.382 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.382 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 7, 2024-09-19T09:15:16.382 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_data", 2024-09-19T09:15:16.383 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:14:42.341949+0000", 2024-09-19T09:15:16.383 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:15:16.383 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:15:16.383 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:15:16.383 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:15:16.383 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:15:16.383 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:15:16.383 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:15:16.383 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:15:16.383 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:15:16.383 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:15:16.383 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:15:16.383 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:15:16.384 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:15:16.384 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 64, 2024-09-19T09:15:16.384 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 64, 2024-09-19T09:15:16.384 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 64, 2024-09-19T09:15:16.384 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 64, 2024-09-19T09:15:16.384 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 64, 2024-09-19T09:15:16.384 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:15:16.384 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:15:16.384 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:15:16.385 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:15:16.385 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:15:16.385 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:15:16.385 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:15:16.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.385 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "57", 2024-09-19T09:15:16.385 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:15:16.385 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:15:16.385 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:15:16.385 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:15:16.385 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:15:16.385 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:15:16.386 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:15:16.386 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:15:16.386 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:15:16.386 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:15:16.386 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:15:16.386 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:15:16.386 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:15:16.386 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:15:16.386 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:15:16.386 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:15:16.387 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:15:16.387 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:15:16.387 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:15:16.387 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:15:16.387 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:15:16.387 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:15:16.387 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:15:16.387 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:15:16.387 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:15:16.387 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:15:16.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.387 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:15:16.387 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:15:16.388 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:15:16.388 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:15:16.388 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:15:16.388 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:15:16.388 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:15:16.388 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:15:16.388 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:15:16.388 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:15:16.388 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:15:16.388 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:15:16.388 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 64, 2024-09-19T09:15:16.388 INFO:teuthology.orchestra.run.smithi018.stdout: "target_size_ratio": 0.89999997615814209 2024-09-19T09:15:16.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.389 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:15:16.389 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:15:16.389 INFO:teuthology.orchestra.run.smithi018.stdout: "data": "cephfs" 2024-09-19T09:15:16.389 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.389 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:15:16.389 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:15:16.389 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.25, 2024-09-19T09:15:16.389 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.25, 2024-09-19T09:15:16.390 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:15:16.390 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.25, 2024-09-19T09:15:16.390 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.25, 2024-09-19T09:15:16.390 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:15:16.390 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:15:16.390 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:15:16.390 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.390 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.390 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:15:16.390 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-19T09:15:16.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.390 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:15:16.390 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:16.391 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:16.391 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:16.391 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:16.391 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:16.391 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:16.391 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:16.391 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:16.391 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:16.391 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:16.391 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:16.391 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:16.391 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.391 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.392 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-19T09:15:16.392 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:16.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.392 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.392 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-19T09:15:16.392 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:16.392 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.392 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.392 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:16.392 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.392 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.393 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-19T09:15:16.393 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:16.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.393 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.393 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-19T09:15:16.393 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:16.393 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.393 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.393 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:16.393 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.394 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.394 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-19T09:15:16.394 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:16.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.394 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.394 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-19T09:15:16.394 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:16.394 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.394 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.394 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:16.394 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.394 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.395 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-19T09:15:16.395 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:16.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.395 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.395 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-19T09:15:16.395 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:15:16.395 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.395 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.395 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/128722874", 2024-09-19T09:15:16.395 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/128722874", 2024-09-19T09:15:16.395 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/128722874", 2024-09-19T09:15:16.395 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/128722874", 2024-09-19T09:15:16.396 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:16.396 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:16.396 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:16.396 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.396 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:15:16.396 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:16.396 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:16.396 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:16.396 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:16.396 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:16.396 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:16.397 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:16.397 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:16.397 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:16.397 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:16.397 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:16.397 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:16.397 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.397 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.397 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-19T09:15:16.397 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:16.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.398 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.398 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-19T09:15:16.398 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:16.398 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.398 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.398 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:16.398 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.398 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.398 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-19T09:15:16.398 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:16.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.399 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.399 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-19T09:15:16.399 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:16.399 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.399 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.399 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:16.399 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.399 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.399 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-19T09:15:16.400 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:16.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.400 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.400 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-19T09:15:16.400 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:16.400 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.400 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.400 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:16.400 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.400 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.401 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-19T09:15:16.401 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:16.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.401 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.401 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-19T09:15:16.401 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:15:16.401 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.401 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.401 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/3672199638", 2024-09-19T09:15:16.402 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/3672199638", 2024-09-19T09:15:16.402 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/3672199638", 2024-09-19T09:15:16.402 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/3672199638", 2024-09-19T09:15:16.402 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:16.402 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:16.402 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:16.402 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.402 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:15:16.402 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:16.402 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:16.402 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:16.403 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:16.403 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:16.403 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:16.403 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:16.403 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:16.404 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:16.404 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:16.404 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:16.404 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:16.404 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.404 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.404 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T09:15:16.404 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:16.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.404 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.404 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.405 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T09:15:16.405 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:16.405 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.405 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.405 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:16.405 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.406 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.406 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-19T09:15:16.406 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:16.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.406 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.406 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-19T09:15:16.406 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:16.406 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.406 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.406 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:16.406 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.407 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.407 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-19T09:15:16.407 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:16.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.407 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.407 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-19T09:15:16.407 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:16.407 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.408 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.408 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:16.408 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.408 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.408 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-19T09:15:16.408 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:16.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.408 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.408 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-19T09:15:16.408 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:15:16.409 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.409 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.409 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3463367841", 2024-09-19T09:15:16.409 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3463367841", 2024-09-19T09:15:16.409 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3463367841", 2024-09-19T09:15:16.409 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3463367841", 2024-09-19T09:15:16.409 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:16.409 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:16.409 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:16.409 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.410 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:15:16.410 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:16.410 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:16.410 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:16.410 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:16.410 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:16.411 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:16.411 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:16.411 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:16.411 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:16.411 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:16.411 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:16.411 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:16.411 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.412 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.412 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-19T09:15:16.412 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:16.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.412 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.412 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-19T09:15:16.412 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:16.412 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.412 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.412 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:16.412 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.413 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.413 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-19T09:15:16.413 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:16.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.413 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.413 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-19T09:15:16.413 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:16.414 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.414 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.414 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:16.414 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.414 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.414 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-19T09:15:16.414 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:16.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.414 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.414 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-19T09:15:16.415 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:16.415 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.415 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.415 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:16.415 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.415 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.415 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-19T09:15:16.415 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:16.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.416 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.416 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-19T09:15:16.416 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:15:16.416 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.416 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.416 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/4163178582", 2024-09-19T09:15:16.416 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/4163178582", 2024-09-19T09:15:16.416 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/4163178582", 2024-09-19T09:15:16.416 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/4163178582", 2024-09-19T09:15:16.416 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:16.417 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:16.417 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:16.417 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.417 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:15:16.417 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:16.417 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:16.417 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:16.417 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:16.417 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:16.417 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:16.417 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:16.418 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:16.418 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:16.418 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:16.418 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:16.418 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:16.418 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.418 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.418 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6822", 2024-09-19T09:15:16.418 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:16.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.419 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.419 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6824", 2024-09-19T09:15:16.419 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:16.419 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.419 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.419 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:16.419 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.419 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.419 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6826", 2024-09-19T09:15:16.419 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:16.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.420 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.420 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6827", 2024-09-19T09:15:16.420 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:16.420 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.420 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.420 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:16.420 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.420 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.420 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6830", 2024-09-19T09:15:16.420 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:16.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.421 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.421 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6831", 2024-09-19T09:15:16.421 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:16.421 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.421 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.421 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:16.421 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.421 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.421 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6828", 2024-09-19T09:15:16.421 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:16.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.422 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.422 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6829", 2024-09-19T09:15:16.422 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:15:16.422 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.422 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.422 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6824/3538482215", 2024-09-19T09:15:16.422 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6827/3538482215", 2024-09-19T09:15:16.422 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6831/3538482215", 2024-09-19T09:15:16.422 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6829/3538482215", 2024-09-19T09:15:16.422 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:16.423 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:16.423 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:16.423 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.423 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.423 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:15:16.423 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:16.423 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:16.423 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:16.423 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:16.423 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:16.423 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:16.423 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:16.423 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:16.424 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:16.424 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:16.424 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:16.424 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:16.424 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.424 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.424 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6800", 2024-09-19T09:15:16.424 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:16.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.424 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.424 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6801", 2024-09-19T09:15:16.425 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:16.425 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.425 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.425 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.425 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:16.425 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.425 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.425 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6802", 2024-09-19T09:15:16.425 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:16.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.426 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.426 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6803", 2024-09-19T09:15:16.426 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:16.426 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.426 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.426 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:16.426 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.426 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.426 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6806", 2024-09-19T09:15:16.427 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:16.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.427 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.427 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6807", 2024-09-19T09:15:16.427 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:16.427 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.427 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.427 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:16.427 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.427 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.427 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6804", 2024-09-19T09:15:16.428 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:16.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.428 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.428 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6805", 2024-09-19T09:15:16.428 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:15:16.428 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.428 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.428 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6801/2408698413", 2024-09-19T09:15:16.429 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6803/2408698413", 2024-09-19T09:15:16.429 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6807/2408698413", 2024-09-19T09:15:16.429 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6805/2408698413", 2024-09-19T09:15:16.429 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:16.429 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:16.429 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:16.429 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.429 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:15:16.429 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:16.429 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:16.429 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:16.430 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:16.430 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:16.430 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:16.430 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:16.430 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:16.430 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:16.430 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:16.430 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:16.430 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:16.430 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.430 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.430 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.430 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6808", 2024-09-19T09:15:16.430 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:16.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.431 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.431 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6809", 2024-09-19T09:15:16.431 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:16.431 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.431 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.431 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:16.431 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.431 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.431 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6810", 2024-09-19T09:15:16.431 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:16.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.432 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.432 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6811", 2024-09-19T09:15:16.432 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:16.432 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.432 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.432 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:16.432 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.432 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.432 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6814", 2024-09-19T09:15:16.433 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:16.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.433 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.433 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6815", 2024-09-19T09:15:16.433 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:16.433 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.433 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.433 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:16.433 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.433 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.434 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6812", 2024-09-19T09:15:16.434 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:16.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.434 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.434 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6813", 2024-09-19T09:15:16.434 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:15:16.434 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.434 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.434 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6809/2596207948", 2024-09-19T09:15:16.434 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6811/2596207948", 2024-09-19T09:15:16.435 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6815/2596207948", 2024-09-19T09:15:16.435 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6813/2596207948", 2024-09-19T09:15:16.435 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:16.435 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:16.435 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:16.435 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.435 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:15:16.435 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:15:16.435 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:15:16.435 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:15:16.435 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:15:16.435 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:15:16.436 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:15:16.436 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:15:16.436 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:15:16.436 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 46, 2024-09-19T09:15:16.436 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:15:16.436 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:15:16.436 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:15:16.436 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.436 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.436 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6816", 2024-09-19T09:15:16.436 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:16.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.437 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.437 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6817", 2024-09-19T09:15:16.437 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:16.437 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.437 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.437 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.437 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:15:16.437 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.437 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.437 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.437 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6818", 2024-09-19T09:15:16.438 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:16.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.438 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.438 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6819", 2024-09-19T09:15:16.438 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:16.438 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.438 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.438 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:15:16.438 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.438 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.439 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.439 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6823", 2024-09-19T09:15:16.439 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:16.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.439 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.439 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.439 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6825", 2024-09-19T09:15:16.439 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:16.439 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.439 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.439 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.439 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:15:16.440 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:15:16.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.440 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:15:16.440 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6820", 2024-09-19T09:15:16.440 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:16.440 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.440 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.440 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:15:16.440 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6821", 2024-09-19T09:15:16.440 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:15:16.441 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.441 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.441 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.441 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6817/1334618296", 2024-09-19T09:15:16.441 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6819/1334618296", 2024-09-19T09:15:16.441 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6825/1334618296", 2024-09-19T09:15:16.441 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6821/1334618296", 2024-09-19T09:15:16.441 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:15:16.441 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:15:16.441 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:15:16.441 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.442 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.442 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:15:16.442 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-19T09:15:16.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.442 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:15:16.442 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:16.442 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:16.442 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:16.442 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:16.442 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:16.442 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.580838+0000", 2024-09-19T09:15:16.442 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:16.442 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.442 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.443 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:15:16.443 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:16.443 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:16.443 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:16.443 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:16.443 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:16.443 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.599990+0000", 2024-09-19T09:15:16.443 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:16.443 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.443 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.443 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:15:16.443 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:16.443 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:16.444 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:16.444 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:16.444 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:16.444 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.503722+0000", 2024-09-19T09:15:16.444 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:16.444 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.444 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.444 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:15:16.444 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:16.444 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:16.444 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:16.444 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:16.444 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:16.445 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.607846+0000", 2024-09-19T09:15:16.445 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:16.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.445 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.445 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:15:16.445 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:16.445 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:16.445 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:16.445 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:16.445 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:16.445 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.616858+0000", 2024-09-19T09:15:16.445 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:16.445 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.446 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:15:16.446 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:16.446 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:16.446 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:16.446 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:16.446 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:16.446 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.542726+0000", 2024-09-19T09:15:16.446 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:16.446 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.446 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.446 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:15:16.446 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:16.447 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:16.447 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:16.447 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:16.447 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:16.447 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.534178+0000", 2024-09-19T09:15:16.447 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:16.447 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.447 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.447 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:15:16.447 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:15:16.447 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:15:16.447 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:15:16.447 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:15:16.447 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:15:16.447 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.612105+0000", 2024-09-19T09:15:16.448 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:15:16.448 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.448 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:15:16.448 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-19T09:15:16.448 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [ 2024-09-19T09:15:16.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.448 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "7.0", 2024-09-19T09:15:16.448 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-09-19T09:15:16.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.448 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 5, 2024-09-19T09:15:16.448 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 0 2024-09-19T09:15:16.448 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.448 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.449 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.449 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "7.3", 2024-09-19T09:15:16.449 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-09-19T09:15:16.449 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.449 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 5, 2024-09-19T09:15:16.449 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 7 2024-09-19T09:15:16.449 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.449 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.449 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.450 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.450 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "7.14", 2024-09-19T09:15:16.450 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-09-19T09:15:16.450 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.450 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 5, 2024-09-19T09:15:16.450 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 7 2024-09-19T09:15:16.450 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.450 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.450 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.450 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "7.1d", 2024-09-19T09:15:16.450 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-09-19T09:15:16.450 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.451 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 5, 2024-09-19T09:15:16.451 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 7 2024-09-19T09:15:16.451 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.451 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.451 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.451 INFO:teuthology.orchestra.run.smithi018.stdout: "pgid": "7.3c", 2024-09-19T09:15:16.451 INFO:teuthology.orchestra.run.smithi018.stdout: "mappings": [ 2024-09-19T09:15:16.451 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:16.451 INFO:teuthology.orchestra.run.smithi018.stdout: "from": 5, 2024-09-19T09:15:16.451 INFO:teuthology.orchestra.run.smithi018.stdout: "to": 7 2024-09-19T09:15:16.451 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.451 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:16.451 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.451 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:15:16.452 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-19T09:15:16.452 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-19T09:15:16.452 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-19T09:15:16.452 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-19T09:15:16.452 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-19T09:15:16.452 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-19T09:15:16.452 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-19T09:15:16.452 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-19T09:15:16.452 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-19T09:15:16.452 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-19T09:15:16.452 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-19T09:15:16.452 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-19T09:15:16.453 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.453 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:16.453 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-19T09:15:16.453 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-19T09:15:16.453 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-19T09:15:16.453 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-19T09:15:16.453 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-19T09:15:16.453 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-19T09:15:16.453 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-19T09:15:16.453 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-19T09:15:16.453 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-19T09:15:16.454 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-19T09:15:16.454 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-19T09:15:16.454 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:16.454 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:15:16.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.366+0000 7fce44dd6640 1 -- 172.21.15.18:0/1688247617 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fce2006c2b0 msgr2=0x7fce2006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:16.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.366+0000 7fce44dd6640 1 --2- 172.21.15.18:0/1688247617 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fce2006c2b0 0x7fce2006e770 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fce400cf240 tx=0x7fce28009040 comp rx=0 tx=0).stop 2024-09-19T09:15:16.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.366+0000 7fce44dd6640 1 -- 172.21.15.18:0/1688247617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce400b9510 msgr2=0x7fce4015c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:16.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.366+0000 7fce44dd6640 1 --2- 172.21.15.18:0/1688247617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce400b9510 0x7fce4015c020 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fce3802a1e0 tx=0x7fce380046c0 comp rx=0 tx=0).stop 2024-09-19T09:15:16.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.366+0000 7fce44dd6640 1 -- 172.21.15.18:0/1688247617 shutdown_connections 2024-09-19T09:15:16.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.366+0000 7fce44dd6640 1 --2- 172.21.15.18:0/1688247617 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fce2006c2b0 0x7fce2006e770 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:16.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.366+0000 7fce44dd6640 1 --2- 172.21.15.18:0/1688247617 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fce4015ef50 0x7fce401e9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:16.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.366+0000 7fce44dd6640 1 --2- 172.21.15.18:0/1688247617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fce400d3240 0x7fce401e9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:16.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.366+0000 7fce44dd6640 1 --2- 172.21.15.18:0/1688247617 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fce400b9510 0x7fce4015c020 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:16.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.366+0000 7fce44dd6640 1 -- 172.21.15.18:0/1688247617 >> 172.21.15.18:0/1688247617 conn(0x7fce400d4c60 msgr2=0x7fce400b68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:16.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.367+0000 7fce44dd6640 1 -- 172.21.15.18:0/1688247617 shutdown_connections 2024-09-19T09:15:16.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.367+0000 7fce44dd6640 1 -- 172.21.15.18:0/1688247617 wait complete. 2024-09-19T09:15:16.457 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:15:16.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.559+0000 7fca240dd640 1 Processor -- start 2024-09-19T09:15:16.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.559+0000 7fca240dd640 1 -- start start 2024-09-19T09:15:16.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.560+0000 7fca240dd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fca1c15ef80 0x7fca1c0b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:16.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.560+0000 7fca240dd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fca1c06d730 0x7fca1c0cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:16.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.560+0000 7fca240dd640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca1c0cd1a0 con 0x7fca1c0cf910 2024-09-19T09:15:16.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.560+0000 7fca240dd640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fca1c0cd7d0 con 0x7fca1c06d730 2024-09-19T09:15:16.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.560+0000 7fca240dd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fca1c06dc30 con 0x7fca1c15ef80 2024-09-19T09:15:16.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.560+0000 7fca21678640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fca1c06d730 0x7fca1c0cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:16.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.560+0000 7fca21678640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fca1c06d730 0x7fca1c0cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57620/0 (socket says 172.21.15.18:57620) 2024-09-19T09:15:16.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.560+0000 7fca21678640 1 -- 172.21.15.18:0/1473001907 learned_addr learned my addr 172.21.15.18:0/1473001907 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:16.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.560+0000 7fca21e79640 1 --2- 172.21.15.18:0/1473001907 >> v2:172.21.15.162:3300/0 conn(0x7fca1c15ef80 0x7fca1c0b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:16.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.560+0000 7fca21678640 1 -- 172.21.15.18:0/1473001907 >> v2:172.21.15.162:3300/0 conn(0x7fca1c15ef80 msgr2=0x7fca1c0b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:16.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.560+0000 7fca21678640 1 --2- 172.21.15.18:0/1473001907 >> v2:172.21.15.162:3300/0 conn(0x7fca1c15ef80 0x7fca1c0b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:16.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.560+0000 7fca21678640 1 -- 172.21.15.18:0/1473001907 >> v1:172.21.15.162:6789/0 conn(0x7fca1c0cf910 legacy=0x7fca1c0d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:16.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.560+0000 7fca21678640 1 -- 172.21.15.18:0/1473001907 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca1c06df10 con 0x7fca1c06d730 2024-09-19T09:15:16.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.561+0000 7fca21678640 1 --2- 172.21.15.18:0/1473001907 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca1c06d730 0x7fca1c0cf3d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fca1c06f6e0 tx=0x7fca0c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed2a8a2c53047bc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:16.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.561+0000 7fca20e77640 1 -- 172.21.15.18:0/1473001907 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c037070 con 0x7fca1c06d730 2024-09-19T09:15:16.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.561+0000 7fca20e77640 1 -- 172.21.15.18:0/1473001907 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca0c032440 con 0x7fca1c06d730 2024-09-19T09:15:16.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.561+0000 7fca20e77640 1 -- 172.21.15.18:0/1473001907 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c032810 con 0x7fca1c06d730 2024-09-19T09:15:16.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.562+0000 7fca240dd640 1 -- 172.21.15.18:0/1473001907 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca1c06d730 msgr2=0x7fca1c0cf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:16.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.562+0000 7fca240dd640 1 --2- 172.21.15.18:0/1473001907 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca1c06d730 0x7fca1c0cf3d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fca1c06f6e0 tx=0x7fca0c02a270 comp rx=0 tx=0).stop 2024-09-19T09:15:16.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.562+0000 7fca240dd640 1 -- 172.21.15.18:0/1473001907 shutdown_connections 2024-09-19T09:15:16.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.562+0000 7fca240dd640 1 --2- 172.21.15.18:0/1473001907 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca1c06d730 0x7fca1c0cf3d0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:16.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.562+0000 7fca240dd640 1 --2- 172.21.15.18:0/1473001907 >> v2:172.21.15.162:3300/0 conn(0x7fca1c15ef80 0x7fca1c0b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:16.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.562+0000 7fca240dd640 1 -- 172.21.15.18:0/1473001907 >> 172.21.15.18:0/1473001907 conn(0x7fca1c0b4700 msgr2=0x7fca1c0b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:16.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.562+0000 7fca240dd640 1 -- 172.21.15.18:0/1473001907 shutdown_connections 2024-09-19T09:15:16.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.562+0000 7fca240dd640 1 -- 172.21.15.18:0/1473001907 wait complete. 2024-09-19T09:15:16.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.563+0000 7fca240dd640 1 Processor -- start 2024-09-19T09:15:16.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.563+0000 7fca240dd640 1 -- start start 2024-09-19T09:15:16.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.564+0000 7fca240dd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca1c06d730 0x7fca1c0b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:16.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.564+0000 7fca240dd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca1c0cf910 0x7fca1c0c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:16.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.564+0000 7fca240dd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca1c15ef80 0x7fca1c15ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:16.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.564+0000 7fca240dd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fca1c0d0120 con 0x7fca1c0cf910 2024-09-19T09:15:16.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.564+0000 7fca240dd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fca1c15f360 con 0x7fca1c15ef80 2024-09-19T09:15:16.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.564+0000 7fca240dd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fca1c0cec70 con 0x7fca1c06d730 2024-09-19T09:15:16.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.564+0000 7fca21678640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca1c0cf910 0x7fca1c0c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:16.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.564+0000 7fca21678640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca1c0cf910 0x7fca1c0c8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57634/0 (socket says 172.21.15.18:57634) 2024-09-19T09:15:16.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.564+0000 7fca21678640 1 -- 172.21.15.18:0/3940218892 learned_addr learned my addr 172.21.15.18:0/3940218892 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:16.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.564+0000 7fca21e79640 1 --2- 172.21.15.18:0/3940218892 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca1c06d730 0x7fca1c0b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:16.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.564+0000 7fca2267a640 1 --2- 172.21.15.18:0/3940218892 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca1c15ef80 0x7fca1c15ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:16.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.564+0000 7fca21678640 1 -- 172.21.15.18:0/3940218892 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca1c06d730 msgr2=0x7fca1c0b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:16.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.564+0000 7fca21678640 1 --2- 172.21.15.18:0/3940218892 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca1c06d730 0x7fca1c0b6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:16.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.564+0000 7fca21678640 1 -- 172.21.15.18:0/3940218892 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca1c15ef80 msgr2=0x7fca1c15ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:16.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.564+0000 7fca21678640 1 --2- 172.21.15.18:0/3940218892 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca1c15ef80 0x7fca1c15ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:16.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.564+0000 7fca21678640 1 -- 172.21.15.18:0/3940218892 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca1c0c6770 con 0x7fca1c0cf910 2024-09-19T09:15:16.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.564+0000 7fca21678640 1 --2- 172.21.15.18:0/3940218892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca1c0cf910 0x7fca1c0c8600 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fca0c02a2b0 tx=0x7fca0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:16.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.565+0000 7fca127fc640 1 -- 172.21.15.18:0/3940218892 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c041070 con 0x7fca1c0cf910 2024-09-19T09:15:16.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.565+0000 7fca127fc640 1 -- 172.21.15.18:0/3940218892 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca0c03c870 con 0x7fca1c0cf910 2024-09-19T09:15:16.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.565+0000 7fca240dd640 1 -- 172.21.15.18:0/3940218892 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca1c0c6a50 con 0x7fca1c0cf910 2024-09-19T09:15:16.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.565+0000 7fca127fc640 1 -- 172.21.15.18:0/3940218892 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c037040 con 0x7fca1c0cf910 2024-09-19T09:15:16.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.565+0000 7fca240dd640 1 -- 172.21.15.18:0/3940218892 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca1c0c9360 con 0x7fca1c0cf910 2024-09-19T09:15:16.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.566+0000 7fca240dd640 1 -- 172.21.15.18:0/3940218892 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca1c0c95a0 con 0x7fca1c0cf910 2024-09-19T09:15:16.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.566+0000 7fca127fc640 1 -- 172.21.15.18:0/3940218892 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fca0c044070 con 0x7fca1c0cf910 2024-09-19T09:15:16.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.567+0000 7fca127fc640 1 --2- 172.21.15.18:0/3940218892 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fca0006c2b0 0x7fca0006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:16.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.567+0000 7fca127fc640 1 -- 172.21.15.18:0/3940218892 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5854+0+0 (secure 0 0 0) 0x7fca0c0ac060 con 0x7fca1c0cf910 2024-09-19T09:15:16.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.567+0000 7fca21e79640 1 --2- 172.21.15.18:0/3940218892 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fca0006c2b0 0x7fca0006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:16.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.568+0000 7fca21e79640 1 --2- 172.21.15.18:0/3940218892 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fca0006c2b0 0x7fca0006e770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fca18006fd0 tx=0x7fca18008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:16.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.571+0000 7fca127fc640 1 -- 172.21.15.18:0/3940218892 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fca1c0c95a0 con 0x7fca1c0cf910 2024-09-19T09:15:16.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.784+0000 7fca240dd640 1 -- 172.21.15.18:0/3940218892 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca1c0cf3d0 con 0x7fca1c0cf910 2024-09-19T09:15:16.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.785+0000 7fca127fc640 1 -- 172.21.15.18:0/3940218892 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5223 (secure 0 0 0) 0x7fca0c07a2a0 con 0x7fca1c0cf910 2024-09-19T09:15:16.785 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:15:16.786 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"btime":"2024-09-19T09:14:46:022043+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4793,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/113686001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":113686001},{"type":"v1","addr":"172.21.15.162:6835","nonce":113686001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":4799,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3269042030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3269042030},{"type":"v1","addr":"172.21.15.162:6837","nonce":3269042030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/3996030837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3996030837},{"type":"v1","addr":"172.21.15.18:6834","nonce":3996030837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:14:43.367290+0000","modified":"2024-09-19T09:14:45.363192+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5187":{"gid":5187,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/295967875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":295967875},{"type":"v1","addr":"172.21.15.18:6835","nonce":295967875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5187,"qdb_cluster":[5187]},"id":3}]} 2024-09-19T09:15:16.786 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 21 2024-09-19T09:15:16.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.787+0000 7fca240dd640 1 -- 172.21.15.18:0/3940218892 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fca0006c2b0 msgr2=0x7fca0006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:16.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.787+0000 7fca240dd640 1 --2- 172.21.15.18:0/3940218892 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fca0006c2b0 0x7fca0006e770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fca18006fd0 tx=0x7fca18008040 comp rx=0 tx=0).stop 2024-09-19T09:15:16.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.787+0000 7fca240dd640 1 -- 172.21.15.18:0/3940218892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca1c0cf910 msgr2=0x7fca1c0c8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:16.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.787+0000 7fca240dd640 1 --2- 172.21.15.18:0/3940218892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca1c0cf910 0x7fca1c0c8600 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fca0c02a2b0 tx=0x7fca0c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:15:16.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.787+0000 7fca240dd640 1 -- 172.21.15.18:0/3940218892 shutdown_connections 2024-09-19T09:15:16.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.787+0000 7fca240dd640 1 --2- 172.21.15.18:0/3940218892 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fca0006c2b0 0x7fca0006e770 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:16.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.787+0000 7fca240dd640 1 --2- 172.21.15.18:0/3940218892 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca1c15ef80 0x7fca1c15ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:16.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.787+0000 7fca240dd640 1 --2- 172.21.15.18:0/3940218892 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca1c0cf910 0x7fca1c0c8600 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:16.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.787+0000 7fca240dd640 1 --2- 172.21.15.18:0/3940218892 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca1c06d730 0x7fca1c0b6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:16.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.787+0000 7fca240dd640 1 -- 172.21.15.18:0/3940218892 >> 172.21.15.18:0/3940218892 conn(0x7fca1c0b4700 msgr2=0x7fca1c15dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:16.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.787+0000 7fca240dd640 1 -- 172.21.15.18:0/3940218892 shutdown_connections 2024-09-19T09:15:16.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:16.787+0000 7fca240dd640 1 -- 172.21.15.18:0/3940218892 wait complete. 2024-09-19T09:15:16.799 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-19T09:15:16.921 INFO:teuthology.orchestra.run.smithi018.stdout:{"cluster_fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","whoami":0,"id":5187,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":32.895549932000002,"mdsmap_epoch":21,"osdmap_epoch":58,"osdmap_epoch_barrier":52,"uptime":43.886385767} 2024-09-19T09:15:16.922 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", "fs_name": "cephfs", "id": 5187, "mdsmap_epoch": 21, "osdmap_epoch": 58, "osdmap_epoch_barrier": 52, "rank_uptime": 32.895549932, "state": "up:active", "uptime": 43.886385767, "want_state": "up:active", "whoami": 0 } 2024-09-19T09:15:16.922 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-19T09:15:16.922 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:15:16.923 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:15:16.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:15:16.941 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2024-09-19T09:15:17.175 INFO:teuthology.orchestra.run.smithi018.stderr:50+0 records in 2024-09-19T09:15:17.176 INFO:teuthology.orchestra.run.smithi018.stderr:50+0 records out 2024-09-19T09:15:17.176 INFO:teuthology.orchestra.run.smithi018.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.17663 s, 297 MB/s 2024-09-19T09:15:17.176 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T09:15:17.176 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:15:17.221 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:15:17.270 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T09:15:17.270 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:15:17.270 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:15:17.270 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:15:17.286 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:15:17.287 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:15:17.344 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T09:15:17.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.487+0000 7f638edcf640 1 Processor -- start 2024-09-19T09:15:17.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.487+0000 7f638edcf640 1 -- start start 2024-09-19T09:15:17.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.488+0000 7f638edcf640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f638815d1b0 0x7f638815d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:17.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.488+0000 7f638edcf640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63880cd560 con 0x7f63880b1b80 2024-09-19T09:15:17.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.488+0000 7f638edcf640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f638815dad0 con 0x7f63880ce000 2024-09-19T09:15:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.488+0000 7f638edcf640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f638815d000 con 0x7f638815d1b0 2024-09-19T09:15:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.488+0000 7f638cb6b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f638815d1b0 0x7f638815d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.488+0000 7f6387fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f63880b1b80 0x7f63880d0620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43584/0 (socket says 172.21.15.18:43584) 2024-09-19T09:15:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.488+0000 7f6387fff640 1 -- 172.21.15.18:0/2986940900 learned_addr learned my addr 172.21.15.18:0/2986940900 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:15:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.489+0000 7f638cb6b640 1 -- 172.21.15.18:0/2986940900 >> v1:172.21.15.162:6789/0 conn(0x7f63880ce000 legacy=0x7f6388167a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.489+0000 7f638cb6b640 1 -- 172.21.15.18:0/2986940900 >> v1:172.21.15.18:6789/0 conn(0x7f63880b1b80 legacy=0x7f63880d0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.489+0000 7f638cb6b640 1 -- 172.21.15.18:0/2986940900 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63880b53b0 con 0x7f638815d1b0 2024-09-19T09:15:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.489+0000 7f63877fe640 1 -- 172.21.15.18:0/2986940900 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3821496319 0 0) 0x7f63880cd560 con 0x7f63880b1b80 2024-09-19T09:15:17.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.490+0000 7f638cb6b640 1 --2- 172.21.15.18:0/2986940900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f638815d1b0 0x7f638815d590 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f63800097a0 tx=0x7f638002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=875ff109ba15dfa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:17.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.490+0000 7f63877fe640 1 -- 172.21.15.18:0/2986940900 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6380037070 con 0x7f638815d1b0 2024-09-19T09:15:17.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.490+0000 7f63877fe640 1 -- 172.21.15.18:0/2986940900 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6380032440 con 0x7f638815d1b0 2024-09-19T09:15:17.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.490+0000 7f63877fe640 1 -- 172.21.15.18:0/2986940900 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6380032810 con 0x7f638815d1b0 2024-09-19T09:15:17.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.490+0000 7f638edcf640 1 -- 172.21.15.18:0/2986940900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f638815d1b0 msgr2=0x7f638815d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:17.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.490+0000 7f638edcf640 1 --2- 172.21.15.18:0/2986940900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f638815d1b0 0x7f638815d590 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f63800097a0 tx=0x7f638002a1a0 comp rx=0 tx=0).stop 2024-09-19T09:15:17.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.490+0000 7f638edcf640 1 -- 172.21.15.18:0/2986940900 shutdown_connections 2024-09-19T09:15:17.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.490+0000 7f638edcf640 1 --2- 172.21.15.18:0/2986940900 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f638815d1b0 0x7f638815d590 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:17.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.490+0000 7f638edcf640 1 -- 172.21.15.18:0/2986940900 >> 172.21.15.18:0/2986940900 conn(0x7f63880b4560 msgr2=0x7f63880b4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:17.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.490+0000 7f638edcf640 1 -- 172.21.15.18:0/2986940900 shutdown_connections 2024-09-19T09:15:17.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.490+0000 7f638edcf640 1 -- 172.21.15.18:0/2986940900 wait complete. 2024-09-19T09:15:17.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.491+0000 7f638edcf640 1 Processor -- start 2024-09-19T09:15:17.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.492+0000 7f638edcf640 1 -- start start 2024-09-19T09:15:17.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.492+0000 7f638edcf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63880b1b80 0x7f638814fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:17.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.492+0000 7f638edcf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63880ce000 0x7f63880cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:17.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.492+0000 7f638edcf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f638815d1b0 0x7f63880cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:17.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.492+0000 7f638edcf640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f63880d0030 con 0x7f63880ce000 2024-09-19T09:15:17.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.492+0000 7f638edcf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f63880cdb70 con 0x7f63880b1b80 2024-09-19T09:15:17.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.492+0000 7f638edcf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f63880cd800 con 0x7f638815d1b0 2024-09-19T09:15:17.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.492+0000 7f6387fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63880ce000 0x7f63880cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:17.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.492+0000 7f6387fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63880ce000 0x7f63880cbc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57648/0 (socket says 172.21.15.18:57648) 2024-09-19T09:15:17.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.492+0000 7f6387fff640 1 -- 172.21.15.18:0/2313226333 learned_addr learned my addr 172.21.15.18:0/2313226333 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:17.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.493+0000 7f638cb6b640 1 --2- 172.21.15.18:0/2313226333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63880b1b80 0x7f638814fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:17.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.493+0000 7f638d36c640 1 --2- 172.21.15.18:0/2313226333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f638815d1b0 0x7f63880cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:17.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.493+0000 7f6387fff640 1 -- 172.21.15.18:0/2313226333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f638815d1b0 msgr2=0x7f63880cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:17.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.493+0000 7f6387fff640 1 --2- 172.21.15.18:0/2313226333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f638815d1b0 0x7f63880cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:17.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.493+0000 7f6387fff640 1 -- 172.21.15.18:0/2313226333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63880b1b80 msgr2=0x7f638814fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:17.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.493+0000 7f6387fff640 1 --2- 172.21.15.18:0/2313226333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63880b1b80 0x7f638814fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:17.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.493+0000 7f6387fff640 1 -- 172.21.15.18:0/2313226333 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63880cc7b0 con 0x7f63880ce000 2024-09-19T09:15:17.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.493+0000 7f638d36c640 1 --2- 172.21.15.18:0/2313226333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f638815d1b0 0x7f63880cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:17.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.493+0000 7f6387fff640 1 --2- 172.21.15.18:0/2313226333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63880ce000 0x7f63880cbc60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f637800c780 tx=0x7f637800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:17.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.493+0000 7f63857fa640 1 -- 172.21.15.18:0/2313226333 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6378018070 con 0x7f63880ce000 2024-09-19T09:15:17.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.493+0000 7f63857fa640 1 -- 172.21.15.18:0/2313226333 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f637800a640 con 0x7f63880ce000 2024-09-19T09:15:17.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.493+0000 7f638edcf640 1 -- 172.21.15.18:0/2313226333 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63880cca90 con 0x7f63880ce000 2024-09-19T09:15:17.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.493+0000 7f63857fa640 1 -- 172.21.15.18:0/2313226333 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637800aab0 con 0x7f63880ce000 2024-09-19T09:15:17.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.493+0000 7f638edcf640 1 -- 172.21.15.18:0/2313226333 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63880b6560 con 0x7f63880ce000 2024-09-19T09:15:17.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.494+0000 7f638edcf640 1 -- 172.21.15.18:0/2313226333 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63880cf9e0 con 0x7f63880ce000 2024-09-19T09:15:17.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.495+0000 7f63857fa640 1 -- 172.21.15.18:0/2313226333 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f637801b070 con 0x7f63880ce000 2024-09-19T09:15:17.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.495+0000 7f63857fa640 1 --2- 172.21.15.18:0/2313226333 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f636806c2b0 0x7f636806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:17.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.495+0000 7f63857fa640 1 -- 172.21.15.18:0/2313226333 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5854+0+0 (secure 0 0 0) 0x7f637808aa70 con 0x7f63880ce000 2024-09-19T09:15:17.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.495+0000 7f638cb6b640 1 --2- 172.21.15.18:0/2313226333 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f636806c2b0 0x7f636806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:17.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.496+0000 7f638cb6b640 1 --2- 172.21.15.18:0/2313226333 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f636806c2b0 0x7f636806e770 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6380034000 tx=0x7f638002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:17.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.500+0000 7f63857fa640 1 -- 172.21.15.18:0/2313226333 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6378058b00 con 0x7f63880ce000 2024-09-19T09:15:17.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.687+0000 7f638edcf640 1 -- 172.21.15.18:0/2313226333 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f63880686d0 con 0x7f63880ce000 2024-09-19T09:15:17.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.687+0000 7f63857fa640 1 -- 172.21.15.18:0/2313226333 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v59) ==== 80+0+0 (secure 0 0 0) 0x7f637805ce00 con 0x7f63880ce000 2024-09-19T09:15:17.688 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-09-19T09:15:17.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.689+0000 7f638edcf640 1 -- 172.21.15.18:0/2313226333 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f636806c2b0 msgr2=0x7f636806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:17.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.689+0000 7f638edcf640 1 --2- 172.21.15.18:0/2313226333 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f636806c2b0 0x7f636806e770 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6380034000 tx=0x7f638002e000 comp rx=0 tx=0).stop 2024-09-19T09:15:17.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.689+0000 7f638edcf640 1 -- 172.21.15.18:0/2313226333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63880ce000 msgr2=0x7f63880cbc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:17.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.689+0000 7f638edcf640 1 --2- 172.21.15.18:0/2313226333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63880ce000 0x7f63880cbc60 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f637800c780 tx=0x7f637800cc40 comp rx=0 tx=0).stop 2024-09-19T09:15:17.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.689+0000 7f638edcf640 1 -- 172.21.15.18:0/2313226333 shutdown_connections 2024-09-19T09:15:17.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.689+0000 7f638edcf640 1 --2- 172.21.15.18:0/2313226333 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f636806c2b0 0x7f636806e770 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:17.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.689+0000 7f638edcf640 1 --2- 172.21.15.18:0/2313226333 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f638815d1b0 0x7f63880cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:17.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.689+0000 7f638edcf640 1 --2- 172.21.15.18:0/2313226333 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63880ce000 0x7f63880cbc60 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:17.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.689+0000 7f638edcf640 1 --2- 172.21.15.18:0/2313226333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63880b1b80 0x7f638814fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:17.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.689+0000 7f638edcf640 1 -- 172.21.15.18:0/2313226333 >> 172.21.15.18:0/2313226333 conn(0x7f63880b4560 msgr2=0x7f63880ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:17.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.689+0000 7f638edcf640 1 -- 172.21.15.18:0/2313226333 shutdown_connections 2024-09-19T09:15:17.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.689+0000 7f638edcf640 1 -- 172.21.15.18:0/2313226333 wait complete. 2024-09-19T09:15:17.701 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T09:15:17.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:15:17.701 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-19T09:15:17.747 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T09:15:17.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:15:17.747 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T09:15:17.772 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:15:17.773 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:15:17.773 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:15:17.790 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:15:17.790 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:15:17.846 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T09:15:17.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.949+0000 7f9eb1fcf640 1 Processor -- start 2024-09-19T09:15:17.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.949+0000 7f9eb1fcf640 1 -- start start 2024-09-19T09:15:17.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.950+0000 7f9eb1fcf640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9eac15ee60 0x7f9eac06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:17.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.950+0000 7f9eb1fcf640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9eac0b5180 0x7f9eac06d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:17.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.950+0000 7f9eb1fcf640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9eac0d19b0 con 0x7f9eac06dc40 2024-09-19T09:15:17.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.950+0000 7f9eb1fcf640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f9eac15f240 con 0x7f9eac0b5180 2024-09-19T09:15:17.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.950+0000 7f9eb1fcf640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9eac06e090 con 0x7f9eac15ee60 2024-09-19T09:15:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.950+0000 7f9eaaffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9eac0b5180 0x7f9eac06d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.950+0000 7f9eaaffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9eac0b5180 0x7f9eac06d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57662/0 (socket says 172.21.15.18:57662) 2024-09-19T09:15:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.950+0000 7f9eaaffd640 1 -- 172.21.15.18:0/3966186337 learned_addr learned my addr 172.21.15.18:0/3966186337 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.951+0000 7f9eab7fe640 1 --2- 172.21.15.18:0/3966186337 >> v2:172.21.15.162:3300/0 conn(0x7f9eac15ee60 0x7f9eac06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.951+0000 7f9eaaffd640 1 -- 172.21.15.18:0/3966186337 >> v2:172.21.15.162:3300/0 conn(0x7f9eac15ee60 msgr2=0x7f9eac06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.951+0000 7f9eaaffd640 1 --2- 172.21.15.18:0/3966186337 >> v2:172.21.15.162:3300/0 conn(0x7f9eac15ee60 0x7f9eac06cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.951+0000 7f9eaaffd640 1 -- 172.21.15.18:0/3966186337 >> v1:172.21.15.162:6789/0 conn(0x7f9eac06dc40 legacy=0x7f9eac1628c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:17.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.951+0000 7f9eaaffd640 1 -- 172.21.15.18:0/3966186337 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eac0d1c90 con 0x7f9eac0b5180 2024-09-19T09:15:17.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.951+0000 7f9eaaffd640 1 --2- 172.21.15.18:0/3966186337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac0b5180 0x7f9eac06d700 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0009870 tx=0x7f9ea002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d6d4680acebc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:17.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.952+0000 7f9eaa7fc640 1 -- 172.21.15.18:0/3966186337 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0037070 con 0x7f9eac0b5180 2024-09-19T09:15:17.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.952+0000 7f9eaa7fc640 1 -- 172.21.15.18:0/3966186337 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ea0032440 con 0x7f9eac0b5180 2024-09-19T09:15:17.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.952+0000 7f9eaa7fc640 1 -- 172.21.15.18:0/3966186337 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0032810 con 0x7f9eac0b5180 2024-09-19T09:15:17.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.952+0000 7f9eb1fcf640 1 -- 172.21.15.18:0/3966186337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac0b5180 msgr2=0x7f9eac06d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:17.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.952+0000 7f9eb1fcf640 1 --2- 172.21.15.18:0/3966186337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac0b5180 0x7f9eac06d700 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0009870 tx=0x7f9ea002a270 comp rx=0 tx=0).stop 2024-09-19T09:15:17.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.952+0000 7f9eb1fcf640 1 -- 172.21.15.18:0/3966186337 shutdown_connections 2024-09-19T09:15:17.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.952+0000 7f9eb1fcf640 1 --2- 172.21.15.18:0/3966186337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac0b5180 0x7f9eac06d700 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:17.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.952+0000 7f9eb1fcf640 1 --2- 172.21.15.18:0/3966186337 >> v2:172.21.15.162:3300/0 conn(0x7f9eac15ee60 0x7f9eac06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:17.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.952+0000 7f9eb1fcf640 1 -- 172.21.15.18:0/3966186337 >> 172.21.15.18:0/3966186337 conn(0x7f9eac0b45f0 msgr2=0x7f9eac0b4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:17.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.952+0000 7f9eb1fcf640 1 -- 172.21.15.18:0/3966186337 shutdown_connections 2024-09-19T09:15:17.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.952+0000 7f9eb1fcf640 1 -- 172.21.15.18:0/3966186337 wait complete. 2024-09-19T09:15:17.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.953+0000 7f9eb1fcf640 1 Processor -- start 2024-09-19T09:15:17.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.954+0000 7f9eb1fcf640 1 -- start start 2024-09-19T09:15:17.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.954+0000 7f9eb1fcf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9eac06dc40 0x7f9eac0ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:17.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.954+0000 7f9eb1fcf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eac0b5180 0x7f9eac154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:17.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.954+0000 7f9eb1fcf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac15ee60 0x7f9eac0b6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:17.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.954+0000 7f9eb1fcf640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9eac0b37c0 con 0x7f9eac15ee60 2024-09-19T09:15:17.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.954+0000 7f9eb1fcf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9eac06d260 con 0x7f9eac0b5180 2024-09-19T09:15:17.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.954+0000 7f9eb1fcf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9eac0b3940 con 0x7f9eac06dc40 2024-09-19T09:15:17.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.954+0000 7f9eabfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac15ee60 0x7f9eac0b6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:17.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.954+0000 7f9eabfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac15ee60 0x7f9eac0b6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57672/0 (socket says 172.21.15.18:57672) 2024-09-19T09:15:17.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.954+0000 7f9eabfff640 1 -- 172.21.15.18:0/1070242325 learned_addr learned my addr 172.21.15.18:0/1070242325 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:17.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.955+0000 7f9eaaffd640 1 --2- 172.21.15.18:0/1070242325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eac0b5180 0x7f9eac154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:17.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.955+0000 7f9eab7fe640 1 --2- 172.21.15.18:0/1070242325 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9eac06dc40 0x7f9eac0ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:17.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.955+0000 7f9eabfff640 1 -- 172.21.15.18:0/1070242325 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9eac06dc40 msgr2=0x7f9eac0ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:17.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.955+0000 7f9eabfff640 1 --2- 172.21.15.18:0/1070242325 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9eac06dc40 0x7f9eac0ceb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:17.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.955+0000 7f9eabfff640 1 -- 172.21.15.18:0/1070242325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eac0b5180 msgr2=0x7f9eac154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:17.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.955+0000 7f9eabfff640 1 --2- 172.21.15.18:0/1070242325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eac0b5180 0x7f9eac154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:17.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.955+0000 7f9eabfff640 1 -- 172.21.15.18:0/1070242325 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eac0cf090 con 0x7f9eac15ee60 2024-09-19T09:15:17.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.955+0000 7f9eaaffd640 1 --2- 172.21.15.18:0/1070242325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eac0b5180 0x7f9eac154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:17.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.955+0000 7f9eabfff640 1 --2- 172.21.15.18:0/1070242325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac15ee60 0x7f9eac0b6e90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9ea400b970 tx=0x7f9ea400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:17.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.955+0000 7f9e93fff640 1 -- 172.21.15.18:0/1070242325 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4019070 con 0x7f9eac15ee60 2024-09-19T09:15:17.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.955+0000 7f9e93fff640 1 -- 172.21.15.18:0/1070242325 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ea400cb40 con 0x7f9eac15ee60 2024-09-19T09:15:17.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.955+0000 7f9e93fff640 1 -- 172.21.15.18:0/1070242325 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4014440 con 0x7f9eac15ee60 2024-09-19T09:15:17.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.955+0000 7f9eb1fcf640 1 -- 172.21.15.18:0/1070242325 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eac0b5e10 con 0x7f9eac15ee60 2024-09-19T09:15:17.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.955+0000 7f9eb1fcf640 1 -- 172.21.15.18:0/1070242325 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eac0b66b0 con 0x7f9eac15ee60 2024-09-19T09:15:17.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.956+0000 7f9eb1fcf640 1 -- 172.21.15.18:0/1070242325 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9eac06d700 con 0x7f9eac15ee60 2024-09-19T09:15:17.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.957+0000 7f9e93fff640 1 -- 172.21.15.18:0/1070242325 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9ea401c070 con 0x7f9eac15ee60 2024-09-19T09:15:17.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.957+0000 7f9e93fff640 1 --2- 172.21.15.18:0/1070242325 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9e9806c2b0 0x7f9e9806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:17.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.957+0000 7f9e93fff640 1 -- 172.21.15.18:0/1070242325 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5854+0+0 (secure 0 0 0) 0x7f9ea408b0e0 con 0x7f9eac15ee60 2024-09-19T09:15:17.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.957+0000 7f9eab7fe640 1 --2- 172.21.15.18:0/1070242325 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9e9806c2b0 0x7f9e9806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:17.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.958+0000 7f9eab7fe640 1 --2- 172.21.15.18:0/1070242325 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9e9806c2b0 0x7f9e9806e770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c006fd0 tx=0x7f9e9c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:17.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:17.962+0000 7f9e93fff640 1 -- 172.21.15.18:0/1070242325 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9ea40597c0 con 0x7f9eac15ee60 2024-09-19T09:15:18.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.147+0000 7f9eb1fcf640 1 -- 172.21.15.18:0/1070242325 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f9eac0b6ac0 con 0x7f9eac15ee60 2024-09-19T09:15:18.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.147+0000 7f9e93fff640 1 -- 172.21.15.18:0/1070242325 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v59) ==== 80+0+0 (secure 0 0 0) 0x7f9ea40590c0 con 0x7f9eac15ee60 2024-09-19T09:15:18.149 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-09-19T09:15:18.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.149+0000 7f9eb1fcf640 1 -- 172.21.15.18:0/1070242325 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9e9806c2b0 msgr2=0x7f9e9806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:18.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.149+0000 7f9eb1fcf640 1 --2- 172.21.15.18:0/1070242325 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9e9806c2b0 0x7f9e9806e770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c006fd0 tx=0x7f9e9c008040 comp rx=0 tx=0).stop 2024-09-19T09:15:18.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.149+0000 7f9eb1fcf640 1 -- 172.21.15.18:0/1070242325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac15ee60 msgr2=0x7f9eac0b6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:18.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.149+0000 7f9eb1fcf640 1 --2- 172.21.15.18:0/1070242325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac15ee60 0x7f9eac0b6e90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9ea400b970 tx=0x7f9ea400be30 comp rx=0 tx=0).stop 2024-09-19T09:15:18.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.149+0000 7f9eb1fcf640 1 -- 172.21.15.18:0/1070242325 shutdown_connections 2024-09-19T09:15:18.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.149+0000 7f9eb1fcf640 1 --2- 172.21.15.18:0/1070242325 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9e9806c2b0 0x7f9e9806e770 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:18.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.149+0000 7f9eb1fcf640 1 --2- 172.21.15.18:0/1070242325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9eac15ee60 0x7f9eac0b6e90 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:18.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.149+0000 7f9eb1fcf640 1 --2- 172.21.15.18:0/1070242325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9eac0b5180 0x7f9eac154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:18.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.149+0000 7f9eb1fcf640 1 --2- 172.21.15.18:0/1070242325 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9eac06dc40 0x7f9eac0ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:18.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.149+0000 7f9eb1fcf640 1 -- 172.21.15.18:0/1070242325 >> 172.21.15.18:0/1070242325 conn(0x7f9eac0b45f0 msgr2=0x7f9eac0af860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:18.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.150+0000 7f9eb1fcf640 1 -- 172.21.15.18:0/1070242325 shutdown_connections 2024-09-19T09:15:18.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.150+0000 7f9eb1fcf640 1 -- 172.21.15.18:0/1070242325 wait complete. 2024-09-19T09:15:18.161 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-19T09:15:18.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:15:18.161 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-19T09:15:18.190 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-09-19T09:15:18.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:15:18.190 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-19T09:15:18.246 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:15:18.246 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:15:18.246 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:15:18.263 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17075 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T09:15:18.263 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:15:18.263 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:15:18.263 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:15:18.302 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3252 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T09:15:18.302 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:15:18.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.405+0000 7f908656d640 1 Processor -- start 2024-09-19T09:15:18.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.405+0000 7f908656d640 1 -- start start 2024-09-19T09:15:18.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.406+0000 7f908656d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f908015ed30 0x7f9080070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:18.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.406+0000 7f908656d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90800d0a10 con 0x7f90800b5200 2024-09-19T09:15:18.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.406+0000 7f908656d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9080070ab0 con 0x7f90801630f0 2024-09-19T09:15:18.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.406+0000 7f908656d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f90800d0cb0 con 0x7f908015ed30 2024-09-19T09:15:18.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.406+0000 7f907f7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f90800b5200 0x7f90801629e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43592/0 (socket says 172.21.15.18:43592) 2024-09-19T09:15:18.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.406+0000 7f907f7fe640 1 -- 172.21.15.18:0/4214408284 learned_addr learned my addr 172.21.15.18:0/4214408284 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:15:18.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.406+0000 7f907ffff640 1 --2- 172.21.15.18:0/4214408284 >> v2:172.21.15.162:3300/0 conn(0x7f908015ed30 0x7f9080070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:18.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.406+0000 7f907effd640 1 -- 172.21.15.18:0/4214408284 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2914789846 0 0) 0x7f90800d0a10 con 0x7f90800b5200 2024-09-19T09:15:18.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.406+0000 7f907effd640 1 -- 172.21.15.18:0/4214408284 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9068003520 con 0x7f90800b5200 2024-09-19T09:15:18.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.406+0000 7f907effd640 1 -- 172.21.15.18:0/4214408284 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 420247987 0 0) 0x7f9068003520 con 0x7f90800b5200 2024-09-19T09:15:18.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.406+0000 7f907ffff640 1 -- 172.21.15.18:0/4214408284 >> v1:172.21.15.162:6789/0 conn(0x7f90801630f0 legacy=0x7f90800cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:18.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.406+0000 7f907ffff640 1 -- 172.21.15.18:0/4214408284 >> v1:172.21.15.18:6789/0 conn(0x7f90800b5200 legacy=0x7f90801629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:18.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.406+0000 7f907ffff640 1 -- 172.21.15.18:0/4214408284 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90800d0f90 con 0x7f908015ed30 2024-09-19T09:15:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.407+0000 7f907ffff640 1 --2- 172.21.15.18:0/4214408284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f908015ed30 0x7f9080070260 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f90700097a0 tx=0x7f907002a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32a6be4377904144 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.407+0000 7f907effd640 1 -- 172.21.15.18:0/4214408284 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9070037070 con 0x7f908015ed30 2024-09-19T09:15:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.407+0000 7f907effd640 1 -- 172.21.15.18:0/4214408284 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f907002ace0 con 0x7f908015ed30 2024-09-19T09:15:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.407+0000 7f907effd640 1 -- 172.21.15.18:0/4214408284 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9074001670 con 0x7f908015ed30 2024-09-19T09:15:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.408+0000 7f908656d640 1 -- 172.21.15.18:0/4214408284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f908015ed30 msgr2=0x7f9080070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:18.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.408+0000 7f908656d640 1 --2- 172.21.15.18:0/4214408284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f908015ed30 0x7f9080070260 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f90700097a0 tx=0x7f907002a250 comp rx=0 tx=0).stop 2024-09-19T09:15:18.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.408+0000 7f908656d640 1 -- 172.21.15.18:0/4214408284 shutdown_connections 2024-09-19T09:15:18.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.408+0000 7f908656d640 1 --2- 172.21.15.18:0/4214408284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f908015ed30 0x7f9080070260 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:18.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.408+0000 7f908656d640 1 -- 172.21.15.18:0/4214408284 >> 172.21.15.18:0/4214408284 conn(0x7f90800b4600 msgr2=0x7f90800b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:18.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.408+0000 7f908656d640 1 -- 172.21.15.18:0/4214408284 shutdown_connections 2024-09-19T09:15:18.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.408+0000 7f908656d640 1 -- 172.21.15.18:0/4214408284 wait complete. 2024-09-19T09:15:18.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.409+0000 7f908656d640 1 Processor -- start 2024-09-19T09:15:18.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.409+0000 7f908656d640 1 -- start start 2024-09-19T09:15:18.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.410+0000 7f908656d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90800b5200 0x7f90800b6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:18.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.410+0000 7f908656d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f908015ed30 0x7f90800ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:18.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.410+0000 7f908656d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90801630f0 0x7f908015a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:18.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.410+0000 7f908656d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9080070f10 con 0x7f908015ed30 2024-09-19T09:15:18.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.410+0000 7f908656d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9080070d90 con 0x7f90800b5200 2024-09-19T09:15:18.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.410+0000 7f908656d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f908015f110 con 0x7f90801630f0 2024-09-19T09:15:18.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.410+0000 7f907f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f908015ed30 0x7f90800ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:18.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.410+0000 7f907f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f908015ed30 0x7f90800ceb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57682/0 (socket says 172.21.15.18:57682) 2024-09-19T09:15:18.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.410+0000 7f907f7fe640 1 -- 172.21.15.18:0/4207258192 learned_addr learned my addr 172.21.15.18:0/4207258192 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:18.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.410+0000 7f907ffff640 1 --2- 172.21.15.18:0/4207258192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90800b5200 0x7f90800b6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:18.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.410+0000 7f9084b0a640 1 --2- 172.21.15.18:0/4207258192 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90801630f0 0x7f908015a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:18.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.410+0000 7f907f7fe640 1 -- 172.21.15.18:0/4207258192 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90801630f0 msgr2=0x7f908015a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:18.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.410+0000 7f907f7fe640 1 --2- 172.21.15.18:0/4207258192 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90801630f0 0x7f908015a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:18.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.410+0000 7f907f7fe640 1 -- 172.21.15.18:0/4207258192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90800b5200 msgr2=0x7f90800b6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:18.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.411+0000 7f907f7fe640 1 --2- 172.21.15.18:0/4207258192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90800b5200 0x7f90800b6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:18.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.411+0000 7f907f7fe640 1 -- 172.21.15.18:0/4207258192 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90800cf0b0 con 0x7f908015ed30 2024-09-19T09:15:18.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.411+0000 7f9084b0a640 1 --2- 172.21.15.18:0/4207258192 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90801630f0 0x7f908015a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:18.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.411+0000 7f907ffff640 1 --2- 172.21.15.18:0/4207258192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90800b5200 0x7f90800b6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:18.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.411+0000 7f907f7fe640 1 --2- 172.21.15.18:0/4207258192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f908015ed30 0x7f90800ceb70 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f907400c780 tx=0x7f907400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:18.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.411+0000 7f907cff9640 1 -- 172.21.15.18:0/4207258192 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9074017070 con 0x7f908015ed30 2024-09-19T09:15:18.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.411+0000 7f907cff9640 1 -- 172.21.15.18:0/4207258192 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9074005ad0 con 0x7f908015ed30 2024-09-19T09:15:18.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.411+0000 7f908656d640 1 -- 172.21.15.18:0/4207258192 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f908015a650 con 0x7f908015ed30 2024-09-19T09:15:18.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.411+0000 7f907cff9640 1 -- 172.21.15.18:0/4207258192 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9074007070 con 0x7f908015ed30 2024-09-19T09:15:18.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.411+0000 7f908656d640 1 -- 172.21.15.18:0/4207258192 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90800b7700 con 0x7f908015ed30 2024-09-19T09:15:18.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.412+0000 7f908656d640 1 -- 172.21.15.18:0/4207258192 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90800d0220 con 0x7f908015ed30 2024-09-19T09:15:18.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.412+0000 7f907cff9640 1 -- 172.21.15.18:0/4207258192 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f907401a070 con 0x7f908015ed30 2024-09-19T09:15:18.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.413+0000 7f907cff9640 1 --2- 172.21.15.18:0/4207258192 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f906c06c2b0 0x7f906c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:18.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.413+0000 7f907cff9640 1 -- 172.21.15.18:0/4207258192 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5854+0+0 (secure 0 0 0) 0x7f907408a980 con 0x7f908015ed30 2024-09-19T09:15:18.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.413+0000 7f907ffff640 1 --2- 172.21.15.18:0/4207258192 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f906c06c2b0 0x7f906c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:18.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.414+0000 7f907ffff640 1 --2- 172.21.15.18:0/4207258192 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f906c06c2b0 0x7f906c06e770 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9070034000 tx=0x7f907002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:18.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.417+0000 7f907cff9640 1 -- 172.21.15.18:0/4207258192 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f90800d0220 con 0x7f908015ed30 2024-09-19T09:15:18.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.632+0000 7f908656d640 1 -- 172.21.15.18:0/4207258192 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9080070260 con 0x7f908015ed30 2024-09-19T09:15:18.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.633+0000 7f907cff9640 1 -- 172.21.15.18:0/4207258192 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5223 (secure 0 0 0) 0x7f90740590f0 con 0x7f908015ed30 2024-09-19T09:15:18.634 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:15:18.634 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"btime":"2024-09-19T09:14:46:022043+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4793,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/113686001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":113686001},{"type":"v1","addr":"172.21.15.162:6835","nonce":113686001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":4799,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3269042030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3269042030},{"type":"v1","addr":"172.21.15.162:6837","nonce":3269042030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/3996030837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3996030837},{"type":"v1","addr":"172.21.15.18:6834","nonce":3996030837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:14:43.367290+0000","modified":"2024-09-19T09:14:45.363192+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5187":{"gid":5187,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/295967875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":295967875},{"type":"v1","addr":"172.21.15.18:6835","nonce":295967875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5187,"qdb_cluster":[5187]},"id":3}]} 2024-09-19T09:15:18.634 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 21 2024-09-19T09:15:18.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.635+0000 7f908656d640 1 -- 172.21.15.18:0/4207258192 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f906c06c2b0 msgr2=0x7f906c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:18.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.635+0000 7f908656d640 1 --2- 172.21.15.18:0/4207258192 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f906c06c2b0 0x7f906c06e770 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9070034000 tx=0x7f907002e000 comp rx=0 tx=0).stop 2024-09-19T09:15:18.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.635+0000 7f908656d640 1 -- 172.21.15.18:0/4207258192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f908015ed30 msgr2=0x7f90800ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:18.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.635+0000 7f908656d640 1 --2- 172.21.15.18:0/4207258192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f908015ed30 0x7f90800ceb70 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f907400c780 tx=0x7f907400cc40 comp rx=0 tx=0).stop 2024-09-19T09:15:18.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.635+0000 7f908656d640 1 -- 172.21.15.18:0/4207258192 shutdown_connections 2024-09-19T09:15:18.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.635+0000 7f908656d640 1 --2- 172.21.15.18:0/4207258192 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f906c06c2b0 0x7f906c06e770 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:18.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.635+0000 7f908656d640 1 --2- 172.21.15.18:0/4207258192 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90801630f0 0x7f908015a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:18.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.635+0000 7f908656d640 1 --2- 172.21.15.18:0/4207258192 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f908015ed30 0x7f90800ceb70 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:18.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.635+0000 7f908656d640 1 --2- 172.21.15.18:0/4207258192 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90800b5200 0x7f90800b6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:18.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.635+0000 7f908656d640 1 -- 172.21.15.18:0/4207258192 >> 172.21.15.18:0/4207258192 conn(0x7f90800b4600 msgr2=0x7f908006d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:18.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.635+0000 7f908656d640 1 -- 172.21.15.18:0/4207258192 shutdown_connections 2024-09-19T09:15:18.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.635+0000 7f908656d640 1 -- 172.21.15.18:0/4207258192 wait complete. 2024-09-19T09:15:18.647 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:15:18.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.749+0000 7fa9a8dc4640 1 Processor -- start 2024-09-19T09:15:18.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.749+0000 7fa9a8dc4640 1 -- start start 2024-09-19T09:15:18.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.750+0000 7fa9a8dc4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa9a415ecc0 0x7fa9a40d3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:18.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.750+0000 7fa9a8dc4640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa9a40d57a0 0x7fa9a40d1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:18.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.750+0000 7fa9a8dc4640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9a40d3b20 con 0x7fa9a40d1990 2024-09-19T09:15:18.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.750+0000 7fa9a8dc4640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fa9a40b42f0 con 0x7fa9a415ecc0 2024-09-19T09:15:18.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.750+0000 7fa9a8dc4640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa9a40b45d0 con 0x7fa9a40d57a0 2024-09-19T09:15:18.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.750+0000 7fa9a259c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa9a415ecc0 0x7fa9a40d3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:18.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.750+0000 7fa9a259c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa9a415ecc0 0x7fa9a40d3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57692/0 (socket says 172.21.15.18:57692) 2024-09-19T09:15:18.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.750+0000 7fa9a259c640 1 -- 172.21.15.18:0/3851557525 learned_addr learned my addr 172.21.15.18:0/3851557525 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:18.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.750+0000 7fa9a259c640 1 -- 172.21.15.18:0/3851557525 >> v2:172.21.15.162:3300/0 conn(0x7fa9a40d57a0 msgr2=0x7fa9a40d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:18.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.750+0000 7fa9a259c640 1 --2- 172.21.15.18:0/3851557525 >> v2:172.21.15.162:3300/0 conn(0x7fa9a40d57a0 0x7fa9a40d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:18.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.750+0000 7fa9a259c640 1 -- 172.21.15.18:0/3851557525 >> v1:172.21.15.162:6789/0 conn(0x7fa9a40d1990 legacy=0x7fa9a40cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:18.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.751+0000 7fa9a259c640 1 -- 172.21.15.18:0/3851557525 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a40b48b0 con 0x7fa9a415ecc0 2024-09-19T09:15:18.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.751+0000 7fa9a259c640 1 --2- 172.21.15.18:0/3851557525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9a415ecc0 0x7fa9a40d3170 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa9a40d3e10 tx=0x7fa99402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c4fd414489a8c97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:18.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.751+0000 7fa9a159a640 1 -- 172.21.15.18:0/3851557525 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa994037070 con 0x7fa9a415ecc0 2024-09-19T09:15:18.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.751+0000 7fa9a159a640 1 -- 172.21.15.18:0/3851557525 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa994032440 con 0x7fa9a415ecc0 2024-09-19T09:15:18.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.751+0000 7fa9a159a640 1 -- 172.21.15.18:0/3851557525 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa994032810 con 0x7fa9a415ecc0 2024-09-19T09:15:18.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.752+0000 7fa9a8dc4640 1 -- 172.21.15.18:0/3851557525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9a415ecc0 msgr2=0x7fa9a40d3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:18.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.752+0000 7fa9a8dc4640 1 --2- 172.21.15.18:0/3851557525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9a415ecc0 0x7fa9a40d3170 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa9a40d3e10 tx=0x7fa99402a230 comp rx=0 tx=0).stop 2024-09-19T09:15:18.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.752+0000 7fa9a8dc4640 1 -- 172.21.15.18:0/3851557525 shutdown_connections 2024-09-19T09:15:18.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.752+0000 7fa9a8dc4640 1 --2- 172.21.15.18:0/3851557525 >> v2:172.21.15.162:3300/0 conn(0x7fa9a40d57a0 0x7fa9a40d1450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:18.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.752+0000 7fa9a8dc4640 1 --2- 172.21.15.18:0/3851557525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9a415ecc0 0x7fa9a40d3170 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:18.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.752+0000 7fa9a8dc4640 1 -- 172.21.15.18:0/3851557525 >> 172.21.15.18:0/3851557525 conn(0x7fa9a40d4bd0 msgr2=0x7fa9a40d4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:18.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.752+0000 7fa9a8dc4640 1 -- 172.21.15.18:0/3851557525 shutdown_connections 2024-09-19T09:15:18.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.752+0000 7fa9a8dc4640 1 -- 172.21.15.18:0/3851557525 wait complete. 2024-09-19T09:15:18.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.753+0000 7fa9a8dc4640 1 Processor -- start 2024-09-19T09:15:18.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.754+0000 7fa9a8dc4640 1 -- start start 2024-09-19T09:15:18.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.754+0000 7fa9a8dc4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9a40d1990 0x7fa9a40b97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:18.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.754+0000 7fa9a8dc4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9a40d57a0 0x7fa9a40b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:18.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.754+0000 7fa9a8dc4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9a415ecc0 0x7fa9a40b2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:18.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.754+0000 7fa9a8dc4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a415f220 con 0x7fa9a40d57a0 2024-09-19T09:15:18.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.754+0000 7fa9a8dc4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa9a415f0a0 con 0x7fa9a415ecc0 2024-09-19T09:15:18.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.754+0000 7fa9a8dc4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa9a40d36b0 con 0x7fa9a40d1990 2024-09-19T09:15:18.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.754+0000 7fa9a1d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9a40d57a0 0x7fa9a40b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:18.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.754+0000 7fa9a1d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9a40d57a0 0x7fa9a40b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57708/0 (socket says 172.21.15.18:57708) 2024-09-19T09:15:18.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.755+0000 7fa9a259c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9a40d1990 0x7fa9a40b97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:18.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.755+0000 7fa9a1d9b640 1 -- 172.21.15.18:0/2928123542 learned_addr learned my addr 172.21.15.18:0/2928123542 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:18.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.755+0000 7fa9a2d9d640 1 --2- 172.21.15.18:0/2928123542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9a415ecc0 0x7fa9a40b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:18.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.755+0000 7fa9a1d9b640 1 -- 172.21.15.18:0/2928123542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9a40d1990 msgr2=0x7fa9a40b97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:18.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.755+0000 7fa9a1d9b640 1 --2- 172.21.15.18:0/2928123542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9a40d1990 0x7fa9a40b97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:18.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.755+0000 7fa9a1d9b640 1 -- 172.21.15.18:0/2928123542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9a415ecc0 msgr2=0x7fa9a40b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:18.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.755+0000 7fa9a1d9b640 1 --2- 172.21.15.18:0/2928123542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9a415ecc0 0x7fa9a40b2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:18.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.755+0000 7fa9a1d9b640 1 -- 172.21.15.18:0/2928123542 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9a40ba690 con 0x7fa9a40d57a0 2024-09-19T09:15:18.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.755+0000 7fa9a1d9b640 1 --2- 172.21.15.18:0/2928123542 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9a40d57a0 0x7fa9a40b1bc0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa99800b4a0 tx=0x7fa99800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:18.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.755+0000 7fa992ffd640 1 -- 172.21.15.18:0/2928123542 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa998014070 con 0x7fa9a40d57a0 2024-09-19T09:15:18.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.755+0000 7fa992ffd640 1 -- 172.21.15.18:0/2928123542 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa998010610 con 0x7fa9a40d57a0 2024-09-19T09:15:18.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.755+0000 7fa9a8dc4640 1 -- 172.21.15.18:0/2928123542 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9a40ba970 con 0x7fa9a40d57a0 2024-09-19T09:15:18.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.755+0000 7fa992ffd640 1 -- 172.21.15.18:0/2928123542 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa998010a00 con 0x7fa9a40d57a0 2024-09-19T09:15:18.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.755+0000 7fa9a8dc4640 1 -- 172.21.15.18:0/2928123542 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9a40ca010 con 0x7fa9a40d57a0 2024-09-19T09:15:18.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.756+0000 7fa9a8dc4640 1 -- 172.21.15.18:0/2928123542 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9a40d1450 con 0x7fa9a40d57a0 2024-09-19T09:15:18.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.757+0000 7fa992ffd640 1 -- 172.21.15.18:0/2928123542 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa998017070 con 0x7fa9a40d57a0 2024-09-19T09:15:18.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.757+0000 7fa992ffd640 1 --2- 172.21.15.18:0/2928123542 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa98406c2b0 0x7fa98406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:18.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.757+0000 7fa992ffd640 1 -- 172.21.15.18:0/2928123542 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5854+0+0 (secure 0 0 0) 0x7fa99808af40 con 0x7fa9a40d57a0 2024-09-19T09:15:18.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.757+0000 7fa9a259c640 1 --2- 172.21.15.18:0/2928123542 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa98406c2b0 0x7fa98406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:18.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.758+0000 7fa9a259c640 1 --2- 172.21.15.18:0/2928123542 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa98406c2b0 0x7fa98406e770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa994034000 tx=0x7fa99402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:18.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.762+0000 7fa992ffd640 1 -- 172.21.15.18:0/2928123542 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa998058f40 con 0x7fa9a40d57a0 2024-09-19T09:15:18.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.974+0000 7fa9a8dc4640 1 -- 172.21.15.18:0/2928123542 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa9a408e3c0 con 0x7fa9a40d57a0 2024-09-19T09:15:18.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.975+0000 7fa992ffd640 1 -- 172.21.15.18:0/2928123542 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5223 (secure 0 0 0) 0x7fa99805d240 con 0x7fa9a40d57a0 2024-09-19T09:15:18.975 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:15:18.976 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"btime":"2024-09-19T09:14:46:022043+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4793,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/113686001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":113686001},{"type":"v1","addr":"172.21.15.162:6835","nonce":113686001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":4799,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3269042030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3269042030},{"type":"v1","addr":"172.21.15.162:6837","nonce":3269042030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/3996030837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3996030837},{"type":"v1","addr":"172.21.15.18:6834","nonce":3996030837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:14:43.367290+0000","modified":"2024-09-19T09:14:45.363192+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5187":{"gid":5187,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/295967875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":295967875},{"type":"v1","addr":"172.21.15.18:6835","nonce":295967875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5187,"qdb_cluster":[5187]},"id":3}]} 2024-09-19T09:15:18.976 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 21 2024-09-19T09:15:18.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.977+0000 7fa9a8dc4640 1 -- 172.21.15.18:0/2928123542 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa98406c2b0 msgr2=0x7fa98406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:18.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.977+0000 7fa9a8dc4640 1 --2- 172.21.15.18:0/2928123542 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa98406c2b0 0x7fa98406e770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa994034000 tx=0x7fa99402e000 comp rx=0 tx=0).stop 2024-09-19T09:15:18.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.977+0000 7fa9a8dc4640 1 -- 172.21.15.18:0/2928123542 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9a40d57a0 msgr2=0x7fa9a40b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:18.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.977+0000 7fa9a8dc4640 1 --2- 172.21.15.18:0/2928123542 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9a40d57a0 0x7fa9a40b1bc0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fa99800b4a0 tx=0x7fa99800b960 comp rx=0 tx=0).stop 2024-09-19T09:15:18.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.977+0000 7fa9a8dc4640 1 -- 172.21.15.18:0/2928123542 shutdown_connections 2024-09-19T09:15:18.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.977+0000 7fa9a8dc4640 1 --2- 172.21.15.18:0/2928123542 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa98406c2b0 0x7fa98406e770 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:18.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.977+0000 7fa9a8dc4640 1 --2- 172.21.15.18:0/2928123542 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9a415ecc0 0x7fa9a40b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:18.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.977+0000 7fa9a8dc4640 1 --2- 172.21.15.18:0/2928123542 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9a40d57a0 0x7fa9a40b1bc0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:18.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.977+0000 7fa9a8dc4640 1 --2- 172.21.15.18:0/2928123542 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9a40d1990 0x7fa9a40b97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:18.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.977+0000 7fa9a8dc4640 1 -- 172.21.15.18:0/2928123542 >> 172.21.15.18:0/2928123542 conn(0x7fa9a40d4bd0 msgr2=0x7fa9a40b3490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:18.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.977+0000 7fa9a8dc4640 1 -- 172.21.15.18:0/2928123542 shutdown_connections 2024-09-19T09:15:18.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:18.977+0000 7fa9a8dc4640 1 -- 172.21.15.18:0/2928123542 wait complete. 2024-09-19T09:15:18.988 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:15:19.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.090+0000 7f3c317cf640 1 Processor -- start 2024-09-19T09:15:19.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.090+0000 7f3c317cf640 1 -- start start 2024-09-19T09:15:19.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.091+0000 7f3c317cf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c2c13fae0 0x7f3c2c06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:19.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.091+0000 7f3c317cf640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3c2c160c50 0x7f3c2c0cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:19.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.091+0000 7f3c317cf640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c2c142650 con 0x7f3c2c142150 2024-09-19T09:15:19.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.091+0000 7f3c317cf640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f3c2c0ce780 con 0x7f3c2c160c50 2024-09-19T09:15:19.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.091+0000 7f3c317cf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3c2c142930 con 0x7f3c2c13fae0 2024-09-19T09:15:19.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.091+0000 7f3c2affd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c2c13fae0 0x7f3c2c06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:19.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.091+0000 7f3c2b7fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3c2c160c50 0x7f3c2c0cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:19.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.091+0000 7f3c2affd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c2c13fae0 0x7f3c2c06f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:36066/0 (socket says 172.21.15.18:36066) 2024-09-19T09:15:19.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.091+0000 7f3c2affd640 1 -- 172.21.15.18:0/942399550 learned_addr learned my addr 172.21.15.18:0/942399550 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:19.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.092+0000 7f3c2affd640 1 -- 172.21.15.18:0/942399550 >> v2:172.21.15.162:3300/0 conn(0x7f3c2c160c50 msgr2=0x7f3c2c0cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:19.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.092+0000 7f3c2affd640 1 --2- 172.21.15.18:0/942399550 >> v2:172.21.15.162:3300/0 conn(0x7f3c2c160c50 0x7f3c2c0cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:19.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.092+0000 7f3c2affd640 1 -- 172.21.15.18:0/942399550 >> v1:172.21.15.162:6789/0 conn(0x7f3c2c142150 legacy=0x7f3c2c160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:19.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.092+0000 7f3c2affd640 1 -- 172.21.15.18:0/942399550 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c2c142c10 con 0x7f3c2c13fae0 2024-09-19T09:15:19.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.092+0000 7f3c2b7fe640 1 --2- 172.21.15.18:0/942399550 >> v2:172.21.15.162:3300/0 conn(0x7f3c2c160c50 0x7f3c2c0cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:15:19.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.093+0000 7f3c2affd640 1 --2- 172.21.15.18:0/942399550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c2c13fae0 0x7f3c2c06f1b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3c24009870 tx=0x7f3c2402a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75ae325aa8209e9d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:19.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.093+0000 7f3c29ffb640 1 -- 172.21.15.18:0/942399550 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c24037070 con 0x7f3c2c13fae0 2024-09-19T09:15:19.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.093+0000 7f3c29ffb640 1 -- 172.21.15.18:0/942399550 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c24032440 con 0x7f3c2c13fae0 2024-09-19T09:15:19.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.093+0000 7f3c29ffb640 1 -- 172.21.15.18:0/942399550 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c24032810 con 0x7f3c2c13fae0 2024-09-19T09:15:19.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.093+0000 7f3c317cf640 1 -- 172.21.15.18:0/942399550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c2c13fae0 msgr2=0x7f3c2c06f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:19.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.093+0000 7f3c317cf640 1 --2- 172.21.15.18:0/942399550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c2c13fae0 0x7f3c2c06f1b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3c24009870 tx=0x7f3c2402a1c0 comp rx=0 tx=0).stop 2024-09-19T09:15:19.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.093+0000 7f3c317cf640 1 -- 172.21.15.18:0/942399550 shutdown_connections 2024-09-19T09:15:19.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.093+0000 7f3c317cf640 1 --2- 172.21.15.18:0/942399550 >> v2:172.21.15.162:3300/0 conn(0x7f3c2c160c50 0x7f3c2c0cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:19.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.093+0000 7f3c317cf640 1 --2- 172.21.15.18:0/942399550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c2c13fae0 0x7f3c2c06f1b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:19.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.093+0000 7f3c317cf640 1 -- 172.21.15.18:0/942399550 >> 172.21.15.18:0/942399550 conn(0x7f3c2c06bc10 msgr2=0x7f3c2c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:19.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.093+0000 7f3c317cf640 1 -- 172.21.15.18:0/942399550 shutdown_connections 2024-09-19T09:15:19.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.093+0000 7f3c317cf640 1 -- 172.21.15.18:0/942399550 wait complete. 2024-09-19T09:15:19.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.095+0000 7f3c317cf640 1 Processor -- start 2024-09-19T09:15:19.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.095+0000 7f3c317cf640 1 -- start start 2024-09-19T09:15:19.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.095+0000 7f3c317cf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c2c13fae0 0x7f3c2c1460c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:19.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.095+0000 7f3c317cf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c2c142150 0x7f3c2c1f5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:19.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.095+0000 7f3c317cf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c2c160c50 0x7f3c2c13db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:19.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.095+0000 7f3c317cf640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2c06f870 con 0x7f3c2c160c50 2024-09-19T09:15:19.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.095+0000 7f3c317cf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2c06f6f0 con 0x7f3c2c13fae0 2024-09-19T09:15:19.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.095+0000 7f3c317cf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3c2c0cf150 con 0x7f3c2c142150 2024-09-19T09:15:19.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.095+0000 7f3c2b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c2c160c50 0x7f3c2c13db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:19.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.095+0000 7f3c2a7fc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c2c142150 0x7f3c2c1f5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:19.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.096+0000 7f3c2b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c2c160c50 0x7f3c2c13db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57720/0 (socket says 172.21.15.18:57720) 2024-09-19T09:15:19.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.096+0000 7f3c2b7fe640 1 -- 172.21.15.18:0/3943161626 learned_addr learned my addr 172.21.15.18:0/3943161626 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:19.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.096+0000 7f3c2affd640 1 --2- 172.21.15.18:0/3943161626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c2c13fae0 0x7f3c2c1460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:19.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.096+0000 7f3c2b7fe640 1 -- 172.21.15.18:0/3943161626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c2c142150 msgr2=0x7f3c2c1f5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:19.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.096+0000 7f3c2b7fe640 1 --2- 172.21.15.18:0/3943161626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c2c142150 0x7f3c2c1f5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:19.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.096+0000 7f3c2b7fe640 1 -- 172.21.15.18:0/3943161626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c2c13fae0 msgr2=0x7f3c2c1460c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:19.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.096+0000 7f3c2b7fe640 1 --2- 172.21.15.18:0/3943161626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c2c13fae0 0x7f3c2c1460c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:19.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.096+0000 7f3c2b7fe640 1 -- 172.21.15.18:0/3943161626 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c2c1f6510 con 0x7f3c2c160c50 2024-09-19T09:15:19.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.096+0000 7f3c2affd640 1 --2- 172.21.15.18:0/3943161626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c2c13fae0 0x7f3c2c1460c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:15:19.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.096+0000 7f3c2b7fe640 1 --2- 172.21.15.18:0/3943161626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c2c160c50 0x7f3c2c13db50 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c009e00 tx=0x7f3c1c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:19.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.096+0000 7f3c237fe640 1 -- 172.21.15.18:0/3943161626 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c018020 con 0x7f3c2c160c50 2024-09-19T09:15:19.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.096+0000 7f3c237fe640 1 -- 172.21.15.18:0/3943161626 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c1c014480 con 0x7f3c2c160c50 2024-09-19T09:15:19.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.096+0000 7f3c317cf640 1 -- 172.21.15.18:0/3943161626 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c2c1f67b0 con 0x7f3c2c160c50 2024-09-19T09:15:19.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.096+0000 7f3c237fe640 1 -- 172.21.15.18:0/3943161626 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c014870 con 0x7f3c2c160c50 2024-09-19T09:15:19.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.096+0000 7f3c317cf640 1 -- 172.21.15.18:0/3943161626 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c2c1f7050 con 0x7f3c2c160c50 2024-09-19T09:15:19.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.097+0000 7f3c317cf640 1 -- 172.21.15.18:0/3943161626 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c2c1f6980 con 0x7f3c2c160c50 2024-09-19T09:15:19.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.098+0000 7f3c237fe640 1 -- 172.21.15.18:0/3943161626 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3c1c005d10 con 0x7f3c2c160c50 2024-09-19T09:15:19.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.098+0000 7f3c237fe640 1 --2- 172.21.15.18:0/3943161626 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3c0c06c2b0 0x7f3c0c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:19.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.099+0000 7f3c237fe640 1 -- 172.21.15.18:0/3943161626 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5854+0+0 (secure 0 0 0) 0x7f3c1c08c070 con 0x7f3c2c160c50 2024-09-19T09:15:19.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.099+0000 7f3c2affd640 1 --2- 172.21.15.18:0/3943161626 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3c0c06c2b0 0x7f3c0c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:19.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.099+0000 7f3c2affd640 1 --2- 172.21.15.18:0/3943161626 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3c0c06c2b0 0x7f3c0c06e770 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3c24034000 tx=0x7f3c2402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:19.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.103+0000 7f3c237fe640 1 -- 172.21.15.18:0/3943161626 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3c1c022030 con 0x7f3c2c160c50 2024-09-19T09:15:19.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.284+0000 7f3c317cf640 1 -- 172.21.15.18:0/3943161626 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3c2c1f7250 con 0x7f3c2c160c50 2024-09-19T09:15:19.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.285+0000 7f3c237fe640 1 -- 172.21.15.18:0/3943161626 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) ==== 74+0+16916 (secure 0 0 0) 0x7f3c1c010040 con 0x7f3c2c160c50 2024-09-19T09:15:19.286 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:15:19.286 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":59,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:15:17.124924+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:14:41.948276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-19T09:14:42.341949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.0","mappings":[{"from":5,"to":0}]},{"pgid":"7.3","mappings":[{"from":5,"to":7}]},{"pgid":"7.14","mappings":[{"from":5,"to":7}]},{"pgid":"7.1d","mappings":[{"from":5,"to":7}]},{"pgid":"7.3c","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:15:19.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.287+0000 7f3c317cf640 1 -- 172.21.15.18:0/3943161626 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3c0c06c2b0 msgr2=0x7f3c0c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:19.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.287+0000 7f3c317cf640 1 --2- 172.21.15.18:0/3943161626 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3c0c06c2b0 0x7f3c0c06e770 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3c24034000 tx=0x7f3c2402e000 comp rx=0 tx=0).stop 2024-09-19T09:15:19.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.287+0000 7f3c317cf640 1 -- 172.21.15.18:0/3943161626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c2c160c50 msgr2=0x7f3c2c13db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:19.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.287+0000 7f3c317cf640 1 --2- 172.21.15.18:0/3943161626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c2c160c50 0x7f3c2c13db50 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c009e00 tx=0x7f3c1c00c490 comp rx=0 tx=0).stop 2024-09-19T09:15:19.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.287+0000 7f3c317cf640 1 -- 172.21.15.18:0/3943161626 shutdown_connections 2024-09-19T09:15:19.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.287+0000 7f3c317cf640 1 --2- 172.21.15.18:0/3943161626 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3c0c06c2b0 0x7f3c0c06e770 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:19.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.287+0000 7f3c317cf640 1 --2- 172.21.15.18:0/3943161626 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c2c160c50 0x7f3c2c13db50 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:19.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.287+0000 7f3c317cf640 1 --2- 172.21.15.18:0/3943161626 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c2c142150 0x7f3c2c1f5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:19.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.287+0000 7f3c317cf640 1 --2- 172.21.15.18:0/3943161626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c2c13fae0 0x7f3c2c1460c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:19.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.287+0000 7f3c317cf640 1 -- 172.21.15.18:0/3943161626 >> 172.21.15.18:0/3943161626 conn(0x7f3c2c06bc10 msgr2=0x7f3c2c06d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:19.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.287+0000 7f3c317cf640 1 -- 172.21.15.18:0/3943161626 shutdown_connections 2024-09-19T09:15:19.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.287+0000 7f3c317cf640 1 -- 172.21.15.18:0/3943161626 wait complete. 2024-09-19T09:15:19.299 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T09:15:19.299 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:15:19.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.402+0000 7f2c1d62e640 1 Processor -- start 2024-09-19T09:15:19.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.402+0000 7f2c1d62e640 1 -- start start 2024-09-19T09:15:19.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.403+0000 7f2c1d62e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2c180d1ab0 0x7f2c180b8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:19.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.403+0000 7f2c1d62e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2c180d3240 0x7f2c180b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:19.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.403+0000 7f2c1d62e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c180b7a90 con 0x7f2c1815ef50 2024-09-19T09:15:19.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.403+0000 7f2c1d62e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f2c180d3740 con 0x7f2c180d1ab0 2024-09-19T09:15:19.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.403+0000 7f2c1d62e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2c180d3a20 con 0x7f2c180d3240 2024-09-19T09:15:19.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.403+0000 7f2c167fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2c180d1ab0 0x7f2c180b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:19.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.403+0000 7f2c16ffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f2c1815ef50 0x7f2c180d13a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43602/0 (socket says 172.21.15.18:43602) 2024-09-19T09:15:19.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.403+0000 7f2c16ffd640 1 -- 172.21.15.18:0/1035720169 learned_addr learned my addr 172.21.15.18:0/1035720169 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:15:19.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.404+0000 7f2c177fe640 1 --2- 172.21.15.18:0/1035720169 >> v2:172.21.15.162:3300/0 conn(0x7f2c180d3240 0x7f2c180b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:19.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.404+0000 7f2c167fc640 1 -- 172.21.15.18:0/1035720169 >> v2:172.21.15.162:3300/0 conn(0x7f2c180d3240 msgr2=0x7f2c180b8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:19.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.404+0000 7f2c167fc640 1 --2- 172.21.15.18:0/1035720169 >> v2:172.21.15.162:3300/0 conn(0x7f2c180d3240 0x7f2c180b8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:19.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.404+0000 7f2c167fc640 1 -- 172.21.15.18:0/1035720169 >> v1:172.21.15.18:6789/0 conn(0x7f2c1815ef50 legacy=0x7f2c180d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:19.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.404+0000 7f2c15ffb640 1 -- 172.21.15.18:0/1035720169 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1363383082 0 0) 0x7f2c180b7a90 con 0x7f2c1815ef50 2024-09-19T09:15:19.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.404+0000 7f2c167fc640 1 -- 172.21.15.18:0/1035720169 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c180b7d00 con 0x7f2c180d1ab0 2024-09-19T09:15:19.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.404+0000 7f2c167fc640 1 --2- 172.21.15.18:0/1035720169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c180d1ab0 0x7f2c180b8500 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f2c180b7760 tx=0x7f2c0c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b75040058df81b50 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:19.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.405+0000 7f2c15ffb640 1 -- 172.21.15.18:0/1035720169 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c037070 con 0x7f2c180d1ab0 2024-09-19T09:15:19.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.405+0000 7f2c15ffb640 1 -- 172.21.15.18:0/1035720169 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c0c032440 con 0x7f2c180d1ab0 2024-09-19T09:15:19.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.405+0000 7f2c15ffb640 1 -- 172.21.15.18:0/1035720169 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c02ae60 con 0x7f2c180d1ab0 2024-09-19T09:15:19.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.405+0000 7f2c1d62e640 1 -- 172.21.15.18:0/1035720169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c180d1ab0 msgr2=0x7f2c180b8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:19.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.405+0000 7f2c1d62e640 1 --2- 172.21.15.18:0/1035720169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c180d1ab0 0x7f2c180b8500 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f2c180b7760 tx=0x7f2c0c02a110 comp rx=0 tx=0).stop 2024-09-19T09:15:19.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.405+0000 7f2c1d62e640 1 -- 172.21.15.18:0/1035720169 shutdown_connections 2024-09-19T09:15:19.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.405+0000 7f2c1d62e640 1 --2- 172.21.15.18:0/1035720169 >> v2:172.21.15.162:3300/0 conn(0x7f2c180d3240 0x7f2c180b8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:19.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.405+0000 7f2c1d62e640 1 --2- 172.21.15.18:0/1035720169 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c180d1ab0 0x7f2c180b8500 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:19.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.405+0000 7f2c1d62e640 1 -- 172.21.15.18:0/1035720169 >> 172.21.15.18:0/1035720169 conn(0x7f2c180d4c60 msgr2=0x7f2c180d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:19.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.405+0000 7f2c1d62e640 1 -- 172.21.15.18:0/1035720169 shutdown_connections 2024-09-19T09:15:19.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.405+0000 7f2c1d62e640 1 -- 172.21.15.18:0/1035720169 wait complete. 2024-09-19T09:15:19.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.407+0000 7f2c1d62e640 1 Processor -- start 2024-09-19T09:15:19.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.407+0000 7f2c1d62e640 1 -- start start 2024-09-19T09:15:19.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.407+0000 7f2c1d62e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c180d1ab0 0x7f2c18157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:19.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.407+0000 7f2c1d62e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c180d3240 0x7f2c180b1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:19.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.407+0000 7f2c1d62e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c1815ef50 0x7f2c180ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:19.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.407+0000 7f2c1d62e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2c180d21a0 con 0x7f2c180d1ab0 2024-09-19T09:15:19.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.407+0000 7f2c1d62e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2c180d2020 con 0x7f2c1815ef50 2024-09-19T09:15:19.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.407+0000 7f2c1d62e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2c180d5780 con 0x7f2c180d3240 2024-09-19T09:15:19.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.407+0000 7f2c16ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c180d1ab0 0x7f2c18157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:19.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.407+0000 7f2c16ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c180d1ab0 0x7f2c18157d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57740/0 (socket says 172.21.15.18:57740) 2024-09-19T09:15:19.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.407+0000 7f2c16ffd640 1 -- 172.21.15.18:0/527280133 learned_addr learned my addr 172.21.15.18:0/527280133 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:19.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.408+0000 7f2c167fc640 1 --2- 172.21.15.18:0/527280133 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c180d3240 0x7f2c180b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:19.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.408+0000 7f2c177fe640 1 --2- 172.21.15.18:0/527280133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c1815ef50 0x7f2c180ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:19.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.408+0000 7f2c16ffd640 1 -- 172.21.15.18:0/527280133 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c180d3240 msgr2=0x7f2c180b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:19.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.408+0000 7f2c16ffd640 1 --2- 172.21.15.18:0/527280133 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c180d3240 0x7f2c180b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:19.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.408+0000 7f2c16ffd640 1 -- 172.21.15.18:0/527280133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c1815ef50 msgr2=0x7f2c180ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:19.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.408+0000 7f2c16ffd640 1 --2- 172.21.15.18:0/527280133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c1815ef50 0x7f2c180ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:19.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.408+0000 7f2c16ffd640 1 -- 172.21.15.18:0/527280133 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c18158290 con 0x7f2c180d1ab0 2024-09-19T09:15:19.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.408+0000 7f2c167fc640 1 --2- 172.21.15.18:0/527280133 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c180d3240 0x7f2c180b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:19.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.408+0000 7f2c177fe640 1 --2- 172.21.15.18:0/527280133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c1815ef50 0x7f2c180ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:19.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.408+0000 7f2c16ffd640 1 --2- 172.21.15.18:0/527280133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c180d1ab0 0x7f2c18157d50 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2c0800c460 tx=0x7f2c0800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:19.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.408+0000 7f2bff7fe640 1 -- 172.21.15.18:0/527280133 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c08018070 con 0x7f2c180d1ab0 2024-09-19T09:15:19.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.408+0000 7f2bff7fe640 1 -- 172.21.15.18:0/527280133 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c08007500 con 0x7f2c180d1ab0 2024-09-19T09:15:19.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.408+0000 7f2c1d62e640 1 -- 172.21.15.18:0/527280133 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c180cd720 con 0x7f2c180d1ab0 2024-09-19T09:15:19.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.408+0000 7f2bff7fe640 1 -- 172.21.15.18:0/527280133 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c08004a20 con 0x7f2c180d1ab0 2024-09-19T09:15:19.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.408+0000 7f2c1d62e640 1 -- 172.21.15.18:0/527280133 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c180cdce0 con 0x7f2c180d1ab0 2024-09-19T09:15:19.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.409+0000 7f2c1d62e640 1 -- 172.21.15.18:0/527280133 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c180d13a0 con 0x7f2c180d1ab0 2024-09-19T09:15:19.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.410+0000 7f2bff7fe640 1 -- 172.21.15.18:0/527280133 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2c0801b070 con 0x7f2c180d1ab0 2024-09-19T09:15:19.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.410+0000 7f2bff7fe640 1 --2- 172.21.15.18:0/527280133 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2c0406c2b0 0x7f2c0406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:19.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.410+0000 7f2bff7fe640 1 -- 172.21.15.18:0/527280133 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5854+0+0 (secure 0 0 0) 0x7f2c0808a680 con 0x7f2c180d1ab0 2024-09-19T09:15:19.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.411+0000 7f2c167fc640 1 --2- 172.21.15.18:0/527280133 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2c0406c2b0 0x7f2c0406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:19.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.411+0000 7f2c167fc640 1 --2- 172.21.15.18:0/527280133 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2c0406c2b0 0x7f2c0406e770 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c034000 tx=0x7f2c0c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:19.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.414+0000 7f2bff7fe640 1 -- 172.21.15.18:0/527280133 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2c08058df0 con 0x7f2c180d1ab0 2024-09-19T09:15:19.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.624+0000 7f2c1d62e640 1 -- 172.21.15.18:0/527280133 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c1806cfe0 con 0x7f2c180d1ab0 2024-09-19T09:15:19.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.625+0000 7f2bff7fe640 1 -- 172.21.15.18:0/527280133 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5223 (secure 0 0 0) 0x7f2c080586f0 con 0x7f2c180d1ab0 2024-09-19T09:15:19.626 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:15:19.626 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"btime":"2024-09-19T09:14:46:022043+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4793,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/113686001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":113686001},{"type":"v1","addr":"172.21.15.162:6835","nonce":113686001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":4799,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3269042030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3269042030},{"type":"v1","addr":"172.21.15.162:6837","nonce":3269042030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/3996030837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3996030837},{"type":"v1","addr":"172.21.15.18:6834","nonce":3996030837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:14:43.367290+0000","modified":"2024-09-19T09:14:45.363192+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5187":{"gid":5187,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/295967875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":295967875},{"type":"v1","addr":"172.21.15.18:6835","nonce":295967875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5187,"qdb_cluster":[5187]},"id":3}]} 2024-09-19T09:15:19.626 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 21 2024-09-19T09:15:19.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.627+0000 7f2c1d62e640 1 -- 172.21.15.18:0/527280133 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2c0406c2b0 msgr2=0x7f2c0406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:19.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.627+0000 7f2c1d62e640 1 --2- 172.21.15.18:0/527280133 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2c0406c2b0 0x7f2c0406e770 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c034000 tx=0x7f2c0c02e000 comp rx=0 tx=0).stop 2024-09-19T09:15:19.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.627+0000 7f2c1d62e640 1 -- 172.21.15.18:0/527280133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c180d1ab0 msgr2=0x7f2c18157d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:19.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.627+0000 7f2c1d62e640 1 --2- 172.21.15.18:0/527280133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c180d1ab0 0x7f2c18157d50 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2c0800c460 tx=0x7f2c0800c920 comp rx=0 tx=0).stop 2024-09-19T09:15:19.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.627+0000 7f2c1d62e640 1 -- 172.21.15.18:0/527280133 shutdown_connections 2024-09-19T09:15:19.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.627+0000 7f2c1d62e640 1 --2- 172.21.15.18:0/527280133 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2c0406c2b0 0x7f2c0406e770 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:19.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.627+0000 7f2c1d62e640 1 --2- 172.21.15.18:0/527280133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c1815ef50 0x7f2c180ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:19.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.627+0000 7f2c1d62e640 1 --2- 172.21.15.18:0/527280133 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c180d3240 0x7f2c180b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:19.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.627+0000 7f2c1d62e640 1 --2- 172.21.15.18:0/527280133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c180d1ab0 0x7f2c18157d50 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:19.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.627+0000 7f2c1d62e640 1 -- 172.21.15.18:0/527280133 >> 172.21.15.18:0/527280133 conn(0x7f2c180d4c60 msgr2=0x7f2c180b85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:19.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.627+0000 7f2c1d62e640 1 -- 172.21.15.18:0/527280133 shutdown_connections 2024-09-19T09:15:19.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.627+0000 7f2c1d62e640 1 -- 172.21.15.18:0/527280133 wait complete. 2024-09-19T09:15:19.639 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:15:19.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.741+0000 7efce75c4640 1 Processor -- start 2024-09-19T09:15:19.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.741+0000 7efce75c4640 1 -- start start 2024-09-19T09:15:19.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.742+0000 7efce75c4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efce015eb00 0x7efce01630d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:19.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.742+0000 7efce75c4640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efce006e730 con 0x7efce006d810 2024-09-19T09:15:19.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.742+0000 7efce75c4640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efce006ea10 con 0x7efce015fef0 2024-09-19T09:15:19.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.742+0000 7efce75c4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efce01628d0 con 0x7efce015eb00 2024-09-19T09:15:19.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.742+0000 7efce4b5f640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7efce006d810 0x7efce00b0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43608/0 (socket says 172.21.15.18:43608) 2024-09-19T09:15:19.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.742+0000 7efce4b5f640 1 -- 172.21.15.18:0/2395648220 learned_addr learned my addr 172.21.15.18:0/2395648220 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:15:19.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.742+0000 7efce5360640 1 --2- 172.21.15.18:0/2395648220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efce015eb00 0x7efce01630d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:19.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.742+0000 7efcd7fff640 1 -- 172.21.15.18:0/2395648220 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 934564784 0 0) 0x7efce006e730 con 0x7efce006d810 2024-09-19T09:15:19.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.742+0000 7efcd7fff640 1 -- 172.21.15.18:0/2395648220 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efccc003520 con 0x7efce006d810 2024-09-19T09:15:19.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.742+0000 7efcd7fff640 1 -- 172.21.15.18:0/2395648220 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4009151842 0 0) 0x7efccc003520 con 0x7efce006d810 2024-09-19T09:15:19.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.742+0000 7efcd7fff640 1 -- 172.21.15.18:0/2395648220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efce015eb00 msgr2=0x7efce01630d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:19.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.742+0000 7efcd7fff640 1 --2- 172.21.15.18:0/2395648220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efce015eb00 0x7efce01630d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:19.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.742+0000 7efcd7fff640 1 -- 172.21.15.18:0/2395648220 >> v1:172.21.15.162:6789/0 conn(0x7efce015fef0 legacy=0x7efce00cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:19.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.742+0000 7efcd7fff640 1 -- 172.21.15.18:0/2395648220 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce0162bb0 con 0x7efce006d810 2024-09-19T09:15:19.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.742+0000 7efcd7fff640 1 -- 172.21.15.18:0/2395648220 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7efcd0001670 con 0x7efce006d810 2024-09-19T09:15:19.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.742+0000 7efcd7fff640 1 -- 172.21.15.18:0/2395648220 >> v1:172.21.15.18:6789/0 conn(0x7efce006d810 legacy=0x7efce00b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:19.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.742+0000 7efcd7fff640 1 --2- 172.21.15.18:0/2395648220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efccc0039e0 0x7efccc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:19.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.742+0000 7efcd7fff640 1 --2- 172.21.15.18:0/2395648220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efce015eb00 0x7efccc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:19.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.742+0000 7efcd7fff640 1 --2- 172.21.15.18:0/2395648220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efccc004d40 0x7efccc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:19.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.742+0000 7efcd7fff640 1 -- 172.21.15.18:0/2395648220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efce01628d0 con 0x7efccc0039e0 2024-09-19T09:15:19.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.742+0000 7efcd7fff640 1 -- 172.21.15.18:0/2395648220 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efccc00ba70 con 0x7efccc004d40 2024-09-19T09:15:19.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.742+0000 7efcd7fff640 1 -- 172.21.15.18:0/2395648220 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efccc00bc70 con 0x7efce015eb00 2024-09-19T09:15:19.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.743+0000 7efce5360640 1 --2- 172.21.15.18:0/2395648220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efccc0039e0 0x7efccc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:19.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.743+0000 7efce4b5f640 1 --2- 172.21.15.18:0/2395648220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efce015eb00 0x7efccc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:19.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.743+0000 7efce5b61640 1 --2- 172.21.15.18:0/2395648220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efccc004d40 0x7efccc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:19.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.743+0000 7efce5360640 1 -- 172.21.15.18:0/2395648220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efce015eb00 msgr2=0x7efccc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:19.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.743+0000 7efce5360640 1 --2- 172.21.15.18:0/2395648220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efce015eb00 0x7efccc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:19.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.743+0000 7efce5360640 1 -- 172.21.15.18:0/2395648220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efccc004d40 msgr2=0x7efccc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:19.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.743+0000 7efce5360640 1 --2- 172.21.15.18:0/2395648220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efccc004d40 0x7efccc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:19.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.743+0000 7efce5360640 1 -- 172.21.15.18:0/2395648220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efccc003520 con 0x7efccc0039e0 2024-09-19T09:15:19.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.743+0000 7efce5b61640 1 --2- 172.21.15.18:0/2395648220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efccc004d40 0x7efccc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:19.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.744+0000 7efce5360640 1 --2- 172.21.15.18:0/2395648220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efccc0039e0 0x7efccc003e00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7efcdc009a90 tx=0x7efccc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce4843c09bab5b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:19.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.744+0000 7efcd7fff640 1 -- 172.21.15.18:0/2395648220 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcdc036070 con 0x7efccc0039e0 2024-09-19T09:15:19.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.744+0000 7efcd7fff640 1 -- 172.21.15.18:0/2395648220 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcdc031400 con 0x7efccc0039e0 2024-09-19T09:15:19.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.744+0000 7efcd7fff640 1 -- 172.21.15.18:0/2395648220 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcdc009690 con 0x7efccc0039e0 2024-09-19T09:15:19.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.744+0000 7efce75c4640 1 -- 172.21.15.18:0/2395648220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efccc0039e0 msgr2=0x7efccc003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:19.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.744+0000 7efce75c4640 1 --2- 172.21.15.18:0/2395648220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efccc0039e0 0x7efccc003e00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7efcdc009a90 tx=0x7efccc005830 comp rx=0 tx=0).stop 2024-09-19T09:15:19.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.744+0000 7efce5b61640 1 -- 172.21.15.18:0/2395648220 reap_dead start 2024-09-19T09:15:19.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.744+0000 7efce75c4640 1 -- 172.21.15.18:0/2395648220 shutdown_connections 2024-09-19T09:15:19.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.744+0000 7efce75c4640 1 -- 172.21.15.18:0/2395648220 >> 172.21.15.18:0/2395648220 conn(0x7efce006cd20 msgr2=0x7efce006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:19.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.744+0000 7efce75c4640 1 -- 172.21.15.18:0/2395648220 shutdown_connections 2024-09-19T09:15:19.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.744+0000 7efce75c4640 1 -- 172.21.15.18:0/2395648220 wait complete. 2024-09-19T09:15:19.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.746+0000 7efce75c4640 1 Processor -- start 2024-09-19T09:15:19.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.746+0000 7efce75c4640 1 -- start start 2024-09-19T09:15:19.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.746+0000 7efce75c4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efccc0039e0 0x7efce014c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:19.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.746+0000 7efce75c4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efce015b4f0 0x7efce00c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:19.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.746+0000 7efce75c4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efce00c74a0 0x7efce00c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:19.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.746+0000 7efce75c4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efce006ffd0 con 0x7efce00c74a0 2024-09-19T09:15:19.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.746+0000 7efce75c4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efce00b13d0 con 0x7efccc0039e0 2024-09-19T09:15:19.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.746+0000 7efce75c4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efce0070150 con 0x7efce015b4f0 2024-09-19T09:15:19.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.746+0000 7efce5b61640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efce00c74a0 0x7efce00c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:19.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.746+0000 7efce5b61640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efce00c74a0 0x7efce00c7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57758/0 (socket says 172.21.15.18:57758) 2024-09-19T09:15:19.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.746+0000 7efce5b61640 1 -- 172.21.15.18:0/1873125182 learned_addr learned my addr 172.21.15.18:0/1873125182 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:19.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.747+0000 7efce4b5f640 1 --2- 172.21.15.18:0/1873125182 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efce015b4f0 0x7efce00c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:19.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.747+0000 7efce5360640 1 --2- 172.21.15.18:0/1873125182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efccc0039e0 0x7efce014c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:19.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.747+0000 7efce5b61640 1 -- 172.21.15.18:0/1873125182 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efce015b4f0 msgr2=0x7efce00c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:19.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.747+0000 7efce5b61640 1 --2- 172.21.15.18:0/1873125182 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efce015b4f0 0x7efce00c6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:19.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.747+0000 7efce5b61640 1 -- 172.21.15.18:0/1873125182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efccc0039e0 msgr2=0x7efce014c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:19.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.747+0000 7efce5b61640 1 --2- 172.21.15.18:0/1873125182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efccc0039e0 0x7efce014c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:19.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.747+0000 7efce5b61640 1 -- 172.21.15.18:0/1873125182 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efce015c490 con 0x7efce00c74a0 2024-09-19T09:15:19.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.747+0000 7efce5360640 1 --2- 172.21.15.18:0/1873125182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efccc0039e0 0x7efce014c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:19.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.747+0000 7efce5b61640 1 --2- 172.21.15.18:0/1873125182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efce00c74a0 0x7efce00c7920 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7efce006f830 tx=0x7efcd800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:19.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.747+0000 7efcd5ffb640 1 -- 172.21.15.18:0/1873125182 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd8006b50 con 0x7efce00c74a0 2024-09-19T09:15:19.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.747+0000 7efcd5ffb640 1 -- 172.21.15.18:0/1873125182 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcd8006d10 con 0x7efce00c74a0 2024-09-19T09:15:19.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.747+0000 7efce75c4640 1 -- 172.21.15.18:0/1873125182 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efce015b970 con 0x7efce00c74a0 2024-09-19T09:15:19.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.747+0000 7efcd5ffb640 1 -- 172.21.15.18:0/1873125182 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcd8003970 con 0x7efce00c74a0 2024-09-19T09:15:19.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.747+0000 7efce75c4640 1 -- 172.21.15.18:0/1873125182 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efce015bed0 con 0x7efce00c74a0 2024-09-19T09:15:19.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.748+0000 7efce75c4640 1 -- 172.21.15.18:0/1873125182 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efce00d1460 con 0x7efce00c74a0 2024-09-19T09:15:19.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.749+0000 7efcd5ffb640 1 -- 172.21.15.18:0/1873125182 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efcd801a020 con 0x7efce00c74a0 2024-09-19T09:15:19.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.749+0000 7efcd5ffb640 1 --2- 172.21.15.18:0/1873125182 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7efcc406c2e0 0x7efcc406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:19.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.749+0000 7efcd5ffb640 1 -- 172.21.15.18:0/1873125182 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5854+0+0 (secure 0 0 0) 0x7efcd808aad0 con 0x7efce00c74a0 2024-09-19T09:15:19.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.750+0000 7efce5360640 1 --2- 172.21.15.18:0/1873125182 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7efcc406c2e0 0x7efcc406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:19.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.750+0000 7efce5360640 1 --2- 172.21.15.18:0/1873125182 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7efcc406c2e0 0x7efcc406e7a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efcdc033000 tx=0x7efcdc008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:19.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.753+0000 7efcd5ffb640 1 -- 172.21.15.18:0/1873125182 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7efce015b970 con 0x7efce00c74a0 2024-09-19T09:15:19.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.963+0000 7efce75c4640 1 -- 172.21.15.18:0/1873125182 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efce00b0e40 con 0x7efce00c74a0 2024-09-19T09:15:19.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.964+0000 7efcd5ffb640 1 -- 172.21.15.18:0/1873125182 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5223 (secure 0 0 0) 0x7efcd8006f00 con 0x7efce00c74a0 2024-09-19T09:15:19.965 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:15:19.966 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":21,"btime":"2024-09-19T09:14:46:022043+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4793,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/113686001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":113686001},{"type":"v1","addr":"172.21.15.162:6835","nonce":113686001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":4799,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3269042030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3269042030},{"type":"v1","addr":"172.21.15.162:6837","nonce":3269042030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/3996030837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3996030837},{"type":"v1","addr":"172.21.15.18:6834","nonce":3996030837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:14:43.367290+0000","modified":"2024-09-19T09:14:45.363192+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5187},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5187":{"gid":5187,"name":"c","rank":0,"incarnation":19,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/295967875","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":295967875},{"type":"v1","addr":"172.21.15.18:6835","nonce":295967875}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5187,"qdb_cluster":[5187]},"id":3}]} 2024-09-19T09:15:19.966 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 21 2024-09-19T09:15:19.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.966+0000 7efce75c4640 1 -- 172.21.15.18:0/1873125182 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7efcc406c2e0 msgr2=0x7efcc406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:19.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.966+0000 7efce75c4640 1 --2- 172.21.15.18:0/1873125182 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7efcc406c2e0 0x7efcc406e7a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efcdc033000 tx=0x7efcdc008030 comp rx=0 tx=0).stop 2024-09-19T09:15:19.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.966+0000 7efce75c4640 1 -- 172.21.15.18:0/1873125182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efce00c74a0 msgr2=0x7efce00c7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:19.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.966+0000 7efce75c4640 1 --2- 172.21.15.18:0/1873125182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efce00c74a0 0x7efce00c7920 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7efce006f830 tx=0x7efcd800eb90 comp rx=0 tx=0).stop 2024-09-19T09:15:19.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.966+0000 7efce75c4640 1 -- 172.21.15.18:0/1873125182 shutdown_connections 2024-09-19T09:15:19.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.966+0000 7efce75c4640 1 --2- 172.21.15.18:0/1873125182 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7efcc406c2e0 0x7efcc406e7a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:19.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.966+0000 7efce75c4640 1 --2- 172.21.15.18:0/1873125182 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efce00c74a0 0x7efce00c7920 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:19.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.966+0000 7efce75c4640 1 --2- 172.21.15.18:0/1873125182 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efce015b4f0 0x7efce00c6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:19.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.966+0000 7efce75c4640 1 --2- 172.21.15.18:0/1873125182 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efccc0039e0 0x7efce014c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:19.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.966+0000 7efce75c4640 1 -- 172.21.15.18:0/1873125182 >> 172.21.15.18:0/1873125182 conn(0x7efce006cd20 msgr2=0x7efce00b1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:19.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.966+0000 7efce75c4640 1 -- 172.21.15.18:0/1873125182 shutdown_connections 2024-09-19T09:15:19.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:19.966+0000 7efce75c4640 1 -- 172.21.15.18:0/1873125182 wait complete. 2024-09-19T09:15:19.978 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:15:20.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.079+0000 7f25219cf640 1 Processor -- start 2024-09-19T09:15:20.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.079+0000 7f25219cf640 1 -- start start 2024-09-19T09:15:20.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.080+0000 7f25219cf640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f251c072f40 0x7f251c06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:20.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.080+0000 7f25219cf640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f251c06e3d0 con 0x7f251c145290 2024-09-19T09:15:20.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.080+0000 7f25219cf640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f251c06e6b0 con 0x7f251c0ce780 2024-09-19T09:15:20.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.080+0000 7f25219cf640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f251c06efe0 con 0x7f251c072f40 2024-09-19T09:15:20.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.080+0000 7f251affd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f251c145290 0x7f251c072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43622/0 (socket says 172.21.15.18:43622) 2024-09-19T09:15:20.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.080+0000 7f251affd640 1 -- 172.21.15.18:0/1124973352 learned_addr learned my addr 172.21.15.18:0/1124973352 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:15:20.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.080+0000 7f2519ffb640 1 -- 172.21.15.18:0/1124973352 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2637406823 0 0) 0x7f251c06e3d0 con 0x7f251c145290 2024-09-19T09:15:20.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.080+0000 7f251a7fc640 1 --2- 172.21.15.18:0/1124973352 >> v2:172.21.15.162:3300/0 conn(0x7f251c072f40 0x7f251c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:20.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.080+0000 7f2519ffb640 1 -- 172.21.15.18:0/1124973352 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2508003520 con 0x7f251c145290 2024-09-19T09:15:20.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.080+0000 7f2519ffb640 1 -- 172.21.15.18:0/1124973352 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 734604382 0 0) 0x7f2508003520 con 0x7f251c145290 2024-09-19T09:15:20.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.080+0000 7f2519ffb640 1 -- 172.21.15.18:0/1124973352 >> v2:172.21.15.162:3300/0 conn(0x7f251c072f40 msgr2=0x7f251c06f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:20.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.080+0000 7f2519ffb640 1 --2- 172.21.15.18:0/1124973352 >> v2:172.21.15.162:3300/0 conn(0x7f251c072f40 0x7f251c06f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:20.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.080+0000 7f2519ffb640 1 -- 172.21.15.18:0/1124973352 >> v1:172.21.15.162:6789/0 conn(0x7f251c0ce780 legacy=0x7f251c0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:20.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.080+0000 7f2519ffb640 1 -- 172.21.15.18:0/1124973352 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f251c06e990 con 0x7f251c145290 2024-09-19T09:15:20.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.080+0000 7f2519ffb640 1 -- 172.21.15.18:0/1124973352 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f250c0019f0 con 0x7f251c145290 2024-09-19T09:15:20.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.080+0000 7f2519ffb640 1 -- 172.21.15.18:0/1124973352 >> v1:172.21.15.18:6789/0 conn(0x7f251c145290 legacy=0x7f251c072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:20.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.081+0000 7f2519ffb640 1 --2- 172.21.15.18:0/1124973352 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25080039b0 0x7f2508003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:20.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.081+0000 7f2519ffb640 1 --2- 172.21.15.18:0/1124973352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2508004800 0x7f2508004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:20.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.081+0000 7f2519ffb640 1 --2- 172.21.15.18:0/1124973352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25080051c0 0x7f250800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:20.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.081+0000 7f2519ffb640 1 -- 172.21.15.18:0/1124973352 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f251c06efe0 con 0x7f25080051c0 2024-09-19T09:15:20.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.081+0000 7f2519ffb640 1 -- 172.21.15.18:0/1124973352 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f250800c060 con 0x7f2508004800 2024-09-19T09:15:20.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.081+0000 7f2519ffb640 1 -- 172.21.15.18:0/1124973352 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f250800c260 con 0x7f25080039b0 2024-09-19T09:15:20.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.081+0000 7f251b7fe640 1 --2- 172.21.15.18:0/1124973352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25080051c0 0x7f250800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:20.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.081+0000 7f251a7fc640 1 --2- 172.21.15.18:0/1124973352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2508004800 0x7f2508004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:20.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.081+0000 7f251affd640 1 --2- 172.21.15.18:0/1124973352 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25080039b0 0x7f2508003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:20.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.081+0000 7f251b7fe640 1 -- 172.21.15.18:0/1124973352 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25080039b0 msgr2=0x7f2508003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:20.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.081+0000 7f251b7fe640 1 --2- 172.21.15.18:0/1124973352 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25080039b0 0x7f2508003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:20.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.081+0000 7f251b7fe640 1 -- 172.21.15.18:0/1124973352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2508004800 msgr2=0x7f2508004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:20.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.081+0000 7f251b7fe640 1 --2- 172.21.15.18:0/1124973352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2508004800 0x7f2508004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:20.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.081+0000 7f251b7fe640 1 -- 172.21.15.18:0/1124973352 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2508003520 con 0x7f25080051c0 2024-09-19T09:15:20.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.081+0000 7f251affd640 1 --2- 172.21.15.18:0/1124973352 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25080039b0 0x7f2508003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:20.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.081+0000 7f251a7fc640 1 --2- 172.21.15.18:0/1124973352 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2508004800 0x7f2508004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:20.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.082+0000 7f251b7fe640 1 -- 172.21.15.18:0/1124973352 reap_dead start 2024-09-19T09:15:20.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.082+0000 7f251b7fe640 1 --2- 172.21.15.18:0/1124973352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25080051c0 0x7f250800b9c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2514001750 tx=0x7f2508005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538d956d1a6554cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:20.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.082+0000 7f2519ffb640 1 -- 172.21.15.18:0/1124973352 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2514001370 con 0x7f25080051c0 2024-09-19T09:15:20.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.082+0000 7f2519ffb640 1 -- 172.21.15.18:0/1124973352 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2514005310 con 0x7f25080051c0 2024-09-19T09:15:20.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.082+0000 7f2519ffb640 1 -- 172.21.15.18:0/1124973352 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f251402abe0 con 0x7f25080051c0 2024-09-19T09:15:20.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.082+0000 7f25219cf640 1 -- 172.21.15.18:0/1124973352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25080051c0 msgr2=0x7f250800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:20.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.082+0000 7f25219cf640 1 --2- 172.21.15.18:0/1124973352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25080051c0 0x7f250800b9c0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2514001750 tx=0x7f2508005830 comp rx=0 tx=0).stop 2024-09-19T09:15:20.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.082+0000 7f25219cf640 1 -- 172.21.15.18:0/1124973352 shutdown_connections 2024-09-19T09:15:20.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.082+0000 7f25219cf640 1 --2- 172.21.15.18:0/1124973352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25080051c0 0x7f250800b9c0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:20.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.082+0000 7f25219cf640 1 -- 172.21.15.18:0/1124973352 >> 172.21.15.18:0/1124973352 conn(0x7f251c06bc10 msgr2=0x7f251c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:20.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.082+0000 7f25219cf640 1 -- 172.21.15.18:0/1124973352 shutdown_connections 2024-09-19T09:15:20.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.082+0000 7f25219cf640 1 -- 172.21.15.18:0/1124973352 wait complete. 2024-09-19T09:15:20.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.084+0000 7f25219cf640 1 Processor -- start 2024-09-19T09:15:20.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.084+0000 7f25219cf640 1 -- start start 2024-09-19T09:15:20.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.084+0000 7f25219cf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25080051c0 0x7f251c153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:20.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.085+0000 7f25219cf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f251c0b0730 0x7f251c0b0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:20.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.085+0000 7f25219cf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f251c135f80 0x7f251c136400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:20.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.085+0000 7f25219cf640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f251c06df80 con 0x7f251c0b0730 2024-09-19T09:15:20.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.085+0000 7f25219cf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f251c145670 con 0x7f25080051c0 2024-09-19T09:15:20.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.085+0000 7f25219cf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f251c06e100 con 0x7f251c135f80 2024-09-19T09:15:20.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.085+0000 7f251a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f251c0b0730 0x7f251c0b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:20.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.085+0000 7f251a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f251c0b0730 0x7f251c0b0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57766/0 (socket says 172.21.15.18:57766) 2024-09-19T09:15:20.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.085+0000 7f251a7fc640 1 -- 172.21.15.18:0/1213660259 learned_addr learned my addr 172.21.15.18:0/1213660259 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:20.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.085+0000 7f251b7fe640 1 --2- 172.21.15.18:0/1213660259 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f251c135f80 0x7f251c136400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:20.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.085+0000 7f251affd640 1 --2- 172.21.15.18:0/1213660259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25080051c0 0x7f251c153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:20.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.085+0000 7f251a7fc640 1 -- 172.21.15.18:0/1213660259 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f251c135f80 msgr2=0x7f251c136400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:20.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.085+0000 7f251a7fc640 1 --2- 172.21.15.18:0/1213660259 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f251c135f80 0x7f251c136400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:20.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.085+0000 7f251a7fc640 1 -- 172.21.15.18:0/1213660259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25080051c0 msgr2=0x7f251c153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:20.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.085+0000 7f251a7fc640 1 --2- 172.21.15.18:0/1213660259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25080051c0 0x7f251c153460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:20.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.085+0000 7f251a7fc640 1 -- 172.21.15.18:0/1213660259 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f251c15d410 con 0x7f251c0b0730 2024-09-19T09:15:20.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.085+0000 7f251a7fc640 1 --2- 172.21.15.18:0/1213660259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f251c0b0730 0x7f251c0b0bb0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2504011570 tx=0x7f2504011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:20.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.085+0000 7f2513fff640 1 -- 172.21.15.18:0/1213660259 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2504015870 con 0x7f251c0b0730 2024-09-19T09:15:20.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.085+0000 7f2513fff640 1 -- 172.21.15.18:0/1213660259 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2504015a10 con 0x7f251c0b0730 2024-09-19T09:15:20.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.085+0000 7f2513fff640 1 -- 172.21.15.18:0/1213660259 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2504015dc0 con 0x7f251c0b0730 2024-09-19T09:15:20.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.085+0000 7f25219cf640 1 -- 172.21.15.18:0/1213660259 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f251c15d6f0 con 0x7f251c0b0730 2024-09-19T09:15:20.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.085+0000 7f25219cf640 1 -- 172.21.15.18:0/1213660259 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f251c136940 con 0x7f251c0b0730 2024-09-19T09:15:20.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.086+0000 7f25219cf640 1 -- 172.21.15.18:0/1213660259 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f251c0715a0 con 0x7f251c0b0730 2024-09-19T09:15:20.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.087+0000 7f2513fff640 1 -- 172.21.15.18:0/1213660259 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f250400f460 con 0x7f251c0b0730 2024-09-19T09:15:20.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.087+0000 7f2513fff640 1 --2- 172.21.15.18:0/1213660259 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f24fc06c2b0 0x7f24fc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:20.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.087+0000 7f2513fff640 1 -- 172.21.15.18:0/1213660259 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5854+0+0 (secure 0 0 0) 0x7f250408bd20 con 0x7f251c0b0730 2024-09-19T09:15:20.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.088+0000 7f251affd640 1 --2- 172.21.15.18:0/1213660259 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f24fc06c2b0 0x7f24fc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:20.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.088+0000 7f251affd640 1 --2- 172.21.15.18:0/1213660259 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f24fc06c2b0 0x7f24fc06e770 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f250c0012e0 tx=0x7f250c002190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:20.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.092+0000 7f2513fff640 1 -- 172.21.15.18:0/1213660259 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2504019030 con 0x7f251c0b0730 2024-09-19T09:15:20.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.267+0000 7f25219cf640 1 -- 172.21.15.18:0/1213660259 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f251c0cf120 con 0x7f251c0b0730 2024-09-19T09:15:20.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.268+0000 7f2513fff640 1 -- 172.21.15.18:0/1213660259 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) ==== 74+0+16916 (secure 0 0 0) 0x7f2504059d10 con 0x7f251c0b0730 2024-09-19T09:15:20.270 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:15:20.270 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":59,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:15:17.124924+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:14:41.948276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-19T09:14:42.341949+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.0","mappings":[{"from":5,"to":0}]},{"pgid":"7.3","mappings":[{"from":5,"to":7}]},{"pgid":"7.14","mappings":[{"from":5,"to":7}]},{"pgid":"7.1d","mappings":[{"from":5,"to":7}]},{"pgid":"7.3c","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:15:20.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.270+0000 7f25219cf640 1 -- 172.21.15.18:0/1213660259 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f24fc06c2b0 msgr2=0x7f24fc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:20.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.270+0000 7f25219cf640 1 --2- 172.21.15.18:0/1213660259 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f24fc06c2b0 0x7f24fc06e770 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f250c0012e0 tx=0x7f250c002190 comp rx=0 tx=0).stop 2024-09-19T09:15:20.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.270+0000 7f25219cf640 1 -- 172.21.15.18:0/1213660259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f251c0b0730 msgr2=0x7f251c0b0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:20.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.270+0000 7f25219cf640 1 --2- 172.21.15.18:0/1213660259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f251c0b0730 0x7f251c0b0bb0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2504011570 tx=0x7f2504011a30 comp rx=0 tx=0).stop 2024-09-19T09:15:20.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.270+0000 7f25219cf640 1 -- 172.21.15.18:0/1213660259 shutdown_connections 2024-09-19T09:15:20.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.270+0000 7f25219cf640 1 --2- 172.21.15.18:0/1213660259 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f24fc06c2b0 0x7f24fc06e770 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:20.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.270+0000 7f25219cf640 1 --2- 172.21.15.18:0/1213660259 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f251c135f80 0x7f251c136400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:20.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.270+0000 7f25219cf640 1 --2- 172.21.15.18:0/1213660259 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f251c0b0730 0x7f251c0b0bb0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:20.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.270+0000 7f25219cf640 1 --2- 172.21.15.18:0/1213660259 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25080051c0 0x7f251c153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:20.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.270+0000 7f25219cf640 1 -- 172.21.15.18:0/1213660259 >> 172.21.15.18:0/1213660259 conn(0x7f251c06bc10 msgr2=0x7f251c0b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:20.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.270+0000 7f25219cf640 1 -- 172.21.15.18:0/1213660259 shutdown_connections 2024-09-19T09:15:20.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.270+0000 7f25219cf640 1 -- 172.21.15.18:0/1213660259 wait complete. 2024-09-19T09:15:20.282 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-19T09:15:20.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.384+0000 7f6bf390c640 1 Processor -- start 2024-09-19T09:15:20.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.384+0000 7f6bf390c640 1 -- start start 2024-09-19T09:15:20.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.385+0000 7f6bf390c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bec06d730 0x7f6bec0b7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:20.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.385+0000 7f6bf390c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6bec0b6290 0x7f6bec06db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:20.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.385+0000 7f6bf390c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bec06e050 con 0x7f6bec1627a0 2024-09-19T09:15:20.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.385+0000 7f6bf390c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6bec0b66d0 con 0x7f6bec0b6290 2024-09-19T09:15:20.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.385+0000 7f6bf390c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6bec0b7890 con 0x7f6bec06d730 2024-09-19T09:15:20.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.385+0000 7f6bf1ea9640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6bec1627a0 0x7f6bec162c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43630/0 (socket says 172.21.15.18:43630) 2024-09-19T09:15:20.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.385+0000 7f6bf1ea9640 1 -- 172.21.15.18:0/3340421220 learned_addr learned my addr 172.21.15.18:0/3340421220 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:15:20.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.385+0000 7f6bf16a8640 1 --2- 172.21.15.18:0/3340421220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bec06d730 0x7f6bec0b7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:20.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.385+0000 7f6bf0ea7640 1 --2- 172.21.15.18:0/3340421220 >> v2:172.21.15.162:3300/0 conn(0x7f6bec0b6290 0x7f6bec06db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:20.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.385+0000 7f6be3fff640 1 -- 172.21.15.18:0/3340421220 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 853167950 0 0) 0x7f6bec06e050 con 0x7f6bec1627a0 2024-09-19T09:15:20.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.385+0000 7f6be3fff640 1 -- 172.21.15.18:0/3340421220 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bd8003520 con 0x7f6bec1627a0 2024-09-19T09:15:20.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.385+0000 7f6be3fff640 1 -- 172.21.15.18:0/3340421220 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2354818652 0 0) 0x7f6bd8003520 con 0x7f6bec1627a0 2024-09-19T09:15:20.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.385+0000 7f6bf0ea7640 1 -- 172.21.15.18:0/3340421220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bec06d730 msgr2=0x7f6bec0b7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:20.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.385+0000 7f6bf0ea7640 1 --2- 172.21.15.18:0/3340421220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bec06d730 0x7f6bec0b7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:20.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.385+0000 7f6bf0ea7640 1 -- 172.21.15.18:0/3340421220 >> v1:172.21.15.18:6789/0 conn(0x7f6bec1627a0 legacy=0x7f6bec162c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:20.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.385+0000 7f6bf0ea7640 1 -- 172.21.15.18:0/3340421220 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bec0b7b70 con 0x7f6bec0b6290 2024-09-19T09:15:20.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.386+0000 7f6bf16a8640 1 --2- 172.21.15.18:0/3340421220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bec06d730 0x7f6bec0b7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:15:20.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.386+0000 7f6bf0ea7640 1 --2- 172.21.15.18:0/3340421220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bec0b6290 0x7f6bec06db10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc0097a0 tx=0x7f6bdc02a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c6b84865be5d33e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:20.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.387+0000 7f6be3fff640 1 -- 172.21.15.18:0/3340421220 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc037070 con 0x7f6bec0b6290 2024-09-19T09:15:20.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.387+0000 7f6be3fff640 1 -- 172.21.15.18:0/3340421220 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bdc02aba0 con 0x7f6bec0b6290 2024-09-19T09:15:20.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.387+0000 7f6be3fff640 1 -- 172.21.15.18:0/3340421220 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be40019f0 con 0x7f6bec0b6290 2024-09-19T09:15:20.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.387+0000 7f6bf390c640 1 -- 172.21.15.18:0/3340421220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bec0b6290 msgr2=0x7f6bec06db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:20.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.387+0000 7f6bf390c640 1 --2- 172.21.15.18:0/3340421220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bec0b6290 0x7f6bec06db10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc0097a0 tx=0x7f6bdc02a110 comp rx=0 tx=0).stop 2024-09-19T09:15:20.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.387+0000 7f6bf390c640 1 -- 172.21.15.18:0/3340421220 shutdown_connections 2024-09-19T09:15:20.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.387+0000 7f6bf390c640 1 --2- 172.21.15.18:0/3340421220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bec0b6290 0x7f6bec06db10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:20.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.387+0000 7f6bf390c640 1 --2- 172.21.15.18:0/3340421220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bec06d730 0x7f6bec0b7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:20.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.387+0000 7f6bf390c640 1 -- 172.21.15.18:0/3340421220 >> 172.21.15.18:0/3340421220 conn(0x7f6bec0b7e10 msgr2=0x7f6bec0b8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:20.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.387+0000 7f6bf390c640 1 -- 172.21.15.18:0/3340421220 shutdown_connections 2024-09-19T09:15:20.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.387+0000 7f6bf390c640 1 -- 172.21.15.18:0/3340421220 wait complete. 2024-09-19T09:15:20.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.388+0000 7f6bf390c640 1 Processor -- start 2024-09-19T09:15:20.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.388+0000 7f6bf390c640 1 -- start start 2024-09-19T09:15:20.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.389+0000 7f6bf390c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bec06d730 0x7f6bec0b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:20.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.389+0000 7f6bf390c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bec0b6290 0x7f6bec15e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:20.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.389+0000 7f6bf390c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6bec1627a0 0x7f6bec15c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:20.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.389+0000 7f6bf390c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6bec0cc2d0 con 0x7f6bec1627a0 2024-09-19T09:15:20.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.389+0000 7f6bf390c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6bec0cbff0 con 0x7f6bec0b6290 2024-09-19T09:15:20.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.389+0000 7f6bf390c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6bec0b4310 con 0x7f6bec06d730 2024-09-19T09:15:20.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.389+0000 7f6bf1ea9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6bec1627a0 0x7f6bec15c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:20.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.389+0000 7f6bf1ea9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6bec1627a0 0x7f6bec15c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57770/0 (socket says 172.21.15.18:57770) 2024-09-19T09:15:20.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.389+0000 7f6bf1ea9640 1 -- 172.21.15.18:0/3380324458 learned_addr learned my addr 172.21.15.18:0/3380324458 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:20.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.390+0000 7f6bf0ea7640 1 --2- 172.21.15.18:0/3380324458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bec0b6290 0x7f6bec15e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:20.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.390+0000 7f6bf16a8640 1 --2- 172.21.15.18:0/3380324458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bec06d730 0x7f6bec0b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:20.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.390+0000 7f6bf1ea9640 1 -- 172.21.15.18:0/3380324458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bec06d730 msgr2=0x7f6bec0b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:20.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.390+0000 7f6bf1ea9640 1 --2- 172.21.15.18:0/3380324458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bec06d730 0x7f6bec0b0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:20.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.390+0000 7f6bf1ea9640 1 -- 172.21.15.18:0/3380324458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bec0b6290 msgr2=0x7f6bec15e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:20.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.390+0000 7f6bf1ea9640 1 --2- 172.21.15.18:0/3380324458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bec0b6290 0x7f6bec15e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:20.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.390+0000 7f6bf1ea9640 1 -- 172.21.15.18:0/3380324458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bec15b880 con 0x7f6bec1627a0 2024-09-19T09:15:20.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.390+0000 7f6bf0ea7640 1 --2- 172.21.15.18:0/3380324458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bec0b6290 0x7f6bec15e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:15:20.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.390+0000 7f6bf1ea9640 1 --2- 172.21.15.18:0/3380324458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6bec1627a0 0x7f6bec15c920 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6be4001b60 tx=0x7f6be400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:20.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.390+0000 7f6be1ffb640 1 -- 172.21.15.18:0/3380324458 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be4017070 con 0x7f6bec1627a0 2024-09-19T09:15:20.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.390+0000 7f6be1ffb640 1 -- 172.21.15.18:0/3380324458 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6be4012400 con 0x7f6bec1627a0 2024-09-19T09:15:20.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.390+0000 7f6bf390c640 1 -- 172.21.15.18:0/3380324458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bec15bb60 con 0x7f6bec1627a0 2024-09-19T09:15:20.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.390+0000 7f6be1ffb640 1 -- 172.21.15.18:0/3380324458 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be40127b0 con 0x7f6bec1627a0 2024-09-19T09:15:20.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.390+0000 7f6bf390c640 1 -- 172.21.15.18:0/3380324458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bec15c120 con 0x7f6bec1627a0 2024-09-19T09:15:20.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.391+0000 7f6bf390c640 1 -- 172.21.15.18:0/3380324458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bec15efe0 con 0x7f6bec1627a0 2024-09-19T09:15:20.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.392+0000 7f6be1ffb640 1 -- 172.21.15.18:0/3380324458 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6be401a070 con 0x7f6bec1627a0 2024-09-19T09:15:20.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.392+0000 7f6be1ffb640 1 --2- 172.21.15.18:0/3380324458 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6bd006c2e0 0x7f6bd006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:20.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.392+0000 7f6be1ffb640 1 -- 172.21.15.18:0/3380324458 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5854+0+0 (secure 0 0 0) 0x7f6be408b340 con 0x7f6bec1627a0 2024-09-19T09:15:20.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.392+0000 7f6bf16a8640 1 --2- 172.21.15.18:0/3380324458 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6bd006c2e0 0x7f6bd006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:20.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.393+0000 7f6bf16a8640 1 --2- 172.21.15.18:0/3380324458 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6bd006c2e0 0x7f6bd006e7a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6be8009950 tx=0x7f6be8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:20.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.396+0000 7f6be1ffb640 1 -- 172.21.15.18:0/3380324458 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6be4059350 con 0x7f6bec1627a0 2024-09-19T09:15:20.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.606+0000 7f6bf390c640 1 -- 172.21.15.18:0/3380324458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6bec0b3ff0 con 0x7f6bec1627a0 2024-09-19T09:15:20.608 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-19T09:15:20.607+0000 7fca8a79c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:15:20.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.608+0000 7f6be1ffb640 1 -- 172.21.15.18:0/3380324458 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) ==== 161+0+0 (secure 0 0 0) 0x7f6be405d650 con 0x7f6bec1627a0 2024-09-19T09:15:20.610 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T09:15:20.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.610+0000 7f6bf390c640 1 -- 172.21.15.18:0/3380324458 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6bd006c2e0 msgr2=0x7f6bd006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:20.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.610+0000 7f6bf390c640 1 --2- 172.21.15.18:0/3380324458 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6bd006c2e0 0x7f6bd006e7a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6be8009950 tx=0x7f6be8008040 comp rx=0 tx=0).stop 2024-09-19T09:15:20.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.610+0000 7f6bf390c640 1 -- 172.21.15.18:0/3380324458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6bec1627a0 msgr2=0x7f6bec15c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:20.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.610+0000 7f6bf390c640 1 --2- 172.21.15.18:0/3380324458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6bec1627a0 0x7f6bec15c920 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6be4001b60 tx=0x7f6be400a430 comp rx=0 tx=0).stop 2024-09-19T09:15:20.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.610+0000 7f6bf390c640 1 -- 172.21.15.18:0/3380324458 shutdown_connections 2024-09-19T09:15:20.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.610+0000 7f6bf390c640 1 --2- 172.21.15.18:0/3380324458 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6bd006c2e0 0x7f6bd006e7a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:20.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.610+0000 7f6bf390c640 1 --2- 172.21.15.18:0/3380324458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6bec1627a0 0x7f6bec15c920 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:20.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.610+0000 7f6bf390c640 1 --2- 172.21.15.18:0/3380324458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6bec0b6290 0x7f6bec15e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:20.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.610+0000 7f6bf390c640 1 --2- 172.21.15.18:0/3380324458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6bec06d730 0x7f6bec0b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:20.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.610+0000 7f6bf390c640 1 -- 172.21.15.18:0/3380324458 >> 172.21.15.18:0/3380324458 conn(0x7f6bec0b7e10 msgr2=0x7f6bec070040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:20.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.610+0000 7f6bf390c640 1 -- 172.21.15.18:0/3380324458 shutdown_connections 2024-09-19T09:15:20.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.610+0000 7f6bf390c640 1 -- 172.21.15.18:0/3380324458 wait complete. 2024-09-19T09:15:20.624 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T09:15:20.651 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2024-09-19T09:15:20.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.727+0000 7f3fea0e6640 1 Processor -- start 2024-09-19T09:15:20.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.727+0000 7f3fea0e6640 1 -- start start 2024-09-19T09:15:20.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.728+0000 7f3fea0e6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe406deb0 0x7f3fe40b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:20.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.728+0000 7f3fea0e6640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3fe415f1a0 0x7f3fe4160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:20.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.728+0000 7f3fea0e6640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fe40b6a60 con 0x7f3fe415c670 2024-09-19T09:15:20.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.728+0000 7f3fea0e6640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f3fe40b6d40 con 0x7f3fe415f1a0 2024-09-19T09:15:20.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.728+0000 7f3fea0e6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3fe40b7020 con 0x7f3fe406deb0 2024-09-19T09:15:20.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.728+0000 7f3fe37fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3fe415c670 0x7f3fe406d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43632/0 (socket says 172.21.15.18:43632) 2024-09-19T09:15:20.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.728+0000 7f3fe37fe640 1 -- 172.21.15.18:0/1746053729 learned_addr learned my addr 172.21.15.18:0/1746053729 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:15:20.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.728+0000 7f3fe27fc640 1 -- 172.21.15.18:0/1746053729 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2097068207 0 0) 0x7f3fe40b6a60 con 0x7f3fe415c670 2024-09-19T09:15:20.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.728+0000 7f3fe27fc640 1 -- 172.21.15.18:0/1746053729 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fcc003520 con 0x7f3fe415c670 2024-09-19T09:15:20.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.728+0000 7f3fe3fff640 1 --2- 172.21.15.18:0/1746053729 >> v2:172.21.15.162:3300/0 conn(0x7f3fe415f1a0 0x7f3fe4160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:20.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.728+0000 7f3fe2ffd640 1 --2- 172.21.15.18:0/1746053729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe406deb0 0x7f3fe40b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:20.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.729+0000 7f3fe27fc640 1 -- 172.21.15.18:0/1746053729 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3056548273 0 0) 0x7f3fcc003520 con 0x7f3fe415c670 2024-09-19T09:15:20.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.729+0000 7f3fe27fc640 1 -- 172.21.15.18:0/1746053729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe406deb0 msgr2=0x7f3fe40b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:20.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.729+0000 7f3fe27fc640 1 --2- 172.21.15.18:0/1746053729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe406deb0 0x7f3fe40b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:20.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.729+0000 7f3fe27fc640 1 -- 172.21.15.18:0/1746053729 >> v2:172.21.15.162:3300/0 conn(0x7f3fe415f1a0 msgr2=0x7f3fe4160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:20.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.729+0000 7f3fe27fc640 1 --2- 172.21.15.18:0/1746053729 >> v2:172.21.15.162:3300/0 conn(0x7f3fe415f1a0 0x7f3fe4160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:20.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.729+0000 7f3fe27fc640 1 -- 172.21.15.18:0/1746053729 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe40b7300 con 0x7f3fe415c670 2024-09-19T09:15:20.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.729+0000 7f3fe27fc640 1 -- 172.21.15.18:0/1746053729 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f3fd4001670 con 0x7f3fe415c670 2024-09-19T09:15:20.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.729+0000 7f3fe27fc640 1 -- 172.21.15.18:0/1746053729 >> v1:172.21.15.18:6789/0 conn(0x7f3fe415c670 legacy=0x7f3fe406d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:20.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.729+0000 7f3fe27fc640 1 --2- 172.21.15.18:0/1746053729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fcc0039b0 0x7f3fcc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:20.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.729+0000 7f3fe27fc640 1 --2- 172.21.15.18:0/1746053729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fcc004800 0x7f3fcc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:20.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.729+0000 7f3fe27fc640 1 --2- 172.21.15.18:0/1746053729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe406deb0 0x7f3fcc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:20.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.729+0000 7f3fe27fc640 1 -- 172.21.15.18:0/1746053729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe40b6d40 con 0x7f3fcc0039b0 2024-09-19T09:15:20.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.729+0000 7f3fe27fc640 1 -- 172.21.15.18:0/1746053729 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe40b7020 con 0x7f3fcc004800 2024-09-19T09:15:20.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.729+0000 7f3fe27fc640 1 -- 172.21.15.18:0/1746053729 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3fcc00b9c0 con 0x7f3fe406deb0 2024-09-19T09:15:20.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.729+0000 7f3fe37fe640 1 --2- 172.21.15.18:0/1746053729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fcc0039b0 0x7f3fcc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:20.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.729+0000 7f3fe2ffd640 1 --2- 172.21.15.18:0/1746053729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fcc004800 0x7f3fcc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:20.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.729+0000 7f3fe3fff640 1 --2- 172.21.15.18:0/1746053729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe406deb0 0x7f3fcc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:20.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.729+0000 7f3fe37fe640 1 -- 172.21.15.18:0/1746053729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe406deb0 msgr2=0x7f3fcc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:20.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.729+0000 7f3fe37fe640 1 --2- 172.21.15.18:0/1746053729 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe406deb0 0x7f3fcc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:20.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.729+0000 7f3fe37fe640 1 -- 172.21.15.18:0/1746053729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fcc004800 msgr2=0x7f3fcc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:20.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.729+0000 7f3fe37fe640 1 --2- 172.21.15.18:0/1746053729 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fcc004800 0x7f3fcc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:20.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.729+0000 7f3fe37fe640 1 -- 172.21.15.18:0/1746053729 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fcc003520 con 0x7f3fcc0039b0 2024-09-19T09:15:20.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.730+0000 7f3fe37fe640 1 --2- 172.21.15.18:0/1746053729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fcc0039b0 0x7f3fcc003dd0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3fd400c240 tx=0x7f3fcc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=347ad9140898b4e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:20.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.730+0000 7f3fe27fc640 1 -- 172.21.15.18:0/1746053729 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd4007d50 con 0x7f3fcc0039b0 2024-09-19T09:15:20.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.730+0000 7f3fe27fc640 1 -- 172.21.15.18:0/1746053729 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fd402e070 con 0x7f3fcc0039b0 2024-09-19T09:15:20.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.730+0000 7f3fe27fc640 1 -- 172.21.15.18:0/1746053729 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd4005d30 con 0x7f3fcc0039b0 2024-09-19T09:15:20.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.731+0000 7f3fea0e6640 1 -- 172.21.15.18:0/1746053729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fcc0039b0 msgr2=0x7f3fcc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:20.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.731+0000 7f3fea0e6640 1 --2- 172.21.15.18:0/1746053729 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fcc0039b0 0x7f3fcc003dd0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f3fd400c240 tx=0x7f3fcc005830 comp rx=0 tx=0).stop 2024-09-19T09:15:20.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.731+0000 7f3fe3fff640 1 -- 172.21.15.18:0/1746053729 reap_dead start 2024-09-19T09:15:20.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.731+0000 7f3fea0e6640 1 -- 172.21.15.18:0/1746053729 shutdown_connections 2024-09-19T09:15:20.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.731+0000 7f3fea0e6640 1 -- 172.21.15.18:0/1746053729 >> 172.21.15.18:0/1746053729 conn(0x7f3fe409b9d0 msgr2=0x7f3fe409bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:20.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.731+0000 7f3fea0e6640 1 -- 172.21.15.18:0/1746053729 shutdown_connections 2024-09-19T09:15:20.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.731+0000 7f3fea0e6640 1 -- 172.21.15.18:0/1746053729 wait complete. 2024-09-19T09:15:20.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.732+0000 7f3fea0e6640 1 Processor -- start 2024-09-19T09:15:20.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.732+0000 7f3fea0e6640 1 -- start start 2024-09-19T09:15:20.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.733+0000 7f3fea0e6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fcc0039b0 0x7f3fe409d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:20.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.733+0000 7f3fea0e6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fe40a03a0 0x7f3fe41543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:20.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.733+0000 7f3fea0e6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe41588b0 0x7f3fe4158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:20.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.733+0000 7f3fea0e6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe40b7b00 con 0x7f3fcc0039b0 2024-09-19T09:15:20.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.733+0000 7f3fea0e6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3fe409c560 con 0x7f3fe40a03a0 2024-09-19T09:15:20.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.733+0000 7f3fea0e6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3fe41548e0 con 0x7f3fe41588b0 2024-09-19T09:15:20.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.733+0000 7f3fe37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fcc0039b0 0x7f3fe409d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:20.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.733+0000 7f3fe37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fcc0039b0 0x7f3fe409d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57816/0 (socket says 172.21.15.18:57816) 2024-09-19T09:15:20.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.733+0000 7f3fe37fe640 1 -- 172.21.15.18:0/1964584640 learned_addr learned my addr 172.21.15.18:0/1964584640 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:20.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.733+0000 7f3fe2ffd640 1 --2- 172.21.15.18:0/1964584640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fe40a03a0 0x7f3fe41543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:20.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.733+0000 7f3fe3fff640 1 --2- 172.21.15.18:0/1964584640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe41588b0 0x7f3fe4158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:20.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.733+0000 7f3fe37fe640 1 -- 172.21.15.18:0/1964584640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe41588b0 msgr2=0x7f3fe4158d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:20.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.733+0000 7f3fe37fe640 1 --2- 172.21.15.18:0/1964584640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe41588b0 0x7f3fe4158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:20.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.733+0000 7f3fe37fe640 1 -- 172.21.15.18:0/1964584640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fe40a03a0 msgr2=0x7f3fe41543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:20.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.733+0000 7f3fe37fe640 1 --2- 172.21.15.18:0/1964584640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fe40a03a0 0x7f3fe41543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:20.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.733+0000 7f3fe37fe640 1 -- 172.21.15.18:0/1964584640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe409d7e0 con 0x7f3fcc0039b0 2024-09-19T09:15:20.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.733+0000 7f3fe2ffd640 1 --2- 172.21.15.18:0/1964584640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fe40a03a0 0x7f3fe41543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:15:20.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.733+0000 7f3fe37fe640 1 --2- 172.21.15.18:0/1964584640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fcc0039b0 0x7f3fe409d150 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3fd400c360 tx=0x7f3fd4001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:20.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.733+0000 7f3fcbfff640 1 -- 172.21.15.18:0/1964584640 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd4042020 con 0x7f3fcc0039b0 2024-09-19T09:15:20.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.734+0000 7f3fcbfff640 1 -- 172.21.15.18:0/1964584640 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fd4007270 con 0x7f3fcc0039b0 2024-09-19T09:15:20.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.734+0000 7f3fcbfff640 1 -- 172.21.15.18:0/1964584640 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fd4001c90 con 0x7f3fcc0039b0 2024-09-19T09:15:20.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.734+0000 7f3fea0e6640 1 -- 172.21.15.18:0/1964584640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fe409dac0 con 0x7f3fcc0039b0 2024-09-19T09:15:20.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.734+0000 7f3fea0e6640 1 -- 172.21.15.18:0/1964584640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fe4161a30 con 0x7f3fcc0039b0 2024-09-19T09:15:20.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.734+0000 7f3fea0e6640 1 -- 172.21.15.18:0/1964584640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fe415ca50 con 0x7f3fcc0039b0 2024-09-19T09:15:20.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.735+0000 7f3fcbfff640 1 -- 172.21.15.18:0/1964584640 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3fd4045020 con 0x7f3fcc0039b0 2024-09-19T09:15:20.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.735+0000 7f3fcbfff640 1 --2- 172.21.15.18:0/1964584640 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3fd006c2b0 0x7f3fd006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:20.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.736+0000 7f3fcbfff640 1 -- 172.21.15.18:0/1964584640 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5940+0+0 (secure 0 0 0) 0x7f3fd40ab8c0 con 0x7f3fcc0039b0 2024-09-19T09:15:20.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.736+0000 7f3fe2ffd640 1 --2- 172.21.15.18:0/1964584640 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3fd006c2b0 0x7f3fd006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:20.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.736+0000 7f3fe2ffd640 1 --2- 172.21.15.18:0/1964584640 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3fd006c2b0 0x7f3fd006e770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3fd80093d0 tx=0x7f3fd8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:20.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.740+0000 7f3fcbfff640 1 -- 172.21.15.18:0/1964584640 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3fd404c070 con 0x7f3fcc0039b0 2024-09-19T09:15:20.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:20.949+0000 7f3fea0e6640 1 -- 172.21.15.18:0/1964584640 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f3fe40b4030 con 0x7f3fcc0039b0 2024-09-19T09:15:21.612 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.610+0000 7f3fcbfff640 1 -- 172.21.15.18:0/1964584640 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) ==== 104+0+0 (secure 0 0 0) 0x7f3fd4004e20 con 0x7f3fcc0039b0 2024-09-19T09:15:21.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.613+0000 7f3fea0e6640 1 -- 172.21.15.18:0/1964584640 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3fd006c2b0 msgr2=0x7f3fd006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:21.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.613+0000 7f3fea0e6640 1 --2- 172.21.15.18:0/1964584640 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3fd006c2b0 0x7f3fd006e770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3fd80093d0 tx=0x7f3fd8008040 comp rx=0 tx=0).stop 2024-09-19T09:15:21.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.613+0000 7f3fea0e6640 1 -- 172.21.15.18:0/1964584640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fcc0039b0 msgr2=0x7f3fe409d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:21.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.613+0000 7f3fea0e6640 1 --2- 172.21.15.18:0/1964584640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fcc0039b0 0x7f3fe409d150 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3fd400c360 tx=0x7f3fd4001a40 comp rx=0 tx=0).stop 2024-09-19T09:15:21.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.613+0000 7f3fea0e6640 1 -- 172.21.15.18:0/1964584640 shutdown_connections 2024-09-19T09:15:21.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.613+0000 7f3fea0e6640 1 --2- 172.21.15.18:0/1964584640 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3fd006c2b0 0x7f3fd006e770 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:21.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.613+0000 7f3fea0e6640 1 --2- 172.21.15.18:0/1964584640 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fe41588b0 0x7f3fe4158d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:21.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.613+0000 7f3fea0e6640 1 --2- 172.21.15.18:0/1964584640 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fe40a03a0 0x7f3fe41543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:21.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.613+0000 7f3fea0e6640 1 --2- 172.21.15.18:0/1964584640 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fcc0039b0 0x7f3fe409d150 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:21.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.613+0000 7f3fea0e6640 1 -- 172.21.15.18:0/1964584640 >> 172.21.15.18:0/1964584640 conn(0x7f3fe409b9d0 msgr2=0x7f3fe415d1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:21.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.613+0000 7f3fea0e6640 1 -- 172.21.15.18:0/1964584640 shutdown_connections 2024-09-19T09:15:21.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.613+0000 7f3fea0e6640 1 -- 172.21.15.18:0/1964584640 wait complete. 2024-09-19T09:15:21.628 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T09:15:21.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.780+0000 7f92b6dbd640 1 Processor -- start 2024-09-19T09:15:21.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.780+0000 7f92b6dbd640 1 -- start start 2024-09-19T09:15:21.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.781+0000 7f92b6dbd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f92b00ce460 0x7f92b00cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:21.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.781+0000 7f92b6dbd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f92b00d0420 0x7f92b006e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:21.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.781+0000 7f92b6dbd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92b006eb20 0x7f92b01605c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:21.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.781+0000 7f92b6dbd640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f92b015dfc0 con 0x7f92b00d0420 2024-09-19T09:15:21.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.781+0000 7f92b6dbd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f92b015d3b0 con 0x7f92b00ce460 2024-09-19T09:15:21.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.781+0000 7f92b6dbd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f92b015d690 con 0x7f92b006eb20 2024-09-19T09:15:21.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.781+0000 7f92affff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f92b00d0420 0x7f92b006e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:21.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.781+0000 7f92affff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f92b00d0420 0x7f92b006e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57832/0 (socket says 172.21.15.18:57832) 2024-09-19T09:15:21.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.781+0000 7f92affff640 1 -- 172.21.15.18:0/2421077924 learned_addr learned my addr 172.21.15.18:0/2421077924 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:21.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.781+0000 7f92b535a640 1 --2- 172.21.15.18:0/2421077924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92b006eb20 0x7f92b01605c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:21.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.782+0000 7f92b4b59640 1 --2- 172.21.15.18:0/2421077924 >> v2:172.21.15.162:3300/0 conn(0x7f92b00ce460 0x7f92b00cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:21.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.782+0000 7f92affff640 1 -- 172.21.15.18:0/2421077924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92b006eb20 msgr2=0x7f92b01605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:21.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.782+0000 7f92affff640 1 --2- 172.21.15.18:0/2421077924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92b006eb20 0x7f92b01605c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:21.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.782+0000 7f92affff640 1 -- 172.21.15.18:0/2421077924 >> v2:172.21.15.162:3300/0 conn(0x7f92b00ce460 msgr2=0x7f92b00cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:21.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.782+0000 7f92affff640 1 --2- 172.21.15.18:0/2421077924 >> v2:172.21.15.162:3300/0 conn(0x7f92b00ce460 0x7f92b00cfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:21.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.782+0000 7f92affff640 1 -- 172.21.15.18:0/2421077924 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92b015d970 con 0x7f92b00d0420 2024-09-19T09:15:21.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.782+0000 7f92affff640 1 --2- 172.21.15.18:0/2421077924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92b00d0420 0x7f92b006e5e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f92b0076810 tx=0x7f929802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16019d1e2fde5e8b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:21.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.783+0000 7f92af7fe640 1 -- 172.21.15.18:0/2421077924 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9298036070 con 0x7f92b00d0420 2024-09-19T09:15:21.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.783+0000 7f92af7fe640 1 -- 172.21.15.18:0/2421077924 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9298031600 con 0x7f92b00d0420 2024-09-19T09:15:21.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.783+0000 7f92af7fe640 1 -- 172.21.15.18:0/2421077924 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92980319d0 con 0x7f92b00d0420 2024-09-19T09:15:21.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.783+0000 7f92b6dbd640 1 -- 172.21.15.18:0/2421077924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92b00d0420 msgr2=0x7f92b006e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:21.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.783+0000 7f92b6dbd640 1 --2- 172.21.15.18:0/2421077924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92b00d0420 0x7f92b006e5e0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f92b0076810 tx=0x7f929802a6a0 comp rx=0 tx=0).stop 2024-09-19T09:15:21.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.783+0000 7f92b6dbd640 1 -- 172.21.15.18:0/2421077924 shutdown_connections 2024-09-19T09:15:21.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.783+0000 7f92b6dbd640 1 --2- 172.21.15.18:0/2421077924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92b006eb20 0x7f92b01605c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:21.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.783+0000 7f92b6dbd640 1 --2- 172.21.15.18:0/2421077924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92b00d0420 0x7f92b006e5e0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:21.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.783+0000 7f92b6dbd640 1 --2- 172.21.15.18:0/2421077924 >> v2:172.21.15.162:3300/0 conn(0x7f92b00ce460 0x7f92b00cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:21.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.783+0000 7f92b6dbd640 1 -- 172.21.15.18:0/2421077924 >> 172.21.15.18:0/2421077924 conn(0x7f92b00b26a0 msgr2=0x7f92b00b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:21.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.783+0000 7f92b6dbd640 1 -- 172.21.15.18:0/2421077924 shutdown_connections 2024-09-19T09:15:21.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.783+0000 7f92b6dbd640 1 -- 172.21.15.18:0/2421077924 wait complete. 2024-09-19T09:15:21.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.784+0000 7f92b6dbd640 1 Processor -- start 2024-09-19T09:15:21.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.784+0000 7f92b6dbd640 1 -- start start 2024-09-19T09:15:21.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.785+0000 7f92b6dbd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92b006eb20 0x7f92b01f4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:21.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.785+0000 7f92b6dbd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92b00ce460 0x7f92b014dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:21.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.785+0000 7f92b6dbd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92b00d0420 0x7f92b014be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:21.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.785+0000 7f92b6dbd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f92b015cfd0 con 0x7f92b00d0420 2024-09-19T09:15:21.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.785+0000 7f92b6dbd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f92b00ce840 con 0x7f92b006eb20 2024-09-19T09:15:21.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.785+0000 7f92b6dbd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f92b015d150 con 0x7f92b00ce460 2024-09-19T09:15:21.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.785+0000 7f92b535a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92b00d0420 0x7f92b014be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:21.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.785+0000 7f92b535a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92b00d0420 0x7f92b014be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57840/0 (socket says 172.21.15.18:57840) 2024-09-19T09:15:21.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.785+0000 7f92b535a640 1 -- 172.21.15.18:0/3246229975 learned_addr learned my addr 172.21.15.18:0/3246229975 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:21.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.786+0000 7f92b4b59640 1 --2- 172.21.15.18:0/3246229975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92b006eb20 0x7f92b01f4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:21.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.786+0000 7f92affff640 1 --2- 172.21.15.18:0/3246229975 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92b00ce460 0x7f92b014dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:21.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.786+0000 7f92b535a640 1 -- 172.21.15.18:0/3246229975 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92b00ce460 msgr2=0x7f92b014dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:21.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.786+0000 7f92b535a640 1 --2- 172.21.15.18:0/3246229975 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92b00ce460 0x7f92b014dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:21.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.786+0000 7f92b535a640 1 -- 172.21.15.18:0/3246229975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92b006eb20 msgr2=0x7f92b01f4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:21.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.786+0000 7f92b535a640 1 --2- 172.21.15.18:0/3246229975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92b006eb20 0x7f92b01f4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:21.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.786+0000 7f92b535a640 1 -- 172.21.15.18:0/3246229975 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92b014e570 con 0x7f92b00d0420 2024-09-19T09:15:21.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.786+0000 7f92b4b59640 1 --2- 172.21.15.18:0/3246229975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92b006eb20 0x7f92b01f4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:15:21.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.786+0000 7f92affff640 1 --2- 172.21.15.18:0/3246229975 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92b00ce460 0x7f92b014dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:15:21.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.786+0000 7f92b535a640 1 --2- 172.21.15.18:0/3246229975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92b00d0420 0x7f92b014be40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f92a800d600 tx=0x7f92a800dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:21.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.786+0000 7f92ad7fa640 1 -- 172.21.15.18:0/3246229975 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a8018020 con 0x7f92b00d0420 2024-09-19T09:15:21.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.786+0000 7f92ad7fa640 1 -- 172.21.15.18:0/3246229975 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92a8014620 con 0x7f92b00d0420 2024-09-19T09:15:21.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.786+0000 7f92ad7fa640 1 -- 172.21.15.18:0/3246229975 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92a80149f0 con 0x7f92b00d0420 2024-09-19T09:15:21.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.786+0000 7f92b6dbd640 1 -- 172.21.15.18:0/3246229975 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92b014e850 con 0x7f92b00d0420 2024-09-19T09:15:21.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.786+0000 7f92b6dbd640 1 -- 172.21.15.18:0/3246229975 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92b014e260 con 0x7f92b00d0420 2024-09-19T09:15:21.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.787+0000 7f92b6dbd640 1 -- 172.21.15.18:0/3246229975 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92b00cfee0 con 0x7f92b00d0420 2024-09-19T09:15:21.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.788+0000 7f92ad7fa640 1 -- 172.21.15.18:0/3246229975 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f92a801b020 con 0x7f92b00d0420 2024-09-19T09:15:21.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.788+0000 7f92ad7fa640 1 --2- 172.21.15.18:0/3246229975 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f929006c2b0 0x7f929006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:21.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.788+0000 7f92ad7fa640 1 -- 172.21.15.18:0/3246229975 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5940+0+0 (secure 0 0 0) 0x7f92a808b6c0 con 0x7f92b00d0420 2024-09-19T09:15:21.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.788+0000 7f92b4b59640 1 --2- 172.21.15.18:0/3246229975 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f929006c2b0 0x7f929006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:21.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.789+0000 7f92b4b59640 1 --2- 172.21.15.18:0/3246229975 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f929006c2b0 0x7f929006e770 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f92a0006fd0 tx=0x7f92a0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:21.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.793+0000 7f92ad7fa640 1 -- 172.21.15.18:0/3246229975 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f92a8022030 con 0x7f92b00d0420 2024-09-19T09:15:21.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:21.970+0000 7f92b6dbd640 1 -- 172.21.15.18:0/3246229975 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f92b0073260 con 0x7f92b00d0420 2024-09-19T09:15:22.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.611+0000 7f92ad7fa640 1 -- 172.21.15.18:0/3246229975 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v61) ==== 181+0+0 (secure 0 0 0) 0x7f92a8059db0 con 0x7f92b00d0420 2024-09-19T09:15:22.613 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' removed 2024-09-19T09:15:22.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.615+0000 7f92b6dbd640 1 -- 172.21.15.18:0/3246229975 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f929006c2b0 msgr2=0x7f929006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:22.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.615+0000 7f92b6dbd640 1 --2- 172.21.15.18:0/3246229975 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f929006c2b0 0x7f929006e770 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f92a0006fd0 tx=0x7f92a0008040 comp rx=0 tx=0).stop 2024-09-19T09:15:22.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.615+0000 7f92b6dbd640 1 -- 172.21.15.18:0/3246229975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92b00d0420 msgr2=0x7f92b014be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:22.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.615+0000 7f92b6dbd640 1 --2- 172.21.15.18:0/3246229975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92b00d0420 0x7f92b014be40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f92a800d600 tx=0x7f92a800dac0 comp rx=0 tx=0).stop 2024-09-19T09:15:22.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.616+0000 7f92b6dbd640 1 -- 172.21.15.18:0/3246229975 shutdown_connections 2024-09-19T09:15:22.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.616+0000 7f92b6dbd640 1 --2- 172.21.15.18:0/3246229975 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f929006c2b0 0x7f929006e770 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:22.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.616+0000 7f92b6dbd640 1 --2- 172.21.15.18:0/3246229975 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92b00d0420 0x7f92b014be40 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:22.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.616+0000 7f92b6dbd640 1 --2- 172.21.15.18:0/3246229975 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92b00ce460 0x7f92b014dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:22.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.616+0000 7f92b6dbd640 1 --2- 172.21.15.18:0/3246229975 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92b006eb20 0x7f92b01f4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:22.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.616+0000 7f92b6dbd640 1 -- 172.21.15.18:0/3246229975 >> 172.21.15.18:0/3246229975 conn(0x7f92b00b26a0 msgr2=0x7f92b015f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:22.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.616+0000 7f92b6dbd640 1 -- 172.21.15.18:0/3246229975 shutdown_connections 2024-09-19T09:15:22.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.616+0000 7f92b6dbd640 1 -- 172.21.15.18:0/3246229975 wait complete. 2024-09-19T09:15:22.632 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T09:15:22.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.746+0000 7f6812c45640 1 Processor -- start 2024-09-19T09:15:22.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.746+0000 7f6812c45640 1 -- start start 2024-09-19T09:15:22.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.746+0000 7f6812c45640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f680c0d3990 0x7f680c169960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:22.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.746+0000 7f6812c45640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f680c0d0870 con 0x7f680c0d0370 2024-09-19T09:15:22.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.747+0000 7f6812c45640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f680c0d0b50 con 0x7f680c15edb0 2024-09-19T09:15:22.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.747+0000 7f6812c45640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f680c0b4400 con 0x7f680c0d3990 2024-09-19T09:15:22.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.747+0000 7f680bfff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f680c0d0370 0x7f680c0d3280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43646/0 (socket says 172.21.15.18:43646) 2024-09-19T09:15:22.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.747+0000 7f680bfff640 1 -- 172.21.15.18:0/876484885 learned_addr learned my addr 172.21.15.18:0/876484885 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:15:22.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.747+0000 7f68111e2640 1 --2- 172.21.15.18:0/876484885 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f680c0d3990 0x7f680c169960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:22.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.747+0000 7f680b7fe640 1 -- 172.21.15.18:0/876484885 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 766059927 0 0) 0x7f680c0d0870 con 0x7f680c0d0370 2024-09-19T09:15:22.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.747+0000 7f680b7fe640 1 -- 172.21.15.18:0/876484885 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67fc003520 con 0x7f680c0d0370 2024-09-19T09:15:22.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.747+0000 7f680b7fe640 1 -- 172.21.15.18:0/876484885 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 566474499 0 0) 0x7f680c0d0b50 con 0x7f680c15edb0 2024-09-19T09:15:22.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.747+0000 7f680b7fe640 1 -- 172.21.15.18:0/876484885 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f680c0d0870 con 0x7f680c15edb0 2024-09-19T09:15:22.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.747+0000 7f680b7fe640 1 -- 172.21.15.18:0/876484885 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3359926596 0 0) 0x7f67fc003520 con 0x7f680c0d0370 2024-09-19T09:15:22.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.747+0000 7f680b7fe640 1 -- 172.21.15.18:0/876484885 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f680c0d3990 msgr2=0x7f680c169960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:22.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.747+0000 7f680b7fe640 1 --2- 172.21.15.18:0/876484885 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f680c0d3990 0x7f680c169960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:22.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.747+0000 7f680b7fe640 1 -- 172.21.15.18:0/876484885 >> v1:172.21.15.162:6789/0 conn(0x7f680c15edb0 legacy=0x7f680c0d29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:22.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.747+0000 7f680b7fe640 1 -- 172.21.15.18:0/876484885 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f680c0b4620 con 0x7f680c0d0370 2024-09-19T09:15:22.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.747+0000 7f680b7fe640 1 -- 172.21.15.18:0/876484885 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f67f8001670 con 0x7f680c0d0370 2024-09-19T09:15:22.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.747+0000 7f680b7fe640 1 -- 172.21.15.18:0/876484885 >> v1:172.21.15.18:6789/0 conn(0x7f680c0d0370 legacy=0x7f680c0d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:22.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.747+0000 7f680b7fe640 1 --2- 172.21.15.18:0/876484885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67fc003b70 0x7f67fc003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:22.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.747+0000 7f680b7fe640 1 --2- 172.21.15.18:0/876484885 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f680c0d3990 0x7f67fc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:22.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.747+0000 7f680b7fe640 1 --2- 172.21.15.18:0/876484885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67fc004d40 0x7f67fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:22.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.747+0000 7f680b7fe640 1 -- 172.21.15.18:0/876484885 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f680c0b4400 con 0x7f67fc003b70 2024-09-19T09:15:22.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.747+0000 7f680b7fe640 1 -- 172.21.15.18:0/876484885 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f67fc00baa0 con 0x7f67fc004d40 2024-09-19T09:15:22.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.747+0000 7f680b7fe640 1 -- 172.21.15.18:0/876484885 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f67fc00bca0 con 0x7f680c0d3990 2024-09-19T09:15:22.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.747+0000 7f68109e1640 1 --2- 172.21.15.18:0/876484885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67fc003b70 0x7f67fc003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:22.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.748+0000 7f680bfff640 1 --2- 172.21.15.18:0/876484885 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f680c0d3990 0x7f67fc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:22.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.748+0000 7f68111e2640 1 --2- 172.21.15.18:0/876484885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67fc004d40 0x7f67fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:22.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.748+0000 7f68109e1640 1 -- 172.21.15.18:0/876484885 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f680c0d3990 msgr2=0x7f67fc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:22.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.748+0000 7f68109e1640 1 --2- 172.21.15.18:0/876484885 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f680c0d3990 0x7f67fc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:22.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.748+0000 7f68109e1640 1 -- 172.21.15.18:0/876484885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67fc004d40 msgr2=0x7f67fc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:22.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.748+0000 7f68109e1640 1 --2- 172.21.15.18:0/876484885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67fc004d40 0x7f67fc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:22.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.748+0000 7f68109e1640 1 -- 172.21.15.18:0/876484885 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67fc003520 con 0x7f67fc003b70 2024-09-19T09:15:22.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.748+0000 7f68111e2640 1 --2- 172.21.15.18:0/876484885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f67fc004d40 0x7f67fc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:22.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.749+0000 7f68109e1640 1 --2- 172.21.15.18:0/876484885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67fc003b70 0x7f67fc003f70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f68000018d0 tx=0x7f67fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef7bc9eb921fa85c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:22.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.749+0000 7f680b7fe640 1 -- 172.21.15.18:0/876484885 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68000014f0 con 0x7f67fc003b70 2024-09-19T09:15:22.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.749+0000 7f680b7fe640 1 -- 172.21.15.18:0/876484885 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68000052d0 con 0x7f67fc003b70 2024-09-19T09:15:22.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.749+0000 7f680b7fe640 1 -- 172.21.15.18:0/876484885 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680002aca0 con 0x7f67fc003b70 2024-09-19T09:15:22.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.749+0000 7f6812c45640 1 -- 172.21.15.18:0/876484885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67fc003b70 msgr2=0x7f67fc003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:22.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.749+0000 7f6812c45640 1 --2- 172.21.15.18:0/876484885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67fc003b70 0x7f67fc003f70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f68000018d0 tx=0x7f67fc005830 comp rx=0 tx=0).stop 2024-09-19T09:15:22.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.749+0000 7f68111e2640 1 -- 172.21.15.18:0/876484885 reap_dead start 2024-09-19T09:15:22.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.749+0000 7f6812c45640 1 -- 172.21.15.18:0/876484885 shutdown_connections 2024-09-19T09:15:22.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.749+0000 7f6812c45640 1 -- 172.21.15.18:0/876484885 >> 172.21.15.18:0/876484885 conn(0x7f680c09df30 msgr2=0x7f680c0d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:22.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.749+0000 7f6812c45640 1 -- 172.21.15.18:0/876484885 shutdown_connections 2024-09-19T09:15:22.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.749+0000 7f6812c45640 1 -- 172.21.15.18:0/876484885 wait complete. 2024-09-19T09:15:22.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.751+0000 7f6812c45640 1 Processor -- start 2024-09-19T09:15:22.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.751+0000 7f6812c45640 1 -- start start 2024-09-19T09:15:22.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.751+0000 7f6812c45640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67fc003b70 0x7f680c0ba6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:22.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.751+0000 7f6812c45640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f680c1f1c00 0x7f680c1f5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:22.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.751+0000 7f6812c45640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f680c161530 0x7f680c0b8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:22.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.751+0000 7f6812c45640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f680c15f190 con 0x7f680c161530 2024-09-19T09:15:22.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.751+0000 7f6812c45640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f680c0b4be0 con 0x7f680c1f1c00 2024-09-19T09:15:22.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.751+0000 7f6812c45640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f680c0b6110 con 0x7f67fc003b70 2024-09-19T09:15:22.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.752+0000 7f68111e2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f680c161530 0x7f680c0b8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:22.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.752+0000 7f68111e2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f680c161530 0x7f680c0b8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57854/0 (socket says 172.21.15.18:57854) 2024-09-19T09:15:22.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.752+0000 7f68111e2640 1 -- 172.21.15.18:0/3475421851 learned_addr learned my addr 172.21.15.18:0/3475421851 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:22.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.752+0000 7f68109e1640 1 --2- 172.21.15.18:0/3475421851 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67fc003b70 0x7f680c0ba6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:22.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.752+0000 7f680bfff640 1 --2- 172.21.15.18:0/3475421851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f680c1f1c00 0x7f680c1f5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:22.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.752+0000 7f68111e2640 1 -- 172.21.15.18:0/3475421851 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67fc003b70 msgr2=0x7f680c0ba6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:22.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.752+0000 7f68111e2640 1 --2- 172.21.15.18:0/3475421851 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67fc003b70 0x7f680c0ba6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:22.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.752+0000 7f68111e2640 1 -- 172.21.15.18:0/3475421851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f680c1f1c00 msgr2=0x7f680c1f5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:22.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.752+0000 7f68111e2640 1 --2- 172.21.15.18:0/3475421851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f680c1f1c00 0x7f680c1f5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:22.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.752+0000 7f68111e2640 1 -- 172.21.15.18:0/3475421851 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f680c1f5640 con 0x7f680c161530 2024-09-19T09:15:22.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.752+0000 7f68111e2640 1 --2- 172.21.15.18:0/3475421851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f680c161530 0x7f680c0b8020 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f680c0b6780 tx=0x7f6804010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:22.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.752+0000 7f68097fa640 1 -- 172.21.15.18:0/3475421851 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680401a030 con 0x7f680c161530 2024-09-19T09:15:22.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.752+0000 7f68097fa640 1 -- 172.21.15.18:0/3475421851 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6804010e60 con 0x7f680c161530 2024-09-19T09:15:22.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.752+0000 7f68097fa640 1 -- 172.21.15.18:0/3475421851 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6804003bd0 con 0x7f680c161530 2024-09-19T09:15:22.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.752+0000 7f6812c45640 1 -- 172.21.15.18:0/3475421851 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f680c1f2080 con 0x7f680c161530 2024-09-19T09:15:22.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.752+0000 7f6812c45640 1 -- 172.21.15.18:0/3475421851 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f680c160770 con 0x7f680c161530 2024-09-19T09:15:22.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.753+0000 7f6812c45640 1 -- 172.21.15.18:0/3475421851 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f680c0d3280 con 0x7f680c161530 2024-09-19T09:15:22.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.754+0000 7f68097fa640 1 -- 172.21.15.18:0/3475421851 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6804005d10 con 0x7f680c161530 2024-09-19T09:15:22.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.754+0000 7f68097fa640 1 --2- 172.21.15.18:0/3475421851 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f67f006c2b0 0x7f67f006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:22.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.754+0000 7f68097fa640 1 -- 172.21.15.18:0/3475421851 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5502+0+0 (secure 0 0 0) 0x7f680408ba60 con 0x7f680c161530 2024-09-19T09:15:22.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.755+0000 7f68109e1640 1 --2- 172.21.15.18:0/3475421851 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f67f006c2b0 0x7f67f006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:22.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.755+0000 7f68109e1640 1 --2- 172.21.15.18:0/3475421851 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f67f006c2b0 0x7f67f006e770 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6800032000 tx=0x7f6800009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:22.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.759+0000 7f68097fa640 1 -- 172.21.15.18:0/3475421851 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6804025020 con 0x7f680c161530 2024-09-19T09:15:22.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:22.933+0000 7f6812c45640 1 -- 172.21.15.18:0/3475421851 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f680c0d2ce0 con 0x7f680c161530 2024-09-19T09:15:23.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.613+0000 7f68097fa640 1 -- 172.21.15.18:0/3475421851 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v62) ==== 169+0+0 (secure 0 0 0) 0x7f680c1f5640 con 0x7f680c161530 2024-09-19T09:15:23.615 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' removed 2024-09-19T09:15:23.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.616+0000 7f6812c45640 1 -- 172.21.15.18:0/3475421851 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f67f006c2b0 msgr2=0x7f67f006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:23.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.616+0000 7f6812c45640 1 --2- 172.21.15.18:0/3475421851 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f67f006c2b0 0x7f67f006e770 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6800032000 tx=0x7f6800009030 comp rx=0 tx=0).stop 2024-09-19T09:15:23.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.616+0000 7f6812c45640 1 -- 172.21.15.18:0/3475421851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f680c161530 msgr2=0x7f680c0b8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:23.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.616+0000 7f6812c45640 1 --2- 172.21.15.18:0/3475421851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f680c161530 0x7f680c0b8020 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f680c0b6780 tx=0x7f6804010590 comp rx=0 tx=0).stop 2024-09-19T09:15:23.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.616+0000 7f6812c45640 1 -- 172.21.15.18:0/3475421851 shutdown_connections 2024-09-19T09:15:23.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.616+0000 7f6812c45640 1 --2- 172.21.15.18:0/3475421851 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f67f006c2b0 0x7f67f006e770 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:23.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.616+0000 7f6812c45640 1 --2- 172.21.15.18:0/3475421851 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f680c161530 0x7f680c0b8020 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:23.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.616+0000 7f6812c45640 1 --2- 172.21.15.18:0/3475421851 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f680c1f1c00 0x7f680c1f5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:23.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.616+0000 7f6812c45640 1 --2- 172.21.15.18:0/3475421851 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67fc003b70 0x7f680c0ba6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:23.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.616+0000 7f6812c45640 1 -- 172.21.15.18:0/3475421851 >> 172.21.15.18:0/3475421851 conn(0x7f680c09df30 msgr2=0x7f680c0d1600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:23.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.616+0000 7f6812c45640 1 -- 172.21.15.18:0/3475421851 shutdown_connections 2024-09-19T09:15:23.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.616+0000 7f6812c45640 1 -- 172.21.15.18:0/3475421851 wait complete. 2024-09-19T09:15:23.631 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-19T09:15:23.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.740+0000 7f766014b640 1 Processor -- start 2024-09-19T09:15:23.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.740+0000 7f766014b640 1 -- start start 2024-09-19T09:15:23.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.741+0000 7f766014b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f765815edb0 0x7f765806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:23.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.741+0000 7f766014b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f765806cf30 0x7f76580ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:23.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.741+0000 7f766014b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f765815f190 con 0x7f765806c150 2024-09-19T09:15:23.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.741+0000 7f766014b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f76580b39b0 con 0x7f765815edb0 2024-09-19T09:15:23.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.741+0000 7f766014b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f765806d610 con 0x7f765806cf30 2024-09-19T09:15:23.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.741+0000 7f765d6e6640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f765806c150 0x7f765806c820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43656/0 (socket says 172.21.15.18:43656) 2024-09-19T09:15:23.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.741+0000 7f765d6e6640 1 -- 172.21.15.18:0/3086166313 learned_addr learned my addr 172.21.15.18:0/3086166313 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:15:23.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.741+0000 7f765dee7640 1 --2- 172.21.15.18:0/3086166313 >> v2:172.21.15.18:3300/0 conn(0x7f765815edb0 0x7f765806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:23.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.741+0000 7f765e6e8640 1 --2- 172.21.15.18:0/3086166313 >> v2:172.21.15.162:3300/0 conn(0x7f765806cf30 0x7f76580ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:23.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.741+0000 7f765cee5640 1 -- 172.21.15.18:0/3086166313 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 914237277 0 0) 0x7f765815f190 con 0x7f765806c150 2024-09-19T09:15:23.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.741+0000 7f765cee5640 1 -- 172.21.15.18:0/3086166313 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7644003520 con 0x7f765806c150 2024-09-19T09:15:23.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.741+0000 7f765dee7640 1 -- 172.21.15.18:0/3086166313 >> v2:172.21.15.162:3300/0 conn(0x7f765806cf30 msgr2=0x7f76580ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:23.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.741+0000 7f765dee7640 1 --2- 172.21.15.18:0/3086166313 >> v2:172.21.15.162:3300/0 conn(0x7f765806cf30 0x7f76580ae1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:23.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.741+0000 7f765dee7640 1 -- 172.21.15.18:0/3086166313 >> v1:172.21.15.18:6789/0 conn(0x7f765806c150 legacy=0x7f765806c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:23.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.741+0000 7f765dee7640 1 -- 172.21.15.18:0/3086166313 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76580b2da0 con 0x7f765815edb0 2024-09-19T09:15:23.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.741+0000 7f765e6e8640 1 --2- 172.21.15.18:0/3086166313 >> v2:172.21.15.162:3300/0 conn(0x7f765806cf30 0x7f76580ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:23.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.742+0000 7f765dee7640 1 --2- 172.21.15.18:0/3086166313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f765815edb0 0x7f765806bc10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f765806c7b0 tx=0x7f765402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c65e60c3a2cf5efa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:23.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.742+0000 7f765cee5640 1 -- 172.21.15.18:0/3086166313 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7654037070 con 0x7f765815edb0 2024-09-19T09:15:23.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.742+0000 7f765cee5640 1 -- 172.21.15.18:0/3086166313 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7654032440 con 0x7f765815edb0 2024-09-19T09:15:23.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.742+0000 7f765cee5640 1 -- 172.21.15.18:0/3086166313 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7654032810 con 0x7f765815edb0 2024-09-19T09:15:23.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.743+0000 7f766014b640 1 -- 172.21.15.18:0/3086166313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f765815edb0 msgr2=0x7f765806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:23.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.743+0000 7f766014b640 1 --2- 172.21.15.18:0/3086166313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f765815edb0 0x7f765806bc10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f765806c7b0 tx=0x7f765402a1a0 comp rx=0 tx=0).stop 2024-09-19T09:15:23.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.743+0000 7f766014b640 1 -- 172.21.15.18:0/3086166313 shutdown_connections 2024-09-19T09:15:23.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.743+0000 7f766014b640 1 --2- 172.21.15.18:0/3086166313 >> v2:172.21.15.162:3300/0 conn(0x7f765806cf30 0x7f76580ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:23.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.743+0000 7f766014b640 1 --2- 172.21.15.18:0/3086166313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f765815edb0 0x7f765806bc10 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:23.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.743+0000 7f766014b640 1 -- 172.21.15.18:0/3086166313 >> 172.21.15.18:0/3086166313 conn(0x7f76580b5fc0 msgr2=0x7f76580b6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:23.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.743+0000 7f766014b640 1 -- 172.21.15.18:0/3086166313 shutdown_connections 2024-09-19T09:15:23.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.743+0000 7f766014b640 1 -- 172.21.15.18:0/3086166313 wait complete. 2024-09-19T09:15:23.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.744+0000 7f766014b640 1 Processor -- start 2024-09-19T09:15:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.744+0000 7f766014b640 1 -- start start 2024-09-19T09:15:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.745+0000 7f766014b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f765806c150 0x7f7658153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.745+0000 7f766014b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f765806cf30 0x7f7658161590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.745+0000 7f766014b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f765815edb0 0x7f7658145520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.745+0000 7f766014b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f76580b3640 con 0x7f765815edb0 2024-09-19T09:15:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.745+0000 7f766014b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f76580b3360 con 0x7f765806c150 2024-09-19T09:15:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.745+0000 7f766014b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f76580ae710 con 0x7f765806cf30 2024-09-19T09:15:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.745+0000 7f765e6e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f765815edb0 0x7f7658145520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.745+0000 7f765e6e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f765815edb0 0x7f7658145520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57860/0 (socket says 172.21.15.18:57860) 2024-09-19T09:15:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.745+0000 7f765e6e8640 1 -- 172.21.15.18:0/4230895449 learned_addr learned my addr 172.21.15.18:0/4230895449 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.745+0000 7f765d6e6640 1 --2- 172.21.15.18:0/4230895449 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f765806cf30 0x7f7658161590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.745+0000 7f765dee7640 1 --2- 172.21.15.18:0/4230895449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f765806c150 0x7f7658153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:23.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.745+0000 7f765e6e8640 1 -- 172.21.15.18:0/4230895449 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f765806cf30 msgr2=0x7f7658161590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:23.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.745+0000 7f765e6e8640 1 --2- 172.21.15.18:0/4230895449 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f765806cf30 0x7f7658161590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:23.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.745+0000 7f765e6e8640 1 -- 172.21.15.18:0/4230895449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f765806c150 msgr2=0x7f7658153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:23.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.745+0000 7f765e6e8640 1 --2- 172.21.15.18:0/4230895449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f765806c150 0x7f7658153470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:23.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.745+0000 7f765e6e8640 1 -- 172.21.15.18:0/4230895449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76581546e0 con 0x7f765815edb0 2024-09-19T09:15:23.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.746+0000 7f765e6e8640 1 --2- 172.21.15.18:0/4230895449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f765815edb0 0x7f7658145520 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7650007ec0 tx=0x7f765000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:23.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.746+0000 7f764e7fc640 1 -- 172.21.15.18:0/4230895449 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765001a070 con 0x7f765815edb0 2024-09-19T09:15:23.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.746+0000 7f764e7fc640 1 -- 172.21.15.18:0/4230895449 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7650003b90 con 0x7f765815edb0 2024-09-19T09:15:23.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.746+0000 7f764e7fc640 1 -- 172.21.15.18:0/4230895449 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765000de20 con 0x7f765815edb0 2024-09-19T09:15:23.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.746+0000 7f766014b640 1 -- 172.21.15.18:0/4230895449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7658153e40 con 0x7f765815edb0 2024-09-19T09:15:23.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.746+0000 7f766014b640 1 -- 172.21.15.18:0/4230895449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7658154400 con 0x7f765815edb0 2024-09-19T09:15:23.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.747+0000 7f766014b640 1 -- 172.21.15.18:0/4230895449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76580ae1b0 con 0x7f765815edb0 2024-09-19T09:15:23.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.747+0000 7f764e7fc640 1 -- 172.21.15.18:0/4230895449 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f765001d070 con 0x7f765815edb0 2024-09-19T09:15:23.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.748+0000 7f764e7fc640 1 --2- 172.21.15.18:0/4230895449 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f763c06c2b0 0x7f763c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:23.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.748+0000 7f764e7fc640 1 -- 172.21.15.18:0/4230895449 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 4943+0+0 (secure 0 0 0) 0x7f765008b490 con 0x7f765815edb0 2024-09-19T09:15:23.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.748+0000 7f765dee7640 1 --2- 172.21.15.18:0/4230895449 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f763c06c2b0 0x7f763c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:23.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.749+0000 7f765dee7640 1 --2- 172.21.15.18:0/4230895449 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f763c06c2b0 0x7f763c06e770 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7654034000 tx=0x7f765402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:23.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.752+0000 7f764e7fc640 1 -- 172.21.15.18:0/4230895449 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f76581546e0 con 0x7f765815edb0 2024-09-19T09:15:23.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.928+0000 7f766014b640 1 -- 172.21.15.18:0/4230895449 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f76580af8e0 con 0x7f765815edb0 2024-09-19T09:15:23.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.931+0000 7f764e7fc640 1 -- 172.21.15.18:0/4230895449 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) ==== 104+0+0 (secure 0 0 0) 0x7f7650010070 con 0x7f765815edb0 2024-09-19T09:15:23.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.933+0000 7f766014b640 1 -- 172.21.15.18:0/4230895449 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f763c06c2b0 msgr2=0x7f763c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:23.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.933+0000 7f766014b640 1 --2- 172.21.15.18:0/4230895449 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f763c06c2b0 0x7f763c06e770 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7654034000 tx=0x7f765402e000 comp rx=0 tx=0).stop 2024-09-19T09:15:23.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.933+0000 7f766014b640 1 -- 172.21.15.18:0/4230895449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f765815edb0 msgr2=0x7f7658145520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:23.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.933+0000 7f766014b640 1 --2- 172.21.15.18:0/4230895449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f765815edb0 0x7f7658145520 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7650007ec0 tx=0x7f765000d4a0 comp rx=0 tx=0).stop 2024-09-19T09:15:23.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.933+0000 7f766014b640 1 -- 172.21.15.18:0/4230895449 shutdown_connections 2024-09-19T09:15:23.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.933+0000 7f766014b640 1 --2- 172.21.15.18:0/4230895449 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f763c06c2b0 0x7f763c06e770 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:23.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.933+0000 7f766014b640 1 --2- 172.21.15.18:0/4230895449 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f765815edb0 0x7f7658145520 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:23.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.933+0000 7f766014b640 1 --2- 172.21.15.18:0/4230895449 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f765806cf30 0x7f7658161590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:23.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.933+0000 7f766014b640 1 --2- 172.21.15.18:0/4230895449 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f765806c150 0x7f7658153470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:23.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.933+0000 7f766014b640 1 -- 172.21.15.18:0/4230895449 >> 172.21.15.18:0/4230895449 conn(0x7f76580b5fc0 msgr2=0x7f76580aee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:23.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.933+0000 7f766014b640 1 -- 172.21.15.18:0/4230895449 shutdown_connections 2024-09-19T09:15:23.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:23.933+0000 7f766014b640 1 -- 172.21.15.18:0/4230895449 wait complete. 2024-09-19T09:15:23.945 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2024-09-19T09:15:24.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.048+0000 7fa30e45e640 1 Processor -- start 2024-09-19T09:15:24.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.048+0000 7fa30e45e640 1 -- start start 2024-09-19T09:15:24.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.048+0000 7fa30e45e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa30815ef80 0x7fa3080b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:24.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.048+0000 7fa30e45e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa30806d730 0x7fa3080cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:24.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.048+0000 7fa30e45e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa3080cf910 0x7fa3080d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:24.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.048+0000 7fa30e45e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fa3080cd7d0 con 0x7fa3080cf910 2024-09-19T09:15:24.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.048+0000 7fa30e45e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa3080cd1a0 con 0x7fa30815ef80 2024-09-19T09:15:24.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.048+0000 7fa30e45e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa30806dc30 con 0x7fa30806d730 2024-09-19T09:15:24.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.049+0000 7fa30c9fb640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa3080cf910 0x7fa3080d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:24.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.049+0000 7fa30c9fb640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa3080cf910 0x7fa3080d0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57876/0 (socket says 172.21.15.18:57876) 2024-09-19T09:15:24.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.049+0000 7fa30c9fb640 1 -- 172.21.15.18:0/2521716485 learned_addr learned my addr 172.21.15.18:0/2521716485 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:24.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.049+0000 7fa30c9fb640 1 -- 172.21.15.18:0/2521716485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa30806d730 msgr2=0x7fa3080cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:24.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.049+0000 7fa3077fe640 1 --2- 172.21.15.18:0/2521716485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa30806d730 0x7fa3080cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:24.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.049+0000 7fa307fff640 1 --2- 172.21.15.18:0/2521716485 >> v2:172.21.15.162:3300/0 conn(0x7fa30815ef80 0x7fa3080b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:24.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.049+0000 7fa30c9fb640 1 --2- 172.21.15.18:0/2521716485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa30806d730 0x7fa3080cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:24.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.049+0000 7fa30c9fb640 1 -- 172.21.15.18:0/2521716485 >> v2:172.21.15.162:3300/0 conn(0x7fa30815ef80 msgr2=0x7fa3080b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:24.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.049+0000 7fa30c9fb640 1 --2- 172.21.15.18:0/2521716485 >> v2:172.21.15.162:3300/0 conn(0x7fa30815ef80 0x7fa3080b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:24.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.049+0000 7fa30c9fb640 1 -- 172.21.15.18:0/2521716485 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa30806df10 con 0x7fa3080cf910 2024-09-19T09:15:24.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.050+0000 7fa30c9fb640 1 --2- 172.21.15.18:0/2521716485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3080cf910 0x7fa3080d0ce0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa30806f6e0 tx=0x7fa30002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b1b9305f24bc1f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:24.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.050+0000 7fa306ffd640 1 -- 172.21.15.18:0/2521716485 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa300036070 con 0x7fa3080cf910 2024-09-19T09:15:24.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.050+0000 7fa306ffd640 1 -- 172.21.15.18:0/2521716485 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa300031600 con 0x7fa3080cf910 2024-09-19T09:15:24.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.050+0000 7fa306ffd640 1 -- 172.21.15.18:0/2521716485 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3000319d0 con 0x7fa3080cf910 2024-09-19T09:15:24.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.050+0000 7fa30e45e640 1 -- 172.21.15.18:0/2521716485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3080cf910 msgr2=0x7fa3080d0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:24.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.050+0000 7fa30e45e640 1 --2- 172.21.15.18:0/2521716485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3080cf910 0x7fa3080d0ce0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa30806f6e0 tx=0x7fa30002a6a0 comp rx=0 tx=0).stop 2024-09-19T09:15:24.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.050+0000 7fa30e45e640 1 -- 172.21.15.18:0/2521716485 shutdown_connections 2024-09-19T09:15:24.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.050+0000 7fa30e45e640 1 --2- 172.21.15.18:0/2521716485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3080cf910 0x7fa3080d0ce0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:24.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.050+0000 7fa30e45e640 1 --2- 172.21.15.18:0/2521716485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa30806d730 0x7fa3080cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:24.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.050+0000 7fa30e45e640 1 --2- 172.21.15.18:0/2521716485 >> v2:172.21.15.162:3300/0 conn(0x7fa30815ef80 0x7fa3080b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:24.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.050+0000 7fa30e45e640 1 -- 172.21.15.18:0/2521716485 >> 172.21.15.18:0/2521716485 conn(0x7fa3080b4700 msgr2=0x7fa3080b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:24.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.050+0000 7fa30e45e640 1 -- 172.21.15.18:0/2521716485 shutdown_connections 2024-09-19T09:15:24.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.050+0000 7fa30e45e640 1 -- 172.21.15.18:0/2521716485 wait complete. 2024-09-19T09:15:24.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.052+0000 7fa30e45e640 1 Processor -- start 2024-09-19T09:15:24.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.052+0000 7fa30e45e640 1 -- start start 2024-09-19T09:15:24.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.052+0000 7fa30e45e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa30806d730 0x7fa3080b83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:24.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.052+0000 7fa30e45e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3080cf910 0x7fa30815dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:24.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.052+0000 7fa30e45e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa30815ef80 0x7fa308154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:24.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.053+0000 7fa30e45e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa3080d0120 con 0x7fa3080cf910 2024-09-19T09:15:24.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.053+0000 7fa30e45e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa30815f360 con 0x7fa30806d730 2024-09-19T09:15:24.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.053+0000 7fa30e45e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa3080d1220 con 0x7fa30815ef80 2024-09-19T09:15:24.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.053+0000 7fa3077fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3080cf910 0x7fa30815dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:24.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.053+0000 7fa3077fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3080cf910 0x7fa30815dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57886/0 (socket says 172.21.15.18:57886) 2024-09-19T09:15:24.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.053+0000 7fa3077fe640 1 -- 172.21.15.18:0/1860012283 learned_addr learned my addr 172.21.15.18:0/1860012283 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:24.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.053+0000 7fa30c9fb640 1 --2- 172.21.15.18:0/1860012283 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa30815ef80 0x7fa308154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:24.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.053+0000 7fa307fff640 1 --2- 172.21.15.18:0/1860012283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa30806d730 0x7fa3080b83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:24.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.053+0000 7fa3077fe640 1 -- 172.21.15.18:0/1860012283 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa30815ef80 msgr2=0x7fa308154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:24.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.053+0000 7fa3077fe640 1 --2- 172.21.15.18:0/1860012283 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa30815ef80 0x7fa308154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:24.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.053+0000 7fa3077fe640 1 -- 172.21.15.18:0/1860012283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa30806d730 msgr2=0x7fa3080b83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:24.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.053+0000 7fa3077fe640 1 --2- 172.21.15.18:0/1860012283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa30806d730 0x7fa3080b83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:24.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.053+0000 7fa3077fe640 1 -- 172.21.15.18:0/1860012283 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3080cb860 con 0x7fa3080cf910 2024-09-19T09:15:24.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.053+0000 7fa30c9fb640 1 --2- 172.21.15.18:0/1860012283 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa30815ef80 0x7fa308154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:15:24.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.053+0000 7fa3077fe640 1 --2- 172.21.15.18:0/1860012283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3080cf910 0x7fa30815dd00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc00c7f0 tx=0x7fa2fc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:24.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.053+0000 7fa304ff9640 1 -- 172.21.15.18:0/1860012283 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc004230 con 0x7fa3080cf910 2024-09-19T09:15:24.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.053+0000 7fa304ff9640 1 -- 172.21.15.18:0/1860012283 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2fc0043d0 con 0x7fa3080cf910 2024-09-19T09:15:24.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.053+0000 7fa30e45e640 1 -- 172.21.15.18:0/1860012283 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3080cbb40 con 0x7fa3080cf910 2024-09-19T09:15:24.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.053+0000 7fa304ff9640 1 -- 172.21.15.18:0/1860012283 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2fc007860 con 0x7fa3080cf910 2024-09-19T09:15:24.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.053+0000 7fa30e45e640 1 -- 172.21.15.18:0/1860012283 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3080cc100 con 0x7fa3080cf910 2024-09-19T09:15:24.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.054+0000 7fa30e45e640 1 -- 172.21.15.18:0/1860012283 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3080d0ce0 con 0x7fa3080cf910 2024-09-19T09:15:24.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.055+0000 7fa304ff9640 1 -- 172.21.15.18:0/1860012283 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa2fc007c10 con 0x7fa3080cf910 2024-09-19T09:15:24.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.055+0000 7fa304ff9640 1 --2- 172.21.15.18:0/1860012283 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa2f406c2b0 0x7fa2f406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:24.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.055+0000 7fa304ff9640 1 -- 172.21.15.18:0/1860012283 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 4943+0+0 (secure 0 0 0) 0x7fa2fc08b350 con 0x7fa3080cf910 2024-09-19T09:15:24.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.055+0000 7fa307fff640 1 --2- 172.21.15.18:0/1860012283 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa2f406c2b0 0x7fa2f406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:24.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.056+0000 7fa307fff640 1 --2- 172.21.15.18:0/1860012283 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa2f406c2b0 0x7fa2f406e770 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa2f800b740 tx=0x7fa2f8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:24.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.059+0000 7fa304ff9640 1 -- 172.21.15.18:0/1860012283 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa2fc015020 con 0x7fa3080cf910 2024-09-19T09:15:24.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.304+0000 7fa30e45e640 1 -- 172.21.15.18:0/1860012283 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) -- 0x7fa3080cf6f0 con 0x7fa3080cf910 2024-09-19T09:15:24.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.614+0000 7fa304ff9640 1 -- 172.21.15.18:0/1860012283 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v125) ==== 142+0+0 (secure 0 0 0) 0x7fa2fc059dc0 con 0x7fa3080cf910 2024-09-19T09:15:24.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.617+0000 7fa30e45e640 1 -- 172.21.15.18:0/1860012283 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa2f406c2b0 msgr2=0x7fa2f406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:24.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.617+0000 7fa30e45e640 1 --2- 172.21.15.18:0/1860012283 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa2f406c2b0 0x7fa2f406e770 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa2f800b740 tx=0x7fa2f8008040 comp rx=0 tx=0).stop 2024-09-19T09:15:24.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.617+0000 7fa30e45e640 1 -- 172.21.15.18:0/1860012283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3080cf910 msgr2=0x7fa30815dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:24.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.617+0000 7fa30e45e640 1 --2- 172.21.15.18:0/1860012283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3080cf910 0x7fa30815dd00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc00c7f0 tx=0x7fa2fc00ccb0 comp rx=0 tx=0).stop 2024-09-19T09:15:24.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.617+0000 7fa30e45e640 1 -- 172.21.15.18:0/1860012283 shutdown_connections 2024-09-19T09:15:24.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.617+0000 7fa30e45e640 1 --2- 172.21.15.18:0/1860012283 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa2f406c2b0 0x7fa2f406e770 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:24.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.617+0000 7fa30e45e640 1 --2- 172.21.15.18:0/1860012283 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa30815ef80 0x7fa308154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:24.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.617+0000 7fa30e45e640 1 --2- 172.21.15.18:0/1860012283 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3080cf910 0x7fa30815dd00 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:24.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.617+0000 7fa30e45e640 1 --2- 172.21.15.18:0/1860012283 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa30806d730 0x7fa3080b83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:24.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.617+0000 7fa30e45e640 1 -- 172.21.15.18:0/1860012283 >> 172.21.15.18:0/1860012283 conn(0x7fa3080b4700 msgr2=0x7fa3080d3590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:24.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.617+0000 7fa30e45e640 1 -- 172.21.15.18:0/1860012283 shutdown_connections 2024-09-19T09:15:24.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.617+0000 7fa30e45e640 1 -- 172.21.15.18:0/1860012283 wait complete. 2024-09-19T09:15:24.630 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2024-09-19T09:15:24.630 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestClusterFull) 2024-09-19T09:15:24.631 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:15:24.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.735+0000 7f1e57d86640 1 Processor -- start 2024-09-19T09:15:24.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.736+0000 7f1e57d86640 1 -- start start 2024-09-19T09:15:24.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.736+0000 7f1e57d86640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e5015ef50 0x7f1e500d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:24.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.736+0000 7f1e57d86640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1e500b9510 0x7f1e500d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:24.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.736+0000 7f1e57d86640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e500b7a90 con 0x7f1e500d3240 2024-09-19T09:15:24.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.736+0000 7f1e57d86640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f1e500d3740 con 0x7f1e500b9510 2024-09-19T09:15:24.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.736+0000 7f1e57d86640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1e500d3a20 con 0x7f1e5015ef50 2024-09-19T09:15:24.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.737+0000 7f1e56323640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1e500b9510 0x7f1e500d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:24.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.737+0000 7f1e55321640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f1e500d3240 0x7f1e500cf770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43670/0 (socket says 172.21.15.18:43670) 2024-09-19T09:15:24.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.737+0000 7f1e55321640 1 -- 172.21.15.18:0/3650907184 learned_addr learned my addr 172.21.15.18:0/3650907184 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:15:24.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.737+0000 7f1e56323640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1e500b9510 0x7f1e500d18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57898/0 (socket says 172.21.15.18:57898) 2024-09-19T09:15:24.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.737+0000 7f1e55b22640 1 --2- 172.21.15.18:0/3650907184 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e5015ef50 0x7f1e500d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:24.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.737+0000 7f1e56323640 1 -- 172.21.15.18:0/3650907184 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e5015ef50 msgr2=0x7f1e500d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:24.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.737+0000 7f1e56323640 1 --2- 172.21.15.18:0/3650907184 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e5015ef50 0x7f1e500d13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:24.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.737+0000 7f1e56323640 1 -- 172.21.15.18:0/3650907184 >> v1:172.21.15.18:6789/0 conn(0x7f1e500d3240 legacy=0x7f1e500cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:24.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.737+0000 7f1e56323640 1 -- 172.21.15.18:0/3650907184 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e500b7d00 con 0x7f1e500b9510 2024-09-19T09:15:24.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.737+0000 7f1e54b20640 1 -- 172.21.15.18:0/3650907184 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2319957783 0 0) 0x7f1e500b7a90 con 0x7f1e500d3240 2024-09-19T09:15:24.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.738+0000 7f1e56323640 1 --2- 172.21.15.18:0/3650907184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e500b9510 0x7f1e500d18e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1e480097a0 tx=0x7f1e4802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551a414d8902e6cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:24.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.738+0000 7f1e54b20640 1 -- 172.21.15.18:0/3650907184 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e48037070 con 0x7f1e500b9510 2024-09-19T09:15:24.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.738+0000 7f1e54b20640 1 -- 172.21.15.18:0/3650907184 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e48032440 con 0x7f1e500b9510 2024-09-19T09:15:24.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.738+0000 7f1e54b20640 1 -- 172.21.15.18:0/3650907184 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4802ae60 con 0x7f1e500b9510 2024-09-19T09:15:24.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.738+0000 7f1e57d86640 1 -- 172.21.15.18:0/3650907184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e500b9510 msgr2=0x7f1e500d18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:24.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.738+0000 7f1e57d86640 1 --2- 172.21.15.18:0/3650907184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e500b9510 0x7f1e500d18e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1e480097a0 tx=0x7f1e4802a110 comp rx=0 tx=0).stop 2024-09-19T09:15:24.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.738+0000 7f1e57d86640 1 -- 172.21.15.18:0/3650907184 shutdown_connections 2024-09-19T09:15:24.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.738+0000 7f1e57d86640 1 --2- 172.21.15.18:0/3650907184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e500b9510 0x7f1e500d18e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:24.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.738+0000 7f1e57d86640 1 --2- 172.21.15.18:0/3650907184 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e5015ef50 0x7f1e500d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:24.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.738+0000 7f1e57d86640 1 -- 172.21.15.18:0/3650907184 >> 172.21.15.18:0/3650907184 conn(0x7f1e500d4c60 msgr2=0x7f1e500d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:24.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.738+0000 7f1e57d86640 1 -- 172.21.15.18:0/3650907184 shutdown_connections 2024-09-19T09:15:24.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.738+0000 7f1e57d86640 1 -- 172.21.15.18:0/3650907184 wait complete. 2024-09-19T09:15:24.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.740+0000 7f1e57d86640 1 Processor -- start 2024-09-19T09:15:24.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.740+0000 7f1e57d86640 1 -- start start 2024-09-19T09:15:24.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.740+0000 7f1e57d86640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e500b9510 0x7f1e500cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:24.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.740+0000 7f1e57d86640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e500d3240 0x7f1e501f85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:24.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.740+0000 7f1e57d86640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e5015ef50 0x7f1e50155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:24.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.740+0000 7f1e57d86640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1e500d21a0 con 0x7f1e500b9510 2024-09-19T09:15:24.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.740+0000 7f1e57d86640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1e500d2020 con 0x7f1e5015ef50 2024-09-19T09:15:24.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.740+0000 7f1e57d86640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1e500d5780 con 0x7f1e500d3240 2024-09-19T09:15:24.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.740+0000 7f1e55b22640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e500b9510 0x7f1e500cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:24.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.740+0000 7f1e55b22640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e500b9510 0x7f1e500cdcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57902/0 (socket says 172.21.15.18:57902) 2024-09-19T09:15:24.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.740+0000 7f1e55b22640 1 -- 172.21.15.18:0/3348508577 learned_addr learned my addr 172.21.15.18:0/3348508577 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:24.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.741+0000 7f1e56323640 1 --2- 172.21.15.18:0/3348508577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e5015ef50 0x7f1e50155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:24.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.741+0000 7f1e55321640 1 --2- 172.21.15.18:0/3348508577 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e500d3240 0x7f1e501f85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:24.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.741+0000 7f1e55b22640 1 -- 172.21.15.18:0/3348508577 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e500d3240 msgr2=0x7f1e501f85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:24.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.741+0000 7f1e55b22640 1 --2- 172.21.15.18:0/3348508577 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e500d3240 0x7f1e501f85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:24.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.741+0000 7f1e55b22640 1 -- 172.21.15.18:0/3348508577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e5015ef50 msgr2=0x7f1e50155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:24.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.741+0000 7f1e55b22640 1 --2- 172.21.15.18:0/3348508577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e5015ef50 0x7f1e50155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:24.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.741+0000 7f1e55b22640 1 -- 172.21.15.18:0/3348508577 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e500ce400 con 0x7f1e500b9510 2024-09-19T09:15:24.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.741+0000 7f1e56323640 1 --2- 172.21.15.18:0/3348508577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e5015ef50 0x7f1e50155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:15:24.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.741+0000 7f1e55321640 1 --2- 172.21.15.18:0/3348508577 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e500d3240 0x7f1e501f85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:15:24.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.741+0000 7f1e55b22640 1 --2- 172.21.15.18:0/3348508577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e500b9510 0x7f1e500cdcd0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1e4000cd00 tx=0x7f1e4000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:24.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.741+0000 7f1e4e7fc640 1 -- 172.21.15.18:0/3348508577 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e40003990 con 0x7f1e500b9510 2024-09-19T09:15:24.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.741+0000 7f1e4e7fc640 1 -- 172.21.15.18:0/3348508577 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e40003b30 con 0x7f1e500b9510 2024-09-19T09:15:24.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.741+0000 7f1e57d86640 1 -- 172.21.15.18:0/3348508577 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e500ce6e0 con 0x7f1e500b9510 2024-09-19T09:15:24.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.741+0000 7f1e4e7fc640 1 -- 172.21.15.18:0/3348508577 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e40004020 con 0x7f1e500b9510 2024-09-19T09:15:24.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.741+0000 7f1e57d86640 1 -- 172.21.15.18:0/3348508577 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e500cbe60 con 0x7f1e500b9510 2024-09-19T09:15:24.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.742+0000 7f1e57d86640 1 -- 172.21.15.18:0/3348508577 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e500d13a0 con 0x7f1e500b9510 2024-09-19T09:15:24.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.743+0000 7f1e4e7fc640 1 -- 172.21.15.18:0/3348508577 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1e400041c0 con 0x7f1e500b9510 2024-09-19T09:15:24.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.743+0000 7f1e4e7fc640 1 --2- 172.21.15.18:0/3348508577 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1e3c06c2b0 0x7f1e3c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:24.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.743+0000 7f1e4e7fc640 1 -- 172.21.15.18:0/3348508577 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 4943+0+0 (secure 0 0 0) 0x7f1e4008b580 con 0x7f1e500b9510 2024-09-19T09:15:24.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.743+0000 7f1e55321640 1 --2- 172.21.15.18:0/3348508577 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1e3c06c2b0 0x7f1e3c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:24.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.744+0000 7f1e55321640 1 --2- 172.21.15.18:0/3348508577 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1e3c06c2b0 0x7f1e3c06e770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1e500d2500 tx=0x7f1e44009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:24.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.747+0000 7f1e4e7fc640 1 -- 172.21.15.18:0/3348508577 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1e40014030 con 0x7f1e500b9510 2024-09-19T09:15:24.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.923+0000 7f1e57d86640 1 -- 172.21.15.18:0/3348508577 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1e500cb9a0 con 0x7f1e500b9510 2024-09-19T09:15:24.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.924+0000 7f1e4e7fc640 1 -- 172.21.15.18:0/3348508577 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+13042 (secure 0 0 0) 0x7f1e4005a080 con 0x7f1e500b9510 2024-09-19T09:15:24.926 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:15:24.926 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":62,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:15:23.613695+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6835/295967875":"2024-09-20T09:15:20.608982+0000","172.21.15.18:6833/295967875":"2024-09-20T09:15:20.608982+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:15:24.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.925+0000 7f1e57d86640 1 -- 172.21.15.18:0/3348508577 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1e3c06c2b0 msgr2=0x7f1e3c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:24.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.925+0000 7f1e57d86640 1 --2- 172.21.15.18:0/3348508577 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1e3c06c2b0 0x7f1e3c06e770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1e500d2500 tx=0x7f1e44009040 comp rx=0 tx=0).stop 2024-09-19T09:15:24.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.925+0000 7f1e57d86640 1 -- 172.21.15.18:0/3348508577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e500b9510 msgr2=0x7f1e500cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:24.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.925+0000 7f1e57d86640 1 --2- 172.21.15.18:0/3348508577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e500b9510 0x7f1e500cdcd0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1e4000cd00 tx=0x7f1e4000a5c0 comp rx=0 tx=0).stop 2024-09-19T09:15:24.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.926+0000 7f1e57d86640 1 -- 172.21.15.18:0/3348508577 shutdown_connections 2024-09-19T09:15:24.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.926+0000 7f1e57d86640 1 --2- 172.21.15.18:0/3348508577 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1e3c06c2b0 0x7f1e3c06e770 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:24.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.926+0000 7f1e57d86640 1 --2- 172.21.15.18:0/3348508577 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1e5015ef50 0x7f1e50155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:24.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.926+0000 7f1e57d86640 1 --2- 172.21.15.18:0/3348508577 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1e500d3240 0x7f1e501f85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:24.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.926+0000 7f1e57d86640 1 --2- 172.21.15.18:0/3348508577 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1e500b9510 0x7f1e500cdcd0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:24.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.926+0000 7f1e57d86640 1 -- 172.21.15.18:0/3348508577 >> 172.21.15.18:0/3348508577 conn(0x7f1e500d4c60 msgr2=0x7f1e500b6c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:24.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.926+0000 7f1e57d86640 1 -- 172.21.15.18:0/3348508577 shutdown_connections 2024-09-19T09:15:24.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:24.926+0000 7f1e57d86640 1 -- 172.21.15.18:0/3348508577 wait complete. 2024-09-19T09:15:24.938 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T09:13:17.564717+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '57', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T09:15:24.938 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T09:15:25.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.042+0000 7f2fea3e8640 1 Processor -- start 2024-09-19T09:15:25.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.042+0000 7f2fea3e8640 1 -- start start 2024-09-19T09:15:25.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.043+0000 7f2fea3e8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fe406deb0 0x7f2fe40b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:25.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.043+0000 7f2fea3e8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2fe415f1a0 0x7f2fe4160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:25.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.043+0000 7f2fea3e8640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fe40b6a60 con 0x7f2fe415c670 2024-09-19T09:15:25.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.043+0000 7f2fea3e8640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f2fe40b6d40 con 0x7f2fe415f1a0 2024-09-19T09:15:25.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.043+0000 7f2fea3e8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe40b7020 con 0x7f2fe406deb0 2024-09-19T09:15:25.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.043+0000 7f2fe3fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f2fe415c670 0x7f2fe406d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43678/0 (socket says 172.21.15.18:43678) 2024-09-19T09:15:25.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.043+0000 7f2fe3fff640 1 -- 172.21.15.18:0/3654756083 learned_addr learned my addr 172.21.15.18:0/3654756083 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:15:25.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.043+0000 7f2fe8985640 1 --2- 172.21.15.18:0/3654756083 >> v2:172.21.15.18:3300/0 conn(0x7f2fe415f1a0 0x7f2fe4160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:25.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.043+0000 7f2fe37fe640 1 --2- 172.21.15.18:0/3654756083 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fe406deb0 0x7f2fe40b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:25.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.044+0000 7f2fe2ffd640 1 -- 172.21.15.18:0/3654756083 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4292690353 0 0) 0x7f2fe40b6a60 con 0x7f2fe415c670 2024-09-19T09:15:25.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.044+0000 7f2fe2ffd640 1 -- 172.21.15.18:0/3654756083 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fcc003520 con 0x7f2fe415c670 2024-09-19T09:15:25.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.044+0000 7f2fe8985640 1 -- 172.21.15.18:0/3654756083 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fe406deb0 msgr2=0x7f2fe40b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:25.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.044+0000 7f2fe8985640 1 --2- 172.21.15.18:0/3654756083 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fe406deb0 0x7f2fe40b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:25.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.044+0000 7f2fe8985640 1 -- 172.21.15.18:0/3654756083 >> v1:172.21.15.18:6789/0 conn(0x7f2fe415c670 legacy=0x7f2fe406d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:25.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.044+0000 7f2fe8985640 1 -- 172.21.15.18:0/3654756083 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe40b7300 con 0x7f2fe415f1a0 2024-09-19T09:15:25.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.044+0000 7f2fe8985640 1 --2- 172.21.15.18:0/3654756083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fe415f1a0 0x7f2fe4160300 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc009d90 tx=0x7f2fdc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=714a30bfb665d24e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:25.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.044+0000 7f2fe2ffd640 1 -- 172.21.15.18:0/3654756083 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc007740 con 0x7f2fe415f1a0 2024-09-19T09:15:25.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.045+0000 7f2fe2ffd640 1 -- 172.21.15.18:0/3654756083 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fdc0078e0 con 0x7f2fe415f1a0 2024-09-19T09:15:25.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.045+0000 7f2fe2ffd640 1 -- 172.21.15.18:0/3654756083 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fdc007cb0 con 0x7f2fe415f1a0 2024-09-19T09:15:25.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.045+0000 7f2fea3e8640 1 -- 172.21.15.18:0/3654756083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fe415f1a0 msgr2=0x7f2fe4160300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:25.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.045+0000 7f2fea3e8640 1 --2- 172.21.15.18:0/3654756083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fe415f1a0 0x7f2fe4160300 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc009d90 tx=0x7f2fdc02a660 comp rx=0 tx=0).stop 2024-09-19T09:15:25.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.045+0000 7f2fea3e8640 1 -- 172.21.15.18:0/3654756083 shutdown_connections 2024-09-19T09:15:25.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.045+0000 7f2fea3e8640 1 --2- 172.21.15.18:0/3654756083 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fe415f1a0 0x7f2fe4160300 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:25.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.045+0000 7f2fea3e8640 1 --2- 172.21.15.18:0/3654756083 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fe406deb0 0x7f2fe40b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:25.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.045+0000 7f2fea3e8640 1 -- 172.21.15.18:0/3654756083 >> 172.21.15.18:0/3654756083 conn(0x7f2fe409b9d0 msgr2=0x7f2fe409bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:25.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.045+0000 7f2fea3e8640 1 -- 172.21.15.18:0/3654756083 shutdown_connections 2024-09-19T09:15:25.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.045+0000 7f2fea3e8640 1 -- 172.21.15.18:0/3654756083 wait complete. 2024-09-19T09:15:25.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.046+0000 7f2fea3e8640 1 Processor -- start 2024-09-19T09:15:25.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.047+0000 7f2fea3e8640 1 -- start start 2024-09-19T09:15:25.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.047+0000 7f2fea3e8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fe406deb0 0x7f2fe41f8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:25.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.047+0000 7f2fea3e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fe415c670 0x7f2fe4162e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:25.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.047+0000 7f2fea3e8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fe415f1a0 0x7f2fe40a0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:25.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.047+0000 7f2fea3e8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe40b7b00 con 0x7f2fe415c670 2024-09-19T09:15:25.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.047+0000 7f2fea3e8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe409c560 con 0x7f2fe415f1a0 2024-09-19T09:15:25.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.047+0000 7f2fea3e8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2fe4158220 con 0x7f2fe406deb0 2024-09-19T09:15:25.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.047+0000 7f2fe37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fe415c670 0x7f2fe4162e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:25.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.047+0000 7f2fe37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fe415c670 0x7f2fe4162e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:57922/0 (socket says 172.21.15.18:57922) 2024-09-19T09:15:25.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.047+0000 7f2fe37fe640 1 -- 172.21.15.18:0/3487860679 learned_addr learned my addr 172.21.15.18:0/3487860679 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:25.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.047+0000 7f2fe8985640 1 --2- 172.21.15.18:0/3487860679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fe415f1a0 0x7f2fe40a0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:25.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.047+0000 7f2fe3fff640 1 --2- 172.21.15.18:0/3487860679 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fe406deb0 0x7f2fe41f8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:25.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.048+0000 7f2fe37fe640 1 -- 172.21.15.18:0/3487860679 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fe406deb0 msgr2=0x7f2fe41f8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:25.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.048+0000 7f2fe37fe640 1 --2- 172.21.15.18:0/3487860679 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fe406deb0 0x7f2fe41f8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:25.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.048+0000 7f2fe37fe640 1 -- 172.21.15.18:0/3487860679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fe415f1a0 msgr2=0x7f2fe40a0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:25.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.048+0000 7f2fe37fe640 1 --2- 172.21.15.18:0/3487860679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fe415f1a0 0x7f2fe40a0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:25.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.048+0000 7f2fe37fe640 1 -- 172.21.15.18:0/3487860679 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe4158500 con 0x7f2fe415c670 2024-09-19T09:15:25.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.048+0000 7f2fe8985640 1 --2- 172.21.15.18:0/3487860679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fe415f1a0 0x7f2fe40a0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:25.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.048+0000 7f2fe37fe640 1 --2- 172.21.15.18:0/3487860679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fe415c670 0x7f2fe4162e60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2fd800e870 tx=0x7f2fd800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:25.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.048+0000 7f2fe0ff9640 1 -- 172.21.15.18:0/3487860679 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd8017070 con 0x7f2fe415c670 2024-09-19T09:15:25.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.048+0000 7f2fe0ff9640 1 -- 172.21.15.18:0/3487860679 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd800c940 con 0x7f2fe415c670 2024-09-19T09:15:25.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.048+0000 7f2fea3e8640 1 -- 172.21.15.18:0/3487860679 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe41f7b70 con 0x7f2fe415c670 2024-09-19T09:15:25.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.048+0000 7f2fe0ff9640 1 -- 172.21.15.18:0/3487860679 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd800cd30 con 0x7f2fe415c670 2024-09-19T09:15:25.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.048+0000 7f2fea3e8640 1 -- 172.21.15.18:0/3487860679 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe4157e40 con 0x7f2fe415c670 2024-09-19T09:15:25.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.049+0000 7f2fea3e8640 1 -- 172.21.15.18:0/3487860679 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fe415ca50 con 0x7f2fe415c670 2024-09-19T09:15:25.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.050+0000 7f2fe0ff9640 1 -- 172.21.15.18:0/3487860679 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2fd801a070 con 0x7f2fe415c670 2024-09-19T09:15:25.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.050+0000 7f2fe0ff9640 1 --2- 172.21.15.18:0/3487860679 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2fd006c2b0 0x7f2fd006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:25.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.050+0000 7f2fe0ff9640 1 -- 172.21.15.18:0/3487860679 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 4943+0+0 (secure 0 0 0) 0x7f2fd808b310 con 0x7f2fe415c670 2024-09-19T09:15:25.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.050+0000 7f2fe3fff640 1 --2- 172.21.15.18:0/3487860679 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2fd006c2b0 0x7f2fd006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:25.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.051+0000 7f2fe3fff640 1 --2- 172.21.15.18:0/3487860679 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2fd006c2b0 0x7f2fd006e770 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4005880 tx=0x7f2fd4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:25.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.054+0000 7f2fe0ff9640 1 -- 172.21.15.18:0/3487860679 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2fd8059e10 con 0x7f2fe415c670 2024-09-19T09:15:25.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.228+0000 7f2fea3e8640 1 -- 172.21.15.18:0/3487860679 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2fe40d3220 con 0x7f2fe415c670 2024-09-19T09:15:25.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.228+0000 7f2fe0ff9640 1 -- 172.21.15.18:0/3487860679 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v62) ==== 93+0+10 (secure 0 0 0) 0x7f2fd8059710 con 0x7f2fe415c670 2024-09-19T09:15:25.230 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-09-19T09:15:25.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.230+0000 7f2fea3e8640 1 -- 172.21.15.18:0/3487860679 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2fd006c2b0 msgr2=0x7f2fd006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:25.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.230+0000 7f2fea3e8640 1 --2- 172.21.15.18:0/3487860679 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2fd006c2b0 0x7f2fd006e770 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4005880 tx=0x7f2fd4009040 comp rx=0 tx=0).stop 2024-09-19T09:15:25.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.230+0000 7f2fea3e8640 1 -- 172.21.15.18:0/3487860679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fe415c670 msgr2=0x7f2fe4162e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:25.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.230+0000 7f2fea3e8640 1 --2- 172.21.15.18:0/3487860679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fe415c670 0x7f2fe4162e60 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f2fd800e870 tx=0x7f2fd800ed30 comp rx=0 tx=0).stop 2024-09-19T09:15:25.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.230+0000 7f2fea3e8640 1 -- 172.21.15.18:0/3487860679 shutdown_connections 2024-09-19T09:15:25.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.230+0000 7f2fea3e8640 1 --2- 172.21.15.18:0/3487860679 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2fd006c2b0 0x7f2fd006e770 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:25.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.230+0000 7f2fea3e8640 1 --2- 172.21.15.18:0/3487860679 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fe415f1a0 0x7f2fe40a0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:25.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.230+0000 7f2fea3e8640 1 --2- 172.21.15.18:0/3487860679 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2fe415c670 0x7f2fe4162e60 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:25.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.230+0000 7f2fea3e8640 1 --2- 172.21.15.18:0/3487860679 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2fe406deb0 0x7f2fe41f8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:25.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.230+0000 7f2fea3e8640 1 -- 172.21.15.18:0/3487860679 >> 172.21.15.18:0/3487860679 conn(0x7f2fe409b9d0 msgr2=0x7f2fe415cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:25.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.230+0000 7f2fea3e8640 1 -- 172.21.15.18:0/3487860679 shutdown_connections 2024-09-19T09:15:25.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.230+0000 7f2fea3e8640 1 -- 172.21.15.18:0/3487860679 wait complete. 2024-09-19T09:15:25.243 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2024-09-19T09:15:25.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.344+0000 7efcdf2dd640 1 Processor -- start 2024-09-19T09:15:25.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.344+0000 7efcdf2dd640 1 -- start start 2024-09-19T09:15:25.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.345+0000 7efcdf2dd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efcd815ef80 0x7efcd80b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:25.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.345+0000 7efcdf2dd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7efcd806d730 0x7efcd80cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:25.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.345+0000 7efcdf2dd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7efcd80cf910 0x7efcd80d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:25.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.345+0000 7efcdf2dd640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7efcd80cd7d0 con 0x7efcd806d730 2024-09-19T09:15:25.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.345+0000 7efcdf2dd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7efcd80cd1a0 con 0x7efcd80cf910 2024-09-19T09:15:25.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.345+0000 7efcdf2dd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efcd806dc30 con 0x7efcd815ef80 2024-09-19T09:15:25.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.345+0000 7efcdc878640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7efcd806d730 0x7efcd80cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:25.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.345+0000 7efcdc878640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7efcd806d730 0x7efcd80cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52512/0 (socket says 172.21.15.18:52512) 2024-09-19T09:15:25.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.345+0000 7efcdc878640 1 -- 172.21.15.18:0/3478553692 learned_addr learned my addr 172.21.15.18:0/3478553692 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:25.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.345+0000 7efcdd87a640 1 --2- 172.21.15.18:0/3478553692 >> v2:172.21.15.162:3300/0 conn(0x7efcd80cf910 0x7efcd80d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:25.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.345+0000 7efcdd079640 1 --2- 172.21.15.18:0/3478553692 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efcd815ef80 0x7efcd80b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:25.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.345+0000 7efcdc878640 1 -- 172.21.15.18:0/3478553692 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efcd815ef80 msgr2=0x7efcd80b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:25.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.345+0000 7efcdc878640 1 --2- 172.21.15.18:0/3478553692 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efcd815ef80 0x7efcd80b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:25.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.345+0000 7efcdc878640 1 -- 172.21.15.18:0/3478553692 >> v2:172.21.15.162:3300/0 conn(0x7efcd80cf910 msgr2=0x7efcd80d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:25.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.345+0000 7efcdc878640 1 --2- 172.21.15.18:0/3478553692 >> v2:172.21.15.162:3300/0 conn(0x7efcd80cf910 0x7efcd80d0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:25.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.345+0000 7efcdc878640 1 -- 172.21.15.18:0/3478553692 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd806df10 con 0x7efcd806d730 2024-09-19T09:15:25.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.346+0000 7efcdc878640 1 --2- 172.21.15.18:0/3478553692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcd806d730 0x7efcd80cf3d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7efcd80727a0 tx=0x7efcc802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84be5f39c9edd1e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:25.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.346+0000 7efccffff640 1 -- 172.21.15.18:0/3478553692 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc8037070 con 0x7efcd806d730 2024-09-19T09:15:25.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.346+0000 7efccffff640 1 -- 172.21.15.18:0/3478553692 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcc8032440 con 0x7efcd806d730 2024-09-19T09:15:25.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.346+0000 7efccffff640 1 -- 172.21.15.18:0/3478553692 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc8032810 con 0x7efcd806d730 2024-09-19T09:15:25.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.347+0000 7efcdf2dd640 1 -- 172.21.15.18:0/3478553692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcd806d730 msgr2=0x7efcd80cf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:25.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.347+0000 7efcdf2dd640 1 --2- 172.21.15.18:0/3478553692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcd806d730 0x7efcd80cf3d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7efcd80727a0 tx=0x7efcc802a1e0 comp rx=0 tx=0).stop 2024-09-19T09:15:25.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.347+0000 7efcdf2dd640 1 -- 172.21.15.18:0/3478553692 shutdown_connections 2024-09-19T09:15:25.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.347+0000 7efcdf2dd640 1 --2- 172.21.15.18:0/3478553692 >> v2:172.21.15.162:3300/0 conn(0x7efcd80cf910 0x7efcd80d0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:25.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.347+0000 7efcdf2dd640 1 --2- 172.21.15.18:0/3478553692 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcd806d730 0x7efcd80cf3d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:25.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.347+0000 7efcdf2dd640 1 --2- 172.21.15.18:0/3478553692 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efcd815ef80 0x7efcd80b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:25.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.347+0000 7efcdf2dd640 1 -- 172.21.15.18:0/3478553692 >> 172.21.15.18:0/3478553692 conn(0x7efcd80b4700 msgr2=0x7efcd80b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:25.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.347+0000 7efcdf2dd640 1 -- 172.21.15.18:0/3478553692 shutdown_connections 2024-09-19T09:15:25.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.347+0000 7efcdf2dd640 1 -- 172.21.15.18:0/3478553692 wait complete. 2024-09-19T09:15:25.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.348+0000 7efcdf2dd640 1 Processor -- start 2024-09-19T09:15:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.348+0000 7efcdf2dd640 1 -- start start 2024-09-19T09:15:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.349+0000 7efcdf2dd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efcd806d730 0x7efcd8155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.349+0000 7efcdf2dd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcd80cf910 0x7efcd80c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.349+0000 7efcdf2dd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efcd815ef80 0x7efcd80cc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.349+0000 7efcdf2dd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7efcd80d0120 con 0x7efcd80cf910 2024-09-19T09:15:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.349+0000 7efcdf2dd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efcd815f360 con 0x7efcd815ef80 2024-09-19T09:15:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.349+0000 7efcdf2dd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7efcd80d1220 con 0x7efcd806d730 2024-09-19T09:15:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.349+0000 7efcdc878640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcd80cf910 0x7efcd80c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.349+0000 7efcdc878640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcd80cf910 0x7efcd80c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52528/0 (socket says 172.21.15.18:52528) 2024-09-19T09:15:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.349+0000 7efcdc878640 1 -- 172.21.15.18:0/1991028997 learned_addr learned my addr 172.21.15.18:0/1991028997 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.349+0000 7efcdd079640 1 --2- 172.21.15.18:0/1991028997 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efcd806d730 0x7efcd8155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:25.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.349+0000 7efcdd87a640 1 --2- 172.21.15.18:0/1991028997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efcd815ef80 0x7efcd80cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.349+0000 7efcdc878640 1 -- 172.21.15.18:0/1991028997 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efcd806d730 msgr2=0x7efcd8155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.349+0000 7efcdc878640 1 --2- 172.21.15.18:0/1991028997 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efcd806d730 0x7efcd8155080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.349+0000 7efcdc878640 1 -- 172.21.15.18:0/1991028997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efcd815ef80 msgr2=0x7efcd80cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.349+0000 7efcdc878640 1 --2- 172.21.15.18:0/1991028997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efcd815ef80 0x7efcd80cc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.349+0000 7efcdc878640 1 -- 172.21.15.18:0/1991028997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd80ca6e0 con 0x7efcd80cf910 2024-09-19T09:15:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.350+0000 7efcdc878640 1 --2- 172.21.15.18:0/1991028997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcd80cf910 0x7efcd80c9c20 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7efcc802a220 tx=0x7efcc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.350+0000 7efccdffb640 1 -- 172.21.15.18:0/1991028997 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc8041020 con 0x7efcd80cf910 2024-09-19T09:15:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.350+0000 7efccdffb640 1 -- 172.21.15.18:0/1991028997 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcc803d620 con 0x7efcd80cf910 2024-09-19T09:15:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.350+0000 7efccdffb640 1 -- 172.21.15.18:0/1991028997 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc8037040 con 0x7efcd80cf910 2024-09-19T09:15:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.350+0000 7efcdf2dd640 1 -- 172.21.15.18:0/1991028997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcd80ca9c0 con 0x7efcd80cf910 2024-09-19T09:15:25.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.350+0000 7efcdf2dd640 1 -- 172.21.15.18:0/1991028997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcd80caf80 con 0x7efcd80cf910 2024-09-19T09:15:25.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.351+0000 7efcdf2dd640 1 -- 172.21.15.18:0/1991028997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcd80d0ce0 con 0x7efcd80cf910 2024-09-19T09:15:25.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.351+0000 7efccdffb640 1 -- 172.21.15.18:0/1991028997 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7efcc8044020 con 0x7efcd80cf910 2024-09-19T09:15:25.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.352+0000 7efccdffb640 1 --2- 172.21.15.18:0/1991028997 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7efcbc06c2b0 0x7efcbc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:25.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.352+0000 7efccdffb640 1 -- 172.21.15.18:0/1991028997 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 4943+0+0 (secure 0 0 0) 0x7efcc80ab710 con 0x7efcd80cf910 2024-09-19T09:15:25.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.352+0000 7efcdd079640 1 --2- 172.21.15.18:0/1991028997 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7efcbc06c2b0 0x7efcbc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:25.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.353+0000 7efcdd079640 1 --2- 172.21.15.18:0/1991028997 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7efcbc06c2b0 0x7efcbc06e770 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efcd80c8f90 tx=0x7efcd4009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:25.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.356+0000 7efccdffb640 1 -- 172.21.15.18:0/1991028997 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7efcc804b030 con 0x7efcd80cf910 2024-09-19T09:15:25.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.603+0000 7efcdf2dd640 1 -- 172.21.15.18:0/1991028997 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) -- 0x7efcd80cff00 con 0x7efcd80cf910 2024-09-19T09:15:25.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.620+0000 7efccdffb640 1 -- 172.21.15.18:0/1991028997 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v126) ==== 137+0+0 (secure 0 0 0) 0x7efcc807a180 con 0x7efcd80cf910 2024-09-19T09:15:25.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.622+0000 7efcdf2dd640 1 -- 172.21.15.18:0/1991028997 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7efcbc06c2b0 msgr2=0x7efcbc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:25.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.622+0000 7efcdf2dd640 1 --2- 172.21.15.18:0/1991028997 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7efcbc06c2b0 0x7efcbc06e770 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efcd80c8f90 tx=0x7efcd4009190 comp rx=0 tx=0).stop 2024-09-19T09:15:25.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.622+0000 7efcdf2dd640 1 -- 172.21.15.18:0/1991028997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcd80cf910 msgr2=0x7efcd80c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:25.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.622+0000 7efcdf2dd640 1 --2- 172.21.15.18:0/1991028997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcd80cf910 0x7efcd80c9c20 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7efcc802a220 tx=0x7efcc80046c0 comp rx=0 tx=0).stop 2024-09-19T09:15:25.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.622+0000 7efcdf2dd640 1 -- 172.21.15.18:0/1991028997 shutdown_connections 2024-09-19T09:15:25.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.622+0000 7efcdf2dd640 1 --2- 172.21.15.18:0/1991028997 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7efcbc06c2b0 0x7efcbc06e770 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:25.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.622+0000 7efcdf2dd640 1 --2- 172.21.15.18:0/1991028997 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efcd815ef80 0x7efcd80cc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:25.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.622+0000 7efcdf2dd640 1 --2- 172.21.15.18:0/1991028997 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7efcd80cf910 0x7efcd80c9c20 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:25.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.622+0000 7efcdf2dd640 1 --2- 172.21.15.18:0/1991028997 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7efcd806d730 0x7efcd8155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:25.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.622+0000 7efcdf2dd640 1 -- 172.21.15.18:0/1991028997 >> 172.21.15.18:0/1991028997 conn(0x7efcd80b4700 msgr2=0x7efcd80d2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:25.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.622+0000 7efcdf2dd640 1 -- 172.21.15.18:0/1991028997 shutdown_connections 2024-09-19T09:15:25.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.622+0000 7efcdf2dd640 1 -- 172.21.15.18:0/1991028997 wait complete. 2024-09-19T09:15:25.635 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2024-09-19T09:15:25.749 INFO:teuthology.orchestra.run.smithi018.stdout:{"osd_objectstore":"memstore"} 2024-09-19T09:15:25.749 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2024-09-19T09:15:25.750 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-19T09:15:25.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.854+0000 7f3a79494640 1 Processor -- start 2024-09-19T09:15:25.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.854+0000 7f3a79494640 1 -- start start 2024-09-19T09:15:25.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.855+0000 7f3a79494640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a7406e280 0x7f3a74073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:25.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.855+0000 7f3a79494640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3a740d1010 0x7f3a740ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:25.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.855+0000 7f3a79494640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a740722d0 con 0x7f3a74071df0 2024-09-19T09:15:25.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.855+0000 7f3a79494640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f3a740738b0 con 0x7f3a740d1010 2024-09-19T09:15:25.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.855+0000 7f3a79494640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3a740725b0 con 0x7f3a7406e280 2024-09-19T09:15:25.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.855+0000 7f3a737fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3a740d1010 0x7f3a740ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:25.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.855+0000 7f3a6bfff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3a74071df0 0x7f3a7406e660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57094/0 (socket says 172.21.15.18:57094) 2024-09-19T09:15:25.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.855+0000 7f3a6bfff640 1 -- 172.21.15.18:0/3082972126 learned_addr learned my addr 172.21.15.18:0/3082972126 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:15:25.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.855+0000 7f3a737fe640 1 -- 172.21.15.18:0/3082972126 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a7406e280 msgr2=0x7f3a74073370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:25.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.855+0000 7f3a72ffd640 1 --2- 172.21.15.18:0/3082972126 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a7406e280 0x7f3a74073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:25.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.855+0000 7f3a737fe640 1 --2- 172.21.15.18:0/3082972126 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a7406e280 0x7f3a74073370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:25.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.855+0000 7f3a737fe640 1 -- 172.21.15.18:0/3082972126 >> v1:172.21.15.18:6789/0 conn(0x7f3a74071df0 legacy=0x7f3a7406e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:25.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.855+0000 7f3a727fc640 1 -- 172.21.15.18:0/3082972126 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2314125384 0 0) 0x7f3a740722d0 con 0x7f3a74071df0 2024-09-19T09:15:25.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.855+0000 7f3a737fe640 1 -- 172.21.15.18:0/3082972126 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a74072890 con 0x7f3a740d1010 2024-09-19T09:15:25.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.855+0000 7f3a72ffd640 1 --2- 172.21.15.18:0/3082972126 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a7406e280 0x7f3a74073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:15:25.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.856+0000 7f3a737fe640 1 --2- 172.21.15.18:0/3082972126 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a740d1010 0x7f3a740ce3d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c009d90 tx=0x7f3a6c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a3a060525f2b39 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:25.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.856+0000 7f3a727fc640 1 -- 172.21.15.18:0/3082972126 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c007740 con 0x7f3a740d1010 2024-09-19T09:15:25.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.856+0000 7f3a727fc640 1 -- 172.21.15.18:0/3082972126 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a6c0078e0 con 0x7f3a740d1010 2024-09-19T09:15:25.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.856+0000 7f3a727fc640 1 -- 172.21.15.18:0/3082972126 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c007cb0 con 0x7f3a740d1010 2024-09-19T09:15:25.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.857+0000 7f3a79494640 1 -- 172.21.15.18:0/3082972126 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a740d1010 msgr2=0x7f3a740ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:25.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.857+0000 7f3a79494640 1 --2- 172.21.15.18:0/3082972126 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a740d1010 0x7f3a740ce3d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c009d90 tx=0x7f3a6c02a680 comp rx=0 tx=0).stop 2024-09-19T09:15:25.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.857+0000 7f3a79494640 1 -- 172.21.15.18:0/3082972126 shutdown_connections 2024-09-19T09:15:25.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.857+0000 7f3a79494640 1 --2- 172.21.15.18:0/3082972126 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a740d1010 0x7f3a740ce3d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:25.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.857+0000 7f3a79494640 1 --2- 172.21.15.18:0/3082972126 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a7406e280 0x7f3a74073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:25.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.857+0000 7f3a79494640 1 -- 172.21.15.18:0/3082972126 >> 172.21.15.18:0/3082972126 conn(0x7f3a7406bc10 msgr2=0x7f3a7406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:25.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.857+0000 7f3a79494640 1 -- 172.21.15.18:0/3082972126 shutdown_connections 2024-09-19T09:15:25.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.857+0000 7f3a79494640 1 -- 172.21.15.18:0/3082972126 wait complete. 2024-09-19T09:15:25.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.858+0000 7f3a79494640 1 Processor -- start 2024-09-19T09:15:25.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.858+0000 7f3a79494640 1 -- start start 2024-09-19T09:15:25.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.859+0000 7f3a79494640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a7406e280 0x7f3a740b3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:25.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.859+0000 7f3a79494640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a74071df0 0x7f3a74150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:25.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.859+0000 7f3a79494640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a740d1010 0x7f3a74153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:25.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.859+0000 7f3a79494640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3a7415db60 con 0x7f3a74071df0 2024-09-19T09:15:25.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.859+0000 7f3a79494640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3a74072e50 con 0x7f3a740d1010 2024-09-19T09:15:25.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.859+0000 7f3a79494640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3a740d14c0 con 0x7f3a7406e280 2024-09-19T09:15:25.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.859+0000 7f3a6bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a74071df0 0x7f3a74150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:25.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.859+0000 7f3a6bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a74071df0 0x7f3a74150180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52560/0 (socket says 172.21.15.18:52560) 2024-09-19T09:15:25.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.859+0000 7f3a6bfff640 1 -- 172.21.15.18:0/13018186 learned_addr learned my addr 172.21.15.18:0/13018186 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:25.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.859+0000 7f3a72ffd640 1 --2- 172.21.15.18:0/13018186 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a7406e280 0x7f3a740b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:25.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.859+0000 7f3a737fe640 1 --2- 172.21.15.18:0/13018186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a740d1010 0x7f3a74153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:25.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.859+0000 7f3a6bfff640 1 -- 172.21.15.18:0/13018186 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a7406e280 msgr2=0x7f3a740b3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:25.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.859+0000 7f3a6bfff640 1 --2- 172.21.15.18:0/13018186 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a7406e280 0x7f3a740b3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:25.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.859+0000 7f3a6bfff640 1 -- 172.21.15.18:0/13018186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a740d1010 msgr2=0x7f3a74153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:25.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.859+0000 7f3a6bfff640 1 --2- 172.21.15.18:0/13018186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a740d1010 0x7f3a74153030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:25.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.859+0000 7f3a6bfff640 1 -- 172.21.15.18:0/13018186 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a740cae50 con 0x7f3a74071df0 2024-09-19T09:15:25.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.859+0000 7f3a737fe640 1 --2- 172.21.15.18:0/13018186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a740d1010 0x7f3a74153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:15:25.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.859+0000 7f3a6bfff640 1 --2- 172.21.15.18:0/13018186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a74071df0 0x7f3a74150180 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00c480 tx=0x7f3a5c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:25.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.859+0000 7f3a6b7fe640 1 -- 172.21.15.18:0/13018186 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c018070 con 0x7f3a74071df0 2024-09-19T09:15:25.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.860+0000 7f3a6b7fe640 1 -- 172.21.15.18:0/13018186 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a5c0074e0 con 0x7f3a74071df0 2024-09-19T09:15:25.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.860+0000 7f3a79494640 1 -- 172.21.15.18:0/13018186 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a74153910 con 0x7f3a74071df0 2024-09-19T09:15:25.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.860+0000 7f3a6b7fe640 1 -- 172.21.15.18:0/13018186 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c007690 con 0x7f3a74071df0 2024-09-19T09:15:25.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.860+0000 7f3a79494640 1 -- 172.21.15.18:0/13018186 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a740cb0f0 con 0x7f3a74071df0 2024-09-19T09:15:25.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.861+0000 7f3a79494640 1 -- 172.21.15.18:0/13018186 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a74073370 con 0x7f3a74071df0 2024-09-19T09:15:25.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.861+0000 7f3a6b7fe640 1 -- 172.21.15.18:0/13018186 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3a5c01b070 con 0x7f3a74071df0 2024-09-19T09:15:25.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.861+0000 7f3a6b7fe640 1 --2- 172.21.15.18:0/13018186 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3a5406c2e0 0x7f3a5406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:25.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.862+0000 7f3a6b7fe640 1 -- 172.21.15.18:0/13018186 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 4943+0+0 (secure 0 0 0) 0x7f3a5c08a4d0 con 0x7f3a74071df0 2024-09-19T09:15:25.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.862+0000 7f3a72ffd640 1 --2- 172.21.15.18:0/13018186 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3a5406c2e0 0x7f3a5406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:25.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.862+0000 7f3a72ffd640 1 --2- 172.21.15.18:0/13018186 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3a5406c2e0 0x7f3a5406e7a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3a6400a990 tx=0x7f3a64008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:25.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:25.866+0000 7f3a6b7fe640 1 -- 172.21.15.18:0/13018186 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3a5c058fd0 con 0x7f3a74071df0 2024-09-19T09:15:26.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.045+0000 7f3a79494640 1 -- 172.21.15.18:0/13018186 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f3a740cf990 con 0x7f3a74071df0 2024-09-19T09:15:26.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.048+0000 7f3a6b7fe640 1 -- 172.21.15.18:0/13018186 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7f3a5c0588d0 con 0x7f3a74071df0 2024-09-19T09:15:26.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.051+0000 7f3a79494640 1 -- 172.21.15.18:0/13018186 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3a5406c2e0 msgr2=0x7f3a5406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:26.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.051+0000 7f3a79494640 1 --2- 172.21.15.18:0/13018186 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3a5406c2e0 0x7f3a5406e7a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3a6400a990 tx=0x7f3a64008040 comp rx=0 tx=0).stop 2024-09-19T09:15:26.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.051+0000 7f3a79494640 1 -- 172.21.15.18:0/13018186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a74071df0 msgr2=0x7f3a74150180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:26.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.051+0000 7f3a79494640 1 --2- 172.21.15.18:0/13018186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a74071df0 0x7f3a74150180 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00c480 tx=0x7f3a5c00c940 comp rx=0 tx=0).stop 2024-09-19T09:15:26.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.051+0000 7f3a79494640 1 -- 172.21.15.18:0/13018186 shutdown_connections 2024-09-19T09:15:26.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.051+0000 7f3a79494640 1 --2- 172.21.15.18:0/13018186 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3a5406c2e0 0x7f3a5406e7a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:26.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.051+0000 7f3a79494640 1 --2- 172.21.15.18:0/13018186 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a740d1010 0x7f3a74153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:26.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.051+0000 7f3a79494640 1 --2- 172.21.15.18:0/13018186 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a74071df0 0x7f3a74150180 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:26.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.051+0000 7f3a79494640 1 --2- 172.21.15.18:0/13018186 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a7406e280 0x7f3a740b3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:26.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.051+0000 7f3a79494640 1 -- 172.21.15.18:0/13018186 >> 172.21.15.18:0/13018186 conn(0x7f3a7406bc10 msgr2=0x7f3a740ce360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:26.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.051+0000 7f3a79494640 1 -- 172.21.15.18:0/13018186 shutdown_connections 2024-09-19T09:15:26.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.051+0000 7f3a79494640 1 -- 172.21.15.18:0/13018186 wait complete. 2024-09-19T09:15:26.063 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T09:15:26.063 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:15:26.103 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:15:26.155 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T09:15:26.155 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:15:26.155 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:15:26.172 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17075 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T09:15:26.172 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:15:26.172 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:15:26.190 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3252 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T09:15:26.190 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:15:26.191 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:15:26.228 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17075 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T09:15:26.228 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:15:26.228 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:15:26.248 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3252 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T09:15:26.248 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-19T09:15:26.248 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:15:26.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.369+0000 7f30b9781640 1 Processor -- start 2024-09-19T09:15:26.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.369+0000 7f30b9781640 1 -- start start 2024-09-19T09:15:26.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.369+0000 7f30b9781640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f30b415ef80 0x7f30b40b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:26.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.370+0000 7f30b9781640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30b406d730 0x7f30b40cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:26.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.370+0000 7f30b9781640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30b40cd1a0 con 0x7f30b40cf910 2024-09-19T09:15:26.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.370+0000 7f30b9781640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f30b40cd7d0 con 0x7f30b415ef80 2024-09-19T09:15:26.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.370+0000 7f30b9781640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f30b406dc30 con 0x7f30b406d730 2024-09-19T09:15:26.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.370+0000 7f30b2ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f30b415ef80 0x7f30b40b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:26.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.370+0000 7f30b37fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f30b40cf910 0x7f30b40d0ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57110/0 (socket says 172.21.15.18:57110) 2024-09-19T09:15:26.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.370+0000 7f30b37fe640 1 -- 172.21.15.18:0/2075989348 learned_addr learned my addr 172.21.15.18:0/2075989348 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:15:26.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.370+0000 7f30b27fc640 1 --2- 172.21.15.18:0/2075989348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30b406d730 0x7f30b40cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:26.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.370+0000 7f30b2ffd640 1 -- 172.21.15.18:0/2075989348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30b406d730 msgr2=0x7f30b40cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:26.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.370+0000 7f30b2ffd640 1 --2- 172.21.15.18:0/2075989348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30b406d730 0x7f30b40cf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:26.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.370+0000 7f30b2ffd640 1 -- 172.21.15.18:0/2075989348 >> v1:172.21.15.18:6789/0 conn(0x7f30b40cf910 legacy=0x7f30b40d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:26.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.370+0000 7f30b2ffd640 1 -- 172.21.15.18:0/2075989348 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b406df10 con 0x7f30b415ef80 2024-09-19T09:15:26.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.370+0000 7f30b1ffb640 1 -- 172.21.15.18:0/2075989348 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3770424780 0 0) 0x7f30b40cd1a0 con 0x7f30b40cf910 2024-09-19T09:15:26.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.371+0000 7f30b2ffd640 1 --2- 172.21.15.18:0/2075989348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30b415ef80 0x7f30b40b5220 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f30a40097a0 tx=0x7f30a402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf6f73735e4e4b71 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:26.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.371+0000 7f30b1ffb640 1 -- 172.21.15.18:0/2075989348 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4037070 con 0x7f30b415ef80 2024-09-19T09:15:26.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.371+0000 7f30b1ffb640 1 -- 172.21.15.18:0/2075989348 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a4032440 con 0x7f30b415ef80 2024-09-19T09:15:26.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.371+0000 7f30b1ffb640 1 -- 172.21.15.18:0/2075989348 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a4032810 con 0x7f30b415ef80 2024-09-19T09:15:26.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.371+0000 7f30b9781640 1 -- 172.21.15.18:0/2075989348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30b415ef80 msgr2=0x7f30b40b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:26.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.371+0000 7f30b9781640 1 --2- 172.21.15.18:0/2075989348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30b415ef80 0x7f30b40b5220 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f30a40097a0 tx=0x7f30a402a180 comp rx=0 tx=0).stop 2024-09-19T09:15:26.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.371+0000 7f30b9781640 1 -- 172.21.15.18:0/2075989348 shutdown_connections 2024-09-19T09:15:26.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.371+0000 7f30b9781640 1 --2- 172.21.15.18:0/2075989348 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30b406d730 0x7f30b40cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:26.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.371+0000 7f30b9781640 1 --2- 172.21.15.18:0/2075989348 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30b415ef80 0x7f30b40b5220 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:26.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.371+0000 7f30b9781640 1 -- 172.21.15.18:0/2075989348 >> 172.21.15.18:0/2075989348 conn(0x7f30b40b4700 msgr2=0x7f30b40b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:26.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.371+0000 7f30b9781640 1 -- 172.21.15.18:0/2075989348 shutdown_connections 2024-09-19T09:15:26.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.371+0000 7f30b9781640 1 -- 172.21.15.18:0/2075989348 wait complete. 2024-09-19T09:15:26.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.373+0000 7f30b9781640 1 Processor -- start 2024-09-19T09:15:26.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.373+0000 7f30b9781640 1 -- start start 2024-09-19T09:15:26.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.373+0000 7f30b9781640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30b406d730 0x7f30b415bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:26.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.373+0000 7f30b9781640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30b40cf910 0x7f30b4158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:26.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.374+0000 7f30b9781640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30b415ef80 0x7f30b40b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:26.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.374+0000 7f30b9781640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f30b40d0120 con 0x7f30b40cf910 2024-09-19T09:15:26.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.374+0000 7f30b9781640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f30b415f360 con 0x7f30b415ef80 2024-09-19T09:15:26.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.374+0000 7f30b9781640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f30b40cec70 con 0x7f30b406d730 2024-09-19T09:15:26.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.374+0000 7f30b27fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30b40cf910 0x7f30b4158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:26.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.374+0000 7f30b27fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30b40cf910 0x7f30b4158140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52576/0 (socket says 172.21.15.18:52576) 2024-09-19T09:15:26.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.374+0000 7f30b27fc640 1 -- 172.21.15.18:0/3988603878 learned_addr learned my addr 172.21.15.18:0/3988603878 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:26.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.374+0000 7f30b2ffd640 1 --2- 172.21.15.18:0/3988603878 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30b406d730 0x7f30b415bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:26.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.374+0000 7f30b37fe640 1 --2- 172.21.15.18:0/3988603878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30b415ef80 0x7f30b40b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:26.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.374+0000 7f30b27fc640 1 -- 172.21.15.18:0/3988603878 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30b406d730 msgr2=0x7f30b415bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:26.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.374+0000 7f30b27fc640 1 --2- 172.21.15.18:0/3988603878 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30b406d730 0x7f30b415bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:26.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.374+0000 7f30b27fc640 1 -- 172.21.15.18:0/3988603878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30b415ef80 msgr2=0x7f30b40b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:26.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.374+0000 7f30b27fc640 1 --2- 172.21.15.18:0/3988603878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30b415ef80 0x7f30b40b6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:26.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.374+0000 7f30b27fc640 1 -- 172.21.15.18:0/3988603878 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b40b71c0 con 0x7f30b40cf910 2024-09-19T09:15:26.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.374+0000 7f30b37fe640 1 --2- 172.21.15.18:0/3988603878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30b415ef80 0x7f30b40b6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:15:26.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.374+0000 7f30b27fc640 1 --2- 172.21.15.18:0/3988603878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30b40cf910 0x7f30b4158140 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f30a800d7d0 tx=0x7f30a800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:26.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.374+0000 7f309b7fe640 1 -- 172.21.15.18:0/3988603878 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a8004030 con 0x7f30b40cf910 2024-09-19T09:15:26.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.374+0000 7f309b7fe640 1 -- 172.21.15.18:0/3988603878 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a80041d0 con 0x7f30b40cf910 2024-09-19T09:15:26.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.374+0000 7f309b7fe640 1 -- 172.21.15.18:0/3988603878 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a800b6c0 con 0x7f30b40cf910 2024-09-19T09:15:26.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.374+0000 7f30b9781640 1 -- 172.21.15.18:0/3988603878 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b40b74a0 con 0x7f30b40cf910 2024-09-19T09:15:26.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.374+0000 7f30b9781640 1 -- 172.21.15.18:0/3988603878 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b40b7a60 con 0x7f30b40cf910 2024-09-19T09:15:26.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.375+0000 7f30b9781640 1 -- 172.21.15.18:0/3988603878 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30b40cf3d0 con 0x7f30b40cf910 2024-09-19T09:15:26.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.376+0000 7f309b7fe640 1 -- 172.21.15.18:0/3988603878 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f30a800b860 con 0x7f30b40cf910 2024-09-19T09:15:26.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.377+0000 7f309b7fe640 1 --2- 172.21.15.18:0/3988603878 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f30a006c2b0 0x7f30a006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:26.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.377+0000 7f309b7fe640 1 -- 172.21.15.18:0/3988603878 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 4943+0+0 (secure 0 0 0) 0x7f30a808b470 con 0x7f30b40cf910 2024-09-19T09:15:26.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.377+0000 7f30b2ffd640 1 --2- 172.21.15.18:0/3988603878 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f30a006c2b0 0x7f30a006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:26.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.377+0000 7f30b2ffd640 1 --2- 172.21.15.18:0/3988603878 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f30a006c2b0 0x7f30a006e770 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f30a4034000 tx=0x7f30a402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:26.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.381+0000 7f309b7fe640 1 -- 172.21.15.18:0/3988603878 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f30a801c360 con 0x7f30b40cf910 2024-09-19T09:15:26.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.596+0000 7f30b9781640 1 -- 172.21.15.18:0/3988603878 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30b40cff00 con 0x7f30b40cf910 2024-09-19T09:15:26.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.596+0000 7f309b7fe640 1 -- 172.21.15.18:0/3988603878 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+3914 (secure 0 0 0) 0x7f30a8059ee0 con 0x7f30b40cf910 2024-09-19T09:15:26.598 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:15:26.598 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":23,"btime":"2024-09-19T09:15:21:610537+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4793,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/113686001","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":113686001},{"type":"v1","addr":"172.21.15.162:6835","nonce":113686001}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17},{"gid":4799,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3269042030","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3269042030},{"type":"v1","addr":"172.21.15.162:6837","nonce":3269042030}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5184,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/3996030837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3996030837},{"type":"v1","addr":"172.21.15.18:6834","nonce":3996030837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":5481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1347866443","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1347866443},{"type":"v1","addr":"172.21.15.18:6835","nonce":1347866443}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":23}],"filesystems":[]} 2024-09-19T09:15:26.599 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 23 2024-09-19T09:15:26.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.599+0000 7f30b9781640 1 -- 172.21.15.18:0/3988603878 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f30a006c2b0 msgr2=0x7f30a006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:26.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.599+0000 7f30b9781640 1 --2- 172.21.15.18:0/3988603878 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f30a006c2b0 0x7f30a006e770 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f30a4034000 tx=0x7f30a402e000 comp rx=0 tx=0).stop 2024-09-19T09:15:26.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.599+0000 7f30b9781640 1 -- 172.21.15.18:0/3988603878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30b40cf910 msgr2=0x7f30b4158140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:26.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.599+0000 7f30b9781640 1 --2- 172.21.15.18:0/3988603878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30b40cf910 0x7f30b4158140 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f30a800d7d0 tx=0x7f30a800dc90 comp rx=0 tx=0).stop 2024-09-19T09:15:26.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.599+0000 7f30b9781640 1 -- 172.21.15.18:0/3988603878 shutdown_connections 2024-09-19T09:15:26.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.599+0000 7f30b9781640 1 --2- 172.21.15.18:0/3988603878 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f30a006c2b0 0x7f30a006e770 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:26.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.599+0000 7f30b9781640 1 --2- 172.21.15.18:0/3988603878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30b415ef80 0x7f30b40b6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:26.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.599+0000 7f30b9781640 1 --2- 172.21.15.18:0/3988603878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30b40cf910 0x7f30b4158140 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:26.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.599+0000 7f30b9781640 1 --2- 172.21.15.18:0/3988603878 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30b406d730 0x7f30b415bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:26.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.599+0000 7f30b9781640 1 -- 172.21.15.18:0/3988603878 >> 172.21.15.18:0/3988603878 conn(0x7f30b40b4700 msgr2=0x7f30b4070b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:26.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.599+0000 7f30b9781640 1 -- 172.21.15.18:0/3988603878 shutdown_connections 2024-09-19T09:15:26.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.599+0000 7f30b9781640 1 -- 172.21.15.18:0/3988603878 wait complete. 2024-09-19T09:15:26.612 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T09:15:26.612 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-19T09:15:26.612 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T09:15:26.613 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:15:26.613 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T09:15:26.613 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-19T09:15:26.613 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T09:15:26.613 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:15:26.613 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T09:15:26.613 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-19T09:15:26.614 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T09:15:26.614 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:15:26.614 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T09:15:26.614 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-19T09:15:26.614 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T09:15:26.614 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:15:26.622 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T09:15:26.623 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T09:15:26.624 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T09:15:26.624 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T09:15:26.626 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T09:15:26.627 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T09:15:26.628 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T09:15:26.628 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T09:15:26.665 INFO:tasks.ceph.mds.a:Started 2024-09-19T09:15:26.665 DEBUG:teuthology.parallel:result is None 2024-09-19T09:15:26.666 INFO:tasks.ceph.mds.c:Started 2024-09-19T09:15:26.666 DEBUG:teuthology.parallel:result is None 2024-09-19T09:15:26.668 INFO:tasks.ceph.mds.b:Started 2024-09-19T09:15:26.669 DEBUG:teuthology.parallel:result is None 2024-09-19T09:15:26.669 INFO:tasks.ceph.mds.d:Started 2024-09-19T09:15:26.669 DEBUG:teuthology.parallel:result is None 2024-09-19T09:15:26.670 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-19T09:15:26.743 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2024-09-19T09:15:26.744 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-09-19T09:15:26.749 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-09-19T09:15:26.749 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-09-19T09:15:26.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.777+0000 7fd3ad3d6640 1 Processor -- start 2024-09-19T09:15:26.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.777+0000 7fd3ad3d6640 1 -- start start 2024-09-19T09:15:26.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.778+0000 7fd3ad3d6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd3a815eda0 0x7fd3a80d5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:26.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.778+0000 7fd3ad3d6640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3a80d3cc0 con 0x7fd3a80d0480 2024-09-19T09:15:26.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.778+0000 7fd3ad3d6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3a80d0bf0 con 0x7fd3a80d1630 2024-09-19T09:15:26.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.778+0000 7fd3ad3d6640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fd3a80d2880 con 0x7fd3a815eda0 2024-09-19T09:15:26.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.778+0000 7fd3a6ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd3a815eda0 0x7fd3a80d5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:26.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.778+0000 7fd3a67fc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd3a80d0480 0x7fd3a80d35b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57128/0 (socket says 172.21.15.18:57128) 2024-09-19T09:15:26.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.778+0000 7fd3a67fc640 1 -- 172.21.15.18:0/3603230161 learned_addr learned my addr 172.21.15.18:0/3603230161 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:15:26.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.778+0000 7fd3a6ffd640 1 -- 172.21.15.18:0/3603230161 >> v1:172.21.15.162:6789/0 conn(0x7fd3a80d1630 legacy=0x7fd3a80b7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:26.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.778+0000 7fd3a6ffd640 1 -- 172.21.15.18:0/3603230161 >> v1:172.21.15.18:6789/0 conn(0x7fd3a80d0480 legacy=0x7fd3a80d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:26.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.778+0000 7fd3a6ffd640 1 -- 172.21.15.18:0/3603230161 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3a80d2ad0 con 0x7fd3a815eda0 2024-09-19T09:15:26.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.778+0000 7fd3a5ffb640 1 -- 172.21.15.18:0/3603230161 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4137526661 0 0) 0x7fd3a80d3cc0 con 0x7fd3a80d0480 2024-09-19T09:15:26.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.779+0000 7fd3a6ffd640 1 --2- 172.21.15.18:0/3603230161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3a815eda0 0x7fd3a80d5790 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd3900097a0 tx=0x7fd39002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f99010eb5c5138b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:26.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.779+0000 7fd3a5ffb640 1 -- 172.21.15.18:0/3603230161 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd390037070 con 0x7fd3a815eda0 2024-09-19T09:15:26.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.779+0000 7fd3a5ffb640 1 -- 172.21.15.18:0/3603230161 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd390032440 con 0x7fd3a815eda0 2024-09-19T09:15:26.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.779+0000 7fd3a5ffb640 1 -- 172.21.15.18:0/3603230161 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd390032810 con 0x7fd3a815eda0 2024-09-19T09:15:26.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.780+0000 7fd3ad3d6640 1 -- 172.21.15.18:0/3603230161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3a815eda0 msgr2=0x7fd3a80d5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:26.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.780+0000 7fd3ad3d6640 1 --2- 172.21.15.18:0/3603230161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3a815eda0 0x7fd3a80d5790 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd3900097a0 tx=0x7fd39002a230 comp rx=0 tx=0).stop 2024-09-19T09:15:26.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.780+0000 7fd3ad3d6640 1 -- 172.21.15.18:0/3603230161 shutdown_connections 2024-09-19T09:15:26.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.780+0000 7fd3ad3d6640 1 --2- 172.21.15.18:0/3603230161 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3a815eda0 0x7fd3a80d5790 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:26.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.780+0000 7fd3ad3d6640 1 -- 172.21.15.18:0/3603230161 >> 172.21.15.18:0/3603230161 conn(0x7fd3a809df40 msgr2=0x7fd3a80d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:26.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.780+0000 7fd3ad3d6640 1 -- 172.21.15.18:0/3603230161 shutdown_connections 2024-09-19T09:15:26.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.780+0000 7fd3ad3d6640 1 -- 172.21.15.18:0/3603230161 wait complete. 2024-09-19T09:15:26.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.781+0000 7fd3ad3d6640 1 Processor -- start 2024-09-19T09:15:26.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.781+0000 7fd3ad3d6640 1 -- start start 2024-09-19T09:15:26.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.782+0000 7fd3ad3d6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3a80d0480 0x7fd3a8157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:26.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.782+0000 7fd3ad3d6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3a80d1630 0x7fd3a80cec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:26.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.782+0000 7fd3ad3d6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3a815eda0 0x7fd3a8161490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:26.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.782+0000 7fd3ad3d6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a80d08f0 con 0x7fd3a815eda0 2024-09-19T09:15:26.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.782+0000 7fd3ad3d6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd3a80d3120 con 0x7fd3a80d1630 2024-09-19T09:15:26.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.782+0000 7fd3ad3d6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd3a815f180 con 0x7fd3a80d0480 2024-09-19T09:15:26.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.782+0000 7fd3a77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3a815eda0 0x7fd3a8161490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:26.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.782+0000 7fd3a77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3a815eda0 0x7fd3a8161490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52618/0 (socket says 172.21.15.18:52618) 2024-09-19T09:15:26.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.782+0000 7fd3a77fe640 1 -- 172.21.15.18:0/1407850122 learned_addr learned my addr 172.21.15.18:0/1407850122 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:26.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.782+0000 7fd3a67fc640 1 --2- 172.21.15.18:0/1407850122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3a80d1630 0x7fd3a80cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:26.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.782+0000 7fd3a6ffd640 1 --2- 172.21.15.18:0/1407850122 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3a80d0480 0x7fd3a8157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:26.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.782+0000 7fd3a77fe640 1 -- 172.21.15.18:0/1407850122 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3a80d0480 msgr2=0x7fd3a8157650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:26.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.782+0000 7fd3a77fe640 1 --2- 172.21.15.18:0/1407850122 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3a80d0480 0x7fd3a8157650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:26.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.783+0000 7fd3a77fe640 1 -- 172.21.15.18:0/1407850122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3a80d1630 msgr2=0x7fd3a80cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:26.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.783+0000 7fd3a77fe640 1 --2- 172.21.15.18:0/1407850122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3a80d1630 0x7fd3a80cec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:26.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.783+0000 7fd3a77fe640 1 -- 172.21.15.18:0/1407850122 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3a80cd0d0 con 0x7fd3a815eda0 2024-09-19T09:15:26.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.783+0000 7fd3a77fe640 1 --2- 172.21.15.18:0/1407850122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3a815eda0 0x7fd3a8161490 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd3a000c7d0 tx=0x7fd3a000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:26.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.783+0000 7fd39f7fe640 1 -- 172.21.15.18:0/1407850122 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a0003b70 con 0x7fd3a815eda0 2024-09-19T09:15:26.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.783+0000 7fd39f7fe640 1 -- 172.21.15.18:0/1407850122 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3a0003d30 con 0x7fd3a815eda0 2024-09-19T09:15:26.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.783+0000 7fd3ad3d6640 1 -- 172.21.15.18:0/1407850122 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3a80cd3b0 con 0x7fd3a815eda0 2024-09-19T09:15:26.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.783+0000 7fd39f7fe640 1 -- 172.21.15.18:0/1407850122 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3a000aa90 con 0x7fd3a815eda0 2024-09-19T09:15:26.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.783+0000 7fd3ad3d6640 1 -- 172.21.15.18:0/1407850122 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3a80cd970 con 0x7fd3a815eda0 2024-09-19T09:15:26.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.784+0000 7fd3ad3d6640 1 -- 172.21.15.18:0/1407850122 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3a80a00e0 con 0x7fd3a815eda0 2024-09-19T09:15:26.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.784+0000 7fd39f7fe640 1 -- 172.21.15.18:0/1407850122 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd3a000ac30 con 0x7fd3a815eda0 2024-09-19T09:15:26.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.785+0000 7fd39f7fe640 1 --2- 172.21.15.18:0/1407850122 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd38806c2b0 0x7fd38806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:26.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.785+0000 7fd39f7fe640 1 -- 172.21.15.18:0/1407850122 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 4943+0+0 (secure 0 0 0) 0x7fd3a008af20 con 0x7fd3a815eda0 2024-09-19T09:15:26.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.785+0000 7fd3a6ffd640 1 --2- 172.21.15.18:0/1407850122 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd38806c2b0 0x7fd38806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:26.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.786+0000 7fd3a6ffd640 1 --2- 172.21.15.18:0/1407850122 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd38806c2b0 0x7fd38806e770 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd390034000 tx=0x7fd39002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:26.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.789+0000 7fd39f7fe640 1 -- 172.21.15.18:0/1407850122 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd3a0059340 con 0x7fd3a815eda0 2024-09-19T09:15:26.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:26.975+0000 7fd3ad3d6640 1 -- 172.21.15.18:0/1407850122 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fd3a80d5790 con 0x7fd3a815eda0 2024-09-19T09:15:27.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.634+0000 7fd39f7fe640 1 -- 172.21.15.18:0/1407850122 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v64) ==== 97+0+0 (secure 0 0 0) 0x7fd3a005d640 con 0x7fd3a815eda0 2024-09-19T09:15:27.636 INFO:teuthology.orchestra.run.smithi018.stderr: removed all blocklist entries 2024-09-19T09:15:27.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.637+0000 7fd3ad3d6640 1 -- 172.21.15.18:0/1407850122 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd38806c2b0 msgr2=0x7fd38806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:27.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.637+0000 7fd3ad3d6640 1 --2- 172.21.15.18:0/1407850122 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd38806c2b0 0x7fd38806e770 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd390034000 tx=0x7fd39002e000 comp rx=0 tx=0).stop 2024-09-19T09:15:27.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.637+0000 7fd3ad3d6640 1 -- 172.21.15.18:0/1407850122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3a815eda0 msgr2=0x7fd3a8161490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:27.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.637+0000 7fd3ad3d6640 1 --2- 172.21.15.18:0/1407850122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3a815eda0 0x7fd3a8161490 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd3a000c7d0 tx=0x7fd3a000cc90 comp rx=0 tx=0).stop 2024-09-19T09:15:27.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.637+0000 7fd3ad3d6640 1 -- 172.21.15.18:0/1407850122 shutdown_connections 2024-09-19T09:15:27.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.637+0000 7fd3ad3d6640 1 --2- 172.21.15.18:0/1407850122 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd38806c2b0 0x7fd38806e770 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:27.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.637+0000 7fd3ad3d6640 1 --2- 172.21.15.18:0/1407850122 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3a815eda0 0x7fd3a8161490 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:27.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.637+0000 7fd3ad3d6640 1 --2- 172.21.15.18:0/1407850122 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3a80d1630 0x7fd3a80cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:27.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.637+0000 7fd3ad3d6640 1 --2- 172.21.15.18:0/1407850122 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3a80d0480 0x7fd3a8157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:27.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.637+0000 7fd3ad3d6640 1 -- 172.21.15.18:0/1407850122 >> 172.21.15.18:0/1407850122 conn(0x7fd3a809df40 msgr2=0x7fd3a80b8660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:27.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.637+0000 7fd3ad3d6640 1 -- 172.21.15.18:0/1407850122 shutdown_connections 2024-09-19T09:15:27.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.637+0000 7fd3ad3d6640 1 -- 172.21.15.18:0/1407850122 wait complete. 2024-09-19T09:15:27.652 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-19T09:15:27.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.755+0000 7f10fe4a5640 1 Processor -- start 2024-09-19T09:15:27.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.755+0000 7f10fe4a5640 1 -- start start 2024-09-19T09:15:27.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.756+0000 7f10fe4a5640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f10f815ef50 0x7f10f80d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:27.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.756+0000 7f10fe4a5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f10f80d3240 0x7f10f80d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:27.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.756+0000 7f10fe4a5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10f80d5780 0x7f10f80cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:27.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.756+0000 7f10fe4a5640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f10f80b7a90 con 0x7f10f815ef50 2024-09-19T09:15:27.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.756+0000 7f10fe4a5640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f10f80d3740 con 0x7f10f80d3240 2024-09-19T09:15:27.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.756+0000 7f10fe4a5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f10f80d3a20 con 0x7f10f80d5780 2024-09-19T09:15:27.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.756+0000 7f10f7fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f10f815ef50 0x7f10f80d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:27.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.756+0000 7f10f7fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f10f815ef50 0x7f10f80d13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52622/0 (socket says 172.21.15.18:52622) 2024-09-19T09:15:27.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.756+0000 7f10f7fff640 1 -- 172.21.15.18:0/4108002371 learned_addr learned my addr 172.21.15.18:0/4108002371 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:27.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.757+0000 7f10fca42640 1 --2- 172.21.15.18:0/4108002371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10f80d5780 0x7f10f80cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:27.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.757+0000 7f10f77fe640 1 --2- 172.21.15.18:0/4108002371 >> v2:172.21.15.162:3300/0 conn(0x7f10f80d3240 0x7f10f80d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:27.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.757+0000 7f10f7fff640 1 -- 172.21.15.18:0/4108002371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10f80d5780 msgr2=0x7f10f80cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:27.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.757+0000 7f10f7fff640 1 --2- 172.21.15.18:0/4108002371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10f80d5780 0x7f10f80cf770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:27.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.757+0000 7f10f7fff640 1 -- 172.21.15.18:0/4108002371 >> v2:172.21.15.162:3300/0 conn(0x7f10f80d3240 msgr2=0x7f10f80d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:27.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.757+0000 7f10f7fff640 1 --2- 172.21.15.18:0/4108002371 >> v2:172.21.15.162:3300/0 conn(0x7f10f80d3240 0x7f10f80d18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:27.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.757+0000 7f10f7fff640 1 -- 172.21.15.18:0/4108002371 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f80b7d00 con 0x7f10f815ef50 2024-09-19T09:15:27.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.757+0000 7f10fca42640 1 --2- 172.21.15.18:0/4108002371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10f80d5780 0x7f10f80cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:15:27.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.757+0000 7f10f77fe640 1 --2- 172.21.15.18:0/4108002371 >> v2:172.21.15.162:3300/0 conn(0x7f10f80d3240 0x7f10f80d18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:15:27.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.757+0000 7f10f7fff640 1 --2- 172.21.15.18:0/4108002371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10f815ef50 0x7f10f80d13a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f10f808df60 tx=0x7f10e802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b38891c2cc0172 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:27.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.758+0000 7f10f6ffd640 1 -- 172.21.15.18:0/4108002371 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e8037070 con 0x7f10f815ef50 2024-09-19T09:15:27.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.758+0000 7f10f6ffd640 1 -- 172.21.15.18:0/4108002371 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10e8032440 con 0x7f10f815ef50 2024-09-19T09:15:27.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.758+0000 7f10f6ffd640 1 -- 172.21.15.18:0/4108002371 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e8032810 con 0x7f10f815ef50 2024-09-19T09:15:27.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.758+0000 7f10fe4a5640 1 -- 172.21.15.18:0/4108002371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10f815ef50 msgr2=0x7f10f80d13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:27.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.758+0000 7f10fe4a5640 1 --2- 172.21.15.18:0/4108002371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10f815ef50 0x7f10f80d13a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f10f808df60 tx=0x7f10e802a140 comp rx=0 tx=0).stop 2024-09-19T09:15:27.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.758+0000 7f10fe4a5640 1 -- 172.21.15.18:0/4108002371 shutdown_connections 2024-09-19T09:15:27.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.758+0000 7f10fe4a5640 1 --2- 172.21.15.18:0/4108002371 >> v2:172.21.15.162:3300/0 conn(0x7f10f80d3240 0x7f10f80d18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:27.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.758+0000 7f10fe4a5640 1 --2- 172.21.15.18:0/4108002371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10f80d5780 0x7f10f80cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:27.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.758+0000 7f10fe4a5640 1 --2- 172.21.15.18:0/4108002371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10f815ef50 0x7f10f80d13a0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:27.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.758+0000 7f10fe4a5640 1 -- 172.21.15.18:0/4108002371 >> 172.21.15.18:0/4108002371 conn(0x7f10f80d4c60 msgr2=0x7f10f80d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:27.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.758+0000 7f10fe4a5640 1 -- 172.21.15.18:0/4108002371 shutdown_connections 2024-09-19T09:15:27.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.758+0000 7f10fe4a5640 1 -- 172.21.15.18:0/4108002371 wait complete. 2024-09-19T09:15:27.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.759+0000 7f10fe4a5640 1 Processor -- start 2024-09-19T09:15:27.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.760+0000 7f10fe4a5640 1 -- start start 2024-09-19T09:15:27.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.760+0000 7f10fe4a5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10f80d3240 0x7f10f80c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:27.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.760+0000 7f10fe4a5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10f80d5780 0x7f10f8154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:27.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.760+0000 7f10fe4a5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10f815ef50 0x7f10f80b9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:27.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.760+0000 7f10fe4a5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f10f80d21a0 con 0x7f10f80d3240 2024-09-19T09:15:27.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.760+0000 7f10fe4a5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f10f80d2020 con 0x7f10f80d5780 2024-09-19T09:15:27.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.760+0000 7f10fe4a5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f10f80cfcb0 con 0x7f10f815ef50 2024-09-19T09:15:27.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.761+0000 7f10f7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10f80d3240 0x7f10f80c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:27.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.761+0000 7f10f7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10f80d3240 0x7f10f80c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52636/0 (socket says 172.21.15.18:52636) 2024-09-19T09:15:27.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.761+0000 7f10f7fff640 1 -- 172.21.15.18:0/1778499080 learned_addr learned my addr 172.21.15.18:0/1778499080 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:27.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.761+0000 7f10f7fff640 1 -- 172.21.15.18:0/1778499080 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10f815ef50 msgr2=0x7f10f80b9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:27.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.761+0000 7f10f7fff640 1 --2- 172.21.15.18:0/1778499080 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10f815ef50 0x7f10f80b9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:27.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.761+0000 7f10f7fff640 1 -- 172.21.15.18:0/1778499080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10f80d5780 msgr2=0x7f10f8154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:27.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.761+0000 7f10f7fff640 1 --2- 172.21.15.18:0/1778499080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10f80d5780 0x7f10f8154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:27.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.761+0000 7f10f7fff640 1 -- 172.21.15.18:0/1778499080 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f81590a0 con 0x7f10f80d3240 2024-09-19T09:15:27.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.761+0000 7f10f7fff640 1 --2- 172.21.15.18:0/1778499080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10f80d3240 0x7f10f80c8560 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f10e80097c0 tx=0x7f10e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:27.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.761+0000 7f10f4ff9640 1 -- 172.21.15.18:0/1778499080 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e8037040 con 0x7f10f80d3240 2024-09-19T09:15:27.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.761+0000 7f10f4ff9640 1 -- 172.21.15.18:0/1778499080 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10e8042070 con 0x7f10f80d3240 2024-09-19T09:15:27.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.761+0000 7f10fe4a5640 1 -- 172.21.15.18:0/1778499080 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10f8159380 con 0x7f10f80d3240 2024-09-19T09:15:27.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.761+0000 7f10f4ff9640 1 -- 172.21.15.18:0/1778499080 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e8030bb0 con 0x7f10f80d3240 2024-09-19T09:15:27.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.761+0000 7f10fe4a5640 1 -- 172.21.15.18:0/1778499080 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10f8159940 con 0x7f10f80d3240 2024-09-19T09:15:27.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.762+0000 7f10fe4a5640 1 -- 172.21.15.18:0/1778499080 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10f80cf770 con 0x7f10f80d3240 2024-09-19T09:15:27.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.763+0000 7f10f4ff9640 1 -- 172.21.15.18:0/1778499080 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f10e8047460 con 0x7f10f80d3240 2024-09-19T09:15:27.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.763+0000 7f10f4ff9640 1 --2- 172.21.15.18:0/1778499080 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f10e406c2b0 0x7f10e406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:27.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.763+0000 7f10f4ff9640 1 -- 172.21.15.18:0/1778499080 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 4857+0+0 (secure 0 0 0) 0x7f10e80abc90 con 0x7f10f80d3240 2024-09-19T09:15:27.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.764+0000 7f10f77fe640 1 --2- 172.21.15.18:0/1778499080 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f10e406c2b0 0x7f10e406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:27.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.764+0000 7f10f77fe640 1 --2- 172.21.15.18:0/1778499080 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f10e406c2b0 0x7f10e406e770 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f10f80d0ec0 tx=0x7f10ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:27.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:27.768+0000 7f10f4ff9640 1 -- 172.21.15.18:0/1778499080 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f10e8045360 con 0x7f10f80d3240 2024-09-19T09:15:28.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.012+0000 7f10fe4a5640 1 -- 172.21.15.18:0/1778499080 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f10f806e090 con 0x7f10f80d3240 2024-09-19T09:15:28.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.013+0000 7f10f4ff9640 1 -- 172.21.15.18:0/1778499080 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) ==== 80+0+5304 (secure 0 0 0) 0x7f10e807a7e0 con 0x7f10f80d3240 2024-09-19T09:15:28.014 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:15:28.014 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:15:28.015 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_dump": [ 2024-09-19T09:15:28.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:28.015 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.a", 2024-09-19T09:15:28.015 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmDY7cHhAALxtxGq6eR3A2QXYp+nW0FA==", 2024-09-19T09:15:28.015 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:15:28.015 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:15:28.015 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:15:28.015 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:15:28.015 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:15:28.015 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:28.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:28.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:28.016 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.b", 2024-09-19T09:15:28.016 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tm9ILFKhAABEtgvzO5YBXqzYaeBZ0qZg==", 2024-09-19T09:15:28.016 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:15:28.016 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:15:28.016 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:15:28.016 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:15:28.016 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:15:28.016 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:28.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:28.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:28.016 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.c", 2024-09-19T09:15:28.016 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmwPkOJhAADt/0XVei2kl79pIw55wu1A==", 2024-09-19T09:15:28.016 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:15:28.016 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:15:28.017 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:15:28.017 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:15:28.017 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:15:28.017 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:28.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:28.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:28.017 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.d", 2024-09-19T09:15:28.017 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tm35XYMRAA/OSE5iv8M+TekEJVTARETw==", 2024-09-19T09:15:28.017 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:15:28.017 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:15:28.017 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:15:28.017 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:15:28.017 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:15:28.018 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:28.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:28.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:28.018 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.0", 2024-09-19T09:15:28.018 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmkUBiGhAATWtnqNPWyZJ+tnQcZOtT5A==", 2024-09-19T09:15:28.018 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:15:28.018 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:15:28.018 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:15:28.018 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:15:28.018 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:28.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:28.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:28.018 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.1", 2024-09-19T09:15:28.018 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmir5wIRAA9QumyCr8yLHtNj/YqQ1d0A==", 2024-09-19T09:15:28.019 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:15:28.019 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:15:28.019 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:15:28.019 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:15:28.019 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:28.019 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:28.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:28.019 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.2", 2024-09-19T09:15:28.019 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmfQJ6KBAAfTerKv1zCzFf6UfAVUikxA==", 2024-09-19T09:15:28.019 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:15:28.019 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:15:28.019 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:15:28.019 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:15:28.019 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:28.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:28.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:28.020 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.3", 2024-09-19T09:15:28.020 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmSeSOLxAACqCpiIQO4cDyjXUmoGPKAQ==", 2024-09-19T09:15:28.020 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:15:28.020 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:15:28.020 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:15:28.020 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:15:28.020 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:28.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:28.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:28.020 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.4", 2024-09-19T09:15:28.020 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmrsoFAhAArI7cRPVe/jrnSdmyE8jCsQ==", 2024-09-19T09:15:28.021 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:15:28.021 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:15:28.021 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:15:28.021 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:15:28.021 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:28.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:28.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:28.021 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.5", 2024-09-19T09:15:28.021 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmudM3CRAAXF3uI58SNJE6qtYX2wNQeQ==", 2024-09-19T09:15:28.021 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:15:28.021 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:15:28.021 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:15:28.021 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:15:28.021 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:28.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:28.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:28.022 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.6", 2024-09-19T09:15:28.022 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmqEQmEBAAm4h/8p91HwX84pl/U80Q9Q==", 2024-09-19T09:15:28.022 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:15:28.022 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:15:28.022 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:15:28.022 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:15:28.022 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:28.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:28.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:28.022 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.7", 2024-09-19T09:15:28.022 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmhDs0FxAAxZvRVkBoWqsdmyifRZzgwg==", 2024-09-19T09:15:28.023 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:15:28.023 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:15:28.023 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:15:28.023 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:15:28.023 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:28.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:28.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:28.023 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.0", 2024-09-19T09:15:28.023 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmcbwDNhAAaG0+wu96Locwws+h0zeh8Q==", 2024-09-19T09:15:28.023 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:15:28.023 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:15:28.023 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow r", 2024-09-19T09:15:28.023 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-19T09:15:28.024 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:28.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:28.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:28.024 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.1", 2024-09-19T09:15:28.024 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAf6+tmb4FeAxAAU+nZN/Vb33HrU0yfXmU9gA==", 2024-09-19T09:15:28.024 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:15:28.024 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:15:28.024 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-19T09:15:28.024 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-19T09:15:28.024 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-19T09:15:28.024 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:28.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:28.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:28.025 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.2", 2024-09-19T09:15:28.025 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAf6+tmc34kABAAC5b4Kkm2dJvxxyXva6PT2g==", 2024-09-19T09:15:28.025 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:15:28.025 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:15:28.025 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-19T09:15:28.025 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-19T09:15:28.025 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-19T09:15:28.025 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:28.025 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:28.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:28.025 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.3", 2024-09-19T09:15:28.025 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAf6+tmx4vzCBAAZ7ZrdGI2s8LqT0MjjzOCjw==", 2024-09-19T09:15:28.025 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:15:28.026 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:15:28.026 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-19T09:15:28.026 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-19T09:15:28.026 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-19T09:15:28.026 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:28.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:28.026 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:28.026 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.admin", 2024-09-19T09:15:28.026 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmZaWgAhAAx7MUazt6rS+wa/ZMSGC97Q==", 2024-09-19T09:15:28.026 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:15:28.026 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-19T09:15:28.026 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:15:28.026 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:15:28.027 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:15:28.027 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:28.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:28.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:28.027 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.x", 2024-09-19T09:15:28.027 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmwr6NGxAA3M5NZKkjc36L25teWJS7bQ==", 2024-09-19T09:15:28.027 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:15:28.027 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-19T09:15:28.027 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-09-19T09:15:28.027 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:15:28.027 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:28.027 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:15:28.027 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:28.027 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.y", 2024-09-19T09:15:28.028 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmBWOWFxAAEYKCroBhMcqoIe6WzXnNCg==", 2024-09-19T09:15:28.028 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:15:28.028 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-19T09:15:28.028 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-09-19T09:15:28.028 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:15:28.028 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:28.028 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:28.028 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:15:28.028 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:15:28.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.014+0000 7f10fe4a5640 1 -- 172.21.15.18:0/1778499080 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f10e406c2b0 msgr2=0x7f10e406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:28.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.014+0000 7f10fe4a5640 1 --2- 172.21.15.18:0/1778499080 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f10e406c2b0 0x7f10e406e770 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f10f80d0ec0 tx=0x7f10ec008040 comp rx=0 tx=0).stop 2024-09-19T09:15:28.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.014+0000 7f10fe4a5640 1 -- 172.21.15.18:0/1778499080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10f80d3240 msgr2=0x7f10f80c8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:28.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.014+0000 7f10fe4a5640 1 --2- 172.21.15.18:0/1778499080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10f80d3240 0x7f10f80c8560 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f10e80097c0 tx=0x7f10e80046c0 comp rx=0 tx=0).stop 2024-09-19T09:15:28.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.015+0000 7f10fe4a5640 1 -- 172.21.15.18:0/1778499080 shutdown_connections 2024-09-19T09:15:28.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.015+0000 7f10fe4a5640 1 --2- 172.21.15.18:0/1778499080 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f10e406c2b0 0x7f10e406e770 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:28.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.015+0000 7f10fe4a5640 1 --2- 172.21.15.18:0/1778499080 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10f815ef50 0x7f10f80b9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:28.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.015+0000 7f10fe4a5640 1 --2- 172.21.15.18:0/1778499080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10f80d5780 0x7f10f8154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:28.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.015+0000 7f10fe4a5640 1 --2- 172.21.15.18:0/1778499080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f10f80d3240 0x7f10f80c8560 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:28.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.015+0000 7f10fe4a5640 1 -- 172.21.15.18:0/1778499080 >> 172.21.15.18:0/1778499080 conn(0x7f10f80d4c60 msgr2=0x7f10f80b6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:28.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.015+0000 7f10fe4a5640 1 -- 172.21.15.18:0/1778499080 shutdown_connections 2024-09-19T09:15:28.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.015+0000 7f10fe4a5640 1 -- 172.21.15.18:0/1778499080 wait complete. 2024-09-19T09:15:28.031 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-19T09:15:28.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.132+0000 7fe96bf78640 1 Processor -- start 2024-09-19T09:15:28.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.133+0000 7fe96bf78640 1 -- start start 2024-09-19T09:15:28.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.133+0000 7fe96bf78640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe96415ef50 0x7fe9640d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:28.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.133+0000 7fe96bf78640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9640b9510 0x7fe9640d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:28.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.133+0000 7fe96bf78640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9640b7a90 con 0x7fe9640d3240 2024-09-19T09:15:28.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.133+0000 7fe96bf78640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fe9640d3740 con 0x7fe96415ef50 2024-09-19T09:15:28.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.133+0000 7fe96bf78640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe9640d3a20 con 0x7fe9640b9510 2024-09-19T09:15:28.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.134+0000 7fe969d14640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe96415ef50 0x7fe9640d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:28.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.134+0000 7fe969513640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe9640d3240 0x7fe9640cf770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57130/0 (socket says 172.21.15.18:57130) 2024-09-19T09:15:28.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.134+0000 7fe969513640 1 -- 172.21.15.18:0/1085765313 learned_addr learned my addr 172.21.15.18:0/1085765313 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:15:28.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.134+0000 7fe96a515640 1 --2- 172.21.15.18:0/1085765313 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9640b9510 0x7fe9640d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:28.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.134+0000 7fe969d14640 1 -- 172.21.15.18:0/1085765313 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9640b9510 msgr2=0x7fe9640d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:28.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.134+0000 7fe969d14640 1 --2- 172.21.15.18:0/1085765313 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9640b9510 0x7fe9640d18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:28.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.134+0000 7fe969d14640 1 -- 172.21.15.18:0/1085765313 >> v1:172.21.15.18:6789/0 conn(0x7fe9640d3240 legacy=0x7fe9640cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:28.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.134+0000 7fe969d14640 1 -- 172.21.15.18:0/1085765313 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9640b7d00 con 0x7fe96415ef50 2024-09-19T09:15:28.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.134+0000 7fe968d12640 1 -- 172.21.15.18:0/1085765313 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 906278230 0 0) 0x7fe9640b7a90 con 0x7fe9640d3240 2024-09-19T09:15:28.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.134+0000 7fe96a515640 1 --2- 172.21.15.18:0/1085765313 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9640b9510 0x7fe9640d18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:15:28.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.135+0000 7fe969d14640 1 --2- 172.21.15.18:0/1085765313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe96415ef50 0x7fe9640d13a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe9540097a0 tx=0x7fe95402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccd6cf7d224b679 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:28.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.135+0000 7fe968d12640 1 -- 172.21.15.18:0/1085765313 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe954037070 con 0x7fe96415ef50 2024-09-19T09:15:28.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.135+0000 7fe968d12640 1 -- 172.21.15.18:0/1085765313 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe95402ae50 con 0x7fe96415ef50 2024-09-19T09:15:28.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.135+0000 7fe968d12640 1 -- 172.21.15.18:0/1085765313 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe954032660 con 0x7fe96415ef50 2024-09-19T09:15:28.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.135+0000 7fe96bf78640 1 -- 172.21.15.18:0/1085765313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe96415ef50 msgr2=0x7fe9640d13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:28.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.135+0000 7fe96bf78640 1 --2- 172.21.15.18:0/1085765313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe96415ef50 0x7fe9640d13a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe9540097a0 tx=0x7fe95402a100 comp rx=0 tx=0).stop 2024-09-19T09:15:28.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.135+0000 7fe96bf78640 1 -- 172.21.15.18:0/1085765313 shutdown_connections 2024-09-19T09:15:28.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.135+0000 7fe96bf78640 1 --2- 172.21.15.18:0/1085765313 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9640b9510 0x7fe9640d18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:28.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.135+0000 7fe96bf78640 1 --2- 172.21.15.18:0/1085765313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe96415ef50 0x7fe9640d13a0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:28.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.135+0000 7fe96bf78640 1 -- 172.21.15.18:0/1085765313 >> 172.21.15.18:0/1085765313 conn(0x7fe9640d4c60 msgr2=0x7fe9640d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:28.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.135+0000 7fe96bf78640 1 -- 172.21.15.18:0/1085765313 shutdown_connections 2024-09-19T09:15:28.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.135+0000 7fe96bf78640 1 -- 172.21.15.18:0/1085765313 wait complete. 2024-09-19T09:15:28.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.137+0000 7fe96bf78640 1 Processor -- start 2024-09-19T09:15:28.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.137+0000 7fe96bf78640 1 -- start start 2024-09-19T09:15:28.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.137+0000 7fe96bf78640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9640b9510 0x7fe9641f5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:28.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.137+0000 7fe96bf78640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9640d3240 0x7fe9641f5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:28.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.137+0000 7fe96bf78640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe96415ef50 0x7fe9640ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:28.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.137+0000 7fe96bf78640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe9640d21a0 con 0x7fe9640b9510 2024-09-19T09:15:28.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.137+0000 7fe96bf78640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe9640d2020 con 0x7fe96415ef50 2024-09-19T09:15:28.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.137+0000 7fe96bf78640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe9640d5780 con 0x7fe9640d3240 2024-09-19T09:15:28.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.137+0000 7fe969d14640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9640b9510 0x7fe9641f5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:28.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.137+0000 7fe969d14640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9640b9510 0x7fe9641f5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52662/0 (socket says 172.21.15.18:52662) 2024-09-19T09:15:28.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.137+0000 7fe969d14640 1 -- 172.21.15.18:0/1339866945 learned_addr learned my addr 172.21.15.18:0/1339866945 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:28.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.138+0000 7fe969d14640 1 -- 172.21.15.18:0/1339866945 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9640d3240 msgr2=0x7fe9641f5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:28.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.138+0000 7fe969d14640 1 --2- 172.21.15.18:0/1339866945 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9640d3240 0x7fe9641f5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:28.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.138+0000 7fe96a515640 1 --2- 172.21.15.18:0/1339866945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe96415ef50 0x7fe9640ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:28.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.138+0000 7fe969d14640 1 -- 172.21.15.18:0/1339866945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe96415ef50 msgr2=0x7fe9640ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:28.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.138+0000 7fe969d14640 1 --2- 172.21.15.18:0/1339866945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe96415ef50 0x7fe9640ca520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:28.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.138+0000 7fe969d14640 1 -- 172.21.15.18:0/1339866945 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9641f5ab0 con 0x7fe9640b9510 2024-09-19T09:15:28.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.138+0000 7fe969d14640 1 --2- 172.21.15.18:0/1339866945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9640b9510 0x7fe9641f5ce0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe954035040 tx=0x7fe9540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:28.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.138+0000 7fe9627fc640 1 -- 172.21.15.18:0/1339866945 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe954041070 con 0x7fe9640b9510 2024-09-19T09:15:28.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.138+0000 7fe9627fc640 1 -- 172.21.15.18:0/1339866945 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe95403c670 con 0x7fe9640b9510 2024-09-19T09:15:28.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.138+0000 7fe96bf78640 1 -- 172.21.15.18:0/1339866945 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9640b5460 con 0x7fe9640b9510 2024-09-19T09:15:28.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.138+0000 7fe9627fc640 1 -- 172.21.15.18:0/1339866945 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe954037040 con 0x7fe9640b9510 2024-09-19T09:15:28.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.138+0000 7fe96bf78640 1 -- 172.21.15.18:0/1339866945 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9640c8bd0 con 0x7fe9640b9510 2024-09-19T09:15:28.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.139+0000 7fe96bf78640 1 -- 172.21.15.18:0/1339866945 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9640d13a0 con 0x7fe9640b9510 2024-09-19T09:15:28.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.140+0000 7fe9627fc640 1 -- 172.21.15.18:0/1339866945 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe95403a070 con 0x7fe9640b9510 2024-09-19T09:15:28.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.140+0000 7fe9627fc640 1 --2- 172.21.15.18:0/1339866945 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe95006c2b0 0x7fe95006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:28.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.140+0000 7fe9627fc640 1 -- 172.21.15.18:0/1339866945 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 4857+0+0 (secure 0 0 0) 0x7fe9540ab490 con 0x7fe9640b9510 2024-09-19T09:15:28.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.140+0000 7fe969513640 1 --2- 172.21.15.18:0/1339866945 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe95006c2b0 0x7fe95006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:28.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.141+0000 7fe969513640 1 --2- 172.21.15.18:0/1339866945 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe95006c2b0 0x7fe95006e770 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe958007fd0 tx=0x7fe958007920 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:28.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.144+0000 7fe9627fc640 1 -- 172.21.15.18:0/1339866945 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe954079fe0 con 0x7fe9640b9510 2024-09-19T09:15:28.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.323+0000 7fe96bf78640 1 -- 172.21.15.18:0/1339866945 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fe9640b6330 con 0x7fe9640b9510 2024-09-19T09:15:28.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.324+0000 7fe9627fc640 1 -- 172.21.15.18:0/1339866945 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v66) ==== 84+0+65 (secure 0 0 0) 0x7fe95407ee20 con 0x7fe9640b9510 2024-09-19T09:15:28.326 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:15:28.326 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-09-19T09:15:28.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:15:28.326 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 1, 2024-09-19T09:15:28.326 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": ".mgr" 2024-09-19T09:15:28.326 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:15:28.326 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-09-19T09:15:28.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.326+0000 7fe96bf78640 1 -- 172.21.15.18:0/1339866945 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe95006c2b0 msgr2=0x7fe95006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:28.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.326+0000 7fe96bf78640 1 --2- 172.21.15.18:0/1339866945 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe95006c2b0 0x7fe95006e770 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe958007fd0 tx=0x7fe958007920 comp rx=0 tx=0).stop 2024-09-19T09:15:28.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.326+0000 7fe96bf78640 1 -- 172.21.15.18:0/1339866945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9640b9510 msgr2=0x7fe9641f5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:28.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.326+0000 7fe96bf78640 1 --2- 172.21.15.18:0/1339866945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9640b9510 0x7fe9641f5ce0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe954035040 tx=0x7fe9540046c0 comp rx=0 tx=0).stop 2024-09-19T09:15:28.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.326+0000 7fe96bf78640 1 -- 172.21.15.18:0/1339866945 shutdown_connections 2024-09-19T09:15:28.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.326+0000 7fe96bf78640 1 --2- 172.21.15.18:0/1339866945 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe95006c2b0 0x7fe95006e770 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:28.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.326+0000 7fe96bf78640 1 --2- 172.21.15.18:0/1339866945 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe96415ef50 0x7fe9640ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:28.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.326+0000 7fe96bf78640 1 --2- 172.21.15.18:0/1339866945 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe9640d3240 0x7fe9641f5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:28.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.326+0000 7fe96bf78640 1 --2- 172.21.15.18:0/1339866945 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9640b9510 0x7fe9641f5ce0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:28.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.326+0000 7fe96bf78640 1 -- 172.21.15.18:0/1339866945 >> 172.21.15.18:0/1339866945 conn(0x7fe9640d4c60 msgr2=0x7fe9640d0140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:28.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.326+0000 7fe96bf78640 1 -- 172.21.15.18:0/1339866945 shutdown_connections 2024-09-19T09:15:28.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.326+0000 7fe96bf78640 1 -- 172.21.15.18:0/1339866945 wait complete. 2024-09-19T09:15:28.338 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T09:15:28.338 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T09:15:28.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.443+0000 7f730d4d0640 1 Processor -- start 2024-09-19T09:15:28.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.443+0000 7f730d4d0640 1 -- start start 2024-09-19T09:15:28.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.444+0000 7f730d4d0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f73080d17c0 0x7f73080ce5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:28.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.444+0000 7f730d4d0640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73080b3a80 con 0x7f73080d01a0 2024-09-19T09:15:28.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.444+0000 7f730d4d0640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73080b3d60 con 0x7f73080c90f0 2024-09-19T09:15:28.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.444+0000 7f730d4d0640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f73080c94d0 con 0x7f73080d17c0 2024-09-19T09:15:28.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.444+0000 7f73077fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f73080d17c0 0x7f73080ce5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:28.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.444+0000 7f73067fc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f73080d01a0 0x7f73080d10b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57144/0 (socket says 172.21.15.18:57144) 2024-09-19T09:15:28.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.444+0000 7f73067fc640 1 -- 172.21.15.18:0/3137816950 learned_addr learned my addr 172.21.15.18:0/3137816950 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:15:28.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.444+0000 7f73077fe640 1 -- 172.21.15.18:0/3137816950 >> v1:172.21.15.162:6789/0 conn(0x7f73080c90f0 legacy=0x7f73080d06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:28.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.444+0000 7f73077fe640 1 -- 172.21.15.18:0/3137816950 >> v1:172.21.15.18:6789/0 conn(0x7f73080d01a0 legacy=0x7f73080d10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:28.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.444+0000 7f73077fe640 1 -- 172.21.15.18:0/3137816950 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73080b4040 con 0x7f73080d17c0 2024-09-19T09:15:28.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.444+0000 7f7305ffb640 1 -- 172.21.15.18:0/3137816950 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1524164255 0 0) 0x7f73080b3a80 con 0x7f73080d01a0 2024-09-19T09:15:28.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.445+0000 7f73077fe640 1 --2- 172.21.15.18:0/3137816950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73080d17c0 0x7f73080ce5d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f72f8009d90 tx=0x7f72f802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aefe9e18e0833eeb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:28.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.445+0000 7f7305ffb640 1 -- 172.21.15.18:0/3137816950 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f8007740 con 0x7f73080d17c0 2024-09-19T09:15:28.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.445+0000 7f7305ffb640 1 -- 172.21.15.18:0/3137816950 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f80078e0 con 0x7f73080d17c0 2024-09-19T09:15:28.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.445+0000 7f7305ffb640 1 -- 172.21.15.18:0/3137816950 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f8007cb0 con 0x7f73080d17c0 2024-09-19T09:15:28.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.446+0000 7f730d4d0640 1 -- 172.21.15.18:0/3137816950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73080d17c0 msgr2=0x7f73080ce5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:28.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.446+0000 7f730d4d0640 1 --2- 172.21.15.18:0/3137816950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73080d17c0 0x7f73080ce5d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f72f8009d90 tx=0x7f72f802a660 comp rx=0 tx=0).stop 2024-09-19T09:15:28.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.446+0000 7f730d4d0640 1 -- 172.21.15.18:0/3137816950 shutdown_connections 2024-09-19T09:15:28.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.446+0000 7f730d4d0640 1 --2- 172.21.15.18:0/3137816950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73080d17c0 0x7f73080ce5d0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:28.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.446+0000 7f730d4d0640 1 -- 172.21.15.18:0/3137816950 >> 172.21.15.18:0/3137816950 conn(0x7f73080b4660 msgr2=0x7f73080b4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:28.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.446+0000 7f730d4d0640 1 -- 172.21.15.18:0/3137816950 shutdown_connections 2024-09-19T09:15:28.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.446+0000 7f730d4d0640 1 -- 172.21.15.18:0/3137816950 wait complete. 2024-09-19T09:15:28.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.447+0000 7f730d4d0640 1 Processor -- start 2024-09-19T09:15:28.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.447+0000 7f730d4d0640 1 -- start start 2024-09-19T09:15:28.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.448+0000 7f730d4d0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73080c90f0 0x7f73080b8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:28.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.448+0000 7f730d4d0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73080d01a0 0x7f73080c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:28.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.448+0000 7f730d4d0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73080d17c0 0x7f7308156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:28.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.448+0000 7f730d4d0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7308167980 con 0x7f73080d17c0 2024-09-19T09:15:28.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.448+0000 7f730d4d0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f73080b5420 con 0x7f73080d01a0 2024-09-19T09:15:28.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.448+0000 7f730d4d0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7308167b00 con 0x7f73080c90f0 2024-09-19T09:15:28.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.448+0000 7f73077fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73080d17c0 0x7f7308156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:28.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.448+0000 7f73077fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73080d17c0 0x7f7308156940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52688/0 (socket says 172.21.15.18:52688) 2024-09-19T09:15:28.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.448+0000 7f73077fe640 1 -- 172.21.15.18:0/342967389 learned_addr learned my addr 172.21.15.18:0/342967389 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:28.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.448+0000 7f73067fc640 1 --2- 172.21.15.18:0/342967389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73080d01a0 0x7f73080c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:28.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.448+0000 7f7306ffd640 1 --2- 172.21.15.18:0/342967389 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73080c90f0 0x7f73080b8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:28.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.448+0000 7f73077fe640 1 -- 172.21.15.18:0/342967389 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73080c90f0 msgr2=0x7f73080b8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:28.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.448+0000 7f73077fe640 1 --2- 172.21.15.18:0/342967389 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73080c90f0 0x7f73080b8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:28.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.448+0000 7f73077fe640 1 -- 172.21.15.18:0/342967389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73080d01a0 msgr2=0x7f73080c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:28.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.448+0000 7f73077fe640 1 --2- 172.21.15.18:0/342967389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73080d01a0 0x7f73080c9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:28.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.448+0000 7f73077fe640 1 -- 172.21.15.18:0/342967389 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73080cc8d0 con 0x7f73080d17c0 2024-09-19T09:15:28.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.448+0000 7f73077fe640 1 --2- 172.21.15.18:0/342967389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73080d17c0 0x7f7308156940 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f72f8009eb0 tx=0x7f72f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:28.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.449+0000 7f72ff7fe640 1 -- 172.21.15.18:0/342967389 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f803f070 con 0x7f73080d17c0 2024-09-19T09:15:28.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.449+0000 7f72ff7fe640 1 -- 172.21.15.18:0/342967389 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72f8031c40 con 0x7f73080d17c0 2024-09-19T09:15:28.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.449+0000 7f730d4d0640 1 -- 172.21.15.18:0/342967389 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73081505b0 con 0x7f73080d17c0 2024-09-19T09:15:28.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.449+0000 7f72ff7fe640 1 -- 172.21.15.18:0/342967389 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f8003990 con 0x7f73080d17c0 2024-09-19T09:15:28.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.449+0000 7f730d4d0640 1 -- 172.21.15.18:0/342967389 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7308150b70 con 0x7f73080d17c0 2024-09-19T09:15:28.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.450+0000 7f730d4d0640 1 -- 172.21.15.18:0/342967389 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7308150d70 con 0x7f73080d17c0 2024-09-19T09:15:28.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.450+0000 7f72ff7fe640 1 -- 172.21.15.18:0/342967389 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f72f8003b30 con 0x7f73080d17c0 2024-09-19T09:15:28.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.451+0000 7f72ff7fe640 1 --2- 172.21.15.18:0/342967389 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f72e806c2b0 0x7f72e806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:28.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.451+0000 7f72ff7fe640 1 -- 172.21.15.18:0/342967389 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 4857+0+0 (secure 0 0 0) 0x7f72f80ac3a0 con 0x7f73080d17c0 2024-09-19T09:15:28.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.451+0000 7f7306ffd640 1 --2- 172.21.15.18:0/342967389 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f72e806c2b0 0x7f72e806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:28.454 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.451+0000 7f7306ffd640 1 --2- 172.21.15.18:0/342967389 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f72e806c2b0 0x7f72e806e770 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7300000f60 tx=0x7f7300009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:28.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.456+0000 7f72ff7fe640 1 -- 172.21.15.18:0/342967389 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7308150d70 con 0x7f73080d17c0 2024-09-19T09:15:28.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:28.631+0000 7f730d4d0640 1 -- 172.21.15.18:0/342967389 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f73080d06a0 con 0x7f73080d17c0 2024-09-19T09:15:29.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.635+0000 7f72ff7fe640 1 -- 172.21.15.18:0/342967389 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v67) ==== 138+0+0 (secure 0 0 0) 0x7f72f807a790 con 0x7f73080d17c0 2024-09-19T09:15:29.636 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' created 2024-09-19T09:15:29.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.639+0000 7f730d4d0640 1 -- 172.21.15.18:0/342967389 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f72e806c2b0 msgr2=0x7f72e806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:29.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.639+0000 7f730d4d0640 1 --2- 172.21.15.18:0/342967389 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f72e806c2b0 0x7f72e806e770 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7300000f60 tx=0x7f7300009040 comp rx=0 tx=0).stop 2024-09-19T09:15:29.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.639+0000 7f730d4d0640 1 -- 172.21.15.18:0/342967389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73080d17c0 msgr2=0x7f7308156940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:29.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.639+0000 7f730d4d0640 1 --2- 172.21.15.18:0/342967389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73080d17c0 0x7f7308156940 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f72f8009eb0 tx=0x7f72f8004a40 comp rx=0 tx=0).stop 2024-09-19T09:15:29.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.639+0000 7f730d4d0640 1 -- 172.21.15.18:0/342967389 shutdown_connections 2024-09-19T09:15:29.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.639+0000 7f730d4d0640 1 --2- 172.21.15.18:0/342967389 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f72e806c2b0 0x7f72e806e770 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:29.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.639+0000 7f730d4d0640 1 --2- 172.21.15.18:0/342967389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73080d17c0 0x7f7308156940 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:29.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.639+0000 7f730d4d0640 1 --2- 172.21.15.18:0/342967389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73080d01a0 0x7f73080c9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:29.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.639+0000 7f730d4d0640 1 --2- 172.21.15.18:0/342967389 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73080c90f0 0x7f73080b8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:29.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.639+0000 7f730d4d0640 1 -- 172.21.15.18:0/342967389 >> 172.21.15.18:0/342967389 conn(0x7f73080b4660 msgr2=0x7f73080cd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:29.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.640+0000 7f730d4d0640 1 -- 172.21.15.18:0/342967389 shutdown_connections 2024-09-19T09:15:29.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.640+0000 7f730d4d0640 1 -- 172.21.15.18:0/342967389 wait complete. 2024-09-19T09:15:29.656 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T09:15:29.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.770+0000 7f4b6f703640 1 Processor -- start 2024-09-19T09:15:29.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.770+0000 7f4b6f703640 1 -- start start 2024-09-19T09:15:29.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.771+0000 7f4b6f703640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4b6815c670 0x7f4b680b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:29.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.771+0000 7f4b6f703640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b6806deb0 0x7f4b68160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:29.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.771+0000 7f4b6f703640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b680b6a60 con 0x7f4b6815f1a0 2024-09-19T09:15:29.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.771+0000 7f4b6f703640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4b680b6d40 con 0x7f4b6815c670 2024-09-19T09:15:29.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.771+0000 7f4b6f703640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4b680b7020 con 0x7f4b6806deb0 2024-09-19T09:15:29.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.772+0000 7f4b6dca0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b6806deb0 0x7f4b68160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:29.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.772+0000 7f4b6d49f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4b6815c670 0x7f4b680b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:29.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.772+0000 7f4b6cc9e640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f4b6815f1a0 0x7f4b6806d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:52314/0 (socket says 172.21.15.18:52314) 2024-09-19T09:15:29.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.772+0000 7f4b6dca0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b6806deb0 0x7f4b68160300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:53896/0 (socket says 172.21.15.18:53896) 2024-09-19T09:15:29.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.772+0000 7f4b6cc9e640 1 -- 172.21.15.18:0/3717764530 learned_addr learned my addr 172.21.15.18:0/3717764530 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:15:29.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.772+0000 7f4b6dca0640 1 -- 172.21.15.18:0/3717764530 >> v2:172.21.15.162:3300/0 conn(0x7f4b6815c670 msgr2=0x7f4b680b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:29.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.772+0000 7f4b6dca0640 1 --2- 172.21.15.18:0/3717764530 >> v2:172.21.15.162:3300/0 conn(0x7f4b6815c670 0x7f4b680b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:29.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.772+0000 7f4b6dca0640 1 -- 172.21.15.18:0/3717764530 >> v1:172.21.15.162:6789/0 conn(0x7f4b6815f1a0 legacy=0x7f4b6806d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:29.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.772+0000 7f4b67fff640 1 -- 172.21.15.18:0/3717764530 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1602394691 0 0) 0x7f4b680b6a60 con 0x7f4b6815f1a0 2024-09-19T09:15:29.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.772+0000 7f4b6dca0640 1 -- 172.21.15.18:0/3717764530 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b680b7300 con 0x7f4b6806deb0 2024-09-19T09:15:29.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.772+0000 7f4b6d49f640 1 --2- 172.21.15.18:0/3717764530 >> v2:172.21.15.162:3300/0 conn(0x7f4b6815c670 0x7f4b680b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:15:29.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.773+0000 7f4b6dca0640 1 --2- 172.21.15.18:0/3717764530 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b6806deb0 0x7f4b68160300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4b60009d90 tx=0x7f4b6002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3c9a1ee7e25e6886 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:29.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.773+0000 7f4b67fff640 1 -- 172.21.15.18:0/3717764530 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b60007740 con 0x7f4b6806deb0 2024-09-19T09:15:29.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.773+0000 7f4b67fff640 1 -- 172.21.15.18:0/3717764530 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b600078e0 con 0x7f4b6806deb0 2024-09-19T09:15:29.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.773+0000 7f4b67fff640 1 -- 172.21.15.18:0/3717764530 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b60007cb0 con 0x7f4b6806deb0 2024-09-19T09:15:29.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.774+0000 7f4b6f703640 1 -- 172.21.15.18:0/3717764530 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b6806deb0 msgr2=0x7f4b68160300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:29.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.774+0000 7f4b6f703640 1 --2- 172.21.15.18:0/3717764530 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b6806deb0 0x7f4b68160300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4b60009d90 tx=0x7f4b6002a660 comp rx=0 tx=0).stop 2024-09-19T09:15:29.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.774+0000 7f4b6f703640 1 -- 172.21.15.18:0/3717764530 shutdown_connections 2024-09-19T09:15:29.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.774+0000 7f4b6f703640 1 --2- 172.21.15.18:0/3717764530 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b6806deb0 0x7f4b68160300 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:29.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.774+0000 7f4b6f703640 1 --2- 172.21.15.18:0/3717764530 >> v2:172.21.15.162:3300/0 conn(0x7f4b6815c670 0x7f4b680b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:29.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.774+0000 7f4b6f703640 1 -- 172.21.15.18:0/3717764530 >> 172.21.15.18:0/3717764530 conn(0x7f4b6809b9d0 msgr2=0x7f4b6809bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:29.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.774+0000 7f4b6f703640 1 -- 172.21.15.18:0/3717764530 shutdown_connections 2024-09-19T09:15:29.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.774+0000 7f4b6f703640 1 -- 172.21.15.18:0/3717764530 wait complete. 2024-09-19T09:15:29.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.775+0000 7f4b6f703640 1 Processor -- start 2024-09-19T09:15:29.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.775+0000 7f4b6f703640 1 -- start start 2024-09-19T09:15:29.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.776+0000 7f4b6f703640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b6806deb0 0x7f4b680ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:29.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.776+0000 7f4b6f703640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b6815c670 0x7f4b68156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:29.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.776+0000 7f4b6f703640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b6815f1a0 0x7f4b68157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:29.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.776+0000 7f4b6f703640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4b680b7b00 con 0x7f4b6815c670 2024-09-19T09:15:29.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.776+0000 7f4b6f703640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4b6809c560 con 0x7f4b6806deb0 2024-09-19T09:15:29.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.776+0000 7f4b6f703640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4b680cbcf0 con 0x7f4b6815f1a0 2024-09-19T09:15:29.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.776+0000 7f4b6cc9e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b6815c670 0x7f4b68156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:29.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.776+0000 7f4b6cc9e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b6815c670 0x7f4b68156b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52692/0 (socket says 172.21.15.18:52692) 2024-09-19T09:15:29.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.776+0000 7f4b6cc9e640 1 -- 172.21.15.18:0/574840693 learned_addr learned my addr 172.21.15.18:0/574840693 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:29.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.776+0000 7f4b6dca0640 1 --2- 172.21.15.18:0/574840693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b6815f1a0 0x7f4b68157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:29.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.776+0000 7f4b6d49f640 1 --2- 172.21.15.18:0/574840693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b6806deb0 0x7f4b680ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:29.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.776+0000 7f4b6cc9e640 1 -- 172.21.15.18:0/574840693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b6815f1a0 msgr2=0x7f4b68157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:29.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.776+0000 7f4b6cc9e640 1 --2- 172.21.15.18:0/574840693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b6815f1a0 0x7f4b68157060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:29.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.776+0000 7f4b6cc9e640 1 -- 172.21.15.18:0/574840693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b6806deb0 msgr2=0x7f4b680ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:29.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.776+0000 7f4b6cc9e640 1 --2- 172.21.15.18:0/574840693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b6806deb0 0x7f4b680ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:29.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.776+0000 7f4b6cc9e640 1 -- 172.21.15.18:0/574840693 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b680cbf40 con 0x7f4b6815c670 2024-09-19T09:15:29.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.776+0000 7f4b6dca0640 1 --2- 172.21.15.18:0/574840693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b6815f1a0 0x7f4b68157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:15:29.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.776+0000 7f4b6cc9e640 1 --2- 172.21.15.18:0/574840693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b6815c670 0x7f4b68156b20 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c00c430 tx=0x7f4b5c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:29.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.777+0000 7f4b65ffb640 1 -- 172.21.15.18:0/574840693 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c0074e0 con 0x7f4b6815c670 2024-09-19T09:15:29.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.777+0000 7f4b65ffb640 1 -- 172.21.15.18:0/574840693 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b5c0047e0 con 0x7f4b6815c670 2024-09-19T09:15:29.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.777+0000 7f4b6f703640 1 -- 172.21.15.18:0/574840693 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b680cc220 con 0x7f4b6815c670 2024-09-19T09:15:29.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.777+0000 7f4b65ffb640 1 -- 172.21.15.18:0/574840693 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c004bd0 con 0x7f4b6815c670 2024-09-19T09:15:29.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.777+0000 7f4b6f703640 1 -- 172.21.15.18:0/574840693 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b680cc7e0 con 0x7f4b6815c670 2024-09-19T09:15:29.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.778+0000 7f4b6f703640 1 -- 172.21.15.18:0/574840693 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b6815ca50 con 0x7f4b6815c670 2024-09-19T09:15:29.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.778+0000 7f4b65ffb640 1 -- 172.21.15.18:0/574840693 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4b5c011070 con 0x7f4b6815c670 2024-09-19T09:15:29.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.779+0000 7f4b65ffb640 1 --2- 172.21.15.18:0/574840693 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4b5406c2e0 0x7f4b5406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:29.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.779+0000 7f4b65ffb640 1 -- 172.21.15.18:0/574840693 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5227+0+0 (secure 0 0 0) 0x7f4b5c08ace0 con 0x7f4b6815c670 2024-09-19T09:15:29.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.779+0000 7f4b6d49f640 1 --2- 172.21.15.18:0/574840693 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4b5406c2e0 0x7f4b5406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:29.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.780+0000 7f4b6d49f640 1 --2- 172.21.15.18:0/574840693 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4b5406c2e0 0x7f4b5406e7a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009560 tx=0x7f4b58009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:29.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.783+0000 7f4b65ffb640 1 -- 172.21.15.18:0/574840693 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f4b5c059070 con 0x7f4b6815c670 2024-09-19T09:15:29.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:29.959+0000 7f4b6f703640 1 -- 172.21.15.18:0/574840693 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f4b6806d940 con 0x7f4b6815c670 2024-09-19T09:15:30.430 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:15:30.433 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:15:30.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.638+0000 7f4b65ffb640 1 -- 172.21.15.18:0/574840693 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v68) ==== 170+0+0 (secure 0 0 0) 0x7f4b5c05d370 con 0x7f4b6815c670 2024-09-19T09:15:30.638 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' created 2024-09-19T09:15:30.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.641+0000 7f4b6f703640 1 -- 172.21.15.18:0/574840693 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4b5406c2e0 msgr2=0x7f4b5406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:30.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.641+0000 7f4b6f703640 1 --2- 172.21.15.18:0/574840693 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4b5406c2e0 0x7f4b5406e7a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009560 tx=0x7f4b58009190 comp rx=0 tx=0).stop 2024-09-19T09:15:30.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.641+0000 7f4b6f703640 1 -- 172.21.15.18:0/574840693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b6815c670 msgr2=0x7f4b68156b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:30.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.641+0000 7f4b6f703640 1 --2- 172.21.15.18:0/574840693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b6815c670 0x7f4b68156b20 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c00c430 tx=0x7f4b5c00c8f0 comp rx=0 tx=0).stop 2024-09-19T09:15:30.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.648+0000 7f4b6f703640 1 -- 172.21.15.18:0/574840693 shutdown_connections 2024-09-19T09:15:30.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.648+0000 7f4b6f703640 1 --2- 172.21.15.18:0/574840693 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4b5406c2e0 0x7f4b5406e7a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:30.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.648+0000 7f4b6f703640 1 --2- 172.21.15.18:0/574840693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4b6815f1a0 0x7f4b68157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:30.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.648+0000 7f4b6f703640 1 --2- 172.21.15.18:0/574840693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4b6815c670 0x7f4b68156b20 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:30.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.648+0000 7f4b6f703640 1 --2- 172.21.15.18:0/574840693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4b6806deb0 0x7f4b680ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:30.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.648+0000 7f4b6f703640 1 -- 172.21.15.18:0/574840693 >> 172.21.15.18:0/574840693 conn(0x7f4b6809b9d0 msgr2=0x7f4b6806cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:30.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.649+0000 7f4b6f703640 1 -- 172.21.15.18:0/574840693 shutdown_connections 2024-09-19T09:15:30.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.650+0000 7f4b6f703640 1 -- 172.21.15.18:0/574840693 wait complete. 2024-09-19T09:15:30.664 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T09:15:30.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.772+0000 7f35016dd640 1 Processor -- start 2024-09-19T09:15:30.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.772+0000 7f35016dd640 1 -- start start 2024-09-19T09:15:30.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.773+0000 7f35016dd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f34fc06e280 0x7f34fc073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:30.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.773+0000 7f35016dd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34fc0d1010 0x7f34fc0ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:30.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.773+0000 7f35016dd640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34fc0722d0 con 0x7f34fc071df0 2024-09-19T09:15:30.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.773+0000 7f35016dd640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f34fc0738b0 con 0x7f34fc06e280 2024-09-19T09:15:30.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.773+0000 7f35016dd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f34fc0725b0 con 0x7f34fc0d1010 2024-09-19T09:15:30.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.773+0000 7f34faffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f34fc06e280 0x7f34fc073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:30.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.773+0000 7f34faffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f34fc06e280 0x7f34fc073370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52704/0 (socket says 172.21.15.18:52704) 2024-09-19T09:15:30.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.773+0000 7f34faffd640 1 -- 172.21.15.18:0/1999612140 learned_addr learned my addr 172.21.15.18:0/1999612140 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:30.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.773+0000 7f34fb7fe640 1 --2- 172.21.15.18:0/1999612140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34fc0d1010 0x7f34fc0ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:30.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.773+0000 7f34faffd640 1 -- 172.21.15.18:0/1999612140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34fc0d1010 msgr2=0x7f34fc0ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:30.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.773+0000 7f34faffd640 1 --2- 172.21.15.18:0/1999612140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34fc0d1010 0x7f34fc0ce3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:30.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.773+0000 7f34faffd640 1 -- 172.21.15.18:0/1999612140 >> v1:172.21.15.162:6789/0 conn(0x7f34fc071df0 legacy=0x7f34fc06e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:30.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.773+0000 7f34faffd640 1 -- 172.21.15.18:0/1999612140 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34fc072890 con 0x7f34fc06e280 2024-09-19T09:15:30.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.774+0000 7f34faffd640 1 --2- 172.21.15.18:0/1999612140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34fc06e280 0x7f34fc073370 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f34ec009870 tx=0x7f34ec02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f25e21cc3ba366 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:30.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.774+0000 7f34f9ffb640 1 -- 172.21.15.18:0/1999612140 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ec037070 con 0x7f34fc06e280 2024-09-19T09:15:30.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.774+0000 7f34f9ffb640 1 -- 172.21.15.18:0/1999612140 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34ec032440 con 0x7f34fc06e280 2024-09-19T09:15:30.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.774+0000 7f34f9ffb640 1 -- 172.21.15.18:0/1999612140 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ec032810 con 0x7f34fc06e280 2024-09-19T09:15:30.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.775+0000 7f35016dd640 1 -- 172.21.15.18:0/1999612140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34fc06e280 msgr2=0x7f34fc073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:30.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.775+0000 7f35016dd640 1 --2- 172.21.15.18:0/1999612140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34fc06e280 0x7f34fc073370 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f34ec009870 tx=0x7f34ec02a210 comp rx=0 tx=0).stop 2024-09-19T09:15:30.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.775+0000 7f35016dd640 1 -- 172.21.15.18:0/1999612140 shutdown_connections 2024-09-19T09:15:30.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.775+0000 7f35016dd640 1 --2- 172.21.15.18:0/1999612140 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34fc0d1010 0x7f34fc0ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:30.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.775+0000 7f35016dd640 1 --2- 172.21.15.18:0/1999612140 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34fc06e280 0x7f34fc073370 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:30.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.775+0000 7f35016dd640 1 -- 172.21.15.18:0/1999612140 >> 172.21.15.18:0/1999612140 conn(0x7f34fc06bc10 msgr2=0x7f34fc06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:30.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.775+0000 7f35016dd640 1 -- 172.21.15.18:0/1999612140 shutdown_connections 2024-09-19T09:15:30.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.775+0000 7f35016dd640 1 -- 172.21.15.18:0/1999612140 wait complete. 2024-09-19T09:15:30.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.776+0000 7f35016dd640 1 Processor -- start 2024-09-19T09:15:30.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.776+0000 7f35016dd640 1 -- start start 2024-09-19T09:15:30.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.777+0000 7f35016dd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34fc06e280 0x7f34fc150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:30.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.777+0000 7f35016dd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34fc071df0 0x7f34fc1513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:30.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.777+0000 7f35016dd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34fc0d1010 0x7f34fc1534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:30.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.777+0000 7f35016dd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f34fc15db60 con 0x7f34fc06e280 2024-09-19T09:15:30.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.777+0000 7f35016dd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f34fc072e50 con 0x7f34fc071df0 2024-09-19T09:15:30.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.777+0000 7f35016dd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f34fc0d14c0 con 0x7f34fc0d1010 2024-09-19T09:15:30.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.777+0000 7f34faffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34fc06e280 0x7f34fc150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:30.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.777+0000 7f34faffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34fc06e280 0x7f34fc150290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52718/0 (socket says 172.21.15.18:52718) 2024-09-19T09:15:30.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.777+0000 7f34faffd640 1 -- 172.21.15.18:0/2095342875 learned_addr learned my addr 172.21.15.18:0/2095342875 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:30.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.777+0000 7f34fb7fe640 1 --2- 172.21.15.18:0/2095342875 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34fc0d1010 0x7f34fc1534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:30.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.777+0000 7f34fa7fc640 1 --2- 172.21.15.18:0/2095342875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34fc071df0 0x7f34fc1513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:30.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.777+0000 7f34faffd640 1 -- 172.21.15.18:0/2095342875 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34fc0d1010 msgr2=0x7f34fc1534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:30.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.777+0000 7f34faffd640 1 --2- 172.21.15.18:0/2095342875 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34fc0d1010 0x7f34fc1534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:30.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.777+0000 7f34faffd640 1 -- 172.21.15.18:0/2095342875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34fc071df0 msgr2=0x7f34fc1513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:30.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.777+0000 7f34faffd640 1 --2- 172.21.15.18:0/2095342875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34fc071df0 0x7f34fc1513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:30.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.777+0000 7f34faffd640 1 -- 172.21.15.18:0/2095342875 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34fc151e30 con 0x7f34fc06e280 2024-09-19T09:15:30.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.777+0000 7f34fa7fc640 1 --2- 172.21.15.18:0/2095342875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34fc071df0 0x7f34fc1513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:30.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.777+0000 7f34fb7fe640 1 --2- 172.21.15.18:0/2095342875 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34fc0d1010 0x7f34fc1534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:30.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.777+0000 7f34faffd640 1 --2- 172.21.15.18:0/2095342875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34fc06e280 0x7f34fc150290 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f34ec009870 tx=0x7f34ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:30.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.778+0000 7f34e37fe640 1 -- 172.21.15.18:0/2095342875 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ec041020 con 0x7f34fc06e280 2024-09-19T09:15:30.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.778+0000 7f34e37fe640 1 -- 172.21.15.18:0/2095342875 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34ec030970 con 0x7f34fc06e280 2024-09-19T09:15:30.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.778+0000 7f35016dd640 1 -- 172.21.15.18:0/2095342875 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34fc0b3d30 con 0x7f34fc06e280 2024-09-19T09:15:30.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.778+0000 7f34e37fe640 1 -- 172.21.15.18:0/2095342875 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34ec037040 con 0x7f34fc06e280 2024-09-19T09:15:30.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.778+0000 7f35016dd640 1 -- 172.21.15.18:0/2095342875 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34fc0b42f0 con 0x7f34fc06e280 2024-09-19T09:15:30.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.779+0000 7f35016dd640 1 -- 172.21.15.18:0/2095342875 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34fc0b3b40 con 0x7f34fc06e280 2024-09-19T09:15:30.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.779+0000 7f34e37fe640 1 -- 172.21.15.18:0/2095342875 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f34ec044020 con 0x7f34fc06e280 2024-09-19T09:15:30.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.780+0000 7f34e37fe640 1 --2- 172.21.15.18:0/2095342875 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f34e806c2b0 0x7f34e806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:30.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.780+0000 7f34e37fe640 1 -- 172.21.15.18:0/2095342875 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5609+0+0 (secure 0 0 0) 0x7f34ec0abd60 con 0x7f34fc06e280 2024-09-19T09:15:30.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.780+0000 7f34fa7fc640 1 --2- 172.21.15.18:0/2095342875 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f34e806c2b0 0x7f34e806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:30.782 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.781+0000 7f34fa7fc640 1 --2- 172.21.15.18:0/2095342875 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f34e806c2b0 0x7f34e806e770 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f34fc156ef0 tx=0x7f34f0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:30.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.785+0000 7f34e37fe640 1 -- 172.21.15.18:0/2095342875 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f34ec04b030 con 0x7f34fc06e280 2024-09-19T09:15:30.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:30.998+0000 7f35016dd640 1 -- 172.21.15.18:0/2095342875 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f34fc073370 con 0x7f34fc06e280 2024-09-19T09:15:31.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.649+0000 7f34e37fe640 1 -- 172.21.15.18:0/2095342875 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v26) ==== 172+0+0 (secure 0 0 0) 0x7f34ec07a5c0 con 0x7f34fc06e280 2024-09-19T09:15:31.650 INFO:teuthology.orchestra.run.smithi018.stderr:new fs with metadata pool 8 and data pool 9 2024-09-19T09:15:31.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.654+0000 7f35016dd640 1 -- 172.21.15.18:0/2095342875 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f34e806c2b0 msgr2=0x7f34e806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:31.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.654+0000 7f35016dd640 1 --2- 172.21.15.18:0/2095342875 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f34e806c2b0 0x7f34e806e770 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f34fc156ef0 tx=0x7f34f0009040 comp rx=0 tx=0).stop 2024-09-19T09:15:31.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.654+0000 7f35016dd640 1 -- 172.21.15.18:0/2095342875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34fc06e280 msgr2=0x7f34fc150290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:31.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.654+0000 7f35016dd640 1 --2- 172.21.15.18:0/2095342875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34fc06e280 0x7f34fc150290 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f34ec009870 tx=0x7f34ec0046c0 comp rx=0 tx=0).stop 2024-09-19T09:15:31.655 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.654+0000 7f35016dd640 1 -- 172.21.15.18:0/2095342875 shutdown_connections 2024-09-19T09:15:31.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.654+0000 7f35016dd640 1 --2- 172.21.15.18:0/2095342875 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f34e806c2b0 0x7f34e806e770 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:31.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.654+0000 7f35016dd640 1 --2- 172.21.15.18:0/2095342875 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34fc0d1010 0x7f34fc1534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:31.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.654+0000 7f35016dd640 1 --2- 172.21.15.18:0/2095342875 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34fc071df0 0x7f34fc1513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:31.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.654+0000 7f35016dd640 1 --2- 172.21.15.18:0/2095342875 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34fc06e280 0x7f34fc150290 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:31.656 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.654+0000 7f35016dd640 1 -- 172.21.15.18:0/2095342875 >> 172.21.15.18:0/2095342875 conn(0x7f34fc06bc10 msgr2=0x7f34fc15def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:31.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.658+0000 7f35016dd640 1 -- 172.21.15.18:0/2095342875 shutdown_connections 2024-09-19T09:15:31.659 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.658+0000 7f35016dd640 1 -- 172.21.15.18:0/2095342875 wait complete. 2024-09-19T09:15:31.684 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:15:31.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.788+0000 7f8db9ad7640 1 Processor -- start 2024-09-19T09:15:31.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.788+0000 7f8db9ad7640 1 -- start start 2024-09-19T09:15:31.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.789+0000 7f8db9ad7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8db415ef80 0x7f8db40b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:31.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.789+0000 7f8db9ad7640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8db406d730 0x7f8db40cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:31.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.789+0000 7f8db9ad7640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8db40cf910 0x7f8db40d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:31.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.789+0000 7f8db9ad7640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f8db40cd7d0 con 0x7f8db40cf910 2024-09-19T09:15:31.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.789+0000 7f8db9ad7640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8db40cd1a0 con 0x7f8db406d730 2024-09-19T09:15:31.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.789+0000 7f8db9ad7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8db406dc30 con 0x7f8db415ef80 2024-09-19T09:15:31.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.789+0000 7f8db3fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8db40cf910 0x7f8db40d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:31.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.789+0000 7f8db3fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8db40cf910 0x7f8db40d0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52720/0 (socket says 172.21.15.18:52720) 2024-09-19T09:15:31.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.789+0000 7f8db3fff640 1 -- 172.21.15.18:0/1551861242 learned_addr learned my addr 172.21.15.18:0/1551861242 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:31.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.789+0000 7f8db37fe640 1 --2- 172.21.15.18:0/1551861242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8db415ef80 0x7f8db40b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:31.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.789+0000 7f8db2ffd640 1 --2- 172.21.15.18:0/1551861242 >> v2:172.21.15.162:3300/0 conn(0x7f8db406d730 0x7f8db40cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:31.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.790+0000 7f8db3fff640 1 -- 172.21.15.18:0/1551861242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8db415ef80 msgr2=0x7f8db40b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:31.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.790+0000 7f8db3fff640 1 --2- 172.21.15.18:0/1551861242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8db415ef80 0x7f8db40b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:31.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.790+0000 7f8db3fff640 1 -- 172.21.15.18:0/1551861242 >> v2:172.21.15.162:3300/0 conn(0x7f8db406d730 msgr2=0x7f8db40cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:31.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.790+0000 7f8db3fff640 1 --2- 172.21.15.18:0/1551861242 >> v2:172.21.15.162:3300/0 conn(0x7f8db406d730 0x7f8db40cf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:31.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.790+0000 7f8db3fff640 1 -- 172.21.15.18:0/1551861242 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db406df10 con 0x7f8db40cf910 2024-09-19T09:15:31.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.790+0000 7f8db3fff640 1 --2- 172.21.15.18:0/1551861242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8db40cf910 0x7f8db40d0ce0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f8db40729b0 tx=0x7f8dac02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=574ab5e476aea6b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:31.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.791+0000 7f8db27fc640 1 -- 172.21.15.18:0/1551861242 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac036070 con 0x7f8db40cf910 2024-09-19T09:15:31.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.791+0000 7f8db27fc640 1 -- 172.21.15.18:0/1551861242 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dac031600 con 0x7f8db40cf910 2024-09-19T09:15:31.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.791+0000 7f8db27fc640 1 -- 172.21.15.18:0/1551861242 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dac0319d0 con 0x7f8db40cf910 2024-09-19T09:15:31.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.791+0000 7f8db9ad7640 1 -- 172.21.15.18:0/1551861242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8db40cf910 msgr2=0x7f8db40d0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:31.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.791+0000 7f8db9ad7640 1 --2- 172.21.15.18:0/1551861242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8db40cf910 0x7f8db40d0ce0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f8db40729b0 tx=0x7f8dac02a6a0 comp rx=0 tx=0).stop 2024-09-19T09:15:31.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.791+0000 7f8db9ad7640 1 -- 172.21.15.18:0/1551861242 shutdown_connections 2024-09-19T09:15:31.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.791+0000 7f8db9ad7640 1 --2- 172.21.15.18:0/1551861242 >> v2:172.21.15.162:3300/0 conn(0x7f8db406d730 0x7f8db40cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:31.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.791+0000 7f8db9ad7640 1 --2- 172.21.15.18:0/1551861242 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8db40cf910 0x7f8db40d0ce0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:31.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.791+0000 7f8db9ad7640 1 --2- 172.21.15.18:0/1551861242 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8db415ef80 0x7f8db40b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:31.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.791+0000 7f8db9ad7640 1 -- 172.21.15.18:0/1551861242 >> 172.21.15.18:0/1551861242 conn(0x7f8db40b4700 msgr2=0x7f8db40b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:31.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.791+0000 7f8db9ad7640 1 -- 172.21.15.18:0/1551861242 shutdown_connections 2024-09-19T09:15:31.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.791+0000 7f8db9ad7640 1 -- 172.21.15.18:0/1551861242 wait complete. 2024-09-19T09:15:31.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.792+0000 7f8db9ad7640 1 Processor -- start 2024-09-19T09:15:31.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.793+0000 7f8db9ad7640 1 -- start start 2024-09-19T09:15:31.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.793+0000 7f8db9ad7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8db406d730 0x7f8db40cca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:31.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.793+0000 7f8db9ad7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8db40cf910 0x7f8db40c7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:31.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.793+0000 7f8db9ad7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8db415ef80 0x7f8db415c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:31.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.793+0000 7f8db9ad7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8db40d0120 con 0x7f8db406d730 2024-09-19T09:15:31.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.793+0000 7f8db9ad7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8db415f360 con 0x7f8db415ef80 2024-09-19T09:15:31.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.793+0000 7f8db9ad7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8db40d1220 con 0x7f8db40cf910 2024-09-19T09:15:31.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.793+0000 7f8db37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8db406d730 0x7f8db40cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:31.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.793+0000 7f8db37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8db406d730 0x7f8db40cca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52736/0 (socket says 172.21.15.18:52736) 2024-09-19T09:15:31.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.793+0000 7f8db37fe640 1 -- 172.21.15.18:0/38627078 learned_addr learned my addr 172.21.15.18:0/38627078 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:31.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.793+0000 7f8db2ffd640 1 --2- 172.21.15.18:0/38627078 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8db40cf910 0x7f8db40c7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:31.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.794+0000 7f8db3fff640 1 --2- 172.21.15.18:0/38627078 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8db415ef80 0x7f8db415c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:31.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.794+0000 7f8db37fe640 1 -- 172.21.15.18:0/38627078 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8db40cf910 msgr2=0x7f8db40c7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:31.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.794+0000 7f8db37fe640 1 --2- 172.21.15.18:0/38627078 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8db40cf910 0x7f8db40c7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:31.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.794+0000 7f8db37fe640 1 -- 172.21.15.18:0/38627078 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8db415ef80 msgr2=0x7f8db415c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:31.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.794+0000 7f8db37fe640 1 --2- 172.21.15.18:0/38627078 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8db415ef80 0x7f8db415c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:31.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.794+0000 7f8db37fe640 1 -- 172.21.15.18:0/38627078 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db40b44a0 con 0x7f8db406d730 2024-09-19T09:15:31.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.794+0000 7f8db37fe640 1 --2- 172.21.15.18:0/38627078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8db406d730 0x7f8db40cca20 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8da400e870 tx=0x7f8da400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:31.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.794+0000 7f8d9bfff640 1 -- 172.21.15.18:0/38627078 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da4017070 con 0x7f8db406d730 2024-09-19T09:15:31.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.794+0000 7f8d9bfff640 1 -- 172.21.15.18:0/38627078 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8da400c8e0 con 0x7f8db406d730 2024-09-19T09:15:31.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.794+0000 7f8db9ad7640 1 -- 172.21.15.18:0/38627078 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8db40b41c0 con 0x7f8db406d730 2024-09-19T09:15:31.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.794+0000 7f8d9bfff640 1 -- 172.21.15.18:0/38627078 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da400ccd0 con 0x7f8db406d730 2024-09-19T09:15:31.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.794+0000 7f8db9ad7640 1 -- 172.21.15.18:0/38627078 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8db40c6a30 con 0x7f8db406d730 2024-09-19T09:15:31.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.795+0000 7f8db9ad7640 1 -- 172.21.15.18:0/38627078 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8db40d0ce0 con 0x7f8db406d730 2024-09-19T09:15:31.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.796+0000 7f8d9bfff640 1 -- 172.21.15.18:0/38627078 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8da401a070 con 0x7f8db406d730 2024-09-19T09:15:31.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.796+0000 7f8d9bfff640 1 --2- 172.21.15.18:0/38627078 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8da006c2b0 0x7f8da006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:31.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.796+0000 7f8d9bfff640 1 -- 172.21.15.18:0/38627078 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f8da408b130 con 0x7f8db406d730 2024-09-19T09:15:31.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.796+0000 7f8db2ffd640 1 --2- 172.21.15.18:0/38627078 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8da006c2b0 0x7f8da006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:31.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.797+0000 7f8db2ffd640 1 --2- 172.21.15.18:0/38627078 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8da006c2b0 0x7f8da006e770 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8db40cf0f0 tx=0x7f8da8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:31.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.801+0000 7f8d9bfff640 1 -- 172.21.15.18:0/38627078 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8da4059250 con 0x7f8db406d730 2024-09-19T09:15:31.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.977+0000 7f8db9ad7640 1 -- 172.21.15.18:0/38627078 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8db4162650 con 0x7f8db406d730 2024-09-19T09:15:31.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.979+0000 7f8d9bfff640 1 -- 172.21.15.18:0/38627078 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+16750 (secure 0 0 0) 0x7f8da405d550 con 0x7f8db406d730 2024-09-19T09:15:31.979 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:15:31.979 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":69,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:15:30.999671+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:15:28.664467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-19T09:15:29.990340+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:15:31.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.981+0000 7f8db9ad7640 1 -- 172.21.15.18:0/38627078 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8da006c2b0 msgr2=0x7f8da006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:31.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.981+0000 7f8db9ad7640 1 --2- 172.21.15.18:0/38627078 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8da006c2b0 0x7f8da006e770 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8db40cf0f0 tx=0x7f8da8009190 comp rx=0 tx=0).stop 2024-09-19T09:15:31.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.981+0000 7f8db9ad7640 1 -- 172.21.15.18:0/38627078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8db406d730 msgr2=0x7f8db40cca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:31.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.981+0000 7f8db9ad7640 1 --2- 172.21.15.18:0/38627078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8db406d730 0x7f8db40cca20 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f8da400e870 tx=0x7f8da400ed30 comp rx=0 tx=0).stop 2024-09-19T09:15:31.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.981+0000 7f8db9ad7640 1 -- 172.21.15.18:0/38627078 shutdown_connections 2024-09-19T09:15:31.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.981+0000 7f8db9ad7640 1 --2- 172.21.15.18:0/38627078 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8da006c2b0 0x7f8da006e770 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:31.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.981+0000 7f8db9ad7640 1 --2- 172.21.15.18:0/38627078 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8db415ef80 0x7f8db415c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:31.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.981+0000 7f8db9ad7640 1 --2- 172.21.15.18:0/38627078 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8db40cf910 0x7f8db40c7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:31.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.981+0000 7f8db9ad7640 1 --2- 172.21.15.18:0/38627078 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8db406d730 0x7f8db40cca20 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:31.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.981+0000 7f8db9ad7640 1 -- 172.21.15.18:0/38627078 >> 172.21.15.18:0/38627078 conn(0x7f8db40b4700 msgr2=0x7f8db415db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:31.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.981+0000 7f8db9ad7640 1 -- 172.21.15.18:0/38627078 shutdown_connections 2024-09-19T09:15:31.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:31.981+0000 7f8db9ad7640 1 -- 172.21.15.18:0/38627078 wait complete. 2024-09-19T09:15:31.993 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:15:32.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.095+0000 7fbbb4311640 1 Processor -- start 2024-09-19T09:15:32.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.095+0000 7fbbb4311640 1 -- start start 2024-09-19T09:15:32.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.096+0000 7fbbb4311640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbbac15ed50 0x7fbbac0d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:32.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.096+0000 7fbbb4311640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbac0d31b0 con 0x7fbbac0d1aa0 2024-09-19T09:15:32.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.096+0000 7fbbb4311640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbac0d3490 con 0x7fbbac0d09d0 2024-09-19T09:15:32.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.096+0000 7fbbb4311640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fbbac0d1ee0 con 0x7fbbac15ed50 2024-09-19T09:15:32.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.096+0000 7fbbb18ac640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fbbac0d1aa0 0x7fbbac0b4af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57152/0 (socket says 172.21.15.18:57152) 2024-09-19T09:15:32.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.096+0000 7fbbb18ac640 1 -- 172.21.15.18:0/3326524475 learned_addr learned my addr 172.21.15.18:0/3326524475 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:15:32.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.096+0000 7fbbb20ad640 1 --2- 172.21.15.18:0/3326524475 >> v2:172.21.15.162:3300/0 conn(0x7fbbac15ed50 0x7fbbac0d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:32.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.096+0000 7fbbb10ab640 1 -- 172.21.15.18:0/3326524475 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2708962671 0 0) 0x7fbbac0d31b0 con 0x7fbbac0d1aa0 2024-09-19T09:15:32.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.096+0000 7fbbb10ab640 1 -- 172.21.15.18:0/3326524475 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb98003520 con 0x7fbbac0d1aa0 2024-09-19T09:15:32.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.096+0000 7fbbb20ad640 1 -- 172.21.15.18:0/3326524475 >> v1:172.21.15.162:6789/0 conn(0x7fbbac0d09d0 legacy=0x7fbbac0b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:32.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.096+0000 7fbbb20ad640 1 -- 172.21.15.18:0/3326524475 >> v1:172.21.15.18:6789/0 conn(0x7fbbac0d1aa0 legacy=0x7fbbac0b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:32.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.096+0000 7fbbb20ad640 1 -- 172.21.15.18:0/3326524475 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbac0d3770 con 0x7fbbac15ed50 2024-09-19T09:15:32.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.097+0000 7fbbb20ad640 1 --2- 172.21.15.18:0/3326524475 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbac15ed50 0x7fbbac0d1560 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbba80097a0 tx=0x7fbba802a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1db9c8e52981e2fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:32.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.097+0000 7fbbb10ab640 1 -- 172.21.15.18:0/3326524475 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba8037070 con 0x7fbbac15ed50 2024-09-19T09:15:32.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.097+0000 7fbbb10ab640 1 -- 172.21.15.18:0/3326524475 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba8032640 con 0x7fbbac15ed50 2024-09-19T09:15:32.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.097+0000 7fbbb10ab640 1 -- 172.21.15.18:0/3326524475 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba80329f0 con 0x7fbbac15ed50 2024-09-19T09:15:32.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.098+0000 7fbbb4311640 1 -- 172.21.15.18:0/3326524475 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbac15ed50 msgr2=0x7fbbac0d1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:32.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.098+0000 7fbbb4311640 1 --2- 172.21.15.18:0/3326524475 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbac15ed50 0x7fbbac0d1560 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fbba80097a0 tx=0x7fbba802a2c0 comp rx=0 tx=0).stop 2024-09-19T09:15:32.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.098+0000 7fbbb4311640 1 -- 172.21.15.18:0/3326524475 shutdown_connections 2024-09-19T09:15:32.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.098+0000 7fbbb4311640 1 --2- 172.21.15.18:0/3326524475 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbac15ed50 0x7fbbac0d1560 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:32.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.098+0000 7fbbb4311640 1 -- 172.21.15.18:0/3326524475 >> 172.21.15.18:0/3326524475 conn(0x7fbbac0d4bd0 msgr2=0x7fbbac0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:32.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.098+0000 7fbbb4311640 1 -- 172.21.15.18:0/3326524475 shutdown_connections 2024-09-19T09:15:32.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.098+0000 7fbbb4311640 1 -- 172.21.15.18:0/3326524475 wait complete. 2024-09-19T09:15:32.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.099+0000 7fbbb4311640 1 Processor -- start 2024-09-19T09:15:32.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.099+0000 7fbbb4311640 1 -- start start 2024-09-19T09:15:32.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.100+0000 7fbbb4311640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbac0d09d0 0x7fbbac156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:32.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.100+0000 7fbbb4311640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbac0d1aa0 0x7fbbac15f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:32.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.100+0000 7fbbb4311640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbac15ed50 0x7fbbac0b6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:32.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.100+0000 7fbbb4311640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbbac0d3d30 con 0x7fbbac0d09d0 2024-09-19T09:15:32.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.100+0000 7fbbb4311640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbbac0b45d0 con 0x7fbbac15ed50 2024-09-19T09:15:32.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.100+0000 7fbbb4311640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbbac15f130 con 0x7fbbac0d1aa0 2024-09-19T09:15:32.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.100+0000 7fbbb20ad640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbac0d09d0 0x7fbbac156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:32.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.100+0000 7fbbb20ad640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbac0d09d0 0x7fbbac156210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52742/0 (socket says 172.21.15.18:52742) 2024-09-19T09:15:32.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.100+0000 7fbbb20ad640 1 -- 172.21.15.18:0/3028768447 learned_addr learned my addr 172.21.15.18:0/3028768447 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:32.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.100+0000 7fbbb28ae640 1 --2- 172.21.15.18:0/3028768447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbac15ed50 0x7fbbac0b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:32.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.100+0000 7fbbb18ac640 1 --2- 172.21.15.18:0/3028768447 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbac0d1aa0 0x7fbbac15f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:32.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.100+0000 7fbbb20ad640 1 -- 172.21.15.18:0/3028768447 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbac0d1aa0 msgr2=0x7fbbac15f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:32.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.100+0000 7fbbb20ad640 1 --2- 172.21.15.18:0/3028768447 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbac0d1aa0 0x7fbbac15f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:32.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.100+0000 7fbbb20ad640 1 -- 172.21.15.18:0/3028768447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbac15ed50 msgr2=0x7fbbac0b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:32.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.100+0000 7fbbb20ad640 1 --2- 172.21.15.18:0/3028768447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbac15ed50 0x7fbbac0b6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:32.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.100+0000 7fbbb20ad640 1 -- 172.21.15.18:0/3028768447 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbac156750 con 0x7fbbac0d09d0 2024-09-19T09:15:32.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.100+0000 7fbbb18ac640 1 --2- 172.21.15.18:0/3028768447 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbac0d1aa0 0x7fbbac15f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:32.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.100+0000 7fbbb20ad640 1 --2- 172.21.15.18:0/3028768447 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbac0d09d0 0x7fbbac156210 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fbba80097a0 tx=0x7fbba80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:32.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.101+0000 7fbba2ffd640 1 -- 172.21.15.18:0/3028768447 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba8037050 con 0x7fbbac0d09d0 2024-09-19T09:15:32.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.101+0000 7fbbb4311640 1 -- 172.21.15.18:0/3028768447 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbac0c8870 con 0x7fbbac0d09d0 2024-09-19T09:15:32.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.101+0000 7fbba2ffd640 1 -- 172.21.15.18:0/3028768447 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbba8038040 con 0x7fbbac0d09d0 2024-09-19T09:15:32.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.101+0000 7fbba2ffd640 1 -- 172.21.15.18:0/3028768447 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba8004250 con 0x7fbbac0d09d0 2024-09-19T09:15:32.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.101+0000 7fbbb4311640 1 -- 172.21.15.18:0/3028768447 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbac0c8df0 con 0x7fbbac0d09d0 2024-09-19T09:15:32.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.102+0000 7fbbb4311640 1 -- 172.21.15.18:0/3028768447 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbac0d0e60 con 0x7fbbac0d09d0 2024-09-19T09:15:32.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.102+0000 7fbba2ffd640 1 -- 172.21.15.18:0/3028768447 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbba8030900 con 0x7fbbac0d09d0 2024-09-19T09:15:32.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.103+0000 7fbba2ffd640 1 --2- 172.21.15.18:0/3028768447 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbb9006c2b0 0x7fbb9006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:32.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.103+0000 7fbba2ffd640 1 -- 172.21.15.18:0/3028768447 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fbba80abed0 con 0x7fbbac0d09d0 2024-09-19T09:15:32.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.103+0000 7fbbb18ac640 1 --2- 172.21.15.18:0/3028768447 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbb9006c2b0 0x7fbb9006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:32.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.104+0000 7fbbb18ac640 1 --2- 172.21.15.18:0/3028768447 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbb9006c2b0 0x7fbb9006e770 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbbac15df50 tx=0x7fbb9c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:32.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.107+0000 7fbba2ffd640 1 -- 172.21.15.18:0/3028768447 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fbbac156750 con 0x7fbbac0d09d0 2024-09-19T09:15:32.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.283+0000 7fbbb4311640 1 -- 172.21.15.18:0/3028768447 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbbac075500 con 0x7fbbac0d09d0 2024-09-19T09:15:32.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.284+0000 7fbba2ffd640 1 -- 172.21.15.18:0/3028768447 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+16750 (secure 0 0 0) 0x7fbba807a770 con 0x7fbbac0d09d0 2024-09-19T09:15:32.285 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:15:32.285 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":69,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:15:30.999671+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:15:28.664467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-19T09:15:29.990340+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:15:32.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.286+0000 7fbbb4311640 1 -- 172.21.15.18:0/3028768447 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbb9006c2b0 msgr2=0x7fbb9006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:32.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.286+0000 7fbbb4311640 1 --2- 172.21.15.18:0/3028768447 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbb9006c2b0 0x7fbb9006e770 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fbbac15df50 tx=0x7fbb9c009040 comp rx=0 tx=0).stop 2024-09-19T09:15:32.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.286+0000 7fbbb4311640 1 -- 172.21.15.18:0/3028768447 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbac0d09d0 msgr2=0x7fbbac156210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:32.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.286+0000 7fbbb4311640 1 --2- 172.21.15.18:0/3028768447 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbac0d09d0 0x7fbbac156210 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fbba80097a0 tx=0x7fbba80046c0 comp rx=0 tx=0).stop 2024-09-19T09:15:32.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.286+0000 7fbbb4311640 1 -- 172.21.15.18:0/3028768447 shutdown_connections 2024-09-19T09:15:32.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.286+0000 7fbbb4311640 1 --2- 172.21.15.18:0/3028768447 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbb9006c2b0 0x7fbb9006e770 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:32.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.286+0000 7fbbb4311640 1 --2- 172.21.15.18:0/3028768447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbbac15ed50 0x7fbbac0b6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:32.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.286+0000 7fbbb4311640 1 --2- 172.21.15.18:0/3028768447 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbbac0d1aa0 0x7fbbac15f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:32.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.286+0000 7fbbb4311640 1 --2- 172.21.15.18:0/3028768447 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbbac0d09d0 0x7fbbac156210 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:32.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.286+0000 7fbbb4311640 1 -- 172.21.15.18:0/3028768447 >> 172.21.15.18:0/3028768447 conn(0x7fbbac0d4bd0 msgr2=0x7fbbac0d4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:32.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.286+0000 7fbbb4311640 1 -- 172.21.15.18:0/3028768447 shutdown_connections 2024-09-19T09:15:32.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.286+0000 7fbbb4311640 1 -- 172.21.15.18:0/3028768447 wait complete. 2024-09-19T09:15:32.298 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-19T09:15:32.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.403+0000 7fc94b3df640 1 Processor -- start 2024-09-19T09:15:32.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.403+0000 7fc94b3df640 1 -- start start 2024-09-19T09:15:32.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.404+0000 7fc94b3df640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc94406f7e0 0x7fc94406fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:32.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.404+0000 7fc94b3df640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc944070100 con 0x7fc9440af8d0 2024-09-19T09:15:32.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.404+0000 7fc94b3df640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc94415fef0 con 0x7fc9440afd30 2024-09-19T09:15:32.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.404+0000 7fc94b3df640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc9440b6f20 con 0x7fc94406f7e0 2024-09-19T09:15:32.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.404+0000 7fc94897a640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc9440af8d0 0x7fc9440b73b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57166/0 (socket says 172.21.15.18:57166) 2024-09-19T09:15:32.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.404+0000 7fc94897a640 1 -- 172.21.15.18:0/277961257 learned_addr learned my addr 172.21.15.18:0/277961257 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:15:32.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.404+0000 7fc94917b640 1 --2- 172.21.15.18:0/277961257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc94406f7e0 0x7fc94406fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:32.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.405+0000 7fc93bfff640 1 -- 172.21.15.18:0/277961257 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3423787892 0 0) 0x7fc944070100 con 0x7fc9440af8d0 2024-09-19T09:15:32.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.405+0000 7fc93bfff640 1 -- 172.21.15.18:0/277961257 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc930003520 con 0x7fc9440af8d0 2024-09-19T09:15:32.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.405+0000 7fc93bfff640 1 -- 172.21.15.18:0/277961257 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2452363708 0 0) 0x7fc930003520 con 0x7fc9440af8d0 2024-09-19T09:15:32.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.405+0000 7fc93bfff640 1 -- 172.21.15.18:0/277961257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc94406f7e0 msgr2=0x7fc94406fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:32.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.405+0000 7fc93bfff640 1 --2- 172.21.15.18:0/277961257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc94406f7e0 0x7fc94406fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:32.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.405+0000 7fc93bfff640 1 -- 172.21.15.18:0/277961257 >> v1:172.21.15.162:6789/0 conn(0x7fc9440afd30 legacy=0x7fc94415f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:32.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.405+0000 7fc93bfff640 1 -- 172.21.15.18:0/277961257 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9440b68d0 con 0x7fc9440af8d0 2024-09-19T09:15:32.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.405+0000 7fc93bfff640 1 -- 172.21.15.18:0/277961257 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fc934001670 con 0x7fc9440af8d0 2024-09-19T09:15:32.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.405+0000 7fc93bfff640 1 -- 172.21.15.18:0/277961257 >> v1:172.21.15.18:6789/0 conn(0x7fc9440af8d0 legacy=0x7fc9440b73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:32.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.405+0000 7fc93bfff640 1 --2- 172.21.15.18:0/277961257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc94406f7e0 0x7fc9300039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:32.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.405+0000 7fc93bfff640 1 --2- 172.21.15.18:0/277961257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc930003f60 0x7fc930004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:32.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.405+0000 7fc93bfff640 1 --2- 172.21.15.18:0/277961257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc930004d40 0x7fc9300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:32.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.405+0000 7fc93bfff640 1 -- 172.21.15.18:0/277961257 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc9440b6f20 con 0x7fc930003f60 2024-09-19T09:15:32.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.405+0000 7fc93bfff640 1 -- 172.21.15.18:0/277961257 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc93000baa0 con 0x7fc930004d40 2024-09-19T09:15:32.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.405+0000 7fc93bfff640 1 -- 172.21.15.18:0/277961257 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc93000bca0 con 0x7fc94406f7e0 2024-09-19T09:15:32.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.405+0000 7fc94897a640 1 --2- 172.21.15.18:0/277961257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc930003f60 0x7fc930004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:32.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.405+0000 7fc94917b640 1 --2- 172.21.15.18:0/277961257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc94406f7e0 0x7fc9300039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:32.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.405+0000 7fc94997c640 1 --2- 172.21.15.18:0/277961257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc930004d40 0x7fc9300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:32.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.405+0000 7fc94897a640 1 -- 172.21.15.18:0/277961257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc94406f7e0 msgr2=0x7fc9300039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:32.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.405+0000 7fc94897a640 1 --2- 172.21.15.18:0/277961257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc94406f7e0 0x7fc9300039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:32.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.405+0000 7fc94897a640 1 -- 172.21.15.18:0/277961257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc930004d40 msgr2=0x7fc9300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:32.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.405+0000 7fc94897a640 1 --2- 172.21.15.18:0/277961257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc930004d40 0x7fc9300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:32.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.405+0000 7fc94897a640 1 -- 172.21.15.18:0/277961257 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc930003520 con 0x7fc930003f60 2024-09-19T09:15:32.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.405+0000 7fc94997c640 1 --2- 172.21.15.18:0/277961257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc930004d40 0x7fc9300051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:32.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.406+0000 7fc94897a640 1 --2- 172.21.15.18:0/277961257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc930003f60 0x7fc930004800 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc93400c210 tx=0x7fc930005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=733e7736471117b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:32.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.406+0000 7fc93bfff640 1 -- 172.21.15.18:0/277961257 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc934007d10 con 0x7fc930003f60 2024-09-19T09:15:32.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.406+0000 7fc93bfff640 1 -- 172.21.15.18:0/277961257 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9340058d0 con 0x7fc930003f60 2024-09-19T09:15:32.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.406+0000 7fc93bfff640 1 -- 172.21.15.18:0/277961257 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc934005d40 con 0x7fc930003f60 2024-09-19T09:15:32.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.407+0000 7fc94b3df640 1 -- 172.21.15.18:0/277961257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc930003f60 msgr2=0x7fc930004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:32.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.407+0000 7fc94b3df640 1 --2- 172.21.15.18:0/277961257 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc930003f60 0x7fc930004800 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc93400c210 tx=0x7fc930005830 comp rx=0 tx=0).stop 2024-09-19T09:15:32.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.407+0000 7fc94997c640 1 -- 172.21.15.18:0/277961257 reap_dead start 2024-09-19T09:15:32.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.407+0000 7fc94b3df640 1 -- 172.21.15.18:0/277961257 shutdown_connections 2024-09-19T09:15:32.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.407+0000 7fc94b3df640 1 -- 172.21.15.18:0/277961257 >> 172.21.15.18:0/277961257 conn(0x7fc944073c80 msgr2=0x7fc94409b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:32.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.407+0000 7fc94b3df640 1 -- 172.21.15.18:0/277961257 shutdown_connections 2024-09-19T09:15:32.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.407+0000 7fc94b3df640 1 -- 172.21.15.18:0/277961257 wait complete. 2024-09-19T09:15:32.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.408+0000 7fc94b3df640 1 Processor -- start 2024-09-19T09:15:32.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.408+0000 7fc94b3df640 1 -- start start 2024-09-19T09:15:32.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.409+0000 7fc94b3df640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc930003f60 0x7fc9440cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:32.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.409+0000 7fc94b3df640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9440b3b00 0x7fc9440b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:32.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.409+0000 7fc94b3df640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9440ce200 0x7fc9440b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:32.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.409+0000 7fc94b3df640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc9441594a0 con 0x7fc9440ce200 2024-09-19T09:15:32.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.409+0000 7fc94b3df640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc9440b65e0 con 0x7fc9440b3b00 2024-09-19T09:15:32.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.409+0000 7fc94b3df640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc944159620 con 0x7fc930003f60 2024-09-19T09:15:32.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.409+0000 7fc94997c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9440ce200 0x7fc9440b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:32.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.409+0000 7fc94997c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9440ce200 0x7fc9440b2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52764/0 (socket says 172.21.15.18:52764) 2024-09-19T09:15:32.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.409+0000 7fc94997c640 1 -- 172.21.15.18:0/757575408 learned_addr learned my addr 172.21.15.18:0/757575408 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:32.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.409+0000 7fc94917b640 1 --2- 172.21.15.18:0/757575408 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc930003f60 0x7fc9440cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:32.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.409+0000 7fc94897a640 1 --2- 172.21.15.18:0/757575408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9440b3b00 0x7fc9440b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:32.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.409+0000 7fc94997c640 1 -- 172.21.15.18:0/757575408 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc930003f60 msgr2=0x7fc9440cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:32.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.409+0000 7fc94997c640 1 --2- 172.21.15.18:0/757575408 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc930003f60 0x7fc9440cdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:32.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.409+0000 7fc94997c640 1 -- 172.21.15.18:0/757575408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9440b3b00 msgr2=0x7fc9440b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.409+0000 7fc94997c640 1 --2- 172.21.15.18:0/757575408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9440b3b00 0x7fc9440b29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.409+0000 7fc94997c640 1 -- 172.21.15.18:0/757575408 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9440ce6a0 con 0x7fc9440ce200 2024-09-19T09:15:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.410+0000 7fc94997c640 1 --2- 172.21.15.18:0/757575408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9440ce200 0x7fc9440b2f30 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc93c000f80 tx=0x7fc93c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.410+0000 7fc939ffb640 1 -- 172.21.15.18:0/757575408 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93c006b50 con 0x7fc9440ce200 2024-09-19T09:15:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.410+0000 7fc939ffb640 1 -- 172.21.15.18:0/757575408 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc93c006d10 con 0x7fc9440ce200 2024-09-19T09:15:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.410+0000 7fc94b3df640 1 -- 172.21.15.18:0/757575408 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9440ce980 con 0x7fc9440ce200 2024-09-19T09:15:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.410+0000 7fc939ffb640 1 -- 172.21.15.18:0/757575408 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93c003970 con 0x7fc9440ce200 2024-09-19T09:15:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.410+0000 7fc94b3df640 1 -- 172.21.15.18:0/757575408 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9440b3470 con 0x7fc9440ce200 2024-09-19T09:15:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.411+0000 7fc94b3df640 1 -- 172.21.15.18:0/757575408 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc94406fbc0 con 0x7fc9440ce200 2024-09-19T09:15:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.411+0000 7fc939ffb640 1 -- 172.21.15.18:0/757575408 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc93c01a020 con 0x7fc9440ce200 2024-09-19T09:15:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.412+0000 7fc939ffb640 1 --2- 172.21.15.18:0/757575408 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc92806c2b0 0x7fc92806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.412+0000 7fc939ffb640 1 -- 172.21.15.18:0/757575408 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fc93c08ab00 con 0x7fc9440ce200 2024-09-19T09:15:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.412+0000 7fc94917b640 1 --2- 172.21.15.18:0/757575408 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc92806c2b0 0x7fc92806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:32.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.413+0000 7fc94917b640 1 --2- 172.21.15.18:0/757575408 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc92806c2b0 0x7fc92806e770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc940009b00 tx=0x7fc940008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:32.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.416+0000 7fc939ffb640 1 -- 172.21.15.18:0/757575408 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc93c059270 con 0x7fc9440ce200 2024-09-19T09:15:32.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.630+0000 7fc94b3df640 1 -- 172.21.15.18:0/757575408 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc9440b7e60 con 0x7fc9440ce200 2024-09-19T09:15:32.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.665+0000 7fc939ffb640 1 -- 172.21.15.18:0/757575408 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v27) ==== 118+0+0 (secure 0 0 0) 0x7fc93c058b70 con 0x7fc9440ce200 2024-09-19T09:15:32.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.668+0000 7fc94b3df640 1 -- 172.21.15.18:0/757575408 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc92806c2b0 msgr2=0x7fc92806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:32.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.668+0000 7fc94b3df640 1 --2- 172.21.15.18:0/757575408 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc92806c2b0 0x7fc92806e770 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc940009b00 tx=0x7fc940008040 comp rx=0 tx=0).stop 2024-09-19T09:15:32.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.668+0000 7fc94b3df640 1 -- 172.21.15.18:0/757575408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9440ce200 msgr2=0x7fc9440b2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:32.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.668+0000 7fc94b3df640 1 --2- 172.21.15.18:0/757575408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9440ce200 0x7fc9440b2f30 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc93c000f80 tx=0x7fc93c00eb90 comp rx=0 tx=0).stop 2024-09-19T09:15:32.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.668+0000 7fc94b3df640 1 -- 172.21.15.18:0/757575408 shutdown_connections 2024-09-19T09:15:32.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.668+0000 7fc94b3df640 1 --2- 172.21.15.18:0/757575408 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc92806c2b0 0x7fc92806e770 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:32.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.668+0000 7fc94b3df640 1 --2- 172.21.15.18:0/757575408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9440ce200 0x7fc9440b2f30 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:32.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.668+0000 7fc94b3df640 1 --2- 172.21.15.18:0/757575408 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9440b3b00 0x7fc9440b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:32.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.668+0000 7fc94b3df640 1 --2- 172.21.15.18:0/757575408 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc930003f60 0x7fc9440cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:32.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.668+0000 7fc94b3df640 1 -- 172.21.15.18:0/757575408 >> 172.21.15.18:0/757575408 conn(0x7fc944073c80 msgr2=0x7fc94406d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:32.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.668+0000 7fc94b3df640 1 -- 172.21.15.18:0/757575408 shutdown_connections 2024-09-19T09:15:32.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.668+0000 7fc94b3df640 1 -- 172.21.15.18:0/757575408 wait complete. 2024-09-19T09:15:32.680 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-19T09:15:32.680 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-19T09:15:32.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.784+0000 7f37bfe17640 1 Processor -- start 2024-09-19T09:15:32.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.784+0000 7f37bfe17640 1 -- start start 2024-09-19T09:15:32.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.785+0000 7f37bfe17640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37b815ede0 0x7f37b80d5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:32.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.785+0000 7f37bfe17640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f37b80d5840 0x7f37b80d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:32.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.785+0000 7f37bfe17640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37b80d3270 con 0x7f37b80d1a20 2024-09-19T09:15:32.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.785+0000 7f37bfe17640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f37b80d34e0 con 0x7f37b80d5840 2024-09-19T09:15:32.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.785+0000 7f37bfe17640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f37b80d37c0 con 0x7f37b815ede0 2024-09-19T09:15:32.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.785+0000 7f37bdbb3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37b815ede0 0x7f37b80d5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:32.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.785+0000 7f37bd3b2640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f37b80d5840 0x7f37b80d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:32.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.785+0000 7f37bdbb3640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37b815ede0 0x7f37b80d5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:53990/0 (socket says 172.21.15.18:53990) 2024-09-19T09:15:32.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.785+0000 7f37be3b4640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f37b80d1a20 0x7f37b80cf8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:52334/0 (socket says 172.21.15.18:52334) 2024-09-19T09:15:32.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.785+0000 7f37bdbb3640 1 -- 172.21.15.18:0/1819786563 learned_addr learned my addr 172.21.15.18:0/1819786563 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:32.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.785+0000 7f37bd3b2640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f37b80d5840 0x7f37b80d14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:46236/0 (socket says 172.21.15.18:46236) 2024-09-19T09:15:32.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.786+0000 7f37bdbb3640 1 -- 172.21.15.18:0/1819786563 >> v2:172.21.15.162:3300/0 conn(0x7f37b80d5840 msgr2=0x7f37b80d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:32.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.786+0000 7f37bdbb3640 1 --2- 172.21.15.18:0/1819786563 >> v2:172.21.15.162:3300/0 conn(0x7f37b80d5840 0x7f37b80d14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:32.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.786+0000 7f37bdbb3640 1 -- 172.21.15.18:0/1819786563 >> v1:172.21.15.162:6789/0 conn(0x7f37b80d1a20 legacy=0x7f37b80cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:32.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.786+0000 7f37bdbb3640 1 -- 172.21.15.18:0/1819786563 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b80d3aa0 con 0x7f37b815ede0 2024-09-19T09:15:32.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.786+0000 7f37bd3b2640 1 --2- 172.21.15.18:0/1819786563 >> v2:172.21.15.162:3300/0 conn(0x7f37b80d5840 0x7f37b80d14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:15:32.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.787+0000 7f37bdbb3640 1 --2- 172.21.15.18:0/1819786563 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37b815ede0 0x7f37b80d5300 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f37b4009e50 tx=0x7f37b402a7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd131466eaf87080 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:32.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.787+0000 7f37bcbb1640 1 -- 172.21.15.18:0/1819786563 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b4036070 con 0x7f37b815ede0 2024-09-19T09:15:32.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.787+0000 7f37bcbb1640 1 -- 172.21.15.18:0/1819786563 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b4031600 con 0x7f37b815ede0 2024-09-19T09:15:32.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.787+0000 7f37bcbb1640 1 -- 172.21.15.18:0/1819786563 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b40319d0 con 0x7f37b815ede0 2024-09-19T09:15:32.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.787+0000 7f37bfe17640 1 -- 172.21.15.18:0/1819786563 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37b815ede0 msgr2=0x7f37b80d5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:32.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.787+0000 7f37bfe17640 1 --2- 172.21.15.18:0/1819786563 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37b815ede0 0x7f37b80d5300 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f37b4009e50 tx=0x7f37b402a7a0 comp rx=0 tx=0).stop 2024-09-19T09:15:32.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.787+0000 7f37bfe17640 1 -- 172.21.15.18:0/1819786563 shutdown_connections 2024-09-19T09:15:32.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.787+0000 7f37bfe17640 1 --2- 172.21.15.18:0/1819786563 >> v2:172.21.15.162:3300/0 conn(0x7f37b80d5840 0x7f37b80d14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:32.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.787+0000 7f37bfe17640 1 --2- 172.21.15.18:0/1819786563 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37b815ede0 0x7f37b80d5300 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:32.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.787+0000 7f37bfe17640 1 -- 172.21.15.18:0/1819786563 >> 172.21.15.18:0/1819786563 conn(0x7f37b809df30 msgr2=0x7f37b80d4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:32.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.787+0000 7f37bfe17640 1 -- 172.21.15.18:0/1819786563 shutdown_connections 2024-09-19T09:15:32.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.787+0000 7f37bfe17640 1 -- 172.21.15.18:0/1819786563 wait complete. 2024-09-19T09:15:32.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.789+0000 7f37bfe17640 1 Processor -- start 2024-09-19T09:15:32.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.789+0000 7f37bfe17640 1 -- start start 2024-09-19T09:15:32.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.789+0000 7f37bfe17640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37b80d1a20 0x7f37b8154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:32.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.789+0000 7f37bfe17640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37b80d5840 0x7f37b80cb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:32.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.789+0000 7f37bfe17640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37b815ede0 0x7f37b81589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:32.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.789+0000 7f37bfe17640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f37b80b41a0 con 0x7f37b80d5840 2024-09-19T09:15:32.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.789+0000 7f37bfe17640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f37b80b4020 con 0x7f37b80d1a20 2024-09-19T09:15:32.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.789+0000 7f37bfe17640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f37b80b57f0 con 0x7f37b815ede0 2024-09-19T09:15:32.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.790+0000 7f37bd3b2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37b80d5840 0x7f37b80cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:32.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.790+0000 7f37bd3b2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37b80d5840 0x7f37b80cb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52772/0 (socket says 172.21.15.18:52772) 2024-09-19T09:15:32.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.790+0000 7f37bd3b2640 1 -- 172.21.15.18:0/595000718 learned_addr learned my addr 172.21.15.18:0/595000718 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:32.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.790+0000 7f37be3b4640 1 --2- 172.21.15.18:0/595000718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37b815ede0 0x7f37b81589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:32.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.790+0000 7f37bdbb3640 1 --2- 172.21.15.18:0/595000718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37b80d1a20 0x7f37b8154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:32.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.790+0000 7f37bd3b2640 1 -- 172.21.15.18:0/595000718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37b815ede0 msgr2=0x7f37b81589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:32.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.790+0000 7f37bd3b2640 1 --2- 172.21.15.18:0/595000718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37b815ede0 0x7f37b81589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:32.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.790+0000 7f37bd3b2640 1 -- 172.21.15.18:0/595000718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37b80d1a20 msgr2=0x7f37b8154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:32.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.790+0000 7f37bd3b2640 1 --2- 172.21.15.18:0/595000718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37b80d1a20 0x7f37b8154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:32.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.790+0000 7f37bd3b2640 1 -- 172.21.15.18:0/595000718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b80b8780 con 0x7f37b80d5840 2024-09-19T09:15:32.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.790+0000 7f37bd3b2640 1 --2- 172.21.15.18:0/595000718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37b80d5840 0x7f37b80cb080 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f37a800ebb0 tx=0x7f37a800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:32.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.790+0000 7f37ae7fc640 1 -- 172.21.15.18:0/595000718 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a8017070 con 0x7f37b80d5840 2024-09-19T09:15:32.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.790+0000 7f37ae7fc640 1 -- 172.21.15.18:0/595000718 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37a800cc30 con 0x7f37b80d5840 2024-09-19T09:15:32.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.790+0000 7f37ae7fc640 1 -- 172.21.15.18:0/595000718 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37a8013470 con 0x7f37b80d5840 2024-09-19T09:15:32.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.790+0000 7f37bfe17640 1 -- 172.21.15.18:0/595000718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37b80c9860 con 0x7f37b80d5840 2024-09-19T09:15:32.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.790+0000 7f37bfe17640 1 -- 172.21.15.18:0/595000718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37b80c9e20 con 0x7f37b80d5840 2024-09-19T09:15:32.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.791+0000 7f37bfe17640 1 -- 172.21.15.18:0/595000718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37b815e940 con 0x7f37b80d5840 2024-09-19T09:15:32.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.792+0000 7f37ae7fc640 1 -- 172.21.15.18:0/595000718 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f37a801a070 con 0x7f37b80d5840 2024-09-19T09:15:32.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.792+0000 7f37ae7fc640 1 --2- 172.21.15.18:0/595000718 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f379c06c2e0 0x7f379c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:32.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.792+0000 7f37ae7fc640 1 -- 172.21.15.18:0/595000718 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7f37a808b6a0 con 0x7f37b80d5840 2024-09-19T09:15:32.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.793+0000 7f37bdbb3640 1 --2- 172.21.15.18:0/595000718 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f379c06c2e0 0x7f379c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:32.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.793+0000 7f37bdbb3640 1 --2- 172.21.15.18:0/595000718 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f379c06c2e0 0x7f379c06e7a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f37b4033000 tx=0x7f37b4009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:32.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:32.796+0000 7f37ae7fc640 1 -- 172.21.15.18:0/595000718 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f37b815e940 con 0x7f37b80d5840 2024-09-19T09:15:33.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.009+0000 7f37bfe17640 1 -- 172.21.15.18:0/595000718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f37b806d710 con 0x7f37b80d5840 2024-09-19T09:15:33.636 INFO:tasks.ceph.mds.a.smithi018.stderr:2024-09-19T09:15:33.636+0000 7f3638ff4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T09:15:33.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.671+0000 7f37ae7fc640 1 -- 172.21.15.18:0/595000718 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7f37b806d710 con 0x7f37b80d5840 2024-09-19T09:15:33.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.674+0000 7f37bfe17640 1 -- 172.21.15.18:0/595000718 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f379c06c2e0 msgr2=0x7f379c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:33.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.674+0000 7f37bfe17640 1 --2- 172.21.15.18:0/595000718 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f379c06c2e0 0x7f379c06e7a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f37b4033000 tx=0x7f37b4009000 comp rx=0 tx=0).stop 2024-09-19T09:15:33.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.674+0000 7f37bfe17640 1 -- 172.21.15.18:0/595000718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37b80d5840 msgr2=0x7f37b80cb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:33.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.674+0000 7f37bfe17640 1 --2- 172.21.15.18:0/595000718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37b80d5840 0x7f37b80cb080 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f37a800ebb0 tx=0x7f37a800c520 comp rx=0 tx=0).stop 2024-09-19T09:15:33.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.674+0000 7f37bfe17640 1 -- 172.21.15.18:0/595000718 shutdown_connections 2024-09-19T09:15:33.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.674+0000 7f37bfe17640 1 --2- 172.21.15.18:0/595000718 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f379c06c2e0 0x7f379c06e7a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:33.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.674+0000 7f37bfe17640 1 --2- 172.21.15.18:0/595000718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37b815ede0 0x7f37b81589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:33.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.674+0000 7f37bfe17640 1 --2- 172.21.15.18:0/595000718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37b80d5840 0x7f37b80cb080 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:33.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.674+0000 7f37bfe17640 1 --2- 172.21.15.18:0/595000718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37b80d1a20 0x7f37b8154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:33.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.674+0000 7f37bfe17640 1 -- 172.21.15.18:0/595000718 >> 172.21.15.18:0/595000718 conn(0x7f37b809df30 msgr2=0x7f37b806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:33.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.674+0000 7f37bfe17640 1 -- 172.21.15.18:0/595000718 shutdown_connections 2024-09-19T09:15:33.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.674+0000 7f37bfe17640 1 -- 172.21.15.18:0/595000718 wait complete. 2024-09-19T09:15:33.688 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-19T09:15:33.688 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:15:33.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.800+0000 7f50ecc8d640 1 Processor -- start 2024-09-19T09:15:33.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.800+0000 7f50ecc8d640 1 -- start start 2024-09-19T09:15:33.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.801+0000 7f50ecc8d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f50e8145290 0x7f50e806f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:33.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.801+0000 7f50ecc8d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50e80ce780 0x7f50e8072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:33.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.801+0000 7f50ecc8d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50e806e3d0 con 0x7f50e8071510 2024-09-19T09:15:33.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.801+0000 7f50ecc8d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f50e806efe0 con 0x7f50e8145290 2024-09-19T09:15:33.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.801+0000 7f50ecc8d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f50e806e6b0 con 0x7f50e80ce780 2024-09-19T09:15:33.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.802+0000 7f50e5d9b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50e80ce780 0x7f50e8072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:33.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.802+0000 7f50e6d9d640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f50e8071510 0x7f50e80b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:52336/0 (socket says 172.21.15.18:52336) 2024-09-19T09:15:33.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.802+0000 7f50e5d9b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50e80ce780 0x7f50e8072830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:53998/0 (socket says 172.21.15.18:53998) 2024-09-19T09:15:33.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.802+0000 7f50e6d9d640 1 -- 172.21.15.18:0/752129756 learned_addr learned my addr 172.21.15.18:0/752129756 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:15:33.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.802+0000 7f50e659c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f50e8145290 0x7f50e806f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:33.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.802+0000 7f50e659c640 1 -- 172.21.15.18:0/752129756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50e80ce780 msgr2=0x7f50e8072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:33.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.802+0000 7f50e659c640 1 --2- 172.21.15.18:0/752129756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50e80ce780 0x7f50e8072830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:33.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.802+0000 7f50e659c640 1 -- 172.21.15.18:0/752129756 >> v1:172.21.15.162:6789/0 conn(0x7f50e8071510 legacy=0x7f50e80b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:33.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.802+0000 7f50e659c640 1 -- 172.21.15.18:0/752129756 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e806e990 con 0x7f50e8145290 2024-09-19T09:15:33.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.803+0000 7f50e659c640 1 --2- 172.21.15.18:0/752129756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50e8145290 0x7f50e806f470 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f50d80097a0 tx=0x7f50d802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0c10fb1c2d90fe4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:33.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.803+0000 7f50e559a640 1 -- 172.21.15.18:0/752129756 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d8037070 con 0x7f50e8145290 2024-09-19T09:15:33.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.803+0000 7f50e559a640 1 -- 172.21.15.18:0/752129756 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50d8032440 con 0x7f50e8145290 2024-09-19T09:15:33.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.803+0000 7f50e559a640 1 -- 172.21.15.18:0/752129756 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50d8032810 con 0x7f50e8145290 2024-09-19T09:15:33.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.804+0000 7f50ecc8d640 1 -- 172.21.15.18:0/752129756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50e8145290 msgr2=0x7f50e806f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:33.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.804+0000 7f50ecc8d640 1 --2- 172.21.15.18:0/752129756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50e8145290 0x7f50e806f470 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f50d80097a0 tx=0x7f50d802a180 comp rx=0 tx=0).stop 2024-09-19T09:15:33.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.804+0000 7f50ecc8d640 1 -- 172.21.15.18:0/752129756 shutdown_connections 2024-09-19T09:15:33.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.804+0000 7f50ecc8d640 1 --2- 172.21.15.18:0/752129756 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50e80ce780 0x7f50e8072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:33.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.804+0000 7f50ecc8d640 1 --2- 172.21.15.18:0/752129756 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50e8145290 0x7f50e806f470 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:33.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.804+0000 7f50ecc8d640 1 -- 172.21.15.18:0/752129756 >> 172.21.15.18:0/752129756 conn(0x7f50e806bc10 msgr2=0x7f50e806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:33.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.804+0000 7f50ecc8d640 1 -- 172.21.15.18:0/752129756 shutdown_connections 2024-09-19T09:15:33.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.804+0000 7f50ecc8d640 1 -- 172.21.15.18:0/752129756 wait complete. 2024-09-19T09:15:33.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.805+0000 7f50ecc8d640 1 Processor -- start 2024-09-19T09:15:33.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.805+0000 7f50ecc8d640 1 -- start start 2024-09-19T09:15:33.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.806+0000 7f50ecc8d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50e8071510 0x7f50e815cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:33.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.806+0000 7f50ecc8d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50e80ce780 0x7f50e813e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:33.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.806+0000 7f50ecc8d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50e8145290 0x7f50e815dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:33.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.806+0000 7f50ecc8d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f50e806df80 con 0x7f50e8145290 2024-09-19T09:15:33.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.806+0000 7f50ecc8d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f50e8145670 con 0x7f50e80ce780 2024-09-19T09:15:33.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.806+0000 7f50ecc8d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f50e806e100 con 0x7f50e8071510 2024-09-19T09:15:33.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.806+0000 7f50e6d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50e8145290 0x7f50e815dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:33.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.806+0000 7f50e659c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50e8071510 0x7f50e815cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:33.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.806+0000 7f50e659c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50e8071510 0x7f50e815cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:54002/0 (socket says 172.21.15.18:54002) 2024-09-19T09:15:33.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.806+0000 7f50e6d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50e8145290 0x7f50e815dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52778/0 (socket says 172.21.15.18:52778) 2024-09-19T09:15:33.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.806+0000 7f50e659c640 1 -- 172.21.15.18:0/2607204994 learned_addr learned my addr 172.21.15.18:0/2607204994 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:33.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.806+0000 7f50e5d9b640 1 --2- 172.21.15.18:0/2607204994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50e80ce780 0x7f50e813e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:33.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.806+0000 7f50e6d9d640 1 -- 172.21.15.18:0/2607204994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50e8071510 msgr2=0x7f50e815cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:33.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.806+0000 7f50e6d9d640 1 --2- 172.21.15.18:0/2607204994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50e8071510 0x7f50e815cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:33.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.806+0000 7f50e6d9d640 1 -- 172.21.15.18:0/2607204994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50e80ce780 msgr2=0x7f50e813e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:33.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.806+0000 7f50e6d9d640 1 --2- 172.21.15.18:0/2607204994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50e80ce780 0x7f50e813e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:33.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.806+0000 7f50e6d9d640 1 -- 172.21.15.18:0/2607204994 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e815e810 con 0x7f50e8145290 2024-09-19T09:15:33.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.806+0000 7f50e5d9b640 1 --2- 172.21.15.18:0/2607204994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50e80ce780 0x7f50e813e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:15:33.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.806+0000 7f50e659c640 1 --2- 172.21.15.18:0/2607204994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50e8071510 0x7f50e815cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:15:33.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.807+0000 7f50e6d9d640 1 --2- 172.21.15.18:0/2607204994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50e8145290 0x7f50e815dd90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f50e000ca70 tx=0x7f50e000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:33.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.807+0000 7f50d6ffd640 1 -- 172.21.15.18:0/2607204994 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e0017070 con 0x7f50e8145290 2024-09-19T09:15:33.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.807+0000 7f50d6ffd640 1 -- 172.21.15.18:0/2607204994 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50e000ab10 con 0x7f50e8145290 2024-09-19T09:15:33.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.807+0000 7f50ecc8d640 1 -- 172.21.15.18:0/2607204994 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50e815c500 con 0x7f50e8145290 2024-09-19T09:15:33.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.807+0000 7f50d6ffd640 1 -- 172.21.15.18:0/2607204994 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50e0012400 con 0x7f50e8145290 2024-09-19T09:15:33.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.807+0000 7f50ecc8d640 1 -- 172.21.15.18:0/2607204994 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50e815cac0 con 0x7f50e8145290 2024-09-19T09:15:33.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.808+0000 7f50ecc8d640 1 -- 172.21.15.18:0/2607204994 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50e806f450 con 0x7f50e8145290 2024-09-19T09:15:33.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.808+0000 7f50d6ffd640 1 -- 172.21.15.18:0/2607204994 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f50e001a070 con 0x7f50e8145290 2024-09-19T09:15:33.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.809+0000 7f50d6ffd640 1 --2- 172.21.15.18:0/2607204994 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f50c806c2b0 0x7f50c806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:33.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.809+0000 7f50d6ffd640 1 -- 172.21.15.18:0/2607204994 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7f50e008afb0 con 0x7f50e8145290 2024-09-19T09:15:33.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.809+0000 7f50e659c640 1 --2- 172.21.15.18:0/2607204994 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f50c806c2b0 0x7f50c806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:33.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.810+0000 7f50e659c640 1 --2- 172.21.15.18:0/2607204994 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f50c806c2b0 0x7f50c806e770 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f50d802a1c0 tx=0x7f50d802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:33.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:33.813+0000 7f50d6ffd640 1 -- 172.21.15.18:0/2607204994 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f50e00590d0 con 0x7f50e8145290 2024-09-19T09:15:34.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.024+0000 7f50ecc8d640 1 -- 172.21.15.18:0/2607204994 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50e81421f0 con 0x7f50e8145290 2024-09-19T09:15:34.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.025+0000 7f50d6ffd640 1 -- 172.21.15.18:0/2607204994 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5229 (secure 0 0 0) 0x7f50e005d3d0 con 0x7f50e8145290 2024-09-19T09:15:34.025 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:15:34.025 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:15:33:667104+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3337833568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3337833568},{"type":"v1","addr":"172.21.15.162:6837","nonce":3337833568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1692924872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1692924872},{"type":"v1","addr":"172.21.15.162:6836","nonce":1692924872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5377,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2351287916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2351287916},{"type":"v1","addr":"172.21.15.18:6834","nonce":2351287916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:15:31.000055+0000","modified":"2024-09-19T09:15:33.010750+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5574},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5574":{"gid":5574,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/1824357592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1824357592},{"type":"v1","addr":"172.21.15.18:6835","nonce":1824357592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5574,"qdb_cluster":[5574]},"id":4}]} 2024-09-19T09:15:34.026 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:15:34.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.026+0000 7f50ecc8d640 1 -- 172.21.15.18:0/2607204994 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f50c806c2b0 msgr2=0x7f50c806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:34.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.026+0000 7f50ecc8d640 1 --2- 172.21.15.18:0/2607204994 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f50c806c2b0 0x7f50c806e770 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f50d802a1c0 tx=0x7f50d802e000 comp rx=0 tx=0).stop 2024-09-19T09:15:34.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.026+0000 7f50ecc8d640 1 -- 172.21.15.18:0/2607204994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50e8145290 msgr2=0x7f50e815dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:34.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.026+0000 7f50ecc8d640 1 --2- 172.21.15.18:0/2607204994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50e8145290 0x7f50e815dd90 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f50e000ca70 tx=0x7f50e000cf30 comp rx=0 tx=0).stop 2024-09-19T09:15:34.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.026+0000 7f50ecc8d640 1 -- 172.21.15.18:0/2607204994 shutdown_connections 2024-09-19T09:15:34.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.026+0000 7f50ecc8d640 1 --2- 172.21.15.18:0/2607204994 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f50c806c2b0 0x7f50c806e770 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.026+0000 7f50ecc8d640 1 --2- 172.21.15.18:0/2607204994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50e8145290 0x7f50e815dd90 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.026+0000 7f50ecc8d640 1 --2- 172.21.15.18:0/2607204994 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50e80ce780 0x7f50e813e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.026+0000 7f50ecc8d640 1 --2- 172.21.15.18:0/2607204994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50e8071510 0x7f50e815cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.027+0000 7f50ecc8d640 1 -- 172.21.15.18:0/2607204994 >> 172.21.15.18:0/2607204994 conn(0x7f50e806bc10 msgr2=0x7f50e8072830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:34.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.027+0000 7f50ecc8d640 1 -- 172.21.15.18:0/2607204994 shutdown_connections 2024-09-19T09:15:34.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.027+0000 7f50ecc8d640 1 -- 172.21.15.18:0/2607204994 wait complete. 2024-09-19T09:15:34.038 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:15:34.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.140+0000 7fc11d25e640 1 Processor -- start 2024-09-19T09:15:34.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.140+0000 7fc11d25e640 1 -- start start 2024-09-19T09:15:34.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.141+0000 7fc11d25e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc11815ef80 0x7fc1180b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:34.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.141+0000 7fc11d25e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1180cfae0 0x7fc1180cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:34.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.141+0000 7fc11d25e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1180cd1a0 con 0x7fc11806d730 2024-09-19T09:15:34.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.141+0000 7fc11d25e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fc1180cd7d0 con 0x7fc11815ef80 2024-09-19T09:15:34.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.141+0000 7fc11d25e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc11806dc30 con 0x7fc1180cfae0 2024-09-19T09:15:34.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.141+0000 7fc116d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc11815ef80 0x7fc1180b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:34.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.141+0000 7fc116d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc11815ef80 0x7fc1180b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52782/0 (socket says 172.21.15.18:52782) 2024-09-19T09:15:34.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.141+0000 7fc116d9d640 1 -- 172.21.15.18:0/520736280 learned_addr learned my addr 172.21.15.18:0/520736280 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:34.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.141+0000 7fc11759e640 1 --2- 172.21.15.18:0/520736280 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1180cfae0 0x7fc1180cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:34.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.141+0000 7fc116d9d640 1 -- 172.21.15.18:0/520736280 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1180cfae0 msgr2=0x7fc1180cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:34.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.141+0000 7fc116d9d640 1 --2- 172.21.15.18:0/520736280 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1180cfae0 0x7fc1180cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.141+0000 7fc116d9d640 1 -- 172.21.15.18:0/520736280 >> v1:172.21.15.162:6789/0 conn(0x7fc11806d730 legacy=0x7fc1180cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:34.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.141+0000 7fc116d9d640 1 -- 172.21.15.18:0/520736280 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc11806df10 con 0x7fc11815ef80 2024-09-19T09:15:34.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.141+0000 7fc11759e640 1 --2- 172.21.15.18:0/520736280 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1180cfae0 0x7fc1180cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:15:34.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.142+0000 7fc116d9d640 1 --2- 172.21.15.18:0/520736280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc11815ef80 0x7fc1180b5220 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc108009870 tx=0x7fc10802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7339877bbf440a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:34.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.142+0000 7fc115d9b640 1 -- 172.21.15.18:0/520736280 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc108037070 con 0x7fc11815ef80 2024-09-19T09:15:34.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.142+0000 7fc115d9b640 1 -- 172.21.15.18:0/520736280 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc108032440 con 0x7fc11815ef80 2024-09-19T09:15:34.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.142+0000 7fc115d9b640 1 -- 172.21.15.18:0/520736280 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc108032810 con 0x7fc11815ef80 2024-09-19T09:15:34.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.142+0000 7fc11d25e640 1 -- 172.21.15.18:0/520736280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc11815ef80 msgr2=0x7fc1180b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:34.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.142+0000 7fc11d25e640 1 --2- 172.21.15.18:0/520736280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc11815ef80 0x7fc1180b5220 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc108009870 tx=0x7fc10802a210 comp rx=0 tx=0).stop 2024-09-19T09:15:34.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.143+0000 7fc11d25e640 1 -- 172.21.15.18:0/520736280 shutdown_connections 2024-09-19T09:15:34.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.143+0000 7fc11d25e640 1 --2- 172.21.15.18:0/520736280 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1180cfae0 0x7fc1180cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.143+0000 7fc11d25e640 1 --2- 172.21.15.18:0/520736280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc11815ef80 0x7fc1180b5220 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.143+0000 7fc11d25e640 1 -- 172.21.15.18:0/520736280 >> 172.21.15.18:0/520736280 conn(0x7fc1180b4700 msgr2=0x7fc1180b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:34.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.143+0000 7fc11d25e640 1 -- 172.21.15.18:0/520736280 shutdown_connections 2024-09-19T09:15:34.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.143+0000 7fc11d25e640 1 -- 172.21.15.18:0/520736280 wait complete. 2024-09-19T09:15:34.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.144+0000 7fc11d25e640 1 Processor -- start 2024-09-19T09:15:34.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.144+0000 7fc11d25e640 1 -- start start 2024-09-19T09:15:34.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.145+0000 7fc11d25e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc11806d730 0x7fc11815c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:34.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.145+0000 7fc11d25e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1180cfae0 0x7fc118161000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:34.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.145+0000 7fc11d25e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc11815ef80 0x7fc11815f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:34.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.145+0000 7fc11d25e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc1180d0120 con 0x7fc11806d730 2024-09-19T09:15:34.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.145+0000 7fc11d25e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc11815f360 con 0x7fc11815ef80 2024-09-19T09:15:34.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.145+0000 7fc11d25e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc1180ce1a0 con 0x7fc1180cfae0 2024-09-19T09:15:34.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.145+0000 7fc116d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc11806d730 0x7fc11815c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:34.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.145+0000 7fc116d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc11806d730 0x7fc11815c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52784/0 (socket says 172.21.15.18:52784) 2024-09-19T09:15:34.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.145+0000 7fc116d9d640 1 -- 172.21.15.18:0/1825396386 learned_addr learned my addr 172.21.15.18:0/1825396386 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:34.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.145+0000 7fc11659c640 1 --2- 172.21.15.18:0/1825396386 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1180cfae0 0x7fc118161000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:34.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.145+0000 7fc11759e640 1 --2- 172.21.15.18:0/1825396386 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc11815ef80 0x7fc11815f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:34.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.145+0000 7fc116d9d640 1 -- 172.21.15.18:0/1825396386 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1180cfae0 msgr2=0x7fc118161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:34.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.145+0000 7fc116d9d640 1 --2- 172.21.15.18:0/1825396386 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1180cfae0 0x7fc118161000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.145+0000 7fc116d9d640 1 -- 172.21.15.18:0/1825396386 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc11815ef80 msgr2=0x7fc11815f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:34.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.145+0000 7fc116d9d640 1 --2- 172.21.15.18:0/1825396386 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc11815ef80 0x7fc11815f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.145+0000 7fc116d9d640 1 -- 172.21.15.18:0/1825396386 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc11815ff60 con 0x7fc11806d730 2024-09-19T09:15:34.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.145+0000 7fc11759e640 1 --2- 172.21.15.18:0/1825396386 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc11815ef80 0x7fc11815f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:34.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.146+0000 7fc116d9d640 1 --2- 172.21.15.18:0/1825396386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc11806d730 0x7fc11815c7f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc1080097c0 tx=0x7fc1080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:34.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.146+0000 7fc0ff7fe640 1 -- 172.21.15.18:0/1825396386 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc108041020 con 0x7fc11806d730 2024-09-19T09:15:34.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.146+0000 7fc0ff7fe640 1 -- 172.21.15.18:0/1825396386 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc108030970 con 0x7fc11806d730 2024-09-19T09:15:34.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.146+0000 7fc11d25e640 1 -- 172.21.15.18:0/1825396386 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc118160240 con 0x7fc11806d730 2024-09-19T09:15:34.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.146+0000 7fc0ff7fe640 1 -- 172.21.15.18:0/1825396386 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc108037040 con 0x7fc11806d730 2024-09-19T09:15:34.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.146+0000 7fc11d25e640 1 -- 172.21.15.18:0/1825396386 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc118160800 con 0x7fc11806d730 2024-09-19T09:15:34.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.147+0000 7fc11d25e640 1 -- 172.21.15.18:0/1825396386 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1180cdc60 con 0x7fc11806d730 2024-09-19T09:15:34.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.147+0000 7fc0ff7fe640 1 -- 172.21.15.18:0/1825396386 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc108044020 con 0x7fc11806d730 2024-09-19T09:15:34.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.148+0000 7fc0ff7fe640 1 --2- 172.21.15.18:0/1825396386 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc10406c2b0 0x7fc10406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:34.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.148+0000 7fc0ff7fe640 1 -- 172.21.15.18:0/1825396386 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7fc1080abce0 con 0x7fc11806d730 2024-09-19T09:15:34.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.148+0000 7fc11659c640 1 --2- 172.21.15.18:0/1825396386 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc10406c2b0 0x7fc10406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:34.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.149+0000 7fc11659c640 1 --2- 172.21.15.18:0/1825396386 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc10406c2b0 0x7fc10406e770 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc1181f7eb0 tx=0x7fc10c007e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:34.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.152+0000 7fc0ff7fe640 1 -- 172.21.15.18:0/1825396386 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc10804b030 con 0x7fc11806d730 2024-09-19T09:15:34.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.329+0000 7fc11d25e640 1 -- 172.21.15.18:0/1825396386 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc1180cff00 con 0x7fc11806d730 2024-09-19T09:15:34.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.330+0000 7fc0ff7fe640 1 -- 172.21.15.18:0/1825396386 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) ==== 74+0+16737 (secure 0 0 0) 0x7fc10807a570 con 0x7fc11806d730 2024-09-19T09:15:34.331 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:15:34.331 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":70,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:15:32.661573+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:15:28.664467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-19T09:15:29.990340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:15:34.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.332+0000 7fc11d25e640 1 -- 172.21.15.18:0/1825396386 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc10406c2b0 msgr2=0x7fc10406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:34.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.332+0000 7fc11d25e640 1 --2- 172.21.15.18:0/1825396386 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc10406c2b0 0x7fc10406e770 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc1181f7eb0 tx=0x7fc10c007e30 comp rx=0 tx=0).stop 2024-09-19T09:15:34.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.332+0000 7fc11d25e640 1 -- 172.21.15.18:0/1825396386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc11806d730 msgr2=0x7fc11815c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:34.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.332+0000 7fc11d25e640 1 --2- 172.21.15.18:0/1825396386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc11806d730 0x7fc11815c7f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc1080097c0 tx=0x7fc1080046c0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.332+0000 7fc11d25e640 1 -- 172.21.15.18:0/1825396386 shutdown_connections 2024-09-19T09:15:34.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.332+0000 7fc11d25e640 1 --2- 172.21.15.18:0/1825396386 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc10406c2b0 0x7fc10406e770 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.332+0000 7fc11d25e640 1 --2- 172.21.15.18:0/1825396386 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc11815ef80 0x7fc11815f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.332+0000 7fc11d25e640 1 --2- 172.21.15.18:0/1825396386 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1180cfae0 0x7fc118161000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.332+0000 7fc11d25e640 1 --2- 172.21.15.18:0/1825396386 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc11806d730 0x7fc11815c7f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.332+0000 7fc11d25e640 1 -- 172.21.15.18:0/1825396386 >> 172.21.15.18:0/1825396386 conn(0x7fc1180b4700 msgr2=0x7fc1180b60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:34.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.332+0000 7fc11d25e640 1 -- 172.21.15.18:0/1825396386 shutdown_connections 2024-09-19T09:15:34.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.332+0000 7fc11d25e640 1 -- 172.21.15.18:0/1825396386 wait complete. 2024-09-19T09:15:34.344 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T09:15:34.344 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:15:34.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.446+0000 7f6c713bd640 1 Processor -- start 2024-09-19T09:15:34.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.446+0000 7f6c713bd640 1 -- start start 2024-09-19T09:15:34.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.447+0000 7f6c713bd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6c6c145290 0x7f6c6c06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:34.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.447+0000 7f6c713bd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c6c0ce780 0x7f6c6c072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:34.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.447+0000 7f6c713bd640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c6c06e3d0 con 0x7f6c6c071510 2024-09-19T09:15:34.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.447+0000 7f6c713bd640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f6c6c06efe0 con 0x7f6c6c145290 2024-09-19T09:15:34.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.447+0000 7f6c713bd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6c6c06e6b0 con 0x7f6c6c0ce780 2024-09-19T09:15:34.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.447+0000 7f6c6affd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6c6c145290 0x7f6c6c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:34.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.447+0000 7f6c6affd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6c6c145290 0x7f6c6c06f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52800/0 (socket says 172.21.15.18:52800) 2024-09-19T09:15:34.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.447+0000 7f6c6affd640 1 -- 172.21.15.18:0/191828050 learned_addr learned my addr 172.21.15.18:0/191828050 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:34.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.447+0000 7f6c6a7fc640 1 --2- 172.21.15.18:0/191828050 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c6c0ce780 0x7f6c6c072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:34.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.447+0000 7f6c6affd640 1 -- 172.21.15.18:0/191828050 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c6c0ce780 msgr2=0x7f6c6c072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:34.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.447+0000 7f6c6affd640 1 --2- 172.21.15.18:0/191828050 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c6c0ce780 0x7f6c6c072830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.447+0000 7f6c6affd640 1 -- 172.21.15.18:0/191828050 >> v1:172.21.15.162:6789/0 conn(0x7f6c6c071510 legacy=0x7f6c6c0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:34.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.447+0000 7f6c6affd640 1 -- 172.21.15.18:0/191828050 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c6c06e990 con 0x7f6c6c145290 2024-09-19T09:15:34.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.447+0000 7f6c6a7fc640 1 --2- 172.21.15.18:0/191828050 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c6c0ce780 0x7f6c6c072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:15:34.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.448+0000 7f6c6affd640 1 --2- 172.21.15.18:0/191828050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c6c145290 0x7f6c6c06f470 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400bb10 tx=0x7f6c6402c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f76533ea4cfbc53 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:34.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.448+0000 7f6c69ffb640 1 -- 172.21.15.18:0/191828050 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c64032790 con 0x7f6c6c145290 2024-09-19T09:15:34.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.448+0000 7f6c69ffb640 1 -- 172.21.15.18:0/191828050 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c64038070 con 0x7f6c6c145290 2024-09-19T09:15:34.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.448+0000 7f6c69ffb640 1 -- 172.21.15.18:0/191828050 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c64032b50 con 0x7f6c6c145290 2024-09-19T09:15:34.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.449+0000 7f6c713bd640 1 -- 172.21.15.18:0/191828050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c6c145290 msgr2=0x7f6c6c06f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:34.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.449+0000 7f6c713bd640 1 --2- 172.21.15.18:0/191828050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c6c145290 0x7f6c6c06f470 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400bb10 tx=0x7f6c6402c8d0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.449+0000 7f6c713bd640 1 -- 172.21.15.18:0/191828050 shutdown_connections 2024-09-19T09:15:34.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.449+0000 7f6c713bd640 1 --2- 172.21.15.18:0/191828050 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c6c0ce780 0x7f6c6c072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.449+0000 7f6c713bd640 1 --2- 172.21.15.18:0/191828050 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c6c145290 0x7f6c6c06f470 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.449+0000 7f6c713bd640 1 -- 172.21.15.18:0/191828050 >> 172.21.15.18:0/191828050 conn(0x7f6c6c06bc10 msgr2=0x7f6c6c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:34.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.449+0000 7f6c713bd640 1 -- 172.21.15.18:0/191828050 shutdown_connections 2024-09-19T09:15:34.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.449+0000 7f6c713bd640 1 -- 172.21.15.18:0/191828050 wait complete. 2024-09-19T09:15:34.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.450+0000 7f6c713bd640 1 Processor -- start 2024-09-19T09:15:34.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.450+0000 7f6c713bd640 1 -- start start 2024-09-19T09:15:34.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.451+0000 7f6c713bd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c6c071510 0x7f6c6c1387d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:34.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.451+0000 7f6c713bd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c6c0ce780 0x7f6c6c1353d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:34.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.451+0000 7f6c713bd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c6c145290 0x7f6c6c13a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:34.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.451+0000 7f6c713bd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c06df80 con 0x7f6c6c145290 2024-09-19T09:15:34.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.451+0000 7f6c713bd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c145670 con 0x7f6c6c0ce780 2024-09-19T09:15:34.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.451+0000 7f6c713bd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6c6c06e100 con 0x7f6c6c071510 2024-09-19T09:15:34.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.451+0000 7f6c6b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c6c145290 0x7f6c6c13a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:34.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.451+0000 7f6c6b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c6c145290 0x7f6c6c13a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52804/0 (socket says 172.21.15.18:52804) 2024-09-19T09:15:34.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.451+0000 7f6c6b7fe640 1 -- 172.21.15.18:0/3802527014 learned_addr learned my addr 172.21.15.18:0/3802527014 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:34.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.451+0000 7f6c6affd640 1 --2- 172.21.15.18:0/3802527014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c6c071510 0x7f6c6c1387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:34.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.451+0000 7f6c6a7fc640 1 --2- 172.21.15.18:0/3802527014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c6c0ce780 0x7f6c6c1353d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:34.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.451+0000 7f6c6b7fe640 1 -- 172.21.15.18:0/3802527014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c6c071510 msgr2=0x7f6c6c1387d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:34.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.451+0000 7f6c6b7fe640 1 --2- 172.21.15.18:0/3802527014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c6c071510 0x7f6c6c1387d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.451+0000 7f6c6b7fe640 1 -- 172.21.15.18:0/3802527014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c6c0ce780 msgr2=0x7f6c6c1353d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:34.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.451+0000 7f6c6b7fe640 1 --2- 172.21.15.18:0/3802527014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c6c0ce780 0x7f6c6c1353d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.451+0000 7f6c6b7fe640 1 -- 172.21.15.18:0/3802527014 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c6c13af80 con 0x7f6c6c145290 2024-09-19T09:15:34.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.452+0000 7f6c6b7fe640 1 --2- 172.21.15.18:0/3802527014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c6c145290 0x7f6c6c13a730 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00b9e0 tx=0x7f6c5c00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:34.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.452+0000 7f6c637fe640 1 -- 172.21.15.18:0/3802527014 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c003b70 con 0x7f6c6c145290 2024-09-19T09:15:34.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.452+0000 7f6c637fe640 1 -- 172.21.15.18:0/3802527014 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c5c003d10 con 0x7f6c6c145290 2024-09-19T09:15:34.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.452+0000 7f6c637fe640 1 -- 172.21.15.18:0/3802527014 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c00cb00 con 0x7f6c6c145290 2024-09-19T09:15:34.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.452+0000 7f6c713bd640 1 -- 172.21.15.18:0/3802527014 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c6c13b260 con 0x7f6c6c145290 2024-09-19T09:15:34.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.452+0000 7f6c713bd640 1 -- 172.21.15.18:0/3802527014 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c6c139b00 con 0x7f6c6c145290 2024-09-19T09:15:34.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.453+0000 7f6c713bd640 1 -- 172.21.15.18:0/3802527014 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c6c06f450 con 0x7f6c6c145290 2024-09-19T09:15:34.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.453+0000 7f6c637fe640 1 -- 172.21.15.18:0/3802527014 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6c5c00cca0 con 0x7f6c6c145290 2024-09-19T09:15:34.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.454+0000 7f6c637fe640 1 --2- 172.21.15.18:0/3802527014 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6c4c06c2b0 0x7f6c4c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:34.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.454+0000 7f6c637fe640 1 -- 172.21.15.18:0/3802527014 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7f6c5c08b0b0 con 0x7f6c6c145290 2024-09-19T09:15:34.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.454+0000 7f6c6affd640 1 --2- 172.21.15.18:0/3802527014 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6c4c06c2b0 0x7f6c4c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:34.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.455+0000 7f6c6affd640 1 --2- 172.21.15.18:0/3802527014 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6c4c06c2b0 0x7f6c4c06e770 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6c64037000 tx=0x7f6c6403e040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:34.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.458+0000 7f6c637fe640 1 -- 172.21.15.18:0/3802527014 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6c5c059260 con 0x7f6c6c145290 2024-09-19T09:15:34.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.630+0000 7f6c713bd640 1 -- 172.21.15.18:0/3802527014 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6c6c1408c0 con 0x7f6c4c06c2b0 2024-09-19T09:15:34.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.637+0000 7f6c637fe640 1 -- 172.21.15.18:0/3802527014 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242219 (secure 0 0 0) 0x7f6c6c1408c0 con 0x7f6c4c06c2b0 2024-09-19T09:15:34.640 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:15:34.642 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:15:34.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.640+0000 7f6c713bd640 1 -- 172.21.15.18:0/3802527014 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6c4c06c2b0 msgr2=0x7f6c4c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:34.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.640+0000 7f6c713bd640 1 --2- 172.21.15.18:0/3802527014 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6c4c06c2b0 0x7f6c4c06e770 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6c64037000 tx=0x7f6c6403e040 comp rx=0 tx=0).stop 2024-09-19T09:15:34.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.640+0000 7f6c713bd640 1 -- 172.21.15.18:0/3802527014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c6c145290 msgr2=0x7f6c6c13a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:34.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.640+0000 7f6c713bd640 1 --2- 172.21.15.18:0/3802527014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c6c145290 0x7f6c6c13a730 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00b9e0 tx=0x7f6c5c00bea0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.640+0000 7f6c713bd640 1 -- 172.21.15.18:0/3802527014 shutdown_connections 2024-09-19T09:15:34.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.640+0000 7f6c713bd640 1 --2- 172.21.15.18:0/3802527014 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6c4c06c2b0 0x7f6c4c06e770 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.640+0000 7f6c713bd640 1 --2- 172.21.15.18:0/3802527014 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c6c145290 0x7f6c6c13a730 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.640+0000 7f6c713bd640 1 --2- 172.21.15.18:0/3802527014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c6c0ce780 0x7f6c6c1353d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.640+0000 7f6c713bd640 1 --2- 172.21.15.18:0/3802527014 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c6c071510 0x7f6c6c1387d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.640+0000 7f6c713bd640 1 -- 172.21.15.18:0/3802527014 >> 172.21.15.18:0/3802527014 conn(0x7f6c6c06bc10 msgr2=0x7f6c6c0719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:34.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.640+0000 7f6c713bd640 1 -- 172.21.15.18:0/3802527014 shutdown_connections 2024-09-19T09:15:34.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.640+0000 7f6c713bd640 1 -- 172.21.15.18:0/3802527014 wait complete. 2024-09-19T09:15:34.652 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2024-09-19T09:15:33.552123+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3882,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558617,"statfs":{"total":1600000000,"available":1596024627,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001079"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646988+0000","last_change":"2024-09-19T09:15:30.646988+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646988+0000","last_undegraded":"2024-09-19T09:15:30.646988+0000","last_fullsized":"2024-09-19T09:15:30.646988+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644359+0000","last_change":"2024-09-19T09:15:30.644359+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644359+0000","last_undegraded":"2024-09-19T09:15:30.644359+0000","last_fullsized":"2024-09-19T09:15:30.644359+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642581+0000","last_change":"2024-09-19T09:15:30.642581+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642581+0000","last_undegraded":"2024-09-19T09:15:30.642581+0000","last_fullsized":"2024-09-19T09:15:30.642581+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643943+0000","last_change":"2024-09-19T09:15:30.643943+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643943+0000","last_undegraded":"2024-09-19T09:15:30.643943+0000","last_fullsized":"2024-09-19T09:15:30.643943+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646618+0000","last_change":"2024-09-19T09:15:30.646618+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646618+0000","last_undegraded":"2024-09-19T09:15:30.646618+0000","last_fullsized":"2024-09-19T09:15:30.646618+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644382+0000","last_change":"2024-09-19T09:15:30.644382+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644382+0000","last_undegraded":"2024-09-19T09:15:30.644382+0000","last_fullsized":"2024-09-19T09:15:30.644382+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644922+0000","last_change":"2024-09-19T09:15:30.644922+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644922+0000","last_undegraded":"2024-09-19T09:15:30.644922+0000","last_fullsized":"2024-09-19T09:15:30.644922+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644580+0000","last_change":"2024-09-19T09:15:30.644580+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644580+0000","last_undegraded":"2024-09-19T09:15:30.644580+0000","last_fullsized":"2024-09-19T09:15:30.644580+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643746+0000","last_change":"2024-09-19T09:15:30.643746+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643746+0000","last_undegraded":"2024-09-19T09:15:30.643746+0000","last_fullsized":"2024-09-19T09:15:30.643746+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643603+0000","last_change":"2024-09-19T09:15:30.643603+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643603+0000","last_undegraded":"2024-09-19T09:15:30.643603+0000","last_fullsized":"2024-09-19T09:15:30.643603+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644355+0000","last_change":"2024-09-19T09:15:30.644355+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644355+0000","last_undegraded":"2024-09-19T09:15:30.644355+0000","last_fullsized":"2024-09-19T09:15:30.644355+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642700+0000","last_change":"2024-09-19T09:15:30.642700+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642700+0000","last_undegraded":"2024-09-19T09:15:30.642700+0000","last_fullsized":"2024-09-19T09:15:30.642700+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.647068+0000","last_change":"2024-09-19T09:15:30.647068+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.647068+0000","last_undegraded":"2024-09-19T09:15:30.647068+0000","last_fullsized":"2024-09-19T09:15:30.647068+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642256+0000","last_change":"2024-09-19T09:15:30.642256+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642256+0000","last_undegraded":"2024-09-19T09:15:30.642256+0000","last_fullsized":"2024-09-19T09:15:30.642256+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644936+0000","last_change":"2024-09-19T09:15:30.644936+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644936+0000","last_undegraded":"2024-09-19T09:15:30.644936+0000","last_fullsized":"2024-09-19T09:15:30.644936+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643372+0000","last_change":"2024-09-19T09:15:30.643372+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643372+0000","last_undegraded":"2024-09-19T09:15:30.643372+0000","last_fullsized":"2024-09-19T09:15:30.643372+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642863+0000","last_change":"2024-09-19T09:15:30.642863+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642863+0000","last_undegraded":"2024-09-19T09:15:30.642863+0000","last_fullsized":"2024-09-19T09:15:30.642863+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641999+0000","last_change":"2024-09-19T09:15:30.641999+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641999+0000","last_undegraded":"2024-09-19T09:15:30.641999+0000","last_fullsized":"2024-09-19T09:15:30.641999+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642131+0000","last_change":"2024-09-19T09:15:30.642131+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642131+0000","last_undegraded":"2024-09-19T09:15:30.642131+0000","last_fullsized":"2024-09-19T09:15:30.642131+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644901+0000","last_change":"2024-09-19T09:15:30.644901+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644901+0000","last_undegraded":"2024-09-19T09:15:30.644901+0000","last_fullsized":"2024-09-19T09:15:30.644901+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646553+0000","last_change":"2024-09-19T09:15:30.646553+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646553+0000","last_undegraded":"2024-09-19T09:15:30.646553+0000","last_fullsized":"2024-09-19T09:15:30.646553+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646820+0000","last_change":"2024-09-19T09:15:30.646820+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646820+0000","last_undegraded":"2024-09-19T09:15:30.646820+0000","last_fullsized":"2024-09-19T09:15:30.646820+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.645443+0000","last_change":"2024-09-19T09:15:30.645443+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.645443+0000","last_undegraded":"2024-09-19T09:15:30.645443+0000","last_fullsized":"2024-09-19T09:15:30.645443+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643480+0000","last_change":"2024-09-19T09:15:30.643480+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643480+0000","last_undegraded":"2024-09-19T09:15:30.643480+0000","last_fullsized":"2024-09-19T09:15:30.643480+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.645392+0000","last_change":"2024-09-19T09:15:30.645392+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.645392+0000","last_undegraded":"2024-09-19T09:15:30.645392+0000","last_fullsized":"2024-09-19T09:15:30.645392+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646020+0000","last_change":"2024-09-19T09:15:30.646020+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646020+0000","last_undegraded":"2024-09-19T09:15:30.646020+0000","last_fullsized":"2024-09-19T09:15:30.646020+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644075+0000","last_change":"2024-09-19T09:15:30.644075+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644075+0000","last_undegraded":"2024-09-19T09:15:30.644075+0000","last_fullsized":"2024-09-19T09:15:30.644075+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644303+0000","last_change":"2024-09-19T09:15:30.644303+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644303+0000","last_undegraded":"2024-09-19T09:15:30.644303+0000","last_fullsized":"2024-09-19T09:15:30.644303+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646932+0000","last_change":"2024-09-19T09:15:30.646932+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646932+0000","last_undegraded":"2024-09-19T09:15:30.646932+0000","last_fullsized":"2024-09-19T09:15:30.646932+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642854+0000","last_change":"2024-09-19T09:15:30.642854+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642854+0000","last_undegraded":"2024-09-19T09:15:30.642854+0000","last_fullsized":"2024-09-19T09:15:30.642854+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642767+0000","last_change":"2024-09-19T09:15:30.642767+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642767+0000","last_undegraded":"2024-09-19T09:15:30.642767+0000","last_fullsized":"2024-09-19T09:15:30.642767+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646522+0000","last_change":"2024-09-19T09:15:30.646522+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646522+0000","last_undegraded":"2024-09-19T09:15:30.646522+0000","last_fullsized":"2024-09-19T09:15:30.646522+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642107+0000","last_change":"2024-09-19T09:15:30.642107+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642107+0000","last_undegraded":"2024-09-19T09:15:30.642107+0000","last_fullsized":"2024-09-19T09:15:30.642107+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.649797+0000","last_change":"2024-09-19T09:15:30.649649+0000","last_active":"2024-09-19T09:15:30.649797+0000","last_peered":"2024-09-19T09:15:30.649797+0000","last_clean":"2024-09-19T09:15:30.649797+0000","last_became_active":"2024-09-19T09:15:30.649349+0000","last_became_peered":"2024-09-19T09:15:30.649349+0000","last_unstale":"2024-09-19T09:15:30.649797+0000","last_undegraded":"2024-09-19T09:15:30.649797+0000","last_fullsized":"2024-09-19T09:15:30.649797+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:42.259611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643373+0000","last_change":"2024-09-19T09:15:30.643373+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643373+0000","last_undegraded":"2024-09-19T09:15:30.643373+0000","last_fullsized":"2024-09-19T09:15:30.643373+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.654164+0000","last_change":"2024-09-19T09:15:30.654042+0000","last_active":"2024-09-19T09:15:30.654164+0000","last_peered":"2024-09-19T09:15:30.654164+0000","last_clean":"2024-09-19T09:15:30.654164+0000","last_became_active":"2024-09-19T09:15:30.653763+0000","last_became_peered":"2024-09-19T09:15:30.653763+0000","last_unstale":"2024-09-19T09:15:30.654164+0000","last_undegraded":"2024-09-19T09:15:30.654164+0000","last_fullsized":"2024-09-19T09:15:30.654164+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:52.454188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643877+0000","last_change":"2024-09-19T09:15:30.643877+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643877+0000","last_undegraded":"2024-09-19T09:15:30.643877+0000","last_fullsized":"2024-09-19T09:15:30.643877+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.651817+0000","last_change":"2024-09-19T09:15:30.651705+0000","last_active":"2024-09-19T09:15:30.651817+0000","last_peered":"2024-09-19T09:15:30.651817+0000","last_clean":"2024-09-19T09:15:30.651817+0000","last_became_active":"2024-09-19T09:15:30.651486+0000","last_became_peered":"2024-09-19T09:15:30.651486+0000","last_unstale":"2024-09-19T09:15:30.651817+0000","last_undegraded":"2024-09-19T09:15:30.651817+0000","last_fullsized":"2024-09-19T09:15:30.651817+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:34.313611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642442+0000","last_change":"2024-09-19T09:15:30.642442+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642442+0000","last_undegraded":"2024-09-19T09:15:30.642442+0000","last_fullsized":"2024-09-19T09:15:30.642442+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.649299+0000","last_change":"2024-09-19T09:15:30.649173+0000","last_active":"2024-09-19T09:15:30.649299+0000","last_peered":"2024-09-19T09:15:30.649299+0000","last_clean":"2024-09-19T09:15:30.649299+0000","last_became_active":"2024-09-19T09:15:30.648936+0000","last_became_peered":"2024-09-19T09:15:30.648936+0000","last_unstale":"2024-09-19T09:15:30.649299+0000","last_undegraded":"2024-09-19T09:15:30.649299+0000","last_fullsized":"2024-09-19T09:15:30.649299+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:41.776269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643973+0000","last_change":"2024-09-19T09:15:30.643973+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643973+0000","last_undegraded":"2024-09-19T09:15:30.643973+0000","last_fullsized":"2024-09-19T09:15:30.643973+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.650884+0000","last_change":"2024-09-19T09:15:30.650218+0000","last_active":"2024-09-19T09:15:30.650884+0000","last_peered":"2024-09-19T09:15:30.650884+0000","last_clean":"2024-09-19T09:15:30.650884+0000","last_became_active":"2024-09-19T09:15:30.649963+0000","last_became_peered":"2024-09-19T09:15:30.649963+0000","last_unstale":"2024-09-19T09:15:30.650884+0000","last_undegraded":"2024-09-19T09:15:30.650884+0000","last_fullsized":"2024-09-19T09:15:30.650884+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:53.351073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646234+0000","last_change":"2024-09-19T09:15:30.646234+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646234+0000","last_undegraded":"2024-09-19T09:15:30.646234+0000","last_fullsized":"2024-09-19T09:15:30.646234+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.646376+0000","last_change":"2024-09-19T09:15:30.646184+0000","last_active":"2024-09-19T09:15:30.646376+0000","last_peered":"2024-09-19T09:15:30.646376+0000","last_clean":"2024-09-19T09:15:30.646376+0000","last_became_active":"2024-09-19T09:15:30.645538+0000","last_became_peered":"2024-09-19T09:15:30.645538+0000","last_unstale":"2024-09-19T09:15:30.646376+0000","last_undegraded":"2024-09-19T09:15:30.646376+0000","last_fullsized":"2024-09-19T09:15:30.646376+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:21.530044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642074+0000","last_change":"2024-09-19T09:15:30.642074+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642074+0000","last_undegraded":"2024-09-19T09:15:30.642074+0000","last_fullsized":"2024-09-19T09:15:30.642074+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.649129+0000","last_change":"2024-09-19T09:15:30.649010+0000","last_active":"2024-09-19T09:15:30.649129+0000","last_peered":"2024-09-19T09:15:30.649129+0000","last_clean":"2024-09-19T09:15:30.649129+0000","last_became_active":"2024-09-19T09:15:30.648759+0000","last_became_peered":"2024-09-19T09:15:30.648759+0000","last_unstale":"2024-09-19T09:15:30.649129+0000","last_undegraded":"2024-09-19T09:15:30.649129+0000","last_fullsized":"2024-09-19T09:15:30.649129+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:29.829394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641731+0000","last_change":"2024-09-19T09:15:30.641731+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641731+0000","last_undegraded":"2024-09-19T09:15:30.641731+0000","last_fullsized":"2024-09-19T09:15:30.641731+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.652963+0000","last_change":"2024-09-19T09:15:30.652419+0000","last_active":"2024-09-19T09:15:30.652963+0000","last_peered":"2024-09-19T09:15:30.652963+0000","last_clean":"2024-09-19T09:15:30.652963+0000","last_became_active":"2024-09-19T09:15:30.652189+0000","last_became_peered":"2024-09-19T09:15:30.652189+0000","last_unstale":"2024-09-19T09:15:30.652963+0000","last_undegraded":"2024-09-19T09:15:30.652963+0000","last_fullsized":"2024-09-19T09:15:30.652963+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:12.041128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644523+0000","last_change":"2024-09-19T09:15:30.644523+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644523+0000","last_undegraded":"2024-09-19T09:15:30.644523+0000","last_fullsized":"2024-09-19T09:15:30.644523+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.651825+0000","last_change":"2024-09-19T09:15:30.651532+0000","last_active":"2024-09-19T09:15:30.651825+0000","last_peered":"2024-09-19T09:15:30.651825+0000","last_clean":"2024-09-19T09:15:30.651825+0000","last_became_active":"2024-09-19T09:15:30.651103+0000","last_became_peered":"2024-09-19T09:15:30.651103+0000","last_unstale":"2024-09-19T09:15:30.651825+0000","last_undegraded":"2024-09-19T09:15:30.651825+0000","last_fullsized":"2024-09-19T09:15:30.651825+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:14.467351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641635+0000","last_change":"2024-09-19T09:15:30.641635+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641635+0000","last_undegraded":"2024-09-19T09:15:30.641635+0000","last_fullsized":"2024-09-19T09:15:30.641635+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.653150+0000","last_change":"2024-09-19T09:15:30.650745+0000","last_active":"2024-09-19T09:15:30.653150+0000","last_peered":"2024-09-19T09:15:30.653150+0000","last_clean":"2024-09-19T09:15:30.653150+0000","last_became_active":"2024-09-19T09:15:30.650538+0000","last_became_peered":"2024-09-19T09:15:30.650538+0000","last_unstale":"2024-09-19T09:15:30.653150+0000","last_undegraded":"2024-09-19T09:15:30.653150+0000","last_fullsized":"2024-09-19T09:15:30.653150+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:46.526044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646643+0000","last_change":"2024-09-19T09:15:30.646643+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646643+0000","last_undegraded":"2024-09-19T09:15:30.646643+0000","last_fullsized":"2024-09-19T09:15:30.646643+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.650508+0000","last_change":"2024-09-19T09:15:30.650364+0000","last_active":"2024-09-19T09:15:30.650508+0000","last_peered":"2024-09-19T09:15:30.650508+0000","last_clean":"2024-09-19T09:15:30.650508+0000","last_became_active":"2024-09-19T09:15:30.649795+0000","last_became_peered":"2024-09-19T09:15:30.649795+0000","last_unstale":"2024-09-19T09:15:30.650508+0000","last_undegraded":"2024-09-19T09:15:30.650508+0000","last_fullsized":"2024-09-19T09:15:30.650508+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:59.730723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643050+0000","last_change":"2024-09-19T09:15:30.643050+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643050+0000","last_undegraded":"2024-09-19T09:15:30.643050+0000","last_fullsized":"2024-09-19T09:15:30.643050+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.652923+0000","last_change":"2024-09-19T09:15:30.651245+0000","last_active":"2024-09-19T09:15:30.652923+0000","last_peered":"2024-09-19T09:15:30.652923+0000","last_clean":"2024-09-19T09:15:30.652923+0000","last_became_active":"2024-09-19T09:15:30.650992+0000","last_became_peered":"2024-09-19T09:15:30.650992+0000","last_unstale":"2024-09-19T09:15:30.652923+0000","last_undegraded":"2024-09-19T09:15:30.652923+0000","last_fullsized":"2024-09-19T09:15:30.652923+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:21.687370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.648212+0000","last_change":"2024-09-19T09:15:30.648212+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.648212+0000","last_undegraded":"2024-09-19T09:15:30.648212+0000","last_fullsized":"2024-09-19T09:15:30.648212+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.653873+0000","last_change":"2024-09-19T09:15:30.653657+0000","last_active":"2024-09-19T09:15:30.653873+0000","last_peered":"2024-09-19T09:15:30.653873+0000","last_clean":"2024-09-19T09:15:30.653873+0000","last_became_active":"2024-09-19T09:15:30.653393+0000","last_became_peered":"2024-09-19T09:15:30.653393+0000","last_unstale":"2024-09-19T09:15:30.653873+0000","last_undegraded":"2024-09-19T09:15:30.653873+0000","last_fullsized":"2024-09-19T09:15:30.653873+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:54.122291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641551+0000","last_change":"2024-09-19T09:15:30.641551+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641551+0000","last_undegraded":"2024-09-19T09:15:30.641551+0000","last_fullsized":"2024-09-19T09:15:30.641551+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.652181+0000","last_change":"2024-09-19T09:15:30.652071+0000","last_active":"2024-09-19T09:15:30.652181+0000","last_peered":"2024-09-19T09:15:30.652181+0000","last_clean":"2024-09-19T09:15:30.652181+0000","last_became_active":"2024-09-19T09:15:30.651854+0000","last_became_peered":"2024-09-19T09:15:30.651854+0000","last_unstale":"2024-09-19T09:15:30.652181+0000","last_undegraded":"2024-09-19T09:15:30.652181+0000","last_fullsized":"2024-09-19T09:15:30.652181+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:24.480796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643119+0000","last_change":"2024-09-19T09:15:30.643119+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643119+0000","last_undegraded":"2024-09-19T09:15:30.643119+0000","last_fullsized":"2024-09-19T09:15:30.643119+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.648027+0000","last_change":"2024-09-19T09:15:30.647466+0000","last_active":"2024-09-19T09:15:30.648027+0000","last_peered":"2024-09-19T09:15:30.648027+0000","last_clean":"2024-09-19T09:15:30.648027+0000","last_became_active":"2024-09-19T09:15:30.647243+0000","last_became_peered":"2024-09-19T09:15:30.647243+0000","last_unstale":"2024-09-19T09:15:30.648027+0000","last_undegraded":"2024-09-19T09:15:30.648027+0000","last_fullsized":"2024-09-19T09:15:30.648027+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:26.248970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644596+0000","last_change":"2024-09-19T09:15:30.644596+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644596+0000","last_undegraded":"2024-09-19T09:15:30.644596+0000","last_fullsized":"2024-09-19T09:15:30.644596+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.650731+0000","last_change":"2024-09-19T09:15:30.650623+0000","last_active":"2024-09-19T09:15:30.650731+0000","last_peered":"2024-09-19T09:15:30.650731+0000","last_clean":"2024-09-19T09:15:30.650731+0000","last_became_active":"2024-09-19T09:15:30.650128+0000","last_became_peered":"2024-09-19T09:15:30.650128+0000","last_unstale":"2024-09-19T09:15:30.650731+0000","last_undegraded":"2024-09-19T09:15:30.650731+0000","last_fullsized":"2024-09-19T09:15:30.650731+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:05.567127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641147+0000","last_change":"2024-09-19T09:15:30.641147+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641147+0000","last_undegraded":"2024-09-19T09:15:30.641147+0000","last_fullsized":"2024-09-19T09:15:30.641147+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.652953+0000","last_change":"2024-09-19T09:15:30.652777+0000","last_active":"2024-09-19T09:15:30.652953+0000","last_peered":"2024-09-19T09:15:30.652953+0000","last_clean":"2024-09-19T09:15:30.652953+0000","last_became_active":"2024-09-19T09:15:30.652329+0000","last_became_peered":"2024-09-19T09:15:30.652329+0000","last_unstale":"2024-09-19T09:15:30.652953+0000","last_undegraded":"2024-09-19T09:15:30.652953+0000","last_fullsized":"2024-09-19T09:15:30.652953+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:07:00.758153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641181+0000","last_change":"2024-09-19T09:15:30.641181+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641181+0000","last_undegraded":"2024-09-19T09:15:30.641181+0000","last_fullsized":"2024-09-19T09:15:30.641181+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.653128+0000","last_change":"2024-09-19T09:15:30.651289+0000","last_active":"2024-09-19T09:15:30.653128+0000","last_peered":"2024-09-19T09:15:30.653128+0000","last_clean":"2024-09-19T09:15:30.653128+0000","last_became_active":"2024-09-19T09:15:30.651068+0000","last_became_peered":"2024-09-19T09:15:30.651068+0000","last_unstale":"2024-09-19T09:15:30.653128+0000","last_undegraded":"2024-09-19T09:15:30.653128+0000","last_fullsized":"2024-09-19T09:15:30.653128+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:48.463943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643750+0000","last_change":"2024-09-19T09:15:30.643750+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643750+0000","last_undegraded":"2024-09-19T09:15:30.643750+0000","last_fullsized":"2024-09-19T09:15:30.643750+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.647596+0000","last_change":"2024-09-19T09:15:30.647469+0000","last_active":"2024-09-19T09:15:30.647596+0000","last_peered":"2024-09-19T09:15:30.647596+0000","last_clean":"2024-09-19T09:15:30.647596+0000","last_became_active":"2024-09-19T09:15:30.647178+0000","last_became_peered":"2024-09-19T09:15:30.647178+0000","last_unstale":"2024-09-19T09:15:30.647596+0000","last_undegraded":"2024-09-19T09:15:30.647596+0000","last_fullsized":"2024-09-19T09:15:30.647596+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:17.125864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.645009+0000","last_change":"2024-09-19T09:15:30.645009+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.645009+0000","last_undegraded":"2024-09-19T09:15:30.645009+0000","last_fullsized":"2024-09-19T09:15:30.645009+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.653743+0000","last_change":"2024-09-19T09:15:30.653622+0000","last_active":"2024-09-19T09:15:30.653743+0000","last_peered":"2024-09-19T09:15:30.653743+0000","last_clean":"2024-09-19T09:15:30.653743+0000","last_became_active":"2024-09-19T09:15:30.653276+0000","last_became_peered":"2024-09-19T09:15:30.653276+0000","last_unstale":"2024-09-19T09:15:30.653743+0000","last_undegraded":"2024-09-19T09:15:30.653743+0000","last_fullsized":"2024-09-19T09:15:30.653743+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:21.197276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643180+0000","last_change":"2024-09-19T09:15:30.643180+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643180+0000","last_undegraded":"2024-09-19T09:15:30.643180+0000","last_fullsized":"2024-09-19T09:15:30.643180+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.652219+0000","last_change":"2024-09-19T09:15:30.651929+0000","last_active":"2024-09-19T09:15:30.652219+0000","last_peered":"2024-09-19T09:15:30.652219+0000","last_clean":"2024-09-19T09:15:30.652219+0000","last_became_active":"2024-09-19T09:15:30.651697+0000","last_became_peered":"2024-09-19T09:15:30.651697+0000","last_unstale":"2024-09-19T09:15:30.652219+0000","last_undegraded":"2024-09-19T09:15:30.652219+0000","last_fullsized":"2024-09-19T09:15:30.652219+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:00.296266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643237+0000","last_change":"2024-09-19T09:15:30.643237+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643237+0000","last_undegraded":"2024-09-19T09:15:30.643237+0000","last_fullsized":"2024-09-19T09:15:30.643237+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.651369+0000","last_change":"2024-09-19T09:15:30.650297+0000","last_active":"2024-09-19T09:15:30.651369+0000","last_peered":"2024-09-19T09:15:30.651369+0000","last_clean":"2024-09-19T09:15:30.651369+0000","last_became_active":"2024-09-19T09:15:30.648904+0000","last_became_peered":"2024-09-19T09:15:30.648904+0000","last_unstale":"2024-09-19T09:15:30.651369+0000","last_undegraded":"2024-09-19T09:15:30.651369+0000","last_fullsized":"2024-09-19T09:15:30.651369+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:52.310374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642927+0000","last_change":"2024-09-19T09:15:30.642927+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642927+0000","last_undegraded":"2024-09-19T09:15:30.642927+0000","last_fullsized":"2024-09-19T09:15:30.642927+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.652995+0000","last_change":"2024-09-19T09:15:30.652887+0000","last_active":"2024-09-19T09:15:30.652995+0000","last_peered":"2024-09-19T09:15:30.652995+0000","last_clean":"2024-09-19T09:15:30.652995+0000","last_became_active":"2024-09-19T09:15:30.652627+0000","last_became_peered":"2024-09-19T09:15:30.652627+0000","last_unstale":"2024-09-19T09:15:30.652995+0000","last_undegraded":"2024-09-19T09:15:30.652995+0000","last_fullsized":"2024-09-19T09:15:30.652995+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:09.841176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641142+0000","last_change":"2024-09-19T09:15:30.641142+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641142+0000","last_undegraded":"2024-09-19T09:15:30.641142+0000","last_fullsized":"2024-09-19T09:15:30.641142+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.649055+0000","last_change":"2024-09-19T09:15:30.648918+0000","last_active":"2024-09-19T09:15:30.649055+0000","last_peered":"2024-09-19T09:15:30.649055+0000","last_clean":"2024-09-19T09:15:30.649055+0000","last_became_active":"2024-09-19T09:15:30.648422+0000","last_became_peered":"2024-09-19T09:15:30.648422+0000","last_unstale":"2024-09-19T09:15:30.649055+0000","last_undegraded":"2024-09-19T09:15:30.649055+0000","last_fullsized":"2024-09-19T09:15:30.649055+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:35.967314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641461+0000","last_change":"2024-09-19T09:15:30.641461+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641461+0000","last_undegraded":"2024-09-19T09:15:30.641461+0000","last_fullsized":"2024-09-19T09:15:30.641461+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.646511+0000","last_change":"2024-09-19T09:15:30.646415+0000","last_active":"2024-09-19T09:15:30.646511+0000","last_peered":"2024-09-19T09:15:30.646511+0000","last_clean":"2024-09-19T09:15:30.646511+0000","last_became_active":"2024-09-19T09:15:30.645939+0000","last_became_peered":"2024-09-19T09:15:30.645939+0000","last_unstale":"2024-09-19T09:15:30.646511+0000","last_undegraded":"2024-09-19T09:15:30.646511+0000","last_fullsized":"2024-09-19T09:15:30.646511+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:24.942472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.645096+0000","last_change":"2024-09-19T09:15:30.645096+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.645096+0000","last_undegraded":"2024-09-19T09:15:30.645096+0000","last_fullsized":"2024-09-19T09:15:30.645096+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.651777+0000","last_change":"2024-09-19T09:15:30.651522+0000","last_active":"2024-09-19T09:15:30.651777+0000","last_peered":"2024-09-19T09:15:30.651777+0000","last_clean":"2024-09-19T09:15:30.651777+0000","last_became_active":"2024-09-19T09:15:30.650503+0000","last_became_peered":"2024-09-19T09:15:30.650503+0000","last_unstale":"2024-09-19T09:15:30.651777+0000","last_undegraded":"2024-09-19T09:15:30.651777+0000","last_fullsized":"2024-09-19T09:15:30.651777+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:52.043381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646363+0000","last_change":"2024-09-19T09:15:30.646363+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646363+0000","last_undegraded":"2024-09-19T09:15:30.646363+0000","last_fullsized":"2024-09-19T09:15:30.646363+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.649523+0000","last_change":"2024-09-19T09:15:30.649413+0000","last_active":"2024-09-19T09:15:30.649523+0000","last_peered":"2024-09-19T09:15:30.649523+0000","last_clean":"2024-09-19T09:15:30.649523+0000","last_became_active":"2024-09-19T09:15:30.648048+0000","last_became_peered":"2024-09-19T09:15:30.648048+0000","last_unstale":"2024-09-19T09:15:30.649523+0000","last_undegraded":"2024-09-19T09:15:30.649523+0000","last_fullsized":"2024-09-19T09:15:30.649523+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:26.745779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.640821+0000","last_change":"2024-09-19T09:15:30.640821+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.640821+0000","last_undegraded":"2024-09-19T09:15:30.640821+0000","last_fullsized":"2024-09-19T09:15:30.640821+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.651308+0000","last_change":"2024-09-19T09:15:30.650891+0000","last_active":"2024-09-19T09:15:30.651308+0000","last_peered":"2024-09-19T09:15:30.651308+0000","last_clean":"2024-09-19T09:15:30.651308+0000","last_became_active":"2024-09-19T09:15:30.650650+0000","last_became_peered":"2024-09-19T09:15:30.650650+0000","last_unstale":"2024-09-19T09:15:30.651308+0000","last_undegraded":"2024-09-19T09:15:30.651308+0000","last_fullsized":"2024-09-19T09:15:30.651308+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:22.098542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.645658+0000","last_change":"2024-09-19T09:15:30.645658+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.645658+0000","last_undegraded":"2024-09-19T09:15:30.645658+0000","last_fullsized":"2024-09-19T09:15:30.645658+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.648117+0000","last_change":"2024-09-19T09:15:30.647949+0000","last_active":"2024-09-19T09:15:30.648117+0000","last_peered":"2024-09-19T09:15:30.648117+0000","last_clean":"2024-09-19T09:15:30.648117+0000","last_became_active":"2024-09-19T09:15:30.647705+0000","last_became_peered":"2024-09-19T09:15:30.647705+0000","last_unstale":"2024-09-19T09:15:30.648117+0000","last_undegraded":"2024-09-19T09:15:30.648117+0000","last_fullsized":"2024-09-19T09:15:30.648117+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:38.127374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643805+0000","last_change":"2024-09-19T09:15:30.643805+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643805+0000","last_undegraded":"2024-09-19T09:15:30.643805+0000","last_fullsized":"2024-09-19T09:15:30.643805+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.650020+0000","last_change":"2024-09-19T09:15:30.648756+0000","last_active":"2024-09-19T09:15:30.650020+0000","last_peered":"2024-09-19T09:15:30.650020+0000","last_clean":"2024-09-19T09:15:30.650020+0000","last_became_active":"2024-09-19T09:15:30.648510+0000","last_became_peered":"2024-09-19T09:15:30.648510+0000","last_unstale":"2024-09-19T09:15:30.650020+0000","last_undegraded":"2024-09-19T09:15:30.650020+0000","last_fullsized":"2024-09-19T09:15:30.650020+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:07.333629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642133+0000","last_change":"2024-09-19T09:15:30.642133+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642133+0000","last_undegraded":"2024-09-19T09:15:30.642133+0000","last_fullsized":"2024-09-19T09:15:30.642133+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.654327+0000","last_change":"2024-09-19T09:15:30.653974+0000","last_active":"2024-09-19T09:15:30.654327+0000","last_peered":"2024-09-19T09:15:30.654327+0000","last_clean":"2024-09-19T09:15:30.654327+0000","last_became_active":"2024-09-19T09:15:30.653484+0000","last_became_peered":"2024-09-19T09:15:30.653484+0000","last_unstale":"2024-09-19T09:15:30.654327+0000","last_undegraded":"2024-09-19T09:15:30.654327+0000","last_fullsized":"2024-09-19T09:15:30.654327+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:28.509727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643475+0000","last_change":"2024-09-19T09:15:30.643475+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643475+0000","last_undegraded":"2024-09-19T09:15:30.643475+0000","last_fullsized":"2024-09-19T09:15:30.643475+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.652902+0000","last_change":"2024-09-19T09:15:30.650413+0000","last_active":"2024-09-19T09:15:30.652902+0000","last_peered":"2024-09-19T09:15:30.652902+0000","last_clean":"2024-09-19T09:15:30.652902+0000","last_became_active":"2024-09-19T09:15:30.650057+0000","last_became_peered":"2024-09-19T09:15:30.650057+0000","last_unstale":"2024-09-19T09:15:30.652902+0000","last_undegraded":"2024-09-19T09:15:30.652902+0000","last_fullsized":"2024-09-19T09:15:30.652902+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:05.004163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":261,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.643891+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:15:30.643891+0000","last_peered":"2024-09-19T09:15:30.643891+0000","last_clean":"2024-09-19T09:15:30.643891+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:15:30.643891+0000","last_undegraded":"2024-09-19T09:15:30.643891+0000","last_fullsized":"2024-09-19T09:15:30.643891+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:48.025210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":341,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194970,"statfs":{"total":200000000,"available":199649886,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":341,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194970,"statfs":{"total":200000000,"available":199649886,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":918,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194394,"statfs":{"total":200000000,"available":199059518,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":341,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194970,"statfs":{"total":200000000,"available":199649886,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":341,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194970,"statfs":{"total":200000000,"available":199649886,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":341,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194970,"statfs":{"total":200000000,"available":199649886,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":912,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194400,"statfs":{"total":200000000,"available":199065793,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":341,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194970,"statfs":{"total":200000000,"available":199649886,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:15:34.656 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:15:34.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.794+0000 7f43b8b5f640 1 Processor -- start 2024-09-19T09:15:34.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.794+0000 7f43b8b5f640 1 -- start start 2024-09-19T09:15:34.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.795+0000 7f43b8b5f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f43b406bc10 0x7f43b4163190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:34.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.795+0000 7f43b8b5f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f43b406bff0 0x7f43b40725b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:34.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.795+0000 7f43b8b5f640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43b40ae840 con 0x7f43b4072af0 2024-09-19T09:15:34.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.795+0000 7f43b8b5f640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f43b41636d0 con 0x7f43b406bff0 2024-09-19T09:15:34.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.795+0000 7f43b8b5f640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f43b40b6d20 con 0x7f43b406bc10 2024-09-19T09:15:34.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.795+0000 7f43b1d9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f43b406bff0 0x7f43b40725b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:34.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.796+0000 7f43b1d9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f43b406bff0 0x7f43b40725b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52808/0 (socket says 172.21.15.18:52808) 2024-09-19T09:15:34.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.796+0000 7f43b1d9b640 1 -- 172.21.15.18:0/365756888 learned_addr learned my addr 172.21.15.18:0/365756888 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:34.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.796+0000 7f43b259c640 1 --2- 172.21.15.18:0/365756888 >> v2:172.21.15.162:3300/0 conn(0x7f43b406bc10 0x7f43b4163190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:34.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.796+0000 7f43b1d9b640 1 -- 172.21.15.18:0/365756888 >> v2:172.21.15.162:3300/0 conn(0x7f43b406bc10 msgr2=0x7f43b4163190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:34.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.796+0000 7f43b1d9b640 1 --2- 172.21.15.18:0/365756888 >> v2:172.21.15.162:3300/0 conn(0x7f43b406bc10 0x7f43b4163190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.796+0000 7f43b1d9b640 1 -- 172.21.15.18:0/365756888 >> v1:172.21.15.162:6789/0 conn(0x7f43b4072af0 legacy=0x7f43b406e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:34.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.796+0000 7f43b1d9b640 1 -- 172.21.15.18:0/365756888 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b40b6a40 con 0x7f43b406bff0 2024-09-19T09:15:34.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.796+0000 7f43b259c640 1 --2- 172.21.15.18:0/365756888 >> v2:172.21.15.162:3300/0 conn(0x7f43b406bc10 0x7f43b4163190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:15:34.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.797+0000 7f43b1d9b640 1 --2- 172.21.15.18:0/365756888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43b406bff0 0x7f43b40725b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f43b4050590 tx=0x7f439c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e829b9e3f633282f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:34.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.797+0000 7f43b159a640 1 -- 172.21.15.18:0/365756888 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c037070 con 0x7f43b406bff0 2024-09-19T09:15:34.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.797+0000 7f43b159a640 1 -- 172.21.15.18:0/365756888 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f439c032440 con 0x7f43b406bff0 2024-09-19T09:15:34.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.797+0000 7f43b159a640 1 -- 172.21.15.18:0/365756888 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c032810 con 0x7f43b406bff0 2024-09-19T09:15:34.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.797+0000 7f43b8b5f640 1 -- 172.21.15.18:0/365756888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43b406bff0 msgr2=0x7f43b40725b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:34.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.797+0000 7f43b8b5f640 1 --2- 172.21.15.18:0/365756888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43b406bff0 0x7f43b40725b0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f43b4050590 tx=0x7f439c02a230 comp rx=0 tx=0).stop 2024-09-19T09:15:34.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.797+0000 7f43b8b5f640 1 -- 172.21.15.18:0/365756888 shutdown_connections 2024-09-19T09:15:34.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.797+0000 7f43b8b5f640 1 --2- 172.21.15.18:0/365756888 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43b406bff0 0x7f43b40725b0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.797+0000 7f43b8b5f640 1 --2- 172.21.15.18:0/365756888 >> v2:172.21.15.162:3300/0 conn(0x7f43b406bc10 0x7f43b4163190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.797+0000 7f43b8b5f640 1 -- 172.21.15.18:0/365756888 >> 172.21.15.18:0/365756888 conn(0x7f43b40d1970 msgr2=0x7f43b40d1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:34.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.797+0000 7f43b8b5f640 1 -- 172.21.15.18:0/365756888 shutdown_connections 2024-09-19T09:15:34.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.797+0000 7f43b8b5f640 1 -- 172.21.15.18:0/365756888 wait complete. 2024-09-19T09:15:34.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.799+0000 7f43b8b5f640 1 Processor -- start 2024-09-19T09:15:34.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.799+0000 7f43b8b5f640 1 -- start start 2024-09-19T09:15:34.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.799+0000 7f43b8b5f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43b406bc10 0x7f43b413d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:34.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.800+0000 7f43b8b5f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43b406bff0 0x7f43b4146e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:34.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.800+0000 7f43b8b5f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43b4072af0 0x7f43b4147360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:34.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.800+0000 7f43b8b5f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f43b40b5110 con 0x7f43b406bc10 2024-09-19T09:15:34.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.800+0000 7f43b8b5f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f43b40b4e30 con 0x7f43b4072af0 2024-09-19T09:15:34.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.800+0000 7f43b8b5f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f43b406c430 con 0x7f43b406bff0 2024-09-19T09:15:34.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.800+0000 7f43b259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43b406bc10 0x7f43b413d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:34.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.800+0000 7f43b259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43b406bc10 0x7f43b413d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52814/0 (socket says 172.21.15.18:52814) 2024-09-19T09:15:34.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.800+0000 7f43b259c640 1 -- 172.21.15.18:0/814805762 learned_addr learned my addr 172.21.15.18:0/814805762 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:34.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.800+0000 7f43b2d9d640 1 --2- 172.21.15.18:0/814805762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43b4072af0 0x7f43b4147360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:34.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.800+0000 7f43b1d9b640 1 --2- 172.21.15.18:0/814805762 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43b406bff0 0x7f43b4146e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:34.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.800+0000 7f43b259c640 1 -- 172.21.15.18:0/814805762 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43b406bff0 msgr2=0x7f43b4146e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:34.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.800+0000 7f43b259c640 1 --2- 172.21.15.18:0/814805762 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43b406bff0 0x7f43b4146e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.800+0000 7f43b259c640 1 -- 172.21.15.18:0/814805762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43b4072af0 msgr2=0x7f43b4147360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:34.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.800+0000 7f43b259c640 1 --2- 172.21.15.18:0/814805762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43b4072af0 0x7f43b4147360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.800+0000 7f43b259c640 1 -- 172.21.15.18:0/814805762 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b413f000 con 0x7f43b406bc10 2024-09-19T09:15:34.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.800+0000 7f43b259c640 1 --2- 172.21.15.18:0/814805762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43b406bc10 0x7f43b413d910 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00ce00 tx=0x7f43ac00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:34.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.800+0000 7f43aaffd640 1 -- 172.21.15.18:0/814805762 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac00f890 con 0x7f43b406bc10 2024-09-19T09:15:34.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.800+0000 7f43aaffd640 1 -- 172.21.15.18:0/814805762 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43ac00fa30 con 0x7f43b406bc10 2024-09-19T09:15:34.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.800+0000 7f43b8b5f640 1 -- 172.21.15.18:0/814805762 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43b413f2a0 con 0x7f43b406bc10 2024-09-19T09:15:34.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.800+0000 7f43aaffd640 1 -- 172.21.15.18:0/814805762 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac00fe40 con 0x7f43b406bc10 2024-09-19T09:15:34.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.801+0000 7f43b8b5f640 1 -- 172.21.15.18:0/814805762 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43b413f860 con 0x7f43b406bc10 2024-09-19T09:15:34.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.801+0000 7f43b8b5f640 1 -- 172.21.15.18:0/814805762 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43b40b6660 con 0x7f43b406bc10 2024-09-19T09:15:34.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.802+0000 7f43aaffd640 1 -- 172.21.15.18:0/814805762 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f43ac018400 con 0x7f43b406bc10 2024-09-19T09:15:34.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.802+0000 7f43aaffd640 1 --2- 172.21.15.18:0/814805762 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f439406c2b0 0x7f439406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:34.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.802+0000 7f43aaffd640 1 -- 172.21.15.18:0/814805762 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7f43ac08c180 con 0x7f43b406bc10 2024-09-19T09:15:34.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.803+0000 7f43b1d9b640 1 --2- 172.21.15.18:0/814805762 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f439406c2b0 0x7f439406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:34.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.803+0000 7f43b1d9b640 1 --2- 172.21.15.18:0/814805762 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f439406c2b0 0x7f439406e770 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f439c034000 tx=0x7f439c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:34.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.807+0000 7f43aaffd640 1 -- 172.21.15.18:0/814805762 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f43ac014030 con 0x7f43b406bc10 2024-09-19T09:15:34.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.977+0000 7f43b8b5f640 1 -- 172.21.15.18:0/814805762 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f43b4070000 con 0x7f439406c2b0 2024-09-19T09:15:34.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.984+0000 7f43aaffd640 1 -- 172.21.15.18:0/814805762 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242219 (secure 0 0 0) 0x7f43b4070000 con 0x7f439406c2b0 2024-09-19T09:15:34.986 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:15:34.987 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:15:34.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.987+0000 7f43b8b5f640 1 -- 172.21.15.18:0/814805762 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f439406c2b0 msgr2=0x7f439406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:34.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.987+0000 7f43b8b5f640 1 --2- 172.21.15.18:0/814805762 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f439406c2b0 0x7f439406e770 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f439c034000 tx=0x7f439c02e000 comp rx=0 tx=0).stop 2024-09-19T09:15:34.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.987+0000 7f43b8b5f640 1 -- 172.21.15.18:0/814805762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43b406bc10 msgr2=0x7f43b413d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:34.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.987+0000 7f43b8b5f640 1 --2- 172.21.15.18:0/814805762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43b406bc10 0x7f43b413d910 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00ce00 tx=0x7f43ac00a650 comp rx=0 tx=0).stop 2024-09-19T09:15:34.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.987+0000 7f43b8b5f640 1 -- 172.21.15.18:0/814805762 shutdown_connections 2024-09-19T09:15:34.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.987+0000 7f43b8b5f640 1 --2- 172.21.15.18:0/814805762 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f439406c2b0 0x7f439406e770 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.987+0000 7f43b8b5f640 1 --2- 172.21.15.18:0/814805762 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f43b4072af0 0x7f43b4147360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.987+0000 7f43b8b5f640 1 --2- 172.21.15.18:0/814805762 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f43b406bff0 0x7f43b4146e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.987+0000 7f43b8b5f640 1 --2- 172.21.15.18:0/814805762 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f43b406bc10 0x7f43b413d910 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:34.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.987+0000 7f43b8b5f640 1 -- 172.21.15.18:0/814805762 >> 172.21.15.18:0/814805762 conn(0x7f43b40d1970 msgr2=0x7f43b406cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:34.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.987+0000 7f43b8b5f640 1 -- 172.21.15.18:0/814805762 shutdown_connections 2024-09-19T09:15:34.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:34.987+0000 7f43b8b5f640 1 -- 172.21.15.18:0/814805762 wait complete. 2024-09-19T09:15:34.998 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2024-09-19T09:15:33.552123+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3882,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558617,"statfs":{"total":1600000000,"available":1596024627,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001079"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646988+0000","last_change":"2024-09-19T09:15:30.646988+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646988+0000","last_undegraded":"2024-09-19T09:15:30.646988+0000","last_fullsized":"2024-09-19T09:15:30.646988+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644359+0000","last_change":"2024-09-19T09:15:30.644359+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644359+0000","last_undegraded":"2024-09-19T09:15:30.644359+0000","last_fullsized":"2024-09-19T09:15:30.644359+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642581+0000","last_change":"2024-09-19T09:15:30.642581+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642581+0000","last_undegraded":"2024-09-19T09:15:30.642581+0000","last_fullsized":"2024-09-19T09:15:30.642581+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643943+0000","last_change":"2024-09-19T09:15:30.643943+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643943+0000","last_undegraded":"2024-09-19T09:15:30.643943+0000","last_fullsized":"2024-09-19T09:15:30.643943+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646618+0000","last_change":"2024-09-19T09:15:30.646618+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646618+0000","last_undegraded":"2024-09-19T09:15:30.646618+0000","last_fullsized":"2024-09-19T09:15:30.646618+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644382+0000","last_change":"2024-09-19T09:15:30.644382+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644382+0000","last_undegraded":"2024-09-19T09:15:30.644382+0000","last_fullsized":"2024-09-19T09:15:30.644382+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644922+0000","last_change":"2024-09-19T09:15:30.644922+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644922+0000","last_undegraded":"2024-09-19T09:15:30.644922+0000","last_fullsized":"2024-09-19T09:15:30.644922+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644580+0000","last_change":"2024-09-19T09:15:30.644580+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644580+0000","last_undegraded":"2024-09-19T09:15:30.644580+0000","last_fullsized":"2024-09-19T09:15:30.644580+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643746+0000","last_change":"2024-09-19T09:15:30.643746+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643746+0000","last_undegraded":"2024-09-19T09:15:30.643746+0000","last_fullsized":"2024-09-19T09:15:30.643746+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643603+0000","last_change":"2024-09-19T09:15:30.643603+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643603+0000","last_undegraded":"2024-09-19T09:15:30.643603+0000","last_fullsized":"2024-09-19T09:15:30.643603+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644355+0000","last_change":"2024-09-19T09:15:30.644355+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644355+0000","last_undegraded":"2024-09-19T09:15:30.644355+0000","last_fullsized":"2024-09-19T09:15:30.644355+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642700+0000","last_change":"2024-09-19T09:15:30.642700+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642700+0000","last_undegraded":"2024-09-19T09:15:30.642700+0000","last_fullsized":"2024-09-19T09:15:30.642700+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.647068+0000","last_change":"2024-09-19T09:15:30.647068+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.647068+0000","last_undegraded":"2024-09-19T09:15:30.647068+0000","last_fullsized":"2024-09-19T09:15:30.647068+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642256+0000","last_change":"2024-09-19T09:15:30.642256+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642256+0000","last_undegraded":"2024-09-19T09:15:30.642256+0000","last_fullsized":"2024-09-19T09:15:30.642256+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644936+0000","last_change":"2024-09-19T09:15:30.644936+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644936+0000","last_undegraded":"2024-09-19T09:15:30.644936+0000","last_fullsized":"2024-09-19T09:15:30.644936+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643372+0000","last_change":"2024-09-19T09:15:30.643372+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643372+0000","last_undegraded":"2024-09-19T09:15:30.643372+0000","last_fullsized":"2024-09-19T09:15:30.643372+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642863+0000","last_change":"2024-09-19T09:15:30.642863+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642863+0000","last_undegraded":"2024-09-19T09:15:30.642863+0000","last_fullsized":"2024-09-19T09:15:30.642863+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641999+0000","last_change":"2024-09-19T09:15:30.641999+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641999+0000","last_undegraded":"2024-09-19T09:15:30.641999+0000","last_fullsized":"2024-09-19T09:15:30.641999+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642131+0000","last_change":"2024-09-19T09:15:30.642131+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642131+0000","last_undegraded":"2024-09-19T09:15:30.642131+0000","last_fullsized":"2024-09-19T09:15:30.642131+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644901+0000","last_change":"2024-09-19T09:15:30.644901+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644901+0000","last_undegraded":"2024-09-19T09:15:30.644901+0000","last_fullsized":"2024-09-19T09:15:30.644901+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646553+0000","last_change":"2024-09-19T09:15:30.646553+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646553+0000","last_undegraded":"2024-09-19T09:15:30.646553+0000","last_fullsized":"2024-09-19T09:15:30.646553+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646820+0000","last_change":"2024-09-19T09:15:30.646820+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646820+0000","last_undegraded":"2024-09-19T09:15:30.646820+0000","last_fullsized":"2024-09-19T09:15:30.646820+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.645443+0000","last_change":"2024-09-19T09:15:30.645443+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.645443+0000","last_undegraded":"2024-09-19T09:15:30.645443+0000","last_fullsized":"2024-09-19T09:15:30.645443+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643480+0000","last_change":"2024-09-19T09:15:30.643480+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643480+0000","last_undegraded":"2024-09-19T09:15:30.643480+0000","last_fullsized":"2024-09-19T09:15:30.643480+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.645392+0000","last_change":"2024-09-19T09:15:30.645392+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.645392+0000","last_undegraded":"2024-09-19T09:15:30.645392+0000","last_fullsized":"2024-09-19T09:15:30.645392+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646020+0000","last_change":"2024-09-19T09:15:30.646020+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646020+0000","last_undegraded":"2024-09-19T09:15:30.646020+0000","last_fullsized":"2024-09-19T09:15:30.646020+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644075+0000","last_change":"2024-09-19T09:15:30.644075+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644075+0000","last_undegraded":"2024-09-19T09:15:30.644075+0000","last_fullsized":"2024-09-19T09:15:30.644075+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644303+0000","last_change":"2024-09-19T09:15:30.644303+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644303+0000","last_undegraded":"2024-09-19T09:15:30.644303+0000","last_fullsized":"2024-09-19T09:15:30.644303+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646932+0000","last_change":"2024-09-19T09:15:30.646932+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646932+0000","last_undegraded":"2024-09-19T09:15:30.646932+0000","last_fullsized":"2024-09-19T09:15:30.646932+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642854+0000","last_change":"2024-09-19T09:15:30.642854+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642854+0000","last_undegraded":"2024-09-19T09:15:30.642854+0000","last_fullsized":"2024-09-19T09:15:30.642854+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642767+0000","last_change":"2024-09-19T09:15:30.642767+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642767+0000","last_undegraded":"2024-09-19T09:15:30.642767+0000","last_fullsized":"2024-09-19T09:15:30.642767+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646522+0000","last_change":"2024-09-19T09:15:30.646522+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646522+0000","last_undegraded":"2024-09-19T09:15:30.646522+0000","last_fullsized":"2024-09-19T09:15:30.646522+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642107+0000","last_change":"2024-09-19T09:15:30.642107+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642107+0000","last_undegraded":"2024-09-19T09:15:30.642107+0000","last_fullsized":"2024-09-19T09:15:30.642107+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.649797+0000","last_change":"2024-09-19T09:15:30.649649+0000","last_active":"2024-09-19T09:15:30.649797+0000","last_peered":"2024-09-19T09:15:30.649797+0000","last_clean":"2024-09-19T09:15:30.649797+0000","last_became_active":"2024-09-19T09:15:30.649349+0000","last_became_peered":"2024-09-19T09:15:30.649349+0000","last_unstale":"2024-09-19T09:15:30.649797+0000","last_undegraded":"2024-09-19T09:15:30.649797+0000","last_fullsized":"2024-09-19T09:15:30.649797+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:42.259611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643373+0000","last_change":"2024-09-19T09:15:30.643373+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643373+0000","last_undegraded":"2024-09-19T09:15:30.643373+0000","last_fullsized":"2024-09-19T09:15:30.643373+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.654164+0000","last_change":"2024-09-19T09:15:30.654042+0000","last_active":"2024-09-19T09:15:30.654164+0000","last_peered":"2024-09-19T09:15:30.654164+0000","last_clean":"2024-09-19T09:15:30.654164+0000","last_became_active":"2024-09-19T09:15:30.653763+0000","last_became_peered":"2024-09-19T09:15:30.653763+0000","last_unstale":"2024-09-19T09:15:30.654164+0000","last_undegraded":"2024-09-19T09:15:30.654164+0000","last_fullsized":"2024-09-19T09:15:30.654164+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:52.454188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643877+0000","last_change":"2024-09-19T09:15:30.643877+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643877+0000","last_undegraded":"2024-09-19T09:15:30.643877+0000","last_fullsized":"2024-09-19T09:15:30.643877+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.651817+0000","last_change":"2024-09-19T09:15:30.651705+0000","last_active":"2024-09-19T09:15:30.651817+0000","last_peered":"2024-09-19T09:15:30.651817+0000","last_clean":"2024-09-19T09:15:30.651817+0000","last_became_active":"2024-09-19T09:15:30.651486+0000","last_became_peered":"2024-09-19T09:15:30.651486+0000","last_unstale":"2024-09-19T09:15:30.651817+0000","last_undegraded":"2024-09-19T09:15:30.651817+0000","last_fullsized":"2024-09-19T09:15:30.651817+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:34.313611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642442+0000","last_change":"2024-09-19T09:15:30.642442+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642442+0000","last_undegraded":"2024-09-19T09:15:30.642442+0000","last_fullsized":"2024-09-19T09:15:30.642442+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.649299+0000","last_change":"2024-09-19T09:15:30.649173+0000","last_active":"2024-09-19T09:15:30.649299+0000","last_peered":"2024-09-19T09:15:30.649299+0000","last_clean":"2024-09-19T09:15:30.649299+0000","last_became_active":"2024-09-19T09:15:30.648936+0000","last_became_peered":"2024-09-19T09:15:30.648936+0000","last_unstale":"2024-09-19T09:15:30.649299+0000","last_undegraded":"2024-09-19T09:15:30.649299+0000","last_fullsized":"2024-09-19T09:15:30.649299+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:41.776269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643973+0000","last_change":"2024-09-19T09:15:30.643973+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643973+0000","last_undegraded":"2024-09-19T09:15:30.643973+0000","last_fullsized":"2024-09-19T09:15:30.643973+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.650884+0000","last_change":"2024-09-19T09:15:30.650218+0000","last_active":"2024-09-19T09:15:30.650884+0000","last_peered":"2024-09-19T09:15:30.650884+0000","last_clean":"2024-09-19T09:15:30.650884+0000","last_became_active":"2024-09-19T09:15:30.649963+0000","last_became_peered":"2024-09-19T09:15:30.649963+0000","last_unstale":"2024-09-19T09:15:30.650884+0000","last_undegraded":"2024-09-19T09:15:30.650884+0000","last_fullsized":"2024-09-19T09:15:30.650884+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:53.351073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646234+0000","last_change":"2024-09-19T09:15:30.646234+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646234+0000","last_undegraded":"2024-09-19T09:15:30.646234+0000","last_fullsized":"2024-09-19T09:15:30.646234+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.646376+0000","last_change":"2024-09-19T09:15:30.646184+0000","last_active":"2024-09-19T09:15:30.646376+0000","last_peered":"2024-09-19T09:15:30.646376+0000","last_clean":"2024-09-19T09:15:30.646376+0000","last_became_active":"2024-09-19T09:15:30.645538+0000","last_became_peered":"2024-09-19T09:15:30.645538+0000","last_unstale":"2024-09-19T09:15:30.646376+0000","last_undegraded":"2024-09-19T09:15:30.646376+0000","last_fullsized":"2024-09-19T09:15:30.646376+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:21.530044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642074+0000","last_change":"2024-09-19T09:15:30.642074+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642074+0000","last_undegraded":"2024-09-19T09:15:30.642074+0000","last_fullsized":"2024-09-19T09:15:30.642074+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.649129+0000","last_change":"2024-09-19T09:15:30.649010+0000","last_active":"2024-09-19T09:15:30.649129+0000","last_peered":"2024-09-19T09:15:30.649129+0000","last_clean":"2024-09-19T09:15:30.649129+0000","last_became_active":"2024-09-19T09:15:30.648759+0000","last_became_peered":"2024-09-19T09:15:30.648759+0000","last_unstale":"2024-09-19T09:15:30.649129+0000","last_undegraded":"2024-09-19T09:15:30.649129+0000","last_fullsized":"2024-09-19T09:15:30.649129+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:29.829394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641731+0000","last_change":"2024-09-19T09:15:30.641731+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641731+0000","last_undegraded":"2024-09-19T09:15:30.641731+0000","last_fullsized":"2024-09-19T09:15:30.641731+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.652963+0000","last_change":"2024-09-19T09:15:30.652419+0000","last_active":"2024-09-19T09:15:30.652963+0000","last_peered":"2024-09-19T09:15:30.652963+0000","last_clean":"2024-09-19T09:15:30.652963+0000","last_became_active":"2024-09-19T09:15:30.652189+0000","last_became_peered":"2024-09-19T09:15:30.652189+0000","last_unstale":"2024-09-19T09:15:30.652963+0000","last_undegraded":"2024-09-19T09:15:30.652963+0000","last_fullsized":"2024-09-19T09:15:30.652963+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:12.041128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644523+0000","last_change":"2024-09-19T09:15:30.644523+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644523+0000","last_undegraded":"2024-09-19T09:15:30.644523+0000","last_fullsized":"2024-09-19T09:15:30.644523+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.651825+0000","last_change":"2024-09-19T09:15:30.651532+0000","last_active":"2024-09-19T09:15:30.651825+0000","last_peered":"2024-09-19T09:15:30.651825+0000","last_clean":"2024-09-19T09:15:30.651825+0000","last_became_active":"2024-09-19T09:15:30.651103+0000","last_became_peered":"2024-09-19T09:15:30.651103+0000","last_unstale":"2024-09-19T09:15:30.651825+0000","last_undegraded":"2024-09-19T09:15:30.651825+0000","last_fullsized":"2024-09-19T09:15:30.651825+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:14.467351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641635+0000","last_change":"2024-09-19T09:15:30.641635+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641635+0000","last_undegraded":"2024-09-19T09:15:30.641635+0000","last_fullsized":"2024-09-19T09:15:30.641635+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.653150+0000","last_change":"2024-09-19T09:15:30.650745+0000","last_active":"2024-09-19T09:15:30.653150+0000","last_peered":"2024-09-19T09:15:30.653150+0000","last_clean":"2024-09-19T09:15:30.653150+0000","last_became_active":"2024-09-19T09:15:30.650538+0000","last_became_peered":"2024-09-19T09:15:30.650538+0000","last_unstale":"2024-09-19T09:15:30.653150+0000","last_undegraded":"2024-09-19T09:15:30.653150+0000","last_fullsized":"2024-09-19T09:15:30.653150+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:46.526044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646643+0000","last_change":"2024-09-19T09:15:30.646643+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646643+0000","last_undegraded":"2024-09-19T09:15:30.646643+0000","last_fullsized":"2024-09-19T09:15:30.646643+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.650508+0000","last_change":"2024-09-19T09:15:30.650364+0000","last_active":"2024-09-19T09:15:30.650508+0000","last_peered":"2024-09-19T09:15:30.650508+0000","last_clean":"2024-09-19T09:15:30.650508+0000","last_became_active":"2024-09-19T09:15:30.649795+0000","last_became_peered":"2024-09-19T09:15:30.649795+0000","last_unstale":"2024-09-19T09:15:30.650508+0000","last_undegraded":"2024-09-19T09:15:30.650508+0000","last_fullsized":"2024-09-19T09:15:30.650508+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:59.730723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643050+0000","last_change":"2024-09-19T09:15:30.643050+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643050+0000","last_undegraded":"2024-09-19T09:15:30.643050+0000","last_fullsized":"2024-09-19T09:15:30.643050+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.652923+0000","last_change":"2024-09-19T09:15:30.651245+0000","last_active":"2024-09-19T09:15:30.652923+0000","last_peered":"2024-09-19T09:15:30.652923+0000","last_clean":"2024-09-19T09:15:30.652923+0000","last_became_active":"2024-09-19T09:15:30.650992+0000","last_became_peered":"2024-09-19T09:15:30.650992+0000","last_unstale":"2024-09-19T09:15:30.652923+0000","last_undegraded":"2024-09-19T09:15:30.652923+0000","last_fullsized":"2024-09-19T09:15:30.652923+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:21.687370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.648212+0000","last_change":"2024-09-19T09:15:30.648212+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.648212+0000","last_undegraded":"2024-09-19T09:15:30.648212+0000","last_fullsized":"2024-09-19T09:15:30.648212+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.653873+0000","last_change":"2024-09-19T09:15:30.653657+0000","last_active":"2024-09-19T09:15:30.653873+0000","last_peered":"2024-09-19T09:15:30.653873+0000","last_clean":"2024-09-19T09:15:30.653873+0000","last_became_active":"2024-09-19T09:15:30.653393+0000","last_became_peered":"2024-09-19T09:15:30.653393+0000","last_unstale":"2024-09-19T09:15:30.653873+0000","last_undegraded":"2024-09-19T09:15:30.653873+0000","last_fullsized":"2024-09-19T09:15:30.653873+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:54.122291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641551+0000","last_change":"2024-09-19T09:15:30.641551+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641551+0000","last_undegraded":"2024-09-19T09:15:30.641551+0000","last_fullsized":"2024-09-19T09:15:30.641551+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.652181+0000","last_change":"2024-09-19T09:15:30.652071+0000","last_active":"2024-09-19T09:15:30.652181+0000","last_peered":"2024-09-19T09:15:30.652181+0000","last_clean":"2024-09-19T09:15:30.652181+0000","last_became_active":"2024-09-19T09:15:30.651854+0000","last_became_peered":"2024-09-19T09:15:30.651854+0000","last_unstale":"2024-09-19T09:15:30.652181+0000","last_undegraded":"2024-09-19T09:15:30.652181+0000","last_fullsized":"2024-09-19T09:15:30.652181+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:24.480796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643119+0000","last_change":"2024-09-19T09:15:30.643119+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643119+0000","last_undegraded":"2024-09-19T09:15:30.643119+0000","last_fullsized":"2024-09-19T09:15:30.643119+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.648027+0000","last_change":"2024-09-19T09:15:30.647466+0000","last_active":"2024-09-19T09:15:30.648027+0000","last_peered":"2024-09-19T09:15:30.648027+0000","last_clean":"2024-09-19T09:15:30.648027+0000","last_became_active":"2024-09-19T09:15:30.647243+0000","last_became_peered":"2024-09-19T09:15:30.647243+0000","last_unstale":"2024-09-19T09:15:30.648027+0000","last_undegraded":"2024-09-19T09:15:30.648027+0000","last_fullsized":"2024-09-19T09:15:30.648027+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:26.248970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644596+0000","last_change":"2024-09-19T09:15:30.644596+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644596+0000","last_undegraded":"2024-09-19T09:15:30.644596+0000","last_fullsized":"2024-09-19T09:15:30.644596+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.650731+0000","last_change":"2024-09-19T09:15:30.650623+0000","last_active":"2024-09-19T09:15:30.650731+0000","last_peered":"2024-09-19T09:15:30.650731+0000","last_clean":"2024-09-19T09:15:30.650731+0000","last_became_active":"2024-09-19T09:15:30.650128+0000","last_became_peered":"2024-09-19T09:15:30.650128+0000","last_unstale":"2024-09-19T09:15:30.650731+0000","last_undegraded":"2024-09-19T09:15:30.650731+0000","last_fullsized":"2024-09-19T09:15:30.650731+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:05.567127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641147+0000","last_change":"2024-09-19T09:15:30.641147+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641147+0000","last_undegraded":"2024-09-19T09:15:30.641147+0000","last_fullsized":"2024-09-19T09:15:30.641147+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.652953+0000","last_change":"2024-09-19T09:15:30.652777+0000","last_active":"2024-09-19T09:15:30.652953+0000","last_peered":"2024-09-19T09:15:30.652953+0000","last_clean":"2024-09-19T09:15:30.652953+0000","last_became_active":"2024-09-19T09:15:30.652329+0000","last_became_peered":"2024-09-19T09:15:30.652329+0000","last_unstale":"2024-09-19T09:15:30.652953+0000","last_undegraded":"2024-09-19T09:15:30.652953+0000","last_fullsized":"2024-09-19T09:15:30.652953+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:07:00.758153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641181+0000","last_change":"2024-09-19T09:15:30.641181+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641181+0000","last_undegraded":"2024-09-19T09:15:30.641181+0000","last_fullsized":"2024-09-19T09:15:30.641181+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.653128+0000","last_change":"2024-09-19T09:15:30.651289+0000","last_active":"2024-09-19T09:15:30.653128+0000","last_peered":"2024-09-19T09:15:30.653128+0000","last_clean":"2024-09-19T09:15:30.653128+0000","last_became_active":"2024-09-19T09:15:30.651068+0000","last_became_peered":"2024-09-19T09:15:30.651068+0000","last_unstale":"2024-09-19T09:15:30.653128+0000","last_undegraded":"2024-09-19T09:15:30.653128+0000","last_fullsized":"2024-09-19T09:15:30.653128+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:48.463943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643750+0000","last_change":"2024-09-19T09:15:30.643750+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643750+0000","last_undegraded":"2024-09-19T09:15:30.643750+0000","last_fullsized":"2024-09-19T09:15:30.643750+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.647596+0000","last_change":"2024-09-19T09:15:30.647469+0000","last_active":"2024-09-19T09:15:30.647596+0000","last_peered":"2024-09-19T09:15:30.647596+0000","last_clean":"2024-09-19T09:15:30.647596+0000","last_became_active":"2024-09-19T09:15:30.647178+0000","last_became_peered":"2024-09-19T09:15:30.647178+0000","last_unstale":"2024-09-19T09:15:30.647596+0000","last_undegraded":"2024-09-19T09:15:30.647596+0000","last_fullsized":"2024-09-19T09:15:30.647596+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:17.125864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.645009+0000","last_change":"2024-09-19T09:15:30.645009+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.645009+0000","last_undegraded":"2024-09-19T09:15:30.645009+0000","last_fullsized":"2024-09-19T09:15:30.645009+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.653743+0000","last_change":"2024-09-19T09:15:30.653622+0000","last_active":"2024-09-19T09:15:30.653743+0000","last_peered":"2024-09-19T09:15:30.653743+0000","last_clean":"2024-09-19T09:15:30.653743+0000","last_became_active":"2024-09-19T09:15:30.653276+0000","last_became_peered":"2024-09-19T09:15:30.653276+0000","last_unstale":"2024-09-19T09:15:30.653743+0000","last_undegraded":"2024-09-19T09:15:30.653743+0000","last_fullsized":"2024-09-19T09:15:30.653743+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:21.197276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643180+0000","last_change":"2024-09-19T09:15:30.643180+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643180+0000","last_undegraded":"2024-09-19T09:15:30.643180+0000","last_fullsized":"2024-09-19T09:15:30.643180+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.652219+0000","last_change":"2024-09-19T09:15:30.651929+0000","last_active":"2024-09-19T09:15:30.652219+0000","last_peered":"2024-09-19T09:15:30.652219+0000","last_clean":"2024-09-19T09:15:30.652219+0000","last_became_active":"2024-09-19T09:15:30.651697+0000","last_became_peered":"2024-09-19T09:15:30.651697+0000","last_unstale":"2024-09-19T09:15:30.652219+0000","last_undegraded":"2024-09-19T09:15:30.652219+0000","last_fullsized":"2024-09-19T09:15:30.652219+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:00.296266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643237+0000","last_change":"2024-09-19T09:15:30.643237+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643237+0000","last_undegraded":"2024-09-19T09:15:30.643237+0000","last_fullsized":"2024-09-19T09:15:30.643237+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.651369+0000","last_change":"2024-09-19T09:15:30.650297+0000","last_active":"2024-09-19T09:15:30.651369+0000","last_peered":"2024-09-19T09:15:30.651369+0000","last_clean":"2024-09-19T09:15:30.651369+0000","last_became_active":"2024-09-19T09:15:30.648904+0000","last_became_peered":"2024-09-19T09:15:30.648904+0000","last_unstale":"2024-09-19T09:15:30.651369+0000","last_undegraded":"2024-09-19T09:15:30.651369+0000","last_fullsized":"2024-09-19T09:15:30.651369+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:52.310374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642927+0000","last_change":"2024-09-19T09:15:30.642927+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642927+0000","last_undegraded":"2024-09-19T09:15:30.642927+0000","last_fullsized":"2024-09-19T09:15:30.642927+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.652995+0000","last_change":"2024-09-19T09:15:30.652887+0000","last_active":"2024-09-19T09:15:30.652995+0000","last_peered":"2024-09-19T09:15:30.652995+0000","last_clean":"2024-09-19T09:15:30.652995+0000","last_became_active":"2024-09-19T09:15:30.652627+0000","last_became_peered":"2024-09-19T09:15:30.652627+0000","last_unstale":"2024-09-19T09:15:30.652995+0000","last_undegraded":"2024-09-19T09:15:30.652995+0000","last_fullsized":"2024-09-19T09:15:30.652995+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:09.841176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641142+0000","last_change":"2024-09-19T09:15:30.641142+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641142+0000","last_undegraded":"2024-09-19T09:15:30.641142+0000","last_fullsized":"2024-09-19T09:15:30.641142+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.649055+0000","last_change":"2024-09-19T09:15:30.648918+0000","last_active":"2024-09-19T09:15:30.649055+0000","last_peered":"2024-09-19T09:15:30.649055+0000","last_clean":"2024-09-19T09:15:30.649055+0000","last_became_active":"2024-09-19T09:15:30.648422+0000","last_became_peered":"2024-09-19T09:15:30.648422+0000","last_unstale":"2024-09-19T09:15:30.649055+0000","last_undegraded":"2024-09-19T09:15:30.649055+0000","last_fullsized":"2024-09-19T09:15:30.649055+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:35.967314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641461+0000","last_change":"2024-09-19T09:15:30.641461+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641461+0000","last_undegraded":"2024-09-19T09:15:30.641461+0000","last_fullsized":"2024-09-19T09:15:30.641461+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.646511+0000","last_change":"2024-09-19T09:15:30.646415+0000","last_active":"2024-09-19T09:15:30.646511+0000","last_peered":"2024-09-19T09:15:30.646511+0000","last_clean":"2024-09-19T09:15:30.646511+0000","last_became_active":"2024-09-19T09:15:30.645939+0000","last_became_peered":"2024-09-19T09:15:30.645939+0000","last_unstale":"2024-09-19T09:15:30.646511+0000","last_undegraded":"2024-09-19T09:15:30.646511+0000","last_fullsized":"2024-09-19T09:15:30.646511+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:24.942472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.645096+0000","last_change":"2024-09-19T09:15:30.645096+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.645096+0000","last_undegraded":"2024-09-19T09:15:30.645096+0000","last_fullsized":"2024-09-19T09:15:30.645096+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.651777+0000","last_change":"2024-09-19T09:15:30.651522+0000","last_active":"2024-09-19T09:15:30.651777+0000","last_peered":"2024-09-19T09:15:30.651777+0000","last_clean":"2024-09-19T09:15:30.651777+0000","last_became_active":"2024-09-19T09:15:30.650503+0000","last_became_peered":"2024-09-19T09:15:30.650503+0000","last_unstale":"2024-09-19T09:15:30.651777+0000","last_undegraded":"2024-09-19T09:15:30.651777+0000","last_fullsized":"2024-09-19T09:15:30.651777+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:52.043381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646363+0000","last_change":"2024-09-19T09:15:30.646363+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646363+0000","last_undegraded":"2024-09-19T09:15:30.646363+0000","last_fullsized":"2024-09-19T09:15:30.646363+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.649523+0000","last_change":"2024-09-19T09:15:30.649413+0000","last_active":"2024-09-19T09:15:30.649523+0000","last_peered":"2024-09-19T09:15:30.649523+0000","last_clean":"2024-09-19T09:15:30.649523+0000","last_became_active":"2024-09-19T09:15:30.648048+0000","last_became_peered":"2024-09-19T09:15:30.648048+0000","last_unstale":"2024-09-19T09:15:30.649523+0000","last_undegraded":"2024-09-19T09:15:30.649523+0000","last_fullsized":"2024-09-19T09:15:30.649523+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:26.745779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.640821+0000","last_change":"2024-09-19T09:15:30.640821+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.640821+0000","last_undegraded":"2024-09-19T09:15:30.640821+0000","last_fullsized":"2024-09-19T09:15:30.640821+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.651308+0000","last_change":"2024-09-19T09:15:30.650891+0000","last_active":"2024-09-19T09:15:30.651308+0000","last_peered":"2024-09-19T09:15:30.651308+0000","last_clean":"2024-09-19T09:15:30.651308+0000","last_became_active":"2024-09-19T09:15:30.650650+0000","last_became_peered":"2024-09-19T09:15:30.650650+0000","last_unstale":"2024-09-19T09:15:30.651308+0000","last_undegraded":"2024-09-19T09:15:30.651308+0000","last_fullsized":"2024-09-19T09:15:30.651308+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:22.098542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.645658+0000","last_change":"2024-09-19T09:15:30.645658+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.645658+0000","last_undegraded":"2024-09-19T09:15:30.645658+0000","last_fullsized":"2024-09-19T09:15:30.645658+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.648117+0000","last_change":"2024-09-19T09:15:30.647949+0000","last_active":"2024-09-19T09:15:30.648117+0000","last_peered":"2024-09-19T09:15:30.648117+0000","last_clean":"2024-09-19T09:15:30.648117+0000","last_became_active":"2024-09-19T09:15:30.647705+0000","last_became_peered":"2024-09-19T09:15:30.647705+0000","last_unstale":"2024-09-19T09:15:30.648117+0000","last_undegraded":"2024-09-19T09:15:30.648117+0000","last_fullsized":"2024-09-19T09:15:30.648117+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:38.127374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643805+0000","last_change":"2024-09-19T09:15:30.643805+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643805+0000","last_undegraded":"2024-09-19T09:15:30.643805+0000","last_fullsized":"2024-09-19T09:15:30.643805+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.650020+0000","last_change":"2024-09-19T09:15:30.648756+0000","last_active":"2024-09-19T09:15:30.650020+0000","last_peered":"2024-09-19T09:15:30.650020+0000","last_clean":"2024-09-19T09:15:30.650020+0000","last_became_active":"2024-09-19T09:15:30.648510+0000","last_became_peered":"2024-09-19T09:15:30.648510+0000","last_unstale":"2024-09-19T09:15:30.650020+0000","last_undegraded":"2024-09-19T09:15:30.650020+0000","last_fullsized":"2024-09-19T09:15:30.650020+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:07.333629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642133+0000","last_change":"2024-09-19T09:15:30.642133+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642133+0000","last_undegraded":"2024-09-19T09:15:30.642133+0000","last_fullsized":"2024-09-19T09:15:30.642133+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.654327+0000","last_change":"2024-09-19T09:15:30.653974+0000","last_active":"2024-09-19T09:15:30.654327+0000","last_peered":"2024-09-19T09:15:30.654327+0000","last_clean":"2024-09-19T09:15:30.654327+0000","last_became_active":"2024-09-19T09:15:30.653484+0000","last_became_peered":"2024-09-19T09:15:30.653484+0000","last_unstale":"2024-09-19T09:15:30.654327+0000","last_undegraded":"2024-09-19T09:15:30.654327+0000","last_fullsized":"2024-09-19T09:15:30.654327+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:28.509727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643475+0000","last_change":"2024-09-19T09:15:30.643475+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643475+0000","last_undegraded":"2024-09-19T09:15:30.643475+0000","last_fullsized":"2024-09-19T09:15:30.643475+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.652902+0000","last_change":"2024-09-19T09:15:30.650413+0000","last_active":"2024-09-19T09:15:30.652902+0000","last_peered":"2024-09-19T09:15:30.652902+0000","last_clean":"2024-09-19T09:15:30.652902+0000","last_became_active":"2024-09-19T09:15:30.650057+0000","last_became_peered":"2024-09-19T09:15:30.650057+0000","last_unstale":"2024-09-19T09:15:30.652902+0000","last_undegraded":"2024-09-19T09:15:30.652902+0000","last_fullsized":"2024-09-19T09:15:30.652902+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:05.004163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":261,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.643891+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:15:30.643891+0000","last_peered":"2024-09-19T09:15:30.643891+0000","last_clean":"2024-09-19T09:15:30.643891+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:15:30.643891+0000","last_undegraded":"2024-09-19T09:15:30.643891+0000","last_fullsized":"2024-09-19T09:15:30.643891+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:48.025210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":341,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194970,"statfs":{"total":200000000,"available":199649886,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":341,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194970,"statfs":{"total":200000000,"available":199649886,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":918,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194394,"statfs":{"total":200000000,"available":199059518,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":341,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194970,"statfs":{"total":200000000,"available":199649886,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":341,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194970,"statfs":{"total":200000000,"available":199649886,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":341,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194970,"statfs":{"total":200000000,"available":199649886,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":912,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194400,"statfs":{"total":200000000,"available":199065793,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":341,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194970,"statfs":{"total":200000000,"available":199649886,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:15:35.002 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:15:35.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.140+0000 7f2b08d59640 1 Processor -- start 2024-09-19T09:15:35.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.140+0000 7f2b08d59640 1 -- start start 2024-09-19T09:15:35.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.141+0000 7f2b08d59640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b040b5b00 0x7f2b04169980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:35.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.141+0000 7f2b08d59640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b040d31b0 con 0x7f2b040d1c70 2024-09-19T09:15:35.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.141+0000 7f2b08d59640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b040d3490 con 0x7f2b0415ed50 2024-09-19T09:15:35.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.141+0000 7f2b08d59640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2b040d3770 con 0x7f2b040b5b00 2024-09-19T09:15:35.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.141+0000 7f2b01d9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f2b040d1c70 0x7f2b040cf9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57180/0 (socket says 172.21.15.18:57180) 2024-09-19T09:15:35.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.141+0000 7f2b01d9b640 1 -- 172.21.15.18:0/2588761270 learned_addr learned my addr 172.21.15.18:0/2588761270 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:15:35.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.141+0000 7f2b0159a640 1 -- 172.21.15.18:0/2588761270 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 262712498 0 0) 0x7f2b040d31b0 con 0x7f2b040d1c70 2024-09-19T09:15:35.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.141+0000 7f2b02d9d640 1 --2- 172.21.15.18:0/2588761270 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b040b5b00 0x7f2b04169980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:35.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.141+0000 7f2b0159a640 1 -- 172.21.15.18:0/2588761270 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2aec003520 con 0x7f2b040d1c70 2024-09-19T09:15:35.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.142+0000 7f2b0159a640 1 -- 172.21.15.18:0/2588761270 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3092206364 0 0) 0x7f2aec003520 con 0x7f2b040d1c70 2024-09-19T09:15:35.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.142+0000 7f2b0159a640 1 -- 172.21.15.18:0/2588761270 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b040b5b00 msgr2=0x7f2b04169980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:35.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.142+0000 7f2b0159a640 1 --2- 172.21.15.18:0/2588761270 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b040b5b00 0x7f2b04169980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.142+0000 7f2b0159a640 1 -- 172.21.15.18:0/2588761270 >> v1:172.21.15.162:6789/0 conn(0x7f2b0415ed50 legacy=0x7f2b040d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:35.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.142+0000 7f2b0159a640 1 -- 172.21.15.18:0/2588761270 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b040d3a50 con 0x7f2b040d1c70 2024-09-19T09:15:35.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.142+0000 7f2b0159a640 1 -- 172.21.15.18:0/2588761270 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f2af8001670 con 0x7f2b040d1c70 2024-09-19T09:15:35.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.142+0000 7f2b0159a640 1 -- 172.21.15.18:0/2588761270 >> v1:172.21.15.18:6789/0 conn(0x7f2b040d1c70 legacy=0x7f2b040cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:35.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.142+0000 7f2b0159a640 1 --2- 172.21.15.18:0/2588761270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2aec0039e0 0x7f2aec003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:35.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.142+0000 7f2b0159a640 1 --2- 172.21.15.18:0/2588761270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2aec004390 0x7f2aec004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:35.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.142+0000 7f2b0159a640 1 --2- 172.21.15.18:0/2588761270 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b040b5b00 0x7f2aec0050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:35.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.142+0000 7f2b0159a640 1 -- 172.21.15.18:0/2588761270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2b040d3770 con 0x7f2aec004390 2024-09-19T09:15:35.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.142+0000 7f2b0159a640 1 -- 172.21.15.18:0/2588761270 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2aec00b9f0 con 0x7f2aec0039e0 2024-09-19T09:15:35.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.142+0000 7f2b0159a640 1 -- 172.21.15.18:0/2588761270 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2aec00bbf0 con 0x7f2b040b5b00 2024-09-19T09:15:35.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.142+0000 7f2b01d9b640 1 --2- 172.21.15.18:0/2588761270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2aec004390 0x7f2aec004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:35.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.142+0000 7f2b0259c640 1 --2- 172.21.15.18:0/2588761270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2aec0039e0 0x7f2aec003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:35.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.142+0000 7f2b02d9d640 1 --2- 172.21.15.18:0/2588761270 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b040b5b00 0x7f2aec0050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:35.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.142+0000 7f2b01d9b640 1 -- 172.21.15.18:0/2588761270 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b040b5b00 msgr2=0x7f2aec0050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:35.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.142+0000 7f2b01d9b640 1 --2- 172.21.15.18:0/2588761270 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b040b5b00 0x7f2aec0050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.142+0000 7f2b01d9b640 1 -- 172.21.15.18:0/2588761270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2aec0039e0 msgr2=0x7f2aec003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:35.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.142+0000 7f2b01d9b640 1 --2- 172.21.15.18:0/2588761270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2aec0039e0 0x7f2aec003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.142+0000 7f2b01d9b640 1 -- 172.21.15.18:0/2588761270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aec003520 con 0x7f2aec004390 2024-09-19T09:15:35.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.143+0000 7f2b01d9b640 1 --2- 172.21.15.18:0/2588761270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2aec004390 0x7f2aec004860 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2af800c240 tx=0x7f2aec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0cedee237dd7a00 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:35.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.143+0000 7f2b0159a640 1 -- 172.21.15.18:0/2588761270 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af8007d10 con 0x7f2aec004390 2024-09-19T09:15:35.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.143+0000 7f2b0159a640 1 -- 172.21.15.18:0/2588761270 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af80058d0 con 0x7f2aec004390 2024-09-19T09:15:35.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.143+0000 7f2b0159a640 1 -- 172.21.15.18:0/2588761270 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af8005ca0 con 0x7f2aec004390 2024-09-19T09:15:35.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.144+0000 7f2b08d59640 1 -- 172.21.15.18:0/2588761270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2aec004390 msgr2=0x7f2aec004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:35.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.144+0000 7f2b08d59640 1 --2- 172.21.15.18:0/2588761270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2aec004390 0x7f2aec004860 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f2af800c240 tx=0x7f2aec005830 comp rx=0 tx=0).stop 2024-09-19T09:15:35.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.144+0000 7f2b02d9d640 1 -- 172.21.15.18:0/2588761270 reap_dead start 2024-09-19T09:15:35.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.144+0000 7f2b08d59640 1 -- 172.21.15.18:0/2588761270 shutdown_connections 2024-09-19T09:15:35.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.144+0000 7f2b08d59640 1 -- 172.21.15.18:0/2588761270 >> 172.21.15.18:0/2588761270 conn(0x7f2b040d4bd0 msgr2=0x7f2b040d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:35.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.144+0000 7f2b08d59640 1 -- 172.21.15.18:0/2588761270 shutdown_connections 2024-09-19T09:15:35.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.144+0000 7f2b08d59640 1 -- 172.21.15.18:0/2588761270 wait complete. 2024-09-19T09:15:35.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.145+0000 7f2b08d59640 1 Processor -- start 2024-09-19T09:15:35.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.145+0000 7f2b08d59640 1 -- start start 2024-09-19T09:15:35.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.146+0000 7f2b08d59640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2aec004390 0x7f2b041f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:35.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.146+0000 7f2b08d59640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b040cf980 0x7f2b040cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:35.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.146+0000 7f2b08d59640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b040cddf0 0x7f2b040ce270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:35.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.146+0000 7f2b08d59640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2b0415f130 con 0x7f2aec004390 2024-09-19T09:15:35.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.146+0000 7f2b08d59640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2b040d3d30 con 0x7f2b040cddf0 2024-09-19T09:15:35.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.146+0000 7f2b08d59640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2b041f44a0 con 0x7f2b040cf980 2024-09-19T09:15:35.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.146+0000 7f2b0259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2aec004390 0x7f2b041f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:35.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.146+0000 7f2b0259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2aec004390 0x7f2b041f3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52832/0 (socket says 172.21.15.18:52832) 2024-09-19T09:15:35.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.146+0000 7f2b0259c640 1 -- 172.21.15.18:0/365702666 learned_addr learned my addr 172.21.15.18:0/365702666 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:35.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.146+0000 7f2b02d9d640 1 --2- 172.21.15.18:0/365702666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b040cddf0 0x7f2b040ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:35.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.146+0000 7f2b01d9b640 1 --2- 172.21.15.18:0/365702666 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b040cf980 0x7f2b040cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:35.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.146+0000 7f2b0259c640 1 -- 172.21.15.18:0/365702666 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b040cf980 msgr2=0x7f2b040cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:35.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.146+0000 7f2b0259c640 1 --2- 172.21.15.18:0/365702666 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b040cf980 0x7f2b040cd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.146+0000 7f2b0259c640 1 -- 172.21.15.18:0/365702666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b040cddf0 msgr2=0x7f2b040ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:35.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.146+0000 7f2b0259c640 1 --2- 172.21.15.18:0/365702666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b040cddf0 0x7f2b040ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.146+0000 7f2b0259c640 1 -- 172.21.15.18:0/365702666 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b04160e60 con 0x7f2aec004390 2024-09-19T09:15:35.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.146+0000 7f2b01d9b640 1 --2- 172.21.15.18:0/365702666 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b040cf980 0x7f2b040cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:35.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.147+0000 7f2b0259c640 1 --2- 172.21.15.18:0/365702666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2aec004390 0x7f2b041f3f60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2af400f7f0 tx=0x7f2af400fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:35.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.147+0000 7f2af2ffd640 1 -- 172.21.15.18:0/365702666 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af400fea0 con 0x7f2aec004390 2024-09-19T09:15:35.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.147+0000 7f2af2ffd640 1 -- 172.21.15.18:0/365702666 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af4018070 con 0x7f2aec004390 2024-09-19T09:15:35.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.147+0000 7f2b08d59640 1 -- 172.21.15.18:0/365702666 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b04161140 con 0x7f2aec004390 2024-09-19T09:15:35.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.147+0000 7f2af2ffd640 1 -- 172.21.15.18:0/365702666 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2af400d730 con 0x7f2aec004390 2024-09-19T09:15:35.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.147+0000 7f2b08d59640 1 -- 172.21.15.18:0/365702666 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b04161700 con 0x7f2aec004390 2024-09-19T09:15:35.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.148+0000 7f2b08d59640 1 -- 172.21.15.18:0/365702666 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b040d21e0 con 0x7f2aec004390 2024-09-19T09:15:35.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.148+0000 7f2af2ffd640 1 -- 172.21.15.18:0/365702666 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2af400d8d0 con 0x7f2aec004390 2024-09-19T09:15:35.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.149+0000 7f2af2ffd640 1 --2- 172.21.15.18:0/365702666 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2ae406c2b0 0x7f2ae406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:35.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.149+0000 7f2af2ffd640 1 -- 172.21.15.18:0/365702666 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7f2af408b1f0 con 0x7f2aec004390 2024-09-19T09:15:35.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.149+0000 7f2b01d9b640 1 --2- 172.21.15.18:0/365702666 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2ae406c2b0 0x7f2ae406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:35.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.149+0000 7f2b01d9b640 1 --2- 172.21.15.18:0/365702666 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2ae406c2b0 0x7f2ae406e770 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2af8033000 tx=0x7f2af8009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:35.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.153+0000 7f2af2ffd640 1 -- 172.21.15.18:0/365702666 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2af40599f0 con 0x7f2aec004390 2024-09-19T09:15:35.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.324+0000 7f2b08d59640 1 -- 172.21.15.18:0/365702666 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2b040d0810 con 0x7f2ae406c2b0 2024-09-19T09:15:35.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.330+0000 7f2af2ffd640 1 -- 172.21.15.18:0/365702666 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242219 (secure 0 0 0) 0x7f2b040d0810 con 0x7f2ae406c2b0 2024-09-19T09:15:35.333 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:15:35.334 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:15:35.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.333+0000 7f2b08d59640 1 -- 172.21.15.18:0/365702666 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2ae406c2b0 msgr2=0x7f2ae406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:35.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.333+0000 7f2b08d59640 1 --2- 172.21.15.18:0/365702666 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2ae406c2b0 0x7f2ae406e770 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2af8033000 tx=0x7f2af8009030 comp rx=0 tx=0).stop 2024-09-19T09:15:35.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.333+0000 7f2b08d59640 1 -- 172.21.15.18:0/365702666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2aec004390 msgr2=0x7f2b041f3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:35.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.333+0000 7f2b08d59640 1 --2- 172.21.15.18:0/365702666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2aec004390 0x7f2b041f3f60 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2af400f7f0 tx=0x7f2af400fcb0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.333+0000 7f2b08d59640 1 -- 172.21.15.18:0/365702666 shutdown_connections 2024-09-19T09:15:35.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.333+0000 7f2b08d59640 1 --2- 172.21.15.18:0/365702666 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2ae406c2b0 0x7f2ae406e770 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.333+0000 7f2b08d59640 1 --2- 172.21.15.18:0/365702666 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b040cddf0 0x7f2b040ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.333+0000 7f2b08d59640 1 --2- 172.21.15.18:0/365702666 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b040cf980 0x7f2b040cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.333+0000 7f2b08d59640 1 --2- 172.21.15.18:0/365702666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2aec004390 0x7f2b041f3f60 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.333+0000 7f2b08d59640 1 -- 172.21.15.18:0/365702666 >> 172.21.15.18:0/365702666 conn(0x7f2b040d4bd0 msgr2=0x7f2b040d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:35.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.333+0000 7f2b08d59640 1 -- 172.21.15.18:0/365702666 shutdown_connections 2024-09-19T09:15:35.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.334+0000 7f2b08d59640 1 -- 172.21.15.18:0/365702666 wait complete. 2024-09-19T09:15:35.345 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":130,"stamp":"2024-09-19T09:15:33.552123+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3882,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558617,"statfs":{"total":1600000000,"available":1596024627,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001079"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646988+0000","last_change":"2024-09-19T09:15:30.646988+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646988+0000","last_undegraded":"2024-09-19T09:15:30.646988+0000","last_fullsized":"2024-09-19T09:15:30.646988+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644359+0000","last_change":"2024-09-19T09:15:30.644359+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644359+0000","last_undegraded":"2024-09-19T09:15:30.644359+0000","last_fullsized":"2024-09-19T09:15:30.644359+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642581+0000","last_change":"2024-09-19T09:15:30.642581+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642581+0000","last_undegraded":"2024-09-19T09:15:30.642581+0000","last_fullsized":"2024-09-19T09:15:30.642581+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643943+0000","last_change":"2024-09-19T09:15:30.643943+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643943+0000","last_undegraded":"2024-09-19T09:15:30.643943+0000","last_fullsized":"2024-09-19T09:15:30.643943+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646618+0000","last_change":"2024-09-19T09:15:30.646618+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646618+0000","last_undegraded":"2024-09-19T09:15:30.646618+0000","last_fullsized":"2024-09-19T09:15:30.646618+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644382+0000","last_change":"2024-09-19T09:15:30.644382+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644382+0000","last_undegraded":"2024-09-19T09:15:30.644382+0000","last_fullsized":"2024-09-19T09:15:30.644382+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644922+0000","last_change":"2024-09-19T09:15:30.644922+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644922+0000","last_undegraded":"2024-09-19T09:15:30.644922+0000","last_fullsized":"2024-09-19T09:15:30.644922+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644580+0000","last_change":"2024-09-19T09:15:30.644580+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644580+0000","last_undegraded":"2024-09-19T09:15:30.644580+0000","last_fullsized":"2024-09-19T09:15:30.644580+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643746+0000","last_change":"2024-09-19T09:15:30.643746+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643746+0000","last_undegraded":"2024-09-19T09:15:30.643746+0000","last_fullsized":"2024-09-19T09:15:30.643746+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643603+0000","last_change":"2024-09-19T09:15:30.643603+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643603+0000","last_undegraded":"2024-09-19T09:15:30.643603+0000","last_fullsized":"2024-09-19T09:15:30.643603+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644355+0000","last_change":"2024-09-19T09:15:30.644355+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644355+0000","last_undegraded":"2024-09-19T09:15:30.644355+0000","last_fullsized":"2024-09-19T09:15:30.644355+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642700+0000","last_change":"2024-09-19T09:15:30.642700+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642700+0000","last_undegraded":"2024-09-19T09:15:30.642700+0000","last_fullsized":"2024-09-19T09:15:30.642700+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.647068+0000","last_change":"2024-09-19T09:15:30.647068+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.647068+0000","last_undegraded":"2024-09-19T09:15:30.647068+0000","last_fullsized":"2024-09-19T09:15:30.647068+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642256+0000","last_change":"2024-09-19T09:15:30.642256+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642256+0000","last_undegraded":"2024-09-19T09:15:30.642256+0000","last_fullsized":"2024-09-19T09:15:30.642256+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644936+0000","last_change":"2024-09-19T09:15:30.644936+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644936+0000","last_undegraded":"2024-09-19T09:15:30.644936+0000","last_fullsized":"2024-09-19T09:15:30.644936+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643372+0000","last_change":"2024-09-19T09:15:30.643372+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643372+0000","last_undegraded":"2024-09-19T09:15:30.643372+0000","last_fullsized":"2024-09-19T09:15:30.643372+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642863+0000","last_change":"2024-09-19T09:15:30.642863+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642863+0000","last_undegraded":"2024-09-19T09:15:30.642863+0000","last_fullsized":"2024-09-19T09:15:30.642863+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641999+0000","last_change":"2024-09-19T09:15:30.641999+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641999+0000","last_undegraded":"2024-09-19T09:15:30.641999+0000","last_fullsized":"2024-09-19T09:15:30.641999+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642131+0000","last_change":"2024-09-19T09:15:30.642131+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642131+0000","last_undegraded":"2024-09-19T09:15:30.642131+0000","last_fullsized":"2024-09-19T09:15:30.642131+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644901+0000","last_change":"2024-09-19T09:15:30.644901+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644901+0000","last_undegraded":"2024-09-19T09:15:30.644901+0000","last_fullsized":"2024-09-19T09:15:30.644901+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646553+0000","last_change":"2024-09-19T09:15:30.646553+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646553+0000","last_undegraded":"2024-09-19T09:15:30.646553+0000","last_fullsized":"2024-09-19T09:15:30.646553+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646820+0000","last_change":"2024-09-19T09:15:30.646820+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646820+0000","last_undegraded":"2024-09-19T09:15:30.646820+0000","last_fullsized":"2024-09-19T09:15:30.646820+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.645443+0000","last_change":"2024-09-19T09:15:30.645443+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.645443+0000","last_undegraded":"2024-09-19T09:15:30.645443+0000","last_fullsized":"2024-09-19T09:15:30.645443+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643480+0000","last_change":"2024-09-19T09:15:30.643480+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643480+0000","last_undegraded":"2024-09-19T09:15:30.643480+0000","last_fullsized":"2024-09-19T09:15:30.643480+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.645392+0000","last_change":"2024-09-19T09:15:30.645392+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.645392+0000","last_undegraded":"2024-09-19T09:15:30.645392+0000","last_fullsized":"2024-09-19T09:15:30.645392+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646020+0000","last_change":"2024-09-19T09:15:30.646020+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646020+0000","last_undegraded":"2024-09-19T09:15:30.646020+0000","last_fullsized":"2024-09-19T09:15:30.646020+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644075+0000","last_change":"2024-09-19T09:15:30.644075+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644075+0000","last_undegraded":"2024-09-19T09:15:30.644075+0000","last_fullsized":"2024-09-19T09:15:30.644075+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644303+0000","last_change":"2024-09-19T09:15:30.644303+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644303+0000","last_undegraded":"2024-09-19T09:15:30.644303+0000","last_fullsized":"2024-09-19T09:15:30.644303+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646932+0000","last_change":"2024-09-19T09:15:30.646932+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646932+0000","last_undegraded":"2024-09-19T09:15:30.646932+0000","last_fullsized":"2024-09-19T09:15:30.646932+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642854+0000","last_change":"2024-09-19T09:15:30.642854+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642854+0000","last_undegraded":"2024-09-19T09:15:30.642854+0000","last_fullsized":"2024-09-19T09:15:30.642854+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642767+0000","last_change":"2024-09-19T09:15:30.642767+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642767+0000","last_undegraded":"2024-09-19T09:15:30.642767+0000","last_fullsized":"2024-09-19T09:15:30.642767+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646522+0000","last_change":"2024-09-19T09:15:30.646522+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646522+0000","last_undegraded":"2024-09-19T09:15:30.646522+0000","last_fullsized":"2024-09-19T09:15:30.646522+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642107+0000","last_change":"2024-09-19T09:15:30.642107+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642107+0000","last_undegraded":"2024-09-19T09:15:30.642107+0000","last_fullsized":"2024-09-19T09:15:30.642107+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.649797+0000","last_change":"2024-09-19T09:15:30.649649+0000","last_active":"2024-09-19T09:15:30.649797+0000","last_peered":"2024-09-19T09:15:30.649797+0000","last_clean":"2024-09-19T09:15:30.649797+0000","last_became_active":"2024-09-19T09:15:30.649349+0000","last_became_peered":"2024-09-19T09:15:30.649349+0000","last_unstale":"2024-09-19T09:15:30.649797+0000","last_undegraded":"2024-09-19T09:15:30.649797+0000","last_fullsized":"2024-09-19T09:15:30.649797+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:42.259611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643373+0000","last_change":"2024-09-19T09:15:30.643373+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643373+0000","last_undegraded":"2024-09-19T09:15:30.643373+0000","last_fullsized":"2024-09-19T09:15:30.643373+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.654164+0000","last_change":"2024-09-19T09:15:30.654042+0000","last_active":"2024-09-19T09:15:30.654164+0000","last_peered":"2024-09-19T09:15:30.654164+0000","last_clean":"2024-09-19T09:15:30.654164+0000","last_became_active":"2024-09-19T09:15:30.653763+0000","last_became_peered":"2024-09-19T09:15:30.653763+0000","last_unstale":"2024-09-19T09:15:30.654164+0000","last_undegraded":"2024-09-19T09:15:30.654164+0000","last_fullsized":"2024-09-19T09:15:30.654164+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:52.454188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643877+0000","last_change":"2024-09-19T09:15:30.643877+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643877+0000","last_undegraded":"2024-09-19T09:15:30.643877+0000","last_fullsized":"2024-09-19T09:15:30.643877+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.651817+0000","last_change":"2024-09-19T09:15:30.651705+0000","last_active":"2024-09-19T09:15:30.651817+0000","last_peered":"2024-09-19T09:15:30.651817+0000","last_clean":"2024-09-19T09:15:30.651817+0000","last_became_active":"2024-09-19T09:15:30.651486+0000","last_became_peered":"2024-09-19T09:15:30.651486+0000","last_unstale":"2024-09-19T09:15:30.651817+0000","last_undegraded":"2024-09-19T09:15:30.651817+0000","last_fullsized":"2024-09-19T09:15:30.651817+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:34.313611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642442+0000","last_change":"2024-09-19T09:15:30.642442+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642442+0000","last_undegraded":"2024-09-19T09:15:30.642442+0000","last_fullsized":"2024-09-19T09:15:30.642442+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.649299+0000","last_change":"2024-09-19T09:15:30.649173+0000","last_active":"2024-09-19T09:15:30.649299+0000","last_peered":"2024-09-19T09:15:30.649299+0000","last_clean":"2024-09-19T09:15:30.649299+0000","last_became_active":"2024-09-19T09:15:30.648936+0000","last_became_peered":"2024-09-19T09:15:30.648936+0000","last_unstale":"2024-09-19T09:15:30.649299+0000","last_undegraded":"2024-09-19T09:15:30.649299+0000","last_fullsized":"2024-09-19T09:15:30.649299+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:41.776269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643973+0000","last_change":"2024-09-19T09:15:30.643973+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643973+0000","last_undegraded":"2024-09-19T09:15:30.643973+0000","last_fullsized":"2024-09-19T09:15:30.643973+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.650884+0000","last_change":"2024-09-19T09:15:30.650218+0000","last_active":"2024-09-19T09:15:30.650884+0000","last_peered":"2024-09-19T09:15:30.650884+0000","last_clean":"2024-09-19T09:15:30.650884+0000","last_became_active":"2024-09-19T09:15:30.649963+0000","last_became_peered":"2024-09-19T09:15:30.649963+0000","last_unstale":"2024-09-19T09:15:30.650884+0000","last_undegraded":"2024-09-19T09:15:30.650884+0000","last_fullsized":"2024-09-19T09:15:30.650884+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:53.351073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646234+0000","last_change":"2024-09-19T09:15:30.646234+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646234+0000","last_undegraded":"2024-09-19T09:15:30.646234+0000","last_fullsized":"2024-09-19T09:15:30.646234+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.646376+0000","last_change":"2024-09-19T09:15:30.646184+0000","last_active":"2024-09-19T09:15:30.646376+0000","last_peered":"2024-09-19T09:15:30.646376+0000","last_clean":"2024-09-19T09:15:30.646376+0000","last_became_active":"2024-09-19T09:15:30.645538+0000","last_became_peered":"2024-09-19T09:15:30.645538+0000","last_unstale":"2024-09-19T09:15:30.646376+0000","last_undegraded":"2024-09-19T09:15:30.646376+0000","last_fullsized":"2024-09-19T09:15:30.646376+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:21.530044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642074+0000","last_change":"2024-09-19T09:15:30.642074+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642074+0000","last_undegraded":"2024-09-19T09:15:30.642074+0000","last_fullsized":"2024-09-19T09:15:30.642074+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.649129+0000","last_change":"2024-09-19T09:15:30.649010+0000","last_active":"2024-09-19T09:15:30.649129+0000","last_peered":"2024-09-19T09:15:30.649129+0000","last_clean":"2024-09-19T09:15:30.649129+0000","last_became_active":"2024-09-19T09:15:30.648759+0000","last_became_peered":"2024-09-19T09:15:30.648759+0000","last_unstale":"2024-09-19T09:15:30.649129+0000","last_undegraded":"2024-09-19T09:15:30.649129+0000","last_fullsized":"2024-09-19T09:15:30.649129+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:29.829394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641731+0000","last_change":"2024-09-19T09:15:30.641731+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641731+0000","last_undegraded":"2024-09-19T09:15:30.641731+0000","last_fullsized":"2024-09-19T09:15:30.641731+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.652963+0000","last_change":"2024-09-19T09:15:30.652419+0000","last_active":"2024-09-19T09:15:30.652963+0000","last_peered":"2024-09-19T09:15:30.652963+0000","last_clean":"2024-09-19T09:15:30.652963+0000","last_became_active":"2024-09-19T09:15:30.652189+0000","last_became_peered":"2024-09-19T09:15:30.652189+0000","last_unstale":"2024-09-19T09:15:30.652963+0000","last_undegraded":"2024-09-19T09:15:30.652963+0000","last_fullsized":"2024-09-19T09:15:30.652963+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:12.041128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644523+0000","last_change":"2024-09-19T09:15:30.644523+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644523+0000","last_undegraded":"2024-09-19T09:15:30.644523+0000","last_fullsized":"2024-09-19T09:15:30.644523+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.651825+0000","last_change":"2024-09-19T09:15:30.651532+0000","last_active":"2024-09-19T09:15:30.651825+0000","last_peered":"2024-09-19T09:15:30.651825+0000","last_clean":"2024-09-19T09:15:30.651825+0000","last_became_active":"2024-09-19T09:15:30.651103+0000","last_became_peered":"2024-09-19T09:15:30.651103+0000","last_unstale":"2024-09-19T09:15:30.651825+0000","last_undegraded":"2024-09-19T09:15:30.651825+0000","last_fullsized":"2024-09-19T09:15:30.651825+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:14.467351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641635+0000","last_change":"2024-09-19T09:15:30.641635+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641635+0000","last_undegraded":"2024-09-19T09:15:30.641635+0000","last_fullsized":"2024-09-19T09:15:30.641635+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.653150+0000","last_change":"2024-09-19T09:15:30.650745+0000","last_active":"2024-09-19T09:15:30.653150+0000","last_peered":"2024-09-19T09:15:30.653150+0000","last_clean":"2024-09-19T09:15:30.653150+0000","last_became_active":"2024-09-19T09:15:30.650538+0000","last_became_peered":"2024-09-19T09:15:30.650538+0000","last_unstale":"2024-09-19T09:15:30.653150+0000","last_undegraded":"2024-09-19T09:15:30.653150+0000","last_fullsized":"2024-09-19T09:15:30.653150+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:46.526044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646643+0000","last_change":"2024-09-19T09:15:30.646643+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646643+0000","last_undegraded":"2024-09-19T09:15:30.646643+0000","last_fullsized":"2024-09-19T09:15:30.646643+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.650508+0000","last_change":"2024-09-19T09:15:30.650364+0000","last_active":"2024-09-19T09:15:30.650508+0000","last_peered":"2024-09-19T09:15:30.650508+0000","last_clean":"2024-09-19T09:15:30.650508+0000","last_became_active":"2024-09-19T09:15:30.649795+0000","last_became_peered":"2024-09-19T09:15:30.649795+0000","last_unstale":"2024-09-19T09:15:30.650508+0000","last_undegraded":"2024-09-19T09:15:30.650508+0000","last_fullsized":"2024-09-19T09:15:30.650508+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:59.730723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643050+0000","last_change":"2024-09-19T09:15:30.643050+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643050+0000","last_undegraded":"2024-09-19T09:15:30.643050+0000","last_fullsized":"2024-09-19T09:15:30.643050+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.652923+0000","last_change":"2024-09-19T09:15:30.651245+0000","last_active":"2024-09-19T09:15:30.652923+0000","last_peered":"2024-09-19T09:15:30.652923+0000","last_clean":"2024-09-19T09:15:30.652923+0000","last_became_active":"2024-09-19T09:15:30.650992+0000","last_became_peered":"2024-09-19T09:15:30.650992+0000","last_unstale":"2024-09-19T09:15:30.652923+0000","last_undegraded":"2024-09-19T09:15:30.652923+0000","last_fullsized":"2024-09-19T09:15:30.652923+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:21.687370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.648212+0000","last_change":"2024-09-19T09:15:30.648212+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.648212+0000","last_undegraded":"2024-09-19T09:15:30.648212+0000","last_fullsized":"2024-09-19T09:15:30.648212+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.653873+0000","last_change":"2024-09-19T09:15:30.653657+0000","last_active":"2024-09-19T09:15:30.653873+0000","last_peered":"2024-09-19T09:15:30.653873+0000","last_clean":"2024-09-19T09:15:30.653873+0000","last_became_active":"2024-09-19T09:15:30.653393+0000","last_became_peered":"2024-09-19T09:15:30.653393+0000","last_unstale":"2024-09-19T09:15:30.653873+0000","last_undegraded":"2024-09-19T09:15:30.653873+0000","last_fullsized":"2024-09-19T09:15:30.653873+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:54.122291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641551+0000","last_change":"2024-09-19T09:15:30.641551+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641551+0000","last_undegraded":"2024-09-19T09:15:30.641551+0000","last_fullsized":"2024-09-19T09:15:30.641551+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.652181+0000","last_change":"2024-09-19T09:15:30.652071+0000","last_active":"2024-09-19T09:15:30.652181+0000","last_peered":"2024-09-19T09:15:30.652181+0000","last_clean":"2024-09-19T09:15:30.652181+0000","last_became_active":"2024-09-19T09:15:30.651854+0000","last_became_peered":"2024-09-19T09:15:30.651854+0000","last_unstale":"2024-09-19T09:15:30.652181+0000","last_undegraded":"2024-09-19T09:15:30.652181+0000","last_fullsized":"2024-09-19T09:15:30.652181+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:24.480796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643119+0000","last_change":"2024-09-19T09:15:30.643119+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643119+0000","last_undegraded":"2024-09-19T09:15:30.643119+0000","last_fullsized":"2024-09-19T09:15:30.643119+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.648027+0000","last_change":"2024-09-19T09:15:30.647466+0000","last_active":"2024-09-19T09:15:30.648027+0000","last_peered":"2024-09-19T09:15:30.648027+0000","last_clean":"2024-09-19T09:15:30.648027+0000","last_became_active":"2024-09-19T09:15:30.647243+0000","last_became_peered":"2024-09-19T09:15:30.647243+0000","last_unstale":"2024-09-19T09:15:30.648027+0000","last_undegraded":"2024-09-19T09:15:30.648027+0000","last_fullsized":"2024-09-19T09:15:30.648027+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:26.248970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644596+0000","last_change":"2024-09-19T09:15:30.644596+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644596+0000","last_undegraded":"2024-09-19T09:15:30.644596+0000","last_fullsized":"2024-09-19T09:15:30.644596+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.650731+0000","last_change":"2024-09-19T09:15:30.650623+0000","last_active":"2024-09-19T09:15:30.650731+0000","last_peered":"2024-09-19T09:15:30.650731+0000","last_clean":"2024-09-19T09:15:30.650731+0000","last_became_active":"2024-09-19T09:15:30.650128+0000","last_became_peered":"2024-09-19T09:15:30.650128+0000","last_unstale":"2024-09-19T09:15:30.650731+0000","last_undegraded":"2024-09-19T09:15:30.650731+0000","last_fullsized":"2024-09-19T09:15:30.650731+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:05.567127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641147+0000","last_change":"2024-09-19T09:15:30.641147+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641147+0000","last_undegraded":"2024-09-19T09:15:30.641147+0000","last_fullsized":"2024-09-19T09:15:30.641147+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.652953+0000","last_change":"2024-09-19T09:15:30.652777+0000","last_active":"2024-09-19T09:15:30.652953+0000","last_peered":"2024-09-19T09:15:30.652953+0000","last_clean":"2024-09-19T09:15:30.652953+0000","last_became_active":"2024-09-19T09:15:30.652329+0000","last_became_peered":"2024-09-19T09:15:30.652329+0000","last_unstale":"2024-09-19T09:15:30.652953+0000","last_undegraded":"2024-09-19T09:15:30.652953+0000","last_fullsized":"2024-09-19T09:15:30.652953+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:07:00.758153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641181+0000","last_change":"2024-09-19T09:15:30.641181+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641181+0000","last_undegraded":"2024-09-19T09:15:30.641181+0000","last_fullsized":"2024-09-19T09:15:30.641181+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.653128+0000","last_change":"2024-09-19T09:15:30.651289+0000","last_active":"2024-09-19T09:15:30.653128+0000","last_peered":"2024-09-19T09:15:30.653128+0000","last_clean":"2024-09-19T09:15:30.653128+0000","last_became_active":"2024-09-19T09:15:30.651068+0000","last_became_peered":"2024-09-19T09:15:30.651068+0000","last_unstale":"2024-09-19T09:15:30.653128+0000","last_undegraded":"2024-09-19T09:15:30.653128+0000","last_fullsized":"2024-09-19T09:15:30.653128+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:48.463943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643750+0000","last_change":"2024-09-19T09:15:30.643750+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643750+0000","last_undegraded":"2024-09-19T09:15:30.643750+0000","last_fullsized":"2024-09-19T09:15:30.643750+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.647596+0000","last_change":"2024-09-19T09:15:30.647469+0000","last_active":"2024-09-19T09:15:30.647596+0000","last_peered":"2024-09-19T09:15:30.647596+0000","last_clean":"2024-09-19T09:15:30.647596+0000","last_became_active":"2024-09-19T09:15:30.647178+0000","last_became_peered":"2024-09-19T09:15:30.647178+0000","last_unstale":"2024-09-19T09:15:30.647596+0000","last_undegraded":"2024-09-19T09:15:30.647596+0000","last_fullsized":"2024-09-19T09:15:30.647596+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:17.125864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.645009+0000","last_change":"2024-09-19T09:15:30.645009+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.645009+0000","last_undegraded":"2024-09-19T09:15:30.645009+0000","last_fullsized":"2024-09-19T09:15:30.645009+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.653743+0000","last_change":"2024-09-19T09:15:30.653622+0000","last_active":"2024-09-19T09:15:30.653743+0000","last_peered":"2024-09-19T09:15:30.653743+0000","last_clean":"2024-09-19T09:15:30.653743+0000","last_became_active":"2024-09-19T09:15:30.653276+0000","last_became_peered":"2024-09-19T09:15:30.653276+0000","last_unstale":"2024-09-19T09:15:30.653743+0000","last_undegraded":"2024-09-19T09:15:30.653743+0000","last_fullsized":"2024-09-19T09:15:30.653743+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:21.197276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643180+0000","last_change":"2024-09-19T09:15:30.643180+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643180+0000","last_undegraded":"2024-09-19T09:15:30.643180+0000","last_fullsized":"2024-09-19T09:15:30.643180+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.652219+0000","last_change":"2024-09-19T09:15:30.651929+0000","last_active":"2024-09-19T09:15:30.652219+0000","last_peered":"2024-09-19T09:15:30.652219+0000","last_clean":"2024-09-19T09:15:30.652219+0000","last_became_active":"2024-09-19T09:15:30.651697+0000","last_became_peered":"2024-09-19T09:15:30.651697+0000","last_unstale":"2024-09-19T09:15:30.652219+0000","last_undegraded":"2024-09-19T09:15:30.652219+0000","last_fullsized":"2024-09-19T09:15:30.652219+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:00.296266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643237+0000","last_change":"2024-09-19T09:15:30.643237+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643237+0000","last_undegraded":"2024-09-19T09:15:30.643237+0000","last_fullsized":"2024-09-19T09:15:30.643237+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.651369+0000","last_change":"2024-09-19T09:15:30.650297+0000","last_active":"2024-09-19T09:15:30.651369+0000","last_peered":"2024-09-19T09:15:30.651369+0000","last_clean":"2024-09-19T09:15:30.651369+0000","last_became_active":"2024-09-19T09:15:30.648904+0000","last_became_peered":"2024-09-19T09:15:30.648904+0000","last_unstale":"2024-09-19T09:15:30.651369+0000","last_undegraded":"2024-09-19T09:15:30.651369+0000","last_fullsized":"2024-09-19T09:15:30.651369+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:52.310374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642927+0000","last_change":"2024-09-19T09:15:30.642927+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642927+0000","last_undegraded":"2024-09-19T09:15:30.642927+0000","last_fullsized":"2024-09-19T09:15:30.642927+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.652995+0000","last_change":"2024-09-19T09:15:30.652887+0000","last_active":"2024-09-19T09:15:30.652995+0000","last_peered":"2024-09-19T09:15:30.652995+0000","last_clean":"2024-09-19T09:15:30.652995+0000","last_became_active":"2024-09-19T09:15:30.652627+0000","last_became_peered":"2024-09-19T09:15:30.652627+0000","last_unstale":"2024-09-19T09:15:30.652995+0000","last_undegraded":"2024-09-19T09:15:30.652995+0000","last_fullsized":"2024-09-19T09:15:30.652995+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:09.841176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641142+0000","last_change":"2024-09-19T09:15:30.641142+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641142+0000","last_undegraded":"2024-09-19T09:15:30.641142+0000","last_fullsized":"2024-09-19T09:15:30.641142+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.649055+0000","last_change":"2024-09-19T09:15:30.648918+0000","last_active":"2024-09-19T09:15:30.649055+0000","last_peered":"2024-09-19T09:15:30.649055+0000","last_clean":"2024-09-19T09:15:30.649055+0000","last_became_active":"2024-09-19T09:15:30.648422+0000","last_became_peered":"2024-09-19T09:15:30.648422+0000","last_unstale":"2024-09-19T09:15:30.649055+0000","last_undegraded":"2024-09-19T09:15:30.649055+0000","last_fullsized":"2024-09-19T09:15:30.649055+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:35.967314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641461+0000","last_change":"2024-09-19T09:15:30.641461+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641461+0000","last_undegraded":"2024-09-19T09:15:30.641461+0000","last_fullsized":"2024-09-19T09:15:30.641461+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.646511+0000","last_change":"2024-09-19T09:15:30.646415+0000","last_active":"2024-09-19T09:15:30.646511+0000","last_peered":"2024-09-19T09:15:30.646511+0000","last_clean":"2024-09-19T09:15:30.646511+0000","last_became_active":"2024-09-19T09:15:30.645939+0000","last_became_peered":"2024-09-19T09:15:30.645939+0000","last_unstale":"2024-09-19T09:15:30.646511+0000","last_undegraded":"2024-09-19T09:15:30.646511+0000","last_fullsized":"2024-09-19T09:15:30.646511+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:24.942472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.645096+0000","last_change":"2024-09-19T09:15:30.645096+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.645096+0000","last_undegraded":"2024-09-19T09:15:30.645096+0000","last_fullsized":"2024-09-19T09:15:30.645096+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.651777+0000","last_change":"2024-09-19T09:15:30.651522+0000","last_active":"2024-09-19T09:15:30.651777+0000","last_peered":"2024-09-19T09:15:30.651777+0000","last_clean":"2024-09-19T09:15:30.651777+0000","last_became_active":"2024-09-19T09:15:30.650503+0000","last_became_peered":"2024-09-19T09:15:30.650503+0000","last_unstale":"2024-09-19T09:15:30.651777+0000","last_undegraded":"2024-09-19T09:15:30.651777+0000","last_fullsized":"2024-09-19T09:15:30.651777+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:52.043381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646363+0000","last_change":"2024-09-19T09:15:30.646363+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646363+0000","last_undegraded":"2024-09-19T09:15:30.646363+0000","last_fullsized":"2024-09-19T09:15:30.646363+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.649523+0000","last_change":"2024-09-19T09:15:30.649413+0000","last_active":"2024-09-19T09:15:30.649523+0000","last_peered":"2024-09-19T09:15:30.649523+0000","last_clean":"2024-09-19T09:15:30.649523+0000","last_became_active":"2024-09-19T09:15:30.648048+0000","last_became_peered":"2024-09-19T09:15:30.648048+0000","last_unstale":"2024-09-19T09:15:30.649523+0000","last_undegraded":"2024-09-19T09:15:30.649523+0000","last_fullsized":"2024-09-19T09:15:30.649523+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:26.745779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.640821+0000","last_change":"2024-09-19T09:15:30.640821+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.640821+0000","last_undegraded":"2024-09-19T09:15:30.640821+0000","last_fullsized":"2024-09-19T09:15:30.640821+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.651308+0000","last_change":"2024-09-19T09:15:30.650891+0000","last_active":"2024-09-19T09:15:30.651308+0000","last_peered":"2024-09-19T09:15:30.651308+0000","last_clean":"2024-09-19T09:15:30.651308+0000","last_became_active":"2024-09-19T09:15:30.650650+0000","last_became_peered":"2024-09-19T09:15:30.650650+0000","last_unstale":"2024-09-19T09:15:30.651308+0000","last_undegraded":"2024-09-19T09:15:30.651308+0000","last_fullsized":"2024-09-19T09:15:30.651308+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:22.098542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.645658+0000","last_change":"2024-09-19T09:15:30.645658+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.645658+0000","last_undegraded":"2024-09-19T09:15:30.645658+0000","last_fullsized":"2024-09-19T09:15:30.645658+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.648117+0000","last_change":"2024-09-19T09:15:30.647949+0000","last_active":"2024-09-19T09:15:30.648117+0000","last_peered":"2024-09-19T09:15:30.648117+0000","last_clean":"2024-09-19T09:15:30.648117+0000","last_became_active":"2024-09-19T09:15:30.647705+0000","last_became_peered":"2024-09-19T09:15:30.647705+0000","last_unstale":"2024-09-19T09:15:30.648117+0000","last_undegraded":"2024-09-19T09:15:30.648117+0000","last_fullsized":"2024-09-19T09:15:30.648117+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:38.127374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643805+0000","last_change":"2024-09-19T09:15:30.643805+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643805+0000","last_undegraded":"2024-09-19T09:15:30.643805+0000","last_fullsized":"2024-09-19T09:15:30.643805+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.650020+0000","last_change":"2024-09-19T09:15:30.648756+0000","last_active":"2024-09-19T09:15:30.650020+0000","last_peered":"2024-09-19T09:15:30.650020+0000","last_clean":"2024-09-19T09:15:30.650020+0000","last_became_active":"2024-09-19T09:15:30.648510+0000","last_became_peered":"2024-09-19T09:15:30.648510+0000","last_unstale":"2024-09-19T09:15:30.650020+0000","last_undegraded":"2024-09-19T09:15:30.650020+0000","last_fullsized":"2024-09-19T09:15:30.650020+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:07.333629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642133+0000","last_change":"2024-09-19T09:15:30.642133+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642133+0000","last_undegraded":"2024-09-19T09:15:30.642133+0000","last_fullsized":"2024-09-19T09:15:30.642133+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.654327+0000","last_change":"2024-09-19T09:15:30.653974+0000","last_active":"2024-09-19T09:15:30.654327+0000","last_peered":"2024-09-19T09:15:30.654327+0000","last_clean":"2024-09-19T09:15:30.654327+0000","last_became_active":"2024-09-19T09:15:30.653484+0000","last_became_peered":"2024-09-19T09:15:30.653484+0000","last_unstale":"2024-09-19T09:15:30.654327+0000","last_undegraded":"2024-09-19T09:15:30.654327+0000","last_fullsized":"2024-09-19T09:15:30.654327+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:28.509727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643475+0000","last_change":"2024-09-19T09:15:30.643475+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643475+0000","last_undegraded":"2024-09-19T09:15:30.643475+0000","last_fullsized":"2024-09-19T09:15:30.643475+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.652902+0000","last_change":"2024-09-19T09:15:30.650413+0000","last_active":"2024-09-19T09:15:30.652902+0000","last_peered":"2024-09-19T09:15:30.652902+0000","last_clean":"2024-09-19T09:15:30.652902+0000","last_became_active":"2024-09-19T09:15:30.650057+0000","last_became_peered":"2024-09-19T09:15:30.650057+0000","last_unstale":"2024-09-19T09:15:30.652902+0000","last_undegraded":"2024-09-19T09:15:30.652902+0000","last_fullsized":"2024-09-19T09:15:30.652902+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:05.004163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":261,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.643891+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:15:30.643891+0000","last_peered":"2024-09-19T09:15:30.643891+0000","last_clean":"2024-09-19T09:15:30.643891+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:15:30.643891+0000","last_undegraded":"2024-09-19T09:15:30.643891+0000","last_fullsized":"2024-09-19T09:15:30.643891+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:48.025210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":341,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194970,"statfs":{"total":200000000,"available":199649886,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":341,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194970,"statfs":{"total":200000000,"available":199649886,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":918,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194394,"statfs":{"total":200000000,"available":199059518,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":341,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194970,"statfs":{"total":200000000,"available":199649886,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":341,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194970,"statfs":{"total":200000000,"available":199649886,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":341,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194970,"statfs":{"total":200000000,"available":199649886,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":912,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194400,"statfs":{"total":200000000,"available":199065793,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":341,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194970,"statfs":{"total":200000000,"available":199649886,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:15:35.348 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3f is not active+clean 2024-09-19T09:15:35.348 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.646988+0000', 'last_change': '2024-09-19T09:15:30.646988+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.646988+0000', 'last_undegraded': '2024-09-19T09:15:30.646988+0000', 'last_fullsized': '2024-09-19T09:15:30.646988+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T09:15:35.348 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3e is not active+clean 2024-09-19T09:15:35.348 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.644359+0000', 'last_change': '2024-09-19T09:15:30.644359+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.644359+0000', 'last_undegraded': '2024-09-19T09:15:30.644359+0000', 'last_fullsized': '2024-09-19T09:15:30.644359+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T09:15:35.349 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3d is not active+clean 2024-09-19T09:15:35.349 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.642581+0000', 'last_change': '2024-09-19T09:15:30.642581+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.642581+0000', 'last_undegraded': '2024-09-19T09:15:30.642581+0000', 'last_fullsized': '2024-09-19T09:15:30.642581+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:15:35.349 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3c is not active+clean 2024-09-19T09:15:35.349 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.643943+0000', 'last_change': '2024-09-19T09:15:30.643943+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.643943+0000', 'last_undegraded': '2024-09-19T09:15:30.643943+0000', 'last_fullsized': '2024-09-19T09:15:30.643943+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T09:15:35.349 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3b is not active+clean 2024-09-19T09:15:35.349 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.646618+0000', 'last_change': '2024-09-19T09:15:30.646618+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.646618+0000', 'last_undegraded': '2024-09-19T09:15:30.646618+0000', 'last_fullsized': '2024-09-19T09:15:30.646618+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T09:15:35.349 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3a is not active+clean 2024-09-19T09:15:35.349 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.644382+0000', 'last_change': '2024-09-19T09:15:30.644382+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.644382+0000', 'last_undegraded': '2024-09-19T09:15:30.644382+0000', 'last_fullsized': '2024-09-19T09:15:30.644382+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T09:15:35.349 INFO:tasks.ceph.ceph_manager.ceph:PG 9.39 is not active+clean 2024-09-19T09:15:35.349 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.644922+0000', 'last_change': '2024-09-19T09:15:30.644922+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.644922+0000', 'last_undegraded': '2024-09-19T09:15:30.644922+0000', 'last_fullsized': '2024-09-19T09:15:30.644922+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T09:15:35.349 INFO:tasks.ceph.ceph_manager.ceph:PG 9.38 is not active+clean 2024-09-19T09:15:35.350 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.644580+0000', 'last_change': '2024-09-19T09:15:30.644580+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.644580+0000', 'last_undegraded': '2024-09-19T09:15:30.644580+0000', 'last_fullsized': '2024-09-19T09:15:30.644580+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T09:15:35.350 INFO:tasks.ceph.ceph_manager.ceph:PG 9.37 is not active+clean 2024-09-19T09:15:35.350 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.643746+0000', 'last_change': '2024-09-19T09:15:30.643746+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.643746+0000', 'last_undegraded': '2024-09-19T09:15:30.643746+0000', 'last_fullsized': '2024-09-19T09:15:30.643746+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T09:15:35.350 INFO:tasks.ceph.ceph_manager.ceph:PG 9.36 is not active+clean 2024-09-19T09:15:35.350 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.643603+0000', 'last_change': '2024-09-19T09:15:30.643603+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.643603+0000', 'last_undegraded': '2024-09-19T09:15:30.643603+0000', 'last_fullsized': '2024-09-19T09:15:30.643603+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T09:15:35.350 INFO:tasks.ceph.ceph_manager.ceph:PG 9.35 is not active+clean 2024-09-19T09:15:35.350 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.644355+0000', 'last_change': '2024-09-19T09:15:30.644355+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.644355+0000', 'last_undegraded': '2024-09-19T09:15:30.644355+0000', 'last_fullsized': '2024-09-19T09:15:30.644355+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T09:15:35.350 INFO:tasks.ceph.ceph_manager.ceph:PG 9.34 is not active+clean 2024-09-19T09:15:35.350 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.642700+0000', 'last_change': '2024-09-19T09:15:30.642700+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.642700+0000', 'last_undegraded': '2024-09-19T09:15:30.642700+0000', 'last_fullsized': '2024-09-19T09:15:30.642700+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T09:15:35.350 INFO:tasks.ceph.ceph_manager.ceph:PG 9.33 is not active+clean 2024-09-19T09:15:35.350 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.647068+0000', 'last_change': '2024-09-19T09:15:30.647068+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.647068+0000', 'last_undegraded': '2024-09-19T09:15:30.647068+0000', 'last_fullsized': '2024-09-19T09:15:30.647068+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T09:15:35.351 INFO:tasks.ceph.ceph_manager.ceph:PG 9.32 is not active+clean 2024-09-19T09:15:35.351 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.642256+0000', 'last_change': '2024-09-19T09:15:30.642256+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.642256+0000', 'last_undegraded': '2024-09-19T09:15:30.642256+0000', 'last_fullsized': '2024-09-19T09:15:30.642256+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:15:35.351 INFO:tasks.ceph.ceph_manager.ceph:PG 9.31 is not active+clean 2024-09-19T09:15:35.351 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.644936+0000', 'last_change': '2024-09-19T09:15:30.644936+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.644936+0000', 'last_undegraded': '2024-09-19T09:15:30.644936+0000', 'last_fullsized': '2024-09-19T09:15:30.644936+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T09:15:35.351 INFO:tasks.ceph.ceph_manager.ceph:PG 9.30 is not active+clean 2024-09-19T09:15:35.351 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.643372+0000', 'last_change': '2024-09-19T09:15:30.643372+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.643372+0000', 'last_undegraded': '2024-09-19T09:15:30.643372+0000', 'last_fullsized': '2024-09-19T09:15:30.643372+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T09:15:35.351 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2f is not active+clean 2024-09-19T09:15:35.351 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.642863+0000', 'last_change': '2024-09-19T09:15:30.642863+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.642863+0000', 'last_undegraded': '2024-09-19T09:15:30.642863+0000', 'last_fullsized': '2024-09-19T09:15:30.642863+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T09:15:35.351 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2e is not active+clean 2024-09-19T09:15:35.351 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.641999+0000', 'last_change': '2024-09-19T09:15:30.641999+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.641999+0000', 'last_undegraded': '2024-09-19T09:15:30.641999+0000', 'last_fullsized': '2024-09-19T09:15:30.641999+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:15:35.351 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2d is not active+clean 2024-09-19T09:15:35.351 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.642131+0000', 'last_change': '2024-09-19T09:15:30.642131+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.642131+0000', 'last_undegraded': '2024-09-19T09:15:30.642131+0000', 'last_fullsized': '2024-09-19T09:15:30.642131+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T09:15:35.352 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2c is not active+clean 2024-09-19T09:15:35.352 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.644901+0000', 'last_change': '2024-09-19T09:15:30.644901+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.644901+0000', 'last_undegraded': '2024-09-19T09:15:30.644901+0000', 'last_fullsized': '2024-09-19T09:15:30.644901+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T09:15:35.352 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2b is not active+clean 2024-09-19T09:15:35.352 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.646553+0000', 'last_change': '2024-09-19T09:15:30.646553+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.646553+0000', 'last_undegraded': '2024-09-19T09:15:30.646553+0000', 'last_fullsized': '2024-09-19T09:15:30.646553+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T09:15:35.352 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2a is not active+clean 2024-09-19T09:15:35.352 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.646820+0000', 'last_change': '2024-09-19T09:15:30.646820+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.646820+0000', 'last_undegraded': '2024-09-19T09:15:30.646820+0000', 'last_fullsized': '2024-09-19T09:15:30.646820+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T09:15:35.352 INFO:tasks.ceph.ceph_manager.ceph:PG 9.29 is not active+clean 2024-09-19T09:15:35.352 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.645443+0000', 'last_change': '2024-09-19T09:15:30.645443+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.645443+0000', 'last_undegraded': '2024-09-19T09:15:30.645443+0000', 'last_fullsized': '2024-09-19T09:15:30.645443+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T09:15:35.352 INFO:tasks.ceph.ceph_manager.ceph:PG 9.28 is not active+clean 2024-09-19T09:15:35.352 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.643480+0000', 'last_change': '2024-09-19T09:15:30.643480+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.643480+0000', 'last_undegraded': '2024-09-19T09:15:30.643480+0000', 'last_fullsized': '2024-09-19T09:15:30.643480+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T09:15:35.352 INFO:tasks.ceph.ceph_manager.ceph:PG 9.27 is not active+clean 2024-09-19T09:15:35.353 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.645392+0000', 'last_change': '2024-09-19T09:15:30.645392+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.645392+0000', 'last_undegraded': '2024-09-19T09:15:30.645392+0000', 'last_fullsized': '2024-09-19T09:15:30.645392+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T09:15:35.353 INFO:tasks.ceph.ceph_manager.ceph:PG 9.26 is not active+clean 2024-09-19T09:15:35.353 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.646020+0000', 'last_change': '2024-09-19T09:15:30.646020+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.646020+0000', 'last_undegraded': '2024-09-19T09:15:30.646020+0000', 'last_fullsized': '2024-09-19T09:15:30.646020+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T09:15:35.353 INFO:tasks.ceph.ceph_manager.ceph:PG 9.25 is not active+clean 2024-09-19T09:15:35.353 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.644075+0000', 'last_change': '2024-09-19T09:15:30.644075+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.644075+0000', 'last_undegraded': '2024-09-19T09:15:30.644075+0000', 'last_fullsized': '2024-09-19T09:15:30.644075+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T09:15:35.353 INFO:tasks.ceph.ceph_manager.ceph:PG 9.24 is not active+clean 2024-09-19T09:15:35.353 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.644303+0000', 'last_change': '2024-09-19T09:15:30.644303+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.644303+0000', 'last_undegraded': '2024-09-19T09:15:30.644303+0000', 'last_fullsized': '2024-09-19T09:15:30.644303+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T09:15:35.353 INFO:tasks.ceph.ceph_manager.ceph:PG 9.23 is not active+clean 2024-09-19T09:15:35.353 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.646932+0000', 'last_change': '2024-09-19T09:15:30.646932+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.646932+0000', 'last_undegraded': '2024-09-19T09:15:30.646932+0000', 'last_fullsized': '2024-09-19T09:15:30.646932+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T09:15:35.353 INFO:tasks.ceph.ceph_manager.ceph:PG 9.22 is not active+clean 2024-09-19T09:15:35.353 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.642854+0000', 'last_change': '2024-09-19T09:15:30.642854+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.642854+0000', 'last_undegraded': '2024-09-19T09:15:30.642854+0000', 'last_fullsized': '2024-09-19T09:15:30.642854+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T09:15:35.354 INFO:tasks.ceph.ceph_manager.ceph:PG 9.21 is not active+clean 2024-09-19T09:15:35.354 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.642767+0000', 'last_change': '2024-09-19T09:15:30.642767+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.642767+0000', 'last_undegraded': '2024-09-19T09:15:30.642767+0000', 'last_fullsized': '2024-09-19T09:15:30.642767+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T09:15:35.354 INFO:tasks.ceph.ceph_manager.ceph:PG 9.20 is not active+clean 2024-09-19T09:15:35.354 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.646522+0000', 'last_change': '2024-09-19T09:15:30.646522+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.646522+0000', 'last_undegraded': '2024-09-19T09:15:30.646522+0000', 'last_fullsized': '2024-09-19T09:15:30.646522+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T09:15:35.354 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1e is not active+clean 2024-09-19T09:15:35.354 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.642107+0000', 'last_change': '2024-09-19T09:15:30.642107+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.642107+0000', 'last_undegraded': '2024-09-19T09:15:30.642107+0000', 'last_fullsized': '2024-09-19T09:15:30.642107+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T09:15:35.354 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1f is not active+clean 2024-09-19T09:15:35.354 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.643373+0000', 'last_change': '2024-09-19T09:15:30.643373+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.643373+0000', 'last_undegraded': '2024-09-19T09:15:30.643373+0000', 'last_fullsized': '2024-09-19T09:15:30.643373+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T09:15:35.354 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1c is not active+clean 2024-09-19T09:15:35.354 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.643877+0000', 'last_change': '2024-09-19T09:15:30.643877+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.643877+0000', 'last_undegraded': '2024-09-19T09:15:30.643877+0000', 'last_fullsized': '2024-09-19T09:15:30.643877+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T09:15:35.354 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1d is not active+clean 2024-09-19T09:15:35.354 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.642442+0000', 'last_change': '2024-09-19T09:15:30.642442+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.642442+0000', 'last_undegraded': '2024-09-19T09:15:30.642442+0000', 'last_fullsized': '2024-09-19T09:15:30.642442+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T09:15:35.355 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1a is not active+clean 2024-09-19T09:15:35.355 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.643973+0000', 'last_change': '2024-09-19T09:15:30.643973+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.643973+0000', 'last_undegraded': '2024-09-19T09:15:30.643973+0000', 'last_fullsized': '2024-09-19T09:15:30.643973+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T09:15:35.355 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1b is not active+clean 2024-09-19T09:15:35.355 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.646234+0000', 'last_change': '2024-09-19T09:15:30.646234+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.646234+0000', 'last_undegraded': '2024-09-19T09:15:30.646234+0000', 'last_fullsized': '2024-09-19T09:15:30.646234+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T09:15:35.355 INFO:tasks.ceph.ceph_manager.ceph:PG 9.18 is not active+clean 2024-09-19T09:15:35.355 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.642074+0000', 'last_change': '2024-09-19T09:15:30.642074+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.642074+0000', 'last_undegraded': '2024-09-19T09:15:30.642074+0000', 'last_fullsized': '2024-09-19T09:15:30.642074+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:15:35.355 INFO:tasks.ceph.ceph_manager.ceph:PG 9.19 is not active+clean 2024-09-19T09:15:35.355 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.641731+0000', 'last_change': '2024-09-19T09:15:30.641731+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.641731+0000', 'last_undegraded': '2024-09-19T09:15:30.641731+0000', 'last_fullsized': '2024-09-19T09:15:30.641731+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T09:15:35.355 INFO:tasks.ceph.ceph_manager.ceph:PG 9.16 is not active+clean 2024-09-19T09:15:35.355 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.644523+0000', 'last_change': '2024-09-19T09:15:30.644523+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.644523+0000', 'last_undegraded': '2024-09-19T09:15:30.644523+0000', 'last_fullsized': '2024-09-19T09:15:30.644523+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T09:15:35.355 INFO:tasks.ceph.ceph_manager.ceph:PG 9.17 is not active+clean 2024-09-19T09:15:35.355 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.641635+0000', 'last_change': '2024-09-19T09:15:30.641635+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.641635+0000', 'last_undegraded': '2024-09-19T09:15:30.641635+0000', 'last_fullsized': '2024-09-19T09:15:30.641635+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:15:35.356 INFO:tasks.ceph.ceph_manager.ceph:PG 9.14 is not active+clean 2024-09-19T09:15:35.356 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.646643+0000', 'last_change': '2024-09-19T09:15:30.646643+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.646643+0000', 'last_undegraded': '2024-09-19T09:15:30.646643+0000', 'last_fullsized': '2024-09-19T09:15:30.646643+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T09:15:35.356 INFO:tasks.ceph.ceph_manager.ceph:PG 9.15 is not active+clean 2024-09-19T09:15:35.356 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.643050+0000', 'last_change': '2024-09-19T09:15:30.643050+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.643050+0000', 'last_undegraded': '2024-09-19T09:15:30.643050+0000', 'last_fullsized': '2024-09-19T09:15:30.643050+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T09:15:35.356 INFO:tasks.ceph.ceph_manager.ceph:PG 9.12 is not active+clean 2024-09-19T09:15:35.356 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.648212+0000', 'last_change': '2024-09-19T09:15:30.648212+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.648212+0000', 'last_undegraded': '2024-09-19T09:15:30.648212+0000', 'last_fullsized': '2024-09-19T09:15:30.648212+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T09:15:35.356 INFO:tasks.ceph.ceph_manager.ceph:PG 9.13 is not active+clean 2024-09-19T09:15:35.356 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.641551+0000', 'last_change': '2024-09-19T09:15:30.641551+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.641551+0000', 'last_undegraded': '2024-09-19T09:15:30.641551+0000', 'last_fullsized': '2024-09-19T09:15:30.641551+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:15:35.356 INFO:tasks.ceph.ceph_manager.ceph:PG 9.10 is not active+clean 2024-09-19T09:15:35.356 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.643119+0000', 'last_change': '2024-09-19T09:15:30.643119+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.643119+0000', 'last_undegraded': '2024-09-19T09:15:30.643119+0000', 'last_fullsized': '2024-09-19T09:15:30.643119+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T09:15:35.356 INFO:tasks.ceph.ceph_manager.ceph:PG 9.11 is not active+clean 2024-09-19T09:15:35.356 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.644596+0000', 'last_change': '2024-09-19T09:15:30.644596+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.644596+0000', 'last_undegraded': '2024-09-19T09:15:30.644596+0000', 'last_fullsized': '2024-09-19T09:15:30.644596+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T09:15:35.357 INFO:tasks.ceph.ceph_manager.ceph:PG 9.e is not active+clean 2024-09-19T09:15:35.357 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.641147+0000', 'last_change': '2024-09-19T09:15:30.641147+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.641147+0000', 'last_undegraded': '2024-09-19T09:15:30.641147+0000', 'last_fullsized': '2024-09-19T09:15:30.641147+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:15:35.357 INFO:tasks.ceph.ceph_manager.ceph:PG 9.f is not active+clean 2024-09-19T09:15:35.357 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.641181+0000', 'last_change': '2024-09-19T09:15:30.641181+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.641181+0000', 'last_undegraded': '2024-09-19T09:15:30.641181+0000', 'last_fullsized': '2024-09-19T09:15:30.641181+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:15:35.357 INFO:tasks.ceph.ceph_manager.ceph:PG 9.c is not active+clean 2024-09-19T09:15:35.357 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.643750+0000', 'last_change': '2024-09-19T09:15:30.643750+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.643750+0000', 'last_undegraded': '2024-09-19T09:15:30.643750+0000', 'last_fullsized': '2024-09-19T09:15:30.643750+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T09:15:35.357 INFO:tasks.ceph.ceph_manager.ceph:PG 9.d is not active+clean 2024-09-19T09:15:35.357 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.645009+0000', 'last_change': '2024-09-19T09:15:30.645009+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.645009+0000', 'last_undegraded': '2024-09-19T09:15:30.645009+0000', 'last_fullsized': '2024-09-19T09:15:30.645009+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T09:15:35.357 INFO:tasks.ceph.ceph_manager.ceph:PG 9.a is not active+clean 2024-09-19T09:15:35.358 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.643180+0000', 'last_change': '2024-09-19T09:15:30.643180+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.643180+0000', 'last_undegraded': '2024-09-19T09:15:30.643180+0000', 'last_fullsized': '2024-09-19T09:15:30.643180+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T09:15:35.358 INFO:tasks.ceph.ceph_manager.ceph:PG 9.b is not active+clean 2024-09-19T09:15:35.358 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.643237+0000', 'last_change': '2024-09-19T09:15:30.643237+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.643237+0000', 'last_undegraded': '2024-09-19T09:15:30.643237+0000', 'last_fullsized': '2024-09-19T09:15:30.643237+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T09:15:35.358 INFO:tasks.ceph.ceph_manager.ceph:PG 9.9 is not active+clean 2024-09-19T09:15:35.358 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.642927+0000', 'last_change': '2024-09-19T09:15:30.642927+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.642927+0000', 'last_undegraded': '2024-09-19T09:15:30.642927+0000', 'last_fullsized': '2024-09-19T09:15:30.642927+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T09:15:35.358 INFO:tasks.ceph.ceph_manager.ceph:PG 9.6 is not active+clean 2024-09-19T09:15:35.358 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.641142+0000', 'last_change': '2024-09-19T09:15:30.641142+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.641142+0000', 'last_undegraded': '2024-09-19T09:15:30.641142+0000', 'last_fullsized': '2024-09-19T09:15:30.641142+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:15:35.358 INFO:tasks.ceph.ceph_manager.ceph:PG 9.7 is not active+clean 2024-09-19T09:15:35.358 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.641461+0000', 'last_change': '2024-09-19T09:15:30.641461+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.641461+0000', 'last_undegraded': '2024-09-19T09:15:30.641461+0000', 'last_fullsized': '2024-09-19T09:15:30.641461+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:15:35.358 INFO:tasks.ceph.ceph_manager.ceph:PG 9.4 is not active+clean 2024-09-19T09:15:35.358 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.645096+0000', 'last_change': '2024-09-19T09:15:30.645096+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.645096+0000', 'last_undegraded': '2024-09-19T09:15:30.645096+0000', 'last_fullsized': '2024-09-19T09:15:30.645096+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T09:15:35.358 INFO:tasks.ceph.ceph_manager.ceph:PG 9.5 is not active+clean 2024-09-19T09:15:35.359 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.646363+0000', 'last_change': '2024-09-19T09:15:30.646363+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.646363+0000', 'last_undegraded': '2024-09-19T09:15:30.646363+0000', 'last_fullsized': '2024-09-19T09:15:30.646363+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T09:15:35.359 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2 is not active+clean 2024-09-19T09:15:35.359 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.640821+0000', 'last_change': '2024-09-19T09:15:30.640821+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.640821+0000', 'last_undegraded': '2024-09-19T09:15:30.640821+0000', 'last_fullsized': '2024-09-19T09:15:30.640821+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T09:15:35.359 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3 is not active+clean 2024-09-19T09:15:35.359 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.645658+0000', 'last_change': '2024-09-19T09:15:30.645658+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.645658+0000', 'last_undegraded': '2024-09-19T09:15:30.645658+0000', 'last_fullsized': '2024-09-19T09:15:30.645658+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T09:15:35.359 INFO:tasks.ceph.ceph_manager.ceph:PG 9.0 is not active+clean 2024-09-19T09:15:35.359 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.643805+0000', 'last_change': '2024-09-19T09:15:30.643805+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.643805+0000', 'last_undegraded': '2024-09-19T09:15:30.643805+0000', 'last_fullsized': '2024-09-19T09:15:30.643805+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T09:15:35.359 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1 is not active+clean 2024-09-19T09:15:35.359 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.642133+0000', 'last_change': '2024-09-19T09:15:30.642133+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.642133+0000', 'last_undegraded': '2024-09-19T09:15:30.642133+0000', 'last_fullsized': '2024-09-19T09:15:30.642133+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-19T09:15:35.359 INFO:tasks.ceph.ceph_manager.ceph:PG 9.8 is not active+clean 2024-09-19T09:15:35.359 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 68, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:15:30.643475+0000', 'last_change': '2024-09-19T09:15:30.643475+0000', 'last_active': '2024-09-19T09:15:30.636771+0000', 'last_peered': '2024-09-19T09:15:30.636771+0000', 'last_clean': '2024-09-19T09:15:30.636771+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:15:30.643475+0000', 'last_undegraded': '2024-09-19T09:15:30.643475+0000', 'last_fullsized': '2024-09-19T09:15:30.643475+0000', 'mapping_epoch': 68, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 68, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'last_clean_scrub_stamp': '2024-09-19T09:15:30.636771+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T09:15:35.360 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T09:15:35.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.486+0000 7f27b6926640 1 Processor -- start 2024-09-19T09:15:35.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.486+0000 7f27b6926640 1 -- start start 2024-09-19T09:15:35.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.487+0000 7f27b6926640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f27b015ecc0 0x7f27b00d3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:35.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.487+0000 7f27b6926640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f27b00d57a0 0x7f27b00d1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:35.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.487+0000 7f27b6926640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27b00d3b20 con 0x7f27b00d1990 2024-09-19T09:15:35.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.487+0000 7f27b6926640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f27b00b42f0 con 0x7f27b00d57a0 2024-09-19T09:15:35.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.487+0000 7f27b6926640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f27b00b45d0 con 0x7f27b015ecc0 2024-09-19T09:15:35.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.487+0000 7f27af7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f27b00d57a0 0x7f27b00d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:35.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.487+0000 7f27b4ec3640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f27b00d1990 0x7f27b00cf820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50652/0 (socket says 172.21.15.18:50652) 2024-09-19T09:15:35.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.487+0000 7f27b4ec3640 1 -- 172.21.15.18:0/22635040 learned_addr learned my addr 172.21.15.18:0/22635040 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:15:35.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.487+0000 7f27af7fe640 1 --2- 172.21.15.18:0/22635040 >> v2:172.21.15.18:3300/0 conn(0x7f27b00d57a0 0x7f27b00d1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42214/0 (socket says 172.21.15.18:42214) 2024-09-19T09:15:35.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.487+0000 7f27affff640 1 --2- 172.21.15.18:0/22635040 >> v2:172.21.15.162:3300/0 conn(0x7f27b015ecc0 0x7f27b00d3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:35.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.487+0000 7f27af7fe640 1 -- 172.21.15.18:0/22635040 >> v2:172.21.15.162:3300/0 conn(0x7f27b015ecc0 msgr2=0x7f27b00d3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:35.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.487+0000 7f27af7fe640 1 --2- 172.21.15.18:0/22635040 >> v2:172.21.15.162:3300/0 conn(0x7f27b015ecc0 0x7f27b00d3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.487+0000 7f27af7fe640 1 -- 172.21.15.18:0/22635040 >> v1:172.21.15.18:6789/0 conn(0x7f27b00d1990 legacy=0x7f27b00cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:35.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.487+0000 7f27af7fe640 1 -- 172.21.15.18:0/22635040 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b00b48b0 con 0x7f27b00d57a0 2024-09-19T09:15:35.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.487+0000 7f27aeffd640 1 -- 172.21.15.18:0/22635040 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1026163824 0 0) 0x7f27b00d3b20 con 0x7f27b00d1990 2024-09-19T09:15:35.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.488+0000 7f27af7fe640 1 --2- 172.21.15.18:0/22635040 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27b00d57a0 0x7f27b00d1450 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f27b00d4b30 tx=0x7f279802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de0f7d879dba5595 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:35.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.488+0000 7f27aeffd640 1 -- 172.21.15.18:0/22635040 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2798037070 con 0x7f27b00d57a0 2024-09-19T09:15:35.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.488+0000 7f27aeffd640 1 -- 172.21.15.18:0/22635040 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2798032440 con 0x7f27b00d57a0 2024-09-19T09:15:35.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.488+0000 7f27aeffd640 1 -- 172.21.15.18:0/22635040 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2798032810 con 0x7f27b00d57a0 2024-09-19T09:15:35.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.489+0000 7f27b6926640 1 -- 172.21.15.18:0/22635040 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27b00d57a0 msgr2=0x7f27b00d1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:35.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.489+0000 7f27b6926640 1 --2- 172.21.15.18:0/22635040 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27b00d57a0 0x7f27b00d1450 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f27b00d4b30 tx=0x7f279802a1a0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.489+0000 7f27b6926640 1 -- 172.21.15.18:0/22635040 shutdown_connections 2024-09-19T09:15:35.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.489+0000 7f27b6926640 1 --2- 172.21.15.18:0/22635040 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27b00d57a0 0x7f27b00d1450 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.489+0000 7f27b6926640 1 --2- 172.21.15.18:0/22635040 >> v2:172.21.15.162:3300/0 conn(0x7f27b015ecc0 0x7f27b00d3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.489+0000 7f27b6926640 1 -- 172.21.15.18:0/22635040 >> 172.21.15.18:0/22635040 conn(0x7f27b00d4bd0 msgr2=0x7f27b00d4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:35.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.489+0000 7f27b6926640 1 -- 172.21.15.18:0/22635040 shutdown_connections 2024-09-19T09:15:35.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.489+0000 7f27b6926640 1 -- 172.21.15.18:0/22635040 wait complete. 2024-09-19T09:15:35.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.490+0000 7f27b6926640 1 Processor -- start 2024-09-19T09:15:35.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.490+0000 7f27b6926640 1 -- start start 2024-09-19T09:15:35.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.491+0000 7f27b6926640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27b00d1990 0x7f27b0156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:35.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.491+0000 7f27b6926640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27b00d57a0 0x7f27b01f82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:35.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.491+0000 7f27b6926640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27b015ecc0 0x7f27b01f8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:35.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.491+0000 7f27b6926640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f27b015f220 con 0x7f27b00d1990 2024-09-19T09:15:35.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.491+0000 7f27b6926640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f27b015f0a0 con 0x7f27b015ecc0 2024-09-19T09:15:35.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.491+0000 7f27b6926640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f27b00d36b0 con 0x7f27b00d57a0 2024-09-19T09:15:35.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.491+0000 7f27affff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27b00d1990 0x7f27b0156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:35.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.491+0000 7f27affff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27b00d1990 0x7f27b0156a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42226/0 (socket says 172.21.15.18:42226) 2024-09-19T09:15:35.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.491+0000 7f27affff640 1 -- 172.21.15.18:0/4014137164 learned_addr learned my addr 172.21.15.18:0/4014137164 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:35.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.491+0000 7f27af7fe640 1 --2- 172.21.15.18:0/4014137164 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27b00d57a0 0x7f27b01f82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:35.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.491+0000 7f27affff640 1 -- 172.21.15.18:0/4014137164 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27b00d57a0 msgr2=0x7f27b01f82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:35.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.491+0000 7f27b4ec3640 1 --2- 172.21.15.18:0/4014137164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27b015ecc0 0x7f27b01f8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:35.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.491+0000 7f27affff640 1 --2- 172.21.15.18:0/4014137164 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27b00d57a0 0x7f27b01f82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.491+0000 7f27affff640 1 -- 172.21.15.18:0/4014137164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27b015ecc0 msgr2=0x7f27b01f8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:35.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.491+0000 7f27affff640 1 --2- 172.21.15.18:0/4014137164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27b015ecc0 0x7f27b01f8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.491+0000 7f27affff640 1 -- 172.21.15.18:0/4014137164 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b00ce030 con 0x7f27b00d1990 2024-09-19T09:15:35.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.492+0000 7f27affff640 1 --2- 172.21.15.18:0/4014137164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27b00d1990 0x7f27b0156a10 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f27a000d5f0 tx=0x7f27a000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:35.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.492+0000 7f27acff9640 1 -- 172.21.15.18:0/4014137164 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a00125f0 con 0x7f27b00d1990 2024-09-19T09:15:35.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.492+0000 7f27acff9640 1 -- 172.21.15.18:0/4014137164 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a0019070 con 0x7f27b00d1990 2024-09-19T09:15:35.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.492+0000 7f27acff9640 1 -- 172.21.15.18:0/4014137164 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a00129d0 con 0x7f27b00d1990 2024-09-19T09:15:35.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.492+0000 7f27b6926640 1 -- 172.21.15.18:0/4014137164 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27b00ce310 con 0x7f27b00d1990 2024-09-19T09:15:35.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.492+0000 7f27b6926640 1 -- 172.21.15.18:0/4014137164 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27b00ce8d0 con 0x7f27b00d1990 2024-09-19T09:15:35.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.493+0000 7f27b6926640 1 -- 172.21.15.18:0/4014137164 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27b00d1450 con 0x7f27b00d1990 2024-09-19T09:15:35.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.493+0000 7f27acff9640 1 -- 172.21.15.18:0/4014137164 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f27a0012b70 con 0x7f27b00d1990 2024-09-19T09:15:35.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.494+0000 7f27acff9640 1 --2- 172.21.15.18:0/4014137164 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f279006c2b0 0x7f279006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:35.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.494+0000 7f27acff9640 1 -- 172.21.15.18:0/4014137164 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7f27a008b790 con 0x7f27b00d1990 2024-09-19T09:15:35.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.494+0000 7f27af7fe640 1 --2- 172.21.15.18:0/4014137164 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f279006c2b0 0x7f279006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:35.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.495+0000 7f27af7fe640 1 --2- 172.21.15.18:0/4014137164 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f279006c2b0 0x7f279006e770 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2798034000 tx=0x7f279802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:35.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.498+0000 7f27acff9640 1 -- 172.21.15.18:0/4014137164 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f27a0059f00 con 0x7f27b00d1990 2024-09-19T09:15:35.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.744+0000 7f27b6926640 1 -- 172.21.15.18:0/4014137164 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f27b008e3c0 con 0x7f27b00d1990 2024-09-19T09:15:35.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.744+0000 7f27acff9640 1 -- 172.21.15.18:0/4014137164 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1489 (secure 0 0 0) 0x7f27a0059800 con 0x7f27b00d1990 2024-09-19T09:15:35.745 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:15:35.745 INFO:teuthology.orchestra.run.smithi018.stdout:{"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":144,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":70,"num_osds":8,"num_up_osds":8,"osd_up_since":1726737196,"num_in_osds":8,"osd_in_since":1726737193,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":3975373,"bytes_avail":1596024627,"bytes_total":1600000000,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":28,"btime":"2024-09-19T09:15:33:667104+0000","id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"a","status":"up:active","gid":5574}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-19T09:15:21.549295+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-19T09:15:35.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.746+0000 7f27b6926640 1 -- 172.21.15.18:0/4014137164 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f279006c2b0 msgr2=0x7f279006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:35.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.746+0000 7f27b6926640 1 --2- 172.21.15.18:0/4014137164 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f279006c2b0 0x7f279006e770 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2798034000 tx=0x7f279802e000 comp rx=0 tx=0).stop 2024-09-19T09:15:35.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.746+0000 7f27b6926640 1 -- 172.21.15.18:0/4014137164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27b00d1990 msgr2=0x7f27b0156a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:35.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.746+0000 7f27b6926640 1 --2- 172.21.15.18:0/4014137164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27b00d1990 0x7f27b0156a10 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f27a000d5f0 tx=0x7f27a000dab0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.746+0000 7f27b6926640 1 -- 172.21.15.18:0/4014137164 shutdown_connections 2024-09-19T09:15:35.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.746+0000 7f27b6926640 1 --2- 172.21.15.18:0/4014137164 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f279006c2b0 0x7f279006e770 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.746+0000 7f27b6926640 1 --2- 172.21.15.18:0/4014137164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27b015ecc0 0x7f27b01f8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.746+0000 7f27b6926640 1 --2- 172.21.15.18:0/4014137164 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27b00d57a0 0x7f27b01f82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.746+0000 7f27b6926640 1 --2- 172.21.15.18:0/4014137164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27b00d1990 0x7f27b0156a10 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.746+0000 7f27b6926640 1 -- 172.21.15.18:0/4014137164 >> 172.21.15.18:0/4014137164 conn(0x7f27b00d4bd0 msgr2=0x7f27b0157d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:35.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.746+0000 7f27b6926640 1 -- 172.21.15.18:0/4014137164 shutdown_connections 2024-09-19T09:15:35.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.746+0000 7f27b6926640 1 -- 172.21.15.18:0/4014137164 wait complete. 2024-09-19T09:15:35.757 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-19T09:15:35.758 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:15:35.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.859+0000 7f2416731640 1 Processor -- start 2024-09-19T09:15:35.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.859+0000 7f2416731640 1 -- start start 2024-09-19T09:15:35.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.860+0000 7f2416731640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f241006bc10 0x7f241006bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:35.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.860+0000 7f2416731640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24100d1500 0x7f24100d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:35.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.860+0000 7f2416731640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f241006c530 con 0x7f2410145e80 2024-09-19T09:15:35.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.860+0000 7f2416731640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f24100704e0 con 0x7f241006bc10 2024-09-19T09:15:35.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.860+0000 7f2416731640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f241006e550 con 0x7f24100d1500 2024-09-19T09:15:35.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.860+0000 7f240ffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f241006bc10 0x7f241006bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:35.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.860+0000 7f240ffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f241006bc10 0x7f241006bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42240/0 (socket says 172.21.15.18:42240) 2024-09-19T09:15:35.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.860+0000 7f240ffff640 1 -- 172.21.15.18:0/1640253994 learned_addr learned my addr 172.21.15.18:0/1640253994 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:35.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.861+0000 7f2414cce640 1 --2- 172.21.15.18:0/1640253994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24100d1500 0x7f24100d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:35.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.861+0000 7f240ffff640 1 -- 172.21.15.18:0/1640253994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24100d1500 msgr2=0x7f24100d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:35.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.861+0000 7f240ffff640 1 --2- 172.21.15.18:0/1640253994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24100d1500 0x7f24100d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.861+0000 7f240ffff640 1 -- 172.21.15.18:0/1640253994 >> v1:172.21.15.162:6789/0 conn(0x7f2410145e80 legacy=0x7f241015d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:35.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.861+0000 7f240ffff640 1 -- 172.21.15.18:0/1640253994 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f241006e830 con 0x7f241006bc10 2024-09-19T09:15:35.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.861+0000 7f240ffff640 1 --2- 172.21.15.18:0/1640253994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f241006bc10 0x7f241006bff0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2400009870 tx=0x7f240002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff08527efabb0a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:35.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.861+0000 7f240effd640 1 -- 172.21.15.18:0/1640253994 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2400037070 con 0x7f241006bc10 2024-09-19T09:15:35.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.862+0000 7f240effd640 1 -- 172.21.15.18:0/1640253994 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2400032440 con 0x7f241006bc10 2024-09-19T09:15:35.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.862+0000 7f240effd640 1 -- 172.21.15.18:0/1640253994 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2400032810 con 0x7f241006bc10 2024-09-19T09:15:35.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.862+0000 7f2416731640 1 -- 172.21.15.18:0/1640253994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f241006bc10 msgr2=0x7f241006bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:35.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.862+0000 7f2416731640 1 --2- 172.21.15.18:0/1640253994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f241006bc10 0x7f241006bff0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f2400009870 tx=0x7f240002a180 comp rx=0 tx=0).stop 2024-09-19T09:15:35.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.862+0000 7f2416731640 1 -- 172.21.15.18:0/1640253994 shutdown_connections 2024-09-19T09:15:35.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.862+0000 7f2416731640 1 --2- 172.21.15.18:0/1640253994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f24100d1500 0x7f24100d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.862+0000 7f2416731640 1 --2- 172.21.15.18:0/1640253994 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f241006bc10 0x7f241006bff0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.862+0000 7f2416731640 1 -- 172.21.15.18:0/1640253994 >> 172.21.15.18:0/1640253994 conn(0x7f241006cd20 msgr2=0x7f241006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:35.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.862+0000 7f2416731640 1 -- 172.21.15.18:0/1640253994 shutdown_connections 2024-09-19T09:15:35.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.862+0000 7f2416731640 1 -- 172.21.15.18:0/1640253994 wait complete. 2024-09-19T09:15:35.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.863+0000 7f2416731640 1 Processor -- start 2024-09-19T09:15:35.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.863+0000 7f2416731640 1 -- start start 2024-09-19T09:15:35.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.864+0000 7f2416731640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f241006bc10 0x7f241015b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:35.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.864+0000 7f2416731640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24100d1500 0x7f24101f8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:35.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.864+0000 7f2416731640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2410145e80 0x7f241015dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:35.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.864+0000 7f2416731640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f241006feb0 con 0x7f24100d1500 2024-09-19T09:15:35.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.864+0000 7f2416731640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f24100b0f80 con 0x7f2410145e80 2024-09-19T09:15:35.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.864+0000 7f2416731640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f241006d880 con 0x7f241006bc10 2024-09-19T09:15:35.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.864+0000 7f240f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24100d1500 0x7f24101f8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:35.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.864+0000 7f240f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24100d1500 0x7f24101f8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42244/0 (socket says 172.21.15.18:42244) 2024-09-19T09:15:35.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.864+0000 7f240f7fe640 1 -- 172.21.15.18:0/181308113 learned_addr learned my addr 172.21.15.18:0/181308113 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:35.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.864+0000 7f240ffff640 1 --2- 172.21.15.18:0/181308113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f241006bc10 0x7f241015b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:35.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.864+0000 7f2414cce640 1 --2- 172.21.15.18:0/181308113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2410145e80 0x7f241015dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:35.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.865+0000 7f240f7fe640 1 -- 172.21.15.18:0/181308113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f241006bc10 msgr2=0x7f241015b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:35.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.865+0000 7f240f7fe640 1 --2- 172.21.15.18:0/181308113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f241006bc10 0x7f241015b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.865+0000 7f240f7fe640 1 -- 172.21.15.18:0/181308113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2410145e80 msgr2=0x7f241015dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:35.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.865+0000 7f240f7fe640 1 --2- 172.21.15.18:0/181308113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2410145e80 0x7f241015dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:35.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.865+0000 7f240f7fe640 1 -- 172.21.15.18:0/181308113 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24101f8540 con 0x7f24100d1500 2024-09-19T09:15:35.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.865+0000 7f240f7fe640 1 --2- 172.21.15.18:0/181308113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24100d1500 0x7f24101f8cd0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f240400c460 tx=0x7f240400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:35.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.865+0000 7f240cff9640 1 -- 172.21.15.18:0/181308113 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2404016020 con 0x7f24100d1500 2024-09-19T09:15:35.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.865+0000 7f240cff9640 1 -- 172.21.15.18:0/181308113 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2404012870 con 0x7f24100d1500 2024-09-19T09:15:35.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.865+0000 7f2416731640 1 -- 172.21.15.18:0/181308113 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f241015bd30 con 0x7f24100d1500 2024-09-19T09:15:35.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.865+0000 7f240cff9640 1 -- 172.21.15.18:0/181308113 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2404012c60 con 0x7f24100d1500 2024-09-19T09:15:35.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.865+0000 7f2416731640 1 -- 172.21.15.18:0/181308113 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24101f87b0 con 0x7f24100d1500 2024-09-19T09:15:35.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.866+0000 7f2416731640 1 -- 172.21.15.18:0/181308113 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24101f89b0 con 0x7f24100d1500 2024-09-19T09:15:35.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.867+0000 7f240cff9640 1 -- 172.21.15.18:0/181308113 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2404019020 con 0x7f24100d1500 2024-09-19T09:15:35.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.867+0000 7f240cff9640 1 --2- 172.21.15.18:0/181308113 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f23fc06c2e0 0x7f23fc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:35.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.867+0000 7f240cff9640 1 -- 172.21.15.18:0/181308113 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7f240408ad00 con 0x7f24100d1500 2024-09-19T09:15:35.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.867+0000 7f240ffff640 1 --2- 172.21.15.18:0/181308113 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f23fc06c2e0 0x7f23fc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:35.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.868+0000 7f240ffff640 1 --2- 172.21.15.18:0/181308113 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f23fc06c2e0 0x7f23fc06e7a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2400034000 tx=0x7f240002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:35.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:35.871+0000 7f240cff9640 1 -- 172.21.15.18:0/181308113 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f24101f89b0 con 0x7f24100d1500 2024-09-19T09:15:36.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:36.045+0000 7f2416731640 1 -- 172.21.15.18:0/181308113 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f24101463d0 con 0x7f23fc06c2e0 2024-09-19T09:15:36.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:36.051+0000 7f240cff9640 1 -- 172.21.15.18:0/181308113 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+242219 (secure 0 0 0) 0x7f24101463d0 con 0x7f23fc06c2e0 2024-09-19T09:15:36.054 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:15:36.055 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:15:36.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:36.054+0000 7f2416731640 1 -- 172.21.15.18:0/181308113 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f23fc06c2e0 msgr2=0x7f23fc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:36.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:36.054+0000 7f2416731640 1 --2- 172.21.15.18:0/181308113 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f23fc06c2e0 0x7f23fc06e7a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2400034000 tx=0x7f240002e000 comp rx=0 tx=0).stop 2024-09-19T09:15:36.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:36.054+0000 7f2416731640 1 -- 172.21.15.18:0/181308113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24100d1500 msgr2=0x7f24101f8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:36.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:36.054+0000 7f2416731640 1 --2- 172.21.15.18:0/181308113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24100d1500 0x7f24101f8cd0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f240400c460 tx=0x7f240400c920 comp rx=0 tx=0).stop 2024-09-19T09:15:36.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:36.054+0000 7f2416731640 1 -- 172.21.15.18:0/181308113 shutdown_connections 2024-09-19T09:15:36.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:36.054+0000 7f2416731640 1 --2- 172.21.15.18:0/181308113 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f23fc06c2e0 0x7f23fc06e7a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:36.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:36.054+0000 7f2416731640 1 --2- 172.21.15.18:0/181308113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2410145e80 0x7f241015dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:36.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:36.054+0000 7f2416731640 1 --2- 172.21.15.18:0/181308113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f24100d1500 0x7f24101f8cd0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:36.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:36.054+0000 7f2416731640 1 --2- 172.21.15.18:0/181308113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f241006bc10 0x7f241015b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:36.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:36.054+0000 7f2416731640 1 -- 172.21.15.18:0/181308113 >> 172.21.15.18:0/181308113 conn(0x7f241006cd20 msgr2=0x7f241015ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:36.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:36.054+0000 7f2416731640 1 -- 172.21.15.18:0/181308113 shutdown_connections 2024-09-19T09:15:36.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:36.055+0000 7f2416731640 1 -- 172.21.15.18:0/181308113 wait complete. 2024-09-19T09:15:36.065 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2024-09-19T09:15:35.552637+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3882,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558617,"statfs":{"total":1600000000,"available":1596024627,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.914750"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646988+0000","last_change":"2024-09-19T09:15:30.646988+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646988+0000","last_undegraded":"2024-09-19T09:15:30.646988+0000","last_fullsized":"2024-09-19T09:15:30.646988+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644359+0000","last_change":"2024-09-19T09:15:30.644359+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644359+0000","last_undegraded":"2024-09-19T09:15:30.644359+0000","last_fullsized":"2024-09-19T09:15:30.644359+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642581+0000","last_change":"2024-09-19T09:15:30.642581+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642581+0000","last_undegraded":"2024-09-19T09:15:30.642581+0000","last_fullsized":"2024-09-19T09:15:30.642581+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643943+0000","last_change":"2024-09-19T09:15:30.643943+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643943+0000","last_undegraded":"2024-09-19T09:15:30.643943+0000","last_fullsized":"2024-09-19T09:15:30.643943+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646618+0000","last_change":"2024-09-19T09:15:30.646618+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646618+0000","last_undegraded":"2024-09-19T09:15:30.646618+0000","last_fullsized":"2024-09-19T09:15:30.646618+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644382+0000","last_change":"2024-09-19T09:15:30.644382+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644382+0000","last_undegraded":"2024-09-19T09:15:30.644382+0000","last_fullsized":"2024-09-19T09:15:30.644382+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644922+0000","last_change":"2024-09-19T09:15:30.644922+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644922+0000","last_undegraded":"2024-09-19T09:15:30.644922+0000","last_fullsized":"2024-09-19T09:15:30.644922+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644580+0000","last_change":"2024-09-19T09:15:30.644580+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644580+0000","last_undegraded":"2024-09-19T09:15:30.644580+0000","last_fullsized":"2024-09-19T09:15:30.644580+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643746+0000","last_change":"2024-09-19T09:15:30.643746+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643746+0000","last_undegraded":"2024-09-19T09:15:30.643746+0000","last_fullsized":"2024-09-19T09:15:30.643746+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643603+0000","last_change":"2024-09-19T09:15:30.643603+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643603+0000","last_undegraded":"2024-09-19T09:15:30.643603+0000","last_fullsized":"2024-09-19T09:15:30.643603+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644355+0000","last_change":"2024-09-19T09:15:30.644355+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644355+0000","last_undegraded":"2024-09-19T09:15:30.644355+0000","last_fullsized":"2024-09-19T09:15:30.644355+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642700+0000","last_change":"2024-09-19T09:15:30.642700+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642700+0000","last_undegraded":"2024-09-19T09:15:30.642700+0000","last_fullsized":"2024-09-19T09:15:30.642700+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.647068+0000","last_change":"2024-09-19T09:15:30.647068+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.647068+0000","last_undegraded":"2024-09-19T09:15:30.647068+0000","last_fullsized":"2024-09-19T09:15:30.647068+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642256+0000","last_change":"2024-09-19T09:15:30.642256+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642256+0000","last_undegraded":"2024-09-19T09:15:30.642256+0000","last_fullsized":"2024-09-19T09:15:30.642256+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644936+0000","last_change":"2024-09-19T09:15:30.644936+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644936+0000","last_undegraded":"2024-09-19T09:15:30.644936+0000","last_fullsized":"2024-09-19T09:15:30.644936+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643372+0000","last_change":"2024-09-19T09:15:30.643372+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643372+0000","last_undegraded":"2024-09-19T09:15:30.643372+0000","last_fullsized":"2024-09-19T09:15:30.643372+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642863+0000","last_change":"2024-09-19T09:15:30.642863+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642863+0000","last_undegraded":"2024-09-19T09:15:30.642863+0000","last_fullsized":"2024-09-19T09:15:30.642863+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641999+0000","last_change":"2024-09-19T09:15:30.641999+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641999+0000","last_undegraded":"2024-09-19T09:15:30.641999+0000","last_fullsized":"2024-09-19T09:15:30.641999+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642131+0000","last_change":"2024-09-19T09:15:30.642131+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642131+0000","last_undegraded":"2024-09-19T09:15:30.642131+0000","last_fullsized":"2024-09-19T09:15:30.642131+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644901+0000","last_change":"2024-09-19T09:15:30.644901+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644901+0000","last_undegraded":"2024-09-19T09:15:30.644901+0000","last_fullsized":"2024-09-19T09:15:30.644901+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646553+0000","last_change":"2024-09-19T09:15:30.646553+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646553+0000","last_undegraded":"2024-09-19T09:15:30.646553+0000","last_fullsized":"2024-09-19T09:15:30.646553+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646820+0000","last_change":"2024-09-19T09:15:30.646820+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646820+0000","last_undegraded":"2024-09-19T09:15:30.646820+0000","last_fullsized":"2024-09-19T09:15:30.646820+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.645443+0000","last_change":"2024-09-19T09:15:30.645443+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.645443+0000","last_undegraded":"2024-09-19T09:15:30.645443+0000","last_fullsized":"2024-09-19T09:15:30.645443+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643480+0000","last_change":"2024-09-19T09:15:30.643480+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643480+0000","last_undegraded":"2024-09-19T09:15:30.643480+0000","last_fullsized":"2024-09-19T09:15:30.643480+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.645392+0000","last_change":"2024-09-19T09:15:30.645392+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.645392+0000","last_undegraded":"2024-09-19T09:15:30.645392+0000","last_fullsized":"2024-09-19T09:15:30.645392+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646020+0000","last_change":"2024-09-19T09:15:30.646020+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646020+0000","last_undegraded":"2024-09-19T09:15:30.646020+0000","last_fullsized":"2024-09-19T09:15:30.646020+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644075+0000","last_change":"2024-09-19T09:15:30.644075+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644075+0000","last_undegraded":"2024-09-19T09:15:30.644075+0000","last_fullsized":"2024-09-19T09:15:30.644075+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644303+0000","last_change":"2024-09-19T09:15:30.644303+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644303+0000","last_undegraded":"2024-09-19T09:15:30.644303+0000","last_fullsized":"2024-09-19T09:15:30.644303+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646932+0000","last_change":"2024-09-19T09:15:30.646932+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646932+0000","last_undegraded":"2024-09-19T09:15:30.646932+0000","last_fullsized":"2024-09-19T09:15:30.646932+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642854+0000","last_change":"2024-09-19T09:15:30.642854+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642854+0000","last_undegraded":"2024-09-19T09:15:30.642854+0000","last_fullsized":"2024-09-19T09:15:30.642854+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642767+0000","last_change":"2024-09-19T09:15:30.642767+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642767+0000","last_undegraded":"2024-09-19T09:15:30.642767+0000","last_fullsized":"2024-09-19T09:15:30.642767+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646522+0000","last_change":"2024-09-19T09:15:30.646522+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646522+0000","last_undegraded":"2024-09-19T09:15:30.646522+0000","last_fullsized":"2024-09-19T09:15:30.646522+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642107+0000","last_change":"2024-09-19T09:15:30.642107+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642107+0000","last_undegraded":"2024-09-19T09:15:30.642107+0000","last_fullsized":"2024-09-19T09:15:30.642107+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.649797+0000","last_change":"2024-09-19T09:15:30.649649+0000","last_active":"2024-09-19T09:15:30.649797+0000","last_peered":"2024-09-19T09:15:30.649797+0000","last_clean":"2024-09-19T09:15:30.649797+0000","last_became_active":"2024-09-19T09:15:30.649349+0000","last_became_peered":"2024-09-19T09:15:30.649349+0000","last_unstale":"2024-09-19T09:15:30.649797+0000","last_undegraded":"2024-09-19T09:15:30.649797+0000","last_fullsized":"2024-09-19T09:15:30.649797+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:42.259611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643373+0000","last_change":"2024-09-19T09:15:30.643373+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643373+0000","last_undegraded":"2024-09-19T09:15:30.643373+0000","last_fullsized":"2024-09-19T09:15:30.643373+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.654164+0000","last_change":"2024-09-19T09:15:30.654042+0000","last_active":"2024-09-19T09:15:30.654164+0000","last_peered":"2024-09-19T09:15:30.654164+0000","last_clean":"2024-09-19T09:15:30.654164+0000","last_became_active":"2024-09-19T09:15:30.653763+0000","last_became_peered":"2024-09-19T09:15:30.653763+0000","last_unstale":"2024-09-19T09:15:30.654164+0000","last_undegraded":"2024-09-19T09:15:30.654164+0000","last_fullsized":"2024-09-19T09:15:30.654164+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:52.454188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643877+0000","last_change":"2024-09-19T09:15:30.643877+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643877+0000","last_undegraded":"2024-09-19T09:15:30.643877+0000","last_fullsized":"2024-09-19T09:15:30.643877+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.651817+0000","last_change":"2024-09-19T09:15:30.651705+0000","last_active":"2024-09-19T09:15:30.651817+0000","last_peered":"2024-09-19T09:15:30.651817+0000","last_clean":"2024-09-19T09:15:30.651817+0000","last_became_active":"2024-09-19T09:15:30.651486+0000","last_became_peered":"2024-09-19T09:15:30.651486+0000","last_unstale":"2024-09-19T09:15:30.651817+0000","last_undegraded":"2024-09-19T09:15:30.651817+0000","last_fullsized":"2024-09-19T09:15:30.651817+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:34.313611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642442+0000","last_change":"2024-09-19T09:15:30.642442+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642442+0000","last_undegraded":"2024-09-19T09:15:30.642442+0000","last_fullsized":"2024-09-19T09:15:30.642442+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.649299+0000","last_change":"2024-09-19T09:15:30.649173+0000","last_active":"2024-09-19T09:15:30.649299+0000","last_peered":"2024-09-19T09:15:30.649299+0000","last_clean":"2024-09-19T09:15:30.649299+0000","last_became_active":"2024-09-19T09:15:30.648936+0000","last_became_peered":"2024-09-19T09:15:30.648936+0000","last_unstale":"2024-09-19T09:15:30.649299+0000","last_undegraded":"2024-09-19T09:15:30.649299+0000","last_fullsized":"2024-09-19T09:15:30.649299+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:48:41.776269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643973+0000","last_change":"2024-09-19T09:15:30.643973+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643973+0000","last_undegraded":"2024-09-19T09:15:30.643973+0000","last_fullsized":"2024-09-19T09:15:30.643973+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.650884+0000","last_change":"2024-09-19T09:15:30.650218+0000","last_active":"2024-09-19T09:15:30.650884+0000","last_peered":"2024-09-19T09:15:30.650884+0000","last_clean":"2024-09-19T09:15:30.650884+0000","last_became_active":"2024-09-19T09:15:30.649963+0000","last_became_peered":"2024-09-19T09:15:30.649963+0000","last_unstale":"2024-09-19T09:15:30.650884+0000","last_undegraded":"2024-09-19T09:15:30.650884+0000","last_fullsized":"2024-09-19T09:15:30.650884+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:53.351073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646234+0000","last_change":"2024-09-19T09:15:30.646234+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646234+0000","last_undegraded":"2024-09-19T09:15:30.646234+0000","last_fullsized":"2024-09-19T09:15:30.646234+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.646376+0000","last_change":"2024-09-19T09:15:30.646184+0000","last_active":"2024-09-19T09:15:30.646376+0000","last_peered":"2024-09-19T09:15:30.646376+0000","last_clean":"2024-09-19T09:15:30.646376+0000","last_became_active":"2024-09-19T09:15:30.645538+0000","last_became_peered":"2024-09-19T09:15:30.645538+0000","last_unstale":"2024-09-19T09:15:30.646376+0000","last_undegraded":"2024-09-19T09:15:30.646376+0000","last_fullsized":"2024-09-19T09:15:30.646376+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:04:21.530044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642074+0000","last_change":"2024-09-19T09:15:30.642074+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642074+0000","last_undegraded":"2024-09-19T09:15:30.642074+0000","last_fullsized":"2024-09-19T09:15:30.642074+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.649129+0000","last_change":"2024-09-19T09:15:30.649010+0000","last_active":"2024-09-19T09:15:30.649129+0000","last_peered":"2024-09-19T09:15:30.649129+0000","last_clean":"2024-09-19T09:15:30.649129+0000","last_became_active":"2024-09-19T09:15:30.648759+0000","last_became_peered":"2024-09-19T09:15:30.648759+0000","last_unstale":"2024-09-19T09:15:30.649129+0000","last_undegraded":"2024-09-19T09:15:30.649129+0000","last_fullsized":"2024-09-19T09:15:30.649129+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:25:29.829394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641731+0000","last_change":"2024-09-19T09:15:30.641731+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641731+0000","last_undegraded":"2024-09-19T09:15:30.641731+0000","last_fullsized":"2024-09-19T09:15:30.641731+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.652963+0000","last_change":"2024-09-19T09:15:30.652419+0000","last_active":"2024-09-19T09:15:30.652963+0000","last_peered":"2024-09-19T09:15:30.652963+0000","last_clean":"2024-09-19T09:15:30.652963+0000","last_became_active":"2024-09-19T09:15:30.652189+0000","last_became_peered":"2024-09-19T09:15:30.652189+0000","last_unstale":"2024-09-19T09:15:30.652963+0000","last_undegraded":"2024-09-19T09:15:30.652963+0000","last_fullsized":"2024-09-19T09:15:30.652963+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:12.041128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644523+0000","last_change":"2024-09-19T09:15:30.644523+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644523+0000","last_undegraded":"2024-09-19T09:15:30.644523+0000","last_fullsized":"2024-09-19T09:15:30.644523+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.651825+0000","last_change":"2024-09-19T09:15:30.651532+0000","last_active":"2024-09-19T09:15:30.651825+0000","last_peered":"2024-09-19T09:15:30.651825+0000","last_clean":"2024-09-19T09:15:30.651825+0000","last_became_active":"2024-09-19T09:15:30.651103+0000","last_became_peered":"2024-09-19T09:15:30.651103+0000","last_unstale":"2024-09-19T09:15:30.651825+0000","last_undegraded":"2024-09-19T09:15:30.651825+0000","last_fullsized":"2024-09-19T09:15:30.651825+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:14.467351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641635+0000","last_change":"2024-09-19T09:15:30.641635+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641635+0000","last_undegraded":"2024-09-19T09:15:30.641635+0000","last_fullsized":"2024-09-19T09:15:30.641635+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.653150+0000","last_change":"2024-09-19T09:15:30.650745+0000","last_active":"2024-09-19T09:15:30.653150+0000","last_peered":"2024-09-19T09:15:30.653150+0000","last_clean":"2024-09-19T09:15:30.653150+0000","last_became_active":"2024-09-19T09:15:30.650538+0000","last_became_peered":"2024-09-19T09:15:30.650538+0000","last_unstale":"2024-09-19T09:15:30.653150+0000","last_undegraded":"2024-09-19T09:15:30.653150+0000","last_fullsized":"2024-09-19T09:15:30.653150+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:46.526044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646643+0000","last_change":"2024-09-19T09:15:30.646643+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646643+0000","last_undegraded":"2024-09-19T09:15:30.646643+0000","last_fullsized":"2024-09-19T09:15:30.646643+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.650508+0000","last_change":"2024-09-19T09:15:30.650364+0000","last_active":"2024-09-19T09:15:30.650508+0000","last_peered":"2024-09-19T09:15:30.650508+0000","last_clean":"2024-09-19T09:15:30.650508+0000","last_became_active":"2024-09-19T09:15:30.649795+0000","last_became_peered":"2024-09-19T09:15:30.649795+0000","last_unstale":"2024-09-19T09:15:30.650508+0000","last_undegraded":"2024-09-19T09:15:30.650508+0000","last_fullsized":"2024-09-19T09:15:30.650508+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:59.730723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643050+0000","last_change":"2024-09-19T09:15:30.643050+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643050+0000","last_undegraded":"2024-09-19T09:15:30.643050+0000","last_fullsized":"2024-09-19T09:15:30.643050+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.652923+0000","last_change":"2024-09-19T09:15:30.651245+0000","last_active":"2024-09-19T09:15:30.652923+0000","last_peered":"2024-09-19T09:15:30.652923+0000","last_clean":"2024-09-19T09:15:30.652923+0000","last_became_active":"2024-09-19T09:15:30.650992+0000","last_became_peered":"2024-09-19T09:15:30.650992+0000","last_unstale":"2024-09-19T09:15:30.652923+0000","last_undegraded":"2024-09-19T09:15:30.652923+0000","last_fullsized":"2024-09-19T09:15:30.652923+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:21.687370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.648212+0000","last_change":"2024-09-19T09:15:30.648212+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.648212+0000","last_undegraded":"2024-09-19T09:15:30.648212+0000","last_fullsized":"2024-09-19T09:15:30.648212+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.653873+0000","last_change":"2024-09-19T09:15:30.653657+0000","last_active":"2024-09-19T09:15:30.653873+0000","last_peered":"2024-09-19T09:15:30.653873+0000","last_clean":"2024-09-19T09:15:30.653873+0000","last_became_active":"2024-09-19T09:15:30.653393+0000","last_became_peered":"2024-09-19T09:15:30.653393+0000","last_unstale":"2024-09-19T09:15:30.653873+0000","last_undegraded":"2024-09-19T09:15:30.653873+0000","last_fullsized":"2024-09-19T09:15:30.653873+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:54.122291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641551+0000","last_change":"2024-09-19T09:15:30.641551+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641551+0000","last_undegraded":"2024-09-19T09:15:30.641551+0000","last_fullsized":"2024-09-19T09:15:30.641551+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.652181+0000","last_change":"2024-09-19T09:15:30.652071+0000","last_active":"2024-09-19T09:15:30.652181+0000","last_peered":"2024-09-19T09:15:30.652181+0000","last_clean":"2024-09-19T09:15:30.652181+0000","last_became_active":"2024-09-19T09:15:30.651854+0000","last_became_peered":"2024-09-19T09:15:30.651854+0000","last_unstale":"2024-09-19T09:15:30.652181+0000","last_undegraded":"2024-09-19T09:15:30.652181+0000","last_fullsized":"2024-09-19T09:15:30.652181+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:24.480796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643119+0000","last_change":"2024-09-19T09:15:30.643119+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643119+0000","last_undegraded":"2024-09-19T09:15:30.643119+0000","last_fullsized":"2024-09-19T09:15:30.643119+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.648027+0000","last_change":"2024-09-19T09:15:30.647466+0000","last_active":"2024-09-19T09:15:30.648027+0000","last_peered":"2024-09-19T09:15:30.648027+0000","last_clean":"2024-09-19T09:15:30.648027+0000","last_became_active":"2024-09-19T09:15:30.647243+0000","last_became_peered":"2024-09-19T09:15:30.647243+0000","last_unstale":"2024-09-19T09:15:30.648027+0000","last_undegraded":"2024-09-19T09:15:30.648027+0000","last_fullsized":"2024-09-19T09:15:30.648027+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:38:26.248970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.644596+0000","last_change":"2024-09-19T09:15:30.644596+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.644596+0000","last_undegraded":"2024-09-19T09:15:30.644596+0000","last_fullsized":"2024-09-19T09:15:30.644596+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.650731+0000","last_change":"2024-09-19T09:15:30.650623+0000","last_active":"2024-09-19T09:15:30.650731+0000","last_peered":"2024-09-19T09:15:30.650731+0000","last_clean":"2024-09-19T09:15:30.650731+0000","last_became_active":"2024-09-19T09:15:30.650128+0000","last_became_peered":"2024-09-19T09:15:30.650128+0000","last_unstale":"2024-09-19T09:15:30.650731+0000","last_undegraded":"2024-09-19T09:15:30.650731+0000","last_fullsized":"2024-09-19T09:15:30.650731+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:05.567127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641147+0000","last_change":"2024-09-19T09:15:30.641147+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641147+0000","last_undegraded":"2024-09-19T09:15:30.641147+0000","last_fullsized":"2024-09-19T09:15:30.641147+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.652953+0000","last_change":"2024-09-19T09:15:30.652777+0000","last_active":"2024-09-19T09:15:30.652953+0000","last_peered":"2024-09-19T09:15:30.652953+0000","last_clean":"2024-09-19T09:15:30.652953+0000","last_became_active":"2024-09-19T09:15:30.652329+0000","last_became_peered":"2024-09-19T09:15:30.652329+0000","last_unstale":"2024-09-19T09:15:30.652953+0000","last_undegraded":"2024-09-19T09:15:30.652953+0000","last_fullsized":"2024-09-19T09:15:30.652953+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:07:00.758153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641181+0000","last_change":"2024-09-19T09:15:30.641181+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641181+0000","last_undegraded":"2024-09-19T09:15:30.641181+0000","last_fullsized":"2024-09-19T09:15:30.641181+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.653128+0000","last_change":"2024-09-19T09:15:30.651289+0000","last_active":"2024-09-19T09:15:30.653128+0000","last_peered":"2024-09-19T09:15:30.653128+0000","last_clean":"2024-09-19T09:15:30.653128+0000","last_became_active":"2024-09-19T09:15:30.651068+0000","last_became_peered":"2024-09-19T09:15:30.651068+0000","last_unstale":"2024-09-19T09:15:30.653128+0000","last_undegraded":"2024-09-19T09:15:30.653128+0000","last_fullsized":"2024-09-19T09:15:30.653128+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:48.463943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643750+0000","last_change":"2024-09-19T09:15:30.643750+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643750+0000","last_undegraded":"2024-09-19T09:15:30.643750+0000","last_fullsized":"2024-09-19T09:15:30.643750+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.647596+0000","last_change":"2024-09-19T09:15:30.647469+0000","last_active":"2024-09-19T09:15:30.647596+0000","last_peered":"2024-09-19T09:15:30.647596+0000","last_clean":"2024-09-19T09:15:30.647596+0000","last_became_active":"2024-09-19T09:15:30.647178+0000","last_became_peered":"2024-09-19T09:15:30.647178+0000","last_unstale":"2024-09-19T09:15:30.647596+0000","last_undegraded":"2024-09-19T09:15:30.647596+0000","last_fullsized":"2024-09-19T09:15:30.647596+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:32:17.125864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.645009+0000","last_change":"2024-09-19T09:15:30.645009+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.645009+0000","last_undegraded":"2024-09-19T09:15:30.645009+0000","last_fullsized":"2024-09-19T09:15:30.645009+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.653743+0000","last_change":"2024-09-19T09:15:30.653622+0000","last_active":"2024-09-19T09:15:30.653743+0000","last_peered":"2024-09-19T09:15:30.653743+0000","last_clean":"2024-09-19T09:15:30.653743+0000","last_became_active":"2024-09-19T09:15:30.653276+0000","last_became_peered":"2024-09-19T09:15:30.653276+0000","last_unstale":"2024-09-19T09:15:30.653743+0000","last_undegraded":"2024-09-19T09:15:30.653743+0000","last_fullsized":"2024-09-19T09:15:30.653743+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:21.197276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643180+0000","last_change":"2024-09-19T09:15:30.643180+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643180+0000","last_undegraded":"2024-09-19T09:15:30.643180+0000","last_fullsized":"2024-09-19T09:15:30.643180+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.652219+0000","last_change":"2024-09-19T09:15:30.651929+0000","last_active":"2024-09-19T09:15:30.652219+0000","last_peered":"2024-09-19T09:15:30.652219+0000","last_clean":"2024-09-19T09:15:30.652219+0000","last_became_active":"2024-09-19T09:15:30.651697+0000","last_became_peered":"2024-09-19T09:15:30.651697+0000","last_unstale":"2024-09-19T09:15:30.652219+0000","last_undegraded":"2024-09-19T09:15:30.652219+0000","last_fullsized":"2024-09-19T09:15:30.652219+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:00.296266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643237+0000","last_change":"2024-09-19T09:15:30.643237+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643237+0000","last_undegraded":"2024-09-19T09:15:30.643237+0000","last_fullsized":"2024-09-19T09:15:30.643237+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.651369+0000","last_change":"2024-09-19T09:15:30.650297+0000","last_active":"2024-09-19T09:15:30.651369+0000","last_peered":"2024-09-19T09:15:30.651369+0000","last_clean":"2024-09-19T09:15:30.651369+0000","last_became_active":"2024-09-19T09:15:30.648904+0000","last_became_peered":"2024-09-19T09:15:30.648904+0000","last_unstale":"2024-09-19T09:15:30.651369+0000","last_undegraded":"2024-09-19T09:15:30.651369+0000","last_fullsized":"2024-09-19T09:15:30.651369+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:54:52.310374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642927+0000","last_change":"2024-09-19T09:15:30.642927+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642927+0000","last_undegraded":"2024-09-19T09:15:30.642927+0000","last_fullsized":"2024-09-19T09:15:30.642927+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.652995+0000","last_change":"2024-09-19T09:15:30.652887+0000","last_active":"2024-09-19T09:15:30.652995+0000","last_peered":"2024-09-19T09:15:30.652995+0000","last_clean":"2024-09-19T09:15:30.652995+0000","last_became_active":"2024-09-19T09:15:30.652627+0000","last_became_peered":"2024-09-19T09:15:30.652627+0000","last_unstale":"2024-09-19T09:15:30.652995+0000","last_undegraded":"2024-09-19T09:15:30.652995+0000","last_fullsized":"2024-09-19T09:15:30.652995+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:09.841176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641142+0000","last_change":"2024-09-19T09:15:30.641142+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641142+0000","last_undegraded":"2024-09-19T09:15:30.641142+0000","last_fullsized":"2024-09-19T09:15:30.641142+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.649055+0000","last_change":"2024-09-19T09:15:30.648918+0000","last_active":"2024-09-19T09:15:30.649055+0000","last_peered":"2024-09-19T09:15:30.649055+0000","last_clean":"2024-09-19T09:15:30.649055+0000","last_became_active":"2024-09-19T09:15:30.648422+0000","last_became_peered":"2024-09-19T09:15:30.648422+0000","last_unstale":"2024-09-19T09:15:30.649055+0000","last_undegraded":"2024-09-19T09:15:30.649055+0000","last_fullsized":"2024-09-19T09:15:30.649055+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:35.967314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.641461+0000","last_change":"2024-09-19T09:15:30.641461+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.641461+0000","last_undegraded":"2024-09-19T09:15:30.641461+0000","last_fullsized":"2024-09-19T09:15:30.641461+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.646511+0000","last_change":"2024-09-19T09:15:30.646415+0000","last_active":"2024-09-19T09:15:30.646511+0000","last_peered":"2024-09-19T09:15:30.646511+0000","last_clean":"2024-09-19T09:15:30.646511+0000","last_became_active":"2024-09-19T09:15:30.645939+0000","last_became_peered":"2024-09-19T09:15:30.645939+0000","last_unstale":"2024-09-19T09:15:30.646511+0000","last_undegraded":"2024-09-19T09:15:30.646511+0000","last_fullsized":"2024-09-19T09:15:30.646511+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:24.942472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.645096+0000","last_change":"2024-09-19T09:15:30.645096+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.645096+0000","last_undegraded":"2024-09-19T09:15:30.645096+0000","last_fullsized":"2024-09-19T09:15:30.645096+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.651777+0000","last_change":"2024-09-19T09:15:30.651522+0000","last_active":"2024-09-19T09:15:30.651777+0000","last_peered":"2024-09-19T09:15:30.651777+0000","last_clean":"2024-09-19T09:15:30.651777+0000","last_became_active":"2024-09-19T09:15:30.650503+0000","last_became_peered":"2024-09-19T09:15:30.650503+0000","last_unstale":"2024-09-19T09:15:30.651777+0000","last_undegraded":"2024-09-19T09:15:30.651777+0000","last_fullsized":"2024-09-19T09:15:30.651777+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:52.043381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.646363+0000","last_change":"2024-09-19T09:15:30.646363+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.646363+0000","last_undegraded":"2024-09-19T09:15:30.646363+0000","last_fullsized":"2024-09-19T09:15:30.646363+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.649523+0000","last_change":"2024-09-19T09:15:30.649413+0000","last_active":"2024-09-19T09:15:30.649523+0000","last_peered":"2024-09-19T09:15:30.649523+0000","last_clean":"2024-09-19T09:15:30.649523+0000","last_became_active":"2024-09-19T09:15:30.648048+0000","last_became_peered":"2024-09-19T09:15:30.648048+0000","last_unstale":"2024-09-19T09:15:30.649523+0000","last_undegraded":"2024-09-19T09:15:30.649523+0000","last_fullsized":"2024-09-19T09:15:30.649523+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:26.745779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.640821+0000","last_change":"2024-09-19T09:15:30.640821+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.640821+0000","last_undegraded":"2024-09-19T09:15:30.640821+0000","last_fullsized":"2024-09-19T09:15:30.640821+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.651308+0000","last_change":"2024-09-19T09:15:30.650891+0000","last_active":"2024-09-19T09:15:30.651308+0000","last_peered":"2024-09-19T09:15:30.651308+0000","last_clean":"2024-09-19T09:15:30.651308+0000","last_became_active":"2024-09-19T09:15:30.650650+0000","last_became_peered":"2024-09-19T09:15:30.650650+0000","last_unstale":"2024-09-19T09:15:30.651308+0000","last_undegraded":"2024-09-19T09:15:30.651308+0000","last_fullsized":"2024-09-19T09:15:30.651308+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:22.098542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.645658+0000","last_change":"2024-09-19T09:15:30.645658+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.645658+0000","last_undegraded":"2024-09-19T09:15:30.645658+0000","last_fullsized":"2024-09-19T09:15:30.645658+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.648117+0000","last_change":"2024-09-19T09:15:30.647949+0000","last_active":"2024-09-19T09:15:30.648117+0000","last_peered":"2024-09-19T09:15:30.648117+0000","last_clean":"2024-09-19T09:15:30.648117+0000","last_became_active":"2024-09-19T09:15:30.647705+0000","last_became_peered":"2024-09-19T09:15:30.647705+0000","last_unstale":"2024-09-19T09:15:30.648117+0000","last_undegraded":"2024-09-19T09:15:30.648117+0000","last_fullsized":"2024-09-19T09:15:30.648117+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:38.127374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643805+0000","last_change":"2024-09-19T09:15:30.643805+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643805+0000","last_undegraded":"2024-09-19T09:15:30.643805+0000","last_fullsized":"2024-09-19T09:15:30.643805+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.650020+0000","last_change":"2024-09-19T09:15:30.648756+0000","last_active":"2024-09-19T09:15:30.650020+0000","last_peered":"2024-09-19T09:15:30.650020+0000","last_clean":"2024-09-19T09:15:30.650020+0000","last_became_active":"2024-09-19T09:15:30.648510+0000","last_became_peered":"2024-09-19T09:15:30.648510+0000","last_unstale":"2024-09-19T09:15:30.650020+0000","last_undegraded":"2024-09-19T09:15:30.650020+0000","last_fullsized":"2024-09-19T09:15:30.650020+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:07.333629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.642133+0000","last_change":"2024-09-19T09:15:30.642133+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.642133+0000","last_undegraded":"2024-09-19T09:15:30.642133+0000","last_fullsized":"2024-09-19T09:15:30.642133+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.654327+0000","last_change":"2024-09-19T09:15:30.653974+0000","last_active":"2024-09-19T09:15:30.654327+0000","last_peered":"2024-09-19T09:15:30.654327+0000","last_clean":"2024-09-19T09:15:30.654327+0000","last_became_active":"2024-09-19T09:15:30.653484+0000","last_became_peered":"2024-09-19T09:15:30.653484+0000","last_unstale":"2024-09-19T09:15:30.654327+0000","last_undegraded":"2024-09-19T09:15:30.654327+0000","last_fullsized":"2024-09-19T09:15:30.654327+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:28.509727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":68,"state":"creating+peering","last_fresh":"2024-09-19T09:15:30.643475+0000","last_change":"2024-09-19T09:15:30.643475+0000","last_active":"2024-09-19T09:15:30.636771+0000","last_peered":"2024-09-19T09:15:30.636771+0000","last_clean":"2024-09-19T09:15:30.636771+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:15:30.643475+0000","last_undegraded":"2024-09-19T09:15:30.643475+0000","last_fullsized":"2024-09-19T09:15:30.643475+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":9,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.652902+0000","last_change":"2024-09-19T09:15:30.650413+0000","last_active":"2024-09-19T09:15:30.652902+0000","last_peered":"2024-09-19T09:15:30.652902+0000","last_clean":"2024-09-19T09:15:30.652902+0000","last_became_active":"2024-09-19T09:15:30.650057+0000","last_became_peered":"2024-09-19T09:15:30.650057+0000","last_unstale":"2024-09-19T09:15:30.652902+0000","last_undegraded":"2024-09-19T09:15:30.652902+0000","last_fullsized":"2024-09-19T09:15:30.652902+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:05.004163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":261,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-09-19T09:15:30.643891+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:15:30.643891+0000","last_peered":"2024-09-19T09:15:30.643891+0000","last_clean":"2024-09-19T09:15:30.643891+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:15:30.643891+0000","last_undegraded":"2024-09-19T09:15:30.643891+0000","last_fullsized":"2024-09-19T09:15:30.643891+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:48.025210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":341,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194970,"statfs":{"total":200000000,"available":199649886,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":341,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194970,"statfs":{"total":200000000,"available":199649886,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":918,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194394,"statfs":{"total":200000000,"available":199059518,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":341,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194970,"statfs":{"total":200000000,"available":199649886,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":341,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194970,"statfs":{"total":200000000,"available":199649886,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":341,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194970,"statfs":{"total":200000000,"available":199649886,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":912,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194400,"statfs":{"total":200000000,"available":199065793,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":341,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194970,"statfs":{"total":200000000,"available":199649886,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:15:39.070 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:15:39.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.187+0000 7fe70372c640 1 Processor -- start 2024-09-19T09:15:39.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.187+0000 7fe70372c640 1 -- start start 2024-09-19T09:15:39.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.188+0000 7fe70372c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe6fc0cf890 0x7fe6fc0b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:39.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.188+0000 7fe70372c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe6fc1635d0 0x7fe6fc16cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:39.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.188+0000 7fe70372c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6fc0b4560 con 0x7fe6fc071510 2024-09-19T09:15:39.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.188+0000 7fe70372c640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fe6fc0b5170 con 0x7fe6fc1635d0 2024-09-19T09:15:39.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.188+0000 7fe70372c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe6fc0b4840 con 0x7fe6fc0cf890 2024-09-19T09:15:39.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.188+0000 7fe701cc9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe6fc1635d0 0x7fe6fc16cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:39.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.188+0000 7fe701cc9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe6fc1635d0 0x7fe6fc16cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42254/0 (socket says 172.21.15.18:42254) 2024-09-19T09:15:39.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.188+0000 7fe701cc9640 1 -- 172.21.15.18:0/2496488353 learned_addr learned my addr 172.21.15.18:0/2496488353 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:39.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.188+0000 7fe700cc7640 1 --2- 172.21.15.18:0/2496488353 >> v2:172.21.15.162:3300/0 conn(0x7fe6fc0cf890 0x7fe6fc0b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:39.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.188+0000 7fe701cc9640 1 -- 172.21.15.18:0/2496488353 >> v2:172.21.15.162:3300/0 conn(0x7fe6fc0cf890 msgr2=0x7fe6fc0b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:39.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.188+0000 7fe701cc9640 1 --2- 172.21.15.18:0/2496488353 >> v2:172.21.15.162:3300/0 conn(0x7fe6fc0cf890 0x7fe6fc0b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:39.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.188+0000 7fe701cc9640 1 -- 172.21.15.18:0/2496488353 >> v1:172.21.15.162:6789/0 conn(0x7fe6fc071510 legacy=0x7fe6fc0718f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:39.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.188+0000 7fe701cc9640 1 -- 172.21.15.18:0/2496488353 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6fc0b4b20 con 0x7fe6fc1635d0 2024-09-19T09:15:39.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.189+0000 7fe701cc9640 1 --2- 172.21.15.18:0/2496488353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6fc1635d0 0x7fe6fc16cbf0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc072d30 tx=0x7fe6ec02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=807d1275249b429 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:39.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.189+0000 7fe6fbfff640 1 -- 172.21.15.18:0/2496488353 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec036070 con 0x7fe6fc1635d0 2024-09-19T09:15:39.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.189+0000 7fe6fbfff640 1 -- 172.21.15.18:0/2496488353 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6ec031600 con 0x7fe6fc1635d0 2024-09-19T09:15:39.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.189+0000 7fe6fbfff640 1 -- 172.21.15.18:0/2496488353 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6ec0319d0 con 0x7fe6fc1635d0 2024-09-19T09:15:39.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.190+0000 7fe70372c640 1 -- 172.21.15.18:0/2496488353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6fc1635d0 msgr2=0x7fe6fc16cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:39.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.190+0000 7fe70372c640 1 --2- 172.21.15.18:0/2496488353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6fc1635d0 0x7fe6fc16cbf0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc072d30 tx=0x7fe6ec02a6a0 comp rx=0 tx=0).stop 2024-09-19T09:15:39.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.190+0000 7fe70372c640 1 -- 172.21.15.18:0/2496488353 shutdown_connections 2024-09-19T09:15:39.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.190+0000 7fe70372c640 1 --2- 172.21.15.18:0/2496488353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6fc1635d0 0x7fe6fc16cbf0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:39.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.190+0000 7fe70372c640 1 --2- 172.21.15.18:0/2496488353 >> v2:172.21.15.162:3300/0 conn(0x7fe6fc0cf890 0x7fe6fc0b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:39.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.190+0000 7fe70372c640 1 -- 172.21.15.18:0/2496488353 >> 172.21.15.18:0/2496488353 conn(0x7fe6fc06bc10 msgr2=0x7fe6fc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:39.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.190+0000 7fe70372c640 1 -- 172.21.15.18:0/2496488353 shutdown_connections 2024-09-19T09:15:39.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.190+0000 7fe70372c640 1 -- 172.21.15.18:0/2496488353 wait complete. 2024-09-19T09:15:39.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.191+0000 7fe70372c640 1 Processor -- start 2024-09-19T09:15:39.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.191+0000 7fe70372c640 1 -- start start 2024-09-19T09:15:39.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.192+0000 7fe70372c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6fc071510 0x7fe6fc0aa430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:39.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.192+0000 7fe70372c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6fc0cf890 0x7fe6fc1611c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:39.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.192+0000 7fe70372c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6fc1635d0 0x7fe6fc159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:39.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.192+0000 7fe70372c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe6fc164480 con 0x7fe6fc0cf890 2024-09-19T09:15:39.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.192+0000 7fe70372c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe6fc06cb40 con 0x7fe6fc071510 2024-09-19T09:15:39.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.192+0000 7fe70372c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe6fc16d130 con 0x7fe6fc1635d0 2024-09-19T09:15:39.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.192+0000 7fe700cc7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6fc0cf890 0x7fe6fc1611c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:39.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.192+0000 7fe700cc7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6fc0cf890 0x7fe6fc1611c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42260/0 (socket says 172.21.15.18:42260) 2024-09-19T09:15:39.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.192+0000 7fe700cc7640 1 -- 172.21.15.18:0/3137827107 learned_addr learned my addr 172.21.15.18:0/3137827107 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:39.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.192+0000 7fe7014c8640 1 --2- 172.21.15.18:0/3137827107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6fc071510 0x7fe6fc0aa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:39.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.192+0000 7fe701cc9640 1 --2- 172.21.15.18:0/3137827107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6fc1635d0 0x7fe6fc159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:39.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.192+0000 7fe700cc7640 1 -- 172.21.15.18:0/3137827107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6fc1635d0 msgr2=0x7fe6fc159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:39.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.192+0000 7fe700cc7640 1 --2- 172.21.15.18:0/3137827107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6fc1635d0 0x7fe6fc159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:39.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.192+0000 7fe700cc7640 1 -- 172.21.15.18:0/3137827107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6fc071510 msgr2=0x7fe6fc0aa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:39.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.192+0000 7fe700cc7640 1 --2- 172.21.15.18:0/3137827107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6fc071510 0x7fe6fc0aa430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:39.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.192+0000 7fe700cc7640 1 -- 172.21.15.18:0/3137827107 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6fc161700 con 0x7fe6fc0cf890 2024-09-19T09:15:39.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.193+0000 7fe700cc7640 1 --2- 172.21.15.18:0/3137827107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6fc0cf890 0x7fe6fc1611c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe6f000e9b0 tx=0x7fe6f000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:39.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.193+0000 7fe6f9ffb640 1 -- 172.21.15.18:0/3137827107 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0017070 con 0x7fe6fc0cf890 2024-09-19T09:15:39.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.193+0000 7fe6f9ffb640 1 -- 172.21.15.18:0/3137827107 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6f000c9a0 con 0x7fe6fc0cf890 2024-09-19T09:15:39.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.193+0000 7fe70372c640 1 -- 172.21.15.18:0/3137827107 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6fc162e10 con 0x7fe6fc0cf890 2024-09-19T09:15:39.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.193+0000 7fe6f9ffb640 1 -- 172.21.15.18:0/3137827107 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f000cd90 con 0x7fe6fc0cf890 2024-09-19T09:15:39.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.193+0000 7fe70372c640 1 -- 172.21.15.18:0/3137827107 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6fc06ece0 con 0x7fe6fc0cf890 2024-09-19T09:15:39.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.194+0000 7fe70372c640 1 -- 172.21.15.18:0/3137827107 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6fc0ce2b0 con 0x7fe6fc0cf890 2024-09-19T09:15:39.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.195+0000 7fe6f9ffb640 1 -- 172.21.15.18:0/3137827107 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe6f001a070 con 0x7fe6fc0cf890 2024-09-19T09:15:39.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.195+0000 7fe6f9ffb640 1 --2- 172.21.15.18:0/3137827107 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe6e806c2b0 0x7fe6e806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:39.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.195+0000 7fe6f9ffb640 1 -- 172.21.15.18:0/3137827107 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7fe6f008b780 con 0x7fe6fc0cf890 2024-09-19T09:15:39.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.195+0000 7fe7014c8640 1 --2- 172.21.15.18:0/3137827107 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe6e806c2b0 0x7fe6e806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:39.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.196+0000 7fe7014c8640 1 --2- 172.21.15.18:0/3137827107 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe6e806c2b0 0x7fe6e806e770 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4001780 tx=0x7fe6f4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:39.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.200+0000 7fe6f9ffb640 1 -- 172.21.15.18:0/3137827107 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe6f00598a0 con 0x7fe6fc0cf890 2024-09-19T09:15:39.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.371+0000 7fe70372c640 1 -- 172.21.15.18:0/3137827107 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe6fc0cdcf0 con 0x7fe6e806c2b0 2024-09-19T09:15:39.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.377+0000 7fe6f9ffb640 1 -- 172.21.15.18:0/3137827107 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247492 (secure 0 0 0) 0x7fe6fc0cdcf0 con 0x7fe6e806c2b0 2024-09-19T09:15:39.380 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:15:39.382 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:15:39.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.380+0000 7fe70372c640 1 -- 172.21.15.18:0/3137827107 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe6e806c2b0 msgr2=0x7fe6e806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:39.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.380+0000 7fe70372c640 1 --2- 172.21.15.18:0/3137827107 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe6e806c2b0 0x7fe6e806e770 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe6f4001780 tx=0x7fe6f4009040 comp rx=0 tx=0).stop 2024-09-19T09:15:39.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.380+0000 7fe70372c640 1 -- 172.21.15.18:0/3137827107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6fc0cf890 msgr2=0x7fe6fc1611c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:39.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.380+0000 7fe70372c640 1 --2- 172.21.15.18:0/3137827107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6fc0cf890 0x7fe6fc1611c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe6f000e9b0 tx=0x7fe6f000ee70 comp rx=0 tx=0).stop 2024-09-19T09:15:39.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.381+0000 7fe70372c640 1 -- 172.21.15.18:0/3137827107 shutdown_connections 2024-09-19T09:15:39.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.381+0000 7fe70372c640 1 --2- 172.21.15.18:0/3137827107 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe6e806c2b0 0x7fe6e806e770 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:39.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.381+0000 7fe70372c640 1 --2- 172.21.15.18:0/3137827107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6fc1635d0 0x7fe6fc159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:39.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.381+0000 7fe70372c640 1 --2- 172.21.15.18:0/3137827107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6fc0cf890 0x7fe6fc1611c0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:39.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.381+0000 7fe70372c640 1 --2- 172.21.15.18:0/3137827107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6fc071510 0x7fe6fc0aa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:39.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.381+0000 7fe70372c640 1 -- 172.21.15.18:0/3137827107 >> 172.21.15.18:0/3137827107 conn(0x7fe6fc06bc10 msgr2=0x7fe6fc0b1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:39.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.381+0000 7fe70372c640 1 -- 172.21.15.18:0/3137827107 shutdown_connections 2024-09-19T09:15:39.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.381+0000 7fe70372c640 1 -- 172.21.15.18:0/3137827107 wait complete. 2024-09-19T09:15:39.393 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":132,"stamp":"2024-09-19T09:15:37.553075+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":188,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3995,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558504,"statfs":{"total":1600000000,"available":1595908932,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.913230"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464892+0000","last_change":"2024-09-19T09:15:31.674340+0000","last_active":"2024-09-19T09:15:33.464892+0000","last_peered":"2024-09-19T09:15:33.464892+0000","last_clean":"2024-09-19T09:15:33.464892+0000","last_became_active":"2024-09-19T09:15:31.674063+0000","last_became_peered":"2024-09-19T09:15:31.674063+0000","last_unstale":"2024-09-19T09:15:33.464892+0000","last_undegraded":"2024-09-19T09:15:33.464892+0000","last_fullsized":"2024-09-19T09:15:33.464892+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:46.706347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464025+0000","last_change":"2024-09-19T09:15:31.667390+0000","last_active":"2024-09-19T09:15:33.464025+0000","last_peered":"2024-09-19T09:15:33.464025+0000","last_clean":"2024-09-19T09:15:33.464025+0000","last_became_active":"2024-09-19T09:15:31.665839+0000","last_became_peered":"2024-09-19T09:15:31.665839+0000","last_unstale":"2024-09-19T09:15:33.464025+0000","last_undegraded":"2024-09-19T09:15:33.464025+0000","last_fullsized":"2024-09-19T09:15:33.464025+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:20.145173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.463921+0000","last_change":"2024-09-19T09:15:31.657611+0000","last_active":"2024-09-19T09:15:33.463921+0000","last_peered":"2024-09-19T09:15:33.463921+0000","last_clean":"2024-09-19T09:15:33.463921+0000","last_became_active":"2024-09-19T09:15:31.657375+0000","last_became_peered":"2024-09-19T09:15:31.657375+0000","last_unstale":"2024-09-19T09:15:33.463921+0000","last_undegraded":"2024-09-19T09:15:33.463921+0000","last_fullsized":"2024-09-19T09:15:33.463921+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:12:17.463925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464842+0000","last_change":"2024-09-19T09:15:31.667464+0000","last_active":"2024-09-19T09:15:33.464842+0000","last_peered":"2024-09-19T09:15:33.464842+0000","last_clean":"2024-09-19T09:15:33.464842+0000","last_became_active":"2024-09-19T09:15:31.667093+0000","last_became_peered":"2024-09-19T09:15:31.667093+0000","last_unstale":"2024-09-19T09:15:33.464842+0000","last_undegraded":"2024-09-19T09:15:33.464842+0000","last_fullsized":"2024-09-19T09:15:33.464842+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:06.815394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464180+0000","last_change":"2024-09-19T09:15:31.671138+0000","last_active":"2024-09-19T09:15:33.464180+0000","last_peered":"2024-09-19T09:15:33.464180+0000","last_clean":"2024-09-19T09:15:33.464180+0000","last_became_active":"2024-09-19T09:15:31.670917+0000","last_became_peered":"2024-09-19T09:15:31.670917+0000","last_unstale":"2024-09-19T09:15:33.464180+0000","last_undegraded":"2024-09-19T09:15:33.464180+0000","last_fullsized":"2024-09-19T09:15:33.464180+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:28:13.982883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.465000+0000","last_change":"2024-09-19T09:15:31.672112+0000","last_active":"2024-09-19T09:15:33.465000+0000","last_peered":"2024-09-19T09:15:33.465000+0000","last_clean":"2024-09-19T09:15:33.465000+0000","last_became_active":"2024-09-19T09:15:31.667768+0000","last_became_peered":"2024-09-19T09:15:31.667768+0000","last_unstale":"2024-09-19T09:15:33.465000+0000","last_undegraded":"2024-09-19T09:15:33.465000+0000","last_fullsized":"2024-09-19T09:15:33.465000+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:12:27.740878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464956+0000","last_change":"2024-09-19T09:15:31.661748+0000","last_active":"2024-09-19T09:15:33.464956+0000","last_peered":"2024-09-19T09:15:33.464956+0000","last_clean":"2024-09-19T09:15:33.464956+0000","last_became_active":"2024-09-19T09:15:31.661521+0000","last_became_peered":"2024-09-19T09:15:31.661521+0000","last_unstale":"2024-09-19T09:15:33.464956+0000","last_undegraded":"2024-09-19T09:15:33.464956+0000","last_fullsized":"2024-09-19T09:15:33.464956+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:15.542255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.668647+0000","last_change":"2024-09-19T09:15:31.671026+0000","last_active":"2024-09-19T09:15:32.668647+0000","last_peered":"2024-09-19T09:15:32.668647+0000","last_clean":"2024-09-19T09:15:32.668647+0000","last_became_active":"2024-09-19T09:15:31.670424+0000","last_became_peered":"2024-09-19T09:15:31.670424+0000","last_unstale":"2024-09-19T09:15:32.668647+0000","last_undegraded":"2024-09-19T09:15:32.668647+0000","last_fullsized":"2024-09-19T09:15:32.668647+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:17.709393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.463923+0000","last_change":"2024-09-19T09:15:31.666346+0000","last_active":"2024-09-19T09:15:33.463923+0000","last_peered":"2024-09-19T09:15:33.463923+0000","last_clean":"2024-09-19T09:15:33.463923+0000","last_became_active":"2024-09-19T09:15:31.665515+0000","last_became_peered":"2024-09-19T09:15:31.665515+0000","last_unstale":"2024-09-19T09:15:33.463923+0000","last_undegraded":"2024-09-19T09:15:33.463923+0000","last_fullsized":"2024-09-19T09:15:33.463923+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:27.155157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464805+0000","last_change":"2024-09-19T09:15:31.664853+0000","last_active":"2024-09-19T09:15:33.464805+0000","last_peered":"2024-09-19T09:15:33.464805+0000","last_clean":"2024-09-19T09:15:33.464805+0000","last_became_active":"2024-09-19T09:15:31.664614+0000","last_became_peered":"2024-09-19T09:15:31.664614+0000","last_unstale":"2024-09-19T09:15:33.464805+0000","last_undegraded":"2024-09-19T09:15:33.464805+0000","last_fullsized":"2024-09-19T09:15:33.464805+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:58.074628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.669794+0000","last_change":"2024-09-19T09:15:31.673027+0000","last_active":"2024-09-19T09:15:32.669794+0000","last_peered":"2024-09-19T09:15:32.669794+0000","last_clean":"2024-09-19T09:15:32.669794+0000","last_became_active":"2024-09-19T09:15:31.672254+0000","last_became_peered":"2024-09-19T09:15:31.672254+0000","last_unstale":"2024-09-19T09:15:32.669794+0000","last_undegraded":"2024-09-19T09:15:32.669794+0000","last_fullsized":"2024-09-19T09:15:32.669794+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:59.378176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464436+0000","last_change":"2024-09-19T09:15:31.664628+0000","last_active":"2024-09-19T09:15:33.464436+0000","last_peered":"2024-09-19T09:15:33.464436+0000","last_clean":"2024-09-19T09:15:33.464436+0000","last_became_active":"2024-09-19T09:15:31.664399+0000","last_became_peered":"2024-09-19T09:15:31.664399+0000","last_unstale":"2024-09-19T09:15:33.464436+0000","last_undegraded":"2024-09-19T09:15:33.464436+0000","last_fullsized":"2024-09-19T09:15:33.464436+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:03.339892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.672682+0000","last_change":"2024-09-19T09:15:31.669603+0000","last_active":"2024-09-19T09:15:32.672682+0000","last_peered":"2024-09-19T09:15:32.672682+0000","last_clean":"2024-09-19T09:15:32.672682+0000","last_became_active":"2024-09-19T09:15:31.669367+0000","last_became_peered":"2024-09-19T09:15:31.669367+0000","last_unstale":"2024-09-19T09:15:32.672682+0000","last_undegraded":"2024-09-19T09:15:32.672682+0000","last_fullsized":"2024-09-19T09:15:32.672682+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:48.074365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.463900+0000","last_change":"2024-09-19T09:15:31.675813+0000","last_active":"2024-09-19T09:15:33.463900+0000","last_peered":"2024-09-19T09:15:33.463900+0000","last_clean":"2024-09-19T09:15:33.463900+0000","last_became_active":"2024-09-19T09:15:31.675556+0000","last_became_peered":"2024-09-19T09:15:31.675556+0000","last_unstale":"2024-09-19T09:15:33.463900+0000","last_undegraded":"2024-09-19T09:15:33.463900+0000","last_fullsized":"2024-09-19T09:15:33.463900+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:27:46.330033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.672745+0000","last_change":"2024-09-19T09:15:31.666079+0000","last_active":"2024-09-19T09:15:32.672745+0000","last_peered":"2024-09-19T09:15:32.672745+0000","last_clean":"2024-09-19T09:15:32.672745+0000","last_became_active":"2024-09-19T09:15:31.665723+0000","last_became_peered":"2024-09-19T09:15:31.665723+0000","last_unstale":"2024-09-19T09:15:32.672745+0000","last_undegraded":"2024-09-19T09:15:32.672745+0000","last_fullsized":"2024-09-19T09:15:32.672745+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:21.994145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.465090+0000","last_change":"2024-09-19T09:15:31.671908+0000","last_active":"2024-09-19T09:15:33.465090+0000","last_peered":"2024-09-19T09:15:33.465090+0000","last_clean":"2024-09-19T09:15:33.465090+0000","last_became_active":"2024-09-19T09:15:31.667453+0000","last_became_peered":"2024-09-19T09:15:31.667453+0000","last_unstale":"2024-09-19T09:15:33.465090+0000","last_undegraded":"2024-09-19T09:15:33.465090+0000","last_fullsized":"2024-09-19T09:15:33.465090+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:38.507700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464055+0000","last_change":"2024-09-19T09:15:31.662996+0000","last_active":"2024-09-19T09:15:33.464055+0000","last_peered":"2024-09-19T09:15:33.464055+0000","last_clean":"2024-09-19T09:15:33.464055+0000","last_became_active":"2024-09-19T09:15:31.662737+0000","last_became_peered":"2024-09-19T09:15:31.662737+0000","last_unstale":"2024-09-19T09:15:33.464055+0000","last_undegraded":"2024-09-19T09:15:33.464055+0000","last_fullsized":"2024-09-19T09:15:33.464055+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:21.304508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464096+0000","last_change":"2024-09-19T09:15:31.661674+0000","last_active":"2024-09-19T09:15:33.464096+0000","last_peered":"2024-09-19T09:15:33.464096+0000","last_clean":"2024-09-19T09:15:33.464096+0000","last_became_active":"2024-09-19T09:15:31.661398+0000","last_became_peered":"2024-09-19T09:15:31.661398+0000","last_unstale":"2024-09-19T09:15:33.464096+0000","last_undegraded":"2024-09-19T09:15:33.464096+0000","last_fullsized":"2024-09-19T09:15:33.464096+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:22.894915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.463788+0000","last_change":"2024-09-19T09:15:31.675843+0000","last_active":"2024-09-19T09:15:33.463788+0000","last_peered":"2024-09-19T09:15:33.463788+0000","last_clean":"2024-09-19T09:15:33.463788+0000","last_became_active":"2024-09-19T09:15:31.675603+0000","last_became_peered":"2024-09-19T09:15:31.675603+0000","last_unstale":"2024-09-19T09:15:33.463788+0000","last_undegraded":"2024-09-19T09:15:33.463788+0000","last_fullsized":"2024-09-19T09:15:33.463788+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:18.031127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.669616+0000","last_change":"2024-09-19T09:15:31.671113+0000","last_active":"2024-09-19T09:15:32.669616+0000","last_peered":"2024-09-19T09:15:32.669616+0000","last_clean":"2024-09-19T09:15:32.669616+0000","last_became_active":"2024-09-19T09:15:31.670892+0000","last_became_peered":"2024-09-19T09:15:31.670892+0000","last_unstale":"2024-09-19T09:15:32.669616+0000","last_undegraded":"2024-09-19T09:15:32.669616+0000","last_fullsized":"2024-09-19T09:15:32.669616+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:50:07.000027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.672672+0000","last_change":"2024-09-19T09:15:31.671830+0000","last_active":"2024-09-19T09:15:32.672672+0000","last_peered":"2024-09-19T09:15:32.672672+0000","last_clean":"2024-09-19T09:15:32.672672+0000","last_became_active":"2024-09-19T09:15:31.671227+0000","last_became_peered":"2024-09-19T09:15:31.671227+0000","last_unstale":"2024-09-19T09:15:32.672672+0000","last_undegraded":"2024-09-19T09:15:32.672672+0000","last_fullsized":"2024-09-19T09:15:32.672672+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:21.718582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.669081+0000","last_change":"2024-09-19T09:15:31.671726+0000","last_active":"2024-09-19T09:15:32.669081+0000","last_peered":"2024-09-19T09:15:32.669081+0000","last_clean":"2024-09-19T09:15:32.669081+0000","last_became_active":"2024-09-19T09:15:31.671497+0000","last_became_peered":"2024-09-19T09:15:31.671497+0000","last_unstale":"2024-09-19T09:15:32.669081+0000","last_undegraded":"2024-09-19T09:15:32.669081+0000","last_fullsized":"2024-09-19T09:15:32.669081+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:12.762300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464665+0000","last_change":"2024-09-19T09:15:31.659593+0000","last_active":"2024-09-19T09:15:33.464665+0000","last_peered":"2024-09-19T09:15:33.464665+0000","last_clean":"2024-09-19T09:15:33.464665+0000","last_became_active":"2024-09-19T09:15:31.659322+0000","last_became_peered":"2024-09-19T09:15:31.659322+0000","last_unstale":"2024-09-19T09:15:33.464665+0000","last_undegraded":"2024-09-19T09:15:33.464665+0000","last_fullsized":"2024-09-19T09:15:33.464665+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:28.812780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464074+0000","last_change":"2024-09-19T09:15:31.666146+0000","last_active":"2024-09-19T09:15:33.464074+0000","last_peered":"2024-09-19T09:15:33.464074+0000","last_clean":"2024-09-19T09:15:33.464074+0000","last_became_active":"2024-09-19T09:15:31.665209+0000","last_became_peered":"2024-09-19T09:15:31.665209+0000","last_unstale":"2024-09-19T09:15:33.464074+0000","last_undegraded":"2024-09-19T09:15:33.464074+0000","last_fullsized":"2024-09-19T09:15:33.464074+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:08:38.500565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464391+0000","last_change":"2024-09-19T09:15:31.671383+0000","last_active":"2024-09-19T09:15:33.464391+0000","last_peered":"2024-09-19T09:15:33.464391+0000","last_clean":"2024-09-19T09:15:33.464391+0000","last_became_active":"2024-09-19T09:15:31.670755+0000","last_became_peered":"2024-09-19T09:15:31.670755+0000","last_unstale":"2024-09-19T09:15:33.464391+0000","last_undegraded":"2024-09-19T09:15:33.464391+0000","last_fullsized":"2024-09-19T09:15:33.464391+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:28:26.450186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.672838+0000","last_change":"2024-09-19T09:15:31.672063+0000","last_active":"2024-09-19T09:15:32.672838+0000","last_peered":"2024-09-19T09:15:32.672838+0000","last_clean":"2024-09-19T09:15:32.672838+0000","last_became_active":"2024-09-19T09:15:31.671585+0000","last_became_peered":"2024-09-19T09:15:31.671585+0000","last_unstale":"2024-09-19T09:15:32.672838+0000","last_undegraded":"2024-09-19T09:15:32.672838+0000","last_fullsized":"2024-09-19T09:15:32.672838+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:31:29.618975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464268+0000","last_change":"2024-09-19T09:15:31.670653+0000","last_active":"2024-09-19T09:15:33.464268+0000","last_peered":"2024-09-19T09:15:33.464268+0000","last_clean":"2024-09-19T09:15:33.464268+0000","last_became_active":"2024-09-19T09:15:31.670426+0000","last_became_peered":"2024-09-19T09:15:31.670426+0000","last_unstale":"2024-09-19T09:15:33.464268+0000","last_undegraded":"2024-09-19T09:15:33.464268+0000","last_fullsized":"2024-09-19T09:15:33.464268+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:15.893615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.668805+0000","last_change":"2024-09-19T09:15:31.666989+0000","last_active":"2024-09-19T09:15:32.668805+0000","last_peered":"2024-09-19T09:15:32.668805+0000","last_clean":"2024-09-19T09:15:32.668805+0000","last_became_active":"2024-09-19T09:15:31.666668+0000","last_became_peered":"2024-09-19T09:15:31.666668+0000","last_unstale":"2024-09-19T09:15:32.668805+0000","last_undegraded":"2024-09-19T09:15:32.668805+0000","last_fullsized":"2024-09-19T09:15:32.668805+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:38.361217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.668834+0000","last_change":"2024-09-19T09:15:31.676531+0000","last_active":"2024-09-19T09:15:32.668834+0000","last_peered":"2024-09-19T09:15:32.668834+0000","last_clean":"2024-09-19T09:15:32.668834+0000","last_became_active":"2024-09-19T09:15:31.674938+0000","last_became_peered":"2024-09-19T09:15:31.674938+0000","last_unstale":"2024-09-19T09:15:32.668834+0000","last_undegraded":"2024-09-19T09:15:32.668834+0000","last_fullsized":"2024-09-19T09:15:32.668834+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:08.058576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464635+0000","last_change":"2024-09-19T09:15:31.666098+0000","last_active":"2024-09-19T09:15:33.464635+0000","last_peered":"2024-09-19T09:15:33.464635+0000","last_clean":"2024-09-19T09:15:33.464635+0000","last_became_active":"2024-09-19T09:15:31.665839+0000","last_became_peered":"2024-09-19T09:15:31.665839+0000","last_unstale":"2024-09-19T09:15:33.464635+0000","last_undegraded":"2024-09-19T09:15:33.464635+0000","last_fullsized":"2024-09-19T09:15:33.464635+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:58.221463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464483+0000","last_change":"2024-09-19T09:15:31.660661+0000","last_active":"2024-09-19T09:15:33.464483+0000","last_peered":"2024-09-19T09:15:33.464483+0000","last_clean":"2024-09-19T09:15:33.464483+0000","last_became_active":"2024-09-19T09:15:31.660422+0000","last_became_peered":"2024-09-19T09:15:31.660422+0000","last_unstale":"2024-09-19T09:15:33.464483+0000","last_undegraded":"2024-09-19T09:15:33.464483+0000","last_fullsized":"2024-09-19T09:15:33.464483+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:28:15.069761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.669230+0000","last_change":"2024-09-19T09:15:31.668061+0000","last_active":"2024-09-19T09:15:32.669230+0000","last_peered":"2024-09-19T09:15:32.669230+0000","last_clean":"2024-09-19T09:15:32.669230+0000","last_became_active":"2024-09-19T09:15:31.667653+0000","last_became_peered":"2024-09-19T09:15:31.667653+0000","last_unstale":"2024-09-19T09:15:32.669230+0000","last_undegraded":"2024-09-19T09:15:32.669230+0000","last_fullsized":"2024-09-19T09:15:32.669230+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:32.716365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464094+0000","last_change":"2024-09-19T09:15:31.662459+0000","last_active":"2024-09-19T09:15:33.464094+0000","last_peered":"2024-09-19T09:15:33.464094+0000","last_clean":"2024-09-19T09:15:33.464094+0000","last_became_active":"2024-09-19T09:15:31.661912+0000","last_became_peered":"2024-09-19T09:15:31.661912+0000","last_unstale":"2024-09-19T09:15:33.464094+0000","last_undegraded":"2024-09-19T09:15:33.464094+0000","last_fullsized":"2024-09-19T09:15:33.464094+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:57:58.365936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"69'4","reported_seq":18,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.669493+0000","last_change":"2024-09-19T09:15:30.649649+0000","last_active":"2024-09-19T09:15:32.669493+0000","last_peered":"2024-09-19T09:15:32.669493+0000","last_clean":"2024-09-19T09:15:32.669493+0000","last_became_active":"2024-09-19T09:15:30.649349+0000","last_became_peered":"2024-09-19T09:15:30.649349+0000","last_unstale":"2024-09-19T09:15:32.669493+0000","last_undegraded":"2024-09-19T09:15:32.669493+0000","last_fullsized":"2024-09-19T09:15:32.669493+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:55:30.425286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464521+0000","last_change":"2024-09-19T09:15:31.665294+0000","last_active":"2024-09-19T09:15:33.464521+0000","last_peered":"2024-09-19T09:15:33.464521+0000","last_clean":"2024-09-19T09:15:33.464521+0000","last_became_active":"2024-09-19T09:15:31.665042+0000","last_became_peered":"2024-09-19T09:15:31.665042+0000","last_unstale":"2024-09-19T09:15:33.464521+0000","last_undegraded":"2024-09-19T09:15:33.464521+0000","last_fullsized":"2024-09-19T09:15:33.464521+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:40.704307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"69'1","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.463919+0000","last_change":"2024-09-19T09:15:30.654042+0000","last_active":"2024-09-19T09:15:33.463919+0000","last_peered":"2024-09-19T09:15:33.463919+0000","last_clean":"2024-09-19T09:15:33.463919+0000","last_became_active":"2024-09-19T09:15:30.653763+0000","last_became_peered":"2024-09-19T09:15:30.653763+0000","last_unstale":"2024-09-19T09:15:33.463919+0000","last_undegraded":"2024-09-19T09:15:33.463919+0000","last_fullsized":"2024-09-19T09:15:33.463919+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:31.079827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.669933+0000","last_change":"2024-09-19T09:15:31.675193+0000","last_active":"2024-09-19T09:15:32.669933+0000","last_peered":"2024-09-19T09:15:32.669933+0000","last_clean":"2024-09-19T09:15:32.669933+0000","last_became_active":"2024-09-19T09:15:31.674808+0000","last_became_peered":"2024-09-19T09:15:31.674808+0000","last_unstale":"2024-09-19T09:15:32.669933+0000","last_undegraded":"2024-09-19T09:15:32.669933+0000","last_fullsized":"2024-09-19T09:15:32.669933+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:10.611624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"69'2","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.465047+0000","last_change":"2024-09-19T09:15:30.651705+0000","last_active":"2024-09-19T09:15:33.465047+0000","last_peered":"2024-09-19T09:15:33.465047+0000","last_clean":"2024-09-19T09:15:33.465047+0000","last_became_active":"2024-09-19T09:15:30.651486+0000","last_became_peered":"2024-09-19T09:15:30.651486+0000","last_unstale":"2024-09-19T09:15:33.465047+0000","last_undegraded":"2024-09-19T09:15:33.465047+0000","last_fullsized":"2024-09-19T09:15:33.465047+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:26.812191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464979+0000","last_change":"2024-09-19T09:15:31.675694+0000","last_active":"2024-09-19T09:15:33.464979+0000","last_peered":"2024-09-19T09:15:33.464979+0000","last_clean":"2024-09-19T09:15:33.464979+0000","last_became_active":"2024-09-19T09:15:31.675266+0000","last_became_peered":"2024-09-19T09:15:31.675266+0000","last_unstale":"2024-09-19T09:15:33.464979+0000","last_undegraded":"2024-09-19T09:15:33.464979+0000","last_fullsized":"2024-09-19T09:15:33.464979+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:59.111123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"69'2","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464129+0000","last_change":"2024-09-19T09:15:30.649173+0000","last_active":"2024-09-19T09:15:33.464129+0000","last_peered":"2024-09-19T09:15:33.464129+0000","last_clean":"2024-09-19T09:15:33.464129+0000","last_became_active":"2024-09-19T09:15:30.648936+0000","last_became_peered":"2024-09-19T09:15:30.648936+0000","last_unstale":"2024-09-19T09:15:33.464129+0000","last_undegraded":"2024-09-19T09:15:33.464129+0000","last_fullsized":"2024-09-19T09:15:33.464129+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:46.167783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.668972+0000","last_change":"2024-09-19T09:15:31.671208+0000","last_active":"2024-09-19T09:15:32.668972+0000","last_peered":"2024-09-19T09:15:32.668972+0000","last_clean":"2024-09-19T09:15:32.668972+0000","last_became_active":"2024-09-19T09:15:31.670751+0000","last_became_peered":"2024-09-19T09:15:31.670751+0000","last_unstale":"2024-09-19T09:15:32.668972+0000","last_undegraded":"2024-09-19T09:15:32.668972+0000","last_fullsized":"2024-09-19T09:15:32.668972+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:30.679333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"69'1","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464346+0000","last_change":"2024-09-19T09:15:30.650218+0000","last_active":"2024-09-19T09:15:33.464346+0000","last_peered":"2024-09-19T09:15:33.464346+0000","last_clean":"2024-09-19T09:15:33.464346+0000","last_became_active":"2024-09-19T09:15:30.649963+0000","last_became_peered":"2024-09-19T09:15:30.649963+0000","last_unstale":"2024-09-19T09:15:33.464346+0000","last_undegraded":"2024-09-19T09:15:33.464346+0000","last_fullsized":"2024-09-19T09:15:33.464346+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:32.602914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.669460+0000","last_change":"2024-09-19T09:15:31.667871+0000","last_active":"2024-09-19T09:15:32.669460+0000","last_peered":"2024-09-19T09:15:32.669460+0000","last_clean":"2024-09-19T09:15:32.669460+0000","last_became_active":"2024-09-19T09:15:31.667353+0000","last_became_peered":"2024-09-19T09:15:31.667353+0000","last_unstale":"2024-09-19T09:15:32.669460+0000","last_undegraded":"2024-09-19T09:15:32.669460+0000","last_fullsized":"2024-09-19T09:15:32.669460+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:10:09.494855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"69'1","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464253+0000","last_change":"2024-09-19T09:15:30.646184+0000","last_active":"2024-09-19T09:15:33.464253+0000","last_peered":"2024-09-19T09:15:33.464253+0000","last_clean":"2024-09-19T09:15:33.464253+0000","last_became_active":"2024-09-19T09:15:30.645538+0000","last_became_peered":"2024-09-19T09:15:30.645538+0000","last_unstale":"2024-09-19T09:15:33.464253+0000","last_undegraded":"2024-09-19T09:15:33.464253+0000","last_fullsized":"2024-09-19T09:15:33.464253+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:19.605959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.463921+0000","last_change":"2024-09-19T09:15:31.659583+0000","last_active":"2024-09-19T09:15:33.463921+0000","last_peered":"2024-09-19T09:15:33.463921+0000","last_clean":"2024-09-19T09:15:33.463921+0000","last_became_active":"2024-09-19T09:15:31.659119+0000","last_became_peered":"2024-09-19T09:15:31.659119+0000","last_unstale":"2024-09-19T09:15:33.463921+0000","last_undegraded":"2024-09-19T09:15:33.463921+0000","last_fullsized":"2024-09-19T09:15:33.463921+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:51.770422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464389+0000","last_change":"2024-09-19T09:15:30.649010+0000","last_active":"2024-09-19T09:15:33.464389+0000","last_peered":"2024-09-19T09:15:33.464389+0000","last_clean":"2024-09-19T09:15:33.464389+0000","last_became_active":"2024-09-19T09:15:30.648759+0000","last_became_peered":"2024-09-19T09:15:30.648759+0000","last_unstale":"2024-09-19T09:15:33.464389+0000","last_undegraded":"2024-09-19T09:15:33.464389+0000","last_fullsized":"2024-09-19T09:15:33.464389+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:31:52.108869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464415+0000","last_change":"2024-09-19T09:15:31.662662+0000","last_active":"2024-09-19T09:15:33.464415+0000","last_peered":"2024-09-19T09:15:33.464415+0000","last_clean":"2024-09-19T09:15:33.464415+0000","last_became_active":"2024-09-19T09:15:31.662220+0000","last_became_peered":"2024-09-19T09:15:31.662220+0000","last_unstale":"2024-09-19T09:15:33.464415+0000","last_undegraded":"2024-09-19T09:15:33.464415+0000","last_fullsized":"2024-09-19T09:15:33.464415+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:21.766111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.672809+0000","last_change":"2024-09-19T09:15:30.652419+0000","last_active":"2024-09-19T09:15:32.672809+0000","last_peered":"2024-09-19T09:15:32.672809+0000","last_clean":"2024-09-19T09:15:32.672809+0000","last_became_active":"2024-09-19T09:15:30.652189+0000","last_became_peered":"2024-09-19T09:15:30.652189+0000","last_unstale":"2024-09-19T09:15:32.672809+0000","last_undegraded":"2024-09-19T09:15:32.672809+0000","last_fullsized":"2024-09-19T09:15:32.672809+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:07.524321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.672718+0000","last_change":"2024-09-19T09:15:31.670249+0000","last_active":"2024-09-19T09:15:32.672718+0000","last_peered":"2024-09-19T09:15:32.672718+0000","last_clean":"2024-09-19T09:15:32.672718+0000","last_became_active":"2024-09-19T09:15:31.669889+0000","last_became_peered":"2024-09-19T09:15:31.669889+0000","last_unstale":"2024-09-19T09:15:32.672718+0000","last_undegraded":"2024-09-19T09:15:32.672718+0000","last_fullsized":"2024-09-19T09:15:32.672718+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:44.267079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464059+0000","last_change":"2024-09-19T09:15:30.651532+0000","last_active":"2024-09-19T09:15:33.464059+0000","last_peered":"2024-09-19T09:15:33.464059+0000","last_clean":"2024-09-19T09:15:33.464059+0000","last_became_active":"2024-09-19T09:15:30.651103+0000","last_became_peered":"2024-09-19T09:15:30.651103+0000","last_unstale":"2024-09-19T09:15:33.464059+0000","last_undegraded":"2024-09-19T09:15:33.464059+0000","last_fullsized":"2024-09-19T09:15:33.464059+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:19:14.524895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464074+0000","last_change":"2024-09-19T09:15:31.673561+0000","last_active":"2024-09-19T09:15:33.464074+0000","last_peered":"2024-09-19T09:15:33.464074+0000","last_clean":"2024-09-19T09:15:33.464074+0000","last_became_active":"2024-09-19T09:15:31.673341+0000","last_became_peered":"2024-09-19T09:15:31.673341+0000","last_unstale":"2024-09-19T09:15:33.464074+0000","last_undegraded":"2024-09-19T09:15:33.464074+0000","last_fullsized":"2024-09-19T09:15:33.464074+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:59:57.800672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.668688+0000","last_change":"2024-09-19T09:15:30.650745+0000","last_active":"2024-09-19T09:15:32.668688+0000","last_peered":"2024-09-19T09:15:32.668688+0000","last_clean":"2024-09-19T09:15:32.668688+0000","last_became_active":"2024-09-19T09:15:30.650538+0000","last_became_peered":"2024-09-19T09:15:30.650538+0000","last_unstale":"2024-09-19T09:15:32.668688+0000","last_undegraded":"2024-09-19T09:15:32.668688+0000","last_fullsized":"2024-09-19T09:15:32.668688+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:20.867174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.669035+0000","last_change":"2024-09-19T09:15:31.677030+0000","last_active":"2024-09-19T09:15:32.669035+0000","last_peered":"2024-09-19T09:15:32.669035+0000","last_clean":"2024-09-19T09:15:32.669035+0000","last_became_active":"2024-09-19T09:15:31.676255+0000","last_became_peered":"2024-09-19T09:15:31.676255+0000","last_unstale":"2024-09-19T09:15:32.669035+0000","last_undegraded":"2024-09-19T09:15:32.669035+0000","last_fullsized":"2024-09-19T09:15:32.669035+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:59:15.734647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"69'3","reported_seq":17,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464909+0000","last_change":"2024-09-19T09:15:30.650364+0000","last_active":"2024-09-19T09:15:33.464909+0000","last_peered":"2024-09-19T09:15:33.464909+0000","last_clean":"2024-09-19T09:15:33.464909+0000","last_became_active":"2024-09-19T09:15:30.649795+0000","last_became_peered":"2024-09-19T09:15:30.649795+0000","last_unstale":"2024-09-19T09:15:33.464909+0000","last_undegraded":"2024-09-19T09:15:33.464909+0000","last_fullsized":"2024-09-19T09:15:33.464909+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:53:49.164386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464832+0000","last_change":"2024-09-19T09:15:31.668222+0000","last_active":"2024-09-19T09:15:33.464832+0000","last_peered":"2024-09-19T09:15:33.464832+0000","last_clean":"2024-09-19T09:15:33.464832+0000","last_became_active":"2024-09-19T09:15:31.667834+0000","last_became_peered":"2024-09-19T09:15:31.667834+0000","last_unstale":"2024-09-19T09:15:33.464832+0000","last_undegraded":"2024-09-19T09:15:33.464832+0000","last_fullsized":"2024-09-19T09:15:33.464832+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:12.579531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"69'6","reported_seq":20,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.672551+0000","last_change":"2024-09-19T09:15:30.651245+0000","last_active":"2024-09-19T09:15:32.672551+0000","last_peered":"2024-09-19T09:15:32.672551+0000","last_clean":"2024-09-19T09:15:32.672551+0000","last_became_active":"2024-09-19T09:15:30.650992+0000","last_became_peered":"2024-09-19T09:15:30.650992+0000","last_unstale":"2024-09-19T09:15:32.672551+0000","last_undegraded":"2024-09-19T09:15:32.672551+0000","last_fullsized":"2024-09-19T09:15:32.672551+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:38.544350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.463968+0000","last_change":"2024-09-19T09:15:31.660695+0000","last_active":"2024-09-19T09:15:33.463968+0000","last_peered":"2024-09-19T09:15:33.463968+0000","last_clean":"2024-09-19T09:15:33.463968+0000","last_became_active":"2024-09-19T09:15:31.660438+0000","last_became_peered":"2024-09-19T09:15:31.660438+0000","last_unstale":"2024-09-19T09:15:33.463968+0000","last_undegraded":"2024-09-19T09:15:33.463968+0000","last_fullsized":"2024-09-19T09:15:33.463968+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:18:12.801420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"69'2","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.669726+0000","last_change":"2024-09-19T09:15:30.653657+0000","last_active":"2024-09-19T09:15:32.669726+0000","last_peered":"2024-09-19T09:15:32.669726+0000","last_clean":"2024-09-19T09:15:32.669726+0000","last_became_active":"2024-09-19T09:15:30.653393+0000","last_became_peered":"2024-09-19T09:15:30.653393+0000","last_unstale":"2024-09-19T09:15:32.669726+0000","last_undegraded":"2024-09-19T09:15:32.669726+0000","last_fullsized":"2024-09-19T09:15:32.669726+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:56:02.345505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464418+0000","last_change":"2024-09-19T09:15:31.658579+0000","last_active":"2024-09-19T09:15:33.464418+0000","last_peered":"2024-09-19T09:15:33.464418+0000","last_clean":"2024-09-19T09:15:33.464418+0000","last_became_active":"2024-09-19T09:15:31.657944+0000","last_became_peered":"2024-09-19T09:15:31.657944+0000","last_unstale":"2024-09-19T09:15:33.464418+0000","last_undegraded":"2024-09-19T09:15:33.464418+0000","last_fullsized":"2024-09-19T09:15:33.464418+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:32.018556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464239+0000","last_change":"2024-09-19T09:15:30.652071+0000","last_active":"2024-09-19T09:15:33.464239+0000","last_peered":"2024-09-19T09:15:33.464239+0000","last_clean":"2024-09-19T09:15:33.464239+0000","last_became_active":"2024-09-19T09:15:30.651854+0000","last_became_peered":"2024-09-19T09:15:30.651854+0000","last_unstale":"2024-09-19T09:15:33.464239+0000","last_undegraded":"2024-09-19T09:15:33.464239+0000","last_fullsized":"2024-09-19T09:15:33.464239+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:18.783105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464511+0000","last_change":"2024-09-19T09:15:31.665838+0000","last_active":"2024-09-19T09:15:33.464511+0000","last_peered":"2024-09-19T09:15:33.464511+0000","last_clean":"2024-09-19T09:15:33.464511+0000","last_became_active":"2024-09-19T09:15:31.665482+0000","last_became_peered":"2024-09-19T09:15:31.665482+0000","last_unstale":"2024-09-19T09:15:33.464511+0000","last_undegraded":"2024-09-19T09:15:33.464511+0000","last_fullsized":"2024-09-19T09:15:33.464511+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:40.275135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.465192+0000","last_change":"2024-09-19T09:15:30.647466+0000","last_active":"2024-09-19T09:15:33.465192+0000","last_peered":"2024-09-19T09:15:33.465192+0000","last_clean":"2024-09-19T09:15:33.465192+0000","last_became_active":"2024-09-19T09:15:30.647243+0000","last_became_peered":"2024-09-19T09:15:30.647243+0000","last_unstale":"2024-09-19T09:15:33.465192+0000","last_undegraded":"2024-09-19T09:15:33.465192+0000","last_fullsized":"2024-09-19T09:15:33.465192+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:40.767635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.465093+0000","last_change":"2024-09-19T09:15:31.669069+0000","last_active":"2024-09-19T09:15:33.465093+0000","last_peered":"2024-09-19T09:15:33.465093+0000","last_clean":"2024-09-19T09:15:33.465093+0000","last_became_active":"2024-09-19T09:15:31.668809+0000","last_became_peered":"2024-09-19T09:15:31.668809+0000","last_unstale":"2024-09-19T09:15:33.465093+0000","last_undegraded":"2024-09-19T09:15:33.465093+0000","last_fullsized":"2024-09-19T09:15:33.465093+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:45:28.642164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"69'8","reported_seq":22,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464969+0000","last_change":"2024-09-19T09:15:30.650623+0000","last_active":"2024-09-19T09:15:33.464969+0000","last_peered":"2024-09-19T09:15:33.464969+0000","last_clean":"2024-09-19T09:15:33.464969+0000","last_became_active":"2024-09-19T09:15:30.650128+0000","last_became_peered":"2024-09-19T09:15:30.650128+0000","last_unstale":"2024-09-19T09:15:33.464969+0000","last_undegraded":"2024-09-19T09:15:33.464969+0000","last_fullsized":"2024-09-19T09:15:33.464969+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:49.988800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464538+0000","last_change":"2024-09-19T09:15:31.659357+0000","last_active":"2024-09-19T09:15:33.464538+0000","last_peered":"2024-09-19T09:15:33.464538+0000","last_clean":"2024-09-19T09:15:33.464538+0000","last_became_active":"2024-09-19T09:15:31.658295+0000","last_became_peered":"2024-09-19T09:15:31.658295+0000","last_unstale":"2024-09-19T09:15:33.464538+0000","last_undegraded":"2024-09-19T09:15:33.464538+0000","last_fullsized":"2024-09-19T09:15:33.464538+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:13.928380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"69'1","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464038+0000","last_change":"2024-09-19T09:15:30.652777+0000","last_active":"2024-09-19T09:15:33.464038+0000","last_peered":"2024-09-19T09:15:33.464038+0000","last_clean":"2024-09-19T09:15:33.464038+0000","last_became_active":"2024-09-19T09:15:30.652329+0000","last_became_peered":"2024-09-19T09:15:30.652329+0000","last_unstale":"2024-09-19T09:15:33.464038+0000","last_undegraded":"2024-09-19T09:15:33.464038+0000","last_fullsized":"2024-09-19T09:15:33.464038+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:35.204746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464056+0000","last_change":"2024-09-19T09:15:31.675350+0000","last_active":"2024-09-19T09:15:33.464056+0000","last_peered":"2024-09-19T09:15:33.464056+0000","last_clean":"2024-09-19T09:15:33.464056+0000","last_became_active":"2024-09-19T09:15:31.675204+0000","last_became_peered":"2024-09-19T09:15:31.675204+0000","last_unstale":"2024-09-19T09:15:33.464056+0000","last_undegraded":"2024-09-19T09:15:33.464056+0000","last_fullsized":"2024-09-19T09:15:33.464056+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:01:51.114687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"69'2","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.669831+0000","last_change":"2024-09-19T09:15:30.651289+0000","last_active":"2024-09-19T09:15:32.669831+0000","last_peered":"2024-09-19T09:15:32.669831+0000","last_clean":"2024-09-19T09:15:32.669831+0000","last_became_active":"2024-09-19T09:15:30.651068+0000","last_became_peered":"2024-09-19T09:15:30.651068+0000","last_unstale":"2024-09-19T09:15:32.669831+0000","last_undegraded":"2024-09-19T09:15:32.669831+0000","last_fullsized":"2024-09-19T09:15:32.669831+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:47.638863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464423+0000","last_change":"2024-09-19T09:15:31.667647+0000","last_active":"2024-09-19T09:15:33.464423+0000","last_peered":"2024-09-19T09:15:33.464423+0000","last_clean":"2024-09-19T09:15:33.464423+0000","last_became_active":"2024-09-19T09:15:31.666192+0000","last_became_peered":"2024-09-19T09:15:31.666192+0000","last_unstale":"2024-09-19T09:15:33.464423+0000","last_undegraded":"2024-09-19T09:15:33.464423+0000","last_fullsized":"2024-09-19T09:15:33.464423+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:58.825212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"69'1","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464166+0000","last_change":"2024-09-19T09:15:30.647469+0000","last_active":"2024-09-19T09:15:33.464166+0000","last_peered":"2024-09-19T09:15:33.464166+0000","last_clean":"2024-09-19T09:15:33.464166+0000","last_became_active":"2024-09-19T09:15:30.647178+0000","last_became_peered":"2024-09-19T09:15:30.647178+0000","last_unstale":"2024-09-19T09:15:33.464166+0000","last_undegraded":"2024-09-19T09:15:33.464166+0000","last_fullsized":"2024-09-19T09:15:33.464166+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:57:55.527388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464034+0000","last_change":"2024-09-19T09:15:31.671753+0000","last_active":"2024-09-19T09:15:33.464034+0000","last_peered":"2024-09-19T09:15:33.464034+0000","last_clean":"2024-09-19T09:15:33.464034+0000","last_became_active":"2024-09-19T09:15:31.671442+0000","last_became_peered":"2024-09-19T09:15:31.671442+0000","last_unstale":"2024-09-19T09:15:33.464034+0000","last_undegraded":"2024-09-19T09:15:33.464034+0000","last_fullsized":"2024-09-19T09:15:33.464034+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:31:30.713689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.668792+0000","last_change":"2024-09-19T09:15:30.653622+0000","last_active":"2024-09-19T09:15:32.668792+0000","last_peered":"2024-09-19T09:15:32.668792+0000","last_clean":"2024-09-19T09:15:32.668792+0000","last_became_active":"2024-09-19T09:15:30.653276+0000","last_became_peered":"2024-09-19T09:15:30.653276+0000","last_unstale":"2024-09-19T09:15:32.668792+0000","last_undegraded":"2024-09-19T09:15:32.668792+0000","last_fullsized":"2024-09-19T09:15:32.668792+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:38.849381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464291+0000","last_change":"2024-09-19T09:15:31.665722+0000","last_active":"2024-09-19T09:15:33.464291+0000","last_peered":"2024-09-19T09:15:33.464291+0000","last_clean":"2024-09-19T09:15:33.464291+0000","last_became_active":"2024-09-19T09:15:31.664702+0000","last_became_peered":"2024-09-19T09:15:31.664702+0000","last_unstale":"2024-09-19T09:15:33.464291+0000","last_undegraded":"2024-09-19T09:15:33.464291+0000","last_fullsized":"2024-09-19T09:15:33.464291+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:11:07.767423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"69'2","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.669612+0000","last_change":"2024-09-19T09:15:30.651929+0000","last_active":"2024-09-19T09:15:32.669612+0000","last_peered":"2024-09-19T09:15:32.669612+0000","last_clean":"2024-09-19T09:15:32.669612+0000","last_became_active":"2024-09-19T09:15:30.651697+0000","last_became_peered":"2024-09-19T09:15:30.651697+0000","last_unstale":"2024-09-19T09:15:32.669612+0000","last_undegraded":"2024-09-19T09:15:32.669612+0000","last_fullsized":"2024-09-19T09:15:32.669612+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:40.186796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.669231+0000","last_change":"2024-09-19T09:15:31.665624+0000","last_active":"2024-09-19T09:15:32.669231+0000","last_peered":"2024-09-19T09:15:32.669231+0000","last_clean":"2024-09-19T09:15:32.669231+0000","last_became_active":"2024-09-19T09:15:31.665366+0000","last_became_peered":"2024-09-19T09:15:31.665366+0000","last_unstale":"2024-09-19T09:15:32.669231+0000","last_undegraded":"2024-09-19T09:15:32.669231+0000","last_fullsized":"2024-09-19T09:15:32.669231+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:59.186611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.669437+0000","last_change":"2024-09-19T09:15:30.650297+0000","last_active":"2024-09-19T09:15:32.669437+0000","last_peered":"2024-09-19T09:15:32.669437+0000","last_clean":"2024-09-19T09:15:32.669437+0000","last_became_active":"2024-09-19T09:15:30.648904+0000","last_became_peered":"2024-09-19T09:15:30.648904+0000","last_unstale":"2024-09-19T09:15:32.669437+0000","last_undegraded":"2024-09-19T09:15:32.669437+0000","last_fullsized":"2024-09-19T09:15:32.669437+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:31:21.790848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.668778+0000","last_change":"2024-09-19T09:15:31.663721+0000","last_active":"2024-09-19T09:15:32.668778+0000","last_peered":"2024-09-19T09:15:32.668778+0000","last_clean":"2024-09-19T09:15:32.668778+0000","last_became_active":"2024-09-19T09:15:31.663467+0000","last_became_peered":"2024-09-19T09:15:31.663467+0000","last_unstale":"2024-09-19T09:15:32.668778+0000","last_undegraded":"2024-09-19T09:15:32.668778+0000","last_fullsized":"2024-09-19T09:15:32.668778+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:30.360686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464153+0000","last_change":"2024-09-19T09:15:30.652887+0000","last_active":"2024-09-19T09:15:33.464153+0000","last_peered":"2024-09-19T09:15:33.464153+0000","last_clean":"2024-09-19T09:15:33.464153+0000","last_became_active":"2024-09-19T09:15:30.652627+0000","last_became_peered":"2024-09-19T09:15:30.652627+0000","last_unstale":"2024-09-19T09:15:33.464153+0000","last_undegraded":"2024-09-19T09:15:33.464153+0000","last_fullsized":"2024-09-19T09:15:33.464153+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:47.866283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464242+0000","last_change":"2024-09-19T09:15:31.660955+0000","last_active":"2024-09-19T09:15:33.464242+0000","last_peered":"2024-09-19T09:15:33.464242+0000","last_clean":"2024-09-19T09:15:33.464242+0000","last_became_active":"2024-09-19T09:15:31.660723+0000","last_became_peered":"2024-09-19T09:15:31.660723+0000","last_unstale":"2024-09-19T09:15:33.464242+0000","last_undegraded":"2024-09-19T09:15:33.464242+0000","last_fullsized":"2024-09-19T09:15:33.464242+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:26.025493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"69'2","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464696+0000","last_change":"2024-09-19T09:15:30.648918+0000","last_active":"2024-09-19T09:15:33.464696+0000","last_peered":"2024-09-19T09:15:33.464696+0000","last_clean":"2024-09-19T09:15:33.464696+0000","last_became_active":"2024-09-19T09:15:30.648422+0000","last_became_peered":"2024-09-19T09:15:30.648422+0000","last_unstale":"2024-09-19T09:15:33.464696+0000","last_undegraded":"2024-09-19T09:15:33.464696+0000","last_fullsized":"2024-09-19T09:15:33.464696+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:48:44.013885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464255+0000","last_change":"2024-09-19T09:15:31.661911+0000","last_active":"2024-09-19T09:15:33.464255+0000","last_peered":"2024-09-19T09:15:33.464255+0000","last_clean":"2024-09-19T09:15:33.464255+0000","last_became_active":"2024-09-19T09:15:31.660951+0000","last_became_peered":"2024-09-19T09:15:31.660951+0000","last_unstale":"2024-09-19T09:15:33.464255+0000","last_undegraded":"2024-09-19T09:15:33.464255+0000","last_fullsized":"2024-09-19T09:15:33.464255+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:46:44.586716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"70'1","reported_seq":15,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464412+0000","last_change":"2024-09-19T09:15:30.646415+0000","last_active":"2024-09-19T09:15:33.464412+0000","last_peered":"2024-09-19T09:15:33.464412+0000","last_clean":"2024-09-19T09:15:33.464412+0000","last_became_active":"2024-09-19T09:15:30.645939+0000","last_became_peered":"2024-09-19T09:15:30.645939+0000","last_unstale":"2024-09-19T09:15:33.464412+0000","last_undegraded":"2024-09-19T09:15:33.464412+0000","last_fullsized":"2024-09-19T09:15:33.464412+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:27.080842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464505+0000","last_change":"2024-09-19T09:15:31.662271+0000","last_active":"2024-09-19T09:15:33.464505+0000","last_peered":"2024-09-19T09:15:33.464505+0000","last_clean":"2024-09-19T09:15:33.464505+0000","last_became_active":"2024-09-19T09:15:31.662036+0000","last_became_peered":"2024-09-19T09:15:31.662036+0000","last_unstale":"2024-09-19T09:15:33.464505+0000","last_undegraded":"2024-09-19T09:15:33.464505+0000","last_fullsized":"2024-09-19T09:15:33.464505+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:30.258345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464500+0000","last_change":"2024-09-19T09:15:30.651522+0000","last_active":"2024-09-19T09:15:33.464500+0000","last_peered":"2024-09-19T09:15:33.464500+0000","last_clean":"2024-09-19T09:15:33.464500+0000","last_became_active":"2024-09-19T09:15:30.650503+0000","last_became_peered":"2024-09-19T09:15:30.650503+0000","last_unstale":"2024-09-19T09:15:33.464500+0000","last_undegraded":"2024-09-19T09:15:33.464500+0000","last_fullsized":"2024-09-19T09:15:33.464500+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:06:57.536830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.669194+0000","last_change":"2024-09-19T09:15:31.675890+0000","last_active":"2024-09-19T09:15:32.669194+0000","last_peered":"2024-09-19T09:15:32.669194+0000","last_clean":"2024-09-19T09:15:32.669194+0000","last_became_active":"2024-09-19T09:15:31.674533+0000","last_became_peered":"2024-09-19T09:15:31.674533+0000","last_unstale":"2024-09-19T09:15:32.669194+0000","last_undegraded":"2024-09-19T09:15:32.669194+0000","last_fullsized":"2024-09-19T09:15:32.669194+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:53.717867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464584+0000","last_change":"2024-09-19T09:15:30.649413+0000","last_active":"2024-09-19T09:15:33.464584+0000","last_peered":"2024-09-19T09:15:33.464584+0000","last_clean":"2024-09-19T09:15:33.464584+0000","last_became_active":"2024-09-19T09:15:30.648048+0000","last_became_peered":"2024-09-19T09:15:30.648048+0000","last_unstale":"2024-09-19T09:15:33.464584+0000","last_undegraded":"2024-09-19T09:15:33.464584+0000","last_fullsized":"2024-09-19T09:15:33.464584+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:34.285737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464229+0000","last_change":"2024-09-19T09:15:31.660742+0000","last_active":"2024-09-19T09:15:33.464229+0000","last_peered":"2024-09-19T09:15:33.464229+0000","last_clean":"2024-09-19T09:15:33.464229+0000","last_became_active":"2024-09-19T09:15:31.660487+0000","last_became_peered":"2024-09-19T09:15:31.660487+0000","last_unstale":"2024-09-19T09:15:33.464229+0000","last_undegraded":"2024-09-19T09:15:33.464229+0000","last_fullsized":"2024-09-19T09:15:33.464229+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:16.256676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464747+0000","last_change":"2024-09-19T09:15:30.650891+0000","last_active":"2024-09-19T09:15:33.464747+0000","last_peered":"2024-09-19T09:15:33.464747+0000","last_clean":"2024-09-19T09:15:33.464747+0000","last_became_active":"2024-09-19T09:15:30.650650+0000","last_became_peered":"2024-09-19T09:15:30.650650+0000","last_unstale":"2024-09-19T09:15:33.464747+0000","last_undegraded":"2024-09-19T09:15:33.464747+0000","last_fullsized":"2024-09-19T09:15:33.464747+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:34.252060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.672984+0000","last_change":"2024-09-19T09:15:31.673889+0000","last_active":"2024-09-19T09:15:32.672984+0000","last_peered":"2024-09-19T09:15:32.672984+0000","last_clean":"2024-09-19T09:15:32.672984+0000","last_became_active":"2024-09-19T09:15:31.673608+0000","last_became_peered":"2024-09-19T09:15:31.673608+0000","last_unstale":"2024-09-19T09:15:32.672984+0000","last_undegraded":"2024-09-19T09:15:32.672984+0000","last_fullsized":"2024-09-19T09:15:32.672984+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:07:46.014025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464443+0000","last_change":"2024-09-19T09:15:30.647949+0000","last_active":"2024-09-19T09:15:33.464443+0000","last_peered":"2024-09-19T09:15:33.464443+0000","last_clean":"2024-09-19T09:15:33.464443+0000","last_became_active":"2024-09-19T09:15:30.647705+0000","last_became_peered":"2024-09-19T09:15:30.647705+0000","last_unstale":"2024-09-19T09:15:33.464443+0000","last_undegraded":"2024-09-19T09:15:33.464443+0000","last_fullsized":"2024-09-19T09:15:33.464443+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:26.493133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.669350+0000","last_change":"2024-09-19T09:15:31.675351+0000","last_active":"2024-09-19T09:15:32.669350+0000","last_peered":"2024-09-19T09:15:32.669350+0000","last_clean":"2024-09-19T09:15:32.669350+0000","last_became_active":"2024-09-19T09:15:31.673983+0000","last_became_peered":"2024-09-19T09:15:31.673983+0000","last_unstale":"2024-09-19T09:15:32.669350+0000","last_undegraded":"2024-09-19T09:15:32.669350+0000","last_fullsized":"2024-09-19T09:15:32.669350+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:38.412714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464613+0000","last_change":"2024-09-19T09:15:30.648756+0000","last_active":"2024-09-19T09:15:33.464613+0000","last_peered":"2024-09-19T09:15:33.464613+0000","last_clean":"2024-09-19T09:15:33.464613+0000","last_became_active":"2024-09-19T09:15:30.648510+0000","last_became_peered":"2024-09-19T09:15:30.648510+0000","last_unstale":"2024-09-19T09:15:33.464613+0000","last_undegraded":"2024-09-19T09:15:33.464613+0000","last_fullsized":"2024-09-19T09:15:33.464613+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:47.168849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464117+0000","last_change":"2024-09-19T09:15:31.658906+0000","last_active":"2024-09-19T09:15:33.464117+0000","last_peered":"2024-09-19T09:15:33.464117+0000","last_clean":"2024-09-19T09:15:33.464117+0000","last_became_active":"2024-09-19T09:15:31.658637+0000","last_became_peered":"2024-09-19T09:15:31.658637+0000","last_unstale":"2024-09-19T09:15:33.464117+0000","last_undegraded":"2024-09-19T09:15:33.464117+0000","last_fullsized":"2024-09-19T09:15:33.464117+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:40.541261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.669532+0000","last_change":"2024-09-19T09:15:30.653974+0000","last_active":"2024-09-19T09:15:32.669532+0000","last_peered":"2024-09-19T09:15:32.669532+0000","last_clean":"2024-09-19T09:15:32.669532+0000","last_became_active":"2024-09-19T09:15:30.653484+0000","last_became_peered":"2024-09-19T09:15:30.653484+0000","last_unstale":"2024-09-19T09:15:32.669532+0000","last_undegraded":"2024-09-19T09:15:32.669532+0000","last_fullsized":"2024-09-19T09:15:32.669532+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:56.010033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.670029+0000","last_change":"2024-09-19T09:15:31.673230+0000","last_active":"2024-09-19T09:15:32.670029+0000","last_peered":"2024-09-19T09:15:32.670029+0000","last_clean":"2024-09-19T09:15:32.670029+0000","last_became_active":"2024-09-19T09:15:31.672758+0000","last_became_peered":"2024-09-19T09:15:31.672758+0000","last_unstale":"2024-09-19T09:15:32.670029+0000","last_undegraded":"2024-09-19T09:15:32.670029+0000","last_fullsized":"2024-09-19T09:15:32.670029+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:30.636771+0000","last_clean_scrub_stamp":"2024-09-19T09:15:30.636771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:18.018267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":14,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:32.672856+0000","last_change":"2024-09-19T09:15:30.650413+0000","last_active":"2024-09-19T09:15:32.672856+0000","last_peered":"2024-09-19T09:15:32.672856+0000","last_clean":"2024-09-19T09:15:32.672856+0000","last_became_active":"2024-09-19T09:15:30.650057+0000","last_became_peered":"2024-09-19T09:15:30.650057+0000","last_unstale":"2024-09-19T09:15:32.672856+0000","last_undegraded":"2024-09-19T09:15:32.672856+0000","last_fullsized":"2024-09-19T09:15:32.672856+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:15:29.632287+0000","last_clean_scrub_stamp":"2024-09-19T09:15:29.632287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:36:24.126639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":265,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-19T09:15:33.464598+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:15:33.464598+0000","last_peered":"2024-09-19T09:15:33.464598+0000","last_clean":"2024-09-19T09:15:33.464598+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:15:33.464598+0000","last_undegraded":"2024-09-19T09:15:33.464598+0000","last_fullsized":"2024-09-19T09:15:33.464598+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:48.025210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":354,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194957,"statfs":{"total":200000000,"available":199636719,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":354,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194957,"statfs":{"total":200000000,"available":199636789,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":931,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194381,"statfs":{"total":200000000,"available":199046409,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":355,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194957,"statfs":{"total":200000000,"available":199636195,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574878,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":354,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194957,"statfs":{"total":200000000,"available":199636721,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":356,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194956,"statfs":{"total":200000000,"available":199635039,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":931,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194380,"statfs":{"total":200000000,"available":199045861,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574878,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":356,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194956,"statfs":{"total":200000000,"available":199635199,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:15:39.453 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T09:15:39.453 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-19T09:15:39.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.564+0000 7fdc071e8640 1 Processor -- start 2024-09-19T09:15:39.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.564+0000 7fdc071e8640 1 -- start start 2024-09-19T09:15:39.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.564+0000 7fdc071e8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc0006e280 0x7fdc00073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:39.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.564+0000 7fdc071e8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdc00071df0 0x7fdc0006e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:39.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.564+0000 7fdc071e8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdc000d1010 0x7fdc000ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:39.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.564+0000 7fdc071e8640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fdc000738b0 con 0x7fdc00071df0 2024-09-19T09:15:39.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.564+0000 7fdc071e8640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fdc0006eba0 con 0x7fdc000d1010 2024-09-19T09:15:39.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.564+0000 7fdc071e8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdc000722d0 con 0x7fdc0006e280 2024-09-19T09:15:39.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.565+0000 7fdbfffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdc00071df0 0x7fdc0006e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:39.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.565+0000 7fdbfffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdc00071df0 0x7fdc0006e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42270/0 (socket says 172.21.15.18:42270) 2024-09-19T09:15:39.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.565+0000 7fdbfffff640 1 -- 172.21.15.18:0/2852989131 learned_addr learned my addr 172.21.15.18:0/2852989131 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:39.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.565+0000 7fdc04f84640 1 --2- 172.21.15.18:0/2852989131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc0006e280 0x7fdc00073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:39.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.565+0000 7fdc05785640 1 --2- 172.21.15.18:0/2852989131 >> v2:172.21.15.162:3300/0 conn(0x7fdc000d1010 0x7fdc000ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:39.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.565+0000 7fdbfffff640 1 -- 172.21.15.18:0/2852989131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc0006e280 msgr2=0x7fdc00073370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:39.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.565+0000 7fdbfffff640 1 --2- 172.21.15.18:0/2852989131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc0006e280 0x7fdc00073370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:39.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.565+0000 7fdbfffff640 1 -- 172.21.15.18:0/2852989131 >> v2:172.21.15.162:3300/0 conn(0x7fdc000d1010 msgr2=0x7fdc000ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:39.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.565+0000 7fdbfffff640 1 --2- 172.21.15.18:0/2852989131 >> v2:172.21.15.162:3300/0 conn(0x7fdc000d1010 0x7fdc000ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:39.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.565+0000 7fdbfffff640 1 -- 172.21.15.18:0/2852989131 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc000725b0 con 0x7fdc00071df0 2024-09-19T09:15:39.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.565+0000 7fdc04f84640 1 --2- 172.21.15.18:0/2852989131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc0006e280 0x7fdc00073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:39.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.565+0000 7fdc05785640 1 --2- 172.21.15.18:0/2852989131 >> v2:172.21.15.162:3300/0 conn(0x7fdc000d1010 0x7fdc000ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:39.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.566+0000 7fdbfffff640 1 --2- 172.21.15.18:0/2852989131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc00071df0 0x7fdc0006e660 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fdc000b5ca0 tx=0x7fdbec02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cc10b9e98c2254c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:39.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.566+0000 7fdbff7fe640 1 -- 172.21.15.18:0/2852989131 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbec037070 con 0x7fdc00071df0 2024-09-19T09:15:39.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.566+0000 7fdbff7fe640 1 -- 172.21.15.18:0/2852989131 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbec032440 con 0x7fdc00071df0 2024-09-19T09:15:39.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.566+0000 7fdbff7fe640 1 -- 172.21.15.18:0/2852989131 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbec032810 con 0x7fdc00071df0 2024-09-19T09:15:39.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.566+0000 7fdc071e8640 1 -- 172.21.15.18:0/2852989131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc00071df0 msgr2=0x7fdc0006e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:39.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.566+0000 7fdc071e8640 1 --2- 172.21.15.18:0/2852989131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc00071df0 0x7fdc0006e660 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fdc000b5ca0 tx=0x7fdbec02a1e0 comp rx=0 tx=0).stop 2024-09-19T09:15:39.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.566+0000 7fdc071e8640 1 -- 172.21.15.18:0/2852989131 shutdown_connections 2024-09-19T09:15:39.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.566+0000 7fdc071e8640 1 --2- 172.21.15.18:0/2852989131 >> v2:172.21.15.162:3300/0 conn(0x7fdc000d1010 0x7fdc000ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:39.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.566+0000 7fdc071e8640 1 --2- 172.21.15.18:0/2852989131 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc00071df0 0x7fdc0006e660 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:39.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.566+0000 7fdc071e8640 1 --2- 172.21.15.18:0/2852989131 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc0006e280 0x7fdc00073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:39.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.566+0000 7fdc071e8640 1 -- 172.21.15.18:0/2852989131 >> 172.21.15.18:0/2852989131 conn(0x7fdc0006bc10 msgr2=0x7fdc0006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:39.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.566+0000 7fdc071e8640 1 -- 172.21.15.18:0/2852989131 shutdown_connections 2024-09-19T09:15:39.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.566+0000 7fdc071e8640 1 -- 172.21.15.18:0/2852989131 wait complete. 2024-09-19T09:15:39.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.568+0000 7fdc071e8640 1 Processor -- start 2024-09-19T09:15:39.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.568+0000 7fdc071e8640 1 -- start start 2024-09-19T09:15:39.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.568+0000 7fdc071e8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc0006e280 0x7fdc000b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:39.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.568+0000 7fdc071e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc00071df0 0x7fdc0014e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:39.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.568+0000 7fdc071e8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc000d1010 0x7fdc0015dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.569+0000 7fdc071e8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdc00072e50 con 0x7fdc00071df0 2024-09-19T09:15:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.569+0000 7fdc071e8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdc00072b70 con 0x7fdc0006e280 2024-09-19T09:15:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.569+0000 7fdc071e8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdc000d14c0 con 0x7fdc000d1010 2024-09-19T09:15:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.569+0000 7fdbfffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc00071df0 0x7fdc0014e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.569+0000 7fdbfffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc00071df0 0x7fdc0014e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42272/0 (socket says 172.21.15.18:42272) 2024-09-19T09:15:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.569+0000 7fdbfffff640 1 -- 172.21.15.18:0/2751714458 learned_addr learned my addr 172.21.15.18:0/2751714458 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.569+0000 7fdc04f84640 1 --2- 172.21.15.18:0/2751714458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc0006e280 0x7fdc000b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.569+0000 7fdc05785640 1 --2- 172.21.15.18:0/2751714458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc000d1010 0x7fdc0015dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.569+0000 7fdbfffff640 1 -- 172.21.15.18:0/2751714458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc000d1010 msgr2=0x7fdc0015dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.569+0000 7fdbfffff640 1 --2- 172.21.15.18:0/2751714458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc000d1010 0x7fdc0015dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.569+0000 7fdbfffff640 1 -- 172.21.15.18:0/2751714458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc0006e280 msgr2=0x7fdc000b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.569+0000 7fdbfffff640 1 --2- 172.21.15.18:0/2751714458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc0006e280 0x7fdc000b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:39.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.569+0000 7fdbfffff640 1 -- 172.21.15.18:0/2751714458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc0015f540 con 0x7fdc00071df0 2024-09-19T09:15:39.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.569+0000 7fdc05785640 1 --2- 172.21.15.18:0/2751714458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc000d1010 0x7fdc0015dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:39.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.569+0000 7fdbfffff640 1 --2- 172.21.15.18:0/2751714458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc00071df0 0x7fdc0014e650 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fdbec000c00 tx=0x7fdbec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:39.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.569+0000 7fdbfd7fa640 1 -- 172.21.15.18:0/2751714458 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbec041020 con 0x7fdc00071df0 2024-09-19T09:15:39.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.569+0000 7fdbfd7fa640 1 -- 172.21.15.18:0/2751714458 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbec0306c0 con 0x7fdc00071df0 2024-09-19T09:15:39.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.569+0000 7fdc071e8640 1 -- 172.21.15.18:0/2751714458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc0015e4a0 con 0x7fdc00071df0 2024-09-19T09:15:39.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.569+0000 7fdbfd7fa640 1 -- 172.21.15.18:0/2751714458 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbec037040 con 0x7fdc00071df0 2024-09-19T09:15:39.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.569+0000 7fdc071e8640 1 -- 172.21.15.18:0/2751714458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc0015ea60 con 0x7fdc00071df0 2024-09-19T09:15:39.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.570+0000 7fdc071e8640 1 -- 172.21.15.18:0/2751714458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc00073370 con 0x7fdc00071df0 2024-09-19T09:15:39.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.571+0000 7fdbfd7fa640 1 -- 172.21.15.18:0/2751714458 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdbec044020 con 0x7fdc00071df0 2024-09-19T09:15:39.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.571+0000 7fdbfd7fa640 1 --2- 172.21.15.18:0/2751714458 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdbe406c2b0 0x7fdbe406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:39.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.571+0000 7fdbfd7fa640 1 -- 172.21.15.18:0/2751714458 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7fdbec0abba0 con 0x7fdc00071df0 2024-09-19T09:15:39.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.572+0000 7fdc04f84640 1 --2- 172.21.15.18:0/2751714458 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdbe406c2b0 0x7fdbe406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:39.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.572+0000 7fdc04f84640 1 --2- 172.21.15.18:0/2751714458 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdbe406c2b0 0x7fdbe406e770 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4009950 tx=0x7fdbf4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:39.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.576+0000 7fdbfd7fa640 1 -- 172.21.15.18:0/2751714458 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fdbec04b030 con 0x7fdc00071df0 2024-09-19T09:15:39.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.826+0000 7fdc071e8640 1 -- 172.21.15.18:0/2751714458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fdc0015b9c0 con 0x7fdc00071df0 2024-09-19T09:15:39.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.828+0000 7fdbfd7fa640 1 -- 172.21.15.18:0/2751714458 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7fdbec07a3a0 con 0x7fdc00071df0 2024-09-19T09:15:39.833 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-09-19T09:15:39.833 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAe6+tmcbwDNhAAaG0+wu96Locwws+h0zeh8Q== 2024-09-19T09:15:39.833 INFO:teuthology.orchestra.run.smithi018.stdout: caps mds = "allow" 2024-09-19T09:15:39.833 INFO:teuthology.orchestra.run.smithi018.stdout: caps mon = "allow r" 2024-09-19T09:15:39.833 INFO:teuthology.orchestra.run.smithi018.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-19T09:15:39.834 INFO:teuthology.orchestra.run.smithi018.stderr:updated caps for client.0 2024-09-19T09:15:39.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.830+0000 7fdc071e8640 1 -- 172.21.15.18:0/2751714458 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdbe406c2b0 msgr2=0x7fdbe406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:39.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.830+0000 7fdc071e8640 1 --2- 172.21.15.18:0/2751714458 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdbe406c2b0 0x7fdbe406e770 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdbf4009950 tx=0x7fdbf4008040 comp rx=0 tx=0).stop 2024-09-19T09:15:39.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.830+0000 7fdc071e8640 1 -- 172.21.15.18:0/2751714458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc00071df0 msgr2=0x7fdc0014e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:39.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.830+0000 7fdc071e8640 1 --2- 172.21.15.18:0/2751714458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc00071df0 0x7fdc0014e650 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fdbec000c00 tx=0x7fdbec0046c0 comp rx=0 tx=0).stop 2024-09-19T09:15:39.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.831+0000 7fdc071e8640 1 -- 172.21.15.18:0/2751714458 shutdown_connections 2024-09-19T09:15:39.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.831+0000 7fdc071e8640 1 --2- 172.21.15.18:0/2751714458 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdbe406c2b0 0x7fdbe406e770 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:39.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.831+0000 7fdc071e8640 1 --2- 172.21.15.18:0/2751714458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc000d1010 0x7fdc0015dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:39.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.831+0000 7fdc071e8640 1 --2- 172.21.15.18:0/2751714458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc00071df0 0x7fdc0014e650 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:39.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.831+0000 7fdc071e8640 1 --2- 172.21.15.18:0/2751714458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc0006e280 0x7fdc000b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:39.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.831+0000 7fdc071e8640 1 -- 172.21.15.18:0/2751714458 >> 172.21.15.18:0/2751714458 conn(0x7fdc0006bc10 msgr2=0x7fdc000cca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:39.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.831+0000 7fdc071e8640 1 -- 172.21.15.18:0/2751714458 shutdown_connections 2024-09-19T09:15:39.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.831+0000 7fdc071e8640 1 -- 172.21.15.18:0/2751714458 wait complete. 2024-09-19T09:15:39.842 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:15:39.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.944+0000 7f5625eac640 1 Processor -- start 2024-09-19T09:15:39.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.944+0000 7f5625eac640 1 -- start start 2024-09-19T09:15:39.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.944+0000 7f5625eac640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f562015ef50 0x7f56200d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:39.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.944+0000 7f5625eac640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56200b9510 0x7f56200d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:39.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.944+0000 7f5625eac640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56200b7a90 con 0x7f56200d3240 2024-09-19T09:15:39.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.944+0000 7f5625eac640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f56200d3740 con 0x7f562015ef50 2024-09-19T09:15:39.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.944+0000 7f5625eac640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f56200d3a20 con 0x7f56200b9510 2024-09-19T09:15:39.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.945+0000 7f561effd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f56200d3240 0x7f56200cf770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50666/0 (socket says 172.21.15.18:50666) 2024-09-19T09:15:39.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.945+0000 7f561effd640 1 -- 172.21.15.18:0/948070257 learned_addr learned my addr 172.21.15.18:0/948070257 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:15:39.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.945+0000 7f561f7fe640 1 --2- 172.21.15.18:0/948070257 >> v2:172.21.15.162:3300/0 conn(0x7f562015ef50 0x7f56200d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:39.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.945+0000 7f561ffff640 1 --2- 172.21.15.18:0/948070257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56200b9510 0x7f56200d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:39.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.945+0000 7f561e7fc640 1 -- 172.21.15.18:0/948070257 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 605214803 0 0) 0x7f56200b7a90 con 0x7f56200d3240 2024-09-19T09:15:39.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.945+0000 7f561e7fc640 1 -- 172.21.15.18:0/948070257 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5608003520 con 0x7f56200d3240 2024-09-19T09:15:39.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.945+0000 7f561f7fe640 1 -- 172.21.15.18:0/948070257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56200b9510 msgr2=0x7f56200d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:39.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.945+0000 7f561f7fe640 1 --2- 172.21.15.18:0/948070257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56200b9510 0x7f56200d18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:39.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.945+0000 7f561e7fc640 1 -- 172.21.15.18:0/948070257 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1058287359 0 0) 0x7f5608003520 con 0x7f56200d3240 2024-09-19T09:15:39.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.945+0000 7f561f7fe640 1 -- 172.21.15.18:0/948070257 >> v1:172.21.15.18:6789/0 conn(0x7f56200d3240 legacy=0x7f56200cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:39.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.945+0000 7f561f7fe640 1 -- 172.21.15.18:0/948070257 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56200b7d00 con 0x7f562015ef50 2024-09-19T09:15:39.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.946+0000 7f561f7fe640 1 --2- 172.21.15.18:0/948070257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f562015ef50 0x7f56200d13a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f56100097a0 tx=0x7f561002a080 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5db687d3fe462601 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:39.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.946+0000 7f561e7fc640 1 -- 172.21.15.18:0/948070257 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5610037070 con 0x7f562015ef50 2024-09-19T09:15:39.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.946+0000 7f561e7fc640 1 -- 172.21.15.18:0/948070257 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f561002ab10 con 0x7f562015ef50 2024-09-19T09:15:39.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.946+0000 7f561e7fc640 1 -- 172.21.15.18:0/948070257 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5614001670 con 0x7f562015ef50 2024-09-19T09:15:39.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.947+0000 7f5625eac640 1 -- 172.21.15.18:0/948070257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f562015ef50 msgr2=0x7f56200d13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:39.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.947+0000 7f5625eac640 1 --2- 172.21.15.18:0/948070257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f562015ef50 0x7f56200d13a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f56100097a0 tx=0x7f561002a080 comp rx=0 tx=0).stop 2024-09-19T09:15:39.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.947+0000 7f5625eac640 1 -- 172.21.15.18:0/948070257 shutdown_connections 2024-09-19T09:15:39.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.947+0000 7f5625eac640 1 --2- 172.21.15.18:0/948070257 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56200b9510 0x7f56200d18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:39.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.947+0000 7f5625eac640 1 --2- 172.21.15.18:0/948070257 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f562015ef50 0x7f56200d13a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:39.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.947+0000 7f5625eac640 1 -- 172.21.15.18:0/948070257 >> 172.21.15.18:0/948070257 conn(0x7f56200d4c60 msgr2=0x7f56200d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:39.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.947+0000 7f5625eac640 1 -- 172.21.15.18:0/948070257 shutdown_connections 2024-09-19T09:15:39.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.947+0000 7f5625eac640 1 -- 172.21.15.18:0/948070257 wait complete. 2024-09-19T09:15:39.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.948+0000 7f5625eac640 1 Processor -- start 2024-09-19T09:15:39.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.948+0000 7f5625eac640 1 -- start start 2024-09-19T09:15:39.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.949+0000 7f5625eac640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56200b9510 0x7f56201f7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:39.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.949+0000 7f5625eac640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56200d3240 0x7f56200b99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:39.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.949+0000 7f5625eac640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f562015ef50 0x7f56200b9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:39.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.949+0000 7f5625eac640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f56200d21a0 con 0x7f56200b9510 2024-09-19T09:15:39.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.949+0000 7f5625eac640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f56200d2020 con 0x7f56200d3240 2024-09-19T09:15:39.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.949+0000 7f5625eac640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f56200d5780 con 0x7f562015ef50 2024-09-19T09:15:39.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.949+0000 7f561f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56200b9510 0x7f56201f7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:39.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.949+0000 7f561f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56200b9510 0x7f56201f7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42280/0 (socket says 172.21.15.18:42280) 2024-09-19T09:15:39.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.949+0000 7f561f7fe640 1 -- 172.21.15.18:0/2536486939 learned_addr learned my addr 172.21.15.18:0/2536486939 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:39.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.949+0000 7f561ffff640 1 --2- 172.21.15.18:0/2536486939 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f562015ef50 0x7f56200b9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:39.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.949+0000 7f561effd640 1 --2- 172.21.15.18:0/2536486939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56200d3240 0x7f56200b99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:39.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.949+0000 7f561f7fe640 1 -- 172.21.15.18:0/2536486939 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f562015ef50 msgr2=0x7f56200b9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:39.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.949+0000 7f561f7fe640 1 --2- 172.21.15.18:0/2536486939 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f562015ef50 0x7f56200b9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:39.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.949+0000 7f561f7fe640 1 -- 172.21.15.18:0/2536486939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56200d3240 msgr2=0x7f56200b99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:39.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.949+0000 7f561f7fe640 1 --2- 172.21.15.18:0/2536486939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56200d3240 0x7f56200b99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:39.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.949+0000 7f561f7fe640 1 -- 172.21.15.18:0/2536486939 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56201f5cf0 con 0x7f56200b9510 2024-09-19T09:15:39.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.949+0000 7f561f7fe640 1 --2- 172.21.15.18:0/2536486939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56200b9510 0x7f56201f7cb0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5610035040 tx=0x7f56100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:39.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.950+0000 7f5607fff640 1 -- 172.21.15.18:0/2536486939 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5610041070 con 0x7f56200b9510 2024-09-19T09:15:39.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.950+0000 7f5607fff640 1 -- 172.21.15.18:0/2536486939 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f561003c660 con 0x7f56200b9510 2024-09-19T09:15:39.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.950+0000 7f5625eac640 1 -- 172.21.15.18:0/2536486939 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56201f8580 con 0x7f56200b9510 2024-09-19T09:15:39.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.950+0000 7f5607fff640 1 -- 172.21.15.18:0/2536486939 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5610037040 con 0x7f56200b9510 2024-09-19T09:15:39.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.950+0000 7f5625eac640 1 -- 172.21.15.18:0/2536486939 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56201f8b40 con 0x7f56200b9510 2024-09-19T09:15:39.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.951+0000 7f5625eac640 1 -- 172.21.15.18:0/2536486939 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56200d3030 con 0x7f56200b9510 2024-09-19T09:15:39.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.951+0000 7f5607fff640 1 -- 172.21.15.18:0/2536486939 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5610044070 con 0x7f56200b9510 2024-09-19T09:15:39.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.952+0000 7f5607fff640 1 --2- 172.21.15.18:0/2536486939 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f560c06c2e0 0x7f560c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:39.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.952+0000 7f5607fff640 1 -- 172.21.15.18:0/2536486939 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7f56100abc10 con 0x7f56200b9510 2024-09-19T09:15:39.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.952+0000 7f561effd640 1 --2- 172.21.15.18:0/2536486939 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f560c06c2e0 0x7f560c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:39.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.952+0000 7f561effd640 1 --2- 172.21.15.18:0/2536486939 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f560c06c2e0 0x7f560c06e7a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5620153fe0 tx=0x7f5614009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:39.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:39.956+0000 7f5607fff640 1 -- 172.21.15.18:0/2536486939 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f56200d3030 con 0x7f56200b9510 2024-09-19T09:15:40.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.167+0000 7f5625eac640 1 -- 172.21.15.18:0/2536486939 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56200d13a0 con 0x7f56200b9510 2024-09-19T09:15:40.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.167+0000 7f5607fff640 1 -- 172.21.15.18:0/2536486939 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5229 (secure 0 0 0) 0x7f561007a400 con 0x7f56200b9510 2024-09-19T09:15:40.168 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:15:40.168 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:15:33:667104+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3337833568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3337833568},{"type":"v1","addr":"172.21.15.162:6837","nonce":3337833568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1692924872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1692924872},{"type":"v1","addr":"172.21.15.162:6836","nonce":1692924872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5377,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2351287916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2351287916},{"type":"v1","addr":"172.21.15.18:6834","nonce":2351287916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:15:31.000055+0000","modified":"2024-09-19T09:15:33.010750+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5574},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5574":{"gid":5574,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/1824357592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1824357592},{"type":"v1","addr":"172.21.15.18:6835","nonce":1824357592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5574,"qdb_cluster":[5574]},"id":4}]} 2024-09-19T09:15:40.169 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:15:40.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.169+0000 7f5625eac640 1 -- 172.21.15.18:0/2536486939 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f560c06c2e0 msgr2=0x7f560c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:40.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.169+0000 7f5625eac640 1 --2- 172.21.15.18:0/2536486939 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f560c06c2e0 0x7f560c06e7a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5620153fe0 tx=0x7f5614009040 comp rx=0 tx=0).stop 2024-09-19T09:15:40.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.169+0000 7f5625eac640 1 -- 172.21.15.18:0/2536486939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56200b9510 msgr2=0x7f56201f7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:40.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.169+0000 7f5625eac640 1 --2- 172.21.15.18:0/2536486939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56200b9510 0x7f56201f7cb0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5610035040 tx=0x7f56100046c0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.169+0000 7f5625eac640 1 -- 172.21.15.18:0/2536486939 shutdown_connections 2024-09-19T09:15:40.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.169+0000 7f5625eac640 1 --2- 172.21.15.18:0/2536486939 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f560c06c2e0 0x7f560c06e7a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.169+0000 7f5625eac640 1 --2- 172.21.15.18:0/2536486939 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f562015ef50 0x7f56200b9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.169+0000 7f5625eac640 1 --2- 172.21.15.18:0/2536486939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56200d3240 0x7f56200b99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.169+0000 7f5625eac640 1 --2- 172.21.15.18:0/2536486939 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f56200b9510 0x7f56201f7cb0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.169+0000 7f5625eac640 1 -- 172.21.15.18:0/2536486939 >> 172.21.15.18:0/2536486939 conn(0x7f56200d4c60 msgr2=0x7f56200d0500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:40.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.170+0000 7f5625eac640 1 -- 172.21.15.18:0/2536486939 shutdown_connections 2024-09-19T09:15:40.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.170+0000 7f5625eac640 1 -- 172.21.15.18:0/2536486939 wait complete. 2024-09-19T09:15:40.585 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T09:15:31.000055+0000', 'modified': '2024-09-19T09:15:33.010750+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5574}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5574': {'gid': 5574, 'name': 'a', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.18:6835/1824357592', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6833', 'nonce': 1824357592}, {'type': 'v1', 'addr': '172.21.15.18:6835', 'nonce': 1824357592}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5574, 'qdb_cluster': [5574]} 2024-09-19T09:15:40.585 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T09:15:40.586 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-19T09:15:40.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.693+0000 7ff0919e8640 1 Processor -- start 2024-09-19T09:15:40.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.693+0000 7ff0919e8640 1 -- start start 2024-09-19T09:15:40.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.693+0000 7ff0919e8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff08c1622d0 0x7ff08c0cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:40.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.693+0000 7ff0919e8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff08c0b8430 0x7ff08c0b8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:40.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.693+0000 7ff0919e8640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff08c0d36b0 con 0x7ff08c0cfd20 2024-09-19T09:15:40.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.693+0000 7ff0919e8640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7ff08c0d5ad0 con 0x7ff08c1622d0 2024-09-19T09:15:40.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.693+0000 7ff0919e8640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff08c1626b0 con 0x7ff08c0b8430 2024-09-19T09:15:40.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.694+0000 7ff08affd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff08c1622d0 0x7ff08c0cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:40.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.694+0000 7ff08a7fc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff08c0cfd20 0x7ff08c0d0150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50672/0 (socket says 172.21.15.18:50672) 2024-09-19T09:15:40.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.694+0000 7ff08a7fc640 1 -- 172.21.15.18:0/2152842542 learned_addr learned my addr 172.21.15.18:0/2152842542 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:15:40.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.694+0000 7ff08b7fe640 1 --2- 172.21.15.18:0/2152842542 >> v2:172.21.15.162:3300/0 conn(0x7ff08c0b8430 0x7ff08c0b8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:40.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.694+0000 7ff089ffb640 1 -- 172.21.15.18:0/2152842542 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3832768861 0 0) 0x7ff08c0d36b0 con 0x7ff08c0cfd20 2024-09-19T09:15:40.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.694+0000 7ff089ffb640 1 -- 172.21.15.18:0/2152842542 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff078003520 con 0x7ff08c0cfd20 2024-09-19T09:15:40.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.694+0000 7ff08affd640 1 -- 172.21.15.18:0/2152842542 >> v2:172.21.15.162:3300/0 conn(0x7ff08c0b8430 msgr2=0x7ff08c0b8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:40.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.694+0000 7ff08affd640 1 --2- 172.21.15.18:0/2152842542 >> v2:172.21.15.162:3300/0 conn(0x7ff08c0b8430 0x7ff08c0b8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.694+0000 7ff08affd640 1 -- 172.21.15.18:0/2152842542 >> v1:172.21.15.18:6789/0 conn(0x7ff08c0cfd20 legacy=0x7ff08c0d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:40.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.694+0000 7ff08affd640 1 -- 172.21.15.18:0/2152842542 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08c0d3990 con 0x7ff08c1622d0 2024-09-19T09:15:40.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.695+0000 7ff08affd640 1 --2- 172.21.15.18:0/2152842542 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff08c1622d0 0x7ff08c0cf7e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff08c0cbb30 tx=0x7ff07c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6abdbff5f415d34 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:40.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.695+0000 7ff089ffb640 1 -- 172.21.15.18:0/2152842542 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07c007740 con 0x7ff08c1622d0 2024-09-19T09:15:40.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.695+0000 7ff089ffb640 1 -- 172.21.15.18:0/2152842542 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff07c0078e0 con 0x7ff08c1622d0 2024-09-19T09:15:40.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.695+0000 7ff089ffb640 1 -- 172.21.15.18:0/2152842542 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07c007c90 con 0x7ff08c1622d0 2024-09-19T09:15:40.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.695+0000 7ff0919e8640 1 -- 172.21.15.18:0/2152842542 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff08c1622d0 msgr2=0x7ff08c0cf7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:40.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.695+0000 7ff0919e8640 1 --2- 172.21.15.18:0/2152842542 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff08c1622d0 0x7ff08c0cf7e0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff08c0cbb30 tx=0x7ff07c02a710 comp rx=0 tx=0).stop 2024-09-19T09:15:40.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.695+0000 7ff0919e8640 1 -- 172.21.15.18:0/2152842542 shutdown_connections 2024-09-19T09:15:40.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.695+0000 7ff0919e8640 1 --2- 172.21.15.18:0/2152842542 >> v2:172.21.15.162:3300/0 conn(0x7ff08c0b8430 0x7ff08c0b8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.695+0000 7ff0919e8640 1 --2- 172.21.15.18:0/2152842542 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff08c1622d0 0x7ff08c0cf7e0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.695+0000 7ff0919e8640 1 -- 172.21.15.18:0/2152842542 >> 172.21.15.18:0/2152842542 conn(0x7ff08c0d4c60 msgr2=0x7ff08c0d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:40.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.696+0000 7ff0919e8640 1 -- 172.21.15.18:0/2152842542 shutdown_connections 2024-09-19T09:15:40.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.696+0000 7ff0919e8640 1 -- 172.21.15.18:0/2152842542 wait complete. 2024-09-19T09:15:40.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.697+0000 7ff0919e8640 1 Processor -- start 2024-09-19T09:15:40.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.697+0000 7ff0919e8640 1 -- start start 2024-09-19T09:15:40.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.698+0000 7ff0919e8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff08c0b8430 0x7ff08c1f79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:40.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.698+0000 7ff0919e8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff08c0cfd20 0x7ff08c1f7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:40.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.698+0000 7ff0919e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff08c1622d0 0x7ff08c1e7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:40.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.698+0000 7ff0919e8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c0d3c70 con 0x7ff08c1622d0 2024-09-19T09:15:40.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.698+0000 7ff0919e8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c0b7fa0 con 0x7ff08c0cfd20 2024-09-19T09:15:40.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.698+0000 7ff0919e8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff08c0d23b0 con 0x7ff08c0b8430 2024-09-19T09:15:40.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.698+0000 7ff08b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff08c1622d0 0x7ff08c1e7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:40.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.698+0000 7ff08b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff08c1622d0 0x7ff08c1e7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42296/0 (socket says 172.21.15.18:42296) 2024-09-19T09:15:40.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.698+0000 7ff08b7fe640 1 -- 172.21.15.18:0/2301831262 learned_addr learned my addr 172.21.15.18:0/2301831262 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:40.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.698+0000 7ff08a7fc640 1 --2- 172.21.15.18:0/2301831262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff08c0cfd20 0x7ff08c1f7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:40.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.698+0000 7ff08affd640 1 --2- 172.21.15.18:0/2301831262 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff08c0b8430 0x7ff08c1f79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:40.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.698+0000 7ff08b7fe640 1 -- 172.21.15.18:0/2301831262 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff08c0b8430 msgr2=0x7ff08c1f79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:40.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.698+0000 7ff08b7fe640 1 --2- 172.21.15.18:0/2301831262 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff08c0b8430 0x7ff08c1f79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.698+0000 7ff08b7fe640 1 -- 172.21.15.18:0/2301831262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff08c0cfd20 msgr2=0x7ff08c1f7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:40.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.698+0000 7ff08b7fe640 1 --2- 172.21.15.18:0/2301831262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff08c0cfd20 0x7ff08c1f7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.698+0000 7ff08b7fe640 1 -- 172.21.15.18:0/2301831262 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08c1e8ab0 con 0x7ff08c1622d0 2024-09-19T09:15:40.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.698+0000 7ff08affd640 1 --2- 172.21.15.18:0/2301831262 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff08c0b8430 0x7ff08c1f79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:40.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.698+0000 7ff08b7fe640 1 --2- 172.21.15.18:0/2301831262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff08c1622d0 0x7ff08c1e7df0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff08400e930 tx=0x7ff08400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:40.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.698+0000 7ff083fff640 1 -- 172.21.15.18:0/2301831262 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff084017070 con 0x7ff08c1622d0 2024-09-19T09:15:40.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.698+0000 7ff083fff640 1 -- 172.21.15.18:0/2301831262 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff08400c980 con 0x7ff08c1622d0 2024-09-19T09:15:40.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.698+0000 7ff0919e8640 1 -- 172.21.15.18:0/2301831262 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff08c1e8d90 con 0x7ff08c1622d0 2024-09-19T09:15:40.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.698+0000 7ff083fff640 1 -- 172.21.15.18:0/2301831262 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08400cd70 con 0x7ff08c1622d0 2024-09-19T09:15:40.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.698+0000 7ff0919e8640 1 -- 172.21.15.18:0/2301831262 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff08c1e9350 con 0x7ff08c1622d0 2024-09-19T09:15:40.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.700+0000 7ff083fff640 1 -- 172.21.15.18:0/2301831262 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff08401a070 con 0x7ff08c1622d0 2024-09-19T09:15:40.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.700+0000 7ff083fff640 1 --2- 172.21.15.18:0/2301831262 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff06c06c2b0 0x7ff06c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:40.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.700+0000 7ff083fff640 1 -- 172.21.15.18:0/2301831262 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7ff08408b3a0 con 0x7ff08c1622d0 2024-09-19T09:15:40.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.701+0000 7ff08affd640 1 --2- 172.21.15.18:0/2301831262 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff06c06c2b0 0x7ff06c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:40.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.701+0000 7ff08affd640 1 --2- 172.21.15.18:0/2301831262 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff06c06c2b0 0x7ff06c06e770 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff07c034000 tx=0x7ff07c033040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:40.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.701+0000 7ff094862740 1 Processor -- start 2024-09-19T09:15:40.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.701+0000 7ff094862740 1 -- start start 2024-09-19T09:15:40.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.702+0000 7ff094862740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556fbe5162c0 0x556fbe55ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:40.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.702+0000 7ff094862740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556fbe513a80 0x556fbe5166a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:40.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.702+0000 7ff094862740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556fbe517a50 0x556fbe5108b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:40.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.702+0000 7ff094862740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556fbe478520 con 0x556fbe5162c0 2024-09-19T09:15:40.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.702+0000 7ff094862740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556fbe4203e0 con 0x556fbe517a50 2024-09-19T09:15:40.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.702+0000 7ff094862740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x556fbe4744e0 con 0x556fbe513a80 2024-09-19T09:15:40.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.702+0000 7ff08affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556fbe5162c0 0x556fbe55ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:40.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.702+0000 7ff08affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556fbe5162c0 0x556fbe55ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42308/0 (socket says 172.21.15.18:42308) 2024-09-19T09:15:40.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.702+0000 7ff08affd640 1 -- 172.21.15.18:0/432550600 learned_addr learned my addr 172.21.15.18:0/432550600 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:40.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.702+0000 7ff08b7fe640 1 --2- 172.21.15.18:0/432550600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556fbe517a50 0x556fbe5108b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:40.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.702+0000 7ff08a7fc640 1 --2- 172.21.15.18:0/432550600 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556fbe513a80 0x556fbe5166a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:40.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.703+0000 7ff08affd640 1 -- 172.21.15.18:0/432550600 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556fbe513a80 msgr2=0x556fbe5166a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:40.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.703+0000 7ff08affd640 1 --2- 172.21.15.18:0/432550600 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556fbe513a80 0x556fbe5166a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.703+0000 7ff08affd640 1 -- 172.21.15.18:0/432550600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556fbe517a50 msgr2=0x556fbe5108b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:40.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.703+0000 7ff08affd640 1 --2- 172.21.15.18:0/432550600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556fbe517a50 0x556fbe5108b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.703+0000 7ff08affd640 1 -- 172.21.15.18:0/432550600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fbe43b2f0 con 0x556fbe5162c0 2024-09-19T09:15:40.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.703+0000 7ff08affd640 1 --2- 172.21.15.18:0/432550600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556fbe5162c0 0x556fbe55ba60 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff07c007860 tx=0x7ff07c02f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d904e42c3dd1e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:40.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.703+0000 7ff0817fa640 1 -- 172.21.15.18:0/432550600 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07c041070 con 0x556fbe5162c0 2024-09-19T09:15:40.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.703+0000 7ff0817fa640 1 -- 172.21.15.18:0/432550600 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff07c04c070 con 0x556fbe5162c0 2024-09-19T09:15:40.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.703+0000 7ff0817fa640 1 -- 172.21.15.18:0/432550600 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07c047820 con 0x556fbe5162c0 2024-09-19T09:15:40.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.704+0000 7ff094862740 1 -- 172.21.15.18:0/432550600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556fbe5162c0 msgr2=0x556fbe55ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:40.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.704+0000 7ff094862740 1 --2- 172.21.15.18:0/432550600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556fbe5162c0 0x556fbe55ba60 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7ff07c007860 tx=0x7ff07c02f000 comp rx=0 tx=0).stop 2024-09-19T09:15:40.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.704+0000 7ff094862740 1 -- 172.21.15.18:0/432550600 shutdown_connections 2024-09-19T09:15:40.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.704+0000 7ff094862740 1 --2- 172.21.15.18:0/432550600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556fbe517a50 0x556fbe5108b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.704+0000 7ff094862740 1 --2- 172.21.15.18:0/432550600 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556fbe513a80 0x556fbe5166a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.704+0000 7ff094862740 1 --2- 172.21.15.18:0/432550600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556fbe5162c0 0x556fbe55ba60 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.704+0000 7ff094862740 1 -- 172.21.15.18:0/432550600 >> 172.21.15.18:0/432550600 conn(0x556fbe512a80 msgr2=0x556fbe55af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:40.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.704+0000 7ff094862740 1 -- 172.21.15.18:0/432550600 shutdown_connections 2024-09-19T09:15:40.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.704+0000 7ff094862740 1 -- 172.21.15.18:0/432550600 wait complete. 2024-09-19T09:15:40.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.704+0000 7ff094862740 1 -- start start 2024-09-19T09:15:40.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.704+0000 7ff094862740 1 Processor -- start 2024-09-19T09:15:40.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.705+0000 7ff094862740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556fbe5162c0 0x556fbe5314c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:40.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.705+0000 7ff094862740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556fbe517a50 0x556fbe5112e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:40.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.705+0000 7ff094862740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556fbe514ba0 0x556fbe515020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:40.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.705+0000 7ff094862740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556fbe511f20 con 0x556fbe514ba0 2024-09-19T09:15:40.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.705+0000 7ff094862740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556fbe401450 con 0x556fbe5162c0 2024-09-19T09:15:40.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.705+0000 7ff094862740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x556fbe55c290 con 0x556fbe517a50 2024-09-19T09:15:40.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.705+0000 7ff094862740 10 client.0 _ll_register_callbacks cb 0x556fbe18aac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:15:40.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.705+0000 7ff08b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556fbe514ba0 0x556fbe515020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:40.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.705+0000 7ff08b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556fbe514ba0 0x556fbe515020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42310/0 (socket says 172.21.15.18:42310) 2024-09-19T09:15:40.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.705+0000 7ff08b7fe640 1 -- 172.21.15.18:0/4176905107 learned_addr learned my addr 172.21.15.18:0/4176905107 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:40.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.705+0000 7ff08a7fc640 1 --2- 172.21.15.18:0/4176905107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556fbe517a50 0x556fbe5112e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:40.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.705+0000 7ff08affd640 1 --2- 172.21.15.18:0/4176905107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556fbe5162c0 0x556fbe5314c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:40.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.706+0000 7ff08b7fe640 1 -- 172.21.15.18:0/4176905107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556fbe517a50 msgr2=0x556fbe5112e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:40.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.706+0000 7ff08b7fe640 1 --2- 172.21.15.18:0/4176905107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556fbe517a50 0x556fbe5112e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.706+0000 7ff08b7fe640 1 -- 172.21.15.18:0/4176905107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556fbe5162c0 msgr2=0x556fbe5314c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:40.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.706+0000 7ff08b7fe640 1 --2- 172.21.15.18:0/4176905107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556fbe5162c0 0x556fbe5314c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.706+0000 7ff08b7fe640 1 -- 172.21.15.18:0/4176905107 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fbe18b2d0 con 0x556fbe514ba0 2024-09-19T09:15:40.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.706+0000 7ff08b7fe640 1 --2- 172.21.15.18:0/4176905107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556fbe514ba0 0x556fbe515020 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff0840559d0 tx=0x7ff0840596b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0c68aeab2a3a2c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:40.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.706+0000 7ff06a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:15:40.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.706+0000 7ff06a7fc640 1 -- 172.21.15.18:0/4176905107 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff084021040 con 0x556fbe514ba0 2024-09-19T09:15:40.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.706+0000 7ff06a7fc640 1 -- 172.21.15.18:0/4176905107 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7ff084058bc0 con 0x556fbe514ba0 2024-09-19T09:15:40.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.706+0000 7ff094862740 1 -- 172.21.15.18:0/4176905107 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff07c04c070 con 0x556fbe514ba0 2024-09-19T09:15:40.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.706+0000 7ff06a7fc640 1 -- 172.21.15.18:0/4176905107 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff084057930 con 0x556fbe514ba0 2024-09-19T09:15:40.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.706+0000 7ff094862740 10 client.5718 fetch_fsmap learned FSMap version 28 2024-09-19T09:15:40.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.706+0000 7ff094862740 1 -- 172.21.15.18:0/4176905107 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x556fbe2556b0 con 0x556fbe514ba0 2024-09-19T09:15:40.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.706+0000 7ff06a7fc640 1 -- 172.21.15.18:0/4176905107 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff07c04c070 con 0x556fbe514ba0 2024-09-19T09:15:40.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.706+0000 7ff06a7fc640 1 -- 172.21.15.18:0/4176905107 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7ff084024060 con 0x556fbe514ba0 2024-09-19T09:15:40.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.706+0000 7ff094862740 10 client.5718 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:15:40.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.706+0000 7ff094862740 10 client.5718 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T09:15:40.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.706+0000 7ff094862740 20 client.5718 populate_metadata read hostname 'smithi018' 2024-09-19T09:15:40.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.706+0000 7ff094862740 1 --2- 172.21.15.18:0/4176905107 >> [v2:172.21.15.18:6833/1824357592,v1:172.21.15.18:6835/1824357592] conn(0x556fbe53f670 0x556fbe53fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:40.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.706+0000 7ff094862740 4 client.5718 mds_command: new command op to 5574 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:15:40.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.706+0000 7ff094862740 1 -- 172.21.15.18:0/4176905107 --> [v2:172.21.15.18:6833/1824357592,v1:172.21.15.18:6835/1824357592] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556fbe485c50 con 0x556fbe53f670 2024-09-19T09:15:40.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.707+0000 7ff08affd640 1 --2- 172.21.15.18:0/4176905107 >> [v2:172.21.15.18:6833/1824357592,v1:172.21.15.18:6835/1824357592] conn(0x556fbe53f670 0x556fbe53fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:40.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.707+0000 7ff08affd640 1 --2- 172.21.15.18:0/4176905107 >> [v2:172.21.15.18:6833/1824357592,v1:172.21.15.18:6835/1824357592] conn(0x556fbe53f670 0x556fbe53fa50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b64b338aad1fcf5c server_cookie=d8a6bad271cf2711 in_seq=0 out_seq=0 2024-09-19T09:15:40.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.707+0000 7ff06a7fc640 10 client.5718 ms_handle_connect on v2:172.21.15.18:6833/1824357592 2024-09-19T09:15:40.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.707+0000 7ff06a7fc640 1 -- 172.21.15.18:0/4176905107 <== mds.0 v2:172.21.15.18:6833/1824357592 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556fbe485c50 con 0x556fbe53f670 2024-09-19T09:15:40.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.707+0000 7ff06a7fc640 10 client.5718 handle_command_reply: tid=0 2024-09-19T09:15:40.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.707+0000 7ff094862740 1 client.5718 shutdown 2024-09-19T09:15:40.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.708+0000 7ff094862740 1 -- 172.21.15.18:0/4176905107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556fbe514ba0 msgr2=0x556fbe515020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:40.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.708+0000 7ff094862740 1 --2- 172.21.15.18:0/4176905107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556fbe514ba0 0x556fbe515020 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7ff0840559d0 tx=0x7ff0840596b0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.708+0000 7ff094862740 1 -- 172.21.15.18:0/4176905107 shutdown_connections 2024-09-19T09:15:40.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.708+0000 7ff094862740 1 --2- 172.21.15.18:0/4176905107 >> [v2:172.21.15.18:6833/1824357592,v1:172.21.15.18:6835/1824357592] conn(0x556fbe53f670 0x556fbe53fa50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.708+0000 7ff094862740 1 --2- 172.21.15.18:0/4176905107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556fbe514ba0 0x556fbe515020 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.708+0000 7ff094862740 1 --2- 172.21.15.18:0/4176905107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556fbe517a50 0x556fbe5112e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.708+0000 7ff06a7fc640 0 client.5718 ms_handle_reset on v2:172.21.15.18:6833/1824357592 2024-09-19T09:15:40.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.708+0000 7ff094862740 1 --2- 172.21.15.18:0/4176905107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556fbe5162c0 0x556fbe5314c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.708+0000 7ff094862740 1 -- 172.21.15.18:0/4176905107 >> 172.21.15.18:0/4176905107 conn(0x556fbe513a80 msgr2=0x556fbe558ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:40.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.708+0000 7ff094862740 1 -- 172.21.15.18:0/4176905107 shutdown_connections 2024-09-19T09:15:40.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.708+0000 7ff094862740 1 -- 172.21.15.18:0/4176905107 wait complete. 2024-09-19T09:15:40.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.708+0000 7ff094862740 20 client.5718 trim_cache size 0 max 16384 2024-09-19T09:15:40.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.726+0000 7ff094862740 1 Processor -- start 2024-09-19T09:15:40.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.726+0000 7ff094862740 1 -- start start 2024-09-19T09:15:40.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.727+0000 7ff094862740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556fbe514ba0 0x556fbe53b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:40.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.727+0000 7ff094862740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556fbe5162c0 0x556fbe55ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:40.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.727+0000 7ff094862740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556fbe517a50 0x556fbe53fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:40.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.727+0000 7ff094862740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c1ffdf0 con 0x556fbe517a50 2024-09-19T09:15:40.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.727+0000 7ff094862740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff08c1f5060 con 0x556fbe5162c0 2024-09-19T09:15:40.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.727+0000 7ff094862740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff08c1ff7a0 con 0x556fbe514ba0 2024-09-19T09:15:40.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.727+0000 7ff08b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556fbe517a50 0x556fbe53fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:40.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.727+0000 7ff08b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556fbe517a50 0x556fbe53fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42320/0 (socket says 172.21.15.18:42320) 2024-09-19T09:15:40.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.727+0000 7ff08b7fe640 1 -- 172.21.15.18:0/3279278798 learned_addr learned my addr 172.21.15.18:0/3279278798 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:40.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.727+0000 7ff08affd640 1 --2- 172.21.15.18:0/3279278798 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556fbe514ba0 0x556fbe53b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:40.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.727+0000 7ff08a7fc640 1 --2- 172.21.15.18:0/3279278798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556fbe5162c0 0x556fbe55ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:40.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.727+0000 7ff08b7fe640 1 -- 172.21.15.18:0/3279278798 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556fbe514ba0 msgr2=0x556fbe53b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:40.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.727+0000 7ff08b7fe640 1 --2- 172.21.15.18:0/3279278798 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556fbe514ba0 0x556fbe53b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.727+0000 7ff08b7fe640 1 -- 172.21.15.18:0/3279278798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556fbe5162c0 msgr2=0x556fbe55ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:40.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.727+0000 7ff08b7fe640 1 --2- 172.21.15.18:0/3279278798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556fbe5162c0 0x556fbe55ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.727+0000 7ff08b7fe640 1 -- 172.21.15.18:0/3279278798 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fbe57f9f0 con 0x556fbe517a50 2024-09-19T09:15:40.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.727+0000 7ff08b7fe640 1 --2- 172.21.15.18:0/3279278798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556fbe517a50 0x556fbe53fa50 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff084006d00 tx=0x7ff08401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8efbd0ef30b7104b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:40.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.727+0000 7ff080ff9640 1 -- 172.21.15.18:0/3279278798 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff084021030 con 0x556fbe517a50 2024-09-19T09:15:40.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.727+0000 7ff080ff9640 1 -- 172.21.15.18:0/3279278798 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0840553e0 con 0x556fbe517a50 2024-09-19T09:15:40.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.727+0000 7ff080ff9640 1 -- 172.21.15.18:0/3279278798 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0840590b0 con 0x556fbe517a50 2024-09-19T09:15:40.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.728+0000 7ff094862740 1 -- 172.21.15.18:0/3279278798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556fbe517a50 msgr2=0x556fbe53fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:40.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.728+0000 7ff094862740 1 --2- 172.21.15.18:0/3279278798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556fbe517a50 0x556fbe53fa50 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff084006d00 tx=0x7ff08401e000 comp rx=0 tx=0).stop 2024-09-19T09:15:40.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.728+0000 7ff094862740 1 -- 172.21.15.18:0/3279278798 shutdown_connections 2024-09-19T09:15:40.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.728+0000 7ff094862740 1 --2- 172.21.15.18:0/3279278798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556fbe517a50 0x556fbe53fa50 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.728+0000 7ff094862740 1 --2- 172.21.15.18:0/3279278798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556fbe5162c0 0x556fbe55ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.728+0000 7ff094862740 1 --2- 172.21.15.18:0/3279278798 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556fbe514ba0 0x556fbe53b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.728+0000 7ff094862740 1 -- 172.21.15.18:0/3279278798 >> 172.21.15.18:0/3279278798 conn(0x556fbe513a80 msgr2=0x556fbe558ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:40.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.728+0000 7ff094862740 1 -- 172.21.15.18:0/3279278798 shutdown_connections 2024-09-19T09:15:40.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.728+0000 7ff094862740 1 -- 172.21.15.18:0/3279278798 wait complete. 2024-09-19T09:15:40.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.729+0000 7ff094862740 1 -- start start 2024-09-19T09:15:40.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.729+0000 7ff094862740 1 Processor -- start 2024-09-19T09:15:40.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.729+0000 7ff094862740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556fbe514ba0 0x556fbe57de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:40.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.729+0000 7ff094862740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556fbe5162c0 0x556fbe57e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:40.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.729+0000 7ff094862740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556fbe517a50 0x556fbe57e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:40.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.729+0000 7ff094862740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x556fbe531af0 con 0x556fbe514ba0 2024-09-19T09:15:40.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.729+0000 7ff094862740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x556fbe540670 con 0x556fbe5162c0 2024-09-19T09:15:40.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.729+0000 7ff094862740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x556fbe50fca0 con 0x556fbe517a50 2024-09-19T09:15:40.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.729+0000 7ff094862740 10 client.0 _ll_register_callbacks cb 0x7ff084006c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:15:40.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.729+0000 7ff08affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556fbe514ba0 0x556fbe57de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:40.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.730+0000 7ff08affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556fbe514ba0 0x556fbe57de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42330/0 (socket says 172.21.15.18:42330) 2024-09-19T09:15:40.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.730+0000 7ff08affd640 1 -- 172.21.15.18:0/3046147013 learned_addr learned my addr 172.21.15.18:0/3046147013 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:40.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.730+0000 7ff08b7fe640 1 --2- 172.21.15.18:0/3046147013 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556fbe517a50 0x556fbe57e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:40.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.730+0000 7ff08a7fc640 1 --2- 172.21.15.18:0/3046147013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556fbe5162c0 0x556fbe57e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:40.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.730+0000 7ff08affd640 1 -- 172.21.15.18:0/3046147013 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556fbe517a50 msgr2=0x556fbe57e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:40.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.730+0000 7ff08affd640 1 --2- 172.21.15.18:0/3046147013 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556fbe517a50 0x556fbe57e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.730+0000 7ff08affd640 1 -- 172.21.15.18:0/3046147013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556fbe5162c0 msgr2=0x556fbe57e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:40.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.730+0000 7ff08affd640 1 --2- 172.21.15.18:0/3046147013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556fbe5162c0 0x556fbe57e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.730+0000 7ff08affd640 1 -- 172.21.15.18:0/3046147013 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fbe53a550 con 0x556fbe514ba0 2024-09-19T09:15:40.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.730+0000 7ff08affd640 1 --2- 172.21.15.18:0/3046147013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556fbe514ba0 0x556fbe57de70 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff07c049040 tx=0x7ff07c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ec44177d25767f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:40.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.730+0000 7ff06a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:15:40.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.730+0000 7ff06a7fc640 1 -- 172.21.15.18:0/3046147013 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07c060060 con 0x556fbe514ba0 2024-09-19T09:15:40.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.730+0000 7ff06a7fc640 1 -- 172.21.15.18:0/3046147013 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7ff07c047af0 con 0x556fbe514ba0 2024-09-19T09:15:40.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.730+0000 7ff094862740 1 -- 172.21.15.18:0/3046147013 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0840553e0 con 0x556fbe514ba0 2024-09-19T09:15:40.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.730+0000 7ff06a7fc640 1 -- 172.21.15.18:0/3046147013 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff07c066050 con 0x556fbe514ba0 2024-09-19T09:15:40.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.730+0000 7ff094862740 10 client.5724 fetch_fsmap learned FSMap version 28 2024-09-19T09:15:40.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.730+0000 7ff094862740 1 -- 172.21.15.18:0/3046147013 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=2+}) -- 0x556fbe56b3f0 con 0x556fbe514ba0 2024-09-19T09:15:40.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.730+0000 7ff06a7fc640 1 -- 172.21.15.18:0/3046147013 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0840553e0 con 0x556fbe514ba0 2024-09-19T09:15:40.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.731+0000 7ff06a7fc640 1 -- 172.21.15.18:0/3046147013 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 28) ==== 3502+0+0 (secure 0 0 0) 0x7ff07c069020 con 0x556fbe514ba0 2024-09-19T09:15:40.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.731+0000 7ff094862740 10 client.5724 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T09:15:40.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.731+0000 7ff094862740 10 client.5724 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T09:15:40.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.731+0000 7ff094862740 20 client.5724 populate_metadata read hostname 'smithi018' 2024-09-19T09:15:40.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.731+0000 7ff094862740 1 --2- 172.21.15.18:0/3046147013 >> [v2:172.21.15.18:6833/1824357592,v1:172.21.15.18:6835/1824357592] conn(0x556fbe5d9150 0x556fbe5d9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:40.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.731+0000 7ff094862740 4 client.5724 mds_command: new command op to 5574 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:15:40.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.731+0000 7ff094862740 1 -- 172.21.15.18:0/3046147013 --> [v2:172.21.15.18:6833/1824357592,v1:172.21.15.18:6835/1824357592] -- command(tid 0: {"prefix": "status"}) -- 0x556fbe47ffa0 con 0x556fbe5d9150 2024-09-19T09:15:40.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.731+0000 7ff08a7fc640 1 --2- 172.21.15.18:0/3046147013 >> [v2:172.21.15.18:6833/1824357592,v1:172.21.15.18:6835/1824357592] conn(0x556fbe5d9150 0x556fbe5d9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:40.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.731+0000 7ff08a7fc640 1 --2- 172.21.15.18:0/3046147013 >> [v2:172.21.15.18:6833/1824357592,v1:172.21.15.18:6835/1824357592] conn(0x556fbe5d9150 0x556fbe5d9530 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be76f9b0702c4f14 server_cookie=e8e727991c187e43 in_seq=0 out_seq=0 2024-09-19T09:15:40.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.731+0000 7ff06a7fc640 10 client.5724 ms_handle_connect on v2:172.21.15.18:6833/1824357592 2024-09-19T09:15:40.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.731+0000 7ff06a7fc640 1 -- 172.21.15.18:0/3046147013 <== mds.0 v2:172.21.15.18:6833/1824357592 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x556fbe47ffa0 con 0x556fbe5d9150 2024-09-19T09:15:40.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.731+0000 7ff06a7fc640 10 client.5724 handle_command_reply: tid=0 2024-09-19T09:15:40.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.731+0000 7ff094862740 1 client.5724 shutdown 2024-09-19T09:15:40.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.731+0000 7ff094862740 1 -- 172.21.15.18:0/3046147013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556fbe514ba0 msgr2=0x556fbe57de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:40.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.731+0000 7ff094862740 1 --2- 172.21.15.18:0/3046147013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556fbe514ba0 0x556fbe57de70 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff07c049040 tx=0x7ff07c004ab0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.731+0000 7ff094862740 1 -- 172.21.15.18:0/3046147013 shutdown_connections 2024-09-19T09:15:40.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.731+0000 7ff094862740 1 --2- 172.21.15.18:0/3046147013 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x556fbe517a50 0x556fbe57e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.731+0000 7ff094862740 1 --2- 172.21.15.18:0/3046147013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x556fbe5162c0 0x556fbe57e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.731+0000 7ff094862740 1 --2- 172.21.15.18:0/3046147013 >> [v2:172.21.15.18:6833/1824357592,v1:172.21.15.18:6835/1824357592] conn(0x556fbe5d9150 0x556fbe5d9530 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.731+0000 7ff094862740 1 --2- 172.21.15.18:0/3046147013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x556fbe514ba0 0x556fbe57de70 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.731+0000 7ff06a7fc640 0 client.5724 ms_handle_reset on v2:172.21.15.18:6833/1824357592 2024-09-19T09:15:40.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.731+0000 7ff094862740 1 -- 172.21.15.18:0/3046147013 >> 172.21.15.18:0/3046147013 conn(0x556fbe513a80 msgr2=0x556fbe55ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:40.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.731+0000 7ff094862740 1 -- 172.21.15.18:0/3046147013 shutdown_connections 2024-09-19T09:15:40.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.731+0000 7ff094862740 1 -- 172.21.15.18:0/3046147013 wait complete. 2024-09-19T09:15:40.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.732+0000 7ff094862740 20 client.5724 trim_cache size 0 max 16384 2024-09-19T09:15:40.753 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:15:40.753 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:15:40.754 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-09-19T09:15:40.754 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 5574, 2024-09-19T09:15:40.754 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-19T09:15:40.754 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-19T09:15:40.754 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-19T09:15:40.754 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 9.0810358509999993, 2024-09-19T09:15:40.754 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 28, 2024-09-19T09:15:40.754 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 70, 2024-09-19T09:15:40.755 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 70, 2024-09-19T09:15:40.755 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 13.985894451 2024-09-19T09:15:40.755 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:15:40.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.732+0000 7ff0919e8640 1 -- 172.21.15.18:0/2301831262 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff06c06c2b0 msgr2=0x7ff06c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:40.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.732+0000 7ff0919e8640 1 --2- 172.21.15.18:0/2301831262 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff06c06c2b0 0x7ff06c06e770 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff07c034000 tx=0x7ff07c033040 comp rx=0 tx=0).stop 2024-09-19T09:15:40.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.732+0000 7ff0919e8640 1 -- 172.21.15.18:0/2301831262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff08c1622d0 msgr2=0x7ff08c1e7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:40.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.732+0000 7ff0919e8640 1 --2- 172.21.15.18:0/2301831262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff08c1622d0 0x7ff08c1e7df0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff08400e930 tx=0x7ff08400edf0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.732+0000 7ff0919e8640 1 -- 172.21.15.18:0/2301831262 shutdown_connections 2024-09-19T09:15:40.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.732+0000 7ff0919e8640 1 --2- 172.21.15.18:0/2301831262 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff06c06c2b0 0x7ff06c06e770 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.732+0000 7ff0919e8640 1 --2- 172.21.15.18:0/2301831262 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff08c1622d0 0x7ff08c1e7df0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.732+0000 7ff0919e8640 1 --2- 172.21.15.18:0/2301831262 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff08c0cfd20 0x7ff08c1f7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.732+0000 7ff0919e8640 1 --2- 172.21.15.18:0/2301831262 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff08c0b8430 0x7ff08c1f79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.732+0000 7ff0919e8640 1 -- 172.21.15.18:0/2301831262 >> 172.21.15.18:0/2301831262 conn(0x7ff08c0d4c60 msgr2=0x7ff08c0d0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:40.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.732+0000 7ff0919e8640 1 -- 172.21.15.18:0/2301831262 shutdown_connections 2024-09-19T09:15:40.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.732+0000 7ff0919e8640 1 -- 172.21.15.18:0/2301831262 wait complete. 2024-09-19T09:15:40.758 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T09:15:40.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.860+0000 7f618a14b640 1 Processor -- start 2024-09-19T09:15:40.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.860+0000 7f618a14b640 1 -- start start 2024-09-19T09:15:40.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.861+0000 7f618a14b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f61840cf560 0x7f61840cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:40.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.861+0000 7f618a14b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f61840cfe80 0x7f61840b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:40.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.861+0000 7f618a14b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61840d0e10 con 0x7f61840b3210 2024-09-19T09:15:40.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.861+0000 7f618a14b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f61840d0310 con 0x7f61840cf560 2024-09-19T09:15:40.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.861+0000 7f618a14b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f61840d0850 con 0x7f61840cfe80 2024-09-19T09:15:40.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.861+0000 7f61837fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f61840cf560 0x7f61840cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:40.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.861+0000 7f6183fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f61840b3210 0x7f61840b3620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50676/0 (socket says 172.21.15.18:50676) 2024-09-19T09:15:40.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.861+0000 7f6183fff640 1 -- 172.21.15.18:0/2469140364 learned_addr learned my addr 172.21.15.18:0/2469140364 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:15:40.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.861+0000 7f6182ffd640 1 --2- 172.21.15.18:0/2469140364 >> v2:172.21.15.162:3300/0 conn(0x7f61840cfe80 0x7f61840b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:40.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.861+0000 7f61837fe640 1 -- 172.21.15.18:0/2469140364 >> v2:172.21.15.162:3300/0 conn(0x7f61840cfe80 msgr2=0x7f61840b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:40.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.861+0000 7f61837fe640 1 --2- 172.21.15.18:0/2469140364 >> v2:172.21.15.162:3300/0 conn(0x7f61840cfe80 0x7f61840b2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.861+0000 7f61837fe640 1 -- 172.21.15.18:0/2469140364 >> v1:172.21.15.18:6789/0 conn(0x7f61840b3210 legacy=0x7f61840b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:40.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.861+0000 7f61837fe640 1 -- 172.21.15.18:0/2469140364 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61840d0b30 con 0x7f61840cf560 2024-09-19T09:15:40.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.861+0000 7f61827fc640 1 -- 172.21.15.18:0/2469140364 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3974009597 0 0) 0x7f61840d0e10 con 0x7f61840b3210 2024-09-19T09:15:40.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.862+0000 7f61837fe640 1 --2- 172.21.15.18:0/2469140364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61840cf560 0x7f61840cf940 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f61840b52b0 tx=0x7f617402a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24812ebca86ae39 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:40.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.862+0000 7f61827fc640 1 -- 172.21.15.18:0/2469140364 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6174037070 con 0x7f61840cf560 2024-09-19T09:15:40.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.862+0000 7f61827fc640 1 -- 172.21.15.18:0/2469140364 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f617402add0 con 0x7f61840cf560 2024-09-19T09:15:40.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.862+0000 7f61827fc640 1 -- 172.21.15.18:0/2469140364 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6174032660 con 0x7f61840cf560 2024-09-19T09:15:40.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.863+0000 7f618a14b640 1 -- 172.21.15.18:0/2469140364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61840cf560 msgr2=0x7f61840cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:40.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.863+0000 7f618a14b640 1 --2- 172.21.15.18:0/2469140364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61840cf560 0x7f61840cf940 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f61840b52b0 tx=0x7f617402a080 comp rx=0 tx=0).stop 2024-09-19T09:15:40.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.863+0000 7f618a14b640 1 -- 172.21.15.18:0/2469140364 shutdown_connections 2024-09-19T09:15:40.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.863+0000 7f618a14b640 1 --2- 172.21.15.18:0/2469140364 >> v2:172.21.15.162:3300/0 conn(0x7f61840cfe80 0x7f61840b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.863+0000 7f618a14b640 1 --2- 172.21.15.18:0/2469140364 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61840cf560 0x7f61840cf940 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.863+0000 7f618a14b640 1 -- 172.21.15.18:0/2469140364 >> 172.21.15.18:0/2469140364 conn(0x7f61840b4700 msgr2=0x7f61840b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:40.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.863+0000 7f618a14b640 1 -- 172.21.15.18:0/2469140364 shutdown_connections 2024-09-19T09:15:40.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.863+0000 7f618a14b640 1 -- 172.21.15.18:0/2469140364 wait complete. 2024-09-19T09:15:40.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.864+0000 7f618a14b640 1 Processor -- start 2024-09-19T09:15:40.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.864+0000 7f618a14b640 1 -- start start 2024-09-19T09:15:40.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.865+0000 7f618a14b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61840b3210 0x7f61840c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:40.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.865+0000 7f618a14b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61840cf560 0x7f61841552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:40.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.865+0000 7f618a14b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61840cfe80 0x7f61840ce060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:40.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.865+0000 7f618a14b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f61840b5420 con 0x7f61840b3210 2024-09-19T09:15:40.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.865+0000 7f618a14b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f61840b27b0 con 0x7f61840cf560 2024-09-19T09:15:40.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.865+0000 7f618a14b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f61840b55a0 con 0x7f61840cfe80 2024-09-19T09:15:40.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.865+0000 7f61837fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61840b3210 0x7f61840c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:40.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.865+0000 7f61837fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61840b3210 0x7f61840c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42342/0 (socket says 172.21.15.18:42342) 2024-09-19T09:15:40.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.865+0000 7f61837fe640 1 -- 172.21.15.18:0/1517212469 learned_addr learned my addr 172.21.15.18:0/1517212469 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:40.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.865+0000 7f61837fe640 1 -- 172.21.15.18:0/1517212469 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61840cfe80 msgr2=0x7f61840ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:40.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.865+0000 7f61837fe640 1 --2- 172.21.15.18:0/1517212469 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61840cfe80 0x7f61840ce060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.865+0000 7f61837fe640 1 -- 172.21.15.18:0/1517212469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61840cf560 msgr2=0x7f61841552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:40.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.865+0000 7f61837fe640 1 --2- 172.21.15.18:0/1517212469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61840cf560 0x7f61841552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:40.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.865+0000 7f61837fe640 1 -- 172.21.15.18:0/1517212469 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6184155b90 con 0x7f61840b3210 2024-09-19T09:15:40.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.866+0000 7f61837fe640 1 --2- 172.21.15.18:0/1517212469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61840b3210 0x7f61840c9c20 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6174000c00 tx=0x7f61740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:40.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.866+0000 7f616bfff640 1 -- 172.21.15.18:0/1517212469 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6174037040 con 0x7f61840b3210 2024-09-19T09:15:40.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.866+0000 7f616bfff640 1 -- 172.21.15.18:0/1517212469 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6174042070 con 0x7f61840b3210 2024-09-19T09:15:40.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.866+0000 7f618a14b640 1 -- 172.21.15.18:0/1517212469 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f618415a720 con 0x7f61840b3210 2024-09-19T09:15:40.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.866+0000 7f616bfff640 1 -- 172.21.15.18:0/1517212469 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617403b870 con 0x7f61840b3210 2024-09-19T09:15:40.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.866+0000 7f618a14b640 1 -- 172.21.15.18:0/1517212469 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6184155e30 con 0x7f61840b3210 2024-09-19T09:15:40.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.867+0000 7f618a14b640 1 -- 172.21.15.18:0/1517212469 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6184050050 con 0x7f61840b3210 2024-09-19T09:15:40.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.867+0000 7f616bfff640 1 -- 172.21.15.18:0/1517212469 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f617402ac90 con 0x7f61840b3210 2024-09-19T09:15:40.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.868+0000 7f616bfff640 1 --2- 172.21.15.18:0/1517212469 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f617006c2b0 0x7f617006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:40.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.868+0000 7f616bfff640 1 -- 172.21.15.18:0/1517212469 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7f61740ab9f0 con 0x7f61840b3210 2024-09-19T09:15:40.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.868+0000 7f6182ffd640 1 --2- 172.21.15.18:0/1517212469 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f617006c2b0 0x7f617006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:40.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.869+0000 7f6182ffd640 1 --2- 172.21.15.18:0/1517212469 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f617006c2b0 0x7f617006e770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6178006fd0 tx=0x7f6178008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:40.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:40.872+0000 7f616bfff640 1 -- 172.21.15.18:0/1517212469 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6184050050 con 0x7f61840b3210 2024-09-19T09:15:41.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.081+0000 7f618a14b640 1 -- 172.21.15.18:0/1517212469 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f618415d090 con 0x7f61840b3210 2024-09-19T09:15:41.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.082+0000 7f616bfff640 1 -- 172.21.15.18:0/1517212469 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+73 (secure 0 0 0) 0x7f617407a310 con 0x7f61840b3210 2024-09-19T09:15:41.083 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T09:15:41.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.084+0000 7f618a14b640 1 -- 172.21.15.18:0/1517212469 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f617006c2b0 msgr2=0x7f617006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:41.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.084+0000 7f618a14b640 1 --2- 172.21.15.18:0/1517212469 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f617006c2b0 0x7f617006e770 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6178006fd0 tx=0x7f6178008040 comp rx=0 tx=0).stop 2024-09-19T09:15:41.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.084+0000 7f618a14b640 1 -- 172.21.15.18:0/1517212469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61840b3210 msgr2=0x7f61840c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:41.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.084+0000 7f618a14b640 1 --2- 172.21.15.18:0/1517212469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61840b3210 0x7f61840c9c20 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f6174000c00 tx=0x7f61740046c0 comp rx=0 tx=0).stop 2024-09-19T09:15:41.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.084+0000 7f618a14b640 1 -- 172.21.15.18:0/1517212469 shutdown_connections 2024-09-19T09:15:41.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.084+0000 7f618a14b640 1 --2- 172.21.15.18:0/1517212469 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f617006c2b0 0x7f617006e770 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:41.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.084+0000 7f618a14b640 1 --2- 172.21.15.18:0/1517212469 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61840cfe80 0x7f61840ce060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:41.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.084+0000 7f618a14b640 1 --2- 172.21.15.18:0/1517212469 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61840cf560 0x7f61841552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:41.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.084+0000 7f618a14b640 1 --2- 172.21.15.18:0/1517212469 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61840b3210 0x7f61840c9c20 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:41.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.084+0000 7f618a14b640 1 -- 172.21.15.18:0/1517212469 >> 172.21.15.18:0/1517212469 conn(0x7f61840b4700 msgr2=0x7f61840d2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:41.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.084+0000 7f618a14b640 1 -- 172.21.15.18:0/1517212469 shutdown_connections 2024-09-19T09:15:41.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.084+0000 7f618a14b640 1 -- 172.21.15.18:0/1517212469 wait complete. 2024-09-19T09:15:41.095 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-19T09:15:41.095 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:15:41.095 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-09-19T09:15:41.095 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T09:15:41.095 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:15:41.095 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-19T09:15:41.096 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-19T09:15:41.096 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:15:41.096 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:15:41.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:15:41.096 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-09-19T09:15:41.112 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:15:41.112 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:15:41.113 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:15:41.113 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:15:41.113 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-09-19T09:15:41.113 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:15:41.113 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:15:41.113 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:15:41.113 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-09-19T09:15:41.113 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:15:41.113 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:15:41.113 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-09-19T09:15:41.114 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:15:41.114 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:15:41.114 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-09-19T09:15:41.114 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T09:15:41.114 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42656sec preferred_lft 42656sec 2024-09-19T09:15:41.114 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-09-19T09:15:41.114 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:15:41.114 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:15:41.114 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:15:41.114 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-09-19T09:15:41.114 INFO:teuthology.orchestra.run.smithi018.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T09:15:41.115 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:44:1b:02:86:87 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:15:41.115 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T09:15:41.115 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:15:41.115 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::a0ce:faff:feaa:13ec/64 scope link 2024-09-19T09:15:41.115 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:15:41.115 INFO:teuthology.orchestra.run.smithi018.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:15:41.115 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:44:1b:02:86:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:15:41.115 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::44:1bff:fe02:8687/64 scope link 2024-09-19T09:15:41.115 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:15:41.115 INFO:teuthology.orchestra.run.smithi018.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:15:41.115 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether e2:6d:c4:af:6a:8b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T09:15:41.116 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::e06d:c4ff:feaf:6a8b/64 scope link 2024-09-19T09:15:41.116 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:15:41.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:15:41.116 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:15:41.176 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-09-19T09:15:41.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:15:41.178 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-09-19T09:15:41.235 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-09-19T09:15:41.235 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:15:41.235 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T09:15:41.235 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T09:15:41.235 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:15:41.236 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:15:41.236 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T09:15:41.236 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T09:15:41.236 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T09:15:41.236 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T09:15:41.236 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T09:15:41.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:15:41.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:15:41.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:15:41.364 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-19T09:15:41.380 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-19T09:15:41.381 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T09:15:41.381 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:15:41.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:15:41.381 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-09-19T09:15:41.447 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:15:41.448 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T09:15:41.503 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:15:41.503 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:15:41.503 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:15:41.559 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-19T09:15:41.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:15:41.559 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:15:41.644 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:15:41.644 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:15:41.644 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:15:41.653 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:15:41.653 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:15:41.653 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:15:41.653 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:15:41.653 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:15:41.659 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:15:41.659 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:15:41.659 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:15:41.659 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:15:41.659 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:15:41.660 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-19T09:15:41.660 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-19T09:15:41.660 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fec66d7e-50e5-42ed-81de-ad141a2f0f4e" will pass to kernel 2024-09-19T09:15:41.663 INFO:teuthology.orchestra.run.smithi018.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-19T09:15:41.663 INFO:teuthology.orchestra.run.smithi018.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:15:41.663 INFO:teuthology.orchestra.run.smithi018.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:15:41.663 INFO:teuthology.orchestra.run.smithi018.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:15:41.663 INFO:teuthology.orchestra.run.smithi018.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:15:41.663 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:15:41.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:15:41.663 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:15:41.694 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:15:41.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:15:41.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:15:41.792 INFO:teuthology.orchestra.run.smithi018.stdout:client5512 2024-09-19T09:15:41.792 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:15:41.792 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:15:41.808 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T09:15:41.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.950+0000 7fa12ad3a640 1 Processor -- start 2024-09-19T09:15:41.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.950+0000 7fa12ad3a640 1 -- start start 2024-09-19T09:15:41.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.951+0000 7fa12ad3a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa124145290 0x7fa12406f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:41.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.951+0000 7fa12ad3a640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa12406e3d0 con 0x7fa124072f40 2024-09-19T09:15:41.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.951+0000 7fa12ad3a640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa12406e6b0 con 0x7fa1240ce780 2024-09-19T09:15:41.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.951+0000 7fa12ad3a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa12406efe0 con 0x7fa124145290 2024-09-19T09:15:41.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.951+0000 7fa1292d7640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa124072f40 0x7fa1240b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50678/0 (socket says 172.21.15.18:50678) 2024-09-19T09:15:41.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.951+0000 7fa1292d7640 1 -- 172.21.15.18:0/733539491 learned_addr learned my addr 172.21.15.18:0/733539491 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:15:41.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.951+0000 7fa128ad6640 1 --2- 172.21.15.18:0/733539491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa124145290 0x7fa12406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:41.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.951+0000 7fa1237fe640 1 -- 172.21.15.18:0/733539491 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 382715037 0 0) 0x7fa12406e3d0 con 0x7fa124072f40 2024-09-19T09:15:41.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.951+0000 7fa1237fe640 1 -- 172.21.15.18:0/733539491 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa110003520 con 0x7fa124072f40 2024-09-19T09:15:41.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.952+0000 7fa1237fe640 1 -- 172.21.15.18:0/733539491 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2773207068 0 0) 0x7fa12406e6b0 con 0x7fa1240ce780 2024-09-19T09:15:41.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.952+0000 7fa1237fe640 1 -- 172.21.15.18:0/733539491 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa12406e3d0 con 0x7fa1240ce780 2024-09-19T09:15:41.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.952+0000 7fa1237fe640 1 -- 172.21.15.18:0/733539491 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2322476689 0 0) 0x7fa110003520 con 0x7fa124072f40 2024-09-19T09:15:41.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.952+0000 7fa1237fe640 1 -- 172.21.15.18:0/733539491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa124145290 msgr2=0x7fa12406f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:41.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.952+0000 7fa1237fe640 1 --2- 172.21.15.18:0/733539491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa124145290 0x7fa12406f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:41.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.952+0000 7fa1237fe640 1 -- 172.21.15.18:0/733539491 >> v1:172.21.15.162:6789/0 conn(0x7fa1240ce780 legacy=0x7fa124072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:41.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.952+0000 7fa1237fe640 1 -- 172.21.15.18:0/733539491 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa12406e990 con 0x7fa124072f40 2024-09-19T09:15:41.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.952+0000 7fa1237fe640 1 -- 172.21.15.18:0/733539491 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fa11c001670 con 0x7fa124072f40 2024-09-19T09:15:41.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.952+0000 7fa1237fe640 1 -- 172.21.15.18:0/733539491 >> v1:172.21.15.18:6789/0 conn(0x7fa124072f40 legacy=0x7fa1240b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:41.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.952+0000 7fa1237fe640 1 --2- 172.21.15.18:0/733539491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa124145290 0x7fa110003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:41.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.952+0000 7fa1237fe640 1 --2- 172.21.15.18:0/733539491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1100040d0 0x7fa110004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:41.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.952+0000 7fa1237fe640 1 --2- 172.21.15.18:0/733539491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa110004d40 0x7fa1100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:41.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.952+0000 7fa1237fe640 1 -- 172.21.15.18:0/733539491 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa12406efe0 con 0x7fa1100040d0 2024-09-19T09:15:41.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.952+0000 7fa1237fe640 1 -- 172.21.15.18:0/733539491 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa11000baa0 con 0x7fa110004d40 2024-09-19T09:15:41.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.952+0000 7fa1237fe640 1 -- 172.21.15.18:0/733539491 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa11000bca0 con 0x7fa124145290 2024-09-19T09:15:41.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.952+0000 7fa123fff640 1 --2- 172.21.15.18:0/733539491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1100040d0 0x7fa110004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:41.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.952+0000 7fa128ad6640 1 --2- 172.21.15.18:0/733539491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa124145290 0x7fa110003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:41.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.952+0000 7fa1292d7640 1 --2- 172.21.15.18:0/733539491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa110004d40 0x7fa1100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:41.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.952+0000 7fa123fff640 1 -- 172.21.15.18:0/733539491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa124145290 msgr2=0x7fa110003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:41.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.952+0000 7fa123fff640 1 --2- 172.21.15.18:0/733539491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa124145290 0x7fa110003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:41.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.952+0000 7fa123fff640 1 -- 172.21.15.18:0/733539491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa110004d40 msgr2=0x7fa1100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:41.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.952+0000 7fa123fff640 1 --2- 172.21.15.18:0/733539491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa110004d40 0x7fa1100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:41.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.952+0000 7fa123fff640 1 -- 172.21.15.18:0/733539491 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa110003520 con 0x7fa1100040d0 2024-09-19T09:15:41.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.952+0000 7fa1292d7640 1 --2- 172.21.15.18:0/733539491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa110004d40 0x7fa1100051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:41.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.953+0000 7fa123fff640 1 --2- 172.21.15.18:0/733539491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1100040d0 0x7fa110004800 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa10c0018a0 tx=0x7fa110005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9fa51d85a403e0a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:41.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.953+0000 7fa1237fe640 1 -- 172.21.15.18:0/733539491 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c0014f0 con 0x7fa1100040d0 2024-09-19T09:15:41.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.953+0000 7fa1237fe640 1 -- 172.21.15.18:0/733539491 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa10c0052d0 con 0x7fa1100040d0 2024-09-19T09:15:41.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.953+0000 7fa1237fe640 1 -- 172.21.15.18:0/733539491 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c02ac60 con 0x7fa1100040d0 2024-09-19T09:15:41.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.954+0000 7fa12ad3a640 1 -- 172.21.15.18:0/733539491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1100040d0 msgr2=0x7fa110004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:41.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.954+0000 7fa12ad3a640 1 --2- 172.21.15.18:0/733539491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1100040d0 0x7fa110004800 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fa10c0018a0 tx=0x7fa110005830 comp rx=0 tx=0).stop 2024-09-19T09:15:41.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.954+0000 7fa1292d7640 1 -- 172.21.15.18:0/733539491 reap_dead start 2024-09-19T09:15:41.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.954+0000 7fa12ad3a640 1 -- 172.21.15.18:0/733539491 shutdown_connections 2024-09-19T09:15:41.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.954+0000 7fa12ad3a640 1 -- 172.21.15.18:0/733539491 >> 172.21.15.18:0/733539491 conn(0x7fa12406bc10 msgr2=0x7fa12406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:41.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.954+0000 7fa12ad3a640 1 -- 172.21.15.18:0/733539491 shutdown_connections 2024-09-19T09:15:41.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.954+0000 7fa12ad3a640 1 -- 172.21.15.18:0/733539491 wait complete. 2024-09-19T09:15:41.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.955+0000 7fa12ad3a640 1 Processor -- start 2024-09-19T09:15:41.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.955+0000 7fa12ad3a640 1 -- start start 2024-09-19T09:15:41.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.956+0000 7fa12ad3a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1100040d0 0x7fa12415b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:41.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.956+0000 7fa12ad3a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1241380d0 0x7fa124138550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:41.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.956+0000 7fa12ad3a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1241f0550 0x7fa1241f09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:41.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.956+0000 7fa12ad3a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa12406df80 con 0x7fa1241380d0 2024-09-19T09:15:41.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.956+0000 7fa12ad3a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa124145670 con 0x7fa1100040d0 2024-09-19T09:15:41.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.956+0000 7fa12ad3a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa12406e100 con 0x7fa1241f0550 2024-09-19T09:15:41.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.956+0000 7fa123fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1241380d0 0x7fa124138550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:41.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.956+0000 7fa123fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1241380d0 0x7fa124138550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42366/0 (socket says 172.21.15.18:42366) 2024-09-19T09:15:41.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.956+0000 7fa123fff640 1 -- 172.21.15.18:0/2422741953 learned_addr learned my addr 172.21.15.18:0/2422741953 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:41.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.956+0000 7fa1292d7640 1 --2- 172.21.15.18:0/2422741953 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1241f0550 0x7fa1241f09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:41.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.956+0000 7fa128ad6640 1 --2- 172.21.15.18:0/2422741953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1100040d0 0x7fa12415b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:41.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.956+0000 7fa123fff640 1 -- 172.21.15.18:0/2422741953 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1241f0550 msgr2=0x7fa1241f09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:41.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.956+0000 7fa123fff640 1 --2- 172.21.15.18:0/2422741953 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1241f0550 0x7fa1241f09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:41.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.956+0000 7fa123fff640 1 -- 172.21.15.18:0/2422741953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1100040d0 msgr2=0x7fa12415b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:41.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.956+0000 7fa123fff640 1 --2- 172.21.15.18:0/2422741953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1100040d0 0x7fa12415b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:41.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.956+0000 7fa123fff640 1 -- 172.21.15.18:0/2422741953 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1241f1160 con 0x7fa1241380d0 2024-09-19T09:15:41.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.957+0000 7fa123fff640 1 --2- 172.21.15.18:0/2422741953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1241380d0 0x7fa124138550 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa10c005040 tx=0x7fa10c0012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:41.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.957+0000 7fa1217fa640 1 -- 172.21.15.18:0/2422741953 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c040020 con 0x7fa1241380d0 2024-09-19T09:15:41.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.957+0000 7fa1217fa640 1 -- 172.21.15.18:0/2422741953 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa10c005480 con 0x7fa1241380d0 2024-09-19T09:15:41.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.957+0000 7fa12ad3a640 1 -- 172.21.15.18:0/2422741953 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1241f1440 con 0x7fa1241380d0 2024-09-19T09:15:41.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.957+0000 7fa1217fa640 1 -- 172.21.15.18:0/2422741953 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10c0014f0 con 0x7fa1241380d0 2024-09-19T09:15:41.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.957+0000 7fa12ad3a640 1 -- 172.21.15.18:0/2422741953 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1241f1a00 con 0x7fa1241380d0 2024-09-19T09:15:41.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.958+0000 7fa12ad3a640 1 -- 172.21.15.18:0/2422741953 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1240715a0 con 0x7fa1241380d0 2024-09-19T09:15:41.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.958+0000 7fa1217fa640 1 -- 172.21.15.18:0/2422741953 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa10c043020 con 0x7fa1241380d0 2024-09-19T09:15:41.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.959+0000 7fa1217fa640 1 --2- 172.21.15.18:0/2422741953 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa10406c2b0 0x7fa10406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:41.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.959+0000 7fa1217fa640 1 -- 172.21.15.18:0/2422741953 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7fa10c0ab4e0 con 0x7fa1241380d0 2024-09-19T09:15:41.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.959+0000 7fa128ad6640 1 --2- 172.21.15.18:0/2422741953 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa10406c2b0 0x7fa10406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:41.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.959+0000 7fa128ad6640 1 --2- 172.21.15.18:0/2422741953 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa10406c2b0 0x7fa10406e770 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa114014430 tx=0x7fa11400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:41.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:41.963+0000 7fa1217fa640 1 -- 172.21.15.18:0/2422741953 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa10c04a030 con 0x7fa1241380d0 2024-09-19T09:15:42.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:42.175+0000 7fa12ad3a640 1 -- 172.21.15.18:0/2422741953 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa1240b2290 con 0x7fa1241380d0 2024-09-19T09:15:42.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:42.176+0000 7fa1217fa640 1 -- 172.21.15.18:0/2422741953 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+73 (secure 0 0 0) 0x7fa10c079600 con 0x7fa1241380d0 2024-09-19T09:15:42.176 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T09:15:42.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:42.178+0000 7fa12ad3a640 1 -- 172.21.15.18:0/2422741953 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa10406c2b0 msgr2=0x7fa10406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:42.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:42.178+0000 7fa12ad3a640 1 --2- 172.21.15.18:0/2422741953 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa10406c2b0 0x7fa10406e770 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa114014430 tx=0x7fa11400b040 comp rx=0 tx=0).stop 2024-09-19T09:15:42.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:42.178+0000 7fa12ad3a640 1 -- 172.21.15.18:0/2422741953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1241380d0 msgr2=0x7fa124138550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:42.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:42.178+0000 7fa12ad3a640 1 --2- 172.21.15.18:0/2422741953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1241380d0 0x7fa124138550 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fa10c005040 tx=0x7fa10c0012d0 comp rx=0 tx=0).stop 2024-09-19T09:15:42.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:42.178+0000 7fa12ad3a640 1 -- 172.21.15.18:0/2422741953 shutdown_connections 2024-09-19T09:15:42.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:42.178+0000 7fa12ad3a640 1 --2- 172.21.15.18:0/2422741953 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa10406c2b0 0x7fa10406e770 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:42.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:42.178+0000 7fa12ad3a640 1 --2- 172.21.15.18:0/2422741953 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1241f0550 0x7fa1241f09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:42.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:42.178+0000 7fa12ad3a640 1 --2- 172.21.15.18:0/2422741953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1241380d0 0x7fa124138550 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:42.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:42.178+0000 7fa12ad3a640 1 --2- 172.21.15.18:0/2422741953 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1100040d0 0x7fa12415b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:42.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:42.178+0000 7fa12ad3a640 1 -- 172.21.15.18:0/2422741953 >> 172.21.15.18:0/2422741953 conn(0x7fa12406bc10 msgr2=0x7fa1240b5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:42.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:42.178+0000 7fa12ad3a640 1 -- 172.21.15.18:0/2422741953 shutdown_connections 2024-09-19T09:15:42.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:42.178+0000 7fa12ad3a640 1 -- 172.21.15.18:0/2422741953 wait complete. 2024-09-19T09:15:42.189 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-19T09:15:42.189 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:15:42.189 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-09-19T09:15:42.189 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-19T09:15:42.189 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-19T09:15:42.190 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-19T09:15:42.190 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-19T09:15:42.190 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:15:42.190 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:15:42.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:15:42.190 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-09-19T09:15:42.210 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:15:42.210 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:15:42.210 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:15:42.210 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:15:42.211 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-09-19T09:15:42.211 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:15:42.211 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:15:42.211 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:15:42.211 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-09-19T09:15:42.211 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:15:42.211 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:15:42.211 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-09-19T09:15:42.211 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:15:42.211 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:15:42.212 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:15:42.212 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:15:42.212 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T09:15:42.212 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42666sec preferred_lft 42666sec 2024-09-19T09:15:42.212 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link noprefixroute 2024-09-19T09:15:42.212 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:15:42.212 INFO:teuthology.orchestra.run.smithi162.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T09:15:42.212 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 5e:4d:7e:1d:19:f9 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:15:42.212 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T09:15:42.212 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:15:42.212 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::5829:65ff:fe01:6bc7/64 scope link 2024-09-19T09:15:42.213 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:15:42.213 INFO:teuthology.orchestra.run.smithi162.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:15:42.213 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 86:86:3e:32:67:c5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T09:15:42.213 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::8486:3eff:fe32:67c5/64 scope link 2024-09-19T09:15:42.213 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:15:42.213 INFO:teuthology.orchestra.run.smithi162.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:15:42.213 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 5e:4d:7e:1d:19:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-19T09:15:42.213 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::5c4d:7eff:fe1d:19f9/64 scope link 2024-09-19T09:15:42.213 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:15:42.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:15:42.214 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:15:42.279 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-09-19T09:15:42.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:15:42.280 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-09-19T09:15:42.339 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-09-19T09:15:42.339 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:15:42.339 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T09:15:42.339 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T09:15:42.339 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:15:42.340 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:15:42.340 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-19T09:15:42.340 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T09:15:42.340 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T09:15:42.340 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T09:15:42.340 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-19T09:15:42.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:15:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:15:42.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:15:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:15:42.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:15:42.472 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-19T09:15:42.490 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-19T09:15:42.490 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-19T09:15:42.491 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:15:42.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:15:42.491 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2024-09-19T09:15:42.555 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:15:42.555 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-19T09:15:42.610 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:15:42.611 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:15:42.611 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-19T09:15:42.666 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-19T09:15:42.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:15:42.666 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:15:42.750 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:15:42.751 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:15:42.751 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:15:42.759 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:15:42.760 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:15:42.760 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:15:42.760 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:15:42.760 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:15:42.764 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:15:42.764 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:15:42.764 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:15:42.764 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:15:42.764 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:15:42.764 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-19T09:15:42.764 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-19T09:15:42.764 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=fec66d7e-50e5-42ed-81de-ad141a2f0f4e" will pass to kernel 2024-09-19T09:15:42.765 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-19T09:15:42.765 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:15:42.765 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:15:42.765 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:15:42.765 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:15:42.766 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:15:42.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:15:42.767 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-19T09:15:42.832 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:15:42.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:15:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:15:42.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:15:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:15:42.928 INFO:teuthology.orchestra.run.smithi162.stdout:client5132 2024-09-19T09:15:42.929 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:15:42.929 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:15:42.944 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:15:43.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.058+0000 7fcc35c0a640 1 Processor -- start 2024-09-19T09:15:43.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.058+0000 7fcc35c0a640 1 -- start start 2024-09-19T09:15:43.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.058+0000 7fcc35c0a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcc3015ef50 0x7fcc300d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:43.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.058+0000 7fcc35c0a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcc300b9510 0x7fcc300d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:43.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.058+0000 7fcc35c0a640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc300b7a90 con 0x7fcc300d3240 2024-09-19T09:15:43.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.058+0000 7fcc35c0a640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fcc300d3740 con 0x7fcc300b9510 2024-09-19T09:15:43.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.058+0000 7fcc35c0a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fcc300d3a20 con 0x7fcc3015ef50 2024-09-19T09:15:43.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.059+0000 7fcc2ffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcc300b9510 0x7fcc300d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:43.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.059+0000 7fcc2effd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fcc300d3240 0x7fcc300cf770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50686/0 (socket says 172.21.15.18:50686) 2024-09-19T09:15:43.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.059+0000 7fcc2effd640 1 -- 172.21.15.18:0/2517958091 learned_addr learned my addr 172.21.15.18:0/2517958091 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:15:43.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.059+0000 7fcc2ffff640 1 --2- 172.21.15.18:0/2517958091 >> v2:172.21.15.18:3300/0 conn(0x7fcc300b9510 0x7fcc300d18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42368/0 (socket says 172.21.15.18:42368) 2024-09-19T09:15:43.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.059+0000 7fcc2f7fe640 1 --2- 172.21.15.18:0/2517958091 >> v2:172.21.15.162:3300/0 conn(0x7fcc3015ef50 0x7fcc300d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:43.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.059+0000 7fcc2ffff640 1 -- 172.21.15.18:0/2517958091 >> v2:172.21.15.162:3300/0 conn(0x7fcc3015ef50 msgr2=0x7fcc300d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:15:43.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.059+0000 7fcc2ffff640 1 --2- 172.21.15.18:0/2517958091 >> v2:172.21.15.162:3300/0 conn(0x7fcc3015ef50 0x7fcc300d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:43.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.059+0000 7fcc2ffff640 1 -- 172.21.15.18:0/2517958091 >> v1:172.21.15.18:6789/0 conn(0x7fcc300d3240 legacy=0x7fcc300cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:43.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.059+0000 7fcc2ffff640 1 -- 172.21.15.18:0/2517958091 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc300b7d00 con 0x7fcc300b9510 2024-09-19T09:15:43.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.059+0000 7fcc2e7fc640 1 -- 172.21.15.18:0/2517958091 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3885245011 0 0) 0x7fcc300b7a90 con 0x7fcc300d3240 2024-09-19T09:15:43.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.059+0000 7fcc2f7fe640 1 --2- 172.21.15.18:0/2517958091 >> v2:172.21.15.162:3300/0 conn(0x7fcc3015ef50 0x7fcc300d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:43.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.060+0000 7fcc2ffff640 1 --2- 172.21.15.18:0/2517958091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc300b9510 0x7fcc300d18e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fcc300b7850 tx=0x7fcc2802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daf0bb147955027e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:43.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.060+0000 7fcc2e7fc640 1 -- 172.21.15.18:0/2517958091 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28007740 con 0x7fcc300b9510 2024-09-19T09:15:43.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.060+0000 7fcc2e7fc640 1 -- 172.21.15.18:0/2517958091 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc280078e0 con 0x7fcc300b9510 2024-09-19T09:15:43.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.060+0000 7fcc2e7fc640 1 -- 172.21.15.18:0/2517958091 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28007cb0 con 0x7fcc300b9510 2024-09-19T09:15:43.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.060+0000 7fcc35c0a640 1 -- 172.21.15.18:0/2517958091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc300b9510 msgr2=0x7fcc300d18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:43.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.060+0000 7fcc35c0a640 1 --2- 172.21.15.18:0/2517958091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc300b9510 0x7fcc300d18e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fcc300b7850 tx=0x7fcc2802a5f0 comp rx=0 tx=0).stop 2024-09-19T09:15:43.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.060+0000 7fcc35c0a640 1 -- 172.21.15.18:0/2517958091 shutdown_connections 2024-09-19T09:15:43.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.060+0000 7fcc35c0a640 1 --2- 172.21.15.18:0/2517958091 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc300b9510 0x7fcc300d18e0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:43.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.061+0000 7fcc35c0a640 1 --2- 172.21.15.18:0/2517958091 >> v2:172.21.15.162:3300/0 conn(0x7fcc3015ef50 0x7fcc300d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:43.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.061+0000 7fcc35c0a640 1 -- 172.21.15.18:0/2517958091 >> 172.21.15.18:0/2517958091 conn(0x7fcc300d4c60 msgr2=0x7fcc300d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:43.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.061+0000 7fcc35c0a640 1 -- 172.21.15.18:0/2517958091 shutdown_connections 2024-09-19T09:15:43.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.061+0000 7fcc35c0a640 1 -- 172.21.15.18:0/2517958091 wait complete. 2024-09-19T09:15:43.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.062+0000 7fcc35c0a640 1 Processor -- start 2024-09-19T09:15:43.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.062+0000 7fcc35c0a640 1 -- start start 2024-09-19T09:15:43.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.063+0000 7fcc35c0a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc300b9510 0x7fcc300cae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:43.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.063+0000 7fcc35c0a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc300d3240 0x7fcc300b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:43.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.063+0000 7fcc35c0a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc3015ef50 0x7fcc301520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:43.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.063+0000 7fcc35c0a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcc300d21a0 con 0x7fcc300b9510 2024-09-19T09:15:43.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.063+0000 7fcc35c0a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcc300d2020 con 0x7fcc3015ef50 2024-09-19T09:15:43.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.063+0000 7fcc35c0a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcc300d5780 con 0x7fcc300d3240 2024-09-19T09:15:43.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.063+0000 7fcc2f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc300b9510 0x7fcc300cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:43.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.063+0000 7fcc2f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc300b9510 0x7fcc300cae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:42378/0 (socket says 172.21.15.18:42378) 2024-09-19T09:15:43.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.063+0000 7fcc2f7fe640 1 -- 172.21.15.18:0/193303308 learned_addr learned my addr 172.21.15.18:0/193303308 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:15:43.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.063+0000 7fcc2ffff640 1 --2- 172.21.15.18:0/193303308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc3015ef50 0x7fcc301520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:43.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.063+0000 7fcc2effd640 1 --2- 172.21.15.18:0/193303308 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc300d3240 0x7fcc300b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:43.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.063+0000 7fcc2f7fe640 1 -- 172.21.15.18:0/193303308 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc300d3240 msgr2=0x7fcc300b2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:43.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.063+0000 7fcc2f7fe640 1 --2- 172.21.15.18:0/193303308 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc300d3240 0x7fcc300b2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:43.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.063+0000 7fcc2f7fe640 1 -- 172.21.15.18:0/193303308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc3015ef50 msgr2=0x7fcc301520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:43.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.063+0000 7fcc2f7fe640 1 --2- 172.21.15.18:0/193303308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc3015ef50 0x7fcc301520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:43.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.063+0000 7fcc2f7fe640 1 -- 172.21.15.18:0/193303308 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc300b3320 con 0x7fcc300b9510 2024-09-19T09:15:43.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.063+0000 7fcc2ffff640 1 --2- 172.21.15.18:0/193303308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc3015ef50 0x7fcc301520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:43.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.063+0000 7fcc2effd640 1 --2- 172.21.15.18:0/193303308 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc300d3240 0x7fcc300b2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:15:43.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.063+0000 7fcc2f7fe640 1 --2- 172.21.15.18:0/193303308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc300b9510 0x7fcc300cae90 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000d7d0 tx=0x7fcc2000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:43.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.063+0000 7fcc17fff640 1 -- 172.21.15.18:0/193303308 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc20004030 con 0x7fcc300b9510 2024-09-19T09:15:43.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.063+0000 7fcc17fff640 1 -- 172.21.15.18:0/193303308 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc200041d0 con 0x7fcc300b9510 2024-09-19T09:15:43.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.063+0000 7fcc35c0a640 1 -- 172.21.15.18:0/193303308 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc300b35c0 con 0x7fcc300b9510 2024-09-19T09:15:43.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.063+0000 7fcc17fff640 1 -- 172.21.15.18:0/193303308 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc200096a0 con 0x7fcc300b9510 2024-09-19T09:15:43.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.064+0000 7fcc35c0a640 1 -- 172.21.15.18:0/193303308 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc300b3b80 con 0x7fcc300b9510 2024-09-19T09:15:43.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.064+0000 7fcc35c0a640 1 -- 172.21.15.18:0/193303308 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc300d13a0 con 0x7fcc300b9510 2024-09-19T09:15:43.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.065+0000 7fcc17fff640 1 -- 172.21.15.18:0/193303308 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcc20009840 con 0x7fcc300b9510 2024-09-19T09:15:43.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.066+0000 7fcc17fff640 1 --2- 172.21.15.18:0/193303308 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcc1c06c2b0 0x7fcc1c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:15:43.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.066+0000 7fcc17fff640 1 -- 172.21.15.18:0/193303308 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5709+0+0 (secure 0 0 0) 0x7fcc2008b630 con 0x7fcc300b9510 2024-09-19T09:15:43.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.066+0000 7fcc2effd640 1 --2- 172.21.15.18:0/193303308 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcc1c06c2b0 0x7fcc1c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:15:43.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.066+0000 7fcc2effd640 1 --2- 172.21.15.18:0/193303308 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcc1c06c2b0 0x7fcc1c06e770 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcc300b4920 tx=0x7fcc24007c10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:15:43.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.070+0000 7fcc17fff640 1 -- 172.21.15.18:0/193303308 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fcc20059e30 con 0x7fcc300b9510 2024-09-19T09:15:43.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.280+0000 7fcc35c0a640 1 -- 172.21.15.18:0/193303308 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc300cf9f0 con 0x7fcc300b9510 2024-09-19T09:15:43.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.280+0000 7fcc17fff640 1 -- 172.21.15.18:0/193303308 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5229 (secure 0 0 0) 0x7fcc20059730 con 0x7fcc300b9510 2024-09-19T09:15:43.281 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:15:43.281 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:15:33:667104+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3337833568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3337833568},{"type":"v1","addr":"172.21.15.162:6837","nonce":3337833568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1692924872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1692924872},{"type":"v1","addr":"172.21.15.162:6836","nonce":1692924872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5377,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2351287916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2351287916},{"type":"v1","addr":"172.21.15.18:6834","nonce":2351287916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:15:31.000055+0000","modified":"2024-09-19T09:15:33.010750+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5574},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5574":{"gid":5574,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/1824357592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1824357592},{"type":"v1","addr":"172.21.15.18:6835","nonce":1824357592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5574,"qdb_cluster":[5574]},"id":4}]} 2024-09-19T09:15:43.281 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:15:43.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.282+0000 7fcc35c0a640 1 -- 172.21.15.18:0/193303308 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcc1c06c2b0 msgr2=0x7fcc1c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:43.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.282+0000 7fcc35c0a640 1 --2- 172.21.15.18:0/193303308 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcc1c06c2b0 0x7fcc1c06e770 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fcc300b4920 tx=0x7fcc24007c10 comp rx=0 tx=0).stop 2024-09-19T09:15:43.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.282+0000 7fcc35c0a640 1 -- 172.21.15.18:0/193303308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc300b9510 msgr2=0x7fcc300cae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:15:43.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.282+0000 7fcc35c0a640 1 --2- 172.21.15.18:0/193303308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc300b9510 0x7fcc300cae90 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000d7d0 tx=0x7fcc2000dc90 comp rx=0 tx=0).stop 2024-09-19T09:15:43.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.282+0000 7fcc35c0a640 1 -- 172.21.15.18:0/193303308 shutdown_connections 2024-09-19T09:15:43.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.282+0000 7fcc35c0a640 1 --2- 172.21.15.18:0/193303308 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcc1c06c2b0 0x7fcc1c06e770 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:43.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.282+0000 7fcc35c0a640 1 --2- 172.21.15.18:0/193303308 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc3015ef50 0x7fcc301520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:43.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.282+0000 7fcc35c0a640 1 --2- 172.21.15.18:0/193303308 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc300d3240 0x7fcc300b2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:43.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.282+0000 7fcc35c0a640 1 --2- 172.21.15.18:0/193303308 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc300b9510 0x7fcc300cae90 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:15:43.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.282+0000 7fcc35c0a640 1 -- 172.21.15.18:0/193303308 >> 172.21.15.18:0/193303308 conn(0x7fcc300d4c60 msgr2=0x7fcc300b98f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:15:43.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.282+0000 7fcc35c0a640 1 -- 172.21.15.18:0/193303308 shutdown_connections 2024-09-19T09:15:43.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:15:43.282+0000 7fcc35c0a640 1 -- 172.21.15.18:0/193303308 wait complete. 2024-09-19T09:15:43.295 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-19T09:15:43.416 INFO:teuthology.orchestra.run.smithi018.stdout:{"cluster_fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","whoami":0,"id":5574,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":11.756144092,"mdsmap_epoch":28,"osdmap_epoch":70,"osdmap_epoch_barrier":70,"uptime":16.661009327999999} 2024-09-19T09:15:43.416 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", "fs_name": "cephfs", "id": 5574, "mdsmap_epoch": 28, "osdmap_epoch": 70, "osdmap_epoch_barrier": 70, "rank_uptime": 11.756144092, "state": "up:active", "uptime": 16.661009328, "want_state": "up:active", "whoami": 0 } 2024-09-19T09:15:43.417 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-19T09:15:43.531 INFO:teuthology.orchestra.run.smithi018.stdout:{"osd_mon_report_interval":"5"} 2024-09-19T09:15:43.531 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-19T09:15:43.532 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2024-09-19T09:15:43.639 INFO:teuthology.orchestra.run.smithi018.stdout:{"mon_tick_interval":"5"} 2024-09-19T09:15:43.640 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2024-09-19T09:15:43.640 INFO:tasks.cephfs.test_full:pool capacity 557057600, 531MB should be enough to fill it 2024-09-19T09:15:43.640 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-09-19T09:15:43.640 DEBUG:teuthology.orchestra.run.smithi018:> import time 2024-09-19T09:15:43.640 DEBUG:teuthology.orchestra.run.smithi018:> import datetime 2024-09-19T09:15:43.640 DEBUG:teuthology.orchestra.run.smithi018:> import subprocess 2024-09-19T09:15:43.641 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-09-19T09:15:43.641 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:15:43.641 DEBUG:teuthology.orchestra.run.smithi018:> # Write some buffered data through before going full, all should be well 2024-09-19T09:15:43.641 DEBUG:teuthology.orchestra.run.smithi018:> print("writing some data through which we expect to succeed") 2024-09-19T09:15:43.641 DEBUG:teuthology.orchestra.run.smithi018:> bytes = 0 2024-09-19T09:15:43.641 DEBUG:teuthology.orchestra.run.smithi018:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2024-09-19T09:15:43.641 DEBUG:teuthology.orchestra.run.smithi018:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2024-09-19T09:15:43.641 DEBUG:teuthology.orchestra.run.smithi018:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2024-09-19T09:15:43.641 DEBUG:teuthology.orchestra.run.smithi018:> os.fsync(f) 2024-09-19T09:15:43.641 DEBUG:teuthology.orchestra.run.smithi018:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2024-09-19T09:15:43.641 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:15:43.641 DEBUG:teuthology.orchestra.run.smithi018:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2024-09-19T09:15:43.642 DEBUG:teuthology.orchestra.run.smithi018:> # writing until we see an error from fsync. As long as we'"'"'re doing 2024-09-19T09:15:43.642 DEBUG:teuthology.orchestra.run.smithi018:> # buffered IO, the error should always only appear from fsync and not 2024-09-19T09:15:43.642 DEBUG:teuthology.orchestra.run.smithi018:> # from write 2024-09-19T09:15:43.642 DEBUG:teuthology.orchestra.run.smithi018:> full = False 2024-09-19T09:15:43.642 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:15:43.642 DEBUG:teuthology.orchestra.run.smithi018:> for n in range(0, int(531 * 0.9)): 2024-09-19T09:15:43.642 DEBUG:teuthology.orchestra.run.smithi018:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-19T09:15:43.642 DEBUG:teuthology.orchestra.run.smithi018:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2024-09-19T09:15:43.642 DEBUG:teuthology.orchestra.run.smithi018:> print("done writing {0} bytes".format(bytes)) 2024-09-19T09:15:43.642 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:15:43.642 DEBUG:teuthology.orchestra.run.smithi018:> # OK, now we should sneak in under the full condition 2024-09-19T09:15:43.642 DEBUG:teuthology.orchestra.run.smithi018:> # due to the time it takes the OSDs to report to the 2024-09-19T09:15:43.642 DEBUG:teuthology.orchestra.run.smithi018:> # mons, and get a successful fsync on our full-making data 2024-09-19T09:15:43.642 DEBUG:teuthology.orchestra.run.smithi018:> os.fsync(f) 2024-09-19T09:15:43.643 DEBUG:teuthology.orchestra.run.smithi018:> print("successfully fsync'"'"'ed prior to getting full state reported") 2024-09-19T09:15:43.643 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:15:43.643 DEBUG:teuthology.orchestra.run.smithi018:> # buffered write, add more dirty data to the buffer 2024-09-19T09:15:43.643 DEBUG:teuthology.orchestra.run.smithi018:> print("starting buffered write") 2024-09-19T09:15:43.643 DEBUG:teuthology.orchestra.run.smithi018:> try: 2024-09-19T09:15:43.643 DEBUG:teuthology.orchestra.run.smithi018:> for n in range(0, int(531 * 0.2)): 2024-09-19T09:15:43.643 DEBUG:teuthology.orchestra.run.smithi018:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-19T09:15:43.643 DEBUG:teuthology.orchestra.run.smithi018:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2024-09-19T09:15:43.643 DEBUG:teuthology.orchestra.run.smithi018:> time.sleep(15.0) 2024-09-19T09:15:43.643 DEBUG:teuthology.orchestra.run.smithi018:> except OSError: 2024-09-19T09:15:43.643 DEBUG:teuthology.orchestra.run.smithi018:> pass; 2024-09-19T09:15:43.643 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:15:43.643 DEBUG:teuthology.orchestra.run.smithi018:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2024-09-19T09:15:43.644 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:15:43.644 DEBUG:teuthology.orchestra.run.smithi018:> # Wait long enough for a background flush that should fail 2024-09-19T09:15:43.644 DEBUG:teuthology.orchestra.run.smithi018:> time.sleep(30) 2024-09-19T09:15:43.644 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:15:43.644 DEBUG:teuthology.orchestra.run.smithi018:> if False: 2024-09-19T09:15:43.644 DEBUG:teuthology.orchestra.run.smithi018:> # ...and check that the failed background flush is reflected in fclose 2024-09-19T09:15:43.644 DEBUG:teuthology.orchestra.run.smithi018:> try: 2024-09-19T09:15:43.644 DEBUG:teuthology.orchestra.run.smithi018:> os.close(f) 2024-09-19T09:15:43.644 DEBUG:teuthology.orchestra.run.smithi018:> except OSError: 2024-09-19T09:15:43.644 DEBUG:teuthology.orchestra.run.smithi018:> print("close() returned an error as expected") 2024-09-19T09:15:43.644 DEBUG:teuthology.orchestra.run.smithi018:> else: 2024-09-19T09:15:43.644 DEBUG:teuthology.orchestra.run.smithi018:> raise RuntimeError("close() failed to raise error") 2024-09-19T09:15:43.644 DEBUG:teuthology.orchestra.run.smithi018:> else: 2024-09-19T09:15:43.645 DEBUG:teuthology.orchestra.run.smithi018:> # The kernel cephfs client does not raise errors on fclose 2024-09-19T09:15:43.645 DEBUG:teuthology.orchestra.run.smithi018:> os.close(f) 2024-09-19T09:15:43.645 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:15:43.645 DEBUG:teuthology.orchestra.run.smithi018:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2024-09-19T09:15:43.645 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-09-19T09:15:46.823 INFO:teuthology.orchestra.run.smithi018.stdout:writing some data through which we expect to succeed 2024-09-19T09:15:46.824 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed data successfully, will now attempt to fill fs 2024-09-19T09:15:46.824 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 1572864 bytes via buffered write, may repeat 2024-09-19T09:15:46.824 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 2621440 bytes via buffered write, may repeat 2024-09-19T09:15:46.824 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 3670016 bytes via buffered write, may repeat 2024-09-19T09:15:46.824 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 4718592 bytes via buffered write, may repeat 2024-09-19T09:15:46.824 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 5767168 bytes via buffered write, may repeat 2024-09-19T09:15:46.824 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 6815744 bytes via buffered write, may repeat 2024-09-19T09:15:46.824 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 7864320 bytes via buffered write, may repeat 2024-09-19T09:15:46.824 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 8912896 bytes via buffered write, may repeat 2024-09-19T09:15:46.824 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 9961472 bytes via buffered write, may repeat 2024-09-19T09:15:46.825 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 11010048 bytes via buffered write, may repeat 2024-09-19T09:15:46.825 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 12058624 bytes via buffered write, may repeat 2024-09-19T09:15:46.825 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 13107200 bytes via buffered write, may repeat 2024-09-19T09:15:46.825 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 14155776 bytes via buffered write, may repeat 2024-09-19T09:15:46.825 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 15204352 bytes via buffered write, may repeat 2024-09-19T09:15:46.825 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 16252928 bytes via buffered write, may repeat 2024-09-19T09:15:46.825 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 17301504 bytes via buffered write, may repeat 2024-09-19T09:15:46.825 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 18350080 bytes via buffered write, may repeat 2024-09-19T09:15:46.825 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 19398656 bytes via buffered write, may repeat 2024-09-19T09:15:46.825 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 20447232 bytes via buffered write, may repeat 2024-09-19T09:15:46.825 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 21495808 bytes via buffered write, may repeat 2024-09-19T09:15:46.825 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 22544384 bytes via buffered write, may repeat 2024-09-19T09:15:46.825 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 23592960 bytes via buffered write, may repeat 2024-09-19T09:15:46.825 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 24641536 bytes via buffered write, may repeat 2024-09-19T09:15:46.826 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 25690112 bytes via buffered write, may repeat 2024-09-19T09:15:46.826 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 26738688 bytes via buffered write, may repeat 2024-09-19T09:15:46.826 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 27787264 bytes via buffered write, may repeat 2024-09-19T09:15:46.826 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 28835840 bytes via buffered write, may repeat 2024-09-19T09:15:46.826 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 29884416 bytes via buffered write, may repeat 2024-09-19T09:15:46.826 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 30932992 bytes via buffered write, may repeat 2024-09-19T09:15:46.826 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 31981568 bytes via buffered write, may repeat 2024-09-19T09:15:46.826 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 33030144 bytes via buffered write, may repeat 2024-09-19T09:15:46.826 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 34078720 bytes via buffered write, may repeat 2024-09-19T09:15:46.826 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 35127296 bytes via buffered write, may repeat 2024-09-19T09:15:46.826 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 36175872 bytes via buffered write, may repeat 2024-09-19T09:15:46.826 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 37224448 bytes via buffered write, may repeat 2024-09-19T09:15:46.826 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 38273024 bytes via buffered write, may repeat 2024-09-19T09:15:46.827 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 39321600 bytes via buffered write, may repeat 2024-09-19T09:15:46.827 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 40370176 bytes via buffered write, may repeat 2024-09-19T09:15:46.827 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 41418752 bytes via buffered write, may repeat 2024-09-19T09:15:46.827 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 42467328 bytes via buffered write, may repeat 2024-09-19T09:15:46.827 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 43515904 bytes via buffered write, may repeat 2024-09-19T09:15:46.827 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 44564480 bytes via buffered write, may repeat 2024-09-19T09:15:46.827 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 45613056 bytes via buffered write, may repeat 2024-09-19T09:15:46.827 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 46661632 bytes via buffered write, may repeat 2024-09-19T09:15:46.827 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 47710208 bytes via buffered write, may repeat 2024-09-19T09:15:46.827 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 48758784 bytes via buffered write, may repeat 2024-09-19T09:15:46.827 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 49807360 bytes via buffered write, may repeat 2024-09-19T09:15:46.827 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 50855936 bytes via buffered write, may repeat 2024-09-19T09:15:46.827 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 51904512 bytes via buffered write, may repeat 2024-09-19T09:15:46.827 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 52953088 bytes via buffered write, may repeat 2024-09-19T09:15:46.827 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 54001664 bytes via buffered write, may repeat 2024-09-19T09:15:46.828 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 55050240 bytes via buffered write, may repeat 2024-09-19T09:15:46.828 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 56098816 bytes via buffered write, may repeat 2024-09-19T09:15:46.828 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 57147392 bytes via buffered write, may repeat 2024-09-19T09:15:46.828 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 58195968 bytes via buffered write, may repeat 2024-09-19T09:15:46.828 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 59244544 bytes via buffered write, may repeat 2024-09-19T09:15:46.828 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 60293120 bytes via buffered write, may repeat 2024-09-19T09:15:46.828 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 61341696 bytes via buffered write, may repeat 2024-09-19T09:15:46.828 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 62390272 bytes via buffered write, may repeat 2024-09-19T09:15:46.828 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 63438848 bytes via buffered write, may repeat 2024-09-19T09:15:46.828 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 64487424 bytes via buffered write, may repeat 2024-09-19T09:15:46.828 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 65536000 bytes via buffered write, may repeat 2024-09-19T09:15:46.828 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 66584576 bytes via buffered write, may repeat 2024-09-19T09:15:46.828 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 67633152 bytes via buffered write, may repeat 2024-09-19T09:15:46.829 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 68681728 bytes via buffered write, may repeat 2024-09-19T09:15:46.829 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 69730304 bytes via buffered write, may repeat 2024-09-19T09:15:46.829 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 70778880 bytes via buffered write, may repeat 2024-09-19T09:15:46.829 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 71827456 bytes via buffered write, may repeat 2024-09-19T09:15:46.829 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 72876032 bytes via buffered write, may repeat 2024-09-19T09:15:46.829 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 73924608 bytes via buffered write, may repeat 2024-09-19T09:15:46.829 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 74973184 bytes via buffered write, may repeat 2024-09-19T09:15:46.829 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 76021760 bytes via buffered write, may repeat 2024-09-19T09:15:46.829 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 77070336 bytes via buffered write, may repeat 2024-09-19T09:15:46.829 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 78118912 bytes via buffered write, may repeat 2024-09-19T09:15:46.829 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 79167488 bytes via buffered write, may repeat 2024-09-19T09:15:46.829 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 80216064 bytes via buffered write, may repeat 2024-09-19T09:15:46.829 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 81264640 bytes via buffered write, may repeat 2024-09-19T09:15:46.829 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 82313216 bytes via buffered write, may repeat 2024-09-19T09:15:46.830 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 83361792 bytes via buffered write, may repeat 2024-09-19T09:15:46.830 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 84410368 bytes via buffered write, may repeat 2024-09-19T09:15:46.830 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 85458944 bytes via buffered write, may repeat 2024-09-19T09:15:46.830 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 86507520 bytes via buffered write, may repeat 2024-09-19T09:15:46.830 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 87556096 bytes via buffered write, may repeat 2024-09-19T09:15:46.830 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 88604672 bytes via buffered write, may repeat 2024-09-19T09:15:46.830 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 89653248 bytes via buffered write, may repeat 2024-09-19T09:15:46.830 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 90701824 bytes via buffered write, may repeat 2024-09-19T09:15:46.830 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 91750400 bytes via buffered write, may repeat 2024-09-19T09:15:46.830 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 92798976 bytes via buffered write, may repeat 2024-09-19T09:15:46.830 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 93847552 bytes via buffered write, may repeat 2024-09-19T09:15:46.830 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 94896128 bytes via buffered write, may repeat 2024-09-19T09:15:46.830 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 95944704 bytes via buffered write, may repeat 2024-09-19T09:15:46.831 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 96993280 bytes via buffered write, may repeat 2024-09-19T09:15:46.831 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 98041856 bytes via buffered write, may repeat 2024-09-19T09:15:46.831 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 99090432 bytes via buffered write, may repeat 2024-09-19T09:15:46.831 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 100139008 bytes via buffered write, may repeat 2024-09-19T09:15:46.831 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 101187584 bytes via buffered write, may repeat 2024-09-19T09:15:46.831 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 102236160 bytes via buffered write, may repeat 2024-09-19T09:15:46.831 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 103284736 bytes via buffered write, may repeat 2024-09-19T09:15:46.831 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 104333312 bytes via buffered write, may repeat 2024-09-19T09:15:46.831 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 105381888 bytes via buffered write, may repeat 2024-09-19T09:15:46.831 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 106430464 bytes via buffered write, may repeat 2024-09-19T09:15:46.831 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 107479040 bytes via buffered write, may repeat 2024-09-19T09:15:46.831 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 108527616 bytes via buffered write, may repeat 2024-09-19T09:15:46.831 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 109576192 bytes via buffered write, may repeat 2024-09-19T09:15:46.831 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 110624768 bytes via buffered write, may repeat 2024-09-19T09:15:46.831 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 111673344 bytes via buffered write, may repeat 2024-09-19T09:15:46.832 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 112721920 bytes via buffered write, may repeat 2024-09-19T09:15:46.832 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 113770496 bytes via buffered write, may repeat 2024-09-19T09:15:46.832 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 114819072 bytes via buffered write, may repeat 2024-09-19T09:15:46.832 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 115867648 bytes via buffered write, may repeat 2024-09-19T09:15:46.832 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 116916224 bytes via buffered write, may repeat 2024-09-19T09:15:46.832 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 117964800 bytes via buffered write, may repeat 2024-09-19T09:15:46.832 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 119013376 bytes via buffered write, may repeat 2024-09-19T09:15:46.832 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 120061952 bytes via buffered write, may repeat 2024-09-19T09:15:46.832 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 121110528 bytes via buffered write, may repeat 2024-09-19T09:15:46.832 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 122159104 bytes via buffered write, may repeat 2024-09-19T09:15:46.832 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 123207680 bytes via buffered write, may repeat 2024-09-19T09:15:46.832 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 124256256 bytes via buffered write, may repeat 2024-09-19T09:15:46.832 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 125304832 bytes via buffered write, may repeat 2024-09-19T09:15:46.833 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 126353408 bytes via buffered write, may repeat 2024-09-19T09:15:46.833 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 127401984 bytes via buffered write, may repeat 2024-09-19T09:15:46.833 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 128450560 bytes via buffered write, may repeat 2024-09-19T09:15:46.833 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 129499136 bytes via buffered write, may repeat 2024-09-19T09:15:46.833 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 130547712 bytes via buffered write, may repeat 2024-09-19T09:15:46.833 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 131596288 bytes via buffered write, may repeat 2024-09-19T09:15:46.833 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 132644864 bytes via buffered write, may repeat 2024-09-19T09:15:46.833 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 133693440 bytes via buffered write, may repeat 2024-09-19T09:15:46.833 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 134742016 bytes via buffered write, may repeat 2024-09-19T09:15:46.833 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 135790592 bytes via buffered write, may repeat 2024-09-19T09:15:46.833 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 136839168 bytes via buffered write, may repeat 2024-09-19T09:15:46.833 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 137887744 bytes via buffered write, may repeat 2024-09-19T09:15:46.833 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 138936320 bytes via buffered write, may repeat 2024-09-19T09:15:46.833 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 139984896 bytes via buffered write, may repeat 2024-09-19T09:15:46.834 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 141033472 bytes via buffered write, may repeat 2024-09-19T09:15:46.834 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 142082048 bytes via buffered write, may repeat 2024-09-19T09:15:46.834 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 143130624 bytes via buffered write, may repeat 2024-09-19T09:15:46.834 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 144179200 bytes via buffered write, may repeat 2024-09-19T09:15:46.834 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 145227776 bytes via buffered write, may repeat 2024-09-19T09:15:46.834 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 146276352 bytes via buffered write, may repeat 2024-09-19T09:15:46.834 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 147324928 bytes via buffered write, may repeat 2024-09-19T09:15:46.834 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 148373504 bytes via buffered write, may repeat 2024-09-19T09:15:46.834 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 149422080 bytes via buffered write, may repeat 2024-09-19T09:15:46.834 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 150470656 bytes via buffered write, may repeat 2024-09-19T09:15:46.834 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 151519232 bytes via buffered write, may repeat 2024-09-19T09:15:46.834 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 152567808 bytes via buffered write, may repeat 2024-09-19T09:15:46.834 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 153616384 bytes via buffered write, may repeat 2024-09-19T09:15:46.834 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 154664960 bytes via buffered write, may repeat 2024-09-19T09:15:46.835 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 155713536 bytes via buffered write, may repeat 2024-09-19T09:15:46.835 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 156762112 bytes via buffered write, may repeat 2024-09-19T09:15:46.835 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 157810688 bytes via buffered write, may repeat 2024-09-19T09:15:46.835 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 158859264 bytes via buffered write, may repeat 2024-09-19T09:15:46.835 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 159907840 bytes via buffered write, may repeat 2024-09-19T09:15:46.835 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 160956416 bytes via buffered write, may repeat 2024-09-19T09:15:46.835 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 162004992 bytes via buffered write, may repeat 2024-09-19T09:15:46.877 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 163053568 bytes via buffered write, may repeat 2024-09-19T09:15:46.877 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 164102144 bytes via buffered write, may repeat 2024-09-19T09:15:46.877 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 165150720 bytes via buffered write, may repeat 2024-09-19T09:15:46.878 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 166199296 bytes via buffered write, may repeat 2024-09-19T09:15:46.878 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 167247872 bytes via buffered write, may repeat 2024-09-19T09:15:46.878 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 168296448 bytes via buffered write, may repeat 2024-09-19T09:15:46.878 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 169345024 bytes via buffered write, may repeat 2024-09-19T09:15:46.878 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 170393600 bytes via buffered write, may repeat 2024-09-19T09:15:46.878 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 171442176 bytes via buffered write, may repeat 2024-09-19T09:15:46.878 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 172490752 bytes via buffered write, may repeat 2024-09-19T09:15:46.878 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 173539328 bytes via buffered write, may repeat 2024-09-19T09:15:46.878 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 174587904 bytes via buffered write, may repeat 2024-09-19T09:15:46.878 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 175636480 bytes via buffered write, may repeat 2024-09-19T09:15:46.878 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 176685056 bytes via buffered write, may repeat 2024-09-19T09:15:46.878 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 177733632 bytes via buffered write, may repeat 2024-09-19T09:15:46.878 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 178782208 bytes via buffered write, may repeat 2024-09-19T09:15:46.879 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 179830784 bytes via buffered write, may repeat 2024-09-19T09:15:46.879 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 180879360 bytes via buffered write, may repeat 2024-09-19T09:15:46.879 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 181927936 bytes via buffered write, may repeat 2024-09-19T09:15:46.879 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 182976512 bytes via buffered write, may repeat 2024-09-19T09:15:46.879 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 184025088 bytes via buffered write, may repeat 2024-09-19T09:15:46.879 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 185073664 bytes via buffered write, may repeat 2024-09-19T09:15:46.879 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 186122240 bytes via buffered write, may repeat 2024-09-19T09:15:46.879 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 187170816 bytes via buffered write, may repeat 2024-09-19T09:15:46.879 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 188219392 bytes via buffered write, may repeat 2024-09-19T09:15:46.879 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 189267968 bytes via buffered write, may repeat 2024-09-19T09:15:46.879 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 190316544 bytes via buffered write, may repeat 2024-09-19T09:15:46.879 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 191365120 bytes via buffered write, may repeat 2024-09-19T09:15:46.879 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 192413696 bytes via buffered write, may repeat 2024-09-19T09:15:46.879 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 193462272 bytes via buffered write, may repeat 2024-09-19T09:15:46.880 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 194510848 bytes via buffered write, may repeat 2024-09-19T09:15:46.880 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 195559424 bytes via buffered write, may repeat 2024-09-19T09:15:46.880 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 196608000 bytes via buffered write, may repeat 2024-09-19T09:15:46.880 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 197656576 bytes via buffered write, may repeat 2024-09-19T09:15:46.880 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 198705152 bytes via buffered write, may repeat 2024-09-19T09:15:46.880 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 199753728 bytes via buffered write, may repeat 2024-09-19T09:15:46.880 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 200802304 bytes via buffered write, may repeat 2024-09-19T09:15:46.880 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 201850880 bytes via buffered write, may repeat 2024-09-19T09:15:46.880 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 202899456 bytes via buffered write, may repeat 2024-09-19T09:15:46.880 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 203948032 bytes via buffered write, may repeat 2024-09-19T09:15:46.880 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 204996608 bytes via buffered write, may repeat 2024-09-19T09:15:46.880 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 206045184 bytes via buffered write, may repeat 2024-09-19T09:15:46.880 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 207093760 bytes via buffered write, may repeat 2024-09-19T09:15:46.881 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 208142336 bytes via buffered write, may repeat 2024-09-19T09:15:46.881 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 209190912 bytes via buffered write, may repeat 2024-09-19T09:15:46.881 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 210239488 bytes via buffered write, may repeat 2024-09-19T09:15:46.881 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 211288064 bytes via buffered write, may repeat 2024-09-19T09:15:46.881 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 212336640 bytes via buffered write, may repeat 2024-09-19T09:15:46.881 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 213385216 bytes via buffered write, may repeat 2024-09-19T09:15:46.881 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 214433792 bytes via buffered write, may repeat 2024-09-19T09:15:46.881 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 215482368 bytes via buffered write, may repeat 2024-09-19T09:15:46.881 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 216530944 bytes via buffered write, may repeat 2024-09-19T09:15:46.881 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 217579520 bytes via buffered write, may repeat 2024-09-19T09:15:46.881 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 218628096 bytes via buffered write, may repeat 2024-09-19T09:15:46.881 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 219676672 bytes via buffered write, may repeat 2024-09-19T09:15:46.881 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 220725248 bytes via buffered write, may repeat 2024-09-19T09:15:46.882 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 221773824 bytes via buffered write, may repeat 2024-09-19T09:15:46.882 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 222822400 bytes via buffered write, may repeat 2024-09-19T09:15:46.882 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 223870976 bytes via buffered write, may repeat 2024-09-19T09:15:46.882 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 224919552 bytes via buffered write, may repeat 2024-09-19T09:15:46.882 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 225968128 bytes via buffered write, may repeat 2024-09-19T09:15:46.882 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 227016704 bytes via buffered write, may repeat 2024-09-19T09:15:46.882 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 228065280 bytes via buffered write, may repeat 2024-09-19T09:15:46.882 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 229113856 bytes via buffered write, may repeat 2024-09-19T09:15:46.882 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 230162432 bytes via buffered write, may repeat 2024-09-19T09:15:46.882 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 231211008 bytes via buffered write, may repeat 2024-09-19T09:15:46.882 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 232259584 bytes via buffered write, may repeat 2024-09-19T09:15:46.882 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 233308160 bytes via buffered write, may repeat 2024-09-19T09:15:46.882 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 234356736 bytes via buffered write, may repeat 2024-09-19T09:15:46.882 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 235405312 bytes via buffered write, may repeat 2024-09-19T09:15:46.882 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 236453888 bytes via buffered write, may repeat 2024-09-19T09:15:46.883 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 237502464 bytes via buffered write, may repeat 2024-09-19T09:15:46.883 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 238551040 bytes via buffered write, may repeat 2024-09-19T09:15:46.883 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 239599616 bytes via buffered write, may repeat 2024-09-19T09:15:46.883 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 240648192 bytes via buffered write, may repeat 2024-09-19T09:15:46.883 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 241696768 bytes via buffered write, may repeat 2024-09-19T09:15:46.883 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 242745344 bytes via buffered write, may repeat 2024-09-19T09:15:46.883 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 243793920 bytes via buffered write, may repeat 2024-09-19T09:15:46.883 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 244842496 bytes via buffered write, may repeat 2024-09-19T09:15:46.883 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 245891072 bytes via buffered write, may repeat 2024-09-19T09:15:46.883 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 246939648 bytes via buffered write, may repeat 2024-09-19T09:15:46.884 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 247988224 bytes via buffered write, may repeat 2024-09-19T09:15:46.884 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 249036800 bytes via buffered write, may repeat 2024-09-19T09:15:46.884 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 250085376 bytes via buffered write, may repeat 2024-09-19T09:15:46.884 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 251133952 bytes via buffered write, may repeat 2024-09-19T09:15:46.884 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 252182528 bytes via buffered write, may repeat 2024-09-19T09:15:46.884 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 253231104 bytes via buffered write, may repeat 2024-09-19T09:15:46.884 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 254279680 bytes via buffered write, may repeat 2024-09-19T09:15:46.884 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 255328256 bytes via buffered write, may repeat 2024-09-19T09:15:46.884 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 256376832 bytes via buffered write, may repeat 2024-09-19T09:15:46.884 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 257425408 bytes via buffered write, may repeat 2024-09-19T09:15:46.884 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 258473984 bytes via buffered write, may repeat 2024-09-19T09:15:46.884 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 259522560 bytes via buffered write, may repeat 2024-09-19T09:15:46.884 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 260571136 bytes via buffered write, may repeat 2024-09-19T09:15:46.884 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 261619712 bytes via buffered write, may repeat 2024-09-19T09:15:46.885 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 262668288 bytes via buffered write, may repeat 2024-09-19T09:15:46.885 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 263716864 bytes via buffered write, may repeat 2024-09-19T09:15:46.885 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 264765440 bytes via buffered write, may repeat 2024-09-19T09:15:46.885 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 265814016 bytes via buffered write, may repeat 2024-09-19T09:15:46.885 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 266862592 bytes via buffered write, may repeat 2024-09-19T09:15:46.885 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 267911168 bytes via buffered write, may repeat 2024-09-19T09:15:46.885 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 268959744 bytes via buffered write, may repeat 2024-09-19T09:15:46.885 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 270008320 bytes via buffered write, may repeat 2024-09-19T09:15:46.885 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 271056896 bytes via buffered write, may repeat 2024-09-19T09:15:46.885 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 272105472 bytes via buffered write, may repeat 2024-09-19T09:15:46.885 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 273154048 bytes via buffered write, may repeat 2024-09-19T09:15:46.885 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 274202624 bytes via buffered write, may repeat 2024-09-19T09:15:46.885 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 275251200 bytes via buffered write, may repeat 2024-09-19T09:15:46.885 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 276299776 bytes via buffered write, may repeat 2024-09-19T09:15:46.886 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 277348352 bytes via buffered write, may repeat 2024-09-19T09:15:46.886 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 278396928 bytes via buffered write, may repeat 2024-09-19T09:15:46.886 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 279445504 bytes via buffered write, may repeat 2024-09-19T09:15:46.886 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 280494080 bytes via buffered write, may repeat 2024-09-19T09:15:46.886 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 281542656 bytes via buffered write, may repeat 2024-09-19T09:15:46.886 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 282591232 bytes via buffered write, may repeat 2024-09-19T09:15:46.886 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 283639808 bytes via buffered write, may repeat 2024-09-19T09:15:46.886 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 284688384 bytes via buffered write, may repeat 2024-09-19T09:15:46.886 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 285736960 bytes via buffered write, may repeat 2024-09-19T09:15:46.886 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 286785536 bytes via buffered write, may repeat 2024-09-19T09:15:46.886 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 287834112 bytes via buffered write, may repeat 2024-09-19T09:15:46.886 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 288882688 bytes via buffered write, may repeat 2024-09-19T09:15:46.886 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 289931264 bytes via buffered write, may repeat 2024-09-19T09:15:46.886 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 290979840 bytes via buffered write, may repeat 2024-09-19T09:15:46.887 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 292028416 bytes via buffered write, may repeat 2024-09-19T09:15:46.887 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 293076992 bytes via buffered write, may repeat 2024-09-19T09:15:46.887 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 294125568 bytes via buffered write, may repeat 2024-09-19T09:15:46.887 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 295174144 bytes via buffered write, may repeat 2024-09-19T09:15:46.887 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 296222720 bytes via buffered write, may repeat 2024-09-19T09:15:46.887 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 297271296 bytes via buffered write, may repeat 2024-09-19T09:15:46.887 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 298319872 bytes via buffered write, may repeat 2024-09-19T09:15:46.887 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 299368448 bytes via buffered write, may repeat 2024-09-19T09:15:46.887 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 300417024 bytes via buffered write, may repeat 2024-09-19T09:15:46.887 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 301465600 bytes via buffered write, may repeat 2024-09-19T09:15:46.887 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 302514176 bytes via buffered write, may repeat 2024-09-19T09:15:46.887 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 303562752 bytes via buffered write, may repeat 2024-09-19T09:15:46.887 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 304611328 bytes via buffered write, may repeat 2024-09-19T09:15:46.887 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 305659904 bytes via buffered write, may repeat 2024-09-19T09:15:46.888 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 306708480 bytes via buffered write, may repeat 2024-09-19T09:15:46.888 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 307757056 bytes via buffered write, may repeat 2024-09-19T09:15:46.888 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 308805632 bytes via buffered write, may repeat 2024-09-19T09:15:46.888 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 309854208 bytes via buffered write, may repeat 2024-09-19T09:15:46.888 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 310902784 bytes via buffered write, may repeat 2024-09-19T09:15:46.888 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 311951360 bytes via buffered write, may repeat 2024-09-19T09:15:46.888 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 312999936 bytes via buffered write, may repeat 2024-09-19T09:15:46.888 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 314048512 bytes via buffered write, may repeat 2024-09-19T09:15:46.888 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 315097088 bytes via buffered write, may repeat 2024-09-19T09:15:46.888 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 316145664 bytes via buffered write, may repeat 2024-09-19T09:15:46.888 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 317194240 bytes via buffered write, may repeat 2024-09-19T09:15:46.888 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 318242816 bytes via buffered write, may repeat 2024-09-19T09:15:46.889 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 319291392 bytes via buffered write, may repeat 2024-09-19T09:15:46.889 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 320339968 bytes via buffered write, may repeat 2024-09-19T09:15:46.889 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 321388544 bytes via buffered write, may repeat 2024-09-19T09:15:46.889 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 322437120 bytes via buffered write, may repeat 2024-09-19T09:15:46.889 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 323485696 bytes via buffered write, may repeat 2024-09-19T09:15:46.927 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 324534272 bytes via buffered write, may repeat 2024-09-19T09:15:46.928 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 325582848 bytes via buffered write, may repeat 2024-09-19T09:15:46.928 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 326631424 bytes via buffered write, may repeat 2024-09-19T09:15:46.928 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 327680000 bytes via buffered write, may repeat 2024-09-19T09:15:46.928 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 328728576 bytes via buffered write, may repeat 2024-09-19T09:15:46.928 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 329777152 bytes via buffered write, may repeat 2024-09-19T09:15:46.928 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 330825728 bytes via buffered write, may repeat 2024-09-19T09:15:46.928 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 331874304 bytes via buffered write, may repeat 2024-09-19T09:15:46.928 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 332922880 bytes via buffered write, may repeat 2024-09-19T09:15:46.928 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 333971456 bytes via buffered write, may repeat 2024-09-19T09:15:46.928 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 335020032 bytes via buffered write, may repeat 2024-09-19T09:15:46.928 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 336068608 bytes via buffered write, may repeat 2024-09-19T09:15:46.928 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 337117184 bytes via buffered write, may repeat 2024-09-19T09:15:46.928 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 338165760 bytes via buffered write, may repeat 2024-09-19T09:15:46.929 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 339214336 bytes via buffered write, may repeat 2024-09-19T09:15:46.929 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 340262912 bytes via buffered write, may repeat 2024-09-19T09:15:46.929 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 341311488 bytes via buffered write, may repeat 2024-09-19T09:15:46.929 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 342360064 bytes via buffered write, may repeat 2024-09-19T09:15:46.929 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 343408640 bytes via buffered write, may repeat 2024-09-19T09:15:46.929 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 344457216 bytes via buffered write, may repeat 2024-09-19T09:15:46.929 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 345505792 bytes via buffered write, may repeat 2024-09-19T09:15:46.929 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 346554368 bytes via buffered write, may repeat 2024-09-19T09:15:46.929 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 347602944 bytes via buffered write, may repeat 2024-09-19T09:15:46.929 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 348651520 bytes via buffered write, may repeat 2024-09-19T09:15:46.929 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 349700096 bytes via buffered write, may repeat 2024-09-19T09:15:46.929 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 350748672 bytes via buffered write, may repeat 2024-09-19T09:15:46.930 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 351797248 bytes via buffered write, may repeat 2024-09-19T09:15:46.930 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 352845824 bytes via buffered write, may repeat 2024-09-19T09:15:46.930 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 353894400 bytes via buffered write, may repeat 2024-09-19T09:15:46.930 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 354942976 bytes via buffered write, may repeat 2024-09-19T09:15:46.930 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 355991552 bytes via buffered write, may repeat 2024-09-19T09:15:46.930 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 357040128 bytes via buffered write, may repeat 2024-09-19T09:15:46.930 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 358088704 bytes via buffered write, may repeat 2024-09-19T09:15:46.930 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 359137280 bytes via buffered write, may repeat 2024-09-19T09:15:46.931 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 360185856 bytes via buffered write, may repeat 2024-09-19T09:15:46.931 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 361234432 bytes via buffered write, may repeat 2024-09-19T09:15:46.931 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 362283008 bytes via buffered write, may repeat 2024-09-19T09:15:46.931 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 363331584 bytes via buffered write, may repeat 2024-09-19T09:15:46.931 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 364380160 bytes via buffered write, may repeat 2024-09-19T09:15:46.931 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 365428736 bytes via buffered write, may repeat 2024-09-19T09:15:46.931 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 366477312 bytes via buffered write, may repeat 2024-09-19T09:15:46.931 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 367525888 bytes via buffered write, may repeat 2024-09-19T09:15:46.931 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 368574464 bytes via buffered write, may repeat 2024-09-19T09:15:46.931 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 369623040 bytes via buffered write, may repeat 2024-09-19T09:15:46.931 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 370671616 bytes via buffered write, may repeat 2024-09-19T09:15:46.931 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 371720192 bytes via buffered write, may repeat 2024-09-19T09:15:46.931 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 372768768 bytes via buffered write, may repeat 2024-09-19T09:15:46.932 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 373817344 bytes via buffered write, may repeat 2024-09-19T09:15:46.932 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 374865920 bytes via buffered write, may repeat 2024-09-19T09:15:46.932 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 375914496 bytes via buffered write, may repeat 2024-09-19T09:15:46.932 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 376963072 bytes via buffered write, may repeat 2024-09-19T09:15:46.932 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 378011648 bytes via buffered write, may repeat 2024-09-19T09:15:46.932 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 379060224 bytes via buffered write, may repeat 2024-09-19T09:15:46.932 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 380108800 bytes via buffered write, may repeat 2024-09-19T09:15:46.932 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 381157376 bytes via buffered write, may repeat 2024-09-19T09:15:46.932 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 382205952 bytes via buffered write, may repeat 2024-09-19T09:15:46.932 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 383254528 bytes via buffered write, may repeat 2024-09-19T09:15:46.933 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 384303104 bytes via buffered write, may repeat 2024-09-19T09:15:46.933 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 385351680 bytes via buffered write, may repeat 2024-09-19T09:15:46.933 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 386400256 bytes via buffered write, may repeat 2024-09-19T09:15:46.933 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 387448832 bytes via buffered write, may repeat 2024-09-19T09:15:46.933 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 388497408 bytes via buffered write, may repeat 2024-09-19T09:15:46.933 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 389545984 bytes via buffered write, may repeat 2024-09-19T09:15:46.933 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 390594560 bytes via buffered write, may repeat 2024-09-19T09:15:46.934 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 391643136 bytes via buffered write, may repeat 2024-09-19T09:15:46.934 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 392691712 bytes via buffered write, may repeat 2024-09-19T09:15:46.934 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 393740288 bytes via buffered write, may repeat 2024-09-19T09:15:46.934 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 394788864 bytes via buffered write, may repeat 2024-09-19T09:15:46.934 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 395837440 bytes via buffered write, may repeat 2024-09-19T09:15:46.934 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 396886016 bytes via buffered write, may repeat 2024-09-19T09:15:46.934 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 397934592 bytes via buffered write, may repeat 2024-09-19T09:15:46.934 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 398983168 bytes via buffered write, may repeat 2024-09-19T09:15:46.934 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 400031744 bytes via buffered write, may repeat 2024-09-19T09:15:46.935 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 401080320 bytes via buffered write, may repeat 2024-09-19T09:15:46.935 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 402128896 bytes via buffered write, may repeat 2024-09-19T09:15:46.935 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 403177472 bytes via buffered write, may repeat 2024-09-19T09:15:46.935 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 404226048 bytes via buffered write, may repeat 2024-09-19T09:15:46.935 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 405274624 bytes via buffered write, may repeat 2024-09-19T09:15:46.935 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 406323200 bytes via buffered write, may repeat 2024-09-19T09:15:46.935 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 407371776 bytes via buffered write, may repeat 2024-09-19T09:15:46.935 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 408420352 bytes via buffered write, may repeat 2024-09-19T09:15:46.935 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 409468928 bytes via buffered write, may repeat 2024-09-19T09:15:46.935 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 410517504 bytes via buffered write, may repeat 2024-09-19T09:15:46.935 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 411566080 bytes via buffered write, may repeat 2024-09-19T09:15:46.936 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 412614656 bytes via buffered write, may repeat 2024-09-19T09:15:46.936 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 413663232 bytes via buffered write, may repeat 2024-09-19T09:15:46.936 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 414711808 bytes via buffered write, may repeat 2024-09-19T09:15:46.936 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 415760384 bytes via buffered write, may repeat 2024-09-19T09:15:46.936 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 416808960 bytes via buffered write, may repeat 2024-09-19T09:15:46.936 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 417857536 bytes via buffered write, may repeat 2024-09-19T09:15:46.936 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 418906112 bytes via buffered write, may repeat 2024-09-19T09:15:46.936 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 419954688 bytes via buffered write, may repeat 2024-09-19T09:15:46.936 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 421003264 bytes via buffered write, may repeat 2024-09-19T09:15:46.936 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 422051840 bytes via buffered write, may repeat 2024-09-19T09:15:46.937 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 423100416 bytes via buffered write, may repeat 2024-09-19T09:15:46.937 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 424148992 bytes via buffered write, may repeat 2024-09-19T09:15:46.937 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 425197568 bytes via buffered write, may repeat 2024-09-19T09:15:46.937 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 426246144 bytes via buffered write, may repeat 2024-09-19T09:15:46.937 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 427294720 bytes via buffered write, may repeat 2024-09-19T09:15:46.937 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 428343296 bytes via buffered write, may repeat 2024-09-19T09:15:46.938 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 429391872 bytes via buffered write, may repeat 2024-09-19T09:15:46.938 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 430440448 bytes via buffered write, may repeat 2024-09-19T09:15:46.938 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 431489024 bytes via buffered write, may repeat 2024-09-19T09:15:46.938 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 432537600 bytes via buffered write, may repeat 2024-09-19T09:15:46.938 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 433586176 bytes via buffered write, may repeat 2024-09-19T09:15:46.938 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 434634752 bytes via buffered write, may repeat 2024-09-19T09:15:46.939 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 435683328 bytes via buffered write, may repeat 2024-09-19T09:15:46.939 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 436731904 bytes via buffered write, may repeat 2024-09-19T09:15:46.939 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 437780480 bytes via buffered write, may repeat 2024-09-19T09:15:46.939 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 438829056 bytes via buffered write, may repeat 2024-09-19T09:15:46.939 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 439877632 bytes via buffered write, may repeat 2024-09-19T09:15:46.939 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 440926208 bytes via buffered write, may repeat 2024-09-19T09:15:46.939 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 441974784 bytes via buffered write, may repeat 2024-09-19T09:15:46.939 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 443023360 bytes via buffered write, may repeat 2024-09-19T09:15:46.940 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 444071936 bytes via buffered write, may repeat 2024-09-19T09:15:46.940 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 445120512 bytes via buffered write, may repeat 2024-09-19T09:15:46.940 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 446169088 bytes via buffered write, may repeat 2024-09-19T09:15:46.940 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 447217664 bytes via buffered write, may repeat 2024-09-19T09:15:46.940 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 448266240 bytes via buffered write, may repeat 2024-09-19T09:15:46.940 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 449314816 bytes via buffered write, may repeat 2024-09-19T09:15:46.940 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 450363392 bytes via buffered write, may repeat 2024-09-19T09:15:46.940 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 451411968 bytes via buffered write, may repeat 2024-09-19T09:15:46.941 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 452460544 bytes via buffered write, may repeat 2024-09-19T09:15:46.941 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 453509120 bytes via buffered write, may repeat 2024-09-19T09:15:46.941 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 454557696 bytes via buffered write, may repeat 2024-09-19T09:15:46.941 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 455606272 bytes via buffered write, may repeat 2024-09-19T09:15:46.941 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 456654848 bytes via buffered write, may repeat 2024-09-19T09:15:46.941 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 457703424 bytes via buffered write, may repeat 2024-09-19T09:15:46.941 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 458752000 bytes via buffered write, may repeat 2024-09-19T09:15:46.941 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 459800576 bytes via buffered write, may repeat 2024-09-19T09:15:46.941 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 460849152 bytes via buffered write, may repeat 2024-09-19T09:15:46.942 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 461897728 bytes via buffered write, may repeat 2024-09-19T09:15:46.942 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 462946304 bytes via buffered write, may repeat 2024-09-19T09:15:46.942 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 463994880 bytes via buffered write, may repeat 2024-09-19T09:15:46.942 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 465043456 bytes via buffered write, may repeat 2024-09-19T09:15:46.942 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 466092032 bytes via buffered write, may repeat 2024-09-19T09:15:46.942 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 467140608 bytes via buffered write, may repeat 2024-09-19T09:15:46.942 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 468189184 bytes via buffered write, may repeat 2024-09-19T09:15:46.942 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 469237760 bytes via buffered write, may repeat 2024-09-19T09:15:46.942 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 470286336 bytes via buffered write, may repeat 2024-09-19T09:15:46.942 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 471334912 bytes via buffered write, may repeat 2024-09-19T09:15:46.942 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 472383488 bytes via buffered write, may repeat 2024-09-19T09:15:46.943 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 473432064 bytes via buffered write, may repeat 2024-09-19T09:15:46.943 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 474480640 bytes via buffered write, may repeat 2024-09-19T09:15:46.943 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 475529216 bytes via buffered write, may repeat 2024-09-19T09:15:46.943 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 476577792 bytes via buffered write, may repeat 2024-09-19T09:15:46.943 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 477626368 bytes via buffered write, may repeat 2024-09-19T09:15:46.943 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 478674944 bytes via buffered write, may repeat 2024-09-19T09:15:46.943 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 479723520 bytes via buffered write, may repeat 2024-09-19T09:15:46.943 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 480772096 bytes via buffered write, may repeat 2024-09-19T09:15:46.943 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 481820672 bytes via buffered write, may repeat 2024-09-19T09:15:46.943 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 482869248 bytes via buffered write, may repeat 2024-09-19T09:15:46.943 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 483917824 bytes via buffered write, may repeat 2024-09-19T09:15:46.943 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 484966400 bytes via buffered write, may repeat 2024-09-19T09:15:48.705 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-19T09:15:48.704+0000 7fca8cfa1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2024-09-19T09:15:53.732 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-19T09:15:53.731+0000 7fca8cfa1640 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2024-09-19T09:16:00.492 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:16:00.496 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:16:21.832 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-19T09:16:21.832+0000 7fca8cfa1640 -1 log_channel(cluster) log [ERR] : Health check failed: Full OSDs blocking recovery: 1 pg recovery_toofull (PG_RECOVERY_FULL) 2024-09-19T09:16:30.560 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:16:30.563 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:17:00.624 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:17:00.628 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:17:02.377 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 486014976 bytes via buffered write, may repeat 2024-09-19T09:17:02.377 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 487063552 bytes via buffered write, may repeat 2024-09-19T09:17:02.377 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 488112128 bytes via buffered write, may repeat 2024-09-19T09:17:02.377 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 489160704 bytes via buffered write, may repeat 2024-09-19T09:17:02.377 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 490209280 bytes via buffered write, may repeat 2024-09-19T09:17:02.377 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 491257856 bytes via buffered write, may repeat 2024-09-19T09:17:02.377 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 492306432 bytes via buffered write, may repeat 2024-09-19T09:17:02.377 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 493355008 bytes via buffered write, may repeat 2024-09-19T09:17:02.378 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 494403584 bytes via buffered write, may repeat 2024-09-19T09:17:02.378 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 495452160 bytes via buffered write, may repeat 2024-09-19T09:17:02.378 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 496500736 bytes via buffered write, may repeat 2024-09-19T09:17:02.378 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 497549312 bytes via buffered write, may repeat 2024-09-19T09:17:02.378 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 498597888 bytes via buffered write, may repeat 2024-09-19T09:17:02.378 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 499646464 bytes via buffered write, may repeat 2024-09-19T09:17:02.378 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 500695040 bytes via buffered write, may repeat 2024-09-19T09:17:02.378 INFO:teuthology.orchestra.run.smithi018.stdout:done writing 500695040 bytes 2024-09-19T09:17:02.378 INFO:teuthology.orchestra.run.smithi018.stdout:successfully fsync'ed prior to getting full state reported 2024-09-19T09:17:02.378 INFO:teuthology.orchestra.run.smithi018.stdout:starting buffered write 2024-09-19T09:17:02.378 INFO:teuthology.orchestra.run.smithi018.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-19T09:17:02.378 INFO:teuthology.orchestra.run.smithi018.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-19T09:17:02.378 INFO:teuthology.orchestra.run.smithi018.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-19T09:17:02.379 INFO:teuthology.orchestra.run.smithi018.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2024-09-19T09:17:02.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:17:02.390 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T09:17:02.390 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:17:02.431 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:17:02.482 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T09:17:02.482 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:17:02.482 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:17:02.483 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:17:02.501 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:17:02.501 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:17:02.559 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T09:17:02.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.706+0000 7f688cd03640 1 Processor -- start 2024-09-19T09:17:02.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.706+0000 7f688cd03640 1 -- start start 2024-09-19T09:17:02.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.707+0000 7f688cd03640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f688815eda0 0x7f68880d5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:02.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.707+0000 7f688cd03640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68880d0480 0x7f68880d35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:02.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.707+0000 7f688cd03640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f68880d3af0 0x7f68880d1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:02.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.707+0000 7f688cd03640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f68880d2880 con 0x7f688815eda0 2024-09-19T09:17:02.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.707+0000 7f688cd03640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f68880d3120 con 0x7f68880d3af0 2024-09-19T09:17:02.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.707+0000 7f688cd03640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f68880d0bf0 con 0x7f68880d0480 2024-09-19T09:17:02.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.707+0000 7f688659c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f688815eda0 0x7f68880d5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:02.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.707+0000 7f688659c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f688815eda0 0x7f68880d5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56016/0 (socket says 172.21.15.18:56016) 2024-09-19T09:17:02.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.707+0000 7f688659c640 1 -- 172.21.15.18:0/4067372665 learned_addr learned my addr 172.21.15.18:0/4067372665 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:02.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.708+0000 7f6886d9d640 1 --2- 172.21.15.18:0/4067372665 >> v2:172.21.15.162:3300/0 conn(0x7f68880d3af0 0x7f68880d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:02.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.708+0000 7f6885d9b640 1 --2- 172.21.15.18:0/4067372665 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68880d0480 0x7f68880d35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:02.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.708+0000 7f688659c640 1 -- 172.21.15.18:0/4067372665 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68880d0480 msgr2=0x7f68880d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:02.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.708+0000 7f688659c640 1 --2- 172.21.15.18:0/4067372665 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68880d0480 0x7f68880d35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:02.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.708+0000 7f688659c640 1 -- 172.21.15.18:0/4067372665 >> v2:172.21.15.162:3300/0 conn(0x7f68880d3af0 msgr2=0x7f68880d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:02.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.708+0000 7f688659c640 1 --2- 172.21.15.18:0/4067372665 >> v2:172.21.15.162:3300/0 conn(0x7f68880d3af0 0x7f68880d1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:02.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.708+0000 7f688659c640 1 -- 172.21.15.18:0/4067372665 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68880d2ad0 con 0x7f688815eda0 2024-09-19T09:17:02.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.708+0000 7f6885d9b640 1 --2- 172.21.15.18:0/4067372665 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68880d0480 0x7f68880d35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:17:02.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.709+0000 7f688659c640 1 --2- 172.21.15.18:0/4067372665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f688815eda0 0x7f68880d5790 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f68880d2810 tx=0x7f687802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63de2b0f0e42ce05 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:02.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.709+0000 7f688559a640 1 -- 172.21.15.18:0/4067372665 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878036070 con 0x7f688815eda0 2024-09-19T09:17:02.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.709+0000 7f688559a640 1 -- 172.21.15.18:0/4067372665 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6878031600 con 0x7f688815eda0 2024-09-19T09:17:02.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.709+0000 7f688559a640 1 -- 172.21.15.18:0/4067372665 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68780319d0 con 0x7f688815eda0 2024-09-19T09:17:02.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.709+0000 7f688cd03640 1 -- 172.21.15.18:0/4067372665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f688815eda0 msgr2=0x7f68880d5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:02.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.709+0000 7f688cd03640 1 --2- 172.21.15.18:0/4067372665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f688815eda0 0x7f68880d5790 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f68880d2810 tx=0x7f687802a6a0 comp rx=0 tx=0).stop 2024-09-19T09:17:02.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.709+0000 7f688cd03640 1 -- 172.21.15.18:0/4067372665 shutdown_connections 2024-09-19T09:17:02.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.709+0000 7f688cd03640 1 --2- 172.21.15.18:0/4067372665 >> v2:172.21.15.162:3300/0 conn(0x7f68880d3af0 0x7f68880d1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:02.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.709+0000 7f688cd03640 1 --2- 172.21.15.18:0/4067372665 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68880d0480 0x7f68880d35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:02.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.709+0000 7f688cd03640 1 --2- 172.21.15.18:0/4067372665 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f688815eda0 0x7f68880d5790 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:02.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.709+0000 7f688cd03640 1 -- 172.21.15.18:0/4067372665 >> 172.21.15.18:0/4067372665 conn(0x7f688809df40 msgr2=0x7f68880d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:02.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.709+0000 7f688cd03640 1 -- 172.21.15.18:0/4067372665 shutdown_connections 2024-09-19T09:17:02.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.709+0000 7f688cd03640 1 -- 172.21.15.18:0/4067372665 wait complete. 2024-09-19T09:17:02.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.711+0000 7f688cd03640 1 Processor -- start 2024-09-19T09:17:02.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.711+0000 7f688cd03640 1 -- start start 2024-09-19T09:17:02.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.711+0000 7f688cd03640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68880d0480 0x7f688815c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:02.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.711+0000 7f688cd03640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f688815eda0 0x7f68881f4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:02.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.711+0000 7f688cd03640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68881f5460 0x7f68880b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:02.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.711+0000 7f688cd03640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f688815f180 con 0x7f68881f5460 2024-09-19T09:17:02.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.711+0000 7f688cd03640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f68880d08c0 con 0x7f68880d0480 2024-09-19T09:17:02.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.711+0000 7f688cd03640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f688815f300 con 0x7f688815eda0 2024-09-19T09:17:02.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.712+0000 7f6886d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68881f5460 0x7f68880b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:02.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.712+0000 7f6886d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68881f5460 0x7f68880b67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56026/0 (socket says 172.21.15.18:56026) 2024-09-19T09:17:02.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.712+0000 7f6886d9d640 1 -- 172.21.15.18:0/3774803766 learned_addr learned my addr 172.21.15.18:0/3774803766 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:02.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.712+0000 7f688659c640 1 --2- 172.21.15.18:0/3774803766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68880d0480 0x7f688815c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:02.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.712+0000 7f6885d9b640 1 --2- 172.21.15.18:0/3774803766 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f688815eda0 0x7f68881f4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:02.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.712+0000 7f6886d9d640 1 -- 172.21.15.18:0/3774803766 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f688815eda0 msgr2=0x7f68881f4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:02.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.712+0000 7f6886d9d640 1 --2- 172.21.15.18:0/3774803766 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f688815eda0 0x7f68881f4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:02.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.712+0000 7f6886d9d640 1 -- 172.21.15.18:0/3774803766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68880d0480 msgr2=0x7f688815c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:02.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.712+0000 7f6886d9d640 1 --2- 172.21.15.18:0/3774803766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68880d0480 0x7f688815c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:02.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.712+0000 7f6886d9d640 1 -- 172.21.15.18:0/3774803766 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68880cdd70 con 0x7f68881f5460 2024-09-19T09:17:02.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.712+0000 7f6885d9b640 1 --2- 172.21.15.18:0/3774803766 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f688815eda0 0x7f68881f4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:02.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.712+0000 7f6886d9d640 1 --2- 172.21.15.18:0/3774803766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68881f5460 0x7f68880b67a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f688000d800 tx=0x7f688000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:02.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.712+0000 7f687effd640 1 -- 172.21.15.18:0/3774803766 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688000b6c0 con 0x7f68881f5460 2024-09-19T09:17:02.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.712+0000 7f687effd640 1 -- 172.21.15.18:0/3774803766 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6880019070 con 0x7f68881f5460 2024-09-19T09:17:02.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.712+0000 7f688cd03640 1 -- 172.21.15.18:0/3774803766 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f688815c690 con 0x7f68881f5460 2024-09-19T09:17:02.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.712+0000 7f687effd640 1 -- 172.21.15.18:0/3774803766 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688000bac0 con 0x7f68881f5460 2024-09-19T09:17:02.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.712+0000 7f688cd03640 1 -- 172.21.15.18:0/3774803766 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f688809ea50 con 0x7f68881f5460 2024-09-19T09:17:02.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.713+0000 7f688cd03640 1 -- 172.21.15.18:0/3774803766 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68880d1150 con 0x7f68881f5460 2024-09-19T09:17:02.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.714+0000 7f687effd640 1 -- 172.21.15.18:0/3774803766 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f688000bc60 con 0x7f68881f5460 2024-09-19T09:17:02.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.714+0000 7f687effd640 1 --2- 172.21.15.18:0/3774803766 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f686806c2b0 0x7f686806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:02.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.715+0000 7f687effd640 1 -- 172.21.15.18:0/3774803766 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5767+0+0 (secure 0 0 0) 0x7f688008b8f0 con 0x7f68881f5460 2024-09-19T09:17:02.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.715+0000 7f688659c640 1 --2- 172.21.15.18:0/3774803766 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f686806c2b0 0x7f686806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:02.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.715+0000 7f687effd640 1 -- 172.21.15.18:0/3774803766 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=77}) -- 0x7f6868073ea0 con 0x7f68881f5460 2024-09-19T09:17:02.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.715+0000 7f688659c640 1 --2- 172.21.15.18:0/3774803766 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f686806c2b0 0x7f686806e770 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6878033000 tx=0x7f6878009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:02.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.719+0000 7f687effd640 1 -- 172.21.15.18:0/3774803766 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f68880d1150 con 0x7f68881f5460 2024-09-19T09:17:02.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.907+0000 7f688cd03640 1 -- 172.21.15.18:0/3774803766 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f688815e910 con 0x7f68881f5460 2024-09-19T09:17:02.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.907+0000 7f687effd640 1 -- 172.21.15.18:0/3774803766 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v76) ==== 80+0+0 (secure 0 0 0) 0x7f6880059f80 con 0x7f68881f5460 2024-09-19T09:17:02.908 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-09-19T09:17:02.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.909+0000 7f688cd03640 1 -- 172.21.15.18:0/3774803766 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f686806c2b0 msgr2=0x7f686806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:02.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.909+0000 7f688cd03640 1 --2- 172.21.15.18:0/3774803766 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f686806c2b0 0x7f686806e770 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6878033000 tx=0x7f6878009000 comp rx=0 tx=0).stop 2024-09-19T09:17:02.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.909+0000 7f688cd03640 1 -- 172.21.15.18:0/3774803766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68881f5460 msgr2=0x7f68880b67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:02.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.909+0000 7f688cd03640 1 --2- 172.21.15.18:0/3774803766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68881f5460 0x7f68880b67a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f688000d800 tx=0x7f688000dcc0 comp rx=0 tx=0).stop 2024-09-19T09:17:02.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.909+0000 7f688cd03640 1 -- 172.21.15.18:0/3774803766 shutdown_connections 2024-09-19T09:17:02.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.909+0000 7f688cd03640 1 --2- 172.21.15.18:0/3774803766 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f686806c2b0 0x7f686806e770 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:02.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.909+0000 7f688cd03640 1 --2- 172.21.15.18:0/3774803766 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68881f5460 0x7f68880b67a0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:02.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.909+0000 7f688cd03640 1 --2- 172.21.15.18:0/3774803766 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f688815eda0 0x7f68881f4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:02.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.909+0000 7f688cd03640 1 --2- 172.21.15.18:0/3774803766 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68880d0480 0x7f688815c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:02.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.909+0000 7f688cd03640 1 -- 172.21.15.18:0/3774803766 >> 172.21.15.18:0/3774803766 conn(0x7f688809df40 msgr2=0x7f688815dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:02.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.909+0000 7f688cd03640 1 -- 172.21.15.18:0/3774803766 shutdown_connections 2024-09-19T09:17:02.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:02.909+0000 7f688cd03640 1 -- 172.21.15.18:0/3774803766 wait complete. 2024-09-19T09:17:02.921 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T09:17:02.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:17:02.921 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-19T09:17:02.952 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T09:17:02.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:17:02.952 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T09:17:03.016 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:17:03.016 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:17:03.016 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:17:03.036 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:17:03.036 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:17:03.095 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T09:17:03.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.198+0000 7f4a63b2a640 1 Processor -- start 2024-09-19T09:17:03.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.198+0000 7f4a63b2a640 1 -- start start 2024-09-19T09:17:03.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.199+0000 7f4a63b2a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4a5c06bc10 0x7f4a5c0b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.199+0000 7f4a63b2a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a5c0b4b90 0x7f4a5c06bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.199+0000 7f4a63b2a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4a5c162750 0x7f4a5c162be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.199+0000 7f4a63b2a640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f4a5c06c530 con 0x7f4a5c06bc10 2024-09-19T09:17:03.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.199+0000 7f4a63b2a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4a5c1600c0 con 0x7f4a5c162750 2024-09-19T09:17:03.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.199+0000 7f4a63b2a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4a5c0d1920 con 0x7f4a5c0b4b90 2024-09-19T09:17:03.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.199+0000 7f4a618c6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4a5c06bc10 0x7f4a5c0b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:03.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.199+0000 7f4a618c6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4a5c06bc10 0x7f4a5c0b6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56034/0 (socket says 172.21.15.18:56034) 2024-09-19T09:17:03.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.199+0000 7f4a618c6640 1 -- 172.21.15.18:0/3874262487 learned_addr learned my addr 172.21.15.18:0/3874262487 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:03.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.200+0000 7f4a620c7640 1 --2- 172.21.15.18:0/3874262487 >> v2:172.21.15.162:3300/0 conn(0x7f4a5c162750 0x7f4a5c162be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:03.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.200+0000 7f4a610c5640 1 --2- 172.21.15.18:0/3874262487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a5c0b4b90 0x7f4a5c06bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:03.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.200+0000 7f4a618c6640 1 -- 172.21.15.18:0/3874262487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a5c0b4b90 msgr2=0x7f4a5c06bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:03.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.200+0000 7f4a618c6640 1 --2- 172.21.15.18:0/3874262487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a5c0b4b90 0x7f4a5c06bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.200+0000 7f4a618c6640 1 -- 172.21.15.18:0/3874262487 >> v2:172.21.15.162:3300/0 conn(0x7f4a5c162750 msgr2=0x7f4a5c162be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:03.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.200+0000 7f4a618c6640 1 --2- 172.21.15.18:0/3874262487 >> v2:172.21.15.162:3300/0 conn(0x7f4a5c162750 0x7f4a5c162be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.200+0000 7f4a618c6640 1 -- 172.21.15.18:0/3874262487 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a5c15f300 con 0x7f4a5c06bc10 2024-09-19T09:17:03.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.200+0000 7f4a618c6640 1 --2- 172.21.15.18:0/3874262487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a5c06bc10 0x7f4a5c0b6a50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c06feb0 tx=0x7f4a5402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff332b9d74200bef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:03.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.201+0000 7f4a608c4640 1 -- 172.21.15.18:0/3874262487 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a54037070 con 0x7f4a5c06bc10 2024-09-19T09:17:03.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.201+0000 7f4a608c4640 1 -- 172.21.15.18:0/3874262487 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a54032440 con 0x7f4a5c06bc10 2024-09-19T09:17:03.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.201+0000 7f4a608c4640 1 -- 172.21.15.18:0/3874262487 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a54032810 con 0x7f4a5c06bc10 2024-09-19T09:17:03.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.201+0000 7f4a63b2a640 1 -- 172.21.15.18:0/3874262487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a5c06bc10 msgr2=0x7f4a5c0b6a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.201+0000 7f4a63b2a640 1 --2- 172.21.15.18:0/3874262487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a5c06bc10 0x7f4a5c0b6a50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c06feb0 tx=0x7f4a5402a140 comp rx=0 tx=0).stop 2024-09-19T09:17:03.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.201+0000 7f4a63b2a640 1 -- 172.21.15.18:0/3874262487 shutdown_connections 2024-09-19T09:17:03.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.201+0000 7f4a63b2a640 1 --2- 172.21.15.18:0/3874262487 >> v2:172.21.15.162:3300/0 conn(0x7f4a5c162750 0x7f4a5c162be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.201+0000 7f4a63b2a640 1 --2- 172.21.15.18:0/3874262487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a5c0b4b90 0x7f4a5c06bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.201+0000 7f4a63b2a640 1 --2- 172.21.15.18:0/3874262487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a5c06bc10 0x7f4a5c0b6a50 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.201+0000 7f4a63b2a640 1 -- 172.21.15.18:0/3874262487 >> 172.21.15.18:0/3874262487 conn(0x7f4a5c0b3890 msgr2=0x7f4a5c0b3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:03.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.201+0000 7f4a63b2a640 1 -- 172.21.15.18:0/3874262487 shutdown_connections 2024-09-19T09:17:03.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.201+0000 7f4a63b2a640 1 -- 172.21.15.18:0/3874262487 wait complete. 2024-09-19T09:17:03.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.202+0000 7f4a63b2a640 1 Processor -- start 2024-09-19T09:17:03.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.203+0000 7f4a63b2a640 1 -- start start 2024-09-19T09:17:03.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.203+0000 7f4a63b2a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a5c06bc10 0x7f4a5c140700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.203+0000 7f4a63b2a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a5c0b4b90 0x7f4a5c1f88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.203+0000 7f4a63b2a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a5c162750 0x7f4a5c0b0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.203+0000 7f4a63b2a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4a5c15fba0 con 0x7f4a5c162750 2024-09-19T09:17:03.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.203+0000 7f4a63b2a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4a5c15f8c0 con 0x7f4a5c0b4b90 2024-09-19T09:17:03.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.203+0000 7f4a63b2a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4a5c0b5000 con 0x7f4a5c06bc10 2024-09-19T09:17:03.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.203+0000 7f4a620c7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a5c162750 0x7f4a5c0b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:03.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.203+0000 7f4a620c7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a5c162750 0x7f4a5c0b0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56038/0 (socket says 172.21.15.18:56038) 2024-09-19T09:17:03.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.203+0000 7f4a620c7640 1 -- 172.21.15.18:0/3678474473 learned_addr learned my addr 172.21.15.18:0/3678474473 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:03.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.203+0000 7f4a610c5640 1 --2- 172.21.15.18:0/3678474473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a5c0b4b90 0x7f4a5c1f88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:03.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.204+0000 7f4a618c6640 1 --2- 172.21.15.18:0/3678474473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a5c06bc10 0x7f4a5c140700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:03.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.204+0000 7f4a620c7640 1 -- 172.21.15.18:0/3678474473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a5c06bc10 msgr2=0x7f4a5c140700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.204+0000 7f4a620c7640 1 --2- 172.21.15.18:0/3678474473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a5c06bc10 0x7f4a5c140700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.204+0000 7f4a620c7640 1 -- 172.21.15.18:0/3678474473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a5c0b4b90 msgr2=0x7f4a5c1f88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.204+0000 7f4a620c7640 1 --2- 172.21.15.18:0/3678474473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a5c0b4b90 0x7f4a5c1f88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.204+0000 7f4a620c7640 1 -- 172.21.15.18:0/3678474473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a5c1f8df0 con 0x7f4a5c162750 2024-09-19T09:17:03.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.204+0000 7f4a620c7640 1 --2- 172.21.15.18:0/3678474473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a5c162750 0x7f4a5c0b0130 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c007e60 tx=0x7f4a4c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:03.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.204+0000 7f4a5a7fc640 1 -- 172.21.15.18:0/3678474473 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c014420 con 0x7f4a5c162750 2024-09-19T09:17:03.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.204+0000 7f4a5a7fc640 1 -- 172.21.15.18:0/3678474473 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a4c019070 con 0x7f4a5c162750 2024-09-19T09:17:03.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.204+0000 7f4a63b2a640 1 -- 172.21.15.18:0/3678474473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a5c142980 con 0x7f4a5c162750 2024-09-19T09:17:03.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.204+0000 7f4a5a7fc640 1 -- 172.21.15.18:0/3678474473 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c014820 con 0x7f4a5c162750 2024-09-19T09:17:03.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.204+0000 7f4a63b2a640 1 -- 172.21.15.18:0/3678474473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a5c0af930 con 0x7f4a5c162750 2024-09-19T09:17:03.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.205+0000 7f4a63b2a640 1 -- 172.21.15.18:0/3678474473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a5c0b52e0 con 0x7f4a5c162750 2024-09-19T09:17:03.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.206+0000 7f4a5a7fc640 1 -- 172.21.15.18:0/3678474473 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4a4c0149c0 con 0x7f4a5c162750 2024-09-19T09:17:03.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.206+0000 7f4a5a7fc640 1 --2- 172.21.15.18:0/3678474473 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4a4806c2b0 0x7f4a4806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.206+0000 7f4a5a7fc640 1 -- 172.21.15.18:0/3678474473 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5767+0+0 (secure 0 0 0) 0x7f4a4c08bb80 con 0x7f4a5c162750 2024-09-19T09:17:03.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.206+0000 7f4a5a7fc640 1 -- 172.21.15.18:0/3678474473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=77}) -- 0x7f4a48073ea0 con 0x7f4a5c162750 2024-09-19T09:17:03.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.206+0000 7f4a618c6640 1 --2- 172.21.15.18:0/3678474473 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4a4806c2b0 0x7f4a4806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:03.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.207+0000 7f4a618c6640 1 --2- 172.21.15.18:0/3678474473 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4a4806c2b0 0x7f4a4806e770 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4a54034000 tx=0x7f4a5402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:03.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.211+0000 7f4a5a7fc640 1 -- 172.21.15.18:0/3678474473 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f4a5c1f8df0 con 0x7f4a5c162750 2024-09-19T09:17:03.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.397+0000 7f4a63b2a640 1 -- 172.21.15.18:0/3678474473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4a5c0b4760 con 0x7f4a5c162750 2024-09-19T09:17:03.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.398+0000 7f4a5a7fc640 1 -- 172.21.15.18:0/3678474473 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v76) ==== 80+0+0 (secure 0 0 0) 0x7f4a4c059c60 con 0x7f4a5c162750 2024-09-19T09:17:03.398 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-09-19T09:17:03.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.400+0000 7f4a63b2a640 1 -- 172.21.15.18:0/3678474473 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4a4806c2b0 msgr2=0x7f4a4806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.400+0000 7f4a63b2a640 1 --2- 172.21.15.18:0/3678474473 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4a4806c2b0 0x7f4a4806e770 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4a54034000 tx=0x7f4a5402e000 comp rx=0 tx=0).stop 2024-09-19T09:17:03.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.400+0000 7f4a63b2a640 1 -- 172.21.15.18:0/3678474473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a5c162750 msgr2=0x7f4a5c0b0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.400+0000 7f4a63b2a640 1 --2- 172.21.15.18:0/3678474473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a5c162750 0x7f4a5c0b0130 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c007e60 tx=0x7f4a4c00e4b0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.400+0000 7f4a63b2a640 1 -- 172.21.15.18:0/3678474473 shutdown_connections 2024-09-19T09:17:03.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.400+0000 7f4a63b2a640 1 --2- 172.21.15.18:0/3678474473 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4a4806c2b0 0x7f4a4806e770 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.400+0000 7f4a63b2a640 1 --2- 172.21.15.18:0/3678474473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4a5c162750 0x7f4a5c0b0130 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.400+0000 7f4a63b2a640 1 --2- 172.21.15.18:0/3678474473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a5c0b4b90 0x7f4a5c1f88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.400+0000 7f4a63b2a640 1 --2- 172.21.15.18:0/3678474473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4a5c06bc10 0x7f4a5c140700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.400+0000 7f4a63b2a640 1 -- 172.21.15.18:0/3678474473 >> 172.21.15.18:0/3678474473 conn(0x7f4a5c0b3890 msgr2=0x7f4a5c0b2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:03.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.400+0000 7f4a63b2a640 1 -- 172.21.15.18:0/3678474473 shutdown_connections 2024-09-19T09:17:03.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.400+0000 7f4a63b2a640 1 -- 172.21.15.18:0/3678474473 wait complete. 2024-09-19T09:17:03.411 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-19T09:17:03.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:17:03.412 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-19T09:17:03.445 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-09-19T09:17:03.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:17:03.445 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-19T09:17:03.505 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:17:03.505 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:17:03.505 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:17:03.523 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17075 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T09:17:03.523 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:17:03.524 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:17:03.524 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:17:03.575 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3252 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T09:17:03.575 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:17:03.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.687+0000 7f2b9a352640 1 Processor -- start 2024-09-19T09:17:03.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.687+0000 7f2b9a352640 1 -- start start 2024-09-19T09:17:03.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.688+0000 7f2b9a352640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b9415ed30 0x7f2b94070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.688+0000 7f2b9a352640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2b941630f0 0x7f2b940cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.688+0000 7f2b9a352640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b940d0a10 con 0x7f2b940b5200 2024-09-19T09:17:03.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.688+0000 7f2b9a352640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2b94070ab0 con 0x7f2b941630f0 2024-09-19T09:17:03.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.688+0000 7f2b9a352640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2b940d0cb0 con 0x7f2b9415ed30 2024-09-19T09:17:03.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.688+0000 7f2b93fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b9415ed30 0x7f2b94070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:03.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.688+0000 7f2b93fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b9415ed30 0x7f2b94070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:43720/0 (socket says 172.21.15.18:43720) 2024-09-19T09:17:03.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.688+0000 7f2b93fff640 1 -- 172.21.15.18:0/1956829851 learned_addr learned my addr 172.21.15.18:0/1956829851 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:03.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.688+0000 7f2b988ef640 1 --2- 172.21.15.18:0/1956829851 >> v2:172.21.15.162:3300/0 conn(0x7f2b941630f0 0x7f2b940cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:03.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.689+0000 7f2b93fff640 1 -- 172.21.15.18:0/1956829851 >> v2:172.21.15.162:3300/0 conn(0x7f2b941630f0 msgr2=0x7f2b940cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:03.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.689+0000 7f2b93fff640 1 --2- 172.21.15.18:0/1956829851 >> v2:172.21.15.162:3300/0 conn(0x7f2b941630f0 0x7f2b940cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.689+0000 7f2b93fff640 1 -- 172.21.15.18:0/1956829851 >> v1:172.21.15.162:6789/0 conn(0x7f2b940b5200 legacy=0x7f2b941629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.689+0000 7f2b93fff640 1 -- 172.21.15.18:0/1956829851 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b940d0f90 con 0x7f2b9415ed30 2024-09-19T09:17:03.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.689+0000 7f2b93fff640 1 --2- 172.21.15.18:0/1956829851 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b9415ed30 0x7f2b94070260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2b84009870 tx=0x7f2b8402a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=656c0f511d1490b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:03.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.689+0000 7f2b92ffd640 1 -- 172.21.15.18:0/1956829851 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b84037070 con 0x7f2b9415ed30 2024-09-19T09:17:03.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.690+0000 7f2b92ffd640 1 -- 172.21.15.18:0/1956829851 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b8402ae50 con 0x7f2b9415ed30 2024-09-19T09:17:03.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.690+0000 7f2b92ffd640 1 -- 172.21.15.18:0/1956829851 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b84032860 con 0x7f2b9415ed30 2024-09-19T09:17:03.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.690+0000 7f2b9a352640 1 -- 172.21.15.18:0/1956829851 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b9415ed30 msgr2=0x7f2b94070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.690+0000 7f2b9a352640 1 --2- 172.21.15.18:0/1956829851 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b9415ed30 0x7f2b94070260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2b84009870 tx=0x7f2b8402a300 comp rx=0 tx=0).stop 2024-09-19T09:17:03.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.690+0000 7f2b9a352640 1 -- 172.21.15.18:0/1956829851 shutdown_connections 2024-09-19T09:17:03.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.690+0000 7f2b9a352640 1 --2- 172.21.15.18:0/1956829851 >> v2:172.21.15.162:3300/0 conn(0x7f2b941630f0 0x7f2b940cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.690+0000 7f2b9a352640 1 --2- 172.21.15.18:0/1956829851 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b9415ed30 0x7f2b94070260 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.690+0000 7f2b9a352640 1 -- 172.21.15.18:0/1956829851 >> 172.21.15.18:0/1956829851 conn(0x7f2b940b4600 msgr2=0x7f2b940b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:03.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.690+0000 7f2b9a352640 1 -- 172.21.15.18:0/1956829851 shutdown_connections 2024-09-19T09:17:03.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.690+0000 7f2b9a352640 1 -- 172.21.15.18:0/1956829851 wait complete. 2024-09-19T09:17:03.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.691+0000 7f2b9a352640 1 Processor -- start 2024-09-19T09:17:03.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.691+0000 7f2b9a352640 1 -- start start 2024-09-19T09:17:03.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.692+0000 7f2b9a352640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b940b5200 0x7f2b94155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.692+0000 7f2b9a352640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b9415ed30 0x7f2b940cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.692+0000 7f2b9a352640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b941630f0 0x7f2b940cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.692+0000 7f2b9a352640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2b94070f10 con 0x7f2b9415ed30 2024-09-19T09:17:03.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.692+0000 7f2b9a352640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2b94070d90 con 0x7f2b940b5200 2024-09-19T09:17:03.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.692+0000 7f2b9a352640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2b9415f110 con 0x7f2b941630f0 2024-09-19T09:17:03.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.692+0000 7f2b937fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b9415ed30 0x7f2b940cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:03.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.692+0000 7f2b937fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b9415ed30 0x7f2b940cb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56042/0 (socket says 172.21.15.18:56042) 2024-09-19T09:17:03.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.692+0000 7f2b937fe640 1 -- 172.21.15.18:0/3150872518 learned_addr learned my addr 172.21.15.18:0/3150872518 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:03.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.692+0000 7f2b93fff640 1 --2- 172.21.15.18:0/3150872518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b940b5200 0x7f2b94155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:03.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.692+0000 7f2b988ef640 1 --2- 172.21.15.18:0/3150872518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b941630f0 0x7f2b940cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:03.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.693+0000 7f2b937fe640 1 -- 172.21.15.18:0/3150872518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b941630f0 msgr2=0x7f2b940cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.693+0000 7f2b937fe640 1 --2- 172.21.15.18:0/3150872518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b941630f0 0x7f2b940cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.693+0000 7f2b937fe640 1 -- 172.21.15.18:0/3150872518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b940b5200 msgr2=0x7f2b94155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.693+0000 7f2b937fe640 1 --2- 172.21.15.18:0/3150872518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b940b5200 0x7f2b94155c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.693+0000 7f2b937fe640 1 -- 172.21.15.18:0/3150872518 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b940cd120 con 0x7f2b9415ed30 2024-09-19T09:17:03.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.693+0000 7f2b937fe640 1 --2- 172.21.15.18:0/3150872518 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b9415ed30 0x7f2b940cb6a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800c440 tx=0x7f2b88001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:03.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.693+0000 7f2b90ff9640 1 -- 172.21.15.18:0/3150872518 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b880052d0 con 0x7f2b9415ed30 2024-09-19T09:17:03.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.693+0000 7f2b90ff9640 1 -- 172.21.15.18:0/3150872518 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b88005470 con 0x7f2b9415ed30 2024-09-19T09:17:03.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.693+0000 7f2b9a352640 1 -- 172.21.15.18:0/3150872518 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b940ce830 con 0x7f2b9415ed30 2024-09-19T09:17:03.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.693+0000 7f2b90ff9640 1 -- 172.21.15.18:0/3150872518 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b88007260 con 0x7f2b9415ed30 2024-09-19T09:17:03.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.693+0000 7f2b9a352640 1 -- 172.21.15.18:0/3150872518 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b940cd3c0 con 0x7f2b9415ed30 2024-09-19T09:17:03.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.694+0000 7f2b9a352640 1 -- 172.21.15.18:0/3150872518 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b940cd5c0 con 0x7f2b9415ed30 2024-09-19T09:17:03.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.695+0000 7f2b90ff9640 1 -- 172.21.15.18:0/3150872518 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2b88007400 con 0x7f2b9415ed30 2024-09-19T09:17:03.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.695+0000 7f2b90ff9640 1 --2- 172.21.15.18:0/3150872518 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2b8006c2e0 0x7f2b8006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:03.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.695+0000 7f2b90ff9640 1 -- 172.21.15.18:0/3150872518 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5767+0+0 (secure 0 0 0) 0x7f2b8808a980 con 0x7f2b9415ed30 2024-09-19T09:17:03.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.695+0000 7f2b90ff9640 1 -- 172.21.15.18:0/3150872518 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=77}) -- 0x7f2b80073ed0 con 0x7f2b9415ed30 2024-09-19T09:17:03.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.695+0000 7f2b93fff640 1 --2- 172.21.15.18:0/3150872518 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2b8006c2e0 0x7f2b8006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:03.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.696+0000 7f2b93fff640 1 --2- 172.21.15.18:0/3150872518 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2b8006c2e0 0x7f2b8006e7a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2b84034000 tx=0x7f2b8402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:03.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.699+0000 7f2b90ff9640 1 -- 172.21.15.18:0/3150872518 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2b940cd5c0 con 0x7f2b9415ed30 2024-09-19T09:17:03.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.977+0000 7f2b9a352640 1 -- 172.21.15.18:0/3150872518 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2b94070260 con 0x7f2b9415ed30 2024-09-19T09:17:03.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.977+0000 7f2b90ff9640 1 -- 172.21.15.18:0/3150872518 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5229 (secure 0 0 0) 0x7f2b880590b0 con 0x7f2b9415ed30 2024-09-19T09:17:03.978 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:17:03.978 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:15:33:667104+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3337833568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3337833568},{"type":"v1","addr":"172.21.15.162:6837","nonce":3337833568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1692924872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1692924872},{"type":"v1","addr":"172.21.15.162:6836","nonce":1692924872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5377,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2351287916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2351287916},{"type":"v1","addr":"172.21.15.18:6834","nonce":2351287916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:15:31.000055+0000","modified":"2024-09-19T09:15:33.010750+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5574},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5574":{"gid":5574,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/1824357592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1824357592},{"type":"v1","addr":"172.21.15.18:6835","nonce":1824357592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5574,"qdb_cluster":[5574]},"id":4}]} 2024-09-19T09:17:03.979 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:17:03.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.979+0000 7f2b9a352640 1 -- 172.21.15.18:0/3150872518 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2b8006c2e0 msgr2=0x7f2b8006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.979+0000 7f2b9a352640 1 --2- 172.21.15.18:0/3150872518 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2b8006c2e0 0x7f2b8006e7a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2b84034000 tx=0x7f2b8402e000 comp rx=0 tx=0).stop 2024-09-19T09:17:03.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.979+0000 7f2b9a352640 1 -- 172.21.15.18:0/3150872518 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b9415ed30 msgr2=0x7f2b940cb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:03.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.979+0000 7f2b9a352640 1 --2- 172.21.15.18:0/3150872518 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b9415ed30 0x7f2b940cb6a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2b8800c440 tx=0x7f2b88001e70 comp rx=0 tx=0).stop 2024-09-19T09:17:03.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.980+0000 7f2b9a352640 1 -- 172.21.15.18:0/3150872518 shutdown_connections 2024-09-19T09:17:03.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.980+0000 7f2b9a352640 1 --2- 172.21.15.18:0/3150872518 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2b8006c2e0 0x7f2b8006e7a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.980+0000 7f2b9a352640 1 --2- 172.21.15.18:0/3150872518 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b941630f0 0x7f2b940cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.980+0000 7f2b9a352640 1 --2- 172.21.15.18:0/3150872518 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b9415ed30 0x7f2b940cb6a0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.980+0000 7f2b9a352640 1 --2- 172.21.15.18:0/3150872518 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b940b5200 0x7f2b94155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:03.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.980+0000 7f2b9a352640 1 -- 172.21.15.18:0/3150872518 >> 172.21.15.18:0/3150872518 conn(0x7f2b940b4600 msgr2=0x7f2b940b3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:03.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.980+0000 7f2b9a352640 1 -- 172.21.15.18:0/3150872518 shutdown_connections 2024-09-19T09:17:03.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:03.980+0000 7f2b9a352640 1 -- 172.21.15.18:0/3150872518 wait complete. 2024-09-19T09:17:03.992 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:17:04.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.095+0000 7fcaa02dd640 1 Processor -- start 2024-09-19T09:17:04.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.095+0000 7fcaa02dd640 1 -- start start 2024-09-19T09:17:04.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.096+0000 7fcaa02dd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fca980cf560 0x7fca980cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:04.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.096+0000 7fcaa02dd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fca980ce600 0x7fca980b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:04.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.096+0000 7fcaa02dd640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca980d0e10 con 0x7fca980cfe80 2024-09-19T09:17:04.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.096+0000 7fcaa02dd640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fca980d0310 con 0x7fca980ce600 2024-09-19T09:17:04.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.096+0000 7fcaa02dd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fca980d0850 con 0x7fca980cf560 2024-09-19T09:17:04.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.096+0000 7fca9e87a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fca980ce600 0x7fca980b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:04.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.096+0000 7fca9d878640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fca980cfe80 0x7fca980b2cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50636/0 (socket says 172.21.15.18:50636) 2024-09-19T09:17:04.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.096+0000 7fca9d878640 1 -- 172.21.15.18:0/3301019226 learned_addr learned my addr 172.21.15.18:0/3301019226 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:17:04.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.096+0000 7fca9e079640 1 --2- 172.21.15.18:0/3301019226 >> v2:172.21.15.162:3300/0 conn(0x7fca980cf560 0x7fca980cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:04.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.096+0000 7fca9e87a640 1 -- 172.21.15.18:0/3301019226 >> v2:172.21.15.162:3300/0 conn(0x7fca980cf560 msgr2=0x7fca980cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:04.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.096+0000 7fca9e87a640 1 --2- 172.21.15.18:0/3301019226 >> v2:172.21.15.162:3300/0 conn(0x7fca980cf560 0x7fca980cf940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.096+0000 7fca9e87a640 1 -- 172.21.15.18:0/3301019226 >> v1:172.21.15.18:6789/0 conn(0x7fca980cfe80 legacy=0x7fca980b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:04.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.096+0000 7fca9e87a640 1 -- 172.21.15.18:0/3301019226 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca980d0b30 con 0x7fca980ce600 2024-09-19T09:17:04.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.097+0000 7fca9e87a640 1 --2- 172.21.15.18:0/3301019226 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca980ce600 0x7fca980b33e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fca98073b90 tx=0x7fca9002a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=841ecddaf440e55f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:04.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.097+0000 7fca9d077640 1 -- 172.21.15.18:0/3301019226 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca90007740 con 0x7fca980ce600 2024-09-19T09:17:04.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.097+0000 7fca9d077640 1 -- 172.21.15.18:0/3301019226 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca900078e0 con 0x7fca980ce600 2024-09-19T09:17:04.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.097+0000 7fca9d077640 1 -- 172.21.15.18:0/3301019226 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca90007cb0 con 0x7fca980ce600 2024-09-19T09:17:04.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.098+0000 7fcaa02dd640 1 -- 172.21.15.18:0/3301019226 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca980ce600 msgr2=0x7fca980b33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:04.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.098+0000 7fcaa02dd640 1 --2- 172.21.15.18:0/3301019226 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca980ce600 0x7fca980b33e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fca98073b90 tx=0x7fca9002a560 comp rx=0 tx=0).stop 2024-09-19T09:17:04.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.098+0000 7fcaa02dd640 1 -- 172.21.15.18:0/3301019226 shutdown_connections 2024-09-19T09:17:04.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.098+0000 7fcaa02dd640 1 --2- 172.21.15.18:0/3301019226 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca980ce600 0x7fca980b33e0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.098+0000 7fcaa02dd640 1 --2- 172.21.15.18:0/3301019226 >> v2:172.21.15.162:3300/0 conn(0x7fca980cf560 0x7fca980cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.098+0000 7fcaa02dd640 1 -- 172.21.15.18:0/3301019226 >> 172.21.15.18:0/3301019226 conn(0x7fca980b4700 msgr2=0x7fca980b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:04.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.098+0000 7fcaa02dd640 1 -- 172.21.15.18:0/3301019226 shutdown_connections 2024-09-19T09:17:04.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.098+0000 7fcaa02dd640 1 -- 172.21.15.18:0/3301019226 wait complete. 2024-09-19T09:17:04.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.099+0000 7fcaa02dd640 1 Processor -- start 2024-09-19T09:17:04.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.099+0000 7fcaa02dd640 1 -- start start 2024-09-19T09:17:04.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.100+0000 7fcaa02dd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca980ce600 0x7fca980c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:04.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.100+0000 7fcaa02dd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca980cf560 0x7fca980c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:04.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.100+0000 7fcaa02dd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca980cfe80 0x7fca980c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:04.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.100+0000 7fcaa02dd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fca980b5420 con 0x7fca980cfe80 2024-09-19T09:17:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.100+0000 7fcaa02dd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fca980b27b0 con 0x7fca980cf560 2024-09-19T09:17:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.100+0000 7fcaa02dd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fca980b55a0 con 0x7fca980ce600 2024-09-19T09:17:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.100+0000 7fca9e87a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca980cfe80 0x7fca980c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.100+0000 7fca9e87a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca980cfe80 0x7fca980c6bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56054/0 (socket says 172.21.15.18:56054) 2024-09-19T09:17:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.100+0000 7fca9e87a640 1 -- 172.21.15.18:0/1742270496 learned_addr learned my addr 172.21.15.18:0/1742270496 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.100+0000 7fca9e079640 1 --2- 172.21.15.18:0/1742270496 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca980ce600 0x7fca980c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.100+0000 7fca9d878640 1 --2- 172.21.15.18:0/1742270496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca980cf560 0x7fca980c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.100+0000 7fca9e87a640 1 -- 172.21.15.18:0/1742270496 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca980ce600 msgr2=0x7fca980c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.100+0000 7fca9e87a640 1 --2- 172.21.15.18:0/1742270496 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca980ce600 0x7fca980c80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.100+0000 7fca9e87a640 1 -- 172.21.15.18:0/1742270496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca980cf560 msgr2=0x7fca980c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.100+0000 7fca9e87a640 1 --2- 172.21.15.18:0/1742270496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca980cf560 0x7fca980c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.100+0000 7fca9e87a640 1 -- 172.21.15.18:0/1742270496 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca981580c0 con 0x7fca980cfe80 2024-09-19T09:17:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.100+0000 7fca9d878640 1 --2- 172.21.15.18:0/1742270496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca980cf560 0x7fca980c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:17:04.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.100+0000 7fca9e87a640 1 --2- 172.21.15.18:0/1742270496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca980cfe80 0x7fca980c6bc0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fca9002ab50 tx=0x7fca90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:04.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.100+0000 7fca8effd640 1 -- 172.21.15.18:0/1742270496 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca9003f070 con 0x7fca980cfe80 2024-09-19T09:17:04.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.100+0000 7fca8effd640 1 -- 172.21.15.18:0/1742270496 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca90031bc0 con 0x7fca980cfe80 2024-09-19T09:17:04.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.100+0000 7fcaa02dd640 1 -- 172.21.15.18:0/1742270496 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca98158360 con 0x7fca980cfe80 2024-09-19T09:17:04.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.100+0000 7fca8effd640 1 -- 172.21.15.18:0/1742270496 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca90009450 con 0x7fca980cfe80 2024-09-19T09:17:04.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.101+0000 7fcaa02dd640 1 -- 172.21.15.18:0/1742270496 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca98158920 con 0x7fca980cfe80 2024-09-19T09:17:04.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.101+0000 7fcaa02dd640 1 -- 172.21.15.18:0/1742270496 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca980703b0 con 0x7fca980cfe80 2024-09-19T09:17:04.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.102+0000 7fca8effd640 1 -- 172.21.15.18:0/1742270496 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fca9003b410 con 0x7fca980cfe80 2024-09-19T09:17:04.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.102+0000 7fca8effd640 1 --2- 172.21.15.18:0/1742270496 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fca7c06c2e0 0x7fca7c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:04.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.103+0000 7fca8effd640 1 -- 172.21.15.18:0/1742270496 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5767+0+0 (secure 0 0 0) 0x7fca900acbd0 con 0x7fca980cfe80 2024-09-19T09:17:04.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.103+0000 7fca9e079640 1 --2- 172.21.15.18:0/1742270496 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fca7c06c2e0 0x7fca7c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:04.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.103+0000 7fca8effd640 1 -- 172.21.15.18:0/1742270496 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=77}) -- 0x7fca7c073ed0 con 0x7fca980cfe80 2024-09-19T09:17:04.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.103+0000 7fca9e079640 1 --2- 172.21.15.18:0/1742270496 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fca7c06c2e0 0x7fca7c06e7a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fca94009970 tx=0x7fca94008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:04.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.107+0000 7fca8effd640 1 -- 172.21.15.18:0/1742270496 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fca9007b300 con 0x7fca980cfe80 2024-09-19T09:17:04.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.321+0000 7fcaa02dd640 1 -- 172.21.15.18:0/1742270496 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fca980755b0 con 0x7fca980cfe80 2024-09-19T09:17:04.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.322+0000 7fca8effd640 1 -- 172.21.15.18:0/1742270496 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5229 (secure 0 0 0) 0x7fca9007ac00 con 0x7fca980cfe80 2024-09-19T09:17:04.322 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:17:04.323 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:15:33:667104+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3337833568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3337833568},{"type":"v1","addr":"172.21.15.162:6837","nonce":3337833568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1692924872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1692924872},{"type":"v1","addr":"172.21.15.162:6836","nonce":1692924872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5377,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2351287916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2351287916},{"type":"v1","addr":"172.21.15.18:6834","nonce":2351287916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:15:31.000055+0000","modified":"2024-09-19T09:15:33.010750+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5574},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5574":{"gid":5574,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/1824357592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1824357592},{"type":"v1","addr":"172.21.15.18:6835","nonce":1824357592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5574,"qdb_cluster":[5574]},"id":4}]} 2024-09-19T09:17:04.323 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:17:04.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.324+0000 7fcaa02dd640 1 -- 172.21.15.18:0/1742270496 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fca7c06c2e0 msgr2=0x7fca7c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:04.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.324+0000 7fcaa02dd640 1 --2- 172.21.15.18:0/1742270496 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fca7c06c2e0 0x7fca7c06e7a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fca94009970 tx=0x7fca94008040 comp rx=0 tx=0).stop 2024-09-19T09:17:04.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.324+0000 7fcaa02dd640 1 -- 172.21.15.18:0/1742270496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca980cfe80 msgr2=0x7fca980c6bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:04.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.324+0000 7fcaa02dd640 1 --2- 172.21.15.18:0/1742270496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca980cfe80 0x7fca980c6bc0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fca9002ab50 tx=0x7fca90004a40 comp rx=0 tx=0).stop 2024-09-19T09:17:04.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.324+0000 7fcaa02dd640 1 -- 172.21.15.18:0/1742270496 shutdown_connections 2024-09-19T09:17:04.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.324+0000 7fcaa02dd640 1 --2- 172.21.15.18:0/1742270496 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fca7c06c2e0 0x7fca7c06e7a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.324+0000 7fcaa02dd640 1 --2- 172.21.15.18:0/1742270496 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca980cfe80 0x7fca980c6bc0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.324+0000 7fcaa02dd640 1 --2- 172.21.15.18:0/1742270496 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca980cf560 0x7fca980c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.324+0000 7fcaa02dd640 1 --2- 172.21.15.18:0/1742270496 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca980ce600 0x7fca980c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.324+0000 7fcaa02dd640 1 -- 172.21.15.18:0/1742270496 >> 172.21.15.18:0/1742270496 conn(0x7fca980b4700 msgr2=0x7fca980d2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:04.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.324+0000 7fcaa02dd640 1 -- 172.21.15.18:0/1742270496 shutdown_connections 2024-09-19T09:17:04.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.324+0000 7fcaa02dd640 1 -- 172.21.15.18:0/1742270496 wait complete. 2024-09-19T09:17:04.336 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:17:04.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.438+0000 7f986c952640 1 Processor -- start 2024-09-19T09:17:04.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.438+0000 7f986c952640 1 -- start start 2024-09-19T09:17:04.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.439+0000 7f986c952640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f986806d730 0x7f98680b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:04.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.439+0000 7f986c952640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98680cd1a0 con 0x7f986815ef80 2024-09-19T09:17:04.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.439+0000 7f986c952640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f986806dc30 con 0x7f98680cfae0 2024-09-19T09:17:04.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.439+0000 7f986c952640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f98680cd7d0 con 0x7f986806d730 2024-09-19T09:17:04.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.439+0000 7f9866d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f986806d730 0x7f98680b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:04.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.439+0000 7f9866d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f986806d730 0x7f98680b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56064/0 (socket says 172.21.15.18:56064) 2024-09-19T09:17:04.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.439+0000 7f9866d9d640 1 -- 172.21.15.18:0/546989369 learned_addr learned my addr 172.21.15.18:0/546989369 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:04.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.439+0000 7f986659c640 1 --1- 172.21.15.18:0/546989369 >> v1:172.21.15.18:6789/0 conn(0x7f986815ef80 0x7f98680cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50652/0 (socket says 172.21.15.18:50652) 2024-09-19T09:17:04.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.439+0000 7f9866d9d640 1 -- 172.21.15.18:0/546989369 >> v1:172.21.15.162:6789/0 conn(0x7f98680cfae0 legacy=0x7f98680cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:04.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.439+0000 7f9866d9d640 1 -- 172.21.15.18:0/546989369 >> v1:172.21.15.18:6789/0 conn(0x7f986815ef80 legacy=0x7f98680cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:04.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.439+0000 7f9866d9d640 1 -- 172.21.15.18:0/546989369 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f986806df10 con 0x7f986806d730 2024-09-19T09:17:04.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.440+0000 7f9866d9d640 1 --2- 172.21.15.18:0/546989369 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f986806d730 0x7f98680b5220 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9860009e50 tx=0x7f986002a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87da5ac40193214 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:04.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.440+0000 7f986559a640 1 -- 172.21.15.18:0/546989369 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9860036070 con 0x7f986806d730 2024-09-19T09:17:04.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.440+0000 7f986559a640 1 -- 172.21.15.18:0/546989369 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9860031600 con 0x7f986806d730 2024-09-19T09:17:04.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.440+0000 7f986559a640 1 -- 172.21.15.18:0/546989369 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98600319d0 con 0x7f986806d730 2024-09-19T09:17:04.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.441+0000 7f986c952640 1 -- 172.21.15.18:0/546989369 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f986806d730 msgr2=0x7f98680b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:04.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.441+0000 7f986c952640 1 --2- 172.21.15.18:0/546989369 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f986806d730 0x7f98680b5220 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f9860009e50 tx=0x7f986002a760 comp rx=0 tx=0).stop 2024-09-19T09:17:04.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.441+0000 7f986c952640 1 -- 172.21.15.18:0/546989369 shutdown_connections 2024-09-19T09:17:04.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.441+0000 7f986c952640 1 --2- 172.21.15.18:0/546989369 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f986806d730 0x7f98680b5220 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.441+0000 7f986c952640 1 -- 172.21.15.18:0/546989369 >> 172.21.15.18:0/546989369 conn(0x7f98680b4700 msgr2=0x7f98680b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:04.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.441+0000 7f986c952640 1 -- 172.21.15.18:0/546989369 shutdown_connections 2024-09-19T09:17:04.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.441+0000 7f986c952640 1 -- 172.21.15.18:0/546989369 wait complete. 2024-09-19T09:17:04.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.442+0000 7f986c952640 1 Processor -- start 2024-09-19T09:17:04.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.442+0000 7f986c952640 1 -- start start 2024-09-19T09:17:04.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.443+0000 7f986c952640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986806d730 0x7f98680c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:04.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.443+0000 7f986c952640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98680cfae0 0x7f986809e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:04.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.443+0000 7f986c952640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f986815ef80 0x7f9868151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:04.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.443+0000 7f986c952640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f98680d0120 con 0x7f986815ef80 2024-09-19T09:17:04.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.443+0000 7f986c952640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f986815f360 con 0x7f98680cfae0 2024-09-19T09:17:04.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.443+0000 7f986c952640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f98680ce370 con 0x7f986806d730 2024-09-19T09:17:04.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.443+0000 7f9866d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f986815ef80 0x7f9868151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:04.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.443+0000 7f9866d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f986815ef80 0x7f9868151040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56068/0 (socket says 172.21.15.18:56068) 2024-09-19T09:17:04.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.443+0000 7f9866d9d640 1 -- 172.21.15.18:0/3907029132 learned_addr learned my addr 172.21.15.18:0/3907029132 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:04.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.443+0000 7f9865d9b640 1 --2- 172.21.15.18:0/3907029132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98680cfae0 0x7f986809e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:04.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.443+0000 7f986659c640 1 --2- 172.21.15.18:0/3907029132 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986806d730 0x7f98680c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:04.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.443+0000 7f9866d9d640 1 -- 172.21.15.18:0/3907029132 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986806d730 msgr2=0x7f98680c92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:04.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.443+0000 7f9866d9d640 1 --2- 172.21.15.18:0/3907029132 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986806d730 0x7f98680c92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.443+0000 7f9866d9d640 1 -- 172.21.15.18:0/3907029132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98680cfae0 msgr2=0x7f986809e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:04.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.443+0000 7f9866d9d640 1 --2- 172.21.15.18:0/3907029132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98680cfae0 0x7f986809e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.443+0000 7f9866d9d640 1 -- 172.21.15.18:0/3907029132 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f986809e8a0 con 0x7f986815ef80 2024-09-19T09:17:04.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.443+0000 7f986659c640 1 --2- 172.21.15.18:0/3907029132 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986806d730 0x7f98680c92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:04.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.443+0000 7f9865d9b640 1 --2- 172.21.15.18:0/3907029132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98680cfae0 0x7f986809e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:04.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.443+0000 7f9866d9d640 1 --2- 172.21.15.18:0/3907029132 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f986815ef80 0x7f9868151040 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9860034040 tx=0x7f9860004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:04.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.444+0000 7f9856ffd640 1 -- 172.21.15.18:0/3907029132 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9860041020 con 0x7f986815ef80 2024-09-19T09:17:04.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.444+0000 7f9856ffd640 1 -- 172.21.15.18:0/3907029132 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98600077a0 con 0x7f986815ef80 2024-09-19T09:17:04.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.444+0000 7f986c952640 1 -- 172.21.15.18:0/3907029132 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9868151580 con 0x7f986815ef80 2024-09-19T09:17:04.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.444+0000 7f9856ffd640 1 -- 172.21.15.18:0/3907029132 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9860036040 con 0x7f986815ef80 2024-09-19T09:17:04.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.444+0000 7f986c952640 1 -- 172.21.15.18:0/3907029132 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f986809ee00 con 0x7f986815ef80 2024-09-19T09:17:04.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.445+0000 7f986c952640 1 -- 172.21.15.18:0/3907029132 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98680d07f0 con 0x7f986815ef80 2024-09-19T09:17:04.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.445+0000 7f9856ffd640 1 -- 172.21.15.18:0/3907029132 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9860044020 con 0x7f986815ef80 2024-09-19T09:17:04.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.446+0000 7f9856ffd640 1 --2- 172.21.15.18:0/3907029132 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f984806c2b0 0x7f984806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:04.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.446+0000 7f9856ffd640 1 -- 172.21.15.18:0/3907029132 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5767+0+0 (secure 0 0 0) 0x7f98600ac270 con 0x7f986815ef80 2024-09-19T09:17:04.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.446+0000 7f9856ffd640 1 -- 172.21.15.18:0/3907029132 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=77}) -- 0x7f9848073ea0 con 0x7f986815ef80 2024-09-19T09:17:04.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.446+0000 7f986659c640 1 --2- 172.21.15.18:0/3907029132 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f984806c2b0 0x7f984806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:04.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.446+0000 7f986659c640 1 --2- 172.21.15.18:0/3907029132 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f984806c2b0 0x7f984806e770 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9858007fd0 tx=0x7f9858007d60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:04.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.450+0000 7f9856ffd640 1 -- 172.21.15.18:0/3907029132 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f98680d07f0 con 0x7f986815ef80 2024-09-19T09:17:04.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.626+0000 7f986c952640 1 -- 172.21.15.18:0/3907029132 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f98680b5220 con 0x7f986815ef80 2024-09-19T09:17:04.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.627+0000 7f9856ffd640 1 -- 172.21.15.18:0/3907029132 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+16883 (secure 0 0 0) 0x7f986004b030 con 0x7f986815ef80 2024-09-19T09:17:04.628 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:17:04.629 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":76,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:16:17.817282+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:15:28.664467+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-19T09:15:29.990340+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["backfillfull","exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","full","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.2","mappings":[{"from":6,"to":1}]},{"pgid":"9.1c","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:17:04.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.629+0000 7f986c952640 1 -- 172.21.15.18:0/3907029132 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f984806c2b0 msgr2=0x7f984806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:04.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.629+0000 7f986c952640 1 --2- 172.21.15.18:0/3907029132 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f984806c2b0 0x7f984806e770 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9858007fd0 tx=0x7f9858007d60 comp rx=0 tx=0).stop 2024-09-19T09:17:04.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.629+0000 7f986c952640 1 -- 172.21.15.18:0/3907029132 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f986815ef80 msgr2=0x7f9868151040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:04.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.629+0000 7f986c952640 1 --2- 172.21.15.18:0/3907029132 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f986815ef80 0x7f9868151040 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9860034040 tx=0x7f9860004a40 comp rx=0 tx=0).stop 2024-09-19T09:17:04.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.629+0000 7f986c952640 1 -- 172.21.15.18:0/3907029132 shutdown_connections 2024-09-19T09:17:04.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.629+0000 7f986c952640 1 --2- 172.21.15.18:0/3907029132 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f984806c2b0 0x7f984806e770 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.629+0000 7f986c952640 1 --2- 172.21.15.18:0/3907029132 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f986815ef80 0x7f9868151040 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.629+0000 7f986c952640 1 --2- 172.21.15.18:0/3907029132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f98680cfae0 0x7f986809e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.629+0000 7f986c952640 1 --2- 172.21.15.18:0/3907029132 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f986806d730 0x7f98680c92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.629+0000 7f986c952640 1 -- 172.21.15.18:0/3907029132 >> 172.21.15.18:0/3907029132 conn(0x7f98680b4700 msgr2=0x7f98680b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:04.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.629+0000 7f986c952640 1 -- 172.21.15.18:0/3907029132 shutdown_connections 2024-09-19T09:17:04.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.629+0000 7f986c952640 1 -- 172.21.15.18:0/3907029132 wait complete. 2024-09-19T09:17:04.642 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T09:17:04.642 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:17:04.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.745+0000 7fb80a1fd640 1 Processor -- start 2024-09-19T09:17:04.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.745+0000 7fb80a1fd640 1 -- start start 2024-09-19T09:17:04.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.745+0000 7fb80a1fd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb80406c320 0x7fb8040b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:04.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.745+0000 7fb80a1fd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb8040ced00 0x7fb8040b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:04.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.745+0000 7fb80a1fd640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8040b6b20 con 0x7fb80415eea0 2024-09-19T09:17:04.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.745+0000 7fb80a1fd640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fb8040b6db0 con 0x7fb80406c320 2024-09-19T09:17:04.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.745+0000 7fb80a1fd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb8040b7070 con 0x7fb8040ced00 2024-09-19T09:17:04.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.746+0000 7fb802ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb80406c320 0x7fb8040b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:04.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.746+0000 7fb802ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb80406c320 0x7fb8040b60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56084/0 (socket says 172.21.15.18:56084) 2024-09-19T09:17:04.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.746+0000 7fb802ffd640 1 -- 172.21.15.18:0/569437184 learned_addr learned my addr 172.21.15.18:0/569437184 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:04.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.746+0000 7fb803fff640 1 --2- 172.21.15.18:0/569437184 >> v2:172.21.15.162:3300/0 conn(0x7fb8040ced00 0x7fb8040b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:04.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.746+0000 7fb802ffd640 1 -- 172.21.15.18:0/569437184 >> v2:172.21.15.162:3300/0 conn(0x7fb8040ced00 msgr2=0x7fb8040b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:04.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.746+0000 7fb802ffd640 1 --2- 172.21.15.18:0/569437184 >> v2:172.21.15.162:3300/0 conn(0x7fb8040ced00 0x7fb8040b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.746+0000 7fb802ffd640 1 -- 172.21.15.18:0/569437184 >> v1:172.21.15.162:6789/0 conn(0x7fb80415eea0 legacy=0x7fb80406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:04.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.746+0000 7fb802ffd640 1 -- 172.21.15.18:0/569437184 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8040b1390 con 0x7fb80406c320 2024-09-19T09:17:04.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.747+0000 7fb802ffd640 1 --2- 172.21.15.18:0/569437184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb80406c320 0x7fb8040b60a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fb80406d3d0 tx=0x7fb7f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f745705a030883 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:04.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.747+0000 7fb8027fc640 1 -- 172.21.15.18:0/569437184 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8037070 con 0x7fb80406c320 2024-09-19T09:17:04.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.747+0000 7fb8027fc640 1 -- 172.21.15.18:0/569437184 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7f8032440 con 0x7fb80406c320 2024-09-19T09:17:04.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.747+0000 7fb8027fc640 1 -- 172.21.15.18:0/569437184 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8032810 con 0x7fb80406c320 2024-09-19T09:17:04.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.747+0000 7fb80a1fd640 1 -- 172.21.15.18:0/569437184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb80406c320 msgr2=0x7fb8040b60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:04.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.747+0000 7fb80a1fd640 1 --2- 172.21.15.18:0/569437184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb80406c320 0x7fb8040b60a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fb80406d3d0 tx=0x7fb7f802a270 comp rx=0 tx=0).stop 2024-09-19T09:17:04.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.748+0000 7fb80a1fd640 1 -- 172.21.15.18:0/569437184 shutdown_connections 2024-09-19T09:17:04.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.748+0000 7fb80a1fd640 1 --2- 172.21.15.18:0/569437184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb80406c320 0x7fb8040b60a0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.748+0000 7fb80a1fd640 1 --2- 172.21.15.18:0/569437184 >> v2:172.21.15.162:3300/0 conn(0x7fb8040ced00 0x7fb8040b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.748+0000 7fb80a1fd640 1 -- 172.21.15.18:0/569437184 >> 172.21.15.18:0/569437184 conn(0x7fb8040731b0 msgr2=0x7fb8040735c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:04.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.748+0000 7fb80a1fd640 1 -- 172.21.15.18:0/569437184 shutdown_connections 2024-09-19T09:17:04.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.748+0000 7fb80a1fd640 1 -- 172.21.15.18:0/569437184 wait complete. 2024-09-19T09:17:04.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.749+0000 7fb80a1fd640 1 Processor -- start 2024-09-19T09:17:04.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.749+0000 7fb80a1fd640 1 -- start start 2024-09-19T09:17:04.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.750+0000 7fb80a1fd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb80406c320 0x7fb80414ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:04.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.750+0000 7fb80a1fd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8040ced00 0x7fb8041610c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:04.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.750+0000 7fb80a1fd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb80415eea0 0x7fb8040afa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:04.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.750+0000 7fb80a1fd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb8040b1040 con 0x7fb80415eea0 2024-09-19T09:17:04.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.750+0000 7fb80a1fd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb80415f280 con 0x7fb80406c320 2024-09-19T09:17:04.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.750+0000 7fb80a1fd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb8040b1b90 con 0x7fb8040ced00 2024-09-19T09:17:04.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.750+0000 7fb803fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb80415eea0 0x7fb8040afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:04.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.750+0000 7fb803fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb80415eea0 0x7fb8040afa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56088/0 (socket says 172.21.15.18:56088) 2024-09-19T09:17:04.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.750+0000 7fb803fff640 1 -- 172.21.15.18:0/280347759 learned_addr learned my addr 172.21.15.18:0/280347759 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:04.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.750+0000 7fb8037fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb80406c320 0x7fb80414ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:04.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.750+0000 7fb802ffd640 1 --2- 172.21.15.18:0/280347759 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8040ced00 0x7fb8041610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:04.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.750+0000 7fb803fff640 1 -- 172.21.15.18:0/280347759 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8040ced00 msgr2=0x7fb8041610c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:04.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.750+0000 7fb803fff640 1 --2- 172.21.15.18:0/280347759 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8040ced00 0x7fb8041610c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.750+0000 7fb803fff640 1 -- 172.21.15.18:0/280347759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb80406c320 msgr2=0x7fb80414ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:04.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.750+0000 7fb803fff640 1 --2- 172.21.15.18:0/280347759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb80406c320 0x7fb80414ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.750+0000 7fb803fff640 1 -- 172.21.15.18:0/280347759 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb80414f1c0 con 0x7fb80415eea0 2024-09-19T09:17:04.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.750+0000 7fb803fff640 1 --2- 172.21.15.18:0/280347759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb80415eea0 0x7fb8040afa20 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc00efc0 tx=0x7fb7fc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:04.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.750+0000 7fb7ebfff640 1 -- 172.21.15.18:0/280347759 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc018020 con 0x7fb80415eea0 2024-09-19T09:17:04.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.750+0000 7fb7ebfff640 1 -- 172.21.15.18:0/280347759 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7fc014480 con 0x7fb80415eea0 2024-09-19T09:17:04.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.750+0000 7fb80a1fd640 1 -- 172.21.15.18:0/280347759 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb80415bd20 con 0x7fb80415eea0 2024-09-19T09:17:04.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.750+0000 7fb7ebfff640 1 -- 172.21.15.18:0/280347759 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc014870 con 0x7fb80415eea0 2024-09-19T09:17:04.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.751+0000 7fb80a1fd640 1 -- 172.21.15.18:0/280347759 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb80415c2c0 con 0x7fb80415eea0 2024-09-19T09:17:04.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.751+0000 7fb80a1fd640 1 -- 172.21.15.18:0/280347759 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb80406bc10 con 0x7fb80415eea0 2024-09-19T09:17:04.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.752+0000 7fb7ebfff640 1 -- 172.21.15.18:0/280347759 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb7fc005d10 con 0x7fb80415eea0 2024-09-19T09:17:04.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.752+0000 7fb7ebfff640 1 --2- 172.21.15.18:0/280347759 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb7f006c2b0 0x7fb7f006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:04.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.753+0000 7fb7ebfff640 1 -- 172.21.15.18:0/280347759 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5767+0+0 (secure 0 0 0) 0x7fb7fc08be20 con 0x7fb80415eea0 2024-09-19T09:17:04.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.753+0000 7fb7ebfff640 1 -- 172.21.15.18:0/280347759 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=77}) -- 0x7fb7f0073ea0 con 0x7fb80415eea0 2024-09-19T09:17:04.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.753+0000 7fb8037fe640 1 --2- 172.21.15.18:0/280347759 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb7f006c2b0 0x7fb7f006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:04.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.753+0000 7fb8037fe640 1 --2- 172.21.15.18:0/280347759 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb7f006c2b0 0x7fb7f006e770 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40016e0 tx=0x7fb7f4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:04.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.757+0000 7fb7ebfff640 1 -- 172.21.15.18:0/280347759 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb7fc022070 con 0x7fb80415eea0 2024-09-19T09:17:04.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.966+0000 7fb80a1fd640 1 -- 172.21.15.18:0/280347759 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8040cf3c0 con 0x7fb80415eea0 2024-09-19T09:17:04.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.967+0000 7fb7ebfff640 1 -- 172.21.15.18:0/280347759 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5229 (secure 0 0 0) 0x7fb80414f1c0 con 0x7fb80415eea0 2024-09-19T09:17:04.968 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:17:04.968 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:15:33:667104+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3337833568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3337833568},{"type":"v1","addr":"172.21.15.162:6837","nonce":3337833568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1692924872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1692924872},{"type":"v1","addr":"172.21.15.162:6836","nonce":1692924872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5377,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2351287916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2351287916},{"type":"v1","addr":"172.21.15.18:6834","nonce":2351287916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:15:31.000055+0000","modified":"2024-09-19T09:15:33.010750+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5574},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5574":{"gid":5574,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/1824357592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1824357592},{"type":"v1","addr":"172.21.15.18:6835","nonce":1824357592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5574,"qdb_cluster":[5574]},"id":4}]} 2024-09-19T09:17:04.968 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:17:04.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.969+0000 7fb80a1fd640 1 -- 172.21.15.18:0/280347759 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb7f006c2b0 msgr2=0x7fb7f006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:04.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.969+0000 7fb80a1fd640 1 --2- 172.21.15.18:0/280347759 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb7f006c2b0 0x7fb7f006e770 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40016e0 tx=0x7fb7f4009040 comp rx=0 tx=0).stop 2024-09-19T09:17:04.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.969+0000 7fb80a1fd640 1 -- 172.21.15.18:0/280347759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb80415eea0 msgr2=0x7fb8040afa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:04.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.969+0000 7fb80a1fd640 1 --2- 172.21.15.18:0/280347759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb80415eea0 0x7fb8040afa20 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc00efc0 tx=0x7fb7fc00c490 comp rx=0 tx=0).stop 2024-09-19T09:17:04.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.969+0000 7fb80a1fd640 1 -- 172.21.15.18:0/280347759 shutdown_connections 2024-09-19T09:17:04.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.969+0000 7fb80a1fd640 1 --2- 172.21.15.18:0/280347759 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb7f006c2b0 0x7fb7f006e770 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.969+0000 7fb80a1fd640 1 --2- 172.21.15.18:0/280347759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb80415eea0 0x7fb8040afa20 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.969+0000 7fb80a1fd640 1 --2- 172.21.15.18:0/280347759 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8040ced00 0x7fb8041610c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.969+0000 7fb80a1fd640 1 --2- 172.21.15.18:0/280347759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb80406c320 0x7fb80414ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:04.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.969+0000 7fb80a1fd640 1 -- 172.21.15.18:0/280347759 >> 172.21.15.18:0/280347759 conn(0x7fb8040731b0 msgr2=0x7fb80406e870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:04.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.969+0000 7fb80a1fd640 1 -- 172.21.15.18:0/280347759 shutdown_connections 2024-09-19T09:17:04.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:04.969+0000 7fb80a1fd640 1 -- 172.21.15.18:0/280347759 wait complete. 2024-09-19T09:17:04.981 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:17:05.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.083+0000 7f5353eaf640 1 Processor -- start 2024-09-19T09:17:05.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.084+0000 7f5353eaf640 1 -- start start 2024-09-19T09:17:05.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.084+0000 7f5353eaf640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f534c15ef50 0x7f534c0d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.084+0000 7f5353eaf640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f534c0d3240 0x7f534c0d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.084+0000 7f5353eaf640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f534c0b7a90 con 0x7f534c0d5780 2024-09-19T09:17:05.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.084+0000 7f5353eaf640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f534c0d3740 con 0x7f534c0d3240 2024-09-19T09:17:05.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.084+0000 7f5353eaf640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f534c0d3a20 con 0x7f534c15ef50 2024-09-19T09:17:05.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.085+0000 7f535144a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f534c0d3240 0x7f534c0d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.085+0000 7f535244c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f534c0d5780 0x7f534c0cf770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:50654/0 (socket says 172.21.15.18:50654) 2024-09-19T09:17:05.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.085+0000 7f535244c640 1 -- 172.21.15.18:0/1793846517 learned_addr learned my addr 172.21.15.18:0/1793846517 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:17:05.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.085+0000 7f5351c4b640 1 --2- 172.21.15.18:0/1793846517 >> v2:172.21.15.162:3300/0 conn(0x7f534c15ef50 0x7f534c0d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.085+0000 7f535144a640 1 -- 172.21.15.18:0/1793846517 >> v2:172.21.15.162:3300/0 conn(0x7f534c15ef50 msgr2=0x7f534c0d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:05.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.085+0000 7f535144a640 1 --2- 172.21.15.18:0/1793846517 >> v2:172.21.15.162:3300/0 conn(0x7f534c15ef50 0x7f534c0d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.085+0000 7f535144a640 1 -- 172.21.15.18:0/1793846517 >> v1:172.21.15.18:6789/0 conn(0x7f534c0d5780 legacy=0x7f534c0cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.085+0000 7f535144a640 1 -- 172.21.15.18:0/1793846517 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f534c0b7d00 con 0x7f534c0d3240 2024-09-19T09:17:05.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.085+0000 7f5350c49640 1 -- 172.21.15.18:0/1793846517 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4210458352 0 0) 0x7f534c0b7a90 con 0x7f534c0d5780 2024-09-19T09:17:05.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.085+0000 7f5351c4b640 1 --2- 172.21.15.18:0/1793846517 >> v2:172.21.15.162:3300/0 conn(0x7f534c15ef50 0x7f534c0d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:17:05.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.086+0000 7f535144a640 1 --2- 172.21.15.18:0/1793846517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f534c0d3240 0x7f534c0d18e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f534c0b7850 tx=0x7f534002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a561115a79f8f07 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:05.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.086+0000 7f5350c49640 1 -- 172.21.15.18:0/1793846517 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5340037070 con 0x7f534c0d3240 2024-09-19T09:17:05.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.086+0000 7f5350c49640 1 -- 172.21.15.18:0/1793846517 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5340032440 con 0x7f534c0d3240 2024-09-19T09:17:05.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.086+0000 7f5350c49640 1 -- 172.21.15.18:0/1793846517 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f534002ae60 con 0x7f534c0d3240 2024-09-19T09:17:05.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.086+0000 7f5353eaf640 1 -- 172.21.15.18:0/1793846517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f534c0d3240 msgr2=0x7f534c0d18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.086+0000 7f5353eaf640 1 --2- 172.21.15.18:0/1793846517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f534c0d3240 0x7f534c0d18e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f534c0b7850 tx=0x7f534002a110 comp rx=0 tx=0).stop 2024-09-19T09:17:05.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.086+0000 7f5353eaf640 1 -- 172.21.15.18:0/1793846517 shutdown_connections 2024-09-19T09:17:05.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.086+0000 7f5353eaf640 1 --2- 172.21.15.18:0/1793846517 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f534c0d3240 0x7f534c0d18e0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.086+0000 7f5353eaf640 1 --2- 172.21.15.18:0/1793846517 >> v2:172.21.15.162:3300/0 conn(0x7f534c15ef50 0x7f534c0d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.086+0000 7f5353eaf640 1 -- 172.21.15.18:0/1793846517 >> 172.21.15.18:0/1793846517 conn(0x7f534c0d4c60 msgr2=0x7f534c0d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:05.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.086+0000 7f5353eaf640 1 -- 172.21.15.18:0/1793846517 shutdown_connections 2024-09-19T09:17:05.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.086+0000 7f5353eaf640 1 -- 172.21.15.18:0/1793846517 wait complete. 2024-09-19T09:17:05.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.088+0000 7f5353eaf640 1 Processor -- start 2024-09-19T09:17:05.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.088+0000 7f5353eaf640 1 -- start start 2024-09-19T09:17:05.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.088+0000 7f5353eaf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f534c0d3240 0x7f534c150120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.088+0000 7f5353eaf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f534c0d5780 0x7f534c1f4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.088+0000 7f5353eaf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f534c15ef50 0x7f534c0ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.088+0000 7f5353eaf640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f534c0d21a0 con 0x7f534c0d5780 2024-09-19T09:17:05.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.088+0000 7f5353eaf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f534c0d2020 con 0x7f534c0d3240 2024-09-19T09:17:05.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.088+0000 7f5353eaf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f534c0b9510 con 0x7f534c15ef50 2024-09-19T09:17:05.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.088+0000 7f535144a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f534c0d5780 0x7f534c1f4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.088+0000 7f535144a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f534c0d5780 0x7f534c1f4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56100/0 (socket says 172.21.15.18:56100) 2024-09-19T09:17:05.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.088+0000 7f535144a640 1 -- 172.21.15.18:0/1299721832 learned_addr learned my addr 172.21.15.18:0/1299721832 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:05.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.089+0000 7f535144a640 1 -- 172.21.15.18:0/1299721832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f534c15ef50 msgr2=0x7f534c0ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.089+0000 7f535144a640 1 --2- 172.21.15.18:0/1299721832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f534c15ef50 0x7f534c0ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.089+0000 7f535144a640 1 -- 172.21.15.18:0/1299721832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f534c0d3240 msgr2=0x7f534c150120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.089+0000 7f5351c4b640 1 --2- 172.21.15.18:0/1299721832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f534c0d3240 0x7f534c150120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.089+0000 7f535144a640 1 --2- 172.21.15.18:0/1299721832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f534c0d3240 0x7f534c150120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.089+0000 7f535144a640 1 -- 172.21.15.18:0/1299721832 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f534c0b1ae0 con 0x7f534c0d5780 2024-09-19T09:17:05.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.089+0000 7f535144a640 1 --2- 172.21.15.18:0/1299721832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f534c0d5780 0x7f534c1f4bd0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f5340000c00 tx=0x7f53400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:05.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.089+0000 7f534a7fc640 1 -- 172.21.15.18:0/1299721832 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5340041070 con 0x7f534c0d5780 2024-09-19T09:17:05.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.089+0000 7f534a7fc640 1 -- 172.21.15.18:0/1299721832 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f534003c890 con 0x7f534c0d5780 2024-09-19T09:17:05.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.089+0000 7f5353eaf640 1 -- 172.21.15.18:0/1299721832 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f534c0b1dc0 con 0x7f534c0d5780 2024-09-19T09:17:05.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.089+0000 7f534a7fc640 1 -- 172.21.15.18:0/1299721832 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5340037040 con 0x7f534c0d5780 2024-09-19T09:17:05.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.089+0000 7f5353eaf640 1 -- 172.21.15.18:0/1299721832 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f534c0b2380 con 0x7f534c0d5780 2024-09-19T09:17:05.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.090+0000 7f5353eaf640 1 -- 172.21.15.18:0/1299721832 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f534c0d13a0 con 0x7f534c0d5780 2024-09-19T09:17:05.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.091+0000 7f534a7fc640 1 -- 172.21.15.18:0/1299721832 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5340044070 con 0x7f534c0d5780 2024-09-19T09:17:05.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.091+0000 7f534a7fc640 1 --2- 172.21.15.18:0/1299721832 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f533806c2b0 0x7f533806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.091+0000 7f534a7fc640 1 -- 172.21.15.18:0/1299721832 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5767+0+0 (secure 0 0 0) 0x7f53400ac010 con 0x7f534c0d5780 2024-09-19T09:17:05.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.091+0000 7f534a7fc640 1 -- 172.21.15.18:0/1299721832 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=77}) -- 0x7f5338073ea0 con 0x7f534c0d5780 2024-09-19T09:17:05.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.091+0000 7f5351c4b640 1 --2- 172.21.15.18:0/1299721832 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f533806c2b0 0x7f533806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.092+0000 7f5351c4b640 1 --2- 172.21.15.18:0/1299721832 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f533806c2b0 0x7f533806e770 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f534400b840 tx=0x7f5344008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:05.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.095+0000 7f534a7fc640 1 -- 172.21.15.18:0/1299721832 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f534007a860 con 0x7f534c0d5780 2024-09-19T09:17:05.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.309+0000 7f5353eaf640 1 -- 172.21.15.18:0/1299721832 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f534c0d1a30 con 0x7f534c0d5780 2024-09-19T09:17:05.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.309+0000 7f534a7fc640 1 -- 172.21.15.18:0/1299721832 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+5229 (secure 0 0 0) 0x7f534007a160 con 0x7f534c0d5780 2024-09-19T09:17:05.310 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:17:05.310 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":28,"btime":"2024-09-19T09:15:33:667104+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3337833568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3337833568},{"type":"v1","addr":"172.21.15.162:6837","nonce":3337833568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1692924872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1692924872},{"type":"v1","addr":"172.21.15.162:6836","nonce":1692924872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5377,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2351287916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2351287916},{"type":"v1","addr":"172.21.15.18:6834","nonce":2351287916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:15:31.000055+0000","modified":"2024-09-19T09:15:33.010750+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5574},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5574":{"gid":5574,"name":"a","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/1824357592","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1824357592},{"type":"v1","addr":"172.21.15.18:6835","nonce":1824357592}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5574,"qdb_cluster":[5574]},"id":4}]} 2024-09-19T09:17:05.310 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 28 2024-09-19T09:17:05.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.311+0000 7f5353eaf640 1 -- 172.21.15.18:0/1299721832 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f533806c2b0 msgr2=0x7f533806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.311+0000 7f5353eaf640 1 --2- 172.21.15.18:0/1299721832 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f533806c2b0 0x7f533806e770 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f534400b840 tx=0x7f5344008040 comp rx=0 tx=0).stop 2024-09-19T09:17:05.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.312+0000 7f5353eaf640 1 -- 172.21.15.18:0/1299721832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f534c0d5780 msgr2=0x7f534c1f4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.312+0000 7f5353eaf640 1 --2- 172.21.15.18:0/1299721832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f534c0d5780 0x7f534c1f4bd0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f5340000c00 tx=0x7f53400046c0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.312+0000 7f5353eaf640 1 -- 172.21.15.18:0/1299721832 shutdown_connections 2024-09-19T09:17:05.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.312+0000 7f5353eaf640 1 --2- 172.21.15.18:0/1299721832 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f533806c2b0 0x7f533806e770 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.312+0000 7f5353eaf640 1 --2- 172.21.15.18:0/1299721832 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f534c15ef50 0x7f534c0ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.312+0000 7f5353eaf640 1 --2- 172.21.15.18:0/1299721832 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f534c0d5780 0x7f534c1f4bd0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.312+0000 7f5353eaf640 1 --2- 172.21.15.18:0/1299721832 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f534c0d3240 0x7f534c150120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.312+0000 7f5353eaf640 1 -- 172.21.15.18:0/1299721832 >> 172.21.15.18:0/1299721832 conn(0x7f534c0d4c60 msgr2=0x7f534c0cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:05.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.312+0000 7f5353eaf640 1 -- 172.21.15.18:0/1299721832 shutdown_connections 2024-09-19T09:17:05.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.312+0000 7f5353eaf640 1 -- 172.21.15.18:0/1299721832 wait complete. 2024-09-19T09:17:05.323 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:17:05.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.425+0000 7fe1aa29b640 1 Processor -- start 2024-09-19T09:17:05.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.425+0000 7fe1aa29b640 1 -- start start 2024-09-19T09:17:05.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.426+0000 7fe1aa29b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1a415ef50 0x7fe1a40d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.426+0000 7fe1aa29b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1a40b7a90 con 0x7fe1a40b9510 2024-09-19T09:17:05.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.426+0000 7fe1aa29b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1a40d3740 con 0x7fe1a40d3240 2024-09-19T09:17:05.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.426+0000 7fe1aa29b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe1a40d3a20 con 0x7fe1a415ef50 2024-09-19T09:17:05.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.426+0000 7fe1a8838640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe1a40b9510 0x7fe1a40cfe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57538/0 (socket says 172.21.15.18:57538) 2024-09-19T09:17:05.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.426+0000 7fe1a8838640 1 -- 172.21.15.18:0/3666317838 learned_addr learned my addr 172.21.15.18:0/3666317838 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:17:05.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.427+0000 7fe1a3fff640 1 --2- 172.21.15.18:0/3666317838 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1a415ef50 0x7fe1a40d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.427+0000 7fe1a2ffd640 1 -- 172.21.15.18:0/3666317838 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1567399679 0 0) 0x7fe1a40b7a90 con 0x7fe1a40b9510 2024-09-19T09:17:05.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.427+0000 7fe1a2ffd640 1 -- 172.21.15.18:0/3666317838 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe18c003520 con 0x7fe1a40b9510 2024-09-19T09:17:05.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.427+0000 7fe1a2ffd640 1 -- 172.21.15.18:0/3666317838 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 762076253 0 0) 0x7fe1a40d3740 con 0x7fe1a40d3240 2024-09-19T09:17:05.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.427+0000 7fe1a2ffd640 1 -- 172.21.15.18:0/3666317838 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1a40b7a90 con 0x7fe1a40d3240 2024-09-19T09:17:05.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.427+0000 7fe1a2ffd640 1 -- 172.21.15.18:0/3666317838 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3262262603 0 0) 0x7fe18c003520 con 0x7fe1a40b9510 2024-09-19T09:17:05.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.427+0000 7fe1a2ffd640 1 -- 172.21.15.18:0/3666317838 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1a415ef50 msgr2=0x7fe1a40d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:05.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.427+0000 7fe1a2ffd640 1 --2- 172.21.15.18:0/3666317838 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1a415ef50 0x7fe1a40d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.427+0000 7fe1a2ffd640 1 -- 172.21.15.18:0/3666317838 >> v1:172.21.15.162:6789/0 conn(0x7fe1a40d3240 legacy=0x7fe1a40cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.427+0000 7fe1a2ffd640 1 -- 172.21.15.18:0/3666317838 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a40b7d00 con 0x7fe1a40b9510 2024-09-19T09:17:05.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.427+0000 7fe1a2ffd640 1 -- 172.21.15.18:0/3666317838 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fe19c0019f0 con 0x7fe1a40b9510 2024-09-19T09:17:05.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.427+0000 7fe1a2ffd640 1 -- 172.21.15.18:0/3666317838 >> v1:172.21.15.18:6789/0 conn(0x7fe1a40b9510 legacy=0x7fe1a40cfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.427+0000 7fe1a2ffd640 1 --2- 172.21.15.18:0/3666317838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe18c003b70 0x7fe18c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.427+0000 7fe1a2ffd640 1 --2- 172.21.15.18:0/3666317838 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe18c004800 0x7fe18c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.427+0000 7fe1a2ffd640 1 --2- 172.21.15.18:0/3666317838 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1a415ef50 0x7fe18c005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.427+0000 7fe1a2ffd640 1 -- 172.21.15.18:0/3666317838 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a40d3a20 con 0x7fe18c003b70 2024-09-19T09:17:05.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.427+0000 7fe1a2ffd640 1 -- 172.21.15.18:0/3666317838 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe18c00bb50 con 0x7fe18c004800 2024-09-19T09:17:05.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.427+0000 7fe1a2ffd640 1 -- 172.21.15.18:0/3666317838 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe18c00bd20 con 0x7fe1a415ef50 2024-09-19T09:17:05.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.427+0000 7fe1a3fff640 1 --2- 172.21.15.18:0/3666317838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe18c003b70 0x7fe18c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.427+0000 7fe1a8838640 1 --2- 172.21.15.18:0/3666317838 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1a415ef50 0x7fe18c005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.427+0000 7fe1a37fe640 1 --2- 172.21.15.18:0/3666317838 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe18c004800 0x7fe18c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.427+0000 7fe1a3fff640 1 -- 172.21.15.18:0/3666317838 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1a415ef50 msgr2=0x7fe18c005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:05.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.428+0000 7fe1a3fff640 1 --2- 172.21.15.18:0/3666317838 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1a415ef50 0x7fe18c005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.428+0000 7fe1a3fff640 1 -- 172.21.15.18:0/3666317838 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe18c004800 msgr2=0x7fe18c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:05.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.428+0000 7fe1a3fff640 1 --2- 172.21.15.18:0/3666317838 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe18c004800 0x7fe18c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.428+0000 7fe1a3fff640 1 -- 172.21.15.18:0/3666317838 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe18c003520 con 0x7fe18c003b70 2024-09-19T09:17:05.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.428+0000 7fe1a37fe640 1 --2- 172.21.15.18:0/3666317838 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe18c004800 0x7fe18c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:05.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.428+0000 7fe1a3fff640 1 --2- 172.21.15.18:0/3666317838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe18c003b70 0x7fe18c003f70 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe194009af0 tx=0x7fe18c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741825876a30eeff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:05.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.428+0000 7fe1a2ffd640 1 -- 172.21.15.18:0/3666317838 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe194036070 con 0x7fe18c003b70 2024-09-19T09:17:05.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.428+0000 7fe1a2ffd640 1 -- 172.21.15.18:0/3666317838 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe194031400 con 0x7fe18c003b70 2024-09-19T09:17:05.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.428+0000 7fe1a2ffd640 1 -- 172.21.15.18:0/3666317838 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe194009690 con 0x7fe18c003b70 2024-09-19T09:17:05.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.429+0000 7fe1aa29b640 1 -- 172.21.15.18:0/3666317838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe18c003b70 msgr2=0x7fe18c003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.429+0000 7fe1aa29b640 1 --2- 172.21.15.18:0/3666317838 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe18c003b70 0x7fe18c003f70 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe194009af0 tx=0x7fe18c005830 comp rx=0 tx=0).stop 2024-09-19T09:17:05.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.429+0000 7fe1a8838640 1 -- 172.21.15.18:0/3666317838 reap_dead start 2024-09-19T09:17:05.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.429+0000 7fe1aa29b640 1 -- 172.21.15.18:0/3666317838 shutdown_connections 2024-09-19T09:17:05.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.429+0000 7fe1aa29b640 1 -- 172.21.15.18:0/3666317838 >> 172.21.15.18:0/3666317838 conn(0x7fe1a40d4c60 msgr2=0x7fe1a40d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:05.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.429+0000 7fe1aa29b640 1 -- 172.21.15.18:0/3666317838 shutdown_connections 2024-09-19T09:17:05.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.429+0000 7fe1aa29b640 1 -- 172.21.15.18:0/3666317838 wait complete. 2024-09-19T09:17:05.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.430+0000 7fe1aa29b640 1 Processor -- start 2024-09-19T09:17:05.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.430+0000 7fe1aa29b640 1 -- start start 2024-09-19T09:17:05.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.431+0000 7fe1aa29b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe18c003b70 0x7fe1a4158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.431+0000 7fe1aa29b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1a41f4ad0 0x7fe1a415b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.431+0000 7fe1aa29b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1a40b5e90 0x7fe1a40b6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.431+0000 7fe1aa29b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a40d2020 con 0x7fe1a41f4ad0 2024-09-19T09:17:05.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.431+0000 7fe1aa29b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a40d0590 con 0x7fe18c003b70 2024-09-19T09:17:05.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.431+0000 7fe1aa29b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe1a40d21a0 con 0x7fe1a40b5e90 2024-09-19T09:17:05.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.431+0000 7fe1a37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1a41f4ad0 0x7fe1a415b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.431+0000 7fe1a37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1a41f4ad0 0x7fe1a415b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50938/0 (socket says 172.21.15.18:50938) 2024-09-19T09:17:05.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.431+0000 7fe1a37fe640 1 -- 172.21.15.18:0/1004809037 learned_addr learned my addr 172.21.15.18:0/1004809037 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:05.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.432+0000 7fe1a3fff640 1 --2- 172.21.15.18:0/1004809037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe18c003b70 0x7fe1a4158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.432+0000 7fe1a8838640 1 --2- 172.21.15.18:0/1004809037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1a40b5e90 0x7fe1a40b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.432+0000 7fe1a37fe640 1 -- 172.21.15.18:0/1004809037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1a40b5e90 msgr2=0x7fe1a40b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.432+0000 7fe1a37fe640 1 --2- 172.21.15.18:0/1004809037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1a40b5e90 0x7fe1a40b6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.432+0000 7fe1a37fe640 1 -- 172.21.15.18:0/1004809037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe18c003b70 msgr2=0x7fe1a4158ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.432+0000 7fe1a37fe640 1 --2- 172.21.15.18:0/1004809037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe18c003b70 0x7fe1a4158ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.432+0000 7fe1a37fe640 1 -- 172.21.15.18:0/1004809037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a415b8a0 con 0x7fe1a41f4ad0 2024-09-19T09:17:05.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.432+0000 7fe1a3fff640 1 --2- 172.21.15.18:0/1004809037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe18c003b70 0x7fe1a4158ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:17:05.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.432+0000 7fe1a37fe640 1 --2- 172.21.15.18:0/1004809037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1a41f4ad0 0x7fe1a415b050 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe19800e550 tx=0x7fe19800ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:05.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.432+0000 7fe1a0ff9640 1 -- 172.21.15.18:0/1004809037 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1980052e0 con 0x7fe1a41f4ad0 2024-09-19T09:17:05.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.432+0000 7fe1a0ff9640 1 -- 172.21.15.18:0/1004809037 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe198007030 con 0x7fe1a41f4ad0 2024-09-19T09:17:05.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.432+0000 7fe1aa29b640 1 -- 172.21.15.18:0/1004809037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1a415bb80 con 0x7fe1a41f4ad0 2024-09-19T09:17:05.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.432+0000 7fe1a0ff9640 1 -- 172.21.15.18:0/1004809037 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1980073e0 con 0x7fe1a41f4ad0 2024-09-19T09:17:05.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.432+0000 7fe1aa29b640 1 -- 172.21.15.18:0/1004809037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1a415b590 con 0x7fe1a41f4ad0 2024-09-19T09:17:05.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.433+0000 7fe1aa29b640 1 -- 172.21.15.18:0/1004809037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1a40d40c0 con 0x7fe1a41f4ad0 2024-09-19T09:17:05.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.434+0000 7fe1a0ff9640 1 -- 172.21.15.18:0/1004809037 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe1980067d0 con 0x7fe1a41f4ad0 2024-09-19T09:17:05.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.434+0000 7fe1a0ff9640 1 --2- 172.21.15.18:0/1004809037 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe19006c2e0 0x7fe19006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.434+0000 7fe1a0ff9640 1 -- 172.21.15.18:0/1004809037 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5767+0+0 (secure 0 0 0) 0x7fe19808af90 con 0x7fe1a41f4ad0 2024-09-19T09:17:05.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.434+0000 7fe1a0ff9640 1 -- 172.21.15.18:0/1004809037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=77}) -- 0x7fe190073ed0 con 0x7fe1a41f4ad0 2024-09-19T09:17:05.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.435+0000 7fe1a3fff640 1 --2- 172.21.15.18:0/1004809037 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe19006c2e0 0x7fe19006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.435+0000 7fe1a3fff640 1 --2- 172.21.15.18:0/1004809037 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe19006c2e0 0x7fe19006e7a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe194033000 tx=0x7fe194008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:05.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.439+0000 7fe1a0ff9640 1 -- 172.21.15.18:0/1004809037 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe1a40d40c0 con 0x7fe1a41f4ad0 2024-09-19T09:17:05.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.615+0000 7fe1aa29b640 1 -- 172.21.15.18:0/1004809037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe1a40d5780 con 0x7fe1a41f4ad0 2024-09-19T09:17:05.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.616+0000 7fe1a0ff9640 1 -- 172.21.15.18:0/1004809037 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+16883 (secure 0 0 0) 0x7fe1980596c0 con 0x7fe1a41f4ad0 2024-09-19T09:17:05.617 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:17:05.617 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":76,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:16:17.817282+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:15:28.664467+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-19T09:15:29.990340+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["backfillfull","exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","full","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.2","mappings":[{"from":6,"to":1}]},{"pgid":"9.1c","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:17:05.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.618+0000 7fe1aa29b640 1 -- 172.21.15.18:0/1004809037 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe19006c2e0 msgr2=0x7fe19006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.618+0000 7fe1aa29b640 1 --2- 172.21.15.18:0/1004809037 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe19006c2e0 0x7fe19006e7a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe194033000 tx=0x7fe194008030 comp rx=0 tx=0).stop 2024-09-19T09:17:05.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.618+0000 7fe1aa29b640 1 -- 172.21.15.18:0/1004809037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1a41f4ad0 msgr2=0x7fe1a415b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.618+0000 7fe1aa29b640 1 --2- 172.21.15.18:0/1004809037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1a41f4ad0 0x7fe1a415b050 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fe19800e550 tx=0x7fe19800ea10 comp rx=0 tx=0).stop 2024-09-19T09:17:05.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.618+0000 7fe1aa29b640 1 -- 172.21.15.18:0/1004809037 shutdown_connections 2024-09-19T09:17:05.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.618+0000 7fe1aa29b640 1 --2- 172.21.15.18:0/1004809037 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe19006c2e0 0x7fe19006e7a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.618+0000 7fe1aa29b640 1 --2- 172.21.15.18:0/1004809037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1a40b5e90 0x7fe1a40b6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.618+0000 7fe1aa29b640 1 --2- 172.21.15.18:0/1004809037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe1a41f4ad0 0x7fe1a415b050 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.618+0000 7fe1aa29b640 1 --2- 172.21.15.18:0/1004809037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe18c003b70 0x7fe1a4158ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.618+0000 7fe1aa29b640 1 -- 172.21.15.18:0/1004809037 >> 172.21.15.18:0/1004809037 conn(0x7fe1a40d4c60 msgr2=0x7fe1a406c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:05.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.618+0000 7fe1aa29b640 1 -- 172.21.15.18:0/1004809037 shutdown_connections 2024-09-19T09:17:05.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.618+0000 7fe1aa29b640 1 -- 172.21.15.18:0/1004809037 wait complete. 2024-09-19T09:17:05.630 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-19T09:17:05.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.732+0000 7f63bd2ba640 1 Processor -- start 2024-09-19T09:17:05.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.732+0000 7f63bd2ba640 1 -- start start 2024-09-19T09:17:05.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.733+0000 7f63bd2ba640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f63b815db60 0x7f63b8071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.733+0000 7f63bd2ba640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63b80724d0 0x7f63b806e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.733+0000 7f63bd2ba640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f63b806e580 0x7f63b8160580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.733+0000 7f63bd2ba640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f63b815df40 con 0x7f63b815db60 2024-09-19T09:17:05.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.733+0000 7f63bd2ba640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f63b806e9b0 con 0x7f63b806e580 2024-09-19T09:17:05.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.733+0000 7f63bd2ba640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f63b8153e50 con 0x7f63b80724d0 2024-09-19T09:17:05.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.733+0000 7f63b6ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f63b815db60 0x7f63b8071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.733+0000 7f63b6ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f63b815db60 0x7f63b8071f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50948/0 (socket says 172.21.15.18:50948) 2024-09-19T09:17:05.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.733+0000 7f63b6ffd640 1 -- 172.21.15.18:0/1144121497 learned_addr learned my addr 172.21.15.18:0/1144121497 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:05.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.733+0000 7f63b77fe640 1 --2- 172.21.15.18:0/1144121497 >> v2:172.21.15.162:3300/0 conn(0x7f63b806e580 0x7f63b8160580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.733+0000 7f63b67fc640 1 --2- 172.21.15.18:0/1144121497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63b80724d0 0x7f63b806e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.733+0000 7f63b6ffd640 1 -- 172.21.15.18:0/1144121497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63b80724d0 msgr2=0x7f63b806e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:05.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.733+0000 7f63b6ffd640 1 --2- 172.21.15.18:0/1144121497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63b80724d0 0x7f63b806e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.733+0000 7f63b6ffd640 1 -- 172.21.15.18:0/1144121497 >> v2:172.21.15.162:3300/0 conn(0x7f63b806e580 msgr2=0x7f63b8160580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:05.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.733+0000 7f63b6ffd640 1 --2- 172.21.15.18:0/1144121497 >> v2:172.21.15.162:3300/0 conn(0x7f63b806e580 0x7f63b8160580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.733+0000 7f63b6ffd640 1 -- 172.21.15.18:0/1144121497 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b8072ac0 con 0x7f63b815db60 2024-09-19T09:17:05.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.734+0000 7f63b6ffd640 1 --2- 172.21.15.18:0/1144121497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63b815db60 0x7f63b8071f90 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f63b815cf90 tx=0x7f63a802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92525b30707a8f27 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:05.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.734+0000 7f63b5ffb640 1 -- 172.21.15.18:0/1144121497 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a8037070 con 0x7f63b815db60 2024-09-19T09:17:05.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.734+0000 7f63b5ffb640 1 -- 172.21.15.18:0/1144121497 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63a8032440 con 0x7f63b815db60 2024-09-19T09:17:05.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.734+0000 7f63b5ffb640 1 -- 172.21.15.18:0/1144121497 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a8032810 con 0x7f63b815db60 2024-09-19T09:17:05.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.735+0000 7f63bd2ba640 1 -- 172.21.15.18:0/1144121497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63b815db60 msgr2=0x7f63b8071f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.735+0000 7f63bd2ba640 1 --2- 172.21.15.18:0/1144121497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63b815db60 0x7f63b8071f90 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f63b815cf90 tx=0x7f63a802a210 comp rx=0 tx=0).stop 2024-09-19T09:17:05.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.735+0000 7f63bd2ba640 1 -- 172.21.15.18:0/1144121497 shutdown_connections 2024-09-19T09:17:05.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.735+0000 7f63bd2ba640 1 --2- 172.21.15.18:0/1144121497 >> v2:172.21.15.162:3300/0 conn(0x7f63b806e580 0x7f63b8160580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.735+0000 7f63bd2ba640 1 --2- 172.21.15.18:0/1144121497 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63b80724d0 0x7f63b806e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.735+0000 7f63bd2ba640 1 --2- 172.21.15.18:0/1144121497 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63b815db60 0x7f63b8071f90 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.735+0000 7f63bd2ba640 1 -- 172.21.15.18:0/1144121497 >> 172.21.15.18:0/1144121497 conn(0x7f63b80b2630 msgr2=0x7f63b80b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:05.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.735+0000 7f63bd2ba640 1 -- 172.21.15.18:0/1144121497 shutdown_connections 2024-09-19T09:17:05.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.735+0000 7f63bd2ba640 1 -- 172.21.15.18:0/1144121497 wait complete. 2024-09-19T09:17:05.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.736+0000 7f63bd2ba640 1 Processor -- start 2024-09-19T09:17:05.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.736+0000 7f63bd2ba640 1 -- start start 2024-09-19T09:17:05.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.737+0000 7f63bd2ba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63b806e580 0x7f63b814bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.737+0000 7f63bd2ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63b80724d0 0x7f63b80b4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.737+0000 7f63bd2ba640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63b815db60 0x7f63b80b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.737+0000 7f63bd2ba640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f63b8073360 con 0x7f63b806e580 2024-09-19T09:17:05.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.737+0000 7f63bd2ba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f63b8073080 con 0x7f63b80724d0 2024-09-19T09:17:05.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.737+0000 7f63bd2ba640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f63b8073640 con 0x7f63b815db60 2024-09-19T09:17:05.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.737+0000 7f63b6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63b806e580 0x7f63b814bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.737+0000 7f63b6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63b806e580 0x7f63b814bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50952/0 (socket says 172.21.15.18:50952) 2024-09-19T09:17:05.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.737+0000 7f63b6ffd640 1 -- 172.21.15.18:0/2274808380 learned_addr learned my addr 172.21.15.18:0/2274808380 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:05.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.737+0000 7f63b67fc640 1 --2- 172.21.15.18:0/2274808380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63b80724d0 0x7f63b80b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.737+0000 7f63b77fe640 1 --2- 172.21.15.18:0/2274808380 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63b815db60 0x7f63b80b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.737+0000 7f63b6ffd640 1 -- 172.21.15.18:0/2274808380 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63b815db60 msgr2=0x7f63b80b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.737+0000 7f63b6ffd640 1 --2- 172.21.15.18:0/2274808380 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63b815db60 0x7f63b80b05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.737+0000 7f63b6ffd640 1 -- 172.21.15.18:0/2274808380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63b80724d0 msgr2=0x7f63b80b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.737+0000 7f63b6ffd640 1 --2- 172.21.15.18:0/2274808380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63b80724d0 0x7f63b80b4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.737+0000 7f63b6ffd640 1 -- 172.21.15.18:0/2274808380 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b80afdc0 con 0x7f63b806e580 2024-09-19T09:17:05.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.737+0000 7f63b67fc640 1 --2- 172.21.15.18:0/2274808380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63b80724d0 0x7f63b80b4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:17:05.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.738+0000 7f63b6ffd640 1 --2- 172.21.15.18:0/2274808380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63b806e580 0x7f63b814bf60 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f63a802a250 tx=0x7f63a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:05.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.738+0000 7f639f7fe640 1 -- 172.21.15.18:0/2274808380 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a8041020 con 0x7f63b806e580 2024-09-19T09:17:05.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.738+0000 7f639f7fe640 1 -- 172.21.15.18:0/2274808380 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63a80306c0 con 0x7f63b806e580 2024-09-19T09:17:05.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.738+0000 7f63bd2ba640 1 -- 172.21.15.18:0/2274808380 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63b80aed20 con 0x7f63b806e580 2024-09-19T09:17:05.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.738+0000 7f639f7fe640 1 -- 172.21.15.18:0/2274808380 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a8037040 con 0x7f63b806e580 2024-09-19T09:17:05.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.738+0000 7f63bd2ba640 1 -- 172.21.15.18:0/2274808380 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63b80af2e0 con 0x7f63b806e580 2024-09-19T09:17:05.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.739+0000 7f63bd2ba640 1 -- 172.21.15.18:0/2274808380 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63b815d1c0 con 0x7f63b806e580 2024-09-19T09:17:05.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.739+0000 7f639f7fe640 1 -- 172.21.15.18:0/2274808380 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f63a8044020 con 0x7f63b806e580 2024-09-19T09:17:05.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.740+0000 7f639f7fe640 1 --2- 172.21.15.18:0/2274808380 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f63a406c2b0 0x7f63a406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:05.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.740+0000 7f639f7fe640 1 -- 172.21.15.18:0/2274808380 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 5767+0+0 (secure 0 0 0) 0x7f63a80abd10 con 0x7f63b806e580 2024-09-19T09:17:05.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.740+0000 7f639f7fe640 1 -- 172.21.15.18:0/2274808380 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=77}) -- 0x7f63a4073ea0 con 0x7f63b806e580 2024-09-19T09:17:05.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.740+0000 7f63b67fc640 1 --2- 172.21.15.18:0/2274808380 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f63a406c2b0 0x7f63a406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:05.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.741+0000 7f63b67fc640 1 --2- 172.21.15.18:0/2274808380 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f63a406c2b0 0x7f63a406e770 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f63b8153800 tx=0x7f63ac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:05.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.744+0000 7f639f7fe640 1 -- 172.21.15.18:0/2274808380 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f63a804b030 con 0x7f63b806e580 2024-09-19T09:17:05.948 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-19T09:17:05.947+0000 7fca8cfa1640 -1 log_channel(cluster) log [ERR] : Health check update: 1 full osd(s) (OSD_FULL) 2024-09-19T09:17:05.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.951+0000 7f639f7fe640 1 -- 172.21.15.18:0/2274808380 <== mon.0 v2:172.21.15.18:3300/0 7 ==== osd_map(77..77 src has 1..77) ==== 304+0+0 (secure 0 0 0) 0x7f63a80b0070 con 0x7f63b806e580 2024-09-19T09:17:05.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.951+0000 7f639f7fe640 1 -- 172.21.15.18:0/2274808380 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=78}) -- 0x7f63a4074790 con 0x7f63b806e580 2024-09-19T09:17:05.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.956+0000 7f63bd2ba640 1 -- 172.21.15.18:0/2274808380 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f63b8153890 con 0x7f63b806e580 2024-09-19T09:17:05.957 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-19T09:17:05.957+0000 7fca8a79c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:17:05.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.958+0000 7f639f7fe640 1 -- 172.21.15.18:0/2274808380 <== mon.0 v2:172.21.15.18:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v29) ==== 161+0+0 (secure 0 0 0) 0x7f63a807a440 con 0x7f63b806e580 2024-09-19T09:17:05.959 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T09:17:05.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.958+0000 7f639f7fe640 1 -- 172.21.15.18:0/2274808380 <== mon.0 v2:172.21.15.18:3300/0 9 ==== osd_map(78..78 src has 1..78) ==== 374+0+0 (secure 0 0 0) 0x7f63a808f030 con 0x7f63b806e580 2024-09-19T09:17:05.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.959+0000 7f639f7fe640 1 -- 172.21.15.18:0/2274808380 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=79}) -- 0x7f63a4074ab0 con 0x7f63b806e580 2024-09-19T09:17:05.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.960+0000 7f63bd2ba640 1 -- 172.21.15.18:0/2274808380 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f63a406c2b0 msgr2=0x7f63a406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.960+0000 7f63bd2ba640 1 --2- 172.21.15.18:0/2274808380 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f63a406c2b0 0x7f63a406e770 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f63b8153800 tx=0x7f63ac008040 comp rx=0 tx=0).stop 2024-09-19T09:17:05.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.960+0000 7f63bd2ba640 1 -- 172.21.15.18:0/2274808380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63b806e580 msgr2=0x7f63b814bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:05.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.960+0000 7f63bd2ba640 1 --2- 172.21.15.18:0/2274808380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63b806e580 0x7f63b814bf60 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f63a802a250 tx=0x7f63a80046c0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.960+0000 7f63bd2ba640 1 -- 172.21.15.18:0/2274808380 shutdown_connections 2024-09-19T09:17:05.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.960+0000 7f63bd2ba640 1 --2- 172.21.15.18:0/2274808380 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f63a406c2b0 0x7f63a406e770 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.960+0000 7f63bd2ba640 1 --2- 172.21.15.18:0/2274808380 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f63b815db60 0x7f63b80b05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.960+0000 7f63bd2ba640 1 --2- 172.21.15.18:0/2274808380 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63b80724d0 0x7f63b80b4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.960+0000 7f63bd2ba640 1 --2- 172.21.15.18:0/2274808380 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63b806e580 0x7f63b814bf60 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:05.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.960+0000 7f63bd2ba640 1 -- 172.21.15.18:0/2274808380 >> 172.21.15.18:0/2274808380 conn(0x7f63b80b2630 msgr2=0x7f63b80cf190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:05.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.961+0000 7f63bd2ba640 1 -- 172.21.15.18:0/2274808380 shutdown_connections 2024-09-19T09:17:05.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:05.961+0000 7f63bd2ba640 1 -- 172.21.15.18:0/2274808380 wait complete. 2024-09-19T09:17:05.974 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T09:17:06.000 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-09-19T09:17:06.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.079+0000 7fb41e94b640 1 Processor -- start 2024-09-19T09:17:06.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.079+0000 7fb41e94b640 1 -- start start 2024-09-19T09:17:06.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.080+0000 7fb41e94b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb41815b760 0x7fb4180afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:06.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.080+0000 7fb41e94b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb4180b4a90 0x7fb41806f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:06.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.080+0000 7fb41e94b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb4180d0630 0x7fb4180d0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:06.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.080+0000 7fb41e94b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fb4180b4300 con 0x7fb4180d0630 2024-09-19T09:17:06.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.080+0000 7fb41e94b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb4180d0fc0 con 0x7fb4180b4a90 2024-09-19T09:17:06.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.080+0000 7fb41e94b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb41806d700 con 0x7fb41815b760 2024-09-19T09:17:06.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.080+0000 7fb41cee8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb4180d0630 0x7fb4180d0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:06.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.080+0000 7fb41cee8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb4180d0630 0x7fb4180d0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50970/0 (socket says 172.21.15.18:50970) 2024-09-19T09:17:06.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.081+0000 7fb41cee8640 1 -- 172.21.15.18:0/44653227 learned_addr learned my addr 172.21.15.18:0/44653227 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:06.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.081+0000 7fb417fff640 1 --2- 172.21.15.18:0/44653227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb41815b760 0x7fb4180afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:06.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.081+0000 7fb40ffff640 1 --2- 172.21.15.18:0/44653227 >> v2:172.21.15.162:3300/0 conn(0x7fb4180b4a90 0x7fb41806f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:06.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.081+0000 7fb41cee8640 1 -- 172.21.15.18:0/44653227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb41815b760 msgr2=0x7fb4180afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:06.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.081+0000 7fb41cee8640 1 --2- 172.21.15.18:0/44653227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb41815b760 0x7fb4180afa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:06.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.081+0000 7fb41cee8640 1 -- 172.21.15.18:0/44653227 >> v2:172.21.15.162:3300/0 conn(0x7fb4180b4a90 msgr2=0x7fb41806f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:06.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.081+0000 7fb41cee8640 1 --2- 172.21.15.18:0/44653227 >> v2:172.21.15.162:3300/0 conn(0x7fb4180b4a90 0x7fb41806f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:06.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.081+0000 7fb41cee8640 1 -- 172.21.15.18:0/44653227 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb41806d9e0 con 0x7fb4180d0630 2024-09-19T09:17:06.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.081+0000 7fb41cee8640 1 --2- 172.21.15.18:0/44653227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4180d0630 0x7fb4180d0a80 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb41806d910 tx=0x7fb41002a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b134df8b47b5267 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:06.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.082+0000 7fb4177fe640 1 -- 172.21.15.18:0/44653227 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb410036070 con 0x7fb4180d0630 2024-09-19T09:17:06.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.082+0000 7fb4177fe640 1 -- 172.21.15.18:0/44653227 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb410031600 con 0x7fb4180d0630 2024-09-19T09:17:06.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.082+0000 7fb4177fe640 1 -- 172.21.15.18:0/44653227 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4100319d0 con 0x7fb4180d0630 2024-09-19T09:17:06.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.082+0000 7fb41e94b640 1 -- 172.21.15.18:0/44653227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4180d0630 msgr2=0x7fb4180d0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:06.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.082+0000 7fb41e94b640 1 --2- 172.21.15.18:0/44653227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4180d0630 0x7fb4180d0a80 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fb41806d910 tx=0x7fb41002a560 comp rx=0 tx=0).stop 2024-09-19T09:17:06.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.082+0000 7fb41e94b640 1 -- 172.21.15.18:0/44653227 shutdown_connections 2024-09-19T09:17:06.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.082+0000 7fb41e94b640 1 --2- 172.21.15.18:0/44653227 >> v2:172.21.15.162:3300/0 conn(0x7fb4180b4a90 0x7fb41806f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:06.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.082+0000 7fb41e94b640 1 --2- 172.21.15.18:0/44653227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb4180d0630 0x7fb4180d0a80 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:06.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.082+0000 7fb41e94b640 1 --2- 172.21.15.18:0/44653227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb41815b760 0x7fb4180afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:06.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.082+0000 7fb41e94b640 1 -- 172.21.15.18:0/44653227 >> 172.21.15.18:0/44653227 conn(0x7fb41806bc10 msgr2=0x7fb41806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:06.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.082+0000 7fb41e94b640 1 -- 172.21.15.18:0/44653227 shutdown_connections 2024-09-19T09:17:06.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.082+0000 7fb41e94b640 1 -- 172.21.15.18:0/44653227 wait complete. 2024-09-19T09:17:06.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.083+0000 7fb41e94b640 1 Processor -- start 2024-09-19T09:17:06.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.084+0000 7fb41e94b640 1 -- start start 2024-09-19T09:17:06.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.084+0000 7fb41e94b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4180b4a90 0x7fb4180aac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:06.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.084+0000 7fb41e94b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4180d0630 0x7fb4181f2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:06.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.084+0000 7fb41e94b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb41815b760 0x7fb4180af170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:06.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.084+0000 7fb41e94b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb4180b4ef0 con 0x7fb41815b760 2024-09-19T09:17:06.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.084+0000 7fb41e94b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb41806f7d0 con 0x7fb4180b4a90 2024-09-19T09:17:06.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.084+0000 7fb41e94b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb4180b5070 con 0x7fb4180d0630 2024-09-19T09:17:06.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.084+0000 7fb41cee8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb41815b760 0x7fb4180af170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:06.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.084+0000 7fb41cee8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb41815b760 0x7fb4180af170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50984/0 (socket says 172.21.15.18:50984) 2024-09-19T09:17:06.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.084+0000 7fb41cee8640 1 -- 172.21.15.18:0/2997690567 learned_addr learned my addr 172.21.15.18:0/2997690567 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:06.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.085+0000 7fb417fff640 1 --2- 172.21.15.18:0/2997690567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4180b4a90 0x7fb4180aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:06.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.085+0000 7fb40ffff640 1 --2- 172.21.15.18:0/2997690567 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4180d0630 0x7fb4181f2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:06.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.085+0000 7fb41cee8640 1 -- 172.21.15.18:0/2997690567 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4180d0630 msgr2=0x7fb4181f2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:06.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.085+0000 7fb41cee8640 1 --2- 172.21.15.18:0/2997690567 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4180d0630 0x7fb4181f2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:06.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.085+0000 7fb41cee8640 1 -- 172.21.15.18:0/2997690567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4180b4a90 msgr2=0x7fb4180aac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:06.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.085+0000 7fb41cee8640 1 --2- 172.21.15.18:0/2997690567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4180b4a90 0x7fb4180aac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:06.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.085+0000 7fb41cee8640 1 -- 172.21.15.18:0/2997690567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4180ad380 con 0x7fb41815b760 2024-09-19T09:17:06.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.085+0000 7fb40ffff640 1 --2- 172.21.15.18:0/2997690567 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4180d0630 0x7fb4181f2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:06.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.085+0000 7fb41cee8640 1 --2- 172.21.15.18:0/2997690567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb41815b760 0x7fb4180af170 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb410009f10 tx=0x7fb410004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:06.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.085+0000 7fb4157fa640 1 -- 172.21.15.18:0/2997690567 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb410036050 con 0x7fb41815b760 2024-09-19T09:17:06.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.085+0000 7fb4157fa640 1 -- 172.21.15.18:0/2997690567 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb410042070 con 0x7fb41815b760 2024-09-19T09:17:06.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.085+0000 7fb41e94b640 1 -- 172.21.15.18:0/2997690567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4180ab200 con 0x7fb41815b760 2024-09-19T09:17:06.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.085+0000 7fb4157fa640 1 -- 172.21.15.18:0/2997690567 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb410007bd0 con 0x7fb41815b760 2024-09-19T09:17:06.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.085+0000 7fb41e94b640 1 -- 172.21.15.18:0/2997690567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4180ad8e0 con 0x7fb41815b760 2024-09-19T09:17:06.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.086+0000 7fb41e94b640 1 -- 172.21.15.18:0/2997690567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb41815bc60 con 0x7fb41815b760 2024-09-19T09:17:06.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.087+0000 7fb4157fa640 1 -- 172.21.15.18:0/2997690567 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb410047460 con 0x7fb41815b760 2024-09-19T09:17:06.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.087+0000 7fb4157fa640 1 --2- 172.21.15.18:0/2997690567 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb3f806c2b0 0x7fb3f806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:06.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.087+0000 7fb4157fa640 1 -- 172.21.15.18:0/2997690567 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 5853+0+0 (secure 0 0 0) 0x7fb4100ac3c0 con 0x7fb41815b760 2024-09-19T09:17:06.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.088+0000 7fb4157fa640 1 -- 172.21.15.18:0/2997690567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=79}) -- 0x7fb3f8073fb0 con 0x7fb41815b760 2024-09-19T09:17:06.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.088+0000 7fb417fff640 1 --2- 172.21.15.18:0/2997690567 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb3f806c2b0 0x7fb3f806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:06.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.088+0000 7fb417fff640 1 --2- 172.21.15.18:0/2997690567 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb3f806c2b0 0x7fb3f806e770 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb4180b4180 tx=0x7fb408008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:06.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.092+0000 7fb4157fa640 1 -- 172.21.15.18:0/2997690567 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb4180ad380 con 0x7fb41815b760 2024-09-19T09:17:06.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.303+0000 7fb41e94b640 1 -- 172.21.15.18:0/2997690567 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fb4181f26d0 con 0x7fb41815b760 2024-09-19T09:17:06.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.959+0000 7fb4157fa640 1 -- 172.21.15.18:0/2997690567 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v30) ==== 104+0+0 (secure 0 0 0) 0x7fb41007ab30 con 0x7fb41815b760 2024-09-19T09:17:06.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.962+0000 7fb41e94b640 1 -- 172.21.15.18:0/2997690567 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb3f806c2b0 msgr2=0x7fb3f806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:06.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.962+0000 7fb41e94b640 1 --2- 172.21.15.18:0/2997690567 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb3f806c2b0 0x7fb3f806e770 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb4180b4180 tx=0x7fb408008040 comp rx=0 tx=0).stop 2024-09-19T09:17:06.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.962+0000 7fb41e94b640 1 -- 172.21.15.18:0/2997690567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb41815b760 msgr2=0x7fb4180af170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:06.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.962+0000 7fb41e94b640 1 --2- 172.21.15.18:0/2997690567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb41815b760 0x7fb4180af170 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb410009f10 tx=0x7fb410004a40 comp rx=0 tx=0).stop 2024-09-19T09:17:06.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.962+0000 7fb41e94b640 1 -- 172.21.15.18:0/2997690567 shutdown_connections 2024-09-19T09:17:06.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.962+0000 7fb41e94b640 1 --2- 172.21.15.18:0/2997690567 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb3f806c2b0 0x7fb3f806e770 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:06.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.962+0000 7fb41e94b640 1 --2- 172.21.15.18:0/2997690567 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb41815b760 0x7fb4180af170 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:06.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.962+0000 7fb41e94b640 1 --2- 172.21.15.18:0/2997690567 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb4180d0630 0x7fb4181f2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:06.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.962+0000 7fb41e94b640 1 --2- 172.21.15.18:0/2997690567 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4180b4a90 0x7fb4180aac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:06.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.962+0000 7fb41e94b640 1 -- 172.21.15.18:0/2997690567 >> 172.21.15.18:0/2997690567 conn(0x7fb41806bc10 msgr2=0x7fb4180ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:06.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.962+0000 7fb41e94b640 1 -- 172.21.15.18:0/2997690567 shutdown_connections 2024-09-19T09:17:06.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:06.962+0000 7fb41e94b640 1 -- 172.21.15.18:0/2997690567 wait complete. 2024-09-19T09:17:06.979 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T09:17:07.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.131+0000 7f6d7a76d640 1 Processor -- start 2024-09-19T09:17:07.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.132+0000 7f6d7a76d640 1 -- start start 2024-09-19T09:17:07.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.132+0000 7f6d7a76d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6d7415edb0 0x7f6d740d29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:07.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.132+0000 7f6d7a76d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d740d3990 0x7f6d740b5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:07.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.132+0000 7f6d7a76d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d740d0870 con 0x7f6d740d0370 2024-09-19T09:17:07.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.132+0000 7f6d7a76d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6d740b4400 con 0x7f6d7415edb0 2024-09-19T09:17:07.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.132+0000 7f6d7a76d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6d740d0b50 con 0x7f6d740d3990 2024-09-19T09:17:07.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.132+0000 7f6d737fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6d740d0370 0x7f6d740d3280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57544/0 (socket says 172.21.15.18:57544) 2024-09-19T09:17:07.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.133+0000 7f6d737fe640 1 -- 172.21.15.18:0/3429681933 learned_addr learned my addr 172.21.15.18:0/3429681933 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:17:07.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.133+0000 7f6d78d0a640 1 --2- 172.21.15.18:0/3429681933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d740d3990 0x7f6d740b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:07.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.133+0000 7f6d73fff640 1 --2- 172.21.15.18:0/3429681933 >> v2:172.21.15.162:3300/0 conn(0x7f6d7415edb0 0x7f6d740d29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:07.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.133+0000 7f6d72ffd640 1 -- 172.21.15.18:0/3429681933 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4146077837 0 0) 0x7f6d740d0870 con 0x7f6d740d0370 2024-09-19T09:17:07.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.133+0000 7f6d72ffd640 1 -- 172.21.15.18:0/3429681933 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d5c003520 con 0x7f6d740d0370 2024-09-19T09:17:07.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.133+0000 7f6d72ffd640 1 -- 172.21.15.18:0/3429681933 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3719908922 0 0) 0x7f6d5c003520 con 0x7f6d740d0370 2024-09-19T09:17:07.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.133+0000 7f6d72ffd640 1 -- 172.21.15.18:0/3429681933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d740d3990 msgr2=0x7f6d740b5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:07.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.133+0000 7f6d72ffd640 1 --2- 172.21.15.18:0/3429681933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d740d3990 0x7f6d740b5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:07.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.133+0000 7f6d72ffd640 1 -- 172.21.15.18:0/3429681933 >> v2:172.21.15.162:3300/0 conn(0x7f6d7415edb0 msgr2=0x7f6d740d29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:07.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.133+0000 7f6d72ffd640 1 --2- 172.21.15.18:0/3429681933 >> v2:172.21.15.162:3300/0 conn(0x7f6d7415edb0 0x7f6d740d29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:07.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.133+0000 7f6d72ffd640 1 -- 172.21.15.18:0/3429681933 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d740b4620 con 0x7f6d740d0370 2024-09-19T09:17:07.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.133+0000 7f6d72ffd640 1 -- 172.21.15.18:0/3429681933 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f6d68001670 con 0x7f6d740d0370 2024-09-19T09:17:07.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.133+0000 7f6d72ffd640 1 -- 172.21.15.18:0/3429681933 >> v1:172.21.15.18:6789/0 conn(0x7f6d740d0370 legacy=0x7f6d740d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:07.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.133+0000 7f6d72ffd640 1 --2- 172.21.15.18:0/3429681933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d5c0039b0 0x7f6d5c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:07.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.133+0000 7f6d72ffd640 1 --2- 172.21.15.18:0/3429681933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d5c004800 0x7f6d5c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:07.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.133+0000 7f6d72ffd640 1 --2- 172.21.15.18:0/3429681933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d740d3990 0x7f6d5c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:07.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.133+0000 7f6d72ffd640 1 -- 172.21.15.18:0/3429681933 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6d740b4400 con 0x7f6d5c004800 2024-09-19T09:17:07.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.133+0000 7f6d72ffd640 1 -- 172.21.15.18:0/3429681933 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6d740d0b50 con 0x7f6d5c0039b0 2024-09-19T09:17:07.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.133+0000 7f6d72ffd640 1 -- 172.21.15.18:0/3429681933 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6d5c00b9c0 con 0x7f6d740d3990 2024-09-19T09:17:07.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.133+0000 7f6d737fe640 1 --2- 172.21.15.18:0/3429681933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d5c004800 0x7f6d5c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:07.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.133+0000 7f6d73fff640 1 --2- 172.21.15.18:0/3429681933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d5c0039b0 0x7f6d5c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:07.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.133+0000 7f6d78d0a640 1 --2- 172.21.15.18:0/3429681933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d740d3990 0x7f6d5c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:07.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.134+0000 7f6d737fe640 1 -- 172.21.15.18:0/3429681933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d740d3990 msgr2=0x7f6d5c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:07.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.134+0000 7f6d737fe640 1 --2- 172.21.15.18:0/3429681933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d740d3990 0x7f6d5c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:07.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.134+0000 7f6d737fe640 1 -- 172.21.15.18:0/3429681933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d5c0039b0 msgr2=0x7f6d5c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:07.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.134+0000 7f6d737fe640 1 --2- 172.21.15.18:0/3429681933 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d5c0039b0 0x7f6d5c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:07.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.134+0000 7f6d737fe640 1 -- 172.21.15.18:0/3429681933 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d5c003520 con 0x7f6d5c004800 2024-09-19T09:17:07.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.134+0000 7f6d737fe640 1 --2- 172.21.15.18:0/3429681933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d5c004800 0x7f6d5c004c80 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6d6800c210 tx=0x7f6d5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f08ae0ac99347d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:07.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.134+0000 7f6d72ffd640 1 -- 172.21.15.18:0/3429681933 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d68007d30 con 0x7f6d5c004800 2024-09-19T09:17:07.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.134+0000 7f6d72ffd640 1 -- 172.21.15.18:0/3429681933 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d68005ad0 con 0x7f6d5c004800 2024-09-19T09:17:07.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.134+0000 7f6d72ffd640 1 -- 172.21.15.18:0/3429681933 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d68007070 con 0x7f6d5c004800 2024-09-19T09:17:07.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.135+0000 7f6d7a76d640 1 -- 172.21.15.18:0/3429681933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d5c004800 msgr2=0x7f6d5c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:07.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.135+0000 7f6d7a76d640 1 --2- 172.21.15.18:0/3429681933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d5c004800 0x7f6d5c004c80 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6d6800c210 tx=0x7f6d5c005830 comp rx=0 tx=0).stop 2024-09-19T09:17:07.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.135+0000 7f6d78d0a640 1 -- 172.21.15.18:0/3429681933 reap_dead start 2024-09-19T09:17:07.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.135+0000 7f6d7a76d640 1 -- 172.21.15.18:0/3429681933 shutdown_connections 2024-09-19T09:17:07.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.135+0000 7f6d7a76d640 1 -- 172.21.15.18:0/3429681933 >> 172.21.15.18:0/3429681933 conn(0x7f6d7409df30 msgr2=0x7f6d740d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:07.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.135+0000 7f6d7a76d640 1 -- 172.21.15.18:0/3429681933 shutdown_connections 2024-09-19T09:17:07.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.135+0000 7f6d7a76d640 1 -- 172.21.15.18:0/3429681933 wait complete. 2024-09-19T09:17:07.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.136+0000 7f6d7a76d640 1 Processor -- start 2024-09-19T09:17:07.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.136+0000 7f6d7a76d640 1 -- start start 2024-09-19T09:17:07.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.137+0000 7f6d7a76d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d5c004800 0x7f6d7415b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:07.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.137+0000 7f6d7a76d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d740b86a0 0x7f6d741589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:07.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.137+0000 7f6d7a76d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d74158f10 0x7f6d74161090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:07.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.137+0000 7f6d7a76d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6d7415f190 con 0x7f6d74158f10 2024-09-19T09:17:07.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.137+0000 7f6d7a76d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6d740b4be0 con 0x7f6d5c004800 2024-09-19T09:17:07.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.137+0000 7f6d7a76d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6d740d2f20 con 0x7f6d740b86a0 2024-09-19T09:17:07.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.137+0000 7f6d78d0a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d74158f10 0x7f6d74161090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:07.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.137+0000 7f6d78d0a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d74158f10 0x7f6d74161090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51010/0 (socket says 172.21.15.18:51010) 2024-09-19T09:17:07.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.137+0000 7f6d78d0a640 1 -- 172.21.15.18:0/685403931 learned_addr learned my addr 172.21.15.18:0/685403931 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:07.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.137+0000 7f6d737fe640 1 --2- 172.21.15.18:0/685403931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d740b86a0 0x7f6d741589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:07.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.137+0000 7f6d73fff640 1 --2- 172.21.15.18:0/685403931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d5c004800 0x7f6d7415b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:07.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.138+0000 7f6d78d0a640 1 -- 172.21.15.18:0/685403931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d740b86a0 msgr2=0x7f6d741589d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:07.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.138+0000 7f6d78d0a640 1 --2- 172.21.15.18:0/685403931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d740b86a0 0x7f6d741589d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:07.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.138+0000 7f6d78d0a640 1 -- 172.21.15.18:0/685403931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d5c004800 msgr2=0x7f6d7415b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:07.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.138+0000 7f6d78d0a640 1 --2- 172.21.15.18:0/685403931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d5c004800 0x7f6d7415b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:07.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.138+0000 7f6d78d0a640 1 -- 172.21.15.18:0/685403931 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d741602d0 con 0x7f6d74158f10 2024-09-19T09:17:07.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.138+0000 7f6d73fff640 1 --2- 172.21.15.18:0/685403931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d5c004800 0x7f6d7415b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:07.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.138+0000 7f6d737fe640 1 --2- 172.21.15.18:0/685403931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d740b86a0 0x7f6d741589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:07.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.138+0000 7f6d78d0a640 1 --2- 172.21.15.18:0/685403931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d74158f10 0x7f6d74161090 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f6d740b6780 tx=0x7f6d6c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:07.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.138+0000 7f6d70ff9640 1 -- 172.21.15.18:0/685403931 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c00fd80 con 0x7f6d74158f10 2024-09-19T09:17:07.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.138+0000 7f6d70ff9640 1 -- 172.21.15.18:0/685403931 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d6c015430 con 0x7f6d74158f10 2024-09-19T09:17:07.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.138+0000 7f6d7a76d640 1 -- 172.21.15.18:0/685403931 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d741605b0 con 0x7f6d74158f10 2024-09-19T09:17:07.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.138+0000 7f6d70ff9640 1 -- 172.21.15.18:0/685403931 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c015820 con 0x7f6d74158f10 2024-09-19T09:17:07.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.138+0000 7f6d7a76d640 1 -- 172.21.15.18:0/685403931 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d74160b70 con 0x7f6d74158f10 2024-09-19T09:17:07.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.139+0000 7f6d7a76d640 1 -- 172.21.15.18:0/685403931 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d740d29e0 con 0x7f6d74158f10 2024-09-19T09:17:07.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.139+0000 7f6d70ff9640 1 -- 172.21.15.18:0/685403931 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6d6c0159c0 con 0x7f6d74158f10 2024-09-19T09:17:07.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.140+0000 7f6d70ff9640 1 --2- 172.21.15.18:0/685403931 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6d6006c2e0 0x7f6d6006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:07.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.140+0000 7f6d70ff9640 1 -- 172.21.15.18:0/685403931 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 5853+0+0 (secure 0 0 0) 0x7f6d6c08c230 con 0x7f6d74158f10 2024-09-19T09:17:07.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.140+0000 7f6d73fff640 1 --2- 172.21.15.18:0/685403931 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6d6006c2e0 0x7f6d6006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:07.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.141+0000 7f6d73fff640 1 --2- 172.21.15.18:0/685403931 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6d6006c2e0 0x7f6d6006e7a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6d64009bc0 tx=0x7f6d64008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:07.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.144+0000 7f6d70ff9640 1 -- 172.21.15.18:0/685403931 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6d6c019030 con 0x7f6d74158f10 2024-09-19T09:17:07.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.322+0000 7f6d7a76d640 1 -- 172.21.15.18:0/685403931 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6d740d1920 con 0x7f6d74158f10 2024-09-19T09:17:07.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.966+0000 7f6d70ff9640 1 -- 172.21.15.18:0/685403931 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v80) ==== 181+0+0 (secure 0 0 0) 0x7f6d6c010040 con 0x7f6d74158f10 2024-09-19T09:17:07.967 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' removed 2024-09-19T09:17:07.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.973+0000 7f6d7a76d640 1 -- 172.21.15.18:0/685403931 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6d6006c2e0 msgr2=0x7f6d6006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:07.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.973+0000 7f6d7a76d640 1 --2- 172.21.15.18:0/685403931 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6d6006c2e0 0x7f6d6006e7a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6d64009bc0 tx=0x7f6d64008040 comp rx=0 tx=0).stop 2024-09-19T09:17:07.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.973+0000 7f6d7a76d640 1 -- 172.21.15.18:0/685403931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d74158f10 msgr2=0x7f6d74161090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:07.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.973+0000 7f6d7a76d640 1 --2- 172.21.15.18:0/685403931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d74158f10 0x7f6d74161090 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f6d740b6780 tx=0x7f6d6c00f580 comp rx=0 tx=0).stop 2024-09-19T09:17:07.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.973+0000 7f6d7a76d640 1 -- 172.21.15.18:0/685403931 shutdown_connections 2024-09-19T09:17:07.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.973+0000 7f6d7a76d640 1 --2- 172.21.15.18:0/685403931 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6d6006c2e0 0x7f6d6006e7a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:07.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.973+0000 7f6d7a76d640 1 --2- 172.21.15.18:0/685403931 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d74158f10 0x7f6d74161090 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:07.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.973+0000 7f6d7a76d640 1 --2- 172.21.15.18:0/685403931 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d740b86a0 0x7f6d741589d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:07.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.973+0000 7f6d7a76d640 1 --2- 172.21.15.18:0/685403931 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d5c004800 0x7f6d7415b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:07.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.973+0000 7f6d7a76d640 1 -- 172.21.15.18:0/685403931 >> 172.21.15.18:0/685403931 conn(0x7f6d7409df30 msgr2=0x7f6d740d0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:07.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.974+0000 7f6d7a76d640 1 -- 172.21.15.18:0/685403931 shutdown_connections 2024-09-19T09:17:07.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:07.974+0000 7f6d7a76d640 1 -- 172.21.15.18:0/685403931 wait complete. 2024-09-19T09:17:07.987 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T09:17:08.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.096+0000 7f5ed1cd9640 1 Processor -- start 2024-09-19T09:17:08.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.096+0000 7f5ed1cd9640 1 -- start start 2024-09-19T09:17:08.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.096+0000 7f5ed1cd9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ecc0ce460 0x7f5ecc0cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:08.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.097+0000 7f5ed1cd9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5ecc06ecf0 0x7f5ecc15e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:08.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.097+0000 7f5ed1cd9640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ecc15dfc0 con 0x7f5ecc0d0420 2024-09-19T09:17:08.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.097+0000 7f5ed1cd9640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f5ecc15d3b0 con 0x7f5ecc06ecf0 2024-09-19T09:17:08.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.097+0000 7f5ed1cd9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5ecc15d690 con 0x7f5ecc0ce460 2024-09-19T09:17:08.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.097+0000 7f5ecbfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f5ecc06ecf0 0x7f5ecc15e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:08.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.097+0000 7f5ecaffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f5ecc0d0420 0x7f5ecc06e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57548/0 (socket says 172.21.15.18:57548) 2024-09-19T09:17:08.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.097+0000 7f5ecaffd640 1 -- 172.21.15.18:0/1344383332 learned_addr learned my addr 172.21.15.18:0/1344383332 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:17:08.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.097+0000 7f5ecb7fe640 1 --2- 172.21.15.18:0/1344383332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ecc0ce460 0x7f5ecc0cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:08.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.097+0000 7f5ecbfff640 1 -- 172.21.15.18:0/1344383332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ecc0ce460 msgr2=0x7f5ecc0cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:08.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.097+0000 7f5ecbfff640 1 --2- 172.21.15.18:0/1344383332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ecc0ce460 0x7f5ecc0cfee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:08.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.097+0000 7f5ecbfff640 1 -- 172.21.15.18:0/1344383332 >> v1:172.21.15.18:6789/0 conn(0x7f5ecc0d0420 legacy=0x7f5ecc06e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:08.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.097+0000 7f5ecbfff640 1 -- 172.21.15.18:0/1344383332 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ecc15d970 con 0x7f5ecc06ecf0 2024-09-19T09:17:08.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.097+0000 7f5eca7fc640 1 -- 172.21.15.18:0/1344383332 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2051089256 0 0) 0x7f5ecc15dfc0 con 0x7f5ecc0d0420 2024-09-19T09:17:08.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.097+0000 7f5ecb7fe640 1 --2- 172.21.15.18:0/1344383332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ecc0ce460 0x7f5ecc0cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:08.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.098+0000 7f5ecbfff640 1 --2- 172.21.15.18:0/1344383332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ecc06ecf0 0x7f5ecc15e470 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4009d90 tx=0x7f5ec402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb6d4b809b3da3bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:08.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.098+0000 7f5eca7fc640 1 -- 172.21.15.18:0/1344383332 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4007740 con 0x7f5ecc06ecf0 2024-09-19T09:17:08.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.098+0000 7f5eca7fc640 1 -- 172.21.15.18:0/1344383332 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ec40078e0 con 0x7f5ecc06ecf0 2024-09-19T09:17:08.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.098+0000 7f5eca7fc640 1 -- 172.21.15.18:0/1344383332 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec4007cb0 con 0x7f5ecc06ecf0 2024-09-19T09:17:08.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.099+0000 7f5ed1cd9640 1 -- 172.21.15.18:0/1344383332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ecc06ecf0 msgr2=0x7f5ecc15e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:08.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.099+0000 7f5ed1cd9640 1 --2- 172.21.15.18:0/1344383332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ecc06ecf0 0x7f5ecc15e470 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f5ec4009d90 tx=0x7f5ec402a660 comp rx=0 tx=0).stop 2024-09-19T09:17:08.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.099+0000 7f5ed1cd9640 1 -- 172.21.15.18:0/1344383332 shutdown_connections 2024-09-19T09:17:08.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.099+0000 7f5ed1cd9640 1 --2- 172.21.15.18:0/1344383332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ecc06ecf0 0x7f5ecc15e470 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:08.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.099+0000 7f5ed1cd9640 1 --2- 172.21.15.18:0/1344383332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ecc0ce460 0x7f5ecc0cfee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:08.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.099+0000 7f5ed1cd9640 1 -- 172.21.15.18:0/1344383332 >> 172.21.15.18:0/1344383332 conn(0x7f5ecc0b26a0 msgr2=0x7f5ecc0b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:08.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.099+0000 7f5ed1cd9640 1 -- 172.21.15.18:0/1344383332 shutdown_connections 2024-09-19T09:17:08.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.099+0000 7f5ed1cd9640 1 -- 172.21.15.18:0/1344383332 wait complete. 2024-09-19T09:17:08.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.100+0000 7f5ed1cd9640 1 Processor -- start 2024-09-19T09:17:08.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.100+0000 7f5ed1cd9640 1 -- start start 2024-09-19T09:17:08.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.101+0000 7f5ed1cd9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ecc06ecf0 0x7f5ecc148090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:08.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.101+0000 7f5ed1cd9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ecc0ce460 0x7f5ecc1f3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:08.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.101+0000 7f5ed1cd9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ecc0d0420 0x7f5ecc1f67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:08.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.101+0000 7f5ed1cd9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5ecc15cfd0 con 0x7f5ecc0ce460 2024-09-19T09:17:08.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.101+0000 7f5ed1cd9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5ecc0ce840 con 0x7f5ecc06ecf0 2024-09-19T09:17:08.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.101+0000 7f5ed1cd9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5ecc15d150 con 0x7f5ecc0d0420 2024-09-19T09:17:08.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.101+0000 7f5ecaffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ecc0ce460 0x7f5ecc1f3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:08.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.101+0000 7f5ecaffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ecc0ce460 0x7f5ecc1f3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51024/0 (socket says 172.21.15.18:51024) 2024-09-19T09:17:08.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.101+0000 7f5ecaffd640 1 -- 172.21.15.18:0/945440569 learned_addr learned my addr 172.21.15.18:0/945440569 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:08.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.101+0000 7f5ecb7fe640 1 --2- 172.21.15.18:0/945440569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ecc06ecf0 0x7f5ecc148090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:08.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.101+0000 7f5ecbfff640 1 --2- 172.21.15.18:0/945440569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ecc0d0420 0x7f5ecc1f67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:08.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.101+0000 7f5ecaffd640 1 -- 172.21.15.18:0/945440569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ecc0d0420 msgr2=0x7f5ecc1f67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:08.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.101+0000 7f5ecaffd640 1 --2- 172.21.15.18:0/945440569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ecc0d0420 0x7f5ecc1f67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:08.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.101+0000 7f5ecaffd640 1 -- 172.21.15.18:0/945440569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ecc06ecf0 msgr2=0x7f5ecc148090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:08.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.101+0000 7f5ecaffd640 1 --2- 172.21.15.18:0/945440569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ecc06ecf0 0x7f5ecc148090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:08.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.101+0000 7f5ecaffd640 1 -- 172.21.15.18:0/945440569 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ecc15cda0 con 0x7f5ecc0ce460 2024-09-19T09:17:08.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.101+0000 7f5ecb7fe640 1 --2- 172.21.15.18:0/945440569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ecc06ecf0 0x7f5ecc148090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:08.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.101+0000 7f5ecaffd640 1 --2- 172.21.15.18:0/945440569 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ecc0ce460 0x7f5ecc1f3380 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f5ec000c440 tx=0x7f5ec000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:08.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.102+0000 7f5eb3fff640 1 -- 172.21.15.18:0/945440569 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0018070 con 0x7f5ecc0ce460 2024-09-19T09:17:08.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.102+0000 7f5eb3fff640 1 -- 172.21.15.18:0/945440569 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ec00074e0 con 0x7f5ecc0ce460 2024-09-19T09:17:08.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.102+0000 7f5ed1cd9640 1 -- 172.21.15.18:0/945440569 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ecc15c7e0 con 0x7f5ecc0ce460 2024-09-19T09:17:08.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.102+0000 7f5eb3fff640 1 -- 172.21.15.18:0/945440569 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ec0004a20 con 0x7f5ecc0ce460 2024-09-19T09:17:08.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.102+0000 7f5ed1cd9640 1 -- 172.21.15.18:0/945440569 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ecc1f5fc0 con 0x7f5ecc0ce460 2024-09-19T09:17:08.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.103+0000 7f5ed1cd9640 1 -- 172.21.15.18:0/945440569 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ecc0cfee0 con 0x7f5ecc0ce460 2024-09-19T09:17:08.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.103+0000 7f5eb3fff640 1 -- 172.21.15.18:0/945440569 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5ec001b070 con 0x7f5ecc0ce460 2024-09-19T09:17:08.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.104+0000 7f5eb3fff640 1 --2- 172.21.15.18:0/945440569 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5eb806c2b0 0x7f5eb806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:08.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.104+0000 7f5eb3fff640 1 -- 172.21.15.18:0/945440569 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5415+0+0 (secure 0 0 0) 0x7f5ec008a540 con 0x7f5ecc0ce460 2024-09-19T09:17:08.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.104+0000 7f5ecb7fe640 1 --2- 172.21.15.18:0/945440569 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5eb806c2b0 0x7f5eb806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:08.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.105+0000 7f5ecb7fe640 1 --2- 172.21.15.18:0/945440569 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5eb806c2b0 0x7f5eb806e770 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc0104d0 tx=0x7f5ebc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:08.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.108+0000 7f5eb3fff640 1 -- 172.21.15.18:0/945440569 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5ec0058780 con 0x7f5ecc0ce460 2024-09-19T09:17:08.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.283+0000 7f5ed1cd9640 1 -- 172.21.15.18:0/945440569 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5ecc152160 con 0x7f5ecc0ce460 2024-09-19T09:17:08.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.967+0000 7f5eb3fff640 1 -- 172.21.15.18:0/945440569 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v81) ==== 169+0+0 (secure 0 0 0) 0x7f5ec005ca80 con 0x7f5ecc0ce460 2024-09-19T09:17:08.968 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' removed 2024-09-19T09:17:08.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.970+0000 7f5ed1cd9640 1 -- 172.21.15.18:0/945440569 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5eb806c2b0 msgr2=0x7f5eb806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:08.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.970+0000 7f5ed1cd9640 1 --2- 172.21.15.18:0/945440569 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5eb806c2b0 0x7f5eb806e770 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5ebc0104d0 tx=0x7f5ebc008040 comp rx=0 tx=0).stop 2024-09-19T09:17:08.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.970+0000 7f5ed1cd9640 1 -- 172.21.15.18:0/945440569 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ecc0ce460 msgr2=0x7f5ecc1f3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:08.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.970+0000 7f5ed1cd9640 1 --2- 172.21.15.18:0/945440569 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ecc0ce460 0x7f5ecc1f3380 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f5ec000c440 tx=0x7f5ec000c900 comp rx=0 tx=0).stop 2024-09-19T09:17:08.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.970+0000 7f5ed1cd9640 1 -- 172.21.15.18:0/945440569 shutdown_connections 2024-09-19T09:17:08.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.970+0000 7f5ed1cd9640 1 --2- 172.21.15.18:0/945440569 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5eb806c2b0 0x7f5eb806e770 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:08.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.970+0000 7f5ed1cd9640 1 --2- 172.21.15.18:0/945440569 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ecc0d0420 0x7f5ecc1f67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:08.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.970+0000 7f5ed1cd9640 1 --2- 172.21.15.18:0/945440569 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5ecc0ce460 0x7f5ecc1f3380 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:08.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.970+0000 7f5ed1cd9640 1 --2- 172.21.15.18:0/945440569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ecc06ecf0 0x7f5ecc148090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:08.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.970+0000 7f5ed1cd9640 1 -- 172.21.15.18:0/945440569 >> 172.21.15.18:0/945440569 conn(0x7f5ecc0b26a0 msgr2=0x7f5ecc15f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:08.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.970+0000 7f5ed1cd9640 1 -- 172.21.15.18:0/945440569 shutdown_connections 2024-09-19T09:17:08.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:08.970+0000 7f5ed1cd9640 1 -- 172.21.15.18:0/945440569 wait complete. 2024-09-19T09:17:08.985 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-19T09:17:09.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.095+0000 7f8d0357f640 1 Processor -- start 2024-09-19T09:17:09.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.096+0000 7f8d0357f640 1 -- start start 2024-09-19T09:17:09.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.096+0000 7f8d0357f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8cfc1623c0 0x7f8cfc0b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:09.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.096+0000 7f8d0357f640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cfc0d3700 con 0x7f8cfc0d56b0 2024-09-19T09:17:09.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.096+0000 7f8d0357f640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cfc0cfa70 con 0x7f8cfc0d1470 2024-09-19T09:17:09.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.096+0000 7f8d0357f640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f8cfc0d21a0 con 0x7f8cfc1623c0 2024-09-19T09:17:09.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.096+0000 7f8d0131b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8cfc1623c0 0x7f8cfc0b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:09.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.097+0000 7f8d0131b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8cfc1623c0 0x7f8cfc0b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51032/0 (socket says 172.21.15.18:51032) 2024-09-19T09:17:09.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.097+0000 7f8d00b1a640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f8cfc0d56b0 0x7f8cfc0d0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57558/0 (socket says 172.21.15.18:57558) 2024-09-19T09:17:09.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.097+0000 7f8d0131b640 1 -- 172.21.15.18:0/3768174700 learned_addr learned my addr 172.21.15.18:0/3768174700 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:09.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.097+0000 7f8d0131b640 1 -- 172.21.15.18:0/3768174700 >> v1:172.21.15.162:6789/0 conn(0x7f8cfc0d1470 legacy=0x7f8cfc0b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:09.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.097+0000 7f8d0131b640 1 -- 172.21.15.18:0/3768174700 >> v1:172.21.15.18:6789/0 conn(0x7f8cfc0d56b0 legacy=0x7f8cfc0d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:09.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.097+0000 7f8d0131b640 1 -- 172.21.15.18:0/3768174700 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cfc0d0c20 con 0x7f8cfc1623c0 2024-09-19T09:17:09.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.097+0000 7f8d0131b640 1 --2- 172.21.15.18:0/3768174700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8cfc1623c0 0x7f8cfc0b6260 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc08daf0 tx=0x7f8cf402a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbc1964315dd6beb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:09.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.098+0000 7f8cfbfff640 1 -- 172.21.15.18:0/3768174700 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4037070 con 0x7f8cfc1623c0 2024-09-19T09:17:09.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.098+0000 7f8cfbfff640 1 -- 172.21.15.18:0/3768174700 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf4032440 con 0x7f8cfc1623c0 2024-09-19T09:17:09.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.098+0000 7f8cfbfff640 1 -- 172.21.15.18:0/3768174700 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4032810 con 0x7f8cfc1623c0 2024-09-19T09:17:09.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.098+0000 7f8d0357f640 1 -- 172.21.15.18:0/3768174700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8cfc1623c0 msgr2=0x7f8cfc0b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:09.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.098+0000 7f8d0357f640 1 --2- 172.21.15.18:0/3768174700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8cfc1623c0 0x7f8cfc0b6260 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc08daf0 tx=0x7f8cf402a290 comp rx=0 tx=0).stop 2024-09-19T09:17:09.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.098+0000 7f8d0357f640 1 -- 172.21.15.18:0/3768174700 shutdown_connections 2024-09-19T09:17:09.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.098+0000 7f8d0357f640 1 --2- 172.21.15.18:0/3768174700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8cfc1623c0 0x7f8cfc0b6260 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:09.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.098+0000 7f8d0357f640 1 -- 172.21.15.18:0/3768174700 >> 172.21.15.18:0/3768174700 conn(0x7f8cfc09df30 msgr2=0x7f8cfc0d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:09.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.098+0000 7f8d0357f640 1 -- 172.21.15.18:0/3768174700 shutdown_connections 2024-09-19T09:17:09.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.098+0000 7f8d0357f640 1 -- 172.21.15.18:0/3768174700 wait complete. 2024-09-19T09:17:09.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.099+0000 7f8d0357f640 1 Processor -- start 2024-09-19T09:17:09.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.100+0000 7f8d0357f640 1 -- start start 2024-09-19T09:17:09.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.100+0000 7f8d0357f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8cfc0d1470 0x7f8cfc1574a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:09.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.100+0000 7f8d0357f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8cfc0d56b0 0x7f8cfc0c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:09.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.100+0000 7f8d0357f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cfc1623c0 0x7f8cfc0ba0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:09.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.100+0000 7f8d0357f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8cfc0cfd10 con 0x7f8cfc0d1470 2024-09-19T09:17:09.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.100+0000 7f8d0357f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8cfc0d0080 con 0x7f8cfc1623c0 2024-09-19T09:17:09.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.100+0000 7f8d0357f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8cfc1627a0 con 0x7f8cfc0d56b0 2024-09-19T09:17:09.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.100+0000 7f8d0131b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8cfc0d1470 0x7f8cfc1574a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:09.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.100+0000 7f8d0131b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8cfc0d1470 0x7f8cfc1574a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51046/0 (socket says 172.21.15.18:51046) 2024-09-19T09:17:09.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.100+0000 7f8d0131b640 1 -- 172.21.15.18:0/2557626227 learned_addr learned my addr 172.21.15.18:0/2557626227 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:09.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.101+0000 7f8d01b1c640 1 --2- 172.21.15.18:0/2557626227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cfc1623c0 0x7f8cfc0ba0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:09.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.101+0000 7f8d00b1a640 1 --2- 172.21.15.18:0/2557626227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8cfc0d56b0 0x7f8cfc0c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:09.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.101+0000 7f8d0131b640 1 -- 172.21.15.18:0/2557626227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8cfc0d56b0 msgr2=0x7f8cfc0c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:09.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.101+0000 7f8d0131b640 1 --2- 172.21.15.18:0/2557626227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8cfc0d56b0 0x7f8cfc0c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:09.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.101+0000 7f8d0131b640 1 -- 172.21.15.18:0/2557626227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cfc1623c0 msgr2=0x7f8cfc0ba0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:09.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.101+0000 7f8d0131b640 1 --2- 172.21.15.18:0/2557626227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cfc1623c0 0x7f8cfc0ba0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:09.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.101+0000 7f8d0131b640 1 -- 172.21.15.18:0/2557626227 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cfc1579e0 con 0x7f8cfc0d1470 2024-09-19T09:17:09.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.101+0000 7f8d0131b640 1 --2- 172.21.15.18:0/2557626227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8cfc0d1470 0x7f8cfc1574a0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40090b0 tx=0x7f8cf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:09.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.101+0000 7f8cf9ffb640 1 -- 172.21.15.18:0/2557626227 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4041070 con 0x7f8cfc0d1470 2024-09-19T09:17:09.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.101+0000 7f8cf9ffb640 1 -- 172.21.15.18:0/2557626227 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf403c870 con 0x7f8cfc0d1470 2024-09-19T09:17:09.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.101+0000 7f8d0357f640 1 -- 172.21.15.18:0/2557626227 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cfc0b8d40 con 0x7f8cfc0d1470 2024-09-19T09:17:09.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.101+0000 7f8cf9ffb640 1 -- 172.21.15.18:0/2557626227 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4037040 con 0x7f8cfc0d1470 2024-09-19T09:17:09.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.101+0000 7f8d0357f640 1 -- 172.21.15.18:0/2557626227 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cfc0b9300 con 0x7f8cfc0d1470 2024-09-19T09:17:09.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.102+0000 7f8d0357f640 1 -- 172.21.15.18:0/2557626227 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cfc0d3c80 con 0x7f8cfc0d1470 2024-09-19T09:17:09.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.103+0000 7f8cf9ffb640 1 -- 172.21.15.18:0/2557626227 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8cf4044070 con 0x7f8cfc0d1470 2024-09-19T09:17:09.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.103+0000 7f8cf9ffb640 1 --2- 172.21.15.18:0/2557626227 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8ce806c2b0 0x7f8ce806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:09.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.104+0000 7f8cf9ffb640 1 -- 172.21.15.18:0/2557626227 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 4943+0+0 (secure 0 0 0) 0x7f8cf40ac000 con 0x7f8cfc0d1470 2024-09-19T09:17:09.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.104+0000 7f8d00b1a640 1 --2- 172.21.15.18:0/2557626227 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8ce806c2b0 0x7f8ce806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:09.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.104+0000 7f8d00b1a640 1 --2- 172.21.15.18:0/2557626227 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8ce806c2b0 0x7f8ce806e770 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc1f8550 tx=0x7f8cf0007cc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:09.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.108+0000 7f8cf9ffb640 1 -- 172.21.15.18:0/2557626227 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8cf407ab00 con 0x7f8cfc0d1470 2024-09-19T09:17:09.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.287+0000 7f8d0357f640 1 -- 172.21.15.18:0/2557626227 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f8cfc0d2340 con 0x7f8cfc0d1470 2024-09-19T09:17:09.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.290+0000 7f8cf9ffb640 1 -- 172.21.15.18:0/2557626227 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) ==== 104+0+0 (secure 0 0 0) 0x7f8cf407a400 con 0x7f8cfc0d1470 2024-09-19T09:17:09.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.292+0000 7f8d0357f640 1 -- 172.21.15.18:0/2557626227 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8ce806c2b0 msgr2=0x7f8ce806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:09.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.292+0000 7f8d0357f640 1 --2- 172.21.15.18:0/2557626227 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8ce806c2b0 0x7f8ce806e770 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc1f8550 tx=0x7f8cf0007cc0 comp rx=0 tx=0).stop 2024-09-19T09:17:09.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.292+0000 7f8d0357f640 1 -- 172.21.15.18:0/2557626227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8cfc0d1470 msgr2=0x7f8cfc1574a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:09.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.292+0000 7f8d0357f640 1 --2- 172.21.15.18:0/2557626227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8cfc0d1470 0x7f8cfc1574a0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f8cf40090b0 tx=0x7f8cf40046c0 comp rx=0 tx=0).stop 2024-09-19T09:17:09.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.292+0000 7f8d0357f640 1 -- 172.21.15.18:0/2557626227 shutdown_connections 2024-09-19T09:17:09.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.292+0000 7f8d0357f640 1 --2- 172.21.15.18:0/2557626227 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8ce806c2b0 0x7f8ce806e770 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:09.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.292+0000 7f8d0357f640 1 --2- 172.21.15.18:0/2557626227 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cfc1623c0 0x7f8cfc0ba0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:09.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.292+0000 7f8d0357f640 1 --2- 172.21.15.18:0/2557626227 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8cfc0d56b0 0x7f8cfc0c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:09.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.292+0000 7f8d0357f640 1 --2- 172.21.15.18:0/2557626227 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8cfc0d1470 0x7f8cfc1574a0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:09.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.292+0000 7f8d0357f640 1 -- 172.21.15.18:0/2557626227 >> 172.21.15.18:0/2557626227 conn(0x7f8cfc09df30 msgr2=0x7f8cfc06d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:09.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.292+0000 7f8d0357f640 1 -- 172.21.15.18:0/2557626227 shutdown_connections 2024-09-19T09:17:09.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.292+0000 7f8d0357f640 1 -- 172.21.15.18:0/2557626227 wait complete. 2024-09-19T09:17:09.304 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2024-09-19T09:17:09.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.405+0000 7f481ab11640 1 Processor -- start 2024-09-19T09:17:09.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.405+0000 7f481ab11640 1 -- start start 2024-09-19T09:17:09.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.406+0000 7f481ab11640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f48140b5670 0x7f48140ce250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:09.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.406+0000 7f481ab11640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48140ce790 0x7f48140cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:09.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.406+0000 7f481ab11640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f481415cfa0 con 0x7f481415fd50 2024-09-19T09:17:09.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.406+0000 7f481ab11640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f481415d280 con 0x7f48140b5670 2024-09-19T09:17:09.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.406+0000 7f481ab11640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f481415d560 con 0x7f48140ce790 2024-09-19T09:17:09.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.406+0000 7f48188ad640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f481415fd50 0x7f48140b4f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57564/0 (socket says 172.21.15.18:57564) 2024-09-19T09:17:09.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.406+0000 7f48188ad640 1 -- 172.21.15.18:0/987378683 learned_addr learned my addr 172.21.15.18:0/987378683 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:17:09.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.406+0000 7f480b7fe640 1 -- 172.21.15.18:0/987378683 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1212859393 0 0) 0x7f481415cfa0 con 0x7f481415fd50 2024-09-19T09:17:09.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.406+0000 7f480b7fe640 1 -- 172.21.15.18:0/987378683 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47fc003520 con 0x7f481415fd50 2024-09-19T09:17:09.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.406+0000 7f48190ae640 1 --2- 172.21.15.18:0/987378683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48140ce790 0x7f48140cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:09.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.406+0000 7f480bfff640 1 --2- 172.21.15.18:0/987378683 >> v2:172.21.15.162:3300/0 conn(0x7f48140b5670 0x7f48140ce250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:09.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.407+0000 7f480b7fe640 1 -- 172.21.15.18:0/987378683 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2215952356 0 0) 0x7f47fc003520 con 0x7f481415fd50 2024-09-19T09:17:09.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.407+0000 7f480b7fe640 1 -- 172.21.15.18:0/987378683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48140ce790 msgr2=0x7f48140cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:09.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.407+0000 7f480b7fe640 1 --2- 172.21.15.18:0/987378683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48140ce790 0x7f48140cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:09.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.407+0000 7f480b7fe640 1 -- 172.21.15.18:0/987378683 >> v2:172.21.15.162:3300/0 conn(0x7f48140b5670 msgr2=0x7f48140ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:09.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.407+0000 7f480b7fe640 1 --2- 172.21.15.18:0/987378683 >> v2:172.21.15.162:3300/0 conn(0x7f48140b5670 0x7f48140ce250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:09.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.407+0000 7f480b7fe640 1 -- 172.21.15.18:0/987378683 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f481415d840 con 0x7f481415fd50 2024-09-19T09:17:09.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.407+0000 7f480b7fe640 1 -- 172.21.15.18:0/987378683 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f4810001670 con 0x7f481415fd50 2024-09-19T09:17:09.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.407+0000 7f480b7fe640 1 -- 172.21.15.18:0/987378683 >> v1:172.21.15.18:6789/0 conn(0x7f481415fd50 legacy=0x7f48140b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:09.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.407+0000 7f480b7fe640 1 --2- 172.21.15.18:0/987378683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48140ce790 0x7f47fc0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:09.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.407+0000 7f480b7fe640 1 --2- 172.21.15.18:0/987378683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47fc003f30 0x7f47fc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:09.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.407+0000 7f480b7fe640 1 --2- 172.21.15.18:0/987378683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47fc004d40 0x7f47fc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:09.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.407+0000 7f480b7fe640 1 -- 172.21.15.18:0/987378683 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f481415d280 con 0x7f47fc003f30 2024-09-19T09:17:09.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.407+0000 7f480b7fe640 1 -- 172.21.15.18:0/987378683 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f481415d560 con 0x7f47fc004d40 2024-09-19T09:17:09.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.407+0000 7f480b7fe640 1 -- 172.21.15.18:0/987378683 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f47fc00b9c0 con 0x7f48140ce790 2024-09-19T09:17:09.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.407+0000 7f480bfff640 1 --2- 172.21.15.18:0/987378683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47fc003f30 0x7f47fc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:09.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.407+0000 7f48188ad640 1 --2- 172.21.15.18:0/987378683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48140ce790 0x7f47fc0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:09.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.407+0000 7f48190ae640 1 --2- 172.21.15.18:0/987378683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47fc004d40 0x7f47fc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:09.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.407+0000 7f480bfff640 1 -- 172.21.15.18:0/987378683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48140ce790 msgr2=0x7f47fc0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:09.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.407+0000 7f480bfff640 1 --2- 172.21.15.18:0/987378683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f48140ce790 0x7f47fc0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:09.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.407+0000 7f480bfff640 1 -- 172.21.15.18:0/987378683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47fc004d40 msgr2=0x7f47fc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:09.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.407+0000 7f480bfff640 1 --2- 172.21.15.18:0/987378683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47fc004d40 0x7f47fc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:09.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.407+0000 7f480bfff640 1 -- 172.21.15.18:0/987378683 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47fc003520 con 0x7f47fc003f30 2024-09-19T09:17:09.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.408+0000 7f480bfff640 1 --2- 172.21.15.18:0/987378683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47fc003f30 0x7f47fc004800 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f4804009a90 tx=0x7f47fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a790a711757834e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:09.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.408+0000 7f480b7fe640 1 -- 172.21.15.18:0/987378683 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4804036070 con 0x7f47fc003f30 2024-09-19T09:17:09.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.408+0000 7f480b7fe640 1 -- 172.21.15.18:0/987378683 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4804031400 con 0x7f47fc003f30 2024-09-19T09:17:09.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.408+0000 7f480b7fe640 1 -- 172.21.15.18:0/987378683 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4804009690 con 0x7f47fc003f30 2024-09-19T09:17:09.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.408+0000 7f481ab11640 1 -- 172.21.15.18:0/987378683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47fc003f30 msgr2=0x7f47fc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:09.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.408+0000 7f481ab11640 1 --2- 172.21.15.18:0/987378683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47fc003f30 0x7f47fc004800 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f4804009a90 tx=0x7f47fc005830 comp rx=0 tx=0).stop 2024-09-19T09:17:09.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.408+0000 7f48190ae640 1 -- 172.21.15.18:0/987378683 reap_dead start 2024-09-19T09:17:09.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.409+0000 7f481ab11640 1 -- 172.21.15.18:0/987378683 shutdown_connections 2024-09-19T09:17:09.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.409+0000 7f481ab11640 1 -- 172.21.15.18:0/987378683 >> 172.21.15.18:0/987378683 conn(0x7f48140b2b50 msgr2=0x7f48140b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:09.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.409+0000 7f481ab11640 1 -- 172.21.15.18:0/987378683 shutdown_connections 2024-09-19T09:17:09.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.409+0000 7f481ab11640 1 -- 172.21.15.18:0/987378683 wait complete. 2024-09-19T09:17:09.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.410+0000 7f481ab11640 1 Processor -- start 2024-09-19T09:17:09.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.410+0000 7f481ab11640 1 -- start start 2024-09-19T09:17:09.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.411+0000 7f481ab11640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47fc003f30 0x7f48141f6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:09.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.411+0000 7f481ab11640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48141f2220 0x7f48141502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:09.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.411+0000 7f481ab11640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48141f2660 0x7f4814073010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:09.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.411+0000 7f481ab11640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4814160130 con 0x7f48141f2220 2024-09-19T09:17:09.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.411+0000 7f481ab11640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f48140cec00 con 0x7f48141f2660 2024-09-19T09:17:09.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.411+0000 7f481ab11640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f48140cce30 con 0x7f47fc003f30 2024-09-19T09:17:09.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.411+0000 7f480bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48141f2220 0x7f48141502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:09.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.411+0000 7f480bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48141f2220 0x7f48141502e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51066/0 (socket says 172.21.15.18:51066) 2024-09-19T09:17:09.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.411+0000 7f480bfff640 1 -- 172.21.15.18:0/731581879 learned_addr learned my addr 172.21.15.18:0/731581879 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:09.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.411+0000 7f48190ae640 1 --2- 172.21.15.18:0/731581879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48141f2660 0x7f4814073010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:09.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.411+0000 7f48188ad640 1 --2- 172.21.15.18:0/731581879 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47fc003f30 0x7f48141f6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:09.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.411+0000 7f480bfff640 1 -- 172.21.15.18:0/731581879 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47fc003f30 msgr2=0x7f48141f6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:09.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.411+0000 7f480bfff640 1 --2- 172.21.15.18:0/731581879 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47fc003f30 0x7f48141f6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:09.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.411+0000 7f480bfff640 1 -- 172.21.15.18:0/731581879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48141f2660 msgr2=0x7f4814073010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:09.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.411+0000 7f480bfff640 1 --2- 172.21.15.18:0/731581879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48141f2660 0x7f4814073010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:09.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.411+0000 7f480bfff640 1 -- 172.21.15.18:0/731581879 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48141f5f70 con 0x7f48141f2220 2024-09-19T09:17:09.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.411+0000 7f480bfff640 1 --2- 172.21.15.18:0/731581879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48141f2220 0x7f48141502e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4804009a90 tx=0x7f4804004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:09.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.412+0000 7f48097fa640 1 -- 172.21.15.18:0/731581879 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4804040020 con 0x7f48141f2220 2024-09-19T09:17:09.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.412+0000 7f48097fa640 1 -- 172.21.15.18:0/731581879 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f480403b660 con 0x7f48141f2220 2024-09-19T09:17:09.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.412+0000 7f48097fa640 1 -- 172.21.15.18:0/731581879 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4804036040 con 0x7f48141f2220 2024-09-19T09:17:09.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.412+0000 7f481ab11640 1 -- 172.21.15.18:0/731581879 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4814150d80 con 0x7f48141f2220 2024-09-19T09:17:09.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.412+0000 7f481ab11640 1 -- 172.21.15.18:0/731581879 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48141f6230 con 0x7f48141f2220 2024-09-19T09:17:09.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.413+0000 7f481ab11640 1 -- 172.21.15.18:0/731581879 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4814075500 con 0x7f48141f2220 2024-09-19T09:17:09.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.413+0000 7f48097fa640 1 -- 172.21.15.18:0/731581879 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4804043020 con 0x7f48141f2220 2024-09-19T09:17:09.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.414+0000 7f48097fa640 1 --2- 172.21.15.18:0/731581879 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f480006c2b0 0x7f480006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:09.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.414+0000 7f48097fa640 1 -- 172.21.15.18:0/731581879 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 4943+0+0 (secure 0 0 0) 0x7f48040ab850 con 0x7f48141f2220 2024-09-19T09:17:09.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.414+0000 7f48188ad640 1 --2- 172.21.15.18:0/731581879 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f480006c2b0 0x7f480006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:09.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.415+0000 7f48188ad640 1 --2- 172.21.15.18:0/731581879 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f480006c2b0 0x7f480006e770 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4810001eb0 tx=0x7f4810007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:09.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.418+0000 7f48097fa640 1 -- 172.21.15.18:0/731581879 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f480404a030 con 0x7f48141f2220 2024-09-19T09:17:09.662 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.662+0000 7f481ab11640 1 -- 172.21.15.18:0/731581879 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) -- 0x7f48140ce250 con 0x7f48141f2220 2024-09-19T09:17:09.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.969+0000 7f48097fa640 1 -- 172.21.15.18:0/731581879 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v195) ==== 134+0+0 (secure 0 0 0) 0x7f4804079b40 con 0x7f48141f2220 2024-09-19T09:17:09.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.971+0000 7f481ab11640 1 -- 172.21.15.18:0/731581879 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f480006c2b0 msgr2=0x7f480006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:09.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.971+0000 7f481ab11640 1 --2- 172.21.15.18:0/731581879 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f480006c2b0 0x7f480006e770 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4810001eb0 tx=0x7f4810007040 comp rx=0 tx=0).stop 2024-09-19T09:17:09.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.971+0000 7f481ab11640 1 -- 172.21.15.18:0/731581879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48141f2220 msgr2=0x7f48141502e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:09.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.971+0000 7f481ab11640 1 --2- 172.21.15.18:0/731581879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48141f2220 0x7f48141502e0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f4804009a90 tx=0x7f4804004730 comp rx=0 tx=0).stop 2024-09-19T09:17:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.971+0000 7f481ab11640 1 -- 172.21.15.18:0/731581879 shutdown_connections 2024-09-19T09:17:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.971+0000 7f481ab11640 1 --2- 172.21.15.18:0/731581879 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f480006c2b0 0x7f480006e770 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.971+0000 7f481ab11640 1 --2- 172.21.15.18:0/731581879 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f48141f2660 0x7f4814073010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.971+0000 7f481ab11640 1 --2- 172.21.15.18:0/731581879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f48141f2220 0x7f48141502e0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.971+0000 7f481ab11640 1 --2- 172.21.15.18:0/731581879 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f47fc003f30 0x7f48141f6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.971+0000 7f481ab11640 1 -- 172.21.15.18:0/731581879 >> 172.21.15.18:0/731581879 conn(0x7f48140b2b50 msgr2=0x7f48140b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.971+0000 7f481ab11640 1 -- 172.21.15.18:0/731581879 shutdown_connections 2024-09-19T09:17:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:09.972+0000 7f481ab11640 1 -- 172.21.15.18:0/731581879 wait complete. 2024-09-19T09:17:09.983 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestClusterFull) ... ok 2024-09-19T09:17:09.983 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) That when the full flag is encountered during asynchronous 2024-09-19T09:17:09.983 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestClusterFull) 2024-09-19T09:17:09.984 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:17:10.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.086+0000 7f92d8349640 1 Processor -- start 2024-09-19T09:17:10.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.086+0000 7f92d8349640 1 -- start start 2024-09-19T09:17:10.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.087+0000 7f92d8349640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f92d00b1180 0x7f92d00cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:10.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.087+0000 7f92d8349640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92d006e730 con 0x7f92d015eb00 2024-09-19T09:17:10.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.087+0000 7f92d8349640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92d006ea10 con 0x7f92d015fef0 2024-09-19T09:17:10.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.087+0000 7f92d8349640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f92d01637e0 con 0x7f92d00b1180 2024-09-19T09:17:10.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.087+0000 7f92d60e5640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f92d015eb00 0x7f92d01630d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57570/0 (socket says 172.21.15.18:57570) 2024-09-19T09:17:10.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.087+0000 7f92d60e5640 1 -- 172.21.15.18:0/2290958383 learned_addr learned my addr 172.21.15.18:0/2290958383 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:17:10.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.087+0000 7f92d68e6640 1 --2- 172.21.15.18:0/2290958383 >> v2:172.21.15.162:3300/0 conn(0x7f92d00b1180 0x7f92d00cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:10.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.087+0000 7f92d50e3640 1 -- 172.21.15.18:0/2290958383 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3782572468 0 0) 0x7f92d006e730 con 0x7f92d015eb00 2024-09-19T09:17:10.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.087+0000 7f92d50e3640 1 -- 172.21.15.18:0/2290958383 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92bc003520 con 0x7f92d015eb00 2024-09-19T09:17:10.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.087+0000 7f92d50e3640 1 -- 172.21.15.18:0/2290958383 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1721145229 0 0) 0x7f92bc003520 con 0x7f92d015eb00 2024-09-19T09:17:10.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.088+0000 7f92d50e3640 1 -- 172.21.15.18:0/2290958383 >> v2:172.21.15.162:3300/0 conn(0x7f92d00b1180 msgr2=0x7f92d00cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:10.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.088+0000 7f92d50e3640 1 --2- 172.21.15.18:0/2290958383 >> v2:172.21.15.162:3300/0 conn(0x7f92d00b1180 0x7f92d00cf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.088+0000 7f92d50e3640 1 -- 172.21.15.18:0/2290958383 >> v1:172.21.15.162:6789/0 conn(0x7f92d015fef0 legacy=0x7f92d00b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:10.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.088+0000 7f92d50e3640 1 -- 172.21.15.18:0/2290958383 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d01628d0 con 0x7f92d015eb00 2024-09-19T09:17:10.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.088+0000 7f92d50e3640 1 -- 172.21.15.18:0/2290958383 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f92cc001670 con 0x7f92d015eb00 2024-09-19T09:17:10.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.088+0000 7f92d50e3640 1 -- 172.21.15.18:0/2290958383 >> v1:172.21.15.18:6789/0 conn(0x7f92d015eb00 legacy=0x7f92d01630d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:10.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.088+0000 7f92d50e3640 1 --2- 172.21.15.18:0/2290958383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92bc0039b0 0x7f92bc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:10.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.088+0000 7f92d50e3640 1 --2- 172.21.15.18:0/2290958383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92bc004800 0x7f92bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:10.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.088+0000 7f92d50e3640 1 --2- 172.21.15.18:0/2290958383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92bc0051c0 0x7f92bc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:10.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.088+0000 7f92d50e3640 1 -- 172.21.15.18:0/2290958383 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f92d01637e0 con 0x7f92bc004800 2024-09-19T09:17:10.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.088+0000 7f92d50e3640 1 -- 172.21.15.18:0/2290958383 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f92bc00c160 con 0x7f92bc0051c0 2024-09-19T09:17:10.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.088+0000 7f92d50e3640 1 -- 172.21.15.18:0/2290958383 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f92bc00c360 con 0x7f92bc0039b0 2024-09-19T09:17:10.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.088+0000 7f92d58e4640 1 --2- 172.21.15.18:0/2290958383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92bc004800 0x7f92bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:10.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.088+0000 7f92d60e5640 1 --2- 172.21.15.18:0/2290958383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92bc0039b0 0x7f92bc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:10.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.088+0000 7f92d68e6640 1 --2- 172.21.15.18:0/2290958383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92bc0051c0 0x7f92bc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:10.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.088+0000 7f92d58e4640 1 -- 172.21.15.18:0/2290958383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92bc0039b0 msgr2=0x7f92bc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:10.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.088+0000 7f92d58e4640 1 --2- 172.21.15.18:0/2290958383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92bc0039b0 0x7f92bc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.088+0000 7f92d58e4640 1 -- 172.21.15.18:0/2290958383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92bc0051c0 msgr2=0x7f92bc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:10.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.088+0000 7f92d58e4640 1 --2- 172.21.15.18:0/2290958383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92bc0051c0 0x7f92bc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.088+0000 7f92d58e4640 1 -- 172.21.15.18:0/2290958383 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92bc003520 con 0x7f92bc004800 2024-09-19T09:17:10.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.088+0000 7f92d68e6640 1 --2- 172.21.15.18:0/2290958383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92bc0051c0 0x7f92bc00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:10.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.088+0000 7f92d68e6640 1 -- 172.21.15.18:0/2290958383 reap_dead start 2024-09-19T09:17:10.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.089+0000 7f92d58e4640 1 --2- 172.21.15.18:0/2290958383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92bc004800 0x7f92bc004c80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f92c0001750 tx=0x7f92bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=317e1dc057aed136 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:10.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.089+0000 7f92d50e3640 1 -- 172.21.15.18:0/2290958383 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c0001370 con 0x7f92bc004800 2024-09-19T09:17:10.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.089+0000 7f92d50e3640 1 -- 172.21.15.18:0/2290958383 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92c00052d0 con 0x7f92bc004800 2024-09-19T09:17:10.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.089+0000 7f92d50e3640 1 -- 172.21.15.18:0/2290958383 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c002abc0 con 0x7f92bc004800 2024-09-19T09:17:10.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.089+0000 7f92d8349640 1 -- 172.21.15.18:0/2290958383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92bc004800 msgr2=0x7f92bc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:10.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.089+0000 7f92d8349640 1 --2- 172.21.15.18:0/2290958383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92bc004800 0x7f92bc004c80 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f92c0001750 tx=0x7f92bc005830 comp rx=0 tx=0).stop 2024-09-19T09:17:10.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.090+0000 7f92d8349640 1 -- 172.21.15.18:0/2290958383 shutdown_connections 2024-09-19T09:17:10.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.090+0000 7f92d8349640 1 --2- 172.21.15.18:0/2290958383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92bc004800 0x7f92bc004c80 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.090+0000 7f92d8349640 1 -- 172.21.15.18:0/2290958383 >> 172.21.15.18:0/2290958383 conn(0x7f92d006cd20 msgr2=0x7f92d006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:10.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.090+0000 7f92d8349640 1 -- 172.21.15.18:0/2290958383 shutdown_connections 2024-09-19T09:17:10.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.090+0000 7f92d8349640 1 -- 172.21.15.18:0/2290958383 wait complete. 2024-09-19T09:17:10.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.091+0000 7f92d8349640 1 Processor -- start 2024-09-19T09:17:10.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.091+0000 7f92d8349640 1 -- start start 2024-09-19T09:17:10.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.091+0000 7f92d8349640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92bc004800 0x7f92d01f4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:10.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.091+0000 7f92d8349640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92d01594a0 0x7f92d0158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:10.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.091+0000 7f92d8349640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92d01e8670 0x7f92d00cfd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:10.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.092+0000 7f92d8349640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f92d006d990 con 0x7f92d01594a0 2024-09-19T09:17:10.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.092+0000 7f92d8349640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f92d006d810 con 0x7f92bc004800 2024-09-19T09:17:10.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.092+0000 7f92d8349640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f92d006ffd0 con 0x7f92d01e8670 2024-09-19T09:17:10.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.092+0000 7f92d58e4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92d01594a0 0x7f92d0158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:10.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.092+0000 7f92d58e4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92d01594a0 0x7f92d0158d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51094/0 (socket says 172.21.15.18:51094) 2024-09-19T09:17:10.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.092+0000 7f92d58e4640 1 -- 172.21.15.18:0/2445680205 learned_addr learned my addr 172.21.15.18:0/2445680205 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:10.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.092+0000 7f92d60e5640 1 --2- 172.21.15.18:0/2445680205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92bc004800 0x7f92d01f4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:10.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.092+0000 7f92d68e6640 1 --2- 172.21.15.18:0/2445680205 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92d01e8670 0x7f92d00cfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:10.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.092+0000 7f92d58e4640 1 -- 172.21.15.18:0/2445680205 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92d01e8670 msgr2=0x7f92d00cfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:10.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.092+0000 7f92d58e4640 1 --2- 172.21.15.18:0/2445680205 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92d01e8670 0x7f92d00cfd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.092+0000 7f92d58e4640 1 -- 172.21.15.18:0/2445680205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92bc004800 msgr2=0x7f92d01f4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:10.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.092+0000 7f92d58e4640 1 --2- 172.21.15.18:0/2445680205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92bc004800 0x7f92d01f4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.092+0000 7f92d58e4640 1 -- 172.21.15.18:0/2445680205 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d00af0f0 con 0x7f92d01594a0 2024-09-19T09:17:10.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.092+0000 7f92d68e6640 1 --2- 172.21.15.18:0/2445680205 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92d01e8670 0x7f92d00cfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:10.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.092+0000 7f92d58e4640 1 --2- 172.21.15.18:0/2445680205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92d01594a0 0x7f92d0158d50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f92c0000c00 tx=0x7f92c0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:10.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.092+0000 7f92c6ffd640 1 -- 172.21.15.18:0/2445680205 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c003f030 con 0x7f92d01594a0 2024-09-19T09:17:10.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.092+0000 7f92c6ffd640 1 -- 172.21.15.18:0/2445680205 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92c0005480 con 0x7f92d01594a0 2024-09-19T09:17:10.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.092+0000 7f92d8349640 1 -- 172.21.15.18:0/2445680205 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92d00af3d0 con 0x7f92d01594a0 2024-09-19T09:17:10.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.092+0000 7f92c6ffd640 1 -- 172.21.15.18:0/2445680205 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c0037040 con 0x7f92d01594a0 2024-09-19T09:17:10.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.092+0000 7f92d8349640 1 -- 172.21.15.18:0/2445680205 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92d00af990 con 0x7f92d01594a0 2024-09-19T09:17:10.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.093+0000 7f92d8349640 1 -- 172.21.15.18:0/2445680205 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92d00d1460 con 0x7f92d01594a0 2024-09-19T09:17:10.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.094+0000 7f92c6ffd640 1 -- 172.21.15.18:0/2445680205 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f92c0042070 con 0x7f92d01594a0 2024-09-19T09:17:10.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.094+0000 7f92c6ffd640 1 --2- 172.21.15.18:0/2445680205 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f92b406c2e0 0x7f92b406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:10.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.094+0000 7f92c6ffd640 1 -- 172.21.15.18:0/2445680205 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 4943+0+0 (secure 0 0 0) 0x7f92c00aa660 con 0x7f92d01594a0 2024-09-19T09:17:10.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.095+0000 7f92d60e5640 1 --2- 172.21.15.18:0/2445680205 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f92b406c2e0 0x7f92b406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:10.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.095+0000 7f92d60e5640 1 --2- 172.21.15.18:0/2445680205 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f92b406c2e0 0x7f92b406e7a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f92cc0015d0 tx=0x7f92cc0078f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:10.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.099+0000 7f92c6ffd640 1 -- 172.21.15.18:0/2445680205 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f92c0079040 con 0x7f92d01594a0 2024-09-19T09:17:10.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.278+0000 7f92d8349640 1 -- 172.21.15.18:0/2445680205 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f92d006c8f0 con 0x7f92d01594a0 2024-09-19T09:17:10.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.279+0000 7f92c6ffd640 1 -- 172.21.15.18:0/2445680205 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+13044 (secure 0 0 0) 0x7f92c0078940 con 0x7f92d01594a0 2024-09-19T09:17:10.279 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:17:10.279 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":81,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:17:08.967622+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":68,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6835/1824357592":"2024-09-20T09:17:05.958053+0000","172.21.15.18:6833/1824357592":"2024-09-20T09:17:05.958053+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:17:10.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.281+0000 7f92d8349640 1 -- 172.21.15.18:0/2445680205 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f92b406c2e0 msgr2=0x7f92b406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:10.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.281+0000 7f92d8349640 1 --2- 172.21.15.18:0/2445680205 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f92b406c2e0 0x7f92b406e7a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f92cc0015d0 tx=0x7f92cc0078f0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.281+0000 7f92d8349640 1 -- 172.21.15.18:0/2445680205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92d01594a0 msgr2=0x7f92d0158d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:10.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.281+0000 7f92d8349640 1 --2- 172.21.15.18:0/2445680205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92d01594a0 0x7f92d0158d50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f92c0000c00 tx=0x7f92c0001120 comp rx=0 tx=0).stop 2024-09-19T09:17:10.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.281+0000 7f92d8349640 1 -- 172.21.15.18:0/2445680205 shutdown_connections 2024-09-19T09:17:10.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.281+0000 7f92d8349640 1 --2- 172.21.15.18:0/2445680205 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f92b406c2e0 0x7f92b406e7a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.281+0000 7f92d8349640 1 --2- 172.21.15.18:0/2445680205 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92d01e8670 0x7f92d00cfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.281+0000 7f92d8349640 1 --2- 172.21.15.18:0/2445680205 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92d01594a0 0x7f92d0158d50 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.281+0000 7f92d8349640 1 --2- 172.21.15.18:0/2445680205 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92bc004800 0x7f92d01f4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.281+0000 7f92d8349640 1 -- 172.21.15.18:0/2445680205 >> 172.21.15.18:0/2445680205 conn(0x7f92d006cd20 msgr2=0x7f92d00b1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:10.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.281+0000 7f92d8349640 1 -- 172.21.15.18:0/2445680205 shutdown_connections 2024-09-19T09:17:10.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.281+0000 7f92d8349640 1 -- 172.21.15.18:0/2445680205 wait complete. 2024-09-19T09:17:10.293 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T09:13:17.564717+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T09:17:10.294 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T09:17:10.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.399+0000 7f62fc168640 1 Processor -- start 2024-09-19T09:17:10.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.399+0000 7f62fc168640 1 -- start start 2024-09-19T09:17:10.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.400+0000 7f62fc168640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62f40d17f0 0x7f62f40b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:10.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.400+0000 7f62fc168640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62f40d5c20 con 0x7f62f40d1bd0 2024-09-19T09:17:10.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.400+0000 7f62fc168640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62f40d2150 con 0x7f62f41626c0 2024-09-19T09:17:10.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.400+0000 7f62fc168640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f62f40b5020 con 0x7f62f40d17f0 2024-09-19T09:17:10.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.400+0000 7f62f9703640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f62f40d1bd0 0x7f62f4161fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57584/0 (socket says 172.21.15.18:57584) 2024-09-19T09:17:10.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.400+0000 7f62f9703640 1 -- 172.21.15.18:0/2157463648 learned_addr learned my addr 172.21.15.18:0/2157463648 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:17:10.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.400+0000 7f62f8f02640 1 -- 172.21.15.18:0/2157463648 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 162300624 0 0) 0x7f62f40d5c20 con 0x7f62f40d1bd0 2024-09-19T09:17:10.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.400+0000 7f62f8f02640 1 -- 172.21.15.18:0/2157463648 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62e0003520 con 0x7f62f40d1bd0 2024-09-19T09:17:10.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.400+0000 7f62f9f04640 1 --2- 172.21.15.18:0/2157463648 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62f40d17f0 0x7f62f40b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:10.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.400+0000 7f62f8f02640 1 -- 172.21.15.18:0/2157463648 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1764302176 0 0) 0x7f62e0003520 con 0x7f62f40d1bd0 2024-09-19T09:17:10.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.400+0000 7f62f8f02640 1 -- 172.21.15.18:0/2157463648 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62f40d17f0 msgr2=0x7f62f40b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:10.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.400+0000 7f62f8f02640 1 --2- 172.21.15.18:0/2157463648 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62f40d17f0 0x7f62f40b54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.400+0000 7f62f8f02640 1 -- 172.21.15.18:0/2157463648 >> v1:172.21.15.162:6789/0 conn(0x7f62f41626c0 legacy=0x7f62f40d28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:10.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.401+0000 7f62f8f02640 1 -- 172.21.15.18:0/2157463648 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f40d2430 con 0x7f62f40d1bd0 2024-09-19T09:17:10.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.401+0000 7f62f8f02640 1 -- 172.21.15.18:0/2157463648 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f62e4001670 con 0x7f62f40d1bd0 2024-09-19T09:17:10.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.401+0000 7f62f8f02640 1 -- 172.21.15.18:0/2157463648 >> v1:172.21.15.18:6789/0 conn(0x7f62f40d1bd0 legacy=0x7f62f4161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:10.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.401+0000 7f62f8f02640 1 --2- 172.21.15.18:0/2157463648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62e00039e0 0x7f62e0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.401+0000 7f62f8f02640 1 --2- 172.21.15.18:0/2157463648 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62f40d17f0 0x7f62e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.401+0000 7f62f8f02640 1 --2- 172.21.15.18:0/2157463648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e0004d40 0x7f62e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.401+0000 7f62f8f02640 1 -- 172.21.15.18:0/2157463648 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f62f40b5020 con 0x7f62e00039e0 2024-09-19T09:17:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.401+0000 7f62f8f02640 1 -- 172.21.15.18:0/2157463648 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f62e000bb50 con 0x7f62e0004d40 2024-09-19T09:17:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.401+0000 7f62f8f02640 1 -- 172.21.15.18:0/2157463648 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f62e000bd20 con 0x7f62f40d17f0 2024-09-19T09:17:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.401+0000 7f62f9f04640 1 --2- 172.21.15.18:0/2157463648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62e00039e0 0x7f62e0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.401+0000 7f62f9703640 1 --2- 172.21.15.18:0/2157463648 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62f40d17f0 0x7f62e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.401+0000 7f62fa705640 1 --2- 172.21.15.18:0/2157463648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e0004d40 0x7f62e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.401+0000 7f62f9f04640 1 -- 172.21.15.18:0/2157463648 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62f40d17f0 msgr2=0x7f62e0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.401+0000 7f62f9f04640 1 --2- 172.21.15.18:0/2157463648 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62f40d17f0 0x7f62e0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.401+0000 7f62f9f04640 1 -- 172.21.15.18:0/2157463648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e0004d40 msgr2=0x7f62e00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.401+0000 7f62f9f04640 1 --2- 172.21.15.18:0/2157463648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e0004d40 0x7f62e00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.401+0000 7f62f9f04640 1 -- 172.21.15.18:0/2157463648 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e0003520 con 0x7f62e00039e0 2024-09-19T09:17:10.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.401+0000 7f62fa705640 1 --2- 172.21.15.18:0/2157463648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e0004d40 0x7f62e00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:10.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.402+0000 7f62f9f04640 1 --2- 172.21.15.18:0/2157463648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62e00039e0 0x7f62e0003e00 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f62f000ba60 tx=0x7f62e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=756e139545d8ea6a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:10.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.402+0000 7f62f8f02640 1 -- 172.21.15.18:0/2157463648 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f0030070 con 0x7f62e00039e0 2024-09-19T09:17:10.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.402+0000 7f62f8f02640 1 -- 172.21.15.18:0/2157463648 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62f002ae10 con 0x7f62e00039e0 2024-09-19T09:17:10.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.402+0000 7f62f8f02640 1 -- 172.21.15.18:0/2157463648 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f000b600 con 0x7f62e00039e0 2024-09-19T09:17:10.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.402+0000 7f62fc168640 1 -- 172.21.15.18:0/2157463648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62e00039e0 msgr2=0x7f62e0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:10.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.402+0000 7f62fc168640 1 --2- 172.21.15.18:0/2157463648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62e00039e0 0x7f62e0003e00 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f62f000ba60 tx=0x7f62e0005830 comp rx=0 tx=0).stop 2024-09-19T09:17:10.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.402+0000 7f62fa705640 1 -- 172.21.15.18:0/2157463648 reap_dead start 2024-09-19T09:17:10.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.402+0000 7f62fc168640 1 -- 172.21.15.18:0/2157463648 shutdown_connections 2024-09-19T09:17:10.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.402+0000 7f62fc168640 1 -- 172.21.15.18:0/2157463648 >> 172.21.15.18:0/2157463648 conn(0x7f62f40d4d20 msgr2=0x7f62f40d5130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:10.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.403+0000 7f62fc168640 1 -- 172.21.15.18:0/2157463648 shutdown_connections 2024-09-19T09:17:10.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.403+0000 7f62fc168640 1 -- 172.21.15.18:0/2157463648 wait complete. 2024-09-19T09:17:10.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.404+0000 7f62fc168640 1 Processor -- start 2024-09-19T09:17:10.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.404+0000 7f62fc168640 1 -- start start 2024-09-19T09:17:10.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.404+0000 7f62fc168640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e00039e0 0x7f62f40ce970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:10.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.404+0000 7f62fc168640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f40b2680 0x7f62f40b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:10.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.404+0000 7f62fc168640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62f414e190 0x7f62f414e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:10.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.404+0000 7f62fc168640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f62f40b5630 con 0x7f62f40b2680 2024-09-19T09:17:10.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.404+0000 7f62fc168640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f62f40b54b0 con 0x7f62e00039e0 2024-09-19T09:17:10.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.404+0000 7f62fc168640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f62f40b57b0 con 0x7f62f414e190 2024-09-19T09:17:10.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.405+0000 7f62f9703640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f40b2680 0x7f62f40b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:10.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.405+0000 7f62f9703640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f40b2680 0x7f62f40b2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51108/0 (socket says 172.21.15.18:51108) 2024-09-19T09:17:10.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.405+0000 7f62f9703640 1 -- 172.21.15.18:0/1297715332 learned_addr learned my addr 172.21.15.18:0/1297715332 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:10.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.405+0000 7f62f9f04640 1 --2- 172.21.15.18:0/1297715332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e00039e0 0x7f62f40ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:10.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.405+0000 7f62fa705640 1 --2- 172.21.15.18:0/1297715332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62f414e190 0x7f62f414e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:10.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.405+0000 7f62f9703640 1 -- 172.21.15.18:0/1297715332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62f414e190 msgr2=0x7f62f414e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:10.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.405+0000 7f62f9703640 1 --2- 172.21.15.18:0/1297715332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62f414e190 0x7f62f414e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.405+0000 7f62f9703640 1 -- 172.21.15.18:0/1297715332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e00039e0 msgr2=0x7f62f40ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:10.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.405+0000 7f62f9703640 1 --2- 172.21.15.18:0/1297715332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e00039e0 0x7f62f40ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.405+0000 7f62f9703640 1 -- 172.21.15.18:0/1297715332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f40ceeb0 con 0x7f62f40b2680 2024-09-19T09:17:10.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.405+0000 7f62f9f04640 1 --2- 172.21.15.18:0/1297715332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e00039e0 0x7f62f40ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:10.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.405+0000 7f62f9703640 1 --2- 172.21.15.18:0/1297715332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f40b2680 0x7f62f40b2b00 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f62e4001eb0 tx=0x7f62e400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:10.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.405+0000 7f62ea7fc640 1 -- 172.21.15.18:0/1297715332 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e400c8a0 con 0x7f62f40b2680 2024-09-19T09:17:10.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.405+0000 7f62ea7fc640 1 -- 172.21.15.18:0/1297715332 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e4018070 con 0x7f62f40b2680 2024-09-19T09:17:10.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.405+0000 7f62fc168640 1 -- 172.21.15.18:0/1297715332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62f414ef50 con 0x7f62f40b2680 2024-09-19T09:17:10.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.405+0000 7f62ea7fc640 1 -- 172.21.15.18:0/1297715332 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e400cc80 con 0x7f62f40b2680 2024-09-19T09:17:10.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.405+0000 7f62fc168640 1 -- 172.21.15.18:0/1297715332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62f41f8310 con 0x7f62f40b2680 2024-09-19T09:17:10.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.406+0000 7f62fc168640 1 -- 172.21.15.18:0/1297715332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62f40b5a20 con 0x7f62f40b2680 2024-09-19T09:17:10.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.407+0000 7f62ea7fc640 1 -- 172.21.15.18:0/1297715332 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f62e401d460 con 0x7f62f40b2680 2024-09-19T09:17:10.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.407+0000 7f62ea7fc640 1 --2- 172.21.15.18:0/1297715332 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f62d806c2b0 0x7f62d806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:10.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.407+0000 7f62ea7fc640 1 -- 172.21.15.18:0/1297715332 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 4943+0+0 (secure 0 0 0) 0x7f62e408af20 con 0x7f62f40b2680 2024-09-19T09:17:10.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.407+0000 7f62f9f04640 1 --2- 172.21.15.18:0/1297715332 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f62d806c2b0 0x7f62d806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:10.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.408+0000 7f62f9f04640 1 --2- 172.21.15.18:0/1297715332 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f62d806c2b0 0x7f62d806e770 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f62f000ba30 tx=0x7f62f0030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:10.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.411+0000 7f62ea7fc640 1 -- 172.21.15.18:0/1297715332 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f62e400ce20 con 0x7f62f40b2680 2024-09-19T09:17:10.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.585+0000 7f62fc168640 1 -- 172.21.15.18:0/1297715332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f62f406c1a0 con 0x7f62f40b2680 2024-09-19T09:17:10.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.585+0000 7f62ea7fc640 1 -- 172.21.15.18:0/1297715332 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) ==== 93+0+10 (secure 0 0 0) 0x7f62e4059a20 con 0x7f62f40b2680 2024-09-19T09:17:10.586 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-09-19T09:17:10.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.587+0000 7f62fc168640 1 -- 172.21.15.18:0/1297715332 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f62d806c2b0 msgr2=0x7f62d806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:10.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.587+0000 7f62fc168640 1 --2- 172.21.15.18:0/1297715332 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f62d806c2b0 0x7f62d806e770 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f62f000ba30 tx=0x7f62f0030000 comp rx=0 tx=0).stop 2024-09-19T09:17:10.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.587+0000 7f62fc168640 1 -- 172.21.15.18:0/1297715332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f40b2680 msgr2=0x7f62f40b2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:10.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.587+0000 7f62fc168640 1 --2- 172.21.15.18:0/1297715332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f40b2680 0x7f62f40b2b00 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f62e4001eb0 tx=0x7f62e400ec60 comp rx=0 tx=0).stop 2024-09-19T09:17:10.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.587+0000 7f62fc168640 1 -- 172.21.15.18:0/1297715332 shutdown_connections 2024-09-19T09:17:10.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.587+0000 7f62fc168640 1 --2- 172.21.15.18:0/1297715332 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f62d806c2b0 0x7f62d806e770 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.587+0000 7f62fc168640 1 --2- 172.21.15.18:0/1297715332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62f414e190 0x7f62f414e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.587+0000 7f62fc168640 1 --2- 172.21.15.18:0/1297715332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f40b2680 0x7f62f40b2b00 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.587+0000 7f62fc168640 1 --2- 172.21.15.18:0/1297715332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e00039e0 0x7f62f40ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.587+0000 7f62fc168640 1 -- 172.21.15.18:0/1297715332 >> 172.21.15.18:0/1297715332 conn(0x7f62f40d4d20 msgr2=0x7f62f40d28d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:10.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.587+0000 7f62fc168640 1 -- 172.21.15.18:0/1297715332 shutdown_connections 2024-09-19T09:17:10.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.587+0000 7f62fc168640 1 -- 172.21.15.18:0/1297715332 wait complete. 2024-09-19T09:17:10.599 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2024-09-19T09:17:10.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.701+0000 7fc86b28d640 1 Processor -- start 2024-09-19T09:17:10.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.701+0000 7fc86b28d640 1 -- start start 2024-09-19T09:17:10.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.702+0000 7fc86b28d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc864160300 0x7fc8640cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:10.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.702+0000 7fc86b28d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc8640708f0 0x7fc8640cd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:10.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.702+0000 7fc86b28d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8640d0050 con 0x7fc8640d1ed0 2024-09-19T09:17:10.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.702+0000 7fc86b28d640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fc8640d0330 con 0x7fc8640708f0 2024-09-19T09:17:10.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.702+0000 7fc86b28d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc8640d1420 con 0x7fc864160300 2024-09-19T09:17:10.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.702+0000 7fc86982a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc8640708f0 0x7fc8640cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:10.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.702+0000 7fc86982a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc8640708f0 0x7fc8640cd730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51118/0 (socket says 172.21.15.18:51118) 2024-09-19T09:17:10.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.702+0000 7fc86982a640 1 -- 172.21.15.18:0/3341421549 learned_addr learned my addr 172.21.15.18:0/3341421549 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.702+0000 7fc869029640 1 --2- 172.21.15.18:0/3341421549 >> v2:172.21.15.162:3300/0 conn(0x7fc864160300 0x7fc8640cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.702+0000 7fc86982a640 1 -- 172.21.15.18:0/3341421549 >> v2:172.21.15.162:3300/0 conn(0x7fc864160300 msgr2=0x7fc8640cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.702+0000 7fc86982a640 1 --2- 172.21.15.18:0/3341421549 >> v2:172.21.15.162:3300/0 conn(0x7fc864160300 0x7fc8640cf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.702+0000 7fc86982a640 1 -- 172.21.15.18:0/3341421549 >> v1:172.21.15.162:6789/0 conn(0x7fc8640d1ed0 legacy=0x7fc8640cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.702+0000 7fc86982a640 1 -- 172.21.15.18:0/3341421549 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8640d1700 con 0x7fc8640708f0 2024-09-19T09:17:10.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.703+0000 7fc86982a640 1 --2- 172.21.15.18:0/3341421549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8640708f0 0x7fc8640cd730 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc864072570 tx=0x7fc85c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc55ccd218a05ed9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:10.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.703+0000 7fc85bfff640 1 -- 172.21.15.18:0/3341421549 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85c036070 con 0x7fc8640708f0 2024-09-19T09:17:10.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.703+0000 7fc85bfff640 1 -- 172.21.15.18:0/3341421549 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc85c031600 con 0x7fc8640708f0 2024-09-19T09:17:10.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.703+0000 7fc85bfff640 1 -- 172.21.15.18:0/3341421549 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85c0319d0 con 0x7fc8640708f0 2024-09-19T09:17:10.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.704+0000 7fc86b28d640 1 -- 172.21.15.18:0/3341421549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8640708f0 msgr2=0x7fc8640cd730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:10.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.704+0000 7fc86b28d640 1 --2- 172.21.15.18:0/3341421549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8640708f0 0x7fc8640cd730 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fc864072570 tx=0x7fc85c02a6a0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.704+0000 7fc86b28d640 1 -- 172.21.15.18:0/3341421549 shutdown_connections 2024-09-19T09:17:10.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.704+0000 7fc86b28d640 1 --2- 172.21.15.18:0/3341421549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc8640708f0 0x7fc8640cd730 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.704+0000 7fc86b28d640 1 --2- 172.21.15.18:0/3341421549 >> v2:172.21.15.162:3300/0 conn(0x7fc864160300 0x7fc8640cf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.704+0000 7fc86b28d640 1 -- 172.21.15.18:0/3341421549 >> 172.21.15.18:0/3341421549 conn(0x7fc8640b4600 msgr2=0x7fc8640b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:10.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.704+0000 7fc86b28d640 1 -- 172.21.15.18:0/3341421549 shutdown_connections 2024-09-19T09:17:10.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.704+0000 7fc86b28d640 1 -- 172.21.15.18:0/3341421549 wait complete. 2024-09-19T09:17:10.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.705+0000 7fc86b28d640 1 Processor -- start 2024-09-19T09:17:10.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.706+0000 7fc86b28d640 1 -- start start 2024-09-19T09:17:10.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.706+0000 7fc86b28d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8640708f0 0x7fc86414bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:10.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.706+0000 7fc86b28d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8640d1ed0 0x7fc8640b8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:10.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.706+0000 7fc86b28d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc864160300 0x7fc8640b5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:10.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.706+0000 7fc86b28d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc8641606e0 con 0x7fc864160300 2024-09-19T09:17:10.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.706+0000 7fc86b28d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc8640b54a0 con 0x7fc8640708f0 2024-09-19T09:17:10.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.706+0000 7fc86b28d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc864160860 con 0x7fc8640d1ed0 2024-09-19T09:17:10.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.706+0000 7fc86982a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc864160300 0x7fc8640b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:10.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.706+0000 7fc86982a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc864160300 0x7fc8640b5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51134/0 (socket says 172.21.15.18:51134) 2024-09-19T09:17:10.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.706+0000 7fc86982a640 1 -- 172.21.15.18:0/3929426110 learned_addr learned my addr 172.21.15.18:0/3929426110 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:10.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.706+0000 7fc869029640 1 --2- 172.21.15.18:0/3929426110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8640708f0 0x7fc86414bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:10.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.707+0000 7fc868828640 1 --2- 172.21.15.18:0/3929426110 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8640d1ed0 0x7fc8640b8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:10.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.707+0000 7fc86982a640 1 -- 172.21.15.18:0/3929426110 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8640d1ed0 msgr2=0x7fc8640b8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:10.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.707+0000 7fc86982a640 1 --2- 172.21.15.18:0/3929426110 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8640d1ed0 0x7fc8640b8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.707+0000 7fc86982a640 1 -- 172.21.15.18:0/3929426110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8640708f0 msgr2=0x7fc86414bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:10.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.707+0000 7fc86982a640 1 --2- 172.21.15.18:0/3929426110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8640708f0 0x7fc86414bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.707+0000 7fc86982a640 1 -- 172.21.15.18:0/3929426110 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc86414c3e0 con 0x7fc864160300 2024-09-19T09:17:10.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.707+0000 7fc868828640 1 --2- 172.21.15.18:0/3929426110 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8640d1ed0 0x7fc8640b8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:10.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.707+0000 7fc86982a640 1 --2- 172.21.15.18:0/3929426110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc864160300 0x7fc8640b5900 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc85c034040 tx=0x7fc85c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:10.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.707+0000 7fc859ffb640 1 -- 172.21.15.18:0/3929426110 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85c036050 con 0x7fc864160300 2024-09-19T09:17:10.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.707+0000 7fc859ffb640 1 -- 172.21.15.18:0/3929426110 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc85c042070 con 0x7fc864160300 2024-09-19T09:17:10.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.707+0000 7fc859ffb640 1 -- 172.21.15.18:0/3929426110 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc85c009510 con 0x7fc864160300 2024-09-19T09:17:10.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.707+0000 7fc86b28d640 1 -- 172.21.15.18:0/3929426110 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc86415ac10 con 0x7fc864160300 2024-09-19T09:17:10.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.707+0000 7fc86b28d640 1 -- 172.21.15.18:0/3929426110 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc86415b1d0 con 0x7fc864160300 2024-09-19T09:17:10.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.708+0000 7fc86b28d640 1 -- 172.21.15.18:0/3929426110 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8640cf2d0 con 0x7fc864160300 2024-09-19T09:17:10.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.709+0000 7fc859ffb640 1 -- 172.21.15.18:0/3929426110 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc85c007bf0 con 0x7fc864160300 2024-09-19T09:17:10.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.709+0000 7fc859ffb640 1 --2- 172.21.15.18:0/3929426110 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc84806c2b0 0x7fc84806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:10.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.709+0000 7fc859ffb640 1 -- 172.21.15.18:0/3929426110 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 4943+0+0 (secure 0 0 0) 0x7fc85c0abe20 con 0x7fc864160300 2024-09-19T09:17:10.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.710+0000 7fc869029640 1 --2- 172.21.15.18:0/3929426110 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc84806c2b0 0x7fc84806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:10.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.710+0000 7fc869029640 1 --2- 172.21.15.18:0/3929426110 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc84806c2b0 0x7fc84806e770 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc860009aa0 tx=0x7fc860009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:10.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.714+0000 7fc859ffb640 1 -- 172.21.15.18:0/3929426110 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc86414c3e0 con 0x7fc864160300 2024-09-19T09:17:10.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.963+0000 7fc86b28d640 1 -- 172.21.15.18:0/3929426110 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) -- 0x7fc864068740 con 0x7fc864160300 2024-09-19T09:17:10.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.970+0000 7fc859ffb640 1 -- 172.21.15.18:0/3929426110 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v196) ==== 136+0+0 (secure 0 0 0) 0x7fc85c07a880 con 0x7fc864160300 2024-09-19T09:17:10.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.972+0000 7fc86b28d640 1 -- 172.21.15.18:0/3929426110 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc84806c2b0 msgr2=0x7fc84806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:10.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.972+0000 7fc86b28d640 1 --2- 172.21.15.18:0/3929426110 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc84806c2b0 0x7fc84806e770 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc860009aa0 tx=0x7fc860009190 comp rx=0 tx=0).stop 2024-09-19T09:17:10.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.972+0000 7fc86b28d640 1 -- 172.21.15.18:0/3929426110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc864160300 msgr2=0x7fc8640b5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:10.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.972+0000 7fc86b28d640 1 --2- 172.21.15.18:0/3929426110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc864160300 0x7fc8640b5900 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc85c034040 tx=0x7fc85c004a40 comp rx=0 tx=0).stop 2024-09-19T09:17:10.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.972+0000 7fc86b28d640 1 -- 172.21.15.18:0/3929426110 shutdown_connections 2024-09-19T09:17:10.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.972+0000 7fc86b28d640 1 --2- 172.21.15.18:0/3929426110 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc84806c2b0 0x7fc84806e770 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.972+0000 7fc86b28d640 1 --2- 172.21.15.18:0/3929426110 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc864160300 0x7fc8640b5900 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.972+0000 7fc86b28d640 1 --2- 172.21.15.18:0/3929426110 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc8640d1ed0 0x7fc8640b8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.972+0000 7fc86b28d640 1 --2- 172.21.15.18:0/3929426110 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc8640708f0 0x7fc86414bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:10.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.972+0000 7fc86b28d640 1 -- 172.21.15.18:0/3929426110 >> 172.21.15.18:0/3929426110 conn(0x7fc8640b4600 msgr2=0x7fc8640d2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:10.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.973+0000 7fc86b28d640 1 -- 172.21.15.18:0/3929426110 shutdown_connections 2024-09-19T09:17:10.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:10.973+0000 7fc86b28d640 1 -- 172.21.15.18:0/3929426110 wait complete. 2024-09-19T09:17:10.984 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2024-09-19T09:17:11.097 INFO:teuthology.orchestra.run.smithi018.stdout:{"osd_objectstore":"memstore"} 2024-09-19T09:17:11.098 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2024-09-19T09:17:11.098 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-19T09:17:11.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.202+0000 7f0362742640 1 Processor -- start 2024-09-19T09:17:11.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.202+0000 7f0362742640 1 -- start start 2024-09-19T09:17:11.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.203+0000 7f0362742640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f035c15a670 0x7f035c15dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:11.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.203+0000 7f0362742640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f035c0b5970 0x7f035c0b6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:11.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.203+0000 7f0362742640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f035c0b69c0 0x7f035c160610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:11.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.203+0000 7f0362742640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f035c0b6150 con 0x7f035c0b69c0 2024-09-19T09:17:11.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.203+0000 7f0362742640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f035c15aa50 con 0x7f035c0b5970 2024-09-19T09:17:11.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.203+0000 7f0362742640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f035c15e310 con 0x7f035c15a670 2024-09-19T09:17:11.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.203+0000 7f0360cdf640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f035c0b69c0 0x7f035c160610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:11.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.203+0000 7f0360cdf640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f035c0b69c0 0x7f035c160610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51136/0 (socket says 172.21.15.18:51136) 2024-09-19T09:17:11.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.203+0000 7f0360cdf640 1 -- 172.21.15.18:0/356537272 learned_addr learned my addr 172.21.15.18:0/356537272 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:11.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.203+0000 7f035bfff640 1 --2- 172.21.15.18:0/356537272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f035c15a670 0x7f035c15dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:11.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.203+0000 7f035b7fe640 1 --2- 172.21.15.18:0/356537272 >> v2:172.21.15.162:3300/0 conn(0x7f035c0b5970 0x7f035c0b6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:11.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.204+0000 7f0360cdf640 1 -- 172.21.15.18:0/356537272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f035c15a670 msgr2=0x7f035c15dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:11.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.204+0000 7f0360cdf640 1 --2- 172.21.15.18:0/356537272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f035c15a670 0x7f035c15dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:11.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.204+0000 7f0360cdf640 1 -- 172.21.15.18:0/356537272 >> v2:172.21.15.162:3300/0 conn(0x7f035c0b5970 msgr2=0x7f035c0b6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:11.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.204+0000 7f0360cdf640 1 --2- 172.21.15.18:0/356537272 >> v2:172.21.15.162:3300/0 conn(0x7f035c0b5970 0x7f035c0b6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:11.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.204+0000 7f0360cdf640 1 -- 172.21.15.18:0/356537272 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f035c15e5f0 con 0x7f035c0b69c0 2024-09-19T09:17:11.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.205+0000 7f0360cdf640 1 --2- 172.21.15.18:0/356537272 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f035c0b69c0 0x7f035c160610 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f035c072e80 tx=0x7f035402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aada7aef3035f61 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:11.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.205+0000 7f035affd640 1 -- 172.21.15.18:0/356537272 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0354036070 con 0x7f035c0b69c0 2024-09-19T09:17:11.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.205+0000 7f035affd640 1 -- 172.21.15.18:0/356537272 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0354031600 con 0x7f035c0b69c0 2024-09-19T09:17:11.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.205+0000 7f035affd640 1 -- 172.21.15.18:0/356537272 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03540319d0 con 0x7f035c0b69c0 2024-09-19T09:17:11.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.205+0000 7f0362742640 1 -- 172.21.15.18:0/356537272 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f035c0b69c0 msgr2=0x7f035c160610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:11.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.205+0000 7f0362742640 1 --2- 172.21.15.18:0/356537272 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f035c0b69c0 0x7f035c160610 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f035c072e80 tx=0x7f035402a610 comp rx=0 tx=0).stop 2024-09-19T09:17:11.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.205+0000 7f0362742640 1 -- 172.21.15.18:0/356537272 shutdown_connections 2024-09-19T09:17:11.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.205+0000 7f0362742640 1 --2- 172.21.15.18:0/356537272 >> v2:172.21.15.162:3300/0 conn(0x7f035c0b5970 0x7f035c0b6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:11.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.205+0000 7f0362742640 1 --2- 172.21.15.18:0/356537272 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f035c0b69c0 0x7f035c160610 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:11.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.205+0000 7f0362742640 1 --2- 172.21.15.18:0/356537272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f035c15a670 0x7f035c15dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:11.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.205+0000 7f0362742640 1 -- 172.21.15.18:0/356537272 >> 172.21.15.18:0/356537272 conn(0x7f035c09b9d0 msgr2=0x7f035c09bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:11.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.205+0000 7f0362742640 1 -- 172.21.15.18:0/356537272 shutdown_connections 2024-09-19T09:17:11.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.205+0000 7f0362742640 1 -- 172.21.15.18:0/356537272 wait complete. 2024-09-19T09:17:11.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.207+0000 7f0362742640 1 Processor -- start 2024-09-19T09:17:11.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.207+0000 7f0362742640 1 -- start start 2024-09-19T09:17:11.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.207+0000 7f0362742640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f035c0b5970 0x7f035c14a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:11.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.207+0000 7f0362742640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f035c0b69c0 0x7f035c09d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:11.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.207+0000 7f0362742640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f035c15a670 0x7f035c09fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:11.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.207+0000 7f0362742640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f035c160b50 con 0x7f035c0b69c0 2024-09-19T09:17:11.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.207+0000 7f0362742640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f035c0b5dd0 con 0x7f035c15a670 2024-09-19T09:17:11.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.207+0000 7f0362742640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f035c160cd0 con 0x7f035c0b5970 2024-09-19T09:17:11.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.208+0000 7f035b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f035c0b69c0 0x7f035c09d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:11.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.208+0000 7f035b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f035c0b69c0 0x7f035c09d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51148/0 (socket says 172.21.15.18:51148) 2024-09-19T09:17:11.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.208+0000 7f035b7fe640 1 -- 172.21.15.18:0/3807247043 learned_addr learned my addr 172.21.15.18:0/3807247043 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:11.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.208+0000 7f0360cdf640 1 --2- 172.21.15.18:0/3807247043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f035c15a670 0x7f035c09fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:11.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.208+0000 7f035b7fe640 1 -- 172.21.15.18:0/3807247043 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f035c0b5970 msgr2=0x7f035c14a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:11.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.208+0000 7f035bfff640 1 --2- 172.21.15.18:0/3807247043 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f035c0b5970 0x7f035c14a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:11.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.208+0000 7f035b7fe640 1 --2- 172.21.15.18:0/3807247043 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f035c0b5970 0x7f035c14a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:11.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.208+0000 7f035b7fe640 1 -- 172.21.15.18:0/3807247043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f035c15a670 msgr2=0x7f035c09fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:11.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.208+0000 7f035b7fe640 1 --2- 172.21.15.18:0/3807247043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f035c15a670 0x7f035c09fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:11.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.208+0000 7f035b7fe640 1 -- 172.21.15.18:0/3807247043 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f035c09ffb0 con 0x7f035c0b69c0 2024-09-19T09:17:11.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.208+0000 7f0360cdf640 1 --2- 172.21.15.18:0/3807247043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f035c15a670 0x7f035c09fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:17:11.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.208+0000 7f035b7fe640 1 --2- 172.21.15.18:0/3807247043 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f035c0b69c0 0x7f035c09d660 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f035000e860 tx=0x7f035000ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:11.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.208+0000 7f0358ff9640 1 -- 172.21.15.18:0/3807247043 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0350017070 con 0x7f035c0b69c0 2024-09-19T09:17:11.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.208+0000 7f0358ff9640 1 -- 172.21.15.18:0/3807247043 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f035000c940 con 0x7f035c0b69c0 2024-09-19T09:17:11.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.208+0000 7f0362742640 1 -- 172.21.15.18:0/3807247043 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f035c0a0230 con 0x7f035c0b69c0 2024-09-19T09:17:11.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.208+0000 7f0358ff9640 1 -- 172.21.15.18:0/3807247043 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f035000cd10 con 0x7f035c0b69c0 2024-09-19T09:17:11.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.208+0000 7f0362742640 1 -- 172.21.15.18:0/3807247043 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f035c06cf70 con 0x7f035c0b69c0 2024-09-19T09:17:11.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.209+0000 7f0362742640 1 -- 172.21.15.18:0/3807247043 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f035c160610 con 0x7f035c0b69c0 2024-09-19T09:17:11.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.210+0000 7f0358ff9640 1 -- 172.21.15.18:0/3807247043 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f035001a070 con 0x7f035c0b69c0 2024-09-19T09:17:11.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.210+0000 7f0358ff9640 1 --2- 172.21.15.18:0/3807247043 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f034806c2b0 0x7f034806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:11.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.210+0000 7f0358ff9640 1 -- 172.21.15.18:0/3807247043 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 4943+0+0 (secure 0 0 0) 0x7f035008ada0 con 0x7f035c0b69c0 2024-09-19T09:17:11.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.211+0000 7f035bfff640 1 --2- 172.21.15.18:0/3807247043 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f034806c2b0 0x7f034806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:11.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.211+0000 7f035bfff640 1 --2- 172.21.15.18:0/3807247043 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f034806c2b0 0x7f034806e770 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f035c1f8040 tx=0x7f034c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:11.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.215+0000 7f0358ff9640 1 -- 172.21.15.18:0/3807247043 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f035c09ffb0 con 0x7f035c0b69c0 2024-09-19T09:17:11.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.392+0000 7f0362742640 1 -- 172.21.15.18:0/3807247043 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f035c09c5f0 con 0x7f035c0b69c0 2024-09-19T09:17:11.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.395+0000 7f0358ff9640 1 -- 172.21.15.18:0/3807247043 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f03500598a0 con 0x7f035c0b69c0 2024-09-19T09:17:11.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.397+0000 7f0362742640 1 -- 172.21.15.18:0/3807247043 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f034806c2b0 msgr2=0x7f034806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:11.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.397+0000 7f0362742640 1 --2- 172.21.15.18:0/3807247043 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f034806c2b0 0x7f034806e770 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f035c1f8040 tx=0x7f034c008040 comp rx=0 tx=0).stop 2024-09-19T09:17:11.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.397+0000 7f0362742640 1 -- 172.21.15.18:0/3807247043 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f035c0b69c0 msgr2=0x7f035c09d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:11.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.397+0000 7f0362742640 1 --2- 172.21.15.18:0/3807247043 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f035c0b69c0 0x7f035c09d660 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f035000e860 tx=0x7f035000ed20 comp rx=0 tx=0).stop 2024-09-19T09:17:11.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.397+0000 7f0362742640 1 -- 172.21.15.18:0/3807247043 shutdown_connections 2024-09-19T09:17:11.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.397+0000 7f0362742640 1 --2- 172.21.15.18:0/3807247043 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f034806c2b0 0x7f034806e770 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:11.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.397+0000 7f0362742640 1 --2- 172.21.15.18:0/3807247043 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f035c15a670 0x7f035c09fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:11.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.397+0000 7f0362742640 1 --2- 172.21.15.18:0/3807247043 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f035c0b69c0 0x7f035c09d660 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:11.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.397+0000 7f0362742640 1 --2- 172.21.15.18:0/3807247043 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f035c0b5970 0x7f035c14a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:11.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.397+0000 7f0362742640 1 -- 172.21.15.18:0/3807247043 >> 172.21.15.18:0/3807247043 conn(0x7f035c09b9d0 msgr2=0x7f035c071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:11.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.397+0000 7f0362742640 1 -- 172.21.15.18:0/3807247043 shutdown_connections 2024-09-19T09:17:11.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.397+0000 7f0362742640 1 -- 172.21.15.18:0/3807247043 wait complete. 2024-09-19T09:17:11.409 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T09:17:11.409 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:17:11.458 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:17:11.498 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T09:17:11.498 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:17:11.498 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:17:11.514 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17075 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T09:17:11.515 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:17:11.515 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:17:11.557 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3252 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T09:17:11.557 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:17:11.557 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:17:11.573 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17075 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T09:17:11.574 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:17:11.574 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:17:11.615 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3252 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T09:17:11.615 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-19T09:17:11.616 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:17:11.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.717+0000 7f796dcac640 1 Processor -- start 2024-09-19T09:17:11.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.717+0000 7f796dcac640 1 -- start start 2024-09-19T09:17:11.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.718+0000 7f796dcac640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f796813fae0 0x7f796806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:11.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.718+0000 7f796dcac640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7968160c50 0x7f79680cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:11.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.718+0000 7f796dcac640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7968142650 con 0x7f7968142150 2024-09-19T09:17:11.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.718+0000 7f796dcac640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f79680ce780 con 0x7f7968160c50 2024-09-19T09:17:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.718+0000 7f796dcac640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7968142930 con 0x7f796813fae0 2024-09-19T09:17:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.718+0000 7f7967fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7968160c50 0x7f79680cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.718+0000 7f7966ffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f7968142150 0x7f7968160540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:57598/0 (socket says 172.21.15.18:57598) 2024-09-19T09:17:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.718+0000 7f7966ffd640 1 -- 172.21.15.18:0/1304580264 learned_addr learned my addr 172.21.15.18:0/1304580264 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:17:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.719+0000 7f79677fe640 1 --2- 172.21.15.18:0/1304580264 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f796813fae0 0x7f796806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.719+0000 7f7967fff640 1 -- 172.21.15.18:0/1304580264 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f796813fae0 msgr2=0x7f796806f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.719+0000 7f7967fff640 1 --2- 172.21.15.18:0/1304580264 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f796813fae0 0x7f796806f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.719+0000 7f7967fff640 1 -- 172.21.15.18:0/1304580264 >> v1:172.21.15.18:6789/0 conn(0x7f7968142150 legacy=0x7f7968160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.719+0000 7f79667fc640 1 -- 172.21.15.18:0/1304580264 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3402840649 0 0) 0x7f7968142650 con 0x7f7968142150 2024-09-19T09:17:11.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.719+0000 7f7967fff640 1 -- 172.21.15.18:0/1304580264 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7968142c10 con 0x7f7968160c50 2024-09-19T09:17:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.719+0000 7f7967fff640 1 --2- 172.21.15.18:0/1304580264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7968160c50 0x7f79680cec10 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7960009d90 tx=0x7f796002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=430a8b0746321063 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.720+0000 7f79667fc640 1 -- 172.21.15.18:0/1304580264 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7960031600 con 0x7f7968160c50 2024-09-19T09:17:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.720+0000 7f79667fc640 1 -- 172.21.15.18:0/1304580264 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79600317a0 con 0x7f7968160c50 2024-09-19T09:17:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.720+0000 7f79667fc640 1 -- 172.21.15.18:0/1304580264 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7960031b70 con 0x7f7968160c50 2024-09-19T09:17:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.720+0000 7f796dcac640 1 -- 172.21.15.18:0/1304580264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7968160c50 msgr2=0x7f79680cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.720+0000 7f796dcac640 1 --2- 172.21.15.18:0/1304580264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7968160c50 0x7f79680cec10 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7960009d90 tx=0x7f796002a5d0 comp rx=0 tx=0).stop 2024-09-19T09:17:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.720+0000 7f796dcac640 1 -- 172.21.15.18:0/1304580264 shutdown_connections 2024-09-19T09:17:11.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.720+0000 7f796dcac640 1 --2- 172.21.15.18:0/1304580264 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7968160c50 0x7f79680cec10 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.720+0000 7f796dcac640 1 --2- 172.21.15.18:0/1304580264 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f796813fae0 0x7f796806f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.720+0000 7f796dcac640 1 -- 172.21.15.18:0/1304580264 >> 172.21.15.18:0/1304580264 conn(0x7f796806bc10 msgr2=0x7f796806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.720+0000 7f796dcac640 1 -- 172.21.15.18:0/1304580264 shutdown_connections 2024-09-19T09:17:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.720+0000 7f796dcac640 1 -- 172.21.15.18:0/1304580264 wait complete. 2024-09-19T09:17:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.721+0000 7f796dcac640 1 Processor -- start 2024-09-19T09:17:11.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.722+0000 7f796dcac640 1 -- start start 2024-09-19T09:17:11.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.722+0000 7f796dcac640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f796813fae0 0x7f7968141680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:11.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.722+0000 7f796dcac640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7968142150 0x7f796813ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:11.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.722+0000 7f796dcac640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7968160c50 0x7f796813b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:11.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.722+0000 7f796dcac640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f796806f870 con 0x7f7968142150 2024-09-19T09:17:11.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.722+0000 7f796dcac640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f796806f6f0 con 0x7f796813fae0 2024-09-19T09:17:11.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.722+0000 7f796dcac640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f79680cf150 con 0x7f7968160c50 2024-09-19T09:17:11.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.722+0000 7f7966ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7968142150 0x7f796813ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:11.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.722+0000 7f7966ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7968142150 0x7f796813ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51160/0 (socket says 172.21.15.18:51160) 2024-09-19T09:17:11.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.722+0000 7f7966ffd640 1 -- 172.21.15.18:0/424752652 learned_addr learned my addr 172.21.15.18:0/424752652 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:11.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.723+0000 7f7966ffd640 1 -- 172.21.15.18:0/424752652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7968160c50 msgr2=0x7f796813b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:11.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.723+0000 7f7966ffd640 1 --2- 172.21.15.18:0/424752652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7968160c50 0x7f796813b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:11.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.723+0000 7f7966ffd640 1 -- 172.21.15.18:0/424752652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f796813fae0 msgr2=0x7f7968141680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:11.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.723+0000 7f7966ffd640 1 --2- 172.21.15.18:0/424752652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f796813fae0 0x7f7968141680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:11.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.723+0000 7f7966ffd640 1 -- 172.21.15.18:0/424752652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79681f25f0 con 0x7f7968142150 2024-09-19T09:17:11.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.723+0000 7f7966ffd640 1 --2- 172.21.15.18:0/424752652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7968142150 0x7f796813ad70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f795c00c470 tx=0x7f795c00c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:11.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.723+0000 7f794ffff640 1 -- 172.21.15.18:0/424752652 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795c018070 con 0x7f7968142150 2024-09-19T09:17:11.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.723+0000 7f794ffff640 1 -- 172.21.15.18:0/424752652 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f795c0074e0 con 0x7f7968142150 2024-09-19T09:17:11.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.723+0000 7f796dcac640 1 -- 172.21.15.18:0/424752652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79681f28d0 con 0x7f7968142150 2024-09-19T09:17:11.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.723+0000 7f794ffff640 1 -- 172.21.15.18:0/424752652 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795c004a20 con 0x7f7968142150 2024-09-19T09:17:11.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.723+0000 7f796dcac640 1 -- 172.21.15.18:0/424752652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79681f2e90 con 0x7f7968142150 2024-09-19T09:17:11.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.724+0000 7f796dcac640 1 -- 172.21.15.18:0/424752652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f796806f1b0 con 0x7f7968142150 2024-09-19T09:17:11.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.725+0000 7f794ffff640 1 -- 172.21.15.18:0/424752652 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f795c01b070 con 0x7f7968142150 2024-09-19T09:17:11.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.725+0000 7f794ffff640 1 --2- 172.21.15.18:0/424752652 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f795406c2b0 0x7f795406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:11.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.725+0000 7f794ffff640 1 -- 172.21.15.18:0/424752652 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 4943+0+0 (secure 0 0 0) 0x7f795c08a3d0 con 0x7f7968142150 2024-09-19T09:17:11.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.725+0000 7f79677fe640 1 --2- 172.21.15.18:0/424752652 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f795406c2b0 0x7f795406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:11.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.726+0000 7f79677fe640 1 --2- 172.21.15.18:0/424752652 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f795406c2b0 0x7f795406e770 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f79680b2020 tx=0x7f7958008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:11.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.729+0000 7f794ffff640 1 -- 172.21.15.18:0/424752652 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f795c058ed0 con 0x7f7968142150 2024-09-19T09:17:11.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.940+0000 7f796dcac640 1 -- 172.21.15.18:0/424752652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79680cf6c0 con 0x7f7968142150 2024-09-19T09:17:11.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.940+0000 7f794ffff640 1 -- 172.21.15.18:0/424752652 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+3917 (secure 0 0 0) 0x7f795c0587d0 con 0x7f7968142150 2024-09-19T09:17:11.941 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:17:11.941 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":30,"btime":"2024-09-19T09:17:06:959373+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5027,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3337833568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3337833568},{"type":"v1","addr":"172.21.15.162:6837","nonce":3337833568}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5030,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/1692924872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1692924872},{"type":"v1","addr":"172.21.15.162:6836","nonce":1692924872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25},{"gid":5377,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/2351287916","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2351287916},{"type":"v1","addr":"172.21.15.18:6834","nonce":2351287916}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":24},{"gid":5814,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/2286454672","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2286454672},{"type":"v1","addr":"172.21.15.18:6835","nonce":2286454672}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30}],"filesystems":[]} 2024-09-19T09:17:11.941 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 30 2024-09-19T09:17:11.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.942+0000 7f796dcac640 1 -- 172.21.15.18:0/424752652 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f795406c2b0 msgr2=0x7f795406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:11.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.942+0000 7f796dcac640 1 --2- 172.21.15.18:0/424752652 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f795406c2b0 0x7f795406e770 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f79680b2020 tx=0x7f7958008040 comp rx=0 tx=0).stop 2024-09-19T09:17:11.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.942+0000 7f796dcac640 1 -- 172.21.15.18:0/424752652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7968142150 msgr2=0x7f796813ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:11.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.942+0000 7f796dcac640 1 --2- 172.21.15.18:0/424752652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7968142150 0x7f796813ad70 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f795c00c470 tx=0x7f795c00c930 comp rx=0 tx=0).stop 2024-09-19T09:17:11.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.942+0000 7f796dcac640 1 -- 172.21.15.18:0/424752652 shutdown_connections 2024-09-19T09:17:11.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.942+0000 7f796dcac640 1 --2- 172.21.15.18:0/424752652 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f795406c2b0 0x7f795406e770 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:11.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.942+0000 7f796dcac640 1 --2- 172.21.15.18:0/424752652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7968160c50 0x7f796813b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:11.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.942+0000 7f796dcac640 1 --2- 172.21.15.18:0/424752652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7968142150 0x7f796813ad70 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:11.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.942+0000 7f796dcac640 1 --2- 172.21.15.18:0/424752652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f796813fae0 0x7f7968141680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:11.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.943+0000 7f796dcac640 1 -- 172.21.15.18:0/424752652 >> 172.21.15.18:0/424752652 conn(0x7f796806bc10 msgr2=0x7f7968072d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:11.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.943+0000 7f796dcac640 1 -- 172.21.15.18:0/424752652 shutdown_connections 2024-09-19T09:17:11.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:11.943+0000 7f796dcac640 1 -- 172.21.15.18:0/424752652 wait complete. 2024-09-19T09:17:11.954 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T09:17:11.954 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-19T09:17:11.955 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T09:17:11.955 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:17:11.955 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T09:17:11.955 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-19T09:17:11.955 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T09:17:11.955 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:17:11.955 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T09:17:11.956 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-19T09:17:11.956 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T09:17:11.956 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:17:11.956 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T09:17:11.956 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-19T09:17:11.956 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T09:17:11.956 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:17:11.963 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T09:17:11.963 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T09:17:11.964 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T09:17:11.965 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T09:17:11.968 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T09:17:11.968 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T09:17:12.006 INFO:tasks.ceph.mds.a:Started 2024-09-19T09:17:12.007 DEBUG:teuthology.parallel:result is None 2024-09-19T09:17:12.008 INFO:tasks.ceph.mds.c:Started 2024-09-19T09:17:12.008 DEBUG:teuthology.parallel:result is None 2024-09-19T09:17:12.011 INFO:tasks.ceph.mds.d:Started 2024-09-19T09:17:12.011 DEBUG:teuthology.parallel:result is None 2024-09-19T09:17:12.085 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-09-19T09:17:12.085 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2024-09-19T09:17:12.090 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-09-19T09:17:17.969 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T09:17:17.969 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T09:17:17.973 INFO:tasks.ceph.mds.b:Started 2024-09-19T09:17:17.973 DEBUG:teuthology.parallel:result is None 2024-09-19T09:17:17.973 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-19T09:17:18.055 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-09-19T09:17:18.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.090+0000 7fa15ac5e640 1 Processor -- start 2024-09-19T09:17:18.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.091+0000 7fa15ac5e640 1 -- start start 2024-09-19T09:17:18.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.091+0000 7fa15ac5e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa1540d0fd0 0x7fa15415d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:18.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.091+0000 7fa15ac5e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa154073850 0x7fa1541678d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:18.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.091+0000 7fa15ac5e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa15406d580 con 0x7fa1540d13b0 2024-09-19T09:17:18.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.091+0000 7fa15ac5e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fa15406ce10 con 0x7fa154073850 2024-09-19T09:17:18.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.091+0000 7fa15ac5e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa15406d0f0 con 0x7fa1540d0fd0 2024-09-19T09:17:18.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.092+0000 7fa1591fb640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa154073850 0x7fa1541678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:18.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.092+0000 7fa1591fb640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa154073850 0x7fa1541678d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38158/0 (socket says 172.21.15.18:38158) 2024-09-19T09:17:18.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.092+0000 7fa1591fb640 1 -- 172.21.15.18:0/2812371335 learned_addr learned my addr 172.21.15.18:0/2812371335 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:18.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.092+0000 7fa1589fa640 1 --2- 172.21.15.18:0/2812371335 >> v2:172.21.15.162:3300/0 conn(0x7fa1540d0fd0 0x7fa15415d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:18.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.092+0000 7fa1591fb640 1 -- 172.21.15.18:0/2812371335 >> v2:172.21.15.162:3300/0 conn(0x7fa1540d0fd0 msgr2=0x7fa15415d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:18.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.092+0000 7fa1591fb640 1 --2- 172.21.15.18:0/2812371335 >> v2:172.21.15.162:3300/0 conn(0x7fa1540d0fd0 0x7fa15415d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:18.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.092+0000 7fa1591fb640 1 -- 172.21.15.18:0/2812371335 >> v1:172.21.15.162:6789/0 conn(0x7fa1540d13b0 legacy=0x7fa154073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:18.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.092+0000 7fa1591fb640 1 -- 172.21.15.18:0/2812371335 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1540b70d0 con 0x7fa154073850 2024-09-19T09:17:18.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.093+0000 7fa1591fb640 1 --2- 172.21.15.18:0/2812371335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa154073850 0x7fa1541678d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa154071a10 tx=0x7fa14c02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d97d2a35eacb4530 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:18.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.093+0000 7fa1537fe640 1 -- 172.21.15.18:0/2812371335 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa14c036070 con 0x7fa154073850 2024-09-19T09:17:18.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.093+0000 7fa1537fe640 1 -- 172.21.15.18:0/2812371335 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa14c031600 con 0x7fa154073850 2024-09-19T09:17:18.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.093+0000 7fa1537fe640 1 -- 172.21.15.18:0/2812371335 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa14c0319d0 con 0x7fa154073850 2024-09-19T09:17:18.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.093+0000 7fa15ac5e640 1 -- 172.21.15.18:0/2812371335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa154073850 msgr2=0x7fa1541678d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:18.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.093+0000 7fa15ac5e640 1 --2- 172.21.15.18:0/2812371335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa154073850 0x7fa1541678d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa154071a10 tx=0x7fa14c02a730 comp rx=0 tx=0).stop 2024-09-19T09:17:18.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.094+0000 7fa15ac5e640 1 -- 172.21.15.18:0/2812371335 shutdown_connections 2024-09-19T09:17:18.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.094+0000 7fa15ac5e640 1 --2- 172.21.15.18:0/2812371335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa154073850 0x7fa1541678d0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:18.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.094+0000 7fa15ac5e640 1 --2- 172.21.15.18:0/2812371335 >> v2:172.21.15.162:3300/0 conn(0x7fa1540d0fd0 0x7fa15415d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:18.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.094+0000 7fa15ac5e640 1 -- 172.21.15.18:0/2812371335 >> 172.21.15.18:0/2812371335 conn(0x7fa1540b5eb0 msgr2=0x7fa1540b6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:18.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.094+0000 7fa15ac5e640 1 -- 172.21.15.18:0/2812371335 shutdown_connections 2024-09-19T09:17:18.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.094+0000 7fa15ac5e640 1 -- 172.21.15.18:0/2812371335 wait complete. 2024-09-19T09:17:18.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.095+0000 7fa15ac5e640 1 Processor -- start 2024-09-19T09:17:18.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.095+0000 7fa15ac5e640 1 -- start start 2024-09-19T09:17:18.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.096+0000 7fa15ac5e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa154073850 0x7fa154154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:18.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.096+0000 7fa15ac5e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1540d0fd0 0x7fa1541607a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:18.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.096+0000 7fa15ac5e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1540d13b0 0x7fa154152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:18.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.096+0000 7fa15ac5e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa15406bc10 con 0x7fa154073850 2024-09-19T09:17:18.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.096+0000 7fa15ac5e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa154067cd0 con 0x7fa1540d13b0 2024-09-19T09:17:18.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.096+0000 7fa15ac5e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa15415ccf0 con 0x7fa1540d0fd0 2024-09-19T09:17:18.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.096+0000 7fa1589fa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa154073850 0x7fa154154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:18.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.096+0000 7fa1589fa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa154073850 0x7fa154154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38170/0 (socket says 172.21.15.18:38170) 2024-09-19T09:17:18.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.096+0000 7fa1589fa640 1 -- 172.21.15.18:0/817484532 learned_addr learned my addr 172.21.15.18:0/817484532 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:18.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.096+0000 7fa1591fb640 1 --2- 172.21.15.18:0/817484532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1540d13b0 0x7fa154152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:18.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.096+0000 7fa153fff640 1 --2- 172.21.15.18:0/817484532 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1540d0fd0 0x7fa1541607a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:18.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.096+0000 7fa1589fa640 1 -- 172.21.15.18:0/817484532 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1540d0fd0 msgr2=0x7fa1541607a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:18.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.096+0000 7fa1589fa640 1 --2- 172.21.15.18:0/817484532 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1540d0fd0 0x7fa1541607a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:18.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.096+0000 7fa1589fa640 1 -- 172.21.15.18:0/817484532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1540d13b0 msgr2=0x7fa154152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:18.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.096+0000 7fa1589fa640 1 --2- 172.21.15.18:0/817484532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1540d13b0 0x7fa154152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:18.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.096+0000 7fa1589fa640 1 -- 172.21.15.18:0/817484532 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1540cc1d0 con 0x7fa154073850 2024-09-19T09:17:18.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.097+0000 7fa1589fa640 1 --2- 172.21.15.18:0/817484532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa154073850 0x7fa154154950 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa14400d800 tx=0x7fa14400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:18.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.097+0000 7fa1517fa640 1 -- 172.21.15.18:0/817484532 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa14400b6c0 con 0x7fa154073850 2024-09-19T09:17:18.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.097+0000 7fa1517fa640 1 -- 172.21.15.18:0/817484532 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa144019070 con 0x7fa154073850 2024-09-19T09:17:18.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.097+0000 7fa1517fa640 1 -- 172.21.15.18:0/817484532 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa14400bac0 con 0x7fa154073850 2024-09-19T09:17:18.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.097+0000 7fa15ac5e640 1 -- 172.21.15.18:0/817484532 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1540cc4b0 con 0x7fa154073850 2024-09-19T09:17:18.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.097+0000 7fa15ac5e640 1 -- 172.21.15.18:0/817484532 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1540ca550 con 0x7fa154073850 2024-09-19T09:17:18.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.098+0000 7fa15ac5e640 1 -- 172.21.15.18:0/817484532 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa154154f50 con 0x7fa154073850 2024-09-19T09:17:18.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.098+0000 7fa1517fa640 1 -- 172.21.15.18:0/817484532 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa14400bc60 con 0x7fa154073850 2024-09-19T09:17:18.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.099+0000 7fa1517fa640 1 --2- 172.21.15.18:0/817484532 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa14006c2b0 0x7fa14006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:18.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.099+0000 7fa1517fa640 1 -- 172.21.15.18:0/817484532 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 4943+0+0 (secure 0 0 0) 0x7fa14408b4a0 con 0x7fa154073850 2024-09-19T09:17:18.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.099+0000 7fa153fff640 1 --2- 172.21.15.18:0/817484532 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa14006c2b0 0x7fa14006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:18.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.100+0000 7fa153fff640 1 --2- 172.21.15.18:0/817484532 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa14006c2b0 0x7fa14006e770 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa154160000 tx=0x7fa148009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:18.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.104+0000 7fa1517fa640 1 -- 172.21.15.18:0/817484532 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa1440598c0 con 0x7fa154073850 2024-09-19T09:17:18.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:18.291+0000 7fa15ac5e640 1 -- 172.21.15.18:0/817484532 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fa154072960 con 0x7fa154073850 2024-09-19T09:17:19.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:19.993+0000 7fa1517fa640 1 -- 172.21.15.18:0/817484532 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v86) ==== 97+0+0 (secure 0 0 0) 0x7fa14405dbc0 con 0x7fa154073850 2024-09-19T09:17:19.994 INFO:teuthology.orchestra.run.smithi018.stderr: removed all blocklist entries 2024-09-19T09:17:19.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:19.996+0000 7fa15ac5e640 1 -- 172.21.15.18:0/817484532 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa14006c2b0 msgr2=0x7fa14006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:19.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:19.996+0000 7fa15ac5e640 1 --2- 172.21.15.18:0/817484532 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa14006c2b0 0x7fa14006e770 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa154160000 tx=0x7fa148009040 comp rx=0 tx=0).stop 2024-09-19T09:17:19.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:19.996+0000 7fa15ac5e640 1 -- 172.21.15.18:0/817484532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa154073850 msgr2=0x7fa154154950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:19.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:19.996+0000 7fa15ac5e640 1 --2- 172.21.15.18:0/817484532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa154073850 0x7fa154154950 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa14400d800 tx=0x7fa14400dcc0 comp rx=0 tx=0).stop 2024-09-19T09:17:19.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:19.996+0000 7fa15ac5e640 1 -- 172.21.15.18:0/817484532 shutdown_connections 2024-09-19T09:17:19.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:19.996+0000 7fa15ac5e640 1 --2- 172.21.15.18:0/817484532 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa14006c2b0 0x7fa14006e770 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:19.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:19.996+0000 7fa15ac5e640 1 --2- 172.21.15.18:0/817484532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1540d13b0 0x7fa154152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:19.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:19.996+0000 7fa15ac5e640 1 --2- 172.21.15.18:0/817484532 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1540d0fd0 0x7fa1541607a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:19.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:19.996+0000 7fa15ac5e640 1 --2- 172.21.15.18:0/817484532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa154073850 0x7fa154154950 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:19.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:19.996+0000 7fa15ac5e640 1 -- 172.21.15.18:0/817484532 >> 172.21.15.18:0/817484532 conn(0x7fa1540b5eb0 msgr2=0x7fa1540ce110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:19.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:19.996+0000 7fa15ac5e640 1 -- 172.21.15.18:0/817484532 shutdown_connections 2024-09-19T09:17:19.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:19.996+0000 7fa15ac5e640 1 -- 172.21.15.18:0/817484532 wait complete. 2024-09-19T09:17:20.012 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-19T09:17:20.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.120+0000 7f013a05e640 1 Processor -- start 2024-09-19T09:17:20.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.120+0000 7f013a05e640 1 -- start start 2024-09-19T09:17:20.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.121+0000 7f013a05e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f013415ed30 0x7f0134070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:20.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.121+0000 7f013a05e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f01341630f0 0x7f01340cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:20.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.121+0000 7f013a05e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01340d0a10 con 0x7f01340b5200 2024-09-19T09:17:20.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.121+0000 7f013a05e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f0134070ab0 con 0x7f01341630f0 2024-09-19T09:17:20.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.121+0000 7f013a05e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f01340d0cb0 con 0x7f013415ed30 2024-09-19T09:17:20.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.121+0000 7f0133fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f01341630f0 0x7f01340cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:20.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.121+0000 7f0132ffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f01340b5200 0x7f01341629e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49556/0 (socket says 172.21.15.18:49556) 2024-09-19T09:17:20.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.121+0000 7f0132ffd640 1 -- 172.21.15.18:0/3229433407 learned_addr learned my addr 172.21.15.18:0/3229433407 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:17:20.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.121+0000 7f01337fe640 1 --2- 172.21.15.18:0/3229433407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f013415ed30 0x7f0134070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:20.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.121+0000 7f0133fff640 1 -- 172.21.15.18:0/3229433407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f013415ed30 msgr2=0x7f0134070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:20.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.121+0000 7f0133fff640 1 --2- 172.21.15.18:0/3229433407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f013415ed30 0x7f0134070260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.121+0000 7f0133fff640 1 -- 172.21.15.18:0/3229433407 >> v1:172.21.15.18:6789/0 conn(0x7f01340b5200 legacy=0x7f01341629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:20.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.121+0000 7f0133fff640 1 -- 172.21.15.18:0/3229433407 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01340d0f90 con 0x7f01341630f0 2024-09-19T09:17:20.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.121+0000 7f01327fc640 1 -- 172.21.15.18:0/3229433407 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3810872629 0 0) 0x7f01340d0a10 con 0x7f01340b5200 2024-09-19T09:17:20.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.122+0000 7f0133fff640 1 --2- 172.21.15.18:0/3229433407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01341630f0 0x7f01340cf1e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f012c009d90 tx=0x7f012c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ebe5f4bcdcdde58 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:20.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.122+0000 7f01327fc640 1 -- 172.21.15.18:0/3229433407 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c007740 con 0x7f01341630f0 2024-09-19T09:17:20.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.122+0000 7f01327fc640 1 -- 172.21.15.18:0/3229433407 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f012c0078e0 con 0x7f01341630f0 2024-09-19T09:17:20.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.122+0000 7f01327fc640 1 -- 172.21.15.18:0/3229433407 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012c007cb0 con 0x7f01341630f0 2024-09-19T09:17:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.123+0000 7f013a05e640 1 -- 172.21.15.18:0/3229433407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01341630f0 msgr2=0x7f01340cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.123+0000 7f013a05e640 1 --2- 172.21.15.18:0/3229433407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01341630f0 0x7f01340cf1e0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f012c009d90 tx=0x7f012c02a6f0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.123+0000 7f013a05e640 1 -- 172.21.15.18:0/3229433407 shutdown_connections 2024-09-19T09:17:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.123+0000 7f013a05e640 1 --2- 172.21.15.18:0/3229433407 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01341630f0 0x7f01340cf1e0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.123+0000 7f013a05e640 1 --2- 172.21.15.18:0/3229433407 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f013415ed30 0x7f0134070260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.123+0000 7f013a05e640 1 -- 172.21.15.18:0/3229433407 >> 172.21.15.18:0/3229433407 conn(0x7f01340b4600 msgr2=0x7f01340b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.123+0000 7f013a05e640 1 -- 172.21.15.18:0/3229433407 shutdown_connections 2024-09-19T09:17:20.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.123+0000 7f013a05e640 1 -- 172.21.15.18:0/3229433407 wait complete. 2024-09-19T09:17:20.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.124+0000 7f013a05e640 1 Processor -- start 2024-09-19T09:17:20.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.124+0000 7f013a05e640 1 -- start start 2024-09-19T09:17:20.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.125+0000 7f013a05e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01340b5200 0x7f013415c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:20.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.125+0000 7f013a05e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f013415ed30 0x7f01340cda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:20.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.125+0000 7f013a05e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01341630f0 0x7f01340cf890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:20.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.125+0000 7f013a05e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0134070f10 con 0x7f01340b5200 2024-09-19T09:17:20.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.125+0000 7f013a05e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0134070d90 con 0x7f01341630f0 2024-09-19T09:17:20.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.125+0000 7f013a05e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f013415f110 con 0x7f013415ed30 2024-09-19T09:17:20.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.125+0000 7f01337fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01340b5200 0x7f013415c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:20.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.125+0000 7f01337fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01340b5200 0x7f013415c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38188/0 (socket says 172.21.15.18:38188) 2024-09-19T09:17:20.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.125+0000 7f01337fe640 1 -- 172.21.15.18:0/419227874 learned_addr learned my addr 172.21.15.18:0/419227874 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:20.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.125+0000 7f01337fe640 1 -- 172.21.15.18:0/419227874 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f013415ed30 msgr2=0x7f01340cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:20.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.125+0000 7f01337fe640 1 --2- 172.21.15.18:0/419227874 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f013415ed30 0x7f01340cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.125+0000 7f01337fe640 1 -- 172.21.15.18:0/419227874 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01341630f0 msgr2=0x7f01340cf890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:20.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.125+0000 7f0133fff640 1 --2- 172.21.15.18:0/419227874 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01341630f0 0x7f01340cf890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:20.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.125+0000 7f01337fe640 1 --2- 172.21.15.18:0/419227874 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01341630f0 0x7f01340cf890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.126+0000 7f01337fe640 1 -- 172.21.15.18:0/419227874 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013415c5c0 con 0x7f01340b5200 2024-09-19T09:17:20.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.126+0000 7f0133fff640 1 --2- 172.21.15.18:0/419227874 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01341630f0 0x7f01340cf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:17:20.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.126+0000 7f01337fe640 1 --2- 172.21.15.18:0/419227874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01340b5200 0x7f013415c080 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f012400d800 tx=0x7f012400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:20.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.126+0000 7f011bfff640 1 -- 172.21.15.18:0/419227874 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012400b6c0 con 0x7f01340b5200 2024-09-19T09:17:20.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.126+0000 7f011bfff640 1 -- 172.21.15.18:0/419227874 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0124019070 con 0x7f01340b5200 2024-09-19T09:17:20.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.126+0000 7f011bfff640 1 -- 172.21.15.18:0/419227874 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f012400ba80 con 0x7f01340b5200 2024-09-19T09:17:20.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.126+0000 7f013a05e640 1 -- 172.21.15.18:0/419227874 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01340ce7f0 con 0x7f01340b5200 2024-09-19T09:17:20.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.126+0000 7f013a05e640 1 -- 172.21.15.18:0/419227874 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01340cedb0 con 0x7f01340b5200 2024-09-19T09:17:20.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.127+0000 7f013a05e640 1 -- 172.21.15.18:0/419227874 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0134070260 con 0x7f01340b5200 2024-09-19T09:17:20.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.128+0000 7f011bfff640 1 -- 172.21.15.18:0/419227874 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f012400bc20 con 0x7f01340b5200 2024-09-19T09:17:20.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.128+0000 7f011bfff640 1 --2- 172.21.15.18:0/419227874 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f012006c2b0 0x7f012006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:20.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.128+0000 7f011bfff640 1 -- 172.21.15.18:0/419227874 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 4857+0+0 (secure 0 0 0) 0x7f012408b4e0 con 0x7f01340b5200 2024-09-19T09:17:20.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.128+0000 7f0132ffd640 1 --2- 172.21.15.18:0/419227874 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f012006c2b0 0x7f012006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:20.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.129+0000 7f0132ffd640 1 --2- 172.21.15.18:0/419227874 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f012006c2b0 0x7f012006e770 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0128007fd0 tx=0x7f0128007920 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:20.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.132+0000 7f011bfff640 1 -- 172.21.15.18:0/419227874 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f013415c5c0 con 0x7f01340b5200 2024-09-19T09:17:20.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.375+0000 7f013a05e640 1 -- 172.21.15.18:0/419227874 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f01340686d0 con 0x7f01340b5200 2024-09-19T09:17:20.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.375+0000 7f011bfff640 1 -- 172.21.15.18:0/419227874 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7f012405a030 con 0x7f01340b5200 2024-09-19T09:17:20.376 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:17:20.376 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:17:20.376 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_dump": [ 2024-09-19T09:17:20.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:17:20.376 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.a", 2024-09-19T09:17:20.376 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmDY7cHhAALxtxGq6eR3A2QXYp+nW0FA==", 2024-09-19T09:17:20.376 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:17:20.376 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:17:20.376 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:17:20.377 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:17:20.377 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:17:20.377 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:17:20.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:17:20.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:17:20.377 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.b", 2024-09-19T09:17:20.377 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tm9ILFKhAABEtgvzO5YBXqzYaeBZ0qZg==", 2024-09-19T09:17:20.377 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:17:20.377 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:17:20.377 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:17:20.377 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:17:20.377 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:17:20.377 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:17:20.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:17:20.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:17:20.378 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.c", 2024-09-19T09:17:20.378 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmwPkOJhAADt/0XVei2kl79pIw55wu1A==", 2024-09-19T09:17:20.378 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:17:20.378 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:17:20.378 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:17:20.378 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:17:20.378 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:17:20.378 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:17:20.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:17:20.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:17:20.378 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.d", 2024-09-19T09:17:20.378 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tm35XYMRAA/OSE5iv8M+TekEJVTARETw==", 2024-09-19T09:17:20.379 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:17:20.379 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:17:20.379 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:17:20.379 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:17:20.379 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:17:20.379 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:17:20.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:17:20.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:17:20.379 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.0", 2024-09-19T09:17:20.379 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmkUBiGhAATWtnqNPWyZJ+tnQcZOtT5A==", 2024-09-19T09:17:20.379 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:17:20.379 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:17:20.379 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:17:20.380 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:17:20.380 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:17:20.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:17:20.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:17:20.380 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.1", 2024-09-19T09:17:20.380 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmir5wIRAA9QumyCr8yLHtNj/YqQ1d0A==", 2024-09-19T09:17:20.380 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:17:20.380 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:17:20.380 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:17:20.380 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:17:20.380 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:17:20.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:17:20.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:17:20.381 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.2", 2024-09-19T09:17:20.381 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmfQJ6KBAAfTerKv1zCzFf6UfAVUikxA==", 2024-09-19T09:17:20.381 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:17:20.381 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:17:20.381 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:17:20.381 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:17:20.381 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:17:20.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:17:20.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:17:20.381 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.3", 2024-09-19T09:17:20.381 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmSeSOLxAACqCpiIQO4cDyjXUmoGPKAQ==", 2024-09-19T09:17:20.381 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:17:20.381 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:17:20.382 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:17:20.382 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:17:20.382 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:17:20.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:17:20.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:17:20.382 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.4", 2024-09-19T09:17:20.382 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmrsoFAhAArI7cRPVe/jrnSdmyE8jCsQ==", 2024-09-19T09:17:20.382 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:17:20.382 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:17:20.382 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:17:20.382 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:17:20.382 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:17:20.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:17:20.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:17:20.383 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.5", 2024-09-19T09:17:20.383 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmudM3CRAAXF3uI58SNJE6qtYX2wNQeQ==", 2024-09-19T09:17:20.383 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:17:20.383 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:17:20.383 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:17:20.383 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:17:20.383 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:17:20.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:17:20.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:17:20.383 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.6", 2024-09-19T09:17:20.383 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmqEQmEBAAm4h/8p91HwX84pl/U80Q9Q==", 2024-09-19T09:17:20.383 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:17:20.383 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:17:20.383 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:17:20.383 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:17:20.384 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:17:20.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:17:20.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:17:20.384 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.7", 2024-09-19T09:17:20.384 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmhDs0FxAAxZvRVkBoWqsdmyifRZzgwg==", 2024-09-19T09:17:20.384 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:17:20.384 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:17:20.384 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:17:20.384 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:17:20.384 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:17:20.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:17:20.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:17:20.385 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.0", 2024-09-19T09:17:20.385 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmcbwDNhAAaG0+wu96Locwws+h0zeh8Q==", 2024-09-19T09:17:20.385 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:17:20.385 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:17:20.385 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow r", 2024-09-19T09:17:20.385 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-19T09:17:20.385 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:17:20.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:17:20.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:17:20.385 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.1", 2024-09-19T09:17:20.385 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAf6+tmb4FeAxAAU+nZN/Vb33HrU0yfXmU9gA==", 2024-09-19T09:17:20.385 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:17:20.385 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:17:20.386 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-19T09:17:20.386 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-19T09:17:20.386 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-19T09:17:20.386 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:17:20.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:17:20.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:17:20.387 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.2", 2024-09-19T09:17:20.387 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAf6+tmc34kABAAC5b4Kkm2dJvxxyXva6PT2g==", 2024-09-19T09:17:20.387 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:17:20.388 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:17:20.388 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-19T09:17:20.388 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-19T09:17:20.388 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-19T09:17:20.388 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:17:20.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:17:20.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:17:20.388 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.3", 2024-09-19T09:17:20.389 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAf6+tmx4vzCBAAZ7ZrdGI2s8LqT0MjjzOCjw==", 2024-09-19T09:17:20.389 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:17:20.389 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:17:20.389 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-19T09:17:20.389 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-19T09:17:20.389 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-19T09:17:20.389 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:17:20.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:17:20.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:17:20.389 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.admin", 2024-09-19T09:17:20.389 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmZaWgAhAAx7MUazt6rS+wa/ZMSGC97Q==", 2024-09-19T09:17:20.389 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:17:20.389 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-19T09:17:20.390 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:17:20.390 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:17:20.390 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:17:20.390 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:17:20.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:17:20.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:17:20.390 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.x", 2024-09-19T09:17:20.390 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmwr6NGxAA3M5NZKkjc36L25teWJS7bQ==", 2024-09-19T09:17:20.390 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:17:20.390 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-19T09:17:20.391 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-09-19T09:17:20.391 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:17:20.391 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:17:20.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:17:20.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:17:20.391 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.y", 2024-09-19T09:17:20.391 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmBWOWFxAAEYKCroBhMcqoIe6WzXnNCg==", 2024-09-19T09:17:20.391 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:17:20.391 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-19T09:17:20.391 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-09-19T09:17:20.391 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:17:20.391 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:17:20.391 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:17:20.391 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:17:20.391 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:17:20.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.377+0000 7f013a05e640 1 -- 172.21.15.18:0/419227874 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f012006c2b0 msgr2=0x7f012006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:20.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.377+0000 7f013a05e640 1 --2- 172.21.15.18:0/419227874 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f012006c2b0 0x7f012006e770 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0128007fd0 tx=0x7f0128007920 comp rx=0 tx=0).stop 2024-09-19T09:17:20.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.377+0000 7f013a05e640 1 -- 172.21.15.18:0/419227874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01340b5200 msgr2=0x7f013415c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:20.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.377+0000 7f013a05e640 1 --2- 172.21.15.18:0/419227874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01340b5200 0x7f013415c080 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f012400d800 tx=0x7f012400dcc0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.377+0000 7f013a05e640 1 -- 172.21.15.18:0/419227874 shutdown_connections 2024-09-19T09:17:20.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.377+0000 7f013a05e640 1 --2- 172.21.15.18:0/419227874 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f012006c2b0 0x7f012006e770 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.377+0000 7f013a05e640 1 --2- 172.21.15.18:0/419227874 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f01341630f0 0x7f01340cf890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.377+0000 7f013a05e640 1 --2- 172.21.15.18:0/419227874 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f013415ed30 0x7f01340cda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.377+0000 7f013a05e640 1 --2- 172.21.15.18:0/419227874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f01340b5200 0x7f013415c080 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.377+0000 7f013a05e640 1 -- 172.21.15.18:0/419227874 >> 172.21.15.18:0/419227874 conn(0x7f01340b4600 msgr2=0x7f01340d14b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:20.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.377+0000 7f013a05e640 1 -- 172.21.15.18:0/419227874 shutdown_connections 2024-09-19T09:17:20.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.377+0000 7f013a05e640 1 -- 172.21.15.18:0/419227874 wait complete. 2024-09-19T09:17:20.395 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-19T09:17:20.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.497+0000 7f8ebc696640 1 Processor -- start 2024-09-19T09:17:20.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.497+0000 7f8ebc696640 1 -- start start 2024-09-19T09:17:20.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.498+0000 7f8ebc696640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8eb4145290 0x7f8eb406f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:20.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.498+0000 7f8ebc696640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8eb406e3d0 con 0x7f8eb40ce780 2024-09-19T09:17:20.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.498+0000 7f8ebc696640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8eb406e6b0 con 0x7f8eb4072f40 2024-09-19T09:17:20.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.498+0000 7f8ebc696640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8eb406efe0 con 0x7f8eb4145290 2024-09-19T09:17:20.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.498+0000 7f8eb9c31640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f8eb40ce780 0x7f8eb4072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49566/0 (socket says 172.21.15.18:49566) 2024-09-19T09:17:20.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.498+0000 7f8eb9c31640 1 -- 172.21.15.18:0/2256587939 learned_addr learned my addr 172.21.15.18:0/2256587939 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:17:20.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.498+0000 7f8eba432640 1 --2- 172.21.15.18:0/2256587939 >> v2:172.21.15.162:3300/0 conn(0x7f8eb4145290 0x7f8eb406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:20.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.498+0000 7f8eb9430640 1 -- 172.21.15.18:0/2256587939 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4251849227 0 0) 0x7f8eb406e3d0 con 0x7f8eb40ce780 2024-09-19T09:17:20.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.498+0000 7f8eb9430640 1 -- 172.21.15.18:0/2256587939 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ea0003520 con 0x7f8eb40ce780 2024-09-19T09:17:20.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.498+0000 7f8eb9430640 1 -- 172.21.15.18:0/2256587939 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 392435892 0 0) 0x7f8ea0003520 con 0x7f8eb40ce780 2024-09-19T09:17:20.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.498+0000 7f8eba432640 1 -- 172.21.15.18:0/2256587939 >> v1:172.21.15.162:6789/0 conn(0x7f8eb4072f40 legacy=0x7f8eb40b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:20.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.498+0000 7f8eba432640 1 -- 172.21.15.18:0/2256587939 >> v1:172.21.15.18:6789/0 conn(0x7f8eb40ce780 legacy=0x7f8eb4072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:20.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.498+0000 7f8eba432640 1 -- 172.21.15.18:0/2256587939 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb406e990 con 0x7f8eb4145290 2024-09-19T09:17:20.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.499+0000 7f8eba432640 1 --2- 172.21.15.18:0/2256587939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb4145290 0x7f8eb406f470 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00097a0 tx=0x7f8eb002a0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9349146af8950a8d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:20.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.499+0000 7f8eb9430640 1 -- 172.21.15.18:0/2256587939 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0037070 con 0x7f8eb4145290 2024-09-19T09:17:20.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.499+0000 7f8eb9430640 1 -- 172.21.15.18:0/2256587939 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eb002ab60 con 0x7f8eb4145290 2024-09-19T09:17:20.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.499+0000 7f8eb9430640 1 -- 172.21.15.18:0/2256587939 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4001670 con 0x7f8eb4145290 2024-09-19T09:17:20.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.500+0000 7f8ebc696640 1 -- 172.21.15.18:0/2256587939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb4145290 msgr2=0x7f8eb406f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:20.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.500+0000 7f8ebc696640 1 --2- 172.21.15.18:0/2256587939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb4145290 0x7f8eb406f470 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00097a0 tx=0x7f8eb002a0d0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.500+0000 7f8ebc696640 1 -- 172.21.15.18:0/2256587939 shutdown_connections 2024-09-19T09:17:20.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.500+0000 7f8ebc696640 1 --2- 172.21.15.18:0/2256587939 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb4145290 0x7f8eb406f470 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.500+0000 7f8ebc696640 1 -- 172.21.15.18:0/2256587939 >> 172.21.15.18:0/2256587939 conn(0x7f8eb406bc10 msgr2=0x7f8eb406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:20.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.500+0000 7f8ebc696640 1 -- 172.21.15.18:0/2256587939 shutdown_connections 2024-09-19T09:17:20.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.500+0000 7f8ebc696640 1 -- 172.21.15.18:0/2256587939 wait complete. 2024-09-19T09:17:20.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.501+0000 7f8ebc696640 1 Processor -- start 2024-09-19T09:17:20.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.501+0000 7f8ebc696640 1 -- start start 2024-09-19T09:17:20.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.502+0000 7f8ebc696640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8eb4072f40 0x7f8eb413ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:20.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.502+0000 7f8ebc696640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8eb40ce780 0x7f8eb415b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:20.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.502+0000 7f8ebc696640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb4145290 0x7f8eb40cd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:20.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.502+0000 7f8ebc696640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb406df80 con 0x7f8eb4072f40 2024-09-19T09:17:20.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.502+0000 7f8ebc696640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb4145670 con 0x7f8eb4145290 2024-09-19T09:17:20.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.502+0000 7f8ebc696640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8eb406e100 con 0x7f8eb40ce780 2024-09-19T09:17:20.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.502+0000 7f8eba432640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8eb4072f40 0x7f8eb413ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:20.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.502+0000 7f8eba432640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8eb4072f40 0x7f8eb413ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38190/0 (socket says 172.21.15.18:38190) 2024-09-19T09:17:20.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.502+0000 7f8eba432640 1 -- 172.21.15.18:0/806253739 learned_addr learned my addr 172.21.15.18:0/806253739 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:20.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.502+0000 7f8eba432640 1 -- 172.21.15.18:0/806253739 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8eb40ce780 msgr2=0x7f8eb415b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:20.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.502+0000 7f8eba432640 1 --2- 172.21.15.18:0/806253739 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8eb40ce780 0x7f8eb415b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.502+0000 7f8eba432640 1 -- 172.21.15.18:0/806253739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb4145290 msgr2=0x7f8eb40cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:20.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.502+0000 7f8eba432640 1 --2- 172.21.15.18:0/806253739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb4145290 0x7f8eb40cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.502+0000 7f8eba432640 1 -- 172.21.15.18:0/806253739 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb413d9c0 con 0x7f8eb4072f40 2024-09-19T09:17:20.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.503+0000 7f8eba432640 1 --2- 172.21.15.18:0/806253739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8eb4072f40 0x7f8eb413ea60 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00097a0 tx=0x7f8eb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:20.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.503+0000 7f8eaaffd640 1 -- 172.21.15.18:0/806253739 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0037040 con 0x7f8eb4072f40 2024-09-19T09:17:20.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.503+0000 7f8eaaffd640 1 -- 172.21.15.18:0/806253739 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eb0004030 con 0x7f8eb4072f40 2024-09-19T09:17:20.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.503+0000 7f8ebc696640 1 -- 172.21.15.18:0/806253739 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eb413dca0 con 0x7f8eb4072f40 2024-09-19T09:17:20.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.503+0000 7f8eaaffd640 1 -- 172.21.15.18:0/806253739 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0004400 con 0x7f8eb4072f40 2024-09-19T09:17:20.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.503+0000 7f8ebc696640 1 -- 172.21.15.18:0/806253739 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eb413e260 con 0x7f8eb4072f40 2024-09-19T09:17:20.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.504+0000 7f8ebc696640 1 -- 172.21.15.18:0/806253739 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8eb406fe20 con 0x7f8eb4072f40 2024-09-19T09:17:20.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.504+0000 7f8eaaffd640 1 -- 172.21.15.18:0/806253739 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8eb003a040 con 0x7f8eb4072f40 2024-09-19T09:17:20.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.505+0000 7f8eaaffd640 1 --2- 172.21.15.18:0/806253739 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8e9806c2b0 0x7f8e9806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:20.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.505+0000 7f8eaaffd640 1 -- 172.21.15.18:0/806253739 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 4857+0+0 (secure 0 0 0) 0x7f8eb00ab4e0 con 0x7f8eb4072f40 2024-09-19T09:17:20.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.505+0000 7f8eb9c31640 1 --2- 172.21.15.18:0/806253739 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8e9806c2b0 0x7f8e9806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:20.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.506+0000 7f8eb9c31640 1 --2- 172.21.15.18:0/806253739 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8e9806c2b0 0x7f8e9806e770 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4001eb0 tx=0x7f8ea4001a40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:20.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.509+0000 7f8eaaffd640 1 -- 172.21.15.18:0/806253739 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8eb406fe20 con 0x7f8eb4072f40 2024-09-19T09:17:20.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.688+0000 7f8ebc696640 1 -- 172.21.15.18:0/806253739 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8eb40b09e0 con 0x7f8eb4072f40 2024-09-19T09:17:20.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.688+0000 7f8eaaffd640 1 -- 172.21.15.18:0/806253739 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v86) ==== 84+0+65 (secure 0 0 0) 0x7f8eb0042020 con 0x7f8eb4072f40 2024-09-19T09:17:20.689 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:17:20.689 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-09-19T09:17:20.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:17:20.690 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 1, 2024-09-19T09:17:20.690 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": ".mgr" 2024-09-19T09:17:20.690 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:17:20.690 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-09-19T09:17:20.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.691+0000 7f8ebc696640 1 -- 172.21.15.18:0/806253739 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8e9806c2b0 msgr2=0x7f8e9806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:20.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.691+0000 7f8ebc696640 1 --2- 172.21.15.18:0/806253739 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8e9806c2b0 0x7f8e9806e770 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4001eb0 tx=0x7f8ea4001a40 comp rx=0 tx=0).stop 2024-09-19T09:17:20.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.691+0000 7f8ebc696640 1 -- 172.21.15.18:0/806253739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8eb4072f40 msgr2=0x7f8eb413ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:20.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.691+0000 7f8ebc696640 1 --2- 172.21.15.18:0/806253739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8eb4072f40 0x7f8eb413ea60 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00097a0 tx=0x7f8eb00046c0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.691+0000 7f8ebc696640 1 -- 172.21.15.18:0/806253739 shutdown_connections 2024-09-19T09:17:20.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.691+0000 7f8ebc696640 1 --2- 172.21.15.18:0/806253739 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8e9806c2b0 0x7f8e9806e770 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.691+0000 7f8ebc696640 1 --2- 172.21.15.18:0/806253739 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8eb4145290 0x7f8eb40cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.691+0000 7f8ebc696640 1 --2- 172.21.15.18:0/806253739 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8eb40ce780 0x7f8eb415b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.691+0000 7f8ebc696640 1 --2- 172.21.15.18:0/806253739 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8eb4072f40 0x7f8eb413ea60 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.691+0000 7f8ebc696640 1 -- 172.21.15.18:0/806253739 >> 172.21.15.18:0/806253739 conn(0x7f8eb406bc10 msgr2=0x7f8eb40b14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:20.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.691+0000 7f8ebc696640 1 -- 172.21.15.18:0/806253739 shutdown_connections 2024-09-19T09:17:20.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.691+0000 7f8ebc696640 1 -- 172.21.15.18:0/806253739 wait complete. 2024-09-19T09:17:20.702 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T09:17:20.702 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T09:17:20.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.807+0000 7f146d2d0640 1 Processor -- start 2024-09-19T09:17:20.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.807+0000 7f146d2d0640 1 -- start start 2024-09-19T09:17:20.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.808+0000 7f146d2d0640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f14680d1ac0 0x7f1468159050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:20.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.808+0000 7f146d2d0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f14680d1ea0 0x7f1468159590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:20.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.808+0000 7f146d2d0640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f146815f620 con 0x7f146815c3b0 2024-09-19T09:17:20.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.808+0000 7f146d2d0640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f146815f8c0 con 0x7f14680d1ea0 2024-09-19T09:17:20.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.808+0000 7f146d2d0640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f146815fba0 con 0x7f14680d1ac0 2024-09-19T09:17:20.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.808+0000 7f14667fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f14680d1ea0 0x7f1468159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:20.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.808+0000 7f14677fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f146815c3b0 0x7f146815c840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49570/0 (socket says 172.21.15.18:49570) 2024-09-19T09:17:20.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.808+0000 7f14677fe640 1 -- 172.21.15.18:0/2428891399 learned_addr learned my addr 172.21.15.18:0/2428891399 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:17:20.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.809+0000 7f1466ffd640 1 --2- 172.21.15.18:0/2428891399 >> v2:172.21.15.162:3300/0 conn(0x7f14680d1ac0 0x7f1468159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:20.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.809+0000 7f14667fc640 1 -- 172.21.15.18:0/2428891399 >> v2:172.21.15.162:3300/0 conn(0x7f14680d1ac0 msgr2=0x7f1468159050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:20.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.809+0000 7f14667fc640 1 --2- 172.21.15.18:0/2428891399 >> v2:172.21.15.162:3300/0 conn(0x7f14680d1ac0 0x7f1468159050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.809+0000 7f14667fc640 1 -- 172.21.15.18:0/2428891399 >> v1:172.21.15.18:6789/0 conn(0x7f146815c3b0 legacy=0x7f146815c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:20.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.809+0000 7f14667fc640 1 -- 172.21.15.18:0/2428891399 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f146815fe80 con 0x7f14680d1ea0 2024-09-19T09:17:20.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.809+0000 7f1465ffb640 1 -- 172.21.15.18:0/2428891399 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 527359961 0 0) 0x7f146815f620 con 0x7f146815c3b0 2024-09-19T09:17:20.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.809+0000 7f14667fc640 1 --2- 172.21.15.18:0/2428891399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14680d1ea0 0x7f1468159590 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f14500097a0 tx=0x7f145002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e471d64d499515b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:20.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.810+0000 7f1465ffb640 1 -- 172.21.15.18:0/2428891399 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1450037070 con 0x7f14680d1ea0 2024-09-19T09:17:20.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.810+0000 7f1465ffb640 1 -- 172.21.15.18:0/2428891399 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1450032440 con 0x7f14680d1ea0 2024-09-19T09:17:20.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.810+0000 7f1465ffb640 1 -- 172.21.15.18:0/2428891399 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1450032810 con 0x7f14680d1ea0 2024-09-19T09:17:20.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.810+0000 7f146d2d0640 1 -- 172.21.15.18:0/2428891399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14680d1ea0 msgr2=0x7f1468159590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:20.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.810+0000 7f146d2d0640 1 --2- 172.21.15.18:0/2428891399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14680d1ea0 0x7f1468159590 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f14500097a0 tx=0x7f145002a1e0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.810+0000 7f146d2d0640 1 -- 172.21.15.18:0/2428891399 shutdown_connections 2024-09-19T09:17:20.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.810+0000 7f146d2d0640 1 --2- 172.21.15.18:0/2428891399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f14680d1ea0 0x7f1468159590 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.810+0000 7f146d2d0640 1 --2- 172.21.15.18:0/2428891399 >> v2:172.21.15.162:3300/0 conn(0x7f14680d1ac0 0x7f1468159050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.810+0000 7f146d2d0640 1 -- 172.21.15.18:0/2428891399 >> 172.21.15.18:0/2428891399 conn(0x7f146806cd20 msgr2=0x7f146806d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:20.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.810+0000 7f146d2d0640 1 -- 172.21.15.18:0/2428891399 shutdown_connections 2024-09-19T09:17:20.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.810+0000 7f146d2d0640 1 -- 172.21.15.18:0/2428891399 wait complete. 2024-09-19T09:17:20.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.811+0000 7f146d2d0640 1 Processor -- start 2024-09-19T09:17:20.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.812+0000 7f146d2d0640 1 -- start start 2024-09-19T09:17:20.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.812+0000 7f146d2d0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14680d1ac0 0x7f1468157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:20.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.812+0000 7f146d2d0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14680d1ea0 0x7f14680ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:20.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.812+0000 7f146d2d0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f146815c3b0 0x7f14680adaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:20.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.812+0000 7f146d2d0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f146806ec10 con 0x7f146815c3b0 2024-09-19T09:17:20.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.812+0000 7f146d2d0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f146806bc10 con 0x7f14680d1ea0 2024-09-19T09:17:20.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.812+0000 7f146d2d0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f14681583b0 con 0x7f14680d1ac0 2024-09-19T09:17:20.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.812+0000 7f14677fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f146815c3b0 0x7f14680adaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:20.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.812+0000 7f14677fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f146815c3b0 0x7f14680adaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38208/0 (socket says 172.21.15.18:38208) 2024-09-19T09:17:20.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.812+0000 7f14677fe640 1 -- 172.21.15.18:0/1780055108 learned_addr learned my addr 172.21.15.18:0/1780055108 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:20.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.812+0000 7f1466ffd640 1 --2- 172.21.15.18:0/1780055108 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14680d1ac0 0x7f1468157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:20.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.813+0000 7f14667fc640 1 --2- 172.21.15.18:0/1780055108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14680d1ea0 0x7f14680ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:20.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.813+0000 7f14677fe640 1 -- 172.21.15.18:0/1780055108 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14680d1ac0 msgr2=0x7f1468157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:20.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.813+0000 7f14677fe640 1 --2- 172.21.15.18:0/1780055108 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14680d1ac0 0x7f1468157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.813+0000 7f14677fe640 1 -- 172.21.15.18:0/1780055108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14680d1ea0 msgr2=0x7f14680ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:20.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.813+0000 7f14677fe640 1 --2- 172.21.15.18:0/1780055108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14680d1ea0 0x7f14680ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:20.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.813+0000 7f14677fe640 1 -- 172.21.15.18:0/1780055108 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14680b30a0 con 0x7f146815c3b0 2024-09-19T09:17:20.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.813+0000 7f14667fc640 1 --2- 172.21.15.18:0/1780055108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14680d1ea0 0x7f14680ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:20.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.813+0000 7f1466ffd640 1 --2- 172.21.15.18:0/1780055108 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14680d1ac0 0x7f1468157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:20.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.813+0000 7f14677fe640 1 --2- 172.21.15.18:0/1780055108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f146815c3b0 0x7f14680adaf0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f146000c410 tx=0x7f146000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:20.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.813+0000 7f145f7fe640 1 -- 172.21.15.18:0/1780055108 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14600074e0 con 0x7f146815c3b0 2024-09-19T09:17:20.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.813+0000 7f145f7fe640 1 -- 172.21.15.18:0/1780055108 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14600047e0 con 0x7f146815c3b0 2024-09-19T09:17:20.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.813+0000 7f145f7fe640 1 -- 172.21.15.18:0/1780055108 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1460004bd0 con 0x7f146815c3b0 2024-09-19T09:17:20.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.813+0000 7f146d2d0640 1 -- 172.21.15.18:0/1780055108 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14680b3380 con 0x7f146815c3b0 2024-09-19T09:17:20.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.813+0000 7f146d2d0640 1 -- 172.21.15.18:0/1780055108 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14680b3940 con 0x7f146815c3b0 2024-09-19T09:17:20.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.814+0000 7f146d2d0640 1 -- 172.21.15.18:0/1780055108 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f146815c840 con 0x7f146815c3b0 2024-09-19T09:17:20.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.815+0000 7f145f7fe640 1 -- 172.21.15.18:0/1780055108 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1460011070 con 0x7f146815c3b0 2024-09-19T09:17:20.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.815+0000 7f145f7fe640 1 --2- 172.21.15.18:0/1780055108 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f144806c2b0 0x7f144806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:20.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.815+0000 7f145f7fe640 1 -- 172.21.15.18:0/1780055108 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 4857+0+0 (secure 0 0 0) 0x7f146008ac20 con 0x7f146815c3b0 2024-09-19T09:17:20.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.816+0000 7f1466ffd640 1 --2- 172.21.15.18:0/1780055108 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f144806c2b0 0x7f144806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:20.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.816+0000 7f1466ffd640 1 --2- 172.21.15.18:0/1780055108 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f144806c2b0 0x7f144806e770 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f14680ce230 tx=0x7f14580039f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:20.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.820+0000 7f145f7fe640 1 -- 172.21.15.18:0/1780055108 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1460059770 con 0x7f146815c3b0 2024-09-19T09:17:20.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:20.996+0000 7f146d2d0640 1 -- 172.21.15.18:0/1780055108 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f146806c730 con 0x7f146815c3b0 2024-09-19T09:17:21.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.078+0000 7f145f7fe640 1 -- 172.21.15.18:0/1780055108 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v87) ==== 138+0+0 (secure 0 0 0) 0x7f1460059070 con 0x7f146815c3b0 2024-09-19T09:17:21.079 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' created 2024-09-19T09:17:21.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.081+0000 7f146d2d0640 1 -- 172.21.15.18:0/1780055108 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f144806c2b0 msgr2=0x7f144806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:21.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.081+0000 7f146d2d0640 1 --2- 172.21.15.18:0/1780055108 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f144806c2b0 0x7f144806e770 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f14680ce230 tx=0x7f14580039f0 comp rx=0 tx=0).stop 2024-09-19T09:17:21.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.081+0000 7f146d2d0640 1 -- 172.21.15.18:0/1780055108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f146815c3b0 msgr2=0x7f14680adaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:21.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.081+0000 7f146d2d0640 1 --2- 172.21.15.18:0/1780055108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f146815c3b0 0x7f14680adaf0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f146000c410 tx=0x7f146000c8d0 comp rx=0 tx=0).stop 2024-09-19T09:17:21.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.081+0000 7f146d2d0640 1 -- 172.21.15.18:0/1780055108 shutdown_connections 2024-09-19T09:17:21.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.081+0000 7f146d2d0640 1 --2- 172.21.15.18:0/1780055108 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f144806c2b0 0x7f144806e770 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:21.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.082+0000 7f146d2d0640 1 --2- 172.21.15.18:0/1780055108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f146815c3b0 0x7f14680adaf0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:21.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.082+0000 7f146d2d0640 1 --2- 172.21.15.18:0/1780055108 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14680d1ea0 0x7f14680ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:21.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.082+0000 7f146d2d0640 1 --2- 172.21.15.18:0/1780055108 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14680d1ac0 0x7f1468157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:21.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.082+0000 7f146d2d0640 1 -- 172.21.15.18:0/1780055108 >> 172.21.15.18:0/1780055108 conn(0x7f146806cd20 msgr2=0x7f146815dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:21.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.082+0000 7f146d2d0640 1 -- 172.21.15.18:0/1780055108 shutdown_connections 2024-09-19T09:17:21.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.082+0000 7f146d2d0640 1 -- 172.21.15.18:0/1780055108 wait complete. 2024-09-19T09:17:21.095 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T09:17:21.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.204+0000 7f36d7a23640 1 Processor -- start 2024-09-19T09:17:21.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.204+0000 7f36d7a23640 1 -- start start 2024-09-19T09:17:21.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.205+0000 7f36d7a23640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f36d015edb0 0x7f36d006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:21.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.205+0000 7f36d7a23640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36d006cf30 0x7f36d00ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:21.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.205+0000 7f36d7a23640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36d015f190 con 0x7f36d006c150 2024-09-19T09:17:21.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.205+0000 7f36d7a23640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f36d00b39b0 con 0x7f36d015edb0 2024-09-19T09:17:21.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.205+0000 7f36d7a23640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f36d006d610 con 0x7f36d006cf30 2024-09-19T09:17:21.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.205+0000 7f36d57bf640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f36d015edb0 0x7f36d006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:21.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.205+0000 7f36d5fc0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36d006cf30 0x7f36d00ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:21.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.205+0000 7f36d4fbe640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f36d006c150 0x7f36d006c820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:54362/0 (socket says 172.21.15.18:54362) 2024-09-19T09:17:21.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.205+0000 7f36d4fbe640 1 -- 172.21.15.18:0/1163937213 learned_addr learned my addr 172.21.15.18:0/1163937213 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:17:21.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.206+0000 7f36d5fc0640 1 -- 172.21.15.18:0/1163937213 >> v2:172.21.15.162:3300/0 conn(0x7f36d015edb0 msgr2=0x7f36d006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:21.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.206+0000 7f36d5fc0640 1 --2- 172.21.15.18:0/1163937213 >> v2:172.21.15.162:3300/0 conn(0x7f36d015edb0 0x7f36d006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:21.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.206+0000 7f36d5fc0640 1 -- 172.21.15.18:0/1163937213 >> v1:172.21.15.162:6789/0 conn(0x7f36d006c150 legacy=0x7f36d006c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:21.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.206+0000 7f36d5fc0640 1 -- 172.21.15.18:0/1163937213 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36d00b2da0 con 0x7f36d006cf30 2024-09-19T09:17:21.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.206+0000 7f36d57bf640 1 --2- 172.21.15.18:0/1163937213 >> v2:172.21.15.162:3300/0 conn(0x7f36d015edb0 0x7f36d006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:17:21.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.207+0000 7f36d5fc0640 1 --2- 172.21.15.18:0/1163937213 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36d006cf30 0x7f36d00ae1d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f36c8009d90 tx=0x7f36c802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fef6b5b4f24ffcfc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:21.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.207+0000 7f36c7fff640 1 -- 172.21.15.18:0/1163937213 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c8007740 con 0x7f36d006cf30 2024-09-19T09:17:21.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.207+0000 7f36c7fff640 1 -- 172.21.15.18:0/1163937213 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36c80078e0 con 0x7f36d006cf30 2024-09-19T09:17:21.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.207+0000 7f36c7fff640 1 -- 172.21.15.18:0/1163937213 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c8007cb0 con 0x7f36d006cf30 2024-09-19T09:17:21.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.207+0000 7f36d7a23640 1 -- 172.21.15.18:0/1163937213 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36d006cf30 msgr2=0x7f36d00ae1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:21.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.207+0000 7f36d7a23640 1 --2- 172.21.15.18:0/1163937213 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36d006cf30 0x7f36d00ae1d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f36c8009d90 tx=0x7f36c802a660 comp rx=0 tx=0).stop 2024-09-19T09:17:21.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.207+0000 7f36d7a23640 1 -- 172.21.15.18:0/1163937213 shutdown_connections 2024-09-19T09:17:21.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.207+0000 7f36d7a23640 1 --2- 172.21.15.18:0/1163937213 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36d006cf30 0x7f36d00ae1d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:21.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.207+0000 7f36d7a23640 1 --2- 172.21.15.18:0/1163937213 >> v2:172.21.15.162:3300/0 conn(0x7f36d015edb0 0x7f36d006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:21.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.207+0000 7f36d7a23640 1 -- 172.21.15.18:0/1163937213 >> 172.21.15.18:0/1163937213 conn(0x7f36d00b5fc0 msgr2=0x7f36d00b6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:21.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.207+0000 7f36d7a23640 1 -- 172.21.15.18:0/1163937213 shutdown_connections 2024-09-19T09:17:21.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.207+0000 7f36d7a23640 1 -- 172.21.15.18:0/1163937213 wait complete. 2024-09-19T09:17:21.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.209+0000 7f36d7a23640 1 Processor -- start 2024-09-19T09:17:21.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.209+0000 7f36d7a23640 1 -- start start 2024-09-19T09:17:21.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.209+0000 7f36d7a23640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36d006c150 0x7f36d01493f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:21.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.209+0000 7f36d7a23640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36d006cf30 0x7f36d015dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:21.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.209+0000 7f36d7a23640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36d015edb0 0x7f36d0161650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:21.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.209+0000 7f36d7a23640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f36d00b3640 con 0x7f36d015edb0 2024-09-19T09:17:21.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.209+0000 7f36d7a23640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f36d00b3360 con 0x7f36d006c150 2024-09-19T09:17:21.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.209+0000 7f36d7a23640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f36d00ae710 con 0x7f36d006cf30 2024-09-19T09:17:21.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.209+0000 7f36d5fc0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36d015edb0 0x7f36d0161650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:21.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.209+0000 7f36d5fc0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36d015edb0 0x7f36d0161650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38222/0 (socket says 172.21.15.18:38222) 2024-09-19T09:17:21.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.209+0000 7f36d5fc0640 1 -- 172.21.15.18:0/2861400363 learned_addr learned my addr 172.21.15.18:0/2861400363 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:21.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.210+0000 7f36d57bf640 1 --2- 172.21.15.18:0/2861400363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36d006c150 0x7f36d01493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:21.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.210+0000 7f36d4fbe640 1 --2- 172.21.15.18:0/2861400363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36d006cf30 0x7f36d015dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:21.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.210+0000 7f36d5fc0640 1 -- 172.21.15.18:0/2861400363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36d006cf30 msgr2=0x7f36d015dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:21.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.210+0000 7f36d5fc0640 1 --2- 172.21.15.18:0/2861400363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36d006cf30 0x7f36d015dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:21.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.210+0000 7f36d5fc0640 1 -- 172.21.15.18:0/2861400363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36d006c150 msgr2=0x7f36d01493f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:21.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.210+0000 7f36d5fc0640 1 --2- 172.21.15.18:0/2861400363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36d006c150 0x7f36d01493f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:21.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.210+0000 7f36d5fc0640 1 -- 172.21.15.18:0/2861400363 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36d01f4ea0 con 0x7f36d015edb0 2024-09-19T09:17:21.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.210+0000 7f36d5fc0640 1 --2- 172.21.15.18:0/2861400363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36d015edb0 0x7f36d0161650 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f36c8009eb0 tx=0x7f36c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:21.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.210+0000 7f36c5ffb640 1 -- 172.21.15.18:0/2861400363 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c8040070 con 0x7f36d015edb0 2024-09-19T09:17:21.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.210+0000 7f36c5ffb640 1 -- 172.21.15.18:0/2861400363 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36c8031c60 con 0x7f36d015edb0 2024-09-19T09:17:21.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.210+0000 7f36d7a23640 1 -- 172.21.15.18:0/2861400363 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36d01f5180 con 0x7f36d015edb0 2024-09-19T09:17:21.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.210+0000 7f36c5ffb640 1 -- 172.21.15.18:0/2861400363 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c8009450 con 0x7f36d015edb0 2024-09-19T09:17:21.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.210+0000 7f36d7a23640 1 -- 172.21.15.18:0/2861400363 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36d01f5740 con 0x7f36d015edb0 2024-09-19T09:17:21.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.212+0000 7f36d7a23640 1 -- 172.21.15.18:0/2861400363 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36d00ae1d0 con 0x7f36d015edb0 2024-09-19T09:17:21.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.212+0000 7f36c5ffb640 1 -- 172.21.15.18:0/2861400363 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f36c8039040 con 0x7f36d015edb0 2024-09-19T09:17:21.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.213+0000 7f36c5ffb640 1 --2- 172.21.15.18:0/2861400363 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f36b406c2e0 0x7f36b406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:21.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.213+0000 7f36c5ffb640 1 -- 172.21.15.18:0/2861400363 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 5227+0+0 (secure 0 0 0) 0x7f36c80ac6a0 con 0x7f36d015edb0 2024-09-19T09:17:21.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.213+0000 7f36d57bf640 1 --2- 172.21.15.18:0/2861400363 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f36b406c2e0 0x7f36b406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:21.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.213+0000 7f36d57bf640 1 --2- 172.21.15.18:0/2861400363 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f36b406c2e0 0x7f36b406e7a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f36d015d870 tx=0x7f36cc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:21.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.217+0000 7f36c5ffb640 1 -- 172.21.15.18:0/2861400363 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f36c807a900 con 0x7f36d015edb0 2024-09-19T09:17:21.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:21.395+0000 7f36d7a23640 1 -- 172.21.15.18:0/2861400363 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f36d0163510 con 0x7f36d015edb0 2024-09-19T09:17:22.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.086+0000 7f36c5ffb640 1 -- 172.21.15.18:0/2861400363 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v88) ==== 170+0+0 (secure 0 0 0) 0x7f36c8081120 con 0x7f36d015edb0 2024-09-19T09:17:22.086 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' created 2024-09-19T09:17:22.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.090+0000 7f36d7a23640 1 -- 172.21.15.18:0/2861400363 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f36b406c2e0 msgr2=0x7f36b406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:22.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.090+0000 7f36d7a23640 1 --2- 172.21.15.18:0/2861400363 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f36b406c2e0 0x7f36b406e7a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f36d015d870 tx=0x7f36cc009190 comp rx=0 tx=0).stop 2024-09-19T09:17:22.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.090+0000 7f36d7a23640 1 -- 172.21.15.18:0/2861400363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36d015edb0 msgr2=0x7f36d0161650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:22.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.090+0000 7f36d7a23640 1 --2- 172.21.15.18:0/2861400363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36d015edb0 0x7f36d0161650 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f36c8009eb0 tx=0x7f36c8004a40 comp rx=0 tx=0).stop 2024-09-19T09:17:22.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.096+0000 7f36d7a23640 1 -- 172.21.15.18:0/2861400363 shutdown_connections 2024-09-19T09:17:22.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.096+0000 7f36d7a23640 1 --2- 172.21.15.18:0/2861400363 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f36b406c2e0 0x7f36b406e7a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:22.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.096+0000 7f36d7a23640 1 --2- 172.21.15.18:0/2861400363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36d015edb0 0x7f36d0161650 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:22.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.096+0000 7f36d7a23640 1 --2- 172.21.15.18:0/2861400363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36d006cf30 0x7f36d015dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:22.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.096+0000 7f36d7a23640 1 --2- 172.21.15.18:0/2861400363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36d006c150 0x7f36d01493f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:22.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.096+0000 7f36d7a23640 1 -- 172.21.15.18:0/2861400363 >> 172.21.15.18:0/2861400363 conn(0x7f36d00b5fc0 msgr2=0x7f36d0159a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:22.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.096+0000 7f36d7a23640 1 -- 172.21.15.18:0/2861400363 shutdown_connections 2024-09-19T09:17:22.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.096+0000 7f36d7a23640 1 -- 172.21.15.18:0/2861400363 wait complete. 2024-09-19T09:17:22.114 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T09:17:22.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.224+0000 7f7194e77640 1 Processor -- start 2024-09-19T09:17:22.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.224+0000 7f7194e77640 1 -- start start 2024-09-19T09:17:22.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.225+0000 7f7194e77640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f71901623c0 0x7f71900b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:22.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.225+0000 7f7194e77640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71900d1470 0x7f71900d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:22.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.225+0000 7f7194e77640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71900d3700 con 0x7f71900d56b0 2024-09-19T09:17:22.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.225+0000 7f7194e77640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f71900d21a0 con 0x7f71901623c0 2024-09-19T09:17:22.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.225+0000 7f7194e77640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f71900d0080 con 0x7f71900d1470 2024-09-19T09:17:22.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.226+0000 7f718e59c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f71901623c0 0x7f71900b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:22.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.226+0000 7f718ed9d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71900d1470 0x7f71900d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:22.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.226+0000 7f718e59c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f71901623c0 0x7f71900b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:60256/0 (socket says 172.21.15.18:60256) 2024-09-19T09:17:22.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.226+0000 7f718ed9d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71900d1470 0x7f71900d1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:44526/0 (socket says 172.21.15.18:44526) 2024-09-19T09:17:22.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.226+0000 7f718e59c640 1 -- 172.21.15.18:0/1475193478 learned_addr learned my addr 172.21.15.18:0/1475193478 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:22.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.226+0000 7f718e59c640 1 -- 172.21.15.18:0/1475193478 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71900d1470 msgr2=0x7f71900d1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:22.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.226+0000 7f718e59c640 1 --2- 172.21.15.18:0/1475193478 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71900d1470 0x7f71900d1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:22.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.226+0000 7f718e59c640 1 -- 172.21.15.18:0/1475193478 >> v1:172.21.15.162:6789/0 conn(0x7f71900d56b0 legacy=0x7f71900d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:22.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.226+0000 7f718e59c640 1 -- 172.21.15.18:0/1475193478 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71900cfa70 con 0x7f71901623c0 2024-09-19T09:17:22.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.226+0000 7f718ed9d640 1 --2- 172.21.15.18:0/1475193478 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71900d1470 0x7f71900d1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:17:22.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.227+0000 7f718e59c640 1 --2- 172.21.15.18:0/1475193478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71901623c0 0x7f71900b6260 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7188009e50 tx=0x7f718802a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60255276e3fe249e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:22.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.227+0000 7f718d59a640 1 -- 172.21.15.18:0/1475193478 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7188036070 con 0x7f71901623c0 2024-09-19T09:17:22.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.227+0000 7f718d59a640 1 -- 172.21.15.18:0/1475193478 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7188031600 con 0x7f71901623c0 2024-09-19T09:17:22.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.227+0000 7f718d59a640 1 -- 172.21.15.18:0/1475193478 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71880319d0 con 0x7f71901623c0 2024-09-19T09:17:22.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.228+0000 7f7194e77640 1 -- 172.21.15.18:0/1475193478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71901623c0 msgr2=0x7f71900b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:22.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.228+0000 7f7194e77640 1 --2- 172.21.15.18:0/1475193478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71901623c0 0x7f71900b6260 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7188009e50 tx=0x7f718802a710 comp rx=0 tx=0).stop 2024-09-19T09:17:22.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.228+0000 7f7194e77640 1 -- 172.21.15.18:0/1475193478 shutdown_connections 2024-09-19T09:17:22.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.228+0000 7f7194e77640 1 --2- 172.21.15.18:0/1475193478 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71900d1470 0x7f71900d1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:22.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.228+0000 7f7194e77640 1 --2- 172.21.15.18:0/1475193478 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71901623c0 0x7f71900b6260 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:22.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.228+0000 7f7194e77640 1 -- 172.21.15.18:0/1475193478 >> 172.21.15.18:0/1475193478 conn(0x7f719009df30 msgr2=0x7f71900d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:22.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.228+0000 7f7194e77640 1 -- 172.21.15.18:0/1475193478 shutdown_connections 2024-09-19T09:17:22.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.228+0000 7f7194e77640 1 -- 172.21.15.18:0/1475193478 wait complete. 2024-09-19T09:17:22.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.229+0000 7f7194e77640 1 Processor -- start 2024-09-19T09:17:22.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.229+0000 7f7194e77640 1 -- start start 2024-09-19T09:17:22.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.230+0000 7f7194e77640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71900d1470 0x7f719015e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:22.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.230+0000 7f7194e77640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71900d56b0 0x7f71900c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:22.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.230+0000 7f7194e77640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71901623c0 0x7f719015edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:22.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.230+0000 7f7194e77640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f71900cfd10 con 0x7f71900d1470 2024-09-19T09:17:22.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.230+0000 7f7194e77640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f71900d39a0 con 0x7f71900d56b0 2024-09-19T09:17:22.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.230+0000 7f7194e77640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f71901627a0 con 0x7f71901623c0 2024-09-19T09:17:22.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.230+0000 7f718e59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71900d1470 0x7f719015e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:22.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.230+0000 7f718e59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71900d1470 0x7f719015e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38234/0 (socket says 172.21.15.18:38234) 2024-09-19T09:17:22.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.230+0000 7f718e59c640 1 -- 172.21.15.18:0/904804599 learned_addr learned my addr 172.21.15.18:0/904804599 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:22.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.230+0000 7f718dd9b640 1 --2- 172.21.15.18:0/904804599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71900d56b0 0x7f71900c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:22.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.230+0000 7f718ed9d640 1 --2- 172.21.15.18:0/904804599 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71901623c0 0x7f719015edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:22.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.230+0000 7f718e59c640 1 -- 172.21.15.18:0/904804599 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71901623c0 msgr2=0x7f719015edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:22.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.230+0000 7f718e59c640 1 --2- 172.21.15.18:0/904804599 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71901623c0 0x7f719015edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:22.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.230+0000 7f718e59c640 1 -- 172.21.15.18:0/904804599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71900d56b0 msgr2=0x7f71900c9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:22.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.230+0000 7f718e59c640 1 --2- 172.21.15.18:0/904804599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71900d56b0 0x7f71900c9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:22.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.230+0000 7f718e59c640 1 -- 172.21.15.18:0/904804599 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71900c9f40 con 0x7f71900d1470 2024-09-19T09:17:22.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.231+0000 7f718e59c640 1 --2- 172.21.15.18:0/904804599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71900d1470 0x7f719015e190 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7188034040 tx=0x7f7188004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:22.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.231+0000 7f7186ffd640 1 -- 172.21.15.18:0/904804599 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7188036050 con 0x7f71900d1470 2024-09-19T09:17:22.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.231+0000 7f7186ffd640 1 -- 172.21.15.18:0/904804599 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7188042070 con 0x7f71900d1470 2024-09-19T09:17:22.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.231+0000 7f7194e77640 1 -- 172.21.15.18:0/904804599 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71900ca220 con 0x7f71900d1470 2024-09-19T09:17:22.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.231+0000 7f7186ffd640 1 -- 172.21.15.18:0/904804599 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7188009510 con 0x7f71900d1470 2024-09-19T09:17:22.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.231+0000 7f7194e77640 1 -- 172.21.15.18:0/904804599 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71900ca7e0 con 0x7f71900d1470 2024-09-19T09:17:22.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.232+0000 7f7194e77640 1 -- 172.21.15.18:0/904804599 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71900d3c80 con 0x7f71900d1470 2024-09-19T09:17:22.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.233+0000 7f7186ffd640 1 -- 172.21.15.18:0/904804599 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7188007c70 con 0x7f71900d1470 2024-09-19T09:17:22.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.233+0000 7f7186ffd640 1 --2- 172.21.15.18:0/904804599 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f717006c2b0 0x7f717006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:22.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.233+0000 7f7186ffd640 1 -- 172.21.15.18:0/904804599 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 5609+0+0 (secure 0 0 0) 0x7f71880ac0d0 con 0x7f71900d1470 2024-09-19T09:17:22.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.233+0000 7f718dd9b640 1 --2- 172.21.15.18:0/904804599 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f717006c2b0 0x7f717006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:22.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.234+0000 7f718dd9b640 1 --2- 172.21.15.18:0/904804599 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f717006c2b0 0x7f717006e770 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f71900b8630 tx=0x7f7178009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:22.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.238+0000 7f7186ffd640 1 -- 172.21.15.18:0/904804599 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f718807a8a0 con 0x7f71900d1470 2024-09-19T09:17:22.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:22.450+0000 7f7194e77640 1 -- 172.21.15.18:0/904804599 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f7190161be0 con 0x7f71900d1470 2024-09-19T09:17:23.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.087+0000 7f7186ffd640 1 -- 172.21.15.18:0/904804599 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v33) ==== 174+0+0 (secure 0 0 0) 0x7f718807a1a0 con 0x7f71900d1470 2024-09-19T09:17:23.087 INFO:teuthology.orchestra.run.smithi018.stderr:new fs with metadata pool 10 and data pool 11 2024-09-19T09:17:23.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.090+0000 7f7194e77640 1 -- 172.21.15.18:0/904804599 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f717006c2b0 msgr2=0x7f717006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:23.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.090+0000 7f7194e77640 1 --2- 172.21.15.18:0/904804599 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f717006c2b0 0x7f717006e770 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f71900b8630 tx=0x7f7178009040 comp rx=0 tx=0).stop 2024-09-19T09:17:23.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.090+0000 7f7194e77640 1 -- 172.21.15.18:0/904804599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71900d1470 msgr2=0x7f719015e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:23.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.090+0000 7f7194e77640 1 --2- 172.21.15.18:0/904804599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71900d1470 0x7f719015e190 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f7188034040 tx=0x7f7188004a40 comp rx=0 tx=0).stop 2024-09-19T09:17:23.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.090+0000 7f7194e77640 1 -- 172.21.15.18:0/904804599 shutdown_connections 2024-09-19T09:17:23.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.090+0000 7f7194e77640 1 --2- 172.21.15.18:0/904804599 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f717006c2b0 0x7f717006e770 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.090+0000 7f7194e77640 1 --2- 172.21.15.18:0/904804599 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f71901623c0 0x7f719015edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.090+0000 7f7194e77640 1 --2- 172.21.15.18:0/904804599 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f71900d56b0 0x7f71900c9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.090+0000 7f7194e77640 1 --2- 172.21.15.18:0/904804599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f71900d1470 0x7f719015e190 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.090+0000 7f7194e77640 1 -- 172.21.15.18:0/904804599 >> 172.21.15.18:0/904804599 conn(0x7f719009df30 msgr2=0x7f71900d2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:23.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.091+0000 7f7194e77640 1 -- 172.21.15.18:0/904804599 shutdown_connections 2024-09-19T09:17:23.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.091+0000 7f7194e77640 1 -- 172.21.15.18:0/904804599 wait complete. 2024-09-19T09:17:23.106 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:17:23.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.210+0000 7f970b7c4640 1 Processor -- start 2024-09-19T09:17:23.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.210+0000 7f970b7c4640 1 -- start start 2024-09-19T09:17:23.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.211+0000 7f970b7c4640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f97040cfae0 0x7f97040b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:23.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.211+0000 7f970b7c4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f970406d730 0x7f97040cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:23.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.211+0000 7f970b7c4640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97040cd1a0 con 0x7f970415ef80 2024-09-19T09:17:23.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.211+0000 7f970b7c4640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f97040cd7d0 con 0x7f97040cfae0 2024-09-19T09:17:23.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.211+0000 7f970b7c4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f970406dc30 con 0x7f970406d730 2024-09-19T09:17:23.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.211+0000 7f9708d5f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f97040cfae0 0x7f97040b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:23.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.211+0000 7f9709d61640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f970406d730 0x7f97040cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:23.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.211+0000 7f9708d5f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f97040cfae0 0x7f97040b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:60274/0 (socket says 172.21.15.18:60274) 2024-09-19T09:17:23.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.211+0000 7f9709560640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f970415ef80 0x7f97040cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:54390/0 (socket says 172.21.15.18:54390) 2024-09-19T09:17:23.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.211+0000 7f9708d5f640 1 -- 172.21.15.18:0/1099848396 learned_addr learned my addr 172.21.15.18:0/1099848396 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:23.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.211+0000 7f9709d61640 1 -- 172.21.15.18:0/1099848396 >> v2:172.21.15.162:3300/0 conn(0x7f97040cfae0 msgr2=0x7f97040b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:23.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.211+0000 7f9709d61640 1 --2- 172.21.15.18:0/1099848396 >> v2:172.21.15.162:3300/0 conn(0x7f97040cfae0 0x7f97040b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.211+0000 7f9709d61640 1 -- 172.21.15.18:0/1099848396 >> v1:172.21.15.162:6789/0 conn(0x7f970415ef80 legacy=0x7f97040cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:23.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.211+0000 7f9709d61640 1 -- 172.21.15.18:0/1099848396 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f970406df10 con 0x7f970406d730 2024-09-19T09:17:23.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.211+0000 7f9708d5f640 1 --2- 172.21.15.18:0/1099848396 >> v2:172.21.15.162:3300/0 conn(0x7f97040cfae0 0x7f97040b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:17:23.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.212+0000 7f9709d61640 1 --2- 172.21.15.18:0/1099848396 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f970406d730 0x7f97040cdc60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f96fc009d90 tx=0x7f96fc02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84a68e5f930259b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:23.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.212+0000 7f96fbfff640 1 -- 172.21.15.18:0/1099848396 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96fc007740 con 0x7f970406d730 2024-09-19T09:17:23.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.213+0000 7f96fbfff640 1 -- 172.21.15.18:0/1099848396 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96fc0078e0 con 0x7f970406d730 2024-09-19T09:17:23.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.213+0000 7f96fbfff640 1 -- 172.21.15.18:0/1099848396 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96fc007cb0 con 0x7f970406d730 2024-09-19T09:17:23.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.213+0000 7f970b7c4640 1 -- 172.21.15.18:0/1099848396 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f970406d730 msgr2=0x7f97040cdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:23.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.213+0000 7f970b7c4640 1 --2- 172.21.15.18:0/1099848396 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f970406d730 0x7f97040cdc60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f96fc009d90 tx=0x7f96fc02a660 comp rx=0 tx=0).stop 2024-09-19T09:17:23.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.213+0000 7f970b7c4640 1 -- 172.21.15.18:0/1099848396 shutdown_connections 2024-09-19T09:17:23.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.213+0000 7f970b7c4640 1 --2- 172.21.15.18:0/1099848396 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f970406d730 0x7f97040cdc60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.213+0000 7f970b7c4640 1 --2- 172.21.15.18:0/1099848396 >> v2:172.21.15.162:3300/0 conn(0x7f97040cfae0 0x7f97040b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.213+0000 7f970b7c4640 1 -- 172.21.15.18:0/1099848396 >> 172.21.15.18:0/1099848396 conn(0x7f97040b4700 msgr2=0x7f97040b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:23.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.213+0000 7f970b7c4640 1 -- 172.21.15.18:0/1099848396 shutdown_connections 2024-09-19T09:17:23.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.213+0000 7f970b7c4640 1 -- 172.21.15.18:0/1099848396 wait complete. 2024-09-19T09:17:23.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.214+0000 7f970b7c4640 1 Processor -- start 2024-09-19T09:17:23.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.215+0000 7f970b7c4640 1 -- start start 2024-09-19T09:17:23.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.215+0000 7f970b7c4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f970406d730 0x7f9704157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:23.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.215+0000 7f970b7c4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97040cfae0 0x7f97040b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:23.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.215+0000 7f970b7c4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f970415ef80 0x7f97040b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:23.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.215+0000 7f970b7c4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f97040d0120 con 0x7f970415ef80 2024-09-19T09:17:23.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.215+0000 7f970b7c4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f970415f360 con 0x7f97040cfae0 2024-09-19T09:17:23.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.215+0000 7f970b7c4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f97040ce1a0 con 0x7f970406d730 2024-09-19T09:17:23.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.215+0000 7f9709d61640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f970415ef80 0x7f97040b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:23.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.215+0000 7f9709d61640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f970415ef80 0x7f97040b5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38246/0 (socket says 172.21.15.18:38246) 2024-09-19T09:17:23.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.215+0000 7f9709d61640 1 -- 172.21.15.18:0/1252308151 learned_addr learned my addr 172.21.15.18:0/1252308151 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:23.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.216+0000 7f9708d5f640 1 --2- 172.21.15.18:0/1252308151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97040cfae0 0x7f97040b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:23.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.216+0000 7f9709560640 1 --2- 172.21.15.18:0/1252308151 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f970406d730 0x7f9704157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:23.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.216+0000 7f9709d61640 1 -- 172.21.15.18:0/1252308151 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f970406d730 msgr2=0x7f9704157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:23.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.216+0000 7f9709d61640 1 --2- 172.21.15.18:0/1252308151 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f970406d730 0x7f9704157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.216+0000 7f9709d61640 1 -- 172.21.15.18:0/1252308151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97040cfae0 msgr2=0x7f97040b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:23.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.216+0000 7f9709d61640 1 --2- 172.21.15.18:0/1252308151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97040cfae0 0x7f97040b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.216+0000 7f9709d61640 1 -- 172.21.15.18:0/1252308151 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97041f8480 con 0x7f970415ef80 2024-09-19T09:17:23.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.216+0000 7f9709d61640 1 --2- 172.21.15.18:0/1252308151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f970415ef80 0x7f97040b5020 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f96fc02ac50 tx=0x7f96fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:23.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.216+0000 7f96f9ffb640 1 -- 172.21.15.18:0/1252308151 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96fc040070 con 0x7f970415ef80 2024-09-19T09:17:23.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.216+0000 7f96f9ffb640 1 -- 172.21.15.18:0/1252308151 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96fc031bc0 con 0x7f970415ef80 2024-09-19T09:17:23.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.216+0000 7f96f9ffb640 1 -- 172.21.15.18:0/1252308151 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96fc009450 con 0x7f970415ef80 2024-09-19T09:17:23.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.216+0000 7f970b7c4640 1 -- 172.21.15.18:0/1252308151 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97041f8760 con 0x7f970415ef80 2024-09-19T09:17:23.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.216+0000 7f970b7c4640 1 -- 172.21.15.18:0/1252308151 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97041f8d20 con 0x7f970415ef80 2024-09-19T09:17:23.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.217+0000 7f970b7c4640 1 -- 172.21.15.18:0/1252308151 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97041f8f20 con 0x7f970415ef80 2024-09-19T09:17:23.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.218+0000 7f96f9ffb640 1 -- 172.21.15.18:0/1252308151 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f96fc039040 con 0x7f970415ef80 2024-09-19T09:17:23.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.219+0000 7f96f9ffb640 1 --2- 172.21.15.18:0/1252308151 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f96e806c2b0 0x7f96e806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:23.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.219+0000 7f96f9ffb640 1 -- 172.21.15.18:0/1252308151 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5709+0+0 (secure 0 0 0) 0x7f96fc0acc00 con 0x7f970415ef80 2024-09-19T09:17:23.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.219+0000 7f9709560640 1 --2- 172.21.15.18:0/1252308151 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f96e806c2b0 0x7f96e806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:23.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.220+0000 7f9709560640 1 --2- 172.21.15.18:0/1252308151 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f96e806c2b0 0x7f96e806e770 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9700000f60 tx=0x7f9700007c80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:23.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.223+0000 7f96f9ffb640 1 -- 172.21.15.18:0/1252308151 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f97041f8f20 con 0x7f970415ef80 2024-09-19T09:17:23.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.398+0000 7f970b7c4640 1 -- 172.21.15.18:0/1252308151 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f97040cdc60 con 0x7f970415ef80 2024-09-19T09:17:23.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.399+0000 7f96f9ffb640 1 -- 172.21.15.18:0/1252308151 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+16693 (secure 0 0 0) 0x7f96fc0b3080 con 0x7f970415ef80 2024-09-19T09:17:23.400 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:17:23.400 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":89,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:17:22.451577+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:17:21.027574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-19T09:17:21.426866+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:17:23.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.401+0000 7f970b7c4640 1 -- 172.21.15.18:0/1252308151 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f96e806c2b0 msgr2=0x7f96e806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:23.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.401+0000 7f970b7c4640 1 --2- 172.21.15.18:0/1252308151 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f96e806c2b0 0x7f96e806e770 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f9700000f60 tx=0x7f9700007c80 comp rx=0 tx=0).stop 2024-09-19T09:17:23.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.401+0000 7f970b7c4640 1 -- 172.21.15.18:0/1252308151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f970415ef80 msgr2=0x7f97040b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:23.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.401+0000 7f970b7c4640 1 --2- 172.21.15.18:0/1252308151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f970415ef80 0x7f97040b5020 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f96fc02ac50 tx=0x7f96fc004a40 comp rx=0 tx=0).stop 2024-09-19T09:17:23.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.402+0000 7f970b7c4640 1 -- 172.21.15.18:0/1252308151 shutdown_connections 2024-09-19T09:17:23.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.402+0000 7f970b7c4640 1 --2- 172.21.15.18:0/1252308151 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f96e806c2b0 0x7f96e806e770 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.402+0000 7f970b7c4640 1 --2- 172.21.15.18:0/1252308151 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f970415ef80 0x7f97040b5020 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.402+0000 7f970b7c4640 1 --2- 172.21.15.18:0/1252308151 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97040cfae0 0x7f97040b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.402+0000 7f970b7c4640 1 --2- 172.21.15.18:0/1252308151 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f970406d730 0x7f9704157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.402+0000 7f970b7c4640 1 -- 172.21.15.18:0/1252308151 >> 172.21.15.18:0/1252308151 conn(0x7f97040b4700 msgr2=0x7f97040b7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:23.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.402+0000 7f970b7c4640 1 -- 172.21.15.18:0/1252308151 shutdown_connections 2024-09-19T09:17:23.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.402+0000 7f970b7c4640 1 -- 172.21.15.18:0/1252308151 wait complete. 2024-09-19T09:17:23.413 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:17:23.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.515+0000 7fc1ce5d6640 1 Processor -- start 2024-09-19T09:17:23.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.515+0000 7fc1ce5d6640 1 -- start start 2024-09-19T09:17:23.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.516+0000 7fc1ce5d6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1c80b3ce0 0x7fc1c80cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:23.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.516+0000 7fc1ce5d6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc1c80d0050 0x7fc1c80cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:23.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.516+0000 7fc1ce5d6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1c80d0e10 con 0x7fc1c80cf560 2024-09-19T09:17:23.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.516+0000 7fc1ce5d6640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fc1c80d0850 con 0x7fc1c80d0050 2024-09-19T09:17:23.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.516+0000 7fc1ce5d6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc1c80d0b30 con 0x7fc1c80b3ce0 2024-09-19T09:17:23.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.516+0000 7fc1ccb73640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc1c80d0050 0x7fc1c80cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:23.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.516+0000 7fc1ccb73640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc1c80d0050 0x7fc1c80cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38260/0 (socket says 172.21.15.18:38260) 2024-09-19T09:17:23.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.516+0000 7fc1ccb73640 1 -- 172.21.15.18:0/2986762026 learned_addr learned my addr 172.21.15.18:0/2986762026 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:23.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.516+0000 7fc1c77fe640 1 --2- 172.21.15.18:0/2986762026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1c80b3ce0 0x7fc1c80cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:23.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.517+0000 7fc1ccb73640 1 -- 172.21.15.18:0/2986762026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1c80b3ce0 msgr2=0x7fc1c80cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:23.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.517+0000 7fc1ccb73640 1 --2- 172.21.15.18:0/2986762026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1c80b3ce0 0x7fc1c80cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.517+0000 7fc1ccb73640 1 -- 172.21.15.18:0/2986762026 >> v1:172.21.15.162:6789/0 conn(0x7fc1c80cf560 legacy=0x7fc1c80cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:23.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.517+0000 7fc1ccb73640 1 -- 172.21.15.18:0/2986762026 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c80b24d0 con 0x7fc1c80d0050 2024-09-19T09:17:23.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.517+0000 7fc1c77fe640 1 --2- 172.21.15.18:0/2986762026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1c80b3ce0 0x7fc1c80cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:23.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.517+0000 7fc1ccb73640 1 --2- 172.21.15.18:0/2986762026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1c80d0050 0x7fc1c80cdb30 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009e50 tx=0x7fc1c002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48908a4a708d6a11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:23.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.518+0000 7fc1c6ffd640 1 -- 172.21.15.18:0/2986762026 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0036070 con 0x7fc1c80d0050 2024-09-19T09:17:23.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.518+0000 7fc1c6ffd640 1 -- 172.21.15.18:0/2986762026 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1c0031600 con 0x7fc1c80d0050 2024-09-19T09:17:23.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.518+0000 7fc1c6ffd640 1 -- 172.21.15.18:0/2986762026 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1c00319d0 con 0x7fc1c80d0050 2024-09-19T09:17:23.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.518+0000 7fc1ce5d6640 1 -- 172.21.15.18:0/2986762026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1c80d0050 msgr2=0x7fc1c80cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:23.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.518+0000 7fc1ce5d6640 1 --2- 172.21.15.18:0/2986762026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1c80d0050 0x7fc1c80cdb30 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0009e50 tx=0x7fc1c002a5f0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.518+0000 7fc1ce5d6640 1 -- 172.21.15.18:0/2986762026 shutdown_connections 2024-09-19T09:17:23.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.518+0000 7fc1ce5d6640 1 --2- 172.21.15.18:0/2986762026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1c80d0050 0x7fc1c80cdb30 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.518+0000 7fc1ce5d6640 1 --2- 172.21.15.18:0/2986762026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1c80b3ce0 0x7fc1c80cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.518+0000 7fc1ce5d6640 1 -- 172.21.15.18:0/2986762026 >> 172.21.15.18:0/2986762026 conn(0x7fc1c80b4700 msgr2=0x7fc1c80b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:23.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.518+0000 7fc1ce5d6640 1 -- 172.21.15.18:0/2986762026 shutdown_connections 2024-09-19T09:17:23.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.518+0000 7fc1ce5d6640 1 -- 172.21.15.18:0/2986762026 wait complete. 2024-09-19T09:17:23.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.519+0000 7fc1ce5d6640 1 Processor -- start 2024-09-19T09:17:23.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.520+0000 7fc1ce5d6640 1 -- start start 2024-09-19T09:17:23.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.520+0000 7fc1ce5d6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1c80b3ce0 0x7fc1c815c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:23.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.520+0000 7fc1ce5d6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1c80cf560 0x7fc1c80c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:23.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.520+0000 7fc1ce5d6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1c80d0050 0x7fc1c81591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:23.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.520+0000 7fc1ce5d6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c80b55a0 con 0x7fc1c80cf560 2024-09-19T09:17:23.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.520+0000 7fc1ce5d6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc1c80b5420 con 0x7fc1c80d0050 2024-09-19T09:17:23.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.520+0000 7fc1ce5d6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc1c815d090 con 0x7fc1c80b3ce0 2024-09-19T09:17:23.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.520+0000 7fc1c77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1c80cf560 0x7fc1c80c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:23.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.520+0000 7fc1c77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1c80cf560 0x7fc1c80c6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38264/0 (socket says 172.21.15.18:38264) 2024-09-19T09:17:23.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.520+0000 7fc1c77fe640 1 -- 172.21.15.18:0/1887246300 learned_addr learned my addr 172.21.15.18:0/1887246300 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:23.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.521+0000 7fc1ccb73640 1 --2- 172.21.15.18:0/1887246300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1c80d0050 0x7fc1c81591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:23.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.521+0000 7fc1c7fff640 1 --2- 172.21.15.18:0/1887246300 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1c80b3ce0 0x7fc1c815c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:23.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.521+0000 7fc1c77fe640 1 -- 172.21.15.18:0/1887246300 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1c80b3ce0 msgr2=0x7fc1c815c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:23.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.521+0000 7fc1c77fe640 1 --2- 172.21.15.18:0/1887246300 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1c80b3ce0 0x7fc1c815c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.521+0000 7fc1c77fe640 1 -- 172.21.15.18:0/1887246300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1c80d0050 msgr2=0x7fc1c81591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:23.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.521+0000 7fc1c77fe640 1 --2- 172.21.15.18:0/1887246300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1c80d0050 0x7fc1c81591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.521+0000 7fc1c77fe640 1 -- 172.21.15.18:0/1887246300 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1c815fa40 con 0x7fc1c80cf560 2024-09-19T09:17:23.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.521+0000 7fc1ccb73640 1 --2- 172.21.15.18:0/1887246300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1c80d0050 0x7fc1c81591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:23.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.521+0000 7fc1c77fe640 1 --2- 172.21.15.18:0/1887246300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1c80cf560 0x7fc1c80c6680 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc00e810 tx=0x7fc1bc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:23.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.521+0000 7fc1c4ff9640 1 -- 172.21.15.18:0/1887246300 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc017070 con 0x7fc1c80cf560 2024-09-19T09:17:23.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.521+0000 7fc1c4ff9640 1 -- 172.21.15.18:0/1887246300 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1bc00c8d0 con 0x7fc1c80cf560 2024-09-19T09:17:23.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.521+0000 7fc1ce5d6640 1 -- 172.21.15.18:0/1887246300 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1c80b6a50 con 0x7fc1c80cf560 2024-09-19T09:17:23.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.521+0000 7fc1c4ff9640 1 -- 172.21.15.18:0/1887246300 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1bc00f040 con 0x7fc1c80cf560 2024-09-19T09:17:23.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.521+0000 7fc1ce5d6640 1 -- 172.21.15.18:0/1887246300 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1c80b7010 con 0x7fc1c80cf560 2024-09-19T09:17:23.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.522+0000 7fc1ce5d6640 1 -- 172.21.15.18:0/1887246300 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1c80cf940 con 0x7fc1c80cf560 2024-09-19T09:17:23.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.523+0000 7fc1c4ff9640 1 -- 172.21.15.18:0/1887246300 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc1bc01a070 con 0x7fc1c80cf560 2024-09-19T09:17:23.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.523+0000 7fc1c4ff9640 1 --2- 172.21.15.18:0/1887246300 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc1b406c2e0 0x7fc1b406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:23.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.523+0000 7fc1c4ff9640 1 -- 172.21.15.18:0/1887246300 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5709+0+0 (secure 0 0 0) 0x7fc1bc08b080 con 0x7fc1c80cf560 2024-09-19T09:17:23.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.523+0000 7fc1c7fff640 1 --2- 172.21.15.18:0/1887246300 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc1b406c2e0 0x7fc1b406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:23.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.524+0000 7fc1c7fff640 1 --2- 172.21.15.18:0/1887246300 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc1b406c2e0 0x7fc1b406e7a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8001640 tx=0x7fc1b8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:23.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.527+0000 7fc1c4ff9640 1 -- 172.21.15.18:0/1887246300 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc1bc059760 con 0x7fc1c80cf560 2024-09-19T09:17:23.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.706+0000 7fc1ce5d6640 1 -- 172.21.15.18:0/1887246300 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc1c80c6bc0 con 0x7fc1c80cf560 2024-09-19T09:17:23.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.707+0000 7fc1c4ff9640 1 -- 172.21.15.18:0/1887246300 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+16693 (secure 0 0 0) 0x7fc1bc059060 con 0x7fc1c80cf560 2024-09-19T09:17:23.708 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:17:23.709 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":89,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:17:22.451577+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:17:21.027574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-19T09:17:21.426866+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:17:23.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.710+0000 7fc1ce5d6640 1 -- 172.21.15.18:0/1887246300 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc1b406c2e0 msgr2=0x7fc1b406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:23.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.710+0000 7fc1ce5d6640 1 --2- 172.21.15.18:0/1887246300 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc1b406c2e0 0x7fc1b406e7a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8001640 tx=0x7fc1b8009040 comp rx=0 tx=0).stop 2024-09-19T09:17:23.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.710+0000 7fc1ce5d6640 1 -- 172.21.15.18:0/1887246300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1c80cf560 msgr2=0x7fc1c80c6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:23.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.710+0000 7fc1ce5d6640 1 --2- 172.21.15.18:0/1887246300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1c80cf560 0x7fc1c80c6680 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fc1bc00e810 tx=0x7fc1bc00ecd0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.710+0000 7fc1ce5d6640 1 -- 172.21.15.18:0/1887246300 shutdown_connections 2024-09-19T09:17:23.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.710+0000 7fc1ce5d6640 1 --2- 172.21.15.18:0/1887246300 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc1b406c2e0 0x7fc1b406e7a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.710+0000 7fc1ce5d6640 1 --2- 172.21.15.18:0/1887246300 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc1c80d0050 0x7fc1c81591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.710+0000 7fc1ce5d6640 1 --2- 172.21.15.18:0/1887246300 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc1c80cf560 0x7fc1c80c6680 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.710+0000 7fc1ce5d6640 1 --2- 172.21.15.18:0/1887246300 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc1c80b3ce0 0x7fc1c815c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.710+0000 7fc1ce5d6640 1 -- 172.21.15.18:0/1887246300 >> 172.21.15.18:0/1887246300 conn(0x7fc1c80b4700 msgr2=0x7fc1c80d2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:23.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.710+0000 7fc1ce5d6640 1 -- 172.21.15.18:0/1887246300 shutdown_connections 2024-09-19T09:17:23.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.710+0000 7fc1ce5d6640 1 -- 172.21.15.18:0/1887246300 wait complete. 2024-09-19T09:17:23.722 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-19T09:17:23.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.827+0000 7fe431442640 1 Processor -- start 2024-09-19T09:17:23.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.827+0000 7fe431442640 1 -- start start 2024-09-19T09:17:23.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.827+0000 7fe431442640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe42c15c670 0x7fe42c0b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:23.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.827+0000 7fe431442640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe42c0b6a60 con 0x7fe42c15f1a0 2024-09-19T09:17:23.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.827+0000 7fe431442640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe42c0b6d40 con 0x7fe42c06deb0 2024-09-19T09:17:23.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.827+0000 7fe431442640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe42c0b7020 con 0x7fe42c15c670 2024-09-19T09:17:23.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.828+0000 7fe42a7fc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe42c15f1a0 0x7fe42c06d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49574/0 (socket says 172.21.15.18:49574) 2024-09-19T09:17:23.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.828+0000 7fe42a7fc640 1 -- 172.21.15.18:0/3887566508 learned_addr learned my addr 172.21.15.18:0/3887566508 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:17:23.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.828+0000 7fe42affd640 1 --2- 172.21.15.18:0/3887566508 >> v2:172.21.15.162:3300/0 conn(0x7fe42c15c670 0x7fe42c0b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:23.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.828+0000 7fe429ffb640 1 -- 172.21.15.18:0/3887566508 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3649115618 0 0) 0x7fe42c0b6a60 con 0x7fe42c15f1a0 2024-09-19T09:17:23.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.828+0000 7fe429ffb640 1 -- 172.21.15.18:0/3887566508 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe414003520 con 0x7fe42c15f1a0 2024-09-19T09:17:23.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.828+0000 7fe429ffb640 1 -- 172.21.15.18:0/3887566508 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1575848132 0 0) 0x7fe414003520 con 0x7fe42c15f1a0 2024-09-19T09:17:23.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.828+0000 7fe429ffb640 1 -- 172.21.15.18:0/3887566508 >> v2:172.21.15.162:3300/0 conn(0x7fe42c15c670 msgr2=0x7fe42c0b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:23.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.828+0000 7fe429ffb640 1 --2- 172.21.15.18:0/3887566508 >> v2:172.21.15.162:3300/0 conn(0x7fe42c15c670 0x7fe42c0b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.828+0000 7fe429ffb640 1 -- 172.21.15.18:0/3887566508 >> v1:172.21.15.162:6789/0 conn(0x7fe42c06deb0 legacy=0x7fe42c160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:23.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.828+0000 7fe429ffb640 1 -- 172.21.15.18:0/3887566508 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42c0b7300 con 0x7fe42c15f1a0 2024-09-19T09:17:23.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.828+0000 7fe429ffb640 1 -- 172.21.15.18:0/3887566508 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fe420001670 con 0x7fe42c15f1a0 2024-09-19T09:17:23.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.828+0000 7fe429ffb640 1 -- 172.21.15.18:0/3887566508 >> v1:172.21.15.18:6789/0 conn(0x7fe42c15f1a0 legacy=0x7fe42c06d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:23.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.828+0000 7fe429ffb640 1 --2- 172.21.15.18:0/3887566508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4140039b0 0x7fe414003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:23.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.828+0000 7fe429ffb640 1 --2- 172.21.15.18:0/3887566508 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe414004800 0x7fe414004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:23.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.828+0000 7fe429ffb640 1 --2- 172.21.15.18:0/3887566508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4140051c0 0x7fe41400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:23.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.828+0000 7fe429ffb640 1 -- 172.21.15.18:0/3887566508 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c0b7020 con 0x7fe414004800 2024-09-19T09:17:23.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.828+0000 7fe429ffb640 1 -- 172.21.15.18:0/3887566508 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe414014870 con 0x7fe4140051c0 2024-09-19T09:17:23.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.828+0000 7fe429ffb640 1 -- 172.21.15.18:0/3887566508 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe414014a70 con 0x7fe4140039b0 2024-09-19T09:17:23.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.828+0000 7fe42a7fc640 1 --2- 172.21.15.18:0/3887566508 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe414004800 0x7fe414004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:23.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.828+0000 7fe42affd640 1 --2- 172.21.15.18:0/3887566508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4140039b0 0x7fe414003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:23.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.829+0000 7fe42b7fe640 1 --2- 172.21.15.18:0/3887566508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4140051c0 0x7fe41400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:23.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.829+0000 7fe42a7fc640 1 -- 172.21.15.18:0/3887566508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4140039b0 msgr2=0x7fe414003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:23.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.829+0000 7fe42a7fc640 1 --2- 172.21.15.18:0/3887566508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe4140039b0 0x7fe414003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.829+0000 7fe42a7fc640 1 -- 172.21.15.18:0/3887566508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4140051c0 msgr2=0x7fe41400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:23.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.829+0000 7fe42a7fc640 1 --2- 172.21.15.18:0/3887566508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe4140051c0 0x7fe41400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.829+0000 7fe42a7fc640 1 -- 172.21.15.18:0/3887566508 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe414003520 con 0x7fe414004800 2024-09-19T09:17:23.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.829+0000 7fe42b7fe640 1 -- 172.21.15.18:0/3887566508 reap_dead start 2024-09-19T09:17:23.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.829+0000 7fe42a7fc640 1 --2- 172.21.15.18:0/3887566508 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe414004800 0x7fe414004c80 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fe42000c210 tx=0x7fe414005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2082b3b5c7be779c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:23.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.830+0000 7fe429ffb640 1 -- 172.21.15.18:0/3887566508 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe420007d30 con 0x7fe414004800 2024-09-19T09:17:23.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.830+0000 7fe429ffb640 1 -- 172.21.15.18:0/3887566508 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe420005ad0 con 0x7fe414004800 2024-09-19T09:17:23.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.830+0000 7fe429ffb640 1 -- 172.21.15.18:0/3887566508 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe420007070 con 0x7fe414004800 2024-09-19T09:17:23.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.830+0000 7fe431442640 1 -- 172.21.15.18:0/3887566508 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe414004800 msgr2=0x7fe414004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:23.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.830+0000 7fe431442640 1 --2- 172.21.15.18:0/3887566508 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe414004800 0x7fe414004c80 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fe42000c210 tx=0x7fe414005830 comp rx=0 tx=0).stop 2024-09-19T09:17:23.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.830+0000 7fe431442640 1 -- 172.21.15.18:0/3887566508 shutdown_connections 2024-09-19T09:17:23.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.830+0000 7fe431442640 1 --2- 172.21.15.18:0/3887566508 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe414004800 0x7fe414004c80 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.830+0000 7fe431442640 1 -- 172.21.15.18:0/3887566508 >> 172.21.15.18:0/3887566508 conn(0x7fe42c09b9d0 msgr2=0x7fe42c09bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:23.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.830+0000 7fe431442640 1 -- 172.21.15.18:0/3887566508 shutdown_connections 2024-09-19T09:17:23.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.830+0000 7fe431442640 1 -- 172.21.15.18:0/3887566508 wait complete. 2024-09-19T09:17:23.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.832+0000 7fe431442640 1 Processor -- start 2024-09-19T09:17:23.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.832+0000 7fe431442640 1 -- start start 2024-09-19T09:17:23.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.832+0000 7fe431442640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe414004800 0x7fe42c0cf250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:23.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.832+0000 7fe431442640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe42c159410 0x7fe42c159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:23.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.832+0000 7fe431442640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe42c15a1a0 0x7fe42c1606c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:23.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.832+0000 7fe431442640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c0b7b00 con 0x7fe42c15a1a0 2024-09-19T09:17:23.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.832+0000 7fe431442640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe42c09c560 con 0x7fe42c159410 2024-09-19T09:17:23.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.832+0000 7fe431442640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe42c0b1460 con 0x7fe414004800 2024-09-19T09:17:23.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.833+0000 7fe42b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe42c15a1a0 0x7fe42c1606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:23.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.833+0000 7fe42b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe42c15a1a0 0x7fe42c1606c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38276/0 (socket says 172.21.15.18:38276) 2024-09-19T09:17:23.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.833+0000 7fe42b7fe640 1 -- 172.21.15.18:0/1594023562 learned_addr learned my addr 172.21.15.18:0/1594023562 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:23.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.833+0000 7fe42affd640 1 --2- 172.21.15.18:0/1594023562 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe414004800 0x7fe42c0cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:23.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.833+0000 7fe42a7fc640 1 --2- 172.21.15.18:0/1594023562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe42c159410 0x7fe42c159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:23.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.833+0000 7fe42b7fe640 1 -- 172.21.15.18:0/1594023562 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe414004800 msgr2=0x7fe42c0cf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:23.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.833+0000 7fe42b7fe640 1 --2- 172.21.15.18:0/1594023562 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe414004800 0x7fe42c0cf250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.833+0000 7fe42b7fe640 1 -- 172.21.15.18:0/1594023562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe42c159410 msgr2=0x7fe42c159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:23.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.833+0000 7fe42b7fe640 1 --2- 172.21.15.18:0/1594023562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe42c159410 0x7fe42c159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:23.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.833+0000 7fe42b7fe640 1 -- 172.21.15.18:0/1594023562 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe42c09f7f0 con 0x7fe42c15a1a0 2024-09-19T09:17:23.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.833+0000 7fe42affd640 1 --2- 172.21.15.18:0/1594023562 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe414004800 0x7fe42c0cf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:17:23.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.833+0000 7fe42b7fe640 1 --2- 172.21.15.18:0/1594023562 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe42c15a1a0 0x7fe42c1606c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fe424007fd0 tx=0x7fe42400e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:23.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.833+0000 7fe4137fe640 1 -- 172.21.15.18:0/1594023562 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe424019070 con 0x7fe42c15a1a0 2024-09-19T09:17:23.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.833+0000 7fe4137fe640 1 -- 172.21.15.18:0/1594023562 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe424006d60 con 0x7fe42c15a1a0 2024-09-19T09:17:23.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.833+0000 7fe431442640 1 -- 172.21.15.18:0/1594023562 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe42c0a0460 con 0x7fe42c15a1a0 2024-09-19T09:17:23.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.833+0000 7fe4137fe640 1 -- 172.21.15.18:0/1594023562 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe424003b90 con 0x7fe42c15a1a0 2024-09-19T09:17:23.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.833+0000 7fe431442640 1 -- 172.21.15.18:0/1594023562 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe42c09f480 con 0x7fe42c15a1a0 2024-09-19T09:17:23.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.834+0000 7fe431442640 1 -- 172.21.15.18:0/1594023562 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe42c0b6660 con 0x7fe42c15a1a0 2024-09-19T09:17:23.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.835+0000 7fe4137fe640 1 -- 172.21.15.18:0/1594023562 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe42401c070 con 0x7fe42c15a1a0 2024-09-19T09:17:23.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.835+0000 7fe4137fe640 1 --2- 172.21.15.18:0/1594023562 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe41806c2b0 0x7fe41806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:23.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.835+0000 7fe4137fe640 1 -- 172.21.15.18:0/1594023562 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 5709+0+0 (secure 0 0 0) 0x7fe42408a950 con 0x7fe42c15a1a0 2024-09-19T09:17:23.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.836+0000 7fe42affd640 1 --2- 172.21.15.18:0/1594023562 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe41806c2b0 0x7fe41806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:23.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.836+0000 7fe42affd640 1 --2- 172.21.15.18:0/1594023562 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe41806c2b0 0x7fe41806e770 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe41c014400 tx=0x7fe41c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:23.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:23.839+0000 7fe4137fe640 1 -- 172.21.15.18:0/1594023562 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe4240589d0 con 0x7fe42c15a1a0 2024-09-19T09:17:24.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.051+0000 7fe431442640 1 -- 172.21.15.18:0/1594023562 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe42c0755b0 con 0x7fe42c15a1a0 2024-09-19T09:17:24.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.094+0000 7fe4137fe640 1 -- 172.21.15.18:0/1594023562 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v34) ==== 118+0+0 (secure 0 0 0) 0x7fe42405ccd0 con 0x7fe42c15a1a0 2024-09-19T09:17:24.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.096+0000 7fe431442640 1 -- 172.21.15.18:0/1594023562 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe41806c2b0 msgr2=0x7fe41806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:24.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.096+0000 7fe431442640 1 --2- 172.21.15.18:0/1594023562 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe41806c2b0 0x7fe41806e770 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe41c014400 tx=0x7fe41c009190 comp rx=0 tx=0).stop 2024-09-19T09:17:24.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.096+0000 7fe431442640 1 -- 172.21.15.18:0/1594023562 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe42c15a1a0 msgr2=0x7fe42c1606c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:24.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.096+0000 7fe431442640 1 --2- 172.21.15.18:0/1594023562 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe42c15a1a0 0x7fe42c1606c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fe424007fd0 tx=0x7fe42400e8a0 comp rx=0 tx=0).stop 2024-09-19T09:17:24.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.096+0000 7fe431442640 1 -- 172.21.15.18:0/1594023562 shutdown_connections 2024-09-19T09:17:24.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.096+0000 7fe431442640 1 --2- 172.21.15.18:0/1594023562 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe41806c2b0 0x7fe41806e770 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:24.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.096+0000 7fe431442640 1 --2- 172.21.15.18:0/1594023562 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe42c15a1a0 0x7fe42c1606c0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:24.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.096+0000 7fe431442640 1 --2- 172.21.15.18:0/1594023562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe42c159410 0x7fe42c159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:24.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.096+0000 7fe431442640 1 --2- 172.21.15.18:0/1594023562 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe414004800 0x7fe42c0cf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:24.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.096+0000 7fe431442640 1 -- 172.21.15.18:0/1594023562 >> 172.21.15.18:0/1594023562 conn(0x7fe42c09b9d0 msgr2=0x7fe42c15e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:24.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.096+0000 7fe431442640 1 -- 172.21.15.18:0/1594023562 shutdown_connections 2024-09-19T09:17:24.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.096+0000 7fe431442640 1 -- 172.21.15.18:0/1594023562 wait complete. 2024-09-19T09:17:24.147 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-19T09:17:24.147 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-19T09:17:24.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.259+0000 7f1d44baf640 1 Processor -- start 2024-09-19T09:17:24.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.259+0000 7f1d44baf640 1 -- start start 2024-09-19T09:17:24.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.259+0000 7f1d44baf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d4015c670 0x7f1d400b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:24.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.260+0000 7f1d44baf640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1d4015f1a0 0x7f1d4006d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:24.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.260+0000 7f1d44baf640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1d4006dce0 0x7f1d401627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:24.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.260+0000 7f1d44baf640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f1d4006e150 con 0x7f1d4015f1a0 2024-09-19T09:17:24.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.260+0000 7f1d44baf640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f1d4015f5e0 con 0x7f1d4006dce0 2024-09-19T09:17:24.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.260+0000 7f1d44baf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1d400b6a60 con 0x7f1d4015c670 2024-09-19T09:17:24.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.260+0000 7f1d3dd9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1d4015f1a0 0x7f1d4006d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:24.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.260+0000 7f1d3dd9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1d4015f1a0 0x7f1d4006d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38290/0 (socket says 172.21.15.18:38290) 2024-09-19T09:17:24.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.260+0000 7f1d3dd9b640 1 -- 172.21.15.18:0/1091963098 learned_addr learned my addr 172.21.15.18:0/1091963098 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:24.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.260+0000 7f1d3e59c640 1 --2- 172.21.15.18:0/1091963098 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d4015c670 0x7f1d400b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:24.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.260+0000 7f1d3ed9d640 1 --2- 172.21.15.18:0/1091963098 >> v2:172.21.15.162:3300/0 conn(0x7f1d4006dce0 0x7f1d401627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:24.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.260+0000 7f1d3dd9b640 1 -- 172.21.15.18:0/1091963098 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d4015c670 msgr2=0x7f1d400b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:24.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.260+0000 7f1d3dd9b640 1 --2- 172.21.15.18:0/1091963098 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d4015c670 0x7f1d400b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:24.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.260+0000 7f1d3dd9b640 1 -- 172.21.15.18:0/1091963098 >> v2:172.21.15.162:3300/0 conn(0x7f1d4006dce0 msgr2=0x7f1d401627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:24.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.260+0000 7f1d3dd9b640 1 --2- 172.21.15.18:0/1091963098 >> v2:172.21.15.162:3300/0 conn(0x7f1d4006dce0 0x7f1d401627e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:24.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.260+0000 7f1d3dd9b640 1 -- 172.21.15.18:0/1091963098 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d400b6d40 con 0x7f1d4015f1a0 2024-09-19T09:17:24.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.261+0000 7f1d3dd9b640 1 --2- 172.21.15.18:0/1091963098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d4015f1a0 0x7f1d4006d7a0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1d40162720 tx=0x7f1d3402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea05584a61bd6738 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:24.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.261+0000 7f1d3d59a640 1 -- 172.21.15.18:0/1091963098 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d34037070 con 0x7f1d4015f1a0 2024-09-19T09:17:24.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.261+0000 7f1d3d59a640 1 -- 172.21.15.18:0/1091963098 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d34032440 con 0x7f1d4015f1a0 2024-09-19T09:17:24.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.261+0000 7f1d3d59a640 1 -- 172.21.15.18:0/1091963098 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d34032810 con 0x7f1d4015f1a0 2024-09-19T09:17:24.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.261+0000 7f1d44baf640 1 -- 172.21.15.18:0/1091963098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d4015f1a0 msgr2=0x7f1d4006d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:24.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.261+0000 7f1d44baf640 1 --2- 172.21.15.18:0/1091963098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d4015f1a0 0x7f1d4006d7a0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1d40162720 tx=0x7f1d3402a1e0 comp rx=0 tx=0).stop 2024-09-19T09:17:24.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.262+0000 7f1d44baf640 1 -- 172.21.15.18:0/1091963098 shutdown_connections 2024-09-19T09:17:24.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.262+0000 7f1d44baf640 1 --2- 172.21.15.18:0/1091963098 >> v2:172.21.15.162:3300/0 conn(0x7f1d4006dce0 0x7f1d401627e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:24.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.262+0000 7f1d44baf640 1 --2- 172.21.15.18:0/1091963098 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d4015f1a0 0x7f1d4006d7a0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:24.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.262+0000 7f1d44baf640 1 --2- 172.21.15.18:0/1091963098 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d4015c670 0x7f1d400b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:24.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.262+0000 7f1d44baf640 1 -- 172.21.15.18:0/1091963098 >> 172.21.15.18:0/1091963098 conn(0x7f1d4009b9d0 msgr2=0x7f1d4009bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:24.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.262+0000 7f1d44baf640 1 -- 172.21.15.18:0/1091963098 shutdown_connections 2024-09-19T09:17:24.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.262+0000 7f1d44baf640 1 -- 172.21.15.18:0/1091963098 wait complete. 2024-09-19T09:17:24.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.263+0000 7f1d44baf640 1 Processor -- start 2024-09-19T09:17:24.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.263+0000 7f1d44baf640 1 -- start start 2024-09-19T09:17:24.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.264+0000 7f1d44baf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d4006dce0 0x7f1d40154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:24.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.264+0000 7f1d44baf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d4015c670 0x7f1d40156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:24.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.264+0000 7f1d44baf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d4015f1a0 0x7f1d4015aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:24.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.264+0000 7f1d44baf640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1d400b75e0 con 0x7f1d4015f1a0 2024-09-19T09:17:24.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.264+0000 7f1d44baf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1d400b7300 con 0x7f1d4015c670 2024-09-19T09:17:24.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.264+0000 7f1d44baf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1d4009c560 con 0x7f1d4006dce0 2024-09-19T09:17:24.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.264+0000 7f1d3ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d4015f1a0 0x7f1d4015aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:24.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.264+0000 7f1d3ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d4015f1a0 0x7f1d4015aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38296/0 (socket says 172.21.15.18:38296) 2024-09-19T09:17:24.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.264+0000 7f1d3ed9d640 1 -- 172.21.15.18:0/4151780447 learned_addr learned my addr 172.21.15.18:0/4151780447 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:24.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.264+0000 7f1d3e59c640 1 --2- 172.21.15.18:0/4151780447 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d4006dce0 0x7f1d40154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:24.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.264+0000 7f1d3dd9b640 1 --2- 172.21.15.18:0/4151780447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d4015c670 0x7f1d40156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:24.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.264+0000 7f1d3ed9d640 1 -- 172.21.15.18:0/4151780447 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d4006dce0 msgr2=0x7f1d40154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:24.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.264+0000 7f1d3ed9d640 1 --2- 172.21.15.18:0/4151780447 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d4006dce0 0x7f1d40154200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:24.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.264+0000 7f1d3ed9d640 1 -- 172.21.15.18:0/4151780447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d4015c670 msgr2=0x7f1d40156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:24.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.264+0000 7f1d3ed9d640 1 --2- 172.21.15.18:0/4151780447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d4015c670 0x7f1d40156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:24.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.264+0000 7f1d3ed9d640 1 -- 172.21.15.18:0/4151780447 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d40146050 con 0x7f1d4015f1a0 2024-09-19T09:17:24.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.264+0000 7f1d3ed9d640 1 --2- 172.21.15.18:0/4151780447 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d4015f1a0 0x7f1d4015aee0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1d38007e60 tx=0x7f1d3800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:24.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.264+0000 7f1d2effd640 1 -- 172.21.15.18:0/4151780447 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d38014620 con 0x7f1d4015f1a0 2024-09-19T09:17:24.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.264+0000 7f1d2effd640 1 -- 172.21.15.18:0/4151780447 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d38019070 con 0x7f1d4015f1a0 2024-09-19T09:17:24.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.264+0000 7f1d44baf640 1 -- 172.21.15.18:0/4151780447 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d40146330 con 0x7f1d4015f1a0 2024-09-19T09:17:24.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.264+0000 7f1d2effd640 1 -- 172.21.15.18:0/4151780447 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d38014a20 con 0x7f1d4015f1a0 2024-09-19T09:17:24.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.265+0000 7f1d44baf640 1 -- 172.21.15.18:0/4151780447 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d40156200 con 0x7f1d4015f1a0 2024-09-19T09:17:24.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.265+0000 7f1d44baf640 1 -- 172.21.15.18:0/4151780447 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d400b7b00 con 0x7f1d4015f1a0 2024-09-19T09:17:24.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.266+0000 7f1d2effd640 1 -- 172.21.15.18:0/4151780447 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1d38014bc0 con 0x7f1d4015f1a0 2024-09-19T09:17:24.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.266+0000 7f1d2effd640 1 --2- 172.21.15.18:0/4151780447 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1d2006c2b0 0x7f1d2006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:24.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.267+0000 7f1d2effd640 1 -- 172.21.15.18:0/4151780447 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5709+0+0 (secure 0 0 0) 0x7f1d3808bad0 con 0x7f1d4015f1a0 2024-09-19T09:17:24.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.267+0000 7f1d3e59c640 1 --2- 172.21.15.18:0/4151780447 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1d2006c2b0 0x7f1d2006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:24.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.267+0000 7f1d3e59c640 1 --2- 172.21.15.18:0/4151780447 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1d2006c2b0 0x7f1d2006e770 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1d30006fd0 tx=0x7f1d30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:24.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.271+0000 7f1d2effd640 1 -- 172.21.15.18:0/4151780447 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1d38059c80 con 0x7f1d4015f1a0 2024-09-19T09:17:24.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:24.481+0000 7f1d44baf640 1 -- 172.21.15.18:0/4151780447 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f1d40070400 con 0x7f1d4015f1a0 2024-09-19T09:17:25.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.095+0000 7f1d2effd640 1 -- 172.21.15.18:0/4151780447 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v35) ==== 122+0+0 (secure 0 0 0) 0x7f1d3805df80 con 0x7f1d4015f1a0 2024-09-19T09:17:25.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.098+0000 7f1d44baf640 1 -- 172.21.15.18:0/4151780447 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1d2006c2b0 msgr2=0x7f1d2006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:25.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.098+0000 7f1d44baf640 1 --2- 172.21.15.18:0/4151780447 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1d2006c2b0 0x7f1d2006e770 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1d30006fd0 tx=0x7f1d30008040 comp rx=0 tx=0).stop 2024-09-19T09:17:25.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.098+0000 7f1d44baf640 1 -- 172.21.15.18:0/4151780447 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d4015f1a0 msgr2=0x7f1d4015aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:25.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.098+0000 7f1d44baf640 1 --2- 172.21.15.18:0/4151780447 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d4015f1a0 0x7f1d4015aee0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1d38007e60 tx=0x7f1d3800e4b0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.098+0000 7f1d44baf640 1 -- 172.21.15.18:0/4151780447 shutdown_connections 2024-09-19T09:17:25.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.098+0000 7f1d44baf640 1 --2- 172.21.15.18:0/4151780447 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1d2006c2b0 0x7f1d2006e770 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.098+0000 7f1d44baf640 1 --2- 172.21.15.18:0/4151780447 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1d4015f1a0 0x7f1d4015aee0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.098+0000 7f1d44baf640 1 --2- 172.21.15.18:0/4151780447 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d4015c670 0x7f1d40156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.098+0000 7f1d44baf640 1 --2- 172.21.15.18:0/4151780447 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1d4006dce0 0x7f1d40154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.098+0000 7f1d44baf640 1 -- 172.21.15.18:0/4151780447 >> 172.21.15.18:0/4151780447 conn(0x7f1d4009b9d0 msgr2=0x7f1d40160ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:25.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.098+0000 7f1d44baf640 1 -- 172.21.15.18:0/4151780447 shutdown_connections 2024-09-19T09:17:25.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.098+0000 7f1d44baf640 1 -- 172.21.15.18:0/4151780447 wait complete. 2024-09-19T09:17:25.111 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-19T09:17:25.111 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:17:25.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.216+0000 7f8af5d4b640 1 Processor -- start 2024-09-19T09:17:25.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.216+0000 7f8af5d4b640 1 -- start start 2024-09-19T09:17:25.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.217+0000 7f8af5d4b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8af015ef80 0x7f8af00b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:25.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.217+0000 7f8af5d4b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8af00cfae0 0x7f8af00cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:25.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.217+0000 7f8af5d4b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8af00cd1a0 con 0x7f8af006d730 2024-09-19T09:17:25.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.217+0000 7f8af5d4b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8af00cd7d0 con 0x7f8af00cfae0 2024-09-19T09:17:25.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.217+0000 7f8af5d4b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8af006dc30 con 0x7f8af015ef80 2024-09-19T09:17:25.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.218+0000 7f8aef7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8af015ef80 0x7f8af00b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:25.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.218+0000 7f8aeffff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8af00cfae0 0x7f8af00cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:25.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.218+0000 7f8aeeffd640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f8af006d730 0x7f8af00cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:54422/0 (socket says 172.21.15.18:54422) 2024-09-19T09:17:25.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.218+0000 7f8aef7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8af015ef80 0x7f8af00b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:44614/0 (socket says 172.21.15.18:44614) 2024-09-19T09:17:25.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.218+0000 7f8aeeffd640 1 -- 172.21.15.18:0/2173638255 learned_addr learned my addr 172.21.15.18:0/2173638255 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:17:25.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.218+0000 7f8aeffff640 1 -- 172.21.15.18:0/2173638255 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8af015ef80 msgr2=0x7f8af00b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:25.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.218+0000 7f8aeffff640 1 --2- 172.21.15.18:0/2173638255 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8af015ef80 0x7f8af00b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.218+0000 7f8aeffff640 1 -- 172.21.15.18:0/2173638255 >> v1:172.21.15.162:6789/0 conn(0x7f8af006d730 legacy=0x7f8af00cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:25.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.218+0000 7f8aeffff640 1 -- 172.21.15.18:0/2173638255 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af006df10 con 0x7f8af00cfae0 2024-09-19T09:17:25.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.218+0000 7f8aef7fe640 1 --2- 172.21.15.18:0/2173638255 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8af015ef80 0x7f8af00b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:17:25.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.219+0000 7f8aeffff640 1 --2- 172.21.15.18:0/2173638255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8af00cfae0 0x7f8af00cdc60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8009d90 tx=0x7f8ae802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=896a2e678e72b8ea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:25.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.219+0000 7f8aee7fc640 1 -- 172.21.15.18:0/2173638255 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8007740 con 0x7f8af00cfae0 2024-09-19T09:17:25.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.219+0000 7f8aee7fc640 1 -- 172.21.15.18:0/2173638255 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ae80078e0 con 0x7f8af00cfae0 2024-09-19T09:17:25.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.219+0000 7f8aee7fc640 1 -- 172.21.15.18:0/2173638255 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae8007cb0 con 0x7f8af00cfae0 2024-09-19T09:17:25.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.219+0000 7f8af5d4b640 1 -- 172.21.15.18:0/2173638255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8af00cfae0 msgr2=0x7f8af00cdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:25.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.219+0000 7f8af5d4b640 1 --2- 172.21.15.18:0/2173638255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8af00cfae0 0x7f8af00cdc60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8ae8009d90 tx=0x7f8ae802a660 comp rx=0 tx=0).stop 2024-09-19T09:17:25.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.220+0000 7f8af5d4b640 1 -- 172.21.15.18:0/2173638255 shutdown_connections 2024-09-19T09:17:25.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.220+0000 7f8af5d4b640 1 --2- 172.21.15.18:0/2173638255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8af00cfae0 0x7f8af00cdc60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.220+0000 7f8af5d4b640 1 --2- 172.21.15.18:0/2173638255 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8af015ef80 0x7f8af00b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.220+0000 7f8af5d4b640 1 -- 172.21.15.18:0/2173638255 >> 172.21.15.18:0/2173638255 conn(0x7f8af00b4700 msgr2=0x7f8af00b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:25.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.220+0000 7f8af5d4b640 1 -- 172.21.15.18:0/2173638255 shutdown_connections 2024-09-19T09:17:25.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.220+0000 7f8af5d4b640 1 -- 172.21.15.18:0/2173638255 wait complete. 2024-09-19T09:17:25.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.221+0000 7f8af5d4b640 1 Processor -- start 2024-09-19T09:17:25.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.221+0000 7f8af5d4b640 1 -- start start 2024-09-19T09:17:25.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.222+0000 7f8af5d4b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8af006d730 0x7f8af0154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:25.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.222+0000 7f8af5d4b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8af00cfae0 0x7f8af01e8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:25.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.222+0000 7f8af5d4b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8af015ef80 0x7f8af00b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:25.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.222+0000 7f8af5d4b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8af00d0120 con 0x7f8af00cfae0 2024-09-19T09:17:25.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.222+0000 7f8af5d4b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8af015f360 con 0x7f8af015ef80 2024-09-19T09:17:25.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.222+0000 7f8af5d4b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8af00ce1a0 con 0x7f8af006d730 2024-09-19T09:17:25.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.222+0000 7f8aeeffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8af00cfae0 0x7f8af01e8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:25.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.222+0000 7f8aeeffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8af00cfae0 0x7f8af01e8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38302/0 (socket says 172.21.15.18:38302) 2024-09-19T09:17:25.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.222+0000 7f8aeeffd640 1 -- 172.21.15.18:0/3159147869 learned_addr learned my addr 172.21.15.18:0/3159147869 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:25.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.222+0000 7f8aef7fe640 1 --2- 172.21.15.18:0/3159147869 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8af006d730 0x7f8af0154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:25.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.222+0000 7f8aeffff640 1 --2- 172.21.15.18:0/3159147869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8af015ef80 0x7f8af00b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:25.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.222+0000 7f8aeeffd640 1 -- 172.21.15.18:0/3159147869 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8af006d730 msgr2=0x7f8af0154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:25.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.222+0000 7f8aeeffd640 1 --2- 172.21.15.18:0/3159147869 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8af006d730 0x7f8af0154c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.222+0000 7f8aeeffd640 1 -- 172.21.15.18:0/3159147869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8af015ef80 msgr2=0x7f8af00b5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:25.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.222+0000 7f8aeeffd640 1 --2- 172.21.15.18:0/3159147869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8af015ef80 0x7f8af00b5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.222+0000 7f8aeeffd640 1 -- 172.21.15.18:0/3159147869 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af01e9980 con 0x7f8af00cfae0 2024-09-19T09:17:25.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.222+0000 7f8aeeffd640 1 --2- 172.21.15.18:0/3159147869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8af00cfae0 0x7f8af01e8fe0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400c3a0 tx=0x7f8ae400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:25.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.222+0000 7f8ad7fff640 1 -- 172.21.15.18:0/3159147869 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4017070 con 0x7f8af00cfae0 2024-09-19T09:17:25.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.223+0000 7f8ad7fff640 1 -- 172.21.15.18:0/3159147869 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ae4005ce0 con 0x7f8af00cfae0 2024-09-19T09:17:25.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.223+0000 7f8af5d4b640 1 -- 172.21.15.18:0/3159147869 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8af00c6ed0 con 0x7f8af00cfae0 2024-09-19T09:17:25.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.223+0000 7f8ad7fff640 1 -- 172.21.15.18:0/3159147869 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4007310 con 0x7f8af00cfae0 2024-09-19T09:17:25.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.223+0000 7f8af5d4b640 1 -- 172.21.15.18:0/3159147869 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8af01e9520 con 0x7f8af00cfae0 2024-09-19T09:17:25.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.224+0000 7f8af5d4b640 1 -- 172.21.15.18:0/3159147869 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8af00cdc60 con 0x7f8af00cfae0 2024-09-19T09:17:25.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.224+0000 7f8ad7fff640 1 -- 172.21.15.18:0/3159147869 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8ae401a070 con 0x7f8af00cfae0 2024-09-19T09:17:25.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.224+0000 7f8ad7fff640 1 --2- 172.21.15.18:0/3159147869 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8adc06c2b0 0x7f8adc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:25.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.225+0000 7f8ad7fff640 1 -- 172.21.15.18:0/3159147869 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5709+0+0 (secure 0 0 0) 0x7f8ae408a7e0 con 0x7f8af00cfae0 2024-09-19T09:17:25.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.225+0000 7f8aef7fe640 1 --2- 172.21.15.18:0/3159147869 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8adc06c2b0 0x7f8adc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:25.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.225+0000 7f8aef7fe640 1 --2- 172.21.15.18:0/3159147869 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8adc06c2b0 0x7f8adc06e770 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8af01f8160 tx=0x7f8ae0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:25.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.229+0000 7f8ad7fff640 1 -- 172.21.15.18:0/3159147869 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8ae4058860 con 0x7f8af00cfae0 2024-09-19T09:17:25.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.438+0000 7f8af5d4b640 1 -- 172.21.15.18:0/3159147869 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8af00cff00 con 0x7f8af00cfae0 2024-09-19T09:17:25.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.439+0000 7f8ad7fff640 1 -- 172.21.15.18:0/3159147869 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5228 (secure 0 0 0) 0x7f8ae405cb60 con 0x7f8af00cfae0 2024-09-19T09:17:25.440 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:17:25.440 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":35,"btime":"2024-09-19T09:17:25:094931+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1906118343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1906118343},{"type":"v1","addr":"172.21.15.162:6837","nonce":1906118343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1051418414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1051418414},{"type":"v1","addr":"172.21.15.162:6835","nonce":1051418414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5892,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1630984812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630984812},{"type":"v1","addr":"172.21.15.18:6834","nonce":1630984812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:17:22.451890+0000","modified":"2024-09-19T09:17:24.482665+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5895},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5895":{"gid":5895,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/905153716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":905153716},{"type":"v1","addr":"172.21.15.18:6835","nonce":905153716}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5895,"qdb_cluster":[5895]},"id":5}]} 2024-09-19T09:17:25.440 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 35 2024-09-19T09:17:25.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.441+0000 7f8af5d4b640 1 -- 172.21.15.18:0/3159147869 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8adc06c2b0 msgr2=0x7f8adc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:25.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.441+0000 7f8af5d4b640 1 --2- 172.21.15.18:0/3159147869 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8adc06c2b0 0x7f8adc06e770 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8af01f8160 tx=0x7f8ae0009190 comp rx=0 tx=0).stop 2024-09-19T09:17:25.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.441+0000 7f8af5d4b640 1 -- 172.21.15.18:0/3159147869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8af00cfae0 msgr2=0x7f8af01e8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:25.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.441+0000 7f8af5d4b640 1 --2- 172.21.15.18:0/3159147869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8af00cfae0 0x7f8af01e8fe0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8ae400c3a0 tx=0x7f8ae400c860 comp rx=0 tx=0).stop 2024-09-19T09:17:25.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.441+0000 7f8af5d4b640 1 -- 172.21.15.18:0/3159147869 shutdown_connections 2024-09-19T09:17:25.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.441+0000 7f8af5d4b640 1 --2- 172.21.15.18:0/3159147869 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8adc06c2b0 0x7f8adc06e770 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.441+0000 7f8af5d4b640 1 --2- 172.21.15.18:0/3159147869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8af015ef80 0x7f8af00b5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.441+0000 7f8af5d4b640 1 --2- 172.21.15.18:0/3159147869 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8af00cfae0 0x7f8af01e8fe0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.441+0000 7f8af5d4b640 1 --2- 172.21.15.18:0/3159147869 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8af006d730 0x7f8af0154c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.441+0000 7f8af5d4b640 1 -- 172.21.15.18:0/3159147869 >> 172.21.15.18:0/3159147869 conn(0x7f8af00b4700 msgr2=0x7f8af00d30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:25.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.441+0000 7f8af5d4b640 1 -- 172.21.15.18:0/3159147869 shutdown_connections 2024-09-19T09:17:25.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.441+0000 7f8af5d4b640 1 -- 172.21.15.18:0/3159147869 wait complete. 2024-09-19T09:17:25.455 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:17:25.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.556+0000 7ff0f742e640 1 Processor -- start 2024-09-19T09:17:25.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.557+0000 7ff0f742e640 1 -- start start 2024-09-19T09:17:25.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.557+0000 7ff0f742e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0f00d1ab0 0x7ff0f00b8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:25.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.557+0000 7ff0f742e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff0f00d3240 0x7ff0f00b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:25.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.557+0000 7ff0f742e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0f00b7a90 con 0x7ff0f015ef50 2024-09-19T09:17:25.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.557+0000 7ff0f742e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7ff0f00d3740 con 0x7ff0f00d3240 2024-09-19T09:17:25.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.557+0000 7ff0f742e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff0f00d3a20 con 0x7ff0f00d1ab0 2024-09-19T09:17:25.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.558+0000 7ff0f59cb640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff0f00d3240 0x7ff0f00b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:25.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.558+0000 7ff0f51ca640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff0f015ef50 0x7ff0f00d13a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:37396/0 (socket says 172.21.15.18:37396) 2024-09-19T09:17:25.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.558+0000 7ff0f51ca640 1 -- 172.21.15.18:0/3658914746 learned_addr learned my addr 172.21.15.18:0/3658914746 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:17:25.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.558+0000 7ff0f49c9640 1 --2- 172.21.15.18:0/3658914746 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0f00d1ab0 0x7ff0f00b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:25.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.558+0000 7ff0f59cb640 1 -- 172.21.15.18:0/3658914746 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0f00d1ab0 msgr2=0x7ff0f00b8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:25.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.558+0000 7ff0f59cb640 1 --2- 172.21.15.18:0/3658914746 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0f00d1ab0 0x7ff0f00b8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.558+0000 7ff0f59cb640 1 -- 172.21.15.18:0/3658914746 >> v1:172.21.15.18:6789/0 conn(0x7ff0f015ef50 legacy=0x7ff0f00d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:25.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.558+0000 7ff0e7fff640 1 -- 172.21.15.18:0/3658914746 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 401938213 0 0) 0x7ff0f00b7a90 con 0x7ff0f015ef50 2024-09-19T09:17:25.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.558+0000 7ff0f59cb640 1 -- 172.21.15.18:0/3658914746 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f00b7d00 con 0x7ff0f00d3240 2024-09-19T09:17:25.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.559+0000 7ff0f59cb640 1 --2- 172.21.15.18:0/3658914746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0f00d3240 0x7ff0f00b8a40 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8009d90 tx=0x7ff0e802a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b44feb49049517b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:25.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.559+0000 7ff0e7fff640 1 -- 172.21.15.18:0/3658914746 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8031600 con 0x7ff0f00d3240 2024-09-19T09:17:25.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.559+0000 7ff0e7fff640 1 -- 172.21.15.18:0/3658914746 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0e80317a0 con 0x7ff0f00d3240 2024-09-19T09:17:25.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.559+0000 7ff0e7fff640 1 -- 172.21.15.18:0/3658914746 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e8031b70 con 0x7ff0f00d3240 2024-09-19T09:17:25.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.559+0000 7ff0f742e640 1 -- 172.21.15.18:0/3658914746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0f00d3240 msgr2=0x7ff0f00b8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:25.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.559+0000 7ff0f742e640 1 --2- 172.21.15.18:0/3658914746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0f00d3240 0x7ff0f00b8a40 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8009d90 tx=0x7ff0e802a5d0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.559+0000 7ff0f742e640 1 -- 172.21.15.18:0/3658914746 shutdown_connections 2024-09-19T09:17:25.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.559+0000 7ff0f742e640 1 --2- 172.21.15.18:0/3658914746 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0f00d3240 0x7ff0f00b8a40 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.559+0000 7ff0f742e640 1 --2- 172.21.15.18:0/3658914746 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0f00d1ab0 0x7ff0f00b8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.559+0000 7ff0f742e640 1 -- 172.21.15.18:0/3658914746 >> 172.21.15.18:0/3658914746 conn(0x7ff0f00d4c60 msgr2=0x7ff0f00d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:25.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.559+0000 7ff0f742e640 1 -- 172.21.15.18:0/3658914746 shutdown_connections 2024-09-19T09:17:25.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.560+0000 7ff0f742e640 1 -- 172.21.15.18:0/3658914746 wait complete. 2024-09-19T09:17:25.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.561+0000 7ff0f742e640 1 Processor -- start 2024-09-19T09:17:25.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.561+0000 7ff0f742e640 1 -- start start 2024-09-19T09:17:25.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.561+0000 7ff0f742e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0f00d1ab0 0x7ff0f0159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:25.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.561+0000 7ff0f742e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0f00d3240 0x7ff0f0156980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:25.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.561+0000 7ff0f742e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0f015ef50 0x7ff0f00ba0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:25.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.561+0000 7ff0f742e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f00d21a0 con 0x7ff0f00d3240 2024-09-19T09:17:25.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.561+0000 7ff0f742e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f00d2020 con 0x7ff0f015ef50 2024-09-19T09:17:25.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.561+0000 7ff0f742e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff0f00d5780 con 0x7ff0f00d1ab0 2024-09-19T09:17:25.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.562+0000 7ff0f49c9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0f00d3240 0x7ff0f0156980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:25.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.562+0000 7ff0f49c9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0f00d3240 0x7ff0f0156980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34102/0 (socket says 172.21.15.18:34102) 2024-09-19T09:17:25.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.562+0000 7ff0f49c9640 1 -- 172.21.15.18:0/3249286377 learned_addr learned my addr 172.21.15.18:0/3249286377 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:25.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.562+0000 7ff0f59cb640 1 --2- 172.21.15.18:0/3249286377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0f015ef50 0x7ff0f00ba0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:25.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.562+0000 7ff0f51ca640 1 --2- 172.21.15.18:0/3249286377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0f00d1ab0 0x7ff0f0159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:25.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.562+0000 7ff0f49c9640 1 -- 172.21.15.18:0/3249286377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0f00d1ab0 msgr2=0x7ff0f0159070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:25.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.562+0000 7ff0f49c9640 1 --2- 172.21.15.18:0/3249286377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0f00d1ab0 0x7ff0f0159070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.562+0000 7ff0f49c9640 1 -- 172.21.15.18:0/3249286377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0f015ef50 msgr2=0x7ff0f00ba0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:25.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.562+0000 7ff0f49c9640 1 --2- 172.21.15.18:0/3249286377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0f015ef50 0x7ff0f00ba0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.562+0000 7ff0f49c9640 1 -- 172.21.15.18:0/3249286377 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f0157160 con 0x7ff0f00d3240 2024-09-19T09:17:25.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.562+0000 7ff0f49c9640 1 --2- 172.21.15.18:0/3249286377 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0f00d3240 0x7ff0f0156980 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff0e000d800 tx=0x7ff0e000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:25.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.562+0000 7ff0e5ffb640 1 -- 172.21.15.18:0/3249286377 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e000b6c0 con 0x7ff0f00d3240 2024-09-19T09:17:25.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.562+0000 7ff0e5ffb640 1 -- 172.21.15.18:0/3249286377 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0e0019070 con 0x7ff0f00d3240 2024-09-19T09:17:25.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.562+0000 7ff0e5ffb640 1 -- 172.21.15.18:0/3249286377 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0e000ba80 con 0x7ff0f00d3240 2024-09-19T09:17:25.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.562+0000 7ff0f742e640 1 -- 172.21.15.18:0/3249286377 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0f009eb80 con 0x7ff0f00d3240 2024-09-19T09:17:25.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.562+0000 7ff0f742e640 1 -- 172.21.15.18:0/3249286377 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0f00a27b0 con 0x7ff0f00d3240 2024-09-19T09:17:25.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.563+0000 7ff0f742e640 1 -- 172.21.15.18:0/3249286377 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0f009e9a0 con 0x7ff0f00d3240 2024-09-19T09:17:25.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.564+0000 7ff0e5ffb640 1 -- 172.21.15.18:0/3249286377 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff0e000bc20 con 0x7ff0f00d3240 2024-09-19T09:17:25.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.564+0000 7ff0e5ffb640 1 --2- 172.21.15.18:0/3249286377 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff0d406c2b0 0x7ff0d406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:25.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.564+0000 7ff0e5ffb640 1 -- 172.21.15.18:0/3249286377 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5709+0+0 (secure 0 0 0) 0x7ff0e008b870 con 0x7ff0f00d3240 2024-09-19T09:17:25.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.565+0000 7ff0f51ca640 1 --2- 172.21.15.18:0/3249286377 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff0d406c2b0 0x7ff0d406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:25.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.565+0000 7ff0f51ca640 1 --2- 172.21.15.18:0/3249286377 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff0d406c2b0 0x7ff0d406e770 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec000f60 tx=0x7ff0ec007c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:25.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.569+0000 7ff0e5ffb640 1 -- 172.21.15.18:0/3249286377 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff0f009e9a0 con 0x7ff0f00d3240 2024-09-19T09:17:25.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.745+0000 7ff0f742e640 1 -- 172.21.15.18:0/3249286377 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff0f00d13a0 con 0x7ff0f00d3240 2024-09-19T09:17:25.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.746+0000 7ff0e5ffb640 1 -- 172.21.15.18:0/3249286377 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+16680 (secure 0 0 0) 0x7ff0e005a070 con 0x7ff0f00d3240 2024-09-19T09:17:25.747 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:17:25.747 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":90,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:17:24.032012+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:17:21.027574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-19T09:17:21.426866+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:17:25.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.748+0000 7ff0f742e640 1 -- 172.21.15.18:0/3249286377 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff0d406c2b0 msgr2=0x7ff0d406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:25.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.748+0000 7ff0f742e640 1 --2- 172.21.15.18:0/3249286377 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff0d406c2b0 0x7ff0d406e770 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec000f60 tx=0x7ff0ec007c00 comp rx=0 tx=0).stop 2024-09-19T09:17:25.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.748+0000 7ff0f742e640 1 -- 172.21.15.18:0/3249286377 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0f00d3240 msgr2=0x7ff0f0156980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:25.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.748+0000 7ff0f742e640 1 --2- 172.21.15.18:0/3249286377 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0f00d3240 0x7ff0f0156980 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff0e000d800 tx=0x7ff0e000dcc0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.748+0000 7ff0f742e640 1 -- 172.21.15.18:0/3249286377 shutdown_connections 2024-09-19T09:17:25.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.748+0000 7ff0f742e640 1 --2- 172.21.15.18:0/3249286377 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff0d406c2b0 0x7ff0d406e770 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.748+0000 7ff0f742e640 1 --2- 172.21.15.18:0/3249286377 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0f015ef50 0x7ff0f00ba0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.748+0000 7ff0f742e640 1 --2- 172.21.15.18:0/3249286377 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0f00d3240 0x7ff0f0156980 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.748+0000 7ff0f742e640 1 --2- 172.21.15.18:0/3249286377 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0f00d1ab0 0x7ff0f0159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.748+0000 7ff0f742e640 1 -- 172.21.15.18:0/3249286377 >> 172.21.15.18:0/3249286377 conn(0x7ff0f00d4c60 msgr2=0x7ff0f00d2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:25.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.748+0000 7ff0f742e640 1 -- 172.21.15.18:0/3249286377 shutdown_connections 2024-09-19T09:17:25.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.748+0000 7ff0f742e640 1 -- 172.21.15.18:0/3249286377 wait complete. 2024-09-19T09:17:25.760 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T09:17:25.761 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:17:25.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.862+0000 7f4ddc3f8640 1 Processor -- start 2024-09-19T09:17:25.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.862+0000 7f4ddc3f8640 1 -- start start 2024-09-19T09:17:25.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.863+0000 7f4ddc3f8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4dd40cfae0 0x7f4dd40b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:25.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.863+0000 7f4ddc3f8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4dd406d730 0x7f4dd40cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:25.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.863+0000 7f4ddc3f8640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dd40cd1a0 con 0x7f4dd415ef80 2024-09-19T09:17:25.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.863+0000 7f4ddc3f8640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f4dd40cd7d0 con 0x7f4dd406d730 2024-09-19T09:17:25.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.863+0000 7f4ddc3f8640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4dd406dc30 con 0x7f4dd40cfae0 2024-09-19T09:17:25.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.863+0000 7f4dda995640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4dd406d730 0x7f4dd40cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:25.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.863+0000 7f4dda194640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f4dd415ef80 0x7f4dd40cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:37408/0 (socket says 172.21.15.18:37408) 2024-09-19T09:17:25.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.863+0000 7f4dda194640 1 -- 172.21.15.18:0/2474917636 learned_addr learned my addr 172.21.15.18:0/2474917636 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:17:25.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.863+0000 7f4dd9993640 1 --2- 172.21.15.18:0/2474917636 >> v2:172.21.15.162:3300/0 conn(0x7f4dd40cfae0 0x7f4dd40b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:25.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.863+0000 7f4dda995640 1 -- 172.21.15.18:0/2474917636 >> v2:172.21.15.162:3300/0 conn(0x7f4dd40cfae0 msgr2=0x7f4dd40b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:25.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.863+0000 7f4dda995640 1 --2- 172.21.15.18:0/2474917636 >> v2:172.21.15.162:3300/0 conn(0x7f4dd40cfae0 0x7f4dd40b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.863+0000 7f4dda995640 1 -- 172.21.15.18:0/2474917636 >> v1:172.21.15.18:6789/0 conn(0x7f4dd415ef80 legacy=0x7f4dd40cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:25.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.863+0000 7f4dda995640 1 -- 172.21.15.18:0/2474917636 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd406df10 con 0x7f4dd406d730 2024-09-19T09:17:25.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.863+0000 7f4dd9192640 1 -- 172.21.15.18:0/2474917636 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2090372389 0 0) 0x7f4dd40cd1a0 con 0x7f4dd415ef80 2024-09-19T09:17:25.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.864+0000 7f4dda995640 1 --2- 172.21.15.18:0/2474917636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dd406d730 0x7f4dd40cdc60 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40b57c0 tx=0x7f4dcc02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d837c9571007fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:25.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.864+0000 7f4dd9192640 1 -- 172.21.15.18:0/2474917636 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc007740 con 0x7f4dd406d730 2024-09-19T09:17:25.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.864+0000 7f4dd9192640 1 -- 172.21.15.18:0/2474917636 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dcc0078e0 con 0x7f4dd406d730 2024-09-19T09:17:25.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.864+0000 7f4dd9192640 1 -- 172.21.15.18:0/2474917636 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc007cb0 con 0x7f4dd406d730 2024-09-19T09:17:25.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.865+0000 7f4ddc3f8640 1 -- 172.21.15.18:0/2474917636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dd406d730 msgr2=0x7f4dd40cdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:25.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.865+0000 7f4ddc3f8640 1 --2- 172.21.15.18:0/2474917636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dd406d730 0x7f4dd40cdc60 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f4dd40b57c0 tx=0x7f4dcc02a680 comp rx=0 tx=0).stop 2024-09-19T09:17:25.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.865+0000 7f4ddc3f8640 1 -- 172.21.15.18:0/2474917636 shutdown_connections 2024-09-19T09:17:25.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.865+0000 7f4ddc3f8640 1 --2- 172.21.15.18:0/2474917636 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dd406d730 0x7f4dd40cdc60 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.865+0000 7f4ddc3f8640 1 --2- 172.21.15.18:0/2474917636 >> v2:172.21.15.162:3300/0 conn(0x7f4dd40cfae0 0x7f4dd40b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.865+0000 7f4ddc3f8640 1 -- 172.21.15.18:0/2474917636 >> 172.21.15.18:0/2474917636 conn(0x7f4dd40b4700 msgr2=0x7f4dd40b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:25.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.865+0000 7f4ddc3f8640 1 -- 172.21.15.18:0/2474917636 shutdown_connections 2024-09-19T09:17:25.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.865+0000 7f4ddc3f8640 1 -- 172.21.15.18:0/2474917636 wait complete. 2024-09-19T09:17:25.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.866+0000 7f4ddc3f8640 1 Processor -- start 2024-09-19T09:17:25.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.866+0000 7f4ddc3f8640 1 -- start start 2024-09-19T09:17:25.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.867+0000 7f4ddc3f8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dd406d730 0x7f4dd41f4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:25.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.867+0000 7f4ddc3f8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dd40cfae0 0x7f4dd40b85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:25.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.867+0000 7f4ddc3f8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4dd415ef80 0x7f4dd40d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:25.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.867+0000 7f4ddc3f8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd40d0120 con 0x7f4dd40cfae0 2024-09-19T09:17:25.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.867+0000 7f4ddc3f8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd415f360 con 0x7f4dd415ef80 2024-09-19T09:17:25.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.867+0000 7f4ddc3f8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4dd40ce1a0 con 0x7f4dd406d730 2024-09-19T09:17:25.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.867+0000 7f4dd9993640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dd40cfae0 0x7f4dd40b85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:25.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.867+0000 7f4dd9993640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dd40cfae0 0x7f4dd40b85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34128/0 (socket says 172.21.15.18:34128) 2024-09-19T09:17:25.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.867+0000 7f4dd9993640 1 -- 172.21.15.18:0/1002257923 learned_addr learned my addr 172.21.15.18:0/1002257923 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:25.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.867+0000 7f4dda194640 1 --2- 172.21.15.18:0/1002257923 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dd406d730 0x7f4dd41f4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:25.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.867+0000 7f4dda995640 1 --2- 172.21.15.18:0/1002257923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4dd415ef80 0x7f4dd40d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:25.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.867+0000 7f4dd9993640 1 -- 172.21.15.18:0/1002257923 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dd406d730 msgr2=0x7f4dd41f4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:25.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.867+0000 7f4dd9993640 1 --2- 172.21.15.18:0/1002257923 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dd406d730 0x7f4dd41f4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.867+0000 7f4dd9993640 1 -- 172.21.15.18:0/1002257923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4dd415ef80 msgr2=0x7f4dd40d1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:25.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.867+0000 7f4dd9993640 1 --2- 172.21.15.18:0/1002257923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4dd415ef80 0x7f4dd40d1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:25.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.867+0000 7f4dd9993640 1 -- 172.21.15.18:0/1002257923 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd40b8b00 con 0x7f4dd40cfae0 2024-09-19T09:17:25.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.867+0000 7f4dda995640 1 --2- 172.21.15.18:0/1002257923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4dd415ef80 0x7f4dd40d1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:17:25.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.867+0000 7f4dd9993640 1 --2- 172.21.15.18:0/1002257923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dd40cfae0 0x7f4dd40b85c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400d800 tx=0x7f4dc400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:25.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.868+0000 7f4dcaffd640 1 -- 172.21.15.18:0/1002257923 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc400b6c0 con 0x7f4dd40cfae0 2024-09-19T09:17:25.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.868+0000 7f4dcaffd640 1 -- 172.21.15.18:0/1002257923 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dc4019070 con 0x7f4dd40cfae0 2024-09-19T09:17:25.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.868+0000 7f4dcaffd640 1 -- 172.21.15.18:0/1002257923 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc400ba80 con 0x7f4dd40cfae0 2024-09-19T09:17:25.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.868+0000 7f4ddc3f8640 1 -- 172.21.15.18:0/1002257923 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dd41f8260 con 0x7f4dd40cfae0 2024-09-19T09:17:25.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.868+0000 7f4ddc3f8640 1 -- 172.21.15.18:0/1002257923 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dd41f8820 con 0x7f4dd40cfae0 2024-09-19T09:17:25.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.869+0000 7f4ddc3f8640 1 -- 172.21.15.18:0/1002257923 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dd40cff00 con 0x7f4dd40cfae0 2024-09-19T09:17:25.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.869+0000 7f4dcaffd640 1 -- 172.21.15.18:0/1002257923 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4dc400bc20 con 0x7f4dd40cfae0 2024-09-19T09:17:25.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.870+0000 7f4dcaffd640 1 --2- 172.21.15.18:0/1002257923 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4db806c2b0 0x7f4db806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:25.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.870+0000 7f4dcaffd640 1 -- 172.21.15.18:0/1002257923 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5709+0+0 (secure 0 0 0) 0x7f4dc408b870 con 0x7f4dd40cfae0 2024-09-19T09:17:25.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.870+0000 7f4dda194640 1 --2- 172.21.15.18:0/1002257923 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4db806c2b0 0x7f4db806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:25.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.871+0000 7f4dda194640 1 --2- 172.21.15.18:0/1002257923 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4db806c2b0 0x7f4db806e770 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0000f60 tx=0x7f4dd0007c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:25.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:25.874+0000 7f4dcaffd640 1 -- 172.21.15.18:0/1002257923 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f4dc405a070 con 0x7f4dd40cfae0 2024-09-19T09:17:26.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.047+0000 7f4ddc3f8640 1 -- 172.21.15.18:0/1002257923 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4dd40cd1a0 con 0x7f4db806c2b0 2024-09-19T09:17:26.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.054+0000 7f4dcaffd640 1 -- 172.21.15.18:0/1002257923 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237510 (secure 0 0 0) 0x7f4dd40cd1a0 con 0x7f4db806c2b0 2024-09-19T09:17:26.057 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:17:26.058 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:17:26.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.057+0000 7f4ddc3f8640 1 -- 172.21.15.18:0/1002257923 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4db806c2b0 msgr2=0x7f4db806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:26.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.057+0000 7f4ddc3f8640 1 --2- 172.21.15.18:0/1002257923 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4db806c2b0 0x7f4db806e770 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0000f60 tx=0x7f4dd0007c00 comp rx=0 tx=0).stop 2024-09-19T09:17:26.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.057+0000 7f4ddc3f8640 1 -- 172.21.15.18:0/1002257923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dd40cfae0 msgr2=0x7f4dd40b85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:26.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.057+0000 7f4ddc3f8640 1 --2- 172.21.15.18:0/1002257923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dd40cfae0 0x7f4dd40b85c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f4dc400d800 tx=0x7f4dc400dcc0 comp rx=0 tx=0).stop 2024-09-19T09:17:26.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.057+0000 7f4ddc3f8640 1 -- 172.21.15.18:0/1002257923 shutdown_connections 2024-09-19T09:17:26.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.057+0000 7f4ddc3f8640 1 --2- 172.21.15.18:0/1002257923 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4db806c2b0 0x7f4db806e770 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:26.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.057+0000 7f4ddc3f8640 1 --2- 172.21.15.18:0/1002257923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4dd415ef80 0x7f4dd40d1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:26.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.057+0000 7f4ddc3f8640 1 --2- 172.21.15.18:0/1002257923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4dd40cfae0 0x7f4dd40b85c0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:26.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.057+0000 7f4ddc3f8640 1 --2- 172.21.15.18:0/1002257923 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4dd406d730 0x7f4dd41f4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:26.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.057+0000 7f4ddc3f8640 1 -- 172.21.15.18:0/1002257923 >> 172.21.15.18:0/1002257923 conn(0x7f4dd40b4700 msgr2=0x7f4dd40d3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:26.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.057+0000 7f4ddc3f8640 1 -- 172.21.15.18:0/1002257923 shutdown_connections 2024-09-19T09:17:26.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.057+0000 7f4ddc3f8640 1 -- 172.21.15.18:0/1002257923 wait complete. 2024-09-19T09:17:26.069 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2024-09-19T09:17:25.580860+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4749,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557750,"statfs":{"total":1600000000,"available":1595136107,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.500322"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.081909+0000","last_change":"2024-09-19T09:17:21.081909+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.081909+0000","last_undegraded":"2024-09-19T09:17:21.081909+0000","last_fullsized":"2024-09-19T09:17:21.081909+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.081224+0000","last_change":"2024-09-19T09:17:21.081224+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.081224+0000","last_undegraded":"2024-09-19T09:17:21.081224+0000","last_fullsized":"2024-09-19T09:17:21.081224+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083093+0000","last_change":"2024-09-19T09:17:21.083093+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083093+0000","last_undegraded":"2024-09-19T09:17:21.083093+0000","last_fullsized":"2024-09-19T09:17:21.083093+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.081905+0000","last_change":"2024-09-19T09:17:21.081905+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.081905+0000","last_undegraded":"2024-09-19T09:17:21.081905+0000","last_fullsized":"2024-09-19T09:17:21.081905+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083080+0000","last_change":"2024-09-19T09:17:21.083080+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083080+0000","last_undegraded":"2024-09-19T09:17:21.083080+0000","last_fullsized":"2024-09-19T09:17:21.083080+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083999+0000","last_change":"2024-09-19T09:17:21.083999+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083999+0000","last_undegraded":"2024-09-19T09:17:21.083999+0000","last_fullsized":"2024-09-19T09:17:21.083999+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083770+0000","last_change":"2024-09-19T09:17:21.083770+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083770+0000","last_undegraded":"2024-09-19T09:17:21.083770+0000","last_fullsized":"2024-09-19T09:17:21.083770+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083577+0000","last_change":"2024-09-19T09:17:21.083577+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083577+0000","last_undegraded":"2024-09-19T09:17:21.083577+0000","last_fullsized":"2024-09-19T09:17:21.083577+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083145+0000","last_change":"2024-09-19T09:17:21.083145+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083145+0000","last_undegraded":"2024-09-19T09:17:21.083145+0000","last_fullsized":"2024-09-19T09:17:21.083145+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082044+0000","last_change":"2024-09-19T09:17:21.082044+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082044+0000","last_undegraded":"2024-09-19T09:17:21.082044+0000","last_fullsized":"2024-09-19T09:17:21.082044+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082712+0000","last_change":"2024-09-19T09:17:21.082712+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082712+0000","last_undegraded":"2024-09-19T09:17:21.082712+0000","last_fullsized":"2024-09-19T09:17:21.082712+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083362+0000","last_change":"2024-09-19T09:17:21.083362+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083362+0000","last_undegraded":"2024-09-19T09:17:21.083362+0000","last_fullsized":"2024-09-19T09:17:21.083362+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082962+0000","last_change":"2024-09-19T09:17:21.082962+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082962+0000","last_undegraded":"2024-09-19T09:17:21.082962+0000","last_fullsized":"2024-09-19T09:17:21.082962+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.084396+0000","last_change":"2024-09-19T09:17:21.084396+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.084396+0000","last_undegraded":"2024-09-19T09:17:21.084396+0000","last_fullsized":"2024-09-19T09:17:21.084396+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083621+0000","last_change":"2024-09-19T09:17:21.083621+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083621+0000","last_undegraded":"2024-09-19T09:17:21.083621+0000","last_fullsized":"2024-09-19T09:17:21.083621+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083690+0000","last_change":"2024-09-19T09:17:21.083690+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083690+0000","last_undegraded":"2024-09-19T09:17:21.083690+0000","last_fullsized":"2024-09-19T09:17:21.083690+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083410+0000","last_change":"2024-09-19T09:17:21.083410+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083410+0000","last_undegraded":"2024-09-19T09:17:21.083410+0000","last_fullsized":"2024-09-19T09:17:21.083410+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082420+0000","last_change":"2024-09-19T09:17:21.082420+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082420+0000","last_undegraded":"2024-09-19T09:17:21.082420+0000","last_fullsized":"2024-09-19T09:17:21.082420+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082415+0000","last_change":"2024-09-19T09:17:21.082415+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082415+0000","last_undegraded":"2024-09-19T09:17:21.082415+0000","last_fullsized":"2024-09-19T09:17:21.082415+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082233+0000","last_change":"2024-09-19T09:17:21.082233+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082233+0000","last_undegraded":"2024-09-19T09:17:21.082233+0000","last_fullsized":"2024-09-19T09:17:21.082233+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082325+0000","last_change":"2024-09-19T09:17:21.082325+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082325+0000","last_undegraded":"2024-09-19T09:17:21.082325+0000","last_fullsized":"2024-09-19T09:17:21.082325+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082133+0000","last_change":"2024-09-19T09:17:21.082133+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082133+0000","last_undegraded":"2024-09-19T09:17:21.082133+0000","last_fullsized":"2024-09-19T09:17:21.082133+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.081262+0000","last_change":"2024-09-19T09:17:21.081262+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.081262+0000","last_undegraded":"2024-09-19T09:17:21.081262+0000","last_fullsized":"2024-09-19T09:17:21.081262+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083074+0000","last_change":"2024-09-19T09:17:21.083074+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083074+0000","last_undegraded":"2024-09-19T09:17:21.083074+0000","last_fullsized":"2024-09-19T09:17:21.083074+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083120+0000","last_change":"2024-09-19T09:17:21.083120+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083120+0000","last_undegraded":"2024-09-19T09:17:21.083120+0000","last_fullsized":"2024-09-19T09:17:21.083120+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082698+0000","last_change":"2024-09-19T09:17:21.082698+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082698+0000","last_undegraded":"2024-09-19T09:17:21.082698+0000","last_fullsized":"2024-09-19T09:17:21.082698+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083204+0000","last_change":"2024-09-19T09:17:21.083204+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083204+0000","last_undegraded":"2024-09-19T09:17:21.083204+0000","last_fullsized":"2024-09-19T09:17:21.083204+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083131+0000","last_change":"2024-09-19T09:17:21.083131+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083131+0000","last_undegraded":"2024-09-19T09:17:21.083131+0000","last_fullsized":"2024-09-19T09:17:21.083131+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.080942+0000","last_change":"2024-09-19T09:17:21.080942+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.080942+0000","last_undegraded":"2024-09-19T09:17:21.080942+0000","last_fullsized":"2024-09-19T09:17:21.080942+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082042+0000","last_change":"2024-09-19T09:17:21.082042+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082042+0000","last_undegraded":"2024-09-19T09:17:21.082042+0000","last_fullsized":"2024-09-19T09:17:21.082042+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.081905+0000","last_change":"2024-09-19T09:17:21.081905+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.081905+0000","last_undegraded":"2024-09-19T09:17:21.081905+0000","last_fullsized":"2024-09-19T09:17:21.081905+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083363+0000","last_change":"2024-09-19T09:17:21.083363+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083363+0000","last_undegraded":"2024-09-19T09:17:21.083363+0000","last_fullsized":"2024-09-19T09:17:21.083363+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":300,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:17:21.084254+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:17:21.084254+0000","last_peered":"2024-09-19T09:17:21.084254+0000","last_clean":"2024-09-19T09:17:21.084254+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:17:21.084254+0000","last_undegraded":"2024-09-19T09:17:21.084254+0000","last_fullsized":"2024-09-19T09:17:21.084254+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:58.919093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":451,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194860,"statfs":{"total":200000000,"available":199537424,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":446,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194866,"statfs":{"total":200000000,"available":199543241,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1028,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194284,"statfs":{"total":200000000,"available":198947056,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":446,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194866,"statfs":{"total":200000000,"available":199543241,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":451,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194860,"statfs":{"total":200000000,"available":199537424,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":451,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194860,"statfs":{"total":200000000,"available":199537424,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1028,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194284,"statfs":{"total":200000000,"available":198947056,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":446,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194866,"statfs":{"total":200000000,"available":199543241,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:17:26.074 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:17:26.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.211+0000 7f2830f86640 1 Processor -- start 2024-09-19T09:17:26.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.211+0000 7f2830f86640 1 -- start start 2024-09-19T09:17:26.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.212+0000 7f2830f86640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f282c15ed50 0x7f282c0d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:26.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.212+0000 7f2830f86640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f282c0d1aa0 0x7f282c0b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:26.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.212+0000 7f2830f86640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f282c0d31b0 con 0x7f282c0b5030 2024-09-19T09:17:26.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.212+0000 7f2830f86640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f282c0d1ee0 con 0x7f282c0d1aa0 2024-09-19T09:17:26.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.212+0000 7f2830f86640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f282c0d3490 con 0x7f282c15ed50 2024-09-19T09:17:26.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.212+0000 7f282ad9d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f282c0b5030 0x7f282c0b54e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:37422/0 (socket says 172.21.15.18:37422) 2024-09-19T09:17:26.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.212+0000 7f282ad9d640 1 -- 172.21.15.18:0/1492479994 learned_addr learned my addr 172.21.15.18:0/1492479994 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:17:26.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.212+0000 7f2829d9b640 1 --2- 172.21.15.18:0/1492479994 >> v2:172.21.15.162:3300/0 conn(0x7f282c0d1aa0 0x7f282c0b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:26.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.212+0000 7f282a59c640 1 --2- 172.21.15.18:0/1492479994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f282c15ed50 0x7f282c0d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:26.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.212+0000 7f282959a640 1 -- 172.21.15.18:0/1492479994 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 421118204 0 0) 0x7f282c0d31b0 con 0x7f282c0b5030 2024-09-19T09:17:26.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.212+0000 7f282959a640 1 -- 172.21.15.18:0/1492479994 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2814003520 con 0x7f282c0b5030 2024-09-19T09:17:26.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.213+0000 7f282a59c640 1 -- 172.21.15.18:0/1492479994 >> v2:172.21.15.162:3300/0 conn(0x7f282c0d1aa0 msgr2=0x7f282c0b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:26.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.213+0000 7f282a59c640 1 --2- 172.21.15.18:0/1492479994 >> v2:172.21.15.162:3300/0 conn(0x7f282c0d1aa0 0x7f282c0b4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:26.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.213+0000 7f282a59c640 1 -- 172.21.15.18:0/1492479994 >> v1:172.21.15.18:6789/0 conn(0x7f282c0b5030 legacy=0x7f282c0b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:26.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.213+0000 7f282a59c640 1 -- 172.21.15.18:0/1492479994 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f282c0d3770 con 0x7f282c15ed50 2024-09-19T09:17:26.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.213+0000 7f2829d9b640 1 --2- 172.21.15.18:0/1492479994 >> v2:172.21.15.162:3300/0 conn(0x7f282c0d1aa0 0x7f282c0b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:17:26.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.213+0000 7f282a59c640 1 --2- 172.21.15.18:0/1492479994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f282c15ed50 0x7f282c0d1560 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f281c0097a0 tx=0x7f281c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b07254ad8277c3d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:26.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.214+0000 7f282959a640 1 -- 172.21.15.18:0/1492479994 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281c037070 con 0x7f282c15ed50 2024-09-19T09:17:26.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.214+0000 7f282959a640 1 -- 172.21.15.18:0/1492479994 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f281c032440 con 0x7f282c15ed50 2024-09-19T09:17:26.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.214+0000 7f282959a640 1 -- 172.21.15.18:0/1492479994 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281c0327f0 con 0x7f282c15ed50 2024-09-19T09:17:26.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.214+0000 7f2830f86640 1 -- 172.21.15.18:0/1492479994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f282c15ed50 msgr2=0x7f282c0d1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:26.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.214+0000 7f2830f86640 1 --2- 172.21.15.18:0/1492479994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f282c15ed50 0x7f282c0d1560 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f281c0097a0 tx=0x7f281c02a210 comp rx=0 tx=0).stop 2024-09-19T09:17:26.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.214+0000 7f2830f86640 1 -- 172.21.15.18:0/1492479994 shutdown_connections 2024-09-19T09:17:26.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.214+0000 7f2830f86640 1 --2- 172.21.15.18:0/1492479994 >> v2:172.21.15.162:3300/0 conn(0x7f282c0d1aa0 0x7f282c0b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:26.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.214+0000 7f2830f86640 1 --2- 172.21.15.18:0/1492479994 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f282c15ed50 0x7f282c0d1560 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:26.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.214+0000 7f2830f86640 1 -- 172.21.15.18:0/1492479994 >> 172.21.15.18:0/1492479994 conn(0x7f282c0d4bd0 msgr2=0x7f282c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:26.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.214+0000 7f2830f86640 1 -- 172.21.15.18:0/1492479994 shutdown_connections 2024-09-19T09:17:26.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.214+0000 7f2830f86640 1 -- 172.21.15.18:0/1492479994 wait complete. 2024-09-19T09:17:26.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.216+0000 7f2830f86640 1 Processor -- start 2024-09-19T09:17:26.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.216+0000 7f2830f86640 1 -- start start 2024-09-19T09:17:26.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.216+0000 7f2830f86640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f282c0b5030 0x7f282c1f5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:26.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.216+0000 7f2830f86640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f282c0d1aa0 0x7f282c161070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:26.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.216+0000 7f2830f86640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f282c15ed50 0x7f282c1615b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:26.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.216+0000 7f2830f86640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f282c0d3d30 con 0x7f282c15ed50 2024-09-19T09:17:26.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.216+0000 7f2830f86640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f282c0b45d0 con 0x7f282c0d1aa0 2024-09-19T09:17:26.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.216+0000 7f2830f86640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f282c15f130 con 0x7f282c0b5030 2024-09-19T09:17:26.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.216+0000 7f282ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f282c15ed50 0x7f282c1615b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:26.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.216+0000 7f282ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f282c15ed50 0x7f282c1615b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34130/0 (socket says 172.21.15.18:34130) 2024-09-19T09:17:26.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.216+0000 7f282ad9d640 1 -- 172.21.15.18:0/2105405716 learned_addr learned my addr 172.21.15.18:0/2105405716 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:26.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.217+0000 7f2829d9b640 1 --2- 172.21.15.18:0/2105405716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f282c0d1aa0 0x7f282c161070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:26.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.217+0000 7f282a59c640 1 --2- 172.21.15.18:0/2105405716 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f282c0b5030 0x7f282c1f5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:26.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.217+0000 7f282ad9d640 1 -- 172.21.15.18:0/2105405716 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f282c0b5030 msgr2=0x7f282c1f5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:26.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.217+0000 7f282ad9d640 1 --2- 172.21.15.18:0/2105405716 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f282c0b5030 0x7f282c1f5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:26.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.217+0000 7f282ad9d640 1 -- 172.21.15.18:0/2105405716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f282c0d1aa0 msgr2=0x7f282c161070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:26.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.217+0000 7f282ad9d640 1 --2- 172.21.15.18:0/2105405716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f282c0d1aa0 0x7f282c161070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:26.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.217+0000 7f282ad9d640 1 -- 172.21.15.18:0/2105405716 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f282c1f5850 con 0x7f282c15ed50 2024-09-19T09:17:26.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.217+0000 7f2829d9b640 1 --2- 172.21.15.18:0/2105405716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f282c0d1aa0 0x7f282c161070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:26.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.217+0000 7f282ad9d640 1 --2- 172.21.15.18:0/2105405716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f282c15ed50 0x7f282c1615b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f282400c430 tx=0x7f282400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:26.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.217+0000 7f281affd640 1 -- 172.21.15.18:0/2105405716 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2824017070 con 0x7f282c15ed50 2024-09-19T09:17:26.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.217+0000 7f281affd640 1 -- 172.21.15.18:0/2105405716 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2824005ce0 con 0x7f282c15ed50 2024-09-19T09:17:26.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.217+0000 7f2830f86640 1 -- 172.21.15.18:0/2105405716 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f282c1f22c0 con 0x7f282c15ed50 2024-09-19T09:17:26.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.217+0000 7f281affd640 1 -- 172.21.15.18:0/2105405716 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2824007310 con 0x7f282c15ed50 2024-09-19T09:17:26.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.217+0000 7f2830f86640 1 -- 172.21.15.18:0/2105405716 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f282c15fb20 con 0x7f282c15ed50 2024-09-19T09:17:26.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.218+0000 7f2830f86640 1 -- 172.21.15.18:0/2105405716 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f282c0d21e0 con 0x7f282c15ed50 2024-09-19T09:17:26.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.219+0000 7f281affd640 1 -- 172.21.15.18:0/2105405716 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f282401a070 con 0x7f282c15ed50 2024-09-19T09:17:26.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.219+0000 7f281affd640 1 --2- 172.21.15.18:0/2105405716 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f280c06c2b0 0x7f280c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:26.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.219+0000 7f281affd640 1 -- 172.21.15.18:0/2105405716 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5709+0+0 (secure 0 0 0) 0x7f282408a8b0 con 0x7f282c15ed50 2024-09-19T09:17:26.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.219+0000 7f282a59c640 1 --2- 172.21.15.18:0/2105405716 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f280c06c2b0 0x7f280c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:26.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.220+0000 7f282a59c640 1 --2- 172.21.15.18:0/2105405716 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f280c06c2b0 0x7f280c06e770 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f281c034000 tx=0x7f281c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:26.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.223+0000 7f281affd640 1 -- 172.21.15.18:0/2105405716 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2824059020 con 0x7f282c15ed50 2024-09-19T09:17:26.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.398+0000 7f2830f86640 1 -- 172.21.15.18:0/2105405716 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f282c0d2a30 con 0x7f280c06c2b0 2024-09-19T09:17:26.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.404+0000 7f281affd640 1 -- 172.21.15.18:0/2105405716 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237510 (secure 0 0 0) 0x7f282c0d2a30 con 0x7f280c06c2b0 2024-09-19T09:17:26.407 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:17:26.409 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:17:26.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.406+0000 7f2830f86640 1 -- 172.21.15.18:0/2105405716 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f280c06c2b0 msgr2=0x7f280c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:26.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.407+0000 7f2830f86640 1 --2- 172.21.15.18:0/2105405716 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f280c06c2b0 0x7f280c06e770 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f281c034000 tx=0x7f281c02e000 comp rx=0 tx=0).stop 2024-09-19T09:17:26.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.407+0000 7f2830f86640 1 -- 172.21.15.18:0/2105405716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f282c15ed50 msgr2=0x7f282c1615b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:26.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.407+0000 7f2830f86640 1 --2- 172.21.15.18:0/2105405716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f282c15ed50 0x7f282c1615b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f282400c430 tx=0x7f282400c8f0 comp rx=0 tx=0).stop 2024-09-19T09:17:26.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.407+0000 7f2830f86640 1 -- 172.21.15.18:0/2105405716 shutdown_connections 2024-09-19T09:17:26.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.407+0000 7f2830f86640 1 --2- 172.21.15.18:0/2105405716 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f280c06c2b0 0x7f280c06e770 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:26.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.407+0000 7f2830f86640 1 --2- 172.21.15.18:0/2105405716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f282c15ed50 0x7f282c1615b0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:26.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.407+0000 7f2830f86640 1 --2- 172.21.15.18:0/2105405716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f282c0d1aa0 0x7f282c161070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:26.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.407+0000 7f2830f86640 1 --2- 172.21.15.18:0/2105405716 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f282c0b5030 0x7f282c1f5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:26.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.407+0000 7f2830f86640 1 -- 172.21.15.18:0/2105405716 >> 172.21.15.18:0/2105405716 conn(0x7f282c0d4bd0 msgr2=0x7f282c0d4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:26.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.407+0000 7f2830f86640 1 -- 172.21.15.18:0/2105405716 shutdown_connections 2024-09-19T09:17:26.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.407+0000 7f2830f86640 1 -- 172.21.15.18:0/2105405716 wait complete. 2024-09-19T09:17:26.418 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2024-09-19T09:17:25.580860+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4749,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557750,"statfs":{"total":1600000000,"available":1595136107,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.500322"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.081909+0000","last_change":"2024-09-19T09:17:21.081909+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.081909+0000","last_undegraded":"2024-09-19T09:17:21.081909+0000","last_fullsized":"2024-09-19T09:17:21.081909+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.081224+0000","last_change":"2024-09-19T09:17:21.081224+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.081224+0000","last_undegraded":"2024-09-19T09:17:21.081224+0000","last_fullsized":"2024-09-19T09:17:21.081224+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083093+0000","last_change":"2024-09-19T09:17:21.083093+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083093+0000","last_undegraded":"2024-09-19T09:17:21.083093+0000","last_fullsized":"2024-09-19T09:17:21.083093+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.081905+0000","last_change":"2024-09-19T09:17:21.081905+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.081905+0000","last_undegraded":"2024-09-19T09:17:21.081905+0000","last_fullsized":"2024-09-19T09:17:21.081905+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083080+0000","last_change":"2024-09-19T09:17:21.083080+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083080+0000","last_undegraded":"2024-09-19T09:17:21.083080+0000","last_fullsized":"2024-09-19T09:17:21.083080+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083999+0000","last_change":"2024-09-19T09:17:21.083999+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083999+0000","last_undegraded":"2024-09-19T09:17:21.083999+0000","last_fullsized":"2024-09-19T09:17:21.083999+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083770+0000","last_change":"2024-09-19T09:17:21.083770+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083770+0000","last_undegraded":"2024-09-19T09:17:21.083770+0000","last_fullsized":"2024-09-19T09:17:21.083770+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083577+0000","last_change":"2024-09-19T09:17:21.083577+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083577+0000","last_undegraded":"2024-09-19T09:17:21.083577+0000","last_fullsized":"2024-09-19T09:17:21.083577+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083145+0000","last_change":"2024-09-19T09:17:21.083145+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083145+0000","last_undegraded":"2024-09-19T09:17:21.083145+0000","last_fullsized":"2024-09-19T09:17:21.083145+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082044+0000","last_change":"2024-09-19T09:17:21.082044+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082044+0000","last_undegraded":"2024-09-19T09:17:21.082044+0000","last_fullsized":"2024-09-19T09:17:21.082044+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082712+0000","last_change":"2024-09-19T09:17:21.082712+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082712+0000","last_undegraded":"2024-09-19T09:17:21.082712+0000","last_fullsized":"2024-09-19T09:17:21.082712+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083362+0000","last_change":"2024-09-19T09:17:21.083362+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083362+0000","last_undegraded":"2024-09-19T09:17:21.083362+0000","last_fullsized":"2024-09-19T09:17:21.083362+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082962+0000","last_change":"2024-09-19T09:17:21.082962+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082962+0000","last_undegraded":"2024-09-19T09:17:21.082962+0000","last_fullsized":"2024-09-19T09:17:21.082962+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.084396+0000","last_change":"2024-09-19T09:17:21.084396+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.084396+0000","last_undegraded":"2024-09-19T09:17:21.084396+0000","last_fullsized":"2024-09-19T09:17:21.084396+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083621+0000","last_change":"2024-09-19T09:17:21.083621+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083621+0000","last_undegraded":"2024-09-19T09:17:21.083621+0000","last_fullsized":"2024-09-19T09:17:21.083621+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083690+0000","last_change":"2024-09-19T09:17:21.083690+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083690+0000","last_undegraded":"2024-09-19T09:17:21.083690+0000","last_fullsized":"2024-09-19T09:17:21.083690+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083410+0000","last_change":"2024-09-19T09:17:21.083410+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083410+0000","last_undegraded":"2024-09-19T09:17:21.083410+0000","last_fullsized":"2024-09-19T09:17:21.083410+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082420+0000","last_change":"2024-09-19T09:17:21.082420+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082420+0000","last_undegraded":"2024-09-19T09:17:21.082420+0000","last_fullsized":"2024-09-19T09:17:21.082420+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082415+0000","last_change":"2024-09-19T09:17:21.082415+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082415+0000","last_undegraded":"2024-09-19T09:17:21.082415+0000","last_fullsized":"2024-09-19T09:17:21.082415+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082233+0000","last_change":"2024-09-19T09:17:21.082233+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082233+0000","last_undegraded":"2024-09-19T09:17:21.082233+0000","last_fullsized":"2024-09-19T09:17:21.082233+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082325+0000","last_change":"2024-09-19T09:17:21.082325+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082325+0000","last_undegraded":"2024-09-19T09:17:21.082325+0000","last_fullsized":"2024-09-19T09:17:21.082325+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082133+0000","last_change":"2024-09-19T09:17:21.082133+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082133+0000","last_undegraded":"2024-09-19T09:17:21.082133+0000","last_fullsized":"2024-09-19T09:17:21.082133+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.081262+0000","last_change":"2024-09-19T09:17:21.081262+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.081262+0000","last_undegraded":"2024-09-19T09:17:21.081262+0000","last_fullsized":"2024-09-19T09:17:21.081262+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083074+0000","last_change":"2024-09-19T09:17:21.083074+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083074+0000","last_undegraded":"2024-09-19T09:17:21.083074+0000","last_fullsized":"2024-09-19T09:17:21.083074+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083120+0000","last_change":"2024-09-19T09:17:21.083120+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083120+0000","last_undegraded":"2024-09-19T09:17:21.083120+0000","last_fullsized":"2024-09-19T09:17:21.083120+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082698+0000","last_change":"2024-09-19T09:17:21.082698+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082698+0000","last_undegraded":"2024-09-19T09:17:21.082698+0000","last_fullsized":"2024-09-19T09:17:21.082698+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083204+0000","last_change":"2024-09-19T09:17:21.083204+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083204+0000","last_undegraded":"2024-09-19T09:17:21.083204+0000","last_fullsized":"2024-09-19T09:17:21.083204+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083131+0000","last_change":"2024-09-19T09:17:21.083131+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083131+0000","last_undegraded":"2024-09-19T09:17:21.083131+0000","last_fullsized":"2024-09-19T09:17:21.083131+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.080942+0000","last_change":"2024-09-19T09:17:21.080942+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.080942+0000","last_undegraded":"2024-09-19T09:17:21.080942+0000","last_fullsized":"2024-09-19T09:17:21.080942+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082042+0000","last_change":"2024-09-19T09:17:21.082042+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082042+0000","last_undegraded":"2024-09-19T09:17:21.082042+0000","last_fullsized":"2024-09-19T09:17:21.082042+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.081905+0000","last_change":"2024-09-19T09:17:21.081905+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.081905+0000","last_undegraded":"2024-09-19T09:17:21.081905+0000","last_fullsized":"2024-09-19T09:17:21.081905+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083363+0000","last_change":"2024-09-19T09:17:21.083363+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083363+0000","last_undegraded":"2024-09-19T09:17:21.083363+0000","last_fullsized":"2024-09-19T09:17:21.083363+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":300,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:17:21.084254+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:17:21.084254+0000","last_peered":"2024-09-19T09:17:21.084254+0000","last_clean":"2024-09-19T09:17:21.084254+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:17:21.084254+0000","last_undegraded":"2024-09-19T09:17:21.084254+0000","last_fullsized":"2024-09-19T09:17:21.084254+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:58.919093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":451,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194860,"statfs":{"total":200000000,"available":199537424,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":446,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194866,"statfs":{"total":200000000,"available":199543241,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1028,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194284,"statfs":{"total":200000000,"available":198947056,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":446,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194866,"statfs":{"total":200000000,"available":199543241,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":451,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194860,"statfs":{"total":200000000,"available":199537424,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":451,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194860,"statfs":{"total":200000000,"available":199537424,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1028,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194284,"statfs":{"total":200000000,"available":198947056,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":446,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194866,"statfs":{"total":200000000,"available":199543241,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:17:26.424 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:17:26.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.560+0000 7fc0f400e640 1 Processor -- start 2024-09-19T09:17:26.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.560+0000 7fc0f400e640 1 -- start start 2024-09-19T09:17:26.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.561+0000 7fc0f400e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc0ec1630f0 0x7fc0ec0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:26.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.561+0000 7fc0f400e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0ec0d0a10 con 0x7fc0ec15ed30 2024-09-19T09:17:26.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.561+0000 7fc0f400e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0ec070ab0 con 0x7fc0ec0b5200 2024-09-19T09:17:26.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.561+0000 7fc0f400e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fc0ec0d0cb0 con 0x7fc0ec1630f0 2024-09-19T09:17:26.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.561+0000 7fc0f1daa640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc0ec15ed30 0x7fc0ec070260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:37430/0 (socket says 172.21.15.18:37430) 2024-09-19T09:17:26.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.561+0000 7fc0f1daa640 1 -- 172.21.15.18:0/3316716751 learned_addr learned my addr 172.21.15.18:0/3316716751 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:17:26.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.561+0000 7fc0f25ab640 1 --2- 172.21.15.18:0/3316716751 >> v2:172.21.15.18:3300/0 conn(0x7fc0ec1630f0 0x7fc0ec0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:26.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.561+0000 7fc0f0da8640 1 -- 172.21.15.18:0/3316716751 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4093300000 0 0) 0x7fc0ec0d0a10 con 0x7fc0ec15ed30 2024-09-19T09:17:26.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.561+0000 7fc0f0da8640 1 -- 172.21.15.18:0/3316716751 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0d8003520 con 0x7fc0ec15ed30 2024-09-19T09:17:26.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.562+0000 7fc0f25ab640 1 -- 172.21.15.18:0/3316716751 >> v1:172.21.15.162:6789/0 conn(0x7fc0ec0b5200 legacy=0x7fc0ec1629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:26.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.562+0000 7fc0f25ab640 1 -- 172.21.15.18:0/3316716751 >> v1:172.21.15.18:6789/0 conn(0x7fc0ec15ed30 legacy=0x7fc0ec070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:26.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.562+0000 7fc0f25ab640 1 -- 172.21.15.18:0/3316716751 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0ec0d0f90 con 0x7fc0ec1630f0 2024-09-19T09:17:26.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.562+0000 7fc0f25ab640 1 --2- 172.21.15.18:0/3316716751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0ec1630f0 0x7fc0ec0cf1e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4009d90 tx=0x7fc0e402a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f320c8640e0e471 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:26.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.562+0000 7fc0f0da8640 1 -- 172.21.15.18:0/3316716751 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e4037070 con 0x7fc0ec1630f0 2024-09-19T09:17:26.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.562+0000 7fc0f0da8640 1 -- 172.21.15.18:0/3316716751 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0e4007740 con 0x7fc0ec1630f0 2024-09-19T09:17:26.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.562+0000 7fc0f0da8640 1 -- 172.21.15.18:0/3316716751 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e4007b10 con 0x7fc0ec1630f0 2024-09-19T09:17:26.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.563+0000 7fc0f400e640 1 -- 172.21.15.18:0/3316716751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0ec1630f0 msgr2=0x7fc0ec0cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:26.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.563+0000 7fc0f400e640 1 --2- 172.21.15.18:0/3316716751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0ec1630f0 0x7fc0ec0cf1e0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fc0e4009d90 tx=0x7fc0e402a780 comp rx=0 tx=0).stop 2024-09-19T09:17:26.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.563+0000 7fc0f400e640 1 -- 172.21.15.18:0/3316716751 shutdown_connections 2024-09-19T09:17:26.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.563+0000 7fc0f400e640 1 --2- 172.21.15.18:0/3316716751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0ec1630f0 0x7fc0ec0cf1e0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:26.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.563+0000 7fc0f400e640 1 -- 172.21.15.18:0/3316716751 >> 172.21.15.18:0/3316716751 conn(0x7fc0ec0b4600 msgr2=0x7fc0ec0b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:26.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.563+0000 7fc0f400e640 1 -- 172.21.15.18:0/3316716751 shutdown_connections 2024-09-19T09:17:26.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.563+0000 7fc0f400e640 1 -- 172.21.15.18:0/3316716751 wait complete. 2024-09-19T09:17:26.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.564+0000 7fc0f400e640 1 Processor -- start 2024-09-19T09:17:26.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.564+0000 7fc0f400e640 1 -- start start 2024-09-19T09:17:26.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.565+0000 7fc0f400e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0ec0b5200 0x7fc0ec15c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:26.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.565+0000 7fc0f400e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0ec15ed30 0x7fc0ec0cf0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:26.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.565+0000 7fc0f400e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0ec1630f0 0x7fc0ec0cf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:26.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.565+0000 7fc0f400e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ec15f290 con 0x7fc0ec0b5200 2024-09-19T09:17:26.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.565+0000 7fc0f400e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc0ec15f110 con 0x7fc0ec15ed30 2024-09-19T09:17:26.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.565+0000 7fc0f400e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc0ec0d24c0 con 0x7fc0ec1630f0 2024-09-19T09:17:26.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.565+0000 7fc0f1daa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0ec0b5200 0x7fc0ec15c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:26.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.565+0000 7fc0f1daa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0ec0b5200 0x7fc0ec15c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34144/0 (socket says 172.21.15.18:34144) 2024-09-19T09:17:26.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.565+0000 7fc0f1daa640 1 -- 172.21.15.18:0/433265412 learned_addr learned my addr 172.21.15.18:0/433265412 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:26.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.565+0000 7fc0f25ab640 1 --2- 172.21.15.18:0/433265412 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0ec1630f0 0x7fc0ec0cf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:26.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.565+0000 7fc0f15a9640 1 --2- 172.21.15.18:0/433265412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0ec15ed30 0x7fc0ec0cf0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:26.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.565+0000 7fc0f1daa640 1 -- 172.21.15.18:0/433265412 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0ec1630f0 msgr2=0x7fc0ec0cf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:26.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.565+0000 7fc0f1daa640 1 --2- 172.21.15.18:0/433265412 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0ec1630f0 0x7fc0ec0cf5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:26.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.565+0000 7fc0f1daa640 1 -- 172.21.15.18:0/433265412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0ec15ed30 msgr2=0x7fc0ec0cf0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:26.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.565+0000 7fc0f1daa640 1 --2- 172.21.15.18:0/433265412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0ec15ed30 0x7fc0ec0cf0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:26.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.565+0000 7fc0f1daa640 1 -- 172.21.15.18:0/433265412 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0ec15c900 con 0x7fc0ec0b5200 2024-09-19T09:17:26.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.566+0000 7fc0f1daa640 1 --2- 172.21.15.18:0/433265412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0ec0b5200 0x7fc0ec15c3c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc0e800c500 tx=0x7fc0e800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:26.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.566+0000 7fc0e27fc640 1 -- 172.21.15.18:0/433265412 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8017070 con 0x7fc0ec0b5200 2024-09-19T09:17:26.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.566+0000 7fc0e27fc640 1 -- 172.21.15.18:0/433265412 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc0e8005ce0 con 0x7fc0ec0b5200 2024-09-19T09:17:26.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.566+0000 7fc0f400e640 1 -- 172.21.15.18:0/433265412 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0ec0b87c0 con 0x7fc0ec0b5200 2024-09-19T09:17:26.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.566+0000 7fc0e27fc640 1 -- 172.21.15.18:0/433265412 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0e8007330 con 0x7fc0ec0b5200 2024-09-19T09:17:26.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.566+0000 7fc0f400e640 1 -- 172.21.15.18:0/433265412 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0ec1f8250 con 0x7fc0ec0b5200 2024-09-19T09:17:26.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.567+0000 7fc0f400e640 1 -- 172.21.15.18:0/433265412 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0ec1629e0 con 0x7fc0ec0b5200 2024-09-19T09:17:26.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.567+0000 7fc0e27fc640 1 -- 172.21.15.18:0/433265412 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc0e801a070 con 0x7fc0ec0b5200 2024-09-19T09:17:26.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.568+0000 7fc0e27fc640 1 --2- 172.21.15.18:0/433265412 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc0d006c2e0 0x7fc0d006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:26.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.568+0000 7fc0e27fc640 1 -- 172.21.15.18:0/433265412 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5709+0+0 (secure 0 0 0) 0x7fc0e808a770 con 0x7fc0ec0b5200 2024-09-19T09:17:26.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.568+0000 7fc0f15a9640 1 --2- 172.21.15.18:0/433265412 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc0d006c2e0 0x7fc0d006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:26.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.569+0000 7fc0f15a9640 1 --2- 172.21.15.18:0/433265412 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc0d006c2e0 0x7fc0d006e7a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec0cd050 tx=0x7fc0dc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:26.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.572+0000 7fc0e27fc640 1 -- 172.21.15.18:0/433265412 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc0e80589e0 con 0x7fc0ec0b5200 2024-09-19T09:17:26.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.744+0000 7fc0f400e640 1 -- 172.21.15.18:0/433265412 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc0ec0d02e0 con 0x7fc0d006c2e0 2024-09-19T09:17:26.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.750+0000 7fc0e27fc640 1 -- 172.21.15.18:0/433265412 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237510 (secure 0 0 0) 0x7fc0ec0d02e0 con 0x7fc0d006c2e0 2024-09-19T09:17:26.753 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:17:26.754 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:17:26.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.753+0000 7fc0f400e640 1 -- 172.21.15.18:0/433265412 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc0d006c2e0 msgr2=0x7fc0d006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:26.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.753+0000 7fc0f400e640 1 --2- 172.21.15.18:0/433265412 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc0d006c2e0 0x7fc0d006e7a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec0cd050 tx=0x7fc0dc009040 comp rx=0 tx=0).stop 2024-09-19T09:17:26.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.753+0000 7fc0f400e640 1 -- 172.21.15.18:0/433265412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0ec0b5200 msgr2=0x7fc0ec15c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:26.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.753+0000 7fc0f400e640 1 --2- 172.21.15.18:0/433265412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0ec0b5200 0x7fc0ec15c3c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc0e800c500 tx=0x7fc0e800c9c0 comp rx=0 tx=0).stop 2024-09-19T09:17:26.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.753+0000 7fc0f400e640 1 -- 172.21.15.18:0/433265412 shutdown_connections 2024-09-19T09:17:26.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.753+0000 7fc0f400e640 1 --2- 172.21.15.18:0/433265412 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc0d006c2e0 0x7fc0d006e7a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:26.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.753+0000 7fc0f400e640 1 --2- 172.21.15.18:0/433265412 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc0ec1630f0 0x7fc0ec0cf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:26.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.753+0000 7fc0f400e640 1 --2- 172.21.15.18:0/433265412 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0ec15ed30 0x7fc0ec0cf0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:26.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.753+0000 7fc0f400e640 1 --2- 172.21.15.18:0/433265412 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0ec0b5200 0x7fc0ec15c3c0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:26.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.753+0000 7fc0f400e640 1 -- 172.21.15.18:0/433265412 >> 172.21.15.18:0/433265412 conn(0x7fc0ec0b4600 msgr2=0x7fc0ec070260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:26.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.753+0000 7fc0f400e640 1 -- 172.21.15.18:0/433265412 shutdown_connections 2024-09-19T09:17:26.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.753+0000 7fc0f400e640 1 -- 172.21.15.18:0/433265412 wait complete. 2024-09-19T09:17:26.765 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2024-09-19T09:17:25.580860+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4749,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557750,"statfs":{"total":1600000000,"available":1595136107,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.500322"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.081909+0000","last_change":"2024-09-19T09:17:21.081909+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.081909+0000","last_undegraded":"2024-09-19T09:17:21.081909+0000","last_fullsized":"2024-09-19T09:17:21.081909+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.081224+0000","last_change":"2024-09-19T09:17:21.081224+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.081224+0000","last_undegraded":"2024-09-19T09:17:21.081224+0000","last_fullsized":"2024-09-19T09:17:21.081224+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083093+0000","last_change":"2024-09-19T09:17:21.083093+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083093+0000","last_undegraded":"2024-09-19T09:17:21.083093+0000","last_fullsized":"2024-09-19T09:17:21.083093+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.081905+0000","last_change":"2024-09-19T09:17:21.081905+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.081905+0000","last_undegraded":"2024-09-19T09:17:21.081905+0000","last_fullsized":"2024-09-19T09:17:21.081905+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083080+0000","last_change":"2024-09-19T09:17:21.083080+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083080+0000","last_undegraded":"2024-09-19T09:17:21.083080+0000","last_fullsized":"2024-09-19T09:17:21.083080+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083999+0000","last_change":"2024-09-19T09:17:21.083999+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083999+0000","last_undegraded":"2024-09-19T09:17:21.083999+0000","last_fullsized":"2024-09-19T09:17:21.083999+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083770+0000","last_change":"2024-09-19T09:17:21.083770+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083770+0000","last_undegraded":"2024-09-19T09:17:21.083770+0000","last_fullsized":"2024-09-19T09:17:21.083770+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083577+0000","last_change":"2024-09-19T09:17:21.083577+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083577+0000","last_undegraded":"2024-09-19T09:17:21.083577+0000","last_fullsized":"2024-09-19T09:17:21.083577+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083145+0000","last_change":"2024-09-19T09:17:21.083145+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083145+0000","last_undegraded":"2024-09-19T09:17:21.083145+0000","last_fullsized":"2024-09-19T09:17:21.083145+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082044+0000","last_change":"2024-09-19T09:17:21.082044+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082044+0000","last_undegraded":"2024-09-19T09:17:21.082044+0000","last_fullsized":"2024-09-19T09:17:21.082044+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082712+0000","last_change":"2024-09-19T09:17:21.082712+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082712+0000","last_undegraded":"2024-09-19T09:17:21.082712+0000","last_fullsized":"2024-09-19T09:17:21.082712+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083362+0000","last_change":"2024-09-19T09:17:21.083362+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083362+0000","last_undegraded":"2024-09-19T09:17:21.083362+0000","last_fullsized":"2024-09-19T09:17:21.083362+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082962+0000","last_change":"2024-09-19T09:17:21.082962+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082962+0000","last_undegraded":"2024-09-19T09:17:21.082962+0000","last_fullsized":"2024-09-19T09:17:21.082962+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.084396+0000","last_change":"2024-09-19T09:17:21.084396+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.084396+0000","last_undegraded":"2024-09-19T09:17:21.084396+0000","last_fullsized":"2024-09-19T09:17:21.084396+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083621+0000","last_change":"2024-09-19T09:17:21.083621+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083621+0000","last_undegraded":"2024-09-19T09:17:21.083621+0000","last_fullsized":"2024-09-19T09:17:21.083621+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083690+0000","last_change":"2024-09-19T09:17:21.083690+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083690+0000","last_undegraded":"2024-09-19T09:17:21.083690+0000","last_fullsized":"2024-09-19T09:17:21.083690+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083410+0000","last_change":"2024-09-19T09:17:21.083410+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083410+0000","last_undegraded":"2024-09-19T09:17:21.083410+0000","last_fullsized":"2024-09-19T09:17:21.083410+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082420+0000","last_change":"2024-09-19T09:17:21.082420+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082420+0000","last_undegraded":"2024-09-19T09:17:21.082420+0000","last_fullsized":"2024-09-19T09:17:21.082420+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082415+0000","last_change":"2024-09-19T09:17:21.082415+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082415+0000","last_undegraded":"2024-09-19T09:17:21.082415+0000","last_fullsized":"2024-09-19T09:17:21.082415+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082233+0000","last_change":"2024-09-19T09:17:21.082233+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082233+0000","last_undegraded":"2024-09-19T09:17:21.082233+0000","last_fullsized":"2024-09-19T09:17:21.082233+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082325+0000","last_change":"2024-09-19T09:17:21.082325+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082325+0000","last_undegraded":"2024-09-19T09:17:21.082325+0000","last_fullsized":"2024-09-19T09:17:21.082325+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082133+0000","last_change":"2024-09-19T09:17:21.082133+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082133+0000","last_undegraded":"2024-09-19T09:17:21.082133+0000","last_fullsized":"2024-09-19T09:17:21.082133+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.081262+0000","last_change":"2024-09-19T09:17:21.081262+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.081262+0000","last_undegraded":"2024-09-19T09:17:21.081262+0000","last_fullsized":"2024-09-19T09:17:21.081262+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083074+0000","last_change":"2024-09-19T09:17:21.083074+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083074+0000","last_undegraded":"2024-09-19T09:17:21.083074+0000","last_fullsized":"2024-09-19T09:17:21.083074+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083120+0000","last_change":"2024-09-19T09:17:21.083120+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083120+0000","last_undegraded":"2024-09-19T09:17:21.083120+0000","last_fullsized":"2024-09-19T09:17:21.083120+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082698+0000","last_change":"2024-09-19T09:17:21.082698+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082698+0000","last_undegraded":"2024-09-19T09:17:21.082698+0000","last_fullsized":"2024-09-19T09:17:21.082698+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083204+0000","last_change":"2024-09-19T09:17:21.083204+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083204+0000","last_undegraded":"2024-09-19T09:17:21.083204+0000","last_fullsized":"2024-09-19T09:17:21.083204+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083131+0000","last_change":"2024-09-19T09:17:21.083131+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083131+0000","last_undegraded":"2024-09-19T09:17:21.083131+0000","last_fullsized":"2024-09-19T09:17:21.083131+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.080942+0000","last_change":"2024-09-19T09:17:21.080942+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.080942+0000","last_undegraded":"2024-09-19T09:17:21.080942+0000","last_fullsized":"2024-09-19T09:17:21.080942+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082042+0000","last_change":"2024-09-19T09:17:21.082042+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082042+0000","last_undegraded":"2024-09-19T09:17:21.082042+0000","last_fullsized":"2024-09-19T09:17:21.082042+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.081905+0000","last_change":"2024-09-19T09:17:21.081905+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.081905+0000","last_undegraded":"2024-09-19T09:17:21.081905+0000","last_fullsized":"2024-09-19T09:17:21.081905+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083363+0000","last_change":"2024-09-19T09:17:21.083363+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083363+0000","last_undegraded":"2024-09-19T09:17:21.083363+0000","last_fullsized":"2024-09-19T09:17:21.083363+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":300,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:17:21.084254+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:17:21.084254+0000","last_peered":"2024-09-19T09:17:21.084254+0000","last_clean":"2024-09-19T09:17:21.084254+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:17:21.084254+0000","last_undegraded":"2024-09-19T09:17:21.084254+0000","last_fullsized":"2024-09-19T09:17:21.084254+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:58.919093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":451,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194860,"statfs":{"total":200000000,"available":199537424,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":446,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194866,"statfs":{"total":200000000,"available":199543241,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1028,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194284,"statfs":{"total":200000000,"available":198947056,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":446,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194866,"statfs":{"total":200000000,"available":199543241,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":451,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194860,"statfs":{"total":200000000,"available":199537424,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":451,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194860,"statfs":{"total":200000000,"available":199537424,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1028,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194284,"statfs":{"total":200000000,"available":198947056,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":446,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194866,"statfs":{"total":200000000,"available":199543241,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:17:26.768 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3f is not active+clean 2024-09-19T09:17:26.768 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.769 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3e is not active+clean 2024-09-19T09:17:26.769 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.769 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3d is not active+clean 2024-09-19T09:17:26.769 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.769 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3c is not active+clean 2024-09-19T09:17:26.769 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.769 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3b is not active+clean 2024-09-19T09:17:26.769 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.769 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3a is not active+clean 2024-09-19T09:17:26.770 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.770 INFO:tasks.ceph.ceph_manager.ceph:PG 11.39 is not active+clean 2024-09-19T09:17:26.770 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.770 INFO:tasks.ceph.ceph_manager.ceph:PG 11.38 is not active+clean 2024-09-19T09:17:26.770 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.770 INFO:tasks.ceph.ceph_manager.ceph:PG 11.37 is not active+clean 2024-09-19T09:17:26.770 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.770 INFO:tasks.ceph.ceph_manager.ceph:PG 11.36 is not active+clean 2024-09-19T09:17:26.770 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.770 INFO:tasks.ceph.ceph_manager.ceph:PG 11.35 is not active+clean 2024-09-19T09:17:26.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.771 INFO:tasks.ceph.ceph_manager.ceph:PG 11.34 is not active+clean 2024-09-19T09:17:26.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.771 INFO:tasks.ceph.ceph_manager.ceph:PG 11.33 is not active+clean 2024-09-19T09:17:26.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.771 INFO:tasks.ceph.ceph_manager.ceph:PG 11.32 is not active+clean 2024-09-19T09:17:26.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.771 INFO:tasks.ceph.ceph_manager.ceph:PG 11.31 is not active+clean 2024-09-19T09:17:26.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.771 INFO:tasks.ceph.ceph_manager.ceph:PG 11.30 is not active+clean 2024-09-19T09:17:26.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.772 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2f is not active+clean 2024-09-19T09:17:26.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.772 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2e is not active+clean 2024-09-19T09:17:26.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.772 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2d is not active+clean 2024-09-19T09:17:26.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.772 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2c is not active+clean 2024-09-19T09:17:26.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.772 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2b is not active+clean 2024-09-19T09:17:26.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.773 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2a is not active+clean 2024-09-19T09:17:26.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.773 INFO:tasks.ceph.ceph_manager.ceph:PG 11.29 is not active+clean 2024-09-19T09:17:26.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.773 INFO:tasks.ceph.ceph_manager.ceph:PG 11.28 is not active+clean 2024-09-19T09:17:26.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.773 INFO:tasks.ceph.ceph_manager.ceph:PG 11.27 is not active+clean 2024-09-19T09:17:26.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.774 INFO:tasks.ceph.ceph_manager.ceph:PG 11.26 is not active+clean 2024-09-19T09:17:26.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.774 INFO:tasks.ceph.ceph_manager.ceph:PG 11.25 is not active+clean 2024-09-19T09:17:26.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.774 INFO:tasks.ceph.ceph_manager.ceph:PG 11.24 is not active+clean 2024-09-19T09:17:26.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.775 INFO:tasks.ceph.ceph_manager.ceph:PG 11.23 is not active+clean 2024-09-19T09:17:26.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.775 INFO:tasks.ceph.ceph_manager.ceph:PG 11.22 is not active+clean 2024-09-19T09:17:26.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.775 INFO:tasks.ceph.ceph_manager.ceph:PG 11.21 is not active+clean 2024-09-19T09:17:26.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.775 INFO:tasks.ceph.ceph_manager.ceph:PG 11.20 is not active+clean 2024-09-19T09:17:26.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.775 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1e is not active+clean 2024-09-19T09:17:26.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.776 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1f is not active+clean 2024-09-19T09:17:26.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.081909+0000', 'last_change': '2024-09-19T09:17:21.081909+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.081909+0000', 'last_undegraded': '2024-09-19T09:17:21.081909+0000', 'last_fullsized': '2024-09-19T09:17:21.081909+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:17:26.776 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1f is not active+clean 2024-09-19T09:17:26.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.776 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1e is not active+clean 2024-09-19T09:17:26.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.081224+0000', 'last_change': '2024-09-19T09:17:21.081224+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.081224+0000', 'last_undegraded': '2024-09-19T09:17:21.081224+0000', 'last_fullsized': '2024-09-19T09:17:21.081224+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T09:17:26.777 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1c is not active+clean 2024-09-19T09:17:26.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.777 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1d is not active+clean 2024-09-19T09:17:26.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.083093+0000', 'last_change': '2024-09-19T09:17:21.083093+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.083093+0000', 'last_undegraded': '2024-09-19T09:17:21.083093+0000', 'last_fullsized': '2024-09-19T09:17:21.083093+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T09:17:26.777 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1d is not active+clean 2024-09-19T09:17:26.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.777 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1c is not active+clean 2024-09-19T09:17:26.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.081905+0000', 'last_change': '2024-09-19T09:17:21.081905+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.081905+0000', 'last_undegraded': '2024-09-19T09:17:21.081905+0000', 'last_fullsized': '2024-09-19T09:17:21.081905+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:17:26.777 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1a is not active+clean 2024-09-19T09:17:26.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.778 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1b is not active+clean 2024-09-19T09:17:26.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.083080+0000', 'last_change': '2024-09-19T09:17:21.083080+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.083080+0000', 'last_undegraded': '2024-09-19T09:17:21.083080+0000', 'last_fullsized': '2024-09-19T09:17:21.083080+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T09:17:26.778 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1b is not active+clean 2024-09-19T09:17:26.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.778 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1a is not active+clean 2024-09-19T09:17:26.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.083999+0000', 'last_change': '2024-09-19T09:17:21.083999+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.083999+0000', 'last_undegraded': '2024-09-19T09:17:21.083999+0000', 'last_fullsized': '2024-09-19T09:17:21.083999+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T09:17:26.778 INFO:tasks.ceph.ceph_manager.ceph:PG 11.18 is not active+clean 2024-09-19T09:17:26.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.778 INFO:tasks.ceph.ceph_manager.ceph:PG 10.19 is not active+clean 2024-09-19T09:17:26.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.083770+0000', 'last_change': '2024-09-19T09:17:21.083770+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.083770+0000', 'last_undegraded': '2024-09-19T09:17:21.083770+0000', 'last_fullsized': '2024-09-19T09:17:21.083770+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T09:17:26.779 INFO:tasks.ceph.ceph_manager.ceph:PG 11.19 is not active+clean 2024-09-19T09:17:26.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.779 INFO:tasks.ceph.ceph_manager.ceph:PG 10.18 is not active+clean 2024-09-19T09:17:26.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.083577+0000', 'last_change': '2024-09-19T09:17:21.083577+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.083577+0000', 'last_undegraded': '2024-09-19T09:17:21.083577+0000', 'last_fullsized': '2024-09-19T09:17:21.083577+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T09:17:26.779 INFO:tasks.ceph.ceph_manager.ceph:PG 11.16 is not active+clean 2024-09-19T09:17:26.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.779 INFO:tasks.ceph.ceph_manager.ceph:PG 10.17 is not active+clean 2024-09-19T09:17:26.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.083145+0000', 'last_change': '2024-09-19T09:17:21.083145+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.083145+0000', 'last_undegraded': '2024-09-19T09:17:21.083145+0000', 'last_fullsized': '2024-09-19T09:17:21.083145+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T09:17:26.779 INFO:tasks.ceph.ceph_manager.ceph:PG 11.17 is not active+clean 2024-09-19T09:17:26.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.780 INFO:tasks.ceph.ceph_manager.ceph:PG 10.16 is not active+clean 2024-09-19T09:17:26.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.082044+0000', 'last_change': '2024-09-19T09:17:21.082044+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.082044+0000', 'last_undegraded': '2024-09-19T09:17:21.082044+0000', 'last_fullsized': '2024-09-19T09:17:21.082044+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T09:17:26.780 INFO:tasks.ceph.ceph_manager.ceph:PG 11.14 is not active+clean 2024-09-19T09:17:26.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.780 INFO:tasks.ceph.ceph_manager.ceph:PG 10.15 is not active+clean 2024-09-19T09:17:26.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.082712+0000', 'last_change': '2024-09-19T09:17:21.082712+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.082712+0000', 'last_undegraded': '2024-09-19T09:17:21.082712+0000', 'last_fullsized': '2024-09-19T09:17:21.082712+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T09:17:26.780 INFO:tasks.ceph.ceph_manager.ceph:PG 11.15 is not active+clean 2024-09-19T09:17:26.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.780 INFO:tasks.ceph.ceph_manager.ceph:PG 10.14 is not active+clean 2024-09-19T09:17:26.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.083362+0000', 'last_change': '2024-09-19T09:17:21.083362+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.083362+0000', 'last_undegraded': '2024-09-19T09:17:21.083362+0000', 'last_fullsized': '2024-09-19T09:17:21.083362+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T09:17:26.781 INFO:tasks.ceph.ceph_manager.ceph:PG 11.12 is not active+clean 2024-09-19T09:17:26.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.781 INFO:tasks.ceph.ceph_manager.ceph:PG 10.13 is not active+clean 2024-09-19T09:17:26.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.082962+0000', 'last_change': '2024-09-19T09:17:21.082962+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.082962+0000', 'last_undegraded': '2024-09-19T09:17:21.082962+0000', 'last_fullsized': '2024-09-19T09:17:21.082962+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-19T09:17:26.781 INFO:tasks.ceph.ceph_manager.ceph:PG 11.13 is not active+clean 2024-09-19T09:17:26.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.781 INFO:tasks.ceph.ceph_manager.ceph:PG 10.12 is not active+clean 2024-09-19T09:17:26.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.084396+0000', 'last_change': '2024-09-19T09:17:21.084396+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.084396+0000', 'last_undegraded': '2024-09-19T09:17:21.084396+0000', 'last_fullsized': '2024-09-19T09:17:21.084396+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T09:17:26.782 INFO:tasks.ceph.ceph_manager.ceph:PG 11.10 is not active+clean 2024-09-19T09:17:26.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.782 INFO:tasks.ceph.ceph_manager.ceph:PG 10.11 is not active+clean 2024-09-19T09:17:26.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.083621+0000', 'last_change': '2024-09-19T09:17:21.083621+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.083621+0000', 'last_undegraded': '2024-09-19T09:17:21.083621+0000', 'last_fullsized': '2024-09-19T09:17:21.083621+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T09:17:26.782 INFO:tasks.ceph.ceph_manager.ceph:PG 11.11 is not active+clean 2024-09-19T09:17:26.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.782 INFO:tasks.ceph.ceph_manager.ceph:PG 10.10 is not active+clean 2024-09-19T09:17:26.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.083690+0000', 'last_change': '2024-09-19T09:17:21.083690+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.083690+0000', 'last_undegraded': '2024-09-19T09:17:21.083690+0000', 'last_fullsized': '2024-09-19T09:17:21.083690+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T09:17:26.782 INFO:tasks.ceph.ceph_manager.ceph:PG 11.e is not active+clean 2024-09-19T09:17:26.782 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.783 INFO:tasks.ceph.ceph_manager.ceph:PG 10.f is not active+clean 2024-09-19T09:17:26.783 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.083410+0000', 'last_change': '2024-09-19T09:17:21.083410+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.083410+0000', 'last_undegraded': '2024-09-19T09:17:21.083410+0000', 'last_fullsized': '2024-09-19T09:17:21.083410+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T09:17:26.783 INFO:tasks.ceph.ceph_manager.ceph:PG 11.f is not active+clean 2024-09-19T09:17:26.783 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.783 INFO:tasks.ceph.ceph_manager.ceph:PG 10.e is not active+clean 2024-09-19T09:17:26.783 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.082420+0000', 'last_change': '2024-09-19T09:17:21.082420+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.082420+0000', 'last_undegraded': '2024-09-19T09:17:21.082420+0000', 'last_fullsized': '2024-09-19T09:17:21.082420+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T09:17:26.783 INFO:tasks.ceph.ceph_manager.ceph:PG 11.c is not active+clean 2024-09-19T09:17:26.783 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.783 INFO:tasks.ceph.ceph_manager.ceph:PG 10.d is not active+clean 2024-09-19T09:17:26.783 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.082415+0000', 'last_change': '2024-09-19T09:17:21.082415+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.082415+0000', 'last_undegraded': '2024-09-19T09:17:21.082415+0000', 'last_fullsized': '2024-09-19T09:17:21.082415+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T09:17:26.784 INFO:tasks.ceph.ceph_manager.ceph:PG 11.d is not active+clean 2024-09-19T09:17:26.784 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.784 INFO:tasks.ceph.ceph_manager.ceph:PG 10.c is not active+clean 2024-09-19T09:17:26.784 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.082233+0000', 'last_change': '2024-09-19T09:17:21.082233+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.082233+0000', 'last_undegraded': '2024-09-19T09:17:21.082233+0000', 'last_fullsized': '2024-09-19T09:17:21.082233+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:17:26.784 INFO:tasks.ceph.ceph_manager.ceph:PG 11.b is not active+clean 2024-09-19T09:17:26.784 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.784 INFO:tasks.ceph.ceph_manager.ceph:PG 10.a is not active+clean 2024-09-19T09:17:26.784 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.082325+0000', 'last_change': '2024-09-19T09:17:21.082325+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.082325+0000', 'last_undegraded': '2024-09-19T09:17:21.082325+0000', 'last_fullsized': '2024-09-19T09:17:21.082325+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:17:26.784 INFO:tasks.ceph.ceph_manager.ceph:PG 11.8 is not active+clean 2024-09-19T09:17:26.785 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.785 INFO:tasks.ceph.ceph_manager.ceph:PG 10.9 is not active+clean 2024-09-19T09:17:26.785 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.082133+0000', 'last_change': '2024-09-19T09:17:21.082133+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.082133+0000', 'last_undegraded': '2024-09-19T09:17:21.082133+0000', 'last_fullsized': '2024-09-19T09:17:21.082133+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T09:17:26.785 INFO:tasks.ceph.ceph_manager.ceph:PG 11.9 is not active+clean 2024-09-19T09:17:26.785 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.785 INFO:tasks.ceph.ceph_manager.ceph:PG 10.8 is not active+clean 2024-09-19T09:17:26.785 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.081262+0000', 'last_change': '2024-09-19T09:17:21.081262+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.081262+0000', 'last_undegraded': '2024-09-19T09:17:21.081262+0000', 'last_fullsized': '2024-09-19T09:17:21.081262+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T09:17:26.785 INFO:tasks.ceph.ceph_manager.ceph:PG 11.6 is not active+clean 2024-09-19T09:17:26.785 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.786 INFO:tasks.ceph.ceph_manager.ceph:PG 10.7 is not active+clean 2024-09-19T09:17:26.786 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.083074+0000', 'last_change': '2024-09-19T09:17:21.083074+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.083074+0000', 'last_undegraded': '2024-09-19T09:17:21.083074+0000', 'last_fullsized': '2024-09-19T09:17:21.083074+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T09:17:26.786 INFO:tasks.ceph.ceph_manager.ceph:PG 11.7 is not active+clean 2024-09-19T09:17:26.786 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.786 INFO:tasks.ceph.ceph_manager.ceph:PG 10.6 is not active+clean 2024-09-19T09:17:26.786 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.083120+0000', 'last_change': '2024-09-19T09:17:21.083120+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.083120+0000', 'last_undegraded': '2024-09-19T09:17:21.083120+0000', 'last_fullsized': '2024-09-19T09:17:21.083120+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-19T09:17:26.786 INFO:tasks.ceph.ceph_manager.ceph:PG 11.4 is not active+clean 2024-09-19T09:17:26.786 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.786 INFO:tasks.ceph.ceph_manager.ceph:PG 10.5 is not active+clean 2024-09-19T09:17:26.786 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.082698+0000', 'last_change': '2024-09-19T09:17:21.082698+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.082698+0000', 'last_undegraded': '2024-09-19T09:17:21.082698+0000', 'last_fullsized': '2024-09-19T09:17:21.082698+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T09:17:26.787 INFO:tasks.ceph.ceph_manager.ceph:PG 11.5 is not active+clean 2024-09-19T09:17:26.787 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.787 INFO:tasks.ceph.ceph_manager.ceph:PG 10.4 is not active+clean 2024-09-19T09:17:26.787 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.083204+0000', 'last_change': '2024-09-19T09:17:21.083204+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.083204+0000', 'last_undegraded': '2024-09-19T09:17:21.083204+0000', 'last_fullsized': '2024-09-19T09:17:21.083204+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T09:17:26.787 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2 is not active+clean 2024-09-19T09:17:26.787 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.787 INFO:tasks.ceph.ceph_manager.ceph:PG 10.3 is not active+clean 2024-09-19T09:17:26.787 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.083131+0000', 'last_change': '2024-09-19T09:17:21.083131+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.083131+0000', 'last_undegraded': '2024-09-19T09:17:21.083131+0000', 'last_fullsized': '2024-09-19T09:17:21.083131+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-19T09:17:26.787 INFO:tasks.ceph.ceph_manager.ceph:PG 11.3 is not active+clean 2024-09-19T09:17:26.787 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.788 INFO:tasks.ceph.ceph_manager.ceph:PG 10.2 is not active+clean 2024-09-19T09:17:26.788 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.080942+0000', 'last_change': '2024-09-19T09:17:21.080942+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.080942+0000', 'last_undegraded': '2024-09-19T09:17:21.080942+0000', 'last_fullsized': '2024-09-19T09:17:21.080942+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-19T09:17:26.788 INFO:tasks.ceph.ceph_manager.ceph:PG 11.0 is not active+clean 2024-09-19T09:17:26.788 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.788 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1 is not active+clean 2024-09-19T09:17:26.788 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.082042+0000', 'last_change': '2024-09-19T09:17:21.082042+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.082042+0000', 'last_undegraded': '2024-09-19T09:17:21.082042+0000', 'last_fullsized': '2024-09-19T09:17:21.082042+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-19T09:17:26.788 INFO:tasks.ceph.ceph_manager.ceph:PG 11.1 is not active+clean 2024-09-19T09:17:26.788 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.788 INFO:tasks.ceph.ceph_manager.ceph:PG 10.0 is not active+clean 2024-09-19T09:17:26.788 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.081905+0000', 'last_change': '2024-09-19T09:17:21.081905+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.081905+0000', 'last_undegraded': '2024-09-19T09:17:21.081905+0000', 'last_fullsized': '2024-09-19T09:17:21.081905+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-19T09:17:26.789 INFO:tasks.ceph.ceph_manager.ceph:PG 11.a is not active+clean 2024-09-19T09:17:26.789 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-19T09:17:22.079945+0000', 'last_change': '2024-09-19T09:17:22.079945+0000', 'last_active': '2024-09-19T09:17:22.079945+0000', 'last_peered': '2024-09-19T09:17:22.079945+0000', 'last_clean': '2024-09-19T09:17:22.079945+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:22.079945+0000', 'last_undegraded': '2024-09-19T09:17:22.079945+0000', 'last_fullsized': '2024-09-19T09:17:22.079945+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:22.079945+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-19T09:17:26.789 INFO:tasks.ceph.ceph_manager.ceph:PG 10.b is not active+clean 2024-09-19T09:17:26.789 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 87, 'state': 'creating+peering', 'last_fresh': '2024-09-19T09:17:21.083363+0000', 'last_change': '2024-09-19T09:17:21.083363+0000', 'last_active': '2024-09-19T09:17:21.077762+0000', 'last_peered': '2024-09-19T09:17:21.077762+0000', 'last_clean': '2024-09-19T09:17:21.077762+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-19T09:17:21.083363+0000', 'last_undegraded': '2024-09-19T09:17:21.083363+0000', 'last_fullsized': '2024-09-19T09:17:21.083363+0000', 'mapping_epoch': 87, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 87, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'last_clean_scrub_stamp': '2024-09-19T09:17:21.077762+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-19T09:17:26.790 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-19T09:17:26.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.909+0000 7fd2d1781640 1 Processor -- start 2024-09-19T09:17:26.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.909+0000 7fd2d1781640 1 -- start start 2024-09-19T09:17:26.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.910+0000 7fd2d1781640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd2cc15eea0 0x7fd2cc06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:26.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.910+0000 7fd2d1781640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd2cc0ced00 0x7fd2cc06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:26.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.910+0000 7fd2d1781640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2cc0b60a0 0x7fd2cc0b6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:26.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.910+0000 7fd2d1781640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fd2cc0b6db0 con 0x7fd2cc0ced00 2024-09-19T09:17:26.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.910+0000 7fd2d1781640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd2cc0b7070 con 0x7fd2cc15eea0 2024-09-19T09:17:26.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.910+0000 7fd2d1781640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd2cc0b1390 con 0x7fd2cc0b60a0 2024-09-19T09:17:26.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.910+0000 7fd2ca7fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd2cc0ced00 0x7fd2cc06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:26.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.910+0000 7fd2ca7fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd2cc0ced00 0x7fd2cc06c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34158/0 (socket says 172.21.15.18:34158) 2024-09-19T09:17:26.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.910+0000 7fd2ca7fc640 1 -- 172.21.15.18:0/1113858599 learned_addr learned my addr 172.21.15.18:0/1113858599 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:26.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.910+0000 7fd2ca7fc640 1 -- 172.21.15.18:0/1113858599 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2cc0b60a0 msgr2=0x7fd2cc0b6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:26.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.910+0000 7fd2ca7fc640 1 --2- 172.21.15.18:0/1113858599 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2cc0b60a0 0x7fd2cc0b6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:26.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.910+0000 7fd2ca7fc640 1 -- 172.21.15.18:0/1113858599 >> v2:172.21.15.162:3300/0 conn(0x7fd2cc15eea0 msgr2=0x7fd2cc06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:26.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.910+0000 7fd2ca7fc640 1 --2- 172.21.15.18:0/1113858599 >> v2:172.21.15.162:3300/0 conn(0x7fd2cc15eea0 0x7fd2cc06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:26.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.910+0000 7fd2ca7fc640 1 -- 172.21.15.18:0/1113858599 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2cc0b1670 con 0x7fd2cc0ced00 2024-09-19T09:17:26.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.911+0000 7fd2ca7fc640 1 --2- 172.21.15.18:0/1113858599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2cc0ced00 0x7fd2cc06c150 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc0cec20 tx=0x7fd2c002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49e83d6a3490510c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:26.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.911+0000 7fd2c9ffb640 1 -- 172.21.15.18:0/1113858599 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0037070 con 0x7fd2cc0ced00 2024-09-19T09:17:26.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.911+0000 7fd2c9ffb640 1 -- 172.21.15.18:0/1113858599 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c0032440 con 0x7fd2cc0ced00 2024-09-19T09:17:26.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.911+0000 7fd2c9ffb640 1 -- 172.21.15.18:0/1113858599 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0032810 con 0x7fd2cc0ced00 2024-09-19T09:17:26.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.912+0000 7fd2d1781640 1 -- 172.21.15.18:0/1113858599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2cc0ced00 msgr2=0x7fd2cc06c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:26.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.912+0000 7fd2d1781640 1 --2- 172.21.15.18:0/1113858599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2cc0ced00 0x7fd2cc06c150 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc0cec20 tx=0x7fd2c002a1e0 comp rx=0 tx=0).stop 2024-09-19T09:17:26.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.912+0000 7fd2d1781640 1 -- 172.21.15.18:0/1113858599 shutdown_connections 2024-09-19T09:17:26.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.912+0000 7fd2d1781640 1 --2- 172.21.15.18:0/1113858599 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2cc0b60a0 0x7fd2cc0b6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:26.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.912+0000 7fd2d1781640 1 --2- 172.21.15.18:0/1113858599 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2cc0ced00 0x7fd2cc06c150 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:26.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.912+0000 7fd2d1781640 1 --2- 172.21.15.18:0/1113858599 >> v2:172.21.15.162:3300/0 conn(0x7fd2cc15eea0 0x7fd2cc06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:26.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.912+0000 7fd2d1781640 1 -- 172.21.15.18:0/1113858599 >> 172.21.15.18:0/1113858599 conn(0x7fd2cc0731b0 msgr2=0x7fd2cc0735c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:26.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.912+0000 7fd2d1781640 1 -- 172.21.15.18:0/1113858599 shutdown_connections 2024-09-19T09:17:26.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.912+0000 7fd2d1781640 1 -- 172.21.15.18:0/1113858599 wait complete. 2024-09-19T09:17:26.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.913+0000 7fd2d1781640 1 Processor -- start 2024-09-19T09:17:26.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.913+0000 7fd2d1781640 1 -- start start 2024-09-19T09:17:26.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.914+0000 7fd2d1781640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2cc0b60a0 0x7fd2cc15fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:26.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.914+0000 7fd2d1781640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2cc0ced00 0x7fd2cc1591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:26.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.914+0000 7fd2d1781640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2cc15eea0 0x7fd2cc0caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:26.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.914+0000 7fd2d1781640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd2cc0b1040 con 0x7fd2cc0ced00 2024-09-19T09:17:26.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.914+0000 7fd2d1781640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd2cc0b6a90 con 0x7fd2cc0b60a0 2024-09-19T09:17:26.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.914+0000 7fd2d1781640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd2cc0cdb10 con 0x7fd2cc15eea0 2024-09-19T09:17:26.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.914+0000 7fd2ca7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2cc0ced00 0x7fd2cc1591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:26.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.914+0000 7fd2ca7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2cc0ced00 0x7fd2cc1591e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34172/0 (socket says 172.21.15.18:34172) 2024-09-19T09:17:26.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.914+0000 7fd2ca7fc640 1 -- 172.21.15.18:0/2288987087 learned_addr learned my addr 172.21.15.18:0/2288987087 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:26.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.914+0000 7fd2cb7fe640 1 --2- 172.21.15.18:0/2288987087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2cc15eea0 0x7fd2cc0caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:26.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.914+0000 7fd2caffd640 1 --2- 172.21.15.18:0/2288987087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2cc0b60a0 0x7fd2cc15fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:26.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.914+0000 7fd2ca7fc640 1 -- 172.21.15.18:0/2288987087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2cc15eea0 msgr2=0x7fd2cc0caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:26.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.914+0000 7fd2ca7fc640 1 --2- 172.21.15.18:0/2288987087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2cc15eea0 0x7fd2cc0caef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:26.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.914+0000 7fd2ca7fc640 1 -- 172.21.15.18:0/2288987087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2cc0b60a0 msgr2=0x7fd2cc15fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:26.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.914+0000 7fd2ca7fc640 1 --2- 172.21.15.18:0/2288987087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2cc0b60a0 0x7fd2cc15fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:26.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.914+0000 7fd2ca7fc640 1 -- 172.21.15.18:0/2288987087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2cc1e9e90 con 0x7fd2cc0ced00 2024-09-19T09:17:26.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.914+0000 7fd2ca7fc640 1 --2- 172.21.15.18:0/2288987087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2cc0ced00 0x7fd2cc1591e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0000c00 tx=0x7fd2c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:26.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.915+0000 7fd2b37fe640 1 -- 172.21.15.18:0/2288987087 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0041070 con 0x7fd2cc0ced00 2024-09-19T09:17:26.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.915+0000 7fd2b37fe640 1 -- 172.21.15.18:0/2288987087 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c003c870 con 0x7fd2cc0ced00 2024-09-19T09:17:26.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.915+0000 7fd2b37fe640 1 -- 172.21.15.18:0/2288987087 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0037040 con 0x7fd2cc0ced00 2024-09-19T09:17:26.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.915+0000 7fd2d1781640 1 -- 172.21.15.18:0/2288987087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2cc1e78d0 con 0x7fd2cc0ced00 2024-09-19T09:17:26.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.915+0000 7fd2d1781640 1 -- 172.21.15.18:0/2288987087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2cc159720 con 0x7fd2cc0ced00 2024-09-19T09:17:26.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.916+0000 7fd2d1781640 1 -- 172.21.15.18:0/2288987087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2cc0b6550 con 0x7fd2cc0ced00 2024-09-19T09:17:26.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.916+0000 7fd2b37fe640 1 -- 172.21.15.18:0/2288987087 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd2c0044070 con 0x7fd2cc0ced00 2024-09-19T09:17:26.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.917+0000 7fd2b37fe640 1 --2- 172.21.15.18:0/2288987087 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd2b806c2b0 0x7fd2b806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:26.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.917+0000 7fd2b37fe640 1 -- 172.21.15.18:0/2288987087 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5709+0+0 (secure 0 0 0) 0x7fd2c00ac1c0 con 0x7fd2cc0ced00 2024-09-19T09:17:26.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.917+0000 7fd2caffd640 1 --2- 172.21.15.18:0/2288987087 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd2b806c2b0 0x7fd2b806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:26.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.917+0000 7fd2caffd640 1 --2- 172.21.15.18:0/2288987087 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd2b806c2b0 0x7fd2b806e770 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00b810 tx=0x7fd2bc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:26.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:26.921+0000 7fd2b37fe640 1 -- 172.21.15.18:0/2288987087 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd2c007aae0 con 0x7fd2cc0ced00 2024-09-19T09:17:27.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.172+0000 7fd2d1781640 1 -- 172.21.15.18:0/2288987087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fd2cc074080 con 0x7fd2cc0ced00 2024-09-19T09:17:27.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.172+0000 7fd2b37fe640 1 -- 172.21.15.18:0/2288987087 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1145 (secure 0 0 0) 0x7fd2c007a3e0 con 0x7fd2cc0ced00 2024-09-19T09:17:27.173 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:17:27.173 INFO:teuthology.orchestra.run.smithi018.stdout:{"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":255,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":90,"num_osds":8,"num_up_osds":8,"osd_up_since":1726737196,"num_in_osds":8,"osd_in_since":1726737193,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":4863893,"bytes_avail":1595136107,"bytes_total":1600000000,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":35,"btime":"2024-09-19T09:17:25:094931+0000","id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":5895}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2024-09-19T09:16:39.569671+0000","services":{}},"progress_events":{}} 2024-09-19T09:17:27.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.174+0000 7fd2d1781640 1 -- 172.21.15.18:0/2288987087 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd2b806c2b0 msgr2=0x7fd2b806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:27.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.174+0000 7fd2d1781640 1 --2- 172.21.15.18:0/2288987087 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd2b806c2b0 0x7fd2b806e770 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc00b810 tx=0x7fd2bc008040 comp rx=0 tx=0).stop 2024-09-19T09:17:27.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.174+0000 7fd2d1781640 1 -- 172.21.15.18:0/2288987087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2cc0ced00 msgr2=0x7fd2cc1591e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:27.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.174+0000 7fd2d1781640 1 --2- 172.21.15.18:0/2288987087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2cc0ced00 0x7fd2cc1591e0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0000c00 tx=0x7fd2c00046c0 comp rx=0 tx=0).stop 2024-09-19T09:17:27.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.174+0000 7fd2d1781640 1 -- 172.21.15.18:0/2288987087 shutdown_connections 2024-09-19T09:17:27.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.174+0000 7fd2d1781640 1 --2- 172.21.15.18:0/2288987087 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd2b806c2b0 0x7fd2b806e770 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:27.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.174+0000 7fd2d1781640 1 --2- 172.21.15.18:0/2288987087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd2cc15eea0 0x7fd2cc0caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:27.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.174+0000 7fd2d1781640 1 --2- 172.21.15.18:0/2288987087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd2cc0ced00 0x7fd2cc1591e0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:27.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.174+0000 7fd2d1781640 1 --2- 172.21.15.18:0/2288987087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd2cc0b60a0 0x7fd2cc15fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:27.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.174+0000 7fd2d1781640 1 -- 172.21.15.18:0/2288987087 >> 172.21.15.18:0/2288987087 conn(0x7fd2cc0731b0 msgr2=0x7fd2cc06bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:27.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.174+0000 7fd2d1781640 1 -- 172.21.15.18:0/2288987087 shutdown_connections 2024-09-19T09:17:27.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.174+0000 7fd2d1781640 1 -- 172.21.15.18:0/2288987087 wait complete. 2024-09-19T09:17:27.186 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-19T09:17:27.186 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:17:27.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.289+0000 7fafc5c77640 1 Processor -- start 2024-09-19T09:17:27.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.289+0000 7fafc5c77640 1 -- start start 2024-09-19T09:17:27.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.290+0000 7fafc5c77640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fafc00d1c70 0x7fafc00cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:27.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.290+0000 7fafc5c77640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafc00d31b0 con 0x7fafc00b5b00 2024-09-19T09:17:27.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.290+0000 7fafc5c77640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafc00d3490 con 0x7fafc015ed50 2024-09-19T09:17:27.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.290+0000 7fafc5c77640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fafc00d3770 con 0x7fafc00d1c70 2024-09-19T09:17:27.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.290+0000 7fafbeffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fafc00d1c70 0x7fafc00cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:27.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.290+0000 7fafbffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fafc00b5b00 0x7fafc00cff00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:37432/0 (socket says 172.21.15.18:37432) 2024-09-19T09:17:27.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.290+0000 7fafbffff640 1 -- 172.21.15.18:0/162949102 learned_addr learned my addr 172.21.15.18:0/162949102 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:17:27.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.290+0000 7fafbeffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fafc00d1c70 0x7fafc00cf9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34176/0 (socket says 172.21.15.18:34176) 2024-09-19T09:17:27.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.290+0000 7fafbeffd640 1 -- 172.21.15.18:0/162949102 >> v1:172.21.15.162:6789/0 conn(0x7fafc015ed50 legacy=0x7fafc00d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:27.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.290+0000 7fafbeffd640 1 -- 172.21.15.18:0/162949102 >> v1:172.21.15.18:6789/0 conn(0x7fafc00b5b00 legacy=0x7fafc00cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:27.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.290+0000 7fafbeffd640 1 -- 172.21.15.18:0/162949102 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafc00d3a50 con 0x7fafc00d1c70 2024-09-19T09:17:27.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.290+0000 7fafbe7fc640 1 -- 172.21.15.18:0/162949102 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1450301543 0 0) 0x7fafc00d31b0 con 0x7fafc00b5b00 2024-09-19T09:17:27.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.291+0000 7fafbeffd640 1 --2- 172.21.15.18:0/162949102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafc00d1c70 0x7fafc00cf9c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fafb40097a0 tx=0x7fafb402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cefbd7e4b449ba5a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:27.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.291+0000 7fafbe7fc640 1 -- 172.21.15.18:0/162949102 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb4037070 con 0x7fafc00d1c70 2024-09-19T09:17:27.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.291+0000 7fafbe7fc640 1 -- 172.21.15.18:0/162949102 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb4032440 con 0x7fafc00d1c70 2024-09-19T09:17:27.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.291+0000 7fafbe7fc640 1 -- 172.21.15.18:0/162949102 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb4032810 con 0x7fafc00d1c70 2024-09-19T09:17:27.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.291+0000 7fafc5c77640 1 -- 172.21.15.18:0/162949102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafc00d1c70 msgr2=0x7fafc00cf9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:27.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.291+0000 7fafc5c77640 1 --2- 172.21.15.18:0/162949102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafc00d1c70 0x7fafc00cf9c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fafb40097a0 tx=0x7fafb402a270 comp rx=0 tx=0).stop 2024-09-19T09:17:27.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.291+0000 7fafc5c77640 1 -- 172.21.15.18:0/162949102 shutdown_connections 2024-09-19T09:17:27.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.291+0000 7fafc5c77640 1 --2- 172.21.15.18:0/162949102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafc00d1c70 0x7fafc00cf9c0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:27.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.291+0000 7fafc5c77640 1 -- 172.21.15.18:0/162949102 >> 172.21.15.18:0/162949102 conn(0x7fafc00d4bd0 msgr2=0x7fafc00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:27.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.292+0000 7fafc5c77640 1 -- 172.21.15.18:0/162949102 shutdown_connections 2024-09-19T09:17:27.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.292+0000 7fafc5c77640 1 -- 172.21.15.18:0/162949102 wait complete. 2024-09-19T09:17:27.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.293+0000 7fafc5c77640 1 Processor -- start 2024-09-19T09:17:27.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.293+0000 7fafc5c77640 1 -- start start 2024-09-19T09:17:27.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.294+0000 7fafc5c77640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafc00b5b00 0x7fafc015f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:27.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.294+0000 7fafc5c77640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafc00d1c70 0x7fafc00b9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:27.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.294+0000 7fafc5c77640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fafc015ed50 0x7fafc00cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:27.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.294+0000 7fafc5c77640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fafc015f130 con 0x7fafc00b5b00 2024-09-19T09:17:27.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.294+0000 7fafc5c77640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fafc00d3d30 con 0x7fafc00d1c70 2024-09-19T09:17:27.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.294+0000 7fafc5c77640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fafc00cd3d0 con 0x7fafc015ed50 2024-09-19T09:17:27.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.294+0000 7fafbf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafc00b5b00 0x7fafc015f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:27.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.294+0000 7fafbf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafc00b5b00 0x7fafc015f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34188/0 (socket says 172.21.15.18:34188) 2024-09-19T09:17:27.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.294+0000 7fafbf7fe640 1 -- 172.21.15.18:0/4214428107 learned_addr learned my addr 172.21.15.18:0/4214428107 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:27.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.294+0000 7fafbffff640 1 --2- 172.21.15.18:0/4214428107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fafc015ed50 0x7fafc00cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:27.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.294+0000 7fafbeffd640 1 --2- 172.21.15.18:0/4214428107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafc00d1c70 0x7fafc00b9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:27.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.294+0000 7fafbf7fe640 1 -- 172.21.15.18:0/4214428107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fafc015ed50 msgr2=0x7fafc00cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:27.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.294+0000 7fafbf7fe640 1 --2- 172.21.15.18:0/4214428107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fafc015ed50 0x7fafc00cc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:27.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.294+0000 7fafbf7fe640 1 -- 172.21.15.18:0/4214428107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafc00d1c70 msgr2=0x7fafc00b9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:27.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.294+0000 7fafbf7fe640 1 --2- 172.21.15.18:0/4214428107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafc00d1c70 0x7fafc00b9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:27.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.294+0000 7fafbf7fe640 1 -- 172.21.15.18:0/4214428107 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafc00ba060 con 0x7fafc00b5b00 2024-09-19T09:17:27.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.294+0000 7fafbeffd640 1 --2- 172.21.15.18:0/4214428107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafc00d1c70 0x7fafc00b9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:17:27.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.294+0000 7fafbffff640 1 --2- 172.21.15.18:0/4214428107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fafc015ed50 0x7fafc00cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:17:27.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.294+0000 7fafbf7fe640 1 --2- 172.21.15.18:0/4214428107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafc00b5b00 0x7fafc015f440 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fafb000b3f0 tx=0x7fafb000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:27.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.294+0000 7fafa7fff640 1 -- 172.21.15.18:0/4214428107 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb0015020 con 0x7fafc00b5b00 2024-09-19T09:17:27.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.294+0000 7fafa7fff640 1 -- 172.21.15.18:0/4214428107 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafb0011830 con 0x7fafc00b5b00 2024-09-19T09:17:27.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.294+0000 7fafc5c77640 1 -- 172.21.15.18:0/4214428107 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafc00ba340 con 0x7fafc00b5b00 2024-09-19T09:17:27.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.294+0000 7fafa7fff640 1 -- 172.21.15.18:0/4214428107 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafb0011c20 con 0x7fafc00b5b00 2024-09-19T09:17:27.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.294+0000 7fafc5c77640 1 -- 172.21.15.18:0/4214428107 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafc00b9d70 con 0x7fafc00b5b00 2024-09-19T09:17:27.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.295+0000 7fafc5c77640 1 -- 172.21.15.18:0/4214428107 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafc00cd780 con 0x7fafc00b5b00 2024-09-19T09:17:27.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.296+0000 7fafa7fff640 1 -- 172.21.15.18:0/4214428107 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fafb0018020 con 0x7fafc00b5b00 2024-09-19T09:17:27.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.296+0000 7fafa7fff640 1 --2- 172.21.15.18:0/4214428107 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fafac06c2b0 0x7fafac06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:27.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.296+0000 7fafa7fff640 1 -- 172.21.15.18:0/4214428107 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5709+0+0 (secure 0 0 0) 0x7fafb008b4e0 con 0x7fafc00b5b00 2024-09-19T09:17:27.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.297+0000 7fafbeffd640 1 --2- 172.21.15.18:0/4214428107 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fafac06c2b0 0x7fafac06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:27.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.297+0000 7fafbeffd640 1 --2- 172.21.15.18:0/4214428107 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fafac06c2b0 0x7fafac06e770 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fafb4034000 tx=0x7fafb402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:27.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.301+0000 7fafa7fff640 1 -- 172.21.15.18:0/4214428107 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fafb001f020 con 0x7fafc00b5b00 2024-09-19T09:17:27.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.473+0000 7fafc5c77640 1 -- 172.21.15.18:0/4214428107 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fafc00d21e0 con 0x7fafac06c2b0 2024-09-19T09:17:27.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.478+0000 7fafa7fff640 1 -- 172.21.15.18:0/4214428107 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237510 (secure 0 0 0) 0x7fafc00d21e0 con 0x7fafac06c2b0 2024-09-19T09:17:27.482 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:17:27.483 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:17:27.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.481+0000 7fafc5c77640 1 -- 172.21.15.18:0/4214428107 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fafac06c2b0 msgr2=0x7fafac06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:27.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.481+0000 7fafc5c77640 1 --2- 172.21.15.18:0/4214428107 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fafac06c2b0 0x7fafac06e770 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fafb4034000 tx=0x7fafb402e000 comp rx=0 tx=0).stop 2024-09-19T09:17:27.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.481+0000 7fafc5c77640 1 -- 172.21.15.18:0/4214428107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafc00b5b00 msgr2=0x7fafc015f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:27.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.481+0000 7fafc5c77640 1 --2- 172.21.15.18:0/4214428107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafc00b5b00 0x7fafc015f440 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fafb000b3f0 tx=0x7fafb000b8b0 comp rx=0 tx=0).stop 2024-09-19T09:17:27.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.481+0000 7fafc5c77640 1 -- 172.21.15.18:0/4214428107 shutdown_connections 2024-09-19T09:17:27.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.481+0000 7fafc5c77640 1 --2- 172.21.15.18:0/4214428107 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fafac06c2b0 0x7fafac06e770 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:27.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.481+0000 7fafc5c77640 1 --2- 172.21.15.18:0/4214428107 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fafc015ed50 0x7fafc00cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:27.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.481+0000 7fafc5c77640 1 --2- 172.21.15.18:0/4214428107 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fafc00d1c70 0x7fafc00b9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:27.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.481+0000 7fafc5c77640 1 --2- 172.21.15.18:0/4214428107 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fafc00b5b00 0x7fafc015f440 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:27.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.481+0000 7fafc5c77640 1 -- 172.21.15.18:0/4214428107 >> 172.21.15.18:0/4214428107 conn(0x7fafc00d4bd0 msgr2=0x7fafc00d0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:27.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.482+0000 7fafc5c77640 1 -- 172.21.15.18:0/4214428107 shutdown_connections 2024-09-19T09:17:27.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:27.482+0000 7fafc5c77640 1 -- 172.21.15.18:0/4214428107 wait complete. 2024-09-19T09:17:27.493 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2024-09-19T09:17:25.580860+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4749,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557750,"statfs":{"total":1600000000,"available":1595136107,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.500322"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.081909+0000","last_change":"2024-09-19T09:17:21.081909+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.081909+0000","last_undegraded":"2024-09-19T09:17:21.081909+0000","last_fullsized":"2024-09-19T09:17:21.081909+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.081224+0000","last_change":"2024-09-19T09:17:21.081224+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.081224+0000","last_undegraded":"2024-09-19T09:17:21.081224+0000","last_fullsized":"2024-09-19T09:17:21.081224+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083093+0000","last_change":"2024-09-19T09:17:21.083093+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083093+0000","last_undegraded":"2024-09-19T09:17:21.083093+0000","last_fullsized":"2024-09-19T09:17:21.083093+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.081905+0000","last_change":"2024-09-19T09:17:21.081905+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.081905+0000","last_undegraded":"2024-09-19T09:17:21.081905+0000","last_fullsized":"2024-09-19T09:17:21.081905+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083080+0000","last_change":"2024-09-19T09:17:21.083080+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083080+0000","last_undegraded":"2024-09-19T09:17:21.083080+0000","last_fullsized":"2024-09-19T09:17:21.083080+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083999+0000","last_change":"2024-09-19T09:17:21.083999+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083999+0000","last_undegraded":"2024-09-19T09:17:21.083999+0000","last_fullsized":"2024-09-19T09:17:21.083999+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083770+0000","last_change":"2024-09-19T09:17:21.083770+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083770+0000","last_undegraded":"2024-09-19T09:17:21.083770+0000","last_fullsized":"2024-09-19T09:17:21.083770+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083577+0000","last_change":"2024-09-19T09:17:21.083577+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083577+0000","last_undegraded":"2024-09-19T09:17:21.083577+0000","last_fullsized":"2024-09-19T09:17:21.083577+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083145+0000","last_change":"2024-09-19T09:17:21.083145+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083145+0000","last_undegraded":"2024-09-19T09:17:21.083145+0000","last_fullsized":"2024-09-19T09:17:21.083145+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082044+0000","last_change":"2024-09-19T09:17:21.082044+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082044+0000","last_undegraded":"2024-09-19T09:17:21.082044+0000","last_fullsized":"2024-09-19T09:17:21.082044+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082712+0000","last_change":"2024-09-19T09:17:21.082712+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082712+0000","last_undegraded":"2024-09-19T09:17:21.082712+0000","last_fullsized":"2024-09-19T09:17:21.082712+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083362+0000","last_change":"2024-09-19T09:17:21.083362+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083362+0000","last_undegraded":"2024-09-19T09:17:21.083362+0000","last_fullsized":"2024-09-19T09:17:21.083362+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082962+0000","last_change":"2024-09-19T09:17:21.082962+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082962+0000","last_undegraded":"2024-09-19T09:17:21.082962+0000","last_fullsized":"2024-09-19T09:17:21.082962+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.084396+0000","last_change":"2024-09-19T09:17:21.084396+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.084396+0000","last_undegraded":"2024-09-19T09:17:21.084396+0000","last_fullsized":"2024-09-19T09:17:21.084396+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083621+0000","last_change":"2024-09-19T09:17:21.083621+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083621+0000","last_undegraded":"2024-09-19T09:17:21.083621+0000","last_fullsized":"2024-09-19T09:17:21.083621+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083690+0000","last_change":"2024-09-19T09:17:21.083690+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083690+0000","last_undegraded":"2024-09-19T09:17:21.083690+0000","last_fullsized":"2024-09-19T09:17:21.083690+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083410+0000","last_change":"2024-09-19T09:17:21.083410+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083410+0000","last_undegraded":"2024-09-19T09:17:21.083410+0000","last_fullsized":"2024-09-19T09:17:21.083410+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082420+0000","last_change":"2024-09-19T09:17:21.082420+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082420+0000","last_undegraded":"2024-09-19T09:17:21.082420+0000","last_fullsized":"2024-09-19T09:17:21.082420+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082415+0000","last_change":"2024-09-19T09:17:21.082415+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082415+0000","last_undegraded":"2024-09-19T09:17:21.082415+0000","last_fullsized":"2024-09-19T09:17:21.082415+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082233+0000","last_change":"2024-09-19T09:17:21.082233+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082233+0000","last_undegraded":"2024-09-19T09:17:21.082233+0000","last_fullsized":"2024-09-19T09:17:21.082233+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082325+0000","last_change":"2024-09-19T09:17:21.082325+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082325+0000","last_undegraded":"2024-09-19T09:17:21.082325+0000","last_fullsized":"2024-09-19T09:17:21.082325+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082133+0000","last_change":"2024-09-19T09:17:21.082133+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082133+0000","last_undegraded":"2024-09-19T09:17:21.082133+0000","last_fullsized":"2024-09-19T09:17:21.082133+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.081262+0000","last_change":"2024-09-19T09:17:21.081262+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.081262+0000","last_undegraded":"2024-09-19T09:17:21.081262+0000","last_fullsized":"2024-09-19T09:17:21.081262+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083074+0000","last_change":"2024-09-19T09:17:21.083074+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083074+0000","last_undegraded":"2024-09-19T09:17:21.083074+0000","last_fullsized":"2024-09-19T09:17:21.083074+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083120+0000","last_change":"2024-09-19T09:17:21.083120+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083120+0000","last_undegraded":"2024-09-19T09:17:21.083120+0000","last_fullsized":"2024-09-19T09:17:21.083120+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082698+0000","last_change":"2024-09-19T09:17:21.082698+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082698+0000","last_undegraded":"2024-09-19T09:17:21.082698+0000","last_fullsized":"2024-09-19T09:17:21.082698+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083204+0000","last_change":"2024-09-19T09:17:21.083204+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083204+0000","last_undegraded":"2024-09-19T09:17:21.083204+0000","last_fullsized":"2024-09-19T09:17:21.083204+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083131+0000","last_change":"2024-09-19T09:17:21.083131+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083131+0000","last_undegraded":"2024-09-19T09:17:21.083131+0000","last_fullsized":"2024-09-19T09:17:21.083131+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.080942+0000","last_change":"2024-09-19T09:17:21.080942+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.080942+0000","last_undegraded":"2024-09-19T09:17:21.080942+0000","last_fullsized":"2024-09-19T09:17:21.080942+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.082042+0000","last_change":"2024-09-19T09:17:21.082042+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.082042+0000","last_undegraded":"2024-09-19T09:17:21.082042+0000","last_fullsized":"2024-09-19T09:17:21.082042+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.081905+0000","last_change":"2024-09-19T09:17:21.081905+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.081905+0000","last_undegraded":"2024-09-19T09:17:21.081905+0000","last_fullsized":"2024-09-19T09:17:21.081905+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:17:22.079945+0000","last_change":"2024-09-19T09:17:22.079945+0000","last_active":"2024-09-19T09:17:22.079945+0000","last_peered":"2024-09-19T09:17:22.079945+0000","last_clean":"2024-09-19T09:17:22.079945+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:22.079945+0000","last_undegraded":"2024-09-19T09:17:22.079945+0000","last_fullsized":"2024-09-19T09:17:22.079945+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":87,"state":"creating+peering","last_fresh":"2024-09-19T09:17:21.083363+0000","last_change":"2024-09-19T09:17:21.083363+0000","last_active":"2024-09-19T09:17:21.077762+0000","last_peered":"2024-09-19T09:17:21.077762+0000","last_clean":"2024-09-19T09:17:21.077762+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:17:21.083363+0000","last_undegraded":"2024-09-19T09:17:21.083363+0000","last_fullsized":"2024-09-19T09:17:21.083363+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":300,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-09-19T09:17:21.084254+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:17:21.084254+0000","last_peered":"2024-09-19T09:17:21.084254+0000","last_clean":"2024-09-19T09:17:21.084254+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:17:21.084254+0000","last_undegraded":"2024-09-19T09:17:21.084254+0000","last_fullsized":"2024-09-19T09:17:21.084254+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:58.919093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":451,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194860,"statfs":{"total":200000000,"available":199537424,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":446,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194866,"statfs":{"total":200000000,"available":199543241,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1028,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194284,"statfs":{"total":200000000,"available":198947056,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":446,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194866,"statfs":{"total":200000000,"available":199543241,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":451,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194860,"statfs":{"total":200000000,"available":199537424,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":451,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194860,"statfs":{"total":200000000,"available":199537424,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1028,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194284,"statfs":{"total":200000000,"available":198947056,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":446,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194866,"statfs":{"total":200000000,"available":199543241,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:17:27.983 INFO:tasks.ceph.mds.c.smithi018.stderr:2024-09-19T09:17:27.983+0000 7f17294e1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T09:17:30.498 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:17:30.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.615+0000 7f4f662d2640 1 Processor -- start 2024-09-19T09:17:30.616 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.615+0000 7f4f662d2640 1 -- start start 2024-09-19T09:17:30.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.616+0000 7f4f662d2640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4f6015ed50 0x7f4f600d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:30.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.616+0000 7f4f662d2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f600d1aa0 0x7f4f600b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:30.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.616+0000 7f4f662d2640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f600d31b0 con 0x7f4f600b5030 2024-09-19T09:17:30.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.616+0000 7f4f662d2640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f4f600d1ee0 con 0x7f4f6015ed50 2024-09-19T09:17:30.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.616+0000 7f4f662d2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4f600d3490 con 0x7f4f600d1aa0 2024-09-19T09:17:30.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.616+0000 7f4f5ffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4f6015ed50 0x7f4f600d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:30.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.616+0000 7f4f5ffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4f6015ed50 0x7f4f600d1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34198/0 (socket says 172.21.15.18:34198) 2024-09-19T09:17:30.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.616+0000 7f4f5ffff640 1 -- 172.21.15.18:0/3767159218 learned_addr learned my addr 172.21.15.18:0/3767159218 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:30.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.616+0000 7f4f5f7fe640 1 --2- 172.21.15.18:0/3767159218 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f600d1aa0 0x7f4f600b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:30.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.616+0000 7f4f5ffff640 1 -- 172.21.15.18:0/3767159218 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f600d1aa0 msgr2=0x7f4f600b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:30.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.616+0000 7f4f5ffff640 1 --2- 172.21.15.18:0/3767159218 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f600d1aa0 0x7f4f600b4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:30.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.616+0000 7f4f5ffff640 1 -- 172.21.15.18:0/3767159218 >> v1:172.21.15.162:6789/0 conn(0x7f4f600b5030 legacy=0x7f4f600b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:30.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.616+0000 7f4f5ffff640 1 -- 172.21.15.18:0/3767159218 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f600d3770 con 0x7f4f6015ed50 2024-09-19T09:17:30.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.616+0000 7f4f5f7fe640 1 --2- 172.21.15.18:0/3767159218 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f600d1aa0 0x7f4f600b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:17:30.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.617+0000 7f4f5ffff640 1 --2- 172.21.15.18:0/3767159218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f6015ed50 0x7f4f600d1560 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4f50009870 tx=0x7f4f5002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88b28d06e203e70 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:30.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.617+0000 7f4f5effd640 1 -- 172.21.15.18:0/3767159218 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f50037070 con 0x7f4f6015ed50 2024-09-19T09:17:30.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.617+0000 7f4f5effd640 1 -- 172.21.15.18:0/3767159218 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f50032440 con 0x7f4f6015ed50 2024-09-19T09:17:30.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.617+0000 7f4f5effd640 1 -- 172.21.15.18:0/3767159218 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f50032810 con 0x7f4f6015ed50 2024-09-19T09:17:30.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.618+0000 7f4f662d2640 1 -- 172.21.15.18:0/3767159218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f6015ed50 msgr2=0x7f4f600d1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:30.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.618+0000 7f4f662d2640 1 --2- 172.21.15.18:0/3767159218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f6015ed50 0x7f4f600d1560 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4f50009870 tx=0x7f4f5002a2a0 comp rx=0 tx=0).stop 2024-09-19T09:17:30.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.618+0000 7f4f662d2640 1 -- 172.21.15.18:0/3767159218 shutdown_connections 2024-09-19T09:17:30.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.618+0000 7f4f662d2640 1 --2- 172.21.15.18:0/3767159218 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f600d1aa0 0x7f4f600b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:30.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.618+0000 7f4f662d2640 1 --2- 172.21.15.18:0/3767159218 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f6015ed50 0x7f4f600d1560 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:30.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.618+0000 7f4f662d2640 1 -- 172.21.15.18:0/3767159218 >> 172.21.15.18:0/3767159218 conn(0x7f4f600d4bd0 msgr2=0x7f4f600d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:30.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.618+0000 7f4f662d2640 1 -- 172.21.15.18:0/3767159218 shutdown_connections 2024-09-19T09:17:30.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.618+0000 7f4f662d2640 1 -- 172.21.15.18:0/3767159218 wait complete. 2024-09-19T09:17:30.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.619+0000 7f4f662d2640 1 Processor -- start 2024-09-19T09:17:30.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.619+0000 7f4f662d2640 1 -- start start 2024-09-19T09:17:30.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.620+0000 7f4f662d2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f600b5030 0x7f4f600cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:30.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.620+0000 7f4f662d2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f600d1aa0 0x7f4f600ba450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:30.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.620+0000 7f4f662d2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f6015ed50 0x7f4f600b7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:30.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.620+0000 7f4f662d2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4f600d3d30 con 0x7f4f600b5030 2024-09-19T09:17:30.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.620+0000 7f4f662d2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4f600b45d0 con 0x7f4f6015ed50 2024-09-19T09:17:30.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.620+0000 7f4f662d2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4f6015f130 con 0x7f4f600d1aa0 2024-09-19T09:17:30.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.620+0000 7f4f5ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f600b5030 0x7f4f600cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:30.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.620+0000 7f4f5ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f600b5030 0x7f4f600cc4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34212/0 (socket says 172.21.15.18:34212) 2024-09-19T09:17:30.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.620+0000 7f4f5ffff640 1 -- 172.21.15.18:0/832455207 learned_addr learned my addr 172.21.15.18:0/832455207 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:30.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.620+0000 7f4f5f7fe640 1 --2- 172.21.15.18:0/832455207 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f600d1aa0 0x7f4f600ba450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:30.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.620+0000 7f4f6486f640 1 --2- 172.21.15.18:0/832455207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f6015ed50 0x7f4f600b7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:30.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.621+0000 7f4f5ffff640 1 -- 172.21.15.18:0/832455207 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f600d1aa0 msgr2=0x7f4f600ba450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:30.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.621+0000 7f4f5ffff640 1 --2- 172.21.15.18:0/832455207 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f600d1aa0 0x7f4f600ba450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:30.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.621+0000 7f4f5ffff640 1 -- 172.21.15.18:0/832455207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f6015ed50 msgr2=0x7f4f600b7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:30.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.621+0000 7f4f5ffff640 1 --2- 172.21.15.18:0/832455207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f6015ed50 0x7f4f600b7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:30.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.621+0000 7f4f5ffff640 1 -- 172.21.15.18:0/832455207 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f600ccba0 con 0x7f4f600b5030 2024-09-19T09:17:30.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.621+0000 7f4f5f7fe640 1 --2- 172.21.15.18:0/832455207 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f600d1aa0 0x7f4f600ba450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:30.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.621+0000 7f4f6486f640 1 --2- 172.21.15.18:0/832455207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f6015ed50 0x7f4f600b7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:30.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.621+0000 7f4f5ffff640 1 --2- 172.21.15.18:0/832455207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f600b5030 0x7f4f600cc4e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4f50000c00 tx=0x7f4f500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:30.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.621+0000 7f4f5cff9640 1 -- 172.21.15.18:0/832455207 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f50037040 con 0x7f4f600b5030 2024-09-19T09:17:30.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.621+0000 7f4f5cff9640 1 -- 172.21.15.18:0/832455207 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f50042070 con 0x7f4f600b5030 2024-09-19T09:17:30.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.621+0000 7f4f662d2640 1 -- 172.21.15.18:0/832455207 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f600cce80 con 0x7f4f600b5030 2024-09-19T09:17:30.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.621+0000 7f4f5cff9640 1 -- 172.21.15.18:0/832455207 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f50030bd0 con 0x7f4f600b5030 2024-09-19T09:17:30.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.621+0000 7f4f662d2640 1 -- 172.21.15.18:0/832455207 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f600cd440 con 0x7f4f600b5030 2024-09-19T09:17:30.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.622+0000 7f4f662d2640 1 -- 172.21.15.18:0/832455207 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f600d21e0 con 0x7f4f600b5030 2024-09-19T09:17:30.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.623+0000 7f4f5cff9640 1 -- 172.21.15.18:0/832455207 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4f50047460 con 0x7f4f600b5030 2024-09-19T09:17:30.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.623+0000 7f4f5cff9640 1 --2- 172.21.15.18:0/832455207 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4f4c06c2b0 0x7f4f4c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:30.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.623+0000 7f4f5cff9640 1 -- 172.21.15.18:0/832455207 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5709+0+0 (secure 0 0 0) 0x7f4f500abfe0 con 0x7f4f600b5030 2024-09-19T09:17:30.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.624+0000 7f4f5f7fe640 1 --2- 172.21.15.18:0/832455207 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4f4c06c2b0 0x7f4f4c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:30.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.624+0000 7f4f5f7fe640 1 --2- 172.21.15.18:0/832455207 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4f4c06c2b0 0x7f4f4c06e770 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4f600c8250 tx=0x7f4f54008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:30.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.628+0000 7f4f5cff9640 1 -- 172.21.15.18:0/832455207 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f4f50045360 con 0x7f4f600b5030 2024-09-19T09:17:30.691 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:17:30.693 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:17:30.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.800+0000 7f4f662d2640 1 -- 172.21.15.18:0/832455207 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4f600d5700 con 0x7f4f4c06c2b0 2024-09-19T09:17:30.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.806+0000 7f4f5cff9640 1 -- 172.21.15.18:0/832455207 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247592 (secure 0 0 0) 0x7f4f600d5700 con 0x7f4f4c06c2b0 2024-09-19T09:17:30.809 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:17:30.811 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:17:30.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.809+0000 7f4f662d2640 1 -- 172.21.15.18:0/832455207 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4f4c06c2b0 msgr2=0x7f4f4c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:30.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.809+0000 7f4f662d2640 1 --2- 172.21.15.18:0/832455207 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4f4c06c2b0 0x7f4f4c06e770 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4f600c8250 tx=0x7f4f54008040 comp rx=0 tx=0).stop 2024-09-19T09:17:30.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.809+0000 7f4f662d2640 1 -- 172.21.15.18:0/832455207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f600b5030 msgr2=0x7f4f600cc4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:30.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.809+0000 7f4f662d2640 1 --2- 172.21.15.18:0/832455207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f600b5030 0x7f4f600cc4e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4f50000c00 tx=0x7f4f500046c0 comp rx=0 tx=0).stop 2024-09-19T09:17:30.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.809+0000 7f4f662d2640 1 -- 172.21.15.18:0/832455207 shutdown_connections 2024-09-19T09:17:30.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.809+0000 7f4f662d2640 1 --2- 172.21.15.18:0/832455207 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4f4c06c2b0 0x7f4f4c06e770 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:30.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.809+0000 7f4f662d2640 1 --2- 172.21.15.18:0/832455207 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4f6015ed50 0x7f4f600b7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:30.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.809+0000 7f4f662d2640 1 --2- 172.21.15.18:0/832455207 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4f600d1aa0 0x7f4f600ba450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:30.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.809+0000 7f4f662d2640 1 --2- 172.21.15.18:0/832455207 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4f600b5030 0x7f4f600cc4e0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:30.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.809+0000 7f4f662d2640 1 -- 172.21.15.18:0/832455207 >> 172.21.15.18:0/832455207 conn(0x7f4f600d4bd0 msgr2=0x7f4f600b37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:30.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.809+0000 7f4f662d2640 1 -- 172.21.15.18:0/832455207 shutdown_connections 2024-09-19T09:17:30.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.809+0000 7f4f662d2640 1 -- 172.21.15.18:0/832455207 wait complete. 2024-09-19T09:17:30.820 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2024-09-19T09:17:29.581787+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4922,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557577,"statfs":{"total":1600000000,"available":1594959100,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.494062"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.040965+0000","last_change":"2024-09-19T09:17:23.049312+0000","last_active":"2024-09-19T09:17:24.040965+0000","last_peered":"2024-09-19T09:17:24.040965+0000","last_clean":"2024-09-19T09:17:24.040965+0000","last_became_active":"2024-09-19T09:17:23.049066+0000","last_became_peered":"2024-09-19T09:17:23.049066+0000","last_unstale":"2024-09-19T09:17:24.040965+0000","last_undegraded":"2024-09-19T09:17:24.040965+0000","last_fullsized":"2024-09-19T09:17:24.040965+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:48.719216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.486647+0000","last_change":"2024-09-19T09:17:23.044212+0000","last_active":"2024-09-19T09:17:24.486647+0000","last_peered":"2024-09-19T09:17:24.486647+0000","last_clean":"2024-09-19T09:17:24.486647+0000","last_became_active":"2024-09-19T09:17:23.043814+0000","last_became_peered":"2024-09-19T09:17:23.043814+0000","last_unstale":"2024-09-19T09:17:24.486647+0000","last_undegraded":"2024-09-19T09:17:24.486647+0000","last_fullsized":"2024-09-19T09:17:24.486647+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:55.492942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.487072+0000","last_change":"2024-09-19T09:17:23.041613+0000","last_active":"2024-09-19T09:17:24.487072+0000","last_peered":"2024-09-19T09:17:24.487072+0000","last_clean":"2024-09-19T09:17:24.487072+0000","last_became_active":"2024-09-19T09:17:23.040929+0000","last_became_peered":"2024-09-19T09:17:23.040929+0000","last_unstale":"2024-09-19T09:17:24.487072+0000","last_undegraded":"2024-09-19T09:17:24.487072+0000","last_fullsized":"2024-09-19T09:17:24.487072+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:53.606232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.487141+0000","last_change":"2024-09-19T09:17:23.041129+0000","last_active":"2024-09-19T09:17:24.487141+0000","last_peered":"2024-09-19T09:17:24.487141+0000","last_clean":"2024-09-19T09:17:24.487141+0000","last_became_active":"2024-09-19T09:17:23.040899+0000","last_became_peered":"2024-09-19T09:17:23.040899+0000","last_unstale":"2024-09-19T09:17:24.487141+0000","last_undegraded":"2024-09-19T09:17:24.487141+0000","last_fullsized":"2024-09-19T09:17:24.487141+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:47.013912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.041292+0000","last_change":"2024-09-19T09:17:23.048703+0000","last_active":"2024-09-19T09:17:24.041292+0000","last_peered":"2024-09-19T09:17:24.041292+0000","last_clean":"2024-09-19T09:17:24.041292+0000","last_became_active":"2024-09-19T09:17:23.048290+0000","last_became_peered":"2024-09-19T09:17:23.048290+0000","last_unstale":"2024-09-19T09:17:24.041292+0000","last_undegraded":"2024-09-19T09:17:24.041292+0000","last_fullsized":"2024-09-19T09:17:24.041292+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:10.862692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.707646+0000","last_change":"2024-09-19T09:17:23.046293+0000","last_active":"2024-09-19T09:17:24.707646+0000","last_peered":"2024-09-19T09:17:24.707646+0000","last_clean":"2024-09-19T09:17:24.707646+0000","last_became_active":"2024-09-19T09:17:23.046060+0000","last_became_peered":"2024-09-19T09:17:23.046060+0000","last_unstale":"2024-09-19T09:17:24.707646+0000","last_undegraded":"2024-09-19T09:17:24.707646+0000","last_fullsized":"2024-09-19T09:17:24.707646+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:47:57.367671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.707505+0000","last_change":"2024-09-19T09:17:23.046146+0000","last_active":"2024-09-19T09:17:24.707505+0000","last_peered":"2024-09-19T09:17:24.707505+0000","last_clean":"2024-09-19T09:17:24.707505+0000","last_became_active":"2024-09-19T09:17:23.041954+0000","last_became_peered":"2024-09-19T09:17:23.041954+0000","last_unstale":"2024-09-19T09:17:24.707505+0000","last_undegraded":"2024-09-19T09:17:24.707505+0000","last_fullsized":"2024-09-19T09:17:24.707505+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:01.809670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.040773+0000","last_change":"2024-09-19T09:17:23.047969+0000","last_active":"2024-09-19T09:17:24.040773+0000","last_peered":"2024-09-19T09:17:24.040773+0000","last_clean":"2024-09-19T09:17:24.040773+0000","last_became_active":"2024-09-19T09:17:23.047405+0000","last_became_peered":"2024-09-19T09:17:23.047405+0000","last_unstale":"2024-09-19T09:17:24.040773+0000","last_undegraded":"2024-09-19T09:17:24.040773+0000","last_fullsized":"2024-09-19T09:17:24.040773+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:28.156010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.487304+0000","last_change":"2024-09-19T09:17:23.043443+0000","last_active":"2024-09-19T09:17:24.487304+0000","last_peered":"2024-09-19T09:17:24.487304+0000","last_clean":"2024-09-19T09:17:24.487304+0000","last_became_active":"2024-09-19T09:17:23.043167+0000","last_became_peered":"2024-09-19T09:17:23.043167+0000","last_unstale":"2024-09-19T09:17:24.487304+0000","last_undegraded":"2024-09-19T09:17:24.487304+0000","last_fullsized":"2024-09-19T09:17:24.487304+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:51:28.783565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.708359+0000","last_change":"2024-09-19T09:17:23.044175+0000","last_active":"2024-09-19T09:17:24.708359+0000","last_peered":"2024-09-19T09:17:24.708359+0000","last_clean":"2024-09-19T09:17:24.708359+0000","last_became_active":"2024-09-19T09:17:23.043940+0000","last_became_peered":"2024-09-19T09:17:23.043940+0000","last_unstale":"2024-09-19T09:17:24.708359+0000","last_undegraded":"2024-09-19T09:17:24.708359+0000","last_fullsized":"2024-09-19T09:17:24.708359+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:57.765604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.041221+0000","last_change":"2024-09-19T09:17:23.048679+0000","last_active":"2024-09-19T09:17:24.041221+0000","last_peered":"2024-09-19T09:17:24.041221+0000","last_clean":"2024-09-19T09:17:24.041221+0000","last_became_active":"2024-09-19T09:17:23.048066+0000","last_became_peered":"2024-09-19T09:17:23.048066+0000","last_unstale":"2024-09-19T09:17:24.041221+0000","last_undegraded":"2024-09-19T09:17:24.041221+0000","last_fullsized":"2024-09-19T09:17:24.041221+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:20:10.021343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.101225+0000","last_change":"2024-09-19T09:17:23.041384+0000","last_active":"2024-09-19T09:17:24.101225+0000","last_peered":"2024-09-19T09:17:24.101225+0000","last_clean":"2024-09-19T09:17:24.101225+0000","last_became_active":"2024-09-19T09:17:23.041136+0000","last_became_peered":"2024-09-19T09:17:23.041136+0000","last_unstale":"2024-09-19T09:17:24.101225+0000","last_undegraded":"2024-09-19T09:17:24.101225+0000","last_fullsized":"2024-09-19T09:17:24.101225+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:33:42.405248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.487244+0000","last_change":"2024-09-19T09:17:23.041813+0000","last_active":"2024-09-19T09:17:24.487244+0000","last_peered":"2024-09-19T09:17:24.487244+0000","last_clean":"2024-09-19T09:17:24.487244+0000","last_became_active":"2024-09-19T09:17:23.041203+0000","last_became_peered":"2024-09-19T09:17:23.041203+0000","last_unstale":"2024-09-19T09:17:24.487244+0000","last_undegraded":"2024-09-19T09:17:24.487244+0000","last_fullsized":"2024-09-19T09:17:24.487244+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:41.957865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.101154+0000","last_change":"2024-09-19T09:17:23.047205+0000","last_active":"2024-09-19T09:17:24.101154+0000","last_peered":"2024-09-19T09:17:24.101154+0000","last_clean":"2024-09-19T09:17:24.101154+0000","last_became_active":"2024-09-19T09:17:23.046975+0000","last_became_peered":"2024-09-19T09:17:23.046975+0000","last_unstale":"2024-09-19T09:17:24.101154+0000","last_undegraded":"2024-09-19T09:17:24.101154+0000","last_fullsized":"2024-09-19T09:17:24.101154+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:18.004998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.101350+0000","last_change":"2024-09-19T09:17:23.042350+0000","last_active":"2024-09-19T09:17:24.101350+0000","last_peered":"2024-09-19T09:17:24.101350+0000","last_clean":"2024-09-19T09:17:24.101350+0000","last_became_active":"2024-09-19T09:17:23.042092+0000","last_became_peered":"2024-09-19T09:17:23.042092+0000","last_unstale":"2024-09-19T09:17:24.101350+0000","last_undegraded":"2024-09-19T09:17:24.101350+0000","last_fullsized":"2024-09-19T09:17:24.101350+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:47:40.444656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.041405+0000","last_change":"2024-09-19T09:17:23.048475+0000","last_active":"2024-09-19T09:17:24.041405+0000","last_peered":"2024-09-19T09:17:24.041405+0000","last_clean":"2024-09-19T09:17:24.041405+0000","last_became_active":"2024-09-19T09:17:23.047604+0000","last_became_peered":"2024-09-19T09:17:23.047604+0000","last_unstale":"2024-09-19T09:17:24.041405+0000","last_undegraded":"2024-09-19T09:17:24.041405+0000","last_fullsized":"2024-09-19T09:17:24.041405+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:56.795407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.040984+0000","last_change":"2024-09-19T09:17:23.046705+0000","last_active":"2024-09-19T09:17:24.040984+0000","last_peered":"2024-09-19T09:17:24.040984+0000","last_clean":"2024-09-19T09:17:24.040984+0000","last_became_active":"2024-09-19T09:17:23.046424+0000","last_became_peered":"2024-09-19T09:17:23.046424+0000","last_unstale":"2024-09-19T09:17:24.040984+0000","last_undegraded":"2024-09-19T09:17:24.040984+0000","last_fullsized":"2024-09-19T09:17:24.040984+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:51.608026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.040915+0000","last_change":"2024-09-19T09:17:23.044131+0000","last_active":"2024-09-19T09:17:24.040915+0000","last_peered":"2024-09-19T09:17:24.040915+0000","last_clean":"2024-09-19T09:17:24.040915+0000","last_became_active":"2024-09-19T09:17:23.042659+0000","last_became_peered":"2024-09-19T09:17:23.042659+0000","last_unstale":"2024-09-19T09:17:24.040915+0000","last_undegraded":"2024-09-19T09:17:24.040915+0000","last_fullsized":"2024-09-19T09:17:24.040915+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:59.596037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.040721+0000","last_change":"2024-09-19T09:17:23.043120+0000","last_active":"2024-09-19T09:17:24.040721+0000","last_peered":"2024-09-19T09:17:24.040721+0000","last_clean":"2024-09-19T09:17:24.040721+0000","last_became_active":"2024-09-19T09:17:23.042885+0000","last_became_peered":"2024-09-19T09:17:23.042885+0000","last_unstale":"2024-09-19T09:17:24.040721+0000","last_undegraded":"2024-09-19T09:17:24.040721+0000","last_fullsized":"2024-09-19T09:17:24.040721+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:10:05.590810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.041443+0000","last_change":"2024-09-19T09:17:23.047339+0000","last_active":"2024-09-19T09:17:24.041443+0000","last_peered":"2024-09-19T09:17:24.041443+0000","last_clean":"2024-09-19T09:17:24.041443+0000","last_became_active":"2024-09-19T09:17:23.047008+0000","last_became_peered":"2024-09-19T09:17:23.047008+0000","last_unstale":"2024-09-19T09:17:24.041443+0000","last_undegraded":"2024-09-19T09:17:24.041443+0000","last_fullsized":"2024-09-19T09:17:24.041443+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:06.932806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.486716+0000","last_change":"2024-09-19T09:17:23.046397+0000","last_active":"2024-09-19T09:17:24.486716+0000","last_peered":"2024-09-19T09:17:24.486716+0000","last_clean":"2024-09-19T09:17:24.486716+0000","last_became_active":"2024-09-19T09:17:23.046174+0000","last_became_peered":"2024-09-19T09:17:23.046174+0000","last_unstale":"2024-09-19T09:17:24.486716+0000","last_undegraded":"2024-09-19T09:17:24.486716+0000","last_fullsized":"2024-09-19T09:17:24.486716+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:05.571903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.708021+0000","last_change":"2024-09-19T09:17:23.043492+0000","last_active":"2024-09-19T09:17:24.708021+0000","last_peered":"2024-09-19T09:17:24.708021+0000","last_clean":"2024-09-19T09:17:24.708021+0000","last_became_active":"2024-09-19T09:17:23.043250+0000","last_became_peered":"2024-09-19T09:17:23.043250+0000","last_unstale":"2024-09-19T09:17:24.708021+0000","last_undegraded":"2024-09-19T09:17:24.708021+0000","last_fullsized":"2024-09-19T09:17:24.708021+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:53:41.961568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.707757+0000","last_change":"2024-09-19T09:17:23.050734+0000","last_active":"2024-09-19T09:17:24.707757+0000","last_peered":"2024-09-19T09:17:24.707757+0000","last_clean":"2024-09-19T09:17:24.707757+0000","last_became_active":"2024-09-19T09:17:23.050380+0000","last_became_peered":"2024-09-19T09:17:23.050380+0000","last_unstale":"2024-09-19T09:17:24.707757+0000","last_undegraded":"2024-09-19T09:17:24.707757+0000","last_fullsized":"2024-09-19T09:17:24.707757+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:51.075908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.040801+0000","last_change":"2024-09-19T09:17:23.042600+0000","last_active":"2024-09-19T09:17:24.040801+0000","last_peered":"2024-09-19T09:17:24.040801+0000","last_clean":"2024-09-19T09:17:24.040801+0000","last_became_active":"2024-09-19T09:17:23.042029+0000","last_became_peered":"2024-09-19T09:17:23.042029+0000","last_unstale":"2024-09-19T09:17:24.040801+0000","last_undegraded":"2024-09-19T09:17:24.040801+0000","last_fullsized":"2024-09-19T09:17:24.040801+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:23.308631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.708274+0000","last_change":"2024-09-19T09:17:23.047514+0000","last_active":"2024-09-19T09:17:24.708274+0000","last_peered":"2024-09-19T09:17:24.708274+0000","last_clean":"2024-09-19T09:17:24.708274+0000","last_became_active":"2024-09-19T09:17:23.047263+0000","last_became_peered":"2024-09-19T09:17:23.047263+0000","last_unstale":"2024-09-19T09:17:24.708274+0000","last_undegraded":"2024-09-19T09:17:24.708274+0000","last_fullsized":"2024-09-19T09:17:24.708274+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:38:13.682082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.041592+0000","last_change":"2024-09-19T09:17:23.045311+0000","last_active":"2024-09-19T09:17:24.041592+0000","last_peered":"2024-09-19T09:17:24.041592+0000","last_clean":"2024-09-19T09:17:24.041592+0000","last_became_active":"2024-09-19T09:17:23.044824+0000","last_became_peered":"2024-09-19T09:17:23.044824+0000","last_unstale":"2024-09-19T09:17:24.041592+0000","last_undegraded":"2024-09-19T09:17:24.041592+0000","last_fullsized":"2024-09-19T09:17:24.041592+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:29:56.350330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.041284+0000","last_change":"2024-09-19T09:17:23.042981+0000","last_active":"2024-09-19T09:17:24.041284+0000","last_peered":"2024-09-19T09:17:24.041284+0000","last_clean":"2024-09-19T09:17:24.041284+0000","last_became_active":"2024-09-19T09:17:23.042742+0000","last_became_peered":"2024-09-19T09:17:23.042742+0000","last_unstale":"2024-09-19T09:17:24.041284+0000","last_undegraded":"2024-09-19T09:17:24.041284+0000","last_fullsized":"2024-09-19T09:17:24.041284+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:10.109404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.486660+0000","last_change":"2024-09-19T09:17:23.047775+0000","last_active":"2024-09-19T09:17:24.486660+0000","last_peered":"2024-09-19T09:17:24.486660+0000","last_clean":"2024-09-19T09:17:24.486660+0000","last_became_active":"2024-09-19T09:17:23.047540+0000","last_became_peered":"2024-09-19T09:17:23.047540+0000","last_unstale":"2024-09-19T09:17:24.486660+0000","last_undegraded":"2024-09-19T09:17:24.486660+0000","last_fullsized":"2024-09-19T09:17:24.486660+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:58:57.882551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.487444+0000","last_change":"2024-09-19T09:17:23.040298+0000","last_active":"2024-09-19T09:17:24.487444+0000","last_peered":"2024-09-19T09:17:24.487444+0000","last_clean":"2024-09-19T09:17:24.487444+0000","last_became_active":"2024-09-19T09:17:23.040014+0000","last_became_peered":"2024-09-19T09:17:23.040014+0000","last_unstale":"2024-09-19T09:17:24.487444+0000","last_undegraded":"2024-09-19T09:17:24.487444+0000","last_fullsized":"2024-09-19T09:17:24.487444+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:35.459743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.040940+0000","last_change":"2024-09-19T09:17:23.041219+0000","last_active":"2024-09-19T09:17:24.040940+0000","last_peered":"2024-09-19T09:17:24.040940+0000","last_clean":"2024-09-19T09:17:24.040940+0000","last_became_active":"2024-09-19T09:17:23.040974+0000","last_became_peered":"2024-09-19T09:17:23.040974+0000","last_unstale":"2024-09-19T09:17:24.040940+0000","last_undegraded":"2024-09-19T09:17:24.040940+0000","last_fullsized":"2024-09-19T09:17:24.040940+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:48:01.835226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.486858+0000","last_change":"2024-09-19T09:17:23.048238+0000","last_active":"2024-09-19T09:17:24.486858+0000","last_peered":"2024-09-19T09:17:24.486858+0000","last_clean":"2024-09-19T09:17:24.486858+0000","last_became_active":"2024-09-19T09:17:23.047659+0000","last_became_peered":"2024-09-19T09:17:23.047659+0000","last_unstale":"2024-09-19T09:17:24.486858+0000","last_undegraded":"2024-09-19T09:17:24.486858+0000","last_fullsized":"2024-09-19T09:17:24.486858+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:28.817915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.486734+0000","last_change":"2024-09-19T09:17:23.044880+0000","last_active":"2024-09-19T09:17:24.486734+0000","last_peered":"2024-09-19T09:17:24.486734+0000","last_clean":"2024-09-19T09:17:24.486734+0000","last_became_active":"2024-09-19T09:17:23.044636+0000","last_became_peered":"2024-09-19T09:17:23.044636+0000","last_unstale":"2024-09-19T09:17:24.486734+0000","last_undegraded":"2024-09-19T09:17:24.486734+0000","last_fullsized":"2024-09-19T09:17:24.486734+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:01.227684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.040907+0000","last_change":"2024-09-19T09:17:23.044796+0000","last_active":"2024-09-19T09:17:24.040907+0000","last_peered":"2024-09-19T09:17:24.040907+0000","last_clean":"2024-09-19T09:17:24.040907+0000","last_became_active":"2024-09-19T09:17:23.044559+0000","last_became_peered":"2024-09-19T09:17:23.044559+0000","last_unstale":"2024-09-19T09:17:24.040907+0000","last_undegraded":"2024-09-19T09:17:24.040907+0000","last_fullsized":"2024-09-19T09:17:24.040907+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:39.827735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1f","version":"89'4","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.708005+0000","last_change":"2024-09-19T09:17:22.099142+0000","last_active":"2024-09-19T09:17:24.708005+0000","last_peered":"2024-09-19T09:17:24.708005+0000","last_clean":"2024-09-19T09:17:24.708005+0000","last_became_active":"2024-09-19T09:17:22.096897+0000","last_became_peered":"2024-09-19T09:17:22.096897+0000","last_unstale":"2024-09-19T09:17:24.708005+0000","last_undegraded":"2024-09-19T09:17:24.708005+0000","last_fullsized":"2024-09-19T09:17:24.708005+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:33:10.481571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.487395+0000","last_change":"2024-09-19T09:17:23.044003+0000","last_active":"2024-09-19T09:17:24.487395+0000","last_peered":"2024-09-19T09:17:24.487395+0000","last_clean":"2024-09-19T09:17:24.487395+0000","last_became_active":"2024-09-19T09:17:23.043650+0000","last_became_peered":"2024-09-19T09:17:23.043650+0000","last_unstale":"2024-09-19T09:17:24.487395+0000","last_undegraded":"2024-09-19T09:17:24.487395+0000","last_fullsized":"2024-09-19T09:17:24.487395+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:22:25.580302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"89'1","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.040754+0000","last_change":"2024-09-19T09:17:22.099954+0000","last_active":"2024-09-19T09:17:24.040754+0000","last_peered":"2024-09-19T09:17:24.040754+0000","last_clean":"2024-09-19T09:17:24.040754+0000","last_became_active":"2024-09-19T09:17:22.099659+0000","last_became_peered":"2024-09-19T09:17:22.099659+0000","last_unstale":"2024-09-19T09:17:24.040754+0000","last_undegraded":"2024-09-19T09:17:24.040754+0000","last_fullsized":"2024-09-19T09:17:24.040754+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:07.349874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.707791+0000","last_change":"2024-09-19T09:17:23.045707+0000","last_active":"2024-09-19T09:17:24.707791+0000","last_peered":"2024-09-19T09:17:24.707791+0000","last_clean":"2024-09-19T09:17:24.707791+0000","last_became_active":"2024-09-19T09:17:23.045482+0000","last_became_peered":"2024-09-19T09:17:23.045482+0000","last_unstale":"2024-09-19T09:17:24.707791+0000","last_undegraded":"2024-09-19T09:17:24.707791+0000","last_fullsized":"2024-09-19T09:17:24.707791+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:04.038062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"89'2","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.041002+0000","last_change":"2024-09-19T09:17:22.092639+0000","last_active":"2024-09-19T09:17:24.041002+0000","last_peered":"2024-09-19T09:17:24.041002+0000","last_clean":"2024-09-19T09:17:24.041002+0000","last_became_active":"2024-09-19T09:17:22.092357+0000","last_became_peered":"2024-09-19T09:17:22.092357+0000","last_unstale":"2024-09-19T09:17:24.041002+0000","last_undegraded":"2024-09-19T09:17:24.041002+0000","last_fullsized":"2024-09-19T09:17:24.041002+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:59:11.721308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.708428+0000","last_change":"2024-09-19T09:17:23.048848+0000","last_active":"2024-09-19T09:17:24.708428+0000","last_peered":"2024-09-19T09:17:24.708428+0000","last_clean":"2024-09-19T09:17:24.708428+0000","last_became_active":"2024-09-19T09:17:23.048585+0000","last_became_peered":"2024-09-19T09:17:23.048585+0000","last_unstale":"2024-09-19T09:17:24.708428+0000","last_undegraded":"2024-09-19T09:17:24.708428+0000","last_fullsized":"2024-09-19T09:17:24.708428+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:53.568661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"89'2","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.708057+0000","last_change":"2024-09-19T09:17:22.095486+0000","last_active":"2024-09-19T09:17:24.708057+0000","last_peered":"2024-09-19T09:17:24.708057+0000","last_clean":"2024-09-19T09:17:24.708057+0000","last_became_active":"2024-09-19T09:17:22.094964+0000","last_became_peered":"2024-09-19T09:17:22.094964+0000","last_unstale":"2024-09-19T09:17:24.708057+0000","last_undegraded":"2024-09-19T09:17:24.708057+0000","last_fullsized":"2024-09-19T09:17:24.708057+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:10.085992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.040674+0000","last_change":"2024-09-19T09:17:23.048214+0000","last_active":"2024-09-19T09:17:24.040674+0000","last_peered":"2024-09-19T09:17:24.040674+0000","last_clean":"2024-09-19T09:17:24.040674+0000","last_became_active":"2024-09-19T09:17:23.047734+0000","last_became_peered":"2024-09-19T09:17:23.047734+0000","last_unstale":"2024-09-19T09:17:24.040674+0000","last_undegraded":"2024-09-19T09:17:24.040674+0000","last_fullsized":"2024-09-19T09:17:24.040674+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:58.620853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"89'1","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.101371+0000","last_change":"2024-09-19T09:17:22.103106+0000","last_active":"2024-09-19T09:17:24.101371+0000","last_peered":"2024-09-19T09:17:24.101371+0000","last_clean":"2024-09-19T09:17:24.101371+0000","last_became_active":"2024-09-19T09:17:22.102694+0000","last_became_peered":"2024-09-19T09:17:22.102694+0000","last_unstale":"2024-09-19T09:17:24.101371+0000","last_undegraded":"2024-09-19T09:17:24.101371+0000","last_fullsized":"2024-09-19T09:17:24.101371+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:03.449207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.708172+0000","last_change":"2024-09-19T09:17:23.044267+0000","last_active":"2024-09-19T09:17:24.708172+0000","last_peered":"2024-09-19T09:17:24.708172+0000","last_clean":"2024-09-19T09:17:24.708172+0000","last_became_active":"2024-09-19T09:17:23.044044+0000","last_became_peered":"2024-09-19T09:17:23.044044+0000","last_unstale":"2024-09-19T09:17:24.708172+0000","last_undegraded":"2024-09-19T09:17:24.708172+0000","last_fullsized":"2024-09-19T09:17:24.708172+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:35.539020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"89'1","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.707866+0000","last_change":"2024-09-19T09:17:22.100857+0000","last_active":"2024-09-19T09:17:24.707866+0000","last_peered":"2024-09-19T09:17:24.707866+0000","last_clean":"2024-09-19T09:17:24.707866+0000","last_became_active":"2024-09-19T09:17:22.100613+0000","last_became_peered":"2024-09-19T09:17:22.100613+0000","last_unstale":"2024-09-19T09:17:24.707866+0000","last_undegraded":"2024-09-19T09:17:24.707866+0000","last_fullsized":"2024-09-19T09:17:24.707866+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:07.381254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.707900+0000","last_change":"2024-09-19T09:17:23.043965+0000","last_active":"2024-09-19T09:17:24.707900+0000","last_peered":"2024-09-19T09:17:24.707900+0000","last_clean":"2024-09-19T09:17:24.707900+0000","last_became_active":"2024-09-19T09:17:23.043706+0000","last_became_peered":"2024-09-19T09:17:23.043706+0000","last_unstale":"2024-09-19T09:17:24.707900+0000","last_undegraded":"2024-09-19T09:17:24.707900+0000","last_fullsized":"2024-09-19T09:17:24.707900+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:15:06.592919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.707843+0000","last_change":"2024-09-19T09:17:22.097719+0000","last_active":"2024-09-19T09:17:24.707843+0000","last_peered":"2024-09-19T09:17:24.707843+0000","last_clean":"2024-09-19T09:17:24.707843+0000","last_became_active":"2024-09-19T09:17:22.097408+0000","last_became_peered":"2024-09-19T09:17:22.097408+0000","last_unstale":"2024-09-19T09:17:24.707843+0000","last_undegraded":"2024-09-19T09:17:24.707843+0000","last_fullsized":"2024-09-19T09:17:24.707843+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:24:20.502259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.101336+0000","last_change":"2024-09-19T09:17:23.045810+0000","last_active":"2024-09-19T09:17:24.101336+0000","last_peered":"2024-09-19T09:17:24.101336+0000","last_clean":"2024-09-19T09:17:24.101336+0000","last_became_active":"2024-09-19T09:17:23.045377+0000","last_became_peered":"2024-09-19T09:17:23.045377+0000","last_unstale":"2024-09-19T09:17:24.101336+0000","last_undegraded":"2024-09-19T09:17:24.101336+0000","last_fullsized":"2024-09-19T09:17:24.101336+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:36.487204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.101556+0000","last_change":"2024-09-19T09:17:22.100230+0000","last_active":"2024-09-19T09:17:24.101556+0000","last_peered":"2024-09-19T09:17:24.101556+0000","last_clean":"2024-09-19T09:17:24.101556+0000","last_became_active":"2024-09-19T09:17:22.099690+0000","last_became_peered":"2024-09-19T09:17:22.099690+0000","last_unstale":"2024-09-19T09:17:24.101556+0000","last_undegraded":"2024-09-19T09:17:24.101556+0000","last_fullsized":"2024-09-19T09:17:24.101556+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:42.057385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.707649+0000","last_change":"2024-09-19T09:17:23.045237+0000","last_active":"2024-09-19T09:17:24.707649+0000","last_peered":"2024-09-19T09:17:24.707649+0000","last_clean":"2024-09-19T09:17:24.707649+0000","last_became_active":"2024-09-19T09:17:23.041489+0000","last_became_peered":"2024-09-19T09:17:23.041489+0000","last_unstale":"2024-09-19T09:17:24.707649+0000","last_undegraded":"2024-09-19T09:17:24.707649+0000","last_fullsized":"2024-09-19T09:17:24.707649+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:24.795180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.041762+0000","last_change":"2024-09-19T09:17:22.100119+0000","last_active":"2024-09-19T09:17:24.041762+0000","last_peered":"2024-09-19T09:17:24.041762+0000","last_clean":"2024-09-19T09:17:24.041762+0000","last_became_active":"2024-09-19T09:17:22.099866+0000","last_became_peered":"2024-09-19T09:17:22.099866+0000","last_unstale":"2024-09-19T09:17:24.041762+0000","last_undegraded":"2024-09-19T09:17:24.041762+0000","last_fullsized":"2024-09-19T09:17:24.041762+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:35.040565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.487010+0000","last_change":"2024-09-19T09:17:23.047251+0000","last_active":"2024-09-19T09:17:24.487010+0000","last_peered":"2024-09-19T09:17:24.487010+0000","last_clean":"2024-09-19T09:17:24.487010+0000","last_became_active":"2024-09-19T09:17:23.046939+0000","last_became_peered":"2024-09-19T09:17:23.046939+0000","last_unstale":"2024-09-19T09:17:24.487010+0000","last_undegraded":"2024-09-19T09:17:24.487010+0000","last_fullsized":"2024-09-19T09:17:24.487010+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:15.414426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.486763+0000","last_change":"2024-09-19T09:17:22.101219+0000","last_active":"2024-09-19T09:17:24.486763+0000","last_peered":"2024-09-19T09:17:24.486763+0000","last_clean":"2024-09-19T09:17:24.486763+0000","last_became_active":"2024-09-19T09:17:22.100939+0000","last_became_peered":"2024-09-19T09:17:22.100939+0000","last_unstale":"2024-09-19T09:17:24.486763+0000","last_undegraded":"2024-09-19T09:17:24.486763+0000","last_fullsized":"2024-09-19T09:17:24.486763+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:57.452386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.040986+0000","last_change":"2024-09-19T09:17:23.042272+0000","last_active":"2024-09-19T09:17:24.040986+0000","last_peered":"2024-09-19T09:17:24.040986+0000","last_clean":"2024-09-19T09:17:24.040986+0000","last_became_active":"2024-09-19T09:17:23.041691+0000","last_became_peered":"2024-09-19T09:17:23.041691+0000","last_unstale":"2024-09-19T09:17:24.040986+0000","last_undegraded":"2024-09-19T09:17:24.040986+0000","last_fullsized":"2024-09-19T09:17:24.040986+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:04.688020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"89'3","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.101203+0000","last_change":"2024-09-19T09:17:22.099373+0000","last_active":"2024-09-19T09:17:24.101203+0000","last_peered":"2024-09-19T09:17:24.101203+0000","last_clean":"2024-09-19T09:17:24.101203+0000","last_became_active":"2024-09-19T09:17:22.099072+0000","last_became_peered":"2024-09-19T09:17:22.099072+0000","last_unstale":"2024-09-19T09:17:24.101203+0000","last_undegraded":"2024-09-19T09:17:24.101203+0000","last_fullsized":"2024-09-19T09:17:24.101203+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:57.862809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.041094+0000","last_change":"2024-09-19T09:17:23.044520+0000","last_active":"2024-09-19T09:17:24.041094+0000","last_peered":"2024-09-19T09:17:24.041094+0000","last_clean":"2024-09-19T09:17:24.041094+0000","last_became_active":"2024-09-19T09:17:23.043887+0000","last_became_peered":"2024-09-19T09:17:23.043887+0000","last_unstale":"2024-09-19T09:17:24.041094+0000","last_undegraded":"2024-09-19T09:17:24.041094+0000","last_fullsized":"2024-09-19T09:17:24.041094+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:50.546410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"89'6","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.707934+0000","last_change":"2024-09-19T09:17:22.096947+0000","last_active":"2024-09-19T09:17:24.707934+0000","last_peered":"2024-09-19T09:17:24.707934+0000","last_clean":"2024-09-19T09:17:24.707934+0000","last_became_active":"2024-09-19T09:17:22.096540+0000","last_became_peered":"2024-09-19T09:17:22.096540+0000","last_unstale":"2024-09-19T09:17:24.707934+0000","last_undegraded":"2024-09-19T09:17:24.707934+0000","last_fullsized":"2024-09-19T09:17:24.707934+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:38.781758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.707944+0000","last_change":"2024-09-19T09:17:23.035440+0000","last_active":"2024-09-19T09:17:24.707944+0000","last_peered":"2024-09-19T09:17:24.707944+0000","last_clean":"2024-09-19T09:17:24.707944+0000","last_became_active":"2024-09-19T09:17:23.035303+0000","last_became_peered":"2024-09-19T09:17:23.035303+0000","last_unstale":"2024-09-19T09:17:24.707944+0000","last_undegraded":"2024-09-19T09:17:24.707944+0000","last_fullsized":"2024-09-19T09:17:24.707944+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:58.600908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"89'2","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.707978+0000","last_change":"2024-09-19T09:17:22.097248+0000","last_active":"2024-09-19T09:17:24.707978+0000","last_peered":"2024-09-19T09:17:24.707978+0000","last_clean":"2024-09-19T09:17:24.707978+0000","last_became_active":"2024-09-19T09:17:22.097006+0000","last_became_peered":"2024-09-19T09:17:22.097006+0000","last_unstale":"2024-09-19T09:17:24.707978+0000","last_undegraded":"2024-09-19T09:17:24.707978+0000","last_fullsized":"2024-09-19T09:17:24.707978+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:35.166734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.708497+0000","last_change":"2024-09-19T09:17:23.039609+0000","last_active":"2024-09-19T09:17:24.708497+0000","last_peered":"2024-09-19T09:17:24.708497+0000","last_clean":"2024-09-19T09:17:24.708497+0000","last_became_active":"2024-09-19T09:17:23.039348+0000","last_became_peered":"2024-09-19T09:17:23.039348+0000","last_unstale":"2024-09-19T09:17:24.708497+0000","last_undegraded":"2024-09-19T09:17:24.708497+0000","last_fullsized":"2024-09-19T09:17:24.708497+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:54.156462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.708069+0000","last_change":"2024-09-19T09:17:22.100120+0000","last_active":"2024-09-19T09:17:24.708069+0000","last_peered":"2024-09-19T09:17:24.708069+0000","last_clean":"2024-09-19T09:17:24.708069+0000","last_became_active":"2024-09-19T09:17:22.099877+0000","last_became_peered":"2024-09-19T09:17:22.099877+0000","last_unstale":"2024-09-19T09:17:24.708069+0000","last_undegraded":"2024-09-19T09:17:24.708069+0000","last_fullsized":"2024-09-19T09:17:24.708069+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:10.673456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.041240+0000","last_change":"2024-09-19T09:17:23.047759+0000","last_active":"2024-09-19T09:17:24.041240+0000","last_peered":"2024-09-19T09:17:24.041240+0000","last_clean":"2024-09-19T09:17:24.041240+0000","last_became_active":"2024-09-19T09:17:23.047479+0000","last_became_peered":"2024-09-19T09:17:23.047479+0000","last_unstale":"2024-09-19T09:17:24.041240+0000","last_undegraded":"2024-09-19T09:17:24.041240+0000","last_fullsized":"2024-09-19T09:17:24.041240+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:44:51.419148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.707919+0000","last_change":"2024-09-19T09:17:22.102822+0000","last_active":"2024-09-19T09:17:24.707919+0000","last_peered":"2024-09-19T09:17:24.707919+0000","last_clean":"2024-09-19T09:17:24.707919+0000","last_became_active":"2024-09-19T09:17:22.102577+0000","last_became_peered":"2024-09-19T09:17:22.102577+0000","last_unstale":"2024-09-19T09:17:24.707919+0000","last_undegraded":"2024-09-19T09:17:24.707919+0000","last_fullsized":"2024-09-19T09:17:24.707919+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:50:22.837350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.487162+0000","last_change":"2024-09-19T09:17:23.040629+0000","last_active":"2024-09-19T09:17:24.487162+0000","last_peered":"2024-09-19T09:17:24.487162+0000","last_clean":"2024-09-19T09:17:24.487162+0000","last_became_active":"2024-09-19T09:17:23.040375+0000","last_became_peered":"2024-09-19T09:17:23.040375+0000","last_unstale":"2024-09-19T09:17:24.487162+0000","last_undegraded":"2024-09-19T09:17:24.487162+0000","last_fullsized":"2024-09-19T09:17:24.487162+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:14.961244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"89'8","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.707978+0000","last_change":"2024-09-19T09:17:22.100262+0000","last_active":"2024-09-19T09:17:24.707978+0000","last_peered":"2024-09-19T09:17:24.707978+0000","last_clean":"2024-09-19T09:17:24.707978+0000","last_became_active":"2024-09-19T09:17:22.100029+0000","last_became_peered":"2024-09-19T09:17:22.100029+0000","last_unstale":"2024-09-19T09:17:24.707978+0000","last_undegraded":"2024-09-19T09:17:24.707978+0000","last_fullsized":"2024-09-19T09:17:24.707978+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:08.425320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.486749+0000","last_change":"2024-09-19T09:17:23.047105+0000","last_active":"2024-09-19T09:17:24.486749+0000","last_peered":"2024-09-19T09:17:24.486749+0000","last_clean":"2024-09-19T09:17:24.486749+0000","last_became_active":"2024-09-19T09:17:23.046876+0000","last_became_peered":"2024-09-19T09:17:23.046876+0000","last_unstale":"2024-09-19T09:17:24.486749+0000","last_undegraded":"2024-09-19T09:17:24.486749+0000","last_fullsized":"2024-09-19T09:17:24.486749+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:31.353270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"89'1","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.041013+0000","last_change":"2024-09-19T09:17:22.101538+0000","last_active":"2024-09-19T09:17:24.041013+0000","last_peered":"2024-09-19T09:17:24.041013+0000","last_clean":"2024-09-19T09:17:24.041013+0000","last_became_active":"2024-09-19T09:17:22.101303+0000","last_became_peered":"2024-09-19T09:17:22.101303+0000","last_unstale":"2024-09-19T09:17:24.041013+0000","last_undegraded":"2024-09-19T09:17:24.041013+0000","last_fullsized":"2024-09-19T09:17:24.041013+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:12.380831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.486726+0000","last_change":"2024-09-19T09:17:23.048104+0000","last_active":"2024-09-19T09:17:24.486726+0000","last_peered":"2024-09-19T09:17:24.486726+0000","last_clean":"2024-09-19T09:17:24.486726+0000","last_became_active":"2024-09-19T09:17:23.047868+0000","last_became_peered":"2024-09-19T09:17:23.047868+0000","last_unstale":"2024-09-19T09:17:24.486726+0000","last_undegraded":"2024-09-19T09:17:24.486726+0000","last_fullsized":"2024-09-19T09:17:24.486726+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:40:56.777875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"89'2","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.486868+0000","last_change":"2024-09-19T09:17:22.098908+0000","last_active":"2024-09-19T09:17:24.486868+0000","last_peered":"2024-09-19T09:17:24.486868+0000","last_clean":"2024-09-19T09:17:24.486868+0000","last_became_active":"2024-09-19T09:17:22.098274+0000","last_became_peered":"2024-09-19T09:17:22.098274+0000","last_unstale":"2024-09-19T09:17:24.486868+0000","last_undegraded":"2024-09-19T09:17:24.486868+0000","last_fullsized":"2024-09-19T09:17:24.486868+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:43.358715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.487272+0000","last_change":"2024-09-19T09:17:23.044781+0000","last_active":"2024-09-19T09:17:24.487272+0000","last_peered":"2024-09-19T09:17:24.487272+0000","last_clean":"2024-09-19T09:17:24.487272+0000","last_became_active":"2024-09-19T09:17:23.043681+0000","last_became_peered":"2024-09-19T09:17:23.043681+0000","last_unstale":"2024-09-19T09:17:24.487272+0000","last_undegraded":"2024-09-19T09:17:24.487272+0000","last_fullsized":"2024-09-19T09:17:24.487272+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:29.550272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"89'1","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.487070+0000","last_change":"2024-09-19T09:17:22.098933+0000","last_active":"2024-09-19T09:17:24.487070+0000","last_peered":"2024-09-19T09:17:24.487070+0000","last_clean":"2024-09-19T09:17:24.487070+0000","last_became_active":"2024-09-19T09:17:22.098311+0000","last_became_peered":"2024-09-19T09:17:22.098311+0000","last_unstale":"2024-09-19T09:17:24.487070+0000","last_undegraded":"2024-09-19T09:17:24.487070+0000","last_fullsized":"2024-09-19T09:17:24.487070+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:20.685601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.487077+0000","last_change":"2024-09-19T09:17:23.046555+0000","last_active":"2024-09-19T09:17:24.487077+0000","last_peered":"2024-09-19T09:17:24.487077+0000","last_clean":"2024-09-19T09:17:24.487077+0000","last_became_active":"2024-09-19T09:17:23.046324+0000","last_became_peered":"2024-09-19T09:17:23.046324+0000","last_unstale":"2024-09-19T09:17:24.487077+0000","last_undegraded":"2024-09-19T09:17:24.487077+0000","last_fullsized":"2024-09-19T09:17:24.487077+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:52:38.673428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.708221+0000","last_change":"2024-09-19T09:17:22.100432+0000","last_active":"2024-09-19T09:17:24.708221+0000","last_peered":"2024-09-19T09:17:24.708221+0000","last_clean":"2024-09-19T09:17:24.708221+0000","last_became_active":"2024-09-19T09:17:22.097140+0000","last_became_peered":"2024-09-19T09:17:22.097140+0000","last_unstale":"2024-09-19T09:17:24.708221+0000","last_undegraded":"2024-09-19T09:17:24.708221+0000","last_fullsized":"2024-09-19T09:17:24.708221+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:15:19.366409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.708058+0000","last_change":"2024-09-19T09:17:23.042150+0000","last_active":"2024-09-19T09:17:24.708058+0000","last_peered":"2024-09-19T09:17:24.708058+0000","last_clean":"2024-09-19T09:17:24.708058+0000","last_became_active":"2024-09-19T09:17:23.041912+0000","last_became_peered":"2024-09-19T09:17:23.041912+0000","last_unstale":"2024-09-19T09:17:24.708058+0000","last_undegraded":"2024-09-19T09:17:24.708058+0000","last_fullsized":"2024-09-19T09:17:24.708058+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:43:40.088191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.707626+0000","last_change":"2024-09-19T09:17:22.096530+0000","last_active":"2024-09-19T09:17:24.707626+0000","last_peered":"2024-09-19T09:17:24.707626+0000","last_clean":"2024-09-19T09:17:24.707626+0000","last_became_active":"2024-09-19T09:17:22.095744+0000","last_became_peered":"2024-09-19T09:17:22.095744+0000","last_unstale":"2024-09-19T09:17:24.707626+0000","last_undegraded":"2024-09-19T09:17:24.707626+0000","last_fullsized":"2024-09-19T09:17:24.707626+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:40.848715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.707961+0000","last_change":"2024-09-19T09:17:23.044953+0000","last_active":"2024-09-19T09:17:24.707961+0000","last_peered":"2024-09-19T09:17:24.707961+0000","last_clean":"2024-09-19T09:17:24.707961+0000","last_became_active":"2024-09-19T09:17:23.044705+0000","last_became_peered":"2024-09-19T09:17:23.044705+0000","last_unstale":"2024-09-19T09:17:24.707961+0000","last_undegraded":"2024-09-19T09:17:24.707961+0000","last_fullsized":"2024-09-19T09:17:24.707961+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:45.247131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.486937+0000","last_change":"2024-09-19T09:17:22.099235+0000","last_active":"2024-09-19T09:17:24.486937+0000","last_peered":"2024-09-19T09:17:24.486937+0000","last_clean":"2024-09-19T09:17:24.486937+0000","last_became_active":"2024-09-19T09:17:22.098649+0000","last_became_peered":"2024-09-19T09:17:22.098649+0000","last_unstale":"2024-09-19T09:17:24.486937+0000","last_undegraded":"2024-09-19T09:17:24.486937+0000","last_fullsized":"2024-09-19T09:17:24.486937+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:16.933726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.101506+0000","last_change":"2024-09-19T09:17:23.039054+0000","last_active":"2024-09-19T09:17:24.101506+0000","last_peered":"2024-09-19T09:17:24.101506+0000","last_clean":"2024-09-19T09:17:24.101506+0000","last_became_active":"2024-09-19T09:17:23.038774+0000","last_became_peered":"2024-09-19T09:17:23.038774+0000","last_unstale":"2024-09-19T09:17:24.101506+0000","last_undegraded":"2024-09-19T09:17:24.101506+0000","last_fullsized":"2024-09-19T09:17:24.101506+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:28:35.686744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.041007+0000","last_change":"2024-09-19T09:17:22.098113+0000","last_active":"2024-09-19T09:17:24.041007+0000","last_peered":"2024-09-19T09:17:24.041007+0000","last_clean":"2024-09-19T09:17:24.041007+0000","last_became_active":"2024-09-19T09:17:22.097867+0000","last_became_peered":"2024-09-19T09:17:22.097867+0000","last_unstale":"2024-09-19T09:17:24.041007+0000","last_undegraded":"2024-09-19T09:17:24.041007+0000","last_fullsized":"2024-09-19T09:17:24.041007+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:38.468920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.041336+0000","last_change":"2024-09-19T09:17:23.044316+0000","last_active":"2024-09-19T09:17:24.041336+0000","last_peered":"2024-09-19T09:17:24.041336+0000","last_clean":"2024-09-19T09:17:24.041336+0000","last_became_active":"2024-09-19T09:17:23.043573+0000","last_became_peered":"2024-09-19T09:17:23.043573+0000","last_unstale":"2024-09-19T09:17:24.041336+0000","last_undegraded":"2024-09-19T09:17:24.041336+0000","last_fullsized":"2024-09-19T09:17:24.041336+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:08.750333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"89'2","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.040782+0000","last_change":"2024-09-19T09:17:22.102322+0000","last_active":"2024-09-19T09:17:24.040782+0000","last_peered":"2024-09-19T09:17:24.040782+0000","last_clean":"2024-09-19T09:17:24.040782+0000","last_became_active":"2024-09-19T09:17:22.102001+0000","last_became_peered":"2024-09-19T09:17:22.102001+0000","last_unstale":"2024-09-19T09:17:24.040782+0000","last_undegraded":"2024-09-19T09:17:24.040782+0000","last_fullsized":"2024-09-19T09:17:24.040782+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:54.287399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.707788+0000","last_change":"2024-09-19T09:17:23.041105+0000","last_active":"2024-09-19T09:17:24.707788+0000","last_peered":"2024-09-19T09:17:24.707788+0000","last_clean":"2024-09-19T09:17:24.707788+0000","last_became_active":"2024-09-19T09:17:23.040782+0000","last_became_peered":"2024-09-19T09:17:23.040782+0000","last_unstale":"2024-09-19T09:17:24.707788+0000","last_undegraded":"2024-09-19T09:17:24.707788+0000","last_fullsized":"2024-09-19T09:17:24.707788+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:11.296941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"90'1","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.040856+0000","last_change":"2024-09-19T09:17:22.096180+0000","last_active":"2024-09-19T09:17:24.040856+0000","last_peered":"2024-09-19T09:17:24.040856+0000","last_clean":"2024-09-19T09:17:24.040856+0000","last_became_active":"2024-09-19T09:17:22.095865+0000","last_became_peered":"2024-09-19T09:17:22.095865+0000","last_unstale":"2024-09-19T09:17:24.040856+0000","last_undegraded":"2024-09-19T09:17:24.040856+0000","last_fullsized":"2024-09-19T09:17:24.040856+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:34.679166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.486839+0000","last_change":"2024-09-19T09:17:23.046350+0000","last_active":"2024-09-19T09:17:24.486839+0000","last_peered":"2024-09-19T09:17:24.486839+0000","last_clean":"2024-09-19T09:17:24.486839+0000","last_became_active":"2024-09-19T09:17:23.046109+0000","last_became_peered":"2024-09-19T09:17:23.046109+0000","last_unstale":"2024-09-19T09:17:24.486839+0000","last_undegraded":"2024-09-19T09:17:24.486839+0000","last_fullsized":"2024-09-19T09:17:24.486839+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:51:24.834978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.101484+0000","last_change":"2024-09-19T09:17:22.096485+0000","last_active":"2024-09-19T09:17:24.101484+0000","last_peered":"2024-09-19T09:17:24.101484+0000","last_clean":"2024-09-19T09:17:24.101484+0000","last_became_active":"2024-09-19T09:17:22.095961+0000","last_became_peered":"2024-09-19T09:17:22.095961+0000","last_unstale":"2024-09-19T09:17:24.101484+0000","last_undegraded":"2024-09-19T09:17:24.101484+0000","last_fullsized":"2024-09-19T09:17:24.101484+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:59:31.804573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.708185+0000","last_change":"2024-09-19T09:17:23.041619+0000","last_active":"2024-09-19T09:17:24.708185+0000","last_peered":"2024-09-19T09:17:24.708185+0000","last_clean":"2024-09-19T09:17:24.708185+0000","last_became_active":"2024-09-19T09:17:23.041366+0000","last_became_peered":"2024-09-19T09:17:23.041366+0000","last_unstale":"2024-09-19T09:17:24.708185+0000","last_undegraded":"2024-09-19T09:17:24.708185+0000","last_fullsized":"2024-09-19T09:17:24.708185+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:00:53.887875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.101643+0000","last_change":"2024-09-19T09:17:22.097918+0000","last_active":"2024-09-19T09:17:24.101643+0000","last_peered":"2024-09-19T09:17:24.101643+0000","last_clean":"2024-09-19T09:17:24.101643+0000","last_became_active":"2024-09-19T09:17:22.097279+0000","last_became_peered":"2024-09-19T09:17:22.097279+0000","last_unstale":"2024-09-19T09:17:24.101643+0000","last_undegraded":"2024-09-19T09:17:24.101643+0000","last_fullsized":"2024-09-19T09:17:24.101643+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:57.028977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.041458+0000","last_change":"2024-09-19T09:17:23.046029+0000","last_active":"2024-09-19T09:17:24.041458+0000","last_peered":"2024-09-19T09:17:24.041458+0000","last_clean":"2024-09-19T09:17:24.041458+0000","last_became_active":"2024-09-19T09:17:23.045799+0000","last_became_peered":"2024-09-19T09:17:23.045799+0000","last_unstale":"2024-09-19T09:17:24.041458+0000","last_undegraded":"2024-09-19T09:17:24.041458+0000","last_fullsized":"2024-09-19T09:17:24.041458+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:06.353894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.101208+0000","last_change":"2024-09-19T09:17:22.100532+0000","last_active":"2024-09-19T09:17:24.101208+0000","last_peered":"2024-09-19T09:17:24.101208+0000","last_clean":"2024-09-19T09:17:24.101208+0000","last_became_active":"2024-09-19T09:17:22.100307+0000","last_became_peered":"2024-09-19T09:17:22.100307+0000","last_unstale":"2024-09-19T09:17:24.101208+0000","last_undegraded":"2024-09-19T09:17:24.101208+0000","last_fullsized":"2024-09-19T09:17:24.101208+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:31.497616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.041716+0000","last_change":"2024-09-19T09:17:23.048292+0000","last_active":"2024-09-19T09:17:24.041716+0000","last_peered":"2024-09-19T09:17:24.041716+0000","last_clean":"2024-09-19T09:17:24.041716+0000","last_became_active":"2024-09-19T09:17:23.047283+0000","last_became_peered":"2024-09-19T09:17:23.047283+0000","last_unstale":"2024-09-19T09:17:24.041716+0000","last_undegraded":"2024-09-19T09:17:24.041716+0000","last_fullsized":"2024-09-19T09:17:24.041716+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:37.619746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.041509+0000","last_change":"2024-09-19T09:17:22.101477+0000","last_active":"2024-09-19T09:17:24.041509+0000","last_peered":"2024-09-19T09:17:24.041509+0000","last_clean":"2024-09-19T09:17:24.041509+0000","last_became_active":"2024-09-19T09:17:22.101223+0000","last_became_peered":"2024-09-19T09:17:22.101223+0000","last_unstale":"2024-09-19T09:17:24.041509+0000","last_undegraded":"2024-09-19T09:17:24.041509+0000","last_fullsized":"2024-09-19T09:17:24.041509+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:32.724910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.707780+0000","last_change":"2024-09-19T09:17:23.042463+0000","last_active":"2024-09-19T09:17:24.707780+0000","last_peered":"2024-09-19T09:17:24.707780+0000","last_clean":"2024-09-19T09:17:24.707780+0000","last_became_active":"2024-09-19T09:17:23.042182+0000","last_became_peered":"2024-09-19T09:17:23.042182+0000","last_unstale":"2024-09-19T09:17:24.707780+0000","last_undegraded":"2024-09-19T09:17:24.707780+0000","last_fullsized":"2024-09-19T09:17:24.707780+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:27.064201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.486865+0000","last_change":"2024-09-19T09:17:22.100491+0000","last_active":"2024-09-19T09:17:24.486865+0000","last_peered":"2024-09-19T09:17:24.486865+0000","last_clean":"2024-09-19T09:17:24.486865+0000","last_became_active":"2024-09-19T09:17:22.100205+0000","last_became_peered":"2024-09-19T09:17:22.100205+0000","last_unstale":"2024-09-19T09:17:24.486865+0000","last_undegraded":"2024-09-19T09:17:24.486865+0000","last_fullsized":"2024-09-19T09:17:24.486865+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:06.375065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.486811+0000","last_change":"2024-09-19T09:17:23.051269+0000","last_active":"2024-09-19T09:17:24.486811+0000","last_peered":"2024-09-19T09:17:24.486811+0000","last_clean":"2024-09-19T09:17:24.486811+0000","last_became_active":"2024-09-19T09:17:23.051009+0000","last_became_peered":"2024-09-19T09:17:23.051009+0000","last_unstale":"2024-09-19T09:17:24.486811+0000","last_undegraded":"2024-09-19T09:17:24.486811+0000","last_fullsized":"2024-09-19T09:17:24.486811+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:22:25.353850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.707727+0000","last_change":"2024-09-19T09:17:22.097363+0000","last_active":"2024-09-19T09:17:24.707727+0000","last_peered":"2024-09-19T09:17:24.707727+0000","last_clean":"2024-09-19T09:17:24.707727+0000","last_became_active":"2024-09-19T09:17:22.097122+0000","last_became_peered":"2024-09-19T09:17:22.097122+0000","last_unstale":"2024-09-19T09:17:24.707727+0000","last_undegraded":"2024-09-19T09:17:24.707727+0000","last_fullsized":"2024-09-19T09:17:24.707727+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:52.371116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.041106+0000","last_change":"2024-09-19T09:17:23.041912+0000","last_active":"2024-09-19T09:17:24.041106+0000","last_peered":"2024-09-19T09:17:24.041106+0000","last_clean":"2024-09-19T09:17:24.041106+0000","last_became_active":"2024-09-19T09:17:23.041649+0000","last_became_peered":"2024-09-19T09:17:23.041649+0000","last_unstale":"2024-09-19T09:17:24.041106+0000","last_undegraded":"2024-09-19T09:17:24.041106+0000","last_fullsized":"2024-09-19T09:17:24.041106+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:22.079945+0000","last_clean_scrub_stamp":"2024-09-19T09:17:22.079945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:18.126673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"89'2","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.708076+0000","last_change":"2024-09-19T09:17:22.101852+0000","last_active":"2024-09-19T09:17:24.708076+0000","last_peered":"2024-09-19T09:17:24.708076+0000","last_clean":"2024-09-19T09:17:24.708076+0000","last_became_active":"2024-09-19T09:17:22.101618+0000","last_became_peered":"2024-09-19T09:17:22.101618+0000","last_unstale":"2024-09-19T09:17:24.708076+0000","last_undegraded":"2024-09-19T09:17:24.708076+0000","last_fullsized":"2024-09-19T09:17:24.708076+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:17:21.077762+0000","last_clean_scrub_stamp":"2024-09-19T09:17:21.077762+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:28.384954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":306,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-19T09:17:24.708238+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:17:24.708238+0000","last_peered":"2024-09-19T09:17:24.708238+0000","last_clean":"2024-09-19T09:17:24.708238+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:17:24.708238+0000","last_undegraded":"2024-09-19T09:17:24.708238+0000","last_fullsized":"2024-09-19T09:17:24.708238+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:58.919093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574900,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":472,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194840,"statfs":{"total":200000000,"available":199516470,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":472,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194840,"statfs":{"total":200000000,"available":199516436,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1047,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194265,"statfs":{"total":200000000,"available":198927624,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":471,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194841,"statfs":{"total":200000000,"available":199517388,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574900,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":470,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194841,"statfs":{"total":200000000,"available":199517956,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":471,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194841,"statfs":{"total":200000000,"available":199517500,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1047,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194265,"statfs":{"total":200000000,"available":198927714,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":470,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194841,"statfs":{"total":200000000,"available":199518012,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:17:30.824 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T09:17:30.824 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-19T09:17:30.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.969+0000 7fbd6008d640 1 Processor -- start 2024-09-19T09:17:30.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.969+0000 7fbd6008d640 1 -- start start 2024-09-19T09:17:30.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.970+0000 7fbd6008d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd580af8d0 0x7fbd580afd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:30.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.970+0000 7fbd6008d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbd580b73b0 0x7fbd580b7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:30.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.970+0000 7fbd6008d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd5815fef0 con 0x7fbd5806f7e0 2024-09-19T09:17:30.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.970+0000 7fbd6008d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fbd580b6f20 con 0x7fbd580b73b0 2024-09-19T09:17:30.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.970+0000 7fbd6008d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbd580b68d0 con 0x7fbd580af8d0 2024-09-19T09:17:30.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.970+0000 7fbd5d628640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd580af8d0 0x7fbd580afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:30.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.970+0000 7fbd5e62a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbd580b73b0 0x7fbd580b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:30.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.970+0000 7fbd5d628640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd580af8d0 0x7fbd580afd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:38944/0 (socket says 172.21.15.18:38944) 2024-09-19T09:17:30.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.970+0000 7fbd5d628640 1 -- 172.21.15.18:0/604635564 learned_addr learned my addr 172.21.15.18:0/604635564 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:30.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.970+0000 7fbd5e62a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbd580b73b0 0x7fbd580b7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:55384/0 (socket says 172.21.15.18:55384) 2024-09-19T09:17:30.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.971+0000 7fbd5d628640 1 -- 172.21.15.18:0/604635564 >> v2:172.21.15.162:3300/0 conn(0x7fbd580b73b0 msgr2=0x7fbd580b7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:30.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.971+0000 7fbd5d628640 1 --2- 172.21.15.18:0/604635564 >> v2:172.21.15.162:3300/0 conn(0x7fbd580b73b0 0x7fbd580b7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:30.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.971+0000 7fbd5d628640 1 -- 172.21.15.18:0/604635564 >> v1:172.21.15.162:6789/0 conn(0x7fbd5806f7e0 legacy=0x7fbd5806fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:30.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.971+0000 7fbd5d628640 1 -- 172.21.15.18:0/604635564 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd580b6bb0 con 0x7fbd580af8d0 2024-09-19T09:17:30.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.972+0000 7fbd5d628640 1 --2- 172.21.15.18:0/604635564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd580af8d0 0x7fbd580afd30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbd54009870 tx=0x7fbd5402a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=265845f24152492 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:30.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.972+0000 7fbd5ce27640 1 -- 172.21.15.18:0/604635564 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd54037070 con 0x7fbd580af8d0 2024-09-19T09:17:30.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.972+0000 7fbd5ce27640 1 -- 172.21.15.18:0/604635564 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd54032440 con 0x7fbd580af8d0 2024-09-19T09:17:30.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.972+0000 7fbd5ce27640 1 -- 172.21.15.18:0/604635564 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd54032810 con 0x7fbd580af8d0 2024-09-19T09:17:30.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.972+0000 7fbd6008d640 1 -- 172.21.15.18:0/604635564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd580af8d0 msgr2=0x7fbd580afd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:30.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.972+0000 7fbd6008d640 1 --2- 172.21.15.18:0/604635564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd580af8d0 0x7fbd580afd30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbd54009870 tx=0x7fbd5402a270 comp rx=0 tx=0).stop 2024-09-19T09:17:30.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.972+0000 7fbd6008d640 1 -- 172.21.15.18:0/604635564 shutdown_connections 2024-09-19T09:17:30.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.972+0000 7fbd6008d640 1 --2- 172.21.15.18:0/604635564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd580af8d0 0x7fbd580afd30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:30.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.972+0000 7fbd6008d640 1 --2- 172.21.15.18:0/604635564 >> v2:172.21.15.162:3300/0 conn(0x7fbd580b73b0 0x7fbd580b7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:30.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.972+0000 7fbd6008d640 1 -- 172.21.15.18:0/604635564 >> 172.21.15.18:0/604635564 conn(0x7fbd58073c80 msgr2=0x7fbd5809b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:30.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.972+0000 7fbd6008d640 1 -- 172.21.15.18:0/604635564 shutdown_connections 2024-09-19T09:17:30.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.972+0000 7fbd6008d640 1 -- 172.21.15.18:0/604635564 wait complete. 2024-09-19T09:17:30.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.974+0000 7fbd6008d640 1 Processor -- start 2024-09-19T09:17:30.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.974+0000 7fbd6008d640 1 -- start start 2024-09-19T09:17:30.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.974+0000 7fbd6008d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd5806f7e0 0x7fbd5814b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.974+0000 7fbd6008d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd580af8d0 0x7fbd5815b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.974+0000 7fbd6008d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd580b73b0 0x7fbd581613d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.974+0000 7fbd6008d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbd58159620 con 0x7fbd5806f7e0 2024-09-19T09:17:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.974+0000 7fbd6008d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbd581594a0 con 0x7fbd580b73b0 2024-09-19T09:17:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.974+0000 7fbd6008d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbd5815f170 con 0x7fbd580af8d0 2024-09-19T09:17:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.975+0000 7fbd5de29640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd5806f7e0 0x7fbd5814b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.975+0000 7fbd5de29640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd5806f7e0 0x7fbd5814b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34214/0 (socket says 172.21.15.18:34214) 2024-09-19T09:17:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.975+0000 7fbd5de29640 1 -- 172.21.15.18:0/3512392024 learned_addr learned my addr 172.21.15.18:0/3512392024 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.975+0000 7fbd5e62a640 1 --2- 172.21.15.18:0/3512392024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd580b73b0 0x7fbd581613d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.975+0000 7fbd5d628640 1 --2- 172.21.15.18:0/3512392024 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd580af8d0 0x7fbd5815b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.975+0000 7fbd5de29640 1 -- 172.21.15.18:0/3512392024 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd580af8d0 msgr2=0x7fbd5815b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.975+0000 7fbd5de29640 1 --2- 172.21.15.18:0/3512392024 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd580af8d0 0x7fbd5815b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:30.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.975+0000 7fbd5de29640 1 -- 172.21.15.18:0/3512392024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd580b73b0 msgr2=0x7fbd581613d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:30.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.975+0000 7fbd5de29640 1 --2- 172.21.15.18:0/3512392024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd580b73b0 0x7fbd581613d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:30.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.975+0000 7fbd5de29640 1 -- 172.21.15.18:0/3512392024 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd58155f30 con 0x7fbd5806f7e0 2024-09-19T09:17:30.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.975+0000 7fbd5de29640 1 --2- 172.21.15.18:0/3512392024 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd5806f7e0 0x7fbd5814b680 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00c400 tx=0x7fbd4c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:30.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.975+0000 7fbd4a7fc640 1 -- 172.21.15.18:0/3512392024 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c0052d0 con 0x7fbd5806f7e0 2024-09-19T09:17:30.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.975+0000 7fbd4a7fc640 1 -- 172.21.15.18:0/3512392024 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd4c005490 con 0x7fbd5806f7e0 2024-09-19T09:17:30.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.975+0000 7fbd6008d640 1 -- 172.21.15.18:0/3512392024 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd5815a720 con 0x7fbd5806f7e0 2024-09-19T09:17:30.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.975+0000 7fbd4a7fc640 1 -- 172.21.15.18:0/3512392024 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c007260 con 0x7fbd5806f7e0 2024-09-19T09:17:30.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.975+0000 7fbd6008d640 1 -- 172.21.15.18:0/3512392024 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd581e8990 con 0x7fbd5806f7e0 2024-09-19T09:17:30.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.977+0000 7fbd6008d640 1 -- 172.21.15.18:0/3512392024 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd580afd30 con 0x7fbd5806f7e0 2024-09-19T09:17:30.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.977+0000 7fbd4a7fc640 1 -- 172.21.15.18:0/3512392024 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbd4c007400 con 0x7fbd5806f7e0 2024-09-19T09:17:30.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.978+0000 7fbd4a7fc640 1 --2- 172.21.15.18:0/3512392024 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbd3c06c2b0 0x7fbd3c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:30.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.978+0000 7fbd4a7fc640 1 -- 172.21.15.18:0/3512392024 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5709+0+0 (secure 0 0 0) 0x7fbd4c08a8b0 con 0x7fbd5806f7e0 2024-09-19T09:17:30.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.978+0000 7fbd5d628640 1 --2- 172.21.15.18:0/3512392024 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbd3c06c2b0 0x7fbd3c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:30.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.978+0000 7fbd5d628640 1 --2- 172.21.15.18:0/3512392024 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbd3c06c2b0 0x7fbd3c06e770 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbd54034000 tx=0x7fbd5402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:30.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:30.982+0000 7fbd4a7fc640 1 -- 172.21.15.18:0/3512392024 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fbd4c0589c0 con 0x7fbd5806f7e0 2024-09-19T09:17:31.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.237+0000 7fbd6008d640 1 -- 172.21.15.18:0/3512392024 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fbd580b7e60 con 0x7fbd5806f7e0 2024-09-19T09:17:31.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.239+0000 7fbd4a7fc640 1 -- 172.21.15.18:0/3512392024 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7fbd4c05ccc0 con 0x7fbd5806f7e0 2024-09-19T09:17:31.240 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-09-19T09:17:31.240 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAe6+tmcbwDNhAAaG0+wu96Locwws+h0zeh8Q== 2024-09-19T09:17:31.240 INFO:teuthology.orchestra.run.smithi018.stdout: caps mds = "allow" 2024-09-19T09:17:31.240 INFO:teuthology.orchestra.run.smithi018.stdout: caps mon = "allow r" 2024-09-19T09:17:31.240 INFO:teuthology.orchestra.run.smithi018.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-19T09:17:31.240 INFO:teuthology.orchestra.run.smithi018.stderr:updated caps for client.0 2024-09-19T09:17:31.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.241+0000 7fbd6008d640 1 -- 172.21.15.18:0/3512392024 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbd3c06c2b0 msgr2=0x7fbd3c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:31.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.241+0000 7fbd6008d640 1 --2- 172.21.15.18:0/3512392024 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbd3c06c2b0 0x7fbd3c06e770 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fbd54034000 tx=0x7fbd5402e000 comp rx=0 tx=0).stop 2024-09-19T09:17:31.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.241+0000 7fbd6008d640 1 -- 172.21.15.18:0/3512392024 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd5806f7e0 msgr2=0x7fbd5814b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:31.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.241+0000 7fbd6008d640 1 --2- 172.21.15.18:0/3512392024 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd5806f7e0 0x7fbd5814b680 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00c400 tx=0x7fbd4c00c8c0 comp rx=0 tx=0).stop 2024-09-19T09:17:31.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.241+0000 7fbd6008d640 1 -- 172.21.15.18:0/3512392024 shutdown_connections 2024-09-19T09:17:31.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.241+0000 7fbd6008d640 1 --2- 172.21.15.18:0/3512392024 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbd3c06c2b0 0x7fbd3c06e770 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:31.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.241+0000 7fbd6008d640 1 --2- 172.21.15.18:0/3512392024 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbd580b73b0 0x7fbd581613d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:31.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.241+0000 7fbd6008d640 1 --2- 172.21.15.18:0/3512392024 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbd580af8d0 0x7fbd5815b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:31.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.241+0000 7fbd6008d640 1 --2- 172.21.15.18:0/3512392024 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbd5806f7e0 0x7fbd5814b680 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:31.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.241+0000 7fbd6008d640 1 -- 172.21.15.18:0/3512392024 >> 172.21.15.18:0/3512392024 conn(0x7fbd58073c80 msgr2=0x7fbd581604a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:31.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.242+0000 7fbd6008d640 1 -- 172.21.15.18:0/3512392024 shutdown_connections 2024-09-19T09:17:31.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.242+0000 7fbd6008d640 1 -- 172.21.15.18:0/3512392024 wait complete. 2024-09-19T09:17:31.253 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:17:31.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.355+0000 7f3f7a759640 1 Processor -- start 2024-09-19T09:17:31.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.355+0000 7f3f7a759640 1 -- start start 2024-09-19T09:17:31.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.356+0000 7f3f7a759640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3f7406bc10 0x7f3f7406bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:31.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.356+0000 7f3f7a759640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3f740d1500 0x7f3f740d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:31.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.356+0000 7f3f7a759640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f7406c530 con 0x7f3f74145e80 2024-09-19T09:17:31.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.356+0000 7f3f7a759640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f3f740704e0 con 0x7f3f740d1500 2024-09-19T09:17:31.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.356+0000 7f3f7a759640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f3f7406e550 con 0x7f3f7406bc10 2024-09-19T09:17:31.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.356+0000 7f3f78cf6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3f740d1500 0x7f3f740d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:31.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.356+0000 7f3f78cf6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3f740d1500 0x7f3f740d0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34224/0 (socket says 172.21.15.18:34224) 2024-09-19T09:17:31.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.356+0000 7f3f78cf6640 1 -- 172.21.15.18:0/2528639701 learned_addr learned my addr 172.21.15.18:0/2528639701 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:31.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.356+0000 7f3f73fff640 1 --2- 172.21.15.18:0/2528639701 >> v2:172.21.15.162:3300/0 conn(0x7f3f7406bc10 0x7f3f7406bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:31.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.356+0000 7f3f78cf6640 1 -- 172.21.15.18:0/2528639701 >> v2:172.21.15.162:3300/0 conn(0x7f3f7406bc10 msgr2=0x7f3f7406bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:31.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.356+0000 7f3f78cf6640 1 --2- 172.21.15.18:0/2528639701 >> v2:172.21.15.162:3300/0 conn(0x7f3f7406bc10 0x7f3f7406bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:31.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.356+0000 7f3f78cf6640 1 -- 172.21.15.18:0/2528639701 >> v1:172.21.15.162:6789/0 conn(0x7f3f74145e80 legacy=0x7f3f7415d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:31.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.356+0000 7f3f78cf6640 1 -- 172.21.15.18:0/2528639701 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f7406e830 con 0x7f3f740d1500 2024-09-19T09:17:31.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.357+0000 7f3f78cf6640 1 --2- 172.21.15.18:0/2528639701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f740d1500 0x7f3f740d0240 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3f74075930 tx=0x7f3f6c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64ac1d40acba25a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:31.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.357+0000 7f3f72ffd640 1 -- 172.21.15.18:0/2528639701 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c036070 con 0x7f3f740d1500 2024-09-19T09:17:31.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.357+0000 7f3f72ffd640 1 -- 172.21.15.18:0/2528639701 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f6c031600 con 0x7f3f740d1500 2024-09-19T09:17:31.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.357+0000 7f3f72ffd640 1 -- 172.21.15.18:0/2528639701 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f6c0319d0 con 0x7f3f740d1500 2024-09-19T09:17:31.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.358+0000 7f3f7a759640 1 -- 172.21.15.18:0/2528639701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f740d1500 msgr2=0x7f3f740d0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:31.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.358+0000 7f3f7a759640 1 --2- 172.21.15.18:0/2528639701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f740d1500 0x7f3f740d0240 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3f74075930 tx=0x7f3f6c02a660 comp rx=0 tx=0).stop 2024-09-19T09:17:31.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.358+0000 7f3f7a759640 1 -- 172.21.15.18:0/2528639701 shutdown_connections 2024-09-19T09:17:31.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.358+0000 7f3f7a759640 1 --2- 172.21.15.18:0/2528639701 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f740d1500 0x7f3f740d0240 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:31.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.358+0000 7f3f7a759640 1 --2- 172.21.15.18:0/2528639701 >> v2:172.21.15.162:3300/0 conn(0x7f3f7406bc10 0x7f3f7406bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:31.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.358+0000 7f3f7a759640 1 -- 172.21.15.18:0/2528639701 >> 172.21.15.18:0/2528639701 conn(0x7f3f7406cd20 msgr2=0x7f3f7406d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:31.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.358+0000 7f3f7a759640 1 -- 172.21.15.18:0/2528639701 shutdown_connections 2024-09-19T09:17:31.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.358+0000 7f3f7a759640 1 -- 172.21.15.18:0/2528639701 wait complete. 2024-09-19T09:17:31.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.359+0000 7f3f7a759640 1 Processor -- start 2024-09-19T09:17:31.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.359+0000 7f3f7a759640 1 -- start start 2024-09-19T09:17:31.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.360+0000 7f3f7a759640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f7406bc10 0x7f3f74142b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:31.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.360+0000 7f3f7a759640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f740d1500 0x7f3f741422b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:31.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.360+0000 7f3f7a759640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f74145e80 0x7f3f741e9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:31.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.360+0000 7f3f7a759640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3f7406feb0 con 0x7f3f740d1500 2024-09-19T09:17:31.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.360+0000 7f3f7a759640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3f740b0f80 con 0x7f3f74145e80 2024-09-19T09:17:31.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.360+0000 7f3f7a759640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3f7406d880 con 0x7f3f7406bc10 2024-09-19T09:17:31.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.360+0000 7f3f737fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f740d1500 0x7f3f741422b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:31.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.360+0000 7f3f737fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f740d1500 0x7f3f741422b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34232/0 (socket says 172.21.15.18:34232) 2024-09-19T09:17:31.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.360+0000 7f3f737fe640 1 -- 172.21.15.18:0/1330652429 learned_addr learned my addr 172.21.15.18:0/1330652429 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:31.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.360+0000 7f3f73fff640 1 --2- 172.21.15.18:0/1330652429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f7406bc10 0x7f3f74142b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:31.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.360+0000 7f3f78cf6640 1 --2- 172.21.15.18:0/1330652429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f74145e80 0x7f3f741e9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:31.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.360+0000 7f3f737fe640 1 -- 172.21.15.18:0/1330652429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f7406bc10 msgr2=0x7f3f74142b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:31.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.360+0000 7f3f737fe640 1 --2- 172.21.15.18:0/1330652429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f7406bc10 0x7f3f74142b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:31.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.360+0000 7f3f737fe640 1 -- 172.21.15.18:0/1330652429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f74145e80 msgr2=0x7f3f741e9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:31.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.360+0000 7f3f737fe640 1 --2- 172.21.15.18:0/1330652429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f74145e80 0x7f3f741e9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:31.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.360+0000 7f3f737fe640 1 -- 172.21.15.18:0/1330652429 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f74144380 con 0x7f3f740d1500 2024-09-19T09:17:31.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.360+0000 7f3f73fff640 1 --2- 172.21.15.18:0/1330652429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f7406bc10 0x7f3f74142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:31.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.361+0000 7f3f737fe640 1 --2- 172.21.15.18:0/1330652429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f740d1500 0x7f3f741422b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f3f6800c410 tx=0x7f3f6800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:31.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.361+0000 7f3f70ff9640 1 -- 172.21.15.18:0/1330652429 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f68017070 con 0x7f3f740d1500 2024-09-19T09:17:31.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.361+0000 7f3f70ff9640 1 -- 172.21.15.18:0/1330652429 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f680035f0 con 0x7f3f740d1500 2024-09-19T09:17:31.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.361+0000 7f3f70ff9640 1 -- 172.21.15.18:0/1330652429 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f68003a20 con 0x7f3f740d1500 2024-09-19T09:17:31.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.361+0000 7f3f7a759640 1 -- 172.21.15.18:0/1330652429 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f741432e0 con 0x7f3f740d1500 2024-09-19T09:17:31.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.361+0000 7f3f7a759640 1 -- 172.21.15.18:0/1330652429 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f741438a0 con 0x7f3f740d1500 2024-09-19T09:17:31.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.362+0000 7f3f7a759640 1 -- 172.21.15.18:0/1330652429 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f741463d0 con 0x7f3f740d1500 2024-09-19T09:17:31.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.363+0000 7f3f70ff9640 1 -- 172.21.15.18:0/1330652429 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3f6801a070 con 0x7f3f740d1500 2024-09-19T09:17:31.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.363+0000 7f3f70ff9640 1 --2- 172.21.15.18:0/1330652429 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3f6006c2b0 0x7f3f6006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:31.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.363+0000 7f3f70ff9640 1 -- 172.21.15.18:0/1330652429 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5709+0+0 (secure 0 0 0) 0x7f3f6808a7a0 con 0x7f3f740d1500 2024-09-19T09:17:31.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.363+0000 7f3f73fff640 1 --2- 172.21.15.18:0/1330652429 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3f6006c2b0 0x7f3f6006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:31.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.364+0000 7f3f73fff640 1 --2- 172.21.15.18:0/1330652429 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3f6006c2b0 0x7f3f6006e770 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3f64006fd0 tx=0x7f3f64008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:31.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.368+0000 7f3f70ff9640 1 -- 172.21.15.18:0/1330652429 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3f680010c0 con 0x7f3f740d1500 2024-09-19T09:17:31.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.582+0000 7f3f7a759640 1 -- 172.21.15.18:0/1330652429 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f74073850 con 0x7f3f740d1500 2024-09-19T09:17:31.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.583+0000 7f3f70ff9640 1 -- 172.21.15.18:0/1330652429 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5228 (secure 0 0 0) 0x7f3f68058950 con 0x7f3f740d1500 2024-09-19T09:17:31.586 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:17:31.586 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":35,"btime":"2024-09-19T09:17:25:094931+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1906118343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1906118343},{"type":"v1","addr":"172.21.15.162:6837","nonce":1906118343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1051418414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1051418414},{"type":"v1","addr":"172.21.15.162:6835","nonce":1051418414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5892,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1630984812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630984812},{"type":"v1","addr":"172.21.15.18:6834","nonce":1630984812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:17:22.451890+0000","modified":"2024-09-19T09:17:24.482665+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5895},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5895":{"gid":5895,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/905153716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":905153716},{"type":"v1","addr":"172.21.15.18:6835","nonce":905153716}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5895,"qdb_cluster":[5895]},"id":5}]} 2024-09-19T09:17:31.587 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 35 2024-09-19T09:17:31.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.585+0000 7f3f7a759640 1 -- 172.21.15.18:0/1330652429 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3f6006c2b0 msgr2=0x7f3f6006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:31.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.585+0000 7f3f7a759640 1 --2- 172.21.15.18:0/1330652429 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3f6006c2b0 0x7f3f6006e770 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f3f64006fd0 tx=0x7f3f64008040 comp rx=0 tx=0).stop 2024-09-19T09:17:31.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.585+0000 7f3f7a759640 1 -- 172.21.15.18:0/1330652429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f740d1500 msgr2=0x7f3f741422b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:31.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.585+0000 7f3f7a759640 1 --2- 172.21.15.18:0/1330652429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f740d1500 0x7f3f741422b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f3f6800c410 tx=0x7f3f6800c8d0 comp rx=0 tx=0).stop 2024-09-19T09:17:31.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.585+0000 7f3f7a759640 1 -- 172.21.15.18:0/1330652429 shutdown_connections 2024-09-19T09:17:31.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.585+0000 7f3f7a759640 1 --2- 172.21.15.18:0/1330652429 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3f6006c2b0 0x7f3f6006e770 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:31.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.585+0000 7f3f7a759640 1 --2- 172.21.15.18:0/1330652429 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f74145e80 0x7f3f741e9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:31.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.585+0000 7f3f7a759640 1 --2- 172.21.15.18:0/1330652429 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3f740d1500 0x7f3f741422b0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:31.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.585+0000 7f3f7a759640 1 --2- 172.21.15.18:0/1330652429 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3f7406bc10 0x7f3f74142b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:31.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.585+0000 7f3f7a759640 1 -- 172.21.15.18:0/1330652429 >> 172.21.15.18:0/1330652429 conn(0x7f3f7406cd20 msgr2=0x7f3f740b22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:31.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.585+0000 7f3f7a759640 1 -- 172.21.15.18:0/1330652429 shutdown_connections 2024-09-19T09:17:31.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:31.585+0000 7f3f7a759640 1 -- 172.21.15.18:0/1330652429 wait complete. 2024-09-19T09:17:32.000 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 35, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T09:17:22.451890+0000', 'modified': '2024-09-19T09:17:24.482665+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5895}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5895': {'gid': 5895, 'name': 'c', 'rank': 0, 'incarnation': 33, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.18:6835/905153716', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6833', 'nonce': 905153716}, {'type': 'v1', 'addr': '172.21.15.18:6835', 'nonce': 905153716}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5895, 'qdb_cluster': [5895]} 2024-09-19T09:17:32.000 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T09:17:32.001 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-19T09:17:32.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.106+0000 7f70c6aaf640 1 Processor -- start 2024-09-19T09:17:32.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.106+0000 7f70c6aaf640 1 -- start start 2024-09-19T09:17:32.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.107+0000 7f70c6aaf640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f70c00aeee0 0x7f70c00af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.107+0000 7f70c6aaf640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f70c00728b0 0x7f70c00add00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.107+0000 7f70c6aaf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70c00b5d40 0x7f70c00ae240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.107+0000 7f70c6aaf640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f70c006e220 con 0x7f70c00728b0 2024-09-19T09:17:32.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.107+0000 7f70c6aaf640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f70c00af800 con 0x7f70c00aeee0 2024-09-19T09:17:32.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.107+0000 7f70c6aaf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f70c0072d60 con 0x7f70c00b5d40 2024-09-19T09:17:32.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.108+0000 7f70bffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f70c00728b0 0x7f70c00add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:32.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.108+0000 7f70bffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f70c00728b0 0x7f70c00add00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34236/0 (socket says 172.21.15.18:34236) 2024-09-19T09:17:32.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.108+0000 7f70bffff640 1 -- 172.21.15.18:0/570338611 learned_addr learned my addr 172.21.15.18:0/570338611 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:32.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.108+0000 7f70c504c640 1 --2- 172.21.15.18:0/570338611 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70c00b5d40 0x7f70c00ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:32.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.108+0000 7f70c484b640 1 --2- 172.21.15.18:0/570338611 >> v2:172.21.15.162:3300/0 conn(0x7f70c00aeee0 0x7f70c00af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:32.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.108+0000 7f70bffff640 1 -- 172.21.15.18:0/570338611 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70c00b5d40 msgr2=0x7f70c00ae240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:32.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.108+0000 7f70bffff640 1 --2- 172.21.15.18:0/570338611 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70c00b5d40 0x7f70c00ae240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.108+0000 7f70bffff640 1 -- 172.21.15.18:0/570338611 >> v2:172.21.15.162:3300/0 conn(0x7f70c00aeee0 msgr2=0x7f70c00af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:32.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.108+0000 7f70bffff640 1 --2- 172.21.15.18:0/570338611 >> v2:172.21.15.162:3300/0 conn(0x7f70c00aeee0 0x7f70c00af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.108+0000 7f70bffff640 1 -- 172.21.15.18:0/570338611 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c0073040 con 0x7f70c00728b0 2024-09-19T09:17:32.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.109+0000 7f70bffff640 1 --2- 172.21.15.18:0/570338611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70c00728b0 0x7f70c00add00 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f70c006d7f0 tx=0x7f70b402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7d55ce9523c2859 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:32.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.109+0000 7f70bf7fe640 1 -- 172.21.15.18:0/570338611 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b4037070 con 0x7f70c00728b0 2024-09-19T09:17:32.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.109+0000 7f70bf7fe640 1 -- 172.21.15.18:0/570338611 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70b4032440 con 0x7f70c00728b0 2024-09-19T09:17:32.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.109+0000 7f70bf7fe640 1 -- 172.21.15.18:0/570338611 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b4032810 con 0x7f70c00728b0 2024-09-19T09:17:32.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.109+0000 7f70c6aaf640 1 -- 172.21.15.18:0/570338611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70c00728b0 msgr2=0x7f70c00add00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:32.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.109+0000 7f70c6aaf640 1 --2- 172.21.15.18:0/570338611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70c00728b0 0x7f70c00add00 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f70c006d7f0 tx=0x7f70b402a1e0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.109+0000 7f70c6aaf640 1 -- 172.21.15.18:0/570338611 shutdown_connections 2024-09-19T09:17:32.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.109+0000 7f70c6aaf640 1 --2- 172.21.15.18:0/570338611 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70c00b5d40 0x7f70c00ae240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.109+0000 7f70c6aaf640 1 --2- 172.21.15.18:0/570338611 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70c00728b0 0x7f70c00add00 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.109+0000 7f70c6aaf640 1 --2- 172.21.15.18:0/570338611 >> v2:172.21.15.162:3300/0 conn(0x7f70c00aeee0 0x7f70c00af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.109+0000 7f70c6aaf640 1 -- 172.21.15.18:0/570338611 >> 172.21.15.18:0/570338611 conn(0x7f70c00d0c00 msgr2=0x7f70c00d0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:32.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.109+0000 7f70c6aaf640 1 -- 172.21.15.18:0/570338611 shutdown_connections 2024-09-19T09:17:32.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.109+0000 7f70c6aaf640 1 -- 172.21.15.18:0/570338611 wait complete. 2024-09-19T09:17:32.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.111+0000 7f70c6aaf640 1 Processor -- start 2024-09-19T09:17:32.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.111+0000 7f70c6aaf640 1 -- start start 2024-09-19T09:17:32.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.112+0000 7f70c6aaf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70c00728b0 0x7f70c009d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.112+0000 7f70c6aaf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70c00aeee0 0x7f70c00cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.112+0000 7f70c6aaf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70c00b5d40 0x7f70c00b5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.112+0000 7f70c6aaf640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f70c015bc80 con 0x7f70c00b5d40 2024-09-19T09:17:32.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.112+0000 7f70c6aaf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f70c006e450 con 0x7f70c00728b0 2024-09-19T09:17:32.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.112+0000 7f70c6aaf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f70c015be00 con 0x7f70c00aeee0 2024-09-19T09:17:32.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.112+0000 7f70c504c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70c00b5d40 0x7f70c00b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:32.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.112+0000 7f70c504c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70c00b5d40 0x7f70c00b5070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34240/0 (socket says 172.21.15.18:34240) 2024-09-19T09:17:32.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.112+0000 7f70c504c640 1 -- 172.21.15.18:0/2511090004 learned_addr learned my addr 172.21.15.18:0/2511090004 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:32.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.112+0000 7f70c484b640 1 --2- 172.21.15.18:0/2511090004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70c00728b0 0x7f70c009d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:32.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.112+0000 7f70bffff640 1 --2- 172.21.15.18:0/2511090004 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70c00aeee0 0x7f70c00cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:32.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.112+0000 7f70c504c640 1 -- 172.21.15.18:0/2511090004 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70c00aeee0 msgr2=0x7f70c00cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:32.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.112+0000 7f70c504c640 1 --2- 172.21.15.18:0/2511090004 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70c00aeee0 0x7f70c00cf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.112+0000 7f70c504c640 1 -- 172.21.15.18:0/2511090004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70c00728b0 msgr2=0x7f70c009d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:32.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.112+0000 7f70c504c640 1 --2- 172.21.15.18:0/2511090004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70c00728b0 0x7f70c009d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.112+0000 7f70c504c640 1 -- 172.21.15.18:0/2511090004 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c015e4b0 con 0x7f70c00b5d40 2024-09-19T09:17:32.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.112+0000 7f70c504c640 1 --2- 172.21.15.18:0/2511090004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70c00b5d40 0x7f70c00b5070 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f70b800efc0 tx=0x7f70b800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:32.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.114+0000 7f70bd7fa640 1 -- 172.21.15.18:0/2511090004 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b8018020 con 0x7f70c00b5d40 2024-09-19T09:17:32.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.114+0000 7f70bd7fa640 1 -- 172.21.15.18:0/2511090004 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70b8014480 con 0x7f70c00b5d40 2024-09-19T09:17:32.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.114+0000 7f70c6aaf640 1 -- 172.21.15.18:0/2511090004 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70c015e790 con 0x7f70c00b5d40 2024-09-19T09:17:32.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.114+0000 7f70bd7fa640 1 -- 172.21.15.18:0/2511090004 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b8014870 con 0x7f70c00b5d40 2024-09-19T09:17:32.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.114+0000 7f70c6aaf640 1 -- 172.21.15.18:0/2511090004 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70c015ed50 con 0x7f70c00b5d40 2024-09-19T09:17:32.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.115+0000 7f70bd7fa640 1 -- 172.21.15.18:0/2511090004 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f70b8005d10 con 0x7f70c00b5d40 2024-09-19T09:17:32.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.116+0000 7f70bd7fa640 1 --2- 172.21.15.18:0/2511090004 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f70ac06c2b0 0x7f70ac06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.116+0000 7f70bd7fa640 1 -- 172.21.15.18:0/2511090004 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5709+0+0 (secure 0 0 0) 0x7f70b808c1e0 con 0x7f70c00b5d40 2024-09-19T09:17:32.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.116+0000 7f70c484b640 1 --2- 172.21.15.18:0/2511090004 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f70ac06c2b0 0x7f70ac06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:32.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.116+0000 7f70c484b640 1 --2- 172.21.15.18:0/2511090004 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f70ac06c2b0 0x7f70ac06e770 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f70b0009aa0 tx=0x7f70b0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:32.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.117+0000 7f70c9842740 1 Processor -- start 2024-09-19T09:17:32.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.117+0000 7f70c9842740 1 -- start start 2024-09-19T09:17:32.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.117+0000 7f70c9842740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601281272c0 0x56012816ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.117+0000 7f70c9842740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560128124a80 0x5601281276a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.117+0000 7f70c9842740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560128128a50 0x5601281218b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.117+0000 7f70c9842740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560128089520 con 0x5601281272c0 2024-09-19T09:17:32.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.117+0000 7f70c9842740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5601280313e0 con 0x560128124a80 2024-09-19T09:17:32.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.117+0000 7f70c9842740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5601280854e0 con 0x560128128a50 2024-09-19T09:17:32.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.117+0000 7f70c484b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601281272c0 0x56012816ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:32.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.118+0000 7f70c484b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601281272c0 0x56012816ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34246/0 (socket says 172.21.15.18:34246) 2024-09-19T09:17:32.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.118+0000 7f70c484b640 1 -- 172.21.15.18:0/4066075539 learned_addr learned my addr 172.21.15.18:0/4066075539 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:32.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.118+0000 7f70bffff640 1 --2- 172.21.15.18:0/4066075539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560128124a80 0x5601281276a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:32.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.118+0000 7f70c504c640 1 --2- 172.21.15.18:0/4066075539 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560128128a50 0x5601281218b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:32.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.118+0000 7f70c484b640 1 -- 172.21.15.18:0/4066075539 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560128128a50 msgr2=0x5601281218b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:32.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.118+0000 7f70c484b640 1 --2- 172.21.15.18:0/4066075539 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560128128a50 0x5601281218b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.118+0000 7f70c484b640 1 -- 172.21.15.18:0/4066075539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560128124a80 msgr2=0x5601281276a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:32.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.118+0000 7f70c484b640 1 --2- 172.21.15.18:0/4066075539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560128124a80 0x5601281276a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.118+0000 7f70c484b640 1 -- 172.21.15.18:0/4066075539 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56012804c2f0 con 0x5601281272c0 2024-09-19T09:17:32.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.118+0000 7f70c484b640 1 --2- 172.21.15.18:0/4066075539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601281272c0 0x56012816ca60 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f70b00044a0 tx=0x7f70b0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb75212cbfd8bd8c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:32.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.118+0000 7f70a67fc640 1 -- 172.21.15.18:0/4066075539 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b001b070 con 0x5601281272c0 2024-09-19T09:17:32.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.118+0000 7f70a67fc640 1 -- 172.21.15.18:0/4066075539 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70b0027070 con 0x5601281272c0 2024-09-19T09:17:32.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.118+0000 7f70a67fc640 1 -- 172.21.15.18:0/4066075539 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b0003a20 con 0x5601281272c0 2024-09-19T09:17:32.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.119+0000 7f70c9842740 1 -- 172.21.15.18:0/4066075539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601281272c0 msgr2=0x56012816ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:32.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.119+0000 7f70c9842740 1 --2- 172.21.15.18:0/4066075539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601281272c0 0x56012816ca60 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f70b00044a0 tx=0x7f70b0014000 comp rx=0 tx=0).stop 2024-09-19T09:17:32.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.119+0000 7f70c9842740 1 -- 172.21.15.18:0/4066075539 shutdown_connections 2024-09-19T09:17:32.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.119+0000 7f70c9842740 1 --2- 172.21.15.18:0/4066075539 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560128128a50 0x5601281218b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.119+0000 7f70c9842740 1 --2- 172.21.15.18:0/4066075539 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560128124a80 0x5601281276a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.119+0000 7f70c9842740 1 --2- 172.21.15.18:0/4066075539 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5601281272c0 0x56012816ca60 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.119+0000 7f70c9842740 1 -- 172.21.15.18:0/4066075539 >> 172.21.15.18:0/4066075539 conn(0x560128123a80 msgr2=0x56012816bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:32.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.119+0000 7f70c9842740 1 -- 172.21.15.18:0/4066075539 shutdown_connections 2024-09-19T09:17:32.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.119+0000 7f70c9842740 1 -- 172.21.15.18:0/4066075539 wait complete. 2024-09-19T09:17:32.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.119+0000 7f70c9842740 1 -- start start 2024-09-19T09:17:32.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.120+0000 7f70c9842740 1 Processor -- start 2024-09-19T09:17:32.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.120+0000 7f70c9842740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601281272c0 0x560128122330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.120+0000 7f70c9842740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560128128a50 0x56012817cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.120+0000 7f70c9842740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560128121c80 0x5601281259c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.120+0000 7f70c9842740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560128122f20 con 0x560128128a50 2024-09-19T09:17:32.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.120+0000 7f70c9842740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560128012450 con 0x5601281272c0 2024-09-19T09:17:32.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.120+0000 7f70c9842740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56012816d290 con 0x560128121c80 2024-09-19T09:17:32.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.120+0000 7f70c9842740 10 client.0 _ll_register_callbacks cb 0x560127d9bac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:17:32.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.120+0000 7f70bffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560128128a50 0x56012817cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:32.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.121+0000 7f70bffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560128128a50 0x56012817cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34262/0 (socket says 172.21.15.18:34262) 2024-09-19T09:17:32.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.121+0000 7f70bffff640 1 -- 172.21.15.18:0/2966444921 learned_addr learned my addr 172.21.15.18:0/2966444921 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:32.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.121+0000 7f70c484b640 1 --2- 172.21.15.18:0/2966444921 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601281272c0 0x560128122330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:32.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.121+0000 7f70c504c640 1 --2- 172.21.15.18:0/2966444921 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560128121c80 0x5601281259c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:32.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.121+0000 7f70bffff640 1 -- 172.21.15.18:0/2966444921 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560128121c80 msgr2=0x5601281259c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:32.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.121+0000 7f70bffff640 1 --2- 172.21.15.18:0/2966444921 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560128121c80 0x5601281259c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.121+0000 7f70bffff640 1 -- 172.21.15.18:0/2966444921 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601281272c0 msgr2=0x560128122330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:32.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.121+0000 7f70bffff640 1 --2- 172.21.15.18:0/2966444921 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601281272c0 0x560128122330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.121+0000 7f70bffff640 1 -- 172.21.15.18:0/2966444921 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560127d9c2d0 con 0x560128128a50 2024-09-19T09:17:32.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.121+0000 7f70bffff640 1 --2- 172.21.15.18:0/2966444921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560128128a50 0x56012817cd50 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f70b40090b0 tx=0x7f70b4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a41f0a63535d4c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:32.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.121+0000 7f709f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:17:32.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.121+0000 7f709f7fe640 1 -- 172.21.15.18:0/2966444921 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b4037040 con 0x560128128a50 2024-09-19T09:17:32.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.121+0000 7f709f7fe640 1 -- 172.21.15.18:0/2966444921 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 5709+0+0 (secure 0 0 0) 0x7f70b4047480 con 0x560128128a50 2024-09-19T09:17:32.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.121+0000 7f70c9842740 1 -- 172.21.15.18:0/2966444921 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70b0027070 con 0x560128128a50 2024-09-19T09:17:32.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.121+0000 7f709f7fe640 1 -- 172.21.15.18:0/2966444921 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f70b404f050 con 0x560128128a50 2024-09-19T09:17:32.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.121+0000 7f70c9842740 10 client.6045 fetch_fsmap learned FSMap version 35 2024-09-19T09:17:32.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.121+0000 7f70c9842740 1 -- 172.21.15.18:0/2966444921 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x560127e666b0 con 0x560128128a50 2024-09-19T09:17:32.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.121+0000 7f709f7fe640 1 -- 172.21.15.18:0/2966444921 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70b0027070 con 0x560128128a50 2024-09-19T09:17:32.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.122+0000 7f709f7fe640 1 -- 172.21.15.18:0/2966444921 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 35) ==== 3502+0+0 (secure 0 0 0) 0x7f70b4052020 con 0x560128128a50 2024-09-19T09:17:32.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.122+0000 7f70c9842740 10 client.6045 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T09:17:32.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.122+0000 7f70c9842740 10 client.6045 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T09:17:32.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.122+0000 7f70c9842740 20 client.6045 populate_metadata read hostname 'smithi018' 2024-09-19T09:17:32.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.122+0000 7f70c9842740 1 --2- 172.21.15.18:0/2966444921 >> [v2:172.21.15.18:6833/905153716,v1:172.21.15.18:6835/905153716] conn(0x56012817f7d0 0x560128120990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.122+0000 7f70c9842740 4 client.6045 mds_command: new command op to 5895 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:17:32.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.122+0000 7f70c9842740 1 -- 172.21.15.18:0/2966444921 --> [v2:172.21.15.18:6833/905153716,v1:172.21.15.18:6835/905153716] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560128096c50 con 0x56012817f7d0 2024-09-19T09:17:32.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.122+0000 7f70c484b640 1 --2- 172.21.15.18:0/2966444921 >> [v2:172.21.15.18:6833/905153716,v1:172.21.15.18:6835/905153716] conn(0x56012817f7d0 0x560128120990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:32.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.122+0000 7f709f7fe640 10 client.6045 ms_handle_connect on v2:172.21.15.18:6833/905153716 2024-09-19T09:17:32.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.122+0000 7f70c484b640 1 --2- 172.21.15.18:0/2966444921 >> [v2:172.21.15.18:6833/905153716,v1:172.21.15.18:6835/905153716] conn(0x56012817f7d0 0x560128120990 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb4b20f23597405 server_cookie=e7494e8bde65d633 in_seq=0 out_seq=0 2024-09-19T09:17:32.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.123+0000 7f709f7fe640 1 -- 172.21.15.18:0/2966444921 <== mds.0 v2:172.21.15.18:6833/905153716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560128096c50 con 0x56012817f7d0 2024-09-19T09:17:32.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.123+0000 7f709f7fe640 10 client.6045 handle_command_reply: tid=0 2024-09-19T09:17:32.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.123+0000 7f70c9842740 1 client.6045 shutdown 2024-09-19T09:17:32.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.123+0000 7f70c9842740 1 -- 172.21.15.18:0/2966444921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560128128a50 msgr2=0x56012817cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:32.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.123+0000 7f70c9842740 1 --2- 172.21.15.18:0/2966444921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560128128a50 0x56012817cd50 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f70b40090b0 tx=0x7f70b4004730 comp rx=0 tx=0).stop 2024-09-19T09:17:32.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.123+0000 7f70c9842740 1 -- 172.21.15.18:0/2966444921 shutdown_connections 2024-09-19T09:17:32.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.123+0000 7f70c9842740 1 --2- 172.21.15.18:0/2966444921 >> [v2:172.21.15.18:6833/905153716,v1:172.21.15.18:6835/905153716] conn(0x56012817f7d0 0x560128120990 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.123+0000 7f70c9842740 1 --2- 172.21.15.18:0/2966444921 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560128121c80 0x5601281259c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.123+0000 7f70c9842740 1 --2- 172.21.15.18:0/2966444921 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560128128a50 0x56012817cd50 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.123+0000 7f709f7fe640 0 client.6045 ms_handle_reset on v2:172.21.15.18:6833/905153716 2024-09-19T09:17:32.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.123+0000 7f70c9842740 1 --2- 172.21.15.18:0/2966444921 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601281272c0 0x560128122330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.123+0000 7f70c9842740 1 -- 172.21.15.18:0/2966444921 >> 172.21.15.18:0/2966444921 conn(0x560128124a80 msgr2=0x560128169ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:32.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.123+0000 7f70c9842740 1 -- 172.21.15.18:0/2966444921 shutdown_connections 2024-09-19T09:17:32.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.123+0000 7f70c9842740 1 -- 172.21.15.18:0/2966444921 wait complete. 2024-09-19T09:17:32.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.123+0000 7f70c9842740 20 client.6045 trim_cache size 0 max 16384 2024-09-19T09:17:32.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.142+0000 7f70c9842740 1 Processor -- start 2024-09-19T09:17:32.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.142+0000 7f70c9842740 1 -- start start 2024-09-19T09:17:32.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.142+0000 7f70c9842740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560128121c80 0x56012816dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.142+0000 7f70c9842740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601281272c0 0x56012817cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.142+0000 7f70c9842740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560128128a50 0x56012816a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.142+0000 7f70c9842740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f70c009c860 con 0x560128128a50 2024-09-19T09:17:32.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.142+0000 7f70c9842740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f70c009bbc0 con 0x5601281272c0 2024-09-19T09:17:32.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.142+0000 7f70c9842740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f70c009c210 con 0x560128121c80 2024-09-19T09:17:32.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.142+0000 7f70c504c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560128128a50 0x56012816a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:32.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.142+0000 7f70c504c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560128128a50 0x56012816a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34268/0 (socket says 172.21.15.18:34268) 2024-09-19T09:17:32.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.142+0000 7f70c504c640 1 -- 172.21.15.18:0/2932306511 learned_addr learned my addr 172.21.15.18:0/2932306511 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:32.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.143+0000 7f70c484b640 1 --2- 172.21.15.18:0/2932306511 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560128121c80 0x56012816dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:32.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.143+0000 7f70bffff640 1 --2- 172.21.15.18:0/2932306511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601281272c0 0x56012817cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:32.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.143+0000 7f70c504c640 1 -- 172.21.15.18:0/2932306511 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560128121c80 msgr2=0x56012816dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:32.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.143+0000 7f70c504c640 1 --2- 172.21.15.18:0/2932306511 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560128121c80 0x56012816dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.143+0000 7f70c504c640 1 -- 172.21.15.18:0/2932306511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601281272c0 msgr2=0x56012817cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:32.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.143+0000 7f70c504c640 1 --2- 172.21.15.18:0/2932306511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601281272c0 0x56012817cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.143+0000 7f70c504c640 1 -- 172.21.15.18:0/2932306511 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560128122aa0 con 0x560128128a50 2024-09-19T09:17:32.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.143+0000 7f70c504c640 1 --2- 172.21.15.18:0/2932306511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560128128a50 0x56012816a0d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f70b805a240 tx=0x7f70b8016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26507b974282a93f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:32.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.143+0000 7f70a5ffb640 1 -- 172.21.15.18:0/2932306511 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b8062e30 con 0x560128128a50 2024-09-19T09:17:32.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.143+0000 7f70a5ffb640 1 -- 172.21.15.18:0/2932306511 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70b80583a0 con 0x560128128a50 2024-09-19T09:17:32.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.143+0000 7f70a5ffb640 1 -- 172.21.15.18:0/2932306511 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b8056970 con 0x560128128a50 2024-09-19T09:17:32.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.144+0000 7f70c9842740 1 -- 172.21.15.18:0/2932306511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560128128a50 msgr2=0x56012816a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:32.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.144+0000 7f70c9842740 1 --2- 172.21.15.18:0/2932306511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560128128a50 0x56012816a0d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f70b805a240 tx=0x7f70b8016040 comp rx=0 tx=0).stop 2024-09-19T09:17:32.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.144+0000 7f70c9842740 1 -- 172.21.15.18:0/2932306511 shutdown_connections 2024-09-19T09:17:32.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.144+0000 7f70c9842740 1 --2- 172.21.15.18:0/2932306511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560128128a50 0x56012816a0d0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.144+0000 7f70c9842740 1 --2- 172.21.15.18:0/2932306511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5601281272c0 0x56012817cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.144+0000 7f70c9842740 1 --2- 172.21.15.18:0/2932306511 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x560128121c80 0x56012816dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.144+0000 7f70c9842740 1 -- 172.21.15.18:0/2932306511 >> 172.21.15.18:0/2932306511 conn(0x560128124a80 msgr2=0x56012816c140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:32.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.144+0000 7f70c9842740 1 -- 172.21.15.18:0/2932306511 shutdown_connections 2024-09-19T09:17:32.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.144+0000 7f70c9842740 1 -- 172.21.15.18:0/2932306511 wait complete. 2024-09-19T09:17:32.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.144+0000 7f70c9842740 1 -- start start 2024-09-19T09:17:32.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.144+0000 7f70c9842740 1 Processor -- start 2024-09-19T09:17:32.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.145+0000 7f70c9842740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560128121c80 0x56012814d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.145+0000 7f70c9842740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5601281272c0 0x5601281d7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.145+0000 7f70c9842740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560128128a50 0x56012816b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.145+0000 7f70c9842740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x560128147050 con 0x560128128a50 2024-09-19T09:17:32.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.145+0000 7f70c9842740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x560128146a90 con 0x560128121c80 2024-09-19T09:17:32.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.145+0000 7f70c9842740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x56012817fbf0 con 0x5601281272c0 2024-09-19T09:17:32.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.145+0000 7f70c9842740 10 client.0 _ll_register_callbacks cb 0x7f70b80095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:17:32.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.145+0000 7f70c504c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560128128a50 0x56012816b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:32.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.145+0000 7f70c504c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560128128a50 0x56012816b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34280/0 (socket says 172.21.15.18:34280) 2024-09-19T09:17:32.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.145+0000 7f70c504c640 1 -- 172.21.15.18:0/1562433075 learned_addr learned my addr 172.21.15.18:0/1562433075 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:32.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.145+0000 7f70c484b640 1 --2- 172.21.15.18:0/1562433075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560128121c80 0x56012814d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:32.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.145+0000 7f70bffff640 1 --2- 172.21.15.18:0/1562433075 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5601281272c0 0x5601281d7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:32.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.145+0000 7f70c504c640 1 -- 172.21.15.18:0/1562433075 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5601281272c0 msgr2=0x5601281d7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:32.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.145+0000 7f70c504c640 1 --2- 172.21.15.18:0/1562433075 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5601281272c0 0x5601281d7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.145+0000 7f70c504c640 1 -- 172.21.15.18:0/1562433075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560128121c80 msgr2=0x56012814d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:32.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.145+0000 7f70c504c640 1 --2- 172.21.15.18:0/1562433075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560128121c80 0x56012814d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.145+0000 7f70c504c640 1 -- 172.21.15.18:0/1562433075 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56012814dcc0 con 0x560128128a50 2024-09-19T09:17:32.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.146+0000 7f70bffff640 1 --2- 172.21.15.18:0/1562433075 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5601281272c0 0x5601281d7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:32.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.146+0000 7f70c504c640 1 --2- 172.21.15.18:0/1562433075 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560128128a50 0x56012816b120 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f70b800c990 tx=0x7f70b808a5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8613a707d02973bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:32.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.146+0000 7f709f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:17:32.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.146+0000 7f709f7fe640 1 -- 172.21.15.18:0/1562433075 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b8062e30 con 0x560128128a50 2024-09-19T09:17:32.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.146+0000 7f709f7fe640 1 -- 172.21.15.18:0/1562433075 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 5709+0+0 (secure 0 0 0) 0x7f70b8079120 con 0x560128128a50 2024-09-19T09:17:32.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.146+0000 7f70c9842740 1 -- 172.21.15.18:0/1562433075 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70b80583a0 con 0x560128128a50 2024-09-19T09:17:32.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.146+0000 7f709f7fe640 1 -- 172.21.15.18:0/1562433075 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f70b80629a0 con 0x560128128a50 2024-09-19T09:17:32.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.146+0000 7f70c9842740 10 client.6051 fetch_fsmap learned FSMap version 35 2024-09-19T09:17:32.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.146+0000 7f70c9842740 1 -- 172.21.15.18:0/1562433075 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) -- 0x5601281d7fb0 con 0x560128128a50 2024-09-19T09:17:32.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.146+0000 7f709f7fe640 1 -- 172.21.15.18:0/1562433075 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70b80583a0 con 0x560128128a50 2024-09-19T09:17:32.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.146+0000 7f709f7fe640 1 -- 172.21.15.18:0/1562433075 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 35) ==== 3502+0+0 (secure 0 0 0) 0x7f70b808ab30 con 0x560128128a50 2024-09-19T09:17:32.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.146+0000 7f70c9842740 10 client.6051 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T09:17:32.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.146+0000 7f70c9842740 10 client.6051 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T09:17:32.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.146+0000 7f70c9842740 20 client.6051 populate_metadata read hostname 'smithi018' 2024-09-19T09:17:32.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.146+0000 7f70c9842740 1 --2- 172.21.15.18:0/1562433075 >> [v2:172.21.15.18:6833/905153716,v1:172.21.15.18:6835/905153716] conn(0x56012818ef90 0x56012818f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.146+0000 7f70c9842740 4 client.6051 mds_command: new command op to 5895 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:17:32.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.146+0000 7f70c9842740 1 -- 172.21.15.18:0/1562433075 --> [v2:172.21.15.18:6833/905153716,v1:172.21.15.18:6835/905153716] -- command(tid 0: {"prefix": "status"}) -- 0x560128090fa0 con 0x56012818ef90 2024-09-19T09:17:32.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.146+0000 7f70c484b640 1 --2- 172.21.15.18:0/1562433075 >> [v2:172.21.15.18:6833/905153716,v1:172.21.15.18:6835/905153716] conn(0x56012818ef90 0x56012818f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:32.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.147+0000 7f709f7fe640 10 client.6051 ms_handle_connect on v2:172.21.15.18:6833/905153716 2024-09-19T09:17:32.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.147+0000 7f70c484b640 1 --2- 172.21.15.18:0/1562433075 >> [v2:172.21.15.18:6833/905153716,v1:172.21.15.18:6835/905153716] conn(0x56012818ef90 0x56012818f370 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37701223dfae6692 server_cookie=e35d53fe7af93e6c in_seq=0 out_seq=0 2024-09-19T09:17:32.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.147+0000 7f709f7fe640 1 -- 172.21.15.18:0/1562433075 <== mds.0 v2:172.21.15.18:6833/905153716 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x560128090fa0 con 0x56012818ef90 2024-09-19T09:17:32.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.147+0000 7f709f7fe640 10 client.6051 handle_command_reply: tid=0 2024-09-19T09:17:32.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.147+0000 7f70c9842740 1 client.6051 shutdown 2024-09-19T09:17:32.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.147+0000 7f70c9842740 1 -- 172.21.15.18:0/1562433075 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560128128a50 msgr2=0x56012816b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:32.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.147+0000 7f70c9842740 1 --2- 172.21.15.18:0/1562433075 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560128128a50 0x56012816b120 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f70b800c990 tx=0x7f70b808a5e0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.147+0000 7f70c9842740 1 -- 172.21.15.18:0/1562433075 shutdown_connections 2024-09-19T09:17:32.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.147+0000 7f70c9842740 1 --2- 172.21.15.18:0/1562433075 >> [v2:172.21.15.18:6833/905153716,v1:172.21.15.18:6835/905153716] conn(0x56012818ef90 0x56012818f370 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.147+0000 7f70c9842740 1 --2- 172.21.15.18:0/1562433075 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x560128128a50 0x56012816b120 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.147+0000 7f70c9842740 1 --2- 172.21.15.18:0/1562433075 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5601281272c0 0x5601281d7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.147+0000 7f70c9842740 1 --2- 172.21.15.18:0/1562433075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x560128121c80 0x56012814d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.147+0000 7f709f7fe640 0 client.6051 ms_handle_reset on v2:172.21.15.18:6833/905153716 2024-09-19T09:17:32.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.147+0000 7f70c9842740 1 -- 172.21.15.18:0/1562433075 >> 172.21.15.18:0/1562433075 conn(0x560128124a80 msgr2=0x560128147c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:32.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.147+0000 7f70c9842740 1 -- 172.21.15.18:0/1562433075 shutdown_connections 2024-09-19T09:17:32.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.147+0000 7f70c9842740 1 -- 172.21.15.18:0/1562433075 wait complete. 2024-09-19T09:17:32.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.147+0000 7f70c9842740 20 client.6051 trim_cache size 0 max 16384 2024-09-19T09:17:32.160 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:17:32.160 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:17:32.160 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-09-19T09:17:32.160 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 5895, 2024-09-19T09:17:32.160 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-19T09:17:32.160 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-19T09:17:32.161 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-19T09:17:32.161 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 9.0596558389999995, 2024-09-19T09:17:32.161 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 35, 2024-09-19T09:17:32.161 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 90, 2024-09-19T09:17:32.161 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 90, 2024-09-19T09:17:32.161 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 20.062963918000001 2024-09-19T09:17:32.161 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:17:32.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.148+0000 7f70c6aaf640 1 -- 172.21.15.18:0/2511090004 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f70ac06c2b0 msgr2=0x7f70ac06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:32.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.148+0000 7f70c6aaf640 1 --2- 172.21.15.18:0/2511090004 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f70ac06c2b0 0x7f70ac06e770 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f70b0009aa0 tx=0x7f70b0009190 comp rx=0 tx=0).stop 2024-09-19T09:17:32.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.148+0000 7f70c6aaf640 1 -- 172.21.15.18:0/2511090004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70c00b5d40 msgr2=0x7f70c00b5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:32.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.148+0000 7f70c6aaf640 1 --2- 172.21.15.18:0/2511090004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70c00b5d40 0x7f70c00b5070 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f70b800efc0 tx=0x7f70b800c490 comp rx=0 tx=0).stop 2024-09-19T09:17:32.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.148+0000 7f70c6aaf640 1 -- 172.21.15.18:0/2511090004 shutdown_connections 2024-09-19T09:17:32.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.148+0000 7f70c6aaf640 1 --2- 172.21.15.18:0/2511090004 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f70ac06c2b0 0x7f70ac06e770 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.148+0000 7f70c6aaf640 1 --2- 172.21.15.18:0/2511090004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f70c00b5d40 0x7f70c00b5070 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.148+0000 7f70c6aaf640 1 --2- 172.21.15.18:0/2511090004 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f70c00aeee0 0x7f70c00cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.148+0000 7f70c6aaf640 1 --2- 172.21.15.18:0/2511090004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f70c00728b0 0x7f70c009d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.148+0000 7f70c6aaf640 1 -- 172.21.15.18:0/2511090004 >> 172.21.15.18:0/2511090004 conn(0x7f70c00d0c00 msgr2=0x7f70c0154ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:32.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.148+0000 7f70c6aaf640 1 -- 172.21.15.18:0/2511090004 shutdown_connections 2024-09-19T09:17:32.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.148+0000 7f70c6aaf640 1 -- 172.21.15.18:0/2511090004 wait complete. 2024-09-19T09:17:32.166 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T09:17:32.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.268+0000 7f0d82874640 1 Processor -- start 2024-09-19T09:17:32.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.268+0000 7f0d82874640 1 -- start start 2024-09-19T09:17:32.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.269+0000 7f0d82874640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0d7c15ec40 0x7f0d7c0d1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.269+0000 7f0d82874640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d7c06de00 con 0x7f0d7c15f020 2024-09-19T09:17:32.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.269+0000 7f0d82874640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d7c15fb40 con 0x7f0d7c15fe50 2024-09-19T09:17:32.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.269+0000 7f0d82874640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f0d7c06e0a0 con 0x7f0d7c15ec40 2024-09-19T09:17:32.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.269+0000 7f0d80e11640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f0d7c15f020 0x7f0d7c15f430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:37440/0 (socket says 172.21.15.18:37440) 2024-09-19T09:17:32.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.269+0000 7f0d80e11640 1 -- 172.21.15.18:0/997867922 learned_addr learned my addr 172.21.15.18:0/997867922 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:17:32.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.270+0000 7f0d7bfff640 1 --2- 172.21.15.18:0/997867922 >> v2:172.21.15.162:3300/0 conn(0x7f0d7c15ec40 0x7f0d7c0d1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:32.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.270+0000 7f0d7affd640 1 -- 172.21.15.18:0/997867922 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 53618904 0 0) 0x7f0d7c06de00 con 0x7f0d7c15f020 2024-09-19T09:17:32.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.270+0000 7f0d7affd640 1 -- 172.21.15.18:0/997867922 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d64003520 con 0x7f0d7c15f020 2024-09-19T09:17:32.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.270+0000 7f0d7affd640 1 -- 172.21.15.18:0/997867922 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1519142133 0 0) 0x7f0d64003520 con 0x7f0d7c15f020 2024-09-19T09:17:32.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.270+0000 7f0d7affd640 1 -- 172.21.15.18:0/997867922 >> v2:172.21.15.162:3300/0 conn(0x7f0d7c15ec40 msgr2=0x7f0d7c0d1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:32.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.270+0000 7f0d7affd640 1 --2- 172.21.15.18:0/997867922 >> v2:172.21.15.162:3300/0 conn(0x7f0d7c15ec40 0x7f0d7c0d1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.270+0000 7f0d7affd640 1 -- 172.21.15.18:0/997867922 >> v1:172.21.15.162:6789/0 conn(0x7f0d7c15fe50 legacy=0x7f0d7c06d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:32.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.270+0000 7f0d7affd640 1 -- 172.21.15.18:0/997867922 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d7c0d0f10 con 0x7f0d7c15f020 2024-09-19T09:17:32.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.270+0000 7f0d7affd640 1 -- 172.21.15.18:0/997867922 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f0d74001a10 con 0x7f0d7c15f020 2024-09-19T09:17:32.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.270+0000 7f0d7affd640 1 -- 172.21.15.18:0/997867922 >> v1:172.21.15.18:6789/0 conn(0x7f0d7c15f020 legacy=0x7f0d7c15f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:32.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.270+0000 7f0d7affd640 1 --2- 172.21.15.18:0/997867922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d64003a00 0x7f0d64003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.270+0000 7f0d7affd640 1 --2- 172.21.15.18:0/997867922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d64004800 0x7f0d64004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.270+0000 7f0d7affd640 1 --2- 172.21.15.18:0/997867922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d640051c0 0x7f0d6400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.270+0000 7f0d7affd640 1 -- 172.21.15.18:0/997867922 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c06e0a0 con 0x7f0d64004800 2024-09-19T09:17:32.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.270+0000 7f0d7affd640 1 -- 172.21.15.18:0/997867922 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6400c0c0 con 0x7f0d640051c0 2024-09-19T09:17:32.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.270+0000 7f0d7affd640 1 -- 172.21.15.18:0/997867922 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0d6400c2c0 con 0x7f0d64003a00 2024-09-19T09:17:32.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.270+0000 7f0d7b7fe640 1 --2- 172.21.15.18:0/997867922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d64004800 0x7f0d64004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:32.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.270+0000 7f0d7bfff640 1 --2- 172.21.15.18:0/997867922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d64003a00 0x7f0d64003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:32.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.270+0000 7f0d80e11640 1 --2- 172.21.15.18:0/997867922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d640051c0 0x7f0d6400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:32.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.270+0000 7f0d7b7fe640 1 -- 172.21.15.18:0/997867922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d64003a00 msgr2=0x7f0d64003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:32.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.270+0000 7f0d7b7fe640 1 --2- 172.21.15.18:0/997867922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d64003a00 0x7f0d64003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.270+0000 7f0d7b7fe640 1 -- 172.21.15.18:0/997867922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d640051c0 msgr2=0x7f0d6400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:32.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.270+0000 7f0d7b7fe640 1 --2- 172.21.15.18:0/997867922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d640051c0 0x7f0d6400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.270+0000 7f0d7b7fe640 1 -- 172.21.15.18:0/997867922 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d64003520 con 0x7f0d64004800 2024-09-19T09:17:32.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.270+0000 7f0d80e11640 1 -- 172.21.15.18:0/997867922 reap_dead start 2024-09-19T09:17:32.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.271+0000 7f0d7b7fe640 1 --2- 172.21.15.18:0/997867922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d64004800 0x7f0d64004c80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f0d70001750 tx=0x7f0d64005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995e77012c3693cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:32.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.271+0000 7f0d7affd640 1 -- 172.21.15.18:0/997867922 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d70001370 con 0x7f0d64004800 2024-09-19T09:17:32.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.271+0000 7f0d7affd640 1 -- 172.21.15.18:0/997867922 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d700052d0 con 0x7f0d64004800 2024-09-19T09:17:32.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.271+0000 7f0d7affd640 1 -- 172.21.15.18:0/997867922 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d7002abc0 con 0x7f0d64004800 2024-09-19T09:17:32.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.272+0000 7f0d82874640 1 -- 172.21.15.18:0/997867922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d64004800 msgr2=0x7f0d64004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:32.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.272+0000 7f0d82874640 1 --2- 172.21.15.18:0/997867922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d64004800 0x7f0d64004c80 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f0d70001750 tx=0x7f0d64005830 comp rx=0 tx=0).stop 2024-09-19T09:17:32.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.272+0000 7f0d82874640 1 -- 172.21.15.18:0/997867922 shutdown_connections 2024-09-19T09:17:32.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.272+0000 7f0d82874640 1 --2- 172.21.15.18:0/997867922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d64004800 0x7f0d64004c80 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.272+0000 7f0d82874640 1 -- 172.21.15.18:0/997867922 >> 172.21.15.18:0/997867922 conn(0x7f0d7c0b45f0 msgr2=0x7f0d7c0b4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:32.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.272+0000 7f0d82874640 1 -- 172.21.15.18:0/997867922 shutdown_connections 2024-09-19T09:17:32.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.272+0000 7f0d82874640 1 -- 172.21.15.18:0/997867922 wait complete. 2024-09-19T09:17:32.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.273+0000 7f0d82874640 1 Processor -- start 2024-09-19T09:17:32.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.273+0000 7f0d82874640 1 -- start start 2024-09-19T09:17:32.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.274+0000 7f0d82874640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d64004800 0x7f0d7c1571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.274+0000 7f0d82874640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d7c0c94d0 0x7f0d7c0b5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.274+0000 7f0d82874640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d7c0b5e50 0x7f0d7c0cc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.274+0000 7f0d82874640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c0d17b0 con 0x7f0d64004800 2024-09-19T09:17:32.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.274+0000 7f0d82874640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0d7c0d14d0 con 0x7f0d7c0b5e50 2024-09-19T09:17:32.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.274+0000 7f0d82874640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0d7c15f430 con 0x7f0d7c0c94d0 2024-09-19T09:17:32.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.274+0000 7f0d7bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d64004800 0x7f0d7c1571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:32.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.274+0000 7f0d7bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d64004800 0x7f0d7c1571a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34300/0 (socket says 172.21.15.18:34300) 2024-09-19T09:17:32.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.274+0000 7f0d7bfff640 1 -- 172.21.15.18:0/4198959678 learned_addr learned my addr 172.21.15.18:0/4198959678 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:32.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.274+0000 7f0d7bfff640 1 -- 172.21.15.18:0/4198959678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d7c0c94d0 msgr2=0x7f0d7c0b5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:32.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.274+0000 7f0d7bfff640 1 --2- 172.21.15.18:0/4198959678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d7c0c94d0 0x7f0d7c0b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.274+0000 7f0d7bfff640 1 -- 172.21.15.18:0/4198959678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d7c0b5e50 msgr2=0x7f0d7c0cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:32.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.274+0000 7f0d7bfff640 1 --2- 172.21.15.18:0/4198959678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d7c0b5e50 0x7f0d7c0cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.274+0000 7f0d7bfff640 1 -- 172.21.15.18:0/4198959678 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d7c1576e0 con 0x7f0d64004800 2024-09-19T09:17:32.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.274+0000 7f0d7bfff640 1 --2- 172.21.15.18:0/4198959678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d64004800 0x7f0d7c1571a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c011aa0 tx=0x7f0d6c011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:32.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.275+0000 7f0d78ff9640 1 -- 172.21.15.18:0/4198959678 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c00fb00 con 0x7f0d64004800 2024-09-19T09:17:32.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.275+0000 7f0d78ff9640 1 -- 172.21.15.18:0/4198959678 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d6c00fca0 con 0x7f0d64004800 2024-09-19T09:17:32.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.275+0000 7f0d78ff9640 1 -- 172.21.15.18:0/4198959678 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c014660 con 0x7f0d64004800 2024-09-19T09:17:32.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.275+0000 7f0d82874640 1 -- 172.21.15.18:0/4198959678 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d7c0b87c0 con 0x7f0d64004800 2024-09-19T09:17:32.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.275+0000 7f0d82874640 1 -- 172.21.15.18:0/4198959678 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d7c0b7fc0 con 0x7f0d64004800 2024-09-19T09:17:32.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.276+0000 7f0d82874640 1 -- 172.21.15.18:0/4198959678 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d7c15f7c0 con 0x7f0d64004800 2024-09-19T09:17:32.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.276+0000 7f0d78ff9640 1 -- 172.21.15.18:0/4198959678 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0d6c012040 con 0x7f0d64004800 2024-09-19T09:17:32.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.277+0000 7f0d78ff9640 1 --2- 172.21.15.18:0/4198959678 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0d6806c2e0 0x7f0d6806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:32.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.277+0000 7f0d78ff9640 1 -- 172.21.15.18:0/4198959678 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5709+0+0 (secure 0 0 0) 0x7f0d6c08bc50 con 0x7f0d64004800 2024-09-19T09:17:32.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.277+0000 7f0d7b7fe640 1 --2- 172.21.15.18:0/4198959678 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0d6806c2e0 0x7f0d6806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:32.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.277+0000 7f0d7b7fe640 1 --2- 172.21.15.18:0/4198959678 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0d6806c2e0 0x7f0d6806e7a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0d70032000 tx=0x7f0d7002c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:32.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.281+0000 7f0d78ff9640 1 -- 172.21.15.18:0/4198959678 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0d6c019030 con 0x7f0d64004800 2024-09-19T09:17:32.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.492+0000 7f0d82874640 1 -- 172.21.15.18:0/4198959678 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0d7c0b8a40 con 0x7f0d64004800 2024-09-19T09:17:32.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.493+0000 7f0d78ff9640 1 -- 172.21.15.18:0/4198959678 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) ==== 53+0+73 (secure 0 0 0) 0x7f0d6c05a290 con 0x7f0d64004800 2024-09-19T09:17:32.493 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T09:17:32.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.495+0000 7f0d82874640 1 -- 172.21.15.18:0/4198959678 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0d6806c2e0 msgr2=0x7f0d6806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:32.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.495+0000 7f0d82874640 1 --2- 172.21.15.18:0/4198959678 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0d6806c2e0 0x7f0d6806e7a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f0d70032000 tx=0x7f0d7002c000 comp rx=0 tx=0).stop 2024-09-19T09:17:32.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.495+0000 7f0d82874640 1 -- 172.21.15.18:0/4198959678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d64004800 msgr2=0x7f0d7c1571a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:32.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.495+0000 7f0d82874640 1 --2- 172.21.15.18:0/4198959678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d64004800 0x7f0d7c1571a0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c011aa0 tx=0x7f0d6c011f60 comp rx=0 tx=0).stop 2024-09-19T09:17:32.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.495+0000 7f0d82874640 1 -- 172.21.15.18:0/4198959678 shutdown_connections 2024-09-19T09:17:32.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.495+0000 7f0d82874640 1 --2- 172.21.15.18:0/4198959678 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0d6806c2e0 0x7f0d6806e7a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.495+0000 7f0d82874640 1 --2- 172.21.15.18:0/4198959678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0d7c0b5e50 0x7f0d7c0cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.495+0000 7f0d82874640 1 --2- 172.21.15.18:0/4198959678 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0d7c0c94d0 0x7f0d7c0b5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.495+0000 7f0d82874640 1 --2- 172.21.15.18:0/4198959678 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0d64004800 0x7f0d7c1571a0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:32.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.495+0000 7f0d82874640 1 -- 172.21.15.18:0/4198959678 >> 172.21.15.18:0/4198959678 conn(0x7f0d7c0b45f0 msgr2=0x7f0d7c0d1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:32.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.495+0000 7f0d82874640 1 -- 172.21.15.18:0/4198959678 shutdown_connections 2024-09-19T09:17:32.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32.495+0000 7f0d82874640 1 -- 172.21.15.18:0/4198959678 wait complete. 2024-09-19T09:17:32.507 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-19T09:17:32.507 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:17:32.507 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-09-19T09:17:32.507 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T09:17:32.507 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:17:32.507 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-19T09:17:32.507 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-19T09:17:32.507 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:17:32.507 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:17:32.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:17:32.508 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-09-19T09:17:32.526 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:17:32.526 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:17:32.526 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:17:32.526 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:17:32.526 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-09-19T09:17:32.526 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:17:32.526 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:17:32.527 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:17:32.527 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-09-19T09:17:32.527 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:17:32.527 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:17:32.527 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-09-19T09:17:32.527 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:17:32.527 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:17:32.527 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-09-19T09:17:32.527 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T09:17:32.527 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42545sec preferred_lft 42545sec 2024-09-19T09:17:32.528 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-09-19T09:17:32.528 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:17:32.529 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:17:32.529 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:17:32.529 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-09-19T09:17:32.529 INFO:teuthology.orchestra.run.smithi018.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T09:17:32.529 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:44:1b:02:86:87 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:17:32.529 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T09:17:32.529 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:17:32.529 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::a0ce:faff:feaa:13ec/64 scope link 2024-09-19T09:17:32.529 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:17:32.529 INFO:teuthology.orchestra.run.smithi018.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:17:32.529 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:44:1b:02:86:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:17:32.530 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::44:1bff:fe02:8687/64 scope link 2024-09-19T09:17:32.530 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:17:32.530 INFO:teuthology.orchestra.run.smithi018.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:17:32.530 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether e2:6d:c4:af:6a:8b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T09:17:32.530 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::e06d:c4ff:feaf:6a8b/64 scope link 2024-09-19T09:17:32.530 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:17:32.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:17:32.530 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:17:32.593 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-09-19T09:17:32.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:17:32.595 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-09-19T09:17:32.657 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-09-19T09:17:32.657 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:17:32.657 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T09:17:32.657 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T09:17:32.658 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:17:32.658 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:17:32.658 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T09:17:32.658 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T09:17:32.658 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T09:17:32.658 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T09:17:32.658 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T09:17:32.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:17:32.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:17:32.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:17:32.786 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-19T09:17:32.802 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-19T09:17:32.802 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T09:17:32.803 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:17:32.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:17:32.803 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-09-19T09:17:32.868 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:17:32.868 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T09:17:32.924 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:17:32.925 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:17:32.925 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:17:32.982 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-19T09:17:32.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:17:32.982 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:17:33.068 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:17:33.068 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:17:33.068 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:17:33.077 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:17:33.077 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:17:33.077 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:17:33.077 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:17:33.077 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:17:33.082 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:17:33.082 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:17:33.082 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:17:33.082 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:17:33.082 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:17:33.083 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-19T09:17:33.083 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-19T09:17:33.083 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fec66d7e-50e5-42ed-81de-ad141a2f0f4e" will pass to kernel 2024-09-19T09:17:33.083 INFO:teuthology.orchestra.run.smithi018.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-19T09:17:33.083 INFO:teuthology.orchestra.run.smithi018.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:17:33.083 INFO:teuthology.orchestra.run.smithi018.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:17:33.083 INFO:teuthology.orchestra.run.smithi018.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:17:33.083 INFO:teuthology.orchestra.run.smithi018.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:17:33.084 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:17:33.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:17:33.085 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:17:33.151 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:17:33.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:17:33.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:17:33.255 INFO:teuthology.orchestra.run.smithi018.stdout:client5330 2024-09-19T09:17:33.255 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:17:33.255 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:17:33.272 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T09:17:33.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.413+0000 7f5abc8af640 1 Processor -- start 2024-09-19T09:17:33.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.413+0000 7f5abc8af640 1 -- start start 2024-09-19T09:17:33.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.414+0000 7f5abc8af640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5ab80708f0 0x7f5ab80cf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:33.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.414+0000 7f5abc8af640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ab80d0050 con 0x7f5ab80d1ed0 2024-09-19T09:17:33.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.414+0000 7f5abc8af640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ab80d0330 con 0x7f5ab8160300 2024-09-19T09:17:33.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.414+0000 7f5abc8af640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f5ab80d1420 con 0x7f5ab80708f0 2024-09-19T09:17:33.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.414+0000 7f5ab6d9d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f5ab80d1ed0 0x7f5ab80cd730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:37456/0 (socket says 172.21.15.18:37456) 2024-09-19T09:17:33.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.414+0000 7f5ab6d9d640 1 -- 172.21.15.18:0/3967294479 learned_addr learned my addr 172.21.15.18:0/3967294479 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:17:33.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.415+0000 7f5ab559a640 1 -- 172.21.15.18:0/3967294479 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 318112761 0 0) 0x7f5ab80d0050 con 0x7f5ab80d1ed0 2024-09-19T09:17:33.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.415+0000 7f5ab559a640 1 -- 172.21.15.18:0/3967294479 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5aa0003520 con 0x7f5ab80d1ed0 2024-09-19T09:17:33.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.415+0000 7f5ab5d9b640 1 --2- 172.21.15.18:0/3967294479 >> v2:172.21.15.162:3300/0 conn(0x7f5ab80708f0 0x7f5ab80cf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:33.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.415+0000 7f5ab559a640 1 -- 172.21.15.18:0/3967294479 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2534085239 0 0) 0x7f5aa0003520 con 0x7f5ab80d1ed0 2024-09-19T09:17:33.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.415+0000 7f5ab559a640 1 -- 172.21.15.18:0/3967294479 >> v2:172.21.15.162:3300/0 conn(0x7f5ab80708f0 msgr2=0x7f5ab80cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:33.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.415+0000 7f5ab559a640 1 --2- 172.21.15.18:0/3967294479 >> v2:172.21.15.162:3300/0 conn(0x7f5ab80708f0 0x7f5ab80cf9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:33.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.415+0000 7f5ab559a640 1 -- 172.21.15.18:0/3967294479 >> v1:172.21.15.162:6789/0 conn(0x7f5ab8160300 legacy=0x7f5ab80cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:33.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.415+0000 7f5ab559a640 1 -- 172.21.15.18:0/3967294479 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab80d1700 con 0x7f5ab80d1ed0 2024-09-19T09:17:33.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.415+0000 7f5ab559a640 1 -- 172.21.15.18:0/3967294479 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f5ab00019f0 con 0x7f5ab80d1ed0 2024-09-19T09:17:33.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.415+0000 7f5ab559a640 1 -- 172.21.15.18:0/3967294479 >> v1:172.21.15.18:6789/0 conn(0x7f5ab80d1ed0 legacy=0x7f5ab80cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:33.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.415+0000 7f5ab559a640 1 --2- 172.21.15.18:0/3967294479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5aa00039b0 0x7f5aa0003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:33.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.415+0000 7f5ab559a640 1 --2- 172.21.15.18:0/3967294479 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5aa0004800 0x7f5aa0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:33.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.415+0000 7f5ab559a640 1 --2- 172.21.15.18:0/3967294479 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5aa00052e0 0x7f5aa000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:33.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.415+0000 7f5ab559a640 1 -- 172.21.15.18:0/3967294479 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab80d1420 con 0x7f5aa00039b0 2024-09-19T09:17:33.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.415+0000 7f5ab559a640 1 -- 172.21.15.18:0/3967294479 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5aa000c190 con 0x7f5aa00052e0 2024-09-19T09:17:33.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.415+0000 7f5ab559a640 1 -- 172.21.15.18:0/3967294479 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5aa000c390 con 0x7f5aa0004800 2024-09-19T09:17:33.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.415+0000 7f5ab659c640 1 --2- 172.21.15.18:0/3967294479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5aa00039b0 0x7f5aa0003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:33.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.415+0000 7f5ab5d9b640 1 --2- 172.21.15.18:0/3967294479 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5aa0004800 0x7f5aa0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:33.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.415+0000 7f5ab6d9d640 1 --2- 172.21.15.18:0/3967294479 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5aa00052e0 0x7f5aa000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:33.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.415+0000 7f5ab659c640 1 -- 172.21.15.18:0/3967294479 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5aa0004800 msgr2=0x7f5aa0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:33.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.415+0000 7f5ab659c640 1 --2- 172.21.15.18:0/3967294479 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5aa0004800 0x7f5aa0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:33.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.415+0000 7f5ab659c640 1 -- 172.21.15.18:0/3967294479 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5aa00052e0 msgr2=0x7f5aa000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:17:33.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.415+0000 7f5ab659c640 1 --2- 172.21.15.18:0/3967294479 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5aa00052e0 0x7f5aa000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:33.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.415+0000 7f5ab659c640 1 -- 172.21.15.18:0/3967294479 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aa0003520 con 0x7f5aa00039b0 2024-09-19T09:17:33.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.415+0000 7f5ab6d9d640 1 --2- 172.21.15.18:0/3967294479 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5aa00052e0 0x7f5aa000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:33.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.415+0000 7f5ab6d9d640 1 -- 172.21.15.18:0/3967294479 reap_dead start 2024-09-19T09:17:33.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.415+0000 7f5ab5d9b640 1 --2- 172.21.15.18:0/3967294479 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5aa0004800 0x7f5aa0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:33.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.416+0000 7f5ab659c640 1 --2- 172.21.15.18:0/3967294479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5aa00039b0 0x7f5aa0003db0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8003d80 tx=0x7f5aa0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ce7a68545792e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:33.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.416+0000 7f5ab559a640 1 -- 172.21.15.18:0/3967294479 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8037070 con 0x7f5aa00039b0 2024-09-19T09:17:33.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.416+0000 7f5ab559a640 1 -- 172.21.15.18:0/3967294479 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5aa802a9c0 con 0x7f5aa00039b0 2024-09-19T09:17:33.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.416+0000 7f5ab559a640 1 -- 172.21.15.18:0/3967294479 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8003980 con 0x7f5aa00039b0 2024-09-19T09:17:33.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.417+0000 7f5abc8af640 1 -- 172.21.15.18:0/3967294479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5aa00039b0 msgr2=0x7f5aa0003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:33.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.417+0000 7f5abc8af640 1 --2- 172.21.15.18:0/3967294479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5aa00039b0 0x7f5aa0003db0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8003d80 tx=0x7f5aa0005830 comp rx=0 tx=0).stop 2024-09-19T09:17:33.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.417+0000 7f5abc8af640 1 -- 172.21.15.18:0/3967294479 shutdown_connections 2024-09-19T09:17:33.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.417+0000 7f5abc8af640 1 --2- 172.21.15.18:0/3967294479 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5aa00039b0 0x7f5aa0003db0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:33.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.417+0000 7f5abc8af640 1 -- 172.21.15.18:0/3967294479 >> 172.21.15.18:0/3967294479 conn(0x7f5ab80b4600 msgr2=0x7f5ab80b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:33.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.417+0000 7f5abc8af640 1 -- 172.21.15.18:0/3967294479 shutdown_connections 2024-09-19T09:17:33.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.417+0000 7f5abc8af640 1 -- 172.21.15.18:0/3967294479 wait complete. 2024-09-19T09:17:33.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.418+0000 7f5abc8af640 1 Processor -- start 2024-09-19T09:17:33.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.418+0000 7f5abc8af640 1 -- start start 2024-09-19T09:17:33.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.419+0000 7f5abc8af640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5aa00039b0 0x7f5ab8159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:33.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.419+0000 7f5abc8af640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ab814b660 0x7f5ab80b83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:33.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.419+0000 7f5abc8af640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ab815b7e0 0x7f5ab815bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:33.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.419+0000 7f5abc8af640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab81606e0 con 0x7f5aa00039b0 2024-09-19T09:17:33.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.419+0000 7f5abc8af640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab80b54a0 con 0x7f5ab815b7e0 2024-09-19T09:17:33.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.419+0000 7f5abc8af640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5ab8160860 con 0x7f5ab814b660 2024-09-19T09:17:33.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.419+0000 7f5ab659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5aa00039b0 0x7f5ab8159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:33.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.419+0000 7f5ab659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5aa00039b0 0x7f5ab8159530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34330/0 (socket says 172.21.15.18:34330) 2024-09-19T09:17:33.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.419+0000 7f5ab659c640 1 -- 172.21.15.18:0/1628080860 learned_addr learned my addr 172.21.15.18:0/1628080860 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:33.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.419+0000 7f5ab6d9d640 1 --2- 172.21.15.18:0/1628080860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ab815b7e0 0x7f5ab815bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:33.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.419+0000 7f5ab5d9b640 1 --2- 172.21.15.18:0/1628080860 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ab814b660 0x7f5ab80b83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:33.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.419+0000 7f5ab659c640 1 -- 172.21.15.18:0/1628080860 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ab814b660 msgr2=0x7f5ab80b83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:33.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.419+0000 7f5ab659c640 1 --2- 172.21.15.18:0/1628080860 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ab814b660 0x7f5ab80b83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:33.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.419+0000 7f5ab659c640 1 -- 172.21.15.18:0/1628080860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ab815b7e0 msgr2=0x7f5ab815bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:33.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.419+0000 7f5ab659c640 1 --2- 172.21.15.18:0/1628080860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ab815b7e0 0x7f5ab815bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:33.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.419+0000 7f5ab659c640 1 -- 172.21.15.18:0/1628080860 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab814bed0 con 0x7f5aa00039b0 2024-09-19T09:17:33.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.420+0000 7f5ab659c640 1 --2- 172.21.15.18:0/1628080860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5aa00039b0 0x7f5ab8159530 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8035040 tx=0x7f5aa80036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:33.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.420+0000 7f5aa6ffd640 1 -- 172.21.15.18:0/1628080860 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8042020 con 0x7f5aa00039b0 2024-09-19T09:17:33.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.420+0000 7f5aa6ffd640 1 -- 172.21.15.18:0/1628080860 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5aa8038040 con 0x7f5aa00039b0 2024-09-19T09:17:33.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.420+0000 7f5abc8af640 1 -- 172.21.15.18:0/1628080860 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ab8159a70 con 0x7f5aa00039b0 2024-09-19T09:17:33.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.420+0000 7f5aa6ffd640 1 -- 172.21.15.18:0/1628080860 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8037050 con 0x7f5aa00039b0 2024-09-19T09:17:33.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.420+0000 7f5abc8af640 1 -- 172.21.15.18:0/1628080860 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ab80c69b0 con 0x7f5aa00039b0 2024-09-19T09:17:33.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.421+0000 7f5abc8af640 1 -- 172.21.15.18:0/1628080860 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ab80cf2d0 con 0x7f5aa00039b0 2024-09-19T09:17:33.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.421+0000 7f5aa6ffd640 1 -- 172.21.15.18:0/1628080860 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5aa8007450 con 0x7f5aa00039b0 2024-09-19T09:17:33.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.422+0000 7f5aa6ffd640 1 --2- 172.21.15.18:0/1628080860 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5a9806c2e0 0x7f5a9806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:33.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.422+0000 7f5aa6ffd640 1 -- 172.21.15.18:0/1628080860 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5709+0+0 (secure 0 0 0) 0x7f5aa80ab440 con 0x7f5aa00039b0 2024-09-19T09:17:33.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.422+0000 7f5ab5d9b640 1 --2- 172.21.15.18:0/1628080860 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5a9806c2e0 0x7f5a9806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:33.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.422+0000 7f5ab5d9b640 1 --2- 172.21.15.18:0/1628080860 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5a9806c2e0 0x7f5a9806e7a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5ab814b610 tx=0x7f5aac008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:33.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.426+0000 7f5aa6ffd640 1 -- 172.21.15.18:0/1628080860 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5aa804c020 con 0x7f5aa00039b0 2024-09-19T09:17:33.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.636+0000 7f5abc8af640 1 -- 172.21.15.18:0/1628080860 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5ab8068740 con 0x7f5aa00039b0 2024-09-19T09:17:33.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.636+0000 7f5aa6ffd640 1 -- 172.21.15.18:0/1628080860 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v35) ==== 53+0+73 (secure 0 0 0) 0x7f5aa8079bc0 con 0x7f5aa00039b0 2024-09-19T09:17:33.637 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T09:17:33.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.638+0000 7f5abc8af640 1 -- 172.21.15.18:0/1628080860 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5a9806c2e0 msgr2=0x7f5a9806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:33.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.638+0000 7f5abc8af640 1 --2- 172.21.15.18:0/1628080860 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5a9806c2e0 0x7f5a9806e7a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5ab814b610 tx=0x7f5aac008040 comp rx=0 tx=0).stop 2024-09-19T09:17:33.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.638+0000 7f5abc8af640 1 -- 172.21.15.18:0/1628080860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5aa00039b0 msgr2=0x7f5ab8159530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:33.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.638+0000 7f5abc8af640 1 --2- 172.21.15.18:0/1628080860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5aa00039b0 0x7f5ab8159530 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8035040 tx=0x7f5aa80036f0 comp rx=0 tx=0).stop 2024-09-19T09:17:33.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.638+0000 7f5abc8af640 1 -- 172.21.15.18:0/1628080860 shutdown_connections 2024-09-19T09:17:33.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.638+0000 7f5abc8af640 1 --2- 172.21.15.18:0/1628080860 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5a9806c2e0 0x7f5a9806e7a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:33.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.638+0000 7f5abc8af640 1 --2- 172.21.15.18:0/1628080860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5ab815b7e0 0x7f5ab815bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:33.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.638+0000 7f5abc8af640 1 --2- 172.21.15.18:0/1628080860 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5ab814b660 0x7f5ab80b83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:33.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.638+0000 7f5abc8af640 1 --2- 172.21.15.18:0/1628080860 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5aa00039b0 0x7f5ab8159530 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:33.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.638+0000 7f5abc8af640 1 -- 172.21.15.18:0/1628080860 >> 172.21.15.18:0/1628080860 conn(0x7f5ab80b4600 msgr2=0x7f5ab80b3cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:33.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.638+0000 7f5abc8af640 1 -- 172.21.15.18:0/1628080860 shutdown_connections 2024-09-19T09:17:33.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:33.638+0000 7f5abc8af640 1 -- 172.21.15.18:0/1628080860 wait complete. 2024-09-19T09:17:33.650 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-19T09:17:33.650 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:17:33.650 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-09-19T09:17:33.650 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-19T09:17:33.650 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-19T09:17:33.650 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-19T09:17:33.650 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-19T09:17:33.650 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:17:33.650 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:17:33.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:17:33.651 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-09-19T09:17:33.671 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:17:33.671 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:17:33.671 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:17:33.671 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:17:33.671 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-09-19T09:17:33.671 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:17:33.672 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:17:33.672 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:17:33.672 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-09-19T09:17:33.672 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:17:33.672 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:17:33.672 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-09-19T09:17:33.672 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:17:33.672 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:17:33.672 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:17:33.672 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:17:33.672 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T09:17:33.672 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42555sec preferred_lft 42555sec 2024-09-19T09:17:33.672 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link noprefixroute 2024-09-19T09:17:33.672 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:17:33.673 INFO:teuthology.orchestra.run.smithi162.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T09:17:33.673 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 5e:4d:7e:1d:19:f9 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:17:33.673 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T09:17:33.673 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:17:33.673 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::5829:65ff:fe01:6bc7/64 scope link 2024-09-19T09:17:33.673 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:17:33.673 INFO:teuthology.orchestra.run.smithi162.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:17:33.673 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 86:86:3e:32:67:c5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T09:17:33.673 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::8486:3eff:fe32:67c5/64 scope link 2024-09-19T09:17:33.673 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:17:33.673 INFO:teuthology.orchestra.run.smithi162.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:17:33.673 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 5e:4d:7e:1d:19:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-19T09:17:33.673 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::5c4d:7eff:fe1d:19f9/64 scope link 2024-09-19T09:17:33.674 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:17:33.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:17:33.674 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:17:33.740 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-09-19T09:17:33.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:17:33.742 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-09-19T09:17:33.800 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-09-19T09:17:33.801 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:17:33.801 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T09:17:33.801 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T09:17:33.801 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:17:33.801 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:17:33.801 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-19T09:17:33.801 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T09:17:33.801 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T09:17:33.801 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T09:17:33.801 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-19T09:17:33.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:17:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:17:33.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:17:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:17:33.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:17:33.934 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-19T09:17:33.954 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-19T09:17:33.954 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-19T09:17:33.954 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:17:33.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:17:33.955 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2024-09-19T09:17:34.021 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:17:34.021 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-19T09:17:34.077 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:17:34.077 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:17:34.078 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-19T09:17:34.133 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-19T09:17:34.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:17:34.133 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:17:34.217 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:17:34.218 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:17:34.218 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:17:34.226 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:17:34.226 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:17:34.226 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:17:34.226 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:17:34.226 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:17:34.231 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:17:34.232 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:17:34.232 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:17:34.232 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:17:34.232 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:17:34.232 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-19T09:17:34.232 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-19T09:17:34.232 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=fec66d7e-50e5-42ed-81de-ad141a2f0f4e" will pass to kernel 2024-09-19T09:17:34.233 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-19T09:17:34.233 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:17:34.233 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:17:34.233 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:17:34.233 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:17:34.234 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:17:34.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:17:34.234 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-19T09:17:34.306 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:17:34.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:17:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:17:34.397 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:17:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:17:34.403 INFO:teuthology.orchestra.run.smithi162.stdout:client6066 2024-09-19T09:17:34.403 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:17:34.403 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:17:34.420 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:17:34.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.535+0000 7fbec815f640 1 Processor -- start 2024-09-19T09:17:34.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.535+0000 7fbec815f640 1 -- start start 2024-09-19T09:17:34.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.536+0000 7fbec815f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbec015eea0 0x7fbec006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:34.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.536+0000 7fbec815f640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbec00b6db0 con 0x7fbec00ced00 2024-09-19T09:17:34.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.536+0000 7fbec815f640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbec00b7070 con 0x7fbec00b67b0 2024-09-19T09:17:34.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.536+0000 7fbec815f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbec00b1390 con 0x7fbec015eea0 2024-09-19T09:17:34.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.536+0000 7fbec56fa640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fbec00ced00 0x7fbec00b60a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:37468/0 (socket says 172.21.15.18:37468) 2024-09-19T09:17:34.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.536+0000 7fbec56fa640 1 -- 172.21.15.18:0/2893030643 learned_addr learned my addr 172.21.15.18:0/2893030643 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:17:34.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.536+0000 7fbec5efb640 1 --2- 172.21.15.18:0/2893030643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbec015eea0 0x7fbec006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:34.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.536+0000 7fbec4ef9640 1 -- 172.21.15.18:0/2893030643 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1556588851 0 0) 0x7fbec00b6db0 con 0x7fbec00ced00 2024-09-19T09:17:34.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.536+0000 7fbec4ef9640 1 -- 172.21.15.18:0/2893030643 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbeac003520 con 0x7fbec00ced00 2024-09-19T09:17:34.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.536+0000 7fbec4ef9640 1 -- 172.21.15.18:0/2893030643 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2655962646 0 0) 0x7fbec00b7070 con 0x7fbec00b67b0 2024-09-19T09:17:34.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.536+0000 7fbec4ef9640 1 -- 172.21.15.18:0/2893030643 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbec00b6db0 con 0x7fbec00b67b0 2024-09-19T09:17:34.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.536+0000 7fbec4ef9640 1 -- 172.21.15.18:0/2893030643 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3261558440 0 0) 0x7fbeac003520 con 0x7fbec00ced00 2024-09-19T09:17:34.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.536+0000 7fbec5efb640 1 -- 172.21.15.18:0/2893030643 >> v1:172.21.15.162:6789/0 conn(0x7fbec00b67b0 legacy=0x7fbec00b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:34.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.536+0000 7fbec5efb640 1 -- 172.21.15.18:0/2893030643 >> v1:172.21.15.18:6789/0 conn(0x7fbec00ced00 legacy=0x7fbec00b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:34.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.536+0000 7fbec5efb640 1 -- 172.21.15.18:0/2893030643 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec00b1670 con 0x7fbec015eea0 2024-09-19T09:17:34.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.537+0000 7fbec5efb640 1 --2- 172.21.15.18:0/2893030643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbec015eea0 0x7fbec006bc10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0097d0 tx=0x7fbebc02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e973b11baf3b76c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:34.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.537+0000 7fbec4ef9640 1 -- 172.21.15.18:0/2893030643 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc037070 con 0x7fbec015eea0 2024-09-19T09:17:34.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.537+0000 7fbec4ef9640 1 -- 172.21.15.18:0/2893030643 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbebc02ac30 con 0x7fbec015eea0 2024-09-19T09:17:34.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.537+0000 7fbec4ef9640 1 -- 172.21.15.18:0/2893030643 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeb0001670 con 0x7fbec015eea0 2024-09-19T09:17:34.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.538+0000 7fbec815f640 1 -- 172.21.15.18:0/2893030643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbec015eea0 msgr2=0x7fbec006bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.538+0000 7fbec815f640 1 --2- 172.21.15.18:0/2893030643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbec015eea0 0x7fbec006bc10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0097d0 tx=0x7fbebc02a1a0 comp rx=0 tx=0).stop 2024-09-19T09:17:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.538+0000 7fbec815f640 1 -- 172.21.15.18:0/2893030643 shutdown_connections 2024-09-19T09:17:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.538+0000 7fbec815f640 1 --2- 172.21.15.18:0/2893030643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbec015eea0 0x7fbec006bc10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.538+0000 7fbec815f640 1 -- 172.21.15.18:0/2893030643 >> 172.21.15.18:0/2893030643 conn(0x7fbec00731b0 msgr2=0x7fbec00735c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.538+0000 7fbec815f640 1 -- 172.21.15.18:0/2893030643 shutdown_connections 2024-09-19T09:17:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.538+0000 7fbec815f640 1 -- 172.21.15.18:0/2893030643 wait complete. 2024-09-19T09:17:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.539+0000 7fbec815f640 1 Processor -- start 2024-09-19T09:17:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.539+0000 7fbec815f640 1 -- start start 2024-09-19T09:17:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.540+0000 7fbec815f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbec00b67b0 0x7fbec0161af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.540+0000 7fbec815f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbec00ced00 0x7fbec0152a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.540+0000 7fbec815f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbec015eea0 0x7fbec00cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.540+0000 7fbec815f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbec006c150 con 0x7fbec00b67b0 2024-09-19T09:17:34.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.540+0000 7fbec815f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbec00b1040 con 0x7fbec015eea0 2024-09-19T09:17:34.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.540+0000 7fbec815f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbec006c2d0 con 0x7fbec00ced00 2024-09-19T09:17:34.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.540+0000 7fbec5efb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbec00b67b0 0x7fbec0161af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:34.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.540+0000 7fbec5efb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbec00b67b0 0x7fbec0161af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:34340/0 (socket says 172.21.15.18:34340) 2024-09-19T09:17:34.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.540+0000 7fbec5efb640 1 -- 172.21.15.18:0/3844080173 learned_addr learned my addr 172.21.15.18:0/3844080173 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:17:34.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.541+0000 7fbec56fa640 1 --2- 172.21.15.18:0/3844080173 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbec00ced00 0x7fbec0152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:34.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.541+0000 7fbec66fc640 1 --2- 172.21.15.18:0/3844080173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbec015eea0 0x7fbec00cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:34.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.541+0000 7fbec5efb640 1 -- 172.21.15.18:0/3844080173 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbec00ced00 msgr2=0x7fbec0152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:34.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.541+0000 7fbec5efb640 1 --2- 172.21.15.18:0/3844080173 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbec00ced00 0x7fbec0152a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:34.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.541+0000 7fbec5efb640 1 -- 172.21.15.18:0/3844080173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbec015eea0 msgr2=0x7fbec00cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:34.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.541+0000 7fbec5efb640 1 --2- 172.21.15.18:0/3844080173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbec015eea0 0x7fbec00cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:34.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.541+0000 7fbec5efb640 1 -- 172.21.15.18:0/3844080173 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec0152fd0 con 0x7fbec00b67b0 2024-09-19T09:17:34.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.541+0000 7fbec66fc640 1 --2- 172.21.15.18:0/3844080173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbec015eea0 0x7fbec00cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:17:34.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.541+0000 7fbec5efb640 1 --2- 172.21.15.18:0/3844080173 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbec00b67b0 0x7fbec0161af0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0097d0 tx=0x7fbebc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:34.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.541+0000 7fbeb67fc640 1 -- 172.21.15.18:0/3844080173 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc037050 con 0x7fbec00b67b0 2024-09-19T09:17:34.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.541+0000 7fbeb67fc640 1 -- 172.21.15.18:0/3844080173 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbebc043070 con 0x7fbec00b67b0 2024-09-19T09:17:34.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.541+0000 7fbec815f640 1 -- 172.21.15.18:0/3844080173 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec00cb890 con 0x7fbec00b67b0 2024-09-19T09:17:34.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.541+0000 7fbeb67fc640 1 -- 172.21.15.18:0/3844080173 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbebc03ca50 con 0x7fbec00b67b0 2024-09-19T09:17:34.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.541+0000 7fbec815f640 1 -- 172.21.15.18:0/3844080173 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec00cbe50 con 0x7fbec00b67b0 2024-09-19T09:17:34.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.542+0000 7fbec815f640 1 -- 172.21.15.18:0/3844080173 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbec006bc10 con 0x7fbec00b67b0 2024-09-19T09:17:34.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.543+0000 7fbeb67fc640 1 -- 172.21.15.18:0/3844080173 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbebc03cbf0 con 0x7fbec00b67b0 2024-09-19T09:17:34.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.543+0000 7fbeb67fc640 1 --2- 172.21.15.18:0/3844080173 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbea406c2b0 0x7fbea406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:17:34.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.543+0000 7fbeb67fc640 1 -- 172.21.15.18:0/3844080173 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5709+0+0 (secure 0 0 0) 0x7fbebc0abf80 con 0x7fbec00b67b0 2024-09-19T09:17:34.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.543+0000 7fbec56fa640 1 --2- 172.21.15.18:0/3844080173 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbea406c2b0 0x7fbea406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:17:34.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.544+0000 7fbec56fa640 1 --2- 172.21.15.18:0/3844080173 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbea406c2b0 0x7fbea406e770 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbec015bf60 tx=0x7fbeb0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:17:34.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.547+0000 7fbeb67fc640 1 -- 172.21.15.18:0/3844080173 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fbebc046360 con 0x7fbec00b67b0 2024-09-19T09:17:34.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.758+0000 7fbec815f640 1 -- 172.21.15.18:0/3844080173 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbec0074080 con 0x7fbec00b67b0 2024-09-19T09:17:34.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.758+0000 7fbeb67fc640 1 -- 172.21.15.18:0/3844080173 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5228 (secure 0 0 0) 0x7fbebc07a780 con 0x7fbec00b67b0 2024-09-19T09:17:34.759 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:17:34.759 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":35,"btime":"2024-09-19T09:17:25:094931+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1906118343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1906118343},{"type":"v1","addr":"172.21.15.162:6837","nonce":1906118343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1051418414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1051418414},{"type":"v1","addr":"172.21.15.162:6835","nonce":1051418414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5892,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1630984812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630984812},{"type":"v1","addr":"172.21.15.18:6834","nonce":1630984812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:17:22.451890+0000","modified":"2024-09-19T09:17:24.482665+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5895},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5895":{"gid":5895,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/905153716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":905153716},{"type":"v1","addr":"172.21.15.18:6835","nonce":905153716}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5895,"qdb_cluster":[5895]},"id":5}]} 2024-09-19T09:17:34.759 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 35 2024-09-19T09:17:34.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.760+0000 7fbec815f640 1 -- 172.21.15.18:0/3844080173 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbea406c2b0 msgr2=0x7fbea406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:34.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.760+0000 7fbec815f640 1 --2- 172.21.15.18:0/3844080173 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbea406c2b0 0x7fbea406e770 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbec015bf60 tx=0x7fbeb0009040 comp rx=0 tx=0).stop 2024-09-19T09:17:34.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.760+0000 7fbec815f640 1 -- 172.21.15.18:0/3844080173 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbec00b67b0 msgr2=0x7fbec0161af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:17:34.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.760+0000 7fbec815f640 1 --2- 172.21.15.18:0/3844080173 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbec00b67b0 0x7fbec0161af0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fbebc0097d0 tx=0x7fbebc0046c0 comp rx=0 tx=0).stop 2024-09-19T09:17:34.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.760+0000 7fbec815f640 1 -- 172.21.15.18:0/3844080173 shutdown_connections 2024-09-19T09:17:34.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.760+0000 7fbec815f640 1 --2- 172.21.15.18:0/3844080173 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbea406c2b0 0x7fbea406e770 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:34.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.760+0000 7fbec815f640 1 --2- 172.21.15.18:0/3844080173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbec015eea0 0x7fbec00cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:34.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.760+0000 7fbec815f640 1 --2- 172.21.15.18:0/3844080173 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbec00ced00 0x7fbec0152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:34.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.760+0000 7fbec815f640 1 --2- 172.21.15.18:0/3844080173 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbec00b67b0 0x7fbec0161af0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:17:34.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.760+0000 7fbec815f640 1 -- 172.21.15.18:0/3844080173 >> 172.21.15.18:0/3844080173 conn(0x7fbec00731b0 msgr2=0x7fbec00b0150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:17:34.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.760+0000 7fbec815f640 1 -- 172.21.15.18:0/3844080173 shutdown_connections 2024-09-19T09:17:34.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:17:34.760+0000 7fbec815f640 1 -- 172.21.15.18:0/3844080173 wait complete. 2024-09-19T09:17:34.772 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-19T09:17:34.893 INFO:teuthology.orchestra.run.smithi018.stdout:{"cluster_fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","whoami":0,"id":5895,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":11.796171376,"mdsmap_epoch":35,"osdmap_epoch":90,"osdmap_epoch_barrier":90,"uptime":22.799480914} 2024-09-19T09:17:34.893 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", "fs_name": "cephfs", "id": 5895, "mdsmap_epoch": 35, "osdmap_epoch": 90, "osdmap_epoch_barrier": 90, "rank_uptime": 11.796171376, "state": "up:active", "uptime": 22.799480914, "want_state": "up:active", "whoami": 0 } 2024-09-19T09:17:34.893 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-19T09:17:35.007 INFO:teuthology.orchestra.run.smithi018.stdout:{"osd_mon_report_interval":"5"} 2024-09-19T09:17:35.007 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-19T09:17:35.008 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2024-09-19T09:17:35.115 INFO:teuthology.orchestra.run.smithi018.stdout:{"mon_tick_interval":"5"} 2024-09-19T09:17:35.116 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2024-09-19T09:17:35.116 INFO:tasks.cephfs.test_full:pool capacity 557057600, 531MB should be enough to fill it 2024-09-19T09:17:35.116 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-09-19T09:17:35.116 DEBUG:teuthology.orchestra.run.smithi018:> import time 2024-09-19T09:17:35.116 DEBUG:teuthology.orchestra.run.smithi018:> import datetime 2024-09-19T09:17:35.117 DEBUG:teuthology.orchestra.run.smithi018:> import subprocess 2024-09-19T09:17:35.117 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-09-19T09:17:35.117 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:17:35.117 DEBUG:teuthology.orchestra.run.smithi018:> # Write some buffered data through before going full, all should be well 2024-09-19T09:17:35.117 DEBUG:teuthology.orchestra.run.smithi018:> print("writing some data through which we expect to succeed") 2024-09-19T09:17:35.117 DEBUG:teuthology.orchestra.run.smithi018:> bytes = 0 2024-09-19T09:17:35.117 DEBUG:teuthology.orchestra.run.smithi018:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2024-09-19T09:17:35.117 DEBUG:teuthology.orchestra.run.smithi018:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2024-09-19T09:17:35.117 DEBUG:teuthology.orchestra.run.smithi018:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2024-09-19T09:17:35.117 DEBUG:teuthology.orchestra.run.smithi018:> os.fsync(f) 2024-09-19T09:17:35.118 DEBUG:teuthology.orchestra.run.smithi018:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2024-09-19T09:17:35.118 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:17:35.118 DEBUG:teuthology.orchestra.run.smithi018:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2024-09-19T09:17:35.118 DEBUG:teuthology.orchestra.run.smithi018:> # writing until we see an error from fsync. As long as we'"'"'re doing 2024-09-19T09:17:35.118 DEBUG:teuthology.orchestra.run.smithi018:> # buffered IO, the error should always only appear from fsync and not 2024-09-19T09:17:35.118 DEBUG:teuthology.orchestra.run.smithi018:> # from write 2024-09-19T09:17:35.118 DEBUG:teuthology.orchestra.run.smithi018:> full = False 2024-09-19T09:17:35.118 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:17:35.118 DEBUG:teuthology.orchestra.run.smithi018:> for n in range(0, int(531 * 1.1)): 2024-09-19T09:17:35.118 DEBUG:teuthology.orchestra.run.smithi018:> try: 2024-09-19T09:17:35.118 DEBUG:teuthology.orchestra.run.smithi018:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-19T09:17:35.118 DEBUG:teuthology.orchestra.run.smithi018:> print("wrote bytes via buffered write, moving on to fsync") 2024-09-19T09:17:35.118 DEBUG:teuthology.orchestra.run.smithi018:> except OSError as e: 2024-09-19T09:17:35.119 DEBUG:teuthology.orchestra.run.smithi018:> if False: 2024-09-19T09:17:35.119 DEBUG:teuthology.orchestra.run.smithi018:> print("Unexpected error %s from write() instead of fsync()" % e) 2024-09-19T09:17:35.119 DEBUG:teuthology.orchestra.run.smithi018:> raise 2024-09-19T09:17:35.119 DEBUG:teuthology.orchestra.run.smithi018:> else: 2024-09-19T09:17:35.119 DEBUG:teuthology.orchestra.run.smithi018:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-19T09:17:35.119 DEBUG:teuthology.orchestra.run.smithi018:> full = True 2024-09-19T09:17:35.119 DEBUG:teuthology.orchestra.run.smithi018:> break 2024-09-19T09:17:35.119 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:17:35.119 DEBUG:teuthology.orchestra.run.smithi018:> try: 2024-09-19T09:17:35.119 DEBUG:teuthology.orchestra.run.smithi018:> os.fsync(f) 2024-09-19T09:17:35.120 DEBUG:teuthology.orchestra.run.smithi018:> print("fsync'"'"'ed successfully") 2024-09-19T09:17:35.120 DEBUG:teuthology.orchestra.run.smithi018:> except OSError as e: 2024-09-19T09:17:35.120 DEBUG:teuthology.orchestra.run.smithi018:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-19T09:17:35.120 DEBUG:teuthology.orchestra.run.smithi018:> full = True 2024-09-19T09:17:35.120 DEBUG:teuthology.orchestra.run.smithi018:> break 2024-09-19T09:17:35.120 DEBUG:teuthology.orchestra.run.smithi018:> else: 2024-09-19T09:17:35.120 DEBUG:teuthology.orchestra.run.smithi018:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-19T09:17:35.120 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:17:35.120 DEBUG:teuthology.orchestra.run.smithi018:> if n > 531 * 0.9: 2024-09-19T09:17:35.121 DEBUG:teuthology.orchestra.run.smithi018:> # Be cautious in the last region where we expect to hit 2024-09-19T09:17:35.121 DEBUG:teuthology.orchestra.run.smithi018:> # the full condition, so that we don'"'"'t overshoot too dramatically 2024-09-19T09:17:35.121 DEBUG:teuthology.orchestra.run.smithi018:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2024-09-19T09:17:35.121 DEBUG:teuthology.orchestra.run.smithi018:> time.sleep(15.0) 2024-09-19T09:17:35.121 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:17:35.121 DEBUG:teuthology.orchestra.run.smithi018:> if not full: 2024-09-19T09:17:35.121 DEBUG:teuthology.orchestra.run.smithi018:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2024-09-19T09:17:35.121 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:17:35.121 DEBUG:teuthology.orchestra.run.smithi018:> # close() should not raise an error because we already caught it in 2024-09-19T09:17:35.122 DEBUG:teuthology.orchestra.run.smithi018:> # fsync. There shouldn'"'"'t have been any more writeback errors 2024-09-19T09:17:35.122 DEBUG:teuthology.orchestra.run.smithi018:> # since then because all IOs got cancelled on the full flag. 2024-09-19T09:17:35.122 DEBUG:teuthology.orchestra.run.smithi018:> print("calling close") 2024-09-19T09:17:35.122 DEBUG:teuthology.orchestra.run.smithi018:> os.close(f) 2024-09-19T09:17:35.122 DEBUG:teuthology.orchestra.run.smithi018:> print("close() did not raise error") 2024-09-19T09:17:35.122 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:17:35.122 DEBUG:teuthology.orchestra.run.smithi018:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2024-09-19T09:17:35.122 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-09-19T09:17:37.320 INFO:teuthology.orchestra.run.smithi018.stdout:writing some data through which we expect to succeed 2024-09-19T09:17:37.320 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed data successfully, will now attempt to fill fs 2024-09-19T09:17:37.321 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.321 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.321 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 1.00 MB 2024-09-19T09:17:37.321 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.321 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.321 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 2.00 MB 2024-09-19T09:17:37.321 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.321 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.321 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 3.00 MB 2024-09-19T09:17:37.321 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.321 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.321 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 4.00 MB 2024-09-19T09:17:37.321 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.322 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.322 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 5.00 MB 2024-09-19T09:17:37.322 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.322 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.322 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 6.00 MB 2024-09-19T09:17:37.322 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.322 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.322 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 7.00 MB 2024-09-19T09:17:37.322 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.322 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.322 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 8.00 MB 2024-09-19T09:17:37.323 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.323 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.323 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 9.00 MB 2024-09-19T09:17:37.323 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.323 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.323 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 10.00 MB 2024-09-19T09:17:37.323 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.323 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.323 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 11.00 MB 2024-09-19T09:17:37.323 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.323 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.323 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 12.00 MB 2024-09-19T09:17:37.323 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.323 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.324 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 13.00 MB 2024-09-19T09:17:37.324 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.324 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.324 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 14.00 MB 2024-09-19T09:17:37.324 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.324 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.324 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 15.00 MB 2024-09-19T09:17:37.324 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.324 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.324 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 16.00 MB 2024-09-19T09:17:37.324 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.324 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.324 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 17.00 MB 2024-09-19T09:17:37.325 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.325 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.325 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 18.00 MB 2024-09-19T09:17:37.325 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.325 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.325 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 19.00 MB 2024-09-19T09:17:37.325 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.325 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.325 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 20.00 MB 2024-09-19T09:17:37.325 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.325 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.325 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 21.00 MB 2024-09-19T09:17:37.325 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.325 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.326 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 22.00 MB 2024-09-19T09:17:37.326 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.326 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.326 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 23.00 MB 2024-09-19T09:17:37.326 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.326 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.326 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 24.00 MB 2024-09-19T09:17:37.326 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.326 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.326 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 25.00 MB 2024-09-19T09:17:37.326 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.326 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.326 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 26.00 MB 2024-09-19T09:17:37.326 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.326 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.327 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 27.00 MB 2024-09-19T09:17:37.327 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.327 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.327 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 28.00 MB 2024-09-19T09:17:37.327 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.327 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.327 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 29.00 MB 2024-09-19T09:17:37.327 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.327 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.327 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 30.00 MB 2024-09-19T09:17:37.327 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.327 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.327 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 31.00 MB 2024-09-19T09:17:37.328 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.328 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.328 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 32.00 MB 2024-09-19T09:17:37.328 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.328 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.328 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 33.00 MB 2024-09-19T09:17:37.328 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.328 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.328 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 34.00 MB 2024-09-19T09:17:37.328 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.328 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.328 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 35.00 MB 2024-09-19T09:17:37.328 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.328 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.329 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 36.00 MB 2024-09-19T09:17:37.329 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.329 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.329 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 37.00 MB 2024-09-19T09:17:37.329 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.329 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.329 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 38.00 MB 2024-09-19T09:17:37.329 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.329 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.329 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 39.00 MB 2024-09-19T09:17:37.329 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.329 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.329 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 40.00 MB 2024-09-19T09:17:37.330 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.330 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.330 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 41.00 MB 2024-09-19T09:17:37.330 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.330 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.330 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 42.00 MB 2024-09-19T09:17:37.330 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.330 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.330 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 43.00 MB 2024-09-19T09:17:37.330 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.330 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.330 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 44.00 MB 2024-09-19T09:17:37.330 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.330 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.330 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 45.00 MB 2024-09-19T09:17:37.331 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.331 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.331 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 46.00 MB 2024-09-19T09:17:37.331 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.331 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.331 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 47.00 MB 2024-09-19T09:17:37.331 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.331 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.331 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 48.00 MB 2024-09-19T09:17:37.331 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.331 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.331 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 49.00 MB 2024-09-19T09:17:37.331 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.331 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.332 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 50.00 MB 2024-09-19T09:17:37.332 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.332 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.332 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 51.00 MB 2024-09-19T09:17:37.332 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.332 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.332 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 52.00 MB 2024-09-19T09:17:37.332 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.332 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.332 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 53.00 MB 2024-09-19T09:17:37.333 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.333 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.333 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 54.00 MB 2024-09-19T09:17:37.333 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.333 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.333 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 55.00 MB 2024-09-19T09:17:37.333 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.333 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.333 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 56.00 MB 2024-09-19T09:17:37.334 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.334 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.334 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 57.00 MB 2024-09-19T09:17:37.334 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.334 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.334 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 58.00 MB 2024-09-19T09:17:37.334 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.334 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.334 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 59.00 MB 2024-09-19T09:17:37.334 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.334 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.334 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 60.00 MB 2024-09-19T09:17:37.334 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.334 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.335 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 61.00 MB 2024-09-19T09:17:37.335 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.335 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.335 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 62.00 MB 2024-09-19T09:17:37.335 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.335 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.335 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 63.00 MB 2024-09-19T09:17:37.335 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.335 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.335 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 64.00 MB 2024-09-19T09:17:37.335 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.335 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.335 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 65.00 MB 2024-09-19T09:17:37.335 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.336 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.336 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 66.00 MB 2024-09-19T09:17:37.336 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.336 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.336 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 67.00 MB 2024-09-19T09:17:37.336 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.336 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.336 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 68.00 MB 2024-09-19T09:17:37.336 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.336 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.336 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 69.00 MB 2024-09-19T09:17:37.336 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.336 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.336 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 70.00 MB 2024-09-19T09:17:37.337 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.337 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.337 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 71.00 MB 2024-09-19T09:17:37.337 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.337 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.337 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 72.00 MB 2024-09-19T09:17:37.337 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.337 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.337 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 73.00 MB 2024-09-19T09:17:37.337 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.337 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.337 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 74.00 MB 2024-09-19T09:17:37.337 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.337 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.338 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 75.00 MB 2024-09-19T09:17:37.338 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.338 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.338 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 76.00 MB 2024-09-19T09:17:37.338 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.338 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.338 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 77.00 MB 2024-09-19T09:17:37.338 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.338 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.338 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 78.00 MB 2024-09-19T09:17:37.338 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.338 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.338 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 79.00 MB 2024-09-19T09:17:37.338 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.339 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.339 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 80.00 MB 2024-09-19T09:17:37.520 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.521 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.521 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 81.00 MB 2024-09-19T09:17:37.521 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.521 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.521 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 82.00 MB 2024-09-19T09:17:37.521 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.521 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.521 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 83.00 MB 2024-09-19T09:17:37.521 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.521 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.521 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 84.00 MB 2024-09-19T09:17:37.521 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.521 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.522 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 85.00 MB 2024-09-19T09:17:37.522 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.522 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.522 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 86.00 MB 2024-09-19T09:17:37.522 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.522 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.522 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 87.00 MB 2024-09-19T09:17:37.522 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.522 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.522 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 88.00 MB 2024-09-19T09:17:37.522 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.523 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.523 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 89.00 MB 2024-09-19T09:17:37.523 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.523 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.523 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 90.00 MB 2024-09-19T09:17:37.523 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.523 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.523 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 91.00 MB 2024-09-19T09:17:37.523 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.523 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.523 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 92.00 MB 2024-09-19T09:17:37.523 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.523 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.523 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 93.00 MB 2024-09-19T09:17:37.524 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.524 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.524 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 94.00 MB 2024-09-19T09:17:37.524 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.524 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.524 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 95.00 MB 2024-09-19T09:17:37.524 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.524 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.524 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 96.00 MB 2024-09-19T09:17:37.524 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.524 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.524 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 97.00 MB 2024-09-19T09:17:37.524 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.525 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.525 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 98.00 MB 2024-09-19T09:17:37.525 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.525 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.525 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 99.00 MB 2024-09-19T09:17:37.525 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.525 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.525 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 100.00 MB 2024-09-19T09:17:37.525 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.526 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.526 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 101.00 MB 2024-09-19T09:17:37.526 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.526 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.526 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 102.00 MB 2024-09-19T09:17:37.526 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.526 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.526 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 103.00 MB 2024-09-19T09:17:37.526 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.526 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.526 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 104.00 MB 2024-09-19T09:17:37.526 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.526 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.527 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 105.00 MB 2024-09-19T09:17:37.527 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.527 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.527 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 106.00 MB 2024-09-19T09:17:37.527 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.527 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.527 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 107.00 MB 2024-09-19T09:17:37.527 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.527 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.527 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 108.00 MB 2024-09-19T09:17:37.528 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.528 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.528 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 109.00 MB 2024-09-19T09:17:37.528 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.528 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.528 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 110.00 MB 2024-09-19T09:17:37.528 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.528 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.528 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 111.00 MB 2024-09-19T09:17:37.528 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.528 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.528 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 112.00 MB 2024-09-19T09:17:37.528 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.528 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.529 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 113.00 MB 2024-09-19T09:17:37.529 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.529 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.529 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 114.00 MB 2024-09-19T09:17:37.529 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.529 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.529 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 115.00 MB 2024-09-19T09:17:37.529 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.529 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.529 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 116.00 MB 2024-09-19T09:17:37.529 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.529 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.529 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 117.00 MB 2024-09-19T09:17:37.529 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.530 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.530 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 118.00 MB 2024-09-19T09:17:37.530 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.530 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.530 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 119.00 MB 2024-09-19T09:17:37.530 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.530 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.530 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 120.00 MB 2024-09-19T09:17:37.530 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.530 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.530 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 121.00 MB 2024-09-19T09:17:37.530 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.530 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.530 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 122.00 MB 2024-09-19T09:17:37.531 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.531 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.531 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 123.00 MB 2024-09-19T09:17:37.531 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.531 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.531 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 124.00 MB 2024-09-19T09:17:37.531 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.531 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.531 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 125.00 MB 2024-09-19T09:17:37.531 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.531 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.531 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 126.00 MB 2024-09-19T09:17:37.531 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.531 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.532 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 127.00 MB 2024-09-19T09:17:37.532 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.532 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.532 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 128.00 MB 2024-09-19T09:17:37.532 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.532 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.532 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 129.00 MB 2024-09-19T09:17:37.532 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.532 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.532 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 130.00 MB 2024-09-19T09:17:37.532 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.532 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.532 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 131.00 MB 2024-09-19T09:17:37.532 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.533 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.533 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 132.00 MB 2024-09-19T09:17:37.533 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.533 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.533 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 133.00 MB 2024-09-19T09:17:37.533 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.533 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.533 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 134.00 MB 2024-09-19T09:17:37.533 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.533 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.533 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 135.00 MB 2024-09-19T09:17:37.533 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.533 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.533 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 136.00 MB 2024-09-19T09:17:37.534 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.534 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.534 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 137.00 MB 2024-09-19T09:17:37.534 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.534 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.534 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 138.00 MB 2024-09-19T09:17:37.534 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.534 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.534 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 139.00 MB 2024-09-19T09:17:37.534 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.534 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.534 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 140.00 MB 2024-09-19T09:17:37.534 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.535 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.535 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 141.00 MB 2024-09-19T09:17:37.535 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.535 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.535 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 142.00 MB 2024-09-19T09:17:37.535 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.535 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.535 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 143.00 MB 2024-09-19T09:17:37.535 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.535 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.535 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 144.00 MB 2024-09-19T09:17:37.535 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.535 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.535 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 145.00 MB 2024-09-19T09:17:37.536 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.536 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.536 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 146.00 MB 2024-09-19T09:17:37.536 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.536 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.536 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 147.00 MB 2024-09-19T09:17:37.536 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.536 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.536 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 148.00 MB 2024-09-19T09:17:37.536 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.536 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.536 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 149.00 MB 2024-09-19T09:17:37.536 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.537 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.537 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 150.00 MB 2024-09-19T09:17:37.537 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.537 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.537 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 151.00 MB 2024-09-19T09:17:37.537 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.537 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.537 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 152.00 MB 2024-09-19T09:17:37.537 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.537 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.537 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 153.00 MB 2024-09-19T09:17:37.537 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.537 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.537 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 154.00 MB 2024-09-19T09:17:37.538 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.538 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.538 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 155.00 MB 2024-09-19T09:17:37.538 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.538 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.538 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 156.00 MB 2024-09-19T09:17:37.538 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.538 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.538 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 157.00 MB 2024-09-19T09:17:37.538 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.538 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.538 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 158.00 MB 2024-09-19T09:17:37.538 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.538 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.538 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 159.00 MB 2024-09-19T09:17:37.539 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.539 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.539 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 160.00 MB 2024-09-19T09:17:37.539 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.719 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.719 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 161.00 MB 2024-09-19T09:17:37.719 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.719 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.719 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 162.00 MB 2024-09-19T09:17:37.720 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.720 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.720 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 163.00 MB 2024-09-19T09:17:37.720 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.720 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.720 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 164.00 MB 2024-09-19T09:17:37.720 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.720 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.720 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 165.00 MB 2024-09-19T09:17:37.720 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.720 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.720 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 166.00 MB 2024-09-19T09:17:37.720 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.720 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.721 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 167.00 MB 2024-09-19T09:17:37.721 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.721 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.721 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 168.00 MB 2024-09-19T09:17:37.721 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.721 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.721 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 169.00 MB 2024-09-19T09:17:37.721 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.721 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.721 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 170.00 MB 2024-09-19T09:17:37.721 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.721 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.721 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 171.00 MB 2024-09-19T09:17:37.722 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.722 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.722 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 172.00 MB 2024-09-19T09:17:37.722 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.722 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.722 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 173.00 MB 2024-09-19T09:17:37.722 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.722 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.722 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 174.00 MB 2024-09-19T09:17:37.722 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.722 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.722 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 175.00 MB 2024-09-19T09:17:37.722 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.722 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.723 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 176.00 MB 2024-09-19T09:17:37.723 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.723 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.723 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 177.00 MB 2024-09-19T09:17:37.723 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.723 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.723 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 178.00 MB 2024-09-19T09:17:37.723 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.723 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.723 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 179.00 MB 2024-09-19T09:17:37.723 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.723 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.723 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 180.00 MB 2024-09-19T09:17:37.724 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.724 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.724 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 181.00 MB 2024-09-19T09:17:37.724 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.724 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.724 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 182.00 MB 2024-09-19T09:17:37.724 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.724 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.724 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 183.00 MB 2024-09-19T09:17:37.724 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.724 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.724 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 184.00 MB 2024-09-19T09:17:37.724 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.724 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.725 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 185.00 MB 2024-09-19T09:17:37.725 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.725 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.725 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 186.00 MB 2024-09-19T09:17:37.725 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.725 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.725 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 187.00 MB 2024-09-19T09:17:37.725 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.725 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.725 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 188.00 MB 2024-09-19T09:17:37.725 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.725 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.725 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 189.00 MB 2024-09-19T09:17:37.725 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.726 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.726 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 190.00 MB 2024-09-19T09:17:37.726 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.726 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.726 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 191.00 MB 2024-09-19T09:17:37.726 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.726 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.726 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 192.00 MB 2024-09-19T09:17:37.726 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.726 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.726 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 193.00 MB 2024-09-19T09:17:37.726 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.726 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.726 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 194.00 MB 2024-09-19T09:17:37.727 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.727 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.727 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 195.00 MB 2024-09-19T09:17:37.727 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.727 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.727 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 196.00 MB 2024-09-19T09:17:37.727 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.727 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.727 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 197.00 MB 2024-09-19T09:17:37.727 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.727 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.727 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 198.00 MB 2024-09-19T09:17:37.727 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.727 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.728 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 199.00 MB 2024-09-19T09:17:37.728 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.728 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.728 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 200.00 MB 2024-09-19T09:17:37.728 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.728 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.728 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 201.00 MB 2024-09-19T09:17:37.728 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.728 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.728 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 202.00 MB 2024-09-19T09:17:37.728 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.728 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.728 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 203.00 MB 2024-09-19T09:17:37.729 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.729 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.729 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 204.00 MB 2024-09-19T09:17:37.729 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.729 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.729 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 205.00 MB 2024-09-19T09:17:37.729 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.729 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.729 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 206.00 MB 2024-09-19T09:17:37.729 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.729 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.729 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 207.00 MB 2024-09-19T09:17:37.729 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.730 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.730 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 208.00 MB 2024-09-19T09:17:37.730 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.730 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.730 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 209.00 MB 2024-09-19T09:17:37.730 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.730 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.730 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 210.00 MB 2024-09-19T09:17:37.730 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.730 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.730 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 211.00 MB 2024-09-19T09:17:37.730 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.730 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.730 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 212.00 MB 2024-09-19T09:17:37.731 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.731 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.731 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 213.00 MB 2024-09-19T09:17:37.731 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.731 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.731 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 214.00 MB 2024-09-19T09:17:37.731 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.731 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.731 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 215.00 MB 2024-09-19T09:17:37.731 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.731 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.731 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 216.00 MB 2024-09-19T09:17:37.731 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.731 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.731 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 217.00 MB 2024-09-19T09:17:37.732 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.732 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.732 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 218.00 MB 2024-09-19T09:17:37.732 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.732 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.732 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 219.00 MB 2024-09-19T09:17:37.732 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.732 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.732 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 220.00 MB 2024-09-19T09:17:37.732 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.732 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.732 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 221.00 MB 2024-09-19T09:17:37.732 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.732 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.733 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 222.00 MB 2024-09-19T09:17:37.733 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.733 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.733 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 223.00 MB 2024-09-19T09:17:37.733 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.733 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.733 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 224.00 MB 2024-09-19T09:17:37.733 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.733 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.733 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 225.00 MB 2024-09-19T09:17:37.733 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.733 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.733 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 226.00 MB 2024-09-19T09:17:37.734 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.734 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.734 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 227.00 MB 2024-09-19T09:17:37.734 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.734 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.734 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 228.00 MB 2024-09-19T09:17:37.734 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.734 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.734 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 229.00 MB 2024-09-19T09:17:37.734 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.734 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.734 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 230.00 MB 2024-09-19T09:17:37.734 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.734 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.734 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 231.00 MB 2024-09-19T09:17:37.735 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.735 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.735 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 232.00 MB 2024-09-19T09:17:37.735 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.735 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.735 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 233.00 MB 2024-09-19T09:17:37.735 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.735 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.735 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 234.00 MB 2024-09-19T09:17:37.735 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.735 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.735 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 235.00 MB 2024-09-19T09:17:37.735 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.735 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.736 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 236.00 MB 2024-09-19T09:17:37.736 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.736 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.736 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 237.00 MB 2024-09-19T09:17:37.736 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.736 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.736 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 238.00 MB 2024-09-19T09:17:37.736 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.736 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.736 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 239.00 MB 2024-09-19T09:17:37.736 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.736 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.736 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 240.00 MB 2024-09-19T09:17:37.736 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.736 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.913 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 241.00 MB 2024-09-19T09:17:37.914 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.914 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.914 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 242.00 MB 2024-09-19T09:17:37.914 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.914 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.914 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 243.00 MB 2024-09-19T09:17:37.914 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.914 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.914 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 244.00 MB 2024-09-19T09:17:37.914 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.914 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.914 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 245.00 MB 2024-09-19T09:17:37.914 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.915 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.915 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 246.00 MB 2024-09-19T09:17:37.915 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.915 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.915 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 247.00 MB 2024-09-19T09:17:37.915 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.915 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.915 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 248.00 MB 2024-09-19T09:17:37.915 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.915 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.915 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 249.00 MB 2024-09-19T09:17:37.915 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.915 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.915 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 250.00 MB 2024-09-19T09:17:37.915 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.916 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.916 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 251.00 MB 2024-09-19T09:17:37.916 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.916 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.916 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 252.00 MB 2024-09-19T09:17:37.916 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.916 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.916 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 253.00 MB 2024-09-19T09:17:37.916 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.916 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.916 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 254.00 MB 2024-09-19T09:17:37.916 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.916 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.917 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 255.00 MB 2024-09-19T09:17:37.917 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.917 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.917 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 256.00 MB 2024-09-19T09:17:37.917 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.917 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.917 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 257.00 MB 2024-09-19T09:17:37.917 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.917 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.917 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 258.00 MB 2024-09-19T09:17:37.917 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.917 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.917 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 259.00 MB 2024-09-19T09:17:37.917 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.917 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.918 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 260.00 MB 2024-09-19T09:17:37.918 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.918 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.918 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 261.00 MB 2024-09-19T09:17:37.918 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.918 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.918 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 262.00 MB 2024-09-19T09:17:37.918 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.918 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.918 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 263.00 MB 2024-09-19T09:17:37.918 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.918 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.918 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 264.00 MB 2024-09-19T09:17:37.918 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.919 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.919 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 265.00 MB 2024-09-19T09:17:37.919 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.919 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.919 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 266.00 MB 2024-09-19T09:17:37.919 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.919 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.919 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 267.00 MB 2024-09-19T09:17:37.919 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.919 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.919 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 268.00 MB 2024-09-19T09:17:37.919 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.919 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.919 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 269.00 MB 2024-09-19T09:17:37.919 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.920 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.920 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 270.00 MB 2024-09-19T09:17:37.920 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.920 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.920 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 271.00 MB 2024-09-19T09:17:37.920 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.920 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.920 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 272.00 MB 2024-09-19T09:17:37.920 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.920 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.920 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 273.00 MB 2024-09-19T09:17:37.920 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.920 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.920 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 274.00 MB 2024-09-19T09:17:37.921 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.921 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.921 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 275.00 MB 2024-09-19T09:17:37.921 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.921 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.921 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 276.00 MB 2024-09-19T09:17:37.921 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.921 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.921 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 277.00 MB 2024-09-19T09:17:37.921 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.921 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.921 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 278.00 MB 2024-09-19T09:17:37.921 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.921 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.922 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 279.00 MB 2024-09-19T09:17:37.922 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.922 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.922 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 280.00 MB 2024-09-19T09:17:37.922 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.922 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.922 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 281.00 MB 2024-09-19T09:17:37.922 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.922 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.922 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 282.00 MB 2024-09-19T09:17:37.922 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.922 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.922 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 283.00 MB 2024-09-19T09:17:37.922 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.922 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.923 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 284.00 MB 2024-09-19T09:17:37.923 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.923 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.923 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 285.00 MB 2024-09-19T09:17:37.923 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.923 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.923 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 286.00 MB 2024-09-19T09:17:37.923 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.923 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.923 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 287.00 MB 2024-09-19T09:17:37.923 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.923 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.923 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 288.00 MB 2024-09-19T09:17:37.924 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.924 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.924 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 289.00 MB 2024-09-19T09:17:37.924 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.924 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.924 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 290.00 MB 2024-09-19T09:17:37.924 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.924 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.924 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 291.00 MB 2024-09-19T09:17:37.924 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.924 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.924 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 292.00 MB 2024-09-19T09:17:37.924 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.924 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.925 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 293.00 MB 2024-09-19T09:17:37.925 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.925 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.925 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 294.00 MB 2024-09-19T09:17:37.925 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.925 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.925 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 295.00 MB 2024-09-19T09:17:37.925 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.925 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.925 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 296.00 MB 2024-09-19T09:17:37.925 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.925 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.925 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 297.00 MB 2024-09-19T09:17:37.925 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.925 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.926 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 298.00 MB 2024-09-19T09:17:37.926 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.926 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.926 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 299.00 MB 2024-09-19T09:17:37.926 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.926 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.926 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 300.00 MB 2024-09-19T09:17:37.926 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.926 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.926 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 301.00 MB 2024-09-19T09:17:37.926 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.926 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.926 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 302.00 MB 2024-09-19T09:17:37.926 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.927 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.927 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 303.00 MB 2024-09-19T09:17:37.927 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.927 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.927 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 304.00 MB 2024-09-19T09:17:37.927 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.927 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.927 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 305.00 MB 2024-09-19T09:17:37.927 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.927 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.927 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 306.00 MB 2024-09-19T09:17:37.927 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.927 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.927 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 307.00 MB 2024-09-19T09:17:37.927 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.928 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.928 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 308.00 MB 2024-09-19T09:17:37.928 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.928 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.928 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 309.00 MB 2024-09-19T09:17:37.928 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.928 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.928 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 310.00 MB 2024-09-19T09:17:37.928 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.928 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.928 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 311.00 MB 2024-09-19T09:17:37.928 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.928 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.928 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 312.00 MB 2024-09-19T09:17:37.929 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.929 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.929 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 313.00 MB 2024-09-19T09:17:37.929 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.929 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.929 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 314.00 MB 2024-09-19T09:17:37.929 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.929 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.929 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 315.00 MB 2024-09-19T09:17:37.929 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.929 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.929 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 316.00 MB 2024-09-19T09:17:37.929 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.929 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.929 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 317.00 MB 2024-09-19T09:17:37.930 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.930 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.930 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 318.00 MB 2024-09-19T09:17:37.930 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.930 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.930 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 319.00 MB 2024-09-19T09:17:37.930 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.930 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.930 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 320.00 MB 2024-09-19T09:17:37.930 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:37.930 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:37.930 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 321.00 MB 2024-09-19T09:17:38.102 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.103 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.103 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 322.00 MB 2024-09-19T09:17:38.103 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.103 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.103 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 323.00 MB 2024-09-19T09:17:38.103 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.103 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.103 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 324.00 MB 2024-09-19T09:17:38.103 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.103 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.103 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 325.00 MB 2024-09-19T09:17:38.103 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.104 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.104 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 326.00 MB 2024-09-19T09:17:38.104 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.104 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.104 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 327.00 MB 2024-09-19T09:17:38.104 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.104 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.104 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 328.00 MB 2024-09-19T09:17:38.104 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.104 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.104 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 329.00 MB 2024-09-19T09:17:38.104 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.105 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.105 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 330.00 MB 2024-09-19T09:17:38.105 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.105 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.105 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 331.00 MB 2024-09-19T09:17:38.105 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.105 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.105 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 332.00 MB 2024-09-19T09:17:38.105 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.106 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.106 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 333.00 MB 2024-09-19T09:17:38.106 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.106 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.106 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 334.00 MB 2024-09-19T09:17:38.106 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.106 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.106 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 335.00 MB 2024-09-19T09:17:38.106 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.106 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.106 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 336.00 MB 2024-09-19T09:17:38.106 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.107 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.107 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 337.00 MB 2024-09-19T09:17:38.107 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.107 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.107 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 338.00 MB 2024-09-19T09:17:38.107 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.107 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.107 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 339.00 MB 2024-09-19T09:17:38.107 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.107 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.108 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 340.00 MB 2024-09-19T09:17:38.108 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.108 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.108 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 341.00 MB 2024-09-19T09:17:38.108 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.108 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.108 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 342.00 MB 2024-09-19T09:17:38.108 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.109 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.109 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 343.00 MB 2024-09-19T09:17:38.109 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.109 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.109 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 344.00 MB 2024-09-19T09:17:38.109 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.109 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.109 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 345.00 MB 2024-09-19T09:17:38.109 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.109 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.110 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 346.00 MB 2024-09-19T09:17:38.110 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.110 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.110 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 347.00 MB 2024-09-19T09:17:38.110 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.110 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.111 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 348.00 MB 2024-09-19T09:17:38.111 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.111 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.111 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 349.00 MB 2024-09-19T09:17:38.111 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.111 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.111 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 350.00 MB 2024-09-19T09:17:38.111 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.111 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.111 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 351.00 MB 2024-09-19T09:17:38.111 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.112 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.112 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 352.00 MB 2024-09-19T09:17:38.112 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.112 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.112 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 353.00 MB 2024-09-19T09:17:38.112 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.112 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.112 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 354.00 MB 2024-09-19T09:17:38.112 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.112 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.113 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 355.00 MB 2024-09-19T09:17:38.113 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.113 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.113 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 356.00 MB 2024-09-19T09:17:38.113 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.113 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.113 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 357.00 MB 2024-09-19T09:17:38.113 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.113 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.113 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 358.00 MB 2024-09-19T09:17:38.113 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.113 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.113 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 359.00 MB 2024-09-19T09:17:38.113 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.114 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.114 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 360.00 MB 2024-09-19T09:17:38.114 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.114 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.114 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 361.00 MB 2024-09-19T09:17:38.114 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.114 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.114 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 362.00 MB 2024-09-19T09:17:38.114 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.114 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.114 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 363.00 MB 2024-09-19T09:17:38.114 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.114 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.114 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 364.00 MB 2024-09-19T09:17:38.114 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.115 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.115 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 365.00 MB 2024-09-19T09:17:38.115 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.115 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.115 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 366.00 MB 2024-09-19T09:17:38.115 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.115 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.115 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 367.00 MB 2024-09-19T09:17:38.115 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.115 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.115 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 368.00 MB 2024-09-19T09:17:38.115 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.115 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.115 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 369.00 MB 2024-09-19T09:17:38.116 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.116 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.116 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 370.00 MB 2024-09-19T09:17:38.116 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.116 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.116 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 371.00 MB 2024-09-19T09:17:38.116 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.116 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.116 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 372.00 MB 2024-09-19T09:17:38.116 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.116 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.116 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 373.00 MB 2024-09-19T09:17:38.117 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.117 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.117 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 374.00 MB 2024-09-19T09:17:38.117 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.117 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.117 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 375.00 MB 2024-09-19T09:17:38.117 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.117 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.117 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 376.00 MB 2024-09-19T09:17:38.118 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.118 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.118 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 377.00 MB 2024-09-19T09:17:38.118 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.118 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.118 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 378.00 MB 2024-09-19T09:17:38.118 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.118 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.118 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 379.00 MB 2024-09-19T09:17:38.118 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.118 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.118 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 380.00 MB 2024-09-19T09:17:38.119 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.119 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.119 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 381.00 MB 2024-09-19T09:17:38.119 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.119 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.119 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 382.00 MB 2024-09-19T09:17:38.119 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.119 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.119 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 383.00 MB 2024-09-19T09:17:38.119 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.119 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.119 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 384.00 MB 2024-09-19T09:17:38.119 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.120 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.120 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 385.00 MB 2024-09-19T09:17:38.120 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.120 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.120 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 386.00 MB 2024-09-19T09:17:38.120 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.120 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.120 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 387.00 MB 2024-09-19T09:17:38.120 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.120 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.120 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 388.00 MB 2024-09-19T09:17:38.120 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.120 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.120 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 389.00 MB 2024-09-19T09:17:38.121 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.121 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.121 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 390.00 MB 2024-09-19T09:17:38.121 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.121 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.121 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 391.00 MB 2024-09-19T09:17:38.121 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.121 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.121 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 392.00 MB 2024-09-19T09:17:38.121 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.121 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.121 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 393.00 MB 2024-09-19T09:17:38.121 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.121 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.122 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 394.00 MB 2024-09-19T09:17:38.122 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.122 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.122 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 395.00 MB 2024-09-19T09:17:38.122 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.122 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.122 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 396.00 MB 2024-09-19T09:17:38.122 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.122 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.122 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 397.00 MB 2024-09-19T09:17:38.122 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.122 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.122 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 398.00 MB 2024-09-19T09:17:38.122 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.123 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.123 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 399.00 MB 2024-09-19T09:17:38.123 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.123 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.123 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 400.00 MB 2024-09-19T09:17:38.123 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:17:38.123 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:17:38.123 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 401.00 MB 2024-09-19T09:17:42.257 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-19T09:17:42.256+0000 7fca8cfa1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2024-09-19T09:17:51.175 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-19T09:17:51.175+0000 7fca8cfa1640 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2024-09-19T09:18:00.820 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:18:00.823 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:18:08.335 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.336 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.336 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 402.00 MB 2024-09-19T09:18:08.336 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.336 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.336 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 403.00 MB 2024-09-19T09:18:08.336 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.336 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.336 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 404.00 MB 2024-09-19T09:18:08.336 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.336 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.336 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 405.00 MB 2024-09-19T09:18:08.337 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.337 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.337 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 406.00 MB 2024-09-19T09:18:08.337 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.337 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.337 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 407.00 MB 2024-09-19T09:18:08.337 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.337 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.337 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 408.00 MB 2024-09-19T09:18:08.337 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.337 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.337 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 409.00 MB 2024-09-19T09:18:08.337 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.337 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.338 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 410.00 MB 2024-09-19T09:18:08.338 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.338 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.338 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 411.00 MB 2024-09-19T09:18:08.338 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.338 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.338 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 412.00 MB 2024-09-19T09:18:08.338 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.338 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.338 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 413.00 MB 2024-09-19T09:18:08.338 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.338 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.338 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 414.00 MB 2024-09-19T09:18:08.339 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.339 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.339 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 415.00 MB 2024-09-19T09:18:08.339 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.340 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.340 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 416.00 MB 2024-09-19T09:18:08.340 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.340 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.340 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 417.00 MB 2024-09-19T09:18:08.340 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.340 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.340 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 418.00 MB 2024-09-19T09:18:08.340 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.340 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.340 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 419.00 MB 2024-09-19T09:18:08.340 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.340 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.341 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 420.00 MB 2024-09-19T09:18:08.341 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.341 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.341 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 421.00 MB 2024-09-19T09:18:08.341 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.341 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.341 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 422.00 MB 2024-09-19T09:18:08.341 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.341 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.341 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 423.00 MB 2024-09-19T09:18:08.341 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.341 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.341 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 424.00 MB 2024-09-19T09:18:08.342 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.342 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.342 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 425.00 MB 2024-09-19T09:18:08.342 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.342 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.343 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 426.00 MB 2024-09-19T09:18:08.343 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.343 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.343 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 427.00 MB 2024-09-19T09:18:08.343 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.343 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.343 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 428.00 MB 2024-09-19T09:18:08.343 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.343 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.343 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 429.00 MB 2024-09-19T09:18:08.343 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.344 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.344 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 430.00 MB 2024-09-19T09:18:08.344 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.344 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.344 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 431.00 MB 2024-09-19T09:18:08.344 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.344 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.344 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 432.00 MB 2024-09-19T09:18:08.344 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.344 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.346 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 433.00 MB 2024-09-19T09:18:08.346 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.346 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.346 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 434.00 MB 2024-09-19T09:18:08.346 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.346 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.346 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 435.00 MB 2024-09-19T09:18:08.346 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.346 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.347 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 436.00 MB 2024-09-19T09:18:08.347 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.347 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.347 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 437.00 MB 2024-09-19T09:18:08.347 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.347 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.347 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 438.00 MB 2024-09-19T09:18:08.347 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.347 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.347 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 439.00 MB 2024-09-19T09:18:08.347 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.347 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.347 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 440.00 MB 2024-09-19T09:18:08.347 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.348 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.348 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 441.00 MB 2024-09-19T09:18:08.348 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.348 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.348 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 442.00 MB 2024-09-19T09:18:08.348 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.348 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.348 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 443.00 MB 2024-09-19T09:18:08.348 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.348 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.348 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 444.00 MB 2024-09-19T09:18:08.348 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.348 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.349 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 445.00 MB 2024-09-19T09:18:08.349 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.349 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.349 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 446.00 MB 2024-09-19T09:18:08.350 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.350 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.350 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 447.00 MB 2024-09-19T09:18:08.350 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.350 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.350 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 448.00 MB 2024-09-19T09:18:08.350 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.350 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.350 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 449.00 MB 2024-09-19T09:18:08.350 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.350 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.350 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 450.00 MB 2024-09-19T09:18:08.350 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.351 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.351 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 451.00 MB 2024-09-19T09:18:08.351 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.351 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.351 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 452.00 MB 2024-09-19T09:18:08.351 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.351 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.351 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 453.00 MB 2024-09-19T09:18:08.352 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.352 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.352 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 454.00 MB 2024-09-19T09:18:08.352 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.352 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.352 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 455.00 MB 2024-09-19T09:18:08.352 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.352 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.352 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 456.00 MB 2024-09-19T09:18:08.353 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.353 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.353 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 457.00 MB 2024-09-19T09:18:08.353 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.353 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.353 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 458.00 MB 2024-09-19T09:18:08.353 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.353 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.353 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 459.00 MB 2024-09-19T09:18:08.353 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.353 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.353 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 460.00 MB 2024-09-19T09:18:08.353 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.354 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.354 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 461.00 MB 2024-09-19T09:18:08.354 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.354 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.354 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 462.00 MB 2024-09-19T09:18:08.354 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.354 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.354 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 463.00 MB 2024-09-19T09:18:08.354 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.354 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.354 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 464.00 MB 2024-09-19T09:18:08.354 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.354 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.354 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 465.00 MB 2024-09-19T09:18:08.355 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.355 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.355 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 466.00 MB 2024-09-19T09:18:08.355 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.355 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.355 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 467.00 MB 2024-09-19T09:18:08.355 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.355 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.355 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 468.00 MB 2024-09-19T09:18:08.355 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.355 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.355 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 469.00 MB 2024-09-19T09:18:08.355 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.355 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.356 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 470.00 MB 2024-09-19T09:18:08.356 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.357 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.357 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 471.00 MB 2024-09-19T09:18:08.357 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.357 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.357 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 472.00 MB 2024-09-19T09:18:08.357 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.358 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.358 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 473.00 MB 2024-09-19T09:18:08.358 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.358 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.358 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 474.00 MB 2024-09-19T09:18:08.358 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.358 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.358 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 475.00 MB 2024-09-19T09:18:08.359 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.359 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.359 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 476.00 MB 2024-09-19T09:18:08.359 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.359 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.359 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 477.00 MB 2024-09-19T09:18:08.359 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.359 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.360 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 478.00 MB 2024-09-19T09:18:08.360 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.360 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.360 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 479.00 MB 2024-09-19T09:18:08.360 INFO:teuthology.orchestra.run.smithi018.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-19T09:18:08.360 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:18:08.360 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:18:08.360 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 480.00 MB 2024-09-19T09:18:08.360 INFO:teuthology.orchestra.run.smithi018.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-19T09:18:08.366 INFO:teuthology.orchestra.run.smithi018.stdout:Reached fullness after 480.00 MB 2024-09-19T09:18:08.366 INFO:teuthology.orchestra.run.smithi018.stdout:calling close 2024-09-19T09:18:08.366 INFO:teuthology.orchestra.run.smithi018.stdout:close() did not raise error 2024-09-19T09:18:08.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:18:08.379 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T09:18:08.379 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:18:08.418 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:18:08.462 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T09:18:08.463 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:18:08.463 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:18:08.463 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:18:08.485 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:18:08.485 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:18:08.544 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T09:18:08.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.693+0000 7fe07170a640 1 Processor -- start 2024-09-19T09:18:08.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.694+0000 7fe07170a640 1 -- start start 2024-09-19T09:18:08.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.694+0000 7fe07170a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe06c15eda0 0x7fe06c0d5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:08.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.694+0000 7fe07170a640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe06c0d3cc0 con 0x7fe06c0d1630 2024-09-19T09:18:08.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.694+0000 7fe07170a640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe06c0d0bf0 con 0x7fe06c0d0480 2024-09-19T09:18:08.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.694+0000 7fe07170a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe06c0d2880 con 0x7fe06c15eda0 2024-09-19T09:18:08.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.694+0000 7fe06b7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe06c0d1630 0x7fe06c0b7b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:42718/0 (socket says 172.21.15.18:42718) 2024-09-19T09:18:08.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.695+0000 7fe06b7fe640 1 -- 172.21.15.18:0/3522666513 learned_addr learned my addr 172.21.15.18:0/3522666513 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:08.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.695+0000 7fe06affd640 1 --2- 172.21.15.18:0/3522666513 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe06c15eda0 0x7fe06c0d5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:08.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.695+0000 7fe069ffb640 1 -- 172.21.15.18:0/3522666513 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3355678361 0 0) 0x7fe06c0d3cc0 con 0x7fe06c0d1630 2024-09-19T09:18:08.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.695+0000 7fe069ffb640 1 -- 172.21.15.18:0/3522666513 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe058003520 con 0x7fe06c0d1630 2024-09-19T09:18:08.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.695+0000 7fe069ffb640 1 -- 172.21.15.18:0/3522666513 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2762252962 0 0) 0x7fe058003520 con 0x7fe06c0d1630 2024-09-19T09:18:08.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.695+0000 7fe069ffb640 1 -- 172.21.15.18:0/3522666513 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe06c15eda0 msgr2=0x7fe06c0d5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:08.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.695+0000 7fe069ffb640 1 --2- 172.21.15.18:0/3522666513 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe06c15eda0 0x7fe06c0d5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:08.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.695+0000 7fe069ffb640 1 -- 172.21.15.18:0/3522666513 >> v1:172.21.15.162:6789/0 conn(0x7fe06c0d0480 legacy=0x7fe06c0d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:08.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.695+0000 7fe069ffb640 1 -- 172.21.15.18:0/3522666513 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe06c0d2ad0 con 0x7fe06c0d1630 2024-09-19T09:18:08.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.695+0000 7fe069ffb640 1 -- 172.21.15.18:0/3522666513 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fe064001670 con 0x7fe06c0d1630 2024-09-19T09:18:08.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.695+0000 7fe069ffb640 1 -- 172.21.15.18:0/3522666513 >> v1:172.21.15.18:6789/0 conn(0x7fe06c0d1630 legacy=0x7fe06c0b7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:08.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.695+0000 7fe069ffb640 1 --2- 172.21.15.18:0/3522666513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0580039e0 0x7fe058003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:08.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.695+0000 7fe069ffb640 1 --2- 172.21.15.18:0/3522666513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe058004800 0x7fe058004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:08.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.695+0000 7fe069ffb640 1 --2- 172.21.15.18:0/3522666513 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe06c15eda0 0x7fe0580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:08.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.695+0000 7fe069ffb640 1 -- 172.21.15.18:0/3522666513 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe06c0d2880 con 0x7fe0580039e0 2024-09-19T09:18:08.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.695+0000 7fe069ffb640 1 -- 172.21.15.18:0/3522666513 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe05800ba70 con 0x7fe058004800 2024-09-19T09:18:08.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.695+0000 7fe069ffb640 1 -- 172.21.15.18:0/3522666513 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe05800bc70 con 0x7fe06c15eda0 2024-09-19T09:18:08.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.695+0000 7fe06affd640 1 --2- 172.21.15.18:0/3522666513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0580039e0 0x7fe058003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:08.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.695+0000 7fe06a7fc640 1 --2- 172.21.15.18:0/3522666513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe058004800 0x7fe058004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:08.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.695+0000 7fe06b7fe640 1 --2- 172.21.15.18:0/3522666513 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe06c15eda0 0x7fe0580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:08.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.696+0000 7fe06affd640 1 -- 172.21.15.18:0/3522666513 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe06c15eda0 msgr2=0x7fe0580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:08.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.696+0000 7fe06affd640 1 --2- 172.21.15.18:0/3522666513 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe06c15eda0 0x7fe0580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:08.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.696+0000 7fe06affd640 1 -- 172.21.15.18:0/3522666513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe058004800 msgr2=0x7fe058004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:08.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.696+0000 7fe06affd640 1 --2- 172.21.15.18:0/3522666513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe058004800 0x7fe058004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:08.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.696+0000 7fe06affd640 1 -- 172.21.15.18:0/3522666513 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe058003520 con 0x7fe0580039e0 2024-09-19T09:18:08.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.696+0000 7fe06a7fc640 1 --2- 172.21.15.18:0/3522666513 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe058004800 0x7fe058004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:08.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.696+0000 7fe06affd640 1 --2- 172.21.15.18:0/3522666513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0580039e0 0x7fe058003e00 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe05c009f90 tx=0x7fe058005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=160e0d4210d8f35a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:08.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.696+0000 7fe069ffb640 1 -- 172.21.15.18:0/3522666513 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05c009c10 con 0x7fe0580039e0 2024-09-19T09:18:08.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.696+0000 7fe069ffb640 1 -- 172.21.15.18:0/3522666513 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe05c036070 con 0x7fe0580039e0 2024-09-19T09:18:08.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.696+0000 7fe069ffb640 1 -- 172.21.15.18:0/3522666513 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05c031830 con 0x7fe0580039e0 2024-09-19T09:18:08.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.697+0000 7fe07170a640 1 -- 172.21.15.18:0/3522666513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0580039e0 msgr2=0x7fe058003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:08.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.697+0000 7fe07170a640 1 --2- 172.21.15.18:0/3522666513 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0580039e0 0x7fe058003e00 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fe05c009f90 tx=0x7fe058005830 comp rx=0 tx=0).stop 2024-09-19T09:18:08.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.697+0000 7fe06b7fe640 1 -- 172.21.15.18:0/3522666513 reap_dead start 2024-09-19T09:18:08.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.697+0000 7fe07170a640 1 -- 172.21.15.18:0/3522666513 shutdown_connections 2024-09-19T09:18:08.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.697+0000 7fe07170a640 1 -- 172.21.15.18:0/3522666513 >> 172.21.15.18:0/3522666513 conn(0x7fe06c09df40 msgr2=0x7fe06c0d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:08.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.697+0000 7fe07170a640 1 -- 172.21.15.18:0/3522666513 shutdown_connections 2024-09-19T09:18:08.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.697+0000 7fe07170a640 1 -- 172.21.15.18:0/3522666513 wait complete. 2024-09-19T09:18:08.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.698+0000 7fe07170a640 1 Processor -- start 2024-09-19T09:18:08.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.698+0000 7fe07170a640 1 -- start start 2024-09-19T09:18:08.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.699+0000 7fe07170a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0580039e0 0x7fe06c157270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:08.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.699+0000 7fe07170a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe06c0c9450 0x7fe06c1f51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:08.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.699+0000 7fe07170a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe06c15a670 0x7fe06c0cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:08.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.699+0000 7fe07170a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe06c0d08c0 con 0x7fe0580039e0 2024-09-19T09:18:08.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.699+0000 7fe07170a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe06c0d3120 con 0x7fe06c15a670 2024-09-19T09:18:08.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.699+0000 7fe07170a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe06c15f180 con 0x7fe06c0c9450 2024-09-19T09:18:08.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.699+0000 7fe06affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0580039e0 0x7fe06c157270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:08.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.699+0000 7fe06affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0580039e0 0x7fe06c157270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53348/0 (socket says 172.21.15.18:53348) 2024-09-19T09:18:08.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.699+0000 7fe06affd640 1 -- 172.21.15.18:0/540697633 learned_addr learned my addr 172.21.15.18:0/540697633 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:08.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.699+0000 7fe06a7fc640 1 --2- 172.21.15.18:0/540697633 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe06c0c9450 0x7fe06c1f51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:08.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.699+0000 7fe06b7fe640 1 --2- 172.21.15.18:0/540697633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe06c15a670 0x7fe06c0cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:08.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.700+0000 7fe06affd640 1 -- 172.21.15.18:0/540697633 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe06c0c9450 msgr2=0x7fe06c1f51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:08.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.700+0000 7fe06affd640 1 --2- 172.21.15.18:0/540697633 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe06c0c9450 0x7fe06c1f51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:08.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.700+0000 7fe06affd640 1 -- 172.21.15.18:0/540697633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe06c15a670 msgr2=0x7fe06c0cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:08.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.700+0000 7fe06affd640 1 --2- 172.21.15.18:0/540697633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe06c15a670 0x7fe06c0cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:08.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.700+0000 7fe06affd640 1 -- 172.21.15.18:0/540697633 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe06c1f5b00 con 0x7fe0580039e0 2024-09-19T09:18:08.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.700+0000 7fe06affd640 1 --2- 172.21.15.18:0/540697633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0580039e0 0x7fe06c157270 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe05c033040 tx=0x7fe05c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:08.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.700+0000 7fe0637fe640 1 -- 172.21.15.18:0/540697633 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05c009c10 con 0x7fe0580039e0 2024-09-19T09:18:08.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.700+0000 7fe0637fe640 1 -- 172.21.15.18:0/540697633 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe05c045650 con 0x7fe0580039e0 2024-09-19T09:18:08.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.700+0000 7fe07170a640 1 -- 172.21.15.18:0/540697633 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe06c1f5de0 con 0x7fe0580039e0 2024-09-19T09:18:08.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.700+0000 7fe0637fe640 1 -- 172.21.15.18:0/540697633 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05c045a40 con 0x7fe0580039e0 2024-09-19T09:18:08.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.700+0000 7fe07170a640 1 -- 172.21.15.18:0/540697633 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe06c159e70 con 0x7fe0580039e0 2024-09-19T09:18:08.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.701+0000 7fe07170a640 1 -- 172.21.15.18:0/540697633 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe06c0b6340 con 0x7fe0580039e0 2024-09-19T09:18:08.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.702+0000 7fe0637fe640 1 -- 172.21.15.18:0/540697633 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe05c005d10 con 0x7fe0580039e0 2024-09-19T09:18:08.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.702+0000 7fe0637fe640 1 --2- 172.21.15.18:0/540697633 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe04c06c2b0 0x7fe04c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:08.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.702+0000 7fe0637fe640 1 -- 172.21.15.18:0/540697633 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7fe05c0ac570 con 0x7fe0580039e0 2024-09-19T09:18:08.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.702+0000 7fe0637fe640 1 -- 172.21.15.18:0/540697633 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=93}) -- 0x7fe04c073e40 con 0x7fe0580039e0 2024-09-19T09:18:08.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.702+0000 7fe06a7fc640 1 --2- 172.21.15.18:0/540697633 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe04c06c2b0 0x7fe04c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:08.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.703+0000 7fe06a7fc640 1 --2- 172.21.15.18:0/540697633 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe04c06c2b0 0x7fe04c06e770 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0c9890 tx=0x7fe054009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:08.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.707+0000 7fe0637fe640 1 -- 172.21.15.18:0/540697633 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe06c0b6340 con 0x7fe0580039e0 2024-09-19T09:18:08.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.895+0000 7fe07170a640 1 -- 172.21.15.18:0/540697633 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe06c0d2330 con 0x7fe0580039e0 2024-09-19T09:18:08.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.896+0000 7fe0637fe640 1 -- 172.21.15.18:0/540697633 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v92) ==== 80+0+0 (secure 0 0 0) 0x7fe05c07a720 con 0x7fe0580039e0 2024-09-19T09:18:08.896 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-09-19T09:18:08.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.898+0000 7fe07170a640 1 -- 172.21.15.18:0/540697633 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe04c06c2b0 msgr2=0x7fe04c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:08.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.898+0000 7fe07170a640 1 --2- 172.21.15.18:0/540697633 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe04c06c2b0 0x7fe04c06e770 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fe06c0c9890 tx=0x7fe054009040 comp rx=0 tx=0).stop 2024-09-19T09:18:08.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.898+0000 7fe07170a640 1 -- 172.21.15.18:0/540697633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0580039e0 msgr2=0x7fe06c157270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:08.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.898+0000 7fe07170a640 1 --2- 172.21.15.18:0/540697633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0580039e0 0x7fe06c157270 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fe05c033040 tx=0x7fe05c009750 comp rx=0 tx=0).stop 2024-09-19T09:18:08.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.898+0000 7fe07170a640 1 -- 172.21.15.18:0/540697633 shutdown_connections 2024-09-19T09:18:08.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.898+0000 7fe07170a640 1 --2- 172.21.15.18:0/540697633 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe04c06c2b0 0x7fe04c06e770 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:08.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.898+0000 7fe07170a640 1 --2- 172.21.15.18:0/540697633 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe06c15a670 0x7fe06c0cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:08.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.898+0000 7fe07170a640 1 --2- 172.21.15.18:0/540697633 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe06c0c9450 0x7fe06c1f51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:08.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.898+0000 7fe07170a640 1 --2- 172.21.15.18:0/540697633 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0580039e0 0x7fe06c157270 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:08.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.898+0000 7fe07170a640 1 -- 172.21.15.18:0/540697633 >> 172.21.15.18:0/540697633 conn(0x7fe06c09df40 msgr2=0x7fe06c0ceae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:08.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.898+0000 7fe07170a640 1 -- 172.21.15.18:0/540697633 shutdown_connections 2024-09-19T09:18:08.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:08.898+0000 7fe07170a640 1 -- 172.21.15.18:0/540697633 wait complete. 2024-09-19T09:18:08.910 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T09:18:08.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:08.910 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-19T09:18:08.941 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T09:18:08.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:08.941 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T09:18:08.998 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:18:08.998 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:18:08.998 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:18:09.017 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:18:09.017 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:18:09.077 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T09:18:09.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.227+0000 7fd48e08d640 1 Processor -- start 2024-09-19T09:18:09.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.227+0000 7fd48e08d640 1 -- start start 2024-09-19T09:18:09.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.228+0000 7fd48e08d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd48815d520 0x7fd4881640d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.229+0000 7fd48e08d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd488072cd0 0x7fd4880cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.229+0000 7fd48e08d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4880cfdb0 0x7fd4880ce9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.229+0000 7fd48e08d640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fd48806e540 con 0x7fd48815d520 2024-09-19T09:18:09.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.229+0000 7fd48e08d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd48806e820 con 0x7fd488072cd0 2024-09-19T09:18:09.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.229+0000 7fd48e08d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd4880ce4c0 con 0x7fd4880cfdb0 2024-09-19T09:18:09.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.229+0000 7fd4877fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd48815d520 0x7fd4881640d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.229+0000 7fd4877fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd48815d520 0x7fd4881640d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53360/0 (socket says 172.21.15.18:53360) 2024-09-19T09:18:09.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.229+0000 7fd487fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4880cfdb0 0x7fd4880ce9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.229+0000 7fd487fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4880cfdb0 0x7fd4880ce9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:43940/0 (socket says 172.21.15.18:43940) 2024-09-19T09:18:09.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.229+0000 7fd4877fe640 1 -- 172.21.15.18:0/2068541890 learned_addr learned my addr 172.21.15.18:0/2068541890 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:09.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.230+0000 7fd486ffd640 1 --2- 172.21.15.18:0/2068541890 >> v2:172.21.15.162:3300/0 conn(0x7fd488072cd0 0x7fd4880cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.230+0000 7fd4877fe640 1 -- 172.21.15.18:0/2068541890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4880cfdb0 msgr2=0x7fd4880ce9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:09.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.230+0000 7fd4877fe640 1 --2- 172.21.15.18:0/2068541890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4880cfdb0 0x7fd4880ce9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.230+0000 7fd4877fe640 1 -- 172.21.15.18:0/2068541890 >> v2:172.21.15.162:3300/0 conn(0x7fd488072cd0 msgr2=0x7fd4880cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:09.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.230+0000 7fd4877fe640 1 --2- 172.21.15.18:0/2068541890 >> v2:172.21.15.162:3300/0 conn(0x7fd488072cd0 0x7fd4880cf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.230+0000 7fd4877fe640 1 -- 172.21.15.18:0/2068541890 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd48806eb00 con 0x7fd48815d520 2024-09-19T09:18:09.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.231+0000 7fd4877fe640 1 --2- 172.21.15.18:0/2068541890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd48815d520 0x7fd4881640d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd48806fb10 tx=0x7fd47802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=689e98bde603147b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:09.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.232+0000 7fd4867fc640 1 -- 172.21.15.18:0/2068541890 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd478037070 con 0x7fd48815d520 2024-09-19T09:18:09.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.232+0000 7fd4867fc640 1 -- 172.21.15.18:0/2068541890 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd478032440 con 0x7fd48815d520 2024-09-19T09:18:09.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.232+0000 7fd4867fc640 1 -- 172.21.15.18:0/2068541890 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd478032810 con 0x7fd48815d520 2024-09-19T09:18:09.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.233+0000 7fd48e08d640 1 -- 172.21.15.18:0/2068541890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd48815d520 msgr2=0x7fd4881640d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:09.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.233+0000 7fd48e08d640 1 --2- 172.21.15.18:0/2068541890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd48815d520 0x7fd4881640d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fd48806fb10 tx=0x7fd47802a140 comp rx=0 tx=0).stop 2024-09-19T09:18:09.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.233+0000 7fd48e08d640 1 -- 172.21.15.18:0/2068541890 shutdown_connections 2024-09-19T09:18:09.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.233+0000 7fd48e08d640 1 --2- 172.21.15.18:0/2068541890 >> v2:172.21.15.162:3300/0 conn(0x7fd488072cd0 0x7fd4880cf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.234+0000 7fd48e08d640 1 --2- 172.21.15.18:0/2068541890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4880cfdb0 0x7fd4880ce9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.234+0000 7fd48e08d640 1 --2- 172.21.15.18:0/2068541890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd48815d520 0x7fd4881640d0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.234+0000 7fd48e08d640 1 -- 172.21.15.18:0/2068541890 >> 172.21.15.18:0/2068541890 conn(0x7fd4880b3900 msgr2=0x7fd4880b3d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:09.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.234+0000 7fd48e08d640 1 -- 172.21.15.18:0/2068541890 shutdown_connections 2024-09-19T09:18:09.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.234+0000 7fd48e08d640 1 -- 172.21.15.18:0/2068541890 wait complete. 2024-09-19T09:18:09.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.236+0000 7fd48e08d640 1 Processor -- start 2024-09-19T09:18:09.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.236+0000 7fd48e08d640 1 -- start start 2024-09-19T09:18:09.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.237+0000 7fd48e08d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd488072cd0 0x7fd4881edcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.237+0000 7fd48e08d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4880cfdb0 0x7fd4881f8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.237+0000 7fd48e08d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd48815d520 0x7fd488161ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.237+0000 7fd48e08d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd48815da80 con 0x7fd488072cd0 2024-09-19T09:18:09.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.237+0000 7fd48e08d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd48815d900 con 0x7fd48815d520 2024-09-19T09:18:09.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.237+0000 7fd48e08d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd4880cef20 con 0x7fd4880cfdb0 2024-09-19T09:18:09.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.237+0000 7fd486ffd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4880cfdb0 0x7fd4881f8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.238+0000 7fd4877fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd488072cd0 0x7fd4881edcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.238+0000 7fd487fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd48815d520 0x7fd488161ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.238+0000 7fd4877fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd488072cd0 0x7fd4881edcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53374/0 (socket says 172.21.15.18:53374) 2024-09-19T09:18:09.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.238+0000 7fd4877fe640 1 -- 172.21.15.18:0/3753599362 learned_addr learned my addr 172.21.15.18:0/3753599362 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:09.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.238+0000 7fd486ffd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4880cfdb0 0x7fd4881f8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:43954/0 (socket says 172.21.15.18:43954) 2024-09-19T09:18:09.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.238+0000 7fd4877fe640 1 -- 172.21.15.18:0/3753599362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4880cfdb0 msgr2=0x7fd4881f8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:09.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.238+0000 7fd4877fe640 1 --2- 172.21.15.18:0/3753599362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4880cfdb0 0x7fd4881f8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.238+0000 7fd4877fe640 1 -- 172.21.15.18:0/3753599362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd48815d520 msgr2=0x7fd488161ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:09.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.238+0000 7fd4877fe640 1 --2- 172.21.15.18:0/3753599362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd48815d520 0x7fd488161ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.238+0000 7fd4877fe640 1 -- 172.21.15.18:0/3753599362 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd48815ff10 con 0x7fd488072cd0 2024-09-19T09:18:09.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.239+0000 7fd4877fe640 1 --2- 172.21.15.18:0/3753599362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd488072cd0 0x7fd4881edcb0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd478000c00 tx=0x7fd4780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:09.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.239+0000 7fd46ffff640 1 -- 172.21.15.18:0/3753599362 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd478037040 con 0x7fd488072cd0 2024-09-19T09:18:09.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.239+0000 7fd48e08d640 1 -- 172.21.15.18:0/3753599362 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4881601f0 con 0x7fd488072cd0 2024-09-19T09:18:09.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.239+0000 7fd46ffff640 1 -- 172.21.15.18:0/3753599362 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd478042070 con 0x7fd488072cd0 2024-09-19T09:18:09.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.239+0000 7fd48e08d640 1 -- 172.21.15.18:0/3753599362 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4881607b0 con 0x7fd488072cd0 2024-09-19T09:18:09.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.239+0000 7fd46ffff640 1 -- 172.21.15.18:0/3753599362 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd478030940 con 0x7fd488072cd0 2024-09-19T09:18:09.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.241+0000 7fd48e08d640 1 -- 172.21.15.18:0/3753599362 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd48806c530 con 0x7fd488072cd0 2024-09-19T09:18:09.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.241+0000 7fd46ffff640 1 -- 172.21.15.18:0/3753599362 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd478030ae0 con 0x7fd488072cd0 2024-09-19T09:18:09.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.242+0000 7fd46ffff640 1 --2- 172.21.15.18:0/3753599362 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd47406c2b0 0x7fd47406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.242+0000 7fd46ffff640 1 -- 172.21.15.18:0/3753599362 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7fd4780abb50 con 0x7fd488072cd0 2024-09-19T09:18:09.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.242+0000 7fd486ffd640 1 --2- 172.21.15.18:0/3753599362 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd47406c2b0 0x7fd47406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.242+0000 7fd46ffff640 1 -- 172.21.15.18:0/3753599362 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=93}) -- 0x7fd474073de0 con 0x7fd488072cd0 2024-09-19T09:18:09.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.244+0000 7fd486ffd640 1 --2- 172.21.15.18:0/3753599362 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd47406c2b0 0x7fd47406e770 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd48815c510 tx=0x7fd47c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:09.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.251+0000 7fd46ffff640 1 -- 172.21.15.18:0/3753599362 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd48806c530 con 0x7fd488072cd0 2024-09-19T09:18:09.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.441+0000 7fd48e08d640 1 -- 172.21.15.18:0/3753599362 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd4880703d0 con 0x7fd488072cd0 2024-09-19T09:18:09.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.441+0000 7fd46ffff640 1 -- 172.21.15.18:0/3753599362 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v92) ==== 80+0+0 (secure 0 0 0) 0x7fd48806c530 con 0x7fd488072cd0 2024-09-19T09:18:09.442 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-09-19T09:18:09.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.443+0000 7fd48e08d640 1 -- 172.21.15.18:0/3753599362 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd47406c2b0 msgr2=0x7fd47406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:09.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.443+0000 7fd48e08d640 1 --2- 172.21.15.18:0/3753599362 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd47406c2b0 0x7fd47406e770 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd48815c510 tx=0x7fd47c008040 comp rx=0 tx=0).stop 2024-09-19T09:18:09.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.443+0000 7fd48e08d640 1 -- 172.21.15.18:0/3753599362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd488072cd0 msgr2=0x7fd4881edcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:09.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.443+0000 7fd48e08d640 1 --2- 172.21.15.18:0/3753599362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd488072cd0 0x7fd4881edcb0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fd478000c00 tx=0x7fd4780046c0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.443+0000 7fd48e08d640 1 -- 172.21.15.18:0/3753599362 shutdown_connections 2024-09-19T09:18:09.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.443+0000 7fd48e08d640 1 --2- 172.21.15.18:0/3753599362 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd47406c2b0 0x7fd47406e770 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.443+0000 7fd48e08d640 1 --2- 172.21.15.18:0/3753599362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd48815d520 0x7fd488161ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.443+0000 7fd48e08d640 1 --2- 172.21.15.18:0/3753599362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd4880cfdb0 0x7fd4881f8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.443+0000 7fd48e08d640 1 --2- 172.21.15.18:0/3753599362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd488072cd0 0x7fd4881edcb0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.443+0000 7fd48e08d640 1 -- 172.21.15.18:0/3753599362 >> 172.21.15.18:0/3753599362 conn(0x7fd4880b3900 msgr2=0x7fd4880b3ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:09.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.444+0000 7fd48e08d640 1 -- 172.21.15.18:0/3753599362 shutdown_connections 2024-09-19T09:18:09.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.444+0000 7fd48e08d640 1 -- 172.21.15.18:0/3753599362 wait complete. 2024-09-19T09:18:09.455 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-19T09:18:09.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:09.455 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-19T09:18:09.485 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-09-19T09:18:09.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:09.485 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-19T09:18:09.541 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:18:09.541 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:18:09.541 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:18:09.558 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17075 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T09:18:09.558 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:18:09.558 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:18:09.558 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:18:09.597 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3252 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T09:18:09.598 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:18:09.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.700+0000 7f198b5b9640 1 Processor -- start 2024-09-19T09:18:09.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.700+0000 7f198b5b9640 1 -- start start 2024-09-19T09:18:09.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.701+0000 7f198b5b9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f198415ed50 0x7f19840d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.701+0000 7f198b5b9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19840d1aa0 0x7f19840b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.701+0000 7f198b5b9640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19840d31b0 con 0x7f19840b5030 2024-09-19T09:18:09.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.701+0000 7f198b5b9640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f19840d1ee0 con 0x7f198415ed50 2024-09-19T09:18:09.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.701+0000 7f198b5b9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f19840d3490 con 0x7f19840d1aa0 2024-09-19T09:18:09.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.701+0000 7f1989355640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f198415ed50 0x7f19840d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.701+0000 7f1989355640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f198415ed50 0x7f19840d1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53386/0 (socket says 172.21.15.18:53386) 2024-09-19T09:18:09.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.701+0000 7f1989355640 1 -- 172.21.15.18:0/3902596526 learned_addr learned my addr 172.21.15.18:0/3902596526 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:09.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.701+0000 7f1988b54640 1 --2- 172.21.15.18:0/3902596526 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19840d1aa0 0x7f19840b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.701+0000 7f1989355640 1 -- 172.21.15.18:0/3902596526 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19840d1aa0 msgr2=0x7f19840b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:09.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.701+0000 7f1989355640 1 --2- 172.21.15.18:0/3902596526 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19840d1aa0 0x7f19840b4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.701+0000 7f1989355640 1 -- 172.21.15.18:0/3902596526 >> v1:172.21.15.162:6789/0 conn(0x7f19840b5030 legacy=0x7f19840b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:09.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.701+0000 7f1989355640 1 -- 172.21.15.18:0/3902596526 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19840d3770 con 0x7f198415ed50 2024-09-19T09:18:09.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.702+0000 7f1989355640 1 --2- 172.21.15.18:0/3902596526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f198415ed50 0x7f19840d1560 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f1980009870 tx=0x7f198002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a2590a32818b3d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:09.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.702+0000 7f197bfff640 1 -- 172.21.15.18:0/3902596526 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1980037070 con 0x7f198415ed50 2024-09-19T09:18:09.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.702+0000 7f197bfff640 1 -- 172.21.15.18:0/3902596526 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f198002ae50 con 0x7f198415ed50 2024-09-19T09:18:09.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.702+0000 7f197bfff640 1 -- 172.21.15.18:0/3902596526 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1980032860 con 0x7f198415ed50 2024-09-19T09:18:09.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.703+0000 7f198b5b9640 1 -- 172.21.15.18:0/3902596526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f198415ed50 msgr2=0x7f19840d1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:09.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.703+0000 7f198b5b9640 1 --2- 172.21.15.18:0/3902596526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f198415ed50 0x7f19840d1560 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f1980009870 tx=0x7f198002a300 comp rx=0 tx=0).stop 2024-09-19T09:18:09.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.703+0000 7f198b5b9640 1 -- 172.21.15.18:0/3902596526 shutdown_connections 2024-09-19T09:18:09.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.703+0000 7f198b5b9640 1 --2- 172.21.15.18:0/3902596526 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19840d1aa0 0x7f19840b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.703+0000 7f198b5b9640 1 --2- 172.21.15.18:0/3902596526 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f198415ed50 0x7f19840d1560 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.703+0000 7f198b5b9640 1 -- 172.21.15.18:0/3902596526 >> 172.21.15.18:0/3902596526 conn(0x7f19840d4bd0 msgr2=0x7f19840d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:09.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.703+0000 7f198b5b9640 1 -- 172.21.15.18:0/3902596526 shutdown_connections 2024-09-19T09:18:09.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.703+0000 7f198b5b9640 1 -- 172.21.15.18:0/3902596526 wait complete. 2024-09-19T09:18:09.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.704+0000 7f198b5b9640 1 Processor -- start 2024-09-19T09:18:09.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.704+0000 7f198b5b9640 1 -- start start 2024-09-19T09:18:09.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.705+0000 7f198b5b9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19840b5030 0x7f19841f8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.705+0000 7f198b5b9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19840d1aa0 0x7f19841f8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.705+0000 7f198b5b9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f198415ed50 0x7f19840b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.705+0000 7f198b5b9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f19840d3d30 con 0x7f19840d1aa0 2024-09-19T09:18:09.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.705+0000 7f198b5b9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f19840b45d0 con 0x7f198415ed50 2024-09-19T09:18:09.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.705+0000 7f198b5b9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f198415f130 con 0x7f19840b5030 2024-09-19T09:18:09.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.705+0000 7f1988b54640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19840d1aa0 0x7f19841f8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.705+0000 7f1988b54640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19840d1aa0 0x7f19841f8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53394/0 (socket says 172.21.15.18:53394) 2024-09-19T09:18:09.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.705+0000 7f1988b54640 1 -- 172.21.15.18:0/865491927 learned_addr learned my addr 172.21.15.18:0/865491927 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:09.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.705+0000 7f1989355640 1 --2- 172.21.15.18:0/865491927 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19840b5030 0x7f19841f8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.705+0000 7f1989b56640 1 --2- 172.21.15.18:0/865491927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f198415ed50 0x7f19840b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.705+0000 7f1988b54640 1 -- 172.21.15.18:0/865491927 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19840b5030 msgr2=0x7f19841f8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:09.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.705+0000 7f1988b54640 1 --2- 172.21.15.18:0/865491927 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19840b5030 0x7f19841f8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.705+0000 7f1988b54640 1 -- 172.21.15.18:0/865491927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f198415ed50 msgr2=0x7f19840b8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:09.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.705+0000 7f1988b54640 1 --2- 172.21.15.18:0/865491927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f198415ed50 0x7f19840b8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.705+0000 7f1988b54640 1 -- 172.21.15.18:0/865491927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19840ca2f0 con 0x7f19840d1aa0 2024-09-19T09:18:09.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.705+0000 7f1988b54640 1 --2- 172.21.15.18:0/865491927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19840d1aa0 0x7f19841f8690 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f197400e9b0 tx=0x7f197400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:09.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.705+0000 7f1979ffb640 1 -- 172.21.15.18:0/865491927 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1974017070 con 0x7f19840d1aa0 2024-09-19T09:18:09.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.706+0000 7f1979ffb640 1 -- 172.21.15.18:0/865491927 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f197400c9a0 con 0x7f19840d1aa0 2024-09-19T09:18:09.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.706+0000 7f198b5b9640 1 -- 172.21.15.18:0/865491927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19840ca5d0 con 0x7f19840d1aa0 2024-09-19T09:18:09.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.706+0000 7f1979ffb640 1 -- 172.21.15.18:0/865491927 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197400cd70 con 0x7f19840d1aa0 2024-09-19T09:18:09.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.706+0000 7f198b5b9640 1 -- 172.21.15.18:0/865491927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19840cab90 con 0x7f19840d1aa0 2024-09-19T09:18:09.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.707+0000 7f198b5b9640 1 -- 172.21.15.18:0/865491927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19840d21e0 con 0x7f19840d1aa0 2024-09-19T09:18:09.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.707+0000 7f1979ffb640 1 -- 172.21.15.18:0/865491927 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f197401a070 con 0x7f19840d1aa0 2024-09-19T09:18:09.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.708+0000 7f1979ffb640 1 --2- 172.21.15.18:0/865491927 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f196806c2b0 0x7f196806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:09.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.708+0000 7f1979ffb640 1 -- 172.21.15.18:0/865491927 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f197408b740 con 0x7f19840d1aa0 2024-09-19T09:18:09.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.708+0000 7f1989355640 1 --2- 172.21.15.18:0/865491927 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f196806c2b0 0x7f196806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:09.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.708+0000 7f1979ffb640 1 -- 172.21.15.18:0/865491927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=93}) -- 0x7f1968073de0 con 0x7f19840d1aa0 2024-09-19T09:18:09.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.708+0000 7f1989355640 1 --2- 172.21.15.18:0/865491927 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f196806c2b0 0x7f196806e770 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1980034000 tx=0x7f198002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:09.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.712+0000 7f1979ffb640 1 -- 172.21.15.18:0/865491927 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1974059850 con 0x7f19840d1aa0 2024-09-19T09:18:09.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.924+0000 7f198b5b9640 1 -- 172.21.15.18:0/865491927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f198406e110 con 0x7f19840d1aa0 2024-09-19T09:18:09.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.925+0000 7f1979ffb640 1 -- 172.21.15.18:0/865491927 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5228 (secure 0 0 0) 0x7f197405db50 con 0x7f19840d1aa0 2024-09-19T09:18:09.926 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:09.926 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":35,"btime":"2024-09-19T09:17:25:094931+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1906118343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1906118343},{"type":"v1","addr":"172.21.15.162:6837","nonce":1906118343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1051418414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1051418414},{"type":"v1","addr":"172.21.15.162:6835","nonce":1051418414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5892,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1630984812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630984812},{"type":"v1","addr":"172.21.15.18:6834","nonce":1630984812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:17:22.451890+0000","modified":"2024-09-19T09:17:24.482665+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5895},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5895":{"gid":5895,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/905153716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":905153716},{"type":"v1","addr":"172.21.15.18:6835","nonce":905153716}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5895,"qdb_cluster":[5895]},"id":5}]} 2024-09-19T09:18:09.926 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 35 2024-09-19T09:18:09.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.927+0000 7f198b5b9640 1 -- 172.21.15.18:0/865491927 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f196806c2b0 msgr2=0x7f196806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:09.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.927+0000 7f198b5b9640 1 --2- 172.21.15.18:0/865491927 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f196806c2b0 0x7f196806e770 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1980034000 tx=0x7f198002e000 comp rx=0 tx=0).stop 2024-09-19T09:18:09.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.927+0000 7f198b5b9640 1 -- 172.21.15.18:0/865491927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19840d1aa0 msgr2=0x7f19841f8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:09.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.927+0000 7f198b5b9640 1 --2- 172.21.15.18:0/865491927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19840d1aa0 0x7f19841f8690 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f197400e9b0 tx=0x7f197400ee70 comp rx=0 tx=0).stop 2024-09-19T09:18:09.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.927+0000 7f198b5b9640 1 -- 172.21.15.18:0/865491927 shutdown_connections 2024-09-19T09:18:09.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.927+0000 7f198b5b9640 1 --2- 172.21.15.18:0/865491927 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f196806c2b0 0x7f196806e770 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.927+0000 7f198b5b9640 1 --2- 172.21.15.18:0/865491927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f198415ed50 0x7f19840b8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.927+0000 7f198b5b9640 1 --2- 172.21.15.18:0/865491927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19840d1aa0 0x7f19841f8690 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.927+0000 7f198b5b9640 1 --2- 172.21.15.18:0/865491927 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19840b5030 0x7f19841f8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:09.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.927+0000 7f198b5b9640 1 -- 172.21.15.18:0/865491927 >> 172.21.15.18:0/865491927 conn(0x7f19840d4bd0 msgr2=0x7f19840b65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:09.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.927+0000 7f198b5b9640 1 -- 172.21.15.18:0/865491927 shutdown_connections 2024-09-19T09:18:09.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:09.927+0000 7f198b5b9640 1 -- 172.21.15.18:0/865491927 wait complete. 2024-09-19T09:18:09.939 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:18:10.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.041+0000 7fcfa016d640 1 Processor -- start 2024-09-19T09:18:10.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.041+0000 7fcfa016d640 1 -- start start 2024-09-19T09:18:10.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.042+0000 7fcfa016d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcf98072f40 0x7fcf9806f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:10.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.042+0000 7fcfa016d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf9806e3d0 con 0x7fcf980ce780 2024-09-19T09:18:10.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.042+0000 7fcfa016d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf9806e6b0 con 0x7fcf98145290 2024-09-19T09:18:10.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.042+0000 7fcfa016d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fcf9806efe0 con 0x7fcf98072f40 2024-09-19T09:18:10.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.042+0000 7fcf9e70a640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fcf980ce780 0x7fcf980b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:42724/0 (socket says 172.21.15.18:42724) 2024-09-19T09:18:10.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.042+0000 7fcf9e70a640 1 -- 172.21.15.18:0/2974053332 learned_addr learned my addr 172.21.15.18:0/2974053332 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:10.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.042+0000 7fcf9d708640 1 --2- 172.21.15.18:0/2974053332 >> v2:172.21.15.162:3300/0 conn(0x7fcf98072f40 0x7fcf9806f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:10.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.042+0000 7fcf9cf07640 1 -- 172.21.15.18:0/2974053332 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3647906960 0 0) 0x7fcf9806e3d0 con 0x7fcf980ce780 2024-09-19T09:18:10.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.042+0000 7fcf9cf07640 1 -- 172.21.15.18:0/2974053332 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf84005730 con 0x7fcf980ce780 2024-09-19T09:18:10.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.043+0000 7fcf9cf07640 1 -- 172.21.15.18:0/2974053332 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2889282490 0 0) 0x7fcf84005730 con 0x7fcf980ce780 2024-09-19T09:18:10.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.043+0000 7fcf9cf07640 1 -- 172.21.15.18:0/2974053332 >> v2:172.21.15.162:3300/0 conn(0x7fcf98072f40 msgr2=0x7fcf9806f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:10.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.043+0000 7fcf9cf07640 1 --2- 172.21.15.18:0/2974053332 >> v2:172.21.15.162:3300/0 conn(0x7fcf98072f40 0x7fcf9806f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:10.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.043+0000 7fcf9cf07640 1 -- 172.21.15.18:0/2974053332 >> v1:172.21.15.162:6789/0 conn(0x7fcf98145290 legacy=0x7fcf98072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:10.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.043+0000 7fcf9cf07640 1 -- 172.21.15.18:0/2974053332 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf9806e990 con 0x7fcf980ce780 2024-09-19T09:18:10.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.043+0000 7fcf9cf07640 1 -- 172.21.15.18:0/2974053332 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fcf900019f0 con 0x7fcf980ce780 2024-09-19T09:18:10.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.043+0000 7fcf9cf07640 1 -- 172.21.15.18:0/2974053332 >> v1:172.21.15.18:6789/0 conn(0x7fcf980ce780 legacy=0x7fcf980b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:10.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.043+0000 7fcf9cf07640 1 --2- 172.21.15.18:0/2974053332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf84005bc0 0x7fcf84005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:10.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.043+0000 7fcf9cf07640 1 --2- 172.21.15.18:0/2974053332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf84006a10 0x7fcf84006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:10.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.043+0000 7fcf9cf07640 1 --2- 172.21.15.18:0/2974053332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf840073d0 0x7fcf8400dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:10.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.043+0000 7fcf9cf07640 1 -- 172.21.15.18:0/2974053332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9806efe0 con 0x7fcf84006a10 2024-09-19T09:18:10.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.043+0000 7fcf9cf07640 1 -- 172.21.15.18:0/2974053332 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8400e270 con 0x7fcf840073d0 2024-09-19T09:18:10.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.043+0000 7fcf9cf07640 1 -- 172.21.15.18:0/2974053332 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcf8400e470 con 0x7fcf84005bc0 2024-09-19T09:18:10.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.043+0000 7fcf9d708640 1 --2- 172.21.15.18:0/2974053332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf84006a10 0x7fcf84006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:10.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.043+0000 7fcf9df09640 1 --2- 172.21.15.18:0/2974053332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf84005bc0 0x7fcf84005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:10.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.043+0000 7fcf9e70a640 1 --2- 172.21.15.18:0/2974053332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf840073d0 0x7fcf8400dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:10.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.043+0000 7fcf9d708640 1 -- 172.21.15.18:0/2974053332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf84005bc0 msgr2=0x7fcf84005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:10.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.043+0000 7fcf9d708640 1 --2- 172.21.15.18:0/2974053332 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf84005bc0 0x7fcf84005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:10.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.043+0000 7fcf9d708640 1 -- 172.21.15.18:0/2974053332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf840073d0 msgr2=0x7fcf8400dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:10.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.043+0000 7fcf9d708640 1 --2- 172.21.15.18:0/2974053332 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf840073d0 0x7fcf8400dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:10.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.043+0000 7fcf9d708640 1 -- 172.21.15.18:0/2974053332 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf84005730 con 0x7fcf84006a10 2024-09-19T09:18:10.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.043+0000 7fcf9e70a640 1 -- 172.21.15.18:0/2974053332 reap_dead start 2024-09-19T09:18:10.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.044+0000 7fcf9d708640 1 --2- 172.21.15.18:0/2974053332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf84006a10 0x7fcf84006e90 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fcf88009ac0 tx=0x7fcf84007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18622547c572f97a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:10.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.044+0000 7fcf9cf07640 1 -- 172.21.15.18:0/2974053332 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf88036070 con 0x7fcf84006a10 2024-09-19T09:18:10.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.044+0000 7fcf9cf07640 1 -- 172.21.15.18:0/2974053332 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf88031400 con 0x7fcf84006a10 2024-09-19T09:18:10.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.044+0000 7fcf9cf07640 1 -- 172.21.15.18:0/2974053332 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf88009690 con 0x7fcf84006a10 2024-09-19T09:18:10.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.044+0000 7fcfa016d640 1 -- 172.21.15.18:0/2974053332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf84006a10 msgr2=0x7fcf84006e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:10.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.044+0000 7fcfa016d640 1 --2- 172.21.15.18:0/2974053332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf84006a10 0x7fcf84006e90 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fcf88009ac0 tx=0x7fcf84007a40 comp rx=0 tx=0).stop 2024-09-19T09:18:10.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.045+0000 7fcfa016d640 1 -- 172.21.15.18:0/2974053332 shutdown_connections 2024-09-19T09:18:10.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.045+0000 7fcfa016d640 1 --2- 172.21.15.18:0/2974053332 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf84006a10 0x7fcf84006e90 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:10.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.045+0000 7fcfa016d640 1 -- 172.21.15.18:0/2974053332 >> 172.21.15.18:0/2974053332 conn(0x7fcf9806bc10 msgr2=0x7fcf9806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:10.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.045+0000 7fcfa016d640 1 -- 172.21.15.18:0/2974053332 shutdown_connections 2024-09-19T09:18:10.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.045+0000 7fcfa016d640 1 -- 172.21.15.18:0/2974053332 wait complete. 2024-09-19T09:18:10.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.046+0000 7fcfa016d640 1 Processor -- start 2024-09-19T09:18:10.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.046+0000 7fcfa016d640 1 -- start start 2024-09-19T09:18:10.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.047+0000 7fcfa016d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf84006a10 0x7fcf9815a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:10.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.047+0000 7fcfa016d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf98138b30 0x7fcf980cf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:10.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.047+0000 7fcfa016d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf98138fb0 0x7fcf980cf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:10.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.047+0000 7fcfa016d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcf9806df80 con 0x7fcf98138fb0 2024-09-19T09:18:10.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.047+0000 7fcfa016d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcf98145670 con 0x7fcf98138b30 2024-09-19T09:18:10.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.047+0000 7fcfa016d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcf9806e100 con 0x7fcf84006a10 2024-09-19T09:18:10.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.047+0000 7fcf9e70a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf98138fb0 0x7fcf980cf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:10.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.047+0000 7fcf9e70a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf98138fb0 0x7fcf980cf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53414/0 (socket says 172.21.15.18:53414) 2024-09-19T09:18:10.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.047+0000 7fcf9e70a640 1 -- 172.21.15.18:0/131827511 learned_addr learned my addr 172.21.15.18:0/131827511 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:10.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.047+0000 7fcf9df09640 1 --2- 172.21.15.18:0/131827511 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf84006a10 0x7fcf9815a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:10.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.047+0000 7fcf9d708640 1 --2- 172.21.15.18:0/131827511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf98138b30 0x7fcf980cf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:10.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.047+0000 7fcf9e70a640 1 -- 172.21.15.18:0/131827511 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf84006a10 msgr2=0x7fcf9815a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:10.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.047+0000 7fcf9e70a640 1 --2- 172.21.15.18:0/131827511 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf84006a10 0x7fcf9815a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:10.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.047+0000 7fcf9e70a640 1 -- 172.21.15.18:0/131827511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf98138b30 msgr2=0x7fcf980cf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:10.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.047+0000 7fcf9e70a640 1 --2- 172.21.15.18:0/131827511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf98138b30 0x7fcf980cf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:10.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.047+0000 7fcf9e70a640 1 -- 172.21.15.18:0/131827511 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf9813be00 con 0x7fcf98138fb0 2024-09-19T09:18:10.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.047+0000 7fcf9df09640 1 --2- 172.21.15.18:0/131827511 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf84006a10 0x7fcf9815a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:10.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.047+0000 7fcf9d708640 1 --2- 172.21.15.18:0/131827511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf98138b30 0x7fcf980cf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:10.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.047+0000 7fcf9e70a640 1 --2- 172.21.15.18:0/131827511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf98138fb0 0x7fcf980cf8a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fcf9806ef50 tx=0x7fcf90007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:10.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.047+0000 7fcf8e7fc640 1 -- 172.21.15.18:0/131827511 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf9000ab00 con 0x7fcf98138fb0 2024-09-19T09:18:10.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.047+0000 7fcf8e7fc640 1 -- 172.21.15.18:0/131827511 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf90018070 con 0x7fcf98138fb0 2024-09-19T09:18:10.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.047+0000 7fcfa016d640 1 -- 172.21.15.18:0/131827511 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf9813c0e0 con 0x7fcf98138fb0 2024-09-19T09:18:10.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.047+0000 7fcf8e7fc640 1 -- 172.21.15.18:0/131827511 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf900133f0 con 0x7fcf98138fb0 2024-09-19T09:18:10.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.047+0000 7fcfa016d640 1 -- 172.21.15.18:0/131827511 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf9813ba90 con 0x7fcf98138fb0 2024-09-19T09:18:10.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.048+0000 7fcfa016d640 1 -- 172.21.15.18:0/131827511 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf980715a0 con 0x7fcf98138fb0 2024-09-19T09:18:10.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.049+0000 7fcf8e7fc640 1 -- 172.21.15.18:0/131827511 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcf90013590 con 0x7fcf98138fb0 2024-09-19T09:18:10.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.049+0000 7fcf8e7fc640 1 --2- 172.21.15.18:0/131827511 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcf7c06c2e0 0x7fcf7c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:10.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.049+0000 7fcf8e7fc640 1 -- 172.21.15.18:0/131827511 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7fcf9008b960 con 0x7fcf98138fb0 2024-09-19T09:18:10.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.050+0000 7fcf8e7fc640 1 -- 172.21.15.18:0/131827511 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=93}) -- 0x7fcf7c073e10 con 0x7fcf98138fb0 2024-09-19T09:18:10.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.050+0000 7fcf9df09640 1 --2- 172.21.15.18:0/131827511 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcf7c06c2e0 0x7fcf7c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:10.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.050+0000 7fcf9df09640 1 --2- 172.21.15.18:0/131827511 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcf7c06c2e0 0x7fcf7c06e7a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcf94005580 tx=0x7fcf94009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:10.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.054+0000 7fcf8e7fc640 1 -- 172.21.15.18:0/131827511 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fcf9005a030 con 0x7fcf98138fb0 2024-09-19T09:18:10.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.272+0000 7fcfa016d640 1 -- 172.21.15.18:0/131827511 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcf98140ef0 con 0x7fcf98138fb0 2024-09-19T09:18:10.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.272+0000 7fcf8e7fc640 1 -- 172.21.15.18:0/131827511 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5228 (secure 0 0 0) 0x7fcf90059930 con 0x7fcf98138fb0 2024-09-19T09:18:10.273 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:10.273 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":35,"btime":"2024-09-19T09:17:25:094931+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1906118343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1906118343},{"type":"v1","addr":"172.21.15.162:6837","nonce":1906118343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1051418414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1051418414},{"type":"v1","addr":"172.21.15.162:6835","nonce":1051418414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5892,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1630984812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630984812},{"type":"v1","addr":"172.21.15.18:6834","nonce":1630984812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:17:22.451890+0000","modified":"2024-09-19T09:17:24.482665+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5895},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5895":{"gid":5895,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/905153716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":905153716},{"type":"v1","addr":"172.21.15.18:6835","nonce":905153716}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5895,"qdb_cluster":[5895]},"id":5}]} 2024-09-19T09:18:10.274 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 35 2024-09-19T09:18:10.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.274+0000 7fcfa016d640 1 -- 172.21.15.18:0/131827511 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcf7c06c2e0 msgr2=0x7fcf7c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:10.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.274+0000 7fcfa016d640 1 --2- 172.21.15.18:0/131827511 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcf7c06c2e0 0x7fcf7c06e7a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fcf94005580 tx=0x7fcf94009040 comp rx=0 tx=0).stop 2024-09-19T09:18:10.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.274+0000 7fcfa016d640 1 -- 172.21.15.18:0/131827511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf98138fb0 msgr2=0x7fcf980cf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:10.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.274+0000 7fcfa016d640 1 --2- 172.21.15.18:0/131827511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf98138fb0 0x7fcf980cf8a0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fcf9806ef50 tx=0x7fcf90007a90 comp rx=0 tx=0).stop 2024-09-19T09:18:10.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.275+0000 7fcfa016d640 1 -- 172.21.15.18:0/131827511 shutdown_connections 2024-09-19T09:18:10.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.275+0000 7fcfa016d640 1 --2- 172.21.15.18:0/131827511 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcf7c06c2e0 0x7fcf7c06e7a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:10.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.275+0000 7fcfa016d640 1 --2- 172.21.15.18:0/131827511 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf98138fb0 0x7fcf980cf8a0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:10.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.275+0000 7fcfa016d640 1 --2- 172.21.15.18:0/131827511 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf98138b30 0x7fcf980cf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:10.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.275+0000 7fcfa016d640 1 --2- 172.21.15.18:0/131827511 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf84006a10 0x7fcf9815a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:10.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.275+0000 7fcfa016d640 1 -- 172.21.15.18:0/131827511 >> 172.21.15.18:0/131827511 conn(0x7fcf9806bc10 msgr2=0x7fcf98140030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:10.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.275+0000 7fcfa016d640 1 -- 172.21.15.18:0/131827511 shutdown_connections 2024-09-19T09:18:10.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.275+0000 7fcfa016d640 1 -- 172.21.15.18:0/131827511 wait complete. 2024-09-19T09:18:10.286 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:18:10.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.388+0000 7f57232c0640 1 Processor -- start 2024-09-19T09:18:10.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.388+0000 7f57232c0640 1 -- start start 2024-09-19T09:18:10.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.389+0000 7f57232c0640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f571c15ee10 0x7f571c0d1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:10.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.389+0000 7f57232c0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f571c0d1c70 0x7f571c0d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:10.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.389+0000 7f57232c0640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f571c0d3300 con 0x7f571c15f1f0 2024-09-19T09:18:10.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.389+0000 7f57232c0640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f571c0d20e0 con 0x7f571c15ee10 2024-09-19T09:18:10.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.389+0000 7f57232c0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f571c0d35e0 con 0x7f571c0d1c70 2024-09-19T09:18:10.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.389+0000 7f572085b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f571c15f1f0 0x7f571c0b4c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:42740/0 (socket says 172.21.15.18:42740) 2024-09-19T09:18:10.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.389+0000 7f572085b640 1 -- 172.21.15.18:0/1905176992 learned_addr learned my addr 172.21.15.18:0/1905176992 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:10.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.389+0000 7f572105c640 1 --2- 172.21.15.18:0/1905176992 >> v2:172.21.15.162:3300/0 conn(0x7f571c15ee10 0x7f571c0d1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:10.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.389+0000 7f572185d640 1 --2- 172.21.15.18:0/1905176992 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f571c0d1c70 0x7f571c0d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:10.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.390+0000 7f571bfff640 1 -- 172.21.15.18:0/1905176992 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4099456654 0 0) 0x7f571c0d3300 con 0x7f571c15f1f0 2024-09-19T09:18:10.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.390+0000 7f571bfff640 1 -- 172.21.15.18:0/1905176992 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5704003520 con 0x7f571c15f1f0 2024-09-19T09:18:10.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.390+0000 7f572105c640 1 -- 172.21.15.18:0/1905176992 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f571c0d1c70 msgr2=0x7f571c0d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:10.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.390+0000 7f572105c640 1 --2- 172.21.15.18:0/1905176992 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f571c0d1c70 0x7f571c0d0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:10.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.390+0000 7f572105c640 1 -- 172.21.15.18:0/1905176992 >> v1:172.21.15.18:6789/0 conn(0x7f571c15f1f0 legacy=0x7f571c0b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:10.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.390+0000 7f571bfff640 1 -- 172.21.15.18:0/1905176992 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 109883397 0 0) 0x7f5704003520 con 0x7f571c15f1f0 2024-09-19T09:18:10.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.390+0000 7f572105c640 1 -- 172.21.15.18:0/1905176992 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571c0d38c0 con 0x7f571c15ee10 2024-09-19T09:18:10.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.390+0000 7f572185d640 1 --2- 172.21.15.18:0/1905176992 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f571c0d1c70 0x7f571c0d0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:18:10.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.391+0000 7f572105c640 1 --2- 172.21.15.18:0/1905176992 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f571c15ee10 0x7f571c0d1730 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f570c009d90 tx=0x7f570c02a560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e6659f3899ef1e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:10.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.391+0000 7f571bfff640 1 -- 172.21.15.18:0/1905176992 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5710001670 con 0x7f571c15ee10 2024-09-19T09:18:10.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.391+0000 7f571bfff640 1 -- 172.21.15.18:0/1905176992 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f570c007540 con 0x7f571c15ee10 2024-09-19T09:18:10.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.391+0000 7f571bfff640 1 -- 172.21.15.18:0/1905176992 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c007910 con 0x7f571c15ee10 2024-09-19T09:18:10.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.391+0000 7f57232c0640 1 -- 172.21.15.18:0/1905176992 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f571c15ee10 msgr2=0x7f571c0d1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:10.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.391+0000 7f57232c0640 1 --2- 172.21.15.18:0/1905176992 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f571c15ee10 0x7f571c0d1730 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f570c009d90 tx=0x7f570c02a560 comp rx=0 tx=0).stop 2024-09-19T09:18:10.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.391+0000 7f57232c0640 1 -- 172.21.15.18:0/1905176992 shutdown_connections 2024-09-19T09:18:10.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.391+0000 7f57232c0640 1 --2- 172.21.15.18:0/1905176992 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f571c0d1c70 0x7f571c0d0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:10.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.391+0000 7f57232c0640 1 --2- 172.21.15.18:0/1905176992 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f571c15ee10 0x7f571c0d1730 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:10.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.391+0000 7f57232c0640 1 -- 172.21.15.18:0/1905176992 >> 172.21.15.18:0/1905176992 conn(0x7f571c0d4d20 msgr2=0x7f571c0d5130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:10.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.391+0000 7f57232c0640 1 -- 172.21.15.18:0/1905176992 shutdown_connections 2024-09-19T09:18:10.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.391+0000 7f57232c0640 1 -- 172.21.15.18:0/1905176992 wait complete. 2024-09-19T09:18:10.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.393+0000 7f57232c0640 1 Processor -- start 2024-09-19T09:18:10.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.393+0000 7f57232c0640 1 -- start start 2024-09-19T09:18:10.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.393+0000 7f57232c0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f571c0d1c70 0x7f571c153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:10.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.393+0000 7f57232c0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f571c15ee10 0x7f571c1f49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:10.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.393+0000 7f57232c0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f571c15f1f0 0x7f571c0b5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:10.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.393+0000 7f57232c0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f571c0d3e80 con 0x7f571c0d1c70 2024-09-19T09:18:10.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.393+0000 7f57232c0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f571c0b4720 con 0x7f571c15f1f0 2024-09-19T09:18:10.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.393+0000 7f57232c0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f571c0d1060 con 0x7f571c15ee10 2024-09-19T09:18:10.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.393+0000 7f572105c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f571c0d1c70 0x7f571c153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:10.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.393+0000 7f572105c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f571c0d1c70 0x7f571c153070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53428/0 (socket says 172.21.15.18:53428) 2024-09-19T09:18:10.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.393+0000 7f572105c640 1 -- 172.21.15.18:0/3365247965 learned_addr learned my addr 172.21.15.18:0/3365247965 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:10.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.394+0000 7f572185d640 1 --2- 172.21.15.18:0/3365247965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f571c15f1f0 0x7f571c0b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:10.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.394+0000 7f572085b640 1 --2- 172.21.15.18:0/3365247965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f571c15ee10 0x7f571c1f49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:10.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.394+0000 7f572105c640 1 -- 172.21.15.18:0/3365247965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f571c15ee10 msgr2=0x7f571c1f49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:10.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.394+0000 7f572105c640 1 --2- 172.21.15.18:0/3365247965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f571c15ee10 0x7f571c1f49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:10.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.394+0000 7f572105c640 1 -- 172.21.15.18:0/3365247965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f571c15f1f0 msgr2=0x7f571c0b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:10.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.394+0000 7f572105c640 1 --2- 172.21.15.18:0/3365247965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f571c15f1f0 0x7f571c0b5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:10.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.394+0000 7f572105c640 1 -- 172.21.15.18:0/3365247965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571c1f5300 con 0x7f571c0d1c70 2024-09-19T09:18:10.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.394+0000 7f572185d640 1 --2- 172.21.15.18:0/3365247965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f571c15f1f0 0x7f571c0b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:10.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.394+0000 7f572105c640 1 --2- 172.21.15.18:0/3365247965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f571c0d1c70 0x7f571c153070 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f570c009d90 tx=0x7f570c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:10.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.394+0000 7f5719ffb640 1 -- 172.21.15.18:0/3365247965 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c040070 con 0x7f571c0d1c70 2024-09-19T09:18:10.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.394+0000 7f5719ffb640 1 -- 172.21.15.18:0/3365247965 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f570c031c40 con 0x7f571c0d1c70 2024-09-19T09:18:10.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.394+0000 7f57232c0640 1 -- 172.21.15.18:0/3365247965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f571c1f55e0 con 0x7f571c0d1c70 2024-09-19T09:18:10.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.394+0000 7f5719ffb640 1 -- 172.21.15.18:0/3365247965 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570c009450 con 0x7f571c0d1c70 2024-09-19T09:18:10.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.394+0000 7f57232c0640 1 -- 172.21.15.18:0/3365247965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f571c1f5ef0 con 0x7f571c0d1c70 2024-09-19T09:18:10.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.395+0000 7f57232c0640 1 -- 172.21.15.18:0/3365247965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f571c0d5a00 con 0x7f571c0d1c70 2024-09-19T09:18:10.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.396+0000 7f5719ffb640 1 -- 172.21.15.18:0/3365247965 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f570c039040 con 0x7f571c0d1c70 2024-09-19T09:18:10.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.397+0000 7f5719ffb640 1 --2- 172.21.15.18:0/3365247965 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f570806c2b0 0x7f570806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:10.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.397+0000 7f5719ffb640 1 -- 172.21.15.18:0/3365247965 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f570c0acc80 con 0x7f571c0d1c70 2024-09-19T09:18:10.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.397+0000 7f5719ffb640 1 -- 172.21.15.18:0/3365247965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=93}) -- 0x7f5708073de0 con 0x7f571c0d1c70 2024-09-19T09:18:10.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.397+0000 7f572085b640 1 --2- 172.21.15.18:0/3365247965 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f570806c2b0 0x7f570806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:10.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.397+0000 7f572085b640 1 --2- 172.21.15.18:0/3365247965 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f570806c2b0 0x7f570806e770 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f571c0b6690 tx=0x7f5710009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:10.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.401+0000 7f5719ffb640 1 -- 172.21.15.18:0/3365247965 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f570c0443c0 con 0x7f571c0d1c70 2024-09-19T09:18:10.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.577+0000 7f57232c0640 1 -- 172.21.15.18:0/3365247965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f571c08e940 con 0x7f571c0d1c70 2024-09-19T09:18:10.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.578+0000 7f5719ffb640 1 -- 172.21.15.18:0/3365247965 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+16769 (secure 0 0 0) 0x7f570c07b3f0 con 0x7f571c0d1c70 2024-09-19T09:18:10.579 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:10.579 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":92,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:17:43.309416+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:17:21.027574+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-19T09:17:21.426866+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["backfillfull","exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["backfillfull","exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["backfillfull","exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:18:10.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.580+0000 7f57232c0640 1 -- 172.21.15.18:0/3365247965 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f570806c2b0 msgr2=0x7f570806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:10.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.580+0000 7f57232c0640 1 --2- 172.21.15.18:0/3365247965 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f570806c2b0 0x7f570806e770 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f571c0b6690 tx=0x7f5710009040 comp rx=0 tx=0).stop 2024-09-19T09:18:10.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.580+0000 7f57232c0640 1 -- 172.21.15.18:0/3365247965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f571c0d1c70 msgr2=0x7f571c153070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:10.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.580+0000 7f57232c0640 1 --2- 172.21.15.18:0/3365247965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f571c0d1c70 0x7f571c153070 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f570c009d90 tx=0x7f570c004a40 comp rx=0 tx=0).stop 2024-09-19T09:18:10.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.580+0000 7f57232c0640 1 -- 172.21.15.18:0/3365247965 shutdown_connections 2024-09-19T09:18:10.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.580+0000 7f57232c0640 1 --2- 172.21.15.18:0/3365247965 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f570806c2b0 0x7f570806e770 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:10.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.580+0000 7f57232c0640 1 --2- 172.21.15.18:0/3365247965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f571c15f1f0 0x7f571c0b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:10.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.580+0000 7f57232c0640 1 --2- 172.21.15.18:0/3365247965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f571c15ee10 0x7f571c1f49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:10.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.580+0000 7f57232c0640 1 --2- 172.21.15.18:0/3365247965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f571c0d1c70 0x7f571c153070 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:10.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.580+0000 7f57232c0640 1 -- 172.21.15.18:0/3365247965 >> 172.21.15.18:0/3365247965 conn(0x7f571c0d4d20 msgr2=0x7f571c0b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:10.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.580+0000 7f57232c0640 1 -- 172.21.15.18:0/3365247965 shutdown_connections 2024-09-19T09:18:10.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.580+0000 7f57232c0640 1 -- 172.21.15.18:0/3365247965 wait complete. 2024-09-19T09:18:10.592 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T09:18:10.592 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:18:10.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.693+0000 7fac00cd0640 1 Processor -- start 2024-09-19T09:18:10.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.693+0000 7fac00cd0640 1 -- start start 2024-09-19T09:18:10.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.694+0000 7fac00cd0640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fabfc0d1ab0 0x7fabfc0b8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:10.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.694+0000 7fac00cd0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabfc0d3240 0x7fabfc0b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:10.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.694+0000 7fac00cd0640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabfc0b7a90 con 0x7fabfc15ef50 2024-09-19T09:18:10.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.694+0000 7fac00cd0640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fabfc0d3740 con 0x7fabfc0d1ab0 2024-09-19T09:18:10.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.694+0000 7fac00cd0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fabfc0d3a20 con 0x7fabfc0d3240 2024-09-19T09:18:10.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.694+0000 7fabfad9d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabfc0d3240 0x7fabfc0b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:10.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.694+0000 7fabf9d9b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fabfc0d1ab0 0x7fabfc0b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:10.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.694+0000 7fabfad9d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabfc0d3240 0x7fabfc0b8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:44026/0 (socket says 172.21.15.18:44026) 2024-09-19T09:18:10.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.694+0000 7fabfa59c640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fabfc15ef50 0x7fabfc0d13a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:54624/0 (socket says 172.21.15.18:54624) 2024-09-19T09:18:10.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.694+0000 7fabfad9d640 1 -- 172.21.15.18:0/2629829264 learned_addr learned my addr 172.21.15.18:0/2629829264 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:10.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.695+0000 7fabf9d9b640 1 -- 172.21.15.18:0/2629829264 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabfc0d3240 msgr2=0x7fabfc0b8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:10.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.695+0000 7fabf9d9b640 1 --2- 172.21.15.18:0/2629829264 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabfc0d3240 0x7fabfc0b8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:10.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.695+0000 7fabf9d9b640 1 -- 172.21.15.18:0/2629829264 >> v1:172.21.15.162:6789/0 conn(0x7fabfc15ef50 legacy=0x7fabfc0d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:10.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.695+0000 7fabf959a640 1 -- 172.21.15.18:0/2629829264 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3997066667 0 0) 0x7fabfc0b7a90 con 0x7fabfc15ef50 2024-09-19T09:18:10.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.695+0000 7fabf9d9b640 1 -- 172.21.15.18:0/2629829264 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabfc0b7d00 con 0x7fabfc0d1ab0 2024-09-19T09:18:10.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.696+0000 7fabf9d9b640 1 --2- 172.21.15.18:0/2629829264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabfc0d1ab0 0x7fabfc0b8500 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fabe40097a0 tx=0x7fabe402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e0f5596e93c5951 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:10.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.696+0000 7fabf959a640 1 -- 172.21.15.18:0/2629829264 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe4037070 con 0x7fabfc0d1ab0 2024-09-19T09:18:10.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.696+0000 7fabf959a640 1 -- 172.21.15.18:0/2629829264 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabe402ae50 con 0x7fabfc0d1ab0 2024-09-19T09:18:10.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.696+0000 7fabf959a640 1 -- 172.21.15.18:0/2629829264 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe4032660 con 0x7fabfc0d1ab0 2024-09-19T09:18:10.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.696+0000 7fac00cd0640 1 -- 172.21.15.18:0/2629829264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabfc0d1ab0 msgr2=0x7fabfc0b8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:10.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.696+0000 7fac00cd0640 1 --2- 172.21.15.18:0/2629829264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabfc0d1ab0 0x7fabfc0b8500 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fabe40097a0 tx=0x7fabe402a100 comp rx=0 tx=0).stop 2024-09-19T09:18:10.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.696+0000 7fac00cd0640 1 -- 172.21.15.18:0/2629829264 shutdown_connections 2024-09-19T09:18:10.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.696+0000 7fac00cd0640 1 --2- 172.21.15.18:0/2629829264 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabfc0d3240 0x7fabfc0b8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:10.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.696+0000 7fac00cd0640 1 --2- 172.21.15.18:0/2629829264 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabfc0d1ab0 0x7fabfc0b8500 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:10.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.696+0000 7fac00cd0640 1 -- 172.21.15.18:0/2629829264 >> 172.21.15.18:0/2629829264 conn(0x7fabfc0d4c60 msgr2=0x7fabfc0d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:10.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.696+0000 7fac00cd0640 1 -- 172.21.15.18:0/2629829264 shutdown_connections 2024-09-19T09:18:10.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.696+0000 7fac00cd0640 1 -- 172.21.15.18:0/2629829264 wait complete. 2024-09-19T09:18:10.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.698+0000 7fac00cd0640 1 Processor -- start 2024-09-19T09:18:10.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.698+0000 7fac00cd0640 1 -- start start 2024-09-19T09:18:10.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.698+0000 7fac00cd0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabfc0d1ab0 0x7fabfc1527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:10.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.699+0000 7fac00cd0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabfc0d3240 0x7fabfc0c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:10.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.699+0000 7fac00cd0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabfc15ef50 0x7fabfc0cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:10.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.699+0000 7fac00cd0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fabfc0d21a0 con 0x7fabfc15ef50 2024-09-19T09:18:10.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.699+0000 7fac00cd0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fabfc0d2020 con 0x7fabfc0d3240 2024-09-19T09:18:10.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.699+0000 7fac00cd0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fabfc0d5780 con 0x7fabfc0d1ab0 2024-09-19T09:18:10.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.699+0000 7fabfad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabfc15ef50 0x7fabfc0cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:10.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.699+0000 7fabfa59c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabfc0d1ab0 0x7fabfc1527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:10.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.699+0000 7fabfad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabfc15ef50 0x7fabfc0cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53432/0 (socket says 172.21.15.18:53432) 2024-09-19T09:18:10.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.699+0000 7fabfad9d640 1 -- 172.21.15.18:0/1641048142 learned_addr learned my addr 172.21.15.18:0/1641048142 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.699+0000 7fabf9d9b640 1 --2- 172.21.15.18:0/1641048142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabfc0d3240 0x7fabfc0c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.699+0000 7fabfad9d640 1 -- 172.21.15.18:0/1641048142 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabfc0d1ab0 msgr2=0x7fabfc1527b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.699+0000 7fabfad9d640 1 --2- 172.21.15.18:0/1641048142 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabfc0d1ab0 0x7fabfc1527b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.699+0000 7fabfad9d640 1 -- 172.21.15.18:0/1641048142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabfc0d3240 msgr2=0x7fabfc0c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.699+0000 7fabfad9d640 1 --2- 172.21.15.18:0/1641048142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabfc0d3240 0x7fabfc0c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.699+0000 7fabfad9d640 1 -- 172.21.15.18:0/1641048142 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabfc0c8830 con 0x7fabfc15ef50 2024-09-19T09:18:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.699+0000 7fabfad9d640 1 --2- 172.21.15.18:0/1641048142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabfc15ef50 0x7fabfc0cbd30 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fabf400e870 tx=0x7fabf400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.699+0000 7fabf2ffd640 1 -- 172.21.15.18:0/1641048142 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf4017070 con 0x7fabfc15ef50 2024-09-19T09:18:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.699+0000 7fabf2ffd640 1 -- 172.21.15.18:0/1641048142 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabf400c940 con 0x7fabfc15ef50 2024-09-19T09:18:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.699+0000 7fabf2ffd640 1 -- 172.21.15.18:0/1641048142 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf400cd10 con 0x7fabfc15ef50 2024-09-19T09:18:10.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.699+0000 7fac00cd0640 1 -- 172.21.15.18:0/1641048142 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabfc0ce880 con 0x7fabfc15ef50 2024-09-19T09:18:10.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.700+0000 7fac00cd0640 1 -- 172.21.15.18:0/1641048142 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabfc0cc900 con 0x7fabfc15ef50 2024-09-19T09:18:10.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.700+0000 7fac00cd0640 1 -- 172.21.15.18:0/1641048142 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabfc0d13a0 con 0x7fabfc15ef50 2024-09-19T09:18:10.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.701+0000 7fabf2ffd640 1 -- 172.21.15.18:0/1641048142 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fabf401a070 con 0x7fabfc15ef50 2024-09-19T09:18:10.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.702+0000 7fabf2ffd640 1 --2- 172.21.15.18:0/1641048142 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fabdc06c2b0 0x7fabdc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:10.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.702+0000 7fabf2ffd640 1 -- 172.21.15.18:0/1641048142 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7fabf408b820 con 0x7fabfc15ef50 2024-09-19T09:18:10.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.702+0000 7fabf2ffd640 1 -- 172.21.15.18:0/1641048142 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=93}) -- 0x7fabdc073de0 con 0x7fabfc15ef50 2024-09-19T09:18:10.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.702+0000 7fabfa59c640 1 --2- 172.21.15.18:0/1641048142 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fabdc06c2b0 0x7fabdc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:10.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.702+0000 7fabfa59c640 1 --2- 172.21.15.18:0/1641048142 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fabdc06c2b0 0x7fabdc06e770 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fabec0012e0 tx=0x7fabec001630 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:10.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.706+0000 7fabf2ffd640 1 -- 172.21.15.18:0/1641048142 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fabf4059810 con 0x7fabfc15ef50 2024-09-19T09:18:10.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.917+0000 7fac00cd0640 1 -- 172.21.15.18:0/1641048142 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fabfc06cb90 con 0x7fabfc15ef50 2024-09-19T09:18:10.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.917+0000 7fabf2ffd640 1 -- 172.21.15.18:0/1641048142 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5228 (secure 0 0 0) 0x7fabf405db10 con 0x7fabfc15ef50 2024-09-19T09:18:10.918 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:10.918 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":35,"btime":"2024-09-19T09:17:25:094931+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1906118343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1906118343},{"type":"v1","addr":"172.21.15.162:6837","nonce":1906118343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1051418414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1051418414},{"type":"v1","addr":"172.21.15.162:6835","nonce":1051418414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5892,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1630984812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630984812},{"type":"v1","addr":"172.21.15.18:6834","nonce":1630984812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:17:22.451890+0000","modified":"2024-09-19T09:17:24.482665+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5895},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5895":{"gid":5895,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/905153716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":905153716},{"type":"v1","addr":"172.21.15.18:6835","nonce":905153716}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5895,"qdb_cluster":[5895]},"id":5}]} 2024-09-19T09:18:10.919 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 35 2024-09-19T09:18:10.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.919+0000 7fac00cd0640 1 -- 172.21.15.18:0/1641048142 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fabdc06c2b0 msgr2=0x7fabdc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:10.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.919+0000 7fac00cd0640 1 --2- 172.21.15.18:0/1641048142 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fabdc06c2b0 0x7fabdc06e770 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fabec0012e0 tx=0x7fabec001630 comp rx=0 tx=0).stop 2024-09-19T09:18:10.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.919+0000 7fac00cd0640 1 -- 172.21.15.18:0/1641048142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabfc15ef50 msgr2=0x7fabfc0cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:10.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.919+0000 7fac00cd0640 1 --2- 172.21.15.18:0/1641048142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabfc15ef50 0x7fabfc0cbd30 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fabf400e870 tx=0x7fabf400ed30 comp rx=0 tx=0).stop 2024-09-19T09:18:10.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.919+0000 7fac00cd0640 1 -- 172.21.15.18:0/1641048142 shutdown_connections 2024-09-19T09:18:10.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.919+0000 7fac00cd0640 1 --2- 172.21.15.18:0/1641048142 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fabdc06c2b0 0x7fabdc06e770 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:10.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.919+0000 7fac00cd0640 1 --2- 172.21.15.18:0/1641048142 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabfc15ef50 0x7fabfc0cbd30 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:10.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.919+0000 7fac00cd0640 1 --2- 172.21.15.18:0/1641048142 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabfc0d3240 0x7fabfc0c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:10.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.919+0000 7fac00cd0640 1 --2- 172.21.15.18:0/1641048142 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabfc0d1ab0 0x7fabfc1527b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:10.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.919+0000 7fac00cd0640 1 -- 172.21.15.18:0/1641048142 >> 172.21.15.18:0/1641048142 conn(0x7fabfc0d4c60 msgr2=0x7fabfc0b8470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:10.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.919+0000 7fac00cd0640 1 -- 172.21.15.18:0/1641048142 shutdown_connections 2024-09-19T09:18:10.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:10.919+0000 7fac00cd0640 1 -- 172.21.15.18:0/1641048142 wait complete. 2024-09-19T09:18:10.931 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:18:11.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.032+0000 7fc26a27b640 1 Processor -- start 2024-09-19T09:18:11.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.032+0000 7fc26a27b640 1 -- start start 2024-09-19T09:18:11.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.033+0000 7fc26a27b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc264145290 0x7fc26406f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:11.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.033+0000 7fc26a27b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc26406e3d0 con 0x7fc2640ce780 2024-09-19T09:18:11.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.033+0000 7fc26a27b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc26406e6b0 con 0x7fc264072f40 2024-09-19T09:18:11.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.033+0000 7fc26a27b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc26406efe0 con 0x7fc264145290 2024-09-19T09:18:11.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.033+0000 7fc2637fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc2640ce780 0x7fc264072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:42746/0 (socket says 172.21.15.18:42746) 2024-09-19T09:18:11.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.033+0000 7fc2637fe640 1 -- 172.21.15.18:0/2912235782 learned_addr learned my addr 172.21.15.18:0/2912235782 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:11.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.033+0000 7fc263fff640 1 --2- 172.21.15.18:0/2912235782 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc264145290 0x7fc26406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:11.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.033+0000 7fc262ffd640 1 -- 172.21.15.18:0/2912235782 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3547518569 0 0) 0x7fc26406e3d0 con 0x7fc2640ce780 2024-09-19T09:18:11.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.033+0000 7fc262ffd640 1 -- 172.21.15.18:0/2912235782 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc24c005730 con 0x7fc2640ce780 2024-09-19T09:18:11.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.033+0000 7fc262ffd640 1 -- 172.21.15.18:0/2912235782 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2216571782 0 0) 0x7fc26406e6b0 con 0x7fc264072f40 2024-09-19T09:18:11.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.033+0000 7fc262ffd640 1 -- 172.21.15.18:0/2912235782 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc26406e3d0 con 0x7fc264072f40 2024-09-19T09:18:11.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.034+0000 7fc263fff640 1 -- 172.21.15.18:0/2912235782 >> v1:172.21.15.162:6789/0 conn(0x7fc264072f40 legacy=0x7fc2640b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:11.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.034+0000 7fc263fff640 1 -- 172.21.15.18:0/2912235782 >> v1:172.21.15.18:6789/0 conn(0x7fc2640ce780 legacy=0x7fc264072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:11.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.034+0000 7fc263fff640 1 -- 172.21.15.18:0/2912235782 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc26406e990 con 0x7fc264145290 2024-09-19T09:18:11.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.034+0000 7fc263fff640 1 --2- 172.21.15.18:0/2912235782 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc264145290 0x7fc26406f470 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc2540097d0 tx=0x7fc25402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=379cd2a1d31e852c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:11.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.034+0000 7fc262ffd640 1 -- 172.21.15.18:0/2912235782 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc254037070 con 0x7fc264145290 2024-09-19T09:18:11.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.035+0000 7fc262ffd640 1 -- 172.21.15.18:0/2912235782 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc254032440 con 0x7fc264145290 2024-09-19T09:18:11.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.035+0000 7fc262ffd640 1 -- 172.21.15.18:0/2912235782 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2540327f0 con 0x7fc264145290 2024-09-19T09:18:11.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.035+0000 7fc26a27b640 1 -- 172.21.15.18:0/2912235782 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc264145290 msgr2=0x7fc26406f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:11.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.035+0000 7fc26a27b640 1 --2- 172.21.15.18:0/2912235782 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc264145290 0x7fc26406f470 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc2540097d0 tx=0x7fc25402a210 comp rx=0 tx=0).stop 2024-09-19T09:18:11.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.035+0000 7fc26a27b640 1 -- 172.21.15.18:0/2912235782 shutdown_connections 2024-09-19T09:18:11.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.035+0000 7fc26a27b640 1 --2- 172.21.15.18:0/2912235782 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc264145290 0x7fc26406f470 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.035+0000 7fc26a27b640 1 -- 172.21.15.18:0/2912235782 >> 172.21.15.18:0/2912235782 conn(0x7fc26406bc10 msgr2=0x7fc26406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:11.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.035+0000 7fc26a27b640 1 -- 172.21.15.18:0/2912235782 shutdown_connections 2024-09-19T09:18:11.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.035+0000 7fc26a27b640 1 -- 172.21.15.18:0/2912235782 wait complete. 2024-09-19T09:18:11.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.036+0000 7fc26a27b640 1 Processor -- start 2024-09-19T09:18:11.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.037+0000 7fc26a27b640 1 -- start start 2024-09-19T09:18:11.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.037+0000 7fc26a27b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc264072f40 0x7fc264140880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:11.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.037+0000 7fc26a27b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2640ce780 0x7fc2641415b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:11.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.037+0000 7fc26a27b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc264145290 0x7fc264137020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:11.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.037+0000 7fc26a27b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc26406df80 con 0x7fc2640ce780 2024-09-19T09:18:11.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.037+0000 7fc26a27b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc264145670 con 0x7fc264145290 2024-09-19T09:18:11.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.037+0000 7fc26a27b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc26406e100 con 0x7fc264072f40 2024-09-19T09:18:11.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.037+0000 7fc2637fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2640ce780 0x7fc2641415b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:11.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.037+0000 7fc2637fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2640ce780 0x7fc2641415b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53434/0 (socket says 172.21.15.18:53434) 2024-09-19T09:18:11.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.037+0000 7fc2637fe640 1 -- 172.21.15.18:0/116728632 learned_addr learned my addr 172.21.15.18:0/116728632 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:11.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.038+0000 7fc263fff640 1 --2- 172.21.15.18:0/116728632 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc264072f40 0x7fc264140880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:11.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.038+0000 7fc268818640 1 --2- 172.21.15.18:0/116728632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc264145290 0x7fc264137020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:11.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.038+0000 7fc2637fe640 1 -- 172.21.15.18:0/116728632 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc264072f40 msgr2=0x7fc264140880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:11.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.038+0000 7fc2637fe640 1 --2- 172.21.15.18:0/116728632 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc264072f40 0x7fc264140880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.038+0000 7fc2637fe640 1 -- 172.21.15.18:0/116728632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc264145290 msgr2=0x7fc264137020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:11.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.038+0000 7fc2637fe640 1 --2- 172.21.15.18:0/116728632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc264145290 0x7fc264137020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.038+0000 7fc2637fe640 1 -- 172.21.15.18:0/116728632 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc264141f20 con 0x7fc2640ce780 2024-09-19T09:18:11.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.038+0000 7fc2637fe640 1 --2- 172.21.15.18:0/116728632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2640ce780 0x7fc2641415b0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fc25800c3e0 tx=0x7fc25800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:11.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.038+0000 7fc260ff9640 1 -- 172.21.15.18:0/116728632 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc258017070 con 0x7fc2640ce780 2024-09-19T09:18:11.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.038+0000 7fc260ff9640 1 -- 172.21.15.18:0/116728632 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc258005ce0 con 0x7fc2640ce780 2024-09-19T09:18:11.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.038+0000 7fc26a27b640 1 -- 172.21.15.18:0/116728632 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc264142200 con 0x7fc2640ce780 2024-09-19T09:18:11.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.038+0000 7fc260ff9640 1 -- 172.21.15.18:0/116728632 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2580072d0 con 0x7fc2640ce780 2024-09-19T09:18:11.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.038+0000 7fc26a27b640 1 -- 172.21.15.18:0/116728632 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc264140dc0 con 0x7fc2640ce780 2024-09-19T09:18:11.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.039+0000 7fc26a27b640 1 -- 172.21.15.18:0/116728632 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc264071d60 con 0x7fc2640ce780 2024-09-19T09:18:11.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.040+0000 7fc260ff9640 1 -- 172.21.15.18:0/116728632 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc25801a070 con 0x7fc2640ce780 2024-09-19T09:18:11.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.040+0000 7fc260ff9640 1 --2- 172.21.15.18:0/116728632 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc25006c2b0 0x7fc25006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:11.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.040+0000 7fc260ff9640 1 -- 172.21.15.18:0/116728632 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7fc25808a6d0 con 0x7fc2640ce780 2024-09-19T09:18:11.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.040+0000 7fc263fff640 1 --2- 172.21.15.18:0/116728632 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc25006c2b0 0x7fc25006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:11.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.041+0000 7fc260ff9640 1 -- 172.21.15.18:0/116728632 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=93}) -- 0x7fc250073de0 con 0x7fc2640ce780 2024-09-19T09:18:11.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.041+0000 7fc263fff640 1 --2- 172.21.15.18:0/116728632 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc25006c2b0 0x7fc25006e770 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc254034000 tx=0x7fc25402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:11.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.045+0000 7fc260ff9640 1 -- 172.21.15.18:0/116728632 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc258058880 con 0x7fc2640ce780 2024-09-19T09:18:11.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.261+0000 7fc26a27b640 1 -- 172.21.15.18:0/116728632 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc264142590 con 0x7fc2640ce780 2024-09-19T09:18:11.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.261+0000 7fc260ff9640 1 -- 172.21.15.18:0/116728632 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5228 (secure 0 0 0) 0x7fc25805cb80 con 0x7fc2640ce780 2024-09-19T09:18:11.262 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:11.263 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":35,"btime":"2024-09-19T09:17:25:094931+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1906118343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1906118343},{"type":"v1","addr":"172.21.15.162:6837","nonce":1906118343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1051418414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1051418414},{"type":"v1","addr":"172.21.15.162:6835","nonce":1051418414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5892,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1630984812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630984812},{"type":"v1","addr":"172.21.15.18:6834","nonce":1630984812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:17:22.451890+0000","modified":"2024-09-19T09:17:24.482665+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5895},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5895":{"gid":5895,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/905153716","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":905153716},{"type":"v1","addr":"172.21.15.18:6835","nonce":905153716}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5895,"qdb_cluster":[5895]},"id":5}]} 2024-09-19T09:18:11.263 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 35 2024-09-19T09:18:11.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.263+0000 7fc26a27b640 1 -- 172.21.15.18:0/116728632 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc25006c2b0 msgr2=0x7fc25006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:11.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.263+0000 7fc26a27b640 1 --2- 172.21.15.18:0/116728632 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc25006c2b0 0x7fc25006e770 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc254034000 tx=0x7fc25402e000 comp rx=0 tx=0).stop 2024-09-19T09:18:11.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.263+0000 7fc26a27b640 1 -- 172.21.15.18:0/116728632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2640ce780 msgr2=0x7fc2641415b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:11.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.263+0000 7fc26a27b640 1 --2- 172.21.15.18:0/116728632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2640ce780 0x7fc2641415b0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fc25800c3e0 tx=0x7fc25800c8a0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.263+0000 7fc26a27b640 1 -- 172.21.15.18:0/116728632 shutdown_connections 2024-09-19T09:18:11.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.263+0000 7fc26a27b640 1 --2- 172.21.15.18:0/116728632 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc25006c2b0 0x7fc25006e770 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.263+0000 7fc26a27b640 1 --2- 172.21.15.18:0/116728632 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc264145290 0x7fc264137020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.263+0000 7fc26a27b640 1 --2- 172.21.15.18:0/116728632 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc2640ce780 0x7fc2641415b0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.263+0000 7fc26a27b640 1 --2- 172.21.15.18:0/116728632 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc264072f40 0x7fc264140880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.263+0000 7fc26a27b640 1 -- 172.21.15.18:0/116728632 >> 172.21.15.18:0/116728632 conn(0x7fc26406bc10 msgr2=0x7fc2640b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:11.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.264+0000 7fc26a27b640 1 -- 172.21.15.18:0/116728632 shutdown_connections 2024-09-19T09:18:11.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.264+0000 7fc26a27b640 1 -- 172.21.15.18:0/116728632 wait complete. 2024-09-19T09:18:11.275 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:18:11.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.377+0000 7f36b9b86640 1 Processor -- start 2024-09-19T09:18:11.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.377+0000 7f36b9b86640 1 -- start start 2024-09-19T09:18:11.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.378+0000 7f36b9b86640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f36b406d730 0x7f36b40b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:11.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.378+0000 7f36b9b86640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36b40cd1a0 con 0x7f36b40cfae0 2024-09-19T09:18:11.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.378+0000 7f36b9b86640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36b406dc30 con 0x7f36b415ef80 2024-09-19T09:18:11.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.378+0000 7f36b9b86640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f36b40cd7d0 con 0x7f36b406d730 2024-09-19T09:18:11.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.378+0000 7f36aaffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f36b40cfae0 0x7f36b40cdc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:42760/0 (socket says 172.21.15.18:42760) 2024-09-19T09:18:11.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.378+0000 7f36aaffd640 1 -- 172.21.15.18:0/2634661781 learned_addr learned my addr 172.21.15.18:0/2634661781 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:11.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.379+0000 7f36b2ffd640 1 -- 172.21.15.18:0/2634661781 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1220149143 0 0) 0x7f36b40cd1a0 con 0x7f36b40cfae0 2024-09-19T09:18:11.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.379+0000 7f36b3fff640 1 --2- 172.21.15.18:0/2634661781 >> v2:172.21.15.162:3300/0 conn(0x7f36b406d730 0x7f36b40b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:11.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.379+0000 7f36b2ffd640 1 -- 172.21.15.18:0/2634661781 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36a0003520 con 0x7f36b40cfae0 2024-09-19T09:18:11.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.379+0000 7f36b2ffd640 1 -- 172.21.15.18:0/2634661781 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1870001978 0 0) 0x7f36a0003520 con 0x7f36b40cfae0 2024-09-19T09:18:11.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.379+0000 7f36b2ffd640 1 -- 172.21.15.18:0/2634661781 >> v2:172.21.15.162:3300/0 conn(0x7f36b406d730 msgr2=0x7f36b40b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:11.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.379+0000 7f36b2ffd640 1 --2- 172.21.15.18:0/2634661781 >> v2:172.21.15.162:3300/0 conn(0x7f36b406d730 0x7f36b40b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.379+0000 7f36b2ffd640 1 -- 172.21.15.18:0/2634661781 >> v1:172.21.15.162:6789/0 conn(0x7f36b415ef80 legacy=0x7f36b40cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:11.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.379+0000 7f36b2ffd640 1 -- 172.21.15.18:0/2634661781 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36b406df10 con 0x7f36b40cfae0 2024-09-19T09:18:11.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.379+0000 7f36b2ffd640 1 -- 172.21.15.18:0/2634661781 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f369c001670 con 0x7f36b40cfae0 2024-09-19T09:18:11.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.379+0000 7f36b2ffd640 1 -- 172.21.15.18:0/2634661781 >> v1:172.21.15.18:6789/0 conn(0x7f36b40cfae0 legacy=0x7f36b40cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:11.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.379+0000 7f36b2ffd640 1 --2- 172.21.15.18:0/2634661781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36a00039b0 0x7f36a0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:11.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.379+0000 7f36b2ffd640 1 --2- 172.21.15.18:0/2634661781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36a0004800 0x7f36a0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:11.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.379+0000 7f36b2ffd640 1 --2- 172.21.15.18:0/2634661781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36a00051c0 0x7f36a000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:11.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.379+0000 7f36b2ffd640 1 -- 172.21.15.18:0/2634661781 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f36b40cd7d0 con 0x7f36a0004800 2024-09-19T09:18:11.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.379+0000 7f36b2ffd640 1 -- 172.21.15.18:0/2634661781 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f36a000c060 con 0x7f36a00039b0 2024-09-19T09:18:11.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.379+0000 7f36b2ffd640 1 -- 172.21.15.18:0/2634661781 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f36a000c260 con 0x7f36a00051c0 2024-09-19T09:18:11.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.379+0000 7f36aaffd640 1 --2- 172.21.15.18:0/2634661781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36a0004800 0x7f36a0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:11.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.379+0000 7f36b37fe640 1 --2- 172.21.15.18:0/2634661781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36a00039b0 0x7f36a0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:11.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.379+0000 7f36b3fff640 1 --2- 172.21.15.18:0/2634661781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36a00051c0 0x7f36a000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:11.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.379+0000 7f36aaffd640 1 -- 172.21.15.18:0/2634661781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36a00051c0 msgr2=0x7f36a000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:11.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.379+0000 7f36aaffd640 1 --2- 172.21.15.18:0/2634661781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36a00051c0 0x7f36a000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.379+0000 7f36aaffd640 1 -- 172.21.15.18:0/2634661781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36a00039b0 msgr2=0x7f36a0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:11.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.379+0000 7f36aaffd640 1 --2- 172.21.15.18:0/2634661781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36a00039b0 0x7f36a0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.379+0000 7f36aaffd640 1 -- 172.21.15.18:0/2634661781 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a0003520 con 0x7f36a0004800 2024-09-19T09:18:11.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.379+0000 7f36b3fff640 1 --2- 172.21.15.18:0/2634661781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36a00051c0 0x7f36a000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:11.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.379+0000 7f36b37fe640 1 --2- 172.21.15.18:0/2634661781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36a00039b0 0x7f36a0003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:11.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.379+0000 7f36b3fff640 1 -- 172.21.15.18:0/2634661781 reap_dead start 2024-09-19T09:18:11.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.380+0000 7f36aaffd640 1 --2- 172.21.15.18:0/2634661781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36a0004800 0x7f36a0004c80 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f369c00c210 tx=0x7f36a0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f26a44ee7409f80 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:11.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.380+0000 7f36b2ffd640 1 -- 172.21.15.18:0/2634661781 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369c007d30 con 0x7f36a0004800 2024-09-19T09:18:11.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.380+0000 7f36b2ffd640 1 -- 172.21.15.18:0/2634661781 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f369c005af0 con 0x7f36a0004800 2024-09-19T09:18:11.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.380+0000 7f36b2ffd640 1 -- 172.21.15.18:0/2634661781 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369c007070 con 0x7f36a0004800 2024-09-19T09:18:11.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.381+0000 7f36b9b86640 1 -- 172.21.15.18:0/2634661781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36a0004800 msgr2=0x7f36a0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:11.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.381+0000 7f36b9b86640 1 --2- 172.21.15.18:0/2634661781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36a0004800 0x7f36a0004c80 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f369c00c210 tx=0x7f36a0005830 comp rx=0 tx=0).stop 2024-09-19T09:18:11.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.381+0000 7f36b9b86640 1 -- 172.21.15.18:0/2634661781 shutdown_connections 2024-09-19T09:18:11.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.381+0000 7f36b9b86640 1 --2- 172.21.15.18:0/2634661781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36a0004800 0x7f36a0004c80 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.381+0000 7f36b9b86640 1 -- 172.21.15.18:0/2634661781 >> 172.21.15.18:0/2634661781 conn(0x7f36b40b4700 msgr2=0x7f36b40b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:11.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.381+0000 7f36b9b86640 1 -- 172.21.15.18:0/2634661781 shutdown_connections 2024-09-19T09:18:11.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.381+0000 7f36b9b86640 1 -- 172.21.15.18:0/2634661781 wait complete. 2024-09-19T09:18:11.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.382+0000 7f36b9b86640 1 Processor -- start 2024-09-19T09:18:11.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.382+0000 7f36b9b86640 1 -- start start 2024-09-19T09:18:11.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.383+0000 7f36b9b86640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36a0004800 0x7f36b415d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:11.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.383+0000 7f36b9b86640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36b415dcf0 0x7f36b40b81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:11.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.383+0000 7f36b9b86640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36b40b86f0 0x7f36b40b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:11.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.383+0000 7f36b9b86640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f36b40d0120 con 0x7f36b40b86f0 2024-09-19T09:18:11.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.383+0000 7f36b9b86640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f36b415f360 con 0x7f36b415dcf0 2024-09-19T09:18:11.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.383+0000 7f36b9b86640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f36b40b5220 con 0x7f36a0004800 2024-09-19T09:18:11.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.383+0000 7f36b3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36b40b86f0 0x7f36b40b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:11.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.383+0000 7f36b3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36b40b86f0 0x7f36b40b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53456/0 (socket says 172.21.15.18:53456) 2024-09-19T09:18:11.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.383+0000 7f36b3fff640 1 -- 172.21.15.18:0/1231292481 learned_addr learned my addr 172.21.15.18:0/1231292481 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:11.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.383+0000 7f36aaffd640 1 --2- 172.21.15.18:0/1231292481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36b415dcf0 0x7f36b40b81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:11.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.383+0000 7f36b37fe640 1 --2- 172.21.15.18:0/1231292481 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36a0004800 0x7f36b415d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:11.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.383+0000 7f36b3fff640 1 -- 172.21.15.18:0/1231292481 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36a0004800 msgr2=0x7f36b415d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:11.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.383+0000 7f36b3fff640 1 --2- 172.21.15.18:0/1231292481 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36a0004800 0x7f36b415d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.383+0000 7f36b3fff640 1 -- 172.21.15.18:0/1231292481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36b415dcf0 msgr2=0x7f36b40b81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:11.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.383+0000 7f36b3fff640 1 --2- 172.21.15.18:0/1231292481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36b415dcf0 0x7f36b40b81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.383+0000 7f36b3fff640 1 -- 172.21.15.18:0/1231292481 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36b40b67c0 con 0x7f36b40b86f0 2024-09-19T09:18:11.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.383+0000 7f36b37fe640 1 --2- 172.21.15.18:0/1231292481 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36a0004800 0x7f36b415d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:11.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.384+0000 7f36b3fff640 1 --2- 172.21.15.18:0/1231292481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36b40b86f0 0x7f36b40b5a70 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f36b40727c0 tx=0x7f36ac010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:11.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.384+0000 7f36b0ff9640 1 -- 172.21.15.18:0/1231292481 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac01a030 con 0x7f36b40b86f0 2024-09-19T09:18:11.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.384+0000 7f36b0ff9640 1 -- 172.21.15.18:0/1231292481 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36ac010e00 con 0x7f36b40b86f0 2024-09-19T09:18:11.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.384+0000 7f36b9b86640 1 -- 172.21.15.18:0/1231292481 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36b40b6aa0 con 0x7f36b40b86f0 2024-09-19T09:18:11.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.384+0000 7f36b0ff9640 1 -- 172.21.15.18:0/1231292481 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac003bd0 con 0x7f36b40b86f0 2024-09-19T09:18:11.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.384+0000 7f36b9b86640 1 -- 172.21.15.18:0/1231292481 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36b40b7060 con 0x7f36b40b86f0 2024-09-19T09:18:11.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.385+0000 7f36b9b86640 1 -- 172.21.15.18:0/1231292481 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36b40b7440 con 0x7f36b40b86f0 2024-09-19T09:18:11.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.385+0000 7f36b0ff9640 1 -- 172.21.15.18:0/1231292481 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f36ac01d070 con 0x7f36b40b86f0 2024-09-19T09:18:11.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.386+0000 7f36b0ff9640 1 --2- 172.21.15.18:0/1231292481 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f369406c2e0 0x7f369406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:11.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.386+0000 7f36b0ff9640 1 -- 172.21.15.18:0/1231292481 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f36ac08ba80 con 0x7f36b40b86f0 2024-09-19T09:18:11.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.386+0000 7f36b0ff9640 1 -- 172.21.15.18:0/1231292481 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=93}) -- 0x7f3694073e70 con 0x7f36b40b86f0 2024-09-19T09:18:11.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.386+0000 7f36b37fe640 1 --2- 172.21.15.18:0/1231292481 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f369406c2e0 0x7f369406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:11.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.387+0000 7f36b37fe640 1 --2- 172.21.15.18:0/1231292481 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f369406c2e0 0x7f369406e7a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f36a4000c00 tx=0x7f36a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:11.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.390+0000 7f36b0ff9640 1 -- 172.21.15.18:0/1231292481 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f36b40b7440 con 0x7f36b40b86f0 2024-09-19T09:18:11.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.566+0000 7f36b9b86640 1 -- 172.21.15.18:0/1231292481 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f36b41f4db0 con 0x7f36b40b86f0 2024-09-19T09:18:11.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.568+0000 7f36b0ff9640 1 -- 172.21.15.18:0/1231292481 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+16769 (secure 0 0 0) 0x7f36ac05a280 con 0x7f36b40b86f0 2024-09-19T09:18:11.568 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:11.569 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":92,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:17:43.309416+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:17:21.027574+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-19T09:17:21.426866+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["backfillfull","exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["backfillfull","exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["backfillfull","exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:18:11.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.569+0000 7f36b9b86640 1 -- 172.21.15.18:0/1231292481 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f369406c2e0 msgr2=0x7f369406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:11.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.570+0000 7f36b9b86640 1 --2- 172.21.15.18:0/1231292481 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f369406c2e0 0x7f369406e7a0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f36a4000c00 tx=0x7f36a4009040 comp rx=0 tx=0).stop 2024-09-19T09:18:11.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.570+0000 7f36b9b86640 1 -- 172.21.15.18:0/1231292481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36b40b86f0 msgr2=0x7f36b40b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:11.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.570+0000 7f36b9b86640 1 --2- 172.21.15.18:0/1231292481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36b40b86f0 0x7f36b40b5a70 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f36b40727c0 tx=0x7f36ac010590 comp rx=0 tx=0).stop 2024-09-19T09:18:11.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.570+0000 7f36b9b86640 1 -- 172.21.15.18:0/1231292481 shutdown_connections 2024-09-19T09:18:11.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.570+0000 7f36b9b86640 1 --2- 172.21.15.18:0/1231292481 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f369406c2e0 0x7f369406e7a0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.570+0000 7f36b9b86640 1 --2- 172.21.15.18:0/1231292481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36b40b86f0 0x7f36b40b5a70 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.570+0000 7f36b9b86640 1 --2- 172.21.15.18:0/1231292481 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36b415dcf0 0x7f36b40b81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.570+0000 7f36b9b86640 1 --2- 172.21.15.18:0/1231292481 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36a0004800 0x7f36b415d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.570+0000 7f36b9b86640 1 -- 172.21.15.18:0/1231292481 >> 172.21.15.18:0/1231292481 conn(0x7f36b40b4700 msgr2=0x7f36b4070fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:11.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.570+0000 7f36b9b86640 1 -- 172.21.15.18:0/1231292481 shutdown_connections 2024-09-19T09:18:11.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.570+0000 7f36b9b86640 1 -- 172.21.15.18:0/1231292481 wait complete. 2024-09-19T09:18:11.583 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-19T09:18:11.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.686+0000 7f51264dd640 1 Processor -- start 2024-09-19T09:18:11.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.686+0000 7f51264dd640 1 -- start start 2024-09-19T09:18:11.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.687+0000 7f51264dd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f512015eda0 0x7f51200d5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:11.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.687+0000 7f51264dd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f51200d0480 0x7f51200d35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:11.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.687+0000 7f51264dd640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51200d0bf0 con 0x7f51200d3af0 2024-09-19T09:18:11.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.687+0000 7f51264dd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f51200d2880 con 0x7f51200d0480 2024-09-19T09:18:11.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.687+0000 7f51264dd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f51200d3120 con 0x7f512015eda0 2024-09-19T09:18:11.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.687+0000 7f511f7fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f51200d0480 0x7f51200d35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:11.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.687+0000 7f511ffff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f512015eda0 0x7f51200d5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.687+0000 7f5124a7a640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f51200d3af0 0x7f51200d1630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:54648/0 (socket says 172.21.15.18:54648) 2024-09-19T09:18:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.687+0000 7f511f7fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f51200d0480 0x7f51200d35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:44576/0 (socket says 172.21.15.18:44576) 2024-09-19T09:18:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.687+0000 7f5124a7a640 1 -- 172.21.15.18:0/2699329927 learned_addr learned my addr 172.21.15.18:0/2699329927 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.687+0000 7f511f7fe640 1 -- 172.21.15.18:0/2699329927 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f512015eda0 msgr2=0x7f51200d5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.687+0000 7f511f7fe640 1 --2- 172.21.15.18:0/2699329927 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f512015eda0 0x7f51200d5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.687+0000 7f511f7fe640 1 -- 172.21.15.18:0/2699329927 >> v1:172.21.15.162:6789/0 conn(0x7f51200d3af0 legacy=0x7f51200d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.687+0000 7f511f7fe640 1 -- 172.21.15.18:0/2699329927 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51200d2ad0 con 0x7f51200d0480 2024-09-19T09:18:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.687+0000 7f511effd640 1 -- 172.21.15.18:0/2699329927 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1779409142 0 0) 0x7f51200d0bf0 con 0x7f51200d3af0 2024-09-19T09:18:11.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.688+0000 7f511ffff640 1 --2- 172.21.15.18:0/2699329927 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f512015eda0 0x7f51200d5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:18:11.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.688+0000 7f511f7fe640 1 --2- 172.21.15.18:0/2699329927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51200d0480 0x7f51200d35b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f51140097a0 tx=0x7f511402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be295f42a3b7a29e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:11.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.688+0000 7f511effd640 1 -- 172.21.15.18:0/2699329927 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5114037070 con 0x7f51200d0480 2024-09-19T09:18:11.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.689+0000 7f511effd640 1 -- 172.21.15.18:0/2699329927 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5114032440 con 0x7f51200d0480 2024-09-19T09:18:11.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.689+0000 7f511effd640 1 -- 172.21.15.18:0/2699329927 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5114032810 con 0x7f51200d0480 2024-09-19T09:18:11.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.689+0000 7f51264dd640 1 -- 172.21.15.18:0/2699329927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51200d0480 msgr2=0x7f51200d35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:11.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.689+0000 7f51264dd640 1 --2- 172.21.15.18:0/2699329927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51200d0480 0x7f51200d35b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f51140097a0 tx=0x7f511402a180 comp rx=0 tx=0).stop 2024-09-19T09:18:11.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.689+0000 7f51264dd640 1 -- 172.21.15.18:0/2699329927 shutdown_connections 2024-09-19T09:18:11.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.689+0000 7f51264dd640 1 --2- 172.21.15.18:0/2699329927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51200d0480 0x7f51200d35b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.689+0000 7f51264dd640 1 --2- 172.21.15.18:0/2699329927 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f512015eda0 0x7f51200d5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.689+0000 7f51264dd640 1 -- 172.21.15.18:0/2699329927 >> 172.21.15.18:0/2699329927 conn(0x7f512009df40 msgr2=0x7f51200d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:11.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.689+0000 7f51264dd640 1 -- 172.21.15.18:0/2699329927 shutdown_connections 2024-09-19T09:18:11.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.689+0000 7f51264dd640 1 -- 172.21.15.18:0/2699329927 wait complete. 2024-09-19T09:18:11.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.690+0000 7f51264dd640 1 Processor -- start 2024-09-19T09:18:11.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.690+0000 7f51264dd640 1 -- start start 2024-09-19T09:18:11.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.691+0000 7f51264dd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51200d0480 0x7f51200c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:11.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.691+0000 7f51264dd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f512015eda0 0x7f51200cac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:11.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.691+0000 7f51264dd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51200cb1a0 0x7f5120162990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:11.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.691+0000 7f51264dd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f512015f180 con 0x7f51200cb1a0 2024-09-19T09:18:11.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.691+0000 7f51264dd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f51200d08c0 con 0x7f512015eda0 2024-09-19T09:18:11.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.691+0000 7f51264dd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f512015f300 con 0x7f51200d0480 2024-09-19T09:18:11.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.691+0000 7f5124a7a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51200cb1a0 0x7f5120162990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:11.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.691+0000 7f5124a7a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51200cb1a0 0x7f5120162990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53458/0 (socket says 172.21.15.18:53458) 2024-09-19T09:18:11.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.691+0000 7f5124a7a640 1 -- 172.21.15.18:0/1910985533 learned_addr learned my addr 172.21.15.18:0/1910985533 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:11.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.691+0000 7f511f7fe640 1 --2- 172.21.15.18:0/1910985533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f512015eda0 0x7f51200cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:11.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.691+0000 7f511ffff640 1 --2- 172.21.15.18:0/1910985533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51200d0480 0x7f51200c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:11.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.692+0000 7f5124a7a640 1 -- 172.21.15.18:0/1910985533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51200d0480 msgr2=0x7f51200c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:11.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.692+0000 7f5124a7a640 1 --2- 172.21.15.18:0/1910985533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51200d0480 0x7f51200c9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.692+0000 7f5124a7a640 1 -- 172.21.15.18:0/1910985533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f512015eda0 msgr2=0x7f51200cac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:11.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.692+0000 7f5124a7a640 1 --2- 172.21.15.18:0/1910985533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f512015eda0 0x7f51200cac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.692+0000 7f5124a7a640 1 -- 172.21.15.18:0/1910985533 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5120160dc0 con 0x7f51200cb1a0 2024-09-19T09:18:11.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.692+0000 7f5124a7a640 1 --2- 172.21.15.18:0/1910985533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51200cb1a0 0x7f5120162990 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f511800c7a0 tx=0x7f511800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:11.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.692+0000 7f511cff9640 1 -- 172.21.15.18:0/1910985533 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5118018070 con 0x7f51200cb1a0 2024-09-19T09:18:11.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.692+0000 7f511cff9640 1 -- 172.21.15.18:0/1910985533 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f511800a640 con 0x7f51200cb1a0 2024-09-19T09:18:11.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.692+0000 7f51264dd640 1 -- 172.21.15.18:0/1910985533 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51201610a0 con 0x7f51200cb1a0 2024-09-19T09:18:11.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.692+0000 7f511cff9640 1 -- 172.21.15.18:0/1910985533 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f511800aab0 con 0x7f51200cb1a0 2024-09-19T09:18:11.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.692+0000 7f51264dd640 1 -- 172.21.15.18:0/1910985533 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5120161660 con 0x7f51200cb1a0 2024-09-19T09:18:11.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.693+0000 7f51264dd640 1 -- 172.21.15.18:0/1910985533 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51200d35b0 con 0x7f51200cb1a0 2024-09-19T09:18:11.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.694+0000 7f511cff9640 1 -- 172.21.15.18:0/1910985533 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f511800ac50 con 0x7f51200cb1a0 2024-09-19T09:18:11.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.694+0000 7f511cff9640 1 --2- 172.21.15.18:0/1910985533 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f510c06c2b0 0x7f510c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:11.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.694+0000 7f511cff9640 1 -- 172.21.15.18:0/1910985533 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5709+0+0 (secure 0 0 0) 0x7f511808aa70 con 0x7f51200cb1a0 2024-09-19T09:18:11.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.694+0000 7f511ffff640 1 --2- 172.21.15.18:0/1910985533 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f510c06c2b0 0x7f510c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:11.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.694+0000 7f511cff9640 1 -- 172.21.15.18:0/1910985533 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=93}) -- 0x7f510c073de0 con 0x7f51200cb1a0 2024-09-19T09:18:11.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.695+0000 7f511ffff640 1 --2- 172.21.15.18:0/1910985533 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f510c06c2b0 0x7f510c06e770 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5110009560 tx=0x7f5110009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:11.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.698+0000 7f511cff9640 1 -- 172.21.15.18:0/1910985533 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5118058b00 con 0x7f51200cb1a0 2024-09-19T09:18:11.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.908+0000 7f51264dd640 1 -- 172.21.15.18:0/1910985533 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f51200d2330 con 0x7f51200cb1a0 2024-09-19T09:18:11.909 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-19T09:18:11.908+0000 7fca8a79c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:18:11.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.909+0000 7f511cff9640 1 -- 172.21.15.18:0/1910985533 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v36) ==== 161+0+0 (secure 0 0 0) 0x7f511805ce00 con 0x7f51200cb1a0 2024-09-19T09:18:11.910 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T09:18:11.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.910+0000 7f511cff9640 1 -- 172.21.15.18:0/1910985533 <== mon.0 v2:172.21.15.18:3300/0 8 ==== osd_map(93..93 src has 1..93) ==== 374+0+0 (secure 0 0 0) 0x7f5118056ba0 con 0x7f51200cb1a0 2024-09-19T09:18:11.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.910+0000 7f511cff9640 1 -- 172.21.15.18:0/1910985533 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=94}) -- 0x7f510c074740 con 0x7f51200cb1a0 2024-09-19T09:18:11.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.911+0000 7f51264dd640 1 -- 172.21.15.18:0/1910985533 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f510c06c2b0 msgr2=0x7f510c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:11.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.911+0000 7f51264dd640 1 --2- 172.21.15.18:0/1910985533 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f510c06c2b0 0x7f510c06e770 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5110009560 tx=0x7f5110009190 comp rx=0 tx=0).stop 2024-09-19T09:18:11.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.911+0000 7f51264dd640 1 -- 172.21.15.18:0/1910985533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51200cb1a0 msgr2=0x7f5120162990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:11.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.911+0000 7f51264dd640 1 --2- 172.21.15.18:0/1910985533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51200cb1a0 0x7f5120162990 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f511800c7a0 tx=0x7f511800cc60 comp rx=0 tx=0).stop 2024-09-19T09:18:11.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.912+0000 7f51264dd640 1 -- 172.21.15.18:0/1910985533 shutdown_connections 2024-09-19T09:18:11.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.912+0000 7f51264dd640 1 --2- 172.21.15.18:0/1910985533 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f510c06c2b0 0x7f510c06e770 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.912+0000 7f51264dd640 1 --2- 172.21.15.18:0/1910985533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f51200cb1a0 0x7f5120162990 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.912+0000 7f51264dd640 1 --2- 172.21.15.18:0/1910985533 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f512015eda0 0x7f51200cac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.912+0000 7f51264dd640 1 --2- 172.21.15.18:0/1910985533 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f51200d0480 0x7f51200c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:11.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.912+0000 7f51264dd640 1 -- 172.21.15.18:0/1910985533 >> 172.21.15.18:0/1910985533 conn(0x7f512009df40 msgr2=0x7f51200b7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:11.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.912+0000 7f51264dd640 1 -- 172.21.15.18:0/1910985533 shutdown_connections 2024-09-19T09:18:11.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:11.912+0000 7f51264dd640 1 -- 172.21.15.18:0/1910985533 wait complete. 2024-09-19T09:18:11.926 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T09:18:11.952 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2024-09-19T09:18:12.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.031+0000 7f1516542640 1 Processor -- start 2024-09-19T09:18:12.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.031+0000 7f1516542640 1 -- start start 2024-09-19T09:18:12.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.032+0000 7f1516542640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f151015ede0 0x7f15100d5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:12.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.032+0000 7f1516542640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15100d5840 0x7f15100d14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:12.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.032+0000 7f1516542640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f15100d1a20 0x7f15100cf8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:12.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.032+0000 7f1516542640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f15100d3270 con 0x7f151015ede0 2024-09-19T09:18:12.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.032+0000 7f1516542640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f15100d34e0 con 0x7f15100d1a20 2024-09-19T09:18:12.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.032+0000 7f1516542640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f15100d37c0 con 0x7f15100d5840 2024-09-19T09:18:12.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.032+0000 7f150ffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f151015ede0 0x7f15100d5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:12.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.032+0000 7f150ffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f151015ede0 0x7f15100d5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53492/0 (socket says 172.21.15.18:53492) 2024-09-19T09:18:12.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.032+0000 7f150ffff640 1 -- 172.21.15.18:0/941023368 learned_addr learned my addr 172.21.15.18:0/941023368 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:12.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.032+0000 7f1514adf640 1 --2- 172.21.15.18:0/941023368 >> v2:172.21.15.162:3300/0 conn(0x7f15100d1a20 0x7f15100cf8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:12.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.032+0000 7f1507fff640 1 --2- 172.21.15.18:0/941023368 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15100d5840 0x7f15100d14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:12.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.032+0000 7f150ffff640 1 -- 172.21.15.18:0/941023368 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15100d5840 msgr2=0x7f15100d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:12.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.032+0000 7f150ffff640 1 --2- 172.21.15.18:0/941023368 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15100d5840 0x7f15100d14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:12.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.032+0000 7f150ffff640 1 -- 172.21.15.18:0/941023368 >> v2:172.21.15.162:3300/0 conn(0x7f15100d1a20 msgr2=0x7f15100cf8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:12.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.032+0000 7f150ffff640 1 --2- 172.21.15.18:0/941023368 >> v2:172.21.15.162:3300/0 conn(0x7f15100d1a20 0x7f15100cf8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:12.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.032+0000 7f150ffff640 1 -- 172.21.15.18:0/941023368 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15100d3aa0 con 0x7f151015ede0 2024-09-19T09:18:12.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.032+0000 7f1514adf640 1 --2- 172.21.15.18:0/941023368 >> v2:172.21.15.162:3300/0 conn(0x7f15100d1a20 0x7f15100cf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:12.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.033+0000 7f150ffff640 1 --2- 172.21.15.18:0/941023368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f151015ede0 0x7f15100d5300 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f151008dbb0 tx=0x7f150002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdfd9ab0b17a1a3d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:12.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.033+0000 7f150f7fe640 1 -- 172.21.15.18:0/941023368 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1500037070 con 0x7f151015ede0 2024-09-19T09:18:12.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.033+0000 7f150f7fe640 1 -- 172.21.15.18:0/941023368 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1500032440 con 0x7f151015ede0 2024-09-19T09:18:12.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.033+0000 7f150f7fe640 1 -- 172.21.15.18:0/941023368 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1500032810 con 0x7f151015ede0 2024-09-19T09:18:12.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.034+0000 7f1516542640 1 -- 172.21.15.18:0/941023368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f151015ede0 msgr2=0x7f15100d5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:12.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.034+0000 7f1516542640 1 --2- 172.21.15.18:0/941023368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f151015ede0 0x7f15100d5300 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f151008dbb0 tx=0x7f150002a270 comp rx=0 tx=0).stop 2024-09-19T09:18:12.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.034+0000 7f1516542640 1 -- 172.21.15.18:0/941023368 shutdown_connections 2024-09-19T09:18:12.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.034+0000 7f1516542640 1 --2- 172.21.15.18:0/941023368 >> v2:172.21.15.162:3300/0 conn(0x7f15100d1a20 0x7f15100cf8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:12.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.034+0000 7f1516542640 1 --2- 172.21.15.18:0/941023368 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15100d5840 0x7f15100d14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:12.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.034+0000 7f1516542640 1 --2- 172.21.15.18:0/941023368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f151015ede0 0x7f15100d5300 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:12.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.034+0000 7f1516542640 1 -- 172.21.15.18:0/941023368 >> 172.21.15.18:0/941023368 conn(0x7f151009df30 msgr2=0x7f15100d4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:12.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.034+0000 7f1516542640 1 -- 172.21.15.18:0/941023368 shutdown_connections 2024-09-19T09:18:12.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.034+0000 7f1516542640 1 -- 172.21.15.18:0/941023368 wait complete. 2024-09-19T09:18:12.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.035+0000 7f1516542640 1 Processor -- start 2024-09-19T09:18:12.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.035+0000 7f1516542640 1 -- start start 2024-09-19T09:18:12.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.036+0000 7f1516542640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15100d1a20 0x7f15101f5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:12.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.036+0000 7f1516542640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15100d5840 0x7f1510154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:12.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.036+0000 7f1516542640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f151015ede0 0x7f15100ca080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:12.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.036+0000 7f1516542640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f15100b41a0 con 0x7f151015ede0 2024-09-19T09:18:12.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.036+0000 7f1516542640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f15100b4020 con 0x7f15100d5840 2024-09-19T09:18:12.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.036+0000 7f1516542640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f15100cfdf0 con 0x7f15100d1a20 2024-09-19T09:18:12.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.036+0000 7f1514adf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f151015ede0 0x7f15100ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:12.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.036+0000 7f1514adf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f151015ede0 0x7f15100ca080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53500/0 (socket says 172.21.15.18:53500) 2024-09-19T09:18:12.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.036+0000 7f1514adf640 1 -- 172.21.15.18:0/1416232559 learned_addr learned my addr 172.21.15.18:0/1416232559 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:12.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.036+0000 7f150ffff640 1 --2- 172.21.15.18:0/1416232559 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15100d1a20 0x7f15101f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:12.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.036+0000 7f1507fff640 1 --2- 172.21.15.18:0/1416232559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15100d5840 0x7f1510154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:12.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.036+0000 7f1514adf640 1 -- 172.21.15.18:0/1416232559 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15100d1a20 msgr2=0x7f15101f5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:12.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.036+0000 7f1514adf640 1 --2- 172.21.15.18:0/1416232559 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15100d1a20 0x7f15101f5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:12.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.036+0000 7f1514adf640 1 -- 172.21.15.18:0/1416232559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15100d5840 msgr2=0x7f1510154110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:12.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.036+0000 7f1514adf640 1 --2- 172.21.15.18:0/1416232559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15100d5840 0x7f1510154110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:12.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.036+0000 7f1514adf640 1 -- 172.21.15.18:0/1416232559 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15100ca5c0 con 0x7f151015ede0 2024-09-19T09:18:12.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.036+0000 7f1514adf640 1 --2- 172.21.15.18:0/1416232559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f151015ede0 0x7f15100ca080 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f150800cef0 tx=0x7f150800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:12.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.036+0000 7f150d7fa640 1 -- 172.21.15.18:0/1416232559 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150801a070 con 0x7f151015ede0 2024-09-19T09:18:12.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.036+0000 7f150d7fa640 1 -- 172.21.15.18:0/1416232559 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f150800d860 con 0x7f151015ede0 2024-09-19T09:18:12.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.036+0000 7f1516542640 1 -- 172.21.15.18:0/1416232559 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15100cb920 con 0x7f151015ede0 2024-09-19T09:18:12.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.036+0000 7f150d7fa640 1 -- 172.21.15.18:0/1416232559 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f150800dc50 con 0x7f151015ede0 2024-09-19T09:18:12.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.036+0000 7f1516542640 1 -- 172.21.15.18:0/1416232559 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15100cab60 con 0x7f151015ede0 2024-09-19T09:18:12.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.037+0000 7f1516542640 1 -- 172.21.15.18:0/1416232559 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15100d14e0 con 0x7f151015ede0 2024-09-19T09:18:12.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.038+0000 7f150d7fa640 1 -- 172.21.15.18:0/1416232559 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f150801d070 con 0x7f151015ede0 2024-09-19T09:18:12.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.038+0000 7f150d7fa640 1 --2- 172.21.15.18:0/1416232559 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f14f006c2e0 0x7f14f006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:12.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.038+0000 7f150d7fa640 1 -- 172.21.15.18:0/1416232559 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5795+0+0 (secure 0 0 0) 0x7f150808bc80 con 0x7f151015ede0 2024-09-19T09:18:12.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.039+0000 7f150d7fa640 1 -- 172.21.15.18:0/1416232559 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=94}) -- 0x7f14f0073f10 con 0x7f151015ede0 2024-09-19T09:18:12.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.039+0000 7f150ffff640 1 --2- 172.21.15.18:0/1416232559 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f14f006c2e0 0x7f14f006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:12.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.039+0000 7f150ffff640 1 --2- 172.21.15.18:0/1416232559 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f14f006c2e0 0x7f14f006e7a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1500034000 tx=0x7f150002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:12.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.043+0000 7f150d7fa640 1 -- 172.21.15.18:0/1416232559 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1508059e00 con 0x7f151015ede0 2024-09-19T09:18:12.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.257+0000 7f1516542640 1 -- 172.21.15.18:0/1416232559 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f15100c8070 con 0x7f151015ede0 2024-09-19T09:18:12.910 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-19T09:18:12.910+0000 7fca8cfa1640 -1 log_channel(cluster) log [ERR] : Health check update: 1 full osd(s) (OSD_FULL) 2024-09-19T09:18:12.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.911+0000 7f150d7fa640 1 -- 172.21.15.18:0/1416232559 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v37) ==== 104+0+0 (secure 0 0 0) 0x7f150805e100 con 0x7f151015ede0 2024-09-19T09:18:12.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.913+0000 7f1516542640 1 -- 172.21.15.18:0/1416232559 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f14f006c2e0 msgr2=0x7f14f006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:12.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.913+0000 7f1516542640 1 --2- 172.21.15.18:0/1416232559 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f14f006c2e0 0x7f14f006e7a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1500034000 tx=0x7f150002e000 comp rx=0 tx=0).stop 2024-09-19T09:18:12.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.913+0000 7f1516542640 1 -- 172.21.15.18:0/1416232559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f151015ede0 msgr2=0x7f15100ca080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:12.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.913+0000 7f1516542640 1 --2- 172.21.15.18:0/1416232559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f151015ede0 0x7f15100ca080 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f150800cef0 tx=0x7f150800a710 comp rx=0 tx=0).stop 2024-09-19T09:18:12.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.914+0000 7f1516542640 1 -- 172.21.15.18:0/1416232559 shutdown_connections 2024-09-19T09:18:12.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.914+0000 7f1516542640 1 --2- 172.21.15.18:0/1416232559 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f14f006c2e0 0x7f14f006e7a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:12.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.914+0000 7f1516542640 1 --2- 172.21.15.18:0/1416232559 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f151015ede0 0x7f15100ca080 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:12.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.914+0000 7f1516542640 1 --2- 172.21.15.18:0/1416232559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15100d5840 0x7f1510154110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:12.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.914+0000 7f1516542640 1 --2- 172.21.15.18:0/1416232559 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15100d1a20 0x7f15101f5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:12.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.914+0000 7f1516542640 1 -- 172.21.15.18:0/1416232559 >> 172.21.15.18:0/1416232559 conn(0x7f151009df30 msgr2=0x7f151015cfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:12.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.914+0000 7f1516542640 1 -- 172.21.15.18:0/1416232559 shutdown_connections 2024-09-19T09:18:12.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:12.914+0000 7f1516542640 1 -- 172.21.15.18:0/1416232559 wait complete. 2024-09-19T09:18:12.929 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T09:18:13.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.080+0000 7f1f02fd6640 1 Processor -- start 2024-09-19T09:18:13.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.080+0000 7f1f02fd6640 1 -- start start 2024-09-19T09:18:13.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.081+0000 7f1f02fd6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1efc06e5e0 0x7f1efc06ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:13.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.081+0000 7f1f02fd6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1efc15e470 0x7f1efc15e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:13.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.081+0000 7f1f02fd6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1efc15dfc0 con 0x7f1efc0ce460 2024-09-19T09:18:13.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.081+0000 7f1f02fd6640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f1efc06ef80 con 0x7f1efc15e470 2024-09-19T09:18:13.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.081+0000 7f1f02fd6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1efc15d3b0 con 0x7f1efc06e5e0 2024-09-19T09:18:13.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.081+0000 7f1f01573640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1efc15e470 0x7f1efc15e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:13.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.081+0000 7f1f01573640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1efc15e470 0x7f1efc15e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53510/0 (socket says 172.21.15.18:53510) 2024-09-19T09:18:13.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.081+0000 7f1f01573640 1 -- 172.21.15.18:0/2333153134 learned_addr learned my addr 172.21.15.18:0/2333153134 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:13.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.081+0000 7f1f01573640 1 -- 172.21.15.18:0/2333153134 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1efc06e5e0 msgr2=0x7f1efc06ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:13.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.081+0000 7f1efbfff640 1 --2- 172.21.15.18:0/2333153134 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1efc06e5e0 0x7f1efc06ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:13.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.081+0000 7f1f01573640 1 --2- 172.21.15.18:0/2333153134 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1efc06e5e0 0x7f1efc06ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:13.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.081+0000 7f1f01573640 1 -- 172.21.15.18:0/2333153134 >> v1:172.21.15.162:6789/0 conn(0x7f1efc0ce460 legacy=0x7f1efc0cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:13.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.081+0000 7f1f01573640 1 -- 172.21.15.18:0/2333153134 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1efc15d690 con 0x7f1efc15e470 2024-09-19T09:18:13.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.082+0000 7f1f01573640 1 --2- 172.21.15.18:0/2333153134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1efc15e470 0x7f1efc15e920 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4009e50 tx=0x7f1ef402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990253b06b83f84 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:13.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.082+0000 7f1efb7fe640 1 -- 172.21.15.18:0/2333153134 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef4036070 con 0x7f1efc15e470 2024-09-19T09:18:13.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.082+0000 7f1efb7fe640 1 -- 172.21.15.18:0/2333153134 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ef4031600 con 0x7f1efc15e470 2024-09-19T09:18:13.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.082+0000 7f1efb7fe640 1 -- 172.21.15.18:0/2333153134 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef40319d0 con 0x7f1efc15e470 2024-09-19T09:18:13.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.083+0000 7f1f02fd6640 1 -- 172.21.15.18:0/2333153134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1efc15e470 msgr2=0x7f1efc15e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:13.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.083+0000 7f1f02fd6640 1 --2- 172.21.15.18:0/2333153134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1efc15e470 0x7f1efc15e920 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f1ef4009e50 tx=0x7f1ef402a6c0 comp rx=0 tx=0).stop 2024-09-19T09:18:13.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.083+0000 7f1f02fd6640 1 -- 172.21.15.18:0/2333153134 shutdown_connections 2024-09-19T09:18:13.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.083+0000 7f1f02fd6640 1 --2- 172.21.15.18:0/2333153134 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1efc15e470 0x7f1efc15e920 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:13.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.083+0000 7f1f02fd6640 1 --2- 172.21.15.18:0/2333153134 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1efc06e5e0 0x7f1efc06ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:13.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.083+0000 7f1f02fd6640 1 -- 172.21.15.18:0/2333153134 >> 172.21.15.18:0/2333153134 conn(0x7f1efc0b26a0 msgr2=0x7f1efc0b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:13.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.083+0000 7f1f02fd6640 1 -- 172.21.15.18:0/2333153134 shutdown_connections 2024-09-19T09:18:13.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.083+0000 7f1f02fd6640 1 -- 172.21.15.18:0/2333153134 wait complete. 2024-09-19T09:18:13.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.084+0000 7f1f02fd6640 1 Processor -- start 2024-09-19T09:18:13.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.084+0000 7f1f02fd6640 1 -- start start 2024-09-19T09:18:13.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.085+0000 7f1f02fd6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1efc06e5e0 0x7f1efc0b5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:13.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.085+0000 7f1f02fd6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1efc0ce460 0x7f1efc14fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:13.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.085+0000 7f1f02fd6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1efc15e470 0x7f1efc0af890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:13.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.085+0000 7f1f02fd6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1efc0ce840 con 0x7f1efc0ce460 2024-09-19T09:18:13.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.085+0000 7f1f02fd6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1efc15dc50 con 0x7f1efc06e5e0 2024-09-19T09:18:13.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.085+0000 7f1f02fd6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1efc0d05f0 con 0x7f1efc15e470 2024-09-19T09:18:13.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.085+0000 7f1efbfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1efc0ce460 0x7f1efc14fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:13.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.085+0000 7f1efbfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1efc0ce460 0x7f1efc14fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53512/0 (socket says 172.21.15.18:53512) 2024-09-19T09:18:13.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.085+0000 7f1efbfff640 1 -- 172.21.15.18:0/2603483978 learned_addr learned my addr 172.21.15.18:0/2603483978 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:13.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.085+0000 7f1f01573640 1 --2- 172.21.15.18:0/2603483978 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1efc15e470 0x7f1efc0af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:13.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.085+0000 7f1f00d72640 1 --2- 172.21.15.18:0/2603483978 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1efc06e5e0 0x7f1efc0b5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:13.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.085+0000 7f1efbfff640 1 -- 172.21.15.18:0/2603483978 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1efc15e470 msgr2=0x7f1efc0af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:13.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.085+0000 7f1efbfff640 1 --2- 172.21.15.18:0/2603483978 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1efc15e470 0x7f1efc0af890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:13.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.085+0000 7f1efbfff640 1 -- 172.21.15.18:0/2603483978 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1efc06e5e0 msgr2=0x7f1efc0b5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:13.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.085+0000 7f1efbfff640 1 --2- 172.21.15.18:0/2603483978 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1efc06e5e0 0x7f1efc0b5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:13.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.085+0000 7f1efbfff640 1 -- 172.21.15.18:0/2603483978 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1efc0ccfe0 con 0x7f1efc0ce460 2024-09-19T09:18:13.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.086+0000 7f1efbfff640 1 --2- 172.21.15.18:0/2603483978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1efc0ce460 0x7f1efc14fef0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f1ee800c820 tx=0x7f1ee800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:13.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.086+0000 7f1ef97fa640 1 -- 172.21.15.18:0/2603483978 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8015070 con 0x7f1efc0ce460 2024-09-19T09:18:13.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.086+0000 7f1ef97fa640 1 -- 172.21.15.18:0/2603483978 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ee8004220 con 0x7f1efc0ce460 2024-09-19T09:18:13.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.086+0000 7f1f02fd6640 1 -- 172.21.15.18:0/2603483978 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1efc0c5a40 con 0x7f1efc0ce460 2024-09-19T09:18:13.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.086+0000 7f1ef97fa640 1 -- 172.21.15.18:0/2603483978 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee800ce10 con 0x7f1efc0ce460 2024-09-19T09:18:13.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.086+0000 7f1f02fd6640 1 -- 172.21.15.18:0/2603483978 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1efc0c5ce0 con 0x7f1efc0ce460 2024-09-19T09:18:13.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.087+0000 7f1f02fd6640 1 -- 172.21.15.18:0/2603483978 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1efc15cfd0 con 0x7f1efc0ce460 2024-09-19T09:18:13.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.087+0000 7f1ef97fa640 1 -- 172.21.15.18:0/2603483978 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1ee8007830 con 0x7f1efc0ce460 2024-09-19T09:18:13.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.088+0000 7f1ef97fa640 1 --2- 172.21.15.18:0/2603483978 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1ee006c2e0 0x7f1ee006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:13.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.088+0000 7f1ef97fa640 1 -- 172.21.15.18:0/2603483978 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 5795+0+0 (secure 0 0 0) 0x7f1ee808b2f0 con 0x7f1efc0ce460 2024-09-19T09:18:13.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.088+0000 7f1ef97fa640 1 -- 172.21.15.18:0/2603483978 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=95}) -- 0x7f1ee0073f20 con 0x7f1efc0ce460 2024-09-19T09:18:13.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.088+0000 7f1f00d72640 1 --2- 172.21.15.18:0/2603483978 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1ee006c2e0 0x7f1ee006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:13.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.089+0000 7f1f00d72640 1 --2- 172.21.15.18:0/2603483978 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1ee006c2e0 0x7f1ee006e7a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0004ea0 tx=0x7f1ef0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:13.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.092+0000 7f1ef97fa640 1 -- 172.21.15.18:0/2603483978 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1ee8059a00 con 0x7f1efc0ce460 2024-09-19T09:18:13.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.269+0000 7f1f02fd6640 1 -- 172.21.15.18:0/2603483978 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1efc1610f0 con 0x7f1efc0ce460 2024-09-19T09:18:13.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.917+0000 7f1ef97fa640 1 -- 172.21.15.18:0/2603483978 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v95) ==== 181+0+0 (secure 0 0 0) 0x7f1ee8059300 con 0x7f1efc0ce460 2024-09-19T09:18:13.918 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' removed 2024-09-19T09:18:13.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.917+0000 7f1ef97fa640 1 -- 172.21.15.18:0/2603483978 <== mon.0 v2:172.21.15.18:3300/0 8 ==== osd_map(95..95 src has 1..95) ==== 1081+0+0 (secure 0 0 0) 0x7f1ee80bfda0 con 0x7f1efc0ce460 2024-09-19T09:18:13.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.917+0000 7f1ef97fa640 1 -- 172.21.15.18:0/2603483978 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=96}) -- 0x7f1ee0072350 con 0x7f1efc0ce460 2024-09-19T09:18:13.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.925+0000 7f1f02fd6640 1 -- 172.21.15.18:0/2603483978 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1ee006c2e0 msgr2=0x7f1ee006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:13.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.925+0000 7f1f02fd6640 1 --2- 172.21.15.18:0/2603483978 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1ee006c2e0 0x7f1ee006e7a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0004ea0 tx=0x7f1ef0009040 comp rx=0 tx=0).stop 2024-09-19T09:18:13.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.925+0000 7f1f02fd6640 1 -- 172.21.15.18:0/2603483978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1efc0ce460 msgr2=0x7f1efc14fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:13.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.925+0000 7f1f02fd6640 1 --2- 172.21.15.18:0/2603483978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1efc0ce460 0x7f1efc14fef0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f1ee800c820 tx=0x7f1ee800cce0 comp rx=0 tx=0).stop 2024-09-19T09:18:13.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.925+0000 7f1f02fd6640 1 -- 172.21.15.18:0/2603483978 shutdown_connections 2024-09-19T09:18:13.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.925+0000 7f1f02fd6640 1 --2- 172.21.15.18:0/2603483978 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1ee006c2e0 0x7f1ee006e7a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:13.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.925+0000 7f1f02fd6640 1 --2- 172.21.15.18:0/2603483978 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1efc15e470 0x7f1efc0af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:13.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.925+0000 7f1f02fd6640 1 --2- 172.21.15.18:0/2603483978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1efc0ce460 0x7f1efc14fef0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:13.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.925+0000 7f1f02fd6640 1 --2- 172.21.15.18:0/2603483978 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1efc06e5e0 0x7f1efc0b5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:13.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.925+0000 7f1f02fd6640 1 -- 172.21.15.18:0/2603483978 >> 172.21.15.18:0/2603483978 conn(0x7f1efc0b26a0 msgr2=0x7f1efc071ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:13.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.926+0000 7f1f02fd6640 1 -- 172.21.15.18:0/2603483978 shutdown_connections 2024-09-19T09:18:13.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:13.926+0000 7f1f02fd6640 1 -- 172.21.15.18:0/2603483978 wait complete. 2024-09-19T09:18:13.939 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T09:18:14.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.052+0000 7f25aa5c6640 1 Processor -- start 2024-09-19T09:18:14.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.052+0000 7f25aa5c6640 1 -- start start 2024-09-19T09:18:14.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.053+0000 7f25aa5c6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25a40cf420 0x7f25a40cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:14.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.053+0000 7f25aa5c6640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25a40cfd80 con 0x7f25a415f230 2024-09-19T09:18:14.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.053+0000 7f25aa5c6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25a40700b0 con 0x7f25a415ee50 2024-09-19T09:18:14.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.053+0000 7f25aa5c6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f25a40d2440 con 0x7f25a40cf420 2024-09-19T09:18:14.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.053+0000 7f25a8b63640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f25a415f230 0x7f25a415f6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:42784/0 (socket says 172.21.15.18:42784) 2024-09-19T09:18:14.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.053+0000 7f25a8b63640 1 -- 172.21.15.18:0/1355795472 learned_addr learned my addr 172.21.15.18:0/1355795472 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:14.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.053+0000 7f25a37fe640 1 --2- 172.21.15.18:0/1355795472 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25a40cf420 0x7f25a40cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:14.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.053+0000 7f25a2ffd640 1 -- 172.21.15.18:0/1355795472 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2232848037 0 0) 0x7f25a40cfd80 con 0x7f25a415f230 2024-09-19T09:18:14.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.053+0000 7f25a2ffd640 1 -- 172.21.15.18:0/1355795472 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2590003520 con 0x7f25a415f230 2024-09-19T09:18:14.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.054+0000 7f25a2ffd640 1 -- 172.21.15.18:0/1355795472 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2465846290 0 0) 0x7f2590003520 con 0x7f25a415f230 2024-09-19T09:18:14.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.054+0000 7f25a2ffd640 1 -- 172.21.15.18:0/1355795472 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25a40cf420 msgr2=0x7f25a40cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:14.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.054+0000 7f25a2ffd640 1 --2- 172.21.15.18:0/1355795472 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25a40cf420 0x7f25a40cf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:14.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.054+0000 7f25a2ffd640 1 -- 172.21.15.18:0/1355795472 >> v1:172.21.15.162:6789/0 conn(0x7f25a415ee50 legacy=0x7f25a4163390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:14.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.054+0000 7f25a2ffd640 1 -- 172.21.15.18:0/1355795472 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a40d2160 con 0x7f25a415f230 2024-09-19T09:18:14.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.054+0000 7f25a2ffd640 1 -- 172.21.15.18:0/1355795472 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f259c0019f0 con 0x7f25a415f230 2024-09-19T09:18:14.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.054+0000 7f25a2ffd640 1 -- 172.21.15.18:0/1355795472 >> v1:172.21.15.18:6789/0 conn(0x7f25a415f230 legacy=0x7f25a415f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:14.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.054+0000 7f25a2ffd640 1 --2- 172.21.15.18:0/1355795472 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25a40cf420 0x7f25900039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:14.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.054+0000 7f25a2ffd640 1 --2- 172.21.15.18:0/1355795472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2590003f20 0x7f2590004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:14.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.054+0000 7f25a2ffd640 1 --2- 172.21.15.18:0/1355795472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2590004d40 0x7f25900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:14.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.054+0000 7f25a2ffd640 1 -- 172.21.15.18:0/1355795472 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f25a40d2440 con 0x7f2590004d40 2024-09-19T09:18:14.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.054+0000 7f25a2ffd640 1 -- 172.21.15.18:0/1355795472 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f259000ba20 con 0x7f2590003f20 2024-09-19T09:18:14.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.054+0000 7f25a2ffd640 1 -- 172.21.15.18:0/1355795472 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f259000bc20 con 0x7f25a40cf420 2024-09-19T09:18:14.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.054+0000 7f25a8b63640 1 --2- 172.21.15.18:0/1355795472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2590004d40 0x7f25900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:14.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.054+0000 7f25a3fff640 1 --2- 172.21.15.18:0/1355795472 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25a40cf420 0x7f25900039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:14.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.054+0000 7f25a37fe640 1 --2- 172.21.15.18:0/1355795472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2590003f20 0x7f2590004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:14.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.054+0000 7f25a8b63640 1 -- 172.21.15.18:0/1355795472 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25a40cf420 msgr2=0x7f25900039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:14.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.054+0000 7f25a8b63640 1 --2- 172.21.15.18:0/1355795472 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25a40cf420 0x7f25900039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:14.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.054+0000 7f25a8b63640 1 -- 172.21.15.18:0/1355795472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2590003f20 msgr2=0x7f2590004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:14.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.054+0000 7f25a8b63640 1 --2- 172.21.15.18:0/1355795472 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2590003f20 0x7f2590004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:14.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.054+0000 7f25a8b63640 1 -- 172.21.15.18:0/1355795472 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2590003520 con 0x7f2590004d40 2024-09-19T09:18:14.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.055+0000 7f25a8b63640 1 --2- 172.21.15.18:0/1355795472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2590004d40 0x7f25900051c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f259c00a920 tx=0x7f2590005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf8c4824c7846a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:14.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.055+0000 7f25a2ffd640 1 -- 172.21.15.18:0/1355795472 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c00a4c0 con 0x7f2590004d40 2024-09-19T09:18:14.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.055+0000 7f25a2ffd640 1 -- 172.21.15.18:0/1355795472 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f259c02f070 con 0x7f2590004d40 2024-09-19T09:18:14.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.055+0000 7f25a2ffd640 1 -- 172.21.15.18:0/1355795472 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259c02bd20 con 0x7f2590004d40 2024-09-19T09:18:14.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.056+0000 7f25aa5c6640 1 -- 172.21.15.18:0/1355795472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2590004d40 msgr2=0x7f25900051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:14.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.056+0000 7f25aa5c6640 1 --2- 172.21.15.18:0/1355795472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2590004d40 0x7f25900051c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f259c00a920 tx=0x7f2590005830 comp rx=0 tx=0).stop 2024-09-19T09:18:14.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.056+0000 7f25a8b63640 1 -- 172.21.15.18:0/1355795472 reap_dead start 2024-09-19T09:18:14.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.056+0000 7f25aa5c6640 1 -- 172.21.15.18:0/1355795472 shutdown_connections 2024-09-19T09:18:14.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.056+0000 7f25aa5c6640 1 -- 172.21.15.18:0/1355795472 >> 172.21.15.18:0/1355795472 conn(0x7f25a409b9d0 msgr2=0x7f25a409bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:14.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.056+0000 7f25aa5c6640 1 -- 172.21.15.18:0/1355795472 shutdown_connections 2024-09-19T09:18:14.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.056+0000 7f25aa5c6640 1 -- 172.21.15.18:0/1355795472 wait complete. 2024-09-19T09:18:14.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.057+0000 7f25aa5c6640 1 Processor -- start 2024-09-19T09:18:14.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.057+0000 7f25aa5c6640 1 -- start start 2024-09-19T09:18:14.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.058+0000 7f25aa5c6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25a41546a0 0x7f25a41f5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:14.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.058+0000 7f25aa5c6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25a4154a80 0x7f25a41ee680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:14.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.058+0000 7f25aa5c6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25a41eebc0 0x7f25a41f8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:14.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.058+0000 7f25aa5c6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f25a40d0150 con 0x7f25a41546a0 2024-09-19T09:18:14.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.058+0000 7f25aa5c6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f25a406fd40 con 0x7f25a41eebc0 2024-09-19T09:18:14.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.058+0000 7f25aa5c6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f25a40d1dc0 con 0x7f25a4154a80 2024-09-19T09:18:14.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.058+0000 7f25a3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25a41546a0 0x7f25a41f5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:14.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.058+0000 7f25a3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25a41546a0 0x7f25a41f5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53532/0 (socket says 172.21.15.18:53532) 2024-09-19T09:18:14.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.058+0000 7f25a3fff640 1 -- 172.21.15.18:0/102721772 learned_addr learned my addr 172.21.15.18:0/102721772 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:14.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.058+0000 7f25a37fe640 1 --2- 172.21.15.18:0/102721772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25a4154a80 0x7f25a41ee680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:14.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.058+0000 7f25a8b63640 1 --2- 172.21.15.18:0/102721772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25a41eebc0 0x7f25a41f8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:14.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.058+0000 7f25a3fff640 1 -- 172.21.15.18:0/102721772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25a4154a80 msgr2=0x7f25a41ee680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:14.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.058+0000 7f25a3fff640 1 --2- 172.21.15.18:0/102721772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25a4154a80 0x7f25a41ee680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:14.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.058+0000 7f25a3fff640 1 -- 172.21.15.18:0/102721772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25a41eebc0 msgr2=0x7f25a41f8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:14.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.058+0000 7f25a3fff640 1 --2- 172.21.15.18:0/102721772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25a41eebc0 0x7f25a41f8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:14.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.058+0000 7f25a3fff640 1 -- 172.21.15.18:0/102721772 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a41f5ad0 con 0x7f25a41546a0 2024-09-19T09:18:14.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.058+0000 7f25a3fff640 1 --2- 172.21.15.18:0/102721772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25a41546a0 0x7f25a41f5590 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f259400f7c0 tx=0x7f259400fbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:14.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.059+0000 7f25a0ff9640 1 -- 172.21.15.18:0/102721772 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25940050d0 con 0x7f25a41546a0 2024-09-19T09:18:14.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.059+0000 7f25a0ff9640 1 -- 172.21.15.18:0/102721772 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2594018070 con 0x7f25a41546a0 2024-09-19T09:18:14.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.059+0000 7f25aa5c6640 1 -- 172.21.15.18:0/102721772 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25a40b2570 con 0x7f25a41546a0 2024-09-19T09:18:14.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.059+0000 7f25a0ff9640 1 -- 172.21.15.18:0/102721772 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259400d730 con 0x7f25a41546a0 2024-09-19T09:18:14.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.059+0000 7f25aa5c6640 1 -- 172.21.15.18:0/102721772 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25a40b2af0 con 0x7f25a41546a0 2024-09-19T09:18:14.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.060+0000 7f25aa5c6640 1 -- 172.21.15.18:0/102721772 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25a41eefd0 con 0x7f25a41546a0 2024-09-19T09:18:14.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.060+0000 7f25a0ff9640 1 -- 172.21.15.18:0/102721772 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f259400d8d0 con 0x7f25a41546a0 2024-09-19T09:18:14.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.061+0000 7f25a0ff9640 1 --2- 172.21.15.18:0/102721772 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f258406c2b0 0x7f258406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:14.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.061+0000 7f25a0ff9640 1 -- 172.21.15.18:0/102721772 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 5357+0+0 (secure 0 0 0) 0x7f259408b140 con 0x7f25a41546a0 2024-09-19T09:18:14.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.061+0000 7f25a37fe640 1 --2- 172.21.15.18:0/102721772 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f258406c2b0 0x7f258406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:14.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.061+0000 7f25a37fe640 1 --2- 172.21.15.18:0/102721772 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f258406c2b0 0x7f258406e770 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f25a40b0a40 tx=0x7f258c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:14.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.065+0000 7f25a0ff9640 1 -- 172.21.15.18:0/102721772 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f25a41f5ad0 con 0x7f25a41546a0 2024-09-19T09:18:14.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.243+0000 7f25aa5c6640 1 -- 172.21.15.18:0/102721772 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f25a40d0910 con 0x7f25a41546a0 2024-09-19T09:18:14.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.918+0000 7f25a0ff9640 1 -- 172.21.15.18:0/102721772 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v96) ==== 169+0+0 (secure 0 0 0) 0x7f2594059a00 con 0x7f25a41546a0 2024-09-19T09:18:14.919 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' removed 2024-09-19T09:18:14.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.924+0000 7f25aa5c6640 1 -- 172.21.15.18:0/102721772 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f258406c2b0 msgr2=0x7f258406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:14.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.925+0000 7f25aa5c6640 1 --2- 172.21.15.18:0/102721772 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f258406c2b0 0x7f258406e770 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f25a40b0a40 tx=0x7f258c009190 comp rx=0 tx=0).stop 2024-09-19T09:18:14.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.925+0000 7f25aa5c6640 1 -- 172.21.15.18:0/102721772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25a41546a0 msgr2=0x7f25a41f5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:14.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.925+0000 7f25aa5c6640 1 --2- 172.21.15.18:0/102721772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25a41546a0 0x7f25a41f5590 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f259400f7c0 tx=0x7f259400fbc0 comp rx=0 tx=0).stop 2024-09-19T09:18:14.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.926+0000 7f25aa5c6640 1 -- 172.21.15.18:0/102721772 shutdown_connections 2024-09-19T09:18:14.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.926+0000 7f25aa5c6640 1 --2- 172.21.15.18:0/102721772 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f258406c2b0 0x7f258406e770 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:14.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.926+0000 7f25aa5c6640 1 --2- 172.21.15.18:0/102721772 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f25a41eebc0 0x7f25a41f8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:14.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.926+0000 7f25aa5c6640 1 --2- 172.21.15.18:0/102721772 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25a4154a80 0x7f25a41ee680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:14.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.926+0000 7f25aa5c6640 1 --2- 172.21.15.18:0/102721772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25a41546a0 0x7f25a41f5590 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:14.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.926+0000 7f25aa5c6640 1 -- 172.21.15.18:0/102721772 >> 172.21.15.18:0/102721772 conn(0x7f25a409b9d0 msgr2=0x7f25a409bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:14.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.927+0000 7f25aa5c6640 1 -- 172.21.15.18:0/102721772 shutdown_connections 2024-09-19T09:18:14.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:14.927+0000 7f25aa5c6640 1 -- 172.21.15.18:0/102721772 wait complete. 2024-09-19T09:18:14.947 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-19T09:18:15.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.057+0000 7fef3b786640 1 Processor -- start 2024-09-19T09:18:15.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.057+0000 7fef3b786640 1 -- start start 2024-09-19T09:18:15.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.058+0000 7fef3b786640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef340d14e0 0x7fef340d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:15.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.058+0000 7fef3b786640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fef340b47e0 0x7fef340b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:15.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.058+0000 7fef3b786640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef340d3270 con 0x7fef3415ede0 2024-09-19T09:18:15.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.058+0000 7fef3b786640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fef340d1e60 con 0x7fef340b47e0 2024-09-19T09:18:15.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.058+0000 7fef3b786640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fef340d34e0 con 0x7fef340d14e0 2024-09-19T09:18:15.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.058+0000 7fef38d21640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef340d14e0 0x7fef340d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:15.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.058+0000 7fef39d23640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fef340b47e0 0x7fef340b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:15.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.058+0000 7fef38d21640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef340d14e0 0x7fef340d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:44176/0 (socket says 172.21.15.18:44176) 2024-09-19T09:18:15.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.058+0000 7fef38d21640 1 -- 172.21.15.18:0/3323721436 learned_addr learned my addr 172.21.15.18:0/3323721436 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:15.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.059+0000 7fef38d21640 1 -- 172.21.15.18:0/3323721436 >> v2:172.21.15.162:3300/0 conn(0x7fef340b47e0 msgr2=0x7fef340b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:15.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.059+0000 7fef38d21640 1 --2- 172.21.15.18:0/3323721436 >> v2:172.21.15.162:3300/0 conn(0x7fef340b47e0 0x7fef340b4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.059+0000 7fef38d21640 1 -- 172.21.15.18:0/3323721436 >> v1:172.21.15.162:6789/0 conn(0x7fef3415ede0 legacy=0x7fef340d5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:15.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.059+0000 7fef38d21640 1 -- 172.21.15.18:0/3323721436 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef340d37c0 con 0x7fef340d14e0 2024-09-19T09:18:15.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.059+0000 7fef39d23640 1 --2- 172.21.15.18:0/3323721436 >> v2:172.21.15.162:3300/0 conn(0x7fef340b47e0 0x7fef340b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:18:15.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.060+0000 7fef38d21640 1 --2- 172.21.15.18:0/3323721436 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef340d14e0 0x7fef340d1920 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fef24009870 tx=0x7fef2402a2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9a6db6b6c862ac9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:15.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.060+0000 7fef2bfff640 1 -- 172.21.15.18:0/3323721436 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef24037070 con 0x7fef340d14e0 2024-09-19T09:18:15.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.060+0000 7fef2bfff640 1 -- 172.21.15.18:0/3323721436 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef24032640 con 0x7fef340d14e0 2024-09-19T09:18:15.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.060+0000 7fef2bfff640 1 -- 172.21.15.18:0/3323721436 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef24032a10 con 0x7fef340d14e0 2024-09-19T09:18:15.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.060+0000 7fef3b786640 1 -- 172.21.15.18:0/3323721436 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef340d14e0 msgr2=0x7fef340d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:15.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.060+0000 7fef3b786640 1 --2- 172.21.15.18:0/3323721436 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef340d14e0 0x7fef340d1920 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fef24009870 tx=0x7fef2402a2e0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.060+0000 7fef3b786640 1 -- 172.21.15.18:0/3323721436 shutdown_connections 2024-09-19T09:18:15.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.060+0000 7fef3b786640 1 --2- 172.21.15.18:0/3323721436 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef340d14e0 0x7fef340d1920 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.060+0000 7fef3b786640 1 --2- 172.21.15.18:0/3323721436 >> v2:172.21.15.162:3300/0 conn(0x7fef340b47e0 0x7fef340b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.060+0000 7fef3b786640 1 -- 172.21.15.18:0/3323721436 >> 172.21.15.18:0/3323721436 conn(0x7fef3409df30 msgr2=0x7fef340d4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:15.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.060+0000 7fef3b786640 1 -- 172.21.15.18:0/3323721436 shutdown_connections 2024-09-19T09:18:15.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.061+0000 7fef3b786640 1 -- 172.21.15.18:0/3323721436 wait complete. 2024-09-19T09:18:15.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.062+0000 7fef3b786640 1 Processor -- start 2024-09-19T09:18:15.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.062+0000 7fef3b786640 1 -- start start 2024-09-19T09:18:15.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.062+0000 7fef3b786640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef340b47e0 0x7fef340ba720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:15.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.062+0000 7fef3b786640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef340d14e0 0x7fef34161eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:15.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.062+0000 7fef3b786640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef3415ede0 0x7fef341f40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:15.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.062+0000 7fef3b786640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fef340d5a10 con 0x7fef340d14e0 2024-09-19T09:18:15.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.062+0000 7fef3b786640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fef3415f1c0 con 0x7fef3415ede0 2024-09-19T09:18:15.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.062+0000 7fef3b786640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fef340b4020 con 0x7fef340b47e0 2024-09-19T09:18:15.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.063+0000 7fef38d21640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef340d14e0 0x7fef34161eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:15.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.063+0000 7fef38d21640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef340d14e0 0x7fef34161eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53540/0 (socket says 172.21.15.18:53540) 2024-09-19T09:18:15.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.063+0000 7fef38d21640 1 -- 172.21.15.18:0/4250439843 learned_addr learned my addr 172.21.15.18:0/4250439843 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:15.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.063+0000 7fef39522640 1 --2- 172.21.15.18:0/4250439843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef340b47e0 0x7fef340ba720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:15.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.063+0000 7fef39d23640 1 --2- 172.21.15.18:0/4250439843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef3415ede0 0x7fef341f40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:15.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.063+0000 7fef38d21640 1 -- 172.21.15.18:0/4250439843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef340b47e0 msgr2=0x7fef340ba720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:15.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.063+0000 7fef38d21640 1 --2- 172.21.15.18:0/4250439843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef340b47e0 0x7fef340ba720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.063+0000 7fef38d21640 1 -- 172.21.15.18:0/4250439843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef3415ede0 msgr2=0x7fef341f40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:15.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.063+0000 7fef38d21640 1 --2- 172.21.15.18:0/4250439843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef3415ede0 0x7fef341f40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.063+0000 7fef38d21640 1 -- 172.21.15.18:0/4250439843 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef340b7b70 con 0x7fef340d14e0 2024-09-19T09:18:15.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.063+0000 7fef38d21640 1 --2- 172.21.15.18:0/4250439843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef340d14e0 0x7fef34161eb0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fef24000c00 tx=0x7fef240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:15.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.063+0000 7fef29ffb640 1 -- 172.21.15.18:0/4250439843 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef24037040 con 0x7fef340d14e0 2024-09-19T09:18:15.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.063+0000 7fef29ffb640 1 -- 172.21.15.18:0/4250439843 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef24042070 con 0x7fef340d14e0 2024-09-19T09:18:15.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.063+0000 7fef29ffb640 1 -- 172.21.15.18:0/4250439843 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef24030970 con 0x7fef340d14e0 2024-09-19T09:18:15.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.063+0000 7fef3b786640 1 -- 172.21.15.18:0/4250439843 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef340b7e50 con 0x7fef340d14e0 2024-09-19T09:18:15.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.064+0000 7fef3b786640 1 -- 172.21.15.18:0/4250439843 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef341f8900 con 0x7fef340d14e0 2024-09-19T09:18:15.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.065+0000 7fef3b786640 1 -- 172.21.15.18:0/4250439843 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef340b8020 con 0x7fef340d14e0 2024-09-19T09:18:15.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.065+0000 7fef29ffb640 1 -- 172.21.15.18:0/4250439843 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fef24030b10 con 0x7fef340d14e0 2024-09-19T09:18:15.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.066+0000 7fef29ffb640 1 --2- 172.21.15.18:0/4250439843 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fef1806c2b0 0x7fef1806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:15.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.066+0000 7fef29ffb640 1 -- 172.21.15.18:0/4250439843 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 4943+0+0 (secure 0 0 0) 0x7fef240ab770 con 0x7fef340d14e0 2024-09-19T09:18:15.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.066+0000 7fef39522640 1 --2- 172.21.15.18:0/4250439843 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fef1806c2b0 0x7fef1806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:15.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.067+0000 7fef39522640 1 --2- 172.21.15.18:0/4250439843 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fef1806c2b0 0x7fef1806e770 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fef3415fdc0 tx=0x7fef30009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:15.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.070+0000 7fef29ffb640 1 -- 172.21.15.18:0/4250439843 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fef2407a270 con 0x7fef340d14e0 2024-09-19T09:18:15.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.245+0000 7fef3b786640 1 -- 172.21.15.18:0/4250439843 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fef340b6f70 con 0x7fef340d14e0 2024-09-19T09:18:15.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.248+0000 7fef29ffb640 1 -- 172.21.15.18:0/4250439843 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) ==== 104+0+0 (secure 0 0 0) 0x7fef24079b70 con 0x7fef340d14e0 2024-09-19T09:18:15.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.250+0000 7fef3b786640 1 -- 172.21.15.18:0/4250439843 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fef1806c2b0 msgr2=0x7fef1806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:15.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.250+0000 7fef3b786640 1 --2- 172.21.15.18:0/4250439843 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fef1806c2b0 0x7fef1806e770 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fef3415fdc0 tx=0x7fef30009040 comp rx=0 tx=0).stop 2024-09-19T09:18:15.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.250+0000 7fef3b786640 1 -- 172.21.15.18:0/4250439843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef340d14e0 msgr2=0x7fef34161eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:15.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.250+0000 7fef3b786640 1 --2- 172.21.15.18:0/4250439843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef340d14e0 0x7fef34161eb0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fef24000c00 tx=0x7fef240046c0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.250+0000 7fef3b786640 1 -- 172.21.15.18:0/4250439843 shutdown_connections 2024-09-19T09:18:15.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.250+0000 7fef3b786640 1 --2- 172.21.15.18:0/4250439843 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fef1806c2b0 0x7fef1806e770 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.250+0000 7fef3b786640 1 --2- 172.21.15.18:0/4250439843 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef3415ede0 0x7fef341f40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.250+0000 7fef3b786640 1 --2- 172.21.15.18:0/4250439843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef340d14e0 0x7fef34161eb0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.250+0000 7fef3b786640 1 --2- 172.21.15.18:0/4250439843 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef340b47e0 0x7fef340ba720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.250+0000 7fef3b786640 1 -- 172.21.15.18:0/4250439843 >> 172.21.15.18:0/4250439843 conn(0x7fef3409df30 msgr2=0x7fef3406cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:15.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.250+0000 7fef3b786640 1 -- 172.21.15.18:0/4250439843 shutdown_connections 2024-09-19T09:18:15.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.250+0000 7fef3b786640 1 -- 172.21.15.18:0/4250439843 wait complete. 2024-09-19T09:18:15.262 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2024-09-19T09:18:15.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.364+0000 7fad5d39f640 1 Processor -- start 2024-09-19T09:18:15.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.364+0000 7fad5d39f640 1 -- start start 2024-09-19T09:18:15.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.365+0000 7fad5d39f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fad58142150 0x7fad58160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:15.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.365+0000 7fad5d39f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fad58160a80 0x7fad580cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:15.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.365+0000 7fad5d39f640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad58142650 con 0x7fad5813fae0 2024-09-19T09:18:15.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.365+0000 7fad5d39f640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fad580ce780 con 0x7fad58160a80 2024-09-19T09:18:15.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.365+0000 7fad5d39f640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fad58142930 con 0x7fad58142150 2024-09-19T09:18:15.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.365+0000 7fad577fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fad58160a80 0x7fad580cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:15.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.365+0000 7fad577fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fad58160a80 0x7fad580cec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39342/0 (socket says 172.21.15.18:39342) 2024-09-19T09:18:15.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.365+0000 7fad577fe640 1 -- 172.21.15.18:0/1786179401 learned_addr learned my addr 172.21.15.18:0/1786179401 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:15.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.365+0000 7fad567fc640 1 --2- 172.21.15.18:0/1786179401 >> v2:172.21.15.162:3300/0 conn(0x7fad58142150 0x7fad58160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:15.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.365+0000 7fad577fe640 1 -- 172.21.15.18:0/1786179401 >> v2:172.21.15.162:3300/0 conn(0x7fad58142150 msgr2=0x7fad58160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:15.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.365+0000 7fad577fe640 1 --2- 172.21.15.18:0/1786179401 >> v2:172.21.15.162:3300/0 conn(0x7fad58142150 0x7fad58160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.365+0000 7fad577fe640 1 -- 172.21.15.18:0/1786179401 >> v1:172.21.15.162:6789/0 conn(0x7fad5813fae0 legacy=0x7fad5806f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:15.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.365+0000 7fad577fe640 1 -- 172.21.15.18:0/1786179401 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad58142c10 con 0x7fad58160a80 2024-09-19T09:18:15.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.366+0000 7fad577fe640 1 --2- 172.21.15.18:0/1786179401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad58160a80 0x7fad580cec10 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fad58075560 tx=0x7fad5002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd3010be489cc70 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:15.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.366+0000 7fad55ffb640 1 -- 172.21.15.18:0/1786179401 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad50036070 con 0x7fad58160a80 2024-09-19T09:18:15.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.366+0000 7fad55ffb640 1 -- 172.21.15.18:0/1786179401 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad50031600 con 0x7fad58160a80 2024-09-19T09:18:15.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.366+0000 7fad55ffb640 1 -- 172.21.15.18:0/1786179401 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad500319d0 con 0x7fad58160a80 2024-09-19T09:18:15.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.366+0000 7fad5d39f640 1 -- 172.21.15.18:0/1786179401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad58160a80 msgr2=0x7fad580cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:15.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.366+0000 7fad5d39f640 1 --2- 172.21.15.18:0/1786179401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad58160a80 0x7fad580cec10 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fad58075560 tx=0x7fad5002a660 comp rx=0 tx=0).stop 2024-09-19T09:18:15.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.367+0000 7fad5d39f640 1 -- 172.21.15.18:0/1786179401 shutdown_connections 2024-09-19T09:18:15.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.367+0000 7fad5d39f640 1 --2- 172.21.15.18:0/1786179401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad58160a80 0x7fad580cec10 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.367+0000 7fad5d39f640 1 --2- 172.21.15.18:0/1786179401 >> v2:172.21.15.162:3300/0 conn(0x7fad58142150 0x7fad58160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.367+0000 7fad5d39f640 1 -- 172.21.15.18:0/1786179401 >> 172.21.15.18:0/1786179401 conn(0x7fad5806bc10 msgr2=0x7fad5806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:15.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.367+0000 7fad5d39f640 1 -- 172.21.15.18:0/1786179401 shutdown_connections 2024-09-19T09:18:15.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.367+0000 7fad5d39f640 1 -- 172.21.15.18:0/1786179401 wait complete. 2024-09-19T09:18:15.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.368+0000 7fad5d39f640 1 Processor -- start 2024-09-19T09:18:15.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.368+0000 7fad5d39f640 1 -- start start 2024-09-19T09:18:15.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.369+0000 7fad5d39f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad5813fae0 0x7fad58144090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:15.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.369+0000 7fad5d39f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad58142150 0x7fad5813f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:15.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.369+0000 7fad5d39f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad58160a80 0x7fad581454b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:15.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.369+0000 7fad5d39f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fad580cf2d0 con 0x7fad58160a80 2024-09-19T09:18:15.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.369+0000 7fad5d39f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fad580cf150 con 0x7fad58142150 2024-09-19T09:18:15.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.369+0000 7fad5d39f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fad580cf450 con 0x7fad5813fae0 2024-09-19T09:18:15.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.369+0000 7fad577fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad58160a80 0x7fad581454b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:15.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.369+0000 7fad577fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad58160a80 0x7fad581454b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39358/0 (socket says 172.21.15.18:39358) 2024-09-19T09:18:15.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.369+0000 7fad577fe640 1 -- 172.21.15.18:0/678983841 learned_addr learned my addr 172.21.15.18:0/678983841 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:15.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.369+0000 7fad567fc640 1 --2- 172.21.15.18:0/678983841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad58142150 0x7fad5813f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:15.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.369+0000 7fad56ffd640 1 --2- 172.21.15.18:0/678983841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad5813fae0 0x7fad58144090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:15.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.369+0000 7fad577fe640 1 -- 172.21.15.18:0/678983841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad5813fae0 msgr2=0x7fad58144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:15.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.369+0000 7fad577fe640 1 --2- 172.21.15.18:0/678983841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad5813fae0 0x7fad58144090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.369+0000 7fad577fe640 1 -- 172.21.15.18:0/678983841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad58142150 msgr2=0x7fad5813f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:15.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.369+0000 7fad577fe640 1 --2- 172.21.15.18:0/678983841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad58142150 0x7fad5813f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:15.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.369+0000 7fad577fe640 1 -- 172.21.15.18:0/678983841 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad5813f560 con 0x7fad58160a80 2024-09-19T09:18:15.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.369+0000 7fad577fe640 1 --2- 172.21.15.18:0/678983841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad58160a80 0x7fad581454b0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fad50009f40 tx=0x7fad50004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:15.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.369+0000 7fad3f7fe640 1 -- 172.21.15.18:0/678983841 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad50036050 con 0x7fad58160a80 2024-09-19T09:18:15.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.369+0000 7fad3f7fe640 1 -- 172.21.15.18:0/678983841 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad50042070 con 0x7fad58160a80 2024-09-19T09:18:15.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.369+0000 7fad5d39f640 1 -- 172.21.15.18:0/678983841 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad58141e20 con 0x7fad58160a80 2024-09-19T09:18:15.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.369+0000 7fad3f7fe640 1 -- 172.21.15.18:0/678983841 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad50009510 con 0x7fad58160a80 2024-09-19T09:18:15.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.370+0000 7fad5d39f640 1 -- 172.21.15.18:0/678983841 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad581432d0 con 0x7fad58160a80 2024-09-19T09:18:15.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.371+0000 7fad5d39f640 1 -- 172.21.15.18:0/678983841 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad58160540 con 0x7fad58160a80 2024-09-19T09:18:15.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.371+0000 7fad3f7fe640 1 -- 172.21.15.18:0/678983841 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fad50007bd0 con 0x7fad58160a80 2024-09-19T09:18:15.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.372+0000 7fad3f7fe640 1 --2- 172.21.15.18:0/678983841 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fad4406c2b0 0x7fad4406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:15.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.372+0000 7fad3f7fe640 1 -- 172.21.15.18:0/678983841 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 4943+0+0 (secure 0 0 0) 0x7fad500abe40 con 0x7fad58160a80 2024-09-19T09:18:15.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.372+0000 7fad56ffd640 1 --2- 172.21.15.18:0/678983841 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fad4406c2b0 0x7fad4406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:15.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.372+0000 7fad56ffd640 1 --2- 172.21.15.18:0/678983841 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fad4406c2b0 0x7fad4406e770 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fad48004f60 tx=0x7fad48007e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:15.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.376+0000 7fad3f7fe640 1 -- 172.21.15.18:0/678983841 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fad5007a2f0 con 0x7fad58160a80 2024-09-19T09:18:15.625 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:15.625+0000 7fad5d39f640 1 -- 172.21.15.18:0/678983841 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) -- 0x7fad580cdaa0 con 0x7fad58160a80 2024-09-19T09:18:16.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.386+0000 7fad3f7fe640 1 -- 172.21.15.18:0/678983841 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v243) ==== 133+0+0 (secure 0 0 0) 0x7fad5007e5f0 con 0x7fad58160a80 2024-09-19T09:18:16.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.389+0000 7fad5d39f640 1 -- 172.21.15.18:0/678983841 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fad4406c2b0 msgr2=0x7fad4406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:16.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.389+0000 7fad5d39f640 1 --2- 172.21.15.18:0/678983841 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fad4406c2b0 0x7fad4406e770 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fad48004f60 tx=0x7fad48007e30 comp rx=0 tx=0).stop 2024-09-19T09:18:16.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.389+0000 7fad5d39f640 1 -- 172.21.15.18:0/678983841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad58160a80 msgr2=0x7fad581454b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:16.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.389+0000 7fad5d39f640 1 --2- 172.21.15.18:0/678983841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad58160a80 0x7fad581454b0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fad50009f40 tx=0x7fad50004a40 comp rx=0 tx=0).stop 2024-09-19T09:18:16.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.389+0000 7fad5d39f640 1 -- 172.21.15.18:0/678983841 shutdown_connections 2024-09-19T09:18:16.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.389+0000 7fad5d39f640 1 --2- 172.21.15.18:0/678983841 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fad4406c2b0 0x7fad4406e770 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:16.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.389+0000 7fad5d39f640 1 --2- 172.21.15.18:0/678983841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fad58160a80 0x7fad581454b0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:16.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.389+0000 7fad5d39f640 1 --2- 172.21.15.18:0/678983841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fad58142150 0x7fad5813f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:16.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.389+0000 7fad5d39f640 1 --2- 172.21.15.18:0/678983841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fad5813fae0 0x7fad58144090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:16.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.389+0000 7fad5d39f640 1 -- 172.21.15.18:0/678983841 >> 172.21.15.18:0/678983841 conn(0x7fad5806bc10 msgr2=0x7fad58074d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:16.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.389+0000 7fad5d39f640 1 -- 172.21.15.18:0/678983841 shutdown_connections 2024-09-19T09:18:16.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.389+0000 7fad5d39f640 1 -- 172.21.15.18:0/678983841 wait complete. 2024-09-19T09:18:16.403 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2024-09-19T09:18:16.403 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestClusterFull) 2024-09-19T09:18:16.404 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:18:16.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.512+0000 7fb1c8918640 1 Processor -- start 2024-09-19T09:18:16.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.512+0000 7fb1c8918640 1 -- start start 2024-09-19T09:18:16.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.513+0000 7fb1c8918640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb1c40d10a0 0x7fb1c40d1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:16.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.513+0000 7fb1c8918640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb1c40ce7b0 0x7fb1c4067950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:16.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.513+0000 7fb1c8918640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1c40cd710 con 0x7fb1c415cd60 2024-09-19T09:18:16.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.513+0000 7fb1c8918640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fb1c40b1f20 con 0x7fb1c40ce7b0 2024-09-19T09:18:16.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.513+0000 7fb1c8918640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb1c40cd9f0 con 0x7fb1c40d10a0 2024-09-19T09:18:16.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.513+0000 7fb1c2d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb1c40ce7b0 0x7fb1c4067950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:16.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.513+0000 7fb1c2d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb1c40ce7b0 0x7fb1c4067950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39372/0 (socket says 172.21.15.18:39372) 2024-09-19T09:18:16.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.513+0000 7fb1c2d9d640 1 -- 172.21.15.18:0/1183650978 learned_addr learned my addr 172.21.15.18:0/1183650978 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:16.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.513+0000 7fb1c259c640 1 --2- 172.21.15.18:0/1183650978 >> v2:172.21.15.162:3300/0 conn(0x7fb1c40d10a0 0x7fb1c40d1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:16.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.513+0000 7fb1c2d9d640 1 -- 172.21.15.18:0/1183650978 >> v2:172.21.15.162:3300/0 conn(0x7fb1c40d10a0 msgr2=0x7fb1c40d1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:16.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.513+0000 7fb1c2d9d640 1 --2- 172.21.15.18:0/1183650978 >> v2:172.21.15.162:3300/0 conn(0x7fb1c40d10a0 0x7fb1c40d1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:16.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.513+0000 7fb1c2d9d640 1 -- 172.21.15.18:0/1183650978 >> v1:172.21.15.162:6789/0 conn(0x7fb1c415cd60 legacy=0x7fb1c40d1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:16.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.513+0000 7fb1c2d9d640 1 -- 172.21.15.18:0/1183650978 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c40cdcd0 con 0x7fb1c40ce7b0 2024-09-19T09:18:16.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.514+0000 7fb1c2d9d640 1 --2- 172.21.15.18:0/1183650978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1c40ce7b0 0x7fb1c4067950 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4072dc0 tx=0x7fb1b402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f2cb7fde55151c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:16.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.514+0000 7fb1c159a640 1 -- 172.21.15.18:0/1183650978 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4037070 con 0x7fb1c40ce7b0 2024-09-19T09:18:16.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.514+0000 7fb1c159a640 1 -- 172.21.15.18:0/1183650978 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1b4032440 con 0x7fb1c40ce7b0 2024-09-19T09:18:16.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.514+0000 7fb1c159a640 1 -- 172.21.15.18:0/1183650978 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4032810 con 0x7fb1c40ce7b0 2024-09-19T09:18:16.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.515+0000 7fb1c8918640 1 -- 172.21.15.18:0/1183650978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1c40ce7b0 msgr2=0x7fb1c4067950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:16.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.515+0000 7fb1c8918640 1 --2- 172.21.15.18:0/1183650978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1c40ce7b0 0x7fb1c4067950 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb1c4072dc0 tx=0x7fb1b402a230 comp rx=0 tx=0).stop 2024-09-19T09:18:16.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.515+0000 7fb1c8918640 1 -- 172.21.15.18:0/1183650978 shutdown_connections 2024-09-19T09:18:16.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.515+0000 7fb1c8918640 1 --2- 172.21.15.18:0/1183650978 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1c40ce7b0 0x7fb1c4067950 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:16.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.515+0000 7fb1c8918640 1 --2- 172.21.15.18:0/1183650978 >> v2:172.21.15.162:3300/0 conn(0x7fb1c40d10a0 0x7fb1c40d1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:16.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.515+0000 7fb1c8918640 1 -- 172.21.15.18:0/1183650978 >> 172.21.15.18:0/1183650978 conn(0x7fb1c40731b0 msgr2=0x7fb1c40735c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:16.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.515+0000 7fb1c8918640 1 -- 172.21.15.18:0/1183650978 shutdown_connections 2024-09-19T09:18:16.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.515+0000 7fb1c8918640 1 -- 172.21.15.18:0/1183650978 wait complete. 2024-09-19T09:18:16.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.516+0000 7fb1c8918640 1 Processor -- start 2024-09-19T09:18:16.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.516+0000 7fb1c8918640 1 -- start start 2024-09-19T09:18:16.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.517+0000 7fb1c8918640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1c40ce7b0 0x7fb1c414dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:16.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.517+0000 7fb1c8918640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1c40d10a0 0x7fb1c4151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:16.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.517+0000 7fb1c8918640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1c415cd60 0x7fb1c414eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:16.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.517+0000 7fb1c8918640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c4067e90 con 0x7fb1c40d10a0 2024-09-19T09:18:16.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.517+0000 7fb1c8918640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c40ce290 con 0x7fb1c40ce7b0 2024-09-19T09:18:16.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.517+0000 7fb1c8918640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb1c40b0f10 con 0x7fb1c415cd60 2024-09-19T09:18:16.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.517+0000 7fb1c1d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1c40d10a0 0x7fb1c4151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:16.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.517+0000 7fb1c1d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1c40d10a0 0x7fb1c4151680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39378/0 (socket says 172.21.15.18:39378) 2024-09-19T09:18:16.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.517+0000 7fb1c1d9b640 1 -- 172.21.15.18:0/2286048436 learned_addr learned my addr 172.21.15.18:0/2286048436 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:16.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.517+0000 7fb1c259c640 1 --2- 172.21.15.18:0/2286048436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1c40ce7b0 0x7fb1c414dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:16.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.517+0000 7fb1c2d9d640 1 --2- 172.21.15.18:0/2286048436 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1c415cd60 0x7fb1c414eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:16.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.517+0000 7fb1c1d9b640 1 -- 172.21.15.18:0/2286048436 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1c415cd60 msgr2=0x7fb1c414eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:16.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.517+0000 7fb1c1d9b640 1 --2- 172.21.15.18:0/2286048436 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1c415cd60 0x7fb1c414eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:16.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.517+0000 7fb1c1d9b640 1 -- 172.21.15.18:0/2286048436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1c40ce7b0 msgr2=0x7fb1c414dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:16.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.517+0000 7fb1c1d9b640 1 --2- 172.21.15.18:0/2286048436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1c40ce7b0 0x7fb1c414dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:16.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.517+0000 7fb1c1d9b640 1 -- 172.21.15.18:0/2286048436 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c4158550 con 0x7fb1c40d10a0 2024-09-19T09:18:16.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.518+0000 7fb1c1d9b640 1 --2- 172.21.15.18:0/2286048436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1c40d10a0 0x7fb1c4151680 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00b3f0 tx=0x7fb1ac00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:16.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.518+0000 7fb1baffd640 1 -- 172.21.15.18:0/2286048436 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac015020 con 0x7fb1c40d10a0 2024-09-19T09:18:16.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.518+0000 7fb1baffd640 1 -- 172.21.15.18:0/2286048436 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1ac011830 con 0x7fb1c40d10a0 2024-09-19T09:18:16.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.518+0000 7fb1c8918640 1 -- 172.21.15.18:0/2286048436 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1c4158830 con 0x7fb1c40d10a0 2024-09-19T09:18:16.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.518+0000 7fb1baffd640 1 -- 172.21.15.18:0/2286048436 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac011c20 con 0x7fb1c40d10a0 2024-09-19T09:18:16.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.518+0000 7fb1c8918640 1 -- 172.21.15.18:0/2286048436 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1c4158df0 con 0x7fb1c40d10a0 2024-09-19T09:18:16.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.519+0000 7fb1c8918640 1 -- 172.21.15.18:0/2286048436 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1c4157be0 con 0x7fb1c40d10a0 2024-09-19T09:18:16.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.519+0000 7fb1baffd640 1 -- 172.21.15.18:0/2286048436 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb1ac018020 con 0x7fb1c40d10a0 2024-09-19T09:18:16.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.520+0000 7fb1baffd640 1 --2- 172.21.15.18:0/2286048436 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb1a406c2b0 0x7fb1a406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:16.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.520+0000 7fb1baffd640 1 -- 172.21.15.18:0/2286048436 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 4943+0+0 (secure 0 0 0) 0x7fb1ac08ac10 con 0x7fb1c40d10a0 2024-09-19T09:18:16.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.520+0000 7fb1c259c640 1 --2- 172.21.15.18:0/2286048436 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb1a406c2b0 0x7fb1a406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:16.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.521+0000 7fb1c259c640 1 --2- 172.21.15.18:0/2286048436 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb1a406c2b0 0x7fb1a406e770 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb1c415fba0 tx=0x7fb1bc0098d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:16.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.524+0000 7fb1baffd640 1 -- 172.21.15.18:0/2286048436 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb1c4157be0 con 0x7fb1c40d10a0 2024-09-19T09:18:16.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.705+0000 7fb1c8918640 1 -- 172.21.15.18:0/2286048436 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb1c4158ff0 con 0x7fb1c40d10a0 2024-09-19T09:18:16.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.706+0000 7fb1baffd640 1 -- 172.21.15.18:0/2286048436 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) ==== 74+0+13043 (secure 0 0 0) 0x7fb1c4158ff0 con 0x7fb1c40d10a0 2024-09-19T09:18:16.706 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:16.706 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":96,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:18:14.917997+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6835/905153716":"2024-09-20T09:18:11.909330+0000","172.21.15.18:6833/905153716":"2024-09-20T09:18:11.909330+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:18:16.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.708+0000 7fb1c8918640 1 -- 172.21.15.18:0/2286048436 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb1a406c2b0 msgr2=0x7fb1a406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:16.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.708+0000 7fb1c8918640 1 --2- 172.21.15.18:0/2286048436 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb1a406c2b0 0x7fb1a406e770 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb1c415fba0 tx=0x7fb1bc0098d0 comp rx=0 tx=0).stop 2024-09-19T09:18:16.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.708+0000 7fb1c8918640 1 -- 172.21.15.18:0/2286048436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1c40d10a0 msgr2=0x7fb1c4151680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:16.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.708+0000 7fb1c8918640 1 --2- 172.21.15.18:0/2286048436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1c40d10a0 0x7fb1c4151680 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00b3f0 tx=0x7fb1ac00b8b0 comp rx=0 tx=0).stop 2024-09-19T09:18:16.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.708+0000 7fb1c8918640 1 -- 172.21.15.18:0/2286048436 shutdown_connections 2024-09-19T09:18:16.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.708+0000 7fb1c8918640 1 --2- 172.21.15.18:0/2286048436 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb1a406c2b0 0x7fb1a406e770 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:16.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.708+0000 7fb1c8918640 1 --2- 172.21.15.18:0/2286048436 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb1c415cd60 0x7fb1c414eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:16.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.708+0000 7fb1c8918640 1 --2- 172.21.15.18:0/2286048436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb1c40d10a0 0x7fb1c4151680 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:16.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.708+0000 7fb1c8918640 1 --2- 172.21.15.18:0/2286048436 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb1c40ce7b0 0x7fb1c414dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:16.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.708+0000 7fb1c8918640 1 -- 172.21.15.18:0/2286048436 >> 172.21.15.18:0/2286048436 conn(0x7fb1c40731b0 msgr2=0x7fb1c415bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:16.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.708+0000 7fb1c8918640 1 -- 172.21.15.18:0/2286048436 shutdown_connections 2024-09-19T09:18:16.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.708+0000 7fb1c8918640 1 -- 172.21.15.18:0/2286048436 wait complete. 2024-09-19T09:18:16.720 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T09:13:17.564717+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '96', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T09:18:16.720 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T09:18:16.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.825+0000 7f22f5cf8640 1 Processor -- start 2024-09-19T09:18:16.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.825+0000 7f22f5cf8640 1 -- start start 2024-09-19T09:18:16.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.826+0000 7f22f5cf8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f22f006e280 0x7f22f0073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:16.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.826+0000 7f22f5cf8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f22f00d1010 0x7f22f00ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:16.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.826+0000 7f22f5cf8640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22f00722d0 con 0x7f22f0071df0 2024-09-19T09:18:16.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.826+0000 7f22f5cf8640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f22f00738b0 con 0x7f22f00d1010 2024-09-19T09:18:16.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.826+0000 7f22f5cf8640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f22f00725b0 con 0x7f22f006e280 2024-09-19T09:18:16.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.826+0000 7f22effff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f22f00d1010 0x7f22f00ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:16.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.826+0000 7f22effff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f22f00d1010 0x7f22f00ce3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39386/0 (socket says 172.21.15.18:39386) 2024-09-19T09:18:16.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.826+0000 7f22effff640 1 -- 172.21.15.18:0/3230582401 learned_addr learned my addr 172.21.15.18:0/3230582401 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:16.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.826+0000 7f22ef7fe640 1 --2- 172.21.15.18:0/3230582401 >> v2:172.21.15.162:3300/0 conn(0x7f22f006e280 0x7f22f0073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:16.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.827+0000 7f22effff640 1 -- 172.21.15.18:0/3230582401 >> v2:172.21.15.162:3300/0 conn(0x7f22f006e280 msgr2=0x7f22f0073370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:16.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.827+0000 7f22effff640 1 --2- 172.21.15.18:0/3230582401 >> v2:172.21.15.162:3300/0 conn(0x7f22f006e280 0x7f22f0073370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:16.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.827+0000 7f22effff640 1 -- 172.21.15.18:0/3230582401 >> v1:172.21.15.162:6789/0 conn(0x7f22f0071df0 legacy=0x7f22f006e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:16.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.827+0000 7f22effff640 1 -- 172.21.15.18:0/3230582401 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f0072890 con 0x7f22f00d1010 2024-09-19T09:18:16.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.827+0000 7f22effff640 1 --2- 172.21.15.18:0/3230582401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22f00d1010 0x7f22f00ce3d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f22f00506f0 tx=0x7f22e802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af11905697fcbd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:16.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.827+0000 7f22ee7fc640 1 -- 172.21.15.18:0/3230582401 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e8036070 con 0x7f22f00d1010 2024-09-19T09:18:16.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.827+0000 7f22ee7fc640 1 -- 172.21.15.18:0/3230582401 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22e8031600 con 0x7f22f00d1010 2024-09-19T09:18:16.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.827+0000 7f22ee7fc640 1 -- 172.21.15.18:0/3230582401 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e80319d0 con 0x7f22f00d1010 2024-09-19T09:18:16.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.828+0000 7f22f5cf8640 1 -- 172.21.15.18:0/3230582401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22f00d1010 msgr2=0x7f22f00ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:16.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.828+0000 7f22f5cf8640 1 --2- 172.21.15.18:0/3230582401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22f00d1010 0x7f22f00ce3d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f22f00506f0 tx=0x7f22e802a730 comp rx=0 tx=0).stop 2024-09-19T09:18:16.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.828+0000 7f22f5cf8640 1 -- 172.21.15.18:0/3230582401 shutdown_connections 2024-09-19T09:18:16.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.828+0000 7f22f5cf8640 1 --2- 172.21.15.18:0/3230582401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22f00d1010 0x7f22f00ce3d0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:16.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.828+0000 7f22f5cf8640 1 --2- 172.21.15.18:0/3230582401 >> v2:172.21.15.162:3300/0 conn(0x7f22f006e280 0x7f22f0073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:16.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.828+0000 7f22f5cf8640 1 -- 172.21.15.18:0/3230582401 >> 172.21.15.18:0/3230582401 conn(0x7f22f006bc10 msgr2=0x7f22f006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:16.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.828+0000 7f22f5cf8640 1 -- 172.21.15.18:0/3230582401 shutdown_connections 2024-09-19T09:18:16.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.828+0000 7f22f5cf8640 1 -- 172.21.15.18:0/3230582401 wait complete. 2024-09-19T09:18:16.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.829+0000 7f22f5cf8640 1 Processor -- start 2024-09-19T09:18:16.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.829+0000 7f22f5cf8640 1 -- start start 2024-09-19T09:18:16.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.830+0000 7f22f5cf8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22f006e280 0x7f22f01518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:16.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.830+0000 7f22f5cf8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22f0071df0 0x7f22f01e5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:16.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.830+0000 7f22f5cf8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22f00d1010 0x7f22f01f5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:16.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.830+0000 7f22f5cf8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f22f015db60 con 0x7f22f00d1010 2024-09-19T09:18:16.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.830+0000 7f22f5cf8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f22f0072e50 con 0x7f22f0071df0 2024-09-19T09:18:16.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.830+0000 7f22f5cf8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f22f00d14c0 con 0x7f22f006e280 2024-09-19T09:18:16.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.830+0000 7f22effff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22f00d1010 0x7f22f01f5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:16.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.830+0000 7f22effff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22f00d1010 0x7f22f01f5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39390/0 (socket says 172.21.15.18:39390) 2024-09-19T09:18:16.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.830+0000 7f22effff640 1 -- 172.21.15.18:0/3545772973 learned_addr learned my addr 172.21.15.18:0/3545772973 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:16.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.830+0000 7f22eeffd640 1 --2- 172.21.15.18:0/3545772973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22f0071df0 0x7f22f01e5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:16.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.830+0000 7f22ef7fe640 1 --2- 172.21.15.18:0/3545772973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22f006e280 0x7f22f01518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:16.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.831+0000 7f22effff640 1 -- 172.21.15.18:0/3545772973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22f006e280 msgr2=0x7f22f01518d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:16.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.831+0000 7f22effff640 1 --2- 172.21.15.18:0/3545772973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22f006e280 0x7f22f01518d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:16.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.831+0000 7f22effff640 1 -- 172.21.15.18:0/3545772973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22f0071df0 msgr2=0x7f22f01e5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:16.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.831+0000 7f22effff640 1 --2- 172.21.15.18:0/3545772973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22f0071df0 0x7f22f01e5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:16.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.831+0000 7f22effff640 1 -- 172.21.15.18:0/3545772973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22f01e56c0 con 0x7f22f00d1010 2024-09-19T09:18:16.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.831+0000 7f22effff640 1 --2- 172.21.15.18:0/3545772973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22f00d1010 0x7f22f01f5620 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f22e802ad20 tx=0x7f22e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:16.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.831+0000 7f22d7fff640 1 -- 172.21.15.18:0/3545772973 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e8041020 con 0x7f22f00d1010 2024-09-19T09:18:16.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.831+0000 7f22d7fff640 1 -- 172.21.15.18:0/3545772973 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22e80077a0 con 0x7f22f00d1010 2024-09-19T09:18:16.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.831+0000 7f22f5cf8640 1 -- 172.21.15.18:0/3545772973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22f01f5b60 con 0x7f22f00d1010 2024-09-19T09:18:16.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.831+0000 7f22d7fff640 1 -- 172.21.15.18:0/3545772973 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22e8036040 con 0x7f22f00d1010 2024-09-19T09:18:16.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.831+0000 7f22f5cf8640 1 -- 172.21.15.18:0/3545772973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22f01522b0 con 0x7f22f00d1010 2024-09-19T09:18:16.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.832+0000 7f22f5cf8640 1 -- 172.21.15.18:0/3545772973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22f00d0730 con 0x7f22f00d1010 2024-09-19T09:18:16.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.833+0000 7f22d7fff640 1 -- 172.21.15.18:0/3545772973 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f22e8044020 con 0x7f22f00d1010 2024-09-19T09:18:16.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.833+0000 7f22d7fff640 1 --2- 172.21.15.18:0/3545772973 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f22dc06c2e0 0x7f22dc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:16.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.833+0000 7f22d7fff640 1 -- 172.21.15.18:0/3545772973 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 4943+0+0 (secure 0 0 0) 0x7f22e80aba60 con 0x7f22f00d1010 2024-09-19T09:18:16.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.833+0000 7f22ef7fe640 1 --2- 172.21.15.18:0/3545772973 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f22dc06c2e0 0x7f22dc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:16.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.834+0000 7f22ef7fe640 1 --2- 172.21.15.18:0/3545772973 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f22dc06c2e0 0x7f22dc06e7a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f22e0009b40 tx=0x7f22e0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:16.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:16.837+0000 7f22d7fff640 1 -- 172.21.15.18:0/3545772973 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f22e804b030 con 0x7f22f00d1010 2024-09-19T09:18:17.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.015+0000 7f22f5cf8640 1 -- 172.21.15.18:0/3545772973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f22f0075160 con 0x7f22f00d1010 2024-09-19T09:18:17.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.016+0000 7f22d7fff640 1 -- 172.21.15.18:0/3545772973 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v96) ==== 93+0+10 (secure 0 0 0) 0x7f22f01e56c0 con 0x7f22f00d1010 2024-09-19T09:18:17.016 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-09-19T09:18:17.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.017+0000 7f22f5cf8640 1 -- 172.21.15.18:0/3545772973 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f22dc06c2e0 msgr2=0x7f22dc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:17.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.017+0000 7f22f5cf8640 1 --2- 172.21.15.18:0/3545772973 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f22dc06c2e0 0x7f22dc06e7a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f22e0009b40 tx=0x7f22e0009190 comp rx=0 tx=0).stop 2024-09-19T09:18:17.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.017+0000 7f22f5cf8640 1 -- 172.21.15.18:0/3545772973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22f00d1010 msgr2=0x7f22f01f5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:17.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.017+0000 7f22f5cf8640 1 --2- 172.21.15.18:0/3545772973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22f00d1010 0x7f22f01f5620 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f22e802ad20 tx=0x7f22e8004a40 comp rx=0 tx=0).stop 2024-09-19T09:18:17.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.017+0000 7f22f5cf8640 1 -- 172.21.15.18:0/3545772973 shutdown_connections 2024-09-19T09:18:17.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.017+0000 7f22f5cf8640 1 --2- 172.21.15.18:0/3545772973 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f22dc06c2e0 0x7f22dc06e7a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:17.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.017+0000 7f22f5cf8640 1 --2- 172.21.15.18:0/3545772973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22f00d1010 0x7f22f01f5620 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:17.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.017+0000 7f22f5cf8640 1 --2- 172.21.15.18:0/3545772973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22f0071df0 0x7f22f01e5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:17.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.017+0000 7f22f5cf8640 1 --2- 172.21.15.18:0/3545772973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22f006e280 0x7f22f01518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:17.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.017+0000 7f22f5cf8640 1 -- 172.21.15.18:0/3545772973 >> 172.21.15.18:0/3545772973 conn(0x7f22f006bc10 msgr2=0x7f22f006e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:17.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.018+0000 7f22f5cf8640 1 -- 172.21.15.18:0/3545772973 shutdown_connections 2024-09-19T09:18:17.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.018+0000 7f22f5cf8640 1 -- 172.21.15.18:0/3545772973 wait complete. 2024-09-19T09:18:17.029 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2024-09-19T09:18:17.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.131+0000 7f7af5176640 1 Processor -- start 2024-09-19T09:18:17.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.131+0000 7f7af5176640 1 -- start start 2024-09-19T09:18:17.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.132+0000 7f7af5176640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7af015ed50 0x7f7af00d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:17.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.132+0000 7f7af5176640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7af00d31b0 con 0x7f7af00d09d0 2024-09-19T09:18:17.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.132+0000 7f7af5176640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7af00d3490 con 0x7f7af00d1aa0 2024-09-19T09:18:17.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.132+0000 7f7af5176640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7af00d1ee0 con 0x7f7af015ed50 2024-09-19T09:18:17.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.132+0000 7f7aef59e640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f7af00d09d0 0x7f7af00b5200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56038/0 (socket says 172.21.15.18:56038) 2024-09-19T09:18:17.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.132+0000 7f7aef59e640 1 -- 172.21.15.18:0/2173016383 learned_addr learned my addr 172.21.15.18:0/2173016383 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:17.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.132+0000 7f7aeed9d640 1 --2- 172.21.15.18:0/2173016383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7af015ed50 0x7f7af00d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:17.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.132+0000 7f7aedd9b640 1 -- 172.21.15.18:0/2173016383 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2731060486 0 0) 0x7f7af00d31b0 con 0x7f7af00d09d0 2024-09-19T09:18:17.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.132+0000 7f7aedd9b640 1 -- 172.21.15.18:0/2173016383 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ad8003520 con 0x7f7af00d09d0 2024-09-19T09:18:17.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.132+0000 7f7aedd9b640 1 -- 172.21.15.18:0/2173016383 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2214588856 0 0) 0x7f7af00d3490 con 0x7f7af00d1aa0 2024-09-19T09:18:17.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.132+0000 7f7aedd9b640 1 -- 172.21.15.18:0/2173016383 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7af00d31b0 con 0x7f7af00d1aa0 2024-09-19T09:18:17.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.132+0000 7f7aedd9b640 1 -- 172.21.15.18:0/2173016383 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1513024020 0 0) 0x7f7ad8003520 con 0x7f7af00d09d0 2024-09-19T09:18:17.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.132+0000 7f7aedd9b640 1 -- 172.21.15.18:0/2173016383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7af015ed50 msgr2=0x7f7af00d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:17.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.132+0000 7f7aedd9b640 1 --2- 172.21.15.18:0/2173016383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7af015ed50 0x7f7af00d1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:17.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.132+0000 7f7aedd9b640 1 -- 172.21.15.18:0/2173016383 >> v1:172.21.15.162:6789/0 conn(0x7f7af00d1aa0 legacy=0x7f7af00b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:17.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.132+0000 7f7aedd9b640 1 -- 172.21.15.18:0/2173016383 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7af00d3770 con 0x7f7af00d09d0 2024-09-19T09:18:17.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.132+0000 7f7aedd9b640 1 -- 172.21.15.18:0/2173016383 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f7ae80019f0 con 0x7f7af00d09d0 2024-09-19T09:18:17.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.132+0000 7f7aedd9b640 1 -- 172.21.15.18:0/2173016383 >> v1:172.21.15.18:6789/0 conn(0x7f7af00d09d0 legacy=0x7f7af00b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:17.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.132+0000 7f7aedd9b640 1 --2- 172.21.15.18:0/2173016383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7af015ed50 0x7f7ad8003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:17.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.132+0000 7f7aedd9b640 1 --2- 172.21.15.18:0/2173016383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ad80040d0 0x7f7ad8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:17.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.133+0000 7f7aedd9b640 1 --2- 172.21.15.18:0/2173016383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ad8004d40 0x7f7ad80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:17.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.133+0000 7f7aedd9b640 1 -- 172.21.15.18:0/2173016383 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7af00d1ee0 con 0x7f7ad80040d0 2024-09-19T09:18:17.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.133+0000 7f7aedd9b640 1 -- 172.21.15.18:0/2173016383 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad800baa0 con 0x7f7ad8004d40 2024-09-19T09:18:17.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.133+0000 7f7aedd9b640 1 -- 172.21.15.18:0/2173016383 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7ad800bca0 con 0x7f7af015ed50 2024-09-19T09:18:17.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.133+0000 7f7aee59c640 1 --2- 172.21.15.18:0/2173016383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ad80040d0 0x7f7ad8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:17.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.133+0000 7f7aeed9d640 1 --2- 172.21.15.18:0/2173016383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7af015ed50 0x7f7ad8003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:17.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.133+0000 7f7aef59e640 1 --2- 172.21.15.18:0/2173016383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ad8004d40 0x7f7ad80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:17.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.133+0000 7f7aee59c640 1 -- 172.21.15.18:0/2173016383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7af015ed50 msgr2=0x7f7ad8003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:17.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.133+0000 7f7aee59c640 1 --2- 172.21.15.18:0/2173016383 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7af015ed50 0x7f7ad8003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:17.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.133+0000 7f7aee59c640 1 -- 172.21.15.18:0/2173016383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ad8004d40 msgr2=0x7f7ad80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:17.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.133+0000 7f7aee59c640 1 --2- 172.21.15.18:0/2173016383 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7ad8004d40 0x7f7ad80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:17.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.133+0000 7f7aee59c640 1 -- 172.21.15.18:0/2173016383 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad8003520 con 0x7f7ad80040d0 2024-09-19T09:18:17.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.134+0000 7f7aee59c640 1 --2- 172.21.15.18:0/2173016383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ad80040d0 0x7f7ad8004800 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7ae40018a0 tx=0x7f7ad8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e9593d1c21719e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:17.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.134+0000 7f7aedd9b640 1 -- 172.21.15.18:0/2173016383 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae40014f0 con 0x7f7ad80040d0 2024-09-19T09:18:17.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.134+0000 7f7aedd9b640 1 -- 172.21.15.18:0/2173016383 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ae40052d0 con 0x7f7ad80040d0 2024-09-19T09:18:17.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.134+0000 7f7aedd9b640 1 -- 172.21.15.18:0/2173016383 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae402ac60 con 0x7f7ad80040d0 2024-09-19T09:18:17.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.134+0000 7f7af5176640 1 -- 172.21.15.18:0/2173016383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ad80040d0 msgr2=0x7f7ad8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:17.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.134+0000 7f7af5176640 1 --2- 172.21.15.18:0/2173016383 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ad80040d0 0x7f7ad8004800 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7ae40018a0 tx=0x7f7ad8005830 comp rx=0 tx=0).stop 2024-09-19T09:18:17.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.134+0000 7f7aef59e640 1 -- 172.21.15.18:0/2173016383 reap_dead start 2024-09-19T09:18:17.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.134+0000 7f7af5176640 1 -- 172.21.15.18:0/2173016383 shutdown_connections 2024-09-19T09:18:17.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.134+0000 7f7af5176640 1 -- 172.21.15.18:0/2173016383 >> 172.21.15.18:0/2173016383 conn(0x7f7af00d4bd0 msgr2=0x7f7af00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:17.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.134+0000 7f7af5176640 1 -- 172.21.15.18:0/2173016383 shutdown_connections 2024-09-19T09:18:17.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.134+0000 7f7af5176640 1 -- 172.21.15.18:0/2173016383 wait complete. 2024-09-19T09:18:17.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.136+0000 7f7af5176640 1 Processor -- start 2024-09-19T09:18:17.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.136+0000 7f7af5176640 1 -- start start 2024-09-19T09:18:17.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.137+0000 7f7af5176640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ad80040d0 0x7f7af014b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:17.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.137+0000 7f7af5176640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7af015f3a0 0x7f7af0157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:17.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.137+0000 7f7af5176640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7af015f820 0x7f7af0157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:17.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.137+0000 7f7af5176640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7af00d3d30 con 0x7f7ad80040d0 2024-09-19T09:18:17.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.137+0000 7f7af5176640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7af00b45d0 con 0x7f7af015f820 2024-09-19T09:18:17.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.137+0000 7f7af5176640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7af015f130 con 0x7f7af015f3a0 2024-09-19T09:18:17.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.137+0000 7f7aeed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ad80040d0 0x7f7af014b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:17.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.137+0000 7f7aeed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ad80040d0 0x7f7af014b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39408/0 (socket says 172.21.15.18:39408) 2024-09-19T09:18:17.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.137+0000 7f7aeed9d640 1 -- 172.21.15.18:0/937835060 learned_addr learned my addr 172.21.15.18:0/937835060 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:17.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.137+0000 7f7aee59c640 1 --2- 172.21.15.18:0/937835060 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7af015f3a0 0x7f7af0157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:17.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.137+0000 7f7aef59e640 1 --2- 172.21.15.18:0/937835060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7af015f820 0x7f7af0157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:17.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.137+0000 7f7aeed9d640 1 -- 172.21.15.18:0/937835060 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7af015f3a0 msgr2=0x7f7af0157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:17.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.137+0000 7f7aeed9d640 1 --2- 172.21.15.18:0/937835060 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7af015f3a0 0x7f7af0157830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:17.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.137+0000 7f7aeed9d640 1 -- 172.21.15.18:0/937835060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7af015f820 msgr2=0x7f7af0157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:17.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.137+0000 7f7aeed9d640 1 --2- 172.21.15.18:0/937835060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7af015f820 0x7f7af0157d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:17.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.137+0000 7f7aeed9d640 1 -- 172.21.15.18:0/937835060 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7af00b95b0 con 0x7f7ad80040d0 2024-09-19T09:18:17.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.137+0000 7f7aeed9d640 1 --2- 172.21.15.18:0/937835060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ad80040d0 0x7f7af014b160 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0011630 tx=0x7f7ae0011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:17.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.137+0000 7f7ad77fe640 1 -- 172.21.15.18:0/937835060 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae000f920 con 0x7f7ad80040d0 2024-09-19T09:18:17.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.137+0000 7f7ad77fe640 1 -- 172.21.15.18:0/937835060 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ae000fac0 con 0x7f7ad80040d0 2024-09-19T09:18:17.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.137+0000 7f7af5176640 1 -- 172.21.15.18:0/937835060 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7af00b9890 con 0x7f7ad80040d0 2024-09-19T09:18:17.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.137+0000 7f7ad77fe640 1 -- 172.21.15.18:0/937835060 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ae000fe70 con 0x7f7ad80040d0 2024-09-19T09:18:17.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.138+0000 7f7af5176640 1 -- 172.21.15.18:0/937835060 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7af00b9e50 con 0x7f7ad80040d0 2024-09-19T09:18:17.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.138+0000 7f7af5176640 1 -- 172.21.15.18:0/937835060 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7af00d0e80 con 0x7f7ad80040d0 2024-09-19T09:18:17.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.139+0000 7f7ad77fe640 1 -- 172.21.15.18:0/937835060 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7ae0015460 con 0x7f7ad80040d0 2024-09-19T09:18:17.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.139+0000 7f7ad77fe640 1 --2- 172.21.15.18:0/937835060 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7adc06c2e0 0x7f7adc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:17.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.139+0000 7f7ad77fe640 1 -- 172.21.15.18:0/937835060 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 4943+0+0 (secure 0 0 0) 0x7f7ae008b970 con 0x7f7ad80040d0 2024-09-19T09:18:17.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.140+0000 7f7aee59c640 1 --2- 172.21.15.18:0/937835060 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7adc06c2e0 0x7f7adc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:17.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.140+0000 7f7aee59c640 1 --2- 172.21.15.18:0/937835060 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7adc06c2e0 0x7f7adc06e7a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4032000 tx=0x7f7ae4009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:17.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.144+0000 7f7ad77fe640 1 -- 172.21.15.18:0/937835060 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7ae0019030 con 0x7f7ad80040d0 2024-09-19T09:18:17.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:17.388+0000 7f7af5176640 1 -- 172.21.15.18:0/937835060 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) -- 0x7f7af00b2d10 con 0x7f7ad80040d0 2024-09-19T09:18:18.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.394+0000 7f7ad77fe640 1 -- 172.21.15.18:0/937835060 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v245) ==== 140+0+0 (secure 0 0 0) 0x7f7ae005a470 con 0x7f7ad80040d0 2024-09-19T09:18:18.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.397+0000 7f7af5176640 1 -- 172.21.15.18:0/937835060 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7adc06c2e0 msgr2=0x7f7adc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:18.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.397+0000 7f7af5176640 1 --2- 172.21.15.18:0/937835060 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7adc06c2e0 0x7f7adc06e7a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4032000 tx=0x7f7ae4009030 comp rx=0 tx=0).stop 2024-09-19T09:18:18.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.397+0000 7f7af5176640 1 -- 172.21.15.18:0/937835060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ad80040d0 msgr2=0x7f7af014b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:18.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.397+0000 7f7af5176640 1 --2- 172.21.15.18:0/937835060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ad80040d0 0x7f7af014b160 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0011630 tx=0x7f7ae0011af0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.397+0000 7f7af5176640 1 -- 172.21.15.18:0/937835060 shutdown_connections 2024-09-19T09:18:18.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.397+0000 7f7af5176640 1 --2- 172.21.15.18:0/937835060 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7adc06c2e0 0x7f7adc06e7a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.397+0000 7f7af5176640 1 --2- 172.21.15.18:0/937835060 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7af015f820 0x7f7af0157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.397+0000 7f7af5176640 1 --2- 172.21.15.18:0/937835060 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7af015f3a0 0x7f7af0157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.397+0000 7f7af5176640 1 --2- 172.21.15.18:0/937835060 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7ad80040d0 0x7f7af014b160 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.397+0000 7f7af5176640 1 -- 172.21.15.18:0/937835060 >> 172.21.15.18:0/937835060 conn(0x7f7af00d4bd0 msgr2=0x7f7af00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:18.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.397+0000 7f7af5176640 1 -- 172.21.15.18:0/937835060 shutdown_connections 2024-09-19T09:18:18.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.397+0000 7f7af5176640 1 -- 172.21.15.18:0/937835060 wait complete. 2024-09-19T09:18:18.412 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2024-09-19T09:18:18.533 INFO:teuthology.orchestra.run.smithi018.stdout:{"osd_objectstore":"memstore"} 2024-09-19T09:18:18.533 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2024-09-19T09:18:18.534 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-19T09:18:18.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.638+0000 7f888513b640 1 Processor -- start 2024-09-19T09:18:18.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.638+0000 7f888513b640 1 -- start start 2024-09-19T09:18:18.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.639+0000 7f888513b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f888015dc30 0x7f88800b6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:18.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.639+0000 7f888513b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f88800b69c0 0x7f888015f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:18.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.639+0000 7f888513b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f888015aa50 con 0x7f888015a670 2024-09-19T09:18:18.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.639+0000 7f888513b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f88800b6150 con 0x7f88800b69c0 2024-09-19T09:18:18.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.639+0000 7f888513b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f888015e310 con 0x7f888015dc30 2024-09-19T09:18:18.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.639+0000 7f887f59e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f88800b69c0 0x7f888015f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:18.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.639+0000 7f887f59e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f88800b69c0 0x7f888015f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39414/0 (socket says 172.21.15.18:39414) 2024-09-19T09:18:18.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.639+0000 7f887f59e640 1 -- 172.21.15.18:0/393512825 learned_addr learned my addr 172.21.15.18:0/393512825 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:18.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.639+0000 7f887f59e640 1 -- 172.21.15.18:0/393512825 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f888015dc30 msgr2=0x7f88800b6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:18.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.639+0000 7f887f59e640 1 --2- 172.21.15.18:0/393512825 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f888015dc30 0x7f88800b6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.639+0000 7f887f59e640 1 -- 172.21.15.18:0/393512825 >> v1:172.21.15.162:6789/0 conn(0x7f888015a670 legacy=0x7f88800b5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:18.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.639+0000 7f887f59e640 1 -- 172.21.15.18:0/393512825 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f888015e5f0 con 0x7f88800b69c0 2024-09-19T09:18:18.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.640+0000 7f887f59e640 1 --2- 172.21.15.18:0/393512825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88800b69c0 0x7f888015f0d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f8878009870 tx=0x7f887802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36474dd62d71fe7b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:18.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.640+0000 7f887dd9b640 1 -- 172.21.15.18:0/393512825 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8878037070 con 0x7f88800b69c0 2024-09-19T09:18:18.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.640+0000 7f887dd9b640 1 -- 172.21.15.18:0/393512825 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8878032440 con 0x7f88800b69c0 2024-09-19T09:18:18.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.640+0000 7f887dd9b640 1 -- 172.21.15.18:0/393512825 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8878032810 con 0x7f88800b69c0 2024-09-19T09:18:18.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.641+0000 7f888513b640 1 -- 172.21.15.18:0/393512825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88800b69c0 msgr2=0x7f888015f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:18.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.641+0000 7f888513b640 1 --2- 172.21.15.18:0/393512825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88800b69c0 0x7f888015f0d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f8878009870 tx=0x7f887802a180 comp rx=0 tx=0).stop 2024-09-19T09:18:18.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.641+0000 7f888513b640 1 -- 172.21.15.18:0/393512825 shutdown_connections 2024-09-19T09:18:18.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.641+0000 7f888513b640 1 --2- 172.21.15.18:0/393512825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f88800b69c0 0x7f888015f0d0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.641+0000 7f888513b640 1 --2- 172.21.15.18:0/393512825 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f888015dc30 0x7f88800b6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.641+0000 7f888513b640 1 -- 172.21.15.18:0/393512825 >> 172.21.15.18:0/393512825 conn(0x7f888009b9d0 msgr2=0x7f888009bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:18.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.641+0000 7f888513b640 1 -- 172.21.15.18:0/393512825 shutdown_connections 2024-09-19T09:18:18.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.641+0000 7f888513b640 1 -- 172.21.15.18:0/393512825 wait complete. 2024-09-19T09:18:18.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.642+0000 7f888513b640 1 Processor -- start 2024-09-19T09:18:18.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.642+0000 7f888513b640 1 -- start start 2024-09-19T09:18:18.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.643+0000 7f888513b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f88800b69c0 0x7f888009d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:18.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.643+0000 7f888513b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f888015a670 0x7f8880155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:18.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.643+0000 7f888513b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f888015dc30 0x7f8880156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:18.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.643+0000 7f888513b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f888015f790 con 0x7f888015a670 2024-09-19T09:18:18.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.643+0000 7f888513b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f888015f610 con 0x7f888015dc30 2024-09-19T09:18:18.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.643+0000 7f888513b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f888015f910 con 0x7f88800b69c0 2024-09-19T09:18:18.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.643+0000 7f887e59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f888015a670 0x7f8880155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:18.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.643+0000 7f887e59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f888015a670 0x7f8880155260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39420/0 (socket says 172.21.15.18:39420) 2024-09-19T09:18:18.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.643+0000 7f887e59c640 1 -- 172.21.15.18:0/882169285 learned_addr learned my addr 172.21.15.18:0/882169285 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:18.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.643+0000 7f887ed9d640 1 --2- 172.21.15.18:0/882169285 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f88800b69c0 0x7f888009d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:18.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.643+0000 7f887f59e640 1 --2- 172.21.15.18:0/882169285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f888015dc30 0x7f8880156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:18.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.643+0000 7f887e59c640 1 -- 172.21.15.18:0/882169285 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f88800b69c0 msgr2=0x7f888009d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:18.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.643+0000 7f887e59c640 1 --2- 172.21.15.18:0/882169285 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f88800b69c0 0x7f888009d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.643+0000 7f887e59c640 1 -- 172.21.15.18:0/882169285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f888015dc30 msgr2=0x7f8880156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:18.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.643+0000 7f887e59c640 1 --2- 172.21.15.18:0/882169285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f888015dc30 0x7f8880156de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.643+0000 7f887e59c640 1 -- 172.21.15.18:0/882169285 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88801544a0 con 0x7f888015a670 2024-09-19T09:18:18.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.643+0000 7f887f59e640 1 --2- 172.21.15.18:0/882169285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f888015dc30 0x7f8880156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:18.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.644+0000 7f887e59c640 1 --2- 172.21.15.18:0/882169285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f888015a670 0x7f8880155260 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f887400b9c0 tx=0x7f887400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:18.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.644+0000 7f88677fe640 1 -- 172.21.15.18:0/882169285 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8874019070 con 0x7f888015a670 2024-09-19T09:18:18.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.644+0000 7f88677fe640 1 -- 172.21.15.18:0/882169285 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f887400cba0 con 0x7f888015a670 2024-09-19T09:18:18.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.644+0000 7f88677fe640 1 -- 172.21.15.18:0/882169285 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8874014440 con 0x7f888015a670 2024-09-19T09:18:18.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.644+0000 7f888513b640 1 -- 172.21.15.18:0/882169285 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8880154780 con 0x7f888015a670 2024-09-19T09:18:18.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.644+0000 7f888513b640 1 -- 172.21.15.18:0/882169285 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8880154d40 con 0x7f888015a670 2024-09-19T09:18:18.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.645+0000 7f888513b640 1 -- 172.21.15.18:0/882169285 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8880154f40 con 0x7f888015a670 2024-09-19T09:18:18.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.645+0000 7f88677fe640 1 -- 172.21.15.18:0/882169285 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f887401c070 con 0x7f888015a670 2024-09-19T09:18:18.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.646+0000 7f88677fe640 1 --2- 172.21.15.18:0/882169285 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f886c06c2b0 0x7f886c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:18.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.646+0000 7f88677fe640 1 -- 172.21.15.18:0/882169285 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 4943+0+0 (secure 0 0 0) 0x7f887408af00 con 0x7f888015a670 2024-09-19T09:18:18.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.646+0000 7f887ed9d640 1 --2- 172.21.15.18:0/882169285 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f886c06c2b0 0x7f886c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:18.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.647+0000 7f887ed9d640 1 --2- 172.21.15.18:0/882169285 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f886c06c2b0 0x7f886c06e770 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8870007fd0 tx=0x7f8870009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:18.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.650+0000 7f88677fe640 1 -- 172.21.15.18:0/882169285 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8880154f40 con 0x7f888015a670 2024-09-19T09:18:18.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.825+0000 7f888513b640 1 -- 172.21.15.18:0/882169285 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f888009c5f0 con 0x7f888015a670 2024-09-19T09:18:18.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.828+0000 7f88677fe640 1 -- 172.21.15.18:0/882169285 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f8874059970 con 0x7f888015a670 2024-09-19T09:18:18.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.831+0000 7f888513b640 1 -- 172.21.15.18:0/882169285 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f886c06c2b0 msgr2=0x7f886c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:18.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.831+0000 7f888513b640 1 --2- 172.21.15.18:0/882169285 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f886c06c2b0 0x7f886c06e770 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8870007fd0 tx=0x7f8870009040 comp rx=0 tx=0).stop 2024-09-19T09:18:18.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.831+0000 7f888513b640 1 -- 172.21.15.18:0/882169285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f888015a670 msgr2=0x7f8880155260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:18.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.831+0000 7f888513b640 1 --2- 172.21.15.18:0/882169285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f888015a670 0x7f8880155260 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f887400b9c0 tx=0x7f887400be80 comp rx=0 tx=0).stop 2024-09-19T09:18:18.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.831+0000 7f888513b640 1 -- 172.21.15.18:0/882169285 shutdown_connections 2024-09-19T09:18:18.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.831+0000 7f888513b640 1 --2- 172.21.15.18:0/882169285 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f886c06c2b0 0x7f886c06e770 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.831+0000 7f888513b640 1 --2- 172.21.15.18:0/882169285 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f888015dc30 0x7f8880156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.831+0000 7f888513b640 1 --2- 172.21.15.18:0/882169285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f888015a670 0x7f8880155260 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.831+0000 7f888513b640 1 --2- 172.21.15.18:0/882169285 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f88800b69c0 0x7f888009d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:18.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.831+0000 7f888513b640 1 -- 172.21.15.18:0/882169285 >> 172.21.15.18:0/882169285 conn(0x7f888009b9d0 msgr2=0x7f888015ac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:18.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.831+0000 7f888513b640 1 -- 172.21.15.18:0/882169285 shutdown_connections 2024-09-19T09:18:18.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:18.831+0000 7f888513b640 1 -- 172.21.15.18:0/882169285 wait complete. 2024-09-19T09:18:18.843 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T09:18:18.843 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:18:18.881 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:18:18.923 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T09:18:18.923 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:18:18.923 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:18:18.939 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17075 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T09:18:18.940 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:18:18.940 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:18:18.982 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3252 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T09:18:18.982 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:18:18.983 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:18:18.998 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17075 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T09:18:18.998 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:18:18.999 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:18:19.042 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3252 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T09:18:19.042 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-19T09:18:19.042 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:18:19.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.144+0000 7f68a5933640 1 Processor -- start 2024-09-19T09:18:19.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.144+0000 7f68a5933640 1 -- start start 2024-09-19T09:18:19.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.145+0000 7f68a5933640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f68a015eea0 0x7f68a006bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:19.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.145+0000 7f68a5933640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f68a00ced00 0x7f68a006c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:19.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.145+0000 7f68a5933640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68a00b6db0 con 0x7f68a00b60a0 2024-09-19T09:18:19.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.145+0000 7f68a5933640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f68a00b7070 con 0x7f68a00ced00 2024-09-19T09:18:19.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.145+0000 7f68a5933640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f68a00b1390 con 0x7f68a015eea0 2024-09-19T09:18:19.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.145+0000 7f689e7fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f68a00ced00 0x7f68a006c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:19.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.145+0000 7f689e7fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f68a00ced00 0x7f68a006c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39424/0 (socket says 172.21.15.18:39424) 2024-09-19T09:18:19.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.145+0000 7f689e7fc640 1 -- 172.21.15.18:0/777622991 learned_addr learned my addr 172.21.15.18:0/777622991 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:19.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.145+0000 7f689effd640 1 --2- 172.21.15.18:0/777622991 >> v2:172.21.15.162:3300/0 conn(0x7f68a015eea0 0x7f68a006bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:19.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.145+0000 7f689e7fc640 1 -- 172.21.15.18:0/777622991 >> v2:172.21.15.162:3300/0 conn(0x7f68a015eea0 msgr2=0x7f68a006bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:19.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.145+0000 7f689e7fc640 1 --2- 172.21.15.18:0/777622991 >> v2:172.21.15.162:3300/0 conn(0x7f68a015eea0 0x7f68a006bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:19.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.145+0000 7f689e7fc640 1 -- 172.21.15.18:0/777622991 >> v1:172.21.15.162:6789/0 conn(0x7f68a00b60a0 legacy=0x7f68a00b6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:19.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.145+0000 7f689e7fc640 1 -- 172.21.15.18:0/777622991 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a00b1670 con 0x7f68a00ced00 2024-09-19T09:18:19.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.146+0000 7f689e7fc640 1 --2- 172.21.15.18:0/777622991 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68a00ced00 0x7f68a006c150 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f68a00cec20 tx=0x7f688802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c74b62e5af6963c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:19.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.146+0000 7f689dffb640 1 -- 172.21.15.18:0/777622991 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6888037070 con 0x7f68a00ced00 2024-09-19T09:18:19.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.146+0000 7f689dffb640 1 -- 172.21.15.18:0/777622991 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6888032440 con 0x7f68a00ced00 2024-09-19T09:18:19.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.146+0000 7f689dffb640 1 -- 172.21.15.18:0/777622991 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6888032810 con 0x7f68a00ced00 2024-09-19T09:18:19.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.147+0000 7f68a5933640 1 -- 172.21.15.18:0/777622991 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68a00ced00 msgr2=0x7f68a006c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:19.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.147+0000 7f68a5933640 1 --2- 172.21.15.18:0/777622991 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68a00ced00 0x7f68a006c150 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f68a00cec20 tx=0x7f688802a230 comp rx=0 tx=0).stop 2024-09-19T09:18:19.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.147+0000 7f68a5933640 1 -- 172.21.15.18:0/777622991 shutdown_connections 2024-09-19T09:18:19.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.147+0000 7f68a5933640 1 --2- 172.21.15.18:0/777622991 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68a00ced00 0x7f68a006c150 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:19.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.147+0000 7f68a5933640 1 --2- 172.21.15.18:0/777622991 >> v2:172.21.15.162:3300/0 conn(0x7f68a015eea0 0x7f68a006bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:19.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.147+0000 7f68a5933640 1 -- 172.21.15.18:0/777622991 >> 172.21.15.18:0/777622991 conn(0x7f68a00731b0 msgr2=0x7f68a00735c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:19.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.147+0000 7f68a5933640 1 -- 172.21.15.18:0/777622991 shutdown_connections 2024-09-19T09:18:19.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.147+0000 7f68a5933640 1 -- 172.21.15.18:0/777622991 wait complete. 2024-09-19T09:18:19.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.148+0000 7f68a5933640 1 Processor -- start 2024-09-19T09:18:19.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.148+0000 7f68a5933640 1 -- start start 2024-09-19T09:18:19.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.149+0000 7f68a5933640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68a00b60a0 0x7f68a009a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:19.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.149+0000 7f68a5933640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68a00ced00 0x7f68a0156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:19.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.149+0000 7f68a5933640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68a015eea0 0x7f68a01519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:19.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.149+0000 7f68a5933640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f68a00b1b90 con 0x7f68a015eea0 2024-09-19T09:18:19.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.149+0000 7f68a5933640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f68a00b1040 con 0x7f68a00ced00 2024-09-19T09:18:19.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.149+0000 7f68a5933640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f68a00b1d10 con 0x7f68a00b60a0 2024-09-19T09:18:19.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.149+0000 7f689f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68a015eea0 0x7f68a01519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:19.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.149+0000 7f689f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68a015eea0 0x7f68a01519f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39430/0 (socket says 172.21.15.18:39430) 2024-09-19T09:18:19.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.149+0000 7f689f7fe640 1 -- 172.21.15.18:0/176836515 learned_addr learned my addr 172.21.15.18:0/176836515 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:19.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.149+0000 7f689e7fc640 1 --2- 172.21.15.18:0/176836515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68a00ced00 0x7f68a0156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:19.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.149+0000 7f689effd640 1 --2- 172.21.15.18:0/176836515 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68a00b60a0 0x7f68a009a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:19.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.149+0000 7f689f7fe640 1 -- 172.21.15.18:0/176836515 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68a00b60a0 msgr2=0x7f68a009a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:19.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.149+0000 7f689f7fe640 1 --2- 172.21.15.18:0/176836515 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68a00b60a0 0x7f68a009a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:19.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.149+0000 7f689f7fe640 1 -- 172.21.15.18:0/176836515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68a00ced00 msgr2=0x7f68a0156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:19.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.149+0000 7f689f7fe640 1 --2- 172.21.15.18:0/176836515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68a00ced00 0x7f68a0156060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:19.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.149+0000 7f689f7fe640 1 -- 172.21.15.18:0/176836515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a009ae60 con 0x7f68a015eea0 2024-09-19T09:18:19.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.150+0000 7f689f7fe640 1 --2- 172.21.15.18:0/176836515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68a015eea0 0x7f68a01519f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f689800c780 tx=0x7f689800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:19.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.150+0000 7f6897fff640 1 -- 172.21.15.18:0/176836515 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6898004b60 con 0x7f68a015eea0 2024-09-19T09:18:19.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.150+0000 7f6897fff640 1 -- 172.21.15.18:0/176836515 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6898004d00 con 0x7f68a015eea0 2024-09-19T09:18:19.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.150+0000 7f68a5933640 1 -- 172.21.15.18:0/176836515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68a0156b60 con 0x7f68a015eea0 2024-09-19T09:18:19.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.150+0000 7f6897fff640 1 -- 172.21.15.18:0/176836515 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689800aa90 con 0x7f68a015eea0 2024-09-19T09:18:19.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.150+0000 7f68a5933640 1 -- 172.21.15.18:0/176836515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68a015f670 con 0x7f68a015eea0 2024-09-19T09:18:19.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.151+0000 7f68a5933640 1 -- 172.21.15.18:0/176836515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68a015f490 con 0x7f68a015eea0 2024-09-19T09:18:19.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.151+0000 7f6897fff640 1 -- 172.21.15.18:0/176836515 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f689800ac30 con 0x7f68a015eea0 2024-09-19T09:18:19.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.152+0000 7f6897fff640 1 --2- 172.21.15.18:0/176836515 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f688006c2b0 0x7f688006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:19.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.152+0000 7f6897fff640 1 -- 172.21.15.18:0/176836515 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 4943+0+0 (secure 0 0 0) 0x7f689808b510 con 0x7f68a015eea0 2024-09-19T09:18:19.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.152+0000 7f689effd640 1 --2- 172.21.15.18:0/176836515 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f688006c2b0 0x7f688006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:19.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.152+0000 7f689effd640 1 --2- 172.21.15.18:0/176836515 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f688006c2b0 0x7f688006e770 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f68a00b0350 tx=0x7f6890008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:19.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.156+0000 7f6897fff640 1 -- 172.21.15.18:0/176836515 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f68a015f490 con 0x7f68a015eea0 2024-09-19T09:18:19.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.367+0000 7f68a5933640 1 -- 172.21.15.18:0/176836515 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f68a0074080 con 0x7f68a015eea0 2024-09-19T09:18:19.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.367+0000 7f6897fff640 1 -- 172.21.15.18:0/176836515 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+3917 (secure 0 0 0) 0x7f68a009ae60 con 0x7f68a015eea0 2024-09-19T09:18:19.368 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:19.368 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":37,"btime":"2024-09-19T09:18:12:910756+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5228,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1906118343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1906118343},{"type":"v1","addr":"172.21.15.162:6837","nonce":1906118343}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32},{"gid":5635,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1051418414","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1051418414},{"type":"v1","addr":"172.21.15.162:6835","nonce":1051418414}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":5892,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1630984812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1630984812},{"type":"v1","addr":"172.21.15.18:6834","nonce":1630984812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":31},{"gid":6126,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1185978176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1185978176},{"type":"v1","addr":"172.21.15.18:6835","nonce":1185978176}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":37}],"filesystems":[]} 2024-09-19T09:18:19.368 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 37 2024-09-19T09:18:19.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.370+0000 7f68a5933640 1 -- 172.21.15.18:0/176836515 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f688006c2b0 msgr2=0x7f688006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:19.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.370+0000 7f68a5933640 1 --2- 172.21.15.18:0/176836515 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f688006c2b0 0x7f688006e770 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f68a00b0350 tx=0x7f6890008040 comp rx=0 tx=0).stop 2024-09-19T09:18:19.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.370+0000 7f68a5933640 1 -- 172.21.15.18:0/176836515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68a015eea0 msgr2=0x7f68a01519f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:19.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.370+0000 7f68a5933640 1 --2- 172.21.15.18:0/176836515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68a015eea0 0x7f68a01519f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f689800c780 tx=0x7f689800cc40 comp rx=0 tx=0).stop 2024-09-19T09:18:19.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.370+0000 7f68a5933640 1 -- 172.21.15.18:0/176836515 shutdown_connections 2024-09-19T09:18:19.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.370+0000 7f68a5933640 1 --2- 172.21.15.18:0/176836515 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f688006c2b0 0x7f688006e770 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:19.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.370+0000 7f68a5933640 1 --2- 172.21.15.18:0/176836515 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68a015eea0 0x7f68a01519f0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:19.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.370+0000 7f68a5933640 1 --2- 172.21.15.18:0/176836515 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68a00ced00 0x7f68a0156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:19.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.370+0000 7f68a5933640 1 --2- 172.21.15.18:0/176836515 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68a00b60a0 0x7f68a009a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:19.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.370+0000 7f68a5933640 1 -- 172.21.15.18:0/176836515 >> 172.21.15.18:0/176836515 conn(0x7f68a00731b0 msgr2=0x7f68a00d0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:19.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.370+0000 7f68a5933640 1 -- 172.21.15.18:0/176836515 shutdown_connections 2024-09-19T09:18:19.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.370+0000 7f68a5933640 1 -- 172.21.15.18:0/176836515 wait complete. 2024-09-19T09:18:19.382 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T09:18:19.382 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-19T09:18:19.382 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T09:18:19.382 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:18:19.383 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T09:18:19.383 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-19T09:18:19.383 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T09:18:19.383 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:18:19.383 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T09:18:19.383 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-19T09:18:19.384 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T09:18:19.384 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:18:19.384 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T09:18:19.384 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-19T09:18:19.384 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T09:18:19.384 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:18:19.392 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T09:18:19.392 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T09:18:19.393 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T09:18:19.393 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T09:18:19.396 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T09:18:19.396 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T09:18:19.397 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T09:18:19.397 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T09:18:19.435 INFO:tasks.ceph.mds.a:Started 2024-09-19T09:18:19.435 DEBUG:teuthology.parallel:result is None 2024-09-19T09:18:19.436 INFO:tasks.ceph.mds.c:Started 2024-09-19T09:18:19.436 DEBUG:teuthology.parallel:result is None 2024-09-19T09:18:19.439 INFO:tasks.ceph.mds.b:Started 2024-09-19T09:18:19.439 DEBUG:teuthology.parallel:result is None 2024-09-19T09:18:19.440 INFO:tasks.ceph.mds.d:Started 2024-09-19T09:18:19.440 DEBUG:teuthology.parallel:result is None 2024-09-19T09:18:19.440 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-19T09:18:19.513 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-09-19T09:18:19.514 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2024-09-19T09:18:19.521 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-09-19T09:18:19.521 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-09-19T09:18:19.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.548+0000 7f2efe0dd640 1 Processor -- start 2024-09-19T09:18:19.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.548+0000 7f2efe0dd640 1 -- start start 2024-09-19T09:18:19.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.549+0000 7f2efe0dd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2ef815eda0 0x7f2ef80d5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:19.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.549+0000 7f2efe0dd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ef80d0480 0x7f2ef80d35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:19.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.549+0000 7f2efe0dd640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ef80d0bf0 con 0x7f2ef80d3af0 2024-09-19T09:18:19.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.549+0000 7f2efe0dd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2ef80d2880 con 0x7f2ef815eda0 2024-09-19T09:18:19.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.549+0000 7f2efe0dd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2ef80d3120 con 0x7f2ef80d0480 2024-09-19T09:18:19.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.549+0000 7f2ef77fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2ef815eda0 0x7f2ef80d5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:19.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.549+0000 7f2ef6ffd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ef80d0480 0x7f2ef80d35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:19.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.550+0000 7f2ef7fff640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f2ef80d3af0 0x7f2ef80d1630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:46168/0 (socket says 172.21.15.18:46168) 2024-09-19T09:18:19.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.550+0000 7f2ef77fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2ef815eda0 0x7f2ef80d5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:59940/0 (socket says 172.21.15.18:59940) 2024-09-19T09:18:19.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.550+0000 7f2ef6ffd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ef80d0480 0x7f2ef80d35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:41684/0 (socket says 172.21.15.18:41684) 2024-09-19T09:18:19.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.550+0000 7f2ef7fff640 1 -- 172.21.15.18:0/282034491 learned_addr learned my addr 172.21.15.18:0/282034491 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:19.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.550+0000 7f2ef6ffd640 1 -- 172.21.15.18:0/282034491 >> v2:172.21.15.162:3300/0 conn(0x7f2ef815eda0 msgr2=0x7f2ef80d5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:19.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.550+0000 7f2ef6ffd640 1 --2- 172.21.15.18:0/282034491 >> v2:172.21.15.162:3300/0 conn(0x7f2ef815eda0 0x7f2ef80d5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:19.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.550+0000 7f2ef6ffd640 1 -- 172.21.15.18:0/282034491 >> v1:172.21.15.162:6789/0 conn(0x7f2ef80d3af0 legacy=0x7f2ef80d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:19.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.550+0000 7f2ef6ffd640 1 -- 172.21.15.18:0/282034491 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef80d2ad0 con 0x7f2ef80d0480 2024-09-19T09:18:19.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.550+0000 7f2ef77fe640 1 --2- 172.21.15.18:0/282034491 >> v2:172.21.15.162:3300/0 conn(0x7f2ef815eda0 0x7f2ef80d5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:18:19.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.551+0000 7f2ef6ffd640 1 --2- 172.21.15.18:0/282034491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ef80d0480 0x7f2ef80d35b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2eec0097a0 tx=0x7f2eec02a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3ae8c496241414f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:19.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.551+0000 7f2ef67fc640 1 -- 172.21.15.18:0/282034491 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec037070 con 0x7f2ef80d0480 2024-09-19T09:18:19.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.551+0000 7f2ef67fc640 1 -- 172.21.15.18:0/282034491 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eec02ad10 con 0x7f2ef80d0480 2024-09-19T09:18:19.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.551+0000 7f2ef67fc640 1 -- 172.21.15.18:0/282034491 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec032660 con 0x7f2ef80d0480 2024-09-19T09:18:19.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.551+0000 7f2efe0dd640 1 -- 172.21.15.18:0/282034491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ef80d0480 msgr2=0x7f2ef80d35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:19.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.551+0000 7f2efe0dd640 1 --2- 172.21.15.18:0/282034491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ef80d0480 0x7f2ef80d35b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2eec0097a0 tx=0x7f2eec02a080 comp rx=0 tx=0).stop 2024-09-19T09:18:19.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.551+0000 7f2efe0dd640 1 -- 172.21.15.18:0/282034491 shutdown_connections 2024-09-19T09:18:19.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.551+0000 7f2efe0dd640 1 --2- 172.21.15.18:0/282034491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ef80d0480 0x7f2ef80d35b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:19.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.551+0000 7f2efe0dd640 1 --2- 172.21.15.18:0/282034491 >> v2:172.21.15.162:3300/0 conn(0x7f2ef815eda0 0x7f2ef80d5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:19.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.552+0000 7f2efe0dd640 1 -- 172.21.15.18:0/282034491 >> 172.21.15.18:0/282034491 conn(0x7f2ef809df40 msgr2=0x7f2ef80d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:19.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.552+0000 7f2efe0dd640 1 -- 172.21.15.18:0/282034491 shutdown_connections 2024-09-19T09:18:19.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.552+0000 7f2efe0dd640 1 -- 172.21.15.18:0/282034491 wait complete. 2024-09-19T09:18:19.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.553+0000 7f2efe0dd640 1 Processor -- start 2024-09-19T09:18:19.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.553+0000 7f2efe0dd640 1 -- start start 2024-09-19T09:18:19.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.554+0000 7f2efe0dd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ef80d0480 0x7f2ef80c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:19.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.554+0000 7f2efe0dd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ef815eda0 0x7f2ef815be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:19.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.554+0000 7f2efe0dd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ef80c87e0 0x7f2ef80cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:19.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.554+0000 7f2efe0dd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef815f180 con 0x7f2ef815eda0 2024-09-19T09:18:19.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.554+0000 7f2efe0dd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef80d08c0 con 0x7f2ef80c87e0 2024-09-19T09:18:19.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.554+0000 7f2efe0dd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2ef815f300 con 0x7f2ef80d0480 2024-09-19T09:18:19.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.554+0000 7f2ef6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ef815eda0 0x7f2ef815be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:19.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.554+0000 7f2ef6ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ef815eda0 0x7f2ef815be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39460/0 (socket says 172.21.15.18:39460) 2024-09-19T09:18:19.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.554+0000 7f2ef6ffd640 1 -- 172.21.15.18:0/1999213986 learned_addr learned my addr 172.21.15.18:0/1999213986 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:19.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.554+0000 7f2ef7fff640 1 --2- 172.21.15.18:0/1999213986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ef80c87e0 0x7f2ef80cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:19.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.554+0000 7f2ef77fe640 1 --2- 172.21.15.18:0/1999213986 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ef80d0480 0x7f2ef80c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:19.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.554+0000 7f2ef7fff640 1 -- 172.21.15.18:0/1999213986 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ef80d0480 msgr2=0x7f2ef80c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:19.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.554+0000 7f2ef7fff640 1 --2- 172.21.15.18:0/1999213986 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ef80d0480 0x7f2ef80c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:19.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.554+0000 7f2ef7fff640 1 -- 172.21.15.18:0/1999213986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ef815eda0 msgr2=0x7f2ef815be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:19.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.554+0000 7f2ef7fff640 1 --2- 172.21.15.18:0/1999213986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ef815eda0 0x7f2ef815be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:19.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.554+0000 7f2ef7fff640 1 -- 172.21.15.18:0/1999213986 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef80c8ce0 con 0x7f2ef80c87e0 2024-09-19T09:18:19.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.554+0000 7f2ef6ffd640 1 --2- 172.21.15.18:0/1999213986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ef815eda0 0x7f2ef815be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:18:19.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.555+0000 7f2ef7fff640 1 --2- 172.21.15.18:0/1999213986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ef80c87e0 0x7f2ef80cbd80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000c8c0 tx=0x7f2ef000cd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:19.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.555+0000 7f2edffff640 1 -- 172.21.15.18:0/1999213986 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef0018070 con 0x7f2ef80c87e0 2024-09-19T09:18:19.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.555+0000 7f2edffff640 1 -- 172.21.15.18:0/1999213986 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ef000a640 con 0x7f2ef80c87e0 2024-09-19T09:18:19.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.555+0000 7f2efe0dd640 1 -- 172.21.15.18:0/1999213986 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ef80c8fc0 con 0x7f2ef80c87e0 2024-09-19T09:18:19.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.555+0000 7f2edffff640 1 -- 172.21.15.18:0/1999213986 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef000aa30 con 0x7f2ef80c87e0 2024-09-19T09:18:19.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.555+0000 7f2efe0dd640 1 -- 172.21.15.18:0/1999213986 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ef80c9580 con 0x7f2ef80c87e0 2024-09-19T09:18:19.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.556+0000 7f2efe0dd640 1 -- 172.21.15.18:0/1999213986 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ef80d35b0 con 0x7f2ef80c87e0 2024-09-19T09:18:19.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.557+0000 7f2edffff640 1 -- 172.21.15.18:0/1999213986 <== mon.1 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2ef001b070 con 0x7f2ef80c87e0 2024-09-19T09:18:19.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.557+0000 7f2edffff640 1 --2- 172.21.15.18:0/1999213986 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2ee406c2b0 0x7f2ee406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:19.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.557+0000 7f2edffff640 1 -- 172.21.15.18:0/1999213986 <== mon.1 v2:172.21.15.162:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 4943+0+0 (secure 0 0 0) 0x7f2ef008a790 con 0x7f2ef80c87e0 2024-09-19T09:18:19.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.557+0000 7f2ef77fe640 1 --2- 172.21.15.18:0/1999213986 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2ee406c2b0 0x7f2ee406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:19.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.558+0000 7f2ef77fe640 1 --2- 172.21.15.18:0/1999213986 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2ee406c2b0 0x7f2ee406e770 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80a26f0 tx=0x7f2ee8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:19.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.562+0000 7f2edffff640 1 -- 172.21.15.18:0/1999213986 <== mon.1 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2ef0058bb0 con 0x7f2ef80c87e0 2024-09-19T09:18:19.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:19.749+0000 7f2efe0dd640 1 -- 172.21.15.18:0/1999213986 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f2ef80d2330 con 0x7f2ef80c87e0 2024-09-19T09:18:20.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.407+0000 7f2edffff640 1 -- 172.21.15.18:0/1999213986 <== mon.1 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v98) ==== 97+0+0 (secure 0 0 0) 0x7f2ef005ceb0 con 0x7f2ef80c87e0 2024-09-19T09:18:20.408 INFO:teuthology.orchestra.run.smithi018.stderr: removed all blocklist entries 2024-09-19T09:18:20.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.409+0000 7f2efe0dd640 1 -- 172.21.15.18:0/1999213986 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2ee406c2b0 msgr2=0x7f2ee406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:20.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.410+0000 7f2efe0dd640 1 --2- 172.21.15.18:0/1999213986 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2ee406c2b0 0x7f2ee406e770 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80a26f0 tx=0x7f2ee8009190 comp rx=0 tx=0).stop 2024-09-19T09:18:20.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.410+0000 7f2efe0dd640 1 -- 172.21.15.18:0/1999213986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ef80c87e0 msgr2=0x7f2ef80cbd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:20.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.410+0000 7f2efe0dd640 1 --2- 172.21.15.18:0/1999213986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ef80c87e0 0x7f2ef80cbd80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2ef000c8c0 tx=0x7f2ef000cd80 comp rx=0 tx=0).stop 2024-09-19T09:18:20.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.410+0000 7f2efe0dd640 1 -- 172.21.15.18:0/1999213986 shutdown_connections 2024-09-19T09:18:20.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.410+0000 7f2efe0dd640 1 --2- 172.21.15.18:0/1999213986 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2ee406c2b0 0x7f2ee406e770 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:20.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.410+0000 7f2efe0dd640 1 --2- 172.21.15.18:0/1999213986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ef80c87e0 0x7f2ef80cbd80 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:20.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.410+0000 7f2efe0dd640 1 --2- 172.21.15.18:0/1999213986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ef815eda0 0x7f2ef815be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:20.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.410+0000 7f2efe0dd640 1 --2- 172.21.15.18:0/1999213986 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ef80d0480 0x7f2ef80c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:20.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.410+0000 7f2efe0dd640 1 -- 172.21.15.18:0/1999213986 >> 172.21.15.18:0/1999213986 conn(0x7f2ef809df40 msgr2=0x7f2ef80b8300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:20.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.410+0000 7f2efe0dd640 1 -- 172.21.15.18:0/1999213986 shutdown_connections 2024-09-19T09:18:20.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.410+0000 7f2efe0dd640 1 -- 172.21.15.18:0/1999213986 wait complete. 2024-09-19T09:18:20.424 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-19T09:18:20.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.530+0000 7fd5cd5b7640 1 Processor -- start 2024-09-19T09:18:20.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.530+0000 7fd5cd5b7640 1 -- start start 2024-09-19T09:18:20.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.531+0000 7fd5cd5b7640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd5c8072f40 0x7fd5c806f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:20.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.531+0000 7fd5cd5b7640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd5c80ce780 0x7fd5c80b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:20.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.531+0000 7fd5cd5b7640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5c806e3d0 con 0x7fd5c8145290 2024-09-19T09:18:20.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.531+0000 7fd5cd5b7640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fd5c806efe0 con 0x7fd5c80ce780 2024-09-19T09:18:20.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.531+0000 7fd5cd5b7640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd5c806e6b0 con 0x7fd5c8072f40 2024-09-19T09:18:20.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.531+0000 7fd5c77fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd5c80ce780 0x7fd5c80b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:20.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.531+0000 7fd5c77fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd5c80ce780 0x7fd5c80b3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39474/0 (socket says 172.21.15.18:39474) 2024-09-19T09:18:20.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.531+0000 7fd5c77fe640 1 -- 172.21.15.18:0/2793439338 learned_addr learned my addr 172.21.15.18:0/2793439338 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:20.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.531+0000 7fd5c67fc640 1 --2- 172.21.15.18:0/2793439338 >> v2:172.21.15.162:3300/0 conn(0x7fd5c8072f40 0x7fd5c806f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:20.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.532+0000 7fd5c77fe640 1 -- 172.21.15.18:0/2793439338 >> v2:172.21.15.162:3300/0 conn(0x7fd5c8072f40 msgr2=0x7fd5c806f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:20.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.532+0000 7fd5c77fe640 1 --2- 172.21.15.18:0/2793439338 >> v2:172.21.15.162:3300/0 conn(0x7fd5c8072f40 0x7fd5c806f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:20.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.532+0000 7fd5c77fe640 1 -- 172.21.15.18:0/2793439338 >> v1:172.21.15.162:6789/0 conn(0x7fd5c8145290 legacy=0x7fd5c8072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:20.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.532+0000 7fd5c77fe640 1 -- 172.21.15.18:0/2793439338 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5c806e990 con 0x7fd5c80ce780 2024-09-19T09:18:20.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.532+0000 7fd5c77fe640 1 --2- 172.21.15.18:0/2793439338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5c80ce780 0x7fd5c80b3930 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fd5c806d450 tx=0x7fd5c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e9492299dbe81a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:20.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.532+0000 7fd5c5ffb640 1 -- 172.21.15.18:0/2793439338 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0037070 con 0x7fd5c80ce780 2024-09-19T09:18:20.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.532+0000 7fd5c5ffb640 1 -- 172.21.15.18:0/2793439338 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5c0032440 con 0x7fd5c80ce780 2024-09-19T09:18:20.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.532+0000 7fd5c5ffb640 1 -- 172.21.15.18:0/2793439338 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0032810 con 0x7fd5c80ce780 2024-09-19T09:18:20.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.533+0000 7fd5cd5b7640 1 -- 172.21.15.18:0/2793439338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5c80ce780 msgr2=0x7fd5c80b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:20.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.533+0000 7fd5cd5b7640 1 --2- 172.21.15.18:0/2793439338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5c80ce780 0x7fd5c80b3930 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fd5c806d450 tx=0x7fd5c002a270 comp rx=0 tx=0).stop 2024-09-19T09:18:20.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.533+0000 7fd5cd5b7640 1 -- 172.21.15.18:0/2793439338 shutdown_connections 2024-09-19T09:18:20.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.533+0000 7fd5cd5b7640 1 --2- 172.21.15.18:0/2793439338 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5c80ce780 0x7fd5c80b3930 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:20.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.533+0000 7fd5cd5b7640 1 --2- 172.21.15.18:0/2793439338 >> v2:172.21.15.162:3300/0 conn(0x7fd5c8072f40 0x7fd5c806f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:20.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.533+0000 7fd5cd5b7640 1 -- 172.21.15.18:0/2793439338 >> 172.21.15.18:0/2793439338 conn(0x7fd5c806bc10 msgr2=0x7fd5c806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:20.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.533+0000 7fd5cd5b7640 1 -- 172.21.15.18:0/2793439338 shutdown_connections 2024-09-19T09:18:20.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.533+0000 7fd5cd5b7640 1 -- 172.21.15.18:0/2793439338 wait complete. 2024-09-19T09:18:20.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.534+0000 7fd5cd5b7640 1 Processor -- start 2024-09-19T09:18:20.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.534+0000 7fd5cd5b7640 1 -- start start 2024-09-19T09:18:20.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.535+0000 7fd5cd5b7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5c8072f40 0x7fd5c81387f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:20.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.535+0000 7fd5cd5b7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5c80ce780 0x7fd5c8166fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:20.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.535+0000 7fd5cd5b7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5c8145290 0x7fd5c8168af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:20.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.535+0000 7fd5cd5b7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c806df80 con 0x7fd5c8145290 2024-09-19T09:18:20.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.535+0000 7fd5cd5b7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c8145670 con 0x7fd5c8072f40 2024-09-19T09:18:20.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.535+0000 7fd5cd5b7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd5c806e100 con 0x7fd5c80ce780 2024-09-19T09:18:20.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.535+0000 7fd5c77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5c8145290 0x7fd5c8168af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:20.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.535+0000 7fd5c77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5c8145290 0x7fd5c8168af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39484/0 (socket says 172.21.15.18:39484) 2024-09-19T09:18:20.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.535+0000 7fd5c77fe640 1 -- 172.21.15.18:0/1573102794 learned_addr learned my addr 172.21.15.18:0/1573102794 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:20.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.535+0000 7fd5c67fc640 1 --2- 172.21.15.18:0/1573102794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5c80ce780 0x7fd5c8166fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:20.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.535+0000 7fd5c6ffd640 1 --2- 172.21.15.18:0/1573102794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5c8072f40 0x7fd5c81387f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:20.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.536+0000 7fd5c77fe640 1 -- 172.21.15.18:0/1573102794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5c80ce780 msgr2=0x7fd5c8166fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:20.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.536+0000 7fd5c77fe640 1 --2- 172.21.15.18:0/1573102794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5c80ce780 0x7fd5c8166fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:20.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.536+0000 7fd5c77fe640 1 -- 172.21.15.18:0/1573102794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5c8072f40 msgr2=0x7fd5c81387f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:20.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.536+0000 7fd5c77fe640 1 --2- 172.21.15.18:0/1573102794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5c8072f40 0x7fd5c81387f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:20.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.536+0000 7fd5c77fe640 1 -- 172.21.15.18:0/1573102794 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5c8164f10 con 0x7fd5c8145290 2024-09-19T09:18:20.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.536+0000 7fd5c67fc640 1 --2- 172.21.15.18:0/1573102794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5c80ce780 0x7fd5c8166fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:20.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.536+0000 7fd5c77fe640 1 --2- 172.21.15.18:0/1573102794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5c8145290 0x7fd5c8168af0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fd5c002a2b0 tx=0x7fd5c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:20.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.536+0000 7fd5bf7fe640 1 -- 172.21.15.18:0/1573102794 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0041020 con 0x7fd5c8145290 2024-09-19T09:18:20.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.536+0000 7fd5bf7fe640 1 -- 172.21.15.18:0/1573102794 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5c003d640 con 0x7fd5c8145290 2024-09-19T09:18:20.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.536+0000 7fd5bf7fe640 1 -- 172.21.15.18:0/1573102794 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0037040 con 0x7fd5c8145290 2024-09-19T09:18:20.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.536+0000 7fd5cd5b7640 1 -- 172.21.15.18:0/1573102794 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5c81651f0 con 0x7fd5c8145290 2024-09-19T09:18:20.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.536+0000 7fd5cd5b7640 1 -- 172.21.15.18:0/1573102794 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5c8165a90 con 0x7fd5c8145290 2024-09-19T09:18:20.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.537+0000 7fd5cd5b7640 1 -- 172.21.15.18:0/1573102794 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5c81653c0 con 0x7fd5c8145290 2024-09-19T09:18:20.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.538+0000 7fd5bf7fe640 1 -- 172.21.15.18:0/1573102794 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd5c0044020 con 0x7fd5c8145290 2024-09-19T09:18:20.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.538+0000 7fd5bf7fe640 1 --2- 172.21.15.18:0/1573102794 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd5a806c2b0 0x7fd5a806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:20.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.538+0000 7fd5bf7fe640 1 -- 172.21.15.18:0/1573102794 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 4857+0+0 (secure 0 0 0) 0x7fd5c00ab790 con 0x7fd5c8145290 2024-09-19T09:18:20.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.538+0000 7fd5c6ffd640 1 --2- 172.21.15.18:0/1573102794 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd5a806c2b0 0x7fd5a806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:20.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.539+0000 7fd5c6ffd640 1 --2- 172.21.15.18:0/1573102794 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd5a806c2b0 0x7fd5a806e770 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8001d40 tx=0x7fd5b8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:20.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.543+0000 7fd5bf7fe640 1 -- 172.21.15.18:0/1573102794 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd5c004b030 con 0x7fd5c8145290 2024-09-19T09:18:20.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.785+0000 7fd5cd5b7640 1 -- 172.21.15.18:0/1573102794 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fd5c8165c90 con 0x7fd5c8145290 2024-09-19T09:18:20.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.785+0000 7fd5bf7fe640 1 -- 172.21.15.18:0/1573102794 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) ==== 80+0+5304 (secure 0 0 0) 0x7fd5c007a260 con 0x7fd5c8145290 2024-09-19T09:18:20.786 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:20.786 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:18:20.786 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_dump": [ 2024-09-19T09:18:20.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:20.787 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.a", 2024-09-19T09:18:20.787 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmDY7cHhAALxtxGq6eR3A2QXYp+nW0FA==", 2024-09-19T09:18:20.787 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:18:20.787 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:18:20.787 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:18:20.787 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:18:20.787 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:18:20.787 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:20.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:20.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:20.787 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.b", 2024-09-19T09:18:20.788 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tm9ILFKhAABEtgvzO5YBXqzYaeBZ0qZg==", 2024-09-19T09:18:20.788 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:18:20.788 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:18:20.788 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:18:20.788 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:18:20.788 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:18:20.788 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:20.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:20.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:20.788 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.c", 2024-09-19T09:18:20.788 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmwPkOJhAADt/0XVei2kl79pIw55wu1A==", 2024-09-19T09:18:20.788 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:18:20.788 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:18:20.789 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:18:20.789 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:18:20.789 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:18:20.789 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:20.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:20.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:20.789 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.d", 2024-09-19T09:18:20.789 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tm35XYMRAA/OSE5iv8M+TekEJVTARETw==", 2024-09-19T09:18:20.789 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:18:20.789 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:18:20.789 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:18:20.789 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:18:20.789 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:18:20.789 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:20.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:20.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:20.790 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.0", 2024-09-19T09:18:20.790 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmkUBiGhAATWtnqNPWyZJ+tnQcZOtT5A==", 2024-09-19T09:18:20.790 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:18:20.790 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:18:20.790 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:18:20.790 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:18:20.790 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:20.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:20.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:20.790 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.1", 2024-09-19T09:18:20.790 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmir5wIRAA9QumyCr8yLHtNj/YqQ1d0A==", 2024-09-19T09:18:20.790 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:18:20.791 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:18:20.791 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:18:20.791 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:18:20.791 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:20.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:20.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:20.791 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.2", 2024-09-19T09:18:20.791 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmfQJ6KBAAfTerKv1zCzFf6UfAVUikxA==", 2024-09-19T09:18:20.791 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:18:20.791 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:18:20.791 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:18:20.791 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:18:20.791 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:20.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:20.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:20.792 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.3", 2024-09-19T09:18:20.792 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmSeSOLxAACqCpiIQO4cDyjXUmoGPKAQ==", 2024-09-19T09:18:20.792 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:18:20.792 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:18:20.792 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:18:20.792 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:18:20.792 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:20.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:20.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:20.792 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.4", 2024-09-19T09:18:20.793 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmrsoFAhAArI7cRPVe/jrnSdmyE8jCsQ==", 2024-09-19T09:18:20.793 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:18:20.793 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:18:20.793 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:18:20.793 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:18:20.793 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:20.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:20.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:20.793 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.5", 2024-09-19T09:18:20.793 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmudM3CRAAXF3uI58SNJE6qtYX2wNQeQ==", 2024-09-19T09:18:20.793 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:18:20.793 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:18:20.793 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:18:20.794 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:18:20.794 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:20.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:20.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:20.794 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.6", 2024-09-19T09:18:20.794 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmqEQmEBAAm4h/8p91HwX84pl/U80Q9Q==", 2024-09-19T09:18:20.794 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:18:20.794 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:18:20.794 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:18:20.794 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:18:20.794 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:20.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:20.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:20.795 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.7", 2024-09-19T09:18:20.795 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmhDs0FxAAxZvRVkBoWqsdmyifRZzgwg==", 2024-09-19T09:18:20.795 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:18:20.795 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:18:20.795 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:18:20.795 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:18:20.795 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:20.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:20.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:20.795 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.0", 2024-09-19T09:18:20.796 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmcbwDNhAAaG0+wu96Locwws+h0zeh8Q==", 2024-09-19T09:18:20.796 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:18:20.796 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:18:20.796 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow r", 2024-09-19T09:18:20.796 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-19T09:18:20.796 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:20.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:20.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:20.796 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.1", 2024-09-19T09:18:20.796 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAf6+tmb4FeAxAAU+nZN/Vb33HrU0yfXmU9gA==", 2024-09-19T09:18:20.796 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:18:20.797 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:18:20.797 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-19T09:18:20.797 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-19T09:18:20.797 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-19T09:18:20.797 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:20.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:20.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:20.797 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.2", 2024-09-19T09:18:20.797 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAf6+tmc34kABAAC5b4Kkm2dJvxxyXva6PT2g==", 2024-09-19T09:18:20.797 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:18:20.797 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:18:20.797 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-19T09:18:20.798 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-19T09:18:20.798 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-19T09:18:20.798 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:20.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:20.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:20.798 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.3", 2024-09-19T09:18:20.798 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAf6+tmx4vzCBAAZ7ZrdGI2s8LqT0MjjzOCjw==", 2024-09-19T09:18:20.798 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:18:20.798 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:18:20.799 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-19T09:18:20.799 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-19T09:18:20.799 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-19T09:18:20.799 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:20.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:20.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:20.799 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.admin", 2024-09-19T09:18:20.799 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmZaWgAhAAx7MUazt6rS+wa/ZMSGC97Q==", 2024-09-19T09:18:20.799 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:18:20.799 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-19T09:18:20.799 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:18:20.800 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:18:20.800 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:18:20.800 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:20.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:20.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:20.800 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.x", 2024-09-19T09:18:20.800 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmwr6NGxAA3M5NZKkjc36L25teWJS7bQ==", 2024-09-19T09:18:20.800 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:18:20.800 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-19T09:18:20.800 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-09-19T09:18:20.801 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:18:20.801 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:20.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:20.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:20.801 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.y", 2024-09-19T09:18:20.802 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmBWOWFxAAEYKCroBhMcqoIe6WzXnNCg==", 2024-09-19T09:18:20.802 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:18:20.802 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-19T09:18:20.802 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-09-19T09:18:20.802 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:18:20.802 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:20.802 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:20.802 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:20.802 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:18:20.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.787+0000 7fd5cd5b7640 1 -- 172.21.15.18:0/1573102794 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd5a806c2b0 msgr2=0x7fd5a806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:20.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.787+0000 7fd5cd5b7640 1 --2- 172.21.15.18:0/1573102794 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd5a806c2b0 0x7fd5a806e770 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8001d40 tx=0x7fd5b8009040 comp rx=0 tx=0).stop 2024-09-19T09:18:20.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.787+0000 7fd5cd5b7640 1 -- 172.21.15.18:0/1573102794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5c8145290 msgr2=0x7fd5c8168af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:20.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.787+0000 7fd5cd5b7640 1 --2- 172.21.15.18:0/1573102794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5c8145290 0x7fd5c8168af0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fd5c002a2b0 tx=0x7fd5c00046c0 comp rx=0 tx=0).stop 2024-09-19T09:18:20.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.788+0000 7fd5cd5b7640 1 -- 172.21.15.18:0/1573102794 shutdown_connections 2024-09-19T09:18:20.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.788+0000 7fd5cd5b7640 1 --2- 172.21.15.18:0/1573102794 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd5a806c2b0 0x7fd5a806e770 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:20.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.788+0000 7fd5cd5b7640 1 --2- 172.21.15.18:0/1573102794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5c8145290 0x7fd5c8168af0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:20.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.788+0000 7fd5cd5b7640 1 --2- 172.21.15.18:0/1573102794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5c80ce780 0x7fd5c8166fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:20.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.788+0000 7fd5cd5b7640 1 --2- 172.21.15.18:0/1573102794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5c8072f40 0x7fd5c81387f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:20.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.788+0000 7fd5cd5b7640 1 -- 172.21.15.18:0/1573102794 >> 172.21.15.18:0/1573102794 conn(0x7fd5c806bc10 msgr2=0x7fd5c80cfaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:20.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.788+0000 7fd5cd5b7640 1 -- 172.21.15.18:0/1573102794 shutdown_connections 2024-09-19T09:18:20.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.788+0000 7fd5cd5b7640 1 -- 172.21.15.18:0/1573102794 wait complete. 2024-09-19T09:18:20.806 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-19T09:18:20.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.908+0000 7fcc716d0640 1 Processor -- start 2024-09-19T09:18:20.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.908+0000 7fcc716d0640 1 -- start start 2024-09-19T09:18:20.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.908+0000 7fcc716d0640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcc6c15ef80 0x7fcc6c0b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:20.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.908+0000 7fcc716d0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcc6c0cfae0 0x7fcc6c0cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:20.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.908+0000 7fcc716d0640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc6c0cd1a0 con 0x7fcc6c06d730 2024-09-19T09:18:20.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.908+0000 7fcc716d0640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fcc6c0cd7d0 con 0x7fcc6c0cfae0 2024-09-19T09:18:20.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.908+0000 7fcc716d0640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fcc6c06dc30 con 0x7fcc6c15ef80 2024-09-19T09:18:20.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.909+0000 7fcc6b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcc6c0cfae0 0x7fcc6c0cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:20.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.909+0000 7fcc6b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcc6c0cfae0 0x7fcc6c0cdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39500/0 (socket says 172.21.15.18:39500) 2024-09-19T09:18:20.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.909+0000 7fcc6b7fe640 1 -- 172.21.15.18:0/3480213108 learned_addr learned my addr 172.21.15.18:0/3480213108 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:20.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.909+0000 7fcc6b7fe640 1 -- 172.21.15.18:0/3480213108 >> v2:172.21.15.162:3300/0 conn(0x7fcc6c15ef80 msgr2=0x7fcc6c0b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:20.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.909+0000 7fcc6b7fe640 1 --2- 172.21.15.18:0/3480213108 >> v2:172.21.15.162:3300/0 conn(0x7fcc6c15ef80 0x7fcc6c0b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:20.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.909+0000 7fcc6b7fe640 1 -- 172.21.15.18:0/3480213108 >> v1:172.21.15.162:6789/0 conn(0x7fcc6c06d730 legacy=0x7fcc6c0cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:20.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.909+0000 7fcc6b7fe640 1 -- 172.21.15.18:0/3480213108 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc6c06df10 con 0x7fcc6c0cfae0 2024-09-19T09:18:20.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.909+0000 7fcc6b7fe640 1 --2- 172.21.15.18:0/3480213108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc6c0cfae0 0x7fcc6c0cdc60 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c06f6e0 tx=0x7fcc5c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1820c193bc870b2f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:20.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.910+0000 7fcc69ffb640 1 -- 172.21.15.18:0/3480213108 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c036070 con 0x7fcc6c0cfae0 2024-09-19T09:18:20.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.910+0000 7fcc69ffb640 1 -- 172.21.15.18:0/3480213108 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc5c031600 con 0x7fcc6c0cfae0 2024-09-19T09:18:20.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.910+0000 7fcc69ffb640 1 -- 172.21.15.18:0/3480213108 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c0319d0 con 0x7fcc6c0cfae0 2024-09-19T09:18:20.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.910+0000 7fcc716d0640 1 -- 172.21.15.18:0/3480213108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc6c0cfae0 msgr2=0x7fcc6c0cdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:20.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.910+0000 7fcc716d0640 1 --2- 172.21.15.18:0/3480213108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc6c0cfae0 0x7fcc6c0cdc60 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c06f6e0 tx=0x7fcc5c02a6f0 comp rx=0 tx=0).stop 2024-09-19T09:18:20.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.910+0000 7fcc716d0640 1 -- 172.21.15.18:0/3480213108 shutdown_connections 2024-09-19T09:18:20.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.910+0000 7fcc716d0640 1 --2- 172.21.15.18:0/3480213108 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc6c0cfae0 0x7fcc6c0cdc60 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:20.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.910+0000 7fcc716d0640 1 --2- 172.21.15.18:0/3480213108 >> v2:172.21.15.162:3300/0 conn(0x7fcc6c15ef80 0x7fcc6c0b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:20.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.910+0000 7fcc716d0640 1 -- 172.21.15.18:0/3480213108 >> 172.21.15.18:0/3480213108 conn(0x7fcc6c0b4700 msgr2=0x7fcc6c0b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:20.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.910+0000 7fcc716d0640 1 -- 172.21.15.18:0/3480213108 shutdown_connections 2024-09-19T09:18:20.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.910+0000 7fcc716d0640 1 -- 172.21.15.18:0/3480213108 wait complete. 2024-09-19T09:18:20.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.912+0000 7fcc716d0640 1 Processor -- start 2024-09-19T09:18:20.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.912+0000 7fcc716d0640 1 -- start start 2024-09-19T09:18:20.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.912+0000 7fcc716d0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc6c06d730 0x7fcc6c0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:20.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.912+0000 7fcc716d0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc6c0cfae0 0x7fcc6c155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:20.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.912+0000 7fcc716d0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc6c15ef80 0x7fcc6c0c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:20.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.912+0000 7fcc716d0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6c0d0120 con 0x7fcc6c15ef80 2024-09-19T09:18:20.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.912+0000 7fcc716d0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcc6c15f360 con 0x7fcc6c0cfae0 2024-09-19T09:18:20.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.912+0000 7fcc716d0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcc6c0ce1a0 con 0x7fcc6c06d730 2024-09-19T09:18:20.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.912+0000 7fcc6b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc6c15ef80 0x7fcc6c0c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:20.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.912+0000 7fcc6b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc6c15ef80 0x7fcc6c0c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39502/0 (socket says 172.21.15.18:39502) 2024-09-19T09:18:20.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.912+0000 7fcc6b7fe640 1 -- 172.21.15.18:0/2623505075 learned_addr learned my addr 172.21.15.18:0/2623505075 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:20.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.913+0000 7fcc6a7fc640 1 --2- 172.21.15.18:0/2623505075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc6c0cfae0 0x7fcc6c155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:20.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.913+0000 7fcc6affd640 1 --2- 172.21.15.18:0/2623505075 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc6c06d730 0x7fcc6c0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:20.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.913+0000 7fcc6b7fe640 1 -- 172.21.15.18:0/2623505075 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc6c06d730 msgr2=0x7fcc6c0b6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:20.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.913+0000 7fcc6b7fe640 1 --2- 172.21.15.18:0/2623505075 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc6c06d730 0x7fcc6c0b6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:20.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.913+0000 7fcc6b7fe640 1 -- 172.21.15.18:0/2623505075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc6c0cfae0 msgr2=0x7fcc6c155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:20.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.913+0000 7fcc6b7fe640 1 --2- 172.21.15.18:0/2623505075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc6c0cfae0 0x7fcc6c155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:20.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.913+0000 7fcc6b7fe640 1 -- 172.21.15.18:0/2623505075 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc6c0cc0d0 con 0x7fcc6c15ef80 2024-09-19T09:18:20.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.913+0000 7fcc6a7fc640 1 --2- 172.21.15.18:0/2623505075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc6c0cfae0 0x7fcc6c155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:20.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.913+0000 7fcc6affd640 1 --2- 172.21.15.18:0/2623505075 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc6c06d730 0x7fcc6c0b6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:20.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.913+0000 7fcc6b7fe640 1 --2- 172.21.15.18:0/2623505075 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc6c15ef80 0x7fcc6c0c9ed0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c034040 tx=0x7fcc5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:20.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.913+0000 7fcc537fe640 1 -- 172.21.15.18:0/2623505075 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c041020 con 0x7fcc6c15ef80 2024-09-19T09:18:20.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.913+0000 7fcc537fe640 1 -- 172.21.15.18:0/2623505075 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc5c0077a0 con 0x7fcc6c15ef80 2024-09-19T09:18:20.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.913+0000 7fcc716d0640 1 -- 172.21.15.18:0/2623505075 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc6c0cc3b0 con 0x7fcc6c15ef80 2024-09-19T09:18:20.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.913+0000 7fcc537fe640 1 -- 172.21.15.18:0/2623505075 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc5c036040 con 0x7fcc6c15ef80 2024-09-19T09:18:20.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.913+0000 7fcc716d0640 1 -- 172.21.15.18:0/2623505075 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc6c0cc970 con 0x7fcc6c15ef80 2024-09-19T09:18:20.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.914+0000 7fcc716d0640 1 -- 172.21.15.18:0/2623505075 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc6c0cdc60 con 0x7fcc6c15ef80 2024-09-19T09:18:20.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.915+0000 7fcc537fe640 1 -- 172.21.15.18:0/2623505075 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcc5c044020 con 0x7fcc6c15ef80 2024-09-19T09:18:20.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.915+0000 7fcc537fe640 1 --2- 172.21.15.18:0/2623505075 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcc5806c2b0 0x7fcc5806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:20.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.915+0000 7fcc537fe640 1 -- 172.21.15.18:0/2623505075 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 4857+0+0 (secure 0 0 0) 0x7fcc5c0ac060 con 0x7fcc6c15ef80 2024-09-19T09:18:20.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.916+0000 7fcc6affd640 1 --2- 172.21.15.18:0/2623505075 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcc5806c2b0 0x7fcc5806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:20.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.916+0000 7fcc6affd640 1 --2- 172.21.15.18:0/2623505075 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcc5806c2b0 0x7fcc5806e770 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcc6400a870 tx=0x7fcc64008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:20.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:20.920+0000 7fcc537fe640 1 -- 172.21.15.18:0/2623505075 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fcc5c04b030 con 0x7fcc6c15ef80 2024-09-19T09:18:21.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.098+0000 7fcc716d0640 1 -- 172.21.15.18:0/2623505075 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fcc6c0cff00 con 0x7fcc6c15ef80 2024-09-19T09:18:21.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.099+0000 7fcc537fe640 1 -- 172.21.15.18:0/2623505075 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v100) ==== 84+0+65 (secure 0 0 0) 0x7fcc5c07aa70 con 0x7fcc6c15ef80 2024-09-19T09:18:21.101 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:21.101 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-09-19T09:18:21.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:21.101 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 1, 2024-09-19T09:18:21.101 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": ".mgr" 2024-09-19T09:18:21.101 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:21.102 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-09-19T09:18:21.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.100+0000 7fcc716d0640 1 -- 172.21.15.18:0/2623505075 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcc5806c2b0 msgr2=0x7fcc5806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:21.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.100+0000 7fcc716d0640 1 --2- 172.21.15.18:0/2623505075 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcc5806c2b0 0x7fcc5806e770 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcc6400a870 tx=0x7fcc64008040 comp rx=0 tx=0).stop 2024-09-19T09:18:21.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.100+0000 7fcc716d0640 1 -- 172.21.15.18:0/2623505075 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc6c15ef80 msgr2=0x7fcc6c0c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:21.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.100+0000 7fcc716d0640 1 --2- 172.21.15.18:0/2623505075 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc6c15ef80 0x7fcc6c0c9ed0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c034040 tx=0x7fcc5c004a40 comp rx=0 tx=0).stop 2024-09-19T09:18:21.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.101+0000 7fcc716d0640 1 -- 172.21.15.18:0/2623505075 shutdown_connections 2024-09-19T09:18:21.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.101+0000 7fcc716d0640 1 --2- 172.21.15.18:0/2623505075 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcc5806c2b0 0x7fcc5806e770 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:21.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.101+0000 7fcc716d0640 1 --2- 172.21.15.18:0/2623505075 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcc6c15ef80 0x7fcc6c0c9ed0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:21.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.101+0000 7fcc716d0640 1 --2- 172.21.15.18:0/2623505075 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcc6c0cfae0 0x7fcc6c155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:21.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.101+0000 7fcc716d0640 1 --2- 172.21.15.18:0/2623505075 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcc6c06d730 0x7fcc6c0b6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:21.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.101+0000 7fcc716d0640 1 -- 172.21.15.18:0/2623505075 >> 172.21.15.18:0/2623505075 conn(0x7fcc6c0b4700 msgr2=0x7fcc6c0d3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:21.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.101+0000 7fcc716d0640 1 -- 172.21.15.18:0/2623505075 shutdown_connections 2024-09-19T09:18:21.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.101+0000 7fcc716d0640 1 -- 172.21.15.18:0/2623505075 wait complete. 2024-09-19T09:18:21.112 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T09:18:21.112 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T09:18:21.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.218+0000 7fdcf8a23640 1 Processor -- start 2024-09-19T09:18:21.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.218+0000 7fdcf8a23640 1 -- start start 2024-09-19T09:18:21.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.219+0000 7fdcf8a23640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdcf415edb0 0x7fdcf40d29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:21.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.219+0000 7fdcf8a23640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcf40d0870 con 0x7fdcf40d3990 2024-09-19T09:18:21.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.219+0000 7fdcf8a23640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcf40d0b50 con 0x7fdcf40d0370 2024-09-19T09:18:21.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.219+0000 7fdcf8a23640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fdcf40b4400 con 0x7fdcf415edb0 2024-09-19T09:18:21.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.219+0000 7fdcf2d9d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fdcf40d3990 0x7fdcf40b5100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56070/0 (socket says 172.21.15.18:56070) 2024-09-19T09:18:21.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.219+0000 7fdcf2d9d640 1 -- 172.21.15.18:0/2908286059 learned_addr learned my addr 172.21.15.18:0/2908286059 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:21.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.219+0000 7fdcf259c640 1 --2- 172.21.15.18:0/2908286059 >> v2:172.21.15.162:3300/0 conn(0x7fdcf415edb0 0x7fdcf40d29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:21.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.219+0000 7fdcf159a640 1 -- 172.21.15.18:0/2908286059 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 382806420 0 0) 0x7fdcf40d0870 con 0x7fdcf40d3990 2024-09-19T09:18:21.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.219+0000 7fdcf159a640 1 -- 172.21.15.18:0/2908286059 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcdc003520 con 0x7fdcf40d3990 2024-09-19T09:18:21.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.220+0000 7fdcf159a640 1 -- 172.21.15.18:0/2908286059 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 91567784 0 0) 0x7fdcdc003520 con 0x7fdcf40d3990 2024-09-19T09:18:21.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.220+0000 7fdcf159a640 1 -- 172.21.15.18:0/2908286059 >> v2:172.21.15.162:3300/0 conn(0x7fdcf415edb0 msgr2=0x7fdcf40d29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:21.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.220+0000 7fdcf159a640 1 --2- 172.21.15.18:0/2908286059 >> v2:172.21.15.162:3300/0 conn(0x7fdcf415edb0 0x7fdcf40d29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:21.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.220+0000 7fdcf159a640 1 -- 172.21.15.18:0/2908286059 >> v1:172.21.15.162:6789/0 conn(0x7fdcf40d0370 legacy=0x7fdcf40d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:21.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.220+0000 7fdcf159a640 1 -- 172.21.15.18:0/2908286059 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcf40b4620 con 0x7fdcf40d3990 2024-09-19T09:18:21.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.220+0000 7fdcf159a640 1 -- 172.21.15.18:0/2908286059 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fdcec0019f0 con 0x7fdcf40d3990 2024-09-19T09:18:21.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.220+0000 7fdcf159a640 1 -- 172.21.15.18:0/2908286059 >> v1:172.21.15.18:6789/0 conn(0x7fdcf40d3990 legacy=0x7fdcf40b5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:21.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.220+0000 7fdcf159a640 1 --2- 172.21.15.18:0/2908286059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdcdc0039b0 0x7fdcdc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:21.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.220+0000 7fdcf159a640 1 --2- 172.21.15.18:0/2908286059 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdcdc004800 0x7fdcdc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:21.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.220+0000 7fdcf159a640 1 --2- 172.21.15.18:0/2908286059 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdcdc0051c0 0x7fdcdc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:21.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.220+0000 7fdcf159a640 1 -- 172.21.15.18:0/2908286059 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf40b4400 con 0x7fdcdc0039b0 2024-09-19T09:18:21.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.220+0000 7fdcf159a640 1 -- 172.21.15.18:0/2908286059 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdcdc00c060 con 0x7fdcdc0051c0 2024-09-19T09:18:21.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.220+0000 7fdcf159a640 1 -- 172.21.15.18:0/2908286059 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdcdc00c260 con 0x7fdcdc004800 2024-09-19T09:18:21.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.220+0000 7fdcf259c640 1 --2- 172.21.15.18:0/2908286059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdcdc0039b0 0x7fdcdc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:21.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.220+0000 7fdcf1d9b640 1 --2- 172.21.15.18:0/2908286059 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdcdc004800 0x7fdcdc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:21.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.220+0000 7fdcf2d9d640 1 --2- 172.21.15.18:0/2908286059 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdcdc0051c0 0x7fdcdc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:21.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.220+0000 7fdcf259c640 1 -- 172.21.15.18:0/2908286059 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdcdc004800 msgr2=0x7fdcdc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:21.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.220+0000 7fdcf259c640 1 --2- 172.21.15.18:0/2908286059 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdcdc004800 0x7fdcdc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:21.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.220+0000 7fdcf259c640 1 -- 172.21.15.18:0/2908286059 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdcdc0051c0 msgr2=0x7fdcdc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:21.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.220+0000 7fdcf259c640 1 --2- 172.21.15.18:0/2908286059 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdcdc0051c0 0x7fdcdc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:21.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.220+0000 7fdcf259c640 1 -- 172.21.15.18:0/2908286059 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcdc003520 con 0x7fdcdc0039b0 2024-09-19T09:18:21.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.220+0000 7fdcf2d9d640 1 --2- 172.21.15.18:0/2908286059 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdcdc0051c0 0x7fdcdc00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:21.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.220+0000 7fdcf2d9d640 1 -- 172.21.15.18:0/2908286059 reap_dead start 2024-09-19T09:18:21.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.221+0000 7fdcf259c640 1 --2- 172.21.15.18:0/2908286059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdcdc0039b0 0x7fdcdc003dd0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fdce4009ac0 tx=0x7fdcdc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7924059e7387819 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:21.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.221+0000 7fdcf159a640 1 -- 172.21.15.18:0/2908286059 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce4036070 con 0x7fdcdc0039b0 2024-09-19T09:18:21.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.221+0000 7fdcf159a640 1 -- 172.21.15.18:0/2908286059 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdce4031400 con 0x7fdcdc0039b0 2024-09-19T09:18:21.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.221+0000 7fdcf159a640 1 -- 172.21.15.18:0/2908286059 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce4009690 con 0x7fdcdc0039b0 2024-09-19T09:18:21.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.221+0000 7fdcf8a23640 1 -- 172.21.15.18:0/2908286059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdcdc0039b0 msgr2=0x7fdcdc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:21.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.221+0000 7fdcf8a23640 1 --2- 172.21.15.18:0/2908286059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdcdc0039b0 0x7fdcdc003dd0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fdce4009ac0 tx=0x7fdcdc005830 comp rx=0 tx=0).stop 2024-09-19T09:18:21.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.221+0000 7fdcf8a23640 1 -- 172.21.15.18:0/2908286059 shutdown_connections 2024-09-19T09:18:21.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.222+0000 7fdcf8a23640 1 --2- 172.21.15.18:0/2908286059 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdcdc0039b0 0x7fdcdc003dd0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:21.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.222+0000 7fdcf8a23640 1 -- 172.21.15.18:0/2908286059 >> 172.21.15.18:0/2908286059 conn(0x7fdcf409df30 msgr2=0x7fdcf40d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:21.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.222+0000 7fdcf8a23640 1 -- 172.21.15.18:0/2908286059 shutdown_connections 2024-09-19T09:18:21.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.222+0000 7fdcf8a23640 1 -- 172.21.15.18:0/2908286059 wait complete. 2024-09-19T09:18:21.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.223+0000 7fdcf8a23640 1 Processor -- start 2024-09-19T09:18:21.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.223+0000 7fdcf8a23640 1 -- start start 2024-09-19T09:18:21.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.224+0000 7fdcf8a23640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdcdc0039b0 0x7fdcf4160f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:21.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.224+0000 7fdcf8a23640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdcf40ba0d0 0x7fdcf4161c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:21.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.224+0000 7fdcf8a23640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdcf40ba550 0x7fdcf40ca770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:21.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.224+0000 7fdcf8a23640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf415f190 con 0x7fdcdc0039b0 2024-09-19T09:18:21.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.224+0000 7fdcf8a23640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf40b4be0 con 0x7fdcf40ba0d0 2024-09-19T09:18:21.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.224+0000 7fdcf8a23640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdcf40d3280 con 0x7fdcf40ba550 2024-09-19T09:18:21.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.224+0000 7fdcf259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdcdc0039b0 0x7fdcf4160f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:21.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.224+0000 7fdcf259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdcdc0039b0 0x7fdcf4160f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39528/0 (socket says 172.21.15.18:39528) 2024-09-19T09:18:21.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.224+0000 7fdcf259c640 1 -- 172.21.15.18:0/1291015287 learned_addr learned my addr 172.21.15.18:0/1291015287 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:21.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.224+0000 7fdcf2d9d640 1 --2- 172.21.15.18:0/1291015287 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdcf40ba550 0x7fdcf40ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:21.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.224+0000 7fdcf1d9b640 1 --2- 172.21.15.18:0/1291015287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdcf40ba0d0 0x7fdcf4161c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:21.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.224+0000 7fdcf259c640 1 -- 172.21.15.18:0/1291015287 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdcf40ba550 msgr2=0x7fdcf40ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:21.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.224+0000 7fdcf259c640 1 --2- 172.21.15.18:0/1291015287 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdcf40ba550 0x7fdcf40ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:21.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.224+0000 7fdcf259c640 1 -- 172.21.15.18:0/1291015287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdcf40ba0d0 msgr2=0x7fdcf4161c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:21.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.224+0000 7fdcf259c640 1 --2- 172.21.15.18:0/1291015287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdcf40ba0d0 0x7fdcf4161c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:21.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.224+0000 7fdcf259c640 1 -- 172.21.15.18:0/1291015287 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcf4158a50 con 0x7fdcdc0039b0 2024-09-19T09:18:21.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.224+0000 7fdcf259c640 1 --2- 172.21.15.18:0/1291015287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdcdc0039b0 0x7fdcf4160f20 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fdce4034040 tx=0x7fdce4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:21.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.224+0000 7fdce2ffd640 1 -- 172.21.15.18:0/1291015287 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce403f020 con 0x7fdcdc0039b0 2024-09-19T09:18:21.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.224+0000 7fdce2ffd640 1 -- 172.21.15.18:0/1291015287 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdce4037040 con 0x7fdcdc0039b0 2024-09-19T09:18:21.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.225+0000 7fdce2ffd640 1 -- 172.21.15.18:0/1291015287 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce4036070 con 0x7fdcdc0039b0 2024-09-19T09:18:21.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.225+0000 7fdcf8a23640 1 -- 172.21.15.18:0/1291015287 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcf415fe80 con 0x7fdcdc0039b0 2024-09-19T09:18:21.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.225+0000 7fdcf8a23640 1 -- 172.21.15.18:0/1291015287 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcf4160440 con 0x7fdcdc0039b0 2024-09-19T09:18:21.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.225+0000 7fdcf8a23640 1 -- 172.21.15.18:0/1291015287 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcf40b4030 con 0x7fdcdc0039b0 2024-09-19T09:18:21.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.226+0000 7fdce2ffd640 1 -- 172.21.15.18:0/1291015287 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdce4042020 con 0x7fdcdc0039b0 2024-09-19T09:18:21.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.226+0000 7fdce2ffd640 1 --2- 172.21.15.18:0/1291015287 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdcd406c2e0 0x7fdcd406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:21.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.227+0000 7fdce2ffd640 1 -- 172.21.15.18:0/1291015287 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 4857+0+0 (secure 0 0 0) 0x7fdce40ab0d0 con 0x7fdcdc0039b0 2024-09-19T09:18:21.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.227+0000 7fdcf1d9b640 1 --2- 172.21.15.18:0/1291015287 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdcd406c2e0 0x7fdcd406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:21.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.227+0000 7fdcf1d9b640 1 --2- 172.21.15.18:0/1291015287 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdcd406c2e0 0x7fdcd406e7a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdce8007fd0 tx=0x7fdce8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:21.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.231+0000 7fdce2ffd640 1 -- 172.21.15.18:0/1291015287 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fdcf40b4030 con 0x7fdcdc0039b0 2024-09-19T09:18:21.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:21.408+0000 7fdcf8a23640 1 -- 172.21.15.18:0/1291015287 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fdcf40d3610 con 0x7fdcdc0039b0 2024-09-19T09:18:22.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.414+0000 7fdce2ffd640 1 -- 172.21.15.18:0/1291015287 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v101) ==== 138+0+0 (secure 0 0 0) 0x7fdce4049030 con 0x7fdcdc0039b0 2024-09-19T09:18:22.415 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' created 2024-09-19T09:18:22.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.418+0000 7fdcf8a23640 1 -- 172.21.15.18:0/1291015287 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdcd406c2e0 msgr2=0x7fdcd406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:22.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.418+0000 7fdcf8a23640 1 --2- 172.21.15.18:0/1291015287 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdcd406c2e0 0x7fdcd406e7a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fdce8007fd0 tx=0x7fdce8009040 comp rx=0 tx=0).stop 2024-09-19T09:18:22.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.418+0000 7fdcf8a23640 1 -- 172.21.15.18:0/1291015287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdcdc0039b0 msgr2=0x7fdcf4160f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:22.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.418+0000 7fdcf8a23640 1 --2- 172.21.15.18:0/1291015287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdcdc0039b0 0x7fdcf4160f20 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fdce4034040 tx=0x7fdce4004730 comp rx=0 tx=0).stop 2024-09-19T09:18:22.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.419+0000 7fdcf8a23640 1 -- 172.21.15.18:0/1291015287 shutdown_connections 2024-09-19T09:18:22.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.419+0000 7fdcf8a23640 1 --2- 172.21.15.18:0/1291015287 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdcd406c2e0 0x7fdcd406e7a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:22.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.419+0000 7fdcf8a23640 1 --2- 172.21.15.18:0/1291015287 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdcf40ba550 0x7fdcf40ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:22.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.419+0000 7fdcf8a23640 1 --2- 172.21.15.18:0/1291015287 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdcf40ba0d0 0x7fdcf4161c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:22.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.419+0000 7fdcf8a23640 1 --2- 172.21.15.18:0/1291015287 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdcdc0039b0 0x7fdcf4160f20 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:22.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.419+0000 7fdcf8a23640 1 -- 172.21.15.18:0/1291015287 >> 172.21.15.18:0/1291015287 conn(0x7fdcf409df30 msgr2=0x7fdcf40cf9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:22.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.420+0000 7fdcf8a23640 1 -- 172.21.15.18:0/1291015287 shutdown_connections 2024-09-19T09:18:22.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.420+0000 7fdcf8a23640 1 -- 172.21.15.18:0/1291015287 wait complete. 2024-09-19T09:18:22.434 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T09:18:22.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.549+0000 7f0488623640 1 Processor -- start 2024-09-19T09:18:22.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.549+0000 7f0488623640 1 -- start start 2024-09-19T09:18:22.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.550+0000 7f0488623640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f048006deb0 0x7f04800b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:22.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.550+0000 7f0488623640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f048015f1a0 0x7f0480160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:22.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.550+0000 7f0488623640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04800b6a60 con 0x7f048015c670 2024-09-19T09:18:22.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.550+0000 7f0488623640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f04800b6d40 con 0x7f048015f1a0 2024-09-19T09:18:22.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.550+0000 7f0488623640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f04800b7020 con 0x7f048006deb0 2024-09-19T09:18:22.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.550+0000 7f0486bc0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f048015f1a0 0x7f0480160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:22.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.550+0000 7f0486bc0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f048015f1a0 0x7f0480160300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39536/0 (socket says 172.21.15.18:39536) 2024-09-19T09:18:22.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.550+0000 7f0486bc0640 1 -- 172.21.15.18:0/3334113022 learned_addr learned my addr 172.21.15.18:0/3334113022 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:22.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.550+0000 7f0485bbe640 1 --2- 172.21.15.18:0/3334113022 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f048006deb0 0x7f04800b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:22.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.550+0000 7f0486bc0640 1 -- 172.21.15.18:0/3334113022 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f048006deb0 msgr2=0x7f04800b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:22.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.550+0000 7f0486bc0640 1 --2- 172.21.15.18:0/3334113022 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f048006deb0 0x7f04800b6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:22.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.550+0000 7f0486bc0640 1 -- 172.21.15.18:0/3334113022 >> v1:172.21.15.162:6789/0 conn(0x7f048015c670 legacy=0x7f048006d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:22.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.550+0000 7f0486bc0640 1 -- 172.21.15.18:0/3334113022 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04800b7300 con 0x7f048015f1a0 2024-09-19T09:18:22.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.551+0000 7f0486bc0640 1 --2- 172.21.15.18:0/3334113022 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f048015f1a0 0x7f0480160300 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f0478009e50 tx=0x7f047802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c55e12a230d3b19 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:22.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.551+0000 7f04853bd640 1 -- 172.21.15.18:0/3334113022 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0478036070 con 0x7f048015f1a0 2024-09-19T09:18:22.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.551+0000 7f04853bd640 1 -- 172.21.15.18:0/3334113022 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0478031600 con 0x7f048015f1a0 2024-09-19T09:18:22.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.551+0000 7f04853bd640 1 -- 172.21.15.18:0/3334113022 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04780319d0 con 0x7f048015f1a0 2024-09-19T09:18:22.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.551+0000 7f0488623640 1 -- 172.21.15.18:0/3334113022 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f048015f1a0 msgr2=0x7f0480160300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:22.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.551+0000 7f0488623640 1 --2- 172.21.15.18:0/3334113022 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f048015f1a0 0x7f0480160300 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f0478009e50 tx=0x7f047802a6c0 comp rx=0 tx=0).stop 2024-09-19T09:18:22.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.552+0000 7f0488623640 1 -- 172.21.15.18:0/3334113022 shutdown_connections 2024-09-19T09:18:22.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.552+0000 7f0488623640 1 --2- 172.21.15.18:0/3334113022 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f048015f1a0 0x7f0480160300 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:22.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.552+0000 7f0488623640 1 --2- 172.21.15.18:0/3334113022 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f048006deb0 0x7f04800b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:22.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.552+0000 7f0488623640 1 -- 172.21.15.18:0/3334113022 >> 172.21.15.18:0/3334113022 conn(0x7f048009b9d0 msgr2=0x7f048009bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:22.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.552+0000 7f0488623640 1 -- 172.21.15.18:0/3334113022 shutdown_connections 2024-09-19T09:18:22.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.552+0000 7f0488623640 1 -- 172.21.15.18:0/3334113022 wait complete. 2024-09-19T09:18:22.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.553+0000 7f0488623640 1 Processor -- start 2024-09-19T09:18:22.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.553+0000 7f0488623640 1 -- start start 2024-09-19T09:18:22.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.554+0000 7f0488623640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f048006deb0 0x7f0480140280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:22.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.554+0000 7f0488623640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f048015c670 0x7f0480160370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:22.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.554+0000 7f0488623640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f048015f1a0 0x7f04801608b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:22.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.554+0000 7f0488623640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f04800b7b00 con 0x7f048015c670 2024-09-19T09:18:22.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.554+0000 7f0488623640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f048009c560 con 0x7f048006deb0 2024-09-19T09:18:22.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.554+0000 7f0488623640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f04801e8780 con 0x7f048015f1a0 2024-09-19T09:18:22.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.554+0000 7f0485bbe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f048015c670 0x7f0480160370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:22.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.554+0000 7f0485bbe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f048015c670 0x7f0480160370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39544/0 (socket says 172.21.15.18:39544) 2024-09-19T09:18:22.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.554+0000 7f0485bbe640 1 -- 172.21.15.18:0/4048746501 learned_addr learned my addr 172.21.15.18:0/4048746501 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:22.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.554+0000 7f04863bf640 1 --2- 172.21.15.18:0/4048746501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f048006deb0 0x7f0480140280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:22.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.554+0000 7f0486bc0640 1 --2- 172.21.15.18:0/4048746501 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f048015f1a0 0x7f04801608b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:22.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.554+0000 7f0485bbe640 1 -- 172.21.15.18:0/4048746501 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f048015f1a0 msgr2=0x7f04801608b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:22.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.554+0000 7f0485bbe640 1 --2- 172.21.15.18:0/4048746501 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f048015f1a0 0x7f04801608b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:22.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.554+0000 7f0485bbe640 1 -- 172.21.15.18:0/4048746501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f048006deb0 msgr2=0x7f0480140280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:22.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.554+0000 7f0485bbe640 1 --2- 172.21.15.18:0/4048746501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f048006deb0 0x7f0480140280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:22.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.554+0000 7f0485bbe640 1 -- 172.21.15.18:0/4048746501 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04801e8a60 con 0x7f048015c670 2024-09-19T09:18:22.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.554+0000 7f0485bbe640 1 --2- 172.21.15.18:0/4048746501 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f048015c670 0x7f0480160370 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f047000c7f0 tx=0x7f047000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:22.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.554+0000 7f0476ffd640 1 -- 172.21.15.18:0/4048746501 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0470015070 con 0x7f048015c670 2024-09-19T09:18:22.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.554+0000 7f0476ffd640 1 -- 172.21.15.18:0/4048746501 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0470004220 con 0x7f048015c670 2024-09-19T09:18:22.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.554+0000 7f0488623640 1 -- 172.21.15.18:0/4048746501 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04801e8d40 con 0x7f048015c670 2024-09-19T09:18:22.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.554+0000 7f0476ffd640 1 -- 172.21.15.18:0/4048746501 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0470007620 con 0x7f048015c670 2024-09-19T09:18:22.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.555+0000 7f0488623640 1 -- 172.21.15.18:0/4048746501 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04801407c0 con 0x7f048015c670 2024-09-19T09:18:22.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.555+0000 7f0488623640 1 -- 172.21.15.18:0/4048746501 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f048015ca50 con 0x7f048015c670 2024-09-19T09:18:22.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.556+0000 7f0476ffd640 1 -- 172.21.15.18:0/4048746501 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f04700079d0 con 0x7f048015c670 2024-09-19T09:18:22.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.557+0000 7f0476ffd640 1 --2- 172.21.15.18:0/4048746501 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f046406c2b0 0x7f046406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:22.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.557+0000 7f0476ffd640 1 -- 172.21.15.18:0/4048746501 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5227+0+0 (secure 0 0 0) 0x7f047008b580 con 0x7f048015c670 2024-09-19T09:18:22.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.557+0000 7f04863bf640 1 --2- 172.21.15.18:0/4048746501 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f046406c2b0 0x7f046406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:22.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.557+0000 7f04863bf640 1 --2- 172.21.15.18:0/4048746501 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f046406c2b0 0x7f046406e770 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f047c004f60 tx=0x7f047c007e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:22.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.561+0000 7f0476ffd640 1 -- 172.21.15.18:0/4048746501 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0470059870 con 0x7f048015c670 2024-09-19T09:18:22.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:22.736+0000 7f0488623640 1 -- 172.21.15.18:0/4048746501 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f048015d810 con 0x7f048015c670 2024-09-19T09:18:23.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.416+0000 7f0476ffd640 1 -- 172.21.15.18:0/4048746501 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v102) ==== 170+0+0 (secure 0 0 0) 0x7f047005db70 con 0x7f048015c670 2024-09-19T09:18:23.417 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' created 2024-09-19T09:18:23.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.419+0000 7f0488623640 1 -- 172.21.15.18:0/4048746501 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f046406c2b0 msgr2=0x7f046406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:23.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.419+0000 7f0488623640 1 --2- 172.21.15.18:0/4048746501 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f046406c2b0 0x7f046406e770 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f047c004f60 tx=0x7f047c007e30 comp rx=0 tx=0).stop 2024-09-19T09:18:23.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.419+0000 7f0488623640 1 -- 172.21.15.18:0/4048746501 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f048015c670 msgr2=0x7f0480160370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:23.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.419+0000 7f0488623640 1 --2- 172.21.15.18:0/4048746501 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f048015c670 0x7f0480160370 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f047000c7f0 tx=0x7f047000ccb0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.420+0000 7f0488623640 1 -- 172.21.15.18:0/4048746501 shutdown_connections 2024-09-19T09:18:23.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.420+0000 7f0488623640 1 --2- 172.21.15.18:0/4048746501 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f046406c2b0 0x7f046406e770 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.420+0000 7f0488623640 1 --2- 172.21.15.18:0/4048746501 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f048015f1a0 0x7f04801608b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.420+0000 7f0488623640 1 --2- 172.21.15.18:0/4048746501 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f048015c670 0x7f0480160370 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.420+0000 7f0488623640 1 --2- 172.21.15.18:0/4048746501 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f048006deb0 0x7f0480140280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.420+0000 7f0488623640 1 -- 172.21.15.18:0/4048746501 >> 172.21.15.18:0/4048746501 conn(0x7f048009b9d0 msgr2=0x7f048015cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:23.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.422+0000 7f0488623640 1 -- 172.21.15.18:0/4048746501 shutdown_connections 2024-09-19T09:18:23.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.422+0000 7f0488623640 1 -- 172.21.15.18:0/4048746501 wait complete. 2024-09-19T09:18:23.447 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T09:18:23.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.557+0000 7fb36c1d6640 1 Processor -- start 2024-09-19T09:18:23.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.557+0000 7fb36c1d6640 1 -- start start 2024-09-19T09:18:23.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.558+0000 7fb36c1d6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb3641623c0 0x7fb3640b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:23.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.558+0000 7fb36c1d6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3640d56b0 0x7fb3640d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:23.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.558+0000 7fb36c1d6640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb3640d0a50 0x7fb3640d1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:23.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.558+0000 7fb36c1d6640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fb3640d21a0 con 0x7fb3641623c0 2024-09-19T09:18:23.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.558+0000 7fb36c1d6640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb3640d0080 con 0x7fb3640d0a50 2024-09-19T09:18:23.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.558+0000 7fb36c1d6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb3640d3700 con 0x7fb3640d56b0 2024-09-19T09:18:23.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.558+0000 7fb369f72640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb3641623c0 0x7fb3640b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:23.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.558+0000 7fb369f72640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb3641623c0 0x7fb3640b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39556/0 (socket says 172.21.15.18:39556) 2024-09-19T09:18:23.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.558+0000 7fb369f72640 1 -- 172.21.15.18:0/4129741150 learned_addr learned my addr 172.21.15.18:0/4129741150 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:23.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.558+0000 7fb369771640 1 --2- 172.21.15.18:0/4129741150 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3640d56b0 0x7fb3640d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:23.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.558+0000 7fb36a773640 1 --2- 172.21.15.18:0/4129741150 >> v2:172.21.15.162:3300/0 conn(0x7fb3640d0a50 0x7fb3640d1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:23.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.558+0000 7fb369f72640 1 -- 172.21.15.18:0/4129741150 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3640d56b0 msgr2=0x7fb3640d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:23.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.558+0000 7fb369f72640 1 --2- 172.21.15.18:0/4129741150 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3640d56b0 0x7fb3640d0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.558+0000 7fb369f72640 1 -- 172.21.15.18:0/4129741150 >> v2:172.21.15.162:3300/0 conn(0x7fb3640d0a50 msgr2=0x7fb3640d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:23.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.558+0000 7fb369f72640 1 --2- 172.21.15.18:0/4129741150 >> v2:172.21.15.162:3300/0 conn(0x7fb3640d0a50 0x7fb3640d1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.558+0000 7fb369f72640 1 -- 172.21.15.18:0/4129741150 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3640cfa70 con 0x7fb3641623c0 2024-09-19T09:18:23.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.558+0000 7fb369771640 1 --2- 172.21.15.18:0/4129741150 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3640d56b0 0x7fb3640d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:23.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.558+0000 7fb36a773640 1 --2- 172.21.15.18:0/4129741150 >> v2:172.21.15.162:3300/0 conn(0x7fb3640d0a50 0x7fb3640d1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:23.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.559+0000 7fb369f72640 1 --2- 172.21.15.18:0/4129741150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3641623c0 0x7fb3640b6260 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb3640cfff0 tx=0x7fb36002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ee942642c8fb5a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:23.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.559+0000 7fb368f70640 1 -- 172.21.15.18:0/4129741150 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb360037070 con 0x7fb3641623c0 2024-09-19T09:18:23.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.559+0000 7fb368f70640 1 -- 172.21.15.18:0/4129741150 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb360032440 con 0x7fb3641623c0 2024-09-19T09:18:23.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.559+0000 7fb368f70640 1 -- 172.21.15.18:0/4129741150 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb360032810 con 0x7fb3641623c0 2024-09-19T09:18:23.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.560+0000 7fb36c1d6640 1 -- 172.21.15.18:0/4129741150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3641623c0 msgr2=0x7fb3640b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:23.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.560+0000 7fb36c1d6640 1 --2- 172.21.15.18:0/4129741150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3641623c0 0x7fb3640b6260 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fb3640cfff0 tx=0x7fb36002a1e0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.560+0000 7fb36c1d6640 1 -- 172.21.15.18:0/4129741150 shutdown_connections 2024-09-19T09:18:23.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.560+0000 7fb36c1d6640 1 --2- 172.21.15.18:0/4129741150 >> v2:172.21.15.162:3300/0 conn(0x7fb3640d0a50 0x7fb3640d1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.560+0000 7fb36c1d6640 1 --2- 172.21.15.18:0/4129741150 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3640d56b0 0x7fb3640d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.560+0000 7fb36c1d6640 1 --2- 172.21.15.18:0/4129741150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3641623c0 0x7fb3640b6260 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.560+0000 7fb36c1d6640 1 -- 172.21.15.18:0/4129741150 >> 172.21.15.18:0/4129741150 conn(0x7fb36409df30 msgr2=0x7fb3640d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:23.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.560+0000 7fb36c1d6640 1 -- 172.21.15.18:0/4129741150 shutdown_connections 2024-09-19T09:18:23.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.560+0000 7fb36c1d6640 1 -- 172.21.15.18:0/4129741150 wait complete. 2024-09-19T09:18:23.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.561+0000 7fb36c1d6640 1 Processor -- start 2024-09-19T09:18:23.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.561+0000 7fb36c1d6640 1 -- start start 2024-09-19T09:18:23.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.562+0000 7fb36c1d6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3640d56b0 0x7fb3640ce670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:23.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.562+0000 7fb36c1d6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3641623c0 0x7fb3641579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:23.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.562+0000 7fb36c1d6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3640cd600 0x7fb3640ca840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:23.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.562+0000 7fb36c1d6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb3641627a0 con 0x7fb3641623c0 2024-09-19T09:18:23.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.562+0000 7fb36c1d6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb3640cfd10 con 0x7fb3640d56b0 2024-09-19T09:18:23.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.562+0000 7fb36c1d6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb3640d3c80 con 0x7fb3640cd600 2024-09-19T09:18:23.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.562+0000 7fb369771640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3641623c0 0x7fb3641579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:23.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.562+0000 7fb369771640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3641623c0 0x7fb3641579f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39558/0 (socket says 172.21.15.18:39558) 2024-09-19T09:18:23.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.562+0000 7fb369771640 1 -- 172.21.15.18:0/2492311924 learned_addr learned my addr 172.21.15.18:0/2492311924 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:23.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.562+0000 7fb36a773640 1 --2- 172.21.15.18:0/2492311924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3640cd600 0x7fb3640ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:23.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.562+0000 7fb369f72640 1 --2- 172.21.15.18:0/2492311924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3640d56b0 0x7fb3640ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:23.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.562+0000 7fb369771640 1 -- 172.21.15.18:0/2492311924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3640cd600 msgr2=0x7fb3640ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:23.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.562+0000 7fb369771640 1 --2- 172.21.15.18:0/2492311924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3640cd600 0x7fb3640ca840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.562+0000 7fb369771640 1 -- 172.21.15.18:0/2492311924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3640d56b0 msgr2=0x7fb3640ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:23.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.562+0000 7fb369771640 1 --2- 172.21.15.18:0/2492311924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3640d56b0 0x7fb3640ce670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:23.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.562+0000 7fb369771640 1 -- 172.21.15.18:0/2492311924 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb364158440 con 0x7fb3641623c0 2024-09-19T09:18:23.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.562+0000 7fb369771640 1 --2- 172.21.15.18:0/2492311924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3641623c0 0x7fb3641579f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fb35400e810 tx=0x7fb35400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:23.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.562+0000 7fb35a7fc640 1 -- 172.21.15.18:0/2492311924 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb354017070 con 0x7fb3641623c0 2024-09-19T09:18:23.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.562+0000 7fb35a7fc640 1 -- 172.21.15.18:0/2492311924 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb35400c6d0 con 0x7fb3641623c0 2024-09-19T09:18:23.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.562+0000 7fb36c1d6640 1 -- 172.21.15.18:0/2492311924 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3640ced00 con 0x7fb3641623c0 2024-09-19T09:18:23.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.562+0000 7fb35a7fc640 1 -- 172.21.15.18:0/2492311924 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb35400f040 con 0x7fb3641623c0 2024-09-19T09:18:23.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.562+0000 7fb36c1d6640 1 -- 172.21.15.18:0/2492311924 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3640ccb20 con 0x7fb3641623c0 2024-09-19T09:18:23.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.563+0000 7fb36c1d6640 1 -- 172.21.15.18:0/2492311924 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3640d2340 con 0x7fb3641623c0 2024-09-19T09:18:23.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.564+0000 7fb35a7fc640 1 -- 172.21.15.18:0/2492311924 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb35401a070 con 0x7fb3641623c0 2024-09-19T09:18:23.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.565+0000 7fb35a7fc640 1 --2- 172.21.15.18:0/2492311924 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb34806c2e0 0x7fb34806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:23.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.565+0000 7fb35a7fc640 1 -- 172.21.15.18:0/2492311924 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 5609+0+0 (secure 0 0 0) 0x7fb35408af90 con 0x7fb3641623c0 2024-09-19T09:18:23.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.565+0000 7fb369f72640 1 --2- 172.21.15.18:0/2492311924 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb34806c2e0 0x7fb34806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:23.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.566+0000 7fb369f72640 1 --2- 172.21.15.18:0/2492311924 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb34806c2e0 0x7fb34806e7a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb360034000 tx=0x7fb36002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:23.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.570+0000 7fb35a7fc640 1 -- 172.21.15.18:0/2492311924 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb364158440 con 0x7fb3641623c0 2024-09-19T09:18:23.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:23.780+0000 7fb36c1d6640 1 -- 172.21.15.18:0/2492311924 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb3640d04f0 con 0x7fb3641623c0 2024-09-19T09:18:24.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.427+0000 7fb35a7fc640 1 -- 172.21.15.18:0/2492311924 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v40) ==== 174+0+0 (secure 0 0 0) 0x7fb354059760 con 0x7fb3641623c0 2024-09-19T09:18:24.428 INFO:teuthology.orchestra.run.smithi018.stderr:new fs with metadata pool 12 and data pool 13 2024-09-19T09:18:24.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.431+0000 7fb36c1d6640 1 -- 172.21.15.18:0/2492311924 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb34806c2e0 msgr2=0x7fb34806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:24.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.431+0000 7fb36c1d6640 1 --2- 172.21.15.18:0/2492311924 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb34806c2e0 0x7fb34806e7a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb360034000 tx=0x7fb36002e000 comp rx=0 tx=0).stop 2024-09-19T09:18:24.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.431+0000 7fb36c1d6640 1 -- 172.21.15.18:0/2492311924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3641623c0 msgr2=0x7fb3641579f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:24.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.431+0000 7fb36c1d6640 1 --2- 172.21.15.18:0/2492311924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3641623c0 0x7fb3641579f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fb35400e810 tx=0x7fb35400ecd0 comp rx=0 tx=0).stop 2024-09-19T09:18:24.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.431+0000 7fb36c1d6640 1 -- 172.21.15.18:0/2492311924 shutdown_connections 2024-09-19T09:18:24.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.431+0000 7fb36c1d6640 1 --2- 172.21.15.18:0/2492311924 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb34806c2e0 0x7fb34806e7a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:24.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.431+0000 7fb36c1d6640 1 --2- 172.21.15.18:0/2492311924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb3640cd600 0x7fb3640ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:24.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.431+0000 7fb36c1d6640 1 --2- 172.21.15.18:0/2492311924 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb3641623c0 0x7fb3641579f0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:24.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.431+0000 7fb36c1d6640 1 --2- 172.21.15.18:0/2492311924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb3640d56b0 0x7fb3640ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:24.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.431+0000 7fb36c1d6640 1 -- 172.21.15.18:0/2492311924 >> 172.21.15.18:0/2492311924 conn(0x7fb36409df30 msgr2=0x7fb36406dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:24.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.431+0000 7fb36c1d6640 1 -- 172.21.15.18:0/2492311924 shutdown_connections 2024-09-19T09:18:24.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.431+0000 7fb36c1d6640 1 -- 172.21.15.18:0/2492311924 wait complete. 2024-09-19T09:18:24.455 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:18:24.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.561+0000 7f23185b9640 1 Processor -- start 2024-09-19T09:18:24.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.561+0000 7f23185b9640 1 -- start start 2024-09-19T09:18:24.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.562+0000 7f23185b9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2310163190 0x7f231006e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:24.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.562+0000 7f23185b9640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23100ae840 con 0x7f231006ec70 2024-09-19T09:18:24.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.562+0000 7f23185b9640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23100b6a40 con 0x7f231006bc10 2024-09-19T09:18:24.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.562+0000 7f23185b9640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f23100b6d20 con 0x7f2310163190 2024-09-19T09:18:24.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.562+0000 7f2315b54640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2310163190 0x7f231006e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:24.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.562+0000 7f2316b56640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f231006ec70 0x7f231006f0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56082/0 (socket says 172.21.15.18:56082) 2024-09-19T09:18:24.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.562+0000 7f2316b56640 1 -- 172.21.15.18:0/4168382953 learned_addr learned my addr 172.21.15.18:0/4168382953 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:24.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.563+0000 7f2315b54640 1 -- 172.21.15.18:0/4168382953 >> v1:172.21.15.162:6789/0 conn(0x7f231006bc10 legacy=0x7f231006bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:24.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.563+0000 7f2315b54640 1 -- 172.21.15.18:0/4168382953 >> v1:172.21.15.18:6789/0 conn(0x7f231006ec70 legacy=0x7f231006f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:24.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.563+0000 7f2315b54640 1 -- 172.21.15.18:0/4168382953 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23100b4b50 con 0x7f2310163190 2024-09-19T09:18:24.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.563+0000 7f2315353640 1 -- 172.21.15.18:0/4168382953 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 801849053 0 0) 0x7f23100ae840 con 0x7f231006ec70 2024-09-19T09:18:24.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.564+0000 7f2315b54640 1 --2- 172.21.15.18:0/4168382953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2310163190 0x7f231006e730 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f23000097a0 tx=0x7f230002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99b437a3a6c4e8d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:24.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.564+0000 7f2315353640 1 -- 172.21.15.18:0/4168382953 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2300037070 con 0x7f2310163190 2024-09-19T09:18:24.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.564+0000 7f2315353640 1 -- 172.21.15.18:0/4168382953 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2300032440 con 0x7f2310163190 2024-09-19T09:18:24.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.564+0000 7f2315353640 1 -- 172.21.15.18:0/4168382953 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2300032810 con 0x7f2310163190 2024-09-19T09:18:24.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.564+0000 7f23185b9640 1 -- 172.21.15.18:0/4168382953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2310163190 msgr2=0x7f231006e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:24.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.564+0000 7f23185b9640 1 --2- 172.21.15.18:0/4168382953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2310163190 0x7f231006e730 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f23000097a0 tx=0x7f230002a230 comp rx=0 tx=0).stop 2024-09-19T09:18:24.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.564+0000 7f23185b9640 1 -- 172.21.15.18:0/4168382953 shutdown_connections 2024-09-19T09:18:24.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.564+0000 7f23185b9640 1 --2- 172.21.15.18:0/4168382953 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2310163190 0x7f231006e730 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:24.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.564+0000 7f23185b9640 1 -- 172.21.15.18:0/4168382953 >> 172.21.15.18:0/4168382953 conn(0x7f23100d1970 msgr2=0x7f23100d1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:24.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.564+0000 7f23185b9640 1 -- 172.21.15.18:0/4168382953 shutdown_connections 2024-09-19T09:18:24.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.564+0000 7f23185b9640 1 -- 172.21.15.18:0/4168382953 wait complete. 2024-09-19T09:18:24.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.565+0000 7f23185b9640 1 Processor -- start 2024-09-19T09:18:24.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.566+0000 7f23185b9640 1 -- start start 2024-09-19T09:18:24.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.566+0000 7f23185b9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f231006bc10 0x7f23100c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:24.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.566+0000 7f23185b9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f231006ec70 0x7f2310143cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:24.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.566+0000 7f23185b9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2310163190 0x7f23101441f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:24.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.566+0000 7f23185b9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f23101635d0 con 0x7f231006ec70 2024-09-19T09:18:24.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.566+0000 7f23185b9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f231006f7f0 con 0x7f231006bc10 2024-09-19T09:18:24.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.566+0000 7f23185b9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f23100b5110 con 0x7f2310163190 2024-09-19T09:18:24.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.566+0000 7f2315b54640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f231006ec70 0x7f2310143cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:24.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.566+0000 7f2315b54640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f231006ec70 0x7f2310143cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39562/0 (socket says 172.21.15.18:39562) 2024-09-19T09:18:24.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.566+0000 7f2315b54640 1 -- 172.21.15.18:0/1932239673 learned_addr learned my addr 172.21.15.18:0/1932239673 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:24.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.567+0000 7f2316b56640 1 --2- 172.21.15.18:0/1932239673 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2310163190 0x7f23101441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:24.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.567+0000 7f2316355640 1 --2- 172.21.15.18:0/1932239673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f231006bc10 0x7f23100c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:24.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.567+0000 7f2315b54640 1 -- 172.21.15.18:0/1932239673 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2310163190 msgr2=0x7f23101441f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:24.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.567+0000 7f2315b54640 1 --2- 172.21.15.18:0/1932239673 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2310163190 0x7f23101441f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:24.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.567+0000 7f2315b54640 1 -- 172.21.15.18:0/1932239673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f231006bc10 msgr2=0x7f23100c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:24.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.567+0000 7f2315b54640 1 --2- 172.21.15.18:0/1932239673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f231006bc10 0x7f23100c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:24.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.567+0000 7f2315b54640 1 -- 172.21.15.18:0/1932239673 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23100b21e0 con 0x7f231006ec70 2024-09-19T09:18:24.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.567+0000 7f2316b56640 1 --2- 172.21.15.18:0/1932239673 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2310163190 0x7f23101441f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:24.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.567+0000 7f2316355640 1 --2- 172.21.15.18:0/1932239673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f231006bc10 0x7f23100c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:24.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.567+0000 7f2315b54640 1 --2- 172.21.15.18:0/1932239673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f231006ec70 0x7f2310143cb0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f2300000c00 tx=0x7f23000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:24.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.567+0000 7f2306ffd640 1 -- 172.21.15.18:0/1932239673 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2300037040 con 0x7f231006ec70 2024-09-19T09:18:24.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.567+0000 7f2306ffd640 1 -- 172.21.15.18:0/1932239673 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2300042070 con 0x7f231006ec70 2024-09-19T09:18:24.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.567+0000 7f23185b9640 1 -- 172.21.15.18:0/1932239673 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23100b24c0 con 0x7f231006ec70 2024-09-19T09:18:24.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.567+0000 7f2306ffd640 1 -- 172.21.15.18:0/1932239673 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2300030a70 con 0x7f231006ec70 2024-09-19T09:18:24.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.567+0000 7f23185b9640 1 -- 172.21.15.18:0/1932239673 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23100b2a80 con 0x7f231006ec70 2024-09-19T09:18:24.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.568+0000 7f23185b9640 1 -- 172.21.15.18:0/1932239673 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23100b5f10 con 0x7f231006ec70 2024-09-19T09:18:24.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.569+0000 7f2306ffd640 1 -- 172.21.15.18:0/1932239673 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2300030c10 con 0x7f231006ec70 2024-09-19T09:18:24.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.569+0000 7f2306ffd640 1 --2- 172.21.15.18:0/1932239673 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f22f406c2b0 0x7f22f406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:24.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.569+0000 7f2306ffd640 1 -- 172.21.15.18:0/1932239673 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f23000abf00 con 0x7f231006ec70 2024-09-19T09:18:24.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.570+0000 7f2316355640 1 --2- 172.21.15.18:0/1932239673 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f22f406c2b0 0x7f22f406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:24.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.570+0000 7f2316355640 1 --2- 172.21.15.18:0/1932239673 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f22f406c2b0 0x7f22f406e770 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f23100c85f0 tx=0x7f230c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:24.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.574+0000 7f2306ffd640 1 -- 172.21.15.18:0/1932239673 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f23100b5f10 con 0x7f231006ec70 2024-09-19T09:18:24.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.752+0000 7f23185b9640 1 -- 172.21.15.18:0/1932239673 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f23100b6660 con 0x7f231006ec70 2024-09-19T09:18:24.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.753+0000 7f2306ffd640 1 -- 172.21.15.18:0/1932239673 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+16768 (secure 0 0 0) 0x7f230007a660 con 0x7f231006ec70 2024-09-19T09:18:24.754 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:24.754 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":103,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:18:23.781850+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:18:21.441414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-19T09:18:22.767737+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:18:24.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.755+0000 7f23185b9640 1 -- 172.21.15.18:0/1932239673 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f22f406c2b0 msgr2=0x7f22f406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:24.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.755+0000 7f23185b9640 1 --2- 172.21.15.18:0/1932239673 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f22f406c2b0 0x7f22f406e770 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f23100c85f0 tx=0x7f230c009040 comp rx=0 tx=0).stop 2024-09-19T09:18:24.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.755+0000 7f23185b9640 1 -- 172.21.15.18:0/1932239673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f231006ec70 msgr2=0x7f2310143cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:24.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.755+0000 7f23185b9640 1 --2- 172.21.15.18:0/1932239673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f231006ec70 0x7f2310143cb0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f2300000c00 tx=0x7f23000046c0 comp rx=0 tx=0).stop 2024-09-19T09:18:24.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.755+0000 7f23185b9640 1 -- 172.21.15.18:0/1932239673 shutdown_connections 2024-09-19T09:18:24.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.755+0000 7f23185b9640 1 --2- 172.21.15.18:0/1932239673 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f22f406c2b0 0x7f22f406e770 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:24.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.755+0000 7f23185b9640 1 --2- 172.21.15.18:0/1932239673 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2310163190 0x7f23101441f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:24.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.755+0000 7f23185b9640 1 --2- 172.21.15.18:0/1932239673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f231006ec70 0x7f2310143cb0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:24.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.755+0000 7f23185b9640 1 --2- 172.21.15.18:0/1932239673 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f231006bc10 0x7f23100c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:24.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.755+0000 7f23185b9640 1 -- 172.21.15.18:0/1932239673 >> 172.21.15.18:0/1932239673 conn(0x7f23100d1970 msgr2=0x7f23100af9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:24.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.755+0000 7f23185b9640 1 -- 172.21.15.18:0/1932239673 shutdown_connections 2024-09-19T09:18:24.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.755+0000 7f23185b9640 1 -- 172.21.15.18:0/1932239673 wait complete. 2024-09-19T09:18:24.767 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:18:24.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.868+0000 7f62fcb4b640 1 Processor -- start 2024-09-19T09:18:24.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.868+0000 7f62fcb4b640 1 -- start start 2024-09-19T09:18:24.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.869+0000 7f62fcb4b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f62f80ce780 0x7f62f806f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:24.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.869+0000 7f62fcb4b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62f806e3d0 con 0x7f62f8145290 2024-09-19T09:18:24.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.869+0000 7f62fcb4b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62f806e6b0 con 0x7f62f8072f40 2024-09-19T09:18:24.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.869+0000 7f62fcb4b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f62f806efe0 con 0x7f62f80ce780 2024-09-19T09:18:24.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.869+0000 7f62f659c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f62f8145290 0x7f62f8072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56092/0 (socket says 172.21.15.18:56092) 2024-09-19T09:18:24.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.869+0000 7f62f659c640 1 -- 172.21.15.18:0/1257467527 learned_addr learned my addr 172.21.15.18:0/1257467527 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:24.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.869+0000 7f62f559a640 1 -- 172.21.15.18:0/1257467527 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1544120001 0 0) 0x7f62f806e3d0 con 0x7f62f8145290 2024-09-19T09:18:24.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.869+0000 7f62f559a640 1 -- 172.21.15.18:0/1257467527 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62e4005730 con 0x7f62f8145290 2024-09-19T09:18:24.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.869+0000 7f62f6d9d640 1 --2- 172.21.15.18:0/1257467527 >> v2:172.21.15.162:3300/0 conn(0x7f62f80ce780 0x7f62f806f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:24.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.870+0000 7f62f559a640 1 -- 172.21.15.18:0/1257467527 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4016661517 0 0) 0x7f62e4005730 con 0x7f62f8145290 2024-09-19T09:18:24.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.870+0000 7f62f559a640 1 -- 172.21.15.18:0/1257467527 >> v2:172.21.15.162:3300/0 conn(0x7f62f80ce780 msgr2=0x7f62f806f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:24.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.870+0000 7f62f559a640 1 --2- 172.21.15.18:0/1257467527 >> v2:172.21.15.162:3300/0 conn(0x7f62f80ce780 0x7f62f806f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:24.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.870+0000 7f62f559a640 1 -- 172.21.15.18:0/1257467527 >> v1:172.21.15.162:6789/0 conn(0x7f62f8072f40 legacy=0x7f62f80b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:24.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.870+0000 7f62f559a640 1 -- 172.21.15.18:0/1257467527 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f806e990 con 0x7f62f8145290 2024-09-19T09:18:24.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.870+0000 7f62f559a640 1 -- 172.21.15.18:0/1257467527 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f62f0001670 con 0x7f62f8145290 2024-09-19T09:18:24.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.870+0000 7f62f559a640 1 -- 172.21.15.18:0/1257467527 >> v1:172.21.15.18:6789/0 conn(0x7f62f8145290 legacy=0x7f62f8072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:24.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.870+0000 7f62f559a640 1 --2- 172.21.15.18:0/1257467527 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62e4005bc0 0x7f62e4005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:24.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.870+0000 7f62f559a640 1 --2- 172.21.15.18:0/1257467527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e40065c0 0x7f62e4006a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:24.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.870+0000 7f62f559a640 1 --2- 172.21.15.18:0/1257467527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62e4007290 0x7f62e400dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:24.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.870+0000 7f62f559a640 1 -- 172.21.15.18:0/1257467527 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f62f806efe0 con 0x7f62e4007290 2024-09-19T09:18:24.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.870+0000 7f62f559a640 1 -- 172.21.15.18:0/1257467527 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f62e400e1f0 con 0x7f62e40065c0 2024-09-19T09:18:24.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.870+0000 7f62f559a640 1 -- 172.21.15.18:0/1257467527 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f62e400e3f0 con 0x7f62e4005bc0 2024-09-19T09:18:24.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.870+0000 7f62f6d9d640 1 --2- 172.21.15.18:0/1257467527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62e4007290 0x7f62e400dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:24.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.870+0000 7f62f659c640 1 --2- 172.21.15.18:0/1257467527 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62e4005bc0 0x7f62e4005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:24.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.870+0000 7f62f5d9b640 1 --2- 172.21.15.18:0/1257467527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e40065c0 0x7f62e4006a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:24.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.870+0000 7f62f6d9d640 1 -- 172.21.15.18:0/1257467527 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62e4005bc0 msgr2=0x7f62e4005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:24.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.870+0000 7f62f6d9d640 1 --2- 172.21.15.18:0/1257467527 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62e4005bc0 0x7f62e4005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:24.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.870+0000 7f62f6d9d640 1 -- 172.21.15.18:0/1257467527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e40065c0 msgr2=0x7f62e4006a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:24.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.870+0000 7f62f6d9d640 1 --2- 172.21.15.18:0/1257467527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e40065c0 0x7f62e4006a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:24.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.870+0000 7f62f6d9d640 1 -- 172.21.15.18:0/1257467527 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e4005730 con 0x7f62e4007290 2024-09-19T09:18:24.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.870+0000 7f62f5d9b640 1 --2- 172.21.15.18:0/1257467527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62e40065c0 0x7f62e4006a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:24.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.871+0000 7f62f6d9d640 1 -- 172.21.15.18:0/1257467527 reap_dead start 2024-09-19T09:18:24.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.871+0000 7f62f6d9d640 1 --2- 172.21.15.18:0/1257467527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62e4007290 0x7f62e400dbd0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f62e8009fc0 tx=0x7f62e4007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78adc8104f9e0a4d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:24.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.871+0000 7f62f559a640 1 -- 172.21.15.18:0/1257467527 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e8035020 con 0x7f62e4007290 2024-09-19T09:18:24.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.871+0000 7f62f559a640 1 -- 172.21.15.18:0/1257467527 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e8003bd0 con 0x7f62e4007290 2024-09-19T09:18:24.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.871+0000 7f62f559a640 1 -- 172.21.15.18:0/1257467527 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e8009c10 con 0x7f62e4007290 2024-09-19T09:18:24.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.872+0000 7f62fcb4b640 1 -- 172.21.15.18:0/1257467527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62e4007290 msgr2=0x7f62e400dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:24.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.872+0000 7f62fcb4b640 1 --2- 172.21.15.18:0/1257467527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62e4007290 0x7f62e400dbd0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f62e8009fc0 tx=0x7f62e4007a40 comp rx=0 tx=0).stop 2024-09-19T09:18:24.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.872+0000 7f62fcb4b640 1 -- 172.21.15.18:0/1257467527 shutdown_connections 2024-09-19T09:18:24.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.872+0000 7f62fcb4b640 1 --2- 172.21.15.18:0/1257467527 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62e4007290 0x7f62e400dbd0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:24.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.872+0000 7f62fcb4b640 1 -- 172.21.15.18:0/1257467527 >> 172.21.15.18:0/1257467527 conn(0x7f62f806bc10 msgr2=0x7f62f806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:24.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.872+0000 7f62fcb4b640 1 -- 172.21.15.18:0/1257467527 shutdown_connections 2024-09-19T09:18:24.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.872+0000 7f62fcb4b640 1 -- 172.21.15.18:0/1257467527 wait complete. 2024-09-19T09:18:24.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.873+0000 7f62fcb4b640 1 Processor -- start 2024-09-19T09:18:24.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.873+0000 7f62fcb4b640 1 -- start start 2024-09-19T09:18:24.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.874+0000 7f62fcb4b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62e4007290 0x7f62f815bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:24.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.874+0000 7f62fcb4b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62f80af220 0x7f62f813db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:24.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.874+0000 7f62fcb4b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62f815afc0 0x7f62f815b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:24.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.874+0000 7f62fcb4b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f62f806df80 con 0x7f62e4007290 2024-09-19T09:18:24.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.874+0000 7f62fcb4b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f62f8145670 con 0x7f62f815afc0 2024-09-19T09:18:24.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.874+0000 7f62fcb4b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f62f806e100 con 0x7f62f80af220 2024-09-19T09:18:24.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.874+0000 7f62f659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62e4007290 0x7f62f815bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:24.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.874+0000 7f62f659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62e4007290 0x7f62f815bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39584/0 (socket says 172.21.15.18:39584) 2024-09-19T09:18:24.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.874+0000 7f62f659c640 1 -- 172.21.15.18:0/666046643 learned_addr learned my addr 172.21.15.18:0/666046643 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:24.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.874+0000 7f62f659c640 1 -- 172.21.15.18:0/666046643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62f80af220 msgr2=0x7f62f813db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:24.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.874+0000 7f62f5d9b640 1 --2- 172.21.15.18:0/666046643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62f80af220 0x7f62f813db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:24.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.874+0000 7f62f6d9d640 1 --2- 172.21.15.18:0/666046643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62f815afc0 0x7f62f815b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:24.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.874+0000 7f62f659c640 1 --2- 172.21.15.18:0/666046643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62f80af220 0x7f62f813db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:24.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.874+0000 7f62f659c640 1 -- 172.21.15.18:0/666046643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62f815afc0 msgr2=0x7f62f815b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:24.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.874+0000 7f62f659c640 1 --2- 172.21.15.18:0/666046643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62f815afc0 0x7f62f815b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:24.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.874+0000 7f62f659c640 1 -- 172.21.15.18:0/666046643 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f8135c50 con 0x7f62e4007290 2024-09-19T09:18:24.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.875+0000 7f62f659c640 1 --2- 172.21.15.18:0/666046643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62e4007290 0x7f62f815bfa0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f62f00072c0 tx=0x7f62f0007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:24.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.875+0000 7f62eeffd640 1 -- 172.21.15.18:0/666046643 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f000f960 con 0x7f62e4007290 2024-09-19T09:18:24.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.875+0000 7f62eeffd640 1 -- 172.21.15.18:0/666046643 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62f0018070 con 0x7f62e4007290 2024-09-19T09:18:24.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.875+0000 7f62fcb4b640 1 -- 172.21.15.18:0/666046643 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62f815d890 con 0x7f62e4007290 2024-09-19T09:18:24.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.875+0000 7f62eeffd640 1 -- 172.21.15.18:0/666046643 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62f000fd60 con 0x7f62e4007290 2024-09-19T09:18:24.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.875+0000 7f62fcb4b640 1 -- 172.21.15.18:0/666046643 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62f8138630 con 0x7f62e4007290 2024-09-19T09:18:24.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.876+0000 7f62fcb4b640 1 -- 172.21.15.18:0/666046643 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62f80715a0 con 0x7f62e4007290 2024-09-19T09:18:24.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.876+0000 7f62eeffd640 1 -- 172.21.15.18:0/666046643 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f62f001d460 con 0x7f62e4007290 2024-09-19T09:18:24.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.877+0000 7f62eeffd640 1 --2- 172.21.15.18:0/666046643 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f62d806c2b0 0x7f62d806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:24.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.877+0000 7f62eeffd640 1 -- 172.21.15.18:0/666046643 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f62f008b400 con 0x7f62e4007290 2024-09-19T09:18:24.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.877+0000 7f62f5d9b640 1 --2- 172.21.15.18:0/666046643 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f62d806c2b0 0x7f62d806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:24.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.878+0000 7f62f5d9b640 1 --2- 172.21.15.18:0/666046643 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f62d806c2b0 0x7f62d806e770 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f62f813eb00 tx=0x7f62e0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:24.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:24.881+0000 7f62eeffd640 1 -- 172.21.15.18:0/666046643 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f62f0059c00 con 0x7f62e4007290 2024-09-19T09:18:25.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.055+0000 7f62fcb4b640 1 -- 172.21.15.18:0/666046643 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f62f80cfe90 con 0x7f62e4007290 2024-09-19T09:18:25.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.057+0000 7f62eeffd640 1 -- 172.21.15.18:0/666046643 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) ==== 74+0+16768 (secure 0 0 0) 0x7f62f0059500 con 0x7f62e4007290 2024-09-19T09:18:25.058 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:25.058 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":103,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:18:23.781850+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:18:21.441414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-19T09:18:22.767737+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:18:25.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.058+0000 7f62fcb4b640 1 -- 172.21.15.18:0/666046643 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f62d806c2b0 msgr2=0x7f62d806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:25.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.058+0000 7f62fcb4b640 1 --2- 172.21.15.18:0/666046643 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f62d806c2b0 0x7f62d806e770 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f62f813eb00 tx=0x7f62e0009040 comp rx=0 tx=0).stop 2024-09-19T09:18:25.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.058+0000 7f62fcb4b640 1 -- 172.21.15.18:0/666046643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62e4007290 msgr2=0x7f62f815bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:25.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.058+0000 7f62fcb4b640 1 --2- 172.21.15.18:0/666046643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62e4007290 0x7f62f815bfa0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f62f00072c0 tx=0x7f62f0007780 comp rx=0 tx=0).stop 2024-09-19T09:18:25.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.058+0000 7f62fcb4b640 1 -- 172.21.15.18:0/666046643 shutdown_connections 2024-09-19T09:18:25.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.058+0000 7f62fcb4b640 1 --2- 172.21.15.18:0/666046643 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f62d806c2b0 0x7f62d806e770 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.058+0000 7f62fcb4b640 1 --2- 172.21.15.18:0/666046643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62f815afc0 0x7f62f815b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.058+0000 7f62fcb4b640 1 --2- 172.21.15.18:0/666046643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62f80af220 0x7f62f813db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.058+0000 7f62fcb4b640 1 --2- 172.21.15.18:0/666046643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62e4007290 0x7f62f815bfa0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.058+0000 7f62fcb4b640 1 -- 172.21.15.18:0/666046643 >> 172.21.15.18:0/666046643 conn(0x7f62f806bc10 msgr2=0x7f62f80ceda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:25.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.059+0000 7f62fcb4b640 1 -- 172.21.15.18:0/666046643 shutdown_connections 2024-09-19T09:18:25.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.059+0000 7f62fcb4b640 1 -- 172.21.15.18:0/666046643 wait complete. 2024-09-19T09:18:25.070 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-19T09:18:25.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.174+0000 7f465650a640 1 Processor -- start 2024-09-19T09:18:25.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.175+0000 7f465650a640 1 -- start start 2024-09-19T09:18:25.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.175+0000 7f465650a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46500b46f0 0x7f46500af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.175+0000 7f465650a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f46500b4b30 0x7f46500af600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.175+0000 7f465650a640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4650072790 con 0x7f46500b4f90 2024-09-19T09:18:25.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.175+0000 7f465650a640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f46500d0a80 con 0x7f46500b4b30 2024-09-19T09:18:25.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.175+0000 7f465650a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4650073640 con 0x7f46500b46f0 2024-09-19T09:18:25.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.176+0000 7f4654aa7640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f46500b4b30 0x7f46500af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.176+0000 7f4654aa7640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f46500b4b30 0x7f46500af600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39590/0 (socket says 172.21.15.18:39590) 2024-09-19T09:18:25.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.176+0000 7f4654aa7640 1 -- 172.21.15.18:0/1406431707 learned_addr learned my addr 172.21.15.18:0/1406431707 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:25.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.176+0000 7f464f7fe640 1 --2- 172.21.15.18:0/1406431707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46500b46f0 0x7f46500af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.176+0000 7f4654aa7640 1 -- 172.21.15.18:0/1406431707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46500b46f0 msgr2=0x7f46500af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:25.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.176+0000 7f4654aa7640 1 --2- 172.21.15.18:0/1406431707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46500b46f0 0x7f46500af0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.176+0000 7f4654aa7640 1 -- 172.21.15.18:0/1406431707 >> v1:172.21.15.162:6789/0 conn(0x7f46500b4f90 legacy=0x7f46500b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:25.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.176+0000 7f4654aa7640 1 -- 172.21.15.18:0/1406431707 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4650072a30 con 0x7f46500b4b30 2024-09-19T09:18:25.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.177+0000 7f4654aa7640 1 --2- 172.21.15.18:0/1406431707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46500b4b30 0x7f46500af600 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f4648009e50 tx=0x7f464802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=619814f808b2a40a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:25.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.177+0000 7f464effd640 1 -- 172.21.15.18:0/1406431707 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4648036070 con 0x7f46500b4b30 2024-09-19T09:18:25.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.177+0000 7f464effd640 1 -- 172.21.15.18:0/1406431707 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4648031600 con 0x7f46500b4b30 2024-09-19T09:18:25.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.177+0000 7f464effd640 1 -- 172.21.15.18:0/1406431707 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46480319d0 con 0x7f46500b4b30 2024-09-19T09:18:25.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.177+0000 7f465650a640 1 -- 172.21.15.18:0/1406431707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46500b4b30 msgr2=0x7f46500af600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:25.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.177+0000 7f465650a640 1 --2- 172.21.15.18:0/1406431707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46500b4b30 0x7f46500af600 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f4648009e50 tx=0x7f464802a6c0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.177+0000 7f465650a640 1 -- 172.21.15.18:0/1406431707 shutdown_connections 2024-09-19T09:18:25.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.177+0000 7f465650a640 1 --2- 172.21.15.18:0/1406431707 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46500b4b30 0x7f46500af600 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.177+0000 7f465650a640 1 --2- 172.21.15.18:0/1406431707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46500b46f0 0x7f46500af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.177+0000 7f465650a640 1 -- 172.21.15.18:0/1406431707 >> 172.21.15.18:0/1406431707 conn(0x7f465006bc10 msgr2=0x7f465006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:25.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.177+0000 7f465650a640 1 -- 172.21.15.18:0/1406431707 shutdown_connections 2024-09-19T09:18:25.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.177+0000 7f465650a640 1 -- 172.21.15.18:0/1406431707 wait complete. 2024-09-19T09:18:25.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.178+0000 7f465650a640 1 Processor -- start 2024-09-19T09:18:25.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.179+0000 7f465650a640 1 -- start start 2024-09-19T09:18:25.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.179+0000 7f465650a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46500b46f0 0x7f46501582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.179+0000 7f465650a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46500b4b30 0x7f4650154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.179+0000 7f465650a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46500b4f90 0x7f465015df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.179+0000 7f465650a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f46500732d0 con 0x7f46500b4b30 2024-09-19T09:18:25.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.179+0000 7f465650a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4650072ff0 con 0x7f46500b46f0 2024-09-19T09:18:25.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.179+0000 7f465650a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f46500b3fa0 con 0x7f46500b4f90 2024-09-19T09:18:25.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.179+0000 7f464f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46500b4b30 0x7f4650154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.180+0000 7f464f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46500b4b30 0x7f4650154de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39596/0 (socket says 172.21.15.18:39596) 2024-09-19T09:18:25.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.180+0000 7f464f7fe640 1 -- 172.21.15.18:0/1672816188 learned_addr learned my addr 172.21.15.18:0/1672816188 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:25.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.180+0000 7f464ffff640 1 --2- 172.21.15.18:0/1672816188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46500b46f0 0x7f46501582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.180+0000 7f4654aa7640 1 --2- 172.21.15.18:0/1672816188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46500b4f90 0x7f465015df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.180+0000 7f464f7fe640 1 -- 172.21.15.18:0/1672816188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46500b4f90 msgr2=0x7f465015df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:25.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.180+0000 7f464f7fe640 1 --2- 172.21.15.18:0/1672816188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46500b4f90 0x7f465015df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.180+0000 7f464f7fe640 1 -- 172.21.15.18:0/1672816188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46500b46f0 msgr2=0x7f46501582c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:25.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.180+0000 7f464f7fe640 1 --2- 172.21.15.18:0/1672816188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46500b46f0 0x7f46501582c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.180+0000 7f464f7fe640 1 -- 172.21.15.18:0/1672816188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4650157fb0 con 0x7f46500b4b30 2024-09-19T09:18:25.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.180+0000 7f4654aa7640 1 --2- 172.21.15.18:0/1672816188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46500b4f90 0x7f465015df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:25.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.180+0000 7f464ffff640 1 --2- 172.21.15.18:0/1672816188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46500b46f0 0x7f46501582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:25.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.180+0000 7f464f7fe640 1 --2- 172.21.15.18:0/1672816188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46500b4b30 0x7f4650154de0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f464400c7f0 tx=0x7f464400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:25.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.180+0000 7f464cff9640 1 -- 172.21.15.18:0/1672816188 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4644015070 con 0x7f46500b4b30 2024-09-19T09:18:25.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.180+0000 7f464cff9640 1 -- 172.21.15.18:0/1672816188 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4644004240 con 0x7f46500b4b30 2024-09-19T09:18:25.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.180+0000 7f465650a640 1 -- 172.21.15.18:0/1672816188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4650156780 con 0x7f46500b4b30 2024-09-19T09:18:25.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.180+0000 7f464cff9640 1 -- 172.21.15.18:0/1672816188 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4644007620 con 0x7f46500b4b30 2024-09-19T09:18:25.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.180+0000 7f465650a640 1 -- 172.21.15.18:0/1672816188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4650156d40 con 0x7f46500b4b30 2024-09-19T09:18:25.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.181+0000 7f465650a640 1 -- 172.21.15.18:0/1672816188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4650073ab0 con 0x7f46500b4b30 2024-09-19T09:18:25.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.182+0000 7f464cff9640 1 -- 172.21.15.18:0/1672816188 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f46440077c0 con 0x7f46500b4b30 2024-09-19T09:18:25.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.182+0000 7f464cff9640 1 --2- 172.21.15.18:0/1672816188 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f463c06c2b0 0x7f463c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.182+0000 7f464cff9640 1 -- 172.21.15.18:0/1672816188 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5709+0+0 (secure 0 0 0) 0x7f464408b5b0 con 0x7f46500b4b30 2024-09-19T09:18:25.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.182+0000 7f464ffff640 1 --2- 172.21.15.18:0/1672816188 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f463c06c2b0 0x7f463c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.183+0000 7f464ffff640 1 --2- 172.21.15.18:0/1672816188 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f463c06c2b0 0x7f463c06e770 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4640006fd0 tx=0x7f4640008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:25.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.187+0000 7f464cff9640 1 -- 172.21.15.18:0/1672816188 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f4644059db0 con 0x7f46500b4b30 2024-09-19T09:18:25.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.397+0000 7f465650a640 1 -- 172.21.15.18:0/1672816188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f465006eec0 con 0x7f46500b4b30 2024-09-19T09:18:25.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.439+0000 7f464cff9640 1 -- 172.21.15.18:0/1672816188 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v41) ==== 118+0+0 (secure 0 0 0) 0x7f46440596b0 con 0x7f46500b4b30 2024-09-19T09:18:25.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.441+0000 7f465650a640 1 -- 172.21.15.18:0/1672816188 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f463c06c2b0 msgr2=0x7f463c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:25.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.441+0000 7f465650a640 1 --2- 172.21.15.18:0/1672816188 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f463c06c2b0 0x7f463c06e770 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4640006fd0 tx=0x7f4640008040 comp rx=0 tx=0).stop 2024-09-19T09:18:25.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.441+0000 7f465650a640 1 -- 172.21.15.18:0/1672816188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46500b4b30 msgr2=0x7f4650154de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:25.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.441+0000 7f465650a640 1 --2- 172.21.15.18:0/1672816188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46500b4b30 0x7f4650154de0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f464400c7f0 tx=0x7f464400ccb0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.441+0000 7f465650a640 1 -- 172.21.15.18:0/1672816188 shutdown_connections 2024-09-19T09:18:25.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.441+0000 7f465650a640 1 --2- 172.21.15.18:0/1672816188 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f463c06c2b0 0x7f463c06e770 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.441+0000 7f465650a640 1 --2- 172.21.15.18:0/1672816188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f46500b4f90 0x7f465015df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.441+0000 7f465650a640 1 --2- 172.21.15.18:0/1672816188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f46500b4b30 0x7f4650154de0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.441+0000 7f465650a640 1 --2- 172.21.15.18:0/1672816188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f46500b46f0 0x7f46501582c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.441+0000 7f465650a640 1 -- 172.21.15.18:0/1672816188 >> 172.21.15.18:0/1672816188 conn(0x7f465006bc10 msgr2=0x7f46501410c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:25.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.441+0000 7f465650a640 1 -- 172.21.15.18:0/1672816188 shutdown_connections 2024-09-19T09:18:25.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.441+0000 7f465650a640 1 -- 172.21.15.18:0/1672816188 wait complete. 2024-09-19T09:18:25.453 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-19T09:18:25.453 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-19T09:18:25.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.557+0000 7f908de9b640 1 Processor -- start 2024-09-19T09:18:25.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.557+0000 7f908de9b640 1 -- start start 2024-09-19T09:18:25.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.558+0000 7f908de9b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90880d14e0 0x7f90880d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.558+0000 7f908de9b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f90880b47e0 0x7f90880b4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.558+0000 7f908de9b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90880d3270 con 0x7f908815ede0 2024-09-19T09:18:25.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.558+0000 7f908de9b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f90880d1e60 con 0x7f90880b47e0 2024-09-19T09:18:25.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.558+0000 7f908de9b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f90880d34e0 con 0x7f90880d14e0 2024-09-19T09:18:25.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.559+0000 7f9087fff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f90880b47e0 0x7f90880b4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.559+0000 7f9086ffd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90880d14e0 0x7f90880d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.559+0000 7f90877fe640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f908815ede0 0x7f90880d5300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:58618/0 (socket says 172.21.15.18:58618) 2024-09-19T09:18:25.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.559+0000 7f90877fe640 1 -- 172.21.15.18:0/615122028 learned_addr learned my addr 172.21.15.18:0/615122028 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:25.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.559+0000 7f9086ffd640 1 -- 172.21.15.18:0/615122028 >> v2:172.21.15.162:3300/0 conn(0x7f90880b47e0 msgr2=0x7f90880b4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:25.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.559+0000 7f9086ffd640 1 --2- 172.21.15.18:0/615122028 >> v2:172.21.15.162:3300/0 conn(0x7f90880b47e0 0x7f90880b4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.559+0000 7f9086ffd640 1 -- 172.21.15.18:0/615122028 >> v1:172.21.15.162:6789/0 conn(0x7f908815ede0 legacy=0x7f90880d5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:25.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.559+0000 7f9086ffd640 1 -- 172.21.15.18:0/615122028 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90880d37c0 con 0x7f90880d14e0 2024-09-19T09:18:25.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.560+0000 7f9086ffd640 1 --2- 172.21.15.18:0/615122028 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90880d14e0 0x7f90880d1920 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f907c0097a0 tx=0x7f907c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff02e1de306dfd88 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:25.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.560+0000 7f90867fc640 1 -- 172.21.15.18:0/615122028 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907c037070 con 0x7f90880d14e0 2024-09-19T09:18:25.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.560+0000 7f90867fc640 1 -- 172.21.15.18:0/615122028 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f907c032440 con 0x7f90880d14e0 2024-09-19T09:18:25.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.560+0000 7f90867fc640 1 -- 172.21.15.18:0/615122028 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f907c032810 con 0x7f90880d14e0 2024-09-19T09:18:25.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.561+0000 7f908de9b640 1 -- 172.21.15.18:0/615122028 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90880d14e0 msgr2=0x7f90880d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:25.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.561+0000 7f908de9b640 1 --2- 172.21.15.18:0/615122028 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90880d14e0 0x7f90880d1920 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f907c0097a0 tx=0x7f907c02a210 comp rx=0 tx=0).stop 2024-09-19T09:18:25.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.561+0000 7f908de9b640 1 -- 172.21.15.18:0/615122028 shutdown_connections 2024-09-19T09:18:25.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.561+0000 7f908de9b640 1 --2- 172.21.15.18:0/615122028 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90880d14e0 0x7f90880d1920 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.561+0000 7f908de9b640 1 --2- 172.21.15.18:0/615122028 >> v2:172.21.15.162:3300/0 conn(0x7f90880b47e0 0x7f90880b4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.561+0000 7f908de9b640 1 -- 172.21.15.18:0/615122028 >> 172.21.15.18:0/615122028 conn(0x7f908809df30 msgr2=0x7f90880d4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:25.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.561+0000 7f908de9b640 1 -- 172.21.15.18:0/615122028 shutdown_connections 2024-09-19T09:18:25.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.561+0000 7f908de9b640 1 -- 172.21.15.18:0/615122028 wait complete. 2024-09-19T09:18:25.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.562+0000 7f908de9b640 1 Processor -- start 2024-09-19T09:18:25.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.562+0000 7f908de9b640 1 -- start start 2024-09-19T09:18:25.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.563+0000 7f908de9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90880b47e0 0x7f90881f4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.563+0000 7f908de9b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90880d14e0 0x7f90880cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.563+0000 7f908de9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f908815ede0 0x7f90881610f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.563+0000 7f908de9b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f90880d5a10 con 0x7f908815ede0 2024-09-19T09:18:25.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.563+0000 7f908de9b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f908815f1c0 con 0x7f90880b47e0 2024-09-19T09:18:25.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.563+0000 7f908de9b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f90880b4020 con 0x7f90880d14e0 2024-09-19T09:18:25.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.563+0000 7f9087fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f908815ede0 0x7f90881610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.563+0000 7f9087fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f908815ede0 0x7f90881610f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51270/0 (socket says 172.21.15.18:51270) 2024-09-19T09:18:25.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.563+0000 7f9087fff640 1 -- 172.21.15.18:0/1294840128 learned_addr learned my addr 172.21.15.18:0/1294840128 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:25.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.563+0000 7f9086ffd640 1 --2- 172.21.15.18:0/1294840128 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90880d14e0 0x7f90880cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.563+0000 7f90877fe640 1 --2- 172.21.15.18:0/1294840128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90880b47e0 0x7f90881f4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.563+0000 7f9087fff640 1 -- 172.21.15.18:0/1294840128 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90880d14e0 msgr2=0x7f90880cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:25.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.563+0000 7f9087fff640 1 --2- 172.21.15.18:0/1294840128 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90880d14e0 0x7f90880cbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.563+0000 7f9087fff640 1 -- 172.21.15.18:0/1294840128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90880b47e0 msgr2=0x7f90881f4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:25.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.563+0000 7f9087fff640 1 --2- 172.21.15.18:0/1294840128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90880b47e0 0x7f90881f4ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:25.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.563+0000 7f9087fff640 1 -- 172.21.15.18:0/1294840128 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9088161b90 con 0x7f908815ede0 2024-09-19T09:18:25.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.563+0000 7f9087fff640 1 --2- 172.21.15.18:0/1294840128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f908815ede0 0x7f90881610f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f9080009d30 tx=0x7f908000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:25.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.564+0000 7f906ffff640 1 -- 172.21.15.18:0/1294840128 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9080018020 con 0x7f908815ede0 2024-09-19T09:18:25.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.564+0000 7f906ffff640 1 -- 172.21.15.18:0/1294840128 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9080014480 con 0x7f908815ede0 2024-09-19T09:18:25.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.564+0000 7f908de9b640 1 -- 172.21.15.18:0/1294840128 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90880b8620 con 0x7f908815ede0 2024-09-19T09:18:25.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.564+0000 7f906ffff640 1 -- 172.21.15.18:0/1294840128 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9080014870 con 0x7f908815ede0 2024-09-19T09:18:25.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.564+0000 7f908de9b640 1 -- 172.21.15.18:0/1294840128 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90880b8ec0 con 0x7f908815ede0 2024-09-19T09:18:25.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.565+0000 7f908de9b640 1 -- 172.21.15.18:0/1294840128 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90880b87f0 con 0x7f908815ede0 2024-09-19T09:18:25.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.565+0000 7f906ffff640 1 -- 172.21.15.18:0/1294840128 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f908001b020 con 0x7f908815ede0 2024-09-19T09:18:25.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.566+0000 7f906ffff640 1 --2- 172.21.15.18:0/1294840128 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f907406c2b0 0x7f907406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:25.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.566+0000 7f906ffff640 1 -- 172.21.15.18:0/1294840128 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f908008be70 con 0x7f908815ede0 2024-09-19T09:18:25.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.566+0000 7f90877fe640 1 --2- 172.21.15.18:0/1294840128 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f907406c2b0 0x7f907406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:25.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.567+0000 7f90877fe640 1 --2- 172.21.15.18:0/1294840128 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f907406c2b0 0x7f907406e770 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9078007fd0 tx=0x7f9078007e80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:25.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.570+0000 7f906ffff640 1 -- 172.21.15.18:0/1294840128 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9080022030 con 0x7f908815ede0 2024-09-19T09:18:25.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:25.788+0000 7f908de9b640 1 -- 172.21.15.18:0/1294840128 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f908815be60 con 0x7f908815ede0 2024-09-19T09:18:26.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.444+0000 7f906ffff640 1 -- 172.21.15.18:0/1294840128 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v42) ==== 122+0+0 (secure 0 0 0) 0x7f9080010040 con 0x7f908815ede0 2024-09-19T09:18:26.446 INFO:tasks.ceph.mds.d.smithi162.stderr:2024-09-19T09:18:26.445+0000 7f172e023640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T09:18:26.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.447+0000 7f908de9b640 1 -- 172.21.15.18:0/1294840128 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f907406c2b0 msgr2=0x7f907406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:26.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.447+0000 7f908de9b640 1 --2- 172.21.15.18:0/1294840128 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f907406c2b0 0x7f907406e770 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9078007fd0 tx=0x7f9078007e80 comp rx=0 tx=0).stop 2024-09-19T09:18:26.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.447+0000 7f908de9b640 1 -- 172.21.15.18:0/1294840128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f908815ede0 msgr2=0x7f90881610f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:26.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.447+0000 7f908de9b640 1 --2- 172.21.15.18:0/1294840128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f908815ede0 0x7f90881610f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f9080009d30 tx=0x7f908000c490 comp rx=0 tx=0).stop 2024-09-19T09:18:26.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.447+0000 7f908de9b640 1 -- 172.21.15.18:0/1294840128 shutdown_connections 2024-09-19T09:18:26.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.447+0000 7f908de9b640 1 --2- 172.21.15.18:0/1294840128 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f907406c2b0 0x7f907406e770 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:26.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.447+0000 7f908de9b640 1 --2- 172.21.15.18:0/1294840128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f908815ede0 0x7f90881610f0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:26.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.447+0000 7f908de9b640 1 --2- 172.21.15.18:0/1294840128 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f90880d14e0 0x7f90880cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:26.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.447+0000 7f908de9b640 1 --2- 172.21.15.18:0/1294840128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f90880b47e0 0x7f90881f4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:26.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.447+0000 7f908de9b640 1 -- 172.21.15.18:0/1294840128 >> 172.21.15.18:0/1294840128 conn(0x7f908809df30 msgr2=0x7f90880b6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:26.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.447+0000 7f908de9b640 1 -- 172.21.15.18:0/1294840128 shutdown_connections 2024-09-19T09:18:26.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.447+0000 7f908de9b640 1 -- 172.21.15.18:0/1294840128 wait complete. 2024-09-19T09:18:26.462 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-19T09:18:26.462 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:18:26.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.571+0000 7feeee152640 1 Processor -- start 2024-09-19T09:18:26.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.572+0000 7feeee152640 1 -- start start 2024-09-19T09:18:26.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.572+0000 7feeee152640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7feee815ef50 0x7feee80d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:26.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.572+0000 7feeee152640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feee80d3240 0x7feee80d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:26.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.572+0000 7feeee152640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7feee80d5780 0x7feee80cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:26.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.572+0000 7feeee152640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7feee80b7a90 con 0x7feee80d5780 2024-09-19T09:18:26.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.572+0000 7feeee152640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7feee80d3740 con 0x7feee815ef50 2024-09-19T09:18:26.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.572+0000 7feeee152640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7feee80d3a20 con 0x7feee80d3240 2024-09-19T09:18:26.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.572+0000 7feee7fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7feee80d5780 0x7feee80cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:26.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.573+0000 7feee7fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7feee80d5780 0x7feee80cf770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51276/0 (socket says 172.21.15.18:51276) 2024-09-19T09:18:26.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.573+0000 7feee7fff640 1 -- 172.21.15.18:0/424295371 learned_addr learned my addr 172.21.15.18:0/424295371 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:26.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.573+0000 7feee6ffd640 1 --2- 172.21.15.18:0/424295371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feee80d3240 0x7feee80d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:26.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.573+0000 7feee77fe640 1 --2- 172.21.15.18:0/424295371 >> v2:172.21.15.162:3300/0 conn(0x7feee815ef50 0x7feee80d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:26.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.573+0000 7feee7fff640 1 -- 172.21.15.18:0/424295371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feee80d3240 msgr2=0x7feee80d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:26.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.573+0000 7feee7fff640 1 --2- 172.21.15.18:0/424295371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feee80d3240 0x7feee80d18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:26.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.573+0000 7feee7fff640 1 -- 172.21.15.18:0/424295371 >> v2:172.21.15.162:3300/0 conn(0x7feee815ef50 msgr2=0x7feee80d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:26.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.573+0000 7feee7fff640 1 --2- 172.21.15.18:0/424295371 >> v2:172.21.15.162:3300/0 conn(0x7feee815ef50 0x7feee80d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:26.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.573+0000 7feee7fff640 1 -- 172.21.15.18:0/424295371 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee80b7d00 con 0x7feee80d5780 2024-09-19T09:18:26.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.574+0000 7feee7fff640 1 --2- 172.21.15.18:0/424295371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feee80d5780 0x7feee80cf770 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7feee80b7850 tx=0x7feee002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38f6a8a0afcd363 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:26.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.574+0000 7feee67fc640 1 -- 172.21.15.18:0/424295371 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee0036070 con 0x7feee80d5780 2024-09-19T09:18:26.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.574+0000 7feee67fc640 1 -- 172.21.15.18:0/424295371 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feee0031600 con 0x7feee80d5780 2024-09-19T09:18:26.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.574+0000 7feee67fc640 1 -- 172.21.15.18:0/424295371 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee00319d0 con 0x7feee80d5780 2024-09-19T09:18:26.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.574+0000 7feeee152640 1 -- 172.21.15.18:0/424295371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feee80d5780 msgr2=0x7feee80cf770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:26.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.574+0000 7feeee152640 1 --2- 172.21.15.18:0/424295371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feee80d5780 0x7feee80cf770 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7feee80b7850 tx=0x7feee002a610 comp rx=0 tx=0).stop 2024-09-19T09:18:26.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.574+0000 7feeee152640 1 -- 172.21.15.18:0/424295371 shutdown_connections 2024-09-19T09:18:26.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.574+0000 7feeee152640 1 --2- 172.21.15.18:0/424295371 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feee80d5780 0x7feee80cf770 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:26.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.574+0000 7feeee152640 1 --2- 172.21.15.18:0/424295371 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feee80d3240 0x7feee80d18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:26.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.574+0000 7feeee152640 1 --2- 172.21.15.18:0/424295371 >> v2:172.21.15.162:3300/0 conn(0x7feee815ef50 0x7feee80d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:26.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.574+0000 7feeee152640 1 -- 172.21.15.18:0/424295371 >> 172.21.15.18:0/424295371 conn(0x7feee80d4c60 msgr2=0x7feee80d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:26.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.574+0000 7feeee152640 1 -- 172.21.15.18:0/424295371 shutdown_connections 2024-09-19T09:18:26.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.574+0000 7feeee152640 1 -- 172.21.15.18:0/424295371 wait complete. 2024-09-19T09:18:26.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.576+0000 7feeee152640 1 Processor -- start 2024-09-19T09:18:26.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.576+0000 7feeee152640 1 -- start start 2024-09-19T09:18:26.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.577+0000 7feeee152640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feee80d3240 0x7feee81f81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:26.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.577+0000 7feeee152640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feee80d5780 0x7feee814c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:26.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.577+0000 7feeee152640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feee815ef50 0x7feee81f4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:26.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.577+0000 7feeee152640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feee80d21a0 con 0x7feee815ef50 2024-09-19T09:18:26.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.577+0000 7feeee152640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feee80d2020 con 0x7feee80d5780 2024-09-19T09:18:26.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.577+0000 7feeee152640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7feee80cfcb0 con 0x7feee80d3240 2024-09-19T09:18:26.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.577+0000 7feee7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feee815ef50 0x7feee81f4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:26.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.577+0000 7feee7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feee815ef50 0x7feee81f4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51284/0 (socket says 172.21.15.18:51284) 2024-09-19T09:18:26.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.577+0000 7feee7fff640 1 -- 172.21.15.18:0/2145562761 learned_addr learned my addr 172.21.15.18:0/2145562761 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:26.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.577+0000 7feee77fe640 1 --2- 172.21.15.18:0/2145562761 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feee80d3240 0x7feee81f81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:26.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.577+0000 7feee6ffd640 1 --2- 172.21.15.18:0/2145562761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feee80d5780 0x7feee814c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:26.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.577+0000 7feee7fff640 1 -- 172.21.15.18:0/2145562761 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feee80d3240 msgr2=0x7feee81f81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:26.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.577+0000 7feee7fff640 1 --2- 172.21.15.18:0/2145562761 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feee80d3240 0x7feee81f81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:26.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.577+0000 7feee7fff640 1 -- 172.21.15.18:0/2145562761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feee80d5780 msgr2=0x7feee814c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:26.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.577+0000 7feee7fff640 1 --2- 172.21.15.18:0/2145562761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feee80d5780 0x7feee814c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:26.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.577+0000 7feee7fff640 1 -- 172.21.15.18:0/2145562761 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee81f88b0 con 0x7feee815ef50 2024-09-19T09:18:26.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.577+0000 7feee7fff640 1 --2- 172.21.15.18:0/2145562761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feee815ef50 0x7feee81f4340 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7feee0034040 tx=0x7feee0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:26.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.577+0000 7feecffff640 1 -- 172.21.15.18:0/2145562761 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee0036050 con 0x7feee815ef50 2024-09-19T09:18:26.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.578+0000 7feecffff640 1 -- 172.21.15.18:0/2145562761 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feee0042070 con 0x7feee815ef50 2024-09-19T09:18:26.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.578+0000 7feeee152640 1 -- 172.21.15.18:0/2145562761 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee81f8b90 con 0x7feee815ef50 2024-09-19T09:18:26.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.578+0000 7feecffff640 1 -- 172.21.15.18:0/2145562761 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee0009510 con 0x7feee815ef50 2024-09-19T09:18:26.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.578+0000 7feeee152640 1 -- 172.21.15.18:0/2145562761 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee80ca1b0 con 0x7feee815ef50 2024-09-19T09:18:26.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.579+0000 7feeee152640 1 -- 172.21.15.18:0/2145562761 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feee81f90b0 con 0x7feee815ef50 2024-09-19T09:18:26.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.579+0000 7feecffff640 1 -- 172.21.15.18:0/2145562761 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7feee0007bf0 con 0x7feee815ef50 2024-09-19T09:18:26.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.579+0000 7feecffff640 1 --2- 172.21.15.18:0/2145562761 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7feed406c2e0 0x7feed406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:26.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.580+0000 7feecffff640 1 -- 172.21.15.18:0/2145562761 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7feee00ac000 con 0x7feee815ef50 2024-09-19T09:18:26.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.580+0000 7feee77fe640 1 --2- 172.21.15.18:0/2145562761 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7feed406c2e0 0x7feed406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:26.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.580+0000 7feee77fe640 1 --2- 172.21.15.18:0/2145562761 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7feed406c2e0 0x7feed406e7a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7feed8009aa0 tx=0x7feed8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:26.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.584+0000 7feecffff640 1 -- 172.21.15.18:0/2145562761 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7feee81f90b0 con 0x7feee815ef50 2024-09-19T09:18:26.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.795+0000 7feeee152640 1 -- 172.21.15.18:0/2145562761 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feee80cf770 con 0x7feee815ef50 2024-09-19T09:18:26.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.796+0000 7feecffff640 1 -- 172.21.15.18:0/2145562761 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5225 (secure 0 0 0) 0x7feee007a240 con 0x7feee815ef50 2024-09-19T09:18:26.797 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:26.797 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":42,"btime":"2024-09-19T09:18:26:440614+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5944,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/935732637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":935732637},{"type":"v1","addr":"172.21.15.162:6836","nonce":935732637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6192,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3186899169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":3186899169},{"type":"v1","addr":"172.21.15.18:6835","nonce":3186899169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6195,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/3889971648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3889971648},{"type":"v1","addr":"172.21.15.18:6834","nonce":3889971648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:18:23.782156+0000","modified":"2024-09-19T09:18:25.789778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"d","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6837/133611430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":133611430},{"type":"v1","addr":"172.21.15.162:6837","nonce":133611430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6207,"qdb_cluster":[6207]},"id":6}]} 2024-09-19T09:18:26.797 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 42 2024-09-19T09:18:26.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.798+0000 7feeee152640 1 -- 172.21.15.18:0/2145562761 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7feed406c2e0 msgr2=0x7feed406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:26.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.798+0000 7feeee152640 1 --2- 172.21.15.18:0/2145562761 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7feed406c2e0 0x7feed406e7a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7feed8009aa0 tx=0x7feed8009190 comp rx=0 tx=0).stop 2024-09-19T09:18:26.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.798+0000 7feeee152640 1 -- 172.21.15.18:0/2145562761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feee815ef50 msgr2=0x7feee81f4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:26.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.798+0000 7feeee152640 1 --2- 172.21.15.18:0/2145562761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feee815ef50 0x7feee81f4340 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7feee0034040 tx=0x7feee0004a40 comp rx=0 tx=0).stop 2024-09-19T09:18:26.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.798+0000 7feeee152640 1 -- 172.21.15.18:0/2145562761 shutdown_connections 2024-09-19T09:18:26.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.798+0000 7feeee152640 1 --2- 172.21.15.18:0/2145562761 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7feed406c2e0 0x7feed406e7a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:26.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.798+0000 7feeee152640 1 --2- 172.21.15.18:0/2145562761 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feee815ef50 0x7feee81f4340 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:26.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.798+0000 7feeee152640 1 --2- 172.21.15.18:0/2145562761 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feee80d5780 0x7feee814c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:26.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.798+0000 7feeee152640 1 --2- 172.21.15.18:0/2145562761 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feee80d3240 0x7feee81f81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:26.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.798+0000 7feeee152640 1 -- 172.21.15.18:0/2145562761 >> 172.21.15.18:0/2145562761 conn(0x7feee80d4c60 msgr2=0x7feee80cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:26.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.798+0000 7feeee152640 1 -- 172.21.15.18:0/2145562761 shutdown_connections 2024-09-19T09:18:26.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.798+0000 7feeee152640 1 -- 172.21.15.18:0/2145562761 wait complete. 2024-09-19T09:18:26.810 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:18:26.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.911+0000 7f7cf9f0c640 1 Processor -- start 2024-09-19T09:18:26.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.911+0000 7f7cf9f0c640 1 -- start start 2024-09-19T09:18:26.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.912+0000 7f7cf9f0c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cf4072f40 0x7f7cf406f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:26.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.912+0000 7f7cf9f0c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7cf40ce780 0x7f7cf40b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.912+0000 7f7cf9f0c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf406e3d0 con 0x7f7cf4145290 2024-09-19T09:18:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.912+0000 7f7cf9f0c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f7cf406efe0 con 0x7f7cf40ce780 2024-09-19T09:18:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.912+0000 7f7cf9f0c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf406e6b0 con 0x7f7cf4072f40 2024-09-19T09:18:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.912+0000 7f7cf37fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f7cf4145290 0x7f7cf4072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33362/0 (socket says 172.21.15.18:33362) 2024-09-19T09:18:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.912+0000 7f7cf37fe640 1 -- 172.21.15.18:0/1947855428 learned_addr learned my addr 172.21.15.18:0/1947855428 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.912+0000 7f7cf2ffd640 1 --2- 172.21.15.18:0/1947855428 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cf4072f40 0x7f7cf406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.912+0000 7f7cf3fff640 1 --2- 172.21.15.18:0/1947855428 >> v2:172.21.15.162:3300/0 conn(0x7f7cf40ce780 0x7f7cf40b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.912+0000 7f7cf27fc640 1 -- 172.21.15.18:0/1947855428 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3855026847 0 0) 0x7f7cf406e3d0 con 0x7f7cf4145290 2024-09-19T09:18:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.912+0000 7f7cf27fc640 1 -- 172.21.15.18:0/1947855428 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cdc003520 con 0x7f7cf4145290 2024-09-19T09:18:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.913+0000 7f7cf27fc640 1 -- 172.21.15.18:0/1947855428 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 290280651 0 0) 0x7f7cdc003520 con 0x7f7cf4145290 2024-09-19T09:18:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.913+0000 7f7cf3fff640 1 -- 172.21.15.18:0/1947855428 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cf4072f40 msgr2=0x7f7cf406f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.913+0000 7f7cf3fff640 1 --2- 172.21.15.18:0/1947855428 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cf4072f40 0x7f7cf406f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:26.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.913+0000 7f7cf3fff640 1 -- 172.21.15.18:0/1947855428 >> v1:172.21.15.18:6789/0 conn(0x7f7cf4145290 legacy=0x7f7cf4072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:26.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.913+0000 7f7cf3fff640 1 -- 172.21.15.18:0/1947855428 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf406e990 con 0x7f7cf40ce780 2024-09-19T09:18:26.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.914+0000 7f7cf3fff640 1 --2- 172.21.15.18:0/1947855428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cf40ce780 0x7f7cf40b3930 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7cec009d90 tx=0x7f7cec02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f650e1ee9702293c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:26.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.914+0000 7f7cf27fc640 1 -- 172.21.15.18:0/1947855428 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4001670 con 0x7f7cf40ce780 2024-09-19T09:18:26.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.914+0000 7f7cf27fc640 1 -- 172.21.15.18:0/1947855428 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cec007540 con 0x7f7cf40ce780 2024-09-19T09:18:26.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.914+0000 7f7cf27fc640 1 -- 172.21.15.18:0/1947855428 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cec0078f0 con 0x7f7cf40ce780 2024-09-19T09:18:26.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.914+0000 7f7cf9f0c640 1 -- 172.21.15.18:0/1947855428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cf40ce780 msgr2=0x7f7cf40b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:26.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.914+0000 7f7cf9f0c640 1 --2- 172.21.15.18:0/1947855428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cf40ce780 0x7f7cf40b3930 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7cec009d90 tx=0x7f7cec02a5f0 comp rx=0 tx=0).stop 2024-09-19T09:18:26.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.914+0000 7f7cf9f0c640 1 -- 172.21.15.18:0/1947855428 shutdown_connections 2024-09-19T09:18:26.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.914+0000 7f7cf9f0c640 1 --2- 172.21.15.18:0/1947855428 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cf40ce780 0x7f7cf40b3930 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:26.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.914+0000 7f7cf9f0c640 1 --2- 172.21.15.18:0/1947855428 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cf4072f40 0x7f7cf406f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:26.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.914+0000 7f7cf9f0c640 1 -- 172.21.15.18:0/1947855428 >> 172.21.15.18:0/1947855428 conn(0x7f7cf406bc10 msgr2=0x7f7cf406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:26.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.914+0000 7f7cf9f0c640 1 -- 172.21.15.18:0/1947855428 shutdown_connections 2024-09-19T09:18:26.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.914+0000 7f7cf9f0c640 1 -- 172.21.15.18:0/1947855428 wait complete. 2024-09-19T09:18:26.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.916+0000 7f7cf9f0c640 1 Processor -- start 2024-09-19T09:18:26.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.916+0000 7f7cf9f0c640 1 -- start start 2024-09-19T09:18:26.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.916+0000 7f7cf9f0c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7cf4072f40 0x7f7cf4142ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:26.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.916+0000 7f7cf9f0c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cf40ce780 0x7f7cf41416e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:26.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.916+0000 7f7cf9f0c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cf4145290 0x7f7cf4141c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:26.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.916+0000 7f7cf9f0c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf406df80 con 0x7f7cf4072f40 2024-09-19T09:18:26.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.916+0000 7f7cf9f0c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf4145670 con 0x7f7cf4145290 2024-09-19T09:18:26.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.916+0000 7f7cf9f0c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf406e100 con 0x7f7cf40ce780 2024-09-19T09:18:26.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.917+0000 7f7cf37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7cf4072f40 0x7f7cf4142ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:26.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.917+0000 7f7cf37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7cf4072f40 0x7f7cf4142ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51288/0 (socket says 172.21.15.18:51288) 2024-09-19T09:18:26.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.917+0000 7f7cf37fe640 1 -- 172.21.15.18:0/2043600863 learned_addr learned my addr 172.21.15.18:0/2043600863 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:26.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.917+0000 7f7cf3fff640 1 --2- 172.21.15.18:0/2043600863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cf4145290 0x7f7cf4141c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:26.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.917+0000 7f7cf2ffd640 1 --2- 172.21.15.18:0/2043600863 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cf40ce780 0x7f7cf41416e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:26.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.917+0000 7f7cf37fe640 1 -- 172.21.15.18:0/2043600863 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cf40ce780 msgr2=0x7f7cf41416e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:26.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.917+0000 7f7cf37fe640 1 --2- 172.21.15.18:0/2043600863 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cf40ce780 0x7f7cf41416e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:26.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.917+0000 7f7cf37fe640 1 -- 172.21.15.18:0/2043600863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cf4145290 msgr2=0x7f7cf4141c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:26.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.917+0000 7f7cf37fe640 1 --2- 172.21.15.18:0/2043600863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cf4145290 0x7f7cf4141c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:26.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.917+0000 7f7cf37fe640 1 -- 172.21.15.18:0/2043600863 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf4143370 con 0x7f7cf4072f40 2024-09-19T09:18:26.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.917+0000 7f7cf2ffd640 1 --2- 172.21.15.18:0/2043600863 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cf40ce780 0x7f7cf41416e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:26.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.917+0000 7f7cf37fe640 1 --2- 172.21.15.18:0/2043600863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7cf4072f40 0x7f7cf4142ab0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f7ce400c780 tx=0x7f7ce400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:26.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.917+0000 7f7cdbfff640 1 -- 172.21.15.18:0/2043600863 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4017070 con 0x7f7cf4072f40 2024-09-19T09:18:26.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.917+0000 7f7cdbfff640 1 -- 172.21.15.18:0/2043600863 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ce4005ad0 con 0x7f7cf4072f40 2024-09-19T09:18:26.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.917+0000 7f7cf9f0c640 1 -- 172.21.15.18:0/2043600863 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf4143650 con 0x7f7cf4072f40 2024-09-19T09:18:26.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.917+0000 7f7cdbfff640 1 -- 172.21.15.18:0/2043600863 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4007070 con 0x7f7cf4072f40 2024-09-19T09:18:26.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.917+0000 7f7cf9f0c640 1 -- 172.21.15.18:0/2043600863 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf4143c10 con 0x7f7cf4072f40 2024-09-19T09:18:26.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.918+0000 7f7cf9f0c640 1 -- 172.21.15.18:0/2043600863 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cf4071510 con 0x7f7cf4072f40 2024-09-19T09:18:26.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.919+0000 7f7cdbfff640 1 -- 172.21.15.18:0/2043600863 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7ce401a070 con 0x7f7cf4072f40 2024-09-19T09:18:26.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.919+0000 7f7cdbfff640 1 --2- 172.21.15.18:0/2043600863 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7ce006c2b0 0x7f7ce006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:26.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.919+0000 7f7cdbfff640 1 -- 172.21.15.18:0/2043600863 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f7ce408a9c0 con 0x7f7cf4072f40 2024-09-19T09:18:26.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.919+0000 7f7cf2ffd640 1 --2- 172.21.15.18:0/2043600863 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7ce006c2b0 0x7f7ce006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:26.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.920+0000 7f7cf2ffd640 1 --2- 172.21.15.18:0/2043600863 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7ce006c2b0 0x7f7ce006e770 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7cf413e760 tx=0x7f7ce8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:26.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:26.924+0000 7f7cdbfff640 1 -- 172.21.15.18:0/2043600863 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7ce408ce20 con 0x7f7cf4072f40 2024-09-19T09:18:27.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.101+0000 7f7cf9f0c640 1 -- 172.21.15.18:0/2043600863 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7cf4072bb0 con 0x7f7cf4072f40 2024-09-19T09:18:27.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.102+0000 7f7cdbfff640 1 -- 172.21.15.18:0/2043600863 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v104) ==== 74+0+16755 (secure 0 0 0) 0x7f7ce4059130 con 0x7f7cf4072f40 2024-09-19T09:18:27.103 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:27.103 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":104,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:18:25.435341+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"96","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:18:21.441414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-19T09:18:22.767737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"104","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:18:27.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.104+0000 7f7cf9f0c640 1 -- 172.21.15.18:0/2043600863 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7ce006c2b0 msgr2=0x7f7ce006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:27.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.104+0000 7f7cf9f0c640 1 --2- 172.21.15.18:0/2043600863 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7ce006c2b0 0x7f7ce006e770 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7cf413e760 tx=0x7f7ce8008040 comp rx=0 tx=0).stop 2024-09-19T09:18:27.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.104+0000 7f7cf9f0c640 1 -- 172.21.15.18:0/2043600863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7cf4072f40 msgr2=0x7f7cf4142ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:27.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.104+0000 7f7cf9f0c640 1 --2- 172.21.15.18:0/2043600863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7cf4072f40 0x7f7cf4142ab0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f7ce400c780 tx=0x7f7ce400cc40 comp rx=0 tx=0).stop 2024-09-19T09:18:27.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.104+0000 7f7cf9f0c640 1 -- 172.21.15.18:0/2043600863 shutdown_connections 2024-09-19T09:18:27.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.104+0000 7f7cf9f0c640 1 --2- 172.21.15.18:0/2043600863 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7ce006c2b0 0x7f7ce006e770 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.104+0000 7f7cf9f0c640 1 --2- 172.21.15.18:0/2043600863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7cf4145290 0x7f7cf4141c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.104+0000 7f7cf9f0c640 1 --2- 172.21.15.18:0/2043600863 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7cf40ce780 0x7f7cf41416e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.104+0000 7f7cf9f0c640 1 --2- 172.21.15.18:0/2043600863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7cf4072f40 0x7f7cf4142ab0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.104+0000 7f7cf9f0c640 1 -- 172.21.15.18:0/2043600863 >> 172.21.15.18:0/2043600863 conn(0x7f7cf406bc10 msgr2=0x7f7cf4140180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:27.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.105+0000 7f7cf9f0c640 1 -- 172.21.15.18:0/2043600863 shutdown_connections 2024-09-19T09:18:27.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.105+0000 7f7cf9f0c640 1 -- 172.21.15.18:0/2043600863 wait complete. 2024-09-19T09:18:27.116 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T09:18:27.117 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:18:27.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.218+0000 7f8a439c4640 1 Processor -- start 2024-09-19T09:18:27.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.218+0000 7f8a439c4640 1 -- start start 2024-09-19T09:18:27.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.219+0000 7f8a439c4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a3c15ef80 0x7f8a3c0b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:27.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.219+0000 7f8a439c4640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a3c0cd1a0 con 0x7f8a3c06d730 2024-09-19T09:18:27.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.219+0000 7f8a439c4640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a3c06dc30 con 0x7f8a3c0cfae0 2024-09-19T09:18:27.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.219+0000 7f8a439c4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8a3c0cd7d0 con 0x7f8a3c15ef80 2024-09-19T09:18:27.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.219+0000 7f8a40f5f640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f8a3c06d730 0x7f8a3c0cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33372/0 (socket says 172.21.15.18:33372) 2024-09-19T09:18:27.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.219+0000 7f8a40f5f640 1 -- 172.21.15.18:0/2471673584 learned_addr learned my addr 172.21.15.18:0/2471673584 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:27.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.219+0000 7f8a41760640 1 --2- 172.21.15.18:0/2471673584 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a3c15ef80 0x7f8a3c0b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:27.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.219+0000 7f8a33fff640 1 -- 172.21.15.18:0/2471673584 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 794918460 0 0) 0x7f8a3c0cd1a0 con 0x7f8a3c06d730 2024-09-19T09:18:27.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.219+0000 7f8a33fff640 1 -- 172.21.15.18:0/2471673584 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a28003520 con 0x7f8a3c06d730 2024-09-19T09:18:27.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.220+0000 7f8a33fff640 1 -- 172.21.15.18:0/2471673584 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3901250889 0 0) 0x7f8a28003520 con 0x7f8a3c06d730 2024-09-19T09:18:27.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.220+0000 7f8a33fff640 1 -- 172.21.15.18:0/2471673584 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a3c15ef80 msgr2=0x7f8a3c0b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:27.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.220+0000 7f8a33fff640 1 --2- 172.21.15.18:0/2471673584 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a3c15ef80 0x7f8a3c0b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.220+0000 7f8a33fff640 1 -- 172.21.15.18:0/2471673584 >> v1:172.21.15.162:6789/0 conn(0x7f8a3c0cfae0 legacy=0x7f8a3c0cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:27.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.220+0000 7f8a33fff640 1 -- 172.21.15.18:0/2471673584 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a3c06df10 con 0x7f8a3c06d730 2024-09-19T09:18:27.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.220+0000 7f8a33fff640 1 -- 172.21.15.18:0/2471673584 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f8a2c001670 con 0x7f8a3c06d730 2024-09-19T09:18:27.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.220+0000 7f8a33fff640 1 -- 172.21.15.18:0/2471673584 >> v1:172.21.15.18:6789/0 conn(0x7f8a3c06d730 legacy=0x7f8a3c0cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:27.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.220+0000 7f8a33fff640 1 --2- 172.21.15.18:0/2471673584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a280039e0 0x7f8a28003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:27.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.220+0000 7f8a33fff640 1 --2- 172.21.15.18:0/2471673584 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a3c15ef80 0x7f8a28004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:27.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.220+0000 7f8a33fff640 1 --2- 172.21.15.18:0/2471673584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a28004d40 0x7f8a280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:27.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.220+0000 7f8a33fff640 1 -- 172.21.15.18:0/2471673584 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3c0cd7d0 con 0x7f8a280039e0 2024-09-19T09:18:27.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.220+0000 7f8a33fff640 1 -- 172.21.15.18:0/2471673584 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8a2800b9c0 con 0x7f8a28004d40 2024-09-19T09:18:27.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.220+0000 7f8a33fff640 1 -- 172.21.15.18:0/2471673584 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8a2800bbc0 con 0x7f8a3c15ef80 2024-09-19T09:18:27.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.220+0000 7f8a41760640 1 --2- 172.21.15.18:0/2471673584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a280039e0 0x7f8a28003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:27.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.220+0000 7f8a40f5f640 1 --2- 172.21.15.18:0/2471673584 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a3c15ef80 0x7f8a28004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:27.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.220+0000 7f8a41f61640 1 --2- 172.21.15.18:0/2471673584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a28004d40 0x7f8a280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:27.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.220+0000 7f8a41760640 1 -- 172.21.15.18:0/2471673584 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a3c15ef80 msgr2=0x7f8a28004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:27.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.220+0000 7f8a41760640 1 --2- 172.21.15.18:0/2471673584 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a3c15ef80 0x7f8a28004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.220+0000 7f8a41760640 1 -- 172.21.15.18:0/2471673584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a28004d40 msgr2=0x7f8a280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:27.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.220+0000 7f8a41760640 1 --2- 172.21.15.18:0/2471673584 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a28004d40 0x7f8a280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.220+0000 7f8a41760640 1 -- 172.21.15.18:0/2471673584 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a28003520 con 0x7f8a280039e0 2024-09-19T09:18:27.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.221+0000 7f8a41760640 1 --2- 172.21.15.18:0/2471673584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a280039e0 0x7f8a28003dc0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f8a38009ac0 tx=0x7f8a28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba4e19da51d114f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:27.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.221+0000 7f8a33fff640 1 -- 172.21.15.18:0/2471673584 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a38036070 con 0x7f8a280039e0 2024-09-19T09:18:27.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.221+0000 7f8a33fff640 1 -- 172.21.15.18:0/2471673584 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a38031400 con 0x7f8a280039e0 2024-09-19T09:18:27.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.221+0000 7f8a33fff640 1 -- 172.21.15.18:0/2471673584 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a38009690 con 0x7f8a280039e0 2024-09-19T09:18:27.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.221+0000 7f8a439c4640 1 -- 172.21.15.18:0/2471673584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a280039e0 msgr2=0x7f8a28003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:27.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.221+0000 7f8a439c4640 1 --2- 172.21.15.18:0/2471673584 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a280039e0 0x7f8a28003dc0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f8a38009ac0 tx=0x7f8a28005830 comp rx=0 tx=0).stop 2024-09-19T09:18:27.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.221+0000 7f8a41f61640 1 -- 172.21.15.18:0/2471673584 reap_dead start 2024-09-19T09:18:27.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.221+0000 7f8a439c4640 1 -- 172.21.15.18:0/2471673584 shutdown_connections 2024-09-19T09:18:27.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.221+0000 7f8a439c4640 1 -- 172.21.15.18:0/2471673584 >> 172.21.15.18:0/2471673584 conn(0x7f8a3c0b4700 msgr2=0x7f8a3c0b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:27.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.221+0000 7f8a439c4640 1 -- 172.21.15.18:0/2471673584 shutdown_connections 2024-09-19T09:18:27.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.221+0000 7f8a439c4640 1 -- 172.21.15.18:0/2471673584 wait complete. 2024-09-19T09:18:27.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.223+0000 7f8a439c4640 1 Processor -- start 2024-09-19T09:18:27.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.223+0000 7f8a439c4640 1 -- start start 2024-09-19T09:18:27.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.223+0000 7f8a439c4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a280039e0 0x7f8a3c0ca630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:27.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.223+0000 7f8a439c4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a3c1f8240 0x7f8a3c1f86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:27.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.223+0000 7f8a439c4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a3c14e6c0 0x7f8a3c14eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:27.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.223+0000 7f8a439c4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3c0d0120 con 0x7f8a3c1f8240 2024-09-19T09:18:27.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.223+0000 7f8a439c4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3c15f360 con 0x7f8a3c14e6c0 2024-09-19T09:18:27.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.223+0000 7f8a439c4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8a3c0b5220 con 0x7f8a280039e0 2024-09-19T09:18:27.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.224+0000 7f8a40f5f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a3c1f8240 0x7f8a3c1f86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:27.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.224+0000 7f8a40f5f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a3c1f8240 0x7f8a3c1f86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51316/0 (socket says 172.21.15.18:51316) 2024-09-19T09:18:27.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.224+0000 7f8a40f5f640 1 -- 172.21.15.18:0/3242776056 learned_addr learned my addr 172.21.15.18:0/3242776056 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:27.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.224+0000 7f8a41760640 1 --2- 172.21.15.18:0/3242776056 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a280039e0 0x7f8a3c0ca630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:27.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.224+0000 7f8a41f61640 1 --2- 172.21.15.18:0/3242776056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a3c14e6c0 0x7f8a3c14eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:27.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.224+0000 7f8a40f5f640 1 -- 172.21.15.18:0/3242776056 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a280039e0 msgr2=0x7f8a3c0ca630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:27.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.224+0000 7f8a40f5f640 1 --2- 172.21.15.18:0/3242776056 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a280039e0 0x7f8a3c0ca630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.224+0000 7f8a40f5f640 1 -- 172.21.15.18:0/3242776056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a3c14e6c0 msgr2=0x7f8a3c14eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:27.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.224+0000 7f8a40f5f640 1 --2- 172.21.15.18:0/3242776056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a3c14e6c0 0x7f8a3c14eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.224+0000 7f8a40f5f640 1 -- 172.21.15.18:0/3242776056 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a3c0cac10 con 0x7f8a3c1f8240 2024-09-19T09:18:27.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.224+0000 7f8a40f5f640 1 --2- 172.21.15.18:0/3242776056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a3c1f8240 0x7f8a3c1f86c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c001d10 tx=0x7f8a2c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:27.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.224+0000 7f8a31ffb640 1 -- 172.21.15.18:0/3242776056 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c00c870 con 0x7f8a3c1f8240 2024-09-19T09:18:27.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.224+0000 7f8a31ffb640 1 -- 172.21.15.18:0/3242776056 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a2c018070 con 0x7f8a3c1f8240 2024-09-19T09:18:27.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.224+0000 7f8a31ffb640 1 -- 172.21.15.18:0/3242776056 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c00cc70 con 0x7f8a3c1f8240 2024-09-19T09:18:27.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.224+0000 7f8a439c4640 1 -- 172.21.15.18:0/3242776056 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a3c0caef0 con 0x7f8a3c1f8240 2024-09-19T09:18:27.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.224+0000 7f8a439c4640 1 -- 172.21.15.18:0/3242776056 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a3c0cb4b0 con 0x7f8a3c1f8240 2024-09-19T09:18:27.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.225+0000 7f8a439c4640 1 -- 172.21.15.18:0/3242776056 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a3c06dc30 con 0x7f8a3c1f8240 2024-09-19T09:18:27.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.226+0000 7f8a31ffb640 1 -- 172.21.15.18:0/3242776056 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8a2c01d460 con 0x7f8a3c1f8240 2024-09-19T09:18:27.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.226+0000 7f8a31ffb640 1 --2- 172.21.15.18:0/3242776056 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8a2006c2e0 0x7f8a2006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:27.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.226+0000 7f8a31ffb640 1 -- 172.21.15.18:0/3242776056 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f8a2c08b150 con 0x7f8a3c1f8240 2024-09-19T09:18:27.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.227+0000 7f8a41760640 1 --2- 172.21.15.18:0/3242776056 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8a2006c2e0 0x7f8a2006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:27.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.227+0000 7f8a41760640 1 --2- 172.21.15.18:0/3242776056 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8a2006c2e0 0x7f8a2006e7a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8a38033000 tx=0x7f8a38008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:27.231 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.231+0000 7f8a31ffb640 1 -- 172.21.15.18:0/3242776056 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8a2c059260 con 0x7f8a3c1f8240 2024-09-19T09:18:27.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.404+0000 7f8a439c4640 1 -- 172.21.15.18:0/3242776056 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8a3c0cff00 con 0x7f8a2006c2e0 2024-09-19T09:18:27.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.410+0000 7f8a31ffb640 1 -- 172.21.15.18:0/3242776056 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+236387 (secure 0 0 0) 0x7f8a3c0cff00 con 0x7f8a2006c2e0 2024-09-19T09:18:27.414 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:27.415 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:18:27.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.414+0000 7f8a439c4640 1 -- 172.21.15.18:0/3242776056 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8a2006c2e0 msgr2=0x7f8a2006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:27.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.414+0000 7f8a439c4640 1 --2- 172.21.15.18:0/3242776056 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8a2006c2e0 0x7f8a2006e7a0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8a38033000 tx=0x7f8a38008030 comp rx=0 tx=0).stop 2024-09-19T09:18:27.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.414+0000 7f8a439c4640 1 -- 172.21.15.18:0/3242776056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a3c1f8240 msgr2=0x7f8a3c1f86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:27.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.414+0000 7f8a439c4640 1 --2- 172.21.15.18:0/3242776056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a3c1f8240 0x7f8a3c1f86c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c001d10 tx=0x7f8a2c00ec80 comp rx=0 tx=0).stop 2024-09-19T09:18:27.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.414+0000 7f8a439c4640 1 -- 172.21.15.18:0/3242776056 shutdown_connections 2024-09-19T09:18:27.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.414+0000 7f8a439c4640 1 --2- 172.21.15.18:0/3242776056 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8a2006c2e0 0x7f8a2006e7a0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.414+0000 7f8a439c4640 1 --2- 172.21.15.18:0/3242776056 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a3c14e6c0 0x7f8a3c14eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.414+0000 7f8a439c4640 1 --2- 172.21.15.18:0/3242776056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a3c1f8240 0x7f8a3c1f86c0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.414+0000 7f8a439c4640 1 --2- 172.21.15.18:0/3242776056 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a280039e0 0x7f8a3c0ca630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.414+0000 7f8a439c4640 1 -- 172.21.15.18:0/3242776056 >> 172.21.15.18:0/3242776056 conn(0x7f8a3c0b4700 msgr2=0x7f8a3c0d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:27.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.414+0000 7f8a439c4640 1 -- 172.21.15.18:0/3242776056 shutdown_connections 2024-09-19T09:18:27.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.414+0000 7f8a439c4640 1 -- 172.21.15.18:0/3242776056 wait complete. 2024-09-19T09:18:27.426 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":250,"stamp":"2024-09-19T09:18:25.596411+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5333,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557166,"statfs":{"total":1600000000,"available":1594538642,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000967"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:23.414897+0000","last_change":"2024-09-19T09:18:23.414897+0000","last_active":"2024-09-19T09:18:23.414897+0000","last_peered":"2024-09-19T09:18:23.414897+0000","last_clean":"2024-09-19T09:18:23.414897+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:23.414897+0000","last_undegraded":"2024-09-19T09:18:23.414897+0000","last_fullsized":"2024-09-19T09:18:23.414897+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-19T09:18:22.410216+0000","last_change":"2024-09-19T09:18:22.410216+0000","last_active":"2024-09-19T09:18:22.410216+0000","last_peered":"2024-09-19T09:18:22.410216+0000","last_clean":"2024-09-19T09:18:22.410216+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-19T09:18:22.410216+0000","last_undegraded":"2024-09-19T09:18:22.410216+0000","last_fullsized":"2024-09-19T09:18:22.410216+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":327,"reported_epoch":100,"state":"active+clean","last_fresh":"2024-09-19T09:18:20.815812+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:18:20.815812+0000","last_peered":"2024-09-19T09:18:20.815812+0000","last_clean":"2024-09-19T09:18:20.815812+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:18:20.815812+0000","last_undegraded":"2024-09-19T09:18:20.815812+0000","last_fullsized":"2024-09-19T09:18:20.815812+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:59:34.496396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":527,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194784,"statfs":{"total":200000000,"available":199459837,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":527,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194784,"statfs":{"total":200000000,"available":199459837,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574911,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1099,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194213,"statfs":{"total":200000000,"available":198874526,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":507,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194804,"statfs":{"total":200000000,"available":199480221,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":527,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194784,"statfs":{"total":200000000,"available":199459837,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":527,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194784,"statfs":{"total":200000000,"available":199459837,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1104,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194208,"statfs":{"total":200000000,"available":198869469,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":512,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194799,"statfs":{"total":200000000,"available":199475078,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:18:27.430 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:18:27.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.569+0000 7fb86c50a640 1 Processor -- start 2024-09-19T09:18:27.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.569+0000 7fb86c50a640 1 -- start start 2024-09-19T09:18:27.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.570+0000 7fb86c50a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb86415ed30 0x7fb864070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:27.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.570+0000 7fb86c50a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8640b5200 0x7fb8641629e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:27.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.570+0000 7fb86c50a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb864162f20 0x7fb8640cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:27.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.570+0000 7fb86c50a640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fb8640d0a10 con 0x7fb86415ed30 2024-09-19T09:18:27.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.570+0000 7fb86c50a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb864070ab0 con 0x7fb864162f20 2024-09-19T09:18:27.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.570+0000 7fb86c50a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb8640d0cb0 con 0x7fb8640b5200 2024-09-19T09:18:27.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.570+0000 7fb86a2a6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb86415ed30 0x7fb864070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:27.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.570+0000 7fb86a2a6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb86415ed30 0x7fb864070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51332/0 (socket says 172.21.15.18:51332) 2024-09-19T09:18:27.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.570+0000 7fb86a2a6640 1 -- 172.21.15.18:0/3037386056 learned_addr learned my addr 172.21.15.18:0/3037386056 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:27.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.570+0000 7fb86a2a6640 1 -- 172.21.15.18:0/3037386056 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8640b5200 msgr2=0x7fb8641629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:27.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.570+0000 7fb869aa5640 1 --2- 172.21.15.18:0/3037386056 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8640b5200 0x7fb8641629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:27.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.570+0000 7fb86a2a6640 1 --2- 172.21.15.18:0/3037386056 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8640b5200 0x7fb8641629e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.570+0000 7fb86a2a6640 1 -- 172.21.15.18:0/3037386056 >> v2:172.21.15.162:3300/0 conn(0x7fb864162f20 msgr2=0x7fb8640cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:27.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.570+0000 7fb86a2a6640 1 --2- 172.21.15.18:0/3037386056 >> v2:172.21.15.162:3300/0 conn(0x7fb864162f20 0x7fb8640cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.570+0000 7fb86a2a6640 1 -- 172.21.15.18:0/3037386056 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8640d0f90 con 0x7fb86415ed30 2024-09-19T09:18:27.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.571+0000 7fb86a2a6640 1 --2- 172.21.15.18:0/3037386056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb86415ed30 0x7fb864070260 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb864073060 tx=0x7fb86002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dccc515a60bfd0d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:27.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.571+0000 7fb8692a4640 1 -- 172.21.15.18:0/3037386056 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb860037070 con 0x7fb86415ed30 2024-09-19T09:18:27.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.571+0000 7fb8692a4640 1 -- 172.21.15.18:0/3037386056 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb860032440 con 0x7fb86415ed30 2024-09-19T09:18:27.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.571+0000 7fb8692a4640 1 -- 172.21.15.18:0/3037386056 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb860032810 con 0x7fb86415ed30 2024-09-19T09:18:27.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.572+0000 7fb86c50a640 1 -- 172.21.15.18:0/3037386056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb86415ed30 msgr2=0x7fb864070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:27.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.572+0000 7fb86c50a640 1 --2- 172.21.15.18:0/3037386056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb86415ed30 0x7fb864070260 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb864073060 tx=0x7fb86002a270 comp rx=0 tx=0).stop 2024-09-19T09:18:27.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.572+0000 7fb86c50a640 1 -- 172.21.15.18:0/3037386056 shutdown_connections 2024-09-19T09:18:27.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.572+0000 7fb86c50a640 1 --2- 172.21.15.18:0/3037386056 >> v2:172.21.15.162:3300/0 conn(0x7fb864162f20 0x7fb8640cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.572+0000 7fb86c50a640 1 --2- 172.21.15.18:0/3037386056 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb8640b5200 0x7fb8641629e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.572+0000 7fb86c50a640 1 --2- 172.21.15.18:0/3037386056 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb86415ed30 0x7fb864070260 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.572+0000 7fb86c50a640 1 -- 172.21.15.18:0/3037386056 >> 172.21.15.18:0/3037386056 conn(0x7fb8640b4600 msgr2=0x7fb8640b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:27.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.572+0000 7fb86c50a640 1 -- 172.21.15.18:0/3037386056 shutdown_connections 2024-09-19T09:18:27.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.572+0000 7fb86c50a640 1 -- 172.21.15.18:0/3037386056 wait complete. 2024-09-19T09:18:27.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.573+0000 7fb86c50a640 1 Processor -- start 2024-09-19T09:18:27.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.573+0000 7fb86c50a640 1 -- start start 2024-09-19T09:18:27.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.574+0000 7fb86c50a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8640b5200 0x7fb864156490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:27.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.574+0000 7fb86c50a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb86415ed30 0x7fb8640c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:27.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.574+0000 7fb86c50a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb864162f20 0x7fb8640b6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:27.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.574+0000 7fb86c50a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb864070f10 con 0x7fb86415ed30 2024-09-19T09:18:27.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.574+0000 7fb86c50a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb864070d90 con 0x7fb8640b5200 2024-09-19T09:18:27.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.574+0000 7fb86c50a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb86415f110 con 0x7fb864162f20 2024-09-19T09:18:27.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.574+0000 7fb869aa5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb86415ed30 0x7fb8640c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:27.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.574+0000 7fb869aa5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb86415ed30 0x7fb8640c8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51348/0 (socket says 172.21.15.18:51348) 2024-09-19T09:18:27.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.574+0000 7fb869aa5640 1 -- 172.21.15.18:0/2449208125 learned_addr learned my addr 172.21.15.18:0/2449208125 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:27.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.574+0000 7fb86a2a6640 1 --2- 172.21.15.18:0/2449208125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8640b5200 0x7fb864156490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:27.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.574+0000 7fb86aaa7640 1 --2- 172.21.15.18:0/2449208125 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb864162f20 0x7fb8640b6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:27.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.574+0000 7fb869aa5640 1 -- 172.21.15.18:0/2449208125 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb864162f20 msgr2=0x7fb8640b6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:27.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.574+0000 7fb869aa5640 1 --2- 172.21.15.18:0/2449208125 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb864162f20 0x7fb8640b6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.574+0000 7fb869aa5640 1 -- 172.21.15.18:0/2449208125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8640b5200 msgr2=0x7fb864156490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:27.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.574+0000 7fb869aa5640 1 --2- 172.21.15.18:0/2449208125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8640b5200 0x7fb864156490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.574+0000 7fb869aa5640 1 -- 172.21.15.18:0/2449208125 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8641572c0 con 0x7fb86415ed30 2024-09-19T09:18:27.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.575+0000 7fb869aa5640 1 --2- 172.21.15.18:0/2449208125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb86415ed30 0x7fb8640c8dd0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fb85400c820 tx=0x7fb85400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:27.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.575+0000 7fb85affd640 1 -- 172.21.15.18:0/2449208125 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb854015070 con 0x7fb86415ed30 2024-09-19T09:18:27.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.575+0000 7fb85affd640 1 -- 172.21.15.18:0/2449208125 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb854004220 con 0x7fb86415ed30 2024-09-19T09:18:27.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.575+0000 7fb86c50a640 1 -- 172.21.15.18:0/2449208125 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8640c94d0 con 0x7fb86415ed30 2024-09-19T09:18:27.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.575+0000 7fb85affd640 1 -- 172.21.15.18:0/2449208125 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb85400ce10 con 0x7fb86415ed30 2024-09-19T09:18:27.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.575+0000 7fb86c50a640 1 -- 172.21.15.18:0/2449208125 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8640b79b0 con 0x7fb86415ed30 2024-09-19T09:18:27.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.576+0000 7fb86c50a640 1 -- 172.21.15.18:0/2449208125 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8640d0390 con 0x7fb86415ed30 2024-09-19T09:18:27.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.576+0000 7fb85affd640 1 -- 172.21.15.18:0/2449208125 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb854007830 con 0x7fb86415ed30 2024-09-19T09:18:27.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.577+0000 7fb85affd640 1 --2- 172.21.15.18:0/2449208125 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb84806c2b0 0x7fb84806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:27.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.577+0000 7fb85affd640 1 -- 172.21.15.18:0/2449208125 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fb85408b0d0 con 0x7fb86415ed30 2024-09-19T09:18:27.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.577+0000 7fb86a2a6640 1 --2- 172.21.15.18:0/2449208125 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb84806c2b0 0x7fb84806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:27.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.577+0000 7fb86a2a6640 1 --2- 172.21.15.18:0/2449208125 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb84806c2b0 0x7fb84806e770 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb860034000 tx=0x7fb86002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:27.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.581+0000 7fb85affd640 1 -- 172.21.15.18:0/2449208125 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb8640d0390 con 0x7fb86415ed30 2024-09-19T09:18:27.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.755+0000 7fb86c50a640 1 -- 172.21.15.18:0/2449208125 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb8641629e0 con 0x7fb84806c2b0 2024-09-19T09:18:27.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.761+0000 7fb85affd640 1 -- 172.21.15.18:0/2449208125 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247990 (secure 0 0 0) 0x7fb8641629e0 con 0x7fb84806c2b0 2024-09-19T09:18:27.764 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:27.765 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:18:27.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.764+0000 7fb86c50a640 1 -- 172.21.15.18:0/2449208125 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb84806c2b0 msgr2=0x7fb84806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:27.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.764+0000 7fb86c50a640 1 --2- 172.21.15.18:0/2449208125 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb84806c2b0 0x7fb84806e770 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fb860034000 tx=0x7fb86002e000 comp rx=0 tx=0).stop 2024-09-19T09:18:27.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.764+0000 7fb86c50a640 1 -- 172.21.15.18:0/2449208125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb86415ed30 msgr2=0x7fb8640c8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:27.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.764+0000 7fb86c50a640 1 --2- 172.21.15.18:0/2449208125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb86415ed30 0x7fb8640c8dd0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fb85400c820 tx=0x7fb85400cce0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.764+0000 7fb86c50a640 1 -- 172.21.15.18:0/2449208125 shutdown_connections 2024-09-19T09:18:27.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.764+0000 7fb86c50a640 1 --2- 172.21.15.18:0/2449208125 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb84806c2b0 0x7fb84806e770 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.764+0000 7fb86c50a640 1 --2- 172.21.15.18:0/2449208125 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb864162f20 0x7fb8640b6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.764+0000 7fb86c50a640 1 --2- 172.21.15.18:0/2449208125 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb86415ed30 0x7fb8640c8dd0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.764+0000 7fb86c50a640 1 --2- 172.21.15.18:0/2449208125 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb8640b5200 0x7fb864156490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.764+0000 7fb86c50a640 1 -- 172.21.15.18:0/2449208125 >> 172.21.15.18:0/2449208125 conn(0x7fb8640b4600 msgr2=0x7fb86406e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:27.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.764+0000 7fb86c50a640 1 -- 172.21.15.18:0/2449208125 shutdown_connections 2024-09-19T09:18:27.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.764+0000 7fb86c50a640 1 -- 172.21.15.18:0/2449208125 wait complete. 2024-09-19T09:18:27.776 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":251,"stamp":"2024-09-19T09:18:27.596943+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":138,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5574,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556925,"statfs":{"total":1600000000,"available":1594291804,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.181316"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609303+0000","last_change":"2024-09-19T09:18:24.446630+0000","last_active":"2024-09-19T09:18:25.609303+0000","last_peered":"2024-09-19T09:18:25.609303+0000","last_clean":"2024-09-19T09:18:25.609303+0000","last_became_active":"2024-09-19T09:18:24.446342+0000","last_became_peered":"2024-09-19T09:18:24.446342+0000","last_unstale":"2024-09-19T09:18:25.609303+0000","last_undegraded":"2024-09-19T09:18:25.609303+0000","last_fullsized":"2024-09-19T09:18:25.609303+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:51.069390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.438095+0000","last_change":"2024-09-19T09:18:24.443315+0000","last_active":"2024-09-19T09:18:25.438095+0000","last_peered":"2024-09-19T09:18:25.438095+0000","last_clean":"2024-09-19T09:18:25.438095+0000","last_became_active":"2024-09-19T09:18:24.441981+0000","last_became_peered":"2024-09-19T09:18:24.441981+0000","last_unstale":"2024-09-19T09:18:25.438095+0000","last_undegraded":"2024-09-19T09:18:25.438095+0000","last_fullsized":"2024-09-19T09:18:25.438095+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:58:23.379712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.437944+0000","last_change":"2024-09-19T09:18:24.443035+0000","last_active":"2024-09-19T09:18:25.437944+0000","last_peered":"2024-09-19T09:18:25.437944+0000","last_clean":"2024-09-19T09:18:25.437944+0000","last_became_active":"2024-09-19T09:18:24.442582+0000","last_became_peered":"2024-09-19T09:18:24.442582+0000","last_unstale":"2024-09-19T09:18:25.437944+0000","last_undegraded":"2024-09-19T09:18:25.437944+0000","last_fullsized":"2024-09-19T09:18:25.437944+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:59.210207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.608672+0000","last_change":"2024-09-19T09:18:24.444830+0000","last_active":"2024-09-19T09:18:25.608672+0000","last_peered":"2024-09-19T09:18:25.608672+0000","last_clean":"2024-09-19T09:18:25.608672+0000","last_became_active":"2024-09-19T09:18:24.444617+0000","last_became_peered":"2024-09-19T09:18:24.444617+0000","last_unstale":"2024-09-19T09:18:25.608672+0000","last_undegraded":"2024-09-19T09:18:25.608672+0000","last_fullsized":"2024-09-19T09:18:25.608672+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:03.803866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.608773+0000","last_change":"2024-09-19T09:18:24.442344+0000","last_active":"2024-09-19T09:18:25.608773+0000","last_peered":"2024-09-19T09:18:25.608773+0000","last_clean":"2024-09-19T09:18:25.608773+0000","last_became_active":"2024-09-19T09:18:24.441656+0000","last_became_peered":"2024-09-19T09:18:24.441656+0000","last_unstale":"2024-09-19T09:18:25.608773+0000","last_undegraded":"2024-09-19T09:18:25.608773+0000","last_fullsized":"2024-09-19T09:18:25.608773+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:24:34.340784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.438114+0000","last_change":"2024-09-19T09:18:24.445719+0000","last_active":"2024-09-19T09:18:25.438114+0000","last_peered":"2024-09-19T09:18:25.438114+0000","last_clean":"2024-09-19T09:18:25.438114+0000","last_became_active":"2024-09-19T09:18:24.444552+0000","last_became_peered":"2024-09-19T09:18:24.444552+0000","last_unstale":"2024-09-19T09:18:25.438114+0000","last_undegraded":"2024-09-19T09:18:25.438114+0000","last_fullsized":"2024-09-19T09:18:25.438114+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:48:07.485129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.438358+0000","last_change":"2024-09-19T09:18:24.446013+0000","last_active":"2024-09-19T09:18:25.438358+0000","last_peered":"2024-09-19T09:18:25.438358+0000","last_clean":"2024-09-19T09:18:25.438358+0000","last_became_active":"2024-09-19T09:18:24.443038+0000","last_became_peered":"2024-09-19T09:18:24.443038+0000","last_unstale":"2024-09-19T09:18:25.438358+0000","last_undegraded":"2024-09-19T09:18:25.438358+0000","last_fullsized":"2024-09-19T09:18:25.438358+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:45.433539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609001+0000","last_change":"2024-09-19T09:18:24.441986+0000","last_active":"2024-09-19T09:18:25.609001+0000","last_peered":"2024-09-19T09:18:25.609001+0000","last_clean":"2024-09-19T09:18:25.609001+0000","last_became_active":"2024-09-19T09:18:24.441740+0000","last_became_peered":"2024-09-19T09:18:24.441740+0000","last_unstale":"2024-09-19T09:18:25.609001+0000","last_undegraded":"2024-09-19T09:18:25.609001+0000","last_fullsized":"2024-09-19T09:18:25.609001+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:15:53.649041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609586+0000","last_change":"2024-09-19T09:18:24.442612+0000","last_active":"2024-09-19T09:18:25.609586+0000","last_peered":"2024-09-19T09:18:25.609586+0000","last_clean":"2024-09-19T09:18:25.609586+0000","last_became_active":"2024-09-19T09:18:24.442372+0000","last_became_peered":"2024-09-19T09:18:24.442372+0000","last_unstale":"2024-09-19T09:18:25.609586+0000","last_undegraded":"2024-09-19T09:18:25.609586+0000","last_fullsized":"2024-09-19T09:18:25.609586+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:25.665934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.438084+0000","last_change":"2024-09-19T09:18:24.442414+0000","last_active":"2024-09-19T09:18:25.438084+0000","last_peered":"2024-09-19T09:18:25.438084+0000","last_clean":"2024-09-19T09:18:25.438084+0000","last_became_active":"2024-09-19T09:18:24.442173+0000","last_became_peered":"2024-09-19T09:18:24.442173+0000","last_unstale":"2024-09-19T09:18:25.438084+0000","last_undegraded":"2024-09-19T09:18:25.438084+0000","last_fullsized":"2024-09-19T09:18:25.438084+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:47:01.901213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609633+0000","last_change":"2024-09-19T09:18:24.440427+0000","last_active":"2024-09-19T09:18:25.609633+0000","last_peered":"2024-09-19T09:18:25.609633+0000","last_clean":"2024-09-19T09:18:25.609633+0000","last_became_active":"2024-09-19T09:18:24.439849+0000","last_became_peered":"2024-09-19T09:18:24.439849+0000","last_unstale":"2024-09-19T09:18:25.609633+0000","last_undegraded":"2024-09-19T09:18:25.609633+0000","last_fullsized":"2024-09-19T09:18:25.609633+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:33.139716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609110+0000","last_change":"2024-09-19T09:18:24.448533+0000","last_active":"2024-09-19T09:18:25.609110+0000","last_peered":"2024-09-19T09:18:25.609110+0000","last_clean":"2024-09-19T09:18:25.609110+0000","last_became_active":"2024-09-19T09:18:24.448020+0000","last_became_peered":"2024-09-19T09:18:24.448020+0000","last_unstale":"2024-09-19T09:18:25.609110+0000","last_undegraded":"2024-09-19T09:18:25.609110+0000","last_fullsized":"2024-09-19T09:18:25.609110+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:57.344680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609104+0000","last_change":"2024-09-19T09:18:24.438539+0000","last_active":"2024-09-19T09:18:25.609104+0000","last_peered":"2024-09-19T09:18:25.609104+0000","last_clean":"2024-09-19T09:18:25.609104+0000","last_became_active":"2024-09-19T09:18:24.438306+0000","last_became_peered":"2024-09-19T09:18:24.438306+0000","last_unstale":"2024-09-19T09:18:25.609104+0000","last_undegraded":"2024-09-19T09:18:25.609104+0000","last_fullsized":"2024-09-19T09:18:25.609104+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:26.796560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609501+0000","last_change":"2024-09-19T09:18:24.446459+0000","last_active":"2024-09-19T09:18:25.609501+0000","last_peered":"2024-09-19T09:18:25.609501+0000","last_clean":"2024-09-19T09:18:25.609501+0000","last_became_active":"2024-09-19T09:18:24.445911+0000","last_became_peered":"2024-09-19T09:18:24.445911+0000","last_unstale":"2024-09-19T09:18:25.609501+0000","last_undegraded":"2024-09-19T09:18:25.609501+0000","last_fullsized":"2024-09-19T09:18:25.609501+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:20:08.885541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.438372+0000","last_change":"2024-09-19T09:18:24.439194+0000","last_active":"2024-09-19T09:18:25.438372+0000","last_peered":"2024-09-19T09:18:25.438372+0000","last_clean":"2024-09-19T09:18:25.438372+0000","last_became_active":"2024-09-19T09:18:24.438874+0000","last_became_peered":"2024-09-19T09:18:24.438874+0000","last_unstale":"2024-09-19T09:18:25.438372+0000","last_undegraded":"2024-09-19T09:18:25.438372+0000","last_fullsized":"2024-09-19T09:18:25.438372+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:37.999485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.438254+0000","last_change":"2024-09-19T09:18:24.445975+0000","last_active":"2024-09-19T09:18:25.438254+0000","last_peered":"2024-09-19T09:18:25.438254+0000","last_clean":"2024-09-19T09:18:25.438254+0000","last_became_active":"2024-09-19T09:18:24.444902+0000","last_became_peered":"2024-09-19T09:18:24.444902+0000","last_unstale":"2024-09-19T09:18:25.438254+0000","last_undegraded":"2024-09-19T09:18:25.438254+0000","last_fullsized":"2024-09-19T09:18:25.438254+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:04:35.163359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609246+0000","last_change":"2024-09-19T09:18:24.448243+0000","last_active":"2024-09-19T09:18:25.609246+0000","last_peered":"2024-09-19T09:18:25.609246+0000","last_clean":"2024-09-19T09:18:25.609246+0000","last_became_active":"2024-09-19T09:18:24.447675+0000","last_became_peered":"2024-09-19T09:18:24.447675+0000","last_unstale":"2024-09-19T09:18:25.609246+0000","last_undegraded":"2024-09-19T09:18:25.609246+0000","last_fullsized":"2024-09-19T09:18:25.609246+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:02.953711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609723+0000","last_change":"2024-09-19T09:18:24.447095+0000","last_active":"2024-09-19T09:18:25.609723+0000","last_peered":"2024-09-19T09:18:25.609723+0000","last_clean":"2024-09-19T09:18:25.609723+0000","last_became_active":"2024-09-19T09:18:24.445921+0000","last_became_peered":"2024-09-19T09:18:24.445921+0000","last_unstale":"2024-09-19T09:18:25.609723+0000","last_undegraded":"2024-09-19T09:18:25.609723+0000","last_fullsized":"2024-09-19T09:18:25.609723+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:20.327409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609669+0000","last_change":"2024-09-19T09:18:24.446642+0000","last_active":"2024-09-19T09:18:25.609669+0000","last_peered":"2024-09-19T09:18:25.609669+0000","last_clean":"2024-09-19T09:18:25.609669+0000","last_became_active":"2024-09-19T09:18:24.446209+0000","last_became_peered":"2024-09-19T09:18:24.446209+0000","last_unstale":"2024-09-19T09:18:25.609669+0000","last_undegraded":"2024-09-19T09:18:25.609669+0000","last_fullsized":"2024-09-19T09:18:25.609669+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:48.200785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.608995+0000","last_change":"2024-09-19T09:18:24.441234+0000","last_active":"2024-09-19T09:18:25.608995+0000","last_peered":"2024-09-19T09:18:25.608995+0000","last_clean":"2024-09-19T09:18:25.608995+0000","last_became_active":"2024-09-19T09:18:24.440786+0000","last_became_peered":"2024-09-19T09:18:24.440786+0000","last_unstale":"2024-09-19T09:18:25.608995+0000","last_undegraded":"2024-09-19T09:18:25.608995+0000","last_fullsized":"2024-09-19T09:18:25.608995+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:38.094445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.608872+0000","last_change":"2024-09-19T09:18:24.442700+0000","last_active":"2024-09-19T09:18:25.608872+0000","last_peered":"2024-09-19T09:18:25.608872+0000","last_clean":"2024-09-19T09:18:25.608872+0000","last_became_active":"2024-09-19T09:18:24.442466+0000","last_became_peered":"2024-09-19T09:18:24.442466+0000","last_unstale":"2024-09-19T09:18:25.608872+0000","last_undegraded":"2024-09-19T09:18:25.608872+0000","last_fullsized":"2024-09-19T09:18:25.608872+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:16.976463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.610004+0000","last_change":"2024-09-19T09:18:24.446062+0000","last_active":"2024-09-19T09:18:25.610004+0000","last_peered":"2024-09-19T09:18:25.610004+0000","last_clean":"2024-09-19T09:18:25.610004+0000","last_became_active":"2024-09-19T09:18:24.445796+0000","last_became_peered":"2024-09-19T09:18:24.445796+0000","last_unstale":"2024-09-19T09:18:25.610004+0000","last_undegraded":"2024-09-19T09:18:25.610004+0000","last_fullsized":"2024-09-19T09:18:25.610004+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:30.807676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609142+0000","last_change":"2024-09-19T09:18:24.439681+0000","last_active":"2024-09-19T09:18:25.609142+0000","last_peered":"2024-09-19T09:18:25.609142+0000","last_clean":"2024-09-19T09:18:25.609142+0000","last_became_active":"2024-09-19T09:18:24.439442+0000","last_became_peered":"2024-09-19T09:18:24.439442+0000","last_unstale":"2024-09-19T09:18:25.609142+0000","last_undegraded":"2024-09-19T09:18:25.609142+0000","last_fullsized":"2024-09-19T09:18:25.609142+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:32:16.116052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609152+0000","last_change":"2024-09-19T09:18:24.444465+0000","last_active":"2024-09-19T09:18:25.609152+0000","last_peered":"2024-09-19T09:18:25.609152+0000","last_clean":"2024-09-19T09:18:25.609152+0000","last_became_active":"2024-09-19T09:18:24.444198+0000","last_became_peered":"2024-09-19T09:18:24.444198+0000","last_unstale":"2024-09-19T09:18:25.609152+0000","last_undegraded":"2024-09-19T09:18:25.609152+0000","last_fullsized":"2024-09-19T09:18:25.609152+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:11:45.618828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609834+0000","last_change":"2024-09-19T09:18:24.444870+0000","last_active":"2024-09-19T09:18:25.609834+0000","last_peered":"2024-09-19T09:18:25.609834+0000","last_clean":"2024-09-19T09:18:25.609834+0000","last_became_active":"2024-09-19T09:18:24.444642+0000","last_became_peered":"2024-09-19T09:18:24.444642+0000","last_unstale":"2024-09-19T09:18:25.609834+0000","last_undegraded":"2024-09-19T09:18:25.609834+0000","last_fullsized":"2024-09-19T09:18:25.609834+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:40.987215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.608764+0000","last_change":"2024-09-19T09:18:24.446713+0000","last_active":"2024-09-19T09:18:25.608764+0000","last_peered":"2024-09-19T09:18:25.608764+0000","last_clean":"2024-09-19T09:18:25.608764+0000","last_became_active":"2024-09-19T09:18:24.446500+0000","last_became_peered":"2024-09-19T09:18:24.446500+0000","last_unstale":"2024-09-19T09:18:25.608764+0000","last_undegraded":"2024-09-19T09:18:25.608764+0000","last_fullsized":"2024-09-19T09:18:25.608764+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:01:24.029363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.608616+0000","last_change":"2024-09-19T09:18:24.445043+0000","last_active":"2024-09-19T09:18:25.608616+0000","last_peered":"2024-09-19T09:18:25.608616+0000","last_clean":"2024-09-19T09:18:25.608616+0000","last_became_active":"2024-09-19T09:18:24.441639+0000","last_became_peered":"2024-09-19T09:18:24.441639+0000","last_unstale":"2024-09-19T09:18:25.608616+0000","last_undegraded":"2024-09-19T09:18:25.608616+0000","last_fullsized":"2024-09-19T09:18:25.608616+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:11.723441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.608832+0000","last_change":"2024-09-19T09:18:24.454426+0000","last_active":"2024-09-19T09:18:25.608832+0000","last_peered":"2024-09-19T09:18:25.608832+0000","last_clean":"2024-09-19T09:18:25.608832+0000","last_became_active":"2024-09-19T09:18:24.453137+0000","last_became_peered":"2024-09-19T09:18:24.453137+0000","last_unstale":"2024-09-19T09:18:25.608832+0000","last_undegraded":"2024-09-19T09:18:25.608832+0000","last_fullsized":"2024-09-19T09:18:25.608832+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:14:13.159636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.608855+0000","last_change":"2024-09-19T09:18:24.436502+0000","last_active":"2024-09-19T09:18:25.608855+0000","last_peered":"2024-09-19T09:18:25.608855+0000","last_clean":"2024-09-19T09:18:25.608855+0000","last_became_active":"2024-09-19T09:18:24.436281+0000","last_became_peered":"2024-09-19T09:18:24.436281+0000","last_unstale":"2024-09-19T09:18:25.608855+0000","last_undegraded":"2024-09-19T09:18:25.608855+0000","last_fullsized":"2024-09-19T09:18:25.608855+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:24.132361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.608828+0000","last_change":"2024-09-19T09:18:24.441042+0000","last_active":"2024-09-19T09:18:25.608828+0000","last_peered":"2024-09-19T09:18:25.608828+0000","last_clean":"2024-09-19T09:18:25.608828+0000","last_became_active":"2024-09-19T09:18:24.440466+0000","last_became_peered":"2024-09-19T09:18:24.440466+0000","last_unstale":"2024-09-19T09:18:25.608828+0000","last_undegraded":"2024-09-19T09:18:25.608828+0000","last_fullsized":"2024-09-19T09:18:25.608828+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:35.029220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.438384+0000","last_change":"2024-09-19T09:18:24.445192+0000","last_active":"2024-09-19T09:18:25.438384+0000","last_peered":"2024-09-19T09:18:25.438384+0000","last_clean":"2024-09-19T09:18:25.438384+0000","last_became_active":"2024-09-19T09:18:24.444210+0000","last_became_peered":"2024-09-19T09:18:24.444210+0000","last_unstale":"2024-09-19T09:18:25.438384+0000","last_undegraded":"2024-09-19T09:18:25.438384+0000","last_fullsized":"2024-09-19T09:18:25.438384+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:41.225851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.438048+0000","last_change":"2024-09-19T09:18:24.443736+0000","last_active":"2024-09-19T09:18:25.438048+0000","last_peered":"2024-09-19T09:18:25.438048+0000","last_clean":"2024-09-19T09:18:25.438048+0000","last_became_active":"2024-09-19T09:18:24.443343+0000","last_became_peered":"2024-09-19T09:18:24.443343+0000","last_unstale":"2024-09-19T09:18:25.438048+0000","last_undegraded":"2024-09-19T09:18:25.438048+0000","last_fullsized":"2024-09-19T09:18:25.438048+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:32.212663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.608369+0000","last_change":"2024-09-19T09:18:24.445976+0000","last_active":"2024-09-19T09:18:25.608369+0000","last_peered":"2024-09-19T09:18:25.608369+0000","last_clean":"2024-09-19T09:18:25.608369+0000","last_became_active":"2024-09-19T09:18:24.445716+0000","last_became_peered":"2024-09-19T09:18:24.445716+0000","last_unstale":"2024-09-19T09:18:25.608369+0000","last_undegraded":"2024-09-19T09:18:25.608369+0000","last_fullsized":"2024-09-19T09:18:25.608369+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:59:45.301346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"103'4","reported_seq":18,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609596+0000","last_change":"2024-09-19T09:18:23.427523+0000","last_active":"2024-09-19T09:18:25.609596+0000","last_peered":"2024-09-19T09:18:25.609596+0000","last_clean":"2024-09-19T09:18:25.609596+0000","last_became_active":"2024-09-19T09:18:23.427098+0000","last_became_peered":"2024-09-19T09:18:23.427098+0000","last_unstale":"2024-09-19T09:18:25.609596+0000","last_undegraded":"2024-09-19T09:18:25.609596+0000","last_fullsized":"2024-09-19T09:18:25.609596+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:57:06.298201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.608976+0000","last_change":"2024-09-19T09:18:24.454135+0000","last_active":"2024-09-19T09:18:25.608976+0000","last_peered":"2024-09-19T09:18:25.608976+0000","last_clean":"2024-09-19T09:18:25.608976+0000","last_became_active":"2024-09-19T09:18:24.452672+0000","last_became_peered":"2024-09-19T09:18:24.452672+0000","last_unstale":"2024-09-19T09:18:25.608976+0000","last_undegraded":"2024-09-19T09:18:25.608976+0000","last_fullsized":"2024-09-19T09:18:25.608976+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:13:35.865674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"103'1","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.438109+0000","last_change":"2024-09-19T09:18:23.432856+0000","last_active":"2024-09-19T09:18:25.438109+0000","last_peered":"2024-09-19T09:18:25.438109+0000","last_clean":"2024-09-19T09:18:25.438109+0000","last_became_active":"2024-09-19T09:18:23.432588+0000","last_became_peered":"2024-09-19T09:18:23.432588+0000","last_unstale":"2024-09-19T09:18:25.438109+0000","last_undegraded":"2024-09-19T09:18:25.438109+0000","last_fullsized":"2024-09-19T09:18:25.438109+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:10.025426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.608603+0000","last_change":"2024-09-19T09:18:24.447366+0000","last_active":"2024-09-19T09:18:25.608603+0000","last_peered":"2024-09-19T09:18:25.608603+0000","last_clean":"2024-09-19T09:18:25.608603+0000","last_became_active":"2024-09-19T09:18:24.440646+0000","last_became_peered":"2024-09-19T09:18:24.440646+0000","last_unstale":"2024-09-19T09:18:25.608603+0000","last_undegraded":"2024-09-19T09:18:25.608603+0000","last_fullsized":"2024-09-19T09:18:25.608603+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:46:57.993273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"103'2","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.610031+0000","last_change":"2024-09-19T09:18:23.429681+0000","last_active":"2024-09-19T09:18:25.610031+0000","last_peered":"2024-09-19T09:18:25.610031+0000","last_clean":"2024-09-19T09:18:25.610031+0000","last_became_active":"2024-09-19T09:18:23.429379+0000","last_became_peered":"2024-09-19T09:18:23.429379+0000","last_unstale":"2024-09-19T09:18:25.610031+0000","last_undegraded":"2024-09-19T09:18:25.610031+0000","last_fullsized":"2024-09-19T09:18:25.610031+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:40.537723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609507+0000","last_change":"2024-09-19T09:18:24.454526+0000","last_active":"2024-09-19T09:18:25.609507+0000","last_peered":"2024-09-19T09:18:25.609507+0000","last_clean":"2024-09-19T09:18:25.609507+0000","last_became_active":"2024-09-19T09:18:24.453361+0000","last_became_peered":"2024-09-19T09:18:24.453361+0000","last_unstale":"2024-09-19T09:18:25.609507+0000","last_undegraded":"2024-09-19T09:18:25.609507+0000","last_fullsized":"2024-09-19T09:18:25.609507+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:12:00.230988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"103'2","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609304+0000","last_change":"2024-09-19T09:18:23.426744+0000","last_active":"2024-09-19T09:18:25.609304+0000","last_peered":"2024-09-19T09:18:25.609304+0000","last_clean":"2024-09-19T09:18:25.609304+0000","last_became_active":"2024-09-19T09:18:23.426523+0000","last_became_peered":"2024-09-19T09:18:23.426523+0000","last_unstale":"2024-09-19T09:18:25.609304+0000","last_undegraded":"2024-09-19T09:18:25.609304+0000","last_fullsized":"2024-09-19T09:18:25.609304+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:01.731385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.608715+0000","last_change":"2024-09-19T09:18:24.442302+0000","last_active":"2024-09-19T09:18:25.608715+0000","last_peered":"2024-09-19T09:18:25.608715+0000","last_clean":"2024-09-19T09:18:25.608715+0000","last_became_active":"2024-09-19T09:18:24.442086+0000","last_became_peered":"2024-09-19T09:18:24.442086+0000","last_unstale":"2024-09-19T09:18:25.608715+0000","last_undegraded":"2024-09-19T09:18:25.608715+0000","last_fullsized":"2024-09-19T09:18:25.608715+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:55.077699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"103'1","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609407+0000","last_change":"2024-09-19T09:18:23.428635+0000","last_active":"2024-09-19T09:18:25.609407+0000","last_peered":"2024-09-19T09:18:25.609407+0000","last_clean":"2024-09-19T09:18:25.609407+0000","last_became_active":"2024-09-19T09:18:23.427843+0000","last_became_peered":"2024-09-19T09:18:23.427843+0000","last_unstale":"2024-09-19T09:18:25.609407+0000","last_undegraded":"2024-09-19T09:18:25.609407+0000","last_fullsized":"2024-09-19T09:18:25.609407+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:13.607024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.438192+0000","last_change":"2024-09-19T09:18:24.449204+0000","last_active":"2024-09-19T09:18:25.438192+0000","last_peered":"2024-09-19T09:18:25.438192+0000","last_clean":"2024-09-19T09:18:25.438192+0000","last_became_active":"2024-09-19T09:18:24.448951+0000","last_became_peered":"2024-09-19T09:18:24.448951+0000","last_unstale":"2024-09-19T09:18:25.438192+0000","last_undegraded":"2024-09-19T09:18:25.438192+0000","last_fullsized":"2024-09-19T09:18:25.438192+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:42.111703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"103'1","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.438061+0000","last_change":"2024-09-19T09:18:23.432692+0000","last_active":"2024-09-19T09:18:25.438061+0000","last_peered":"2024-09-19T09:18:25.438061+0000","last_clean":"2024-09-19T09:18:25.438061+0000","last_became_active":"2024-09-19T09:18:23.432443+0000","last_became_peered":"2024-09-19T09:18:23.432443+0000","last_unstale":"2024-09-19T09:18:25.438061+0000","last_undegraded":"2024-09-19T09:18:25.438061+0000","last_fullsized":"2024-09-19T09:18:25.438061+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:20.957137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609646+0000","last_change":"2024-09-19T09:18:24.454324+0000","last_active":"2024-09-19T09:18:25.609646+0000","last_peered":"2024-09-19T09:18:25.609646+0000","last_clean":"2024-09-19T09:18:25.609646+0000","last_became_active":"2024-09-19T09:18:24.452383+0000","last_became_peered":"2024-09-19T09:18:24.452383+0000","last_unstale":"2024-09-19T09:18:25.609646+0000","last_undegraded":"2024-09-19T09:18:25.609646+0000","last_fullsized":"2024-09-19T09:18:25.609646+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:42.689489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.610016+0000","last_change":"2024-09-19T09:18:23.433292+0000","last_active":"2024-09-19T09:18:25.610016+0000","last_peered":"2024-09-19T09:18:25.610016+0000","last_clean":"2024-09-19T09:18:25.610016+0000","last_became_active":"2024-09-19T09:18:23.432992+0000","last_became_peered":"2024-09-19T09:18:23.432992+0000","last_unstale":"2024-09-19T09:18:25.610016+0000","last_undegraded":"2024-09-19T09:18:25.610016+0000","last_fullsized":"2024-09-19T09:18:25.610016+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:41.524126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609831+0000","last_change":"2024-09-19T09:18:24.449487+0000","last_active":"2024-09-19T09:18:25.609831+0000","last_peered":"2024-09-19T09:18:25.609831+0000","last_clean":"2024-09-19T09:18:25.609831+0000","last_became_active":"2024-09-19T09:18:24.449103+0000","last_became_peered":"2024-09-19T09:18:24.449103+0000","last_unstale":"2024-09-19T09:18:25.609831+0000","last_undegraded":"2024-09-19T09:18:25.609831+0000","last_fullsized":"2024-09-19T09:18:25.609831+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:20.100308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609089+0000","last_change":"2024-09-19T09:18:23.429332+0000","last_active":"2024-09-19T09:18:25.609089+0000","last_peered":"2024-09-19T09:18:25.609089+0000","last_clean":"2024-09-19T09:18:25.609089+0000","last_became_active":"2024-09-19T09:18:23.429107+0000","last_became_peered":"2024-09-19T09:18:23.429107+0000","last_unstale":"2024-09-19T09:18:25.609089+0000","last_undegraded":"2024-09-19T09:18:25.609089+0000","last_fullsized":"2024-09-19T09:18:25.609089+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:04:07.758654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609893+0000","last_change":"2024-09-19T09:18:24.449358+0000","last_active":"2024-09-19T09:18:25.609893+0000","last_peered":"2024-09-19T09:18:25.609893+0000","last_clean":"2024-09-19T09:18:25.609893+0000","last_became_active":"2024-09-19T09:18:24.449045+0000","last_became_peered":"2024-09-19T09:18:24.449045+0000","last_unstale":"2024-09-19T09:18:25.609893+0000","last_undegraded":"2024-09-19T09:18:25.609893+0000","last_fullsized":"2024-09-19T09:18:25.609893+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:40.425291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609605+0000","last_change":"2024-09-19T09:18:23.426201+0000","last_active":"2024-09-19T09:18:25.609605+0000","last_peered":"2024-09-19T09:18:25.609605+0000","last_clean":"2024-09-19T09:18:25.609605+0000","last_became_active":"2024-09-19T09:18:23.425905+0000","last_became_peered":"2024-09-19T09:18:23.425905+0000","last_unstale":"2024-09-19T09:18:25.609605+0000","last_undegraded":"2024-09-19T09:18:25.609605+0000","last_fullsized":"2024-09-19T09:18:25.609605+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:50.172671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609513+0000","last_change":"2024-09-19T09:18:24.447403+0000","last_active":"2024-09-19T09:18:25.609513+0000","last_peered":"2024-09-19T09:18:25.609513+0000","last_clean":"2024-09-19T09:18:25.609513+0000","last_became_active":"2024-09-19T09:18:24.447119+0000","last_became_peered":"2024-09-19T09:18:24.447119+0000","last_unstale":"2024-09-19T09:18:25.609513+0000","last_undegraded":"2024-09-19T09:18:25.609513+0000","last_fullsized":"2024-09-19T09:18:25.609513+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:41:16.337374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.438282+0000","last_change":"2024-09-19T09:18:23.433851+0000","last_active":"2024-09-19T09:18:25.438282+0000","last_peered":"2024-09-19T09:18:25.438282+0000","last_clean":"2024-09-19T09:18:25.438282+0000","last_became_active":"2024-09-19T09:18:23.432140+0000","last_became_peered":"2024-09-19T09:18:23.432140+0000","last_unstale":"2024-09-19T09:18:25.438282+0000","last_undegraded":"2024-09-19T09:18:25.438282+0000","last_fullsized":"2024-09-19T09:18:25.438282+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:35:18.776770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609322+0000","last_change":"2024-09-19T09:18:24.441439+0000","last_active":"2024-09-19T09:18:25.609322+0000","last_peered":"2024-09-19T09:18:25.609322+0000","last_clean":"2024-09-19T09:18:25.609322+0000","last_became_active":"2024-09-19T09:18:24.441175+0000","last_became_peered":"2024-09-19T09:18:24.441175+0000","last_unstale":"2024-09-19T09:18:25.609322+0000","last_undegraded":"2024-09-19T09:18:25.609322+0000","last_fullsized":"2024-09-19T09:18:25.609322+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:38:41.829108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"103'3","reported_seq":17,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609198+0000","last_change":"2024-09-19T09:18:23.431157+0000","last_active":"2024-09-19T09:18:25.609198+0000","last_peered":"2024-09-19T09:18:25.609198+0000","last_clean":"2024-09-19T09:18:25.609198+0000","last_became_active":"2024-09-19T09:18:23.430383+0000","last_became_peered":"2024-09-19T09:18:23.430383+0000","last_unstale":"2024-09-19T09:18:25.609198+0000","last_undegraded":"2024-09-19T09:18:25.609198+0000","last_fullsized":"2024-09-19T09:18:25.609198+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:47.946487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609242+0000","last_change":"2024-09-19T09:18:24.443724+0000","last_active":"2024-09-19T09:18:25.609242+0000","last_peered":"2024-09-19T09:18:25.609242+0000","last_clean":"2024-09-19T09:18:25.609242+0000","last_became_active":"2024-09-19T09:18:24.443288+0000","last_became_peered":"2024-09-19T09:18:24.443288+0000","last_unstale":"2024-09-19T09:18:25.609242+0000","last_undegraded":"2024-09-19T09:18:25.609242+0000","last_fullsized":"2024-09-19T09:18:25.609242+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:44.435370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"103'6","reported_seq":20,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.608470+0000","last_change":"2024-09-19T09:18:23.427648+0000","last_active":"2024-09-19T09:18:25.608470+0000","last_peered":"2024-09-19T09:18:25.608470+0000","last_clean":"2024-09-19T09:18:25.608470+0000","last_became_active":"2024-09-19T09:18:23.426597+0000","last_became_peered":"2024-09-19T09:18:23.426597+0000","last_unstale":"2024-09-19T09:18:25.608470+0000","last_undegraded":"2024-09-19T09:18:25.608470+0000","last_fullsized":"2024-09-19T09:18:25.608470+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:37.198367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609224+0000","last_change":"2024-09-19T09:18:24.448493+0000","last_active":"2024-09-19T09:18:25.609224+0000","last_peered":"2024-09-19T09:18:25.609224+0000","last_clean":"2024-09-19T09:18:25.609224+0000","last_became_active":"2024-09-19T09:18:24.448272+0000","last_became_peered":"2024-09-19T09:18:24.448272+0000","last_unstale":"2024-09-19T09:18:25.609224+0000","last_undegraded":"2024-09-19T09:18:25.609224+0000","last_fullsized":"2024-09-19T09:18:25.609224+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:58:06.008940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"103'2","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609943+0000","last_change":"2024-09-19T09:18:23.427600+0000","last_active":"2024-09-19T09:18:25.609943+0000","last_peered":"2024-09-19T09:18:25.609943+0000","last_clean":"2024-09-19T09:18:25.609943+0000","last_became_active":"2024-09-19T09:18:23.427361+0000","last_became_peered":"2024-09-19T09:18:23.427361+0000","last_unstale":"2024-09-19T09:18:25.609943+0000","last_undegraded":"2024-09-19T09:18:25.609943+0000","last_fullsized":"2024-09-19T09:18:25.609943+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:48:56.469703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609848+0000","last_change":"2024-09-19T09:18:24.454117+0000","last_active":"2024-09-19T09:18:25.609848+0000","last_peered":"2024-09-19T09:18:25.609848+0000","last_clean":"2024-09-19T09:18:25.609848+0000","last_became_active":"2024-09-19T09:18:24.452046+0000","last_became_peered":"2024-09-19T09:18:24.452046+0000","last_unstale":"2024-09-19T09:18:25.609848+0000","last_undegraded":"2024-09-19T09:18:25.609848+0000","last_fullsized":"2024-09-19T09:18:25.609848+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:08:50.548369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.438197+0000","last_change":"2024-09-19T09:18:23.426750+0000","last_active":"2024-09-19T09:18:25.438197+0000","last_peered":"2024-09-19T09:18:25.438197+0000","last_clean":"2024-09-19T09:18:25.438197+0000","last_became_active":"2024-09-19T09:18:23.426400+0000","last_became_peered":"2024-09-19T09:18:23.426400+0000","last_unstale":"2024-09-19T09:18:25.438197+0000","last_undegraded":"2024-09-19T09:18:25.438197+0000","last_fullsized":"2024-09-19T09:18:25.438197+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:47:56.334250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609528+0000","last_change":"2024-09-19T09:18:24.447847+0000","last_active":"2024-09-19T09:18:25.609528+0000","last_peered":"2024-09-19T09:18:25.609528+0000","last_clean":"2024-09-19T09:18:25.609528+0000","last_became_active":"2024-09-19T09:18:24.447442+0000","last_became_peered":"2024-09-19T09:18:24.447442+0000","last_unstale":"2024-09-19T09:18:25.609528+0000","last_undegraded":"2024-09-19T09:18:25.609528+0000","last_fullsized":"2024-09-19T09:18:25.609528+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:27.965986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.438365+0000","last_change":"2024-09-19T09:18:23.434146+0000","last_active":"2024-09-19T09:18:25.438365+0000","last_peered":"2024-09-19T09:18:25.438365+0000","last_clean":"2024-09-19T09:18:25.438365+0000","last_became_active":"2024-09-19T09:18:23.433156+0000","last_became_peered":"2024-09-19T09:18:23.433156+0000","last_unstale":"2024-09-19T09:18:25.438365+0000","last_undegraded":"2024-09-19T09:18:25.438365+0000","last_fullsized":"2024-09-19T09:18:25.438365+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:37.285148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.608812+0000","last_change":"2024-09-19T09:18:24.444640+0000","last_active":"2024-09-19T09:18:25.608812+0000","last_peered":"2024-09-19T09:18:25.608812+0000","last_clean":"2024-09-19T09:18:25.608812+0000","last_became_active":"2024-09-19T09:18:24.444410+0000","last_became_peered":"2024-09-19T09:18:24.444410+0000","last_unstale":"2024-09-19T09:18:25.608812+0000","last_undegraded":"2024-09-19T09:18:25.608812+0000","last_fullsized":"2024-09-19T09:18:25.608812+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:00.272019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"103'8","reported_seq":22,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609819+0000","last_change":"2024-09-19T09:18:23.427845+0000","last_active":"2024-09-19T09:18:25.609819+0000","last_peered":"2024-09-19T09:18:25.609819+0000","last_clean":"2024-09-19T09:18:25.609819+0000","last_became_active":"2024-09-19T09:18:23.427609+0000","last_became_peered":"2024-09-19T09:18:23.427609+0000","last_unstale":"2024-09-19T09:18:25.609819+0000","last_undegraded":"2024-09-19T09:18:25.609819+0000","last_fullsized":"2024-09-19T09:18:25.609819+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:20.354048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.608800+0000","last_change":"2024-09-19T09:18:24.449314+0000","last_active":"2024-09-19T09:18:25.608800+0000","last_peered":"2024-09-19T09:18:25.608800+0000","last_clean":"2024-09-19T09:18:25.608800+0000","last_became_active":"2024-09-19T09:18:24.449050+0000","last_became_peered":"2024-09-19T09:18:24.449050+0000","last_unstale":"2024-09-19T09:18:25.608800+0000","last_undegraded":"2024-09-19T09:18:25.608800+0000","last_fullsized":"2024-09-19T09:18:25.608800+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:47:18.552238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"103'1","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609603+0000","last_change":"2024-09-19T09:18:23.431515+0000","last_active":"2024-09-19T09:18:25.609603+0000","last_peered":"2024-09-19T09:18:25.609603+0000","last_clean":"2024-09-19T09:18:25.609603+0000","last_became_active":"2024-09-19T09:18:23.429079+0000","last_became_peered":"2024-09-19T09:18:23.429079+0000","last_unstale":"2024-09-19T09:18:25.609603+0000","last_undegraded":"2024-09-19T09:18:25.609603+0000","last_fullsized":"2024-09-19T09:18:25.609603+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:15:25.621852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.437950+0000","last_change":"2024-09-19T09:18:24.444028+0000","last_active":"2024-09-19T09:18:25.437950+0000","last_peered":"2024-09-19T09:18:25.437950+0000","last_clean":"2024-09-19T09:18:25.437950+0000","last_became_active":"2024-09-19T09:18:24.443766+0000","last_became_peered":"2024-09-19T09:18:24.443766+0000","last_unstale":"2024-09-19T09:18:25.437950+0000","last_undegraded":"2024-09-19T09:18:25.437950+0000","last_fullsized":"2024-09-19T09:18:25.437950+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:46.054438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"103'2","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609273+0000","last_change":"2024-09-19T09:18:23.431666+0000","last_active":"2024-09-19T09:18:25.609273+0000","last_peered":"2024-09-19T09:18:25.609273+0000","last_clean":"2024-09-19T09:18:25.609273+0000","last_became_active":"2024-09-19T09:18:23.431400+0000","last_became_peered":"2024-09-19T09:18:23.431400+0000","last_unstale":"2024-09-19T09:18:25.609273+0000","last_undegraded":"2024-09-19T09:18:25.609273+0000","last_fullsized":"2024-09-19T09:18:25.609273+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:54.889862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.608805+0000","last_change":"2024-09-19T09:18:24.447646+0000","last_active":"2024-09-19T09:18:25.608805+0000","last_peered":"2024-09-19T09:18:25.608805+0000","last_clean":"2024-09-19T09:18:25.608805+0000","last_became_active":"2024-09-19T09:18:24.447080+0000","last_became_peered":"2024-09-19T09:18:24.447080+0000","last_unstale":"2024-09-19T09:18:25.608805+0000","last_undegraded":"2024-09-19T09:18:25.608805+0000","last_fullsized":"2024-09-19T09:18:25.608805+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:26.471983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.610106+0000","last_change":"2024-09-19T09:18:23.431524+0000","last_active":"2024-09-19T09:18:25.610106+0000","last_peered":"2024-09-19T09:18:25.610106+0000","last_clean":"2024-09-19T09:18:25.610106+0000","last_became_active":"2024-09-19T09:18:23.431269+0000","last_became_peered":"2024-09-19T09:18:23.431269+0000","last_unstale":"2024-09-19T09:18:25.610106+0000","last_undegraded":"2024-09-19T09:18:25.610106+0000","last_fullsized":"2024-09-19T09:18:25.610106+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:23.105482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.438123+0000","last_change":"2024-09-19T09:18:24.442173+0000","last_active":"2024-09-19T09:18:25.438123+0000","last_peered":"2024-09-19T09:18:25.438123+0000","last_clean":"2024-09-19T09:18:25.438123+0000","last_became_active":"2024-09-19T09:18:24.441779+0000","last_became_peered":"2024-09-19T09:18:24.441779+0000","last_unstale":"2024-09-19T09:18:25.438123+0000","last_undegraded":"2024-09-19T09:18:25.438123+0000","last_fullsized":"2024-09-19T09:18:25.438123+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:33.931703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"103'2","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609638+0000","last_change":"2024-09-19T09:18:23.430434+0000","last_active":"2024-09-19T09:18:25.609638+0000","last_peered":"2024-09-19T09:18:25.609638+0000","last_clean":"2024-09-19T09:18:25.609638+0000","last_became_active":"2024-09-19T09:18:23.429705+0000","last_became_peered":"2024-09-19T09:18:23.429705+0000","last_unstale":"2024-09-19T09:18:25.609638+0000","last_undegraded":"2024-09-19T09:18:25.609638+0000","last_fullsized":"2024-09-19T09:18:25.609638+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:08:38.398112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609501+0000","last_change":"2024-09-19T09:18:24.443517+0000","last_active":"2024-09-19T09:18:25.609501+0000","last_peered":"2024-09-19T09:18:25.609501+0000","last_clean":"2024-09-19T09:18:25.609501+0000","last_became_active":"2024-09-19T09:18:24.442936+0000","last_became_peered":"2024-09-19T09:18:24.442936+0000","last_unstale":"2024-09-19T09:18:25.609501+0000","last_undegraded":"2024-09-19T09:18:25.609501+0000","last_fullsized":"2024-09-19T09:18:25.609501+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:54.122760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.438195+0000","last_change":"2024-09-19T09:18:23.423972+0000","last_active":"2024-09-19T09:18:25.438195+0000","last_peered":"2024-09-19T09:18:25.438195+0000","last_clean":"2024-09-19T09:18:25.438195+0000","last_became_active":"2024-09-19T09:18:23.423728+0000","last_became_peered":"2024-09-19T09:18:23.423728+0000","last_unstale":"2024-09-19T09:18:25.438195+0000","last_undegraded":"2024-09-19T09:18:25.438195+0000","last_fullsized":"2024-09-19T09:18:25.438195+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:41.737700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609115+0000","last_change":"2024-09-19T09:18:24.449485+0000","last_active":"2024-09-19T09:18:25.609115+0000","last_peered":"2024-09-19T09:18:25.609115+0000","last_clean":"2024-09-19T09:18:25.609115+0000","last_became_active":"2024-09-19T09:18:24.449183+0000","last_became_peered":"2024-09-19T09:18:24.449183+0000","last_unstale":"2024-09-19T09:18:25.609115+0000","last_undegraded":"2024-09-19T09:18:25.609115+0000","last_fullsized":"2024-09-19T09:18:25.609115+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:46.118934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.610130+0000","last_change":"2024-09-19T09:18:23.428758+0000","last_active":"2024-09-19T09:18:25.610130+0000","last_peered":"2024-09-19T09:18:25.610130+0000","last_clean":"2024-09-19T09:18:25.610130+0000","last_became_active":"2024-09-19T09:18:23.428493+0000","last_became_peered":"2024-09-19T09:18:23.428493+0000","last_unstale":"2024-09-19T09:18:25.610130+0000","last_undegraded":"2024-09-19T09:18:25.610130+0000","last_fullsized":"2024-09-19T09:18:25.610130+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:22.027057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.608941+0000","last_change":"2024-09-19T09:18:24.438582+0000","last_active":"2024-09-19T09:18:25.608941+0000","last_peered":"2024-09-19T09:18:25.608941+0000","last_clean":"2024-09-19T09:18:25.608941+0000","last_became_active":"2024-09-19T09:18:24.438333+0000","last_became_peered":"2024-09-19T09:18:24.438333+0000","last_unstale":"2024-09-19T09:18:25.608941+0000","last_undegraded":"2024-09-19T09:18:25.608941+0000","last_fullsized":"2024-09-19T09:18:25.608941+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:29.215892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.608737+0000","last_change":"2024-09-19T09:18:23.428082+0000","last_active":"2024-09-19T09:18:25.608737+0000","last_peered":"2024-09-19T09:18:25.608737+0000","last_clean":"2024-09-19T09:18:25.608737+0000","last_became_active":"2024-09-19T09:18:23.427847+0000","last_became_peered":"2024-09-19T09:18:23.427847+0000","last_unstale":"2024-09-19T09:18:25.608737+0000","last_undegraded":"2024-09-19T09:18:25.608737+0000","last_fullsized":"2024-09-19T09:18:25.608737+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:37.594881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609371+0000","last_change":"2024-09-19T09:18:24.454379+0000","last_active":"2024-09-19T09:18:25.609371+0000","last_peered":"2024-09-19T09:18:25.609371+0000","last_clean":"2024-09-19T09:18:25.609371+0000","last_became_active":"2024-09-19T09:18:24.454146+0000","last_became_peered":"2024-09-19T09:18:24.454146+0000","last_unstale":"2024-09-19T09:18:25.609371+0000","last_undegraded":"2024-09-19T09:18:25.609371+0000","last_fullsized":"2024-09-19T09:18:25.609371+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:44.933487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"103'2","reported_seq":16,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.610191+0000","last_change":"2024-09-19T09:18:23.432622+0000","last_active":"2024-09-19T09:18:25.610191+0000","last_peered":"2024-09-19T09:18:25.610191+0000","last_clean":"2024-09-19T09:18:25.610191+0000","last_became_active":"2024-09-19T09:18:23.432412+0000","last_became_peered":"2024-09-19T09:18:23.432412+0000","last_unstale":"2024-09-19T09:18:25.610191+0000","last_undegraded":"2024-09-19T09:18:25.610191+0000","last_fullsized":"2024-09-19T09:18:25.610191+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:24.279738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.608758+0000","last_change":"2024-09-19T09:18:24.444788+0000","last_active":"2024-09-19T09:18:25.608758+0000","last_peered":"2024-09-19T09:18:25.608758+0000","last_clean":"2024-09-19T09:18:25.608758+0000","last_became_active":"2024-09-19T09:18:24.441283+0000","last_became_peered":"2024-09-19T09:18:24.441283+0000","last_unstale":"2024-09-19T09:18:25.608758+0000","last_undegraded":"2024-09-19T09:18:25.608758+0000","last_fullsized":"2024-09-19T09:18:25.608758+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:41.705632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"104'1","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:26.436225+0000","last_change":"2024-09-19T09:18:23.427122+0000","last_active":"2024-09-19T09:18:26.436225+0000","last_peered":"2024-09-19T09:18:26.436225+0000","last_clean":"2024-09-19T09:18:26.436225+0000","last_became_active":"2024-09-19T09:18:23.426805+0000","last_became_peered":"2024-09-19T09:18:23.426805+0000","last_unstale":"2024-09-19T09:18:26.436225+0000","last_undegraded":"2024-09-19T09:18:26.436225+0000","last_fullsized":"2024-09-19T09:18:26.436225+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:39:52.504817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.608561+0000","last_change":"2024-09-19T09:18:24.446212+0000","last_active":"2024-09-19T09:18:25.608561+0000","last_peered":"2024-09-19T09:18:25.608561+0000","last_clean":"2024-09-19T09:18:25.608561+0000","last_became_active":"2024-09-19T09:18:24.445965+0000","last_became_peered":"2024-09-19T09:18:24.445965+0000","last_unstale":"2024-09-19T09:18:25.608561+0000","last_undegraded":"2024-09-19T09:18:25.608561+0000","last_fullsized":"2024-09-19T09:18:25.608561+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:01:15.285904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.608560+0000","last_change":"2024-09-19T09:18:23.426839+0000","last_active":"2024-09-19T09:18:25.608560+0000","last_peered":"2024-09-19T09:18:25.608560+0000","last_clean":"2024-09-19T09:18:25.608560+0000","last_became_active":"2024-09-19T09:18:23.425762+0000","last_became_peered":"2024-09-19T09:18:23.425762+0000","last_unstale":"2024-09-19T09:18:25.608560+0000","last_undegraded":"2024-09-19T09:18:25.608560+0000","last_fullsized":"2024-09-19T09:18:25.608560+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:05:05.902164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.438047+0000","last_change":"2024-09-19T09:18:24.448483+0000","last_active":"2024-09-19T09:18:25.438047+0000","last_peered":"2024-09-19T09:18:25.438047+0000","last_clean":"2024-09-19T09:18:25.438047+0000","last_became_active":"2024-09-19T09:18:24.448252+0000","last_became_peered":"2024-09-19T09:18:24.448252+0000","last_unstale":"2024-09-19T09:18:25.438047+0000","last_undegraded":"2024-09-19T09:18:25.438047+0000","last_fullsized":"2024-09-19T09:18:25.438047+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:57:01.769536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.438149+0000","last_change":"2024-09-19T09:18:23.429669+0000","last_active":"2024-09-19T09:18:25.438149+0000","last_peered":"2024-09-19T09:18:25.438149+0000","last_clean":"2024-09-19T09:18:25.438149+0000","last_became_active":"2024-09-19T09:18:23.429440+0000","last_became_peered":"2024-09-19T09:18:23.429440+0000","last_unstale":"2024-09-19T09:18:25.438149+0000","last_undegraded":"2024-09-19T09:18:25.438149+0000","last_fullsized":"2024-09-19T09:18:25.438149+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:44.408910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609755+0000","last_change":"2024-09-19T09:18:24.438649+0000","last_active":"2024-09-19T09:18:25.609755+0000","last_peered":"2024-09-19T09:18:25.609755+0000","last_clean":"2024-09-19T09:18:25.609755+0000","last_became_active":"2024-09-19T09:18:24.438364+0000","last_became_peered":"2024-09-19T09:18:24.438364+0000","last_unstale":"2024-09-19T09:18:25.609755+0000","last_undegraded":"2024-09-19T09:18:25.609755+0000","last_fullsized":"2024-09-19T09:18:25.609755+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:44.296846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.438308+0000","last_change":"2024-09-19T09:18:23.429498+0000","last_active":"2024-09-19T09:18:25.438308+0000","last_peered":"2024-09-19T09:18:25.438308+0000","last_clean":"2024-09-19T09:18:25.438308+0000","last_became_active":"2024-09-19T09:18:23.429266+0000","last_became_peered":"2024-09-19T09:18:23.429266+0000","last_unstale":"2024-09-19T09:18:25.438308+0000","last_undegraded":"2024-09-19T09:18:25.438308+0000","last_fullsized":"2024-09-19T09:18:25.438308+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:07.921876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609377+0000","last_change":"2024-09-19T09:18:24.440687+0000","last_active":"2024-09-19T09:18:25.609377+0000","last_peered":"2024-09-19T09:18:25.609377+0000","last_clean":"2024-09-19T09:18:25.609377+0000","last_became_active":"2024-09-19T09:18:24.440193+0000","last_became_peered":"2024-09-19T09:18:24.440193+0000","last_unstale":"2024-09-19T09:18:25.609377+0000","last_undegraded":"2024-09-19T09:18:25.609377+0000","last_fullsized":"2024-09-19T09:18:25.609377+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:46:13.590783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.438452+0000","last_change":"2024-09-19T09:18:23.433407+0000","last_active":"2024-09-19T09:18:25.438452+0000","last_peered":"2024-09-19T09:18:25.438452+0000","last_clean":"2024-09-19T09:18:25.438452+0000","last_became_active":"2024-09-19T09:18:23.431787+0000","last_became_peered":"2024-09-19T09:18:23.431787+0000","last_unstale":"2024-09-19T09:18:25.438452+0000","last_undegraded":"2024-09-19T09:18:25.438452+0000","last_fullsized":"2024-09-19T09:18:25.438452+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:29.803057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609727+0000","last_change":"2024-09-19T09:18:24.438145+0000","last_active":"2024-09-19T09:18:25.609727+0000","last_peered":"2024-09-19T09:18:25.609727+0000","last_clean":"2024-09-19T09:18:25.609727+0000","last_became_active":"2024-09-19T09:18:24.437906+0000","last_became_peered":"2024-09-19T09:18:24.437906+0000","last_unstale":"2024-09-19T09:18:25.609727+0000","last_undegraded":"2024-09-19T09:18:25.609727+0000","last_fullsized":"2024-09-19T09:18:25.609727+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:32.389037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609289+0000","last_change":"2024-09-19T09:18:23.430938+0000","last_active":"2024-09-19T09:18:25.609289+0000","last_peered":"2024-09-19T09:18:25.609289+0000","last_clean":"2024-09-19T09:18:25.609289+0000","last_became_active":"2024-09-19T09:18:23.430054+0000","last_became_peered":"2024-09-19T09:18:23.430054+0000","last_unstale":"2024-09-19T09:18:25.609289+0000","last_undegraded":"2024-09-19T09:18:25.609289+0000","last_fullsized":"2024-09-19T09:18:25.609289+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:30.405082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609104+0000","last_change":"2024-09-19T09:18:24.453468+0000","last_active":"2024-09-19T09:18:25.609104+0000","last_peered":"2024-09-19T09:18:25.609104+0000","last_clean":"2024-09-19T09:18:25.609104+0000","last_became_active":"2024-09-19T09:18:24.452175+0000","last_became_peered":"2024-09-19T09:18:24.452175+0000","last_unstale":"2024-09-19T09:18:25.609104+0000","last_undegraded":"2024-09-19T09:18:25.609104+0000","last_fullsized":"2024-09-19T09:18:25.609104+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:03:25.220754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.608651+0000","last_change":"2024-09-19T09:18:23.427896+0000","last_active":"2024-09-19T09:18:25.608651+0000","last_peered":"2024-09-19T09:18:25.608651+0000","last_clean":"2024-09-19T09:18:25.608651+0000","last_became_active":"2024-09-19T09:18:23.427408+0000","last_became_peered":"2024-09-19T09:18:23.427408+0000","last_unstale":"2024-09-19T09:18:25.608651+0000","last_undegraded":"2024-09-19T09:18:25.608651+0000","last_fullsized":"2024-09-19T09:18:25.608651+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:09.742616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":12,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609026+0000","last_change":"2024-09-19T09:18:24.440120+0000","last_active":"2024-09-19T09:18:25.609026+0000","last_peered":"2024-09-19T09:18:25.609026+0000","last_clean":"2024-09-19T09:18:25.609026+0000","last_became_active":"2024-09-19T09:18:24.439910+0000","last_became_peered":"2024-09-19T09:18:24.439910+0000","last_unstale":"2024-09-19T09:18:25.609026+0000","last_undegraded":"2024-09-19T09:18:25.609026+0000","last_fullsized":"2024-09-19T09:18:25.609026+0000","mapping_epoch":102,"log_start":"0'0","ondisk_log_start":"0'0","created":102,"last_epoch_clean":103,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:23.414897+0000","last_clean_scrub_stamp":"2024-09-19T09:18:23.414897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:17.419780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"103'1","reported_seq":15,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.608864+0000","last_change":"2024-09-19T09:18:23.430716+0000","last_active":"2024-09-19T09:18:25.608864+0000","last_peered":"2024-09-19T09:18:25.608864+0000","last_clean":"2024-09-19T09:18:25.608864+0000","last_became_active":"2024-09-19T09:18:23.430209+0000","last_became_peered":"2024-09-19T09:18:23.430209+0000","last_unstale":"2024-09-19T09:18:25.608864+0000","last_undegraded":"2024-09-19T09:18:25.608864+0000","last_fullsized":"2024-09-19T09:18:25.608864+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:18:22.410216+0000","last_clean_scrub_stamp":"2024-09-19T09:18:22.410216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:25.770369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":335,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-19T09:18:25.609779+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:18:25.609779+0000","last_peered":"2024-09-19T09:18:25.609779+0000","last_clean":"2024-09-19T09:18:25.609779+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:18:25.609779+0000","last_undegraded":"2024-09-19T09:18:25.609779+0000","last_fullsized":"2024-09-19T09:18:25.609779+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:59:34.496396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574912,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":552,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194760,"statfs":{"total":200000000,"available":199434600,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574912,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":552,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194759,"statfs":{"total":200000000,"available":199433998,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1130,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194182,"statfs":{"total":200000000,"available":198842656,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574912,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":552,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194760,"statfs":{"total":200000000,"available":199434636,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574912,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":552,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194759,"statfs":{"total":200000000,"available":199433996,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574912,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":552,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194760,"statfs":{"total":200000000,"available":199434670,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1128,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194183,"statfs":{"total":200000000,"available":198844212,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574912,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":553,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194758,"statfs":{"total":200000000,"available":199433036,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:18:27.780 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T09:18:27.780 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-19T09:18:27.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.925+0000 7f62f80d7640 1 Processor -- start 2024-09-19T09:18:27.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.925+0000 7f62f80d7640 1 -- start start 2024-09-19T09:18:27.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.926+0000 7f62f80d7640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f62f015b760 0x7f62f00afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:27.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.926+0000 7f62f80d7640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62f00b4300 con 0x7f62f00b4a90 2024-09-19T09:18:27.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.926+0000 7f62f80d7640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62f006d700 con 0x7f62f00d0630 2024-09-19T09:18:27.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.926+0000 7f62f80d7640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f62f006d9e0 con 0x7f62f015b760 2024-09-19T09:18:27.930 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.926+0000 7f62f5672640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f62f00b4a90 0x7f62f006f290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33374/0 (socket says 172.21.15.18:33374) 2024-09-19T09:18:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.926+0000 7f62f5672640 1 -- 172.21.15.18:0/1778366897 learned_addr learned my addr 172.21.15.18:0/1778366897 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.927+0000 7f62f5e73640 1 --2- 172.21.15.18:0/1778366897 >> v2:172.21.15.162:3300/0 conn(0x7f62f015b760 0x7f62f00afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.927+0000 7f62f4e71640 1 -- 172.21.15.18:0/1778366897 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3139513713 0 0) 0x7f62f00b4300 con 0x7f62f00b4a90 2024-09-19T09:18:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.927+0000 7f62f4e71640 1 -- 172.21.15.18:0/1778366897 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62d8003520 con 0x7f62f00b4a90 2024-09-19T09:18:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.927+0000 7f62f4e71640 1 -- 172.21.15.18:0/1778366897 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3339069197 0 0) 0x7f62d8003520 con 0x7f62f00b4a90 2024-09-19T09:18:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.927+0000 7f62f4e71640 1 -- 172.21.15.18:0/1778366897 >> v2:172.21.15.162:3300/0 conn(0x7f62f015b760 msgr2=0x7f62f00afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.927+0000 7f62f4e71640 1 --2- 172.21.15.18:0/1778366897 >> v2:172.21.15.162:3300/0 conn(0x7f62f015b760 0x7f62f00afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.927+0000 7f62f4e71640 1 -- 172.21.15.18:0/1778366897 >> v1:172.21.15.162:6789/0 conn(0x7f62f00d0630 legacy=0x7f62f00d0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.927+0000 7f62f4e71640 1 -- 172.21.15.18:0/1778366897 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f00b4570 con 0x7f62f00b4a90 2024-09-19T09:18:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.927+0000 7f62f4e71640 1 -- 172.21.15.18:0/1778366897 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f62e4001670 con 0x7f62f00b4a90 2024-09-19T09:18:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.927+0000 7f62f4e71640 1 -- 172.21.15.18:0/1778366897 >> v1:172.21.15.18:6789/0 conn(0x7f62f00b4a90 legacy=0x7f62f006f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.927+0000 7f62f4e71640 1 --2- 172.21.15.18:0/1778366897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62d80039b0 0x7f62d8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:27.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.927+0000 7f62f4e71640 1 --2- 172.21.15.18:0/1778366897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d8004800 0x7f62d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:27.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.927+0000 7f62f4e71640 1 --2- 172.21.15.18:0/1778366897 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62d80052e0 0x7f62d800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:27.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.927+0000 7f62f4e71640 1 -- 172.21.15.18:0/1778366897 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f62f006d9e0 con 0x7f62d8004800 2024-09-19T09:18:27.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.927+0000 7f62f4e71640 1 -- 172.21.15.18:0/1778366897 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f62d800c1b0 con 0x7f62d80039b0 2024-09-19T09:18:27.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.927+0000 7f62f4e71640 1 -- 172.21.15.18:0/1778366897 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f62d800c3b0 con 0x7f62d80052e0 2024-09-19T09:18:27.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.927+0000 7f62f5672640 1 --2- 172.21.15.18:0/1778366897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d8004800 0x7f62d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:27.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.927+0000 7f62f5e73640 1 --2- 172.21.15.18:0/1778366897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62d80039b0 0x7f62d8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:27.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.927+0000 7f62f6674640 1 --2- 172.21.15.18:0/1778366897 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62d80052e0 0x7f62d800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:27.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.927+0000 7f62f5672640 1 -- 172.21.15.18:0/1778366897 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62d80052e0 msgr2=0x7f62d800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:27.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.927+0000 7f62f5672640 1 --2- 172.21.15.18:0/1778366897 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62d80052e0 0x7f62d800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.927+0000 7f62f5672640 1 -- 172.21.15.18:0/1778366897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62d80039b0 msgr2=0x7f62d8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:27.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.927+0000 7f62f5672640 1 --2- 172.21.15.18:0/1778366897 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62d80039b0 0x7f62d8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.927+0000 7f62f5672640 1 -- 172.21.15.18:0/1778366897 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62d8003520 con 0x7f62d8004800 2024-09-19T09:18:27.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.927+0000 7f62f6674640 1 -- 172.21.15.18:0/1778366897 reap_dead start 2024-09-19T09:18:27.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.928+0000 7f62f5672640 1 --2- 172.21.15.18:0/1778366897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d8004800 0x7f62d8004c80 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f62e400c210 tx=0x7f62d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd36bf7d35d3620e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:27.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.928+0000 7f62f4e71640 1 -- 172.21.15.18:0/1778366897 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e4007cf0 con 0x7f62d8004800 2024-09-19T09:18:27.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.928+0000 7f62f4e71640 1 -- 172.21.15.18:0/1778366897 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e4005ad0 con 0x7f62d8004800 2024-09-19T09:18:27.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.928+0000 7f62f4e71640 1 -- 172.21.15.18:0/1778366897 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e4007070 con 0x7f62d8004800 2024-09-19T09:18:27.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.929+0000 7f62f80d7640 1 -- 172.21.15.18:0/1778366897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d8004800 msgr2=0x7f62d8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:27.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.929+0000 7f62f80d7640 1 --2- 172.21.15.18:0/1778366897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d8004800 0x7f62d8004c80 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f62e400c210 tx=0x7f62d8005830 comp rx=0 tx=0).stop 2024-09-19T09:18:27.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.929+0000 7f62f80d7640 1 -- 172.21.15.18:0/1778366897 shutdown_connections 2024-09-19T09:18:27.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.929+0000 7f62f80d7640 1 --2- 172.21.15.18:0/1778366897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62d8004800 0x7f62d8004c80 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.929+0000 7f62f80d7640 1 -- 172.21.15.18:0/1778366897 >> 172.21.15.18:0/1778366897 conn(0x7f62f006bc10 msgr2=0x7f62f006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:27.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.929+0000 7f62f80d7640 1 -- 172.21.15.18:0/1778366897 shutdown_connections 2024-09-19T09:18:27.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.929+0000 7f62f80d7640 1 -- 172.21.15.18:0/1778366897 wait complete. 2024-09-19T09:18:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.930+0000 7f62f80d7640 1 Processor -- start 2024-09-19T09:18:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.930+0000 7f62f80d7640 1 -- start start 2024-09-19T09:18:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.931+0000 7f62f80d7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62d8004800 0x7f62f00c6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.931+0000 7f62f80d7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f015e0c0 0x7f62f014ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.931+0000 7f62f80d7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62f015e540 0x7f62f014e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.931+0000 7f62f80d7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f62f015bcc0 con 0x7f62f015e0c0 2024-09-19T09:18:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.931+0000 7f62f80d7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f62f015bb40 con 0x7f62d8004800 2024-09-19T09:18:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.931+0000 7f62f80d7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f62f006dcc0 con 0x7f62f015e540 2024-09-19T09:18:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.931+0000 7f62f5672640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f015e0c0 0x7f62f014ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.931+0000 7f62f5672640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f015e0c0 0x7f62f014ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51368/0 (socket says 172.21.15.18:51368) 2024-09-19T09:18:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.931+0000 7f62f5672640 1 -- 172.21.15.18:0/3486092375 learned_addr learned my addr 172.21.15.18:0/3486092375 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:27.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.931+0000 7f62f6674640 1 --2- 172.21.15.18:0/3486092375 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62f015e540 0x7f62f014e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:27.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.931+0000 7f62f5e73640 1 --2- 172.21.15.18:0/3486092375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62d8004800 0x7f62f00c6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:27.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.931+0000 7f62f5672640 1 -- 172.21.15.18:0/3486092375 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62f015e540 msgr2=0x7f62f014e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:27.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.931+0000 7f62f5672640 1 --2- 172.21.15.18:0/3486092375 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62f015e540 0x7f62f014e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.931+0000 7f62f5672640 1 -- 172.21.15.18:0/3486092375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62d8004800 msgr2=0x7f62f00c6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:27.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.931+0000 7f62f5672640 1 --2- 172.21.15.18:0/3486092375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62d8004800 0x7f62f00c6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:27.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.931+0000 7f62f5672640 1 -- 172.21.15.18:0/3486092375 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f00c5960 con 0x7f62f015e0c0 2024-09-19T09:18:27.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.931+0000 7f62f6674640 1 --2- 172.21.15.18:0/3486092375 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62f015e540 0x7f62f014e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:27.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.932+0000 7f62f5672640 1 --2- 172.21.15.18:0/3486092375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f015e0c0 0x7f62f014ded0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f62e400c210 tx=0x7f62f00b4740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:27.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.932+0000 7f62ee7fc640 1 -- 172.21.15.18:0/3486092375 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e4040030 con 0x7f62f015e0c0 2024-09-19T09:18:27.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.932+0000 7f62ee7fc640 1 -- 172.21.15.18:0/3486092375 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62e4001430 con 0x7f62f015e0c0 2024-09-19T09:18:27.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.932+0000 7f62f80d7640 1 -- 172.21.15.18:0/3486092375 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62f00c5c40 con 0x7f62f015e0c0 2024-09-19T09:18:27.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.932+0000 7f62ee7fc640 1 -- 172.21.15.18:0/3486092375 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62e4037040 con 0x7f62f015e0c0 2024-09-19T09:18:27.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.932+0000 7f62f80d7640 1 -- 172.21.15.18:0/3486092375 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62f00c6200 con 0x7f62f015e0c0 2024-09-19T09:18:27.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.933+0000 7f62f80d7640 1 -- 172.21.15.18:0/3486092375 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62f00afa90 con 0x7f62f015e0c0 2024-09-19T09:18:27.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.933+0000 7f62ee7fc640 1 -- 172.21.15.18:0/3486092375 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f62e4043070 con 0x7f62f015e0c0 2024-09-19T09:18:27.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.934+0000 7f62ee7fc640 1 --2- 172.21.15.18:0/3486092375 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f62dc06c2b0 0x7f62dc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:27.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.934+0000 7f62ee7fc640 1 -- 172.21.15.18:0/3486092375 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f62e40aa830 con 0x7f62f015e0c0 2024-09-19T09:18:27.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.934+0000 7f62f5e73640 1 --2- 172.21.15.18:0/3486092375 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f62dc06c2b0 0x7f62dc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:27.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.934+0000 7f62f5e73640 1 --2- 172.21.15.18:0/3486092375 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f62dc06c2b0 0x7f62dc06e770 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f62f0077320 tx=0x7f62e8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:27.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:27.938+0000 7f62ee7fc640 1 -- 172.21.15.18:0/3486092375 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f62e404a020 con 0x7f62f015e0c0 2024-09-19T09:18:28.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.181+0000 7f62f80d7640 1 -- 172.21.15.18:0/3486092375 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f62f00728d0 con 0x7f62f015e0c0 2024-09-19T09:18:28.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.183+0000 7f62ee7fc640 1 -- 172.21.15.18:0/3486092375 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7f62e4078e70 con 0x7f62f015e0c0 2024-09-19T09:18:28.184 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-09-19T09:18:28.184 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAe6+tmcbwDNhAAaG0+wu96Locwws+h0zeh8Q== 2024-09-19T09:18:28.184 INFO:teuthology.orchestra.run.smithi018.stdout: caps mds = "allow" 2024-09-19T09:18:28.185 INFO:teuthology.orchestra.run.smithi018.stdout: caps mon = "allow r" 2024-09-19T09:18:28.185 INFO:teuthology.orchestra.run.smithi018.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-19T09:18:28.185 INFO:teuthology.orchestra.run.smithi018.stderr:updated caps for client.0 2024-09-19T09:18:28.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.186+0000 7f62f80d7640 1 -- 172.21.15.18:0/3486092375 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f62dc06c2b0 msgr2=0x7f62dc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:28.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.186+0000 7f62f80d7640 1 --2- 172.21.15.18:0/3486092375 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f62dc06c2b0 0x7f62dc06e770 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f62f0077320 tx=0x7f62e8009190 comp rx=0 tx=0).stop 2024-09-19T09:18:28.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.186+0000 7f62f80d7640 1 -- 172.21.15.18:0/3486092375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f015e0c0 msgr2=0x7f62f014ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:28.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.186+0000 7f62f80d7640 1 --2- 172.21.15.18:0/3486092375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f015e0c0 0x7f62f014ded0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f62e400c210 tx=0x7f62f00b4740 comp rx=0 tx=0).stop 2024-09-19T09:18:28.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.186+0000 7f62f80d7640 1 -- 172.21.15.18:0/3486092375 shutdown_connections 2024-09-19T09:18:28.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.186+0000 7f62f80d7640 1 --2- 172.21.15.18:0/3486092375 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f62dc06c2b0 0x7f62dc06e770 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:28.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.186+0000 7f62f80d7640 1 --2- 172.21.15.18:0/3486092375 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f62f015e540 0x7f62f014e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:28.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.186+0000 7f62f80d7640 1 --2- 172.21.15.18:0/3486092375 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f62f015e0c0 0x7f62f014ded0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:28.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.186+0000 7f62f80d7640 1 --2- 172.21.15.18:0/3486092375 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f62d8004800 0x7f62f00c6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:28.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.186+0000 7f62f80d7640 1 -- 172.21.15.18:0/3486092375 >> 172.21.15.18:0/3486092375 conn(0x7f62f006bc10 msgr2=0x7f62f00b04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:28.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.186+0000 7f62f80d7640 1 -- 172.21.15.18:0/3486092375 shutdown_connections 2024-09-19T09:18:28.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.186+0000 7f62f80d7640 1 -- 172.21.15.18:0/3486092375 wait complete. 2024-09-19T09:18:28.197 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:18:28.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.299+0000 7fe5ff81e640 1 Processor -- start 2024-09-19T09:18:28.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.299+0000 7fe5ff81e640 1 -- start start 2024-09-19T09:18:28.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.300+0000 7fe5ff81e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe5f8072620 0x7fe5f80cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:28.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.300+0000 7fe5ff81e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe5f8073110 0x7fe5f80b5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:28.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.300+0000 7fe5ff81e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5f815ce70 con 0x7fe5f815c990 2024-09-19T09:18:28.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.300+0000 7fe5ff81e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fe5f80b4c50 con 0x7fe5f8072620 2024-09-19T09:18:28.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.300+0000 7fe5ff81e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe5f806f2a0 con 0x7fe5f8073110 2024-09-19T09:18:28.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.300+0000 7fe5fd5ba640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe5f8072620 0x7fe5f80cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:28.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.300+0000 7fe5fcdb9640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe5f815c990 0x7fe5f8072a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33378/0 (socket says 172.21.15.18:33378) 2024-09-19T09:18:28.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.300+0000 7fe5fcdb9640 1 -- 172.21.15.18:0/2002612481 learned_addr learned my addr 172.21.15.18:0/2002612481 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:28.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.301+0000 7fe5fd5ba640 1 -- 172.21.15.18:0/2002612481 >> v2:172.21.15.162:3300/0 conn(0x7fe5f8073110 msgr2=0x7fe5f80b5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:28.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.301+0000 7fe5fddbb640 1 --2- 172.21.15.18:0/2002612481 >> v2:172.21.15.162:3300/0 conn(0x7fe5f8073110 0x7fe5f80b5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:28.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.301+0000 7fe5fd5ba640 1 --2- 172.21.15.18:0/2002612481 >> v2:172.21.15.162:3300/0 conn(0x7fe5f8073110 0x7fe5f80b5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:28.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.301+0000 7fe5f7fff640 1 -- 172.21.15.18:0/2002612481 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2041366702 0 0) 0x7fe5f815ce70 con 0x7fe5f815c990 2024-09-19T09:18:28.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.301+0000 7fe5fd5ba640 1 -- 172.21.15.18:0/2002612481 >> v1:172.21.15.18:6789/0 conn(0x7fe5f815c990 legacy=0x7fe5f8072a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:28.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.301+0000 7fe5fd5ba640 1 -- 172.21.15.18:0/2002612481 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f806f580 con 0x7fe5f8072620 2024-09-19T09:18:28.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.301+0000 7fe5fddbb640 1 --2- 172.21.15.18:0/2002612481 >> v2:172.21.15.162:3300/0 conn(0x7fe5f8073110 0x7fe5f80b5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:28.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.301+0000 7fe5fd5ba640 1 --2- 172.21.15.18:0/2002612481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f8072620 0x7fe5f80cf870 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe5f806db60 tx=0x7fe5e802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69419e85011795a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:28.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.302+0000 7fe5f7fff640 1 -- 172.21.15.18:0/2002612481 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e8007740 con 0x7fe5f8072620 2024-09-19T09:18:28.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.302+0000 7fe5f7fff640 1 -- 172.21.15.18:0/2002612481 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5e80078e0 con 0x7fe5f8072620 2024-09-19T09:18:28.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.302+0000 7fe5f7fff640 1 -- 172.21.15.18:0/2002612481 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5e8007cb0 con 0x7fe5f8072620 2024-09-19T09:18:28.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.302+0000 7fe5ff81e640 1 -- 172.21.15.18:0/2002612481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f8072620 msgr2=0x7fe5f80cf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:28.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.302+0000 7fe5ff81e640 1 --2- 172.21.15.18:0/2002612481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f8072620 0x7fe5f80cf870 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe5f806db60 tx=0x7fe5e802a680 comp rx=0 tx=0).stop 2024-09-19T09:18:28.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.302+0000 7fe5ff81e640 1 -- 172.21.15.18:0/2002612481 shutdown_connections 2024-09-19T09:18:28.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.302+0000 7fe5ff81e640 1 --2- 172.21.15.18:0/2002612481 >> v2:172.21.15.162:3300/0 conn(0x7fe5f8073110 0x7fe5f80b5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:28.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.302+0000 7fe5ff81e640 1 --2- 172.21.15.18:0/2002612481 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f8072620 0x7fe5f80cf870 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:28.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.302+0000 7fe5ff81e640 1 -- 172.21.15.18:0/2002612481 >> 172.21.15.18:0/2002612481 conn(0x7fe5f806cd20 msgr2=0x7fe5f806d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:28.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.302+0000 7fe5ff81e640 1 -- 172.21.15.18:0/2002612481 shutdown_connections 2024-09-19T09:18:28.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.302+0000 7fe5ff81e640 1 -- 172.21.15.18:0/2002612481 wait complete. 2024-09-19T09:18:28.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.303+0000 7fe5ff81e640 1 Processor -- start 2024-09-19T09:18:28.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.303+0000 7fe5ff81e640 1 -- start start 2024-09-19T09:18:28.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.304+0000 7fe5ff81e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5f8072620 0x7fe5f815b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:28.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.304+0000 7fe5ff81e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f8073110 0x7fe5f80d0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:28.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.304+0000 7fe5ff81e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5f815c990 0x7fe5f80d0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:28.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.304+0000 7fe5ff81e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f81456b0 con 0x7fe5f8073110 2024-09-19T09:18:28.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.304+0000 7fe5ff81e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f80b56a0 con 0x7fe5f8072620 2024-09-19T09:18:28.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.304+0000 7fe5ff81e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe5f8145830 con 0x7fe5f815c990 2024-09-19T09:18:28.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.304+0000 7fe5fcdb9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f8073110 0x7fe5f80d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:28.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.304+0000 7fe5fcdb9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f8073110 0x7fe5f80d0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51396/0 (socket says 172.21.15.18:51396) 2024-09-19T09:18:28.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.304+0000 7fe5fcdb9640 1 -- 172.21.15.18:0/3063577008 learned_addr learned my addr 172.21.15.18:0/3063577008 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:28.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.305+0000 7fe5fd5ba640 1 --2- 172.21.15.18:0/3063577008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5f8072620 0x7fe5f815b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:28.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.305+0000 7fe5fddbb640 1 --2- 172.21.15.18:0/3063577008 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5f815c990 0x7fe5f80d0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:28.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.305+0000 7fe5fcdb9640 1 -- 172.21.15.18:0/3063577008 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5f815c990 msgr2=0x7fe5f80d0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:28.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.305+0000 7fe5fcdb9640 1 --2- 172.21.15.18:0/3063577008 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5f815c990 0x7fe5f80d0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:28.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.305+0000 7fe5fcdb9640 1 -- 172.21.15.18:0/3063577008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5f8072620 msgr2=0x7fe5f815b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:28.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.305+0000 7fe5fcdb9640 1 --2- 172.21.15.18:0/3063577008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5f8072620 0x7fe5f815b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:28.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.305+0000 7fe5fcdb9640 1 -- 172.21.15.18:0/3063577008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f8143b50 con 0x7fe5f8073110 2024-09-19T09:18:28.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.305+0000 7fe5fd5ba640 1 --2- 172.21.15.18:0/3063577008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5f8072620 0x7fe5f815b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:28.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.305+0000 7fe5fddbb640 1 --2- 172.21.15.18:0/3063577008 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5f815c990 0x7fe5f80d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:28.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.305+0000 7fe5fcdb9640 1 --2- 172.21.15.18:0/3063577008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f8073110 0x7fe5f80d0130 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec00c430 tx=0x7fe5ec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:28.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.305+0000 7fe5f5ffb640 1 -- 172.21.15.18:0/3063577008 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec0074e0 con 0x7fe5f8073110 2024-09-19T09:18:28.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.305+0000 7fe5f5ffb640 1 -- 172.21.15.18:0/3063577008 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5ec0047e0 con 0x7fe5f8073110 2024-09-19T09:18:28.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.305+0000 7fe5ff81e640 1 -- 172.21.15.18:0/3063577008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5f815f910 con 0x7fe5f8073110 2024-09-19T09:18:28.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.305+0000 7fe5f5ffb640 1 -- 172.21.15.18:0/3063577008 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec004bd0 con 0x7fe5f8073110 2024-09-19T09:18:28.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.305+0000 7fe5ff81e640 1 -- 172.21.15.18:0/3063577008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5f80aebc0 con 0x7fe5f8073110 2024-09-19T09:18:28.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.306+0000 7fe5ff81e640 1 -- 172.21.15.18:0/3063577008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5f806e550 con 0x7fe5f8073110 2024-09-19T09:18:28.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.307+0000 7fe5f5ffb640 1 -- 172.21.15.18:0/3063577008 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe5ec011070 con 0x7fe5f8073110 2024-09-19T09:18:28.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.307+0000 7fe5f5ffb640 1 --2- 172.21.15.18:0/3063577008 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe5e406c2e0 0x7fe5e406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:28.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.308+0000 7fe5f5ffb640 1 -- 172.21.15.18:0/3063577008 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fe5ec08b060 con 0x7fe5f8073110 2024-09-19T09:18:28.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.308+0000 7fe5fd5ba640 1 --2- 172.21.15.18:0/3063577008 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe5e406c2e0 0x7fe5e406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:28.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.308+0000 7fe5fd5ba640 1 --2- 172.21.15.18:0/3063577008 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe5e406c2e0 0x7fe5e406e7a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8034000 tx=0x7fe5e802f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:28.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.312+0000 7fe5f5ffb640 1 -- 172.21.15.18:0/3063577008 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe5ec00e280 con 0x7fe5f8073110 2024-09-19T09:18:28.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.524+0000 7fe5ff81e640 1 -- 172.21.15.18:0/3063577008 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe5f80d0f60 con 0x7fe5f8073110 2024-09-19T09:18:28.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.525+0000 7fe5f5ffb640 1 -- 172.21.15.18:0/3063577008 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5225 (secure 0 0 0) 0x7fe5ec0597d0 con 0x7fe5f8073110 2024-09-19T09:18:28.525 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:28.526 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":42,"btime":"2024-09-19T09:18:26:440614+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5944,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/935732637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":935732637},{"type":"v1","addr":"172.21.15.162:6836","nonce":935732637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6192,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3186899169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":3186899169},{"type":"v1","addr":"172.21.15.18:6835","nonce":3186899169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6195,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/3889971648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3889971648},{"type":"v1","addr":"172.21.15.18:6834","nonce":3889971648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:18:23.782156+0000","modified":"2024-09-19T09:18:25.789778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"d","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6837/133611430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":133611430},{"type":"v1","addr":"172.21.15.162:6837","nonce":133611430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6207,"qdb_cluster":[6207]},"id":6}]} 2024-09-19T09:18:28.526 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 42 2024-09-19T09:18:28.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.527+0000 7fe5ff81e640 1 -- 172.21.15.18:0/3063577008 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe5e406c2e0 msgr2=0x7fe5e406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:28.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.527+0000 7fe5ff81e640 1 --2- 172.21.15.18:0/3063577008 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe5e406c2e0 0x7fe5e406e7a0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8034000 tx=0x7fe5e802f000 comp rx=0 tx=0).stop 2024-09-19T09:18:28.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.527+0000 7fe5ff81e640 1 -- 172.21.15.18:0/3063577008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f8073110 msgr2=0x7fe5f80d0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:28.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.527+0000 7fe5ff81e640 1 --2- 172.21.15.18:0/3063577008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f8073110 0x7fe5f80d0130 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec00c430 tx=0x7fe5ec00c8f0 comp rx=0 tx=0).stop 2024-09-19T09:18:28.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.527+0000 7fe5ff81e640 1 -- 172.21.15.18:0/3063577008 shutdown_connections 2024-09-19T09:18:28.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.527+0000 7fe5ff81e640 1 --2- 172.21.15.18:0/3063577008 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe5e406c2e0 0x7fe5e406e7a0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:28.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.527+0000 7fe5ff81e640 1 --2- 172.21.15.18:0/3063577008 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5f815c990 0x7fe5f80d0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:28.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.527+0000 7fe5ff81e640 1 --2- 172.21.15.18:0/3063577008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5f8073110 0x7fe5f80d0130 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:28.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.527+0000 7fe5ff81e640 1 --2- 172.21.15.18:0/3063577008 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5f8072620 0x7fe5f815b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:28.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.527+0000 7fe5ff81e640 1 -- 172.21.15.18:0/3063577008 >> 172.21.15.18:0/3063577008 conn(0x7fe5f806cd20 msgr2=0x7fe5f8072a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:28.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.527+0000 7fe5ff81e640 1 -- 172.21.15.18:0/3063577008 shutdown_connections 2024-09-19T09:18:28.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:28.527+0000 7fe5ff81e640 1 -- 172.21.15.18:0/3063577008 wait complete. 2024-09-19T09:18:28.941 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 42, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T09:18:23.782156+0000', 'modified': '2024-09-19T09:18:25.789778+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6207}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6207': {'gid': 6207, 'name': 'd', 'rank': 0, 'incarnation': 40, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.162:6837/133611430', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6835', 'nonce': 133611430}, {'type': 'v1', 'addr': '172.21.15.162:6837', 'nonce': 133611430}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6207, 'qdb_cluster': [6207]} 2024-09-19T09:18:28.941 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T09:18:28.941 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-19T09:18:29.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.048+0000 7f3305ef1640 1 Processor -- start 2024-09-19T09:18:29.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.049+0000 7f3305ef1640 1 -- start start 2024-09-19T09:18:29.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.049+0000 7f3305ef1640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f330015eda0 0x7f33000d5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:29.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.049+0000 7f3305ef1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33000d1630 0x7f33000d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:29.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.049+0000 7f3305ef1640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33000d3cc0 con 0x7f33000d0480 2024-09-19T09:18:29.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.049+0000 7f3305ef1640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f33000d2880 con 0x7f330015eda0 2024-09-19T09:18:29.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.049+0000 7f3305ef1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f33000d3120 con 0x7f33000d1630 2024-09-19T09:18:29.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.049+0000 7f32feffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f33000d0480 0x7f33000d35b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33382/0 (socket says 172.21.15.18:33382) 2024-09-19T09:18:29.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.049+0000 7f32feffd640 1 -- 172.21.15.18:0/1103258735 learned_addr learned my addr 172.21.15.18:0/1103258735 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:29.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.050+0000 7f32fe7fc640 1 -- 172.21.15.18:0/1103258735 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2115881599 0 0) 0x7f33000d3cc0 con 0x7f33000d0480 2024-09-19T09:18:29.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.050+0000 7f32fe7fc640 1 -- 172.21.15.18:0/1103258735 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32e8003520 con 0x7f33000d0480 2024-09-19T09:18:29.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.050+0000 7f32ff7fe640 1 --2- 172.21.15.18:0/1103258735 >> v2:172.21.15.162:3300/0 conn(0x7f330015eda0 0x7f33000d5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:29.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.050+0000 7f32fffff640 1 --2- 172.21.15.18:0/1103258735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33000d1630 0x7f33000d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:29.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.050+0000 7f32fe7fc640 1 -- 172.21.15.18:0/1103258735 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1315033843 0 0) 0x7f32e8003520 con 0x7f33000d0480 2024-09-19T09:18:29.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.050+0000 7f32fe7fc640 1 -- 172.21.15.18:0/1103258735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33000d1630 msgr2=0x7f33000d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:29.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.050+0000 7f32fe7fc640 1 --2- 172.21.15.18:0/1103258735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33000d1630 0x7f33000d1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.050+0000 7f32fe7fc640 1 -- 172.21.15.18:0/1103258735 >> v2:172.21.15.162:3300/0 conn(0x7f330015eda0 msgr2=0x7f33000d5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:29.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.050+0000 7f32fe7fc640 1 --2- 172.21.15.18:0/1103258735 >> v2:172.21.15.162:3300/0 conn(0x7f330015eda0 0x7f33000d5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.050+0000 7f32fe7fc640 1 -- 172.21.15.18:0/1103258735 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33000d0bf0 con 0x7f33000d0480 2024-09-19T09:18:29.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.050+0000 7f32fe7fc640 1 -- 172.21.15.18:0/1103258735 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f32f4001670 con 0x7f33000d0480 2024-09-19T09:18:29.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.050+0000 7f32fe7fc640 1 -- 172.21.15.18:0/1103258735 >> v1:172.21.15.18:6789/0 conn(0x7f33000d0480 legacy=0x7f33000d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:29.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.050+0000 7f32fe7fc640 1 --2- 172.21.15.18:0/1103258735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33000d1630 0x7f32e80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:29.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.050+0000 7f32fe7fc640 1 --2- 172.21.15.18:0/1103258735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32e8003f30 0x7f32e8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:29.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.050+0000 7f32fe7fc640 1 --2- 172.21.15.18:0/1103258735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32e8004d40 0x7f32e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:29.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.050+0000 7f32fe7fc640 1 -- 172.21.15.18:0/1103258735 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f33000d2880 con 0x7f32e8004d40 2024-09-19T09:18:29.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.050+0000 7f32fe7fc640 1 -- 172.21.15.18:0/1103258735 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f33000d3120 con 0x7f32e8003f30 2024-09-19T09:18:29.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.050+0000 7f32fe7fc640 1 -- 172.21.15.18:0/1103258735 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f32e800b9c0 con 0x7f33000d1630 2024-09-19T09:18:29.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.050+0000 7f32fffff640 1 --2- 172.21.15.18:0/1103258735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32e8004d40 0x7f32e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:29.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.050+0000 7f32feffd640 1 --2- 172.21.15.18:0/1103258735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32e8003f30 0x7f32e8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:29.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.050+0000 7f32ff7fe640 1 --2- 172.21.15.18:0/1103258735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33000d1630 0x7f32e80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:29.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.051+0000 7f32fffff640 1 -- 172.21.15.18:0/1103258735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33000d1630 msgr2=0x7f32e80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:29.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.051+0000 7f32fffff640 1 --2- 172.21.15.18:0/1103258735 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f33000d1630 0x7f32e80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.051+0000 7f32fffff640 1 -- 172.21.15.18:0/1103258735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32e8003f30 msgr2=0x7f32e8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:29.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.051+0000 7f32fffff640 1 --2- 172.21.15.18:0/1103258735 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f32e8003f30 0x7f32e8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.051+0000 7f32fffff640 1 -- 172.21.15.18:0/1103258735 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e8003520 con 0x7f32e8004d40 2024-09-19T09:18:29.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.051+0000 7f32fffff640 1 --2- 172.21.15.18:0/1103258735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32e8004d40 0x7f32e80051c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f32f8009fc0 tx=0x7f32e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27b76a0456836c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:29.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.051+0000 7f32fe7fc640 1 -- 172.21.15.18:0/1103258735 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f8009c10 con 0x7f32e8004d40 2024-09-19T09:18:29.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.052+0000 7f32fe7fc640 1 -- 172.21.15.18:0/1103258735 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f8036070 con 0x7f32e8004d40 2024-09-19T09:18:29.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.052+0000 7f32fe7fc640 1 -- 172.21.15.18:0/1103258735 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f8031670 con 0x7f32e8004d40 2024-09-19T09:18:29.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.052+0000 7f3305ef1640 1 -- 172.21.15.18:0/1103258735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32e8004d40 msgr2=0x7f32e80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:29.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.052+0000 7f3305ef1640 1 --2- 172.21.15.18:0/1103258735 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f32e8004d40 0x7f32e80051c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f32f8009fc0 tx=0x7f32e8005830 comp rx=0 tx=0).stop 2024-09-19T09:18:29.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.052+0000 7f32fffff640 1 -- 172.21.15.18:0/1103258735 reap_dead start 2024-09-19T09:18:29.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.052+0000 7f3305ef1640 1 -- 172.21.15.18:0/1103258735 shutdown_connections 2024-09-19T09:18:29.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.052+0000 7f3305ef1640 1 -- 172.21.15.18:0/1103258735 >> 172.21.15.18:0/1103258735 conn(0x7f330009df40 msgr2=0x7f33000d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:29.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.052+0000 7f3305ef1640 1 -- 172.21.15.18:0/1103258735 shutdown_connections 2024-09-19T09:18:29.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.052+0000 7f3305ef1640 1 -- 172.21.15.18:0/1103258735 wait complete. 2024-09-19T09:18:29.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.053+0000 7f3305ef1640 1 Processor -- start 2024-09-19T09:18:29.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.053+0000 7f3305ef1640 1 -- start start 2024-09-19T09:18:29.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.054+0000 7f3305ef1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f330009f630 0x7f33000cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:29.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.054+0000 7f3305ef1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33000cb700 0x7f33000a1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:29.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.054+0000 7f3305ef1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f330009fa10 0x7f33000a24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:29.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.054+0000 7f3305ef1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f33000d08f0 con 0x7f33000cb700 2024-09-19T09:18:29.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.054+0000 7f3305ef1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f33000d2db0 con 0x7f330009fa10 2024-09-19T09:18:29.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.054+0000 7f3305ef1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f330015f180 con 0x7f330009f630 2024-09-19T09:18:29.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.054+0000 7f32feffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33000cb700 0x7f33000a1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:29.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.054+0000 7f32feffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33000cb700 0x7f33000a1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51418/0 (socket says 172.21.15.18:51418) 2024-09-19T09:18:29.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.054+0000 7f32feffd640 1 -- 172.21.15.18:0/2222118485 learned_addr learned my addr 172.21.15.18:0/2222118485 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:29.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.054+0000 7f32ff7fe640 1 --2- 172.21.15.18:0/2222118485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f330009f630 0x7f33000cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:29.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.055+0000 7f32fffff640 1 --2- 172.21.15.18:0/2222118485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f330009fa10 0x7f33000a24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:29.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.055+0000 7f32feffd640 1 -- 172.21.15.18:0/2222118485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f330009f630 msgr2=0x7f33000cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:29.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.055+0000 7f32feffd640 1 --2- 172.21.15.18:0/2222118485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f330009f630 0x7f33000cb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.055+0000 7f32feffd640 1 -- 172.21.15.18:0/2222118485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f330009fa10 msgr2=0x7f33000a24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:29.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.055+0000 7f32feffd640 1 --2- 172.21.15.18:0/2222118485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f330009fa10 0x7f33000a24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.055+0000 7f32feffd640 1 -- 172.21.15.18:0/2222118485 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33000ca120 con 0x7f33000cb700 2024-09-19T09:18:29.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.055+0000 7f32fffff640 1 --2- 172.21.15.18:0/2222118485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f330009fa10 0x7f33000a24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:29.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.055+0000 7f32feffd640 1 --2- 172.21.15.18:0/2222118485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33000cb700 0x7f33000a1fb0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f32f40072c0 tx=0x7f32f4007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:29.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.055+0000 7f32e7fff640 1 -- 172.21.15.18:0/2222118485 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f401a070 con 0x7f33000cb700 2024-09-19T09:18:29.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.055+0000 7f32e7fff640 1 -- 172.21.15.18:0/2222118485 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f400f960 con 0x7f33000cb700 2024-09-19T09:18:29.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.055+0000 7f3305ef1640 1 -- 172.21.15.18:0/2222118485 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33000ca400 con 0x7f33000cb700 2024-09-19T09:18:29.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.055+0000 7f32e7fff640 1 -- 172.21.15.18:0/2222118485 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f400fd50 con 0x7f33000cb700 2024-09-19T09:18:29.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.055+0000 7f3305ef1640 1 -- 172.21.15.18:0/2222118485 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33000ca9c0 con 0x7f33000cb700 2024-09-19T09:18:29.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.056+0000 7f32e7fff640 1 -- 172.21.15.18:0/2222118485 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f32f401d070 con 0x7f33000cb700 2024-09-19T09:18:29.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.057+0000 7f32e7fff640 1 --2- 172.21.15.18:0/2222118485 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f32ec06c2b0 0x7f32ec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:29.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.057+0000 7f32e7fff640 1 -- 172.21.15.18:0/2222118485 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f32f408af20 con 0x7f33000cb700 2024-09-19T09:18:29.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.057+0000 7f32ff7fe640 1 --2- 172.21.15.18:0/2222118485 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f32ec06c2b0 0x7f32ec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:29.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.058+0000 7f32ff7fe640 1 --2- 172.21.15.18:0/2222118485 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f32ec06c2b0 0x7f32ec06e770 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f32f0009b80 tx=0x7f32f0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:29.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.058+0000 7f3308c8b740 1 Processor -- start 2024-09-19T09:18:29.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.058+0000 7f3308c8b740 1 -- start start 2024-09-19T09:18:29.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.059+0000 7f3308c8b740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5633da0252c0 0x5633da06aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:29.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.059+0000 7f3308c8b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633da022a80 0x5633da0256a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:29.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.059+0000 7f3308c8b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633da026a50 0x5633da01f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:29.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.059+0000 7f3308c8b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5633d9f87520 con 0x5633da026a50 2024-09-19T09:18:29.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.059+0000 7f3308c8b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5633d9f2f3e0 con 0x5633da022a80 2024-09-19T09:18:29.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.059+0000 7f3308c8b740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5633d9f834e0 con 0x5633da0252c0 2024-09-19T09:18:29.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.059+0000 7f32fffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633da026a50 0x5633da01f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:29.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.059+0000 7f32fffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633da026a50 0x5633da01f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51420/0 (socket says 172.21.15.18:51420) 2024-09-19T09:18:29.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.059+0000 7f32fffff640 1 -- 172.21.15.18:0/751324247 learned_addr learned my addr 172.21.15.18:0/751324247 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:29.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.059+0000 7f32ff7fe640 1 --2- 172.21.15.18:0/751324247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5633da0252c0 0x5633da06aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:29.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.059+0000 7f32feffd640 1 --2- 172.21.15.18:0/751324247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633da022a80 0x5633da0256a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:29.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.059+0000 7f32fffff640 1 -- 172.21.15.18:0/751324247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5633da0252c0 msgr2=0x5633da06aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:29.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.059+0000 7f32fffff640 1 --2- 172.21.15.18:0/751324247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5633da0252c0 0x5633da06aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.059+0000 7f32fffff640 1 -- 172.21.15.18:0/751324247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633da022a80 msgr2=0x5633da0256a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:29.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.059+0000 7f32fffff640 1 --2- 172.21.15.18:0/751324247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633da022a80 0x5633da0256a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.059+0000 7f32fffff640 1 -- 172.21.15.18:0/751324247 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633d9f4a2f0 con 0x5633da026a50 2024-09-19T09:18:29.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.060+0000 7f32fffff640 1 --2- 172.21.15.18:0/751324247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633da026a50 0x5633da01f8b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f32f800e200 tx=0x7f32f802d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c666396faabd40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:29.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.060+0000 7f32e57fa640 1 -- 172.21.15.18:0/751324247 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f8003990 con 0x5633da026a50 2024-09-19T09:18:29.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.060+0000 7f32e57fa640 1 -- 172.21.15.18:0/751324247 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f803f070 con 0x5633da026a50 2024-09-19T09:18:29.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.060+0000 7f32e57fa640 1 -- 172.21.15.18:0/751324247 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f8003d70 con 0x5633da026a50 2024-09-19T09:18:29.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.060+0000 7f3308c8b740 1 -- 172.21.15.18:0/751324247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633da026a50 msgr2=0x5633da01f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:29.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.060+0000 7f3308c8b740 1 --2- 172.21.15.18:0/751324247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633da026a50 0x5633da01f8b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f32f800e200 tx=0x7f32f802d000 comp rx=0 tx=0).stop 2024-09-19T09:18:29.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.060+0000 7f3308c8b740 1 -- 172.21.15.18:0/751324247 shutdown_connections 2024-09-19T09:18:29.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.060+0000 7f3308c8b740 1 --2- 172.21.15.18:0/751324247 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633da026a50 0x5633da01f8b0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.060+0000 7f3308c8b740 1 --2- 172.21.15.18:0/751324247 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633da022a80 0x5633da0256a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.060+0000 7f3308c8b740 1 --2- 172.21.15.18:0/751324247 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5633da0252c0 0x5633da06aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.060+0000 7f3308c8b740 1 -- 172.21.15.18:0/751324247 >> 172.21.15.18:0/751324247 conn(0x5633da021a80 msgr2=0x5633da069f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:29.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.060+0000 7f3308c8b740 1 -- 172.21.15.18:0/751324247 shutdown_connections 2024-09-19T09:18:29.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.061+0000 7f3308c8b740 1 -- 172.21.15.18:0/751324247 wait complete. 2024-09-19T09:18:29.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.061+0000 7f3308c8b740 1 -- start start 2024-09-19T09:18:29.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.061+0000 7f3308c8b740 1 Processor -- start 2024-09-19T09:18:29.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.062+0000 7f3308c8b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633da0252c0 0x5633da046370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:29.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.062+0000 7f3308c8b740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5633da026a50 0x5633da01f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:29.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.062+0000 7f3308c8b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633da06d660 0x5633da06dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:29.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.062+0000 7f3308c8b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5633da020f20 con 0x5633da0252c0 2024-09-19T09:18:29.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.062+0000 7f3308c8b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5633d9f10450 con 0x5633da06d660 2024-09-19T09:18:29.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.062+0000 7f3308c8b740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5633da06b290 con 0x5633da026a50 2024-09-19T09:18:29.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.062+0000 7f3308c8b740 10 client.0 _ll_register_callbacks cb 0x5633d9c99ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:29.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.062+0000 7f32ff7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633da0252c0 0x5633da046370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:29.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.062+0000 7f32ff7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633da0252c0 0x5633da046370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51428/0 (socket says 172.21.15.18:51428) 2024-09-19T09:18:29.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.062+0000 7f32ff7fe640 1 -- 172.21.15.18:0/892745853 learned_addr learned my addr 172.21.15.18:0/892745853 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:29.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.062+0000 7f32feffd640 1 --2- 172.21.15.18:0/892745853 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5633da026a50 0x5633da01f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:29.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.062+0000 7f32fffff640 1 --2- 172.21.15.18:0/892745853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633da06d660 0x5633da06dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:29.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.062+0000 7f32ff7fe640 1 -- 172.21.15.18:0/892745853 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5633da026a50 msgr2=0x5633da01f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:29.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.062+0000 7f32ff7fe640 1 --2- 172.21.15.18:0/892745853 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5633da026a50 0x5633da01f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.062+0000 7f32ff7fe640 1 -- 172.21.15.18:0/892745853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633da06d660 msgr2=0x5633da06dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:29.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.062+0000 7f32ff7fe640 1 --2- 172.21.15.18:0/892745853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633da06d660 0x5633da06dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.062+0000 7f32ff7fe640 1 -- 172.21.15.18:0/892745853 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633d9c9a2d0 con 0x5633da0252c0 2024-09-19T09:18:29.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.062+0000 7f32fffff640 1 --2- 172.21.15.18:0/892745853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633da06d660 0x5633da06dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:29.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.062+0000 7f32ff7fe640 1 --2- 172.21.15.18:0/892745853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633da0252c0 0x5633da046370 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f32f0016a90 tx=0x7f32f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bcd4f32b8e06c53 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:29.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.062+0000 7f32de7fc640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:18:29.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.063+0000 7f32de7fc640 1 -- 172.21.15.18:0/892745853 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f0023c10 con 0x5633da0252c0 2024-09-19T09:18:29.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.063+0000 7f32de7fc640 1 -- 172.21.15.18:0/892745853 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f32f0023db0 con 0x5633da0252c0 2024-09-19T09:18:29.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.063+0000 7f3308c8b740 1 -- 172.21.15.18:0/892745853 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32f803f070 con 0x5633da0252c0 2024-09-19T09:18:29.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.063+0000 7f32de7fc640 1 -- 172.21.15.18:0/892745853 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f32f0036050 con 0x5633da0252c0 2024-09-19T09:18:29.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.063+0000 7f3308c8b740 10 client.6315 fetch_fsmap learned FSMap version 42 2024-09-19T09:18:29.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.063+0000 7f3308c8b740 1 -- 172.21.15.18:0/892745853 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) -- 0x5633d9d646b0 con 0x5633da0252c0 2024-09-19T09:18:29.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.063+0000 7f32de7fc640 1 -- 172.21.15.18:0/892745853 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f803f070 con 0x5633da0252c0 2024-09-19T09:18:29.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.063+0000 7f32de7fc640 1 -- 172.21.15.18:0/892745853 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 42) ==== 3502+0+0 (secure 0 0 0) 0x7f32f0039020 con 0x5633da0252c0 2024-09-19T09:18:29.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.063+0000 7f3308c8b740 10 client.6315 fetch_fsmap finished waiting for FSMap version 42 2024-09-19T09:18:29.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.063+0000 7f3308c8b740 10 client.6315 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-19T09:18:29.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.063+0000 7f3308c8b740 20 client.6315 populate_metadata read hostname 'smithi018' 2024-09-19T09:18:29.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.063+0000 7f3308c8b740 1 --2- 172.21.15.18:0/892745853 >> [v2:172.21.15.162:6835/133611430,v1:172.21.15.162:6837/133611430] conn(0x5633da04d040 0x5633da04d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:29.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.063+0000 7f3308c8b740 4 client.6315 mds_command: new command op to 6207 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:18:29.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.063+0000 7f3308c8b740 1 -- 172.21.15.18:0/892745853 --> [v2:172.21.15.162:6835/133611430,v1:172.21.15.162:6837/133611430] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633d9f94c50 con 0x5633da04d040 2024-09-19T09:18:29.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.063+0000 7f32feffd640 1 --2- 172.21.15.18:0/892745853 >> [v2:172.21.15.162:6835/133611430,v1:172.21.15.162:6837/133611430] conn(0x5633da04d040 0x5633da04d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:29.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.064+0000 7f32de7fc640 10 client.6315 ms_handle_connect on v2:172.21.15.162:6835/133611430 2024-09-19T09:18:29.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.064+0000 7f32feffd640 1 --2- 172.21.15.18:0/892745853 >> [v2:172.21.15.162:6835/133611430,v1:172.21.15.162:6837/133611430] conn(0x5633da04d040 0x5633da04d420 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=103bac8d3a8c5a0f server_cookie=5f45dd8eca93a0a9 in_seq=0 out_seq=0 2024-09-19T09:18:29.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.065+0000 7f32de7fc640 1 -- 172.21.15.18:0/892745853 <== mds.0 v2:172.21.15.162:6835/133611430 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5633d9f94c50 con 0x5633da04d040 2024-09-19T09:18:29.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.065+0000 7f32de7fc640 10 client.6315 handle_command_reply: tid=0 2024-09-19T09:18:29.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.065+0000 7f3308c8b740 1 client.6315 shutdown 2024-09-19T09:18:29.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.065+0000 7f3308c8b740 1 -- 172.21.15.18:0/892745853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633da0252c0 msgr2=0x5633da046370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:29.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.065+0000 7f3308c8b740 1 --2- 172.21.15.18:0/892745853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633da0252c0 0x5633da046370 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f32f0016a90 tx=0x7f32f0004730 comp rx=0 tx=0).stop 2024-09-19T09:18:29.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.065+0000 7f3308c8b740 1 -- 172.21.15.18:0/892745853 shutdown_connections 2024-09-19T09:18:29.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.065+0000 7f3308c8b740 1 --2- 172.21.15.18:0/892745853 >> [v2:172.21.15.162:6835/133611430,v1:172.21.15.162:6837/133611430] conn(0x5633da04d040 0x5633da04d420 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.065+0000 7f3308c8b740 1 --2- 172.21.15.18:0/892745853 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633da06d660 0x5633da06dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.065+0000 7f3308c8b740 1 --2- 172.21.15.18:0/892745853 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5633da026a50 0x5633da01f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.065+0000 7f32de7fc640 0 client.6315 ms_handle_reset on v2:172.21.15.162:6835/133611430 2024-09-19T09:18:29.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.065+0000 7f3308c8b740 1 --2- 172.21.15.18:0/892745853 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633da0252c0 0x5633da046370 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.065+0000 7f3308c8b740 1 -- 172.21.15.18:0/892745853 >> 172.21.15.18:0/892745853 conn(0x5633da022a80 msgr2=0x5633da067ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:29.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.065+0000 7f3308c8b740 1 -- 172.21.15.18:0/892745853 shutdown_connections 2024-09-19T09:18:29.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.065+0000 7f3308c8b740 1 -- 172.21.15.18:0/892745853 wait complete. 2024-09-19T09:18:29.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.065+0000 7f3308c8b740 20 client.6315 trim_cache size 0 max 16384 2024-09-19T09:18:29.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.083+0000 7f3308c8b740 1 Processor -- start 2024-09-19T09:18:29.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.083+0000 7f3308c8b740 1 -- start start 2024-09-19T09:18:29.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.084+0000 7f3308c8b740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5633da0252c0 0x5633da01fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:29.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.084+0000 7f3308c8b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633da026a50 0x5633da08d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:29.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.084+0000 7f3308c8b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633da06d660 0x5633da08de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:29.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.084+0000 7f3308c8b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3300200ce0 con 0x5633da026a50 2024-09-19T09:18:29.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.084+0000 7f3308c8b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f33001f8cc0 con 0x5633da06d660 2024-09-19T09:18:29.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.084+0000 7f3308c8b740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3300200690 con 0x5633da0252c0 2024-09-19T09:18:29.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.084+0000 7f32feffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633da026a50 0x5633da08d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:29.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.084+0000 7f32feffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633da026a50 0x5633da08d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51440/0 (socket says 172.21.15.18:51440) 2024-09-19T09:18:29.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.084+0000 7f32feffd640 1 -- 172.21.15.18:0/822774284 learned_addr learned my addr 172.21.15.18:0/822774284 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:29.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.084+0000 7f32feffd640 1 -- 172.21.15.18:0/822774284 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5633da0252c0 msgr2=0x5633da01fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:29.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.084+0000 7f32feffd640 1 --2- 172.21.15.18:0/822774284 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5633da0252c0 0x5633da01fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.084+0000 7f32feffd640 1 -- 172.21.15.18:0/822774284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633da06d660 msgr2=0x5633da08de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:29.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.084+0000 7f32feffd640 1 --2- 172.21.15.18:0/822774284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633da06d660 0x5633da08de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.084+0000 7f32feffd640 1 -- 172.21.15.18:0/822774284 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633da01f370 con 0x5633da026a50 2024-09-19T09:18:29.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.084+0000 7f32feffd640 1 --2- 172.21.15.18:0/822774284 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633da026a50 0x5633da08d920 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f32f40598d0 tx=0x7f32f406f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e39d5d7754283 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:29.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.085+0000 7f32e4ff9640 1 -- 172.21.15.18:0/822774284 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f40570c0 con 0x5633da026a50 2024-09-19T09:18:29.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.085+0000 7f32e4ff9640 1 -- 172.21.15.18:0/822774284 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f4057320 con 0x5633da026a50 2024-09-19T09:18:29.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.085+0000 7f32e4ff9640 1 -- 172.21.15.18:0/822774284 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f4058470 con 0x5633da026a50 2024-09-19T09:18:29.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.085+0000 7f3308c8b740 1 -- 172.21.15.18:0/822774284 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633da026a50 msgr2=0x5633da08d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:29.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.085+0000 7f3308c8b740 1 --2- 172.21.15.18:0/822774284 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633da026a50 0x5633da08d920 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f32f40598d0 tx=0x7f32f406f040 comp rx=0 tx=0).stop 2024-09-19T09:18:29.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.085+0000 7f3308c8b740 1 -- 172.21.15.18:0/822774284 shutdown_connections 2024-09-19T09:18:29.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.085+0000 7f3308c8b740 1 --2- 172.21.15.18:0/822774284 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633da06d660 0x5633da08de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.085+0000 7f3308c8b740 1 --2- 172.21.15.18:0/822774284 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633da026a50 0x5633da08d920 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.085+0000 7f3308c8b740 1 --2- 172.21.15.18:0/822774284 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5633da0252c0 0x5633da01fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.085+0000 7f3308c8b740 1 -- 172.21.15.18:0/822774284 >> 172.21.15.18:0/822774284 conn(0x5633da022a80 msgr2=0x5633da04d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:29.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.085+0000 7f3308c8b740 1 -- 172.21.15.18:0/822774284 shutdown_connections 2024-09-19T09:18:29.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.085+0000 7f3308c8b740 1 -- 172.21.15.18:0/822774284 wait complete. 2024-09-19T09:18:29.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.086+0000 7f3308c8b740 1 -- start start 2024-09-19T09:18:29.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.086+0000 7f3308c8b740 1 Processor -- start 2024-09-19T09:18:29.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.087+0000 7f3308c8b740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633da0252c0 0x5633da0cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:29.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.087+0000 7f3308c8b740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633da026a50 0x5633da063b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:29.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.087+0000 7f3308c8b740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5633da06d660 0x5633da0640d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:29.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.087+0000 7f3308c8b740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5633da01f7b0 con 0x5633da026a50 2024-09-19T09:18:29.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.087+0000 7f3308c8b740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5633da0468b0 con 0x5633da0252c0 2024-09-19T09:18:29.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.087+0000 7f3308c8b740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5633da023d90 con 0x5633da06d660 2024-09-19T09:18:29.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.087+0000 7f3308c8b740 10 client.0 _ll_register_callbacks cb 0x7f32f0016710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:18:29.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.087+0000 7f32feffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633da026a50 0x5633da063b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:29.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.087+0000 7f32feffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633da026a50 0x5633da063b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51456/0 (socket says 172.21.15.18:51456) 2024-09-19T09:18:29.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.087+0000 7f32feffd640 1 -- 172.21.15.18:0/1740210385 learned_addr learned my addr 172.21.15.18:0/1740210385 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:29.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.087+0000 7f32ff7fe640 1 --2- 172.21.15.18:0/1740210385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633da0252c0 0x5633da0cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:29.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.087+0000 7f32fffff640 1 --2- 172.21.15.18:0/1740210385 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5633da06d660 0x5633da0640d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:29.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.087+0000 7f32feffd640 1 -- 172.21.15.18:0/1740210385 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5633da06d660 msgr2=0x5633da0640d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:29.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.087+0000 7f32feffd640 1 --2- 172.21.15.18:0/1740210385 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5633da06d660 0x5633da0640d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.087+0000 7f32feffd640 1 -- 172.21.15.18:0/1740210385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633da0252c0 msgr2=0x5633da0cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:29.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.087+0000 7f32feffd640 1 --2- 172.21.15.18:0/1740210385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633da0252c0 0x5633da0cdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.087+0000 7f32feffd640 1 -- 172.21.15.18:0/1740210385 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633da0466d0 con 0x5633da026a50 2024-09-19T09:18:29.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.087+0000 7f32feffd640 1 --2- 172.21.15.18:0/1740210385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633da026a50 0x5633da063b90 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f32f4055480 tx=0x7f32f0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3839fb68ec6a2453 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:29.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.087+0000 7f32de7fc640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:18:29.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.087+0000 7f32de7fc640 1 -- 172.21.15.18:0/1740210385 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32f407e060 con 0x5633da026a50 2024-09-19T09:18:29.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.087+0000 7f32de7fc640 1 -- 172.21.15.18:0/1740210385 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f32f4058470 con 0x5633da026a50 2024-09-19T09:18:29.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.087+0000 7f3308c8b740 1 -- 172.21.15.18:0/1740210385 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32f4057320 con 0x5633da026a50 2024-09-19T09:18:29.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.088+0000 7f32de7fc640 1 -- 172.21.15.18:0/1740210385 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f32f4058670 con 0x5633da026a50 2024-09-19T09:18:29.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.088+0000 7f3308c8b740 10 client.6321 fetch_fsmap learned FSMap version 42 2024-09-19T09:18:29.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.088+0000 7f3308c8b740 1 -- 172.21.15.18:0/1740210385 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=2+}) -- 0x5633da0479d0 con 0x5633da026a50 2024-09-19T09:18:29.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.088+0000 7f32de7fc640 1 -- 172.21.15.18:0/1740210385 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32f4057320 con 0x5633da026a50 2024-09-19T09:18:29.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.088+0000 7f32de7fc640 1 -- 172.21.15.18:0/1740210385 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 42) ==== 3502+0+0 (secure 0 0 0) 0x7f32f4054d70 con 0x5633da026a50 2024-09-19T09:18:29.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.088+0000 7f3308c8b740 10 client.6321 fetch_fsmap finished waiting for FSMap version 42 2024-09-19T09:18:29.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.088+0000 7f3308c8b740 10 client.6321 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-19T09:18:29.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.088+0000 7f3308c8b740 20 client.6321 populate_metadata read hostname 'smithi018' 2024-09-19T09:18:29.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.088+0000 7f3308c8b740 1 --2- 172.21.15.18:0/1740210385 >> [v2:172.21.15.162:6835/133611430,v1:172.21.15.162:6837/133611430] conn(0x5633da047120 0x5633da06ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:29.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.088+0000 7f3308c8b740 4 client.6321 mds_command: new command op to 6207 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:18:29.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.088+0000 7f3308c8b740 1 -- 172.21.15.18:0/1740210385 --> [v2:172.21.15.162:6835/133611430,v1:172.21.15.162:6837/133611430] -- command(tid 0: {"prefix": "status"}) -- 0x5633d9f8efa0 con 0x5633da047120 2024-09-19T09:18:29.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.088+0000 7f32ff7fe640 1 --2- 172.21.15.18:0/1740210385 >> [v2:172.21.15.162:6835/133611430,v1:172.21.15.162:6837/133611430] conn(0x5633da047120 0x5633da06ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:29.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.088+0000 7f32de7fc640 10 client.6321 ms_handle_connect on v2:172.21.15.162:6835/133611430 2024-09-19T09:18:29.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.088+0000 7f32ff7fe640 1 --2- 172.21.15.18:0/1740210385 >> [v2:172.21.15.162:6835/133611430,v1:172.21.15.162:6837/133611430] conn(0x5633da047120 0x5633da06ba90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4a3fd0661e4e1fc server_cookie=7dba589cb337bd98 in_seq=0 out_seq=0 2024-09-19T09:18:29.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.089+0000 7f32de7fc640 1 -- 172.21.15.18:0/1740210385 <== mds.0 v2:172.21.15.162:6835/133611430 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x5633d9f8efa0 con 0x5633da047120 2024-09-19T09:18:29.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.089+0000 7f32de7fc640 10 client.6321 handle_command_reply: tid=0 2024-09-19T09:18:29.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.089+0000 7f3308c8b740 1 client.6321 shutdown 2024-09-19T09:18:29.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.089+0000 7f3308c8b740 1 -- 172.21.15.18:0/1740210385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633da026a50 msgr2=0x5633da063b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:29.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.089+0000 7f3308c8b740 1 --2- 172.21.15.18:0/1740210385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633da026a50 0x5633da063b90 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f32f4055480 tx=0x7f32f0017000 comp rx=0 tx=0).stop 2024-09-19T09:18:29.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.089+0000 7f3308c8b740 1 -- 172.21.15.18:0/1740210385 shutdown_connections 2024-09-19T09:18:29.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.089+0000 7f3308c8b740 1 --2- 172.21.15.18:0/1740210385 >> [v2:172.21.15.162:6835/133611430,v1:172.21.15.162:6837/133611430] conn(0x5633da047120 0x5633da06ba90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.089+0000 7f3308c8b740 1 --2- 172.21.15.18:0/1740210385 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5633da06d660 0x5633da0640d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.089+0000 7f3308c8b740 1 --2- 172.21.15.18:0/1740210385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5633da026a50 0x5633da063b90 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.089+0000 7f32de7fc640 0 client.6321 ms_handle_reset on v2:172.21.15.162:6835/133611430 2024-09-19T09:18:29.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.089+0000 7f3308c8b740 1 --2- 172.21.15.18:0/1740210385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5633da0252c0 0x5633da0cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.089+0000 7f3308c8b740 1 -- 172.21.15.18:0/1740210385 >> 172.21.15.18:0/1740210385 conn(0x5633da022a80 msgr2=0x5633da08da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:29.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.089+0000 7f3308c8b740 1 -- 172.21.15.18:0/1740210385 shutdown_connections 2024-09-19T09:18:29.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.089+0000 7f3308c8b740 1 -- 172.21.15.18:0/1740210385 wait complete. 2024-09-19T09:18:29.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.089+0000 7f3308c8b740 20 client.6321 trim_cache size 0 max 16384 2024-09-19T09:18:29.096 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:18:29.096 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:18:29.096 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-09-19T09:18:29.096 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 6207, 2024-09-19T09:18:29.096 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-19T09:18:29.096 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-19T09:18:29.096 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-19T09:18:29.096 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 4.6606826620000001, 2024-09-19T09:18:29.097 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 42, 2024-09-19T09:18:29.097 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 104, 2024-09-19T09:18:29.097 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 104, 2024-09-19T09:18:29.097 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 9.5665685630000006 2024-09-19T09:18:29.097 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:18:29.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.090+0000 7f3305ef1640 1 -- 172.21.15.18:0/2222118485 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f32ec06c2b0 msgr2=0x7f32ec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:29.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.090+0000 7f3305ef1640 1 --2- 172.21.15.18:0/2222118485 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f32ec06c2b0 0x7f32ec06e770 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f32f0009b80 tx=0x7f32f0008040 comp rx=0 tx=0).stop 2024-09-19T09:18:29.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.090+0000 7f3305ef1640 1 -- 172.21.15.18:0/2222118485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33000cb700 msgr2=0x7f33000a1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:29.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.090+0000 7f3305ef1640 1 --2- 172.21.15.18:0/2222118485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33000cb700 0x7f33000a1fb0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f32f40072c0 tx=0x7f32f4007780 comp rx=0 tx=0).stop 2024-09-19T09:18:29.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.090+0000 7f3305ef1640 1 -- 172.21.15.18:0/2222118485 shutdown_connections 2024-09-19T09:18:29.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.090+0000 7f3305ef1640 1 --2- 172.21.15.18:0/2222118485 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f32ec06c2b0 0x7f32ec06e770 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.090+0000 7f3305ef1640 1 --2- 172.21.15.18:0/2222118485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f330009fa10 0x7f33000a24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.090+0000 7f3305ef1640 1 --2- 172.21.15.18:0/2222118485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f33000cb700 0x7f33000a1fb0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.090+0000 7f3305ef1640 1 --2- 172.21.15.18:0/2222118485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f330009f630 0x7f33000cb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.090+0000 7f3305ef1640 1 -- 172.21.15.18:0/2222118485 >> 172.21.15.18:0/2222118485 conn(0x7f330009df40 msgr2=0x7f330006d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:29.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.090+0000 7f3305ef1640 1 -- 172.21.15.18:0/2222118485 shutdown_connections 2024-09-19T09:18:29.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.090+0000 7f3305ef1640 1 -- 172.21.15.18:0/2222118485 wait complete. 2024-09-19T09:18:29.101 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T09:18:29.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.202+0000 7f566902e640 1 Processor -- start 2024-09-19T09:18:29.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.202+0000 7f566902e640 1 -- start start 2024-09-19T09:18:29.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.203+0000 7f566902e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f566415ef50 0x7f56640d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:29.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.203+0000 7f566902e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56640b7a90 con 0x7f56640d3240 2024-09-19T09:18:29.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.203+0000 7f566902e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56640d3740 con 0x7f56640b9510 2024-09-19T09:18:29.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.203+0000 7f566902e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f56640d3a20 con 0x7f566415ef50 2024-09-19T09:18:29.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.203+0000 7f566259c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f56640d3240 0x7f56640cf770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33390/0 (socket says 172.21.15.18:33390) 2024-09-19T09:18:29.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.203+0000 7f566259c640 1 -- 172.21.15.18:0/1274704473 learned_addr learned my addr 172.21.15.18:0/1274704473 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:29.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.204+0000 7f5662d9d640 1 --2- 172.21.15.18:0/1274704473 >> v2:172.21.15.162:3300/0 conn(0x7f566415ef50 0x7f56640d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:29.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.204+0000 7f5661d9b640 1 -- 172.21.15.18:0/1274704473 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2162954930 0 0) 0x7f56640b7a90 con 0x7f56640d3240 2024-09-19T09:18:29.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.204+0000 7f5661d9b640 1 -- 172.21.15.18:0/1274704473 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f564c003520 con 0x7f56640d3240 2024-09-19T09:18:29.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.204+0000 7f5662d9d640 1 -- 172.21.15.18:0/1274704473 >> v1:172.21.15.162:6789/0 conn(0x7f56640b9510 legacy=0x7f56640cfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:29.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.204+0000 7f5662d9d640 1 -- 172.21.15.18:0/1274704473 >> v1:172.21.15.18:6789/0 conn(0x7f56640d3240 legacy=0x7f56640cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:29.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.204+0000 7f5662d9d640 1 -- 172.21.15.18:0/1274704473 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56640b7d00 con 0x7f566415ef50 2024-09-19T09:18:29.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.205+0000 7f5662d9d640 1 --2- 172.21.15.18:0/1274704473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f566415ef50 0x7f56640d13a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f56540097a0 tx=0x7f565402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=381b5fabb9df6892 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:29.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.205+0000 7f5661d9b640 1 -- 172.21.15.18:0/1274704473 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5654037070 con 0x7f566415ef50 2024-09-19T09:18:29.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.205+0000 7f5661d9b640 1 -- 172.21.15.18:0/1274704473 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5654032440 con 0x7f566415ef50 2024-09-19T09:18:29.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.205+0000 7f5661d9b640 1 -- 172.21.15.18:0/1274704473 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56540327f0 con 0x7f566415ef50 2024-09-19T09:18:29.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.205+0000 7f566902e640 1 -- 172.21.15.18:0/1274704473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f566415ef50 msgr2=0x7f56640d13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:29.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.205+0000 7f566902e640 1 --2- 172.21.15.18:0/1274704473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f566415ef50 0x7f56640d13a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f56540097a0 tx=0x7f565402a1a0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.205+0000 7f566902e640 1 -- 172.21.15.18:0/1274704473 shutdown_connections 2024-09-19T09:18:29.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.205+0000 7f566902e640 1 --2- 172.21.15.18:0/1274704473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f566415ef50 0x7f56640d13a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.205+0000 7f566902e640 1 -- 172.21.15.18:0/1274704473 >> 172.21.15.18:0/1274704473 conn(0x7f56640d4c60 msgr2=0x7f56640d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:29.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.205+0000 7f566902e640 1 -- 172.21.15.18:0/1274704473 shutdown_connections 2024-09-19T09:18:29.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.205+0000 7f566902e640 1 -- 172.21.15.18:0/1274704473 wait complete. 2024-09-19T09:18:29.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.207+0000 7f566902e640 1 Processor -- start 2024-09-19T09:18:29.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.207+0000 7f566902e640 1 -- start start 2024-09-19T09:18:29.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.208+0000 7f566902e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56640b9510 0x7f566415bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:29.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.208+0000 7f566902e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56640d3240 0x7f56640b2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:29.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.208+0000 7f566902e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f566415ef50 0x7f56641f4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:29.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.208+0000 7f566902e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f56640d2020 con 0x7f566415ef50 2024-09-19T09:18:29.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.208+0000 7f566902e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f56640d0590 con 0x7f56640d3240 2024-09-19T09:18:29.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.208+0000 7f566902e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f56640d21a0 con 0x7f56640b9510 2024-09-19T09:18:29.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.208+0000 7f566359e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f566415ef50 0x7f56641f4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:29.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.208+0000 7f566359e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f566415ef50 0x7f56641f4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51468/0 (socket says 172.21.15.18:51468) 2024-09-19T09:18:29.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.208+0000 7f566359e640 1 -- 172.21.15.18:0/2580729556 learned_addr learned my addr 172.21.15.18:0/2580729556 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:29.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.208+0000 7f566259c640 1 --2- 172.21.15.18:0/2580729556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56640d3240 0x7f56640b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:29.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.208+0000 7f5662d9d640 1 --2- 172.21.15.18:0/2580729556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56640b9510 0x7f566415bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:29.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.208+0000 7f566359e640 1 -- 172.21.15.18:0/2580729556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56640b9510 msgr2=0x7f566415bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:29.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.208+0000 7f566359e640 1 --2- 172.21.15.18:0/2580729556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56640b9510 0x7f566415bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.208+0000 7f566359e640 1 -- 172.21.15.18:0/2580729556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56640d3240 msgr2=0x7f56640b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:29.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.208+0000 7f566359e640 1 --2- 172.21.15.18:0/2580729556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56640d3240 0x7f56640b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.208+0000 7f566359e640 1 -- 172.21.15.18:0/2580729556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56640ca1f0 con 0x7f566415ef50 2024-09-19T09:18:29.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.208+0000 7f566359e640 1 --2- 172.21.15.18:0/2580729556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f566415ef50 0x7f56641f4b30 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f565c00c680 tx=0x7f565c00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:29.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.208+0000 7f564b7fe640 1 -- 172.21.15.18:0/2580729556 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565c003b70 con 0x7f566415ef50 2024-09-19T09:18:29.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.208+0000 7f564b7fe640 1 -- 172.21.15.18:0/2580729556 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f565c003d10 con 0x7f566415ef50 2024-09-19T09:18:29.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.208+0000 7f566902e640 1 -- 172.21.15.18:0/2580729556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56640ca4d0 con 0x7f566415ef50 2024-09-19T09:18:29.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.208+0000 7f564b7fe640 1 -- 172.21.15.18:0/2580729556 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f565c005310 con 0x7f566415ef50 2024-09-19T09:18:29.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.209+0000 7f566902e640 1 -- 172.21.15.18:0/2580729556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56640caa90 con 0x7f566415ef50 2024-09-19T09:18:29.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.209+0000 7f566902e640 1 -- 172.21.15.18:0/2580729556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56640cac90 con 0x7f566415ef50 2024-09-19T09:18:29.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.210+0000 7f564b7fe640 1 -- 172.21.15.18:0/2580729556 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f565c0054b0 con 0x7f566415ef50 2024-09-19T09:18:29.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.210+0000 7f564b7fe640 1 --2- 172.21.15.18:0/2580729556 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f565006c2b0 0x7f565006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:29.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.211+0000 7f564b7fe640 1 -- 172.21.15.18:0/2580729556 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f565c08b060 con 0x7f566415ef50 2024-09-19T09:18:29.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.211+0000 7f5662d9d640 1 --2- 172.21.15.18:0/2580729556 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f565006c2b0 0x7f565006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:29.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.211+0000 7f5662d9d640 1 --2- 172.21.15.18:0/2580729556 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f565006c2b0 0x7f565006e770 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5654034000 tx=0x7f565402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:29.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.215+0000 7f564b7fe640 1 -- 172.21.15.18:0/2580729556 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f56640cac90 con 0x7f566415ef50 2024-09-19T09:18:29.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.426+0000 7f566902e640 1 -- 172.21.15.18:0/2580729556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f56640d5780 con 0x7f566415ef50 2024-09-19T09:18:29.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.427+0000 7f564b7fe640 1 -- 172.21.15.18:0/2580729556 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v42) ==== 53+0+73 (secure 0 0 0) 0x7f565c059210 con 0x7f566415ef50 2024-09-19T09:18:29.427 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T09:18:29.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.429+0000 7f566902e640 1 -- 172.21.15.18:0/2580729556 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f565006c2b0 msgr2=0x7f565006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:29.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.429+0000 7f566902e640 1 --2- 172.21.15.18:0/2580729556 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f565006c2b0 0x7f565006e770 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5654034000 tx=0x7f565402e000 comp rx=0 tx=0).stop 2024-09-19T09:18:29.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.429+0000 7f566902e640 1 -- 172.21.15.18:0/2580729556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f566415ef50 msgr2=0x7f56641f4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:29.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.429+0000 7f566902e640 1 --2- 172.21.15.18:0/2580729556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f566415ef50 0x7f56641f4b30 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f565c00c680 tx=0x7f565c00cb40 comp rx=0 tx=0).stop 2024-09-19T09:18:29.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.429+0000 7f566902e640 1 -- 172.21.15.18:0/2580729556 shutdown_connections 2024-09-19T09:18:29.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.429+0000 7f566902e640 1 --2- 172.21.15.18:0/2580729556 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f565006c2b0 0x7f565006e770 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.429+0000 7f566902e640 1 --2- 172.21.15.18:0/2580729556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f566415ef50 0x7f56641f4b30 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.429+0000 7f566902e640 1 --2- 172.21.15.18:0/2580729556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f56640d3240 0x7f56640b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.429+0000 7f566902e640 1 --2- 172.21.15.18:0/2580729556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f56640b9510 0x7f566415bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:29.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.429+0000 7f566902e640 1 -- 172.21.15.18:0/2580729556 >> 172.21.15.18:0/2580729556 conn(0x7f56640d4c60 msgr2=0x7f56640b68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:29.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.429+0000 7f566902e640 1 -- 172.21.15.18:0/2580729556 shutdown_connections 2024-09-19T09:18:29.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29.429+0000 7f566902e640 1 -- 172.21.15.18:0/2580729556 wait complete. 2024-09-19T09:18:29.440 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-19T09:18:29.440 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:18:29.440 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-09-19T09:18:29.440 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T09:18:29.440 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:18:29.441 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-19T09:18:29.441 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-19T09:18:29.441 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:18:29.441 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:18:29.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:29.441 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-09-19T09:18:29.458 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:18:29.458 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:18:29.459 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:18:29.459 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:18:29.459 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-09-19T09:18:29.459 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:18:29.459 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:18:29.459 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:18:29.460 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-09-19T09:18:29.460 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:18:29.460 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:18:29.460 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-09-19T09:18:29.460 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:18:29.461 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:18:29.461 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-09-19T09:18:29.461 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T09:18:29.461 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42488sec preferred_lft 42488sec 2024-09-19T09:18:29.461 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-09-19T09:18:29.461 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:18:29.462 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:18:29.462 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:18:29.462 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-09-19T09:18:29.462 INFO:teuthology.orchestra.run.smithi018.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T09:18:29.462 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:44:1b:02:86:87 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:18:29.462 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T09:18:29.463 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:18:29.463 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::a0ce:faff:feaa:13ec/64 scope link 2024-09-19T09:18:29.463 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:18:29.463 INFO:teuthology.orchestra.run.smithi018.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:18:29.463 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:44:1b:02:86:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:18:29.463 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::44:1bff:fe02:8687/64 scope link 2024-09-19T09:18:29.464 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:18:29.464 INFO:teuthology.orchestra.run.smithi018.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:18:29.464 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether e2:6d:c4:af:6a:8b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T09:18:29.464 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::e06d:c4ff:feaf:6a8b/64 scope link 2024-09-19T09:18:29.464 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:18:29.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:29.465 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:18:29.523 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-09-19T09:18:29.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:29.524 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-09-19T09:18:29.581 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-09-19T09:18:29.581 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:18:29.581 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T09:18:29.581 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T09:18:29.582 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:18:29.582 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:18:29.582 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T09:18:29.582 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T09:18:29.582 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T09:18:29.582 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T09:18:29.582 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T09:18:29.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:18:29.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:18:29.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:29.710 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-19T09:18:29.726 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-19T09:18:29.726 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T09:18:29.726 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:18:29.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:29.727 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-09-19T09:18:29.792 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:18:29.792 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T09:18:29.848 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:18:29.849 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:18:29.849 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:18:29.904 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-19T09:18:29.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:29.904 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:18:29.989 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:18:29.989 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:18:29.989 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:18:29.998 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:18:29.998 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:18:29.998 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:18:29.998 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:18:29.998 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:18:30.016 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:18:30.016 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:18:30.016 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:18:30.016 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:18:30.016 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:18:30.016 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-19T09:18:30.016 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-19T09:18:30.016 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fec66d7e-50e5-42ed-81de-ad141a2f0f4e" will pass to kernel 2024-09-19T09:18:30.017 INFO:teuthology.orchestra.run.smithi018.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-19T09:18:30.017 INFO:teuthology.orchestra.run.smithi018.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:18:30.017 INFO:teuthology.orchestra.run.smithi018.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:18:30.017 INFO:teuthology.orchestra.run.smithi018.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:18:30.017 INFO:teuthology.orchestra.run.smithi018.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:18:30.018 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:18:30.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:30.019 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:18:30.045 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:18:30.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:18:30.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:18:30.150 INFO:teuthology.orchestra.run.smithi018.stdout:client6058 2024-09-19T09:18:30.151 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:18:30.151 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:18:30.167 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T09:18:30.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.309+0000 7fb91cca5640 1 Processor -- start 2024-09-19T09:18:30.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.309+0000 7fb91cca5640 1 -- start start 2024-09-19T09:18:30.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.310+0000 7fb91cca5640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb91815ed50 0x7fb9180d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:30.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.310+0000 7fb91cca5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9180d1aa0 0x7fb9180b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:30.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.310+0000 7fb91cca5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb9180b5030 0x7fb9180b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:30.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.310+0000 7fb91cca5640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fb9180d1ee0 con 0x7fb91815ed50 2024-09-19T09:18:30.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.310+0000 7fb91cca5640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb9180d31b0 con 0x7fb9180b5030 2024-09-19T09:18:30.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.310+0000 7fb91cca5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb9180d3490 con 0x7fb9180d1aa0 2024-09-19T09:18:30.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.310+0000 7fb91659c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb91815ed50 0x7fb9180d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:30.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.310+0000 7fb91659c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb91815ed50 0x7fb9180d1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51472/0 (socket says 172.21.15.18:51472) 2024-09-19T09:18:30.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.310+0000 7fb91659c640 1 -- 172.21.15.18:0/1082871113 learned_addr learned my addr 172.21.15.18:0/1082871113 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:30.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.310+0000 7fb915d9b640 1 --2- 172.21.15.18:0/1082871113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9180d1aa0 0x7fb9180b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:30.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.310+0000 7fb916d9d640 1 --2- 172.21.15.18:0/1082871113 >> v2:172.21.15.162:3300/0 conn(0x7fb9180b5030 0x7fb9180b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:30.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.310+0000 7fb91659c640 1 -- 172.21.15.18:0/1082871113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9180d1aa0 msgr2=0x7fb9180b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:30.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.310+0000 7fb91659c640 1 --2- 172.21.15.18:0/1082871113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9180d1aa0 0x7fb9180b4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.310+0000 7fb91659c640 1 -- 172.21.15.18:0/1082871113 >> v2:172.21.15.162:3300/0 conn(0x7fb9180b5030 msgr2=0x7fb9180b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:30.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.310+0000 7fb91659c640 1 --2- 172.21.15.18:0/1082871113 >> v2:172.21.15.162:3300/0 conn(0x7fb9180b5030 0x7fb9180b54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.310+0000 7fb91659c640 1 -- 172.21.15.18:0/1082871113 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9180d3770 con 0x7fb91815ed50 2024-09-19T09:18:30.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.311+0000 7fb91659c640 1 --2- 172.21.15.18:0/1082871113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb91815ed50 0x7fb9180d1560 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fb91808d880 tx=0x7fb90802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8815c20df899992e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:30.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.311+0000 7fb91559a640 1 -- 172.21.15.18:0/1082871113 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb908037070 con 0x7fb91815ed50 2024-09-19T09:18:30.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.311+0000 7fb91559a640 1 -- 172.21.15.18:0/1082871113 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb908032440 con 0x7fb91815ed50 2024-09-19T09:18:30.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.311+0000 7fb91559a640 1 -- 172.21.15.18:0/1082871113 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb908032810 con 0x7fb91815ed50 2024-09-19T09:18:30.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.311+0000 7fb91cca5640 1 -- 172.21.15.18:0/1082871113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb91815ed50 msgr2=0x7fb9180d1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:30.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.311+0000 7fb91cca5640 1 --2- 172.21.15.18:0/1082871113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb91815ed50 0x7fb9180d1560 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fb91808d880 tx=0x7fb90802a270 comp rx=0 tx=0).stop 2024-09-19T09:18:30.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.312+0000 7fb91cca5640 1 -- 172.21.15.18:0/1082871113 shutdown_connections 2024-09-19T09:18:30.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.312+0000 7fb91cca5640 1 --2- 172.21.15.18:0/1082871113 >> v2:172.21.15.162:3300/0 conn(0x7fb9180b5030 0x7fb9180b54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.312+0000 7fb91cca5640 1 --2- 172.21.15.18:0/1082871113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb9180d1aa0 0x7fb9180b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.312+0000 7fb91cca5640 1 --2- 172.21.15.18:0/1082871113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb91815ed50 0x7fb9180d1560 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.312+0000 7fb91cca5640 1 -- 172.21.15.18:0/1082871113 >> 172.21.15.18:0/1082871113 conn(0x7fb9180d4bd0 msgr2=0x7fb9180d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:30.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.312+0000 7fb91cca5640 1 -- 172.21.15.18:0/1082871113 shutdown_connections 2024-09-19T09:18:30.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.312+0000 7fb91cca5640 1 -- 172.21.15.18:0/1082871113 wait complete. 2024-09-19T09:18:30.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.313+0000 7fb91cca5640 1 Processor -- start 2024-09-19T09:18:30.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.313+0000 7fb91cca5640 1 -- start start 2024-09-19T09:18:30.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.314+0000 7fb91cca5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9180b5030 0x7fb9180caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:30.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.314+0000 7fb91cca5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9180d1aa0 0x7fb91815d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:30.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.314+0000 7fb91cca5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb91815ed50 0x7fb9181607b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:30.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.314+0000 7fb91cca5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb9180d3d30 con 0x7fb9180d1aa0 2024-09-19T09:18:30.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.314+0000 7fb91cca5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb9180b45d0 con 0x7fb9180b5030 2024-09-19T09:18:30.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.314+0000 7fb91cca5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb91815f130 con 0x7fb91815ed50 2024-09-19T09:18:30.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.314+0000 7fb915d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9180d1aa0 0x7fb91815d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:30.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.314+0000 7fb915d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9180d1aa0 0x7fb91815d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51478/0 (socket says 172.21.15.18:51478) 2024-09-19T09:18:30.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.314+0000 7fb915d9b640 1 -- 172.21.15.18:0/1504156184 learned_addr learned my addr 172.21.15.18:0/1504156184 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:30.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.314+0000 7fb91659c640 1 --2- 172.21.15.18:0/1504156184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9180b5030 0x7fb9180caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:30.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.314+0000 7fb916d9d640 1 --2- 172.21.15.18:0/1504156184 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb91815ed50 0x7fb9181607b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:30.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.314+0000 7fb915d9b640 1 -- 172.21.15.18:0/1504156184 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb91815ed50 msgr2=0x7fb9181607b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:30.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.314+0000 7fb915d9b640 1 --2- 172.21.15.18:0/1504156184 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb91815ed50 0x7fb9181607b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.314+0000 7fb915d9b640 1 -- 172.21.15.18:0/1504156184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9180b5030 msgr2=0x7fb9180caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:30.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.314+0000 7fb915d9b640 1 --2- 172.21.15.18:0/1504156184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9180b5030 0x7fb9180caef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.314+0000 7fb915d9b640 1 -- 172.21.15.18:0/1504156184 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9180ba530 con 0x7fb9180d1aa0 2024-09-19T09:18:30.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.314+0000 7fb915d9b640 1 --2- 172.21.15.18:0/1504156184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9180d1aa0 0x7fb91815d1d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fb90c00d800 tx=0x7fb90c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:30.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.315+0000 7fb906ffd640 1 -- 172.21.15.18:0/1504156184 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c004020 con 0x7fb9180d1aa0 2024-09-19T09:18:30.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.315+0000 7fb906ffd640 1 -- 172.21.15.18:0/1504156184 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb90c0041c0 con 0x7fb9180d1aa0 2024-09-19T09:18:30.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.315+0000 7fb91cca5640 1 -- 172.21.15.18:0/1504156184 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9180ba810 con 0x7fb9180d1aa0 2024-09-19T09:18:30.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.315+0000 7fb906ffd640 1 -- 172.21.15.18:0/1504156184 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c004390 con 0x7fb9180d1aa0 2024-09-19T09:18:30.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.315+0000 7fb91cca5640 1 -- 172.21.15.18:0/1504156184 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb918160cf0 con 0x7fb9180d1aa0 2024-09-19T09:18:30.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.316+0000 7fb91cca5640 1 -- 172.21.15.18:0/1504156184 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9180d21e0 con 0x7fb9180d1aa0 2024-09-19T09:18:30.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.316+0000 7fb906ffd640 1 -- 172.21.15.18:0/1504156184 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb90c01b020 con 0x7fb9180d1aa0 2024-09-19T09:18:30.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.317+0000 7fb906ffd640 1 --2- 172.21.15.18:0/1504156184 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb8f806c2b0 0x7fb8f806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:30.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.317+0000 7fb906ffd640 1 -- 172.21.15.18:0/1504156184 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7fb90c08b0b0 con 0x7fb9180d1aa0 2024-09-19T09:18:30.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.317+0000 7fb91659c640 1 --2- 172.21.15.18:0/1504156184 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb8f806c2b0 0x7fb8f806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:30.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.317+0000 7fb91659c640 1 --2- 172.21.15.18:0/1504156184 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb8f806c2b0 0x7fb8f806e770 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb908034000 tx=0x7fb90802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:30.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.321+0000 7fb906ffd640 1 -- 172.21.15.18:0/1504156184 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb90c059260 con 0x7fb9180d1aa0 2024-09-19T09:18:30.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.535+0000 7fb91cca5640 1 -- 172.21.15.18:0/1504156184 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb9180b40b0 con 0x7fb9180d1aa0 2024-09-19T09:18:30.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.536+0000 7fb906ffd640 1 -- 172.21.15.18:0/1504156184 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v42) ==== 53+0+73 (secure 0 0 0) 0x7fb90c05d560 con 0x7fb9180d1aa0 2024-09-19T09:18:30.537 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T09:18:30.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.538+0000 7fb91cca5640 1 -- 172.21.15.18:0/1504156184 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb8f806c2b0 msgr2=0x7fb8f806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:30.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.538+0000 7fb91cca5640 1 --2- 172.21.15.18:0/1504156184 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb8f806c2b0 0x7fb8f806e770 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb908034000 tx=0x7fb90802e000 comp rx=0 tx=0).stop 2024-09-19T09:18:30.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.538+0000 7fb91cca5640 1 -- 172.21.15.18:0/1504156184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9180d1aa0 msgr2=0x7fb91815d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:30.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.538+0000 7fb91cca5640 1 --2- 172.21.15.18:0/1504156184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9180d1aa0 0x7fb91815d1d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fb90c00d800 tx=0x7fb90c00dcc0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.538+0000 7fb91cca5640 1 -- 172.21.15.18:0/1504156184 shutdown_connections 2024-09-19T09:18:30.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.538+0000 7fb91cca5640 1 --2- 172.21.15.18:0/1504156184 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb8f806c2b0 0x7fb8f806e770 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.538+0000 7fb91cca5640 1 --2- 172.21.15.18:0/1504156184 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb91815ed50 0x7fb9181607b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.538+0000 7fb91cca5640 1 --2- 172.21.15.18:0/1504156184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb9180d1aa0 0x7fb91815d1d0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.538+0000 7fb91cca5640 1 --2- 172.21.15.18:0/1504156184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb9180b5030 0x7fb9180caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:30.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.538+0000 7fb91cca5640 1 -- 172.21.15.18:0/1504156184 >> 172.21.15.18:0/1504156184 conn(0x7fb9180d4bd0 msgr2=0x7fb9180b6300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:30.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.538+0000 7fb91cca5640 1 -- 172.21.15.18:0/1504156184 shutdown_connections 2024-09-19T09:18:30.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:30.538+0000 7fb91cca5640 1 -- 172.21.15.18:0/1504156184 wait complete. 2024-09-19T09:18:30.549 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-19T09:18:30.549 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:18:30.549 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-09-19T09:18:30.549 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-19T09:18:30.549 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-19T09:18:30.549 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-19T09:18:30.549 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-19T09:18:30.549 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:18:30.550 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:18:30.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:30.550 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-09-19T09:18:30.570 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:18:30.571 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:18:30.571 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:18:30.571 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:18:30.571 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-09-19T09:18:30.571 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:18:30.571 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:18:30.571 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:18:30.572 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-09-19T09:18:30.572 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:18:30.572 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:18:30.572 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-09-19T09:18:30.572 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:18:30.572 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:18:30.573 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:18:30.573 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:18:30.573 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T09:18:30.573 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42498sec preferred_lft 42498sec 2024-09-19T09:18:30.573 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link noprefixroute 2024-09-19T09:18:30.573 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:18:30.574 INFO:teuthology.orchestra.run.smithi162.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T09:18:30.574 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 5e:4d:7e:1d:19:f9 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:18:30.574 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T09:18:30.574 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:18:30.574 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::5829:65ff:fe01:6bc7/64 scope link 2024-09-19T09:18:30.574 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:18:30.575 INFO:teuthology.orchestra.run.smithi162.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:18:30.575 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 86:86:3e:32:67:c5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T09:18:30.575 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::8486:3eff:fe32:67c5/64 scope link 2024-09-19T09:18:30.575 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:18:30.575 INFO:teuthology.orchestra.run.smithi162.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:18:30.575 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 5e:4d:7e:1d:19:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-19T09:18:30.575 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::5c4d:7eff:fe1d:19f9/64 scope link 2024-09-19T09:18:30.575 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:18:30.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:30.576 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:18:30.638 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-09-19T09:18:30.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:30.640 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-09-19T09:18:30.699 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-09-19T09:18:30.699 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:18:30.699 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T09:18:30.699 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T09:18:30.699 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:18:30.700 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:18:30.700 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-19T09:18:30.700 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T09:18:30.700 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T09:18:30.700 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T09:18:30.700 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-19T09:18:30.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:18:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:18:30.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:18:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:18:30.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:30.834 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-19T09:18:30.850 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-19T09:18:30.850 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-19T09:18:30.851 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:18:30.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:30.851 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2024-09-19T09:18:30.916 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:18:30.917 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-19T09:18:30.972 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:18:30.972 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:18:30.973 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-19T09:18:30.983 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:18:30.986 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:18:31.027 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-19T09:18:31.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:31.027 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:18:31.110 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:18:31.110 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:18:31.110 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:18:31.119 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:18:31.119 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:18:31.119 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:18:31.119 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:18:31.119 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:18:31.123 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:18:31.123 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:18:31.123 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:18:31.123 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:18:31.124 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:18:31.124 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-19T09:18:31.124 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-19T09:18:31.124 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=fec66d7e-50e5-42ed-81de-ad141a2f0f4e" will pass to kernel 2024-09-19T09:18:31.124 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-19T09:18:31.124 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:18:31.124 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:18:31.124 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:18:31.124 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:18:31.126 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:18:31.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:31.126 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-19T09:18:31.191 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:18:31.280 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:18:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:18:31.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:18:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:18:31.287 INFO:teuthology.orchestra.run.smithi162.stdout:client6336 2024-09-19T09:18:31.288 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:18:31.288 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:18:31.304 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:18:31.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.414+0000 7f1ce5fa2640 1 Processor -- start 2024-09-19T09:18:31.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.414+0000 7f1ce5fa2640 1 -- start start 2024-09-19T09:18:31.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.415+0000 7f1ce5fa2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ce015e970 0x7f1ce00d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:31.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.415+0000 7f1ce5fa2640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1ce00d2680 0x7f1ce00cf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:31.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.415+0000 7f1ce5fa2640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ce00d2bd0 con 0x7f1ce00cfac0 2024-09-19T09:18:31.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.415+0000 7f1ce5fa2640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f1ce00d37e0 con 0x7f1ce00d2680 2024-09-19T09:18:31.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.415+0000 7f1ce5fa2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce00d2eb0 con 0x7f1ce015e970 2024-09-19T09:18:31.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.415+0000 7f1cdffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1ce00d2680 0x7f1ce00cf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:31.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.415+0000 7f1cdffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1ce00d2680 0x7f1ce00cf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51482/0 (socket says 172.21.15.18:51482) 2024-09-19T09:18:31.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.415+0000 7f1cdffff640 1 -- 172.21.15.18:0/835777471 learned_addr learned my addr 172.21.15.18:0/835777471 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:31.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.415+0000 7f1ce4fa0640 1 --2- 172.21.15.18:0/835777471 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ce015e970 0x7f1ce00d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:31.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.416+0000 7f1cdffff640 1 -- 172.21.15.18:0/835777471 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ce015e970 msgr2=0x7f1ce00d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:31.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.416+0000 7f1cdffff640 1 --2- 172.21.15.18:0/835777471 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ce015e970 0x7f1ce00d0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:31.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.416+0000 7f1cdffff640 1 -- 172.21.15.18:0/835777471 >> v1:172.21.15.162:6789/0 conn(0x7f1ce00cfac0 legacy=0x7f1ce00d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:31.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.416+0000 7f1cdffff640 1 -- 172.21.15.18:0/835777471 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce00d3190 con 0x7f1ce00d2680 2024-09-19T09:18:31.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.416+0000 7f1cdffff640 1 --2- 172.21.15.18:0/835777471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ce00d2680 0x7f1ce00cf580 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009e50 tx=0x7f1cd402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cf00df1b4894a7a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:31.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.416+0000 7f1cdf7fe640 1 -- 172.21.15.18:0/835777471 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd4036070 con 0x7f1ce00d2680 2024-09-19T09:18:31.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.416+0000 7f1cdf7fe640 1 -- 172.21.15.18:0/835777471 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd4031600 con 0x7f1ce00d2680 2024-09-19T09:18:31.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.417+0000 7f1cdf7fe640 1 -- 172.21.15.18:0/835777471 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd40319d0 con 0x7f1ce00d2680 2024-09-19T09:18:31.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.417+0000 7f1ce5fa2640 1 -- 172.21.15.18:0/835777471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ce00d2680 msgr2=0x7f1ce00cf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:31.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.417+0000 7f1ce5fa2640 1 --2- 172.21.15.18:0/835777471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ce00d2680 0x7f1ce00cf580 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4009e50 tx=0x7f1cd402a7a0 comp rx=0 tx=0).stop 2024-09-19T09:18:31.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.417+0000 7f1ce5fa2640 1 -- 172.21.15.18:0/835777471 shutdown_connections 2024-09-19T09:18:31.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.417+0000 7f1ce5fa2640 1 --2- 172.21.15.18:0/835777471 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ce00d2680 0x7f1ce00cf580 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:31.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.417+0000 7f1ce5fa2640 1 --2- 172.21.15.18:0/835777471 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ce015e970 0x7f1ce00d0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:31.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.417+0000 7f1ce5fa2640 1 -- 172.21.15.18:0/835777471 >> 172.21.15.18:0/835777471 conn(0x7f1ce009de00 msgr2=0x7f1ce00d4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:31.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.417+0000 7f1ce5fa2640 1 -- 172.21.15.18:0/835777471 shutdown_connections 2024-09-19T09:18:31.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.417+0000 7f1ce5fa2640 1 -- 172.21.15.18:0/835777471 wait complete. 2024-09-19T09:18:31.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.418+0000 7f1ce5fa2640 1 Processor -- start 2024-09-19T09:18:31.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.418+0000 7f1ce5fa2640 1 -- start start 2024-09-19T09:18:31.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.419+0000 7f1ce5fa2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ce00cfac0 0x7f1ce01574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:31.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.419+0000 7f1ce5fa2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ce00d2680 0x7f1ce00ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:31.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.419+0000 7f1ce5fa2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ce015e970 0x7f1ce00cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:31.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.419+0000 7f1ce5fa2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce00d0840 con 0x7f1ce015e970 2024-09-19T09:18:31.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.419+0000 7f1ce5fa2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1ce00cff70 con 0x7f1ce00d2680 2024-09-19T09:18:31.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.419+0000 7f1ce5fa2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1ce015ed50 con 0x7f1ce00cfac0 2024-09-19T09:18:31.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.419+0000 7f1ce57a1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ce015e970 0x7f1ce00cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:31.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.419+0000 7f1ce57a1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ce015e970 0x7f1ce00cc7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51498/0 (socket says 172.21.15.18:51498) 2024-09-19T09:18:31.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.419+0000 7f1ce57a1640 1 -- 172.21.15.18:0/1459924954 learned_addr learned my addr 172.21.15.18:0/1459924954 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:31.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.419+0000 7f1ce4fa0640 1 --2- 172.21.15.18:0/1459924954 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ce00cfac0 0x7f1ce01574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:31.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.419+0000 7f1cdffff640 1 --2- 172.21.15.18:0/1459924954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ce00d2680 0x7f1ce00ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:31.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.420+0000 7f1ce57a1640 1 -- 172.21.15.18:0/1459924954 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ce00cfac0 msgr2=0x7f1ce01574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:31.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.420+0000 7f1ce57a1640 1 --2- 172.21.15.18:0/1459924954 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ce00cfac0 0x7f1ce01574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:31.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.420+0000 7f1ce57a1640 1 -- 172.21.15.18:0/1459924954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ce00d2680 msgr2=0x7f1ce00ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:31.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.420+0000 7f1ce57a1640 1 --2- 172.21.15.18:0/1459924954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ce00d2680 0x7f1ce00ce3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:31.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.420+0000 7f1ce57a1640 1 -- 172.21.15.18:0/1459924954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ce0157a00 con 0x7f1ce015e970 2024-09-19T09:18:31.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.420+0000 7f1ce57a1640 1 --2- 172.21.15.18:0/1459924954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ce015e970 0x7f1ce00cc7c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800c400 tx=0x7f1cd800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:31.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.420+0000 7f1cdd7fa640 1 -- 172.21.15.18:0/1459924954 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8017070 con 0x7f1ce015e970 2024-09-19T09:18:31.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.420+0000 7f1cdd7fa640 1 -- 172.21.15.18:0/1459924954 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cd80052d0 con 0x7f1ce015e970 2024-09-19T09:18:31.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.420+0000 7f1cdd7fa640 1 -- 172.21.15.18:0/1459924954 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8003810 con 0x7f1ce015e970 2024-09-19T09:18:31.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.420+0000 7f1ce5fa2640 1 -- 172.21.15.18:0/1459924954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ce00cd330 con 0x7f1ce015e970 2024-09-19T09:18:31.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.420+0000 7f1ce5fa2640 1 -- 172.21.15.18:0/1459924954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ce00cd8f0 con 0x7f1ce015e970 2024-09-19T09:18:31.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.421+0000 7f1ce5fa2640 1 -- 172.21.15.18:0/1459924954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ce00cf580 con 0x7f1ce015e970 2024-09-19T09:18:31.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.422+0000 7f1cdd7fa640 1 -- 172.21.15.18:0/1459924954 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1cd801a070 con 0x7f1ce015e970 2024-09-19T09:18:31.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.422+0000 7f1cdd7fa640 1 --2- 172.21.15.18:0/1459924954 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1ccc06c2b0 0x7f1ccc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:31.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.422+0000 7f1cdd7fa640 1 -- 172.21.15.18:0/1459924954 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f1cd808a750 con 0x7f1ce015e970 2024-09-19T09:18:31.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.422+0000 7f1ce4fa0640 1 --2- 172.21.15.18:0/1459924954 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1ccc06c2b0 0x7f1ccc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:31.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.423+0000 7f1ce4fa0640 1 --2- 172.21.15.18:0/1459924954 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1ccc06c2b0 0x7f1ccc06e770 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0009aa0 tx=0x7f1cd0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:31.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.427+0000 7f1cdd7fa640 1 -- 172.21.15.18:0/1459924954 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1ce0157a00 con 0x7f1ce015e970 2024-09-19T09:18:31.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.640+0000 7f1ce5fa2640 1 -- 172.21.15.18:0/1459924954 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ce00d19d0 con 0x7f1ce015e970 2024-09-19T09:18:31.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.641+0000 7f1cdd7fa640 1 -- 172.21.15.18:0/1459924954 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5225 (secure 0 0 0) 0x7f1cd8058870 con 0x7f1ce015e970 2024-09-19T09:18:31.641 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:31.642 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":42,"btime":"2024-09-19T09:18:26:440614+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5944,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/935732637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":935732637},{"type":"v1","addr":"172.21.15.162:6836","nonce":935732637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6192,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3186899169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":3186899169},{"type":"v1","addr":"172.21.15.18:6835","nonce":3186899169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6195,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/3889971648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3889971648},{"type":"v1","addr":"172.21.15.18:6834","nonce":3889971648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:18:23.782156+0000","modified":"2024-09-19T09:18:25.789778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"d","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6837/133611430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":133611430},{"type":"v1","addr":"172.21.15.162:6837","nonce":133611430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6207,"qdb_cluster":[6207]},"id":6}]} 2024-09-19T09:18:31.642 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 42 2024-09-19T09:18:31.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.643+0000 7f1ce5fa2640 1 -- 172.21.15.18:0/1459924954 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1ccc06c2b0 msgr2=0x7f1ccc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:31.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.643+0000 7f1ce5fa2640 1 --2- 172.21.15.18:0/1459924954 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1ccc06c2b0 0x7f1ccc06e770 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0009aa0 tx=0x7f1cd0009190 comp rx=0 tx=0).stop 2024-09-19T09:18:31.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.643+0000 7f1ce5fa2640 1 -- 172.21.15.18:0/1459924954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ce015e970 msgr2=0x7f1ce00cc7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:31.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.643+0000 7f1ce5fa2640 1 --2- 172.21.15.18:0/1459924954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ce015e970 0x7f1ce00cc7c0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800c400 tx=0x7f1cd800c8c0 comp rx=0 tx=0).stop 2024-09-19T09:18:31.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.643+0000 7f1ce5fa2640 1 -- 172.21.15.18:0/1459924954 shutdown_connections 2024-09-19T09:18:31.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.643+0000 7f1ce5fa2640 1 --2- 172.21.15.18:0/1459924954 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1ccc06c2b0 0x7f1ccc06e770 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:31.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.643+0000 7f1ce5fa2640 1 --2- 172.21.15.18:0/1459924954 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1ce015e970 0x7f1ce00cc7c0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:31.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.643+0000 7f1ce5fa2640 1 --2- 172.21.15.18:0/1459924954 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ce00d2680 0x7f1ce00ce3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:31.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.643+0000 7f1ce5fa2640 1 --2- 172.21.15.18:0/1459924954 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1ce00cfac0 0x7f1ce01574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:31.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.643+0000 7f1ce5fa2640 1 -- 172.21.15.18:0/1459924954 >> 172.21.15.18:0/1459924954 conn(0x7f1ce009de00 msgr2=0x7f1ce00c88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:31.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.643+0000 7f1ce5fa2640 1 -- 172.21.15.18:0/1459924954 shutdown_connections 2024-09-19T09:18:31.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:31.643+0000 7f1ce5fa2640 1 -- 172.21.15.18:0/1459924954 wait complete. 2024-09-19T09:18:31.655 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2024-09-19T09:18:31.771 INFO:teuthology.orchestra.run.smithi162.stdout:{"cluster_fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","whoami":0,"id":6207,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":7.3337959530000001,"mdsmap_epoch":42,"osdmap_epoch":104,"osdmap_epoch_barrier":104,"uptime":12.239683274000001} 2024-09-19T09:18:31.771 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", "fs_name": "cephfs", "id": 6207, "mdsmap_epoch": 42, "osdmap_epoch": 104, "osdmap_epoch_barrier": 104, "rank_uptime": 7.333795953, "state": "up:active", "uptime": 12.239683274, "want_state": "up:active", "whoami": 0 } 2024-09-19T09:18:31.772 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-19T09:18:31.887 INFO:teuthology.orchestra.run.smithi018.stdout:{"osd_mon_report_interval":"5"} 2024-09-19T09:18:31.887 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-19T09:18:31.887 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2024-09-19T09:18:31.887 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:18:31.887 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:18:31.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:31.904 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2024-09-19T09:18:32.852 INFO:teuthology.orchestra.run.smithi018.stderr:265+0 records in 2024-09-19T09:18:32.852 INFO:teuthology.orchestra.run.smithi018.stderr:265+0 records out 2024-09-19T09:18:32.852 INFO:teuthology.orchestra.run.smithi018.stderr:277872640 bytes (278 MB, 265 MiB) copied, 0.888197 s, 313 MB/s 2024-09-19T09:18:32.853 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:18:32.853 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:18:32.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:32.869 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2024-09-19T09:18:33.909 INFO:teuthology.orchestra.run.smithi018.stderr:292+0 records in 2024-09-19T09:18:33.910 INFO:teuthology.orchestra.run.smithi018.stderr:292+0 records out 2024-09-19T09:18:33.910 INFO:teuthology.orchestra.run.smithi018.stderr:306184192 bytes (306 MB, 292 MiB) copied, 0.982176 s, 312 MB/s 2024-09-19T09:18:33.910 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2024-09-19T09:18:33.910 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-19T09:18:34.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.011+0000 7f54fc0e4640 1 Processor -- start 2024-09-19T09:18:34.012 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.011+0000 7f54fc0e4640 1 -- start start 2024-09-19T09:18:34.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.012+0000 7f54fc0e4640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f54f4160c50 0x7f54f4167680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:34.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.012+0000 7f54fc0e4640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54f4142650 con 0x7f54f4142150 2024-09-19T09:18:34.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.012+0000 7f54fc0e4640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54f4142930 con 0x7f54f413fae0 2024-09-19T09:18:34.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.012+0000 7f54fc0e4640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f54f40ce780 con 0x7f54f4160c50 2024-09-19T09:18:34.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.012+0000 7f54f967f640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f54f4142150 0x7f54f4160540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:33406/0 (socket says 172.21.15.18:33406) 2024-09-19T09:18:34.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.012+0000 7f54f967f640 1 -- 172.21.15.18:0/3687398585 learned_addr learned my addr 172.21.15.18:0/3687398585 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:34.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.012+0000 7f54f8e7e640 1 -- 172.21.15.18:0/3687398585 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3786059460 0 0) 0x7f54f4142650 con 0x7f54f4142150 2024-09-19T09:18:34.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.013+0000 7f54f8e7e640 1 -- 172.21.15.18:0/3687398585 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54e0003520 con 0x7f54f4142150 2024-09-19T09:18:34.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.013+0000 7f54fa681640 1 --2- 172.21.15.18:0/3687398585 >> v2:172.21.15.162:3300/0 conn(0x7f54f4160c50 0x7f54f4167680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:34.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.013+0000 7f54f8e7e640 1 -- 172.21.15.18:0/3687398585 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4243162791 0 0) 0x7f54e0003520 con 0x7f54f4142150 2024-09-19T09:18:34.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.013+0000 7f54f8e7e640 1 -- 172.21.15.18:0/3687398585 >> v2:172.21.15.162:3300/0 conn(0x7f54f4160c50 msgr2=0x7f54f4167680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:34.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.013+0000 7f54f8e7e640 1 --2- 172.21.15.18:0/3687398585 >> v2:172.21.15.162:3300/0 conn(0x7f54f4160c50 0x7f54f4167680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:34.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.013+0000 7f54f8e7e640 1 -- 172.21.15.18:0/3687398585 >> v1:172.21.15.162:6789/0 conn(0x7f54f413fae0 legacy=0x7f54f406f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:34.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.013+0000 7f54f8e7e640 1 -- 172.21.15.18:0/3687398585 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f4142c10 con 0x7f54f4142150 2024-09-19T09:18:34.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.013+0000 7f54f8e7e640 1 -- 172.21.15.18:0/3687398585 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f54e8001670 con 0x7f54f4142150 2024-09-19T09:18:34.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.013+0000 7f54f8e7e640 1 -- 172.21.15.18:0/3687398585 >> v1:172.21.15.18:6789/0 conn(0x7f54f4142150 legacy=0x7f54f4160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:34.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.013+0000 7f54f8e7e640 1 --2- 172.21.15.18:0/3687398585 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54e00039b0 0x7f54e0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:34.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.013+0000 7f54f8e7e640 1 --2- 172.21.15.18:0/3687398585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54e0004800 0x7f54e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:34.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.013+0000 7f54f8e7e640 1 --2- 172.21.15.18:0/3687398585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54e00051c0 0x7f54e000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:34.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.013+0000 7f54f8e7e640 1 -- 172.21.15.18:0/3687398585 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f54e000c130 con 0x7f54e00051c0 2024-09-19T09:18:34.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.013+0000 7f54f8e7e640 1 -- 172.21.15.18:0/3687398585 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f54e000c2e0 con 0x7f54e0004800 2024-09-19T09:18:34.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.013+0000 7f54f8e7e640 1 -- 172.21.15.18:0/3687398585 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f54e000c4e0 con 0x7f54e00039b0 2024-09-19T09:18:34.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.013+0000 7f54fa681640 1 --2- 172.21.15.18:0/3687398585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54e00051c0 0x7f54e000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:34.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.013+0000 7f54f967f640 1 --2- 172.21.15.18:0/3687398585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54e0004800 0x7f54e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:34.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.013+0000 7f54f9e80640 1 --2- 172.21.15.18:0/3687398585 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54e00039b0 0x7f54e0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:34.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.013+0000 7f54fa681640 1 -- 172.21.15.18:0/3687398585 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54e00039b0 msgr2=0x7f54e0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.013+0000 7f54fa681640 1 --2- 172.21.15.18:0/3687398585 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54e00039b0 0x7f54e0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.013+0000 7f54fa681640 1 -- 172.21.15.18:0/3687398585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54e0004800 msgr2=0x7f54e0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.013+0000 7f54fa681640 1 --2- 172.21.15.18:0/3687398585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54e0004800 0x7f54e0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.013+0000 7f54fa681640 1 -- 172.21.15.18:0/3687398585 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54e0003520 con 0x7f54e00051c0 2024-09-19T09:18:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.014+0000 7f54fa681640 1 -- 172.21.15.18:0/3687398585 reap_dead start 2024-09-19T09:18:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.014+0000 7f54fa681640 1 --2- 172.21.15.18:0/3687398585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54e00051c0 0x7f54e000b9c0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f54f406c7b0 tx=0x7f54e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d869fb8ecbb3da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.014+0000 7f54f8e7e640 1 -- 172.21.15.18:0/3687398585 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ec035020 con 0x7f54e00051c0 2024-09-19T09:18:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.014+0000 7f54f8e7e640 1 -- 172.21.15.18:0/3687398585 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54ec003b90 con 0x7f54e00051c0 2024-09-19T09:18:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.014+0000 7f54f8e7e640 1 -- 172.21.15.18:0/3687398585 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ec009c10 con 0x7f54e00051c0 2024-09-19T09:18:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.015+0000 7f54fc0e4640 1 -- 172.21.15.18:0/3687398585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54e00051c0 msgr2=0x7f54e000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.015+0000 7f54fc0e4640 1 --2- 172.21.15.18:0/3687398585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54e00051c0 0x7f54e000b9c0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f54f406c7b0 tx=0x7f54e0005830 comp rx=0 tx=0).stop 2024-09-19T09:18:34.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.015+0000 7f54fc0e4640 1 -- 172.21.15.18:0/3687398585 shutdown_connections 2024-09-19T09:18:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.015+0000 7f54fc0e4640 1 --2- 172.21.15.18:0/3687398585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54e00051c0 0x7f54e000b9c0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.015+0000 7f54fc0e4640 1 -- 172.21.15.18:0/3687398585 >> 172.21.15.18:0/3687398585 conn(0x7f54f406bc10 msgr2=0x7f54f406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.015+0000 7f54fc0e4640 1 -- 172.21.15.18:0/3687398585 shutdown_connections 2024-09-19T09:18:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.015+0000 7f54fc0e4640 1 -- 172.21.15.18:0/3687398585 wait complete. 2024-09-19T09:18:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.016+0000 7f54fc0e4640 1 Processor -- start 2024-09-19T09:18:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.016+0000 7f54fc0e4640 1 -- start start 2024-09-19T09:18:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.017+0000 7f54fc0e4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54e00051c0 0x7f54f4146160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.017+0000 7f54fc0e4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54f4158b10 0x7f54f41f1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.017+0000 7f54fc0e4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54f415b020 0x7f54f4159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.017+0000 7f54fc0e4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f54f41606c0 con 0x7f54f4158b10 2024-09-19T09:18:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.017+0000 7f54fc0e4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f54f4160540 con 0x7f54e00051c0 2024-09-19T09:18:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.017+0000 7f54fc0e4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f54f4160840 con 0x7f54f415b020 2024-09-19T09:18:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.017+0000 7f54f967f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54f4158b10 0x7f54f41f1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:34.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.017+0000 7f54f967f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54f4158b10 0x7f54f41f1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51512/0 (socket says 172.21.15.18:51512) 2024-09-19T09:18:34.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.017+0000 7f54f967f640 1 -- 172.21.15.18:0/1746270894 learned_addr learned my addr 172.21.15.18:0/1746270894 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:34.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.017+0000 7f54f9e80640 1 --2- 172.21.15.18:0/1746270894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54e00051c0 0x7f54f4146160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:34.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.017+0000 7f54fa681640 1 --2- 172.21.15.18:0/1746270894 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54f415b020 0x7f54f4159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:34.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.017+0000 7f54f967f640 1 -- 172.21.15.18:0/1746270894 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54f415b020 msgr2=0x7f54f4159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:34.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.017+0000 7f54f967f640 1 --2- 172.21.15.18:0/1746270894 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54f415b020 0x7f54f4159030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:34.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.017+0000 7f54f967f640 1 -- 172.21.15.18:0/1746270894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54e00051c0 msgr2=0x7f54f4146160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:34.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.017+0000 7f54f967f640 1 --2- 172.21.15.18:0/1746270894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54e00051c0 0x7f54f4146160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:34.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.017+0000 7f54f967f640 1 -- 172.21.15.18:0/1746270894 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f4144060 con 0x7f54f4158b10 2024-09-19T09:18:34.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.017+0000 7f54f9e80640 1 --2- 172.21.15.18:0/1746270894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54e00051c0 0x7f54f4146160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:18:34.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.017+0000 7f54f967f640 1 --2- 172.21.15.18:0/1746270894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54f4158b10 0x7f54f41f1b90 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f54e8004f50 tx=0x7f54e80074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:34.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.018+0000 7f54e67fc640 1 -- 172.21.15.18:0/1746270894 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e801a070 con 0x7f54f4158b10 2024-09-19T09:18:34.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.018+0000 7f54e67fc640 1 -- 172.21.15.18:0/1746270894 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54e8007740 con 0x7f54f4158b10 2024-09-19T09:18:34.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.018+0000 7f54fc0e4640 1 -- 172.21.15.18:0/1746270894 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54f415b4e0 con 0x7f54f4158b10 2024-09-19T09:18:34.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.018+0000 7f54e67fc640 1 -- 172.21.15.18:0/1746270894 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e800fb80 con 0x7f54f4158b10 2024-09-19T09:18:34.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.018+0000 7f54fc0e4640 1 -- 172.21.15.18:0/1746270894 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54f415baa0 con 0x7f54f4158b10 2024-09-19T09:18:34.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.019+0000 7f54fc0e4640 1 -- 172.21.15.18:0/1746270894 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54f406f1b0 con 0x7f54f4158b10 2024-09-19T09:18:34.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.019+0000 7f54e67fc640 1 -- 172.21.15.18:0/1746270894 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f54e801d070 con 0x7f54f4158b10 2024-09-19T09:18:34.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.020+0000 7f54e67fc640 1 --2- 172.21.15.18:0/1746270894 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f54d806c2b0 0x7f54d806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:34.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.020+0000 7f54e67fc640 1 -- 172.21.15.18:0/1746270894 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5709+0+0 (secure 0 0 0) 0x7f54e808ab20 con 0x7f54f4158b10 2024-09-19T09:18:34.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.020+0000 7f54f9e80640 1 --2- 172.21.15.18:0/1746270894 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f54d806c2b0 0x7f54d806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:34.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.020+0000 7f54f9e80640 1 --2- 172.21.15.18:0/1746270894 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f54d806c2b0 0x7f54d806e770 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f54f0000c00 tx=0x7f54f0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:34.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.024+0000 7f54e67fc640 1 -- 172.21.15.18:0/1746270894 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f54e8058cd0 con 0x7f54f4158b10 2024-09-19T09:18:34.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.199+0000 7f54fc0e4640 1 -- 172.21.15.18:0/1746270894 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f54f4069220 con 0x7f54f4158b10 2024-09-19T09:18:34.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.200+0000 7f54e67fc640 1 -- 172.21.15.18:0/1746270894 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v104) ==== 81+0+34286 (secure 0 0 0) 0x7f54e805cfd0 con 0x7f54f4158b10 2024-09-19T09:18:34.201 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:34.201 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:18:34.201 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 104, 2024-09-19T09:18:34.201 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:18:34.202 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-19T09:13:11.348786+0000", 2024-09-19T09:18:34.202 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-19T09:18:25.435341+0000", 2024-09-19T09:18:34.202 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-19T09:13:16.423937+0000", 2024-09-19T09:18:34.202 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-19T09:13:13.417141+0000", 2024-09-19T09:18:34.202 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-19T09:18:34.202 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-09-19T09:18:34.202 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-19T09:18:34.202 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-19T09:18:34.202 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-19T09:18:34.202 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-19T09:18:34.202 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-19T09:18:34.202 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:18:34.202 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-19T09:18:34.203 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.69999998807907104, 2024-09-19T09:18:34.203 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-19T09:18:34.203 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-19T09:18:34.203 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-19T09:18:34.203 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 13, 2024-09-19T09:18:34.203 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-19T09:18:34.203 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-19T09:18:34.203 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "jewel", 2024-09-19T09:18:34.203 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-19T09:18:34.203 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-19T09:18:34.203 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-19T09:18:34.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.203 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-19T09:18:34.203 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-19T09:18:34.204 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:13:17.564717+0000", 2024-09-19T09:18:34.204 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:18:34.204 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:18:34.204 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:18:34.204 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:18:34.204 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:18:34.204 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:18:34.204 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:18:34.204 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:18:34.204 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:18:34.204 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:18:34.204 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:18:34.204 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:18:34.205 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:18:34.205 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-19T09:18:34.205 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-19T09:18:34.205 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-19T09:18:34.205 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-19T09:18:34.205 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-19T09:18:34.205 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:18:34.205 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:18:34.205 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:18:34.205 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:18:34.205 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:18:34.205 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:18:34.205 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:18:34.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.206 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "96", 2024-09-19T09:18:34.206 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:18:34.206 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:18:34.206 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:18:34.206 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:18:34.206 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:18:34.206 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:18:34.206 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:18:34.206 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:18:34.206 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:18:34.206 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:18:34.206 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:18:34.206 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:18:34.207 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:18:34.207 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:18:34.207 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:18:34.207 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:18:34.207 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:18:34.207 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:18:34.207 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:18:34.207 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:18:34.207 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:18:34.207 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:18:34.207 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:18:34.207 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:18:34.207 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:18:34.207 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:18:34.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.208 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:18:34.208 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:18:34.208 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:18:34.208 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:18:34.208 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:18:34.208 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:18:34.208 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:18:34.208 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:18:34.208 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:18:34.208 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:18:34.208 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:18:34.208 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:18:34.208 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-19T09:18:34.209 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-19T09:18:34.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.209 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:18:34.209 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-19T09:18:34.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.209 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:18:34.209 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:18:34.209 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-19T09:18:34.209 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-19T09:18:34.209 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-19T09:18:34.209 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-19T09:18:34.209 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-19T09:18:34.209 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:18:34.210 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:18:34.210 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:18:34.210 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.210 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 12, 2024-09-19T09:18:34.210 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_metadata", 2024-09-19T09:18:34.210 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:18:21.441414+0000", 2024-09-19T09:18:34.210 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:18:34.210 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:18:34.210 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:18:34.210 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:18:34.210 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:18:34.210 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:18:34.211 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:18:34.211 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:18:34.211 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:18:34.211 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:18:34.211 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:18:34.211 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:18:34.211 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:18:34.211 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-19T09:18:34.211 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-19T09:18:34.211 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-19T09:18:34.211 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-19T09:18:34.211 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-19T09:18:34.211 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:18:34.211 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:18:34.212 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:18:34.212 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:18:34.212 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:18:34.212 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:18:34.212 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:18:34.212 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.212 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "103", 2024-09-19T09:18:34.212 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:18:34.212 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:18:34.212 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:18:34.212 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:18:34.212 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:18:34.212 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:18:34.212 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:18:34.213 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:18:34.213 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:18:34.213 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:18:34.213 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:18:34.213 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:18:34.213 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:18:34.213 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:18:34.213 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:18:34.213 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:18:34.213 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:18:34.213 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:18:34.213 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:18:34.213 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:18:34.213 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:18:34.213 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:18:34.214 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:18:34.214 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:18:34.214 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:18:34.214 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:18:34.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.214 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:18:34.214 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:18:34.214 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:18:34.214 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:18:34.214 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:18:34.214 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:18:34.214 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:18:34.214 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:18:34.215 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:18:34.215 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:18:34.215 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:18:34.215 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:18:34.215 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4, 2024-09-19T09:18:34.215 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 16, 2024-09-19T09:18:34.215 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_priority": 5 2024-09-19T09:18:34.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.215 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:18:34.215 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:18:34.215 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": "cephfs" 2024-09-19T09:18:34.215 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.216 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:18:34.216 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:18:34.216 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.75, 2024-09-19T09:18:34.216 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.75, 2024-09-19T09:18:34.216 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:18:34.216 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.75, 2024-09-19T09:18:34.216 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.75, 2024-09-19T09:18:34.216 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:18:34.216 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:18:34.216 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:18:34.216 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.216 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 13, 2024-09-19T09:18:34.217 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_data", 2024-09-19T09:18:34.217 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:18:22.767737+0000", 2024-09-19T09:18:34.217 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:18:34.217 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:18:34.217 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:18:34.217 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:18:34.217 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:18:34.217 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:18:34.217 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:18:34.217 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:18:34.217 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:18:34.217 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:18:34.217 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:18:34.218 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:18:34.218 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:18:34.218 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 64, 2024-09-19T09:18:34.218 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 64, 2024-09-19T09:18:34.218 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 64, 2024-09-19T09:18:34.218 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 64, 2024-09-19T09:18:34.218 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 64, 2024-09-19T09:18:34.218 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:18:34.218 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:18:34.218 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:18:34.218 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:18:34.218 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:18:34.218 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:18:34.219 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:18:34.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.219 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "104", 2024-09-19T09:18:34.219 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:18:34.219 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:18:34.219 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:18:34.219 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:18:34.219 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:18:34.219 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:18:34.219 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:18:34.219 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:18:34.219 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:18:34.219 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:18:34.219 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:18:34.220 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:18:34.220 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:18:34.220 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:18:34.220 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:18:34.220 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:18:34.220 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:18:34.220 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:18:34.220 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:18:34.220 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:18:34.220 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:18:34.220 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:18:34.220 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:18:34.220 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:18:34.221 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:18:34.221 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:18:34.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.221 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:18:34.221 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:18:34.221 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:18:34.221 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:18:34.221 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:18:34.221 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:18:34.221 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:18:34.221 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:18:34.221 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:18:34.221 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:18:34.222 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:18:34.222 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:18:34.222 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 64, 2024-09-19T09:18:34.222 INFO:teuthology.orchestra.run.smithi018.stdout: "target_size_ratio": 0.89999997615814209 2024-09-19T09:18:34.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.222 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:18:34.222 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:18:34.222 INFO:teuthology.orchestra.run.smithi018.stdout: "data": "cephfs" 2024-09-19T09:18:34.222 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.222 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:18:34.222 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:18:34.222 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.3799999952316284, 2024-09-19T09:18:34.223 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.3799999952316284, 2024-09-19T09:18:34.223 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:18:34.223 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-19T09:18:34.223 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-19T09:18:34.223 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:18:34.223 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:18:34.223 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:18:34.223 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.223 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.223 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:18:34.223 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-19T09:18:34.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.223 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:18:34.223 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:34.224 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:34.224 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:34.224 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:34.224 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:34.224 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:34.224 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:34.224 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:34.224 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:34.224 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:34.224 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:34.224 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:34.224 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.224 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.225 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-19T09:18:34.225 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:34.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.225 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.225 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-19T09:18:34.225 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:34.225 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.225 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.226 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:34.226 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.226 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.226 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-19T09:18:34.226 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:34.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.226 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.226 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-19T09:18:34.226 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:34.226 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.227 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.227 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:34.227 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.227 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.227 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-19T09:18:34.227 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:34.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.227 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.227 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-19T09:18:34.227 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:34.227 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.228 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.228 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:34.228 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.228 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.228 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-19T09:18:34.228 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:34.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.229 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.229 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-19T09:18:34.229 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:34.229 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.229 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.229 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/128722874", 2024-09-19T09:18:34.229 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/128722874", 2024-09-19T09:18:34.229 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/128722874", 2024-09-19T09:18:34.229 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/128722874", 2024-09-19T09:18:34.229 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:34.229 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:34.230 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:34.230 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.230 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.230 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:18:34.230 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:34.230 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:34.230 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:34.230 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:34.230 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:34.230 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:34.230 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:34.230 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:34.230 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:34.231 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:34.231 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:34.231 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:34.231 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.231 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.231 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-19T09:18:34.231 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:34.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.231 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.231 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-19T09:18:34.231 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:34.231 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.232 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.232 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:34.232 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.232 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.232 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-19T09:18:34.232 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:34.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.232 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.232 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-19T09:18:34.232 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:34.232 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.233 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.233 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:34.233 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.233 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.233 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-19T09:18:34.233 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:34.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.233 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.233 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-19T09:18:34.233 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:34.234 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.234 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.234 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:34.234 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.234 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.234 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-19T09:18:34.234 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:34.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.234 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.234 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-19T09:18:34.234 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:34.235 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.235 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.235 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/3672199638", 2024-09-19T09:18:34.235 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/3672199638", 2024-09-19T09:18:34.235 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/3672199638", 2024-09-19T09:18:34.235 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/3672199638", 2024-09-19T09:18:34.235 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:34.235 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:34.235 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:34.235 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.235 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:18:34.236 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:34.236 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:34.236 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:34.236 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:34.236 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:34.236 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:34.236 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:34.236 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:34.236 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:34.236 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:34.236 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:34.236 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:34.236 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.237 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.237 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T09:18:34.237 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:34.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.237 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.237 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T09:18:34.237 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:34.237 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.237 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.237 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:34.238 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.238 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.238 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-19T09:18:34.238 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:34.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.238 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.238 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-19T09:18:34.238 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:34.238 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.238 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.239 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:34.239 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.239 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.239 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-19T09:18:34.239 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:34.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.239 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.239 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-19T09:18:34.239 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:34.239 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.239 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.240 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:34.240 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.240 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.240 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-19T09:18:34.240 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:34.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.240 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.240 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-19T09:18:34.240 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:34.240 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.241 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.241 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3463367841", 2024-09-19T09:18:34.241 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3463367841", 2024-09-19T09:18:34.241 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3463367841", 2024-09-19T09:18:34.241 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3463367841", 2024-09-19T09:18:34.241 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:34.241 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:34.241 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:34.241 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.241 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.241 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.241 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:18:34.242 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:34.242 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:34.242 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:34.242 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:34.242 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:34.242 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:34.242 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:34.242 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:34.242 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:34.242 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:34.242 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:34.242 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:34.242 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.243 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.243 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-19T09:18:34.243 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:34.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.243 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.243 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-19T09:18:34.243 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:34.243 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.243 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.243 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:34.243 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.244 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.244 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-19T09:18:34.244 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:34.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.244 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.244 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-19T09:18:34.244 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:34.244 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.244 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.245 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:34.245 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.245 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.245 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-19T09:18:34.245 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:34.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.245 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.245 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-19T09:18:34.245 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:34.245 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.245 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.246 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:34.246 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.246 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.247 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-19T09:18:34.247 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:34.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.247 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.247 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-19T09:18:34.247 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:34.247 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.247 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.247 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.247 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/4163178582", 2024-09-19T09:18:34.247 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/4163178582", 2024-09-19T09:18:34.247 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/4163178582", 2024-09-19T09:18:34.248 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/4163178582", 2024-09-19T09:18:34.248 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:34.248 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:34.248 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:34.248 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.248 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:18:34.248 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:34.248 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:34.248 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:34.248 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:34.248 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:34.249 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:34.249 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:34.249 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:34.249 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:34.249 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:34.249 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:34.249 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:34.249 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.249 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.249 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6822", 2024-09-19T09:18:34.249 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:34.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.250 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.250 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6824", 2024-09-19T09:18:34.250 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:34.250 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.250 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.250 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:34.250 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.250 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.250 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6826", 2024-09-19T09:18:34.250 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:34.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.251 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.251 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6827", 2024-09-19T09:18:34.251 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:34.251 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.251 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.251 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:34.251 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.251 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.251 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6830", 2024-09-19T09:18:34.252 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:34.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.252 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.252 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6831", 2024-09-19T09:18:34.252 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:34.252 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.252 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.252 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:34.252 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.252 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.252 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6828", 2024-09-19T09:18:34.253 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:34.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.253 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.253 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6829", 2024-09-19T09:18:34.253 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:34.253 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.253 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.253 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6824/3538482215", 2024-09-19T09:18:34.253 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6827/3538482215", 2024-09-19T09:18:34.253 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6831/3538482215", 2024-09-19T09:18:34.253 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6829/3538482215", 2024-09-19T09:18:34.254 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:34.254 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:34.254 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:34.254 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.254 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:18:34.254 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:34.254 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:34.254 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:34.254 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:34.254 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:34.254 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:34.254 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:34.255 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:34.255 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:34.255 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:34.255 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:34.255 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:34.255 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.255 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.255 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6800", 2024-09-19T09:18:34.255 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:34.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.255 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.256 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6801", 2024-09-19T09:18:34.256 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:34.256 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.256 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.256 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:34.256 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.256 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.256 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6802", 2024-09-19T09:18:34.256 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:34.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.256 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.257 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6803", 2024-09-19T09:18:34.257 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:34.257 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.257 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.257 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:34.257 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.257 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.257 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6806", 2024-09-19T09:18:34.257 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:34.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.257 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.258 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.258 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6807", 2024-09-19T09:18:34.258 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:34.258 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.258 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.258 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:34.258 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.258 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.258 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6804", 2024-09-19T09:18:34.258 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:34.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.259 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.259 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6805", 2024-09-19T09:18:34.259 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:34.259 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.259 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.259 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6801/2408698413", 2024-09-19T09:18:34.259 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6803/2408698413", 2024-09-19T09:18:34.259 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6807/2408698413", 2024-09-19T09:18:34.259 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6805/2408698413", 2024-09-19T09:18:34.259 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:34.259 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:34.260 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:34.260 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.260 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:18:34.260 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:34.260 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:34.260 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:34.260 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:34.260 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:34.260 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:34.261 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:34.261 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:34.261 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:34.261 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:34.261 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:34.261 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:34.261 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.261 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.261 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6808", 2024-09-19T09:18:34.261 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:34.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.262 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.262 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6809", 2024-09-19T09:18:34.263 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:34.263 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.263 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.263 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:34.263 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.263 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.263 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6810", 2024-09-19T09:18:34.263 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:34.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.263 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.263 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6811", 2024-09-19T09:18:34.264 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:34.264 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.264 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.264 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:34.264 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.264 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.264 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6814", 2024-09-19T09:18:34.264 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:34.264 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.264 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.264 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.265 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6815", 2024-09-19T09:18:34.265 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:34.265 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.265 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.265 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:34.265 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.265 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.265 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.265 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6812", 2024-09-19T09:18:34.265 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:34.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.266 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.266 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.266 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6813", 2024-09-19T09:18:34.266 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:34.266 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.266 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.266 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.266 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6809/2596207948", 2024-09-19T09:18:34.266 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6811/2596207948", 2024-09-19T09:18:34.266 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6815/2596207948", 2024-09-19T09:18:34.266 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6813/2596207948", 2024-09-19T09:18:34.266 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:34.266 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:34.267 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:34.267 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.267 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.267 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.267 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:18:34.267 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:34.267 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:34.267 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:34.267 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:34.267 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:34.267 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:34.267 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:34.268 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:34.268 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:34.268 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:34.268 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:34.268 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:34.268 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.268 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.268 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6816", 2024-09-19T09:18:34.268 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:34.268 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.268 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.268 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.268 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6817", 2024-09-19T09:18:34.269 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:34.269 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.269 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.269 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:34.269 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.269 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.269 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6818", 2024-09-19T09:18:34.269 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:34.269 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.269 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.269 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.269 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6819", 2024-09-19T09:18:34.270 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:34.270 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.270 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.270 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:34.270 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.270 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.270 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6823", 2024-09-19T09:18:34.270 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:34.270 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.270 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.270 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.271 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6825", 2024-09-19T09:18:34.271 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:34.271 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.271 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.271 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:34.271 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:34.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.271 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:34.271 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6820", 2024-09-19T09:18:34.271 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:34.271 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.271 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.271 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:34.272 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6821", 2024-09-19T09:18:34.272 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:34.272 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.272 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.272 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.272 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6817/1334618296", 2024-09-19T09:18:34.272 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6819/1334618296", 2024-09-19T09:18:34.272 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6825/1334618296", 2024-09-19T09:18:34.272 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6821/1334618296", 2024-09-19T09:18:34.272 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:34.272 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:34.272 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:34.273 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:34.273 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.273 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:18:34.273 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-19T09:18:34.273 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.273 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:18:34.273 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:34.273 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:34.273 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:34.273 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:34.273 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:34.273 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.580838+0000", 2024-09-19T09:18:34.273 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:34.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.274 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:18:34.274 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:34.274 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:34.274 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:34.274 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:34.274 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:34.274 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.599990+0000", 2024-09-19T09:18:34.274 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:34.274 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.274 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.274 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:18:34.274 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:34.275 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:34.275 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:34.275 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:34.275 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:34.275 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.503722+0000", 2024-09-19T09:18:34.275 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:34.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.276 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:18:34.276 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:34.276 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:34.276 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:34.276 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:34.276 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:34.276 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.607846+0000", 2024-09-19T09:18:34.276 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:34.276 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.276 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.277 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:18:34.277 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:34.277 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:34.277 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:34.277 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:34.277 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:34.277 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.616858+0000", 2024-09-19T09:18:34.277 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:34.277 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.277 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.277 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:18:34.277 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:34.277 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:34.278 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:34.278 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:34.278 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:34.278 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.542726+0000", 2024-09-19T09:18:34.278 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:34.278 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.278 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.278 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:18:34.278 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:34.279 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:34.279 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:34.279 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:34.279 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:34.279 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.534178+0000", 2024-09-19T09:18:34.279 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:34.279 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.279 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:34.279 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:18:34.279 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:34.279 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:34.279 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:34.280 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:34.280 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:34.280 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.612105+0000", 2024-09-19T09:18:34.280 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:34.280 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.280 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:18:34.280 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-19T09:18:34.280 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-19T09:18:34.280 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-19T09:18:34.280 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-19T09:18:34.280 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-19T09:18:34.280 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-19T09:18:34.280 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-19T09:18:34.281 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-19T09:18:34.281 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-19T09:18:34.281 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-19T09:18:34.281 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-19T09:18:34.281 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-19T09:18:34.281 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-19T09:18:34.281 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-19T09:18:34.281 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.281 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:34.281 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-19T09:18:34.281 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-19T09:18:34.281 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-19T09:18:34.281 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-19T09:18:34.281 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-19T09:18:34.282 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-19T09:18:34.282 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-19T09:18:34.282 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-19T09:18:34.282 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-19T09:18:34.282 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-19T09:18:34.282 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-19T09:18:34.282 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:34.282 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:18:34.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.202+0000 7f54fc0e4640 1 -- 172.21.15.18:0/1746270894 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f54d806c2b0 msgr2=0x7f54d806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:34.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.202+0000 7f54fc0e4640 1 --2- 172.21.15.18:0/1746270894 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f54d806c2b0 0x7f54d806e770 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f54f0000c00 tx=0x7f54f0009040 comp rx=0 tx=0).stop 2024-09-19T09:18:34.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.202+0000 7f54fc0e4640 1 -- 172.21.15.18:0/1746270894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54f4158b10 msgr2=0x7f54f41f1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:34.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.202+0000 7f54fc0e4640 1 --2- 172.21.15.18:0/1746270894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54f4158b10 0x7f54f41f1b90 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f54e8004f50 tx=0x7f54e80074f0 comp rx=0 tx=0).stop 2024-09-19T09:18:34.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.202+0000 7f54fc0e4640 1 -- 172.21.15.18:0/1746270894 shutdown_connections 2024-09-19T09:18:34.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.202+0000 7f54fc0e4640 1 --2- 172.21.15.18:0/1746270894 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f54d806c2b0 0x7f54d806e770 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:34.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.202+0000 7f54fc0e4640 1 --2- 172.21.15.18:0/1746270894 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54f415b020 0x7f54f4159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:34.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.202+0000 7f54fc0e4640 1 --2- 172.21.15.18:0/1746270894 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54f4158b10 0x7f54f41f1b90 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:34.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.202+0000 7f54fc0e4640 1 --2- 172.21.15.18:0/1746270894 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54e00051c0 0x7f54f4146160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:34.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.202+0000 7f54fc0e4640 1 -- 172.21.15.18:0/1746270894 >> 172.21.15.18:0/1746270894 conn(0x7f54f406bc10 msgr2=0x7f54f415f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:34.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.202+0000 7f54fc0e4640 1 -- 172.21.15.18:0/1746270894 shutdown_connections 2024-09-19T09:18:34.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:34.202+0000 7f54fc0e4640 1 -- 172.21.15.18:0/1746270894 wait complete. 2024-09-19T09:18:34.285 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-19T09:18:35.651 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-19T09:18:35.651+0000 7fca8cfa1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2024-09-19T09:18:39.285 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-19T09:18:39.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.400+0000 7f3477df1640 1 Processor -- start 2024-09-19T09:18:39.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.400+0000 7f3477df1640 1 -- start start 2024-09-19T09:18:39.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.401+0000 7f3477df1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f347015ef80 0x7f34700b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:39.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.401+0000 7f3477df1640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f34700cfae0 0x7f34700cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:39.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.401+0000 7f3477df1640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34700cd1a0 con 0x7f347006d730 2024-09-19T09:18:39.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.401+0000 7f3477df1640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f34700cd7d0 con 0x7f34700cfae0 2024-09-19T09:18:39.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.401+0000 7f3477df1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f347006dc30 con 0x7f347015ef80 2024-09-19T09:18:39.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.401+0000 7f347538c640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f347006d730 0x7f34700cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:35480/0 (socket says 172.21.15.18:35480) 2024-09-19T09:18:39.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.401+0000 7f3475b8d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f347015ef80 0x7f34700b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:39.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.401+0000 7f347638e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f34700cfae0 0x7f34700cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:39.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.401+0000 7f347538c640 1 -- 172.21.15.18:0/4171201350 learned_addr learned my addr 172.21.15.18:0/4171201350 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:39.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.402+0000 7f3474b8b640 1 -- 172.21.15.18:0/4171201350 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2362283238 0 0) 0x7f34700cd1a0 con 0x7f347006d730 2024-09-19T09:18:39.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.402+0000 7f3474b8b640 1 -- 172.21.15.18:0/4171201350 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f345c003520 con 0x7f347006d730 2024-09-19T09:18:39.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.402+0000 7f3475b8d640 1 -- 172.21.15.18:0/4171201350 >> v2:172.21.15.162:3300/0 conn(0x7f34700cfae0 msgr2=0x7f34700cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:39.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.402+0000 7f3475b8d640 1 --2- 172.21.15.18:0/4171201350 >> v2:172.21.15.162:3300/0 conn(0x7f34700cfae0 0x7f34700cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:39.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.402+0000 7f3475b8d640 1 -- 172.21.15.18:0/4171201350 >> v1:172.21.15.162:6789/0 conn(0x7f347006d730 legacy=0x7f34700cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:39.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.402+0000 7f3475b8d640 1 -- 172.21.15.18:0/4171201350 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f347006df10 con 0x7f347015ef80 2024-09-19T09:18:39.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.402+0000 7f347638e640 1 --2- 172.21.15.18:0/4171201350 >> v2:172.21.15.162:3300/0 conn(0x7f34700cfae0 0x7f34700cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:18:39.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.403+0000 7f3475b8d640 1 --2- 172.21.15.18:0/4171201350 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f347015ef80 0x7f34700b5220 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f346c0097a0 tx=0x7f346c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49472b4d99bc7eaa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:39.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.403+0000 7f3474b8b640 1 -- 172.21.15.18:0/4171201350 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c037070 con 0x7f347015ef80 2024-09-19T09:18:39.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.403+0000 7f3474b8b640 1 -- 172.21.15.18:0/4171201350 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f346c032440 con 0x7f347015ef80 2024-09-19T09:18:39.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.403+0000 7f3474b8b640 1 -- 172.21.15.18:0/4171201350 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c032810 con 0x7f347015ef80 2024-09-19T09:18:39.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.403+0000 7f3477df1640 1 -- 172.21.15.18:0/4171201350 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f347015ef80 msgr2=0x7f34700b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:39.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.403+0000 7f3477df1640 1 --2- 172.21.15.18:0/4171201350 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f347015ef80 0x7f34700b5220 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f346c0097a0 tx=0x7f346c02a180 comp rx=0 tx=0).stop 2024-09-19T09:18:39.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.404+0000 7f3477df1640 1 -- 172.21.15.18:0/4171201350 shutdown_connections 2024-09-19T09:18:39.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.404+0000 7f3477df1640 1 --2- 172.21.15.18:0/4171201350 >> v2:172.21.15.162:3300/0 conn(0x7f34700cfae0 0x7f34700cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:39.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.404+0000 7f3477df1640 1 --2- 172.21.15.18:0/4171201350 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f347015ef80 0x7f34700b5220 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:39.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.404+0000 7f3477df1640 1 -- 172.21.15.18:0/4171201350 >> 172.21.15.18:0/4171201350 conn(0x7f34700b4700 msgr2=0x7f34700b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:39.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.404+0000 7f3477df1640 1 -- 172.21.15.18:0/4171201350 shutdown_connections 2024-09-19T09:18:39.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.404+0000 7f3477df1640 1 -- 172.21.15.18:0/4171201350 wait complete. 2024-09-19T09:18:39.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.405+0000 7f3477df1640 1 Processor -- start 2024-09-19T09:18:39.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.405+0000 7f3477df1640 1 -- start start 2024-09-19T09:18:39.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.406+0000 7f3477df1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f347006d730 0x7f34700b7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:39.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.406+0000 7f3477df1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34700cfae0 0x7f34700cc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:39.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.406+0000 7f3477df1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f347015ef80 0x7f34700c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:39.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.406+0000 7f3477df1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f34700d0120 con 0x7f34700cfae0 2024-09-19T09:18:39.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.406+0000 7f3477df1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f347015f360 con 0x7f347006d730 2024-09-19T09:18:39.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.406+0000 7f3477df1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f34700ce1a0 con 0x7f347015ef80 2024-09-19T09:18:39.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.406+0000 7f347538c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34700cfae0 0x7f34700cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:39.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.406+0000 7f347538c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34700cfae0 0x7f34700cc420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38156/0 (socket says 172.21.15.18:38156) 2024-09-19T09:18:39.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.406+0000 7f347538c640 1 -- 172.21.15.18:0/1064930525 learned_addr learned my addr 172.21.15.18:0/1064930525 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:39.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.406+0000 7f3475b8d640 1 --2- 172.21.15.18:0/1064930525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f347006d730 0x7f34700b7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:39.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.406+0000 7f347638e640 1 --2- 172.21.15.18:0/1064930525 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f347015ef80 0x7f34700c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:39.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.406+0000 7f347538c640 1 -- 172.21.15.18:0/1064930525 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f347015ef80 msgr2=0x7f34700c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:39.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.406+0000 7f347538c640 1 --2- 172.21.15.18:0/1064930525 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f347015ef80 0x7f34700c8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:39.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.406+0000 7f347538c640 1 -- 172.21.15.18:0/1064930525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f347006d730 msgr2=0x7f34700b7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:39.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.406+0000 7f347538c640 1 --2- 172.21.15.18:0/1064930525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f347006d730 0x7f34700b7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:39.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.406+0000 7f347538c640 1 -- 172.21.15.18:0/1064930525 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34700c9370 con 0x7f34700cfae0 2024-09-19T09:18:39.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.406+0000 7f347538c640 1 --2- 172.21.15.18:0/1064930525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34700cfae0 0x7f34700cc420 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f346000c430 tx=0x7f346000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:39.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.407+0000 7f34667fc640 1 -- 172.21.15.18:0/1064930525 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3460017070 con 0x7f34700cfae0 2024-09-19T09:18:39.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.407+0000 7f34667fc640 1 -- 172.21.15.18:0/1064930525 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3460005ce0 con 0x7f34700cfae0 2024-09-19T09:18:39.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.407+0000 7f3477df1640 1 -- 172.21.15.18:0/1064930525 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34700caa30 con 0x7f34700cfae0 2024-09-19T09:18:39.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.407+0000 7f34667fc640 1 -- 172.21.15.18:0/1064930525 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34600072f0 con 0x7f34700cfae0 2024-09-19T09:18:39.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.407+0000 7f3477df1640 1 -- 172.21.15.18:0/1064930525 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34700cbf00 con 0x7f34700cfae0 2024-09-19T09:18:39.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.408+0000 7f3477df1640 1 -- 172.21.15.18:0/1064930525 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34700caf50 con 0x7f34700cfae0 2024-09-19T09:18:39.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.408+0000 7f34667fc640 1 -- 172.21.15.18:0/1064930525 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f346001a070 con 0x7f34700cfae0 2024-09-19T09:18:39.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.409+0000 7f34667fc640 1 --2- 172.21.15.18:0/1064930525 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f345406c2b0 0x7f345406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:39.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.409+0000 7f34667fc640 1 -- 172.21.15.18:0/1064930525 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7f346008a760 con 0x7f34700cfae0 2024-09-19T09:18:39.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.409+0000 7f34667fc640 1 -- 172.21.15.18:0/1064930525 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=108}) -- 0x7f3454073de0 con 0x7f34700cfae0 2024-09-19T09:18:39.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.409+0000 7f3475b8d640 1 --2- 172.21.15.18:0/1064930525 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f345406c2b0 0x7f345406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:39.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.410+0000 7f3475b8d640 1 --2- 172.21.15.18:0/1064930525 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f345406c2b0 0x7f345406e770 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f346c034000 tx=0x7f346c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:39.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.413+0000 7f34667fc640 1 -- 172.21.15.18:0/1064930525 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3460007e20 con 0x7f34700cfae0 2024-09-19T09:18:39.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.591+0000 7f3477df1640 1 -- 172.21.15.18:0/1064930525 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f34700cff00 con 0x7f34700cfae0 2024-09-19T09:18:39.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.592+0000 7f34667fc640 1 -- 172.21.15.18:0/1064930525 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v107) ==== 81+0+34462 (secure 0 0 0) 0x7f3460058760 con 0x7f34700cfae0 2024-09-19T09:18:39.593 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:39.593 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:18:39.593 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 107, 2024-09-19T09:18:39.594 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:18:39.594 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-19T09:13:11.348786+0000", 2024-09-19T09:18:39.594 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-19T09:18:37.710547+0000", 2024-09-19T09:18:39.594 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-19T09:13:16.423937+0000", 2024-09-19T09:18:39.594 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-19T09:13:13.417141+0000", 2024-09-19T09:18:39.594 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-19T09:18:39.594 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-09-19T09:18:39.594 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-19T09:18:39.594 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-19T09:18:39.594 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-19T09:18:39.594 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-19T09:18:39.594 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-19T09:18:39.594 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:18:39.595 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-19T09:18:39.595 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.69999998807907104, 2024-09-19T09:18:39.595 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-19T09:18:39.595 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-19T09:18:39.595 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-19T09:18:39.595 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 13, 2024-09-19T09:18:39.595 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-19T09:18:39.595 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-19T09:18:39.595 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "jewel", 2024-09-19T09:18:39.595 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-19T09:18:39.595 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-19T09:18:39.595 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-19T09:18:39.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.595 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-19T09:18:39.596 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-19T09:18:39.596 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:13:17.564717+0000", 2024-09-19T09:18:39.596 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 3, 2024-09-19T09:18:39.596 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full", 2024-09-19T09:18:39.596 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:18:39.596 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:18:39.596 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:18:39.596 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:18:39.596 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:18:39.596 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:18:39.596 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:18:39.596 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:18:39.596 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:18:39.596 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:18:39.597 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:18:39.597 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-19T09:18:39.597 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-19T09:18:39.597 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-19T09:18:39.597 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-19T09:18:39.597 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-19T09:18:39.597 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:18:39.597 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:18:39.597 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:18:39.597 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:18:39.597 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:18:39.597 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:18:39.597 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:18:39.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.598 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "105", 2024-09-19T09:18:39.598 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:18:39.598 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:18:39.598 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:18:39.598 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:18:39.598 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:18:39.598 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:18:39.598 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:18:39.598 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:18:39.598 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:18:39.598 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:18:39.598 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:18:39.598 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:18:39.598 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:18:39.599 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:18:39.599 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:18:39.599 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:18:39.599 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:18:39.599 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:18:39.599 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:18:39.599 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:18:39.599 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:18:39.599 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:18:39.599 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:18:39.599 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:18:39.599 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:18:39.599 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:18:39.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.600 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:18:39.600 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:18:39.600 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:18:39.600 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:18:39.600 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:18:39.600 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:18:39.600 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:18:39.600 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:18:39.600 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:18:39.600 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:18:39.600 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:18:39.600 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:18:39.600 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-19T09:18:39.600 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-19T09:18:39.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.601 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:18:39.601 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-19T09:18:39.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.601 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:18:39.601 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:18:39.601 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-19T09:18:39.601 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-19T09:18:39.601 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-19T09:18:39.601 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-19T09:18:39.601 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-19T09:18:39.601 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:18:39.601 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:18:39.602 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:18:39.602 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.602 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 12, 2024-09-19T09:18:39.602 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_metadata", 2024-09-19T09:18:39.602 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:18:21.441414+0000", 2024-09-19T09:18:39.602 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 3, 2024-09-19T09:18:39.602 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full", 2024-09-19T09:18:39.602 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:18:39.602 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:18:39.602 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:18:39.602 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:18:39.602 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:18:39.602 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:18:39.603 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:18:39.603 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:18:39.603 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:18:39.603 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:18:39.603 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:18:39.603 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-19T09:18:39.603 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-19T09:18:39.603 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-19T09:18:39.603 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-19T09:18:39.603 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-19T09:18:39.603 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:18:39.603 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:18:39.603 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:18:39.604 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:18:39.604 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:18:39.604 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:18:39.604 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:18:39.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.604 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "105", 2024-09-19T09:18:39.604 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:18:39.604 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:18:39.604 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:18:39.604 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:18:39.604 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:18:39.604 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:18:39.604 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:18:39.604 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:18:39.605 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:18:39.605 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:18:39.605 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:18:39.605 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:18:39.605 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:18:39.605 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:18:39.605 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:18:39.605 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:18:39.605 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:18:39.605 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:18:39.605 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:18:39.605 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:18:39.605 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:18:39.605 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:18:39.606 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:18:39.606 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:18:39.606 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:18:39.606 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:18:39.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.606 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:18:39.606 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:18:39.606 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:18:39.606 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:18:39.606 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:18:39.606 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:18:39.606 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:18:39.606 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:18:39.606 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:18:39.607 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:18:39.607 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:18:39.607 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:18:39.607 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4, 2024-09-19T09:18:39.607 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 16, 2024-09-19T09:18:39.607 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_priority": 5 2024-09-19T09:18:39.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.607 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:18:39.607 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:18:39.607 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": "cephfs" 2024-09-19T09:18:39.607 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.607 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:18:39.607 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:18:39.608 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.75, 2024-09-19T09:18:39.608 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.75, 2024-09-19T09:18:39.608 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:18:39.608 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.75, 2024-09-19T09:18:39.608 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.75, 2024-09-19T09:18:39.608 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:18:39.608 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:18:39.608 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:18:39.608 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.608 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 13, 2024-09-19T09:18:39.608 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_data", 2024-09-19T09:18:39.608 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:18:22.767737+0000", 2024-09-19T09:18:39.609 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 3, 2024-09-19T09:18:39.609 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full", 2024-09-19T09:18:39.609 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:18:39.609 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:18:39.609 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:18:39.609 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:18:39.609 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:18:39.609 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:18:39.609 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:18:39.609 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:18:39.609 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:18:39.609 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:18:39.609 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:18:39.610 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 64, 2024-09-19T09:18:39.610 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 64, 2024-09-19T09:18:39.610 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 64, 2024-09-19T09:18:39.610 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 64, 2024-09-19T09:18:39.610 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 64, 2024-09-19T09:18:39.610 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:18:39.610 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:18:39.610 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:18:39.610 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:18:39.610 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:18:39.610 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:18:39.610 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:18:39.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.610 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "105", 2024-09-19T09:18:39.610 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:18:39.611 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:18:39.611 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:18:39.611 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:18:39.611 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:18:39.611 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:18:39.611 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:18:39.611 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:18:39.611 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:18:39.611 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:18:39.611 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:18:39.611 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:18:39.611 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:18:39.611 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:18:39.611 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:18:39.612 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:18:39.612 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:18:39.612 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:18:39.612 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:18:39.612 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:18:39.612 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:18:39.612 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:18:39.612 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:18:39.612 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:18:39.612 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:18:39.612 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:18:39.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.612 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:18:39.612 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:18:39.613 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:18:39.613 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:18:39.613 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:18:39.613 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:18:39.613 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:18:39.613 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:18:39.613 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:18:39.613 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:18:39.613 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:18:39.613 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:18:39.613 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 64, 2024-09-19T09:18:39.613 INFO:teuthology.orchestra.run.smithi018.stdout: "target_size_ratio": 0.89999997615814209 2024-09-19T09:18:39.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.614 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:18:39.614 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:18:39.614 INFO:teuthology.orchestra.run.smithi018.stdout: "data": "cephfs" 2024-09-19T09:18:39.614 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.614 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:18:39.614 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:18:39.614 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.3799999952316284, 2024-09-19T09:18:39.614 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.3799999952316284, 2024-09-19T09:18:39.614 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:18:39.614 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-19T09:18:39.614 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-19T09:18:39.614 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:18:39.614 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:18:39.615 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:18:39.615 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.615 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.615 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:18:39.615 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-19T09:18:39.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.615 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:18:39.615 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:39.615 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:39.615 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:39.615 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:39.615 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:39.615 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:39.615 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:39.616 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:39.616 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:39.616 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:39.616 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:39.616 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:39.616 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.616 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.616 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-19T09:18:39.616 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:39.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.616 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.616 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-19T09:18:39.617 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:39.617 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.617 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.617 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:39.617 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.617 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.617 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-19T09:18:39.617 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:39.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.617 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.617 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-19T09:18:39.618 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:39.618 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.618 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.618 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:39.618 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.618 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.618 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-19T09:18:39.618 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:39.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.618 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.618 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-19T09:18:39.619 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:39.619 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.619 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.619 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:39.619 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.619 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.619 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-19T09:18:39.619 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:39.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.619 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.619 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.619 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-19T09:18:39.620 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:39.620 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.620 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.620 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/128722874", 2024-09-19T09:18:39.620 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/128722874", 2024-09-19T09:18:39.620 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/128722874", 2024-09-19T09:18:39.620 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/128722874", 2024-09-19T09:18:39.620 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:39.620 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:39.620 INFO:teuthology.orchestra.run.smithi018.stdout: "full", 2024-09-19T09:18:39.620 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:39.620 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.621 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:18:39.621 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:39.621 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:39.621 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:39.621 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:39.621 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:39.621 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:39.621 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:39.621 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:39.621 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:39.622 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:39.622 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:39.622 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:39.622 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.622 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.622 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-19T09:18:39.622 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:39.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.622 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.622 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-19T09:18:39.622 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:39.623 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.623 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.623 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:39.623 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.623 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.623 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-19T09:18:39.623 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:39.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.623 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.623 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-19T09:18:39.623 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:39.624 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.624 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.624 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:39.624 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.624 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.624 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-19T09:18:39.624 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:39.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.624 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.624 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-19T09:18:39.624 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:39.625 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.625 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.625 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:39.625 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.625 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.625 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-19T09:18:39.625 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:39.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.625 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.625 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-19T09:18:39.625 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:39.625 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.626 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.626 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/3672199638", 2024-09-19T09:18:39.626 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/3672199638", 2024-09-19T09:18:39.626 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/3672199638", 2024-09-19T09:18:39.626 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/3672199638", 2024-09-19T09:18:39.626 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:39.626 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull", 2024-09-19T09:18:39.626 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:39.626 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:39.626 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.627 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:18:39.627 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:39.627 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:39.627 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:39.627 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:39.627 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:39.627 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:39.627 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:39.627 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:39.627 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:39.627 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:39.627 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:39.627 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:39.627 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.628 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.628 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T09:18:39.628 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:39.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.628 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.628 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T09:18:39.628 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:39.628 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.628 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.628 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:39.628 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.629 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.629 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-19T09:18:39.629 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:39.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.629 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.629 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-19T09:18:39.629 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:39.629 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.629 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.629 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:39.629 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.630 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.630 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-19T09:18:39.630 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:39.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.630 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.630 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-19T09:18:39.630 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:39.630 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.630 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.630 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:39.630 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.631 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.631 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-19T09:18:39.631 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:39.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.631 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.631 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-19T09:18:39.631 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:39.631 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.631 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.631 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3463367841", 2024-09-19T09:18:39.631 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3463367841", 2024-09-19T09:18:39.632 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3463367841", 2024-09-19T09:18:39.632 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3463367841", 2024-09-19T09:18:39.632 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:39.632 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull", 2024-09-19T09:18:39.632 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:39.632 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:39.632 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.632 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:18:39.632 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:39.632 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:39.632 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:39.632 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:39.633 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:39.633 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:39.633 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:39.633 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:39.633 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:39.633 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:39.633 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:39.633 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:39.633 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.633 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.633 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-19T09:18:39.633 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:39.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.634 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.634 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-19T09:18:39.634 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:39.634 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.634 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.634 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:39.634 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.634 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.634 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-19T09:18:39.634 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:39.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.635 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.635 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-19T09:18:39.635 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:39.635 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.635 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.635 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:39.635 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.635 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.635 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-19T09:18:39.635 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:39.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.636 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.636 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-19T09:18:39.636 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:39.636 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.636 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.636 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:39.636 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.636 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.636 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-19T09:18:39.636 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:39.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.637 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.637 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-19T09:18:39.637 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:39.637 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.637 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.637 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/4163178582", 2024-09-19T09:18:39.637 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/4163178582", 2024-09-19T09:18:39.637 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/4163178582", 2024-09-19T09:18:39.637 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/4163178582", 2024-09-19T09:18:39.637 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:39.637 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:39.638 INFO:teuthology.orchestra.run.smithi018.stdout: "full", 2024-09-19T09:18:39.638 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:39.638 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.638 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:18:39.638 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:39.638 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:39.638 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:39.638 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:39.638 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:39.638 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:39.638 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:39.638 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:39.638 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:39.639 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:39.639 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:39.639 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:39.639 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.639 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.639 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6822", 2024-09-19T09:18:39.639 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:39.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.639 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.639 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6824", 2024-09-19T09:18:39.639 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:39.640 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.640 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.640 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:39.640 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.640 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.640 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6826", 2024-09-19T09:18:39.640 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:39.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.640 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.640 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.640 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6827", 2024-09-19T09:18:39.640 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:39.641 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.641 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.641 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:39.641 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.641 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.641 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6830", 2024-09-19T09:18:39.641 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:39.641 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.641 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.641 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6831", 2024-09-19T09:18:39.641 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:39.642 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.642 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.642 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:39.642 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.642 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.642 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6828", 2024-09-19T09:18:39.642 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:39.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.642 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.642 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6829", 2024-09-19T09:18:39.642 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:39.643 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.643 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.643 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6824/3538482215", 2024-09-19T09:18:39.643 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6827/3538482215", 2024-09-19T09:18:39.643 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6831/3538482215", 2024-09-19T09:18:39.643 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6829/3538482215", 2024-09-19T09:18:39.643 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:39.643 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:39.643 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:39.643 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.643 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:18:39.644 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:39.644 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:39.644 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:39.644 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:39.644 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:39.644 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:39.644 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:39.644 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:39.644 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:39.644 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:39.645 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:39.645 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:39.645 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.645 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.645 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6800", 2024-09-19T09:18:39.645 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:39.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.645 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.645 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6801", 2024-09-19T09:18:39.645 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:39.645 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.646 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.646 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:39.646 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.646 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.646 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6802", 2024-09-19T09:18:39.646 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:39.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.646 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.646 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6803", 2024-09-19T09:18:39.646 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:39.646 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.647 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.647 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:39.647 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.647 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.647 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6806", 2024-09-19T09:18:39.647 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:39.647 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.647 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.647 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6807", 2024-09-19T09:18:39.647 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:39.647 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.648 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.648 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:39.648 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.648 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.648 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6804", 2024-09-19T09:18:39.648 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:39.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.648 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.648 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6805", 2024-09-19T09:18:39.648 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:39.649 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.649 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.649 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6801/2408698413", 2024-09-19T09:18:39.649 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6803/2408698413", 2024-09-19T09:18:39.649 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6807/2408698413", 2024-09-19T09:18:39.649 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6805/2408698413", 2024-09-19T09:18:39.649 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:39.649 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:39.649 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:39.649 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.649 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:18:39.650 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:39.650 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:39.650 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:39.650 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:39.650 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:39.650 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:39.650 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:39.650 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:39.650 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:39.650 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:39.650 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:39.650 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:39.650 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.651 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.651 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6808", 2024-09-19T09:18:39.651 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:39.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.651 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.651 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6809", 2024-09-19T09:18:39.651 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:39.651 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.651 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.651 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:39.651 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.652 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.652 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6810", 2024-09-19T09:18:39.652 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:39.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.652 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.652 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6811", 2024-09-19T09:18:39.652 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:39.652 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.652 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.652 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:39.652 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.653 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.653 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6814", 2024-09-19T09:18:39.653 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:39.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.653 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.653 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6815", 2024-09-19T09:18:39.653 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:39.653 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.653 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.653 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:39.654 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.654 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.654 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6812", 2024-09-19T09:18:39.654 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:39.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.654 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.654 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6813", 2024-09-19T09:18:39.654 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:39.654 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.654 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.655 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6809/2596207948", 2024-09-19T09:18:39.655 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6811/2596207948", 2024-09-19T09:18:39.655 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6815/2596207948", 2024-09-19T09:18:39.655 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6813/2596207948", 2024-09-19T09:18:39.655 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:39.655 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:39.655 INFO:teuthology.orchestra.run.smithi018.stdout: "full", 2024-09-19T09:18:39.655 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:39.655 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.655 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:18:39.655 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:39.655 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:39.656 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:39.656 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:39.656 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:39.656 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:39.656 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:39.656 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:39.656 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:39.656 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:39.656 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:39.656 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:39.656 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.656 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.656 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6816", 2024-09-19T09:18:39.657 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:39.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.657 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.657 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6817", 2024-09-19T09:18:39.657 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:39.657 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.657 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.657 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:39.657 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.657 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.657 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.657 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6818", 2024-09-19T09:18:39.658 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:39.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.658 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.658 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6819", 2024-09-19T09:18:39.658 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:39.658 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.658 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.658 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:39.658 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.658 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.659 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6823", 2024-09-19T09:18:39.659 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:39.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.659 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.659 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6825", 2024-09-19T09:18:39.659 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:39.659 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.659 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.659 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:39.659 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:39.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.659 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:39.660 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6820", 2024-09-19T09:18:39.660 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:39.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.660 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:39.660 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6821", 2024-09-19T09:18:39.660 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:39.660 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.660 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.660 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6817/1334618296", 2024-09-19T09:18:39.660 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6819/1334618296", 2024-09-19T09:18:39.660 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6825/1334618296", 2024-09-19T09:18:39.660 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6821/1334618296", 2024-09-19T09:18:39.660 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:39.661 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:39.661 INFO:teuthology.orchestra.run.smithi018.stdout: "full", 2024-09-19T09:18:39.661 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:39.661 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:39.661 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.661 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:18:39.661 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-19T09:18:39.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.661 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:18:39.661 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:39.661 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:39.661 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:39.661 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:39.661 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:39.662 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.580838+0000", 2024-09-19T09:18:39.662 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:39.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.662 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:18:39.662 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:39.662 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:39.662 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:39.662 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:39.662 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:39.662 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.599990+0000", 2024-09-19T09:18:39.662 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:39.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.662 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:18:39.663 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:39.663 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:39.663 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:39.663 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:39.663 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:39.663 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.503722+0000", 2024-09-19T09:18:39.663 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:39.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.663 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:18:39.663 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:39.663 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:39.663 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:39.664 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:39.664 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:39.664 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.607846+0000", 2024-09-19T09:18:39.664 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:39.664 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.664 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.664 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:18:39.664 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:39.664 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:39.664 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:39.664 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:39.664 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:39.664 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.616858+0000", 2024-09-19T09:18:39.664 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:39.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.665 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:18:39.665 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:39.665 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:39.665 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:39.665 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:39.665 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:39.665 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.542726+0000", 2024-09-19T09:18:39.666 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:39.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.666 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:18:39.666 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:39.666 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:39.666 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:39.666 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:39.666 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:39.666 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.534178+0000", 2024-09-19T09:18:39.666 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:39.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:39.666 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:18:39.666 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:39.667 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:39.667 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:39.667 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:39.667 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:39.667 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.612105+0000", 2024-09-19T09:18:39.667 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:39.667 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.667 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:18:39.667 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-19T09:18:39.667 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-19T09:18:39.667 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-19T09:18:39.667 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-19T09:18:39.667 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-19T09:18:39.668 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-19T09:18:39.668 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-19T09:18:39.668 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-19T09:18:39.668 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-19T09:18:39.668 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-19T09:18:39.668 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-19T09:18:39.668 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-19T09:18:39.668 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-19T09:18:39.668 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-19T09:18:39.668 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:39.668 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-19T09:18:39.668 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-19T09:18:39.668 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-19T09:18:39.669 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-19T09:18:39.669 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-19T09:18:39.669 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-19T09:18:39.669 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-19T09:18:39.669 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-19T09:18:39.669 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-19T09:18:39.669 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-19T09:18:39.669 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-19T09:18:39.669 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:39.669 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:18:39.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.594+0000 7f3477df1640 1 -- 172.21.15.18:0/1064930525 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f345406c2b0 msgr2=0x7f345406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:39.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.594+0000 7f3477df1640 1 --2- 172.21.15.18:0/1064930525 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f345406c2b0 0x7f345406e770 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f346c034000 tx=0x7f346c02e000 comp rx=0 tx=0).stop 2024-09-19T09:18:39.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.595+0000 7f3477df1640 1 -- 172.21.15.18:0/1064930525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34700cfae0 msgr2=0x7f34700cc420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:39.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.595+0000 7f3477df1640 1 --2- 172.21.15.18:0/1064930525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34700cfae0 0x7f34700cc420 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f346000c430 tx=0x7f346000c830 comp rx=0 tx=0).stop 2024-09-19T09:18:39.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.595+0000 7f3477df1640 1 -- 172.21.15.18:0/1064930525 shutdown_connections 2024-09-19T09:18:39.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.595+0000 7f3477df1640 1 --2- 172.21.15.18:0/1064930525 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f345406c2b0 0x7f345406e770 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:39.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.595+0000 7f3477df1640 1 --2- 172.21.15.18:0/1064930525 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f347015ef80 0x7f34700c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:39.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.595+0000 7f3477df1640 1 --2- 172.21.15.18:0/1064930525 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34700cfae0 0x7f34700cc420 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:39.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.595+0000 7f3477df1640 1 --2- 172.21.15.18:0/1064930525 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f347006d730 0x7f34700b7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:39.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.595+0000 7f3477df1640 1 -- 172.21.15.18:0/1064930525 >> 172.21.15.18:0/1064930525 conn(0x7f34700b4700 msgr2=0x7f34700b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:39.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.595+0000 7f3477df1640 1 -- 172.21.15.18:0/1064930525 shutdown_connections 2024-09-19T09:18:39.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.595+0000 7f3477df1640 1 -- 172.21.15.18:0/1064930525 wait complete. 2024-09-19T09:18:39.672 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-19T09:18:39.672 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:18:39.672 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:18:39.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:39.689 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2024-09-19T09:18:39.896 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:18:39.896 INFO:teuthology.orchestra.run.smithi018.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2024-09-19T09:18:39.896 INFO:teuthology.orchestra.run.smithi018.stderr:50+0 records in 2024-09-19T09:18:39.896 INFO:teuthology.orchestra.run.smithi018.stderr:50+0 records out 2024-09-19T09:18:39.896 INFO:teuthology.orchestra.run.smithi018.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.142488 s, 368 MB/s 2024-09-19T09:18:39.897 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-19T09:18:39.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.998+0000 7f39fc665640 1 Processor -- start 2024-09-19T09:18:39.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.998+0000 7f39fc665640 1 -- start start 2024-09-19T09:18:40.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.999+0000 7f39fc665640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f39f40aff90 0x7f39f40b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.999+0000 7f39fc665640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f39f40b54a0 0x7f39f406ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.999+0000 7f39fc665640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39f40ae9c0 con 0x7f39f4159230 2024-09-19T09:18:40.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.999+0000 7f39fc665640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f39f40b5910 con 0x7f39f40b54a0 2024-09-19T09:18:40.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.999+0000 7f39fc665640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f39f40aeca0 con 0x7f39f40aff90 2024-09-19T09:18:40.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.999+0000 7f39fac02640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f39f40b54a0 0x7f39f406ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.999+0000 7f39fac02640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f39f40b54a0 0x7f39f406ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38168/0 (socket says 172.21.15.18:38168) 2024-09-19T09:18:40.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.999+0000 7f39fac02640 1 -- 172.21.15.18:0/1950828774 learned_addr learned my addr 172.21.15.18:0/1950828774 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:40.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:39.999+0000 7f39f9c00640 1 --2- 172.21.15.18:0/1950828774 >> v2:172.21.15.162:3300/0 conn(0x7f39f40aff90 0x7f39f40b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.000+0000 7f39fac02640 1 -- 172.21.15.18:0/1950828774 >> v2:172.21.15.162:3300/0 conn(0x7f39f40aff90 msgr2=0x7f39f40b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:40.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.000+0000 7f39fac02640 1 --2- 172.21.15.18:0/1950828774 >> v2:172.21.15.162:3300/0 conn(0x7f39f40aff90 0x7f39f40b4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.000+0000 7f39fac02640 1 -- 172.21.15.18:0/1950828774 >> v1:172.21.15.162:6789/0 conn(0x7f39f4159230 legacy=0x7f39f415fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:40.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.000+0000 7f39fac02640 1 -- 172.21.15.18:0/1950828774 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f40aef80 con 0x7f39f40b54a0 2024-09-19T09:18:40.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.000+0000 7f39fac02640 1 --2- 172.21.15.18:0/1950828774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39f40b54a0 0x7f39f406ed50 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f39f406e650 tx=0x7f39e402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b3e2d47f140dda server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:40.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.000+0000 7f39f93ff640 1 -- 172.21.15.18:0/1950828774 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e4036070 con 0x7f39f40b54a0 2024-09-19T09:18:40.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.000+0000 7f39f93ff640 1 -- 172.21.15.18:0/1950828774 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39e4031600 con 0x7f39f40b54a0 2024-09-19T09:18:40.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.000+0000 7f39f93ff640 1 -- 172.21.15.18:0/1950828774 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e40319d0 con 0x7f39f40b54a0 2024-09-19T09:18:40.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.001+0000 7f39fc665640 1 -- 172.21.15.18:0/1950828774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39f40b54a0 msgr2=0x7f39f406ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:40.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.001+0000 7f39fc665640 1 --2- 172.21.15.18:0/1950828774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39f40b54a0 0x7f39f406ed50 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f39f406e650 tx=0x7f39e402a6a0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.001+0000 7f39fc665640 1 -- 172.21.15.18:0/1950828774 shutdown_connections 2024-09-19T09:18:40.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.001+0000 7f39fc665640 1 --2- 172.21.15.18:0/1950828774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39f40b54a0 0x7f39f406ed50 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.001+0000 7f39fc665640 1 --2- 172.21.15.18:0/1950828774 >> v2:172.21.15.162:3300/0 conn(0x7f39f40aff90 0x7f39f40b4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.001+0000 7f39fc665640 1 -- 172.21.15.18:0/1950828774 >> 172.21.15.18:0/1950828774 conn(0x7f39f40b2b50 msgr2=0x7f39f40b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:40.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.001+0000 7f39fc665640 1 -- 172.21.15.18:0/1950828774 shutdown_connections 2024-09-19T09:18:40.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.001+0000 7f39fc665640 1 -- 172.21.15.18:0/1950828774 wait complete. 2024-09-19T09:18:40.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.002+0000 7f39fc665640 1 Processor -- start 2024-09-19T09:18:40.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.003+0000 7f39fc665640 1 -- start start 2024-09-19T09:18:40.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.003+0000 7f39fc665640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39f40aff90 0x7f39f415e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.003+0000 7f39fc665640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39f40b54a0 0x7f39f41e8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.003+0000 7f39fc665640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39f4159230 0x7f39f41f7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.003+0000 7f39fc665640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f39f406f410 con 0x7f39f40b54a0 2024-09-19T09:18:40.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.003+0000 7f39fc665640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f39f406f290 con 0x7f39f40aff90 2024-09-19T09:18:40.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.003+0000 7f39fc665640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f39f406f590 con 0x7f39f4159230 2024-09-19T09:18:40.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.003+0000 7f39f9c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39f40b54a0 0x7f39f41e8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.003+0000 7f39f9c00640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39f40b54a0 0x7f39f41e8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38180/0 (socket says 172.21.15.18:38180) 2024-09-19T09:18:40.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.003+0000 7f39f9c00640 1 -- 172.21.15.18:0/1652614171 learned_addr learned my addr 172.21.15.18:0/1652614171 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:40.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.004+0000 7f39fa401640 1 --2- 172.21.15.18:0/1652614171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39f40aff90 0x7f39f415e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.004+0000 7f39fac02640 1 --2- 172.21.15.18:0/1652614171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39f4159230 0x7f39f41f7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.004+0000 7f39f9c00640 1 -- 172.21.15.18:0/1652614171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39f4159230 msgr2=0x7f39f41f7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:40.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.004+0000 7f39f9c00640 1 --2- 172.21.15.18:0/1652614171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39f4159230 0x7f39f41f7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.004+0000 7f39f9c00640 1 -- 172.21.15.18:0/1652614171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39f40aff90 msgr2=0x7f39f415e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:40.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.004+0000 7f39f9c00640 1 --2- 172.21.15.18:0/1652614171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39f40aff90 0x7f39f415e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.004+0000 7f39f9c00640 1 -- 172.21.15.18:0/1652614171 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39f413ff30 con 0x7f39f40b54a0 2024-09-19T09:18:40.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.004+0000 7f39fa401640 1 --2- 172.21.15.18:0/1652614171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39f40aff90 0x7f39f415e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:40.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.004+0000 7f39f9c00640 1 --2- 172.21.15.18:0/1652614171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39f40b54a0 0x7f39f41e8d20 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f39e800e980 tx=0x7f39e800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:40.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.004+0000 7f39f2ffd640 1 -- 172.21.15.18:0/1652614171 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e8017070 con 0x7f39f40b54a0 2024-09-19T09:18:40.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.004+0000 7f39f2ffd640 1 -- 172.21.15.18:0/1652614171 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39e800ca00 con 0x7f39f40b54a0 2024-09-19T09:18:40.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.004+0000 7f39fc665640 1 -- 172.21.15.18:0/1652614171 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39f41e9a40 con 0x7f39f40b54a0 2024-09-19T09:18:40.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.004+0000 7f39f2ffd640 1 -- 172.21.15.18:0/1652614171 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39e800cdd0 con 0x7f39f40b54a0 2024-09-19T09:18:40.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.004+0000 7f39fc665640 1 -- 172.21.15.18:0/1652614171 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39f41ea000 con 0x7f39f40b54a0 2024-09-19T09:18:40.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.005+0000 7f39fc665640 1 -- 172.21.15.18:0/1652614171 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39f4075500 con 0x7f39f40b54a0 2024-09-19T09:18:40.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.006+0000 7f39f2ffd640 1 -- 172.21.15.18:0/1652614171 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f39e801a070 con 0x7f39f40b54a0 2024-09-19T09:18:40.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.006+0000 7f39f2ffd640 1 --2- 172.21.15.18:0/1652614171 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f39e006c2b0 0x7f39e006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.006+0000 7f39f2ffd640 1 -- 172.21.15.18:0/1652614171 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7f39e808b3b0 con 0x7f39f40b54a0 2024-09-19T09:18:40.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.006+0000 7f39f2ffd640 1 -- 172.21.15.18:0/1652614171 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=108}) -- 0x7f39e0073de0 con 0x7f39f40b54a0 2024-09-19T09:18:40.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.007+0000 7f39fa401640 1 --2- 172.21.15.18:0/1652614171 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f39e006c2b0 0x7f39e006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.007+0000 7f39fa401640 1 --2- 172.21.15.18:0/1652614171 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f39e006c2b0 0x7f39e006e770 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f39ec001660 tx=0x7f39ec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:40.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.011+0000 7f39f2ffd640 1 -- 172.21.15.18:0/1652614171 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f39e8059bb0 con 0x7f39f40b54a0 2024-09-19T09:18:40.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.188+0000 7f39fc665640 1 -- 172.21.15.18:0/1652614171 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f39f41e9760 con 0x7f39f40b54a0 2024-09-19T09:18:40.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.189+0000 7f39f2ffd640 1 -- 172.21.15.18:0/1652614171 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v107) ==== 81+0+34462 (secure 0 0 0) 0x7f39e80594b0 con 0x7f39f40b54a0 2024-09-19T09:18:40.190 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:40.191 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:18:40.191 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 107, 2024-09-19T09:18:40.191 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:18:40.191 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-19T09:13:11.348786+0000", 2024-09-19T09:18:40.191 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-19T09:18:37.710547+0000", 2024-09-19T09:18:40.191 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-19T09:13:16.423937+0000", 2024-09-19T09:18:40.191 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-19T09:13:13.417141+0000", 2024-09-19T09:18:40.191 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-19T09:18:40.191 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-09-19T09:18:40.191 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-19T09:18:40.191 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-19T09:18:40.191 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-19T09:18:40.191 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-19T09:18:40.192 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-19T09:18:40.192 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:18:40.192 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-19T09:18:40.192 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.69999998807907104, 2024-09-19T09:18:40.192 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-19T09:18:40.192 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-19T09:18:40.192 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-19T09:18:40.192 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 13, 2024-09-19T09:18:40.192 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-19T09:18:40.192 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-19T09:18:40.192 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "jewel", 2024-09-19T09:18:40.192 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-19T09:18:40.192 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-19T09:18:40.193 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-19T09:18:40.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.193 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-19T09:18:40.193 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-19T09:18:40.193 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:13:17.564717+0000", 2024-09-19T09:18:40.193 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 3, 2024-09-19T09:18:40.193 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full", 2024-09-19T09:18:40.193 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:18:40.193 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:18:40.193 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:18:40.193 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:18:40.193 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:18:40.193 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:18:40.194 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:18:40.194 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:18:40.194 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:18:40.194 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:18:40.194 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:18:40.194 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-19T09:18:40.194 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-19T09:18:40.194 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-19T09:18:40.194 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-19T09:18:40.194 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-19T09:18:40.194 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:18:40.194 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:18:40.194 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:18:40.194 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:18:40.195 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:18:40.195 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:18:40.195 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:18:40.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.195 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "105", 2024-09-19T09:18:40.195 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:18:40.195 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:18:40.195 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:18:40.195 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:18:40.195 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:18:40.195 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:18:40.195 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:18:40.195 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:18:40.195 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:18:40.196 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:18:40.196 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:18:40.196 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:18:40.196 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:18:40.196 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:18:40.196 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:18:40.196 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:18:40.196 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:18:40.196 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:18:40.196 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:18:40.196 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:18:40.196 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:18:40.196 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:18:40.196 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:18:40.197 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:18:40.197 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:18:40.197 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:18:40.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.197 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:18:40.197 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:18:40.197 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:18:40.197 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:18:40.197 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:18:40.197 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:18:40.197 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:18:40.197 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:18:40.197 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:18:40.197 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:18:40.198 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:18:40.198 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:18:40.198 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-19T09:18:40.198 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-19T09:18:40.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.198 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:18:40.198 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-19T09:18:40.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.198 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:18:40.198 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:18:40.198 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-19T09:18:40.198 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-19T09:18:40.198 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-19T09:18:40.198 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-19T09:18:40.199 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-19T09:18:40.199 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:18:40.199 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:18:40.199 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:18:40.199 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.199 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 12, 2024-09-19T09:18:40.199 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_metadata", 2024-09-19T09:18:40.199 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:18:21.441414+0000", 2024-09-19T09:18:40.199 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 3, 2024-09-19T09:18:40.199 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full", 2024-09-19T09:18:40.199 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:18:40.199 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:18:40.200 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:18:40.200 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:18:40.200 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:18:40.200 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:18:40.200 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:18:40.200 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:18:40.200 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:18:40.200 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:18:40.200 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:18:40.200 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-19T09:18:40.200 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-19T09:18:40.200 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-19T09:18:40.200 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-19T09:18:40.200 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-19T09:18:40.201 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:18:40.201 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:18:40.201 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:18:40.201 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:18:40.201 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:18:40.201 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:18:40.201 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:18:40.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.201 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "105", 2024-09-19T09:18:40.201 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:18:40.201 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:18:40.201 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:18:40.201 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:18:40.201 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:18:40.202 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:18:40.202 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:18:40.202 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:18:40.202 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:18:40.202 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:18:40.202 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:18:40.202 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:18:40.202 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:18:40.202 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:18:40.202 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:18:40.202 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:18:40.202 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:18:40.202 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:18:40.202 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:18:40.203 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:18:40.203 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:18:40.203 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:18:40.203 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:18:40.203 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:18:40.203 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:18:40.203 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:18:40.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.203 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:18:40.203 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:18:40.203 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:18:40.203 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:18:40.203 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:18:40.203 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:18:40.204 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:18:40.204 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:18:40.204 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:18:40.204 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:18:40.204 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:18:40.204 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:18:40.204 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4, 2024-09-19T09:18:40.204 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 16, 2024-09-19T09:18:40.204 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_priority": 5 2024-09-19T09:18:40.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.204 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:18:40.204 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:18:40.204 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": "cephfs" 2024-09-19T09:18:40.205 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.205 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:18:40.205 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:18:40.205 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.75, 2024-09-19T09:18:40.205 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.75, 2024-09-19T09:18:40.205 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:18:40.205 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.75, 2024-09-19T09:18:40.205 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.75, 2024-09-19T09:18:40.205 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:18:40.205 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:18:40.205 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:18:40.205 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.206 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 13, 2024-09-19T09:18:40.206 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_data", 2024-09-19T09:18:40.206 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:18:22.767737+0000", 2024-09-19T09:18:40.206 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 3, 2024-09-19T09:18:40.206 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full", 2024-09-19T09:18:40.206 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:18:40.206 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:18:40.206 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:18:40.206 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:18:40.206 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:18:40.206 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:18:40.206 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:18:40.206 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:18:40.207 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:18:40.207 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:18:40.207 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:18:40.207 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 64, 2024-09-19T09:18:40.207 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 64, 2024-09-19T09:18:40.207 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 64, 2024-09-19T09:18:40.207 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 64, 2024-09-19T09:18:40.207 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 64, 2024-09-19T09:18:40.207 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:18:40.207 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:18:40.207 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:18:40.207 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:18:40.207 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:18:40.207 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:18:40.208 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:18:40.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.208 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "105", 2024-09-19T09:18:40.208 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:18:40.208 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:18:40.208 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:18:40.208 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:18:40.208 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:18:40.208 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:18:40.208 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:18:40.208 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:18:40.208 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:18:40.208 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:18:40.209 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:18:40.209 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:18:40.209 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:18:40.209 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:18:40.209 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:18:40.209 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:18:40.209 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:18:40.209 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:18:40.209 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:18:40.209 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:18:40.209 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:18:40.209 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:18:40.209 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:18:40.209 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:18:40.210 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:18:40.210 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:18:40.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.210 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:18:40.210 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:18:40.210 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:18:40.210 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:18:40.210 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:18:40.210 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:18:40.210 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:18:40.210 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:18:40.210 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:18:40.210 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:18:40.210 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:18:40.210 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:18:40.211 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 64, 2024-09-19T09:18:40.211 INFO:teuthology.orchestra.run.smithi018.stdout: "target_size_ratio": 0.89999997615814209 2024-09-19T09:18:40.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.211 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:18:40.211 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:18:40.211 INFO:teuthology.orchestra.run.smithi018.stdout: "data": "cephfs" 2024-09-19T09:18:40.211 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.211 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:18:40.211 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:18:40.211 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.3799999952316284, 2024-09-19T09:18:40.211 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.3799999952316284, 2024-09-19T09:18:40.211 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:18:40.211 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-19T09:18:40.212 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-19T09:18:40.212 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:18:40.212 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:18:40.212 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:18:40.212 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.212 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.212 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:18:40.212 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-19T09:18:40.212 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.212 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:18:40.212 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:40.212 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:40.212 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:40.212 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:40.213 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:40.213 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:40.213 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:40.213 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:40.213 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:40.213 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:40.213 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:40.213 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:40.213 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.213 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.213 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-19T09:18:40.213 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:40.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.214 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.214 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-19T09:18:40.214 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:40.214 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.214 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.214 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:40.214 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.214 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.214 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-19T09:18:40.214 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:40.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.214 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.215 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.215 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-19T09:18:40.215 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:40.215 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.215 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.215 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:40.215 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.215 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.215 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-19T09:18:40.215 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:40.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.216 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.216 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-19T09:18:40.216 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:40.216 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.216 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.216 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:40.216 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.216 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.216 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-19T09:18:40.216 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:40.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.217 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.217 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-19T09:18:40.217 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:40.217 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.217 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.217 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/128722874", 2024-09-19T09:18:40.217 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/128722874", 2024-09-19T09:18:40.217 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/128722874", 2024-09-19T09:18:40.217 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/128722874", 2024-09-19T09:18:40.217 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:40.217 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:40.217 INFO:teuthology.orchestra.run.smithi018.stdout: "full", 2024-09-19T09:18:40.217 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:40.218 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.218 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:18:40.218 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:40.218 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:40.218 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:40.218 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:40.218 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:40.218 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:40.218 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:40.218 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:40.218 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:40.218 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:40.219 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:40.219 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:40.219 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.219 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.219 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-19T09:18:40.219 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:40.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.219 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.219 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-19T09:18:40.219 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:40.219 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.219 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.220 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:40.220 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.220 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.220 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-19T09:18:40.220 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:40.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.220 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.220 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.220 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-19T09:18:40.220 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:40.220 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.221 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.221 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:40.221 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.221 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.221 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-19T09:18:40.221 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:40.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.221 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.221 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-19T09:18:40.221 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:40.221 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.222 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.222 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:40.222 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.222 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.222 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-19T09:18:40.222 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:40.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.222 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.222 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-19T09:18:40.222 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:40.222 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.223 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.223 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/3672199638", 2024-09-19T09:18:40.223 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/3672199638", 2024-09-19T09:18:40.223 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/3672199638", 2024-09-19T09:18:40.223 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/3672199638", 2024-09-19T09:18:40.223 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:40.223 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull", 2024-09-19T09:18:40.223 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:40.223 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:40.223 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.223 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:18:40.224 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:40.224 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:40.224 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:40.224 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:40.224 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:40.224 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:40.224 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:40.224 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:40.224 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:40.224 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:40.224 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:40.224 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:40.224 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.225 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.225 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T09:18:40.225 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:40.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.225 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.225 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T09:18:40.225 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:40.225 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.225 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.225 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:40.225 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.226 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.226 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-19T09:18:40.226 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:40.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.226 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.226 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-19T09:18:40.226 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:40.226 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.226 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.226 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:40.227 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.227 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.227 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-19T09:18:40.227 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:40.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.227 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.227 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.227 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-19T09:18:40.227 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:40.227 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.227 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.227 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-19T09:18:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-19T09:18:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.228 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.229 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3463367841", 2024-09-19T09:18:40.229 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3463367841", 2024-09-19T09:18:40.229 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3463367841", 2024-09-19T09:18:40.229 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3463367841", 2024-09-19T09:18:40.229 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:40.229 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull", 2024-09-19T09:18:40.229 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:40.229 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:40.229 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.229 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.229 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:18:40.229 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:40.230 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:40.230 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:40.230 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:40.230 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:40.230 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:40.230 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:40.230 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:40.230 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:40.230 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:40.230 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:40.230 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:40.230 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.230 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.230 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.231 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-19T09:18:40.231 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:40.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.231 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.231 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-19T09:18:40.231 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:40.231 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.231 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.231 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.231 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:40.231 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.231 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.232 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.232 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-19T09:18:40.232 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:40.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.232 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.232 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-19T09:18:40.232 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:40.232 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.232 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.232 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.232 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:40.232 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.232 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.233 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.233 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-19T09:18:40.233 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:40.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.233 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.233 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.233 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-19T09:18:40.233 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:40.233 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.233 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.233 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.233 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:40.233 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.234 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.234 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-19T09:18:40.234 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:40.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.234 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.234 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.234 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-19T09:18:40.234 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:40.234 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.234 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.234 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.234 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/4163178582", 2024-09-19T09:18:40.235 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/4163178582", 2024-09-19T09:18:40.235 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/4163178582", 2024-09-19T09:18:40.235 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/4163178582", 2024-09-19T09:18:40.235 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:40.235 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:40.235 INFO:teuthology.orchestra.run.smithi018.stdout: "full", 2024-09-19T09:18:40.235 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:40.235 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.235 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.235 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.235 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:18:40.235 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:40.235 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:40.235 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:40.235 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:40.236 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:40.236 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:40.236 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:40.236 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:40.236 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:40.236 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:40.236 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:40.236 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:40.236 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.236 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.236 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6822", 2024-09-19T09:18:40.236 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:40.236 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.236 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.237 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.237 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6824", 2024-09-19T09:18:40.237 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:40.237 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.237 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.237 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:40.237 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.237 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.237 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6826", 2024-09-19T09:18:40.237 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:40.237 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.237 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.237 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.238 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6827", 2024-09-19T09:18:40.238 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:40.238 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.238 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.238 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:40.238 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.238 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.238 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6830", 2024-09-19T09:18:40.238 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:40.238 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.238 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.238 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.238 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6831", 2024-09-19T09:18:40.239 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:40.239 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.239 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.239 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:40.239 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.239 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.239 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6828", 2024-09-19T09:18:40.239 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:40.239 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.239 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.239 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.239 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6829", 2024-09-19T09:18:40.240 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:40.240 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.240 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.240 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6824/3538482215", 2024-09-19T09:18:40.240 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6827/3538482215", 2024-09-19T09:18:40.240 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6831/3538482215", 2024-09-19T09:18:40.240 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6829/3538482215", 2024-09-19T09:18:40.240 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:40.240 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:40.240 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:40.240 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.240 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.240 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.241 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:18:40.241 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:40.241 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:40.241 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:40.241 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:40.241 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:40.241 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:40.241 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:40.241 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:40.241 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:40.241 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:40.241 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:40.241 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:40.241 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.242 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.242 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6800", 2024-09-19T09:18:40.242 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:40.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.242 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.242 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.242 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6801", 2024-09-19T09:18:40.242 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:40.242 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.242 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.242 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.242 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:40.242 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.243 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.243 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6802", 2024-09-19T09:18:40.243 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:40.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.243 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.243 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.243 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6803", 2024-09-19T09:18:40.243 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:40.243 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.243 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.243 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.243 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:40.244 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.244 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.244 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6806", 2024-09-19T09:18:40.244 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:40.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.244 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.244 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.244 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6807", 2024-09-19T09:18:40.244 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:40.244 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.244 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.244 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.245 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:40.245 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.245 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.245 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6804", 2024-09-19T09:18:40.245 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:40.245 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.245 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.245 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.245 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6805", 2024-09-19T09:18:40.245 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:40.245 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.245 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.246 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6801/2408698413", 2024-09-19T09:18:40.246 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6803/2408698413", 2024-09-19T09:18:40.246 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6807/2408698413", 2024-09-19T09:18:40.246 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6805/2408698413", 2024-09-19T09:18:40.246 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:40.246 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:40.246 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:40.246 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.246 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.246 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.246 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:18:40.246 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:40.246 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:40.247 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:40.247 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:40.247 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:40.247 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:40.247 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:40.247 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:40.247 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:40.247 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:40.247 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:40.247 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:40.247 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.247 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.247 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.247 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6808", 2024-09-19T09:18:40.248 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:40.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.248 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.248 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6809", 2024-09-19T09:18:40.248 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:40.248 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.248 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.248 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.248 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:40.248 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.248 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.248 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.248 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6810", 2024-09-19T09:18:40.248 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6811", 2024-09-19T09:18:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6814", 2024-09-19T09:18:40.249 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6815", 2024-09-19T09:18:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.250 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6812", 2024-09-19T09:18:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6813", 2024-09-19T09:18:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6809/2596207948", 2024-09-19T09:18:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6811/2596207948", 2024-09-19T09:18:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6815/2596207948", 2024-09-19T09:18:40.251 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6813/2596207948", 2024-09-19T09:18:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: "full", 2024-09-19T09:18:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:18:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:40.252 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:40.253 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:40.253 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:40.253 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:40.253 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:40.253 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:40.253 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:40.253 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.253 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.253 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6816", 2024-09-19T09:18:40.253 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:40.253 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.253 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.253 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.254 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6817", 2024-09-19T09:18:40.254 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:40.254 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.254 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.254 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:40.254 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.254 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.254 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6818", 2024-09-19T09:18:40.254 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:40.254 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.254 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.254 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.254 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6819", 2024-09-19T09:18:40.255 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:40.255 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.255 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.255 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:40.255 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.255 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.255 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6823", 2024-09-19T09:18:40.255 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:40.255 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.255 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.255 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.255 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6825", 2024-09-19T09:18:40.256 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:40.256 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.256 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.256 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:40.256 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:40.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.256 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:40.256 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6820", 2024-09-19T09:18:40.256 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:40.256 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.256 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.256 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:40.256 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6821", 2024-09-19T09:18:40.257 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:40.257 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.257 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.257 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.257 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6817/1334618296", 2024-09-19T09:18:40.257 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6819/1334618296", 2024-09-19T09:18:40.257 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6825/1334618296", 2024-09-19T09:18:40.257 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6821/1334618296", 2024-09-19T09:18:40.257 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:40.257 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:40.257 INFO:teuthology.orchestra.run.smithi018.stdout: "full", 2024-09-19T09:18:40.257 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:40.257 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:40.257 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.258 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:18:40.258 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-19T09:18:40.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.258 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:18:40.258 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:40.258 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:40.258 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:40.258 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:40.258 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:40.258 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.580838+0000", 2024-09-19T09:18:40.258 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:40.258 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.258 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.258 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:18:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.599990+0000", 2024-09-19T09:18:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:18:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:40.259 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.503722+0000", 2024-09-19T09:18:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:18:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.607846+0000", 2024-09-19T09:18:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:40.260 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:18:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.616858+0000", 2024-09-19T09:18:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:18:40.261 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.542726+0000", 2024-09-19T09:18:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:18:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:40.262 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.534178+0000", 2024-09-19T09:18:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:18:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.612105+0000", 2024-09-19T09:18:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.263 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:18:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-19T09:18:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-19T09:18:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-19T09:18:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-19T09:18:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-19T09:18:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-19T09:18:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-19T09:18:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-19T09:18:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-19T09:18:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-19T09:18:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-19T09:18:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-19T09:18:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-19T09:18:40.264 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-19T09:18:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-19T09:18:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-19T09:18:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-19T09:18:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-19T09:18:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-19T09:18:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-19T09:18:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-19T09:18:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-19T09:18:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-19T09:18:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-19T09:18:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-19T09:18:40.265 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:40.266 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:18:40.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.192+0000 7f39fc665640 1 -- 172.21.15.18:0/1652614171 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f39e006c2b0 msgr2=0x7f39e006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:40.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.192+0000 7f39fc665640 1 --2- 172.21.15.18:0/1652614171 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f39e006c2b0 0x7f39e006e770 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f39ec001660 tx=0x7f39ec009040 comp rx=0 tx=0).stop 2024-09-19T09:18:40.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.192+0000 7f39fc665640 1 -- 172.21.15.18:0/1652614171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39f40b54a0 msgr2=0x7f39f41e8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:40.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.192+0000 7f39fc665640 1 --2- 172.21.15.18:0/1652614171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39f40b54a0 0x7f39f41e8d20 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f39e800e980 tx=0x7f39e800ee40 comp rx=0 tx=0).stop 2024-09-19T09:18:40.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.192+0000 7f39fc665640 1 -- 172.21.15.18:0/1652614171 shutdown_connections 2024-09-19T09:18:40.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.192+0000 7f39fc665640 1 --2- 172.21.15.18:0/1652614171 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f39e006c2b0 0x7f39e006e770 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.192+0000 7f39fc665640 1 --2- 172.21.15.18:0/1652614171 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39f4159230 0x7f39f41f7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.192+0000 7f39fc665640 1 --2- 172.21.15.18:0/1652614171 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39f40b54a0 0x7f39f41e8d20 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.192+0000 7f39fc665640 1 --2- 172.21.15.18:0/1652614171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39f40aff90 0x7f39f415e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.192+0000 7f39fc665640 1 -- 172.21.15.18:0/1652614171 >> 172.21.15.18:0/1652614171 conn(0x7f39f40b2b50 msgr2=0x7f39f40b2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:40.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.192+0000 7f39fc665640 1 -- 172.21.15.18:0/1652614171 shutdown_connections 2024-09-19T09:18:40.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.192+0000 7f39fc665640 1 -- 172.21.15.18:0/1652614171 wait complete. 2024-09-19T09:18:40.268 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:18:40.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.370+0000 7f61f79d8640 1 Processor -- start 2024-09-19T09:18:40.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.370+0000 7f61f79d8640 1 -- start start 2024-09-19T09:18:40.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.371+0000 7f61f79d8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f61f00b3ce0 0x7f61f00cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.371+0000 7f61f79d8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61f00d0050 0x7f61f00cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.371+0000 7f61f79d8640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61f00d0e10 con 0x7f61f00cf560 2024-09-19T09:18:40.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.371+0000 7f61f79d8640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f61f00d0850 con 0x7f61f00b3ce0 2024-09-19T09:18:40.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.371+0000 7f61f79d8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f61f00d0b30 con 0x7f61f00d0050 2024-09-19T09:18:40.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.371+0000 7f61f4f73640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f61f00b3ce0 0x7f61f00cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.371+0000 7f61f4f73640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f61f00b3ce0 0x7f61f00cd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38184/0 (socket says 172.21.15.18:38184) 2024-09-19T09:18:40.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.371+0000 7f61f5774640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f61f00cf560 0x7f61f00cf940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:46726/0 (socket says 172.21.15.18:46726) 2024-09-19T09:18:40.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.371+0000 7f61f4f73640 1 -- 172.21.15.18:0/3528343529 learned_addr learned my addr 172.21.15.18:0/3528343529 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:40.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.371+0000 7f61f5f75640 1 --2- 172.21.15.18:0/3528343529 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61f00d0050 0x7f61f00cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.371+0000 7f61f4f73640 1 -- 172.21.15.18:0/3528343529 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61f00d0050 msgr2=0x7f61f00cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:40.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.371+0000 7f61f4f73640 1 --2- 172.21.15.18:0/3528343529 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61f00d0050 0x7f61f00cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.371+0000 7f61f4f73640 1 -- 172.21.15.18:0/3528343529 >> v1:172.21.15.18:6789/0 conn(0x7f61f00cf560 legacy=0x7f61f00cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:40.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.371+0000 7f61e7fff640 1 -- 172.21.15.18:0/3528343529 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3238163650 0 0) 0x7f61f00d0e10 con 0x7f61f00cf560 2024-09-19T09:18:40.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.371+0000 7f61f4f73640 1 -- 172.21.15.18:0/3528343529 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61f00b24d0 con 0x7f61f00b3ce0 2024-09-19T09:18:40.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.372+0000 7f61f4f73640 1 --2- 172.21.15.18:0/3528343529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61f00b3ce0 0x7f61f00cd5f0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f61e0009870 tx=0x7f61e002a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=873aed38be6ed216 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:40.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.372+0000 7f61e7fff640 1 -- 172.21.15.18:0/3528343529 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e0037070 con 0x7f61f00b3ce0 2024-09-19T09:18:40.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.372+0000 7f61e7fff640 1 -- 172.21.15.18:0/3528343529 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61e0032440 con 0x7f61f00b3ce0 2024-09-19T09:18:40.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.372+0000 7f61e7fff640 1 -- 172.21.15.18:0/3528343529 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e0032810 con 0x7f61f00b3ce0 2024-09-19T09:18:40.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.373+0000 7f61f79d8640 1 -- 172.21.15.18:0/3528343529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61f00b3ce0 msgr2=0x7f61f00cd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:40.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.373+0000 7f61f79d8640 1 --2- 172.21.15.18:0/3528343529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61f00b3ce0 0x7f61f00cd5f0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f61e0009870 tx=0x7f61e002a130 comp rx=0 tx=0).stop 2024-09-19T09:18:40.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.373+0000 7f61f79d8640 1 -- 172.21.15.18:0/3528343529 shutdown_connections 2024-09-19T09:18:40.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.373+0000 7f61f79d8640 1 --2- 172.21.15.18:0/3528343529 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61f00d0050 0x7f61f00cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.373+0000 7f61f79d8640 1 --2- 172.21.15.18:0/3528343529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61f00b3ce0 0x7f61f00cd5f0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.373+0000 7f61f79d8640 1 -- 172.21.15.18:0/3528343529 >> 172.21.15.18:0/3528343529 conn(0x7f61f00b4700 msgr2=0x7f61f00b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:40.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.373+0000 7f61f79d8640 1 -- 172.21.15.18:0/3528343529 shutdown_connections 2024-09-19T09:18:40.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.373+0000 7f61f79d8640 1 -- 172.21.15.18:0/3528343529 wait complete. 2024-09-19T09:18:40.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.374+0000 7f61f79d8640 1 Processor -- start 2024-09-19T09:18:40.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.374+0000 7f61f79d8640 1 -- start start 2024-09-19T09:18:40.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.375+0000 7f61f79d8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61f00b3ce0 0x7f61f006e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.375+0000 7f61f79d8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61f00cf560 0x7f61f00c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.375+0000 7f61f79d8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61f00d0050 0x7f61f015fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.375+0000 7f61f79d8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f61f00b55a0 con 0x7f61f00b3ce0 2024-09-19T09:18:40.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.375+0000 7f61f79d8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f61f00b5420 con 0x7f61f00cf560 2024-09-19T09:18:40.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.375+0000 7f61f79d8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f61f015d090 con 0x7f61f00d0050 2024-09-19T09:18:40.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.375+0000 7f61f5774640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61f00b3ce0 0x7f61f006e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.375+0000 7f61f5774640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61f00b3ce0 0x7f61f006e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38192/0 (socket says 172.21.15.18:38192) 2024-09-19T09:18:40.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.375+0000 7f61f5774640 1 -- 172.21.15.18:0/2147404165 learned_addr learned my addr 172.21.15.18:0/2147404165 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:40.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.375+0000 7f61f5f75640 1 --2- 172.21.15.18:0/2147404165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61f00d0050 0x7f61f015fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.375+0000 7f61f4f73640 1 --2- 172.21.15.18:0/2147404165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61f00cf560 0x7f61f00c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.375+0000 7f61f5774640 1 -- 172.21.15.18:0/2147404165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61f00d0050 msgr2=0x7f61f015fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:40.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.375+0000 7f61f5774640 1 --2- 172.21.15.18:0/2147404165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61f00d0050 0x7f61f015fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.375+0000 7f61f5774640 1 -- 172.21.15.18:0/2147404165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61f00cf560 msgr2=0x7f61f00c5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:40.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.375+0000 7f61f5774640 1 --2- 172.21.15.18:0/2147404165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61f00cf560 0x7f61f00c5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.375+0000 7f61f5774640 1 -- 172.21.15.18:0/2147404165 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61f006e110 con 0x7f61f00b3ce0 2024-09-19T09:18:40.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.375+0000 7f61f5774640 1 --2- 172.21.15.18:0/2147404165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61f00b3ce0 0x7f61f006e8b0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f61ec00c430 tx=0x7f61ec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:40.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.375+0000 7f61e5ffb640 1 -- 172.21.15.18:0/2147404165 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ec0074e0 con 0x7f61f00b3ce0 2024-09-19T09:18:40.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.375+0000 7f61e5ffb640 1 -- 172.21.15.18:0/2147404165 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61ec0047e0 con 0x7f61f00b3ce0 2024-09-19T09:18:40.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.375+0000 7f61f79d8640 1 -- 172.21.15.18:0/2147404165 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61f015d4c0 con 0x7f61f00b3ce0 2024-09-19T09:18:40.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.375+0000 7f61e5ffb640 1 -- 172.21.15.18:0/2147404165 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61ec004bd0 con 0x7f61f00b3ce0 2024-09-19T09:18:40.378 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.376+0000 7f61f79d8640 1 -- 172.21.15.18:0/2147404165 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61f006e3b0 con 0x7f61f00b3ce0 2024-09-19T09:18:40.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.377+0000 7f61f79d8640 1 -- 172.21.15.18:0/2147404165 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61f00cf940 con 0x7f61f00b3ce0 2024-09-19T09:18:40.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.377+0000 7f61e5ffb640 1 -- 172.21.15.18:0/2147404165 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f61ec011070 con 0x7f61f00b3ce0 2024-09-19T09:18:40.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.377+0000 7f61e5ffb640 1 --2- 172.21.15.18:0/2147404165 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f61d406c2b0 0x7f61d406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:40.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.378+0000 7f61e5ffb640 1 -- 172.21.15.18:0/2147404165 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7f61ec08b130 con 0x7f61f00b3ce0 2024-09-19T09:18:40.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.378+0000 7f61e5ffb640 1 -- 172.21.15.18:0/2147404165 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=108}) -- 0x7f61d4073de0 con 0x7f61f00b3ce0 2024-09-19T09:18:40.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.378+0000 7f61f4f73640 1 --2- 172.21.15.18:0/2147404165 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f61d406c2b0 0x7f61d406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:40.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.378+0000 7f61f4f73640 1 --2- 172.21.15.18:0/2147404165 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f61d406c2b0 0x7f61d406e770 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f61e0034000 tx=0x7f61e002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:40.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.382+0000 7f61e5ffb640 1 -- 172.21.15.18:0/2147404165 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f61ec00e280 con 0x7f61f00b3ce0 2024-09-19T09:18:40.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.592+0000 7f61f79d8640 1 -- 172.21.15.18:0/2147404165 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61f006fa10 con 0x7f61f00b3ce0 2024-09-19T09:18:40.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.593+0000 7f61e5ffb640 1 -- 172.21.15.18:0/2147404165 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5225 (secure 0 0 0) 0x7f61ec059800 con 0x7f61f00b3ce0 2024-09-19T09:18:40.594 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:40.594 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":42,"btime":"2024-09-19T09:18:26:440614+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5944,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/935732637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":935732637},{"type":"v1","addr":"172.21.15.162:6836","nonce":935732637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6192,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3186899169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":3186899169},{"type":"v1","addr":"172.21.15.18:6835","nonce":3186899169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6195,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/3889971648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3889971648},{"type":"v1","addr":"172.21.15.18:6834","nonce":3889971648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:18:23.782156+0000","modified":"2024-09-19T09:18:25.789778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"d","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6837/133611430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":133611430},{"type":"v1","addr":"172.21.15.162:6837","nonce":133611430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6207,"qdb_cluster":[6207]},"id":6}]} 2024-09-19T09:18:40.594 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 42 2024-09-19T09:18:40.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.595+0000 7f61f79d8640 1 -- 172.21.15.18:0/2147404165 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f61d406c2b0 msgr2=0x7f61d406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:40.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.595+0000 7f61f79d8640 1 --2- 172.21.15.18:0/2147404165 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f61d406c2b0 0x7f61d406e770 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f61e0034000 tx=0x7f61e002e000 comp rx=0 tx=0).stop 2024-09-19T09:18:40.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.595+0000 7f61f79d8640 1 -- 172.21.15.18:0/2147404165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61f00b3ce0 msgr2=0x7f61f006e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:40.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.595+0000 7f61f79d8640 1 --2- 172.21.15.18:0/2147404165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61f00b3ce0 0x7f61f006e8b0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f61ec00c430 tx=0x7f61ec00c8f0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.595+0000 7f61f79d8640 1 -- 172.21.15.18:0/2147404165 shutdown_connections 2024-09-19T09:18:40.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.595+0000 7f61f79d8640 1 --2- 172.21.15.18:0/2147404165 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f61d406c2b0 0x7f61d406e770 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.595+0000 7f61f79d8640 1 --2- 172.21.15.18:0/2147404165 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61f00d0050 0x7f61f015fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.595+0000 7f61f79d8640 1 --2- 172.21.15.18:0/2147404165 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f61f00cf560 0x7f61f00c5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.595+0000 7f61f79d8640 1 --2- 172.21.15.18:0/2147404165 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f61f00b3ce0 0x7f61f006e8b0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:40.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.595+0000 7f61f79d8640 1 -- 172.21.15.18:0/2147404165 >> 172.21.15.18:0/2147404165 conn(0x7f61f00b4700 msgr2=0x7f61f0070900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:40.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.595+0000 7f61f79d8640 1 -- 172.21.15.18:0/2147404165 shutdown_connections 2024-09-19T09:18:40.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:40.595+0000 7f61f79d8640 1 -- 172.21.15.18:0/2147404165 wait complete. 2024-09-19T09:18:40.606 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2024-09-19T09:18:40.736 INFO:teuthology.orchestra.run.smithi162.stdout:{"cluster_fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","whoami":0,"id":6207,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":16.298564379999998,"mdsmap_epoch":42,"osdmap_epoch":107,"osdmap_epoch_barrier":107,"uptime":21.204453067999999} 2024-09-19T09:18:40.737 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", "fs_name": "cephfs", "id": 6207, "mdsmap_epoch": 42, "osdmap_epoch": 107, "osdmap_epoch_barrier": 107, "rank_uptime": 16.29856438, "state": "up:active", "uptime": 21.204453068, "want_state": "up:active", "whoami": 0 } 2024-09-19T09:18:40.737 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-19T09:18:40.737 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:18:40.737 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:18:40.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:40.754 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2024-09-19T09:18:40.811 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:18:40.811 INFO:teuthology.orchestra.run.smithi018.stderr:dd: failed to open 'small_file_1': Permission denied 2024-09-19T09:18:40.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:40.811 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2024-09-19T09:18:40.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:40.869 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2024-09-19T09:18:40.948 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-19T09:18:41.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.090+0000 7fa6b1877640 1 Processor -- start 2024-09-19T09:18:41.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.090+0000 7fa6b1877640 1 -- start start 2024-09-19T09:18:41.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.091+0000 7fa6b1877640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa6ac06c320 0x7fa6ac0b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:41.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.091+0000 7fa6b1877640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6ac0ced00 0x7fa6ac0b65e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:41.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.091+0000 7fa6b1877640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6ac0b6b20 con 0x7fa6ac15eea0 2024-09-19T09:18:41.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.091+0000 7fa6b1877640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fa6ac0b6db0 con 0x7fa6ac06c320 2024-09-19T09:18:41.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.091+0000 7fa6b1877640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa6ac0b7070 con 0x7fa6ac0ced00 2024-09-19T09:18:41.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.091+0000 7fa6a3fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa6ac06c320 0x7fa6ac0b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:41.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.091+0000 7fa6a3fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa6ac06c320 0x7fa6ac0b60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38194/0 (socket says 172.21.15.18:38194) 2024-09-19T09:18:41.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.091+0000 7fa6a3fff640 1 -- 172.21.15.18:0/730530307 learned_addr learned my addr 172.21.15.18:0/730530307 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:41.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.091+0000 7fa6ab7fe640 1 --2- 172.21.15.18:0/730530307 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6ac0ced00 0x7fa6ac0b65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:41.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.091+0000 7fa6a3fff640 1 -- 172.21.15.18:0/730530307 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6ac0ced00 msgr2=0x7fa6ac0b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:41.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.091+0000 7fa6a3fff640 1 --2- 172.21.15.18:0/730530307 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6ac0ced00 0x7fa6ac0b65e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.091+0000 7fa6a3fff640 1 -- 172.21.15.18:0/730530307 >> v1:172.21.15.162:6789/0 conn(0x7fa6ac15eea0 legacy=0x7fa6ac06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:41.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.091+0000 7fa6a3fff640 1 -- 172.21.15.18:0/730530307 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6ac0b1390 con 0x7fa6ac06c320 2024-09-19T09:18:41.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.091+0000 7fa6ab7fe640 1 --2- 172.21.15.18:0/730530307 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6ac0ced00 0x7fa6ac0b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:41.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.092+0000 7fa6a3fff640 1 --2- 172.21.15.18:0/730530307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6ac06c320 0x7fa6ac0b60a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fa694009870 tx=0x7fa69402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360ba59f9523122 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:41.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.092+0000 7fa6aa7fc640 1 -- 172.21.15.18:0/730530307 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa694037070 con 0x7fa6ac06c320 2024-09-19T09:18:41.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.092+0000 7fa6aa7fc640 1 -- 172.21.15.18:0/730530307 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa694032440 con 0x7fa6ac06c320 2024-09-19T09:18:41.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.092+0000 7fa6aa7fc640 1 -- 172.21.15.18:0/730530307 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa694032810 con 0x7fa6ac06c320 2024-09-19T09:18:41.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.093+0000 7fa6b1877640 1 -- 172.21.15.18:0/730530307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6ac06c320 msgr2=0x7fa6ac0b60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:41.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.093+0000 7fa6b1877640 1 --2- 172.21.15.18:0/730530307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6ac06c320 0x7fa6ac0b60a0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fa694009870 tx=0x7fa69402a210 comp rx=0 tx=0).stop 2024-09-19T09:18:41.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.093+0000 7fa6b1877640 1 -- 172.21.15.18:0/730530307 shutdown_connections 2024-09-19T09:18:41.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.093+0000 7fa6b1877640 1 --2- 172.21.15.18:0/730530307 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6ac0ced00 0x7fa6ac0b65e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.093+0000 7fa6b1877640 1 --2- 172.21.15.18:0/730530307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6ac06c320 0x7fa6ac0b60a0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.093+0000 7fa6b1877640 1 -- 172.21.15.18:0/730530307 >> 172.21.15.18:0/730530307 conn(0x7fa6ac0731b0 msgr2=0x7fa6ac0735c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:41.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.093+0000 7fa6b1877640 1 -- 172.21.15.18:0/730530307 shutdown_connections 2024-09-19T09:18:41.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.093+0000 7fa6b1877640 1 -- 172.21.15.18:0/730530307 wait complete. 2024-09-19T09:18:41.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.094+0000 7fa6b1877640 1 Processor -- start 2024-09-19T09:18:41.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.094+0000 7fa6b1877640 1 -- start start 2024-09-19T09:18:41.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.095+0000 7fa6b1877640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6ac06c320 0x7fa6ac161cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:41.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.095+0000 7fa6b1877640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6ac0ced00 0x7fa6ac0b3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:41.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.095+0000 7fa6b1877640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6ac15eea0 0x7fa6ac15b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:41.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.095+0000 7fa6b1877640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ac0b1040 con 0x7fa6ac15eea0 2024-09-19T09:18:41.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.095+0000 7fa6b1877640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa6ac15f280 con 0x7fa6ac0ced00 2024-09-19T09:18:41.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.095+0000 7fa6b1877640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa6ac0b1b90 con 0x7fa6ac06c320 2024-09-19T09:18:41.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.095+0000 7fa6ab7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6ac15eea0 0x7fa6ac15b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:41.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.095+0000 7fa6ab7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6ac15eea0 0x7fa6ac15b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38208/0 (socket says 172.21.15.18:38208) 2024-09-19T09:18:41.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.095+0000 7fa6ab7fe640 1 -- 172.21.15.18:0/1527609767 learned_addr learned my addr 172.21.15.18:0/1527609767 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:41.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.095+0000 7fa6a3fff640 1 --2- 172.21.15.18:0/1527609767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6ac0ced00 0x7fa6ac0b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:41.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.095+0000 7fa6aaffd640 1 --2- 172.21.15.18:0/1527609767 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6ac06c320 0x7fa6ac161cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:41.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.095+0000 7fa6ab7fe640 1 -- 172.21.15.18:0/1527609767 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6ac06c320 msgr2=0x7fa6ac161cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:41.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.095+0000 7fa6ab7fe640 1 --2- 172.21.15.18:0/1527609767 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6ac06c320 0x7fa6ac161cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.095+0000 7fa6ab7fe640 1 -- 172.21.15.18:0/1527609767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6ac0ced00 msgr2=0x7fa6ac0b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:41.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.095+0000 7fa6ab7fe640 1 --2- 172.21.15.18:0/1527609767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6ac0ced00 0x7fa6ac0b3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.095+0000 7fa6ab7fe640 1 -- 172.21.15.18:0/1527609767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6ac15a640 con 0x7fa6ac15eea0 2024-09-19T09:18:41.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.095+0000 7fa6ab7fe640 1 --2- 172.21.15.18:0/1527609767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6ac15eea0 0x7fa6ac15b6e0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fa6a400cef0 tx=0x7fa6a400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:41.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.095+0000 7fa6a8ff9640 1 -- 172.21.15.18:0/1527609767 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a401a070 con 0x7fa6ac15eea0 2024-09-19T09:18:41.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.096+0000 7fa6a8ff9640 1 -- 172.21.15.18:0/1527609767 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6a400d860 con 0x7fa6ac15eea0 2024-09-19T09:18:41.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.096+0000 7fa6b1877640 1 -- 172.21.15.18:0/1527609767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6ac15a920 con 0x7fa6ac15eea0 2024-09-19T09:18:41.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.096+0000 7fa6a8ff9640 1 -- 172.21.15.18:0/1527609767 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6a400dc50 con 0x7fa6ac15eea0 2024-09-19T09:18:41.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.096+0000 7fa6b1877640 1 -- 172.21.15.18:0/1527609767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6ac15aee0 con 0x7fa6ac15eea0 2024-09-19T09:18:41.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.097+0000 7fa6b1877640 1 -- 172.21.15.18:0/1527609767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6ac06bc10 con 0x7fa6ac15eea0 2024-09-19T09:18:41.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.097+0000 7fa6a8ff9640 1 -- 172.21.15.18:0/1527609767 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa6a401d070 con 0x7fa6ac15eea0 2024-09-19T09:18:41.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.097+0000 7fa6a8ff9640 1 --2- 172.21.15.18:0/1527609767 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa68c06c2b0 0x7fa68c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:41.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.097+0000 7fa6a8ff9640 1 -- 172.21.15.18:0/1527609767 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5709+0+0 (secure 0 0 0) 0x7fa6a408bbd0 con 0x7fa6ac15eea0 2024-09-19T09:18:41.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.098+0000 7fa6a8ff9640 1 -- 172.21.15.18:0/1527609767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=108}) -- 0x7fa68c073e40 con 0x7fa6ac15eea0 2024-09-19T09:18:41.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.098+0000 7fa6aaffd640 1 --2- 172.21.15.18:0/1527609767 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa68c06c2b0 0x7fa68c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:41.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.098+0000 7fa6aaffd640 1 --2- 172.21.15.18:0/1527609767 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa68c06c2b0 0x7fa68c06e770 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa69c006fd0 tx=0x7fa69c009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:41.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.102+0000 7fa6a8ff9640 1 -- 172.21.15.18:0/1527609767 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa6a4059e40 con 0x7fa6ac15eea0 2024-09-19T09:18:41.182 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-19T09:18:41.182+0000 7fca8cfa1640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2024-09-19T09:18:41.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.278+0000 7fa6b1877640 1 -- 172.21.15.18:0/1527609767 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fa6ac15e490 con 0x7fa6ac15eea0 2024-09-19T09:18:41.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.280+0000 7fa6a8ff9640 1 -- 172.21.15.18:0/1527609767 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v107) ==== 81+0+34462 (secure 0 0 0) 0x7fa6a405e140 con 0x7fa6ac15eea0 2024-09-19T09:18:41.281 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:41.281 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:18:41.281 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 107, 2024-09-19T09:18:41.281 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:18:41.281 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-19T09:13:11.348786+0000", 2024-09-19T09:18:41.281 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-19T09:18:37.710547+0000", 2024-09-19T09:18:41.281 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-19T09:13:16.423937+0000", 2024-09-19T09:18:41.281 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-19T09:13:13.417141+0000", 2024-09-19T09:18:41.282 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-19T09:18:41.282 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-09-19T09:18:41.282 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-19T09:18:41.282 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-19T09:18:41.282 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-19T09:18:41.282 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-19T09:18:41.282 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-19T09:18:41.282 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:18:41.282 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-19T09:18:41.282 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.69999998807907104, 2024-09-19T09:18:41.282 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-19T09:18:41.282 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-19T09:18:41.282 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-19T09:18:41.283 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 13, 2024-09-19T09:18:41.283 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-19T09:18:41.283 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-19T09:18:41.283 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "jewel", 2024-09-19T09:18:41.283 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-19T09:18:41.283 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-19T09:18:41.283 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-19T09:18:41.283 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.283 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-19T09:18:41.283 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-19T09:18:41.283 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:13:17.564717+0000", 2024-09-19T09:18:41.283 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 3, 2024-09-19T09:18:41.283 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full", 2024-09-19T09:18:41.283 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:18:41.284 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:18:41.284 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:18:41.284 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:18:41.284 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:18:41.284 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:18:41.284 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:18:41.284 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:18:41.284 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:18:41.284 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:18:41.284 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:18:41.284 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-19T09:18:41.284 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-19T09:18:41.284 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-19T09:18:41.284 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-19T09:18:41.285 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-19T09:18:41.285 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:18:41.285 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:18:41.285 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:18:41.285 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:18:41.285 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:18:41.285 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:18:41.285 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:18:41.285 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.285 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "105", 2024-09-19T09:18:41.285 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:18:41.285 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:18:41.285 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:18:41.286 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:18:41.286 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:18:41.286 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:18:41.286 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:18:41.286 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:18:41.286 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:18:41.286 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:18:41.286 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:18:41.286 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:18:41.286 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:18:41.286 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:18:41.286 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:18:41.286 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:18:41.286 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:18:41.287 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:18:41.287 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:18:41.287 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:18:41.287 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:18:41.287 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:18:41.287 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:18:41.287 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:18:41.287 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:18:41.287 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:18:41.287 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.287 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:18:41.287 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:18:41.287 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:18:41.288 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:18:41.288 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:18:41.288 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:18:41.288 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:18:41.288 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:18:41.288 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:18:41.288 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:18:41.288 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:18:41.288 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:18:41.288 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-19T09:18:41.288 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-19T09:18:41.288 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.288 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:18:41.289 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-19T09:18:41.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.289 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:18:41.289 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:18:41.289 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-19T09:18:41.289 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-19T09:18:41.289 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-19T09:18:41.289 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-19T09:18:41.289 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-19T09:18:41.289 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:18:41.289 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:18:41.289 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:18:41.289 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.289 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.289 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.290 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 12, 2024-09-19T09:18:41.290 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_metadata", 2024-09-19T09:18:41.290 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:18:21.441414+0000", 2024-09-19T09:18:41.290 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 3, 2024-09-19T09:18:41.290 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full", 2024-09-19T09:18:41.290 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:18:41.290 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:18:41.290 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:18:41.290 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:18:41.290 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:18:41.290 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:18:41.290 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:18:41.290 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:18:41.291 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:18:41.291 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:18:41.291 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:18:41.291 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-19T09:18:41.291 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-19T09:18:41.291 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-19T09:18:41.291 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-19T09:18:41.291 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-19T09:18:41.291 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:18:41.291 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:18:41.291 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:18:41.291 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:18:41.291 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:18:41.291 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:18:41.292 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:18:41.292 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.292 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "105", 2024-09-19T09:18:41.292 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:18:41.292 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:18:41.292 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:18:41.292 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:18:41.292 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:18:41.292 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:18:41.292 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:18:41.292 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:18:41.292 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:18:41.292 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:18:41.292 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:18:41.293 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:18:41.293 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:18:41.293 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:18:41.293 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:18:41.293 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:18:41.293 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:18:41.293 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:18:41.293 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:18:41.293 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:18:41.293 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:18:41.293 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:18:41.293 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:18:41.293 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:18:41.294 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:18:41.294 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:18:41.294 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.294 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:18:41.294 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:18:41.294 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:18:41.294 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:18:41.294 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:18:41.294 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:18:41.294 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:18:41.294 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:18:41.294 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:18:41.294 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:18:41.295 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:18:41.295 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:18:41.295 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4, 2024-09-19T09:18:41.295 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 16, 2024-09-19T09:18:41.295 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_priority": 5 2024-09-19T09:18:41.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.295 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:18:41.295 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:18:41.295 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": "cephfs" 2024-09-19T09:18:41.295 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.295 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.295 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:18:41.295 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:18:41.295 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.75, 2024-09-19T09:18:41.296 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.75, 2024-09-19T09:18:41.296 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:18:41.296 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.75, 2024-09-19T09:18:41.296 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.75, 2024-09-19T09:18:41.296 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:18:41.296 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:18:41.296 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:18:41.296 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.296 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.296 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.296 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 13, 2024-09-19T09:18:41.296 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_data", 2024-09-19T09:18:41.296 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:18:22.767737+0000", 2024-09-19T09:18:41.296 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 3, 2024-09-19T09:18:41.297 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full", 2024-09-19T09:18:41.297 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:18:41.297 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:18:41.297 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:18:41.297 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:18:41.297 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:18:41.297 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:18:41.297 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:18:41.297 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:18:41.298 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:18:41.298 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:18:41.298 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:18:41.298 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 64, 2024-09-19T09:18:41.298 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 64, 2024-09-19T09:18:41.298 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 64, 2024-09-19T09:18:41.298 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 64, 2024-09-19T09:18:41.298 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 64, 2024-09-19T09:18:41.298 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:18:41.298 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:18:41.298 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:18:41.298 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:18:41.298 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:18:41.299 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:18:41.299 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:18:41.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.299 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "105", 2024-09-19T09:18:41.299 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:18:41.299 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:18:41.299 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:18:41.299 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:18:41.299 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:18:41.299 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:18:41.299 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:18:41.299 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:18:41.299 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:18:41.299 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:18:41.300 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:18:41.300 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:18:41.300 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:18:41.300 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:18:41.300 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:18:41.300 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:18:41.300 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:18:41.300 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:18:41.300 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:18:41.300 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:18:41.300 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:18:41.300 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:18:41.300 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:18:41.301 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:18:41.301 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:18:41.301 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:18:41.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.301 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:18:41.301 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:18:41.301 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:18:41.301 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:18:41.301 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:18:41.301 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:18:41.301 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:18:41.301 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:18:41.301 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:18:41.301 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:18:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:18:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:18:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 64, 2024-09-19T09:18:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: "target_size_ratio": 0.89999997615814209 2024-09-19T09:18:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:18:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:18:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: "data": "cephfs" 2024-09-19T09:18:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:18:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:18:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.3799999952316284, 2024-09-19T09:18:41.302 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.3799999952316284, 2024-09-19T09:18:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:18:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-19T09:18:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-19T09:18:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:18:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:18:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:18:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:18:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-19T09:18:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.303 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:18:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.304 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-19T09:18:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-19T09:18:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.305 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-19T09:18:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-19T09:18:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.306 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-19T09:18:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-19T09:18:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.307 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-19T09:18:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-19T09:18:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/128722874", 2024-09-19T09:18:41.308 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/128722874", 2024-09-19T09:18:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/128722874", 2024-09-19T09:18:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/128722874", 2024-09-19T09:18:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: "full", 2024-09-19T09:18:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:18:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:41.309 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-19T09:18:41.310 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-19T09:18:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-19T09:18:41.311 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-19T09:18:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.312 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-19T09:18:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-19T09:18:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.313 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-19T09:18:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-19T09:18:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/3672199638", 2024-09-19T09:18:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/3672199638", 2024-09-19T09:18:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/3672199638", 2024-09-19T09:18:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/3672199638", 2024-09-19T09:18:41.314 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:41.315 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull", 2024-09-19T09:18:41.315 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:41.315 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:41.315 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.315 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.315 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:18:41.315 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:41.315 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:41.315 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:41.315 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:41.315 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:41.315 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:41.315 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:41.315 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:41.316 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:41.316 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:41.316 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:41.316 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:41.316 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.316 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.316 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T09:18:41.316 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:41.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.316 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.317 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T09:18:41.317 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:41.317 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.317 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.317 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:41.317 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.317 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.317 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-19T09:18:41.317 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:41.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.317 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.318 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-19T09:18:41.318 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:41.318 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.318 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.318 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:41.318 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.318 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.318 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-19T09:18:41.318 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:41.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.319 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.319 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-19T09:18:41.319 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:41.319 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.319 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.319 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:41.319 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.319 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.319 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-19T09:18:41.319 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:41.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.320 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.320 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-19T09:18:41.320 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:41.320 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.320 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.320 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3463367841", 2024-09-19T09:18:41.320 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3463367841", 2024-09-19T09:18:41.320 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3463367841", 2024-09-19T09:18:41.320 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3463367841", 2024-09-19T09:18:41.320 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:41.320 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull", 2024-09-19T09:18:41.320 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:41.320 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:41.321 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.321 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.321 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:18:41.321 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:41.321 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:41.321 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:41.321 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:41.321 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:41.321 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:41.321 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:41.321 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:41.321 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:41.321 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:41.322 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:41.322 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:41.322 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.322 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.322 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-19T09:18:41.322 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:41.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.322 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.322 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-19T09:18:41.322 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:41.322 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.322 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.323 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:41.323 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.323 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.323 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-19T09:18:41.323 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:41.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.323 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.323 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-19T09:18:41.323 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:41.323 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.323 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.324 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:41.324 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.324 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.324 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-19T09:18:41.324 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:41.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.324 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.324 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-19T09:18:41.324 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:41.324 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.325 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.325 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:41.325 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.325 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.325 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-19T09:18:41.325 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:41.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.325 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.325 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-19T09:18:41.325 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:41.326 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.326 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.326 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/4163178582", 2024-09-19T09:18:41.326 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/4163178582", 2024-09-19T09:18:41.326 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/4163178582", 2024-09-19T09:18:41.326 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/4163178582", 2024-09-19T09:18:41.326 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:41.326 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:41.326 INFO:teuthology.orchestra.run.smithi018.stdout: "full", 2024-09-19T09:18:41.326 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:41.326 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.326 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:18:41.327 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:41.327 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:41.327 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:41.327 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:41.327 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:41.327 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:41.327 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:41.327 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:41.327 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:41.327 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:41.327 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:41.327 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:41.327 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.328 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.328 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6822", 2024-09-19T09:18:41.328 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:41.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.328 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.328 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6824", 2024-09-19T09:18:41.328 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:41.328 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.328 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.328 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:41.328 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.329 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.329 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6826", 2024-09-19T09:18:41.329 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:41.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.329 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.329 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6827", 2024-09-19T09:18:41.329 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:41.329 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.329 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.329 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:41.329 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.330 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.330 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6830", 2024-09-19T09:18:41.330 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:41.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.330 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.330 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6831", 2024-09-19T09:18:41.330 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:41.330 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.330 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.330 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:41.330 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.331 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.331 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6828", 2024-09-19T09:18:41.331 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:41.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.331 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.331 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6829", 2024-09-19T09:18:41.331 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:41.331 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.331 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.331 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6824/3538482215", 2024-09-19T09:18:41.331 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6827/3538482215", 2024-09-19T09:18:41.331 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6831/3538482215", 2024-09-19T09:18:41.332 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6829/3538482215", 2024-09-19T09:18:41.332 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:41.332 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:41.332 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:41.332 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.332 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.332 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:18:41.332 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:41.332 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:41.333 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:41.333 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:41.333 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:41.333 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:41.333 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:41.333 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:41.333 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:41.333 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:41.333 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:41.333 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:41.333 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.333 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.333 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6800", 2024-09-19T09:18:41.333 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:41.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.334 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.334 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6801", 2024-09-19T09:18:41.334 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:41.334 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.334 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.334 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:41.334 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.334 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.334 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6802", 2024-09-19T09:18:41.334 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:41.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.335 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.335 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6803", 2024-09-19T09:18:41.335 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:41.335 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.335 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.335 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:41.335 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.335 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.335 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6806", 2024-09-19T09:18:41.335 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:41.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.336 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.336 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6807", 2024-09-19T09:18:41.336 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:41.336 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.336 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.336 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:41.336 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.336 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.336 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6804", 2024-09-19T09:18:41.336 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:41.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.337 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.337 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6805", 2024-09-19T09:18:41.337 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:41.337 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.337 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.337 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6801/2408698413", 2024-09-19T09:18:41.337 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6803/2408698413", 2024-09-19T09:18:41.337 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6807/2408698413", 2024-09-19T09:18:41.337 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6805/2408698413", 2024-09-19T09:18:41.337 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:41.337 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:41.337 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:41.338 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.338 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:18:41.338 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:41.338 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:41.338 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:41.338 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:41.338 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:41.338 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:41.338 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:41.338 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:41.338 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:41.338 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:41.339 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:41.339 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:41.339 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.339 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.339 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6808", 2024-09-19T09:18:41.339 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:41.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.339 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.339 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6809", 2024-09-19T09:18:41.339 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:41.339 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.340 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.340 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:41.340 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.340 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.340 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6810", 2024-09-19T09:18:41.340 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:41.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.340 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.340 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6811", 2024-09-19T09:18:41.340 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:41.340 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.341 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.341 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:41.341 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.341 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.341 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6814", 2024-09-19T09:18:41.341 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:41.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.341 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.341 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6815", 2024-09-19T09:18:41.341 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:41.341 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.342 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.342 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:41.342 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.342 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.342 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6812", 2024-09-19T09:18:41.342 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:41.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.342 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.342 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6813", 2024-09-19T09:18:41.342 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:41.343 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.343 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.343 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6809/2596207948", 2024-09-19T09:18:41.343 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6811/2596207948", 2024-09-19T09:18:41.343 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6815/2596207948", 2024-09-19T09:18:41.343 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6813/2596207948", 2024-09-19T09:18:41.343 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:41.343 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:41.343 INFO:teuthology.orchestra.run.smithi018.stdout: "full", 2024-09-19T09:18:41.343 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:41.343 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.344 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.344 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:18:41.344 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:41.344 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:41.344 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:41.344 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:41.344 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:41.344 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:41.344 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:41.344 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:41.344 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:41.344 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:41.345 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:41.345 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:41.345 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.345 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.345 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6816", 2024-09-19T09:18:41.345 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:41.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.346 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.346 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6817", 2024-09-19T09:18:41.346 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:41.346 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.346 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.346 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:41.346 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.346 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.346 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6818", 2024-09-19T09:18:41.346 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:41.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.347 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.347 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6819", 2024-09-19T09:18:41.347 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:41.347 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.347 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.347 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:41.347 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.347 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.347 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6823", 2024-09-19T09:18:41.347 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:41.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.348 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.348 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6825", 2024-09-19T09:18:41.348 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:41.348 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.348 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.348 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:41.348 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:41.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.348 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:41.348 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6820", 2024-09-19T09:18:41.348 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:41.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.349 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:41.349 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6821", 2024-09-19T09:18:41.349 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:41.349 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.349 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.349 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6817/1334618296", 2024-09-19T09:18:41.349 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6819/1334618296", 2024-09-19T09:18:41.349 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6825/1334618296", 2024-09-19T09:18:41.349 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6821/1334618296", 2024-09-19T09:18:41.349 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:41.349 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:41.349 INFO:teuthology.orchestra.run.smithi018.stdout: "full", 2024-09-19T09:18:41.349 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:41.350 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:41.350 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.350 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:18:41.350 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-19T09:18:41.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.350 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:18:41.350 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:41.350 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:41.350 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:41.350 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:41.350 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:41.350 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.580838+0000", 2024-09-19T09:18:41.350 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:41.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:18:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.599990+0000", 2024-09-19T09:18:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:18:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:41.351 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:41.352 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:41.352 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:41.352 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.503722+0000", 2024-09-19T09:18:41.352 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:41.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.352 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:18:41.352 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:41.352 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:41.352 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:41.352 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:41.352 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:41.352 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.607846+0000", 2024-09-19T09:18:41.352 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:41.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.353 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:18:41.353 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:41.353 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:41.353 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:41.353 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:41.353 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:41.353 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.616858+0000", 2024-09-19T09:18:41.353 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:41.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.353 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:18:41.354 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:41.354 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:41.354 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:41.354 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:41.354 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:41.354 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.542726+0000", 2024-09-19T09:18:41.354 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:41.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.354 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:18:41.354 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:41.354 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:41.354 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:41.354 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:41.355 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:41.355 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.534178+0000", 2024-09-19T09:18:41.355 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:41.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:41.355 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:18:41.355 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:41.355 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:41.355 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:41.355 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:41.355 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:41.355 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.612105+0000", 2024-09-19T09:18:41.355 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:41.356 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.356 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:18:41.356 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-19T09:18:41.356 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-19T09:18:41.356 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-19T09:18:41.356 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-19T09:18:41.356 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-19T09:18:41.356 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-19T09:18:41.356 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-19T09:18:41.356 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-19T09:18:41.356 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-19T09:18:41.356 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-19T09:18:41.356 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-19T09:18:41.356 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-19T09:18:41.357 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-19T09:18:41.357 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-19T09:18:41.357 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:41.357 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-19T09:18:41.357 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-19T09:18:41.357 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-19T09:18:41.357 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-19T09:18:41.357 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-19T09:18:41.357 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-19T09:18:41.357 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-19T09:18:41.357 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-19T09:18:41.357 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-19T09:18:41.357 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-19T09:18:41.358 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-19T09:18:41.358 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:41.358 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:18:41.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.282+0000 7fa6b1877640 1 -- 172.21.15.18:0/1527609767 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa68c06c2b0 msgr2=0x7fa68c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:41.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.282+0000 7fa6b1877640 1 --2- 172.21.15.18:0/1527609767 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa68c06c2b0 0x7fa68c06e770 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fa69c006fd0 tx=0x7fa69c009060 comp rx=0 tx=0).stop 2024-09-19T09:18:41.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.282+0000 7fa6b1877640 1 -- 172.21.15.18:0/1527609767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6ac15eea0 msgr2=0x7fa6ac15b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:41.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.282+0000 7fa6b1877640 1 --2- 172.21.15.18:0/1527609767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6ac15eea0 0x7fa6ac15b6e0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fa6a400cef0 tx=0x7fa6a400a710 comp rx=0 tx=0).stop 2024-09-19T09:18:41.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.282+0000 7fa6b1877640 1 -- 172.21.15.18:0/1527609767 shutdown_connections 2024-09-19T09:18:41.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.282+0000 7fa6b1877640 1 --2- 172.21.15.18:0/1527609767 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa68c06c2b0 0x7fa68c06e770 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.282+0000 7fa6b1877640 1 --2- 172.21.15.18:0/1527609767 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa6ac15eea0 0x7fa6ac15b6e0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.282+0000 7fa6b1877640 1 --2- 172.21.15.18:0/1527609767 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa6ac0ced00 0x7fa6ac0b3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.282+0000 7fa6b1877640 1 --2- 172.21.15.18:0/1527609767 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa6ac06c320 0x7fa6ac161cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:41.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.282+0000 7fa6b1877640 1 -- 172.21.15.18:0/1527609767 >> 172.21.15.18:0/1527609767 conn(0x7fa6ac0731b0 msgr2=0x7fa6ac15d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:41.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.282+0000 7fa6b1877640 1 -- 172.21.15.18:0/1527609767 shutdown_connections 2024-09-19T09:18:41.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:41.282+0000 7fa6b1877640 1 -- 172.21.15.18:0/1527609767 wait complete. 2024-09-19T09:18:41.361 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-19T09:18:46.183 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-19T09:18:46.183+0000 7fca8cfa1640 -1 log_channel(cluster) log [ERR] : Health check update: 1 full osd(s) (OSD_FULL) 2024-09-19T09:18:46.362 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-19T09:18:46.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.478+0000 7ff470bc4640 1 Processor -- start 2024-09-19T09:18:46.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.478+0000 7ff470bc4640 1 -- start start 2024-09-19T09:18:46.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.479+0000 7ff470bc4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff46c15eea0 0x7ff46c06bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:46.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.479+0000 7ff470bc4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff46c0b67b0 0x7ff46c06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:46.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.479+0000 7ff470bc4640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff46c0b6db0 con 0x7ff46c0ced00 2024-09-19T09:18:46.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.479+0000 7ff470bc4640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7ff46c0b7070 con 0x7ff46c0b67b0 2024-09-19T09:18:46.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.479+0000 7ff470bc4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff46c0b1390 con 0x7ff46c15eea0 2024-09-19T09:18:46.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.479+0000 7ff46ad9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff46c0b67b0 0x7ff46c06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:46.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.479+0000 7ff46ad9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff46c0b67b0 0x7ff46c06c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36630/0 (socket says 172.21.15.18:36630) 2024-09-19T09:18:46.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.479+0000 7ff46ad9d640 1 -- 172.21.15.18:0/3166492234 learned_addr learned my addr 172.21.15.18:0/3166492234 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:46.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.479+0000 7ff46a59c640 1 --2- 172.21.15.18:0/3166492234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff46c15eea0 0x7ff46c06bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:46.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.479+0000 7ff46ad9d640 1 -- 172.21.15.18:0/3166492234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff46c15eea0 msgr2=0x7ff46c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:46.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.479+0000 7ff46ad9d640 1 --2- 172.21.15.18:0/3166492234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff46c15eea0 0x7ff46c06bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:46.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.479+0000 7ff46ad9d640 1 -- 172.21.15.18:0/3166492234 >> v1:172.21.15.162:6789/0 conn(0x7ff46c0ced00 legacy=0x7ff46c0b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:46.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.479+0000 7ff46ad9d640 1 -- 172.21.15.18:0/3166492234 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff46c0b1670 con 0x7ff46c0b67b0 2024-09-19T09:18:46.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.479+0000 7ff46a59c640 1 --2- 172.21.15.18:0/3166492234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff46c15eea0 0x7ff46c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:46.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.480+0000 7ff46ad9d640 1 --2- 172.21.15.18:0/3166492234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff46c0b67b0 0x7ff46c06c150 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff464009e50 tx=0x7ff46402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce07595b50dd0ac6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:46.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.480+0000 7ff46959a640 1 -- 172.21.15.18:0/3166492234 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff464036070 con 0x7ff46c0b67b0 2024-09-19T09:18:46.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.480+0000 7ff46959a640 1 -- 172.21.15.18:0/3166492234 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff464031600 con 0x7ff46c0b67b0 2024-09-19T09:18:46.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.480+0000 7ff46959a640 1 -- 172.21.15.18:0/3166492234 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4640319d0 con 0x7ff46c0b67b0 2024-09-19T09:18:46.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.481+0000 7ff470bc4640 1 -- 172.21.15.18:0/3166492234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff46c0b67b0 msgr2=0x7ff46c06c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:46.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.481+0000 7ff470bc4640 1 --2- 172.21.15.18:0/3166492234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff46c0b67b0 0x7ff46c06c150 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff464009e50 tx=0x7ff46402a710 comp rx=0 tx=0).stop 2024-09-19T09:18:46.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.481+0000 7ff470bc4640 1 -- 172.21.15.18:0/3166492234 shutdown_connections 2024-09-19T09:18:46.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.481+0000 7ff470bc4640 1 --2- 172.21.15.18:0/3166492234 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff46c0b67b0 0x7ff46c06c150 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:46.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.481+0000 7ff470bc4640 1 --2- 172.21.15.18:0/3166492234 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff46c15eea0 0x7ff46c06bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:46.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.481+0000 7ff470bc4640 1 -- 172.21.15.18:0/3166492234 >> 172.21.15.18:0/3166492234 conn(0x7ff46c0731b0 msgr2=0x7ff46c0735c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:46.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.481+0000 7ff470bc4640 1 -- 172.21.15.18:0/3166492234 shutdown_connections 2024-09-19T09:18:46.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.481+0000 7ff470bc4640 1 -- 172.21.15.18:0/3166492234 wait complete. 2024-09-19T09:18:46.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.482+0000 7ff470bc4640 1 Processor -- start 2024-09-19T09:18:46.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.482+0000 7ff470bc4640 1 -- start start 2024-09-19T09:18:46.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.483+0000 7ff470bc4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff46c0b67b0 0x7ff46c149550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:46.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.483+0000 7ff470bc4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff46c0ced00 0x7ff46c1e9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:46.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.483+0000 7ff470bc4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff46c15eea0 0x7ff46c159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:46.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.483+0000 7ff470bc4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff46c0b1b90 con 0x7ff46c0ced00 2024-09-19T09:18:46.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.483+0000 7ff470bc4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff46c0b1040 con 0x7ff46c0b67b0 2024-09-19T09:18:46.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.483+0000 7ff470bc4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff46c0b1d10 con 0x7ff46c15eea0 2024-09-19T09:18:46.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.483+0000 7ff469d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff46c0ced00 0x7ff46c1e9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:46.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.483+0000 7ff469d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff46c0ced00 0x7ff46c1e9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36644/0 (socket says 172.21.15.18:36644) 2024-09-19T09:18:46.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.483+0000 7ff469d9b640 1 -- 172.21.15.18:0/1309869235 learned_addr learned my addr 172.21.15.18:0/1309869235 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:46.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.483+0000 7ff46a59c640 1 --2- 172.21.15.18:0/1309869235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff46c0b67b0 0x7ff46c149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:46.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.483+0000 7ff46ad9d640 1 --2- 172.21.15.18:0/1309869235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff46c15eea0 0x7ff46c159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:46.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.483+0000 7ff469d9b640 1 -- 172.21.15.18:0/1309869235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff46c15eea0 msgr2=0x7ff46c159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:46.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.484+0000 7ff469d9b640 1 --2- 172.21.15.18:0/1309869235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff46c15eea0 0x7ff46c159190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:46.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.484+0000 7ff469d9b640 1 -- 172.21.15.18:0/1309869235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff46c0b67b0 msgr2=0x7ff46c149550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:46.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.484+0000 7ff469d9b640 1 --2- 172.21.15.18:0/1309869235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff46c0b67b0 0x7ff46c149550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:46.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.484+0000 7ff469d9b640 1 -- 172.21.15.18:0/1309869235 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff46c1e88b0 con 0x7ff46c0ced00 2024-09-19T09:18:46.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.484+0000 7ff469d9b640 1 --2- 172.21.15.18:0/1309869235 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff46c0ced00 0x7ff46c1e9410 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ff46000c430 tx=0x7ff46000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:46.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.484+0000 7ff45affd640 1 -- 172.21.15.18:0/1309869235 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4600052d0 con 0x7ff46c0ced00 2024-09-19T09:18:46.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.484+0000 7ff45affd640 1 -- 172.21.15.18:0/1309869235 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff460005490 con 0x7ff46c0ced00 2024-09-19T09:18:46.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.484+0000 7ff470bc4640 1 -- 172.21.15.18:0/1309869235 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff46c149a90 con 0x7ff46c0ced00 2024-09-19T09:18:46.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.484+0000 7ff45affd640 1 -- 172.21.15.18:0/1309869235 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff460007260 con 0x7ff46c0ced00 2024-09-19T09:18:46.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.484+0000 7ff470bc4640 1 -- 172.21.15.18:0/1309869235 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff46c1e7dd0 con 0x7ff46c0ced00 2024-09-19T09:18:46.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.485+0000 7ff470bc4640 1 -- 172.21.15.18:0/1309869235 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff46c0b60a0 con 0x7ff46c0ced00 2024-09-19T09:18:46.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.485+0000 7ff45affd640 1 -- 172.21.15.18:0/1309869235 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff460007400 con 0x7ff46c0ced00 2024-09-19T09:18:46.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.486+0000 7ff45affd640 1 --2- 172.21.15.18:0/1309869235 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff44c06c2b0 0x7ff44c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:46.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.486+0000 7ff45affd640 1 -- 172.21.15.18:0/1309869235 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 5709+0+0 (secure 0 0 0) 0x7ff46008a8c0 con 0x7ff46c0ced00 2024-09-19T09:18:46.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.486+0000 7ff45affd640 1 -- 172.21.15.18:0/1309869235 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=111}) -- 0x7ff44c073e40 con 0x7ff46c0ced00 2024-09-19T09:18:46.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.486+0000 7ff46a59c640 1 --2- 172.21.15.18:0/1309869235 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff44c06c2b0 0x7ff44c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:46.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.487+0000 7ff46a59c640 1 --2- 172.21.15.18:0/1309869235 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff44c06c2b0 0x7ff44c06e770 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff45c006fd0 tx=0x7ff45c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:46.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.490+0000 7ff45affd640 1 -- 172.21.15.18:0/1309869235 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff46c149a90 con 0x7ff46c0ced00 2024-09-19T09:18:46.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.669+0000 7ff470bc4640 1 -- 172.21.15.18:0/1309869235 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7ff46c06cfc0 con 0x7ff46c0ced00 2024-09-19T09:18:46.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.670+0000 7ff45affd640 1 -- 172.21.15.18:0/1309869235 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v110) ==== 81+0+34326 (secure 0 0 0) 0x7ff46c1e88b0 con 0x7ff46c0ced00 2024-09-19T09:18:46.671 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:46.671 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:18:46.671 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 110, 2024-09-19T09:18:46.671 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:18:46.671 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-19T09:13:11.348786+0000", 2024-09-19T09:18:46.672 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-19T09:18:44.737783+0000", 2024-09-19T09:18:46.672 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-19T09:13:16.423937+0000", 2024-09-19T09:18:46.672 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-19T09:13:13.417141+0000", 2024-09-19T09:18:46.672 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-19T09:18:46.672 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-09-19T09:18:46.672 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-19T09:18:46.672 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-19T09:18:46.672 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-19T09:18:46.672 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-19T09:18:46.672 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-19T09:18:46.672 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:18:46.672 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-19T09:18:46.673 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.69999998807907104, 2024-09-19T09:18:46.673 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-19T09:18:46.673 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-19T09:18:46.673 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-19T09:18:46.673 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 13, 2024-09-19T09:18:46.673 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-19T09:18:46.673 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-19T09:18:46.673 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "jewel", 2024-09-19T09:18:46.673 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-19T09:18:46.673 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-19T09:18:46.673 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-19T09:18:46.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.673 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-19T09:18:46.674 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-19T09:18:46.674 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:13:17.564717+0000", 2024-09-19T09:18:46.674 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 3, 2024-09-19T09:18:46.674 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full", 2024-09-19T09:18:46.674 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:18:46.674 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:18:46.674 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:18:46.674 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:18:46.674 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:18:46.674 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:18:46.674 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:18:46.674 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:18:46.674 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:18:46.675 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:18:46.675 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:18:46.675 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-19T09:18:46.675 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-19T09:18:46.675 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-19T09:18:46.675 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-19T09:18:46.675 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-19T09:18:46.675 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:18:46.675 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:18:46.675 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:18:46.675 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:18:46.675 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:18:46.675 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:18:46.675 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:18:46.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.676 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "105", 2024-09-19T09:18:46.676 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:18:46.676 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:18:46.676 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:18:46.676 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:18:46.676 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:18:46.676 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:18:46.676 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:18:46.676 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:18:46.676 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:18:46.676 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:18:46.676 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:18:46.677 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:18:46.677 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:18:46.677 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:18:46.677 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:18:46.677 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:18:46.677 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:18:46.677 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:18:46.677 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:18:46.677 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:18:46.677 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:18:46.677 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:18:46.677 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:18:46.677 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:18:46.678 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:18:46.678 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:18:46.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.678 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:18:46.678 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:18:46.679 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:18:46.679 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:18:46.679 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:18:46.679 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:18:46.679 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:18:46.679 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:18:46.679 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:18:46.679 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:18:46.679 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:18:46.679 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:18:46.679 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-19T09:18:46.679 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-19T09:18:46.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.680 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:18:46.680 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-19T09:18:46.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.680 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:18:46.680 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:18:46.680 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-19T09:18:46.680 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-19T09:18:46.680 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-19T09:18:46.680 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-19T09:18:46.680 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-19T09:18:46.680 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:18:46.680 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:18:46.680 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:18:46.681 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.681 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.681 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 12, 2024-09-19T09:18:46.681 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_metadata", 2024-09-19T09:18:46.681 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:18:21.441414+0000", 2024-09-19T09:18:46.681 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 3, 2024-09-19T09:18:46.681 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full", 2024-09-19T09:18:46.681 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:18:46.681 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:18:46.681 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:18:46.681 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:18:46.681 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:18:46.682 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:18:46.682 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:18:46.682 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:18:46.682 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:18:46.682 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:18:46.682 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:18:46.682 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-19T09:18:46.682 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-19T09:18:46.682 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-19T09:18:46.682 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-19T09:18:46.682 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-19T09:18:46.682 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:18:46.682 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:18:46.682 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:18:46.683 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:18:46.683 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:18:46.683 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:18:46.683 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:18:46.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.683 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "105", 2024-09-19T09:18:46.683 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:18:46.683 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:18:46.683 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:18:46.683 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:18:46.683 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:18:46.683 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:18:46.683 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:18:46.683 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:18:46.684 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:18:46.684 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:18:46.684 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:18:46.684 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:18:46.684 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:18:46.684 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:18:46.684 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:18:46.684 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:18:46.684 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:18:46.684 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:18:46.684 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:18:46.684 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:18:46.684 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:18:46.684 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:18:46.685 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:18:46.685 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:18:46.685 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:18:46.685 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:18:46.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.685 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:18:46.685 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:18:46.685 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:18:46.685 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:18:46.685 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:18:46.685 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:18:46.685 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:18:46.686 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:18:46.686 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:18:46.686 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:18:46.686 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:18:46.686 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:18:46.686 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4, 2024-09-19T09:18:46.686 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 16, 2024-09-19T09:18:46.686 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_priority": 5 2024-09-19T09:18:46.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.686 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:18:46.686 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:18:46.686 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": "cephfs" 2024-09-19T09:18:46.686 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.687 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:18:46.687 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:18:46.687 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.75, 2024-09-19T09:18:46.687 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.75, 2024-09-19T09:18:46.687 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:18:46.687 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.75, 2024-09-19T09:18:46.687 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.75, 2024-09-19T09:18:46.687 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:18:46.687 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:18:46.687 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:18:46.687 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.687 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 13, 2024-09-19T09:18:46.688 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_data", 2024-09-19T09:18:46.688 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:18:22.767737+0000", 2024-09-19T09:18:46.688 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 3, 2024-09-19T09:18:46.688 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full", 2024-09-19T09:18:46.688 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:18:46.688 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:18:46.688 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:18:46.688 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:18:46.688 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:18:46.688 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:18:46.688 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:18:46.688 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:18:46.688 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:18:46.689 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:18:46.689 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:18:46.689 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 64, 2024-09-19T09:18:46.689 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 64, 2024-09-19T09:18:46.689 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 64, 2024-09-19T09:18:46.689 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 64, 2024-09-19T09:18:46.689 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 64, 2024-09-19T09:18:46.689 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:18:46.689 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:18:46.689 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:18:46.689 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:18:46.689 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:18:46.690 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:18:46.690 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:18:46.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.690 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "105", 2024-09-19T09:18:46.690 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:18:46.690 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:18:46.692 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:18:46.692 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:18:46.692 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:18:46.692 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:18:46.692 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:18:46.692 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:18:46.692 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:18:46.692 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:18:46.692 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:18:46.692 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:18:46.692 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:18:46.692 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:18:46.692 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:18:46.693 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:18:46.693 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:18:46.693 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:18:46.693 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:18:46.693 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:18:46.693 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:18:46.693 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:18:46.693 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:18:46.693 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:18:46.693 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:18:46.693 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:18:46.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.693 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:18:46.694 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:18:46.694 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:18:46.694 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:18:46.695 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:18:46.695 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:18:46.696 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:18:46.696 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:18:46.696 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:18:46.696 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:18:46.696 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:18:46.696 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:18:46.696 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 64, 2024-09-19T09:18:46.696 INFO:teuthology.orchestra.run.smithi018.stdout: "target_size_ratio": 0.89999997615814209 2024-09-19T09:18:46.696 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.696 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:18:46.696 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:18:46.696 INFO:teuthology.orchestra.run.smithi018.stdout: "data": "cephfs" 2024-09-19T09:18:46.696 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.697 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.697 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:18:46.697 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:18:46.697 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.3799999952316284, 2024-09-19T09:18:46.697 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.3799999952316284, 2024-09-19T09:18:46.697 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:18:46.697 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-19T09:18:46.697 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-19T09:18:46.697 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:18:46.697 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:18:46.697 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:18:46.697 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.697 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.698 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:18:46.698 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-19T09:18:46.698 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.698 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:18:46.698 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:46.698 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:46.698 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:46.698 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:46.698 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:46.698 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:46.698 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:46.698 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:46.698 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:46.698 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:46.699 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:46.700 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:46.700 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.700 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.700 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-19T09:18:46.700 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:46.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.700 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.700 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.700 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-19T09:18:46.700 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:46.701 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.701 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.702 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:46.702 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.702 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.702 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-19T09:18:46.702 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:46.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.702 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.702 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.703 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-19T09:18:46.703 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:46.703 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.703 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.703 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.703 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:46.703 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.704 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.704 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-19T09:18:46.704 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:46.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.704 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.705 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-19T09:18:46.705 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:46.705 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.705 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.705 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:46.705 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.705 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.706 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-19T09:18:46.706 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:46.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.706 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.706 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-19T09:18:46.707 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:46.707 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.707 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.707 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/128722874", 2024-09-19T09:18:46.707 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/128722874", 2024-09-19T09:18:46.707 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/128722874", 2024-09-19T09:18:46.707 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/128722874", 2024-09-19T09:18:46.707 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:46.707 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:46.708 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:46.708 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.708 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:18:46.708 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:46.708 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:46.708 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:46.708 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:46.708 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:46.708 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:46.708 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:46.708 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:46.709 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:46.709 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:46.709 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:46.709 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:46.709 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.709 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.709 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-19T09:18:46.709 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:46.709 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.709 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.710 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-19T09:18:46.710 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:46.710 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.710 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.711 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:46.711 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.711 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.711 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-19T09:18:46.711 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:46.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.711 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.711 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-19T09:18:46.711 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:46.711 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.712 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.712 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:46.712 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.712 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.712 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-19T09:18:46.712 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:46.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.712 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.712 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-19T09:18:46.712 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:46.713 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.713 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.713 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:46.713 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.713 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.713 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-19T09:18:46.713 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:46.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.713 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.713 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-19T09:18:46.714 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:46.714 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.714 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.714 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/3672199638", 2024-09-19T09:18:46.714 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/3672199638", 2024-09-19T09:18:46.714 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/3672199638", 2024-09-19T09:18:46.714 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/3672199638", 2024-09-19T09:18:46.714 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:46.714 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:46.714 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:46.714 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.715 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.715 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:18:46.715 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:46.715 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:46.715 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:46.715 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:46.715 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:46.715 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:46.715 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:46.715 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:46.715 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:46.715 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:46.716 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:46.716 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:46.716 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.716 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.716 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.716 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T09:18:46.716 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:46.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.716 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.716 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.716 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T09:18:46.716 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:46.717 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.717 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.717 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:46.717 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.717 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.717 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-19T09:18:46.717 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:46.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.718 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.718 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-19T09:18:46.718 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:46.718 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.718 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.718 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:46.718 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.718 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.718 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-19T09:18:46.719 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:46.719 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.719 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.719 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.719 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-19T09:18:46.719 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:46.719 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.719 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.719 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.719 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:46.719 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.719 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.719 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.719 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-19T09:18:46.720 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:46.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.720 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.720 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.720 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-19T09:18:46.720 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:46.720 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.720 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.720 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3463367841", 2024-09-19T09:18:46.720 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3463367841", 2024-09-19T09:18:46.720 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3463367841", 2024-09-19T09:18:46.720 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3463367841", 2024-09-19T09:18:46.721 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:46.721 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:46.721 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:46.721 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.721 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:18:46.721 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:46.721 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:46.721 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:46.721 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:46.721 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:46.721 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:46.721 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:46.722 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:46.722 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:46.722 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:46.722 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:46.722 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:46.722 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.722 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.722 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-19T09:18:46.722 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:46.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.722 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.722 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-19T09:18:46.723 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:46.723 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.723 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.723 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:46.723 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.723 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.723 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-19T09:18:46.724 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:46.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.724 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.724 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-19T09:18:46.724 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:46.724 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.724 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.724 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:46.725 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.725 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.725 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.725 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-19T09:18:46.725 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:46.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.725 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.725 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.725 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-19T09:18:46.725 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:46.725 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.725 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.725 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:46.726 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.726 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.726 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.726 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-19T09:18:46.726 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:46.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.726 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.726 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.726 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-19T09:18:46.726 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:46.726 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.726 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.726 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/4163178582", 2024-09-19T09:18:46.727 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/4163178582", 2024-09-19T09:18:46.727 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/4163178582", 2024-09-19T09:18:46.727 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/4163178582", 2024-09-19T09:18:46.727 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:46.727 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:46.727 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:46.727 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.727 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.727 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:18:46.727 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:46.727 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:46.727 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:46.727 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:46.728 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:46.728 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:46.728 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:46.728 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:46.728 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:46.728 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:46.728 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:46.728 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:46.728 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.728 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.728 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.728 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6822", 2024-09-19T09:18:46.729 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:46.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.729 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.729 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.729 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6824", 2024-09-19T09:18:46.729 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:46.729 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.729 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.729 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:46.729 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.729 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.729 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.729 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6826", 2024-09-19T09:18:46.730 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:46.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.730 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.730 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.730 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6827", 2024-09-19T09:18:46.730 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:46.730 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.730 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.730 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:46.730 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.730 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.730 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.730 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6830", 2024-09-19T09:18:46.731 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:46.731 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.731 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.731 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.731 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6831", 2024-09-19T09:18:46.732 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:46.732 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.732 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.732 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.732 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:46.732 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.732 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.732 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.732 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6828", 2024-09-19T09:18:46.732 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:46.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.733 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.733 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6829", 2024-09-19T09:18:46.733 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:46.733 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.733 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.734 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6824/3538482215", 2024-09-19T09:18:46.734 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6827/3538482215", 2024-09-19T09:18:46.734 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6831/3538482215", 2024-09-19T09:18:46.734 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6829/3538482215", 2024-09-19T09:18:46.734 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:46.734 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:46.734 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:46.734 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.735 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:18:46.735 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:46.735 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:46.735 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:46.735 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:46.735 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:46.736 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:46.736 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:46.736 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:46.736 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:46.736 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:46.736 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:46.736 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:46.736 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.736 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.737 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.737 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6800", 2024-09-19T09:18:46.737 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:46.737 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.737 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.737 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.737 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6801", 2024-09-19T09:18:46.737 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:46.737 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.738 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.738 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.738 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:46.738 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.738 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.738 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.738 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6802", 2024-09-19T09:18:46.738 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:46.738 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.738 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.738 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.739 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6803", 2024-09-19T09:18:46.739 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:46.739 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.739 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.739 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:46.739 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.740 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.740 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.740 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6806", 2024-09-19T09:18:46.740 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:46.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.740 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.740 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.740 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6807", 2024-09-19T09:18:46.740 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:46.741 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.741 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.741 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:46.741 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.741 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.741 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.742 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6804", 2024-09-19T09:18:46.742 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:46.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.742 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.742 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.742 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6805", 2024-09-19T09:18:46.742 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:46.743 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.743 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.743 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.743 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6801/2408698413", 2024-09-19T09:18:46.743 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6803/2408698413", 2024-09-19T09:18:46.743 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6807/2408698413", 2024-09-19T09:18:46.744 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6805/2408698413", 2024-09-19T09:18:46.744 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:46.744 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:46.744 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:46.744 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.744 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.744 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:18:46.744 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:46.744 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:46.744 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:46.744 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:46.745 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:46.745 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:46.745 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:46.745 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:46.745 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:46.745 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:46.745 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:46.745 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:46.745 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.745 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.745 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.745 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6808", 2024-09-19T09:18:46.746 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:46.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.746 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.746 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.746 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6809", 2024-09-19T09:18:46.746 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:46.746 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.746 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.746 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:46.746 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.746 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.746 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.746 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6810", 2024-09-19T09:18:46.746 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:46.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.747 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.747 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6811", 2024-09-19T09:18:46.747 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:46.747 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.747 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.747 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:46.747 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.747 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.747 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6814", 2024-09-19T09:18:46.748 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:46.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.748 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.748 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.748 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6815", 2024-09-19T09:18:46.748 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:46.748 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.748 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.748 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:46.748 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.748 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.748 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.748 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6812", 2024-09-19T09:18:46.749 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:46.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.749 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.749 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.749 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6813", 2024-09-19T09:18:46.749 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:46.749 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.749 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.749 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6809/2596207948", 2024-09-19T09:18:46.749 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6811/2596207948", 2024-09-19T09:18:46.749 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6815/2596207948", 2024-09-19T09:18:46.749 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6813/2596207948", 2024-09-19T09:18:46.750 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:46.750 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:46.750 INFO:teuthology.orchestra.run.smithi018.stdout: "full", 2024-09-19T09:18:46.750 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:46.750 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.750 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.750 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:18:46.750 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:46.750 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:46.750 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:46.750 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:46.750 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:46.750 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:46.750 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:46.751 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:46.751 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:46.751 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:46.751 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:46.751 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:46.751 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.751 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.751 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.751 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6816", 2024-09-19T09:18:46.751 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:46.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.751 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.751 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.751 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6817", 2024-09-19T09:18:46.751 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:46.752 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.752 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.752 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:46.752 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.752 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.752 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.752 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6818", 2024-09-19T09:18:46.752 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:46.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.752 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.752 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.753 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6819", 2024-09-19T09:18:46.753 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:46.753 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.753 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.753 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:46.753 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.753 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.753 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.753 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6823", 2024-09-19T09:18:46.753 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:46.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.754 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.754 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.754 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6825", 2024-09-19T09:18:46.754 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:46.754 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.754 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.754 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.754 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:46.754 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:46.754 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.754 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:46.754 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6820", 2024-09-19T09:18:46.754 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:46.754 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.755 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.755 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:46.755 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6821", 2024-09-19T09:18:46.755 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:46.755 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.755 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.755 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6817/1334618296", 2024-09-19T09:18:46.755 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6819/1334618296", 2024-09-19T09:18:46.755 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6825/1334618296", 2024-09-19T09:18:46.755 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6821/1334618296", 2024-09-19T09:18:46.755 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:46.755 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:46.756 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:46.756 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:46.756 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.756 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:18:46.756 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-19T09:18:46.756 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.756 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:18:46.756 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:46.756 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:46.756 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:46.756 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:46.756 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:46.756 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.580838+0000", 2024-09-19T09:18:46.757 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:46.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.757 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:18:46.757 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:46.757 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:46.757 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:46.757 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:46.757 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:46.757 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.599990+0000", 2024-09-19T09:18:46.757 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:46.757 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.757 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.758 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:18:46.758 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:46.758 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:46.758 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:46.758 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:46.758 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:46.758 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.503722+0000", 2024-09-19T09:18:46.758 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:46.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.758 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:18:46.758 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:46.759 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:46.759 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:46.759 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:46.759 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:46.759 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.607846+0000", 2024-09-19T09:18:46.759 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:46.759 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.759 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.759 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:18:46.759 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:46.759 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:46.759 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:46.759 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:46.759 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:46.760 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.616858+0000", 2024-09-19T09:18:46.760 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:46.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.760 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.760 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:18:46.760 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:46.760 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:46.760 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:46.760 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:46.760 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:46.760 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.542726+0000", 2024-09-19T09:18:46.761 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:46.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.761 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:18:46.761 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:46.761 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:46.761 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:46.761 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:46.761 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:46.761 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.534178+0000", 2024-09-19T09:18:46.761 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:46.761 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.761 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:46.762 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:18:46.762 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:46.762 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:46.762 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:46.762 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:46.762 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:46.762 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.612105+0000", 2024-09-19T09:18:46.762 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:46.762 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.762 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:18:46.762 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-19T09:18:46.762 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-19T09:18:46.762 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-19T09:18:46.763 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-19T09:18:46.763 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-19T09:18:46.763 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-19T09:18:46.763 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-19T09:18:46.763 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-19T09:18:46.763 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-19T09:18:46.763 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-19T09:18:46.763 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-19T09:18:46.763 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-19T09:18:46.763 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-19T09:18:46.763 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-19T09:18:46.763 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:46.764 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-19T09:18:46.764 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-19T09:18:46.764 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-19T09:18:46.764 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-19T09:18:46.764 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-19T09:18:46.764 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-19T09:18:46.764 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-19T09:18:46.764 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-19T09:18:46.764 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-19T09:18:46.765 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-19T09:18:46.765 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-19T09:18:46.765 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:46.765 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:18:46.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.672+0000 7ff470bc4640 1 -- 172.21.15.18:0/1309869235 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff44c06c2b0 msgr2=0x7ff44c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:46.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.672+0000 7ff470bc4640 1 --2- 172.21.15.18:0/1309869235 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff44c06c2b0 0x7ff44c06e770 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff45c006fd0 tx=0x7ff45c008040 comp rx=0 tx=0).stop 2024-09-19T09:18:46.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.672+0000 7ff470bc4640 1 -- 172.21.15.18:0/1309869235 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff46c0ced00 msgr2=0x7ff46c1e9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:46.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.672+0000 7ff470bc4640 1 --2- 172.21.15.18:0/1309869235 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff46c0ced00 0x7ff46c1e9410 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ff46000c430 tx=0x7ff46000c8f0 comp rx=0 tx=0).stop 2024-09-19T09:18:46.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.672+0000 7ff470bc4640 1 -- 172.21.15.18:0/1309869235 shutdown_connections 2024-09-19T09:18:46.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.672+0000 7ff470bc4640 1 --2- 172.21.15.18:0/1309869235 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff44c06c2b0 0x7ff44c06e770 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:46.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.672+0000 7ff470bc4640 1 --2- 172.21.15.18:0/1309869235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff46c15eea0 0x7ff46c159190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:46.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.672+0000 7ff470bc4640 1 --2- 172.21.15.18:0/1309869235 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff46c0ced00 0x7ff46c1e9410 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:46.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.672+0000 7ff470bc4640 1 --2- 172.21.15.18:0/1309869235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff46c0b67b0 0x7ff46c149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:46.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.672+0000 7ff470bc4640 1 -- 172.21.15.18:0/1309869235 >> 172.21.15.18:0/1309869235 conn(0x7ff46c0731b0 msgr2=0x7ff46c0ce1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:46.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.672+0000 7ff470bc4640 1 -- 172.21.15.18:0/1309869235 shutdown_connections 2024-09-19T09:18:46.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:46.672+0000 7ff470bc4640 1 -- 172.21.15.18:0/1309869235 wait complete. 2024-09-19T09:18:46.769 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-19T09:18:51.770 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-19T09:18:51.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.885+0000 7f35d2f6d640 1 Processor -- start 2024-09-19T09:18:51.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.885+0000 7f35d2f6d640 1 -- start start 2024-09-19T09:18:51.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.886+0000 7f35d2f6d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35cc142150 0x7f35cc160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:51.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.886+0000 7f35d2f6d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f35cc160a80 0x7f35cc0cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.886+0000 7f35d2f6d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35cc142650 con 0x7f35cc13fae0 2024-09-19T09:18:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.886+0000 7f35d2f6d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f35cc0ce780 con 0x7f35cc160a80 2024-09-19T09:18:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.886+0000 7f35d2f6d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f35cc142930 con 0x7f35cc142150 2024-09-19T09:18:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.886+0000 7f35d0d09640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f35cc13fae0 0x7f35cc06f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43894/0 (socket says 172.21.15.18:43894) 2024-09-19T09:18:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.886+0000 7f35d0d09640 1 -- 172.21.15.18:0/846515123 learned_addr learned my addr 172.21.15.18:0/846515123 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.886+0000 7f35cbfff640 1 --2- 172.21.15.18:0/846515123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35cc142150 0x7f35cc160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.886+0000 7f35d150a640 1 --2- 172.21.15.18:0/846515123 >> v2:172.21.15.162:3300/0 conn(0x7f35cc160a80 0x7f35cc0cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.887+0000 7f35cb7fe640 1 -- 172.21.15.18:0/846515123 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1647664007 0 0) 0x7f35cc142650 con 0x7f35cc13fae0 2024-09-19T09:18:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.887+0000 7f35cb7fe640 1 -- 172.21.15.18:0/846515123 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35b8003520 con 0x7f35cc13fae0 2024-09-19T09:18:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.887+0000 7f35cbfff640 1 -- 172.21.15.18:0/846515123 >> v2:172.21.15.162:3300/0 conn(0x7f35cc160a80 msgr2=0x7f35cc0cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.887+0000 7f35cbfff640 1 --2- 172.21.15.18:0/846515123 >> v2:172.21.15.162:3300/0 conn(0x7f35cc160a80 0x7f35cc0cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.887+0000 7f35cbfff640 1 -- 172.21.15.18:0/846515123 >> v1:172.21.15.18:6789/0 conn(0x7f35cc13fae0 legacy=0x7f35cc06f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:51.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.887+0000 7f35cbfff640 1 -- 172.21.15.18:0/846515123 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35cc142c10 con 0x7f35cc142150 2024-09-19T09:18:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.888+0000 7f35cbfff640 1 --2- 172.21.15.18:0/846515123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35cc142150 0x7f35cc160540 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f35bc0097a0 tx=0x7f35bc02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=195e81ecb1ce312f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.888+0000 7f35cb7fe640 1 -- 172.21.15.18:0/846515123 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35bc037070 con 0x7f35cc142150 2024-09-19T09:18:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.888+0000 7f35cb7fe640 1 -- 172.21.15.18:0/846515123 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35bc02ae50 con 0x7f35cc142150 2024-09-19T09:18:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.888+0000 7f35cb7fe640 1 -- 172.21.15.18:0/846515123 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35bc032640 con 0x7f35cc142150 2024-09-19T09:18:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.888+0000 7f35d2f6d640 1 -- 172.21.15.18:0/846515123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35cc142150 msgr2=0x7f35cc160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.888+0000 7f35d2f6d640 1 --2- 172.21.15.18:0/846515123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35cc142150 0x7f35cc160540 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f35bc0097a0 tx=0x7f35bc02a100 comp rx=0 tx=0).stop 2024-09-19T09:18:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.889+0000 7f35d2f6d640 1 -- 172.21.15.18:0/846515123 shutdown_connections 2024-09-19T09:18:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.889+0000 7f35d2f6d640 1 --2- 172.21.15.18:0/846515123 >> v2:172.21.15.162:3300/0 conn(0x7f35cc160a80 0x7f35cc0cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.889+0000 7f35d2f6d640 1 --2- 172.21.15.18:0/846515123 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35cc142150 0x7f35cc160540 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.889+0000 7f35d2f6d640 1 -- 172.21.15.18:0/846515123 >> 172.21.15.18:0/846515123 conn(0x7f35cc06bc10 msgr2=0x7f35cc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.889+0000 7f35d2f6d640 1 -- 172.21.15.18:0/846515123 shutdown_connections 2024-09-19T09:18:51.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.889+0000 7f35d2f6d640 1 -- 172.21.15.18:0/846515123 wait complete. 2024-09-19T09:18:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.890+0000 7f35d2f6d640 1 Processor -- start 2024-09-19T09:18:51.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.890+0000 7f35d2f6d640 1 -- start start 2024-09-19T09:18:51.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.891+0000 7f35d2f6d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35cc13fae0 0x7f35cc1e6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:51.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.891+0000 7f35d2f6d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35cc142150 0x7f35cc143130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:51.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.891+0000 7f35d2f6d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35cc160a80 0x7f35cc1f4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:51.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.891+0000 7f35d2f6d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f35cc0cf2d0 con 0x7f35cc13fae0 2024-09-19T09:18:51.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.891+0000 7f35d2f6d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f35cc0cf150 con 0x7f35cc142150 2024-09-19T09:18:51.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.891+0000 7f35d2f6d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f35cc0cf450 con 0x7f35cc160a80 2024-09-19T09:18:51.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.891+0000 7f35d0d09640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35cc13fae0 0x7f35cc1e6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:51.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.891+0000 7f35d0d09640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35cc13fae0 0x7f35cc1e6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36652/0 (socket says 172.21.15.18:36652) 2024-09-19T09:18:51.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.891+0000 7f35d0d09640 1 -- 172.21.15.18:0/3605428925 learned_addr learned my addr 172.21.15.18:0/3605428925 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:51.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.891+0000 7f35d150a640 1 --2- 172.21.15.18:0/3605428925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35cc160a80 0x7f35cc1f4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:51.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.891+0000 7f35cbfff640 1 --2- 172.21.15.18:0/3605428925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35cc142150 0x7f35cc143130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:51.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.891+0000 7f35d0d09640 1 -- 172.21.15.18:0/3605428925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35cc160a80 msgr2=0x7f35cc1f4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:51.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.891+0000 7f35d0d09640 1 --2- 172.21.15.18:0/3605428925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35cc160a80 0x7f35cc1f4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:51.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.891+0000 7f35d0d09640 1 -- 172.21.15.18:0/3605428925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35cc142150 msgr2=0x7f35cc143130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:51.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.891+0000 7f35d0d09640 1 --2- 172.21.15.18:0/3605428925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35cc142150 0x7f35cc143130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:51.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.891+0000 7f35d0d09640 1 -- 172.21.15.18:0/3605428925 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35cc1e68a0 con 0x7f35cc13fae0 2024-09-19T09:18:51.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.891+0000 7f35d0d09640 1 --2- 172.21.15.18:0/3605428925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35cc13fae0 0x7f35cc1e6360 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f35c400cb40 tx=0x7f35c400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:51.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.891+0000 7f35c97fa640 1 -- 172.21.15.18:0/3605428925 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c4017070 con 0x7f35cc13fae0 2024-09-19T09:18:51.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.892+0000 7f35c97fa640 1 -- 172.21.15.18:0/3605428925 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35c400aca0 con 0x7f35cc13fae0 2024-09-19T09:18:51.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.892+0000 7f35d2f6d640 1 -- 172.21.15.18:0/3605428925 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35cc0b3fa0 con 0x7f35cc13fae0 2024-09-19T09:18:51.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.892+0000 7f35c97fa640 1 -- 172.21.15.18:0/3605428925 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c4012620 con 0x7f35cc13fae0 2024-09-19T09:18:51.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.892+0000 7f35d2f6d640 1 -- 172.21.15.18:0/3605428925 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35cc0b4560 con 0x7f35cc13fae0 2024-09-19T09:18:51.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.893+0000 7f35d2f6d640 1 -- 172.21.15.18:0/3605428925 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35cc160540 con 0x7f35cc13fae0 2024-09-19T09:18:51.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.893+0000 7f35c97fa640 1 -- 172.21.15.18:0/3605428925 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f35c401a070 con 0x7f35cc13fae0 2024-09-19T09:18:51.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.894+0000 7f35c97fa640 1 --2- 172.21.15.18:0/3605428925 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f35ac06c2b0 0x7f35ac06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:51.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.894+0000 7f35c97fa640 1 -- 172.21.15.18:0/3605428925 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7f35c408b2a0 con 0x7f35cc13fae0 2024-09-19T09:18:51.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.894+0000 7f35cbfff640 1 --2- 172.21.15.18:0/3605428925 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f35ac06c2b0 0x7f35ac06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:51.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.894+0000 7f35cbfff640 1 --2- 172.21.15.18:0/3605428925 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f35ac06c2b0 0x7f35ac06e770 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f35bc034000 tx=0x7f35bc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:51.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:51.898+0000 7f35c97fa640 1 -- 172.21.15.18:0/3605428925 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f35c4059a10 con 0x7f35cc13fae0 2024-09-19T09:18:52.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.073+0000 7f35d2f6d640 1 -- 172.21.15.18:0/3605428925 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f35cc0b0ac0 con 0x7f35cc13fae0 2024-09-19T09:18:52.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.074+0000 7f35c97fa640 1 -- 172.21.15.18:0/3605428925 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v111) ==== 81+0+34287 (secure 0 0 0) 0x7f35c4059310 con 0x7f35cc13fae0 2024-09-19T09:18:52.075 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:52.076 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:18:52.076 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 111, 2024-09-19T09:18:52.076 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:18:52.076 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-19T09:13:11.348786+0000", 2024-09-19T09:18:52.076 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-19T09:18:47.746338+0000", 2024-09-19T09:18:52.076 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-19T09:13:16.423937+0000", 2024-09-19T09:18:52.076 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-19T09:13:13.417141+0000", 2024-09-19T09:18:52.076 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-19T09:18:52.076 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-09-19T09:18:52.076 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-19T09:18:52.076 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-19T09:18:52.076 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-19T09:18:52.077 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-19T09:18:52.077 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-19T09:18:52.077 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:18:52.077 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-19T09:18:52.077 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.69999998807907104, 2024-09-19T09:18:52.077 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-19T09:18:52.077 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-19T09:18:52.077 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-19T09:18:52.077 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 13, 2024-09-19T09:18:52.077 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-19T09:18:52.077 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-19T09:18:52.077 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "jewel", 2024-09-19T09:18:52.077 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-19T09:18:52.078 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-19T09:18:52.078 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-19T09:18:52.078 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.078 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-19T09:18:52.078 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-19T09:18:52.078 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:13:17.564717+0000", 2024-09-19T09:18:52.078 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:18:52.078 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:18:52.078 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:18:52.078 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:18:52.078 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:18:52.078 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:18:52.078 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:18:52.078 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:18:52.078 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:18:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:18:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:18:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:18:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:18:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-19T09:18:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-19T09:18:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-19T09:18:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-19T09:18:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-19T09:18:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:18:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:18:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:18:52.079 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:18:52.080 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:18:52.080 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:18:52.080 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:18:52.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.080 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "111", 2024-09-19T09:18:52.080 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:18:52.080 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:18:52.080 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:18:52.080 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:18:52.080 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:18:52.080 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:18:52.080 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:18:52.080 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:18:52.080 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:18:52.081 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:18:52.081 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:18:52.081 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:18:52.081 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:18:52.081 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:18:52.081 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:18:52.081 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:18:52.081 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:18:52.081 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:18:52.081 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:18:52.081 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:18:52.081 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:18:52.081 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:18:52.081 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:18:52.082 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:18:52.082 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:18:52.082 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:18:52.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.082 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:18:52.082 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:18:52.082 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:18:52.082 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:18:52.082 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:18:52.082 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:18:52.082 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:18:52.082 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:18:52.082 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:18:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:18:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:18:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:18:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-19T09:18:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-19T09:18:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:18:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-19T09:18:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:18:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:18:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-19T09:18:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-19T09:18:52.083 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-19T09:18:52.084 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-19T09:18:52.084 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-19T09:18:52.084 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:18:52.084 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:18:52.084 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:18:52.084 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.084 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 12, 2024-09-19T09:18:52.084 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_metadata", 2024-09-19T09:18:52.084 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:18:21.441414+0000", 2024-09-19T09:18:52.084 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:18:52.084 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:18:52.085 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:18:52.085 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:18:52.085 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:18:52.085 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:18:52.085 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:18:52.085 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:18:52.085 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:18:52.085 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:18:52.085 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:18:52.085 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:18:52.085 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:18:52.085 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-19T09:18:52.085 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-19T09:18:52.085 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-19T09:18:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-19T09:18:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-19T09:18:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:18:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:18:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:18:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:18:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:18:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:18:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:18:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "111", 2024-09-19T09:18:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:18:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:18:52.086 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:18:52.087 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:18:52.087 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:18:52.087 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:18:52.087 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:18:52.087 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:18:52.087 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:18:52.087 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:18:52.087 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:18:52.087 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:18:52.087 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:18:52.087 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:18:52.087 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:18:52.087 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:18:52.087 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:18:52.088 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:18:52.088 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:18:52.088 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:18:52.088 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:18:52.088 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:18:52.088 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:18:52.088 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:18:52.088 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:18:52.088 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:18:52.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.088 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:18:52.088 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:18:52.088 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:18:52.088 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:18:52.089 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:18:52.089 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:18:52.089 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:18:52.089 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:18:52.089 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:18:52.089 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:18:52.089 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:18:52.089 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:18:52.089 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4, 2024-09-19T09:18:52.089 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 16, 2024-09-19T09:18:52.089 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_priority": 5 2024-09-19T09:18:52.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.089 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:18:52.089 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:18:52.090 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": "cephfs" 2024-09-19T09:18:52.090 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.090 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:18:52.090 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:18:52.090 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.75, 2024-09-19T09:18:52.090 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.75, 2024-09-19T09:18:52.090 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:18:52.090 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.75, 2024-09-19T09:18:52.090 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.75, 2024-09-19T09:18:52.090 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:18:52.090 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:18:52.090 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:18:52.090 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.091 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 13, 2024-09-19T09:18:52.091 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_data", 2024-09-19T09:18:52.091 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:18:22.767737+0000", 2024-09-19T09:18:52.091 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:18:52.091 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:18:52.091 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:18:52.091 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:18:52.091 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:18:52.091 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:18:52.091 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:18:52.091 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:18:52.091 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:18:52.092 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:18:52.092 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:18:52.092 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:18:52.092 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:18:52.092 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 64, 2024-09-19T09:18:52.092 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 64, 2024-09-19T09:18:52.092 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 64, 2024-09-19T09:18:52.092 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 64, 2024-09-19T09:18:52.092 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 64, 2024-09-19T09:18:52.092 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:18:52.092 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:18:52.092 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:18:52.092 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:18:52.093 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:18:52.093 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:18:52.093 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:18:52.093 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.093 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "111", 2024-09-19T09:18:52.093 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:18:52.093 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:18:52.093 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:18:52.093 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:18:52.094 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:18:52.094 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:18:52.094 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:18:52.094 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:18:52.094 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:18:52.094 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:18:52.094 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:18:52.094 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:18:52.094 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:18:52.094 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:18:52.094 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:18:52.094 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:18:52.094 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:18:52.094 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:18:52.095 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:18:52.095 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:18:52.095 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:18:52.095 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:18:52.095 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:18:52.095 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:18:52.095 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:18:52.095 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:18:52.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.095 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:18:52.095 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:18:52.095 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:18:52.095 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:18:52.095 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:18:52.096 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:18:52.096 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:18:52.096 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:18:52.096 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:18:52.096 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:18:52.096 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:18:52.096 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:18:52.096 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 64, 2024-09-19T09:18:52.096 INFO:teuthology.orchestra.run.smithi018.stdout: "target_size_ratio": 0.89999997615814209 2024-09-19T09:18:52.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.096 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:18:52.096 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:18:52.096 INFO:teuthology.orchestra.run.smithi018.stdout: "data": "cephfs" 2024-09-19T09:18:52.096 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.097 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:18:52.097 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:18:52.097 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.3799999952316284, 2024-09-19T09:18:52.097 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.3799999952316284, 2024-09-19T09:18:52.097 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:18:52.097 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-19T09:18:52.097 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-19T09:18:52.097 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:18:52.097 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:18:52.097 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:18:52.097 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.097 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.097 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:18:52.098 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-19T09:18:52.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.098 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:18:52.098 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:52.098 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:52.098 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:52.098 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:52.098 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:52.098 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:52.098 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:52.098 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:52.098 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:52.098 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:52.098 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:52.099 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:52.099 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.099 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.099 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-19T09:18:52.099 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:52.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.099 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.099 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-19T09:18:52.099 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:52.099 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.099 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.099 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.100 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:52.100 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.100 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.100 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-19T09:18:52.100 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:52.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.100 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.100 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-19T09:18:52.100 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:52.100 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.100 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.101 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:52.101 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.101 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.101 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-19T09:18:52.101 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:52.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.101 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.101 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-19T09:18:52.101 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:52.101 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.101 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.102 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:52.102 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.102 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.102 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-19T09:18:52.102 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:52.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.102 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.102 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-19T09:18:52.102 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:52.102 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.102 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.103 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/128722874", 2024-09-19T09:18:52.103 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/128722874", 2024-09-19T09:18:52.103 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/128722874", 2024-09-19T09:18:52.103 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/128722874", 2024-09-19T09:18:52.103 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:52.103 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:52.103 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:52.103 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.103 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:18:52.103 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:52.103 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:52.103 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:52.104 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:52.104 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:52.104 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:52.104 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:52.104 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:52.104 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:52.104 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:52.104 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:52.104 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:52.104 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.104 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.104 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-19T09:18:52.104 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:52.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.105 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.105 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-19T09:18:52.105 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:52.105 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.105 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.105 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:52.105 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.105 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.105 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-19T09:18:52.105 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:52.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.106 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.106 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-19T09:18:52.106 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:52.106 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.106 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.106 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:52.106 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.106 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.106 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-19T09:18:52.106 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:52.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.107 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.107 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-19T09:18:52.107 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:52.107 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.107 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.107 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:52.107 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.107 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.107 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-19T09:18:52.107 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:52.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.108 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.108 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-19T09:18:52.108 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:52.108 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.108 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.108 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/3672199638", 2024-09-19T09:18:52.108 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/3672199638", 2024-09-19T09:18:52.108 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/3672199638", 2024-09-19T09:18:52.108 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/3672199638", 2024-09-19T09:18:52.108 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:52.108 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:52.109 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:52.109 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.109 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.109 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:18:52.109 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:52.109 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:52.109 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:52.109 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:52.109 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:52.109 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:52.109 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:52.109 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:52.109 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:52.110 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:52.110 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:52.110 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:52.110 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.110 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.110 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T09:18:52.110 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:52.110 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.110 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.110 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T09:18:52.110 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:52.110 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.111 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.111 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:52.111 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.111 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.111 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-19T09:18:52.111 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:52.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.111 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.111 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-19T09:18:52.111 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:52.111 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.112 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.112 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:52.112 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.112 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.112 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-19T09:18:52.112 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:52.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.112 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.112 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-19T09:18:52.112 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:52.113 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.113 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.113 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:52.113 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.113 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.113 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-19T09:18:52.113 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:52.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.113 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.113 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-19T09:18:52.113 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:52.114 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.114 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.114 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3463367841", 2024-09-19T09:18:52.114 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3463367841", 2024-09-19T09:18:52.114 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3463367841", 2024-09-19T09:18:52.114 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3463367841", 2024-09-19T09:18:52.114 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:52.114 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:52.114 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:52.114 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.114 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:18:52.115 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:52.115 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:52.115 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:52.115 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:52.115 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:52.115 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:52.115 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:52.115 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:52.115 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:52.115 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:52.115 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:52.115 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:52.115 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.116 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.116 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-19T09:18:52.116 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:52.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.116 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.116 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-19T09:18:52.116 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:52.116 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.116 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.116 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:52.116 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.117 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.117 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-19T09:18:52.117 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:52.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.117 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.117 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-19T09:18:52.117 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:52.117 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.117 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.118 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:52.118 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.118 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.118 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-19T09:18:52.119 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:52.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.119 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.119 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-19T09:18:52.119 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:52.119 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.119 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.119 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:52.119 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.119 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.119 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-19T09:18:52.120 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:52.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.120 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.120 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-19T09:18:52.120 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:52.120 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.120 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.120 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/4163178582", 2024-09-19T09:18:52.120 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/4163178582", 2024-09-19T09:18:52.121 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/4163178582", 2024-09-19T09:18:52.121 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/4163178582", 2024-09-19T09:18:52.121 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:52.121 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:52.121 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:52.121 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.121 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:18:52.121 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:52.121 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:52.121 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:52.121 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:52.122 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:52.122 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:52.122 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:52.122 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:52.122 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:52.122 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:52.122 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:52.122 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:52.122 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.122 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.122 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6822", 2024-09-19T09:18:52.122 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:52.122 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.123 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.123 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6824", 2024-09-19T09:18:52.123 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:52.123 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.123 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.123 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:52.123 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.123 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.123 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6826", 2024-09-19T09:18:52.123 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:52.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.124 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.124 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6827", 2024-09-19T09:18:52.124 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:52.124 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.124 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.124 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:52.124 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.124 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.124 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6830", 2024-09-19T09:18:52.124 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:52.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.125 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.125 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6831", 2024-09-19T09:18:52.125 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:52.125 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.125 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.125 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:52.125 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.125 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.125 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6828", 2024-09-19T09:18:52.126 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:52.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.126 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.126 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6829", 2024-09-19T09:18:52.126 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:52.126 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.126 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.127 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6824/3538482215", 2024-09-19T09:18:52.127 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6827/3538482215", 2024-09-19T09:18:52.127 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6831/3538482215", 2024-09-19T09:18:52.127 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6829/3538482215", 2024-09-19T09:18:52.127 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:52.127 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:52.127 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:52.127 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.127 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:18:52.127 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:52.127 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:52.127 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:52.128 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:52.128 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:52.128 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:52.128 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:52.128 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:52.128 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:52.128 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:52.128 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:52.128 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:52.128 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.128 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.128 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6800", 2024-09-19T09:18:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6801", 2024-09-19T09:18:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.129 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6802", 2024-09-19T09:18:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6803", 2024-09-19T09:18:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.131 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.131 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6806", 2024-09-19T09:18:52.131 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:52.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.131 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.131 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6807", 2024-09-19T09:18:52.131 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:52.131 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.131 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.131 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:52.131 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.132 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.132 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6804", 2024-09-19T09:18:52.132 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:52.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.132 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.132 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6805", 2024-09-19T09:18:52.132 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:52.132 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.132 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.132 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6801/2408698413", 2024-09-19T09:18:52.132 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6803/2408698413", 2024-09-19T09:18:52.133 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6807/2408698413", 2024-09-19T09:18:52.133 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6805/2408698413", 2024-09-19T09:18:52.133 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:52.133 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:52.133 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:52.133 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.133 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.133 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:18:52.133 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:52.133 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:52.133 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:52.133 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:52.133 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:52.134 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:52.134 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:52.134 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:52.134 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:52.134 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:52.134 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:52.134 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:52.134 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.134 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.134 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6808", 2024-09-19T09:18:52.134 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:52.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.135 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.135 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6809", 2024-09-19T09:18:52.135 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:52.135 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.135 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.135 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:52.135 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.135 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.135 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6810", 2024-09-19T09:18:52.135 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:52.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.136 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.136 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6811", 2024-09-19T09:18:52.136 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:52.136 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.136 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.136 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:52.136 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.136 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.136 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6814", 2024-09-19T09:18:52.136 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:52.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.137 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.137 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6815", 2024-09-19T09:18:52.137 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:52.137 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.137 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.137 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:52.137 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.137 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.137 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6812", 2024-09-19T09:18:52.137 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:52.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.138 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.138 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6813", 2024-09-19T09:18:52.138 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:52.138 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.138 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.138 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.138 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6809/2596207948", 2024-09-19T09:18:52.138 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6811/2596207948", 2024-09-19T09:18:52.138 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6815/2596207948", 2024-09-19T09:18:52.138 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6813/2596207948", 2024-09-19T09:18:52.138 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:52.138 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:52.138 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:52.139 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.139 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:18:52.139 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:52.139 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:52.139 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:52.139 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:52.139 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:52.139 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:52.139 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:52.139 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:52.139 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:52.139 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:52.140 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:52.140 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:52.140 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.140 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.140 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6816", 2024-09-19T09:18:52.140 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:52.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.141 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.141 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6817", 2024-09-19T09:18:52.141 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:52.141 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.141 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.141 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:52.141 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.141 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.141 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6818", 2024-09-19T09:18:52.141 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:52.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.142 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.142 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6819", 2024-09-19T09:18:52.142 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:52.142 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.142 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.142 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:52.142 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.142 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.142 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6823", 2024-09-19T09:18:52.142 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:52.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.143 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.143 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6825", 2024-09-19T09:18:52.143 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:52.143 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.143 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.143 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:52.143 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.143 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.143 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6820", 2024-09-19T09:18:52.143 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:52.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.144 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.144 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.144 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6821", 2024-09-19T09:18:52.144 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:52.144 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.144 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.144 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.144 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6817/1334618296", 2024-09-19T09:18:52.144 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6819/1334618296", 2024-09-19T09:18:52.144 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6825/1334618296", 2024-09-19T09:18:52.144 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6821/1334618296", 2024-09-19T09:18:52.144 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:52.144 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:52.145 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:52.145 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.145 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.145 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:18:52.145 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-19T09:18:52.145 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.145 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:18:52.145 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:52.145 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:52.145 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:52.145 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:52.145 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:52.145 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.580838+0000", 2024-09-19T09:18:52.146 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:52.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.146 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:18:52.146 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:52.146 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:52.146 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:52.146 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:52.146 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:52.146 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.599990+0000", 2024-09-19T09:18:52.146 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:52.146 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.146 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.146 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:18:52.146 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:52.147 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:52.147 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:52.147 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:52.147 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:52.147 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.503722+0000", 2024-09-19T09:18:52.147 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:52.147 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.147 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:18:52.147 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:52.147 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:52.147 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:52.147 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:52.147 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:52.148 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.607846+0000", 2024-09-19T09:18:52.148 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:52.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.148 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.148 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:18:52.148 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:52.148 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:52.148 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:52.148 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:52.148 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:52.148 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.616858+0000", 2024-09-19T09:18:52.148 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:52.148 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.149 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:18:52.149 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:52.149 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:52.149 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:52.149 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:52.149 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:52.149 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.542726+0000", 2024-09-19T09:18:52.149 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:52.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.149 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.149 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:18:52.150 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:52.150 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:52.150 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:52.150 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:52.150 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:52.150 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.534178+0000", 2024-09-19T09:18:52.150 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:52.150 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.150 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.150 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:18:52.150 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:52.150 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:52.150 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:52.151 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:52.151 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:52.151 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.612105+0000", 2024-09-19T09:18:52.151 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:52.151 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.151 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:18:52.151 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-19T09:18:52.151 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-19T09:18:52.151 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-19T09:18:52.151 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-19T09:18:52.151 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-19T09:18:52.151 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-19T09:18:52.151 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-19T09:18:52.151 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-19T09:18:52.151 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-19T09:18:52.152 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-19T09:18:52.152 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-19T09:18:52.152 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-19T09:18:52.152 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-19T09:18:52.152 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-19T09:18:52.152 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.152 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-19T09:18:52.152 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-19T09:18:52.152 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-19T09:18:52.152 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-19T09:18:52.152 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-19T09:18:52.152 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-19T09:18:52.153 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-19T09:18:52.153 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-19T09:18:52.153 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-19T09:18:52.153 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-19T09:18:52.153 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-19T09:18:52.153 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.153 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:18:52.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.077+0000 7f35d2f6d640 1 -- 172.21.15.18:0/3605428925 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f35ac06c2b0 msgr2=0x7f35ac06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:52.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.077+0000 7f35d2f6d640 1 --2- 172.21.15.18:0/3605428925 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f35ac06c2b0 0x7f35ac06e770 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f35bc034000 tx=0x7f35bc02e000 comp rx=0 tx=0).stop 2024-09-19T09:18:52.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.077+0000 7f35d2f6d640 1 -- 172.21.15.18:0/3605428925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35cc13fae0 msgr2=0x7f35cc1e6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:52.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.077+0000 7f35d2f6d640 1 --2- 172.21.15.18:0/3605428925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35cc13fae0 0x7f35cc1e6360 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f35c400cb40 tx=0x7f35c400a060 comp rx=0 tx=0).stop 2024-09-19T09:18:52.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.077+0000 7f35d2f6d640 1 -- 172.21.15.18:0/3605428925 shutdown_connections 2024-09-19T09:18:52.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.077+0000 7f35d2f6d640 1 --2- 172.21.15.18:0/3605428925 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f35ac06c2b0 0x7f35ac06e770 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:52.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.077+0000 7f35d2f6d640 1 --2- 172.21.15.18:0/3605428925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f35cc160a80 0x7f35cc1f4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:52.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.077+0000 7f35d2f6d640 1 --2- 172.21.15.18:0/3605428925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35cc142150 0x7f35cc143130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:52.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.077+0000 7f35d2f6d640 1 --2- 172.21.15.18:0/3605428925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f35cc13fae0 0x7f35cc1e6360 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:52.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.077+0000 7f35d2f6d640 1 -- 172.21.15.18:0/3605428925 >> 172.21.15.18:0/3605428925 conn(0x7f35cc06bc10 msgr2=0x7f35cc06e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:52.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.077+0000 7f35d2f6d640 1 -- 172.21.15.18:0/3605428925 shutdown_connections 2024-09-19T09:18:52.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.077+0000 7f35d2f6d640 1 -- 172.21.15.18:0/3605428925 wait complete. 2024-09-19T09:18:52.156 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-09-19T09:18:52.156 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-19T09:18:52.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.258+0000 7f281cac9640 1 Processor -- start 2024-09-19T09:18:52.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.258+0000 7f281cac9640 1 -- start start 2024-09-19T09:18:52.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.259+0000 7f281cac9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f281815ef50 0x7f28180d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:52.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.259+0000 7f281cac9640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f28180d3240 0x7f28180d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:52.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.259+0000 7f281cac9640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28180b7a90 con 0x7f28180d5780 2024-09-19T09:18:52.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.259+0000 7f281cac9640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f28180d3740 con 0x7f28180d3240 2024-09-19T09:18:52.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.259+0000 7f281cac9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f28180d3a20 con 0x7f281815ef50 2024-09-19T09:18:52.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.259+0000 7f2815d9b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f28180d3240 0x7f28180d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:52.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.259+0000 7f2816d9d640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f28180d5780 0x7f28180cf770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:50774/0 (socket says 172.21.15.18:50774) 2024-09-19T09:18:52.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.259+0000 7f281659c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f281815ef50 0x7f28180d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:52.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.259+0000 7f2816d9d640 1 -- 172.21.15.18:0/3860790047 learned_addr learned my addr 172.21.15.18:0/3860790047 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:52.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.259+0000 7f281559a640 1 -- 172.21.15.18:0/3860790047 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3903275093 0 0) 0x7f28180b7a90 con 0x7f28180d5780 2024-09-19T09:18:52.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.259+0000 7f281559a640 1 -- 172.21.15.18:0/3860790047 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2800003520 con 0x7f28180d5780 2024-09-19T09:18:52.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.259+0000 7f2815d9b640 1 -- 172.21.15.18:0/3860790047 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f281815ef50 msgr2=0x7f28180d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:52.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.259+0000 7f2815d9b640 1 --2- 172.21.15.18:0/3860790047 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f281815ef50 0x7f28180d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:52.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.259+0000 7f2815d9b640 1 -- 172.21.15.18:0/3860790047 >> v1:172.21.15.162:6789/0 conn(0x7f28180d5780 legacy=0x7f28180cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:52.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.259+0000 7f2815d9b640 1 -- 172.21.15.18:0/3860790047 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28180b7d00 con 0x7f28180d3240 2024-09-19T09:18:52.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.259+0000 7f281659c640 1 --2- 172.21.15.18:0/3860790047 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f281815ef50 0x7f28180d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:18:52.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.260+0000 7f2815d9b640 1 --2- 172.21.15.18:0/3860790047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28180d3240 0x7f28180d18e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f280c0097a0 tx=0x7f280c02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f773208b70f83f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:52.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.260+0000 7f281559a640 1 -- 172.21.15.18:0/3860790047 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c037070 con 0x7f28180d3240 2024-09-19T09:18:52.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.260+0000 7f281559a640 1 -- 172.21.15.18:0/3860790047 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f280c02ae50 con 0x7f28180d3240 2024-09-19T09:18:52.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.260+0000 7f281559a640 1 -- 172.21.15.18:0/3860790047 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c032660 con 0x7f28180d3240 2024-09-19T09:18:52.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.261+0000 7f281cac9640 1 -- 172.21.15.18:0/3860790047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28180d3240 msgr2=0x7f28180d18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:52.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.261+0000 7f281cac9640 1 --2- 172.21.15.18:0/3860790047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28180d3240 0x7f28180d18e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f280c0097a0 tx=0x7f280c02a100 comp rx=0 tx=0).stop 2024-09-19T09:18:52.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.261+0000 7f281cac9640 1 -- 172.21.15.18:0/3860790047 shutdown_connections 2024-09-19T09:18:52.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.261+0000 7f281cac9640 1 --2- 172.21.15.18:0/3860790047 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28180d3240 0x7f28180d18e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:52.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.261+0000 7f281cac9640 1 --2- 172.21.15.18:0/3860790047 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f281815ef50 0x7f28180d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:52.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.261+0000 7f281cac9640 1 -- 172.21.15.18:0/3860790047 >> 172.21.15.18:0/3860790047 conn(0x7f28180d4c60 msgr2=0x7f28180d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:52.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.261+0000 7f281cac9640 1 -- 172.21.15.18:0/3860790047 shutdown_connections 2024-09-19T09:18:52.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.261+0000 7f281cac9640 1 -- 172.21.15.18:0/3860790047 wait complete. 2024-09-19T09:18:52.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.262+0000 7f281cac9640 1 Processor -- start 2024-09-19T09:18:52.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.262+0000 7f281cac9640 1 -- start start 2024-09-19T09:18:52.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.263+0000 7f281cac9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28180d3240 0x7f2818159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:52.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.263+0000 7f281cac9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28180d5780 0x7f28180c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:52.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.263+0000 7f281cac9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f281815ef50 0x7f281815b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:52.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.263+0000 7f281cac9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f28180d21a0 con 0x7f28180d5780 2024-09-19T09:18:52.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.263+0000 7f281cac9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f28180d2020 con 0x7f281815ef50 2024-09-19T09:18:52.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.263+0000 7f281cac9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f28180b9510 con 0x7f28180d3240 2024-09-19T09:18:52.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.263+0000 7f2815d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28180d5780 0x7f28180c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:52.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.263+0000 7f2815d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28180d5780 0x7f28180c82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36656/0 (socket says 172.21.15.18:36656) 2024-09-19T09:18:52.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.263+0000 7f2815d9b640 1 -- 172.21.15.18:0/2805582307 learned_addr learned my addr 172.21.15.18:0/2805582307 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:52.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.264+0000 7f281659c640 1 --2- 172.21.15.18:0/2805582307 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28180d3240 0x7f2818159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:52.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.264+0000 7f2816d9d640 1 --2- 172.21.15.18:0/2805582307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f281815ef50 0x7f281815b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:52.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.264+0000 7f2815d9b640 1 -- 172.21.15.18:0/2805582307 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28180d3240 msgr2=0x7f2818159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:52.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.264+0000 7f2815d9b640 1 --2- 172.21.15.18:0/2805582307 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28180d3240 0x7f2818159220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:52.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.264+0000 7f2815d9b640 1 -- 172.21.15.18:0/2805582307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f281815ef50 msgr2=0x7f281815b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:52.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.264+0000 7f2815d9b640 1 --2- 172.21.15.18:0/2805582307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f281815ef50 0x7f281815b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:52.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.264+0000 7f2815d9b640 1 -- 172.21.15.18:0/2805582307 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28180c8db0 con 0x7f28180d5780 2024-09-19T09:18:52.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.264+0000 7f2815d9b640 1 --2- 172.21.15.18:0/2805582307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28180d5780 0x7f28180c82f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f280c035040 tx=0x7f280c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:52.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.264+0000 7f2806ffd640 1 -- 172.21.15.18:0/2805582307 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c041070 con 0x7f28180d5780 2024-09-19T09:18:52.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.264+0000 7f2806ffd640 1 -- 172.21.15.18:0/2805582307 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f280c03c460 con 0x7f28180d5780 2024-09-19T09:18:52.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.264+0000 7f281cac9640 1 -- 172.21.15.18:0/2805582307 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28180c9090 con 0x7f28180d5780 2024-09-19T09:18:52.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.264+0000 7f2806ffd640 1 -- 172.21.15.18:0/2805582307 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c037040 con 0x7f28180d5780 2024-09-19T09:18:52.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.264+0000 7f281cac9640 1 -- 172.21.15.18:0/2805582307 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28180c9650 con 0x7f28180d5780 2024-09-19T09:18:52.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.265+0000 7f281cac9640 1 -- 172.21.15.18:0/2805582307 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28180d13a0 con 0x7f28180d5780 2024-09-19T09:18:52.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.266+0000 7f2806ffd640 1 -- 172.21.15.18:0/2805582307 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f280c03a070 con 0x7f28180d5780 2024-09-19T09:18:52.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.266+0000 7f2806ffd640 1 --2- 172.21.15.18:0/2805582307 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f27f806c2b0 0x7f27f806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:52.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.266+0000 7f2806ffd640 1 -- 172.21.15.18:0/2805582307 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7f280c0ab5d0 con 0x7f28180d5780 2024-09-19T09:18:52.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.266+0000 7f281659c640 1 --2- 172.21.15.18:0/2805582307 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f27f806c2b0 0x7f27f806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:52.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.267+0000 7f281659c640 1 --2- 172.21.15.18:0/2805582307 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f27f806c2b0 0x7f27f806e770 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2808009950 tx=0x7f2808008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:52.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.271+0000 7f2806ffd640 1 -- 172.21.15.18:0/2805582307 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f280c079dd0 con 0x7f28180d5780 2024-09-19T09:18:52.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.448+0000 7f281cac9640 1 -- 172.21.15.18:0/2805582307 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f281809f660 con 0x7f28180d5780 2024-09-19T09:18:52.450 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.449+0000 7f2806ffd640 1 -- 172.21.15.18:0/2805582307 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v111) ==== 81+0+34287 (secure 0 0 0) 0x7f280c0796d0 con 0x7f28180d5780 2024-09-19T09:18:52.450 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:52.450 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:18:52.451 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 111, 2024-09-19T09:18:52.451 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:18:52.451 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-19T09:13:11.348786+0000", 2024-09-19T09:18:52.451 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-19T09:18:47.746338+0000", 2024-09-19T09:18:52.451 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-19T09:13:16.423937+0000", 2024-09-19T09:18:52.451 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-19T09:13:13.417141+0000", 2024-09-19T09:18:52.451 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-19T09:18:52.451 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-09-19T09:18:52.451 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-19T09:18:52.451 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-19T09:18:52.452 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-19T09:18:52.452 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-19T09:18:52.452 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-19T09:18:52.452 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:18:52.452 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-19T09:18:52.452 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.69999998807907104, 2024-09-19T09:18:52.452 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-19T09:18:52.452 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-19T09:18:52.452 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-19T09:18:52.452 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 13, 2024-09-19T09:18:52.452 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-19T09:18:52.453 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-19T09:18:52.453 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "jewel", 2024-09-19T09:18:52.453 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-19T09:18:52.453 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-19T09:18:52.453 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-19T09:18:52.453 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.453 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-19T09:18:52.453 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-19T09:18:52.453 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:13:17.564717+0000", 2024-09-19T09:18:52.453 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:18:52.453 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:18:52.453 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:18:52.454 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:18:52.454 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:18:52.454 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:18:52.454 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:18:52.454 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:18:52.454 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:18:52.454 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:18:52.454 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:18:52.454 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:18:52.454 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:18:52.454 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-19T09:18:52.454 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-19T09:18:52.455 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-19T09:18:52.455 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-19T09:18:52.455 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-19T09:18:52.455 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:18:52.455 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:18:52.455 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:18:52.455 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:18:52.455 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:18:52.455 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:18:52.455 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:18:52.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.455 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "111", 2024-09-19T09:18:52.456 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:18:52.456 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:18:52.456 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:18:52.456 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:18:52.456 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:18:52.456 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:18:52.456 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:18:52.456 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:18:52.456 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:18:52.456 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:18:52.456 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:18:52.456 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:18:52.457 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:18:52.457 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:18:52.457 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:18:52.457 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:18:52.457 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:18:52.457 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:18:52.457 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:18:52.457 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:18:52.457 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:18:52.457 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:18:52.457 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:18:52.457 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:18:52.458 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:18:52.458 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:18:52.458 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.458 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:18:52.458 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:18:52.458 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:18:52.458 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:18:52.458 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:18:52.458 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:18:52.459 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:18:52.459 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:18:52.459 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:18:52.459 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:18:52.459 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:18:52.459 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:18:52.459 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-19T09:18:52.459 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-19T09:18:52.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.459 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:18:52.459 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-19T09:18:52.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.460 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:18:52.460 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:18:52.460 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-19T09:18:52.460 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-19T09:18:52.460 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-19T09:18:52.460 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-19T09:18:52.460 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-19T09:18:52.460 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:18:52.460 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:18:52.460 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:18:52.460 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.461 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.461 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 12, 2024-09-19T09:18:52.461 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_metadata", 2024-09-19T09:18:52.461 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:18:21.441414+0000", 2024-09-19T09:18:52.461 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:18:52.461 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:18:52.461 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:18:52.461 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:18:52.461 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:18:52.462 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:18:52.462 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:18:52.462 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:18:52.462 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:18:52.462 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:18:52.462 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:18:52.462 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:18:52.462 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:18:52.462 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-19T09:18:52.462 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-19T09:18:52.462 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-19T09:18:52.463 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-19T09:18:52.463 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-19T09:18:52.463 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:18:52.463 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:18:52.463 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:18:52.463 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:18:52.463 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:18:52.463 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:18:52.463 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:18:52.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.463 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "111", 2024-09-19T09:18:52.464 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:18:52.464 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:18:52.464 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:18:52.464 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:18:52.464 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:18:52.464 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:18:52.464 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:18:52.464 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:18:52.464 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:18:52.464 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:18:52.465 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:18:52.465 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:18:52.465 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:18:52.465 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:18:52.465 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:18:52.465 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:18:52.465 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:18:52.465 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:18:52.465 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:18:52.465 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:18:52.466 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:18:52.466 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:18:52.466 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:18:52.466 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:18:52.466 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:18:52.466 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:18:52.466 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.467 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:18:52.467 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:18:52.467 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:18:52.467 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:18:52.467 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:18:52.467 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:18:52.467 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:18:52.467 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:18:52.467 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:18:52.467 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:18:52.467 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:18:52.467 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:18:52.468 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4, 2024-09-19T09:18:52.468 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 16, 2024-09-19T09:18:52.468 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_priority": 5 2024-09-19T09:18:52.468 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.468 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:18:52.468 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:18:52.468 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": "cephfs" 2024-09-19T09:18:52.469 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.469 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.469 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:18:52.469 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:18:52.469 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.75, 2024-09-19T09:18:52.469 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.75, 2024-09-19T09:18:52.469 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:18:52.469 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.75, 2024-09-19T09:18:52.469 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.75, 2024-09-19T09:18:52.469 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:18:52.469 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:18:52.470 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:18:52.470 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.470 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.470 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 13, 2024-09-19T09:18:52.470 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_data", 2024-09-19T09:18:52.470 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:18:22.767737+0000", 2024-09-19T09:18:52.470 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:18:52.471 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:18:52.471 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:18:52.471 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:18:52.471 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:18:52.471 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:18:52.471 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:18:52.471 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:18:52.471 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:18:52.471 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:18:52.471 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:18:52.471 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:18:52.472 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:18:52.472 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 64, 2024-09-19T09:18:52.472 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 64, 2024-09-19T09:18:52.472 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 64, 2024-09-19T09:18:52.472 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 64, 2024-09-19T09:18:52.472 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 64, 2024-09-19T09:18:52.472 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:18:52.472 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:18:52.473 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:18:52.473 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:18:52.473 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:18:52.473 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:18:52.473 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:18:52.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.473 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "111", 2024-09-19T09:18:52.473 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:18:52.473 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:18:52.474 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:18:52.474 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:18:52.474 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:18:52.474 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:18:52.474 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:18:52.474 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:18:52.474 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:18:52.474 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:18:52.475 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:18:52.475 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:18:52.475 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:18:52.475 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:18:52.475 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:18:52.475 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:18:52.475 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:18:52.475 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:18:52.476 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:18:52.476 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:18:52.476 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:18:52.476 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:18:52.476 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:18:52.476 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:18:52.476 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:18:52.477 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:18:52.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.477 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:18:52.477 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:18:52.477 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:18:52.477 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:18:52.477 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:18:52.478 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:18:52.478 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:18:52.478 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:18:52.478 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:18:52.478 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:18:52.478 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:18:52.478 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:18:52.478 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 64, 2024-09-19T09:18:52.478 INFO:teuthology.orchestra.run.smithi018.stdout: "target_size_ratio": 0.89999997615814209 2024-09-19T09:18:52.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.479 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:18:52.479 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:18:52.479 INFO:teuthology.orchestra.run.smithi018.stdout: "data": "cephfs" 2024-09-19T09:18:52.479 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.479 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:18:52.479 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:18:52.479 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.3799999952316284, 2024-09-19T09:18:52.479 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.3799999952316284, 2024-09-19T09:18:52.480 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:18:52.480 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-19T09:18:52.480 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-19T09:18:52.480 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:18:52.480 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:18:52.480 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:18:52.480 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.480 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.480 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:18:52.480 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-19T09:18:52.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.480 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:18:52.481 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:52.481 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:52.481 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:52.481 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:52.481 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:52.481 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:52.481 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:52.481 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:52.481 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:52.481 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:52.481 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:52.481 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:52.482 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.482 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.482 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-19T09:18:52.482 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:52.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.482 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.482 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-19T09:18:52.482 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:52.483 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.483 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.483 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:52.483 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.483 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.483 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-19T09:18:52.483 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:52.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.483 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.484 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-19T09:18:52.484 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:52.484 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.484 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.484 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:52.484 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.484 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.484 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.484 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-19T09:18:52.484 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:52.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.485 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.485 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-19T09:18:52.485 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:52.485 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.485 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.485 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:52.485 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.486 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.486 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-19T09:18:52.486 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:52.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.486 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.486 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.486 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-19T09:18:52.486 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:18:52.486 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.486 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.487 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/128722874", 2024-09-19T09:18:52.487 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/128722874", 2024-09-19T09:18:52.487 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/128722874", 2024-09-19T09:18:52.487 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/128722874", 2024-09-19T09:18:52.487 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:52.487 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:52.487 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:52.487 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.487 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:18:52.487 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:52.488 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:52.488 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:52.488 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:52.488 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:52.488 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:52.488 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:52.488 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:52.488 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:52.489 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:52.489 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:52.489 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:52.489 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.489 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.489 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-19T09:18:52.489 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:52.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.490 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.490 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-19T09:18:52.490 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:52.490 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.490 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.490 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:52.490 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.490 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.490 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.490 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-19T09:18:52.491 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:52.491 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.491 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.491 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.491 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-19T09:18:52.491 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:52.491 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.491 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.491 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.491 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:52.491 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.491 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.492 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.492 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-19T09:18:52.492 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:52.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.492 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.492 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.493 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-19T09:18:52.493 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:52.493 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.493 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.494 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:52.494 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.494 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.494 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-19T09:18:52.494 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:52.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.494 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.494 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-19T09:18:52.495 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:18:52.495 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.495 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.495 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/3672199638", 2024-09-19T09:18:52.495 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/3672199638", 2024-09-19T09:18:52.495 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/3672199638", 2024-09-19T09:18:52.495 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/3672199638", 2024-09-19T09:18:52.495 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:52.496 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:52.496 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:52.496 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.496 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.496 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:18:52.496 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:52.496 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:52.496 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:52.496 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:52.497 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:52.497 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:52.497 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:52.497 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:52.497 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:52.497 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:52.497 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:52.497 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:52.497 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.497 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.497 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.498 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T09:18:52.498 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:52.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.498 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.498 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T09:18:52.498 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:52.498 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.499 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.499 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:52.499 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.499 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.499 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.499 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-19T09:18:52.499 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:52.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.500 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.500 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.500 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-19T09:18:52.500 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:52.500 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.500 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.500 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:52.501 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.501 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.501 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-19T09:18:52.501 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:52.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.501 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.501 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-19T09:18:52.502 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:52.502 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.502 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.502 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:52.502 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.502 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.502 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.502 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-19T09:18:52.502 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:52.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.503 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.503 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.503 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-19T09:18:52.503 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:18:52.503 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.503 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.503 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.504 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3463367841", 2024-09-19T09:18:52.504 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3463367841", 2024-09-19T09:18:52.504 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3463367841", 2024-09-19T09:18:52.504 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3463367841", 2024-09-19T09:18:52.504 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:52.504 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:52.504 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:52.504 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.505 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.505 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:18:52.505 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:52.505 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:52.505 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:52.505 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:52.505 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:52.506 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:52.506 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:52.506 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:52.506 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:52.506 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:52.506 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:52.506 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:52.507 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.507 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.507 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-19T09:18:52.507 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:52.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.507 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.508 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-19T09:18:52.508 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:52.508 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.508 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.508 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:52.508 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.508 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.508 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.509 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-19T09:18:52.509 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:52.509 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.509 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.509 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.509 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-19T09:18:52.509 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:52.510 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.510 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.510 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:52.510 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.510 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.510 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-19T09:18:52.510 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:52.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.511 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.511 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-19T09:18:52.511 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:52.511 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.511 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.511 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:52.511 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.511 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.511 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-19T09:18:52.511 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:52.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.512 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.512 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-19T09:18:52.512 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:18:52.512 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.512 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.513 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/4163178582", 2024-09-19T09:18:52.513 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/4163178582", 2024-09-19T09:18:52.513 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/4163178582", 2024-09-19T09:18:52.513 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/4163178582", 2024-09-19T09:18:52.513 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:52.513 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:52.513 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:52.514 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.514 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.514 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:18:52.514 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:52.514 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:52.514 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:52.514 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:52.514 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:52.514 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:52.514 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:52.514 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:52.515 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:52.515 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:52.515 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:52.515 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:52.515 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.515 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.515 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6822", 2024-09-19T09:18:52.515 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:52.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.515 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.516 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6824", 2024-09-19T09:18:52.516 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:52.516 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.516 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.516 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:52.516 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.516 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.516 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.516 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6826", 2024-09-19T09:18:52.517 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:52.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.517 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.517 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6827", 2024-09-19T09:18:52.517 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:52.517 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.517 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.517 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:52.517 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.518 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.518 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6830", 2024-09-19T09:18:52.518 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:52.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.518 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.518 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6831", 2024-09-19T09:18:52.518 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:52.518 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.518 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.518 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:52.519 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.519 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.519 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6828", 2024-09-19T09:18:52.519 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:52.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.519 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.519 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6829", 2024-09-19T09:18:52.519 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:18:52.519 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.519 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.520 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6824/3538482215", 2024-09-19T09:18:52.520 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6827/3538482215", 2024-09-19T09:18:52.520 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6831/3538482215", 2024-09-19T09:18:52.520 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6829/3538482215", 2024-09-19T09:18:52.520 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:52.520 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:52.520 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:52.520 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.520 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.520 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.521 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:18:52.521 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:52.521 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:52.521 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:52.521 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:52.521 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:52.521 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:52.521 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:52.521 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:52.521 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:52.521 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:52.521 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:52.522 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:52.522 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.522 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.522 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.522 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6800", 2024-09-19T09:18:52.522 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:52.522 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.522 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.522 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.522 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6801", 2024-09-19T09:18:52.522 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:52.523 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.523 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.523 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:52.523 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.523 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.523 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.523 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6802", 2024-09-19T09:18:52.523 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:52.523 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.524 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.524 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6803", 2024-09-19T09:18:52.524 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:52.524 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.524 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.524 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.524 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:52.524 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.524 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.525 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.525 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6806", 2024-09-19T09:18:52.525 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:52.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.525 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.525 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.525 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6807", 2024-09-19T09:18:52.525 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:52.525 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.525 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.525 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.525 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:52.526 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.526 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.526 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6804", 2024-09-19T09:18:52.526 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:52.526 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.526 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.526 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.526 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6805", 2024-09-19T09:18:52.526 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:18:52.526 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.526 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.527 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.527 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6801/2408698413", 2024-09-19T09:18:52.527 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6803/2408698413", 2024-09-19T09:18:52.527 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6807/2408698413", 2024-09-19T09:18:52.527 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6805/2408698413", 2024-09-19T09:18:52.527 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:52.527 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:52.528 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:52.528 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.528 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.528 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.528 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:18:52.528 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:52.528 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:52.528 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:52.528 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:52.528 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:52.528 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:52.529 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:52.529 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:52.529 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:52.529 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:52.529 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:52.529 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:52.529 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.529 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.529 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.529 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6808", 2024-09-19T09:18:52.529 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:52.529 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.530 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.530 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6809", 2024-09-19T09:18:52.530 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:52.530 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.530 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.530 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.530 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:52.530 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.530 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.530 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.531 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6810", 2024-09-19T09:18:52.531 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:52.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.531 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.531 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.531 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6811", 2024-09-19T09:18:52.531 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:52.531 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.531 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.531 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.531 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:52.532 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.532 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.532 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6814", 2024-09-19T09:18:52.532 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:52.532 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.532 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.532 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.532 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6815", 2024-09-19T09:18:52.532 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:52.532 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.532 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.533 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.533 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:52.533 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.533 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.533 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.533 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6812", 2024-09-19T09:18:52.533 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:52.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.534 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.534 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.534 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6813", 2024-09-19T09:18:52.534 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:18:52.534 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.534 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.534 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.534 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6809/2596207948", 2024-09-19T09:18:52.534 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6811/2596207948", 2024-09-19T09:18:52.534 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6815/2596207948", 2024-09-19T09:18:52.535 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6813/2596207948", 2024-09-19T09:18:52.535 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:52.535 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:52.535 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:52.535 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.535 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.535 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.535 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:18:52.535 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:18:52.536 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:18:52.536 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:18:52.536 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:18:52.536 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:18:52.536 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:18:52.536 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:18:52.536 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:18:52.536 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 102, 2024-09-19T09:18:52.536 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:18:52.536 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:18:52.537 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:18:52.537 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.537 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.537 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6816", 2024-09-19T09:18:52.537 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:52.537 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.537 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.537 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.537 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6817", 2024-09-19T09:18:52.538 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:52.538 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.538 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.538 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.538 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:18:52.538 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.538 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.538 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.538 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6818", 2024-09-19T09:18:52.539 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:52.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.539 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.539 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.539 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6819", 2024-09-19T09:18:52.539 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:52.539 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.539 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.539 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.540 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:18:52.540 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.540 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.540 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6823", 2024-09-19T09:18:52.540 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:52.540 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.540 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.540 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6825", 2024-09-19T09:18:52.541 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:52.541 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.541 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.541 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:18:52.541 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:18:52.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.542 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:18:52.542 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6820", 2024-09-19T09:18:52.542 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:52.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.542 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:18:52.543 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6821", 2024-09-19T09:18:52.543 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:18:52.543 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.543 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.543 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6817/1334618296", 2024-09-19T09:18:52.544 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6819/1334618296", 2024-09-19T09:18:52.544 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6825/1334618296", 2024-09-19T09:18:52.544 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6821/1334618296", 2024-09-19T09:18:52.544 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:18:52.544 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:18:52.544 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:18:52.544 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:18:52.544 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.545 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:18:52.545 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-19T09:18:52.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.545 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:18:52.545 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:52.545 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:52.545 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:52.545 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:52.546 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:52.546 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.580838+0000", 2024-09-19T09:18:52.546 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:52.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.546 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:18:52.546 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:52.546 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:52.546 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:52.547 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:52.547 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:52.547 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.599990+0000", 2024-09-19T09:18:52.547 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:52.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.548 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:18:52.548 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:52.548 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:52.548 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:52.548 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:52.548 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:52.548 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.503722+0000", 2024-09-19T09:18:52.548 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:52.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.548 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:18:52.549 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:52.549 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:52.549 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:52.549 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:52.549 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:52.549 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.607846+0000", 2024-09-19T09:18:52.549 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:52.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.550 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:18:52.550 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:52.550 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:52.550 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:52.550 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:52.550 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:52.550 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.616858+0000", 2024-09-19T09:18:52.550 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:52.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.551 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:18:52.551 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:52.551 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:52.551 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:52.551 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:52.551 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:52.551 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.542726+0000", 2024-09-19T09:18:52.551 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:52.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.552 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:18:52.552 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:52.552 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:52.552 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:52.552 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:52.552 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:52.552 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.534178+0000", 2024-09-19T09:18:52.552 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:52.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:18:52.553 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:18:52.553 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:18:52.553 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:18:52.553 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:18:52.553 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:18:52.553 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:18:52.553 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.612105+0000", 2024-09-19T09:18:52.554 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:18:52.554 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.554 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:18:52.554 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-19T09:18:52.554 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-19T09:18:52.554 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-19T09:18:52.554 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-19T09:18:52.554 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-19T09:18:52.554 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-19T09:18:52.554 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-19T09:18:52.555 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-19T09:18:52.555 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-19T09:18:52.555 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-19T09:18:52.555 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-19T09:18:52.555 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-19T09:18:52.555 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-19T09:18:52.555 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-19T09:18:52.555 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.556 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:18:52.556 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-19T09:18:52.556 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-19T09:18:52.556 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-19T09:18:52.556 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-19T09:18:52.556 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-19T09:18:52.556 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-19T09:18:52.556 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-19T09:18:52.556 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-19T09:18:52.557 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-19T09:18:52.557 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-19T09:18:52.557 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-19T09:18:52.557 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:18:52.557 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:18:52.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.451+0000 7f281cac9640 1 -- 172.21.15.18:0/2805582307 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f27f806c2b0 msgr2=0x7f27f806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:52.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.451+0000 7f281cac9640 1 --2- 172.21.15.18:0/2805582307 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f27f806c2b0 0x7f27f806e770 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2808009950 tx=0x7f2808008040 comp rx=0 tx=0).stop 2024-09-19T09:18:52.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.451+0000 7f281cac9640 1 -- 172.21.15.18:0/2805582307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28180d5780 msgr2=0x7f28180c82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:52.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.451+0000 7f281cac9640 1 --2- 172.21.15.18:0/2805582307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28180d5780 0x7f28180c82f0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f280c035040 tx=0x7f280c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:18:52.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.451+0000 7f281cac9640 1 -- 172.21.15.18:0/2805582307 shutdown_connections 2024-09-19T09:18:52.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.451+0000 7f281cac9640 1 --2- 172.21.15.18:0/2805582307 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f27f806c2b0 0x7f27f806e770 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:52.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.451+0000 7f281cac9640 1 --2- 172.21.15.18:0/2805582307 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f281815ef50 0x7f281815b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:52.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.451+0000 7f281cac9640 1 --2- 172.21.15.18:0/2805582307 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28180d5780 0x7f28180c82f0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:52.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.451+0000 7f281cac9640 1 --2- 172.21.15.18:0/2805582307 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28180d3240 0x7f2818159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:52.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.451+0000 7f281cac9640 1 -- 172.21.15.18:0/2805582307 >> 172.21.15.18:0/2805582307 conn(0x7f28180d4c60 msgr2=0x7f281806c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:52.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.451+0000 7f281cac9640 1 -- 172.21.15.18:0/2805582307 shutdown_connections 2024-09-19T09:18:52.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.451+0000 7f281cac9640 1 -- 172.21.15.18:0/2805582307 wait complete. 2024-09-19T09:18:52.560 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:18:52.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.662+0000 7f7c968a4640 1 Processor -- start 2024-09-19T09:18:52.663 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.662+0000 7f7c968a4640 1 -- start start 2024-09-19T09:18:52.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.663+0000 7f7c968a4640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7c900cf560 0x7f7c900cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:52.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.663+0000 7f7c968a4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c900cfe80 0x7f7c900b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:52.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.663+0000 7f7c968a4640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c900d0e10 con 0x7f7c900b3210 2024-09-19T09:18:52.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.663+0000 7f7c968a4640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f7c900d0310 con 0x7f7c900cf560 2024-09-19T09:18:52.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.663+0000 7f7c968a4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7c900d0850 con 0x7f7c900cfe80 2024-09-19T09:18:52.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.663+0000 7f7c8f7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c900cfe80 0x7f7c900b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:52.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.663+0000 7f7c8ffff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7c900cf560 0x7f7c900cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:52.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.663+0000 7f7c94e41640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f7c900b3210 0x7f7c900b3640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:50788/0 (socket says 172.21.15.18:50788) 2024-09-19T09:18:52.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.663+0000 7f7c94e41640 1 -- 172.21.15.18:0/3858166705 learned_addr learned my addr 172.21.15.18:0/3858166705 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:52.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.663+0000 7f7c8f7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c900cfe80 0x7f7c900b2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:45410/0 (socket says 172.21.15.18:45410) 2024-09-19T09:18:52.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.663+0000 7f7c8ffff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7c900cf560 0x7f7c900cf940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:41924/0 (socket says 172.21.15.18:41924) 2024-09-19T09:18:52.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.664+0000 7f7c8ffff640 1 -- 172.21.15.18:0/3858166705 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c900cfe80 msgr2=0x7f7c900b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:52.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.664+0000 7f7c8ffff640 1 --2- 172.21.15.18:0/3858166705 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c900cfe80 0x7f7c900b2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:52.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.664+0000 7f7c8ffff640 1 -- 172.21.15.18:0/3858166705 >> v1:172.21.15.162:6789/0 conn(0x7f7c900b3210 legacy=0x7f7c900b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:52.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.664+0000 7f7c8ffff640 1 -- 172.21.15.18:0/3858166705 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c900d0b30 con 0x7f7c900cf560 2024-09-19T09:18:52.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.664+0000 7f7c8ffff640 1 --2- 172.21.15.18:0/3858166705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c900cf560 0x7f7c900cf940 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7c800097a0 tx=0x7f7c8002a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=353ab335ecad2982 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:52.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.665+0000 7f7c8effd640 1 -- 172.21.15.18:0/3858166705 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c80037070 con 0x7f7c900cf560 2024-09-19T09:18:52.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.665+0000 7f7c8effd640 1 -- 172.21.15.18:0/3858166705 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c8002adb0 con 0x7f7c900cf560 2024-09-19T09:18:52.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.665+0000 7f7c8effd640 1 -- 172.21.15.18:0/3858166705 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c80032660 con 0x7f7c900cf560 2024-09-19T09:18:52.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.665+0000 7f7c968a4640 1 -- 172.21.15.18:0/3858166705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c900cf560 msgr2=0x7f7c900cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:52.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.665+0000 7f7c968a4640 1 --2- 172.21.15.18:0/3858166705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c900cf560 0x7f7c900cf940 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7c800097a0 tx=0x7f7c8002a060 comp rx=0 tx=0).stop 2024-09-19T09:18:52.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.665+0000 7f7c968a4640 1 -- 172.21.15.18:0/3858166705 shutdown_connections 2024-09-19T09:18:52.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.665+0000 7f7c968a4640 1 --2- 172.21.15.18:0/3858166705 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c900cfe80 0x7f7c900b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:52.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.665+0000 7f7c968a4640 1 --2- 172.21.15.18:0/3858166705 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c900cf560 0x7f7c900cf940 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:52.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.665+0000 7f7c968a4640 1 -- 172.21.15.18:0/3858166705 >> 172.21.15.18:0/3858166705 conn(0x7f7c900b4700 msgr2=0x7f7c900b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:52.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.665+0000 7f7c968a4640 1 -- 172.21.15.18:0/3858166705 shutdown_connections 2024-09-19T09:18:52.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.665+0000 7f7c968a4640 1 -- 172.21.15.18:0/3858166705 wait complete. 2024-09-19T09:18:52.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.666+0000 7f7c968a4640 1 Processor -- start 2024-09-19T09:18:52.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.667+0000 7f7c968a4640 1 -- start start 2024-09-19T09:18:52.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.667+0000 7f7c968a4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c900b3210 0x7f7c900c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:52.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.667+0000 7f7c968a4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c900cf560 0x7f7c9015e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:52.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.667+0000 7f7c968a4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c900cfe80 0x7f7c90151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:52.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.667+0000 7f7c968a4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7c900b5420 con 0x7f7c900b3210 2024-09-19T09:18:52.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.667+0000 7f7c968a4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7c900b27b0 con 0x7f7c900cf560 2024-09-19T09:18:52.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.667+0000 7f7c968a4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7c900b55a0 con 0x7f7c900cfe80 2024-09-19T09:18:52.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.667+0000 7f7c8ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c900b3210 0x7f7c900c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:52.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.667+0000 7f7c8ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c900b3210 0x7f7c900c76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36664/0 (socket says 172.21.15.18:36664) 2024-09-19T09:18:52.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.667+0000 7f7c8ffff640 1 -- 172.21.15.18:0/410713616 learned_addr learned my addr 172.21.15.18:0/410713616 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:52.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.668+0000 7f7c8f7fe640 1 --2- 172.21.15.18:0/410713616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c900cf560 0x7f7c9015e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:52.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.668+0000 7f7c94e41640 1 --2- 172.21.15.18:0/410713616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c900cfe80 0x7f7c90151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:52.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.668+0000 7f7c8ffff640 1 -- 172.21.15.18:0/410713616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c900cfe80 msgr2=0x7f7c90151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:52.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.668+0000 7f7c8ffff640 1 --2- 172.21.15.18:0/410713616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c900cfe80 0x7f7c90151bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:52.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.668+0000 7f7c8ffff640 1 -- 172.21.15.18:0/410713616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c900cf560 msgr2=0x7f7c9015e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:52.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.668+0000 7f7c8ffff640 1 --2- 172.21.15.18:0/410713616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c900cf560 0x7f7c9015e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:52.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.668+0000 7f7c8ffff640 1 -- 172.21.15.18:0/410713616 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c900c7e40 con 0x7f7c900b3210 2024-09-19T09:18:52.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.668+0000 7f7c8f7fe640 1 --2- 172.21.15.18:0/410713616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c900cf560 0x7f7c9015e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:52.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.668+0000 7f7c94e41640 1 --2- 172.21.15.18:0/410713616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c900cfe80 0x7f7c90151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:52.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.668+0000 7f7c8ffff640 1 --2- 172.21.15.18:0/410713616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c900b3210 0x7f7c900c76d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f7c800098c0 tx=0x7f7c800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:52.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.668+0000 7f7c8cff9640 1 -- 172.21.15.18:0/410713616 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c80041030 con 0x7f7c900b3210 2024-09-19T09:18:52.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.668+0000 7f7c8cff9640 1 -- 172.21.15.18:0/410713616 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c8002abb0 con 0x7f7c900b3210 2024-09-19T09:18:52.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.668+0000 7f7c968a4640 1 -- 172.21.15.18:0/410713616 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c900c8120 con 0x7f7c900b3210 2024-09-19T09:18:52.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.668+0000 7f7c8cff9640 1 -- 172.21.15.18:0/410713616 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c80037040 con 0x7f7c900b3210 2024-09-19T09:18:52.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.668+0000 7f7c968a4640 1 -- 172.21.15.18:0/410713616 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c900c86e0 con 0x7f7c900b3210 2024-09-19T09:18:52.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.669+0000 7f7c968a4640 1 -- 172.21.15.18:0/410713616 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c900b4f20 con 0x7f7c900b3210 2024-09-19T09:18:52.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.670+0000 7f7c8cff9640 1 -- 172.21.15.18:0/410713616 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7c80044070 con 0x7f7c900b3210 2024-09-19T09:18:52.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.670+0000 7f7c8cff9640 1 --2- 172.21.15.18:0/410713616 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7c7c06c2b0 0x7f7c7c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:52.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.670+0000 7f7c8cff9640 1 -- 172.21.15.18:0/410713616 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7f7c800abae0 con 0x7f7c900b3210 2024-09-19T09:18:52.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.670+0000 7f7c8f7fe640 1 --2- 172.21.15.18:0/410713616 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7c7c06c2b0 0x7f7c7c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:52.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.671+0000 7f7c8f7fe640 1 --2- 172.21.15.18:0/410713616 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7c7c06c2b0 0x7f7c7c06e770 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7c9006d560 tx=0x7f7c84008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:52.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.674+0000 7f7c8cff9640 1 -- 172.21.15.18:0/410713616 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7c80044e40 con 0x7f7c900b3210 2024-09-19T09:18:52.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.887+0000 7f7c968a4640 1 -- 172.21.15.18:0/410713616 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c900755b0 con 0x7f7c900b3210 2024-09-19T09:18:52.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.888+0000 7f7c8cff9640 1 -- 172.21.15.18:0/410713616 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5225 (secure 0 0 0) 0x7f7c8007a1d0 con 0x7f7c900b3210 2024-09-19T09:18:52.889 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:52.889 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":42,"btime":"2024-09-19T09:18:26:440614+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5944,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/935732637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":935732637},{"type":"v1","addr":"172.21.15.162:6836","nonce":935732637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6192,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3186899169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":3186899169},{"type":"v1","addr":"172.21.15.18:6835","nonce":3186899169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6195,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/3889971648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3889971648},{"type":"v1","addr":"172.21.15.18:6834","nonce":3889971648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:18:23.782156+0000","modified":"2024-09-19T09:18:25.789778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"d","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6837/133611430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":133611430},{"type":"v1","addr":"172.21.15.162:6837","nonce":133611430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6207,"qdb_cluster":[6207]},"id":6}]} 2024-09-19T09:18:52.889 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 42 2024-09-19T09:18:52.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.889+0000 7f7c968a4640 1 -- 172.21.15.18:0/410713616 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7c7c06c2b0 msgr2=0x7f7c7c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:52.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.889+0000 7f7c968a4640 1 --2- 172.21.15.18:0/410713616 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7c7c06c2b0 0x7f7c7c06e770 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7c9006d560 tx=0x7f7c84008040 comp rx=0 tx=0).stop 2024-09-19T09:18:52.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.889+0000 7f7c968a4640 1 -- 172.21.15.18:0/410713616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c900b3210 msgr2=0x7f7c900c76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:52.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.889+0000 7f7c968a4640 1 --2- 172.21.15.18:0/410713616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c900b3210 0x7f7c900c76d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f7c800098c0 tx=0x7f7c800046c0 comp rx=0 tx=0).stop 2024-09-19T09:18:52.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.890+0000 7f7c968a4640 1 -- 172.21.15.18:0/410713616 shutdown_connections 2024-09-19T09:18:52.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.890+0000 7f7c968a4640 1 --2- 172.21.15.18:0/410713616 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7c7c06c2b0 0x7f7c7c06e770 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:52.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.890+0000 7f7c968a4640 1 --2- 172.21.15.18:0/410713616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c900cfe80 0x7f7c90151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:52.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.890+0000 7f7c968a4640 1 --2- 172.21.15.18:0/410713616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c900cf560 0x7f7c9015e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:52.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.890+0000 7f7c968a4640 1 --2- 172.21.15.18:0/410713616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c900b3210 0x7f7c900c76d0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:52.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.890+0000 7f7c968a4640 1 -- 172.21.15.18:0/410713616 >> 172.21.15.18:0/410713616 conn(0x7f7c900b4700 msgr2=0x7f7c9006ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:52.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.890+0000 7f7c968a4640 1 -- 172.21.15.18:0/410713616 shutdown_connections 2024-09-19T09:18:52.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:52.890+0000 7f7c968a4640 1 -- 172.21.15.18:0/410713616 wait complete. 2024-09-19T09:18:52.902 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2024-09-19T09:18:53.030 INFO:teuthology.orchestra.run.smithi162.stdout:{"cluster_fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","whoami":0,"id":6207,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":28.592429721999999,"mdsmap_epoch":42,"osdmap_epoch":111,"osdmap_epoch_barrier":107,"uptime":33.498317792000002} 2024-09-19T09:18:53.030 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", "fs_name": "cephfs", "id": 6207, "mdsmap_epoch": 42, "osdmap_epoch": 111, "osdmap_epoch_barrier": 107, "rank_uptime": 28.592429722, "state": "up:active", "uptime": 33.498317792, "want_state": "up:active", "whoami": 0 } 2024-09-19T09:18:53.030 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-19T09:18:53.031 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:18:53.031 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:18:53.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:53.048 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2024-09-19T09:18:53.279 INFO:teuthology.orchestra.run.smithi018.stderr:50+0 records in 2024-09-19T09:18:53.279 INFO:teuthology.orchestra.run.smithi018.stderr:50+0 records out 2024-09-19T09:18:53.279 INFO:teuthology.orchestra.run.smithi018.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.172032 s, 305 MB/s 2024-09-19T09:18:53.279 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T09:18:53.279 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:18:53.329 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:18:53.363 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T09:18:53.363 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:18:53.363 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:18:53.363 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:18:53.380 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:18:53.380 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:18:53.438 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T09:18:53.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.582+0000 7fda5ce0e640 1 Processor -- start 2024-09-19T09:18:53.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.582+0000 7fda5ce0e640 1 -- start start 2024-09-19T09:18:53.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.583+0000 7fda5ce0e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fda580d5790 0x7fda580d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:53.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.583+0000 7fda5ce0e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda580d3cc0 con 0x7fda580d1630 2024-09-19T09:18:53.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.583+0000 7fda5ce0e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda580d0bf0 con 0x7fda5815eda0 2024-09-19T09:18:53.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.583+0000 7fda5ce0e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fda580d5c00 con 0x7fda580d5790 2024-09-19T09:18:53.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.583+0000 7fda55d9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fda580d5790 0x7fda580d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:53.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.583+0000 7fda56d9d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fda580d1630 0x7fda580b7b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43900/0 (socket says 172.21.15.18:43900) 2024-09-19T09:18:53.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.583+0000 7fda56d9d640 1 -- 172.21.15.18:0/1148504833 learned_addr learned my addr 172.21.15.18:0/1148504833 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:53.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.584+0000 7fda55d9b640 1 -- 172.21.15.18:0/1148504833 >> v1:172.21.15.162:6789/0 conn(0x7fda5815eda0 legacy=0x7fda580d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:53.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.584+0000 7fda55d9b640 1 -- 172.21.15.18:0/1148504833 >> v1:172.21.15.18:6789/0 conn(0x7fda580d1630 legacy=0x7fda580b7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:53.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.584+0000 7fda5559a640 1 -- 172.21.15.18:0/1148504833 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2829149244 0 0) 0x7fda580d3cc0 con 0x7fda580d1630 2024-09-19T09:18:53.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.584+0000 7fda55d9b640 1 -- 172.21.15.18:0/1148504833 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda580d2ad0 con 0x7fda580d5790 2024-09-19T09:18:53.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.584+0000 7fda55d9b640 1 --2- 172.21.15.18:0/1148504833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda580d5790 0x7fda580d0480 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fda400097a0 tx=0x7fda4002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74895c6879ffef7d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:53.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.585+0000 7fda5559a640 1 -- 172.21.15.18:0/1148504833 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda40037070 con 0x7fda580d5790 2024-09-19T09:18:53.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.585+0000 7fda5559a640 1 -- 172.21.15.18:0/1148504833 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda40032440 con 0x7fda580d5790 2024-09-19T09:18:53.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.585+0000 7fda5559a640 1 -- 172.21.15.18:0/1148504833 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda40032810 con 0x7fda580d5790 2024-09-19T09:18:53.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.585+0000 7fda5ce0e640 1 -- 172.21.15.18:0/1148504833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda580d5790 msgr2=0x7fda580d0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:53.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.585+0000 7fda5ce0e640 1 --2- 172.21.15.18:0/1148504833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda580d5790 0x7fda580d0480 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fda400097a0 tx=0x7fda4002a1e0 comp rx=0 tx=0).stop 2024-09-19T09:18:53.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.585+0000 7fda5ce0e640 1 -- 172.21.15.18:0/1148504833 shutdown_connections 2024-09-19T09:18:53.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.585+0000 7fda5ce0e640 1 --2- 172.21.15.18:0/1148504833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda580d5790 0x7fda580d0480 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:53.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.585+0000 7fda5ce0e640 1 -- 172.21.15.18:0/1148504833 >> 172.21.15.18:0/1148504833 conn(0x7fda5809df40 msgr2=0x7fda580d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:53.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.585+0000 7fda5ce0e640 1 -- 172.21.15.18:0/1148504833 shutdown_connections 2024-09-19T09:18:53.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.585+0000 7fda5ce0e640 1 -- 172.21.15.18:0/1148504833 wait complete. 2024-09-19T09:18:53.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.587+0000 7fda5ce0e640 1 Processor -- start 2024-09-19T09:18:53.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.587+0000 7fda5ce0e640 1 -- start start 2024-09-19T09:18:53.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.587+0000 7fda5ce0e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda580d1630 0x7fda581510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:53.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.587+0000 7fda5ce0e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda580d5790 0x7fda580c8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:53.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.587+0000 7fda5ce0e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda5815eda0 0x7fda580c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:53.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.587+0000 7fda5ce0e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fda580d2880 con 0x7fda580d1630 2024-09-19T09:18:53.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.587+0000 7fda5ce0e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fda580d3120 con 0x7fda5815eda0 2024-09-19T09:18:53.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.587+0000 7fda5ce0e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fda5815f180 con 0x7fda580d5790 2024-09-19T09:18:53.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.587+0000 7fda5659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda580d1630 0x7fda581510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:53.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.588+0000 7fda5659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda580d1630 0x7fda581510a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36670/0 (socket says 172.21.15.18:36670) 2024-09-19T09:18:53.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.588+0000 7fda5659c640 1 -- 172.21.15.18:0/1820821104 learned_addr learned my addr 172.21.15.18:0/1820821104 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:53.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.588+0000 7fda56d9d640 1 --2- 172.21.15.18:0/1820821104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda5815eda0 0x7fda580c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:53.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.588+0000 7fda55d9b640 1 --2- 172.21.15.18:0/1820821104 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda580d5790 0x7fda580c8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:53.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.588+0000 7fda5659c640 1 -- 172.21.15.18:0/1820821104 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda580d5790 msgr2=0x7fda580c8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:53.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.588+0000 7fda5659c640 1 --2- 172.21.15.18:0/1820821104 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda580d5790 0x7fda580c8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:53.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.588+0000 7fda5659c640 1 -- 172.21.15.18:0/1820821104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda5815eda0 msgr2=0x7fda580c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:53.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.588+0000 7fda5659c640 1 --2- 172.21.15.18:0/1820821104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda5815eda0 0x7fda580c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:53.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.588+0000 7fda5659c640 1 -- 172.21.15.18:0/1820821104 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda581613e0 con 0x7fda580d1630 2024-09-19T09:18:53.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.588+0000 7fda56d9d640 1 --2- 172.21.15.18:0/1820821104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda5815eda0 0x7fda580c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:53.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.588+0000 7fda55d9b640 1 --2- 172.21.15.18:0/1820821104 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda580d5790 0x7fda580c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:53.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.588+0000 7fda5659c640 1 --2- 172.21.15.18:0/1820821104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda580d1630 0x7fda581510a0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fda5000c430 tx=0x7fda5000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:53.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.588+0000 7fda4effd640 1 -- 172.21.15.18:0/1820821104 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda50011790 con 0x7fda580d1630 2024-09-19T09:18:53.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.588+0000 7fda4effd640 1 -- 172.21.15.18:0/1820821104 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda50017070 con 0x7fda580d1630 2024-09-19T09:18:53.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.588+0000 7fda5ce0e640 1 -- 172.21.15.18:0/1820821104 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda581616c0 con 0x7fda580d1630 2024-09-19T09:18:53.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.588+0000 7fda4effd640 1 -- 172.21.15.18:0/1820821104 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda50011bb0 con 0x7fda580d1630 2024-09-19T09:18:53.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.588+0000 7fda5ce0e640 1 -- 172.21.15.18:0/1820821104 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda58161c80 con 0x7fda580d1630 2024-09-19T09:18:53.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.589+0000 7fda5ce0e640 1 -- 172.21.15.18:0/1820821104 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda580d0480 con 0x7fda580d1630 2024-09-19T09:18:53.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.590+0000 7fda4effd640 1 -- 172.21.15.18:0/1820821104 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fda5001c460 con 0x7fda580d1630 2024-09-19T09:18:53.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.590+0000 7fda4effd640 1 --2- 172.21.15.18:0/1820821104 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fda3806c2b0 0x7fda3806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:53.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.590+0000 7fda4effd640 1 -- 172.21.15.18:0/1820821104 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7fda5008b330 con 0x7fda580d1630 2024-09-19T09:18:53.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.591+0000 7fda55d9b640 1 --2- 172.21.15.18:0/1820821104 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fda3806c2b0 0x7fda3806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:53.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.591+0000 7fda55d9b640 1 --2- 172.21.15.18:0/1820821104 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fda3806c2b0 0x7fda3806e770 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fda40034000 tx=0x7fda4002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:53.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.595+0000 7fda4effd640 1 -- 172.21.15.18:0/1820821104 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fda50059aa0 con 0x7fda580d1630 2024-09-19T09:18:53.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.785+0000 7fda5ce0e640 1 -- 172.21.15.18:0/1820821104 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fda580cc770 con 0x7fda580d1630 2024-09-19T09:18:53.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.785+0000 7fda4effd640 1 -- 172.21.15.18:0/1820821104 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v111) ==== 80+0+0 (secure 0 0 0) 0x7fda500593a0 con 0x7fda580d1630 2024-09-19T09:18:53.786 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-09-19T09:18:53.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.787+0000 7fda5ce0e640 1 -- 172.21.15.18:0/1820821104 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fda3806c2b0 msgr2=0x7fda3806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:53.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.787+0000 7fda5ce0e640 1 --2- 172.21.15.18:0/1820821104 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fda3806c2b0 0x7fda3806e770 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fda40034000 tx=0x7fda4002e000 comp rx=0 tx=0).stop 2024-09-19T09:18:53.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.787+0000 7fda5ce0e640 1 -- 172.21.15.18:0/1820821104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda580d1630 msgr2=0x7fda581510a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:53.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.787+0000 7fda5ce0e640 1 --2- 172.21.15.18:0/1820821104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda580d1630 0x7fda581510a0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fda5000c430 tx=0x7fda5000c8f0 comp rx=0 tx=0).stop 2024-09-19T09:18:53.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.788+0000 7fda5ce0e640 1 -- 172.21.15.18:0/1820821104 shutdown_connections 2024-09-19T09:18:53.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.788+0000 7fda5ce0e640 1 --2- 172.21.15.18:0/1820821104 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fda3806c2b0 0x7fda3806e770 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:53.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.788+0000 7fda5ce0e640 1 --2- 172.21.15.18:0/1820821104 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda5815eda0 0x7fda580c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:53.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.788+0000 7fda5ce0e640 1 --2- 172.21.15.18:0/1820821104 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda580d5790 0x7fda580c8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:53.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.788+0000 7fda5ce0e640 1 --2- 172.21.15.18:0/1820821104 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda580d1630 0x7fda581510a0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:53.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.788+0000 7fda5ce0e640 1 -- 172.21.15.18:0/1820821104 >> 172.21.15.18:0/1820821104 conn(0x7fda5809df40 msgr2=0x7fda580b8160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:53.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.788+0000 7fda5ce0e640 1 -- 172.21.15.18:0/1820821104 shutdown_connections 2024-09-19T09:18:53.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:53.788+0000 7fda5ce0e640 1 -- 172.21.15.18:0/1820821104 wait complete. 2024-09-19T09:18:53.799 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T09:18:53.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:53.799 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-19T09:18:53.857 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T09:18:53.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:53.857 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T09:18:53.877 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:18:53.877 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:18:53.877 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:18:53.893 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:18:53.893 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:18:53.950 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T09:18:54.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.052+0000 7f5e8a8dd640 1 Processor -- start 2024-09-19T09:18:54.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.052+0000 7f5e8a8dd640 1 -- start start 2024-09-19T09:18:54.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.053+0000 7f5e8a8dd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5e8406bc10 0x7f5e840b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:54.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.053+0000 7f5e8a8dd640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e841600c0 con 0x7f5e840b4b90 2024-09-19T09:18:54.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.053+0000 7f5e8a8dd640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e840d1920 con 0x7f5e840727d0 2024-09-19T09:18:54.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.053+0000 7f5e8a8dd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f5e8415f300 con 0x7f5e8406bc10 2024-09-19T09:18:54.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.053+0000 7f5e837fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f5e840b4b90 0x7f5e8406bff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43910/0 (socket says 172.21.15.18:43910) 2024-09-19T09:18:54.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.053+0000 7f5e837fe640 1 -- 172.21.15.18:0/1563414532 learned_addr learned my addr 172.21.15.18:0/1563414532 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:54.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.054+0000 7f5e83fff640 1 --2- 172.21.15.18:0/1563414532 >> v2:172.21.15.162:3300/0 conn(0x7f5e8406bc10 0x7f5e840b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:54.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.054+0000 7f5e82ffd640 1 -- 172.21.15.18:0/1563414532 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 840799 0 0) 0x7f5e841600c0 con 0x7f5e840b4b90 2024-09-19T09:18:54.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.054+0000 7f5e82ffd640 1 -- 172.21.15.18:0/1563414532 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e6c003520 con 0x7f5e840b4b90 2024-09-19T09:18:54.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.054+0000 7f5e82ffd640 1 -- 172.21.15.18:0/1563414532 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1654243420 0 0) 0x7f5e6c003520 con 0x7f5e840b4b90 2024-09-19T09:18:54.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.054+0000 7f5e82ffd640 1 -- 172.21.15.18:0/1563414532 >> v2:172.21.15.162:3300/0 conn(0x7f5e8406bc10 msgr2=0x7f5e840b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:54.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.054+0000 7f5e82ffd640 1 --2- 172.21.15.18:0/1563414532 >> v2:172.21.15.162:3300/0 conn(0x7f5e8406bc10 0x7f5e840b6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:54.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.054+0000 7f5e82ffd640 1 -- 172.21.15.18:0/1563414532 >> v1:172.21.15.162:6789/0 conn(0x7f5e840727d0 legacy=0x7f5e84072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:54.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.054+0000 7f5e82ffd640 1 -- 172.21.15.18:0/1563414532 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e8415f5e0 con 0x7f5e840b4b90 2024-09-19T09:18:54.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.054+0000 7f5e82ffd640 1 -- 172.21.15.18:0/1563414532 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f5e78001670 con 0x7f5e840b4b90 2024-09-19T09:18:54.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.054+0000 7f5e82ffd640 1 -- 172.21.15.18:0/1563414532 >> v1:172.21.15.18:6789/0 conn(0x7f5e840b4b90 legacy=0x7f5e8406bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:54.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.054+0000 7f5e82ffd640 1 --2- 172.21.15.18:0/1563414532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e6c0039b0 0x7f5e6c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:54.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.054+0000 7f5e82ffd640 1 --2- 172.21.15.18:0/1563414532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e6c004800 0x7f5e6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:54.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.054+0000 7f5e82ffd640 1 --2- 172.21.15.18:0/1563414532 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e6c005210 0x7f5e6c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:54.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.054+0000 7f5e82ffd640 1 -- 172.21.15.18:0/1563414532 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5e8415f300 con 0x7f5e6c0039b0 2024-09-19T09:18:54.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.054+0000 7f5e82ffd640 1 -- 172.21.15.18:0/1563414532 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5e6c00c140 con 0x7f5e6c004800 2024-09-19T09:18:54.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.054+0000 7f5e82ffd640 1 -- 172.21.15.18:0/1563414532 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5e6c00c340 con 0x7f5e6c005210 2024-09-19T09:18:54.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.054+0000 7f5e83fff640 1 --2- 172.21.15.18:0/1563414532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e6c0039b0 0x7f5e6c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:54.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.054+0000 7f5e837fe640 1 --2- 172.21.15.18:0/1563414532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e6c004800 0x7f5e6c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:54.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.054+0000 7f5e88e7a640 1 --2- 172.21.15.18:0/1563414532 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e6c005210 0x7f5e6c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:54.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.054+0000 7f5e83fff640 1 -- 172.21.15.18:0/1563414532 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e6c005210 msgr2=0x7f5e6c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:54.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.054+0000 7f5e83fff640 1 --2- 172.21.15.18:0/1563414532 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e6c005210 0x7f5e6c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:54.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.054+0000 7f5e83fff640 1 -- 172.21.15.18:0/1563414532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e6c004800 msgr2=0x7f5e6c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:54.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.054+0000 7f5e83fff640 1 --2- 172.21.15.18:0/1563414532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e6c004800 0x7f5e6c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:54.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.054+0000 7f5e83fff640 1 -- 172.21.15.18:0/1563414532 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e6c003520 con 0x7f5e6c0039b0 2024-09-19T09:18:54.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.054+0000 7f5e88e7a640 1 -- 172.21.15.18:0/1563414532 reap_dead start 2024-09-19T09:18:54.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.055+0000 7f5e83fff640 1 --2- 172.21.15.18:0/1563414532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e6c0039b0 0x7f5e6c003dd0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f5e74009ac0 tx=0x7f5e6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6074a8c7944cdbb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:54.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.055+0000 7f5e82ffd640 1 -- 172.21.15.18:0/1563414532 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e74036070 con 0x7f5e6c0039b0 2024-09-19T09:18:54.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.055+0000 7f5e82ffd640 1 -- 172.21.15.18:0/1563414532 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e74031400 con 0x7f5e6c0039b0 2024-09-19T09:18:54.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.055+0000 7f5e82ffd640 1 -- 172.21.15.18:0/1563414532 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e74009690 con 0x7f5e6c0039b0 2024-09-19T09:18:54.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.056+0000 7f5e8a8dd640 1 -- 172.21.15.18:0/1563414532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e6c0039b0 msgr2=0x7f5e6c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:54.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.056+0000 7f5e8a8dd640 1 --2- 172.21.15.18:0/1563414532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e6c0039b0 0x7f5e6c003dd0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f5e74009ac0 tx=0x7f5e6c005830 comp rx=0 tx=0).stop 2024-09-19T09:18:54.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.056+0000 7f5e8a8dd640 1 -- 172.21.15.18:0/1563414532 shutdown_connections 2024-09-19T09:18:54.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.056+0000 7f5e8a8dd640 1 --2- 172.21.15.18:0/1563414532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e6c0039b0 0x7f5e6c003dd0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:54.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.056+0000 7f5e8a8dd640 1 -- 172.21.15.18:0/1563414532 >> 172.21.15.18:0/1563414532 conn(0x7f5e840b3890 msgr2=0x7f5e840b3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:54.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.056+0000 7f5e8a8dd640 1 -- 172.21.15.18:0/1563414532 shutdown_connections 2024-09-19T09:18:54.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.056+0000 7f5e8a8dd640 1 -- 172.21.15.18:0/1563414532 wait complete. 2024-09-19T09:18:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.057+0000 7f5e8a8dd640 1 Processor -- start 2024-09-19T09:18:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.057+0000 7f5e8a8dd640 1 -- start start 2024-09-19T09:18:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.058+0000 7f5e8a8dd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e6c0039b0 0x7f5e84140800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.058+0000 7f5e8a8dd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e84141e70 0x7f5e840b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.058+0000 7f5e8a8dd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e841422f0 0x7f5e840b1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.058+0000 7f5e8a8dd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5e840b5000 con 0x7f5e841422f0 2024-09-19T09:18:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.058+0000 7f5e8a8dd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5e8415fba0 con 0x7f5e84141e70 2024-09-19T09:18:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.058+0000 7f5e8a8dd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5e840b52e0 con 0x7f5e6c0039b0 2024-09-19T09:18:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.058+0000 7f5e88e7a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e841422f0 0x7f5e840b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.058+0000 7f5e88e7a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e841422f0 0x7f5e840b1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36684/0 (socket says 172.21.15.18:36684) 2024-09-19T09:18:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.058+0000 7f5e88e7a640 1 -- 172.21.15.18:0/903342798 learned_addr learned my addr 172.21.15.18:0/903342798 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:54.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.058+0000 7f5e88e7a640 1 -- 172.21.15.18:0/903342798 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e6c0039b0 msgr2=0x7f5e84140800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:54.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.058+0000 7f5e88e7a640 1 --2- 172.21.15.18:0/903342798 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e6c0039b0 0x7f5e84140800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:54.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.058+0000 7f5e88e7a640 1 -- 172.21.15.18:0/903342798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e84141e70 msgr2=0x7f5e840b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:54.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.058+0000 7f5e88e7a640 1 --2- 172.21.15.18:0/903342798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e84141e70 0x7f5e840b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:54.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.058+0000 7f5e88e7a640 1 -- 172.21.15.18:0/903342798 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e841428c0 con 0x7f5e841422f0 2024-09-19T09:18:54.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.058+0000 7f5e88e7a640 1 --2- 172.21.15.18:0/903342798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e841422f0 0x7f5e840b1670 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f5e840b4f70 tx=0x7f5e7c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:54.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.059+0000 7f5e80ff9640 1 -- 172.21.15.18:0/903342798 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c003970 con 0x7f5e841422f0 2024-09-19T09:18:54.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.059+0000 7f5e80ff9640 1 -- 172.21.15.18:0/903342798 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e7c018070 con 0x7f5e841422f0 2024-09-19T09:18:54.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.059+0000 7f5e8a8dd640 1 -- 172.21.15.18:0/903342798 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e84142ba0 con 0x7f5e841422f0 2024-09-19T09:18:54.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.059+0000 7f5e80ff9640 1 -- 172.21.15.18:0/903342798 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c003d50 con 0x7f5e841422f0 2024-09-19T09:18:54.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.059+0000 7f5e8a8dd640 1 -- 172.21.15.18:0/903342798 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e84143160 con 0x7f5e841422f0 2024-09-19T09:18:54.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.060+0000 7f5e8a8dd640 1 -- 172.21.15.18:0/903342798 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e840b6a50 con 0x7f5e841422f0 2024-09-19T09:18:54.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.060+0000 7f5e80ff9640 1 -- 172.21.15.18:0/903342798 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5e7c0050d0 con 0x7f5e841422f0 2024-09-19T09:18:54.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.061+0000 7f5e80ff9640 1 --2- 172.21.15.18:0/903342798 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5e7006c2e0 0x7f5e7006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:54.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.061+0000 7f5e80ff9640 1 -- 172.21.15.18:0/903342798 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7f5e7c08afc0 con 0x7f5e841422f0 2024-09-19T09:18:54.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.061+0000 7f5e83fff640 1 --2- 172.21.15.18:0/903342798 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5e7006c2e0 0x7f5e7006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:54.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.061+0000 7f5e83fff640 1 --2- 172.21.15.18:0/903342798 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5e7006c2e0 0x7f5e7006e7a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5e74033000 tx=0x7f5e7402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:54.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.065+0000 7f5e80ff9640 1 -- 172.21.15.18:0/903342798 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5e7c059730 con 0x7f5e841422f0 2024-09-19T09:18:54.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.256+0000 7f5e8a8dd640 1 -- 172.21.15.18:0/903342798 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5e841472a0 con 0x7f5e841422f0 2024-09-19T09:18:54.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.256+0000 7f5e80ff9640 1 -- 172.21.15.18:0/903342798 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v111) ==== 80+0+0 (secure 0 0 0) 0x7f5e7c01be40 con 0x7f5e841422f0 2024-09-19T09:18:54.257 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-09-19T09:18:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.258+0000 7f5e8a8dd640 1 -- 172.21.15.18:0/903342798 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5e7006c2e0 msgr2=0x7f5e7006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.258+0000 7f5e8a8dd640 1 --2- 172.21.15.18:0/903342798 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5e7006c2e0 0x7f5e7006e7a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5e74033000 tx=0x7f5e7402e000 comp rx=0 tx=0).stop 2024-09-19T09:18:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.258+0000 7f5e8a8dd640 1 -- 172.21.15.18:0/903342798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e841422f0 msgr2=0x7f5e840b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.258+0000 7f5e8a8dd640 1 --2- 172.21.15.18:0/903342798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e841422f0 0x7f5e840b1670 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f5e840b4f70 tx=0x7f5e7c00eb90 comp rx=0 tx=0).stop 2024-09-19T09:18:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.258+0000 7f5e8a8dd640 1 -- 172.21.15.18:0/903342798 shutdown_connections 2024-09-19T09:18:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.258+0000 7f5e8a8dd640 1 --2- 172.21.15.18:0/903342798 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5e7006c2e0 0x7f5e7006e7a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.258+0000 7f5e8a8dd640 1 --2- 172.21.15.18:0/903342798 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e841422f0 0x7f5e840b1670 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.258+0000 7f5e8a8dd640 1 --2- 172.21.15.18:0/903342798 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5e84141e70 0x7f5e840b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:54.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.258+0000 7f5e8a8dd640 1 --2- 172.21.15.18:0/903342798 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e6c0039b0 0x7f5e84140800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:54.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.258+0000 7f5e8a8dd640 1 -- 172.21.15.18:0/903342798 >> 172.21.15.18:0/903342798 conn(0x7f5e840b3890 msgr2=0x7f5e84072be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:54.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.258+0000 7f5e8a8dd640 1 -- 172.21.15.18:0/903342798 shutdown_connections 2024-09-19T09:18:54.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.258+0000 7f5e8a8dd640 1 -- 172.21.15.18:0/903342798 wait complete. 2024-09-19T09:18:54.270 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-19T09:18:54.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:54.270 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-19T09:18:54.299 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-09-19T09:18:54.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:18:54.299 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-19T09:18:54.356 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:18:54.356 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:18:54.356 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:18:54.373 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17075 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T09:18:54.373 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:18:54.373 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:18:54.373 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:18:54.413 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3252 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T09:18:54.413 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:18:54.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.515+0000 7f3d537a1640 1 Processor -- start 2024-09-19T09:18:54.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.515+0000 7f3d537a1640 1 -- start start 2024-09-19T09:18:54.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.516+0000 7f3d537a1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3d4c0cf560 0x7f3d4c0cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:54.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.516+0000 7f3d537a1640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d4c0d0e10 con 0x7f3d4c0cfe80 2024-09-19T09:18:54.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.516+0000 7f3d537a1640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d4c0d0310 con 0x7f3d4c0ce600 2024-09-19T09:18:54.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.516+0000 7f3d537a1640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f3d4c0d0850 con 0x7f3d4c0cf560 2024-09-19T09:18:54.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.516+0000 7f3d5153d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3d4c0cf560 0x7f3d4c0cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:54.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.516+0000 7f3d50d3c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3d4c0cfe80 0x7f3d4c0b2cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:43922/0 (socket says 172.21.15.18:43922) 2024-09-19T09:18:54.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.516+0000 7f3d50d3c640 1 -- 172.21.15.18:0/2580527008 learned_addr learned my addr 172.21.15.18:0/2580527008 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:54.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.516+0000 7f3d5153d640 1 -- 172.21.15.18:0/2580527008 >> v1:172.21.15.162:6789/0 conn(0x7f3d4c0ce600 legacy=0x7f3d4c0b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:54.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.516+0000 7f3d5153d640 1 -- 172.21.15.18:0/2580527008 >> v1:172.21.15.18:6789/0 conn(0x7f3d4c0cfe80 legacy=0x7f3d4c0b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:54.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.517+0000 7f3d5153d640 1 -- 172.21.15.18:0/2580527008 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d4c0d0b30 con 0x7f3d4c0cf560 2024-09-19T09:18:54.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.517+0000 7f3d43fff640 1 -- 172.21.15.18:0/2580527008 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2168835175 0 0) 0x7f3d4c0d0e10 con 0x7f3d4c0cfe80 2024-09-19T09:18:54.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.517+0000 7f3d5153d640 1 --2- 172.21.15.18:0/2580527008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d4c0cf560 0x7f3d4c0cf940 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f3d480097a0 tx=0x7f3d4802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c6cade13465bb07 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:54.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.517+0000 7f3d43fff640 1 -- 172.21.15.18:0/2580527008 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d48037070 con 0x7f3d4c0cf560 2024-09-19T09:18:54.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.517+0000 7f3d43fff640 1 -- 172.21.15.18:0/2580527008 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d48032440 con 0x7f3d4c0cf560 2024-09-19T09:18:54.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.517+0000 7f3d43fff640 1 -- 172.21.15.18:0/2580527008 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4802ae60 con 0x7f3d4c0cf560 2024-09-19T09:18:54.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.518+0000 7f3d537a1640 1 -- 172.21.15.18:0/2580527008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d4c0cf560 msgr2=0x7f3d4c0cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:54.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.518+0000 7f3d537a1640 1 --2- 172.21.15.18:0/2580527008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d4c0cf560 0x7f3d4c0cf940 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f3d480097a0 tx=0x7f3d4802a110 comp rx=0 tx=0).stop 2024-09-19T09:18:54.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.518+0000 7f3d537a1640 1 -- 172.21.15.18:0/2580527008 shutdown_connections 2024-09-19T09:18:54.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.518+0000 7f3d537a1640 1 --2- 172.21.15.18:0/2580527008 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d4c0cf560 0x7f3d4c0cf940 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:54.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.518+0000 7f3d537a1640 1 -- 172.21.15.18:0/2580527008 >> 172.21.15.18:0/2580527008 conn(0x7f3d4c0b4700 msgr2=0x7f3d4c0b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:54.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.518+0000 7f3d537a1640 1 -- 172.21.15.18:0/2580527008 shutdown_connections 2024-09-19T09:18:54.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.518+0000 7f3d537a1640 1 -- 172.21.15.18:0/2580527008 wait complete. 2024-09-19T09:18:54.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.519+0000 7f3d537a1640 1 Processor -- start 2024-09-19T09:18:54.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.519+0000 7f3d537a1640 1 -- start start 2024-09-19T09:18:54.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.520+0000 7f3d537a1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d4c0ce600 0x7f3d4c150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:54.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.520+0000 7f3d537a1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d4c0cf560 0x7f3d4c0c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:54.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.520+0000 7f3d537a1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d4c0cfe80 0x7f3d4c0708a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:54.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.520+0000 7f3d537a1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4c0b5420 con 0x7f3d4c0cfe80 2024-09-19T09:18:54.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.520+0000 7f3d537a1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3d4c0b27b0 con 0x7f3d4c0ce600 2024-09-19T09:18:54.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.520+0000 7f3d537a1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3d4c0b55a0 con 0x7f3d4c0cf560 2024-09-19T09:18:54.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.520+0000 7f3d51d3e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d4c0cfe80 0x7f3d4c0708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:54.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.520+0000 7f3d51d3e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d4c0cfe80 0x7f3d4c0708a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36704/0 (socket says 172.21.15.18:36704) 2024-09-19T09:18:54.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.520+0000 7f3d51d3e640 1 -- 172.21.15.18:0/4129712592 learned_addr learned my addr 172.21.15.18:0/4129712592 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:54.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.520+0000 7f3d5153d640 1 --2- 172.21.15.18:0/4129712592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d4c0ce600 0x7f3d4c150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:54.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.520+0000 7f3d50d3c640 1 --2- 172.21.15.18:0/4129712592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d4c0cf560 0x7f3d4c0c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:54.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.520+0000 7f3d51d3e640 1 -- 172.21.15.18:0/4129712592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d4c0cf560 msgr2=0x7f3d4c0c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:54.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.520+0000 7f3d51d3e640 1 --2- 172.21.15.18:0/4129712592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d4c0cf560 0x7f3d4c0c8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:54.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.520+0000 7f3d51d3e640 1 -- 172.21.15.18:0/4129712592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d4c0ce600 msgr2=0x7f3d4c150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:54.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.520+0000 7f3d51d3e640 1 --2- 172.21.15.18:0/4129712592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d4c0ce600 0x7f3d4c150f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:54.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.520+0000 7f3d51d3e640 1 -- 172.21.15.18:0/4129712592 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d4c0c7d20 con 0x7f3d4c0cfe80 2024-09-19T09:18:54.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.521+0000 7f3d51d3e640 1 --2- 172.21.15.18:0/4129712592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d4c0cfe80 0x7f3d4c0708a0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400c6b0 tx=0x7f3d4400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:54.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.521+0000 7f3d41ffb640 1 -- 172.21.15.18:0/4129712592 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d44003b70 con 0x7f3d4c0cfe80 2024-09-19T09:18:54.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.521+0000 7f3d41ffb640 1 -- 172.21.15.18:0/4129712592 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d44003d30 con 0x7f3d4c0cfe80 2024-09-19T09:18:54.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.521+0000 7f3d537a1640 1 -- 172.21.15.18:0/4129712592 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d4c0c8000 con 0x7f3d4c0cfe80 2024-09-19T09:18:54.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.521+0000 7f3d41ffb640 1 -- 172.21.15.18:0/4129712592 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d44005310 con 0x7f3d4c0cfe80 2024-09-19T09:18:54.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.521+0000 7f3d537a1640 1 -- 172.21.15.18:0/4129712592 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d4c0c85c0 con 0x7f3d4c0cfe80 2024-09-19T09:18:54.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.522+0000 7f3d537a1640 1 -- 172.21.15.18:0/4129712592 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d4c15d090 con 0x7f3d4c0cfe80 2024-09-19T09:18:54.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.523+0000 7f3d41ffb640 1 -- 172.21.15.18:0/4129712592 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3d440054b0 con 0x7f3d4c0cfe80 2024-09-19T09:18:54.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.523+0000 7f3d41ffb640 1 --2- 172.21.15.18:0/4129712592 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3d3006c2b0 0x7f3d3006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:54.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.523+0000 7f3d41ffb640 1 -- 172.21.15.18:0/4129712592 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7f3d4408b180 con 0x7f3d4c0cfe80 2024-09-19T09:18:54.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.523+0000 7f3d5153d640 1 --2- 172.21.15.18:0/4129712592 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3d3006c2b0 0x7f3d3006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:54.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.524+0000 7f3d5153d640 1 --2- 172.21.15.18:0/4129712592 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3d3006c2b0 0x7f3d3006e770 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3d48034000 tx=0x7f3d4802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:54.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.527+0000 7f3d41ffb640 1 -- 172.21.15.18:0/4129712592 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3d440592a0 con 0x7f3d4c0cfe80 2024-09-19T09:18:54.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.739+0000 7f3d537a1640 1 -- 172.21.15.18:0/4129712592 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3d4c070660 con 0x7f3d4c0cfe80 2024-09-19T09:18:54.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.740+0000 7f3d41ffb640 1 -- 172.21.15.18:0/4129712592 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5225 (secure 0 0 0) 0x7f3d4405d5a0 con 0x7f3d4c0cfe80 2024-09-19T09:18:54.740 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:54.741 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":42,"btime":"2024-09-19T09:18:26:440614+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5944,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/935732637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":935732637},{"type":"v1","addr":"172.21.15.162:6836","nonce":935732637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6192,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3186899169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":3186899169},{"type":"v1","addr":"172.21.15.18:6835","nonce":3186899169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6195,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/3889971648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3889971648},{"type":"v1","addr":"172.21.15.18:6834","nonce":3889971648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:18:23.782156+0000","modified":"2024-09-19T09:18:25.789778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"d","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6837/133611430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":133611430},{"type":"v1","addr":"172.21.15.162:6837","nonce":133611430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6207,"qdb_cluster":[6207]},"id":6}]} 2024-09-19T09:18:54.741 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 42 2024-09-19T09:18:54.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.742+0000 7f3d537a1640 1 -- 172.21.15.18:0/4129712592 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3d3006c2b0 msgr2=0x7f3d3006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:54.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.742+0000 7f3d537a1640 1 --2- 172.21.15.18:0/4129712592 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3d3006c2b0 0x7f3d3006e770 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3d48034000 tx=0x7f3d4802e000 comp rx=0 tx=0).stop 2024-09-19T09:18:54.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.742+0000 7f3d537a1640 1 -- 172.21.15.18:0/4129712592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d4c0cfe80 msgr2=0x7f3d4c0708a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:54.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.742+0000 7f3d537a1640 1 --2- 172.21.15.18:0/4129712592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d4c0cfe80 0x7f3d4c0708a0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400c6b0 tx=0x7f3d4400cb70 comp rx=0 tx=0).stop 2024-09-19T09:18:54.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.742+0000 7f3d537a1640 1 -- 172.21.15.18:0/4129712592 shutdown_connections 2024-09-19T09:18:54.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.742+0000 7f3d537a1640 1 --2- 172.21.15.18:0/4129712592 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3d3006c2b0 0x7f3d3006e770 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:54.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.742+0000 7f3d537a1640 1 --2- 172.21.15.18:0/4129712592 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d4c0cfe80 0x7f3d4c0708a0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:54.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.742+0000 7f3d537a1640 1 --2- 172.21.15.18:0/4129712592 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d4c0cf560 0x7f3d4c0c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:54.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.742+0000 7f3d537a1640 1 --2- 172.21.15.18:0/4129712592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d4c0ce600 0x7f3d4c150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:54.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.742+0000 7f3d537a1640 1 -- 172.21.15.18:0/4129712592 >> 172.21.15.18:0/4129712592 conn(0x7f3d4c0b4700 msgr2=0x7f3d4c15c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:54.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.742+0000 7f3d537a1640 1 -- 172.21.15.18:0/4129712592 shutdown_connections 2024-09-19T09:18:54.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.742+0000 7f3d537a1640 1 -- 172.21.15.18:0/4129712592 wait complete. 2024-09-19T09:18:54.753 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:18:54.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.855+0000 7fa59bb0a640 1 Processor -- start 2024-09-19T09:18:54.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.855+0000 7fa59bb0a640 1 -- start start 2024-09-19T09:18:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.856+0000 7fa59bb0a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa59415ef80 0x7fa5940b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.856+0000 7fa59bb0a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa59406d730 0x7fa5940cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.856+0000 7fa59bb0a640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5940cd1a0 con 0x7fa5940cf910 2024-09-19T09:18:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.856+0000 7fa59bb0a640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fa5940cd7d0 con 0x7fa59406d730 2024-09-19T09:18:54.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.856+0000 7fa59bb0a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa59406dc30 con 0x7fa59415ef80 2024-09-19T09:18:54.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.856+0000 7fa5990a5640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa59406d730 0x7fa5940cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:54.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.856+0000 7fa5990a5640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa59406d730 0x7fa5940cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36714/0 (socket says 172.21.15.18:36714) 2024-09-19T09:18:54.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.856+0000 7fa5990a5640 1 -- 172.21.15.18:0/2436795440 learned_addr learned my addr 172.21.15.18:0/2436795440 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:54.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.856+0000 7fa5998a6640 1 --2- 172.21.15.18:0/2436795440 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa59415ef80 0x7fa5940b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:54.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.857+0000 7fa5990a5640 1 -- 172.21.15.18:0/2436795440 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa59415ef80 msgr2=0x7fa5940b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:54.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.857+0000 7fa5990a5640 1 --2- 172.21.15.18:0/2436795440 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa59415ef80 0x7fa5940b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:54.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.857+0000 7fa5990a5640 1 -- 172.21.15.18:0/2436795440 >> v1:172.21.15.162:6789/0 conn(0x7fa5940cf910 legacy=0x7fa5940d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:54.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.857+0000 7fa5990a5640 1 -- 172.21.15.18:0/2436795440 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa59406df10 con 0x7fa59406d730 2024-09-19T09:18:54.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.857+0000 7fa5990a5640 1 --2- 172.21.15.18:0/2436795440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa59406d730 0x7fa5940cf3d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fa588009870 tx=0x7fa58802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdbbef2b03b8f33d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:54.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.857+0000 7fa5988a4640 1 -- 172.21.15.18:0/2436795440 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa588037070 con 0x7fa59406d730 2024-09-19T09:18:54.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.857+0000 7fa5988a4640 1 -- 172.21.15.18:0/2436795440 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa588032440 con 0x7fa59406d730 2024-09-19T09:18:54.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.857+0000 7fa5988a4640 1 -- 172.21.15.18:0/2436795440 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa588032810 con 0x7fa59406d730 2024-09-19T09:18:54.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.858+0000 7fa59bb0a640 1 -- 172.21.15.18:0/2436795440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa59406d730 msgr2=0x7fa5940cf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:54.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.858+0000 7fa59bb0a640 1 --2- 172.21.15.18:0/2436795440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa59406d730 0x7fa5940cf3d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fa588009870 tx=0x7fa58802a270 comp rx=0 tx=0).stop 2024-09-19T09:18:54.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.858+0000 7fa59bb0a640 1 -- 172.21.15.18:0/2436795440 shutdown_connections 2024-09-19T09:18:54.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.858+0000 7fa59bb0a640 1 --2- 172.21.15.18:0/2436795440 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa59406d730 0x7fa5940cf3d0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:54.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.858+0000 7fa59bb0a640 1 --2- 172.21.15.18:0/2436795440 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa59415ef80 0x7fa5940b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:54.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.858+0000 7fa59bb0a640 1 -- 172.21.15.18:0/2436795440 >> 172.21.15.18:0/2436795440 conn(0x7fa5940b4700 msgr2=0x7fa5940b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:54.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.858+0000 7fa59bb0a640 1 -- 172.21.15.18:0/2436795440 shutdown_connections 2024-09-19T09:18:54.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.858+0000 7fa59bb0a640 1 -- 172.21.15.18:0/2436795440 wait complete. 2024-09-19T09:18:54.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.859+0000 7fa59bb0a640 1 Processor -- start 2024-09-19T09:18:54.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.859+0000 7fa59bb0a640 1 -- start start 2024-09-19T09:18:54.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.860+0000 7fa59bb0a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa59406d730 0x7fa5941579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:54.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.860+0000 7fa59bb0a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5940cf910 0x7fa5940b8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:54.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.860+0000 7fa59bb0a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa59415ef80 0x7fa5940cc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:54.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.860+0000 7fa59bb0a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa5940d0120 con 0x7fa59415ef80 2024-09-19T09:18:54.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.860+0000 7fa59bb0a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa59415f360 con 0x7fa5940cf910 2024-09-19T09:18:54.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.860+0000 7fa59bb0a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa5940cec70 con 0x7fa59406d730 2024-09-19T09:18:54.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.860+0000 7fa59a0a7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa59415ef80 0x7fa5940cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:54.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.860+0000 7fa59a0a7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa59415ef80 0x7fa5940cc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36722/0 (socket says 172.21.15.18:36722) 2024-09-19T09:18:54.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.860+0000 7fa59a0a7640 1 -- 172.21.15.18:0/2642495651 learned_addr learned my addr 172.21.15.18:0/2642495651 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:54.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.860+0000 7fa5990a5640 1 --2- 172.21.15.18:0/2642495651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5940cf910 0x7fa5940b8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:54.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.860+0000 7fa5998a6640 1 --2- 172.21.15.18:0/2642495651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa59406d730 0x7fa5941579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:54.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.861+0000 7fa59a0a7640 1 -- 172.21.15.18:0/2642495651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa59406d730 msgr2=0x7fa5941579c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:54.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.861+0000 7fa59a0a7640 1 --2- 172.21.15.18:0/2642495651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa59406d730 0x7fa5941579c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:54.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.861+0000 7fa59a0a7640 1 -- 172.21.15.18:0/2642495651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5940cf910 msgr2=0x7fa5940b8110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:54.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.861+0000 7fa59a0a7640 1 --2- 172.21.15.18:0/2642495651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5940cf910 0x7fa5940b8110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:54.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.861+0000 7fa59a0a7640 1 -- 172.21.15.18:0/2642495651 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5940cb460 con 0x7fa59415ef80 2024-09-19T09:18:54.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.861+0000 7fa59a0a7640 1 --2- 172.21.15.18:0/2642495651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa59415ef80 0x7fa5940cc220 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fa58c00c400 tx=0x7fa58c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:54.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.861+0000 7fa5927fc640 1 -- 172.21.15.18:0/2642495651 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58c017070 con 0x7fa59415ef80 2024-09-19T09:18:54.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.861+0000 7fa5927fc640 1 -- 172.21.15.18:0/2642495651 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa58c0052d0 con 0x7fa59415ef80 2024-09-19T09:18:54.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.861+0000 7fa59bb0a640 1 -- 172.21.15.18:0/2642495651 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5940cb740 con 0x7fa59415ef80 2024-09-19T09:18:54.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.861+0000 7fa5927fc640 1 -- 172.21.15.18:0/2642495651 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa58c003810 con 0x7fa59415ef80 2024-09-19T09:18:54.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.861+0000 7fa59bb0a640 1 -- 172.21.15.18:0/2642495651 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa594157f00 con 0x7fa59415ef80 2024-09-19T09:18:54.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.862+0000 7fa59bb0a640 1 -- 172.21.15.18:0/2642495651 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5940cf3d0 con 0x7fa59415ef80 2024-09-19T09:18:54.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.862+0000 7fa5927fc640 1 -- 172.21.15.18:0/2642495651 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa58c01a070 con 0x7fa59415ef80 2024-09-19T09:18:54.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.863+0000 7fa5927fc640 1 --2- 172.21.15.18:0/2642495651 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa58006c2e0 0x7fa58006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:54.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.863+0000 7fa5927fc640 1 -- 172.21.15.18:0/2642495651 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7fa58c08a670 con 0x7fa59415ef80 2024-09-19T09:18:54.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.863+0000 7fa5998a6640 1 --2- 172.21.15.18:0/2642495651 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa58006c2e0 0x7fa58006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:54.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.864+0000 7fa5998a6640 1 --2- 172.21.15.18:0/2642495651 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa58006c2e0 0x7fa58006e7a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa584011340 tx=0x7fa58400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:54.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:54.868+0000 7fa5927fc640 1 -- 172.21.15.18:0/2642495651 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa58c058820 con 0x7fa59415ef80 2024-09-19T09:18:55.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.080+0000 7fa59bb0a640 1 -- 172.21.15.18:0/2642495651 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5940d0920 con 0x7fa59415ef80 2024-09-19T09:18:55.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.080+0000 7fa5927fc640 1 -- 172.21.15.18:0/2642495651 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5225 (secure 0 0 0) 0x7fa5940d0920 con 0x7fa59415ef80 2024-09-19T09:18:55.081 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:55.081 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":42,"btime":"2024-09-19T09:18:26:440614+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5944,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/935732637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":935732637},{"type":"v1","addr":"172.21.15.162:6836","nonce":935732637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6192,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3186899169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":3186899169},{"type":"v1","addr":"172.21.15.18:6835","nonce":3186899169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6195,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/3889971648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3889971648},{"type":"v1","addr":"172.21.15.18:6834","nonce":3889971648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:18:23.782156+0000","modified":"2024-09-19T09:18:25.789778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"d","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6837/133611430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":133611430},{"type":"v1","addr":"172.21.15.162:6837","nonce":133611430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6207,"qdb_cluster":[6207]},"id":6}]} 2024-09-19T09:18:55.082 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 42 2024-09-19T09:18:55.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.082+0000 7fa59bb0a640 1 -- 172.21.15.18:0/2642495651 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa58006c2e0 msgr2=0x7fa58006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:55.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.082+0000 7fa59bb0a640 1 --2- 172.21.15.18:0/2642495651 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa58006c2e0 0x7fa58006e7a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa584011340 tx=0x7fa58400b040 comp rx=0 tx=0).stop 2024-09-19T09:18:55.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.082+0000 7fa59bb0a640 1 -- 172.21.15.18:0/2642495651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa59415ef80 msgr2=0x7fa5940cc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:55.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.082+0000 7fa59bb0a640 1 --2- 172.21.15.18:0/2642495651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa59415ef80 0x7fa5940cc220 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fa58c00c400 tx=0x7fa58c00c8c0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.082+0000 7fa59bb0a640 1 -- 172.21.15.18:0/2642495651 shutdown_connections 2024-09-19T09:18:55.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.082+0000 7fa59bb0a640 1 --2- 172.21.15.18:0/2642495651 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa58006c2e0 0x7fa58006e7a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.082+0000 7fa59bb0a640 1 --2- 172.21.15.18:0/2642495651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa59415ef80 0x7fa5940cc220 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.082+0000 7fa59bb0a640 1 --2- 172.21.15.18:0/2642495651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa5940cf910 0x7fa5940b8110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.082+0000 7fa59bb0a640 1 --2- 172.21.15.18:0/2642495651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa59406d730 0x7fa5941579c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.082+0000 7fa59bb0a640 1 -- 172.21.15.18:0/2642495651 >> 172.21.15.18:0/2642495651 conn(0x7fa5940b4700 msgr2=0x7fa5940d0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:55.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.082+0000 7fa59bb0a640 1 -- 172.21.15.18:0/2642495651 shutdown_connections 2024-09-19T09:18:55.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.082+0000 7fa59bb0a640 1 -- 172.21.15.18:0/2642495651 wait complete. 2024-09-19T09:18:55.094 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:18:55.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.196+0000 7f091ea8d640 1 Processor -- start 2024-09-19T09:18:55.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.196+0000 7f091ea8d640 1 -- start start 2024-09-19T09:18:55.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.197+0000 7f091ea8d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f091813fae0 0x7f091806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:55.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.197+0000 7f091ea8d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0918160c50 0x7f09180cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:55.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.197+0000 7f091ea8d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0918142650 con 0x7f0918142150 2024-09-19T09:18:55.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.197+0000 7f091ea8d640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f09180ce780 con 0x7f091813fae0 2024-09-19T09:18:55.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.197+0000 7f091ea8d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0918142930 con 0x7f0918160c50 2024-09-19T09:18:55.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.197+0000 7f091c829640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f091813fae0 0x7f091806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:55.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.197+0000 7f091c829640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f091813fae0 0x7f091806f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36734/0 (socket says 172.21.15.18:36734) 2024-09-19T09:18:55.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.197+0000 7f091c829640 1 -- 172.21.15.18:0/2681905813 learned_addr learned my addr 172.21.15.18:0/2681905813 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:55.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.197+0000 7f091d02a640 1 --2- 172.21.15.18:0/2681905813 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0918160c50 0x7f09180cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:55.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.197+0000 7f091c829640 1 -- 172.21.15.18:0/2681905813 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0918160c50 msgr2=0x7f09180cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:55.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.197+0000 7f091c829640 1 --2- 172.21.15.18:0/2681905813 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0918160c50 0x7f09180cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.197+0000 7f091c829640 1 -- 172.21.15.18:0/2681905813 >> v1:172.21.15.162:6789/0 conn(0x7f0918142150 legacy=0x7f0918160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:55.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.197+0000 7f091c829640 1 -- 172.21.15.18:0/2681905813 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0918142c10 con 0x7f091813fae0 2024-09-19T09:18:55.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.198+0000 7f091c829640 1 --2- 172.21.15.18:0/2681905813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f091813fae0 0x7f091806f1b0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f090c009870 tx=0x7f090c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c331bc685fcd06c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:55.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.198+0000 7f09177fe640 1 -- 172.21.15.18:0/2681905813 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f090c037070 con 0x7f091813fae0 2024-09-19T09:18:55.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.198+0000 7f09177fe640 1 -- 172.21.15.18:0/2681905813 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f090c032440 con 0x7f091813fae0 2024-09-19T09:18:55.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.198+0000 7f09177fe640 1 -- 172.21.15.18:0/2681905813 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f090c032810 con 0x7f091813fae0 2024-09-19T09:18:55.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.198+0000 7f091ea8d640 1 -- 172.21.15.18:0/2681905813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f091813fae0 msgr2=0x7f091806f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:55.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.198+0000 7f091ea8d640 1 --2- 172.21.15.18:0/2681905813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f091813fae0 0x7f091806f1b0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f090c009870 tx=0x7f090c02a1c0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.199+0000 7f091ea8d640 1 -- 172.21.15.18:0/2681905813 shutdown_connections 2024-09-19T09:18:55.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.199+0000 7f091ea8d640 1 --2- 172.21.15.18:0/2681905813 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0918160c50 0x7f09180cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.199+0000 7f091ea8d640 1 --2- 172.21.15.18:0/2681905813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f091813fae0 0x7f091806f1b0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.199+0000 7f091ea8d640 1 -- 172.21.15.18:0/2681905813 >> 172.21.15.18:0/2681905813 conn(0x7f091806bc10 msgr2=0x7f091806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:55.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.199+0000 7f091ea8d640 1 -- 172.21.15.18:0/2681905813 shutdown_connections 2024-09-19T09:18:55.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.199+0000 7f091ea8d640 1 -- 172.21.15.18:0/2681905813 wait complete. 2024-09-19T09:18:55.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.200+0000 7f091ea8d640 1 Processor -- start 2024-09-19T09:18:55.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.200+0000 7f091ea8d640 1 -- start start 2024-09-19T09:18:55.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.201+0000 7f091ea8d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f091813fae0 0x7f09181f5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:55.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.201+0000 7f091ea8d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0918142150 0x7f0918144650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:55.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.201+0000 7f091ea8d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0918160c50 0x7f091815f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:55.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.201+0000 7f091ea8d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f091806f870 con 0x7f0918160c50 2024-09-19T09:18:55.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.201+0000 7f091ea8d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f091806f6f0 con 0x7f091813fae0 2024-09-19T09:18:55.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.201+0000 7f091ea8d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f09180cf150 con 0x7f0918142150 2024-09-19T09:18:55.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.201+0000 7f091d02a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0918160c50 0x7f091815f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:55.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.201+0000 7f091d02a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0918160c50 0x7f091815f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36744/0 (socket says 172.21.15.18:36744) 2024-09-19T09:18:55.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.201+0000 7f091d02a640 1 -- 172.21.15.18:0/3568648747 learned_addr learned my addr 172.21.15.18:0/3568648747 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:55.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.201+0000 7f091c829640 1 --2- 172.21.15.18:0/3568648747 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f091813fae0 0x7f09181f5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:55.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.201+0000 7f0917fff640 1 --2- 172.21.15.18:0/3568648747 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0918142150 0x7f0918144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:55.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.201+0000 7f091d02a640 1 -- 172.21.15.18:0/3568648747 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0918142150 msgr2=0x7f0918144650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:55.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.201+0000 7f091d02a640 1 --2- 172.21.15.18:0/3568648747 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0918142150 0x7f0918144650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.201+0000 7f091d02a640 1 -- 172.21.15.18:0/3568648747 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f091813fae0 msgr2=0x7f09181f5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:55.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.201+0000 7f091d02a640 1 --2- 172.21.15.18:0/3568648747 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f091813fae0 0x7f09181f5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.201+0000 7f091d02a640 1 -- 172.21.15.18:0/3568648747 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0918144f60 con 0x7f0918160c50 2024-09-19T09:18:55.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.201+0000 7f091d02a640 1 --2- 172.21.15.18:0/3568648747 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0918160c50 0x7f091815f2a0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f0910007d40 tx=0x7f091000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:55.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.201+0000 7f09157fa640 1 -- 172.21.15.18:0/3568648747 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0910014420 con 0x7f0918160c50 2024-09-19T09:18:55.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.201+0000 7f09157fa640 1 -- 172.21.15.18:0/3568648747 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0910019070 con 0x7f0918160c50 2024-09-19T09:18:55.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.201+0000 7f09157fa640 1 -- 172.21.15.18:0/3568648747 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0910014820 con 0x7f0918160c50 2024-09-19T09:18:55.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.201+0000 7f091ea8d640 1 -- 172.21.15.18:0/3568648747 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0918145240 con 0x7f0918160c50 2024-09-19T09:18:55.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.201+0000 7f091ea8d640 1 -- 172.21.15.18:0/3568648747 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0918145800 con 0x7f0918160c50 2024-09-19T09:18:55.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.202+0000 7f091ea8d640 1 -- 172.21.15.18:0/3568648747 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f091806f1b0 con 0x7f0918160c50 2024-09-19T09:18:55.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.203+0000 7f09157fa640 1 -- 172.21.15.18:0/3568648747 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f09100149c0 con 0x7f0918160c50 2024-09-19T09:18:55.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.203+0000 7f09157fa640 1 --2- 172.21.15.18:0/3568648747 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f08fc06c2e0 0x7f08fc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:55.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.203+0000 7f09157fa640 1 -- 172.21.15.18:0/3568648747 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7f091008b970 con 0x7f0918160c50 2024-09-19T09:18:55.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.204+0000 7f091c829640 1 --2- 172.21.15.18:0/3568648747 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f08fc06c2e0 0x7f08fc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:55.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.204+0000 7f091c829640 1 --2- 172.21.15.18:0/3568648747 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f08fc06c2e0 0x7f08fc06e7a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f090c034000 tx=0x7f090c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:55.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.208+0000 7f09157fa640 1 -- 172.21.15.18:0/3568648747 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0910059b20 con 0x7f0918160c50 2024-09-19T09:18:55.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.384+0000 7f091ea8d640 1 -- 172.21.15.18:0/3568648747 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f09180b0d20 con 0x7f0918160c50 2024-09-19T09:18:55.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.385+0000 7f09157fa640 1 -- 172.21.15.18:0/3568648747 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) ==== 74+0+16756 (secure 0 0 0) 0x7f091005de20 con 0x7f0918160c50 2024-09-19T09:18:55.386 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:55.386 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":111,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:18:47.746338+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:18:21.441414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-19T09:18:22.767737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:18:55.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.387+0000 7f091ea8d640 1 -- 172.21.15.18:0/3568648747 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f08fc06c2e0 msgr2=0x7f08fc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:55.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.387+0000 7f091ea8d640 1 --2- 172.21.15.18:0/3568648747 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f08fc06c2e0 0x7f08fc06e7a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f090c034000 tx=0x7f090c02e000 comp rx=0 tx=0).stop 2024-09-19T09:18:55.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.387+0000 7f091ea8d640 1 -- 172.21.15.18:0/3568648747 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0918160c50 msgr2=0x7f091815f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:55.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.387+0000 7f091ea8d640 1 --2- 172.21.15.18:0/3568648747 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0918160c50 0x7f091815f2a0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f0910007d40 tx=0x7f091000e4b0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.387+0000 7f091ea8d640 1 -- 172.21.15.18:0/3568648747 shutdown_connections 2024-09-19T09:18:55.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.387+0000 7f091ea8d640 1 --2- 172.21.15.18:0/3568648747 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f08fc06c2e0 0x7f08fc06e7a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.387+0000 7f091ea8d640 1 --2- 172.21.15.18:0/3568648747 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0918160c50 0x7f091815f2a0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.387+0000 7f091ea8d640 1 --2- 172.21.15.18:0/3568648747 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0918142150 0x7f0918144650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.387+0000 7f091ea8d640 1 --2- 172.21.15.18:0/3568648747 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f091813fae0 0x7f09181f5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.387+0000 7f091ea8d640 1 -- 172.21.15.18:0/3568648747 >> 172.21.15.18:0/3568648747 conn(0x7f091806bc10 msgr2=0x7f09180cf580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:55.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.387+0000 7f091ea8d640 1 -- 172.21.15.18:0/3568648747 shutdown_connections 2024-09-19T09:18:55.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.387+0000 7f091ea8d640 1 -- 172.21.15.18:0/3568648747 wait complete. 2024-09-19T09:18:55.399 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T09:18:55.399 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:18:55.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.502+0000 7fe6a876f640 1 Processor -- start 2024-09-19T09:18:55.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.502+0000 7fe6a876f640 1 -- start start 2024-09-19T09:18:55.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.503+0000 7fe6a876f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6a00cfae0 0x7fe6a00b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:55.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.503+0000 7fe6a876f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe6a006d730 0x7fe6a00cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:55.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.503+0000 7fe6a876f640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6a00cd1a0 con 0x7fe6a015ef80 2024-09-19T09:18:55.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.503+0000 7fe6a876f640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe6a00cd7d0 con 0x7fe6a006d730 2024-09-19T09:18:55.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.503+0000 7fe6a876f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe6a006dc30 con 0x7fe6a00cfae0 2024-09-19T09:18:55.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.503+0000 7fe6a650b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe6a015ef80 0x7fe6a00cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:45910/0 (socket says 172.21.15.18:45910) 2024-09-19T09:18:55.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.503+0000 7fe6a650b640 1 -- 172.21.15.18:0/1605922138 learned_addr learned my addr 172.21.15.18:0/1605922138 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:55.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.504+0000 7fe6a6d0c640 1 --2- 172.21.15.18:0/1605922138 >> v2:172.21.15.162:3300/0 conn(0x7fe6a006d730 0x7fe6a00cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:55.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.504+0000 7fe6a5509640 1 -- 172.21.15.18:0/1605922138 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2433712046 0 0) 0x7fe6a00cd1a0 con 0x7fe6a015ef80 2024-09-19T09:18:55.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.504+0000 7fe6a5d0a640 1 --2- 172.21.15.18:0/1605922138 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6a00cfae0 0x7fe6a00b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:55.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.504+0000 7fe6a5509640 1 -- 172.21.15.18:0/1605922138 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe688003520 con 0x7fe6a015ef80 2024-09-19T09:18:55.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.504+0000 7fe6a5509640 1 -- 172.21.15.18:0/1605922138 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2699800534 0 0) 0x7fe688003520 con 0x7fe6a015ef80 2024-09-19T09:18:55.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.504+0000 7fe6a5509640 1 -- 172.21.15.18:0/1605922138 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6a00cfae0 msgr2=0x7fe6a00b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:55.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.504+0000 7fe6a5509640 1 --2- 172.21.15.18:0/1605922138 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6a00cfae0 0x7fe6a00b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.504+0000 7fe6a5509640 1 -- 172.21.15.18:0/1605922138 >> v2:172.21.15.162:3300/0 conn(0x7fe6a006d730 msgr2=0x7fe6a00cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:55.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.504+0000 7fe6a5509640 1 --2- 172.21.15.18:0/1605922138 >> v2:172.21.15.162:3300/0 conn(0x7fe6a006d730 0x7fe6a00cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.504+0000 7fe6a5509640 1 -- 172.21.15.18:0/1605922138 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a006df10 con 0x7fe6a015ef80 2024-09-19T09:18:55.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.504+0000 7fe6a5509640 1 -- 172.21.15.18:0/1605922138 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fe6900019f0 con 0x7fe6a015ef80 2024-09-19T09:18:55.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.504+0000 7fe6a5d0a640 1 --2- 172.21.15.18:0/1605922138 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6a00cfae0 0x7fe6a00b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:55.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.504+0000 7fe6a5509640 1 -- 172.21.15.18:0/1605922138 >> v1:172.21.15.18:6789/0 conn(0x7fe6a015ef80 legacy=0x7fe6a00cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:55.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.504+0000 7fe6a5509640 1 --2- 172.21.15.18:0/1605922138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6880039b0 0x7fe688003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:55.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.504+0000 7fe6a5509640 1 --2- 172.21.15.18:0/1605922138 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6a00cfae0 0x7fe688004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:55.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.504+0000 7fe6a5509640 1 --2- 172.21.15.18:0/1605922138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe688004d40 0x7fe6880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:55.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.504+0000 7fe6a5509640 1 -- 172.21.15.18:0/1605922138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a00cd7d0 con 0x7fe6880039b0 2024-09-19T09:18:55.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.504+0000 7fe6a5509640 1 -- 172.21.15.18:0/1605922138 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a006dc30 con 0x7fe688004d40 2024-09-19T09:18:55.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.504+0000 7fe6a5509640 1 -- 172.21.15.18:0/1605922138 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe68800ba70 con 0x7fe6a00cfae0 2024-09-19T09:18:55.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.504+0000 7fe6a650b640 1 --2- 172.21.15.18:0/1605922138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6880039b0 0x7fe688003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:55.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.504+0000 7fe6a5d0a640 1 --2- 172.21.15.18:0/1605922138 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6a00cfae0 0x7fe688004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:55.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.504+0000 7fe6a6d0c640 1 --2- 172.21.15.18:0/1605922138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe688004d40 0x7fe6880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:55.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.504+0000 7fe6a650b640 1 -- 172.21.15.18:0/1605922138 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6a00cfae0 msgr2=0x7fe688004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:55.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.504+0000 7fe6a650b640 1 --2- 172.21.15.18:0/1605922138 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6a00cfae0 0x7fe688004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.504+0000 7fe6a650b640 1 -- 172.21.15.18:0/1605922138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe688004d40 msgr2=0x7fe6880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:55.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.504+0000 7fe6a650b640 1 --2- 172.21.15.18:0/1605922138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe688004d40 0x7fe6880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.504+0000 7fe6a650b640 1 -- 172.21.15.18:0/1605922138 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe688003520 con 0x7fe6880039b0 2024-09-19T09:18:55.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.504+0000 7fe6a6d0c640 1 --2- 172.21.15.18:0/1605922138 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe688004d40 0x7fe6880051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:55.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.505+0000 7fe6a650b640 1 --2- 172.21.15.18:0/1605922138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6880039b0 0x7fe688003dd0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fe69000a8a0 tx=0x7fe688005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=541247dc280fb66d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:55.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.505+0000 7fe6a5509640 1 -- 172.21.15.18:0/1605922138 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69000a4c0 con 0x7fe6880039b0 2024-09-19T09:18:55.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.505+0000 7fe6a5509640 1 -- 172.21.15.18:0/1605922138 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe69002f070 con 0x7fe6880039b0 2024-09-19T09:18:55.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.505+0000 7fe6a5509640 1 -- 172.21.15.18:0/1605922138 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69002bd30 con 0x7fe6880039b0 2024-09-19T09:18:55.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.506+0000 7fe6a876f640 1 -- 172.21.15.18:0/1605922138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6880039b0 msgr2=0x7fe688003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:55.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.506+0000 7fe6a876f640 1 --2- 172.21.15.18:0/1605922138 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6880039b0 0x7fe688003dd0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fe69000a8a0 tx=0x7fe688005830 comp rx=0 tx=0).stop 2024-09-19T09:18:55.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.506+0000 7fe6a6d0c640 1 -- 172.21.15.18:0/1605922138 reap_dead start 2024-09-19T09:18:55.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.506+0000 7fe6a876f640 1 -- 172.21.15.18:0/1605922138 shutdown_connections 2024-09-19T09:18:55.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.506+0000 7fe6a876f640 1 -- 172.21.15.18:0/1605922138 >> 172.21.15.18:0/1605922138 conn(0x7fe6a00b4700 msgr2=0x7fe6a00b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:55.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.506+0000 7fe6a876f640 1 -- 172.21.15.18:0/1605922138 shutdown_connections 2024-09-19T09:18:55.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.506+0000 7fe6a876f640 1 -- 172.21.15.18:0/1605922138 wait complete. 2024-09-19T09:18:55.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.507+0000 7fe6a876f640 1 Processor -- start 2024-09-19T09:18:55.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.507+0000 7fe6a876f640 1 -- start start 2024-09-19T09:18:55.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.508+0000 7fe6a876f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6880039b0 0x7fe6a01581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:55.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.508+0000 7fe6a876f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6a00c9c20 0x7fe6a00cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:55.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.508+0000 7fe6a876f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6a00c8ab0 0x7fe6a00c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:55.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.508+0000 7fe6a876f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a00d0120 con 0x7fe6880039b0 2024-09-19T09:18:55.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.508+0000 7fe6a876f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a015f360 con 0x7fe6a00c8ab0 2024-09-19T09:18:55.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.508+0000 7fe6a876f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe6a00b5220 con 0x7fe6a00c9c20 2024-09-19T09:18:55.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.508+0000 7fe6a650b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6880039b0 0x7fe6a01581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:55.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.508+0000 7fe6a650b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6880039b0 0x7fe6a01581d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53240/0 (socket says 172.21.15.18:53240) 2024-09-19T09:18:55.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.508+0000 7fe6a650b640 1 -- 172.21.15.18:0/3609399087 learned_addr learned my addr 172.21.15.18:0/3609399087 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:55.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.508+0000 7fe6a5d0a640 1 --2- 172.21.15.18:0/3609399087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6a00c9c20 0x7fe6a00cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:55.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.508+0000 7fe6a6d0c640 1 --2- 172.21.15.18:0/3609399087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6a00c8ab0 0x7fe6a00c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:55.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.508+0000 7fe6a650b640 1 -- 172.21.15.18:0/3609399087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6a00c9c20 msgr2=0x7fe6a00cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:55.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.508+0000 7fe6a650b640 1 --2- 172.21.15.18:0/3609399087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6a00c9c20 0x7fe6a00cc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.508+0000 7fe6a650b640 1 -- 172.21.15.18:0/3609399087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6a00c8ab0 msgr2=0x7fe6a00c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:55.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.508+0000 7fe6a650b640 1 --2- 172.21.15.18:0/3609399087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6a00c8ab0 0x7fe6a00c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.508+0000 7fe6a650b640 1 -- 172.21.15.18:0/3609399087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a00cc810 con 0x7fe6880039b0 2024-09-19T09:18:55.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.508+0000 7fe6a6d0c640 1 --2- 172.21.15.18:0/3609399087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6a00c8ab0 0x7fe6a00c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:55.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.509+0000 7fe6a650b640 1 --2- 172.21.15.18:0/3609399087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6880039b0 0x7fe6a01581d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fe69000a8a0 tx=0x7fe690001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:55.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.509+0000 7fe69effd640 1 -- 172.21.15.18:0/3609399087 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69002c960 con 0x7fe6880039b0 2024-09-19T09:18:55.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.509+0000 7fe69effd640 1 -- 172.21.15.18:0/3609399087 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe69002cb00 con 0x7fe6880039b0 2024-09-19T09:18:55.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.509+0000 7fe6a876f640 1 -- 172.21.15.18:0/3609399087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6a00ccaf0 con 0x7fe6880039b0 2024-09-19T09:18:55.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.509+0000 7fe69effd640 1 -- 172.21.15.18:0/3609399087 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe690034470 con 0x7fe6880039b0 2024-09-19T09:18:55.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.509+0000 7fe6a876f640 1 -- 172.21.15.18:0/3609399087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6a00ccdd0 con 0x7fe6880039b0 2024-09-19T09:18:55.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.510+0000 7fe6a876f640 1 -- 172.21.15.18:0/3609399087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6a00cf3d0 con 0x7fe6880039b0 2024-09-19T09:18:55.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.510+0000 7fe69effd640 1 -- 172.21.15.18:0/3609399087 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe690034610 con 0x7fe6880039b0 2024-09-19T09:18:55.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.511+0000 7fe69effd640 1 --2- 172.21.15.18:0/3609399087 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe68c06c2b0 0x7fe68c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:55.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.511+0000 7fe69effd640 1 -- 172.21.15.18:0/3609399087 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7fe6900ab940 con 0x7fe6880039b0 2024-09-19T09:18:55.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.511+0000 7fe6a5d0a640 1 --2- 172.21.15.18:0/3609399087 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe68c06c2b0 0x7fe68c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:55.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.512+0000 7fe6a5d0a640 1 --2- 172.21.15.18:0/3609399087 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe68c06c2b0 0x7fe68c06e770 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe6a015dc60 tx=0x7fe694008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:55.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.515+0000 7fe69effd640 1 -- 172.21.15.18:0/3609399087 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe69007a0b0 con 0x7fe6880039b0 2024-09-19T09:18:55.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.728+0000 7fe6a876f640 1 -- 172.21.15.18:0/3609399087 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe6a00cff00 con 0x7fe6880039b0 2024-09-19T09:18:55.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.728+0000 7fe69effd640 1 -- 172.21.15.18:0/3609399087 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5225 (secure 0 0 0) 0x7fe6900799b0 con 0x7fe6880039b0 2024-09-19T09:18:55.729 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:55.729 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":42,"btime":"2024-09-19T09:18:26:440614+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5944,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/935732637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":935732637},{"type":"v1","addr":"172.21.15.162:6836","nonce":935732637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6192,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3186899169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":3186899169},{"type":"v1","addr":"172.21.15.18:6835","nonce":3186899169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6195,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/3889971648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3889971648},{"type":"v1","addr":"172.21.15.18:6834","nonce":3889971648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:18:23.782156+0000","modified":"2024-09-19T09:18:25.789778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"d","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6837/133611430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":133611430},{"type":"v1","addr":"172.21.15.162:6837","nonce":133611430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6207,"qdb_cluster":[6207]},"id":6}]} 2024-09-19T09:18:55.729 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 42 2024-09-19T09:18:55.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.730+0000 7fe6a876f640 1 -- 172.21.15.18:0/3609399087 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe68c06c2b0 msgr2=0x7fe68c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:55.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.730+0000 7fe6a876f640 1 --2- 172.21.15.18:0/3609399087 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe68c06c2b0 0x7fe68c06e770 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe6a015dc60 tx=0x7fe694008040 comp rx=0 tx=0).stop 2024-09-19T09:18:55.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.730+0000 7fe6a876f640 1 -- 172.21.15.18:0/3609399087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6880039b0 msgr2=0x7fe6a01581d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:55.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.730+0000 7fe6a876f640 1 --2- 172.21.15.18:0/3609399087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6880039b0 0x7fe6a01581d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fe69000a8a0 tx=0x7fe690001dc0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.730+0000 7fe6a876f640 1 -- 172.21.15.18:0/3609399087 shutdown_connections 2024-09-19T09:18:55.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.730+0000 7fe6a876f640 1 --2- 172.21.15.18:0/3609399087 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe68c06c2b0 0x7fe68c06e770 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.730+0000 7fe6a876f640 1 --2- 172.21.15.18:0/3609399087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe6a00c8ab0 0x7fe6a00c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.730+0000 7fe6a876f640 1 --2- 172.21.15.18:0/3609399087 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe6a00c9c20 0x7fe6a00cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.730+0000 7fe6a876f640 1 --2- 172.21.15.18:0/3609399087 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe6880039b0 0x7fe6a01581d0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.730+0000 7fe6a876f640 1 -- 172.21.15.18:0/3609399087 >> 172.21.15.18:0/3609399087 conn(0x7fe6a00b4700 msgr2=0x7fe6a0161b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:55.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.731+0000 7fe6a876f640 1 -- 172.21.15.18:0/3609399087 shutdown_connections 2024-09-19T09:18:55.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.731+0000 7fe6a876f640 1 -- 172.21.15.18:0/3609399087 wait complete. 2024-09-19T09:18:55.742 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:18:55.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.843+0000 7f425b094640 1 Processor -- start 2024-09-19T09:18:55.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.843+0000 7f425b094640 1 -- start start 2024-09-19T09:18:55.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.844+0000 7f425b094640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f425415ef80 0x7f42540b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:55.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.844+0000 7f425b094640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f425406d730 0x7f42540cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:55.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.844+0000 7f425b094640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42540cf910 0x7f42540d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:55.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.844+0000 7f425b094640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f42540cd7d0 con 0x7f425415ef80 2024-09-19T09:18:55.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.844+0000 7f425b094640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f42540cd1a0 con 0x7f425406d730 2024-09-19T09:18:55.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.844+0000 7f425b094640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f425406dc30 con 0x7f42540cf910 2024-09-19T09:18:55.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.844+0000 7f4258e30640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f425415ef80 0x7f42540b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:55.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.844+0000 7f4258e30640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f425415ef80 0x7f42540b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53246/0 (socket says 172.21.15.18:53246) 2024-09-19T09:18:55.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.844+0000 7f4258e30640 1 -- 172.21.15.18:0/2021602673 learned_addr learned my addr 172.21.15.18:0/2021602673 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:55.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.845+0000 7f4258e30640 1 -- 172.21.15.18:0/2021602673 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42540cf910 msgr2=0x7f42540d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:55.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.845+0000 7f4258e30640 1 --2- 172.21.15.18:0/2021602673 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42540cf910 0x7f42540d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.845+0000 7f4258e30640 1 -- 172.21.15.18:0/2021602673 >> v2:172.21.15.162:3300/0 conn(0x7f425406d730 msgr2=0x7f42540cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:55.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.845+0000 7f4258e30640 1 --2- 172.21.15.18:0/2021602673 >> v2:172.21.15.162:3300/0 conn(0x7f425406d730 0x7f42540cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.845+0000 7f4258e30640 1 -- 172.21.15.18:0/2021602673 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f425406df10 con 0x7f425415ef80 2024-09-19T09:18:55.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.845+0000 7f4258e30640 1 --2- 172.21.15.18:0/2021602673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f425415ef80 0x7f42540b5220 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f42540b57c0 tx=0x7f424c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1d49bad33225133 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:55.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.845+0000 7f42537fe640 1 -- 172.21.15.18:0/2021602673 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c036070 con 0x7f425415ef80 2024-09-19T09:18:55.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.845+0000 7f42537fe640 1 -- 172.21.15.18:0/2021602673 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f424c031600 con 0x7f425415ef80 2024-09-19T09:18:55.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.845+0000 7f42537fe640 1 -- 172.21.15.18:0/2021602673 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f424c0319d0 con 0x7f425415ef80 2024-09-19T09:18:55.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.846+0000 7f425b094640 1 -- 172.21.15.18:0/2021602673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f425415ef80 msgr2=0x7f42540b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:55.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.846+0000 7f425b094640 1 --2- 172.21.15.18:0/2021602673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f425415ef80 0x7f42540b5220 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f42540b57c0 tx=0x7f424c02a6a0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.846+0000 7f425b094640 1 -- 172.21.15.18:0/2021602673 shutdown_connections 2024-09-19T09:18:55.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.846+0000 7f425b094640 1 --2- 172.21.15.18:0/2021602673 >> v2:172.21.15.162:3300/0 conn(0x7f425406d730 0x7f42540cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.846+0000 7f425b094640 1 --2- 172.21.15.18:0/2021602673 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f42540cf910 0x7f42540d0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.846+0000 7f425b094640 1 --2- 172.21.15.18:0/2021602673 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f425415ef80 0x7f42540b5220 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.846+0000 7f425b094640 1 -- 172.21.15.18:0/2021602673 >> 172.21.15.18:0/2021602673 conn(0x7f42540b4700 msgr2=0x7f42540b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:55.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.846+0000 7f425b094640 1 -- 172.21.15.18:0/2021602673 shutdown_connections 2024-09-19T09:18:55.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.846+0000 7f425b094640 1 -- 172.21.15.18:0/2021602673 wait complete. 2024-09-19T09:18:55.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.847+0000 7f425b094640 1 Processor -- start 2024-09-19T09:18:55.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.847+0000 7f425b094640 1 -- start start 2024-09-19T09:18:55.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.848+0000 7f425b094640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f425406d730 0x7f4254156240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:55.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.848+0000 7f425b094640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42540cf910 0x7f42540c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:55.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.848+0000 7f425b094640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f425415ef80 0x7f42540b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:55.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.848+0000 7f425b094640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f42540d0120 con 0x7f425415ef80 2024-09-19T09:18:55.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.848+0000 7f425b094640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f425415f360 con 0x7f42540cf910 2024-09-19T09:18:55.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.848+0000 7f425b094640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f42540d1220 con 0x7f425406d730 2024-09-19T09:18:55.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.848+0000 7f4259631640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f425415ef80 0x7f42540b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:55.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.848+0000 7f4259631640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f425415ef80 0x7f42540b5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53254/0 (socket says 172.21.15.18:53254) 2024-09-19T09:18:55.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.848+0000 7f4259631640 1 -- 172.21.15.18:0/1178696795 learned_addr learned my addr 172.21.15.18:0/1178696795 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:55.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.848+0000 7f4258e30640 1 --2- 172.21.15.18:0/1178696795 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f425406d730 0x7f4254156240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:55.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.848+0000 7f4253fff640 1 --2- 172.21.15.18:0/1178696795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42540cf910 0x7f42540c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:55.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.849+0000 7f4259631640 1 -- 172.21.15.18:0/1178696795 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f425406d730 msgr2=0x7f4254156240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:55.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.849+0000 7f4259631640 1 --2- 172.21.15.18:0/1178696795 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f425406d730 0x7f4254156240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.849+0000 7f4259631640 1 -- 172.21.15.18:0/1178696795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42540cf910 msgr2=0x7f42540c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:55.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.849+0000 7f4259631640 1 --2- 172.21.15.18:0/1178696795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42540cf910 0x7f42540c86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:55.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.849+0000 7f4259631640 1 -- 172.21.15.18:0/1178696795 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42540c78e0 con 0x7f425415ef80 2024-09-19T09:18:55.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.849+0000 7f4259631640 1 --2- 172.21.15.18:0/1178696795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f425415ef80 0x7f42540b5a00 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f4244009fd0 tx=0x7f424400b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:55.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.849+0000 7f42517fa640 1 -- 172.21.15.18:0/1178696795 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4244015020 con 0x7f425415ef80 2024-09-19T09:18:55.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.849+0000 7f42517fa640 1 -- 172.21.15.18:0/1178696795 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4244011830 con 0x7f425415ef80 2024-09-19T09:18:55.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.849+0000 7f425b094640 1 -- 172.21.15.18:0/1178696795 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42540c7bc0 con 0x7f425415ef80 2024-09-19T09:18:55.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.849+0000 7f42517fa640 1 -- 172.21.15.18:0/1178696795 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4244011c00 con 0x7f425415ef80 2024-09-19T09:18:55.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.849+0000 7f425b094640 1 -- 172.21.15.18:0/1178696795 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42540c8180 con 0x7f425415ef80 2024-09-19T09:18:55.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.850+0000 7f425b094640 1 -- 172.21.15.18:0/1178696795 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42540d0ce0 con 0x7f425415ef80 2024-09-19T09:18:55.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.851+0000 7f42517fa640 1 -- 172.21.15.18:0/1178696795 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4244018020 con 0x7f425415ef80 2024-09-19T09:18:55.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.851+0000 7f42517fa640 1 --2- 172.21.15.18:0/1178696795 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f424006c2e0 0x7f424006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:55.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.851+0000 7f42517fa640 1 -- 172.21.15.18:0/1178696795 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7f424408b1a0 con 0x7f425415ef80 2024-09-19T09:18:55.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.851+0000 7f4258e30640 1 --2- 172.21.15.18:0/1178696795 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f424006c2e0 0x7f424006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:55.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.852+0000 7f4258e30640 1 --2- 172.21.15.18:0/1178696795 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f424006c2e0 0x7f424006e7a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f424c033000 tx=0x7f424c009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:55.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:55.855+0000 7f42517fa640 1 -- 172.21.15.18:0/1178696795 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f424401f020 con 0x7f425415ef80 2024-09-19T09:18:56.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.066+0000 7f425b094640 1 -- 172.21.15.18:0/1178696795 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42540cff00 con 0x7f425415ef80 2024-09-19T09:18:56.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.066+0000 7f42517fa640 1 -- 172.21.15.18:0/1178696795 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+5225 (secure 0 0 0) 0x7f42440599a0 con 0x7f425415ef80 2024-09-19T09:18:56.068 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:56.068 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":42,"btime":"2024-09-19T09:18:26:440614+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5944,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/935732637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":935732637},{"type":"v1","addr":"172.21.15.162:6836","nonce":935732637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6192,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3186899169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":3186899169},{"type":"v1","addr":"172.21.15.18:6835","nonce":3186899169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6195,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/3889971648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3889971648},{"type":"v1","addr":"172.21.15.18:6834","nonce":3889971648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:18:23.782156+0000","modified":"2024-09-19T09:18:25.789778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6207":{"gid":6207,"name":"d","rank":0,"incarnation":40,"state":"up:active","state_seq":3,"addr":"172.21.15.162:6837/133611430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":133611430},{"type":"v1","addr":"172.21.15.162:6837","nonce":133611430}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6207,"qdb_cluster":[6207]},"id":6}]} 2024-09-19T09:18:56.069 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 42 2024-09-19T09:18:56.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.068+0000 7f425b094640 1 -- 172.21.15.18:0/1178696795 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f424006c2e0 msgr2=0x7f424006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:56.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.068+0000 7f425b094640 1 --2- 172.21.15.18:0/1178696795 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f424006c2e0 0x7f424006e7a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f424c033000 tx=0x7f424c009000 comp rx=0 tx=0).stop 2024-09-19T09:18:56.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.068+0000 7f425b094640 1 -- 172.21.15.18:0/1178696795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f425415ef80 msgr2=0x7f42540b5a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:56.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.068+0000 7f425b094640 1 --2- 172.21.15.18:0/1178696795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f425415ef80 0x7f42540b5a00 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f4244009fd0 tx=0x7f424400b820 comp rx=0 tx=0).stop 2024-09-19T09:18:56.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.068+0000 7f425b094640 1 -- 172.21.15.18:0/1178696795 shutdown_connections 2024-09-19T09:18:56.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.068+0000 7f425b094640 1 --2- 172.21.15.18:0/1178696795 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f424006c2e0 0x7f424006e7a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:56.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.068+0000 7f425b094640 1 --2- 172.21.15.18:0/1178696795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f425415ef80 0x7f42540b5a00 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:56.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.068+0000 7f425b094640 1 --2- 172.21.15.18:0/1178696795 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42540cf910 0x7f42540c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:56.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.068+0000 7f425b094640 1 --2- 172.21.15.18:0/1178696795 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f425406d730 0x7f4254156240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:56.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.068+0000 7f425b094640 1 -- 172.21.15.18:0/1178696795 >> 172.21.15.18:0/1178696795 conn(0x7f42540b4700 msgr2=0x7f425406cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:56.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.068+0000 7f425b094640 1 -- 172.21.15.18:0/1178696795 shutdown_connections 2024-09-19T09:18:56.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.068+0000 7f425b094640 1 -- 172.21.15.18:0/1178696795 wait complete. 2024-09-19T09:18:56.080 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:18:56.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.181+0000 7fddfde27640 1 Processor -- start 2024-09-19T09:18:56.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.181+0000 7fddfde27640 1 -- start start 2024-09-19T09:18:56.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.182+0000 7fddfde27640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fddf80b5160 0x7fddf8070620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:56.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.182+0000 7fddfde27640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fddf80d1660 0x7fddf8160650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:56.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.182+0000 7fddfde27640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddf80d1f00 con 0x7fddf8162850 2024-09-19T09:18:56.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.182+0000 7fddfde27640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fddf806f860 con 0x7fddf80d1660 2024-09-19T09:18:56.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.182+0000 7fddfde27640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fddf806fb40 con 0x7fddf80b5160 2024-09-19T09:18:56.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.182+0000 7fddf7fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fddf80d1660 0x7fddf8160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:56.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.182+0000 7fddf7fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fddf80d1660 0x7fddf8160650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53258/0 (socket says 172.21.15.18:53258) 2024-09-19T09:18:56.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.182+0000 7fddf7fff640 1 -- 172.21.15.18:0/1795823065 learned_addr learned my addr 172.21.15.18:0/1795823065 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:56.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.183+0000 7fddf6ffd640 1 --2- 172.21.15.18:0/1795823065 >> v2:172.21.15.162:3300/0 conn(0x7fddf80b5160 0x7fddf8070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:56.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.183+0000 7fddf7fff640 1 -- 172.21.15.18:0/1795823065 >> v2:172.21.15.162:3300/0 conn(0x7fddf80b5160 msgr2=0x7fddf8070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:56.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.183+0000 7fddf7fff640 1 --2- 172.21.15.18:0/1795823065 >> v2:172.21.15.162:3300/0 conn(0x7fddf80b5160 0x7fddf8070620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:56.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.183+0000 7fddf7fff640 1 -- 172.21.15.18:0/1795823065 >> v1:172.21.15.162:6789/0 conn(0x7fddf8162850 legacy=0x7fddf8162c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:56.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.183+0000 7fddf7fff640 1 -- 172.21.15.18:0/1795823065 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf806fe20 con 0x7fddf80d1660 2024-09-19T09:18:56.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.183+0000 7fddf7fff640 1 --2- 172.21.15.18:0/1795823065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddf80d1660 0x7fddf8160650 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009e50 tx=0x7fddf002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1530d3449c3976b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:56.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.184+0000 7fddf67fc640 1 -- 172.21.15.18:0/1795823065 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf0036070 con 0x7fddf80d1660 2024-09-19T09:18:56.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.184+0000 7fddf67fc640 1 -- 172.21.15.18:0/1795823065 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddf0031600 con 0x7fddf80d1660 2024-09-19T09:18:56.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.184+0000 7fddf67fc640 1 -- 172.21.15.18:0/1795823065 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf002ae60 con 0x7fddf80d1660 2024-09-19T09:18:56.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.184+0000 7fddfde27640 1 -- 172.21.15.18:0/1795823065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddf80d1660 msgr2=0x7fddf8160650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:56.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.184+0000 7fddfde27640 1 --2- 172.21.15.18:0/1795823065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddf80d1660 0x7fddf8160650 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009e50 tx=0x7fddf002a680 comp rx=0 tx=0).stop 2024-09-19T09:18:56.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.184+0000 7fddfde27640 1 -- 172.21.15.18:0/1795823065 shutdown_connections 2024-09-19T09:18:56.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.184+0000 7fddfde27640 1 --2- 172.21.15.18:0/1795823065 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddf80d1660 0x7fddf8160650 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:56.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.184+0000 7fddfde27640 1 --2- 172.21.15.18:0/1795823065 >> v2:172.21.15.162:3300/0 conn(0x7fddf80b5160 0x7fddf8070620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:56.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.184+0000 7fddfde27640 1 -- 172.21.15.18:0/1795823065 >> 172.21.15.18:0/1795823065 conn(0x7fddf80b4560 msgr2=0x7fddf80b4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:56.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.184+0000 7fddfde27640 1 -- 172.21.15.18:0/1795823065 shutdown_connections 2024-09-19T09:18:56.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.184+0000 7fddfde27640 1 -- 172.21.15.18:0/1795823065 wait complete. 2024-09-19T09:18:56.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.185+0000 7fddfde27640 1 Processor -- start 2024-09-19T09:18:56.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.186+0000 7fddfde27640 1 -- start start 2024-09-19T09:18:56.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.186+0000 7fddfde27640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fddf80b5160 0x7fddf815bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:56.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.186+0000 7fddfde27640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fddf80d1660 0x7fddf80c8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:56.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.186+0000 7fddfde27640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddf8162850 0x7fddf80ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:56.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.186+0000 7fddfde27640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fddf81601b0 con 0x7fddf8162850 2024-09-19T09:18:56.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.186+0000 7fddfde27640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fddf8160030 con 0x7fddf80d1660 2024-09-19T09:18:56.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.186+0000 7fddfde27640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fddf80d1ab0 con 0x7fddf80b5160 2024-09-19T09:18:56.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.186+0000 7fddf7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddf8162850 0x7fddf80ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:56.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.186+0000 7fddf7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddf8162850 0x7fddf80ce1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53270/0 (socket says 172.21.15.18:53270) 2024-09-19T09:18:56.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.186+0000 7fddf7fff640 1 -- 172.21.15.18:0/2412454052 learned_addr learned my addr 172.21.15.18:0/2412454052 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:56.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.187+0000 7fddf6ffd640 1 --2- 172.21.15.18:0/2412454052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fddf80d1660 0x7fddf80c8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:56.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.187+0000 7fddf77fe640 1 --2- 172.21.15.18:0/2412454052 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fddf80b5160 0x7fddf815bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:56.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.187+0000 7fddf7fff640 1 -- 172.21.15.18:0/2412454052 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fddf80b5160 msgr2=0x7fddf815bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:56.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.187+0000 7fddf7fff640 1 --2- 172.21.15.18:0/2412454052 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fddf80b5160 0x7fddf815bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:56.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.187+0000 7fddf7fff640 1 -- 172.21.15.18:0/2412454052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fddf80d1660 msgr2=0x7fddf80c8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:56.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.187+0000 7fddf7fff640 1 --2- 172.21.15.18:0/2412454052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fddf80d1660 0x7fddf80c8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:56.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.187+0000 7fddf7fff640 1 -- 172.21.15.18:0/2412454052 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf80c7d40 con 0x7fddf8162850 2024-09-19T09:18:56.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.187+0000 7fddf7fff640 1 --2- 172.21.15.18:0/2412454052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddf8162850 0x7fddf80ce1b0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009e50 tx=0x7fddf0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:56.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.187+0000 7fdddffff640 1 -- 172.21.15.18:0/2412454052 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf0036050 con 0x7fddf8162850 2024-09-19T09:18:56.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.187+0000 7fdddffff640 1 -- 172.21.15.18:0/2412454052 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddf0042070 con 0x7fddf8162850 2024-09-19T09:18:56.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.187+0000 7fddfde27640 1 -- 172.21.15.18:0/2412454052 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddf80c8020 con 0x7fddf8162850 2024-09-19T09:18:56.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.187+0000 7fdddffff640 1 -- 172.21.15.18:0/2412454052 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf0009510 con 0x7fddf8162850 2024-09-19T09:18:56.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.187+0000 7fddfde27640 1 -- 172.21.15.18:0/2412454052 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddf80c85e0 con 0x7fddf8162850 2024-09-19T09:18:56.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.188+0000 7fddfde27640 1 -- 172.21.15.18:0/2412454052 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddf8070620 con 0x7fddf8162850 2024-09-19T09:18:56.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.189+0000 7fdddffff640 1 -- 172.21.15.18:0/2412454052 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fddf0007990 con 0x7fddf8162850 2024-09-19T09:18:56.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.189+0000 7fdddffff640 1 --2- 172.21.15.18:0/2412454052 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdde406c2b0 0x7fdde406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:56.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.189+0000 7fdddffff640 1 -- 172.21.15.18:0/2412454052 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7fddf00ac0b0 con 0x7fddf8162850 2024-09-19T09:18:56.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.190+0000 7fddf77fe640 1 --2- 172.21.15.18:0/2412454052 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdde406c2b0 0x7fdde406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:56.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.190+0000 7fddf77fe640 1 --2- 172.21.15.18:0/2412454052 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdde406c2b0 0x7fdde406e770 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdde8006fd0 tx=0x7fdde8009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:56.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.194+0000 7fdddffff640 1 -- 172.21.15.18:0/2412454052 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fddf007a150 con 0x7fddf8162850 2024-09-19T09:18:56.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.370+0000 7fddfde27640 1 -- 172.21.15.18:0/2412454052 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fddf80d2290 con 0x7fddf8162850 2024-09-19T09:18:56.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.371+0000 7fdddffff640 1 -- 172.21.15.18:0/2412454052 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) ==== 74+0+16756 (secure 0 0 0) 0x7fddf007e450 con 0x7fddf8162850 2024-09-19T09:18:56.372 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:18:56.372 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":111,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:18:47.746338+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:18:21.441414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-19T09:18:22.767737+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:18:56.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.373+0000 7fddfde27640 1 -- 172.21.15.18:0/2412454052 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdde406c2b0 msgr2=0x7fdde406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:56.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.373+0000 7fddfde27640 1 --2- 172.21.15.18:0/2412454052 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdde406c2b0 0x7fdde406e770 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fdde8006fd0 tx=0x7fdde8009060 comp rx=0 tx=0).stop 2024-09-19T09:18:56.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.373+0000 7fddfde27640 1 -- 172.21.15.18:0/2412454052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddf8162850 msgr2=0x7fddf80ce1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:56.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.373+0000 7fddfde27640 1 --2- 172.21.15.18:0/2412454052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddf8162850 0x7fddf80ce1b0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009e50 tx=0x7fddf0004a40 comp rx=0 tx=0).stop 2024-09-19T09:18:56.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.373+0000 7fddfde27640 1 -- 172.21.15.18:0/2412454052 shutdown_connections 2024-09-19T09:18:56.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.373+0000 7fddfde27640 1 --2- 172.21.15.18:0/2412454052 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdde406c2b0 0x7fdde406e770 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:56.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.373+0000 7fddfde27640 1 --2- 172.21.15.18:0/2412454052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddf8162850 0x7fddf80ce1b0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:56.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.373+0000 7fddfde27640 1 --2- 172.21.15.18:0/2412454052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fddf80d1660 0x7fddf80c8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:56.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.373+0000 7fddfde27640 1 --2- 172.21.15.18:0/2412454052 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fddf80b5160 0x7fddf815bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:56.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.373+0000 7fddfde27640 1 -- 172.21.15.18:0/2412454052 >> 172.21.15.18:0/2412454052 conn(0x7fddf80b4560 msgr2=0x7fddf8162c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:56.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.373+0000 7fddfde27640 1 -- 172.21.15.18:0/2412454052 shutdown_connections 2024-09-19T09:18:56.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.373+0000 7fddfde27640 1 -- 172.21.15.18:0/2412454052 wait complete. 2024-09-19T09:18:56.385 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-19T09:18:56.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.489+0000 7fb64c6d0640 1 Processor -- start 2024-09-19T09:18:56.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.489+0000 7fb64c6d0640 1 -- start start 2024-09-19T09:18:56.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.490+0000 7fb64c6d0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb6440cf890 0x7fb6440cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:56.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.490+0000 7fb64c6d0640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb64415d880 con 0x7fb6440b5750 2024-09-19T09:18:56.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.490+0000 7fb64c6d0640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb64415c800 con 0x7fb6440ce070 2024-09-19T09:18:56.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.490+0000 7fb64c6d0640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fb6440b5bb0 con 0x7fb6440cf890 2024-09-19T09:18:56.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.491+0000 7fb64ac6d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb6440cf890 0x7fb6440cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:56.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.491+0000 7fb649c6b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb6440b5750 0x7fb64415d170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:45918/0 (socket says 172.21.15.18:45918) 2024-09-19T09:18:56.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.491+0000 7fb64ac6d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb6440cf890 0x7fb6440cfd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53280/0 (socket says 172.21.15.18:53280) 2024-09-19T09:18:56.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.491+0000 7fb649c6b640 1 -- 172.21.15.18:0/2032467196 learned_addr learned my addr 172.21.15.18:0/2032467196 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:56.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.491+0000 7fb64ac6d640 1 -- 172.21.15.18:0/2032467196 >> v1:172.21.15.162:6789/0 conn(0x7fb6440ce070 legacy=0x7fb64415bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:56.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.491+0000 7fb64ac6d640 1 -- 172.21.15.18:0/2032467196 >> v1:172.21.15.18:6789/0 conn(0x7fb6440b5750 legacy=0x7fb64415d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:56.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.491+0000 7fb64ac6d640 1 -- 172.21.15.18:0/2032467196 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb64415cae0 con 0x7fb6440cf890 2024-09-19T09:18:56.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.492+0000 7fb64ac6d640 1 --2- 172.21.15.18:0/2032467196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6440cf890 0x7fb6440cfd00 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0097a0 tx=0x7fb63c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fcfdfdf71a76d92 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:56.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.492+0000 7fb64946a640 1 -- 172.21.15.18:0/2032467196 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c037070 con 0x7fb6440cf890 2024-09-19T09:18:56.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.492+0000 7fb64946a640 1 -- 172.21.15.18:0/2032467196 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb63c032440 con 0x7fb6440cf890 2024-09-19T09:18:56.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.492+0000 7fb64946a640 1 -- 172.21.15.18:0/2032467196 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63c032810 con 0x7fb6440cf890 2024-09-19T09:18:56.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.492+0000 7fb64c6d0640 1 -- 172.21.15.18:0/2032467196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6440cf890 msgr2=0x7fb6440cfd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:56.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.492+0000 7fb64c6d0640 1 --2- 172.21.15.18:0/2032467196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6440cf890 0x7fb6440cfd00 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0097a0 tx=0x7fb63c02a1e0 comp rx=0 tx=0).stop 2024-09-19T09:18:56.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.492+0000 7fb64c6d0640 1 -- 172.21.15.18:0/2032467196 shutdown_connections 2024-09-19T09:18:56.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.492+0000 7fb64c6d0640 1 --2- 172.21.15.18:0/2032467196 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6440cf890 0x7fb6440cfd00 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:56.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.493+0000 7fb64c6d0640 1 -- 172.21.15.18:0/2032467196 >> 172.21.15.18:0/2032467196 conn(0x7fb6440b2630 msgr2=0x7fb6440b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:56.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.493+0000 7fb64c6d0640 1 -- 172.21.15.18:0/2032467196 shutdown_connections 2024-09-19T09:18:56.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.493+0000 7fb64c6d0640 1 -- 172.21.15.18:0/2032467196 wait complete. 2024-09-19T09:18:56.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.494+0000 7fb64c6d0640 1 Processor -- start 2024-09-19T09:18:56.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.494+0000 7fb64c6d0640 1 -- start start 2024-09-19T09:18:56.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.494+0000 7fb64c6d0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6440b5750 0x7fb644151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:56.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.494+0000 7fb64c6d0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6440ce070 0x7fb64413f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:56.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.494+0000 7fb64c6d0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6440cf890 0x7fb64414d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:56.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.494+0000 7fb64c6d0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb6440ce450 con 0x7fb6440b5750 2024-09-19T09:18:56.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.494+0000 7fb64c6d0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb6440d0240 con 0x7fb6440cf890 2024-09-19T09:18:56.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.494+0000 7fb64c6d0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb64406e080 con 0x7fb6440ce070 2024-09-19T09:18:56.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.495+0000 7fb64a46c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6440b5750 0x7fb644151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:56.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.495+0000 7fb64a46c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6440b5750 0x7fb644151240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53296/0 (socket says 172.21.15.18:53296) 2024-09-19T09:18:56.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.495+0000 7fb64a46c640 1 -- 172.21.15.18:0/4026618685 learned_addr learned my addr 172.21.15.18:0/4026618685 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:56.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.495+0000 7fb64ac6d640 1 --2- 172.21.15.18:0/4026618685 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6440cf890 0x7fb64414d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:56.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.495+0000 7fb649c6b640 1 --2- 172.21.15.18:0/4026618685 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6440ce070 0x7fb64413f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:56.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.495+0000 7fb64a46c640 1 -- 172.21.15.18:0/4026618685 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6440ce070 msgr2=0x7fb64413f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:56.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.495+0000 7fb64a46c640 1 --2- 172.21.15.18:0/4026618685 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6440ce070 0x7fb64413f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:56.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.495+0000 7fb64a46c640 1 -- 172.21.15.18:0/4026618685 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6440cf890 msgr2=0x7fb64414d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:56.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.495+0000 7fb64a46c640 1 --2- 172.21.15.18:0/4026618685 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6440cf890 0x7fb64414d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:56.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.495+0000 7fb64a46c640 1 -- 172.21.15.18:0/4026618685 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb64414c490 con 0x7fb6440b5750 2024-09-19T09:18:56.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.495+0000 7fb64ac6d640 1 --2- 172.21.15.18:0/4026618685 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6440cf890 0x7fb64414d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:56.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.495+0000 7fb64a46c640 1 --2- 172.21.15.18:0/4026618685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6440b5750 0x7fb644151240 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fb63400c7f0 tx=0x7fb63400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:56.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.495+0000 7fb642ffd640 1 -- 172.21.15.18:0/4026618685 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb634016020 con 0x7fb6440b5750 2024-09-19T09:18:56.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.495+0000 7fb642ffd640 1 -- 172.21.15.18:0/4026618685 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb63400aa50 con 0x7fb6440b5750 2024-09-19T09:18:56.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.495+0000 7fb642ffd640 1 -- 172.21.15.18:0/4026618685 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb63400ae40 con 0x7fb6440b5750 2024-09-19T09:18:56.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.495+0000 7fb64c6d0640 1 -- 172.21.15.18:0/4026618685 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb64414c770 con 0x7fb6440b5750 2024-09-19T09:18:56.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.495+0000 7fb64c6d0640 1 -- 172.21.15.18:0/4026618685 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb64414cd30 con 0x7fb6440b5750 2024-09-19T09:18:56.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.496+0000 7fb64c6d0640 1 -- 172.21.15.18:0/4026618685 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6440cfd00 con 0x7fb6440b5750 2024-09-19T09:18:56.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.497+0000 7fb642ffd640 1 -- 172.21.15.18:0/4026618685 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb634019020 con 0x7fb6440b5750 2024-09-19T09:18:56.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.497+0000 7fb642ffd640 1 --2- 172.21.15.18:0/4026618685 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb63006c2b0 0x7fb63006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:56.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.497+0000 7fb642ffd640 1 -- 172.21.15.18:0/4026618685 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(111..111 src has 1..111) ==== 5709+0+0 (secure 0 0 0) 0x7fb63408b0e0 con 0x7fb6440b5750 2024-09-19T09:18:56.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.498+0000 7fb649c6b640 1 --2- 172.21.15.18:0/4026618685 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb63006c2b0 0x7fb63006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:56.501 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.498+0000 7fb649c6b640 1 --2- 172.21.15.18:0/4026618685 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb63006c2b0 0x7fb63006e770 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb6440b1d30 tx=0x7fb638009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:56.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.502+0000 7fb642ffd640 1 -- 172.21.15.18:0/4026618685 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb634020070 con 0x7fb6440b5750 2024-09-19T09:18:56.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.713+0000 7fb64c6d0640 1 -- 172.21.15.18:0/4026618685 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb6440d0420 con 0x7fb6440b5750 2024-09-19T09:18:56.714 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-19T09:18:56.713+0000 7fca8a79c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:18:56.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.715+0000 7fb642ffd640 1 -- 172.21.15.18:0/4026618685 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v43) ==== 161+0+0 (secure 0 0 0) 0x7fb6340598e0 con 0x7fb6440b5750 2024-09-19T09:18:56.715 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T09:18:56.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.719+0000 7fb64c6d0640 1 -- 172.21.15.18:0/4026618685 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb63006c2b0 msgr2=0x7fb63006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:56.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.719+0000 7fb64c6d0640 1 --2- 172.21.15.18:0/4026618685 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb63006c2b0 0x7fb63006e770 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb6440b1d30 tx=0x7fb638009040 comp rx=0 tx=0).stop 2024-09-19T09:18:56.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.719+0000 7fb64c6d0640 1 -- 172.21.15.18:0/4026618685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6440b5750 msgr2=0x7fb644151240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:56.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.719+0000 7fb64c6d0640 1 --2- 172.21.15.18:0/4026618685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6440b5750 0x7fb644151240 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fb63400c7f0 tx=0x7fb63400ccb0 comp rx=0 tx=0).stop 2024-09-19T09:18:56.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.719+0000 7fb64c6d0640 1 -- 172.21.15.18:0/4026618685 shutdown_connections 2024-09-19T09:18:56.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.719+0000 7fb64c6d0640 1 --2- 172.21.15.18:0/4026618685 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb63006c2b0 0x7fb63006e770 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:56.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.719+0000 7fb64c6d0640 1 --2- 172.21.15.18:0/4026618685 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb6440cf890 0x7fb64414d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:56.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.719+0000 7fb64c6d0640 1 --2- 172.21.15.18:0/4026618685 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb6440ce070 0x7fb64413f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:56.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.719+0000 7fb64c6d0640 1 --2- 172.21.15.18:0/4026618685 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb6440b5750 0x7fb644151240 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:56.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.719+0000 7fb64c6d0640 1 -- 172.21.15.18:0/4026618685 >> 172.21.15.18:0/4026618685 conn(0x7fb6440b2630 msgr2=0x7fb64415e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:56.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.720+0000 7fb64c6d0640 1 -- 172.21.15.18:0/4026618685 shutdown_connections 2024-09-19T09:18:56.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.720+0000 7fb64c6d0640 1 -- 172.21.15.18:0/4026618685 wait complete. 2024-09-19T09:18:56.731 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T09:18:56.758 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-09-19T09:18:56.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.836+0000 7fe24dd2c640 1 Processor -- start 2024-09-19T09:18:56.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.836+0000 7fe24dd2c640 1 -- start start 2024-09-19T09:18:56.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.836+0000 7fe24dd2c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe2481623c0 0x7fe2480b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:56.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.836+0000 7fe24dd2c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe2480d1470 0x7fe2480d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:56.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.836+0000 7fe24dd2c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2480d3700 con 0x7fe2480d56b0 2024-09-19T09:18:56.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.836+0000 7fe24dd2c640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fe2480d21a0 con 0x7fe2480d1470 2024-09-19T09:18:56.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.836+0000 7fe24dd2c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe2480d0080 con 0x7fe2481623c0 2024-09-19T09:18:56.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.837+0000 7fe247fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe2480d1470 0x7fe2480d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:56.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.837+0000 7fe246ffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe2480d56b0 0x7fe2480d0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:45922/0 (socket says 172.21.15.18:45922) 2024-09-19T09:18:56.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.837+0000 7fe246ffd640 1 -- 172.21.15.18:0/866192966 learned_addr learned my addr 172.21.15.18:0/866192966 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:56.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.837+0000 7fe2477fe640 1 --2- 172.21.15.18:0/866192966 >> v2:172.21.15.162:3300/0 conn(0x7fe2481623c0 0x7fe2480b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:56.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.837+0000 7fe247fff640 1 -- 172.21.15.18:0/866192966 >> v2:172.21.15.162:3300/0 conn(0x7fe2481623c0 msgr2=0x7fe2480b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:56.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.837+0000 7fe247fff640 1 --2- 172.21.15.18:0/866192966 >> v2:172.21.15.162:3300/0 conn(0x7fe2481623c0 0x7fe2480b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:56.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.837+0000 7fe247fff640 1 -- 172.21.15.18:0/866192966 >> v1:172.21.15.18:6789/0 conn(0x7fe2480d56b0 legacy=0x7fe2480d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:56.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.837+0000 7fe2467fc640 1 -- 172.21.15.18:0/866192966 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1368525731 0 0) 0x7fe2480d3700 con 0x7fe2480d56b0 2024-09-19T09:18:56.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.837+0000 7fe247fff640 1 -- 172.21.15.18:0/866192966 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2480cfa70 con 0x7fe2480d1470 2024-09-19T09:18:56.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.837+0000 7fe2477fe640 1 --2- 172.21.15.18:0/866192966 >> v2:172.21.15.162:3300/0 conn(0x7fe2481623c0 0x7fe2480b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:18:56.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.838+0000 7fe247fff640 1 --2- 172.21.15.18:0/866192966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2480d1470 0x7fe2480d1900 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe24808daf0 tx=0x7fe24002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e79a123cc9ec3ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:56.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.838+0000 7fe2467fc640 1 -- 172.21.15.18:0/866192966 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe240007740 con 0x7fe2480d1470 2024-09-19T09:18:56.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.838+0000 7fe2467fc640 1 -- 172.21.15.18:0/866192966 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2400078e0 con 0x7fe2480d1470 2024-09-19T09:18:56.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.838+0000 7fe2467fc640 1 -- 172.21.15.18:0/866192966 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe240007cb0 con 0x7fe2480d1470 2024-09-19T09:18:56.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.838+0000 7fe24dd2c640 1 -- 172.21.15.18:0/866192966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2480d1470 msgr2=0x7fe2480d1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:56.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.838+0000 7fe24dd2c640 1 --2- 172.21.15.18:0/866192966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2480d1470 0x7fe2480d1900 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe24808daf0 tx=0x7fe24002a680 comp rx=0 tx=0).stop 2024-09-19T09:18:56.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.838+0000 7fe24dd2c640 1 -- 172.21.15.18:0/866192966 shutdown_connections 2024-09-19T09:18:56.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.838+0000 7fe24dd2c640 1 --2- 172.21.15.18:0/866192966 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2480d1470 0x7fe2480d1900 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:56.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.838+0000 7fe24dd2c640 1 --2- 172.21.15.18:0/866192966 >> v2:172.21.15.162:3300/0 conn(0x7fe2481623c0 0x7fe2480b6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:56.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.838+0000 7fe24dd2c640 1 -- 172.21.15.18:0/866192966 >> 172.21.15.18:0/866192966 conn(0x7fe24809df30 msgr2=0x7fe2480d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:56.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.838+0000 7fe24dd2c640 1 -- 172.21.15.18:0/866192966 shutdown_connections 2024-09-19T09:18:56.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.838+0000 7fe24dd2c640 1 -- 172.21.15.18:0/866192966 wait complete. 2024-09-19T09:18:56.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.840+0000 7fe24dd2c640 1 Processor -- start 2024-09-19T09:18:56.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.840+0000 7fe24dd2c640 1 -- start start 2024-09-19T09:18:56.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.840+0000 7fe24dd2c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2480d1470 0x7fe24815de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:56.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.840+0000 7fe24dd2c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2480d56b0 0x7fe24815c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:56.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.840+0000 7fe24dd2c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2481623c0 0x7fe2480b5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:56.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.840+0000 7fe24dd2c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe2480cfd10 con 0x7fe2481623c0 2024-09-19T09:18:56.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.840+0000 7fe24dd2c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe2480d39a0 con 0x7fe2480d1470 2024-09-19T09:18:56.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.840+0000 7fe24dd2c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe2481627a0 con 0x7fe2480d56b0 2024-09-19T09:18:56.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.841+0000 7fe247fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2481623c0 0x7fe2480b5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:56.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.841+0000 7fe247fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2481623c0 0x7fe2480b5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53324/0 (socket says 172.21.15.18:53324) 2024-09-19T09:18:56.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.841+0000 7fe247fff640 1 -- 172.21.15.18:0/3439083912 learned_addr learned my addr 172.21.15.18:0/3439083912 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:56.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.841+0000 7fe2477fe640 1 --2- 172.21.15.18:0/3439083912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2480d1470 0x7fe24815de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:56.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.841+0000 7fe246ffd640 1 --2- 172.21.15.18:0/3439083912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2480d56b0 0x7fe24815c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:56.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.841+0000 7fe247fff640 1 -- 172.21.15.18:0/3439083912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2480d56b0 msgr2=0x7fe24815c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:56.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.841+0000 7fe247fff640 1 --2- 172.21.15.18:0/3439083912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2480d56b0 0x7fe24815c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:56.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.841+0000 7fe247fff640 1 -- 172.21.15.18:0/3439083912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2480d1470 msgr2=0x7fe24815de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:56.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.841+0000 7fe247fff640 1 --2- 172.21.15.18:0/3439083912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2480d1470 0x7fe24815de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:56.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.841+0000 7fe247fff640 1 -- 172.21.15.18:0/3439083912 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2480c8d60 con 0x7fe2481623c0 2024-09-19T09:18:56.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.841+0000 7fe247fff640 1 --2- 172.21.15.18:0/3439083912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2481623c0 0x7fe2480b5b80 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fe240009e50 tx=0x7fe240004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:56.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.841+0000 7fe22ffff640 1 -- 172.21.15.18:0/3439083912 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24003f070 con 0x7fe2481623c0 2024-09-19T09:18:56.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.841+0000 7fe22ffff640 1 -- 172.21.15.18:0/3439083912 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe240031bf0 con 0x7fe2481623c0 2024-09-19T09:18:56.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.841+0000 7fe24dd2c640 1 -- 172.21.15.18:0/3439083912 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2480c9040 con 0x7fe2481623c0 2024-09-19T09:18:56.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.841+0000 7fe22ffff640 1 -- 172.21.15.18:0/3439083912 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe240044460 con 0x7fe2481623c0 2024-09-19T09:18:56.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.841+0000 7fe24dd2c640 1 -- 172.21.15.18:0/3439083912 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2480c9600 con 0x7fe2481623c0 2024-09-19T09:18:56.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.842+0000 7fe24dd2c640 1 -- 172.21.15.18:0/3439083912 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2480d3c80 con 0x7fe2481623c0 2024-09-19T09:18:56.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.843+0000 7fe22ffff640 1 -- 172.21.15.18:0/3439083912 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe240007790 con 0x7fe2481623c0 2024-09-19T09:18:56.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.843+0000 7fe22ffff640 1 --2- 172.21.15.18:0/3439083912 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe23406c2b0 0x7fe23406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:56.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.843+0000 7fe22ffff640 1 -- 172.21.15.18:0/3439083912 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5795+0+0 (secure 0 0 0) 0x7fe2400accb0 con 0x7fe2481623c0 2024-09-19T09:18:56.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.844+0000 7fe2477fe640 1 --2- 172.21.15.18:0/3439083912 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe23406c2b0 0x7fe23406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:56.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.844+0000 7fe2477fe640 1 --2- 172.21.15.18:0/3439083912 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe23406c2b0 0x7fe23406e770 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe238006fd0 tx=0x7fe238008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:56.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:56.848+0000 7fe22ffff640 1 -- 172.21.15.18:0/3439083912 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe24007b450 con 0x7fe2481623c0 2024-09-19T09:18:57.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.059+0000 7fe24dd2c640 1 -- 172.21.15.18:0/3439083912 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fe2480b38d0 con 0x7fe2481623c0 2024-09-19T09:18:57.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.716+0000 7fe22ffff640 1 -- 172.21.15.18:0/3439083912 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v44) ==== 104+0+0 (secure 0 0 0) 0x7fe24007ad50 con 0x7fe2481623c0 2024-09-19T09:18:57.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.720+0000 7fe24dd2c640 1 -- 172.21.15.18:0/3439083912 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe23406c2b0 msgr2=0x7fe23406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:57.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.720+0000 7fe24dd2c640 1 --2- 172.21.15.18:0/3439083912 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe23406c2b0 0x7fe23406e770 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe238006fd0 tx=0x7fe238008040 comp rx=0 tx=0).stop 2024-09-19T09:18:57.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.720+0000 7fe24dd2c640 1 -- 172.21.15.18:0/3439083912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2481623c0 msgr2=0x7fe2480b5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:57.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.720+0000 7fe24dd2c640 1 --2- 172.21.15.18:0/3439083912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2481623c0 0x7fe2480b5b80 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fe240009e50 tx=0x7fe240004a40 comp rx=0 tx=0).stop 2024-09-19T09:18:57.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.720+0000 7fe24dd2c640 1 -- 172.21.15.18:0/3439083912 shutdown_connections 2024-09-19T09:18:57.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.720+0000 7fe24dd2c640 1 --2- 172.21.15.18:0/3439083912 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe23406c2b0 0x7fe23406e770 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.720+0000 7fe24dd2c640 1 --2- 172.21.15.18:0/3439083912 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2481623c0 0x7fe2480b5b80 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.720+0000 7fe24dd2c640 1 --2- 172.21.15.18:0/3439083912 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2480d56b0 0x7fe24815c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.720+0000 7fe24dd2c640 1 --2- 172.21.15.18:0/3439083912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2480d1470 0x7fe24815de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.720+0000 7fe24dd2c640 1 -- 172.21.15.18:0/3439083912 >> 172.21.15.18:0/3439083912 conn(0x7fe24809df30 msgr2=0x7fe2480b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:57.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.720+0000 7fe24dd2c640 1 -- 172.21.15.18:0/3439083912 shutdown_connections 2024-09-19T09:18:57.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.720+0000 7fe24dd2c640 1 -- 172.21.15.18:0/3439083912 wait complete. 2024-09-19T09:18:57.734 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T09:18:57.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.850+0000 7f73e5ed9640 1 Processor -- start 2024-09-19T09:18:57.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.851+0000 7f73e5ed9640 1 -- start start 2024-09-19T09:18:57.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.851+0000 7f73e5ed9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f73e015edb0 0x7f73e00d29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:57.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.851+0000 7f73e5ed9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73e00d0370 0x7f73e00d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:57.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.851+0000 7f73e5ed9640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73e00d0870 con 0x7f73e00d37c0 2024-09-19T09:18:57.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.851+0000 7f73e5ed9640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f73e00b4400 con 0x7f73e015edb0 2024-09-19T09:18:57.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.851+0000 7f73e5ed9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f73e00d0b50 con 0x7f73e00d0370 2024-09-19T09:18:57.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.851+0000 7f73df7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f73e015edb0 0x7f73e00d29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:57.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.851+0000 7f73dffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f73e00d37c0 0x7f73e00d1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:45926/0 (socket says 172.21.15.18:45926) 2024-09-19T09:18:57.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.851+0000 7f73dffff640 1 -- 172.21.15.18:0/692970011 learned_addr learned my addr 172.21.15.18:0/692970011 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:57.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.852+0000 7f73df7fe640 1 -- 172.21.15.18:0/692970011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73e00d0370 msgr2=0x7f73e00d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:57.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.852+0000 7f73df7fe640 1 --2- 172.21.15.18:0/692970011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73e00d0370 0x7f73e00d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.852+0000 7f73df7fe640 1 -- 172.21.15.18:0/692970011 >> v1:172.21.15.18:6789/0 conn(0x7f73e00d37c0 legacy=0x7f73e00d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:57.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.852+0000 7f73df7fe640 1 -- 172.21.15.18:0/692970011 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73e00b4620 con 0x7f73e015edb0 2024-09-19T09:18:57.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.852+0000 7f73de7fc640 1 -- 172.21.15.18:0/692970011 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3945024530 0 0) 0x7f73e00d0870 con 0x7f73e00d37c0 2024-09-19T09:18:57.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.852+0000 7f73df7fe640 1 --2- 172.21.15.18:0/692970011 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73e015edb0 0x7f73e00d29e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f73d0009d90 tx=0x7f73d002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972560f4d16dcc67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:57.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.853+0000 7f73de7fc640 1 -- 172.21.15.18:0/692970011 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d0007740 con 0x7f73e015edb0 2024-09-19T09:18:57.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.853+0000 7f73de7fc640 1 -- 172.21.15.18:0/692970011 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73d00078e0 con 0x7f73e015edb0 2024-09-19T09:18:57.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.853+0000 7f73de7fc640 1 -- 172.21.15.18:0/692970011 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d0007cb0 con 0x7f73e015edb0 2024-09-19T09:18:57.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.853+0000 7f73e5ed9640 1 -- 172.21.15.18:0/692970011 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73e015edb0 msgr2=0x7f73e00d29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:57.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.853+0000 7f73e5ed9640 1 --2- 172.21.15.18:0/692970011 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73e015edb0 0x7f73e00d29e0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f73d0009d90 tx=0x7f73d002a660 comp rx=0 tx=0).stop 2024-09-19T09:18:57.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.853+0000 7f73e5ed9640 1 -- 172.21.15.18:0/692970011 shutdown_connections 2024-09-19T09:18:57.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.853+0000 7f73e5ed9640 1 --2- 172.21.15.18:0/692970011 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73e00d0370 0x7f73e00d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.853+0000 7f73e5ed9640 1 --2- 172.21.15.18:0/692970011 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73e015edb0 0x7f73e00d29e0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.853+0000 7f73e5ed9640 1 -- 172.21.15.18:0/692970011 >> 172.21.15.18:0/692970011 conn(0x7f73e009df30 msgr2=0x7f73e00d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:57.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.853+0000 7f73e5ed9640 1 -- 172.21.15.18:0/692970011 shutdown_connections 2024-09-19T09:18:57.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.853+0000 7f73e5ed9640 1 -- 172.21.15.18:0/692970011 wait complete. 2024-09-19T09:18:57.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.854+0000 7f73e5ed9640 1 Processor -- start 2024-09-19T09:18:57.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.855+0000 7f73e5ed9640 1 -- start start 2024-09-19T09:18:57.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.855+0000 7f73e5ed9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73e00d0370 0x7f73e01550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:57.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.855+0000 7f73e5ed9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73e00d37c0 0x7f73e00cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:57.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.855+0000 7f73e5ed9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73e015edb0 0x7f73e00ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:57.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.855+0000 7f73e5ed9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f73e015f190 con 0x7f73e00d0370 2024-09-19T09:18:57.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.855+0000 7f73e5ed9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f73e00b4be0 con 0x7f73e015edb0 2024-09-19T09:18:57.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.855+0000 7f73e5ed9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f73e00d2f20 con 0x7f73e00d37c0 2024-09-19T09:18:57.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.855+0000 7f73df7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73e00d0370 0x7f73e01550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:57.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.856+0000 7f73df7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73e00d0370 0x7f73e01550d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53356/0 (socket says 172.21.15.18:53356) 2024-09-19T09:18:57.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.856+0000 7f73df7fe640 1 -- 172.21.15.18:0/4031036188 learned_addr learned my addr 172.21.15.18:0/4031036188 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:57.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.856+0000 7f73deffd640 1 --2- 172.21.15.18:0/4031036188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73e00d37c0 0x7f73e00cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:57.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.856+0000 7f73dffff640 1 --2- 172.21.15.18:0/4031036188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73e015edb0 0x7f73e00ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:57.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.856+0000 7f73df7fe640 1 -- 172.21.15.18:0/4031036188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73e00d37c0 msgr2=0x7f73e00cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:57.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.856+0000 7f73df7fe640 1 --2- 172.21.15.18:0/4031036188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73e00d37c0 0x7f73e00cdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.856+0000 7f73df7fe640 1 -- 172.21.15.18:0/4031036188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73e015edb0 msgr2=0x7f73e00ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:57.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.856+0000 7f73df7fe640 1 --2- 172.21.15.18:0/4031036188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73e015edb0 0x7f73e00ce4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:57.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.856+0000 7f73df7fe640 1 -- 172.21.15.18:0/4031036188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73e00b7c90 con 0x7f73e00d0370 2024-09-19T09:18:57.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.856+0000 7f73dffff640 1 --2- 172.21.15.18:0/4031036188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73e015edb0 0x7f73e00ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:57.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.856+0000 7f73deffd640 1 --2- 172.21.15.18:0/4031036188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73e00d37c0 0x7f73e00cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:57.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.856+0000 7f73df7fe640 1 --2- 172.21.15.18:0/4031036188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73e00d0370 0x7f73e01550d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f73d0009d90 tx=0x7f73d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:57.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.856+0000 7f73c7fff640 1 -- 172.21.15.18:0/4031036188 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d0040070 con 0x7f73e00d0370 2024-09-19T09:18:57.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.856+0000 7f73c7fff640 1 -- 172.21.15.18:0/4031036188 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73d0031c40 con 0x7f73e00d0370 2024-09-19T09:18:57.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.856+0000 7f73e5ed9640 1 -- 172.21.15.18:0/4031036188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73e00b7f70 con 0x7f73e00d0370 2024-09-19T09:18:57.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.856+0000 7f73c7fff640 1 -- 172.21.15.18:0/4031036188 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73d003c420 con 0x7f73e00d0370 2024-09-19T09:18:57.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.856+0000 7f73e5ed9640 1 -- 172.21.15.18:0/4031036188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73e00b8530 con 0x7f73e00d0370 2024-09-19T09:18:57.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.857+0000 7f73e5ed9640 1 -- 172.21.15.18:0/4031036188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73e00d3280 con 0x7f73e00d0370 2024-09-19T09:18:57.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.858+0000 7f73c7fff640 1 -- 172.21.15.18:0/4031036188 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f73d0039040 con 0x7f73e00d0370 2024-09-19T09:18:57.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.858+0000 7f73c7fff640 1 --2- 172.21.15.18:0/4031036188 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f73cc06c2b0 0x7f73cc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:57.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.858+0000 7f73c7fff640 1 -- 172.21.15.18:0/4031036188 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 5795+0+0 (secure 0 0 0) 0x7f73d00aca70 con 0x7f73e00d0370 2024-09-19T09:18:57.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.859+0000 7f73deffd640 1 --2- 172.21.15.18:0/4031036188 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f73cc06c2b0 0x7f73cc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:57.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.859+0000 7f73deffd640 1 --2- 172.21.15.18:0/4031036188 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f73cc06c2b0 0x7f73cc06e770 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f73d4006fd0 tx=0x7f73d4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:57.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:57.863+0000 7f73c7fff640 1 -- 172.21.15.18:0/4031036188 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f73d007b180 con 0x7f73e00d0370 2024-09-19T09:18:58.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.037+0000 7f73e5ed9640 1 -- 172.21.15.18:0/4031036188 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f73e00b62d0 con 0x7f73e00d0370 2024-09-19T09:18:58.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.827+0000 7f73c7fff640 1 -- 172.21.15.18:0/4031036188 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v113) ==== 181+0+0 (secure 0 0 0) 0x7f73d007aa80 con 0x7f73e00d0370 2024-09-19T09:18:58.828 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' removed 2024-09-19T09:18:58.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.830+0000 7f73e5ed9640 1 -- 172.21.15.18:0/4031036188 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f73cc06c2b0 msgr2=0x7f73cc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:58.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.830+0000 7f73e5ed9640 1 --2- 172.21.15.18:0/4031036188 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f73cc06c2b0 0x7f73cc06e770 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f73d4006fd0 tx=0x7f73d4008040 comp rx=0 tx=0).stop 2024-09-19T09:18:58.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.830+0000 7f73e5ed9640 1 -- 172.21.15.18:0/4031036188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73e00d0370 msgr2=0x7f73e01550d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:58.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.830+0000 7f73e5ed9640 1 --2- 172.21.15.18:0/4031036188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73e00d0370 0x7f73e01550d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f73d0009d90 tx=0x7f73d0004a40 comp rx=0 tx=0).stop 2024-09-19T09:18:58.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.830+0000 7f73e5ed9640 1 -- 172.21.15.18:0/4031036188 shutdown_connections 2024-09-19T09:18:58.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.830+0000 7f73e5ed9640 1 --2- 172.21.15.18:0/4031036188 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f73cc06c2b0 0x7f73cc06e770 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:58.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.830+0000 7f73e5ed9640 1 --2- 172.21.15.18:0/4031036188 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73e015edb0 0x7f73e00ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:58.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.830+0000 7f73e5ed9640 1 --2- 172.21.15.18:0/4031036188 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73e00d37c0 0x7f73e00cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:58.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.830+0000 7f73e5ed9640 1 --2- 172.21.15.18:0/4031036188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73e00d0370 0x7f73e01550d0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:58.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.830+0000 7f73e5ed9640 1 -- 172.21.15.18:0/4031036188 >> 172.21.15.18:0/4031036188 conn(0x7f73e009df30 msgr2=0x7f73e0161320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:58.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.830+0000 7f73e5ed9640 1 -- 172.21.15.18:0/4031036188 shutdown_connections 2024-09-19T09:18:58.832 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.830+0000 7f73e5ed9640 1 -- 172.21.15.18:0/4031036188 wait complete. 2024-09-19T09:18:58.845 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T09:18:58.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.958+0000 7f3dff58d640 1 Processor -- start 2024-09-19T09:18:58.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.959+0000 7f3dff58d640 1 -- start start 2024-09-19T09:18:58.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.959+0000 7f3dff58d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3df815efc0 0x7f3df806e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:58.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.959+0000 7f3dff58d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3df806d8d0 con 0x7f3df806f7e0 2024-09-19T09:18:58.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.959+0000 7f3dff58d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3df806dbb0 con 0x7f3df80705b0 2024-09-19T09:18:58.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.959+0000 7f3dff58d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f3df815f3a0 con 0x7f3df815efc0 2024-09-19T09:18:58.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.960+0000 7f3dfcb28640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3df806f7e0 0x7f3df806fea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:45942/0 (socket says 172.21.15.18:45942) 2024-09-19T09:18:58.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.960+0000 7f3dfcb28640 1 -- 172.21.15.18:0/755561503 learned_addr learned my addr 172.21.15.18:0/755561503 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:18:58.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.960+0000 7f3deffff640 1 -- 172.21.15.18:0/755561503 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 284981915 0 0) 0x7f3df806d8d0 con 0x7f3df806f7e0 2024-09-19T09:18:58.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.960+0000 7f3deffff640 1 -- 172.21.15.18:0/755561503 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3de4003520 con 0x7f3df806f7e0 2024-09-19T09:18:58.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.960+0000 7f3dfd329640 1 --2- 172.21.15.18:0/755561503 >> v2:172.21.15.162:3300/0 conn(0x7f3df815efc0 0x7f3df806e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:58.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.960+0000 7f3deffff640 1 -- 172.21.15.18:0/755561503 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1997597837 0 0) 0x7f3de4003520 con 0x7f3df806f7e0 2024-09-19T09:18:58.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.960+0000 7f3deffff640 1 -- 172.21.15.18:0/755561503 >> v2:172.21.15.162:3300/0 conn(0x7f3df815efc0 msgr2=0x7f3df806e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:58.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.960+0000 7f3deffff640 1 --2- 172.21.15.18:0/755561503 >> v2:172.21.15.162:3300/0 conn(0x7f3df815efc0 0x7f3df806e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:58.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.960+0000 7f3deffff640 1 -- 172.21.15.18:0/755561503 >> v1:172.21.15.162:6789/0 conn(0x7f3df80705b0 legacy=0x7f3df80af840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:58.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.960+0000 7f3deffff640 1 -- 172.21.15.18:0/755561503 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df806de90 con 0x7f3df806f7e0 2024-09-19T09:18:58.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.960+0000 7f3deffff640 1 -- 172.21.15.18:0/755561503 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f3de8001670 con 0x7f3df806f7e0 2024-09-19T09:18:58.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.960+0000 7f3deffff640 1 -- 172.21.15.18:0/755561503 >> v1:172.21.15.18:6789/0 conn(0x7f3df806f7e0 legacy=0x7f3df806fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:58.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.960+0000 7f3deffff640 1 --2- 172.21.15.18:0/755561503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3de40039b0 0x7f3de4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:58.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.960+0000 7f3deffff640 1 --2- 172.21.15.18:0/755561503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de4004800 0x7f3de4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:58.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.960+0000 7f3deffff640 1 --2- 172.21.15.18:0/755561503 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3de40051c0 0x7f3de400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:58.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.960+0000 7f3deffff640 1 -- 172.21.15.18:0/755561503 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3df815f3a0 con 0x7f3de4004800 2024-09-19T09:18:58.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.960+0000 7f3deffff640 1 -- 172.21.15.18:0/755561503 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3de400c060 con 0x7f3de40039b0 2024-09-19T09:18:58.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.960+0000 7f3deffff640 1 -- 172.21.15.18:0/755561503 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3de400c260 con 0x7f3de40051c0 2024-09-19T09:18:58.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.960+0000 7f3dfcb28640 1 --2- 172.21.15.18:0/755561503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de4004800 0x7f3de4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:58.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.960+0000 7f3dfd329640 1 --2- 172.21.15.18:0/755561503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3de40039b0 0x7f3de4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:58.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.961+0000 7f3dfdb2a640 1 --2- 172.21.15.18:0/755561503 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3de40051c0 0x7f3de400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:58.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.961+0000 7f3dfcb28640 1 -- 172.21.15.18:0/755561503 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3de40051c0 msgr2=0x7f3de400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:58.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.961+0000 7f3dfcb28640 1 --2- 172.21.15.18:0/755561503 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3de40051c0 0x7f3de400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:58.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.961+0000 7f3dfcb28640 1 -- 172.21.15.18:0/755561503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3de40039b0 msgr2=0x7f3de4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:18:58.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.961+0000 7f3dfcb28640 1 --2- 172.21.15.18:0/755561503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3de40039b0 0x7f3de4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:58.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.961+0000 7f3dfcb28640 1 -- 172.21.15.18:0/755561503 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de4003520 con 0x7f3de4004800 2024-09-19T09:18:58.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.961+0000 7f3dfdb2a640 1 -- 172.21.15.18:0/755561503 reap_dead start 2024-09-19T09:18:58.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.961+0000 7f3dfcb28640 1 --2- 172.21.15.18:0/755561503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de4004800 0x7f3de4004c80 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f3de800c210 tx=0x7f3de4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c27d1f1f3f1b33f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:58.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.962+0000 7f3deffff640 1 -- 172.21.15.18:0/755561503 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de8007d10 con 0x7f3de4004800 2024-09-19T09:18:58.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.962+0000 7f3deffff640 1 -- 172.21.15.18:0/755561503 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3de80058d0 con 0x7f3de4004800 2024-09-19T09:18:58.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.962+0000 7f3deffff640 1 -- 172.21.15.18:0/755561503 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3de8005ce0 con 0x7f3de4004800 2024-09-19T09:18:58.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.962+0000 7f3dff58d640 1 -- 172.21.15.18:0/755561503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de4004800 msgr2=0x7f3de4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:58.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.962+0000 7f3dff58d640 1 --2- 172.21.15.18:0/755561503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de4004800 0x7f3de4004c80 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f3de800c210 tx=0x7f3de4005830 comp rx=0 tx=0).stop 2024-09-19T09:18:58.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.962+0000 7f3dff58d640 1 -- 172.21.15.18:0/755561503 shutdown_connections 2024-09-19T09:18:58.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.962+0000 7f3dff58d640 1 --2- 172.21.15.18:0/755561503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de4004800 0x7f3de4004c80 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:58.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.962+0000 7f3dff58d640 1 -- 172.21.15.18:0/755561503 >> 172.21.15.18:0/755561503 conn(0x7f3df80b4560 msgr2=0x7f3df80b4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:58.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.962+0000 7f3dff58d640 1 -- 172.21.15.18:0/755561503 shutdown_connections 2024-09-19T09:18:58.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.962+0000 7f3dff58d640 1 -- 172.21.15.18:0/755561503 wait complete. 2024-09-19T09:18:58.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.963+0000 7f3dff58d640 1 Processor -- start 2024-09-19T09:18:58.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.964+0000 7f3dff58d640 1 -- start start 2024-09-19T09:18:58.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.964+0000 7f3dff58d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de4004800 0x7f3df8152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:58.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.964+0000 7f3dff58d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3df80b72c0 0x7f3df81f7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:58.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.964+0000 7f3dff58d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3df81f84c0 0x7f3df81512f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:58.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.964+0000 7f3dff58d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3df80b1fb0 con 0x7f3de4004800 2024-09-19T09:18:58.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.964+0000 7f3dff58d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3df806e200 con 0x7f3df80b72c0 2024-09-19T09:18:58.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.964+0000 7f3dff58d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3df80b2130 con 0x7f3df81f84c0 2024-09-19T09:18:58.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.964+0000 7f3dfd329640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de4004800 0x7f3df8152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:58.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.964+0000 7f3dfd329640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de4004800 0x7f3df8152f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53366/0 (socket says 172.21.15.18:53366) 2024-09-19T09:18:58.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.964+0000 7f3dfd329640 1 -- 172.21.15.18:0/1252937771 learned_addr learned my addr 172.21.15.18:0/1252937771 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:18:58.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.964+0000 7f3dfdb2a640 1 --2- 172.21.15.18:0/1252937771 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3df81f84c0 0x7f3df81512f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:58.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.965+0000 7f3dfcb28640 1 --2- 172.21.15.18:0/1252937771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3df80b72c0 0x7f3df81f7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:58.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.965+0000 7f3dfd329640 1 -- 172.21.15.18:0/1252937771 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3df81f84c0 msgr2=0x7f3df81512f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:58.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.965+0000 7f3dfd329640 1 --2- 172.21.15.18:0/1252937771 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3df81f84c0 0x7f3df81512f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:58.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.965+0000 7f3dfd329640 1 -- 172.21.15.18:0/1252937771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3df80b72c0 msgr2=0x7f3df81f7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:58.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.965+0000 7f3dfd329640 1 --2- 172.21.15.18:0/1252937771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3df80b72c0 0x7f3df81f7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:58.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.965+0000 7f3dfd329640 1 -- 172.21.15.18:0/1252937771 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df81534c0 con 0x7f3de4004800 2024-09-19T09:18:58.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.965+0000 7f3dfcb28640 1 --2- 172.21.15.18:0/1252937771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3df80b72c0 0x7f3df81f7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:18:58.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.965+0000 7f3dfd329640 1 --2- 172.21.15.18:0/1252937771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de4004800 0x7f3df8152f80 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f3df4011a70 tx=0x7f3df4011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:58.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.965+0000 7f3dedffb640 1 -- 172.21.15.18:0/1252937771 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df400fb50 con 0x7f3de4004800 2024-09-19T09:18:58.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.965+0000 7f3dedffb640 1 -- 172.21.15.18:0/1252937771 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df400fcf0 con 0x7f3de4004800 2024-09-19T09:18:58.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.965+0000 7f3dff58d640 1 -- 172.21.15.18:0/1252937771 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3df80b7830 con 0x7f3de4004800 2024-09-19T09:18:58.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.965+0000 7f3dedffb640 1 -- 172.21.15.18:0/1252937771 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3df400fea0 con 0x7f3de4004800 2024-09-19T09:18:58.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.965+0000 7f3dff58d640 1 -- 172.21.15.18:0/1252937771 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3df80b7df0 con 0x7f3de4004800 2024-09-19T09:18:58.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.966+0000 7f3dff58d640 1 -- 172.21.15.18:0/1252937771 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3df81f88d0 con 0x7f3de4004800 2024-09-19T09:18:58.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.967+0000 7f3dedffb640 1 -- 172.21.15.18:0/1252937771 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3df4012040 con 0x7f3de4004800 2024-09-19T09:18:58.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.968+0000 7f3dedffb640 1 --2- 172.21.15.18:0/1252937771 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3ddc06c2e0 0x7f3ddc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:18:58.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.968+0000 7f3dedffb640 1 -- 172.21.15.18:0/1252937771 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 5357+0+0 (secure 0 0 0) 0x7f3df408ba60 con 0x7f3de4004800 2024-09-19T09:18:58.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.968+0000 7f3dfcb28640 1 --2- 172.21.15.18:0/1252937771 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3ddc06c2e0 0x7f3ddc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:18:58.971 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.969+0000 7f3dfcb28640 1 --2- 172.21.15.18:0/1252937771 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3ddc06c2e0 0x7f3ddc06e7a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3de8033000 tx=0x7f3de8009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:18:58.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:58.972+0000 7f3dedffb640 1 -- 172.21.15.18:0/1252937771 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3df81f88d0 con 0x7f3de4004800 2024-09-19T09:18:59.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:59.156+0000 7f3dff58d640 1 -- 172.21.15.18:0/1252937771 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3df8070e90 con 0x7f3de4004800 2024-09-19T09:18:59.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:59.832+0000 7f3dedffb640 1 -- 172.21.15.18:0/1252937771 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v114) ==== 169+0+0 (secure 0 0 0) 0x7f3df4019030 con 0x7f3de4004800 2024-09-19T09:18:59.902 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' removed 2024-09-19T09:18:59.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:59.838+0000 7f3dff58d640 1 -- 172.21.15.18:0/1252937771 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3ddc06c2e0 msgr2=0x7f3ddc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:59.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:59.838+0000 7f3dff58d640 1 --2- 172.21.15.18:0/1252937771 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3ddc06c2e0 0x7f3ddc06e7a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f3de8033000 tx=0x7f3de8009030 comp rx=0 tx=0).stop 2024-09-19T09:18:59.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:59.838+0000 7f3dff58d640 1 -- 172.21.15.18:0/1252937771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de4004800 msgr2=0x7f3df8152f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:18:59.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:59.838+0000 7f3dff58d640 1 --2- 172.21.15.18:0/1252937771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de4004800 0x7f3df8152f80 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f3df4011a70 tx=0x7f3df4011f30 comp rx=0 tx=0).stop 2024-09-19T09:18:59.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:59.839+0000 7f3dff58d640 1 -- 172.21.15.18:0/1252937771 shutdown_connections 2024-09-19T09:18:59.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:59.839+0000 7f3dff58d640 1 --2- 172.21.15.18:0/1252937771 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3ddc06c2e0 0x7f3ddc06e7a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:59.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:59.839+0000 7f3dff58d640 1 --2- 172.21.15.18:0/1252937771 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3df81f84c0 0x7f3df81512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:59.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:59.839+0000 7f3dff58d640 1 --2- 172.21.15.18:0/1252937771 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3df80b72c0 0x7f3df81f7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:18:59.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:59.839+0000 7f3dff58d640 1 --2- 172.21.15.18:0/1252937771 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de4004800 0x7f3df8152f80 secure :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f3df4011a70 tx=0x7f3df4011f30 comp rx=0 tx=0).stop 2024-09-19T09:18:59.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:59.839+0000 7f3dff58d640 1 -- 172.21.15.18:0/1252937771 >> 172.21.15.18:0/1252937771 conn(0x7f3df80b4560 msgr2=0x7f3df80d2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:18:59.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:59.840+0000 7f3dff58d640 1 -- 172.21.15.18:0/1252937771 shutdown_connections 2024-09-19T09:18:59.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:18:59.840+0000 7f3dff58d640 1 -- 172.21.15.18:0/1252937771 wait complete. 2024-09-19T09:18:59.905 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-19T09:19:00.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.025+0000 7f5e1a376640 1 Processor -- start 2024-09-19T09:19:00.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.025+0000 7f5e1a376640 1 -- start start 2024-09-19T09:19:00.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.026+0000 7f5e1a376640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e140af8d0 0x7f5e140afd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.026+0000 7f5e1a376640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e1415fef0 con 0x7f5e140b73b0 2024-09-19T09:19:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.026+0000 7f5e1a376640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e140b68d0 con 0x7f5e1406f7e0 2024-09-19T09:19:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.026+0000 7f5e1a376640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5e140b6f20 con 0x7f5e140af8d0 2024-09-19T09:19:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.026+0000 7f5e18913640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f5e140b73b0 0x7f5e1415f170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:45952/0 (socket says 172.21.15.18:45952) 2024-09-19T09:19:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.026+0000 7f5e18913640 1 -- 172.21.15.18:0/1524441026 learned_addr learned my addr 172.21.15.18:0/1524441026 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.026+0000 7f5e137fe640 1 --2- 172.21.15.18:0/1524441026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e140af8d0 0x7f5e140afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.026+0000 7f5e12ffd640 1 -- 172.21.15.18:0/1524441026 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2328155663 0 0) 0x7f5e1415fef0 con 0x7f5e140b73b0 2024-09-19T09:19:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.026+0000 7f5e12ffd640 1 -- 172.21.15.18:0/1524441026 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5dfc003520 con 0x7f5e140b73b0 2024-09-19T09:19:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.026+0000 7f5e12ffd640 1 -- 172.21.15.18:0/1524441026 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1822270403 0 0) 0x7f5dfc003520 con 0x7f5e140b73b0 2024-09-19T09:19:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.026+0000 7f5e12ffd640 1 -- 172.21.15.18:0/1524441026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e140af8d0 msgr2=0x7f5e140afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.026+0000 7f5e12ffd640 1 --2- 172.21.15.18:0/1524441026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e140af8d0 0x7f5e140afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.026+0000 7f5e12ffd640 1 -- 172.21.15.18:0/1524441026 >> v1:172.21.15.162:6789/0 conn(0x7f5e1406f7e0 legacy=0x7f5e1406fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.026+0000 7f5e12ffd640 1 -- 172.21.15.18:0/1524441026 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e140b6bb0 con 0x7f5e140b73b0 2024-09-19T09:19:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.027+0000 7f5e12ffd640 1 -- 172.21.15.18:0/1524441026 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f5e0c0019f0 con 0x7f5e140b73b0 2024-09-19T09:19:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.027+0000 7f5e12ffd640 1 -- 172.21.15.18:0/1524441026 >> v1:172.21.15.18:6789/0 conn(0x7f5e140b73b0 legacy=0x7f5e1415f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:00.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.027+0000 7f5e12ffd640 1 --2- 172.21.15.18:0/1524441026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dfc0039e0 0x7f5dfc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:00.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.027+0000 7f5e12ffd640 1 --2- 172.21.15.18:0/1524441026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dfc004800 0x7f5dfc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:00.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.027+0000 7f5e12ffd640 1 --2- 172.21.15.18:0/1524441026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e140af8d0 0x7f5dfc0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:00.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.027+0000 7f5e12ffd640 1 -- 172.21.15.18:0/1524441026 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5e140b6f20 con 0x7f5dfc004800 2024-09-19T09:19:00.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.027+0000 7f5e12ffd640 1 -- 172.21.15.18:0/1524441026 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5dfc00bad0 con 0x7f5dfc0039e0 2024-09-19T09:19:00.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.027+0000 7f5e12ffd640 1 -- 172.21.15.18:0/1524441026 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5dfc00bcd0 con 0x7f5e140af8d0 2024-09-19T09:19:00.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.027+0000 7f5e137fe640 1 --2- 172.21.15.18:0/1524441026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dfc004800 0x7f5dfc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:00.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.027+0000 7f5e18913640 1 --2- 172.21.15.18:0/1524441026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e140af8d0 0x7f5dfc0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:00.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.027+0000 7f5e13fff640 1 --2- 172.21.15.18:0/1524441026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dfc0039e0 0x7f5dfc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:00.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.027+0000 7f5e137fe640 1 -- 172.21.15.18:0/1524441026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e140af8d0 msgr2=0x7f5dfc0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:00.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.027+0000 7f5e137fe640 1 --2- 172.21.15.18:0/1524441026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e140af8d0 0x7f5dfc0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:00.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.027+0000 7f5e137fe640 1 -- 172.21.15.18:0/1524441026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dfc0039e0 msgr2=0x7f5dfc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:00.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.027+0000 7f5e137fe640 1 --2- 172.21.15.18:0/1524441026 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dfc0039e0 0x7f5dfc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:00.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.027+0000 7f5e137fe640 1 -- 172.21.15.18:0/1524441026 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dfc003520 con 0x7f5dfc004800 2024-09-19T09:19:00.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.027+0000 7f5e18913640 1 --2- 172.21.15.18:0/1524441026 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e140af8d0 0x7f5dfc0051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:00.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.028+0000 7f5e137fe640 1 --2- 172.21.15.18:0/1524441026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dfc004800 0x7f5dfc004c80 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f5e0800ba10 tx=0x7f5dfc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d2e99d5e8374fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.028+0000 7f5e12ffd640 1 -- 172.21.15.18:0/1524441026 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e08030070 con 0x7f5dfc004800 2024-09-19T09:19:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.028+0000 7f5e12ffd640 1 -- 172.21.15.18:0/1524441026 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e0802adb0 con 0x7f5dfc004800 2024-09-19T09:19:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.028+0000 7f5e12ffd640 1 -- 172.21.15.18:0/1524441026 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e0800b610 con 0x7f5dfc004800 2024-09-19T09:19:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.028+0000 7f5e1a376640 1 -- 172.21.15.18:0/1524441026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dfc004800 msgr2=0x7f5dfc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.028+0000 7f5e1a376640 1 --2- 172.21.15.18:0/1524441026 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dfc004800 0x7f5dfc004c80 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f5e0800ba10 tx=0x7f5dfc005830 comp rx=0 tx=0).stop 2024-09-19T09:19:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.028+0000 7f5e18913640 1 -- 172.21.15.18:0/1524441026 reap_dead start 2024-09-19T09:19:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.029+0000 7f5e1a376640 1 -- 172.21.15.18:0/1524441026 shutdown_connections 2024-09-19T09:19:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.029+0000 7f5e1a376640 1 -- 172.21.15.18:0/1524441026 >> 172.21.15.18:0/1524441026 conn(0x7f5e14073c80 msgr2=0x7f5e1409b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.029+0000 7f5e1a376640 1 -- 172.21.15.18:0/1524441026 shutdown_connections 2024-09-19T09:19:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.029+0000 7f5e1a376640 1 -- 172.21.15.18:0/1524441026 wait complete. 2024-09-19T09:19:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.030+0000 7f5e1a376640 1 Processor -- start 2024-09-19T09:19:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.030+0000 7f5e1a376640 1 -- start start 2024-09-19T09:19:00.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.031+0000 7f5e1a376640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dfc004800 0x7f5e140b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:00.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.031+0000 7f5e1a376640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e141579d0 0x7f5e14157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:00.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.031+0000 7f5e1a376640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e140b2ce0 0x7f5e140b3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:00.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.031+0000 7f5e1a376640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5e14159620 con 0x7f5e140b2ce0 2024-09-19T09:19:00.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.031+0000 7f5e1a376640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5e141594a0 con 0x7f5dfc004800 2024-09-19T09:19:00.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.031+0000 7f5e1a376640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5e140afd30 con 0x7f5e141579d0 2024-09-19T09:19:00.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.031+0000 7f5e18913640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e140b2ce0 0x7f5e140b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:00.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.031+0000 7f5e18913640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e140b2ce0 0x7f5e140b3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53390/0 (socket says 172.21.15.18:53390) 2024-09-19T09:19:00.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.031+0000 7f5e18913640 1 -- 172.21.15.18:0/1803951591 learned_addr learned my addr 172.21.15.18:0/1803951591 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:00.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.031+0000 7f5e137fe640 1 --2- 172.21.15.18:0/1803951591 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e141579d0 0x7f5e14157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:00.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.031+0000 7f5e13fff640 1 --2- 172.21.15.18:0/1803951591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dfc004800 0x7f5e140b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:00.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.031+0000 7f5e18913640 1 -- 172.21.15.18:0/1803951591 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e141579d0 msgr2=0x7f5e14157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:00.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.031+0000 7f5e18913640 1 --2- 172.21.15.18:0/1803951591 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e141579d0 0x7f5e14157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:00.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.031+0000 7f5e18913640 1 -- 172.21.15.18:0/1803951591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dfc004800 msgr2=0x7f5e140b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:00.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.031+0000 7f5e18913640 1 --2- 172.21.15.18:0/1803951591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dfc004800 0x7f5e140b3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:00.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.031+0000 7f5e18913640 1 -- 172.21.15.18:0/1803951591 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e140b44a0 con 0x7f5e140b2ce0 2024-09-19T09:19:00.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.031+0000 7f5e18913640 1 --2- 172.21.15.18:0/1803951591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e140b2ce0 0x7f5e140b3160 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c001350 tx=0x7f5e0c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:00.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.032+0000 7f5e10ff9640 1 -- 172.21.15.18:0/1803951591 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c007ad0 con 0x7f5e140b2ce0 2024-09-19T09:19:00.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.032+0000 7f5e10ff9640 1 -- 172.21.15.18:0/1803951591 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e0c00eda0 con 0x7f5e140b2ce0 2024-09-19T09:19:00.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.032+0000 7f5e1a376640 1 -- 172.21.15.18:0/1803951591 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e14150cb0 con 0x7f5e140b2ce0 2024-09-19T09:19:00.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.032+0000 7f5e10ff9640 1 -- 172.21.15.18:0/1803951591 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c014650 con 0x7f5e140b2ce0 2024-09-19T09:19:00.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.032+0000 7f5e1a376640 1 -- 172.21.15.18:0/1803951591 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e14151270 con 0x7f5e140b2ce0 2024-09-19T09:19:00.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.033+0000 7f5e1a376640 1 -- 172.21.15.18:0/1803951591 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e140b7860 con 0x7f5e140b2ce0 2024-09-19T09:19:00.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.033+0000 7f5e10ff9640 1 -- 172.21.15.18:0/1803951591 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5e0c0147f0 con 0x7f5e140b2ce0 2024-09-19T09:19:00.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.034+0000 7f5e10ff9640 1 --2- 172.21.15.18:0/1803951591 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5e0006c2b0 0x7f5e0006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:00.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.034+0000 7f5e10ff9640 1 -- 172.21.15.18:0/1803951591 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 4943+0+0 (secure 0 0 0) 0x7f5e0c08ae80 con 0x7f5e140b2ce0 2024-09-19T09:19:00.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.034+0000 7f5e13fff640 1 --2- 172.21.15.18:0/1803951591 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5e0006c2b0 0x7f5e0006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:00.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.035+0000 7f5e13fff640 1 --2- 172.21.15.18:0/1803951591 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5e0006c2b0 0x7f5e0006e770 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5e04007fd0 tx=0x7f5e04009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:00.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.038+0000 7f5e10ff9640 1 -- 172.21.15.18:0/1803951591 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5e0c059330 con 0x7f5e140b2ce0 2024-09-19T09:19:00.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.219+0000 7f5e1a376640 1 -- 172.21.15.18:0/1803951591 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f5e140b7e60 con 0x7f5e140b2ce0 2024-09-19T09:19:00.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.222+0000 7f5e10ff9640 1 -- 172.21.15.18:0/1803951591 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f5e0c05d630 con 0x7f5e140b2ce0 2024-09-19T09:19:00.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.224+0000 7f5e1a376640 1 -- 172.21.15.18:0/1803951591 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5e0006c2b0 msgr2=0x7f5e0006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:00.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.224+0000 7f5e1a376640 1 --2- 172.21.15.18:0/1803951591 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5e0006c2b0 0x7f5e0006e770 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5e04007fd0 tx=0x7f5e04009040 comp rx=0 tx=0).stop 2024-09-19T09:19:00.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.224+0000 7f5e1a376640 1 -- 172.21.15.18:0/1803951591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e140b2ce0 msgr2=0x7f5e140b3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:00.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.224+0000 7f5e1a376640 1 --2- 172.21.15.18:0/1803951591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e140b2ce0 0x7f5e140b3160 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f5e0c001350 tx=0x7f5e0c00e530 comp rx=0 tx=0).stop 2024-09-19T09:19:00.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.225+0000 7f5e1a376640 1 -- 172.21.15.18:0/1803951591 shutdown_connections 2024-09-19T09:19:00.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.225+0000 7f5e1a376640 1 --2- 172.21.15.18:0/1803951591 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5e0006c2b0 0x7f5e0006e770 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:00.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.225+0000 7f5e1a376640 1 --2- 172.21.15.18:0/1803951591 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5e140b2ce0 0x7f5e140b3160 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:00.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.225+0000 7f5e1a376640 1 --2- 172.21.15.18:0/1803951591 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5e141579d0 0x7f5e14157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:00.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.225+0000 7f5e1a376640 1 --2- 172.21.15.18:0/1803951591 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5dfc004800 0x7f5e140b3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:00.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.225+0000 7f5e1a376640 1 -- 172.21.15.18:0/1803951591 >> 172.21.15.18:0/1803951591 conn(0x7f5e14073c80 msgr2=0x7f5e1406d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:00.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.225+0000 7f5e1a376640 1 -- 172.21.15.18:0/1803951591 shutdown_connections 2024-09-19T09:19:00.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.225+0000 7f5e1a376640 1 -- 172.21.15.18:0/1803951591 wait complete. 2024-09-19T09:19:00.237 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2024-09-19T09:19:00.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.338+0000 7fa93a2d0640 1 Processor -- start 2024-09-19T09:19:00.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.338+0000 7fa93a2d0640 1 -- start start 2024-09-19T09:19:00.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.339+0000 7fa93a2d0640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa93415ecc0 0x7fa9340d3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:00.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.339+0000 7fa93a2d0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa9340d1b60 0x7fa9340b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:00.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.339+0000 7fa93a2d0640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9340d3b20 con 0x7fa9340d57a0 2024-09-19T09:19:00.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.339+0000 7fa93a2d0640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fa9340b42f0 con 0x7fa9340d1b60 2024-09-19T09:19:00.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.339+0000 7fa93a2d0640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa9340b45d0 con 0x7fa93415ecc0 2024-09-19T09:19:00.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.339+0000 7fa93886d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa9340d1b60 0x7fa9340b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:00.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.339+0000 7fa9337fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa9340d57a0 0x7fa9340d1450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:45954/0 (socket says 172.21.15.18:45954) 2024-09-19T09:19:00.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.339+0000 7fa9337fe640 1 -- 172.21.15.18:0/832236370 learned_addr learned my addr 172.21.15.18:0/832236370 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:00.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.339+0000 7fa933fff640 1 --2- 172.21.15.18:0/832236370 >> v2:172.21.15.162:3300/0 conn(0x7fa93415ecc0 0x7fa9340d3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:00.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.340+0000 7fa93886d640 1 -- 172.21.15.18:0/832236370 >> v2:172.21.15.162:3300/0 conn(0x7fa93415ecc0 msgr2=0x7fa9340d3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:00.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.340+0000 7fa93886d640 1 --2- 172.21.15.18:0/832236370 >> v2:172.21.15.162:3300/0 conn(0x7fa93415ecc0 0x7fa9340d3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:00.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.340+0000 7fa93886d640 1 -- 172.21.15.18:0/832236370 >> v1:172.21.15.18:6789/0 conn(0x7fa9340d57a0 legacy=0x7fa9340d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:00.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.340+0000 7fa932ffd640 1 -- 172.21.15.18:0/832236370 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2807675253 0 0) 0x7fa9340d3b20 con 0x7fa9340d57a0 2024-09-19T09:19:00.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.340+0000 7fa93886d640 1 -- 172.21.15.18:0/832236370 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9340b48b0 con 0x7fa9340d1b60 2024-09-19T09:19:00.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.340+0000 7fa93886d640 1 --2- 172.21.15.18:0/832236370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9340d1b60 0x7fa9340b50b0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fa9340d4b30 tx=0x7fa92c02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b052320d07ab39 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:00.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.340+0000 7fa932ffd640 1 -- 172.21.15.18:0/832236370 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa92c007740 con 0x7fa9340d1b60 2024-09-19T09:19:00.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.341+0000 7fa932ffd640 1 -- 172.21.15.18:0/832236370 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa92c0078e0 con 0x7fa9340d1b60 2024-09-19T09:19:00.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.341+0000 7fa932ffd640 1 -- 172.21.15.18:0/832236370 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa92c007cb0 con 0x7fa9340d1b60 2024-09-19T09:19:00.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.341+0000 7fa93a2d0640 1 -- 172.21.15.18:0/832236370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9340d1b60 msgr2=0x7fa9340b50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:00.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.341+0000 7fa93a2d0640 1 --2- 172.21.15.18:0/832236370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9340d1b60 0x7fa9340b50b0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fa9340d4b30 tx=0x7fa92c02a5f0 comp rx=0 tx=0).stop 2024-09-19T09:19:00.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.341+0000 7fa93a2d0640 1 -- 172.21.15.18:0/832236370 shutdown_connections 2024-09-19T09:19:00.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.341+0000 7fa93a2d0640 1 --2- 172.21.15.18:0/832236370 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9340d1b60 0x7fa9340b50b0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:00.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.341+0000 7fa93a2d0640 1 --2- 172.21.15.18:0/832236370 >> v2:172.21.15.162:3300/0 conn(0x7fa93415ecc0 0x7fa9340d3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:00.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.341+0000 7fa93a2d0640 1 -- 172.21.15.18:0/832236370 >> 172.21.15.18:0/832236370 conn(0x7fa9340d4bd0 msgr2=0x7fa9340d4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:00.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.341+0000 7fa93a2d0640 1 -- 172.21.15.18:0/832236370 shutdown_connections 2024-09-19T09:19:00.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.341+0000 7fa93a2d0640 1 -- 172.21.15.18:0/832236370 wait complete. 2024-09-19T09:19:00.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.342+0000 7fa93a2d0640 1 Processor -- start 2024-09-19T09:19:00.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.343+0000 7fa93a2d0640 1 -- start start 2024-09-19T09:19:00.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.343+0000 7fa93a2d0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9340d1b60 0x7fa93415e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:00.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.343+0000 7fa93a2d0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9340d57a0 0x7fa9341613a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:00.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.343+0000 7fa93a2d0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa93415ecc0 0x7fa9341618e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:00.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.343+0000 7fa93a2d0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa93415f220 con 0x7fa93415ecc0 2024-09-19T09:19:00.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.343+0000 7fa93a2d0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa93415f0a0 con 0x7fa9340d57a0 2024-09-19T09:19:00.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.343+0000 7fa93a2d0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa9340d36b0 con 0x7fa9340d1b60 2024-09-19T09:19:00.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.343+0000 7fa93886d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa93415ecc0 0x7fa9341618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:00.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.343+0000 7fa93886d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa93415ecc0 0x7fa9341618e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53410/0 (socket says 172.21.15.18:53410) 2024-09-19T09:19:00.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.343+0000 7fa93886d640 1 -- 172.21.15.18:0/738990750 learned_addr learned my addr 172.21.15.18:0/738990750 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:00.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.343+0000 7fa9337fe640 1 --2- 172.21.15.18:0/738990750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9340d57a0 0x7fa9341613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:00.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.344+0000 7fa933fff640 1 --2- 172.21.15.18:0/738990750 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9340d1b60 0x7fa93415e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:00.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.344+0000 7fa93886d640 1 -- 172.21.15.18:0/738990750 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9340d1b60 msgr2=0x7fa93415e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:00.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.344+0000 7fa93886d640 1 --2- 172.21.15.18:0/738990750 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9340d1b60 0x7fa93415e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:00.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.344+0000 7fa93886d640 1 -- 172.21.15.18:0/738990750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9340d57a0 msgr2=0x7fa9341613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:00.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.344+0000 7fa93886d640 1 --2- 172.21.15.18:0/738990750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9340d57a0 0x7fa9341613a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:00.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.344+0000 7fa93886d640 1 -- 172.21.15.18:0/738990750 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9340ca7e0 con 0x7fa93415ecc0 2024-09-19T09:19:00.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.344+0000 7fa9337fe640 1 --2- 172.21.15.18:0/738990750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9340d57a0 0x7fa9341613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:00.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.344+0000 7fa93886d640 1 --2- 172.21.15.18:0/738990750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa93415ecc0 0x7fa9341618e0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fa92c02abe0 tx=0x7fa92c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:00.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.344+0000 7fa930ff9640 1 -- 172.21.15.18:0/738990750 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa92c040070 con 0x7fa93415ecc0 2024-09-19T09:19:00.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.344+0000 7fa930ff9640 1 -- 172.21.15.18:0/738990750 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa92c031bc0 con 0x7fa93415ecc0 2024-09-19T09:19:00.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.344+0000 7fa93a2d0640 1 -- 172.21.15.18:0/738990750 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9340caac0 con 0x7fa93415ecc0 2024-09-19T09:19:00.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.344+0000 7fa930ff9640 1 -- 172.21.15.18:0/738990750 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa92c045460 con 0x7fa93415ecc0 2024-09-19T09:19:00.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.344+0000 7fa93a2d0640 1 -- 172.21.15.18:0/738990750 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9340cb080 con 0x7fa93415ecc0 2024-09-19T09:19:00.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.345+0000 7fa93a2d0640 1 -- 172.21.15.18:0/738990750 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9340d3170 con 0x7fa93415ecc0 2024-09-19T09:19:00.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.345+0000 7fa930ff9640 1 -- 172.21.15.18:0/738990750 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa92c039040 con 0x7fa93415ecc0 2024-09-19T09:19:00.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.346+0000 7fa930ff9640 1 --2- 172.21.15.18:0/738990750 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa92006c2b0 0x7fa92006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:00.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.346+0000 7fa930ff9640 1 -- 172.21.15.18:0/738990750 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 4943+0+0 (secure 0 0 0) 0x7fa92c0aca20 con 0x7fa93415ecc0 2024-09-19T09:19:00.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.346+0000 7fa933fff640 1 --2- 172.21.15.18:0/738990750 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa92006c2b0 0x7fa92006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:00.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.347+0000 7fa933fff640 1 --2- 172.21.15.18:0/738990750 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa92006c2b0 0x7fa92006e770 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa924006fd0 tx=0x7fa924008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:00.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.350+0000 7fa930ff9640 1 -- 172.21.15.18:0/738990750 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa92c07b520 con 0x7fa93415ecc0 2024-09-19T09:19:00.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.593+0000 7fa93a2d0640 1 -- 172.21.15.18:0/738990750 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) -- 0x7fa934069730 con 0x7fa93415ecc0 2024-09-19T09:19:00.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.833+0000 7fa930ff9640 1 -- 172.21.15.18:0/738990750 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v284) ==== 137+0+0 (secure 0 0 0) 0x7fa92c07ae20 con 0x7fa93415ecc0 2024-09-19T09:19:00.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.836+0000 7fa93a2d0640 1 -- 172.21.15.18:0/738990750 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa92006c2b0 msgr2=0x7fa92006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:00.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.836+0000 7fa93a2d0640 1 --2- 172.21.15.18:0/738990750 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa92006c2b0 0x7fa92006e770 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa924006fd0 tx=0x7fa924008040 comp rx=0 tx=0).stop 2024-09-19T09:19:00.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.836+0000 7fa93a2d0640 1 -- 172.21.15.18:0/738990750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa93415ecc0 msgr2=0x7fa9341618e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:00.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.836+0000 7fa93a2d0640 1 --2- 172.21.15.18:0/738990750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa93415ecc0 0x7fa9341618e0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fa92c02abe0 tx=0x7fa92c004a40 comp rx=0 tx=0).stop 2024-09-19T09:19:00.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.836+0000 7fa93a2d0640 1 -- 172.21.15.18:0/738990750 shutdown_connections 2024-09-19T09:19:00.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.836+0000 7fa93a2d0640 1 --2- 172.21.15.18:0/738990750 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa92006c2b0 0x7fa92006e770 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:00.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.836+0000 7fa93a2d0640 1 --2- 172.21.15.18:0/738990750 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa93415ecc0 0x7fa9341618e0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:00.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.836+0000 7fa93a2d0640 1 --2- 172.21.15.18:0/738990750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9340d57a0 0x7fa9341613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:00.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.836+0000 7fa93a2d0640 1 --2- 172.21.15.18:0/738990750 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9340d1b60 0x7fa93415e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:00.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.836+0000 7fa93a2d0640 1 -- 172.21.15.18:0/738990750 >> 172.21.15.18:0/738990750 conn(0x7fa9340d4bd0 msgr2=0x7fa9340b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:00.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.836+0000 7fa93a2d0640 1 -- 172.21.15.18:0/738990750 shutdown_connections 2024-09-19T09:19:00.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.836+0000 7fa93a2d0640 1 -- 172.21.15.18:0/738990750 wait complete. 2024-09-19T09:19:00.848 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2024-09-19T09:19:00.848 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestQuotaFull) That when an OSD epoch barrier is set on an MDS, subsequently 2024-09-19T09:19:00.849 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestQuotaFull) 2024-09-19T09:19:00.849 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:19:00.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.951+0000 7f68faa74640 1 Processor -- start 2024-09-19T09:19:00.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.951+0000 7f68faa74640 1 -- start start 2024-09-19T09:19:00.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.952+0000 7f68faa74640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f68f40cf010 0x7f68f40cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:00.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.952+0000 7f68faa74640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68f4162ba0 0x7f68f4164f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:00.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.952+0000 7f68faa74640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68f415c4f0 con 0x7f68f4152210 2024-09-19T09:19:00.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.952+0000 7f68faa74640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f68f415b730 con 0x7f68f40cf010 2024-09-19T09:19:00.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.952+0000 7f68faa74640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f68f415ba10 con 0x7f68f4162ba0 2024-09-19T09:19:00.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.952+0000 7f68f8810640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f68f4152210 0x7f68f4071e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:45964/0 (socket says 172.21.15.18:45964) 2024-09-19T09:19:00.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.952+0000 7f68f8810640 1 -- 172.21.15.18:0/1688973748 learned_addr learned my addr 172.21.15.18:0/1688973748 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:00.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.952+0000 7f68f37fe640 1 -- 172.21.15.18:0/1688973748 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3080874499 0 0) 0x7f68f415c4f0 con 0x7f68f4152210 2024-09-19T09:19:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.952+0000 7f68f9011640 1 --2- 172.21.15.18:0/1688973748 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68f4162ba0 0x7f68f4164f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.952+0000 7f68f37fe640 1 -- 172.21.15.18:0/1688973748 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68e0003520 con 0x7f68f4152210 2024-09-19T09:19:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.952+0000 7f68f3fff640 1 --2- 172.21.15.18:0/1688973748 >> v2:172.21.15.162:3300/0 conn(0x7f68f40cf010 0x7f68f40cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.953+0000 7f68f37fe640 1 -- 172.21.15.18:0/1688973748 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1647275995 0 0) 0x7f68e0003520 con 0x7f68f4152210 2024-09-19T09:19:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.953+0000 7f68f37fe640 1 -- 172.21.15.18:0/1688973748 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68f4162ba0 msgr2=0x7f68f4164f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.953+0000 7f68f37fe640 1 --2- 172.21.15.18:0/1688973748 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68f4162ba0 0x7f68f4164f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.953+0000 7f68f37fe640 1 -- 172.21.15.18:0/1688973748 >> v2:172.21.15.162:3300/0 conn(0x7f68f40cf010 msgr2=0x7f68f40cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.953+0000 7f68f37fe640 1 --2- 172.21.15.18:0/1688973748 >> v2:172.21.15.162:3300/0 conn(0x7f68f40cf010 0x7f68f40cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.953+0000 7f68f37fe640 1 -- 172.21.15.18:0/1688973748 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f415bcf0 con 0x7f68f4152210 2024-09-19T09:19:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.953+0000 7f68f37fe640 1 -- 172.21.15.18:0/1688973748 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f68ec001670 con 0x7f68f4152210 2024-09-19T09:19:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.953+0000 7f68f37fe640 1 -- 172.21.15.18:0/1688973748 >> v1:172.21.15.18:6789/0 conn(0x7f68f4152210 legacy=0x7f68f4071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.953+0000 7f68f37fe640 1 --2- 172.21.15.18:0/1688973748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68e00039b0 0x7f68e0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:00.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.953+0000 7f68f37fe640 1 --2- 172.21.15.18:0/1688973748 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68f4162ba0 0x7f68e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.953+0000 7f68f37fe640 1 --2- 172.21.15.18:0/1688973748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68e0004d40 0x7f68e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.953+0000 7f68f37fe640 1 -- 172.21.15.18:0/1688973748 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f68f415b730 con 0x7f68e0004d40 2024-09-19T09:19:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.953+0000 7f68f37fe640 1 -- 172.21.15.18:0/1688973748 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f68f415ba10 con 0x7f68e00039b0 2024-09-19T09:19:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.953+0000 7f68f37fe640 1 -- 172.21.15.18:0/1688973748 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f68e000b9c0 con 0x7f68f4162ba0 2024-09-19T09:19:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.953+0000 7f68f9011640 1 --2- 172.21.15.18:0/1688973748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68e0004d40 0x7f68e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.953+0000 7f68f8810640 1 --2- 172.21.15.18:0/1688973748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68e00039b0 0x7f68e0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.953+0000 7f68f3fff640 1 --2- 172.21.15.18:0/1688973748 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68f4162ba0 0x7f68e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.953+0000 7f68f9011640 1 -- 172.21.15.18:0/1688973748 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68f4162ba0 msgr2=0x7f68e0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.953+0000 7f68f9011640 1 --2- 172.21.15.18:0/1688973748 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68f4162ba0 0x7f68e0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.953+0000 7f68f9011640 1 -- 172.21.15.18:0/1688973748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68e00039b0 msgr2=0x7f68e0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.953+0000 7f68f9011640 1 --2- 172.21.15.18:0/1688973748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68e00039b0 0x7f68e0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.953+0000 7f68f9011640 1 -- 172.21.15.18:0/1688973748 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68e0003520 con 0x7f68e0004d40 2024-09-19T09:19:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.953+0000 7f68f8810640 1 --2- 172.21.15.18:0/1688973748 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68e00039b0 0x7f68e0003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:00.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.954+0000 7f68f9011640 1 --2- 172.21.15.18:0/1688973748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68e0004d40 0x7f68e00051c0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f68dc009ac0 tx=0x7f68e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41940fef38f531f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:00.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.954+0000 7f68f37fe640 1 -- 172.21.15.18:0/1688973748 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68dc036070 con 0x7f68e0004d40 2024-09-19T09:19:00.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.954+0000 7f68f37fe640 1 -- 172.21.15.18:0/1688973748 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68dc031400 con 0x7f68e0004d40 2024-09-19T09:19:00.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.954+0000 7f68f37fe640 1 -- 172.21.15.18:0/1688973748 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68dc009690 con 0x7f68e0004d40 2024-09-19T09:19:00.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.954+0000 7f68faa74640 1 -- 172.21.15.18:0/1688973748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68e0004d40 msgr2=0x7f68e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:00.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.954+0000 7f68faa74640 1 --2- 172.21.15.18:0/1688973748 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68e0004d40 0x7f68e00051c0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f68dc009ac0 tx=0x7f68e0005830 comp rx=0 tx=0).stop 2024-09-19T09:19:00.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.954+0000 7f68f9011640 1 -- 172.21.15.18:0/1688973748 reap_dead start 2024-09-19T09:19:00.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.955+0000 7f68faa74640 1 -- 172.21.15.18:0/1688973748 shutdown_connections 2024-09-19T09:19:00.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.955+0000 7f68faa74640 1 -- 172.21.15.18:0/1688973748 >> 172.21.15.18:0/1688973748 conn(0x7f68f406bc10 msgr2=0x7f68f406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:00.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.955+0000 7f68faa74640 1 -- 172.21.15.18:0/1688973748 shutdown_connections 2024-09-19T09:19:00.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.955+0000 7f68faa74640 1 -- 172.21.15.18:0/1688973748 wait complete. 2024-09-19T09:19:00.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.956+0000 7f68faa74640 1 Processor -- start 2024-09-19T09:19:00.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.956+0000 7f68faa74640 1 -- start start 2024-09-19T09:19:00.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.957+0000 7f68faa74640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68e0004d40 0x7f68f4149e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:00.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.957+0000 7f68faa74640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68f4154470 0x7f68f414aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:00.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.957+0000 7f68faa74640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68f4147fb0 0x7f68f4148460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:00.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.957+0000 7f68faa74640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f68f40725a0 con 0x7f68f4154470 2024-09-19T09:19:00.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.957+0000 7f68faa74640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f68f406f380 con 0x7f68f4147fb0 2024-09-19T09:19:00.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.957+0000 7f68faa74640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f68f406e6c0 con 0x7f68e0004d40 2024-09-19T09:19:00.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.957+0000 7f68f3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68f4154470 0x7f68f414aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:00.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.957+0000 7f68f3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68f4154470 0x7f68f414aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53436/0 (socket says 172.21.15.18:53436) 2024-09-19T09:19:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.957+0000 7f68f3fff640 1 -- 172.21.15.18:0/3408129241 learned_addr learned my addr 172.21.15.18:0/3408129241 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.957+0000 7f68f8810640 1 --2- 172.21.15.18:0/3408129241 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68e0004d40 0x7f68f4149e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.957+0000 7f68f9011640 1 --2- 172.21.15.18:0/3408129241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68f4147fb0 0x7f68f4148460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.957+0000 7f68f3fff640 1 -- 172.21.15.18:0/3408129241 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68e0004d40 msgr2=0x7f68f4149e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.957+0000 7f68f3fff640 1 --2- 172.21.15.18:0/3408129241 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68e0004d40 0x7f68f4149e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.957+0000 7f68f3fff640 1 -- 172.21.15.18:0/3408129241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68f4147fb0 msgr2=0x7f68f4148460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.957+0000 7f68f3fff640 1 --2- 172.21.15.18:0/3408129241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68f4147fb0 0x7f68f4148460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.957+0000 7f68f3fff640 1 -- 172.21.15.18:0/3408129241 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68f41548f0 con 0x7f68f4154470 2024-09-19T09:19:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.957+0000 7f68f9011640 1 --2- 172.21.15.18:0/3408129241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68f4147fb0 0x7f68f4148460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.957+0000 7f68f3fff640 1 --2- 172.21.15.18:0/3408129241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68f4154470 0x7f68f414aa90 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f68e4011e30 tx=0x7f68e400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.957+0000 7f68f17fa640 1 -- 172.21.15.18:0/3408129241 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e4015630 con 0x7f68f4154470 2024-09-19T09:19:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.957+0000 7f68f17fa640 1 -- 172.21.15.18:0/3408129241 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68e40157d0 con 0x7f68f4154470 2024-09-19T09:19:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.957+0000 7f68faa74640 1 -- 172.21.15.18:0/3408129241 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68f4154bc0 con 0x7f68f4154470 2024-09-19T09:19:00.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.958+0000 7f68f17fa640 1 -- 172.21.15.18:0/3408129241 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e4015ba0 con 0x7f68f4154470 2024-09-19T09:19:00.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.958+0000 7f68faa74640 1 -- 172.21.15.18:0/3408129241 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68f414eec0 con 0x7f68f4154470 2024-09-19T09:19:00.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.958+0000 7f68faa74640 1 -- 172.21.15.18:0/3408129241 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68f40cf4a0 con 0x7f68f4154470 2024-09-19T09:19:00.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.959+0000 7f68f17fa640 1 -- 172.21.15.18:0/3408129241 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f68e401d400 con 0x7f68f4154470 2024-09-19T09:19:00.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.959+0000 7f68f17fa640 1 --2- 172.21.15.18:0/3408129241 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f68d406c2b0 0x7f68d406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:00.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.959+0000 7f68f17fa640 1 -- 172.21.15.18:0/3408129241 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 4943+0+0 (secure 0 0 0) 0x7f68e408c430 con 0x7f68f4154470 2024-09-19T09:19:00.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.960+0000 7f68f8810640 1 --2- 172.21.15.18:0/3408129241 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f68d406c2b0 0x7f68d406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:00.963 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.960+0000 7f68f8810640 1 --2- 172.21.15.18:0/3408129241 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f68d406c2b0 0x7f68d406e770 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f68ec001050 tx=0x7f68ec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:00.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:00.964+0000 7f68f17fa640 1 -- 172.21.15.18:0/3408129241 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f68e4019030 con 0x7f68f4154470 2024-09-19T09:19:01.078 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:19:01.080 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:19:01.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.140+0000 7f68faa74640 1 -- 172.21.15.18:0/3408129241 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f68f41557d0 con 0x7f68f4154470 2024-09-19T09:19:01.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.141+0000 7f68f17fa640 1 -- 172.21.15.18:0/3408129241 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v114) ==== 74+0+13055 (secure 0 0 0) 0x7f68e4010040 con 0x7f68f4154470 2024-09-19T09:19:01.142 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:01.142 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":114,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:18:59.828852+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.162:6837/133611430":"2024-09-20T09:18:56.714301+0000","172.21.15.162:6835/133611430":"2024-09-20T09:18:56.714301+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:19:01.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.143+0000 7f68faa74640 1 -- 172.21.15.18:0/3408129241 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f68d406c2b0 msgr2=0x7f68d406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:01.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.143+0000 7f68faa74640 1 --2- 172.21.15.18:0/3408129241 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f68d406c2b0 0x7f68d406e770 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f68ec001050 tx=0x7f68ec009040 comp rx=0 tx=0).stop 2024-09-19T09:19:01.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.143+0000 7f68faa74640 1 -- 172.21.15.18:0/3408129241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68f4154470 msgr2=0x7f68f414aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:01.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.143+0000 7f68faa74640 1 --2- 172.21.15.18:0/3408129241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68f4154470 0x7f68f414aa90 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f68e4011e30 tx=0x7f68e400f580 comp rx=0 tx=0).stop 2024-09-19T09:19:01.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.143+0000 7f68faa74640 1 -- 172.21.15.18:0/3408129241 shutdown_connections 2024-09-19T09:19:01.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.143+0000 7f68faa74640 1 --2- 172.21.15.18:0/3408129241 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f68d406c2b0 0x7f68d406e770 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.143+0000 7f68faa74640 1 --2- 172.21.15.18:0/3408129241 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68f4147fb0 0x7f68f4148460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.143+0000 7f68faa74640 1 --2- 172.21.15.18:0/3408129241 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f68f4154470 0x7f68f414aa90 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.143+0000 7f68faa74640 1 --2- 172.21.15.18:0/3408129241 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f68e0004d40 0x7f68f4149e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.143+0000 7f68faa74640 1 -- 172.21.15.18:0/3408129241 >> 172.21.15.18:0/3408129241 conn(0x7f68f406bc10 msgr2=0x7f68f40cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:01.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.144+0000 7f68faa74640 1 -- 172.21.15.18:0/3408129241 shutdown_connections 2024-09-19T09:19:01.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.144+0000 7f68faa74640 1 -- 172.21.15.18:0/3408129241 wait complete. 2024-09-19T09:19:01.155 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T09:13:17.564717+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T09:19:01.156 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T09:19:01.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.300+0000 7f142a0d7640 1 Processor -- start 2024-09-19T09:19:01.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.300+0000 7f142a0d7640 1 -- start start 2024-09-19T09:19:01.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.301+0000 7f142a0d7640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1424073370 0x7f14240ce3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.301+0000 7f142a0d7640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1424073820 con 0x7f1424071df0 2024-09-19T09:19:01.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.301+0000 7f142a0d7640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14240722d0 con 0x7f142406e280 2024-09-19T09:19:01.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.301+0000 7f142a0d7640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f14240d1720 con 0x7f1424073370 2024-09-19T09:19:01.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.301+0000 7f1422ffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f1424071df0 0x7f14240d1010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:45966/0 (socket says 172.21.15.18:45966) 2024-09-19T09:19:01.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.301+0000 7f1422ffd640 1 -- 172.21.15.18:0/123972002 learned_addr learned my addr 172.21.15.18:0/123972002 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:01.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.301+0000 7f1423fff640 1 --2- 172.21.15.18:0/123972002 >> v2:172.21.15.18:3300/0 conn(0x7f1424073370 0x7f14240ce3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.301+0000 7f14227fc640 1 -- 172.21.15.18:0/123972002 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3632447630 0 0) 0x7f1424073820 con 0x7f1424071df0 2024-09-19T09:19:01.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.301+0000 7f14227fc640 1 -- 172.21.15.18:0/123972002 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f140c003520 con 0x7f1424071df0 2024-09-19T09:19:01.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.301+0000 7f1423fff640 1 -- 172.21.15.18:0/123972002 >> v1:172.21.15.162:6789/0 conn(0x7f142406e280 legacy=0x7f142406e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:01.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.301+0000 7f1423fff640 1 -- 172.21.15.18:0/123972002 >> v1:172.21.15.18:6789/0 conn(0x7f1424071df0 legacy=0x7f14240d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:01.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.301+0000 7f1423fff640 1 -- 172.21.15.18:0/123972002 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14240725b0 con 0x7f1424073370 2024-09-19T09:19:01.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.302+0000 7f1423fff640 1 --2- 172.21.15.18:0/123972002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1424073370 0x7f14240ce3d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f141c009d90 tx=0x7f141c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d696e961410fc74a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:01.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.302+0000 7f14227fc640 1 -- 172.21.15.18:0/123972002 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141c007740 con 0x7f1424073370 2024-09-19T09:19:01.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.302+0000 7f14227fc640 1 -- 172.21.15.18:0/123972002 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f141c0078e0 con 0x7f1424073370 2024-09-19T09:19:01.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.302+0000 7f14227fc640 1 -- 172.21.15.18:0/123972002 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141c007c90 con 0x7f1424073370 2024-09-19T09:19:01.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.303+0000 7f142a0d7640 1 -- 172.21.15.18:0/123972002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1424073370 msgr2=0x7f14240ce3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:01.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.303+0000 7f142a0d7640 1 --2- 172.21.15.18:0/123972002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1424073370 0x7f14240ce3d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f141c009d90 tx=0x7f141c02a6a0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.303+0000 7f142a0d7640 1 -- 172.21.15.18:0/123972002 shutdown_connections 2024-09-19T09:19:01.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.303+0000 7f142a0d7640 1 --2- 172.21.15.18:0/123972002 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1424073370 0x7f14240ce3d0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.303+0000 7f142a0d7640 1 -- 172.21.15.18:0/123972002 >> 172.21.15.18:0/123972002 conn(0x7f142406bc10 msgr2=0x7f142406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:01.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.303+0000 7f142a0d7640 1 -- 172.21.15.18:0/123972002 shutdown_connections 2024-09-19T09:19:01.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.303+0000 7f142a0d7640 1 -- 172.21.15.18:0/123972002 wait complete. 2024-09-19T09:19:01.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.304+0000 7f142a0d7640 1 Processor -- start 2024-09-19T09:19:01.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.304+0000 7f142a0d7640 1 -- start start 2024-09-19T09:19:01.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.305+0000 7f142a0d7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f142406e280 0x7f14241483a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.305+0000 7f142a0d7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1424071df0 0x7f14240b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.305+0000 7f142a0d7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1424073370 0x7f1424153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.305+0000 7f142a0d7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1424072e50 con 0x7f1424071df0 2024-09-19T09:19:01.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.305+0000 7f142a0d7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1424072b70 con 0x7f1424073370 2024-09-19T09:19:01.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.305+0000 7f142a0d7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f142415db60 con 0x7f142406e280 2024-09-19T09:19:01.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.305+0000 7f1422ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1424071df0 0x7f14240b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.305+0000 7f1422ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1424071df0 0x7f14240b3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53454/0 (socket says 172.21.15.18:53454) 2024-09-19T09:19:01.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.305+0000 7f1422ffd640 1 -- 172.21.15.18:0/4201468965 learned_addr learned my addr 172.21.15.18:0/4201468965 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:01.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.305+0000 7f14237fe640 1 --2- 172.21.15.18:0/4201468965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f142406e280 0x7f14241483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.305+0000 7f1423fff640 1 --2- 172.21.15.18:0/4201468965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1424073370 0x7f1424153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.305+0000 7f1422ffd640 1 -- 172.21.15.18:0/4201468965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f142406e280 msgr2=0x7f14241483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:01.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.305+0000 7f1422ffd640 1 --2- 172.21.15.18:0/4201468965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f142406e280 0x7f14241483a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.305+0000 7f1422ffd640 1 -- 172.21.15.18:0/4201468965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1424073370 msgr2=0x7f1424153040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:01.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.305+0000 7f1422ffd640 1 --2- 172.21.15.18:0/4201468965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1424073370 0x7f1424153040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.305+0000 7f1422ffd640 1 -- 172.21.15.18:0/4201468965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14240b0fa0 con 0x7f1424071df0 2024-09-19T09:19:01.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.305+0000 7f1423fff640 1 --2- 172.21.15.18:0/4201468965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1424073370 0x7f1424153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:01.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.306+0000 7f1422ffd640 1 --2- 172.21.15.18:0/4201468965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1424071df0 0x7f14240b3b10 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f141800c460 tx=0x7f141800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:01.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.306+0000 7f140bfff640 1 -- 172.21.15.18:0/4201468965 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1418017070 con 0x7f1424071df0 2024-09-19T09:19:01.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.306+0000 7f140bfff640 1 -- 172.21.15.18:0/4201468965 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1418005ce0 con 0x7f1424071df0 2024-09-19T09:19:01.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.306+0000 7f140bfff640 1 -- 172.21.15.18:0/4201468965 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1418007290 con 0x7f1424071df0 2024-09-19T09:19:01.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.306+0000 7f142a0d7640 1 -- 172.21.15.18:0/4201468965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14240b1280 con 0x7f1424071df0 2024-09-19T09:19:01.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.306+0000 7f142a0d7640 1 -- 172.21.15.18:0/4201468965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14240b1840 con 0x7f1424071df0 2024-09-19T09:19:01.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.307+0000 7f142a0d7640 1 -- 172.21.15.18:0/4201468965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f142406e660 con 0x7f1424071df0 2024-09-19T09:19:01.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.307+0000 7f140bfff640 1 -- 172.21.15.18:0/4201468965 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f141801a070 con 0x7f1424071df0 2024-09-19T09:19:01.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.308+0000 7f140bfff640 1 --2- 172.21.15.18:0/4201468965 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f141006c2e0 0x7f141006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.308+0000 7f140bfff640 1 -- 172.21.15.18:0/4201468965 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 4943+0+0 (secure 0 0 0) 0x7f141808a4e0 con 0x7f1424071df0 2024-09-19T09:19:01.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.308+0000 7f14237fe640 1 --2- 172.21.15.18:0/4201468965 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f141006c2e0 0x7f141006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.309+0000 7f14237fe640 1 --2- 172.21.15.18:0/4201468965 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f141006c2e0 0x7f141006e7a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1414004ea0 tx=0x7f1414009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:01.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.312+0000 7f140bfff640 1 -- 172.21.15.18:0/4201468965 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1418058ed0 con 0x7f1424071df0 2024-09-19T09:19:01.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.488+0000 7f142a0d7640 1 -- 172.21.15.18:0/4201468965 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f142415aa70 con 0x7f1424071df0 2024-09-19T09:19:01.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.489+0000 7f140bfff640 1 -- 172.21.15.18:0/4201468965 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v114) ==== 93+0+10 (secure 0 0 0) 0x7f14180587d0 con 0x7f1424071df0 2024-09-19T09:19:01.490 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-09-19T09:19:01.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.491+0000 7f142a0d7640 1 -- 172.21.15.18:0/4201468965 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f141006c2e0 msgr2=0x7f141006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:01.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.491+0000 7f142a0d7640 1 --2- 172.21.15.18:0/4201468965 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f141006c2e0 0x7f141006e7a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1414004ea0 tx=0x7f1414009040 comp rx=0 tx=0).stop 2024-09-19T09:19:01.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.491+0000 7f142a0d7640 1 -- 172.21.15.18:0/4201468965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1424071df0 msgr2=0x7f14240b3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:01.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.491+0000 7f142a0d7640 1 --2- 172.21.15.18:0/4201468965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1424071df0 0x7f14240b3b10 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f141800c460 tx=0x7f141800c920 comp rx=0 tx=0).stop 2024-09-19T09:19:01.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.491+0000 7f142a0d7640 1 -- 172.21.15.18:0/4201468965 shutdown_connections 2024-09-19T09:19:01.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.491+0000 7f142a0d7640 1 --2- 172.21.15.18:0/4201468965 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f141006c2e0 0x7f141006e7a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.491+0000 7f142a0d7640 1 --2- 172.21.15.18:0/4201468965 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1424073370 0x7f1424153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.491+0000 7f142a0d7640 1 --2- 172.21.15.18:0/4201468965 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1424071df0 0x7f14240b3b10 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.491+0000 7f142a0d7640 1 --2- 172.21.15.18:0/4201468965 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f142406e280 0x7f14241483a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.491+0000 7f142a0d7640 1 -- 172.21.15.18:0/4201468965 >> 172.21.15.18:0/4201468965 conn(0x7f142406bc10 msgr2=0x7f14240d0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:01.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.491+0000 7f142a0d7640 1 -- 172.21.15.18:0/4201468965 shutdown_connections 2024-09-19T09:19:01.492 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.491+0000 7f142a0d7640 1 -- 172.21.15.18:0/4201468965 wait complete. 2024-09-19T09:19:01.502 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2024-09-19T09:19:01.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.606+0000 7fb71a9a6640 1 Processor -- start 2024-09-19T09:19:01.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.606+0000 7fb71a9a6640 1 -- start start 2024-09-19T09:19:01.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.606+0000 7fb71a9a6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb71415ef50 0x7fb7140d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.606+0000 7fb71a9a6640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb7140b9510 0x7fb7140d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.606+0000 7fb71a9a6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7140b7a90 con 0x7fb7140d3240 2024-09-19T09:19:01.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.606+0000 7fb71a9a6640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb7140d3740 con 0x7fb7140b9510 2024-09-19T09:19:01.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.606+0000 7fb71a9a6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb7140d3a20 con 0x7fb71415ef50 2024-09-19T09:19:01.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.607+0000 7fb713fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb71415ef50 0x7fb7140d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.607+0000 7fb718f43640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb7140b9510 0x7fb7140d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.607+0000 7fb713fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb71415ef50 0x7fb7140d13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:38302/0 (socket says 172.21.15.18:38302) 2024-09-19T09:19:01.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.607+0000 7fb713fff640 1 -- 172.21.15.18:0/1507795701 learned_addr learned my addr 172.21.15.18:0/1507795701 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:01.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.607+0000 7fb7137fe640 1 --1- 172.21.15.18:0/1507795701 >> v1:172.21.15.162:6789/0 conn(0x7fb7140d3240 0x7fb7140cf770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:35798/0 (socket says 172.21.15.18:35798) 2024-09-19T09:19:01.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.607+0000 7fb718f43640 1 -- 172.21.15.18:0/1507795701 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb71415ef50 msgr2=0x7fb7140d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:01.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.607+0000 7fb718f43640 1 --2- 172.21.15.18:0/1507795701 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb71415ef50 0x7fb7140d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.607+0000 7fb718f43640 1 -- 172.21.15.18:0/1507795701 >> v1:172.21.15.162:6789/0 conn(0x7fb7140d3240 legacy=0x7fb7140cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:01.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.607+0000 7fb718f43640 1 -- 172.21.15.18:0/1507795701 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7140b7d00 con 0x7fb7140b9510 2024-09-19T09:19:01.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.607+0000 7fb713fff640 1 --2- 172.21.15.18:0/1507795701 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb71415ef50 0x7fb7140d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:01.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.608+0000 7fb718f43640 1 --2- 172.21.15.18:0/1507795701 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7140b9510 0x7fb7140d18e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb70c009d90 tx=0x7fb70c02a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b17cf532bf9abcfe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:01.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.608+0000 7fb712ffd640 1 -- 172.21.15.18:0/1507795701 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70c031600 con 0x7fb7140b9510 2024-09-19T09:19:01.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.608+0000 7fb712ffd640 1 -- 172.21.15.18:0/1507795701 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb70c0317a0 con 0x7fb7140b9510 2024-09-19T09:19:01.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.608+0000 7fb712ffd640 1 -- 172.21.15.18:0/1507795701 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70c031b70 con 0x7fb7140b9510 2024-09-19T09:19:01.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.609+0000 7fb71a9a6640 1 -- 172.21.15.18:0/1507795701 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7140b9510 msgr2=0x7fb7140d18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:01.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.609+0000 7fb71a9a6640 1 --2- 172.21.15.18:0/1507795701 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7140b9510 0x7fb7140d18e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb70c009d90 tx=0x7fb70c02a5d0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.609+0000 7fb71a9a6640 1 -- 172.21.15.18:0/1507795701 shutdown_connections 2024-09-19T09:19:01.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.609+0000 7fb71a9a6640 1 --2- 172.21.15.18:0/1507795701 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7140b9510 0x7fb7140d18e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.609+0000 7fb71a9a6640 1 --2- 172.21.15.18:0/1507795701 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb71415ef50 0x7fb7140d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.609+0000 7fb71a9a6640 1 -- 172.21.15.18:0/1507795701 >> 172.21.15.18:0/1507795701 conn(0x7fb7140d4c60 msgr2=0x7fb7140d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:01.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.609+0000 7fb71a9a6640 1 -- 172.21.15.18:0/1507795701 shutdown_connections 2024-09-19T09:19:01.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.609+0000 7fb71a9a6640 1 -- 172.21.15.18:0/1507795701 wait complete. 2024-09-19T09:19:01.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.610+0000 7fb71a9a6640 1 Processor -- start 2024-09-19T09:19:01.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.610+0000 7fb71a9a6640 1 -- start start 2024-09-19T09:19:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.611+0000 7fb71a9a6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7140b9510 0x7fb71415d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.611+0000 7fb71a9a6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7140d3240 0x7fb7141f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.611+0000 7fb71a9a6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb71415ef50 0x7fb71415dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.611+0000 7fb71a9a6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb7140d21a0 con 0x7fb7140b9510 2024-09-19T09:19:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.611+0000 7fb71a9a6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb7140d2020 con 0x7fb7140d3240 2024-09-19T09:19:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.611+0000 7fb71a9a6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb7140d5780 con 0x7fb71415ef50 2024-09-19T09:19:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.611+0000 7fb713fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7140b9510 0x7fb71415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.611+0000 7fb713fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7140b9510 0x7fb71415d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53464/0 (socket says 172.21.15.18:53464) 2024-09-19T09:19:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.611+0000 7fb713fff640 1 -- 172.21.15.18:0/1881287473 learned_addr learned my addr 172.21.15.18:0/1881287473 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.611+0000 7fb718f43640 1 --2- 172.21.15.18:0/1881287473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb71415ef50 0x7fb71415dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.611+0000 7fb7137fe640 1 --2- 172.21.15.18:0/1881287473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7140d3240 0x7fb7141f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.611+0000 7fb713fff640 1 -- 172.21.15.18:0/1881287473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb71415ef50 msgr2=0x7fb71415dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:01.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.611+0000 7fb713fff640 1 --2- 172.21.15.18:0/1881287473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb71415ef50 0x7fb71415dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.611+0000 7fb713fff640 1 -- 172.21.15.18:0/1881287473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7140d3240 msgr2=0x7fb7141f5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:01.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.611+0000 7fb713fff640 1 --2- 172.21.15.18:0/1881287473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7140d3240 0x7fb7141f5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:01.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.611+0000 7fb713fff640 1 -- 172.21.15.18:0/1881287473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb71415d970 con 0x7fb7140b9510 2024-09-19T09:19:01.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.612+0000 7fb713fff640 1 --2- 172.21.15.18:0/1881287473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7140b9510 0x7fb71415d430 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fb70400e9b0 tx=0x7fb70400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:01.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.612+0000 7fb710ff9640 1 -- 172.21.15.18:0/1881287473 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb704017070 con 0x7fb7140b9510 2024-09-19T09:19:01.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.612+0000 7fb710ff9640 1 -- 172.21.15.18:0/1881287473 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb70400c9a0 con 0x7fb7140b9510 2024-09-19T09:19:01.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.612+0000 7fb71a9a6640 1 -- 172.21.15.18:0/1881287473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7140cca00 con 0x7fb7140b9510 2024-09-19T09:19:01.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.612+0000 7fb710ff9640 1 -- 172.21.15.18:0/1881287473 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb70400cd50 con 0x7fb7140b9510 2024-09-19T09:19:01.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.612+0000 7fb71a9a6640 1 -- 172.21.15.18:0/1881287473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7140cc1b0 con 0x7fb7140b9510 2024-09-19T09:19:01.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.613+0000 7fb71a9a6640 1 -- 172.21.15.18:0/1881287473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7140d13a0 con 0x7fb7140b9510 2024-09-19T09:19:01.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.613+0000 7fb710ff9640 1 -- 172.21.15.18:0/1881287473 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb70401a070 con 0x7fb7140b9510 2024-09-19T09:19:01.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.614+0000 7fb710ff9640 1 --2- 172.21.15.18:0/1881287473 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb70006c2e0 0x7fb70006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:01.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.614+0000 7fb710ff9640 1 -- 172.21.15.18:0/1881287473 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 4943+0+0 (secure 0 0 0) 0x7fb70408b050 con 0x7fb7140b9510 2024-09-19T09:19:01.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.614+0000 7fb7137fe640 1 --2- 172.21.15.18:0/1881287473 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb70006c2e0 0x7fb70006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:01.615 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.615+0000 7fb7137fe640 1 --2- 172.21.15.18:0/1881287473 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb70006c2e0 0x7fb70006e7a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb71415e860 tx=0x7fb708009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:01.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.618+0000 7fb710ff9640 1 -- 172.21.15.18:0/1881287473 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb704059a40 con 0x7fb7140b9510 2024-09-19T09:19:01.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:01.864+0000 7fb71a9a6640 1 -- 172.21.15.18:0/1881287473 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) -- 0x7fb7141e9030 con 0x7fb7140b9510 2024-09-19T09:19:02.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.841+0000 7fb710ff9640 1 -- 172.21.15.18:0/1881287473 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v286) ==== 131+0+0 (secure 0 0 0) 0x7fb704059340 con 0x7fb7140b9510 2024-09-19T09:19:02.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.845+0000 7fb71a9a6640 1 -- 172.21.15.18:0/1881287473 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb70006c2e0 msgr2=0x7fb70006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:02.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.845+0000 7fb71a9a6640 1 --2- 172.21.15.18:0/1881287473 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb70006c2e0 0x7fb70006e7a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb71415e860 tx=0x7fb708009040 comp rx=0 tx=0).stop 2024-09-19T09:19:02.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.845+0000 7fb71a9a6640 1 -- 172.21.15.18:0/1881287473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7140b9510 msgr2=0x7fb71415d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:02.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.845+0000 7fb71a9a6640 1 --2- 172.21.15.18:0/1881287473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7140b9510 0x7fb71415d430 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fb70400e9b0 tx=0x7fb70400ee70 comp rx=0 tx=0).stop 2024-09-19T09:19:02.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.845+0000 7fb71a9a6640 1 -- 172.21.15.18:0/1881287473 shutdown_connections 2024-09-19T09:19:02.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.845+0000 7fb71a9a6640 1 --2- 172.21.15.18:0/1881287473 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb70006c2e0 0x7fb70006e7a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:02.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.845+0000 7fb71a9a6640 1 --2- 172.21.15.18:0/1881287473 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb71415ef50 0x7fb71415dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:02.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.845+0000 7fb71a9a6640 1 --2- 172.21.15.18:0/1881287473 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7140d3240 0x7fb7141f5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:02.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.845+0000 7fb71a9a6640 1 --2- 172.21.15.18:0/1881287473 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7140b9510 0x7fb71415d430 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:02.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.845+0000 7fb71a9a6640 1 -- 172.21.15.18:0/1881287473 >> 172.21.15.18:0/1881287473 conn(0x7fb7140d4c60 msgr2=0x7fb7141613d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:02.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.845+0000 7fb71a9a6640 1 -- 172.21.15.18:0/1881287473 shutdown_connections 2024-09-19T09:19:02.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.845+0000 7fb71a9a6640 1 -- 172.21.15.18:0/1881287473 wait complete. 2024-09-19T09:19:02.859 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-19T09:19:02.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.971+0000 7f7a2a896640 1 Processor -- start 2024-09-19T09:19:02.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.971+0000 7f7a2a896640 1 -- start start 2024-09-19T09:19:02.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.972+0000 7f7a2a896640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7a2415edb0 0x7f7a2406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:02.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.972+0000 7f7a2a896640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7a2406c150 0x7f7a2406c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:02.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.972+0000 7f7a2a896640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a2415f190 con 0x7f7a2406cd60 2024-09-19T09:19:02.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.972+0000 7f7a2a896640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f7a240b39b0 con 0x7f7a2415edb0 2024-09-19T09:19:02.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.972+0000 7f7a2a896640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f7a2406d610 con 0x7f7a2406c150 2024-09-19T09:19:02.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.972+0000 7f7a23fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7a2415edb0 0x7f7a2406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:02.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.972+0000 7f7a28e33640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f7a2406cd60 0x7f7a241628e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:45968/0 (socket says 172.21.15.18:45968) 2024-09-19T09:19:02.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.972+0000 7f7a28e33640 1 -- 172.21.15.18:0/919871430 learned_addr learned my addr 172.21.15.18:0/919871430 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:02.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.973+0000 7f7a237fe640 1 --2- 172.21.15.18:0/919871430 >> v2:172.21.15.162:3300/0 conn(0x7f7a2406c150 0x7f7a2406c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:02.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.973+0000 7f7a23fff640 1 -- 172.21.15.18:0/919871430 >> v2:172.21.15.162:3300/0 conn(0x7f7a2406c150 msgr2=0x7f7a2406c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:02.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.973+0000 7f7a23fff640 1 --2- 172.21.15.18:0/919871430 >> v2:172.21.15.162:3300/0 conn(0x7f7a2406c150 0x7f7a2406c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:02.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.973+0000 7f7a23fff640 1 -- 172.21.15.18:0/919871430 >> v1:172.21.15.18:6789/0 conn(0x7f7a2406cd60 legacy=0x7f7a241628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:02.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.973+0000 7f7a23fff640 1 -- 172.21.15.18:0/919871430 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a240b2da0 con 0x7f7a2415edb0 2024-09-19T09:19:02.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.973+0000 7f7a23fff640 1 --2- 172.21.15.18:0/919871430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a2415edb0 0x7f7a2406bc10 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f7a24072290 tx=0x7f7a1402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19e2e8ab98a7a1ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:02.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.973+0000 7f7a22ffd640 1 -- 172.21.15.18:0/919871430 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a14037070 con 0x7f7a2415edb0 2024-09-19T09:19:02.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.974+0000 7f7a22ffd640 1 -- 172.21.15.18:0/919871430 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a14032440 con 0x7f7a2415edb0 2024-09-19T09:19:02.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.974+0000 7f7a22ffd640 1 -- 172.21.15.18:0/919871430 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a14032810 con 0x7f7a2415edb0 2024-09-19T09:19:02.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.974+0000 7f7a2a896640 1 -- 172.21.15.18:0/919871430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a2415edb0 msgr2=0x7f7a2406bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:02.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.974+0000 7f7a2a896640 1 --2- 172.21.15.18:0/919871430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a2415edb0 0x7f7a2406bc10 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f7a24072290 tx=0x7f7a1402a1a0 comp rx=0 tx=0).stop 2024-09-19T09:19:02.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.974+0000 7f7a2a896640 1 -- 172.21.15.18:0/919871430 shutdown_connections 2024-09-19T09:19:02.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.974+0000 7f7a2a896640 1 --2- 172.21.15.18:0/919871430 >> v2:172.21.15.162:3300/0 conn(0x7f7a2406c150 0x7f7a2406c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:02.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.974+0000 7f7a2a896640 1 --2- 172.21.15.18:0/919871430 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a2415edb0 0x7f7a2406bc10 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:02.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.974+0000 7f7a2a896640 1 -- 172.21.15.18:0/919871430 >> 172.21.15.18:0/919871430 conn(0x7f7a240b5fc0 msgr2=0x7f7a240b6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:02.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.974+0000 7f7a2a896640 1 -- 172.21.15.18:0/919871430 shutdown_connections 2024-09-19T09:19:02.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.974+0000 7f7a2a896640 1 -- 172.21.15.18:0/919871430 wait complete. 2024-09-19T09:19:02.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.975+0000 7f7a2a896640 1 Processor -- start 2024-09-19T09:19:02.977 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.976+0000 7f7a2a896640 1 -- start start 2024-09-19T09:19:02.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.976+0000 7f7a2a896640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a2406c150 0x7f7a2415b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:02.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.976+0000 7f7a2a896640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a2406cd60 0x7f7a2415d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:02.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.976+0000 7f7a2a896640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a2415edb0 0x7f7a2415d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:02.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.976+0000 7f7a2a896640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7a240b3640 con 0x7f7a2406cd60 2024-09-19T09:19:02.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.976+0000 7f7a2a896640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7a240b3360 con 0x7f7a2406c150 2024-09-19T09:19:02.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.976+0000 7f7a2a896640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7a240af1e0 con 0x7f7a2415edb0 2024-09-19T09:19:02.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.976+0000 7f7a237fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a2406cd60 0x7f7a2415d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:02.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.976+0000 7f7a237fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a2406cd60 0x7f7a2415d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53486/0 (socket says 172.21.15.18:53486) 2024-09-19T09:19:02.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.976+0000 7f7a237fe640 1 -- 172.21.15.18:0/2048524815 learned_addr learned my addr 172.21.15.18:0/2048524815 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:02.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.977+0000 7f7a23fff640 1 --2- 172.21.15.18:0/2048524815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a2406c150 0x7f7a2415b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:02.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.977+0000 7f7a28e33640 1 --2- 172.21.15.18:0/2048524815 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a2415edb0 0x7f7a2415d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:02.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.977+0000 7f7a237fe640 1 -- 172.21.15.18:0/2048524815 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a2415edb0 msgr2=0x7f7a2415d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:02.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.977+0000 7f7a237fe640 1 --2- 172.21.15.18:0/2048524815 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a2415edb0 0x7f7a2415d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:02.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.977+0000 7f7a237fe640 1 -- 172.21.15.18:0/2048524815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a2406c150 msgr2=0x7f7a2415b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:02.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.977+0000 7f7a237fe640 1 --2- 172.21.15.18:0/2048524815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a2406c150 0x7f7a2415b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:02.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.977+0000 7f7a237fe640 1 -- 172.21.15.18:0/2048524815 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a241573e0 con 0x7f7a2406cd60 2024-09-19T09:19:02.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.977+0000 7f7a237fe640 1 --2- 172.21.15.18:0/2048524815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a2406cd60 0x7f7a2415d090 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f7a1800d800 tx=0x7f7a1800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:02.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.977+0000 7f7a20ff9640 1 -- 172.21.15.18:0/2048524815 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a1800b6c0 con 0x7f7a2406cd60 2024-09-19T09:19:02.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.977+0000 7f7a20ff9640 1 -- 172.21.15.18:0/2048524815 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a18019070 con 0x7f7a2406cd60 2024-09-19T09:19:02.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.977+0000 7f7a20ff9640 1 -- 172.21.15.18:0/2048524815 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a1800ba80 con 0x7f7a2406cd60 2024-09-19T09:19:02.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.977+0000 7f7a2a896640 1 -- 172.21.15.18:0/2048524815 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a2415dc30 con 0x7f7a2406cd60 2024-09-19T09:19:02.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.977+0000 7f7a2a896640 1 -- 172.21.15.18:0/2048524815 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a2415e1f0 con 0x7f7a2406cd60 2024-09-19T09:19:02.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.978+0000 7f7a2a896640 1 -- 172.21.15.18:0/2048524815 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a2406c820 con 0x7f7a2406cd60 2024-09-19T09:19:02.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.979+0000 7f7a20ff9640 1 -- 172.21.15.18:0/2048524815 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7a1800bc20 con 0x7f7a2406cd60 2024-09-19T09:19:02.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.979+0000 7f7a20ff9640 1 --2- 172.21.15.18:0/2048524815 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7a1006c2b0 0x7f7a1006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:02.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.979+0000 7f7a20ff9640 1 -- 172.21.15.18:0/2048524815 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 4943+0+0 (secure 0 0 0) 0x7f7a1808b530 con 0x7f7a2406cd60 2024-09-19T09:19:02.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.980+0000 7f7a23fff640 1 --2- 172.21.15.18:0/2048524815 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7a1006c2b0 0x7f7a1006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:02.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.980+0000 7f7a23fff640 1 --2- 172.21.15.18:0/2048524815 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7a1006c2b0 0x7f7a1006e770 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7a14034000 tx=0x7f7a1402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:02.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:02.984+0000 7f7a20ff9640 1 -- 172.21.15.18:0/2048524815 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7a1805a030 con 0x7f7a2406cd60 2024-09-19T09:19:03.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.158+0000 7f7a2a896640 1 -- 172.21.15.18:0/2048524815 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f7a240b04c0 con 0x7f7a2406cd60 2024-09-19T09:19:03.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.161+0000 7f7a20ff9640 1 -- 172.21.15.18:0/2048524815 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f7a18059930 con 0x7f7a2406cd60 2024-09-19T09:19:03.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.163+0000 7f7a2a896640 1 -- 172.21.15.18:0/2048524815 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7a1006c2b0 msgr2=0x7f7a1006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:03.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.163+0000 7f7a2a896640 1 --2- 172.21.15.18:0/2048524815 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7a1006c2b0 0x7f7a1006e770 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f7a14034000 tx=0x7f7a1402e000 comp rx=0 tx=0).stop 2024-09-19T09:19:03.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.163+0000 7f7a2a896640 1 -- 172.21.15.18:0/2048524815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a2406cd60 msgr2=0x7f7a2415d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:03.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.163+0000 7f7a2a896640 1 --2- 172.21.15.18:0/2048524815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a2406cd60 0x7f7a2415d090 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f7a1800d800 tx=0x7f7a1800dcc0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.163+0000 7f7a2a896640 1 -- 172.21.15.18:0/2048524815 shutdown_connections 2024-09-19T09:19:03.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.163+0000 7f7a2a896640 1 --2- 172.21.15.18:0/2048524815 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7a1006c2b0 0x7f7a1006e770 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.163+0000 7f7a2a896640 1 --2- 172.21.15.18:0/2048524815 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a2415edb0 0x7f7a2415d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.163+0000 7f7a2a896640 1 --2- 172.21.15.18:0/2048524815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a2406cd60 0x7f7a2415d090 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.163+0000 7f7a2a896640 1 --2- 172.21.15.18:0/2048524815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a2406c150 0x7f7a2415b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.163+0000 7f7a2a896640 1 -- 172.21.15.18:0/2048524815 >> 172.21.15.18:0/2048524815 conn(0x7f7a240b5fc0 msgr2=0x7f7a2406dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:03.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.164+0000 7f7a2a896640 1 -- 172.21.15.18:0/2048524815 shutdown_connections 2024-09-19T09:19:03.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.164+0000 7f7a2a896640 1 -- 172.21.15.18:0/2048524815 wait complete. 2024-09-19T09:19:03.176 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T09:19:03.176 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:19:03.215 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:19:03.262 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T09:19:03.262 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:19:03.265 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:19:03.288 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17075 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T09:19:03.288 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:19:03.289 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:19:03.323 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3252 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T09:19:03.527 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:19:03.527 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:19:03.544 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17075 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T09:19:03.544 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:19:03.544 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:19:03.563 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3252 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T09:19:03.564 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-19T09:19:03.564 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:19:03.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.688+0000 7fee2a8f1640 1 Processor -- start 2024-09-19T09:19:03.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.688+0000 7fee2a8f1640 1 -- start start 2024-09-19T09:19:03.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.689+0000 7fee2a8f1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee2415ef80 0x7fee240b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:03.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.689+0000 7fee2a8f1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fee2406d730 0x7fee240cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:03.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.689+0000 7fee2a8f1640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee240cd1a0 con 0x7fee240cf910 2024-09-19T09:19:03.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.689+0000 7fee2a8f1640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fee240cd7d0 con 0x7fee2406d730 2024-09-19T09:19:03.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.689+0000 7fee2a8f1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fee2406dc30 con 0x7fee2415ef80 2024-09-19T09:19:03.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.689+0000 7fee237fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fee2406d730 0x7fee240cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:03.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.689+0000 7fee237fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fee2406d730 0x7fee240cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53496/0 (socket says 172.21.15.18:53496) 2024-09-19T09:19:03.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.689+0000 7fee237fe640 1 -- 172.21.15.18:0/2751833541 learned_addr learned my addr 172.21.15.18:0/2751833541 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:03.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.689+0000 7fee237fe640 1 -- 172.21.15.18:0/2751833541 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee2415ef80 msgr2=0x7fee240b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:03.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.689+0000 7fee23fff640 1 --2- 172.21.15.18:0/2751833541 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee2415ef80 0x7fee240b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:03.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.689+0000 7fee237fe640 1 --2- 172.21.15.18:0/2751833541 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee2415ef80 0x7fee240b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.689+0000 7fee237fe640 1 -- 172.21.15.18:0/2751833541 >> v1:172.21.15.162:6789/0 conn(0x7fee240cf910 legacy=0x7fee240d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:03.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.689+0000 7fee237fe640 1 -- 172.21.15.18:0/2751833541 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee2406df10 con 0x7fee2406d730 2024-09-19T09:19:03.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.689+0000 7fee23fff640 1 --2- 172.21.15.18:0/2751833541 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee2415ef80 0x7fee240b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:03.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.690+0000 7fee237fe640 1 --2- 172.21.15.18:0/2751833541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee2406d730 0x7fee240cf3d0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fee18009870 tx=0x7fee1802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d7dfae11dd0b61 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:03.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.690+0000 7fee22ffd640 1 -- 172.21.15.18:0/2751833541 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee18037070 con 0x7fee2406d730 2024-09-19T09:19:03.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.690+0000 7fee22ffd640 1 -- 172.21.15.18:0/2751833541 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee18032440 con 0x7fee2406d730 2024-09-19T09:19:03.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.690+0000 7fee22ffd640 1 -- 172.21.15.18:0/2751833541 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee18032810 con 0x7fee2406d730 2024-09-19T09:19:03.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.691+0000 7fee2a8f1640 1 -- 172.21.15.18:0/2751833541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee2406d730 msgr2=0x7fee240cf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:03.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.691+0000 7fee2a8f1640 1 --2- 172.21.15.18:0/2751833541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee2406d730 0x7fee240cf3d0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7fee18009870 tx=0x7fee1802a210 comp rx=0 tx=0).stop 2024-09-19T09:19:03.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.691+0000 7fee2a8f1640 1 -- 172.21.15.18:0/2751833541 shutdown_connections 2024-09-19T09:19:03.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.691+0000 7fee2a8f1640 1 --2- 172.21.15.18:0/2751833541 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee2406d730 0x7fee240cf3d0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.691+0000 7fee2a8f1640 1 --2- 172.21.15.18:0/2751833541 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee2415ef80 0x7fee240b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.691+0000 7fee2a8f1640 1 -- 172.21.15.18:0/2751833541 >> 172.21.15.18:0/2751833541 conn(0x7fee240b4700 msgr2=0x7fee240b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:03.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.691+0000 7fee2a8f1640 1 -- 172.21.15.18:0/2751833541 shutdown_connections 2024-09-19T09:19:03.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.691+0000 7fee2a8f1640 1 -- 172.21.15.18:0/2751833541 wait complete. 2024-09-19T09:19:03.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.692+0000 7fee2a8f1640 1 Processor -- start 2024-09-19T09:19:03.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.692+0000 7fee2a8f1640 1 -- start start 2024-09-19T09:19:03.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.693+0000 7fee2a8f1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee2406d730 0x7fee240b8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:03.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.693+0000 7fee2a8f1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee240cf910 0x7fee241f4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:03.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.693+0000 7fee2a8f1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee2415ef80 0x7fee240b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:03.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.693+0000 7fee2a8f1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fee240d0120 con 0x7fee240cf910 2024-09-19T09:19:03.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.693+0000 7fee2a8f1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fee2415f360 con 0x7fee2406d730 2024-09-19T09:19:03.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.693+0000 7fee2a8f1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fee240cec70 con 0x7fee2415ef80 2024-09-19T09:19:03.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.693+0000 7fee237fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee240cf910 0x7fee241f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:03.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.693+0000 7fee237fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee240cf910 0x7fee241f4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53504/0 (socket says 172.21.15.18:53504) 2024-09-19T09:19:03.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.693+0000 7fee237fe640 1 -- 172.21.15.18:0/2987542379 learned_addr learned my addr 172.21.15.18:0/2987542379 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:03.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.693+0000 7fee23fff640 1 --2- 172.21.15.18:0/2987542379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee2406d730 0x7fee240b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:03.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.693+0000 7fee28e8e640 1 --2- 172.21.15.18:0/2987542379 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee2415ef80 0x7fee240b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:03.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.693+0000 7fee237fe640 1 -- 172.21.15.18:0/2987542379 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee2415ef80 msgr2=0x7fee240b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:03.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.693+0000 7fee237fe640 1 --2- 172.21.15.18:0/2987542379 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee2415ef80 0x7fee240b5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.693+0000 7fee237fe640 1 -- 172.21.15.18:0/2987542379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee2406d730 msgr2=0x7fee240b8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:03.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.693+0000 7fee237fe640 1 --2- 172.21.15.18:0/2987542379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee2406d730 0x7fee240b8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.693+0000 7fee237fe640 1 -- 172.21.15.18:0/2987542379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee241f5150 con 0x7fee240cf910 2024-09-19T09:19:03.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.694+0000 7fee237fe640 1 --2- 172.21.15.18:0/2987542379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee240cf910 0x7fee241f4c10 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fee18000c00 tx=0x7fee180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:03.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.694+0000 7fee20ff9640 1 -- 172.21.15.18:0/2987542379 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee18037040 con 0x7fee240cf910 2024-09-19T09:19:03.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.694+0000 7fee20ff9640 1 -- 172.21.15.18:0/2987542379 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee18042070 con 0x7fee240cf910 2024-09-19T09:19:03.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.694+0000 7fee2a8f1640 1 -- 172.21.15.18:0/2987542379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee240cc7f0 con 0x7fee240cf910 2024-09-19T09:19:03.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.694+0000 7fee20ff9640 1 -- 172.21.15.18:0/2987542379 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee18030bd0 con 0x7fee240cf910 2024-09-19T09:19:03.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.694+0000 7fee2a8f1640 1 -- 172.21.15.18:0/2987542379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee240ccdb0 con 0x7fee240cf910 2024-09-19T09:19:03.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.695+0000 7fee2a8f1640 1 -- 172.21.15.18:0/2987542379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee240cf3d0 con 0x7fee240cf910 2024-09-19T09:19:03.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.695+0000 7fee20ff9640 1 -- 172.21.15.18:0/2987542379 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fee18047460 con 0x7fee240cf910 2024-09-19T09:19:03.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.696+0000 7fee20ff9640 1 --2- 172.21.15.18:0/2987542379 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fee1006c2b0 0x7fee1006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:03.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.696+0000 7fee20ff9640 1 -- 172.21.15.18:0/2987542379 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 4943+0+0 (secure 0 0 0) 0x7fee180abd90 con 0x7fee240cf910 2024-09-19T09:19:03.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.696+0000 7fee23fff640 1 --2- 172.21.15.18:0/2987542379 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fee1006c2b0 0x7fee1006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:03.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.697+0000 7fee23fff640 1 --2- 172.21.15.18:0/2987542379 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fee1006c2b0 0x7fee1006e770 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fee1400a950 tx=0x7fee14008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:03.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.700+0000 7fee20ff9640 1 -- 172.21.15.18:0/2987542379 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fee18045360 con 0x7fee240cf910 2024-09-19T09:19:03.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.916+0000 7fee2a8f1640 1 -- 172.21.15.18:0/2987542379 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee240cff00 con 0x7fee240cf910 2024-09-19T09:19:03.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.916+0000 7fee20ff9640 1 -- 172.21.15.18:0/2987542379 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+3914 (secure 0 0 0) 0x7fee1807a800 con 0x7fee240cf910 2024-09-19T09:19:03.917 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:03.918 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":44,"btime":"2024-09-19T09:18:57:715931+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5588,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3893042078","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":3893042078},{"type":"v1","addr":"172.21.15.162:6837","nonce":3893042078}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":5944,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/935732637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":935732637},{"type":"v1","addr":"172.21.15.162:6836","nonce":935732637}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39},{"gid":6192,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/3186899169","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":3186899169},{"type":"v1","addr":"172.21.15.18:6835","nonce":3186899169}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":6195,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/3889971648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":3889971648},{"type":"v1","addr":"172.21.15.18:6834","nonce":3889971648}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":39}],"filesystems":[]} 2024-09-19T09:19:03.918 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 44 2024-09-19T09:19:03.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.918+0000 7fee2a8f1640 1 -- 172.21.15.18:0/2987542379 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fee1006c2b0 msgr2=0x7fee1006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:03.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.918+0000 7fee2a8f1640 1 --2- 172.21.15.18:0/2987542379 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fee1006c2b0 0x7fee1006e770 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fee1400a950 tx=0x7fee14008040 comp rx=0 tx=0).stop 2024-09-19T09:19:03.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.918+0000 7fee2a8f1640 1 -- 172.21.15.18:0/2987542379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee240cf910 msgr2=0x7fee241f4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:03.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.918+0000 7fee2a8f1640 1 --2- 172.21.15.18:0/2987542379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee240cf910 0x7fee241f4c10 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fee18000c00 tx=0x7fee180046c0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.918+0000 7fee2a8f1640 1 -- 172.21.15.18:0/2987542379 shutdown_connections 2024-09-19T09:19:03.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.918+0000 7fee2a8f1640 1 --2- 172.21.15.18:0/2987542379 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fee1006c2b0 0x7fee1006e770 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.918+0000 7fee2a8f1640 1 --2- 172.21.15.18:0/2987542379 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee2415ef80 0x7fee240b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.918+0000 7fee2a8f1640 1 --2- 172.21.15.18:0/2987542379 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee240cf910 0x7fee241f4c10 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.918+0000 7fee2a8f1640 1 --2- 172.21.15.18:0/2987542379 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee2406d730 0x7fee240b8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:03.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.918+0000 7fee2a8f1640 1 -- 172.21.15.18:0/2987542379 >> 172.21.15.18:0/2987542379 conn(0x7fee240b4700 msgr2=0x7fee24161cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:03.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.919+0000 7fee2a8f1640 1 -- 172.21.15.18:0/2987542379 shutdown_connections 2024-09-19T09:19:03.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:03.919+0000 7fee2a8f1640 1 -- 172.21.15.18:0/2987542379 wait complete. 2024-09-19T09:19:03.931 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T09:19:03.931 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-19T09:19:03.931 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T09:19:03.932 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:19:03.932 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T09:19:03.932 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-19T09:19:03.932 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T09:19:03.933 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:19:03.933 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T09:19:03.933 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-19T09:19:03.933 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T09:19:03.934 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:19:03.934 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T09:19:03.934 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-19T09:19:03.934 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T09:19:03.935 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:19:03.941 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T09:19:03.942 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T09:19:03.943 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T09:19:03.943 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T09:19:03.946 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T09:19:03.946 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T09:19:03.948 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T09:19:03.948 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T09:19:03.984 INFO:tasks.ceph.mds.a:Started 2024-09-19T09:19:03.984 DEBUG:teuthology.parallel:result is None 2024-09-19T09:19:03.985 INFO:tasks.ceph.mds.c:Started 2024-09-19T09:19:03.985 DEBUG:teuthology.parallel:result is None 2024-09-19T09:19:03.989 INFO:tasks.ceph.mds.b:Started 2024-09-19T09:19:03.989 DEBUG:teuthology.parallel:result is None 2024-09-19T09:19:03.990 INFO:tasks.ceph.mds.d:Started 2024-09-19T09:19:03.991 DEBUG:teuthology.parallel:result is None 2024-09-19T09:19:03.991 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-19T09:19:04.061 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-09-19T09:19:04.062 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2024-09-19T09:19:04.075 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-09-19T09:19:04.075 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-09-19T09:19:04.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.097+0000 7fda08f31640 1 Processor -- start 2024-09-19T09:19:04.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.097+0000 7fda08f31640 1 -- start start 2024-09-19T09:19:04.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.098+0000 7fda08f31640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fda040d5790 0x7fda040d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:04.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.098+0000 7fda08f31640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fda040d1630 0x7fda040d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:04.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.098+0000 7fda08f31640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda040d3cc0 con 0x7fda0415eda0 2024-09-19T09:19:04.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.098+0000 7fda08f31640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fda040d5c00 con 0x7fda040d5790 2024-09-19T09:19:04.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.098+0000 7fda08f31640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fda040d09c0 con 0x7fda040d1630 2024-09-19T09:19:04.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.098+0000 7fda01d9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fda040d5790 0x7fda040d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:04.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.098+0000 7fda01d9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fda040d5790 0x7fda040d0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53562/0 (socket says 172.21.15.18:53562) 2024-09-19T09:19:04.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.098+0000 7fda01d9b640 1 -- 172.21.15.18:0/2779110490 learned_addr learned my addr 172.21.15.18:0/2779110490 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:04.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.098+0000 7fda01d9b640 1 -- 172.21.15.18:0/2779110490 >> v2:172.21.15.162:3300/0 conn(0x7fda040d1630 msgr2=0x7fda040d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:04.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.098+0000 7fda01d9b640 1 --2- 172.21.15.18:0/2779110490 >> v2:172.21.15.162:3300/0 conn(0x7fda040d1630 0x7fda040d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:04.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.098+0000 7fda01d9b640 1 -- 172.21.15.18:0/2779110490 >> v1:172.21.15.162:6789/0 conn(0x7fda0415eda0 legacy=0x7fda040d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:04.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.098+0000 7fda01d9b640 1 -- 172.21.15.18:0/2779110490 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda040d0bf0 con 0x7fda040d5790 2024-09-19T09:19:04.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.099+0000 7fda01d9b640 1 --2- 172.21.15.18:0/2779110490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda040d5790 0x7fda040d0480 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fda04163ac0 tx=0x7fd9f802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8c66e937431443 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:04.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.099+0000 7fda0159a640 1 -- 172.21.15.18:0/2779110490 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f8037070 con 0x7fda040d5790 2024-09-19T09:19:04.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.099+0000 7fda0159a640 1 -- 172.21.15.18:0/2779110490 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9f8032440 con 0x7fda040d5790 2024-09-19T09:19:04.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.099+0000 7fda0159a640 1 -- 172.21.15.18:0/2779110490 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f8032810 con 0x7fda040d5790 2024-09-19T09:19:04.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.100+0000 7fda08f31640 1 -- 172.21.15.18:0/2779110490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda040d5790 msgr2=0x7fda040d0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:04.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.100+0000 7fda08f31640 1 --2- 172.21.15.18:0/2779110490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda040d5790 0x7fda040d0480 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fda04163ac0 tx=0x7fd9f802a230 comp rx=0 tx=0).stop 2024-09-19T09:19:04.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.100+0000 7fda08f31640 1 -- 172.21.15.18:0/2779110490 shutdown_connections 2024-09-19T09:19:04.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.100+0000 7fda08f31640 1 --2- 172.21.15.18:0/2779110490 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda040d5790 0x7fda040d0480 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:04.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.100+0000 7fda08f31640 1 --2- 172.21.15.18:0/2779110490 >> v2:172.21.15.162:3300/0 conn(0x7fda040d1630 0x7fda040d1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:04.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.100+0000 7fda08f31640 1 -- 172.21.15.18:0/2779110490 >> 172.21.15.18:0/2779110490 conn(0x7fda0409df40 msgr2=0x7fda040d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:04.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.100+0000 7fda08f31640 1 -- 172.21.15.18:0/2779110490 shutdown_connections 2024-09-19T09:19:04.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.100+0000 7fda08f31640 1 -- 172.21.15.18:0/2779110490 wait complete. 2024-09-19T09:19:04.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.102+0000 7fda08f31640 1 Processor -- start 2024-09-19T09:19:04.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.102+0000 7fda08f31640 1 -- start start 2024-09-19T09:19:04.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.102+0000 7fda08f31640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda040d1630 0x7fda04153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:04.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.103+0000 7fda08f31640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda040d5790 0x7fda040ce230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:04.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.103+0000 7fda08f31640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda0415eda0 0x7fda04157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:04.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.103+0000 7fda08f31640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fda040d3120 con 0x7fda040d1630 2024-09-19T09:19:04.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.103+0000 7fda08f31640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fda040d2880 con 0x7fda0415eda0 2024-09-19T09:19:04.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.103+0000 7fda08f31640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fda040d2db0 con 0x7fda040d5790 2024-09-19T09:19:04.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.103+0000 7fda0259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda040d1630 0x7fda04153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:04.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.103+0000 7fda0259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda040d1630 0x7fda04153ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53566/0 (socket says 172.21.15.18:53566) 2024-09-19T09:19:04.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.103+0000 7fda0259c640 1 -- 172.21.15.18:0/2458402355 learned_addr learned my addr 172.21.15.18:0/2458402355 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:04.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.103+0000 7fda01d9b640 1 --2- 172.21.15.18:0/2458402355 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda040d5790 0x7fda040ce230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:04.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.103+0000 7fda02d9d640 1 --2- 172.21.15.18:0/2458402355 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda0415eda0 0x7fda04157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:04.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.103+0000 7fda0259c640 1 -- 172.21.15.18:0/2458402355 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda040d5790 msgr2=0x7fda040ce230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:04.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.103+0000 7fda0259c640 1 --2- 172.21.15.18:0/2458402355 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda040d5790 0x7fda040ce230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:04.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.103+0000 7fda0259c640 1 -- 172.21.15.18:0/2458402355 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda0415eda0 msgr2=0x7fda04157390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:04.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.103+0000 7fda0259c640 1 --2- 172.21.15.18:0/2458402355 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda0415eda0 0x7fda04157390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:04.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.103+0000 7fda0259c640 1 -- 172.21.15.18:0/2458402355 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda041578d0 con 0x7fda040d1630 2024-09-19T09:19:04.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.103+0000 7fda02d9d640 1 --2- 172.21.15.18:0/2458402355 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda0415eda0 0x7fda04157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:04.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.103+0000 7fda0259c640 1 --2- 172.21.15.18:0/2458402355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda040d1630 0x7fda04153ac0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400ba50 tx=0x7fd9f400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:04.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.103+0000 7fd9f2ffd640 1 -- 172.21.15.18:0/2458402355 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4019070 con 0x7fda040d1630 2024-09-19T09:19:04.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.103+0000 7fd9f2ffd640 1 -- 172.21.15.18:0/2458402355 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9f400cc10 con 0x7fda040d1630 2024-09-19T09:19:04.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.103+0000 7fd9f2ffd640 1 -- 172.21.15.18:0/2458402355 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4014440 con 0x7fda040d1630 2024-09-19T09:19:04.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.104+0000 7fda08f31640 1 -- 172.21.15.18:0/2458402355 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda04155d90 con 0x7fda040d1630 2024-09-19T09:19:04.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.104+0000 7fda08f31640 1 -- 172.21.15.18:0/2458402355 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda040cda30 con 0x7fda040d1630 2024-09-19T09:19:04.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.104+0000 7fda08f31640 1 -- 172.21.15.18:0/2458402355 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda0415f180 con 0x7fda040d1630 2024-09-19T09:19:04.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.105+0000 7fd9f2ffd640 1 -- 172.21.15.18:0/2458402355 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd9f401c070 con 0x7fda040d1630 2024-09-19T09:19:04.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.105+0000 7fd9f2ffd640 1 --2- 172.21.15.18:0/2458402355 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd9e406c2b0 0x7fd9e406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:04.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.106+0000 7fd9f2ffd640 1 -- 172.21.15.18:0/2458402355 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 4943+0+0 (secure 0 0 0) 0x7fd9f408af70 con 0x7fda040d1630 2024-09-19T09:19:04.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.106+0000 7fda01d9b640 1 --2- 172.21.15.18:0/2458402355 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd9e406c2b0 0x7fd9e406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:04.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.106+0000 7fda01d9b640 1 --2- 172.21.15.18:0/2458402355 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd9e406c2b0 0x7fd9e406e770 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8034000 tx=0x7fd9f802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:04.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.110+0000 7fd9f2ffd640 1 -- 172.21.15.18:0/2458402355 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fda041578d0 con 0x7fda040d1630 2024-09-19T09:19:04.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:04.299+0000 7fda08f31640 1 -- 172.21.15.18:0/2458402355 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fda04157170 con 0x7fda040d1630 2024-09-19T09:19:05.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.173+0000 7fd9f2ffd640 1 -- 172.21.15.18:0/2458402355 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v119) ==== 97+0+0 (secure 0 0 0) 0x7fd9f40599d0 con 0x7fda040d1630 2024-09-19T09:19:05.174 INFO:teuthology.orchestra.run.smithi018.stderr: removed all blocklist entries 2024-09-19T09:19:05.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.176+0000 7fda08f31640 1 -- 172.21.15.18:0/2458402355 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd9e406c2b0 msgr2=0x7fd9e406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:05.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.176+0000 7fda08f31640 1 --2- 172.21.15.18:0/2458402355 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd9e406c2b0 0x7fd9e406e770 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8034000 tx=0x7fd9f802e000 comp rx=0 tx=0).stop 2024-09-19T09:19:05.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.176+0000 7fda08f31640 1 -- 172.21.15.18:0/2458402355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda040d1630 msgr2=0x7fda04153ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:05.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.176+0000 7fda08f31640 1 --2- 172.21.15.18:0/2458402355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda040d1630 0x7fda04153ac0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400ba50 tx=0x7fd9f400bf10 comp rx=0 tx=0).stop 2024-09-19T09:19:05.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.176+0000 7fda08f31640 1 -- 172.21.15.18:0/2458402355 shutdown_connections 2024-09-19T09:19:05.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.176+0000 7fda08f31640 1 --2- 172.21.15.18:0/2458402355 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd9e406c2b0 0x7fd9e406e770 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.176+0000 7fda08f31640 1 --2- 172.21.15.18:0/2458402355 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda0415eda0 0x7fda04157390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.176+0000 7fda08f31640 1 --2- 172.21.15.18:0/2458402355 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda040d5790 0x7fda040ce230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.176+0000 7fda08f31640 1 --2- 172.21.15.18:0/2458402355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda040d1630 0x7fda04153ac0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.176+0000 7fda08f31640 1 -- 172.21.15.18:0/2458402355 >> 172.21.15.18:0/2458402355 conn(0x7fda0409df40 msgr2=0x7fda040b8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:05.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.176+0000 7fda08f31640 1 -- 172.21.15.18:0/2458402355 shutdown_connections 2024-09-19T09:19:05.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.176+0000 7fda08f31640 1 -- 172.21.15.18:0/2458402355 wait complete. 2024-09-19T09:19:05.191 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-19T09:19:05.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.299+0000 7fbe88149640 1 Processor -- start 2024-09-19T09:19:05.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.300+0000 7fbe88149640 1 -- start start 2024-09-19T09:19:05.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.300+0000 7fbe88149640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe8015ef50 0x7fbe800d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:05.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.300+0000 7fbe88149640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbe800d3240 0x7fbe800d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:05.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.300+0000 7fbe88149640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe800b7a90 con 0x7fbe800d5780 2024-09-19T09:19:05.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.300+0000 7fbe88149640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fbe800d3740 con 0x7fbe800d3240 2024-09-19T09:19:05.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.300+0000 7fbe88149640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbe800d3a20 con 0x7fbe8015ef50 2024-09-19T09:19:05.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.301+0000 7fbe856e4640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbe800d3240 0x7fbe800d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:05.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.301+0000 7fbe85ee5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe8015ef50 0x7fbe800d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:05.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.301+0000 7fbe856e4640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbe800d3240 0x7fbe800d18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:45740/0 (socket says 172.21.15.18:45740) 2024-09-19T09:19:05.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.301+0000 7fbe856e4640 1 -- 172.21.15.18:0/2596868810 learned_addr learned my addr 172.21.15.18:0/2596868810 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:05.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.301+0000 7fbe866e6640 1 --1- 172.21.15.18:0/2596868810 >> v1:172.21.15.162:6789/0 conn(0x7fbe800d5780 0x7fbe800cf770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:57590/0 (socket says 172.21.15.18:57590) 2024-09-19T09:19:05.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.301+0000 7fbe85ee5640 1 -- 172.21.15.18:0/2596868810 >> v2:172.21.15.162:3300/0 conn(0x7fbe800d3240 msgr2=0x7fbe800d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:05.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.301+0000 7fbe85ee5640 1 --2- 172.21.15.18:0/2596868810 >> v2:172.21.15.162:3300/0 conn(0x7fbe800d3240 0x7fbe800d18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.301+0000 7fbe85ee5640 1 -- 172.21.15.18:0/2596868810 >> v1:172.21.15.162:6789/0 conn(0x7fbe800d5780 legacy=0x7fbe800cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:05.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.301+0000 7fbe85ee5640 1 -- 172.21.15.18:0/2596868810 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe800b7d00 con 0x7fbe8015ef50 2024-09-19T09:19:05.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.301+0000 7fbe856e4640 1 --2- 172.21.15.18:0/2596868810 >> v2:172.21.15.162:3300/0 conn(0x7fbe800d3240 0x7fbe800d18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:05.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.302+0000 7fbe85ee5640 1 --2- 172.21.15.18:0/2596868810 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe8015ef50 0x7fbe800d13a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c009d90 tx=0x7fbe7c02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=891606266585d2ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:05.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.302+0000 7fbe84ee3640 1 -- 172.21.15.18:0/2596868810 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c031600 con 0x7fbe8015ef50 2024-09-19T09:19:05.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.302+0000 7fbe84ee3640 1 -- 172.21.15.18:0/2596868810 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe7c0317a0 con 0x7fbe8015ef50 2024-09-19T09:19:05.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.302+0000 7fbe84ee3640 1 -- 172.21.15.18:0/2596868810 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe7c031b70 con 0x7fbe8015ef50 2024-09-19T09:19:05.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.303+0000 7fbe88149640 1 -- 172.21.15.18:0/2596868810 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe8015ef50 msgr2=0x7fbe800d13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:05.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.303+0000 7fbe88149640 1 --2- 172.21.15.18:0/2596868810 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe8015ef50 0x7fbe800d13a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c009d90 tx=0x7fbe7c02a5d0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.303+0000 7fbe88149640 1 -- 172.21.15.18:0/2596868810 shutdown_connections 2024-09-19T09:19:05.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.303+0000 7fbe88149640 1 --2- 172.21.15.18:0/2596868810 >> v2:172.21.15.162:3300/0 conn(0x7fbe800d3240 0x7fbe800d18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.303+0000 7fbe88149640 1 --2- 172.21.15.18:0/2596868810 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe8015ef50 0x7fbe800d13a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.303+0000 7fbe88149640 1 -- 172.21.15.18:0/2596868810 >> 172.21.15.18:0/2596868810 conn(0x7fbe800d4c60 msgr2=0x7fbe800d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:05.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.303+0000 7fbe88149640 1 -- 172.21.15.18:0/2596868810 shutdown_connections 2024-09-19T09:19:05.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.303+0000 7fbe88149640 1 -- 172.21.15.18:0/2596868810 wait complete. 2024-09-19T09:19:05.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.304+0000 7fbe88149640 1 Processor -- start 2024-09-19T09:19:05.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.304+0000 7fbe88149640 1 -- start start 2024-09-19T09:19:05.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.305+0000 7fbe88149640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe800d3240 0x7fbe801f7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:05.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.305+0000 7fbe88149640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe800d5780 0x7fbe800ce9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:05.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.305+0000 7fbe88149640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe8015ef50 0x7fbe800cbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:05.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.305+0000 7fbe88149640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbe800d21a0 con 0x7fbe8015ef50 2024-09-19T09:19:05.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.305+0000 7fbe88149640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbe800d2020 con 0x7fbe800d5780 2024-09-19T09:19:05.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.305+0000 7fbe88149640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbe800b9510 con 0x7fbe800d3240 2024-09-19T09:19:05.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.305+0000 7fbe866e6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe8015ef50 0x7fbe800cbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:05.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.305+0000 7fbe866e6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe8015ef50 0x7fbe800cbfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33704/0 (socket says 172.21.15.18:33704) 2024-09-19T09:19:05.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.305+0000 7fbe866e6640 1 -- 172.21.15.18:0/643832814 learned_addr learned my addr 172.21.15.18:0/643832814 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:05.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.305+0000 7fbe85ee5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe800d3240 0x7fbe801f7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:05.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.305+0000 7fbe856e4640 1 --2- 172.21.15.18:0/643832814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe800d5780 0x7fbe800ce9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:05.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.305+0000 7fbe866e6640 1 -- 172.21.15.18:0/643832814 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe800d3240 msgr2=0x7fbe801f7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:05.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.305+0000 7fbe866e6640 1 --2- 172.21.15.18:0/643832814 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe800d3240 0x7fbe801f7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.305+0000 7fbe866e6640 1 -- 172.21.15.18:0/643832814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe800d5780 msgr2=0x7fbe800ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:05.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.305+0000 7fbe866e6640 1 --2- 172.21.15.18:0/643832814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe800d5780 0x7fbe800ce9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.305+0000 7fbe866e6640 1 -- 172.21.15.18:0/643832814 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe8015a6e0 con 0x7fbe8015ef50 2024-09-19T09:19:05.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.305+0000 7fbe866e6640 1 --2- 172.21.15.18:0/643832814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe8015ef50 0x7fbe800cbfd0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800c430 tx=0x7fbe7800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:05.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.306+0000 7fbe767fc640 1 -- 172.21.15.18:0/643832814 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe780074e0 con 0x7fbe8015ef50 2024-09-19T09:19:05.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.306+0000 7fbe767fc640 1 -- 172.21.15.18:0/643832814 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe78007680 con 0x7fbe8015ef50 2024-09-19T09:19:05.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.306+0000 7fbe88149640 1 -- 172.21.15.18:0/643832814 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe8015a9c0 con 0x7fbe8015ef50 2024-09-19T09:19:05.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.306+0000 7fbe767fc640 1 -- 172.21.15.18:0/643832814 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe780049e0 con 0x7fbe8015ef50 2024-09-19T09:19:05.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.306+0000 7fbe88149640 1 -- 172.21.15.18:0/643832814 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe8015af80 con 0x7fbe8015ef50 2024-09-19T09:19:05.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.306+0000 7fbe88149640 1 -- 172.21.15.18:0/643832814 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe800d1b60 con 0x7fbe8015ef50 2024-09-19T09:19:05.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.307+0000 7fbe767fc640 1 -- 172.21.15.18:0/643832814 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbe7801a020 con 0x7fbe8015ef50 2024-09-19T09:19:05.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.308+0000 7fbe767fc640 1 --2- 172.21.15.18:0/643832814 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbe6406c2e0 0x7fbe6406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:05.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.308+0000 7fbe767fc640 1 -- 172.21.15.18:0/643832814 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 4857+0+0 (secure 0 0 0) 0x7fbe7808a680 con 0x7fbe8015ef50 2024-09-19T09:19:05.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.308+0000 7fbe85ee5640 1 --2- 172.21.15.18:0/643832814 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbe6406c2e0 0x7fbe6406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:05.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.309+0000 7fbe85ee5640 1 --2- 172.21.15.18:0/643832814 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbe6406c2e0 0x7fbe6406e7a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c034000 tx=0x7fbe7c02f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:05.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.312+0000 7fbe767fc640 1 -- 172.21.15.18:0/643832814 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fbe78058b80 con 0x7fbe8015ef50 2024-09-19T09:19:05.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.555+0000 7fbe88149640 1 -- 172.21.15.18:0/643832814 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fbe800b6d00 con 0x7fbe8015ef50 2024-09-19T09:19:05.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.555+0000 7fbe767fc640 1 -- 172.21.15.18:0/643832814 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7fbe7805ce80 con 0x7fbe8015ef50 2024-09-19T09:19:05.557 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:05.557 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:19:05.557 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_dump": [ 2024-09-19T09:19:05.557 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:05.557 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.a", 2024-09-19T09:19:05.557 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmDY7cHhAALxtxGq6eR3A2QXYp+nW0FA==", 2024-09-19T09:19:05.557 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:05.557 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:19:05.557 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:19:05.557 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:19:05.557 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:19:05.557 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:05.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:05.558 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:05.558 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.b", 2024-09-19T09:19:05.558 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tm9ILFKhAABEtgvzO5YBXqzYaeBZ0qZg==", 2024-09-19T09:19:05.558 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:05.558 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:19:05.558 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:19:05.559 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:19:05.559 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:19:05.559 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:05.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:05.559 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:05.559 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.c", 2024-09-19T09:19:05.560 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmwPkOJhAADt/0XVei2kl79pIw55wu1A==", 2024-09-19T09:19:05.560 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:05.560 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:19:05.560 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:19:05.560 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:19:05.560 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:19:05.560 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:05.561 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:05.561 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:05.561 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.d", 2024-09-19T09:19:05.561 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tm35XYMRAA/OSE5iv8M+TekEJVTARETw==", 2024-09-19T09:19:05.561 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:05.561 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:19:05.562 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:19:05.562 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:19:05.562 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:19:05.562 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:05.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:05.562 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:05.563 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.0", 2024-09-19T09:19:05.563 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmkUBiGhAATWtnqNPWyZJ+tnQcZOtT5A==", 2024-09-19T09:19:05.563 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:05.563 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:19:05.563 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:19:05.563 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:19:05.564 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:05.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:05.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:05.564 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.1", 2024-09-19T09:19:05.564 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmir5wIRAA9QumyCr8yLHtNj/YqQ1d0A==", 2024-09-19T09:19:05.564 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:05.565 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:19:05.565 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:19:05.565 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:19:05.565 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:05.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:05.565 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:05.566 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.2", 2024-09-19T09:19:05.566 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmfQJ6KBAAfTerKv1zCzFf6UfAVUikxA==", 2024-09-19T09:19:05.566 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:05.566 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:19:05.566 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:19:05.566 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:19:05.567 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:05.567 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:05.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:05.567 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.3", 2024-09-19T09:19:05.567 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmSeSOLxAACqCpiIQO4cDyjXUmoGPKAQ==", 2024-09-19T09:19:05.567 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:05.568 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:19:05.568 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:19:05.569 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:19:05.569 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:05.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:05.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:05.569 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.4", 2024-09-19T09:19:05.569 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmrsoFAhAArI7cRPVe/jrnSdmyE8jCsQ==", 2024-09-19T09:19:05.569 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:05.569 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:19:05.569 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:19:05.569 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:19:05.569 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:05.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:05.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:05.569 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.5", 2024-09-19T09:19:05.570 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmudM3CRAAXF3uI58SNJE6qtYX2wNQeQ==", 2024-09-19T09:19:05.570 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:05.570 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:19:05.570 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:19:05.570 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:19:05.570 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:05.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:05.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:05.570 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.6", 2024-09-19T09:19:05.570 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmqEQmEBAAm4h/8p91HwX84pl/U80Q9Q==", 2024-09-19T09:19:05.570 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:05.570 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:19:05.570 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:19:05.571 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:19:05.571 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:05.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:05.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:05.571 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.7", 2024-09-19T09:19:05.571 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmhDs0FxAAxZvRVkBoWqsdmyifRZzgwg==", 2024-09-19T09:19:05.571 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:05.571 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:19:05.571 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:19:05.571 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:19:05.571 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:05.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:05.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:05.572 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.0", 2024-09-19T09:19:05.572 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmcbwDNhAAaG0+wu96Locwws+h0zeh8Q==", 2024-09-19T09:19:05.572 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:05.572 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:19:05.572 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow r", 2024-09-19T09:19:05.572 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-19T09:19:05.572 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:05.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:05.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:05.572 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.1", 2024-09-19T09:19:05.572 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAf6+tmb4FeAxAAU+nZN/Vb33HrU0yfXmU9gA==", 2024-09-19T09:19:05.572 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:05.572 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:19:05.573 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-19T09:19:05.573 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-19T09:19:05.573 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-19T09:19:05.573 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:05.573 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:05.573 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:05.573 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.2", 2024-09-19T09:19:05.573 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAf6+tmc34kABAAC5b4Kkm2dJvxxyXva6PT2g==", 2024-09-19T09:19:05.573 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:05.573 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:19:05.573 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-19T09:19:05.573 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-19T09:19:05.573 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-19T09:19:05.574 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:05.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:05.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:05.574 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.3", 2024-09-19T09:19:05.574 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAf6+tmx4vzCBAAZ7ZrdGI2s8LqT0MjjzOCjw==", 2024-09-19T09:19:05.574 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:05.574 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:19:05.574 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-19T09:19:05.574 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-19T09:19:05.574 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-19T09:19:05.574 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:05.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:05.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:05.574 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.admin", 2024-09-19T09:19:05.575 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmZaWgAhAAx7MUazt6rS+wa/ZMSGC97Q==", 2024-09-19T09:19:05.575 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:05.575 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-19T09:19:05.575 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:19:05.575 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:19:05.575 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:19:05.575 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:05.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:05.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:05.575 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.x", 2024-09-19T09:19:05.575 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmwr6NGxAA3M5NZKkjc36L25teWJS7bQ==", 2024-09-19T09:19:05.575 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:05.575 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-19T09:19:05.575 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-09-19T09:19:05.576 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:19:05.576 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:05.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:05.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:05.576 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.y", 2024-09-19T09:19:05.576 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmBWOWFxAAEYKCroBhMcqoIe6WzXnNCg==", 2024-09-19T09:19:05.576 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:05.576 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-19T09:19:05.576 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-09-19T09:19:05.576 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:19:05.576 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:05.576 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:05.576 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:05.577 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:19:05.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.557+0000 7fbe88149640 1 -- 172.21.15.18:0/643832814 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbe6406c2e0 msgr2=0x7fbe6406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:05.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.557+0000 7fbe88149640 1 --2- 172.21.15.18:0/643832814 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbe6406c2e0 0x7fbe6406e7a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c034000 tx=0x7fbe7c02f000 comp rx=0 tx=0).stop 2024-09-19T09:19:05.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.557+0000 7fbe88149640 1 -- 172.21.15.18:0/643832814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe8015ef50 msgr2=0x7fbe800cbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:05.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.557+0000 7fbe88149640 1 --2- 172.21.15.18:0/643832814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe8015ef50 0x7fbe800cbfd0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800c430 tx=0x7fbe7800c8f0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.558+0000 7fbe88149640 1 -- 172.21.15.18:0/643832814 shutdown_connections 2024-09-19T09:19:05.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.558+0000 7fbe88149640 1 --2- 172.21.15.18:0/643832814 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbe6406c2e0 0x7fbe6406e7a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.558+0000 7fbe88149640 1 --2- 172.21.15.18:0/643832814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe8015ef50 0x7fbe800cbfd0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.558+0000 7fbe88149640 1 --2- 172.21.15.18:0/643832814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe800d5780 0x7fbe800ce9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.558+0000 7fbe88149640 1 --2- 172.21.15.18:0/643832814 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe800d3240 0x7fbe801f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.558+0000 7fbe88149640 1 -- 172.21.15.18:0/643832814 >> 172.21.15.18:0/643832814 conn(0x7fbe800d4c60 msgr2=0x7fbe8006c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:05.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.558+0000 7fbe88149640 1 -- 172.21.15.18:0/643832814 shutdown_connections 2024-09-19T09:19:05.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.558+0000 7fbe88149640 1 -- 172.21.15.18:0/643832814 wait complete. 2024-09-19T09:19:05.579 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-19T09:19:05.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.682+0000 7f3ce864c640 1 Processor -- start 2024-09-19T09:19:05.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.682+0000 7f3ce864c640 1 -- start start 2024-09-19T09:19:05.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.683+0000 7f3ce864c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ce0160c50 0x7f3ce0167680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:05.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.683+0000 7f3ce864c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ce0142650 con 0x7f3ce0142150 2024-09-19T09:19:05.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.683+0000 7f3ce864c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ce0142930 con 0x7f3ce013fae0 2024-09-19T09:19:05.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.683+0000 7f3ce864c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3ce00ce780 con 0x7f3ce0160c50 2024-09-19T09:19:05.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.683+0000 7f3ce5be7640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3ce0142150 0x7f3ce0160540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52768/0 (socket says 172.21.15.18:52768) 2024-09-19T09:19:05.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.683+0000 7f3ce5be7640 1 -- 172.21.15.18:0/3292808108 learned_addr learned my addr 172.21.15.18:0/3292808108 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:05.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.683+0000 7f3ce6be9640 1 --2- 172.21.15.18:0/3292808108 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ce0160c50 0x7f3ce0167680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:05.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.683+0000 7f3ce53e6640 1 -- 172.21.15.18:0/3292808108 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 583963548 0 0) 0x7f3ce0142650 con 0x7f3ce0142150 2024-09-19T09:19:05.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.683+0000 7f3ce53e6640 1 -- 172.21.15.18:0/3292808108 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ccc003520 con 0x7f3ce0142150 2024-09-19T09:19:05.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.683+0000 7f3ce53e6640 1 -- 172.21.15.18:0/3292808108 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2650577882 0 0) 0x7f3ce0142930 con 0x7f3ce013fae0 2024-09-19T09:19:05.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.683+0000 7f3ce53e6640 1 -- 172.21.15.18:0/3292808108 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ce0142650 con 0x7f3ce013fae0 2024-09-19T09:19:05.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.683+0000 7f3ce53e6640 1 -- 172.21.15.18:0/3292808108 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 336714295 0 0) 0x7f3ccc003520 con 0x7f3ce0142150 2024-09-19T09:19:05.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.683+0000 7f3ce6be9640 1 -- 172.21.15.18:0/3292808108 >> v1:172.21.15.162:6789/0 conn(0x7f3ce013fae0 legacy=0x7f3ce006f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:05.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.683+0000 7f3ce6be9640 1 -- 172.21.15.18:0/3292808108 >> v1:172.21.15.18:6789/0 conn(0x7f3ce0142150 legacy=0x7f3ce0160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:05.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.683+0000 7f3ce6be9640 1 -- 172.21.15.18:0/3292808108 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce0142c10 con 0x7f3ce0160c50 2024-09-19T09:19:05.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.684+0000 7f3ce6be9640 1 --2- 172.21.15.18:0/3292808108 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ce0160c50 0x7f3ce0167680 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8009dc0 tx=0x7f3cd802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97cc665679763fc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:05.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.684+0000 7f3ce53e6640 1 -- 172.21.15.18:0/3292808108 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0001670 con 0x7f3ce0160c50 2024-09-19T09:19:05.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.684+0000 7f3ce53e6640 1 -- 172.21.15.18:0/3292808108 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cd8007540 con 0x7f3ce0160c50 2024-09-19T09:19:05.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.684+0000 7f3ce53e6640 1 -- 172.21.15.18:0/3292808108 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd80078f0 con 0x7f3ce0160c50 2024-09-19T09:19:05.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.685+0000 7f3ce864c640 1 -- 172.21.15.18:0/3292808108 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ce0160c50 msgr2=0x7f3ce0167680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:05.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.685+0000 7f3ce864c640 1 --2- 172.21.15.18:0/3292808108 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ce0160c50 0x7f3ce0167680 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8009dc0 tx=0x7f3cd802a5d0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.685+0000 7f3ce864c640 1 -- 172.21.15.18:0/3292808108 shutdown_connections 2024-09-19T09:19:05.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.685+0000 7f3ce864c640 1 --2- 172.21.15.18:0/3292808108 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ce0160c50 0x7f3ce0167680 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.685+0000 7f3ce864c640 1 -- 172.21.15.18:0/3292808108 >> 172.21.15.18:0/3292808108 conn(0x7f3ce006bc10 msgr2=0x7f3ce006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:05.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.685+0000 7f3ce864c640 1 -- 172.21.15.18:0/3292808108 shutdown_connections 2024-09-19T09:19:05.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.685+0000 7f3ce864c640 1 -- 172.21.15.18:0/3292808108 wait complete. 2024-09-19T09:19:05.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.686+0000 7f3ce864c640 1 Processor -- start 2024-09-19T09:19:05.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.686+0000 7f3ce864c640 1 -- start start 2024-09-19T09:19:05.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.687+0000 7f3ce864c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ce013fae0 0x7f3ce01f44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:05.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.687+0000 7f3ce864c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ce0142150 0x7f3ce00724a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:05.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.687+0000 7f3ce864c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ce0160c50 0x7f3ce01e7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:05.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.687+0000 7f3ce864c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce00cfda0 con 0x7f3ce0160c50 2024-09-19T09:19:05.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.687+0000 7f3ce864c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce00cfc20 con 0x7f3ce013fae0 2024-09-19T09:19:05.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.687+0000 7f3ce864c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3ce00cff20 con 0x7f3ce0142150 2024-09-19T09:19:05.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.687+0000 7f3ce6be9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ce0160c50 0x7f3ce01e7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:05.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.687+0000 7f3ce6be9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ce0160c50 0x7f3ce01e7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33716/0 (socket says 172.21.15.18:33716) 2024-09-19T09:19:05.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.687+0000 7f3ce6be9640 1 -- 172.21.15.18:0/2801379323 learned_addr learned my addr 172.21.15.18:0/2801379323 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:05.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.687+0000 7f3ce63e8640 1 --2- 172.21.15.18:0/2801379323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ce013fae0 0x7f3ce01f44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:05.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.687+0000 7f3ce5be7640 1 --2- 172.21.15.18:0/2801379323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ce0142150 0x7f3ce00724a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:05.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.687+0000 7f3ce6be9640 1 -- 172.21.15.18:0/2801379323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ce0142150 msgr2=0x7f3ce00724a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:05.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.687+0000 7f3ce6be9640 1 --2- 172.21.15.18:0/2801379323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ce0142150 0x7f3ce00724a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.687+0000 7f3ce6be9640 1 -- 172.21.15.18:0/2801379323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ce013fae0 msgr2=0x7f3ce01f44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:05.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.687+0000 7f3ce6be9640 1 --2- 172.21.15.18:0/2801379323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ce013fae0 0x7f3ce01f44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.687+0000 7f3ce6be9640 1 -- 172.21.15.18:0/2801379323 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce01e60b0 con 0x7f3ce0160c50 2024-09-19T09:19:05.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.688+0000 7f3ce6be9640 1 --2- 172.21.15.18:0/2801379323 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ce0160c50 0x7f3ce01e7150 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8009ee0 tx=0x7f3cd8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:05.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.688+0000 7f3cd6ffd640 1 -- 172.21.15.18:0/2801379323 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8009450 con 0x7f3ce0160c50 2024-09-19T09:19:05.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.688+0000 7f3cd6ffd640 1 -- 172.21.15.18:0/2801379323 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cd8004450 con 0x7f3ce0160c50 2024-09-19T09:19:05.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.688+0000 7f3ce864c640 1 -- 172.21.15.18:0/2801379323 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ce01e6390 con 0x7f3ce0160c50 2024-09-19T09:19:05.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.688+0000 7f3cd6ffd640 1 -- 172.21.15.18:0/2801379323 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8004800 con 0x7f3ce0160c50 2024-09-19T09:19:05.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.688+0000 7f3ce864c640 1 -- 172.21.15.18:0/2801379323 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ce01e6950 con 0x7f3ce0160c50 2024-09-19T09:19:05.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.689+0000 7f3ce864c640 1 -- 172.21.15.18:0/2801379323 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ce0160540 con 0x7f3ce0160c50 2024-09-19T09:19:05.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.689+0000 7f3cd6ffd640 1 -- 172.21.15.18:0/2801379323 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3cd803b410 con 0x7f3ce0160c50 2024-09-19T09:19:05.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.690+0000 7f3cd6ffd640 1 --2- 172.21.15.18:0/2801379323 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3cc406c2b0 0x7f3cc406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:05.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.690+0000 7f3cd6ffd640 1 -- 172.21.15.18:0/2801379323 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 4857+0+0 (secure 0 0 0) 0x7f3cd80ac610 con 0x7f3ce0160c50 2024-09-19T09:19:05.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.690+0000 7f3ce63e8640 1 --2- 172.21.15.18:0/2801379323 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3cc406c2b0 0x7f3cc406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:05.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.691+0000 7f3ce63e8640 1 --2- 172.21.15.18:0/2801379323 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3cc406c2b0 0x7f3cc406e770 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0011e0 tx=0x7f3cdc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:05.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.694+0000 7f3cd6ffd640 1 -- 172.21.15.18:0/2801379323 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3cd803f030 con 0x7f3ce0160c50 2024-09-19T09:19:05.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.872+0000 7f3ce864c640 1 -- 172.21.15.18:0/2801379323 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f3ce00008d0 con 0x7f3ce0160c50 2024-09-19T09:19:05.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.872+0000 7f3cd6ffd640 1 -- 172.21.15.18:0/2801379323 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v119) ==== 84+0+65 (secure 0 0 0) 0x7f3cd8007e20 con 0x7f3ce0160c50 2024-09-19T09:19:05.873 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:05.873 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-09-19T09:19:05.873 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:05.873 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 1, 2024-09-19T09:19:05.873 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": ".mgr" 2024-09-19T09:19:05.873 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:05.874 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-09-19T09:19:05.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.874+0000 7f3ce864c640 1 -- 172.21.15.18:0/2801379323 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3cc406c2b0 msgr2=0x7f3cc406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:05.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.874+0000 7f3ce864c640 1 --2- 172.21.15.18:0/2801379323 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3cc406c2b0 0x7f3cc406e770 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc0011e0 tx=0x7f3cdc009040 comp rx=0 tx=0).stop 2024-09-19T09:19:05.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.874+0000 7f3ce864c640 1 -- 172.21.15.18:0/2801379323 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ce0160c50 msgr2=0x7f3ce01e7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:05.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.874+0000 7f3ce864c640 1 --2- 172.21.15.18:0/2801379323 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ce0160c50 0x7f3ce01e7150 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8009ee0 tx=0x7f3cd8004a40 comp rx=0 tx=0).stop 2024-09-19T09:19:05.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.875+0000 7f3ce864c640 1 -- 172.21.15.18:0/2801379323 shutdown_connections 2024-09-19T09:19:05.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.875+0000 7f3ce864c640 1 --2- 172.21.15.18:0/2801379323 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3cc406c2b0 0x7f3cc406e770 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.875+0000 7f3ce864c640 1 --2- 172.21.15.18:0/2801379323 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ce0160c50 0x7f3ce01e7150 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.875+0000 7f3ce864c640 1 --2- 172.21.15.18:0/2801379323 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ce0142150 0x7f3ce00724a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.875+0000 7f3ce864c640 1 --2- 172.21.15.18:0/2801379323 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ce013fae0 0x7f3ce01f44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.875+0000 7f3ce864c640 1 -- 172.21.15.18:0/2801379323 >> 172.21.15.18:0/2801379323 conn(0x7f3ce006bc10 msgr2=0x7f3ce006d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:05.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.875+0000 7f3ce864c640 1 -- 172.21.15.18:0/2801379323 shutdown_connections 2024-09-19T09:19:05.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.875+0000 7f3ce864c640 1 -- 172.21.15.18:0/2801379323 wait complete. 2024-09-19T09:19:05.886 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T09:19:05.886 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T09:19:05.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.992+0000 7f1dd3549640 1 Processor -- start 2024-09-19T09:19:05.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.993+0000 7f1dd3549640 1 -- start start 2024-09-19T09:19:05.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.993+0000 7f1dd3549640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1dcc15edc0 0x7f1dcc0b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:05.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.993+0000 7f1dd3549640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1dcc0b3c90 0x7f1dcc0d2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:05.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.993+0000 7f1dd3549640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dcc0d0310 con 0x7f1dcc0d3080 2024-09-19T09:19:05.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.993+0000 7f1dd3549640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f1dcc0d05d0 con 0x7f1dcc15edc0 2024-09-19T09:19:05.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.993+0000 7f1dd3549640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1dcc0d08b0 con 0x7f1dcc0b3c90 2024-09-19T09:19:05.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.994+0000 7f1dd12e5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1dcc15edc0 0x7f1dcc0b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:05.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.994+0000 7f1dd0ae4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1dcc0b3c90 0x7f1dcc0d2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:05.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.994+0000 7f1dd12e5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1dcc15edc0 0x7f1dcc0b1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:45770/0 (socket says 172.21.15.18:45770) 2024-09-19T09:19:05.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.994+0000 7f1dd12e5640 1 -- 172.21.15.18:0/231694627 learned_addr learned my addr 172.21.15.18:0/231694627 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:05.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.994+0000 7f1dd12e5640 1 -- 172.21.15.18:0/231694627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1dcc0b3c90 msgr2=0x7f1dcc0d2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:05.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.994+0000 7f1dd12e5640 1 --2- 172.21.15.18:0/231694627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1dcc0b3c90 0x7f1dcc0d2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.994+0000 7f1dd12e5640 1 -- 172.21.15.18:0/231694627 >> v1:172.21.15.162:6789/0 conn(0x7f1dcc0d3080 legacy=0x7f1dcc0d1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:05.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.994+0000 7f1dd12e5640 1 -- 172.21.15.18:0/231694627 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dcc0d0b90 con 0x7f1dcc15edc0 2024-09-19T09:19:05.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.995+0000 7f1dd12e5640 1 --2- 172.21.15.18:0/231694627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1dcc15edc0 0x7f1dcc0b1890 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8009870 tx=0x7f1dc802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8efe20eee052304e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:05.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.995+0000 7f1dc3fff640 1 -- 172.21.15.18:0/231694627 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc8037070 con 0x7f1dcc15edc0 2024-09-19T09:19:05.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.995+0000 7f1dc3fff640 1 -- 172.21.15.18:0/231694627 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dc8032440 con 0x7f1dcc15edc0 2024-09-19T09:19:05.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.995+0000 7f1dc3fff640 1 -- 172.21.15.18:0/231694627 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc8032810 con 0x7f1dcc15edc0 2024-09-19T09:19:05.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.995+0000 7f1dd3549640 1 -- 172.21.15.18:0/231694627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1dcc15edc0 msgr2=0x7f1dcc0b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:05.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.995+0000 7f1dd3549640 1 --2- 172.21.15.18:0/231694627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1dcc15edc0 0x7f1dcc0b1890 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8009870 tx=0x7f1dc802a270 comp rx=0 tx=0).stop 2024-09-19T09:19:05.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.995+0000 7f1dd3549640 1 -- 172.21.15.18:0/231694627 shutdown_connections 2024-09-19T09:19:05.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.995+0000 7f1dd3549640 1 --2- 172.21.15.18:0/231694627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1dcc0b3c90 0x7f1dcc0d2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.995+0000 7f1dd3549640 1 --2- 172.21.15.18:0/231694627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1dcc15edc0 0x7f1dcc0b1890 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:05.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.995+0000 7f1dd3549640 1 -- 172.21.15.18:0/231694627 >> 172.21.15.18:0/231694627 conn(0x7f1dcc0d4c60 msgr2=0x7f1dcc0d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:05.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.996+0000 7f1dd3549640 1 -- 172.21.15.18:0/231694627 shutdown_connections 2024-09-19T09:19:05.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.996+0000 7f1dd3549640 1 -- 172.21.15.18:0/231694627 wait complete. 2024-09-19T09:19:05.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.997+0000 7f1dd3549640 1 Processor -- start 2024-09-19T09:19:05.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.997+0000 7f1dd3549640 1 -- start start 2024-09-19T09:19:05.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.997+0000 7f1dd3549640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1dcc0b3c90 0x7f1dcc1501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:06.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.997+0000 7f1dd3549640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1dcc0d3080 0x7f1dcc1607a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:06.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.997+0000 7f1dd3549640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1dcc15edc0 0x7f1dcc0c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:06.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.997+0000 7f1dd3549640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc0d34f0 con 0x7f1dcc15edc0 2024-09-19T09:19:06.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.997+0000 7f1dd3549640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1dcc0d2d70 con 0x7f1dcc0b3c90 2024-09-19T09:19:06.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.997+0000 7f1dd3549640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1dcc0d3670 con 0x7f1dcc0d3080 2024-09-19T09:19:06.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.998+0000 7f1dd1ae6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1dcc15edc0 0x7f1dcc0c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:06.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.998+0000 7f1dd1ae6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1dcc15edc0 0x7f1dcc0c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33726/0 (socket says 172.21.15.18:33726) 2024-09-19T09:19:06.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.998+0000 7f1dd1ae6640 1 -- 172.21.15.18:0/1914034295 learned_addr learned my addr 172.21.15.18:0/1914034295 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:06.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.998+0000 7f1dd12e5640 1 --2- 172.21.15.18:0/1914034295 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1dcc0b3c90 0x7f1dcc1501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:06.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.998+0000 7f1dd0ae4640 1 --2- 172.21.15.18:0/1914034295 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1dcc0d3080 0x7f1dcc1607a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:06.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.998+0000 7f1dd1ae6640 1 -- 172.21.15.18:0/1914034295 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1dcc0d3080 msgr2=0x7f1dcc1607a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:06.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.998+0000 7f1dd1ae6640 1 --2- 172.21.15.18:0/1914034295 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1dcc0d3080 0x7f1dcc1607a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.998+0000 7f1dd1ae6640 1 -- 172.21.15.18:0/1914034295 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1dcc0b3c90 msgr2=0x7f1dcc1501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:06.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.998+0000 7f1dd1ae6640 1 --2- 172.21.15.18:0/1914034295 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1dcc0b3c90 0x7f1dcc1501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:06.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.998+0000 7f1dd1ae6640 1 -- 172.21.15.18:0/1914034295 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dcc15f610 con 0x7f1dcc15edc0 2024-09-19T09:19:06.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.998+0000 7f1dd1ae6640 1 --2- 172.21.15.18:0/1914034295 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1dcc15edc0 0x7f1dcc0c8460 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f1dc400c7a0 tx=0x7f1dc400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:06.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.998+0000 7f1dc1ffb640 1 -- 172.21.15.18:0/1914034295 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4003b70 con 0x7f1dcc15edc0 2024-09-19T09:19:06.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.998+0000 7f1dc1ffb640 1 -- 172.21.15.18:0/1914034295 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dc4003d30 con 0x7f1dcc15edc0 2024-09-19T09:19:06.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.998+0000 7f1dd3549640 1 -- 172.21.15.18:0/1914034295 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dcc0b59c0 con 0x7f1dcc15edc0 2024-09-19T09:19:06.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.998+0000 7f1dc1ffb640 1 -- 172.21.15.18:0/1914034295 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc400aa90 con 0x7f1dcc15edc0 2024-09-19T09:19:06.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:05.999+0000 7f1dd3549640 1 -- 172.21.15.18:0/1914034295 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dcc0b5f80 con 0x7f1dcc15edc0 2024-09-19T09:19:06.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:06.000+0000 7f1dd3549640 1 -- 172.21.15.18:0/1914034295 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dcc162520 con 0x7f1dcc15edc0 2024-09-19T09:19:06.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:06.000+0000 7f1dc1ffb640 1 -- 172.21.15.18:0/1914034295 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1dc400ac30 con 0x7f1dcc15edc0 2024-09-19T09:19:06.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:06.001+0000 7f1dc1ffb640 1 --2- 172.21.15.18:0/1914034295 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1db006c2b0 0x7f1db006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:06.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:06.001+0000 7f1dc1ffb640 1 -- 172.21.15.18:0/1914034295 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 4857+0+0 (secure 0 0 0) 0x7f1dc408ae80 con 0x7f1dcc15edc0 2024-09-19T09:19:06.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:06.001+0000 7f1dd12e5640 1 --2- 172.21.15.18:0/1914034295 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1db006c2b0 0x7f1db006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:06.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:06.001+0000 7f1dd12e5640 1 --2- 172.21.15.18:0/1914034295 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1db006c2b0 0x7f1db006e770 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8034000 tx=0x7f1dc802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:06.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:06.005+0000 7f1dc1ffb640 1 -- 172.21.15.18:0/1914034295 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1dcc162520 con 0x7f1dcc15edc0 2024-09-19T09:19:06.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:06.184+0000 7f1dd3549640 1 -- 172.21.15.18:0/1914034295 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f1dcc0d2830 con 0x7f1dcc15edc0 2024-09-19T09:19:07.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.176+0000 7f1dc1ffb640 1 -- 172.21.15.18:0/1914034295 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v120) ==== 138+0+0 (secure 0 0 0) 0x7f1dc4059300 con 0x7f1dcc15edc0 2024-09-19T09:19:07.177 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' created 2024-09-19T09:19:07.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.180+0000 7f1dd3549640 1 -- 172.21.15.18:0/1914034295 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1db006c2b0 msgr2=0x7f1db006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:07.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.180+0000 7f1dd3549640 1 --2- 172.21.15.18:0/1914034295 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1db006c2b0 0x7f1db006e770 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8034000 tx=0x7f1dc802e000 comp rx=0 tx=0).stop 2024-09-19T09:19:07.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.180+0000 7f1dd3549640 1 -- 172.21.15.18:0/1914034295 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1dcc15edc0 msgr2=0x7f1dcc0c8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:07.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.180+0000 7f1dd3549640 1 --2- 172.21.15.18:0/1914034295 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1dcc15edc0 0x7f1dcc0c8460 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f1dc400c7a0 tx=0x7f1dc400cc60 comp rx=0 tx=0).stop 2024-09-19T09:19:07.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.181+0000 7f1dd3549640 1 -- 172.21.15.18:0/1914034295 shutdown_connections 2024-09-19T09:19:07.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.181+0000 7f1dd3549640 1 --2- 172.21.15.18:0/1914034295 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1db006c2b0 0x7f1db006e770 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:07.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.181+0000 7f1dd3549640 1 --2- 172.21.15.18:0/1914034295 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1dcc15edc0 0x7f1dcc0c8460 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:07.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.181+0000 7f1dd3549640 1 --2- 172.21.15.18:0/1914034295 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1dcc0d3080 0x7f1dcc1607a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:07.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.181+0000 7f1dd3549640 1 --2- 172.21.15.18:0/1914034295 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1dcc0b3c90 0x7f1dcc1501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:07.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.181+0000 7f1dd3549640 1 -- 172.21.15.18:0/1914034295 >> 172.21.15.18:0/1914034295 conn(0x7f1dcc0d4c60 msgr2=0x7f1dcc06d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:07.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.181+0000 7f1dd3549640 1 -- 172.21.15.18:0/1914034295 shutdown_connections 2024-09-19T09:19:07.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.181+0000 7f1dd3549640 1 -- 172.21.15.18:0/1914034295 wait complete. 2024-09-19T09:19:07.196 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T09:19:07.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.312+0000 7f7638b49640 1 Processor -- start 2024-09-19T09:19:07.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.312+0000 7f7638b49640 1 -- start start 2024-09-19T09:19:07.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.313+0000 7f7638b49640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f763406deb0 0x7f76340b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:07.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.313+0000 7f7638b49640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f763415f1a0 0x7f7634160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:07.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.313+0000 7f7638b49640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76340b6a60 con 0x7f763415c670 2024-09-19T09:19:07.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.313+0000 7f7638b49640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f76340b6d40 con 0x7f763406deb0 2024-09-19T09:19:07.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.313+0000 7f7638b49640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f76340b7020 con 0x7f763415f1a0 2024-09-19T09:19:07.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.313+0000 7f762bfff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f763406deb0 0x7f76340b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:07.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.313+0000 7f7632d9d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f763415f1a0 0x7f7634160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:07.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.313+0000 7f7632d9d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f763415f1a0 0x7f7634160300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:33890/0 (socket says 172.21.15.18:33890) 2024-09-19T09:19:07.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.313+0000 7f7632d9d640 1 -- 172.21.15.18:0/4101073445 learned_addr learned my addr 172.21.15.18:0/4101073445 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:07.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.313+0000 7f763259c640 1 --1- 172.21.15.18:0/4101073445 >> v1:172.21.15.162:6789/0 conn(0x7f763415c670 0x7f763406d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:57616/0 (socket says 172.21.15.18:57616) 2024-09-19T09:19:07.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.313+0000 7f762bfff640 1 -- 172.21.15.18:0/4101073445 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f763415f1a0 msgr2=0x7f7634160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:07.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.313+0000 7f762bfff640 1 --2- 172.21.15.18:0/4101073445 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f763415f1a0 0x7f7634160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:07.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.313+0000 7f762bfff640 1 -- 172.21.15.18:0/4101073445 >> v1:172.21.15.162:6789/0 conn(0x7f763415c670 legacy=0x7f763406d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:07.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.313+0000 7f762bfff640 1 -- 172.21.15.18:0/4101073445 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76340b7300 con 0x7f763406deb0 2024-09-19T09:19:07.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.313+0000 7f7631d9b640 1 -- 172.21.15.18:0/4101073445 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2687966086 0 0) 0x7f76340b6a60 con 0x7f763415c670 2024-09-19T09:19:07.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.314+0000 7f762bfff640 1 --2- 172.21.15.18:0/4101073445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f763406deb0 0x7f76340b6410 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f761c0097d0 tx=0x7f761c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b56bc9a01957ef88 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:07.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.314+0000 7f7631d9b640 1 -- 172.21.15.18:0/4101073445 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c037070 con 0x7f763406deb0 2024-09-19T09:19:07.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.315+0000 7f7631d9b640 1 -- 172.21.15.18:0/4101073445 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f761c032440 con 0x7f763406deb0 2024-09-19T09:19:07.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.315+0000 7f7631d9b640 1 -- 172.21.15.18:0/4101073445 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c032810 con 0x7f763406deb0 2024-09-19T09:19:07.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.315+0000 7f7638b49640 1 -- 172.21.15.18:0/4101073445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f763406deb0 msgr2=0x7f76340b6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:07.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.315+0000 7f7638b49640 1 --2- 172.21.15.18:0/4101073445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f763406deb0 0x7f76340b6410 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f761c0097d0 tx=0x7f761c02a1c0 comp rx=0 tx=0).stop 2024-09-19T09:19:07.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.315+0000 7f7638b49640 1 -- 172.21.15.18:0/4101073445 shutdown_connections 2024-09-19T09:19:07.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.315+0000 7f7638b49640 1 --2- 172.21.15.18:0/4101073445 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f763415f1a0 0x7f7634160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:07.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.315+0000 7f7638b49640 1 --2- 172.21.15.18:0/4101073445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f763406deb0 0x7f76340b6410 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:07.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.315+0000 7f7638b49640 1 -- 172.21.15.18:0/4101073445 >> 172.21.15.18:0/4101073445 conn(0x7f763409b9d0 msgr2=0x7f763409bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:07.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.315+0000 7f7638b49640 1 -- 172.21.15.18:0/4101073445 shutdown_connections 2024-09-19T09:19:07.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.315+0000 7f7638b49640 1 -- 172.21.15.18:0/4101073445 wait complete. 2024-09-19T09:19:07.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.316+0000 7f7638b49640 1 Processor -- start 2024-09-19T09:19:07.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.316+0000 7f7638b49640 1 -- start start 2024-09-19T09:19:07.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.317+0000 7f7638b49640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f763406deb0 0x7f76341549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:07.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.317+0000 7f7638b49640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f763415c670 0x7f76340cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:07.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.317+0000 7f7638b49640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f763415f1a0 0x7f763415a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:07.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.317+0000 7f7638b49640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f76340b7b00 con 0x7f763415c670 2024-09-19T09:19:07.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.317+0000 7f7638b49640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f763409c560 con 0x7f763406deb0 2024-09-19T09:19:07.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.317+0000 7f7638b49640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f76341610f0 con 0x7f763415f1a0 2024-09-19T09:19:07.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.317+0000 7f762bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f763415c670 0x7f76340cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:07.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.317+0000 7f762bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f763415c670 0x7f76340cd8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33742/0 (socket says 172.21.15.18:33742) 2024-09-19T09:19:07.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.317+0000 7f762bfff640 1 -- 172.21.15.18:0/3124416506 learned_addr learned my addr 172.21.15.18:0/3124416506 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:07.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.317+0000 7f763259c640 1 --2- 172.21.15.18:0/3124416506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f763406deb0 0x7f76341549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:07.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.318+0000 7f7632d9d640 1 --2- 172.21.15.18:0/3124416506 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f763415f1a0 0x7f763415a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:07.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.318+0000 7f762bfff640 1 -- 172.21.15.18:0/3124416506 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f763415f1a0 msgr2=0x7f763415a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:07.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.318+0000 7f762bfff640 1 --2- 172.21.15.18:0/3124416506 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f763415f1a0 0x7f763415a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:07.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.318+0000 7f762bfff640 1 -- 172.21.15.18:0/3124416506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f763406deb0 msgr2=0x7f76341549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:07.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.318+0000 7f762bfff640 1 --2- 172.21.15.18:0/3124416506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f763406deb0 0x7f76341549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:07.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.318+0000 7f762bfff640 1 -- 172.21.15.18:0/3124416506 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76341613d0 con 0x7f763415c670 2024-09-19T09:19:07.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.318+0000 7f762bfff640 1 --2- 172.21.15.18:0/3124416506 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f763415c670 0x7f76340cd8b0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f761c02a7b0 tx=0x7f761c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:07.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.318+0000 7f762affd640 1 -- 172.21.15.18:0/3124416506 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c037040 con 0x7f763415c670 2024-09-19T09:19:07.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.318+0000 7f762affd640 1 -- 172.21.15.18:0/3124416506 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f761c042070 con 0x7f763415c670 2024-09-19T09:19:07.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.318+0000 7f7638b49640 1 -- 172.21.15.18:0/3124416506 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76341616b0 con 0x7f763415c670 2024-09-19T09:19:07.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.318+0000 7f762affd640 1 -- 172.21.15.18:0/3124416506 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c03b930 con 0x7f763415c670 2024-09-19T09:19:07.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.318+0000 7f7638b49640 1 -- 172.21.15.18:0/3124416506 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7634161c70 con 0x7f763415c670 2024-09-19T09:19:07.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.319+0000 7f7638b49640 1 -- 172.21.15.18:0/3124416506 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f763415d210 con 0x7f763415c670 2024-09-19T09:19:07.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.320+0000 7f762affd640 1 -- 172.21.15.18:0/3124416506 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f761c03bad0 con 0x7f763415c670 2024-09-19T09:19:07.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.320+0000 7f762affd640 1 --2- 172.21.15.18:0/3124416506 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f761406c2b0 0x7f761406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:07.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.320+0000 7f762affd640 1 -- 172.21.15.18:0/3124416506 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5227+0+0 (secure 0 0 0) 0x7f761c0abba0 con 0x7f763415c670 2024-09-19T09:19:07.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.321+0000 7f763259c640 1 --2- 172.21.15.18:0/3124416506 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f761406c2b0 0x7f761406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:07.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.321+0000 7f763259c640 1 --2- 172.21.15.18:0/3124416506 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f761406c2b0 0x7f761406e770 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7624000f60 tx=0x7f7624007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:07.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.325+0000 7f762affd640 1 -- 172.21.15.18:0/3124416506 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f761c07a3d0 con 0x7f763415c670 2024-09-19T09:19:07.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:07.505+0000 7f7638b49640 1 -- 172.21.15.18:0/3124416506 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f76340755b0 con 0x7f763415c670 2024-09-19T09:19:08.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.181+0000 7f762affd640 1 -- 172.21.15.18:0/3124416506 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v121) ==== 170+0+0 (secure 0 0 0) 0x7f761c079cd0 con 0x7f763415c670 2024-09-19T09:19:08.182 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' created 2024-09-19T09:19:08.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.184+0000 7f7638b49640 1 -- 172.21.15.18:0/3124416506 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f761406c2b0 msgr2=0x7f761406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:08.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.184+0000 7f7638b49640 1 --2- 172.21.15.18:0/3124416506 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f761406c2b0 0x7f761406e770 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f7624000f60 tx=0x7f7624007d50 comp rx=0 tx=0).stop 2024-09-19T09:19:08.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.184+0000 7f7638b49640 1 -- 172.21.15.18:0/3124416506 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f763415c670 msgr2=0x7f76340cd8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:08.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.184+0000 7f7638b49640 1 --2- 172.21.15.18:0/3124416506 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f763415c670 0x7f76340cd8b0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f761c02a7b0 tx=0x7f761c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.184+0000 7f7638b49640 1 -- 172.21.15.18:0/3124416506 shutdown_connections 2024-09-19T09:19:08.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.184+0000 7f7638b49640 1 --2- 172.21.15.18:0/3124416506 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f761406c2b0 0x7f761406e770 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.184+0000 7f7638b49640 1 --2- 172.21.15.18:0/3124416506 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f763415f1a0 0x7f763415a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.184+0000 7f7638b49640 1 --2- 172.21.15.18:0/3124416506 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f763415c670 0x7f76340cd8b0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.184+0000 7f7638b49640 1 --2- 172.21.15.18:0/3124416506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f763406deb0 0x7f76341549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.184+0000 7f7638b49640 1 -- 172.21.15.18:0/3124416506 >> 172.21.15.18:0/3124416506 conn(0x7f763409b9d0 msgr2=0x7f763406d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:08.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.185+0000 7f7638b49640 1 -- 172.21.15.18:0/3124416506 shutdown_connections 2024-09-19T09:19:08.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.185+0000 7f7638b49640 1 -- 172.21.15.18:0/3124416506 wait complete. 2024-09-19T09:19:08.205 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T09:19:08.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.315+0000 7f50c828d640 1 Processor -- start 2024-09-19T09:19:08.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.315+0000 7f50c828d640 1 -- start start 2024-09-19T09:19:08.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.316+0000 7f50c828d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50c015ba30 0x7f50c00b3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:08.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.316+0000 7f50c828d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f50c00b6e00 0x7f50c00ae600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:08.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.316+0000 7f50c828d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f50c00aeb40 0x7f50c00b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:08.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.316+0000 7f50c828d640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f50c006bc10 con 0x7f50c00aeb40 2024-09-19T09:19:08.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.316+0000 7f50c828d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f50c006bef0 con 0x7f50c00b6e00 2024-09-19T09:19:08.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.316+0000 7f50c828d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f50c006cfe0 con 0x7f50c015ba30 2024-09-19T09:19:08.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.316+0000 7f50c682a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f50c00aeb40 0x7f50c00b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:08.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.316+0000 7f50c682a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f50c00aeb40 0x7f50c00b0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33748/0 (socket says 172.21.15.18:33748) 2024-09-19T09:19:08.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.316+0000 7f50c682a640 1 -- 172.21.15.18:0/1091857554 learned_addr learned my addr 172.21.15.18:0/1091857554 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:08.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.316+0000 7f50c5828640 1 --2- 172.21.15.18:0/1091857554 >> v2:172.21.15.162:3300/0 conn(0x7f50c00b6e00 0x7f50c00ae600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:08.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.316+0000 7f50c6029640 1 --2- 172.21.15.18:0/1091857554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50c015ba30 0x7f50c00b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:08.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.316+0000 7f50c682a640 1 -- 172.21.15.18:0/1091857554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50c015ba30 msgr2=0x7f50c00b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:08.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.316+0000 7f50c682a640 1 --2- 172.21.15.18:0/1091857554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50c015ba30 0x7f50c00b3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.316+0000 7f50c682a640 1 -- 172.21.15.18:0/1091857554 >> v2:172.21.15.162:3300/0 conn(0x7f50c00b6e00 msgr2=0x7f50c00ae600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:08.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.316+0000 7f50c682a640 1 --2- 172.21.15.18:0/1091857554 >> v2:172.21.15.162:3300/0 conn(0x7f50c00b6e00 0x7f50c00ae600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.316+0000 7f50c682a640 1 -- 172.21.15.18:0/1091857554 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c006d280 con 0x7f50c00aeb40 2024-09-19T09:19:08.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.317+0000 7f50c682a640 1 --2- 172.21.15.18:0/1091857554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50c00aeb40 0x7f50c00b0fe0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f50c00b0da0 tx=0x7f50b802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=209a94c686d1399f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:08.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.317+0000 7f50c5027640 1 -- 172.21.15.18:0/1091857554 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b8036070 con 0x7f50c00aeb40 2024-09-19T09:19:08.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.317+0000 7f50c5027640 1 -- 172.21.15.18:0/1091857554 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b8031600 con 0x7f50c00aeb40 2024-09-19T09:19:08.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.317+0000 7f50c5027640 1 -- 172.21.15.18:0/1091857554 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b80319d0 con 0x7f50c00aeb40 2024-09-19T09:19:08.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.318+0000 7f50c828d640 1 -- 172.21.15.18:0/1091857554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50c00aeb40 msgr2=0x7f50c00b0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:08.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.318+0000 7f50c828d640 1 --2- 172.21.15.18:0/1091857554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50c00aeb40 0x7f50c00b0fe0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f50c00b0da0 tx=0x7f50b802a6a0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.318+0000 7f50c828d640 1 -- 172.21.15.18:0/1091857554 shutdown_connections 2024-09-19T09:19:08.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.318+0000 7f50c828d640 1 --2- 172.21.15.18:0/1091857554 >> v2:172.21.15.162:3300/0 conn(0x7f50c00b6e00 0x7f50c00ae600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.318+0000 7f50c828d640 1 --2- 172.21.15.18:0/1091857554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50c00aeb40 0x7f50c00b0fe0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.318+0000 7f50c828d640 1 --2- 172.21.15.18:0/1091857554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50c015ba30 0x7f50c00b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.318+0000 7f50c828d640 1 -- 172.21.15.18:0/1091857554 >> 172.21.15.18:0/1091857554 conn(0x7f50c00b5fc0 msgr2=0x7f50c00b6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:08.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.318+0000 7f50c828d640 1 -- 172.21.15.18:0/1091857554 shutdown_connections 2024-09-19T09:19:08.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.318+0000 7f50c828d640 1 -- 172.21.15.18:0/1091857554 wait complete. 2024-09-19T09:19:08.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.319+0000 7f50c828d640 1 Processor -- start 2024-09-19T09:19:08.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.319+0000 7f50c828d640 1 -- start start 2024-09-19T09:19:08.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.320+0000 7f50c828d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50c00aeb40 0x7f50c014f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:08.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.320+0000 7f50c828d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50c00b6e00 0x7f50c006ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:08.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.320+0000 7f50c828d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50c015ba30 0x7f50c006f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:08.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.320+0000 7f50c828d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f50c00b3aa0 con 0x7f50c00b6e00 2024-09-19T09:19:08.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.320+0000 7f50c828d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f50c015be10 con 0x7f50c015ba30 2024-09-19T09:19:08.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.320+0000 7f50c828d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f50c00b3c20 con 0x7f50c00aeb40 2024-09-19T09:19:08.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.320+0000 7f50c5828640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50c00b6e00 0x7f50c006ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:08.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.320+0000 7f50c5828640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50c00b6e00 0x7f50c006ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33758/0 (socket says 172.21.15.18:33758) 2024-09-19T09:19:08.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.320+0000 7f50c5828640 1 -- 172.21.15.18:0/794655384 learned_addr learned my addr 172.21.15.18:0/794655384 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:08.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.320+0000 7f50c6029640 1 --2- 172.21.15.18:0/794655384 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50c00aeb40 0x7f50c014f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:08.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.320+0000 7f50c682a640 1 --2- 172.21.15.18:0/794655384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50c015ba30 0x7f50c006f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:08.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.321+0000 7f50c5828640 1 -- 172.21.15.18:0/794655384 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50c00aeb40 msgr2=0x7f50c014f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:08.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.321+0000 7f50c5828640 1 --2- 172.21.15.18:0/794655384 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50c00aeb40 0x7f50c014f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.321+0000 7f50c5828640 1 -- 172.21.15.18:0/794655384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50c015ba30 msgr2=0x7f50c006f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:08.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.321+0000 7f50c5828640 1 --2- 172.21.15.18:0/794655384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50c015ba30 0x7f50c006f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:08.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.321+0000 7f50c5828640 1 -- 172.21.15.18:0/794655384 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c014f6d0 con 0x7f50c00b6e00 2024-09-19T09:19:08.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.321+0000 7f50c5828640 1 --2- 172.21.15.18:0/794655384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50c00b6e00 0x7f50c006ef00 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f50b000e860 tx=0x7f50b000ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:08.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.321+0000 7f50b6ffd640 1 -- 172.21.15.18:0/794655384 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b0017070 con 0x7f50c00b6e00 2024-09-19T09:19:08.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.321+0000 7f50b6ffd640 1 -- 172.21.15.18:0/794655384 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b000c940 con 0x7f50c00b6e00 2024-09-19T09:19:08.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.321+0000 7f50c828d640 1 -- 172.21.15.18:0/794655384 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c00ca9e0 con 0x7f50c00b6e00 2024-09-19T09:19:08.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.321+0000 7f50b6ffd640 1 -- 172.21.15.18:0/794655384 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b000cd10 con 0x7f50c00b6e00 2024-09-19T09:19:08.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.321+0000 7f50c828d640 1 -- 172.21.15.18:0/794655384 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c00cafa0 con 0x7f50c00b6e00 2024-09-19T09:19:08.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.322+0000 7f50c828d640 1 -- 172.21.15.18:0/794655384 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50c00cb7a0 con 0x7f50c00b6e00 2024-09-19T09:19:08.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.323+0000 7f50b6ffd640 1 -- 172.21.15.18:0/794655384 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f50b001a070 con 0x7f50c00b6e00 2024-09-19T09:19:08.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.323+0000 7f50b6ffd640 1 --2- 172.21.15.18:0/794655384 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f50a406c2b0 0x7f50a406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:08.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.323+0000 7f50b6ffd640 1 -- 172.21.15.18:0/794655384 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5609+0+0 (secure 0 0 0) 0x7f50b008b370 con 0x7f50c00b6e00 2024-09-19T09:19:08.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.323+0000 7f50c6029640 1 --2- 172.21.15.18:0/794655384 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f50a406c2b0 0x7f50a406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:08.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.324+0000 7f50c6029640 1 --2- 172.21.15.18:0/794655384 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f50a406c2b0 0x7f50a406e770 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f50c006ce10 tx=0x7f50bc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:08.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.328+0000 7f50b6ffd640 1 -- 172.21.15.18:0/794655384 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f50c014f6d0 con 0x7f50c00b6e00 2024-09-19T09:19:08.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:08.538+0000 7f50c828d640 1 -- 172.21.15.18:0/794655384 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f50c00ae600 con 0x7f50c00b6e00 2024-09-19T09:19:09.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.183+0000 7f50b6ffd640 1 -- 172.21.15.18:0/794655384 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v46) ==== 174+0+0 (secure 0 0 0) 0x7f50b0059580 con 0x7f50c00b6e00 2024-09-19T09:19:09.184 INFO:teuthology.orchestra.run.smithi018.stderr:new fs with metadata pool 14 and data pool 15 2024-09-19T09:19:09.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.186+0000 7f50c828d640 1 -- 172.21.15.18:0/794655384 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f50a406c2b0 msgr2=0x7f50a406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:09.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.186+0000 7f50c828d640 1 --2- 172.21.15.18:0/794655384 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f50a406c2b0 0x7f50a406e770 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f50c006ce10 tx=0x7f50bc009190 comp rx=0 tx=0).stop 2024-09-19T09:19:09.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.186+0000 7f50c828d640 1 -- 172.21.15.18:0/794655384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50c00b6e00 msgr2=0x7f50c006ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:09.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.186+0000 7f50c828d640 1 --2- 172.21.15.18:0/794655384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50c00b6e00 0x7f50c006ef00 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f50b000e860 tx=0x7f50b000ed20 comp rx=0 tx=0).stop 2024-09-19T09:19:09.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.186+0000 7f50c828d640 1 -- 172.21.15.18:0/794655384 shutdown_connections 2024-09-19T09:19:09.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.186+0000 7f50c828d640 1 --2- 172.21.15.18:0/794655384 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f50a406c2b0 0x7f50a406e770 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.186+0000 7f50c828d640 1 --2- 172.21.15.18:0/794655384 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f50c015ba30 0x7f50c006f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.186+0000 7f50c828d640 1 --2- 172.21.15.18:0/794655384 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f50c00b6e00 0x7f50c006ef00 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.186+0000 7f50c828d640 1 --2- 172.21.15.18:0/794655384 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f50c00aeb40 0x7f50c014f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.186+0000 7f50c828d640 1 -- 172.21.15.18:0/794655384 >> 172.21.15.18:0/794655384 conn(0x7f50c00b5fc0 msgr2=0x7f50c00b05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:09.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.186+0000 7f50c828d640 1 -- 172.21.15.18:0/794655384 shutdown_connections 2024-09-19T09:19:09.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.186+0000 7f50c828d640 1 -- 172.21.15.18:0/794655384 wait complete. 2024-09-19T09:19:09.208 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:19:09.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.315+0000 7fb280791640 1 Processor -- start 2024-09-19T09:19:09.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.315+0000 7fb280791640 1 -- start start 2024-09-19T09:19:09.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.316+0000 7fb280791640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb27815ef80 0x7fb2780b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.316+0000 7fb280791640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb2780cfae0 0x7fb2780cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.316+0000 7fb280791640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2780cd1a0 con 0x7fb27806d730 2024-09-19T09:19:09.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.316+0000 7fb280791640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fb2780cd7d0 con 0x7fb27815ef80 2024-09-19T09:19:09.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.316+0000 7fb280791640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb27806dc30 con 0x7fb2780cfae0 2024-09-19T09:19:09.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.316+0000 7fb27e52d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb27815ef80 0x7fb2780b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.316+0000 7fb27dd2c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb27806d730 0x7fb2780cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52782/0 (socket says 172.21.15.18:52782) 2024-09-19T09:19:09.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.316+0000 7fb27dd2c640 1 -- 172.21.15.18:0/3027617468 learned_addr learned my addr 172.21.15.18:0/3027617468 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:09.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.316+0000 7fb27ed2e640 1 --2- 172.21.15.18:0/3027617468 >> v2:172.21.15.162:3300/0 conn(0x7fb2780cfae0 0x7fb2780cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.316+0000 7fb27e52d640 1 -- 172.21.15.18:0/3027617468 >> v2:172.21.15.162:3300/0 conn(0x7fb2780cfae0 msgr2=0x7fb2780cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:09.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.316+0000 7fb27e52d640 1 --2- 172.21.15.18:0/3027617468 >> v2:172.21.15.162:3300/0 conn(0x7fb2780cfae0 0x7fb2780cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.316+0000 7fb27e52d640 1 -- 172.21.15.18:0/3027617468 >> v1:172.21.15.18:6789/0 conn(0x7fb27806d730 legacy=0x7fb2780cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:09.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.316+0000 7fb27e52d640 1 -- 172.21.15.18:0/3027617468 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb27806df10 con 0x7fb27815ef80 2024-09-19T09:19:09.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.316+0000 7fb27d52b640 1 -- 172.21.15.18:0/3027617468 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 101809073 0 0) 0x7fb2780cd1a0 con 0x7fb27806d730 2024-09-19T09:19:09.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.316+0000 7fb27ed2e640 1 --2- 172.21.15.18:0/3027617468 >> v2:172.21.15.162:3300/0 conn(0x7fb2780cfae0 0x7fb2780cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:09.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.317+0000 7fb27e52d640 1 --2- 172.21.15.18:0/3027617468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb27815ef80 0x7fb2780b5220 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fb27806f360 tx=0x7fb27402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80f643574ba74bf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:09.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.317+0000 7fb27d52b640 1 -- 172.21.15.18:0/3027617468 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb274037070 con 0x7fb27815ef80 2024-09-19T09:19:09.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.317+0000 7fb27d52b640 1 -- 172.21.15.18:0/3027617468 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb274032440 con 0x7fb27815ef80 2024-09-19T09:19:09.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.317+0000 7fb27d52b640 1 -- 172.21.15.18:0/3027617468 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb274032810 con 0x7fb27815ef80 2024-09-19T09:19:09.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.318+0000 7fb280791640 1 -- 172.21.15.18:0/3027617468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb27815ef80 msgr2=0x7fb2780b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:09.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.318+0000 7fb280791640 1 --2- 172.21.15.18:0/3027617468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb27815ef80 0x7fb2780b5220 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fb27806f360 tx=0x7fb27402a1a0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.318+0000 7fb280791640 1 -- 172.21.15.18:0/3027617468 shutdown_connections 2024-09-19T09:19:09.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.318+0000 7fb280791640 1 --2- 172.21.15.18:0/3027617468 >> v2:172.21.15.162:3300/0 conn(0x7fb2780cfae0 0x7fb2780cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.318+0000 7fb280791640 1 --2- 172.21.15.18:0/3027617468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb27815ef80 0x7fb2780b5220 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.318+0000 7fb280791640 1 -- 172.21.15.18:0/3027617468 >> 172.21.15.18:0/3027617468 conn(0x7fb2780b4700 msgr2=0x7fb2780b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:09.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.318+0000 7fb280791640 1 -- 172.21.15.18:0/3027617468 shutdown_connections 2024-09-19T09:19:09.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.318+0000 7fb280791640 1 -- 172.21.15.18:0/3027617468 wait complete. 2024-09-19T09:19:09.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.319+0000 7fb280791640 1 Processor -- start 2024-09-19T09:19:09.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.319+0000 7fb280791640 1 -- start start 2024-09-19T09:19:09.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.320+0000 7fb280791640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb27806d730 0x7fb27815afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.320+0000 7fb280791640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2780cfae0 0x7fb2780b6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.320+0000 7fb280791640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb27815ef80 0x7fb278161a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.320+0000 7fb280791640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb2780d0120 con 0x7fb2780cfae0 2024-09-19T09:19:09.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.320+0000 7fb280791640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb27815f360 con 0x7fb27806d730 2024-09-19T09:19:09.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.320+0000 7fb280791640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb2780ce1a0 con 0x7fb27815ef80 2024-09-19T09:19:09.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.320+0000 7fb27dd2c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2780cfae0 0x7fb2780b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.320+0000 7fb27dd2c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2780cfae0 0x7fb2780b6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33784/0 (socket says 172.21.15.18:33784) 2024-09-19T09:19:09.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.320+0000 7fb27dd2c640 1 -- 172.21.15.18:0/171352358 learned_addr learned my addr 172.21.15.18:0/171352358 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:09.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.320+0000 7fb27e52d640 1 --2- 172.21.15.18:0/171352358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb27806d730 0x7fb27815afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.320+0000 7fb27ed2e640 1 --2- 172.21.15.18:0/171352358 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb27815ef80 0x7fb278161a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.320+0000 7fb27dd2c640 1 -- 172.21.15.18:0/171352358 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb27815ef80 msgr2=0x7fb278161a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:09.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.320+0000 7fb27dd2c640 1 --2- 172.21.15.18:0/171352358 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb27815ef80 0x7fb278161a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.320+0000 7fb27dd2c640 1 -- 172.21.15.18:0/171352358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb27806d730 msgr2=0x7fb27815afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:09.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.320+0000 7fb27dd2c640 1 --2- 172.21.15.18:0/171352358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb27806d730 0x7fb27815afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.320+0000 7fb27dd2c640 1 -- 172.21.15.18:0/171352358 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb27815a210 con 0x7fb2780cfae0 2024-09-19T09:19:09.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.321+0000 7fb27dd2c640 1 --2- 172.21.15.18:0/171352358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2780cfae0 0x7fb2780b6410 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fb26c00c4d0 tx=0x7fb26c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:09.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.321+0000 7fb26affd640 1 -- 172.21.15.18:0/171352358 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c018070 con 0x7fb2780cfae0 2024-09-19T09:19:09.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.321+0000 7fb26affd640 1 -- 172.21.15.18:0/171352358 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb26c007500 con 0x7fb2780cfae0 2024-09-19T09:19:09.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.321+0000 7fb280791640 1 -- 172.21.15.18:0/171352358 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb27815a4f0 con 0x7fb2780cfae0 2024-09-19T09:19:09.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.321+0000 7fb26affd640 1 -- 172.21.15.18:0/171352358 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb26c004a20 con 0x7fb2780cfae0 2024-09-19T09:19:09.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.321+0000 7fb280791640 1 -- 172.21.15.18:0/171352358 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb27815aab0 con 0x7fb2780cfae0 2024-09-19T09:19:09.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.322+0000 7fb280791640 1 -- 172.21.15.18:0/171352358 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb27815acb0 con 0x7fb2780cfae0 2024-09-19T09:19:09.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.322+0000 7fb26affd640 1 -- 172.21.15.18:0/171352358 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb26c01b070 con 0x7fb2780cfae0 2024-09-19T09:19:09.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.323+0000 7fb26affd640 1 --2- 172.21.15.18:0/171352358 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb25c06c2e0 0x7fb25c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.323+0000 7fb26affd640 1 -- 172.21.15.18:0/171352358 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5709+0+0 (secure 0 0 0) 0x7fb26c08a6a0 con 0x7fb2780cfae0 2024-09-19T09:19:09.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.323+0000 7fb27e52d640 1 --2- 172.21.15.18:0/171352358 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb25c06c2e0 0x7fb25c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.324+0000 7fb27e52d640 1 --2- 172.21.15.18:0/171352358 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb25c06c2e0 0x7fb25c06e7a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb274034000 tx=0x7fb27402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:09.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.327+0000 7fb26affd640 1 -- 172.21.15.18:0/171352358 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb27815acb0 con 0x7fb2780cfae0 2024-09-19T09:19:09.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.502+0000 7fb280791640 1 -- 172.21.15.18:0/171352358 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb2780cff00 con 0x7fb2780cfae0 2024-09-19T09:19:09.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.503+0000 7fb26affd640 1 -- 172.21.15.18:0/171352358 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) ==== 74+0+16705 (secure 0 0 0) 0x7fb26c0587b0 con 0x7fb2780cfae0 2024-09-19T09:19:09.504 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:09.504 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":122,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:19:08.539701+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:19:06.215588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-19T09:19:07.536940+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:19:09.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.505+0000 7fb280791640 1 -- 172.21.15.18:0/171352358 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb25c06c2e0 msgr2=0x7fb25c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:09.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.505+0000 7fb280791640 1 --2- 172.21.15.18:0/171352358 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb25c06c2e0 0x7fb25c06e7a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb274034000 tx=0x7fb27402e000 comp rx=0 tx=0).stop 2024-09-19T09:19:09.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.505+0000 7fb280791640 1 -- 172.21.15.18:0/171352358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2780cfae0 msgr2=0x7fb2780b6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:09.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.505+0000 7fb280791640 1 --2- 172.21.15.18:0/171352358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2780cfae0 0x7fb2780b6410 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fb26c00c4d0 tx=0x7fb26c00c990 comp rx=0 tx=0).stop 2024-09-19T09:19:09.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.505+0000 7fb280791640 1 -- 172.21.15.18:0/171352358 shutdown_connections 2024-09-19T09:19:09.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.505+0000 7fb280791640 1 --2- 172.21.15.18:0/171352358 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb25c06c2e0 0x7fb25c06e7a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.505+0000 7fb280791640 1 --2- 172.21.15.18:0/171352358 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb27815ef80 0x7fb278161a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.505+0000 7fb280791640 1 --2- 172.21.15.18:0/171352358 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2780cfae0 0x7fb2780b6410 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.505+0000 7fb280791640 1 --2- 172.21.15.18:0/171352358 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb27806d730 0x7fb27815afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.505+0000 7fb280791640 1 -- 172.21.15.18:0/171352358 >> 172.21.15.18:0/171352358 conn(0x7fb2780b4700 msgr2=0x7fb2780ce500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:09.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.505+0000 7fb280791640 1 -- 172.21.15.18:0/171352358 shutdown_connections 2024-09-19T09:19:09.506 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.505+0000 7fb280791640 1 -- 172.21.15.18:0/171352358 wait complete. 2024-09-19T09:19:09.519 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:19:09.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.622+0000 7f3de61c4640 1 Processor -- start 2024-09-19T09:19:09.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.622+0000 7f3de61c4640 1 -- start start 2024-09-19T09:19:09.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.623+0000 7f3de61c4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3de00b5b00 0x7f3de0169980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.623+0000 7f3de61c4640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3de00d31b0 con 0x7f3de00d1c70 2024-09-19T09:19:09.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.623+0000 7f3de61c4640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3de00d3490 con 0x7f3de015ed50 2024-09-19T09:19:09.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.623+0000 7f3de61c4640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f3de00d3770 con 0x7f3de00b5b00 2024-09-19T09:19:09.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.623+0000 7f3ddeffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3de00d1c70 0x7f3de00cf9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52794/0 (socket says 172.21.15.18:52794) 2024-09-19T09:19:09.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.623+0000 7f3ddeffd640 1 -- 172.21.15.18:0/4126002408 learned_addr learned my addr 172.21.15.18:0/4126002408 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:09.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.623+0000 7f3ddffff640 1 --2- 172.21.15.18:0/4126002408 >> v2:172.21.15.18:3300/0 conn(0x7f3de00b5b00 0x7f3de0169980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.623+0000 7f3dde7fc640 1 -- 172.21.15.18:0/4126002408 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 226635892 0 0) 0x7f3de00d31b0 con 0x7f3de00d1c70 2024-09-19T09:19:09.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.624+0000 7f3dde7fc640 1 -- 172.21.15.18:0/4126002408 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3dc8003520 con 0x7f3de00d1c70 2024-09-19T09:19:09.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.624+0000 7f3ddffff640 1 -- 172.21.15.18:0/4126002408 >> v1:172.21.15.162:6789/0 conn(0x7f3de015ed50 legacy=0x7f3de00d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:09.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.624+0000 7f3ddffff640 1 -- 172.21.15.18:0/4126002408 >> v1:172.21.15.18:6789/0 conn(0x7f3de00d1c70 legacy=0x7f3de00cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:09.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.624+0000 7f3ddffff640 1 -- 172.21.15.18:0/4126002408 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de00d3a50 con 0x7f3de00b5b00 2024-09-19T09:19:09.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.624+0000 7f3ddffff640 1 --2- 172.21.15.18:0/4126002408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de00b5b00 0x7f3de0169980 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8009d90 tx=0x7f3dd802a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92706711d93e62f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:09.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.625+0000 7f3dde7fc640 1 -- 172.21.15.18:0/4126002408 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8037070 con 0x7f3de00b5b00 2024-09-19T09:19:09.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.625+0000 7f3dde7fc640 1 -- 172.21.15.18:0/4126002408 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dd8007740 con 0x7f3de00b5b00 2024-09-19T09:19:09.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.625+0000 7f3dde7fc640 1 -- 172.21.15.18:0/4126002408 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd8007b10 con 0x7f3de00b5b00 2024-09-19T09:19:09.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.625+0000 7f3de61c4640 1 -- 172.21.15.18:0/4126002408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de00b5b00 msgr2=0x7f3de0169980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:09.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.625+0000 7f3de61c4640 1 --2- 172.21.15.18:0/4126002408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de00b5b00 0x7f3de0169980 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f3dd8009d90 tx=0x7f3dd802a780 comp rx=0 tx=0).stop 2024-09-19T09:19:09.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.625+0000 7f3de61c4640 1 -- 172.21.15.18:0/4126002408 shutdown_connections 2024-09-19T09:19:09.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.625+0000 7f3de61c4640 1 --2- 172.21.15.18:0/4126002408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de00b5b00 0x7f3de0169980 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.625+0000 7f3de61c4640 1 -- 172.21.15.18:0/4126002408 >> 172.21.15.18:0/4126002408 conn(0x7f3de00d4bd0 msgr2=0x7f3de00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:09.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.625+0000 7f3de61c4640 1 -- 172.21.15.18:0/4126002408 shutdown_connections 2024-09-19T09:19:09.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.625+0000 7f3de61c4640 1 -- 172.21.15.18:0/4126002408 wait complete. 2024-09-19T09:19:09.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.626+0000 7f3de61c4640 1 Processor -- start 2024-09-19T09:19:09.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.626+0000 7f3de61c4640 1 -- start start 2024-09-19T09:19:09.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.627+0000 7f3de61c4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3de00b5b00 0x7f3de01f8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.627+0000 7f3de61c4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de00d1c70 0x7f3de00b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.627+0000 7f3de61c4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3de015ed50 0x7f3de0153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.627+0000 7f3de61c4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3de015f130 con 0x7f3de00d1c70 2024-09-19T09:19:09.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.627+0000 7f3de61c4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3de00d3d30 con 0x7f3de015ed50 2024-09-19T09:19:09.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.627+0000 7f3de61c4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3de00cdc30 con 0x7f3de00b5b00 2024-09-19T09:19:09.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.627+0000 7f3ddeffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de00d1c70 0x7f3de00b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.627+0000 7f3ddeffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de00d1c70 0x7f3de00b2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33796/0 (socket says 172.21.15.18:33796) 2024-09-19T09:19:09.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.627+0000 7f3ddeffd640 1 -- 172.21.15.18:0/2782813327 learned_addr learned my addr 172.21.15.18:0/2782813327 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:09.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.627+0000 7f3ddf7fe640 1 --2- 172.21.15.18:0/2782813327 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3de00b5b00 0x7f3de01f8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.627+0000 7f3ddffff640 1 --2- 172.21.15.18:0/2782813327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3de015ed50 0x7f3de0153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.628+0000 7f3ddeffd640 1 -- 172.21.15.18:0/2782813327 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3de00b5b00 msgr2=0x7f3de01f8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:09.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.628+0000 7f3ddeffd640 1 --2- 172.21.15.18:0/2782813327 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3de00b5b00 0x7f3de01f8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.628+0000 7f3ddeffd640 1 -- 172.21.15.18:0/2782813327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3de015ed50 msgr2=0x7f3de0153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:09.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.628+0000 7f3ddeffd640 1 --2- 172.21.15.18:0/2782813327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3de015ed50 0x7f3de0153d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.628+0000 7f3ddeffd640 1 -- 172.21.15.18:0/2782813327 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3de01f8da0 con 0x7f3de00d1c70 2024-09-19T09:19:09.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.628+0000 7f3ddeffd640 1 --2- 172.21.15.18:0/2782813327 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de00d1c70 0x7f3de00b2bf0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f3dd400c530 tx=0x7f3dd400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:09.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.628+0000 7f3dc7fff640 1 -- 172.21.15.18:0/2782813327 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd4017070 con 0x7f3de00d1c70 2024-09-19T09:19:09.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.628+0000 7f3dc7fff640 1 -- 172.21.15.18:0/2782813327 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dd4005ce0 con 0x7f3de00d1c70 2024-09-19T09:19:09.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.628+0000 7f3de61c4640 1 -- 172.21.15.18:0/2782813327 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3de00cd020 con 0x7f3de00d1c70 2024-09-19T09:19:09.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.628+0000 7f3dc7fff640 1 -- 172.21.15.18:0/2782813327 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd40072b0 con 0x7f3de00d1c70 2024-09-19T09:19:09.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.628+0000 7f3de61c4640 1 -- 172.21.15.18:0/2782813327 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3de00cd5e0 con 0x7f3de00d1c70 2024-09-19T09:19:09.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.629+0000 7f3de61c4640 1 -- 172.21.15.18:0/2782813327 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3de00d21e0 con 0x7f3de00d1c70 2024-09-19T09:19:09.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.630+0000 7f3dc7fff640 1 -- 172.21.15.18:0/2782813327 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3dd401a070 con 0x7f3de00d1c70 2024-09-19T09:19:09.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.630+0000 7f3dc7fff640 1 --2- 172.21.15.18:0/2782813327 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3dcc06c2b0 0x7f3dcc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.630+0000 7f3dc7fff640 1 -- 172.21.15.18:0/2782813327 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5709+0+0 (secure 0 0 0) 0x7f3dd408a710 con 0x7f3de00d1c70 2024-09-19T09:19:09.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.631+0000 7f3ddf7fe640 1 --2- 172.21.15.18:0/2782813327 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3dcc06c2b0 0x7f3dcc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.631+0000 7f3ddf7fe640 1 --2- 172.21.15.18:0/2782813327 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3dcc06c2b0 0x7f3dcc06e770 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00016e0 tx=0x7f3dd0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:09.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.635+0000 7f3dc7fff640 1 -- 172.21.15.18:0/2782813327 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3de01f8da0 con 0x7f3de00d1c70 2024-09-19T09:19:09.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.815+0000 7f3de61c4640 1 -- 172.21.15.18:0/2782813327 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3de006d750 con 0x7f3de00d1c70 2024-09-19T09:19:09.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.816+0000 7f3dc7fff640 1 -- 172.21.15.18:0/2782813327 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) ==== 74+0+16705 (secure 0 0 0) 0x7f3dd4058980 con 0x7f3de00d1c70 2024-09-19T09:19:09.816 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:09.817 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":122,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:19:08.539701+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:19:06.215588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-19T09:19:07.536940+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:19:09.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.818+0000 7f3de61c4640 1 -- 172.21.15.18:0/2782813327 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3dcc06c2b0 msgr2=0x7f3dcc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:09.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.818+0000 7f3de61c4640 1 --2- 172.21.15.18:0/2782813327 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3dcc06c2b0 0x7f3dcc06e770 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3dd00016e0 tx=0x7f3dd0009040 comp rx=0 tx=0).stop 2024-09-19T09:19:09.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.818+0000 7f3de61c4640 1 -- 172.21.15.18:0/2782813327 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de00d1c70 msgr2=0x7f3de00b2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:09.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.818+0000 7f3de61c4640 1 --2- 172.21.15.18:0/2782813327 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de00d1c70 0x7f3de00b2bf0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f3dd400c530 tx=0x7f3dd400c9f0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.818+0000 7f3de61c4640 1 -- 172.21.15.18:0/2782813327 shutdown_connections 2024-09-19T09:19:09.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.818+0000 7f3de61c4640 1 --2- 172.21.15.18:0/2782813327 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3dcc06c2b0 0x7f3dcc06e770 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.818+0000 7f3de61c4640 1 --2- 172.21.15.18:0/2782813327 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3de015ed50 0x7f3de0153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.818+0000 7f3de61c4640 1 --2- 172.21.15.18:0/2782813327 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3de00d1c70 0x7f3de00b2bf0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.818+0000 7f3de61c4640 1 --2- 172.21.15.18:0/2782813327 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3de00b5b00 0x7f3de01f8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.818+0000 7f3de61c4640 1 -- 172.21.15.18:0/2782813327 >> 172.21.15.18:0/2782813327 conn(0x7f3de00d4bd0 msgr2=0x7f3de00b6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:09.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.818+0000 7f3de61c4640 1 -- 172.21.15.18:0/2782813327 shutdown_connections 2024-09-19T09:19:09.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.818+0000 7f3de61c4640 1 -- 172.21.15.18:0/2782813327 wait complete. 2024-09-19T09:19:09.830 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-19T09:19:09.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.934+0000 7f021858d640 1 Processor -- start 2024-09-19T09:19:09.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.934+0000 7f021858d640 1 -- start start 2024-09-19T09:19:09.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.935+0000 7f021858d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f021015aff0 0x7f02100af9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.935+0000 7f021858d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02100ce830 0x7f021006e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.935+0000 7f021858d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02100b02c0 con 0x7f02100ce3d0 2024-09-19T09:19:09.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.935+0000 7f021858d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f021015b3d0 con 0x7f021015aff0 2024-09-19T09:19:09.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.935+0000 7f021858d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0210071cf0 con 0x7f02100ce830 2024-09-19T09:19:09.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.935+0000 7f0216329640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f021015aff0 0x7f02100af9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.935+0000 7f0216b2a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02100ce830 0x7f021006e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.935+0000 7f0216329640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f021015aff0 0x7f02100af9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:45846/0 (socket says 172.21.15.18:45846) 2024-09-19T09:19:09.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.935+0000 7f0216329640 1 -- 172.21.15.18:0/4291972520 learned_addr learned my addr 172.21.15.18:0/4291972520 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:09.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.936+0000 7f0216329640 1 -- 172.21.15.18:0/4291972520 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02100ce830 msgr2=0x7f021006e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:09.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.936+0000 7f0216329640 1 --2- 172.21.15.18:0/4291972520 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02100ce830 0x7f021006e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.936+0000 7f0216329640 1 -- 172.21.15.18:0/4291972520 >> v1:172.21.15.162:6789/0 conn(0x7f02100ce3d0 legacy=0x7f0210072180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:09.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.936+0000 7f0216329640 1 -- 172.21.15.18:0/4291972520 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02100affe0 con 0x7f021015aff0 2024-09-19T09:19:09.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.936+0000 7f0216b2a640 1 --2- 172.21.15.18:0/4291972520 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02100ce830 0x7f021006e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:09.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.936+0000 7f0216329640 1 --2- 172.21.15.18:0/4291972520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f021015aff0 0x7f02100af9b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0210071e70 tx=0x7f020c02c650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f389b5b9ddd6eaf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:09.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.937+0000 7f0215327640 1 -- 172.21.15.18:0/4291972520 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f020c03a070 con 0x7f021015aff0 2024-09-19T09:19:09.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.937+0000 7f0215327640 1 -- 172.21.15.18:0/4291972520 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f020c032480 con 0x7f021015aff0 2024-09-19T09:19:09.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.937+0000 7f0215327640 1 -- 172.21.15.18:0/4291972520 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f020c032850 con 0x7f021015aff0 2024-09-19T09:19:09.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.937+0000 7f021858d640 1 -- 172.21.15.18:0/4291972520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f021015aff0 msgr2=0x7f02100af9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:09.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.937+0000 7f021858d640 1 --2- 172.21.15.18:0/4291972520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f021015aff0 0x7f02100af9b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0210071e70 tx=0x7f020c02c650 comp rx=0 tx=0).stop 2024-09-19T09:19:09.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.937+0000 7f021858d640 1 -- 172.21.15.18:0/4291972520 shutdown_connections 2024-09-19T09:19:09.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.937+0000 7f021858d640 1 --2- 172.21.15.18:0/4291972520 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02100ce830 0x7f021006e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.937+0000 7f021858d640 1 --2- 172.21.15.18:0/4291972520 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f021015aff0 0x7f02100af9b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.937+0000 7f021858d640 1 -- 172.21.15.18:0/4291972520 >> 172.21.15.18:0/4291972520 conn(0x7f021006bc10 msgr2=0x7f021006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:09.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.937+0000 7f021858d640 1 -- 172.21.15.18:0/4291972520 shutdown_connections 2024-09-19T09:19:09.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.937+0000 7f021858d640 1 -- 172.21.15.18:0/4291972520 wait complete. 2024-09-19T09:19:09.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.938+0000 7f021858d640 1 Processor -- start 2024-09-19T09:19:09.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.938+0000 7f021858d640 1 -- start start 2024-09-19T09:19:09.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.939+0000 7f021858d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02100ce3d0 0x7f02101ede70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.939+0000 7f021858d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02100ce830 0x7f021015c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.939+0000 7f021858d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f021015aff0 0x7f0210159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.939+0000 7f021858d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f02100d12c0 con 0x7f021015aff0 2024-09-19T09:19:09.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.939+0000 7f021858d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0210071980 con 0x7f02100ce830 2024-09-19T09:19:09.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.939+0000 7f021858d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0210072890 con 0x7f02100ce3d0 2024-09-19T09:19:09.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.939+0000 7f0216b2a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f021015aff0 0x7f0210159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.939+0000 7f0216b2a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f021015aff0 0x7f0210159f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33802/0 (socket says 172.21.15.18:33802) 2024-09-19T09:19:09.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.939+0000 7f0216b2a640 1 -- 172.21.15.18:0/3253803120 learned_addr learned my addr 172.21.15.18:0/3253803120 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:09.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.939+0000 7f0216329640 1 --2- 172.21.15.18:0/3253803120 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02100ce3d0 0x7f02101ede70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.939+0000 7f0215b28640 1 --2- 172.21.15.18:0/3253803120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02100ce830 0x7f021015c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.940+0000 7f0216b2a640 1 -- 172.21.15.18:0/3253803120 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02100ce3d0 msgr2=0x7f02101ede70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:09.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.940+0000 7f0216b2a640 1 --2- 172.21.15.18:0/3253803120 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02100ce3d0 0x7f02101ede70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.940+0000 7f0216b2a640 1 -- 172.21.15.18:0/3253803120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02100ce830 msgr2=0x7f021015c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:09.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.940+0000 7f0216b2a640 1 --2- 172.21.15.18:0/3253803120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02100ce830 0x7f021015c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:09.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.940+0000 7f0216b2a640 1 -- 172.21.15.18:0/3253803120 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0210158ef0 con 0x7f021015aff0 2024-09-19T09:19:09.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.940+0000 7f0215b28640 1 --2- 172.21.15.18:0/3253803120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02100ce830 0x7f021015c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:09.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.940+0000 7f0216b2a640 1 --2- 172.21.15.18:0/3253803120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f021015aff0 0x7f0210159f30 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f020800efc0 tx=0x7f0208009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:09.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.940+0000 7f0206ffd640 1 -- 172.21.15.18:0/3253803120 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0208018030 con 0x7f021015aff0 2024-09-19T09:19:09.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.940+0000 7f0206ffd640 1 -- 172.21.15.18:0/3253803120 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f020800cde0 con 0x7f021015aff0 2024-09-19T09:19:09.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.940+0000 7f0206ffd640 1 -- 172.21.15.18:0/3253803120 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0208003bb0 con 0x7f021015aff0 2024-09-19T09:19:09.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.940+0000 7f021858d640 1 -- 172.21.15.18:0/3253803120 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0210159170 con 0x7f021015aff0 2024-09-19T09:19:09.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.940+0000 7f021858d640 1 -- 172.21.15.18:0/3253803120 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0210159730 con 0x7f021015aff0 2024-09-19T09:19:09.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.941+0000 7f021858d640 1 -- 172.21.15.18:0/3253803120 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f021006ff10 con 0x7f021015aff0 2024-09-19T09:19:09.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.941+0000 7f0206ffd640 1 -- 172.21.15.18:0/3253803120 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0208005d10 con 0x7f021015aff0 2024-09-19T09:19:09.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.942+0000 7f0206ffd640 1 --2- 172.21.15.18:0/3253803120 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f01f406c2e0 0x7f01f406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:09.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.942+0000 7f0206ffd640 1 -- 172.21.15.18:0/3253803120 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 5709+0+0 (secure 0 0 0) 0x7f020808bd60 con 0x7f021015aff0 2024-09-19T09:19:09.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.942+0000 7f0216329640 1 --2- 172.21.15.18:0/3253803120 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f01f406c2e0 0x7f01f406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:09.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.943+0000 7f0216329640 1 --2- 172.21.15.18:0/3253803120 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f01f406c2e0 0x7f01f406e7a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f020c037000 tx=0x7f020c030000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:09.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:09.946+0000 7f0206ffd640 1 -- 172.21.15.18:0/3253803120 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f021006ff10 con 0x7f021015aff0 2024-09-19T09:19:10.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.161+0000 7f021858d640 1 -- 172.21.15.18:0/3253803120 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f0210140ab0 con 0x7f021015aff0 2024-09-19T09:19:10.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.196+0000 7f0206ffd640 1 -- 172.21.15.18:0/3253803120 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v47) ==== 118+0+0 (secure 0 0 0) 0x7f0210140ab0 con 0x7f021015aff0 2024-09-19T09:19:10.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.199+0000 7f021858d640 1 -- 172.21.15.18:0/3253803120 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f01f406c2e0 msgr2=0x7f01f406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:10.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.199+0000 7f021858d640 1 --2- 172.21.15.18:0/3253803120 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f01f406c2e0 0x7f01f406e7a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f020c037000 tx=0x7f020c030000 comp rx=0 tx=0).stop 2024-09-19T09:19:10.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.199+0000 7f021858d640 1 -- 172.21.15.18:0/3253803120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f021015aff0 msgr2=0x7f0210159f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:10.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.199+0000 7f021858d640 1 --2- 172.21.15.18:0/3253803120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f021015aff0 0x7f0210159f30 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f020800efc0 tx=0x7f0208009f90 comp rx=0 tx=0).stop 2024-09-19T09:19:10.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.199+0000 7f021858d640 1 -- 172.21.15.18:0/3253803120 shutdown_connections 2024-09-19T09:19:10.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.199+0000 7f021858d640 1 --2- 172.21.15.18:0/3253803120 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f01f406c2e0 0x7f01f406e7a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:10.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.199+0000 7f021858d640 1 --2- 172.21.15.18:0/3253803120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f021015aff0 0x7f0210159f30 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:10.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.199+0000 7f021858d640 1 --2- 172.21.15.18:0/3253803120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02100ce830 0x7f021015c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:10.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.199+0000 7f021858d640 1 --2- 172.21.15.18:0/3253803120 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02100ce3d0 0x7f02101ede70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:10.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.199+0000 7f021858d640 1 -- 172.21.15.18:0/3253803120 >> 172.21.15.18:0/3253803120 conn(0x7f021006bc10 msgr2=0x7f02100b10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:10.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.199+0000 7f021858d640 1 -- 172.21.15.18:0/3253803120 shutdown_connections 2024-09-19T09:19:10.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.199+0000 7f021858d640 1 -- 172.21.15.18:0/3253803120 wait complete. 2024-09-19T09:19:10.210 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-19T09:19:10.211 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-19T09:19:10.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.316+0000 7fb7d178d640 1 Processor -- start 2024-09-19T09:19:10.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.316+0000 7fb7d178d640 1 -- start start 2024-09-19T09:19:10.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.316+0000 7fb7d178d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb7cc06deb0 0x7fb7cc0b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:10.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.317+0000 7fb7d178d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb7cc15f1a0 0x7fb7cc160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:10.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.317+0000 7fb7d178d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7cc0b6a60 con 0x7fb7cc15c670 2024-09-19T09:19:10.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.317+0000 7fb7d178d640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fb7cc0b6d40 con 0x7fb7cc06deb0 2024-09-19T09:19:10.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.317+0000 7fb7d178d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb7cc0b7020 con 0x7fb7cc15f1a0 2024-09-19T09:19:10.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.317+0000 7fb7ca7fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb7cc06deb0 0x7fb7cc0b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:10.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.317+0000 7fb7ca7fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb7cc06deb0 0x7fb7cc0b6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33808/0 (socket says 172.21.15.18:33808) 2024-09-19T09:19:10.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.317+0000 7fb7ca7fc640 1 -- 172.21.15.18:0/3996144676 learned_addr learned my addr 172.21.15.18:0/3996144676 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:10.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.317+0000 7fb7cb7fe640 1 --2- 172.21.15.18:0/3996144676 >> v2:172.21.15.162:3300/0 conn(0x7fb7cc15f1a0 0x7fb7cc160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:10.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.317+0000 7fb7ca7fc640 1 -- 172.21.15.18:0/3996144676 >> v2:172.21.15.162:3300/0 conn(0x7fb7cc15f1a0 msgr2=0x7fb7cc160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:10.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.317+0000 7fb7ca7fc640 1 --2- 172.21.15.18:0/3996144676 >> v2:172.21.15.162:3300/0 conn(0x7fb7cc15f1a0 0x7fb7cc160300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:10.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.317+0000 7fb7ca7fc640 1 -- 172.21.15.18:0/3996144676 >> v1:172.21.15.162:6789/0 conn(0x7fb7cc15c670 legacy=0x7fb7cc06d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:10.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.317+0000 7fb7ca7fc640 1 -- 172.21.15.18:0/3996144676 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7cc0b7300 con 0x7fb7cc06deb0 2024-09-19T09:19:10.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.317+0000 7fb7cb7fe640 1 --2- 172.21.15.18:0/3996144676 >> v2:172.21.15.162:3300/0 conn(0x7fb7cc15f1a0 0x7fb7cc160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:10.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.318+0000 7fb7ca7fc640 1 --2- 172.21.15.18:0/3996144676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7cc06deb0 0x7fb7cc0b6410 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0009870 tx=0x7fb7c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5de4d9733f969fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:10.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.318+0000 7fb7c9ffb640 1 -- 172.21.15.18:0/3996144676 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c0037070 con 0x7fb7cc06deb0 2024-09-19T09:19:10.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.318+0000 7fb7c9ffb640 1 -- 172.21.15.18:0/3996144676 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7c0032440 con 0x7fb7cc06deb0 2024-09-19T09:19:10.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.318+0000 7fb7c9ffb640 1 -- 172.21.15.18:0/3996144676 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c0032810 con 0x7fb7cc06deb0 2024-09-19T09:19:10.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.318+0000 7fb7d178d640 1 -- 172.21.15.18:0/3996144676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7cc06deb0 msgr2=0x7fb7cc0b6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:10.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.318+0000 7fb7d178d640 1 --2- 172.21.15.18:0/3996144676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7cc06deb0 0x7fb7cc0b6410 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0009870 tx=0x7fb7c002a270 comp rx=0 tx=0).stop 2024-09-19T09:19:10.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.318+0000 7fb7d178d640 1 -- 172.21.15.18:0/3996144676 shutdown_connections 2024-09-19T09:19:10.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.318+0000 7fb7d178d640 1 --2- 172.21.15.18:0/3996144676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7cc06deb0 0x7fb7cc0b6410 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:10.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.318+0000 7fb7d178d640 1 --2- 172.21.15.18:0/3996144676 >> v2:172.21.15.162:3300/0 conn(0x7fb7cc15f1a0 0x7fb7cc160300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:10.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.318+0000 7fb7d178d640 1 -- 172.21.15.18:0/3996144676 >> 172.21.15.18:0/3996144676 conn(0x7fb7cc09b9d0 msgr2=0x7fb7cc09bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:10.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.319+0000 7fb7d178d640 1 -- 172.21.15.18:0/3996144676 shutdown_connections 2024-09-19T09:19:10.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.319+0000 7fb7d178d640 1 -- 172.21.15.18:0/3996144676 wait complete. 2024-09-19T09:19:10.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.320+0000 7fb7d178d640 1 Processor -- start 2024-09-19T09:19:10.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.320+0000 7fb7d178d640 1 -- start start 2024-09-19T09:19:10.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.320+0000 7fb7d178d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7cc06deb0 0x7fb7cc152710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:10.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.320+0000 7fb7d178d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7cc15c670 0x7fb7cc0ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:10.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.321+0000 7fb7d178d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb7cc15f1a0 0x7fb7cc1605d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:10.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.321+0000 7fb7d178d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb7cc0b7b00 con 0x7fb7cc15c670 2024-09-19T09:19:10.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.321+0000 7fb7d178d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb7cc09c560 con 0x7fb7cc06deb0 2024-09-19T09:19:10.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.321+0000 7fb7d178d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb7cc0cdc40 con 0x7fb7cc15f1a0 2024-09-19T09:19:10.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.321+0000 7fb7ca7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7cc15c670 0x7fb7cc0ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:10.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.321+0000 7fb7ca7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7cc15c670 0x7fb7cc0ccd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33820/0 (socket says 172.21.15.18:33820) 2024-09-19T09:19:10.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.321+0000 7fb7ca7fc640 1 -- 172.21.15.18:0/863511952 learned_addr learned my addr 172.21.15.18:0/863511952 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:10.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.321+0000 7fb7caffd640 1 --2- 172.21.15.18:0/863511952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7cc06deb0 0x7fb7cc152710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:10.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.321+0000 7fb7cb7fe640 1 --2- 172.21.15.18:0/863511952 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb7cc15f1a0 0x7fb7cc1605d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:10.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.321+0000 7fb7ca7fc640 1 -- 172.21.15.18:0/863511952 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb7cc15f1a0 msgr2=0x7fb7cc1605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:10.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.321+0000 7fb7ca7fc640 1 --2- 172.21.15.18:0/863511952 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb7cc15f1a0 0x7fb7cc1605d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:10.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.321+0000 7fb7ca7fc640 1 -- 172.21.15.18:0/863511952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7cc06deb0 msgr2=0x7fb7cc152710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:10.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.321+0000 7fb7ca7fc640 1 --2- 172.21.15.18:0/863511952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7cc06deb0 0x7fb7cc152710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:10.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.321+0000 7fb7ca7fc640 1 -- 172.21.15.18:0/863511952 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7cc0cdf20 con 0x7fb7cc15c670 2024-09-19T09:19:10.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.321+0000 7fb7cb7fe640 1 --2- 172.21.15.18:0/863511952 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb7cc15f1a0 0x7fb7cc1605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:10.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.321+0000 7fb7caffd640 1 --2- 172.21.15.18:0/863511952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7cc06deb0 0x7fb7cc152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:10.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.321+0000 7fb7ca7fc640 1 --2- 172.21.15.18:0/863511952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7cc15c670 0x7fb7cc0ccd10 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0009870 tx=0x7fb7c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:10.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.321+0000 7fb7b37fe640 1 -- 172.21.15.18:0/863511952 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c0037040 con 0x7fb7cc15c670 2024-09-19T09:19:10.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.321+0000 7fb7b37fe640 1 -- 172.21.15.18:0/863511952 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7c0004230 con 0x7fb7cc15c670 2024-09-19T09:19:10.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.321+0000 7fb7d178d640 1 -- 172.21.15.18:0/863511952 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7cc0ce200 con 0x7fb7cc15c670 2024-09-19T09:19:10.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.321+0000 7fb7b37fe640 1 -- 172.21.15.18:0/863511952 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c0030620 con 0x7fb7cc15c670 2024-09-19T09:19:10.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.321+0000 7fb7d178d640 1 -- 172.21.15.18:0/863511952 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7cc0cd250 con 0x7fb7cc15c670 2024-09-19T09:19:10.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.322+0000 7fb7d178d640 1 -- 172.21.15.18:0/863511952 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7cc0ce5f0 con 0x7fb7cc15c670 2024-09-19T09:19:10.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.323+0000 7fb7b37fe640 1 -- 172.21.15.18:0/863511952 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb7c00307c0 con 0x7fb7cc15c670 2024-09-19T09:19:10.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.323+0000 7fb7b37fe640 1 --2- 172.21.15.18:0/863511952 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb7b806c2b0 0x7fb7b806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:10.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.324+0000 7fb7b37fe640 1 -- 172.21.15.18:0/863511952 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7fb7c00ac280 con 0x7fb7cc15c670 2024-09-19T09:19:10.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.324+0000 7fb7caffd640 1 --2- 172.21.15.18:0/863511952 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb7b806c2b0 0x7fb7b806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:10.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.324+0000 7fb7caffd640 1 --2- 172.21.15.18:0/863511952 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb7b806c2b0 0x7fb7b806e770 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc0cf020 tx=0x7fb7bc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:10.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.328+0000 7fb7b37fe640 1 -- 172.21.15.18:0/863511952 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb7c007aa80 con 0x7fb7cc15c670 2024-09-19T09:19:10.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:10.540+0000 7fb7d178d640 1 -- 172.21.15.18:0/863511952 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb7cc15dbd0 con 0x7fb7cc15c670 2024-09-19T09:19:11.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.197+0000 7fb7b37fe640 1 -- 172.21.15.18:0/863511952 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v48) ==== 122+0+0 (secure 0 0 0) 0x7fb7c007a380 con 0x7fb7cc15c670 2024-09-19T09:19:11.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.200+0000 7fb7d178d640 1 -- 172.21.15.18:0/863511952 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb7b806c2b0 msgr2=0x7fb7b806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:11.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.200+0000 7fb7d178d640 1 --2- 172.21.15.18:0/863511952 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb7b806c2b0 0x7fb7b806e770 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc0cf020 tx=0x7fb7bc009040 comp rx=0 tx=0).stop 2024-09-19T09:19:11.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.200+0000 7fb7d178d640 1 -- 172.21.15.18:0/863511952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7cc15c670 msgr2=0x7fb7cc0ccd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:11.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.200+0000 7fb7d178d640 1 --2- 172.21.15.18:0/863511952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7cc15c670 0x7fb7cc0ccd10 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0009870 tx=0x7fb7c00046c0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.200+0000 7fb7d178d640 1 -- 172.21.15.18:0/863511952 shutdown_connections 2024-09-19T09:19:11.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.200+0000 7fb7d178d640 1 --2- 172.21.15.18:0/863511952 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb7b806c2b0 0x7fb7b806e770 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.200+0000 7fb7d178d640 1 --2- 172.21.15.18:0/863511952 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb7cc15f1a0 0x7fb7cc1605d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.200+0000 7fb7d178d640 1 --2- 172.21.15.18:0/863511952 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb7cc15c670 0x7fb7cc0ccd10 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.200+0000 7fb7d178d640 1 --2- 172.21.15.18:0/863511952 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb7cc06deb0 0x7fb7cc152710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.201+0000 7fb7d178d640 1 -- 172.21.15.18:0/863511952 >> 172.21.15.18:0/863511952 conn(0x7fb7cc09b9d0 msgr2=0x7fb7cc15ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:11.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.201+0000 7fb7d178d640 1 -- 172.21.15.18:0/863511952 shutdown_connections 2024-09-19T09:19:11.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.201+0000 7fb7d178d640 1 -- 172.21.15.18:0/863511952 wait complete. 2024-09-19T09:19:11.215 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-19T09:19:11.216 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:19:11.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.322+0000 7f39b2dfd640 1 Processor -- start 2024-09-19T09:19:11.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.322+0000 7f39b2dfd640 1 -- start start 2024-09-19T09:19:11.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.323+0000 7f39b2dfd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f39ac15eb00 0x7f39ac1630d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.323+0000 7f39b2dfd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39ac06d810 0x7f39ac0b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.323+0000 7f39b2dfd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f39ac06ffd0 0x7f39ac0b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.323+0000 7f39b2dfd640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f39ac06e730 con 0x7f39ac06ffd0 2024-09-19T09:19:11.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.323+0000 7f39b2dfd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f39ac06ea10 con 0x7f39ac15eb00 2024-09-19T09:19:11.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.323+0000 7f39b2dfd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f39ac1628d0 con 0x7f39ac06d810 2024-09-19T09:19:11.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.323+0000 7f39b139a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f39ac06ffd0 0x7f39ac0b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.323+0000 7f39b139a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f39ac06ffd0 0x7f39ac0b0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33822/0 (socket says 172.21.15.18:33822) 2024-09-19T09:19:11.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.323+0000 7f39b139a640 1 -- 172.21.15.18:0/1967150819 learned_addr learned my addr 172.21.15.18:0/1967150819 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:11.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.323+0000 7f39b0b99640 1 --2- 172.21.15.18:0/1967150819 >> v2:172.21.15.162:3300/0 conn(0x7f39ac15eb00 0x7f39ac1630d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.323+0000 7f39a3fff640 1 --2- 172.21.15.18:0/1967150819 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39ac06d810 0x7f39ac0b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.323+0000 7f39b139a640 1 -- 172.21.15.18:0/1967150819 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39ac06d810 msgr2=0x7f39ac0b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:11.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.323+0000 7f39b139a640 1 --2- 172.21.15.18:0/1967150819 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39ac06d810 0x7f39ac0b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.323+0000 7f39b139a640 1 -- 172.21.15.18:0/1967150819 >> v2:172.21.15.162:3300/0 conn(0x7f39ac15eb00 msgr2=0x7f39ac1630d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:11.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.323+0000 7f39b139a640 1 --2- 172.21.15.18:0/1967150819 >> v2:172.21.15.162:3300/0 conn(0x7f39ac15eb00 0x7f39ac1630d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.323+0000 7f39b139a640 1 -- 172.21.15.18:0/1967150819 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39ac162bb0 con 0x7f39ac06ffd0 2024-09-19T09:19:11.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.323+0000 7f39a3fff640 1 --2- 172.21.15.18:0/1967150819 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39ac06d810 0x7f39ac0b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:11.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.324+0000 7f39b139a640 1 --2- 172.21.15.18:0/1967150819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39ac06ffd0 0x7f39ac0b0fb0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f39ac06deb0 tx=0x7f39a402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=873dc663346257e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:11.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.324+0000 7f39a37fe640 1 -- 172.21.15.18:0/1967150819 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a4036070 con 0x7f39ac06ffd0 2024-09-19T09:19:11.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.324+0000 7f39a37fe640 1 -- 172.21.15.18:0/1967150819 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39a4031600 con 0x7f39ac06ffd0 2024-09-19T09:19:11.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.324+0000 7f39a37fe640 1 -- 172.21.15.18:0/1967150819 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a40319d0 con 0x7f39ac06ffd0 2024-09-19T09:19:11.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.325+0000 7f39b2dfd640 1 -- 172.21.15.18:0/1967150819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39ac06ffd0 msgr2=0x7f39ac0b0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:11.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.325+0000 7f39b2dfd640 1 --2- 172.21.15.18:0/1967150819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39ac06ffd0 0x7f39ac0b0fb0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f39ac06deb0 tx=0x7f39a402a610 comp rx=0 tx=0).stop 2024-09-19T09:19:11.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.325+0000 7f39b2dfd640 1 -- 172.21.15.18:0/1967150819 shutdown_connections 2024-09-19T09:19:11.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.325+0000 7f39b2dfd640 1 --2- 172.21.15.18:0/1967150819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39ac06ffd0 0x7f39ac0b0fb0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.325+0000 7f39b2dfd640 1 --2- 172.21.15.18:0/1967150819 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39ac06d810 0x7f39ac0b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.325+0000 7f39b2dfd640 1 --2- 172.21.15.18:0/1967150819 >> v2:172.21.15.162:3300/0 conn(0x7f39ac15eb00 0x7f39ac1630d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.325+0000 7f39b2dfd640 1 -- 172.21.15.18:0/1967150819 >> 172.21.15.18:0/1967150819 conn(0x7f39ac06cd20 msgr2=0x7f39ac06d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:11.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.325+0000 7f39b2dfd640 1 -- 172.21.15.18:0/1967150819 shutdown_connections 2024-09-19T09:19:11.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.325+0000 7f39b2dfd640 1 -- 172.21.15.18:0/1967150819 wait complete. 2024-09-19T09:19:11.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.326+0000 7f39b2dfd640 1 Processor -- start 2024-09-19T09:19:11.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.326+0000 7f39b2dfd640 1 -- start start 2024-09-19T09:19:11.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.327+0000 7f39b2dfd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39ac06d810 0x7f39ac148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.327+0000 7f39b2dfd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39ac06ffd0 0x7f39ac1f49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.327+0000 7f39b2dfd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39ac15eb00 0x7f39ac15fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.327+0000 7f39b2dfd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f39ac0d15e0 con 0x7f39ac06ffd0 2024-09-19T09:19:11.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.327+0000 7f39b2dfd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f39ac0d1460 con 0x7f39ac15eb00 2024-09-19T09:19:11.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.327+0000 7f39b2dfd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f39ac0d1760 con 0x7f39ac06d810 2024-09-19T09:19:11.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.327+0000 7f39a3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39ac06ffd0 0x7f39ac1f49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.327+0000 7f39a3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39ac06ffd0 0x7f39ac1f49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33824/0 (socket says 172.21.15.18:33824) 2024-09-19T09:19:11.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.327+0000 7f39a3fff640 1 -- 172.21.15.18:0/4000947930 learned_addr learned my addr 172.21.15.18:0/4000947930 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:11.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.327+0000 7f39b139a640 1 --2- 172.21.15.18:0/4000947930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39ac15eb00 0x7f39ac15fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.327+0000 7f39b0b99640 1 --2- 172.21.15.18:0/4000947930 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39ac06d810 0x7f39ac148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.327+0000 7f39a3fff640 1 -- 172.21.15.18:0/4000947930 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39ac06d810 msgr2=0x7f39ac148da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:11.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.327+0000 7f39a3fff640 1 --2- 172.21.15.18:0/4000947930 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39ac06d810 0x7f39ac148da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.327+0000 7f39a3fff640 1 -- 172.21.15.18:0/4000947930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39ac15eb00 msgr2=0x7f39ac15fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:11.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.327+0000 7f39a3fff640 1 --2- 172.21.15.18:0/4000947930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39ac15eb00 0x7f39ac15fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.327+0000 7f39a3fff640 1 -- 172.21.15.18:0/4000947930 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39ac160540 con 0x7f39ac06ffd0 2024-09-19T09:19:11.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.327+0000 7f39b0b99640 1 --2- 172.21.15.18:0/4000947930 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39ac06d810 0x7f39ac148da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:11.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.328+0000 7f39a3fff640 1 --2- 172.21.15.18:0/4000947930 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39ac06ffd0 0x7f39ac1f49b0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f399c00c7c0 tx=0x7f399c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:11.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.328+0000 7f39a17fa640 1 -- 172.21.15.18:0/4000947930 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399c015070 con 0x7f39ac06ffd0 2024-09-19T09:19:11.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.328+0000 7f39a17fa640 1 -- 172.21.15.18:0/4000947930 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f399c007820 con 0x7f39ac06ffd0 2024-09-19T09:19:11.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.328+0000 7f39a17fa640 1 -- 172.21.15.18:0/4000947930 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399c007bf0 con 0x7f39ac06ffd0 2024-09-19T09:19:11.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.328+0000 7f39b2dfd640 1 -- 172.21.15.18:0/4000947930 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39ac0af3f0 con 0x7f39ac06ffd0 2024-09-19T09:19:11.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.328+0000 7f39b2dfd640 1 -- 172.21.15.18:0/4000947930 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39ac0af9b0 con 0x7f39ac06ffd0 2024-09-19T09:19:11.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.329+0000 7f39b2dfd640 1 -- 172.21.15.18:0/4000947930 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39ac076190 con 0x7f39ac06ffd0 2024-09-19T09:19:11.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.329+0000 7f39a17fa640 1 -- 172.21.15.18:0/4000947930 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f399c018070 con 0x7f39ac06ffd0 2024-09-19T09:19:11.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.330+0000 7f39a17fa640 1 --2- 172.21.15.18:0/4000947930 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f399806c2b0 0x7f399806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.330+0000 7f39a17fa640 1 -- 172.21.15.18:0/4000947930 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f399c08b2b0 con 0x7f39ac06ffd0 2024-09-19T09:19:11.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.330+0000 7f39b0b99640 1 --2- 172.21.15.18:0/4000947930 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f399806c2b0 0x7f399806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.330+0000 7f39b0b99640 1 --2- 172.21.15.18:0/4000947930 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f399806c2b0 0x7f399806e770 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f39a8006fd0 tx=0x7f39a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:11.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.334+0000 7f39a17fa640 1 -- 172.21.15.18:0/4000947930 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f39ac076190 con 0x7f39ac06ffd0 2024-09-19T09:19:11.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.550+0000 7f39b2dfd640 1 -- 172.21.15.18:0/4000947930 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39ac1630d0 con 0x7f39ac06ffd0 2024-09-19T09:19:11.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.550+0000 7f39a17fa640 1 -- 172.21.15.18:0/4000947930 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5225 (secure 0 0 0) 0x7f399c0593d0 con 0x7f39ac06ffd0 2024-09-19T09:19:11.551 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:11.551 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":48,"btime":"2024-09-19T09:19:11:196952+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5642,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/4210829543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":4210829543},{"type":"v1","addr":"172.21.15.162:6837","nonce":4210829543}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3090247017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3090247017},{"type":"v1","addr":"172.21.15.162:6836","nonce":3090247017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6546,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/62488842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":62488842},{"type":"v1","addr":"172.21.15.18:6833","nonce":62488842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:19:08.540022+0000","modified":"2024-09-19T09:19:10.541774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6549},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6549":{"gid":6549,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2870064683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":2870064683},{"type":"v1","addr":"172.21.15.18:6835","nonce":2870064683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6549,"qdb_cluster":[6549]},"id":7}]} 2024-09-19T09:19:11.551 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 48 2024-09-19T09:19:11.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.552+0000 7f39b2dfd640 1 -- 172.21.15.18:0/4000947930 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f399806c2b0 msgr2=0x7f399806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:11.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.552+0000 7f39b2dfd640 1 --2- 172.21.15.18:0/4000947930 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f399806c2b0 0x7f399806e770 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f39a8006fd0 tx=0x7f39a8008040 comp rx=0 tx=0).stop 2024-09-19T09:19:11.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.552+0000 7f39b2dfd640 1 -- 172.21.15.18:0/4000947930 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39ac06ffd0 msgr2=0x7f39ac1f49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:11.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.552+0000 7f39b2dfd640 1 --2- 172.21.15.18:0/4000947930 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39ac06ffd0 0x7f39ac1f49b0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f399c00c7c0 tx=0x7f399c00cc80 comp rx=0 tx=0).stop 2024-09-19T09:19:11.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.553+0000 7f39b2dfd640 1 -- 172.21.15.18:0/4000947930 shutdown_connections 2024-09-19T09:19:11.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.553+0000 7f39b2dfd640 1 --2- 172.21.15.18:0/4000947930 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f399806c2b0 0x7f399806e770 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.553+0000 7f39b2dfd640 1 --2- 172.21.15.18:0/4000947930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f39ac15eb00 0x7f39ac15fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.553+0000 7f39b2dfd640 1 --2- 172.21.15.18:0/4000947930 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f39ac06ffd0 0x7f39ac1f49b0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.553+0000 7f39b2dfd640 1 --2- 172.21.15.18:0/4000947930 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f39ac06d810 0x7f39ac148da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.553+0000 7f39b2dfd640 1 -- 172.21.15.18:0/4000947930 >> 172.21.15.18:0/4000947930 conn(0x7f39ac06cd20 msgr2=0x7f39ac06d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:11.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.553+0000 7f39b2dfd640 1 -- 172.21.15.18:0/4000947930 shutdown_connections 2024-09-19T09:19:11.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.553+0000 7f39b2dfd640 1 -- 172.21.15.18:0/4000947930 wait complete. 2024-09-19T09:19:11.564 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:19:11.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.666+0000 7fe091bd8640 1 Processor -- start 2024-09-19T09:19:11.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.666+0000 7fe091bd8640 1 -- start start 2024-09-19T09:19:11.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.667+0000 7fe091bd8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe08c15ef80 0x7fe08c0b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.667+0000 7fe091bd8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe08c06d730 0x7fe08c0cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.667+0000 7fe091bd8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe08c0cf910 0x7fe08c0d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.667+0000 7fe091bd8640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fe08c0cd7d0 con 0x7fe08c15ef80 2024-09-19T09:19:11.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.667+0000 7fe091bd8640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe08c0cd1a0 con 0x7fe08c06d730 2024-09-19T09:19:11.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.667+0000 7fe091bd8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe08c06dc30 con 0x7fe08c0cf910 2024-09-19T09:19:11.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.667+0000 7fe08b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe08c15ef80 0x7fe08c0b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.667+0000 7fe08b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe08c15ef80 0x7fe08c0b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33840/0 (socket says 172.21.15.18:33840) 2024-09-19T09:19:11.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.667+0000 7fe08b7fe640 1 -- 172.21.15.18:0/4021809126 learned_addr learned my addr 172.21.15.18:0/4021809126 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:11.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.667+0000 7fe08bfff640 1 --2- 172.21.15.18:0/4021809126 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe08c0cf910 0x7fe08c0d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.668+0000 7fe08b7fe640 1 -- 172.21.15.18:0/4021809126 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe08c0cf910 msgr2=0x7fe08c0d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:11.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.668+0000 7fe08b7fe640 1 --2- 172.21.15.18:0/4021809126 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe08c0cf910 0x7fe08c0d0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.668+0000 7fe08b7fe640 1 -- 172.21.15.18:0/4021809126 >> v2:172.21.15.162:3300/0 conn(0x7fe08c06d730 msgr2=0x7fe08c0cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:11.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.668+0000 7fe08b7fe640 1 --2- 172.21.15.18:0/4021809126 >> v2:172.21.15.162:3300/0 conn(0x7fe08c06d730 0x7fe08c0cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.668+0000 7fe08b7fe640 1 -- 172.21.15.18:0/4021809126 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08c06df10 con 0x7fe08c15ef80 2024-09-19T09:19:11.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.668+0000 7fe08b7fe640 1 --2- 172.21.15.18:0/4021809126 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe08c15ef80 0x7fe08c0b5220 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0b57c0 tx=0x7fe07c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=753fe49e1676b02f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:11.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.668+0000 7fe08a7fc640 1 -- 172.21.15.18:0/4021809126 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c037070 con 0x7fe08c15ef80 2024-09-19T09:19:11.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.668+0000 7fe08a7fc640 1 -- 172.21.15.18:0/4021809126 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe07c032440 con 0x7fe08c15ef80 2024-09-19T09:19:11.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.668+0000 7fe08a7fc640 1 -- 172.21.15.18:0/4021809126 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c032810 con 0x7fe08c15ef80 2024-09-19T09:19:11.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.669+0000 7fe091bd8640 1 -- 172.21.15.18:0/4021809126 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe08c15ef80 msgr2=0x7fe08c0b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:11.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.669+0000 7fe091bd8640 1 --2- 172.21.15.18:0/4021809126 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe08c15ef80 0x7fe08c0b5220 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fe08c0b57c0 tx=0x7fe07c02a1e0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.669+0000 7fe091bd8640 1 -- 172.21.15.18:0/4021809126 shutdown_connections 2024-09-19T09:19:11.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.669+0000 7fe091bd8640 1 --2- 172.21.15.18:0/4021809126 >> v2:172.21.15.162:3300/0 conn(0x7fe08c06d730 0x7fe08c0cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.669+0000 7fe091bd8640 1 --2- 172.21.15.18:0/4021809126 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe08c0cf910 0x7fe08c0d0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.669+0000 7fe091bd8640 1 --2- 172.21.15.18:0/4021809126 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe08c15ef80 0x7fe08c0b5220 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.669+0000 7fe091bd8640 1 -- 172.21.15.18:0/4021809126 >> 172.21.15.18:0/4021809126 conn(0x7fe08c0b4700 msgr2=0x7fe08c0b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:11.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.669+0000 7fe091bd8640 1 -- 172.21.15.18:0/4021809126 shutdown_connections 2024-09-19T09:19:11.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.669+0000 7fe091bd8640 1 -- 172.21.15.18:0/4021809126 wait complete. 2024-09-19T09:19:11.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.670+0000 7fe091bd8640 1 Processor -- start 2024-09-19T09:19:11.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.670+0000 7fe091bd8640 1 -- start start 2024-09-19T09:19:11.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.671+0000 7fe091bd8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe08c06d730 0x7fe08c159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.671+0000 7fe091bd8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe08c0cf910 0x7fe08c0c7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.671+0000 7fe091bd8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe08c15ef80 0x7fe08c0b73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.671+0000 7fe091bd8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe08c0d0120 con 0x7fe08c15ef80 2024-09-19T09:19:11.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.671+0000 7fe091bd8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe08c15f360 con 0x7fe08c0cf910 2024-09-19T09:19:11.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.671+0000 7fe091bd8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe08c0d1220 con 0x7fe08c06d730 2024-09-19T09:19:11.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.671+0000 7fe08bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe08c15ef80 0x7fe08c0b73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.671+0000 7fe08bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe08c15ef80 0x7fe08c0b73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33852/0 (socket says 172.21.15.18:33852) 2024-09-19T09:19:11.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.671+0000 7fe08bfff640 1 -- 172.21.15.18:0/266449366 learned_addr learned my addr 172.21.15.18:0/266449366 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:11.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.672+0000 7fe08b7fe640 1 --2- 172.21.15.18:0/266449366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe08c06d730 0x7fe08c159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.672+0000 7fe08bfff640 1 -- 172.21.15.18:0/266449366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe08c06d730 msgr2=0x7fe08c159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:11.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.672+0000 7fe08bfff640 1 --2- 172.21.15.18:0/266449366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe08c06d730 0x7fe08c159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.672+0000 7fe08affd640 1 --2- 172.21.15.18:0/266449366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe08c0cf910 0x7fe08c0c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.672+0000 7fe08bfff640 1 -- 172.21.15.18:0/266449366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe08c0cf910 msgr2=0x7fe08c0c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:11.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.672+0000 7fe08bfff640 1 --2- 172.21.15.18:0/266449366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe08c0cf910 0x7fe08c0c7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.672+0000 7fe08bfff640 1 -- 172.21.15.18:0/266449366 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08c0c7b30 con 0x7fe08c15ef80 2024-09-19T09:19:11.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.672+0000 7fe08b7fe640 1 --2- 172.21.15.18:0/266449366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe08c06d730 0x7fe08c159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:11.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.672+0000 7fe08affd640 1 --2- 172.21.15.18:0/266449366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe08c0cf910 0x7fe08c0c7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:11.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.672+0000 7fe08bfff640 1 --2- 172.21.15.18:0/266449366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe08c15ef80 0x7fe08c0b73e0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fe08400cda0 tx=0x7fe08400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:11.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.672+0000 7fe073fff640 1 -- 172.21.15.18:0/266449366 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe084003b90 con 0x7fe08c15ef80 2024-09-19T09:19:11.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.672+0000 7fe073fff640 1 -- 172.21.15.18:0/266449366 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe084003d30 con 0x7fe08c15ef80 2024-09-19T09:19:11.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.672+0000 7fe091bd8640 1 -- 172.21.15.18:0/266449366 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe08c0c7e10 con 0x7fe08c15ef80 2024-09-19T09:19:11.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.672+0000 7fe073fff640 1 -- 172.21.15.18:0/266449366 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe084004240 con 0x7fe08c15ef80 2024-09-19T09:19:11.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.672+0000 7fe091bd8640 1 -- 172.21.15.18:0/266449366 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe08c1613f0 con 0x7fe08c15ef80 2024-09-19T09:19:11.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.673+0000 7fe091bd8640 1 -- 172.21.15.18:0/266449366 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe08c0c7fe0 con 0x7fe08c15ef80 2024-09-19T09:19:11.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.674+0000 7fe073fff640 1 -- 172.21.15.18:0/266449366 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe0840043e0 con 0x7fe08c15ef80 2024-09-19T09:19:11.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.674+0000 7fe073fff640 1 --2- 172.21.15.18:0/266449366 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe07806c2e0 0x7fe07806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.674+0000 7fe073fff640 1 -- 172.21.15.18:0/266449366 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7fe08408bf30 con 0x7fe08c15ef80 2024-09-19T09:19:11.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.674+0000 7fe08b7fe640 1 --2- 172.21.15.18:0/266449366 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe07806c2e0 0x7fe07806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.675+0000 7fe08b7fe640 1 --2- 172.21.15.18:0/266449366 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe07806c2e0 0x7fe07806e7a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe07c034000 tx=0x7fe07c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:11.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.679+0000 7fe073fff640 1 -- 172.21.15.18:0/266449366 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe08405a6a0 con 0x7fe08c15ef80 2024-09-19T09:19:11.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.854+0000 7fe091bd8640 1 -- 172.21.15.18:0/266449366 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe08c0d0ce0 con 0x7fe08c15ef80 2024-09-19T09:19:11.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.855+0000 7fe073fff640 1 -- 172.21.15.18:0/266449366 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) ==== 74+0+16692 (secure 0 0 0) 0x7fe084059fa0 con 0x7fe08c15ef80 2024-09-19T09:19:11.856 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:11.856 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":123,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:19:10.192537+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:19:06.215588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-19T09:19:07.536940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:19:11.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.857+0000 7fe091bd8640 1 -- 172.21.15.18:0/266449366 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe07806c2e0 msgr2=0x7fe07806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:11.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.857+0000 7fe091bd8640 1 --2- 172.21.15.18:0/266449366 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe07806c2e0 0x7fe07806e7a0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe07c034000 tx=0x7fe07c02e000 comp rx=0 tx=0).stop 2024-09-19T09:19:11.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.857+0000 7fe091bd8640 1 -- 172.21.15.18:0/266449366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe08c15ef80 msgr2=0x7fe08c0b73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:11.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.857+0000 7fe091bd8640 1 --2- 172.21.15.18:0/266449366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe08c15ef80 0x7fe08c0b73e0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fe08400cda0 tx=0x7fe08400a660 comp rx=0 tx=0).stop 2024-09-19T09:19:11.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.857+0000 7fe091bd8640 1 -- 172.21.15.18:0/266449366 shutdown_connections 2024-09-19T09:19:11.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.857+0000 7fe091bd8640 1 --2- 172.21.15.18:0/266449366 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe07806c2e0 0x7fe07806e7a0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.857+0000 7fe091bd8640 1 --2- 172.21.15.18:0/266449366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe08c15ef80 0x7fe08c0b73e0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.857+0000 7fe091bd8640 1 --2- 172.21.15.18:0/266449366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe08c0cf910 0x7fe08c0c7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.857+0000 7fe091bd8640 1 --2- 172.21.15.18:0/266449366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe08c06d730 0x7fe08c159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.857+0000 7fe091bd8640 1 -- 172.21.15.18:0/266449366 >> 172.21.15.18:0/266449366 conn(0x7fe08c0b4700 msgr2=0x7fe08c070a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:11.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.857+0000 7fe091bd8640 1 -- 172.21.15.18:0/266449366 shutdown_connections 2024-09-19T09:19:11.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.857+0000 7fe091bd8640 1 -- 172.21.15.18:0/266449366 wait complete. 2024-09-19T09:19:11.870 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T09:19:11.870 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:19:11.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.972+0000 7fd36d42e640 1 Processor -- start 2024-09-19T09:19:11.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.973+0000 7fd36d42e640 1 -- start start 2024-09-19T09:19:11.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.973+0000 7fd36d42e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd368162850 0x7fd368162c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.973+0000 7fd36d42e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd3680b5160 0x7fd368070620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.973+0000 7fd36d42e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd368163170 con 0x7fd3680d1660 2024-09-19T09:19:11.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.973+0000 7fd36d42e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fd3680d1f00 con 0x7fd3680b5160 2024-09-19T09:19:11.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.973+0000 7fd36d42e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd36806f860 con 0x7fd368162850 2024-09-19T09:19:11.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.973+0000 7fd3667fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd3680b5160 0x7fd368070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.974+0000 7fd3667fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd3680b5160 0x7fd368070620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33862/0 (socket says 172.21.15.18:33862) 2024-09-19T09:19:11.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.974+0000 7fd3667fc640 1 -- 172.21.15.18:0/2679957190 learned_addr learned my addr 172.21.15.18:0/2679957190 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:11.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.974+0000 7fd366ffd640 1 --2- 172.21.15.18:0/2679957190 >> v2:172.21.15.162:3300/0 conn(0x7fd368162850 0x7fd368162c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.974+0000 7fd3667fc640 1 -- 172.21.15.18:0/2679957190 >> v2:172.21.15.162:3300/0 conn(0x7fd368162850 msgr2=0x7fd368162c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:11.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.974+0000 7fd3667fc640 1 --2- 172.21.15.18:0/2679957190 >> v2:172.21.15.162:3300/0 conn(0x7fd368162850 0x7fd368162c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.974+0000 7fd3667fc640 1 -- 172.21.15.18:0/2679957190 >> v1:172.21.15.162:6789/0 conn(0x7fd3680d1660 legacy=0x7fd368160650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:11.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.974+0000 7fd3667fc640 1 -- 172.21.15.18:0/2679957190 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd36806fb40 con 0x7fd3680b5160 2024-09-19T09:19:11.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.974+0000 7fd366ffd640 1 --2- 172.21.15.18:0/2679957190 >> v2:172.21.15.162:3300/0 conn(0x7fd368162850 0x7fd368162c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:11.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.975+0000 7fd3667fc640 1 --2- 172.21.15.18:0/2679957190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3680b5160 0x7fd368070620 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fd3680727c0 tx=0x7fd35002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2326de350d233f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:11.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.975+0000 7fd365ffb640 1 -- 172.21.15.18:0/2679957190 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd350037070 con 0x7fd3680b5160 2024-09-19T09:19:11.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.975+0000 7fd365ffb640 1 -- 172.21.15.18:0/2679957190 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd350032440 con 0x7fd3680b5160 2024-09-19T09:19:11.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.975+0000 7fd365ffb640 1 -- 172.21.15.18:0/2679957190 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd350032810 con 0x7fd3680b5160 2024-09-19T09:19:11.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.975+0000 7fd36d42e640 1 -- 172.21.15.18:0/2679957190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3680b5160 msgr2=0x7fd368070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:11.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.975+0000 7fd36d42e640 1 --2- 172.21.15.18:0/2679957190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3680b5160 0x7fd368070620 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fd3680727c0 tx=0x7fd35002a1a0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.975+0000 7fd36d42e640 1 -- 172.21.15.18:0/2679957190 shutdown_connections 2024-09-19T09:19:11.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.975+0000 7fd36d42e640 1 --2- 172.21.15.18:0/2679957190 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3680b5160 0x7fd368070620 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.975+0000 7fd36d42e640 1 --2- 172.21.15.18:0/2679957190 >> v2:172.21.15.162:3300/0 conn(0x7fd368162850 0x7fd368162c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.975+0000 7fd36d42e640 1 -- 172.21.15.18:0/2679957190 >> 172.21.15.18:0/2679957190 conn(0x7fd3680b4560 msgr2=0x7fd3680b4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:11.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.975+0000 7fd36d42e640 1 -- 172.21.15.18:0/2679957190 shutdown_connections 2024-09-19T09:19:11.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.975+0000 7fd36d42e640 1 -- 172.21.15.18:0/2679957190 wait complete. 2024-09-19T09:19:11.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.977+0000 7fd36d42e640 1 Processor -- start 2024-09-19T09:19:11.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.977+0000 7fd36d42e640 1 -- start start 2024-09-19T09:19:11.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.977+0000 7fd36d42e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3680b5160 0x7fd36815c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.977+0000 7fd36d42e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3680d1660 0x7fd3681f5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.977+0000 7fd36d42e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd368162850 0x7fd3680ce430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.977+0000 7fd36d42e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd368160030 con 0x7fd3680d1660 2024-09-19T09:19:11.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.977+0000 7fd36d42e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd368070b60 con 0x7fd3680b5160 2024-09-19T09:19:11.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.977+0000 7fd36d42e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd3681601b0 con 0x7fd368162850 2024-09-19T09:19:11.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.978+0000 7fd3667fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3680d1660 0x7fd3681f5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.978+0000 7fd3667fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3680d1660 0x7fd3681f5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33868/0 (socket says 172.21.15.18:33868) 2024-09-19T09:19:11.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.978+0000 7fd3667fc640 1 -- 172.21.15.18:0/3141323313 learned_addr learned my addr 172.21.15.18:0/3141323313 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:11.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.978+0000 7fd366ffd640 1 --2- 172.21.15.18:0/3141323313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3680b5160 0x7fd36815c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.978+0000 7fd3677fe640 1 --2- 172.21.15.18:0/3141323313 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd368162850 0x7fd3680ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.978+0000 7fd3667fc640 1 -- 172.21.15.18:0/3141323313 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd368162850 msgr2=0x7fd3680ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:11.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.978+0000 7fd3667fc640 1 --2- 172.21.15.18:0/3141323313 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd368162850 0x7fd3680ce430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.978+0000 7fd3667fc640 1 -- 172.21.15.18:0/3141323313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3680b5160 msgr2=0x7fd36815c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:11.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.978+0000 7fd3667fc640 1 --2- 172.21.15.18:0/3141323313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3680b5160 0x7fd36815c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:11.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.978+0000 7fd3667fc640 1 -- 172.21.15.18:0/3141323313 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3681f6000 con 0x7fd3680d1660 2024-09-19T09:19:11.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.978+0000 7fd3667fc640 1 --2- 172.21.15.18:0/3141323313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3680d1660 0x7fd3681f5ac0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fd35002a1e0 tx=0x7fd3500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:11.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.978+0000 7fd35f7fe640 1 -- 172.21.15.18:0/3141323313 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd350037040 con 0x7fd3680d1660 2024-09-19T09:19:11.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.978+0000 7fd35f7fe640 1 -- 172.21.15.18:0/3141323313 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd350042070 con 0x7fd3680d1660 2024-09-19T09:19:11.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.978+0000 7fd36d42e640 1 -- 172.21.15.18:0/3141323313 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd368160940 con 0x7fd3680d1660 2024-09-19T09:19:11.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.978+0000 7fd35f7fe640 1 -- 172.21.15.18:0/3141323313 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd350030bb0 con 0x7fd3680d1660 2024-09-19T09:19:11.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.978+0000 7fd36d42e640 1 -- 172.21.15.18:0/3141323313 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd368160f00 con 0x7fd3680d1660 2024-09-19T09:19:11.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.979+0000 7fd36d42e640 1 -- 172.21.15.18:0/3141323313 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3680d1a90 con 0x7fd3680d1660 2024-09-19T09:19:11.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.980+0000 7fd35f7fe640 1 -- 172.21.15.18:0/3141323313 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd350047460 con 0x7fd3680d1660 2024-09-19T09:19:11.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.980+0000 7fd35f7fe640 1 --2- 172.21.15.18:0/3141323313 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd34806c2b0 0x7fd34806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:11.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.980+0000 7fd35f7fe640 1 -- 172.21.15.18:0/3141323313 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7fd3500abf60 con 0x7fd3680d1660 2024-09-19T09:19:11.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.981+0000 7fd366ffd640 1 --2- 172.21.15.18:0/3141323313 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd34806c2b0 0x7fd34806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:11.984 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.981+0000 7fd366ffd640 1 --2- 172.21.15.18:0/3141323313 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd34806c2b0 0x7fd34806e770 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd368162820 tx=0x7fd360008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:11.985 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:11.985+0000 7fd35f7fe640 1 -- 172.21.15.18:0/3141323313 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd3681f6000 con 0x7fd3680d1660 2024-09-19T09:19:12.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.157+0000 7fd36d42e640 1 -- 172.21.15.18:0/3141323313 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd368162120 con 0x7fd34806c2b0 2024-09-19T09:19:12.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.164+0000 7fd35f7fe640 1 -- 172.21.15.18:0/3141323313 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247991 (secure 0 0 0) 0x7fd36000f980 con 0x7fd34806c2b0 2024-09-19T09:19:12.168 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:12.171 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:19:12.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.166+0000 7fd36d42e640 1 -- 172.21.15.18:0/3141323313 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd34806c2b0 msgr2=0x7fd34806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:12.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.166+0000 7fd36d42e640 1 --2- 172.21.15.18:0/3141323313 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd34806c2b0 0x7fd34806e770 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd368162820 tx=0x7fd360008040 comp rx=0 tx=0).stop 2024-09-19T09:19:12.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.166+0000 7fd36d42e640 1 -- 172.21.15.18:0/3141323313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3680d1660 msgr2=0x7fd3681f5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:12.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.166+0000 7fd36d42e640 1 --2- 172.21.15.18:0/3141323313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3680d1660 0x7fd3681f5ac0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fd35002a1e0 tx=0x7fd3500046c0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.166+0000 7fd36d42e640 1 -- 172.21.15.18:0/3141323313 shutdown_connections 2024-09-19T09:19:12.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.166+0000 7fd36d42e640 1 --2- 172.21.15.18:0/3141323313 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd34806c2b0 0x7fd34806e770 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.166+0000 7fd36d42e640 1 --2- 172.21.15.18:0/3141323313 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd368162850 0x7fd3680ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.166+0000 7fd36d42e640 1 --2- 172.21.15.18:0/3141323313 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd3680d1660 0x7fd3681f5ac0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.166+0000 7fd36d42e640 1 --2- 172.21.15.18:0/3141323313 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd3680b5160 0x7fd36815c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.166+0000 7fd36d42e640 1 -- 172.21.15.18:0/3141323313 >> 172.21.15.18:0/3141323313 conn(0x7fd3680b4560 msgr2=0x7fd36815c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:12.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.166+0000 7fd36d42e640 1 -- 172.21.15.18:0/3141323313 shutdown_connections 2024-09-19T09:19:12.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.166+0000 7fd36d42e640 1 -- 172.21.15.18:0/3141323313 wait complete. 2024-09-19T09:19:12.177 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-09-19T09:19:11.607606+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":152,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6439,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556060,"statfs":{"total":1600000000,"available":1593405860,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.429405"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695270+0000","last_change":"2024-09-19T09:19:09.204617+0000","last_active":"2024-09-19T09:19:10.695270+0000","last_peered":"2024-09-19T09:19:10.695270+0000","last_clean":"2024-09-19T09:19:10.695270+0000","last_became_active":"2024-09-19T09:19:09.203023+0000","last_became_peered":"2024-09-19T09:19:09.203023+0000","last_unstale":"2024-09-19T09:19:10.695270+0000","last_undegraded":"2024-09-19T09:19:10.695270+0000","last_fullsized":"2024-09-19T09:19:10.695270+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:28.053591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695189+0000","last_change":"2024-09-19T09:19:09.209508+0000","last_active":"2024-09-19T09:19:10.695189+0000","last_peered":"2024-09-19T09:19:10.695189+0000","last_clean":"2024-09-19T09:19:10.695189+0000","last_became_active":"2024-09-19T09:19:09.209213+0000","last_became_peered":"2024-09-19T09:19:09.209213+0000","last_unstale":"2024-09-19T09:19:10.695189+0000","last_undegraded":"2024-09-19T09:19:10.695189+0000","last_fullsized":"2024-09-19T09:19:10.695189+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:36:39.551729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198945+0000","last_change":"2024-09-19T09:19:09.197899+0000","last_active":"2024-09-19T09:19:10.198945+0000","last_peered":"2024-09-19T09:19:10.198945+0000","last_clean":"2024-09-19T09:19:10.198945+0000","last_became_active":"2024-09-19T09:19:09.197396+0000","last_became_peered":"2024-09-19T09:19:09.197396+0000","last_unstale":"2024-09-19T09:19:10.198945+0000","last_undegraded":"2024-09-19T09:19:10.198945+0000","last_fullsized":"2024-09-19T09:19:10.198945+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:19.672714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695219+0000","last_change":"2024-09-19T09:19:09.198716+0000","last_active":"2024-09-19T09:19:10.695219+0000","last_peered":"2024-09-19T09:19:10.695219+0000","last_clean":"2024-09-19T09:19:10.695219+0000","last_became_active":"2024-09-19T09:19:09.197529+0000","last_became_peered":"2024-09-19T09:19:09.197529+0000","last_unstale":"2024-09-19T09:19:10.695219+0000","last_undegraded":"2024-09-19T09:19:10.695219+0000","last_fullsized":"2024-09-19T09:19:10.695219+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:03.073761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790393+0000","last_change":"2024-09-19T09:19:09.203092+0000","last_active":"2024-09-19T09:19:10.790393+0000","last_peered":"2024-09-19T09:19:10.790393+0000","last_clean":"2024-09-19T09:19:10.790393+0000","last_became_active":"2024-09-19T09:19:09.202839+0000","last_became_peered":"2024-09-19T09:19:09.202839+0000","last_unstale":"2024-09-19T09:19:10.790393+0000","last_undegraded":"2024-09-19T09:19:10.790393+0000","last_fullsized":"2024-09-19T09:19:10.790393+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:47.514428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790567+0000","last_change":"2024-09-19T09:19:09.208358+0000","last_active":"2024-09-19T09:19:10.790567+0000","last_peered":"2024-09-19T09:19:10.790567+0000","last_clean":"2024-09-19T09:19:10.790567+0000","last_became_active":"2024-09-19T09:19:09.206958+0000","last_became_peered":"2024-09-19T09:19:09.206958+0000","last_unstale":"2024-09-19T09:19:10.790567+0000","last_undegraded":"2024-09-19T09:19:10.790567+0000","last_fullsized":"2024-09-19T09:19:10.790567+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:04.991102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790566+0000","last_change":"2024-09-19T09:19:09.204007+0000","last_active":"2024-09-19T09:19:10.790566+0000","last_peered":"2024-09-19T09:19:10.790566+0000","last_clean":"2024-09-19T09:19:10.790566+0000","last_became_active":"2024-09-19T09:19:09.203527+0000","last_became_peered":"2024-09-19T09:19:09.203527+0000","last_unstale":"2024-09-19T09:19:10.790566+0000","last_undegraded":"2024-09-19T09:19:10.790566+0000","last_fullsized":"2024-09-19T09:19:10.790566+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:56.430420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.199098+0000","last_change":"2024-09-19T09:19:09.197642+0000","last_active":"2024-09-19T09:19:10.199098+0000","last_peered":"2024-09-19T09:19:10.199098+0000","last_clean":"2024-09-19T09:19:10.199098+0000","last_became_active":"2024-09-19T09:19:09.197060+0000","last_became_peered":"2024-09-19T09:19:09.197060+0000","last_unstale":"2024-09-19T09:19:10.199098+0000","last_undegraded":"2024-09-19T09:19:10.199098+0000","last_fullsized":"2024-09-19T09:19:10.199098+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:32.105946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790273+0000","last_change":"2024-09-19T09:19:09.205241+0000","last_active":"2024-09-19T09:19:10.790273+0000","last_peered":"2024-09-19T09:19:10.790273+0000","last_clean":"2024-09-19T09:19:10.790273+0000","last_became_active":"2024-09-19T09:19:09.204969+0000","last_became_peered":"2024-09-19T09:19:09.204969+0000","last_unstale":"2024-09-19T09:19:10.790273+0000","last_undegraded":"2024-09-19T09:19:10.790273+0000","last_fullsized":"2024-09-19T09:19:10.790273+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:43.357050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695455+0000","last_change":"2024-09-19T09:19:09.200236+0000","last_active":"2024-09-19T09:19:10.695455+0000","last_peered":"2024-09-19T09:19:10.695455+0000","last_clean":"2024-09-19T09:19:10.695455+0000","last_became_active":"2024-09-19T09:19:09.200012+0000","last_became_peered":"2024-09-19T09:19:09.200012+0000","last_unstale":"2024-09-19T09:19:10.695455+0000","last_undegraded":"2024-09-19T09:19:10.695455+0000","last_fullsized":"2024-09-19T09:19:10.695455+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:18:41.502146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790679+0000","last_change":"2024-09-19T09:19:09.208133+0000","last_active":"2024-09-19T09:19:10.790679+0000","last_peered":"2024-09-19T09:19:10.790679+0000","last_clean":"2024-09-19T09:19:10.790679+0000","last_became_active":"2024-09-19T09:19:09.206601+0000","last_became_peered":"2024-09-19T09:19:09.206601+0000","last_unstale":"2024-09-19T09:19:10.790679+0000","last_undegraded":"2024-09-19T09:19:10.790679+0000","last_fullsized":"2024-09-19T09:19:10.790679+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:51.233990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.789969+0000","last_change":"2024-09-19T09:19:09.208663+0000","last_active":"2024-09-19T09:19:10.789969+0000","last_peered":"2024-09-19T09:19:10.789969+0000","last_clean":"2024-09-19T09:19:10.789969+0000","last_became_active":"2024-09-19T09:19:09.208028+0000","last_became_peered":"2024-09-19T09:19:09.208028+0000","last_unstale":"2024-09-19T09:19:10.789969+0000","last_undegraded":"2024-09-19T09:19:10.789969+0000","last_fullsized":"2024-09-19T09:19:10.789969+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:17.553294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.789634+0000","last_change":"2024-09-19T09:19:09.201096+0000","last_active":"2024-09-19T09:19:10.789634+0000","last_peered":"2024-09-19T09:19:10.789634+0000","last_clean":"2024-09-19T09:19:10.789634+0000","last_became_active":"2024-09-19T09:19:09.200813+0000","last_became_peered":"2024-09-19T09:19:09.200813+0000","last_unstale":"2024-09-19T09:19:10.789634+0000","last_undegraded":"2024-09-19T09:19:10.789634+0000","last_fullsized":"2024-09-19T09:19:10.789634+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:25.460078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695413+0000","last_change":"2024-09-19T09:19:09.197822+0000","last_active":"2024-09-19T09:19:10.695413+0000","last_peered":"2024-09-19T09:19:10.695413+0000","last_clean":"2024-09-19T09:19:10.695413+0000","last_became_active":"2024-09-19T09:19:09.197127+0000","last_became_peered":"2024-09-19T09:19:09.197127+0000","last_unstale":"2024-09-19T09:19:10.695413+0000","last_undegraded":"2024-09-19T09:19:10.695413+0000","last_fullsized":"2024-09-19T09:19:10.695413+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:09.889311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695516+0000","last_change":"2024-09-19T09:19:09.203119+0000","last_active":"2024-09-19T09:19:10.695516+0000","last_peered":"2024-09-19T09:19:10.695516+0000","last_clean":"2024-09-19T09:19:10.695516+0000","last_became_active":"2024-09-19T09:19:09.202606+0000","last_became_peered":"2024-09-19T09:19:09.202606+0000","last_unstale":"2024-09-19T09:19:10.695516+0000","last_undegraded":"2024-09-19T09:19:10.695516+0000","last_fullsized":"2024-09-19T09:19:10.695516+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:29.817258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790751+0000","last_change":"2024-09-19T09:19:09.208890+0000","last_active":"2024-09-19T09:19:10.790751+0000","last_peered":"2024-09-19T09:19:10.790751+0000","last_clean":"2024-09-19T09:19:10.790751+0000","last_became_active":"2024-09-19T09:19:09.207852+0000","last_became_peered":"2024-09-19T09:19:09.207852+0000","last_unstale":"2024-09-19T09:19:10.790751+0000","last_undegraded":"2024-09-19T09:19:10.790751+0000","last_fullsized":"2024-09-19T09:19:10.790751+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:01.761738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.289164+0000","last_change":"2024-09-19T09:19:09.193684+0000","last_active":"2024-09-19T09:19:10.289164+0000","last_peered":"2024-09-19T09:19:10.289164+0000","last_clean":"2024-09-19T09:19:10.289164+0000","last_became_active":"2024-09-19T09:19:09.193450+0000","last_became_peered":"2024-09-19T09:19:09.193450+0000","last_unstale":"2024-09-19T09:19:10.289164+0000","last_undegraded":"2024-09-19T09:19:10.289164+0000","last_fullsized":"2024-09-19T09:19:10.289164+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:13:56.936347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695226+0000","last_change":"2024-09-19T09:19:09.201625+0000","last_active":"2024-09-19T09:19:10.695226+0000","last_peered":"2024-09-19T09:19:10.695226+0000","last_clean":"2024-09-19T09:19:10.695226+0000","last_became_active":"2024-09-19T09:19:09.200145+0000","last_became_peered":"2024-09-19T09:19:09.200145+0000","last_unstale":"2024-09-19T09:19:10.695226+0000","last_undegraded":"2024-09-19T09:19:10.695226+0000","last_fullsized":"2024-09-19T09:19:10.695226+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:21.147230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.289144+0000","last_change":"2024-09-19T09:19:09.200347+0000","last_active":"2024-09-19T09:19:10.289144+0000","last_peered":"2024-09-19T09:19:10.289144+0000","last_clean":"2024-09-19T09:19:10.289144+0000","last_became_active":"2024-09-19T09:19:09.200031+0000","last_became_peered":"2024-09-19T09:19:09.200031+0000","last_unstale":"2024-09-19T09:19:10.289144+0000","last_undegraded":"2024-09-19T09:19:10.289144+0000","last_fullsized":"2024-09-19T09:19:10.289144+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:58.213752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.789980+0000","last_change":"2024-09-19T09:19:09.202674+0000","last_active":"2024-09-19T09:19:10.789980+0000","last_peered":"2024-09-19T09:19:10.789980+0000","last_clean":"2024-09-19T09:19:10.789980+0000","last_became_active":"2024-09-19T09:19:09.202464+0000","last_became_peered":"2024-09-19T09:19:09.202464+0000","last_unstale":"2024-09-19T09:19:10.789980+0000","last_undegraded":"2024-09-19T09:19:10.789980+0000","last_fullsized":"2024-09-19T09:19:10.789980+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:25.617405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198592+0000","last_change":"2024-09-19T09:19:09.193579+0000","last_active":"2024-09-19T09:19:10.198592+0000","last_peered":"2024-09-19T09:19:10.198592+0000","last_clean":"2024-09-19T09:19:10.198592+0000","last_became_active":"2024-09-19T09:19:09.193018+0000","last_became_peered":"2024-09-19T09:19:09.193018+0000","last_unstale":"2024-09-19T09:19:10.198592+0000","last_undegraded":"2024-09-19T09:19:10.198592+0000","last_fullsized":"2024-09-19T09:19:10.198592+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:33.154646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198622+0000","last_change":"2024-09-19T09:19:09.205241+0000","last_active":"2024-09-19T09:19:10.198622+0000","last_peered":"2024-09-19T09:19:10.198622+0000","last_clean":"2024-09-19T09:19:10.198622+0000","last_became_active":"2024-09-19T09:19:09.205007+0000","last_became_peered":"2024-09-19T09:19:09.205007+0000","last_unstale":"2024-09-19T09:19:10.198622+0000","last_undegraded":"2024-09-19T09:19:10.198622+0000","last_fullsized":"2024-09-19T09:19:10.198622+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:02.518629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695368+0000","last_change":"2024-09-19T09:19:09.200510+0000","last_active":"2024-09-19T09:19:10.695368+0000","last_peered":"2024-09-19T09:19:10.695368+0000","last_clean":"2024-09-19T09:19:10.695368+0000","last_became_active":"2024-09-19T09:19:09.199740+0000","last_became_peered":"2024-09-19T09:19:09.199740+0000","last_unstale":"2024-09-19T09:19:10.695368+0000","last_undegraded":"2024-09-19T09:19:10.695368+0000","last_fullsized":"2024-09-19T09:19:10.695368+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:17:00.119554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198251+0000","last_change":"2024-09-19T09:19:09.199804+0000","last_active":"2024-09-19T09:19:10.198251+0000","last_peered":"2024-09-19T09:19:10.198251+0000","last_clean":"2024-09-19T09:19:10.198251+0000","last_became_active":"2024-09-19T09:19:09.199547+0000","last_became_peered":"2024-09-19T09:19:09.199547+0000","last_unstale":"2024-09-19T09:19:10.198251+0000","last_undegraded":"2024-09-19T09:19:10.198251+0000","last_fullsized":"2024-09-19T09:19:10.198251+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:49.685146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695374+0000","last_change":"2024-09-19T09:19:09.193201+0000","last_active":"2024-09-19T09:19:10.695374+0000","last_peered":"2024-09-19T09:19:10.695374+0000","last_clean":"2024-09-19T09:19:10.695374+0000","last_became_active":"2024-09-19T09:19:09.192956+0000","last_became_peered":"2024-09-19T09:19:09.192956+0000","last_unstale":"2024-09-19T09:19:10.695374+0000","last_undegraded":"2024-09-19T09:19:10.695374+0000","last_fullsized":"2024-09-19T09:19:10.695374+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:52.242505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.789866+0000","last_change":"2024-09-19T09:19:09.199996+0000","last_active":"2024-09-19T09:19:10.789866+0000","last_peered":"2024-09-19T09:19:10.789866+0000","last_clean":"2024-09-19T09:19:10.789866+0000","last_became_active":"2024-09-19T09:19:09.199734+0000","last_became_peered":"2024-09-19T09:19:09.199734+0000","last_unstale":"2024-09-19T09:19:10.789866+0000","last_undegraded":"2024-09-19T09:19:10.789866+0000","last_fullsized":"2024-09-19T09:19:10.789866+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:47.506591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198543+0000","last_change":"2024-09-19T09:19:09.199655+0000","last_active":"2024-09-19T09:19:10.198543+0000","last_peered":"2024-09-19T09:19:10.198543+0000","last_clean":"2024-09-19T09:19:10.198543+0000","last_became_active":"2024-09-19T09:19:09.199038+0000","last_became_peered":"2024-09-19T09:19:09.199038+0000","last_unstale":"2024-09-19T09:19:10.198543+0000","last_undegraded":"2024-09-19T09:19:10.198543+0000","last_fullsized":"2024-09-19T09:19:10.198543+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:36.496432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198348+0000","last_change":"2024-09-19T09:19:09.198639+0000","last_active":"2024-09-19T09:19:10.198348+0000","last_peered":"2024-09-19T09:19:10.198348+0000","last_clean":"2024-09-19T09:19:10.198348+0000","last_became_active":"2024-09-19T09:19:09.197904+0000","last_became_peered":"2024-09-19T09:19:09.197904+0000","last_unstale":"2024-09-19T09:19:10.198348+0000","last_undegraded":"2024-09-19T09:19:10.198348+0000","last_fullsized":"2024-09-19T09:19:10.198348+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:08.583135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.789586+0000","last_change":"2024-09-19T09:19:09.195461+0000","last_active":"2024-09-19T09:19:10.789586+0000","last_peered":"2024-09-19T09:19:10.789586+0000","last_clean":"2024-09-19T09:19:10.789586+0000","last_became_active":"2024-09-19T09:19:09.195185+0000","last_became_peered":"2024-09-19T09:19:09.195185+0000","last_unstale":"2024-09-19T09:19:10.789586+0000","last_undegraded":"2024-09-19T09:19:10.789586+0000","last_fullsized":"2024-09-19T09:19:10.789586+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:20:53.158069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.789727+0000","last_change":"2024-09-19T09:19:09.194624+0000","last_active":"2024-09-19T09:19:10.789727+0000","last_peered":"2024-09-19T09:19:10.789727+0000","last_clean":"2024-09-19T09:19:10.789727+0000","last_became_active":"2024-09-19T09:19:09.194350+0000","last_became_peered":"2024-09-19T09:19:09.194350+0000","last_unstale":"2024-09-19T09:19:10.789727+0000","last_undegraded":"2024-09-19T09:19:10.789727+0000","last_fullsized":"2024-09-19T09:19:10.789727+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:15:28.793571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198742+0000","last_change":"2024-09-19T09:19:09.193860+0000","last_active":"2024-09-19T09:19:10.198742+0000","last_peered":"2024-09-19T09:19:10.198742+0000","last_clean":"2024-09-19T09:19:10.198742+0000","last_became_active":"2024-09-19T09:19:09.193346+0000","last_became_peered":"2024-09-19T09:19:09.193346+0000","last_unstale":"2024-09-19T09:19:10.198742+0000","last_undegraded":"2024-09-19T09:19:10.198742+0000","last_fullsized":"2024-09-19T09:19:10.198742+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:10.791364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695670+0000","last_change":"2024-09-19T09:19:09.201021+0000","last_active":"2024-09-19T09:19:10.695670+0000","last_peered":"2024-09-19T09:19:10.695670+0000","last_clean":"2024-09-19T09:19:10.695670+0000","last_became_active":"2024-09-19T09:19:09.199990+0000","last_became_peered":"2024-09-19T09:19:09.199990+0000","last_unstale":"2024-09-19T09:19:10.695670+0000","last_undegraded":"2024-09-19T09:19:10.695670+0000","last_fullsized":"2024-09-19T09:19:10.695670+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:28.135363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.289305+0000","last_change":"2024-09-19T09:19:09.205571+0000","last_active":"2024-09-19T09:19:10.289305+0000","last_peered":"2024-09-19T09:19:10.289305+0000","last_clean":"2024-09-19T09:19:10.289305+0000","last_became_active":"2024-09-19T09:19:09.203851+0000","last_became_peered":"2024-09-19T09:19:09.203851+0000","last_unstale":"2024-09-19T09:19:10.289305+0000","last_undegraded":"2024-09-19T09:19:10.289305+0000","last_fullsized":"2024-09-19T09:19:10.289305+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:51.989174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"122'4","reported_seq":18,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.789850+0000","last_change":"2024-09-19T09:19:08.197331+0000","last_active":"2024-09-19T09:19:10.789850+0000","last_peered":"2024-09-19T09:19:10.789850+0000","last_clean":"2024-09-19T09:19:10.789850+0000","last_became_active":"2024-09-19T09:19:08.197094+0000","last_became_peered":"2024-09-19T09:19:08.197094+0000","last_unstale":"2024-09-19T09:19:10.789850+0000","last_undegraded":"2024-09-19T09:19:10.789850+0000","last_fullsized":"2024-09-19T09:19:10.789850+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:45:44.232246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.789738+0000","last_change":"2024-09-19T09:19:09.196726+0000","last_active":"2024-09-19T09:19:10.789738+0000","last_peered":"2024-09-19T09:19:10.789738+0000","last_clean":"2024-09-19T09:19:10.789738+0000","last_became_active":"2024-09-19T09:19:09.195912+0000","last_became_peered":"2024-09-19T09:19:09.195912+0000","last_unstale":"2024-09-19T09:19:10.789738+0000","last_undegraded":"2024-09-19T09:19:10.789738+0000","last_fullsized":"2024-09-19T09:19:10.789738+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:10:34.217377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1e","version":"122'1","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790506+0000","last_change":"2024-09-19T09:19:08.198191+0000","last_active":"2024-09-19T09:19:10.790506+0000","last_peered":"2024-09-19T09:19:10.790506+0000","last_clean":"2024-09-19T09:19:10.790506+0000","last_became_active":"2024-09-19T09:19:08.197916+0000","last_became_peered":"2024-09-19T09:19:08.197916+0000","last_unstale":"2024-09-19T09:19:10.790506+0000","last_undegraded":"2024-09-19T09:19:10.790506+0000","last_fullsized":"2024-09-19T09:19:10.790506+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:16.605118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695463+0000","last_change":"2024-09-19T09:19:09.199835+0000","last_active":"2024-09-19T09:19:10.695463+0000","last_peered":"2024-09-19T09:19:10.695463+0000","last_clean":"2024-09-19T09:19:10.695463+0000","last_became_active":"2024-09-19T09:19:09.199511+0000","last_became_peered":"2024-09-19T09:19:09.199511+0000","last_unstale":"2024-09-19T09:19:10.695463+0000","last_undegraded":"2024-09-19T09:19:10.695463+0000","last_fullsized":"2024-09-19T09:19:10.695463+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:08.601114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"122'2","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.199115+0000","last_change":"2024-09-19T09:19:08.200706+0000","last_active":"2024-09-19T09:19:10.199115+0000","last_peered":"2024-09-19T09:19:10.199115+0000","last_clean":"2024-09-19T09:19:10.199115+0000","last_became_active":"2024-09-19T09:19:08.200454+0000","last_became_peered":"2024-09-19T09:19:08.200454+0000","last_unstale":"2024-09-19T09:19:10.199115+0000","last_undegraded":"2024-09-19T09:19:10.199115+0000","last_fullsized":"2024-09-19T09:19:10.199115+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:24.617992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695531+0000","last_change":"2024-09-19T09:19:09.193953+0000","last_active":"2024-09-19T09:19:10.695531+0000","last_peered":"2024-09-19T09:19:10.695531+0000","last_clean":"2024-09-19T09:19:10.695531+0000","last_became_active":"2024-09-19T09:19:09.193694+0000","last_became_peered":"2024-09-19T09:19:09.193694+0000","last_unstale":"2024-09-19T09:19:10.695531+0000","last_undegraded":"2024-09-19T09:19:10.695531+0000","last_fullsized":"2024-09-19T09:19:10.695531+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:30.187832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"122'2","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695905+0000","last_change":"2024-09-19T09:19:08.201043+0000","last_active":"2024-09-19T09:19:10.695905+0000","last_peered":"2024-09-19T09:19:10.695905+0000","last_clean":"2024-09-19T09:19:10.695905+0000","last_became_active":"2024-09-19T09:19:08.200503+0000","last_became_peered":"2024-09-19T09:19:08.200503+0000","last_unstale":"2024-09-19T09:19:10.695905+0000","last_undegraded":"2024-09-19T09:19:10.695905+0000","last_fullsized":"2024-09-19T09:19:10.695905+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:09:10.714431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.789934+0000","last_change":"2024-09-19T09:19:09.205101+0000","last_active":"2024-09-19T09:19:10.789934+0000","last_peered":"2024-09-19T09:19:10.789934+0000","last_clean":"2024-09-19T09:19:10.789934+0000","last_became_active":"2024-09-19T09:19:09.203358+0000","last_became_peered":"2024-09-19T09:19:09.203358+0000","last_unstale":"2024-09-19T09:19:10.789934+0000","last_undegraded":"2024-09-19T09:19:10.789934+0000","last_fullsized":"2024-09-19T09:19:10.789934+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:24.202404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"122'1","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695765+0000","last_change":"2024-09-19T09:19:08.199544+0000","last_active":"2024-09-19T09:19:10.695765+0000","last_peered":"2024-09-19T09:19:10.695765+0000","last_clean":"2024-09-19T09:19:10.695765+0000","last_became_active":"2024-09-19T09:19:08.199124+0000","last_became_peered":"2024-09-19T09:19:08.199124+0000","last_unstale":"2024-09-19T09:19:10.695765+0000","last_undegraded":"2024-09-19T09:19:10.695765+0000","last_fullsized":"2024-09-19T09:19:10.695765+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:19.053414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790345+0000","last_change":"2024-09-19T09:19:09.204779+0000","last_active":"2024-09-19T09:19:10.790345+0000","last_peered":"2024-09-19T09:19:10.790345+0000","last_clean":"2024-09-19T09:19:10.790345+0000","last_became_active":"2024-09-19T09:19:09.204536+0000","last_became_peered":"2024-09-19T09:19:09.204536+0000","last_unstale":"2024-09-19T09:19:10.790345+0000","last_undegraded":"2024-09-19T09:19:10.790345+0000","last_fullsized":"2024-09-19T09:19:10.790345+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:55.858928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"122'1","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.199268+0000","last_change":"2024-09-19T09:19:08.197336+0000","last_active":"2024-09-19T09:19:10.199268+0000","last_peered":"2024-09-19T09:19:10.199268+0000","last_clean":"2024-09-19T09:19:10.199268+0000","last_became_active":"2024-09-19T09:19:08.196742+0000","last_became_peered":"2024-09-19T09:19:08.196742+0000","last_unstale":"2024-09-19T09:19:10.199268+0000","last_undegraded":"2024-09-19T09:19:10.199268+0000","last_fullsized":"2024-09-19T09:19:10.199268+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:09.027939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.789827+0000","last_change":"2024-09-19T09:19:09.199474+0000","last_active":"2024-09-19T09:19:10.789827+0000","last_peered":"2024-09-19T09:19:10.789827+0000","last_clean":"2024-09-19T09:19:10.789827+0000","last_became_active":"2024-09-19T09:19:09.199223+0000","last_became_peered":"2024-09-19T09:19:09.199223+0000","last_unstale":"2024-09-19T09:19:10.789827+0000","last_undegraded":"2024-09-19T09:19:10.789827+0000","last_fullsized":"2024-09-19T09:19:10.789827+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:28:18.730711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790643+0000","last_change":"2024-09-19T09:19:08.191461+0000","last_active":"2024-09-19T09:19:10.790643+0000","last_peered":"2024-09-19T09:19:10.790643+0000","last_clean":"2024-09-19T09:19:10.790643+0000","last_became_active":"2024-09-19T09:19:08.191211+0000","last_became_peered":"2024-09-19T09:19:08.191211+0000","last_unstale":"2024-09-19T09:19:10.790643+0000","last_undegraded":"2024-09-19T09:19:10.790643+0000","last_fullsized":"2024-09-19T09:19:10.790643+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:12:20.014353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.789702+0000","last_change":"2024-09-19T09:19:09.206980+0000","last_active":"2024-09-19T09:19:10.789702+0000","last_peered":"2024-09-19T09:19:10.789702+0000","last_clean":"2024-09-19T09:19:10.789702+0000","last_became_active":"2024-09-19T09:19:09.206250+0000","last_became_peered":"2024-09-19T09:19:09.206250+0000","last_unstale":"2024-09-19T09:19:10.789702+0000","last_undegraded":"2024-09-19T09:19:10.789702+0000","last_fullsized":"2024-09-19T09:19:10.789702+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:24.745319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.289368+0000","last_change":"2024-09-19T09:19:08.202664+0000","last_active":"2024-09-19T09:19:10.289368+0000","last_peered":"2024-09-19T09:19:10.289368+0000","last_clean":"2024-09-19T09:19:10.289368+0000","last_became_active":"2024-09-19T09:19:08.202418+0000","last_became_peered":"2024-09-19T09:19:08.202418+0000","last_unstale":"2024-09-19T09:19:10.289368+0000","last_undegraded":"2024-09-19T09:19:10.289368+0000","last_fullsized":"2024-09-19T09:19:10.289368+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:49.361079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695412+0000","last_change":"2024-09-19T09:19:09.204062+0000","last_active":"2024-09-19T09:19:10.695412+0000","last_peered":"2024-09-19T09:19:10.695412+0000","last_clean":"2024-09-19T09:19:10.695412+0000","last_became_active":"2024-09-19T09:19:09.200289+0000","last_became_peered":"2024-09-19T09:19:09.200289+0000","last_unstale":"2024-09-19T09:19:10.695412+0000","last_undegraded":"2024-09-19T09:19:10.695412+0000","last_fullsized":"2024-09-19T09:19:10.695412+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:11:59.945583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198922+0000","last_change":"2024-09-19T09:19:08.192304+0000","last_active":"2024-09-19T09:19:10.198922+0000","last_peered":"2024-09-19T09:19:10.198922+0000","last_clean":"2024-09-19T09:19:10.198922+0000","last_became_active":"2024-09-19T09:19:08.191977+0000","last_became_peered":"2024-09-19T09:19:08.191977+0000","last_unstale":"2024-09-19T09:19:10.198922+0000","last_undegraded":"2024-09-19T09:19:10.198922+0000","last_fullsized":"2024-09-19T09:19:10.198922+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:32.206704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198338+0000","last_change":"2024-09-19T09:19:09.193688+0000","last_active":"2024-09-19T09:19:10.198338+0000","last_peered":"2024-09-19T09:19:10.198338+0000","last_clean":"2024-09-19T09:19:10.198338+0000","last_became_active":"2024-09-19T09:19:09.193396+0000","last_became_peered":"2024-09-19T09:19:09.193396+0000","last_unstale":"2024-09-19T09:19:10.198338+0000","last_undegraded":"2024-09-19T09:19:10.198338+0000","last_fullsized":"2024-09-19T09:19:10.198338+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:51:24.777311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695899+0000","last_change":"2024-09-19T09:19:08.200390+0000","last_active":"2024-09-19T09:19:10.695899+0000","last_peered":"2024-09-19T09:19:10.695899+0000","last_clean":"2024-09-19T09:19:10.695899+0000","last_became_active":"2024-09-19T09:19:08.200129+0000","last_became_peered":"2024-09-19T09:19:08.200129+0000","last_unstale":"2024-09-19T09:19:10.695899+0000","last_undegraded":"2024-09-19T09:19:10.695899+0000","last_fullsized":"2024-09-19T09:19:10.695899+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:02.737300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790409+0000","last_change":"2024-09-19T09:19:09.202422+0000","last_active":"2024-09-19T09:19:10.790409+0000","last_peered":"2024-09-19T09:19:10.790409+0000","last_clean":"2024-09-19T09:19:10.790409+0000","last_became_active":"2024-09-19T09:19:09.202194+0000","last_became_peered":"2024-09-19T09:19:09.202194+0000","last_unstale":"2024-09-19T09:19:10.790409+0000","last_undegraded":"2024-09-19T09:19:10.790409+0000","last_fullsized":"2024-09-19T09:19:10.790409+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:02.465966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"122'3","reported_seq":17,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790275+0000","last_change":"2024-09-19T09:19:08.194846+0000","last_active":"2024-09-19T09:19:10.790275+0000","last_peered":"2024-09-19T09:19:10.790275+0000","last_clean":"2024-09-19T09:19:10.790275+0000","last_became_active":"2024-09-19T09:19:08.194616+0000","last_became_peered":"2024-09-19T09:19:08.194616+0000","last_unstale":"2024-09-19T09:19:10.790275+0000","last_undegraded":"2024-09-19T09:19:10.790275+0000","last_fullsized":"2024-09-19T09:19:10.790275+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:41.845372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198489+0000","last_change":"2024-09-19T09:19:09.198844+0000","last_active":"2024-09-19T09:19:10.198489+0000","last_peered":"2024-09-19T09:19:10.198489+0000","last_clean":"2024-09-19T09:19:10.198489+0000","last_became_active":"2024-09-19T09:19:09.198244+0000","last_became_peered":"2024-09-19T09:19:09.198244+0000","last_unstale":"2024-09-19T09:19:10.198489+0000","last_undegraded":"2024-09-19T09:19:10.198489+0000","last_fullsized":"2024-09-19T09:19:10.198489+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:27.685297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"122'6","reported_seq":20,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.789918+0000","last_change":"2024-09-19T09:19:08.199164+0000","last_active":"2024-09-19T09:19:10.789918+0000","last_peered":"2024-09-19T09:19:10.789918+0000","last_clean":"2024-09-19T09:19:10.789918+0000","last_became_active":"2024-09-19T09:19:08.198690+0000","last_became_peered":"2024-09-19T09:19:08.198690+0000","last_unstale":"2024-09-19T09:19:10.789918+0000","last_undegraded":"2024-09-19T09:19:10.789918+0000","last_fullsized":"2024-09-19T09:19:10.789918+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:29.132429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695640+0000","last_change":"2024-09-19T09:19:09.203751+0000","last_active":"2024-09-19T09:19:10.695640+0000","last_peered":"2024-09-19T09:19:10.695640+0000","last_clean":"2024-09-19T09:19:10.695640+0000","last_became_active":"2024-09-19T09:19:09.202690+0000","last_became_peered":"2024-09-19T09:19:09.202690+0000","last_unstale":"2024-09-19T09:19:10.695640+0000","last_undegraded":"2024-09-19T09:19:10.695640+0000","last_fullsized":"2024-09-19T09:19:10.695640+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:15.153509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"122'2","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.289475+0000","last_change":"2024-09-19T09:19:08.196619+0000","last_active":"2024-09-19T09:19:10.289475+0000","last_peered":"2024-09-19T09:19:10.289475+0000","last_clean":"2024-09-19T09:19:10.289475+0000","last_became_active":"2024-09-19T09:19:08.196189+0000","last_became_peered":"2024-09-19T09:19:08.196189+0000","last_unstale":"2024-09-19T09:19:10.289475+0000","last_undegraded":"2024-09-19T09:19:10.289475+0000","last_fullsized":"2024-09-19T09:19:10.289475+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:19.553314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198651+0000","last_change":"2024-09-19T09:19:09.190770+0000","last_active":"2024-09-19T09:19:10.198651+0000","last_peered":"2024-09-19T09:19:10.198651+0000","last_clean":"2024-09-19T09:19:10.198651+0000","last_became_active":"2024-09-19T09:19:09.190107+0000","last_became_peered":"2024-09-19T09:19:09.190107+0000","last_unstale":"2024-09-19T09:19:10.198651+0000","last_undegraded":"2024-09-19T09:19:10.198651+0000","last_fullsized":"2024-09-19T09:19:10.198651+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:22:27.260772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695979+0000","last_change":"2024-09-19T09:19:08.198205+0000","last_active":"2024-09-19T09:19:10.695979+0000","last_peered":"2024-09-19T09:19:10.695979+0000","last_clean":"2024-09-19T09:19:10.695979+0000","last_became_active":"2024-09-19T09:19:08.197804+0000","last_became_peered":"2024-09-19T09:19:08.197804+0000","last_unstale":"2024-09-19T09:19:10.695979+0000","last_undegraded":"2024-09-19T09:19:10.695979+0000","last_fullsized":"2024-09-19T09:19:10.695979+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:57.102358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790170+0000","last_change":"2024-09-19T09:19:09.204793+0000","last_active":"2024-09-19T09:19:10.790170+0000","last_peered":"2024-09-19T09:19:10.790170+0000","last_clean":"2024-09-19T09:19:10.790170+0000","last_became_active":"2024-09-19T09:19:09.204209+0000","last_became_peered":"2024-09-19T09:19:09.204209+0000","last_unstale":"2024-09-19T09:19:10.790170+0000","last_undegraded":"2024-09-19T09:19:10.790170+0000","last_fullsized":"2024-09-19T09:19:10.790170+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:31.848975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790068+0000","last_change":"2024-09-19T09:19:08.196981+0000","last_active":"2024-09-19T09:19:10.790068+0000","last_peered":"2024-09-19T09:19:10.790068+0000","last_clean":"2024-09-19T09:19:10.790068+0000","last_became_active":"2024-09-19T09:19:08.196702+0000","last_became_peered":"2024-09-19T09:19:08.196702+0000","last_unstale":"2024-09-19T09:19:10.790068+0000","last_undegraded":"2024-09-19T09:19:10.790068+0000","last_fullsized":"2024-09-19T09:19:10.790068+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:14.176599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198804+0000","last_change":"2024-09-19T09:19:09.200422+0000","last_active":"2024-09-19T09:19:10.198804+0000","last_peered":"2024-09-19T09:19:10.198804+0000","last_clean":"2024-09-19T09:19:10.198804+0000","last_became_active":"2024-09-19T09:19:09.200147+0000","last_became_peered":"2024-09-19T09:19:09.200147+0000","last_unstale":"2024-09-19T09:19:10.198804+0000","last_undegraded":"2024-09-19T09:19:10.198804+0000","last_fullsized":"2024-09-19T09:19:10.198804+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:33.334827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.10","version":"122'8","reported_seq":22,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695458+0000","last_change":"2024-09-19T09:19:08.200598+0000","last_active":"2024-09-19T09:19:10.695458+0000","last_peered":"2024-09-19T09:19:10.695458+0000","last_clean":"2024-09-19T09:19:10.695458+0000","last_became_active":"2024-09-19T09:19:08.199681+0000","last_became_peered":"2024-09-19T09:19:08.199681+0000","last_unstale":"2024-09-19T09:19:10.695458+0000","last_undegraded":"2024-09-19T09:19:10.695458+0000","last_fullsized":"2024-09-19T09:19:10.695458+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:36.119734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198405+0000","last_change":"2024-09-19T09:19:09.201431+0000","last_active":"2024-09-19T09:19:10.198405+0000","last_peered":"2024-09-19T09:19:10.198405+0000","last_clean":"2024-09-19T09:19:10.198405+0000","last_became_active":"2024-09-19T09:19:09.201165+0000","last_became_peered":"2024-09-19T09:19:09.201165+0000","last_unstale":"2024-09-19T09:19:10.198405+0000","last_undegraded":"2024-09-19T09:19:10.198405+0000","last_fullsized":"2024-09-19T09:19:10.198405+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:48.046865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"122'2","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790101+0000","last_change":"2024-09-19T09:19:08.199849+0000","last_active":"2024-09-19T09:19:10.790101+0000","last_peered":"2024-09-19T09:19:10.790101+0000","last_clean":"2024-09-19T09:19:10.790101+0000","last_became_active":"2024-09-19T09:19:08.199693+0000","last_became_peered":"2024-09-19T09:19:08.199693+0000","last_unstale":"2024-09-19T09:19:10.790101+0000","last_undegraded":"2024-09-19T09:19:10.790101+0000","last_fullsized":"2024-09-19T09:19:10.790101+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:05:22.085021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198620+0000","last_change":"2024-09-19T09:19:09.196296+0000","last_active":"2024-09-19T09:19:10.198620+0000","last_peered":"2024-09-19T09:19:10.198620+0000","last_clean":"2024-09-19T09:19:10.198620+0000","last_became_active":"2024-09-19T09:19:09.195963+0000","last_became_peered":"2024-09-19T09:19:09.195963+0000","last_unstale":"2024-09-19T09:19:10.198620+0000","last_undegraded":"2024-09-19T09:19:10.198620+0000","last_fullsized":"2024-09-19T09:19:10.198620+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:47.642720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"122'1","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790920+0000","last_change":"2024-09-19T09:19:08.192682+0000","last_active":"2024-09-19T09:19:10.790920+0000","last_peered":"2024-09-19T09:19:10.790920+0000","last_clean":"2024-09-19T09:19:10.790920+0000","last_became_active":"2024-09-19T09:19:08.192497+0000","last_became_peered":"2024-09-19T09:19:08.192497+0000","last_unstale":"2024-09-19T09:19:10.790920+0000","last_undegraded":"2024-09-19T09:19:10.790920+0000","last_fullsized":"2024-09-19T09:19:10.790920+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:27.163201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.789928+0000","last_change":"2024-09-19T09:19:09.204664+0000","last_active":"2024-09-19T09:19:10.789928+0000","last_peered":"2024-09-19T09:19:10.789928+0000","last_clean":"2024-09-19T09:19:10.789928+0000","last_became_active":"2024-09-19T09:19:09.204415+0000","last_became_peered":"2024-09-19T09:19:09.204415+0000","last_unstale":"2024-09-19T09:19:10.789928+0000","last_undegraded":"2024-09-19T09:19:10.789928+0000","last_fullsized":"2024-09-19T09:19:10.789928+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:11:15.238668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.289643+0000","last_change":"2024-09-19T09:19:08.193561+0000","last_active":"2024-09-19T09:19:10.289643+0000","last_peered":"2024-09-19T09:19:10.289643+0000","last_clean":"2024-09-19T09:19:10.289643+0000","last_became_active":"2024-09-19T09:19:08.192830+0000","last_became_peered":"2024-09-19T09:19:08.192830+0000","last_unstale":"2024-09-19T09:19:10.289643+0000","last_undegraded":"2024-09-19T09:19:10.289643+0000","last_fullsized":"2024-09-19T09:19:10.289643+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:11:26.948293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.289439+0000","last_change":"2024-09-19T09:19:09.190010+0000","last_active":"2024-09-19T09:19:10.289439+0000","last_peered":"2024-09-19T09:19:10.289439+0000","last_clean":"2024-09-19T09:19:10.289439+0000","last_became_active":"2024-09-19T09:19:09.189740+0000","last_became_peered":"2024-09-19T09:19:09.189740+0000","last_unstale":"2024-09-19T09:19:10.289439+0000","last_undegraded":"2024-09-19T09:19:10.289439+0000","last_fullsized":"2024-09-19T09:19:10.289439+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:44.172854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"122'2","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695535+0000","last_change":"2024-09-19T09:19:08.200148+0000","last_active":"2024-09-19T09:19:10.695535+0000","last_peered":"2024-09-19T09:19:10.695535+0000","last_clean":"2024-09-19T09:19:10.695535+0000","last_became_active":"2024-09-19T09:19:08.195248+0000","last_became_peered":"2024-09-19T09:19:08.195248+0000","last_unstale":"2024-09-19T09:19:10.695535+0000","last_undegraded":"2024-09-19T09:19:10.695535+0000","last_fullsized":"2024-09-19T09:19:10.695535+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:20.462827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.289051+0000","last_change":"2024-09-19T09:19:09.191074+0000","last_active":"2024-09-19T09:19:10.289051+0000","last_peered":"2024-09-19T09:19:10.289051+0000","last_clean":"2024-09-19T09:19:10.289051+0000","last_became_active":"2024-09-19T09:19:09.190542+0000","last_became_peered":"2024-09-19T09:19:09.190542+0000","last_unstale":"2024-09-19T09:19:10.289051+0000","last_undegraded":"2024-09-19T09:19:10.289051+0000","last_fullsized":"2024-09-19T09:19:10.289051+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:38.209929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198503+0000","last_change":"2024-09-19T09:19:08.196860+0000","last_active":"2024-09-19T09:19:10.198503+0000","last_peered":"2024-09-19T09:19:10.198503+0000","last_clean":"2024-09-19T09:19:10.198503+0000","last_became_active":"2024-09-19T09:19:08.195837+0000","last_became_peered":"2024-09-19T09:19:08.195837+0000","last_unstale":"2024-09-19T09:19:10.198503+0000","last_undegraded":"2024-09-19T09:19:10.198503+0000","last_fullsized":"2024-09-19T09:19:10.198503+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:53:25.907641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695789+0000","last_change":"2024-09-19T09:19:09.197899+0000","last_active":"2024-09-19T09:19:10.695789+0000","last_peered":"2024-09-19T09:19:10.695789+0000","last_clean":"2024-09-19T09:19:10.695789+0000","last_became_active":"2024-09-19T09:19:09.197604+0000","last_became_peered":"2024-09-19T09:19:09.197604+0000","last_unstale":"2024-09-19T09:19:10.695789+0000","last_undegraded":"2024-09-19T09:19:10.695789+0000","last_fullsized":"2024-09-19T09:19:10.695789+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:30.674155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695583+0000","last_change":"2024-09-19T09:19:08.194768+0000","last_active":"2024-09-19T09:19:10.695583+0000","last_peered":"2024-09-19T09:19:10.695583+0000","last_clean":"2024-09-19T09:19:10.695583+0000","last_became_active":"2024-09-19T09:19:08.194530+0000","last_became_peered":"2024-09-19T09:19:08.194530+0000","last_unstale":"2024-09-19T09:19:10.695583+0000","last_undegraded":"2024-09-19T09:19:10.695583+0000","last_fullsized":"2024-09-19T09:19:10.695583+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:20.525839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198287+0000","last_change":"2024-09-19T09:19:09.195493+0000","last_active":"2024-09-19T09:19:10.198287+0000","last_peered":"2024-09-19T09:19:10.198287+0000","last_clean":"2024-09-19T09:19:10.198287+0000","last_became_active":"2024-09-19T09:19:09.195243+0000","last_became_peered":"2024-09-19T09:19:09.195243+0000","last_unstale":"2024-09-19T09:19:10.198287+0000","last_undegraded":"2024-09-19T09:19:10.198287+0000","last_fullsized":"2024-09-19T09:19:10.198287+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:54:43.778180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.199016+0000","last_change":"2024-09-19T09:19:08.198114+0000","last_active":"2024-09-19T09:19:10.199016+0000","last_peered":"2024-09-19T09:19:10.199016+0000","last_clean":"2024-09-19T09:19:10.199016+0000","last_became_active":"2024-09-19T09:19:08.197735+0000","last_became_peered":"2024-09-19T09:19:08.197735+0000","last_unstale":"2024-09-19T09:19:10.199016+0000","last_undegraded":"2024-09-19T09:19:10.199016+0000","last_fullsized":"2024-09-19T09:19:10.199016+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:09.941144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.289228+0000","last_change":"2024-09-19T09:19:09.191755+0000","last_active":"2024-09-19T09:19:10.289228+0000","last_peered":"2024-09-19T09:19:10.289228+0000","last_clean":"2024-09-19T09:19:10.289228+0000","last_became_active":"2024-09-19T09:19:09.191478+0000","last_became_peered":"2024-09-19T09:19:09.191478+0000","last_unstale":"2024-09-19T09:19:10.289228+0000","last_undegraded":"2024-09-19T09:19:10.289228+0000","last_fullsized":"2024-09-19T09:19:10.289228+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:43.761511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"122'2","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790159+0000","last_change":"2024-09-19T09:19:08.194319+0000","last_active":"2024-09-19T09:19:10.790159+0000","last_peered":"2024-09-19T09:19:10.790159+0000","last_clean":"2024-09-19T09:19:10.790159+0000","last_became_active":"2024-09-19T09:19:08.193986+0000","last_became_peered":"2024-09-19T09:19:08.193986+0000","last_unstale":"2024-09-19T09:19:10.790159+0000","last_undegraded":"2024-09-19T09:19:10.790159+0000","last_fullsized":"2024-09-19T09:19:10.790159+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:13.327435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.289437+0000","last_change":"2024-09-19T09:19:09.198664+0000","last_active":"2024-09-19T09:19:10.289437+0000","last_peered":"2024-09-19T09:19:10.289437+0000","last_clean":"2024-09-19T09:19:10.289437+0000","last_became_active":"2024-09-19T09:19:09.198467+0000","last_became_peered":"2024-09-19T09:19:09.198467+0000","last_unstale":"2024-09-19T09:19:10.289437+0000","last_undegraded":"2024-09-19T09:19:10.289437+0000","last_fullsized":"2024-09-19T09:19:10.289437+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:05.621146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"123'1","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:11.189641+0000","last_change":"2024-09-19T09:19:08.195081+0000","last_active":"2024-09-19T09:19:11.189641+0000","last_peered":"2024-09-19T09:19:11.189641+0000","last_clean":"2024-09-19T09:19:11.189641+0000","last_became_active":"2024-09-19T09:19:08.193627+0000","last_became_peered":"2024-09-19T09:19:08.193627+0000","last_unstale":"2024-09-19T09:19:11.189641+0000","last_undegraded":"2024-09-19T09:19:11.189641+0000","last_fullsized":"2024-09-19T09:19:11.189641+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:57.812077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198954+0000","last_change":"2024-09-19T09:19:09.198503+0000","last_active":"2024-09-19T09:19:10.198954+0000","last_peered":"2024-09-19T09:19:10.198954+0000","last_clean":"2024-09-19T09:19:10.198954+0000","last_became_active":"2024-09-19T09:19:09.197706+0000","last_became_peered":"2024-09-19T09:19:09.197706+0000","last_unstale":"2024-09-19T09:19:10.198954+0000","last_undegraded":"2024-09-19T09:19:10.198954+0000","last_fullsized":"2024-09-19T09:19:10.198954+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:25.446337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.289617+0000","last_change":"2024-09-19T09:19:08.196460+0000","last_active":"2024-09-19T09:19:10.289617+0000","last_peered":"2024-09-19T09:19:10.289617+0000","last_clean":"2024-09-19T09:19:10.289617+0000","last_became_active":"2024-09-19T09:19:08.196205+0000","last_became_peered":"2024-09-19T09:19:08.196205+0000","last_unstale":"2024-09-19T09:19:10.289617+0000","last_undegraded":"2024-09-19T09:19:10.289617+0000","last_fullsized":"2024-09-19T09:19:10.289617+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:14.316937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790591+0000","last_change":"2024-09-19T09:19:09.196200+0000","last_active":"2024-09-19T09:19:10.790591+0000","last_peered":"2024-09-19T09:19:10.790591+0000","last_clean":"2024-09-19T09:19:10.790591+0000","last_became_active":"2024-09-19T09:19:09.195950+0000","last_became_peered":"2024-09-19T09:19:09.195950+0000","last_unstale":"2024-09-19T09:19:10.790591+0000","last_undegraded":"2024-09-19T09:19:10.790591+0000","last_fullsized":"2024-09-19T09:19:10.790591+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:48.272431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198386+0000","last_change":"2024-09-19T09:19:08.196100+0000","last_active":"2024-09-19T09:19:10.198386+0000","last_peered":"2024-09-19T09:19:10.198386+0000","last_clean":"2024-09-19T09:19:10.198386+0000","last_became_active":"2024-09-19T09:19:08.195801+0000","last_became_peered":"2024-09-19T09:19:08.195801+0000","last_unstale":"2024-09-19T09:19:10.198386+0000","last_undegraded":"2024-09-19T09:19:10.198386+0000","last_fullsized":"2024-09-19T09:19:10.198386+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:14.939951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.289577+0000","last_change":"2024-09-19T09:19:09.199790+0000","last_active":"2024-09-19T09:19:10.289577+0000","last_peered":"2024-09-19T09:19:10.289577+0000","last_clean":"2024-09-19T09:19:10.289577+0000","last_became_active":"2024-09-19T09:19:09.199550+0000","last_became_peered":"2024-09-19T09:19:09.199550+0000","last_unstale":"2024-09-19T09:19:10.289577+0000","last_undegraded":"2024-09-19T09:19:10.289577+0000","last_fullsized":"2024-09-19T09:19:10.289577+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:48.365431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.199110+0000","last_change":"2024-09-19T09:19:08.201693+0000","last_active":"2024-09-19T09:19:10.199110+0000","last_peered":"2024-09-19T09:19:10.199110+0000","last_clean":"2024-09-19T09:19:10.199110+0000","last_became_active":"2024-09-19T09:19:08.201368+0000","last_became_peered":"2024-09-19T09:19:08.201368+0000","last_unstale":"2024-09-19T09:19:10.199110+0000","last_undegraded":"2024-09-19T09:19:10.199110+0000","last_fullsized":"2024-09-19T09:19:10.199110+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:50.416535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790823+0000","last_change":"2024-09-19T09:19:09.208568+0000","last_active":"2024-09-19T09:19:10.790823+0000","last_peered":"2024-09-19T09:19:10.790823+0000","last_clean":"2024-09-19T09:19:10.790823+0000","last_became_active":"2024-09-19T09:19:09.207336+0000","last_became_peered":"2024-09-19T09:19:09.207336+0000","last_unstale":"2024-09-19T09:19:10.790823+0000","last_undegraded":"2024-09-19T09:19:10.790823+0000","last_fullsized":"2024-09-19T09:19:10.790823+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:26.896940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198667+0000","last_change":"2024-09-19T09:19:08.197707+0000","last_active":"2024-09-19T09:19:10.198667+0000","last_peered":"2024-09-19T09:19:10.198667+0000","last_clean":"2024-09-19T09:19:10.198667+0000","last_became_active":"2024-09-19T09:19:08.197187+0000","last_became_peered":"2024-09-19T09:19:08.197187+0000","last_unstale":"2024-09-19T09:19:10.198667+0000","last_undegraded":"2024-09-19T09:19:10.198667+0000","last_fullsized":"2024-09-19T09:19:10.198667+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:46.201009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.289551+0000","last_change":"2024-09-19T09:19:09.206987+0000","last_active":"2024-09-19T09:19:10.289551+0000","last_peered":"2024-09-19T09:19:10.289551+0000","last_clean":"2024-09-19T09:19:10.289551+0000","last_became_active":"2024-09-19T09:19:09.206648+0000","last_became_peered":"2024-09-19T09:19:09.206648+0000","last_unstale":"2024-09-19T09:19:10.289551+0000","last_undegraded":"2024-09-19T09:19:10.289551+0000","last_fullsized":"2024-09-19T09:19:10.289551+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:25.085784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.789932+0000","last_change":"2024-09-19T09:19:08.201378+0000","last_active":"2024-09-19T09:19:10.789932+0000","last_peered":"2024-09-19T09:19:10.789932+0000","last_clean":"2024-09-19T09:19:10.789932+0000","last_became_active":"2024-09-19T09:19:08.201109+0000","last_became_peered":"2024-09-19T09:19:08.201109+0000","last_unstale":"2024-09-19T09:19:10.789932+0000","last_undegraded":"2024-09-19T09:19:10.789932+0000","last_fullsized":"2024-09-19T09:19:10.789932+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:29.149951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790086+0000","last_change":"2024-09-19T09:19:09.206692+0000","last_active":"2024-09-19T09:19:10.790086+0000","last_peered":"2024-09-19T09:19:10.790086+0000","last_clean":"2024-09-19T09:19:10.790086+0000","last_became_active":"2024-09-19T09:19:09.206345+0000","last_became_peered":"2024-09-19T09:19:09.206345+0000","last_unstale":"2024-09-19T09:19:10.790086+0000","last_undegraded":"2024-09-19T09:19:10.790086+0000","last_fullsized":"2024-09-19T09:19:10.790086+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:40.258607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198430+0000","last_change":"2024-09-19T09:19:08.198375+0000","last_active":"2024-09-19T09:19:10.198430+0000","last_peered":"2024-09-19T09:19:10.198430+0000","last_clean":"2024-09-19T09:19:10.198430+0000","last_became_active":"2024-09-19T09:19:08.198137+0000","last_became_peered":"2024-09-19T09:19:08.198137+0000","last_unstale":"2024-09-19T09:19:10.198430+0000","last_undegraded":"2024-09-19T09:19:10.198430+0000","last_fullsized":"2024-09-19T09:19:10.198430+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:14.640687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198794+0000","last_change":"2024-09-19T09:19:09.199099+0000","last_active":"2024-09-19T09:19:10.198794+0000","last_peered":"2024-09-19T09:19:10.198794+0000","last_clean":"2024-09-19T09:19:10.198794+0000","last_became_active":"2024-09-19T09:19:09.198851+0000","last_became_peered":"2024-09-19T09:19:09.198851+0000","last_unstale":"2024-09-19T09:19:10.198794+0000","last_undegraded":"2024-09-19T09:19:10.198794+0000","last_fullsized":"2024-09-19T09:19:10.198794+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:21.692573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"122'1","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790045+0000","last_change":"2024-09-19T09:19:08.198949+0000","last_active":"2024-09-19T09:19:10.790045+0000","last_peered":"2024-09-19T09:19:10.790045+0000","last_clean":"2024-09-19T09:19:10.790045+0000","last_became_active":"2024-09-19T09:19:08.198339+0000","last_became_peered":"2024-09-19T09:19:08.198339+0000","last_unstale":"2024-09-19T09:19:10.790045+0000","last_undegraded":"2024-09-19T09:19:10.790045+0000","last_fullsized":"2024-09-19T09:19:10.790045+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:03.708781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":373,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790097+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:19:10.790097+0000","last_peered":"2024-09-19T09:19:10.790097+0000","last_clean":"2024-09-19T09:19:10.790097+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:19:10.790097+0000","last_undegraded":"2024-09-19T09:19:10.790097+0000","last_fullsized":"2024-09-19T09:19:10.790097+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:28.823470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":662,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194650,"statfs":{"total":200000000,"available":199321770,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574921,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":661,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194650,"statfs":{"total":200000000,"available":199322352,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574921,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1239,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194072,"statfs":{"total":200000000,"available":198730316,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574921,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":662,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194650,"statfs":{"total":200000000,"available":199321770,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":655,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194656,"statfs":{"total":200000000,"available":199328458,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":661,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194650,"statfs":{"total":200000000,"available":199322282,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1239,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194072,"statfs":{"total":200000000,"available":198730260,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574921,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":655,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194656,"statfs":{"total":200000000,"available":199328652,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:19:12.182 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:19:12.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.319+0000 7fc77db52640 1 Processor -- start 2024-09-19T09:19:12.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.319+0000 7fc77db52640 1 -- start start 2024-09-19T09:19:12.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.320+0000 7fc77db52640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc77806d730 0x7fc7780b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:12.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.320+0000 7fc77db52640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7780cd1a0 con 0x7fc7780cfae0 2024-09-19T09:19:12.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.320+0000 7fc77db52640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc77806dc30 con 0x7fc77815ef80 2024-09-19T09:19:12.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.320+0000 7fc77db52640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc7780cd7d0 con 0x7fc77806d730 2024-09-19T09:19:12.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.320+0000 7fc776ffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc7780cfae0 0x7fc7780cdc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52810/0 (socket says 172.21.15.18:52810) 2024-09-19T09:19:12.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.320+0000 7fc776ffd640 1 -- 172.21.15.18:0/714494671 learned_addr learned my addr 172.21.15.18:0/714494671 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:12.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.320+0000 7fc777fff640 1 --2- 172.21.15.18:0/714494671 >> v2:172.21.15.162:3300/0 conn(0x7fc77806d730 0x7fc7780b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:12.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.320+0000 7fc7767fc640 1 -- 172.21.15.18:0/714494671 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 874173306 0 0) 0x7fc7780cd1a0 con 0x7fc7780cfae0 2024-09-19T09:19:12.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.320+0000 7fc7767fc640 1 -- 172.21.15.18:0/714494671 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc760003520 con 0x7fc7780cfae0 2024-09-19T09:19:12.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.320+0000 7fc7767fc640 1 -- 172.21.15.18:0/714494671 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1247621196 0 0) 0x7fc760003520 con 0x7fc7780cfae0 2024-09-19T09:19:12.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.320+0000 7fc7767fc640 1 -- 172.21.15.18:0/714494671 >> v2:172.21.15.162:3300/0 conn(0x7fc77806d730 msgr2=0x7fc7780b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:12.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.320+0000 7fc7767fc640 1 --2- 172.21.15.18:0/714494671 >> v2:172.21.15.162:3300/0 conn(0x7fc77806d730 0x7fc7780b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.320+0000 7fc7767fc640 1 -- 172.21.15.18:0/714494671 >> v1:172.21.15.162:6789/0 conn(0x7fc77815ef80 legacy=0x7fc7780cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:12.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.320+0000 7fc7767fc640 1 -- 172.21.15.18:0/714494671 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc77806df10 con 0x7fc7780cfae0 2024-09-19T09:19:12.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.320+0000 7fc7767fc640 1 -- 172.21.15.18:0/714494671 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fc76c001670 con 0x7fc7780cfae0 2024-09-19T09:19:12.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.320+0000 7fc7767fc640 1 -- 172.21.15.18:0/714494671 >> v1:172.21.15.18:6789/0 conn(0x7fc7780cfae0 legacy=0x7fc7780cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:12.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.321+0000 7fc7767fc640 1 --2- 172.21.15.18:0/714494671 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7600039b0 0x7fc760003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:12.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.321+0000 7fc7767fc640 1 --2- 172.21.15.18:0/714494671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7600043b0 0x7fc760004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:12.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.321+0000 7fc7767fc640 1 --2- 172.21.15.18:0/714494671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc760005080 0x7fc76000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:12.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.321+0000 7fc7767fc640 1 -- 172.21.15.18:0/714494671 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc7780cd7d0 con 0x7fc7600043b0 2024-09-19T09:19:12.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.321+0000 7fc7767fc640 1 -- 172.21.15.18:0/714494671 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc76000bfe0 con 0x7fc760005080 2024-09-19T09:19:12.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.321+0000 7fc7767fc640 1 -- 172.21.15.18:0/714494671 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc76000c1e0 con 0x7fc7600039b0 2024-09-19T09:19:12.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.321+0000 7fc776ffd640 1 --2- 172.21.15.18:0/714494671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7600043b0 0x7fc760004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:12.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.321+0000 7fc7777fe640 1 --2- 172.21.15.18:0/714494671 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7600039b0 0x7fc760003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:12.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.321+0000 7fc777fff640 1 --2- 172.21.15.18:0/714494671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc760005080 0x7fc76000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:12.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.321+0000 7fc776ffd640 1 -- 172.21.15.18:0/714494671 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7600039b0 msgr2=0x7fc760003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:12.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.321+0000 7fc776ffd640 1 --2- 172.21.15.18:0/714494671 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc7600039b0 0x7fc760003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.321+0000 7fc776ffd640 1 -- 172.21.15.18:0/714494671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc760005080 msgr2=0x7fc76000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:12.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.321+0000 7fc776ffd640 1 --2- 172.21.15.18:0/714494671 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc760005080 0x7fc76000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.321+0000 7fc776ffd640 1 -- 172.21.15.18:0/714494671 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc760003520 con 0x7fc7600043b0 2024-09-19T09:19:12.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.321+0000 7fc777fff640 1 -- 172.21.15.18:0/714494671 reap_dead start 2024-09-19T09:19:12.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.322+0000 7fc776ffd640 1 --2- 172.21.15.18:0/714494671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7600043b0 0x7fc760004880 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc76c00c190 tx=0x7fc760005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e17f8645731089 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:12.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.322+0000 7fc7767fc640 1 -- 172.21.15.18:0/714494671 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c007cc0 con 0x7fc7600043b0 2024-09-19T09:19:12.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.322+0000 7fc7767fc640 1 -- 172.21.15.18:0/714494671 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc76c005ad0 con 0x7fc7600043b0 2024-09-19T09:19:12.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.322+0000 7fc7767fc640 1 -- 172.21.15.18:0/714494671 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc76c007070 con 0x7fc7600043b0 2024-09-19T09:19:12.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.322+0000 7fc77db52640 1 -- 172.21.15.18:0/714494671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7600043b0 msgr2=0x7fc760004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:12.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.322+0000 7fc77db52640 1 --2- 172.21.15.18:0/714494671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7600043b0 0x7fc760004880 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc76c00c190 tx=0x7fc760005830 comp rx=0 tx=0).stop 2024-09-19T09:19:12.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.322+0000 7fc77db52640 1 -- 172.21.15.18:0/714494671 shutdown_connections 2024-09-19T09:19:12.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.322+0000 7fc77db52640 1 --2- 172.21.15.18:0/714494671 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7600043b0 0x7fc760004880 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.322+0000 7fc77db52640 1 -- 172.21.15.18:0/714494671 >> 172.21.15.18:0/714494671 conn(0x7fc7780b4700 msgr2=0x7fc7780b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:12.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.322+0000 7fc77db52640 1 -- 172.21.15.18:0/714494671 shutdown_connections 2024-09-19T09:19:12.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.322+0000 7fc77db52640 1 -- 172.21.15.18:0/714494671 wait complete. 2024-09-19T09:19:12.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.324+0000 7fc77db52640 1 Processor -- start 2024-09-19T09:19:12.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.324+0000 7fc77db52640 1 -- start start 2024-09-19T09:19:12.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.324+0000 7fc77db52640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7600043b0 0x7fc7780cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:12.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.324+0000 7fc77db52640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc77815dc50 0x7fc77815e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:12.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.324+0000 7fc77db52640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7780c8130 0x7fc7780c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:12.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.325+0000 7fc77db52640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc7780d0120 con 0x7fc7780c8130 2024-09-19T09:19:12.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.325+0000 7fc77db52640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc77815f360 con 0x7fc7600043b0 2024-09-19T09:19:12.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.325+0000 7fc77db52640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc7780b5220 con 0x7fc77815dc50 2024-09-19T09:19:12.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.325+0000 7fc777fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7780c8130 0x7fc7780c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:12.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.325+0000 7fc777fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7780c8130 0x7fc7780c8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33886/0 (socket says 172.21.15.18:33886) 2024-09-19T09:19:12.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.325+0000 7fc777fff640 1 -- 172.21.15.18:0/2759551013 learned_addr learned my addr 172.21.15.18:0/2759551013 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:12.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.325+0000 7fc7777fe640 1 --2- 172.21.15.18:0/2759551013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7600043b0 0x7fc7780cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:12.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.325+0000 7fc776ffd640 1 --2- 172.21.15.18:0/2759551013 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc77815dc50 0x7fc77815e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:12.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.325+0000 7fc777fff640 1 -- 172.21.15.18:0/2759551013 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc77815dc50 msgr2=0x7fc77815e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:12.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.325+0000 7fc777fff640 1 --2- 172.21.15.18:0/2759551013 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc77815dc50 0x7fc77815e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.325+0000 7fc777fff640 1 -- 172.21.15.18:0/2759551013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7600043b0 msgr2=0x7fc7780cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:12.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.325+0000 7fc777fff640 1 --2- 172.21.15.18:0/2759551013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7600043b0 0x7fc7780cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.325+0000 7fc777fff640 1 -- 172.21.15.18:0/2759551013 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7780c75c0 con 0x7fc7780c8130 2024-09-19T09:19:12.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.325+0000 7fc777fff640 1 --2- 172.21.15.18:0/2759551013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7780c8130 0x7fc7780c8590 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fc77806db60 tx=0x7fc77000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:12.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.325+0000 7fc75ffff640 1 -- 172.21.15.18:0/2759551013 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc77000fe10 con 0x7fc7780c8130 2024-09-19T09:19:12.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.325+0000 7fc75ffff640 1 -- 172.21.15.18:0/2759551013 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc77001d070 con 0x7fc7780c8130 2024-09-19T09:19:12.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.325+0000 7fc77db52640 1 -- 172.21.15.18:0/2759551013 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7780c6800 con 0x7fc7780c8130 2024-09-19T09:19:12.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.325+0000 7fc75ffff640 1 -- 172.21.15.18:0/2759551013 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc770015670 con 0x7fc7780c8130 2024-09-19T09:19:12.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.325+0000 7fc77db52640 1 -- 172.21.15.18:0/2759551013 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7780c6dc0 con 0x7fc7780c8130 2024-09-19T09:19:12.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.326+0000 7fc77db52640 1 -- 172.21.15.18:0/2759551013 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7780b5550 con 0x7fc7780c8130 2024-09-19T09:19:12.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.327+0000 7fc75ffff640 1 -- 172.21.15.18:0/2759551013 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc770015810 con 0x7fc7780c8130 2024-09-19T09:19:12.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.328+0000 7fc75ffff640 1 --2- 172.21.15.18:0/2759551013 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc76406c2e0 0x7fc76406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:12.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.328+0000 7fc75ffff640 1 -- 172.21.15.18:0/2759551013 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7fc77008bcd0 con 0x7fc7780c8130 2024-09-19T09:19:12.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.328+0000 7fc7777fe640 1 --2- 172.21.15.18:0/2759551013 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc76406c2e0 0x7fc76406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:12.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.328+0000 7fc7777fe640 1 --2- 172.21.15.18:0/2759551013 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc76406c2e0 0x7fc76406e7a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc778161df0 tx=0x7fc768009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:12.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.332+0000 7fc75ffff640 1 -- 172.21.15.18:0/2759551013 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc770010040 con 0x7fc7780c8130 2024-09-19T09:19:12.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.504+0000 7fc77db52640 1 -- 172.21.15.18:0/2759551013 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc7780c65b0 con 0x7fc76406c2e0 2024-09-19T09:19:12.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.511+0000 7fc75ffff640 1 -- 172.21.15.18:0/2759551013 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247991 (secure 0 0 0) 0x7fc7780c65b0 con 0x7fc76406c2e0 2024-09-19T09:19:12.516 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:12.517 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:19:12.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.514+0000 7fc77db52640 1 -- 172.21.15.18:0/2759551013 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc76406c2e0 msgr2=0x7fc76406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:12.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.514+0000 7fc77db52640 1 --2- 172.21.15.18:0/2759551013 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc76406c2e0 0x7fc76406e7a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fc778161df0 tx=0x7fc768009040 comp rx=0 tx=0).stop 2024-09-19T09:19:12.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.514+0000 7fc77db52640 1 -- 172.21.15.18:0/2759551013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7780c8130 msgr2=0x7fc7780c8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:12.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.514+0000 7fc77db52640 1 --2- 172.21.15.18:0/2759551013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7780c8130 0x7fc7780c8590 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fc77806db60 tx=0x7fc77000f580 comp rx=0 tx=0).stop 2024-09-19T09:19:12.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.514+0000 7fc77db52640 1 -- 172.21.15.18:0/2759551013 shutdown_connections 2024-09-19T09:19:12.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.514+0000 7fc77db52640 1 --2- 172.21.15.18:0/2759551013 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc76406c2e0 0x7fc76406e7a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.514+0000 7fc77db52640 1 --2- 172.21.15.18:0/2759551013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc7780c8130 0x7fc7780c8590 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.514+0000 7fc77db52640 1 --2- 172.21.15.18:0/2759551013 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc77815dc50 0x7fc77815e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.514+0000 7fc77db52640 1 --2- 172.21.15.18:0/2759551013 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc7600043b0 0x7fc7780cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.514+0000 7fc77db52640 1 -- 172.21.15.18:0/2759551013 >> 172.21.15.18:0/2759551013 conn(0x7fc7780b4700 msgr2=0x7fc77815f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:12.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.514+0000 7fc77db52640 1 -- 172.21.15.18:0/2759551013 shutdown_connections 2024-09-19T09:19:12.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.514+0000 7fc77db52640 1 -- 172.21.15.18:0/2759551013 wait complete. 2024-09-19T09:19:12.526 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2024-09-19T09:19:11.607606+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":152,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6439,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556060,"statfs":{"total":1600000000,"available":1593405860,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.429405"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695270+0000","last_change":"2024-09-19T09:19:09.204617+0000","last_active":"2024-09-19T09:19:10.695270+0000","last_peered":"2024-09-19T09:19:10.695270+0000","last_clean":"2024-09-19T09:19:10.695270+0000","last_became_active":"2024-09-19T09:19:09.203023+0000","last_became_peered":"2024-09-19T09:19:09.203023+0000","last_unstale":"2024-09-19T09:19:10.695270+0000","last_undegraded":"2024-09-19T09:19:10.695270+0000","last_fullsized":"2024-09-19T09:19:10.695270+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:50:28.053591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695189+0000","last_change":"2024-09-19T09:19:09.209508+0000","last_active":"2024-09-19T09:19:10.695189+0000","last_peered":"2024-09-19T09:19:10.695189+0000","last_clean":"2024-09-19T09:19:10.695189+0000","last_became_active":"2024-09-19T09:19:09.209213+0000","last_became_peered":"2024-09-19T09:19:09.209213+0000","last_unstale":"2024-09-19T09:19:10.695189+0000","last_undegraded":"2024-09-19T09:19:10.695189+0000","last_fullsized":"2024-09-19T09:19:10.695189+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:36:39.551729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198945+0000","last_change":"2024-09-19T09:19:09.197899+0000","last_active":"2024-09-19T09:19:10.198945+0000","last_peered":"2024-09-19T09:19:10.198945+0000","last_clean":"2024-09-19T09:19:10.198945+0000","last_became_active":"2024-09-19T09:19:09.197396+0000","last_became_peered":"2024-09-19T09:19:09.197396+0000","last_unstale":"2024-09-19T09:19:10.198945+0000","last_undegraded":"2024-09-19T09:19:10.198945+0000","last_fullsized":"2024-09-19T09:19:10.198945+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:19.672714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695219+0000","last_change":"2024-09-19T09:19:09.198716+0000","last_active":"2024-09-19T09:19:10.695219+0000","last_peered":"2024-09-19T09:19:10.695219+0000","last_clean":"2024-09-19T09:19:10.695219+0000","last_became_active":"2024-09-19T09:19:09.197529+0000","last_became_peered":"2024-09-19T09:19:09.197529+0000","last_unstale":"2024-09-19T09:19:10.695219+0000","last_undegraded":"2024-09-19T09:19:10.695219+0000","last_fullsized":"2024-09-19T09:19:10.695219+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:03.073761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790393+0000","last_change":"2024-09-19T09:19:09.203092+0000","last_active":"2024-09-19T09:19:10.790393+0000","last_peered":"2024-09-19T09:19:10.790393+0000","last_clean":"2024-09-19T09:19:10.790393+0000","last_became_active":"2024-09-19T09:19:09.202839+0000","last_became_peered":"2024-09-19T09:19:09.202839+0000","last_unstale":"2024-09-19T09:19:10.790393+0000","last_undegraded":"2024-09-19T09:19:10.790393+0000","last_fullsized":"2024-09-19T09:19:10.790393+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:47.514428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790567+0000","last_change":"2024-09-19T09:19:09.208358+0000","last_active":"2024-09-19T09:19:10.790567+0000","last_peered":"2024-09-19T09:19:10.790567+0000","last_clean":"2024-09-19T09:19:10.790567+0000","last_became_active":"2024-09-19T09:19:09.206958+0000","last_became_peered":"2024-09-19T09:19:09.206958+0000","last_unstale":"2024-09-19T09:19:10.790567+0000","last_undegraded":"2024-09-19T09:19:10.790567+0000","last_fullsized":"2024-09-19T09:19:10.790567+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:04.991102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790566+0000","last_change":"2024-09-19T09:19:09.204007+0000","last_active":"2024-09-19T09:19:10.790566+0000","last_peered":"2024-09-19T09:19:10.790566+0000","last_clean":"2024-09-19T09:19:10.790566+0000","last_became_active":"2024-09-19T09:19:09.203527+0000","last_became_peered":"2024-09-19T09:19:09.203527+0000","last_unstale":"2024-09-19T09:19:10.790566+0000","last_undegraded":"2024-09-19T09:19:10.790566+0000","last_fullsized":"2024-09-19T09:19:10.790566+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:33:56.430420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.199098+0000","last_change":"2024-09-19T09:19:09.197642+0000","last_active":"2024-09-19T09:19:10.199098+0000","last_peered":"2024-09-19T09:19:10.199098+0000","last_clean":"2024-09-19T09:19:10.199098+0000","last_became_active":"2024-09-19T09:19:09.197060+0000","last_became_peered":"2024-09-19T09:19:09.197060+0000","last_unstale":"2024-09-19T09:19:10.199098+0000","last_undegraded":"2024-09-19T09:19:10.199098+0000","last_fullsized":"2024-09-19T09:19:10.199098+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:32.105946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790273+0000","last_change":"2024-09-19T09:19:09.205241+0000","last_active":"2024-09-19T09:19:10.790273+0000","last_peered":"2024-09-19T09:19:10.790273+0000","last_clean":"2024-09-19T09:19:10.790273+0000","last_became_active":"2024-09-19T09:19:09.204969+0000","last_became_peered":"2024-09-19T09:19:09.204969+0000","last_unstale":"2024-09-19T09:19:10.790273+0000","last_undegraded":"2024-09-19T09:19:10.790273+0000","last_fullsized":"2024-09-19T09:19:10.790273+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:43.357050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695455+0000","last_change":"2024-09-19T09:19:09.200236+0000","last_active":"2024-09-19T09:19:10.695455+0000","last_peered":"2024-09-19T09:19:10.695455+0000","last_clean":"2024-09-19T09:19:10.695455+0000","last_became_active":"2024-09-19T09:19:09.200012+0000","last_became_peered":"2024-09-19T09:19:09.200012+0000","last_unstale":"2024-09-19T09:19:10.695455+0000","last_undegraded":"2024-09-19T09:19:10.695455+0000","last_fullsized":"2024-09-19T09:19:10.695455+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:18:41.502146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790679+0000","last_change":"2024-09-19T09:19:09.208133+0000","last_active":"2024-09-19T09:19:10.790679+0000","last_peered":"2024-09-19T09:19:10.790679+0000","last_clean":"2024-09-19T09:19:10.790679+0000","last_became_active":"2024-09-19T09:19:09.206601+0000","last_became_peered":"2024-09-19T09:19:09.206601+0000","last_unstale":"2024-09-19T09:19:10.790679+0000","last_undegraded":"2024-09-19T09:19:10.790679+0000","last_fullsized":"2024-09-19T09:19:10.790679+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:51.233990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.789969+0000","last_change":"2024-09-19T09:19:09.208663+0000","last_active":"2024-09-19T09:19:10.789969+0000","last_peered":"2024-09-19T09:19:10.789969+0000","last_clean":"2024-09-19T09:19:10.789969+0000","last_became_active":"2024-09-19T09:19:09.208028+0000","last_became_peered":"2024-09-19T09:19:09.208028+0000","last_unstale":"2024-09-19T09:19:10.789969+0000","last_undegraded":"2024-09-19T09:19:10.789969+0000","last_fullsized":"2024-09-19T09:19:10.789969+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:17.553294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.789634+0000","last_change":"2024-09-19T09:19:09.201096+0000","last_active":"2024-09-19T09:19:10.789634+0000","last_peered":"2024-09-19T09:19:10.789634+0000","last_clean":"2024-09-19T09:19:10.789634+0000","last_became_active":"2024-09-19T09:19:09.200813+0000","last_became_peered":"2024-09-19T09:19:09.200813+0000","last_unstale":"2024-09-19T09:19:10.789634+0000","last_undegraded":"2024-09-19T09:19:10.789634+0000","last_fullsized":"2024-09-19T09:19:10.789634+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:25.460078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695413+0000","last_change":"2024-09-19T09:19:09.197822+0000","last_active":"2024-09-19T09:19:10.695413+0000","last_peered":"2024-09-19T09:19:10.695413+0000","last_clean":"2024-09-19T09:19:10.695413+0000","last_became_active":"2024-09-19T09:19:09.197127+0000","last_became_peered":"2024-09-19T09:19:09.197127+0000","last_unstale":"2024-09-19T09:19:10.695413+0000","last_undegraded":"2024-09-19T09:19:10.695413+0000","last_fullsized":"2024-09-19T09:19:10.695413+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:09.889311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695516+0000","last_change":"2024-09-19T09:19:09.203119+0000","last_active":"2024-09-19T09:19:10.695516+0000","last_peered":"2024-09-19T09:19:10.695516+0000","last_clean":"2024-09-19T09:19:10.695516+0000","last_became_active":"2024-09-19T09:19:09.202606+0000","last_became_peered":"2024-09-19T09:19:09.202606+0000","last_unstale":"2024-09-19T09:19:10.695516+0000","last_undegraded":"2024-09-19T09:19:10.695516+0000","last_fullsized":"2024-09-19T09:19:10.695516+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:04:29.817258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790751+0000","last_change":"2024-09-19T09:19:09.208890+0000","last_active":"2024-09-19T09:19:10.790751+0000","last_peered":"2024-09-19T09:19:10.790751+0000","last_clean":"2024-09-19T09:19:10.790751+0000","last_became_active":"2024-09-19T09:19:09.207852+0000","last_became_peered":"2024-09-19T09:19:09.207852+0000","last_unstale":"2024-09-19T09:19:10.790751+0000","last_undegraded":"2024-09-19T09:19:10.790751+0000","last_fullsized":"2024-09-19T09:19:10.790751+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:42:01.761738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.289164+0000","last_change":"2024-09-19T09:19:09.193684+0000","last_active":"2024-09-19T09:19:10.289164+0000","last_peered":"2024-09-19T09:19:10.289164+0000","last_clean":"2024-09-19T09:19:10.289164+0000","last_became_active":"2024-09-19T09:19:09.193450+0000","last_became_peered":"2024-09-19T09:19:09.193450+0000","last_unstale":"2024-09-19T09:19:10.289164+0000","last_undegraded":"2024-09-19T09:19:10.289164+0000","last_fullsized":"2024-09-19T09:19:10.289164+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:13:56.936347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695226+0000","last_change":"2024-09-19T09:19:09.201625+0000","last_active":"2024-09-19T09:19:10.695226+0000","last_peered":"2024-09-19T09:19:10.695226+0000","last_clean":"2024-09-19T09:19:10.695226+0000","last_became_active":"2024-09-19T09:19:09.200145+0000","last_became_peered":"2024-09-19T09:19:09.200145+0000","last_unstale":"2024-09-19T09:19:10.695226+0000","last_undegraded":"2024-09-19T09:19:10.695226+0000","last_fullsized":"2024-09-19T09:19:10.695226+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:54:21.147230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.289144+0000","last_change":"2024-09-19T09:19:09.200347+0000","last_active":"2024-09-19T09:19:10.289144+0000","last_peered":"2024-09-19T09:19:10.289144+0000","last_clean":"2024-09-19T09:19:10.289144+0000","last_became_active":"2024-09-19T09:19:09.200031+0000","last_became_peered":"2024-09-19T09:19:09.200031+0000","last_unstale":"2024-09-19T09:19:10.289144+0000","last_undegraded":"2024-09-19T09:19:10.289144+0000","last_fullsized":"2024-09-19T09:19:10.289144+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:58.213752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.789980+0000","last_change":"2024-09-19T09:19:09.202674+0000","last_active":"2024-09-19T09:19:10.789980+0000","last_peered":"2024-09-19T09:19:10.789980+0000","last_clean":"2024-09-19T09:19:10.789980+0000","last_became_active":"2024-09-19T09:19:09.202464+0000","last_became_peered":"2024-09-19T09:19:09.202464+0000","last_unstale":"2024-09-19T09:19:10.789980+0000","last_undegraded":"2024-09-19T09:19:10.789980+0000","last_fullsized":"2024-09-19T09:19:10.789980+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:25.617405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198592+0000","last_change":"2024-09-19T09:19:09.193579+0000","last_active":"2024-09-19T09:19:10.198592+0000","last_peered":"2024-09-19T09:19:10.198592+0000","last_clean":"2024-09-19T09:19:10.198592+0000","last_became_active":"2024-09-19T09:19:09.193018+0000","last_became_peered":"2024-09-19T09:19:09.193018+0000","last_unstale":"2024-09-19T09:19:10.198592+0000","last_undegraded":"2024-09-19T09:19:10.198592+0000","last_fullsized":"2024-09-19T09:19:10.198592+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:27:33.154646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198622+0000","last_change":"2024-09-19T09:19:09.205241+0000","last_active":"2024-09-19T09:19:10.198622+0000","last_peered":"2024-09-19T09:19:10.198622+0000","last_clean":"2024-09-19T09:19:10.198622+0000","last_became_active":"2024-09-19T09:19:09.205007+0000","last_became_peered":"2024-09-19T09:19:09.205007+0000","last_unstale":"2024-09-19T09:19:10.198622+0000","last_undegraded":"2024-09-19T09:19:10.198622+0000","last_fullsized":"2024-09-19T09:19:10.198622+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:02.518629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695368+0000","last_change":"2024-09-19T09:19:09.200510+0000","last_active":"2024-09-19T09:19:10.695368+0000","last_peered":"2024-09-19T09:19:10.695368+0000","last_clean":"2024-09-19T09:19:10.695368+0000","last_became_active":"2024-09-19T09:19:09.199740+0000","last_became_peered":"2024-09-19T09:19:09.199740+0000","last_unstale":"2024-09-19T09:19:10.695368+0000","last_undegraded":"2024-09-19T09:19:10.695368+0000","last_fullsized":"2024-09-19T09:19:10.695368+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:17:00.119554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198251+0000","last_change":"2024-09-19T09:19:09.199804+0000","last_active":"2024-09-19T09:19:10.198251+0000","last_peered":"2024-09-19T09:19:10.198251+0000","last_clean":"2024-09-19T09:19:10.198251+0000","last_became_active":"2024-09-19T09:19:09.199547+0000","last_became_peered":"2024-09-19T09:19:09.199547+0000","last_unstale":"2024-09-19T09:19:10.198251+0000","last_undegraded":"2024-09-19T09:19:10.198251+0000","last_fullsized":"2024-09-19T09:19:10.198251+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:59:49.685146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695374+0000","last_change":"2024-09-19T09:19:09.193201+0000","last_active":"2024-09-19T09:19:10.695374+0000","last_peered":"2024-09-19T09:19:10.695374+0000","last_clean":"2024-09-19T09:19:10.695374+0000","last_became_active":"2024-09-19T09:19:09.192956+0000","last_became_peered":"2024-09-19T09:19:09.192956+0000","last_unstale":"2024-09-19T09:19:10.695374+0000","last_undegraded":"2024-09-19T09:19:10.695374+0000","last_fullsized":"2024-09-19T09:19:10.695374+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:52.242505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.789866+0000","last_change":"2024-09-19T09:19:09.199996+0000","last_active":"2024-09-19T09:19:10.789866+0000","last_peered":"2024-09-19T09:19:10.789866+0000","last_clean":"2024-09-19T09:19:10.789866+0000","last_became_active":"2024-09-19T09:19:09.199734+0000","last_became_peered":"2024-09-19T09:19:09.199734+0000","last_unstale":"2024-09-19T09:19:10.789866+0000","last_undegraded":"2024-09-19T09:19:10.789866+0000","last_fullsized":"2024-09-19T09:19:10.789866+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:47.506591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198543+0000","last_change":"2024-09-19T09:19:09.199655+0000","last_active":"2024-09-19T09:19:10.198543+0000","last_peered":"2024-09-19T09:19:10.198543+0000","last_clean":"2024-09-19T09:19:10.198543+0000","last_became_active":"2024-09-19T09:19:09.199038+0000","last_became_peered":"2024-09-19T09:19:09.199038+0000","last_unstale":"2024-09-19T09:19:10.198543+0000","last_undegraded":"2024-09-19T09:19:10.198543+0000","last_fullsized":"2024-09-19T09:19:10.198543+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:36.496432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198348+0000","last_change":"2024-09-19T09:19:09.198639+0000","last_active":"2024-09-19T09:19:10.198348+0000","last_peered":"2024-09-19T09:19:10.198348+0000","last_clean":"2024-09-19T09:19:10.198348+0000","last_became_active":"2024-09-19T09:19:09.197904+0000","last_became_peered":"2024-09-19T09:19:09.197904+0000","last_unstale":"2024-09-19T09:19:10.198348+0000","last_undegraded":"2024-09-19T09:19:10.198348+0000","last_fullsized":"2024-09-19T09:19:10.198348+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:08.583135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.789586+0000","last_change":"2024-09-19T09:19:09.195461+0000","last_active":"2024-09-19T09:19:10.789586+0000","last_peered":"2024-09-19T09:19:10.789586+0000","last_clean":"2024-09-19T09:19:10.789586+0000","last_became_active":"2024-09-19T09:19:09.195185+0000","last_became_peered":"2024-09-19T09:19:09.195185+0000","last_unstale":"2024-09-19T09:19:10.789586+0000","last_undegraded":"2024-09-19T09:19:10.789586+0000","last_fullsized":"2024-09-19T09:19:10.789586+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:20:53.158069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.789727+0000","last_change":"2024-09-19T09:19:09.194624+0000","last_active":"2024-09-19T09:19:10.789727+0000","last_peered":"2024-09-19T09:19:10.789727+0000","last_clean":"2024-09-19T09:19:10.789727+0000","last_became_active":"2024-09-19T09:19:09.194350+0000","last_became_peered":"2024-09-19T09:19:09.194350+0000","last_unstale":"2024-09-19T09:19:10.789727+0000","last_undegraded":"2024-09-19T09:19:10.789727+0000","last_fullsized":"2024-09-19T09:19:10.789727+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:15:28.793571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198742+0000","last_change":"2024-09-19T09:19:09.193860+0000","last_active":"2024-09-19T09:19:10.198742+0000","last_peered":"2024-09-19T09:19:10.198742+0000","last_clean":"2024-09-19T09:19:10.198742+0000","last_became_active":"2024-09-19T09:19:09.193346+0000","last_became_peered":"2024-09-19T09:19:09.193346+0000","last_unstale":"2024-09-19T09:19:10.198742+0000","last_undegraded":"2024-09-19T09:19:10.198742+0000","last_fullsized":"2024-09-19T09:19:10.198742+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:10.791364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695670+0000","last_change":"2024-09-19T09:19:09.201021+0000","last_active":"2024-09-19T09:19:10.695670+0000","last_peered":"2024-09-19T09:19:10.695670+0000","last_clean":"2024-09-19T09:19:10.695670+0000","last_became_active":"2024-09-19T09:19:09.199990+0000","last_became_peered":"2024-09-19T09:19:09.199990+0000","last_unstale":"2024-09-19T09:19:10.695670+0000","last_undegraded":"2024-09-19T09:19:10.695670+0000","last_fullsized":"2024-09-19T09:19:10.695670+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:26:28.135363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.289305+0000","last_change":"2024-09-19T09:19:09.205571+0000","last_active":"2024-09-19T09:19:10.289305+0000","last_peered":"2024-09-19T09:19:10.289305+0000","last_clean":"2024-09-19T09:19:10.289305+0000","last_became_active":"2024-09-19T09:19:09.203851+0000","last_became_peered":"2024-09-19T09:19:09.203851+0000","last_unstale":"2024-09-19T09:19:10.289305+0000","last_undegraded":"2024-09-19T09:19:10.289305+0000","last_fullsized":"2024-09-19T09:19:10.289305+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:51.989174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"122'4","reported_seq":18,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.789850+0000","last_change":"2024-09-19T09:19:08.197331+0000","last_active":"2024-09-19T09:19:10.789850+0000","last_peered":"2024-09-19T09:19:10.789850+0000","last_clean":"2024-09-19T09:19:10.789850+0000","last_became_active":"2024-09-19T09:19:08.197094+0000","last_became_peered":"2024-09-19T09:19:08.197094+0000","last_unstale":"2024-09-19T09:19:10.789850+0000","last_undegraded":"2024-09-19T09:19:10.789850+0000","last_fullsized":"2024-09-19T09:19:10.789850+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:45:44.232246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.789738+0000","last_change":"2024-09-19T09:19:09.196726+0000","last_active":"2024-09-19T09:19:10.789738+0000","last_peered":"2024-09-19T09:19:10.789738+0000","last_clean":"2024-09-19T09:19:10.789738+0000","last_became_active":"2024-09-19T09:19:09.195912+0000","last_became_peered":"2024-09-19T09:19:09.195912+0000","last_unstale":"2024-09-19T09:19:10.789738+0000","last_undegraded":"2024-09-19T09:19:10.789738+0000","last_fullsized":"2024-09-19T09:19:10.789738+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:10:34.217377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1e","version":"122'1","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790506+0000","last_change":"2024-09-19T09:19:08.198191+0000","last_active":"2024-09-19T09:19:10.790506+0000","last_peered":"2024-09-19T09:19:10.790506+0000","last_clean":"2024-09-19T09:19:10.790506+0000","last_became_active":"2024-09-19T09:19:08.197916+0000","last_became_peered":"2024-09-19T09:19:08.197916+0000","last_unstale":"2024-09-19T09:19:10.790506+0000","last_undegraded":"2024-09-19T09:19:10.790506+0000","last_fullsized":"2024-09-19T09:19:10.790506+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:56:16.605118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695463+0000","last_change":"2024-09-19T09:19:09.199835+0000","last_active":"2024-09-19T09:19:10.695463+0000","last_peered":"2024-09-19T09:19:10.695463+0000","last_clean":"2024-09-19T09:19:10.695463+0000","last_became_active":"2024-09-19T09:19:09.199511+0000","last_became_peered":"2024-09-19T09:19:09.199511+0000","last_unstale":"2024-09-19T09:19:10.695463+0000","last_undegraded":"2024-09-19T09:19:10.695463+0000","last_fullsized":"2024-09-19T09:19:10.695463+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:08.601114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"122'2","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.199115+0000","last_change":"2024-09-19T09:19:08.200706+0000","last_active":"2024-09-19T09:19:10.199115+0000","last_peered":"2024-09-19T09:19:10.199115+0000","last_clean":"2024-09-19T09:19:10.199115+0000","last_became_active":"2024-09-19T09:19:08.200454+0000","last_became_peered":"2024-09-19T09:19:08.200454+0000","last_unstale":"2024-09-19T09:19:10.199115+0000","last_undegraded":"2024-09-19T09:19:10.199115+0000","last_fullsized":"2024-09-19T09:19:10.199115+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:30:24.617992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695531+0000","last_change":"2024-09-19T09:19:09.193953+0000","last_active":"2024-09-19T09:19:10.695531+0000","last_peered":"2024-09-19T09:19:10.695531+0000","last_clean":"2024-09-19T09:19:10.695531+0000","last_became_active":"2024-09-19T09:19:09.193694+0000","last_became_peered":"2024-09-19T09:19:09.193694+0000","last_unstale":"2024-09-19T09:19:10.695531+0000","last_undegraded":"2024-09-19T09:19:10.695531+0000","last_fullsized":"2024-09-19T09:19:10.695531+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:30.187832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"122'2","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695905+0000","last_change":"2024-09-19T09:19:08.201043+0000","last_active":"2024-09-19T09:19:10.695905+0000","last_peered":"2024-09-19T09:19:10.695905+0000","last_clean":"2024-09-19T09:19:10.695905+0000","last_became_active":"2024-09-19T09:19:08.200503+0000","last_became_peered":"2024-09-19T09:19:08.200503+0000","last_unstale":"2024-09-19T09:19:10.695905+0000","last_undegraded":"2024-09-19T09:19:10.695905+0000","last_fullsized":"2024-09-19T09:19:10.695905+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:09:10.714431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.789934+0000","last_change":"2024-09-19T09:19:09.205101+0000","last_active":"2024-09-19T09:19:10.789934+0000","last_peered":"2024-09-19T09:19:10.789934+0000","last_clean":"2024-09-19T09:19:10.789934+0000","last_became_active":"2024-09-19T09:19:09.203358+0000","last_became_peered":"2024-09-19T09:19:09.203358+0000","last_unstale":"2024-09-19T09:19:10.789934+0000","last_undegraded":"2024-09-19T09:19:10.789934+0000","last_fullsized":"2024-09-19T09:19:10.789934+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:39:24.202404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"122'1","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695765+0000","last_change":"2024-09-19T09:19:08.199544+0000","last_active":"2024-09-19T09:19:10.695765+0000","last_peered":"2024-09-19T09:19:10.695765+0000","last_clean":"2024-09-19T09:19:10.695765+0000","last_became_active":"2024-09-19T09:19:08.199124+0000","last_became_peered":"2024-09-19T09:19:08.199124+0000","last_unstale":"2024-09-19T09:19:10.695765+0000","last_undegraded":"2024-09-19T09:19:10.695765+0000","last_fullsized":"2024-09-19T09:19:10.695765+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:19.053414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790345+0000","last_change":"2024-09-19T09:19:09.204779+0000","last_active":"2024-09-19T09:19:10.790345+0000","last_peered":"2024-09-19T09:19:10.790345+0000","last_clean":"2024-09-19T09:19:10.790345+0000","last_became_active":"2024-09-19T09:19:09.204536+0000","last_became_peered":"2024-09-19T09:19:09.204536+0000","last_unstale":"2024-09-19T09:19:10.790345+0000","last_undegraded":"2024-09-19T09:19:10.790345+0000","last_fullsized":"2024-09-19T09:19:10.790345+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:55.858928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"122'1","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.199268+0000","last_change":"2024-09-19T09:19:08.197336+0000","last_active":"2024-09-19T09:19:10.199268+0000","last_peered":"2024-09-19T09:19:10.199268+0000","last_clean":"2024-09-19T09:19:10.199268+0000","last_became_active":"2024-09-19T09:19:08.196742+0000","last_became_peered":"2024-09-19T09:19:08.196742+0000","last_unstale":"2024-09-19T09:19:10.199268+0000","last_undegraded":"2024-09-19T09:19:10.199268+0000","last_fullsized":"2024-09-19T09:19:10.199268+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:09.027939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.789827+0000","last_change":"2024-09-19T09:19:09.199474+0000","last_active":"2024-09-19T09:19:10.789827+0000","last_peered":"2024-09-19T09:19:10.789827+0000","last_clean":"2024-09-19T09:19:10.789827+0000","last_became_active":"2024-09-19T09:19:09.199223+0000","last_became_peered":"2024-09-19T09:19:09.199223+0000","last_unstale":"2024-09-19T09:19:10.789827+0000","last_undegraded":"2024-09-19T09:19:10.789827+0000","last_fullsized":"2024-09-19T09:19:10.789827+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:28:18.730711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790643+0000","last_change":"2024-09-19T09:19:08.191461+0000","last_active":"2024-09-19T09:19:10.790643+0000","last_peered":"2024-09-19T09:19:10.790643+0000","last_clean":"2024-09-19T09:19:10.790643+0000","last_became_active":"2024-09-19T09:19:08.191211+0000","last_became_peered":"2024-09-19T09:19:08.191211+0000","last_unstale":"2024-09-19T09:19:10.790643+0000","last_undegraded":"2024-09-19T09:19:10.790643+0000","last_fullsized":"2024-09-19T09:19:10.790643+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:12:20.014353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.789702+0000","last_change":"2024-09-19T09:19:09.206980+0000","last_active":"2024-09-19T09:19:10.789702+0000","last_peered":"2024-09-19T09:19:10.789702+0000","last_clean":"2024-09-19T09:19:10.789702+0000","last_became_active":"2024-09-19T09:19:09.206250+0000","last_became_peered":"2024-09-19T09:19:09.206250+0000","last_unstale":"2024-09-19T09:19:10.789702+0000","last_undegraded":"2024-09-19T09:19:10.789702+0000","last_fullsized":"2024-09-19T09:19:10.789702+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:24.745319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.289368+0000","last_change":"2024-09-19T09:19:08.202664+0000","last_active":"2024-09-19T09:19:10.289368+0000","last_peered":"2024-09-19T09:19:10.289368+0000","last_clean":"2024-09-19T09:19:10.289368+0000","last_became_active":"2024-09-19T09:19:08.202418+0000","last_became_peered":"2024-09-19T09:19:08.202418+0000","last_unstale":"2024-09-19T09:19:10.289368+0000","last_undegraded":"2024-09-19T09:19:10.289368+0000","last_fullsized":"2024-09-19T09:19:10.289368+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:55:49.361079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695412+0000","last_change":"2024-09-19T09:19:09.204062+0000","last_active":"2024-09-19T09:19:10.695412+0000","last_peered":"2024-09-19T09:19:10.695412+0000","last_clean":"2024-09-19T09:19:10.695412+0000","last_became_active":"2024-09-19T09:19:09.200289+0000","last_became_peered":"2024-09-19T09:19:09.200289+0000","last_unstale":"2024-09-19T09:19:10.695412+0000","last_undegraded":"2024-09-19T09:19:10.695412+0000","last_fullsized":"2024-09-19T09:19:10.695412+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:11:59.945583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198922+0000","last_change":"2024-09-19T09:19:08.192304+0000","last_active":"2024-09-19T09:19:10.198922+0000","last_peered":"2024-09-19T09:19:10.198922+0000","last_clean":"2024-09-19T09:19:10.198922+0000","last_became_active":"2024-09-19T09:19:08.191977+0000","last_became_peered":"2024-09-19T09:19:08.191977+0000","last_unstale":"2024-09-19T09:19:10.198922+0000","last_undegraded":"2024-09-19T09:19:10.198922+0000","last_fullsized":"2024-09-19T09:19:10.198922+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:32.206704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198338+0000","last_change":"2024-09-19T09:19:09.193688+0000","last_active":"2024-09-19T09:19:10.198338+0000","last_peered":"2024-09-19T09:19:10.198338+0000","last_clean":"2024-09-19T09:19:10.198338+0000","last_became_active":"2024-09-19T09:19:09.193396+0000","last_became_peered":"2024-09-19T09:19:09.193396+0000","last_unstale":"2024-09-19T09:19:10.198338+0000","last_undegraded":"2024-09-19T09:19:10.198338+0000","last_fullsized":"2024-09-19T09:19:10.198338+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:51:24.777311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695899+0000","last_change":"2024-09-19T09:19:08.200390+0000","last_active":"2024-09-19T09:19:10.695899+0000","last_peered":"2024-09-19T09:19:10.695899+0000","last_clean":"2024-09-19T09:19:10.695899+0000","last_became_active":"2024-09-19T09:19:08.200129+0000","last_became_peered":"2024-09-19T09:19:08.200129+0000","last_unstale":"2024-09-19T09:19:10.695899+0000","last_undegraded":"2024-09-19T09:19:10.695899+0000","last_fullsized":"2024-09-19T09:19:10.695899+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:02.737300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790409+0000","last_change":"2024-09-19T09:19:09.202422+0000","last_active":"2024-09-19T09:19:10.790409+0000","last_peered":"2024-09-19T09:19:10.790409+0000","last_clean":"2024-09-19T09:19:10.790409+0000","last_became_active":"2024-09-19T09:19:09.202194+0000","last_became_peered":"2024-09-19T09:19:09.202194+0000","last_unstale":"2024-09-19T09:19:10.790409+0000","last_undegraded":"2024-09-19T09:19:10.790409+0000","last_fullsized":"2024-09-19T09:19:10.790409+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:02.465966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"122'3","reported_seq":17,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790275+0000","last_change":"2024-09-19T09:19:08.194846+0000","last_active":"2024-09-19T09:19:10.790275+0000","last_peered":"2024-09-19T09:19:10.790275+0000","last_clean":"2024-09-19T09:19:10.790275+0000","last_became_active":"2024-09-19T09:19:08.194616+0000","last_became_peered":"2024-09-19T09:19:08.194616+0000","last_unstale":"2024-09-19T09:19:10.790275+0000","last_undegraded":"2024-09-19T09:19:10.790275+0000","last_fullsized":"2024-09-19T09:19:10.790275+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:20:41.845372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198489+0000","last_change":"2024-09-19T09:19:09.198844+0000","last_active":"2024-09-19T09:19:10.198489+0000","last_peered":"2024-09-19T09:19:10.198489+0000","last_clean":"2024-09-19T09:19:10.198489+0000","last_became_active":"2024-09-19T09:19:09.198244+0000","last_became_peered":"2024-09-19T09:19:09.198244+0000","last_unstale":"2024-09-19T09:19:10.198489+0000","last_undegraded":"2024-09-19T09:19:10.198489+0000","last_fullsized":"2024-09-19T09:19:10.198489+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:27.685297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"122'6","reported_seq":20,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.789918+0000","last_change":"2024-09-19T09:19:08.199164+0000","last_active":"2024-09-19T09:19:10.789918+0000","last_peered":"2024-09-19T09:19:10.789918+0000","last_clean":"2024-09-19T09:19:10.789918+0000","last_became_active":"2024-09-19T09:19:08.198690+0000","last_became_peered":"2024-09-19T09:19:08.198690+0000","last_unstale":"2024-09-19T09:19:10.789918+0000","last_undegraded":"2024-09-19T09:19:10.789918+0000","last_fullsized":"2024-09-19T09:19:10.789918+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:29.132429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695640+0000","last_change":"2024-09-19T09:19:09.203751+0000","last_active":"2024-09-19T09:19:10.695640+0000","last_peered":"2024-09-19T09:19:10.695640+0000","last_clean":"2024-09-19T09:19:10.695640+0000","last_became_active":"2024-09-19T09:19:09.202690+0000","last_became_peered":"2024-09-19T09:19:09.202690+0000","last_unstale":"2024-09-19T09:19:10.695640+0000","last_undegraded":"2024-09-19T09:19:10.695640+0000","last_fullsized":"2024-09-19T09:19:10.695640+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:27:15.153509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"122'2","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.289475+0000","last_change":"2024-09-19T09:19:08.196619+0000","last_active":"2024-09-19T09:19:10.289475+0000","last_peered":"2024-09-19T09:19:10.289475+0000","last_clean":"2024-09-19T09:19:10.289475+0000","last_became_active":"2024-09-19T09:19:08.196189+0000","last_became_peered":"2024-09-19T09:19:08.196189+0000","last_unstale":"2024-09-19T09:19:10.289475+0000","last_undegraded":"2024-09-19T09:19:10.289475+0000","last_fullsized":"2024-09-19T09:19:10.289475+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:19.553314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198651+0000","last_change":"2024-09-19T09:19:09.190770+0000","last_active":"2024-09-19T09:19:10.198651+0000","last_peered":"2024-09-19T09:19:10.198651+0000","last_clean":"2024-09-19T09:19:10.198651+0000","last_became_active":"2024-09-19T09:19:09.190107+0000","last_became_peered":"2024-09-19T09:19:09.190107+0000","last_unstale":"2024-09-19T09:19:10.198651+0000","last_undegraded":"2024-09-19T09:19:10.198651+0000","last_fullsized":"2024-09-19T09:19:10.198651+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:22:27.260772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695979+0000","last_change":"2024-09-19T09:19:08.198205+0000","last_active":"2024-09-19T09:19:10.695979+0000","last_peered":"2024-09-19T09:19:10.695979+0000","last_clean":"2024-09-19T09:19:10.695979+0000","last_became_active":"2024-09-19T09:19:08.197804+0000","last_became_peered":"2024-09-19T09:19:08.197804+0000","last_unstale":"2024-09-19T09:19:10.695979+0000","last_undegraded":"2024-09-19T09:19:10.695979+0000","last_fullsized":"2024-09-19T09:19:10.695979+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:57.102358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790170+0000","last_change":"2024-09-19T09:19:09.204793+0000","last_active":"2024-09-19T09:19:10.790170+0000","last_peered":"2024-09-19T09:19:10.790170+0000","last_clean":"2024-09-19T09:19:10.790170+0000","last_became_active":"2024-09-19T09:19:09.204209+0000","last_became_peered":"2024-09-19T09:19:09.204209+0000","last_unstale":"2024-09-19T09:19:10.790170+0000","last_undegraded":"2024-09-19T09:19:10.790170+0000","last_fullsized":"2024-09-19T09:19:10.790170+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:31.848975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790068+0000","last_change":"2024-09-19T09:19:08.196981+0000","last_active":"2024-09-19T09:19:10.790068+0000","last_peered":"2024-09-19T09:19:10.790068+0000","last_clean":"2024-09-19T09:19:10.790068+0000","last_became_active":"2024-09-19T09:19:08.196702+0000","last_became_peered":"2024-09-19T09:19:08.196702+0000","last_unstale":"2024-09-19T09:19:10.790068+0000","last_undegraded":"2024-09-19T09:19:10.790068+0000","last_fullsized":"2024-09-19T09:19:10.790068+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:14.176599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198804+0000","last_change":"2024-09-19T09:19:09.200422+0000","last_active":"2024-09-19T09:19:10.198804+0000","last_peered":"2024-09-19T09:19:10.198804+0000","last_clean":"2024-09-19T09:19:10.198804+0000","last_became_active":"2024-09-19T09:19:09.200147+0000","last_became_peered":"2024-09-19T09:19:09.200147+0000","last_unstale":"2024-09-19T09:19:10.198804+0000","last_undegraded":"2024-09-19T09:19:10.198804+0000","last_fullsized":"2024-09-19T09:19:10.198804+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:33.334827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.10","version":"122'8","reported_seq":22,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695458+0000","last_change":"2024-09-19T09:19:08.200598+0000","last_active":"2024-09-19T09:19:10.695458+0000","last_peered":"2024-09-19T09:19:10.695458+0000","last_clean":"2024-09-19T09:19:10.695458+0000","last_became_active":"2024-09-19T09:19:08.199681+0000","last_became_peered":"2024-09-19T09:19:08.199681+0000","last_unstale":"2024-09-19T09:19:10.695458+0000","last_undegraded":"2024-09-19T09:19:10.695458+0000","last_fullsized":"2024-09-19T09:19:10.695458+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:02:36.119734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198405+0000","last_change":"2024-09-19T09:19:09.201431+0000","last_active":"2024-09-19T09:19:10.198405+0000","last_peered":"2024-09-19T09:19:10.198405+0000","last_clean":"2024-09-19T09:19:10.198405+0000","last_became_active":"2024-09-19T09:19:09.201165+0000","last_became_peered":"2024-09-19T09:19:09.201165+0000","last_unstale":"2024-09-19T09:19:10.198405+0000","last_undegraded":"2024-09-19T09:19:10.198405+0000","last_fullsized":"2024-09-19T09:19:10.198405+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:48.046865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"122'2","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790101+0000","last_change":"2024-09-19T09:19:08.199849+0000","last_active":"2024-09-19T09:19:10.790101+0000","last_peered":"2024-09-19T09:19:10.790101+0000","last_clean":"2024-09-19T09:19:10.790101+0000","last_became_active":"2024-09-19T09:19:08.199693+0000","last_became_peered":"2024-09-19T09:19:08.199693+0000","last_unstale":"2024-09-19T09:19:10.790101+0000","last_undegraded":"2024-09-19T09:19:10.790101+0000","last_fullsized":"2024-09-19T09:19:10.790101+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:05:22.085021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198620+0000","last_change":"2024-09-19T09:19:09.196296+0000","last_active":"2024-09-19T09:19:10.198620+0000","last_peered":"2024-09-19T09:19:10.198620+0000","last_clean":"2024-09-19T09:19:10.198620+0000","last_became_active":"2024-09-19T09:19:09.195963+0000","last_became_peered":"2024-09-19T09:19:09.195963+0000","last_unstale":"2024-09-19T09:19:10.198620+0000","last_undegraded":"2024-09-19T09:19:10.198620+0000","last_fullsized":"2024-09-19T09:19:10.198620+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:47.642720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"122'1","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790920+0000","last_change":"2024-09-19T09:19:08.192682+0000","last_active":"2024-09-19T09:19:10.790920+0000","last_peered":"2024-09-19T09:19:10.790920+0000","last_clean":"2024-09-19T09:19:10.790920+0000","last_became_active":"2024-09-19T09:19:08.192497+0000","last_became_peered":"2024-09-19T09:19:08.192497+0000","last_unstale":"2024-09-19T09:19:10.790920+0000","last_undegraded":"2024-09-19T09:19:10.790920+0000","last_fullsized":"2024-09-19T09:19:10.790920+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:31:27.163201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.789928+0000","last_change":"2024-09-19T09:19:09.204664+0000","last_active":"2024-09-19T09:19:10.789928+0000","last_peered":"2024-09-19T09:19:10.789928+0000","last_clean":"2024-09-19T09:19:10.789928+0000","last_became_active":"2024-09-19T09:19:09.204415+0000","last_became_peered":"2024-09-19T09:19:09.204415+0000","last_unstale":"2024-09-19T09:19:10.789928+0000","last_undegraded":"2024-09-19T09:19:10.789928+0000","last_fullsized":"2024-09-19T09:19:10.789928+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:11:15.238668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.289643+0000","last_change":"2024-09-19T09:19:08.193561+0000","last_active":"2024-09-19T09:19:10.289643+0000","last_peered":"2024-09-19T09:19:10.289643+0000","last_clean":"2024-09-19T09:19:10.289643+0000","last_became_active":"2024-09-19T09:19:08.192830+0000","last_became_peered":"2024-09-19T09:19:08.192830+0000","last_unstale":"2024-09-19T09:19:10.289643+0000","last_undegraded":"2024-09-19T09:19:10.289643+0000","last_fullsized":"2024-09-19T09:19:10.289643+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:11:26.948293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.289439+0000","last_change":"2024-09-19T09:19:09.190010+0000","last_active":"2024-09-19T09:19:10.289439+0000","last_peered":"2024-09-19T09:19:10.289439+0000","last_clean":"2024-09-19T09:19:10.289439+0000","last_became_active":"2024-09-19T09:19:09.189740+0000","last_became_peered":"2024-09-19T09:19:09.189740+0000","last_unstale":"2024-09-19T09:19:10.289439+0000","last_undegraded":"2024-09-19T09:19:10.289439+0000","last_fullsized":"2024-09-19T09:19:10.289439+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:15:44.172854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"122'2","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695535+0000","last_change":"2024-09-19T09:19:08.200148+0000","last_active":"2024-09-19T09:19:10.695535+0000","last_peered":"2024-09-19T09:19:10.695535+0000","last_clean":"2024-09-19T09:19:10.695535+0000","last_became_active":"2024-09-19T09:19:08.195248+0000","last_became_peered":"2024-09-19T09:19:08.195248+0000","last_unstale":"2024-09-19T09:19:10.695535+0000","last_undegraded":"2024-09-19T09:19:10.695535+0000","last_fullsized":"2024-09-19T09:19:10.695535+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:20.462827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.289051+0000","last_change":"2024-09-19T09:19:09.191074+0000","last_active":"2024-09-19T09:19:10.289051+0000","last_peered":"2024-09-19T09:19:10.289051+0000","last_clean":"2024-09-19T09:19:10.289051+0000","last_became_active":"2024-09-19T09:19:09.190542+0000","last_became_peered":"2024-09-19T09:19:09.190542+0000","last_unstale":"2024-09-19T09:19:10.289051+0000","last_undegraded":"2024-09-19T09:19:10.289051+0000","last_fullsized":"2024-09-19T09:19:10.289051+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:11:38.209929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198503+0000","last_change":"2024-09-19T09:19:08.196860+0000","last_active":"2024-09-19T09:19:10.198503+0000","last_peered":"2024-09-19T09:19:10.198503+0000","last_clean":"2024-09-19T09:19:10.198503+0000","last_became_active":"2024-09-19T09:19:08.195837+0000","last_became_peered":"2024-09-19T09:19:08.195837+0000","last_unstale":"2024-09-19T09:19:10.198503+0000","last_undegraded":"2024-09-19T09:19:10.198503+0000","last_fullsized":"2024-09-19T09:19:10.198503+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:53:25.907641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695789+0000","last_change":"2024-09-19T09:19:09.197899+0000","last_active":"2024-09-19T09:19:10.695789+0000","last_peered":"2024-09-19T09:19:10.695789+0000","last_clean":"2024-09-19T09:19:10.695789+0000","last_became_active":"2024-09-19T09:19:09.197604+0000","last_became_peered":"2024-09-19T09:19:09.197604+0000","last_unstale":"2024-09-19T09:19:10.695789+0000","last_undegraded":"2024-09-19T09:19:10.695789+0000","last_fullsized":"2024-09-19T09:19:10.695789+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:37:30.674155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.695583+0000","last_change":"2024-09-19T09:19:08.194768+0000","last_active":"2024-09-19T09:19:10.695583+0000","last_peered":"2024-09-19T09:19:10.695583+0000","last_clean":"2024-09-19T09:19:10.695583+0000","last_became_active":"2024-09-19T09:19:08.194530+0000","last_became_peered":"2024-09-19T09:19:08.194530+0000","last_unstale":"2024-09-19T09:19:10.695583+0000","last_undegraded":"2024-09-19T09:19:10.695583+0000","last_fullsized":"2024-09-19T09:19:10.695583+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:20.525839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198287+0000","last_change":"2024-09-19T09:19:09.195493+0000","last_active":"2024-09-19T09:19:10.198287+0000","last_peered":"2024-09-19T09:19:10.198287+0000","last_clean":"2024-09-19T09:19:10.198287+0000","last_became_active":"2024-09-19T09:19:09.195243+0000","last_became_peered":"2024-09-19T09:19:09.195243+0000","last_unstale":"2024-09-19T09:19:10.198287+0000","last_undegraded":"2024-09-19T09:19:10.198287+0000","last_fullsized":"2024-09-19T09:19:10.198287+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:54:43.778180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.199016+0000","last_change":"2024-09-19T09:19:08.198114+0000","last_active":"2024-09-19T09:19:10.199016+0000","last_peered":"2024-09-19T09:19:10.199016+0000","last_clean":"2024-09-19T09:19:10.199016+0000","last_became_active":"2024-09-19T09:19:08.197735+0000","last_became_peered":"2024-09-19T09:19:08.197735+0000","last_unstale":"2024-09-19T09:19:10.199016+0000","last_undegraded":"2024-09-19T09:19:10.199016+0000","last_fullsized":"2024-09-19T09:19:10.199016+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:09.941144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.289228+0000","last_change":"2024-09-19T09:19:09.191755+0000","last_active":"2024-09-19T09:19:10.289228+0000","last_peered":"2024-09-19T09:19:10.289228+0000","last_clean":"2024-09-19T09:19:10.289228+0000","last_became_active":"2024-09-19T09:19:09.191478+0000","last_became_peered":"2024-09-19T09:19:09.191478+0000","last_unstale":"2024-09-19T09:19:10.289228+0000","last_undegraded":"2024-09-19T09:19:10.289228+0000","last_fullsized":"2024-09-19T09:19:10.289228+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:43.761511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"122'2","reported_seq":16,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790159+0000","last_change":"2024-09-19T09:19:08.194319+0000","last_active":"2024-09-19T09:19:10.790159+0000","last_peered":"2024-09-19T09:19:10.790159+0000","last_clean":"2024-09-19T09:19:10.790159+0000","last_became_active":"2024-09-19T09:19:08.193986+0000","last_became_peered":"2024-09-19T09:19:08.193986+0000","last_unstale":"2024-09-19T09:19:10.790159+0000","last_undegraded":"2024-09-19T09:19:10.790159+0000","last_fullsized":"2024-09-19T09:19:10.790159+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:13.327435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.289437+0000","last_change":"2024-09-19T09:19:09.198664+0000","last_active":"2024-09-19T09:19:10.289437+0000","last_peered":"2024-09-19T09:19:10.289437+0000","last_clean":"2024-09-19T09:19:10.289437+0000","last_became_active":"2024-09-19T09:19:09.198467+0000","last_became_peered":"2024-09-19T09:19:09.198467+0000","last_unstale":"2024-09-19T09:19:10.289437+0000","last_undegraded":"2024-09-19T09:19:10.289437+0000","last_fullsized":"2024-09-19T09:19:10.289437+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:05:05.621146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"123'1","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:11.189641+0000","last_change":"2024-09-19T09:19:08.195081+0000","last_active":"2024-09-19T09:19:11.189641+0000","last_peered":"2024-09-19T09:19:11.189641+0000","last_clean":"2024-09-19T09:19:11.189641+0000","last_became_active":"2024-09-19T09:19:08.193627+0000","last_became_peered":"2024-09-19T09:19:08.193627+0000","last_unstale":"2024-09-19T09:19:11.189641+0000","last_undegraded":"2024-09-19T09:19:11.189641+0000","last_fullsized":"2024-09-19T09:19:11.189641+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:57.812077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198954+0000","last_change":"2024-09-19T09:19:09.198503+0000","last_active":"2024-09-19T09:19:10.198954+0000","last_peered":"2024-09-19T09:19:10.198954+0000","last_clean":"2024-09-19T09:19:10.198954+0000","last_became_active":"2024-09-19T09:19:09.197706+0000","last_became_peered":"2024-09-19T09:19:09.197706+0000","last_unstale":"2024-09-19T09:19:10.198954+0000","last_undegraded":"2024-09-19T09:19:10.198954+0000","last_fullsized":"2024-09-19T09:19:10.198954+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:25.446337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.289617+0000","last_change":"2024-09-19T09:19:08.196460+0000","last_active":"2024-09-19T09:19:10.289617+0000","last_peered":"2024-09-19T09:19:10.289617+0000","last_clean":"2024-09-19T09:19:10.289617+0000","last_became_active":"2024-09-19T09:19:08.196205+0000","last_became_peered":"2024-09-19T09:19:08.196205+0000","last_unstale":"2024-09-19T09:19:10.289617+0000","last_undegraded":"2024-09-19T09:19:10.289617+0000","last_fullsized":"2024-09-19T09:19:10.289617+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:21:14.316937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790591+0000","last_change":"2024-09-19T09:19:09.196200+0000","last_active":"2024-09-19T09:19:10.790591+0000","last_peered":"2024-09-19T09:19:10.790591+0000","last_clean":"2024-09-19T09:19:10.790591+0000","last_became_active":"2024-09-19T09:19:09.195950+0000","last_became_peered":"2024-09-19T09:19:09.195950+0000","last_unstale":"2024-09-19T09:19:10.790591+0000","last_undegraded":"2024-09-19T09:19:10.790591+0000","last_fullsized":"2024-09-19T09:19:10.790591+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:43:48.272431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198386+0000","last_change":"2024-09-19T09:19:08.196100+0000","last_active":"2024-09-19T09:19:10.198386+0000","last_peered":"2024-09-19T09:19:10.198386+0000","last_clean":"2024-09-19T09:19:10.198386+0000","last_became_active":"2024-09-19T09:19:08.195801+0000","last_became_peered":"2024-09-19T09:19:08.195801+0000","last_unstale":"2024-09-19T09:19:10.198386+0000","last_undegraded":"2024-09-19T09:19:10.198386+0000","last_fullsized":"2024-09-19T09:19:10.198386+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:28:14.939951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.289577+0000","last_change":"2024-09-19T09:19:09.199790+0000","last_active":"2024-09-19T09:19:10.289577+0000","last_peered":"2024-09-19T09:19:10.289577+0000","last_clean":"2024-09-19T09:19:10.289577+0000","last_became_active":"2024-09-19T09:19:09.199550+0000","last_became_peered":"2024-09-19T09:19:09.199550+0000","last_unstale":"2024-09-19T09:19:10.289577+0000","last_undegraded":"2024-09-19T09:19:10.289577+0000","last_fullsized":"2024-09-19T09:19:10.289577+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:48.365431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.199110+0000","last_change":"2024-09-19T09:19:08.201693+0000","last_active":"2024-09-19T09:19:10.199110+0000","last_peered":"2024-09-19T09:19:10.199110+0000","last_clean":"2024-09-19T09:19:10.199110+0000","last_became_active":"2024-09-19T09:19:08.201368+0000","last_became_peered":"2024-09-19T09:19:08.201368+0000","last_unstale":"2024-09-19T09:19:10.199110+0000","last_undegraded":"2024-09-19T09:19:10.199110+0000","last_fullsized":"2024-09-19T09:19:10.199110+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:50.416535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790823+0000","last_change":"2024-09-19T09:19:09.208568+0000","last_active":"2024-09-19T09:19:10.790823+0000","last_peered":"2024-09-19T09:19:10.790823+0000","last_clean":"2024-09-19T09:19:10.790823+0000","last_became_active":"2024-09-19T09:19:09.207336+0000","last_became_peered":"2024-09-19T09:19:09.207336+0000","last_unstale":"2024-09-19T09:19:10.790823+0000","last_undegraded":"2024-09-19T09:19:10.790823+0000","last_fullsized":"2024-09-19T09:19:10.790823+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:26.896940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198667+0000","last_change":"2024-09-19T09:19:08.197707+0000","last_active":"2024-09-19T09:19:10.198667+0000","last_peered":"2024-09-19T09:19:10.198667+0000","last_clean":"2024-09-19T09:19:10.198667+0000","last_became_active":"2024-09-19T09:19:08.197187+0000","last_became_peered":"2024-09-19T09:19:08.197187+0000","last_unstale":"2024-09-19T09:19:10.198667+0000","last_undegraded":"2024-09-19T09:19:10.198667+0000","last_fullsized":"2024-09-19T09:19:10.198667+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:46.201009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.289551+0000","last_change":"2024-09-19T09:19:09.206987+0000","last_active":"2024-09-19T09:19:10.289551+0000","last_peered":"2024-09-19T09:19:10.289551+0000","last_clean":"2024-09-19T09:19:10.289551+0000","last_became_active":"2024-09-19T09:19:09.206648+0000","last_became_peered":"2024-09-19T09:19:09.206648+0000","last_unstale":"2024-09-19T09:19:10.289551+0000","last_undegraded":"2024-09-19T09:19:10.289551+0000","last_fullsized":"2024-09-19T09:19:10.289551+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:25.085784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.789932+0000","last_change":"2024-09-19T09:19:08.201378+0000","last_active":"2024-09-19T09:19:10.789932+0000","last_peered":"2024-09-19T09:19:10.789932+0000","last_clean":"2024-09-19T09:19:10.789932+0000","last_became_active":"2024-09-19T09:19:08.201109+0000","last_became_peered":"2024-09-19T09:19:08.201109+0000","last_unstale":"2024-09-19T09:19:10.789932+0000","last_undegraded":"2024-09-19T09:19:10.789932+0000","last_fullsized":"2024-09-19T09:19:10.789932+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:29.149951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790086+0000","last_change":"2024-09-19T09:19:09.206692+0000","last_active":"2024-09-19T09:19:10.790086+0000","last_peered":"2024-09-19T09:19:10.790086+0000","last_clean":"2024-09-19T09:19:10.790086+0000","last_became_active":"2024-09-19T09:19:09.206345+0000","last_became_peered":"2024-09-19T09:19:09.206345+0000","last_unstale":"2024-09-19T09:19:10.790086+0000","last_undegraded":"2024-09-19T09:19:10.790086+0000","last_fullsized":"2024-09-19T09:19:10.790086+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:40.258607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":14,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198430+0000","last_change":"2024-09-19T09:19:08.198375+0000","last_active":"2024-09-19T09:19:10.198430+0000","last_peered":"2024-09-19T09:19:10.198430+0000","last_clean":"2024-09-19T09:19:10.198430+0000","last_became_active":"2024-09-19T09:19:08.198137+0000","last_became_peered":"2024-09-19T09:19:08.198137+0000","last_unstale":"2024-09-19T09:19:10.198430+0000","last_undegraded":"2024-09-19T09:19:10.198430+0000","last_fullsized":"2024-09-19T09:19:10.198430+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:14.640687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":12,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.198794+0000","last_change":"2024-09-19T09:19:09.199099+0000","last_active":"2024-09-19T09:19:10.198794+0000","last_peered":"2024-09-19T09:19:10.198794+0000","last_clean":"2024-09-19T09:19:10.198794+0000","last_became_active":"2024-09-19T09:19:09.198851+0000","last_became_peered":"2024-09-19T09:19:09.198851+0000","last_unstale":"2024-09-19T09:19:10.198794+0000","last_undegraded":"2024-09-19T09:19:10.198794+0000","last_fullsized":"2024-09-19T09:19:10.198794+0000","mapping_epoch":121,"log_start":"0'0","ondisk_log_start":"0'0","created":121,"last_epoch_clean":122,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:08.177741+0000","last_clean_scrub_stamp":"2024-09-19T09:19:08.177741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:41:21.692573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"122'1","reported_seq":15,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790045+0000","last_change":"2024-09-19T09:19:08.198949+0000","last_active":"2024-09-19T09:19:10.790045+0000","last_peered":"2024-09-19T09:19:10.790045+0000","last_clean":"2024-09-19T09:19:10.790045+0000","last_became_active":"2024-09-19T09:19:08.198339+0000","last_became_peered":"2024-09-19T09:19:08.198339+0000","last_unstale":"2024-09-19T09:19:10.790045+0000","last_undegraded":"2024-09-19T09:19:10.790045+0000","last_fullsized":"2024-09-19T09:19:10.790045+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:07.175678+0000","last_clean_scrub_stamp":"2024-09-19T09:19:07.175678+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:03.708781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":373,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-09-19T09:19:10.790097+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:19:10.790097+0000","last_peered":"2024-09-19T09:19:10.790097+0000","last_clean":"2024-09-19T09:19:10.790097+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:19:10.790097+0000","last_undegraded":"2024-09-19T09:19:10.790097+0000","last_fullsized":"2024-09-19T09:19:10.790097+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:28.823470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574921,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":662,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194650,"statfs":{"total":200000000,"available":199321770,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574921,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":661,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194650,"statfs":{"total":200000000,"available":199322352,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574921,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1239,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194072,"statfs":{"total":200000000,"available":198730316,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574921,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":662,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194650,"statfs":{"total":200000000,"available":199321770,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":655,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194656,"statfs":{"total":200000000,"available":199328458,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574921,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":661,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194650,"statfs":{"total":200000000,"available":199322282,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1239,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194072,"statfs":{"total":200000000,"available":198730260,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574921,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":655,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194656,"statfs":{"total":200000000,"available":199328652,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:19:12.530 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T09:19:12.531 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-19T09:19:12.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.677+0000 7f3c0356d640 1 Processor -- start 2024-09-19T09:19:12.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.677+0000 7f3c0356d640 1 -- start start 2024-09-19T09:19:12.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.678+0000 7f3c0356d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3bfc15a670 0x7f3bfc15dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:12.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.678+0000 7f3c0356d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bfc0b6b90 0x7f3bfc15f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:12.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.678+0000 7f3c0356d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bfc15aa50 con 0x7f3bfc0b5970 2024-09-19T09:19:12.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.678+0000 7f3c0356d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f3bfc0b6150 con 0x7f3bfc15a670 2024-09-19T09:19:12.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.678+0000 7f3c0356d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3bfc15e310 con 0x7f3bfc0b6b90 2024-09-19T09:19:12.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.678+0000 7f3c00b08640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3bfc0b5970 0x7f3bfc0b6480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52826/0 (socket says 172.21.15.18:52826) 2024-09-19T09:19:12.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.678+0000 7f3c00b08640 1 -- 172.21.15.18:0/2354393610 learned_addr learned my addr 172.21.15.18:0/2354393610 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:12.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.678+0000 7f3c01b0a640 1 --2- 172.21.15.18:0/2354393610 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bfc0b6b90 0x7f3bfc15f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:12.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.678+0000 7f3c01309640 1 --2- 172.21.15.18:0/2354393610 >> v2:172.21.15.162:3300/0 conn(0x7f3bfc15a670 0x7f3bfc15dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:12.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.678+0000 7f3bf3fff640 1 -- 172.21.15.18:0/2354393610 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4096336056 0 0) 0x7f3bfc15aa50 con 0x7f3bfc0b5970 2024-09-19T09:19:12.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.678+0000 7f3bf3fff640 1 -- 172.21.15.18:0/2354393610 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3be8003520 con 0x7f3bfc0b5970 2024-09-19T09:19:12.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.679+0000 7f3bf3fff640 1 -- 172.21.15.18:0/2354393610 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2139349447 0 0) 0x7f3be8003520 con 0x7f3bfc0b5970 2024-09-19T09:19:12.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.679+0000 7f3c01b0a640 1 -- 172.21.15.18:0/2354393610 >> v2:172.21.15.162:3300/0 conn(0x7f3bfc15a670 msgr2=0x7f3bfc15dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:12.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.679+0000 7f3c01b0a640 1 --2- 172.21.15.18:0/2354393610 >> v2:172.21.15.162:3300/0 conn(0x7f3bfc15a670 0x7f3bfc15dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.679+0000 7f3c01b0a640 1 -- 172.21.15.18:0/2354393610 >> v1:172.21.15.18:6789/0 conn(0x7f3bfc0b5970 legacy=0x7f3bfc0b6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:12.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.679+0000 7f3c01b0a640 1 -- 172.21.15.18:0/2354393610 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bfc15e5f0 con 0x7f3bfc0b6b90 2024-09-19T09:19:12.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.679+0000 7f3c01b0a640 1 --2- 172.21.15.18:0/2354393610 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bfc0b6b90 0x7f3bfc15f0d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4009d90 tx=0x7f3bf402a560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb05696a348579d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:12.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.680+0000 7f3bf3fff640 1 -- 172.21.15.18:0/2354393610 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bec001670 con 0x7f3bfc0b6b90 2024-09-19T09:19:12.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.680+0000 7f3bf3fff640 1 -- 172.21.15.18:0/2354393610 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf4007540 con 0x7f3bfc0b6b90 2024-09-19T09:19:12.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.680+0000 7f3bf3fff640 1 -- 172.21.15.18:0/2354393610 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4007910 con 0x7f3bfc0b6b90 2024-09-19T09:19:12.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.680+0000 7f3c0356d640 1 -- 172.21.15.18:0/2354393610 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bfc0b6b90 msgr2=0x7f3bfc15f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:12.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.680+0000 7f3c0356d640 1 --2- 172.21.15.18:0/2354393610 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bfc0b6b90 0x7f3bfc15f0d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4009d90 tx=0x7f3bf402a560 comp rx=0 tx=0).stop 2024-09-19T09:19:12.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.680+0000 7f3c0356d640 1 -- 172.21.15.18:0/2354393610 shutdown_connections 2024-09-19T09:19:12.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.680+0000 7f3c0356d640 1 --2- 172.21.15.18:0/2354393610 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bfc0b6b90 0x7f3bfc15f0d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.680+0000 7f3c0356d640 1 --2- 172.21.15.18:0/2354393610 >> v2:172.21.15.162:3300/0 conn(0x7f3bfc15a670 0x7f3bfc15dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.680+0000 7f3c0356d640 1 -- 172.21.15.18:0/2354393610 >> 172.21.15.18:0/2354393610 conn(0x7f3bfc09b9d0 msgr2=0x7f3bfc09bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:12.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.680+0000 7f3c0356d640 1 -- 172.21.15.18:0/2354393610 shutdown_connections 2024-09-19T09:19:12.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.680+0000 7f3c0356d640 1 -- 172.21.15.18:0/2354393610 wait complete. 2024-09-19T09:19:12.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.681+0000 7f3c0356d640 1 Processor -- start 2024-09-19T09:19:12.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.681+0000 7f3c0356d640 1 -- start start 2024-09-19T09:19:12.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.682+0000 7f3c0356d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bfc0b5970 0x7f3bfc1f25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:12.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.682+0000 7f3c0356d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bfc0b6b90 0x7f3bfc155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:12.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.682+0000 7f3c0356d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3bfc15a670 0x7f3bfc09cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:12.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.682+0000 7f3c0356d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3bfc15f610 con 0x7f3bfc15a670 2024-09-19T09:19:12.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.682+0000 7f3c0356d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3bfc0b5dd0 con 0x7f3bfc0b6b90 2024-09-19T09:19:12.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.682+0000 7f3c0356d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3bfc15f790 con 0x7f3bfc0b5970 2024-09-19T09:19:12.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.682+0000 7f3c01b0a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3bfc15a670 0x7f3bfc09cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:12.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.682+0000 7f3c01b0a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3bfc15a670 0x7f3bfc09cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33894/0 (socket says 172.21.15.18:33894) 2024-09-19T09:19:12.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.682+0000 7f3c01b0a640 1 -- 172.21.15.18:0/835490514 learned_addr learned my addr 172.21.15.18:0/835490514 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:12.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.682+0000 7f3c01309640 1 --2- 172.21.15.18:0/835490514 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bfc0b5970 0x7f3bfc1f25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:12.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.682+0000 7f3c00b08640 1 --2- 172.21.15.18:0/835490514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bfc0b6b90 0x7f3bfc155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:12.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.683+0000 7f3c01b0a640 1 -- 172.21.15.18:0/835490514 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bfc0b5970 msgr2=0x7f3bfc1f25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:12.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.683+0000 7f3c01b0a640 1 --2- 172.21.15.18:0/835490514 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bfc0b5970 0x7f3bfc1f25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.683+0000 7f3c01b0a640 1 -- 172.21.15.18:0/835490514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bfc0b6b90 msgr2=0x7f3bfc155980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:12.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.683+0000 7f3c01b0a640 1 --2- 172.21.15.18:0/835490514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bfc0b6b90 0x7f3bfc155980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.683+0000 7f3c01b0a640 1 -- 172.21.15.18:0/835490514 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bfc09d480 con 0x7f3bfc15a670 2024-09-19T09:19:12.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.683+0000 7f3c00b08640 1 --2- 172.21.15.18:0/835490514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bfc0b6b90 0x7f3bfc155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:12.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.683+0000 7f3c01b0a640 1 --2- 172.21.15.18:0/835490514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3bfc15a670 0x7f3bfc09cbf0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4009d90 tx=0x7f3bf4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:12.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.683+0000 7f3bf1ffb640 1 -- 172.21.15.18:0/835490514 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4040070 con 0x7f3bfc15a670 2024-09-19T09:19:12.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.683+0000 7f3bf1ffb640 1 -- 172.21.15.18:0/835490514 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf4031b40 con 0x7f3bfc15a670 2024-09-19T09:19:12.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.683+0000 7f3c0356d640 1 -- 172.21.15.18:0/835490514 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bfc09d760 con 0x7f3bfc15a670 2024-09-19T09:19:12.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.683+0000 7f3bf1ffb640 1 -- 172.21.15.18:0/835490514 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4007e90 con 0x7f3bfc15a670 2024-09-19T09:19:12.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.683+0000 7f3c0356d640 1 -- 172.21.15.18:0/835490514 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bfc09dd20 con 0x7f3bfc15a670 2024-09-19T09:19:12.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.684+0000 7f3c0356d640 1 -- 172.21.15.18:0/835490514 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bfc15f0d0 con 0x7f3bfc15a670 2024-09-19T09:19:12.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.685+0000 7f3bf1ffb640 1 -- 172.21.15.18:0/835490514 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3bf4039040 con 0x7f3bfc15a670 2024-09-19T09:19:12.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.685+0000 7f3bf1ffb640 1 --2- 172.21.15.18:0/835490514 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3be006c2b0 0x7f3be006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:12.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.685+0000 7f3bf1ffb640 1 -- 172.21.15.18:0/835490514 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f3bf40ac760 con 0x7f3bfc15a670 2024-09-19T09:19:12.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.685+0000 7f3c01309640 1 --2- 172.21.15.18:0/835490514 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3be006c2b0 0x7f3be006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:12.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.686+0000 7f3c01309640 1 --2- 172.21.15.18:0/835490514 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3be006c2b0 0x7f3be006e770 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc1f0210 tx=0x7f3bf8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:12.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.690+0000 7f3bf1ffb640 1 -- 172.21.15.18:0/835490514 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3bf407af60 con 0x7f3bfc15a670 2024-09-19T09:19:12.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.932+0000 7f3c0356d640 1 -- 172.21.15.18:0/835490514 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f3bfc09c5f0 con 0x7f3bfc15a670 2024-09-19T09:19:12.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.934+0000 7f3bf1ffb640 1 -- 172.21.15.18:0/835490514 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7f3bf4081130 con 0x7f3bfc15a670 2024-09-19T09:19:12.936 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-09-19T09:19:12.936 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAe6+tmcbwDNhAAaG0+wu96Locwws+h0zeh8Q== 2024-09-19T09:19:12.936 INFO:teuthology.orchestra.run.smithi018.stdout: caps mds = "allow" 2024-09-19T09:19:12.936 INFO:teuthology.orchestra.run.smithi018.stdout: caps mon = "allow r" 2024-09-19T09:19:12.936 INFO:teuthology.orchestra.run.smithi018.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-19T09:19:12.936 INFO:teuthology.orchestra.run.smithi018.stderr:updated caps for client.0 2024-09-19T09:19:12.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.936+0000 7f3c0356d640 1 -- 172.21.15.18:0/835490514 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3be006c2b0 msgr2=0x7f3be006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:12.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.936+0000 7f3c0356d640 1 --2- 172.21.15.18:0/835490514 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3be006c2b0 0x7f3be006e770 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc1f0210 tx=0x7f3bf8009190 comp rx=0 tx=0).stop 2024-09-19T09:19:12.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.936+0000 7f3c0356d640 1 -- 172.21.15.18:0/835490514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3bfc15a670 msgr2=0x7f3bfc09cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:12.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.936+0000 7f3c0356d640 1 --2- 172.21.15.18:0/835490514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3bfc15a670 0x7f3bfc09cbf0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4009d90 tx=0x7f3bf4004a40 comp rx=0 tx=0).stop 2024-09-19T09:19:12.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.936+0000 7f3c0356d640 1 -- 172.21.15.18:0/835490514 shutdown_connections 2024-09-19T09:19:12.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.936+0000 7f3c0356d640 1 --2- 172.21.15.18:0/835490514 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3be006c2b0 0x7f3be006e770 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.936+0000 7f3c0356d640 1 --2- 172.21.15.18:0/835490514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3bfc15a670 0x7f3bfc09cbf0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.936+0000 7f3c0356d640 1 --2- 172.21.15.18:0/835490514 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3bfc0b6b90 0x7f3bfc155980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.936+0000 7f3c0356d640 1 --2- 172.21.15.18:0/835490514 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3bfc0b5970 0x7f3bfc1f25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:12.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.936+0000 7f3c0356d640 1 -- 172.21.15.18:0/835490514 >> 172.21.15.18:0/835490514 conn(0x7f3bfc09b9d0 msgr2=0x7f3bfc158770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:12.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.936+0000 7f3c0356d640 1 -- 172.21.15.18:0/835490514 shutdown_connections 2024-09-19T09:19:12.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:12.936+0000 7f3c0356d640 1 -- 172.21.15.18:0/835490514 wait complete. 2024-09-19T09:19:12.949 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:19:13.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.049+0000 7fb06a16d640 1 Processor -- start 2024-09-19T09:19:13.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.049+0000 7fb06a16d640 1 -- start start 2024-09-19T09:19:13.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.050+0000 7fb06a16d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb064160300 0x7fb0640cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.050+0000 7fb06a16d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb0640708f0 0x7fb0640cd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.050+0000 7fb06a16d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0640d0050 con 0x7fb0640d1ed0 2024-09-19T09:19:13.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.050+0000 7fb06a16d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb0640d0330 con 0x7fb0640708f0 2024-09-19T09:19:13.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.050+0000 7fb06a16d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb0640d1420 con 0x7fb064160300 2024-09-19T09:19:13.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.050+0000 7fb062ffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb0640d1ed0 0x7fb0640cf810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52838/0 (socket says 172.21.15.18:52838) 2024-09-19T09:19:13.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.050+0000 7fb062ffd640 1 -- 172.21.15.18:0/3935556663 learned_addr learned my addr 172.21.15.18:0/3935556663 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:13.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.050+0000 7fb063fff640 1 --2- 172.21.15.18:0/3935556663 >> v2:172.21.15.162:3300/0 conn(0x7fb0640708f0 0x7fb0640cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:13.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.050+0000 7fb0637fe640 1 --2- 172.21.15.18:0/3935556663 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb064160300 0x7fb0640cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:13.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.051+0000 7fb0627fc640 1 -- 172.21.15.18:0/3935556663 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3442558205 0 0) 0x7fb0640d0050 con 0x7fb0640d1ed0 2024-09-19T09:19:13.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.051+0000 7fb0627fc640 1 -- 172.21.15.18:0/3935556663 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb050003520 con 0x7fb0640d1ed0 2024-09-19T09:19:13.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.051+0000 7fb063fff640 1 -- 172.21.15.18:0/3935556663 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb064160300 msgr2=0x7fb0640cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:13.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.051+0000 7fb0627fc640 1 -- 172.21.15.18:0/3935556663 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4034038950 0 0) 0x7fb050003520 con 0x7fb0640d1ed0 2024-09-19T09:19:13.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.051+0000 7fb063fff640 1 --2- 172.21.15.18:0/3935556663 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb064160300 0x7fb0640cf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.051+0000 7fb063fff640 1 -- 172.21.15.18:0/3935556663 >> v1:172.21.15.18:6789/0 conn(0x7fb0640d1ed0 legacy=0x7fb0640cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:13.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.051+0000 7fb063fff640 1 -- 172.21.15.18:0/3935556663 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0640d1700 con 0x7fb0640708f0 2024-09-19T09:19:13.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.051+0000 7fb0637fe640 1 --2- 172.21.15.18:0/3935556663 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb064160300 0x7fb0640cf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:13.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.052+0000 7fb063fff640 1 --2- 172.21.15.18:0/3935556663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0640708f0 0x7fb0640cd730 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb05c009d90 tx=0x7fb05c02a560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55092abac58568e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:13.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.052+0000 7fb0627fc640 1 -- 172.21.15.18:0/3935556663 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c001670 con 0x7fb0640708f0 2024-09-19T09:19:13.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.052+0000 7fb0627fc640 1 -- 172.21.15.18:0/3935556663 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb05c007540 con 0x7fb0640708f0 2024-09-19T09:19:13.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.052+0000 7fb0627fc640 1 -- 172.21.15.18:0/3935556663 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb05c0078f0 con 0x7fb0640708f0 2024-09-19T09:19:13.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.052+0000 7fb06a16d640 1 -- 172.21.15.18:0/3935556663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0640708f0 msgr2=0x7fb0640cd730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:13.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.052+0000 7fb06a16d640 1 --2- 172.21.15.18:0/3935556663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0640708f0 0x7fb0640cd730 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb05c009d90 tx=0x7fb05c02a560 comp rx=0 tx=0).stop 2024-09-19T09:19:13.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.052+0000 7fb06a16d640 1 -- 172.21.15.18:0/3935556663 shutdown_connections 2024-09-19T09:19:13.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.052+0000 7fb06a16d640 1 --2- 172.21.15.18:0/3935556663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0640708f0 0x7fb0640cd730 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.052+0000 7fb06a16d640 1 --2- 172.21.15.18:0/3935556663 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb064160300 0x7fb0640cf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.052+0000 7fb06a16d640 1 -- 172.21.15.18:0/3935556663 >> 172.21.15.18:0/3935556663 conn(0x7fb0640b4600 msgr2=0x7fb0640b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:13.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.052+0000 7fb06a16d640 1 -- 172.21.15.18:0/3935556663 shutdown_connections 2024-09-19T09:19:13.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.052+0000 7fb06a16d640 1 -- 172.21.15.18:0/3935556663 wait complete. 2024-09-19T09:19:13.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.053+0000 7fb06a16d640 1 Processor -- start 2024-09-19T09:19:13.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.054+0000 7fb06a16d640 1 -- start start 2024-09-19T09:19:13.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.054+0000 7fb06a16d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0640708f0 0x7fb0640c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.054+0000 7fb06a16d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0640d1ed0 0x7fb0640b5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.054+0000 7fb06a16d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb064160300 0x7fb064150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.054+0000 7fb06a16d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb0641606e0 con 0x7fb0640d1ed0 2024-09-19T09:19:13.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.054+0000 7fb06a16d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb0640b54a0 con 0x7fb0640708f0 2024-09-19T09:19:13.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.054+0000 7fb06a16d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb064160860 con 0x7fb064160300 2024-09-19T09:19:13.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.055+0000 7fb062ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0640d1ed0 0x7fb0640b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:13.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.055+0000 7fb062ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0640d1ed0 0x7fb0640b5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33898/0 (socket says 172.21.15.18:33898) 2024-09-19T09:19:13.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.055+0000 7fb062ffd640 1 -- 172.21.15.18:0/683076392 learned_addr learned my addr 172.21.15.18:0/683076392 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:13.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.055+0000 7fb0637fe640 1 --2- 172.21.15.18:0/683076392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0640708f0 0x7fb0640c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:13.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.055+0000 7fb063fff640 1 --2- 172.21.15.18:0/683076392 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb064160300 0x7fb064150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:13.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.055+0000 7fb062ffd640 1 -- 172.21.15.18:0/683076392 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb064160300 msgr2=0x7fb064150c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:13.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.055+0000 7fb062ffd640 1 --2- 172.21.15.18:0/683076392 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb064160300 0x7fb064150c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.055+0000 7fb062ffd640 1 -- 172.21.15.18:0/683076392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0640708f0 msgr2=0x7fb0640c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:13.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.055+0000 7fb062ffd640 1 --2- 172.21.15.18:0/683076392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0640708f0 0x7fb0640c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.055+0000 7fb062ffd640 1 -- 172.21.15.18:0/683076392 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0640b6150 con 0x7fb0640d1ed0 2024-09-19T09:19:13.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.055+0000 7fb062ffd640 1 --2- 172.21.15.18:0/683076392 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0640d1ed0 0x7fb0640b5900 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fb04c0011e0 tx=0x7fb04c00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:13.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.055+0000 7fb05bfff640 1 -- 172.21.15.18:0/683076392 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c017070 con 0x7fb0640d1ed0 2024-09-19T09:19:13.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.055+0000 7fb05bfff640 1 -- 172.21.15.18:0/683076392 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb04c005ad0 con 0x7fb0640d1ed0 2024-09-19T09:19:13.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.055+0000 7fb06a16d640 1 -- 172.21.15.18:0/683076392 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0640b6430 con 0x7fb0640d1ed0 2024-09-19T09:19:13.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.055+0000 7fb05bfff640 1 -- 172.21.15.18:0/683076392 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c007070 con 0x7fb0640d1ed0 2024-09-19T09:19:13.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.055+0000 7fb06a16d640 1 -- 172.21.15.18:0/683076392 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0641f2d30 con 0x7fb0640d1ed0 2024-09-19T09:19:13.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.056+0000 7fb06a16d640 1 -- 172.21.15.18:0/683076392 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0641f2f30 con 0x7fb0640d1ed0 2024-09-19T09:19:13.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.057+0000 7fb05bfff640 1 -- 172.21.15.18:0/683076392 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb04c01a070 con 0x7fb0640d1ed0 2024-09-19T09:19:13.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.057+0000 7fb05bfff640 1 --2- 172.21.15.18:0/683076392 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb04406c2b0 0x7fb04406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.057+0000 7fb05bfff640 1 -- 172.21.15.18:0/683076392 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7fb04c08a850 con 0x7fb0640d1ed0 2024-09-19T09:19:13.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.058+0000 7fb0637fe640 1 --2- 172.21.15.18:0/683076392 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb04406c2b0 0x7fb04406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:13.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.058+0000 7fb0637fe640 1 --2- 172.21.15.18:0/683076392 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb04406c2b0 0x7fb04406e770 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb0640c9af0 tx=0x7fb054008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:13.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.062+0000 7fb05bfff640 1 -- 172.21.15.18:0/683076392 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb0641f2f30 con 0x7fb0640d1ed0 2024-09-19T09:19:13.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.278+0000 7fb06a16d640 1 -- 172.21.15.18:0/683076392 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0640cf2d0 con 0x7fb0640d1ed0 2024-09-19T09:19:13.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.278+0000 7fb05bfff640 1 -- 172.21.15.18:0/683076392 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5225 (secure 0 0 0) 0x7fb04c0588f0 con 0x7fb0640d1ed0 2024-09-19T09:19:13.280 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:13.280 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":48,"btime":"2024-09-19T09:19:11:196952+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5642,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/4210829543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":4210829543},{"type":"v1","addr":"172.21.15.162:6837","nonce":4210829543}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3090247017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3090247017},{"type":"v1","addr":"172.21.15.162:6836","nonce":3090247017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6546,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/62488842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":62488842},{"type":"v1","addr":"172.21.15.18:6833","nonce":62488842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:19:08.540022+0000","modified":"2024-09-19T09:19:10.541774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6549},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6549":{"gid":6549,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2870064683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":2870064683},{"type":"v1","addr":"172.21.15.18:6835","nonce":2870064683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6549,"qdb_cluster":[6549]},"id":7}]} 2024-09-19T09:19:13.280 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 48 2024-09-19T09:19:13.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.280+0000 7fb06a16d640 1 -- 172.21.15.18:0/683076392 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb04406c2b0 msgr2=0x7fb04406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:13.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.280+0000 7fb06a16d640 1 --2- 172.21.15.18:0/683076392 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb04406c2b0 0x7fb04406e770 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb0640c9af0 tx=0x7fb054008040 comp rx=0 tx=0).stop 2024-09-19T09:19:13.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.280+0000 7fb06a16d640 1 -- 172.21.15.18:0/683076392 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0640d1ed0 msgr2=0x7fb0640b5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:13.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.280+0000 7fb06a16d640 1 --2- 172.21.15.18:0/683076392 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0640d1ed0 0x7fb0640b5900 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fb04c0011e0 tx=0x7fb04c00cb90 comp rx=0 tx=0).stop 2024-09-19T09:19:13.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.280+0000 7fb06a16d640 1 -- 172.21.15.18:0/683076392 shutdown_connections 2024-09-19T09:19:13.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.280+0000 7fb06a16d640 1 --2- 172.21.15.18:0/683076392 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb04406c2b0 0x7fb04406e770 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.280+0000 7fb06a16d640 1 --2- 172.21.15.18:0/683076392 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb064160300 0x7fb064150c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.280+0000 7fb06a16d640 1 --2- 172.21.15.18:0/683076392 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb0640d1ed0 0x7fb0640b5900 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.280+0000 7fb06a16d640 1 --2- 172.21.15.18:0/683076392 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb0640708f0 0x7fb0640c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.280+0000 7fb06a16d640 1 -- 172.21.15.18:0/683076392 >> 172.21.15.18:0/683076392 conn(0x7fb0640b4600 msgr2=0x7fb0640ce560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:13.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.280+0000 7fb06a16d640 1 -- 172.21.15.18:0/683076392 shutdown_connections 2024-09-19T09:19:13.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.280+0000 7fb06a16d640 1 -- 172.21.15.18:0/683076392 wait complete. 2024-09-19T09:19:13.696 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 48, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T09:19:08.540022+0000', 'modified': '2024-09-19T09:19:10.541774+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6549}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6549': {'gid': 6549, 'name': 'c', 'rank': 0, 'incarnation': 46, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.18:6835/2870064683', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6834', 'nonce': 2870064683}, {'type': 'v1', 'addr': '172.21.15.18:6835', 'nonce': 2870064683}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6549, 'qdb_cluster': [6549]} 2024-09-19T09:19:13.696 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T09:19:13.696 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-19T09:19:13.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.803+0000 7faadcf8d640 1 Processor -- start 2024-09-19T09:19:13.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.803+0000 7faadcf8d640 1 -- start start 2024-09-19T09:19:13.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.804+0000 7faadcf8d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7faad815cbb0 0x7faad80b5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.804+0000 7faadcf8d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faad80b1ba0 0x7faad80cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.804+0000 7faadcf8d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faad815cf90 con 0x7faad80cf9b0 2024-09-19T09:19:13.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.804+0000 7faadcf8d640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7faad80cfe60 con 0x7faad815cbb0 2024-09-19T09:19:13.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.804+0000 7faadcf8d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faad80ce980 con 0x7faad80b1ba0 2024-09-19T09:19:13.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.804+0000 7faad659c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7faad815cbb0 0x7faad80b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:13.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.804+0000 7faad659c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7faad815cbb0 0x7faad80b5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33900/0 (socket says 172.21.15.18:33900) 2024-09-19T09:19:13.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.804+0000 7faad659c640 1 -- 172.21.15.18:0/1443626813 learned_addr learned my addr 172.21.15.18:0/1443626813 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:13.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.804+0000 7faad659c640 1 -- 172.21.15.18:0/1443626813 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faad80b1ba0 msgr2=0x7faad80cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:13.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.804+0000 7faad659c640 1 --2- 172.21.15.18:0/1443626813 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faad80b1ba0 0x7faad80cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.804+0000 7faad659c640 1 -- 172.21.15.18:0/1443626813 >> v1:172.21.15.162:6789/0 conn(0x7faad80cf9b0 legacy=0x7faad8160690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:13.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.804+0000 7faad659c640 1 -- 172.21.15.18:0/1443626813 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faad80d02a0 con 0x7faad815cbb0 2024-09-19T09:19:13.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.805+0000 7faad659c640 1 --2- 172.21.15.18:0/1443626813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faad815cbb0 0x7faad80b5110 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7faac8009870 tx=0x7faac802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9779a607095608a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:13.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.805+0000 7faad5d9b640 1 -- 172.21.15.18:0/1443626813 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac8037070 con 0x7faad815cbb0 2024-09-19T09:19:13.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.805+0000 7faad5d9b640 1 -- 172.21.15.18:0/1443626813 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faac8032440 con 0x7faad815cbb0 2024-09-19T09:19:13.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.805+0000 7faad5d9b640 1 -- 172.21.15.18:0/1443626813 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac8032810 con 0x7faad815cbb0 2024-09-19T09:19:13.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.806+0000 7faadcf8d640 1 -- 172.21.15.18:0/1443626813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faad815cbb0 msgr2=0x7faad80b5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:13.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.806+0000 7faadcf8d640 1 --2- 172.21.15.18:0/1443626813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faad815cbb0 0x7faad80b5110 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7faac8009870 tx=0x7faac802a210 comp rx=0 tx=0).stop 2024-09-19T09:19:13.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.806+0000 7faadcf8d640 1 -- 172.21.15.18:0/1443626813 shutdown_connections 2024-09-19T09:19:13.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.806+0000 7faadcf8d640 1 --2- 172.21.15.18:0/1443626813 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faad80b1ba0 0x7faad80cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.806+0000 7faadcf8d640 1 --2- 172.21.15.18:0/1443626813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faad815cbb0 0x7faad80b5110 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.806+0000 7faadcf8d640 1 -- 172.21.15.18:0/1443626813 >> 172.21.15.18:0/1443626813 conn(0x7faad80b45f0 msgr2=0x7faad80b4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:13.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.806+0000 7faadcf8d640 1 -- 172.21.15.18:0/1443626813 shutdown_connections 2024-09-19T09:19:13.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.806+0000 7faadcf8d640 1 -- 172.21.15.18:0/1443626813 wait complete. 2024-09-19T09:19:13.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.807+0000 7faadcf8d640 1 Processor -- start 2024-09-19T09:19:13.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.807+0000 7faadcf8d640 1 -- start start 2024-09-19T09:19:13.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.808+0000 7faadcf8d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faad80b1ba0 0x7faad81595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.808+0000 7faadcf8d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faad80cf9b0 0x7faad806cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.808+0000 7faadcf8d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faad815cbb0 0x7faad80c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.808+0000 7faadcf8d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faad80ce6a0 con 0x7faad815cbb0 2024-09-19T09:19:13.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.808+0000 7faadcf8d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faad80ce3c0 con 0x7faad80b1ba0 2024-09-19T09:19:13.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.808+0000 7faadcf8d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faad80b2460 con 0x7faad80cf9b0 2024-09-19T09:19:13.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.808+0000 7faad6d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faad815cbb0 0x7faad80c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:13.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.808+0000 7faad6d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faad815cbb0 0x7faad80c62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33912/0 (socket says 172.21.15.18:33912) 2024-09-19T09:19:13.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.808+0000 7faad6d9d640 1 -- 172.21.15.18:0/1310396164 learned_addr learned my addr 172.21.15.18:0/1310396164 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:13.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.808+0000 7faad659c640 1 --2- 172.21.15.18:0/1310396164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faad80b1ba0 0x7faad81595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:13.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.808+0000 7faacffff640 1 --2- 172.21.15.18:0/1310396164 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faad80cf9b0 0x7faad806cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:13.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.808+0000 7faad6d9d640 1 -- 172.21.15.18:0/1310396164 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faad80cf9b0 msgr2=0x7faad806cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:13.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.808+0000 7faad6d9d640 1 --2- 172.21.15.18:0/1310396164 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faad80cf9b0 0x7faad806cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.808+0000 7faad6d9d640 1 -- 172.21.15.18:0/1310396164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faad80b1ba0 msgr2=0x7faad81595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:13.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.808+0000 7faad6d9d640 1 --2- 172.21.15.18:0/1310396164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faad80b1ba0 0x7faad81595c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.808+0000 7faad6d9d640 1 -- 172.21.15.18:0/1310396164 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faad806d490 con 0x7faad815cbb0 2024-09-19T09:19:13.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.809+0000 7faad6d9d640 1 --2- 172.21.15.18:0/1310396164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faad815cbb0 0x7faad80c62c0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7faad000c780 tx=0x7faad000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:13.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.809+0000 7faaceffd640 1 -- 172.21.15.18:0/1310396164 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad0017070 con 0x7faad815cbb0 2024-09-19T09:19:13.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.809+0000 7faaceffd640 1 -- 172.21.15.18:0/1310396164 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faad0003b70 con 0x7faad815cbb0 2024-09-19T09:19:13.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.809+0000 7faaceffd640 1 -- 172.21.15.18:0/1310396164 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad0005070 con 0x7faad815cbb0 2024-09-19T09:19:13.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.809+0000 7faadcf8d640 1 -- 172.21.15.18:0/1310396164 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faad8157380 con 0x7faad815cbb0 2024-09-19T09:19:13.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.809+0000 7faadcf8d640 1 -- 172.21.15.18:0/1310396164 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faad81570a0 con 0x7faad815cbb0 2024-09-19T09:19:13.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.810+0000 7faaceffd640 1 -- 172.21.15.18:0/1310396164 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7faad001a070 con 0x7faad815cbb0 2024-09-19T09:19:13.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.811+0000 7faaceffd640 1 --2- 172.21.15.18:0/1310396164 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faab806c2b0 0x7faab806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.811+0000 7faaceffd640 1 -- 172.21.15.18:0/1310396164 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7faad008a940 con 0x7faad815cbb0 2024-09-19T09:19:13.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.811+0000 7faad659c640 1 --2- 172.21.15.18:0/1310396164 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faab806c2b0 0x7faab806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:13.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.812+0000 7faad659c640 1 --2- 172.21.15.18:0/1310396164 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faab806c2b0 0x7faab806e770 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7faac8034000 tx=0x7faac802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:13.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.812+0000 7faadfe01740 1 Processor -- start 2024-09-19T09:19:13.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.812+0000 7faadfe01740 1 -- start start 2024-09-19T09:19:13.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.812+0000 7faadfe01740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5627f8a192c0 0x5627f8a5ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.812+0000 7faadfe01740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5627f8a16a80 0x5627f8a196a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.812+0000 7faadfe01740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627f8a1aa50 0x5627f8a138b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.812+0000 7faadfe01740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5627f897b520 con 0x5627f8a1aa50 2024-09-19T09:19:13.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.812+0000 7faadfe01740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5627f89233e0 con 0x5627f8a192c0 2024-09-19T09:19:13.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.812+0000 7faadfe01740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5627f89774e0 con 0x5627f8a16a80 2024-09-19T09:19:13.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.813+0000 7faad6d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627f8a1aa50 0x5627f8a138b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:13.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.813+0000 7faad6d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627f8a1aa50 0x5627f8a138b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33926/0 (socket says 172.21.15.18:33926) 2024-09-19T09:19:13.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.813+0000 7faad6d9d640 1 -- 172.21.15.18:0/3990382955 learned_addr learned my addr 172.21.15.18:0/3990382955 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:13.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.813+0000 7faacffff640 1 --2- 172.21.15.18:0/3990382955 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5627f8a16a80 0x5627f8a196a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:13.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.813+0000 7faad659c640 1 --2- 172.21.15.18:0/3990382955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5627f8a192c0 0x5627f8a5ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:13.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.813+0000 7faad6d9d640 1 -- 172.21.15.18:0/3990382955 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5627f8a16a80 msgr2=0x5627f8a196a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:13.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.813+0000 7faad6d9d640 1 --2- 172.21.15.18:0/3990382955 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5627f8a16a80 0x5627f8a196a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.813+0000 7faad6d9d640 1 -- 172.21.15.18:0/3990382955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5627f8a192c0 msgr2=0x5627f8a5ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:13.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.813+0000 7faad6d9d640 1 --2- 172.21.15.18:0/3990382955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5627f8a192c0 0x5627f8a5ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.813+0000 7faad6d9d640 1 -- 172.21.15.18:0/3990382955 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627f893e2f0 con 0x5627f8a1aa50 2024-09-19T09:19:13.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.813+0000 7faad6d9d640 1 --2- 172.21.15.18:0/3990382955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627f8a1aa50 0x5627f8a138b0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7faad0061060 tx=0x7faad005cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc231a88d8c3815 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:13.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.813+0000 7faab7fff640 1 -- 172.21.15.18:0/3990382955 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad00550d0 con 0x5627f8a1aa50 2024-09-19T09:19:13.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.813+0000 7faab7fff640 1 -- 172.21.15.18:0/3990382955 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faad005f0b0 con 0x5627f8a1aa50 2024-09-19T09:19:13.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.813+0000 7faab7fff640 1 -- 172.21.15.18:0/3990382955 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad0055270 con 0x5627f8a1aa50 2024-09-19T09:19:13.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.814+0000 7faadfe01740 1 -- 172.21.15.18:0/3990382955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627f8a1aa50 msgr2=0x5627f8a138b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:13.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.814+0000 7faadfe01740 1 --2- 172.21.15.18:0/3990382955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627f8a1aa50 0x5627f8a138b0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7faad0061060 tx=0x7faad005cea0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.814+0000 7faadfe01740 1 -- 172.21.15.18:0/3990382955 shutdown_connections 2024-09-19T09:19:13.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.814+0000 7faadfe01740 1 --2- 172.21.15.18:0/3990382955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627f8a1aa50 0x5627f8a138b0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.814+0000 7faadfe01740 1 --2- 172.21.15.18:0/3990382955 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5627f8a16a80 0x5627f8a196a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.814+0000 7faadfe01740 1 --2- 172.21.15.18:0/3990382955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5627f8a192c0 0x5627f8a5ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.814+0000 7faadfe01740 1 -- 172.21.15.18:0/3990382955 >> 172.21.15.18:0/3990382955 conn(0x5627f8a15a80 msgr2=0x5627f8a5df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:13.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.814+0000 7faadfe01740 1 -- 172.21.15.18:0/3990382955 shutdown_connections 2024-09-19T09:19:13.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.814+0000 7faadfe01740 1 -- 172.21.15.18:0/3990382955 wait complete. 2024-09-19T09:19:13.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.815+0000 7faadfe01740 1 -- start start 2024-09-19T09:19:13.819 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.815+0000 7faadfe01740 1 Processor -- start 2024-09-19T09:19:13.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.816+0000 7faadfe01740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627f8a192c0 0x5627f8a38030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.816+0000 7faadfe01740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5627f8a1aa50 0x5627f8a131e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.816+0000 7faadfe01740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5627f8a3f260 0x5627f8a3f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.816+0000 7faadfe01740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5627f8a14f20 con 0x5627f8a192c0 2024-09-19T09:19:13.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.816+0000 7faadfe01740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5627f8904450 con 0x5627f8a3f260 2024-09-19T09:19:13.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.816+0000 7faadfe01740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5627f8a5f290 con 0x5627f8a1aa50 2024-09-19T09:19:13.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.816+0000 7faadfe01740 10 client.0 _ll_register_callbacks cb 0x5627f868dac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:13.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.816+0000 7faad659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627f8a192c0 0x5627f8a38030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:13.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.816+0000 7faad659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627f8a192c0 0x5627f8a38030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33936/0 (socket says 172.21.15.18:33936) 2024-09-19T09:19:13.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.816+0000 7faad659c640 1 -- 172.21.15.18:0/4058358554 learned_addr learned my addr 172.21.15.18:0/4058358554 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:13.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.816+0000 7faad6d9d640 1 --2- 172.21.15.18:0/4058358554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5627f8a3f260 0x5627f8a3f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:13.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.816+0000 7faacffff640 1 --2- 172.21.15.18:0/4058358554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5627f8a1aa50 0x5627f8a131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:13.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.816+0000 7faad659c640 1 -- 172.21.15.18:0/4058358554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5627f8a1aa50 msgr2=0x5627f8a131e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:13.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.816+0000 7faad659c640 1 --2- 172.21.15.18:0/4058358554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5627f8a1aa50 0x5627f8a131e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.816+0000 7faad659c640 1 -- 172.21.15.18:0/4058358554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5627f8a3f260 msgr2=0x5627f8a3f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:13.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.816+0000 7faad659c640 1 --2- 172.21.15.18:0/4058358554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5627f8a3f260 0x5627f8a3f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.816+0000 7faad659c640 1 -- 172.21.15.18:0/4058358554 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627f868e2d0 con 0x5627f8a192c0 2024-09-19T09:19:13.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.816+0000 7faad6d9d640 1 --2- 172.21.15.18:0/4058358554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5627f8a3f260 0x5627f8a3f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:13.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.816+0000 7faacffff640 1 --2- 172.21.15.18:0/4058358554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5627f8a1aa50 0x5627f8a131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:13.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.816+0000 7faad659c640 1 --2- 172.21.15.18:0/4058358554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627f8a192c0 0x5627f8a38030 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7faac8009630 tx=0x7faac8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222c4a1a0ab95fde server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:13.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.816+0000 7faab57fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:19:13.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.816+0000 7faab57fa640 1 -- 172.21.15.18:0/4058358554 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac8037040 con 0x5627f8a192c0 2024-09-19T09:19:13.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.816+0000 7faab57fa640 1 -- 172.21.15.18:0/4058358554 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7faac8053b30 con 0x5627f8a192c0 2024-09-19T09:19:13.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.816+0000 7faadfe01740 1 -- 172.21.15.18:0/4058358554 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faad005f0b0 con 0x5627f8a192c0 2024-09-19T09:19:13.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.817+0000 7faab57fa640 1 -- 172.21.15.18:0/4058358554 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7faac8053d30 con 0x5627f8a192c0 2024-09-19T09:19:13.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.817+0000 7faadfe01740 10 client.6660 fetch_fsmap learned FSMap version 48 2024-09-19T09:19:13.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.817+0000 7faadfe01740 1 -- 172.21.15.18:0/4058358554 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) -- 0x5627f87586b0 con 0x5627f8a192c0 2024-09-19T09:19:13.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.817+0000 7faab57fa640 1 -- 172.21.15.18:0/4058358554 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faad005f0b0 con 0x5627f8a192c0 2024-09-19T09:19:13.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.817+0000 7faab57fa640 1 -- 172.21.15.18:0/4058358554 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 48) ==== 3502+0+0 (secure 0 0 0) 0x7faac8047820 con 0x5627f8a192c0 2024-09-19T09:19:13.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.817+0000 7faadfe01740 10 client.6660 fetch_fsmap finished waiting for FSMap version 48 2024-09-19T09:19:13.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.817+0000 7faadfe01740 10 client.6660 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T09:19:13.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.817+0000 7faadfe01740 20 client.6660 populate_metadata read hostname 'smithi018' 2024-09-19T09:19:13.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.817+0000 7faadfe01740 1 --2- 172.21.15.18:0/4058358554 >> [v2:172.21.15.18:6834/2870064683,v1:172.21.15.18:6835/2870064683] conn(0x5627f8a42d80 0x5627f8a43180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.817+0000 7faadfe01740 4 client.6660 mds_command: new command op to 6549 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:19:13.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.817+0000 7faadfe01740 1 -- 172.21.15.18:0/4058358554 --> [v2:172.21.15.18:6834/2870064683,v1:172.21.15.18:6835/2870064683] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5627f8988c50 con 0x5627f8a42d80 2024-09-19T09:19:13.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.817+0000 7faacffff640 1 --2- 172.21.15.18:0/4058358554 >> [v2:172.21.15.18:6834/2870064683,v1:172.21.15.18:6835/2870064683] conn(0x5627f8a42d80 0x5627f8a43180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:13.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.817+0000 7faacffff640 1 --2- 172.21.15.18:0/4058358554 >> [v2:172.21.15.18:6834/2870064683,v1:172.21.15.18:6835/2870064683] conn(0x5627f8a42d80 0x5627f8a43180 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d944f6a01826999a server_cookie=d52184edc2b9a1e8 in_seq=0 out_seq=0 2024-09-19T09:19:13.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.817+0000 7faab57fa640 10 client.6660 ms_handle_connect on v2:172.21.15.18:6834/2870064683 2024-09-19T09:19:13.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.818+0000 7faab57fa640 1 -- 172.21.15.18:0/4058358554 <== mds.0 v2:172.21.15.18:6834/2870064683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5627f8988c50 con 0x5627f8a42d80 2024-09-19T09:19:13.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.818+0000 7faab57fa640 10 client.6660 handle_command_reply: tid=0 2024-09-19T09:19:13.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.818+0000 7faadfe01740 1 client.6660 shutdown 2024-09-19T09:19:13.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.818+0000 7faadfe01740 1 -- 172.21.15.18:0/4058358554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627f8a192c0 msgr2=0x5627f8a38030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:13.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.818+0000 7faadfe01740 1 --2- 172.21.15.18:0/4058358554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627f8a192c0 0x5627f8a38030 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7faac8009630 tx=0x7faac8004730 comp rx=0 tx=0).stop 2024-09-19T09:19:13.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.818+0000 7faadfe01740 1 -- 172.21.15.18:0/4058358554 shutdown_connections 2024-09-19T09:19:13.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.818+0000 7faadfe01740 1 --2- 172.21.15.18:0/4058358554 >> [v2:172.21.15.18:6834/2870064683,v1:172.21.15.18:6835/2870064683] conn(0x5627f8a42d80 0x5627f8a43180 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.818+0000 7faadfe01740 1 --2- 172.21.15.18:0/4058358554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5627f8a3f260 0x5627f8a3f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.818+0000 7faadfe01740 1 --2- 172.21.15.18:0/4058358554 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5627f8a1aa50 0x5627f8a131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.818+0000 7faadfe01740 1 --2- 172.21.15.18:0/4058358554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627f8a192c0 0x5627f8a38030 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.818+0000 7faab57fa640 0 client.6660 ms_handle_reset on v2:172.21.15.18:6834/2870064683 2024-09-19T09:19:13.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.818+0000 7faadfe01740 1 -- 172.21.15.18:0/4058358554 >> 172.21.15.18:0/4058358554 conn(0x5627f8a16a80 msgr2=0x5627f8a5cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:13.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.818+0000 7faadfe01740 1 -- 172.21.15.18:0/4058358554 shutdown_connections 2024-09-19T09:19:13.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.818+0000 7faadfe01740 1 -- 172.21.15.18:0/4058358554 wait complete. 2024-09-19T09:19:13.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.818+0000 7faadfe01740 20 client.6660 trim_cache size 0 max 16384 2024-09-19T09:19:13.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.836+0000 7faadfe01740 1 Processor -- start 2024-09-19T09:19:13.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.836+0000 7faadfe01740 1 -- start start 2024-09-19T09:19:13.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.837+0000 7faadfe01740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5627f8a192c0 0x5627f8a415d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.837+0000 7faadfe01740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5627f8a1aa50 0x5627f8a5d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.837+0000 7faadfe01740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627f8a3f260 0x5627f8a5bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.837+0000 7faadfe01740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faad8200510 con 0x5627f8a3f260 2024-09-19T09:19:13.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.837+0000 7faadfe01740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faad806da60 con 0x5627f8a192c0 2024-09-19T09:19:13.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.837+0000 7faadfe01740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faad806e0b0 con 0x5627f8a1aa50 2024-09-19T09:19:13.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.837+0000 7faad6d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627f8a3f260 0x5627f8a5bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:13.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.837+0000 7faad6d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627f8a3f260 0x5627f8a5bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33950/0 (socket says 172.21.15.18:33950) 2024-09-19T09:19:13.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.837+0000 7faad6d9d640 1 -- 172.21.15.18:0/3245541841 learned_addr learned my addr 172.21.15.18:0/3245541841 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:13.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.837+0000 7faad6d9d640 1 -- 172.21.15.18:0/3245541841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5627f8a1aa50 msgr2=0x5627f8a5d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:13.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.837+0000 7faad6d9d640 1 --2- 172.21.15.18:0/3245541841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5627f8a1aa50 0x5627f8a5d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.837+0000 7faad6d9d640 1 -- 172.21.15.18:0/3245541841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5627f8a192c0 msgr2=0x5627f8a415d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:13.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.837+0000 7faad6d9d640 1 --2- 172.21.15.18:0/3245541841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5627f8a192c0 0x5627f8a415d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.837+0000 7faad6d9d640 1 -- 172.21.15.18:0/3245541841 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627f8a3fb40 con 0x5627f8a3f260 2024-09-19T09:19:13.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.837+0000 7faad6d9d640 1 --2- 172.21.15.18:0/3245541841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627f8a3f260 0x5627f8a5bee0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7faad0054ec0 tx=0x7faad0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ee51aac8ae8811 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:13.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.838+0000 7faab77fe640 1 -- 172.21.15.18:0/3245541841 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad0058830 con 0x5627f8a3f260 2024-09-19T09:19:13.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.838+0000 7faab77fe640 1 -- 172.21.15.18:0/3245541841 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faad0058a60 con 0x5627f8a3f260 2024-09-19T09:19:13.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.838+0000 7faab77fe640 1 -- 172.21.15.18:0/3245541841 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faad00550d0 con 0x5627f8a3f260 2024-09-19T09:19:13.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.838+0000 7faadfe01740 1 -- 172.21.15.18:0/3245541841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627f8a3f260 msgr2=0x5627f8a5bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:13.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.838+0000 7faadfe01740 1 --2- 172.21.15.18:0/3245541841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627f8a3f260 0x5627f8a5bee0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7faad0054ec0 tx=0x7faad0014000 comp rx=0 tx=0).stop 2024-09-19T09:19:13.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.838+0000 7faadfe01740 1 -- 172.21.15.18:0/3245541841 shutdown_connections 2024-09-19T09:19:13.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.838+0000 7faadfe01740 1 --2- 172.21.15.18:0/3245541841 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627f8a3f260 0x5627f8a5bee0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.838+0000 7faadfe01740 1 --2- 172.21.15.18:0/3245541841 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5627f8a1aa50 0x5627f8a5d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.838+0000 7faadfe01740 1 --2- 172.21.15.18:0/3245541841 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5627f8a192c0 0x5627f8a415d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.838+0000 7faadfe01740 1 -- 172.21.15.18:0/3245541841 >> 172.21.15.18:0/3245541841 conn(0x5627f8a16a80 msgr2=0x5627f8a5b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:13.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.838+0000 7faadfe01740 1 -- 172.21.15.18:0/3245541841 shutdown_connections 2024-09-19T09:19:13.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.838+0000 7faadfe01740 1 -- 172.21.15.18:0/3245541841 wait complete. 2024-09-19T09:19:13.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.839+0000 7faadfe01740 1 -- start start 2024-09-19T09:19:13.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.839+0000 7faadfe01740 1 Processor -- start 2024-09-19T09:19:13.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.840+0000 7faadfe01740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627f8a192c0 0x5627f8a37220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.840+0000 7faadfe01740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5627f8a1aa50 0x5627f8adc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.840+0000 7faadfe01740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5627f8a3f260 0x5627f8a3d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.840+0000 7faadfe01740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5627f8a43d10 con 0x5627f8a192c0 2024-09-19T09:19:13.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.840+0000 7faadfe01740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5627f8a3a3a0 con 0x5627f8a3f260 2024-09-19T09:19:13.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.840+0000 7faadfe01740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5627f8a38c30 con 0x5627f8a1aa50 2024-09-19T09:19:13.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.840+0000 7faadfe01740 10 client.0 _ll_register_callbacks cb 0x7faac8040050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:13.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.840+0000 7faad659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627f8a192c0 0x5627f8a37220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:13.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.840+0000 7faad659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627f8a192c0 0x5627f8a37220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33952/0 (socket says 172.21.15.18:33952) 2024-09-19T09:19:13.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.840+0000 7faad659c640 1 -- 172.21.15.18:0/3866353135 learned_addr learned my addr 172.21.15.18:0/3866353135 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:13.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.840+0000 7faacffff640 1 --2- 172.21.15.18:0/3866353135 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5627f8a1aa50 0x5627f8adc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:13.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.840+0000 7faad6d9d640 1 --2- 172.21.15.18:0/3866353135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5627f8a3f260 0x5627f8a3d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:13.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.840+0000 7faad659c640 1 -- 172.21.15.18:0/3866353135 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5627f8a1aa50 msgr2=0x5627f8adc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:13.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.840+0000 7faad659c640 1 --2- 172.21.15.18:0/3866353135 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5627f8a1aa50 0x5627f8adc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.840+0000 7faad659c640 1 -- 172.21.15.18:0/3866353135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5627f8a3f260 msgr2=0x5627f8a3d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:13.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.840+0000 7faad659c640 1 --2- 172.21.15.18:0/3866353135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5627f8a3f260 0x5627f8a3d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.840+0000 7faad659c640 1 -- 172.21.15.18:0/3866353135 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627f8a706f0 con 0x5627f8a192c0 2024-09-19T09:19:13.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.840+0000 7faad6d9d640 1 --2- 172.21.15.18:0/3866353135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5627f8a3f260 0x5627f8a3d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:13.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.840+0000 7faad659c640 1 --2- 172.21.15.18:0/3866353135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627f8a192c0 0x5627f8a37220 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7faac8004770 tx=0x7faac80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d267c371ee8123 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:13.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.840+0000 7faab57fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:19:13.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.840+0000 7faab57fa640 1 -- 172.21.15.18:0/3866353135 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faac8037070 con 0x5627f8a192c0 2024-09-19T09:19:13.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.840+0000 7faab57fa640 1 -- 172.21.15.18:0/3866353135 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7faac8052c40 con 0x5627f8a192c0 2024-09-19T09:19:13.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.840+0000 7faadfe01740 1 -- 172.21.15.18:0/3866353135 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faad0058a60 con 0x5627f8a192c0 2024-09-19T09:19:13.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.841+0000 7faab57fa640 1 -- 172.21.15.18:0/3866353135 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7faac8052e40 con 0x5627f8a192c0 2024-09-19T09:19:13.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.841+0000 7faadfe01740 10 client.6666 fetch_fsmap learned FSMap version 48 2024-09-19T09:19:13.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.841+0000 7faadfe01740 1 -- 172.21.15.18:0/3866353135 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) -- 0x5627f8adc630 con 0x5627f8a192c0 2024-09-19T09:19:13.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.841+0000 7faab57fa640 1 -- 172.21.15.18:0/3866353135 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faad0058a60 con 0x5627f8a192c0 2024-09-19T09:19:13.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.841+0000 7faab57fa640 1 -- 172.21.15.18:0/3866353135 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 48) ==== 3502+0+0 (secure 0 0 0) 0x7faac8065450 con 0x5627f8a192c0 2024-09-19T09:19:13.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.841+0000 7faadfe01740 10 client.6666 fetch_fsmap finished waiting for FSMap version 48 2024-09-19T09:19:13.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.841+0000 7faadfe01740 10 client.6666 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T09:19:13.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.841+0000 7faadfe01740 20 client.6666 populate_metadata read hostname 'smithi018' 2024-09-19T09:19:13.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.841+0000 7faadfe01740 1 --2- 172.21.15.18:0/3866353135 >> [v2:172.21.15.18:6834/2870064683,v1:172.21.15.18:6835/2870064683] conn(0x5627f8a5c330 0x5627f8a6c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.841+0000 7faadfe01740 4 client.6666 mds_command: new command op to 6549 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:19:13.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.841+0000 7faadfe01740 1 -- 172.21.15.18:0/3866353135 --> [v2:172.21.15.18:6834/2870064683,v1:172.21.15.18:6835/2870064683] -- command(tid 0: {"prefix": "status"}) -- 0x5627f8a42490 con 0x5627f8a5c330 2024-09-19T09:19:13.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.841+0000 7faacffff640 1 --2- 172.21.15.18:0/3866353135 >> [v2:172.21.15.18:6834/2870064683,v1:172.21.15.18:6835/2870064683] conn(0x5627f8a5c330 0x5627f8a6c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:13.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.841+0000 7faab57fa640 10 client.6666 ms_handle_connect on v2:172.21.15.18:6834/2870064683 2024-09-19T09:19:13.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.841+0000 7faacffff640 1 --2- 172.21.15.18:0/3866353135 >> [v2:172.21.15.18:6834/2870064683,v1:172.21.15.18:6835/2870064683] conn(0x5627f8a5c330 0x5627f8a6c5f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb59eb6f2b7aea19 server_cookie=f97cef658ca1f5e3 in_seq=0 out_seq=0 2024-09-19T09:19:13.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.842+0000 7faab57fa640 1 -- 172.21.15.18:0/3866353135 <== mds.0 v2:172.21.15.18:6834/2870064683 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5627f8a42490 con 0x5627f8a5c330 2024-09-19T09:19:13.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.842+0000 7faab57fa640 10 client.6666 handle_command_reply: tid=0 2024-09-19T09:19:13.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.842+0000 7faadfe01740 1 client.6666 shutdown 2024-09-19T09:19:13.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.842+0000 7faadfe01740 1 -- 172.21.15.18:0/3866353135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627f8a192c0 msgr2=0x5627f8a37220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:13.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.842+0000 7faadfe01740 1 --2- 172.21.15.18:0/3866353135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627f8a192c0 0x5627f8a37220 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7faac8004770 tx=0x7faac80046c0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.842+0000 7faadfe01740 1 -- 172.21.15.18:0/3866353135 shutdown_connections 2024-09-19T09:19:13.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.842+0000 7faadfe01740 1 --2- 172.21.15.18:0/3866353135 >> [v2:172.21.15.18:6834/2870064683,v1:172.21.15.18:6835/2870064683] conn(0x5627f8a5c330 0x5627f8a6c5f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.842+0000 7faadfe01740 1 --2- 172.21.15.18:0/3866353135 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5627f8a3f260 0x5627f8a3d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.842+0000 7faadfe01740 1 --2- 172.21.15.18:0/3866353135 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5627f8a1aa50 0x5627f8adc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.842+0000 7faab57fa640 0 client.6666 ms_handle_reset on v2:172.21.15.18:6834/2870064683 2024-09-19T09:19:13.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.842+0000 7faadfe01740 1 --2- 172.21.15.18:0/3866353135 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5627f8a192c0 0x5627f8a37220 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.842+0000 7faadfe01740 1 -- 172.21.15.18:0/3866353135 >> 172.21.15.18:0/3866353135 conn(0x5627f8a16a80 msgr2=0x5627f8a3e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:13.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.842+0000 7faadfe01740 1 -- 172.21.15.18:0/3866353135 shutdown_connections 2024-09-19T09:19:13.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.842+0000 7faadfe01740 1 -- 172.21.15.18:0/3866353135 wait complete. 2024-09-19T09:19:13.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.842+0000 7faadfe01740 20 client.6666 trim_cache size 0 max 16384 2024-09-19T09:19:13.850 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:19:13.850 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:19:13.850 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-09-19T09:19:13.850 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 6549, 2024-09-19T09:19:13.850 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-19T09:19:13.850 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-19T09:19:13.851 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-19T09:19:13.851 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 4.6589504819999998, 2024-09-19T09:19:13.851 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 48, 2024-09-19T09:19:13.851 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 123, 2024-09-19T09:19:13.851 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 123, 2024-09-19T09:19:13.851 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 9.778773374 2024-09-19T09:19:13.851 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:19:13.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.843+0000 7faadcf8d640 1 -- 172.21.15.18:0/1310396164 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faab806c2b0 msgr2=0x7faab806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:13.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.843+0000 7faadcf8d640 1 --2- 172.21.15.18:0/1310396164 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faab806c2b0 0x7faab806e770 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7faac8034000 tx=0x7faac802e000 comp rx=0 tx=0).stop 2024-09-19T09:19:13.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.843+0000 7faadcf8d640 1 -- 172.21.15.18:0/1310396164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faad815cbb0 msgr2=0x7faad80c62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:13.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.843+0000 7faadcf8d640 1 --2- 172.21.15.18:0/1310396164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faad815cbb0 0x7faad80c62c0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7faad000c780 tx=0x7faad000cb80 comp rx=0 tx=0).stop 2024-09-19T09:19:13.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.843+0000 7faadcf8d640 1 -- 172.21.15.18:0/1310396164 shutdown_connections 2024-09-19T09:19:13.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.843+0000 7faadcf8d640 1 --2- 172.21.15.18:0/1310396164 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faab806c2b0 0x7faab806e770 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.843+0000 7faadcf8d640 1 --2- 172.21.15.18:0/1310396164 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faad815cbb0 0x7faad80c62c0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.843+0000 7faadcf8d640 1 --2- 172.21.15.18:0/1310396164 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faad80cf9b0 0x7faad806cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.843+0000 7faadcf8d640 1 --2- 172.21.15.18:0/1310396164 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faad80b1ba0 0x7faad81595c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.843+0000 7faadcf8d640 1 -- 172.21.15.18:0/1310396164 >> 172.21.15.18:0/1310396164 conn(0x7faad80b45f0 msgr2=0x7faad8155f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:13.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.843+0000 7faadcf8d640 1 -- 172.21.15.18:0/1310396164 shutdown_connections 2024-09-19T09:19:13.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.843+0000 7faadcf8d640 1 -- 172.21.15.18:0/1310396164 wait complete. 2024-09-19T09:19:13.855 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T09:19:13.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.955+0000 7f5113296640 1 Processor -- start 2024-09-19T09:19:13.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.955+0000 7f5113296640 1 -- start start 2024-09-19T09:19:13.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.956+0000 7f5113296640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f510c15ef50 0x7f510c0d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.956+0000 7f5113296640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f510c0d3240 0x7f510c0d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.956+0000 7f5113296640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f510c0b7a90 con 0x7f510c0d5780 2024-09-19T09:19:13.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.956+0000 7f5113296640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f510c0d3740 con 0x7f510c0d3240 2024-09-19T09:19:13.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.956+0000 7f5113296640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f510c0d3a20 con 0x7f510c15ef50 2024-09-19T09:19:13.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.956+0000 7f5110831640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f510c0d3240 0x7f510c0d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:13.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.956+0000 7f5110831640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f510c0d3240 0x7f510c0d18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33962/0 (socket says 172.21.15.18:33962) 2024-09-19T09:19:13.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.956+0000 7f5110831640 1 -- 172.21.15.18:0/641733286 learned_addr learned my addr 172.21.15.18:0/641733286 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:13.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.957+0000 7f5111032640 1 --2- 172.21.15.18:0/641733286 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f510c15ef50 0x7f510c0d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:13.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.957+0000 7f5110831640 1 -- 172.21.15.18:0/641733286 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f510c15ef50 msgr2=0x7f510c0d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:13.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.957+0000 7f5110831640 1 --2- 172.21.15.18:0/641733286 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f510c15ef50 0x7f510c0d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.957+0000 7f5110831640 1 -- 172.21.15.18:0/641733286 >> v1:172.21.15.162:6789/0 conn(0x7f510c0d5780 legacy=0x7f510c0cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:13.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.957+0000 7f5110831640 1 -- 172.21.15.18:0/641733286 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f510c0b7d00 con 0x7f510c0d3240 2024-09-19T09:19:13.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.957+0000 7f5110831640 1 --2- 172.21.15.18:0/641733286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f510c0d3240 0x7f510c0d18e0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f5100009870 tx=0x7f510002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aa74d40b0e6afe9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:13.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.958+0000 7f510bfff640 1 -- 172.21.15.18:0/641733286 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5100037070 con 0x7f510c0d3240 2024-09-19T09:19:13.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.958+0000 7f510bfff640 1 -- 172.21.15.18:0/641733286 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5100032440 con 0x7f510c0d3240 2024-09-19T09:19:13.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.958+0000 7f510bfff640 1 -- 172.21.15.18:0/641733286 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5100032810 con 0x7f510c0d3240 2024-09-19T09:19:13.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.958+0000 7f5113296640 1 -- 172.21.15.18:0/641733286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f510c0d3240 msgr2=0x7f510c0d18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:13.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.958+0000 7f5113296640 1 --2- 172.21.15.18:0/641733286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f510c0d3240 0x7f510c0d18e0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f5100009870 tx=0x7f510002a1c0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.958+0000 7f5113296640 1 -- 172.21.15.18:0/641733286 shutdown_connections 2024-09-19T09:19:13.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.958+0000 7f5113296640 1 --2- 172.21.15.18:0/641733286 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f510c0d3240 0x7f510c0d18e0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.958+0000 7f5113296640 1 --2- 172.21.15.18:0/641733286 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f510c15ef50 0x7f510c0d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.958+0000 7f5113296640 1 -- 172.21.15.18:0/641733286 >> 172.21.15.18:0/641733286 conn(0x7f510c0d4c60 msgr2=0x7f510c0d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:13.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.958+0000 7f5113296640 1 -- 172.21.15.18:0/641733286 shutdown_connections 2024-09-19T09:19:13.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.958+0000 7f5113296640 1 -- 172.21.15.18:0/641733286 wait complete. 2024-09-19T09:19:13.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.960+0000 7f5113296640 1 Processor -- start 2024-09-19T09:19:13.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.960+0000 7f5113296640 1 -- start start 2024-09-19T09:19:13.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.960+0000 7f5113296640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f510c0d3240 0x7f510c0c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.960+0000 7f5113296640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f510c0d5780 0x7f510c152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.960+0000 7f5113296640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f510c15ef50 0x7f510c0cb120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.960+0000 7f5113296640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f510c0d21a0 con 0x7f510c0d5780 2024-09-19T09:19:13.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.960+0000 7f5113296640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f510c0d2020 con 0x7f510c15ef50 2024-09-19T09:19:13.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.960+0000 7f5113296640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f510c0b9510 con 0x7f510c0d3240 2024-09-19T09:19:13.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.960+0000 7f5110831640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f510c0d5780 0x7f510c152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:13.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.961+0000 7f5110831640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f510c0d5780 0x7f510c152040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33978/0 (socket says 172.21.15.18:33978) 2024-09-19T09:19:13.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.961+0000 7f5110831640 1 -- 172.21.15.18:0/3812329344 learned_addr learned my addr 172.21.15.18:0/3812329344 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:13.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.961+0000 7f5111032640 1 --2- 172.21.15.18:0/3812329344 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f510c0d3240 0x7f510c0c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:13.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.961+0000 7f5111833640 1 --2- 172.21.15.18:0/3812329344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f510c15ef50 0x7f510c0cb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:13.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.961+0000 7f5110831640 1 -- 172.21.15.18:0/3812329344 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f510c0d3240 msgr2=0x7f510c0c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:13.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.961+0000 7f5110831640 1 --2- 172.21.15.18:0/3812329344 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f510c0d3240 0x7f510c0c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.961+0000 7f5110831640 1 -- 172.21.15.18:0/3812329344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f510c15ef50 msgr2=0x7f510c0cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:13.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.961+0000 7f5110831640 1 --2- 172.21.15.18:0/3812329344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f510c15ef50 0x7f510c0cb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:13.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.961+0000 7f5110831640 1 -- 172.21.15.18:0/3812329344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f510c0c9210 con 0x7f510c0d5780 2024-09-19T09:19:13.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.961+0000 7f5110831640 1 --2- 172.21.15.18:0/3812329344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f510c0d5780 0x7f510c152040 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f510002a200 tx=0x7f51000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:13.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.961+0000 7f5109ffb640 1 -- 172.21.15.18:0/3812329344 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5100041020 con 0x7f510c0d5780 2024-09-19T09:19:13.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.961+0000 7f5109ffb640 1 -- 172.21.15.18:0/3812329344 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51000306c0 con 0x7f510c0d5780 2024-09-19T09:19:13.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.961+0000 7f5109ffb640 1 -- 172.21.15.18:0/3812329344 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5100037040 con 0x7f510c0d5780 2024-09-19T09:19:13.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.961+0000 7f5113296640 1 -- 172.21.15.18:0/3812329344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f510c0c94f0 con 0x7f510c0d5780 2024-09-19T09:19:13.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.961+0000 7f5113296640 1 -- 172.21.15.18:0/3812329344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f510c0c9ab0 con 0x7f510c0d5780 2024-09-19T09:19:13.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.962+0000 7f5113296640 1 -- 172.21.15.18:0/3812329344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f510c0cccd0 con 0x7f510c0d5780 2024-09-19T09:19:13.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.963+0000 7f5109ffb640 1 -- 172.21.15.18:0/3812329344 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5100044020 con 0x7f510c0d5780 2024-09-19T09:19:13.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.963+0000 7f5109ffb640 1 --2- 172.21.15.18:0/3812329344 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f50f806c2b0 0x7f50f806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:13.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.963+0000 7f5109ffb640 1 -- 172.21.15.18:0/3812329344 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f51000aba70 con 0x7f510c0d5780 2024-09-19T09:19:13.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.964+0000 7f5111032640 1 --2- 172.21.15.18:0/3812329344 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f50f806c2b0 0x7f50f806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:13.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.964+0000 7f5111032640 1 --2- 172.21.15.18:0/3812329344 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f50f806c2b0 0x7f50f806e770 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f51040079a0 tx=0x7f5104008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:13.969 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:13.968+0000 7f5109ffb640 1 -- 172.21.15.18:0/3812329344 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f510c0cccd0 con 0x7f510c0d5780 2024-09-19T09:19:14.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:14.177+0000 7f5113296640 1 -- 172.21.15.18:0/3812329344 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f510c0d13a0 con 0x7f510c0d5780 2024-09-19T09:19:14.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:14.178+0000 7f5109ffb640 1 -- 172.21.15.18:0/3812329344 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) ==== 53+0+73 (secure 0 0 0) 0x7f510004b030 con 0x7f510c0d5780 2024-09-19T09:19:14.180 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T09:19:14.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:14.180+0000 7f5113296640 1 -- 172.21.15.18:0/3812329344 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f50f806c2b0 msgr2=0x7f50f806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:14.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:14.180+0000 7f5113296640 1 --2- 172.21.15.18:0/3812329344 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f50f806c2b0 0x7f50f806e770 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f51040079a0 tx=0x7f5104008040 comp rx=0 tx=0).stop 2024-09-19T09:19:14.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:14.180+0000 7f5113296640 1 -- 172.21.15.18:0/3812329344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f510c0d5780 msgr2=0x7f510c152040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:14.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:14.180+0000 7f5113296640 1 --2- 172.21.15.18:0/3812329344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f510c0d5780 0x7f510c152040 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f510002a200 tx=0x7f51000046c0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:14.180+0000 7f5113296640 1 -- 172.21.15.18:0/3812329344 shutdown_connections 2024-09-19T09:19:14.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:14.180+0000 7f5113296640 1 --2- 172.21.15.18:0/3812329344 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f50f806c2b0 0x7f50f806e770 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:14.180+0000 7f5113296640 1 --2- 172.21.15.18:0/3812329344 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f510c15ef50 0x7f510c0cb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:14.180+0000 7f5113296640 1 --2- 172.21.15.18:0/3812329344 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f510c0d5780 0x7f510c152040 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:14.180+0000 7f5113296640 1 --2- 172.21.15.18:0/3812329344 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f510c0d3240 0x7f510c0c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:14.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:14.180+0000 7f5113296640 1 -- 172.21.15.18:0/3812329344 >> 172.21.15.18:0/3812329344 conn(0x7f510c0d4c60 msgr2=0x7f510c06d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:14.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:14.180+0000 7f5113296640 1 -- 172.21.15.18:0/3812329344 shutdown_connections 2024-09-19T09:19:14.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:14.180+0000 7f5113296640 1 -- 172.21.15.18:0/3812329344 wait complete. 2024-09-19T09:19:14.192 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-19T09:19:14.193 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:19:14.193 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-09-19T09:19:14.193 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T09:19:14.193 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:19:14.193 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-19T09:19:14.193 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-19T09:19:14.193 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:19:14.193 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:19:14.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:14.193 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-09-19T09:19:14.210 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:19:14.210 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:19:14.211 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:19:14.211 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:19:14.211 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-09-19T09:19:14.211 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:19:14.211 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:19:14.212 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:19:14.212 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-09-19T09:19:14.212 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:19:14.212 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:19:14.212 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-09-19T09:19:14.212 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:19:14.212 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:19:14.212 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-09-19T09:19:14.212 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T09:19:14.213 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42443sec preferred_lft 42443sec 2024-09-19T09:19:14.213 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-09-19T09:19:14.213 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:19:14.213 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:19:14.213 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:19:14.213 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-09-19T09:19:14.213 INFO:teuthology.orchestra.run.smithi018.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T09:19:14.213 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:44:1b:02:86:87 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:19:14.213 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T09:19:14.213 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:19:14.213 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::a0ce:faff:feaa:13ec/64 scope link 2024-09-19T09:19:14.213 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:19:14.213 INFO:teuthology.orchestra.run.smithi018.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:19:14.213 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:44:1b:02:86:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:19:14.214 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::44:1bff:fe02:8687/64 scope link 2024-09-19T09:19:14.214 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:19:14.214 INFO:teuthology.orchestra.run.smithi018.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:19:14.214 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether e2:6d:c4:af:6a:8b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T09:19:14.214 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::e06d:c4ff:feaf:6a8b/64 scope link 2024-09-19T09:19:14.214 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:19:14.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:14.214 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:19:14.275 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-09-19T09:19:14.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:14.277 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-09-19T09:19:14.335 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-09-19T09:19:14.335 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:19:14.335 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T09:19:14.335 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T09:19:14.336 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:19:14.336 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:19:14.336 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T09:19:14.336 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T09:19:14.336 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T09:19:14.336 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T09:19:14.336 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T09:19:14.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:19:14.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:19:14.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:14.464 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-19T09:19:14.479 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-19T09:19:14.480 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T09:19:14.480 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:19:14.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:14.480 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-09-19T09:19:14.546 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:19:14.546 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T09:19:14.602 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:19:14.603 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:19:14.603 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:19:14.658 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-19T09:19:14.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:14.658 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:19:14.744 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:19:14.745 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:19:14.745 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:19:14.753 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:19:14.754 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:19:14.754 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:19:14.754 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:19:14.754 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:19:14.759 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:19:14.759 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:19:14.759 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:19:14.759 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:19:14.759 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:19:14.759 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-19T09:19:14.759 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-19T09:19:14.760 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fec66d7e-50e5-42ed-81de-ad141a2f0f4e" will pass to kernel 2024-09-19T09:19:14.760 INFO:teuthology.orchestra.run.smithi018.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-19T09:19:14.760 INFO:teuthology.orchestra.run.smithi018.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:19:14.760 INFO:teuthology.orchestra.run.smithi018.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:19:14.760 INFO:teuthology.orchestra.run.smithi018.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:19:14.760 INFO:teuthology.orchestra.run.smithi018.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:19:14.762 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:19:14.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:14.762 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:19:14.787 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:19:14.852 INFO:tasks.ceph.mds.c.smithi018.stderr:2024-09-19T09:19:14.850+0000 7f3e793b5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T09:19:14.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:19:14.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:19:14.890 INFO:teuthology.orchestra.run.smithi018.stdout:client6343 2024-09-19T09:19:14.890 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:19:14.890 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:19:14.947 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T09:19:15.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.088+0000 7ff9b9e5c640 1 Processor -- start 2024-09-19T09:19:15.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.088+0000 7ff9b9e5c640 1 -- start start 2024-09-19T09:19:15.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.089+0000 7ff9b9e5c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff9b4142150 0x7ff9b4160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:15.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.089+0000 7ff9b9e5c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9b4160a80 0x7ff9b40cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:15.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.089+0000 7ff9b9e5c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9b4142650 con 0x7ff9b413fae0 2024-09-19T09:19:15.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.089+0000 7ff9b9e5c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff9b40ce780 con 0x7ff9b4142150 2024-09-19T09:19:15.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.089+0000 7ff9b9e5c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff9b4142930 con 0x7ff9b4160a80 2024-09-19T09:19:15.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.089+0000 7ff9b3fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9b4160a80 0x7ff9b40cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:15.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.089+0000 7ff9b2ffd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff9b4142150 0x7ff9b4160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:15.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.089+0000 7ff9b3fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9b4160a80 0x7ff9b40cec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:34158/0 (socket says 172.21.15.18:34158) 2024-09-19T09:19:15.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.089+0000 7ff9b37fe640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7ff9b413fae0 0x7ff9b406f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:57696/0 (socket says 172.21.15.18:57696) 2024-09-19T09:19:15.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.089+0000 7ff9b3fff640 1 -- 172.21.15.18:0/1415689552 learned_addr learned my addr 172.21.15.18:0/1415689552 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:15.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.089+0000 7ff9b2ffd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff9b4142150 0x7ff9b4160540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:46026/0 (socket says 172.21.15.18:46026) 2024-09-19T09:19:15.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.089+0000 7ff9b27fc640 1 -- 172.21.15.18:0/1415689552 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3674542335 0 0) 0x7ff9b4142650 con 0x7ff9b413fae0 2024-09-19T09:19:15.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.089+0000 7ff9b27fc640 1 -- 172.21.15.18:0/1415689552 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9a0003520 con 0x7ff9b413fae0 2024-09-19T09:19:15.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.090+0000 7ff9b3fff640 1 -- 172.21.15.18:0/1415689552 >> v2:172.21.15.162:3300/0 conn(0x7ff9b4142150 msgr2=0x7ff9b4160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:15.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.090+0000 7ff9b3fff640 1 --2- 172.21.15.18:0/1415689552 >> v2:172.21.15.162:3300/0 conn(0x7ff9b4142150 0x7ff9b4160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.090+0000 7ff9b3fff640 1 -- 172.21.15.18:0/1415689552 >> v1:172.21.15.162:6789/0 conn(0x7ff9b413fae0 legacy=0x7ff9b406f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:15.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.090+0000 7ff9b3fff640 1 -- 172.21.15.18:0/1415689552 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b4142c10 con 0x7ff9b4160a80 2024-09-19T09:19:15.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.090+0000 7ff9b2ffd640 1 --2- 172.21.15.18:0/1415689552 >> v2:172.21.15.162:3300/0 conn(0x7ff9b4142150 0x7ff9b4160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:15.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.090+0000 7ff9b3fff640 1 --2- 172.21.15.18:0/1415689552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9b4160a80 0x7ff9b40cec10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009e50 tx=0x7ff9ac02a6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb4780cc5997419e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:15.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.090+0000 7ff9b27fc640 1 -- 172.21.15.18:0/1415689552 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac036070 con 0x7ff9b4160a80 2024-09-19T09:19:15.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.091+0000 7ff9b27fc640 1 -- 172.21.15.18:0/1415689552 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9ac031600 con 0x7ff9b4160a80 2024-09-19T09:19:15.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.091+0000 7ff9b27fc640 1 -- 172.21.15.18:0/1415689552 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ac0319d0 con 0x7ff9b4160a80 2024-09-19T09:19:15.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.091+0000 7ff9b9e5c640 1 -- 172.21.15.18:0/1415689552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9b4160a80 msgr2=0x7ff9b40cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:15.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.091+0000 7ff9b9e5c640 1 --2- 172.21.15.18:0/1415689552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9b4160a80 0x7ff9b40cec10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac009e50 tx=0x7ff9ac02a6a0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.091+0000 7ff9b9e5c640 1 -- 172.21.15.18:0/1415689552 shutdown_connections 2024-09-19T09:19:15.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.091+0000 7ff9b9e5c640 1 --2- 172.21.15.18:0/1415689552 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9b4160a80 0x7ff9b40cec10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.091+0000 7ff9b9e5c640 1 --2- 172.21.15.18:0/1415689552 >> v2:172.21.15.162:3300/0 conn(0x7ff9b4142150 0x7ff9b4160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.091+0000 7ff9b9e5c640 1 -- 172.21.15.18:0/1415689552 >> 172.21.15.18:0/1415689552 conn(0x7ff9b406bc10 msgr2=0x7ff9b406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:15.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.091+0000 7ff9b9e5c640 1 -- 172.21.15.18:0/1415689552 shutdown_connections 2024-09-19T09:19:15.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.091+0000 7ff9b9e5c640 1 -- 172.21.15.18:0/1415689552 wait complete. 2024-09-19T09:19:15.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.092+0000 7ff9b9e5c640 1 Processor -- start 2024-09-19T09:19:15.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.092+0000 7ff9b9e5c640 1 -- start start 2024-09-19T09:19:15.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.093+0000 7ff9b9e5c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9b413fae0 0x7ff9b413ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:15.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.093+0000 7ff9b9e5c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9b4142150 0x7ff9b4144490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:15.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.093+0000 7ff9b9e5c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9b4160a80 0x7ff9b4145c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:15.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.093+0000 7ff9b9e5c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b40cf2d0 con 0x7ff9b4142150 2024-09-19T09:19:15.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.093+0000 7ff9b9e5c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b40cf150 con 0x7ff9b413fae0 2024-09-19T09:19:15.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.093+0000 7ff9b9e5c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff9b40cf450 con 0x7ff9b4160a80 2024-09-19T09:19:15.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.093+0000 7ff9b2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9b4142150 0x7ff9b4144490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:15.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.093+0000 7ff9b2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9b4142150 0x7ff9b4144490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33994/0 (socket says 172.21.15.18:33994) 2024-09-19T09:19:15.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.093+0000 7ff9b2ffd640 1 -- 172.21.15.18:0/1049320076 learned_addr learned my addr 172.21.15.18:0/1049320076 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:15.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.093+0000 7ff9b3fff640 1 --2- 172.21.15.18:0/1049320076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9b4160a80 0x7ff9b4145c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:15.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.093+0000 7ff9b37fe640 1 --2- 172.21.15.18:0/1049320076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9b413fae0 0x7ff9b413ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:15.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.094+0000 7ff9b2ffd640 1 -- 172.21.15.18:0/1049320076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9b4160a80 msgr2=0x7ff9b4145c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:15.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.094+0000 7ff9b2ffd640 1 --2- 172.21.15.18:0/1049320076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9b4160a80 0x7ff9b4145c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.094+0000 7ff9b2ffd640 1 -- 172.21.15.18:0/1049320076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9b413fae0 msgr2=0x7ff9b413ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:15.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.094+0000 7ff9b2ffd640 1 --2- 172.21.15.18:0/1049320076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9b413fae0 0x7ff9b413ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.094+0000 7ff9b2ffd640 1 -- 172.21.15.18:0/1049320076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b41f4260 con 0x7ff9b4142150 2024-09-19T09:19:15.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.094+0000 7ff9b2ffd640 1 --2- 172.21.15.18:0/1049320076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9b4142150 0x7ff9b4144490 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7ff99c012fc0 tx=0x7ff99c010490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:15.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.094+0000 7ff9abfff640 1 -- 172.21.15.18:0/1049320076 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c010da0 con 0x7ff9b4142150 2024-09-19T09:19:15.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.094+0000 7ff9abfff640 1 -- 172.21.15.18:0/1049320076 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff99c01d070 con 0x7ff9b4142150 2024-09-19T09:19:15.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.094+0000 7ff9b9e5c640 1 -- 172.21.15.18:0/1049320076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9b41433f0 con 0x7ff9b4142150 2024-09-19T09:19:15.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.094+0000 7ff9abfff640 1 -- 172.21.15.18:0/1049320076 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c0186a0 con 0x7ff9b4142150 2024-09-19T09:19:15.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.094+0000 7ff9b9e5c640 1 -- 172.21.15.18:0/1049320076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9b41439b0 con 0x7ff9b4142150 2024-09-19T09:19:15.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.095+0000 7ff9b9e5c640 1 -- 172.21.15.18:0/1049320076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9b4160540 con 0x7ff9b4142150 2024-09-19T09:19:15.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.096+0000 7ff9abfff640 1 -- 172.21.15.18:0/1049320076 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff99c016050 con 0x7ff9b4142150 2024-09-19T09:19:15.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.096+0000 7ff9abfff640 1 --2- 172.21.15.18:0/1049320076 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff99406c2e0 0x7ff99406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:15.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.096+0000 7ff9abfff640 1 -- 172.21.15.18:0/1049320076 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7ff99c08f1e0 con 0x7ff9b4142150 2024-09-19T09:19:15.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.096+0000 7ff9b37fe640 1 --2- 172.21.15.18:0/1049320076 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff99406c2e0 0x7ff99406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:15.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.097+0000 7ff9b37fe640 1 --2- 172.21.15.18:0/1049320076 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff99406c2e0 0x7ff99406e7a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4000f60 tx=0x7ff9a4007cf0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:15.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.100+0000 7ff9abfff640 1 -- 172.21.15.18:0/1049320076 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff99c026020 con 0x7ff9b4142150 2024-09-19T09:19:15.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.311+0000 7ff9b9e5c640 1 -- 172.21.15.18:0/1049320076 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff9b4074f10 con 0x7ff9b4142150 2024-09-19T09:19:15.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.311+0000 7ff9abfff640 1 -- 172.21.15.18:0/1049320076 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) ==== 53+0+73 (secure 0 0 0) 0x7ff99c014040 con 0x7ff9b4142150 2024-09-19T09:19:15.313 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T09:19:15.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.313+0000 7ff9b9e5c640 1 -- 172.21.15.18:0/1049320076 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff99406c2e0 msgr2=0x7ff99406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:15.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.313+0000 7ff9b9e5c640 1 --2- 172.21.15.18:0/1049320076 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff99406c2e0 0x7ff99406e7a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4000f60 tx=0x7ff9a4007cf0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.313+0000 7ff9b9e5c640 1 -- 172.21.15.18:0/1049320076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9b4142150 msgr2=0x7ff9b4144490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:15.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.313+0000 7ff9b9e5c640 1 --2- 172.21.15.18:0/1049320076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9b4142150 0x7ff9b4144490 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7ff99c012fc0 tx=0x7ff99c010490 comp rx=0 tx=0).stop 2024-09-19T09:19:15.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.313+0000 7ff9b9e5c640 1 -- 172.21.15.18:0/1049320076 shutdown_connections 2024-09-19T09:19:15.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.313+0000 7ff9b9e5c640 1 --2- 172.21.15.18:0/1049320076 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff99406c2e0 0x7ff99406e7a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.313+0000 7ff9b9e5c640 1 --2- 172.21.15.18:0/1049320076 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff9b4160a80 0x7ff9b4145c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.313+0000 7ff9b9e5c640 1 --2- 172.21.15.18:0/1049320076 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff9b4142150 0x7ff9b4144490 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.313+0000 7ff9b9e5c640 1 --2- 172.21.15.18:0/1049320076 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff9b413fae0 0x7ff9b413ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:15.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.313+0000 7ff9b9e5c640 1 -- 172.21.15.18:0/1049320076 >> 172.21.15.18:0/1049320076 conn(0x7ff9b406bc10 msgr2=0x7ff9b40cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:15.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.313+0000 7ff9b9e5c640 1 -- 172.21.15.18:0/1049320076 shutdown_connections 2024-09-19T09:19:15.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:15.313+0000 7ff9b9e5c640 1 -- 172.21.15.18:0/1049320076 wait complete. 2024-09-19T09:19:15.326 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-19T09:19:15.326 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:19:15.326 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-09-19T09:19:15.326 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-19T09:19:15.326 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-19T09:19:15.326 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-19T09:19:15.326 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-19T09:19:15.326 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:19:15.326 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:19:15.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:15.327 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-09-19T09:19:15.350 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:19:15.351 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:19:15.351 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:19:15.351 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:19:15.351 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-09-19T09:19:15.351 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:19:15.351 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:19:15.351 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:19:15.351 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-09-19T09:19:15.351 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:19:15.351 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:19:15.351 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-09-19T09:19:15.351 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:19:15.352 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:19:15.352 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:19:15.352 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:19:15.352 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T09:19:15.352 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42453sec preferred_lft 42453sec 2024-09-19T09:19:15.352 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link noprefixroute 2024-09-19T09:19:15.352 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:19:15.352 INFO:teuthology.orchestra.run.smithi162.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T09:19:15.352 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 5e:4d:7e:1d:19:f9 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:19:15.352 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T09:19:15.352 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:19:15.352 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::5829:65ff:fe01:6bc7/64 scope link 2024-09-19T09:19:15.352 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:19:15.353 INFO:teuthology.orchestra.run.smithi162.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:19:15.353 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 86:86:3e:32:67:c5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T09:19:15.353 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::8486:3eff:fe32:67c5/64 scope link 2024-09-19T09:19:15.353 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:19:15.353 INFO:teuthology.orchestra.run.smithi162.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:19:15.353 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 5e:4d:7e:1d:19:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-19T09:19:15.353 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::5c4d:7eff:fe1d:19f9/64 scope link 2024-09-19T09:19:15.353 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:19:15.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:15.353 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:19:15.418 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-09-19T09:19:15.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:15.420 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-09-19T09:19:15.478 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-09-19T09:19:15.478 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:19:15.478 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T09:19:15.478 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T09:19:15.478 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:19:15.479 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:19:15.479 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-19T09:19:15.479 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T09:19:15.479 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T09:19:15.479 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T09:19:15.479 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-19T09:19:15.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:19:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:19:15.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:19:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:19:15.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:15.618 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-19T09:19:15.634 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-19T09:19:15.634 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-19T09:19:15.635 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:19:15.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:15.635 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2024-09-19T09:19:15.700 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:19:15.700 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-19T09:19:15.756 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:19:15.756 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:19:15.756 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-19T09:19:15.812 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-19T09:19:15.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:15.812 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:19:15.896 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:19:15.896 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:19:15.896 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:19:15.905 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:19:15.905 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:19:15.905 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:19:15.905 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:19:15.905 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:19:15.914 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:19:15.915 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:19:15.915 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:19:15.915 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:19:15.915 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:19:15.915 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-19T09:19:15.915 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-19T09:19:15.915 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=fec66d7e-50e5-42ed-81de-ad141a2f0f4e" will pass to kernel 2024-09-19T09:19:15.916 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-19T09:19:15.916 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:19:15.916 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:19:15.916 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:19:15.916 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:19:15.917 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:19:15.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:15.917 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-19T09:19:15.942 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:19:16.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:19:16 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:19:16.031 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:19:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:19:16.037 INFO:teuthology.orchestra.run.smithi162.stdout:client6355 2024-09-19T09:19:16.037 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:19:16.037 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:19:16.054 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:19:16.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.163+0000 7f7c91a96640 1 Processor -- start 2024-09-19T09:19:16.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.163+0000 7f7c91a96640 1 -- start start 2024-09-19T09:19:16.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.164+0000 7f7c91a96640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7c8c0b5670 0x7f7c8c0ce250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:16.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.164+0000 7f7c91a96640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7c8c0ce790 0x7f7c8c0cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:16.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.164+0000 7f7c91a96640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c8c15cfa0 con 0x7f7c8c15fd50 2024-09-19T09:19:16.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.164+0000 7f7c91a96640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f7c8c15d280 con 0x7f7c8c0ce790 2024-09-19T09:19:16.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.164+0000 7f7c91a96640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f7c8c15d560 con 0x7f7c8c0b5670 2024-09-19T09:19:16.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.164+0000 7f7c8bfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7c8c0ce790 0x7f7c8c0cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:16.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.164+0000 7f7c8b7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f7c8c15fd50 0x7f7c8c0b4f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34604/0 (socket says 172.21.15.18:34604) 2024-09-19T09:19:16.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.164+0000 7f7c8b7fe640 1 -- 172.21.15.18:0/1072210280 learned_addr learned my addr 172.21.15.18:0/1072210280 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:16.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.164+0000 7f7c8affd640 1 --2- 172.21.15.18:0/1072210280 >> v2:172.21.15.162:3300/0 conn(0x7f7c8c0b5670 0x7f7c8c0ce250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:16.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.164+0000 7f7c8bfff640 1 -- 172.21.15.18:0/1072210280 >> v2:172.21.15.162:3300/0 conn(0x7f7c8c0b5670 msgr2=0x7f7c8c0ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:16.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.164+0000 7f7c8bfff640 1 --2- 172.21.15.18:0/1072210280 >> v2:172.21.15.162:3300/0 conn(0x7f7c8c0b5670 0x7f7c8c0ce250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.164+0000 7f7c8bfff640 1 -- 172.21.15.18:0/1072210280 >> v1:172.21.15.18:6789/0 conn(0x7f7c8c15fd50 legacy=0x7f7c8c0b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:16.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.164+0000 7f7c8bfff640 1 -- 172.21.15.18:0/1072210280 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c8c15d840 con 0x7f7c8c0ce790 2024-09-19T09:19:16.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.165+0000 7f7c8bfff640 1 --2- 172.21.15.18:0/1072210280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c8c0ce790 0x7f7c8c0cce30 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c0b5f40 tx=0x7f7c8402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd19d1957fb97896 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:16.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.165+0000 7f7c8a7fc640 1 -- 172.21.15.18:0/1072210280 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c84007740 con 0x7f7c8c0ce790 2024-09-19T09:19:16.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.165+0000 7f7c8a7fc640 1 -- 172.21.15.18:0/1072210280 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c840078e0 con 0x7f7c8c0ce790 2024-09-19T09:19:16.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.165+0000 7f7c8a7fc640 1 -- 172.21.15.18:0/1072210280 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c84007cb0 con 0x7f7c8c0ce790 2024-09-19T09:19:16.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.166+0000 7f7c91a96640 1 -- 172.21.15.18:0/1072210280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c8c0ce790 msgr2=0x7f7c8c0cce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:16.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.166+0000 7f7c91a96640 1 --2- 172.21.15.18:0/1072210280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c8c0ce790 0x7f7c8c0cce30 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c0b5f40 tx=0x7f7c8402a680 comp rx=0 tx=0).stop 2024-09-19T09:19:16.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.166+0000 7f7c91a96640 1 -- 172.21.15.18:0/1072210280 shutdown_connections 2024-09-19T09:19:16.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.166+0000 7f7c91a96640 1 --2- 172.21.15.18:0/1072210280 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c8c0ce790 0x7f7c8c0cce30 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.166+0000 7f7c91a96640 1 --2- 172.21.15.18:0/1072210280 >> v2:172.21.15.162:3300/0 conn(0x7f7c8c0b5670 0x7f7c8c0ce250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.166+0000 7f7c91a96640 1 -- 172.21.15.18:0/1072210280 >> 172.21.15.18:0/1072210280 conn(0x7f7c8c0b2b50 msgr2=0x7f7c8c0b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:16.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.166+0000 7f7c91a96640 1 -- 172.21.15.18:0/1072210280 shutdown_connections 2024-09-19T09:19:16.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.166+0000 7f7c91a96640 1 -- 172.21.15.18:0/1072210280 wait complete. 2024-09-19T09:19:16.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.167+0000 7f7c91a96640 1 Processor -- start 2024-09-19T09:19:16.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.167+0000 7f7c91a96640 1 -- start start 2024-09-19T09:19:16.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.168+0000 7f7c91a96640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c8c0b5670 0x7f7c8c1f7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:16.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.168+0000 7f7c91a96640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c8c0ce790 0x7f7c8c15a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:16.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.168+0000 7f7c91a96640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c8c15fd50 0x7f7c8c1552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:16.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.168+0000 7f7c91a96640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8c160130 con 0x7f7c8c0ce790 2024-09-19T09:19:16.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.168+0000 7f7c91a96640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7c8c0cec00 con 0x7f7c8c15fd50 2024-09-19T09:19:16.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.168+0000 7f7c91a96640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7c8c0cd370 con 0x7f7c8c0b5670 2024-09-19T09:19:16.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.168+0000 7f7c8affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c8c0ce790 0x7f7c8c15a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:16.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.168+0000 7f7c8affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c8c0ce790 0x7f7c8c15a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36126/0 (socket says 172.21.15.18:36126) 2024-09-19T09:19:16.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.168+0000 7f7c8affd640 1 -- 172.21.15.18:0/3224988468 learned_addr learned my addr 172.21.15.18:0/3224988468 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:16.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.168+0000 7f7c8bfff640 1 --2- 172.21.15.18:0/3224988468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c8c15fd50 0x7f7c8c1552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:16.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.168+0000 7f7c8b7fe640 1 --2- 172.21.15.18:0/3224988468 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c8c0b5670 0x7f7c8c1f7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:16.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.168+0000 7f7c8affd640 1 -- 172.21.15.18:0/3224988468 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c8c0b5670 msgr2=0x7f7c8c1f7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:16.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.168+0000 7f7c8affd640 1 --2- 172.21.15.18:0/3224988468 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c8c0b5670 0x7f7c8c1f7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.168+0000 7f7c8affd640 1 -- 172.21.15.18:0/3224988468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c8c15fd50 msgr2=0x7f7c8c1552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:16.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.168+0000 7f7c8affd640 1 --2- 172.21.15.18:0/3224988468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c8c15fd50 0x7f7c8c1552c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.168+0000 7f7c8affd640 1 -- 172.21.15.18:0/3224988468 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c8c15adb0 con 0x7f7c8c0ce790 2024-09-19T09:19:16.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.168+0000 7f7c8bfff640 1 --2- 172.21.15.18:0/3224988468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c8c15fd50 0x7f7c8c1552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:16.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.168+0000 7f7c8b7fe640 1 --2- 172.21.15.18:0/3224988468 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c8c0b5670 0x7f7c8c1f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:16.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.169+0000 7f7c8affd640 1 --2- 172.21.15.18:0/3224988468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c8c0ce790 0x7f7c8c15a440 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f7c8000e980 tx=0x7f7c8000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:16.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.169+0000 7f7c73fff640 1 -- 172.21.15.18:0/3224988468 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c80017070 con 0x7f7c8c0ce790 2024-09-19T09:19:16.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.169+0000 7f7c73fff640 1 -- 172.21.15.18:0/3224988468 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c8000ca00 con 0x7f7c8c0ce790 2024-09-19T09:19:16.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.169+0000 7f7c91a96640 1 -- 172.21.15.18:0/3224988468 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c8c1490a0 con 0x7f7c8c0ce790 2024-09-19T09:19:16.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.169+0000 7f7c73fff640 1 -- 172.21.15.18:0/3224988468 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c8000cdd0 con 0x7f7c8c0ce790 2024-09-19T09:19:16.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.169+0000 7f7c91a96640 1 -- 172.21.15.18:0/3224988468 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c8c1f80e0 con 0x7f7c8c0ce790 2024-09-19T09:19:16.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.170+0000 7f7c91a96640 1 -- 172.21.15.18:0/3224988468 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c8c075500 con 0x7f7c8c0ce790 2024-09-19T09:19:16.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.170+0000 7f7c73fff640 1 -- 172.21.15.18:0/3224988468 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7c8001a070 con 0x7f7c8c0ce790 2024-09-19T09:19:16.173 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.171+0000 7f7c73fff640 1 --2- 172.21.15.18:0/3224988468 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7c7806c2b0 0x7f7c7806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:16.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.171+0000 7f7c73fff640 1 -- 172.21.15.18:0/3224988468 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f7c8008b7e0 con 0x7f7c8c0ce790 2024-09-19T09:19:16.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.171+0000 7f7c8b7fe640 1 --2- 172.21.15.18:0/3224988468 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7c7806c2b0 0x7f7c7806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:16.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.172+0000 7f7c8b7fe640 1 --2- 172.21.15.18:0/3224988468 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7c7806c2b0 0x7f7c7806e770 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c000f60 tx=0x7f7c7c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:16.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.175+0000 7f7c73fff640 1 -- 172.21.15.18:0/3224988468 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7c80059f50 con 0x7f7c8c0ce790 2024-09-19T09:19:16.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.388+0000 7f7c91a96640 1 -- 172.21.15.18:0/3224988468 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c8c15ed00 con 0x7f7c8c0ce790 2024-09-19T09:19:16.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.388+0000 7f7c73fff640 1 -- 172.21.15.18:0/3224988468 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5225 (secure 0 0 0) 0x7f7c80059850 con 0x7f7c8c0ce790 2024-09-19T09:19:16.391 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:16.391 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":48,"btime":"2024-09-19T09:19:11:196952+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5642,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/4210829543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":4210829543},{"type":"v1","addr":"172.21.15.162:6837","nonce":4210829543}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3090247017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3090247017},{"type":"v1","addr":"172.21.15.162:6836","nonce":3090247017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6546,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/62488842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":62488842},{"type":"v1","addr":"172.21.15.18:6833","nonce":62488842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:19:08.540022+0000","modified":"2024-09-19T09:19:10.541774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6549},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6549":{"gid":6549,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2870064683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":2870064683},{"type":"v1","addr":"172.21.15.18:6835","nonce":2870064683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6549,"qdb_cluster":[6549]},"id":7}]} 2024-09-19T09:19:16.393 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 48 2024-09-19T09:19:16.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.390+0000 7f7c91a96640 1 -- 172.21.15.18:0/3224988468 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7c7806c2b0 msgr2=0x7f7c7806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:16.393 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.390+0000 7f7c91a96640 1 --2- 172.21.15.18:0/3224988468 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7c7806c2b0 0x7f7c7806e770 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c000f60 tx=0x7f7c7c009040 comp rx=0 tx=0).stop 2024-09-19T09:19:16.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.390+0000 7f7c91a96640 1 -- 172.21.15.18:0/3224988468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c8c0ce790 msgr2=0x7f7c8c15a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:16.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.390+0000 7f7c91a96640 1 --2- 172.21.15.18:0/3224988468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c8c0ce790 0x7f7c8c15a440 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f7c8000e980 tx=0x7f7c8000ee40 comp rx=0 tx=0).stop 2024-09-19T09:19:16.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.391+0000 7f7c91a96640 1 -- 172.21.15.18:0/3224988468 shutdown_connections 2024-09-19T09:19:16.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.391+0000 7f7c91a96640 1 --2- 172.21.15.18:0/3224988468 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7c7806c2b0 0x7f7c7806e770 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.391+0000 7f7c91a96640 1 --2- 172.21.15.18:0/3224988468 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c8c15fd50 0x7f7c8c1552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.391+0000 7f7c91a96640 1 --2- 172.21.15.18:0/3224988468 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7c8c0ce790 0x7f7c8c15a440 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.391+0000 7f7c91a96640 1 --2- 172.21.15.18:0/3224988468 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7c8c0b5670 0x7f7c8c1f7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.391+0000 7f7c91a96640 1 -- 172.21.15.18:0/3224988468 >> 172.21.15.18:0/3224988468 conn(0x7f7c8c0b2b50 msgr2=0x7f7c8c073a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:16.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.391+0000 7f7c91a96640 1 -- 172.21.15.18:0/3224988468 shutdown_connections 2024-09-19T09:19:16.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.391+0000 7f7c91a96640 1 -- 172.21.15.18:0/3224988468 wait complete. 2024-09-19T09:19:16.404 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-19T09:19:16.525 INFO:teuthology.orchestra.run.smithi018.stdout:{"cluster_fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","whoami":0,"id":6549,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":7.3319796549999996,"mdsmap_epoch":48,"osdmap_epoch":123,"osdmap_epoch_barrier":123,"uptime":12.451812099} 2024-09-19T09:19:16.525 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", "fs_name": "cephfs", "id": 6549, "mdsmap_epoch": 48, "osdmap_epoch": 123, "osdmap_epoch_barrier": 123, "rank_uptime": 7.331979655, "state": "up:active", "uptime": 12.451812099, "want_state": "up:active", "whoami": 0 } 2024-09-19T09:19:16.526 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2024-09-19T09:19:16.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.630+0000 7f4aca6ba640 1 Processor -- start 2024-09-19T09:19:16.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.631+0000 7f4aca6ba640 1 -- start start 2024-09-19T09:19:16.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.631+0000 7f4aca6ba640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4ac41445a0 0x7f4ac40cd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:16.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.631+0000 7f4aca6ba640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4ac4072d90 0x7f4ac40b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:16.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.631+0000 7f4aca6ba640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ac40cd8c0 con 0x7f4ac40ced50 2024-09-19T09:19:16.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.631+0000 7f4aca6ba640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f4ac415fdd0 con 0x7f4ac41445a0 2024-09-19T09:19:16.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.631+0000 7f4aca6ba640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4ac40b5f00 con 0x7f4ac4072d90 2024-09-19T09:19:16.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.632+0000 7f4ac3fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4ac41445a0 0x7f4ac40cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:16.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.632+0000 7f4ac3fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4ac41445a0 0x7f4ac40cd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36130/0 (socket says 172.21.15.18:36130) 2024-09-19T09:19:16.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.632+0000 7f4ac3fff640 1 -- 172.21.15.18:0/2022471310 learned_addr learned my addr 172.21.15.18:0/2022471310 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:16.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.632+0000 7f4ac3fff640 1 -- 172.21.15.18:0/2022471310 >> v2:172.21.15.162:3300/0 conn(0x7f4ac4072d90 msgr2=0x7f4ac40b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:16.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.632+0000 7f4ac3fff640 1 --2- 172.21.15.18:0/2022471310 >> v2:172.21.15.162:3300/0 conn(0x7f4ac4072d90 0x7f4ac40b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.632+0000 7f4ac3fff640 1 -- 172.21.15.18:0/2022471310 >> v1:172.21.15.162:6789/0 conn(0x7f4ac40ced50 legacy=0x7f4ac4072680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:16.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.632+0000 7f4ac3fff640 1 -- 172.21.15.18:0/2022471310 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac4160310 con 0x7f4ac41445a0 2024-09-19T09:19:16.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.633+0000 7f4ac3fff640 1 --2- 172.21.15.18:0/2022471310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ac41445a0 0x7f4ac40cd380 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f4ab400bb40 tx=0x7f4ab402c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88f21ebf7bf52e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:16.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.633+0000 7f4ac2ffd640 1 -- 172.21.15.18:0/2022471310 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab403a070 con 0x7f4ac41445a0 2024-09-19T09:19:16.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.633+0000 7f4ac2ffd640 1 -- 172.21.15.18:0/2022471310 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab40326f0 con 0x7f4ac41445a0 2024-09-19T09:19:16.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.633+0000 7f4ac2ffd640 1 -- 172.21.15.18:0/2022471310 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4032ac0 con 0x7f4ac41445a0 2024-09-19T09:19:16.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.633+0000 7f4aca6ba640 1 -- 172.21.15.18:0/2022471310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ac41445a0 msgr2=0x7f4ac40cd380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:16.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.633+0000 7f4aca6ba640 1 --2- 172.21.15.18:0/2022471310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ac41445a0 0x7f4ac40cd380 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f4ab400bb40 tx=0x7f4ab402c830 comp rx=0 tx=0).stop 2024-09-19T09:19:16.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.633+0000 7f4aca6ba640 1 -- 172.21.15.18:0/2022471310 shutdown_connections 2024-09-19T09:19:16.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.633+0000 7f4aca6ba640 1 --2- 172.21.15.18:0/2022471310 >> v2:172.21.15.162:3300/0 conn(0x7f4ac4072d90 0x7f4ac40b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.633+0000 7f4aca6ba640 1 --2- 172.21.15.18:0/2022471310 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ac41445a0 0x7f4ac40cd380 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.633+0000 7f4aca6ba640 1 -- 172.21.15.18:0/2022471310 >> 172.21.15.18:0/2022471310 conn(0x7f4ac40b26a0 msgr2=0x7f4ac40b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:16.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.633+0000 7f4aca6ba640 1 -- 172.21.15.18:0/2022471310 shutdown_connections 2024-09-19T09:19:16.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.634+0000 7f4aca6ba640 1 -- 172.21.15.18:0/2022471310 wait complete. 2024-09-19T09:19:16.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.635+0000 7f4aca6ba640 1 Processor -- start 2024-09-19T09:19:16.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.635+0000 7f4aca6ba640 1 -- start start 2024-09-19T09:19:16.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.636+0000 7f4aca6ba640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ac4072d90 0x7f4ac415b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:16.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.636+0000 7f4aca6ba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ac40ced50 0x7f4ac41f0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:16.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.636+0000 7f4aca6ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ac41445a0 0x7f4ac4142530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:16.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.636+0000 7f4aca6ba640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac4144980 con 0x7f4ac40ced50 2024-09-19T09:19:16.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.636+0000 7f4aca6ba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac40b5c20 con 0x7f4ac41445a0 2024-09-19T09:19:16.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.636+0000 7f4aca6ba640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac4144b00 con 0x7f4ac4072d90 2024-09-19T09:19:16.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.636+0000 7f4ac37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ac40ced50 0x7f4ac41f0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:16.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.636+0000 7f4ac37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ac40ced50 0x7f4ac41f0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36138/0 (socket says 172.21.15.18:36138) 2024-09-19T09:19:16.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.636+0000 7f4ac37fe640 1 -- 172.21.15.18:0/4242932022 learned_addr learned my addr 172.21.15.18:0/4242932022 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:16.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.636+0000 7f4ac8c57640 1 --2- 172.21.15.18:0/4242932022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ac41445a0 0x7f4ac4142530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:16.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.636+0000 7f4ac3fff640 1 --2- 172.21.15.18:0/4242932022 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ac4072d90 0x7f4ac415b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:16.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.636+0000 7f4ac37fe640 1 -- 172.21.15.18:0/4242932022 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ac4072d90 msgr2=0x7f4ac415b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:16.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.636+0000 7f4ac37fe640 1 --2- 172.21.15.18:0/4242932022 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ac4072d90 0x7f4ac415b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.636+0000 7f4ac37fe640 1 -- 172.21.15.18:0/4242932022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ac41445a0 msgr2=0x7f4ac4142530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:16.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.636+0000 7f4ac37fe640 1 --2- 172.21.15.18:0/4242932022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ac41445a0 0x7f4ac4142530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:16.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.636+0000 7f4ac37fe640 1 -- 172.21.15.18:0/4242932022 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac415b960 con 0x7f4ac40ced50 2024-09-19T09:19:16.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.636+0000 7f4ac37fe640 1 --2- 172.21.15.18:0/4242932022 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ac40ced50 0x7f4ac41f0840 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f4aac00c400 tx=0x7f4aac00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:16.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.636+0000 7f4ac0ff9640 1 -- 172.21.15.18:0/4242932022 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aac017070 con 0x7f4ac40ced50 2024-09-19T09:19:16.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.636+0000 7f4ac0ff9640 1 -- 172.21.15.18:0/4242932022 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4aac0035f0 con 0x7f4ac40ced50 2024-09-19T09:19:16.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.636+0000 7f4aca6ba640 1 -- 172.21.15.18:0/4242932022 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ac415c270 con 0x7f4ac40ced50 2024-09-19T09:19:16.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.636+0000 7f4ac0ff9640 1 -- 172.21.15.18:0/4242932022 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aac003a20 con 0x7f4ac40ced50 2024-09-19T09:19:16.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.636+0000 7f4aca6ba640 1 -- 172.21.15.18:0/4242932022 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ac415c830 con 0x7f4ac40ced50 2024-09-19T09:19:16.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.637+0000 7f4aca6ba640 1 -- 172.21.15.18:0/4242932022 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ac4142330 con 0x7f4ac40ced50 2024-09-19T09:19:16.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.638+0000 7f4ac0ff9640 1 -- 172.21.15.18:0/4242932022 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4aac01a070 con 0x7f4ac40ced50 2024-09-19T09:19:16.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.638+0000 7f4ac0ff9640 1 --2- 172.21.15.18:0/4242932022 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4aa406c2b0 0x7f4aa406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:16.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.639+0000 7f4ac0ff9640 1 -- 172.21.15.18:0/4242932022 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(123..123 src has 1..123) ==== 5709+0+0 (secure 0 0 0) 0x7f4aac08a840 con 0x7f4ac40ced50 2024-09-19T09:19:16.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.639+0000 7f4ac3fff640 1 --2- 172.21.15.18:0/4242932022 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4aa406c2b0 0x7f4aa406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:16.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.639+0000 7f4ac3fff640 1 --2- 172.21.15.18:0/4242932022 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4aa406c2b0 0x7f4aa406e770 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4037000 tx=0x7f4ab4032000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:16.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.643+0000 7f4ac0ff9640 1 -- 172.21.15.18:0/4242932022 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f4ac4142330 con 0x7f4ac40ced50 2024-09-19T09:19:16.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:16.817+0000 7f4aca6ba640 1 -- 172.21.15.18:0/4242932022 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) -- 0x7f4ac4144ec0 con 0x7f4ac40ced50 2024-09-19T09:19:17.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.228+0000 7f4ac0ff9640 1 -- 172.21.15.18:0/4242932022 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v124) ==== 181+0+0 (secure 0 0 0) 0x7f4aac0588c0 con 0x7f4ac40ced50 2024-09-19T09:19:17.230 INFO:teuthology.orchestra.run.smithi018.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2024-09-19T09:19:17.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.230+0000 7f4aca6ba640 1 -- 172.21.15.18:0/4242932022 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4aa406c2b0 msgr2=0x7f4aa406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:17.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.230+0000 7f4aca6ba640 1 --2- 172.21.15.18:0/4242932022 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4aa406c2b0 0x7f4aa406e770 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4037000 tx=0x7f4ab4032000 comp rx=0 tx=0).stop 2024-09-19T09:19:17.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.230+0000 7f4aca6ba640 1 -- 172.21.15.18:0/4242932022 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ac40ced50 msgr2=0x7f4ac41f0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:17.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.230+0000 7f4aca6ba640 1 --2- 172.21.15.18:0/4242932022 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ac40ced50 0x7f4ac41f0840 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f4aac00c400 tx=0x7f4aac00c8c0 comp rx=0 tx=0).stop 2024-09-19T09:19:17.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.230+0000 7f4aca6ba640 1 -- 172.21.15.18:0/4242932022 shutdown_connections 2024-09-19T09:19:17.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.230+0000 7f4aca6ba640 1 --2- 172.21.15.18:0/4242932022 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4aa406c2b0 0x7f4aa406e770 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:17.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.230+0000 7f4aca6ba640 1 --2- 172.21.15.18:0/4242932022 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4ac41445a0 0x7f4ac4142530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:17.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.230+0000 7f4aca6ba640 1 --2- 172.21.15.18:0/4242932022 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4ac40ced50 0x7f4ac41f0840 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:17.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.230+0000 7f4aca6ba640 1 --2- 172.21.15.18:0/4242932022 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4ac4072d90 0x7f4ac415b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:17.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.231+0000 7f4aca6ba640 1 -- 172.21.15.18:0/4242932022 >> 172.21.15.18:0/4242932022 conn(0x7f4ac40b26a0 msgr2=0x7f4ac415f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:17.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.231+0000 7f4aca6ba640 1 -- 172.21.15.18:0/4242932022 shutdown_connections 2024-09-19T09:19:17.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.231+0000 7f4aca6ba640 1 -- 172.21.15.18:0/4242932022 wait complete. 2024-09-19T09:19:17.245 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-09-19T09:19:17.245 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-09-19T09:19:17.245 DEBUG:teuthology.orchestra.run.smithi018:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-19T09:19:17.245 DEBUG:teuthology.orchestra.run.smithi018:> os.fchmod(fd, 0O666) 2024-09-19T09:19:17.245 DEBUG:teuthology.orchestra.run.smithi018:> os.fsync(fd) 2024-09-19T09:19:17.245 DEBUG:teuthology.orchestra.run.smithi018:> os.close(fd) 2024-09-19T09:19:17.245 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-09-19T09:19:17.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:19:17.328 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:19:17.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:19:17.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:19:17.426 INFO:teuthology.orchestra.run.smithi018.stdout:client6343 2024-09-19T09:19:17.426 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/fec66d7e-50e5-42ed-81de-ad141a2f0f4e.client6343/osdmap') 2024-09-19T09:19:17.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:19:17.486 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 123 barrier 123 flags 0x588000 2024-09-19T09:19:17.486 INFO:teuthology.orchestra.run.smithi018.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-19T09:19:17.486 INFO:teuthology.orchestra.run.smithi018.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-19T09:19:17.486 INFO:teuthology.orchestra.run.smithi018.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-19T09:19:17.486 INFO:teuthology.orchestra.run.smithi018.stdout:osd0 (1)172.21.15.18:6809 100% (exists, up) 100% -1 2024-09-19T09:19:17.486 INFO:teuthology.orchestra.run.smithi018.stdout:osd1 (1)172.21.15.18:6817 100% (exists, up) 100% -1 2024-09-19T09:19:17.486 INFO:teuthology.orchestra.run.smithi018.stdout:osd2 (1)172.21.15.18:6801 100% (exists, up) 100% -1 2024-09-19T09:19:17.487 INFO:teuthology.orchestra.run.smithi018.stdout:osd3 (1)172.21.15.18:6825 100% (exists, up) 100% -1 2024-09-19T09:19:17.487 INFO:teuthology.orchestra.run.smithi018.stdout:osd4 (1)172.21.15.162:6824 100% (exists, up) 100% -1 2024-09-19T09:19:17.487 INFO:teuthology.orchestra.run.smithi018.stdout:osd5 (1)172.21.15.162:6801 100% (exists, up) 100% -1 2024-09-19T09:19:17.487 INFO:teuthology.orchestra.run.smithi018.stdout:osd6 (1)172.21.15.162:6809 100% (exists, up) 100% -1 2024-09-19T09:19:17.487 INFO:teuthology.orchestra.run.smithi018.stdout:osd7 (1)172.21.15.162:6817 100% (exists, up) 100% -1 2024-09-19T09:19:17.487 INFO:teuthology.orchestra.run.smithi018.stderr:1+1 records in 2024-09-19T09:19:17.487 INFO:teuthology.orchestra.run.smithi018.stderr:1+1 records out 2024-09-19T09:19:17.487 INFO:teuthology.orchestra.run.smithi018.stderr:799 bytes copied, 3.8573e-05 s, 20.7 MB/s 2024-09-19T09:19:17.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:19:17.494 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2024-09-19T09:19:17.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.595+0000 7fc94aa53640 1 Processor -- start 2024-09-19T09:19:17.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.595+0000 7fc94aa53640 1 -- start start 2024-09-19T09:19:17.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.596+0000 7fc94aa53640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc9440b6a50 0x7fc9440b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:17.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.596+0000 7fc94aa53640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc9440727d0 0x7fc944072c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:17.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.596+0000 7fc94aa53640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9441600c0 con 0x7fc94406bc10 2024-09-19T09:19:17.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.596+0000 7fc94aa53640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fc9440b6ec0 con 0x7fc9440b6a50 2024-09-19T09:19:17.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.596+0000 7fc94aa53640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc9440d1920 con 0x7fc9440727d0 2024-09-19T09:19:17.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.596+0000 7fc9437fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc9440b6a50 0x7fc9440b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:17.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.596+0000 7fc943fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc94406bc10 0x7fc94406bff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34618/0 (socket says 172.21.15.18:34618) 2024-09-19T09:19:17.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.596+0000 7fc943fff640 1 -- 172.21.15.18:0/1821282133 learned_addr learned my addr 172.21.15.18:0/1821282133 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:17.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.596+0000 7fc948ff0640 1 --2- 172.21.15.18:0/1821282133 >> v2:172.21.15.162:3300/0 conn(0x7fc9440727d0 0x7fc944072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:17.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.596+0000 7fc9437fe640 1 -- 172.21.15.18:0/1821282133 >> v2:172.21.15.162:3300/0 conn(0x7fc9440727d0 msgr2=0x7fc944072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:17.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.596+0000 7fc9437fe640 1 --2- 172.21.15.18:0/1821282133 >> v2:172.21.15.162:3300/0 conn(0x7fc9440727d0 0x7fc944072c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:17.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.596+0000 7fc9437fe640 1 -- 172.21.15.18:0/1821282133 >> v1:172.21.15.18:6789/0 conn(0x7fc94406bc10 legacy=0x7fc94406bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:17.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.596+0000 7fc9437fe640 1 -- 172.21.15.18:0/1821282133 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc94415f300 con 0x7fc9440b6a50 2024-09-19T09:19:17.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.596+0000 7fc942ffd640 1 -- 172.21.15.18:0/1821282133 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1564016566 0 0) 0x7fc9441600c0 con 0x7fc94406bc10 2024-09-19T09:19:17.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.596+0000 7fc948ff0640 1 --2- 172.21.15.18:0/1821282133 >> v2:172.21.15.162:3300/0 conn(0x7fc9440727d0 0x7fc944072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:17.603 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.597+0000 7fc9437fe640 1 --2- 172.21.15.18:0/1821282133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9440b6a50 0x7fc9440b4b90 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fc9380097a0 tx=0x7fc93802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e38b1a7d74c79c51 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:17.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.597+0000 7fc942ffd640 1 -- 172.21.15.18:0/1821282133 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc938037070 con 0x7fc9440b6a50 2024-09-19T09:19:17.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.597+0000 7fc942ffd640 1 -- 172.21.15.18:0/1821282133 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc93802ae50 con 0x7fc9440b6a50 2024-09-19T09:19:17.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.597+0000 7fc942ffd640 1 -- 172.21.15.18:0/1821282133 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc938032660 con 0x7fc9440b6a50 2024-09-19T09:19:17.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.598+0000 7fc94aa53640 1 -- 172.21.15.18:0/1821282133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9440b6a50 msgr2=0x7fc9440b4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:17.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.598+0000 7fc94aa53640 1 --2- 172.21.15.18:0/1821282133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9440b6a50 0x7fc9440b4b90 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fc9380097a0 tx=0x7fc93802a140 comp rx=0 tx=0).stop 2024-09-19T09:19:17.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.598+0000 7fc94aa53640 1 -- 172.21.15.18:0/1821282133 shutdown_connections 2024-09-19T09:19:17.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.598+0000 7fc94aa53640 1 --2- 172.21.15.18:0/1821282133 >> v2:172.21.15.162:3300/0 conn(0x7fc9440727d0 0x7fc944072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:17.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.598+0000 7fc94aa53640 1 --2- 172.21.15.18:0/1821282133 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9440b6a50 0x7fc9440b4b90 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:17.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.598+0000 7fc94aa53640 1 -- 172.21.15.18:0/1821282133 >> 172.21.15.18:0/1821282133 conn(0x7fc9440b3890 msgr2=0x7fc9440b3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:17.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.598+0000 7fc94aa53640 1 -- 172.21.15.18:0/1821282133 shutdown_connections 2024-09-19T09:19:17.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.598+0000 7fc94aa53640 1 -- 172.21.15.18:0/1821282133 wait complete. 2024-09-19T09:19:17.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.599+0000 7fc94aa53640 1 Processor -- start 2024-09-19T09:19:17.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.599+0000 7fc94aa53640 1 -- start start 2024-09-19T09:19:17.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.600+0000 7fc94aa53640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc94406bc10 0x7fc944138a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:17.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.600+0000 7fc94aa53640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9440727d0 0x7fc944162eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:17.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.600+0000 7fc94aa53640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9440b6a50 0x7fc9440c8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:17.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.600+0000 7fc94aa53640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc94415fba0 con 0x7fc9440b6a50 2024-09-19T09:19:17.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.600+0000 7fc94aa53640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc94415f8c0 con 0x7fc94406bc10 2024-09-19T09:19:17.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.600+0000 7fc94aa53640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc9440b52e0 con 0x7fc9440727d0 2024-09-19T09:19:17.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.600+0000 7fc948ff0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9440b6a50 0x7fc9440c8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:17.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.600+0000 7fc948ff0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9440b6a50 0x7fc9440c8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36154/0 (socket says 172.21.15.18:36154) 2024-09-19T09:19:17.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.600+0000 7fc948ff0640 1 -- 172.21.15.18:0/2866993431 learned_addr learned my addr 172.21.15.18:0/2866993431 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:17.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.600+0000 7fc943fff640 1 --2- 172.21.15.18:0/2866993431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc94406bc10 0x7fc944138a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:17.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.600+0000 7fc948ff0640 1 -- 172.21.15.18:0/2866993431 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9440727d0 msgr2=0x7fc944162eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:17.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.600+0000 7fc9437fe640 1 --2- 172.21.15.18:0/2866993431 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9440727d0 0x7fc944162eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:17.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.600+0000 7fc948ff0640 1 --2- 172.21.15.18:0/2866993431 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9440727d0 0x7fc944162eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:17.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.600+0000 7fc948ff0640 1 -- 172.21.15.18:0/2866993431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc94406bc10 msgr2=0x7fc944138a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:17.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.600+0000 7fc948ff0640 1 --2- 172.21.15.18:0/2866993431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc94406bc10 0x7fc944138a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:17.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.600+0000 7fc948ff0640 1 -- 172.21.15.18:0/2866993431 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9440c7ab0 con 0x7fc9440b6a50 2024-09-19T09:19:17.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.600+0000 7fc943fff640 1 --2- 172.21.15.18:0/2866993431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc94406bc10 0x7fc944138a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:17.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.600+0000 7fc9437fe640 1 --2- 172.21.15.18:0/2866993431 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9440727d0 0x7fc944162eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:17.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.601+0000 7fc948ff0640 1 --2- 172.21.15.18:0/2866993431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9440b6a50 0x7fc9440c8260 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fc93c00cef0 tx=0x7fc93c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:17.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.601+0000 7fc940ff9640 1 -- 172.21.15.18:0/2866993431 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93c01a070 con 0x7fc9440b6a50 2024-09-19T09:19:17.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.601+0000 7fc940ff9640 1 -- 172.21.15.18:0/2866993431 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc93c00d860 con 0x7fc9440b6a50 2024-09-19T09:19:17.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.601+0000 7fc94aa53640 1 -- 172.21.15.18:0/2866993431 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9440c7d90 con 0x7fc9440b6a50 2024-09-19T09:19:17.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.601+0000 7fc940ff9640 1 -- 172.21.15.18:0/2866993431 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93c00dc50 con 0x7fc9440b6a50 2024-09-19T09:19:17.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.601+0000 7fc94aa53640 1 -- 172.21.15.18:0/2866993431 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9441633f0 con 0x7fc9440b6a50 2024-09-19T09:19:17.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.602+0000 7fc94aa53640 1 -- 172.21.15.18:0/2866993431 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9440b4b90 con 0x7fc9440b6a50 2024-09-19T09:19:17.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.602+0000 7fc940ff9640 1 -- 172.21.15.18:0/2866993431 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc93c01d070 con 0x7fc9440b6a50 2024-09-19T09:19:17.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.603+0000 7fc940ff9640 1 --2- 172.21.15.18:0/2866993431 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc93006c2b0 0x7fc93006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:17.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.603+0000 7fc940ff9640 1 -- 172.21.15.18:0/2866993431 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 5767+0+0 (secure 0 0 0) 0x7fc93c08bd10 con 0x7fc9440b6a50 2024-09-19T09:19:17.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.603+0000 7fc943fff640 1 --2- 172.21.15.18:0/2866993431 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc93006c2b0 0x7fc93006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:17.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.604+0000 7fc943fff640 1 --2- 172.21.15.18:0/2866993431 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc93006c2b0 0x7fc93006e770 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc934000f60 tx=0x7fc934009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:17.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.607+0000 7fc940ff9640 1 -- 172.21.15.18:0/2866993431 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc93c05a500 con 0x7fc9440b6a50 2024-09-19T09:19:17.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:17.794+0000 7fc94aa53640 1 -- 172.21.15.18:0/2866993431 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) -- 0x7fc9440b4760 con 0x7fc9440b6a50 2024-09-19T09:19:18.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.232+0000 7fc940ff9640 1 -- 172.21.15.18:0/2866993431 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v125) ==== 93+0+0 (secure 0 0 0) 0x7fc93c059e00 con 0x7fc9440b6a50 2024-09-19T09:19:18.234 INFO:teuthology.orchestra.run.smithi018.stderr:pauserd,pausewr is set 2024-09-19T09:19:18.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.235+0000 7fc94aa53640 1 -- 172.21.15.18:0/2866993431 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc93006c2b0 msgr2=0x7fc93006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:18.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.235+0000 7fc94aa53640 1 --2- 172.21.15.18:0/2866993431 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc93006c2b0 0x7fc93006e770 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc934000f60 tx=0x7fc934009040 comp rx=0 tx=0).stop 2024-09-19T09:19:18.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.235+0000 7fc94aa53640 1 -- 172.21.15.18:0/2866993431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9440b6a50 msgr2=0x7fc9440c8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:18.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.235+0000 7fc94aa53640 1 --2- 172.21.15.18:0/2866993431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9440b6a50 0x7fc9440c8260 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fc93c00cef0 tx=0x7fc93c00a710 comp rx=0 tx=0).stop 2024-09-19T09:19:18.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.236+0000 7fc94aa53640 1 -- 172.21.15.18:0/2866993431 shutdown_connections 2024-09-19T09:19:18.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.236+0000 7fc94aa53640 1 --2- 172.21.15.18:0/2866993431 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc93006c2b0 0x7fc93006e770 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:18.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.236+0000 7fc94aa53640 1 --2- 172.21.15.18:0/2866993431 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc9440b6a50 0x7fc9440c8260 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:18.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.236+0000 7fc94aa53640 1 --2- 172.21.15.18:0/2866993431 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc9440727d0 0x7fc944162eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:18.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.236+0000 7fc94aa53640 1 --2- 172.21.15.18:0/2866993431 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc94406bc10 0x7fc944138a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:18.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.236+0000 7fc94aa53640 1 -- 172.21.15.18:0/2866993431 >> 172.21.15.18:0/2866993431 conn(0x7fc9440b3890 msgr2=0x7fc9440af290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:18.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.236+0000 7fc94aa53640 1 -- 172.21.15.18:0/2866993431 shutdown_connections 2024-09-19T09:19:18.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.236+0000 7fc94aa53640 1 -- 172.21.15.18:0/2866993431 wait complete. 2024-09-19T09:19:18.250 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2024-09-19T09:19:18.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.353+0000 7fc4b565e640 1 Processor -- start 2024-09-19T09:19:18.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.353+0000 7fc4b565e640 1 -- start start 2024-09-19T09:19:18.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.354+0000 7fc4b565e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4b006e490 0x7fc4b00cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:18.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.354+0000 7fc4b565e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4b0153e50 con 0x7fc4b006e040 2024-09-19T09:19:18.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.354+0000 7fc4b565e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4b0072ac0 con 0x7fc4b015db60 2024-09-19T09:19:18.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.354+0000 7fc4b565e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b015df40 con 0x7fc4b006e490 2024-09-19T09:19:18.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.354+0000 7fc4ae7fc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc4b006e040 0x7fc4b00ce8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34634/0 (socket says 172.21.15.18:34634) 2024-09-19T09:19:18.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.354+0000 7fc4ae7fc640 1 -- 172.21.15.18:0/101696669 learned_addr learned my addr 172.21.15.18:0/101696669 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:18.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.354+0000 7fc4af7fe640 1 --2- 172.21.15.18:0/101696669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4b006e490 0x7fc4b00cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:18.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.354+0000 7fc4adffb640 1 -- 172.21.15.18:0/101696669 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1673140358 0 0) 0x7fc4b0153e50 con 0x7fc4b006e040 2024-09-19T09:19:18.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.354+0000 7fc4adffb640 1 -- 172.21.15.18:0/101696669 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc49c003520 con 0x7fc4b006e040 2024-09-19T09:19:18.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.355+0000 7fc4adffb640 1 -- 172.21.15.18:0/101696669 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3253533683 0 0) 0x7fc49c003520 con 0x7fc4b006e040 2024-09-19T09:19:18.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.355+0000 7fc4adffb640 1 -- 172.21.15.18:0/101696669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4b006e490 msgr2=0x7fc4b00cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:18.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.355+0000 7fc4adffb640 1 --2- 172.21.15.18:0/101696669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4b006e490 0x7fc4b00cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:18.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.355+0000 7fc4adffb640 1 -- 172.21.15.18:0/101696669 >> v1:172.21.15.162:6789/0 conn(0x7fc4b015db60 legacy=0x7fc4b0071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:18.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.355+0000 7fc4adffb640 1 -- 172.21.15.18:0/101696669 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b0072da0 con 0x7fc4b006e040 2024-09-19T09:19:18.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.355+0000 7fc4adffb640 1 -- 172.21.15.18:0/101696669 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fc498001670 con 0x7fc4b006e040 2024-09-19T09:19:18.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.355+0000 7fc4adffb640 1 -- 172.21.15.18:0/101696669 >> v1:172.21.15.18:6789/0 conn(0x7fc4b006e040 legacy=0x7fc4b00ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:18.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.355+0000 7fc4adffb640 1 --2- 172.21.15.18:0/101696669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc49c0039e0 0x7fc49c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:18.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.355+0000 7fc4adffb640 1 --2- 172.21.15.18:0/101696669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc49c004800 0x7fc49c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:18.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.355+0000 7fc4adffb640 1 --2- 172.21.15.18:0/101696669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4b006e490 0x7fc49c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:18.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.355+0000 7fc4adffb640 1 -- 172.21.15.18:0/101696669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b015df40 con 0x7fc49c004800 2024-09-19T09:19:18.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.355+0000 7fc4adffb640 1 -- 172.21.15.18:0/101696669 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc49c00ba70 con 0x7fc49c0039e0 2024-09-19T09:19:18.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.355+0000 7fc4adffb640 1 -- 172.21.15.18:0/101696669 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc49c00bc70 con 0x7fc4b006e490 2024-09-19T09:19:18.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.355+0000 7fc4ae7fc640 1 --2- 172.21.15.18:0/101696669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc49c004800 0x7fc49c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:18.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.355+0000 7fc4af7fe640 1 --2- 172.21.15.18:0/101696669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4b006e490 0x7fc49c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:18.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.355+0000 7fc4aeffd640 1 --2- 172.21.15.18:0/101696669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc49c0039e0 0x7fc49c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:18.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.355+0000 7fc4ae7fc640 1 -- 172.21.15.18:0/101696669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4b006e490 msgr2=0x7fc49c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:18.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.355+0000 7fc4ae7fc640 1 --2- 172.21.15.18:0/101696669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4b006e490 0x7fc49c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:18.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.355+0000 7fc4ae7fc640 1 -- 172.21.15.18:0/101696669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc49c0039e0 msgr2=0x7fc49c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:18.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.355+0000 7fc4ae7fc640 1 --2- 172.21.15.18:0/101696669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc49c0039e0 0x7fc49c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:18.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.355+0000 7fc4ae7fc640 1 -- 172.21.15.18:0/101696669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc49c003520 con 0x7fc49c004800 2024-09-19T09:19:18.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.355+0000 7fc4aeffd640 1 --2- 172.21.15.18:0/101696669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc49c0039e0 0x7fc49c003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:18.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.356+0000 7fc4ae7fc640 1 --2- 172.21.15.18:0/101696669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc49c004800 0x7fc49c004c80 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fc49800c210 tx=0x7fc49c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c6b450b9b64ce0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:18.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.356+0000 7fc4adffb640 1 -- 172.21.15.18:0/101696669 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc498007d10 con 0x7fc49c004800 2024-09-19T09:19:18.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.356+0000 7fc4adffb640 1 -- 172.21.15.18:0/101696669 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc498005ad0 con 0x7fc49c004800 2024-09-19T09:19:18.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.356+0000 7fc4adffb640 1 -- 172.21.15.18:0/101696669 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc498007070 con 0x7fc49c004800 2024-09-19T09:19:18.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.356+0000 7fc4b565e640 1 -- 172.21.15.18:0/101696669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc49c004800 msgr2=0x7fc49c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:18.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.356+0000 7fc4b565e640 1 --2- 172.21.15.18:0/101696669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc49c004800 0x7fc49c004c80 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fc49800c210 tx=0x7fc49c005830 comp rx=0 tx=0).stop 2024-09-19T09:19:18.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.357+0000 7fc4af7fe640 1 -- 172.21.15.18:0/101696669 reap_dead start 2024-09-19T09:19:18.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.357+0000 7fc4b565e640 1 -- 172.21.15.18:0/101696669 shutdown_connections 2024-09-19T09:19:18.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.357+0000 7fc4b565e640 1 -- 172.21.15.18:0/101696669 >> 172.21.15.18:0/101696669 conn(0x7fc4b00b2630 msgr2=0x7fc4b00b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:18.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.357+0000 7fc4b565e640 1 -- 172.21.15.18:0/101696669 shutdown_connections 2024-09-19T09:19:18.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.357+0000 7fc4b565e640 1 -- 172.21.15.18:0/101696669 wait complete. 2024-09-19T09:19:18.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.358+0000 7fc4b565e640 1 Processor -- start 2024-09-19T09:19:18.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.358+0000 7fc4b565e640 1 -- start start 2024-09-19T09:19:18.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.359+0000 7fc4b565e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc49c004800 0x7fc4b014fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:18.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.359+0000 7fc4b565e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4b01505d0 0x7fc4b0149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:18.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.359+0000 7fc4b565e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4b01f6560 0x7fc4b01f69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:18.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.359+0000 7fc4b565e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b0073640 con 0x7fc4b01505d0 2024-09-19T09:19:18.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.359+0000 7fc4b565e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc4b0073360 con 0x7fc49c004800 2024-09-19T09:19:18.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.359+0000 7fc4b565e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc4b006e920 con 0x7fc4b01f6560 2024-09-19T09:19:18.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.359+0000 7fc4ae7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4b01505d0 0x7fc4b0149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:18.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.359+0000 7fc4ae7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4b01505d0 0x7fc4b0149f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36174/0 (socket says 172.21.15.18:36174) 2024-09-19T09:19:18.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.359+0000 7fc4ae7fc640 1 -- 172.21.15.18:0/3797325753 learned_addr learned my addr 172.21.15.18:0/3797325753 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:18.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.359+0000 7fc4aeffd640 1 --2- 172.21.15.18:0/3797325753 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc49c004800 0x7fc4b014fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:18.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.359+0000 7fc4af7fe640 1 --2- 172.21.15.18:0/3797325753 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4b01f6560 0x7fc4b01f69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:18.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.359+0000 7fc4ae7fc640 1 -- 172.21.15.18:0/3797325753 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4b01f6560 msgr2=0x7fc4b01f69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:18.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.359+0000 7fc4ae7fc640 1 --2- 172.21.15.18:0/3797325753 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4b01f6560 0x7fc4b01f69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:18.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.359+0000 7fc4ae7fc640 1 -- 172.21.15.18:0/3797325753 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc49c004800 msgr2=0x7fc4b014fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:18.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.359+0000 7fc4ae7fc640 1 --2- 172.21.15.18:0/3797325753 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc49c004800 0x7fc4b014fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:18.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.359+0000 7fc4ae7fc640 1 -- 172.21.15.18:0/3797325753 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4b014f5c0 con 0x7fc4b01505d0 2024-09-19T09:19:18.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.359+0000 7fc4ae7fc640 1 --2- 172.21.15.18:0/3797325753 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4b01505d0 0x7fc4b0149f20 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fc49800c330 tx=0x7fc4b0072f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:18.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.359+0000 7fc4a77fe640 1 -- 172.21.15.18:0/3797325753 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc498040020 con 0x7fc4b01505d0 2024-09-19T09:19:18.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.359+0000 7fc4a77fe640 1 -- 172.21.15.18:0/3797325753 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc498001430 con 0x7fc4b01505d0 2024-09-19T09:19:18.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.359+0000 7fc4b565e640 1 -- 172.21.15.18:0/3797325753 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4b014f8a0 con 0x7fc4b01505d0 2024-09-19T09:19:18.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.360+0000 7fc4a77fe640 1 -- 172.21.15.18:0/3797325753 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc498037040 con 0x7fc4b01505d0 2024-09-19T09:19:18.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.360+0000 7fc4b565e640 1 -- 172.21.15.18:0/3797325753 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4b014e7c0 con 0x7fc4b01505d0 2024-09-19T09:19:18.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.361+0000 7fc4b565e640 1 -- 172.21.15.18:0/3797325753 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4b00aa430 con 0x7fc4b01505d0 2024-09-19T09:19:18.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.361+0000 7fc4a77fe640 1 -- 172.21.15.18:0/3797325753 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc498043020 con 0x7fc4b01505d0 2024-09-19T09:19:18.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.361+0000 7fc4a77fe640 1 --2- 172.21.15.18:0/3797325753 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc49006c2e0 0x7fc49006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:18.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.361+0000 7fc4a77fe640 1 -- 172.21.15.18:0/3797325753 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 5767+0+0 (secure 0 0 0) 0x7fc4980aa730 con 0x7fc4b01505d0 2024-09-19T09:19:18.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.362+0000 7fc4a77fe640 1 -- 172.21.15.18:0/3797325753 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=126+}) -- 0x7fc490073ed0 con 0x7fc4b01505d0 2024-09-19T09:19:18.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.362+0000 7fc4aeffd640 1 --2- 172.21.15.18:0/3797325753 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc49006c2e0 0x7fc49006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:18.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.362+0000 7fc4aeffd640 1 --2- 172.21.15.18:0/3797325753 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc49006c2e0 0x7fc49006e7a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8007fd0 tx=0x7fc4a8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:18.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.366+0000 7fc4a77fe640 1 -- 172.21.15.18:0/3797325753 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc4b00aa430 con 0x7fc4b01505d0 2024-09-19T09:19:18.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:18.550+0000 7fc4b565e640 1 -- 172.21.15.18:0/3797325753 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) -- 0x7fc4b015d250 con 0x7fc4b01505d0 2024-09-19T09:19:19.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.234+0000 7fc4a77fe640 1 -- 172.21.15.18:0/3797325753 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v126) ==== 97+0+0 (secure 0 0 0) 0x7fc498005aa0 con 0x7fc4b01505d0 2024-09-19T09:19:19.236 INFO:teuthology.orchestra.run.smithi018.stderr:pauserd,pausewr is unset 2024-09-19T09:19:19.236 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.235+0000 7fc4a77fe640 1 -- 172.21.15.18:0/3797325753 <== mon.0 v2:172.21.15.18:3300/0 8 ==== osd_map(126..126 src has 1..126) ==== 288+0+0 (secure 0 0 0) 0x7fc4980deda0 con 0x7fc4b01505d0 2024-09-19T09:19:19.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.235+0000 7fc4a77fe640 1 -- 172.21.15.18:0/3797325753 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=127}) -- 0x7fc4900748a0 con 0x7fc4b01505d0 2024-09-19T09:19:19.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.238+0000 7fc4b565e640 1 -- 172.21.15.18:0/3797325753 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc49006c2e0 msgr2=0x7fc49006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:19.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.238+0000 7fc4b565e640 1 --2- 172.21.15.18:0/3797325753 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc49006c2e0 0x7fc49006e7a0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8007fd0 tx=0x7fc4a8009040 comp rx=0 tx=0).stop 2024-09-19T09:19:19.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.238+0000 7fc4b565e640 1 -- 172.21.15.18:0/3797325753 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4b01505d0 msgr2=0x7fc4b0149f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:19.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.238+0000 7fc4b565e640 1 --2- 172.21.15.18:0/3797325753 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4b01505d0 0x7fc4b0149f20 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fc49800c330 tx=0x7fc4b0072f70 comp rx=0 tx=0).stop 2024-09-19T09:19:19.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.238+0000 7fc4b565e640 1 -- 172.21.15.18:0/3797325753 shutdown_connections 2024-09-19T09:19:19.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.238+0000 7fc4b565e640 1 --2- 172.21.15.18:0/3797325753 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc49006c2e0 0x7fc49006e7a0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:19.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.238+0000 7fc4b565e640 1 --2- 172.21.15.18:0/3797325753 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc4b01f6560 0x7fc4b01f69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:19.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.238+0000 7fc4b565e640 1 --2- 172.21.15.18:0/3797325753 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc4b01505d0 0x7fc4b0149f20 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:19.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.238+0000 7fc4b565e640 1 --2- 172.21.15.18:0/3797325753 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc49c004800 0x7fc4b014fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:19.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.238+0000 7fc4b565e640 1 -- 172.21.15.18:0/3797325753 >> 172.21.15.18:0/3797325753 conn(0x7fc4b00b2630 msgr2=0x7fc4b006d420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:19.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.239+0000 7fc4b565e640 1 -- 172.21.15.18:0/3797325753 shutdown_connections 2024-09-19T09:19:19.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.239+0000 7fc4b565e640 1 -- 172.21.15.18:0/3797325753 wait complete. 2024-09-19T09:19:19.253 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:19:19.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.356+0000 7fc0281c0640 1 Processor -- start 2024-09-19T09:19:19.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.357+0000 7fc0281c0640 1 -- start start 2024-09-19T09:19:19.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.357+0000 7fc0281c0640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc02015ef50 0x7fc0200d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:19.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.357+0000 7fc0281c0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc0200d3240 0x7fc0200d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:19.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.357+0000 7fc0281c0640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0200b7a90 con 0x7fc0200d5780 2024-09-19T09:19:19.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.357+0000 7fc0281c0640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fc0200d3740 con 0x7fc0200d3240 2024-09-19T09:19:19.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.357+0000 7fc0281c0640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc0200d3a20 con 0x7fc02015ef50 2024-09-19T09:19:19.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.357+0000 7fc02575b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc0200d3240 0x7fc0200d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:19.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.357+0000 7fc02675d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc0200d5780 0x7fc0200cf770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34650/0 (socket says 172.21.15.18:34650) 2024-09-19T09:19:19.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.357+0000 7fc02675d640 1 -- 172.21.15.18:0/1112492294 learned_addr learned my addr 172.21.15.18:0/1112492294 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:19.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.358+0000 7fc025f5c640 1 --2- 172.21.15.18:0/1112492294 >> v2:172.21.15.162:3300/0 conn(0x7fc02015ef50 0x7fc0200d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:19.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.358+0000 7fc02575b640 1 -- 172.21.15.18:0/1112492294 >> v2:172.21.15.162:3300/0 conn(0x7fc02015ef50 msgr2=0x7fc0200d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:19.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.358+0000 7fc02575b640 1 --2- 172.21.15.18:0/1112492294 >> v2:172.21.15.162:3300/0 conn(0x7fc02015ef50 0x7fc0200d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:19.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.358+0000 7fc02575b640 1 -- 172.21.15.18:0/1112492294 >> v1:172.21.15.18:6789/0 conn(0x7fc0200d5780 legacy=0x7fc0200cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:19.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.358+0000 7fc024f5a640 1 -- 172.21.15.18:0/1112492294 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1880478084 0 0) 0x7fc0200b7a90 con 0x7fc0200d5780 2024-09-19T09:19:19.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.358+0000 7fc02575b640 1 -- 172.21.15.18:0/1112492294 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0200b7d00 con 0x7fc0200d3240 2024-09-19T09:19:19.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.359+0000 7fc02575b640 1 --2- 172.21.15.18:0/1112492294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0200d3240 0x7fc0200d18e0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fc0200b7850 tx=0x7fc01402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20286895f9335fff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:19.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.359+0000 7fc024f5a640 1 -- 172.21.15.18:0/1112492294 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc014037070 con 0x7fc0200d3240 2024-09-19T09:19:19.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.359+0000 7fc024f5a640 1 -- 172.21.15.18:0/1112492294 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc014032440 con 0x7fc0200d3240 2024-09-19T09:19:19.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.359+0000 7fc024f5a640 1 -- 172.21.15.18:0/1112492294 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01402ae60 con 0x7fc0200d3240 2024-09-19T09:19:19.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.359+0000 7fc0281c0640 1 -- 172.21.15.18:0/1112492294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0200d3240 msgr2=0x7fc0200d18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:19.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.359+0000 7fc0281c0640 1 --2- 172.21.15.18:0/1112492294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0200d3240 0x7fc0200d18e0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fc0200b7850 tx=0x7fc01402a110 comp rx=0 tx=0).stop 2024-09-19T09:19:19.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.359+0000 7fc0281c0640 1 -- 172.21.15.18:0/1112492294 shutdown_connections 2024-09-19T09:19:19.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.359+0000 7fc0281c0640 1 --2- 172.21.15.18:0/1112492294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0200d3240 0x7fc0200d18e0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:19.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.359+0000 7fc0281c0640 1 --2- 172.21.15.18:0/1112492294 >> v2:172.21.15.162:3300/0 conn(0x7fc02015ef50 0x7fc0200d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:19.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.359+0000 7fc0281c0640 1 -- 172.21.15.18:0/1112492294 >> 172.21.15.18:0/1112492294 conn(0x7fc0200d4c60 msgr2=0x7fc0200d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:19.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.359+0000 7fc0281c0640 1 -- 172.21.15.18:0/1112492294 shutdown_connections 2024-09-19T09:19:19.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.359+0000 7fc0281c0640 1 -- 172.21.15.18:0/1112492294 wait complete. 2024-09-19T09:19:19.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.360+0000 7fc0281c0640 1 Processor -- start 2024-09-19T09:19:19.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.361+0000 7fc0281c0640 1 -- start start 2024-09-19T09:19:19.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.361+0000 7fc0281c0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0200d3240 0x7fc02015c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:19.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.361+0000 7fc0281c0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0200d5780 0x7fc0200ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:19.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.361+0000 7fc0281c0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc02015ef50 0x7fc0200cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:19.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.361+0000 7fc0281c0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc0200d21a0 con 0x7fc0200d3240 2024-09-19T09:19:19.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.361+0000 7fc0281c0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc0200d2020 con 0x7fc0200d5780 2024-09-19T09:19:19.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.361+0000 7fc0281c0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc0200b9510 con 0x7fc02015ef50 2024-09-19T09:19:19.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.361+0000 7fc025f5c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0200d3240 0x7fc02015c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:19.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.361+0000 7fc025f5c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0200d3240 0x7fc02015c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36190/0 (socket says 172.21.15.18:36190) 2024-09-19T09:19:19.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.361+0000 7fc025f5c640 1 -- 172.21.15.18:0/4205040089 learned_addr learned my addr 172.21.15.18:0/4205040089 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:19.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.361+0000 7fc02575b640 1 --2- 172.21.15.18:0/4205040089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0200d5780 0x7fc0200ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:19.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.362+0000 7fc02675d640 1 --2- 172.21.15.18:0/4205040089 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc02015ef50 0x7fc0200cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:19.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.362+0000 7fc025f5c640 1 -- 172.21.15.18:0/4205040089 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc02015ef50 msgr2=0x7fc0200cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:19.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.362+0000 7fc025f5c640 1 --2- 172.21.15.18:0/4205040089 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc02015ef50 0x7fc0200cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:19.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.362+0000 7fc025f5c640 1 -- 172.21.15.18:0/4205040089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0200d5780 msgr2=0x7fc0200ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:19.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.362+0000 7fc025f5c640 1 --2- 172.21.15.18:0/4205040089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0200d5780 0x7fc0200ca2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:19.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.362+0000 7fc025f5c640 1 -- 172.21.15.18:0/4205040089 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0200ca830 con 0x7fc0200d3240 2024-09-19T09:19:19.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.362+0000 7fc02575b640 1 --2- 172.21.15.18:0/4205040089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0200d5780 0x7fc0200ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:19.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.362+0000 7fc02675d640 1 --2- 172.21.15.18:0/4205040089 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc02015ef50 0x7fc0200cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:19.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.362+0000 7fc025f5c640 1 --2- 172.21.15.18:0/4205040089 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0200d3240 0x7fc02015c180 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fc01800d620 tx=0x7fc01800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:19.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.362+0000 7fc01e7fc640 1 -- 172.21.15.18:0/4205040089 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01800b620 con 0x7fc0200d3240 2024-09-19T09:19:19.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.362+0000 7fc01e7fc640 1 -- 172.21.15.18:0/4205040089 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc018019070 con 0x7fc0200d3240 2024-09-19T09:19:19.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.362+0000 7fc0281c0640 1 -- 172.21.15.18:0/4205040089 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0200caad0 con 0x7fc0200d3240 2024-09-19T09:19:19.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.362+0000 7fc01e7fc640 1 -- 172.21.15.18:0/4205040089 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01800ba00 con 0x7fc0200d3240 2024-09-19T09:19:19.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.362+0000 7fc0281c0640 1 -- 172.21.15.18:0/4205040089 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0200b1ae0 con 0x7fc0200d3240 2024-09-19T09:19:19.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.363+0000 7fc0281c0640 1 -- 172.21.15.18:0/4205040089 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0200b18f0 con 0x7fc0200d3240 2024-09-19T09:19:19.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.364+0000 7fc01e7fc640 1 -- 172.21.15.18:0/4205040089 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc01800bba0 con 0x7fc0200d3240 2024-09-19T09:19:19.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.364+0000 7fc01e7fc640 1 --2- 172.21.15.18:0/4205040089 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc00c06c2b0 0x7fc00c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:19.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.364+0000 7fc01e7fc640 1 -- 172.21.15.18:0/4205040089 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5767+0+0 (secure 0 0 0) 0x7fc01808b810 con 0x7fc0200d3240 2024-09-19T09:19:19.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.364+0000 7fc02575b640 1 --2- 172.21.15.18:0/4205040089 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc00c06c2b0 0x7fc00c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:19.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.365+0000 7fc02575b640 1 --2- 172.21.15.18:0/4205040089 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc00c06c2b0 0x7fc00c06e770 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc014034000 tx=0x7fc01402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:19.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.368+0000 7fc01e7fc640 1 -- 172.21.15.18:0/4205040089 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc018059fd0 con 0x7fc0200d3240 2024-09-19T09:19:19.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.545+0000 7fc0281c0640 1 -- 172.21.15.18:0/4205040089 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc0200d13a0 con 0x7fc0200d3240 2024-09-19T09:19:19.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.546+0000 7fc01e7fc640 1 -- 172.21.15.18:0/4205040089 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) ==== 74+0+16797 (secure 0 0 0) 0x7fc0180598d0 con 0x7fc0200d3240 2024-09-19T09:19:19.548 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:19.548 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":126,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:19:19.234859+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:19:06.215588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-19T09:19:07.536940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.18","mappings":[{"from":5,"to":0}]},{"pgid":"14.1e","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:19:19.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.548+0000 7fc0281c0640 1 -- 172.21.15.18:0/4205040089 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc00c06c2b0 msgr2=0x7fc00c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:19.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.548+0000 7fc0281c0640 1 --2- 172.21.15.18:0/4205040089 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc00c06c2b0 0x7fc00c06e770 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fc014034000 tx=0x7fc01402e000 comp rx=0 tx=0).stop 2024-09-19T09:19:19.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.548+0000 7fc0281c0640 1 -- 172.21.15.18:0/4205040089 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0200d3240 msgr2=0x7fc02015c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:19.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.548+0000 7fc0281c0640 1 --2- 172.21.15.18:0/4205040089 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0200d3240 0x7fc02015c180 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fc01800d620 tx=0x7fc01800dae0 comp rx=0 tx=0).stop 2024-09-19T09:19:19.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.548+0000 7fc0281c0640 1 -- 172.21.15.18:0/4205040089 shutdown_connections 2024-09-19T09:19:19.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.548+0000 7fc0281c0640 1 --2- 172.21.15.18:0/4205040089 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc00c06c2b0 0x7fc00c06e770 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:19.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.548+0000 7fc0281c0640 1 --2- 172.21.15.18:0/4205040089 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc02015ef50 0x7fc0200cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:19.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.548+0000 7fc0281c0640 1 --2- 172.21.15.18:0/4205040089 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0200d5780 0x7fc0200ca2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:19.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.548+0000 7fc0281c0640 1 --2- 172.21.15.18:0/4205040089 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc0200d3240 0x7fc02015c180 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:19.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.548+0000 7fc0281c0640 1 -- 172.21.15.18:0/4205040089 >> 172.21.15.18:0/4205040089 conn(0x7fc0200d4c60 msgr2=0x7fc02006da70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:19.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.548+0000 7fc0281c0640 1 -- 172.21.15.18:0/4205040089 shutdown_connections 2024-09-19T09:19:19.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.548+0000 7fc0281c0640 1 -- 172.21.15.18:0/4205040089 wait complete. 2024-09-19T09:19:19.561 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-09-19T09:19:19.561 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-09-19T09:19:19.561 DEBUG:teuthology.orchestra.run.smithi018:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-19T09:19:19.561 DEBUG:teuthology.orchestra.run.smithi018:> os.fchmod(fd, 0O666) 2024-09-19T09:19:19.561 DEBUG:teuthology.orchestra.run.smithi018:> os.fsync(fd) 2024-09-19T09:19:19.561 DEBUG:teuthology.orchestra.run.smithi018:> os.close(fd) 2024-09-19T09:19:19.562 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-09-19T09:19:19.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:19:19.640 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:19:19.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:19:19.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:19:19.736 INFO:teuthology.orchestra.run.smithi018.stdout:client6343 2024-09-19T09:19:19.737 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/fec66d7e-50e5-42ed-81de-ad141a2f0f4e.client6343/osdmap') 2024-09-19T09:19:19.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:19:19.796 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 123 barrier 123 flags 0x588000 2024-09-19T09:19:19.796 INFO:teuthology.orchestra.run.smithi018.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-19T09:19:19.796 INFO:teuthology.orchestra.run.smithi018.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-19T09:19:19.796 INFO:teuthology.orchestra.run.smithi018.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-19T09:19:19.796 INFO:teuthology.orchestra.run.smithi018.stdout:osd0 (1)172.21.15.18:6809 100% (exists, up) 100% -1 2024-09-19T09:19:19.796 INFO:teuthology.orchestra.run.smithi018.stdout:osd1 (1)172.21.15.18:6817 100% (exists, up) 100% -1 2024-09-19T09:19:19.796 INFO:teuthology.orchestra.run.smithi018.stdout:osd2 (1)172.21.15.18:6801 100% (exists, up) 100% -1 2024-09-19T09:19:19.796 INFO:teuthology.orchestra.run.smithi018.stdout:osd3 (1)172.21.15.18:6825 100% (exists, up) 100% -1 2024-09-19T09:19:19.796 INFO:teuthology.orchestra.run.smithi018.stdout:osd4 (1)172.21.15.162:6824 100% (exists, up) 100% -1 2024-09-19T09:19:19.796 INFO:teuthology.orchestra.run.smithi018.stdout:osd5 (1)172.21.15.162:6801 100% (exists, up) 100% -1 2024-09-19T09:19:19.797 INFO:teuthology.orchestra.run.smithi018.stdout:osd6 (1)172.21.15.162:6809 100% (exists, up) 100% -1 2024-09-19T09:19:19.797 INFO:teuthology.orchestra.run.smithi018.stdout:osd7 (1)172.21.15.162:6817 100% (exists, up) 100% -1 2024-09-19T09:19:19.797 INFO:teuthology.orchestra.run.smithi018.stderr:1+1 records in 2024-09-19T09:19:19.797 INFO:teuthology.orchestra.run.smithi018.stderr:1+1 records out 2024-09-19T09:19:19.797 INFO:teuthology.orchestra.run.smithi018.stderr:799 bytes copied, 3.7358e-05 s, 21.4 MB/s 2024-09-19T09:19:19.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:19:19.803 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:19:19.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.903+0000 7fd306d54640 1 Processor -- start 2024-09-19T09:19:19.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.903+0000 7fd306d54640 1 -- start start 2024-09-19T09:19:19.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.904+0000 7fd306d54640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd300145290 0x7fd30006f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:19.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.904+0000 7fd306d54640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd300072f40 0x7fd3000b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:19.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.904+0000 7fd306d54640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd30006e3d0 con 0x7fd3000ce780 2024-09-19T09:19:19.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.904+0000 7fd306d54640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fd30006efe0 con 0x7fd300072f40 2024-09-19T09:19:19.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.904+0000 7fd306d54640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd30006e6b0 con 0x7fd300145290 2024-09-19T09:19:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.904+0000 7fd3052f1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd300072f40 0x7fd3000b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.904+0000 7fd2fffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd3000ce780 0x7fd300072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34654/0 (socket says 172.21.15.18:34654) 2024-09-19T09:19:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.904+0000 7fd2fffff640 1 -- 172.21.15.18:0/3512559009 learned_addr learned my addr 172.21.15.18:0/3512559009 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.905+0000 7fd304af0640 1 --2- 172.21.15.18:0/3512559009 >> v2:172.21.15.162:3300/0 conn(0x7fd300145290 0x7fd30006f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.905+0000 7fd3052f1640 1 -- 172.21.15.18:0/3512559009 >> v2:172.21.15.162:3300/0 conn(0x7fd300145290 msgr2=0x7fd30006f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.905+0000 7fd3052f1640 1 --2- 172.21.15.18:0/3512559009 >> v2:172.21.15.162:3300/0 conn(0x7fd300145290 0x7fd30006f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.905+0000 7fd3052f1640 1 -- 172.21.15.18:0/3512559009 >> v1:172.21.15.18:6789/0 conn(0x7fd3000ce780 legacy=0x7fd300072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.905+0000 7fd2ff7fe640 1 -- 172.21.15.18:0/3512559009 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2332260392 0 0) 0x7fd30006e3d0 con 0x7fd3000ce780 2024-09-19T09:19:19.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.905+0000 7fd3052f1640 1 -- 172.21.15.18:0/3512559009 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd30006e990 con 0x7fd300072f40 2024-09-19T09:19:19.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.905+0000 7fd3052f1640 1 --2- 172.21.15.18:0/3512559009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd300072f40 0x7fd3000b3930 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fd300075940 tx=0x7fd2f002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a114bab12b893c95 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:19.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.905+0000 7fd2ff7fe640 1 -- 172.21.15.18:0/3512559009 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0037070 con 0x7fd300072f40 2024-09-19T09:19:19.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.905+0000 7fd2ff7fe640 1 -- 172.21.15.18:0/3512559009 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2f0032440 con 0x7fd300072f40 2024-09-19T09:19:19.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.905+0000 7fd2ff7fe640 1 -- 172.21.15.18:0/3512559009 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f0032810 con 0x7fd300072f40 2024-09-19T09:19:19.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.906+0000 7fd306d54640 1 -- 172.21.15.18:0/3512559009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd300072f40 msgr2=0x7fd3000b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:19.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.906+0000 7fd306d54640 1 --2- 172.21.15.18:0/3512559009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd300072f40 0x7fd3000b3930 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fd300075940 tx=0x7fd2f002a1a0 comp rx=0 tx=0).stop 2024-09-19T09:19:19.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.906+0000 7fd306d54640 1 -- 172.21.15.18:0/3512559009 shutdown_connections 2024-09-19T09:19:19.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.906+0000 7fd306d54640 1 --2- 172.21.15.18:0/3512559009 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd300072f40 0x7fd3000b3930 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:19.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.906+0000 7fd306d54640 1 --2- 172.21.15.18:0/3512559009 >> v2:172.21.15.162:3300/0 conn(0x7fd300145290 0x7fd30006f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:19.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.906+0000 7fd306d54640 1 -- 172.21.15.18:0/3512559009 >> 172.21.15.18:0/3512559009 conn(0x7fd30006bc10 msgr2=0x7fd30006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:19.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.906+0000 7fd306d54640 1 -- 172.21.15.18:0/3512559009 shutdown_connections 2024-09-19T09:19:19.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.906+0000 7fd306d54640 1 -- 172.21.15.18:0/3512559009 wait complete. 2024-09-19T09:19:19.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.907+0000 7fd306d54640 1 Processor -- start 2024-09-19T09:19:19.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.907+0000 7fd306d54640 1 -- start start 2024-09-19T09:19:19.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.908+0000 7fd306d54640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd300072f40 0x7fd3001432b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:19.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.908+0000 7fd306d54640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3000ce780 0x7fd30015a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:19.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.908+0000 7fd306d54640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd300145290 0x7fd3000aae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:19.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.908+0000 7fd306d54640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd30006df80 con 0x7fd300072f40 2024-09-19T09:19:19.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.908+0000 7fd306d54640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd300145670 con 0x7fd300145290 2024-09-19T09:19:19.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.908+0000 7fd306d54640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd30006e100 con 0x7fd3000ce780 2024-09-19T09:19:19.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.908+0000 7fd304af0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd300072f40 0x7fd3001432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:19.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.908+0000 7fd304af0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd300072f40 0x7fd3001432b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36204/0 (socket says 172.21.15.18:36204) 2024-09-19T09:19:19.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.908+0000 7fd304af0640 1 -- 172.21.15.18:0/361761654 learned_addr learned my addr 172.21.15.18:0/361761654 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:19.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.909+0000 7fd3052f1640 1 --2- 172.21.15.18:0/361761654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd300145290 0x7fd3000aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:19.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.909+0000 7fd2fffff640 1 --2- 172.21.15.18:0/361761654 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3000ce780 0x7fd30015a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:19.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.909+0000 7fd304af0640 1 -- 172.21.15.18:0/361761654 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3000ce780 msgr2=0x7fd30015a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:19.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.909+0000 7fd304af0640 1 --2- 172.21.15.18:0/361761654 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3000ce780 0x7fd30015a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:19.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.909+0000 7fd304af0640 1 -- 172.21.15.18:0/361761654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd300145290 msgr2=0x7fd3000aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:19.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.909+0000 7fd304af0640 1 --2- 172.21.15.18:0/361761654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd300145290 0x7fd3000aae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:19.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.909+0000 7fd304af0640 1 -- 172.21.15.18:0/361761654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3000ab380 con 0x7fd300072f40 2024-09-19T09:19:19.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.909+0000 7fd304af0640 1 --2- 172.21.15.18:0/361761654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd300072f40 0x7fd3001432b0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800cd00 tx=0x7fd2f800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:19.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.909+0000 7fd2fd7fa640 1 -- 172.21.15.18:0/361761654 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8003990 con 0x7fd300072f40 2024-09-19T09:19:19.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.909+0000 7fd2fd7fa640 1 -- 172.21.15.18:0/361761654 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2f8003b30 con 0x7fd300072f40 2024-09-19T09:19:19.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.909+0000 7fd2fd7fa640 1 -- 172.21.15.18:0/361761654 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8004020 con 0x7fd300072f40 2024-09-19T09:19:19.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.909+0000 7fd306d54640 1 -- 172.21.15.18:0/361761654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd300143890 con 0x7fd300072f40 2024-09-19T09:19:19.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.909+0000 7fd306d54640 1 -- 172.21.15.18:0/361761654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd300144130 con 0x7fd300072f40 2024-09-19T09:19:19.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.910+0000 7fd306d54640 1 -- 172.21.15.18:0/361761654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd300071510 con 0x7fd300072f40 2024-09-19T09:19:19.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.911+0000 7fd2fd7fa640 1 -- 172.21.15.18:0/361761654 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd2f80041c0 con 0x7fd300072f40 2024-09-19T09:19:19.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.911+0000 7fd2fd7fa640 1 --2- 172.21.15.18:0/361761654 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd2ec06c2b0 0x7fd2ec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:19.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.911+0000 7fd2fd7fa640 1 -- 172.21.15.18:0/361761654 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5767+0+0 (secure 0 0 0) 0x7fd2f808b8c0 con 0x7fd300072f40 2024-09-19T09:19:19.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.911+0000 7fd2fffff640 1 --2- 172.21.15.18:0/361761654 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd2ec06c2b0 0x7fd2ec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:19.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.912+0000 7fd2fffff640 1 --2- 172.21.15.18:0/361761654 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd2ec06c2b0 0x7fd2ec06e770 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd30013fb50 tx=0x7fd2f4007b50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:19.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:19.916+0000 7fd2fd7fa640 1 -- 172.21.15.18:0/361761654 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd2f8014030 con 0x7fd300072f40 2024-09-19T09:19:20.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.130+0000 7fd306d54640 1 -- 172.21.15.18:0/361761654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd3000aac20 con 0x7fd300072f40 2024-09-19T09:19:20.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.130+0000 7fd2fd7fa640 1 -- 172.21.15.18:0/361761654 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5225 (secure 0 0 0) 0x7fd2f805a080 con 0x7fd300072f40 2024-09-19T09:19:20.132 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:20.132 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":48,"btime":"2024-09-19T09:19:11:196952+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5642,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/4210829543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":4210829543},{"type":"v1","addr":"172.21.15.162:6837","nonce":4210829543}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3090247017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3090247017},{"type":"v1","addr":"172.21.15.162:6836","nonce":3090247017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6546,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/62488842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":62488842},{"type":"v1","addr":"172.21.15.18:6833","nonce":62488842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:19:08.540022+0000","modified":"2024-09-19T09:19:10.541774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6549},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6549":{"gid":6549,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2870064683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":2870064683},{"type":"v1","addr":"172.21.15.18:6835","nonce":2870064683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6549,"qdb_cluster":[6549]},"id":7}]} 2024-09-19T09:19:20.132 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 48 2024-09-19T09:19:20.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.132+0000 7fd306d54640 1 -- 172.21.15.18:0/361761654 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd2ec06c2b0 msgr2=0x7fd2ec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:20.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.132+0000 7fd306d54640 1 --2- 172.21.15.18:0/361761654 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd2ec06c2b0 0x7fd2ec06e770 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd30013fb50 tx=0x7fd2f4007b50 comp rx=0 tx=0).stop 2024-09-19T09:19:20.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.132+0000 7fd306d54640 1 -- 172.21.15.18:0/361761654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd300072f40 msgr2=0x7fd3001432b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:20.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.132+0000 7fd306d54640 1 --2- 172.21.15.18:0/361761654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd300072f40 0x7fd3001432b0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800cd00 tx=0x7fd2f800a5c0 comp rx=0 tx=0).stop 2024-09-19T09:19:20.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.132+0000 7fd306d54640 1 -- 172.21.15.18:0/361761654 shutdown_connections 2024-09-19T09:19:20.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.132+0000 7fd306d54640 1 --2- 172.21.15.18:0/361761654 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd2ec06c2b0 0x7fd2ec06e770 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:20.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.132+0000 7fd306d54640 1 --2- 172.21.15.18:0/361761654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd300145290 0x7fd3000aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:20.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.132+0000 7fd306d54640 1 --2- 172.21.15.18:0/361761654 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd3000ce780 0x7fd30015a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:20.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.132+0000 7fd306d54640 1 --2- 172.21.15.18:0/361761654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd300072f40 0x7fd3001432b0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:20.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.132+0000 7fd306d54640 1 -- 172.21.15.18:0/361761654 >> 172.21.15.18:0/361761654 conn(0x7fd30006bc10 msgr2=0x7fd3000b4ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:20.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.132+0000 7fd306d54640 1 -- 172.21.15.18:0/361761654 shutdown_connections 2024-09-19T09:19:20.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.132+0000 7fd306d54640 1 -- 172.21.15.18:0/361761654 wait complete. 2024-09-19T09:19:20.146 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json osdmap barrier 126 2024-09-19T09:19:20.266 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2024-09-19T09:19:20.266 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-09-19T09:19:20.266 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-09-19T09:19:20.266 DEBUG:teuthology.orchestra.run.smithi018:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-19T09:19:20.266 DEBUG:teuthology.orchestra.run.smithi018:> os.fchmod(fd, 0O666) 2024-09-19T09:19:20.266 DEBUG:teuthology.orchestra.run.smithi018:> os.fsync(fd) 2024-09-19T09:19:20.267 DEBUG:teuthology.orchestra.run.smithi018:> os.close(fd) 2024-09-19T09:19:20.267 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-09-19T09:19:20.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:19:20.346 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:19:20.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:19:20.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:19:20.444 INFO:teuthology.orchestra.run.smithi018.stdout:client6343 2024-09-19T09:19:20.444 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/fec66d7e-50e5-42ed-81de-ad141a2f0f4e.client6343/osdmap') 2024-09-19T09:19:20.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:19:20.503 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 126 barrier 126 flags 0x588000 2024-09-19T09:19:20.503 INFO:teuthology.orchestra.run.smithi018.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-19T09:19:20.503 INFO:teuthology.orchestra.run.smithi018.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-19T09:19:20.503 INFO:teuthology.orchestra.run.smithi018.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-19T09:19:20.504 INFO:teuthology.orchestra.run.smithi018.stdout:osd0 (1)172.21.15.18:6809 100% (exists, up) 100% -1 2024-09-19T09:19:20.504 INFO:teuthology.orchestra.run.smithi018.stdout:osd1 (1)172.21.15.18:6817 100% (exists, up) 100% -1 2024-09-19T09:19:20.504 INFO:teuthology.orchestra.run.smithi018.stdout:osd2 (1)172.21.15.18:6801 100% (exists, up) 100% -1 2024-09-19T09:19:20.504 INFO:teuthology.orchestra.run.smithi018.stdout:osd3 (1)172.21.15.18:6825 100% (exists, up) 100% -1 2024-09-19T09:19:20.504 INFO:teuthology.orchestra.run.smithi018.stdout:osd4 (1)172.21.15.162:6824 100% (exists, up) 100% -1 2024-09-19T09:19:20.504 INFO:teuthology.orchestra.run.smithi018.stdout:osd5 (1)172.21.15.162:6801 100% (exists, up) 100% -1 2024-09-19T09:19:20.504 INFO:teuthology.orchestra.run.smithi018.stdout:osd6 (1)172.21.15.162:6809 100% (exists, up) 100% -1 2024-09-19T09:19:20.504 INFO:teuthology.orchestra.run.smithi018.stdout:osd7 (1)172.21.15.162:6817 100% (exists, up) 100% -1 2024-09-19T09:19:20.504 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 14.18 [5->0] 2024-09-19T09:19:20.504 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 14.1e [5->0] 2024-09-19T09:19:20.505 INFO:teuthology.orchestra.run.smithi018.stderr:1+1 records in 2024-09-19T09:19:20.505 INFO:teuthology.orchestra.run.smithi018.stderr:1+1 records out 2024-09-19T09:19:20.505 INFO:teuthology.orchestra.run.smithi018.stderr:855 bytes copied, 4.2839e-05 s, 20.0 MB/s 2024-09-19T09:19:20.505 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:19:20.511 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:19:20.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:19:20.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:19:20.568 INFO:teuthology.orchestra.run.smithi018.stdout:client6343 2024-09-19T09:19:20.568 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/fec66d7e-50e5-42ed-81de-ad141a2f0f4e.client6343/osdmap') 2024-09-19T09:19:20.617 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:19:20.628 INFO:teuthology.orchestra.run.smithi018.stdout:epoch 126 barrier 126 flags 0x588000 2024-09-19T09:19:20.628 INFO:teuthology.orchestra.run.smithi018.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-19T09:19:20.628 INFO:teuthology.orchestra.run.smithi018.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-19T09:19:20.628 INFO:teuthology.orchestra.run.smithi018.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-19T09:19:20.628 INFO:teuthology.orchestra.run.smithi018.stdout:osd0 (1)172.21.15.18:6809 100% (exists, up) 100% -1 2024-09-19T09:19:20.628 INFO:teuthology.orchestra.run.smithi018.stdout:osd1 (1)172.21.15.18:6817 100% (exists, up) 100% -1 2024-09-19T09:19:20.628 INFO:teuthology.orchestra.run.smithi018.stdout:osd2 (1)172.21.15.18:6801 100% (exists, up) 100% -1 2024-09-19T09:19:20.628 INFO:teuthology.orchestra.run.smithi018.stdout:osd3 (1)172.21.15.18:6825 100% (exists, up) 100% -1 2024-09-19T09:19:20.628 INFO:teuthology.orchestra.run.smithi018.stdout:osd4 (1)172.21.15.162:6824 100% (exists, up) 100% -1 2024-09-19T09:19:20.629 INFO:teuthology.orchestra.run.smithi018.stdout:osd5 (1)172.21.15.162:6801 100% (exists, up) 100% -1 2024-09-19T09:19:20.629 INFO:teuthology.orchestra.run.smithi018.stdout:osd6 (1)172.21.15.162:6809 100% (exists, up) 100% -1 2024-09-19T09:19:20.629 INFO:teuthology.orchestra.run.smithi018.stdout:osd7 (1)172.21.15.162:6817 100% (exists, up) 100% -1 2024-09-19T09:19:20.629 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 14.18 [5->0] 2024-09-19T09:19:20.629 INFO:teuthology.orchestra.run.smithi018.stdout:pg_upmap_items 14.1e [5->0] 2024-09-19T09:19:20.629 INFO:teuthology.orchestra.run.smithi018.stderr:1+1 records in 2024-09-19T09:19:20.629 INFO:teuthology.orchestra.run.smithi018.stderr:1+1 records out 2024-09-19T09:19:20.629 INFO:teuthology.orchestra.run.smithi018.stderr:855 bytes copied, 3.639e-05 s, 23.5 MB/s 2024-09-19T09:19:20.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:19:20.635 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-19T09:19:20.635 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T09:19:20.635 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:19:20.679 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:19:20.735 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T09:19:20.735 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:19:20.735 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:19:20.735 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:19:20.753 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:19:20.753 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:19:20.812 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T09:19:20.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.954+0000 7fabbf3e8640 1 Processor -- start 2024-09-19T09:19:20.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.954+0000 7fabbf3e8640 1 -- start start 2024-09-19T09:19:20.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.955+0000 7fabbf3e8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fabb806bc10 0x7fabb80b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:20.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.955+0000 7fabbf3e8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabb80b4b90 0x7fabb806bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:20.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.955+0000 7fabbf3e8640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabb806c530 con 0x7fabb8162750 2024-09-19T09:19:20.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.955+0000 7fabbf3e8640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fabb81600c0 con 0x7fabb806bc10 2024-09-19T09:19:20.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.955+0000 7fabbf3e8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fabb80d1920 con 0x7fabb80b4b90 2024-09-19T09:19:20.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.955+0000 7fabbd985640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fabb8162750 0x7fabb8162be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34656/0 (socket says 172.21.15.18:34656) 2024-09-19T09:19:20.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.955+0000 7fabbd985640 1 -- 172.21.15.18:0/2209541250 learned_addr learned my addr 172.21.15.18:0/2209541250 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:20.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.955+0000 7fabbd184640 1 --2- 172.21.15.18:0/2209541250 >> v2:172.21.15.162:3300/0 conn(0x7fabb806bc10 0x7fabb80b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:20.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.955+0000 7fabbc983640 1 --2- 172.21.15.18:0/2209541250 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabb80b4b90 0x7fabb806bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:20.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.955+0000 7fabaffff640 1 -- 172.21.15.18:0/2209541250 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2378915071 0 0) 0x7fabb806c530 con 0x7fabb8162750 2024-09-19T09:19:20.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.955+0000 7fabaffff640 1 -- 172.21.15.18:0/2209541250 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faba4003520 con 0x7fabb8162750 2024-09-19T09:19:20.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.955+0000 7fabaffff640 1 -- 172.21.15.18:0/2209541250 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1999164725 0 0) 0x7faba4003520 con 0x7fabb8162750 2024-09-19T09:19:20.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.955+0000 7fabaffff640 1 -- 172.21.15.18:0/2209541250 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabb80b4b90 msgr2=0x7fabb806bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:20.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.955+0000 7fabaffff640 1 --2- 172.21.15.18:0/2209541250 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabb80b4b90 0x7fabb806bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:20.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.956+0000 7fabaffff640 1 -- 172.21.15.18:0/2209541250 >> v2:172.21.15.162:3300/0 conn(0x7fabb806bc10 msgr2=0x7fabb80b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:20.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.956+0000 7fabaffff640 1 --2- 172.21.15.18:0/2209541250 >> v2:172.21.15.162:3300/0 conn(0x7fabb806bc10 0x7fabb80b6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:20.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.956+0000 7fabaffff640 1 -- 172.21.15.18:0/2209541250 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb815f300 con 0x7fabb8162750 2024-09-19T09:19:20.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.956+0000 7fabaffff640 1 -- 172.21.15.18:0/2209541250 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fabb00019f0 con 0x7fabb8162750 2024-09-19T09:19:20.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.956+0000 7fabaffff640 1 -- 172.21.15.18:0/2209541250 >> v1:172.21.15.18:6789/0 conn(0x7fabb8162750 legacy=0x7fabb8162be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:20.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.956+0000 7fabaffff640 1 --2- 172.21.15.18:0/2209541250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faba40039b0 0x7faba4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:20.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.956+0000 7fabaffff640 1 --2- 172.21.15.18:0/2209541250 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabb80b4b90 0x7faba4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:20.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.956+0000 7fabaffff640 1 --2- 172.21.15.18:0/2209541250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faba4004d40 0x7faba40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:20.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.956+0000 7fabaffff640 1 -- 172.21.15.18:0/2209541250 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fabb81600c0 con 0x7faba40039b0 2024-09-19T09:19:20.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.956+0000 7fabaffff640 1 -- 172.21.15.18:0/2209541250 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fabb80d1920 con 0x7faba4004d40 2024-09-19T09:19:20.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.956+0000 7fabaffff640 1 -- 172.21.15.18:0/2209541250 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faba400b9f0 con 0x7fabb80b4b90 2024-09-19T09:19:20.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.956+0000 7fabbd184640 1 --2- 172.21.15.18:0/2209541250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faba40039b0 0x7faba4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:20.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.956+0000 7fabbc983640 1 --2- 172.21.15.18:0/2209541250 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabb80b4b90 0x7faba4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:20.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.956+0000 7fabbd985640 1 --2- 172.21.15.18:0/2209541250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faba4004d40 0x7faba40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:20.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.956+0000 7fabbd184640 1 -- 172.21.15.18:0/2209541250 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabb80b4b90 msgr2=0x7faba4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:20.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.956+0000 7fabbd184640 1 --2- 172.21.15.18:0/2209541250 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fabb80b4b90 0x7faba4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:20.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.956+0000 7fabbd184640 1 -- 172.21.15.18:0/2209541250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faba4004d40 msgr2=0x7faba40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:20.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.956+0000 7fabbd184640 1 --2- 172.21.15.18:0/2209541250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faba4004d40 0x7faba40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:20.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.956+0000 7fabbd184640 1 -- 172.21.15.18:0/2209541250 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faba4003520 con 0x7faba40039b0 2024-09-19T09:19:20.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.956+0000 7fabbd985640 1 --2- 172.21.15.18:0/2209541250 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faba4004d40 0x7faba40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:20.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.957+0000 7fabbd184640 1 --2- 172.21.15.18:0/2209541250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faba40039b0 0x7faba4003dd0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009ac0 tx=0x7faba4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a010de2fe695399b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:20.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.957+0000 7fabaffff640 1 -- 172.21.15.18:0/2209541250 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb4036070 con 0x7faba40039b0 2024-09-19T09:19:20.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.957+0000 7fabaffff640 1 -- 172.21.15.18:0/2209541250 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabb4031400 con 0x7faba40039b0 2024-09-19T09:19:20.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.957+0000 7fabaffff640 1 -- 172.21.15.18:0/2209541250 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb4009690 con 0x7faba40039b0 2024-09-19T09:19:20.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.957+0000 7fabbf3e8640 1 -- 172.21.15.18:0/2209541250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faba40039b0 msgr2=0x7faba4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:20.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.957+0000 7fabbf3e8640 1 --2- 172.21.15.18:0/2209541250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faba40039b0 0x7faba4003dd0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7fabb4009ac0 tx=0x7faba4005830 comp rx=0 tx=0).stop 2024-09-19T09:19:20.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.957+0000 7fabbd985640 1 -- 172.21.15.18:0/2209541250 reap_dead start 2024-09-19T09:19:20.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.957+0000 7fabbf3e8640 1 -- 172.21.15.18:0/2209541250 shutdown_connections 2024-09-19T09:19:20.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.957+0000 7fabbf3e8640 1 -- 172.21.15.18:0/2209541250 >> 172.21.15.18:0/2209541250 conn(0x7fabb80b3890 msgr2=0x7fabb80b3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:20.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.958+0000 7fabbf3e8640 1 -- 172.21.15.18:0/2209541250 shutdown_connections 2024-09-19T09:19:20.964 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.958+0000 7fabbf3e8640 1 -- 172.21.15.18:0/2209541250 wait complete. 2024-09-19T09:19:20.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.959+0000 7fabbf3e8640 1 Processor -- start 2024-09-19T09:19:20.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.959+0000 7fabbf3e8640 1 -- start start 2024-09-19T09:19:20.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.959+0000 7fabbf3e8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faba40039b0 0x7fabb8151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:20.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.959+0000 7fabbf3e8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabb81405e0 0x7fabb80b2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:20.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.959+0000 7fabbf3e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabb8160d20 0x7fabb81611a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:20.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.959+0000 7fabbf3e8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fabb815fba0 con 0x7fabb8160d20 2024-09-19T09:19:20.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.959+0000 7fabbf3e8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fabb815f8c0 con 0x7fabb81405e0 2024-09-19T09:19:20.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.959+0000 7fabbf3e8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fabb80b5000 con 0x7faba40039b0 2024-09-19T09:19:20.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.960+0000 7fabbd985640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabb8160d20 0x7fabb81611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:20.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.960+0000 7fabbd985640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabb8160d20 0x7fabb81611a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36218/0 (socket says 172.21.15.18:36218) 2024-09-19T09:19:20.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.960+0000 7fabbd985640 1 -- 172.21.15.18:0/3432228243 learned_addr learned my addr 172.21.15.18:0/3432228243 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:20.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.960+0000 7fabbd184640 1 --2- 172.21.15.18:0/3432228243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faba40039b0 0x7fabb8151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:20.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.960+0000 7fabbc983640 1 --2- 172.21.15.18:0/3432228243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabb81405e0 0x7fabb80b2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:20.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.960+0000 7fabbd985640 1 -- 172.21.15.18:0/3432228243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faba40039b0 msgr2=0x7fabb8151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:20.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.960+0000 7fabbd985640 1 --2- 172.21.15.18:0/3432228243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faba40039b0 0x7fabb8151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:20.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.960+0000 7fabbd985640 1 -- 172.21.15.18:0/3432228243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabb81405e0 msgr2=0x7fabb80b2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:20.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.960+0000 7fabbd985640 1 --2- 172.21.15.18:0/3432228243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabb81405e0 0x7fabb80b2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:20.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.960+0000 7fabbd985640 1 -- 172.21.15.18:0/3432228243 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb80ae8e0 con 0x7fabb8160d20 2024-09-19T09:19:20.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.960+0000 7fabbd985640 1 --2- 172.21.15.18:0/3432228243 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabb8160d20 0x7fabb81611a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fabb8162b30 tx=0x7fabb000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:20.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.960+0000 7fabadffb640 1 -- 172.21.15.18:0/3432228243 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb000de90 con 0x7fabb8160d20 2024-09-19T09:19:20.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.960+0000 7fabadffb640 1 -- 172.21.15.18:0/3432228243 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabb000bb80 con 0x7fabb8160d20 2024-09-19T09:19:20.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.960+0000 7fabbf3e8640 1 -- 172.21.15.18:0/3432228243 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabb80aebc0 con 0x7fabb8160d20 2024-09-19T09:19:20.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.960+0000 7fabadffb640 1 -- 172.21.15.18:0/3432228243 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabb0007070 con 0x7fabb8160d20 2024-09-19T09:19:20.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.961+0000 7fabbf3e8640 1 -- 172.21.15.18:0/3432228243 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabb80af180 con 0x7fabb8160d20 2024-09-19T09:19:20.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.962+0000 7fabbf3e8640 1 -- 172.21.15.18:0/3432228243 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabb81616e0 con 0x7fabb8160d20 2024-09-19T09:19:20.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.962+0000 7fabadffb640 1 -- 172.21.15.18:0/3432228243 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fabb001b020 con 0x7fabb8160d20 2024-09-19T09:19:20.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.962+0000 7fabadffb640 1 --2- 172.21.15.18:0/3432228243 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fab9c06c450 0x7fab9c06e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:20.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.963+0000 7fabadffb640 1 -- 172.21.15.18:0/3432228243 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5767+0+0 (secure 0 0 0) 0x7fabb008b660 con 0x7fabb8160d20 2024-09-19T09:19:20.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.963+0000 7fabbd184640 1 --2- 172.21.15.18:0/3432228243 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fab9c06c450 0x7fab9c06e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:20.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.963+0000 7fabbd184640 1 --2- 172.21.15.18:0/3432228243 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fab9c06c450 0x7fab9c06e910 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fabb4033000 tx=0x7fabb4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:20.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:20.967+0000 7fabadffb640 1 -- 172.21.15.18:0/3432228243 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fabb0059d90 con 0x7fabb8160d20 2024-09-19T09:19:21.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.156+0000 7fabbf3e8640 1 -- 172.21.15.18:0/3432228243 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fabb80b4760 con 0x7fabb8160d20 2024-09-19T09:19:21.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.156+0000 7fabadffb640 1 -- 172.21.15.18:0/3432228243 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v126) ==== 80+0+0 (secure 0 0 0) 0x7fabb0059690 con 0x7fabb8160d20 2024-09-19T09:19:21.158 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-09-19T09:19:21.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.158+0000 7fabbf3e8640 1 -- 172.21.15.18:0/3432228243 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fab9c06c450 msgr2=0x7fab9c06e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:21.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.158+0000 7fabbf3e8640 1 --2- 172.21.15.18:0/3432228243 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fab9c06c450 0x7fab9c06e910 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fabb4033000 tx=0x7fabb4008030 comp rx=0 tx=0).stop 2024-09-19T09:19:21.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.158+0000 7fabbf3e8640 1 -- 172.21.15.18:0/3432228243 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabb8160d20 msgr2=0x7fabb81611a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:21.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.158+0000 7fabbf3e8640 1 --2- 172.21.15.18:0/3432228243 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabb8160d20 0x7fabb81611a0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fabb8162b30 tx=0x7fabb000b4a0 comp rx=0 tx=0).stop 2024-09-19T09:19:21.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.158+0000 7fabbf3e8640 1 -- 172.21.15.18:0/3432228243 shutdown_connections 2024-09-19T09:19:21.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.158+0000 7fabbf3e8640 1 --2- 172.21.15.18:0/3432228243 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fab9c06c450 0x7fab9c06e910 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:21.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.158+0000 7fabbf3e8640 1 --2- 172.21.15.18:0/3432228243 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fabb8160d20 0x7fabb81611a0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:21.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.158+0000 7fabbf3e8640 1 --2- 172.21.15.18:0/3432228243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fabb81405e0 0x7fabb80b2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:21.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.158+0000 7fabbf3e8640 1 --2- 172.21.15.18:0/3432228243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faba40039b0 0x7fabb8151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:21.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.158+0000 7fabbf3e8640 1 -- 172.21.15.18:0/3432228243 >> 172.21.15.18:0/3432228243 conn(0x7fabb80b3890 msgr2=0x7fabb80727d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:21.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.159+0000 7fabbf3e8640 1 -- 172.21.15.18:0/3432228243 shutdown_connections 2024-09-19T09:19:21.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.159+0000 7fabbf3e8640 1 -- 172.21.15.18:0/3432228243 wait complete. 2024-09-19T09:19:21.172 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T09:19:21.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:21.172 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-19T09:19:21.215 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T09:19:21.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:21.215 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T09:19:21.271 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:19:21.272 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:19:21.272 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:19:21.289 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:19:21.289 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:19:21.347 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T09:19:21.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.449+0000 7f12c5a80640 1 Processor -- start 2024-09-19T09:19:21.451 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.449+0000 7f12c5a80640 1 -- start start 2024-09-19T09:19:21.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.450+0000 7f12c5a80640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f12c015ee60 0x7f12c006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:21.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.450+0000 7f12c5a80640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f12c00b5180 0x7f12c006d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:21.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.450+0000 7f12c5a80640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12c00d19b0 con 0x7f12c006dc40 2024-09-19T09:19:21.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.450+0000 7f12c5a80640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f12c015f240 con 0x7f12c00b5180 2024-09-19T09:19:21.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.450+0000 7f12c5a80640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f12c006e090 con 0x7f12c015ee60 2024-09-19T09:19:21.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.450+0000 7f12beffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f12c00b5180 0x7f12c006d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:21.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.450+0000 7f12beffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f12c00b5180 0x7f12c006d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36222/0 (socket says 172.21.15.18:36222) 2024-09-19T09:19:21.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.450+0000 7f12beffd640 1 -- 172.21.15.18:0/1126330644 learned_addr learned my addr 172.21.15.18:0/1126330644 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:21.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.450+0000 7f12bf7fe640 1 --2- 172.21.15.18:0/1126330644 >> v2:172.21.15.162:3300/0 conn(0x7f12c015ee60 0x7f12c006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:21.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.450+0000 7f12beffd640 1 -- 172.21.15.18:0/1126330644 >> v2:172.21.15.162:3300/0 conn(0x7f12c015ee60 msgr2=0x7f12c006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:21.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.450+0000 7f12beffd640 1 --2- 172.21.15.18:0/1126330644 >> v2:172.21.15.162:3300/0 conn(0x7f12c015ee60 0x7f12c006cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:21.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.450+0000 7f12beffd640 1 -- 172.21.15.18:0/1126330644 >> v1:172.21.15.162:6789/0 conn(0x7f12c006dc40 legacy=0x7f12c01628c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:21.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.450+0000 7f12beffd640 1 -- 172.21.15.18:0/1126330644 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12c00d1c90 con 0x7f12c00b5180 2024-09-19T09:19:21.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.450+0000 7f12bf7fe640 1 --2- 172.21.15.18:0/1126330644 >> v2:172.21.15.162:3300/0 conn(0x7f12c015ee60 0x7f12c006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:21.453 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.451+0000 7f12beffd640 1 --2- 172.21.15.18:0/1126330644 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12c00b5180 0x7f12c006d700 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f12b4009870 tx=0x7f12b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b2e77a5a2beb1b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:21.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.451+0000 7f12be7fc640 1 -- 172.21.15.18:0/1126330644 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b4037070 con 0x7f12c00b5180 2024-09-19T09:19:21.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.451+0000 7f12be7fc640 1 -- 172.21.15.18:0/1126330644 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12b4032440 con 0x7f12c00b5180 2024-09-19T09:19:21.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.451+0000 7f12be7fc640 1 -- 172.21.15.18:0/1126330644 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b4032810 con 0x7f12c00b5180 2024-09-19T09:19:21.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.452+0000 7f12c5a80640 1 -- 172.21.15.18:0/1126330644 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12c00b5180 msgr2=0x7f12c006d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:21.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.452+0000 7f12c5a80640 1 --2- 172.21.15.18:0/1126330644 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12c00b5180 0x7f12c006d700 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f12b4009870 tx=0x7f12b402a270 comp rx=0 tx=0).stop 2024-09-19T09:19:21.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.452+0000 7f12c5a80640 1 -- 172.21.15.18:0/1126330644 shutdown_connections 2024-09-19T09:19:21.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.452+0000 7f12c5a80640 1 --2- 172.21.15.18:0/1126330644 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12c00b5180 0x7f12c006d700 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:21.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.452+0000 7f12c5a80640 1 --2- 172.21.15.18:0/1126330644 >> v2:172.21.15.162:3300/0 conn(0x7f12c015ee60 0x7f12c006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:21.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.452+0000 7f12c5a80640 1 -- 172.21.15.18:0/1126330644 >> 172.21.15.18:0/1126330644 conn(0x7f12c00b45f0 msgr2=0x7f12c00b4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:21.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.452+0000 7f12c5a80640 1 -- 172.21.15.18:0/1126330644 shutdown_connections 2024-09-19T09:19:21.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.452+0000 7f12c5a80640 1 -- 172.21.15.18:0/1126330644 wait complete. 2024-09-19T09:19:21.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.453+0000 7f12c5a80640 1 Processor -- start 2024-09-19T09:19:21.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.453+0000 7f12c5a80640 1 -- start start 2024-09-19T09:19:21.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.454+0000 7f12c5a80640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12c006dc40 0x7f12c015b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:21.457 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.454+0000 7f12c5a80640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12c00b5180 0x7f12c00cf270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:21.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.454+0000 7f12c5a80640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12c015ee60 0x7f12c00cf7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:21.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.454+0000 7f12c5a80640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f12c00b37c0 con 0x7f12c006dc40 2024-09-19T09:19:21.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.454+0000 7f12c5a80640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f12c006d260 con 0x7f12c00b5180 2024-09-19T09:19:21.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.454+0000 7f12c5a80640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f12c00b3940 con 0x7f12c015ee60 2024-09-19T09:19:21.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.454+0000 7f12bf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12c006dc40 0x7f12c015b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:21.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.454+0000 7f12bf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12c006dc40 0x7f12c015b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36236/0 (socket says 172.21.15.18:36236) 2024-09-19T09:19:21.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.454+0000 7f12bf7fe640 1 -- 172.21.15.18:0/2962953321 learned_addr learned my addr 172.21.15.18:0/2962953321 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:21.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.454+0000 7f12beffd640 1 --2- 172.21.15.18:0/2962953321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12c00b5180 0x7f12c00cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:21.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.454+0000 7f12bffff640 1 --2- 172.21.15.18:0/2962953321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12c015ee60 0x7f12c00cf7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:21.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.454+0000 7f12bf7fe640 1 -- 172.21.15.18:0/2962953321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12c015ee60 msgr2=0x7f12c00cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:21.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.454+0000 7f12bf7fe640 1 --2- 172.21.15.18:0/2962953321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12c015ee60 0x7f12c00cf7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:21.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.454+0000 7f12bf7fe640 1 -- 172.21.15.18:0/2962953321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12c00b5180 msgr2=0x7f12c00cf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:21.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.454+0000 7f12bf7fe640 1 --2- 172.21.15.18:0/2962953321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12c00b5180 0x7f12c00cf270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:21.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.454+0000 7f12bf7fe640 1 -- 172.21.15.18:0/2962953321 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12c00cdd40 con 0x7f12c006dc40 2024-09-19T09:19:21.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.455+0000 7f12bf7fe640 1 --2- 172.21.15.18:0/2962953321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12c006dc40 0x7f12c015b6c0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f12b000c7f0 tx=0x7f12b000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:21.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.455+0000 7f12a7fff640 1 -- 172.21.15.18:0/2962953321 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b0015070 con 0x7f12c006dc40 2024-09-19T09:19:21.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.455+0000 7f12a7fff640 1 -- 172.21.15.18:0/2962953321 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12b0007a30 con 0x7f12c006dc40 2024-09-19T09:19:21.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.455+0000 7f12c5a80640 1 -- 172.21.15.18:0/2962953321 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12c00ce020 con 0x7f12c006dc40 2024-09-19T09:19:21.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.455+0000 7f12a7fff640 1 -- 172.21.15.18:0/2962953321 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b0007e00 con 0x7f12c006dc40 2024-09-19T09:19:21.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.455+0000 7f12c5a80640 1 -- 172.21.15.18:0/2962953321 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12c00ce5e0 con 0x7f12c006dc40 2024-09-19T09:19:21.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.456+0000 7f12c5a80640 1 -- 172.21.15.18:0/2962953321 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12c006d700 con 0x7f12c006dc40 2024-09-19T09:19:21.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.456+0000 7f12a7fff640 1 -- 172.21.15.18:0/2962953321 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f12b0018070 con 0x7f12c006dc40 2024-09-19T09:19:21.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.457+0000 7f12a7fff640 1 --2- 172.21.15.18:0/2962953321 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f12ac06c2e0 0x7f12ac06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:21.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.457+0000 7f12a7fff640 1 -- 172.21.15.18:0/2962953321 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5767+0+0 (secure 0 0 0) 0x7f12b008b320 con 0x7f12c006dc40 2024-09-19T09:19:21.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.457+0000 7f12beffd640 1 --2- 172.21.15.18:0/2962953321 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f12ac06c2e0 0x7f12ac06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:21.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.457+0000 7f12beffd640 1 --2- 172.21.15.18:0/2962953321 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f12ac06c2e0 0x7f12ac06e7a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f12b4034000 tx=0x7f12b402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:21.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.461+0000 7f12a7fff640 1 -- 172.21.15.18:0/2962953321 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f12b0059490 con 0x7f12c006dc40 2024-09-19T09:19:21.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.649+0000 7f12c5a80640 1 -- 172.21.15.18:0/2962953321 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f12c00b8a40 con 0x7f12c006dc40 2024-09-19T09:19:21.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.649+0000 7f12a7fff640 1 -- 172.21.15.18:0/2962953321 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v126) ==== 80+0+0 (secure 0 0 0) 0x7f12b005d790 con 0x7f12c006dc40 2024-09-19T09:19:21.651 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-09-19T09:19:21.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.651+0000 7f12c5a80640 1 -- 172.21.15.18:0/2962953321 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f12ac06c2e0 msgr2=0x7f12ac06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:21.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.651+0000 7f12c5a80640 1 --2- 172.21.15.18:0/2962953321 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f12ac06c2e0 0x7f12ac06e7a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f12b4034000 tx=0x7f12b402e000 comp rx=0 tx=0).stop 2024-09-19T09:19:21.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.651+0000 7f12c5a80640 1 -- 172.21.15.18:0/2962953321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12c006dc40 msgr2=0x7f12c015b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:21.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.651+0000 7f12c5a80640 1 --2- 172.21.15.18:0/2962953321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12c006dc40 0x7f12c015b6c0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f12b000c7f0 tx=0x7f12b000cbf0 comp rx=0 tx=0).stop 2024-09-19T09:19:21.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.651+0000 7f12c5a80640 1 -- 172.21.15.18:0/2962953321 shutdown_connections 2024-09-19T09:19:21.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.651+0000 7f12c5a80640 1 --2- 172.21.15.18:0/2962953321 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f12ac06c2e0 0x7f12ac06e7a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:21.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.651+0000 7f12c5a80640 1 --2- 172.21.15.18:0/2962953321 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12c015ee60 0x7f12c00cf7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:21.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.651+0000 7f12c5a80640 1 --2- 172.21.15.18:0/2962953321 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12c00b5180 0x7f12c00cf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:21.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.651+0000 7f12c5a80640 1 --2- 172.21.15.18:0/2962953321 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12c006dc40 0x7f12c015b6c0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:21.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.651+0000 7f12c5a80640 1 -- 172.21.15.18:0/2962953321 >> 172.21.15.18:0/2962953321 conn(0x7f12c00b45f0 msgr2=0x7f12c00d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:21.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.651+0000 7f12c5a80640 1 -- 172.21.15.18:0/2962953321 shutdown_connections 2024-09-19T09:19:21.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.651+0000 7f12c5a80640 1 -- 172.21.15.18:0/2962953321 wait complete. 2024-09-19T09:19:21.664 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-19T09:19:21.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:21.664 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-19T09:19:21.695 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-09-19T09:19:21.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:21.696 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-19T09:19:21.753 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:19:21.754 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:19:21.754 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:19:21.770 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17075 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T09:19:21.770 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:19:21.770 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:19:21.771 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:19:21.811 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3252 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T09:19:21.811 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:19:21.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.911+0000 7faab47c0640 1 Processor -- start 2024-09-19T09:19:21.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.911+0000 7faab47c0640 1 -- start start 2024-09-19T09:19:21.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.912+0000 7faab47c0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7faaac15ef80 0x7faaac0b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:21.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.912+0000 7faab47c0640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7faaac06d730 0x7faaac0cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:21.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.912+0000 7faab47c0640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaac0cd1a0 con 0x7faaac0cf910 2024-09-19T09:19:21.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.912+0000 7faab47c0640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7faaac0cd7d0 con 0x7faaac15ef80 2024-09-19T09:19:21.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.912+0000 7faab47c0640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7faaac06dc30 con 0x7faaac06d730 2024-09-19T09:19:21.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.912+0000 7faab255c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7faaac15ef80 0x7faaac0b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:21.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.912+0000 7faab2d5d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7faaac0cf910 0x7faaac0d0ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34670/0 (socket says 172.21.15.18:34670) 2024-09-19T09:19:21.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.912+0000 7faab2d5d640 1 -- 172.21.15.18:0/995945450 learned_addr learned my addr 172.21.15.18:0/995945450 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:21.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.912+0000 7faab255c640 1 -- 172.21.15.18:0/995945450 >> v2:172.21.15.162:3300/0 conn(0x7faaac06d730 msgr2=0x7faaac0cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:21.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.912+0000 7faab255c640 1 --2- 172.21.15.18:0/995945450 >> v2:172.21.15.162:3300/0 conn(0x7faaac06d730 0x7faaac0cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:21.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.912+0000 7faab255c640 1 -- 172.21.15.18:0/995945450 >> v1:172.21.15.18:6789/0 conn(0x7faaac0cf910 legacy=0x7faaac0d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:21.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.912+0000 7faab255c640 1 -- 172.21.15.18:0/995945450 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaac06df10 con 0x7faaac15ef80 2024-09-19T09:19:21.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.912+0000 7faab155a640 1 -- 172.21.15.18:0/995945450 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3766335781 0 0) 0x7faaac0cd1a0 con 0x7faaac0cf910 2024-09-19T09:19:21.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.913+0000 7faab255c640 1 --2- 172.21.15.18:0/995945450 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faaac15ef80 0x7faaac0b5220 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7faaac0b57c0 tx=0x7faaa802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f58bd0f387add3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:21.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.913+0000 7faab155a640 1 -- 172.21.15.18:0/995945450 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa8037070 con 0x7faaac15ef80 2024-09-19T09:19:21.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.913+0000 7faab155a640 1 -- 172.21.15.18:0/995945450 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaa8032440 con 0x7faaac15ef80 2024-09-19T09:19:21.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.913+0000 7faab155a640 1 -- 172.21.15.18:0/995945450 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa8032810 con 0x7faaac15ef80 2024-09-19T09:19:21.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.914+0000 7faab47c0640 1 -- 172.21.15.18:0/995945450 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faaac15ef80 msgr2=0x7faaac0b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:21.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.914+0000 7faab47c0640 1 --2- 172.21.15.18:0/995945450 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faaac15ef80 0x7faaac0b5220 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7faaac0b57c0 tx=0x7faaa802a1a0 comp rx=0 tx=0).stop 2024-09-19T09:19:21.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.914+0000 7faab47c0640 1 -- 172.21.15.18:0/995945450 shutdown_connections 2024-09-19T09:19:21.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.914+0000 7faab47c0640 1 --2- 172.21.15.18:0/995945450 >> v2:172.21.15.162:3300/0 conn(0x7faaac06d730 0x7faaac0cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:21.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.914+0000 7faab47c0640 1 --2- 172.21.15.18:0/995945450 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faaac15ef80 0x7faaac0b5220 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:21.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.914+0000 7faab47c0640 1 -- 172.21.15.18:0/995945450 >> 172.21.15.18:0/995945450 conn(0x7faaac0b4700 msgr2=0x7faaac0b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:21.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.914+0000 7faab47c0640 1 -- 172.21.15.18:0/995945450 shutdown_connections 2024-09-19T09:19:21.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.914+0000 7faab47c0640 1 -- 172.21.15.18:0/995945450 wait complete. 2024-09-19T09:19:21.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.915+0000 7faab47c0640 1 Processor -- start 2024-09-19T09:19:21.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.915+0000 7faab47c0640 1 -- start start 2024-09-19T09:19:21.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.916+0000 7faab47c0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faaac06d730 0x7faaac157e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:21.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.916+0000 7faab47c0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faaac0cf910 0x7faaac0b7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:21.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.916+0000 7faab47c0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faaac15ef80 0x7faaac0b7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:21.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.916+0000 7faab47c0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faaac0d0120 con 0x7faaac15ef80 2024-09-19T09:19:21.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.916+0000 7faab47c0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faaac15f360 con 0x7faaac06d730 2024-09-19T09:19:21.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.916+0000 7faab47c0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faaac0cec70 con 0x7faaac0cf910 2024-09-19T09:19:21.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.916+0000 7faab2d5d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faaac15ef80 0x7faaac0b7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:21.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.916+0000 7faab2d5d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faaac15ef80 0x7faaac0b7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36252/0 (socket says 172.21.15.18:36252) 2024-09-19T09:19:21.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.916+0000 7faab2d5d640 1 -- 172.21.15.18:0/1794178475 learned_addr learned my addr 172.21.15.18:0/1794178475 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:21.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.916+0000 7faab255c640 1 --2- 172.21.15.18:0/1794178475 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faaac06d730 0x7faaac157e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:21.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.916+0000 7faab1d5b640 1 --2- 172.21.15.18:0/1794178475 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faaac0cf910 0x7faaac0b7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:21.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.916+0000 7faab2d5d640 1 -- 172.21.15.18:0/1794178475 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faaac0cf910 msgr2=0x7faaac0b7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:21.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.916+0000 7faab2d5d640 1 --2- 172.21.15.18:0/1794178475 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faaac0cf910 0x7faaac0b7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:21.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.916+0000 7faab2d5d640 1 -- 172.21.15.18:0/1794178475 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faaac06d730 msgr2=0x7faaac157e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:21.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.916+0000 7faab2d5d640 1 --2- 172.21.15.18:0/1794178475 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faaac06d730 0x7faaac157e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:21.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.916+0000 7faab2d5d640 1 -- 172.21.15.18:0/1794178475 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaac15ae50 con 0x7faaac15ef80 2024-09-19T09:19:21.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.916+0000 7faab2d5d640 1 --2- 172.21.15.18:0/1794178475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faaac15ef80 0x7faaac0b7ff0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7faaa400c7a0 tx=0x7faaa400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:21.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.916+0000 7faaa2ffd640 1 -- 172.21.15.18:0/1794178475 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa4018070 con 0x7faaac15ef80 2024-09-19T09:19:21.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.916+0000 7faaa2ffd640 1 -- 172.21.15.18:0/1794178475 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaa4004d60 con 0x7faaac15ef80 2024-09-19T09:19:21.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.916+0000 7faab47c0640 1 -- 172.21.15.18:0/1794178475 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaac15b0f0 con 0x7faaac15ef80 2024-09-19T09:19:21.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.916+0000 7faaa2ffd640 1 -- 172.21.15.18:0/1794178475 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa400a880 con 0x7faaac15ef80 2024-09-19T09:19:21.928 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.917+0000 7faab47c0640 1 -- 172.21.15.18:0/1794178475 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaac15b6b0 con 0x7faaac15ef80 2024-09-19T09:19:21.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.917+0000 7faab47c0640 1 -- 172.21.15.18:0/1794178475 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaac0cff00 con 0x7faaac15ef80 2024-09-19T09:19:21.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.918+0000 7faaa2ffd640 1 -- 172.21.15.18:0/1794178475 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7faaa401b070 con 0x7faaac15ef80 2024-09-19T09:19:21.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.918+0000 7faaa2ffd640 1 --2- 172.21.15.18:0/1794178475 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faa9006c2b0 0x7faa9006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:21.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.919+0000 7faaa2ffd640 1 -- 172.21.15.18:0/1794178475 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5767+0+0 (secure 0 0 0) 0x7faaa408a8c0 con 0x7faaac15ef80 2024-09-19T09:19:21.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.919+0000 7faab255c640 1 --2- 172.21.15.18:0/1794178475 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faa9006c2b0 0x7faa9006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:21.929 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.919+0000 7faab255c640 1 --2- 172.21.15.18:0/1794178475 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faa9006c2b0 0x7faa9006e770 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7faaa8034000 tx=0x7faaa802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:21.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:21.923+0000 7faaa2ffd640 1 -- 172.21.15.18:0/1794178475 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7faaa4058a30 con 0x7faaac15ef80 2024-09-19T09:19:22.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.132+0000 7faab47c0640 1 -- 172.21.15.18:0/1794178475 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faaac0cd1a0 con 0x7faaac15ef80 2024-09-19T09:19:22.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.132+0000 7faaa2ffd640 1 -- 172.21.15.18:0/1794178475 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5225 (secure 0 0 0) 0x7faaa405cd30 con 0x7faaac15ef80 2024-09-19T09:19:22.134 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:22.134 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":48,"btime":"2024-09-19T09:19:11:196952+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5642,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/4210829543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":4210829543},{"type":"v1","addr":"172.21.15.162:6837","nonce":4210829543}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3090247017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3090247017},{"type":"v1","addr":"172.21.15.162:6836","nonce":3090247017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6546,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/62488842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":62488842},{"type":"v1","addr":"172.21.15.18:6833","nonce":62488842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:19:08.540022+0000","modified":"2024-09-19T09:19:10.541774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6549},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6549":{"gid":6549,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2870064683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":2870064683},{"type":"v1","addr":"172.21.15.18:6835","nonce":2870064683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6549,"qdb_cluster":[6549]},"id":7}]} 2024-09-19T09:19:22.134 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 48 2024-09-19T09:19:22.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.134+0000 7faab47c0640 1 -- 172.21.15.18:0/1794178475 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faa9006c2b0 msgr2=0x7faa9006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:22.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.134+0000 7faab47c0640 1 --2- 172.21.15.18:0/1794178475 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faa9006c2b0 0x7faa9006e770 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7faaa8034000 tx=0x7faaa802e000 comp rx=0 tx=0).stop 2024-09-19T09:19:22.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.134+0000 7faab47c0640 1 -- 172.21.15.18:0/1794178475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faaac15ef80 msgr2=0x7faaac0b7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:22.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.134+0000 7faab47c0640 1 --2- 172.21.15.18:0/1794178475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faaac15ef80 0x7faaac0b7ff0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7faaa400c7a0 tx=0x7faaa400cba0 comp rx=0 tx=0).stop 2024-09-19T09:19:22.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.134+0000 7faab47c0640 1 -- 172.21.15.18:0/1794178475 shutdown_connections 2024-09-19T09:19:22.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.134+0000 7faab47c0640 1 --2- 172.21.15.18:0/1794178475 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faa9006c2b0 0x7faa9006e770 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:22.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.134+0000 7faab47c0640 1 --2- 172.21.15.18:0/1794178475 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faaac15ef80 0x7faaac0b7ff0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:22.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.134+0000 7faab47c0640 1 --2- 172.21.15.18:0/1794178475 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faaac0cf910 0x7faaac0b7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:22.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.134+0000 7faab47c0640 1 --2- 172.21.15.18:0/1794178475 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faaac06d730 0x7faaac157e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:22.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.134+0000 7faab47c0640 1 -- 172.21.15.18:0/1794178475 >> 172.21.15.18:0/1794178475 conn(0x7faaac0b4700 msgr2=0x7faaac0d1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:22.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.134+0000 7faab47c0640 1 -- 172.21.15.18:0/1794178475 shutdown_connections 2024-09-19T09:19:22.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.134+0000 7faab47c0640 1 -- 172.21.15.18:0/1794178475 wait complete. 2024-09-19T09:19:22.148 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:19:22.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.249+0000 7fdc1642e640 1 Processor -- start 2024-09-19T09:19:22.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.249+0000 7fdc1642e640 1 -- start start 2024-09-19T09:19:22.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.250+0000 7fdc1642e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdc100d1ab0 0x7fdc100b8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:22.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.250+0000 7fdc1642e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdc100d3240 0x7fdc100b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:22.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.250+0000 7fdc1642e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc100b7a90 con 0x7fdc1015ef50 2024-09-19T09:19:22.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.250+0000 7fdc1642e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fdc100d3740 con 0x7fdc100d1ab0 2024-09-19T09:19:22.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.250+0000 7fdc1642e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fdc100d3a20 con 0x7fdc100d3240 2024-09-19T09:19:22.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.250+0000 7fdc07fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdc100d1ab0 0x7fdc100b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:22.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.250+0000 7fdc0ffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fdc1015ef50 0x7fdc100d13a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34678/0 (socket says 172.21.15.18:34678) 2024-09-19T09:19:22.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.250+0000 7fdc0ffff640 1 -- 172.21.15.18:0/1417510666 learned_addr learned my addr 172.21.15.18:0/1417510666 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:22.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.250+0000 7fdc149cb640 1 --2- 172.21.15.18:0/1417510666 >> v2:172.21.15.162:3300/0 conn(0x7fdc100d3240 0x7fdc100b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:22.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.250+0000 7fdc07fff640 1 -- 172.21.15.18:0/1417510666 >> v2:172.21.15.162:3300/0 conn(0x7fdc100d3240 msgr2=0x7fdc100b8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:22.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.250+0000 7fdc07fff640 1 --2- 172.21.15.18:0/1417510666 >> v2:172.21.15.162:3300/0 conn(0x7fdc100d3240 0x7fdc100b8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:22.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.250+0000 7fdc07fff640 1 -- 172.21.15.18:0/1417510666 >> v1:172.21.15.18:6789/0 conn(0x7fdc1015ef50 legacy=0x7fdc100d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:22.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.250+0000 7fdc0f7fe640 1 -- 172.21.15.18:0/1417510666 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3387902670 0 0) 0x7fdc100b7a90 con 0x7fdc1015ef50 2024-09-19T09:19:22.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.250+0000 7fdc07fff640 1 -- 172.21.15.18:0/1417510666 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc100b7d00 con 0x7fdc100d1ab0 2024-09-19T09:19:22.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.250+0000 7fdc149cb640 1 --2- 172.21.15.18:0/1417510666 >> v2:172.21.15.162:3300/0 conn(0x7fdc100d3240 0x7fdc100b8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:22.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.251+0000 7fdc07fff640 1 --2- 172.21.15.18:0/1417510666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc100d1ab0 0x7fdc100b8500 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fdc100b7760 tx=0x7fdbf802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97b21151f885c2a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:22.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.251+0000 7fdc0f7fe640 1 -- 172.21.15.18:0/1417510666 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8037070 con 0x7fdc100d1ab0 2024-09-19T09:19:22.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.251+0000 7fdc0f7fe640 1 -- 172.21.15.18:0/1417510666 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbf8032440 con 0x7fdc100d1ab0 2024-09-19T09:19:22.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.251+0000 7fdc0f7fe640 1 -- 172.21.15.18:0/1417510666 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf802ae60 con 0x7fdc100d1ab0 2024-09-19T09:19:22.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.252+0000 7fdc1642e640 1 -- 172.21.15.18:0/1417510666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc100d1ab0 msgr2=0x7fdc100b8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:22.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.252+0000 7fdc1642e640 1 --2- 172.21.15.18:0/1417510666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc100d1ab0 0x7fdc100b8500 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7fdc100b7760 tx=0x7fdbf802a110 comp rx=0 tx=0).stop 2024-09-19T09:19:22.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.252+0000 7fdc1642e640 1 -- 172.21.15.18:0/1417510666 shutdown_connections 2024-09-19T09:19:22.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.252+0000 7fdc1642e640 1 --2- 172.21.15.18:0/1417510666 >> v2:172.21.15.162:3300/0 conn(0x7fdc100d3240 0x7fdc100b8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:22.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.252+0000 7fdc1642e640 1 --2- 172.21.15.18:0/1417510666 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc100d1ab0 0x7fdc100b8500 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:22.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.252+0000 7fdc1642e640 1 -- 172.21.15.18:0/1417510666 >> 172.21.15.18:0/1417510666 conn(0x7fdc100d4c60 msgr2=0x7fdc100d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:22.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.252+0000 7fdc1642e640 1 -- 172.21.15.18:0/1417510666 shutdown_connections 2024-09-19T09:19:22.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.252+0000 7fdc1642e640 1 -- 172.21.15.18:0/1417510666 wait complete. 2024-09-19T09:19:22.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.253+0000 7fdc1642e640 1 Processor -- start 2024-09-19T09:19:22.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.253+0000 7fdc1642e640 1 -- start start 2024-09-19T09:19:22.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.255+0000 7fdc1642e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc100d1ab0 0x7fdc101f56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:22.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.255+0000 7fdc1642e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc100d3240 0x7fdc101521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:22.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.255+0000 7fdc1642e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc1015ef50 0x7fdc101f81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:22.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.255+0000 7fdc1642e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdc100d21a0 con 0x7fdc100d1ab0 2024-09-19T09:19:22.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.255+0000 7fdc1642e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdc100d2020 con 0x7fdc100d3240 2024-09-19T09:19:22.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.255+0000 7fdc1642e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdc100d5780 con 0x7fdc1015ef50 2024-09-19T09:19:22.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.255+0000 7fdc0ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc100d1ab0 0x7fdc101f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:22.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.255+0000 7fdc0ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc100d1ab0 0x7fdc101f56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36268/0 (socket says 172.21.15.18:36268) 2024-09-19T09:19:22.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.255+0000 7fdc0ffff640 1 -- 172.21.15.18:0/4218074925 learned_addr learned my addr 172.21.15.18:0/4218074925 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:22.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.255+0000 7fdc07fff640 1 --2- 172.21.15.18:0/4218074925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc100d3240 0x7fdc101521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:22.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.255+0000 7fdc149cb640 1 --2- 172.21.15.18:0/4218074925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc1015ef50 0x7fdc101f81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:22.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.255+0000 7fdc0ffff640 1 -- 172.21.15.18:0/4218074925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc1015ef50 msgr2=0x7fdc101f81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:22.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.255+0000 7fdc0ffff640 1 --2- 172.21.15.18:0/4218074925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc1015ef50 0x7fdc101f81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:22.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.255+0000 7fdc0ffff640 1 -- 172.21.15.18:0/4218074925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc100d3240 msgr2=0x7fdc101521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:22.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.255+0000 7fdc0ffff640 1 --2- 172.21.15.18:0/4218074925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc100d3240 0x7fdc101521d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:22.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.255+0000 7fdc0ffff640 1 -- 172.21.15.18:0/4218074925 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc101f4be0 con 0x7fdc100d1ab0 2024-09-19T09:19:22.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.255+0000 7fdc0ffff640 1 --2- 172.21.15.18:0/4218074925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc100d1ab0 0x7fdc101f56a0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fdc0000c460 tx=0x7fdc0000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:22.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.255+0000 7fdc0d7fa640 1 -- 172.21.15.18:0/4218074925 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc00018070 con 0x7fdc100d1ab0 2024-09-19T09:19:22.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.255+0000 7fdc0d7fa640 1 -- 172.21.15.18:0/4218074925 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc00007500 con 0x7fdc100d1ab0 2024-09-19T09:19:22.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.255+0000 7fdc1642e640 1 -- 172.21.15.18:0/4218074925 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc101f8cd0 con 0x7fdc100d1ab0 2024-09-19T09:19:22.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.255+0000 7fdc0d7fa640 1 -- 172.21.15.18:0/4218074925 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc00004a20 con 0x7fdc100d1ab0 2024-09-19T09:19:22.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.255+0000 7fdc1642e640 1 -- 172.21.15.18:0/4218074925 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc101f4ea0 con 0x7fdc100d1ab0 2024-09-19T09:19:22.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.256+0000 7fdc1642e640 1 -- 172.21.15.18:0/4218074925 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc100d13a0 con 0x7fdc100d1ab0 2024-09-19T09:19:22.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.256+0000 7fdc0d7fa640 1 -- 172.21.15.18:0/4218074925 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdc0001b070 con 0x7fdc100d1ab0 2024-09-19T09:19:22.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.257+0000 7fdc0d7fa640 1 --2- 172.21.15.18:0/4218074925 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdbf006c2b0 0x7fdbf006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:22.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.257+0000 7fdc0d7fa640 1 -- 172.21.15.18:0/4218074925 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5767+0+0 (secure 0 0 0) 0x7fdc0008a670 con 0x7fdc100d1ab0 2024-09-19T09:19:22.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.257+0000 7fdc07fff640 1 --2- 172.21.15.18:0/4218074925 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdbf006c2b0 0x7fdbf006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:22.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.257+0000 7fdc07fff640 1 --2- 172.21.15.18:0/4218074925 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdbf006c2b0 0x7fdbf006e770 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8034000 tx=0x7fdbf802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:22.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.262+0000 7fdc0d7fa640 1 -- 172.21.15.18:0/4218074925 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fdc00058750 con 0x7fdc100d1ab0 2024-09-19T09:19:22.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.471+0000 7fdc1642e640 1 -- 172.21.15.18:0/4218074925 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc1006cd70 con 0x7fdc100d1ab0 2024-09-19T09:19:22.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.471+0000 7fdc0d7fa640 1 -- 172.21.15.18:0/4218074925 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5225 (secure 0 0 0) 0x7fdc0005ca50 con 0x7fdc100d1ab0 2024-09-19T09:19:22.473 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:22.473 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":48,"btime":"2024-09-19T09:19:11:196952+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5642,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/4210829543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":4210829543},{"type":"v1","addr":"172.21.15.162:6837","nonce":4210829543}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3090247017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3090247017},{"type":"v1","addr":"172.21.15.162:6836","nonce":3090247017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6546,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/62488842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":62488842},{"type":"v1","addr":"172.21.15.18:6833","nonce":62488842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:19:08.540022+0000","modified":"2024-09-19T09:19:10.541774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6549},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6549":{"gid":6549,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2870064683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":2870064683},{"type":"v1","addr":"172.21.15.18:6835","nonce":2870064683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6549,"qdb_cluster":[6549]},"id":7}]} 2024-09-19T09:19:22.474 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 48 2024-09-19T09:19:22.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.474+0000 7fdc1642e640 1 -- 172.21.15.18:0/4218074925 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdbf006c2b0 msgr2=0x7fdbf006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:22.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.474+0000 7fdc1642e640 1 --2- 172.21.15.18:0/4218074925 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdbf006c2b0 0x7fdbf006e770 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8034000 tx=0x7fdbf802e000 comp rx=0 tx=0).stop 2024-09-19T09:19:22.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.474+0000 7fdc1642e640 1 -- 172.21.15.18:0/4218074925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc100d1ab0 msgr2=0x7fdc101f56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:22.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.474+0000 7fdc1642e640 1 --2- 172.21.15.18:0/4218074925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc100d1ab0 0x7fdc101f56a0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fdc0000c460 tx=0x7fdc0000c920 comp rx=0 tx=0).stop 2024-09-19T09:19:22.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.474+0000 7fdc1642e640 1 -- 172.21.15.18:0/4218074925 shutdown_connections 2024-09-19T09:19:22.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.474+0000 7fdc1642e640 1 --2- 172.21.15.18:0/4218074925 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdbf006c2b0 0x7fdbf006e770 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:22.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.474+0000 7fdc1642e640 1 --2- 172.21.15.18:0/4218074925 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdc1015ef50 0x7fdc101f81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:22.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.474+0000 7fdc1642e640 1 --2- 172.21.15.18:0/4218074925 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc100d3240 0x7fdc101521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:22.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.474+0000 7fdc1642e640 1 --2- 172.21.15.18:0/4218074925 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdc100d1ab0 0x7fdc101f56a0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:22.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.474+0000 7fdc1642e640 1 -- 172.21.15.18:0/4218074925 >> 172.21.15.18:0/4218074925 conn(0x7fdc100d4c60 msgr2=0x7fdc100d5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:22.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.474+0000 7fdc1642e640 1 -- 172.21.15.18:0/4218074925 shutdown_connections 2024-09-19T09:19:22.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.474+0000 7fdc1642e640 1 -- 172.21.15.18:0/4218074925 wait complete. 2024-09-19T09:19:22.486 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:19:22.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.587+0000 7f896256d640 1 Processor -- start 2024-09-19T09:19:22.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.587+0000 7f896256d640 1 -- start start 2024-09-19T09:19:22.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.589+0000 7f896256d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f895c06d730 0x7f895c0b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:22.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.589+0000 7f896256d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f895c0cd1a0 con 0x7f895c15ef80 2024-09-19T09:19:22.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.589+0000 7f896256d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f895c06dc30 con 0x7f895c0cfae0 2024-09-19T09:19:22.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.589+0000 7f896256d640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f895c0cd7d0 con 0x7f895c06d730 2024-09-19T09:19:22.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.589+0000 7f8960b0a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f895c06d730 0x7f895c0b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:22.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.589+0000 7f895bfff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f895c15ef80 0x7f895c0cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34694/0 (socket says 172.21.15.18:34694) 2024-09-19T09:19:22.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.589+0000 7f895bfff640 1 -- 172.21.15.18:0/3590652483 learned_addr learned my addr 172.21.15.18:0/3590652483 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:22.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.589+0000 7f8960b0a640 1 -- 172.21.15.18:0/3590652483 >> v1:172.21.15.162:6789/0 conn(0x7f895c0cfae0 legacy=0x7f895c0cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:22.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.589+0000 7f8960b0a640 1 -- 172.21.15.18:0/3590652483 >> v1:172.21.15.18:6789/0 conn(0x7f895c15ef80 legacy=0x7f895c0cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:22.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.589+0000 7f8960b0a640 1 -- 172.21.15.18:0/3590652483 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f895c06df10 con 0x7f895c06d730 2024-09-19T09:19:22.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.589+0000 7f895affd640 1 -- 172.21.15.18:0/3590652483 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2781814926 0 0) 0x7f895c0cd1a0 con 0x7f895c15ef80 2024-09-19T09:19:22.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.589+0000 7f8960b0a640 1 --2- 172.21.15.18:0/3590652483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f895c06d730 0x7f895c0b5220 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f8954009d90 tx=0x7f895402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267186ff34e62d71 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:22.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.589+0000 7f895affd640 1 -- 172.21.15.18:0/3590652483 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8954007740 con 0x7f895c06d730 2024-09-19T09:19:22.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.589+0000 7f895affd640 1 -- 172.21.15.18:0/3590652483 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89540078e0 con 0x7f895c06d730 2024-09-19T09:19:22.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.589+0000 7f895affd640 1 -- 172.21.15.18:0/3590652483 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8954007cb0 con 0x7f895c06d730 2024-09-19T09:19:22.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.589+0000 7f896256d640 1 -- 172.21.15.18:0/3590652483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f895c06d730 msgr2=0x7f895c0b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:22.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.589+0000 7f896256d640 1 --2- 172.21.15.18:0/3590652483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f895c06d730 0x7f895c0b5220 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f8954009d90 tx=0x7f895402a6f0 comp rx=0 tx=0).stop 2024-09-19T09:19:22.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.590+0000 7f896256d640 1 -- 172.21.15.18:0/3590652483 shutdown_connections 2024-09-19T09:19:22.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.590+0000 7f896256d640 1 --2- 172.21.15.18:0/3590652483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f895c06d730 0x7f895c0b5220 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:22.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.590+0000 7f896256d640 1 -- 172.21.15.18:0/3590652483 >> 172.21.15.18:0/3590652483 conn(0x7f895c0b4700 msgr2=0x7f895c0b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:22.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.590+0000 7f896256d640 1 -- 172.21.15.18:0/3590652483 shutdown_connections 2024-09-19T09:19:22.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.590+0000 7f896256d640 1 -- 172.21.15.18:0/3590652483 wait complete. 2024-09-19T09:19:22.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.591+0000 7f896256d640 1 Processor -- start 2024-09-19T09:19:22.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.591+0000 7f896256d640 1 -- start start 2024-09-19T09:19:22.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.592+0000 7f896256d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f895c06d730 0x7f895c156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:22.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.592+0000 7f896256d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f895c0cfae0 0x7f895c0cc540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:22.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.592+0000 7f896256d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f895c15ef80 0x7f895c159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:22.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.592+0000 7f896256d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f895c0d0120 con 0x7f895c15ef80 2024-09-19T09:19:22.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.592+0000 7f896256d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f895c15f360 con 0x7f895c06d730 2024-09-19T09:19:22.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.592+0000 7f896256d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f895c0ce370 con 0x7f895c0cfae0 2024-09-19T09:19:22.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.592+0000 7f8960b0a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f895c15ef80 0x7f895c159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:22.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.592+0000 7f8960b0a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f895c15ef80 0x7f895c159dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36290/0 (socket says 172.21.15.18:36290) 2024-09-19T09:19:22.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.592+0000 7f8960b0a640 1 -- 172.21.15.18:0/2235090462 learned_addr learned my addr 172.21.15.18:0/2235090462 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:22.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.592+0000 7f895bfff640 1 --2- 172.21.15.18:0/2235090462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f895c06d730 0x7f895c156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:22.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.592+0000 7f895b7fe640 1 --2- 172.21.15.18:0/2235090462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f895c0cfae0 0x7f895c0cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:22.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.592+0000 7f8960b0a640 1 -- 172.21.15.18:0/2235090462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f895c0cfae0 msgr2=0x7f895c0cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:22.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.592+0000 7f8960b0a640 1 --2- 172.21.15.18:0/2235090462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f895c0cfae0 0x7f895c0cc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:22.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.592+0000 7f8960b0a640 1 -- 172.21.15.18:0/2235090462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f895c06d730 msgr2=0x7f895c156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:22.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.592+0000 7f8960b0a640 1 --2- 172.21.15.18:0/2235090462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f895c06d730 0x7f895c156020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:22.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.592+0000 7f8960b0a640 1 -- 172.21.15.18:0/2235090462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f895c0cb4e0 con 0x7f895c15ef80 2024-09-19T09:19:22.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.592+0000 7f895b7fe640 1 --2- 172.21.15.18:0/2235090462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f895c0cfae0 0x7f895c0cc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:22.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.592+0000 7f8960b0a640 1 --2- 172.21.15.18:0/2235090462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f895c15ef80 0x7f895c159dc0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f8954009eb0 tx=0x7f8954004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:22.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.593+0000 7f8958ff9640 1 -- 172.21.15.18:0/2235090462 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8954040070 con 0x7f895c15ef80 2024-09-19T09:19:22.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.593+0000 7f8958ff9640 1 -- 172.21.15.18:0/2235090462 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8954031c90 con 0x7f895c15ef80 2024-09-19T09:19:22.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.593+0000 7f896256d640 1 -- 172.21.15.18:0/2235090462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f895c0cb780 con 0x7f895c15ef80 2024-09-19T09:19:22.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.593+0000 7f8958ff9640 1 -- 172.21.15.18:0/2235090462 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8954045680 con 0x7f895c15ef80 2024-09-19T09:19:22.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.593+0000 7f896256d640 1 -- 172.21.15.18:0/2235090462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f895c0cbd40 con 0x7f895c15ef80 2024-09-19T09:19:22.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.594+0000 7f896256d640 1 -- 172.21.15.18:0/2235090462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f895c0b5220 con 0x7f895c15ef80 2024-09-19T09:19:22.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.595+0000 7f8958ff9640 1 -- 172.21.15.18:0/2235090462 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8954039040 con 0x7f895c15ef80 2024-09-19T09:19:22.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.595+0000 7f8958ff9640 1 --2- 172.21.15.18:0/2235090462 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f894806c2e0 0x7f894806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:22.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.595+0000 7f8958ff9640 1 -- 172.21.15.18:0/2235090462 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5767+0+0 (secure 0 0 0) 0x7f89540acda0 con 0x7f895c15ef80 2024-09-19T09:19:22.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.595+0000 7f895bfff640 1 --2- 172.21.15.18:0/2235090462 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f894806c2e0 0x7f894806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:22.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.596+0000 7f895bfff640 1 --2- 172.21.15.18:0/2235090462 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f894806c2e0 0x7f894806e7a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f894c000f60 tx=0x7f894c007e40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:22.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.599+0000 7f8958ff9640 1 -- 172.21.15.18:0/2235090462 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f895407b620 con 0x7f895c15ef80 2024-09-19T09:19:22.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.775+0000 7f896256d640 1 -- 172.21.15.18:0/2235090462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f895c0cff00 con 0x7f895c15ef80 2024-09-19T09:19:22.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.776+0000 7f8958ff9640 1 -- 172.21.15.18:0/2235090462 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) ==== 74+0+16797 (secure 0 0 0) 0x7f895407af20 con 0x7f895c15ef80 2024-09-19T09:19:22.778 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:22.778 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":126,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:19:19.234859+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:19:06.215588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-19T09:19:07.536940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.18","mappings":[{"from":5,"to":0}]},{"pgid":"14.1e","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:19:22.780 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.780+0000 7f896256d640 1 -- 172.21.15.18:0/2235090462 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f894806c2e0 msgr2=0x7f894806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:22.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.780+0000 7f896256d640 1 --2- 172.21.15.18:0/2235090462 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f894806c2e0 0x7f894806e7a0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f894c000f60 tx=0x7f894c007e40 comp rx=0 tx=0).stop 2024-09-19T09:19:22.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.780+0000 7f896256d640 1 -- 172.21.15.18:0/2235090462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f895c15ef80 msgr2=0x7f895c159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:22.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.780+0000 7f896256d640 1 --2- 172.21.15.18:0/2235090462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f895c15ef80 0x7f895c159dc0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f8954009eb0 tx=0x7f8954004a40 comp rx=0 tx=0).stop 2024-09-19T09:19:22.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.780+0000 7f896256d640 1 -- 172.21.15.18:0/2235090462 shutdown_connections 2024-09-19T09:19:22.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.780+0000 7f896256d640 1 --2- 172.21.15.18:0/2235090462 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f894806c2e0 0x7f894806e7a0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:22.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.780+0000 7f896256d640 1 --2- 172.21.15.18:0/2235090462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f895c15ef80 0x7f895c159dc0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:22.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.780+0000 7f896256d640 1 --2- 172.21.15.18:0/2235090462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f895c0cfae0 0x7f895c0cc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:22.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.780+0000 7f896256d640 1 --2- 172.21.15.18:0/2235090462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f895c06d730 0x7f895c156020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:22.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.780+0000 7f896256d640 1 -- 172.21.15.18:0/2235090462 >> 172.21.15.18:0/2235090462 conn(0x7f895c0b4700 msgr2=0x7f895c0b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:22.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.780+0000 7f896256d640 1 -- 172.21.15.18:0/2235090462 shutdown_connections 2024-09-19T09:19:22.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.780+0000 7f896256d640 1 -- 172.21.15.18:0/2235090462 wait complete. 2024-09-19T09:19:22.792 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T09:19:22.792 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:19:22.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.893+0000 7f9e861c0640 1 Processor -- start 2024-09-19T09:19:22.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.893+0000 7f9e861c0640 1 -- start start 2024-09-19T09:19:22.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.894+0000 7f9e861c0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9e8015ef50 0x7f9e800d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:22.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.894+0000 7f9e861c0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e800d3240 0x7f9e800d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:22.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.894+0000 7f9e861c0640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e800b7a90 con 0x7f9e800d5780 2024-09-19T09:19:22.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.894+0000 7f9e861c0640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f9e800d3740 con 0x7f9e8015ef50 2024-09-19T09:19:22.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.894+0000 7f9e861c0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9e800d3a20 con 0x7f9e800d3240 2024-09-19T09:19:22.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.894+0000 7f9e7f7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9e8015ef50 0x7f9e800d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:22.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.894+0000 7f9e7ffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f9e800d5780 0x7f9e800cf770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34702/0 (socket says 172.21.15.18:34702) 2024-09-19T09:19:22.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.894+0000 7f9e7ffff640 1 -- 172.21.15.18:0/960970099 learned_addr learned my addr 172.21.15.18:0/960970099 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:22.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.895+0000 7f9e7effd640 1 --2- 172.21.15.18:0/960970099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e800d3240 0x7f9e800d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:22.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.895+0000 7f9e7f7fe640 1 -- 172.21.15.18:0/960970099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e800d3240 msgr2=0x7f9e800d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:22.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.895+0000 7f9e7f7fe640 1 --2- 172.21.15.18:0/960970099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e800d3240 0x7f9e800d18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:22.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.895+0000 7f9e7f7fe640 1 -- 172.21.15.18:0/960970099 >> v1:172.21.15.18:6789/0 conn(0x7f9e800d5780 legacy=0x7f9e800cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:22.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.895+0000 7f9e7f7fe640 1 -- 172.21.15.18:0/960970099 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e800b7d00 con 0x7f9e8015ef50 2024-09-19T09:19:22.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.895+0000 7f9e7e7fc640 1 -- 172.21.15.18:0/960970099 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2369825433 0 0) 0x7f9e800b7a90 con 0x7f9e800d5780 2024-09-19T09:19:22.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.895+0000 7f9e7f7fe640 1 --2- 172.21.15.18:0/960970099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e8015ef50 0x7f9e800d13a0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f9e70009d90 tx=0x7f9e7002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71cacaf1aaa409a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:22.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.896+0000 7f9e7e7fc640 1 -- 172.21.15.18:0/960970099 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e70031600 con 0x7f9e8015ef50 2024-09-19T09:19:22.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.896+0000 7f9e7e7fc640 1 -- 172.21.15.18:0/960970099 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e700317a0 con 0x7f9e8015ef50 2024-09-19T09:19:22.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.896+0000 7f9e7e7fc640 1 -- 172.21.15.18:0/960970099 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e70031b70 con 0x7f9e8015ef50 2024-09-19T09:19:22.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.896+0000 7f9e861c0640 1 -- 172.21.15.18:0/960970099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e8015ef50 msgr2=0x7f9e800d13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:22.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.896+0000 7f9e861c0640 1 --2- 172.21.15.18:0/960970099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e8015ef50 0x7f9e800d13a0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f9e70009d90 tx=0x7f9e7002a5d0 comp rx=0 tx=0).stop 2024-09-19T09:19:22.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.896+0000 7f9e861c0640 1 -- 172.21.15.18:0/960970099 shutdown_connections 2024-09-19T09:19:22.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.896+0000 7f9e861c0640 1 --2- 172.21.15.18:0/960970099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e800d3240 0x7f9e800d18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:22.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.896+0000 7f9e861c0640 1 --2- 172.21.15.18:0/960970099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e8015ef50 0x7f9e800d13a0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:22.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.896+0000 7f9e861c0640 1 -- 172.21.15.18:0/960970099 >> 172.21.15.18:0/960970099 conn(0x7f9e800d4c60 msgr2=0x7f9e800d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:22.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.896+0000 7f9e861c0640 1 -- 172.21.15.18:0/960970099 shutdown_connections 2024-09-19T09:19:22.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.896+0000 7f9e861c0640 1 -- 172.21.15.18:0/960970099 wait complete. 2024-09-19T09:19:22.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.897+0000 7f9e861c0640 1 Processor -- start 2024-09-19T09:19:22.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.898+0000 7f9e861c0640 1 -- start start 2024-09-19T09:19:22.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.898+0000 7f9e861c0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e800d3240 0x7f9e800cac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:22.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.898+0000 7f9e861c0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e800d5780 0x7f9e800cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:22.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.898+0000 7f9e861c0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e8015ef50 0x7f9e8015b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:22.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.898+0000 7f9e861c0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9e800d21a0 con 0x7f9e800d3240 2024-09-19T09:19:22.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.898+0000 7f9e861c0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9e800d2020 con 0x7f9e8015ef50 2024-09-19T09:19:22.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.898+0000 7f9e861c0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9e800b9510 con 0x7f9e800d5780 2024-09-19T09:19:22.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.898+0000 7f9e7f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e800d3240 0x7f9e800cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:22.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.898+0000 7f9e7f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e800d3240 0x7f9e800cac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36308/0 (socket says 172.21.15.18:36308) 2024-09-19T09:19:22.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.898+0000 7f9e7f7fe640 1 -- 172.21.15.18:0/1639555094 learned_addr learned my addr 172.21.15.18:0/1639555094 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:22.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.899+0000 7f9e7effd640 1 --2- 172.21.15.18:0/1639555094 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e800d5780 0x7f9e800cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:22.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.899+0000 7f9e7ffff640 1 --2- 172.21.15.18:0/1639555094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e8015ef50 0x7f9e8015b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:22.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.899+0000 7f9e7f7fe640 1 -- 172.21.15.18:0/1639555094 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e800d5780 msgr2=0x7f9e800cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:22.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.899+0000 7f9e7f7fe640 1 --2- 172.21.15.18:0/1639555094 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e800d5780 0x7f9e800cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:22.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.899+0000 7f9e7f7fe640 1 -- 172.21.15.18:0/1639555094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e8015ef50 msgr2=0x7f9e8015b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:22.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.899+0000 7f9e7f7fe640 1 --2- 172.21.15.18:0/1639555094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e8015ef50 0x7f9e8015b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:22.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.899+0000 7f9e7f7fe640 1 -- 172.21.15.18:0/1639555094 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e800cd6e0 con 0x7f9e800d3240 2024-09-19T09:19:22.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.899+0000 7f9e7f7fe640 1 --2- 172.21.15.18:0/1639555094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e800d3240 0x7f9e800cac40 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f9e70009d90 tx=0x7f9e70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:22.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.899+0000 7f9e67fff640 1 -- 172.21.15.18:0/1639555094 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7003f070 con 0x7f9e800d3240 2024-09-19T09:19:22.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.899+0000 7f9e67fff640 1 -- 172.21.15.18:0/1639555094 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e70030be0 con 0x7f9e800d3240 2024-09-19T09:19:22.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.899+0000 7f9e67fff640 1 -- 172.21.15.18:0/1639555094 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e70009450 con 0x7f9e800d3240 2024-09-19T09:19:22.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.899+0000 7f9e861c0640 1 -- 172.21.15.18:0/1639555094 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e800cd9c0 con 0x7f9e800d3240 2024-09-19T09:19:22.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.899+0000 7f9e861c0640 1 -- 172.21.15.18:0/1639555094 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e800cdf80 con 0x7f9e800d3240 2024-09-19T09:19:22.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.900+0000 7f9e861c0640 1 -- 172.21.15.18:0/1639555094 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e800cf350 con 0x7f9e800d3240 2024-09-19T09:19:22.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.901+0000 7f9e67fff640 1 -- 172.21.15.18:0/1639555094 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9e70043410 con 0x7f9e800d3240 2024-09-19T09:19:22.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.901+0000 7f9e67fff640 1 --2- 172.21.15.18:0/1639555094 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9e6c06c2b0 0x7f9e6c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:22.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.901+0000 7f9e67fff640 1 -- 172.21.15.18:0/1639555094 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5767+0+0 (secure 0 0 0) 0x7f9e700ac6a0 con 0x7f9e800d3240 2024-09-19T09:19:22.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.901+0000 7f9e7effd640 1 --2- 172.21.15.18:0/1639555094 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9e6c06c2b0 0x7f9e6c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:22.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.902+0000 7f9e7effd640 1 --2- 172.21.15.18:0/1639555094 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9e6c06c2b0 0x7f9e6c06e770 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9e801f8440 tx=0x7f9e74008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:22.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:22.905+0000 7f9e67fff640 1 -- 172.21.15.18:0/1639555094 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9e800cf350 con 0x7f9e800d3240 2024-09-19T09:19:23.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.118+0000 7f9e861c0640 1 -- 172.21.15.18:0/1639555094 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e800d13a0 con 0x7f9e800d3240 2024-09-19T09:19:23.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.119+0000 7f9e67fff640 1 -- 172.21.15.18:0/1639555094 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5225 (secure 0 0 0) 0x7f9e7007ae60 con 0x7f9e800d3240 2024-09-19T09:19:23.120 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:23.120 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":48,"btime":"2024-09-19T09:19:11:196952+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5642,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/4210829543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":4210829543},{"type":"v1","addr":"172.21.15.162:6837","nonce":4210829543}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3090247017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3090247017},{"type":"v1","addr":"172.21.15.162:6836","nonce":3090247017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6546,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/62488842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":62488842},{"type":"v1","addr":"172.21.15.18:6833","nonce":62488842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:19:08.540022+0000","modified":"2024-09-19T09:19:10.541774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6549},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6549":{"gid":6549,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2870064683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":2870064683},{"type":"v1","addr":"172.21.15.18:6835","nonce":2870064683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6549,"qdb_cluster":[6549]},"id":7}]} 2024-09-19T09:19:23.120 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 48 2024-09-19T09:19:23.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.121+0000 7f9e861c0640 1 -- 172.21.15.18:0/1639555094 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9e6c06c2b0 msgr2=0x7f9e6c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:23.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.121+0000 7f9e861c0640 1 --2- 172.21.15.18:0/1639555094 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9e6c06c2b0 0x7f9e6c06e770 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9e801f8440 tx=0x7f9e74008040 comp rx=0 tx=0).stop 2024-09-19T09:19:23.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.121+0000 7f9e861c0640 1 -- 172.21.15.18:0/1639555094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e800d3240 msgr2=0x7f9e800cac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:23.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.121+0000 7f9e861c0640 1 --2- 172.21.15.18:0/1639555094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e800d3240 0x7f9e800cac40 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f9e70009d90 tx=0x7f9e70004a40 comp rx=0 tx=0).stop 2024-09-19T09:19:23.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.121+0000 7f9e861c0640 1 -- 172.21.15.18:0/1639555094 shutdown_connections 2024-09-19T09:19:23.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.121+0000 7f9e861c0640 1 --2- 172.21.15.18:0/1639555094 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9e6c06c2b0 0x7f9e6c06e770 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.121+0000 7f9e861c0640 1 --2- 172.21.15.18:0/1639555094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e8015ef50 0x7f9e8015b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.121+0000 7f9e861c0640 1 --2- 172.21.15.18:0/1639555094 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e800d5780 0x7f9e800cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.121+0000 7f9e861c0640 1 --2- 172.21.15.18:0/1639555094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e800d3240 0x7f9e800cac40 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.121+0000 7f9e861c0640 1 -- 172.21.15.18:0/1639555094 >> 172.21.15.18:0/1639555094 conn(0x7f9e800d4c60 msgr2=0x7f9e800b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:23.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.121+0000 7f9e861c0640 1 -- 172.21.15.18:0/1639555094 shutdown_connections 2024-09-19T09:19:23.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.121+0000 7f9e861c0640 1 -- 172.21.15.18:0/1639555094 wait complete. 2024-09-19T09:19:23.134 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:19:23.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.235+0000 7f66356b7640 1 Processor -- start 2024-09-19T09:19:23.235 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.235+0000 7f66356b7640 1 -- start start 2024-09-19T09:19:23.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.236+0000 7f66356b7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f663013fae0 0x7f663006f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:23.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.236+0000 7f66356b7640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6630142150 0x7f6630160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:23.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.236+0000 7f66356b7640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6630142650 con 0x7f6630160a80 2024-09-19T09:19:23.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.236+0000 7f66356b7640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f66300ce780 con 0x7f6630142150 2024-09-19T09:19:23.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.236+0000 7f66356b7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6630142930 con 0x7f663013fae0 2024-09-19T09:19:23.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.236+0000 7f662f7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6630160a80 0x7f663015cf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34706/0 (socket says 172.21.15.18:34706) 2024-09-19T09:19:23.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.236+0000 7f662f7fe640 1 -- 172.21.15.18:0/3989248281 learned_addr learned my addr 172.21.15.18:0/3989248281 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:23.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.236+0000 7f662e7fc640 1 --2- 172.21.15.18:0/3989248281 >> v2:172.21.15.162:3300/0 conn(0x7f6630142150 0x7f6630160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:23.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.236+0000 7f662effd640 1 --2- 172.21.15.18:0/3989248281 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f663013fae0 0x7f663006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:23.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.236+0000 7f662dffb640 1 -- 172.21.15.18:0/3989248281 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4001009269 0 0) 0x7f6630142650 con 0x7f6630160a80 2024-09-19T09:19:23.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.236+0000 7f662dffb640 1 -- 172.21.15.18:0/3989248281 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6618003520 con 0x7f6630160a80 2024-09-19T09:19:23.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.236+0000 7f662dffb640 1 -- 172.21.15.18:0/3989248281 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3910769995 0 0) 0x7f6618003520 con 0x7f6630160a80 2024-09-19T09:19:23.239 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.236+0000 7f662dffb640 1 -- 172.21.15.18:0/3989248281 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f663013fae0 msgr2=0x7f663006f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:23.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.236+0000 7f662dffb640 1 --2- 172.21.15.18:0/3989248281 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f663013fae0 0x7f663006f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.236+0000 7f662dffb640 1 -- 172.21.15.18:0/3989248281 >> v2:172.21.15.162:3300/0 conn(0x7f6630142150 msgr2=0x7f6630160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:23.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.236+0000 7f662dffb640 1 --2- 172.21.15.18:0/3989248281 >> v2:172.21.15.162:3300/0 conn(0x7f6630142150 0x7f6630160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.236+0000 7f662dffb640 1 -- 172.21.15.18:0/3989248281 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6630142c10 con 0x7f6630160a80 2024-09-19T09:19:23.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.236+0000 7f662dffb640 1 -- 172.21.15.18:0/3989248281 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f66280019f0 con 0x7f6630160a80 2024-09-19T09:19:23.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.236+0000 7f662dffb640 1 -- 172.21.15.18:0/3989248281 >> v1:172.21.15.18:6789/0 conn(0x7f6630160a80 legacy=0x7f663015cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:23.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.236+0000 7f662dffb640 1 --2- 172.21.15.18:0/3989248281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66180039b0 0x7f6618003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:23.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.236+0000 7f662dffb640 1 --2- 172.21.15.18:0/3989248281 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f663013fae0 0x7f6618004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:23.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.236+0000 7f662dffb640 1 --2- 172.21.15.18:0/3989248281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6618004d40 0x7f66180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:23.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.236+0000 7f662dffb640 1 -- 172.21.15.18:0/3989248281 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6630142930 con 0x7f6618004d40 2024-09-19T09:19:23.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.236+0000 7f662dffb640 1 -- 172.21.15.18:0/3989248281 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f661800b9c0 con 0x7f66180039b0 2024-09-19T09:19:23.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.236+0000 7f662dffb640 1 -- 172.21.15.18:0/3989248281 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f661800bb40 con 0x7f663013fae0 2024-09-19T09:19:23.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.237+0000 7f662f7fe640 1 --2- 172.21.15.18:0/3989248281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6618004d40 0x7f66180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:23.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.237+0000 7f662effd640 1 --2- 172.21.15.18:0/3989248281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66180039b0 0x7f6618003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:23.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.237+0000 7f662e7fc640 1 --2- 172.21.15.18:0/3989248281 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f663013fae0 0x7f6618004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:23.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.237+0000 7f662f7fe640 1 -- 172.21.15.18:0/3989248281 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f663013fae0 msgr2=0x7f6618004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:23.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.237+0000 7f662f7fe640 1 --2- 172.21.15.18:0/3989248281 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f663013fae0 0x7f6618004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.237+0000 7f662f7fe640 1 -- 172.21.15.18:0/3989248281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66180039b0 msgr2=0x7f6618003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:23.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.237+0000 7f662f7fe640 1 --2- 172.21.15.18:0/3989248281 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f66180039b0 0x7f6618003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.237+0000 7f662f7fe640 1 -- 172.21.15.18:0/3989248281 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6618003520 con 0x7f6618004d40 2024-09-19T09:19:23.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.237+0000 7f662e7fc640 1 --2- 172.21.15.18:0/3989248281 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f663013fae0 0x7f6618004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:23.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.238+0000 7f662f7fe640 1 --2- 172.21.15.18:0/3989248281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6618004d40 0x7f66180051c0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f662800a920 tx=0x7f6618005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4402cea718bc15e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:23.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.238+0000 7f662dffb640 1 -- 172.21.15.18:0/3989248281 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662800a4c0 con 0x7f6618004d40 2024-09-19T09:19:23.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.238+0000 7f662dffb640 1 -- 172.21.15.18:0/3989248281 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f662802f070 con 0x7f6618004d40 2024-09-19T09:19:23.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.238+0000 7f662dffb640 1 -- 172.21.15.18:0/3989248281 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662802bd00 con 0x7f6618004d40 2024-09-19T09:19:23.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.238+0000 7f66356b7640 1 -- 172.21.15.18:0/3989248281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6618004d40 msgr2=0x7f66180051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:23.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.238+0000 7f66356b7640 1 --2- 172.21.15.18:0/3989248281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6618004d40 0x7f66180051c0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f662800a920 tx=0x7f6618005830 comp rx=0 tx=0).stop 2024-09-19T09:19:23.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.238+0000 7f662f7fe640 1 -- 172.21.15.18:0/3989248281 reap_dead start 2024-09-19T09:19:23.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.238+0000 7f66356b7640 1 -- 172.21.15.18:0/3989248281 shutdown_connections 2024-09-19T09:19:23.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.238+0000 7f66356b7640 1 -- 172.21.15.18:0/3989248281 >> 172.21.15.18:0/3989248281 conn(0x7f663006bc10 msgr2=0x7f663006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:23.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.238+0000 7f66356b7640 1 -- 172.21.15.18:0/3989248281 shutdown_connections 2024-09-19T09:19:23.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.238+0000 7f66356b7640 1 -- 172.21.15.18:0/3989248281 wait complete. 2024-09-19T09:19:23.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.240+0000 7f66356b7640 1 Processor -- start 2024-09-19T09:19:23.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.240+0000 7f66356b7640 1 -- start start 2024-09-19T09:19:23.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.240+0000 7f66356b7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6618004d40 0x7f663015e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:23.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.240+0000 7f66356b7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6630132cc0 0x7f6630145a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:23.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.240+0000 7f66356b7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f663015c1c0 0x7f6630145f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:23.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.240+0000 7f66356b7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f66300cfda0 con 0x7f6630132cc0 2024-09-19T09:19:23.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.240+0000 7f66356b7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f66300cfc20 con 0x7f663015c1c0 2024-09-19T09:19:23.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.240+0000 7f66356b7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f66300cff20 con 0x7f6618004d40 2024-09-19T09:19:23.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.240+0000 7f662e7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6630132cc0 0x7f6630145a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:23.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.240+0000 7f662e7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6630132cc0 0x7f6630145a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36324/0 (socket says 172.21.15.18:36324) 2024-09-19T09:19:23.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.240+0000 7f662e7fc640 1 -- 172.21.15.18:0/2892462085 learned_addr learned my addr 172.21.15.18:0/2892462085 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:23.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.241+0000 7f662effd640 1 --2- 172.21.15.18:0/2892462085 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6618004d40 0x7f663015e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:23.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.241+0000 7f662f7fe640 1 --2- 172.21.15.18:0/2892462085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f663015c1c0 0x7f6630145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:23.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.241+0000 7f662e7fc640 1 -- 172.21.15.18:0/2892462085 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6618004d40 msgr2=0x7f663015e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:23.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.241+0000 7f662e7fc640 1 --2- 172.21.15.18:0/2892462085 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6618004d40 0x7f663015e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.241+0000 7f662e7fc640 1 -- 172.21.15.18:0/2892462085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f663015c1c0 msgr2=0x7f6630145f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:23.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.241+0000 7f662e7fc640 1 --2- 172.21.15.18:0/2892462085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f663015c1c0 0x7f6630145f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.241+0000 7f662e7fc640 1 -- 172.21.15.18:0/2892462085 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f663015f100 con 0x7f6630132cc0 2024-09-19T09:19:23.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.241+0000 7f662effd640 1 --2- 172.21.15.18:0/2892462085 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6618004d40 0x7f663015e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:23.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.241+0000 7f662f7fe640 1 --2- 172.21.15.18:0/2892462085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f663015c1c0 0x7f6630145f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:23.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.241+0000 7f662e7fc640 1 --2- 172.21.15.18:0/2892462085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6630132cc0 0x7f6630145a00 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f6624011610 tx=0x7f6624011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:23.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.241+0000 7f66177fe640 1 -- 172.21.15.18:0/2892462085 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662400f8f0 con 0x7f6630132cc0 2024-09-19T09:19:23.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.241+0000 7f66177fe640 1 -- 172.21.15.18:0/2892462085 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f662400fa90 con 0x7f6630132cc0 2024-09-19T09:19:23.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.241+0000 7f66356b7640 1 -- 172.21.15.18:0/2892462085 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f663015f3e0 con 0x7f6630132cc0 2024-09-19T09:19:23.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.241+0000 7f66177fe640 1 -- 172.21.15.18:0/2892462085 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f662400fe80 con 0x7f6630132cc0 2024-09-19T09:19:23.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.241+0000 7f66356b7640 1 -- 172.21.15.18:0/2892462085 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f663012ec60 con 0x7f6630132cc0 2024-09-19T09:19:23.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.242+0000 7f66356b7640 1 -- 172.21.15.18:0/2892462085 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f663015f900 con 0x7f6630132cc0 2024-09-19T09:19:23.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.243+0000 7f66177fe640 1 -- 172.21.15.18:0/2892462085 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6624015460 con 0x7f6630132cc0 2024-09-19T09:19:23.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.243+0000 7f66177fe640 1 --2- 172.21.15.18:0/2892462085 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f661c06c2b0 0x7f661c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:23.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.243+0000 7f66177fe640 1 -- 172.21.15.18:0/2892462085 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5767+0+0 (secure 0 0 0) 0x7f662408bd50 con 0x7f6630132cc0 2024-09-19T09:19:23.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.244+0000 7f662effd640 1 --2- 172.21.15.18:0/2892462085 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f661c06c2b0 0x7f661c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:23.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.244+0000 7f662effd640 1 --2- 172.21.15.18:0/2892462085 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f661c06c2b0 0x7f661c06e770 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6620009a40 tx=0x7f6620008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:23.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.248+0000 7f66177fe640 1 -- 172.21.15.18:0/2892462085 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f663015f900 con 0x7f6630132cc0 2024-09-19T09:19:23.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.459+0000 7f66356b7640 1 -- 172.21.15.18:0/2892462085 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6630160540 con 0x7f6630132cc0 2024-09-19T09:19:23.460 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.460+0000 7f66177fe640 1 -- 172.21.15.18:0/2892462085 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5225 (secure 0 0 0) 0x7f662408f030 con 0x7f6630132cc0 2024-09-19T09:19:23.461 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:23.461 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":48,"btime":"2024-09-19T09:19:11:196952+0000","default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5642,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/4210829543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":4210829543},{"type":"v1","addr":"172.21.15.162:6837","nonce":4210829543}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3090247017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3090247017},{"type":"v1","addr":"172.21.15.162:6836","nonce":3090247017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6546,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/62488842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":62488842},{"type":"v1","addr":"172.21.15.18:6833","nonce":62488842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:19:08.540022+0000","modified":"2024-09-19T09:19:10.541774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6549},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6549":{"gid":6549,"name":"c","rank":0,"incarnation":46,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2870064683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":2870064683},{"type":"v1","addr":"172.21.15.18:6835","nonce":2870064683}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6549,"qdb_cluster":[6549]},"id":7}]} 2024-09-19T09:19:23.461 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 48 2024-09-19T09:19:23.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.462+0000 7f66356b7640 1 -- 172.21.15.18:0/2892462085 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f661c06c2b0 msgr2=0x7f661c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:23.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.462+0000 7f66356b7640 1 --2- 172.21.15.18:0/2892462085 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f661c06c2b0 0x7f661c06e770 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6620009a40 tx=0x7f6620008040 comp rx=0 tx=0).stop 2024-09-19T09:19:23.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.462+0000 7f66356b7640 1 -- 172.21.15.18:0/2892462085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6630132cc0 msgr2=0x7f6630145a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:23.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.462+0000 7f66356b7640 1 --2- 172.21.15.18:0/2892462085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6630132cc0 0x7f6630145a00 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f6624011610 tx=0x7f6624011ad0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.462+0000 7f66356b7640 1 -- 172.21.15.18:0/2892462085 shutdown_connections 2024-09-19T09:19:23.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.462+0000 7f66356b7640 1 --2- 172.21.15.18:0/2892462085 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f661c06c2b0 0x7f661c06e770 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.462+0000 7f66356b7640 1 --2- 172.21.15.18:0/2892462085 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f663015c1c0 0x7f6630145f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.462+0000 7f66356b7640 1 --2- 172.21.15.18:0/2892462085 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6630132cc0 0x7f6630145a00 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.462+0000 7f66356b7640 1 --2- 172.21.15.18:0/2892462085 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6618004d40 0x7f663015e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.462+0000 7f66356b7640 1 -- 172.21.15.18:0/2892462085 >> 172.21.15.18:0/2892462085 conn(0x7f663006bc10 msgr2=0x7f663013e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:23.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.462+0000 7f66356b7640 1 -- 172.21.15.18:0/2892462085 shutdown_connections 2024-09-19T09:19:23.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.462+0000 7f66356b7640 1 -- 172.21.15.18:0/2892462085 wait complete. 2024-09-19T09:19:23.475 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:19:23.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.575+0000 7fed3ff49640 1 Processor -- start 2024-09-19T09:19:23.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.576+0000 7fed3ff49640 1 -- start start 2024-09-19T09:19:23.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.576+0000 7fed3ff49640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed3815cc40 0x7fed38161070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:23.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.576+0000 7fed3ff49640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed380ce310 con 0x7fed380b2440 2024-09-19T09:19:23.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.576+0000 7fed3ff49640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed380ce5f0 con 0x7fed38160580 2024-09-19T09:19:23.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.576+0000 7fed3ff49640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fed380ce0c0 con 0x7fed3815cc40 2024-09-19T09:19:23.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.576+0000 7fed3e4e6640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fed380b2440 0x7fed380d0690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34718/0 (socket says 172.21.15.18:34718) 2024-09-19T09:19:23.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.576+0000 7fed3e4e6640 1 -- 172.21.15.18:0/2298382613 learned_addr learned my addr 172.21.15.18:0/2298382613 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:23.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.577+0000 7fed3cce3640 1 -- 172.21.15.18:0/2298382613 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 560234069 0 0) 0x7fed380ce310 con 0x7fed380b2440 2024-09-19T09:19:23.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.577+0000 7fed3cce3640 1 -- 172.21.15.18:0/2298382613 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed20003520 con 0x7fed380b2440 2024-09-19T09:19:23.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.577+0000 7fed3d4e4640 1 --2- 172.21.15.18:0/2298382613 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed3815cc40 0x7fed38161070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:23.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.577+0000 7fed3cce3640 1 -- 172.21.15.18:0/2298382613 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2424443331 0 0) 0x7fed20003520 con 0x7fed380b2440 2024-09-19T09:19:23.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.577+0000 7fed3cce3640 1 -- 172.21.15.18:0/2298382613 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed3815cc40 msgr2=0x7fed38161070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:23.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.577+0000 7fed3cce3640 1 --2- 172.21.15.18:0/2298382613 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed3815cc40 0x7fed38161070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.577+0000 7fed3cce3640 1 -- 172.21.15.18:0/2298382613 >> v1:172.21.15.162:6789/0 conn(0x7fed38160580 legacy=0x7fed38160960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:23.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.577+0000 7fed3cce3640 1 -- 172.21.15.18:0/2298382613 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed380ce8d0 con 0x7fed380b2440 2024-09-19T09:19:23.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.577+0000 7fed3cce3640 1 -- 172.21.15.18:0/2298382613 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fed30001670 con 0x7fed380b2440 2024-09-19T09:19:23.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.577+0000 7fed3cce3640 1 -- 172.21.15.18:0/2298382613 >> v1:172.21.15.18:6789/0 conn(0x7fed380b2440 legacy=0x7fed380d0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:23.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.577+0000 7fed3cce3640 1 --2- 172.21.15.18:0/2298382613 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed3815cc40 0x7fed200039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:23.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.577+0000 7fed3cce3640 1 --2- 172.21.15.18:0/2298382613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed20003f20 0x7fed20004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:23.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.577+0000 7fed3cce3640 1 --2- 172.21.15.18:0/2298382613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed20004d40 0x7fed200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:23.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.577+0000 7fed3cce3640 1 -- 172.21.15.18:0/2298382613 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fed380ce0c0 con 0x7fed20004d40 2024-09-19T09:19:23.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.577+0000 7fed3cce3640 1 -- 172.21.15.18:0/2298382613 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fed2000bad0 con 0x7fed20003f20 2024-09-19T09:19:23.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.577+0000 7fed3cce3640 1 -- 172.21.15.18:0/2298382613 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fed2000bcd0 con 0x7fed3815cc40 2024-09-19T09:19:23.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.577+0000 7fed3e4e6640 1 --2- 172.21.15.18:0/2298382613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed20004d40 0x7fed200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:23.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.577+0000 7fed3d4e4640 1 --2- 172.21.15.18:0/2298382613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed20003f20 0x7fed20004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:23.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.577+0000 7fed3dce5640 1 --2- 172.21.15.18:0/2298382613 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed3815cc40 0x7fed200039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:23.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.578+0000 7fed3e4e6640 1 -- 172.21.15.18:0/2298382613 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed3815cc40 msgr2=0x7fed200039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:23.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.578+0000 7fed3e4e6640 1 --2- 172.21.15.18:0/2298382613 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed3815cc40 0x7fed200039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.578+0000 7fed3e4e6640 1 -- 172.21.15.18:0/2298382613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed20003f20 msgr2=0x7fed20004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:23.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.578+0000 7fed3e4e6640 1 --2- 172.21.15.18:0/2298382613 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed20003f20 0x7fed20004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.578+0000 7fed3e4e6640 1 -- 172.21.15.18:0/2298382613 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed20003520 con 0x7fed20004d40 2024-09-19T09:19:23.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.578+0000 7fed3e4e6640 1 --2- 172.21.15.18:0/2298382613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed20004d40 0x7fed200051c0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fed30007fd0 tx=0x7fed20005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbce2627e720e11b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:23.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.578+0000 7fed3cce3640 1 -- 172.21.15.18:0/2298382613 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30007d50 con 0x7fed20004d40 2024-09-19T09:19:23.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.578+0000 7fed3cce3640 1 -- 172.21.15.18:0/2298382613 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed300058d0 con 0x7fed20004d40 2024-09-19T09:19:23.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.578+0000 7fed3cce3640 1 -- 172.21.15.18:0/2298382613 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed30005d20 con 0x7fed20004d40 2024-09-19T09:19:23.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.579+0000 7fed3ff49640 1 -- 172.21.15.18:0/2298382613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed20004d40 msgr2=0x7fed200051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:23.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.579+0000 7fed3ff49640 1 --2- 172.21.15.18:0/2298382613 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed20004d40 0x7fed200051c0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fed30007fd0 tx=0x7fed20005830 comp rx=0 tx=0).stop 2024-09-19T09:19:23.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.579+0000 7fed3e4e6640 1 -- 172.21.15.18:0/2298382613 reap_dead start 2024-09-19T09:19:23.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.579+0000 7fed3ff49640 1 -- 172.21.15.18:0/2298382613 shutdown_connections 2024-09-19T09:19:23.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.579+0000 7fed3ff49640 1 -- 172.21.15.18:0/2298382613 >> 172.21.15.18:0/2298382613 conn(0x7fed380b45f0 msgr2=0x7fed380b4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.579+0000 7fed3ff49640 1 -- 172.21.15.18:0/2298382613 shutdown_connections 2024-09-19T09:19:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.579+0000 7fed3ff49640 1 -- 172.21.15.18:0/2298382613 wait complete. 2024-09-19T09:19:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.580+0000 7fed3ff49640 1 Processor -- start 2024-09-19T09:19:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.580+0000 7fed3ff49640 1 -- start start 2024-09-19T09:19:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.581+0000 7fed3ff49640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed20004d40 0x7fed3815fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.581+0000 7fed3ff49640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed3806cd20 0x7fed3815d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.581+0000 7fed3ff49640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed3806d1a0 0x7fed3815d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.581+0000 7fed3ff49640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fed38161400 con 0x7fed3806cd20 2024-09-19T09:19:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.581+0000 7fed3ff49640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fed38161280 con 0x7fed20004d40 2024-09-19T09:19:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.581+0000 7fed3ff49640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fed380cf100 con 0x7fed3806d1a0 2024-09-19T09:19:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.581+0000 7fed3d4e4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed3806cd20 0x7fed3815d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.581+0000 7fed3d4e4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed3806cd20 0x7fed3815d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36352/0 (socket says 172.21.15.18:36352) 2024-09-19T09:19:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.581+0000 7fed3d4e4640 1 -- 172.21.15.18:0/2769599855 learned_addr learned my addr 172.21.15.18:0/2769599855 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:23.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.581+0000 7fed3dce5640 1 --2- 172.21.15.18:0/2769599855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed20004d40 0x7fed3815fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.581+0000 7fed3e4e6640 1 --2- 172.21.15.18:0/2769599855 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed3806d1a0 0x7fed3815d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.581+0000 7fed3d4e4640 1 -- 172.21.15.18:0/2769599855 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed3806d1a0 msgr2=0x7fed3815d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.581+0000 7fed3d4e4640 1 --2- 172.21.15.18:0/2769599855 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed3806d1a0 0x7fed3815d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.581+0000 7fed3d4e4640 1 -- 172.21.15.18:0/2769599855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed20004d40 msgr2=0x7fed3815fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.581+0000 7fed3d4e4640 1 --2- 172.21.15.18:0/2769599855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed20004d40 0x7fed3815fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.581+0000 7fed3d4e4640 1 -- 172.21.15.18:0/2769599855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed3806d770 con 0x7fed3806cd20 2024-09-19T09:19:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.582+0000 7fed3d4e4640 1 --2- 172.21.15.18:0/2769599855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed3806cd20 0x7fed3815d020 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fed2c011940 tx=0x7fed2c011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.582+0000 7fed367fc640 1 -- 172.21.15.18:0/2769599855 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2c019070 con 0x7fed3806cd20 2024-09-19T09:19:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.582+0000 7fed367fc640 1 -- 172.21.15.18:0/2769599855 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed2c004240 con 0x7fed3806cd20 2024-09-19T09:19:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.582+0000 7fed3ff49640 1 -- 172.21.15.18:0/2769599855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed3806da50 con 0x7fed3806cd20 2024-09-19T09:19:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.582+0000 7fed367fc640 1 -- 172.21.15.18:0/2769599855 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed2c00f8e0 con 0x7fed3806cd20 2024-09-19T09:19:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.582+0000 7fed3ff49640 1 -- 172.21.15.18:0/2769599855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed3806e010 con 0x7fed3806cd20 2024-09-19T09:19:23.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.583+0000 7fed3ff49640 1 -- 172.21.15.18:0/2769599855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed380ce5f0 con 0x7fed3806cd20 2024-09-19T09:19:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.583+0000 7fed367fc640 1 -- 172.21.15.18:0/2769599855 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fed2c01c070 con 0x7fed3806cd20 2024-09-19T09:19:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.584+0000 7fed367fc640 1 --2- 172.21.15.18:0/2769599855 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fed2406c2b0 0x7fed2406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.584+0000 7fed367fc640 1 -- 172.21.15.18:0/2769599855 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5767+0+0 (secure 0 0 0) 0x7fed2c08b920 con 0x7fed3806cd20 2024-09-19T09:19:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.584+0000 7fed3dce5640 1 --2- 172.21.15.18:0/2769599855 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fed2406c2b0 0x7fed2406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:23.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.585+0000 7fed3dce5640 1 --2- 172.21.15.18:0/2769599855 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fed2406c2b0 0x7fed2406e770 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fed28003fd0 tx=0x7fed28009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:23.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.588+0000 7fed367fc640 1 -- 172.21.15.18:0/2769599855 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fed2c05a050 con 0x7fed3806cd20 2024-09-19T09:19:23.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.768+0000 7fed3ff49640 1 -- 172.21.15.18:0/2769599855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed380b8a40 con 0x7fed3806cd20 2024-09-19T09:19:23.770 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.769+0000 7fed367fc640 1 -- 172.21.15.18:0/2769599855 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v126) ==== 74+0+16797 (secure 0 0 0) 0x7fed2c059950 con 0x7fed3806cd20 2024-09-19T09:19:23.770 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:23.770 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":126,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:19:19.234859+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:19:06.215588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-19T09:19:07.536940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"124","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"14.18","mappings":[{"from":5,"to":0}]},{"pgid":"14.1e","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:19:23.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.771+0000 7fed3ff49640 1 -- 172.21.15.18:0/2769599855 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fed2406c2b0 msgr2=0x7fed2406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:23.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.771+0000 7fed3ff49640 1 --2- 172.21.15.18:0/2769599855 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fed2406c2b0 0x7fed2406e770 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fed28003fd0 tx=0x7fed28009040 comp rx=0 tx=0).stop 2024-09-19T09:19:23.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.771+0000 7fed3ff49640 1 -- 172.21.15.18:0/2769599855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed3806cd20 msgr2=0x7fed3815d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:23.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.771+0000 7fed3ff49640 1 --2- 172.21.15.18:0/2769599855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed3806cd20 0x7fed3815d020 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fed2c011940 tx=0x7fed2c011e00 comp rx=0 tx=0).stop 2024-09-19T09:19:23.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.771+0000 7fed3ff49640 1 -- 172.21.15.18:0/2769599855 shutdown_connections 2024-09-19T09:19:23.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.771+0000 7fed3ff49640 1 --2- 172.21.15.18:0/2769599855 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fed2406c2b0 0x7fed2406e770 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.771+0000 7fed3ff49640 1 --2- 172.21.15.18:0/2769599855 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fed3806d1a0 0x7fed3815d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.771+0000 7fed3ff49640 1 --2- 172.21.15.18:0/2769599855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fed3806cd20 0x7fed3815d020 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.771+0000 7fed3ff49640 1 --2- 172.21.15.18:0/2769599855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fed20004d40 0x7fed3815fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.771+0000 7fed3ff49640 1 -- 172.21.15.18:0/2769599855 >> 172.21.15.18:0/2769599855 conn(0x7fed380b45f0 msgr2=0x7fed380b1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:23.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.771+0000 7fed3ff49640 1 -- 172.21.15.18:0/2769599855 shutdown_connections 2024-09-19T09:19:23.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.771+0000 7fed3ff49640 1 -- 172.21.15.18:0/2769599855 wait complete. 2024-09-19T09:19:23.783 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-19T09:19:23.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.885+0000 7ff857fd8640 1 Processor -- start 2024-09-19T09:19:23.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.885+0000 7ff857fd8640 1 -- start start 2024-09-19T09:19:23.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.886+0000 7ff857fd8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff8500b3d80 0x7ff8500b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:23.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.886+0000 7ff857fd8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8500d1c10 0x7ff8500d55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:23.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.886+0000 7ff857fd8640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8500c82c0 con 0x7ff8500b4160 2024-09-19T09:19:23.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.886+0000 7ff857fd8640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7ff8500d36d0 con 0x7ff8500b3d80 2024-09-19T09:19:23.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.886+0000 7ff857fd8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff8500d39b0 con 0x7ff8500d1c10 2024-09-19T09:19:23.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.886+0000 7ff855d74640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff8500b3d80 0x7ff8500b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:23.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.886+0000 7ff855d74640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff8500b3d80 0x7ff8500b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36360/0 (socket says 172.21.15.18:36360) 2024-09-19T09:19:23.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.886+0000 7ff855d74640 1 -- 172.21.15.18:0/1126103010 learned_addr learned my addr 172.21.15.18:0/1126103010 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:23.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.887+0000 7ff856575640 1 --2- 172.21.15.18:0/1126103010 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8500d1c10 0x7ff8500d55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:23.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.887+0000 7ff855d74640 1 -- 172.21.15.18:0/1126103010 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8500d1c10 msgr2=0x7ff8500d55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:23.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.887+0000 7ff855d74640 1 --2- 172.21.15.18:0/1126103010 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8500d1c10 0x7ff8500d55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.887+0000 7ff855d74640 1 -- 172.21.15.18:0/1126103010 >> v1:172.21.15.162:6789/0 conn(0x7ff8500b4160 legacy=0x7ff8500d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:23.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.887+0000 7ff855d74640 1 -- 172.21.15.18:0/1126103010 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8500cfb10 con 0x7ff8500b3d80 2024-09-19T09:19:23.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.888+0000 7ff855d74640 1 --2- 172.21.15.18:0/1126103010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8500b3d80 0x7ff8500b4610 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7ff848009870 tx=0x7ff84802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b693b50c5fb8ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:23.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.888+0000 7ff854d72640 1 -- 172.21.15.18:0/1126103010 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff848037070 con 0x7ff8500b3d80 2024-09-19T09:19:23.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.888+0000 7ff854d72640 1 -- 172.21.15.18:0/1126103010 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff848032440 con 0x7ff8500b3d80 2024-09-19T09:19:23.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.888+0000 7ff854d72640 1 -- 172.21.15.18:0/1126103010 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff848032810 con 0x7ff8500b3d80 2024-09-19T09:19:23.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.888+0000 7ff857fd8640 1 -- 172.21.15.18:0/1126103010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8500b3d80 msgr2=0x7ff8500b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:23.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.888+0000 7ff857fd8640 1 --2- 172.21.15.18:0/1126103010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8500b3d80 0x7ff8500b4610 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7ff848009870 tx=0x7ff84802a270 comp rx=0 tx=0).stop 2024-09-19T09:19:23.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.888+0000 7ff857fd8640 1 -- 172.21.15.18:0/1126103010 shutdown_connections 2024-09-19T09:19:23.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.888+0000 7ff857fd8640 1 --2- 172.21.15.18:0/1126103010 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8500d1c10 0x7ff8500d55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.888+0000 7ff857fd8640 1 --2- 172.21.15.18:0/1126103010 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8500b3d80 0x7ff8500b4610 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.888+0000 7ff857fd8640 1 -- 172.21.15.18:0/1126103010 >> 172.21.15.18:0/1126103010 conn(0x7ff85009df40 msgr2=0x7ff8500d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:23.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.888+0000 7ff857fd8640 1 -- 172.21.15.18:0/1126103010 shutdown_connections 2024-09-19T09:19:23.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.888+0000 7ff857fd8640 1 -- 172.21.15.18:0/1126103010 wait complete. 2024-09-19T09:19:23.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.890+0000 7ff857fd8640 1 Processor -- start 2024-09-19T09:19:23.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.890+0000 7ff857fd8640 1 -- start start 2024-09-19T09:19:23.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.890+0000 7ff857fd8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8500b3d80 0x7ff8501653c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:23.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.890+0000 7ff857fd8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8500b4160 0x7ff8500c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:23.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.890+0000 7ff857fd8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8500d1c10 0x7ff8500ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:23.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.890+0000 7ff857fd8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff8500c7be0 con 0x7ff8500b4160 2024-09-19T09:19:23.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.890+0000 7ff857fd8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff8500c7a60 con 0x7ff8500d1c10 2024-09-19T09:19:23.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.890+0000 7ff857fd8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff8500c7d60 con 0x7ff8500b3d80 2024-09-19T09:19:23.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.890+0000 7ff855573640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8500b4160 0x7ff8500c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:23.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.890+0000 7ff855573640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8500b4160 0x7ff8500c9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36376/0 (socket says 172.21.15.18:36376) 2024-09-19T09:19:23.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.890+0000 7ff855573640 1 -- 172.21.15.18:0/2321272328 learned_addr learned my addr 172.21.15.18:0/2321272328 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:23.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.891+0000 7ff855d74640 1 --2- 172.21.15.18:0/2321272328 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8500b3d80 0x7ff8501653c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:23.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.891+0000 7ff856575640 1 --2- 172.21.15.18:0/2321272328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8500d1c10 0x7ff8500ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:23.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.891+0000 7ff855573640 1 -- 172.21.15.18:0/2321272328 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8500b3d80 msgr2=0x7ff8501653c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:23.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.891+0000 7ff855573640 1 --2- 172.21.15.18:0/2321272328 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8500b3d80 0x7ff8501653c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.891+0000 7ff855573640 1 -- 172.21.15.18:0/2321272328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8500d1c10 msgr2=0x7ff8500ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:23.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.891+0000 7ff855573640 1 --2- 172.21.15.18:0/2321272328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8500d1c10 0x7ff8500ca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:23.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.891+0000 7ff855573640 1 -- 172.21.15.18:0/2321272328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8500b7ae0 con 0x7ff8500b4160 2024-09-19T09:19:23.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.891+0000 7ff855573640 1 --2- 172.21.15.18:0/2321272328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8500b4160 0x7ff8500c9e90 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7ff84400c440 tx=0x7ff844001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:23.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.891+0000 7ff84e7fc640 1 -- 172.21.15.18:0/2321272328 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8440052d0 con 0x7ff8500b4160 2024-09-19T09:19:23.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.891+0000 7ff84e7fc640 1 -- 172.21.15.18:0/2321272328 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff844005470 con 0x7ff8500b4160 2024-09-19T09:19:23.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.891+0000 7ff84e7fc640 1 -- 172.21.15.18:0/2321272328 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff844007260 con 0x7ff8500b4160 2024-09-19T09:19:23.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.891+0000 7ff857fd8640 1 -- 172.21.15.18:0/2321272328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8500c9500 con 0x7ff8500b4160 2024-09-19T09:19:23.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.891+0000 7ff857fd8640 1 -- 172.21.15.18:0/2321272328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8500b7d80 con 0x7ff8500b4160 2024-09-19T09:19:23.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.892+0000 7ff857fd8640 1 -- 172.21.15.18:0/2321272328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8500b4610 con 0x7ff8500b4160 2024-09-19T09:19:23.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.893+0000 7ff84e7fc640 1 -- 172.21.15.18:0/2321272328 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff844007400 con 0x7ff8500b4160 2024-09-19T09:19:23.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.893+0000 7ff84e7fc640 1 --2- 172.21.15.18:0/2321272328 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff83c06c2b0 0x7ff83c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:23.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.893+0000 7ff84e7fc640 1 -- 172.21.15.18:0/2321272328 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5767+0+0 (secure 0 0 0) 0x7ff84408a8f0 con 0x7ff8500b4160 2024-09-19T09:19:23.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.894+0000 7ff855d74640 1 --2- 172.21.15.18:0/2321272328 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff83c06c2b0 0x7ff83c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:23.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.894+0000 7ff855d74640 1 --2- 172.21.15.18:0/2321272328 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff83c06c2b0 0x7ff83c06e770 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff848034000 tx=0x7ff84802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:23.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:23.898+0000 7ff84e7fc640 1 -- 172.21.15.18:0/2321272328 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff8440589c0 con 0x7ff8500b4160 2024-09-19T09:19:24.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.110+0000 7ff857fd8640 1 -- 172.21.15.18:0/2321272328 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff8500d5820 con 0x7ff8500b4160 2024-09-19T09:19:24.111 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-19T09:19:24.110+0000 7fca8a79c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:19:24.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.111+0000 7ff84e7fc640 1 -- 172.21.15.18:0/2321272328 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v49) ==== 161+0+0 (secure 0 0 0) 0x7ff84405ccc0 con 0x7ff8500b4160 2024-09-19T09:19:24.112 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T09:19:24.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.115+0000 7ff857fd8640 1 -- 172.21.15.18:0/2321272328 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff83c06c2b0 msgr2=0x7ff83c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:24.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.115+0000 7ff857fd8640 1 --2- 172.21.15.18:0/2321272328 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff83c06c2b0 0x7ff83c06e770 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff848034000 tx=0x7ff84802e000 comp rx=0 tx=0).stop 2024-09-19T09:19:24.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.115+0000 7ff857fd8640 1 -- 172.21.15.18:0/2321272328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8500b4160 msgr2=0x7ff8500c9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:24.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.115+0000 7ff857fd8640 1 --2- 172.21.15.18:0/2321272328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8500b4160 0x7ff8500c9e90 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7ff84400c440 tx=0x7ff844001e70 comp rx=0 tx=0).stop 2024-09-19T09:19:24.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.116+0000 7ff857fd8640 1 -- 172.21.15.18:0/2321272328 shutdown_connections 2024-09-19T09:19:24.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.116+0000 7ff857fd8640 1 --2- 172.21.15.18:0/2321272328 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff83c06c2b0 0x7ff83c06e770 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:24.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.116+0000 7ff857fd8640 1 --2- 172.21.15.18:0/2321272328 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff8500d1c10 0x7ff8500ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:24.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.116+0000 7ff857fd8640 1 --2- 172.21.15.18:0/2321272328 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff8500b4160 0x7ff8500c9e90 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:24.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.116+0000 7ff857fd8640 1 --2- 172.21.15.18:0/2321272328 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff8500b3d80 0x7ff8501653c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:24.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.116+0000 7ff857fd8640 1 -- 172.21.15.18:0/2321272328 >> 172.21.15.18:0/2321272328 conn(0x7ff85009df40 msgr2=0x7ff8500cff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:24.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.116+0000 7ff857fd8640 1 -- 172.21.15.18:0/2321272328 shutdown_connections 2024-09-19T09:19:24.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.116+0000 7ff857fd8640 1 -- 172.21.15.18:0/2321272328 wait complete. 2024-09-19T09:19:24.118 INFO:tasks.ceph.mds.c.smithi018.stderr: -4294> 2024-09-19T09:19:14.850+0000 7f3e793b5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T09:19:24.128 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T09:19:24.152 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2024-09-19T09:19:24.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.233+0000 7f87e2ec9640 1 Processor -- start 2024-09-19T09:19:24.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.233+0000 7f87e2ec9640 1 -- start start 2024-09-19T09:19:24.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.234+0000 7f87e2ec9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87dc1626c0 0x7f87dc0b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:24.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.234+0000 7f87e2ec9640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87dc0d5c20 con 0x7f87dc0d1bd0 2024-09-19T09:19:24.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.234+0000 7f87e2ec9640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87dc0d2150 con 0x7f87dc0d17f0 2024-09-19T09:19:24.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.234+0000 7f87e2ec9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f87dc0b5020 con 0x7f87dc1626c0 2024-09-19T09:19:24.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.234+0000 7f87e1466640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f87dc0d1bd0 0x7f87dc0d28f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34732/0 (socket says 172.21.15.18:34732) 2024-09-19T09:19:24.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.234+0000 7f87e1466640 1 -- 172.21.15.18:0/1770917092 learned_addr learned my addr 172.21.15.18:0/1770917092 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:24.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.234+0000 7f87dbfff640 1 --2- 172.21.15.18:0/1770917092 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87dc1626c0 0x7f87dc0b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:24.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.234+0000 7f87db7fe640 1 -- 172.21.15.18:0/1770917092 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4229775042 0 0) 0x7f87dc0d5c20 con 0x7f87dc0d1bd0 2024-09-19T09:19:24.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.235+0000 7f87db7fe640 1 -- 172.21.15.18:0/1770917092 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87c4003520 con 0x7f87dc0d1bd0 2024-09-19T09:19:24.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.235+0000 7f87db7fe640 1 -- 172.21.15.18:0/1770917092 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3281594395 0 0) 0x7f87c4003520 con 0x7f87dc0d1bd0 2024-09-19T09:19:24.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.235+0000 7f87db7fe640 1 -- 172.21.15.18:0/1770917092 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87dc1626c0 msgr2=0x7f87dc0b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:24.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.235+0000 7f87db7fe640 1 --2- 172.21.15.18:0/1770917092 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87dc1626c0 0x7f87dc0b54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:24.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.235+0000 7f87db7fe640 1 -- 172.21.15.18:0/1770917092 >> v1:172.21.15.162:6789/0 conn(0x7f87dc0d17f0 legacy=0x7f87dc161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:24.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.235+0000 7f87db7fe640 1 -- 172.21.15.18:0/1770917092 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87dc0d2430 con 0x7f87dc0d1bd0 2024-09-19T09:19:24.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.235+0000 7f87db7fe640 1 -- 172.21.15.18:0/1770917092 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f87d40019f0 con 0x7f87dc0d1bd0 2024-09-19T09:19:24.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.235+0000 7f87db7fe640 1 -- 172.21.15.18:0/1770917092 >> v1:172.21.15.18:6789/0 conn(0x7f87dc0d1bd0 legacy=0x7f87dc0d28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:24.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.235+0000 7f87db7fe640 1 --2- 172.21.15.18:0/1770917092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c40039e0 0x7f87c4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:24.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.235+0000 7f87db7fe640 1 --2- 172.21.15.18:0/1770917092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87c4004800 0x7f87c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:24.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.235+0000 7f87db7fe640 1 --2- 172.21.15.18:0/1770917092 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87dc1626c0 0x7f87c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:24.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.235+0000 7f87db7fe640 1 -- 172.21.15.18:0/1770917092 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f87dc0b5020 con 0x7f87c40039e0 2024-09-19T09:19:24.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.235+0000 7f87db7fe640 1 -- 172.21.15.18:0/1770917092 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f87c400baa0 con 0x7f87c4004800 2024-09-19T09:19:24.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.235+0000 7f87db7fe640 1 -- 172.21.15.18:0/1770917092 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f87c400bca0 con 0x7f87dc1626c0 2024-09-19T09:19:24.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.235+0000 7f87e0c65640 1 --2- 172.21.15.18:0/1770917092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c40039e0 0x7f87c4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:24.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.235+0000 7f87dbfff640 1 --2- 172.21.15.18:0/1770917092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87c4004800 0x7f87c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:24.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.235+0000 7f87e1466640 1 --2- 172.21.15.18:0/1770917092 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87dc1626c0 0x7f87c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:24.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.235+0000 7f87e0c65640 1 -- 172.21.15.18:0/1770917092 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87dc1626c0 msgr2=0x7f87c40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:24.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.235+0000 7f87e0c65640 1 --2- 172.21.15.18:0/1770917092 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87dc1626c0 0x7f87c40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:24.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.235+0000 7f87e0c65640 1 -- 172.21.15.18:0/1770917092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87c4004800 msgr2=0x7f87c4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:24.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.235+0000 7f87e0c65640 1 --2- 172.21.15.18:0/1770917092 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87c4004800 0x7f87c4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:24.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.235+0000 7f87e0c65640 1 -- 172.21.15.18:0/1770917092 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c4003520 con 0x7f87c40039e0 2024-09-19T09:19:24.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.235+0000 7f87e1466640 1 --2- 172.21.15.18:0/1770917092 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87dc1626c0 0x7f87c40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:24.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.236+0000 7f87e0c65640 1 --2- 172.21.15.18:0/1770917092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c40039e0 0x7f87c4003e00 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f87cc001720 tx=0x7f87c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e09e988c168fd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:24.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.236+0000 7f87db7fe640 1 -- 172.21.15.18:0/1770917092 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87cc001370 con 0x7f87c40039e0 2024-09-19T09:19:24.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.236+0000 7f87db7fe640 1 -- 172.21.15.18:0/1770917092 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87cc0052d0 con 0x7f87c40039e0 2024-09-19T09:19:24.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.236+0000 7f87db7fe640 1 -- 172.21.15.18:0/1770917092 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87cc02ab90 con 0x7f87c40039e0 2024-09-19T09:19:24.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.237+0000 7f87e2ec9640 1 -- 172.21.15.18:0/1770917092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c40039e0 msgr2=0x7f87c4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:24.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.237+0000 7f87e2ec9640 1 --2- 172.21.15.18:0/1770917092 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c40039e0 0x7f87c4003e00 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f87cc001720 tx=0x7f87c4005830 comp rx=0 tx=0).stop 2024-09-19T09:19:24.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.237+0000 7f87e1466640 1 -- 172.21.15.18:0/1770917092 reap_dead start 2024-09-19T09:19:24.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.237+0000 7f87e2ec9640 1 -- 172.21.15.18:0/1770917092 shutdown_connections 2024-09-19T09:19:24.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.237+0000 7f87e2ec9640 1 -- 172.21.15.18:0/1770917092 >> 172.21.15.18:0/1770917092 conn(0x7f87dc0d4d20 msgr2=0x7f87dc0d5130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:24.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.237+0000 7f87e2ec9640 1 -- 172.21.15.18:0/1770917092 shutdown_connections 2024-09-19T09:19:24.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.237+0000 7f87e2ec9640 1 -- 172.21.15.18:0/1770917092 wait complete. 2024-09-19T09:19:24.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.238+0000 7f87e2ec9640 1 Processor -- start 2024-09-19T09:19:24.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.238+0000 7f87e2ec9640 1 -- start start 2024-09-19T09:19:24.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.239+0000 7f87e2ec9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c40039e0 0x7f87dc14b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:24.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.239+0000 7f87e2ec9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87dc0c8850 0x7f87dc0c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:24.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.239+0000 7f87e2ec9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87dc0ca6c0 0x7f87dc0cab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:24.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.239+0000 7f87e2ec9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f87dc0b5630 con 0x7f87c40039e0 2024-09-19T09:19:24.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.239+0000 7f87e2ec9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f87dc0b54b0 con 0x7f87dc0c8850 2024-09-19T09:19:24.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.239+0000 7f87e2ec9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f87dc0b57b0 con 0x7f87dc0ca6c0 2024-09-19T09:19:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.239+0000 7f87e0c65640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c40039e0 0x7f87dc14b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.239+0000 7f87e0c65640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c40039e0 0x7f87dc14b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36400/0 (socket says 172.21.15.18:36400) 2024-09-19T09:19:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.239+0000 7f87e0c65640 1 -- 172.21.15.18:0/3423580493 learned_addr learned my addr 172.21.15.18:0/3423580493 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.239+0000 7f87e0c65640 1 -- 172.21.15.18:0/3423580493 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87dc0ca6c0 msgr2=0x7f87dc0cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.239+0000 7f87e0c65640 1 --2- 172.21.15.18:0/3423580493 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87dc0ca6c0 0x7f87dc0cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.239+0000 7f87e0c65640 1 -- 172.21.15.18:0/3423580493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87dc0c8850 msgr2=0x7f87dc0c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.239+0000 7f87dbfff640 1 --2- 172.21.15.18:0/3423580493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87dc0c8850 0x7f87dc0c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.239+0000 7f87e0c65640 1 --2- 172.21.15.18:0/3423580493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87dc0c8850 0x7f87dc0c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.239+0000 7f87e0c65640 1 -- 172.21.15.18:0/3423580493 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87dc0cb3a0 con 0x7f87c40039e0 2024-09-19T09:19:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.239+0000 7f87dbfff640 1 --2- 172.21.15.18:0/3423580493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87dc0c8850 0x7f87dc0c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:24.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.240+0000 7f87e0c65640 1 --2- 172.21.15.18:0/3423580493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c40039e0 0x7f87dc14b5d0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f87cc005040 tx=0x7f87cc001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:24.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.240+0000 7f87d97fa640 1 -- 172.21.15.18:0/3423580493 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87cc042070 con 0x7f87c40039e0 2024-09-19T09:19:24.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.240+0000 7f87d97fa640 1 -- 172.21.15.18:0/3423580493 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87cc005480 con 0x7f87c40039e0 2024-09-19T09:19:24.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.240+0000 7f87e2ec9640 1 -- 172.21.15.18:0/3423580493 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87dc0cb680 con 0x7f87c40039e0 2024-09-19T09:19:24.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.240+0000 7f87d97fa640 1 -- 172.21.15.18:0/3423580493 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87cc037040 con 0x7f87c40039e0 2024-09-19T09:19:24.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.240+0000 7f87e2ec9640 1 -- 172.21.15.18:0/3423580493 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87dc0b2ca0 con 0x7f87c40039e0 2024-09-19T09:19:24.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.241+0000 7f87e2ec9640 1 -- 172.21.15.18:0/3423580493 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87dc0b2a90 con 0x7f87c40039e0 2024-09-19T09:19:24.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.241+0000 7f87d97fa640 1 -- 172.21.15.18:0/3423580493 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f87cc045070 con 0x7f87c40039e0 2024-09-19T09:19:24.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.242+0000 7f87d97fa640 1 --2- 172.21.15.18:0/3423580493 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f87c806c2b0 0x7f87c806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:24.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.242+0000 7f87d97fa640 1 -- 172.21.15.18:0/3423580493 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5853+0+0 (secure 0 0 0) 0x7f87cc02be00 con 0x7f87c40039e0 2024-09-19T09:19:24.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.242+0000 7f87dbfff640 1 --2- 172.21.15.18:0/3423580493 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f87c806c2b0 0x7f87c806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:24.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.242+0000 7f87dbfff640 1 --2- 172.21.15.18:0/3423580493 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f87c806c2b0 0x7f87c806e770 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f87dc1f82a0 tx=0x7f87d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:24.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.246+0000 7f87d97fa640 1 -- 172.21.15.18:0/3423580493 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f87cc079440 con 0x7f87c40039e0 2024-09-19T09:19:24.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:24.463+0000 7f87e2ec9640 1 -- 172.21.15.18:0/3423580493 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f87dc0b5a20 con 0x7f87c40039e0 2024-09-19T09:19:25.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.113+0000 7f87d97fa640 1 -- 172.21.15.18:0/3423580493 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v50) ==== 104+0+0 (secure 0 0 0) 0x7f87cc078d40 con 0x7f87c40039e0 2024-09-19T09:19:25.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.116+0000 7f87e2ec9640 1 -- 172.21.15.18:0/3423580493 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f87c806c2b0 msgr2=0x7f87c806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:25.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.116+0000 7f87e2ec9640 1 --2- 172.21.15.18:0/3423580493 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f87c806c2b0 0x7f87c806e770 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f87dc1f82a0 tx=0x7f87d0008040 comp rx=0 tx=0).stop 2024-09-19T09:19:25.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.116+0000 7f87e2ec9640 1 -- 172.21.15.18:0/3423580493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c40039e0 msgr2=0x7f87dc14b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:25.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.116+0000 7f87e2ec9640 1 --2- 172.21.15.18:0/3423580493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c40039e0 0x7f87dc14b5d0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f87cc005040 tx=0x7f87cc001120 comp rx=0 tx=0).stop 2024-09-19T09:19:25.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.117+0000 7f87e2ec9640 1 -- 172.21.15.18:0/3423580493 shutdown_connections 2024-09-19T09:19:25.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.117+0000 7f87e2ec9640 1 --2- 172.21.15.18:0/3423580493 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f87c806c2b0 0x7f87c806e770 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:25.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.117+0000 7f87e2ec9640 1 --2- 172.21.15.18:0/3423580493 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87dc0ca6c0 0x7f87dc0cab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:25.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.117+0000 7f87e2ec9640 1 --2- 172.21.15.18:0/3423580493 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87dc0c8850 0x7f87dc0c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:25.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.117+0000 7f87e2ec9640 1 --2- 172.21.15.18:0/3423580493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87c40039e0 0x7f87dc14b5d0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:25.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.117+0000 7f87e2ec9640 1 -- 172.21.15.18:0/3423580493 >> 172.21.15.18:0/3423580493 conn(0x7f87dc0d4d20 msgr2=0x7f87dc0d3140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:25.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.117+0000 7f87e2ec9640 1 -- 172.21.15.18:0/3423580493 shutdown_connections 2024-09-19T09:19:25.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.117+0000 7f87e2ec9640 1 -- 172.21.15.18:0/3423580493 wait complete. 2024-09-19T09:19:25.132 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T09:19:25.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.292+0000 7f257d798640 1 Processor -- start 2024-09-19T09:19:25.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.292+0000 7f257d798640 1 -- start start 2024-09-19T09:19:25.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.292+0000 7f257d798640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f25780d0370 0x7f25780d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:25.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.292+0000 7f257d798640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f25780d37c0 0x7f25780b5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:25.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.292+0000 7f257d798640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25780d0870 con 0x7f257815edb0 2024-09-19T09:19:25.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.292+0000 7f257d798640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f25780b4400 con 0x7f25780d37c0 2024-09-19T09:19:25.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.292+0000 7f257d798640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f25780d0b50 con 0x7f25780d0370 2024-09-19T09:19:25.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.292+0000 7f25777fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f25780d37c0 0x7f25780b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:25.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.293+0000 7f25777fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f25780d37c0 0x7f25780b5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53968/0 (socket says 172.21.15.18:53968) 2024-09-19T09:19:25.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.293+0000 7f25777fe640 1 -- 172.21.15.18:0/2121179634 learned_addr learned my addr 172.21.15.18:0/2121179634 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:25.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.293+0000 7f25767fc640 1 --2- 172.21.15.18:0/2121179634 >> v2:172.21.15.162:3300/0 conn(0x7f25780d0370 0x7f25780d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:25.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.293+0000 7f25777fe640 1 -- 172.21.15.18:0/2121179634 >> v2:172.21.15.162:3300/0 conn(0x7f25780d0370 msgr2=0x7f25780d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:25.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.293+0000 7f25777fe640 1 --2- 172.21.15.18:0/2121179634 >> v2:172.21.15.162:3300/0 conn(0x7f25780d0370 0x7f25780d3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:25.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.293+0000 7f25777fe640 1 -- 172.21.15.18:0/2121179634 >> v1:172.21.15.162:6789/0 conn(0x7f257815edb0 legacy=0x7f25780d29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:25.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.293+0000 7f25777fe640 1 -- 172.21.15.18:0/2121179634 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25780b4620 con 0x7f25780d37c0 2024-09-19T09:19:25.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.293+0000 7f25767fc640 1 --2- 172.21.15.18:0/2121179634 >> v2:172.21.15.162:3300/0 conn(0x7f25780d0370 0x7f25780d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:25.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.294+0000 7f25777fe640 1 --2- 172.21.15.18:0/2121179634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25780d37c0 0x7f25780b5100 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f25780d5dc0 tx=0x7f257002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=230a0d8b45d6b26b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:25.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.294+0000 7f2575ffb640 1 -- 172.21.15.18:0/2121179634 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2570037070 con 0x7f25780d37c0 2024-09-19T09:19:25.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.294+0000 7f2575ffb640 1 -- 172.21.15.18:0/2121179634 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2570032440 con 0x7f25780d37c0 2024-09-19T09:19:25.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.294+0000 7f2575ffb640 1 -- 172.21.15.18:0/2121179634 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2570032810 con 0x7f25780d37c0 2024-09-19T09:19:25.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.294+0000 7f257d798640 1 -- 172.21.15.18:0/2121179634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25780d37c0 msgr2=0x7f25780b5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:25.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.294+0000 7f257d798640 1 --2- 172.21.15.18:0/2121179634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25780d37c0 0x7f25780b5100 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f25780d5dc0 tx=0x7f257002a230 comp rx=0 tx=0).stop 2024-09-19T09:19:25.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.294+0000 7f257d798640 1 -- 172.21.15.18:0/2121179634 shutdown_connections 2024-09-19T09:19:25.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.294+0000 7f257d798640 1 --2- 172.21.15.18:0/2121179634 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25780d37c0 0x7f25780b5100 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:25.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.294+0000 7f257d798640 1 --2- 172.21.15.18:0/2121179634 >> v2:172.21.15.162:3300/0 conn(0x7f25780d0370 0x7f25780d3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:25.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.294+0000 7f257d798640 1 -- 172.21.15.18:0/2121179634 >> 172.21.15.18:0/2121179634 conn(0x7f257809df30 msgr2=0x7f25780d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:25.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.294+0000 7f257d798640 1 -- 172.21.15.18:0/2121179634 shutdown_connections 2024-09-19T09:19:25.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.294+0000 7f257d798640 1 -- 172.21.15.18:0/2121179634 wait complete. 2024-09-19T09:19:25.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.296+0000 7f257d798640 1 Processor -- start 2024-09-19T09:19:25.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.296+0000 7f257d798640 1 -- start start 2024-09-19T09:19:25.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.296+0000 7f257d798640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25780d0370 0x7f2578160d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:25.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.296+0000 7f257d798640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25780d37c0 0x7f257815d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:25.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.296+0000 7f257d798640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f257815edb0 0x7f25781e8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:25.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.296+0000 7f257d798640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f257815f190 con 0x7f25780d37c0 2024-09-19T09:19:25.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.296+0000 7f257d798640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f25780b4be0 con 0x7f257815edb0 2024-09-19T09:19:25.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.296+0000 7f257d798640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f25780b5640 con 0x7f25780d0370 2024-09-19T09:19:25.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.297+0000 7f25767fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25780d37c0 0x7f257815d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:25.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.297+0000 7f25767fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25780d37c0 0x7f257815d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53976/0 (socket says 172.21.15.18:53976) 2024-09-19T09:19:25.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.297+0000 7f25767fc640 1 -- 172.21.15.18:0/485458951 learned_addr learned my addr 172.21.15.18:0/485458951 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:25.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.297+0000 7f25777fe640 1 --2- 172.21.15.18:0/485458951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f257815edb0 0x7f25781e8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:25.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.297+0000 7f2576ffd640 1 --2- 172.21.15.18:0/485458951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25780d0370 0x7f2578160d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:25.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.297+0000 7f25767fc640 1 -- 172.21.15.18:0/485458951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25780d0370 msgr2=0x7f2578160d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:25.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.297+0000 7f25767fc640 1 --2- 172.21.15.18:0/485458951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25780d0370 0x7f2578160d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:25.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.297+0000 7f25767fc640 1 -- 172.21.15.18:0/485458951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f257815edb0 msgr2=0x7f25781e8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:25.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.297+0000 7f25767fc640 1 --2- 172.21.15.18:0/485458951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f257815edb0 0x7f25781e8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:25.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.297+0000 7f25767fc640 1 -- 172.21.15.18:0/485458951 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2578161330 con 0x7f25780d37c0 2024-09-19T09:19:25.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.297+0000 7f2576ffd640 1 --2- 172.21.15.18:0/485458951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25780d0370 0x7f2578160d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:25.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.297+0000 7f25767fc640 1 --2- 172.21.15.18:0/485458951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25780d37c0 0x7f257815d170 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f256000c7f0 tx=0x7f256000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:25.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.297+0000 7f256f7fe640 1 -- 172.21.15.18:0/485458951 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2560015070 con 0x7f25780d37c0 2024-09-19T09:19:25.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.297+0000 7f256f7fe640 1 -- 172.21.15.18:0/485458951 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2560007a30 con 0x7f25780d37c0 2024-09-19T09:19:25.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.297+0000 7f256f7fe640 1 -- 172.21.15.18:0/485458951 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2560007e00 con 0x7f25780d37c0 2024-09-19T09:19:25.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.297+0000 7f257d798640 1 -- 172.21.15.18:0/485458951 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2578161610 con 0x7f25780d37c0 2024-09-19T09:19:25.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.297+0000 7f257d798640 1 -- 172.21.15.18:0/485458951 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2578161bd0 con 0x7f25780d37c0 2024-09-19T09:19:25.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.298+0000 7f257d798640 1 -- 172.21.15.18:0/485458951 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25780d3280 con 0x7f25780d37c0 2024-09-19T09:19:25.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.299+0000 7f256f7fe640 1 -- 172.21.15.18:0/485458951 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2560018070 con 0x7f25780d37c0 2024-09-19T09:19:25.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.299+0000 7f256f7fe640 1 --2- 172.21.15.18:0/485458951 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f255806c2b0 0x7f255806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:25.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.299+0000 7f256f7fe640 1 -- 172.21.15.18:0/485458951 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5853+0+0 (secure 0 0 0) 0x7f256008b480 con 0x7f25780d37c0 2024-09-19T09:19:25.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.300+0000 7f2576ffd640 1 --2- 172.21.15.18:0/485458951 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f255806c2b0 0x7f255806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:25.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.300+0000 7f2576ffd640 1 --2- 172.21.15.18:0/485458951 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f255806c2b0 0x7f255806e770 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2568007eb0 tx=0x7f25680073c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:25.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.304+0000 7f256f7fe640 1 -- 172.21.15.18:0/485458951 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2560059b60 con 0x7f25780d37c0 2024-09-19T09:19:25.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:25.482+0000 7f257d798640 1 -- 172.21.15.18:0/485458951 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f25780b31a0 con 0x7f25780d37c0 2024-09-19T09:19:26.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.266+0000 7f256f7fe640 1 -- 172.21.15.18:0/485458951 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v128) ==== 181+0+0 (secure 0 0 0) 0x7f2560059460 con 0x7f25780d37c0 2024-09-19T09:19:26.267 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' removed 2024-09-19T09:19:26.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.269+0000 7f257d798640 1 -- 172.21.15.18:0/485458951 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f255806c2b0 msgr2=0x7f255806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:26.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.269+0000 7f257d798640 1 --2- 172.21.15.18:0/485458951 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f255806c2b0 0x7f255806e770 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2568007eb0 tx=0x7f25680073c0 comp rx=0 tx=0).stop 2024-09-19T09:19:26.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.269+0000 7f257d798640 1 -- 172.21.15.18:0/485458951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25780d37c0 msgr2=0x7f257815d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:26.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.269+0000 7f257d798640 1 --2- 172.21.15.18:0/485458951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25780d37c0 0x7f257815d170 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f256000c7f0 tx=0x7f256000ccb0 comp rx=0 tx=0).stop 2024-09-19T09:19:26.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.269+0000 7f257d798640 1 -- 172.21.15.18:0/485458951 shutdown_connections 2024-09-19T09:19:26.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.269+0000 7f257d798640 1 --2- 172.21.15.18:0/485458951 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f255806c2b0 0x7f255806e770 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:26.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.269+0000 7f257d798640 1 --2- 172.21.15.18:0/485458951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f257815edb0 0x7f25781e8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:26.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.269+0000 7f257d798640 1 --2- 172.21.15.18:0/485458951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f25780d37c0 0x7f257815d170 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:26.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.269+0000 7f257d798640 1 --2- 172.21.15.18:0/485458951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f25780d0370 0x7f2578160d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:26.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.269+0000 7f257d798640 1 -- 172.21.15.18:0/485458951 >> 172.21.15.18:0/485458951 conn(0x7f257809df30 msgr2=0x7f25780cdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:26.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.269+0000 7f257d798640 1 -- 172.21.15.18:0/485458951 shutdown_connections 2024-09-19T09:19:26.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.269+0000 7f257d798640 1 -- 172.21.15.18:0/485458951 wait complete. 2024-09-19T09:19:26.284 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T09:19:26.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.396+0000 7f87c47f8640 1 Processor -- start 2024-09-19T09:19:26.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.396+0000 7f87c47f8640 1 -- start start 2024-09-19T09:19:26.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.397+0000 7f87c47f8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f87bc0cfa60 0x7f87bc0b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:26.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.397+0000 7f87c47f8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87bc0b5180 0x7f87bc0d0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:26.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.397+0000 7f87c47f8640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87bc0b3bf0 con 0x7f87bc162410 2024-09-19T09:19:26.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.397+0000 7f87c47f8640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f87bc06df20 con 0x7f87bc0cfa60 2024-09-19T09:19:26.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.397+0000 7f87c47f8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f87bc06d8d0 con 0x7f87bc0b5180 2024-09-19T09:19:26.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.397+0000 7f87c1d93640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f87bc0cfa60 0x7f87bc0b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:26.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.397+0000 7f87c2d95640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87bc0b5180 0x7f87bc0d0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:26.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.397+0000 7f87c1d93640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f87bc0cfa60 0x7f87bc0b35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:58258/0 (socket says 172.21.15.18:58258) 2024-09-19T09:19:26.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.397+0000 7f87c1d93640 1 -- 172.21.15.18:0/612444871 learned_addr learned my addr 172.21.15.18:0/612444871 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:26.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.397+0000 7f87c2d95640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87bc0b5180 0x7f87bc0d0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:34840/0 (socket says 172.21.15.18:34840) 2024-09-19T09:19:26.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.397+0000 7f87c1d93640 1 -- 172.21.15.18:0/612444871 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87bc0b5180 msgr2=0x7f87bc0d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:26.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.397+0000 7f87c1d93640 1 --2- 172.21.15.18:0/612444871 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87bc0b5180 0x7f87bc0d0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:26.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.397+0000 7f87c1d93640 1 -- 172.21.15.18:0/612444871 >> v1:172.21.15.162:6789/0 conn(0x7f87bc162410 legacy=0x7f87bc0cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:26.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.397+0000 7f87c1592640 1 -- 172.21.15.18:0/612444871 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3006561280 0 0) 0x7f87bc0b3bf0 con 0x7f87bc162410 2024-09-19T09:19:26.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.397+0000 7f87c1d93640 1 -- 172.21.15.18:0/612444871 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87bc06dbb0 con 0x7f87bc0cfa60 2024-09-19T09:19:26.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.398+0000 7f87c1d93640 1 --2- 172.21.15.18:0/612444871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87bc0cfa60 0x7f87bc0b35e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f87ac009870 tx=0x7f87ac02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24e01930d5abc2a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:26.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.398+0000 7f87c1592640 1 -- 172.21.15.18:0/612444871 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ac037070 con 0x7f87bc0cfa60 2024-09-19T09:19:26.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.398+0000 7f87c1592640 1 -- 172.21.15.18:0/612444871 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87ac032440 con 0x7f87bc0cfa60 2024-09-19T09:19:26.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.398+0000 7f87c1592640 1 -- 172.21.15.18:0/612444871 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ac032810 con 0x7f87bc0cfa60 2024-09-19T09:19:26.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.399+0000 7f87c47f8640 1 -- 172.21.15.18:0/612444871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87bc0cfa60 msgr2=0x7f87bc0b35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:26.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.399+0000 7f87c47f8640 1 --2- 172.21.15.18:0/612444871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87bc0cfa60 0x7f87bc0b35e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f87ac009870 tx=0x7f87ac02a270 comp rx=0 tx=0).stop 2024-09-19T09:19:26.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.399+0000 7f87c47f8640 1 -- 172.21.15.18:0/612444871 shutdown_connections 2024-09-19T09:19:26.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.399+0000 7f87c47f8640 1 --2- 172.21.15.18:0/612444871 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87bc0b5180 0x7f87bc0d0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:26.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.399+0000 7f87c47f8640 1 --2- 172.21.15.18:0/612444871 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87bc0cfa60 0x7f87bc0b35e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:26.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.399+0000 7f87c47f8640 1 -- 172.21.15.18:0/612444871 >> 172.21.15.18:0/612444871 conn(0x7f87bc0b4660 msgr2=0x7f87bc0b4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:26.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.399+0000 7f87c47f8640 1 -- 172.21.15.18:0/612444871 shutdown_connections 2024-09-19T09:19:26.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.399+0000 7f87c47f8640 1 -- 172.21.15.18:0/612444871 wait complete. 2024-09-19T09:19:26.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.400+0000 7f87c47f8640 1 Processor -- start 2024-09-19T09:19:26.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.400+0000 7f87c47f8640 1 -- start start 2024-09-19T09:19:26.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.401+0000 7f87c47f8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87bc0b5180 0x7f87bc0b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:26.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.401+0000 7f87c47f8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87bc0cfa60 0x7f87bc14fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:26.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.401+0000 7f87c47f8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87bc162410 0x7f87bc150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:26.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.401+0000 7f87c47f8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f87bc0d00e0 con 0x7f87bc0b5180 2024-09-19T09:19:26.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.401+0000 7f87c47f8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f87bc0cff60 con 0x7f87bc162410 2024-09-19T09:19:26.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.401+0000 7f87c47f8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f87bc0d1230 con 0x7f87bc0cfa60 2024-09-19T09:19:26.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.401+0000 7f87c2594640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87bc0b5180 0x7f87bc0b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:26.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.401+0000 7f87c2594640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87bc0b5180 0x7f87bc0b0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53990/0 (socket says 172.21.15.18:53990) 2024-09-19T09:19:26.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.401+0000 7f87c2594640 1 -- 172.21.15.18:0/1749417987 learned_addr learned my addr 172.21.15.18:0/1749417987 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:26.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.401+0000 7f87c2d95640 1 --2- 172.21.15.18:0/1749417987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87bc162410 0x7f87bc150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:26.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.401+0000 7f87c2594640 1 -- 172.21.15.18:0/1749417987 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87bc0cfa60 msgr2=0x7f87bc14fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:26.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.401+0000 7f87c2594640 1 --2- 172.21.15.18:0/1749417987 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87bc0cfa60 0x7f87bc14fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:26.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.401+0000 7f87c2594640 1 -- 172.21.15.18:0/1749417987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87bc162410 msgr2=0x7f87bc150430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:26.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.401+0000 7f87c2594640 1 --2- 172.21.15.18:0/1749417987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87bc162410 0x7f87bc150430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:26.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.401+0000 7f87c2594640 1 -- 172.21.15.18:0/1749417987 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87bc0cbf80 con 0x7f87bc0b5180 2024-09-19T09:19:26.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.402+0000 7f87c2594640 1 --2- 172.21.15.18:0/1749417987 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87bc0b5180 0x7f87bc0b0b90 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f87b800c410 tx=0x7f87b800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:26.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.402+0000 7f87b2ffd640 1 -- 172.21.15.18:0/1749417987 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b8017070 con 0x7f87bc0b5180 2024-09-19T09:19:26.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.402+0000 7f87b2ffd640 1 -- 172.21.15.18:0/1749417987 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87b80035f0 con 0x7f87bc0b5180 2024-09-19T09:19:26.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.402+0000 7f87b2ffd640 1 -- 172.21.15.18:0/1749417987 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b80039e0 con 0x7f87bc0b5180 2024-09-19T09:19:26.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.402+0000 7f87c47f8640 1 -- 172.21.15.18:0/1749417987 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87bc0cc260 con 0x7f87bc0b5180 2024-09-19T09:19:26.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.402+0000 7f87c47f8640 1 -- 172.21.15.18:0/1749417987 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87bc0cc820 con 0x7f87bc0b5180 2024-09-19T09:19:26.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.403+0000 7f87c47f8640 1 -- 172.21.15.18:0/1749417987 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87bc0d0cf0 con 0x7f87bc0b5180 2024-09-19T09:19:26.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.403+0000 7f87b2ffd640 1 -- 172.21.15.18:0/1749417987 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f87b801a070 con 0x7f87bc0b5180 2024-09-19T09:19:26.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.404+0000 7f87b2ffd640 1 --2- 172.21.15.18:0/1749417987 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f87a006c2b0 0x7f87a006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:26.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.404+0000 7f87b2ffd640 1 -- 172.21.15.18:0/1749417987 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5357+0+0 (secure 0 0 0) 0x7f87b808a6c0 con 0x7f87bc0b5180 2024-09-19T09:19:26.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.404+0000 7f87c1d93640 1 --2- 172.21.15.18:0/1749417987 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f87a006c2b0 0x7f87a006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:26.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.404+0000 7f87c1d93640 1 --2- 172.21.15.18:0/1749417987 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f87a006c2b0 0x7f87a006e770 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f87ac034000 tx=0x7f87ac02c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:26.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.408+0000 7f87b2ffd640 1 -- 172.21.15.18:0/1749417987 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f87b8059020 con 0x7f87bc0b5180 2024-09-19T09:19:26.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:26.583+0000 7f87c47f8640 1 -- 172.21.15.18:0/1749417987 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f87bc0b2200 con 0x7f87bc0b5180 2024-09-19T09:19:27.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.267+0000 7f87b2ffd640 1 -- 172.21.15.18:0/1749417987 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v129) ==== 169+0+0 (secure 0 0 0) 0x7f87b8058920 con 0x7f87bc0b5180 2024-09-19T09:19:27.268 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' removed 2024-09-19T09:19:27.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.271+0000 7f87c47f8640 1 -- 172.21.15.18:0/1749417987 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f87a006c2b0 msgr2=0x7f87a006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:27.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.271+0000 7f87c47f8640 1 --2- 172.21.15.18:0/1749417987 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f87a006c2b0 0x7f87a006e770 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f87ac034000 tx=0x7f87ac02c000 comp rx=0 tx=0).stop 2024-09-19T09:19:27.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.271+0000 7f87c47f8640 1 -- 172.21.15.18:0/1749417987 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87bc0b5180 msgr2=0x7f87bc0b0b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:27.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.271+0000 7f87c47f8640 1 --2- 172.21.15.18:0/1749417987 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87bc0b5180 0x7f87bc0b0b90 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f87b800c410 tx=0x7f87b800c8d0 comp rx=0 tx=0).stop 2024-09-19T09:19:27.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.271+0000 7f87c47f8640 1 -- 172.21.15.18:0/1749417987 shutdown_connections 2024-09-19T09:19:27.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.271+0000 7f87c47f8640 1 --2- 172.21.15.18:0/1749417987 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f87a006c2b0 0x7f87a006e770 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:27.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.271+0000 7f87c47f8640 1 --2- 172.21.15.18:0/1749417987 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87bc162410 0x7f87bc150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:27.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.271+0000 7f87c47f8640 1 --2- 172.21.15.18:0/1749417987 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f87bc0cfa60 0x7f87bc14fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:27.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.271+0000 7f87c47f8640 1 --2- 172.21.15.18:0/1749417987 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f87bc0b5180 0x7f87bc0b0b90 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:27.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.271+0000 7f87c47f8640 1 -- 172.21.15.18:0/1749417987 >> 172.21.15.18:0/1749417987 conn(0x7f87bc0b4660 msgr2=0x7f87bc06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:27.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.271+0000 7f87c47f8640 1 -- 172.21.15.18:0/1749417987 shutdown_connections 2024-09-19T09:19:27.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.271+0000 7f87c47f8640 1 -- 172.21.15.18:0/1749417987 wait complete. 2024-09-19T09:19:27.286 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-19T09:19:27.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.396+0000 7f890495f640 1 Processor -- start 2024-09-19T09:19:27.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.397+0000 7f890495f640 1 -- start start 2024-09-19T09:19:27.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.397+0000 7f890495f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f890015b760 0x7f89000afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:27.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.398+0000 7f890495f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f89000d0630 0x7f89000d0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:27.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.398+0000 7f890495f640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89000b4300 con 0x7f89000b4a90 2024-09-19T09:19:27.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.398+0000 7f890495f640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f89000d0fc0 con 0x7f89000d0630 2024-09-19T09:19:27.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.398+0000 7f890495f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f890006d700 con 0x7f890015b760 2024-09-19T09:19:27.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.398+0000 7f88fe59c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f890015b760 0x7f89000afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:27.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.398+0000 7f88fed9d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f89000d0630 0x7f89000d0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:27.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.398+0000 7f88fed9d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f89000d0630 0x7f89000d0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:58270/0 (socket says 172.21.15.18:58270) 2024-09-19T09:19:27.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.398+0000 7f88fe59c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f890015b760 0x7f89000afa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:34864/0 (socket says 172.21.15.18:34864) 2024-09-19T09:19:27.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.398+0000 7f88fed9d640 1 -- 172.21.15.18:0/4293122910 learned_addr learned my addr 172.21.15.18:0/4293122910 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:27.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.398+0000 7f88fe59c640 1 -- 172.21.15.18:0/4293122910 >> v2:172.21.15.162:3300/0 conn(0x7f89000d0630 msgr2=0x7f89000d0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:27.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.398+0000 7f88fe59c640 1 --2- 172.21.15.18:0/4293122910 >> v2:172.21.15.162:3300/0 conn(0x7f89000d0630 0x7f89000d0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:27.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.398+0000 7f88fe59c640 1 -- 172.21.15.18:0/4293122910 >> v1:172.21.15.162:6789/0 conn(0x7f89000b4a90 legacy=0x7f890006f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:27.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.398+0000 7f88fe59c640 1 -- 172.21.15.18:0/4293122910 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f890006d9e0 con 0x7f890015b760 2024-09-19T09:19:27.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.398+0000 7f88fd59a640 1 -- 172.21.15.18:0/4293122910 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3729094711 0 0) 0x7f89000b4300 con 0x7f89000b4a90 2024-09-19T09:19:27.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.398+0000 7f88fed9d640 1 --2- 172.21.15.18:0/4293122910 >> v2:172.21.15.162:3300/0 conn(0x7f89000d0630 0x7f89000d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:27.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.399+0000 7f88fe59c640 1 --2- 172.21.15.18:0/4293122910 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f890015b760 0x7f89000afa90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f88f00097a0 tx=0x7f88f002a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e293b3e813c5739c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:27.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.399+0000 7f88fd59a640 1 -- 172.21.15.18:0/4293122910 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f0037070 con 0x7f890015b760 2024-09-19T09:19:27.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.399+0000 7f88fd59a640 1 -- 172.21.15.18:0/4293122910 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f002adb0 con 0x7f890015b760 2024-09-19T09:19:27.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.399+0000 7f88fd59a640 1 -- 172.21.15.18:0/4293122910 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f0032660 con 0x7f890015b760 2024-09-19T09:19:27.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.400+0000 7f890495f640 1 -- 172.21.15.18:0/4293122910 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f890015b760 msgr2=0x7f89000afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:27.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.400+0000 7f890495f640 1 --2- 172.21.15.18:0/4293122910 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f890015b760 0x7f89000afa90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f88f00097a0 tx=0x7f88f002a060 comp rx=0 tx=0).stop 2024-09-19T09:19:27.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.400+0000 7f890495f640 1 -- 172.21.15.18:0/4293122910 shutdown_connections 2024-09-19T09:19:27.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.400+0000 7f890495f640 1 --2- 172.21.15.18:0/4293122910 >> v2:172.21.15.162:3300/0 conn(0x7f89000d0630 0x7f89000d0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:27.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.400+0000 7f890495f640 1 --2- 172.21.15.18:0/4293122910 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f890015b760 0x7f89000afa90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:27.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.400+0000 7f890495f640 1 -- 172.21.15.18:0/4293122910 >> 172.21.15.18:0/4293122910 conn(0x7f890006bc10 msgr2=0x7f890006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:27.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.400+0000 7f890495f640 1 -- 172.21.15.18:0/4293122910 shutdown_connections 2024-09-19T09:19:27.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.400+0000 7f890495f640 1 -- 172.21.15.18:0/4293122910 wait complete. 2024-09-19T09:19:27.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.401+0000 7f890495f640 1 Processor -- start 2024-09-19T09:19:27.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.402+0000 7f890495f640 1 -- start start 2024-09-19T09:19:27.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.402+0000 7f890495f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89000b4a90 0x7f8900152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:27.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.402+0000 7f890495f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89000d0630 0x7f89000ab630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:27.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.402+0000 7f890495f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f890015b760 0x7f89000cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:27.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.402+0000 7f890495f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f89000b5070 con 0x7f89000d0630 2024-09-19T09:19:27.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.402+0000 7f890495f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f89000b4ef0 con 0x7f890015b760 2024-09-19T09:19:27.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.402+0000 7f890495f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f890015bb40 con 0x7f89000b4a90 2024-09-19T09:19:27.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.402+0000 7f88fdd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89000d0630 0x7f89000ab630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:27.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.402+0000 7f88fdd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89000d0630 0x7f89000ab630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54004/0 (socket says 172.21.15.18:54004) 2024-09-19T09:19:27.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.402+0000 7f88fdd9b640 1 -- 172.21.15.18:0/2886629023 learned_addr learned my addr 172.21.15.18:0/2886629023 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:27.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.403+0000 7f88fed9d640 1 --2- 172.21.15.18:0/2886629023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f890015b760 0x7f89000cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:27.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.403+0000 7f88fe59c640 1 --2- 172.21.15.18:0/2886629023 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89000b4a90 0x7f8900152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:27.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.403+0000 7f88fdd9b640 1 -- 172.21.15.18:0/2886629023 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89000b4a90 msgr2=0x7f8900152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:27.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.403+0000 7f88fdd9b640 1 --2- 172.21.15.18:0/2886629023 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89000b4a90 0x7f8900152f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:27.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.403+0000 7f88fdd9b640 1 -- 172.21.15.18:0/2886629023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f890015b760 msgr2=0x7f89000cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:27.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.403+0000 7f88fdd9b640 1 --2- 172.21.15.18:0/2886629023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f890015b760 0x7f89000cd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:27.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.403+0000 7f88fdd9b640 1 -- 172.21.15.18:0/2886629023 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89001538c0 con 0x7f89000d0630 2024-09-19T09:19:27.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.403+0000 7f88fed9d640 1 --2- 172.21.15.18:0/2886629023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f890015b760 0x7f89000cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:27.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.403+0000 7f88fe59c640 1 --2- 172.21.15.18:0/2886629023 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89000b4a90 0x7f8900152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:27.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.403+0000 7f88fdd9b640 1 --2- 172.21.15.18:0/2886629023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89000d0630 0x7f89000ab630 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f88f400c410 tx=0x7f88f400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:27.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.403+0000 7f88eeffd640 1 -- 172.21.15.18:0/2886629023 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f4017070 con 0x7f89000d0630 2024-09-19T09:19:27.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.403+0000 7f88eeffd640 1 -- 172.21.15.18:0/2886629023 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f40035f0 con 0x7f89000d0630 2024-09-19T09:19:27.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.403+0000 7f890495f640 1 -- 172.21.15.18:0/2886629023 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89001535e0 con 0x7f89000d0630 2024-09-19T09:19:27.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.403+0000 7f88eeffd640 1 -- 172.21.15.18:0/2886629023 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f40039e0 con 0x7f89000d0630 2024-09-19T09:19:27.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.403+0000 7f890495f640 1 -- 172.21.15.18:0/2886629023 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89001558a0 con 0x7f89000d0630 2024-09-19T09:19:27.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.404+0000 7f890495f640 1 -- 172.21.15.18:0/2886629023 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f890006dcc0 con 0x7f89000d0630 2024-09-19T09:19:27.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.405+0000 7f88eeffd640 1 -- 172.21.15.18:0/2886629023 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f88f401a070 con 0x7f89000d0630 2024-09-19T09:19:27.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.405+0000 7f88eeffd640 1 --2- 172.21.15.18:0/2886629023 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f88e006c2b0 0x7f88e006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:27.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.405+0000 7f88eeffd640 1 -- 172.21.15.18:0/2886629023 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 4943+0+0 (secure 0 0 0) 0x7f88f408a520 con 0x7f89000d0630 2024-09-19T09:19:27.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.406+0000 7f88fe59c640 1 --2- 172.21.15.18:0/2886629023 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f88e006c2b0 0x7f88e006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:27.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.406+0000 7f88fe59c640 1 --2- 172.21.15.18:0/2886629023 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f88e006c2b0 0x7f88e006e770 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f88f0034000 tx=0x7f88f002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:27.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.410+0000 7f88eeffd640 1 -- 172.21.15.18:0/2886629023 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f88f4059020 con 0x7f89000d0630 2024-09-19T09:19:27.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.585+0000 7f890495f640 1 -- 172.21.15.18:0/2886629023 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f89000ccf80 con 0x7f89000d0630 2024-09-19T09:19:27.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.589+0000 7f88eeffd640 1 -- 172.21.15.18:0/2886629023 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7f88f4058920 con 0x7f89000d0630 2024-09-19T09:19:27.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.591+0000 7f890495f640 1 -- 172.21.15.18:0/2886629023 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f88e006c2b0 msgr2=0x7f88e006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:27.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.591+0000 7f890495f640 1 --2- 172.21.15.18:0/2886629023 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f88e006c2b0 0x7f88e006e770 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f88f0034000 tx=0x7f88f002e000 comp rx=0 tx=0).stop 2024-09-19T09:19:27.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.591+0000 7f890495f640 1 -- 172.21.15.18:0/2886629023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89000d0630 msgr2=0x7f89000ab630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:27.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.591+0000 7f890495f640 1 --2- 172.21.15.18:0/2886629023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89000d0630 0x7f89000ab630 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f88f400c410 tx=0x7f88f400c8d0 comp rx=0 tx=0).stop 2024-09-19T09:19:27.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.591+0000 7f890495f640 1 -- 172.21.15.18:0/2886629023 shutdown_connections 2024-09-19T09:19:27.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.591+0000 7f890495f640 1 --2- 172.21.15.18:0/2886629023 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f88e006c2b0 0x7f88e006e770 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:27.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.591+0000 7f890495f640 1 --2- 172.21.15.18:0/2886629023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f890015b760 0x7f89000cd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:27.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.591+0000 7f890495f640 1 --2- 172.21.15.18:0/2886629023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89000d0630 0x7f89000ab630 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:27.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.591+0000 7f890495f640 1 --2- 172.21.15.18:0/2886629023 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89000b4a90 0x7f8900152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:27.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.591+0000 7f890495f640 1 -- 172.21.15.18:0/2886629023 >> 172.21.15.18:0/2886629023 conn(0x7f890006bc10 msgr2=0x7f89000b0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:27.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.591+0000 7f890495f640 1 -- 172.21.15.18:0/2886629023 shutdown_connections 2024-09-19T09:19:27.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.591+0000 7f890495f640 1 -- 172.21.15.18:0/2886629023 wait complete. 2024-09-19T09:19:27.603 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2024-09-19T09:19:27.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.704+0000 7faa139f6640 1 Processor -- start 2024-09-19T09:19:27.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.704+0000 7faa139f6640 1 -- start start 2024-09-19T09:19:27.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.705+0000 7faa139f6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa0c15ef80 0x7faa0c0b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:27.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.705+0000 7faa139f6640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa0c0cd1a0 con 0x7faa0c0cfae0 2024-09-19T09:19:27.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.705+0000 7faa139f6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa0c06dc30 con 0x7faa0c06d730 2024-09-19T09:19:27.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.705+0000 7faa139f6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faa0c0cd7d0 con 0x7faa0c15ef80 2024-09-19T09:19:27.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.705+0000 7faa11f93640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7faa0c0cfae0 0x7faa0c0cdc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34430/0 (socket says 172.21.15.18:34430) 2024-09-19T09:19:27.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.705+0000 7faa11f93640 1 -- 172.21.15.18:0/62404005 learned_addr learned my addr 172.21.15.18:0/62404005 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:27.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.705+0000 7faa11792640 1 --2- 172.21.15.18:0/62404005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa0c15ef80 0x7faa0c0b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:27.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.705+0000 7faa03fff640 1 -- 172.21.15.18:0/62404005 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 897918071 0 0) 0x7faa0c0cd1a0 con 0x7faa0c0cfae0 2024-09-19T09:19:27.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.706+0000 7faa03fff640 1 -- 172.21.15.18:0/62404005 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9f8003520 con 0x7faa0c0cfae0 2024-09-19T09:19:27.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.706+0000 7faa03fff640 1 -- 172.21.15.18:0/62404005 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 473926760 0 0) 0x7fa9f8003520 con 0x7faa0c0cfae0 2024-09-19T09:19:27.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.706+0000 7faa03fff640 1 -- 172.21.15.18:0/62404005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa0c15ef80 msgr2=0x7faa0c0b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:27.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.706+0000 7faa03fff640 1 --2- 172.21.15.18:0/62404005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa0c15ef80 0x7faa0c0b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:27.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.706+0000 7faa03fff640 1 -- 172.21.15.18:0/62404005 >> v1:172.21.15.162:6789/0 conn(0x7faa0c06d730 legacy=0x7faa0c0cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:27.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.706+0000 7faa03fff640 1 -- 172.21.15.18:0/62404005 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0c06df10 con 0x7faa0c0cfae0 2024-09-19T09:19:27.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.706+0000 7faa03fff640 1 -- 172.21.15.18:0/62404005 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7faa040019f0 con 0x7faa0c0cfae0 2024-09-19T09:19:27.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.706+0000 7faa03fff640 1 -- 172.21.15.18:0/62404005 >> v1:172.21.15.18:6789/0 conn(0x7faa0c0cfae0 legacy=0x7faa0c0cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:27.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.706+0000 7faa03fff640 1 --2- 172.21.15.18:0/62404005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa0c15ef80 0x7fa9f80039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:27.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.706+0000 7faa03fff640 1 --2- 172.21.15.18:0/62404005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9f8003f60 0x7fa9f8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:27.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.706+0000 7faa03fff640 1 --2- 172.21.15.18:0/62404005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9f8004d40 0x7fa9f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:27.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.706+0000 7faa03fff640 1 -- 172.21.15.18:0/62404005 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c0cd7d0 con 0x7fa9f8003f60 2024-09-19T09:19:27.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.706+0000 7faa03fff640 1 -- 172.21.15.18:0/62404005 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa9f800baa0 con 0x7fa9f8004d40 2024-09-19T09:19:27.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.706+0000 7faa03fff640 1 -- 172.21.15.18:0/62404005 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa9f800bca0 con 0x7faa0c15ef80 2024-09-19T09:19:27.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.706+0000 7faa10f91640 1 --2- 172.21.15.18:0/62404005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9f8003f60 0x7fa9f8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:27.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.706+0000 7faa11792640 1 --2- 172.21.15.18:0/62404005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa0c15ef80 0x7fa9f80039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:27.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.706+0000 7faa11f93640 1 --2- 172.21.15.18:0/62404005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9f8004d40 0x7fa9f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:27.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.706+0000 7faa10f91640 1 -- 172.21.15.18:0/62404005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa0c15ef80 msgr2=0x7fa9f80039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:27.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.706+0000 7faa10f91640 1 --2- 172.21.15.18:0/62404005 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa0c15ef80 0x7fa9f80039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:27.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.706+0000 7faa10f91640 1 -- 172.21.15.18:0/62404005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9f8004d40 msgr2=0x7fa9f80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:27.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.706+0000 7faa10f91640 1 --2- 172.21.15.18:0/62404005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa9f8004d40 0x7fa9f80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:27.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.706+0000 7faa10f91640 1 -- 172.21.15.18:0/62404005 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9f8003520 con 0x7fa9f8003f60 2024-09-19T09:19:27.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.707+0000 7faa10f91640 1 --2- 172.21.15.18:0/62404005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9f8003f60 0x7fa9f8004800 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0b57c0 tx=0x7fa9f8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a46381676ffe143b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:27.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.707+0000 7faa03fff640 1 -- 172.21.15.18:0/62404005 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc001370 con 0x7fa9f8003f60 2024-09-19T09:19:27.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.707+0000 7faa03fff640 1 -- 172.21.15.18:0/62404005 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9fc0052d0 con 0x7fa9f8003f60 2024-09-19T09:19:27.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.707+0000 7faa03fff640 1 -- 172.21.15.18:0/62404005 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc02ab50 con 0x7fa9f8003f60 2024-09-19T09:19:27.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.708+0000 7faa139f6640 1 -- 172.21.15.18:0/62404005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9f8003f60 msgr2=0x7fa9f8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:27.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.708+0000 7faa139f6640 1 --2- 172.21.15.18:0/62404005 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa9f8003f60 0x7fa9f8004800 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0b57c0 tx=0x7fa9f8005830 comp rx=0 tx=0).stop 2024-09-19T09:19:27.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.708+0000 7faa11f93640 1 -- 172.21.15.18:0/62404005 reap_dead start 2024-09-19T09:19:27.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.708+0000 7faa139f6640 1 -- 172.21.15.18:0/62404005 shutdown_connections 2024-09-19T09:19:27.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.708+0000 7faa139f6640 1 -- 172.21.15.18:0/62404005 >> 172.21.15.18:0/62404005 conn(0x7faa0c0b4700 msgr2=0x7faa0c0b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:27.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.708+0000 7faa139f6640 1 -- 172.21.15.18:0/62404005 shutdown_connections 2024-09-19T09:19:27.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.708+0000 7faa139f6640 1 -- 172.21.15.18:0/62404005 wait complete. 2024-09-19T09:19:27.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.709+0000 7faa139f6640 1 Processor -- start 2024-09-19T09:19:27.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.709+0000 7faa139f6640 1 -- start start 2024-09-19T09:19:27.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.710+0000 7faa139f6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9f8003f60 0x7faa0c161250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:27.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.710+0000 7faa139f6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa0c0c8d80 0x7faa0c161790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:27.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.710+0000 7faa139f6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa0c14b900 0x7faa0c14bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:27.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.710+0000 7faa139f6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c0d0120 con 0x7faa0c14b900 2024-09-19T09:19:27.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.710+0000 7faa139f6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faa0c15f360 con 0x7faa0c0c8d80 2024-09-19T09:19:27.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.710+0000 7faa139f6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faa0c0b5220 con 0x7fa9f8003f60 2024-09-19T09:19:27.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.710+0000 7faa11f93640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa0c14b900 0x7faa0c14bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:27.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.710+0000 7faa11f93640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa0c14b900 0x7faa0c14bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54016/0 (socket says 172.21.15.18:54016) 2024-09-19T09:19:27.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.710+0000 7faa11f93640 1 -- 172.21.15.18:0/1467738532 learned_addr learned my addr 172.21.15.18:0/1467738532 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:27.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.710+0000 7faa11792640 1 --2- 172.21.15.18:0/1467738532 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9f8003f60 0x7faa0c161250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:27.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.710+0000 7faa10f91640 1 --2- 172.21.15.18:0/1467738532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa0c0c8d80 0x7faa0c161790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:27.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.710+0000 7faa11f93640 1 -- 172.21.15.18:0/1467738532 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9f8003f60 msgr2=0x7faa0c161250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:27.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.710+0000 7faa11f93640 1 --2- 172.21.15.18:0/1467738532 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9f8003f60 0x7faa0c161250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:27.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.710+0000 7faa11f93640 1 -- 172.21.15.18:0/1467738532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa0c0c8d80 msgr2=0x7faa0c161790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:27.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.710+0000 7faa11f93640 1 --2- 172.21.15.18:0/1467738532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa0c0c8d80 0x7faa0c161790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:27.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.710+0000 7faa11f93640 1 -- 172.21.15.18:0/1467738532 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa0c0c69b0 con 0x7faa0c14b900 2024-09-19T09:19:27.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.710+0000 7faa11f93640 1 --2- 172.21.15.18:0/1467738532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa0c14b900 0x7faa0c14bdb0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7faa0c072600 tx=0x7faa0400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:27.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.710+0000 7faa01ffb640 1 -- 172.21.15.18:0/1467738532 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0400ec10 con 0x7faa0c14b900 2024-09-19T09:19:27.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.710+0000 7faa01ffb640 1 -- 172.21.15.18:0/1467738532 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa04018070 con 0x7faa0c14b900 2024-09-19T09:19:27.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.710+0000 7faa139f6640 1 -- 172.21.15.18:0/1467738532 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa0c0cb410 con 0x7faa0c14b900 2024-09-19T09:19:27.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.711+0000 7faa01ffb640 1 -- 172.21.15.18:0/1467738532 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa04013420 con 0x7faa0c14b900 2024-09-19T09:19:27.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.711+0000 7faa139f6640 1 -- 172.21.15.18:0/1467738532 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa0c0cb6b0 con 0x7faa0c14b900 2024-09-19T09:19:27.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.712+0000 7faa139f6640 1 -- 172.21.15.18:0/1467738532 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa0c0b5550 con 0x7faa0c14b900 2024-09-19T09:19:27.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.712+0000 7faa01ffb640 1 -- 172.21.15.18:0/1467738532 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7faa040135c0 con 0x7faa0c14b900 2024-09-19T09:19:27.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.713+0000 7faa01ffb640 1 --2- 172.21.15.18:0/1467738532 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa9f006c2e0 0x7fa9f006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:27.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.713+0000 7faa01ffb640 1 -- 172.21.15.18:0/1467738532 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 4943+0+0 (secure 0 0 0) 0x7faa0408b440 con 0x7faa0c14b900 2024-09-19T09:19:27.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.713+0000 7faa11792640 1 --2- 172.21.15.18:0/1467738532 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa9f006c2e0 0x7fa9f006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:27.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.713+0000 7faa11792640 1 --2- 172.21.15.18:0/1467738532 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa9f006c2e0 0x7fa9f006e7a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0b4100 tx=0x7faa08008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:27.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.717+0000 7faa01ffb640 1 -- 172.21.15.18:0/1467738532 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7faa0c0c69b0 con 0x7faa0c14b900 2024-09-19T09:19:27.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:27.964+0000 7faa139f6640 1 -- 172.21.15.18:0/1467738532 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) -- 0x7faa0c0cff00 con 0x7faa0c14b900 2024-09-19T09:19:28.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.274+0000 7faa01ffb640 1 -- 172.21.15.18:0/1467738532 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v311) ==== 128+0+0 (secure 0 0 0) 0x7faa04059800 con 0x7faa0c14b900 2024-09-19T09:19:28.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.277+0000 7faa139f6640 1 -- 172.21.15.18:0/1467738532 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa9f006c2e0 msgr2=0x7fa9f006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:28.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.277+0000 7faa139f6640 1 --2- 172.21.15.18:0/1467738532 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa9f006c2e0 0x7fa9f006e7a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7faa0c0b4100 tx=0x7faa08008040 comp rx=0 tx=0).stop 2024-09-19T09:19:28.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.277+0000 7faa139f6640 1 -- 172.21.15.18:0/1467738532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa0c14b900 msgr2=0x7faa0c14bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:28.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.277+0000 7faa139f6640 1 --2- 172.21.15.18:0/1467738532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa0c14b900 0x7faa0c14bdb0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7faa0c072600 tx=0x7faa0400e530 comp rx=0 tx=0).stop 2024-09-19T09:19:28.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.277+0000 7faa139f6640 1 -- 172.21.15.18:0/1467738532 shutdown_connections 2024-09-19T09:19:28.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.277+0000 7faa139f6640 1 --2- 172.21.15.18:0/1467738532 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa9f006c2e0 0x7fa9f006e7a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.277+0000 7faa139f6640 1 --2- 172.21.15.18:0/1467738532 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa0c14b900 0x7faa0c14bdb0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.277+0000 7faa139f6640 1 --2- 172.21.15.18:0/1467738532 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa0c0c8d80 0x7faa0c161790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.277+0000 7faa139f6640 1 --2- 172.21.15.18:0/1467738532 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa9f8003f60 0x7faa0c161250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.277+0000 7faa139f6640 1 -- 172.21.15.18:0/1467738532 >> 172.21.15.18:0/1467738532 conn(0x7faa0c0b4700 msgr2=0x7faa0c070100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:28.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.277+0000 7faa139f6640 1 -- 172.21.15.18:0/1467738532 shutdown_connections 2024-09-19T09:19:28.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.277+0000 7faa139f6640 1 -- 172.21.15.18:0/1467738532 wait complete. 2024-09-19T09:19:28.289 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2024-09-19T09:19:28.290 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) 2024-09-19T09:19:28.290 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:19:28.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.392+0000 7fb381e77640 1 Processor -- start 2024-09-19T09:19:28.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.393+0000 7fb381e77640 1 -- start start 2024-09-19T09:19:28.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.393+0000 7fb381e77640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb37c0d1ab0 0x7fb37c0b8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.393+0000 7fb381e77640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb37c0b7a90 con 0x7fb37c15ef50 2024-09-19T09:19:28.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.393+0000 7fb381e77640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb37c0d3740 con 0x7fb37c0d3240 2024-09-19T09:19:28.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.393+0000 7fb381e77640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb37c0d3a20 con 0x7fb37c0d1ab0 2024-09-19T09:19:28.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.393+0000 7fb37b7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb37c15ef50 0x7fb37c0d13a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34446/0 (socket says 172.21.15.18:34446) 2024-09-19T09:19:28.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.393+0000 7fb37b7fe640 1 -- 172.21.15.18:0/2146416381 learned_addr learned my addr 172.21.15.18:0/2146416381 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:28.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.394+0000 7fb37affd640 1 --2- 172.21.15.18:0/2146416381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb37c0d1ab0 0x7fb37c0b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:28.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.394+0000 7fb37a7fc640 1 -- 172.21.15.18:0/2146416381 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 982268206 0 0) 0x7fb37c0b7a90 con 0x7fb37c15ef50 2024-09-19T09:19:28.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.394+0000 7fb37a7fc640 1 -- 172.21.15.18:0/2146416381 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb364003520 con 0x7fb37c15ef50 2024-09-19T09:19:28.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.394+0000 7fb37a7fc640 1 -- 172.21.15.18:0/2146416381 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3277404232 0 0) 0x7fb364003520 con 0x7fb37c15ef50 2024-09-19T09:19:28.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.394+0000 7fb37a7fc640 1 -- 172.21.15.18:0/2146416381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb37c0d1ab0 msgr2=0x7fb37c0b8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:28.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.394+0000 7fb37a7fc640 1 --2- 172.21.15.18:0/2146416381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb37c0d1ab0 0x7fb37c0b8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.394+0000 7fb37a7fc640 1 -- 172.21.15.18:0/2146416381 >> v1:172.21.15.162:6789/0 conn(0x7fb37c0d3240 legacy=0x7fb37c0b8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:28.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.394+0000 7fb37a7fc640 1 -- 172.21.15.18:0/2146416381 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb37c0b7d00 con 0x7fb37c15ef50 2024-09-19T09:19:28.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.394+0000 7fb37a7fc640 1 -- 172.21.15.18:0/2146416381 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fb36c001670 con 0x7fb37c15ef50 2024-09-19T09:19:28.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.394+0000 7fb37a7fc640 1 -- 172.21.15.18:0/2146416381 >> v1:172.21.15.18:6789/0 conn(0x7fb37c15ef50 legacy=0x7fb37c0d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:28.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.394+0000 7fb37a7fc640 1 --2- 172.21.15.18:0/2146416381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb37c0d1ab0 0x7fb3640039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.394+0000 7fb37a7fc640 1 --2- 172.21.15.18:0/2146416381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb364003f20 0x7fb364004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.394+0000 7fb37a7fc640 1 --2- 172.21.15.18:0/2146416381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb364004d40 0x7fb3640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.394+0000 7fb37a7fc640 1 -- 172.21.15.18:0/2146416381 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb37c0d3a20 con 0x7fb364004d40 2024-09-19T09:19:28.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.394+0000 7fb37a7fc640 1 -- 172.21.15.18:0/2146416381 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb36400bad0 con 0x7fb364003f20 2024-09-19T09:19:28.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.394+0000 7fb37a7fc640 1 -- 172.21.15.18:0/2146416381 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb36400bcd0 con 0x7fb37c0d1ab0 2024-09-19T09:19:28.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.394+0000 7fb37bfff640 1 --2- 172.21.15.18:0/2146416381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb364004d40 0x7fb3640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:28.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.394+0000 7fb37affd640 1 --2- 172.21.15.18:0/2146416381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb364003f20 0x7fb364004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:28.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.394+0000 7fb37b7fe640 1 --2- 172.21.15.18:0/2146416381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb37c0d1ab0 0x7fb3640039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:28.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.395+0000 7fb37bfff640 1 -- 172.21.15.18:0/2146416381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb37c0d1ab0 msgr2=0x7fb3640039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:28.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.395+0000 7fb37bfff640 1 --2- 172.21.15.18:0/2146416381 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb37c0d1ab0 0x7fb3640039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.395+0000 7fb37bfff640 1 -- 172.21.15.18:0/2146416381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb364003f20 msgr2=0x7fb364004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:28.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.395+0000 7fb37bfff640 1 --2- 172.21.15.18:0/2146416381 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb364003f20 0x7fb364004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.395+0000 7fb37bfff640 1 -- 172.21.15.18:0/2146416381 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb364003520 con 0x7fb364004d40 2024-09-19T09:19:28.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.395+0000 7fb37bfff640 1 --2- 172.21.15.18:0/2146416381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb364004d40 0x7fb3640051c0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fb374001fe0 tx=0x7fb364005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a4dba640101398 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:28.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.395+0000 7fb37a7fc640 1 -- 172.21.15.18:0/2146416381 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb374036070 con 0x7fb364004d40 2024-09-19T09:19:28.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.395+0000 7fb37a7fc640 1 -- 172.21.15.18:0/2146416381 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb374031600 con 0x7fb364004d40 2024-09-19T09:19:28.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.395+0000 7fb37a7fc640 1 -- 172.21.15.18:0/2146416381 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb374001be0 con 0x7fb364004d40 2024-09-19T09:19:28.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.396+0000 7fb381e77640 1 -- 172.21.15.18:0/2146416381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb364004d40 msgr2=0x7fb3640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:28.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.396+0000 7fb381e77640 1 --2- 172.21.15.18:0/2146416381 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb364004d40 0x7fb3640051c0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fb374001fe0 tx=0x7fb364005830 comp rx=0 tx=0).stop 2024-09-19T09:19:28.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.396+0000 7fb37bfff640 1 -- 172.21.15.18:0/2146416381 reap_dead start 2024-09-19T09:19:28.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.396+0000 7fb381e77640 1 -- 172.21.15.18:0/2146416381 shutdown_connections 2024-09-19T09:19:28.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.396+0000 7fb381e77640 1 -- 172.21.15.18:0/2146416381 >> 172.21.15.18:0/2146416381 conn(0x7fb37c0d4c60 msgr2=0x7fb37c0d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:28.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.396+0000 7fb381e77640 1 -- 172.21.15.18:0/2146416381 shutdown_connections 2024-09-19T09:19:28.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.396+0000 7fb381e77640 1 -- 172.21.15.18:0/2146416381 wait complete. 2024-09-19T09:19:28.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.397+0000 7fb381e77640 1 Processor -- start 2024-09-19T09:19:28.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.398+0000 7fb381e77640 1 -- start start 2024-09-19T09:19:28.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.398+0000 7fb381e77640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb364004d40 0x7fb37c151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.398+0000 7fb381e77640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb37c1522e0 0x7fb37c159040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.398+0000 7fb381e77640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb37c0cd550 0x7fb37c0cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.398+0000 7fb381e77640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb37c0d21a0 con 0x7fb37c1522e0 2024-09-19T09:19:28.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.398+0000 7fb381e77640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb37c0d2020 con 0x7fb37c0cd550 2024-09-19T09:19:28.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.398+0000 7fb381e77640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb37c0d5780 con 0x7fb364004d40 2024-09-19T09:19:28.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.398+0000 7fb37affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb37c1522e0 0x7fb37c159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:28.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.398+0000 7fb37affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb37c1522e0 0x7fb37c159040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54026/0 (socket says 172.21.15.18:54026) 2024-09-19T09:19:28.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.398+0000 7fb37affd640 1 -- 172.21.15.18:0/3857143418 learned_addr learned my addr 172.21.15.18:0/3857143418 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:28.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.398+0000 7fb37b7fe640 1 --2- 172.21.15.18:0/3857143418 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb364004d40 0x7fb37c151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:28.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.399+0000 7fb37bfff640 1 --2- 172.21.15.18:0/3857143418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb37c0cd550 0x7fb37c0cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:28.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.399+0000 7fb37affd640 1 -- 172.21.15.18:0/3857143418 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb364004d40 msgr2=0x7fb37c151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:28.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.399+0000 7fb37affd640 1 --2- 172.21.15.18:0/3857143418 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb364004d40 0x7fb37c151c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.399+0000 7fb37affd640 1 -- 172.21.15.18:0/3857143418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb37c0cd550 msgr2=0x7fb37c0cd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:28.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.399+0000 7fb37affd640 1 --2- 172.21.15.18:0/3857143418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb37c0cd550 0x7fb37c0cd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.399+0000 7fb37affd640 1 -- 172.21.15.18:0/3857143418 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb37c159940 con 0x7fb37c1522e0 2024-09-19T09:19:28.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.399+0000 7fb37bfff640 1 --2- 172.21.15.18:0/3857143418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb37c0cd550 0x7fb37c0cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:28.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.399+0000 7fb37affd640 1 --2- 172.21.15.18:0/3857143418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb37c1522e0 0x7fb37c159040 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fb3700119d0 tx=0x7fb370011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:28.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.399+0000 7fb363fff640 1 -- 172.21.15.18:0/3857143418 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb37000fa90 con 0x7fb37c1522e0 2024-09-19T09:19:28.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.399+0000 7fb363fff640 1 -- 172.21.15.18:0/3857143418 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb37000fc30 con 0x7fb37c1522e0 2024-09-19T09:19:28.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.399+0000 7fb381e77640 1 -- 172.21.15.18:0/3857143418 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb37c0c9720 con 0x7fb37c1522e0 2024-09-19T09:19:28.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.399+0000 7fb363fff640 1 -- 172.21.15.18:0/3857143418 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb370014440 con 0x7fb37c1522e0 2024-09-19T09:19:28.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.399+0000 7fb381e77640 1 -- 172.21.15.18:0/3857143418 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb37c0c9ce0 con 0x7fb37c1522e0 2024-09-19T09:19:28.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.400+0000 7fb381e77640 1 -- 172.21.15.18:0/3857143418 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb37c0d13a0 con 0x7fb37c1522e0 2024-09-19T09:19:28.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.401+0000 7fb363fff640 1 -- 172.21.15.18:0/3857143418 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb370012040 con 0x7fb37c1522e0 2024-09-19T09:19:28.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.401+0000 7fb363fff640 1 --2- 172.21.15.18:0/3857143418 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb36806c2e0 0x7fb36806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.401+0000 7fb363fff640 1 -- 172.21.15.18:0/3857143418 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 4943+0+0 (secure 0 0 0) 0x7fb37008b630 con 0x7fb37c1522e0 2024-09-19T09:19:28.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.401+0000 7fb37b7fe640 1 --2- 172.21.15.18:0/3857143418 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb36806c2e0 0x7fb36806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:28.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.402+0000 7fb37b7fe640 1 --2- 172.21.15.18:0/3857143418 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb36806c2e0 0x7fb36806e7a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb36c0010e0 tx=0x7fb36c001bb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:28.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.405+0000 7fb363fff640 1 -- 172.21.15.18:0/3857143418 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb370019030 con 0x7fb37c1522e0 2024-09-19T09:19:28.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.584+0000 7fb381e77640 1 -- 172.21.15.18:0/3857143418 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb37c06c840 con 0x7fb37c1522e0 2024-09-19T09:19:28.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.585+0000 7fb363fff640 1 -- 172.21.15.18:0/3857143418 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) ==== 74+0+13055 (secure 0 0 0) 0x7fb37005a130 con 0x7fb37c1522e0 2024-09-19T09:19:28.586 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:28.586 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":129,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:19:27.266936+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":121,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6835/2870064683":"2024-09-20T09:19:24.111259+0000","172.21.15.18:6834/2870064683":"2024-09-20T09:19:24.111259+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:19:28.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.587+0000 7fb381e77640 1 -- 172.21.15.18:0/3857143418 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb36806c2e0 msgr2=0x7fb36806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:28.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.587+0000 7fb381e77640 1 --2- 172.21.15.18:0/3857143418 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb36806c2e0 0x7fb36806e7a0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb36c0010e0 tx=0x7fb36c001bb0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.587+0000 7fb381e77640 1 -- 172.21.15.18:0/3857143418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb37c1522e0 msgr2=0x7fb37c159040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:28.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.587+0000 7fb381e77640 1 --2- 172.21.15.18:0/3857143418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb37c1522e0 0x7fb37c159040 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fb3700119d0 tx=0x7fb370011e90 comp rx=0 tx=0).stop 2024-09-19T09:19:28.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.587+0000 7fb381e77640 1 -- 172.21.15.18:0/3857143418 shutdown_connections 2024-09-19T09:19:28.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.587+0000 7fb381e77640 1 --2- 172.21.15.18:0/3857143418 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb36806c2e0 0x7fb36806e7a0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.587+0000 7fb381e77640 1 --2- 172.21.15.18:0/3857143418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb37c0cd550 0x7fb37c0cd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.587+0000 7fb381e77640 1 --2- 172.21.15.18:0/3857143418 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb37c1522e0 0x7fb37c159040 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.587+0000 7fb381e77640 1 --2- 172.21.15.18:0/3857143418 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb364004d40 0x7fb37c151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.587+0000 7fb381e77640 1 -- 172.21.15.18:0/3857143418 >> 172.21.15.18:0/3857143418 conn(0x7fb37c0d4c60 msgr2=0x7fb37c0cf770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:28.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.588+0000 7fb381e77640 1 -- 172.21.15.18:0/3857143418 shutdown_connections 2024-09-19T09:19:28.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.588+0000 7fb381e77640 1 -- 172.21.15.18:0/3857143418 wait complete. 2024-09-19T09:19:28.600 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T09:13:17.564717+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T09:19:28.600 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T09:19:28.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.705+0000 7f59a22a5640 1 Processor -- start 2024-09-19T09:19:28.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.705+0000 7f59a22a5640 1 -- start start 2024-09-19T09:19:28.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.706+0000 7f59a22a5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f599c06e280 0x7f599c073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.706+0000 7f59a22a5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f599c071df0 0x7f599c06e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.706+0000 7f59a22a5640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f599c06eba0 con 0x7f599c0d1010 2024-09-19T09:19:28.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.706+0000 7f59a22a5640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f599c0738b0 con 0x7f599c071df0 2024-09-19T09:19:28.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.706+0000 7f59a22a5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f599c0722d0 con 0x7f599c06e280 2024-09-19T09:19:28.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.706+0000 7f599bfff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f599c06e280 0x7f599c073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:28.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.706+0000 7f599b7fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f599c071df0 0x7f599c06e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:28.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.706+0000 7f59a0842640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f599c0d1010 0x7f599c0ce3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:55754/0 (socket says 172.21.15.18:55754) 2024-09-19T09:19:28.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.706+0000 7f599b7fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f599c071df0 0x7f599c06e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:58312/0 (socket says 172.21.15.18:58312) 2024-09-19T09:19:28.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.706+0000 7f599bfff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f599c06e280 0x7f599c073370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:34940/0 (socket says 172.21.15.18:34940) 2024-09-19T09:19:28.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.706+0000 7f59a0842640 1 -- 172.21.15.18:0/1956910073 learned_addr learned my addr 172.21.15.18:0/1956910073 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:28.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.707+0000 7f599b7fe640 1 -- 172.21.15.18:0/1956910073 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f599c06e280 msgr2=0x7f599c073370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:28.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.707+0000 7f599b7fe640 1 --2- 172.21.15.18:0/1956910073 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f599c06e280 0x7f599c073370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.707+0000 7f599b7fe640 1 -- 172.21.15.18:0/1956910073 >> v1:172.21.15.162:6789/0 conn(0x7f599c0d1010 legacy=0x7f599c0ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:28.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.707+0000 7f599b7fe640 1 -- 172.21.15.18:0/1956910073 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f599c0725b0 con 0x7f599c071df0 2024-09-19T09:19:28.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.707+0000 7f599bfff640 1 --2- 172.21.15.18:0/1956910073 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f599c06e280 0x7f599c073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:28.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.708+0000 7f599b7fe640 1 --2- 172.21.15.18:0/1956910073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f599c071df0 0x7f599c06e660 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f59900097a0 tx=0x7f599002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e0335d4517bba8d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:28.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.708+0000 7f599affd640 1 -- 172.21.15.18:0/1956910073 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5990037070 con 0x7f599c071df0 2024-09-19T09:19:28.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.708+0000 7f599affd640 1 -- 172.21.15.18:0/1956910073 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5990032440 con 0x7f599c071df0 2024-09-19T09:19:28.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.708+0000 7f599affd640 1 -- 172.21.15.18:0/1956910073 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5990032810 con 0x7f599c071df0 2024-09-19T09:19:28.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.708+0000 7f59a22a5640 1 -- 172.21.15.18:0/1956910073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f599c071df0 msgr2=0x7f599c06e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:28.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.708+0000 7f59a22a5640 1 --2- 172.21.15.18:0/1956910073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f599c071df0 0x7f599c06e660 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f59900097a0 tx=0x7f599002a180 comp rx=0 tx=0).stop 2024-09-19T09:19:28.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.708+0000 7f59a22a5640 1 -- 172.21.15.18:0/1956910073 shutdown_connections 2024-09-19T09:19:28.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.708+0000 7f59a22a5640 1 --2- 172.21.15.18:0/1956910073 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f599c071df0 0x7f599c06e660 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.708+0000 7f59a22a5640 1 --2- 172.21.15.18:0/1956910073 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f599c06e280 0x7f599c073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.708+0000 7f59a22a5640 1 -- 172.21.15.18:0/1956910073 >> 172.21.15.18:0/1956910073 conn(0x7f599c06bc10 msgr2=0x7f599c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:28.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.708+0000 7f59a22a5640 1 -- 172.21.15.18:0/1956910073 shutdown_connections 2024-09-19T09:19:28.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.708+0000 7f59a22a5640 1 -- 172.21.15.18:0/1956910073 wait complete. 2024-09-19T09:19:28.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.710+0000 7f59a22a5640 1 Processor -- start 2024-09-19T09:19:28.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.710+0000 7f59a22a5640 1 -- start start 2024-09-19T09:19:28.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.710+0000 7f59a22a5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f599c06e280 0x7f599c0cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.710+0000 7f59a22a5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f599c071df0 0x7f599c0cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.710+0000 7f59a22a5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f599c0d1010 0x7f599c0cd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.710+0000 7f59a22a5640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f599c072e50 con 0x7f599c0d1010 2024-09-19T09:19:28.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.710+0000 7f59a22a5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f599c072b70 con 0x7f599c06e280 2024-09-19T09:19:28.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.710+0000 7f59a22a5640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f599c15db60 con 0x7f599c071df0 2024-09-19T09:19:28.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.711+0000 7f59a0842640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f599c0d1010 0x7f599c0cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:28.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.711+0000 7f59a0842640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f599c0d1010 0x7f599c0cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54038/0 (socket says 172.21.15.18:54038) 2024-09-19T09:19:28.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.711+0000 7f59a0842640 1 -- 172.21.15.18:0/3612580878 learned_addr learned my addr 172.21.15.18:0/3612580878 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:28.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.711+0000 7f599b7fe640 1 --2- 172.21.15.18:0/3612580878 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f599c071df0 0x7f599c0cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:28.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.711+0000 7f599bfff640 1 --2- 172.21.15.18:0/3612580878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f599c06e280 0x7f599c0cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:28.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.711+0000 7f59a0842640 1 -- 172.21.15.18:0/3612580878 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f599c071df0 msgr2=0x7f599c0cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:28.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.711+0000 7f59a0842640 1 --2- 172.21.15.18:0/3612580878 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f599c071df0 0x7f599c0cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.711+0000 7f59a0842640 1 -- 172.21.15.18:0/3612580878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f599c06e280 msgr2=0x7f599c0cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:28.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.711+0000 7f59a0842640 1 --2- 172.21.15.18:0/3612580878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f599c06e280 0x7f599c0cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.711+0000 7f59a0842640 1 -- 172.21.15.18:0/3612580878 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f599c0cc830 con 0x7f599c0d1010 2024-09-19T09:19:28.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.711+0000 7f59a0842640 1 --2- 172.21.15.18:0/3612580878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f599c0d1010 0x7f599c0cd770 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f599400ca80 tx=0x7f599400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:28.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.711+0000 7f5998ff9640 1 -- 172.21.15.18:0/3612580878 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5994017070 con 0x7f599c0d1010 2024-09-19T09:19:28.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.711+0000 7f5998ff9640 1 -- 172.21.15.18:0/3612580878 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f599400ac30 con 0x7f599c0d1010 2024-09-19T09:19:28.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.711+0000 7f59a22a5640 1 -- 172.21.15.18:0/3612580878 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f599c1f2f10 con 0x7f599c0d1010 2024-09-19T09:19:28.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.711+0000 7f5998ff9640 1 -- 172.21.15.18:0/3612580878 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5994012600 con 0x7f599c0d1010 2024-09-19T09:19:28.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.711+0000 7f59a22a5640 1 -- 172.21.15.18:0/3612580878 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f599c1f37f0 con 0x7f599c0d1010 2024-09-19T09:19:28.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.713+0000 7f59a22a5640 1 -- 172.21.15.18:0/3612580878 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f599c0d14c0 con 0x7f599c0d1010 2024-09-19T09:19:28.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.713+0000 7f5998ff9640 1 -- 172.21.15.18:0/3612580878 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f599401a070 con 0x7f599c0d1010 2024-09-19T09:19:28.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.713+0000 7f5998ff9640 1 --2- 172.21.15.18:0/3612580878 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f598806c2b0 0x7f598806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:28.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.714+0000 7f5998ff9640 1 -- 172.21.15.18:0/3612580878 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 4943+0+0 (secure 0 0 0) 0x7f599408ad00 con 0x7f599c0d1010 2024-09-19T09:19:28.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.714+0000 7f599bfff640 1 --2- 172.21.15.18:0/3612580878 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f598806c2b0 0x7f598806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:28.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.714+0000 7f599bfff640 1 --2- 172.21.15.18:0/3612580878 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f598806c2b0 0x7f598806e770 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f598c009560 tx=0x7f598c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:28.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.718+0000 7f5998ff9640 1 -- 172.21.15.18:0/3612580878 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f599400ae20 con 0x7f599c0d1010 2024-09-19T09:19:28.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.893+0000 7f59a22a5640 1 -- 172.21.15.18:0/3612580878 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f599c0b2030 con 0x7f599c0d1010 2024-09-19T09:19:28.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.894+0000 7f5998ff9640 1 -- 172.21.15.18:0/3612580878 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v129) ==== 93+0+10 (secure 0 0 0) 0x7f5994059120 con 0x7f599c0d1010 2024-09-19T09:19:28.894 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-09-19T09:19:28.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.896+0000 7f59a22a5640 1 -- 172.21.15.18:0/3612580878 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f598806c2b0 msgr2=0x7f598806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:28.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.896+0000 7f59a22a5640 1 --2- 172.21.15.18:0/3612580878 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f598806c2b0 0x7f598806e770 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f598c009560 tx=0x7f598c009190 comp rx=0 tx=0).stop 2024-09-19T09:19:28.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.896+0000 7f59a22a5640 1 -- 172.21.15.18:0/3612580878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f599c0d1010 msgr2=0x7f599c0cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:28.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.896+0000 7f59a22a5640 1 --2- 172.21.15.18:0/3612580878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f599c0d1010 0x7f599c0cd770 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f599400ca80 tx=0x7f599400cf40 comp rx=0 tx=0).stop 2024-09-19T09:19:28.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.896+0000 7f59a22a5640 1 -- 172.21.15.18:0/3612580878 shutdown_connections 2024-09-19T09:19:28.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.896+0000 7f59a22a5640 1 --2- 172.21.15.18:0/3612580878 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f598806c2b0 0x7f598806e770 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.896+0000 7f59a22a5640 1 --2- 172.21.15.18:0/3612580878 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f599c0d1010 0x7f599c0cd770 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.896+0000 7f59a22a5640 1 --2- 172.21.15.18:0/3612580878 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f599c071df0 0x7f599c0cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.896+0000 7f59a22a5640 1 --2- 172.21.15.18:0/3612580878 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f599c06e280 0x7f599c0cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:28.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.896+0000 7f59a22a5640 1 -- 172.21.15.18:0/3612580878 >> 172.21.15.18:0/3612580878 conn(0x7f599c06bc10 msgr2=0x7f599c0cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:28.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.896+0000 7f59a22a5640 1 -- 172.21.15.18:0/3612580878 shutdown_connections 2024-09-19T09:19:28.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:28.896+0000 7f59a22a5640 1 -- 172.21.15.18:0/3612580878 wait complete. 2024-09-19T09:19:28.908 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2024-09-19T09:19:29.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.010+0000 7f0ac903c640 1 Processor -- start 2024-09-19T09:19:29.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.010+0000 7f0ac903c640 1 -- start start 2024-09-19T09:19:29.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.011+0000 7f0ac903c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0ac40cf560 0x7f0ac40cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:29.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.011+0000 7f0ac903c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0ac40cfe80 0x7f0ac40b2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:29.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.011+0000 7f0ac903c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ac40b3210 0x7f0ac40b3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:29.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.011+0000 7f0ac903c640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f0ac40d0e10 con 0x7f0ac40cfe80 2024-09-19T09:19:29.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.011+0000 7f0ac903c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f0ac40d0310 con 0x7f0ac40cf560 2024-09-19T09:19:29.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.011+0000 7f0ac903c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0ac40d0850 con 0x7f0ac40b3210 2024-09-19T09:19:29.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.011+0000 7f0abbfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0ac40cfe80 0x7f0ac40b2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:29.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.011+0000 7f0abbfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0ac40cfe80 0x7f0ac40b2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54048/0 (socket says 172.21.15.18:54048) 2024-09-19T09:19:29.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.011+0000 7f0abbfff640 1 -- 172.21.15.18:0/352338436 learned_addr learned my addr 172.21.15.18:0/352338436 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:29.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.011+0000 7f0ac2d9d640 1 --2- 172.21.15.18:0/352338436 >> v2:172.21.15.162:3300/0 conn(0x7f0ac40cf560 0x7f0ac40cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:29.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.011+0000 7f0ac359e640 1 --2- 172.21.15.18:0/352338436 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ac40b3210 0x7f0ac40b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:29.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.011+0000 7f0abbfff640 1 -- 172.21.15.18:0/352338436 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ac40b3210 msgr2=0x7f0ac40b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:29.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.011+0000 7f0abbfff640 1 --2- 172.21.15.18:0/352338436 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ac40b3210 0x7f0ac40b3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.011+0000 7f0abbfff640 1 -- 172.21.15.18:0/352338436 >> v2:172.21.15.162:3300/0 conn(0x7f0ac40cf560 msgr2=0x7f0ac40cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:29.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.011+0000 7f0abbfff640 1 --2- 172.21.15.18:0/352338436 >> v2:172.21.15.162:3300/0 conn(0x7f0ac40cf560 0x7f0ac40cf940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.011+0000 7f0abbfff640 1 -- 172.21.15.18:0/352338436 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ac40d0b30 con 0x7f0ac40cfe80 2024-09-19T09:19:29.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.011+0000 7f0ac2d9d640 1 --2- 172.21.15.18:0/352338436 >> v2:172.21.15.162:3300/0 conn(0x7f0ac40cf560 0x7f0ac40cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:29.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.012+0000 7f0abbfff640 1 --2- 172.21.15.18:0/352338436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ac40cfe80 0x7f0ac40b2cd0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4073b90 tx=0x7f0aac02a0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e180e4ee247e68a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:29.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.012+0000 7f0ac259c640 1 -- 172.21.15.18:0/352338436 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac037070 con 0x7f0ac40cfe80 2024-09-19T09:19:29.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.012+0000 7f0ac259c640 1 -- 172.21.15.18:0/352338436 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0aac02ae00 con 0x7f0ac40cfe80 2024-09-19T09:19:29.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.012+0000 7f0ac259c640 1 -- 172.21.15.18:0/352338436 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac032660 con 0x7f0ac40cfe80 2024-09-19T09:19:29.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.013+0000 7f0ac903c640 1 -- 172.21.15.18:0/352338436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ac40cfe80 msgr2=0x7f0ac40b2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:29.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.013+0000 7f0ac903c640 1 --2- 172.21.15.18:0/352338436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ac40cfe80 0x7f0ac40b2cd0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4073b90 tx=0x7f0aac02a0b0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.013+0000 7f0ac903c640 1 -- 172.21.15.18:0/352338436 shutdown_connections 2024-09-19T09:19:29.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.013+0000 7f0ac903c640 1 --2- 172.21.15.18:0/352338436 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ac40b3210 0x7f0ac40b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.013+0000 7f0ac903c640 1 --2- 172.21.15.18:0/352338436 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ac40cfe80 0x7f0ac40b2cd0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.013+0000 7f0ac903c640 1 --2- 172.21.15.18:0/352338436 >> v2:172.21.15.162:3300/0 conn(0x7f0ac40cf560 0x7f0ac40cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.013+0000 7f0ac903c640 1 -- 172.21.15.18:0/352338436 >> 172.21.15.18:0/352338436 conn(0x7f0ac40b4700 msgr2=0x7f0ac40b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:29.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.013+0000 7f0ac903c640 1 -- 172.21.15.18:0/352338436 shutdown_connections 2024-09-19T09:19:29.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.013+0000 7f0ac903c640 1 -- 172.21.15.18:0/352338436 wait complete. 2024-09-19T09:19:29.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.014+0000 7f0ac903c640 1 Processor -- start 2024-09-19T09:19:29.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.014+0000 7f0ac903c640 1 -- start start 2024-09-19T09:19:29.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.015+0000 7f0ac903c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ac40b3210 0x7f0ac40c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:29.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.015+0000 7f0ac903c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ac40cf560 0x7f0ac415b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:29.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.015+0000 7f0ac903c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ac40cfe80 0x7f0ac40b7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:29.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.015+0000 7f0ac903c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac40b5420 con 0x7f0ac40cfe80 2024-09-19T09:19:29.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.015+0000 7f0ac903c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac40b27b0 con 0x7f0ac40cf560 2024-09-19T09:19:29.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.015+0000 7f0ac903c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0ac40b55a0 con 0x7f0ac40b3210 2024-09-19T09:19:29.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.015+0000 7f0ac359e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ac40cfe80 0x7f0ac40b7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:29.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.015+0000 7f0ac359e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ac40cfe80 0x7f0ac40b7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54050/0 (socket says 172.21.15.18:54050) 2024-09-19T09:19:29.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.015+0000 7f0ac359e640 1 -- 172.21.15.18:0/1979640972 learned_addr learned my addr 172.21.15.18:0/1979640972 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:29.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.016+0000 7f0ac359e640 1 -- 172.21.15.18:0/1979640972 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ac40b3210 msgr2=0x7f0ac40c8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:29.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.016+0000 7f0ac2d9d640 1 --2- 172.21.15.18:0/1979640972 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ac40b3210 0x7f0ac40c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:29.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.016+0000 7f0abbfff640 1 --2- 172.21.15.18:0/1979640972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ac40cf560 0x7f0ac415b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:29.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.016+0000 7f0ac359e640 1 --2- 172.21.15.18:0/1979640972 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ac40b3210 0x7f0ac40c8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.016+0000 7f0ac359e640 1 -- 172.21.15.18:0/1979640972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ac40cf560 msgr2=0x7f0ac415b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:29.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.016+0000 7f0ac359e640 1 --2- 172.21.15.18:0/1979640972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ac40cf560 0x7f0ac415b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.016+0000 7f0ac359e640 1 -- 172.21.15.18:0/1979640972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ac40ce490 con 0x7f0ac40cfe80 2024-09-19T09:19:29.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.016+0000 7f0ac359e640 1 --2- 172.21.15.18:0/1979640972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ac40cfe80 0x7f0ac40b7bd0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f0abc007e60 tx=0x7f0abc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:29.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.016+0000 7f0abb7fe640 1 -- 172.21.15.18:0/1979640972 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0abc014420 con 0x7f0ac40cfe80 2024-09-19T09:19:29.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.016+0000 7f0abb7fe640 1 -- 172.21.15.18:0/1979640972 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0abc019070 con 0x7f0ac40cfe80 2024-09-19T09:19:29.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.016+0000 7f0abb7fe640 1 -- 172.21.15.18:0/1979640972 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0abc014820 con 0x7f0ac40cfe80 2024-09-19T09:19:29.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.016+0000 7f0ac903c640 1 -- 172.21.15.18:0/1979640972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ac40ce770 con 0x7f0ac40cfe80 2024-09-19T09:19:29.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.016+0000 7f0ac903c640 1 -- 172.21.15.18:0/1979640972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ac40ced30 con 0x7f0ac40cfe80 2024-09-19T09:19:29.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.017+0000 7f0ac903c640 1 -- 172.21.15.18:0/1979640972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ac40cef70 con 0x7f0ac40cfe80 2024-09-19T09:19:29.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.017+0000 7f0abb7fe640 1 -- 172.21.15.18:0/1979640972 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0abc0149c0 con 0x7f0ac40cfe80 2024-09-19T09:19:29.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.018+0000 7f0abb7fe640 1 --2- 172.21.15.18:0/1979640972 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0aa406c2b0 0x7f0aa406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:29.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.018+0000 7f0abb7fe640 1 -- 172.21.15.18:0/1979640972 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 4943+0+0 (secure 0 0 0) 0x7f0abc08b9e0 con 0x7f0ac40cfe80 2024-09-19T09:19:29.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.018+0000 7f0ac2d9d640 1 --2- 172.21.15.18:0/1979640972 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0aa406c2b0 0x7f0aa406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:29.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.019+0000 7f0ac2d9d640 1 --2- 172.21.15.18:0/1979640972 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0aa406c2b0 0x7f0aa406e770 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4006fd0 tx=0x7f0ab4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:29.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.022+0000 7f0abb7fe640 1 -- 172.21.15.18:0/1979640972 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0ac40cef70 con 0x7f0ac40cfe80 2024-09-19T09:19:29.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.268+0000 7f0ac903c640 1 -- 172.21.15.18:0/1979640972 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) -- 0x7f0ac415d090 con 0x7f0ac40cfe80 2024-09-19T09:19:29.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.275+0000 7f0abb7fe640 1 -- 172.21.15.18:0/1979640972 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v312) ==== 143+0+0 (secure 0 0 0) 0x7f0abc05a3c0 con 0x7f0ac40cfe80 2024-09-19T09:19:29.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.277+0000 7f0ac903c640 1 -- 172.21.15.18:0/1979640972 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0aa406c2b0 msgr2=0x7f0aa406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:29.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.277+0000 7f0ac903c640 1 --2- 172.21.15.18:0/1979640972 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0aa406c2b0 0x7f0aa406e770 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4006fd0 tx=0x7f0ab4008040 comp rx=0 tx=0).stop 2024-09-19T09:19:29.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.277+0000 7f0ac903c640 1 -- 172.21.15.18:0/1979640972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ac40cfe80 msgr2=0x7f0ac40b7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:29.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.277+0000 7f0ac903c640 1 --2- 172.21.15.18:0/1979640972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ac40cfe80 0x7f0ac40b7bd0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f0abc007e60 tx=0x7f0abc00e4b0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.277+0000 7f0ac903c640 1 -- 172.21.15.18:0/1979640972 shutdown_connections 2024-09-19T09:19:29.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.277+0000 7f0ac903c640 1 --2- 172.21.15.18:0/1979640972 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0aa406c2b0 0x7f0aa406e770 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.277+0000 7f0ac903c640 1 --2- 172.21.15.18:0/1979640972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0ac40cfe80 0x7f0ac40b7bd0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.277+0000 7f0ac903c640 1 --2- 172.21.15.18:0/1979640972 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0ac40cf560 0x7f0ac415b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.277+0000 7f0ac903c640 1 --2- 172.21.15.18:0/1979640972 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0ac40b3210 0x7f0ac40c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.277+0000 7f0ac903c640 1 -- 172.21.15.18:0/1979640972 >> 172.21.15.18:0/1979640972 conn(0x7f0ac40b4700 msgr2=0x7f0ac40cd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:29.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.277+0000 7f0ac903c640 1 -- 172.21.15.18:0/1979640972 shutdown_connections 2024-09-19T09:19:29.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.277+0000 7f0ac903c640 1 -- 172.21.15.18:0/1979640972 wait complete. 2024-09-19T09:19:29.288 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-19T09:19:29.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.393+0000 7fac9232c640 1 Processor -- start 2024-09-19T09:19:29.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.393+0000 7fac9232c640 1 -- start start 2024-09-19T09:19:29.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.394+0000 7fac9232c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fac8c0af8d0 0x7fac8c0afd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:29.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.394+0000 7fac9232c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac8c15fef0 con 0x7fac8c06f7e0 2024-09-19T09:19:29.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.394+0000 7fac9232c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac8c0b68d0 con 0x7fac8c0b73b0 2024-09-19T09:19:29.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.394+0000 7fac9232c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fac8c0b6f20 con 0x7fac8c0af8d0 2024-09-19T09:19:29.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.394+0000 7fac8bfff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fac8c06f7e0 0x7fac8c06fbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34450/0 (socket says 172.21.15.18:34450) 2024-09-19T09:19:29.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.394+0000 7fac8bfff640 1 -- 172.21.15.18:0/2786099502 learned_addr learned my addr 172.21.15.18:0/2786099502 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:29.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.394+0000 7fac8affd640 1 -- 172.21.15.18:0/2786099502 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 879395510 0 0) 0x7fac8c15fef0 con 0x7fac8c06f7e0 2024-09-19T09:19:29.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.394+0000 7fac8affd640 1 -- 172.21.15.18:0/2786099502 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac74003520 con 0x7fac8c06f7e0 2024-09-19T09:19:29.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.394+0000 7fac8b7fe640 1 --2- 172.21.15.18:0/2786099502 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fac8c0af8d0 0x7fac8c0afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:29.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.395+0000 7fac8affd640 1 -- 172.21.15.18:0/2786099502 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 737700583 0 0) 0x7fac74003520 con 0x7fac8c06f7e0 2024-09-19T09:19:29.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.395+0000 7fac8affd640 1 -- 172.21.15.18:0/2786099502 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fac8c0af8d0 msgr2=0x7fac8c0afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:29.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.395+0000 7fac8affd640 1 --2- 172.21.15.18:0/2786099502 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fac8c0af8d0 0x7fac8c0afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.395+0000 7fac8affd640 1 -- 172.21.15.18:0/2786099502 >> v1:172.21.15.162:6789/0 conn(0x7fac8c0b73b0 legacy=0x7fac8c15f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:29.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.395+0000 7fac8affd640 1 -- 172.21.15.18:0/2786099502 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac8c0b6bb0 con 0x7fac8c06f7e0 2024-09-19T09:19:29.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.395+0000 7fac8affd640 1 -- 172.21.15.18:0/2786099502 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fac7c001670 con 0x7fac8c06f7e0 2024-09-19T09:19:29.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.395+0000 7fac8affd640 1 -- 172.21.15.18:0/2786099502 >> v1:172.21.15.18:6789/0 conn(0x7fac8c06f7e0 legacy=0x7fac8c06fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:29.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.395+0000 7fac8affd640 1 --2- 172.21.15.18:0/2786099502 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac740039e0 0x7fac74003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:29.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.395+0000 7fac8affd640 1 --2- 172.21.15.18:0/2786099502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac74004800 0x7fac74004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:29.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.395+0000 7fac8affd640 1 --2- 172.21.15.18:0/2786099502 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fac8c0af8d0 0x7fac740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:29.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.395+0000 7fac8affd640 1 -- 172.21.15.18:0/2786099502 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c0b6f20 con 0x7fac74004800 2024-09-19T09:19:29.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.395+0000 7fac8affd640 1 -- 172.21.15.18:0/2786099502 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fac7400ba70 con 0x7fac740039e0 2024-09-19T09:19:29.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.395+0000 7fac8affd640 1 -- 172.21.15.18:0/2786099502 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fac7400bc70 con 0x7fac8c0af8d0 2024-09-19T09:19:29.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.395+0000 7fac8b7fe640 1 --2- 172.21.15.18:0/2786099502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac74004800 0x7fac74004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:29.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.395+0000 7fac8bfff640 1 --2- 172.21.15.18:0/2786099502 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac740039e0 0x7fac74003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:29.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.395+0000 7fac908c9640 1 --2- 172.21.15.18:0/2786099502 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fac8c0af8d0 0x7fac740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:29.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.395+0000 7fac8b7fe640 1 -- 172.21.15.18:0/2786099502 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fac8c0af8d0 msgr2=0x7fac740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:29.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.395+0000 7fac8b7fe640 1 --2- 172.21.15.18:0/2786099502 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fac8c0af8d0 0x7fac740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.395+0000 7fac8b7fe640 1 -- 172.21.15.18:0/2786099502 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac740039e0 msgr2=0x7fac74003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:29.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.395+0000 7fac8b7fe640 1 --2- 172.21.15.18:0/2786099502 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac740039e0 0x7fac74003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.395+0000 7fac8b7fe640 1 -- 172.21.15.18:0/2786099502 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac74003520 con 0x7fac74004800 2024-09-19T09:19:29.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.395+0000 7fac8bfff640 1 --2- 172.21.15.18:0/2786099502 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac740039e0 0x7fac74003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:29.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.396+0000 7fac8b7fe640 1 --2- 172.21.15.18:0/2786099502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac74004800 0x7fac74004c80 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fac8c0719c0 tx=0x7fac74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd1944cb5785789b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:29.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.396+0000 7fac8affd640 1 -- 172.21.15.18:0/2786099502 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac80036070 con 0x7fac74004800 2024-09-19T09:19:29.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.396+0000 7fac8affd640 1 -- 172.21.15.18:0/2786099502 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac80031400 con 0x7fac74004800 2024-09-19T09:19:29.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.396+0000 7fac8affd640 1 -- 172.21.15.18:0/2786099502 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac80009690 con 0x7fac74004800 2024-09-19T09:19:29.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.396+0000 7fac9232c640 1 -- 172.21.15.18:0/2786099502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac74004800 msgr2=0x7fac74004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:29.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.396+0000 7fac9232c640 1 --2- 172.21.15.18:0/2786099502 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac74004800 0x7fac74004c80 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fac8c0719c0 tx=0x7fac74005830 comp rx=0 tx=0).stop 2024-09-19T09:19:29.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.396+0000 7fac908c9640 1 -- 172.21.15.18:0/2786099502 reap_dead start 2024-09-19T09:19:29.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.396+0000 7fac9232c640 1 -- 172.21.15.18:0/2786099502 shutdown_connections 2024-09-19T09:19:29.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.396+0000 7fac9232c640 1 -- 172.21.15.18:0/2786099502 >> 172.21.15.18:0/2786099502 conn(0x7fac8c073c80 msgr2=0x7fac8c09b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:29.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.396+0000 7fac9232c640 1 -- 172.21.15.18:0/2786099502 shutdown_connections 2024-09-19T09:19:29.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.396+0000 7fac9232c640 1 -- 172.21.15.18:0/2786099502 wait complete. 2024-09-19T09:19:29.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.398+0000 7fac9232c640 1 Processor -- start 2024-09-19T09:19:29.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.398+0000 7fac9232c640 1 -- start start 2024-09-19T09:19:29.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.399+0000 7fac9232c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac74004800 0x7fac8c157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:29.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.399+0000 7fac9232c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fac8c0cd000 0x7fac8c1f5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:29.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.399+0000 7fac9232c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac8c15b650 0x7fac8c06d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:29.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.399+0000 7fac9232c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c159620 con 0x7fac74004800 2024-09-19T09:19:29.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.399+0000 7fac9232c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fac8c1594a0 con 0x7fac8c15b650 2024-09-19T09:19:29.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.399+0000 7fac9232c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fac8c0afd30 con 0x7fac8c0cd000 2024-09-19T09:19:29.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.399+0000 7fac8bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac74004800 0x7fac8c157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:29.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.399+0000 7fac8bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac74004800 0x7fac8c157860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54064/0 (socket says 172.21.15.18:54064) 2024-09-19T09:19:29.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.399+0000 7fac8bfff640 1 -- 172.21.15.18:0/228899794 learned_addr learned my addr 172.21.15.18:0/228899794 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:29.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.399+0000 7fac8b7fe640 1 --2- 172.21.15.18:0/228899794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fac8c0cd000 0x7fac8c1f5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:29.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.399+0000 7fac908c9640 1 --2- 172.21.15.18:0/228899794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac8c15b650 0x7fac8c06d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:29.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.399+0000 7fac8bfff640 1 -- 172.21.15.18:0/228899794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fac8c0cd000 msgr2=0x7fac8c1f5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:29.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.399+0000 7fac8bfff640 1 --2- 172.21.15.18:0/228899794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fac8c0cd000 0x7fac8c1f5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.399+0000 7fac8bfff640 1 -- 172.21.15.18:0/228899794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac8c15b650 msgr2=0x7fac8c06d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:29.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.399+0000 7fac8bfff640 1 --2- 172.21.15.18:0/228899794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac8c15b650 0x7fac8c06d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.399+0000 7fac8bfff640 1 -- 172.21.15.18:0/228899794 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac8c0cd570 con 0x7fac74004800 2024-09-19T09:19:29.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.399+0000 7fac908c9640 1 --2- 172.21.15.18:0/228899794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac8c15b650 0x7fac8c06d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:29.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.399+0000 7fac8b7fe640 1 --2- 172.21.15.18:0/228899794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fac8c0cd000 0x7fac8c1f5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:29.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.399+0000 7fac8bfff640 1 --2- 172.21.15.18:0/228899794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac74004800 0x7fac8c157860 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fac7c00e8c0 tx=0x7fac7c00ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:29.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.399+0000 7fac88ff9640 1 -- 172.21.15.18:0/228899794 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c00c870 con 0x7fac74004800 2024-09-19T09:19:29.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.399+0000 7fac88ff9640 1 -- 172.21.15.18:0/228899794 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac7c018070 con 0x7fac74004800 2024-09-19T09:19:29.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.399+0000 7fac9232c640 1 -- 172.21.15.18:0/228899794 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac8c0cd850 con 0x7fac74004800 2024-09-19T09:19:29.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.399+0000 7fac88ff9640 1 -- 172.21.15.18:0/228899794 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7c00cc10 con 0x7fac74004800 2024-09-19T09:19:29.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.399+0000 7fac9232c640 1 -- 172.21.15.18:0/228899794 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac8c0cdb30 con 0x7fac74004800 2024-09-19T09:19:29.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.400+0000 7fac9232c640 1 -- 172.21.15.18:0/228899794 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac8c0b7860 con 0x7fac74004800 2024-09-19T09:19:29.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.401+0000 7fac88ff9640 1 -- 172.21.15.18:0/228899794 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fac7c01d460 con 0x7fac74004800 2024-09-19T09:19:29.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.401+0000 7fac88ff9640 1 --2- 172.21.15.18:0/228899794 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fac7806c2b0 0x7fac7806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:29.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.401+0000 7fac88ff9640 1 -- 172.21.15.18:0/228899794 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 4943+0+0 (secure 0 0 0) 0x7fac7c08afc0 con 0x7fac74004800 2024-09-19T09:19:29.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.402+0000 7fac8b7fe640 1 --2- 172.21.15.18:0/228899794 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fac7806c2b0 0x7fac7806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:29.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.402+0000 7fac8b7fe640 1 --2- 172.21.15.18:0/228899794 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fac7806c2b0 0x7fac7806e770 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fac80033000 tx=0x7fac80008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:29.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.406+0000 7fac88ff9640 1 -- 172.21.15.18:0/228899794 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fac7c059ac0 con 0x7fac74004800 2024-09-19T09:19:29.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.583+0000 7fac9232c640 1 -- 172.21.15.18:0/228899794 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fac8c0b7e60 con 0x7fac74004800 2024-09-19T09:19:29.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.586+0000 7fac88ff9640 1 -- 172.21.15.18:0/228899794 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7fac7c0593c0 con 0x7fac74004800 2024-09-19T09:19:29.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.588+0000 7fac9232c640 1 -- 172.21.15.18:0/228899794 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fac7806c2b0 msgr2=0x7fac7806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:29.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.588+0000 7fac9232c640 1 --2- 172.21.15.18:0/228899794 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fac7806c2b0 0x7fac7806e770 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fac80033000 tx=0x7fac80008030 comp rx=0 tx=0).stop 2024-09-19T09:19:29.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.588+0000 7fac9232c640 1 -- 172.21.15.18:0/228899794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac74004800 msgr2=0x7fac8c157860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:29.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.588+0000 7fac9232c640 1 --2- 172.21.15.18:0/228899794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac74004800 0x7fac8c157860 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fac7c00e8c0 tx=0x7fac7c00ed80 comp rx=0 tx=0).stop 2024-09-19T09:19:29.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.588+0000 7fac9232c640 1 -- 172.21.15.18:0/228899794 shutdown_connections 2024-09-19T09:19:29.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.588+0000 7fac9232c640 1 --2- 172.21.15.18:0/228899794 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fac7806c2b0 0x7fac7806e770 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.588+0000 7fac9232c640 1 --2- 172.21.15.18:0/228899794 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fac8c15b650 0x7fac8c06d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.588+0000 7fac9232c640 1 --2- 172.21.15.18:0/228899794 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fac8c0cd000 0x7fac8c1f5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.588+0000 7fac9232c640 1 --2- 172.21.15.18:0/228899794 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fac74004800 0x7fac8c157860 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.588+0000 7fac9232c640 1 -- 172.21.15.18:0/228899794 >> 172.21.15.18:0/228899794 conn(0x7fac8c073c80 msgr2=0x7fac8c09b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:29.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.588+0000 7fac9232c640 1 -- 172.21.15.18:0/228899794 shutdown_connections 2024-09-19T09:19:29.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.589+0000 7fac9232c640 1 -- 172.21.15.18:0/228899794 wait complete. 2024-09-19T09:19:29.600 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T09:19:29.601 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:19:29.648 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:19:29.692 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T09:19:29.693 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:19:29.693 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:19:29.709 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17075 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T09:19:29.709 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:19:29.709 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:19:29.751 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3252 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T09:19:29.751 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:19:29.751 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:19:29.767 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17075 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T09:19:29.768 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:19:29.768 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:19:29.809 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3252 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T09:19:29.809 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-19T09:19:29.810 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:19:29.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.912+0000 7f979db4b640 1 Processor -- start 2024-09-19T09:19:29.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.912+0000 7f979db4b640 1 -- start start 2024-09-19T09:19:29.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.912+0000 7f979db4b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f97980d1ab0 0x7f97980b8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:29.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.912+0000 7f979db4b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97980d3240 0x7f97980b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:29.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.912+0000 7f979db4b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97980b7a90 con 0x7f979815ef50 2024-09-19T09:19:29.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.912+0000 7f979db4b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f97980d3740 con 0x7f97980d1ab0 2024-09-19T09:19:29.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.912+0000 7f979db4b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f97980d3a20 con 0x7f97980d3240 2024-09-19T09:19:29.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.913+0000 7f9796ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f97980d1ab0 0x7f97980b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:29.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.913+0000 7f97977fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f979815ef50 0x7f97980d13a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34460/0 (socket says 172.21.15.18:34460) 2024-09-19T09:19:29.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.913+0000 7f97977fe640 1 -- 172.21.15.18:0/1115994680 learned_addr learned my addr 172.21.15.18:0/1115994680 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:29.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.913+0000 7f9796ffd640 1 -- 172.21.15.18:0/1115994680 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97980d3240 msgr2=0x7f97980b8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:29.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.913+0000 7f9797fff640 1 --2- 172.21.15.18:0/1115994680 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97980d3240 0x7f97980b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:29.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.913+0000 7f9796ffd640 1 --2- 172.21.15.18:0/1115994680 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97980d3240 0x7f97980b8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.913+0000 7f9796ffd640 1 -- 172.21.15.18:0/1115994680 >> v1:172.21.15.18:6789/0 conn(0x7f979815ef50 legacy=0x7f97980d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:29.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.913+0000 7f97967fc640 1 -- 172.21.15.18:0/1115994680 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 170680056 0 0) 0x7f97980b7a90 con 0x7f979815ef50 2024-09-19T09:19:29.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.913+0000 7f9796ffd640 1 -- 172.21.15.18:0/1115994680 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97980b7d00 con 0x7f97980d1ab0 2024-09-19T09:19:29.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.913+0000 7f9797fff640 1 --2- 172.21.15.18:0/1115994680 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97980d3240 0x7f97980b8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:29.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.914+0000 7f9796ffd640 1 --2- 172.21.15.18:0/1115994680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97980d1ab0 0x7f97980b8500 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f978c0097a0 tx=0x7f978c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa245d64ea6ae42 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:29.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.914+0000 7f97967fc640 1 -- 172.21.15.18:0/1115994680 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c037070 con 0x7f97980d1ab0 2024-09-19T09:19:29.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.914+0000 7f97967fc640 1 -- 172.21.15.18:0/1115994680 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f978c02ae50 con 0x7f97980d1ab0 2024-09-19T09:19:29.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.914+0000 7f97967fc640 1 -- 172.21.15.18:0/1115994680 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f978c032660 con 0x7f97980d1ab0 2024-09-19T09:19:29.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.914+0000 7f979db4b640 1 -- 172.21.15.18:0/1115994680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97980d1ab0 msgr2=0x7f97980b8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:29.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.914+0000 7f979db4b640 1 --2- 172.21.15.18:0/1115994680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97980d1ab0 0x7f97980b8500 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f978c0097a0 tx=0x7f978c02a100 comp rx=0 tx=0).stop 2024-09-19T09:19:29.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.914+0000 7f979db4b640 1 -- 172.21.15.18:0/1115994680 shutdown_connections 2024-09-19T09:19:29.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.914+0000 7f979db4b640 1 --2- 172.21.15.18:0/1115994680 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97980d3240 0x7f97980b8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.914+0000 7f979db4b640 1 --2- 172.21.15.18:0/1115994680 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f97980d1ab0 0x7f97980b8500 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.914+0000 7f979db4b640 1 -- 172.21.15.18:0/1115994680 >> 172.21.15.18:0/1115994680 conn(0x7f97980d4c60 msgr2=0x7f97980d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:29.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.914+0000 7f979db4b640 1 -- 172.21.15.18:0/1115994680 shutdown_connections 2024-09-19T09:19:29.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.915+0000 7f979db4b640 1 -- 172.21.15.18:0/1115994680 wait complete. 2024-09-19T09:19:29.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.916+0000 7f979db4b640 1 Processor -- start 2024-09-19T09:19:29.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.916+0000 7f979db4b640 1 -- start start 2024-09-19T09:19:29.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.917+0000 7f979db4b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97980d1ab0 0x7f9798154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:29.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.917+0000 7f979db4b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97980d3240 0x7f97980cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:29.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.917+0000 7f979db4b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f979815ef50 0x7f9798160c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:29.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.917+0000 7f979db4b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f97980d21a0 con 0x7f979815ef50 2024-09-19T09:19:29.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.917+0000 7f979db4b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f97980d2020 con 0x7f97980d1ab0 2024-09-19T09:19:29.920 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.917+0000 7f979db4b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f97980d5780 con 0x7f97980d3240 2024-09-19T09:19:29.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.917+0000 7f9797fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f979815ef50 0x7f9798160c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:29.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.917+0000 7f9797fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f979815ef50 0x7f9798160c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:54078/0 (socket says 172.21.15.18:54078) 2024-09-19T09:19:29.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.917+0000 7f9797fff640 1 -- 172.21.15.18:0/415086648 learned_addr learned my addr 172.21.15.18:0/415086648 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:29.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.917+0000 7f9796ffd640 1 --2- 172.21.15.18:0/415086648 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97980d3240 0x7f97980cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:29.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.917+0000 7f97977fe640 1 --2- 172.21.15.18:0/415086648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97980d1ab0 0x7f9798154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:29.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.917+0000 7f9797fff640 1 -- 172.21.15.18:0/415086648 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97980d3240 msgr2=0x7f97980cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:29.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.917+0000 7f9797fff640 1 --2- 172.21.15.18:0/415086648 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97980d3240 0x7f97980cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.917+0000 7f9797fff640 1 -- 172.21.15.18:0/415086648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97980d1ab0 msgr2=0x7f9798154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:29.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.917+0000 7f9797fff640 1 --2- 172.21.15.18:0/415086648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97980d1ab0 0x7f9798154fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:29.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.917+0000 7f9797fff640 1 -- 172.21.15.18:0/415086648 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9798161440 con 0x7f979815ef50 2024-09-19T09:19:29.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.917+0000 7f9796ffd640 1 --2- 172.21.15.18:0/415086648 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97980d3240 0x7f97980cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:29.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.917+0000 7f97977fe640 1 --2- 172.21.15.18:0/415086648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97980d1ab0 0x7f9798154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:29.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.917+0000 7f9797fff640 1 --2- 172.21.15.18:0/415086648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f979815ef50 0x7f9798160c10 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f979000ce80 tx=0x7f979000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:29.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.917+0000 7f977ffff640 1 -- 172.21.15.18:0/415086648 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979001a070 con 0x7f979815ef50 2024-09-19T09:19:29.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.917+0000 7f977ffff640 1 -- 172.21.15.18:0/415086648 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f979000d880 con 0x7f979815ef50 2024-09-19T09:19:29.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.917+0000 7f979db4b640 1 -- 172.21.15.18:0/415086648 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9798161720 con 0x7f979815ef50 2024-09-19T09:19:29.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.917+0000 7f977ffff640 1 -- 172.21.15.18:0/415086648 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979000dc70 con 0x7f979815ef50 2024-09-19T09:19:29.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.917+0000 7f979db4b640 1 -- 172.21.15.18:0/415086648 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9798161ce0 con 0x7f979815ef50 2024-09-19T09:19:29.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.918+0000 7f979db4b640 1 -- 172.21.15.18:0/415086648 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97980d13a0 con 0x7f979815ef50 2024-09-19T09:19:29.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.919+0000 7f977ffff640 1 -- 172.21.15.18:0/415086648 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f979001d070 con 0x7f979815ef50 2024-09-19T09:19:29.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.919+0000 7f977ffff640 1 --2- 172.21.15.18:0/415086648 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f978406c2b0 0x7f978406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:29.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.919+0000 7f977ffff640 1 -- 172.21.15.18:0/415086648 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 4943+0+0 (secure 0 0 0) 0x7f979008b880 con 0x7f979815ef50 2024-09-19T09:19:29.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.920+0000 7f97977fe640 1 --2- 172.21.15.18:0/415086648 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f978406c2b0 0x7f978406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:29.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.920+0000 7f97977fe640 1 --2- 172.21.15.18:0/415086648 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f978406c2b0 0x7f978406e770 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9788000f60 tx=0x7f9788009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:29.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:29.924+0000 7f977ffff640 1 -- 172.21.15.18:0/415086648 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9790059c90 con 0x7f979815ef50 2024-09-19T09:19:30.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:30.137+0000 7f979db4b640 1 -- 172.21.15.18:0/415086648 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97980d29b0 con 0x7f979815ef50 2024-09-19T09:19:30.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:30.138+0000 7f977ffff640 1 -- 172.21.15.18:0/415086648 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+3911 (secure 0 0 0) 0x7f979005df90 con 0x7f979815ef50 2024-09-19T09:19:30.139 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:30.139 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":50,"btime":"2024-09-19T09:19:25:112842+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5642,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/4210829543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":4210829543},{"type":"v1","addr":"172.21.15.162:6837","nonce":4210829543}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/3090247017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":3090247017},{"type":"v1","addr":"172.21.15.162:6836","nonce":3090247017}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6546,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/62488842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":62488842},{"type":"v1","addr":"172.21.15.18:6833","nonce":62488842}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":45},{"gid":6795,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1924068029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1924068029},{"type":"v1","addr":"172.21.15.18:6835","nonce":1924068029}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[]} 2024-09-19T09:19:30.139 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 50 2024-09-19T09:19:30.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:30.140+0000 7f979db4b640 1 -- 172.21.15.18:0/415086648 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f978406c2b0 msgr2=0x7f978406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:30.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:30.140+0000 7f979db4b640 1 --2- 172.21.15.18:0/415086648 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f978406c2b0 0x7f978406e770 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9788000f60 tx=0x7f9788009040 comp rx=0 tx=0).stop 2024-09-19T09:19:30.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:30.140+0000 7f979db4b640 1 -- 172.21.15.18:0/415086648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f979815ef50 msgr2=0x7f9798160c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:30.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:30.140+0000 7f979db4b640 1 --2- 172.21.15.18:0/415086648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f979815ef50 0x7f9798160c10 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f979000ce80 tx=0x7f979000a710 comp rx=0 tx=0).stop 2024-09-19T09:19:30.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:30.140+0000 7f979db4b640 1 -- 172.21.15.18:0/415086648 shutdown_connections 2024-09-19T09:19:30.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:30.140+0000 7f979db4b640 1 --2- 172.21.15.18:0/415086648 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f978406c2b0 0x7f978406e770 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:30.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:30.140+0000 7f979db4b640 1 --2- 172.21.15.18:0/415086648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f979815ef50 0x7f9798160c10 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:30.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:30.140+0000 7f979db4b640 1 --2- 172.21.15.18:0/415086648 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f97980d3240 0x7f97980cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:30.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:30.140+0000 7f979db4b640 1 --2- 172.21.15.18:0/415086648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97980d1ab0 0x7f9798154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:30.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:30.140+0000 7f979db4b640 1 -- 172.21.15.18:0/415086648 >> 172.21.15.18:0/415086648 conn(0x7f97980d4c60 msgr2=0x7f97980b98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:30.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:30.140+0000 7f979db4b640 1 -- 172.21.15.18:0/415086648 shutdown_connections 2024-09-19T09:19:30.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:30.140+0000 7f979db4b640 1 -- 172.21.15.18:0/415086648 wait complete. 2024-09-19T09:19:30.152 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T09:19:30.152 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-19T09:19:30.152 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T09:19:30.153 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:19:30.153 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T09:19:30.153 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-19T09:19:30.153 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T09:19:30.153 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:19:30.153 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T09:19:30.153 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-19T09:19:30.154 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T09:19:30.154 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:19:30.154 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T09:19:30.154 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-19T09:19:30.154 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T09:19:30.154 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:19:30.162 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T09:19:30.162 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T09:19:30.163 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T09:19:30.163 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T09:19:30.166 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T09:19:30.166 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T09:19:30.205 INFO:tasks.ceph.mds.a:Started 2024-09-19T09:19:30.205 DEBUG:teuthology.parallel:result is None 2024-09-19T09:19:30.206 INFO:tasks.ceph.mds.c:Started 2024-09-19T09:19:30.206 DEBUG:teuthology.parallel:result is None 2024-09-19T09:19:30.209 INFO:tasks.ceph.mds.d:Started 2024-09-19T09:19:30.209 DEBUG:teuthology.parallel:result is None 2024-09-19T09:19:30.283 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-09-19T09:19:30.283 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2024-09-19T09:19:30.288 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-09-19T09:19:31.141 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:19:31.144 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:19:32.941 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-19T09:19:36.166 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T09:19:36.166 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T09:19:36.169 INFO:tasks.ceph.mds.b:Started 2024-09-19T09:19:36.169 DEBUG:teuthology.parallel:result is None 2024-09-19T09:19:36.170 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-19T09:19:36.254 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-09-19T09:19:36.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.286+0000 7f7778674640 1 Processor -- start 2024-09-19T09:19:36.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.286+0000 7f7778674640 1 -- start start 2024-09-19T09:19:36.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.287+0000 7f7778674640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f777006f620 0x7f7770073850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:36.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.287+0000 7f7778674640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77701626a0 0x7f7770162b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:36.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.287+0000 7f7778674640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77700b6fa0 con 0x7f777015c720 2024-09-19T09:19:36.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.287+0000 7f7778674640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f7770160480 con 0x7f777006f620 2024-09-19T09:19:36.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.287+0000 7f7778674640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f777015fa50 con 0x7f77701626a0 2024-09-19T09:19:36.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.287+0000 7f7775c0f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f777006f620 0x7f7770073850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:36.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.287+0000 7f7776410640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f777015c720 0x7f7770073140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:55458/0 (socket says 172.21.15.18:55458) 2024-09-19T09:19:36.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.287+0000 7f7776410640 1 -- 172.21.15.18:0/2801269189 learned_addr learned my addr 172.21.15.18:0/2801269189 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:36.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.287+0000 7f7776c11640 1 --2- 172.21.15.18:0/2801269189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77701626a0 0x7f7770162b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:36.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.288+0000 7f7775c0f640 1 -- 172.21.15.18:0/2801269189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77701626a0 msgr2=0x7f7770162b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:36.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.288+0000 7f7775c0f640 1 --2- 172.21.15.18:0/2801269189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77701626a0 0x7f7770162b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:36.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.288+0000 7f777540e640 1 -- 172.21.15.18:0/2801269189 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1651310012 0 0) 0x7f7760001110 con 0x7f777015c720 2024-09-19T09:19:36.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.288+0000 7f7775c0f640 1 -- 172.21.15.18:0/2801269189 >> v1:172.21.15.162:6789/0 conn(0x7f777015c720 legacy=0x7f7770073140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:36.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.288+0000 7f7775c0f640 1 -- 172.21.15.18:0/2801269189 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f777006fa40 con 0x7f777006f620 2024-09-19T09:19:36.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.289+0000 7f7775c0f640 1 --2- 172.21.15.18:0/2801269189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f777006f620 0x7f7770073850 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f77640097a0 tx=0x7f776402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e665b77ca658b95 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:36.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.289+0000 7f777540e640 1 -- 172.21.15.18:0/2801269189 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7764037070 con 0x7f777006f620 2024-09-19T09:19:36.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.289+0000 7f777540e640 1 -- 172.21.15.18:0/2801269189 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7764032440 con 0x7f777006f620 2024-09-19T09:19:36.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.289+0000 7f777540e640 1 -- 172.21.15.18:0/2801269189 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7764032810 con 0x7f777006f620 2024-09-19T09:19:36.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.289+0000 7f7778674640 1 -- 172.21.15.18:0/2801269189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f777006f620 msgr2=0x7f7770073850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:36.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.289+0000 7f7778674640 1 --2- 172.21.15.18:0/2801269189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f777006f620 0x7f7770073850 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f77640097a0 tx=0x7f776402a210 comp rx=0 tx=0).stop 2024-09-19T09:19:36.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.289+0000 7f7778674640 1 -- 172.21.15.18:0/2801269189 shutdown_connections 2024-09-19T09:19:36.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.289+0000 7f7778674640 1 --2- 172.21.15.18:0/2801269189 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77701626a0 0x7f7770162b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:36.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.289+0000 7f7778674640 1 --2- 172.21.15.18:0/2801269189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f777006f620 0x7f7770073850 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:36.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.289+0000 7f7778674640 1 -- 172.21.15.18:0/2801269189 >> 172.21.15.18:0/2801269189 conn(0x7f77700b5eb0 msgr2=0x7f77700b6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:36.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.290+0000 7f7778674640 1 -- 172.21.15.18:0/2801269189 shutdown_connections 2024-09-19T09:19:36.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.290+0000 7f7778674640 1 -- 172.21.15.18:0/2801269189 wait complete. 2024-09-19T09:19:36.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.291+0000 7f7778674640 1 Processor -- start 2024-09-19T09:19:36.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.291+0000 7f7778674640 1 -- start start 2024-09-19T09:19:36.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.292+0000 7f7778674640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f777006f620 0x7f7770151440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:36.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.292+0000 7f7778674640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f777015c720 0x7f7770154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:36.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.292+0000 7f7778674640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77701626a0 0x7f7770155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:36.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.292+0000 7f7778674640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f777015f6e0 con 0x7f777006f620 2024-09-19T09:19:36.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.292+0000 7f7778674640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f777015f400 con 0x7f77701626a0 2024-09-19T09:19:36.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.292+0000 7f7778674640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f777015f0b0 con 0x7f777015c720 2024-09-19T09:19:36.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.292+0000 7f7776410640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f777006f620 0x7f7770151440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:36.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.292+0000 7f7776410640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f777006f620 0x7f7770151440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38128/0 (socket says 172.21.15.18:38128) 2024-09-19T09:19:36.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.292+0000 7f7776410640 1 -- 172.21.15.18:0/2917124128 learned_addr learned my addr 172.21.15.18:0/2917124128 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:36.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.292+0000 7f7775c0f640 1 --2- 172.21.15.18:0/2917124128 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f777015c720 0x7f7770154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:36.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.292+0000 7f7776c11640 1 --2- 172.21.15.18:0/2917124128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77701626a0 0x7f7770155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:36.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.292+0000 7f7776410640 1 -- 172.21.15.18:0/2917124128 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f777015c720 msgr2=0x7f7770154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:36.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.292+0000 7f7776410640 1 --2- 172.21.15.18:0/2917124128 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f777015c720 0x7f7770154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:36.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.292+0000 7f7776410640 1 -- 172.21.15.18:0/2917124128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77701626a0 msgr2=0x7f7770155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:36.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.292+0000 7f7776410640 1 --2- 172.21.15.18:0/2917124128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77701626a0 0x7f7770155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:36.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.292+0000 7f7776410640 1 -- 172.21.15.18:0/2917124128 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7770151980 con 0x7f777006f620 2024-09-19T09:19:36.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.292+0000 7f7776410640 1 --2- 172.21.15.18:0/2917124128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f777006f620 0x7f7770151440 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f776000c780 tx=0x7f776000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:36.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.294+0000 7f776effd640 1 -- 172.21.15.18:0/2917124128 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7760017070 con 0x7f777006f620 2024-09-19T09:19:36.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.294+0000 7f776effd640 1 -- 172.21.15.18:0/2917124128 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7760005ab0 con 0x7f777006f620 2024-09-19T09:19:36.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.294+0000 7f776effd640 1 -- 172.21.15.18:0/2917124128 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7760007070 con 0x7f777006f620 2024-09-19T09:19:36.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.294+0000 7f7778674640 1 -- 172.21.15.18:0/2917124128 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7770156c50 con 0x7f777006f620 2024-09-19T09:19:36.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.294+0000 7f7778674640 1 -- 172.21.15.18:0/2917124128 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7770157210 con 0x7f777006f620 2024-09-19T09:19:36.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.295+0000 7f7778674640 1 -- 172.21.15.18:0/2917124128 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7770072960 con 0x7f777006f620 2024-09-19T09:19:36.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.296+0000 7f776effd640 1 -- 172.21.15.18:0/2917124128 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f776001a070 con 0x7f777006f620 2024-09-19T09:19:36.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.296+0000 7f776effd640 1 --2- 172.21.15.18:0/2917124128 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f775c06c2b0 0x7f775c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:36.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.296+0000 7f776effd640 1 -- 172.21.15.18:0/2917124128 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(133..133 src has 1..133) ==== 4943+0+0 (secure 0 0 0) 0x7f776008a460 con 0x7f777006f620 2024-09-19T09:19:36.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.296+0000 7f7775c0f640 1 --2- 172.21.15.18:0/2917124128 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f775c06c2b0 0x7f775c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:36.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.297+0000 7f7775c0f640 1 --2- 172.21.15.18:0/2917124128 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f775c06c2b0 0x7f775c06e770 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7764034000 tx=0x7f776402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:36.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.301+0000 7f776effd640 1 -- 172.21.15.18:0/2917124128 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f77700b6fa0 con 0x7f777006f620 2024-09-19T09:19:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:36.488+0000 7f7778674640 1 -- 172.21.15.18:0/2917124128 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f777015fec0 con 0x7f777006f620 2024-09-19T09:19:37.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.302+0000 7f776effd640 1 -- 172.21.15.18:0/2917124128 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v134) ==== 97+0+0 (secure 0 0 0) 0x7f7760058880 con 0x7f777006f620 2024-09-19T09:19:37.303 INFO:teuthology.orchestra.run.smithi018.stderr: removed all blocklist entries 2024-09-19T09:19:37.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.305+0000 7f7778674640 1 -- 172.21.15.18:0/2917124128 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f775c06c2b0 msgr2=0x7f775c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:37.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.305+0000 7f7778674640 1 --2- 172.21.15.18:0/2917124128 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f775c06c2b0 0x7f775c06e770 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7764034000 tx=0x7f776402e000 comp rx=0 tx=0).stop 2024-09-19T09:19:37.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.305+0000 7f7778674640 1 -- 172.21.15.18:0/2917124128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f777006f620 msgr2=0x7f7770151440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:37.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.305+0000 7f7778674640 1 --2- 172.21.15.18:0/2917124128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f777006f620 0x7f7770151440 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f776000c780 tx=0x7f776000cc40 comp rx=0 tx=0).stop 2024-09-19T09:19:37.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.305+0000 7f7778674640 1 -- 172.21.15.18:0/2917124128 shutdown_connections 2024-09-19T09:19:37.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.305+0000 7f7778674640 1 --2- 172.21.15.18:0/2917124128 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f775c06c2b0 0x7f775c06e770 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.305+0000 7f7778674640 1 --2- 172.21.15.18:0/2917124128 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77701626a0 0x7f7770155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.305+0000 7f7778674640 1 --2- 172.21.15.18:0/2917124128 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f777015c720 0x7f7770154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.305+0000 7f7778674640 1 --2- 172.21.15.18:0/2917124128 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f777006f620 0x7f7770151440 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.305+0000 7f7778674640 1 -- 172.21.15.18:0/2917124128 >> 172.21.15.18:0/2917124128 conn(0x7f77700b5eb0 msgr2=0x7f7770162b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:37.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.305+0000 7f7778674640 1 -- 172.21.15.18:0/2917124128 shutdown_connections 2024-09-19T09:19:37.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.305+0000 7f7778674640 1 -- 172.21.15.18:0/2917124128 wait complete. 2024-09-19T09:19:37.320 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-19T09:19:37.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.428+0000 7fe2292a6640 1 Processor -- start 2024-09-19T09:19:37.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.428+0000 7fe2292a6640 1 -- start start 2024-09-19T09:19:37.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.429+0000 7fe2292a6640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe22415ef80 0x7fe2240b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:37.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.429+0000 7fe2292a6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe2240cfae0 0x7fe2240cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:37.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.429+0000 7fe2292a6640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2240cd1a0 con 0x7fe22406d730 2024-09-19T09:19:37.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.429+0000 7fe2292a6640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fe2240cd7d0 con 0x7fe2240cfae0 2024-09-19T09:19:37.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.429+0000 7fe2292a6640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe22406dc30 con 0x7fe22415ef80 2024-09-19T09:19:37.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.429+0000 7fe2237fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe2240cfae0 0x7fe2240cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:37.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.429+0000 7fe2227fc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe22406d730 0x7fe2240cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:41162/0 (socket says 172.21.15.18:41162) 2024-09-19T09:19:37.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.429+0000 7fe2227fc640 1 -- 172.21.15.18:0/4074721281 learned_addr learned my addr 172.21.15.18:0/4074721281 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:37.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.429+0000 7fe222ffd640 1 --2- 172.21.15.18:0/4074721281 >> v2:172.21.15.162:3300/0 conn(0x7fe22415ef80 0x7fe2240b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:37.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.429+0000 7fe2237fe640 1 -- 172.21.15.18:0/4074721281 >> v2:172.21.15.162:3300/0 conn(0x7fe22415ef80 msgr2=0x7fe2240b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:37.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.429+0000 7fe2237fe640 1 --2- 172.21.15.18:0/4074721281 >> v2:172.21.15.162:3300/0 conn(0x7fe22415ef80 0x7fe2240b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.429+0000 7fe2237fe640 1 -- 172.21.15.18:0/4074721281 >> v1:172.21.15.18:6789/0 conn(0x7fe22406d730 legacy=0x7fe2240cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:37.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.429+0000 7fe2237fe640 1 -- 172.21.15.18:0/4074721281 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe22406df10 con 0x7fe2240cfae0 2024-09-19T09:19:37.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.429+0000 7fe221ffb640 1 -- 172.21.15.18:0/4074721281 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2285716669 0 0) 0x7fe2240cd1a0 con 0x7fe22406d730 2024-09-19T09:19:37.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.430+0000 7fe2237fe640 1 --2- 172.21.15.18:0/4074721281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2240cfae0 0x7fe2240cdc60 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fe22406f6e0 tx=0x7fe21c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee8b9540e1bd2e9d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:37.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.430+0000 7fe221ffb640 1 -- 172.21.15.18:0/4074721281 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c007740 con 0x7fe2240cfae0 2024-09-19T09:19:37.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.430+0000 7fe221ffb640 1 -- 172.21.15.18:0/4074721281 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe21c0078e0 con 0x7fe2240cfae0 2024-09-19T09:19:37.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.430+0000 7fe221ffb640 1 -- 172.21.15.18:0/4074721281 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c007cb0 con 0x7fe2240cfae0 2024-09-19T09:19:37.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.431+0000 7fe2292a6640 1 -- 172.21.15.18:0/4074721281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2240cfae0 msgr2=0x7fe2240cdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:37.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.431+0000 7fe2292a6640 1 --2- 172.21.15.18:0/4074721281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2240cfae0 0x7fe2240cdc60 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fe22406f6e0 tx=0x7fe21c02a680 comp rx=0 tx=0).stop 2024-09-19T09:19:37.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.431+0000 7fe2292a6640 1 -- 172.21.15.18:0/4074721281 shutdown_connections 2024-09-19T09:19:37.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.431+0000 7fe2292a6640 1 --2- 172.21.15.18:0/4074721281 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2240cfae0 0x7fe2240cdc60 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.431+0000 7fe2292a6640 1 --2- 172.21.15.18:0/4074721281 >> v2:172.21.15.162:3300/0 conn(0x7fe22415ef80 0x7fe2240b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.431+0000 7fe2292a6640 1 -- 172.21.15.18:0/4074721281 >> 172.21.15.18:0/4074721281 conn(0x7fe2240b4700 msgr2=0x7fe2240b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:37.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.431+0000 7fe2292a6640 1 -- 172.21.15.18:0/4074721281 shutdown_connections 2024-09-19T09:19:37.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.431+0000 7fe2292a6640 1 -- 172.21.15.18:0/4074721281 wait complete. 2024-09-19T09:19:37.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.432+0000 7fe2292a6640 1 Processor -- start 2024-09-19T09:19:37.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.432+0000 7fe2292a6640 1 -- start start 2024-09-19T09:19:37.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.433+0000 7fe2292a6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe22406d730 0x7fe224158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:37.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.433+0000 7fe2292a6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2240cfae0 0x7fe2240b8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:37.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.433+0000 7fe2292a6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe22415ef80 0x7fe224161a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:37.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.433+0000 7fe2292a6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe2240d0120 con 0x7fe22415ef80 2024-09-19T09:19:37.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.433+0000 7fe2292a6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe22415f360 con 0x7fe22406d730 2024-09-19T09:19:37.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.433+0000 7fe2292a6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe2240ce1a0 con 0x7fe2240cfae0 2024-09-19T09:19:37.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.433+0000 7fe2237fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe22415ef80 0x7fe224161a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:37.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.433+0000 7fe2237fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe22415ef80 0x7fe224161a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38148/0 (socket says 172.21.15.18:38148) 2024-09-19T09:19:37.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.433+0000 7fe2237fe640 1 -- 172.21.15.18:0/634105477 learned_addr learned my addr 172.21.15.18:0/634105477 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:37.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.433+0000 7fe2227fc640 1 --2- 172.21.15.18:0/634105477 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2240cfae0 0x7fe2240b8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:37.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.433+0000 7fe222ffd640 1 --2- 172.21.15.18:0/634105477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe22406d730 0x7fe224158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:37.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.433+0000 7fe2237fe640 1 -- 172.21.15.18:0/634105477 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2240cfae0 msgr2=0x7fe2240b8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:37.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.433+0000 7fe2237fe640 1 --2- 172.21.15.18:0/634105477 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2240cfae0 0x7fe2240b8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.433+0000 7fe2237fe640 1 -- 172.21.15.18:0/634105477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe22406d730 msgr2=0x7fe224158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:37.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.433+0000 7fe2237fe640 1 --2- 172.21.15.18:0/634105477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe22406d730 0x7fe224158b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.433+0000 7fe2237fe640 1 -- 172.21.15.18:0/634105477 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe224157cc0 con 0x7fe22415ef80 2024-09-19T09:19:37.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.433+0000 7fe222ffd640 1 --2- 172.21.15.18:0/634105477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe22406d730 0x7fe224158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:37.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.434+0000 7fe2237fe640 1 --2- 172.21.15.18:0/634105477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe22415ef80 0x7fe224161a10 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009e80 tx=0x7fe21c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:37.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.434+0000 7fe21b7fe640 1 -- 172.21.15.18:0/634105477 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c040070 con 0x7fe22415ef80 2024-09-19T09:19:37.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.434+0000 7fe21b7fe640 1 -- 172.21.15.18:0/634105477 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe21c031c40 con 0x7fe22415ef80 2024-09-19T09:19:37.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.434+0000 7fe2292a6640 1 -- 172.21.15.18:0/634105477 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2240b5a00 con 0x7fe22415ef80 2024-09-19T09:19:37.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.434+0000 7fe21b7fe640 1 -- 172.21.15.18:0/634105477 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c009450 con 0x7fe22415ef80 2024-09-19T09:19:37.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.434+0000 7fe2292a6640 1 -- 172.21.15.18:0/634105477 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2241fd5f0 con 0x7fe22415ef80 2024-09-19T09:19:37.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.435+0000 7fe2292a6640 1 -- 172.21.15.18:0/634105477 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2240cff00 con 0x7fe22415ef80 2024-09-19T09:19:37.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.435+0000 7fe21b7fe640 1 -- 172.21.15.18:0/634105477 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe21c039040 con 0x7fe22415ef80 2024-09-19T09:19:37.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.436+0000 7fe21b7fe640 1 --2- 172.21.15.18:0/634105477 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe20406c2b0 0x7fe20406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:37.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.436+0000 7fe21b7fe640 1 -- 172.21.15.18:0/634105477 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 4857+0+0 (secure 0 0 0) 0x7fe21c0ac250 con 0x7fe22415ef80 2024-09-19T09:19:37.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.436+0000 7fe222ffd640 1 --2- 172.21.15.18:0/634105477 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe20406c2b0 0x7fe20406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:37.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.437+0000 7fe222ffd640 1 --2- 172.21.15.18:0/634105477 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe20406c2b0 0x7fe20406e770 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe20c006fd0 tx=0x7fe20c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:37.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.440+0000 7fe21b7fe640 1 -- 172.21.15.18:0/634105477 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe21c07a750 con 0x7fe22415ef80 2024-09-19T09:19:37.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.680+0000 7fe2292a6640 1 -- 172.21.15.18:0/634105477 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fe2240cd1a0 con 0x7fe22415ef80 2024-09-19T09:19:37.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.680+0000 7fe21b7fe640 1 -- 172.21.15.18:0/634105477 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7fe21c07ea50 con 0x7fe22415ef80 2024-09-19T09:19:37.681 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:37.681 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:19:37.681 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_dump": [ 2024-09-19T09:19:37.681 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:37.681 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.a", 2024-09-19T09:19:37.681 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmDY7cHhAALxtxGq6eR3A2QXYp+nW0FA==", 2024-09-19T09:19:37.681 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:37.681 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:19:37.682 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:19:37.682 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:19:37.682 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:19:37.682 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:37.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:37.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:37.682 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.b", 2024-09-19T09:19:37.682 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tm9ILFKhAABEtgvzO5YBXqzYaeBZ0qZg==", 2024-09-19T09:19:37.682 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:37.682 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:19:37.682 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:19:37.682 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:19:37.682 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:19:37.682 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:37.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:37.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:37.683 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.c", 2024-09-19T09:19:37.683 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmwPkOJhAADt/0XVei2kl79pIw55wu1A==", 2024-09-19T09:19:37.683 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:37.683 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:19:37.683 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:19:37.683 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:19:37.683 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:19:37.683 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:37.683 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:37.683 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:37.683 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.d", 2024-09-19T09:19:37.683 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tm35XYMRAA/OSE5iv8M+TekEJVTARETw==", 2024-09-19T09:19:37.684 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:37.684 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:19:37.684 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:19:37.684 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:19:37.684 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:19:37.684 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:37.684 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:37.684 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:37.684 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.0", 2024-09-19T09:19:37.684 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmkUBiGhAATWtnqNPWyZJ+tnQcZOtT5A==", 2024-09-19T09:19:37.685 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:37.685 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:19:37.685 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:19:37.685 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:19:37.685 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:37.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:37.685 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:37.685 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.1", 2024-09-19T09:19:37.685 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmir5wIRAA9QumyCr8yLHtNj/YqQ1d0A==", 2024-09-19T09:19:37.685 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:37.685 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:19:37.686 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:19:37.686 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:19:37.686 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:37.686 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:37.686 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:37.686 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.2", 2024-09-19T09:19:37.686 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmfQJ6KBAAfTerKv1zCzFf6UfAVUikxA==", 2024-09-19T09:19:37.686 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:37.687 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:19:37.687 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:19:37.687 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:19:37.687 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:37.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:37.687 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:37.687 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.3", 2024-09-19T09:19:37.687 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmSeSOLxAACqCpiIQO4cDyjXUmoGPKAQ==", 2024-09-19T09:19:37.687 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:37.687 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:19:37.687 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:19:37.687 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:19:37.687 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:37.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:37.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:37.688 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.4", 2024-09-19T09:19:37.688 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmrsoFAhAArI7cRPVe/jrnSdmyE8jCsQ==", 2024-09-19T09:19:37.688 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:37.688 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:19:37.688 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:19:37.688 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:19:37.688 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:37.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:37.688 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:37.688 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.5", 2024-09-19T09:19:37.689 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmudM3CRAAXF3uI58SNJE6qtYX2wNQeQ==", 2024-09-19T09:19:37.689 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:37.689 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:19:37.689 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:19:37.689 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:19:37.689 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:37.690 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:37.690 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:37.690 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.6", 2024-09-19T09:19:37.690 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmqEQmEBAAm4h/8p91HwX84pl/U80Q9Q==", 2024-09-19T09:19:37.690 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:37.690 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:19:37.690 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:19:37.690 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:19:37.690 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:37.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:37.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:37.691 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.7", 2024-09-19T09:19:37.691 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmhDs0FxAAxZvRVkBoWqsdmyifRZzgwg==", 2024-09-19T09:19:37.691 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:37.691 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:19:37.691 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:19:37.691 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:19:37.691 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:37.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:37.691 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:37.691 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.0", 2024-09-19T09:19:37.691 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmcbwDNhAAaG0+wu96Locwws+h0zeh8Q==", 2024-09-19T09:19:37.691 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:37.692 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:19:37.692 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow r", 2024-09-19T09:19:37.692 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-19T09:19:37.692 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:37.692 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:37.692 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:37.692 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.1", 2024-09-19T09:19:37.692 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAf6+tmb4FeAxAAU+nZN/Vb33HrU0yfXmU9gA==", 2024-09-19T09:19:37.692 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:37.692 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:19:37.692 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-19T09:19:37.692 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-19T09:19:37.692 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-19T09:19:37.692 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:37.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:37.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:37.693 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.2", 2024-09-19T09:19:37.693 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAf6+tmc34kABAAC5b4Kkm2dJvxxyXva6PT2g==", 2024-09-19T09:19:37.693 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:37.693 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:19:37.693 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-19T09:19:37.693 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-19T09:19:37.693 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-19T09:19:37.693 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:37.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:37.693 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:37.693 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.3", 2024-09-19T09:19:37.693 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAf6+tmx4vzCBAAZ7ZrdGI2s8LqT0MjjzOCjw==", 2024-09-19T09:19:37.694 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:37.694 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:19:37.694 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-19T09:19:37.694 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-19T09:19:37.694 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-19T09:19:37.694 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:37.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:37.694 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:37.694 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.admin", 2024-09-19T09:19:37.694 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmZaWgAhAAx7MUazt6rS+wa/ZMSGC97Q==", 2024-09-19T09:19:37.694 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:37.694 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-19T09:19:37.694 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:19:37.694 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:19:37.695 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:19:37.695 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:37.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:37.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:37.695 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.x", 2024-09-19T09:19:37.695 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmwr6NGxAA3M5NZKkjc36L25teWJS7bQ==", 2024-09-19T09:19:37.695 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:37.695 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-19T09:19:37.695 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-09-19T09:19:37.695 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:19:37.695 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:37.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:37.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:37.695 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.y", 2024-09-19T09:19:37.696 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmBWOWFxAAEYKCroBhMcqoIe6WzXnNCg==", 2024-09-19T09:19:37.696 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:19:37.696 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-19T09:19:37.696 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-09-19T09:19:37.696 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:19:37.696 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:37.696 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:37.696 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:37.696 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:19:37.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.682+0000 7fe2292a6640 1 -- 172.21.15.18:0/634105477 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe20406c2b0 msgr2=0x7fe20406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:37.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.682+0000 7fe2292a6640 1 --2- 172.21.15.18:0/634105477 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe20406c2b0 0x7fe20406e770 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe20c006fd0 tx=0x7fe20c008040 comp rx=0 tx=0).stop 2024-09-19T09:19:37.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.682+0000 7fe2292a6640 1 -- 172.21.15.18:0/634105477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe22415ef80 msgr2=0x7fe224161a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:37.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.682+0000 7fe2292a6640 1 --2- 172.21.15.18:0/634105477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe22415ef80 0x7fe224161a10 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009e80 tx=0x7fe21c004a40 comp rx=0 tx=0).stop 2024-09-19T09:19:37.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.682+0000 7fe2292a6640 1 -- 172.21.15.18:0/634105477 shutdown_connections 2024-09-19T09:19:37.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.682+0000 7fe2292a6640 1 --2- 172.21.15.18:0/634105477 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe20406c2b0 0x7fe20406e770 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.682+0000 7fe2292a6640 1 --2- 172.21.15.18:0/634105477 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe22415ef80 0x7fe224161a10 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.682+0000 7fe2292a6640 1 --2- 172.21.15.18:0/634105477 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe2240cfae0 0x7fe2240b8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.682+0000 7fe2292a6640 1 --2- 172.21.15.18:0/634105477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe22406d730 0x7fe224158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.682+0000 7fe2292a6640 1 -- 172.21.15.18:0/634105477 >> 172.21.15.18:0/634105477 conn(0x7fe2240b4700 msgr2=0x7fe224070f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:37.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.682+0000 7fe2292a6640 1 -- 172.21.15.18:0/634105477 shutdown_connections 2024-09-19T09:19:37.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.682+0000 7fe2292a6640 1 -- 172.21.15.18:0/634105477 wait complete. 2024-09-19T09:19:37.699 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-19T09:19:37.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.802+0000 7f6d2ae2e640 1 Processor -- start 2024-09-19T09:19:37.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.802+0000 7f6d2ae2e640 1 -- start start 2024-09-19T09:19:37.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.802+0000 7f6d2ae2e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6d240d3240 0x7f6d240b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:37.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.802+0000 7f6d2ae2e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d240b7a90 con 0x7f6d240d1ab0 2024-09-19T09:19:37.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.802+0000 7f6d2ae2e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d240d3740 con 0x7f6d2415ef50 2024-09-19T09:19:37.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.802+0000 7f6d2ae2e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6d240d3a20 con 0x7f6d240d3240 2024-09-19T09:19:37.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.803+0000 7f6d23fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6d240d1ab0 0x7f6d240b8500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:41174/0 (socket says 172.21.15.18:41174) 2024-09-19T09:19:37.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.803+0000 7f6d23fff640 1 -- 172.21.15.18:0/2993469579 learned_addr learned my addr 172.21.15.18:0/2993469579 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:37.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.803+0000 7f6d293cb640 1 --2- 172.21.15.18:0/2993469579 >> v2:172.21.15.162:3300/0 conn(0x7f6d240d3240 0x7f6d240b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:37.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.803+0000 7f6d237fe640 1 -- 172.21.15.18:0/2993469579 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3799630705 0 0) 0x7f6d240b7a90 con 0x7f6d240d1ab0 2024-09-19T09:19:37.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.803+0000 7f6d237fe640 1 -- 172.21.15.18:0/2993469579 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d10003520 con 0x7f6d240d1ab0 2024-09-19T09:19:37.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.803+0000 7f6d237fe640 1 -- 172.21.15.18:0/2993469579 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3556628145 0 0) 0x7f6d10003520 con 0x7f6d240d1ab0 2024-09-19T09:19:37.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.803+0000 7f6d237fe640 1 -- 172.21.15.18:0/2993469579 >> v2:172.21.15.162:3300/0 conn(0x7f6d240d3240 msgr2=0x7f6d240b8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:37.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.803+0000 7f6d237fe640 1 --2- 172.21.15.18:0/2993469579 >> v2:172.21.15.162:3300/0 conn(0x7f6d240d3240 0x7f6d240b8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.803+0000 7f6d237fe640 1 -- 172.21.15.18:0/2993469579 >> v1:172.21.15.162:6789/0 conn(0x7f6d2415ef50 legacy=0x7f6d240d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:37.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.803+0000 7f6d237fe640 1 -- 172.21.15.18:0/2993469579 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d240b7d00 con 0x7f6d240d1ab0 2024-09-19T09:19:37.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.803+0000 7f6d237fe640 1 -- 172.21.15.18:0/2993469579 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f6d0c0019f0 con 0x7f6d240d1ab0 2024-09-19T09:19:37.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.803+0000 7f6d237fe640 1 -- 172.21.15.18:0/2993469579 >> v1:172.21.15.18:6789/0 conn(0x7f6d240d1ab0 legacy=0x7f6d240b8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:37.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.803+0000 7f6d237fe640 1 --2- 172.21.15.18:0/2993469579 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d100039b0 0x7f6d10003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:37.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.803+0000 7f6d237fe640 1 --2- 172.21.15.18:0/2993469579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d10004800 0x7f6d10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:37.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.803+0000 7f6d237fe640 1 --2- 172.21.15.18:0/2993469579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d100051c0 0x7f6d1000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:37.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.803+0000 7f6d237fe640 1 -- 172.21.15.18:0/2993469579 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6d240d3a20 con 0x7f6d100051c0 2024-09-19T09:19:37.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.803+0000 7f6d237fe640 1 -- 172.21.15.18:0/2993469579 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6d1000c160 con 0x7f6d10004800 2024-09-19T09:19:37.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.803+0000 7f6d237fe640 1 -- 172.21.15.18:0/2993469579 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6d1000c360 con 0x7f6d100039b0 2024-09-19T09:19:37.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.803+0000 7f6d293cb640 1 --2- 172.21.15.18:0/2993469579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d100051c0 0x7f6d1000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:37.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.803+0000 7f6d23fff640 1 --2- 172.21.15.18:0/2993469579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d10004800 0x7f6d10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:37.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.804+0000 7f6d28bca640 1 --2- 172.21.15.18:0/2993469579 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d100039b0 0x7f6d10003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:37.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.804+0000 7f6d293cb640 1 -- 172.21.15.18:0/2993469579 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d100039b0 msgr2=0x7f6d10003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:37.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.804+0000 7f6d293cb640 1 --2- 172.21.15.18:0/2993469579 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d100039b0 0x7f6d10003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.804+0000 7f6d293cb640 1 -- 172.21.15.18:0/2993469579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d10004800 msgr2=0x7f6d10004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:37.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.804+0000 7f6d293cb640 1 --2- 172.21.15.18:0/2993469579 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d10004800 0x7f6d10004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.804+0000 7f6d293cb640 1 -- 172.21.15.18:0/2993469579 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d10003520 con 0x7f6d100051c0 2024-09-19T09:19:37.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.804+0000 7f6d293cb640 1 -- 172.21.15.18:0/2993469579 reap_dead start 2024-09-19T09:19:37.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.804+0000 7f6d293cb640 1 --2- 172.21.15.18:0/2993469579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d100051c0 0x7f6d1000b9c0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f6d240d3670 tx=0x7f6d10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ba79d76e408197a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:37.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.805+0000 7f6d237fe640 1 -- 172.21.15.18:0/2993469579 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c009690 con 0x7f6d100051c0 2024-09-19T09:19:37.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.805+0000 7f6d237fe640 1 -- 172.21.15.18:0/2993469579 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d1c004020 con 0x7f6d100051c0 2024-09-19T09:19:37.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.805+0000 7f6d237fe640 1 -- 172.21.15.18:0/2993469579 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c004410 con 0x7f6d100051c0 2024-09-19T09:19:37.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.805+0000 7f6d2ae2e640 1 -- 172.21.15.18:0/2993469579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d100051c0 msgr2=0x7f6d1000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:37.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.805+0000 7f6d2ae2e640 1 --2- 172.21.15.18:0/2993469579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d100051c0 0x7f6d1000b9c0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f6d240d3670 tx=0x7f6d10005830 comp rx=0 tx=0).stop 2024-09-19T09:19:37.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.805+0000 7f6d2ae2e640 1 -- 172.21.15.18:0/2993469579 shutdown_connections 2024-09-19T09:19:37.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.805+0000 7f6d2ae2e640 1 --2- 172.21.15.18:0/2993469579 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d100051c0 0x7f6d1000b9c0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.805+0000 7f6d2ae2e640 1 -- 172.21.15.18:0/2993469579 >> 172.21.15.18:0/2993469579 conn(0x7f6d240d4c60 msgr2=0x7f6d240d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:37.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.805+0000 7f6d2ae2e640 1 -- 172.21.15.18:0/2993469579 shutdown_connections 2024-09-19T09:19:37.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.805+0000 7f6d2ae2e640 1 -- 172.21.15.18:0/2993469579 wait complete. 2024-09-19T09:19:37.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.807+0000 7f6d2ae2e640 1 Processor -- start 2024-09-19T09:19:37.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.807+0000 7f6d2ae2e640 1 -- start start 2024-09-19T09:19:37.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.807+0000 7f6d2ae2e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d100051c0 0x7f6d241f8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:37.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.807+0000 7f6d2ae2e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d240cac90 0x7f6d24153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:37.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.807+0000 7f6d2ae2e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d24154250 0x7f6d241546d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:37.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.807+0000 7f6d2ae2e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6d240d21a0 con 0x7f6d240cac90 2024-09-19T09:19:37.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.807+0000 7f6d2ae2e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6d240d2020 con 0x7f6d24154250 2024-09-19T09:19:37.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.807+0000 7f6d2ae2e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6d240d5780 con 0x7f6d100051c0 2024-09-19T09:19:37.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.808+0000 7f6d23fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d240cac90 0x7f6d24153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:37.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.808+0000 7f6d23fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d240cac90 0x7f6d24153300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38166/0 (socket says 172.21.15.18:38166) 2024-09-19T09:19:37.812 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.808+0000 7f6d23fff640 1 -- 172.21.15.18:0/2598701815 learned_addr learned my addr 172.21.15.18:0/2598701815 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:37.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.808+0000 7f6d28bca640 1 --2- 172.21.15.18:0/2598701815 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d100051c0 0x7f6d241f8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:37.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.808+0000 7f6d293cb640 1 --2- 172.21.15.18:0/2598701815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d24154250 0x7f6d241546d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:37.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.808+0000 7f6d23fff640 1 -- 172.21.15.18:0/2598701815 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d100051c0 msgr2=0x7f6d241f8860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:37.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.808+0000 7f6d23fff640 1 --2- 172.21.15.18:0/2598701815 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d100051c0 0x7f6d241f8860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.808+0000 7f6d23fff640 1 -- 172.21.15.18:0/2598701815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d24154250 msgr2=0x7f6d241546d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:37.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.808+0000 7f6d23fff640 1 --2- 172.21.15.18:0/2598701815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d24154250 0x7f6d241546d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.808+0000 7f6d23fff640 1 -- 172.21.15.18:0/2598701815 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d241f8da0 con 0x7f6d240cac90 2024-09-19T09:19:37.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.808+0000 7f6d293cb640 1 --2- 172.21.15.18:0/2598701815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d24154250 0x7f6d241546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:37.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.808+0000 7f6d23fff640 1 --2- 172.21.15.18:0/2598701815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d240cac90 0x7f6d24153300 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c0079d0 tx=0x7f6d0c00a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:37.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.808+0000 7f6d217fa640 1 -- 172.21.15.18:0/2598701815 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c001990 con 0x7f6d240cac90 2024-09-19T09:19:37.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.808+0000 7f6d217fa640 1 -- 172.21.15.18:0/2598701815 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d0c018070 con 0x7f6d240cac90 2024-09-19T09:19:37.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.808+0000 7f6d2ae2e640 1 -- 172.21.15.18:0/2598701815 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d24153840 con 0x7f6d240cac90 2024-09-19T09:19:37.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.808+0000 7f6d217fa640 1 -- 172.21.15.18:0/2598701815 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c013630 con 0x7f6d240cac90 2024-09-19T09:19:37.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.808+0000 7f6d2ae2e640 1 -- 172.21.15.18:0/2598701815 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d240c9750 con 0x7f6d240cac90 2024-09-19T09:19:37.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.809+0000 7f6d2ae2e640 1 -- 172.21.15.18:0/2598701815 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d240d13a0 con 0x7f6d240cac90 2024-09-19T09:19:37.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.810+0000 7f6d217fa640 1 -- 172.21.15.18:0/2598701815 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6d0c0139e0 con 0x7f6d240cac90 2024-09-19T09:19:37.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.810+0000 7f6d217fa640 1 --2- 172.21.15.18:0/2598701815 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6d0406c2e0 0x7f6d0406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:37.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.811+0000 7f6d217fa640 1 -- 172.21.15.18:0/2598701815 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 4857+0+0 (secure 0 0 0) 0x7f6d0c08ba00 con 0x7f6d240cac90 2024-09-19T09:19:37.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.811+0000 7f6d28bca640 1 --2- 172.21.15.18:0/2598701815 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6d0406c2e0 0x7f6d0406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:37.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.811+0000 7f6d28bca640 1 --2- 172.21.15.18:0/2598701815 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6d0406c2e0 0x7f6d0406e7a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6d14000c00 tx=0x7f6d14009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:37.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.815+0000 7f6d217fa640 1 -- 172.21.15.18:0/2598701815 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6d241f8da0 con 0x7f6d240cac90 2024-09-19T09:19:37.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.993+0000 7f6d2ae2e640 1 -- 172.21.15.18:0/2598701815 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f6d240d0b20 con 0x7f6d240cac90 2024-09-19T09:19:37.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.993+0000 7f6d217fa640 1 -- 172.21.15.18:0/2598701815 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v134) ==== 84+0+65 (secure 0 0 0) 0x7f6d0c05a550 con 0x7f6d240cac90 2024-09-19T09:19:37.994 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:37.994 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-09-19T09:19:37.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:37.995 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 1, 2024-09-19T09:19:37.995 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": ".mgr" 2024-09-19T09:19:37.995 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:37.995 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-09-19T09:19:37.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.995+0000 7f6d2ae2e640 1 -- 172.21.15.18:0/2598701815 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6d0406c2e0 msgr2=0x7f6d0406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:37.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.995+0000 7f6d2ae2e640 1 --2- 172.21.15.18:0/2598701815 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6d0406c2e0 0x7f6d0406e7a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f6d14000c00 tx=0x7f6d14009040 comp rx=0 tx=0).stop 2024-09-19T09:19:37.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.995+0000 7f6d2ae2e640 1 -- 172.21.15.18:0/2598701815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d240cac90 msgr2=0x7f6d24153300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:37.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.995+0000 7f6d2ae2e640 1 --2- 172.21.15.18:0/2598701815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d240cac90 0x7f6d24153300 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c0079d0 tx=0x7f6d0c00a730 comp rx=0 tx=0).stop 2024-09-19T09:19:37.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.995+0000 7f6d2ae2e640 1 -- 172.21.15.18:0/2598701815 shutdown_connections 2024-09-19T09:19:37.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.995+0000 7f6d2ae2e640 1 --2- 172.21.15.18:0/2598701815 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6d0406c2e0 0x7f6d0406e7a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.995+0000 7f6d2ae2e640 1 --2- 172.21.15.18:0/2598701815 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d24154250 0x7f6d241546d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.995+0000 7f6d2ae2e640 1 --2- 172.21.15.18:0/2598701815 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d240cac90 0x7f6d24153300 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.995+0000 7f6d2ae2e640 1 --2- 172.21.15.18:0/2598701815 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d100051c0 0x7f6d241f8860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:37.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.995+0000 7f6d2ae2e640 1 -- 172.21.15.18:0/2598701815 >> 172.21.15.18:0/2598701815 conn(0x7f6d240d4c60 msgr2=0x7f6d240cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:37.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.996+0000 7f6d2ae2e640 1 -- 172.21.15.18:0/2598701815 shutdown_connections 2024-09-19T09:19:37.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:37.996+0000 7f6d2ae2e640 1 -- 172.21.15.18:0/2598701815 wait complete. 2024-09-19T09:19:38.007 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T09:19:38.007 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T09:19:38.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.112+0000 7f2ae4928640 1 Processor -- start 2024-09-19T09:19:38.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.112+0000 7f2ae4928640 1 -- start start 2024-09-19T09:19:38.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.113+0000 7f2ae4928640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2ae015edb0 0x7f2ae00d29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:38.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.113+0000 7f2ae4928640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ae00d0370 0x7f2ae00d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:38.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.113+0000 7f2ae4928640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ae00d0870 con 0x7f2ae00d37c0 2024-09-19T09:19:38.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.113+0000 7f2ae4928640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2ae00b4400 con 0x7f2ae015edb0 2024-09-19T09:19:38.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.113+0000 7f2ae4928640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2ae00d0b50 con 0x7f2ae00d0370 2024-09-19T09:19:38.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.114+0000 7f2addd9b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ae00d0370 0x7f2ae00d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:38.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.114+0000 7f2ade59c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2ae015edb0 0x7f2ae00d29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:38.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.114+0000 7f2aded9d640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f2ae00d37c0 0x7f2ae00d1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:55478/0 (socket says 172.21.15.18:55478) 2024-09-19T09:19:38.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.114+0000 7f2aded9d640 1 -- 172.21.15.18:0/438405638 learned_addr learned my addr 172.21.15.18:0/438405638 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:38.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.114+0000 7f2addd9b640 1 -- 172.21.15.18:0/438405638 >> v2:172.21.15.162:3300/0 conn(0x7f2ae015edb0 msgr2=0x7f2ae00d29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:38.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.114+0000 7f2addd9b640 1 --2- 172.21.15.18:0/438405638 >> v2:172.21.15.162:3300/0 conn(0x7f2ae015edb0 0x7f2ae00d29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:38.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.114+0000 7f2addd9b640 1 -- 172.21.15.18:0/438405638 >> v1:172.21.15.162:6789/0 conn(0x7f2ae00d37c0 legacy=0x7f2ae00d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:38.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.114+0000 7f2addd9b640 1 -- 172.21.15.18:0/438405638 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ae00b4620 con 0x7f2ae00d0370 2024-09-19T09:19:38.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.114+0000 7f2add59a640 1 -- 172.21.15.18:0/438405638 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3835651940 0 0) 0x7f2ae00d0870 con 0x7f2ae00d37c0 2024-09-19T09:19:38.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.115+0000 7f2addd9b640 1 --2- 172.21.15.18:0/438405638 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ae00d0370 0x7f2ae00d3280 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40097a0 tx=0x7f2ad402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13671eed60a2ceb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:38.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.115+0000 7f2add59a640 1 -- 172.21.15.18:0/438405638 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4037070 con 0x7f2ae00d0370 2024-09-19T09:19:38.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.115+0000 7f2add59a640 1 -- 172.21.15.18:0/438405638 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ad4032440 con 0x7f2ae00d0370 2024-09-19T09:19:38.117 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.115+0000 7f2add59a640 1 -- 172.21.15.18:0/438405638 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4032810 con 0x7f2ae00d0370 2024-09-19T09:19:38.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.116+0000 7f2ae4928640 1 -- 172.21.15.18:0/438405638 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ae00d0370 msgr2=0x7f2ae00d3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:38.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.116+0000 7f2ae4928640 1 --2- 172.21.15.18:0/438405638 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ae00d0370 0x7f2ae00d3280 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40097a0 tx=0x7f2ad402a180 comp rx=0 tx=0).stop 2024-09-19T09:19:38.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.116+0000 7f2ae4928640 1 -- 172.21.15.18:0/438405638 shutdown_connections 2024-09-19T09:19:38.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.116+0000 7f2ae4928640 1 --2- 172.21.15.18:0/438405638 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ae00d0370 0x7f2ae00d3280 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:38.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.116+0000 7f2ae4928640 1 --2- 172.21.15.18:0/438405638 >> v2:172.21.15.162:3300/0 conn(0x7f2ae015edb0 0x7f2ae00d29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:38.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.116+0000 7f2ae4928640 1 -- 172.21.15.18:0/438405638 >> 172.21.15.18:0/438405638 conn(0x7f2ae009df30 msgr2=0x7f2ae00d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:38.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.116+0000 7f2ae4928640 1 -- 172.21.15.18:0/438405638 shutdown_connections 2024-09-19T09:19:38.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.116+0000 7f2ae4928640 1 -- 172.21.15.18:0/438405638 wait complete. 2024-09-19T09:19:38.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.117+0000 7f2ae4928640 1 Processor -- start 2024-09-19T09:19:38.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.117+0000 7f2ae4928640 1 -- start start 2024-09-19T09:19:38.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.118+0000 7f2ae4928640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ae00d0370 0x7f2ae0160490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:38.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.118+0000 7f2ae4928640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ae00d37c0 0x7f2ae00c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:38.120 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.118+0000 7f2ae4928640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ae015edb0 0x7f2ae00c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:38.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.118+0000 7f2ae4928640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae015f190 con 0x7f2ae00d37c0 2024-09-19T09:19:38.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.118+0000 7f2ae4928640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2ae00b4be0 con 0x7f2ae015edb0 2024-09-19T09:19:38.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.118+0000 7f2ae4928640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2ae00d2f20 con 0x7f2ae00d0370 2024-09-19T09:19:38.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.118+0000 7f2addd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ae00d37c0 0x7f2ae00c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:38.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.118+0000 7f2addd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ae00d37c0 0x7f2ae00c8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38182/0 (socket says 172.21.15.18:38182) 2024-09-19T09:19:38.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.118+0000 7f2addd9b640 1 -- 172.21.15.18:0/1807963177 learned_addr learned my addr 172.21.15.18:0/1807963177 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:38.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.118+0000 7f2aded9d640 1 --2- 172.21.15.18:0/1807963177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ae015edb0 0x7f2ae00c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:38.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.118+0000 7f2ade59c640 1 --2- 172.21.15.18:0/1807963177 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ae00d0370 0x7f2ae0160490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:38.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.119+0000 7f2addd9b640 1 -- 172.21.15.18:0/1807963177 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ae00d0370 msgr2=0x7f2ae0160490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:38.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.119+0000 7f2addd9b640 1 --2- 172.21.15.18:0/1807963177 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ae00d0370 0x7f2ae0160490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:38.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.119+0000 7f2addd9b640 1 -- 172.21.15.18:0/1807963177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ae015edb0 msgr2=0x7f2ae00c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:38.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.119+0000 7f2addd9b640 1 --2- 172.21.15.18:0/1807963177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ae015edb0 0x7f2ae00c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:38.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.119+0000 7f2addd9b640 1 -- 172.21.15.18:0/1807963177 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ae0160b20 con 0x7f2ae00d37c0 2024-09-19T09:19:38.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.119+0000 7f2addd9b640 1 --2- 172.21.15.18:0/1807963177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ae00d37c0 0x7f2ae00c8460 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40097a0 tx=0x7f2ad40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:38.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.119+0000 7f2aceffd640 1 -- 172.21.15.18:0/1807963177 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4037050 con 0x7f2ae00d37c0 2024-09-19T09:19:38.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.119+0000 7f2aceffd640 1 -- 172.21.15.18:0/1807963177 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ad4038040 con 0x7f2ae00d37c0 2024-09-19T09:19:38.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.119+0000 7f2ae4928640 1 -- 172.21.15.18:0/1807963177 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ae0160e00 con 0x7f2ae00d37c0 2024-09-19T09:19:38.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.119+0000 7f2aceffd640 1 -- 172.21.15.18:0/1807963177 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4004490 con 0x7f2ae00d37c0 2024-09-19T09:19:38.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.119+0000 7f2ae4928640 1 -- 172.21.15.18:0/1807963177 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ae01613c0 con 0x7f2ae00d37c0 2024-09-19T09:19:38.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.120+0000 7f2ae4928640 1 -- 172.21.15.18:0/1807963177 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ae00d3280 con 0x7f2ae00d37c0 2024-09-19T09:19:38.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.121+0000 7f2aceffd640 1 -- 172.21.15.18:0/1807963177 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2ad403c6d0 con 0x7f2ae00d37c0 2024-09-19T09:19:38.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.121+0000 7f2aceffd640 1 --2- 172.21.15.18:0/1807963177 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2ac006c2b0 0x7f2ac006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:38.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.121+0000 7f2aceffd640 1 -- 172.21.15.18:0/1807963177 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(134..134 src has 1..134) ==== 4857+0+0 (secure 0 0 0) 0x7f2ad40abac0 con 0x7f2ae00d37c0 2024-09-19T09:19:38.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.121+0000 7f2ade59c640 1 --2- 172.21.15.18:0/1807963177 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2ac006c2b0 0x7f2ac006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:38.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.122+0000 7f2ade59c640 1 --2- 172.21.15.18:0/1807963177 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2ac006c2b0 0x7f2ac006e770 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0009aa0 tx=0x7f2ad0009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:38.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.125+0000 7f2aceffd640 1 -- 172.21.15.18:0/1807963177 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2ad4079e20 con 0x7f2ae00d37c0 2024-09-19T09:19:38.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.301+0000 7f2ae4928640 1 -- 172.21.15.18:0/1807963177 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f2ae00d1ca0 con 0x7f2ae00d37c0 2024-09-19T09:19:38.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.384+0000 7f2aceffd640 1 -- 172.21.15.18:0/1807963177 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v135) ==== 138+0+0 (secure 0 0 0) 0x7f2ad407e120 con 0x7f2ae00d37c0 2024-09-19T09:19:38.385 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' created 2024-09-19T09:19:38.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.386+0000 7f2ae4928640 1 -- 172.21.15.18:0/1807963177 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2ac006c2b0 msgr2=0x7f2ac006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:38.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.386+0000 7f2ae4928640 1 --2- 172.21.15.18:0/1807963177 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2ac006c2b0 0x7f2ac006e770 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0009aa0 tx=0x7f2ad0009190 comp rx=0 tx=0).stop 2024-09-19T09:19:38.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.386+0000 7f2ae4928640 1 -- 172.21.15.18:0/1807963177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ae00d37c0 msgr2=0x7f2ae00c8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:38.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.386+0000 7f2ae4928640 1 --2- 172.21.15.18:0/1807963177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ae00d37c0 0x7f2ae00c8460 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f2ad40097a0 tx=0x7f2ad40046c0 comp rx=0 tx=0).stop 2024-09-19T09:19:38.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.386+0000 7f2ae4928640 1 -- 172.21.15.18:0/1807963177 shutdown_connections 2024-09-19T09:19:38.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.386+0000 7f2ae4928640 1 --2- 172.21.15.18:0/1807963177 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2ac006c2b0 0x7f2ac006e770 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:38.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.386+0000 7f2ae4928640 1 --2- 172.21.15.18:0/1807963177 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ae015edb0 0x7f2ae00c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:38.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.386+0000 7f2ae4928640 1 --2- 172.21.15.18:0/1807963177 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ae00d37c0 0x7f2ae00c8460 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:38.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.386+0000 7f2ae4928640 1 --2- 172.21.15.18:0/1807963177 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ae00d0370 0x7f2ae0160490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:38.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.387+0000 7f2ae4928640 1 -- 172.21.15.18:0/1807963177 >> 172.21.15.18:0/1807963177 conn(0x7f2ae009df30 msgr2=0x7f2ae006dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:38.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.387+0000 7f2ae4928640 1 -- 172.21.15.18:0/1807963177 shutdown_connections 2024-09-19T09:19:38.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.387+0000 7f2ae4928640 1 -- 172.21.15.18:0/1807963177 wait complete. 2024-09-19T09:19:38.399 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T09:19:38.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.508+0000 7f8d4328d640 1 Processor -- start 2024-09-19T09:19:38.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.508+0000 7f8d4328d640 1 -- start start 2024-09-19T09:19:38.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.509+0000 7f8d4328d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8d3c071020 0x7f8d3c0cf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:38.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.509+0000 7f8d4328d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d3c0cfd50 con 0x7f8d3c0cdd80 2024-09-19T09:19:38.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.509+0000 7f8d4328d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d3c0d0030 con 0x7f8d3c1600f0 2024-09-19T09:19:38.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.509+0000 7f8d4328d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8d3c1604d0 con 0x7f8d3c071020 2024-09-19T09:19:38.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.509+0000 7f8d40828640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f8d3c0cdd80 0x7f8d3c0cefe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:41186/0 (socket says 172.21.15.18:41186) 2024-09-19T09:19:38.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.509+0000 7f8d40828640 1 -- 172.21.15.18:0/309668504 learned_addr learned my addr 172.21.15.18:0/309668504 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:38.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.510+0000 7f8d4182a640 1 --2- 172.21.15.18:0/309668504 >> v2:172.21.15.162:3300/0 conn(0x7f8d3c071020 0x7f8d3c0cf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:38.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.510+0000 7f8d33fff640 1 -- 172.21.15.18:0/309668504 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2749703391 0 0) 0x7f8d3c0cfd50 con 0x7f8d3c0cdd80 2024-09-19T09:19:38.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.510+0000 7f8d33fff640 1 -- 172.21.15.18:0/309668504 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d28003520 con 0x7f8d3c0cdd80 2024-09-19T09:19:38.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.510+0000 7f8d33fff640 1 -- 172.21.15.18:0/309668504 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1410294250 0 0) 0x7f8d28003520 con 0x7f8d3c0cdd80 2024-09-19T09:19:38.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.510+0000 7f8d33fff640 1 -- 172.21.15.18:0/309668504 >> v2:172.21.15.162:3300/0 conn(0x7f8d3c071020 msgr2=0x7f8d3c0cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:38.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.510+0000 7f8d33fff640 1 --2- 172.21.15.18:0/309668504 >> v2:172.21.15.162:3300/0 conn(0x7f8d3c071020 0x7f8d3c0cf6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:38.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.510+0000 7f8d33fff640 1 -- 172.21.15.18:0/309668504 >> v1:172.21.15.162:6789/0 conn(0x7f8d3c1600f0 legacy=0x7f8d3c0cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:38.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.510+0000 7f8d33fff640 1 -- 172.21.15.18:0/309668504 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d3c0d0310 con 0x7f8d3c0cdd80 2024-09-19T09:19:38.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.510+0000 7f8d33fff640 1 -- 172.21.15.18:0/309668504 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f8d2c001670 con 0x7f8d3c0cdd80 2024-09-19T09:19:38.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.510+0000 7f8d33fff640 1 -- 172.21.15.18:0/309668504 >> v1:172.21.15.18:6789/0 conn(0x7f8d3c0cdd80 legacy=0x7f8d3c0cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:38.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.510+0000 7f8d33fff640 1 --2- 172.21.15.18:0/309668504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d280039b0 0x7f8d28003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:38.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.510+0000 7f8d33fff640 1 --2- 172.21.15.18:0/309668504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d28004800 0x7f8d28004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:38.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.510+0000 7f8d33fff640 1 --2- 172.21.15.18:0/309668504 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d280051c0 0x7f8d2800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:38.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.510+0000 7f8d33fff640 1 -- 172.21.15.18:0/309668504 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3c1604d0 con 0x7f8d28004800 2024-09-19T09:19:38.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.510+0000 7f8d33fff640 1 -- 172.21.15.18:0/309668504 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2800c060 con 0x7f8d280039b0 2024-09-19T09:19:38.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.510+0000 7f8d33fff640 1 -- 172.21.15.18:0/309668504 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8d2800c260 con 0x7f8d280051c0 2024-09-19T09:19:38.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.510+0000 7f8d40828640 1 --2- 172.21.15.18:0/309668504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d28004800 0x7f8d28004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:38.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.510+0000 7f8d4182a640 1 --2- 172.21.15.18:0/309668504 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d280051c0 0x7f8d2800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:38.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.510+0000 7f8d41029640 1 --2- 172.21.15.18:0/309668504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d280039b0 0x7f8d28003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:38.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.511+0000 7f8d40828640 1 -- 172.21.15.18:0/309668504 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d280051c0 msgr2=0x7f8d2800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:38.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.511+0000 7f8d40828640 1 --2- 172.21.15.18:0/309668504 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d280051c0 0x7f8d2800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:38.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.511+0000 7f8d40828640 1 -- 172.21.15.18:0/309668504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d280039b0 msgr2=0x7f8d28003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:38.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.511+0000 7f8d40828640 1 --2- 172.21.15.18:0/309668504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d280039b0 0x7f8d28003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:38.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.511+0000 7f8d40828640 1 -- 172.21.15.18:0/309668504 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d28003520 con 0x7f8d28004800 2024-09-19T09:19:38.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.511+0000 7f8d4182a640 1 -- 172.21.15.18:0/309668504 reap_dead start 2024-09-19T09:19:38.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.511+0000 7f8d40828640 1 --2- 172.21.15.18:0/309668504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d28004800 0x7f8d28004c80 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c00c210 tx=0x7f8d28005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c25349dacaf74ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:38.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.511+0000 7f8d33fff640 1 -- 172.21.15.18:0/309668504 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c007d30 con 0x7f8d28004800 2024-09-19T09:19:38.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.511+0000 7f8d33fff640 1 -- 172.21.15.18:0/309668504 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d2c005ad0 con 0x7f8d28004800 2024-09-19T09:19:38.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.511+0000 7f8d33fff640 1 -- 172.21.15.18:0/309668504 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d2c007070 con 0x7f8d28004800 2024-09-19T09:19:38.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.512+0000 7f8d4328d640 1 -- 172.21.15.18:0/309668504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d28004800 msgr2=0x7f8d28004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:38.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.512+0000 7f8d4328d640 1 --2- 172.21.15.18:0/309668504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d28004800 0x7f8d28004c80 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c00c210 tx=0x7f8d28005830 comp rx=0 tx=0).stop 2024-09-19T09:19:38.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.512+0000 7f8d4328d640 1 -- 172.21.15.18:0/309668504 shutdown_connections 2024-09-19T09:19:38.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.512+0000 7f8d4328d640 1 --2- 172.21.15.18:0/309668504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d28004800 0x7f8d28004c80 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:38.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.512+0000 7f8d4328d640 1 -- 172.21.15.18:0/309668504 >> 172.21.15.18:0/309668504 conn(0x7f8d3c0b45f0 msgr2=0x7f8d3c0b4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:38.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.512+0000 7f8d4328d640 1 -- 172.21.15.18:0/309668504 shutdown_connections 2024-09-19T09:19:38.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.512+0000 7f8d4328d640 1 -- 172.21.15.18:0/309668504 wait complete. 2024-09-19T09:19:38.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.513+0000 7f8d4328d640 1 Processor -- start 2024-09-19T09:19:38.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.513+0000 7f8d4328d640 1 -- start start 2024-09-19T09:19:38.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.514+0000 7f8d4328d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d28004800 0x7f8d3c0c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:38.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.514+0000 7f8d4328d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d3c0b78a0 0x7f8d3c0b7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:38.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.514+0000 7f8d4328d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d3c0c6590 0x7f8d3c0c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:38.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.514+0000 7f8d4328d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3c0cd670 con 0x7f8d3c0c6590 2024-09-19T09:19:38.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.514+0000 7f8d4328d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3c06fb80 con 0x7f8d3c0b78a0 2024-09-19T09:19:38.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.514+0000 7f8d4328d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8d3c0cd7f0 con 0x7f8d28004800 2024-09-19T09:19:38.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.514+0000 7f8d4182a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d3c0c6590 0x7f8d3c0c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:38.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.514+0000 7f8d4182a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d3c0c6590 0x7f8d3c0c6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38196/0 (socket says 172.21.15.18:38196) 2024-09-19T09:19:38.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.514+0000 7f8d4182a640 1 -- 172.21.15.18:0/2539443909 learned_addr learned my addr 172.21.15.18:0/2539443909 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:38.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.514+0000 7f8d40828640 1 --2- 172.21.15.18:0/2539443909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d3c0b78a0 0x7f8d3c0b7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:38.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.514+0000 7f8d41029640 1 --2- 172.21.15.18:0/2539443909 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d28004800 0x7f8d3c0c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:38.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.515+0000 7f8d4182a640 1 -- 172.21.15.18:0/2539443909 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d28004800 msgr2=0x7f8d3c0c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:38.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.515+0000 7f8d4182a640 1 --2- 172.21.15.18:0/2539443909 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d28004800 0x7f8d3c0c8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:38.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.515+0000 7f8d4182a640 1 -- 172.21.15.18:0/2539443909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d3c0b78a0 msgr2=0x7f8d3c0b7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:38.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.515+0000 7f8d4182a640 1 --2- 172.21.15.18:0/2539443909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d3c0b78a0 0x7f8d3c0b7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:38.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.515+0000 7f8d4182a640 1 -- 172.21.15.18:0/2539443909 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d3c0c7490 con 0x7f8d3c0c6590 2024-09-19T09:19:38.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.515+0000 7f8d4182a640 1 --2- 172.21.15.18:0/2539443909 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d3c0c6590 0x7f8d3c0c6a20 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c072d30 tx=0x7f8d3400f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:38.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.515+0000 7f8d31ffb640 1 -- 172.21.15.18:0/2539443909 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d3400fce0 con 0x7f8d3c0c6590 2024-09-19T09:19:38.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.515+0000 7f8d31ffb640 1 -- 172.21.15.18:0/2539443909 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d3400fe80 con 0x7f8d3c0c6590 2024-09-19T09:19:38.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.515+0000 7f8d4328d640 1 -- 172.21.15.18:0/2539443909 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d3c0b5fd0 con 0x7f8d3c0c6590 2024-09-19T09:19:38.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.515+0000 7f8d31ffb640 1 -- 172.21.15.18:0/2539443909 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d34015670 con 0x7f8d3c0c6590 2024-09-19T09:19:38.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.515+0000 7f8d4328d640 1 -- 172.21.15.18:0/2539443909 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d3c0b6590 con 0x7f8d3c0c6590 2024-09-19T09:19:38.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.516+0000 7f8d4328d640 1 -- 172.21.15.18:0/2539443909 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d3c0cefe0 con 0x7f8d3c0c6590 2024-09-19T09:19:38.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.517+0000 7f8d31ffb640 1 -- 172.21.15.18:0/2539443909 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8d34015810 con 0x7f8d3c0c6590 2024-09-19T09:19:38.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.517+0000 7f8d31ffb640 1 --2- 172.21.15.18:0/2539443909 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8d2006c2e0 0x7f8d2006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:38.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.517+0000 7f8d31ffb640 1 -- 172.21.15.18:0/2539443909 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(135..135 src has 1..135) ==== 5227+0+0 (secure 0 0 0) 0x7f8d3408be80 con 0x7f8d3c0c6590 2024-09-19T09:19:38.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.518+0000 7f8d41029640 1 --2- 172.21.15.18:0/2539443909 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8d2006c2e0 0x7f8d2006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:38.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.518+0000 7f8d41029640 1 --2- 172.21.15.18:0/2539443909 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8d2006c2e0 0x7f8d2006e7a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8d38000c00 tx=0x7f8d38009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:38.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.522+0000 7f8d31ffb640 1 -- 172.21.15.18:0/2539443909 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8d34019030 con 0x7f8d3c0c6590 2024-09-19T09:19:38.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:38.696+0000 7f8d4328d640 1 -- 172.21.15.18:0/2539443909 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f8d3c0d1180 con 0x7f8d3c0c6590 2024-09-19T09:19:39.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.390+0000 7f8d31ffb640 1 -- 172.21.15.18:0/2539443909 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v136) ==== 170+0+0 (secure 0 0 0) 0x7f8d34010040 con 0x7f8d3c0c6590 2024-09-19T09:19:39.391 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' created 2024-09-19T09:19:39.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.394+0000 7f8d4328d640 1 -- 172.21.15.18:0/2539443909 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8d2006c2e0 msgr2=0x7f8d2006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:39.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.394+0000 7f8d4328d640 1 --2- 172.21.15.18:0/2539443909 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8d2006c2e0 0x7f8d2006e7a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8d38000c00 tx=0x7f8d38009040 comp rx=0 tx=0).stop 2024-09-19T09:19:39.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.394+0000 7f8d4328d640 1 -- 172.21.15.18:0/2539443909 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d3c0c6590 msgr2=0x7f8d3c0c6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:39.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.395+0000 7f8d4328d640 1 --2- 172.21.15.18:0/2539443909 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d3c0c6590 0x7f8d3c0c6a20 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c072d30 tx=0x7f8d3400f1b0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.401+0000 7f8d4328d640 1 -- 172.21.15.18:0/2539443909 shutdown_connections 2024-09-19T09:19:39.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.401+0000 7f8d4328d640 1 --2- 172.21.15.18:0/2539443909 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8d2006c2e0 0x7f8d2006e7a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.401+0000 7f8d4328d640 1 --2- 172.21.15.18:0/2539443909 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8d3c0c6590 0x7f8d3c0c6a20 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.401+0000 7f8d4328d640 1 --2- 172.21.15.18:0/2539443909 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8d3c0b78a0 0x7f8d3c0b7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.401+0000 7f8d4328d640 1 --2- 172.21.15.18:0/2539443909 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8d28004800 0x7f8d3c0c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.401+0000 7f8d4328d640 1 -- 172.21.15.18:0/2539443909 >> 172.21.15.18:0/2539443909 conn(0x7f8d3c0b45f0 msgr2=0x7f8d3c0b33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:39.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.402+0000 7f8d4328d640 1 -- 172.21.15.18:0/2539443909 shutdown_connections 2024-09-19T09:19:39.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.402+0000 7f8d4328d640 1 -- 172.21.15.18:0/2539443909 wait complete. 2024-09-19T09:19:39.417 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T09:19:39.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.526+0000 7fe8822dd640 1 Processor -- start 2024-09-19T09:19:39.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.526+0000 7fe8822dd640 1 -- start start 2024-09-19T09:19:39.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.527+0000 7fe8822dd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe87c15b760 0x7fe87c0afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:39.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.527+0000 7fe8822dd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe87c0b4a90 0x7fe87c06f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:39.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.527+0000 7fe8822dd640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe87c0b4300 con 0x7fe87c0d0630 2024-09-19T09:19:39.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.527+0000 7fe8822dd640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fe87c06d700 con 0x7fe87c0b4a90 2024-09-19T09:19:39.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.527+0000 7fe8822dd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe87c06d9e0 con 0x7fe87c15b760 2024-09-19T09:19:39.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.527+0000 7fe87b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe87c0b4a90 0x7fe87c06f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:39.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.527+0000 7fe88087a640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe87c0d0630 0x7fe87c0d0a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:41198/0 (socket says 172.21.15.18:41198) 2024-09-19T09:19:39.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.527+0000 7fe87b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe87c0b4a90 0x7fe87c06f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38198/0 (socket says 172.21.15.18:38198) 2024-09-19T09:19:39.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.527+0000 7fe88087a640 1 -- 172.21.15.18:0/758997817 learned_addr learned my addr 172.21.15.18:0/758997817 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:39.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.527+0000 7fe87bfff640 1 --2- 172.21.15.18:0/758997817 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe87c15b760 0x7fe87c0afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:39.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.527+0000 7fe87b7fe640 1 -- 172.21.15.18:0/758997817 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe87c15b760 msgr2=0x7fe87c0afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:39.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.527+0000 7fe87b7fe640 1 --2- 172.21.15.18:0/758997817 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe87c15b760 0x7fe87c0afa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.527+0000 7fe87b7fe640 1 -- 172.21.15.18:0/758997817 >> v1:172.21.15.18:6789/0 conn(0x7fe87c0d0630 legacy=0x7fe87c0d0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:39.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.527+0000 7fe87b7fe640 1 -- 172.21.15.18:0/758997817 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe87c0b4570 con 0x7fe87c0b4a90 2024-09-19T09:19:39.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.527+0000 7fe87affd640 1 -- 172.21.15.18:0/758997817 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 776625125 0 0) 0x7fe87c0b4300 con 0x7fe87c0d0630 2024-09-19T09:19:39.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.528+0000 7fe87b7fe640 1 --2- 172.21.15.18:0/758997817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe87c0b4a90 0x7fe87c06f290 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fe87000ba40 tx=0x7fe87002c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0d0284300e6e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:39.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.528+0000 7fe87affd640 1 -- 172.21.15.18:0/758997817 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe870031710 con 0x7fe87c0b4a90 2024-09-19T09:19:39.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.528+0000 7fe87affd640 1 -- 172.21.15.18:0/758997817 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8700318b0 con 0x7fe87c0b4a90 2024-09-19T09:19:39.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.528+0000 7fe87affd640 1 -- 172.21.15.18:0/758997817 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe870031c80 con 0x7fe87c0b4a90 2024-09-19T09:19:39.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.529+0000 7fe8822dd640 1 -- 172.21.15.18:0/758997817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe87c0b4a90 msgr2=0x7fe87c06f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:39.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.529+0000 7fe8822dd640 1 --2- 172.21.15.18:0/758997817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe87c0b4a90 0x7fe87c06f290 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fe87000ba40 tx=0x7fe87002c720 comp rx=0 tx=0).stop 2024-09-19T09:19:39.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.529+0000 7fe8822dd640 1 -- 172.21.15.18:0/758997817 shutdown_connections 2024-09-19T09:19:39.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.529+0000 7fe8822dd640 1 --2- 172.21.15.18:0/758997817 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe87c0b4a90 0x7fe87c06f290 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.529+0000 7fe8822dd640 1 --2- 172.21.15.18:0/758997817 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe87c15b760 0x7fe87c0afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.529+0000 7fe8822dd640 1 -- 172.21.15.18:0/758997817 >> 172.21.15.18:0/758997817 conn(0x7fe87c06bc10 msgr2=0x7fe87c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:39.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.529+0000 7fe8822dd640 1 -- 172.21.15.18:0/758997817 shutdown_connections 2024-09-19T09:19:39.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.529+0000 7fe8822dd640 1 -- 172.21.15.18:0/758997817 wait complete. 2024-09-19T09:19:39.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.530+0000 7fe8822dd640 1 Processor -- start 2024-09-19T09:19:39.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.530+0000 7fe8822dd640 1 -- start start 2024-09-19T09:19:39.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.531+0000 7fe8822dd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe87c0b4a90 0x7fe87c15cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:39.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.531+0000 7fe8822dd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe87c0d0630 0x7fe87c1e41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:39.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.531+0000 7fe8822dd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe87c15b760 0x7fe87c0aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:39.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.531+0000 7fe8822dd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe87c0b5070 con 0x7fe87c0d0630 2024-09-19T09:19:39.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.531+0000 7fe8822dd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe87c0b4ef0 con 0x7fe87c0b4a90 2024-09-19T09:19:39.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.531+0000 7fe8822dd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe87c15bb40 con 0x7fe87c15b760 2024-09-19T09:19:39.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.531+0000 7fe87b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe87c0d0630 0x7fe87c1e41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:39.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.531+0000 7fe87b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe87c0d0630 0x7fe87c1e41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38210/0 (socket says 172.21.15.18:38210) 2024-09-19T09:19:39.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.531+0000 7fe87b7fe640 1 -- 172.21.15.18:0/1033234616 learned_addr learned my addr 172.21.15.18:0/1033234616 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:39.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.531+0000 7fe87bfff640 1 --2- 172.21.15.18:0/1033234616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe87c0b4a90 0x7fe87c15cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:39.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.531+0000 7fe88087a640 1 --2- 172.21.15.18:0/1033234616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe87c15b760 0x7fe87c0aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:39.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.531+0000 7fe87b7fe640 1 -- 172.21.15.18:0/1033234616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe87c15b760 msgr2=0x7fe87c0aeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:39.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.531+0000 7fe87b7fe640 1 --2- 172.21.15.18:0/1033234616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe87c15b760 0x7fe87c0aeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.531+0000 7fe87b7fe640 1 -- 172.21.15.18:0/1033234616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe87c0b4a90 msgr2=0x7fe87c15cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:39.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.531+0000 7fe87b7fe640 1 --2- 172.21.15.18:0/1033234616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe87c0b4a90 0x7fe87c15cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:39.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.531+0000 7fe87b7fe640 1 -- 172.21.15.18:0/1033234616 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe87c15e2e0 con 0x7fe87c0d0630 2024-09-19T09:19:39.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.531+0000 7fe88087a640 1 --2- 172.21.15.18:0/1033234616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe87c15b760 0x7fe87c0aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:39.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.532+0000 7fe87b7fe640 1 --2- 172.21.15.18:0/1033234616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe87c0d0630 0x7fe87c1e41a0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fe87000ba40 tx=0x7fe870004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:39.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.532+0000 7fe878ff9640 1 -- 172.21.15.18:0/1033234616 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe870040070 con 0x7fe87c0d0630 2024-09-19T09:19:39.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.532+0000 7fe878ff9640 1 -- 172.21.15.18:0/1033234616 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe870033c40 con 0x7fe87c0d0630 2024-09-19T09:19:39.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.532+0000 7fe8822dd640 1 -- 172.21.15.18:0/1033234616 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe87c1e46e0 con 0x7fe87c0d0630 2024-09-19T09:19:39.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.532+0000 7fe878ff9640 1 -- 172.21.15.18:0/1033234616 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe870004030 con 0x7fe87c0d0630 2024-09-19T09:19:39.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.532+0000 7fe8822dd640 1 -- 172.21.15.18:0/1033234616 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe87c15d800 con 0x7fe87c0d0630 2024-09-19T09:19:39.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.533+0000 7fe8822dd640 1 -- 172.21.15.18:0/1033234616 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe87c06dcc0 con 0x7fe87c0d0630 2024-09-19T09:19:39.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.534+0000 7fe878ff9640 1 -- 172.21.15.18:0/1033234616 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe870043070 con 0x7fe87c0d0630 2024-09-19T09:19:39.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.534+0000 7fe878ff9640 1 --2- 172.21.15.18:0/1033234616 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe86806c2b0 0x7fe86806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:39.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.534+0000 7fe878ff9640 1 -- 172.21.15.18:0/1033234616 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 5609+0+0 (secure 0 0 0) 0x7fe8700ac1b0 con 0x7fe87c0d0630 2024-09-19T09:19:39.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.534+0000 7fe87bfff640 1 --2- 172.21.15.18:0/1033234616 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe86806c2b0 0x7fe86806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:39.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.535+0000 7fe87bfff640 1 --2- 172.21.15.18:0/1033234616 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe86806c2b0 0x7fe86806e770 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe86c00a970 tx=0x7fe86c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:39.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.539+0000 7fe878ff9640 1 -- 172.21.15.18:0/1033234616 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe87007a8f0 con 0x7fe87c0d0630 2024-09-19T09:19:39.652 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-19T09:19:39.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:39.752+0000 7fe8822dd640 1 -- 172.21.15.18:0/1033234616 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe87c0afbe0 con 0x7fe87c0d0630 2024-09-19T09:19:40.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.392+0000 7fe878ff9640 1 -- 172.21.15.18:0/1033234616 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v53) ==== 174+0+0 (secure 0 0 0) 0x7fe87007a1f0 con 0x7fe87c0d0630 2024-09-19T09:19:40.393 INFO:teuthology.orchestra.run.smithi018.stderr:new fs with metadata pool 16 and data pool 17 2024-09-19T09:19:40.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.398+0000 7fe8822dd640 1 -- 172.21.15.18:0/1033234616 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe86806c2b0 msgr2=0x7fe86806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:40.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.398+0000 7fe8822dd640 1 --2- 172.21.15.18:0/1033234616 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe86806c2b0 0x7fe86806e770 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe86c00a970 tx=0x7fe86c008040 comp rx=0 tx=0).stop 2024-09-19T09:19:40.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.398+0000 7fe8822dd640 1 -- 172.21.15.18:0/1033234616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe87c0d0630 msgr2=0x7fe87c1e41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:40.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.399+0000 7fe8822dd640 1 --2- 172.21.15.18:0/1033234616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe87c0d0630 0x7fe87c1e41a0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fe87000ba40 tx=0x7fe870004730 comp rx=0 tx=0).stop 2024-09-19T09:19:40.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.399+0000 7fe8822dd640 1 -- 172.21.15.18:0/1033234616 shutdown_connections 2024-09-19T09:19:40.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.399+0000 7fe8822dd640 1 --2- 172.21.15.18:0/1033234616 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe86806c2b0 0x7fe86806e770 secure :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fe86c00a970 tx=0x7fe86c008040 comp rx=0 tx=0).stop 2024-09-19T09:19:40.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.399+0000 7fe8822dd640 1 --2- 172.21.15.18:0/1033234616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe87c15b760 0x7fe87c0aeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.399+0000 7fe8822dd640 1 --2- 172.21.15.18:0/1033234616 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe87c0d0630 0x7fe87c1e41a0 secure :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fe87000ba40 tx=0x7fe870004730 comp rx=0 tx=0).stop 2024-09-19T09:19:40.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.399+0000 7fe8822dd640 1 --2- 172.21.15.18:0/1033234616 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe87c0b4a90 0x7fe87c15cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.400+0000 7fe8822dd640 1 -- 172.21.15.18:0/1033234616 >> 172.21.15.18:0/1033234616 conn(0x7fe87c06bc10 msgr2=0x7fe87c0b04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:40.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.406+0000 7fe8822dd640 1 -- 172.21.15.18:0/1033234616 shutdown_connections 2024-09-19T09:19:40.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.406+0000 7fe8822dd640 1 -- 172.21.15.18:0/1033234616 wait complete. 2024-09-19T09:19:40.425 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:19:40.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.528+0000 7faa90f31640 1 Processor -- start 2024-09-19T09:19:40.528 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.528+0000 7faa90f31640 1 -- start start 2024-09-19T09:19:40.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.529+0000 7faa90f31640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7faa8c15ed50 0x7faa8c0d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:40.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.529+0000 7faa90f31640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa8c0d31b0 con 0x7faa8c0d09d0 2024-09-19T09:19:40.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.529+0000 7faa90f31640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa8c0d3490 con 0x7faa8c0d1aa0 2024-09-19T09:19:40.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.529+0000 7faa90f31640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7faa8c0d1ee0 con 0x7faa8c15ed50 2024-09-19T09:19:40.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.529+0000 7faa8ad9d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7faa8c0d09d0 0x7faa8c0b5200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:41202/0 (socket says 172.21.15.18:41202) 2024-09-19T09:19:40.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.529+0000 7faa8ad9d640 1 -- 172.21.15.18:0/779951885 learned_addr learned my addr 172.21.15.18:0/779951885 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:40.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.529+0000 7faa8a59c640 1 --2- 172.21.15.18:0/779951885 >> v2:172.21.15.162:3300/0 conn(0x7faa8c15ed50 0x7faa8c0d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:40.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.529+0000 7faa8959a640 1 -- 172.21.15.18:0/779951885 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2277082452 0 0) 0x7faa8c0d31b0 con 0x7faa8c0d09d0 2024-09-19T09:19:40.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.529+0000 7faa8959a640 1 -- 172.21.15.18:0/779951885 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa74003520 con 0x7faa8c0d09d0 2024-09-19T09:19:40.531 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.529+0000 7faa8959a640 1 -- 172.21.15.18:0/779951885 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3671627349 0 0) 0x7faa74003520 con 0x7faa8c0d09d0 2024-09-19T09:19:40.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.529+0000 7faa8959a640 1 -- 172.21.15.18:0/779951885 >> v2:172.21.15.162:3300/0 conn(0x7faa8c15ed50 msgr2=0x7faa8c0d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:40.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.529+0000 7faa8959a640 1 --2- 172.21.15.18:0/779951885 >> v2:172.21.15.162:3300/0 conn(0x7faa8c15ed50 0x7faa8c0d1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.529+0000 7faa8959a640 1 -- 172.21.15.18:0/779951885 >> v1:172.21.15.162:6789/0 conn(0x7faa8c0d1aa0 legacy=0x7faa8c0b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:40.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.529+0000 7faa8959a640 1 -- 172.21.15.18:0/779951885 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa8c0d3770 con 0x7faa8c0d09d0 2024-09-19T09:19:40.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.529+0000 7faa8959a640 1 -- 172.21.15.18:0/779951885 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7faa840019f0 con 0x7faa8c0d09d0 2024-09-19T09:19:40.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.529+0000 7faa8959a640 1 -- 172.21.15.18:0/779951885 >> v1:172.21.15.18:6789/0 conn(0x7faa8c0d09d0 legacy=0x7faa8c0b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:40.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.530+0000 7faa8959a640 1 --2- 172.21.15.18:0/779951885 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa740039b0 0x7faa74003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:40.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.530+0000 7faa8959a640 1 --2- 172.21.15.18:0/779951885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa74004800 0x7faa74004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:40.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.530+0000 7faa8959a640 1 --2- 172.21.15.18:0/779951885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa740051c0 0x7faa7400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:40.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.530+0000 7faa8959a640 1 -- 172.21.15.18:0/779951885 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faa8c0d1ee0 con 0x7faa74004800 2024-09-19T09:19:40.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.530+0000 7faa8959a640 1 -- 172.21.15.18:0/779951885 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faa7400c070 con 0x7faa740051c0 2024-09-19T09:19:40.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.530+0000 7faa8959a640 1 -- 172.21.15.18:0/779951885 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faa7400c270 con 0x7faa740039b0 2024-09-19T09:19:40.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.530+0000 7faa89d9b640 1 --2- 172.21.15.18:0/779951885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa74004800 0x7faa74004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:40.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.530+0000 7faa8ad9d640 1 --2- 172.21.15.18:0/779951885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa740051c0 0x7faa7400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:40.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.530+0000 7faa8a59c640 1 --2- 172.21.15.18:0/779951885 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa740039b0 0x7faa74003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:40.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.530+0000 7faa89d9b640 1 -- 172.21.15.18:0/779951885 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa740039b0 msgr2=0x7faa74003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:40.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.530+0000 7faa89d9b640 1 --2- 172.21.15.18:0/779951885 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa740039b0 0x7faa74003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.530+0000 7faa89d9b640 1 -- 172.21.15.18:0/779951885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa740051c0 msgr2=0x7faa7400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:40.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.530+0000 7faa89d9b640 1 --2- 172.21.15.18:0/779951885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa740051c0 0x7faa7400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.530+0000 7faa89d9b640 1 -- 172.21.15.18:0/779951885 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa74003520 con 0x7faa74004800 2024-09-19T09:19:40.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.530+0000 7faa8ad9d640 1 --2- 172.21.15.18:0/779951885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa740051c0 0x7faa7400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:40.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.530+0000 7faa8ad9d640 1 -- 172.21.15.18:0/779951885 reap_dead start 2024-09-19T09:19:40.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.531+0000 7faa89d9b640 1 --2- 172.21.15.18:0/779951885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa74004800 0x7faa74004c80 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7faa80001750 tx=0x7faa74005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c082f082a8488d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:40.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.531+0000 7faa8959a640 1 -- 172.21.15.18:0/779951885 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa80001370 con 0x7faa74004800 2024-09-19T09:19:40.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.531+0000 7faa8959a640 1 -- 172.21.15.18:0/779951885 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa800052d0 con 0x7faa74004800 2024-09-19T09:19:40.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.531+0000 7faa8959a640 1 -- 172.21.15.18:0/779951885 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8002abc0 con 0x7faa74004800 2024-09-19T09:19:40.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.531+0000 7faa90f31640 1 -- 172.21.15.18:0/779951885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa74004800 msgr2=0x7faa74004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:40.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.531+0000 7faa90f31640 1 --2- 172.21.15.18:0/779951885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa74004800 0x7faa74004c80 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7faa80001750 tx=0x7faa74005830 comp rx=0 tx=0).stop 2024-09-19T09:19:40.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.531+0000 7faa90f31640 1 -- 172.21.15.18:0/779951885 shutdown_connections 2024-09-19T09:19:40.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.531+0000 7faa90f31640 1 --2- 172.21.15.18:0/779951885 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa74004800 0x7faa74004c80 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.531+0000 7faa90f31640 1 -- 172.21.15.18:0/779951885 >> 172.21.15.18:0/779951885 conn(0x7faa8c0d4bd0 msgr2=0x7faa8c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:40.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.531+0000 7faa90f31640 1 -- 172.21.15.18:0/779951885 shutdown_connections 2024-09-19T09:19:40.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.531+0000 7faa90f31640 1 -- 172.21.15.18:0/779951885 wait complete. 2024-09-19T09:19:40.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.533+0000 7faa90f31640 1 Processor -- start 2024-09-19T09:19:40.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.533+0000 7faa90f31640 1 -- start start 2024-09-19T09:19:40.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.534+0000 7faa90f31640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa74004800 0x7faa8c0c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:40.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.534+0000 7faa90f31640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa8c156210 0x7faa8c160120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:40.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.534+0000 7faa90f31640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa8c160660 0x7faa8c0b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:40.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.534+0000 7faa90f31640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faa8c0d3d30 con 0x7faa74004800 2024-09-19T09:19:40.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.534+0000 7faa90f31640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faa8c0b45d0 con 0x7faa8c156210 2024-09-19T09:19:40.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.534+0000 7faa90f31640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faa8c15f130 con 0x7faa8c160660 2024-09-19T09:19:40.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.534+0000 7faa8a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa74004800 0x7faa8c0c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:40.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.534+0000 7faa8a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa74004800 0x7faa8c0c8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38228/0 (socket says 172.21.15.18:38228) 2024-09-19T09:19:40.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.534+0000 7faa8a59c640 1 -- 172.21.15.18:0/60062272 learned_addr learned my addr 172.21.15.18:0/60062272 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:40.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.534+0000 7faa89d9b640 1 --2- 172.21.15.18:0/60062272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa8c156210 0x7faa8c160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:40.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.534+0000 7faa8ad9d640 1 --2- 172.21.15.18:0/60062272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa8c160660 0x7faa8c0b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:40.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.534+0000 7faa8a59c640 1 -- 172.21.15.18:0/60062272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa8c160660 msgr2=0x7faa8c0b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:40.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.534+0000 7faa8a59c640 1 --2- 172.21.15.18:0/60062272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa8c160660 0x7faa8c0b5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.534+0000 7faa8a59c640 1 -- 172.21.15.18:0/60062272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa8c156210 msgr2=0x7faa8c160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:40.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.534+0000 7faa8a59c640 1 --2- 172.21.15.18:0/60062272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa8c156210 0x7faa8c160120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.534+0000 7faa8a59c640 1 -- 172.21.15.18:0/60062272 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa8c0c8c40 con 0x7faa74004800 2024-09-19T09:19:40.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.534+0000 7faa89d9b640 1 --2- 172.21.15.18:0/60062272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa8c156210 0x7faa8c160120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:40.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.534+0000 7faa8a59c640 1 --2- 172.21.15.18:0/60062272 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa74004800 0x7faa8c0c8700 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7faa7c0116d0 tx=0x7faa7c011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:40.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.534+0000 7faa7affd640 1 -- 172.21.15.18:0/60062272 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa7c00f960 con 0x7faa74004800 2024-09-19T09:19:40.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.534+0000 7faa7affd640 1 -- 172.21.15.18:0/60062272 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa7c00fb00 con 0x7faa74004800 2024-09-19T09:19:40.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.534+0000 7faa7affd640 1 -- 172.21.15.18:0/60062272 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa7c015460 con 0x7faa74004800 2024-09-19T09:19:40.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.534+0000 7faa90f31640 1 -- 172.21.15.18:0/60062272 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa8c0b8f10 con 0x7faa74004800 2024-09-19T09:19:40.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.534+0000 7faa90f31640 1 -- 172.21.15.18:0/60062272 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa8c0b9490 con 0x7faa74004800 2024-09-19T09:19:40.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.536+0000 7faa90f31640 1 -- 172.21.15.18:0/60062272 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa8c15e6b0 con 0x7faa74004800 2024-09-19T09:19:40.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.536+0000 7faa7affd640 1 -- 172.21.15.18:0/60062272 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7faa7c015600 con 0x7faa74004800 2024-09-19T09:19:40.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.536+0000 7faa7affd640 1 --2- 172.21.15.18:0/60062272 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faa6c06c2b0 0x7faa6c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:40.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.537+0000 7faa7affd640 1 -- 172.21.15.18:0/60062272 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5709+0+0 (secure 0 0 0) 0x7faa7c08b9a0 con 0x7faa74004800 2024-09-19T09:19:40.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.537+0000 7faa89d9b640 1 --2- 172.21.15.18:0/60062272 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faa6c06c2b0 0x7faa6c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:40.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.537+0000 7faa89d9b640 1 --2- 172.21.15.18:0/60062272 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faa6c06c2b0 0x7faa6c06e770 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7faa80032000 tx=0x7faa8002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:40.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.541+0000 7faa7affd640 1 -- 172.21.15.18:0/60062272 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7faa8c15e6b0 con 0x7faa74004800 2024-09-19T09:19:40.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.720+0000 7faa90f31640 1 -- 172.21.15.18:0/60062272 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faa8c0b5290 con 0x7faa74004800 2024-09-19T09:19:40.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.721+0000 7faa7affd640 1 -- 172.21.15.18:0/60062272 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) ==== 74+0+16769 (secure 0 0 0) 0x7faa7c019030 con 0x7faa74004800 2024-09-19T09:19:40.722 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:40.723 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":137,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:19:39.753771+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:19:38.333262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-19T09:19:38.727884+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:19:40.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.723+0000 7faa90f31640 1 -- 172.21.15.18:0/60062272 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faa6c06c2b0 msgr2=0x7faa6c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:40.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.723+0000 7faa90f31640 1 --2- 172.21.15.18:0/60062272 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faa6c06c2b0 0x7faa6c06e770 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7faa80032000 tx=0x7faa8002e000 comp rx=0 tx=0).stop 2024-09-19T09:19:40.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.723+0000 7faa90f31640 1 -- 172.21.15.18:0/60062272 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa74004800 msgr2=0x7faa8c0c8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:40.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.723+0000 7faa90f31640 1 --2- 172.21.15.18:0/60062272 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa74004800 0x7faa8c0c8700 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7faa7c0116d0 tx=0x7faa7c011b90 comp rx=0 tx=0).stop 2024-09-19T09:19:40.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.723+0000 7faa90f31640 1 -- 172.21.15.18:0/60062272 shutdown_connections 2024-09-19T09:19:40.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.723+0000 7faa90f31640 1 --2- 172.21.15.18:0/60062272 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faa6c06c2b0 0x7faa6c06e770 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.723+0000 7faa90f31640 1 --2- 172.21.15.18:0/60062272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faa8c160660 0x7faa8c0b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.723+0000 7faa90f31640 1 --2- 172.21.15.18:0/60062272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faa8c156210 0x7faa8c160120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.723+0000 7faa90f31640 1 --2- 172.21.15.18:0/60062272 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faa74004800 0x7faa8c0c8700 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.723+0000 7faa90f31640 1 -- 172.21.15.18:0/60062272 >> 172.21.15.18:0/60062272 conn(0x7faa8c0d4bd0 msgr2=0x7faa8c0b3580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:40.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.724+0000 7faa90f31640 1 -- 172.21.15.18:0/60062272 shutdown_connections 2024-09-19T09:19:40.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.724+0000 7faa90f31640 1 -- 172.21.15.18:0/60062272 wait complete. 2024-09-19T09:19:40.736 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:19:40.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.839+0000 7f28f63be640 1 Processor -- start 2024-09-19T09:19:40.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.839+0000 7f28f63be640 1 -- start start 2024-09-19T09:19:40.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.840+0000 7f28f63be640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28f015cd60 0x7f28f00d1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:40.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.840+0000 7f28f63be640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f28f00ce7b0 0x7f28f0067950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:40.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.840+0000 7f28f63be640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28f00cd710 con 0x7f28f00d10a0 2024-09-19T09:19:40.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.840+0000 7f28f63be640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f28f00b1f20 con 0x7f28f00ce7b0 2024-09-19T09:19:40.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.840+0000 7f28f63be640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f28f00cd9f0 con 0x7f28f015cd60 2024-09-19T09:19:40.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.840+0000 7f28effff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f28f00d10a0 0x7f28f00d1480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:41208/0 (socket says 172.21.15.18:41208) 2024-09-19T09:19:40.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.840+0000 7f28effff640 1 -- 172.21.15.18:0/1750810929 learned_addr learned my addr 172.21.15.18:0/1750810929 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:40.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.841+0000 7f28eeffd640 1 -- 172.21.15.18:0/1750810929 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 884140809 0 0) 0x7f28f00cd710 con 0x7f28f00d10a0 2024-09-19T09:19:40.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.841+0000 7f28eeffd640 1 -- 172.21.15.18:0/1750810929 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28d8003520 con 0x7f28f00d10a0 2024-09-19T09:19:40.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.841+0000 7f28f495b640 1 --2- 172.21.15.18:0/1750810929 >> v2:172.21.15.162:3300/0 conn(0x7f28f00ce7b0 0x7f28f0067950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:40.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.841+0000 7f28ef7fe640 1 --2- 172.21.15.18:0/1750810929 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28f015cd60 0x7f28f00d1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:40.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.841+0000 7f28eeffd640 1 -- 172.21.15.18:0/1750810929 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1291471716 0 0) 0x7f28d8003520 con 0x7f28f00d10a0 2024-09-19T09:19:40.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.841+0000 7f28eeffd640 1 -- 172.21.15.18:0/1750810929 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28f015cd60 msgr2=0x7f28f00d1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:40.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.841+0000 7f28eeffd640 1 --2- 172.21.15.18:0/1750810929 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28f015cd60 0x7f28f00d1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.841+0000 7f28eeffd640 1 -- 172.21.15.18:0/1750810929 >> v2:172.21.15.162:3300/0 conn(0x7f28f00ce7b0 msgr2=0x7f28f0067950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:40.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.841+0000 7f28eeffd640 1 --2- 172.21.15.18:0/1750810929 >> v2:172.21.15.162:3300/0 conn(0x7f28f00ce7b0 0x7f28f0067950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.841+0000 7f28eeffd640 1 -- 172.21.15.18:0/1750810929 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f00cdcd0 con 0x7f28f00d10a0 2024-09-19T09:19:40.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.841+0000 7f28eeffd640 1 -- 172.21.15.18:0/1750810929 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f28e0001670 con 0x7f28f00d10a0 2024-09-19T09:19:40.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.841+0000 7f28eeffd640 1 -- 172.21.15.18:0/1750810929 >> v1:172.21.15.18:6789/0 conn(0x7f28f00d10a0 legacy=0x7f28f00d1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:40.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.841+0000 7f28eeffd640 1 --2- 172.21.15.18:0/1750810929 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28d80039b0 0x7f28d8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:40.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.841+0000 7f28eeffd640 1 --2- 172.21.15.18:0/1750810929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28d8004800 0x7f28d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:40.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.841+0000 7f28eeffd640 1 --2- 172.21.15.18:0/1750810929 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28f015cd60 0x7f28d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:40.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.841+0000 7f28eeffd640 1 -- 172.21.15.18:0/1750810929 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f28f00b1f20 con 0x7f28d8004800 2024-09-19T09:19:40.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.841+0000 7f28eeffd640 1 -- 172.21.15.18:0/1750810929 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f28f00cd9f0 con 0x7f28d80039b0 2024-09-19T09:19:40.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.841+0000 7f28eeffd640 1 -- 172.21.15.18:0/1750810929 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f28d800b9c0 con 0x7f28f015cd60 2024-09-19T09:19:40.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.841+0000 7f28ef7fe640 1 --2- 172.21.15.18:0/1750810929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28d8004800 0x7f28d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:40.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.841+0000 7f28effff640 1 --2- 172.21.15.18:0/1750810929 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28d80039b0 0x7f28d8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:40.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.841+0000 7f28f495b640 1 --2- 172.21.15.18:0/1750810929 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28f015cd60 0x7f28d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:40.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.842+0000 7f28ef7fe640 1 -- 172.21.15.18:0/1750810929 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28f015cd60 msgr2=0x7f28d80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:40.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.842+0000 7f28ef7fe640 1 --2- 172.21.15.18:0/1750810929 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28f015cd60 0x7f28d80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.842+0000 7f28ef7fe640 1 -- 172.21.15.18:0/1750810929 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28d80039b0 msgr2=0x7f28d8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:40.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.842+0000 7f28ef7fe640 1 --2- 172.21.15.18:0/1750810929 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28d80039b0 0x7f28d8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.842+0000 7f28ef7fe640 1 -- 172.21.15.18:0/1750810929 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d8003520 con 0x7f28d8004800 2024-09-19T09:19:40.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.842+0000 7f28effff640 1 --2- 172.21.15.18:0/1750810929 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28d80039b0 0x7f28d8003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:40.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.842+0000 7f28ef7fe640 1 --2- 172.21.15.18:0/1750810929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28d8004800 0x7f28d8004c80 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f28e4009af0 tx=0x7f28d8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b3facfa1605bf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:40.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.842+0000 7f28eeffd640 1 -- 172.21.15.18:0/1750810929 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e4036070 con 0x7f28d8004800 2024-09-19T09:19:40.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.842+0000 7f28eeffd640 1 -- 172.21.15.18:0/1750810929 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28e4031400 con 0x7f28d8004800 2024-09-19T09:19:40.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.842+0000 7f28eeffd640 1 -- 172.21.15.18:0/1750810929 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e4009690 con 0x7f28d8004800 2024-09-19T09:19:40.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.843+0000 7f28f63be640 1 -- 172.21.15.18:0/1750810929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28d8004800 msgr2=0x7f28d8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:40.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.843+0000 7f28f63be640 1 --2- 172.21.15.18:0/1750810929 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28d8004800 0x7f28d8004c80 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f28e4009af0 tx=0x7f28d8005830 comp rx=0 tx=0).stop 2024-09-19T09:19:40.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.843+0000 7f28f495b640 1 -- 172.21.15.18:0/1750810929 reap_dead start 2024-09-19T09:19:40.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.843+0000 7f28f63be640 1 -- 172.21.15.18:0/1750810929 shutdown_connections 2024-09-19T09:19:40.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.843+0000 7f28f63be640 1 -- 172.21.15.18:0/1750810929 >> 172.21.15.18:0/1750810929 conn(0x7f28f00731b0 msgr2=0x7f28f00735c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:40.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.843+0000 7f28f63be640 1 -- 172.21.15.18:0/1750810929 shutdown_connections 2024-09-19T09:19:40.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.843+0000 7f28f63be640 1 -- 172.21.15.18:0/1750810929 wait complete. 2024-09-19T09:19:40.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.844+0000 7f28f63be640 1 Processor -- start 2024-09-19T09:19:40.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.844+0000 7f28f63be640 1 -- start start 2024-09-19T09:19:40.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.845+0000 7f28f63be640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28d8004800 0x7f28f015f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:40.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.845+0000 7f28f63be640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28f0154450 0x7f28f0149420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:40.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.845+0000 7f28f63be640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28f009cc00 0x7f28f00b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:40.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.845+0000 7f28f63be640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f28f0067e90 con 0x7f28f009cc00 2024-09-19T09:19:40.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.845+0000 7f28f63be640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f28f00ce290 con 0x7f28d8004800 2024-09-19T09:19:40.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.845+0000 7f28f63be640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f28f00d1d20 con 0x7f28f0154450 2024-09-19T09:19:40.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.845+0000 7f28f495b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28f009cc00 0x7f28f00b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:40.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.845+0000 7f28f495b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28f009cc00 0x7f28f00b0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38242/0 (socket says 172.21.15.18:38242) 2024-09-19T09:19:40.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.845+0000 7f28f495b640 1 -- 172.21.15.18:0/2458853503 learned_addr learned my addr 172.21.15.18:0/2458853503 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:40.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.845+0000 7f28effff640 1 --2- 172.21.15.18:0/2458853503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28d8004800 0x7f28f015f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:40.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.845+0000 7f28ef7fe640 1 --2- 172.21.15.18:0/2458853503 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28f0154450 0x7f28f0149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:40.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.846+0000 7f28f495b640 1 -- 172.21.15.18:0/2458853503 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28f0154450 msgr2=0x7f28f0149420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:40.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.846+0000 7f28f495b640 1 --2- 172.21.15.18:0/2458853503 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28f0154450 0x7f28f0149420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.846+0000 7f28f495b640 1 -- 172.21.15.18:0/2458853503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28d8004800 msgr2=0x7f28f015f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:40.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.846+0000 7f28f495b640 1 --2- 172.21.15.18:0/2458853503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28d8004800 0x7f28f015f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:40.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.846+0000 7f28f495b640 1 -- 172.21.15.18:0/2458853503 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28f015fb80 con 0x7f28f009cc00 2024-09-19T09:19:40.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.846+0000 7f28f495b640 1 --2- 172.21.15.18:0/2458853503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28f009cc00 0x7f28f00b0ed0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f28e8011c80 tx=0x7f28e800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:40.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.846+0000 7f28ecff9640 1 -- 172.21.15.18:0/2458853503 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e8019070 con 0x7f28f009cc00 2024-09-19T09:19:40.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.846+0000 7f28ecff9640 1 -- 172.21.15.18:0/2458853503 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28e8003990 con 0x7f28f009cc00 2024-09-19T09:19:40.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.846+0000 7f28f63be640 1 -- 172.21.15.18:0/2458853503 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28f015fe60 con 0x7f28f009cc00 2024-09-19T09:19:40.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.846+0000 7f28ecff9640 1 -- 172.21.15.18:0/2458853503 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e8003d60 con 0x7f28f009cc00 2024-09-19T09:19:40.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.846+0000 7f28f63be640 1 -- 172.21.15.18:0/2458853503 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28f0149960 con 0x7f28f009cc00 2024-09-19T09:19:40.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.847+0000 7f28f63be640 1 -- 172.21.15.18:0/2458853503 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28f0067950 con 0x7f28f009cc00 2024-09-19T09:19:40.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.848+0000 7f28ecff9640 1 -- 172.21.15.18:0/2458853503 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f28e801c070 con 0x7f28f009cc00 2024-09-19T09:19:40.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.848+0000 7f28ecff9640 1 --2- 172.21.15.18:0/2458853503 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f28dc06c2b0 0x7f28dc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:40.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.848+0000 7f28ecff9640 1 -- 172.21.15.18:0/2458853503 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5709+0+0 (secure 0 0 0) 0x7f28e808bdd0 con 0x7f28f009cc00 2024-09-19T09:19:40.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.848+0000 7f28effff640 1 --2- 172.21.15.18:0/2458853503 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f28dc06c2b0 0x7f28dc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:40.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.849+0000 7f28effff640 1 --2- 172.21.15.18:0/2458853503 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f28dc06c2b0 0x7f28dc06e770 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f28e0001050 tx=0x7f28e0007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:40.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:40.852+0000 7f28ecff9640 1 -- 172.21.15.18:0/2458853503 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f28e8090070 con 0x7f28f009cc00 2024-09-19T09:19:41.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.027+0000 7f28f63be640 1 -- 172.21.15.18:0/2458853503 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f28f0160030 con 0x7f28f009cc00 2024-09-19T09:19:41.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.029+0000 7f28ecff9640 1 -- 172.21.15.18:0/2458853503 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) ==== 74+0+16769 (secure 0 0 0) 0x7f28e8010040 con 0x7f28f009cc00 2024-09-19T09:19:41.029 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:41.030 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":137,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:19:39.753771+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:19:38.333262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-19T09:19:38.727884+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:19:41.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.031+0000 7f28f63be640 1 -- 172.21.15.18:0/2458853503 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f28dc06c2b0 msgr2=0x7f28dc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:41.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.031+0000 7f28f63be640 1 --2- 172.21.15.18:0/2458853503 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f28dc06c2b0 0x7f28dc06e770 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f28e0001050 tx=0x7f28e0007040 comp rx=0 tx=0).stop 2024-09-19T09:19:41.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.031+0000 7f28f63be640 1 -- 172.21.15.18:0/2458853503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28f009cc00 msgr2=0x7f28f00b0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:41.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.031+0000 7f28f63be640 1 --2- 172.21.15.18:0/2458853503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28f009cc00 0x7f28f00b0ed0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f28e8011c80 tx=0x7f28e800f580 comp rx=0 tx=0).stop 2024-09-19T09:19:41.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.031+0000 7f28f63be640 1 -- 172.21.15.18:0/2458853503 shutdown_connections 2024-09-19T09:19:41.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.031+0000 7f28f63be640 1 --2- 172.21.15.18:0/2458853503 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f28dc06c2b0 0x7f28dc06e770 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.031+0000 7f28f63be640 1 --2- 172.21.15.18:0/2458853503 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28f009cc00 0x7f28f00b0ed0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.031+0000 7f28f63be640 1 --2- 172.21.15.18:0/2458853503 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28f0154450 0x7f28f0149420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.031+0000 7f28f63be640 1 --2- 172.21.15.18:0/2458853503 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28d8004800 0x7f28f015f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.031+0000 7f28f63be640 1 -- 172.21.15.18:0/2458853503 >> 172.21.15.18:0/2458853503 conn(0x7f28f00731b0 msgr2=0x7f28f00d1480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:41.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.031+0000 7f28f63be640 1 -- 172.21.15.18:0/2458853503 shutdown_connections 2024-09-19T09:19:41.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.031+0000 7f28f63be640 1 -- 172.21.15.18:0/2458853503 wait complete. 2024-09-19T09:19:41.043 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-19T09:19:41.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.147+0000 7fb28bb13640 1 Processor -- start 2024-09-19T09:19:41.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.148+0000 7fb28bb13640 1 -- start start 2024-09-19T09:19:41.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.148+0000 7fb28bb13640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2840d56b0 0x7fb2840b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:41.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.148+0000 7fb28bb13640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2840d3700 con 0x7fb2841623c0 2024-09-19T09:19:41.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.148+0000 7fb28bb13640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2840cfa70 con 0x7fb2840d1470 2024-09-19T09:19:41.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.148+0000 7fb28bb13640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb2840d21a0 con 0x7fb2840d56b0 2024-09-19T09:19:41.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.148+0000 7fb2898af640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb2841623c0 0x7fb2840d0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:41216/0 (socket says 172.21.15.18:41216) 2024-09-19T09:19:41.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.149+0000 7fb2898af640 1 -- 172.21.15.18:0/2586564982 learned_addr learned my addr 172.21.15.18:0/2586564982 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:41.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.149+0000 7fb2890ae640 1 --2- 172.21.15.18:0/2586564982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2840d56b0 0x7fb2840b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:41.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.149+0000 7fb2888ad640 1 -- 172.21.15.18:0/2586564982 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 487249547 0 0) 0x7fb2840d3700 con 0x7fb2841623c0 2024-09-19T09:19:41.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.149+0000 7fb2888ad640 1 -- 172.21.15.18:0/2586564982 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb270003520 con 0x7fb2841623c0 2024-09-19T09:19:41.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.149+0000 7fb2888ad640 1 -- 172.21.15.18:0/2586564982 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1349864218 0 0) 0x7fb270003520 con 0x7fb2841623c0 2024-09-19T09:19:41.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.149+0000 7fb2888ad640 1 -- 172.21.15.18:0/2586564982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2840d56b0 msgr2=0x7fb2840b6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:41.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.149+0000 7fb2888ad640 1 --2- 172.21.15.18:0/2586564982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2840d56b0 0x7fb2840b6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.149+0000 7fb2888ad640 1 -- 172.21.15.18:0/2586564982 >> v1:172.21.15.162:6789/0 conn(0x7fb2840d1470 legacy=0x7fb2840b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:41.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.149+0000 7fb2888ad640 1 -- 172.21.15.18:0/2586564982 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2840d0c20 con 0x7fb2841623c0 2024-09-19T09:19:41.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.149+0000 7fb2888ad640 1 -- 172.21.15.18:0/2586564982 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fb280001670 con 0x7fb2841623c0 2024-09-19T09:19:41.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.149+0000 7fb2888ad640 1 -- 172.21.15.18:0/2586564982 >> v1:172.21.15.18:6789/0 conn(0x7fb2841623c0 legacy=0x7fb2840d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:41.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.149+0000 7fb2888ad640 1 --2- 172.21.15.18:0/2586564982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2700039e0 0x7fb270003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:41.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.149+0000 7fb2888ad640 1 --2- 172.21.15.18:0/2586564982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2840d56b0 0x7fb270004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:41.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.149+0000 7fb2888ad640 1 --2- 172.21.15.18:0/2586564982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb270004d40 0x7fb2700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:41.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.149+0000 7fb2888ad640 1 -- 172.21.15.18:0/2586564982 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb2840d21a0 con 0x7fb270004d40 2024-09-19T09:19:41.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.149+0000 7fb2888ad640 1 -- 172.21.15.18:0/2586564982 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb27000b9c0 con 0x7fb2700039e0 2024-09-19T09:19:41.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.149+0000 7fb2888ad640 1 -- 172.21.15.18:0/2586564982 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb27000bbc0 con 0x7fb2840d56b0 2024-09-19T09:19:41.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.149+0000 7fb28a0b0640 1 --2- 172.21.15.18:0/2586564982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb270004d40 0x7fb2700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:41.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.149+0000 7fb2898af640 1 --2- 172.21.15.18:0/2586564982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2700039e0 0x7fb270003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:41.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.149+0000 7fb2890ae640 1 --2- 172.21.15.18:0/2586564982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2840d56b0 0x7fb270004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:41.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.150+0000 7fb28a0b0640 1 -- 172.21.15.18:0/2586564982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2840d56b0 msgr2=0x7fb270004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:41.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.150+0000 7fb28a0b0640 1 --2- 172.21.15.18:0/2586564982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2840d56b0 0x7fb270004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.150+0000 7fb28a0b0640 1 -- 172.21.15.18:0/2586564982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2700039e0 msgr2=0x7fb270003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:41.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.150+0000 7fb28a0b0640 1 --2- 172.21.15.18:0/2586564982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2700039e0 0x7fb270003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.150+0000 7fb28a0b0640 1 -- 172.21.15.18:0/2586564982 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb270003520 con 0x7fb270004d40 2024-09-19T09:19:41.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.150+0000 7fb28a0b0640 1 --2- 172.21.15.18:0/2586564982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb270004d40 0x7fb2700051c0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fb27c001f60 tx=0x7fb270005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa1194d1a83ef4b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:41.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.151+0000 7fb2888ad640 1 -- 172.21.15.18:0/2586564982 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c001b30 con 0x7fb270004d40 2024-09-19T09:19:41.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.151+0000 7fb2888ad640 1 -- 172.21.15.18:0/2586564982 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb27c031620 con 0x7fb270004d40 2024-09-19T09:19:41.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.151+0000 7fb2888ad640 1 -- 172.21.15.18:0/2586564982 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c031a10 con 0x7fb270004d40 2024-09-19T09:19:41.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.151+0000 7fb28bb13640 1 -- 172.21.15.18:0/2586564982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb270004d40 msgr2=0x7fb2700051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:41.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.151+0000 7fb28bb13640 1 --2- 172.21.15.18:0/2586564982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb270004d40 0x7fb2700051c0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fb27c001f60 tx=0x7fb270005830 comp rx=0 tx=0).stop 2024-09-19T09:19:41.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.151+0000 7fb28a0b0640 1 -- 172.21.15.18:0/2586564982 reap_dead start 2024-09-19T09:19:41.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.151+0000 7fb28bb13640 1 -- 172.21.15.18:0/2586564982 shutdown_connections 2024-09-19T09:19:41.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.151+0000 7fb28bb13640 1 -- 172.21.15.18:0/2586564982 >> 172.21.15.18:0/2586564982 conn(0x7fb28409df30 msgr2=0x7fb2840d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:41.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.151+0000 7fb28bb13640 1 -- 172.21.15.18:0/2586564982 shutdown_connections 2024-09-19T09:19:41.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.151+0000 7fb28bb13640 1 -- 172.21.15.18:0/2586564982 wait complete. 2024-09-19T09:19:41.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.152+0000 7fb28bb13640 1 Processor -- start 2024-09-19T09:19:41.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.152+0000 7fb28bb13640 1 -- start start 2024-09-19T09:19:41.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.153+0000 7fb28bb13640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb270004d40 0x7fb2840c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:41.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.153+0000 7fb28bb13640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb28415c270 0x7fb2841531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:41.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.153+0000 7fb28bb13640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2841f4d30 0x7fb2841f51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:41.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.153+0000 7fb28bb13640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb2840cfd10 con 0x7fb28415c270 2024-09-19T09:19:41.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.153+0000 7fb28bb13640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb2840d0080 con 0x7fb2841f4d30 2024-09-19T09:19:41.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.153+0000 7fb28bb13640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb2841627a0 con 0x7fb270004d40 2024-09-19T09:19:41.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.153+0000 7fb2890ae640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb28415c270 0x7fb2841531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:41.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.153+0000 7fb2890ae640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb28415c270 0x7fb2841531b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38262/0 (socket says 172.21.15.18:38262) 2024-09-19T09:19:41.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.153+0000 7fb2890ae640 1 -- 172.21.15.18:0/2295377387 learned_addr learned my addr 172.21.15.18:0/2295377387 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:41.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.153+0000 7fb28a0b0640 1 --2- 172.21.15.18:0/2295377387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2841f4d30 0x7fb2841f51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:41.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.153+0000 7fb2898af640 1 --2- 172.21.15.18:0/2295377387 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb270004d40 0x7fb2840c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:41.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.154+0000 7fb2890ae640 1 -- 172.21.15.18:0/2295377387 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb270004d40 msgr2=0x7fb2840c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:41.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.154+0000 7fb2890ae640 1 --2- 172.21.15.18:0/2295377387 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb270004d40 0x7fb2840c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.154+0000 7fb2890ae640 1 -- 172.21.15.18:0/2295377387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2841f4d30 msgr2=0x7fb2841f51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:41.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.154+0000 7fb2890ae640 1 --2- 172.21.15.18:0/2295377387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2841f4d30 0x7fb2841f51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:41.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.154+0000 7fb2890ae640 1 -- 172.21.15.18:0/2295377387 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2840ca180 con 0x7fb28415c270 2024-09-19T09:19:41.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.154+0000 7fb28a0b0640 1 --2- 172.21.15.18:0/2295377387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2841f4d30 0x7fb2841f51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:41.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.154+0000 7fb2898af640 1 --2- 172.21.15.18:0/2295377387 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb270004d40 0x7fb2840c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:41.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.154+0000 7fb2890ae640 1 --2- 172.21.15.18:0/2295377387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb28415c270 0x7fb2841531b0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fb274011940 tx=0x7fb274011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:41.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.154+0000 7fb27a7fc640 1 -- 172.21.15.18:0/2295377387 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27400faf0 con 0x7fb28415c270 2024-09-19T09:19:41.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.154+0000 7fb27a7fc640 1 -- 172.21.15.18:0/2295377387 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb27400fc90 con 0x7fb28415c270 2024-09-19T09:19:41.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.154+0000 7fb28bb13640 1 -- 172.21.15.18:0/2295377387 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2841536f0 con 0x7fb28415c270 2024-09-19T09:19:41.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.154+0000 7fb27a7fc640 1 -- 172.21.15.18:0/2295377387 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb274014440 con 0x7fb28415c270 2024-09-19T09:19:41.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.154+0000 7fb28bb13640 1 -- 172.21.15.18:0/2295377387 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2840b94b0 con 0x7fb28415c270 2024-09-19T09:19:41.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.155+0000 7fb28bb13640 1 -- 172.21.15.18:0/2295377387 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2840c8d30 con 0x7fb28415c270 2024-09-19T09:19:41.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.155+0000 7fb27a7fc640 1 -- 172.21.15.18:0/2295377387 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb274012040 con 0x7fb28415c270 2024-09-19T09:19:41.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.156+0000 7fb27a7fc640 1 --2- 172.21.15.18:0/2295377387 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb26806c2e0 0x7fb26806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:41.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.156+0000 7fb27a7fc640 1 -- 172.21.15.18:0/2295377387 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5709+0+0 (secure 0 0 0) 0x7fb27408ba10 con 0x7fb28415c270 2024-09-19T09:19:41.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.156+0000 7fb2898af640 1 --2- 172.21.15.18:0/2295377387 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb26806c2e0 0x7fb26806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:41.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.157+0000 7fb2898af640 1 --2- 172.21.15.18:0/2295377387 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb26806c2e0 0x7fb26806e7a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb280007db0 tx=0x7fb280009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:41.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.160+0000 7fb27a7fc640 1 -- 172.21.15.18:0/2295377387 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb2840ca180 con 0x7fb28415c270 2024-09-19T09:19:41.288 INFO:tasks.ceph.mds.a.smithi018.stderr:2024-09-19T09:19:41.287+0000 7fd37efec640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T09:19:41.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:41.374+0000 7fb28bb13640 1 -- 172.21.15.18:0/2295377387 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb2840d3c80 con 0x7fb28415c270 2024-09-19T09:19:42.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.223+0000 7fb27a7fc640 1 -- 172.21.15.18:0/2295377387 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v55) ==== 118+0+0 (secure 0 0 0) 0x7fb274019030 con 0x7fb28415c270 2024-09-19T09:19:42.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.226+0000 7fb28bb13640 1 -- 172.21.15.18:0/2295377387 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb26806c2e0 msgr2=0x7fb26806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:42.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.226+0000 7fb28bb13640 1 --2- 172.21.15.18:0/2295377387 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb26806c2e0 0x7fb26806e7a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb280007db0 tx=0x7fb280009040 comp rx=0 tx=0).stop 2024-09-19T09:19:42.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.226+0000 7fb28bb13640 1 -- 172.21.15.18:0/2295377387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb28415c270 msgr2=0x7fb2841531b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:42.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.226+0000 7fb28bb13640 1 --2- 172.21.15.18:0/2295377387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb28415c270 0x7fb2841531b0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fb274011940 tx=0x7fb274011e00 comp rx=0 tx=0).stop 2024-09-19T09:19:42.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.226+0000 7fb28bb13640 1 -- 172.21.15.18:0/2295377387 shutdown_connections 2024-09-19T09:19:42.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.226+0000 7fb28bb13640 1 --2- 172.21.15.18:0/2295377387 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb26806c2e0 0x7fb26806e7a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:42.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.226+0000 7fb28bb13640 1 --2- 172.21.15.18:0/2295377387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2841f4d30 0x7fb2841f51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:42.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.226+0000 7fb28bb13640 1 --2- 172.21.15.18:0/2295377387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb28415c270 0x7fb2841531b0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:42.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.226+0000 7fb28bb13640 1 --2- 172.21.15.18:0/2295377387 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb270004d40 0x7fb2840c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:42.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.226+0000 7fb28bb13640 1 -- 172.21.15.18:0/2295377387 >> 172.21.15.18:0/2295377387 conn(0x7fb28409df30 msgr2=0x7fb2840d4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:42.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.226+0000 7fb28bb13640 1 -- 172.21.15.18:0/2295377387 shutdown_connections 2024-09-19T09:19:42.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.226+0000 7fb28bb13640 1 -- 172.21.15.18:0/2295377387 wait complete. 2024-09-19T09:19:42.240 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-19T09:19:42.241 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-19T09:19:42.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.353+0000 7f9aa5ca6640 1 Processor -- start 2024-09-19T09:19:42.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.353+0000 7f9aa5ca6640 1 -- start start 2024-09-19T09:19:42.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.354+0000 7f9aa5ca6640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9aa00b7080 0x7f9aa0071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:42.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.354+0000 7f9aa5ca6640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9aa006fef0 con 0x7f9aa00b6450 2024-09-19T09:19:42.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.354+0000 7f9aa5ca6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9aa00701a0 con 0x7f9aa0156f90 2024-09-19T09:19:42.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.354+0000 7f9aa5ca6640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9aa0070db0 con 0x7f9aa00b7080 2024-09-19T09:19:42.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.354+0000 7f9a9ffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f9aa00b6450 0x7f9aa015e1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:41228/0 (socket says 172.21.15.18:41228) 2024-09-19T09:19:42.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.354+0000 7f9a9ffff640 1 -- 172.21.15.18:0/1382808582 learned_addr learned my addr 172.21.15.18:0/1382808582 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:42.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.354+0000 7f9a9effd640 1 --2- 172.21.15.18:0/1382808582 >> v2:172.21.15.162:3300/0 conn(0x7f9aa00b7080 0x7f9aa0071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:42.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.354+0000 7f9a9e7fc640 1 -- 172.21.15.18:0/1382808582 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2791875369 0 0) 0x7f9aa006fef0 con 0x7f9aa00b6450 2024-09-19T09:19:42.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.354+0000 7f9a9e7fc640 1 -- 172.21.15.18:0/1382808582 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a88003520 con 0x7f9aa00b6450 2024-09-19T09:19:42.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.355+0000 7f9a9e7fc640 1 -- 172.21.15.18:0/1382808582 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 970053236 0 0) 0x7f9a88003520 con 0x7f9aa00b6450 2024-09-19T09:19:42.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.355+0000 7f9a9e7fc640 1 -- 172.21.15.18:0/1382808582 >> v2:172.21.15.162:3300/0 conn(0x7f9aa00b7080 msgr2=0x7f9aa0071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:42.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.355+0000 7f9a9e7fc640 1 --2- 172.21.15.18:0/1382808582 >> v2:172.21.15.162:3300/0 conn(0x7f9aa00b7080 0x7f9aa0071240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:42.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.355+0000 7f9a9e7fc640 1 -- 172.21.15.18:0/1382808582 >> v1:172.21.15.162:6789/0 conn(0x7f9aa0156f90 legacy=0x7f9aa006f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:42.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.355+0000 7f9a9e7fc640 1 -- 172.21.15.18:0/1382808582 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa0070480 con 0x7f9aa00b6450 2024-09-19T09:19:42.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.355+0000 7f9a9e7fc640 1 -- 172.21.15.18:0/1382808582 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f9a980019f0 con 0x7f9aa00b6450 2024-09-19T09:19:42.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.355+0000 7f9a9e7fc640 1 -- 172.21.15.18:0/1382808582 >> v1:172.21.15.18:6789/0 conn(0x7f9aa00b6450 legacy=0x7f9aa015e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:42.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.355+0000 7f9a9e7fc640 1 --2- 172.21.15.18:0/1382808582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a880039b0 0x7f9a88003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:42.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.355+0000 7f9a9e7fc640 1 --2- 172.21.15.18:0/1382808582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a88004800 0x7f9a88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:42.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.355+0000 7f9a9e7fc640 1 --2- 172.21.15.18:0/1382808582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a880051c0 0x7f9a8800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:42.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.355+0000 7f9a9e7fc640 1 -- 172.21.15.18:0/1382808582 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa0070db0 con 0x7f9a880039b0 2024-09-19T09:19:42.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.355+0000 7f9a9e7fc640 1 -- 172.21.15.18:0/1382808582 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8800c060 con 0x7f9a88004800 2024-09-19T09:19:42.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.355+0000 7f9a9e7fc640 1 -- 172.21.15.18:0/1382808582 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9a8800c260 con 0x7f9a880051c0 2024-09-19T09:19:42.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.355+0000 7f9a9f7fe640 1 --2- 172.21.15.18:0/1382808582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a880039b0 0x7f9a88003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:42.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.355+0000 7f9a9effd640 1 --2- 172.21.15.18:0/1382808582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a88004800 0x7f9a88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:42.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.355+0000 7f9a9ffff640 1 --2- 172.21.15.18:0/1382808582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a880051c0 0x7f9a8800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:42.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.355+0000 7f9a9f7fe640 1 -- 172.21.15.18:0/1382808582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a880051c0 msgr2=0x7f9a8800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:42.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.355+0000 7f9a9f7fe640 1 --2- 172.21.15.18:0/1382808582 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9a880051c0 0x7f9a8800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:42.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.355+0000 7f9a9f7fe640 1 -- 172.21.15.18:0/1382808582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a88004800 msgr2=0x7f9a88004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:42.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.355+0000 7f9a9f7fe640 1 --2- 172.21.15.18:0/1382808582 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a88004800 0x7f9a88004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:42.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.355+0000 7f9a9f7fe640 1 -- 172.21.15.18:0/1382808582 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a88003520 con 0x7f9a880039b0 2024-09-19T09:19:42.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.355+0000 7f9a9ffff640 1 -- 172.21.15.18:0/1382808582 reap_dead start 2024-09-19T09:19:42.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.356+0000 7f9a9f7fe640 1 --2- 172.21.15.18:0/1382808582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a880039b0 0x7f9a88003dd0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f9a90001750 tx=0x7f9a88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab78283c0d7c0d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:42.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.356+0000 7f9a9e7fc640 1 -- 172.21.15.18:0/1382808582 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a90001370 con 0x7f9a880039b0 2024-09-19T09:19:42.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.356+0000 7f9a9e7fc640 1 -- 172.21.15.18:0/1382808582 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a900052d0 con 0x7f9a880039b0 2024-09-19T09:19:42.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.356+0000 7f9a9e7fc640 1 -- 172.21.15.18:0/1382808582 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9002abe0 con 0x7f9a880039b0 2024-09-19T09:19:42.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.357+0000 7f9aa5ca6640 1 -- 172.21.15.18:0/1382808582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a880039b0 msgr2=0x7f9a88003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:42.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.357+0000 7f9aa5ca6640 1 --2- 172.21.15.18:0/1382808582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a880039b0 0x7f9a88003dd0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f9a90001750 tx=0x7f9a88005830 comp rx=0 tx=0).stop 2024-09-19T09:19:42.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.357+0000 7f9aa5ca6640 1 -- 172.21.15.18:0/1382808582 shutdown_connections 2024-09-19T09:19:42.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.357+0000 7f9aa5ca6640 1 --2- 172.21.15.18:0/1382808582 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9a880039b0 0x7f9a88003dd0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:42.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.357+0000 7f9aa5ca6640 1 -- 172.21.15.18:0/1382808582 >> 172.21.15.18:0/1382808582 conn(0x7f9aa0073c80 msgr2=0x7f9aa009b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:42.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.357+0000 7f9aa5ca6640 1 -- 172.21.15.18:0/1382808582 shutdown_connections 2024-09-19T09:19:42.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.357+0000 7f9aa5ca6640 1 -- 172.21.15.18:0/1382808582 wait complete. 2024-09-19T09:19:42.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.358+0000 7f9aa5ca6640 1 Processor -- start 2024-09-19T09:19:42.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.358+0000 7f9aa5ca6640 1 -- start start 2024-09-19T09:19:42.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.359+0000 7f9aa5ca6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a880039b0 0x7f9aa014fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:42.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.359+0000 7f9aa5ca6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9aa0159b30 0x7f9aa014e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:42.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.359+0000 7f9aa5ca6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9aa0159fb0 0x7f9aa014e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:42.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.359+0000 7f9aa5ca6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa0157370 con 0x7f9aa0159fb0 2024-09-19T09:19:42.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.359+0000 7f9aa5ca6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa0070a40 con 0x7f9a880039b0 2024-09-19T09:19:42.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.359+0000 7f9aa5ca6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9aa01574f0 con 0x7f9aa0159b30 2024-09-19T09:19:42.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.359+0000 7f9a9ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9aa0159fb0 0x7f9aa014e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:42.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.359+0000 7f9a9ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9aa0159fb0 0x7f9aa014e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38286/0 (socket says 172.21.15.18:38286) 2024-09-19T09:19:42.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.359+0000 7f9a9ffff640 1 -- 172.21.15.18:0/1293934258 learned_addr learned my addr 172.21.15.18:0/1293934258 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:42.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.359+0000 7f9a9f7fe640 1 --2- 172.21.15.18:0/1293934258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a880039b0 0x7f9aa014fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:42.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.359+0000 7f9a9effd640 1 --2- 172.21.15.18:0/1293934258 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9aa0159b30 0x7f9aa014e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:42.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.359+0000 7f9a9ffff640 1 -- 172.21.15.18:0/1293934258 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9aa0159b30 msgr2=0x7f9aa014e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:42.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.359+0000 7f9a9ffff640 1 --2- 172.21.15.18:0/1293934258 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9aa0159b30 0x7f9aa014e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:42.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.359+0000 7f9a9ffff640 1 -- 172.21.15.18:0/1293934258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a880039b0 msgr2=0x7f9aa014fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:42.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.359+0000 7f9a9ffff640 1 --2- 172.21.15.18:0/1293934258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a880039b0 0x7f9aa014fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:42.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.359+0000 7f9a9ffff640 1 -- 172.21.15.18:0/1293934258 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa014ecf0 con 0x7f9aa0159fb0 2024-09-19T09:19:42.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.359+0000 7f9a9f7fe640 1 --2- 172.21.15.18:0/1293934258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a880039b0 0x7f9aa014fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:42.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.359+0000 7f9a9ffff640 1 --2- 172.21.15.18:0/1293934258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9aa0159fb0 0x7f9aa014e6c0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f9a98000f80 tx=0x7f9a98007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:42.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.360+0000 7f9a87fff640 1 -- 172.21.15.18:0/1293934258 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9800eb00 con 0x7f9aa0159fb0 2024-09-19T09:19:42.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.360+0000 7f9a87fff640 1 -- 172.21.15.18:0/1293934258 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a98018070 con 0x7f9aa0159fb0 2024-09-19T09:19:42.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.360+0000 7f9aa5ca6640 1 -- 172.21.15.18:0/1293934258 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aa014efd0 con 0x7f9aa0159fb0 2024-09-19T09:19:42.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.360+0000 7f9a87fff640 1 -- 172.21.15.18:0/1293934258 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a98013420 con 0x7f9aa0159fb0 2024-09-19T09:19:42.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.360+0000 7f9aa5ca6640 1 -- 172.21.15.18:0/1293934258 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aa014f590 con 0x7f9aa0159fb0 2024-09-19T09:19:42.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.361+0000 7f9aa5ca6640 1 -- 172.21.15.18:0/1293934258 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9aa0071240 con 0x7f9aa0159fb0 2024-09-19T09:19:42.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.361+0000 7f9a87fff640 1 -- 172.21.15.18:0/1293934258 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9a980135c0 con 0x7f9aa0159fb0 2024-09-19T09:19:42.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.362+0000 7f9a87fff640 1 --2- 172.21.15.18:0/1293934258 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9a8c06c2b0 0x7f9a8c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:42.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.362+0000 7f9a87fff640 1 -- 172.21.15.18:0/1293934258 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7f9a9808b5f0 con 0x7f9aa0159fb0 2024-09-19T09:19:42.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.362+0000 7f9a9f7fe640 1 --2- 172.21.15.18:0/1293934258 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9a8c06c2b0 0x7f9a8c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:42.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.362+0000 7f9a9f7fe640 1 --2- 172.21.15.18:0/1293934258 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9a8c06c2b0 0x7f9a8c06e770 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9a90032000 tx=0x7f9a9002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:42.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.366+0000 7f9a87fff640 1 -- 172.21.15.18:0/1293934258 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9a98059df0 con 0x7f9aa0159fb0 2024-09-19T09:19:42.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:42.580+0000 7f9aa5ca6640 1 -- 172.21.15.18:0/1293934258 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f9aa014fa30 con 0x7f9aa0159fb0 2024-09-19T09:19:43.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.420+0000 7f9a87fff640 1 -- 172.21.15.18:0/1293934258 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v56) ==== 122+0+0 (secure 0 0 0) 0x7f9a980596f0 con 0x7f9aa0159fb0 2024-09-19T09:19:43.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.423+0000 7f9aa5ca6640 1 -- 172.21.15.18:0/1293934258 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9a8c06c2b0 msgr2=0x7f9a8c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:43.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.423+0000 7f9aa5ca6640 1 --2- 172.21.15.18:0/1293934258 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9a8c06c2b0 0x7f9a8c06e770 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9a90032000 tx=0x7f9a9002e000 comp rx=0 tx=0).stop 2024-09-19T09:19:43.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.423+0000 7f9aa5ca6640 1 -- 172.21.15.18:0/1293934258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9aa0159fb0 msgr2=0x7f9aa014e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:43.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.423+0000 7f9aa5ca6640 1 --2- 172.21.15.18:0/1293934258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9aa0159fb0 0x7f9aa014e6c0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f9a98000f80 tx=0x7f9a98007bc0 comp rx=0 tx=0).stop 2024-09-19T09:19:43.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.423+0000 7f9aa5ca6640 1 -- 172.21.15.18:0/1293934258 shutdown_connections 2024-09-19T09:19:43.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.423+0000 7f9aa5ca6640 1 --2- 172.21.15.18:0/1293934258 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9a8c06c2b0 0x7f9a8c06e770 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:43.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.423+0000 7f9aa5ca6640 1 --2- 172.21.15.18:0/1293934258 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9aa0159fb0 0x7f9aa014e6c0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:43.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.423+0000 7f9aa5ca6640 1 --2- 172.21.15.18:0/1293934258 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9aa0159b30 0x7f9aa014e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:43.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.423+0000 7f9aa5ca6640 1 --2- 172.21.15.18:0/1293934258 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9a880039b0 0x7f9aa014fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:43.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.423+0000 7f9aa5ca6640 1 -- 172.21.15.18:0/1293934258 >> 172.21.15.18:0/1293934258 conn(0x7f9aa0073c80 msgr2=0x7f9aa015f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:43.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.423+0000 7f9aa5ca6640 1 -- 172.21.15.18:0/1293934258 shutdown_connections 2024-09-19T09:19:43.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.423+0000 7f9aa5ca6640 1 -- 172.21.15.18:0/1293934258 wait complete. 2024-09-19T09:19:43.438 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-19T09:19:43.438 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:19:43.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.546+0000 7ff45c731640 1 Processor -- start 2024-09-19T09:19:43.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.546+0000 7ff45c731640 1 -- start start 2024-09-19T09:19:43.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.546+0000 7ff45c731640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff45415eea0 0x7ff45406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:43.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.547+0000 7ff45c731640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff4540ced00 0x7ff45406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:43.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.547+0000 7ff45c731640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff4540b60a0 0x7ff4540b6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:43.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.547+0000 7ff45c731640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7ff4540b6db0 con 0x7ff4540ced00 2024-09-19T09:19:43.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.547+0000 7ff45c731640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff4540b7070 con 0x7ff4540b60a0 2024-09-19T09:19:43.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.547+0000 7ff45c731640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff4540b1390 con 0x7ff45415eea0 2024-09-19T09:19:43.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.547+0000 7ff459ccc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff4540ced00 0x7ff45406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:43.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.547+0000 7ff459ccc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff4540ced00 0x7ff45406c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38292/0 (socket says 172.21.15.18:38292) 2024-09-19T09:19:43.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.547+0000 7ff459ccc640 1 -- 172.21.15.18:0/162237759 learned_addr learned my addr 172.21.15.18:0/162237759 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:43.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.547+0000 7ff45acce640 1 --2- 172.21.15.18:0/162237759 >> v2:172.21.15.162:3300/0 conn(0x7ff4540b60a0 0x7ff4540b6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:43.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.547+0000 7ff45a4cd640 1 --2- 172.21.15.18:0/162237759 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff45415eea0 0x7ff45406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:43.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.547+0000 7ff459ccc640 1 -- 172.21.15.18:0/162237759 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff45415eea0 msgr2=0x7ff45406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:43.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.547+0000 7ff459ccc640 1 --2- 172.21.15.18:0/162237759 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff45415eea0 0x7ff45406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:43.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.547+0000 7ff459ccc640 1 -- 172.21.15.18:0/162237759 >> v2:172.21.15.162:3300/0 conn(0x7ff4540b60a0 msgr2=0x7ff4540b6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:43.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.547+0000 7ff459ccc640 1 --2- 172.21.15.18:0/162237759 >> v2:172.21.15.162:3300/0 conn(0x7ff4540b60a0 0x7ff4540b6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:43.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.547+0000 7ff459ccc640 1 -- 172.21.15.18:0/162237759 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4540b1670 con 0x7ff4540ced00 2024-09-19T09:19:43.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.547+0000 7ff45a4cd640 1 --2- 172.21.15.18:0/162237759 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff45415eea0 0x7ff45406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:43.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.548+0000 7ff459ccc640 1 --2- 172.21.15.18:0/162237759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4540ced00 0x7ff45406c150 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7ff4540b7350 tx=0x7ff44802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50174cff9324591b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:43.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.548+0000 7ff4594cb640 1 -- 172.21.15.18:0/162237759 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff448037070 con 0x7ff4540ced00 2024-09-19T09:19:43.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.548+0000 7ff4594cb640 1 -- 172.21.15.18:0/162237759 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff448032440 con 0x7ff4540ced00 2024-09-19T09:19:43.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.548+0000 7ff4594cb640 1 -- 172.21.15.18:0/162237759 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff448032810 con 0x7ff4540ced00 2024-09-19T09:19:43.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.549+0000 7ff45c731640 1 -- 172.21.15.18:0/162237759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4540ced00 msgr2=0x7ff45406c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:43.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.549+0000 7ff45c731640 1 --2- 172.21.15.18:0/162237759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4540ced00 0x7ff45406c150 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7ff4540b7350 tx=0x7ff44802a1e0 comp rx=0 tx=0).stop 2024-09-19T09:19:43.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.549+0000 7ff45c731640 1 -- 172.21.15.18:0/162237759 shutdown_connections 2024-09-19T09:19:43.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.549+0000 7ff45c731640 1 --2- 172.21.15.18:0/162237759 >> v2:172.21.15.162:3300/0 conn(0x7ff4540b60a0 0x7ff4540b6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:43.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.549+0000 7ff45c731640 1 --2- 172.21.15.18:0/162237759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4540ced00 0x7ff45406c150 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:43.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.549+0000 7ff45c731640 1 --2- 172.21.15.18:0/162237759 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff45415eea0 0x7ff45406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:43.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.549+0000 7ff45c731640 1 -- 172.21.15.18:0/162237759 >> 172.21.15.18:0/162237759 conn(0x7ff4540731b0 msgr2=0x7ff4540735c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:43.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.549+0000 7ff45c731640 1 -- 172.21.15.18:0/162237759 shutdown_connections 2024-09-19T09:19:43.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.549+0000 7ff45c731640 1 -- 172.21.15.18:0/162237759 wait complete. 2024-09-19T09:19:43.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.550+0000 7ff45c731640 1 Processor -- start 2024-09-19T09:19:43.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.550+0000 7ff45c731640 1 -- start start 2024-09-19T09:19:43.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.551+0000 7ff45c731640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4540b60a0 0x7ff454161870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:43.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.551+0000 7ff45c731640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4540ced00 0x7ff4540caef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:43.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.551+0000 7ff45c731640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff45415eea0 0x7ff4540cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:43.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.551+0000 7ff45c731640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff4540b1040 con 0x7ff4540b60a0 2024-09-19T09:19:43.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.551+0000 7ff45c731640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff4540b6a90 con 0x7ff45415eea0 2024-09-19T09:19:43.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.551+0000 7ff45c731640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff4540cdb10 con 0x7ff4540ced00 2024-09-19T09:19:43.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.551+0000 7ff45a4cd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4540b60a0 0x7ff454161870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:43.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.551+0000 7ff45a4cd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4540b60a0 0x7ff454161870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38294/0 (socket says 172.21.15.18:38294) 2024-09-19T09:19:43.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.551+0000 7ff45a4cd640 1 -- 172.21.15.18:0/1396260608 learned_addr learned my addr 172.21.15.18:0/1396260608 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:43.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.551+0000 7ff459ccc640 1 --2- 172.21.15.18:0/1396260608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4540ced00 0x7ff4540caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:43.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.551+0000 7ff45acce640 1 --2- 172.21.15.18:0/1396260608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff45415eea0 0x7ff4540cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:43.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.551+0000 7ff45a4cd640 1 -- 172.21.15.18:0/1396260608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4540ced00 msgr2=0x7ff4540caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:43.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.551+0000 7ff45a4cd640 1 --2- 172.21.15.18:0/1396260608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4540ced00 0x7ff4540caef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:43.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.551+0000 7ff45a4cd640 1 -- 172.21.15.18:0/1396260608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff45415eea0 msgr2=0x7ff4540cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:43.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.551+0000 7ff45a4cd640 1 --2- 172.21.15.18:0/1396260608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff45415eea0 0x7ff4540cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:43.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.551+0000 7ff45a4cd640 1 -- 172.21.15.18:0/1396260608 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4540cbad0 con 0x7ff4540b60a0 2024-09-19T09:19:43.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.551+0000 7ff459ccc640 1 --2- 172.21.15.18:0/1396260608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4540ced00 0x7ff4540caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:43.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.551+0000 7ff45a4cd640 1 --2- 172.21.15.18:0/1396260608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4540b60a0 0x7ff454161870 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00d800 tx=0x7ff44c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:43.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.551+0000 7ff452ffd640 1 -- 172.21.15.18:0/1396260608 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c004030 con 0x7ff4540b60a0 2024-09-19T09:19:43.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.551+0000 7ff452ffd640 1 -- 172.21.15.18:0/1396260608 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff44c0041d0 con 0x7ff4540b60a0 2024-09-19T09:19:43.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.551+0000 7ff452ffd640 1 -- 172.21.15.18:0/1396260608 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff44c0096a0 con 0x7ff4540b60a0 2024-09-19T09:19:43.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.551+0000 7ff45c731640 1 -- 172.21.15.18:0/1396260608 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4540cbdb0 con 0x7ff4540b60a0 2024-09-19T09:19:43.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.552+0000 7ff45c731640 1 -- 172.21.15.18:0/1396260608 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff45415f860 con 0x7ff4540b60a0 2024-09-19T09:19:43.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.553+0000 7ff45c731640 1 -- 172.21.15.18:0/1396260608 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4540b6550 con 0x7ff4540b60a0 2024-09-19T09:19:43.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.553+0000 7ff452ffd640 1 -- 172.21.15.18:0/1396260608 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff44c009840 con 0x7ff4540b60a0 2024-09-19T09:19:43.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.554+0000 7ff452ffd640 1 --2- 172.21.15.18:0/1396260608 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff44006c2b0 0x7ff44006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:43.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.554+0000 7ff452ffd640 1 -- 172.21.15.18:0/1396260608 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7ff44c08b730 con 0x7ff4540b60a0 2024-09-19T09:19:43.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.554+0000 7ff459ccc640 1 --2- 172.21.15.18:0/1396260608 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff44006c2b0 0x7ff44006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:43.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.554+0000 7ff459ccc640 1 --2- 172.21.15.18:0/1396260608 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff44006c2b0 0x7ff44006e770 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff448034000 tx=0x7ff44802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:43.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.558+0000 7ff452ffd640 1 -- 172.21.15.18:0/1396260608 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff44c059ea0 con 0x7ff4540b60a0 2024-09-19T09:19:43.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.772+0000 7ff45c731640 1 -- 172.21.15.18:0/1396260608 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff4540ce1b0 con 0x7ff4540b60a0 2024-09-19T09:19:43.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.772+0000 7ff452ffd640 1 -- 172.21.15.18:0/1396260608 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5231 (secure 0 0 0) 0x7ff44c0597a0 con 0x7ff4540b60a0 2024-09-19T09:19:43.773 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:43.774 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":56,"btime":"2024-09-19T09:19:43:414636+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5846,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1876507362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1876507362},{"type":"v1","addr":"172.21.15.162:6837","nonce":1876507362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2245870616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2245870616},{"type":"v1","addr":"172.21.15.162:6835","nonce":2245870616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6858,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1245398837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1245398837},{"type":"v1","addr":"172.21.15.18:6834","nonce":1245398837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:19:39.754151+0000","modified":"2024-09-19T09:19:42.581316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6861":{"gid":6861,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/2894746570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2894746570},{"type":"v1","addr":"172.21.15.18:6835","nonce":2894746570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6861,"qdb_cluster":[6861]},"id":8}]} 2024-09-19T09:19:43.774 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 56 2024-09-19T09:19:43.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.775+0000 7ff45c731640 1 -- 172.21.15.18:0/1396260608 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff44006c2b0 msgr2=0x7ff44006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:43.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.775+0000 7ff45c731640 1 --2- 172.21.15.18:0/1396260608 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff44006c2b0 0x7ff44006e770 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff448034000 tx=0x7ff44802e000 comp rx=0 tx=0).stop 2024-09-19T09:19:43.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.775+0000 7ff45c731640 1 -- 172.21.15.18:0/1396260608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4540b60a0 msgr2=0x7ff454161870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:43.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.775+0000 7ff45c731640 1 --2- 172.21.15.18:0/1396260608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4540b60a0 0x7ff454161870 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7ff44c00d800 tx=0x7ff44c00dcc0 comp rx=0 tx=0).stop 2024-09-19T09:19:43.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.775+0000 7ff45c731640 1 -- 172.21.15.18:0/1396260608 shutdown_connections 2024-09-19T09:19:43.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.775+0000 7ff45c731640 1 --2- 172.21.15.18:0/1396260608 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff44006c2b0 0x7ff44006e770 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:43.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.775+0000 7ff45c731640 1 --2- 172.21.15.18:0/1396260608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff45415eea0 0x7ff4540cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:43.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.775+0000 7ff45c731640 1 --2- 172.21.15.18:0/1396260608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff4540ced00 0x7ff4540caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:43.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.775+0000 7ff45c731640 1 --2- 172.21.15.18:0/1396260608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff4540b60a0 0x7ff454161870 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:43.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.775+0000 7ff45c731640 1 -- 172.21.15.18:0/1396260608 >> 172.21.15.18:0/1396260608 conn(0x7ff4540731b0 msgr2=0x7ff4540b0150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:43.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.775+0000 7ff45c731640 1 -- 172.21.15.18:0/1396260608 shutdown_connections 2024-09-19T09:19:43.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.775+0000 7ff45c731640 1 -- 172.21.15.18:0/1396260608 wait complete. 2024-09-19T09:19:43.787 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:19:43.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.888+0000 7f9c5e523640 1 Processor -- start 2024-09-19T09:19:43.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.888+0000 7f9c5e523640 1 -- start start 2024-09-19T09:19:43.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.889+0000 7f9c5e523640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9c5815ef80 0x7f9c580b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:43.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.889+0000 7f9c5e523640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c580cfae0 0x7f9c580cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:43.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.889+0000 7f9c5e523640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c580cd1a0 con 0x7f9c5806d730 2024-09-19T09:19:43.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.889+0000 7f9c5e523640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9c580cd7d0 con 0x7f9c5815ef80 2024-09-19T09:19:43.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.889+0000 7f9c5e523640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9c5806dc30 con 0x7f9c580cfae0 2024-09-19T09:19:43.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.889+0000 7f9c577fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f9c5806d730 0x7f9c580cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:41234/0 (socket says 172.21.15.18:41234) 2024-09-19T09:19:43.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.889+0000 7f9c577fe640 1 -- 172.21.15.18:0/3141550084 learned_addr learned my addr 172.21.15.18:0/3141550084 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:43.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.890+0000 7f9c56ffd640 1 -- 172.21.15.18:0/3141550084 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 791907763 0 0) 0x7f9c580cd1a0 con 0x7f9c5806d730 2024-09-19T09:19:43.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.890+0000 7f9c56ffd640 1 -- 172.21.15.18:0/3141550084 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c40003520 con 0x7f9c5806d730 2024-09-19T09:19:43.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.890+0000 7f9c5cac0640 1 --2- 172.21.15.18:0/3141550084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c580cfae0 0x7f9c580cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:43.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.890+0000 7f9c57fff640 1 --2- 172.21.15.18:0/3141550084 >> v2:172.21.15.162:3300/0 conn(0x7f9c5815ef80 0x7f9c580b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:43.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.890+0000 7f9c56ffd640 1 -- 172.21.15.18:0/3141550084 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 220729041 0 0) 0x7f9c40003520 con 0x7f9c5806d730 2024-09-19T09:19:43.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.890+0000 7f9c56ffd640 1 -- 172.21.15.18:0/3141550084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c580cfae0 msgr2=0x7f9c580cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:43.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.890+0000 7f9c56ffd640 1 --2- 172.21.15.18:0/3141550084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c580cfae0 0x7f9c580cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:43.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.890+0000 7f9c56ffd640 1 -- 172.21.15.18:0/3141550084 >> v2:172.21.15.162:3300/0 conn(0x7f9c5815ef80 msgr2=0x7f9c580b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:43.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.890+0000 7f9c56ffd640 1 --2- 172.21.15.18:0/3141550084 >> v2:172.21.15.162:3300/0 conn(0x7f9c5815ef80 0x7f9c580b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:43.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.890+0000 7f9c56ffd640 1 -- 172.21.15.18:0/3141550084 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c5806df10 con 0x7f9c5806d730 2024-09-19T09:19:43.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.890+0000 7f9c56ffd640 1 -- 172.21.15.18:0/3141550084 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f9c4c001670 con 0x7f9c5806d730 2024-09-19T09:19:43.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.890+0000 7f9c56ffd640 1 -- 172.21.15.18:0/3141550084 >> v1:172.21.15.18:6789/0 conn(0x7f9c5806d730 legacy=0x7f9c580cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:43.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.890+0000 7f9c56ffd640 1 --2- 172.21.15.18:0/3141550084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c400039b0 0x7f9c40003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:43.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.890+0000 7f9c56ffd640 1 --2- 172.21.15.18:0/3141550084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c580cfae0 0x7f9c40004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.890+0000 7f9c56ffd640 1 --2- 172.21.15.18:0/3141550084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c40004d40 0x7f9c400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.890+0000 7f9c56ffd640 1 -- 172.21.15.18:0/3141550084 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9c580cd7d0 con 0x7f9c40004d40 2024-09-19T09:19:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.890+0000 7f9c56ffd640 1 -- 172.21.15.18:0/3141550084 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5806dc30 con 0x7f9c400039b0 2024-09-19T09:19:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.890+0000 7f9c56ffd640 1 -- 172.21.15.18:0/3141550084 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9c4000b9c0 con 0x7f9c580cfae0 2024-09-19T09:19:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.890+0000 7f9c5cac0640 1 --2- 172.21.15.18:0/3141550084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c40004d40 0x7f9c400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.890+0000 7f9c57fff640 1 --2- 172.21.15.18:0/3141550084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c400039b0 0x7f9c40003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.890+0000 7f9c577fe640 1 --2- 172.21.15.18:0/3141550084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c580cfae0 0x7f9c40004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.890+0000 7f9c5cac0640 1 -- 172.21.15.18:0/3141550084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c580cfae0 msgr2=0x7f9c40004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.890+0000 7f9c5cac0640 1 --2- 172.21.15.18:0/3141550084 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c580cfae0 0x7f9c40004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.890+0000 7f9c5cac0640 1 -- 172.21.15.18:0/3141550084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c400039b0 msgr2=0x7f9c40003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.890+0000 7f9c5cac0640 1 --2- 172.21.15.18:0/3141550084 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c400039b0 0x7f9c40003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.891+0000 7f9c5cac0640 1 -- 172.21.15.18:0/3141550084 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c40003520 con 0x7f9c40004d40 2024-09-19T09:19:43.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.891+0000 7f9c5cac0640 1 --2- 172.21.15.18:0/3141550084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c40004d40 0x7f9c400051c0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f9c50009fc0 tx=0x7f9c40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d66930ddce6d2698 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:43.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.891+0000 7f9c56ffd640 1 -- 172.21.15.18:0/3141550084 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c50009c10 con 0x7f9c40004d40 2024-09-19T09:19:43.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.891+0000 7f9c56ffd640 1 -- 172.21.15.18:0/3141550084 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c50036070 con 0x7f9c40004d40 2024-09-19T09:19:43.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.891+0000 7f9c56ffd640 1 -- 172.21.15.18:0/3141550084 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c50031670 con 0x7f9c40004d40 2024-09-19T09:19:43.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.892+0000 7f9c5e523640 1 -- 172.21.15.18:0/3141550084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c40004d40 msgr2=0x7f9c400051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:43.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.892+0000 7f9c5e523640 1 --2- 172.21.15.18:0/3141550084 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c40004d40 0x7f9c400051c0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f9c50009fc0 tx=0x7f9c40005830 comp rx=0 tx=0).stop 2024-09-19T09:19:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.892+0000 7f9c5cac0640 1 -- 172.21.15.18:0/3141550084 reap_dead start 2024-09-19T09:19:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.892+0000 7f9c5e523640 1 -- 172.21.15.18:0/3141550084 shutdown_connections 2024-09-19T09:19:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.892+0000 7f9c5e523640 1 -- 172.21.15.18:0/3141550084 >> 172.21.15.18:0/3141550084 conn(0x7f9c580b4700 msgr2=0x7f9c580b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.892+0000 7f9c5e523640 1 -- 172.21.15.18:0/3141550084 shutdown_connections 2024-09-19T09:19:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.892+0000 7f9c5e523640 1 -- 172.21.15.18:0/3141550084 wait complete. 2024-09-19T09:19:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.893+0000 7f9c5e523640 1 Processor -- start 2024-09-19T09:19:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.893+0000 7f9c5e523640 1 -- start start 2024-09-19T09:19:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.894+0000 7f9c5e523640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c40004d40 0x7f9c581622f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.894+0000 7f9c5e523640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c580b5c70 0x7f9c580c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.894+0000 7f9c5e523640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c580c9080 0x7f9c580cac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.894+0000 7f9c5e523640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9c580d0120 con 0x7f9c40004d40 2024-09-19T09:19:43.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.894+0000 7f9c5e523640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5815f360 con 0x7f9c580b5c70 2024-09-19T09:19:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.894+0000 7f9c5e523640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9c580cdc60 con 0x7f9c580c9080 2024-09-19T09:19:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.894+0000 7f9c57fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c40004d40 0x7f9c581622f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.894+0000 7f9c57fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c40004d40 0x7f9c581622f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38306/0 (socket says 172.21.15.18:38306) 2024-09-19T09:19:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.894+0000 7f9c57fff640 1 -- 172.21.15.18:0/2412518452 learned_addr learned my addr 172.21.15.18:0/2412518452 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.894+0000 7f9c577fe640 1 --2- 172.21.15.18:0/2412518452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c580b5c70 0x7f9c580c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.894+0000 7f9c5cac0640 1 --2- 172.21.15.18:0/2412518452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c580c9080 0x7f9c580cac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.895+0000 7f9c57fff640 1 -- 172.21.15.18:0/2412518452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c580c9080 msgr2=0x7f9c580cac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.895+0000 7f9c57fff640 1 --2- 172.21.15.18:0/2412518452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c580c9080 0x7f9c580cac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.895+0000 7f9c57fff640 1 -- 172.21.15.18:0/2412518452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c580b5c70 msgr2=0x7f9c580c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.895+0000 7f9c57fff640 1 --2- 172.21.15.18:0/2412518452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c580b5c70 0x7f9c580c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.895+0000 7f9c57fff640 1 -- 172.21.15.18:0/2412518452 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c580c7aa0 con 0x7f9c40004d40 2024-09-19T09:19:43.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.895+0000 7f9c5cac0640 1 --2- 172.21.15.18:0/2412518452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c580c9080 0x7f9c580cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:43.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.895+0000 7f9c57fff640 1 --2- 172.21.15.18:0/2412518452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c40004d40 0x7f9c581622f0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f9c48011960 tx=0x7f9c48011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:43.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.895+0000 7f9c54ff9640 1 -- 172.21.15.18:0/2412518452 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4800faf0 con 0x7f9c40004d40 2024-09-19T09:19:43.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.895+0000 7f9c54ff9640 1 -- 172.21.15.18:0/2412518452 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c4800fc90 con 0x7f9c40004d40 2024-09-19T09:19:43.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.895+0000 7f9c54ff9640 1 -- 172.21.15.18:0/2412518452 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c48014440 con 0x7f9c40004d40 2024-09-19T09:19:43.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.895+0000 7f9c5e523640 1 -- 172.21.15.18:0/2412518452 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c580c7d80 con 0x7f9c40004d40 2024-09-19T09:19:43.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.895+0000 7f9c5e523640 1 -- 172.21.15.18:0/2412518452 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c580c8620 con 0x7f9c40004d40 2024-09-19T09:19:43.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.896+0000 7f9c5e523640 1 -- 172.21.15.18:0/2412518452 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c5815e730 con 0x7f9c40004d40 2024-09-19T09:19:43.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.896+0000 7f9c54ff9640 1 -- 172.21.15.18:0/2412518452 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9c48012040 con 0x7f9c40004d40 2024-09-19T09:19:43.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.897+0000 7f9c54ff9640 1 --2- 172.21.15.18:0/2412518452 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9c4406c2b0 0x7f9c4406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:43.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.897+0000 7f9c54ff9640 1 -- 172.21.15.18:0/2412518452 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7f9c4808baa0 con 0x7f9c40004d40 2024-09-19T09:19:43.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.897+0000 7f9c577fe640 1 --2- 172.21.15.18:0/2412518452 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9c4406c2b0 0x7f9c4406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:43.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.898+0000 7f9c577fe640 1 --2- 172.21.15.18:0/2412518452 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9c4406c2b0 0x7f9c4406e770 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c007fd0 tx=0x7f9c4c007970 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:43.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:43.901+0000 7f9c54ff9640 1 -- 172.21.15.18:0/2412518452 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9c48019030 con 0x7f9c40004d40 2024-09-19T09:19:44.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.080+0000 7f9c5e523640 1 -- 172.21.15.18:0/2412518452 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9c580cff00 con 0x7f9c40004d40 2024-09-19T09:19:44.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.081+0000 7f9c54ff9640 1 -- 172.21.15.18:0/2412518452 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v138) ==== 74+0+16756 (secure 0 0 0) 0x7f9c4805a210 con 0x7f9c40004d40 2024-09-19T09:19:44.082 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:44.082 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":138,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:19:41.405438+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:19:38.333262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-19T09:19:38.727884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"138","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:19:44.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.083+0000 7f9c5e523640 1 -- 172.21.15.18:0/2412518452 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9c4406c2b0 msgr2=0x7f9c4406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:44.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.083+0000 7f9c5e523640 1 --2- 172.21.15.18:0/2412518452 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9c4406c2b0 0x7f9c4406e770 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c007fd0 tx=0x7f9c4c007970 comp rx=0 tx=0).stop 2024-09-19T09:19:44.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.083+0000 7f9c5e523640 1 -- 172.21.15.18:0/2412518452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c40004d40 msgr2=0x7f9c581622f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:44.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.083+0000 7f9c5e523640 1 --2- 172.21.15.18:0/2412518452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c40004d40 0x7f9c581622f0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f9c48011960 tx=0x7f9c48011e20 comp rx=0 tx=0).stop 2024-09-19T09:19:44.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.083+0000 7f9c5e523640 1 -- 172.21.15.18:0/2412518452 shutdown_connections 2024-09-19T09:19:44.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.083+0000 7f9c5e523640 1 --2- 172.21.15.18:0/2412518452 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9c4406c2b0 0x7f9c4406e770 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.083+0000 7f9c5e523640 1 --2- 172.21.15.18:0/2412518452 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9c580c9080 0x7f9c580cac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.083+0000 7f9c5e523640 1 --2- 172.21.15.18:0/2412518452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c580b5c70 0x7f9c580c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.083+0000 7f9c5e523640 1 --2- 172.21.15.18:0/2412518452 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9c40004d40 0x7f9c581622f0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.083+0000 7f9c5e523640 1 -- 172.21.15.18:0/2412518452 >> 172.21.15.18:0/2412518452 conn(0x7f9c580b4700 msgr2=0x7f9c580b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:44.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.083+0000 7f9c5e523640 1 -- 172.21.15.18:0/2412518452 shutdown_connections 2024-09-19T09:19:44.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.083+0000 7f9c5e523640 1 -- 172.21.15.18:0/2412518452 wait complete. 2024-09-19T09:19:44.095 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T09:19:44.096 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:19:44.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.199+0000 7f73d176d640 1 Processor -- start 2024-09-19T09:19:44.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.199+0000 7f73d176d640 1 -- start start 2024-09-19T09:19:44.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.200+0000 7f73d176d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f73cc15eb00 0x7f73cc1630d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:44.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.200+0000 7f73d176d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73cc06d810 0x7f73cc0b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:44.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.200+0000 7f73d176d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73cc06e730 con 0x7f73cc06ffd0 2024-09-19T09:19:44.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.200+0000 7f73d176d640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f73cc06ea10 con 0x7f73cc15eb00 2024-09-19T09:19:44.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.200+0000 7f73d176d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f73cc1628d0 con 0x7f73cc06d810 2024-09-19T09:19:44.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.200+0000 7f73caffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f73cc15eb00 0x7f73cc1630d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:44.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.200+0000 7f73caffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f73cc15eb00 0x7f73cc1630d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38308/0 (socket says 172.21.15.18:38308) 2024-09-19T09:19:44.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.200+0000 7f73caffd640 1 -- 172.21.15.18:0/4162279822 learned_addr learned my addr 172.21.15.18:0/4162279822 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:44.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.200+0000 7f73c27fc640 1 --2- 172.21.15.18:0/4162279822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73cc06d810 0x7f73cc0b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:44.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.200+0000 7f73caffd640 1 -- 172.21.15.18:0/4162279822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73cc06d810 msgr2=0x7f73cc0b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:44.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.200+0000 7f73caffd640 1 --2- 172.21.15.18:0/4162279822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73cc06d810 0x7f73cc0b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.200+0000 7f73caffd640 1 -- 172.21.15.18:0/4162279822 >> v1:172.21.15.162:6789/0 conn(0x7f73cc06ffd0 legacy=0x7f73cc0cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:44.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.200+0000 7f73caffd640 1 -- 172.21.15.18:0/4162279822 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73cc162bb0 con 0x7f73cc15eb00 2024-09-19T09:19:44.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.200+0000 7f73c27fc640 1 --2- 172.21.15.18:0/4162279822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73cc06d810 0x7f73cc0b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:44.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.201+0000 7f73caffd640 1 --2- 172.21.15.18:0/4162279822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73cc15eb00 0x7f73cc1630d0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f73bc009870 tx=0x7f73bc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd98a10a68c226e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:44.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.201+0000 7f73ca7fc640 1 -- 172.21.15.18:0/4162279822 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73bc037070 con 0x7f73cc15eb00 2024-09-19T09:19:44.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.201+0000 7f73ca7fc640 1 -- 172.21.15.18:0/4162279822 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73bc032440 con 0x7f73cc15eb00 2024-09-19T09:19:44.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.201+0000 7f73ca7fc640 1 -- 172.21.15.18:0/4162279822 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73bc032810 con 0x7f73cc15eb00 2024-09-19T09:19:44.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.202+0000 7f73d176d640 1 -- 172.21.15.18:0/4162279822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73cc15eb00 msgr2=0x7f73cc1630d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:44.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.202+0000 7f73d176d640 1 --2- 172.21.15.18:0/4162279822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73cc15eb00 0x7f73cc1630d0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f73bc009870 tx=0x7f73bc02a180 comp rx=0 tx=0).stop 2024-09-19T09:19:44.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.202+0000 7f73d176d640 1 -- 172.21.15.18:0/4162279822 shutdown_connections 2024-09-19T09:19:44.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.202+0000 7f73d176d640 1 --2- 172.21.15.18:0/4162279822 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73cc06d810 0x7f73cc0b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.202+0000 7f73d176d640 1 --2- 172.21.15.18:0/4162279822 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73cc15eb00 0x7f73cc1630d0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.202+0000 7f73d176d640 1 -- 172.21.15.18:0/4162279822 >> 172.21.15.18:0/4162279822 conn(0x7f73cc06cd20 msgr2=0x7f73cc06d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:44.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.202+0000 7f73d176d640 1 -- 172.21.15.18:0/4162279822 shutdown_connections 2024-09-19T09:19:44.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.202+0000 7f73d176d640 1 -- 172.21.15.18:0/4162279822 wait complete. 2024-09-19T09:19:44.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.203+0000 7f73d176d640 1 Processor -- start 2024-09-19T09:19:44.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.203+0000 7f73d176d640 1 -- start start 2024-09-19T09:19:44.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.204+0000 7f73d176d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73cc06d810 0x7f73cc161fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:44.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.204+0000 7f73d176d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73cc06ffd0 0x7f73cc0cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:44.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.204+0000 7f73d176d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73cc15eb00 0x7f73cc0d0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:44.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.204+0000 7f73d176d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc160070 con 0x7f73cc06ffd0 2024-09-19T09:19:44.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.204+0000 7f73d176d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f73cc15fef0 con 0x7f73cc06d810 2024-09-19T09:19:44.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.204+0000 7f73d176d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f73cc0d1460 con 0x7f73cc15eb00 2024-09-19T09:19:44.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.204+0000 7f73c27fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73cc06ffd0 0x7f73cc0cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:44.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.204+0000 7f73c27fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73cc06ffd0 0x7f73cc0cfe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38316/0 (socket says 172.21.15.18:38316) 2024-09-19T09:19:44.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.204+0000 7f73c27fc640 1 -- 172.21.15.18:0/2087969353 learned_addr learned my addr 172.21.15.18:0/2087969353 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.204+0000 7f73cb7fe640 1 --2- 172.21.15.18:0/2087969353 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73cc15eb00 0x7f73cc0d0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.204+0000 7f73caffd640 1 --2- 172.21.15.18:0/2087969353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73cc06d810 0x7f73cc161fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.204+0000 7f73c27fc640 1 -- 172.21.15.18:0/2087969353 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73cc15eb00 msgr2=0x7f73cc0d0350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.204+0000 7f73c27fc640 1 --2- 172.21.15.18:0/2087969353 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73cc15eb00 0x7f73cc0d0350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.204+0000 7f73c27fc640 1 -- 172.21.15.18:0/2087969353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73cc06d810 msgr2=0x7f73cc161fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.204+0000 7f73c27fc640 1 --2- 172.21.15.18:0/2087969353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73cc06d810 0x7f73cc161fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.204+0000 7f73c27fc640 1 -- 172.21.15.18:0/2087969353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73cc15d8e0 con 0x7f73cc06ffd0 2024-09-19T09:19:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.204+0000 7f73c27fc640 1 --2- 172.21.15.18:0/2087969353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73cc06ffd0 0x7f73cc0cfe10 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f73b400c7f0 tx=0x7f73b400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.205+0000 7f73c3fff640 1 -- 172.21.15.18:0/2087969353 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b4015070 con 0x7f73cc06ffd0 2024-09-19T09:19:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.205+0000 7f73c3fff640 1 -- 172.21.15.18:0/2087969353 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73b4007a30 con 0x7f73cc06ffd0 2024-09-19T09:19:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.205+0000 7f73d176d640 1 -- 172.21.15.18:0/2087969353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73cc15dbc0 con 0x7f73cc06ffd0 2024-09-19T09:19:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.205+0000 7f73c3fff640 1 -- 172.21.15.18:0/2087969353 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73b4007e00 con 0x7f73cc06ffd0 2024-09-19T09:19:44.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.205+0000 7f73d176d640 1 -- 172.21.15.18:0/2087969353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73cc162510 con 0x7f73cc06ffd0 2024-09-19T09:19:44.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.206+0000 7f73d176d640 1 -- 172.21.15.18:0/2087969353 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73cc1630d0 con 0x7f73cc06ffd0 2024-09-19T09:19:44.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.206+0000 7f73c3fff640 1 -- 172.21.15.18:0/2087969353 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f73b4018070 con 0x7f73cc06ffd0 2024-09-19T09:19:44.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.207+0000 7f73c3fff640 1 --2- 172.21.15.18:0/2087969353 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f73ac06c2b0 0x7f73ac06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:44.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.207+0000 7f73c3fff640 1 -- 172.21.15.18:0/2087969353 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7f73b408b470 con 0x7f73cc06ffd0 2024-09-19T09:19:44.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.207+0000 7f73caffd640 1 --2- 172.21.15.18:0/2087969353 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f73ac06c2b0 0x7f73ac06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:44.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.207+0000 7f73caffd640 1 --2- 172.21.15.18:0/2087969353 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f73ac06c2b0 0x7f73ac06e770 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f73bc034000 tx=0x7f73bc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:44.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.211+0000 7f73c3fff640 1 -- 172.21.15.18:0/2087969353 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f73b4059b50 con 0x7f73cc06ffd0 2024-09-19T09:19:44.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.383+0000 7f73d176d640 1 -- 172.21.15.18:0/2087969353 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f73cc06c8f0 con 0x7f73ac06c2b0 2024-09-19T09:19:44.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.390+0000 7f73c3fff640 1 -- 172.21.15.18:0/2087969353 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247939 (secure 0 0 0) 0x7f73cc06c8f0 con 0x7f73ac06c2b0 2024-09-19T09:19:44.393 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:44.395 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:19:44.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.392+0000 7f73d176d640 1 -- 172.21.15.18:0/2087969353 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f73ac06c2b0 msgr2=0x7f73ac06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:44.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.392+0000 7f73d176d640 1 --2- 172.21.15.18:0/2087969353 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f73ac06c2b0 0x7f73ac06e770 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f73bc034000 tx=0x7f73bc02e000 comp rx=0 tx=0).stop 2024-09-19T09:19:44.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.392+0000 7f73d176d640 1 -- 172.21.15.18:0/2087969353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73cc06ffd0 msgr2=0x7f73cc0cfe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:44.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.392+0000 7f73d176d640 1 --2- 172.21.15.18:0/2087969353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73cc06ffd0 0x7f73cc0cfe10 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f73b400c7f0 tx=0x7f73b400ccb0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.392+0000 7f73d176d640 1 -- 172.21.15.18:0/2087969353 shutdown_connections 2024-09-19T09:19:44.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.392+0000 7f73d176d640 1 --2- 172.21.15.18:0/2087969353 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f73ac06c2b0 0x7f73ac06e770 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.392+0000 7f73d176d640 1 --2- 172.21.15.18:0/2087969353 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f73cc15eb00 0x7f73cc0d0350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.392+0000 7f73d176d640 1 --2- 172.21.15.18:0/2087969353 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f73cc06ffd0 0x7f73cc0cfe10 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.392+0000 7f73d176d640 1 --2- 172.21.15.18:0/2087969353 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73cc06d810 0x7f73cc161fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.393+0000 7f73d176d640 1 -- 172.21.15.18:0/2087969353 >> 172.21.15.18:0/2087969353 conn(0x7f73cc06cd20 msgr2=0x7f73cc072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:44.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.393+0000 7f73d176d640 1 -- 172.21.15.18:0/2087969353 shutdown_connections 2024-09-19T09:19:44.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.393+0000 7f73d176d640 1 -- 172.21.15.18:0/2087969353 wait complete. 2024-09-19T09:19:44.405 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":323,"stamp":"2024-09-19T09:19:43.614776+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7082,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555417,"statfs":{"total":1600000000,"available":1592747876,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.227979"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.415206+0000","last_change":"2024-09-19T09:19:40.406254+0000","last_active":"2024-09-19T09:19:40.415206+0000","last_peered":"2024-09-19T09:19:40.415206+0000","last_clean":"2024-09-19T09:19:40.415206+0000","last_became_active":"2024-09-19T09:19:40.405537+0000","last_became_peered":"2024-09-19T09:19:40.405537+0000","last_unstale":"2024-09-19T09:19:40.415206+0000","last_undegraded":"2024-09-19T09:19:40.415206+0000","last_fullsized":"2024-09-19T09:19:40.415206+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:33.089494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.410044+0000","last_change":"2024-09-19T09:19:40.409769+0000","last_active":"2024-09-19T09:19:40.410044+0000","last_peered":"2024-09-19T09:19:40.410044+0000","last_clean":"2024-09-19T09:19:40.410044+0000","last_became_active":"2024-09-19T09:19:40.409538+0000","last_became_peered":"2024-09-19T09:19:40.409538+0000","last_unstale":"2024-09-19T09:19:40.410044+0000","last_undegraded":"2024-09-19T09:19:40.410044+0000","last_fullsized":"2024-09-19T09:19:40.410044+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:48.618610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411508+0000","last_change":"2024-09-19T09:19:40.407651+0000","last_active":"2024-09-19T09:19:41.411508+0000","last_peered":"2024-09-19T09:19:41.411508+0000","last_clean":"2024-09-19T09:19:41.411508+0000","last_became_active":"2024-09-19T09:19:40.407177+0000","last_became_peered":"2024-09-19T09:19:40.407177+0000","last_unstale":"2024-09-19T09:19:41.411508+0000","last_undegraded":"2024-09-19T09:19:41.411508+0000","last_fullsized":"2024-09-19T09:19:41.411508+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:39.273769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.411252+0000","last_change":"2024-09-19T09:19:40.409362+0000","last_active":"2024-09-19T09:19:40.411252+0000","last_peered":"2024-09-19T09:19:40.411252+0000","last_clean":"2024-09-19T09:19:40.411252+0000","last_became_active":"2024-09-19T09:19:40.408628+0000","last_became_peered":"2024-09-19T09:19:40.408628+0000","last_unstale":"2024-09-19T09:19:40.411252+0000","last_undegraded":"2024-09-19T09:19:40.411252+0000","last_fullsized":"2024-09-19T09:19:40.411252+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:09.774556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.418180+0000","last_change":"2024-09-19T09:19:40.418086+0000","last_active":"2024-09-19T09:19:40.418180+0000","last_peered":"2024-09-19T09:19:40.418180+0000","last_clean":"2024-09-19T09:19:40.418180+0000","last_became_active":"2024-09-19T09:19:40.417711+0000","last_became_peered":"2024-09-19T09:19:40.417711+0000","last_unstale":"2024-09-19T09:19:40.418180+0000","last_undegraded":"2024-09-19T09:19:40.418180+0000","last_fullsized":"2024-09-19T09:19:40.418180+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:26.284881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411554+0000","last_change":"2024-09-19T09:19:40.404115+0000","last_active":"2024-09-19T09:19:41.411554+0000","last_peered":"2024-09-19T09:19:41.411554+0000","last_clean":"2024-09-19T09:19:41.411554+0000","last_became_active":"2024-09-19T09:19:40.403549+0000","last_became_peered":"2024-09-19T09:19:40.403549+0000","last_unstale":"2024-09-19T09:19:41.411554+0000","last_undegraded":"2024-09-19T09:19:41.411554+0000","last_fullsized":"2024-09-19T09:19:41.411554+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:19.202560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.401907+0000","last_change":"2024-09-19T09:19:40.400508+0000","last_active":"2024-09-19T09:19:40.401907+0000","last_peered":"2024-09-19T09:19:40.401907+0000","last_clean":"2024-09-19T09:19:40.401907+0000","last_became_active":"2024-09-19T09:19:40.400283+0000","last_became_peered":"2024-09-19T09:19:40.400283+0000","last_unstale":"2024-09-19T09:19:40.401907+0000","last_undegraded":"2024-09-19T09:19:40.401907+0000","last_fullsized":"2024-09-19T09:19:40.401907+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:09:46.628171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.410839+0000","last_change":"2024-09-19T09:19:40.407223+0000","last_active":"2024-09-19T09:19:40.410839+0000","last_peered":"2024-09-19T09:19:40.410839+0000","last_clean":"2024-09-19T09:19:40.410839+0000","last_became_active":"2024-09-19T09:19:40.407004+0000","last_became_peered":"2024-09-19T09:19:40.407004+0000","last_unstale":"2024-09-19T09:19:40.410839+0000","last_undegraded":"2024-09-19T09:19:40.410839+0000","last_fullsized":"2024-09-19T09:19:40.410839+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:02.843603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.415250+0000","last_change":"2024-09-19T09:19:40.406515+0000","last_active":"2024-09-19T09:19:40.415250+0000","last_peered":"2024-09-19T09:19:40.415250+0000","last_clean":"2024-09-19T09:19:40.415250+0000","last_became_active":"2024-09-19T09:19:40.405008+0000","last_became_peered":"2024-09-19T09:19:40.405008+0000","last_unstale":"2024-09-19T09:19:40.415250+0000","last_undegraded":"2024-09-19T09:19:40.415250+0000","last_fullsized":"2024-09-19T09:19:40.415250+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:12.215683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.416910+0000","last_change":"2024-09-19T09:19:40.416253+0000","last_active":"2024-09-19T09:19:40.416910+0000","last_peered":"2024-09-19T09:19:40.416910+0000","last_clean":"2024-09-19T09:19:40.416910+0000","last_became_active":"2024-09-19T09:19:40.411171+0000","last_became_peered":"2024-09-19T09:19:40.411171+0000","last_unstale":"2024-09-19T09:19:40.416910+0000","last_undegraded":"2024-09-19T09:19:40.416910+0000","last_fullsized":"2024-09-19T09:19:40.416910+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:20.850272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.409225+0000","last_change":"2024-09-19T09:19:40.406612+0000","last_active":"2024-09-19T09:19:40.409225+0000","last_peered":"2024-09-19T09:19:40.409225+0000","last_clean":"2024-09-19T09:19:40.409225+0000","last_became_active":"2024-09-19T09:19:40.406102+0000","last_became_peered":"2024-09-19T09:19:40.406102+0000","last_unstale":"2024-09-19T09:19:40.409225+0000","last_undegraded":"2024-09-19T09:19:40.409225+0000","last_fullsized":"2024-09-19T09:19:40.409225+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:21.076712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.402904+0000","last_change":"2024-09-19T09:19:40.402780+0000","last_active":"2024-09-19T09:19:40.402904+0000","last_peered":"2024-09-19T09:19:40.402904+0000","last_clean":"2024-09-19T09:19:40.402904+0000","last_became_active":"2024-09-19T09:19:40.402543+0000","last_became_peered":"2024-09-19T09:19:40.402543+0000","last_unstale":"2024-09-19T09:19:40.402904+0000","last_undegraded":"2024-09-19T09:19:40.402904+0000","last_fullsized":"2024-09-19T09:19:40.402904+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:35.683954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.406459+0000","last_change":"2024-09-19T09:19:40.406355+0000","last_active":"2024-09-19T09:19:40.406459+0000","last_peered":"2024-09-19T09:19:40.406459+0000","last_clean":"2024-09-19T09:19:40.406459+0000","last_became_active":"2024-09-19T09:19:40.406138+0000","last_became_peered":"2024-09-19T09:19:40.406138+0000","last_unstale":"2024-09-19T09:19:40.406459+0000","last_undegraded":"2024-09-19T09:19:40.406459+0000","last_fullsized":"2024-09-19T09:19:40.406459+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:59:07.111206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.407108+0000","last_change":"2024-09-19T09:19:40.406971+0000","last_active":"2024-09-19T09:19:40.407108+0000","last_peered":"2024-09-19T09:19:40.407108+0000","last_clean":"2024-09-19T09:19:40.407108+0000","last_became_active":"2024-09-19T09:19:40.406227+0000","last_became_peered":"2024-09-19T09:19:40.406227+0000","last_unstale":"2024-09-19T09:19:40.407108+0000","last_undegraded":"2024-09-19T09:19:40.407108+0000","last_fullsized":"2024-09-19T09:19:40.407108+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:43.660631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.416092+0000","last_change":"2024-09-19T09:19:40.415409+0000","last_active":"2024-09-19T09:19:40.416092+0000","last_peered":"2024-09-19T09:19:40.416092+0000","last_clean":"2024-09-19T09:19:40.416092+0000","last_became_active":"2024-09-19T09:19:40.415097+0000","last_became_peered":"2024-09-19T09:19:40.415097+0000","last_unstale":"2024-09-19T09:19:40.416092+0000","last_undegraded":"2024-09-19T09:19:40.416092+0000","last_fullsized":"2024-09-19T09:19:40.416092+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:48.999186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.408793+0000","last_change":"2024-09-19T09:19:40.408684+0000","last_active":"2024-09-19T09:19:40.408793+0000","last_peered":"2024-09-19T09:19:40.408793+0000","last_clean":"2024-09-19T09:19:40.408793+0000","last_became_active":"2024-09-19T09:19:40.408478+0000","last_became_peered":"2024-09-19T09:19:40.408478+0000","last_unstale":"2024-09-19T09:19:40.408793+0000","last_undegraded":"2024-09-19T09:19:40.408793+0000","last_fullsized":"2024-09-19T09:19:40.408793+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:03.519241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411303+0000","last_change":"2024-09-19T09:19:40.403566+0000","last_active":"2024-09-19T09:19:41.411303+0000","last_peered":"2024-09-19T09:19:41.411303+0000","last_clean":"2024-09-19T09:19:41.411303+0000","last_became_active":"2024-09-19T09:19:40.403343+0000","last_became_peered":"2024-09-19T09:19:40.403343+0000","last_unstale":"2024-09-19T09:19:41.411303+0000","last_undegraded":"2024-09-19T09:19:41.411303+0000","last_fullsized":"2024-09-19T09:19:41.411303+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:18:29.898235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.405703+0000","last_change":"2024-09-19T09:19:40.405583+0000","last_active":"2024-09-19T09:19:40.405703+0000","last_peered":"2024-09-19T09:19:40.405703+0000","last_clean":"2024-09-19T09:19:40.405703+0000","last_became_active":"2024-09-19T09:19:40.405356+0000","last_became_peered":"2024-09-19T09:19:40.405356+0000","last_unstale":"2024-09-19T09:19:40.405703+0000","last_undegraded":"2024-09-19T09:19:40.405703+0000","last_fullsized":"2024-09-19T09:19:40.405703+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:35.009905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411305+0000","last_change":"2024-09-19T09:19:40.405955+0000","last_active":"2024-09-19T09:19:41.411305+0000","last_peered":"2024-09-19T09:19:41.411305+0000","last_clean":"2024-09-19T09:19:41.411305+0000","last_became_active":"2024-09-19T09:19:40.405688+0000","last_became_peered":"2024-09-19T09:19:40.405688+0000","last_unstale":"2024-09-19T09:19:41.411305+0000","last_undegraded":"2024-09-19T09:19:41.411305+0000","last_fullsized":"2024-09-19T09:19:41.411305+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:00.598244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411375+0000","last_change":"2024-09-19T09:19:40.409297+0000","last_active":"2024-09-19T09:19:41.411375+0000","last_peered":"2024-09-19T09:19:41.411375+0000","last_clean":"2024-09-19T09:19:41.411375+0000","last_became_active":"2024-09-19T09:19:40.409064+0000","last_became_peered":"2024-09-19T09:19:40.409064+0000","last_unstale":"2024-09-19T09:19:41.411375+0000","last_undegraded":"2024-09-19T09:19:41.411375+0000","last_fullsized":"2024-09-19T09:19:41.411375+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:35.896734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.410803+0000","last_change":"2024-09-19T09:19:40.409349+0000","last_active":"2024-09-19T09:19:40.410803+0000","last_peered":"2024-09-19T09:19:40.410803+0000","last_clean":"2024-09-19T09:19:40.410803+0000","last_became_active":"2024-09-19T09:19:40.406402+0000","last_became_peered":"2024-09-19T09:19:40.406402+0000","last_unstale":"2024-09-19T09:19:40.410803+0000","last_undegraded":"2024-09-19T09:19:40.410803+0000","last_fullsized":"2024-09-19T09:19:40.410803+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:18:33.075213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411776+0000","last_change":"2024-09-19T09:19:40.399232+0000","last_active":"2024-09-19T09:19:41.411776+0000","last_peered":"2024-09-19T09:19:41.411776+0000","last_clean":"2024-09-19T09:19:41.411776+0000","last_became_active":"2024-09-19T09:19:40.398971+0000","last_became_peered":"2024-09-19T09:19:40.398971+0000","last_unstale":"2024-09-19T09:19:41.411776+0000","last_undegraded":"2024-09-19T09:19:41.411776+0000","last_fullsized":"2024-09-19T09:19:41.411776+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:15.161913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.406720+0000","last_change":"2024-09-19T09:19:40.406616+0000","last_active":"2024-09-19T09:19:40.406720+0000","last_peered":"2024-09-19T09:19:40.406720+0000","last_clean":"2024-09-19T09:19:40.406720+0000","last_became_active":"2024-09-19T09:19:40.405940+0000","last_became_peered":"2024-09-19T09:19:40.405940+0000","last_unstale":"2024-09-19T09:19:40.406720+0000","last_undegraded":"2024-09-19T09:19:40.406720+0000","last_fullsized":"2024-09-19T09:19:40.406720+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:46.530944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.405033+0000","last_change":"2024-09-19T09:19:40.404246+0000","last_active":"2024-09-19T09:19:40.405033+0000","last_peered":"2024-09-19T09:19:40.405033+0000","last_clean":"2024-09-19T09:19:40.405033+0000","last_became_active":"2024-09-19T09:19:40.404019+0000","last_became_peered":"2024-09-19T09:19:40.404019+0000","last_unstale":"2024-09-19T09:19:40.405033+0000","last_undegraded":"2024-09-19T09:19:40.405033+0000","last_fullsized":"2024-09-19T09:19:40.405033+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:10.645541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.403690+0000","last_change":"2024-09-19T09:19:40.403397+0000","last_active":"2024-09-19T09:19:40.403690+0000","last_peered":"2024-09-19T09:19:40.403690+0000","last_clean":"2024-09-19T09:19:40.403690+0000","last_became_active":"2024-09-19T09:19:40.403152+0000","last_became_peered":"2024-09-19T09:19:40.403152+0000","last_unstale":"2024-09-19T09:19:40.403690+0000","last_undegraded":"2024-09-19T09:19:40.403690+0000","last_fullsized":"2024-09-19T09:19:40.403690+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:42.041432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411871+0000","last_change":"2024-09-19T09:19:40.403090+0000","last_active":"2024-09-19T09:19:41.411871+0000","last_peered":"2024-09-19T09:19:41.411871+0000","last_clean":"2024-09-19T09:19:41.411871+0000","last_became_active":"2024-09-19T09:19:40.402830+0000","last_became_peered":"2024-09-19T09:19:40.402830+0000","last_unstale":"2024-09-19T09:19:41.411871+0000","last_undegraded":"2024-09-19T09:19:41.411871+0000","last_fullsized":"2024-09-19T09:19:41.411871+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:19.808122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.408161+0000","last_change":"2024-09-19T09:19:40.407939+0000","last_active":"2024-09-19T09:19:40.408161+0000","last_peered":"2024-09-19T09:19:40.408161+0000","last_clean":"2024-09-19T09:19:40.408161+0000","last_became_active":"2024-09-19T09:19:40.407210+0000","last_became_peered":"2024-09-19T09:19:40.407210+0000","last_unstale":"2024-09-19T09:19:40.408161+0000","last_undegraded":"2024-09-19T09:19:40.408161+0000","last_fullsized":"2024-09-19T09:19:40.408161+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:46.554379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411639+0000","last_change":"2024-09-19T09:19:40.403837+0000","last_active":"2024-09-19T09:19:41.411639+0000","last_peered":"2024-09-19T09:19:41.411639+0000","last_clean":"2024-09-19T09:19:41.411639+0000","last_became_active":"2024-09-19T09:19:40.403619+0000","last_became_peered":"2024-09-19T09:19:40.403619+0000","last_unstale":"2024-09-19T09:19:41.411639+0000","last_undegraded":"2024-09-19T09:19:41.411639+0000","last_fullsized":"2024-09-19T09:19:41.411639+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:33.151082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.406882+0000","last_change":"2024-09-19T09:19:40.406772+0000","last_active":"2024-09-19T09:19:40.406882+0000","last_peered":"2024-09-19T09:19:40.406882+0000","last_clean":"2024-09-19T09:19:40.406882+0000","last_became_active":"2024-09-19T09:19:40.405882+0000","last_became_peered":"2024-09-19T09:19:40.405882+0000","last_unstale":"2024-09-19T09:19:40.406882+0000","last_undegraded":"2024-09-19T09:19:40.406882+0000","last_fullsized":"2024-09-19T09:19:40.406882+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:59.887835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.397464+0000","last_change":"2024-09-19T09:19:40.397329+0000","last_active":"2024-09-19T09:19:40.397464+0000","last_peered":"2024-09-19T09:19:40.397464+0000","last_clean":"2024-09-19T09:19:40.397464+0000","last_became_active":"2024-09-19T09:19:40.396979+0000","last_became_peered":"2024-09-19T09:19:40.396979+0000","last_unstale":"2024-09-19T09:19:40.397464+0000","last_undegraded":"2024-09-19T09:19:40.397464+0000","last_fullsized":"2024-09-19T09:19:40.397464+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:23.322233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.415155+0000","last_change":"2024-09-19T09:19:40.405870+0000","last_active":"2024-09-19T09:19:40.415155+0000","last_peered":"2024-09-19T09:19:40.415155+0000","last_clean":"2024-09-19T09:19:40.415155+0000","last_became_active":"2024-09-19T09:19:40.404847+0000","last_became_peered":"2024-09-19T09:19:40.404847+0000","last_unstale":"2024-09-19T09:19:40.415155+0000","last_undegraded":"2024-09-19T09:19:40.415155+0000","last_fullsized":"2024-09-19T09:19:40.415155+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:37.944798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.408224+0000","last_change":"2024-09-19T09:19:40.407919+0000","last_active":"2024-09-19T09:19:40.408224+0000","last_peered":"2024-09-19T09:19:40.408224+0000","last_clean":"2024-09-19T09:19:40.408224+0000","last_became_active":"2024-09-19T09:19:40.407667+0000","last_became_peered":"2024-09-19T09:19:40.407667+0000","last_unstale":"2024-09-19T09:19:40.408224+0000","last_undegraded":"2024-09-19T09:19:40.408224+0000","last_fullsized":"2024-09-19T09:19:40.408224+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:41.521422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.415228+0000","last_change":"2024-09-19T09:19:40.406329+0000","last_active":"2024-09-19T09:19:40.415228+0000","last_peered":"2024-09-19T09:19:40.415228+0000","last_clean":"2024-09-19T09:19:40.415228+0000","last_became_active":"2024-09-19T09:19:40.404179+0000","last_became_peered":"2024-09-19T09:19:40.404179+0000","last_unstale":"2024-09-19T09:19:40.415228+0000","last_undegraded":"2024-09-19T09:19:40.415228+0000","last_fullsized":"2024-09-19T09:19:40.415228+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:13.864602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"137'4","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.413273+0000","last_change":"2024-09-19T09:19:39.401007+0000","last_active":"2024-09-19T09:19:40.413273+0000","last_peered":"2024-09-19T09:19:40.413273+0000","last_clean":"2024-09-19T09:19:40.413273+0000","last_became_active":"2024-09-19T09:19:39.400689+0000","last_became_peered":"2024-09-19T09:19:39.400689+0000","last_unstale":"2024-09-19T09:19:40.413273+0000","last_undegraded":"2024-09-19T09:19:40.413273+0000","last_fullsized":"2024-09-19T09:19:40.413273+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:38:06.460788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.406500+0000","last_change":"2024-09-19T09:19:40.406357+0000","last_active":"2024-09-19T09:19:40.406500+0000","last_peered":"2024-09-19T09:19:40.406500+0000","last_clean":"2024-09-19T09:19:40.406500+0000","last_became_active":"2024-09-19T09:19:40.405546+0000","last_became_peered":"2024-09-19T09:19:40.405546+0000","last_unstale":"2024-09-19T09:19:40.406500+0000","last_undegraded":"2024-09-19T09:19:40.406500+0000","last_fullsized":"2024-09-19T09:19:40.406500+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:11:28.331947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1e","version":"137'1","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.410704+0000","last_change":"2024-09-19T09:19:39.398863+0000","last_active":"2024-09-19T09:19:40.410704+0000","last_peered":"2024-09-19T09:19:40.410704+0000","last_clean":"2024-09-19T09:19:40.410704+0000","last_became_active":"2024-09-19T09:19:39.398621+0000","last_became_peered":"2024-09-19T09:19:39.398621+0000","last_unstale":"2024-09-19T09:19:40.410704+0000","last_undegraded":"2024-09-19T09:19:40.410704+0000","last_fullsized":"2024-09-19T09:19:40.410704+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:46.743642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.412003+0000","last_change":"2024-09-19T09:19:40.404749+0000","last_active":"2024-09-19T09:19:41.412003+0000","last_peered":"2024-09-19T09:19:41.412003+0000","last_clean":"2024-09-19T09:19:41.412003+0000","last_became_active":"2024-09-19T09:19:40.404518+0000","last_became_peered":"2024-09-19T09:19:40.404518+0000","last_unstale":"2024-09-19T09:19:41.412003+0000","last_undegraded":"2024-09-19T09:19:41.412003+0000","last_fullsized":"2024-09-19T09:19:41.412003+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:30.866697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1d","version":"137'2","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.416600+0000","last_change":"2024-09-19T09:19:39.407604+0000","last_active":"2024-09-19T09:19:40.416600+0000","last_peered":"2024-09-19T09:19:40.416600+0000","last_clean":"2024-09-19T09:19:40.416600+0000","last_became_active":"2024-09-19T09:19:39.407372+0000","last_became_peered":"2024-09-19T09:19:39.407372+0000","last_unstale":"2024-09-19T09:19:40.416600+0000","last_undegraded":"2024-09-19T09:19:40.416600+0000","last_fullsized":"2024-09-19T09:19:40.416600+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:39.605595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411542+0000","last_change":"2024-09-19T09:19:40.411715+0000","last_active":"2024-09-19T09:19:41.411542+0000","last_peered":"2024-09-19T09:19:41.411542+0000","last_clean":"2024-09-19T09:19:41.411542+0000","last_became_active":"2024-09-19T09:19:40.411468+0000","last_became_peered":"2024-09-19T09:19:40.411468+0000","last_unstale":"2024-09-19T09:19:41.411542+0000","last_undegraded":"2024-09-19T09:19:41.411542+0000","last_fullsized":"2024-09-19T09:19:41.411542+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:39.147060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"137'2","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.416681+0000","last_change":"2024-09-19T09:19:39.403291+0000","last_active":"2024-09-19T09:19:40.416681+0000","last_peered":"2024-09-19T09:19:40.416681+0000","last_clean":"2024-09-19T09:19:40.416681+0000","last_became_active":"2024-09-19T09:19:39.402322+0000","last_became_peered":"2024-09-19T09:19:39.402322+0000","last_unstale":"2024-09-19T09:19:40.416681+0000","last_undegraded":"2024-09-19T09:19:40.416681+0000","last_fullsized":"2024-09-19T09:19:40.416681+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:02.375604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.416910+0000","last_change":"2024-09-19T09:19:40.416785+0000","last_active":"2024-09-19T09:19:40.416910+0000","last_peered":"2024-09-19T09:19:40.416910+0000","last_clean":"2024-09-19T09:19:40.416910+0000","last_became_active":"2024-09-19T09:19:40.416555+0000","last_became_peered":"2024-09-19T09:19:40.416555+0000","last_unstale":"2024-09-19T09:19:40.416910+0000","last_undegraded":"2024-09-19T09:19:40.416910+0000","last_fullsized":"2024-09-19T09:19:40.416910+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:18:17.095391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1b","version":"137'1","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411658+0000","last_change":"2024-09-19T09:19:39.402754+0000","last_active":"2024-09-19T09:19:41.411658+0000","last_peered":"2024-09-19T09:19:41.411658+0000","last_clean":"2024-09-19T09:19:41.411658+0000","last_became_active":"2024-09-19T09:19:39.402473+0000","last_became_peered":"2024-09-19T09:19:39.402473+0000","last_unstale":"2024-09-19T09:19:41.411658+0000","last_undegraded":"2024-09-19T09:19:41.411658+0000","last_fullsized":"2024-09-19T09:19:41.411658+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:25.414080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.410857+0000","last_change":"2024-09-19T09:19:40.407918+0000","last_active":"2024-09-19T09:19:40.410857+0000","last_peered":"2024-09-19T09:19:40.410857+0000","last_clean":"2024-09-19T09:19:40.410857+0000","last_became_active":"2024-09-19T09:19:40.407394+0000","last_became_peered":"2024-09-19T09:19:40.407394+0000","last_unstale":"2024-09-19T09:19:40.410857+0000","last_undegraded":"2024-09-19T09:19:40.410857+0000","last_fullsized":"2024-09-19T09:19:40.410857+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:12:18.713514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1a","version":"137'1","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.418647+0000","last_change":"2024-09-19T09:19:39.401836+0000","last_active":"2024-09-19T09:19:40.418647+0000","last_peered":"2024-09-19T09:19:40.418647+0000","last_clean":"2024-09-19T09:19:40.418647+0000","last_became_active":"2024-09-19T09:19:39.401047+0000","last_became_peered":"2024-09-19T09:19:39.401047+0000","last_unstale":"2024-09-19T09:19:40.418647+0000","last_undegraded":"2024-09-19T09:19:40.418647+0000","last_fullsized":"2024-09-19T09:19:40.418647+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:47.951386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.417275+0000","last_change":"2024-09-19T09:19:40.417127+0000","last_active":"2024-09-19T09:19:40.417275+0000","last_peered":"2024-09-19T09:19:40.417275+0000","last_clean":"2024-09-19T09:19:40.417275+0000","last_became_active":"2024-09-19T09:19:40.414873+0000","last_became_peered":"2024-09-19T09:19:40.414873+0000","last_unstale":"2024-09-19T09:19:40.417275+0000","last_undegraded":"2024-09-19T09:19:40.417275+0000","last_fullsized":"2024-09-19T09:19:40.417275+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:33.247281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.396530+0000","last_change":"2024-09-19T09:19:39.406046+0000","last_active":"2024-09-19T09:19:40.396530+0000","last_peered":"2024-09-19T09:19:40.396530+0000","last_clean":"2024-09-19T09:19:40.396530+0000","last_became_active":"2024-09-19T09:19:39.405899+0000","last_became_peered":"2024-09-19T09:19:39.405899+0000","last_unstale":"2024-09-19T09:19:40.396530+0000","last_undegraded":"2024-09-19T09:19:40.396530+0000","last_fullsized":"2024-09-19T09:19:40.396530+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:05.281974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.410822+0000","last_change":"2024-09-19T09:19:40.407833+0000","last_active":"2024-09-19T09:19:40.410822+0000","last_peered":"2024-09-19T09:19:40.410822+0000","last_clean":"2024-09-19T09:19:40.410822+0000","last_became_active":"2024-09-19T09:19:40.407537+0000","last_became_peered":"2024-09-19T09:19:40.407537+0000","last_unstale":"2024-09-19T09:19:40.410822+0000","last_undegraded":"2024-09-19T09:19:40.410822+0000","last_fullsized":"2024-09-19T09:19:40.410822+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:00.793684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.404856+0000","last_change":"2024-09-19T09:19:39.407949+0000","last_active":"2024-09-19T09:19:40.404856+0000","last_peered":"2024-09-19T09:19:40.404856+0000","last_clean":"2024-09-19T09:19:40.404856+0000","last_became_active":"2024-09-19T09:19:39.407225+0000","last_became_peered":"2024-09-19T09:19:39.407225+0000","last_unstale":"2024-09-19T09:19:40.404856+0000","last_undegraded":"2024-09-19T09:19:40.404856+0000","last_fullsized":"2024-09-19T09:19:40.404856+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:19.903395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.409092+0000","last_change":"2024-09-19T09:19:40.407389+0000","last_active":"2024-09-19T09:19:40.409092+0000","last_peered":"2024-09-19T09:19:40.409092+0000","last_clean":"2024-09-19T09:19:40.409092+0000","last_became_active":"2024-09-19T09:19:40.407163+0000","last_became_peered":"2024-09-19T09:19:40.407163+0000","last_unstale":"2024-09-19T09:19:40.409092+0000","last_undegraded":"2024-09-19T09:19:40.409092+0000","last_fullsized":"2024-09-19T09:19:40.409092+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:19.427319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.402559+0000","last_change":"2024-09-19T09:19:39.402931+0000","last_active":"2024-09-19T09:19:40.402559+0000","last_peered":"2024-09-19T09:19:40.402559+0000","last_clean":"2024-09-19T09:19:40.402559+0000","last_became_active":"2024-09-19T09:19:39.401132+0000","last_became_peered":"2024-09-19T09:19:39.401132+0000","last_unstale":"2024-09-19T09:19:40.402559+0000","last_undegraded":"2024-09-19T09:19:40.402559+0000","last_fullsized":"2024-09-19T09:19:40.402559+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:39.623104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.405387+0000","last_change":"2024-09-19T09:19:40.405272+0000","last_active":"2024-09-19T09:19:40.405387+0000","last_peered":"2024-09-19T09:19:40.405387+0000","last_clean":"2024-09-19T09:19:40.405387+0000","last_became_active":"2024-09-19T09:19:40.404948+0000","last_became_peered":"2024-09-19T09:19:40.404948+0000","last_unstale":"2024-09-19T09:19:40.405387+0000","last_undegraded":"2024-09-19T09:19:40.405387+0000","last_fullsized":"2024-09-19T09:19:40.405387+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:06.009040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.401204+0000","last_change":"2024-09-19T09:19:39.402177+0000","last_active":"2024-09-19T09:19:40.401204+0000","last_peered":"2024-09-19T09:19:40.401204+0000","last_clean":"2024-09-19T09:19:40.401204+0000","last_became_active":"2024-09-19T09:19:39.401937+0000","last_became_peered":"2024-09-19T09:19:39.401937+0000","last_unstale":"2024-09-19T09:19:40.401204+0000","last_undegraded":"2024-09-19T09:19:40.401204+0000","last_fullsized":"2024-09-19T09:19:40.401204+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:17.440804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411478+0000","last_change":"2024-09-19T09:19:40.403529+0000","last_active":"2024-09-19T09:19:41.411478+0000","last_peered":"2024-09-19T09:19:41.411478+0000","last_clean":"2024-09-19T09:19:41.411478+0000","last_became_active":"2024-09-19T09:19:40.403244+0000","last_became_peered":"2024-09-19T09:19:40.403244+0000","last_unstale":"2024-09-19T09:19:41.411478+0000","last_undegraded":"2024-09-19T09:19:41.411478+0000","last_fullsized":"2024-09-19T09:19:41.411478+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:56.547141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"137'3","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.415927+0000","last_change":"2024-09-19T09:19:39.403973+0000","last_active":"2024-09-19T09:19:40.415927+0000","last_peered":"2024-09-19T09:19:40.415927+0000","last_clean":"2024-09-19T09:19:40.415927+0000","last_became_active":"2024-09-19T09:19:39.403404+0000","last_became_peered":"2024-09-19T09:19:39.403404+0000","last_unstale":"2024-09-19T09:19:40.415927+0000","last_undegraded":"2024-09-19T09:19:40.415927+0000","last_fullsized":"2024-09-19T09:19:40.415927+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:06.118943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.403105+0000","last_change":"2024-09-19T09:19:40.402963+0000","last_active":"2024-09-19T09:19:40.403105+0000","last_peered":"2024-09-19T09:19:40.403105+0000","last_clean":"2024-09-19T09:19:40.403105+0000","last_became_active":"2024-09-19T09:19:40.402729+0000","last_became_peered":"2024-09-19T09:19:40.402729+0000","last_unstale":"2024-09-19T09:19:40.403105+0000","last_undegraded":"2024-09-19T09:19:40.403105+0000","last_fullsized":"2024-09-19T09:19:40.403105+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:59.868189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"137'6","reported_seq":18,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.417710+0000","last_change":"2024-09-19T09:19:39.400164+0000","last_active":"2024-09-19T09:19:40.417710+0000","last_peered":"2024-09-19T09:19:40.417710+0000","last_clean":"2024-09-19T09:19:40.417710+0000","last_became_active":"2024-09-19T09:19:39.399929+0000","last_became_peered":"2024-09-19T09:19:39.399929+0000","last_unstale":"2024-09-19T09:19:40.417710+0000","last_undegraded":"2024-09-19T09:19:40.417710+0000","last_fullsized":"2024-09-19T09:19:40.417710+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:53.729475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.408241+0000","last_change":"2024-09-19T09:19:40.408121+0000","last_active":"2024-09-19T09:19:40.408241+0000","last_peered":"2024-09-19T09:19:40.408241+0000","last_clean":"2024-09-19T09:19:40.408241+0000","last_became_active":"2024-09-19T09:19:40.407906+0000","last_became_peered":"2024-09-19T09:19:40.407906+0000","last_unstale":"2024-09-19T09:19:40.408241+0000","last_undegraded":"2024-09-19T09:19:40.408241+0000","last_fullsized":"2024-09-19T09:19:40.408241+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:29.462966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"137'2","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.419690+0000","last_change":"2024-09-19T09:19:39.407447+0000","last_active":"2024-09-19T09:19:40.419690+0000","last_peered":"2024-09-19T09:19:40.419690+0000","last_clean":"2024-09-19T09:19:40.419690+0000","last_became_active":"2024-09-19T09:19:39.406590+0000","last_became_peered":"2024-09-19T09:19:39.406590+0000","last_unstale":"2024-09-19T09:19:40.419690+0000","last_undegraded":"2024-09-19T09:19:40.419690+0000","last_fullsized":"2024-09-19T09:19:40.419690+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:02.421133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.411120+0000","last_change":"2024-09-19T09:19:40.409247+0000","last_active":"2024-09-19T09:19:40.411120+0000","last_peered":"2024-09-19T09:19:40.411120+0000","last_clean":"2024-09-19T09:19:40.411120+0000","last_became_active":"2024-09-19T09:19:40.408825+0000","last_became_peered":"2024-09-19T09:19:40.408825+0000","last_unstale":"2024-09-19T09:19:40.411120+0000","last_undegraded":"2024-09-19T09:19:40.411120+0000","last_fullsized":"2024-09-19T09:19:40.411120+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:42.944326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411471+0000","last_change":"2024-09-19T09:19:39.400997+0000","last_active":"2024-09-19T09:19:41.411471+0000","last_peered":"2024-09-19T09:19:41.411471+0000","last_clean":"2024-09-19T09:19:41.411471+0000","last_became_active":"2024-09-19T09:19:39.400734+0000","last_became_peered":"2024-09-19T09:19:39.400734+0000","last_unstale":"2024-09-19T09:19:41.411471+0000","last_undegraded":"2024-09-19T09:19:41.411471+0000","last_fullsized":"2024-09-19T09:19:41.411471+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:59:36.942221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.411161+0000","last_change":"2024-09-19T09:19:40.410165+0000","last_active":"2024-09-19T09:19:40.411161+0000","last_peered":"2024-09-19T09:19:40.411161+0000","last_clean":"2024-09-19T09:19:40.411161+0000","last_became_active":"2024-09-19T09:19:40.409770+0000","last_became_peered":"2024-09-19T09:19:40.409770+0000","last_unstale":"2024-09-19T09:19:40.411161+0000","last_undegraded":"2024-09-19T09:19:40.411161+0000","last_fullsized":"2024-09-19T09:19:40.411161+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:20.731439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"137'8","reported_seq":20,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.418368+0000","last_change":"2024-09-19T09:19:39.405159+0000","last_active":"2024-09-19T09:19:40.418368+0000","last_peered":"2024-09-19T09:19:40.418368+0000","last_clean":"2024-09-19T09:19:40.418368+0000","last_became_active":"2024-09-19T09:19:39.404890+0000","last_became_peered":"2024-09-19T09:19:39.404890+0000","last_unstale":"2024-09-19T09:19:40.418368+0000","last_undegraded":"2024-09-19T09:19:40.418368+0000","last_fullsized":"2024-09-19T09:19:40.418368+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:29.966852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.405471+0000","last_change":"2024-09-19T09:19:40.405261+0000","last_active":"2024-09-19T09:19:40.405471+0000","last_peered":"2024-09-19T09:19:40.405471+0000","last_clean":"2024-09-19T09:19:40.405471+0000","last_became_active":"2024-09-19T09:19:40.404997+0000","last_became_peered":"2024-09-19T09:19:40.404997+0000","last_unstale":"2024-09-19T09:19:40.405471+0000","last_undegraded":"2024-09-19T09:19:40.405471+0000","last_fullsized":"2024-09-19T09:19:40.405471+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:10.593080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.f","version":"137'1","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411598+0000","last_change":"2024-09-19T09:19:39.398376+0000","last_active":"2024-09-19T09:19:41.411598+0000","last_peered":"2024-09-19T09:19:41.411598+0000","last_clean":"2024-09-19T09:19:41.411598+0000","last_became_active":"2024-09-19T09:19:39.397709+0000","last_became_peered":"2024-09-19T09:19:39.397709+0000","last_unstale":"2024-09-19T09:19:41.411598+0000","last_undegraded":"2024-09-19T09:19:41.411598+0000","last_fullsized":"2024-09-19T09:19:41.411598+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:40.992955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.415182+0000","last_change":"2024-09-19T09:19:40.405998+0000","last_active":"2024-09-19T09:19:40.415182+0000","last_peered":"2024-09-19T09:19:40.415182+0000","last_clean":"2024-09-19T09:19:40.415182+0000","last_became_active":"2024-09-19T09:19:40.403824+0000","last_became_peered":"2024-09-19T09:19:40.403824+0000","last_unstale":"2024-09-19T09:19:40.415182+0000","last_undegraded":"2024-09-19T09:19:40.415182+0000","last_fullsized":"2024-09-19T09:19:40.415182+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:56:38.970912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"137'2","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.419152+0000","last_change":"2024-09-19T09:19:39.407665+0000","last_active":"2024-09-19T09:19:40.419152+0000","last_peered":"2024-09-19T09:19:40.419152+0000","last_clean":"2024-09-19T09:19:40.419152+0000","last_became_active":"2024-09-19T09:19:39.406935+0000","last_became_peered":"2024-09-19T09:19:39.406935+0000","last_unstale":"2024-09-19T09:19:40.419152+0000","last_undegraded":"2024-09-19T09:19:40.419152+0000","last_fullsized":"2024-09-19T09:19:40.419152+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:51.964094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.410882+0000","last_change":"2024-09-19T09:19:40.410401+0000","last_active":"2024-09-19T09:19:40.410882+0000","last_peered":"2024-09-19T09:19:40.410882+0000","last_clean":"2024-09-19T09:19:40.410882+0000","last_became_active":"2024-09-19T09:19:40.407694+0000","last_became_peered":"2024-09-19T09:19:40.407694+0000","last_unstale":"2024-09-19T09:19:40.410882+0000","last_undegraded":"2024-09-19T09:19:40.410882+0000","last_fullsized":"2024-09-19T09:19:40.410882+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:39.416117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.d","version":"137'1","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.412559+0000","last_change":"2024-09-19T09:19:39.399404+0000","last_active":"2024-09-19T09:19:40.412559+0000","last_peered":"2024-09-19T09:19:40.412559+0000","last_clean":"2024-09-19T09:19:40.412559+0000","last_became_active":"2024-09-19T09:19:39.399173+0000","last_became_peered":"2024-09-19T09:19:39.399173+0000","last_unstale":"2024-09-19T09:19:40.412559+0000","last_undegraded":"2024-09-19T09:19:40.412559+0000","last_fullsized":"2024-09-19T09:19:40.412559+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:41.067666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.404572+0000","last_change":"2024-09-19T09:19:40.404347+0000","last_active":"2024-09-19T09:19:40.404572+0000","last_peered":"2024-09-19T09:19:40.404572+0000","last_clean":"2024-09-19T09:19:40.404572+0000","last_became_active":"2024-09-19T09:19:40.403732+0000","last_became_peered":"2024-09-19T09:19:40.403732+0000","last_unstale":"2024-09-19T09:19:40.404572+0000","last_undegraded":"2024-09-19T09:19:40.404572+0000","last_fullsized":"2024-09-19T09:19:40.404572+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:33.180784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.399306+0000","last_change":"2024-09-19T09:19:39.401291+0000","last_active":"2024-09-19T09:19:40.399306+0000","last_peered":"2024-09-19T09:19:40.399306+0000","last_clean":"2024-09-19T09:19:40.399306+0000","last_became_active":"2024-09-19T09:19:39.401068+0000","last_became_peered":"2024-09-19T09:19:39.401068+0000","last_unstale":"2024-09-19T09:19:40.399306+0000","last_undegraded":"2024-09-19T09:19:40.399306+0000","last_fullsized":"2024-09-19T09:19:40.399306+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:02:22.571662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411532+0000","last_change":"2024-09-19T09:19:40.409325+0000","last_active":"2024-09-19T09:19:41.411532+0000","last_peered":"2024-09-19T09:19:41.411532+0000","last_clean":"2024-09-19T09:19:41.411532+0000","last_became_active":"2024-09-19T09:19:40.408589+0000","last_became_peered":"2024-09-19T09:19:40.408589+0000","last_unstale":"2024-09-19T09:19:41.411532+0000","last_undegraded":"2024-09-19T09:19:41.411532+0000","last_fullsized":"2024-09-19T09:19:41.411532+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:18.037908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.b","version":"137'2","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.416024+0000","last_change":"2024-09-19T09:19:39.404244+0000","last_active":"2024-09-19T09:19:40.416024+0000","last_peered":"2024-09-19T09:19:40.416024+0000","last_clean":"2024-09-19T09:19:40.416024+0000","last_became_active":"2024-09-19T09:19:39.403736+0000","last_became_peered":"2024-09-19T09:19:39.403736+0000","last_unstale":"2024-09-19T09:19:40.416024+0000","last_undegraded":"2024-09-19T09:19:40.416024+0000","last_fullsized":"2024-09-19T09:19:40.416024+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:53.214718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.415299+0000","last_change":"2024-09-19T09:19:40.408714+0000","last_active":"2024-09-19T09:19:40.415299+0000","last_peered":"2024-09-19T09:19:40.415299+0000","last_clean":"2024-09-19T09:19:40.415299+0000","last_became_active":"2024-09-19T09:19:40.408188+0000","last_became_peered":"2024-09-19T09:19:40.408188+0000","last_unstale":"2024-09-19T09:19:40.415299+0000","last_undegraded":"2024-09-19T09:19:40.415299+0000","last_fullsized":"2024-09-19T09:19:40.415299+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:45.346049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.399802+0000","last_change":"2024-09-19T09:19:39.401076+0000","last_active":"2024-09-19T09:19:40.399802+0000","last_peered":"2024-09-19T09:19:40.399802+0000","last_clean":"2024-09-19T09:19:40.399802+0000","last_became_active":"2024-09-19T09:19:39.400829+0000","last_became_peered":"2024-09-19T09:19:39.400829+0000","last_unstale":"2024-09-19T09:19:40.399802+0000","last_undegraded":"2024-09-19T09:19:40.399802+0000","last_fullsized":"2024-09-19T09:19:40.399802+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:17.587700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.404190+0000","last_change":"2024-09-19T09:19:40.404068+0000","last_active":"2024-09-19T09:19:40.404190+0000","last_peered":"2024-09-19T09:19:40.404190+0000","last_clean":"2024-09-19T09:19:40.404190+0000","last_became_active":"2024-09-19T09:19:40.403308+0000","last_became_peered":"2024-09-19T09:19:40.403308+0000","last_unstale":"2024-09-19T09:19:40.404190+0000","last_undegraded":"2024-09-19T09:19:40.404190+0000","last_fullsized":"2024-09-19T09:19:40.404190+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:50.763368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.401772+0000","last_change":"2024-09-19T09:19:39.403144+0000","last_active":"2024-09-19T09:19:40.401772+0000","last_peered":"2024-09-19T09:19:40.401772+0000","last_clean":"2024-09-19T09:19:40.401772+0000","last_became_active":"2024-09-19T09:19:39.402745+0000","last_became_peered":"2024-09-19T09:19:39.402745+0000","last_unstale":"2024-09-19T09:19:40.401772+0000","last_undegraded":"2024-09-19T09:19:40.401772+0000","last_fullsized":"2024-09-19T09:19:40.401772+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:17.657680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.417501+0000","last_change":"2024-09-19T09:19:40.417355+0000","last_active":"2024-09-19T09:19:40.417501+0000","last_peered":"2024-09-19T09:19:40.417501+0000","last_clean":"2024-09-19T09:19:40.417501+0000","last_became_active":"2024-09-19T09:19:40.415180+0000","last_became_peered":"2024-09-19T09:19:40.415180+0000","last_unstale":"2024-09-19T09:19:40.417501+0000","last_undegraded":"2024-09-19T09:19:40.417501+0000","last_fullsized":"2024-09-19T09:19:40.417501+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:24.353197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.402697+0000","last_change":"2024-09-19T09:19:39.403554+0000","last_active":"2024-09-19T09:19:40.402697+0000","last_peered":"2024-09-19T09:19:40.402697+0000","last_clean":"2024-09-19T09:19:40.402697+0000","last_became_active":"2024-09-19T09:19:39.402630+0000","last_became_peered":"2024-09-19T09:19:39.402630+0000","last_unstale":"2024-09-19T09:19:40.402697+0000","last_undegraded":"2024-09-19T09:19:40.402697+0000","last_fullsized":"2024-09-19T09:19:40.402697+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:54.615978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.404168+0000","last_change":"2024-09-19T09:19:40.404055+0000","last_active":"2024-09-19T09:19:40.404168+0000","last_peered":"2024-09-19T09:19:40.404168+0000","last_clean":"2024-09-19T09:19:40.404168+0000","last_became_active":"2024-09-19T09:19:40.403806+0000","last_became_peered":"2024-09-19T09:19:40.403806+0000","last_unstale":"2024-09-19T09:19:40.404168+0000","last_undegraded":"2024-09-19T09:19:40.404168+0000","last_fullsized":"2024-09-19T09:19:40.404168+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:44.206233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"137'2","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.412861+0000","last_change":"2024-09-19T09:19:39.402175+0000","last_active":"2024-09-19T09:19:40.412861+0000","last_peered":"2024-09-19T09:19:40.412861+0000","last_clean":"2024-09-19T09:19:40.412861+0000","last_became_active":"2024-09-19T09:19:39.401099+0000","last_became_peered":"2024-09-19T09:19:39.401099+0000","last_unstale":"2024-09-19T09:19:40.412861+0000","last_undegraded":"2024-09-19T09:19:40.412861+0000","last_fullsized":"2024-09-19T09:19:40.412861+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:11.144782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411939+0000","last_change":"2024-09-19T09:19:40.410361+0000","last_active":"2024-09-19T09:19:41.411939+0000","last_peered":"2024-09-19T09:19:41.411939+0000","last_clean":"2024-09-19T09:19:41.411939+0000","last_became_active":"2024-09-19T09:19:40.410116+0000","last_became_peered":"2024-09-19T09:19:40.410116+0000","last_unstale":"2024-09-19T09:19:41.411939+0000","last_undegraded":"2024-09-19T09:19:41.411939+0000","last_fullsized":"2024-09-19T09:19:41.411939+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:52.592714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"137'1","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.400394+0000","last_change":"2024-09-19T09:19:39.405036+0000","last_active":"2024-09-19T09:19:41.400394+0000","last_peered":"2024-09-19T09:19:41.400394+0000","last_clean":"2024-09-19T09:19:41.400394+0000","last_became_active":"2024-09-19T09:19:39.404770+0000","last_became_peered":"2024-09-19T09:19:39.404770+0000","last_unstale":"2024-09-19T09:19:41.400394+0000","last_undegraded":"2024-09-19T09:19:41.400394+0000","last_fullsized":"2024-09-19T09:19:41.400394+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:42.225366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.415281+0000","last_change":"2024-09-19T09:19:40.406878+0000","last_active":"2024-09-19T09:19:40.415281+0000","last_peered":"2024-09-19T09:19:40.415281+0000","last_clean":"2024-09-19T09:19:40.415281+0000","last_became_active":"2024-09-19T09:19:40.406602+0000","last_became_peered":"2024-09-19T09:19:40.406602+0000","last_unstale":"2024-09-19T09:19:40.415281+0000","last_undegraded":"2024-09-19T09:19:40.415281+0000","last_fullsized":"2024-09-19T09:19:40.415281+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:41:07.463625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.399488+0000","last_change":"2024-09-19T09:19:39.401114+0000","last_active":"2024-09-19T09:19:40.399488+0000","last_peered":"2024-09-19T09:19:40.399488+0000","last_clean":"2024-09-19T09:19:40.399488+0000","last_became_active":"2024-09-19T09:19:39.400872+0000","last_became_peered":"2024-09-19T09:19:39.400872+0000","last_unstale":"2024-09-19T09:19:40.399488+0000","last_undegraded":"2024-09-19T09:19:40.399488+0000","last_fullsized":"2024-09-19T09:19:40.399488+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:35.510193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.407276+0000","last_change":"2024-09-19T09:19:40.407163+0000","last_active":"2024-09-19T09:19:40.407276+0000","last_peered":"2024-09-19T09:19:40.407276+0000","last_clean":"2024-09-19T09:19:40.407276+0000","last_became_active":"2024-09-19T09:19:40.406532+0000","last_became_peered":"2024-09-19T09:19:40.406532+0000","last_unstale":"2024-09-19T09:19:40.407276+0000","last_undegraded":"2024-09-19T09:19:40.407276+0000","last_fullsized":"2024-09-19T09:19:40.407276+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:13.317154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.401918+0000","last_change":"2024-09-19T09:19:39.399727+0000","last_active":"2024-09-19T09:19:40.401918+0000","last_peered":"2024-09-19T09:19:40.401918+0000","last_clean":"2024-09-19T09:19:40.401918+0000","last_became_active":"2024-09-19T09:19:39.399502+0000","last_became_peered":"2024-09-19T09:19:39.399502+0000","last_unstale":"2024-09-19T09:19:40.401918+0000","last_undegraded":"2024-09-19T09:19:40.401918+0000","last_fullsized":"2024-09-19T09:19:40.401918+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:55.851292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411530+0000","last_change":"2024-09-19T09:19:40.408920+0000","last_active":"2024-09-19T09:19:41.411530+0000","last_peered":"2024-09-19T09:19:41.411530+0000","last_clean":"2024-09-19T09:19:41.411530+0000","last_became_active":"2024-09-19T09:19:40.408672+0000","last_became_peered":"2024-09-19T09:19:40.408672+0000","last_unstale":"2024-09-19T09:19:41.411530+0000","last_undegraded":"2024-09-19T09:19:41.411530+0000","last_fullsized":"2024-09-19T09:19:41.411530+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:07.977580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.396340+0000","last_change":"2024-09-19T09:19:39.402740+0000","last_active":"2024-09-19T09:19:40.396340+0000","last_peered":"2024-09-19T09:19:40.396340+0000","last_clean":"2024-09-19T09:19:40.396340+0000","last_became_active":"2024-09-19T09:19:39.402513+0000","last_became_peered":"2024-09-19T09:19:39.402513+0000","last_unstale":"2024-09-19T09:19:40.396340+0000","last_undegraded":"2024-09-19T09:19:40.396340+0000","last_fullsized":"2024-09-19T09:19:40.396340+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:02.569725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.406245+0000","last_change":"2024-09-19T09:19:40.405334+0000","last_active":"2024-09-19T09:19:40.406245+0000","last_peered":"2024-09-19T09:19:40.406245+0000","last_clean":"2024-09-19T09:19:40.406245+0000","last_became_active":"2024-09-19T09:19:40.404959+0000","last_became_peered":"2024-09-19T09:19:40.404959+0000","last_unstale":"2024-09-19T09:19:40.406245+0000","last_undegraded":"2024-09-19T09:19:40.406245+0000","last_fullsized":"2024-09-19T09:19:40.406245+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:42.804029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.399442+0000","last_change":"2024-09-19T09:19:39.400784+0000","last_active":"2024-09-19T09:19:40.399442+0000","last_peered":"2024-09-19T09:19:40.399442+0000","last_clean":"2024-09-19T09:19:40.399442+0000","last_became_active":"2024-09-19T09:19:39.400457+0000","last_became_peered":"2024-09-19T09:19:39.400457+0000","last_unstale":"2024-09-19T09:19:40.399442+0000","last_undegraded":"2024-09-19T09:19:40.399442+0000","last_fullsized":"2024-09-19T09:19:40.399442+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:48.304040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.410660+0000","last_change":"2024-09-19T09:19:40.410497+0000","last_active":"2024-09-19T09:19:40.410660+0000","last_peered":"2024-09-19T09:19:40.410660+0000","last_clean":"2024-09-19T09:19:40.410660+0000","last_became_active":"2024-09-19T09:19:40.410268+0000","last_became_peered":"2024-09-19T09:19:40.410268+0000","last_unstale":"2024-09-19T09:19:40.410660+0000","last_undegraded":"2024-09-19T09:19:40.410660+0000","last_fullsized":"2024-09-19T09:19:40.410660+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:22.789952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.401655+0000","last_change":"2024-09-19T09:19:39.404562+0000","last_active":"2024-09-19T09:19:40.401655+0000","last_peered":"2024-09-19T09:19:40.401655+0000","last_clean":"2024-09-19T09:19:40.401655+0000","last_became_active":"2024-09-19T09:19:39.404321+0000","last_became_peered":"2024-09-19T09:19:39.404321+0000","last_unstale":"2024-09-19T09:19:40.401655+0000","last_undegraded":"2024-09-19T09:19:40.401655+0000","last_fullsized":"2024-09-19T09:19:40.401655+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:18.011073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411809+0000","last_change":"2024-09-19T09:19:40.404499+0000","last_active":"2024-09-19T09:19:41.411809+0000","last_peered":"2024-09-19T09:19:41.411809+0000","last_clean":"2024-09-19T09:19:41.411809+0000","last_became_active":"2024-09-19T09:19:40.404277+0000","last_became_peered":"2024-09-19T09:19:40.404277+0000","last_unstale":"2024-09-19T09:19:41.411809+0000","last_undegraded":"2024-09-19T09:19:41.411809+0000","last_fullsized":"2024-09-19T09:19:41.411809+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:11.068458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411711+0000","last_change":"2024-09-19T09:19:39.397948+0000","last_active":"2024-09-19T09:19:41.411711+0000","last_peered":"2024-09-19T09:19:41.411711+0000","last_clean":"2024-09-19T09:19:41.411711+0000","last_became_active":"2024-09-19T09:19:39.397415+0000","last_became_peered":"2024-09-19T09:19:39.397415+0000","last_unstale":"2024-09-19T09:19:41.411711+0000","last_undegraded":"2024-09-19T09:19:41.411711+0000","last_fullsized":"2024-09-19T09:19:41.411711+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:36.204314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.407785+0000","last_change":"2024-09-19T09:19:40.407613+0000","last_active":"2024-09-19T09:19:40.407785+0000","last_peered":"2024-09-19T09:19:40.407785+0000","last_clean":"2024-09-19T09:19:40.407785+0000","last_became_active":"2024-09-19T09:19:40.407374+0000","last_became_peered":"2024-09-19T09:19:40.407374+0000","last_unstale":"2024-09-19T09:19:40.407785+0000","last_undegraded":"2024-09-19T09:19:40.407785+0000","last_fullsized":"2024-09-19T09:19:40.407785+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:53.817175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.406485+0000","last_change":"2024-09-19T09:19:39.401212+0000","last_active":"2024-09-19T09:19:40.406485+0000","last_peered":"2024-09-19T09:19:40.406485+0000","last_clean":"2024-09-19T09:19:40.406485+0000","last_became_active":"2024-09-19T09:19:39.400030+0000","last_became_peered":"2024-09-19T09:19:39.400030+0000","last_unstale":"2024-09-19T09:19:40.406485+0000","last_undegraded":"2024-09-19T09:19:40.406485+0000","last_fullsized":"2024-09-19T09:19:40.406485+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:18.236287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":402,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411595+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:19:41.411595+0000","last_peered":"2024-09-19T09:19:41.411595+0000","last_clean":"2024-09-19T09:19:41.411595+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:19:41.411595+0000","last_undegraded":"2024-09-19T09:19:41.411595+0000","last_fullsized":"2024-09-19T09:19:41.411595+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:28.823470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":742,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194570,"statfs":{"total":200000000,"available":199239943,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":740,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194571,"statfs":{"total":200000000,"available":199241679,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574927,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1317,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193995,"statfs":{"total":200000000,"available":198651219,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":742,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194570,"statfs":{"total":200000000,"available":199239977,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":740,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194571,"statfs":{"total":200000000,"available":199241679,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":741,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194571,"statfs":{"total":200000000,"available":199241041,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1317,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193995,"statfs":{"total":200000000,"available":198651311,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":741,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194571,"statfs":{"total":200000000,"available":199241027,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:19:44.415 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:19:44.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.547+0000 7f6661711640 1 Processor -- start 2024-09-19T09:19:44.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.547+0000 7f6661711640 1 -- start start 2024-09-19T09:19:44.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.548+0000 7f6661711640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f665c072f40 0x7f665c06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:44.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.548+0000 7f6661711640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f665c0ce780 0x7f665c0b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:44.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.548+0000 7f6661711640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f665c06e3d0 con 0x7f665c145290 2024-09-19T09:19:44.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.548+0000 7f6661711640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f665c06efe0 con 0x7f665c072f40 2024-09-19T09:19:44.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.548+0000 7f6661711640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f665c06e6b0 con 0x7f665c0ce780 2024-09-19T09:19:44.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.548+0000 7f665affd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f665c145290 0x7f665c072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:41248/0 (socket says 172.21.15.18:41248) 2024-09-19T09:19:44.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.548+0000 7f665affd640 1 -- 172.21.15.18:0/1461404442 learned_addr learned my addr 172.21.15.18:0/1461404442 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:44.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.548+0000 7f6659ffb640 1 -- 172.21.15.18:0/1461404442 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3728126877 0 0) 0x7f665c06e3d0 con 0x7f665c145290 2024-09-19T09:19:44.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.548+0000 7f6659ffb640 1 -- 172.21.15.18:0/1461404442 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6644003520 con 0x7f665c145290 2024-09-19T09:19:44.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.548+0000 7f665a7fc640 1 --2- 172.21.15.18:0/1461404442 >> v2:172.21.15.162:3300/0 conn(0x7f665c072f40 0x7f665c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:44.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.548+0000 7f665b7fe640 1 --2- 172.21.15.18:0/1461404442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f665c0ce780 0x7f665c0b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:44.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.549+0000 7f6659ffb640 1 -- 172.21.15.18:0/1461404442 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 591477692 0 0) 0x7f6644003520 con 0x7f665c145290 2024-09-19T09:19:44.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.549+0000 7f6659ffb640 1 -- 172.21.15.18:0/1461404442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f665c0ce780 msgr2=0x7f665c0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:44.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.549+0000 7f6659ffb640 1 --2- 172.21.15.18:0/1461404442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f665c0ce780 0x7f665c0b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.549+0000 7f6659ffb640 1 -- 172.21.15.18:0/1461404442 >> v2:172.21.15.162:3300/0 conn(0x7f665c072f40 msgr2=0x7f665c06f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:44.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.549+0000 7f6659ffb640 1 --2- 172.21.15.18:0/1461404442 >> v2:172.21.15.162:3300/0 conn(0x7f665c072f40 0x7f665c06f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.549+0000 7f6659ffb640 1 -- 172.21.15.18:0/1461404442 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f665c06e990 con 0x7f665c145290 2024-09-19T09:19:44.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.549+0000 7f6659ffb640 1 -- 172.21.15.18:0/1461404442 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f664c001670 con 0x7f665c145290 2024-09-19T09:19:44.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.549+0000 7f665b7fe640 1 --2- 172.21.15.18:0/1461404442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f665c0ce780 0x7f665c0b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:44.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.549+0000 7f6659ffb640 1 -- 172.21.15.18:0/1461404442 >> v1:172.21.15.18:6789/0 conn(0x7f665c145290 legacy=0x7f665c072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:44.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.549+0000 7f6659ffb640 1 --2- 172.21.15.18:0/1461404442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f665c0ce780 0x7f66440039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:44.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.549+0000 7f6659ffb640 1 --2- 172.21.15.18:0/1461404442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6644003f10 0x7f6644004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:44.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.549+0000 7f6659ffb640 1 --2- 172.21.15.18:0/1461404442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6644004d40 0x7f66440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:44.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.549+0000 7f6659ffb640 1 -- 172.21.15.18:0/1461404442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f665c06efe0 con 0x7f6644003f10 2024-09-19T09:19:44.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.549+0000 7f6659ffb640 1 -- 172.21.15.18:0/1461404442 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f665c06e6b0 con 0x7f6644004d40 2024-09-19T09:19:44.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.549+0000 7f6659ffb640 1 -- 172.21.15.18:0/1461404442 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f664400b9f0 con 0x7f665c0ce780 2024-09-19T09:19:44.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.549+0000 7f665a7fc640 1 --2- 172.21.15.18:0/1461404442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6644003f10 0x7f6644004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:44.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.549+0000 7f665affd640 1 --2- 172.21.15.18:0/1461404442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f665c0ce780 0x7f66440039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:44.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.549+0000 7f665b7fe640 1 --2- 172.21.15.18:0/1461404442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6644004d40 0x7f66440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:44.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.549+0000 7f665a7fc640 1 -- 172.21.15.18:0/1461404442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f665c0ce780 msgr2=0x7f66440039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:44.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.549+0000 7f665a7fc640 1 --2- 172.21.15.18:0/1461404442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f665c0ce780 0x7f66440039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.549+0000 7f665a7fc640 1 -- 172.21.15.18:0/1461404442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6644004d40 msgr2=0x7f66440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:44.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.549+0000 7f665a7fc640 1 --2- 172.21.15.18:0/1461404442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6644004d40 0x7f66440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.549+0000 7f665a7fc640 1 -- 172.21.15.18:0/1461404442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6644003520 con 0x7f6644003f10 2024-09-19T09:19:44.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.549+0000 7f665b7fe640 1 --2- 172.21.15.18:0/1461404442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6644004d40 0x7f66440051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:44.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.550+0000 7f665a7fc640 1 --2- 172.21.15.18:0/1461404442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6644003f10 0x7f6644004800 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f6650009ac0 tx=0x7f6644005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b79e9a9b3e49c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:44.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.550+0000 7f6659ffb640 1 -- 172.21.15.18:0/1461404442 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6650036070 con 0x7f6644003f10 2024-09-19T09:19:44.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.550+0000 7f6659ffb640 1 -- 172.21.15.18:0/1461404442 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6650031400 con 0x7f6644003f10 2024-09-19T09:19:44.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.550+0000 7f6659ffb640 1 -- 172.21.15.18:0/1461404442 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6650009690 con 0x7f6644003f10 2024-09-19T09:19:44.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.551+0000 7f6661711640 1 -- 172.21.15.18:0/1461404442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6644003f10 msgr2=0x7f6644004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:44.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.551+0000 7f6661711640 1 --2- 172.21.15.18:0/1461404442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6644003f10 0x7f6644004800 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f6650009ac0 tx=0x7f6644005830 comp rx=0 tx=0).stop 2024-09-19T09:19:44.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.551+0000 7f665b7fe640 1 -- 172.21.15.18:0/1461404442 reap_dead start 2024-09-19T09:19:44.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.551+0000 7f6661711640 1 -- 172.21.15.18:0/1461404442 shutdown_connections 2024-09-19T09:19:44.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.551+0000 7f6661711640 1 -- 172.21.15.18:0/1461404442 >> 172.21.15.18:0/1461404442 conn(0x7f665c06bc10 msgr2=0x7f665c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:44.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.551+0000 7f6661711640 1 -- 172.21.15.18:0/1461404442 shutdown_connections 2024-09-19T09:19:44.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.551+0000 7f6661711640 1 -- 172.21.15.18:0/1461404442 wait complete. 2024-09-19T09:19:44.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.552+0000 7f6661711640 1 Processor -- start 2024-09-19T09:19:44.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.552+0000 7f6661711640 1 -- start start 2024-09-19T09:19:44.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.553+0000 7f6661711640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6644003f10 0x7f665c15b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:44.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.553+0000 7f6661711640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f665c1688b0 0x7f665c169000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:44.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.553+0000 7f6661711640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f665c15dbe0 0x7f665c15e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:44.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.553+0000 7f6661711640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f665c06df80 con 0x7f6644003f10 2024-09-19T09:19:44.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.553+0000 7f6661711640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f665c145670 con 0x7f665c1688b0 2024-09-19T09:19:44.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.553+0000 7f6661711640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f665c06e100 con 0x7f665c15dbe0 2024-09-19T09:19:44.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.553+0000 7f665affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6644003f10 0x7f665c15b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:44.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.553+0000 7f665affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6644003f10 0x7f665c15b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38344/0 (socket says 172.21.15.18:38344) 2024-09-19T09:19:44.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.553+0000 7f665affd640 1 -- 172.21.15.18:0/2073235474 learned_addr learned my addr 172.21.15.18:0/2073235474 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:44.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.553+0000 7f665b7fe640 1 --2- 172.21.15.18:0/2073235474 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f665c15dbe0 0x7f665c15e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:44.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.553+0000 7f665a7fc640 1 --2- 172.21.15.18:0/2073235474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f665c1688b0 0x7f665c169000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:44.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.553+0000 7f665affd640 1 -- 172.21.15.18:0/2073235474 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f665c15dbe0 msgr2=0x7f665c15e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:44.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.553+0000 7f665affd640 1 --2- 172.21.15.18:0/2073235474 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f665c15dbe0 0x7f665c15e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.553+0000 7f665affd640 1 -- 172.21.15.18:0/2073235474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f665c1688b0 msgr2=0x7f665c169000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:44.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.553+0000 7f665affd640 1 --2- 172.21.15.18:0/2073235474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f665c1688b0 0x7f665c169000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.553+0000 7f665affd640 1 -- 172.21.15.18:0/2073235474 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f665c0af3f0 con 0x7f6644003f10 2024-09-19T09:19:44.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.553+0000 7f665affd640 1 --2- 172.21.15.18:0/2073235474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6644003f10 0x7f665c15b020 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f664c007340 tx=0x7f664c007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:44.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.554+0000 7f66437fe640 1 -- 172.21.15.18:0/2073235474 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c00f8b0 con 0x7f6644003f10 2024-09-19T09:19:44.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.554+0000 7f66437fe640 1 -- 172.21.15.18:0/2073235474 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f664c018070 con 0x7f6644003f10 2024-09-19T09:19:44.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.554+0000 7f6661711640 1 -- 172.21.15.18:0/2073235474 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f665c0af6d0 con 0x7f6644003f10 2024-09-19T09:19:44.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.554+0000 7f66437fe640 1 -- 172.21.15.18:0/2073235474 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f664c00fc90 con 0x7f6644003f10 2024-09-19T09:19:44.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.554+0000 7f6661711640 1 -- 172.21.15.18:0/2073235474 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f665c0afc90 con 0x7f6644003f10 2024-09-19T09:19:44.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.555+0000 7f6661711640 1 -- 172.21.15.18:0/2073235474 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f665c0afe90 con 0x7f6644003f10 2024-09-19T09:19:44.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.555+0000 7f66437fe640 1 -- 172.21.15.18:0/2073235474 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f664c01d460 con 0x7f6644003f10 2024-09-19T09:19:44.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.555+0000 7f66437fe640 1 --2- 172.21.15.18:0/2073235474 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f664806c2e0 0x7f664806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:44.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.556+0000 7f66437fe640 1 -- 172.21.15.18:0/2073235474 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7f664c08b380 con 0x7f6644003f10 2024-09-19T09:19:44.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.556+0000 7f665a7fc640 1 --2- 172.21.15.18:0/2073235474 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f664806c2e0 0x7f664806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:44.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.557+0000 7f665a7fc640 1 --2- 172.21.15.18:0/2073235474 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f664806c2e0 0x7f664806e7a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6650033000 tx=0x7f6650008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:44.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.560+0000 7f66437fe640 1 -- 172.21.15.18:0/2073235474 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f665c0afe90 con 0x7f6644003f10 2024-09-19T09:19:44.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.734+0000 7f6661711640 1 -- 172.21.15.18:0/2073235474 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f665c071510 con 0x7f664806c2e0 2024-09-19T09:19:44.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.740+0000 7f66437fe640 1 -- 172.21.15.18:0/2073235474 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247939 (secure 0 0 0) 0x7f665c071510 con 0x7f664806c2e0 2024-09-19T09:19:44.743 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:44.745 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:19:44.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.743+0000 7f6661711640 1 -- 172.21.15.18:0/2073235474 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f664806c2e0 msgr2=0x7f664806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:44.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.743+0000 7f6661711640 1 --2- 172.21.15.18:0/2073235474 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f664806c2e0 0x7f664806e7a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6650033000 tx=0x7f6650008030 comp rx=0 tx=0).stop 2024-09-19T09:19:44.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.743+0000 7f6661711640 1 -- 172.21.15.18:0/2073235474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6644003f10 msgr2=0x7f665c15b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:44.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.743+0000 7f6661711640 1 --2- 172.21.15.18:0/2073235474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6644003f10 0x7f665c15b020 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f664c007340 tx=0x7f664c007800 comp rx=0 tx=0).stop 2024-09-19T09:19:44.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.743+0000 7f6661711640 1 -- 172.21.15.18:0/2073235474 shutdown_connections 2024-09-19T09:19:44.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.743+0000 7f6661711640 1 --2- 172.21.15.18:0/2073235474 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f664806c2e0 0x7f664806e7a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.743+0000 7f6661711640 1 --2- 172.21.15.18:0/2073235474 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f665c15dbe0 0x7f665c15e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.743+0000 7f6661711640 1 --2- 172.21.15.18:0/2073235474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f665c1688b0 0x7f665c169000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.743+0000 7f6661711640 1 --2- 172.21.15.18:0/2073235474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6644003f10 0x7f665c15b020 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.743+0000 7f6661711640 1 -- 172.21.15.18:0/2073235474 >> 172.21.15.18:0/2073235474 conn(0x7f665c06bc10 msgr2=0x7f665c0b1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:44.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.744+0000 7f6661711640 1 -- 172.21.15.18:0/2073235474 shutdown_connections 2024-09-19T09:19:44.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.744+0000 7f6661711640 1 -- 172.21.15.18:0/2073235474 wait complete. 2024-09-19T09:19:44.755 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":323,"stamp":"2024-09-19T09:19:43.614776+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7082,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555417,"statfs":{"total":1600000000,"available":1592747876,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.227979"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.415206+0000","last_change":"2024-09-19T09:19:40.406254+0000","last_active":"2024-09-19T09:19:40.415206+0000","last_peered":"2024-09-19T09:19:40.415206+0000","last_clean":"2024-09-19T09:19:40.415206+0000","last_became_active":"2024-09-19T09:19:40.405537+0000","last_became_peered":"2024-09-19T09:19:40.405537+0000","last_unstale":"2024-09-19T09:19:40.415206+0000","last_undegraded":"2024-09-19T09:19:40.415206+0000","last_fullsized":"2024-09-19T09:19:40.415206+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:33.089494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.410044+0000","last_change":"2024-09-19T09:19:40.409769+0000","last_active":"2024-09-19T09:19:40.410044+0000","last_peered":"2024-09-19T09:19:40.410044+0000","last_clean":"2024-09-19T09:19:40.410044+0000","last_became_active":"2024-09-19T09:19:40.409538+0000","last_became_peered":"2024-09-19T09:19:40.409538+0000","last_unstale":"2024-09-19T09:19:40.410044+0000","last_undegraded":"2024-09-19T09:19:40.410044+0000","last_fullsized":"2024-09-19T09:19:40.410044+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:48.618610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411508+0000","last_change":"2024-09-19T09:19:40.407651+0000","last_active":"2024-09-19T09:19:41.411508+0000","last_peered":"2024-09-19T09:19:41.411508+0000","last_clean":"2024-09-19T09:19:41.411508+0000","last_became_active":"2024-09-19T09:19:40.407177+0000","last_became_peered":"2024-09-19T09:19:40.407177+0000","last_unstale":"2024-09-19T09:19:41.411508+0000","last_undegraded":"2024-09-19T09:19:41.411508+0000","last_fullsized":"2024-09-19T09:19:41.411508+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:39.273769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.411252+0000","last_change":"2024-09-19T09:19:40.409362+0000","last_active":"2024-09-19T09:19:40.411252+0000","last_peered":"2024-09-19T09:19:40.411252+0000","last_clean":"2024-09-19T09:19:40.411252+0000","last_became_active":"2024-09-19T09:19:40.408628+0000","last_became_peered":"2024-09-19T09:19:40.408628+0000","last_unstale":"2024-09-19T09:19:40.411252+0000","last_undegraded":"2024-09-19T09:19:40.411252+0000","last_fullsized":"2024-09-19T09:19:40.411252+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:40:09.774556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.418180+0000","last_change":"2024-09-19T09:19:40.418086+0000","last_active":"2024-09-19T09:19:40.418180+0000","last_peered":"2024-09-19T09:19:40.418180+0000","last_clean":"2024-09-19T09:19:40.418180+0000","last_became_active":"2024-09-19T09:19:40.417711+0000","last_became_peered":"2024-09-19T09:19:40.417711+0000","last_unstale":"2024-09-19T09:19:40.418180+0000","last_undegraded":"2024-09-19T09:19:40.418180+0000","last_fullsized":"2024-09-19T09:19:40.418180+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:26.284881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411554+0000","last_change":"2024-09-19T09:19:40.404115+0000","last_active":"2024-09-19T09:19:41.411554+0000","last_peered":"2024-09-19T09:19:41.411554+0000","last_clean":"2024-09-19T09:19:41.411554+0000","last_became_active":"2024-09-19T09:19:40.403549+0000","last_became_peered":"2024-09-19T09:19:40.403549+0000","last_unstale":"2024-09-19T09:19:41.411554+0000","last_undegraded":"2024-09-19T09:19:41.411554+0000","last_fullsized":"2024-09-19T09:19:41.411554+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:19.202560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.401907+0000","last_change":"2024-09-19T09:19:40.400508+0000","last_active":"2024-09-19T09:19:40.401907+0000","last_peered":"2024-09-19T09:19:40.401907+0000","last_clean":"2024-09-19T09:19:40.401907+0000","last_became_active":"2024-09-19T09:19:40.400283+0000","last_became_peered":"2024-09-19T09:19:40.400283+0000","last_unstale":"2024-09-19T09:19:40.401907+0000","last_undegraded":"2024-09-19T09:19:40.401907+0000","last_fullsized":"2024-09-19T09:19:40.401907+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:09:46.628171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.410839+0000","last_change":"2024-09-19T09:19:40.407223+0000","last_active":"2024-09-19T09:19:40.410839+0000","last_peered":"2024-09-19T09:19:40.410839+0000","last_clean":"2024-09-19T09:19:40.410839+0000","last_became_active":"2024-09-19T09:19:40.407004+0000","last_became_peered":"2024-09-19T09:19:40.407004+0000","last_unstale":"2024-09-19T09:19:40.410839+0000","last_undegraded":"2024-09-19T09:19:40.410839+0000","last_fullsized":"2024-09-19T09:19:40.410839+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:02.843603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.415250+0000","last_change":"2024-09-19T09:19:40.406515+0000","last_active":"2024-09-19T09:19:40.415250+0000","last_peered":"2024-09-19T09:19:40.415250+0000","last_clean":"2024-09-19T09:19:40.415250+0000","last_became_active":"2024-09-19T09:19:40.405008+0000","last_became_peered":"2024-09-19T09:19:40.405008+0000","last_unstale":"2024-09-19T09:19:40.415250+0000","last_undegraded":"2024-09-19T09:19:40.415250+0000","last_fullsized":"2024-09-19T09:19:40.415250+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:12.215683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.416910+0000","last_change":"2024-09-19T09:19:40.416253+0000","last_active":"2024-09-19T09:19:40.416910+0000","last_peered":"2024-09-19T09:19:40.416910+0000","last_clean":"2024-09-19T09:19:40.416910+0000","last_became_active":"2024-09-19T09:19:40.411171+0000","last_became_peered":"2024-09-19T09:19:40.411171+0000","last_unstale":"2024-09-19T09:19:40.416910+0000","last_undegraded":"2024-09-19T09:19:40.416910+0000","last_fullsized":"2024-09-19T09:19:40.416910+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:20.850272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.409225+0000","last_change":"2024-09-19T09:19:40.406612+0000","last_active":"2024-09-19T09:19:40.409225+0000","last_peered":"2024-09-19T09:19:40.409225+0000","last_clean":"2024-09-19T09:19:40.409225+0000","last_became_active":"2024-09-19T09:19:40.406102+0000","last_became_peered":"2024-09-19T09:19:40.406102+0000","last_unstale":"2024-09-19T09:19:40.409225+0000","last_undegraded":"2024-09-19T09:19:40.409225+0000","last_fullsized":"2024-09-19T09:19:40.409225+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:21.076712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.402904+0000","last_change":"2024-09-19T09:19:40.402780+0000","last_active":"2024-09-19T09:19:40.402904+0000","last_peered":"2024-09-19T09:19:40.402904+0000","last_clean":"2024-09-19T09:19:40.402904+0000","last_became_active":"2024-09-19T09:19:40.402543+0000","last_became_peered":"2024-09-19T09:19:40.402543+0000","last_unstale":"2024-09-19T09:19:40.402904+0000","last_undegraded":"2024-09-19T09:19:40.402904+0000","last_fullsized":"2024-09-19T09:19:40.402904+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:35.683954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.406459+0000","last_change":"2024-09-19T09:19:40.406355+0000","last_active":"2024-09-19T09:19:40.406459+0000","last_peered":"2024-09-19T09:19:40.406459+0000","last_clean":"2024-09-19T09:19:40.406459+0000","last_became_active":"2024-09-19T09:19:40.406138+0000","last_became_peered":"2024-09-19T09:19:40.406138+0000","last_unstale":"2024-09-19T09:19:40.406459+0000","last_undegraded":"2024-09-19T09:19:40.406459+0000","last_fullsized":"2024-09-19T09:19:40.406459+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:59:07.111206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.407108+0000","last_change":"2024-09-19T09:19:40.406971+0000","last_active":"2024-09-19T09:19:40.407108+0000","last_peered":"2024-09-19T09:19:40.407108+0000","last_clean":"2024-09-19T09:19:40.407108+0000","last_became_active":"2024-09-19T09:19:40.406227+0000","last_became_peered":"2024-09-19T09:19:40.406227+0000","last_unstale":"2024-09-19T09:19:40.407108+0000","last_undegraded":"2024-09-19T09:19:40.407108+0000","last_fullsized":"2024-09-19T09:19:40.407108+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:43.660631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.416092+0000","last_change":"2024-09-19T09:19:40.415409+0000","last_active":"2024-09-19T09:19:40.416092+0000","last_peered":"2024-09-19T09:19:40.416092+0000","last_clean":"2024-09-19T09:19:40.416092+0000","last_became_active":"2024-09-19T09:19:40.415097+0000","last_became_peered":"2024-09-19T09:19:40.415097+0000","last_unstale":"2024-09-19T09:19:40.416092+0000","last_undegraded":"2024-09-19T09:19:40.416092+0000","last_fullsized":"2024-09-19T09:19:40.416092+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:09:48.999186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.408793+0000","last_change":"2024-09-19T09:19:40.408684+0000","last_active":"2024-09-19T09:19:40.408793+0000","last_peered":"2024-09-19T09:19:40.408793+0000","last_clean":"2024-09-19T09:19:40.408793+0000","last_became_active":"2024-09-19T09:19:40.408478+0000","last_became_peered":"2024-09-19T09:19:40.408478+0000","last_unstale":"2024-09-19T09:19:40.408793+0000","last_undegraded":"2024-09-19T09:19:40.408793+0000","last_fullsized":"2024-09-19T09:19:40.408793+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:03.519241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411303+0000","last_change":"2024-09-19T09:19:40.403566+0000","last_active":"2024-09-19T09:19:41.411303+0000","last_peered":"2024-09-19T09:19:41.411303+0000","last_clean":"2024-09-19T09:19:41.411303+0000","last_became_active":"2024-09-19T09:19:40.403343+0000","last_became_peered":"2024-09-19T09:19:40.403343+0000","last_unstale":"2024-09-19T09:19:41.411303+0000","last_undegraded":"2024-09-19T09:19:41.411303+0000","last_fullsized":"2024-09-19T09:19:41.411303+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:18:29.898235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.405703+0000","last_change":"2024-09-19T09:19:40.405583+0000","last_active":"2024-09-19T09:19:40.405703+0000","last_peered":"2024-09-19T09:19:40.405703+0000","last_clean":"2024-09-19T09:19:40.405703+0000","last_became_active":"2024-09-19T09:19:40.405356+0000","last_became_peered":"2024-09-19T09:19:40.405356+0000","last_unstale":"2024-09-19T09:19:40.405703+0000","last_undegraded":"2024-09-19T09:19:40.405703+0000","last_fullsized":"2024-09-19T09:19:40.405703+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:35.009905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411305+0000","last_change":"2024-09-19T09:19:40.405955+0000","last_active":"2024-09-19T09:19:41.411305+0000","last_peered":"2024-09-19T09:19:41.411305+0000","last_clean":"2024-09-19T09:19:41.411305+0000","last_became_active":"2024-09-19T09:19:40.405688+0000","last_became_peered":"2024-09-19T09:19:40.405688+0000","last_unstale":"2024-09-19T09:19:41.411305+0000","last_undegraded":"2024-09-19T09:19:41.411305+0000","last_fullsized":"2024-09-19T09:19:41.411305+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:56:00.598244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411375+0000","last_change":"2024-09-19T09:19:40.409297+0000","last_active":"2024-09-19T09:19:41.411375+0000","last_peered":"2024-09-19T09:19:41.411375+0000","last_clean":"2024-09-19T09:19:41.411375+0000","last_became_active":"2024-09-19T09:19:40.409064+0000","last_became_peered":"2024-09-19T09:19:40.409064+0000","last_unstale":"2024-09-19T09:19:41.411375+0000","last_undegraded":"2024-09-19T09:19:41.411375+0000","last_fullsized":"2024-09-19T09:19:41.411375+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:35.896734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.410803+0000","last_change":"2024-09-19T09:19:40.409349+0000","last_active":"2024-09-19T09:19:40.410803+0000","last_peered":"2024-09-19T09:19:40.410803+0000","last_clean":"2024-09-19T09:19:40.410803+0000","last_became_active":"2024-09-19T09:19:40.406402+0000","last_became_peered":"2024-09-19T09:19:40.406402+0000","last_unstale":"2024-09-19T09:19:40.410803+0000","last_undegraded":"2024-09-19T09:19:40.410803+0000","last_fullsized":"2024-09-19T09:19:40.410803+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:18:33.075213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411776+0000","last_change":"2024-09-19T09:19:40.399232+0000","last_active":"2024-09-19T09:19:41.411776+0000","last_peered":"2024-09-19T09:19:41.411776+0000","last_clean":"2024-09-19T09:19:41.411776+0000","last_became_active":"2024-09-19T09:19:40.398971+0000","last_became_peered":"2024-09-19T09:19:40.398971+0000","last_unstale":"2024-09-19T09:19:41.411776+0000","last_undegraded":"2024-09-19T09:19:41.411776+0000","last_fullsized":"2024-09-19T09:19:41.411776+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:15.161913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.406720+0000","last_change":"2024-09-19T09:19:40.406616+0000","last_active":"2024-09-19T09:19:40.406720+0000","last_peered":"2024-09-19T09:19:40.406720+0000","last_clean":"2024-09-19T09:19:40.406720+0000","last_became_active":"2024-09-19T09:19:40.405940+0000","last_became_peered":"2024-09-19T09:19:40.405940+0000","last_unstale":"2024-09-19T09:19:40.406720+0000","last_undegraded":"2024-09-19T09:19:40.406720+0000","last_fullsized":"2024-09-19T09:19:40.406720+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:46.530944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.405033+0000","last_change":"2024-09-19T09:19:40.404246+0000","last_active":"2024-09-19T09:19:40.405033+0000","last_peered":"2024-09-19T09:19:40.405033+0000","last_clean":"2024-09-19T09:19:40.405033+0000","last_became_active":"2024-09-19T09:19:40.404019+0000","last_became_peered":"2024-09-19T09:19:40.404019+0000","last_unstale":"2024-09-19T09:19:40.405033+0000","last_undegraded":"2024-09-19T09:19:40.405033+0000","last_fullsized":"2024-09-19T09:19:40.405033+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:07:10.645541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.403690+0000","last_change":"2024-09-19T09:19:40.403397+0000","last_active":"2024-09-19T09:19:40.403690+0000","last_peered":"2024-09-19T09:19:40.403690+0000","last_clean":"2024-09-19T09:19:40.403690+0000","last_became_active":"2024-09-19T09:19:40.403152+0000","last_became_peered":"2024-09-19T09:19:40.403152+0000","last_unstale":"2024-09-19T09:19:40.403690+0000","last_undegraded":"2024-09-19T09:19:40.403690+0000","last_fullsized":"2024-09-19T09:19:40.403690+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:54:42.041432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411871+0000","last_change":"2024-09-19T09:19:40.403090+0000","last_active":"2024-09-19T09:19:41.411871+0000","last_peered":"2024-09-19T09:19:41.411871+0000","last_clean":"2024-09-19T09:19:41.411871+0000","last_became_active":"2024-09-19T09:19:40.402830+0000","last_became_peered":"2024-09-19T09:19:40.402830+0000","last_unstale":"2024-09-19T09:19:41.411871+0000","last_undegraded":"2024-09-19T09:19:41.411871+0000","last_fullsized":"2024-09-19T09:19:41.411871+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:19.808122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.408161+0000","last_change":"2024-09-19T09:19:40.407939+0000","last_active":"2024-09-19T09:19:40.408161+0000","last_peered":"2024-09-19T09:19:40.408161+0000","last_clean":"2024-09-19T09:19:40.408161+0000","last_became_active":"2024-09-19T09:19:40.407210+0000","last_became_peered":"2024-09-19T09:19:40.407210+0000","last_unstale":"2024-09-19T09:19:40.408161+0000","last_undegraded":"2024-09-19T09:19:40.408161+0000","last_fullsized":"2024-09-19T09:19:40.408161+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:32:46.554379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411639+0000","last_change":"2024-09-19T09:19:40.403837+0000","last_active":"2024-09-19T09:19:41.411639+0000","last_peered":"2024-09-19T09:19:41.411639+0000","last_clean":"2024-09-19T09:19:41.411639+0000","last_became_active":"2024-09-19T09:19:40.403619+0000","last_became_peered":"2024-09-19T09:19:40.403619+0000","last_unstale":"2024-09-19T09:19:41.411639+0000","last_undegraded":"2024-09-19T09:19:41.411639+0000","last_fullsized":"2024-09-19T09:19:41.411639+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:33.151082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.406882+0000","last_change":"2024-09-19T09:19:40.406772+0000","last_active":"2024-09-19T09:19:40.406882+0000","last_peered":"2024-09-19T09:19:40.406882+0000","last_clean":"2024-09-19T09:19:40.406882+0000","last_became_active":"2024-09-19T09:19:40.405882+0000","last_became_peered":"2024-09-19T09:19:40.405882+0000","last_unstale":"2024-09-19T09:19:40.406882+0000","last_undegraded":"2024-09-19T09:19:40.406882+0000","last_fullsized":"2024-09-19T09:19:40.406882+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:17:59.887835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.397464+0000","last_change":"2024-09-19T09:19:40.397329+0000","last_active":"2024-09-19T09:19:40.397464+0000","last_peered":"2024-09-19T09:19:40.397464+0000","last_clean":"2024-09-19T09:19:40.397464+0000","last_became_active":"2024-09-19T09:19:40.396979+0000","last_became_peered":"2024-09-19T09:19:40.396979+0000","last_unstale":"2024-09-19T09:19:40.397464+0000","last_undegraded":"2024-09-19T09:19:40.397464+0000","last_fullsized":"2024-09-19T09:19:40.397464+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:30:23.322233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.415155+0000","last_change":"2024-09-19T09:19:40.405870+0000","last_active":"2024-09-19T09:19:40.415155+0000","last_peered":"2024-09-19T09:19:40.415155+0000","last_clean":"2024-09-19T09:19:40.415155+0000","last_became_active":"2024-09-19T09:19:40.404847+0000","last_became_peered":"2024-09-19T09:19:40.404847+0000","last_unstale":"2024-09-19T09:19:40.415155+0000","last_undegraded":"2024-09-19T09:19:40.415155+0000","last_fullsized":"2024-09-19T09:19:40.415155+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:07:37.944798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.408224+0000","last_change":"2024-09-19T09:19:40.407919+0000","last_active":"2024-09-19T09:19:40.408224+0000","last_peered":"2024-09-19T09:19:40.408224+0000","last_clean":"2024-09-19T09:19:40.408224+0000","last_became_active":"2024-09-19T09:19:40.407667+0000","last_became_peered":"2024-09-19T09:19:40.407667+0000","last_unstale":"2024-09-19T09:19:40.408224+0000","last_undegraded":"2024-09-19T09:19:40.408224+0000","last_fullsized":"2024-09-19T09:19:40.408224+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:41.521422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.415228+0000","last_change":"2024-09-19T09:19:40.406329+0000","last_active":"2024-09-19T09:19:40.415228+0000","last_peered":"2024-09-19T09:19:40.415228+0000","last_clean":"2024-09-19T09:19:40.415228+0000","last_became_active":"2024-09-19T09:19:40.404179+0000","last_became_peered":"2024-09-19T09:19:40.404179+0000","last_unstale":"2024-09-19T09:19:40.415228+0000","last_undegraded":"2024-09-19T09:19:40.415228+0000","last_fullsized":"2024-09-19T09:19:40.415228+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:13.864602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"137'4","reported_seq":16,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.413273+0000","last_change":"2024-09-19T09:19:39.401007+0000","last_active":"2024-09-19T09:19:40.413273+0000","last_peered":"2024-09-19T09:19:40.413273+0000","last_clean":"2024-09-19T09:19:40.413273+0000","last_became_active":"2024-09-19T09:19:39.400689+0000","last_became_peered":"2024-09-19T09:19:39.400689+0000","last_unstale":"2024-09-19T09:19:40.413273+0000","last_undegraded":"2024-09-19T09:19:40.413273+0000","last_fullsized":"2024-09-19T09:19:40.413273+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:38:06.460788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.406500+0000","last_change":"2024-09-19T09:19:40.406357+0000","last_active":"2024-09-19T09:19:40.406500+0000","last_peered":"2024-09-19T09:19:40.406500+0000","last_clean":"2024-09-19T09:19:40.406500+0000","last_became_active":"2024-09-19T09:19:40.405546+0000","last_became_peered":"2024-09-19T09:19:40.405546+0000","last_unstale":"2024-09-19T09:19:40.406500+0000","last_undegraded":"2024-09-19T09:19:40.406500+0000","last_fullsized":"2024-09-19T09:19:40.406500+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:11:28.331947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1e","version":"137'1","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.410704+0000","last_change":"2024-09-19T09:19:39.398863+0000","last_active":"2024-09-19T09:19:40.410704+0000","last_peered":"2024-09-19T09:19:40.410704+0000","last_clean":"2024-09-19T09:19:40.410704+0000","last_became_active":"2024-09-19T09:19:39.398621+0000","last_became_peered":"2024-09-19T09:19:39.398621+0000","last_unstale":"2024-09-19T09:19:40.410704+0000","last_undegraded":"2024-09-19T09:19:40.410704+0000","last_fullsized":"2024-09-19T09:19:40.410704+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:46.743642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.412003+0000","last_change":"2024-09-19T09:19:40.404749+0000","last_active":"2024-09-19T09:19:41.412003+0000","last_peered":"2024-09-19T09:19:41.412003+0000","last_clean":"2024-09-19T09:19:41.412003+0000","last_became_active":"2024-09-19T09:19:40.404518+0000","last_became_peered":"2024-09-19T09:19:40.404518+0000","last_unstale":"2024-09-19T09:19:41.412003+0000","last_undegraded":"2024-09-19T09:19:41.412003+0000","last_fullsized":"2024-09-19T09:19:41.412003+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:46:30.866697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1d","version":"137'2","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.416600+0000","last_change":"2024-09-19T09:19:39.407604+0000","last_active":"2024-09-19T09:19:40.416600+0000","last_peered":"2024-09-19T09:19:40.416600+0000","last_clean":"2024-09-19T09:19:40.416600+0000","last_became_active":"2024-09-19T09:19:39.407372+0000","last_became_peered":"2024-09-19T09:19:39.407372+0000","last_unstale":"2024-09-19T09:19:40.416600+0000","last_undegraded":"2024-09-19T09:19:40.416600+0000","last_fullsized":"2024-09-19T09:19:40.416600+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:39.605595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411542+0000","last_change":"2024-09-19T09:19:40.411715+0000","last_active":"2024-09-19T09:19:41.411542+0000","last_peered":"2024-09-19T09:19:41.411542+0000","last_clean":"2024-09-19T09:19:41.411542+0000","last_became_active":"2024-09-19T09:19:40.411468+0000","last_became_peered":"2024-09-19T09:19:40.411468+0000","last_unstale":"2024-09-19T09:19:41.411542+0000","last_undegraded":"2024-09-19T09:19:41.411542+0000","last_fullsized":"2024-09-19T09:19:41.411542+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:39.147060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"137'2","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.416681+0000","last_change":"2024-09-19T09:19:39.403291+0000","last_active":"2024-09-19T09:19:40.416681+0000","last_peered":"2024-09-19T09:19:40.416681+0000","last_clean":"2024-09-19T09:19:40.416681+0000","last_became_active":"2024-09-19T09:19:39.402322+0000","last_became_peered":"2024-09-19T09:19:39.402322+0000","last_unstale":"2024-09-19T09:19:40.416681+0000","last_undegraded":"2024-09-19T09:19:40.416681+0000","last_fullsized":"2024-09-19T09:19:40.416681+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:02.375604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.416910+0000","last_change":"2024-09-19T09:19:40.416785+0000","last_active":"2024-09-19T09:19:40.416910+0000","last_peered":"2024-09-19T09:19:40.416910+0000","last_clean":"2024-09-19T09:19:40.416910+0000","last_became_active":"2024-09-19T09:19:40.416555+0000","last_became_peered":"2024-09-19T09:19:40.416555+0000","last_unstale":"2024-09-19T09:19:40.416910+0000","last_undegraded":"2024-09-19T09:19:40.416910+0000","last_fullsized":"2024-09-19T09:19:40.416910+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:18:17.095391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1b","version":"137'1","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411658+0000","last_change":"2024-09-19T09:19:39.402754+0000","last_active":"2024-09-19T09:19:41.411658+0000","last_peered":"2024-09-19T09:19:41.411658+0000","last_clean":"2024-09-19T09:19:41.411658+0000","last_became_active":"2024-09-19T09:19:39.402473+0000","last_became_peered":"2024-09-19T09:19:39.402473+0000","last_unstale":"2024-09-19T09:19:41.411658+0000","last_undegraded":"2024-09-19T09:19:41.411658+0000","last_fullsized":"2024-09-19T09:19:41.411658+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:25.414080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.410857+0000","last_change":"2024-09-19T09:19:40.407918+0000","last_active":"2024-09-19T09:19:40.410857+0000","last_peered":"2024-09-19T09:19:40.410857+0000","last_clean":"2024-09-19T09:19:40.410857+0000","last_became_active":"2024-09-19T09:19:40.407394+0000","last_became_peered":"2024-09-19T09:19:40.407394+0000","last_unstale":"2024-09-19T09:19:40.410857+0000","last_undegraded":"2024-09-19T09:19:40.410857+0000","last_fullsized":"2024-09-19T09:19:40.410857+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:12:18.713514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1a","version":"137'1","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.418647+0000","last_change":"2024-09-19T09:19:39.401836+0000","last_active":"2024-09-19T09:19:40.418647+0000","last_peered":"2024-09-19T09:19:40.418647+0000","last_clean":"2024-09-19T09:19:40.418647+0000","last_became_active":"2024-09-19T09:19:39.401047+0000","last_became_peered":"2024-09-19T09:19:39.401047+0000","last_unstale":"2024-09-19T09:19:40.418647+0000","last_undegraded":"2024-09-19T09:19:40.418647+0000","last_fullsized":"2024-09-19T09:19:40.418647+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:47.951386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.417275+0000","last_change":"2024-09-19T09:19:40.417127+0000","last_active":"2024-09-19T09:19:40.417275+0000","last_peered":"2024-09-19T09:19:40.417275+0000","last_clean":"2024-09-19T09:19:40.417275+0000","last_became_active":"2024-09-19T09:19:40.414873+0000","last_became_peered":"2024-09-19T09:19:40.414873+0000","last_unstale":"2024-09-19T09:19:40.417275+0000","last_undegraded":"2024-09-19T09:19:40.417275+0000","last_fullsized":"2024-09-19T09:19:40.417275+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:06:33.247281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.396530+0000","last_change":"2024-09-19T09:19:39.406046+0000","last_active":"2024-09-19T09:19:40.396530+0000","last_peered":"2024-09-19T09:19:40.396530+0000","last_clean":"2024-09-19T09:19:40.396530+0000","last_became_active":"2024-09-19T09:19:39.405899+0000","last_became_peered":"2024-09-19T09:19:39.405899+0000","last_unstale":"2024-09-19T09:19:40.396530+0000","last_undegraded":"2024-09-19T09:19:40.396530+0000","last_fullsized":"2024-09-19T09:19:40.396530+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:05.281974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.410822+0000","last_change":"2024-09-19T09:19:40.407833+0000","last_active":"2024-09-19T09:19:40.410822+0000","last_peered":"2024-09-19T09:19:40.410822+0000","last_clean":"2024-09-19T09:19:40.410822+0000","last_became_active":"2024-09-19T09:19:40.407537+0000","last_became_peered":"2024-09-19T09:19:40.407537+0000","last_unstale":"2024-09-19T09:19:40.410822+0000","last_undegraded":"2024-09-19T09:19:40.410822+0000","last_fullsized":"2024-09-19T09:19:40.410822+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:05:00.793684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.404856+0000","last_change":"2024-09-19T09:19:39.407949+0000","last_active":"2024-09-19T09:19:40.404856+0000","last_peered":"2024-09-19T09:19:40.404856+0000","last_clean":"2024-09-19T09:19:40.404856+0000","last_became_active":"2024-09-19T09:19:39.407225+0000","last_became_peered":"2024-09-19T09:19:39.407225+0000","last_unstale":"2024-09-19T09:19:40.404856+0000","last_undegraded":"2024-09-19T09:19:40.404856+0000","last_fullsized":"2024-09-19T09:19:40.404856+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:19.903395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.409092+0000","last_change":"2024-09-19T09:19:40.407389+0000","last_active":"2024-09-19T09:19:40.409092+0000","last_peered":"2024-09-19T09:19:40.409092+0000","last_clean":"2024-09-19T09:19:40.409092+0000","last_became_active":"2024-09-19T09:19:40.407163+0000","last_became_peered":"2024-09-19T09:19:40.407163+0000","last_unstale":"2024-09-19T09:19:40.409092+0000","last_undegraded":"2024-09-19T09:19:40.409092+0000","last_fullsized":"2024-09-19T09:19:40.409092+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:19.427319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.402559+0000","last_change":"2024-09-19T09:19:39.402931+0000","last_active":"2024-09-19T09:19:40.402559+0000","last_peered":"2024-09-19T09:19:40.402559+0000","last_clean":"2024-09-19T09:19:40.402559+0000","last_became_active":"2024-09-19T09:19:39.401132+0000","last_became_peered":"2024-09-19T09:19:39.401132+0000","last_unstale":"2024-09-19T09:19:40.402559+0000","last_undegraded":"2024-09-19T09:19:40.402559+0000","last_fullsized":"2024-09-19T09:19:40.402559+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:53:39.623104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.405387+0000","last_change":"2024-09-19T09:19:40.405272+0000","last_active":"2024-09-19T09:19:40.405387+0000","last_peered":"2024-09-19T09:19:40.405387+0000","last_clean":"2024-09-19T09:19:40.405387+0000","last_became_active":"2024-09-19T09:19:40.404948+0000","last_became_peered":"2024-09-19T09:19:40.404948+0000","last_unstale":"2024-09-19T09:19:40.405387+0000","last_undegraded":"2024-09-19T09:19:40.405387+0000","last_fullsized":"2024-09-19T09:19:40.405387+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:06.009040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.401204+0000","last_change":"2024-09-19T09:19:39.402177+0000","last_active":"2024-09-19T09:19:40.401204+0000","last_peered":"2024-09-19T09:19:40.401204+0000","last_clean":"2024-09-19T09:19:40.401204+0000","last_became_active":"2024-09-19T09:19:39.401937+0000","last_became_peered":"2024-09-19T09:19:39.401937+0000","last_unstale":"2024-09-19T09:19:40.401204+0000","last_undegraded":"2024-09-19T09:19:40.401204+0000","last_fullsized":"2024-09-19T09:19:40.401204+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:02:17.440804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411478+0000","last_change":"2024-09-19T09:19:40.403529+0000","last_active":"2024-09-19T09:19:41.411478+0000","last_peered":"2024-09-19T09:19:41.411478+0000","last_clean":"2024-09-19T09:19:41.411478+0000","last_became_active":"2024-09-19T09:19:40.403244+0000","last_became_peered":"2024-09-19T09:19:40.403244+0000","last_unstale":"2024-09-19T09:19:41.411478+0000","last_undegraded":"2024-09-19T09:19:41.411478+0000","last_fullsized":"2024-09-19T09:19:41.411478+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:56.547141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"137'3","reported_seq":15,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.415927+0000","last_change":"2024-09-19T09:19:39.403973+0000","last_active":"2024-09-19T09:19:40.415927+0000","last_peered":"2024-09-19T09:19:40.415927+0000","last_clean":"2024-09-19T09:19:40.415927+0000","last_became_active":"2024-09-19T09:19:39.403404+0000","last_became_peered":"2024-09-19T09:19:39.403404+0000","last_unstale":"2024-09-19T09:19:40.415927+0000","last_undegraded":"2024-09-19T09:19:40.415927+0000","last_fullsized":"2024-09-19T09:19:40.415927+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:06.118943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.403105+0000","last_change":"2024-09-19T09:19:40.402963+0000","last_active":"2024-09-19T09:19:40.403105+0000","last_peered":"2024-09-19T09:19:40.403105+0000","last_clean":"2024-09-19T09:19:40.403105+0000","last_became_active":"2024-09-19T09:19:40.402729+0000","last_became_peered":"2024-09-19T09:19:40.402729+0000","last_unstale":"2024-09-19T09:19:40.403105+0000","last_undegraded":"2024-09-19T09:19:40.403105+0000","last_fullsized":"2024-09-19T09:19:40.403105+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:14:59.868189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"137'6","reported_seq":18,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.417710+0000","last_change":"2024-09-19T09:19:39.400164+0000","last_active":"2024-09-19T09:19:40.417710+0000","last_peered":"2024-09-19T09:19:40.417710+0000","last_clean":"2024-09-19T09:19:40.417710+0000","last_became_active":"2024-09-19T09:19:39.399929+0000","last_became_peered":"2024-09-19T09:19:39.399929+0000","last_unstale":"2024-09-19T09:19:40.417710+0000","last_undegraded":"2024-09-19T09:19:40.417710+0000","last_fullsized":"2024-09-19T09:19:40.417710+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:53.729475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.408241+0000","last_change":"2024-09-19T09:19:40.408121+0000","last_active":"2024-09-19T09:19:40.408241+0000","last_peered":"2024-09-19T09:19:40.408241+0000","last_clean":"2024-09-19T09:19:40.408241+0000","last_became_active":"2024-09-19T09:19:40.407906+0000","last_became_peered":"2024-09-19T09:19:40.407906+0000","last_unstale":"2024-09-19T09:19:40.408241+0000","last_undegraded":"2024-09-19T09:19:40.408241+0000","last_fullsized":"2024-09-19T09:19:40.408241+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:29.462966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"137'2","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.419690+0000","last_change":"2024-09-19T09:19:39.407447+0000","last_active":"2024-09-19T09:19:40.419690+0000","last_peered":"2024-09-19T09:19:40.419690+0000","last_clean":"2024-09-19T09:19:40.419690+0000","last_became_active":"2024-09-19T09:19:39.406590+0000","last_became_peered":"2024-09-19T09:19:39.406590+0000","last_unstale":"2024-09-19T09:19:40.419690+0000","last_undegraded":"2024-09-19T09:19:40.419690+0000","last_fullsized":"2024-09-19T09:19:40.419690+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:02.421133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.411120+0000","last_change":"2024-09-19T09:19:40.409247+0000","last_active":"2024-09-19T09:19:40.411120+0000","last_peered":"2024-09-19T09:19:40.411120+0000","last_clean":"2024-09-19T09:19:40.411120+0000","last_became_active":"2024-09-19T09:19:40.408825+0000","last_became_peered":"2024-09-19T09:19:40.408825+0000","last_unstale":"2024-09-19T09:19:40.411120+0000","last_undegraded":"2024-09-19T09:19:40.411120+0000","last_fullsized":"2024-09-19T09:19:40.411120+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:42.944326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411471+0000","last_change":"2024-09-19T09:19:39.400997+0000","last_active":"2024-09-19T09:19:41.411471+0000","last_peered":"2024-09-19T09:19:41.411471+0000","last_clean":"2024-09-19T09:19:41.411471+0000","last_became_active":"2024-09-19T09:19:39.400734+0000","last_became_peered":"2024-09-19T09:19:39.400734+0000","last_unstale":"2024-09-19T09:19:41.411471+0000","last_undegraded":"2024-09-19T09:19:41.411471+0000","last_fullsized":"2024-09-19T09:19:41.411471+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:59:36.942221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.411161+0000","last_change":"2024-09-19T09:19:40.410165+0000","last_active":"2024-09-19T09:19:40.411161+0000","last_peered":"2024-09-19T09:19:40.411161+0000","last_clean":"2024-09-19T09:19:40.411161+0000","last_became_active":"2024-09-19T09:19:40.409770+0000","last_became_peered":"2024-09-19T09:19:40.409770+0000","last_unstale":"2024-09-19T09:19:40.411161+0000","last_undegraded":"2024-09-19T09:19:40.411161+0000","last_fullsized":"2024-09-19T09:19:40.411161+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:20.731439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"137'8","reported_seq":20,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.418368+0000","last_change":"2024-09-19T09:19:39.405159+0000","last_active":"2024-09-19T09:19:40.418368+0000","last_peered":"2024-09-19T09:19:40.418368+0000","last_clean":"2024-09-19T09:19:40.418368+0000","last_became_active":"2024-09-19T09:19:39.404890+0000","last_became_peered":"2024-09-19T09:19:39.404890+0000","last_unstale":"2024-09-19T09:19:40.418368+0000","last_undegraded":"2024-09-19T09:19:40.418368+0000","last_fullsized":"2024-09-19T09:19:40.418368+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:29.966852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.405471+0000","last_change":"2024-09-19T09:19:40.405261+0000","last_active":"2024-09-19T09:19:40.405471+0000","last_peered":"2024-09-19T09:19:40.405471+0000","last_clean":"2024-09-19T09:19:40.405471+0000","last_became_active":"2024-09-19T09:19:40.404997+0000","last_became_peered":"2024-09-19T09:19:40.404997+0000","last_unstale":"2024-09-19T09:19:40.405471+0000","last_undegraded":"2024-09-19T09:19:40.405471+0000","last_fullsized":"2024-09-19T09:19:40.405471+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:10.593080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.f","version":"137'1","reported_seq":15,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411598+0000","last_change":"2024-09-19T09:19:39.398376+0000","last_active":"2024-09-19T09:19:41.411598+0000","last_peered":"2024-09-19T09:19:41.411598+0000","last_clean":"2024-09-19T09:19:41.411598+0000","last_became_active":"2024-09-19T09:19:39.397709+0000","last_became_peered":"2024-09-19T09:19:39.397709+0000","last_unstale":"2024-09-19T09:19:41.411598+0000","last_undegraded":"2024-09-19T09:19:41.411598+0000","last_fullsized":"2024-09-19T09:19:41.411598+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:40.992955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.415182+0000","last_change":"2024-09-19T09:19:40.405998+0000","last_active":"2024-09-19T09:19:40.415182+0000","last_peered":"2024-09-19T09:19:40.415182+0000","last_clean":"2024-09-19T09:19:40.415182+0000","last_became_active":"2024-09-19T09:19:40.403824+0000","last_became_peered":"2024-09-19T09:19:40.403824+0000","last_unstale":"2024-09-19T09:19:40.415182+0000","last_undegraded":"2024-09-19T09:19:40.415182+0000","last_fullsized":"2024-09-19T09:19:40.415182+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:56:38.970912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"137'2","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.419152+0000","last_change":"2024-09-19T09:19:39.407665+0000","last_active":"2024-09-19T09:19:40.419152+0000","last_peered":"2024-09-19T09:19:40.419152+0000","last_clean":"2024-09-19T09:19:40.419152+0000","last_became_active":"2024-09-19T09:19:39.406935+0000","last_became_peered":"2024-09-19T09:19:39.406935+0000","last_unstale":"2024-09-19T09:19:40.419152+0000","last_undegraded":"2024-09-19T09:19:40.419152+0000","last_fullsized":"2024-09-19T09:19:40.419152+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:51.964094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.410882+0000","last_change":"2024-09-19T09:19:40.410401+0000","last_active":"2024-09-19T09:19:40.410882+0000","last_peered":"2024-09-19T09:19:40.410882+0000","last_clean":"2024-09-19T09:19:40.410882+0000","last_became_active":"2024-09-19T09:19:40.407694+0000","last_became_peered":"2024-09-19T09:19:40.407694+0000","last_unstale":"2024-09-19T09:19:40.410882+0000","last_undegraded":"2024-09-19T09:19:40.410882+0000","last_fullsized":"2024-09-19T09:19:40.410882+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:39.416117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.d","version":"137'1","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.412559+0000","last_change":"2024-09-19T09:19:39.399404+0000","last_active":"2024-09-19T09:19:40.412559+0000","last_peered":"2024-09-19T09:19:40.412559+0000","last_clean":"2024-09-19T09:19:40.412559+0000","last_became_active":"2024-09-19T09:19:39.399173+0000","last_became_peered":"2024-09-19T09:19:39.399173+0000","last_unstale":"2024-09-19T09:19:40.412559+0000","last_undegraded":"2024-09-19T09:19:40.412559+0000","last_fullsized":"2024-09-19T09:19:40.412559+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:41.067666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.404572+0000","last_change":"2024-09-19T09:19:40.404347+0000","last_active":"2024-09-19T09:19:40.404572+0000","last_peered":"2024-09-19T09:19:40.404572+0000","last_clean":"2024-09-19T09:19:40.404572+0000","last_became_active":"2024-09-19T09:19:40.403732+0000","last_became_peered":"2024-09-19T09:19:40.403732+0000","last_unstale":"2024-09-19T09:19:40.404572+0000","last_undegraded":"2024-09-19T09:19:40.404572+0000","last_fullsized":"2024-09-19T09:19:40.404572+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:33.180784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.399306+0000","last_change":"2024-09-19T09:19:39.401291+0000","last_active":"2024-09-19T09:19:40.399306+0000","last_peered":"2024-09-19T09:19:40.399306+0000","last_clean":"2024-09-19T09:19:40.399306+0000","last_became_active":"2024-09-19T09:19:39.401068+0000","last_became_peered":"2024-09-19T09:19:39.401068+0000","last_unstale":"2024-09-19T09:19:40.399306+0000","last_undegraded":"2024-09-19T09:19:40.399306+0000","last_fullsized":"2024-09-19T09:19:40.399306+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:02:22.571662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411532+0000","last_change":"2024-09-19T09:19:40.409325+0000","last_active":"2024-09-19T09:19:41.411532+0000","last_peered":"2024-09-19T09:19:41.411532+0000","last_clean":"2024-09-19T09:19:41.411532+0000","last_became_active":"2024-09-19T09:19:40.408589+0000","last_became_peered":"2024-09-19T09:19:40.408589+0000","last_unstale":"2024-09-19T09:19:41.411532+0000","last_undegraded":"2024-09-19T09:19:41.411532+0000","last_fullsized":"2024-09-19T09:19:41.411532+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:18.037908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.b","version":"137'2","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.416024+0000","last_change":"2024-09-19T09:19:39.404244+0000","last_active":"2024-09-19T09:19:40.416024+0000","last_peered":"2024-09-19T09:19:40.416024+0000","last_clean":"2024-09-19T09:19:40.416024+0000","last_became_active":"2024-09-19T09:19:39.403736+0000","last_became_peered":"2024-09-19T09:19:39.403736+0000","last_unstale":"2024-09-19T09:19:40.416024+0000","last_undegraded":"2024-09-19T09:19:40.416024+0000","last_fullsized":"2024-09-19T09:19:40.416024+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:53.214718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.415299+0000","last_change":"2024-09-19T09:19:40.408714+0000","last_active":"2024-09-19T09:19:40.415299+0000","last_peered":"2024-09-19T09:19:40.415299+0000","last_clean":"2024-09-19T09:19:40.415299+0000","last_became_active":"2024-09-19T09:19:40.408188+0000","last_became_peered":"2024-09-19T09:19:40.408188+0000","last_unstale":"2024-09-19T09:19:40.415299+0000","last_undegraded":"2024-09-19T09:19:40.415299+0000","last_fullsized":"2024-09-19T09:19:40.415299+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:45.346049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.399802+0000","last_change":"2024-09-19T09:19:39.401076+0000","last_active":"2024-09-19T09:19:40.399802+0000","last_peered":"2024-09-19T09:19:40.399802+0000","last_clean":"2024-09-19T09:19:40.399802+0000","last_became_active":"2024-09-19T09:19:39.400829+0000","last_became_peered":"2024-09-19T09:19:39.400829+0000","last_unstale":"2024-09-19T09:19:40.399802+0000","last_undegraded":"2024-09-19T09:19:40.399802+0000","last_fullsized":"2024-09-19T09:19:40.399802+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:17.587700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.404190+0000","last_change":"2024-09-19T09:19:40.404068+0000","last_active":"2024-09-19T09:19:40.404190+0000","last_peered":"2024-09-19T09:19:40.404190+0000","last_clean":"2024-09-19T09:19:40.404190+0000","last_became_active":"2024-09-19T09:19:40.403308+0000","last_became_peered":"2024-09-19T09:19:40.403308+0000","last_unstale":"2024-09-19T09:19:40.404190+0000","last_undegraded":"2024-09-19T09:19:40.404190+0000","last_fullsized":"2024-09-19T09:19:40.404190+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:50.763368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.401772+0000","last_change":"2024-09-19T09:19:39.403144+0000","last_active":"2024-09-19T09:19:40.401772+0000","last_peered":"2024-09-19T09:19:40.401772+0000","last_clean":"2024-09-19T09:19:40.401772+0000","last_became_active":"2024-09-19T09:19:39.402745+0000","last_became_peered":"2024-09-19T09:19:39.402745+0000","last_unstale":"2024-09-19T09:19:40.401772+0000","last_undegraded":"2024-09-19T09:19:40.401772+0000","last_fullsized":"2024-09-19T09:19:40.401772+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:17.657680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.417501+0000","last_change":"2024-09-19T09:19:40.417355+0000","last_active":"2024-09-19T09:19:40.417501+0000","last_peered":"2024-09-19T09:19:40.417501+0000","last_clean":"2024-09-19T09:19:40.417501+0000","last_became_active":"2024-09-19T09:19:40.415180+0000","last_became_peered":"2024-09-19T09:19:40.415180+0000","last_unstale":"2024-09-19T09:19:40.417501+0000","last_undegraded":"2024-09-19T09:19:40.417501+0000","last_fullsized":"2024-09-19T09:19:40.417501+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:24.353197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.402697+0000","last_change":"2024-09-19T09:19:39.403554+0000","last_active":"2024-09-19T09:19:40.402697+0000","last_peered":"2024-09-19T09:19:40.402697+0000","last_clean":"2024-09-19T09:19:40.402697+0000","last_became_active":"2024-09-19T09:19:39.402630+0000","last_became_peered":"2024-09-19T09:19:39.402630+0000","last_unstale":"2024-09-19T09:19:40.402697+0000","last_undegraded":"2024-09-19T09:19:40.402697+0000","last_fullsized":"2024-09-19T09:19:40.402697+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:54.615978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.404168+0000","last_change":"2024-09-19T09:19:40.404055+0000","last_active":"2024-09-19T09:19:40.404168+0000","last_peered":"2024-09-19T09:19:40.404168+0000","last_clean":"2024-09-19T09:19:40.404168+0000","last_became_active":"2024-09-19T09:19:40.403806+0000","last_became_peered":"2024-09-19T09:19:40.403806+0000","last_unstale":"2024-09-19T09:19:40.404168+0000","last_undegraded":"2024-09-19T09:19:40.404168+0000","last_fullsized":"2024-09-19T09:19:40.404168+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:59:44.206233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"137'2","reported_seq":14,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.412861+0000","last_change":"2024-09-19T09:19:39.402175+0000","last_active":"2024-09-19T09:19:40.412861+0000","last_peered":"2024-09-19T09:19:40.412861+0000","last_clean":"2024-09-19T09:19:40.412861+0000","last_became_active":"2024-09-19T09:19:39.401099+0000","last_became_peered":"2024-09-19T09:19:39.401099+0000","last_unstale":"2024-09-19T09:19:40.412861+0000","last_undegraded":"2024-09-19T09:19:40.412861+0000","last_fullsized":"2024-09-19T09:19:40.412861+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:11.144782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411939+0000","last_change":"2024-09-19T09:19:40.410361+0000","last_active":"2024-09-19T09:19:41.411939+0000","last_peered":"2024-09-19T09:19:41.411939+0000","last_clean":"2024-09-19T09:19:41.411939+0000","last_became_active":"2024-09-19T09:19:40.410116+0000","last_became_peered":"2024-09-19T09:19:40.410116+0000","last_unstale":"2024-09-19T09:19:41.411939+0000","last_undegraded":"2024-09-19T09:19:41.411939+0000","last_fullsized":"2024-09-19T09:19:41.411939+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:10:52.592714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"137'1","reported_seq":13,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.400394+0000","last_change":"2024-09-19T09:19:39.405036+0000","last_active":"2024-09-19T09:19:41.400394+0000","last_peered":"2024-09-19T09:19:41.400394+0000","last_clean":"2024-09-19T09:19:41.400394+0000","last_became_active":"2024-09-19T09:19:39.404770+0000","last_became_peered":"2024-09-19T09:19:39.404770+0000","last_unstale":"2024-09-19T09:19:41.400394+0000","last_undegraded":"2024-09-19T09:19:41.400394+0000","last_fullsized":"2024-09-19T09:19:41.400394+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:42.225366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.415281+0000","last_change":"2024-09-19T09:19:40.406878+0000","last_active":"2024-09-19T09:19:40.415281+0000","last_peered":"2024-09-19T09:19:40.415281+0000","last_clean":"2024-09-19T09:19:40.415281+0000","last_became_active":"2024-09-19T09:19:40.406602+0000","last_became_peered":"2024-09-19T09:19:40.406602+0000","last_unstale":"2024-09-19T09:19:40.415281+0000","last_undegraded":"2024-09-19T09:19:40.415281+0000","last_fullsized":"2024-09-19T09:19:40.415281+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:41:07.463625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.399488+0000","last_change":"2024-09-19T09:19:39.401114+0000","last_active":"2024-09-19T09:19:40.399488+0000","last_peered":"2024-09-19T09:19:40.399488+0000","last_clean":"2024-09-19T09:19:40.399488+0000","last_became_active":"2024-09-19T09:19:39.400872+0000","last_became_peered":"2024-09-19T09:19:39.400872+0000","last_unstale":"2024-09-19T09:19:40.399488+0000","last_undegraded":"2024-09-19T09:19:40.399488+0000","last_fullsized":"2024-09-19T09:19:40.399488+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:35.510193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.407276+0000","last_change":"2024-09-19T09:19:40.407163+0000","last_active":"2024-09-19T09:19:40.407276+0000","last_peered":"2024-09-19T09:19:40.407276+0000","last_clean":"2024-09-19T09:19:40.407276+0000","last_became_active":"2024-09-19T09:19:40.406532+0000","last_became_peered":"2024-09-19T09:19:40.406532+0000","last_unstale":"2024-09-19T09:19:40.407276+0000","last_undegraded":"2024-09-19T09:19:40.407276+0000","last_fullsized":"2024-09-19T09:19:40.407276+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:13.317154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.401918+0000","last_change":"2024-09-19T09:19:39.399727+0000","last_active":"2024-09-19T09:19:40.401918+0000","last_peered":"2024-09-19T09:19:40.401918+0000","last_clean":"2024-09-19T09:19:40.401918+0000","last_became_active":"2024-09-19T09:19:39.399502+0000","last_became_peered":"2024-09-19T09:19:39.399502+0000","last_unstale":"2024-09-19T09:19:40.401918+0000","last_undegraded":"2024-09-19T09:19:40.401918+0000","last_fullsized":"2024-09-19T09:19:40.401918+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:02:55.851292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411530+0000","last_change":"2024-09-19T09:19:40.408920+0000","last_active":"2024-09-19T09:19:41.411530+0000","last_peered":"2024-09-19T09:19:41.411530+0000","last_clean":"2024-09-19T09:19:41.411530+0000","last_became_active":"2024-09-19T09:19:40.408672+0000","last_became_peered":"2024-09-19T09:19:40.408672+0000","last_unstale":"2024-09-19T09:19:41.411530+0000","last_undegraded":"2024-09-19T09:19:41.411530+0000","last_fullsized":"2024-09-19T09:19:41.411530+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:07.977580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.396340+0000","last_change":"2024-09-19T09:19:39.402740+0000","last_active":"2024-09-19T09:19:40.396340+0000","last_peered":"2024-09-19T09:19:40.396340+0000","last_clean":"2024-09-19T09:19:40.396340+0000","last_became_active":"2024-09-19T09:19:39.402513+0000","last_became_peered":"2024-09-19T09:19:39.402513+0000","last_unstale":"2024-09-19T09:19:40.396340+0000","last_undegraded":"2024-09-19T09:19:40.396340+0000","last_fullsized":"2024-09-19T09:19:40.396340+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:25:02.569725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.406245+0000","last_change":"2024-09-19T09:19:40.405334+0000","last_active":"2024-09-19T09:19:40.406245+0000","last_peered":"2024-09-19T09:19:40.406245+0000","last_clean":"2024-09-19T09:19:40.406245+0000","last_became_active":"2024-09-19T09:19:40.404959+0000","last_became_peered":"2024-09-19T09:19:40.404959+0000","last_unstale":"2024-09-19T09:19:40.406245+0000","last_undegraded":"2024-09-19T09:19:40.406245+0000","last_fullsized":"2024-09-19T09:19:40.406245+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:42.804029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.399442+0000","last_change":"2024-09-19T09:19:39.400784+0000","last_active":"2024-09-19T09:19:40.399442+0000","last_peered":"2024-09-19T09:19:40.399442+0000","last_clean":"2024-09-19T09:19:40.399442+0000","last_became_active":"2024-09-19T09:19:39.400457+0000","last_became_peered":"2024-09-19T09:19:39.400457+0000","last_unstale":"2024-09-19T09:19:40.399442+0000","last_undegraded":"2024-09-19T09:19:40.399442+0000","last_fullsized":"2024-09-19T09:19:40.399442+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:48.304040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.410660+0000","last_change":"2024-09-19T09:19:40.410497+0000","last_active":"2024-09-19T09:19:40.410660+0000","last_peered":"2024-09-19T09:19:40.410660+0000","last_clean":"2024-09-19T09:19:40.410660+0000","last_became_active":"2024-09-19T09:19:40.410268+0000","last_became_peered":"2024-09-19T09:19:40.410268+0000","last_unstale":"2024-09-19T09:19:40.410660+0000","last_undegraded":"2024-09-19T09:19:40.410660+0000","last_fullsized":"2024-09-19T09:19:40.410660+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:22.789952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.401655+0000","last_change":"2024-09-19T09:19:39.404562+0000","last_active":"2024-09-19T09:19:40.401655+0000","last_peered":"2024-09-19T09:19:40.401655+0000","last_clean":"2024-09-19T09:19:40.401655+0000","last_became_active":"2024-09-19T09:19:39.404321+0000","last_became_peered":"2024-09-19T09:19:39.404321+0000","last_unstale":"2024-09-19T09:19:40.401655+0000","last_undegraded":"2024-09-19T09:19:40.401655+0000","last_fullsized":"2024-09-19T09:19:40.401655+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:18.011073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":12,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411809+0000","last_change":"2024-09-19T09:19:40.404499+0000","last_active":"2024-09-19T09:19:41.411809+0000","last_peered":"2024-09-19T09:19:41.411809+0000","last_clean":"2024-09-19T09:19:41.411809+0000","last_became_active":"2024-09-19T09:19:40.404277+0000","last_became_peered":"2024-09-19T09:19:40.404277+0000","last_unstale":"2024-09-19T09:19:41.411809+0000","last_undegraded":"2024-09-19T09:19:41.411809+0000","last_fullsized":"2024-09-19T09:19:41.411809+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:11.068458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":14,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411711+0000","last_change":"2024-09-19T09:19:39.397948+0000","last_active":"2024-09-19T09:19:41.411711+0000","last_peered":"2024-09-19T09:19:41.411711+0000","last_clean":"2024-09-19T09:19:41.411711+0000","last_became_active":"2024-09-19T09:19:39.397415+0000","last_became_peered":"2024-09-19T09:19:39.397415+0000","last_unstale":"2024-09-19T09:19:41.411711+0000","last_undegraded":"2024-09-19T09:19:41.411711+0000","last_fullsized":"2024-09-19T09:19:41.411711+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:17:36.204314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.407785+0000","last_change":"2024-09-19T09:19:40.407613+0000","last_active":"2024-09-19T09:19:40.407785+0000","last_peered":"2024-09-19T09:19:40.407785+0000","last_clean":"2024-09-19T09:19:40.407785+0000","last_became_active":"2024-09-19T09:19:40.407374+0000","last_became_peered":"2024-09-19T09:19:40.407374+0000","last_unstale":"2024-09-19T09:19:40.407785+0000","last_undegraded":"2024-09-19T09:19:40.407785+0000","last_fullsized":"2024-09-19T09:19:40.407785+0000","mapping_epoch":136,"log_start":"0'0","ondisk_log_start":"0'0","created":136,"last_epoch_clean":137,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:39.385648+0000","last_clean_scrub_stamp":"2024-09-19T09:19:39.385648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:41:53.817175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":12,"reported_epoch":137,"state":"active+clean","last_fresh":"2024-09-19T09:19:40.406485+0000","last_change":"2024-09-19T09:19:39.401212+0000","last_active":"2024-09-19T09:19:40.406485+0000","last_peered":"2024-09-19T09:19:40.406485+0000","last_clean":"2024-09-19T09:19:40.406485+0000","last_became_active":"2024-09-19T09:19:39.400030+0000","last_became_peered":"2024-09-19T09:19:39.400030+0000","last_unstale":"2024-09-19T09:19:40.406485+0000","last_undegraded":"2024-09-19T09:19:40.406485+0000","last_fullsized":"2024-09-19T09:19:40.406485+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:19:38.383451+0000","last_clean_scrub_stamp":"2024-09-19T09:19:38.383451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:11:18.236287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":402,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-19T09:19:41.411595+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:19:41.411595+0000","last_peered":"2024-09-19T09:19:41.411595+0000","last_clean":"2024-09-19T09:19:41.411595+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:19:41.411595+0000","last_undegraded":"2024-09-19T09:19:41.411595+0000","last_fullsized":"2024-09-19T09:19:41.411595+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:28.823470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":742,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194570,"statfs":{"total":200000000,"available":199239943,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":740,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194571,"statfs":{"total":200000000,"available":199241679,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574927,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1317,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193995,"statfs":{"total":200000000,"available":198651219,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":742,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194570,"statfs":{"total":200000000,"available":199239977,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":740,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194571,"statfs":{"total":200000000,"available":199241679,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":741,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194571,"statfs":{"total":200000000,"available":199241041,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1317,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193995,"statfs":{"total":200000000,"available":198651311,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":741,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194571,"statfs":{"total":200000000,"available":199241027,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:19:44.758 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T09:19:44.759 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-19T09:19:44.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.904+0000 7fe55770a640 1 Processor -- start 2024-09-19T09:19:44.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.904+0000 7fe55770a640 1 -- start start 2024-09-19T09:19:44.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.905+0000 7fe55770a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe5501623c0 0x7fe5500b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:44.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.905+0000 7fe55770a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe5500d1470 0x7fe5500d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:44.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.905+0000 7fe55770a640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5500d3700 con 0x7fe5500d56b0 2024-09-19T09:19:44.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.905+0000 7fe55770a640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fe5500d21a0 con 0x7fe5501623c0 2024-09-19T09:19:44.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.905+0000 7fe55770a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe5500d0080 con 0x7fe5500d1470 2024-09-19T09:19:44.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.905+0000 7fe5554a6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe5501623c0 0x7fe5500b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:44.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.905+0000 7fe554ca5640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe5500d56b0 0x7fe5500d0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:41254/0 (socket says 172.21.15.18:41254) 2024-09-19T09:19:44.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.905+0000 7fe5554a6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe5501623c0 0x7fe5500b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38346/0 (socket says 172.21.15.18:38346) 2024-09-19T09:19:44.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.905+0000 7fe554ca5640 1 -- 172.21.15.18:0/1252543003 learned_addr learned my addr 172.21.15.18:0/1252543003 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:44.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.906+0000 7fe555ca7640 1 --2- 172.21.15.18:0/1252543003 >> v2:172.21.15.162:3300/0 conn(0x7fe5500d1470 0x7fe5500d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:44.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.906+0000 7fe5554a6640 1 -- 172.21.15.18:0/1252543003 >> v2:172.21.15.162:3300/0 conn(0x7fe5500d1470 msgr2=0x7fe5500d1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:44.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.906+0000 7fe5554a6640 1 --2- 172.21.15.18:0/1252543003 >> v2:172.21.15.162:3300/0 conn(0x7fe5500d1470 0x7fe5500d1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.906+0000 7fe5554a6640 1 -- 172.21.15.18:0/1252543003 >> v1:172.21.15.18:6789/0 conn(0x7fe5500d56b0 legacy=0x7fe5500d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:44.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.906+0000 7fe54ffff640 1 -- 172.21.15.18:0/1252543003 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1250287934 0 0) 0x7fe5500d3700 con 0x7fe5500d56b0 2024-09-19T09:19:44.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.906+0000 7fe5554a6640 1 -- 172.21.15.18:0/1252543003 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5500cfa70 con 0x7fe5501623c0 2024-09-19T09:19:44.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.907+0000 7fe5554a6640 1 --2- 172.21.15.18:0/1252543003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5501623c0 0x7fe5500b6260 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fe5500cbcc0 tx=0x7fe54002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=521cb576ed29b439 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:44.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.907+0000 7fe54ffff640 1 -- 172.21.15.18:0/1252543003 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe540007740 con 0x7fe5501623c0 2024-09-19T09:19:44.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.907+0000 7fe54ffff640 1 -- 172.21.15.18:0/1252543003 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5400078e0 con 0x7fe5501623c0 2024-09-19T09:19:44.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.907+0000 7fe54ffff640 1 -- 172.21.15.18:0/1252543003 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe540007cb0 con 0x7fe5501623c0 2024-09-19T09:19:44.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.907+0000 7fe55770a640 1 -- 172.21.15.18:0/1252543003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5501623c0 msgr2=0x7fe5500b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:44.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.907+0000 7fe55770a640 1 --2- 172.21.15.18:0/1252543003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5501623c0 0x7fe5500b6260 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fe5500cbcc0 tx=0x7fe54002a680 comp rx=0 tx=0).stop 2024-09-19T09:19:44.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.907+0000 7fe55770a640 1 -- 172.21.15.18:0/1252543003 shutdown_connections 2024-09-19T09:19:44.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.907+0000 7fe55770a640 1 --2- 172.21.15.18:0/1252543003 >> v2:172.21.15.162:3300/0 conn(0x7fe5500d1470 0x7fe5500d1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.907+0000 7fe55770a640 1 --2- 172.21.15.18:0/1252543003 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5501623c0 0x7fe5500b6260 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.907+0000 7fe55770a640 1 -- 172.21.15.18:0/1252543003 >> 172.21.15.18:0/1252543003 conn(0x7fe55009df30 msgr2=0x7fe5500d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:44.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.907+0000 7fe55770a640 1 -- 172.21.15.18:0/1252543003 shutdown_connections 2024-09-19T09:19:44.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.907+0000 7fe55770a640 1 -- 172.21.15.18:0/1252543003 wait complete. 2024-09-19T09:19:44.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.908+0000 7fe55770a640 1 Processor -- start 2024-09-19T09:19:44.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.909+0000 7fe55770a640 1 -- start start 2024-09-19T09:19:44.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.909+0000 7fe55770a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5500d1470 0x7fe55014ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:44.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.909+0000 7fe55770a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5500d56b0 0x7fe5500cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:44.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.909+0000 7fe55770a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5501623c0 0x7fe5500ba4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:44.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.909+0000 7fe55770a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe5500cfd10 con 0x7fe5501623c0 2024-09-19T09:19:44.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.909+0000 7fe55770a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe5500d39a0 con 0x7fe5500d56b0 2024-09-19T09:19:44.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.909+0000 7fe55770a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe5501627a0 con 0x7fe5500d1470 2024-09-19T09:19:44.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.909+0000 7fe555ca7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5501623c0 0x7fe5500ba4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:44.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.909+0000 7fe555ca7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5501623c0 0x7fe5500ba4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38362/0 (socket says 172.21.15.18:38362) 2024-09-19T09:19:44.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.909+0000 7fe555ca7640 1 -- 172.21.15.18:0/3413090575 learned_addr learned my addr 172.21.15.18:0/3413090575 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:44.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.910+0000 7fe555ca7640 1 -- 172.21.15.18:0/3413090575 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5500d1470 msgr2=0x7fe55014ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:44.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.910+0000 7fe555ca7640 1 --2- 172.21.15.18:0/3413090575 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5500d1470 0x7fe55014ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.910+0000 7fe554ca5640 1 --2- 172.21.15.18:0/3413090575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5500d56b0 0x7fe5500cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:44.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.910+0000 7fe555ca7640 1 -- 172.21.15.18:0/3413090575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5500d56b0 msgr2=0x7fe5500cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:44.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.910+0000 7fe555ca7640 1 --2- 172.21.15.18:0/3413090575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5500d56b0 0x7fe5500cabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:44.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.910+0000 7fe555ca7640 1 -- 172.21.15.18:0/3413090575 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5500c9840 con 0x7fe5501623c0 2024-09-19T09:19:44.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.910+0000 7fe555ca7640 1 --2- 172.21.15.18:0/3413090575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5501623c0 0x7fe5500ba4b0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fe54800d5d0 tx=0x7fe54800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:44.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.910+0000 7fe54dffb640 1 -- 172.21.15.18:0/3413090575 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5480125f0 con 0x7fe5501623c0 2024-09-19T09:19:44.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.910+0000 7fe54dffb640 1 -- 172.21.15.18:0/3413090575 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe548019070 con 0x7fe5501623c0 2024-09-19T09:19:44.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.910+0000 7fe55770a640 1 -- 172.21.15.18:0/3413090575 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5500c9b20 con 0x7fe5501623c0 2024-09-19T09:19:44.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.910+0000 7fe54dffb640 1 -- 172.21.15.18:0/3413090575 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5480129f0 con 0x7fe5501623c0 2024-09-19T09:19:44.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.910+0000 7fe55770a640 1 -- 172.21.15.18:0/3413090575 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5500ca0e0 con 0x7fe5501623c0 2024-09-19T09:19:44.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.911+0000 7fe55770a640 1 -- 172.21.15.18:0/3413090575 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5500d3c80 con 0x7fe5501623c0 2024-09-19T09:19:44.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.912+0000 7fe54dffb640 1 -- 172.21.15.18:0/3413090575 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe548012b90 con 0x7fe5501623c0 2024-09-19T09:19:44.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.912+0000 7fe54dffb640 1 --2- 172.21.15.18:0/3413090575 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe53c06c2b0 0x7fe53c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:44.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.912+0000 7fe54dffb640 1 -- 172.21.15.18:0/3413090575 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7fe54808b810 con 0x7fe5501623c0 2024-09-19T09:19:44.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.912+0000 7fe5554a6640 1 --2- 172.21.15.18:0/3413090575 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe53c06c2b0 0x7fe53c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:44.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.913+0000 7fe5554a6640 1 --2- 172.21.15.18:0/3413090575 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe53c06c2b0 0x7fe53c06e770 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe540034000 tx=0x7fe54002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:44.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:44.916+0000 7fe54dffb640 1 -- 172.21.15.18:0/3413090575 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe548059f90 con 0x7fe5501623c0 2024-09-19T09:19:45.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.163+0000 7fe55770a640 1 -- 172.21.15.18:0/3413090575 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fe5500d2340 con 0x7fe5501623c0 2024-09-19T09:19:45.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.165+0000 7fe54dffb640 1 -- 172.21.15.18:0/3413090575 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7fe548059890 con 0x7fe5501623c0 2024-09-19T09:19:45.166 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-09-19T09:19:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAe6+tmcbwDNhAAaG0+wu96Locwws+h0zeh8Q== 2024-09-19T09:19:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: caps mds = "allow" 2024-09-19T09:19:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: caps mon = "allow r" 2024-09-19T09:19:45.166 INFO:teuthology.orchestra.run.smithi018.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-19T09:19:45.166 INFO:teuthology.orchestra.run.smithi018.stderr:updated caps for client.0 2024-09-19T09:19:45.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.167+0000 7fe55770a640 1 -- 172.21.15.18:0/3413090575 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe53c06c2b0 msgr2=0x7fe53c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:45.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.167+0000 7fe55770a640 1 --2- 172.21.15.18:0/3413090575 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe53c06c2b0 0x7fe53c06e770 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fe540034000 tx=0x7fe54002e000 comp rx=0 tx=0).stop 2024-09-19T09:19:45.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.167+0000 7fe55770a640 1 -- 172.21.15.18:0/3413090575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5501623c0 msgr2=0x7fe5500ba4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:45.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.167+0000 7fe55770a640 1 --2- 172.21.15.18:0/3413090575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5501623c0 0x7fe5500ba4b0 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fe54800d5d0 tx=0x7fe54800da90 comp rx=0 tx=0).stop 2024-09-19T09:19:45.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.167+0000 7fe55770a640 1 -- 172.21.15.18:0/3413090575 shutdown_connections 2024-09-19T09:19:45.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.167+0000 7fe55770a640 1 --2- 172.21.15.18:0/3413090575 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe53c06c2b0 0x7fe53c06e770 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:45.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.167+0000 7fe55770a640 1 --2- 172.21.15.18:0/3413090575 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe5501623c0 0x7fe5500ba4b0 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:45.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.167+0000 7fe55770a640 1 --2- 172.21.15.18:0/3413090575 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe5500d56b0 0x7fe5500cabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:45.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.167+0000 7fe55770a640 1 --2- 172.21.15.18:0/3413090575 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe5500d1470 0x7fe55014ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:45.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.167+0000 7fe55770a640 1 -- 172.21.15.18:0/3413090575 >> 172.21.15.18:0/3413090575 conn(0x7fe55009df30 msgr2=0x7fe5500b4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:45.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.167+0000 7fe55770a640 1 -- 172.21.15.18:0/3413090575 shutdown_connections 2024-09-19T09:19:45.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.167+0000 7fe55770a640 1 -- 172.21.15.18:0/3413090575 wait complete. 2024-09-19T09:19:45.178 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:19:45.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.279+0000 7f9822847640 1 Processor -- start 2024-09-19T09:19:45.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.279+0000 7f9822847640 1 -- start start 2024-09-19T09:19:45.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.280+0000 7f9822847640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f981c072f40 0x7f981c06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:45.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.280+0000 7f9822847640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f981c06e3d0 con 0x7f981c0ce780 2024-09-19T09:19:45.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.280+0000 7f9822847640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f981c06e6b0 con 0x7f981c145290 2024-09-19T09:19:45.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.280+0000 7f9822847640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f981c06efe0 con 0x7f981c072f40 2024-09-19T09:19:45.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.280+0000 7f981b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f981c072f40 0x7f981c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:45.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.280+0000 7f9820de4640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f981c0ce780 0x7f981c0b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:58962/0 (socket says 172.21.15.18:58962) 2024-09-19T09:19:45.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.280+0000 7f9820de4640 1 -- 172.21.15.18:0/3780612980 learned_addr learned my addr 172.21.15.18:0/3780612980 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:45.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.281+0000 7f981b7fe640 1 -- 172.21.15.18:0/3780612980 >> v1:172.21.15.162:6789/0 conn(0x7f981c145290 legacy=0x7f981c072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:45.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.281+0000 7f981b7fe640 1 -- 172.21.15.18:0/3780612980 >> v1:172.21.15.18:6789/0 conn(0x7f981c0ce780 legacy=0x7f981c0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:45.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.281+0000 7f981b7fe640 1 -- 172.21.15.18:0/3780612980 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981c06e990 con 0x7f981c072f40 2024-09-19T09:19:45.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.281+0000 7f981affd640 1 -- 172.21.15.18:0/3780612980 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3806532021 0 0) 0x7f981c06e3d0 con 0x7f981c0ce780 2024-09-19T09:19:45.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.281+0000 7f981b7fe640 1 --2- 172.21.15.18:0/3780612980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f981c072f40 0x7f981c06f470 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f98100097a0 tx=0x7f981002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16640a57aa61316 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:45.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.282+0000 7f981affd640 1 -- 172.21.15.18:0/3780612980 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9810037070 con 0x7f981c072f40 2024-09-19T09:19:45.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.282+0000 7f981affd640 1 -- 172.21.15.18:0/3780612980 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9810032440 con 0x7f981c072f40 2024-09-19T09:19:45.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.282+0000 7f981affd640 1 -- 172.21.15.18:0/3780612980 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9810032810 con 0x7f981c072f40 2024-09-19T09:19:45.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.282+0000 7f9822847640 1 -- 172.21.15.18:0/3780612980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f981c072f40 msgr2=0x7f981c06f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:45.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.282+0000 7f9822847640 1 --2- 172.21.15.18:0/3780612980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f981c072f40 0x7f981c06f470 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f98100097a0 tx=0x7f981002a230 comp rx=0 tx=0).stop 2024-09-19T09:19:45.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.282+0000 7f9822847640 1 -- 172.21.15.18:0/3780612980 shutdown_connections 2024-09-19T09:19:45.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.282+0000 7f9822847640 1 --2- 172.21.15.18:0/3780612980 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f981c072f40 0x7f981c06f470 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:45.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.282+0000 7f9822847640 1 -- 172.21.15.18:0/3780612980 >> 172.21.15.18:0/3780612980 conn(0x7f981c06bc10 msgr2=0x7f981c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:45.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.282+0000 7f9822847640 1 -- 172.21.15.18:0/3780612980 shutdown_connections 2024-09-19T09:19:45.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.282+0000 7f9822847640 1 -- 172.21.15.18:0/3780612980 wait complete. 2024-09-19T09:19:45.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.283+0000 7f9822847640 1 Processor -- start 2024-09-19T09:19:45.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.284+0000 7f9822847640 1 -- start start 2024-09-19T09:19:45.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.284+0000 7f9822847640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f981c072f40 0x7f981c1557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:45.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.284+0000 7f9822847640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f981c0ce780 0x7f981c13bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:45.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.284+0000 7f9822847640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f981c145290 0x7f981c1561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:45.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.284+0000 7f9822847640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f981c06df80 con 0x7f981c145290 2024-09-19T09:19:45.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.284+0000 7f9822847640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f981c145670 con 0x7f981c0ce780 2024-09-19T09:19:45.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.284+0000 7f9822847640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f981c06e100 con 0x7f981c072f40 2024-09-19T09:19:45.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.284+0000 7f9820de4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f981c145290 0x7f981c1561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:45.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.285+0000 7f9820de4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f981c145290 0x7f981c1561b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46844/0 (socket says 172.21.15.18:46844) 2024-09-19T09:19:45.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.285+0000 7f9820de4640 1 -- 172.21.15.18:0/2036071385 learned_addr learned my addr 172.21.15.18:0/2036071385 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:45.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.285+0000 7f981b7fe640 1 --2- 172.21.15.18:0/2036071385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f981c0ce780 0x7f981c13bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:45.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.285+0000 7f981bfff640 1 --2- 172.21.15.18:0/2036071385 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f981c072f40 0x7f981c1557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:45.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.285+0000 7f9820de4640 1 -- 172.21.15.18:0/2036071385 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f981c072f40 msgr2=0x7f981c1557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:45.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.285+0000 7f9820de4640 1 --2- 172.21.15.18:0/2036071385 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f981c072f40 0x7f981c1557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:45.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.285+0000 7f9820de4640 1 -- 172.21.15.18:0/2036071385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f981c0ce780 msgr2=0x7f981c13bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:45.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.285+0000 7f9820de4640 1 --2- 172.21.15.18:0/2036071385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f981c0ce780 0x7f981c13bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:45.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.285+0000 7f9820de4640 1 -- 172.21.15.18:0/2036071385 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981c155db0 con 0x7f981c145290 2024-09-19T09:19:45.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.285+0000 7f9820de4640 1 --2- 172.21.15.18:0/2036071385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f981c145290 0x7f981c1561b0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f981400c7a0 tx=0x7f981400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:45.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.285+0000 7f9818ff9640 1 -- 172.21.15.18:0/2036071385 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9814018070 con 0x7f981c145290 2024-09-19T09:19:45.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.285+0000 7f9818ff9640 1 -- 172.21.15.18:0/2036071385 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f981400a640 con 0x7f981c145290 2024-09-19T09:19:45.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.285+0000 7f9822847640 1 -- 172.21.15.18:0/2036071385 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f981c142770 con 0x7f981c145290 2024-09-19T09:19:45.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.285+0000 7f9818ff9640 1 -- 172.21.15.18:0/2036071385 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f981400aab0 con 0x7f981c145290 2024-09-19T09:19:45.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.285+0000 7f9822847640 1 -- 172.21.15.18:0/2036071385 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f981c142d30 con 0x7f981c145290 2024-09-19T09:19:45.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.286+0000 7f9822847640 1 -- 172.21.15.18:0/2036071385 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f981c071510 con 0x7f981c145290 2024-09-19T09:19:45.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.287+0000 7f9818ff9640 1 -- 172.21.15.18:0/2036071385 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f981401b070 con 0x7f981c145290 2024-09-19T09:19:45.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.287+0000 7f9818ff9640 1 --2- 172.21.15.18:0/2036071385 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f980806c2b0 0x7f980806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:45.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.287+0000 7f9818ff9640 1 -- 172.21.15.18:0/2036071385 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7f981408aaf0 con 0x7f981c145290 2024-09-19T09:19:45.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.288+0000 7f981bfff640 1 --2- 172.21.15.18:0/2036071385 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f980806c2b0 0x7f980806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:45.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.288+0000 7f981bfff640 1 --2- 172.21.15.18:0/2036071385 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f980806c2b0 0x7f980806e770 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f980c000f60 tx=0x7f980c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:45.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.292+0000 7f9818ff9640 1 -- 172.21.15.18:0/2036071385 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9814058ae0 con 0x7f981c145290 2024-09-19T09:19:45.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.503+0000 7f9822847640 1 -- 172.21.15.18:0/2036071385 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f981c15daa0 con 0x7f981c145290 2024-09-19T09:19:45.504 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.503+0000 7f9818ff9640 1 -- 172.21.15.18:0/2036071385 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5231 (secure 0 0 0) 0x7f981405cde0 con 0x7f981c145290 2024-09-19T09:19:45.504 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:45.504 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":56,"btime":"2024-09-19T09:19:43:414636+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5846,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1876507362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1876507362},{"type":"v1","addr":"172.21.15.162:6837","nonce":1876507362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2245870616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2245870616},{"type":"v1","addr":"172.21.15.162:6835","nonce":2245870616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6858,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1245398837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1245398837},{"type":"v1","addr":"172.21.15.18:6834","nonce":1245398837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:19:39.754151+0000","modified":"2024-09-19T09:19:42.581316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6861":{"gid":6861,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/2894746570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2894746570},{"type":"v1","addr":"172.21.15.18:6835","nonce":2894746570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6861,"qdb_cluster":[6861]},"id":8}]} 2024-09-19T09:19:45.505 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 56 2024-09-19T09:19:45.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.505+0000 7f9822847640 1 -- 172.21.15.18:0/2036071385 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f980806c2b0 msgr2=0x7f980806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:45.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.505+0000 7f9822847640 1 --2- 172.21.15.18:0/2036071385 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f980806c2b0 0x7f980806e770 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f980c000f60 tx=0x7f980c009040 comp rx=0 tx=0).stop 2024-09-19T09:19:45.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.505+0000 7f9822847640 1 -- 172.21.15.18:0/2036071385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f981c145290 msgr2=0x7f981c1561b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:45.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.505+0000 7f9822847640 1 --2- 172.21.15.18:0/2036071385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f981c145290 0x7f981c1561b0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f981400c7a0 tx=0x7f981400cc60 comp rx=0 tx=0).stop 2024-09-19T09:19:45.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.506+0000 7f9822847640 1 -- 172.21.15.18:0/2036071385 shutdown_connections 2024-09-19T09:19:45.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.506+0000 7f9822847640 1 --2- 172.21.15.18:0/2036071385 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f980806c2b0 0x7f980806e770 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:45.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.506+0000 7f9822847640 1 --2- 172.21.15.18:0/2036071385 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f981c145290 0x7f981c1561b0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:45.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.506+0000 7f9822847640 1 --2- 172.21.15.18:0/2036071385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f981c0ce780 0x7f981c13bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:45.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.506+0000 7f9822847640 1 --2- 172.21.15.18:0/2036071385 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f981c072f40 0x7f981c1557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:45.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.506+0000 7f9822847640 1 -- 172.21.15.18:0/2036071385 >> 172.21.15.18:0/2036071385 conn(0x7f981c06bc10 msgr2=0x7f981c0cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:45.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.506+0000 7f9822847640 1 -- 172.21.15.18:0/2036071385 shutdown_connections 2024-09-19T09:19:45.508 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:45.506+0000 7f9822847640 1 -- 172.21.15.18:0/2036071385 wait complete. 2024-09-19T09:19:45.921 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 56, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T09:19:39.754151+0000', 'modified': '2024-09-19T09:19:42.581316+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6861}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6861': {'gid': 6861, 'name': 'a', 'rank': 0, 'incarnation': 53, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.18:6835/2894746570', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6833', 'nonce': 2894746570}, {'type': 'v1', 'addr': '172.21.15.18:6835', 'nonce': 2894746570}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6861, 'qdb_cluster': [6861]} 2024-09-19T09:19:45.921 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T09:19:45.921 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-19T09:19:46.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.025+0000 7f2777d49640 1 Processor -- start 2024-09-19T09:19:46.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.026+0000 7f2777d49640 1 -- start start 2024-09-19T09:19:46.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.026+0000 7f2777d49640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f277015eda0 0x7f27700d5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:46.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.027+0000 7f2777d49640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27700d1630 0x7f27700d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:46.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.027+0000 7f2777d49640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27700d3cc0 con 0x7f27700d0480 2024-09-19T09:19:46.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.027+0000 7f2777d49640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f27700d2880 con 0x7f277015eda0 2024-09-19T09:19:46.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.027+0000 7f2777d49640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f27700d3120 con 0x7f27700d1630 2024-09-19T09:19:46.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.027+0000 7f27752e4640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f27700d0480 0x7f27700d35b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:58976/0 (socket says 172.21.15.18:58976) 2024-09-19T09:19:46.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.027+0000 7f27752e4640 1 -- 172.21.15.18:0/3597035948 learned_addr learned my addr 172.21.15.18:0/3597035948 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:46.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.027+0000 7f2774ae3640 1 -- 172.21.15.18:0/3597035948 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3225262801 0 0) 0x7f27700d3cc0 con 0x7f27700d0480 2024-09-19T09:19:46.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.027+0000 7f2774ae3640 1 -- 172.21.15.18:0/3597035948 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f275c003520 con 0x7f27700d0480 2024-09-19T09:19:46.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.027+0000 7f2775ae5640 1 --2- 172.21.15.18:0/3597035948 >> v2:172.21.15.162:3300/0 conn(0x7f277015eda0 0x7f27700d5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:46.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.027+0000 7f27762e6640 1 --2- 172.21.15.18:0/3597035948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27700d1630 0x7f27700d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:46.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.027+0000 7f2774ae3640 1 -- 172.21.15.18:0/3597035948 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 711763186 0 0) 0x7f275c003520 con 0x7f27700d0480 2024-09-19T09:19:46.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.027+0000 7f2774ae3640 1 -- 172.21.15.18:0/3597035948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27700d1630 msgr2=0x7f27700d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:46.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.027+0000 7f2774ae3640 1 --2- 172.21.15.18:0/3597035948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27700d1630 0x7f27700d1ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.027+0000 7f2774ae3640 1 -- 172.21.15.18:0/3597035948 >> v2:172.21.15.162:3300/0 conn(0x7f277015eda0 msgr2=0x7f27700d5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:46.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.027+0000 7f2774ae3640 1 --2- 172.21.15.18:0/3597035948 >> v2:172.21.15.162:3300/0 conn(0x7f277015eda0 0x7f27700d5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.027+0000 7f2774ae3640 1 -- 172.21.15.18:0/3597035948 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27700d0bf0 con 0x7f27700d0480 2024-09-19T09:19:46.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.027+0000 7f2774ae3640 1 -- 172.21.15.18:0/3597035948 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f2760001670 con 0x7f27700d0480 2024-09-19T09:19:46.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.027+0000 7f2774ae3640 1 -- 172.21.15.18:0/3597035948 >> v1:172.21.15.18:6789/0 conn(0x7f27700d0480 legacy=0x7f27700d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:46.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.027+0000 7f2774ae3640 1 --2- 172.21.15.18:0/3597035948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f275c0039b0 0x7f275c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:46.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.027+0000 7f2774ae3640 1 --2- 172.21.15.18:0/3597035948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f275c004800 0x7f275c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:46.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.027+0000 7f2774ae3640 1 --2- 172.21.15.18:0/3597035948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f275c0051c0 0x7f275c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:46.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.027+0000 7f2774ae3640 1 -- 172.21.15.18:0/3597035948 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f27700d2880 con 0x7f275c0051c0 2024-09-19T09:19:46.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.027+0000 7f2774ae3640 1 -- 172.21.15.18:0/3597035948 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f27700d3120 con 0x7f275c004800 2024-09-19T09:19:46.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.027+0000 7f2774ae3640 1 -- 172.21.15.18:0/3597035948 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f275c00c000 con 0x7f275c0039b0 2024-09-19T09:19:46.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.027+0000 7f27762e6640 1 --2- 172.21.15.18:0/3597035948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27700d1630 0x7f27700d1ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:46.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.027+0000 7f2775ae5640 1 --2- 172.21.15.18:0/3597035948 >> v2:172.21.15.162:3300/0 conn(0x7f277015eda0 0x7f27700d5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:46.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.027+0000 7f27762e6640 1 --2- 172.21.15.18:0/3597035948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f275c0051c0 0x7f275c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:46.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.028+0000 7f27752e4640 1 --2- 172.21.15.18:0/3597035948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f275c004800 0x7f275c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:46.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.028+0000 7f2775ae5640 1 --2- 172.21.15.18:0/3597035948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f275c0039b0 0x7f275c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:46.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.028+0000 7f27762e6640 1 -- 172.21.15.18:0/3597035948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f275c0039b0 msgr2=0x7f275c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:46.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.028+0000 7f27762e6640 1 --2- 172.21.15.18:0/3597035948 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f275c0039b0 0x7f275c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.028+0000 7f27762e6640 1 -- 172.21.15.18:0/3597035948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f275c004800 msgr2=0x7f275c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:46.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.028+0000 7f27762e6640 1 --2- 172.21.15.18:0/3597035948 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f275c004800 0x7f275c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.028+0000 7f27762e6640 1 -- 172.21.15.18:0/3597035948 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f275c003520 con 0x7f275c0051c0 2024-09-19T09:19:46.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.028+0000 7f27762e6640 1 --2- 172.21.15.18:0/3597035948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f275c0051c0 0x7f275c00b9c0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f2768009f30 tx=0x7f275c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d225a4ee026e426 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:46.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.029+0000 7f2774ae3640 1 -- 172.21.15.18:0/3597035948 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2768009b50 con 0x7f275c0051c0 2024-09-19T09:19:46.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.029+0000 7f2774ae3640 1 -- 172.21.15.18:0/3597035948 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f276802e070 con 0x7f275c0051c0 2024-09-19T09:19:46.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.029+0000 7f2774ae3640 1 -- 172.21.15.18:0/3597035948 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2768003db0 con 0x7f275c0051c0 2024-09-19T09:19:46.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.029+0000 7f2777d49640 1 -- 172.21.15.18:0/3597035948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f275c0051c0 msgr2=0x7f275c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:46.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.029+0000 7f2777d49640 1 --2- 172.21.15.18:0/3597035948 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f275c0051c0 0x7f275c00b9c0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f2768009f30 tx=0x7f275c005830 comp rx=0 tx=0).stop 2024-09-19T09:19:46.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.029+0000 7f27762e6640 1 -- 172.21.15.18:0/3597035948 reap_dead start 2024-09-19T09:19:46.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.029+0000 7f2777d49640 1 -- 172.21.15.18:0/3597035948 shutdown_connections 2024-09-19T09:19:46.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.029+0000 7f2777d49640 1 -- 172.21.15.18:0/3597035948 >> 172.21.15.18:0/3597035948 conn(0x7f277009df40 msgr2=0x7f27700d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:46.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.029+0000 7f2777d49640 1 -- 172.21.15.18:0/3597035948 shutdown_connections 2024-09-19T09:19:46.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.029+0000 7f2777d49640 1 -- 172.21.15.18:0/3597035948 wait complete. 2024-09-19T09:19:46.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.030+0000 7f2777d49640 1 Processor -- start 2024-09-19T09:19:46.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.030+0000 7f2777d49640 1 -- start start 2024-09-19T09:19:46.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.031+0000 7f2777d49640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f275c0051c0 0x7f2770157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:46.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.031+0000 7f2777d49640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2770158370 0x7f27701591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:46.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.031+0000 7f2777d49640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2770159730 0x7f27700cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:46.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.031+0000 7f2777d49640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f27700d08f0 con 0x7f2770158370 2024-09-19T09:19:46.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.031+0000 7f2777d49640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f27700d2db0 con 0x7f275c0051c0 2024-09-19T09:19:46.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.031+0000 7f2777d49640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f277015f180 con 0x7f2770159730 2024-09-19T09:19:46.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.031+0000 7f27752e4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2770158370 0x7f27701591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:46.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.031+0000 7f27752e4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2770158370 0x7f27701591f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46856/0 (socket says 172.21.15.18:46856) 2024-09-19T09:19:46.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.031+0000 7f27752e4640 1 -- 172.21.15.18:0/2510066551 learned_addr learned my addr 172.21.15.18:0/2510066551 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:46.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.031+0000 7f2775ae5640 1 --2- 172.21.15.18:0/2510066551 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f275c0051c0 0x7f2770157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:46.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.032+0000 7f27752e4640 1 -- 172.21.15.18:0/2510066551 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2770159730 msgr2=0x7f27700cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:46.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.032+0000 7f27762e6640 1 --2- 172.21.15.18:0/2510066551 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2770159730 0x7f27700cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:46.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.032+0000 7f27752e4640 1 --2- 172.21.15.18:0/2510066551 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2770159730 0x7f27700cbd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.032+0000 7f27752e4640 1 -- 172.21.15.18:0/2510066551 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f275c0051c0 msgr2=0x7f2770157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:46.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.032+0000 7f27752e4640 1 --2- 172.21.15.18:0/2510066551 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f275c0051c0 0x7f2770157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.032+0000 7f27752e4640 1 -- 172.21.15.18:0/2510066551 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2770159c40 con 0x7f2770158370 2024-09-19T09:19:46.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.032+0000 7f2775ae5640 1 --2- 172.21.15.18:0/2510066551 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f275c0051c0 0x7f2770157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:46.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.032+0000 7f27752e4640 1 --2- 172.21.15.18:0/2510066551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2770158370 0x7f27701591f0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f27600073a0 tx=0x7f2760007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:46.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.032+0000 7f27667fc640 1 -- 172.21.15.18:0/2510066551 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276001a070 con 0x7f2770158370 2024-09-19T09:19:46.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.032+0000 7f27667fc640 1 -- 172.21.15.18:0/2510066551 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f276000f960 con 0x7f2770158370 2024-09-19T09:19:46.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.032+0000 7f27667fc640 1 -- 172.21.15.18:0/2510066551 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276000fd30 con 0x7f2770158370 2024-09-19T09:19:46.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.032+0000 7f2777d49640 1 -- 172.21.15.18:0/2510066551 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2770159f20 con 0x7f2770158370 2024-09-19T09:19:46.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.032+0000 7f2777d49640 1 -- 172.21.15.18:0/2510066551 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f277015a4e0 con 0x7f2770158370 2024-09-19T09:19:46.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.034+0000 7f27667fc640 1 -- 172.21.15.18:0/2510066551 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f276001d070 con 0x7f2770158370 2024-09-19T09:19:46.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.034+0000 7f27667fc640 1 --2- 172.21.15.18:0/2510066551 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f275406c2b0 0x7f275406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:46.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.034+0000 7f27667fc640 1 -- 172.21.15.18:0/2510066551 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7f276008ad80 con 0x7f2770158370 2024-09-19T09:19:46.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.034+0000 7f2775ae5640 1 --2- 172.21.15.18:0/2510066551 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f275406c2b0 0x7f275406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:46.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.035+0000 7f2775ae5640 1 --2- 172.21.15.18:0/2510066551 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f275406c2b0 0x7f275406e770 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f276c006fd0 tx=0x7f276c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:46.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.035+0000 7f277abbc740 1 Processor -- start 2024-09-19T09:19:46.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.035+0000 7f277abbc740 1 -- start start 2024-09-19T09:19:46.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.036+0000 7f277abbc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cef84ad2c0 0x55cef84f2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:46.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.036+0000 7f277abbc740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cef84aaa80 0x55cef84ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:46.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.036+0000 7f277abbc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cef84aea50 0x55cef84a78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:46.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.036+0000 7f277abbc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cef840f520 con 0x55cef84ad2c0 2024-09-19T09:19:46.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.036+0000 7f277abbc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cef83b73e0 con 0x55cef84aea50 2024-09-19T09:19:46.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.036+0000 7f277abbc740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55cef840b4e0 con 0x55cef84aaa80 2024-09-19T09:19:46.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.036+0000 7f2775ae5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cef84ad2c0 0x55cef84f2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:46.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.036+0000 7f2775ae5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cef84ad2c0 0x55cef84f2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46864/0 (socket says 172.21.15.18:46864) 2024-09-19T09:19:46.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.036+0000 7f2775ae5640 1 -- 172.21.15.18:0/3915953181 learned_addr learned my addr 172.21.15.18:0/3915953181 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:46.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.036+0000 7f27752e4640 1 --2- 172.21.15.18:0/3915953181 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cef84aaa80 0x55cef84ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:46.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.036+0000 7f27762e6640 1 --2- 172.21.15.18:0/3915953181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cef84aea50 0x55cef84a78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:46.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.036+0000 7f2775ae5640 1 -- 172.21.15.18:0/3915953181 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cef84aaa80 msgr2=0x55cef84ad6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:46.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.036+0000 7f2775ae5640 1 --2- 172.21.15.18:0/3915953181 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cef84aaa80 0x55cef84ad6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.036+0000 7f2775ae5640 1 -- 172.21.15.18:0/3915953181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cef84aea50 msgr2=0x55cef84a78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:46.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.036+0000 7f2775ae5640 1 --2- 172.21.15.18:0/3915953181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cef84aea50 0x55cef84a78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.036+0000 7f2775ae5640 1 -- 172.21.15.18:0/3915953181 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cef83d22f0 con 0x55cef84ad2c0 2024-09-19T09:19:46.041 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.036+0000 7f27752e4640 1 --2- 172.21.15.18:0/3915953181 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cef84aaa80 0x55cef84ad6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:46.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.036+0000 7f2775ae5640 1 --2- 172.21.15.18:0/3915953181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cef84ad2c0 0x55cef84f2a60 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f276c011c30 tx=0x7f276c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a618c408af9f60b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:46.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.037+0000 7f27537fe640 1 -- 172.21.15.18:0/3915953181 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c01d050 con 0x55cef84ad2c0 2024-09-19T09:19:46.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.037+0000 7f27537fe640 1 -- 172.21.15.18:0/3915953181 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f276c027070 con 0x55cef84ad2c0 2024-09-19T09:19:46.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.037+0000 7f27537fe640 1 -- 172.21.15.18:0/3915953181 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c00f050 con 0x55cef84ad2c0 2024-09-19T09:19:46.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.037+0000 7f277abbc740 1 -- 172.21.15.18:0/3915953181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cef84ad2c0 msgr2=0x55cef84f2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:46.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.037+0000 7f277abbc740 1 --2- 172.21.15.18:0/3915953181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cef84ad2c0 0x55cef84f2a60 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f276c011c30 tx=0x7f276c014000 comp rx=0 tx=0).stop 2024-09-19T09:19:46.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.037+0000 7f277abbc740 1 -- 172.21.15.18:0/3915953181 shutdown_connections 2024-09-19T09:19:46.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.037+0000 7f277abbc740 1 --2- 172.21.15.18:0/3915953181 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cef84aea50 0x55cef84a78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.037+0000 7f277abbc740 1 --2- 172.21.15.18:0/3915953181 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cef84aaa80 0x55cef84ad6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.037+0000 7f277abbc740 1 --2- 172.21.15.18:0/3915953181 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cef84ad2c0 0x55cef84f2a60 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.037+0000 7f277abbc740 1 -- 172.21.15.18:0/3915953181 >> 172.21.15.18:0/3915953181 conn(0x55cef84a9a80 msgr2=0x55cef84f1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:46.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.037+0000 7f277abbc740 1 -- 172.21.15.18:0/3915953181 shutdown_connections 2024-09-19T09:19:46.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.037+0000 7f277abbc740 1 -- 172.21.15.18:0/3915953181 wait complete. 2024-09-19T09:19:46.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.038+0000 7f277abbc740 1 -- start start 2024-09-19T09:19:46.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.038+0000 7f277abbc740 1 Processor -- start 2024-09-19T09:19:46.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.039+0000 7f277abbc740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cef84ad2c0 0x55cef84cffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:46.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.039+0000 7f277abbc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cef84aea50 0x55cef84d5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:46.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.039+0000 7f277abbc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cef84d6340 0x55cef84d06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:46.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.039+0000 7f277abbc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cef84a8f20 con 0x55cef84aea50 2024-09-19T09:19:46.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.039+0000 7f277abbc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cef8398450 con 0x55cef84d6340 2024-09-19T09:19:46.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.039+0000 7f277abbc740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55cef84f3290 con 0x55cef84ad2c0 2024-09-19T09:19:46.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.039+0000 7f277abbc740 10 client.0 _ll_register_callbacks cb 0x55cef8121ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:46.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.039+0000 7f27752e4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cef84aea50 0x55cef84d5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:46.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.039+0000 7f27752e4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cef84aea50 0x55cef84d5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46868/0 (socket says 172.21.15.18:46868) 2024-09-19T09:19:46.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.039+0000 7f27752e4640 1 -- 172.21.15.18:0/2019676415 learned_addr learned my addr 172.21.15.18:0/2019676415 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:46.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.039+0000 7f2775ae5640 1 --2- 172.21.15.18:0/2019676415 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cef84ad2c0 0x55cef84cffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:46.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.039+0000 7f27762e6640 1 --2- 172.21.15.18:0/2019676415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cef84d6340 0x55cef84d06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:46.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.039+0000 7f27752e4640 1 -- 172.21.15.18:0/2019676415 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cef84ad2c0 msgr2=0x55cef84cffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:46.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.039+0000 7f27752e4640 1 --2- 172.21.15.18:0/2019676415 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cef84ad2c0 0x55cef84cffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.039+0000 7f27752e4640 1 -- 172.21.15.18:0/2019676415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cef84d6340 msgr2=0x55cef84d06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:46.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.039+0000 7f27752e4640 1 --2- 172.21.15.18:0/2019676415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cef84d6340 0x55cef84d06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.039+0000 7f27752e4640 1 -- 172.21.15.18:0/2019676415 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cef81222d0 con 0x55cef84aea50 2024-09-19T09:19:46.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.040+0000 7f2750ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:19:46.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.040+0000 7f27752e4640 1 --2- 172.21.15.18:0/2019676415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cef84aea50 0x55cef84d5e00 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f27600614a0 tx=0x7f2760058df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc494359eace4ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:46.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.040+0000 7f2750ff9640 1 -- 172.21.15.18:0/2019676415 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2760058440 con 0x55cef84aea50 2024-09-19T09:19:46.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.040+0000 7f2750ff9640 1 -- 172.21.15.18:0/2019676415 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7f276005f3a0 con 0x55cef84aea50 2024-09-19T09:19:46.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.040+0000 7f277abbc740 1 -- 172.21.15.18:0/2019676415 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f276c027070 con 0x55cef84aea50 2024-09-19T09:19:46.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.040+0000 7f2750ff9640 1 -- 172.21.15.18:0/2019676415 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f27600619d0 con 0x55cef84aea50 2024-09-19T09:19:46.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.040+0000 7f277abbc740 10 client.6993 fetch_fsmap learned FSMap version 56 2024-09-19T09:19:46.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.040+0000 7f277abbc740 1 -- 172.21.15.18:0/2019676415 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) -- 0x55cef81ec6b0 con 0x55cef84aea50 2024-09-19T09:19:46.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.040+0000 7f2750ff9640 1 -- 172.21.15.18:0/2019676415 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f276c027070 con 0x55cef84aea50 2024-09-19T09:19:46.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.040+0000 7f2750ff9640 1 -- 172.21.15.18:0/2019676415 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 56) ==== 3502+0+0 (secure 0 0 0) 0x7f2760054b40 con 0x55cef84aea50 2024-09-19T09:19:46.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.040+0000 7f277abbc740 10 client.6993 fetch_fsmap finished waiting for FSMap version 56 2024-09-19T09:19:46.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.040+0000 7f277abbc740 10 client.6993 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T09:19:46.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.040+0000 7f277abbc740 20 client.6993 populate_metadata read hostname 'smithi018' 2024-09-19T09:19:46.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.040+0000 7f277abbc740 1 --2- 172.21.15.18:0/2019676415 >> [v2:172.21.15.18:6833/2894746570,v1:172.21.15.18:6835/2894746570] conn(0x55cef84d6ef0 0x55cef8503270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:46.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.040+0000 7f277abbc740 4 client.6993 mds_command: new command op to 6861 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:19:46.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.040+0000 7f277abbc740 1 -- 172.21.15.18:0/2019676415 --> [v2:172.21.15.18:6833/2894746570,v1:172.21.15.18:6835/2894746570] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cef841cc50 con 0x55cef84d6ef0 2024-09-19T09:19:46.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.040+0000 7f2775ae5640 1 --2- 172.21.15.18:0/2019676415 >> [v2:172.21.15.18:6833/2894746570,v1:172.21.15.18:6835/2894746570] conn(0x55cef84d6ef0 0x55cef8503270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:46.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.041+0000 7f2750ff9640 10 client.6993 ms_handle_connect on v2:172.21.15.18:6833/2894746570 2024-09-19T09:19:46.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.041+0000 7f2775ae5640 1 --2- 172.21.15.18:0/2019676415 >> [v2:172.21.15.18:6833/2894746570,v1:172.21.15.18:6835/2894746570] conn(0x55cef84d6ef0 0x55cef8503270 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=890d183cd1324f1c server_cookie=b21f5ba488f86ef3 in_seq=0 out_seq=0 2024-09-19T09:19:46.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.041+0000 7f2750ff9640 1 -- 172.21.15.18:0/2019676415 <== mds.0 v2:172.21.15.18:6833/2894746570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cef841cc50 con 0x55cef84d6ef0 2024-09-19T09:19:46.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.041+0000 7f2750ff9640 10 client.6993 handle_command_reply: tid=0 2024-09-19T09:19:46.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.041+0000 7f277abbc740 1 client.6993 shutdown 2024-09-19T09:19:46.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.041+0000 7f277abbc740 1 -- 172.21.15.18:0/2019676415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cef84aea50 msgr2=0x55cef84d5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:46.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.041+0000 7f277abbc740 1 --2- 172.21.15.18:0/2019676415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cef84aea50 0x55cef84d5e00 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f27600614a0 tx=0x7f2760058df0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.041+0000 7f277abbc740 1 -- 172.21.15.18:0/2019676415 shutdown_connections 2024-09-19T09:19:46.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.041+0000 7f277abbc740 1 --2- 172.21.15.18:0/2019676415 >> [v2:172.21.15.18:6833/2894746570,v1:172.21.15.18:6835/2894746570] conn(0x55cef84d6ef0 0x55cef8503270 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.041+0000 7f277abbc740 1 --2- 172.21.15.18:0/2019676415 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cef84d6340 0x55cef84d06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.041+0000 7f277abbc740 1 --2- 172.21.15.18:0/2019676415 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cef84aea50 0x55cef84d5e00 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.041+0000 7f277abbc740 1 --2- 172.21.15.18:0/2019676415 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cef84ad2c0 0x55cef84cffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.041+0000 7f2750ff9640 0 client.6993 ms_handle_reset on v2:172.21.15.18:6833/2894746570 2024-09-19T09:19:46.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.041+0000 7f277abbc740 1 -- 172.21.15.18:0/2019676415 >> 172.21.15.18:0/2019676415 conn(0x55cef84aaa80 msgr2=0x55cef84f1490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:46.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.042+0000 7f277abbc740 1 -- 172.21.15.18:0/2019676415 shutdown_connections 2024-09-19T09:19:46.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.042+0000 7f277abbc740 1 -- 172.21.15.18:0/2019676415 wait complete. 2024-09-19T09:19:46.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.042+0000 7f277abbc740 20 client.6993 trim_cache size 0 max 16384 2024-09-19T09:19:46.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.060+0000 7f277abbc740 1 Processor -- start 2024-09-19T09:19:46.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.060+0000 7f277abbc740 1 -- start start 2024-09-19T09:19:46.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.060+0000 7f277abbc740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cef84ad2c0 0x55cef84cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:46.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.060+0000 7f277abbc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cef84aea50 0x55cef84ef010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:46.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.060+0000 7f277abbc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cef84d6340 0x55cef8503460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:46.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.060+0000 7f277abbc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f27702009f0 con 0x55cef84d6340 2024-09-19T09:19:46.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.060+0000 7f277abbc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f27700c95a0 con 0x55cef84aea50 2024-09-19T09:19:46.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.060+0000 7f277abbc740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f277015b490 con 0x55cef84ad2c0 2024-09-19T09:19:46.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.060+0000 7f27762e6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cef84d6340 0x55cef8503460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:46.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.061+0000 7f27762e6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cef84d6340 0x55cef8503460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46872/0 (socket says 172.21.15.18:46872) 2024-09-19T09:19:46.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.061+0000 7f27762e6640 1 -- 172.21.15.18:0/1518936944 learned_addr learned my addr 172.21.15.18:0/1518936944 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:46.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.061+0000 7f2775ae5640 1 --2- 172.21.15.18:0/1518936944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cef84ad2c0 0x55cef84cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:46.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.061+0000 7f27762e6640 1 -- 172.21.15.18:0/1518936944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cef84ad2c0 msgr2=0x55cef84cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:46.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.061+0000 7f27762e6640 1 --2- 172.21.15.18:0/1518936944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cef84ad2c0 0x55cef84cdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.061+0000 7f27752e4640 1 --2- 172.21.15.18:0/1518936944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cef84aea50 0x55cef84ef010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:46.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.061+0000 7f27762e6640 1 -- 172.21.15.18:0/1518936944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cef84aea50 msgr2=0x55cef84ef010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:46.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.061+0000 7f27762e6640 1 --2- 172.21.15.18:0/1518936944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cef84aea50 0x55cef84ef010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.061+0000 7f27762e6640 1 -- 172.21.15.18:0/1518936944 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cef84d40a0 con 0x55cef84d6340 2024-09-19T09:19:46.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.061+0000 7f27762e6640 1 --2- 172.21.15.18:0/1518936944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cef84d6340 0x55cef8503460 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f2768036040 tx=0x7f2768031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a6902029e8ceb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:46.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.061+0000 7f2752ffd640 1 -- 172.21.15.18:0/1518936944 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2768003cd0 con 0x55cef84d6340 2024-09-19T09:19:46.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.061+0000 7f2752ffd640 1 -- 172.21.15.18:0/1518936944 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2768004030 con 0x55cef84d6340 2024-09-19T09:19:46.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.061+0000 7f2752ffd640 1 -- 172.21.15.18:0/1518936944 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2768004400 con 0x55cef84d6340 2024-09-19T09:19:46.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.062+0000 7f277abbc740 1 -- 172.21.15.18:0/1518936944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cef84d6340 msgr2=0x55cef8503460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:46.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.062+0000 7f277abbc740 1 --2- 172.21.15.18:0/1518936944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cef84d6340 0x55cef8503460 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f2768036040 tx=0x7f2768031000 comp rx=0 tx=0).stop 2024-09-19T09:19:46.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.062+0000 7f277abbc740 1 -- 172.21.15.18:0/1518936944 shutdown_connections 2024-09-19T09:19:46.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.062+0000 7f277abbc740 1 --2- 172.21.15.18:0/1518936944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cef84d6340 0x55cef8503460 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.062+0000 7f277abbc740 1 --2- 172.21.15.18:0/1518936944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cef84aea50 0x55cef84ef010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.062+0000 7f277abbc740 1 --2- 172.21.15.18:0/1518936944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cef84ad2c0 0x55cef84cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.062+0000 7f277abbc740 1 -- 172.21.15.18:0/1518936944 >> 172.21.15.18:0/1518936944 conn(0x55cef84aaa80 msgr2=0x55cef8515e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:46.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.062+0000 7f277abbc740 1 -- 172.21.15.18:0/1518936944 shutdown_connections 2024-09-19T09:19:46.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.062+0000 7f277abbc740 1 -- 172.21.15.18:0/1518936944 wait complete. 2024-09-19T09:19:46.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.062+0000 7f277abbc740 1 -- start start 2024-09-19T09:19:46.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.062+0000 7f277abbc740 1 Processor -- start 2024-09-19T09:19:46.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.063+0000 7f277abbc740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cef84ad2c0 0x55cef856f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:46.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.063+0000 7f277abbc740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cef84aea50 0x55cef8507410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:46.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.063+0000 7f277abbc740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cef84d6340 0x55cef8507950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:46.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.063+0000 7f277abbc740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55cef85042e0 con 0x55cef84ad2c0 2024-09-19T09:19:46.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.063+0000 7f277abbc740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55cef85029c0 con 0x55cef84aea50 2024-09-19T09:19:46.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.063+0000 7f277abbc740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55cef84d7390 con 0x55cef84d6340 2024-09-19T09:19:46.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.063+0000 7f277abbc740 10 client.0 _ll_register_callbacks cb 0x7f2760055090 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:19:46.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.063+0000 7f2775ae5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cef84ad2c0 0x55cef856f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:46.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.063+0000 7f2775ae5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cef84ad2c0 0x55cef856f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46878/0 (socket says 172.21.15.18:46878) 2024-09-19T09:19:46.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.063+0000 7f2775ae5640 1 -- 172.21.15.18:0/2427709676 learned_addr learned my addr 172.21.15.18:0/2427709676 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:46.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.063+0000 7f27752e4640 1 --2- 172.21.15.18:0/2427709676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cef84aea50 0x55cef8507410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:46.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.063+0000 7f27762e6640 1 --2- 172.21.15.18:0/2427709676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cef84d6340 0x55cef8507950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:46.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.064+0000 7f2775ae5640 1 -- 172.21.15.18:0/2427709676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cef84d6340 msgr2=0x55cef8507950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:46.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.064+0000 7f2775ae5640 1 --2- 172.21.15.18:0/2427709676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cef84d6340 0x55cef8507950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.064+0000 7f2775ae5640 1 -- 172.21.15.18:0/2427709676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cef84aea50 msgr2=0x55cef8507410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:46.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.064+0000 7f2775ae5640 1 --2- 172.21.15.18:0/2427709676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cef84aea50 0x55cef8507410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.064+0000 7f2775ae5640 1 -- 172.21.15.18:0/2427709676 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cef84cd760 con 0x55cef84ad2c0 2024-09-19T09:19:46.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.064+0000 7f2775ae5640 1 --2- 172.21.15.18:0/2427709676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cef84ad2c0 0x55cef856f800 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f276c008010 tx=0x7f276c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a863a626aad6748b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:46.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.064+0000 7f2750ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:19:46.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.064+0000 7f2750ff9640 1 -- 172.21.15.18:0/2427709676 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f276c03d020 con 0x55cef84ad2c0 2024-09-19T09:19:46.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.064+0000 7f2750ff9640 1 -- 172.21.15.18:0/2427709676 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7f276c038850 con 0x55cef84ad2c0 2024-09-19T09:19:46.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.064+0000 7f277abbc740 1 -- 172.21.15.18:0/2427709676 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2768004030 con 0x55cef84ad2c0 2024-09-19T09:19:46.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.064+0000 7f2750ff9640 1 -- 172.21.15.18:0/2427709676 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7f276c01d040 con 0x55cef84ad2c0 2024-09-19T09:19:46.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.064+0000 7f277abbc740 10 client.6999 fetch_fsmap learned FSMap version 56 2024-09-19T09:19:46.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.064+0000 7f277abbc740 1 -- 172.21.15.18:0/2427709676 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=2+}) -- 0x55cef8507ef0 con 0x55cef84ad2c0 2024-09-19T09:19:46.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.064+0000 7f2750ff9640 1 -- 172.21.15.18:0/2427709676 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2768004030 con 0x55cef84ad2c0 2024-09-19T09:19:46.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.064+0000 7f2750ff9640 1 -- 172.21.15.18:0/2427709676 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 56) ==== 3502+0+0 (secure 0 0 0) 0x7f276c038a50 con 0x55cef84ad2c0 2024-09-19T09:19:46.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.064+0000 7f277abbc740 10 client.6999 fetch_fsmap finished waiting for FSMap version 56 2024-09-19T09:19:46.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.064+0000 7f277abbc740 10 client.6999 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T09:19:46.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.064+0000 7f277abbc740 20 client.6999 populate_metadata read hostname 'smithi018' 2024-09-19T09:19:46.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.064+0000 7f277abbc740 1 --2- 172.21.15.18:0/2427709676 >> [v2:172.21.15.18:6833/2894746570,v1:172.21.15.18:6835/2894746570] conn(0x55cef84d26e0 0x55cef85099a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:46.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.064+0000 7f277abbc740 4 client.6999 mds_command: new command op to 6861 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:19:46.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.064+0000 7f277abbc740 1 -- 172.21.15.18:0/2427709676 --> [v2:172.21.15.18:6833/2894746570,v1:172.21.15.18:6835/2894746570] -- command(tid 0: {"prefix": "status"}) -- 0x55cef8416fa0 con 0x55cef84d26e0 2024-09-19T09:19:46.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.064+0000 7f27752e4640 1 --2- 172.21.15.18:0/2427709676 >> [v2:172.21.15.18:6833/2894746570,v1:172.21.15.18:6835/2894746570] conn(0x55cef84d26e0 0x55cef85099a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:46.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.065+0000 7f2750ff9640 10 client.6999 ms_handle_connect on v2:172.21.15.18:6833/2894746570 2024-09-19T09:19:46.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.065+0000 7f27752e4640 1 --2- 172.21.15.18:0/2427709676 >> [v2:172.21.15.18:6833/2894746570,v1:172.21.15.18:6835/2894746570] conn(0x55cef84d26e0 0x55cef85099a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1805bb4ce080e58d server_cookie=a3485f0d3b91523 in_seq=0 out_seq=0 2024-09-19T09:19:46.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.065+0000 7f2750ff9640 1 -- 172.21.15.18:0/2427709676 <== mds.0 v2:172.21.15.18:6833/2894746570 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55cef8416fa0 con 0x55cef84d26e0 2024-09-19T09:19:46.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.065+0000 7f2750ff9640 10 client.6999 handle_command_reply: tid=0 2024-09-19T09:19:46.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.065+0000 7f277abbc740 1 client.6999 shutdown 2024-09-19T09:19:46.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.065+0000 7f277abbc740 1 -- 172.21.15.18:0/2427709676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cef84ad2c0 msgr2=0x55cef856f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:46.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.065+0000 7f277abbc740 1 --2- 172.21.15.18:0/2427709676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cef84ad2c0 0x55cef856f800 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f276c008010 tx=0x7f276c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.065+0000 7f277abbc740 1 -- 172.21.15.18:0/2427709676 shutdown_connections 2024-09-19T09:19:46.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.065+0000 7f277abbc740 1 --2- 172.21.15.18:0/2427709676 >> [v2:172.21.15.18:6833/2894746570,v1:172.21.15.18:6835/2894746570] conn(0x55cef84d26e0 0x55cef85099a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.065+0000 7f277abbc740 1 --2- 172.21.15.18:0/2427709676 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55cef84d6340 0x55cef8507950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.065+0000 7f2750ff9640 0 client.6999 ms_handle_reset on v2:172.21.15.18:6833/2894746570 2024-09-19T09:19:46.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.065+0000 7f277abbc740 1 --2- 172.21.15.18:0/2427709676 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55cef84aea50 0x55cef8507410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.065+0000 7f277abbc740 1 --2- 172.21.15.18:0/2427709676 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55cef84ad2c0 0x55cef856f800 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.065+0000 7f277abbc740 1 -- 172.21.15.18:0/2427709676 >> 172.21.15.18:0/2427709676 conn(0x55cef84aaa80 msgr2=0x55cef84cd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:46.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.065+0000 7f277abbc740 1 -- 172.21.15.18:0/2427709676 shutdown_connections 2024-09-19T09:19:46.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.065+0000 7f277abbc740 1 -- 172.21.15.18:0/2427709676 wait complete. 2024-09-19T09:19:46.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.065+0000 7f277abbc740 20 client.6999 trim_cache size 0 max 16384 2024-09-19T09:19:46.072 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:19:46.073 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:19:46.073 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-09-19T09:19:46.073 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 6861, 2024-09-19T09:19:46.073 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-19T09:19:46.073 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-19T09:19:46.073 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-19T09:19:46.073 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 5.6727574829999998, 2024-09-19T09:19:46.073 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 56, 2024-09-19T09:19:46.073 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 138, 2024-09-19T09:19:46.073 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 138, 2024-09-19T09:19:46.073 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 15.781729217000001 2024-09-19T09:19:46.073 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:19:46.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.066+0000 7f2777d49640 1 -- 172.21.15.18:0/2510066551 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f275406c2b0 msgr2=0x7f275406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:46.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.066+0000 7f2777d49640 1 --2- 172.21.15.18:0/2510066551 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f275406c2b0 0x7f275406e770 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f276c006fd0 tx=0x7f276c008040 comp rx=0 tx=0).stop 2024-09-19T09:19:46.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.066+0000 7f2777d49640 1 -- 172.21.15.18:0/2510066551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2770158370 msgr2=0x7f27701591f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:46.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.066+0000 7f2777d49640 1 --2- 172.21.15.18:0/2510066551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2770158370 0x7f27701591f0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f27600073a0 tx=0x7f2760007860 comp rx=0 tx=0).stop 2024-09-19T09:19:46.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.066+0000 7f2777d49640 1 -- 172.21.15.18:0/2510066551 shutdown_connections 2024-09-19T09:19:46.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.066+0000 7f2777d49640 1 --2- 172.21.15.18:0/2510066551 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f275406c2b0 0x7f275406e770 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.066+0000 7f2777d49640 1 --2- 172.21.15.18:0/2510066551 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2770159730 0x7f27700cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.066+0000 7f2777d49640 1 --2- 172.21.15.18:0/2510066551 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2770158370 0x7f27701591f0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.066+0000 7f2777d49640 1 --2- 172.21.15.18:0/2510066551 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f275c0051c0 0x7f2770157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.066+0000 7f2777d49640 1 -- 172.21.15.18:0/2510066551 >> 172.21.15.18:0/2510066551 conn(0x7f277009df40 msgr2=0x7f27700b8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:46.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.066+0000 7f2777d49640 1 -- 172.21.15.18:0/2510066551 shutdown_connections 2024-09-19T09:19:46.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.066+0000 7f2777d49640 1 -- 172.21.15.18:0/2510066551 wait complete. 2024-09-19T09:19:46.078 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T09:19:46.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.179+0000 7f0a4221e640 1 Processor -- start 2024-09-19T09:19:46.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.179+0000 7f0a4221e640 1 -- start start 2024-09-19T09:19:46.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.180+0000 7f0a4221e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0a3c15ed50 0x7f0a3c0d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:46.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.180+0000 7f0a4221e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a3c0d1aa0 0x7f0a3c0b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:46.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.180+0000 7f0a4221e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a3c0d31b0 con 0x7f0a3c0b5030 2024-09-19T09:19:46.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.180+0000 7f0a4221e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f0a3c0d1ee0 con 0x7f0a3c15ed50 2024-09-19T09:19:46.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.180+0000 7f0a4221e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0a3c0d3490 con 0x7f0a3c0d1aa0 2024-09-19T09:19:46.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.180+0000 7f0a3b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0a3c15ed50 0x7f0a3c0d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:46.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.180+0000 7f0a3b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0a3c15ed50 0x7f0a3c0d1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46890/0 (socket says 172.21.15.18:46890) 2024-09-19T09:19:46.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.180+0000 7f0a3b7fe640 1 -- 172.21.15.18:0/3285337675 learned_addr learned my addr 172.21.15.18:0/3285337675 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:46.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.180+0000 7f0a3affd640 1 --2- 172.21.15.18:0/3285337675 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a3c0d1aa0 0x7f0a3c0b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:46.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.180+0000 7f0a3b7fe640 1 -- 172.21.15.18:0/3285337675 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a3c0d1aa0 msgr2=0x7f0a3c0b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:46.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.180+0000 7f0a3b7fe640 1 --2- 172.21.15.18:0/3285337675 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a3c0d1aa0 0x7f0a3c0b4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.180+0000 7f0a3b7fe640 1 -- 172.21.15.18:0/3285337675 >> v1:172.21.15.162:6789/0 conn(0x7f0a3c0b5030 legacy=0x7f0a3c0b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:46.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.180+0000 7f0a3b7fe640 1 -- 172.21.15.18:0/3285337675 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a3c0d3770 con 0x7f0a3c15ed50 2024-09-19T09:19:46.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.180+0000 7f0a3affd640 1 --2- 172.21.15.18:0/3285337675 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a3c0d1aa0 0x7f0a3c0b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:46.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.181+0000 7f0a3b7fe640 1 --2- 172.21.15.18:0/3285337675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a3c15ed50 0x7f0a3c0d1560 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c009870 tx=0x7f0a2c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51475b6b8269c98b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:46.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.181+0000 7f0a3a7fc640 1 -- 172.21.15.18:0/3285337675 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c037070 con 0x7f0a3c15ed50 2024-09-19T09:19:46.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.181+0000 7f0a3a7fc640 1 -- 172.21.15.18:0/3285337675 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a2c032440 con 0x7f0a3c15ed50 2024-09-19T09:19:46.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.181+0000 7f0a3a7fc640 1 -- 172.21.15.18:0/3285337675 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c032810 con 0x7f0a3c15ed50 2024-09-19T09:19:46.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.182+0000 7f0a4221e640 1 -- 172.21.15.18:0/3285337675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a3c15ed50 msgr2=0x7f0a3c0d1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:46.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.182+0000 7f0a4221e640 1 --2- 172.21.15.18:0/3285337675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a3c15ed50 0x7f0a3c0d1560 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c009870 tx=0x7f0a2c02a2a0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.183 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.182+0000 7f0a4221e640 1 -- 172.21.15.18:0/3285337675 shutdown_connections 2024-09-19T09:19:46.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.182+0000 7f0a4221e640 1 --2- 172.21.15.18:0/3285337675 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a3c0d1aa0 0x7f0a3c0b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.182+0000 7f0a4221e640 1 --2- 172.21.15.18:0/3285337675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a3c15ed50 0x7f0a3c0d1560 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.182+0000 7f0a4221e640 1 -- 172.21.15.18:0/3285337675 >> 172.21.15.18:0/3285337675 conn(0x7f0a3c0d4bd0 msgr2=0x7f0a3c0d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:46.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.182+0000 7f0a4221e640 1 -- 172.21.15.18:0/3285337675 shutdown_connections 2024-09-19T09:19:46.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.182+0000 7f0a4221e640 1 -- 172.21.15.18:0/3285337675 wait complete. 2024-09-19T09:19:46.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.183+0000 7f0a4221e640 1 Processor -- start 2024-09-19T09:19:46.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.183+0000 7f0a4221e640 1 -- start start 2024-09-19T09:19:46.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.184+0000 7f0a4221e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a3c0b5030 0x7f0a3c0cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:46.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.184+0000 7f0a4221e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a3c0d1aa0 0x7f0a3c0ba450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:46.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.184+0000 7f0a4221e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a3c15ed50 0x7f0a3c0b7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:46.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.184+0000 7f0a4221e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3c0d3d30 con 0x7f0a3c0b5030 2024-09-19T09:19:46.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.184+0000 7f0a4221e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3c0b45d0 con 0x7f0a3c0d1aa0 2024-09-19T09:19:46.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.184+0000 7f0a4221e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0a3c15f130 con 0x7f0a3c15ed50 2024-09-19T09:19:46.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.184+0000 7f0a3b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a3c0b5030 0x7f0a3c0cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:46.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.184+0000 7f0a3b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a3c0b5030 0x7f0a3c0cc4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46904/0 (socket says 172.21.15.18:46904) 2024-09-19T09:19:46.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.184+0000 7f0a3b7fe640 1 -- 172.21.15.18:0/1466005915 learned_addr learned my addr 172.21.15.18:0/1466005915 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:46.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.184+0000 7f0a3bfff640 1 --2- 172.21.15.18:0/1466005915 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a3c15ed50 0x7f0a3c0b7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:46.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.184+0000 7f0a3affd640 1 --2- 172.21.15.18:0/1466005915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a3c0d1aa0 0x7f0a3c0ba450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:46.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.184+0000 7f0a3b7fe640 1 -- 172.21.15.18:0/1466005915 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a3c15ed50 msgr2=0x7f0a3c0b7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:46.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.184+0000 7f0a3b7fe640 1 --2- 172.21.15.18:0/1466005915 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a3c15ed50 0x7f0a3c0b7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.184+0000 7f0a3b7fe640 1 -- 172.21.15.18:0/1466005915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a3c0d1aa0 msgr2=0x7f0a3c0ba450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:46.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.184+0000 7f0a3b7fe640 1 --2- 172.21.15.18:0/1466005915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a3c0d1aa0 0x7f0a3c0ba450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.184+0000 7f0a3b7fe640 1 -- 172.21.15.18:0/1466005915 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a3c0ccba0 con 0x7f0a3c0b5030 2024-09-19T09:19:46.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.184+0000 7f0a3affd640 1 --2- 172.21.15.18:0/1466005915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a3c0d1aa0 0x7f0a3c0ba450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:46.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.185+0000 7f0a3b7fe640 1 --2- 172.21.15.18:0/1466005915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a3c0b5030 0x7f0a3c0cc4e0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c000c00 tx=0x7f0a2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:46.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.185+0000 7f0a23fff640 1 -- 172.21.15.18:0/1466005915 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c037040 con 0x7f0a3c0b5030 2024-09-19T09:19:46.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.185+0000 7f0a23fff640 1 -- 172.21.15.18:0/1466005915 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a2c042070 con 0x7f0a3c0b5030 2024-09-19T09:19:46.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.185+0000 7f0a23fff640 1 -- 172.21.15.18:0/1466005915 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c030bd0 con 0x7f0a3c0b5030 2024-09-19T09:19:46.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.185+0000 7f0a4221e640 1 -- 172.21.15.18:0/1466005915 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a3c0cce80 con 0x7f0a3c0b5030 2024-09-19T09:19:46.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.185+0000 7f0a4221e640 1 -- 172.21.15.18:0/1466005915 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a3c0cd440 con 0x7f0a3c0b5030 2024-09-19T09:19:46.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.186+0000 7f0a4221e640 1 -- 172.21.15.18:0/1466005915 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a3c0d21e0 con 0x7f0a3c0b5030 2024-09-19T09:19:46.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.187+0000 7f0a23fff640 1 -- 172.21.15.18:0/1466005915 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0a2c047460 con 0x7f0a3c0b5030 2024-09-19T09:19:46.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.187+0000 7f0a23fff640 1 --2- 172.21.15.18:0/1466005915 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0a2806c2b0 0x7f0a2806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:46.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.187+0000 7f0a23fff640 1 -- 172.21.15.18:0/1466005915 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7f0a2c0abf40 con 0x7f0a3c0b5030 2024-09-19T09:19:46.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.187+0000 7f0a3affd640 1 --2- 172.21.15.18:0/1466005915 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0a2806c2b0 0x7f0a2806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:46.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.188+0000 7f0a3affd640 1 --2- 172.21.15.18:0/1466005915 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0a2806c2b0 0x7f0a2806e770 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c0c8250 tx=0x7f0a30008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:46.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.191+0000 7f0a23fff640 1 -- 172.21.15.18:0/1466005915 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0a2c07a740 con 0x7f0a3c0b5030 2024-09-19T09:19:46.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.403+0000 7f0a4221e640 1 -- 172.21.15.18:0/1466005915 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0a3c0d5700 con 0x7f0a3c0b5030 2024-09-19T09:19:46.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.403+0000 7f0a23fff640 1 -- 172.21.15.18:0/1466005915 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v56) ==== 53+0+73 (secure 0 0 0) 0x7f0a2c07a040 con 0x7f0a3c0b5030 2024-09-19T09:19:46.404 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T09:19:46.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.405+0000 7f0a4221e640 1 -- 172.21.15.18:0/1466005915 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0a2806c2b0 msgr2=0x7f0a2806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:46.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.405+0000 7f0a4221e640 1 --2- 172.21.15.18:0/1466005915 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0a2806c2b0 0x7f0a2806e770 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c0c8250 tx=0x7f0a30008040 comp rx=0 tx=0).stop 2024-09-19T09:19:46.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.405+0000 7f0a4221e640 1 -- 172.21.15.18:0/1466005915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a3c0b5030 msgr2=0x7f0a3c0cc4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:46.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.405+0000 7f0a4221e640 1 --2- 172.21.15.18:0/1466005915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a3c0b5030 0x7f0a3c0cc4e0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c000c00 tx=0x7f0a2c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.405+0000 7f0a4221e640 1 -- 172.21.15.18:0/1466005915 shutdown_connections 2024-09-19T09:19:46.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.405+0000 7f0a4221e640 1 --2- 172.21.15.18:0/1466005915 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0a2806c2b0 0x7f0a2806e770 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.405+0000 7f0a4221e640 1 --2- 172.21.15.18:0/1466005915 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0a3c15ed50 0x7f0a3c0b7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.405+0000 7f0a4221e640 1 --2- 172.21.15.18:0/1466005915 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0a3c0d1aa0 0x7f0a3c0ba450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.405+0000 7f0a4221e640 1 --2- 172.21.15.18:0/1466005915 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0a3c0b5030 0x7f0a3c0cc4e0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:46.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.405+0000 7f0a4221e640 1 -- 172.21.15.18:0/1466005915 >> 172.21.15.18:0/1466005915 conn(0x7f0a3c0d4bd0 msgr2=0x7f0a3c0b37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:46.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.405+0000 7f0a4221e640 1 -- 172.21.15.18:0/1466005915 shutdown_connections 2024-09-19T09:19:46.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46.405+0000 7f0a4221e640 1 -- 172.21.15.18:0/1466005915 wait complete. 2024-09-19T09:19:46.417 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-19T09:19:46.417 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:19:46.417 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-09-19T09:19:46.417 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T09:19:46.417 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:19:46.417 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-19T09:19:46.417 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-19T09:19:46.417 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:19:46.418 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:19:46.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:46.418 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-09-19T09:19:46.435 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:19:46.435 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:19:46.435 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:19:46.435 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:19:46.435 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-09-19T09:19:46.435 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:19:46.435 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:19:46.436 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:19:46.436 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-09-19T09:19:46.436 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:19:46.436 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:19:46.436 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-09-19T09:19:46.436 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:19:46.436 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:19:46.436 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-09-19T09:19:46.436 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T09:19:46.436 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42411sec preferred_lft 42411sec 2024-09-19T09:19:46.436 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-09-19T09:19:46.436 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:19:46.436 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:19:46.437 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:19:46.437 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-09-19T09:19:46.437 INFO:teuthology.orchestra.run.smithi018.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T09:19:46.437 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:44:1b:02:86:87 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:19:46.437 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T09:19:46.437 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:19:46.437 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::a0ce:faff:feaa:13ec/64 scope link 2024-09-19T09:19:46.437 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:19:46.437 INFO:teuthology.orchestra.run.smithi018.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:19:46.437 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:44:1b:02:86:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:19:46.438 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::44:1bff:fe02:8687/64 scope link 2024-09-19T09:19:46.438 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:19:46.438 INFO:teuthology.orchestra.run.smithi018.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:19:46.438 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether e2:6d:c4:af:6a:8b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T09:19:46.438 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::e06d:c4ff:feaf:6a8b/64 scope link 2024-09-19T09:19:46.438 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:19:46.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:46.439 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:19:46.499 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-09-19T09:19:46.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:46.501 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-09-19T09:19:46.558 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-09-19T09:19:46.558 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:19:46.558 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T09:19:46.558 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T09:19:46.558 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:19:46.559 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:19:46.559 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T09:19:46.559 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T09:19:46.559 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T09:19:46.559 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T09:19:46.559 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T09:19:46.648 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:19:46.681 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:19:46.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:46.687 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-19T09:19:46.703 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-19T09:19:46.703 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T09:19:46.704 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:19:46.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:46.704 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-09-19T09:19:46.769 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:19:46.770 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T09:19:46.825 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:19:46.826 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:19:46.826 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:19:46.881 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-19T09:19:46.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:46.881 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:19:46.966 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:19:46.967 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:19:46.967 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:19:46.976 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:19:46.976 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:19:46.976 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:19:46.976 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:19:46.976 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:19:46.984 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:19:46.985 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:19:46.985 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:19:46.985 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:19:46.985 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:19:46.985 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-19T09:19:46.985 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-19T09:19:46.985 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fec66d7e-50e5-42ed-81de-ad141a2f0f4e" will pass to kernel 2024-09-19T09:19:46.985 INFO:teuthology.orchestra.run.smithi018.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-19T09:19:46.985 INFO:teuthology.orchestra.run.smithi018.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:19:46.986 INFO:teuthology.orchestra.run.smithi018.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:19:46.986 INFO:teuthology.orchestra.run.smithi018.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:19:46.986 INFO:teuthology.orchestra.run.smithi018.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:19:46.987 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:19:46.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:46.987 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:19:47.013 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:19:47.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:19:47.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:19:47.115 INFO:teuthology.orchestra.run.smithi018.stdout:client6613 2024-09-19T09:19:47.115 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:19:47.115 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:19:47.131 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T09:19:47.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.272+0000 7fb2b44ba640 1 Processor -- start 2024-09-19T09:19:47.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.272+0000 7fb2b44ba640 1 -- start start 2024-09-19T09:19:47.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.273+0000 7fb2b44ba640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb2ac0cf4a0 0x7fb2ac1662d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:47.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.273+0000 7fb2b44ba640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2ac15c4f0 con 0x7fb2ac0cf010 2024-09-19T09:19:47.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.273+0000 7fb2b44ba640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2ac15b730 con 0x7fb2ac152210 2024-09-19T09:19:47.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.273+0000 7fb2b44ba640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fb2ac15ba10 con 0x7fb2ac0cf4a0 2024-09-19T09:19:47.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.274+0000 7fb2b1a55640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb2ac0cf010 0x7fb2ac162ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:58986/0 (socket says 172.21.15.18:58986) 2024-09-19T09:19:47.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.274+0000 7fb2b1a55640 1 -- 172.21.15.18:0/1227699909 learned_addr learned my addr 172.21.15.18:0/1227699909 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:47.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.274+0000 7fb2b2a57640 1 --2- 172.21.15.18:0/1227699909 >> v2:172.21.15.18:3300/0 conn(0x7fb2ac0cf4a0 0x7fb2ac1662d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:47.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.274+0000 7fb2b1254640 1 -- 172.21.15.18:0/1227699909 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2911911280 0 0) 0x7fb2ac15c4f0 con 0x7fb2ac0cf010 2024-09-19T09:19:47.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.274+0000 7fb2b1254640 1 -- 172.21.15.18:0/1227699909 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb298003520 con 0x7fb2ac0cf010 2024-09-19T09:19:47.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.274+0000 7fb2b2a57640 1 -- 172.21.15.18:0/1227699909 >> v1:172.21.15.162:6789/0 conn(0x7fb2ac152210 legacy=0x7fb2ac071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:47.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.274+0000 7fb2b2a57640 1 -- 172.21.15.18:0/1227699909 >> v1:172.21.15.18:6789/0 conn(0x7fb2ac0cf010 legacy=0x7fb2ac162ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:47.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.274+0000 7fb2b2a57640 1 -- 172.21.15.18:0/1227699909 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2ac15bcf0 con 0x7fb2ac0cf4a0 2024-09-19T09:19:47.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.275+0000 7fb2b2a57640 1 --2- 172.21.15.18:0/1227699909 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2ac0cf4a0 0x7fb2ac1662d0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400aea0 tx=0x7fb2a402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54cf481c95d2cb54 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:47.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.275+0000 7fb2b1254640 1 -- 172.21.15.18:0/1227699909 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4038070 con 0x7fb2ac0cf4a0 2024-09-19T09:19:47.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.275+0000 7fb2b1254640 1 -- 172.21.15.18:0/1227699909 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a4008640 con 0x7fb2ac0cf4a0 2024-09-19T09:19:47.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.275+0000 7fb2b1254640 1 -- 172.21.15.18:0/1227699909 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4008a10 con 0x7fb2ac0cf4a0 2024-09-19T09:19:47.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.275+0000 7fb2b44ba640 1 -- 172.21.15.18:0/1227699909 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2ac0cf4a0 msgr2=0x7fb2ac1662d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:47.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.275+0000 7fb2b44ba640 1 --2- 172.21.15.18:0/1227699909 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2ac0cf4a0 0x7fb2ac1662d0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fb2a400aea0 tx=0x7fb2a402b840 comp rx=0 tx=0).stop 2024-09-19T09:19:47.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.275+0000 7fb2b44ba640 1 -- 172.21.15.18:0/1227699909 shutdown_connections 2024-09-19T09:19:47.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.275+0000 7fb2b44ba640 1 --2- 172.21.15.18:0/1227699909 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2ac0cf4a0 0x7fb2ac1662d0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:47.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.275+0000 7fb2b44ba640 1 -- 172.21.15.18:0/1227699909 >> 172.21.15.18:0/1227699909 conn(0x7fb2ac06bc10 msgr2=0x7fb2ac06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:47.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.275+0000 7fb2b44ba640 1 -- 172.21.15.18:0/1227699909 shutdown_connections 2024-09-19T09:19:47.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.275+0000 7fb2b44ba640 1 -- 172.21.15.18:0/1227699909 wait complete. 2024-09-19T09:19:47.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.277+0000 7fb2b44ba640 1 Processor -- start 2024-09-19T09:19:47.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.277+0000 7fb2b44ba640 1 -- start start 2024-09-19T09:19:47.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.277+0000 7fb2b44ba640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2ac0cf010 0x7fb2ac0cc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:47.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.277+0000 7fb2b44ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2ac0cf4a0 0x7fb2ac1526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:47.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.277+0000 7fb2b44ba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2ac152210 0x7fb2ac15a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:47.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.277+0000 7fb2b44ba640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ac0cf8d0 con 0x7fb2ac152210 2024-09-19T09:19:47.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.277+0000 7fb2b44ba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ac06f380 con 0x7fb2ac0cf4a0 2024-09-19T09:19:47.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.277+0000 7fb2b44ba640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb2ac0725a0 con 0x7fb2ac0cf010 2024-09-19T09:19:47.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.277+0000 7fb2b2a57640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2ac152210 0x7fb2ac15a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:47.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.278+0000 7fb2b2a57640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2ac152210 0x7fb2ac15a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46908/0 (socket says 172.21.15.18:46908) 2024-09-19T09:19:47.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.278+0000 7fb2b2a57640 1 -- 172.21.15.18:0/3742429963 learned_addr learned my addr 172.21.15.18:0/3742429963 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:47.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.278+0000 7fb2b1a55640 1 --2- 172.21.15.18:0/3742429963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2ac0cf4a0 0x7fb2ac1526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:47.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.278+0000 7fb2b2256640 1 --2- 172.21.15.18:0/3742429963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2ac0cf010 0x7fb2ac0cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:47.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.278+0000 7fb2b2a57640 1 -- 172.21.15.18:0/3742429963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2ac0cf010 msgr2=0x7fb2ac0cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:47.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.278+0000 7fb2b2a57640 1 --2- 172.21.15.18:0/3742429963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2ac0cf010 0x7fb2ac0cc710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:47.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.278+0000 7fb2b2a57640 1 -- 172.21.15.18:0/3742429963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2ac0cf4a0 msgr2=0x7fb2ac1526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:47.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.278+0000 7fb2b2a57640 1 --2- 172.21.15.18:0/3742429963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2ac0cf4a0 0x7fb2ac1526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:47.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.278+0000 7fb2b2a57640 1 -- 172.21.15.18:0/3742429963 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2ac153020 con 0x7fb2ac152210 2024-09-19T09:19:47.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.278+0000 7fb2b2256640 1 --2- 172.21.15.18:0/3742429963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2ac0cf010 0x7fb2ac0cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:19:47.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.278+0000 7fb2b2a57640 1 --2- 172.21.15.18:0/3742429963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2ac152210 0x7fb2ac15a060 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4036040 tx=0x7fb2a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:47.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.278+0000 7fb2a2ffd640 1 -- 172.21.15.18:0/3742429963 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4042020 con 0x7fb2ac152210 2024-09-19T09:19:47.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.278+0000 7fb2a2ffd640 1 -- 172.21.15.18:0/3742429963 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a4034730 con 0x7fb2ac152210 2024-09-19T09:19:47.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.278+0000 7fb2b44ba640 1 -- 172.21.15.18:0/3742429963 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2ac153300 con 0x7fb2ac152210 2024-09-19T09:19:47.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.278+0000 7fb2a2ffd640 1 -- 172.21.15.18:0/3742429963 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4038040 con 0x7fb2ac152210 2024-09-19T09:19:47.281 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.278+0000 7fb2b44ba640 1 -- 172.21.15.18:0/3742429963 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2ac1538c0 con 0x7fb2ac152210 2024-09-19T09:19:47.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.279+0000 7fb2b44ba640 1 -- 172.21.15.18:0/3742429963 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2ac071e90 con 0x7fb2ac152210 2024-09-19T09:19:47.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.280+0000 7fb2a2ffd640 1 -- 172.21.15.18:0/3742429963 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb2a4045020 con 0x7fb2ac152210 2024-09-19T09:19:47.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.280+0000 7fb2a2ffd640 1 --2- 172.21.15.18:0/3742429963 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb29006c2b0 0x7fb29006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:47.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.280+0000 7fb2a2ffd640 1 -- 172.21.15.18:0/3742429963 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7fb2a40abd50 con 0x7fb2ac152210 2024-09-19T09:19:47.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.280+0000 7fb2b2256640 1 --2- 172.21.15.18:0/3742429963 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb29006c2b0 0x7fb29006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:47.282 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.281+0000 7fb2b2256640 1 --2- 172.21.15.18:0/3742429963 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb29006c2b0 0x7fb29006e770 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac154810 tx=0x7fb2a8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:47.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.285+0000 7fb2a2ffd640 1 -- 172.21.15.18:0/3742429963 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb2a40af030 con 0x7fb2ac152210 2024-09-19T09:19:47.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.499+0000 7fb2b44ba640 1 -- 172.21.15.18:0/3742429963 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb2ac14d9a0 con 0x7fb2ac152210 2024-09-19T09:19:47.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.499+0000 7fb2a2ffd640 1 -- 172.21.15.18:0/3742429963 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v56) ==== 53+0+73 (secure 0 0 0) 0x7fb2a404c030 con 0x7fb2ac152210 2024-09-19T09:19:47.500 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T09:19:47.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.501+0000 7fb2b44ba640 1 -- 172.21.15.18:0/3742429963 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb29006c2b0 msgr2=0x7fb29006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:47.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.501+0000 7fb2b44ba640 1 --2- 172.21.15.18:0/3742429963 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb29006c2b0 0x7fb29006e770 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac154810 tx=0x7fb2a8009040 comp rx=0 tx=0).stop 2024-09-19T09:19:47.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.501+0000 7fb2b44ba640 1 -- 172.21.15.18:0/3742429963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2ac152210 msgr2=0x7fb2ac15a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:47.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.501+0000 7fb2b44ba640 1 --2- 172.21.15.18:0/3742429963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2ac152210 0x7fb2ac15a060 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fb2a4036040 tx=0x7fb2a4004a40 comp rx=0 tx=0).stop 2024-09-19T09:19:47.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.501+0000 7fb2b44ba640 1 -- 172.21.15.18:0/3742429963 shutdown_connections 2024-09-19T09:19:47.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.501+0000 7fb2b44ba640 1 --2- 172.21.15.18:0/3742429963 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb29006c2b0 0x7fb29006e770 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:47.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.501+0000 7fb2b44ba640 1 --2- 172.21.15.18:0/3742429963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2ac152210 0x7fb2ac15a060 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:47.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.501+0000 7fb2b44ba640 1 --2- 172.21.15.18:0/3742429963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2ac0cf4a0 0x7fb2ac1526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:47.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.501+0000 7fb2b44ba640 1 --2- 172.21.15.18:0/3742429963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2ac0cf010 0x7fb2ac0cc710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:47.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.501+0000 7fb2b44ba640 1 -- 172.21.15.18:0/3742429963 >> 172.21.15.18:0/3742429963 conn(0x7fb2ac06bc10 msgr2=0x7fb2ac0b4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:47.502 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.501+0000 7fb2b44ba640 1 -- 172.21.15.18:0/3742429963 shutdown_connections 2024-09-19T09:19:47.503 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:47.501+0000 7fb2b44ba640 1 -- 172.21.15.18:0/3742429963 wait complete. 2024-09-19T09:19:47.513 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-19T09:19:47.513 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:19:47.513 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-09-19T09:19:47.513 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-19T09:19:47.513 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-19T09:19:47.513 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-19T09:19:47.513 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-19T09:19:47.513 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:19:47.513 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:19:47.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:47.514 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-09-19T09:19:47.534 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:19:47.534 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:19:47.534 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:19:47.534 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:19:47.534 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-09-19T09:19:47.534 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:19:47.534 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:19:47.534 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:19:47.534 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-09-19T09:19:47.534 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:19:47.534 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:19:47.535 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-09-19T09:19:47.535 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:19:47.535 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:19:47.535 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:19:47.535 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:19:47.535 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T09:19:47.535 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42421sec preferred_lft 42421sec 2024-09-19T09:19:47.535 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link noprefixroute 2024-09-19T09:19:47.535 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:19:47.535 INFO:teuthology.orchestra.run.smithi162.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T09:19:47.535 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 5e:4d:7e:1d:19:f9 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:19:47.535 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T09:19:47.535 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:19:47.535 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::5829:65ff:fe01:6bc7/64 scope link 2024-09-19T09:19:47.536 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:19:47.536 INFO:teuthology.orchestra.run.smithi162.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:19:47.536 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 86:86:3e:32:67:c5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T09:19:47.536 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::8486:3eff:fe32:67c5/64 scope link 2024-09-19T09:19:47.536 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:19:47.536 INFO:teuthology.orchestra.run.smithi162.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:19:47.536 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 5e:4d:7e:1d:19:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-19T09:19:47.536 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::5c4d:7eff:fe1d:19f9/64 scope link 2024-09-19T09:19:47.536 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:19:47.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:47.537 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:19:47.603 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-09-19T09:19:47.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:47.605 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-09-19T09:19:47.664 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-09-19T09:19:47.664 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:19:47.664 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T09:19:47.664 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T09:19:47.665 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:19:47.665 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:19:47.665 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-19T09:19:47.665 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T09:19:47.665 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T09:19:47.665 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T09:19:47.665 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-19T09:19:47.757 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:19:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:19:47.791 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:19:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:19:47.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:47.797 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-19T09:19:47.813 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-19T09:19:47.813 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-19T09:19:47.814 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:19:47.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:47.814 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2024-09-19T09:19:47.879 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:19:47.880 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-19T09:19:47.935 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:19:47.936 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:19:47.936 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-19T09:19:47.990 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-19T09:19:47.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:47.991 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:19:48.074 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:19:48.075 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:19:48.075 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:19:48.083 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:19:48.083 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:19:48.083 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:19:48.084 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:19:48.084 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:19:48.088 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:19:48.088 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:19:48.088 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:19:48.088 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:19:48.088 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:19:48.088 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-19T09:19:48.088 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-19T09:19:48.088 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=fec66d7e-50e5-42ed-81de-ad141a2f0f4e" will pass to kernel 2024-09-19T09:19:48.089 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-19T09:19:48.089 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:19:48.090 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:19:48.090 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:19:48.090 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:19:48.091 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:19:48.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:48.091 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-19T09:19:48.156 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:19:48.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:19:48 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:19:48.247 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:19:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:19:48.252 INFO:teuthology.orchestra.run.smithi162.stdout:client6622 2024-09-19T09:19:48.253 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:19:48.253 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:19:48.269 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:19:48.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.381+0000 7f3a60e7b640 1 Processor -- start 2024-09-19T09:19:48.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.381+0000 7f3a60e7b640 1 -- start start 2024-09-19T09:19:48.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.382+0000 7f3a60e7b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a5c15cd60 0x7f3a5c0d1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:48.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.382+0000 7f3a60e7b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3a5c0ce7b0 0x7f3a5c067950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:48.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.382+0000 7f3a60e7b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a5c0cd710 con 0x7f3a5c0d10a0 2024-09-19T09:19:48.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.382+0000 7f3a60e7b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f3a5c0b1f20 con 0x7f3a5c0ce7b0 2024-09-19T09:19:48.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.382+0000 7f3a60e7b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3a5c0cd9f0 con 0x7f3a5c15cd60 2024-09-19T09:19:48.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.382+0000 7f3a5a59c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3a5c0d10a0 0x7f3a5c0d1480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59000/0 (socket says 172.21.15.18:59000) 2024-09-19T09:19:48.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.382+0000 7f3a5a59c640 1 -- 172.21.15.18:0/1926255898 learned_addr learned my addr 172.21.15.18:0/1926255898 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:48.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.382+0000 7f3a5ad9d640 1 --2- 172.21.15.18:0/1926255898 >> v2:172.21.15.18:3300/0 conn(0x7f3a5c0ce7b0 0x7f3a5c067950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:48.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.382+0000 7f3a59d9b640 1 --2- 172.21.15.18:0/1926255898 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a5c15cd60 0x7f3a5c0d1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:48.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.382+0000 7f3a5959a640 1 -- 172.21.15.18:0/1926255898 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1903793893 0 0) 0x7f3a5c0cd710 con 0x7f3a5c0d10a0 2024-09-19T09:19:48.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.382+0000 7f3a5959a640 1 -- 172.21.15.18:0/1926255898 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a44003520 con 0x7f3a5c0d10a0 2024-09-19T09:19:48.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.383+0000 7f3a5ad9d640 1 -- 172.21.15.18:0/1926255898 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a5c15cd60 msgr2=0x7f3a5c0d1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:48.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.383+0000 7f3a5ad9d640 1 --2- 172.21.15.18:0/1926255898 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a5c15cd60 0x7f3a5c0d1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.383+0000 7f3a5ad9d640 1 -- 172.21.15.18:0/1926255898 >> v1:172.21.15.18:6789/0 conn(0x7f3a5c0d10a0 legacy=0x7f3a5c0d1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:48.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.383+0000 7f3a5ad9d640 1 -- 172.21.15.18:0/1926255898 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a5c0cdcd0 con 0x7f3a5c0ce7b0 2024-09-19T09:19:48.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.383+0000 7f3a5ad9d640 1 --2- 172.21.15.18:0/1926255898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a5c0ce7b0 0x7f3a5c067950 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f3a54009dc0 tx=0x7f3a5402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8144813f6bf2e959 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:48.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.383+0000 7f3a5959a640 1 -- 172.21.15.18:0/1926255898 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5402ae60 con 0x7f3a5c0ce7b0 2024-09-19T09:19:48.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.383+0000 7f3a5959a640 1 -- 172.21.15.18:0/1926255898 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a54007740 con 0x7f3a5c0ce7b0 2024-09-19T09:19:48.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.384+0000 7f3a5959a640 1 -- 172.21.15.18:0/1926255898 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a54007b10 con 0x7f3a5c0ce7b0 2024-09-19T09:19:48.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.384+0000 7f3a60e7b640 1 -- 172.21.15.18:0/1926255898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a5c0ce7b0 msgr2=0x7f3a5c067950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:48.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.384+0000 7f3a60e7b640 1 --2- 172.21.15.18:0/1926255898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a5c0ce7b0 0x7f3a5c067950 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f3a54009dc0 tx=0x7f3a5402a680 comp rx=0 tx=0).stop 2024-09-19T09:19:48.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.384+0000 7f3a60e7b640 1 -- 172.21.15.18:0/1926255898 shutdown_connections 2024-09-19T09:19:48.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.384+0000 7f3a60e7b640 1 --2- 172.21.15.18:0/1926255898 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a5c0ce7b0 0x7f3a5c067950 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.384+0000 7f3a60e7b640 1 --2- 172.21.15.18:0/1926255898 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a5c15cd60 0x7f3a5c0d1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.384+0000 7f3a60e7b640 1 -- 172.21.15.18:0/1926255898 >> 172.21.15.18:0/1926255898 conn(0x7f3a5c0731b0 msgr2=0x7f3a5c0735c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:48.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.384+0000 7f3a60e7b640 1 -- 172.21.15.18:0/1926255898 shutdown_connections 2024-09-19T09:19:48.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.384+0000 7f3a60e7b640 1 -- 172.21.15.18:0/1926255898 wait complete. 2024-09-19T09:19:48.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.385+0000 7f3a60e7b640 1 Processor -- start 2024-09-19T09:19:48.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.386+0000 7f3a60e7b640 1 -- start start 2024-09-19T09:19:48.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.386+0000 7f3a60e7b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a5c0ce7b0 0x7f3a5c1f46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:48.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.386+0000 7f3a60e7b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a5c0d10a0 0x7f3a5c0d0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:48.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.386+0000 7f3a60e7b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a5c15cd60 0x7f3a5c15f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:48.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.386+0000 7f3a60e7b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c067e90 con 0x7f3a5c0ce7b0 2024-09-19T09:19:48.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.386+0000 7f3a60e7b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3a5c0ce290 con 0x7f3a5c0d10a0 2024-09-19T09:19:48.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.386+0000 7f3a60e7b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3a5c0b0f10 con 0x7f3a5c15cd60 2024-09-19T09:19:48.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.386+0000 7f3a5a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a5c0ce7b0 0x7f3a5c1f46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:48.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.386+0000 7f3a5a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a5c0ce7b0 0x7f3a5c1f46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46924/0 (socket says 172.21.15.18:46924) 2024-09-19T09:19:48.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.386+0000 7f3a5a59c640 1 -- 172.21.15.18:0/2515899714 learned_addr learned my addr 172.21.15.18:0/2515899714 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:48.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.387+0000 7f3a59d9b640 1 --2- 172.21.15.18:0/2515899714 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a5c0d10a0 0x7f3a5c0d0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:48.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.387+0000 7f3a5a59c640 1 -- 172.21.15.18:0/2515899714 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a5c15cd60 msgr2=0x7f3a5c15f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:48.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.387+0000 7f3a5ad9d640 1 --2- 172.21.15.18:0/2515899714 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a5c15cd60 0x7f3a5c15f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:48.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.387+0000 7f3a5a59c640 1 --2- 172.21.15.18:0/2515899714 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a5c15cd60 0x7f3a5c15f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.387+0000 7f3a5a59c640 1 -- 172.21.15.18:0/2515899714 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a5c0d10a0 msgr2=0x7f3a5c0d0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:48.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.387+0000 7f3a5a59c640 1 --2- 172.21.15.18:0/2515899714 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a5c0d10a0 0x7f3a5c0d0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.387+0000 7f3a5a59c640 1 -- 172.21.15.18:0/2515899714 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a5c0ced00 con 0x7f3a5c0ce7b0 2024-09-19T09:19:48.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.387+0000 7f3a59d9b640 1 --2- 172.21.15.18:0/2515899714 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a5c0d10a0 0x7f3a5c0d0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:48.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.387+0000 7f3a5ad9d640 1 --2- 172.21.15.18:0/2515899714 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a5c15cd60 0x7f3a5c15f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:48.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.387+0000 7f3a5a59c640 1 --2- 172.21.15.18:0/2515899714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a5c0ce7b0 0x7f3a5c1f46c0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c00c430 tx=0x7f3a4c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:48.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.387+0000 7f3a4affd640 1 -- 172.21.15.18:0/2515899714 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c017070 con 0x7f3a5c0ce7b0 2024-09-19T09:19:48.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.387+0000 7f3a4affd640 1 -- 172.21.15.18:0/2515899714 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a4c005ce0 con 0x7f3a5c0ce7b0 2024-09-19T09:19:48.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.387+0000 7f3a60e7b640 1 -- 172.21.15.18:0/2515899714 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a5c0cefe0 con 0x7f3a5c0ce7b0 2024-09-19T09:19:48.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.387+0000 7f3a4affd640 1 -- 172.21.15.18:0/2515899714 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c0072f0 con 0x7f3a5c0ce7b0 2024-09-19T09:19:48.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.387+0000 7f3a60e7b640 1 -- 172.21.15.18:0/2515899714 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a5c0cf5a0 con 0x7f3a5c0ce7b0 2024-09-19T09:19:48.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.388+0000 7f3a60e7b640 1 -- 172.21.15.18:0/2515899714 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a5c067950 con 0x7f3a5c0ce7b0 2024-09-19T09:19:48.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.389+0000 7f3a4affd640 1 -- 172.21.15.18:0/2515899714 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3a4c01a070 con 0x7f3a5c0ce7b0 2024-09-19T09:19:48.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.389+0000 7f3a4affd640 1 --2- 172.21.15.18:0/2515899714 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3a3c06c2e0 0x7f3a3c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:48.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.389+0000 7f3a4affd640 1 -- 172.21.15.18:0/2515899714 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7f3a4c08a8c0 con 0x7f3a5c0ce7b0 2024-09-19T09:19:48.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.389+0000 7f3a59d9b640 1 --2- 172.21.15.18:0/2515899714 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3a3c06c2e0 0x7f3a3c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:48.392 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.390+0000 7f3a59d9b640 1 --2- 172.21.15.18:0/2515899714 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3a3c06c2e0 0x7f3a3c06e7a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3a50006fd0 tx=0x7f3a50008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:48.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.393+0000 7f3a4affd640 1 -- 172.21.15.18:0/2515899714 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3a4c059030 con 0x7f3a5c0ce7b0 2024-09-19T09:19:48.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.610+0000 7f3a60e7b640 1 -- 172.21.15.18:0/2515899714 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a5c160430 con 0x7f3a5c0ce7b0 2024-09-19T09:19:48.611 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.610+0000 7f3a4affd640 1 -- 172.21.15.18:0/2515899714 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5231 (secure 0 0 0) 0x7f3a4c058930 con 0x7f3a5c0ce7b0 2024-09-19T09:19:48.611 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:48.611 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":56,"btime":"2024-09-19T09:19:43:414636+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5846,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1876507362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1876507362},{"type":"v1","addr":"172.21.15.162:6837","nonce":1876507362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2245870616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2245870616},{"type":"v1","addr":"172.21.15.162:6835","nonce":2245870616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6858,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1245398837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1245398837},{"type":"v1","addr":"172.21.15.18:6834","nonce":1245398837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:19:39.754151+0000","modified":"2024-09-19T09:19:42.581316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6861":{"gid":6861,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/2894746570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2894746570},{"type":"v1","addr":"172.21.15.18:6835","nonce":2894746570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6861,"qdb_cluster":[6861]},"id":8}]} 2024-09-19T09:19:48.611 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 56 2024-09-19T09:19:48.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.612+0000 7f3a60e7b640 1 -- 172.21.15.18:0/2515899714 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3a3c06c2e0 msgr2=0x7f3a3c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:48.613 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.612+0000 7f3a60e7b640 1 --2- 172.21.15.18:0/2515899714 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3a3c06c2e0 0x7f3a3c06e7a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3a50006fd0 tx=0x7f3a50008040 comp rx=0 tx=0).stop 2024-09-19T09:19:48.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.612+0000 7f3a60e7b640 1 -- 172.21.15.18:0/2515899714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a5c0ce7b0 msgr2=0x7f3a5c1f46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:48.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.612+0000 7f3a60e7b640 1 --2- 172.21.15.18:0/2515899714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a5c0ce7b0 0x7f3a5c1f46c0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c00c430 tx=0x7f3a4c00c8f0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.613+0000 7f3a60e7b640 1 -- 172.21.15.18:0/2515899714 shutdown_connections 2024-09-19T09:19:48.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.613+0000 7f3a60e7b640 1 --2- 172.21.15.18:0/2515899714 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3a3c06c2e0 0x7f3a3c06e7a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.613+0000 7f3a60e7b640 1 --2- 172.21.15.18:0/2515899714 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a5c15cd60 0x7f3a5c15f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.613+0000 7f3a60e7b640 1 --2- 172.21.15.18:0/2515899714 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a5c0d10a0 0x7f3a5c0d0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.613+0000 7f3a60e7b640 1 --2- 172.21.15.18:0/2515899714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a5c0ce7b0 0x7f3a5c1f46c0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.613+0000 7f3a60e7b640 1 -- 172.21.15.18:0/2515899714 >> 172.21.15.18:0/2515899714 conn(0x7f3a5c0731b0 msgr2=0x7f3a5c0b2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:48.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.613+0000 7f3a60e7b640 1 -- 172.21.15.18:0/2515899714 shutdown_connections 2024-09-19T09:19:48.614 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.613+0000 7f3a60e7b640 1 -- 172.21.15.18:0/2515899714 wait complete. 2024-09-19T09:19:48.624 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-19T09:19:48.745 INFO:teuthology.orchestra.run.smithi018.stdout:{"cluster_fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","whoami":0,"id":6861,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.3432019200000003,"mdsmap_epoch":56,"osdmap_epoch":138,"osdmap_epoch_barrier":138,"uptime":18.452174268} 2024-09-19T09:19:48.745 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", "fs_name": "cephfs", "id": 6861, "mdsmap_epoch": 56, "osdmap_epoch": 138, "osdmap_epoch_barrier": 138, "rank_uptime": 8.34320192, "state": "up:active", "uptime": 18.452174268, "want_state": "up:active", "whoami": 0 } 2024-09-19T09:19:48.745 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2024-09-19T09:19:48.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.853+0000 7f99a51cd640 1 Processor -- start 2024-09-19T09:19:48.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.853+0000 7f99a51cd640 1 -- start start 2024-09-19T09:19:48.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.854+0000 7f99a51cd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f99a00d0370 0x7f99a00d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:48.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.854+0000 7f99a51cd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99a00d37c0 0x7f99a00b5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:48.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.854+0000 7f99a51cd640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99a00d0870 con 0x7f99a015edb0 2024-09-19T09:19:48.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.854+0000 7f99a51cd640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f99a00b4400 con 0x7f99a00d0370 2024-09-19T09:19:48.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.854+0000 7f99a51cd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f99a00d0b50 con 0x7f99a00d37c0 2024-09-19T09:19:48.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.854+0000 7f999e59c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f99a00d0370 0x7f99a00d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:48.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.854+0000 7f999e59c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f99a00d0370 0x7f99a00d3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46934/0 (socket says 172.21.15.18:46934) 2024-09-19T09:19:48.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.854+0000 7f999e59c640 1 -- 172.21.15.18:0/3314643460 learned_addr learned my addr 172.21.15.18:0/3314643460 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:48.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.854+0000 7f999f59e640 1 --2- 172.21.15.18:0/3314643460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99a00d37c0 0x7f99a00b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:48.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.854+0000 7f999e59c640 1 -- 172.21.15.18:0/3314643460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99a00d37c0 msgr2=0x7f99a00b5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:48.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.854+0000 7f999e59c640 1 --2- 172.21.15.18:0/3314643460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99a00d37c0 0x7f99a00b5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.854+0000 7f999e59c640 1 -- 172.21.15.18:0/3314643460 >> v1:172.21.15.162:6789/0 conn(0x7f99a015edb0 legacy=0x7f99a00d29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:48.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.854+0000 7f999e59c640 1 -- 172.21.15.18:0/3314643460 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99a00b4620 con 0x7f99a00d0370 2024-09-19T09:19:48.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.854+0000 7f999f59e640 1 --2- 172.21.15.18:0/3314643460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99a00d37c0 0x7f99a00b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:19:48.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.855+0000 7f999e59c640 1 --2- 172.21.15.18:0/3314643460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99a00d0370 0x7f99a00d3280 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f99a00d5dc0 tx=0x7f999402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81565c641440311e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:48.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.855+0000 7f999dd9b640 1 -- 172.21.15.18:0/3314643460 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9994037070 con 0x7f99a00d0370 2024-09-19T09:19:48.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.855+0000 7f999dd9b640 1 -- 172.21.15.18:0/3314643460 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9994032440 con 0x7f99a00d0370 2024-09-19T09:19:48.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.855+0000 7f999dd9b640 1 -- 172.21.15.18:0/3314643460 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9994032810 con 0x7f99a00d0370 2024-09-19T09:19:48.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.856+0000 7f99a51cd640 1 -- 172.21.15.18:0/3314643460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99a00d0370 msgr2=0x7f99a00d3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:48.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.856+0000 7f99a51cd640 1 --2- 172.21.15.18:0/3314643460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99a00d0370 0x7f99a00d3280 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f99a00d5dc0 tx=0x7f999402a1e0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.856+0000 7f99a51cd640 1 -- 172.21.15.18:0/3314643460 shutdown_connections 2024-09-19T09:19:48.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.856+0000 7f99a51cd640 1 --2- 172.21.15.18:0/3314643460 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99a00d37c0 0x7f99a00b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.856+0000 7f99a51cd640 1 --2- 172.21.15.18:0/3314643460 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99a00d0370 0x7f99a00d3280 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.856+0000 7f99a51cd640 1 -- 172.21.15.18:0/3314643460 >> 172.21.15.18:0/3314643460 conn(0x7f99a009df30 msgr2=0x7f99a00d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:48.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.856+0000 7f99a51cd640 1 -- 172.21.15.18:0/3314643460 shutdown_connections 2024-09-19T09:19:48.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.856+0000 7f99a51cd640 1 -- 172.21.15.18:0/3314643460 wait complete. 2024-09-19T09:19:48.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.857+0000 7f99a51cd640 1 Processor -- start 2024-09-19T09:19:48.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.857+0000 7f99a51cd640 1 -- start start 2024-09-19T09:19:48.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.858+0000 7f99a51cd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99a00d0370 0x7f99a014ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.858+0000 7f99a51cd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99a00d37c0 0x7f99a00ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.858+0000 7f99a51cd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99a015edb0 0x7f99a00ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.858+0000 7f99a51cd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f99a015f190 con 0x7f99a015edb0 2024-09-19T09:19:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.858+0000 7f99a51cd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f99a00b4be0 con 0x7f99a00d0370 2024-09-19T09:19:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.858+0000 7f99a51cd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f99a00b5640 con 0x7f99a00d37c0 2024-09-19T09:19:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.858+0000 7f999f59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99a015edb0 0x7f99a00ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.858+0000 7f999f59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99a015edb0 0x7f99a00ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46942/0 (socket says 172.21.15.18:46942) 2024-09-19T09:19:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.858+0000 7f999f59e640 1 -- 172.21.15.18:0/2574844643 learned_addr learned my addr 172.21.15.18:0/2574844643 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.858+0000 7f999ed9d640 1 --2- 172.21.15.18:0/2574844643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99a00d0370 0x7f99a014ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.858+0000 7f999e59c640 1 --2- 172.21.15.18:0/2574844643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99a00d37c0 0x7f99a00ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.858+0000 7f999f59e640 1 -- 172.21.15.18:0/2574844643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99a00d37c0 msgr2=0x7f99a00ca8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.858+0000 7f999f59e640 1 --2- 172.21.15.18:0/2574844643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99a00d37c0 0x7f99a00ca8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.858+0000 7f999f59e640 1 -- 172.21.15.18:0/2574844643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99a00d0370 msgr2=0x7f99a014ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:48.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.858+0000 7f999f59e640 1 --2- 172.21.15.18:0/2574844643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99a00d0370 0x7f99a014ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:48.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.858+0000 7f999f59e640 1 -- 172.21.15.18:0/2574844643 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99a00cae10 con 0x7f99a015edb0 2024-09-19T09:19:48.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.859+0000 7f999f59e640 1 --2- 172.21.15.18:0/2574844643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99a015edb0 0x7f99a00ce7b0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f999800cf20 tx=0x7f999800a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:48.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.859+0000 7f99877fe640 1 -- 172.21.15.18:0/2574844643 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999801a070 con 0x7f99a015edb0 2024-09-19T09:19:48.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.859+0000 7f99877fe640 1 -- 172.21.15.18:0/2574844643 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f999800d840 con 0x7f99a015edb0 2024-09-19T09:19:48.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.859+0000 7f99a51cd640 1 -- 172.21.15.18:0/2574844643 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99a00c9830 con 0x7f99a015edb0 2024-09-19T09:19:48.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.859+0000 7f99877fe640 1 -- 172.21.15.18:0/2574844643 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f999800dc30 con 0x7f99a015edb0 2024-09-19T09:19:48.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.859+0000 7f99a51cd640 1 -- 172.21.15.18:0/2574844643 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99a00c9df0 con 0x7f99a015edb0 2024-09-19T09:19:48.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.860+0000 7f99a51cd640 1 -- 172.21.15.18:0/2574844643 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99a00d3280 con 0x7f99a015edb0 2024-09-19T09:19:48.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.860+0000 7f99877fe640 1 -- 172.21.15.18:0/2574844643 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f999801d070 con 0x7f99a015edb0 2024-09-19T09:19:48.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.861+0000 7f99877fe640 1 --2- 172.21.15.18:0/2574844643 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f998c06c2b0 0x7f998c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:48.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.861+0000 7f99877fe640 1 -- 172.21.15.18:0/2574844643 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5709+0+0 (secure 0 0 0) 0x7f999808bc00 con 0x7f99a015edb0 2024-09-19T09:19:48.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.861+0000 7f999ed9d640 1 --2- 172.21.15.18:0/2574844643 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f998c06c2b0 0x7f998c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:48.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.862+0000 7f999ed9d640 1 --2- 172.21.15.18:0/2574844643 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f998c06c2b0 0x7f998c06e770 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9990006fd0 tx=0x7f9990009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:48.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:48.865+0000 7f99877fe640 1 -- 172.21.15.18:0/2574844643 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9998092080 con 0x7f99a015edb0 2024-09-19T09:19:49.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.042+0000 7f99a51cd640 1 -- 172.21.15.18:0/2574844643 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) -- 0x7f99a00cf180 con 0x7f99a015edb0 2024-09-19T09:19:49.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.441+0000 7f99877fe640 1 -- 172.21.15.18:0/2574844643 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v139) ==== 181+0+0 (secure 0 0 0) 0x7f9998060030 con 0x7f99a015edb0 2024-09-19T09:19:49.442 INFO:teuthology.orchestra.run.smithi018.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2024-09-19T09:19:49.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.444+0000 7f99a51cd640 1 -- 172.21.15.18:0/2574844643 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f998c06c2b0 msgr2=0x7f998c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:49.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.444+0000 7f99a51cd640 1 --2- 172.21.15.18:0/2574844643 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f998c06c2b0 0x7f998c06e770 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f9990006fd0 tx=0x7f9990009060 comp rx=0 tx=0).stop 2024-09-19T09:19:49.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.444+0000 7f99a51cd640 1 -- 172.21.15.18:0/2574844643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99a015edb0 msgr2=0x7f99a00ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:49.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.444+0000 7f99a51cd640 1 --2- 172.21.15.18:0/2574844643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99a015edb0 0x7f99a00ce7b0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f999800cf20 tx=0x7f999800a7d0 comp rx=0 tx=0).stop 2024-09-19T09:19:49.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.444+0000 7f99a51cd640 1 -- 172.21.15.18:0/2574844643 shutdown_connections 2024-09-19T09:19:49.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.444+0000 7f99a51cd640 1 --2- 172.21.15.18:0/2574844643 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f998c06c2b0 0x7f998c06e770 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:49.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.444+0000 7f99a51cd640 1 --2- 172.21.15.18:0/2574844643 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f99a015edb0 0x7f99a00ce7b0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:49.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.444+0000 7f99a51cd640 1 --2- 172.21.15.18:0/2574844643 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99a00d37c0 0x7f99a00ca8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:49.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.444+0000 7f99a51cd640 1 --2- 172.21.15.18:0/2574844643 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f99a00d0370 0x7f99a014ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:49.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.444+0000 7f99a51cd640 1 -- 172.21.15.18:0/2574844643 >> 172.21.15.18:0/2574844643 conn(0x7f99a009df30 msgr2=0x7f99a00d1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:49.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.444+0000 7f99a51cd640 1 -- 172.21.15.18:0/2574844643 shutdown_connections 2024-09-19T09:19:49.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.444+0000 7f99a51cd640 1 -- 172.21.15.18:0/2574844643 wait complete. 2024-09-19T09:19:49.457 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-19T09:19:49.572 INFO:teuthology.orchestra.run.smithi018.stdout:{"osd_mon_report_interval":"5"} 2024-09-19T09:19:49.573 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-19T09:19:49.573 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2024-09-19T09:19:49.573 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:19:49.573 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:19:49.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:49.589 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2024-09-19T09:19:49.716 INFO:teuthology.orchestra.run.smithi018.stderr:16+0 records in 2024-09-19T09:19:49.716 INFO:teuthology.orchestra.run.smithi018.stderr:16+0 records out 2024-09-19T09:19:49.716 INFO:teuthology.orchestra.run.smithi018.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.0667183 s, 251 MB/s 2024-09-19T09:19:49.717 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:19:49.717 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:19:49.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:19:49.734 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2024-09-19T09:19:49.852 INFO:teuthology.orchestra.run.smithi018.stderr:17+0 records in 2024-09-19T09:19:49.852 INFO:teuthology.orchestra.run.smithi018.stderr:17+0 records out 2024-09-19T09:19:49.852 INFO:teuthology.orchestra.run.smithi018.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.0596415 s, 299 MB/s 2024-09-19T09:19:49.852 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2024-09-19T09:19:49.852 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-19T09:19:49.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.954+0000 7f613abbd640 1 Processor -- start 2024-09-19T09:19:49.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.954+0000 7f613abbd640 1 -- start start 2024-09-19T09:19:49.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.955+0000 7f613abbd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f61340ced00 0x7f61340b67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:49.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.955+0000 7f613abbd640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61340b6db0 con 0x7f613406c320 2024-09-19T09:19:49.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.955+0000 7f613abbd640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61340b7070 con 0x7f613415eea0 2024-09-19T09:19:49.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.955+0000 7f613abbd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f61340b1390 con 0x7f61340ced00 2024-09-19T09:19:49.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.955+0000 7f6133fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f613406c320 0x7f61340b60a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59004/0 (socket says 172.21.15.18:59004) 2024-09-19T09:19:49.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.955+0000 7f6133fff640 1 -- 172.21.15.18:0/3716923399 learned_addr learned my addr 172.21.15.18:0/3716923399 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:49.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.956+0000 7f613915a640 1 --2- 172.21.15.18:0/3716923399 >> v2:172.21.15.162:3300/0 conn(0x7f61340ced00 0x7f61340b67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:49.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.956+0000 7f61337fe640 1 -- 172.21.15.18:0/3716923399 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 473564170 0 0) 0x7f61340b6db0 con 0x7f613406c320 2024-09-19T09:19:49.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.956+0000 7f61337fe640 1 -- 172.21.15.18:0/3716923399 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f611c003520 con 0x7f613406c320 2024-09-19T09:19:49.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.956+0000 7f61337fe640 1 -- 172.21.15.18:0/3716923399 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 710370514 0 0) 0x7f61340b7070 con 0x7f613415eea0 2024-09-19T09:19:49.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.956+0000 7f61337fe640 1 -- 172.21.15.18:0/3716923399 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61340b6db0 con 0x7f613415eea0 2024-09-19T09:19:49.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.956+0000 7f61337fe640 1 -- 172.21.15.18:0/3716923399 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 883904326 0 0) 0x7f611c003520 con 0x7f613406c320 2024-09-19T09:19:49.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.956+0000 7f61337fe640 1 -- 172.21.15.18:0/3716923399 >> v2:172.21.15.162:3300/0 conn(0x7f61340ced00 msgr2=0x7f61340b67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:49.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.956+0000 7f61337fe640 1 --2- 172.21.15.18:0/3716923399 >> v2:172.21.15.162:3300/0 conn(0x7f61340ced00 0x7f61340b67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:49.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.956+0000 7f61337fe640 1 -- 172.21.15.18:0/3716923399 >> v1:172.21.15.162:6789/0 conn(0x7f613415eea0 legacy=0x7f613406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:49.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.956+0000 7f61337fe640 1 -- 172.21.15.18:0/3716923399 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61340b1670 con 0x7f613406c320 2024-09-19T09:19:49.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.956+0000 7f61337fe640 1 -- 172.21.15.18:0/3716923399 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f6128001670 con 0x7f613406c320 2024-09-19T09:19:49.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.956+0000 7f613915a640 1 --2- 172.21.15.18:0/3716923399 >> v2:172.21.15.162:3300/0 conn(0x7f61340ced00 0x7f61340b67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:49.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.956+0000 7f61337fe640 1 -- 172.21.15.18:0/3716923399 >> v1:172.21.15.18:6789/0 conn(0x7f613406c320 legacy=0x7f61340b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:49.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.956+0000 7f61337fe640 1 --2- 172.21.15.18:0/3716923399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f611c003b40 0x7f611c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:49.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.956+0000 7f61337fe640 1 --2- 172.21.15.18:0/3716923399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f611c004800 0x7f611c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:49.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.956+0000 7f61337fe640 1 --2- 172.21.15.18:0/3716923399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f611c0051c0 0x7f611c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:49.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.956+0000 7f61337fe640 1 -- 172.21.15.18:0/3716923399 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f61340b1390 con 0x7f611c003b40 2024-09-19T09:19:49.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.956+0000 7f61337fe640 1 -- 172.21.15.18:0/3716923399 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f611c00c040 con 0x7f611c004800 2024-09-19T09:19:49.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.956+0000 7f61337fe640 1 -- 172.21.15.18:0/3716923399 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f611c00c240 con 0x7f611c0051c0 2024-09-19T09:19:49.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.956+0000 7f6138959640 1 --2- 172.21.15.18:0/3716923399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f611c003b40 0x7f611c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:49.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.956+0000 7f6133fff640 1 --2- 172.21.15.18:0/3716923399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f611c004800 0x7f611c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.956+0000 7f613915a640 1 --2- 172.21.15.18:0/3716923399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f611c0051c0 0x7f611c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.956+0000 7f6138959640 1 -- 172.21.15.18:0/3716923399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f611c0051c0 msgr2=0x7f611c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.956+0000 7f6138959640 1 --2- 172.21.15.18:0/3716923399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f611c0051c0 0x7f611c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.956+0000 7f6138959640 1 -- 172.21.15.18:0/3716923399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f611c004800 msgr2=0x7f611c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.956+0000 7f6138959640 1 --2- 172.21.15.18:0/3716923399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f611c004800 0x7f611c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.956+0000 7f6138959640 1 -- 172.21.15.18:0/3716923399 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f611c003520 con 0x7f611c003b40 2024-09-19T09:19:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.956+0000 7f613915a640 1 -- 172.21.15.18:0/3716923399 reap_dead start 2024-09-19T09:19:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.957+0000 7f6138959640 1 --2- 172.21.15.18:0/3716923399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f611c003b40 0x7f611c003f40 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f61240018d0 tx=0x7f611c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1b123fae2a7772 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.957+0000 7f61337fe640 1 -- 172.21.15.18:0/3716923399 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61240014f0 con 0x7f611c003b40 2024-09-19T09:19:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.957+0000 7f61337fe640 1 -- 172.21.15.18:0/3716923399 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61240052d0 con 0x7f611c003b40 2024-09-19T09:19:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.957+0000 7f61337fe640 1 -- 172.21.15.18:0/3716923399 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612402ac60 con 0x7f611c003b40 2024-09-19T09:19:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.958+0000 7f613abbd640 1 -- 172.21.15.18:0/3716923399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f611c003b40 msgr2=0x7f611c003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:49.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.958+0000 7f613abbd640 1 --2- 172.21.15.18:0/3716923399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f611c003b40 0x7f611c003f40 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f61240018d0 tx=0x7f611c005830 comp rx=0 tx=0).stop 2024-09-19T09:19:49.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.958+0000 7f613abbd640 1 -- 172.21.15.18:0/3716923399 shutdown_connections 2024-09-19T09:19:49.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.958+0000 7f613abbd640 1 --2- 172.21.15.18:0/3716923399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f611c003b40 0x7f611c003f40 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:49.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.958+0000 7f613abbd640 1 -- 172.21.15.18:0/3716923399 >> 172.21.15.18:0/3716923399 conn(0x7f61340731b0 msgr2=0x7f61340735c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:49.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.958+0000 7f613abbd640 1 -- 172.21.15.18:0/3716923399 shutdown_connections 2024-09-19T09:19:49.962 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.958+0000 7f613abbd640 1 -- 172.21.15.18:0/3716923399 wait complete. 2024-09-19T09:19:49.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.959+0000 7f613abbd640 1 Processor -- start 2024-09-19T09:19:49.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.959+0000 7f613abbd640 1 -- start start 2024-09-19T09:19:49.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.960+0000 7f613abbd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f611c003b40 0x7f61341529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:49.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.960+0000 7f613abbd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f613415fae0 0x7f6134161530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:49.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.960+0000 7f613abbd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61341e9730 0x7f61341e9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:49.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.960+0000 7f613abbd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f613406bc10 con 0x7f613415fae0 2024-09-19T09:19:49.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.960+0000 7f613abbd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f61340b1040 con 0x7f611c003b40 2024-09-19T09:19:49.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.960+0000 7f613abbd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f613406bd90 con 0x7f61341e9730 2024-09-19T09:19:49.965 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.960+0000 7f6133fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f613415fae0 0x7f6134161530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:49.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.960+0000 7f6133fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f613415fae0 0x7f6134161530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:46956/0 (socket says 172.21.15.18:46956) 2024-09-19T09:19:49.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.960+0000 7f6133fff640 1 -- 172.21.15.18:0/4218607944 learned_addr learned my addr 172.21.15.18:0/4218607944 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:49.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.960+0000 7f6138959640 1 --2- 172.21.15.18:0/4218607944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f611c003b40 0x7f61341529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:49.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.960+0000 7f613915a640 1 --2- 172.21.15.18:0/4218607944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61341e9730 0x7f61341e9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:49.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.960+0000 7f6133fff640 1 -- 172.21.15.18:0/4218607944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61341e9730 msgr2=0x7f61341e9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:49.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.960+0000 7f6133fff640 1 --2- 172.21.15.18:0/4218607944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61341e9730 0x7f61341e9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:49.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.960+0000 7f6133fff640 1 -- 172.21.15.18:0/4218607944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f611c003b40 msgr2=0x7f61341529a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:49.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.960+0000 7f6133fff640 1 --2- 172.21.15.18:0/4218607944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f611c003b40 0x7f61341529a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:49.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.960+0000 7f6133fff640 1 -- 172.21.15.18:0/4218607944 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6134159ca0 con 0x7f613415fae0 2024-09-19T09:19:49.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.961+0000 7f6133fff640 1 --2- 172.21.15.18:0/4218607944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f613415fae0 0x7f6134161530 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f6128007290 tx=0x7f6128007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:49.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.961+0000 7f61317fa640 1 -- 172.21.15.18:0/4218607944 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6128001630 con 0x7f613415fae0 2024-09-19T09:19:49.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.961+0000 7f61317fa640 1 -- 172.21.15.18:0/4218607944 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6128018070 con 0x7f613415fae0 2024-09-19T09:19:49.966 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.961+0000 7f613abbd640 1 -- 172.21.15.18:0/4218607944 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6134161df0 con 0x7f613415fae0 2024-09-19T09:19:49.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.961+0000 7f61317fa640 1 -- 172.21.15.18:0/4218607944 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f612800fc00 con 0x7f613415fae0 2024-09-19T09:19:49.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.961+0000 7f613abbd640 1 -- 172.21.15.18:0/4218607944 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6134159f40 con 0x7f613415fae0 2024-09-19T09:19:49.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.962+0000 7f613abbd640 1 -- 172.21.15.18:0/4218607944 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61340b60a0 con 0x7f613415fae0 2024-09-19T09:19:49.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.962+0000 7f61317fa640 1 -- 172.21.15.18:0/4218607944 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f612801d460 con 0x7f613415fae0 2024-09-19T09:19:49.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.963+0000 7f61317fa640 1 --2- 172.21.15.18:0/4218607944 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f612006c2e0 0x7f612006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:49.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.963+0000 7f61317fa640 1 -- 172.21.15.18:0/4218607944 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f612808b240 con 0x7f613415fae0 2024-09-19T09:19:49.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.963+0000 7f6138959640 1 --2- 172.21.15.18:0/4218607944 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f612006c2e0 0x7f612006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:49.967 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.964+0000 7f6138959640 1 --2- 172.21.15.18:0/4218607944 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f612006c2e0 0x7f612006e7a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6124032000 tx=0x7f6124009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:49.968 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:49.967+0000 7f61317fa640 1 -- 172.21.15.18:0/4218607944 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6128059360 con 0x7f613415fae0 2024-09-19T09:19:50.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:50.142+0000 7f613abbd640 1 -- 172.21.15.18:0/4218607944 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f6134162310 con 0x7f613415fae0 2024-09-19T09:19:50.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:50.143+0000 7f61317fa640 1 -- 172.21.15.18:0/4218607944 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v139) ==== 81+0+34294 (secure 0 0 0) 0x7f612805d660 con 0x7f613415fae0 2024-09-19T09:19:50.144 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:50.145 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:19:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 139, 2024-09-19T09:19:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:19:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-19T09:13:11.348786+0000", 2024-09-19T09:19:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-19T09:19:49.438130+0000", 2024-09-19T09:19:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-19T09:13:16.423937+0000", 2024-09-19T09:19:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-19T09:13:13.417141+0000", 2024-09-19T09:19:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-19T09:19:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-09-19T09:19:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-19T09:19:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-19T09:19:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-19T09:19:50.145 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-19T09:19:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-19T09:19:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:19:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-19T09:19:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.69999998807907104, 2024-09-19T09:19:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-19T09:19:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-19T09:19:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-19T09:19:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 17, 2024-09-19T09:19:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-19T09:19:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-19T09:19:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "jewel", 2024-09-19T09:19:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-19T09:19:50.146 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-19T09:19:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-19T09:19:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-19T09:19:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-19T09:19:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:13:17.564717+0000", 2024-09-19T09:19:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:19:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:19:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:19:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:19:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:19:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:19:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:19:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:19:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:19:50.147 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:19:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:19:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:19:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:19:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-19T09:19:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-19T09:19:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-19T09:19:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-19T09:19:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-19T09:19:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:19:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:19:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:19:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:19:50.148 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:19:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:19:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:19:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "111", 2024-09-19T09:19:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:19:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:19:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:19:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:19:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:19:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:19:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:19:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:19:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:19:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:19:50.149 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:19:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:19:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:19:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:19:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:19:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:19:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:19:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:19:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:19:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:19:50.150 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:19:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:19:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:19:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:19:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:19:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:19:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:19:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:19:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:19:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:19:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:19:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:19:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:19:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:19:50.151 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:19:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:19:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:19:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:19:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-19T09:19:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-19T09:19:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:19:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-19T09:19:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:19:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:19:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-19T09:19:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-19T09:19:50.152 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-19T09:19:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-19T09:19:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-19T09:19:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:19:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:19:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:19:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 16, 2024-09-19T09:19:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_metadata", 2024-09-19T09:19:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:19:38.333262+0000", 2024-09-19T09:19:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:19:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:19:50.153 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:19:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:19:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:19:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:19:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:19:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:19:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:19:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:19:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:19:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:19:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:19:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-19T09:19:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-19T09:19:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-19T09:19:50.154 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-19T09:19:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-19T09:19:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:19:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:19:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:19:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:19:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:19:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:19:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:19:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "137", 2024-09-19T09:19:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:19:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:19:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:19:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:19:50.155 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:19:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:19:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:19:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:19:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:19:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:19:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:19:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:19:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:19:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:19:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:19:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:19:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:19:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:19:50.156 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:19:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:19:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:19:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:19:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:19:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:19:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:19:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:19:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:19:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:19:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:19:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:19:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:19:50.157 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:19:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:19:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:19:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:19:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:19:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:19:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:19:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4, 2024-09-19T09:19:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 16, 2024-09-19T09:19:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_priority": 5 2024-09-19T09:19:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:19:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:19:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": "cephfs" 2024-09-19T09:19:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.158 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:19:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:19:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 2.25, 2024-09-19T09:19:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 2.25, 2024-09-19T09:19:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:19:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2.25, 2024-09-19T09:19:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2.25, 2024-09-19T09:19:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:19:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:19:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:19:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.159 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 17, 2024-09-19T09:19:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_data", 2024-09-19T09:19:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:19:38.727884+0000", 2024-09-19T09:19:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:19:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:19:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:19:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:19:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:19:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:19:50.160 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:19:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:19:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:19:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:19:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:19:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:19:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:19:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 64, 2024-09-19T09:19:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 64, 2024-09-19T09:19:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 64, 2024-09-19T09:19:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 64, 2024-09-19T09:19:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 64, 2024-09-19T09:19:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:19:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:19:50.161 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:19:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:19:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:19:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:19:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:19:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "139", 2024-09-19T09:19:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:19:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:19:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:19:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:19:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:19:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:19:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:19:50.162 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:19:50.163 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:19:50.163 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 33554432, 2024-09-19T09:19:50.163 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:19:50.163 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:19:50.163 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:19:50.163 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:19:50.163 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:19:50.163 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:19:50.163 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:19:50.163 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:19:50.164 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:19:50.164 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:19:50.164 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:19:50.164 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:19:50.164 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:19:50.164 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:19:50.164 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:19:50.164 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:19:50.164 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.164 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:19:50.164 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:19:50.164 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:19:50.164 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:19:50.165 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:19:50.165 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:19:50.165 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:19:50.165 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:19:50.165 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:19:50.165 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:19:50.165 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:19:50.165 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:19:50.165 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 64, 2024-09-19T09:19:50.165 INFO:teuthology.orchestra.run.smithi018.stdout: "target_size_ratio": 0.89999997615814209 2024-09-19T09:19:50.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.166 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:19:50.166 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:19:50.166 INFO:teuthology.orchestra.run.smithi018.stdout: "data": "cephfs" 2024-09-19T09:19:50.166 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.166 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.166 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:19:50.166 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:19:50.166 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.3799999952316284, 2024-09-19T09:19:50.166 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.3799999952316284, 2024-09-19T09:19:50.167 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:19:50.167 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-19T09:19:50.167 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-19T09:19:50.167 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:19:50.167 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:19:50.167 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:19:50.167 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.167 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.167 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:19:50.167 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-19T09:19:50.167 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.167 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:19:50.167 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:19:50.167 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:19:50.168 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:19:50.168 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:19:50.168 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:19:50.168 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:19:50.168 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:19:50.168 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:19:50.168 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:19:50.168 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:19:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:19:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:19:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-19T09:19:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:19:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-19T09:19:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:19:50.169 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:19:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-19T09:19:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:19:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-19T09:19:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:19:50.170 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.171 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.171 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:19:50.171 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.171 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.171 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-19T09:19:50.171 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:19:50.171 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.171 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.171 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.171 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-19T09:19:50.171 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:19:50.171 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.172 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.172 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:19:50.172 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.172 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.172 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-19T09:19:50.172 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:19:50.172 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.172 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.172 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.172 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-19T09:19:50.173 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:19:50.173 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.173 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.173 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/128722874", 2024-09-19T09:19:50.173 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/128722874", 2024-09-19T09:19:50.173 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/128722874", 2024-09-19T09:19:50.173 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/128722874", 2024-09-19T09:19:50.173 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:19:50.173 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:19:50.173 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:19:50.173 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.173 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.174 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.174 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:19:50.174 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:19:50.174 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:19:50.174 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:19:50.174 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:19:50.174 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:19:50.174 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:19:50.174 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:19:50.174 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:19:50.174 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:19:50.174 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:19:50.174 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:19:50.175 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:19:50.175 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.175 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.175 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-19T09:19:50.175 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:19:50.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.175 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.175 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.175 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-19T09:19:50.175 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:19:50.175 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.175 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.175 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.176 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:19:50.176 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.176 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.176 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-19T09:19:50.176 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:19:50.176 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.176 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.176 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.177 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-19T09:19:50.177 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:19:50.177 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.177 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.177 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:19:50.177 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.177 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.177 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-19T09:19:50.177 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:19:50.177 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.177 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.177 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.178 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-19T09:19:50.178 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:19:50.178 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.178 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.178 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:19:50.178 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.178 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.178 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-19T09:19:50.178 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:19:50.178 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.178 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.179 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.179 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-19T09:19:50.179 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:19:50.179 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.179 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.179 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.179 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/3672199638", 2024-09-19T09:19:50.179 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/3672199638", 2024-09-19T09:19:50.179 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/3672199638", 2024-09-19T09:19:50.179 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/3672199638", 2024-09-19T09:19:50.179 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:19:50.179 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:19:50.179 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:19:50.179 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.180 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.180 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.180 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:19:50.180 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:19:50.180 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:19:50.180 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:19:50.180 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:19:50.180 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:19:50.180 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:19:50.180 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:19:50.180 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:19:50.180 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:19:50.180 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:19:50.180 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:19:50.181 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:19:50.181 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.181 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.181 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T09:19:50.181 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:19:50.181 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.181 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.181 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.181 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T09:19:50.181 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:19:50.181 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.181 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.182 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:19:50.182 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.182 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.182 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-19T09:19:50.182 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:19:50.182 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.182 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.182 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.183 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-19T09:19:50.183 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:19:50.183 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.183 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.183 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:19:50.183 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.183 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.183 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-19T09:19:50.183 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:19:50.183 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.183 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.184 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.184 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-19T09:19:50.184 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:19:50.184 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.184 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.184 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.184 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:19:50.184 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.185 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.185 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-19T09:19:50.185 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:19:50.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.185 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.185 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.185 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-19T09:19:50.185 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:19:50.185 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.185 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.185 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.186 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3463367841", 2024-09-19T09:19:50.186 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3463367841", 2024-09-19T09:19:50.186 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3463367841", 2024-09-19T09:19:50.186 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3463367841", 2024-09-19T09:19:50.186 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:19:50.186 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:19:50.186 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:19:50.186 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.187 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.187 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.187 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:19:50.187 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:19:50.187 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:19:50.187 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:19:50.187 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:19:50.187 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:19:50.187 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:19:50.187 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:19:50.188 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:19:50.188 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:19:50.188 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:19:50.188 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:19:50.188 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:19:50.188 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.188 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.188 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.188 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-19T09:19:50.188 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:19:50.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.189 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.189 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-19T09:19:50.189 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:19:50.189 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.189 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.189 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.189 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:19:50.189 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.189 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.189 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.190 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-19T09:19:50.190 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:19:50.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.190 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.190 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-19T09:19:50.190 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:19:50.190 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.190 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.190 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.190 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:19:50.190 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.190 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.191 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.191 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-19T09:19:50.191 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:19:50.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.191 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.191 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.191 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-19T09:19:50.191 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:19:50.191 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.191 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.191 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.192 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:19:50.192 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.192 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.192 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-19T09:19:50.192 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:19:50.192 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.192 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.192 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.192 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-19T09:19:50.192 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:19:50.192 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.192 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.193 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/4163178582", 2024-09-19T09:19:50.193 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/4163178582", 2024-09-19T09:19:50.193 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/4163178582", 2024-09-19T09:19:50.193 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/4163178582", 2024-09-19T09:19:50.193 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:19:50.193 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:19:50.193 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:19:50.193 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.193 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.193 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.193 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:19:50.193 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:19:50.194 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:19:50.194 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:19:50.194 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:19:50.194 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:19:50.194 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:19:50.194 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:19:50.194 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:19:50.194 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:19:50.194 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:19:50.194 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:19:50.194 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:19:50.194 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.194 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.194 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.195 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6822", 2024-09-19T09:19:50.195 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:19:50.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.195 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.195 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6824", 2024-09-19T09:19:50.195 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:19:50.195 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.195 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.195 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.195 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:19:50.195 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.195 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.195 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.196 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6826", 2024-09-19T09:19:50.196 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:19:50.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.196 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.196 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6827", 2024-09-19T09:19:50.196 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:19:50.196 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.196 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.196 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.196 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:19:50.196 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.196 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.197 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.197 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6830", 2024-09-19T09:19:50.197 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:19:50.197 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.197 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.197 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.197 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6831", 2024-09-19T09:19:50.197 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:19:50.197 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.197 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.198 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:19:50.198 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.198 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.198 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6828", 2024-09-19T09:19:50.198 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:19:50.198 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.198 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.198 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.198 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6829", 2024-09-19T09:19:50.198 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:19:50.198 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.198 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.199 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6824/3538482215", 2024-09-19T09:19:50.199 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6827/3538482215", 2024-09-19T09:19:50.199 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6831/3538482215", 2024-09-19T09:19:50.199 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6829/3538482215", 2024-09-19T09:19:50.199 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:19:50.199 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:19:50.199 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:19:50.199 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.199 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.199 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.199 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:19:50.199 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:19:50.199 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:19:50.200 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:19:50.200 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:19:50.200 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:19:50.200 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:19:50.200 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:19:50.200 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:19:50.200 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:19:50.200 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:19:50.200 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:19:50.200 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:19:50.200 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.200 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.200 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.200 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6800", 2024-09-19T09:19:50.201 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:19:50.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.201 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.201 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6801", 2024-09-19T09:19:50.201 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:19:50.201 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.201 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.201 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.201 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:19:50.201 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.201 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.201 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.202 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6802", 2024-09-19T09:19:50.202 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:19:50.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.202 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.202 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6803", 2024-09-19T09:19:50.202 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:19:50.202 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.202 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.202 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.202 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:19:50.202 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.202 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.203 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.203 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6806", 2024-09-19T09:19:50.203 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:19:50.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.203 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.203 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6807", 2024-09-19T09:19:50.203 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:19:50.203 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.203 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.203 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.203 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:19:50.203 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.203 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.203 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.204 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6804", 2024-09-19T09:19:50.204 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:19:50.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.204 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.204 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.204 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6805", 2024-09-19T09:19:50.204 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:19:50.204 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.204 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.204 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.204 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6801/2408698413", 2024-09-19T09:19:50.204 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6803/2408698413", 2024-09-19T09:19:50.204 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6807/2408698413", 2024-09-19T09:19:50.205 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6805/2408698413", 2024-09-19T09:19:50.205 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:19:50.205 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:19:50.205 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:19:50.205 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.205 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.205 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.205 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:19:50.205 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:19:50.205 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:19:50.205 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:19:50.205 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:19:50.205 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:19:50.206 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:19:50.206 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:19:50.206 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:19:50.206 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:19:50.206 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:19:50.206 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:19:50.206 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:19:50.206 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.206 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.206 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6808", 2024-09-19T09:19:50.206 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:19:50.206 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.206 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.207 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.207 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6809", 2024-09-19T09:19:50.207 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:19:50.207 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.207 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.207 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.207 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:19:50.207 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.208 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.208 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6810", 2024-09-19T09:19:50.208 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:19:50.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.208 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.208 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.208 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6811", 2024-09-19T09:19:50.208 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:19:50.208 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.208 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.208 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.208 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:19:50.209 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.209 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.209 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6814", 2024-09-19T09:19:50.209 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:19:50.209 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.209 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.209 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.209 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6815", 2024-09-19T09:19:50.209 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:19:50.210 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.210 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.210 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:19:50.210 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.210 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.210 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6812", 2024-09-19T09:19:50.210 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:19:50.210 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.210 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.210 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.210 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6813", 2024-09-19T09:19:50.211 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:19:50.211 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.211 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.211 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6809/2596207948", 2024-09-19T09:19:50.211 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6811/2596207948", 2024-09-19T09:19:50.211 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6815/2596207948", 2024-09-19T09:19:50.211 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6813/2596207948", 2024-09-19T09:19:50.211 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:19:50.211 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:19:50.211 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:19:50.211 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.211 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.211 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.211 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:19:50.212 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:19:50.212 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:19:50.212 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:19:50.212 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:19:50.212 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:19:50.212 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:19:50.212 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:19:50.212 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:19:50.212 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:19:50.212 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:19:50.212 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:19:50.212 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:19:50.213 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.213 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.213 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6816", 2024-09-19T09:19:50.213 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:19:50.213 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.213 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.214 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.214 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6817", 2024-09-19T09:19:50.214 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:19:50.214 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.214 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.214 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.215 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:19:50.215 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.215 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.215 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.215 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6818", 2024-09-19T09:19:50.215 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:19:50.215 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.216 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.216 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6819", 2024-09-19T09:19:50.216 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:19:50.216 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.216 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.216 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.216 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:19:50.216 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.216 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.217 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.217 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6823", 2024-09-19T09:19:50.217 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:19:50.217 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.217 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.217 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.217 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6825", 2024-09-19T09:19:50.217 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:19:50.217 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.217 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.218 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.218 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:19:50.218 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:50.218 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.218 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:50.218 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6820", 2024-09-19T09:19:50.219 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:19:50.219 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.219 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.219 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:50.219 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6821", 2024-09-19T09:19:50.219 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:19:50.219 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.220 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.220 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.220 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6817/1334618296", 2024-09-19T09:19:50.220 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6819/1334618296", 2024-09-19T09:19:50.220 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6825/1334618296", 2024-09-19T09:19:50.220 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6821/1334618296", 2024-09-19T09:19:50.220 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:19:50.220 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:19:50.220 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:19:50.220 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:50.221 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.221 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:19:50.221 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-19T09:19:50.221 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.221 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:19:50.221 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:19:50.221 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:19:50.221 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:19:50.221 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:19:50.221 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:19:50.221 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.580838+0000", 2024-09-19T09:19:50.221 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:19:50.221 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.222 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:19:50.222 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:19:50.222 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:19:50.222 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:19:50.222 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:19:50.222 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:19:50.222 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.599990+0000", 2024-09-19T09:19:50.222 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:19:50.222 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.222 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.222 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:19:50.223 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:19:50.223 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:19:50.223 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:19:50.223 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:19:50.223 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:19:50.223 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.503722+0000", 2024-09-19T09:19:50.223 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:19:50.223 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.223 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.223 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:19:50.223 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:19:50.223 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:19:50.223 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:19:50.223 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:19:50.224 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:19:50.224 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.607846+0000", 2024-09-19T09:19:50.224 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:19:50.224 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.224 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.224 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:19:50.224 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:19:50.224 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:19:50.224 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:19:50.224 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:19:50.224 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:19:50.225 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.616858+0000", 2024-09-19T09:19:50.225 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:19:50.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.225 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.225 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:19:50.225 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:19:50.225 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:19:50.225 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:19:50.225 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:19:50.225 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:19:50.225 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.542726+0000", 2024-09-19T09:19:50.225 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:19:50.225 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.226 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:19:50.226 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:19:50.226 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:19:50.226 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:19:50.226 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:19:50.226 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:19:50.226 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.534178+0000", 2024-09-19T09:19:50.226 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:19:50.226 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.226 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:50.226 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:19:50.227 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:19:50.227 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:19:50.227 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:19:50.227 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:19:50.227 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:19:50.227 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.612105+0000", 2024-09-19T09:19:50.227 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:19:50.227 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.227 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:19:50.227 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-19T09:19:50.227 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-19T09:19:50.228 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-19T09:19:50.228 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-19T09:19:50.228 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-19T09:19:50.228 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-19T09:19:50.228 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-19T09:19:50.228 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-19T09:19:50.228 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-19T09:19:50.229 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-19T09:19:50.229 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-19T09:19:50.229 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-19T09:19:50.229 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-19T09:19:50.229 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-19T09:19:50.229 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.229 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:50.229 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-19T09:19:50.229 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-19T09:19:50.229 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-19T09:19:50.229 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-19T09:19:50.230 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-19T09:19:50.230 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-19T09:19:50.230 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-19T09:19:50.230 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-19T09:19:50.230 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-19T09:19:50.230 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-19T09:19:50.230 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-19T09:19:50.230 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:50.230 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:19:50.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:50.145+0000 7f613abbd640 1 -- 172.21.15.18:0/4218607944 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f612006c2e0 msgr2=0x7f612006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:50.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:50.145+0000 7f613abbd640 1 --2- 172.21.15.18:0/4218607944 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f612006c2e0 0x7f612006e7a0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f6124032000 tx=0x7f6124009030 comp rx=0 tx=0).stop 2024-09-19T09:19:50.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:50.145+0000 7f613abbd640 1 -- 172.21.15.18:0/4218607944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f613415fae0 msgr2=0x7f6134161530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:50.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:50.145+0000 7f613abbd640 1 --2- 172.21.15.18:0/4218607944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f613415fae0 0x7f6134161530 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f6128007290 tx=0x7f6128007750 comp rx=0 tx=0).stop 2024-09-19T09:19:50.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:50.145+0000 7f613abbd640 1 -- 172.21.15.18:0/4218607944 shutdown_connections 2024-09-19T09:19:50.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:50.145+0000 7f613abbd640 1 --2- 172.21.15.18:0/4218607944 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f612006c2e0 0x7f612006e7a0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:50.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:50.145+0000 7f613abbd640 1 --2- 172.21.15.18:0/4218607944 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f61341e9730 0x7f61341e9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:50.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:50.145+0000 7f613abbd640 1 --2- 172.21.15.18:0/4218607944 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f613415fae0 0x7f6134161530 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:50.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:50.145+0000 7f613abbd640 1 --2- 172.21.15.18:0/4218607944 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f611c003b40 0x7f61341529a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:50.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:50.145+0000 7f613abbd640 1 -- 172.21.15.18:0/4218607944 >> 172.21.15.18:0/4218607944 conn(0x7f61340731b0 msgr2=0x7f613406ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:50.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:50.146+0000 7f613abbd640 1 -- 172.21.15.18:0/4218607944 shutdown_connections 2024-09-19T09:19:50.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:50.146+0000 7f613abbd640 1 -- 172.21.15.18:0/4218607944 wait complete. 2024-09-19T09:19:50.234 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-19T09:19:55.235 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-19T09:19:55.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.350+0000 7f3afe928640 1 Processor -- start 2024-09-19T09:19:55.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.350+0000 7f3afe928640 1 -- start start 2024-09-19T09:19:55.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.351+0000 7f3afe928640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3af8142150 0x7f3af8160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:55.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.351+0000 7f3afe928640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3af8160a80 0x7f3af80cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:55.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.351+0000 7f3afe928640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3af8142650 con 0x7f3af813fae0 2024-09-19T09:19:55.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.351+0000 7f3afe928640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f3af80ce780 con 0x7f3af8142150 2024-09-19T09:19:55.352 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.351+0000 7f3afe928640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3af8142930 con 0x7f3af8160a80 2024-09-19T09:19:55.353 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.352+0000 7f3afcec5640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3af8160a80 0x7f3af80cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:55.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.352+0000 7f3af77fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3af8142150 0x7f3af8160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:55.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.352+0000 7f3af7fff640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f3af813fae0 0x7f3af806f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:59300/0 (socket says 172.21.15.18:59300) 2024-09-19T09:19:55.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.352+0000 7f3af7fff640 1 -- 172.21.15.18:0/1165859616 learned_addr learned my addr 172.21.15.18:0/1165859616 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:19:55.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.352+0000 7f3af6ffd640 1 -- 172.21.15.18:0/1165859616 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 120125944 0 0) 0x7f3af8142650 con 0x7f3af813fae0 2024-09-19T09:19:55.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.352+0000 7f3af6ffd640 1 -- 172.21.15.18:0/1165859616 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ae0003520 con 0x7f3af813fae0 2024-09-19T09:19:55.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.352+0000 7f3afcec5640 1 -- 172.21.15.18:0/1165859616 >> v2:172.21.15.162:3300/0 conn(0x7f3af8142150 msgr2=0x7f3af8160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:19:55.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.352+0000 7f3afcec5640 1 --2- 172.21.15.18:0/1165859616 >> v2:172.21.15.162:3300/0 conn(0x7f3af8142150 0x7f3af8160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.352+0000 7f3afcec5640 1 -- 172.21.15.18:0/1165859616 >> v1:172.21.15.162:6789/0 conn(0x7f3af813fae0 legacy=0x7f3af806f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:55.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.352+0000 7f3afcec5640 1 -- 172.21.15.18:0/1165859616 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af8142c10 con 0x7f3af8160a80 2024-09-19T09:19:55.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.352+0000 7f3af77fe640 1 --2- 172.21.15.18:0/1165859616 >> v2:172.21.15.162:3300/0 conn(0x7f3af8142150 0x7f3af8160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:19:55.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.353+0000 7f3afcec5640 1 --2- 172.21.15.18:0/1165859616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3af8160a80 0x7f3af80cec10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3af0009d90 tx=0x7f3af002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a786231790bde452 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:55.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.353+0000 7f3af6ffd640 1 -- 172.21.15.18:0/1165859616 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af0031600 con 0x7f3af8160a80 2024-09-19T09:19:55.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.353+0000 7f3af6ffd640 1 -- 172.21.15.18:0/1165859616 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af00317a0 con 0x7f3af8160a80 2024-09-19T09:19:55.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.353+0000 7f3af6ffd640 1 -- 172.21.15.18:0/1165859616 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af0031b70 con 0x7f3af8160a80 2024-09-19T09:19:55.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.354+0000 7f3afe928640 1 -- 172.21.15.18:0/1165859616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3af8160a80 msgr2=0x7f3af80cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:55.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.354+0000 7f3afe928640 1 --2- 172.21.15.18:0/1165859616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3af8160a80 0x7f3af80cec10 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3af0009d90 tx=0x7f3af002a5d0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.354+0000 7f3afe928640 1 -- 172.21.15.18:0/1165859616 shutdown_connections 2024-09-19T09:19:55.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.354+0000 7f3afe928640 1 --2- 172.21.15.18:0/1165859616 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3af8160a80 0x7f3af80cec10 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.354+0000 7f3afe928640 1 --2- 172.21.15.18:0/1165859616 >> v2:172.21.15.162:3300/0 conn(0x7f3af8142150 0x7f3af8160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.354+0000 7f3afe928640 1 -- 172.21.15.18:0/1165859616 >> 172.21.15.18:0/1165859616 conn(0x7f3af806bc10 msgr2=0x7f3af806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:55.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.354+0000 7f3afe928640 1 -- 172.21.15.18:0/1165859616 shutdown_connections 2024-09-19T09:19:55.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.354+0000 7f3afe928640 1 -- 172.21.15.18:0/1165859616 wait complete. 2024-09-19T09:19:55.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.355+0000 7f3afe928640 1 Processor -- start 2024-09-19T09:19:55.357 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.355+0000 7f3afe928640 1 -- start start 2024-09-19T09:19:55.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.356+0000 7f3afe928640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3af813fae0 0x7f3af815bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:55.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.356+0000 7f3afe928640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3af8142150 0x7f3af8145990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:55.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.356+0000 7f3afe928640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3af8160a80 0x7f3af813f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:55.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.356+0000 7f3afe928640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3af80cf2d0 con 0x7f3af8160a80 2024-09-19T09:19:55.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.356+0000 7f3afe928640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3af80cf150 con 0x7f3af8142150 2024-09-19T09:19:55.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.356+0000 7f3afe928640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3af80cf450 con 0x7f3af813fae0 2024-09-19T09:19:55.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.356+0000 7f3afcec5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3af8160a80 0x7f3af813f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:55.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.356+0000 7f3afcec5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3af8160a80 0x7f3af813f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35062/0 (socket says 172.21.15.18:35062) 2024-09-19T09:19:55.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.356+0000 7f3afcec5640 1 -- 172.21.15.18:0/2107561537 learned_addr learned my addr 172.21.15.18:0/2107561537 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:19:55.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.356+0000 7f3af77fe640 1 --2- 172.21.15.18:0/2107561537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3af8142150 0x7f3af8145990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:55.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.356+0000 7f3af7fff640 1 --2- 172.21.15.18:0/2107561537 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3af813fae0 0x7f3af815bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:55.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.356+0000 7f3afcec5640 1 -- 172.21.15.18:0/2107561537 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3af813fae0 msgr2=0x7f3af815bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:55.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.356+0000 7f3afcec5640 1 --2- 172.21.15.18:0/2107561537 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3af813fae0 0x7f3af815bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.356+0000 7f3afcec5640 1 -- 172.21.15.18:0/2107561537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3af8142150 msgr2=0x7f3af8145990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:55.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.356+0000 7f3afcec5640 1 --2- 172.21.15.18:0/2107561537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3af8142150 0x7f3af8145990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.357+0000 7f3afcec5640 1 -- 172.21.15.18:0/2107561537 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af813f670 con 0x7f3af8160a80 2024-09-19T09:19:55.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.357+0000 7f3afcec5640 1 --2- 172.21.15.18:0/2107561537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3af8160a80 0x7f3af813f130 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f3af0009eb0 tx=0x7f3af0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:55.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.357+0000 7f3af4ff9640 1 -- 172.21.15.18:0/2107561537 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af003f070 con 0x7f3af8160a80 2024-09-19T09:19:55.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.357+0000 7f3af4ff9640 1 -- 172.21.15.18:0/2107561537 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3af003b820 con 0x7f3af8160a80 2024-09-19T09:19:55.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.357+0000 7f3afe928640 1 -- 172.21.15.18:0/2107561537 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3af815c330 con 0x7f3af8160a80 2024-09-19T09:19:55.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.357+0000 7f3af4ff9640 1 -- 172.21.15.18:0/2107561537 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af003bbd0 con 0x7f3af8160a80 2024-09-19T09:19:55.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.357+0000 7f3afe928640 1 -- 172.21.15.18:0/2107561537 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3af81432d0 con 0x7f3af8160a80 2024-09-19T09:19:55.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.358+0000 7f3afe928640 1 -- 172.21.15.18:0/2107561537 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3af8160540 con 0x7f3af8160a80 2024-09-19T09:19:55.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.358+0000 7f3af4ff9640 1 -- 172.21.15.18:0/2107561537 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3af004d3f0 con 0x7f3af8160a80 2024-09-19T09:19:55.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.359+0000 7f3af4ff9640 1 --2- 172.21.15.18:0/2107561537 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3ae406c2b0 0x7f3ae406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:19:55.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.359+0000 7f3af4ff9640 1 -- 172.21.15.18:0/2107561537 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5709+0+0 (secure 0 0 0) 0x7f3af00ac750 con 0x7f3af8160a80 2024-09-19T09:19:55.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.359+0000 7f3af7fff640 1 --2- 172.21.15.18:0/2107561537 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3ae406c2b0 0x7f3ae406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:19:55.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.360+0000 7f3af7fff640 1 --2- 172.21.15.18:0/2107561537 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3ae406c2b0 0x7f3ae406e770 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3ae8005880 tx=0x7f3ae8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:19:55.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.363+0000 7f3af4ff9640 1 -- 172.21.15.18:0/2107561537 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3af007a900 con 0x7f3af8160a80 2024-09-19T09:19:55.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.542+0000 7f3afe928640 1 -- 172.21.15.18:0/2107561537 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f3af80b0f50 con 0x7f3af8160a80 2024-09-19T09:19:55.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.543+0000 7f3af4ff9640 1 -- 172.21.15.18:0/2107561537 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v139) ==== 81+0+34294 (secure 0 0 0) 0x7f3af007ec00 con 0x7f3af8160a80 2024-09-19T09:19:55.544 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:19:55.544 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:19:55.544 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 139, 2024-09-19T09:19:55.545 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:19:55.545 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-19T09:13:11.348786+0000", 2024-09-19T09:19:55.545 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-19T09:19:49.438130+0000", 2024-09-19T09:19:55.545 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-19T09:13:16.423937+0000", 2024-09-19T09:19:55.545 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-19T09:13:13.417141+0000", 2024-09-19T09:19:55.545 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-19T09:19:55.545 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-09-19T09:19:55.545 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-19T09:19:55.545 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-19T09:19:55.545 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-19T09:19:55.545 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-19T09:19:55.545 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-19T09:19:55.545 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:19:55.546 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-19T09:19:55.546 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.69999998807907104, 2024-09-19T09:19:55.546 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-19T09:19:55.546 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-19T09:19:55.546 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-19T09:19:55.546 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 17, 2024-09-19T09:19:55.546 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-19T09:19:55.546 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-19T09:19:55.546 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "jewel", 2024-09-19T09:19:55.546 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-19T09:19:55.546 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-19T09:19:55.546 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-19T09:19:55.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.547 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-19T09:19:55.547 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-19T09:19:55.547 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:13:17.564717+0000", 2024-09-19T09:19:55.547 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:19:55.547 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:19:55.547 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:19:55.547 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:19:55.547 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:19:55.547 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:19:55.547 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:19:55.547 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:19:55.547 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:19:55.547 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:19:55.547 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:19:55.548 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:19:55.548 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:19:55.548 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-19T09:19:55.548 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-19T09:19:55.548 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-19T09:19:55.548 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-19T09:19:55.548 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-19T09:19:55.548 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:19:55.548 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:19:55.548 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:19:55.548 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:19:55.548 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:19:55.548 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:19:55.549 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:19:55.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.549 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "111", 2024-09-19T09:19:55.549 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:19:55.549 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:19:55.549 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:19:55.549 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:19:55.549 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:19:55.549 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:19:55.549 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:19:55.549 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:19:55.549 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:19:55.549 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:19:55.550 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:19:55.550 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:19:55.550 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:19:55.550 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:19:55.550 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:19:55.550 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:19:55.550 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:19:55.550 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:19:55.550 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:19:55.550 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:19:55.550 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:19:55.550 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:19:55.550 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:19:55.550 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:19:55.551 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:19:55.551 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:19:55.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.551 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:19:55.551 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:19:55.551 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:19:55.551 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:19:55.551 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:19:55.551 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:19:55.551 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:19:55.551 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:19:55.551 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:19:55.551 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:19:55.551 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:19:55.552 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:19:55.552 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-19T09:19:55.552 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-19T09:19:55.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.552 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:19:55.552 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-19T09:19:55.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.552 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:19:55.552 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:19:55.552 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-19T09:19:55.552 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-19T09:19:55.552 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-19T09:19:55.552 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-19T09:19:55.552 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-19T09:19:55.553 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:19:55.553 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:19:55.553 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:19:55.553 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.553 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.553 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.553 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 16, 2024-09-19T09:19:55.553 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_metadata", 2024-09-19T09:19:55.553 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:19:38.333262+0000", 2024-09-19T09:19:55.553 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:19:55.553 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:19:55.553 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:19:55.553 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:19:55.553 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:19:55.554 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:19:55.554 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:19:55.554 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:19:55.554 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:19:55.554 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:19:55.554 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:19:55.554 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:19:55.554 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:19:55.554 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-19T09:19:55.554 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-19T09:19:55.554 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-19T09:19:55.554 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-19T09:19:55.554 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-19T09:19:55.554 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:19:55.555 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:19:55.555 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:19:55.555 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:19:55.555 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:19:55.555 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:19:55.555 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:19:55.555 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.555 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "137", 2024-09-19T09:19:55.555 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:19:55.555 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:19:55.555 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:19:55.556 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:19:55.556 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:19:55.556 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:19:55.556 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:19:55.556 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:19:55.556 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:19:55.556 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:19:55.556 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:19:55.556 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:19:55.556 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:19:55.556 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:19:55.556 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:19:55.556 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:19:55.556 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:19:55.557 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:19:55.557 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:19:55.557 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:19:55.557 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:19:55.557 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:19:55.557 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:19:55.557 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:19:55.557 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:19:55.557 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:19:55.557 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.557 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:19:55.557 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:19:55.557 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:19:55.557 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:19:55.558 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:19:55.558 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:19:55.558 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:19:55.558 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:19:55.558 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:19:55.558 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:19:55.558 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:19:55.558 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:19:55.558 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4, 2024-09-19T09:19:55.558 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 16, 2024-09-19T09:19:55.558 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_priority": 5 2024-09-19T09:19:55.558 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.558 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:19:55.558 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:19:55.559 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": "cephfs" 2024-09-19T09:19:55.559 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.559 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.559 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:19:55.559 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:19:55.559 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 2.25, 2024-09-19T09:19:55.559 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 2.25, 2024-09-19T09:19:55.559 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:19:55.559 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2.25, 2024-09-19T09:19:55.559 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2.25, 2024-09-19T09:19:55.559 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:19:55.559 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:19:55.559 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:19:55.559 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.560 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.560 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.560 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 17, 2024-09-19T09:19:55.560 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_data", 2024-09-19T09:19:55.560 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:19:38.727884+0000", 2024-09-19T09:19:55.560 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:19:55.560 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:19:55.560 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:19:55.560 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:19:55.560 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:19:55.560 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:19:55.560 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:19:55.560 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:19:55.561 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:19:55.561 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:19:55.561 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:19:55.561 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:19:55.561 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:19:55.561 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 64, 2024-09-19T09:19:55.561 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 64, 2024-09-19T09:19:55.561 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 64, 2024-09-19T09:19:55.561 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 64, 2024-09-19T09:19:55.561 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 64, 2024-09-19T09:19:55.561 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:19:55.561 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:19:55.562 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:19:55.562 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:19:55.562 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:19:55.562 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:19:55.562 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:19:55.562 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.562 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "139", 2024-09-19T09:19:55.562 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:19:55.562 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:19:55.562 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:19:55.562 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:19:55.562 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:19:55.562 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:19:55.563 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:19:55.563 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:19:55.563 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:19:55.563 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 33554432, 2024-09-19T09:19:55.563 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:19:55.563 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:19:55.563 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:19:55.563 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:19:55.563 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:19:55.563 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:19:55.563 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:19:55.563 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:19:55.563 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:19:55.563 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:19:55.564 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:19:55.564 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:19:55.564 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:19:55.564 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:19:55.564 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:19:55.564 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:19:55.564 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.564 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:19:55.564 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:19:55.564 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:19:55.564 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:19:55.564 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:19:55.564 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:19:55.565 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:19:55.565 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:19:55.565 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:19:55.565 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:19:55.565 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:19:55.565 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:19:55.565 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 64, 2024-09-19T09:19:55.565 INFO:teuthology.orchestra.run.smithi018.stdout: "target_size_ratio": 0.89999997615814209 2024-09-19T09:19:55.565 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.565 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:19:55.565 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:19:55.566 INFO:teuthology.orchestra.run.smithi018.stdout: "data": "cephfs" 2024-09-19T09:19:55.566 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.566 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:19:55.566 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:19:55.566 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.3799999952316284, 2024-09-19T09:19:55.566 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.3799999952316284, 2024-09-19T09:19:55.566 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:19:55.566 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-19T09:19:55.566 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-19T09:19:55.566 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:19:55.566 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:19:55.566 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:19:55.567 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.567 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.567 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:19:55.567 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-19T09:19:55.567 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.567 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:19:55.567 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:19:55.567 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:19:55.567 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:19:55.567 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:19:55.567 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:19:55.567 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:19:55.567 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:19:55.567 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:19:55.568 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:19:55.568 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:19:55.568 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:19:55.568 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:19:55.568 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.568 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.568 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-19T09:19:55.568 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:19:55.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.568 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.568 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.568 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-19T09:19:55.568 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:19:55.569 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.569 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.569 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:19:55.569 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.569 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.569 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-19T09:19:55.569 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:19:55.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.569 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.569 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.569 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-19T09:19:55.569 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:19:55.570 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.570 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.570 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:19:55.570 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.570 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.570 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-19T09:19:55.570 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:19:55.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.570 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.570 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-19T09:19:55.570 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:19:55.571 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.571 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.571 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:19:55.571 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.571 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.571 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-19T09:19:55.571 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:19:55.571 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.571 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.571 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.571 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-19T09:19:55.571 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:19:55.572 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.572 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.572 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/128722874", 2024-09-19T09:19:55.572 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/128722874", 2024-09-19T09:19:55.572 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/128722874", 2024-09-19T09:19:55.572 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/128722874", 2024-09-19T09:19:55.572 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:19:55.572 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:19:55.572 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:19:55.572 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.572 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.573 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:19:55.573 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:19:55.573 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:19:55.573 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:19:55.573 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:19:55.573 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:19:55.573 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:19:55.573 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:19:55.573 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:19:55.573 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:19:55.573 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:19:55.573 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:19:55.573 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:19:55.573 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.574 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.574 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-19T09:19:55.574 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:19:55.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.574 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.574 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.574 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-19T09:19:55.574 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:19:55.574 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.574 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.575 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:19:55.575 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.575 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.575 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-19T09:19:55.575 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:19:55.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.575 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.575 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.575 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-19T09:19:55.575 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:19:55.575 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.575 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.576 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:19:55.576 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.576 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.576 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-19T09:19:55.576 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:19:55.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.576 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.576 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.576 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-19T09:19:55.576 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:19:55.576 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.577 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.577 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:19:55.577 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.577 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.577 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-19T09:19:55.577 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:19:55.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.577 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.577 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-19T09:19:55.577 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:19:55.577 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.578 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.578 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/3672199638", 2024-09-19T09:19:55.578 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/3672199638", 2024-09-19T09:19:55.578 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/3672199638", 2024-09-19T09:19:55.578 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/3672199638", 2024-09-19T09:19:55.578 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:19:55.578 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:19:55.578 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:19:55.578 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.578 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.578 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.578 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:19:55.578 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:19:55.579 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:19:55.579 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:19:55.579 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:19:55.579 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:19:55.579 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:19:55.579 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:19:55.579 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:19:55.579 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:19:55.579 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:19:55.579 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:19:55.579 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:19:55.579 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.579 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.579 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.580 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T09:19:55.580 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:19:55.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.580 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.580 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T09:19:55.580 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:19:55.580 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.580 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.580 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.580 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:19:55.580 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.580 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.580 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.581 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-19T09:19:55.581 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:19:55.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.581 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.581 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-19T09:19:55.581 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:19:55.581 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.581 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.581 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:19:55.581 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.581 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.582 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.582 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-19T09:19:55.582 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:19:55.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.582 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.582 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.582 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-19T09:19:55.582 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:19:55.582 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.582 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.583 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:19:55.583 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.583 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.583 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-19T09:19:55.583 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:19:55.583 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.583 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.583 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-19T09:19:55.584 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:19:55.584 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.584 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.584 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3463367841", 2024-09-19T09:19:55.584 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3463367841", 2024-09-19T09:19:55.584 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3463367841", 2024-09-19T09:19:55.584 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3463367841", 2024-09-19T09:19:55.584 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:19:55.584 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:19:55.584 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:19:55.584 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.584 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.585 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:19:55.585 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:19:55.585 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:19:55.585 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:19:55.585 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:19:55.585 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:19:55.585 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:19:55.585 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:19:55.585 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:19:55.585 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:19:55.585 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:19:55.585 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:19:55.585 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:19:55.585 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.586 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.586 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-19T09:19:55.586 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:19:55.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.586 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.586 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-19T09:19:55.586 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:19:55.586 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.586 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.586 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:19:55.587 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.587 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.587 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-19T09:19:55.587 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:19:55.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.587 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.587 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-19T09:19:55.587 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:19:55.587 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.587 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.587 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:19:55.588 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.588 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.588 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-19T09:19:55.588 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:19:55.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.588 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.588 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-19T09:19:55.588 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:19:55.588 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.588 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.588 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:19:55.589 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.589 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.589 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-19T09:19:55.589 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:19:55.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.589 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.589 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-19T09:19:55.589 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:19:55.589 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.589 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.589 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/4163178582", 2024-09-19T09:19:55.590 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/4163178582", 2024-09-19T09:19:55.590 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/4163178582", 2024-09-19T09:19:55.590 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/4163178582", 2024-09-19T09:19:55.590 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:19:55.590 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:19:55.590 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:19:55.590 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.590 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:19:55.590 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:19:55.590 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:19:55.590 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:19:55.590 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:19:55.591 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:19:55.591 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:19:55.591 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:19:55.591 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:19:55.591 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:19:55.591 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:19:55.591 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:19:55.591 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:19:55.591 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.591 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.591 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6822", 2024-09-19T09:19:55.591 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:19:55.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.592 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.592 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6824", 2024-09-19T09:19:55.592 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:19:55.592 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.592 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.592 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:19:55.592 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.592 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.592 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6826", 2024-09-19T09:19:55.592 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:19:55.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.593 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.593 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6827", 2024-09-19T09:19:55.593 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:19:55.593 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.593 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.593 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:19:55.593 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.593 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.593 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6830", 2024-09-19T09:19:55.593 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:19:55.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.594 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.594 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6831", 2024-09-19T09:19:55.594 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:19:55.594 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.594 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.594 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:19:55.594 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.594 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.594 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6828", 2024-09-19T09:19:55.594 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:19:55.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.595 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.595 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6829", 2024-09-19T09:19:55.595 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:19:55.595 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.595 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.595 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.595 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6824/3538482215", 2024-09-19T09:19:55.595 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6827/3538482215", 2024-09-19T09:19:55.595 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6831/3538482215", 2024-09-19T09:19:55.595 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6829/3538482215", 2024-09-19T09:19:55.595 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:19:55.595 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:19:55.595 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:19:55.596 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.596 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:19:55.596 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:19:55.596 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:19:55.596 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:19:55.596 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:19:55.596 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:19:55.596 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:19:55.596 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:19:55.596 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:19:55.596 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:19:55.596 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:19:55.597 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:19:55.597 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:19:55.597 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.597 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.597 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6800", 2024-09-19T09:19:55.597 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:19:55.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.597 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.597 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6801", 2024-09-19T09:19:55.597 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:19:55.597 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.597 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.598 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:19:55.598 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.598 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.598 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6802", 2024-09-19T09:19:55.598 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:19:55.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.598 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.598 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6803", 2024-09-19T09:19:55.598 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:19:55.598 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.598 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.599 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:19:55.599 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.599 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.599 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6806", 2024-09-19T09:19:55.599 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:19:55.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.599 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.599 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6807", 2024-09-19T09:19:55.599 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:19:55.599 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.599 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.600 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:19:55.600 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.600 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.600 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6804", 2024-09-19T09:19:55.600 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:19:55.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.600 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.600 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6805", 2024-09-19T09:19:55.600 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:19:55.600 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.600 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.601 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6801/2408698413", 2024-09-19T09:19:55.601 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6803/2408698413", 2024-09-19T09:19:55.601 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6807/2408698413", 2024-09-19T09:19:55.601 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6805/2408698413", 2024-09-19T09:19:55.601 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:19:55.601 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:19:55.601 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:19:55.601 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.601 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:19:55.601 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:19:55.601 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:19:55.601 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:19:55.602 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:19:55.602 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:19:55.602 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:19:55.602 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:19:55.602 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:19:55.602 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:19:55.602 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:19:55.602 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:19:55.602 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:19:55.602 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.602 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.602 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6808", 2024-09-19T09:19:55.603 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:19:55.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.603 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.603 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6809", 2024-09-19T09:19:55.603 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:19:55.603 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.603 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.603 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:19:55.603 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.603 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.603 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6810", 2024-09-19T09:19:55.603 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:19:55.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.604 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.604 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6811", 2024-09-19T09:19:55.604 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:19:55.604 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.604 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.604 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:19:55.604 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.604 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.604 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6814", 2024-09-19T09:19:55.604 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:19:55.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.605 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.605 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6815", 2024-09-19T09:19:55.605 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:19:55.605 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.605 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.605 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:19:55.605 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.605 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.605 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6812", 2024-09-19T09:19:55.605 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:19:55.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.606 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.606 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.606 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6813", 2024-09-19T09:19:55.606 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:19:55.606 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.606 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.606 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.606 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6809/2596207948", 2024-09-19T09:19:55.606 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6811/2596207948", 2024-09-19T09:19:55.606 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6815/2596207948", 2024-09-19T09:19:55.606 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6813/2596207948", 2024-09-19T09:19:55.606 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:19:55.606 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:19:55.607 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:19:55.607 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.607 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.607 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.607 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:19:55.607 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:19:55.607 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:19:55.607 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:19:55.607 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:19:55.607 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:19:55.607 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:19:55.607 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:19:55.607 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:19:55.607 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:19:55.607 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:19:55.608 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:19:55.608 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:19:55.608 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.608 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.608 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6816", 2024-09-19T09:19:55.608 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:19:55.608 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.608 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.608 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.608 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6817", 2024-09-19T09:19:55.608 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:19:55.608 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.608 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.609 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:19:55.609 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.609 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.609 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6818", 2024-09-19T09:19:55.609 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:19:55.609 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.609 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.609 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6819", 2024-09-19T09:19:55.609 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:19:55.609 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.609 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.610 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:19:55.610 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.610 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.610 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6823", 2024-09-19T09:19:55.610 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:19:55.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.610 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.610 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6825", 2024-09-19T09:19:55.610 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:19:55.610 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.610 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.611 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:19:55.611 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:19:55.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.611 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:19:55.611 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6820", 2024-09-19T09:19:55.611 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:19:55.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.611 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:19:55.611 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6821", 2024-09-19T09:19:55.611 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:19:55.611 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.611 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.612 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6817/1334618296", 2024-09-19T09:19:55.612 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6819/1334618296", 2024-09-19T09:19:55.612 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6825/1334618296", 2024-09-19T09:19:55.612 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6821/1334618296", 2024-09-19T09:19:55.612 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:19:55.612 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:19:55.612 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:19:55.612 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:19:55.612 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.613 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:19:55.613 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-19T09:19:55.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.613 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:19:55.613 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:19:55.613 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:19:55.613 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:19:55.613 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:19:55.613 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:19:55.613 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.580838+0000", 2024-09-19T09:19:55.613 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:19:55.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.613 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:19:55.614 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:19:55.614 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:19:55.614 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:19:55.614 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:19:55.614 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:19:55.614 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.599990+0000", 2024-09-19T09:19:55.614 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:19:55.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.614 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:19:55.614 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:19:55.614 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:19:55.614 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:19:55.614 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:19:55.615 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:19:55.615 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.503722+0000", 2024-09-19T09:19:55.615 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:19:55.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.615 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:19:55.616 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:19:55.616 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:19:55.616 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:19:55.616 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:19:55.616 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:19:55.616 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.607846+0000", 2024-09-19T09:19:55.616 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:19:55.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.616 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:19:55.616 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:19:55.616 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:19:55.616 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:19:55.616 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:19:55.617 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:19:55.617 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.616858+0000", 2024-09-19T09:19:55.617 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:19:55.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.617 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:19:55.617 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:19:55.617 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:19:55.617 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:19:55.617 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:19:55.617 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:19:55.617 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.542726+0000", 2024-09-19T09:19:55.617 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:19:55.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.618 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:19:55.618 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:19:55.618 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:19:55.618 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:19:55.618 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:19:55.618 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:19:55.618 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.534178+0000", 2024-09-19T09:19:55.618 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:19:55.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:19:55.618 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:19:55.618 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:19:55.618 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:19:55.619 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:19:55.619 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:19:55.619 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:19:55.619 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.612105+0000", 2024-09-19T09:19:55.619 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:19:55.619 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.619 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:19:55.619 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-19T09:19:55.619 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-19T09:19:55.619 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-19T09:19:55.619 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-19T09:19:55.619 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-19T09:19:55.619 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-19T09:19:55.619 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-19T09:19:55.620 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-19T09:19:55.620 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-19T09:19:55.620 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-19T09:19:55.620 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-19T09:19:55.620 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-19T09:19:55.620 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-19T09:19:55.620 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-19T09:19:55.620 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:19:55.620 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-19T09:19:55.620 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-19T09:19:55.620 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-19T09:19:55.620 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-19T09:19:55.620 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-19T09:19:55.621 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-19T09:19:55.621 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-19T09:19:55.621 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-19T09:19:55.621 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-19T09:19:55.621 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-19T09:19:55.621 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-19T09:19:55.621 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:19:55.621 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:19:55.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.545+0000 7f3afe928640 1 -- 172.21.15.18:0/2107561537 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3ae406c2b0 msgr2=0x7f3ae406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:55.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.545+0000 7f3afe928640 1 --2- 172.21.15.18:0/2107561537 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3ae406c2b0 0x7f3ae406e770 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3ae8005880 tx=0x7f3ae8009040 comp rx=0 tx=0).stop 2024-09-19T09:19:55.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.545+0000 7f3afe928640 1 -- 172.21.15.18:0/2107561537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3af8160a80 msgr2=0x7f3af813f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:19:55.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.545+0000 7f3afe928640 1 --2- 172.21.15.18:0/2107561537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3af8160a80 0x7f3af813f130 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f3af0009eb0 tx=0x7f3af0004a40 comp rx=0 tx=0).stop 2024-09-19T09:19:55.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.545+0000 7f3afe928640 1 -- 172.21.15.18:0/2107561537 shutdown_connections 2024-09-19T09:19:55.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.545+0000 7f3afe928640 1 --2- 172.21.15.18:0/2107561537 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3ae406c2b0 0x7f3ae406e770 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.545+0000 7f3afe928640 1 --2- 172.21.15.18:0/2107561537 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3af8160a80 0x7f3af813f130 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.545+0000 7f3afe928640 1 --2- 172.21.15.18:0/2107561537 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3af8142150 0x7f3af8145990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.545+0000 7f3afe928640 1 --2- 172.21.15.18:0/2107561537 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3af813fae0 0x7f3af815bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:19:55.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.545+0000 7f3afe928640 1 -- 172.21.15.18:0/2107561537 >> 172.21.15.18:0/2107561537 conn(0x7f3af806bc10 msgr2=0x7f3af80cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:19:55.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.545+0000 7f3afe928640 1 -- 172.21.15.18:0/2107561537 shutdown_connections 2024-09-19T09:19:55.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:19:55.545+0000 7f3afe928640 1 -- 172.21.15.18:0/2107561537 wait complete. 2024-09-19T09:19:55.624 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-19T09:20:00.625 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-19T09:20:00.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.742+0000 7f5f65923640 1 Processor -- start 2024-09-19T09:20:00.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.742+0000 7f5f65923640 1 -- start start 2024-09-19T09:20:00.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.743+0000 7f5f65923640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5f60160c50 0x7f5f60167680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:00.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.743+0000 7f5f65923640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f60142650 con 0x7f5f60142150 2024-09-19T09:20:00.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.743+0000 7f5f65923640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f60142930 con 0x7f5f6013fae0 2024-09-19T09:20:00.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.743+0000 7f5f65923640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f5f600ce780 con 0x7f5f60160c50 2024-09-19T09:20:00.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.743+0000 7f5f5e7fc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f5f60142150 0x7f5f60160540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:58400/0 (socket says 172.21.15.18:58400) 2024-09-19T09:20:00.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.743+0000 7f5f5e7fc640 1 -- 172.21.15.18:0/3011354531 learned_addr learned my addr 172.21.15.18:0/3011354531 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:20:00.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.744+0000 7f5f5f7fe640 1 --2- 172.21.15.18:0/3011354531 >> v2:172.21.15.162:3300/0 conn(0x7f5f60160c50 0x7f5f60167680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:00.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.744+0000 7f5f5dffb640 1 -- 172.21.15.18:0/3011354531 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1688409079 0 0) 0x7f5f60142650 con 0x7f5f60142150 2024-09-19T09:20:00.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.744+0000 7f5f5dffb640 1 -- 172.21.15.18:0/3011354531 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f4c003520 con 0x7f5f60142150 2024-09-19T09:20:00.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.744+0000 7f5f5dffb640 1 -- 172.21.15.18:0/3011354531 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 813431435 0 0) 0x7f5f4c003520 con 0x7f5f60142150 2024-09-19T09:20:00.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.744+0000 7f5f5dffb640 1 -- 172.21.15.18:0/3011354531 >> v2:172.21.15.162:3300/0 conn(0x7f5f60160c50 msgr2=0x7f5f60167680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:00.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.744+0000 7f5f5dffb640 1 --2- 172.21.15.18:0/3011354531 >> v2:172.21.15.162:3300/0 conn(0x7f5f60160c50 0x7f5f60167680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.744+0000 7f5f5dffb640 1 -- 172.21.15.18:0/3011354531 >> v1:172.21.15.162:6789/0 conn(0x7f5f6013fae0 legacy=0x7f5f6006f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:00.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.744+0000 7f5f5dffb640 1 -- 172.21.15.18:0/3011354531 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f60142c10 con 0x7f5f60142150 2024-09-19T09:20:00.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.744+0000 7f5f5dffb640 1 -- 172.21.15.18:0/3011354531 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f5f48001670 con 0x7f5f60142150 2024-09-19T09:20:00.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.744+0000 7f5f5dffb640 1 -- 172.21.15.18:0/3011354531 >> v1:172.21.15.18:6789/0 conn(0x7f5f60142150 legacy=0x7f5f60160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:00.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.744+0000 7f5f5dffb640 1 --2- 172.21.15.18:0/3011354531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f4c0039b0 0x7f5f4c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:00.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.744+0000 7f5f5dffb640 1 --2- 172.21.15.18:0/3011354531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f4c0043b0 0x7f5f4c004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:00.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.744+0000 7f5f5dffb640 1 --2- 172.21.15.18:0/3011354531 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f4c005120 0x7f5f4c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:00.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.744+0000 7f5f5dffb640 1 -- 172.21.15.18:0/3011354531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4c00c030 con 0x7f5f4c0039b0 2024-09-19T09:20:00.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.744+0000 7f5f5dffb640 1 -- 172.21.15.18:0/3011354531 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4c00c1e0 con 0x7f5f4c0043b0 2024-09-19T09:20:00.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.744+0000 7f5f5dffb640 1 -- 172.21.15.18:0/3011354531 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5f4c00c3e0 con 0x7f5f4c005120 2024-09-19T09:20:00.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.744+0000 7f5f5effd640 1 --2- 172.21.15.18:0/3011354531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f4c0039b0 0x7f5f4c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:00.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.744+0000 7f5f5e7fc640 1 --2- 172.21.15.18:0/3011354531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f4c0043b0 0x7f5f4c004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:00.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.744+0000 7f5f5f7fe640 1 --2- 172.21.15.18:0/3011354531 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f4c005120 0x7f5f4c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:00.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.745+0000 7f5f5effd640 1 -- 172.21.15.18:0/3011354531 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f4c005120 msgr2=0x7f5f4c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:00.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.745+0000 7f5f5effd640 1 --2- 172.21.15.18:0/3011354531 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f4c005120 0x7f5f4c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.745+0000 7f5f5effd640 1 -- 172.21.15.18:0/3011354531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f4c0043b0 msgr2=0x7f5f4c004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:00.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.745+0000 7f5f5effd640 1 --2- 172.21.15.18:0/3011354531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f4c0043b0 0x7f5f4c004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.745+0000 7f5f5effd640 1 -- 172.21.15.18:0/3011354531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f4c003520 con 0x7f5f4c0039b0 2024-09-19T09:20:00.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.745+0000 7f5f5f7fe640 1 --2- 172.21.15.18:0/3011354531 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f4c005120 0x7f5f4c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:00.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.745+0000 7f5f5f7fe640 1 -- 172.21.15.18:0/3011354531 reap_dead start 2024-09-19T09:20:00.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.745+0000 7f5f5effd640 1 --2- 172.21.15.18:0/3011354531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f4c0039b0 0x7f5f4c003d90 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f5f58001910 tx=0x7f5f4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0f9134d5ce3a3bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:00.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.746+0000 7f5f5dffb640 1 -- 172.21.15.18:0/3011354531 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f58037070 con 0x7f5f4c0039b0 2024-09-19T09:20:00.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.746+0000 7f5f5dffb640 1 -- 172.21.15.18:0/3011354531 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f5802ac40 con 0x7f5f4c0039b0 2024-09-19T09:20:00.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.746+0000 7f5f5dffb640 1 -- 172.21.15.18:0/3011354531 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f580014e0 con 0x7f5f4c0039b0 2024-09-19T09:20:00.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.746+0000 7f5f65923640 1 -- 172.21.15.18:0/3011354531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f4c0039b0 msgr2=0x7f5f4c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:00.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.746+0000 7f5f65923640 1 --2- 172.21.15.18:0/3011354531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f4c0039b0 0x7f5f4c003d90 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f5f58001910 tx=0x7f5f4c005830 comp rx=0 tx=0).stop 2024-09-19T09:20:00.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.746+0000 7f5f65923640 1 -- 172.21.15.18:0/3011354531 shutdown_connections 2024-09-19T09:20:00.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.746+0000 7f5f65923640 1 --2- 172.21.15.18:0/3011354531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f4c0039b0 0x7f5f4c003d90 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.746+0000 7f5f65923640 1 -- 172.21.15.18:0/3011354531 >> 172.21.15.18:0/3011354531 conn(0x7f5f6006bc10 msgr2=0x7f5f6006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:00.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.746+0000 7f5f65923640 1 -- 172.21.15.18:0/3011354531 shutdown_connections 2024-09-19T09:20:00.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.746+0000 7f5f65923640 1 -- 172.21.15.18:0/3011354531 wait complete. 2024-09-19T09:20:00.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.747+0000 7f5f65923640 1 Processor -- start 2024-09-19T09:20:00.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.748+0000 7f5f65923640 1 -- start start 2024-09-19T09:20:00.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.748+0000 7f5f65923640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f4c0039b0 0x7f5f601f2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:00.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.748+0000 7f5f65923640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f601f5090 0x7f5f601f3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:00.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.748+0000 7f5f65923640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f601f3a90 0x7f5f601413c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:00.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.748+0000 7f5f65923640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5f601606c0 con 0x7f5f601f5090 2024-09-19T09:20:00.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.748+0000 7f5f65923640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5f60160540 con 0x7f5f4c0039b0 2024-09-19T09:20:00.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.748+0000 7f5f65923640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5f60160840 con 0x7f5f601f3a90 2024-09-19T09:20:00.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.748+0000 7f5f5e7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f601f5090 0x7f5f601f3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:00.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.748+0000 7f5f5e7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f601f5090 0x7f5f601f3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35086/0 (socket says 172.21.15.18:35086) 2024-09-19T09:20:00.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.749+0000 7f5f5e7fc640 1 -- 172.21.15.18:0/2375323601 learned_addr learned my addr 172.21.15.18:0/2375323601 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:00.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.749+0000 7f5f5f7fe640 1 --2- 172.21.15.18:0/2375323601 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f601f3a90 0x7f5f601413c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:00.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.749+0000 7f5f5effd640 1 --2- 172.21.15.18:0/2375323601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f4c0039b0 0x7f5f601f2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:00.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.749+0000 7f5f5e7fc640 1 -- 172.21.15.18:0/2375323601 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f601f3a90 msgr2=0x7f5f601413c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:00.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.749+0000 7f5f5e7fc640 1 --2- 172.21.15.18:0/2375323601 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f601f3a90 0x7f5f601413c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.749+0000 7f5f5e7fc640 1 -- 172.21.15.18:0/2375323601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f4c0039b0 msgr2=0x7f5f601f2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:00.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.749+0000 7f5f5e7fc640 1 --2- 172.21.15.18:0/2375323601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f4c0039b0 0x7f5f601f2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:00.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.749+0000 7f5f5e7fc640 1 -- 172.21.15.18:0/2375323601 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f601f3ff0 con 0x7f5f601f5090 2024-09-19T09:20:00.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.749+0000 7f5f5e7fc640 1 --2- 172.21.15.18:0/2375323601 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f601f5090 0x7f5f601f3550 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f5f48007fd0 tx=0x7f5f48007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:00.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.749+0000 7f5f57fff640 1 -- 172.21.15.18:0/2375323601 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4800f7b0 con 0x7f5f601f5090 2024-09-19T09:20:00.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.749+0000 7f5f57fff640 1 -- 172.21.15.18:0/2375323601 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f48018070 con 0x7f5f601f5090 2024-09-19T09:20:00.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.749+0000 7f5f65923640 1 -- 172.21.15.18:0/2375323601 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f601f42d0 con 0x7f5f601f5090 2024-09-19T09:20:00.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.749+0000 7f5f57fff640 1 -- 172.21.15.18:0/2375323601 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4800fbb0 con 0x7f5f601f5090 2024-09-19T09:20:00.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.749+0000 7f5f65923640 1 -- 172.21.15.18:0/2375323601 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f601f4890 con 0x7f5f601f5090 2024-09-19T09:20:00.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.750+0000 7f5f65923640 1 -- 172.21.15.18:0/2375323601 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f6006f1b0 con 0x7f5f601f5090 2024-09-19T09:20:00.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.751+0000 7f5f57fff640 1 -- 172.21.15.18:0/2375323601 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5f4800fd50 con 0x7f5f601f5090 2024-09-19T09:20:00.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.751+0000 7f5f57fff640 1 --2- 172.21.15.18:0/2375323601 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5f4006c2b0 0x7f5f4006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:00.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.752+0000 7f5f57fff640 1 -- 172.21.15.18:0/2375323601 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5709+0+0 (secure 0 0 0) 0x7f5f4808b150 con 0x7f5f601f5090 2024-09-19T09:20:00.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.752+0000 7f5f5effd640 1 --2- 172.21.15.18:0/2375323601 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5f4006c2b0 0x7f5f4006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:00.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.752+0000 7f5f57fff640 1 -- 172.21.15.18:0/2375323601 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=141}) -- 0x7f5f40073de0 con 0x7f5f601f5090 2024-09-19T09:20:00.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.752+0000 7f5f5effd640 1 --2- 172.21.15.18:0/2375323601 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5f4006c2b0 0x7f5f4006e770 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5f58034000 tx=0x7f5f5802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:00.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.756+0000 7f5f57fff640 1 -- 172.21.15.18:0/2375323601 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5f48059300 con 0x7f5f601f5090 2024-09-19T09:20:00.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.933+0000 7f5f65923640 1 -- 172.21.15.18:0/2375323601 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f5f6015f330 con 0x7f5f601f5090 2024-09-19T09:20:00.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.934+0000 7f5f57fff640 1 -- 172.21.15.18:0/2375323601 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v140) ==== 81+0+34313 (secure 0 0 0) 0x7f5f4805d600 con 0x7f5f601f5090 2024-09-19T09:20:00.936 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:20:00.936 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:20:00.936 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 140, 2024-09-19T09:20:00.936 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:20:00.936 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-19T09:13:11.348786+0000", 2024-09-19T09:20:00.936 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-19T09:19:56.224151+0000", 2024-09-19T09:20:00.936 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-19T09:13:16.423937+0000", 2024-09-19T09:20:00.936 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-19T09:13:13.417141+0000", 2024-09-19T09:20:00.936 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-19T09:20:00.936 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-09-19T09:20:00.936 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-19T09:20:00.937 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-19T09:20:00.937 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-19T09:20:00.937 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-19T09:20:00.937 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-19T09:20:00.937 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:20:00.937 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-19T09:20:00.937 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.69999998807907104, 2024-09-19T09:20:00.937 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-19T09:20:00.937 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-19T09:20:00.937 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-19T09:20:00.937 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 17, 2024-09-19T09:20:00.937 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-19T09:20:00.937 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-19T09:20:00.937 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "jewel", 2024-09-19T09:20:00.938 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-19T09:20:00.938 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-19T09:20:00.938 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-19T09:20:00.938 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.938 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-19T09:20:00.938 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-19T09:20:00.938 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:13:17.564717+0000", 2024-09-19T09:20:00.938 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:20:00.938 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:20:00.938 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:20:00.938 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:20:00.938 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:20:00.938 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:20:00.938 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:20:00.939 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:20:00.939 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:20:00.939 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:20:00.939 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:20:00.939 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:20:00.939 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:20:00.939 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-19T09:20:00.939 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-19T09:20:00.939 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-19T09:20:00.939 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-19T09:20:00.939 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-19T09:20:00.939 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:20:00.939 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:20:00.939 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:20:00.939 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:20:00.940 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:20:00.940 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:20:00.940 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:20:00.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.940 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "111", 2024-09-19T09:20:00.940 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:20:00.940 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:20:00.940 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:20:00.940 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:20:00.940 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:20:00.940 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:20:00.940 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:20:00.940 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:20:00.940 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:20:00.941 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:20:00.941 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:20:00.941 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:20:00.941 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:20:00.941 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:20:00.941 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:20:00.941 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:20:00.941 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:20:00.941 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:20:00.941 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:20:00.941 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:20:00.941 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:20:00.941 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:20:00.941 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:20:00.942 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:20:00.942 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:20:00.942 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:20:00.942 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.942 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:20:00.942 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:20:00.942 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:20:00.942 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:20:00.942 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:20:00.942 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:20:00.942 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:20:00.943 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:20:00.943 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:20:00.943 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:20:00.943 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:20:00.943 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:20:00.943 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-19T09:20:00.943 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-19T09:20:00.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.943 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:20:00.943 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-19T09:20:00.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.943 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:20:00.943 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:20:00.943 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-19T09:20:00.944 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-19T09:20:00.944 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-19T09:20:00.944 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-19T09:20:00.944 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-19T09:20:00.944 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:20:00.944 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:20:00.944 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:20:00.944 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.944 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.944 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.944 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 16, 2024-09-19T09:20:00.944 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_metadata", 2024-09-19T09:20:00.944 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:19:38.333262+0000", 2024-09-19T09:20:00.944 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:20:00.945 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:20:00.945 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:20:00.945 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:20:00.945 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:20:00.945 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:20:00.945 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:20:00.945 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:20:00.945 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:20:00.945 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:20:00.945 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:20:00.945 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:20:00.945 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:20:00.945 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-19T09:20:00.945 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-19T09:20:00.946 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-19T09:20:00.946 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-19T09:20:00.946 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-19T09:20:00.946 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:20:00.946 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:20:00.946 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:20:00.946 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:20:00.946 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:20:00.946 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:20:00.946 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:20:00.947 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.947 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "137", 2024-09-19T09:20:00.947 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:20:00.947 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:20:00.947 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:20:00.947 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:20:00.947 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:20:00.947 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:20:00.947 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:20:00.947 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:20:00.947 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:20:00.947 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:20:00.948 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:20:00.948 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:20:00.948 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:20:00.948 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:20:00.948 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:20:00.948 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:20:00.948 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:20:00.948 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:20:00.948 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:20:00.948 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:20:00.948 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:20:00.948 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:20:00.948 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:20:00.949 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:20:00.949 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:20:00.949 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:20:00.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.949 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:20:00.949 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:20:00.949 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:20:00.949 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:20:00.949 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:20:00.949 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:20:00.949 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:20:00.949 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:20:00.949 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:20:00.949 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:20:00.949 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:20:00.950 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:20:00.950 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4, 2024-09-19T09:20:00.950 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 16, 2024-09-19T09:20:00.950 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_priority": 5 2024-09-19T09:20:00.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.950 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:20:00.950 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:20:00.950 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": "cephfs" 2024-09-19T09:20:00.950 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.950 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:20:00.950 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:20:00.950 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 2.25, 2024-09-19T09:20:00.950 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 2.25, 2024-09-19T09:20:00.951 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:20:00.951 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2.25, 2024-09-19T09:20:00.951 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2.25, 2024-09-19T09:20:00.951 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:20:00.951 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:20:00.951 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:20:00.951 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.951 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 17, 2024-09-19T09:20:00.951 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_data", 2024-09-19T09:20:00.951 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:19:38.727884+0000", 2024-09-19T09:20:00.951 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1027, 2024-09-19T09:20:00.951 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-19T09:20:00.952 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:20:00.952 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:20:00.952 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:20:00.952 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:20:00.952 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:20:00.952 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:20:00.952 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:20:00.952 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:20:00.952 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:20:00.952 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:20:00.952 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:20:00.952 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 64, 2024-09-19T09:20:00.952 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 64, 2024-09-19T09:20:00.953 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 64, 2024-09-19T09:20:00.953 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 64, 2024-09-19T09:20:00.953 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 64, 2024-09-19T09:20:00.953 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:20:00.953 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:20:00.953 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:20:00.953 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:20:00.953 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:20:00.953 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:20:00.953 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:20:00.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.953 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "140", 2024-09-19T09:20:00.953 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:20:00.953 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:20:00.954 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:20:00.954 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:20:00.954 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:20:00.954 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:20:00.954 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:20:00.954 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:20:00.954 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:20:00.954 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 33554432, 2024-09-19T09:20:00.954 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:20:00.954 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:20:00.954 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:20:00.954 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:20:00.954 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:20:00.954 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:20:00.955 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:20:00.955 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:20:00.955 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:20:00.955 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:20:00.955 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:20:00.955 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:20:00.955 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:20:00.955 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:20:00.955 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:20:00.955 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:20:00.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.955 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:20:00.955 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:20:00.955 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:20:00.956 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:20:00.956 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:20:00.956 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:20:00.956 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:20:00.956 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:20:00.956 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:20:00.956 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:20:00.956 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:20:00.956 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:20:00.956 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 64, 2024-09-19T09:20:00.956 INFO:teuthology.orchestra.run.smithi018.stdout: "target_size_ratio": 0.89999997615814209 2024-09-19T09:20:00.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.956 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:20:00.956 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:20:00.957 INFO:teuthology.orchestra.run.smithi018.stdout: "data": "cephfs" 2024-09-19T09:20:00.957 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.957 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:20:00.957 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:20:00.957 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.3799999952316284, 2024-09-19T09:20:00.957 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.3799999952316284, 2024-09-19T09:20:00.957 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:20:00.957 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-19T09:20:00.957 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-19T09:20:00.957 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:20:00.957 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:20:00.957 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:20:00.957 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.958 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.958 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:20:00.958 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-19T09:20:00.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.958 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:20:00.958 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:00.958 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:00.958 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:00.958 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:00.958 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:00.958 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:00.958 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:00.958 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:00.958 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:00.958 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:00.959 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:00.959 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:00.959 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:00.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.959 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:00.959 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-19T09:20:00.959 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:00.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.959 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:00.959 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-19T09:20:00.960 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:00.960 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.960 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.960 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:00.960 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:00.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.960 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:00.960 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-19T09:20:00.960 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:00.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.960 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.960 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:00.960 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-19T09:20:00.961 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:00.961 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.961 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.961 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.961 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:00.961 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:00.961 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.961 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:00.961 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-19T09:20:00.961 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:00.961 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.961 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.961 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:00.961 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-19T09:20:00.962 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:00.962 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.962 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.962 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:00.962 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:00.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.962 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:00.962 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-19T09:20:00.962 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:00.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.962 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:00.962 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-19T09:20:00.963 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:00.963 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.963 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.963 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/128722874", 2024-09-19T09:20:00.963 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/128722874", 2024-09-19T09:20:00.963 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/128722874", 2024-09-19T09:20:00.963 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/128722874", 2024-09-19T09:20:00.963 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:00.963 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:00.963 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:00.963 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.963 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:20:00.964 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:00.964 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:00.964 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:00.964 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:00.964 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:00.964 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:00.964 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:00.964 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:00.964 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:00.964 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:00.964 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:00.964 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:00.964 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:00.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.965 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:00.965 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-19T09:20:00.965 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:00.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.965 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:00.965 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-19T09:20:00.965 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:00.965 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.965 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.965 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:00.965 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:00.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.966 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:00.966 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-19T09:20:00.966 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:00.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.966 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:00.966 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-19T09:20:00.966 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:00.966 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.966 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.966 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:00.967 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:00.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.967 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:00.967 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-19T09:20:00.967 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:00.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.967 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:00.967 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-19T09:20:00.967 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:00.967 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.968 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.968 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:00.968 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:00.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.968 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:00.968 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-19T09:20:00.968 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:00.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.968 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:00.968 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-19T09:20:00.968 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:00.969 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.969 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.969 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/3672199638", 2024-09-19T09:20:00.969 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/3672199638", 2024-09-19T09:20:00.969 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/3672199638", 2024-09-19T09:20:00.969 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/3672199638", 2024-09-19T09:20:00.969 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:00.969 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:00.969 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:00.969 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.969 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:20:00.970 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:00.970 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:00.970 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:00.970 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:00.970 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:00.970 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:00.970 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:00.970 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:00.970 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:00.970 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:00.970 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:00.970 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:00.970 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:00.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.971 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:00.971 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T09:20:00.971 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:00.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.971 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:00.971 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T09:20:00.971 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:00.971 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.971 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.971 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:00.971 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:00.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.972 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:00.972 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-19T09:20:00.972 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:00.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.972 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:00.972 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-19T09:20:00.972 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:00.972 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.972 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.972 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:00.972 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:00.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.973 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:00.973 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-19T09:20:00.977 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:00.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.977 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:00.977 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-19T09:20:00.977 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:00.977 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.977 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.977 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:00.977 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:00.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.978 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:00.978 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-19T09:20:00.978 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:00.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.978 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:00.978 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-19T09:20:00.978 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:00.978 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.978 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.978 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3463367841", 2024-09-19T09:20:00.978 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3463367841", 2024-09-19T09:20:00.978 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3463367841", 2024-09-19T09:20:00.979 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3463367841", 2024-09-19T09:20:00.979 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:00.979 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:00.979 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:00.979 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.979 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:20:00.979 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:00.979 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:00.979 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:00.979 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:00.979 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:00.979 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:00.979 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:00.980 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:00.980 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:00.980 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:00.980 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:00.980 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:00.980 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:00.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.980 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:00.980 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-19T09:20:00.980 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:00.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.980 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:00.981 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-19T09:20:00.981 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:00.981 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.981 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.981 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:00.981 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:00.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.981 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:00.981 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-19T09:20:00.981 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:00.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.981 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:00.981 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-19T09:20:00.982 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:00.982 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.982 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.982 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:00.982 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:00.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.982 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:00.982 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-19T09:20:00.982 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:00.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.982 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:00.982 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-19T09:20:00.983 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:00.983 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.983 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.983 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:00.983 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:00.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.983 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:00.983 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-19T09:20:00.983 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:00.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.983 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:00.983 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-19T09:20:00.983 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:00.984 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.984 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.984 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/4163178582", 2024-09-19T09:20:00.984 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/4163178582", 2024-09-19T09:20:00.984 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/4163178582", 2024-09-19T09:20:00.984 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/4163178582", 2024-09-19T09:20:00.984 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:00.984 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:00.984 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:00.984 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.984 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:20:00.985 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:00.985 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:00.985 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:00.985 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:00.985 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:00.985 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:00.985 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:00.985 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:00.985 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:00.985 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:00.985 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:00.985 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:00.985 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:00.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.985 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:00.986 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6822", 2024-09-19T09:20:00.986 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:00.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.986 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:00.986 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6824", 2024-09-19T09:20:00.986 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:00.986 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.986 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.986 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:00.986 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:00.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.986 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:00.987 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6826", 2024-09-19T09:20:00.987 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:00.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.987 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:00.987 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6827", 2024-09-19T09:20:00.987 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:00.987 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.987 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.987 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:00.987 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:00.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.987 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:00.988 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6830", 2024-09-19T09:20:00.988 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:00.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.988 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:00.988 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6831", 2024-09-19T09:20:00.988 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:00.988 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.988 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.988 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:00.988 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:00.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.988 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:00.989 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6828", 2024-09-19T09:20:00.989 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:00.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.989 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:00.989 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6829", 2024-09-19T09:20:00.989 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:00.989 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.989 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.989 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6824/3538482215", 2024-09-19T09:20:00.989 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6827/3538482215", 2024-09-19T09:20:00.989 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6831/3538482215", 2024-09-19T09:20:00.989 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6829/3538482215", 2024-09-19T09:20:00.990 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:00.990 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:00.990 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:00.990 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.990 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:20:00.990 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:00.990 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:00.990 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:00.990 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:00.990 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:00.990 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:00.990 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:00.991 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:00.991 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:00.991 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:00.991 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:00.991 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:00.991 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:00.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.991 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:00.991 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6800", 2024-09-19T09:20:00.991 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:00.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.991 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:00.991 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6801", 2024-09-19T09:20:00.992 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:00.992 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.992 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.992 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:00.992 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:00.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.992 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:00.992 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6802", 2024-09-19T09:20:00.992 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:00.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.992 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:00.992 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6803", 2024-09-19T09:20:00.992 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:00.993 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.993 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.993 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:00.993 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:00.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.993 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:00.993 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6806", 2024-09-19T09:20:00.993 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:00.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.993 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:00.993 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6807", 2024-09-19T09:20:00.994 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:00.994 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.994 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.994 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:00.994 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:00.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.994 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:00.994 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6804", 2024-09-19T09:20:00.994 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:00.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.994 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:00.994 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6805", 2024-09-19T09:20:00.994 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:00.995 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.995 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.995 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6801/2408698413", 2024-09-19T09:20:00.995 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6803/2408698413", 2024-09-19T09:20:00.995 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6807/2408698413", 2024-09-19T09:20:00.995 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6805/2408698413", 2024-09-19T09:20:00.995 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:00.995 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:00.995 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:00.995 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.995 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:20:00.996 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:00.996 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:00.996 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:00.996 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:00.996 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:00.996 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:00.996 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:00.996 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:00.996 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:00.996 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:00.996 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:00.996 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:00.996 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:00.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.997 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:00.997 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6808", 2024-09-19T09:20:00.997 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:00.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.997 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:00.997 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6809", 2024-09-19T09:20:00.997 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:00.997 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.997 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.997 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:00.997 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:00.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.998 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:00.998 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6810", 2024-09-19T09:20:00.998 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:00.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.998 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:00.998 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6811", 2024-09-19T09:20:00.998 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:00.998 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.998 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.998 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:00.998 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:00.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.998 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:00.999 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6814", 2024-09-19T09:20:00.999 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:00.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.999 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:00.999 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6815", 2024-09-19T09:20:00.999 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:00.999 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:00.999 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:00.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:00.999 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:00.999 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:00.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:00.999 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:00.999 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6812", 2024-09-19T09:20:01.000 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:01.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.000 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.000 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6813", 2024-09-19T09:20:01.000 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:01.000 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.000 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.000 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6809/2596207948", 2024-09-19T09:20:01.000 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6811/2596207948", 2024-09-19T09:20:01.000 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6815/2596207948", 2024-09-19T09:20:01.000 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6813/2596207948", 2024-09-19T09:20:01.001 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:01.001 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:01.001 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:01.001 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.001 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:20:01.001 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:01.001 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:01.001 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:01.001 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:01.001 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:01.001 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:01.001 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:01.001 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:01.002 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:01.002 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:01.002 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:01.002 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:01.002 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.002 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.002 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6816", 2024-09-19T09:20:01.002 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:01.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.002 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.003 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6817", 2024-09-19T09:20:01.003 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:01.003 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.003 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.003 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.003 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:01.003 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.003 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.003 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6818", 2024-09-19T09:20:01.003 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:01.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.004 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.004 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6819", 2024-09-19T09:20:01.004 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:01.004 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.004 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.004 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:01.004 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.004 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.004 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6823", 2024-09-19T09:20:01.004 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:01.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.005 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.005 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6825", 2024-09-19T09:20:01.005 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:01.005 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.005 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.005 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:01.005 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.005 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.005 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6820", 2024-09-19T09:20:01.005 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:01.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.006 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.006 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6821", 2024-09-19T09:20:01.006 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:01.006 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.006 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.006 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6817/1334618296", 2024-09-19T09:20:01.006 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6819/1334618296", 2024-09-19T09:20:01.006 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6825/1334618296", 2024-09-19T09:20:01.006 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6821/1334618296", 2024-09-19T09:20:01.006 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:01.006 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:01.006 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:01.007 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.007 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.007 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:20:01.007 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-19T09:20:01.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.007 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:20:01.007 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:01.007 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:01.007 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:01.007 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:01.007 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:01.007 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.580838+0000", 2024-09-19T09:20:01.007 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:01.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.008 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:20:01.008 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:01.008 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:01.008 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:01.008 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:01.008 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:01.008 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.599990+0000", 2024-09-19T09:20:01.008 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:01.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.008 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:20:01.008 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:01.008 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:01.009 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:01.009 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:01.009 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:01.009 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.503722+0000", 2024-09-19T09:20:01.009 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:01.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.009 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:20:01.009 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:01.009 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:01.009 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:01.009 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:01.009 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:01.009 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.607846+0000", 2024-09-19T09:20:01.010 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:01.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.010 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:20:01.010 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:01.010 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:01.010 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:01.010 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:01.010 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:01.010 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.616858+0000", 2024-09-19T09:20:01.010 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:01.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.010 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:20:01.010 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:01.011 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:01.011 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:01.011 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:01.011 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:01.011 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.542726+0000", 2024-09-19T09:20:01.011 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:01.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.011 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:20:01.011 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:01.011 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:01.011 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:01.011 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:01.012 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:01.012 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.534178+0000", 2024-09-19T09:20:01.012 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:01.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.012 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:20:01.012 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:01.012 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:01.012 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:01.012 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:01.012 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:01.012 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.612105+0000", 2024-09-19T09:20:01.012 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:01.012 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.013 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:20:01.013 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-19T09:20:01.013 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-19T09:20:01.013 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-19T09:20:01.013 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-19T09:20:01.013 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-19T09:20:01.013 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-19T09:20:01.013 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-19T09:20:01.013 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-19T09:20:01.013 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-19T09:20:01.013 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-19T09:20:01.013 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-19T09:20:01.013 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-19T09:20:01.014 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-19T09:20:01.014 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-19T09:20:01.014 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.014 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.014 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-19T09:20:01.014 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-19T09:20:01.014 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-19T09:20:01.014 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-19T09:20:01.014 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-19T09:20:01.014 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-19T09:20:01.014 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-19T09:20:01.014 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-19T09:20:01.014 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-19T09:20:01.014 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-19T09:20:01.015 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-19T09:20:01.015 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.015 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:20:01.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.936+0000 7f5f65923640 1 -- 172.21.15.18:0/2375323601 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5f4006c2b0 msgr2=0x7f5f4006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:01.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.936+0000 7f5f65923640 1 --2- 172.21.15.18:0/2375323601 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5f4006c2b0 0x7f5f4006e770 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5f58034000 tx=0x7f5f5802e000 comp rx=0 tx=0).stop 2024-09-19T09:20:01.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.936+0000 7f5f65923640 1 -- 172.21.15.18:0/2375323601 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f601f5090 msgr2=0x7f5f601f3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:01.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.936+0000 7f5f65923640 1 --2- 172.21.15.18:0/2375323601 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f601f5090 0x7f5f601f3550 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f5f48007fd0 tx=0x7f5f48007430 comp rx=0 tx=0).stop 2024-09-19T09:20:01.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.936+0000 7f5f65923640 1 -- 172.21.15.18:0/2375323601 shutdown_connections 2024-09-19T09:20:01.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.936+0000 7f5f65923640 1 --2- 172.21.15.18:0/2375323601 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5f4006c2b0 0x7f5f4006e770 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.936+0000 7f5f65923640 1 --2- 172.21.15.18:0/2375323601 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5f601f3a90 0x7f5f601413c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.936+0000 7f5f65923640 1 --2- 172.21.15.18:0/2375323601 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5f601f5090 0x7f5f601f3550 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.936+0000 7f5f65923640 1 --2- 172.21.15.18:0/2375323601 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5f4c0039b0 0x7f5f601f2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.936+0000 7f5f65923640 1 -- 172.21.15.18:0/2375323601 >> 172.21.15.18:0/2375323601 conn(0x7f5f6006bc10 msgr2=0x7f5f600b1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:01.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.936+0000 7f5f65923640 1 -- 172.21.15.18:0/2375323601 shutdown_connections 2024-09-19T09:20:01.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:00.936+0000 7f5f65923640 1 -- 172.21.15.18:0/2375323601 wait complete. 2024-09-19T09:20:01.018 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-09-19T09:20:01.018 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:20:01.018 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:20:01.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:20:01.035 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2024-09-19T09:20:01.213 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:20:01.216 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:20:01.231 INFO:teuthology.orchestra.run.smithi018.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2024-09-19T09:20:01.231 INFO:teuthology.orchestra.run.smithi018.stderr:50+0 records in 2024-09-19T09:20:01.231 INFO:teuthology.orchestra.run.smithi018.stderr:50+0 records out 2024-09-19T09:20:01.231 INFO:teuthology.orchestra.run.smithi018.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.137055 s, 383 MB/s 2024-09-19T09:20:01.236 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:20:01.237 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-19T09:20:01.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.415+0000 7f825956d640 1 Processor -- start 2024-09-19T09:20:01.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.415+0000 7f825956d640 1 -- start start 2024-09-19T09:20:01.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.416+0000 7f825956d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8254142150 0x7f8254160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:01.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.416+0000 7f825956d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8254160a80 0x7f82540cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:01.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.416+0000 7f825956d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8254142650 con 0x7f825413fae0 2024-09-19T09:20:01.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.416+0000 7f825956d640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f82540ce780 con 0x7f8254160a80 2024-09-19T09:20:01.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.416+0000 7f825956d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8254142930 con 0x7f8254142150 2024-09-19T09:20:01.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.416+0000 7f82537fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8254160a80 0x7f82540cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:01.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.416+0000 7f82537fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8254160a80 0x7f82540cec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35092/0 (socket says 172.21.15.18:35092) 2024-09-19T09:20:01.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.416+0000 7f82537fe640 1 -- 172.21.15.18:0/3809035472 learned_addr learned my addr 172.21.15.18:0/3809035472 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:01.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.416+0000 7f824bfff640 1 --2- 172.21.15.18:0/3809035472 >> v2:172.21.15.162:3300/0 conn(0x7f8254142150 0x7f8254160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:01.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.416+0000 7f82537fe640 1 -- 172.21.15.18:0/3809035472 >> v2:172.21.15.162:3300/0 conn(0x7f8254142150 msgr2=0x7f8254160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:01.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.416+0000 7f82537fe640 1 --2- 172.21.15.18:0/3809035472 >> v2:172.21.15.162:3300/0 conn(0x7f8254142150 0x7f8254160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.416+0000 7f82537fe640 1 -- 172.21.15.18:0/3809035472 >> v1:172.21.15.162:6789/0 conn(0x7f825413fae0 legacy=0x7f825406f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:01.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.417+0000 7f82537fe640 1 -- 172.21.15.18:0/3809035472 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8254142c10 con 0x7f8254160a80 2024-09-19T09:20:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.417+0000 7f82537fe640 1 --2- 172.21.15.18:0/3809035472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8254160a80 0x7f82540cec10 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f8254075560 tx=0x7f824c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=341e3f638b2ef605 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:01.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.417+0000 7f82527fc640 1 -- 172.21.15.18:0/3809035472 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c036070 con 0x7f8254160a80 2024-09-19T09:20:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.417+0000 7f82527fc640 1 -- 172.21.15.18:0/3809035472 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f824c031600 con 0x7f8254160a80 2024-09-19T09:20:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.417+0000 7f82527fc640 1 -- 172.21.15.18:0/3809035472 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c0319d0 con 0x7f8254160a80 2024-09-19T09:20:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.418+0000 7f825956d640 1 -- 172.21.15.18:0/3809035472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8254160a80 msgr2=0x7f82540cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.418+0000 7f825956d640 1 --2- 172.21.15.18:0/3809035472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8254160a80 0x7f82540cec10 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f8254075560 tx=0x7f824c02a6a0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.418+0000 7f825956d640 1 -- 172.21.15.18:0/3809035472 shutdown_connections 2024-09-19T09:20:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.418+0000 7f825956d640 1 --2- 172.21.15.18:0/3809035472 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8254160a80 0x7f82540cec10 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.418+0000 7f825956d640 1 --2- 172.21.15.18:0/3809035472 >> v2:172.21.15.162:3300/0 conn(0x7f8254142150 0x7f8254160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.418+0000 7f825956d640 1 -- 172.21.15.18:0/3809035472 >> 172.21.15.18:0/3809035472 conn(0x7f825406bc10 msgr2=0x7f825406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.418+0000 7f825956d640 1 -- 172.21.15.18:0/3809035472 shutdown_connections 2024-09-19T09:20:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.418+0000 7f825956d640 1 -- 172.21.15.18:0/3809035472 wait complete. 2024-09-19T09:20:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.419+0000 7f825956d640 1 Processor -- start 2024-09-19T09:20:01.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.419+0000 7f825956d640 1 -- start start 2024-09-19T09:20:01.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.420+0000 7f825956d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f825413fae0 0x7f82541f35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:01.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.420+0000 7f825956d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8254142150 0x7f82541f5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:01.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.420+0000 7f825956d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8254160a80 0x7f8254144f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:01.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.420+0000 7f825956d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f82540cf2d0 con 0x7f8254160a80 2024-09-19T09:20:01.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.420+0000 7f825956d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f82540cf150 con 0x7f8254142150 2024-09-19T09:20:01.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.420+0000 7f825956d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f82540cf450 con 0x7f825413fae0 2024-09-19T09:20:01.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.420+0000 7f82537fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8254160a80 0x7f8254144f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:01.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.420+0000 7f82537fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8254160a80 0x7f8254144f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35094/0 (socket says 172.21.15.18:35094) 2024-09-19T09:20:01.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.420+0000 7f82537fe640 1 -- 172.21.15.18:0/3734024462 learned_addr learned my addr 172.21.15.18:0/3734024462 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:01.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.420+0000 7f824bfff640 1 --2- 172.21.15.18:0/3734024462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8254142150 0x7f82541f5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:01.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.420+0000 7f8252ffd640 1 --2- 172.21.15.18:0/3734024462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f825413fae0 0x7f82541f35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:01.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.420+0000 7f82537fe640 1 -- 172.21.15.18:0/3734024462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f825413fae0 msgr2=0x7f82541f35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:01.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.420+0000 7f82537fe640 1 --2- 172.21.15.18:0/3734024462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f825413fae0 0x7f82541f35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.420+0000 7f82537fe640 1 -- 172.21.15.18:0/3734024462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8254142150 msgr2=0x7f82541f5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:01.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.420+0000 7f82537fe640 1 --2- 172.21.15.18:0/3734024462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8254142150 0x7f82541f5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.420+0000 7f82537fe640 1 -- 172.21.15.18:0/3734024462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f825413bdb0 con 0x7f8254160a80 2024-09-19T09:20:01.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.420+0000 7f8252ffd640 1 --2- 172.21.15.18:0/3734024462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f825413fae0 0x7f82541f35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:01.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.420+0000 7f82537fe640 1 --2- 172.21.15.18:0/3734024462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8254160a80 0x7f8254144f00 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f824c009f40 tx=0x7f824c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:01.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.421+0000 7f824b7fe640 1 -- 172.21.15.18:0/3734024462 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c036050 con 0x7f8254160a80 2024-09-19T09:20:01.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.421+0000 7f824b7fe640 1 -- 172.21.15.18:0/3734024462 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f824c042070 con 0x7f8254160a80 2024-09-19T09:20:01.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.421+0000 7f825956d640 1 -- 172.21.15.18:0/3734024462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f825413c050 con 0x7f8254160a80 2024-09-19T09:20:01.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.421+0000 7f824b7fe640 1 -- 172.21.15.18:0/3734024462 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f824c009510 con 0x7f8254160a80 2024-09-19T09:20:01.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.421+0000 7f825956d640 1 -- 172.21.15.18:0/3734024462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82541f5790 con 0x7f8254160a80 2024-09-19T09:20:01.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.422+0000 7f825956d640 1 -- 172.21.15.18:0/3734024462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8254160540 con 0x7f8254160a80 2024-09-19T09:20:01.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.422+0000 7f824b7fe640 1 -- 172.21.15.18:0/3734024462 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f824c007bd0 con 0x7f8254160a80 2024-09-19T09:20:01.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.423+0000 7f824b7fe640 1 --2- 172.21.15.18:0/3734024462 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f823406c2b0 0x7f823406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:01.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.423+0000 7f824b7fe640 1 -- 172.21.15.18:0/3734024462 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5709+0+0 (secure 0 0 0) 0x7f824c0ac1c0 con 0x7f8254160a80 2024-09-19T09:20:01.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.423+0000 7f824b7fe640 1 -- 172.21.15.18:0/3734024462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=141}) -- 0x7f8234073de0 con 0x7f8254160a80 2024-09-19T09:20:01.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.423+0000 7f8252ffd640 1 --2- 172.21.15.18:0/3734024462 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f823406c2b0 0x7f823406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:01.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.424+0000 7f8252ffd640 1 --2- 172.21.15.18:0/3734024462 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f823406c2b0 0x7f823406e770 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f825406d700 tx=0x7f8244009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:01.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.427+0000 7f824b7fe640 1 -- 172.21.15.18:0/3734024462 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f824c07a9c0 con 0x7f8254160a80 2024-09-19T09:20:01.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.605+0000 7f825956d640 1 -- 172.21.15.18:0/3734024462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f8254141400 con 0x7f8254160a80 2024-09-19T09:20:01.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.606+0000 7f824b7fe640 1 -- 172.21.15.18:0/3734024462 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v140) ==== 81+0+34313 (secure 0 0 0) 0x7f824c07a2c0 con 0x7f8254160a80 2024-09-19T09:20:01.607 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:20:01.607 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:20:01.607 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 140, 2024-09-19T09:20:01.607 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:20:01.607 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-19T09:13:11.348786+0000", 2024-09-19T09:20:01.607 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-19T09:19:56.224151+0000", 2024-09-19T09:20:01.608 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-19T09:13:16.423937+0000", 2024-09-19T09:20:01.608 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-19T09:13:13.417141+0000", 2024-09-19T09:20:01.608 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-19T09:20:01.608 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-09-19T09:20:01.608 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-19T09:20:01.608 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-19T09:20:01.608 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-19T09:20:01.608 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-19T09:20:01.608 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-19T09:20:01.608 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:20:01.608 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-19T09:20:01.608 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.69999998807907104, 2024-09-19T09:20:01.608 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-19T09:20:01.609 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-19T09:20:01.609 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-19T09:20:01.609 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 17, 2024-09-19T09:20:01.609 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-19T09:20:01.609 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-19T09:20:01.609 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "jewel", 2024-09-19T09:20:01.609 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-19T09:20:01.609 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-19T09:20:01.609 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-19T09:20:01.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.609 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-19T09:20:01.609 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-19T09:20:01.609 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:13:17.564717+0000", 2024-09-19T09:20:01.609 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:20:01.610 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:20:01.610 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:20:01.610 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:20:01.610 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:20:01.610 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:20:01.610 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:20:01.610 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:20:01.610 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:20:01.610 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:20:01.610 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:20:01.610 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:20:01.610 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:20:01.610 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-19T09:20:01.610 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-19T09:20:01.611 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-19T09:20:01.611 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-19T09:20:01.611 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-19T09:20:01.611 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:20:01.611 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:20:01.611 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:20:01.611 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:20:01.611 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:20:01.611 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:20:01.611 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:20:01.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.611 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "111", 2024-09-19T09:20:01.611 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:20:01.611 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:20:01.612 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:20:01.612 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:20:01.612 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:20:01.612 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:20:01.612 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:20:01.612 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:20:01.612 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:20:01.612 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:20:01.612 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:20:01.612 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:20:01.612 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:20:01.612 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:20:01.612 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:20:01.613 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:20:01.613 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:20:01.613 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:20:01.613 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:20:01.613 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:20:01.613 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:20:01.613 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:20:01.613 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:20:01.613 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:20:01.613 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:20:01.613 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:20:01.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.613 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:20:01.613 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:20:01.614 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:20:01.614 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:20:01.614 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:20:01.614 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:20:01.614 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:20:01.614 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:20:01.614 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:20:01.614 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:20:01.614 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:20:01.614 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:20:01.614 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-19T09:20:01.614 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-19T09:20:01.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.614 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:20:01.615 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-19T09:20:01.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.615 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:20:01.615 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:20:01.615 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-19T09:20:01.615 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-19T09:20:01.615 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-19T09:20:01.615 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-19T09:20:01.615 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-19T09:20:01.615 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:20:01.615 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:20:01.615 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:20:01.615 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.616 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 16, 2024-09-19T09:20:01.616 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_metadata", 2024-09-19T09:20:01.616 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:19:38.333262+0000", 2024-09-19T09:20:01.616 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:20:01.616 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:20:01.616 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:20:01.616 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:20:01.616 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:20:01.616 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:20:01.616 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:20:01.616 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:20:01.616 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:20:01.616 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:20:01.617 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:20:01.617 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:20:01.617 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:20:01.617 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-19T09:20:01.617 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-19T09:20:01.617 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-19T09:20:01.617 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-19T09:20:01.617 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-19T09:20:01.617 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:20:01.617 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:20:01.617 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:20:01.617 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:20:01.617 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:20:01.618 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:20:01.618 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:20:01.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.618 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "137", 2024-09-19T09:20:01.618 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:20:01.618 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:20:01.618 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:20:01.618 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:20:01.618 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:20:01.618 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:20:01.618 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:20:01.618 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:20:01.618 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:20:01.619 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:20:01.619 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:20:01.619 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:20:01.619 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:20:01.619 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:20:01.619 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:20:01.619 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:20:01.619 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:20:01.619 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:20:01.619 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:20:01.619 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:20:01.619 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:20:01.619 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:20:01.619 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:20:01.620 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:20:01.620 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:20:01.620 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:20:01.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.620 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:20:01.620 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:20:01.620 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:20:01.620 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:20:01.620 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:20:01.620 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:20:01.620 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:20:01.620 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:20:01.621 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:20:01.621 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:20:01.621 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:20:01.621 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:20:01.621 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4, 2024-09-19T09:20:01.621 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 16, 2024-09-19T09:20:01.621 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_priority": 5 2024-09-19T09:20:01.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.621 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:20:01.621 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:20:01.621 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": "cephfs" 2024-09-19T09:20:01.621 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.621 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:20:01.622 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:20:01.622 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 2.25, 2024-09-19T09:20:01.622 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 2.25, 2024-09-19T09:20:01.622 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:20:01.622 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2.25, 2024-09-19T09:20:01.622 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2.25, 2024-09-19T09:20:01.622 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:20:01.622 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:20:01.622 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:20:01.622 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.622 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 17, 2024-09-19T09:20:01.622 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_data", 2024-09-19T09:20:01.623 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:19:38.727884+0000", 2024-09-19T09:20:01.623 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1027, 2024-09-19T09:20:01.623 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-19T09:20:01.623 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:20:01.623 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:20:01.623 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:20:01.623 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:20:01.623 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:20:01.623 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:20:01.623 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:20:01.623 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:20:01.623 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:20:01.623 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:20:01.623 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:20:01.624 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 64, 2024-09-19T09:20:01.624 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 64, 2024-09-19T09:20:01.624 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 64, 2024-09-19T09:20:01.624 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 64, 2024-09-19T09:20:01.624 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 64, 2024-09-19T09:20:01.624 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:20:01.624 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:20:01.624 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:20:01.624 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:20:01.624 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:20:01.624 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:20:01.624 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:20:01.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.624 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "140", 2024-09-19T09:20:01.625 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:20:01.625 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:20:01.625 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:20:01.625 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:20:01.625 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:20:01.625 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:20:01.625 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:20:01.625 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:20:01.625 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:20:01.625 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 33554432, 2024-09-19T09:20:01.625 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:20:01.625 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:20:01.625 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:20:01.625 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:20:01.626 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:20:01.626 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:20:01.626 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:20:01.626 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:20:01.626 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:20:01.626 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:20:01.626 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:20:01.626 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:20:01.626 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:20:01.626 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:20:01.626 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:20:01.626 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:20:01.626 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.627 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:20:01.627 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:20:01.627 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:20:01.627 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:20:01.627 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:20:01.627 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:20:01.627 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:20:01.627 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:20:01.627 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:20:01.627 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:20:01.627 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:20:01.627 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:20:01.627 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 64, 2024-09-19T09:20:01.627 INFO:teuthology.orchestra.run.smithi018.stdout: "target_size_ratio": 0.89999997615814209 2024-09-19T09:20:01.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.628 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:20:01.628 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:20:01.628 INFO:teuthology.orchestra.run.smithi018.stdout: "data": "cephfs" 2024-09-19T09:20:01.628 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.628 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:20:01.628 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:20:01.628 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.3799999952316284, 2024-09-19T09:20:01.628 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.3799999952316284, 2024-09-19T09:20:01.628 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:20:01.628 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-19T09:20:01.628 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-19T09:20:01.628 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:20:01.629 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:20:01.629 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:20:01.629 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.629 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.629 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:20:01.629 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-19T09:20:01.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.629 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:20:01.629 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:01.629 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:01.629 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:01.629 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:01.629 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:01.629 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:01.630 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:01.630 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:01.630 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:01.630 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:01.630 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:01.630 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:01.630 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.630 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.630 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-19T09:20:01.630 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:01.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.630 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.631 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-19T09:20:01.631 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:01.631 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.631 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.631 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:01.631 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.631 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.631 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-19T09:20:01.631 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:01.631 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.631 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.632 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-19T09:20:01.632 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:01.632 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.632 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.632 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:01.632 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.632 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.632 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-19T09:20:01.632 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:01.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.633 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.633 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-19T09:20:01.633 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:01.633 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.633 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.633 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:01.633 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.633 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.633 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-19T09:20:01.633 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:01.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.634 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.634 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-19T09:20:01.634 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:01.634 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.634 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.634 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/128722874", 2024-09-19T09:20:01.634 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/128722874", 2024-09-19T09:20:01.634 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/128722874", 2024-09-19T09:20:01.634 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/128722874", 2024-09-19T09:20:01.634 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:01.634 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:01.634 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:01.634 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.635 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:20:01.635 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:01.635 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:01.635 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:01.635 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:01.635 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:01.635 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:01.635 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:01.635 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:01.635 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:01.635 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:01.635 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:01.635 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:01.636 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.636 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.636 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-19T09:20:01.636 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:01.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.636 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.636 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-19T09:20:01.636 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:01.637 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.637 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.637 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:01.637 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.637 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.637 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-19T09:20:01.637 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:01.637 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.637 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.637 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.638 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-19T09:20:01.638 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:01.638 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.638 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.638 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:01.638 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.638 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.638 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-19T09:20:01.638 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:01.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.638 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.638 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.639 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-19T09:20:01.639 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:01.639 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.639 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.639 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:01.639 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.639 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.639 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-19T09:20:01.639 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:01.639 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.639 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.639 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.640 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-19T09:20:01.640 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:01.640 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.640 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.640 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/3672199638", 2024-09-19T09:20:01.640 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/3672199638", 2024-09-19T09:20:01.640 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/3672199638", 2024-09-19T09:20:01.640 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/3672199638", 2024-09-19T09:20:01.640 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:01.640 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:01.640 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:01.640 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.640 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.641 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.641 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:20:01.641 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:01.641 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:01.641 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:01.641 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:01.641 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:01.641 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:01.641 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:01.641 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:01.641 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:01.641 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:01.641 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:01.641 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:01.642 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.642 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.642 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T09:20:01.642 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:01.642 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.642 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.642 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.642 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T09:20:01.642 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:01.642 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.642 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.643 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:01.643 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.643 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.643 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-19T09:20:01.643 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:01.643 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.643 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.643 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.643 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-19T09:20:01.643 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:01.643 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.643 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.644 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:01.644 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.644 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.644 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-19T09:20:01.644 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:01.644 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.644 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.644 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.644 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-19T09:20:01.644 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:01.644 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.644 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.645 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:01.645 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.645 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.645 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-19T09:20:01.645 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:01.645 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.645 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.645 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.645 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-19T09:20:01.645 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:01.645 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.645 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.646 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3463367841", 2024-09-19T09:20:01.646 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3463367841", 2024-09-19T09:20:01.646 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3463367841", 2024-09-19T09:20:01.646 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3463367841", 2024-09-19T09:20:01.646 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:01.646 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:01.646 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:01.646 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.646 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.646 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.646 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:20:01.646 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:01.646 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:01.647 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:01.647 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:01.647 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:01.647 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:01.647 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:01.647 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:01.647 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:01.647 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:01.647 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:01.647 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:01.647 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.647 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.647 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.647 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-19T09:20:01.648 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:01.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.648 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.648 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-19T09:20:01.648 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:01.648 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.648 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.648 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.648 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:01.648 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.648 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.648 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.649 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-19T09:20:01.649 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:01.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.649 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.649 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-19T09:20:01.649 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:01.649 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.649 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.649 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.649 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:01.649 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.649 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.649 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.650 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-19T09:20:01.650 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:01.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.650 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.650 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-19T09:20:01.650 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:01.650 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.650 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.650 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.650 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:01.650 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.650 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.650 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.651 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-19T09:20:01.651 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:01.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.651 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.651 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.651 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-19T09:20:01.651 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:01.651 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.651 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.651 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.651 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/4163178582", 2024-09-19T09:20:01.651 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/4163178582", 2024-09-19T09:20:01.652 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/4163178582", 2024-09-19T09:20:01.652 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/4163178582", 2024-09-19T09:20:01.652 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:01.652 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:01.652 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:01.652 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.652 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.652 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.652 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:20:01.652 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:01.652 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:01.652 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:01.652 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:01.652 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:01.653 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:01.653 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:01.653 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:01.653 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:01.653 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:01.653 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:01.653 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:01.653 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.653 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.653 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6822", 2024-09-19T09:20:01.653 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:01.653 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.653 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.654 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.654 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6824", 2024-09-19T09:20:01.654 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:01.654 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.654 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.654 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:01.654 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.654 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.654 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6826", 2024-09-19T09:20:01.654 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:01.654 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.654 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.655 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.655 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6827", 2024-09-19T09:20:01.655 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:01.655 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.655 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.655 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:01.655 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.655 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.655 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6830", 2024-09-19T09:20:01.655 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:01.655 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.655 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.656 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.656 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6831", 2024-09-19T09:20:01.656 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:01.656 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.656 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.656 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:01.656 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.656 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.656 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6828", 2024-09-19T09:20:01.656 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:01.656 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.656 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.657 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.657 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6829", 2024-09-19T09:20:01.657 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:01.657 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.657 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.657 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.657 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6824/3538482215", 2024-09-19T09:20:01.657 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6827/3538482215", 2024-09-19T09:20:01.657 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6831/3538482215", 2024-09-19T09:20:01.657 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6829/3538482215", 2024-09-19T09:20:01.657 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:01.657 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:01.657 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:01.658 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.658 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.658 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.658 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:20:01.658 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:01.658 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:01.658 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:01.658 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:01.658 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:01.658 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:01.658 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:01.658 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:01.658 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:01.658 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:01.659 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:01.659 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:01.659 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.659 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.659 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6800", 2024-09-19T09:20:01.659 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:01.659 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.659 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.659 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.659 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6801", 2024-09-19T09:20:01.659 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:01.659 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.659 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.660 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:01.660 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.660 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.660 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6802", 2024-09-19T09:20:01.660 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:01.660 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.660 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.660 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.660 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6803", 2024-09-19T09:20:01.660 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:01.660 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.660 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.661 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:01.661 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.661 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.661 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6806", 2024-09-19T09:20:01.661 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:01.661 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.661 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.661 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.661 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6807", 2024-09-19T09:20:01.661 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:01.662 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.662 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.662 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:01.662 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.662 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.662 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6804", 2024-09-19T09:20:01.662 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:01.662 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.662 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.662 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.662 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6805", 2024-09-19T09:20:01.662 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:01.663 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.663 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.663 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6801/2408698413", 2024-09-19T09:20:01.663 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6803/2408698413", 2024-09-19T09:20:01.663 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6807/2408698413", 2024-09-19T09:20:01.663 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6805/2408698413", 2024-09-19T09:20:01.663 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:01.663 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:01.663 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:01.663 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.663 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.663 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.663 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:20:01.664 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:01.664 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:01.664 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:01.664 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:01.664 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:01.664 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:01.664 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:01.664 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:01.664 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:01.664 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:01.664 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:01.664 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:01.664 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.665 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.665 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6808", 2024-09-19T09:20:01.665 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:01.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.665 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.665 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.665 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6809", 2024-09-19T09:20:01.665 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:01.665 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.665 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.665 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.665 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:01.665 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.666 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.666 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6810", 2024-09-19T09:20:01.666 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:01.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.666 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.666 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.666 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6811", 2024-09-19T09:20:01.666 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:01.666 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.666 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.666 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.666 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:01.667 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.667 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.667 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6814", 2024-09-19T09:20:01.667 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:01.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.667 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.667 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.667 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6815", 2024-09-19T09:20:01.667 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:01.667 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.667 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.667 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.667 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:01.667 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.668 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.668 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6812", 2024-09-19T09:20:01.668 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:01.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.668 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.668 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.668 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6813", 2024-09-19T09:20:01.668 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:01.668 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.668 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.668 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.668 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6809/2596207948", 2024-09-19T09:20:01.669 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6811/2596207948", 2024-09-19T09:20:01.669 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6815/2596207948", 2024-09-19T09:20:01.669 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6813/2596207948", 2024-09-19T09:20:01.669 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:01.669 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:01.669 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:01.669 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.669 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.669 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.669 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:20:01.669 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:01.669 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:01.669 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:01.669 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:01.670 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:01.670 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:01.670 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:01.670 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:01.670 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:01.670 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:01.670 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:01.670 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:01.670 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.670 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.670 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.670 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6816", 2024-09-19T09:20:01.670 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:01.670 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.671 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.671 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6817", 2024-09-19T09:20:01.671 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:01.671 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.671 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.671 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:01.671 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.671 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.671 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.671 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6818", 2024-09-19T09:20:01.671 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:01.671 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.672 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.672 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6819", 2024-09-19T09:20:01.672 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:01.672 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.672 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.672 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:01.672 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.672 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.672 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.672 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6823", 2024-09-19T09:20:01.672 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:01.672 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.673 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.673 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6825", 2024-09-19T09:20:01.673 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:01.673 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.673 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.673 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:01.673 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:01.673 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.673 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:01.673 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6820", 2024-09-19T09:20:01.673 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:01.673 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.674 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.674 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:01.674 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6821", 2024-09-19T09:20:01.674 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:01.674 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.674 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.674 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.674 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6817/1334618296", 2024-09-19T09:20:01.674 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6819/1334618296", 2024-09-19T09:20:01.674 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6825/1334618296", 2024-09-19T09:20:01.674 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6821/1334618296", 2024-09-19T09:20:01.674 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:01.674 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:01.674 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:01.675 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:01.675 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.675 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:20:01.675 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-19T09:20:01.675 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.675 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:20:01.675 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:01.675 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:01.675 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:01.675 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:01.675 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:01.675 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.580838+0000", 2024-09-19T09:20:01.675 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:01.675 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.676 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:20:01.676 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:01.676 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:01.676 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:01.676 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:01.676 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:01.676 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.599990+0000", 2024-09-19T09:20:01.676 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:01.676 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.676 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.676 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:20:01.676 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:01.677 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:01.677 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:01.677 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:01.677 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:01.677 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.503722+0000", 2024-09-19T09:20:01.677 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:01.677 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.677 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.677 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:20:01.677 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:01.677 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:01.677 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:01.677 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:01.677 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:01.678 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.607846+0000", 2024-09-19T09:20:01.678 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:01.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.678 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:20:01.678 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:01.678 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:01.678 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:01.678 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:01.678 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:01.678 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.616858+0000", 2024-09-19T09:20:01.678 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:01.678 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.678 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.679 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:20:01.679 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:01.679 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:01.679 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:01.679 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:01.679 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:01.679 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.542726+0000", 2024-09-19T09:20:01.679 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:01.679 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.679 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.679 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:20:01.679 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:01.679 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:01.679 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:01.680 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:01.680 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:01.680 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.534178+0000", 2024-09-19T09:20:01.680 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:01.680 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.680 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:01.680 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:20:01.680 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:01.680 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:01.680 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:01.680 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:01.680 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:01.680 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.612105+0000", 2024-09-19T09:20:01.681 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:01.681 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.681 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:20:01.681 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-19T09:20:01.681 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-19T09:20:01.681 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-19T09:20:01.681 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-19T09:20:01.681 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-19T09:20:01.681 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-19T09:20:01.681 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-19T09:20:01.682 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-19T09:20:01.682 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-19T09:20:01.682 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-19T09:20:01.682 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-19T09:20:01.682 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-19T09:20:01.682 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-19T09:20:01.682 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-19T09:20:01.682 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.682 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:01.682 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-19T09:20:01.682 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-19T09:20:01.682 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-19T09:20:01.682 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-19T09:20:01.682 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-19T09:20:01.683 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-19T09:20:01.683 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-19T09:20:01.683 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-19T09:20:01.683 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-19T09:20:01.683 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-19T09:20:01.683 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-19T09:20:01.683 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:01.683 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:20:01.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.608+0000 7f825956d640 1 -- 172.21.15.18:0/3734024462 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f823406c2b0 msgr2=0x7f823406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:01.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.608+0000 7f825956d640 1 --2- 172.21.15.18:0/3734024462 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f823406c2b0 0x7f823406e770 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f825406d700 tx=0x7f8244009040 comp rx=0 tx=0).stop 2024-09-19T09:20:01.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.608+0000 7f825956d640 1 -- 172.21.15.18:0/3734024462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8254160a80 msgr2=0x7f8254144f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:01.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.608+0000 7f825956d640 1 --2- 172.21.15.18:0/3734024462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8254160a80 0x7f8254144f00 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f824c009f40 tx=0x7f824c004a40 comp rx=0 tx=0).stop 2024-09-19T09:20:01.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.608+0000 7f825956d640 1 -- 172.21.15.18:0/3734024462 shutdown_connections 2024-09-19T09:20:01.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.608+0000 7f825956d640 1 --2- 172.21.15.18:0/3734024462 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f823406c2b0 0x7f823406e770 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.608+0000 7f825956d640 1 --2- 172.21.15.18:0/3734024462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8254160a80 0x7f8254144f00 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.608+0000 7f825956d640 1 --2- 172.21.15.18:0/3734024462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8254142150 0x7f82541f5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.608+0000 7f825956d640 1 --2- 172.21.15.18:0/3734024462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f825413fae0 0x7f82541f35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.608+0000 7f825956d640 1 -- 172.21.15.18:0/3734024462 >> 172.21.15.18:0/3734024462 conn(0x7f825406bc10 msgr2=0x7f82540ccc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:01.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.608+0000 7f825956d640 1 -- 172.21.15.18:0/3734024462 shutdown_connections 2024-09-19T09:20:01.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.608+0000 7f825956d640 1 -- 172.21.15.18:0/3734024462 wait complete. 2024-09-19T09:20:01.686 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:20:01.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.787+0000 7fdd90ed0640 1 Processor -- start 2024-09-19T09:20:01.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.787+0000 7fdd90ed0640 1 -- start start 2024-09-19T09:20:01.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.788+0000 7fdd90ed0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd8c13fae0 0x7fdd8c06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:01.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.788+0000 7fdd90ed0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdd8c160c50 0x7fdd8c0cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:01.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.788+0000 7fdd90ed0640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd8c142650 con 0x7fdd8c142150 2024-09-19T09:20:01.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.788+0000 7fdd90ed0640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fdd8c0ce780 con 0x7fdd8c160c50 2024-09-19T09:20:01.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.788+0000 7fdd90ed0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdd8c142930 con 0x7fdd8c13fae0 2024-09-19T09:20:01.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.788+0000 7fdd8ad9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdd8c160c50 0x7fdd8c0cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:01.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.788+0000 7fdd89d9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fdd8c142150 0x7fdd8c160540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:58404/0 (socket says 172.21.15.18:58404) 2024-09-19T09:20:01.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.788+0000 7fdd89d9b640 1 -- 172.21.15.18:0/2433974335 learned_addr learned my addr 172.21.15.18:0/2433974335 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:20:01.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.789+0000 7fdd8ad9d640 1 -- 172.21.15.18:0/2433974335 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd8c13fae0 msgr2=0x7fdd8c06f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:01.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.789+0000 7fdd8ad9d640 1 --2- 172.21.15.18:0/2433974335 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd8c13fae0 0x7fdd8c06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.789+0000 7fdd8ad9d640 1 -- 172.21.15.18:0/2433974335 >> v1:172.21.15.18:6789/0 conn(0x7fdd8c142150 legacy=0x7fdd8c160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:01.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.789+0000 7fdd8959a640 1 -- 172.21.15.18:0/2433974335 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3016699262 0 0) 0x7fdd8c142650 con 0x7fdd8c142150 2024-09-19T09:20:01.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.789+0000 7fdd8ad9d640 1 -- 172.21.15.18:0/2433974335 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd8c142c10 con 0x7fdd8c160c50 2024-09-19T09:20:01.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.789+0000 7fdd8ad9d640 1 --2- 172.21.15.18:0/2433974335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd8c160c50 0x7fdd8c0cec10 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fdd840097a0 tx=0x7fdd8402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0189b231e8316a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:01.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.790+0000 7fdd8959a640 1 -- 172.21.15.18:0/2433974335 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd84037070 con 0x7fdd8c160c50 2024-09-19T09:20:01.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.790+0000 7fdd8959a640 1 -- 172.21.15.18:0/2433974335 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd8402ae50 con 0x7fdd8c160c50 2024-09-19T09:20:01.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.790+0000 7fdd8959a640 1 -- 172.21.15.18:0/2433974335 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd84032660 con 0x7fdd8c160c50 2024-09-19T09:20:01.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.790+0000 7fdd90ed0640 1 -- 172.21.15.18:0/2433974335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd8c160c50 msgr2=0x7fdd8c0cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:01.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.790+0000 7fdd90ed0640 1 --2- 172.21.15.18:0/2433974335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd8c160c50 0x7fdd8c0cec10 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fdd840097a0 tx=0x7fdd8402a100 comp rx=0 tx=0).stop 2024-09-19T09:20:01.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.790+0000 7fdd90ed0640 1 -- 172.21.15.18:0/2433974335 shutdown_connections 2024-09-19T09:20:01.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.790+0000 7fdd90ed0640 1 --2- 172.21.15.18:0/2433974335 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd8c160c50 0x7fdd8c0cec10 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.790+0000 7fdd90ed0640 1 --2- 172.21.15.18:0/2433974335 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd8c13fae0 0x7fdd8c06f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.790+0000 7fdd90ed0640 1 -- 172.21.15.18:0/2433974335 >> 172.21.15.18:0/2433974335 conn(0x7fdd8c06bc10 msgr2=0x7fdd8c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:01.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.790+0000 7fdd90ed0640 1 -- 172.21.15.18:0/2433974335 shutdown_connections 2024-09-19T09:20:01.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.790+0000 7fdd90ed0640 1 -- 172.21.15.18:0/2433974335 wait complete. 2024-09-19T09:20:01.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.792+0000 7fdd90ed0640 1 Processor -- start 2024-09-19T09:20:01.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.792+0000 7fdd90ed0640 1 -- start start 2024-09-19T09:20:01.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.792+0000 7fdd90ed0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd8c13fae0 0x7fdd8c15fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:01.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.792+0000 7fdd90ed0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd8c142150 0x7fdd8c143220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:01.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.792+0000 7fdd90ed0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd8c160c50 0x7fdd8c0b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:01.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.792+0000 7fdd90ed0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdd8c06f870 con 0x7fdd8c160c50 2024-09-19T09:20:01.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.792+0000 7fdd90ed0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdd8c06f6f0 con 0x7fdd8c13fae0 2024-09-19T09:20:01.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.792+0000 7fdd90ed0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdd8c0cf150 con 0x7fdd8c142150 2024-09-19T09:20:01.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.792+0000 7fdd8ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd8c160c50 0x7fdd8c0b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:01.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.793+0000 7fdd8ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd8c160c50 0x7fdd8c0b0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35104/0 (socket says 172.21.15.18:35104) 2024-09-19T09:20:01.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.793+0000 7fdd8ad9d640 1 -- 172.21.15.18:0/3269396937 learned_addr learned my addr 172.21.15.18:0/3269396937 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:01.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.793+0000 7fdd8a59c640 1 --2- 172.21.15.18:0/3269396937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd8c13fae0 0x7fdd8c15fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:01.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.793+0000 7fdd89d9b640 1 --2- 172.21.15.18:0/3269396937 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd8c142150 0x7fdd8c143220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:01.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.793+0000 7fdd8ad9d640 1 -- 172.21.15.18:0/3269396937 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd8c142150 msgr2=0x7fdd8c143220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:01.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.793+0000 7fdd8ad9d640 1 --2- 172.21.15.18:0/3269396937 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd8c142150 0x7fdd8c143220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.793+0000 7fdd8ad9d640 1 -- 172.21.15.18:0/3269396937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd8c13fae0 msgr2=0x7fdd8c15fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:01.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.793+0000 7fdd8ad9d640 1 --2- 172.21.15.18:0/3269396937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd8c13fae0 0x7fdd8c15fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:01.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.793+0000 7fdd8ad9d640 1 -- 172.21.15.18:0/3269396937 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd8c143c00 con 0x7fdd8c160c50 2024-09-19T09:20:01.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.793+0000 7fdd8ad9d640 1 --2- 172.21.15.18:0/3269396937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd8c160c50 0x7fdd8c0b0a20 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fdd840097a0 tx=0x7fdd840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:01.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.793+0000 7fdd82ffd640 1 -- 172.21.15.18:0/3269396937 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd84042070 con 0x7fdd8c160c50 2024-09-19T09:20:01.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.793+0000 7fdd82ffd640 1 -- 172.21.15.18:0/3269396937 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd84032e10 con 0x7fdd8c160c50 2024-09-19T09:20:01.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.793+0000 7fdd90ed0640 1 -- 172.21.15.18:0/3269396937 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd8c15f1e0 con 0x7fdd8c160c50 2024-09-19T09:20:01.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.793+0000 7fdd82ffd640 1 -- 172.21.15.18:0/3269396937 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd84037040 con 0x7fdd8c160c50 2024-09-19T09:20:01.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.793+0000 7fdd90ed0640 1 -- 172.21.15.18:0/3269396937 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd8c143ee0 con 0x7fdd8c160c50 2024-09-19T09:20:01.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.794+0000 7fdd90ed0640 1 -- 172.21.15.18:0/3269396937 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd8c06f1b0 con 0x7fdd8c160c50 2024-09-19T09:20:01.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.795+0000 7fdd82ffd640 1 -- 172.21.15.18:0/3269396937 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdd84045070 con 0x7fdd8c160c50 2024-09-19T09:20:01.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.795+0000 7fdd82ffd640 1 --2- 172.21.15.18:0/3269396937 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdd6c06c2b0 0x7fdd6c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:01.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.796+0000 7fdd82ffd640 1 -- 172.21.15.18:0/3269396937 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5709+0+0 (secure 0 0 0) 0x7fdd840abc40 con 0x7fdd8c160c50 2024-09-19T09:20:01.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.796+0000 7fdd82ffd640 1 -- 172.21.15.18:0/3269396937 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=141}) -- 0x7fdd6c073de0 con 0x7fdd8c160c50 2024-09-19T09:20:01.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.796+0000 7fdd8a59c640 1 --2- 172.21.15.18:0/3269396937 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdd6c06c2b0 0x7fdd6c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:01.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.796+0000 7fdd8a59c640 1 --2- 172.21.15.18:0/3269396937 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdd6c06c2b0 0x7fdd6c06e770 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c0b1730 tx=0x7fdd7c00d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:01.800 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:01.800+0000 7fdd82ffd640 1 -- 172.21.15.18:0/3269396937 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fdd84079cc0 con 0x7fdd8c160c50 2024-09-19T09:20:02.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.012+0000 7fdd90ed0640 1 -- 172.21.15.18:0/3269396937 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd8c160850 con 0x7fdd8c160c50 2024-09-19T09:20:02.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.013+0000 7fdd82ffd640 1 -- 172.21.15.18:0/3269396937 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5231 (secure 0 0 0) 0x7fdd8407dfc0 con 0x7fdd8c160c50 2024-09-19T09:20:02.013 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:20:02.014 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":56,"btime":"2024-09-19T09:19:43:414636+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5846,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1876507362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1876507362},{"type":"v1","addr":"172.21.15.162:6837","nonce":1876507362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2245870616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2245870616},{"type":"v1","addr":"172.21.15.162:6835","nonce":2245870616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6858,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1245398837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1245398837},{"type":"v1","addr":"172.21.15.18:6834","nonce":1245398837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:19:39.754151+0000","modified":"2024-09-19T09:19:42.581316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6861":{"gid":6861,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/2894746570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2894746570},{"type":"v1","addr":"172.21.15.18:6835","nonce":2894746570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6861,"qdb_cluster":[6861]},"id":8}]} 2024-09-19T09:20:02.014 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 56 2024-09-19T09:20:02.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.015+0000 7fdd90ed0640 1 -- 172.21.15.18:0/3269396937 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdd6c06c2b0 msgr2=0x7fdd6c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:02.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.015+0000 7fdd90ed0640 1 --2- 172.21.15.18:0/3269396937 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdd6c06c2b0 0x7fdd6c06e770 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c0b1730 tx=0x7fdd7c00d040 comp rx=0 tx=0).stop 2024-09-19T09:20:02.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.015+0000 7fdd90ed0640 1 -- 172.21.15.18:0/3269396937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd8c160c50 msgr2=0x7fdd8c0b0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:02.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.015+0000 7fdd90ed0640 1 --2- 172.21.15.18:0/3269396937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd8c160c50 0x7fdd8c0b0a20 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fdd840097a0 tx=0x7fdd840046c0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.015+0000 7fdd90ed0640 1 -- 172.21.15.18:0/3269396937 shutdown_connections 2024-09-19T09:20:02.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.015+0000 7fdd90ed0640 1 --2- 172.21.15.18:0/3269396937 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdd6c06c2b0 0x7fdd6c06e770 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.015+0000 7fdd90ed0640 1 --2- 172.21.15.18:0/3269396937 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdd8c160c50 0x7fdd8c0b0a20 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.015+0000 7fdd90ed0640 1 --2- 172.21.15.18:0/3269396937 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdd8c142150 0x7fdd8c143220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.015+0000 7fdd90ed0640 1 --2- 172.21.15.18:0/3269396937 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdd8c13fae0 0x7fdd8c15fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.015+0000 7fdd90ed0640 1 -- 172.21.15.18:0/3269396937 >> 172.21.15.18:0/3269396937 conn(0x7fdd8c06bc10 msgr2=0x7fdd8c072c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:02.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.015+0000 7fdd90ed0640 1 -- 172.21.15.18:0/3269396937 shutdown_connections 2024-09-19T09:20:02.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.015+0000 7fdd90ed0640 1 -- 172.21.15.18:0/3269396937 wait complete. 2024-09-19T09:20:02.027 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-19T09:20:02.147 INFO:teuthology.orchestra.run.smithi018.stdout:{"cluster_fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","whoami":0,"id":6861,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":21.745874301000001,"mdsmap_epoch":56,"osdmap_epoch":140,"osdmap_epoch_barrier":140,"uptime":31.854852708999999} 2024-09-19T09:20:02.148 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", "fs_name": "cephfs", "id": 6861, "mdsmap_epoch": 56, "osdmap_epoch": 140, "osdmap_epoch_barrier": 140, "rank_uptime": 21.745874301, "state": "up:active", "uptime": 31.854852709, "want_state": "up:active", "whoami": 0 } 2024-09-19T09:20:02.148 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-19T09:20:02.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:20:02.148 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2024-09-19T09:20:02.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:20:02.168 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2024-09-19T09:20:02.229 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-19T09:20:02.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.371+0000 7fcafb84c640 1 Processor -- start 2024-09-19T09:20:02.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.371+0000 7fcafb84c640 1 -- start start 2024-09-19T09:20:02.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.372+0000 7fcafb84c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcaf415ca00 0x7fcaf4072fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.372+0000 7fcafb84c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcaf406bc10 0x7fcaf406c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.372+0000 7fcafb84c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaf40ce3a0 con 0x7fcaf40b68e0 2024-09-19T09:20:02.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.372+0000 7fcafb84c640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fcaf40b51a0 con 0x7fcaf415ca00 2024-09-19T09:20:02.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.372+0000 7fcafb84c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fcaf415cde0 con 0x7fcaf406bc10 2024-09-19T09:20:02.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.372+0000 7fcaf95e8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcaf415ca00 0x7fcaf4072fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.372+0000 7fcaf8de7640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fcaf40b68e0 0x7fcaf40b5630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:58418/0 (socket says 172.21.15.18:58418) 2024-09-19T09:20:02.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.372+0000 7fcaf8de7640 1 -- 172.21.15.18:0/2380125188 learned_addr learned my addr 172.21.15.18:0/2380125188 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:20:02.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.372+0000 7fcaf9de9640 1 --2- 172.21.15.18:0/2380125188 >> v2:172.21.15.162:3300/0 conn(0x7fcaf406bc10 0x7fcaf406c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.372+0000 7fcaf95e8640 1 -- 172.21.15.18:0/2380125188 >> v2:172.21.15.162:3300/0 conn(0x7fcaf406bc10 msgr2=0x7fcaf406c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:02.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.372+0000 7fcaf95e8640 1 --2- 172.21.15.18:0/2380125188 >> v2:172.21.15.162:3300/0 conn(0x7fcaf406bc10 0x7fcaf406c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.372+0000 7fcaf95e8640 1 -- 172.21.15.18:0/2380125188 >> v1:172.21.15.18:6789/0 conn(0x7fcaf40b68e0 legacy=0x7fcaf40b5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:02.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.372+0000 7fcaf95e8640 1 -- 172.21.15.18:0/2380125188 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf40ce610 con 0x7fcaf415ca00 2024-09-19T09:20:02.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.372+0000 7fcaebfff640 1 -- 172.21.15.18:0/2380125188 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1196890936 0 0) 0x7fcaf40ce3a0 con 0x7fcaf40b68e0 2024-09-19T09:20:02.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.373+0000 7fcaf95e8640 1 --2- 172.21.15.18:0/2380125188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcaf415ca00 0x7fcaf4072fc0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fcaf40b5110 tx=0x7fcaf002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=208b41272a986ef4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:02.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.373+0000 7fcaebfff640 1 -- 172.21.15.18:0/2380125188 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0037070 con 0x7fcaf415ca00 2024-09-19T09:20:02.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.373+0000 7fcaebfff640 1 -- 172.21.15.18:0/2380125188 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaf0032440 con 0x7fcaf415ca00 2024-09-19T09:20:02.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.373+0000 7fcaebfff640 1 -- 172.21.15.18:0/2380125188 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf002ae60 con 0x7fcaf415ca00 2024-09-19T09:20:02.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.374+0000 7fcafb84c640 1 -- 172.21.15.18:0/2380125188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcaf415ca00 msgr2=0x7fcaf4072fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:02.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.374+0000 7fcafb84c640 1 --2- 172.21.15.18:0/2380125188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcaf415ca00 0x7fcaf4072fc0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fcaf40b5110 tx=0x7fcaf002a110 comp rx=0 tx=0).stop 2024-09-19T09:20:02.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.374+0000 7fcafb84c640 1 -- 172.21.15.18:0/2380125188 shutdown_connections 2024-09-19T09:20:02.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.374+0000 7fcafb84c640 1 --2- 172.21.15.18:0/2380125188 >> v2:172.21.15.162:3300/0 conn(0x7fcaf406bc10 0x7fcaf406c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.374+0000 7fcafb84c640 1 --2- 172.21.15.18:0/2380125188 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcaf415ca00 0x7fcaf4072fc0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.374+0000 7fcafb84c640 1 -- 172.21.15.18:0/2380125188 >> 172.21.15.18:0/2380125188 conn(0x7fcaf40d1970 msgr2=0x7fcaf40d1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:02.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.374+0000 7fcafb84c640 1 -- 172.21.15.18:0/2380125188 shutdown_connections 2024-09-19T09:20:02.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.374+0000 7fcafb84c640 1 -- 172.21.15.18:0/2380125188 wait complete. 2024-09-19T09:20:02.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.375+0000 7fcafb84c640 1 Processor -- start 2024-09-19T09:20:02.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.375+0000 7fcafb84c640 1 -- start start 2024-09-19T09:20:02.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.376+0000 7fcafb84c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcaf406bc10 0x7fcaf41f6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.376+0000 7fcafb84c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcaf40b68e0 0x7fcaf41554f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.376+0000 7fcafb84c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcaf415ca00 0x7fcaf4152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.376+0000 7fcafb84c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf40ce8f0 con 0x7fcaf40b68e0 2024-09-19T09:20:02.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.376+0000 7fcafb84c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf40b4e30 con 0x7fcaf415ca00 2024-09-19T09:20:02.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.376+0000 7fcafb84c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcaf40cfdd0 con 0x7fcaf406bc10 2024-09-19T09:20:02.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.376+0000 7fcaf8de7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcaf40b68e0 0x7fcaf41554f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.376+0000 7fcaf8de7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcaf40b68e0 0x7fcaf41554f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:35126/0 (socket says 172.21.15.18:35126) 2024-09-19T09:20:02.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.376+0000 7fcaf8de7640 1 -- 172.21.15.18:0/1970965674 learned_addr learned my addr 172.21.15.18:0/1970965674 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:02.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.376+0000 7fcaf9de9640 1 --2- 172.21.15.18:0/1970965674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcaf415ca00 0x7fcaf4152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.376+0000 7fcaf95e8640 1 --2- 172.21.15.18:0/1970965674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcaf406bc10 0x7fcaf41f6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.376+0000 7fcaf8de7640 1 -- 172.21.15.18:0/1970965674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcaf406bc10 msgr2=0x7fcaf41f6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:02.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.376+0000 7fcaf8de7640 1 --2- 172.21.15.18:0/1970965674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcaf406bc10 0x7fcaf41f6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.376+0000 7fcaf8de7640 1 -- 172.21.15.18:0/1970965674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcaf415ca00 msgr2=0x7fcaf4152390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:02.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.376+0000 7fcaf8de7640 1 --2- 172.21.15.18:0/1970965674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcaf415ca00 0x7fcaf4152390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.376+0000 7fcaf8de7640 1 -- 172.21.15.18:0/1970965674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf4155dd0 con 0x7fcaf40b68e0 2024-09-19T09:20:02.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.376+0000 7fcaf8de7640 1 --2- 172.21.15.18:0/1970965674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcaf40b68e0 0x7fcaf41554f0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fcae400c4b0 tx=0x7fcae400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:02.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.377+0000 7fcae9ffb640 1 -- 172.21.15.18:0/1970965674 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae4018070 con 0x7fcaf40b68e0 2024-09-19T09:20:02.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.377+0000 7fcae9ffb640 1 -- 172.21.15.18:0/1970965674 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcae4007500 con 0x7fcaf40b68e0 2024-09-19T09:20:02.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.377+0000 7fcae9ffb640 1 -- 172.21.15.18:0/1970965674 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae4004a20 con 0x7fcaf40b68e0 2024-09-19T09:20:02.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.377+0000 7fcafb84c640 1 -- 172.21.15.18:0/1970965674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaf41560b0 con 0x7fcaf40b68e0 2024-09-19T09:20:02.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.377+0000 7fcafb84c640 1 -- 172.21.15.18:0/1970965674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaf41f6100 con 0x7fcaf40b68e0 2024-09-19T09:20:02.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.378+0000 7fcafb84c640 1 -- 172.21.15.18:0/1970965674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaf406c0c0 con 0x7fcaf40b68e0 2024-09-19T09:20:02.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.378+0000 7fcae9ffb640 1 -- 172.21.15.18:0/1970965674 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcae401b070 con 0x7fcaf40b68e0 2024-09-19T09:20:02.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.379+0000 7fcae9ffb640 1 --2- 172.21.15.18:0/1970965674 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcad806c2b0 0x7fcad806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:02.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.379+0000 7fcae9ffb640 1 -- 172.21.15.18:0/1970965674 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5709+0+0 (secure 0 0 0) 0x7fcae408a7b0 con 0x7fcaf40b68e0 2024-09-19T09:20:02.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.379+0000 7fcaf95e8640 1 --2- 172.21.15.18:0/1970965674 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcad806c2b0 0x7fcad806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:02.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.379+0000 7fcae9ffb640 1 -- 172.21.15.18:0/1970965674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=141}) -- 0x7fcad8073de0 con 0x7fcaf40b68e0 2024-09-19T09:20:02.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.379+0000 7fcaf95e8640 1 --2- 172.21.15.18:0/1970965674 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcad806c2b0 0x7fcad806e770 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0034000 tx=0x7fcaf002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:02.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.383+0000 7fcae9ffb640 1 -- 172.21.15.18:0/1970965674 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fcae405de20 con 0x7fcaf40b68e0 2024-09-19T09:20:02.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.559+0000 7fcafb84c640 1 -- 172.21.15.18:0/1970965674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fcaf406c9c0 con 0x7fcaf40b68e0 2024-09-19T09:20:02.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.560+0000 7fcae9ffb640 1 -- 172.21.15.18:0/1970965674 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v140) ==== 81+0+34313 (secure 0 0 0) 0x7fcae4058fe0 con 0x7fcaf40b68e0 2024-09-19T09:20:02.561 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:20:02.562 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:20:02.562 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 140, 2024-09-19T09:20:02.562 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:20:02.562 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-19T09:13:11.348786+0000", 2024-09-19T09:20:02.562 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-19T09:19:56.224151+0000", 2024-09-19T09:20:02.562 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-19T09:13:16.423937+0000", 2024-09-19T09:20:02.562 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-19T09:13:13.417141+0000", 2024-09-19T09:20:02.562 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-19T09:20:02.562 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-09-19T09:20:02.562 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-19T09:20:02.562 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-19T09:20:02.562 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-19T09:20:02.563 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-19T09:20:02.563 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-19T09:20:02.563 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:20:02.563 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-19T09:20:02.563 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.69999998807907104, 2024-09-19T09:20:02.563 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-19T09:20:02.563 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-19T09:20:02.563 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-19T09:20:02.563 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 17, 2024-09-19T09:20:02.563 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-19T09:20:02.563 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-19T09:20:02.563 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "jewel", 2024-09-19T09:20:02.563 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-19T09:20:02.563 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-19T09:20:02.564 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-19T09:20:02.564 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.564 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-19T09:20:02.564 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-19T09:20:02.564 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:13:17.564717+0000", 2024-09-19T09:20:02.564 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:20:02.564 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:20:02.564 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:20:02.564 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:20:02.564 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:20:02.564 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:20:02.564 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:20:02.564 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:20:02.564 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:20:02.565 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:20:02.565 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:20:02.565 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:20:02.565 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:20:02.565 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-19T09:20:02.565 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-19T09:20:02.565 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-19T09:20:02.565 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-19T09:20:02.565 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-19T09:20:02.565 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:20:02.565 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:20:02.565 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:20:02.565 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:20:02.565 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:20:02.566 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:20:02.566 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:20:02.566 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.566 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "111", 2024-09-19T09:20:02.566 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:20:02.566 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:20:02.566 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:20:02.566 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:20:02.566 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:20:02.566 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:20:02.566 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:20:02.566 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:20:02.566 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:20:02.566 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:20:02.567 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:20:02.567 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:20:02.567 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:20:02.567 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:20:02.567 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:20:02.567 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:20:02.567 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:20:02.567 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:20:02.567 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:20:02.567 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:20:02.567 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:20:02.567 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:20:02.567 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:20:02.567 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:20:02.568 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:20:02.568 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:20:02.568 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.568 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:20:02.568 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:20:02.568 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:20:02.568 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:20:02.568 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:20:02.568 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:20:02.568 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:20:02.568 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:20:02.568 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:20:02.568 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:20:02.568 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:20:02.569 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:20:02.569 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-19T09:20:02.569 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-19T09:20:02.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.569 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:20:02.569 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-19T09:20:02.569 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.569 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:20:02.569 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:20:02.569 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-19T09:20:02.569 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-19T09:20:02.569 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-19T09:20:02.569 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-19T09:20:02.569 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-19T09:20:02.570 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:20:02.570 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:20:02.570 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:20:02.570 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.570 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.570 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.570 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 16, 2024-09-19T09:20:02.570 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_metadata", 2024-09-19T09:20:02.570 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:19:38.333262+0000", 2024-09-19T09:20:02.570 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:20:02.570 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:20:02.570 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:20:02.570 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:20:02.570 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:20:02.570 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:20:02.571 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:20:02.571 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:20:02.571 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:20:02.571 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:20:02.571 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:20:02.571 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:20:02.571 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:20:02.571 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-19T09:20:02.571 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-19T09:20:02.571 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-19T09:20:02.571 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-19T09:20:02.571 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-19T09:20:02.571 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:20:02.571 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:20:02.572 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:20:02.572 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:20:02.572 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:20:02.572 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:20:02.572 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:20:02.572 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.572 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "137", 2024-09-19T09:20:02.572 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:20:02.572 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:20:02.572 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:20:02.572 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:20:02.572 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:20:02.573 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:20:02.573 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:20:02.573 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:20:02.573 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:20:02.573 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:20:02.573 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:20:02.573 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:20:02.573 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:20:02.573 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:20:02.573 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:20:02.573 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:20:02.573 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:20:02.574 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:20:02.574 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:20:02.574 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:20:02.574 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:20:02.574 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:20:02.574 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:20:02.574 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:20:02.574 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:20:02.574 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:20:02.574 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.574 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:20:02.574 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:20:02.574 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:20:02.574 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:20:02.575 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:20:02.575 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:20:02.575 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:20:02.575 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:20:02.575 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:20:02.575 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:20:02.575 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:20:02.575 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:20:02.575 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4, 2024-09-19T09:20:02.575 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 16, 2024-09-19T09:20:02.575 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_priority": 5 2024-09-19T09:20:02.575 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.575 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:20:02.575 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:20:02.576 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": "cephfs" 2024-09-19T09:20:02.576 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.576 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.576 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:20:02.576 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:20:02.576 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 2.25, 2024-09-19T09:20:02.576 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 2.25, 2024-09-19T09:20:02.576 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:20:02.576 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2.25, 2024-09-19T09:20:02.576 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2.25, 2024-09-19T09:20:02.576 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:20:02.576 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:20:02.576 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:20:02.576 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.577 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.577 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.577 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 17, 2024-09-19T09:20:02.577 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_data", 2024-09-19T09:20:02.577 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:19:38.727884+0000", 2024-09-19T09:20:02.577 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1027, 2024-09-19T09:20:02.577 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-19T09:20:02.577 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:20:02.577 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:20:02.577 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:20:02.577 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:20:02.577 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:20:02.577 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:20:02.577 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:20:02.578 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:20:02.578 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:20:02.578 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:20:02.578 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:20:02.578 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 64, 2024-09-19T09:20:02.578 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 64, 2024-09-19T09:20:02.578 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 64, 2024-09-19T09:20:02.578 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 64, 2024-09-19T09:20:02.578 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 64, 2024-09-19T09:20:02.578 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:20:02.578 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:20:02.578 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:20:02.578 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:20:02.578 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:20:02.579 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:20:02.579 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:20:02.579 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.579 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "140", 2024-09-19T09:20:02.579 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:20:02.579 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:20:02.579 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:20:02.579 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:20:02.579 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:20:02.579 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:20:02.579 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:20:02.579 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:20:02.579 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:20:02.579 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 33554432, 2024-09-19T09:20:02.580 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:20:02.580 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:20:02.580 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:20:02.580 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:20:02.580 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:20:02.580 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:20:02.580 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:20:02.580 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:20:02.580 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:20:02.580 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:20:02.580 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:20:02.580 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:20:02.580 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:20:02.581 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:20:02.581 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:20:02.581 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:20:02.581 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.581 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:20:02.581 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:20:02.581 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:20:02.581 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:20:02.581 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:20:02.581 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:20:02.581 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:20:02.581 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:20:02.581 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:20:02.582 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:20:02.582 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:20:02.582 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:20:02.582 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 64, 2024-09-19T09:20:02.582 INFO:teuthology.orchestra.run.smithi018.stdout: "target_size_ratio": 0.89999997615814209 2024-09-19T09:20:02.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.582 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:20:02.582 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:20:02.582 INFO:teuthology.orchestra.run.smithi018.stdout: "data": "cephfs" 2024-09-19T09:20:02.582 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.582 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.582 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:20:02.582 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:20:02.582 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.3799999952316284, 2024-09-19T09:20:02.583 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.3799999952316284, 2024-09-19T09:20:02.583 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:20:02.583 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-19T09:20:02.583 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-19T09:20:02.583 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:20:02.583 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:20:02.583 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:20:02.583 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.583 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.583 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:20:02.583 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-19T09:20:02.583 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.583 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:20:02.583 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:02.584 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:02.584 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:02.584 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:02.584 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:02.584 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:02.584 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:02.584 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:02.584 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:02.584 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:02.584 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:02.584 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:02.584 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.584 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.584 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.585 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-19T09:20:02.585 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:02.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.585 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.585 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-19T09:20:02.585 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:02.585 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.585 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.585 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.585 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:02.585 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.585 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.586 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.586 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-19T09:20:02.586 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:02.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.586 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.586 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-19T09:20:02.586 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:02.586 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.586 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.586 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.586 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:02.586 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.586 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.586 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.587 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-19T09:20:02.587 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:02.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.587 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.587 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-19T09:20:02.587 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:02.587 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.587 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.587 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.587 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:02.587 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.587 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.587 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.588 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-19T09:20:02.588 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:02.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.588 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.588 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.588 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-19T09:20:02.588 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:02.588 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.588 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.588 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.588 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/128722874", 2024-09-19T09:20:02.588 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/128722874", 2024-09-19T09:20:02.588 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/128722874", 2024-09-19T09:20:02.588 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/128722874", 2024-09-19T09:20:02.589 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:02.589 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:02.589 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:02.589 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.589 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.589 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.589 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:20:02.589 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:02.589 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:02.589 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:02.589 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:02.589 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:02.589 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:02.589 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:02.590 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:02.590 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:02.590 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:02.590 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:02.590 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:02.590 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.590 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.590 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-19T09:20:02.590 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:02.590 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.590 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.590 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.590 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-19T09:20:02.590 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:02.591 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.591 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.591 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:02.591 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.591 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.591 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-19T09:20:02.591 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:02.591 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.591 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.591 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.591 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-19T09:20:02.591 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:02.592 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.592 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.592 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:02.592 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.592 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.592 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-19T09:20:02.592 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:02.592 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.592 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.592 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.592 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-19T09:20:02.593 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:02.593 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.593 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.593 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:02.593 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.593 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.593 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-19T09:20:02.593 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:02.593 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.593 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.593 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.593 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-19T09:20:02.594 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:02.594 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.594 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.594 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/3672199638", 2024-09-19T09:20:02.594 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/3672199638", 2024-09-19T09:20:02.594 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/3672199638", 2024-09-19T09:20:02.594 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/3672199638", 2024-09-19T09:20:02.594 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:02.594 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:02.594 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:02.594 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.594 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.594 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.594 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:20:02.595 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:02.595 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:02.595 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:02.595 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:02.595 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:02.595 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:02.595 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:02.595 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:02.595 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:02.595 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:02.595 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:02.595 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:02.595 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.595 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.596 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.596 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T09:20:02.596 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:02.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.596 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.596 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.596 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T09:20:02.596 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:02.596 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.596 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.596 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.596 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:02.596 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.597 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.597 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-19T09:20:02.597 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:02.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.597 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.597 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-19T09:20:02.597 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:02.597 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.597 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.597 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.597 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:02.597 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.597 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.598 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.598 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-19T09:20:02.598 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:02.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.598 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.598 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-19T09:20:02.598 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:02.598 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.598 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.598 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.598 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:02.598 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.598 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.599 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.599 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-19T09:20:02.599 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:02.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.599 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.599 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.599 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-19T09:20:02.599 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:02.599 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.599 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.599 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.599 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3463367841", 2024-09-19T09:20:02.599 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3463367841", 2024-09-19T09:20:02.599 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3463367841", 2024-09-19T09:20:02.599 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3463367841", 2024-09-19T09:20:02.600 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:02.600 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:02.600 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:02.600 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.600 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.600 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.600 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:20:02.600 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:02.600 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:02.600 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:02.600 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:02.600 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:02.600 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:02.600 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:02.601 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:02.601 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:02.601 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:02.601 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:02.601 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:02.601 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.601 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.601 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-19T09:20:02.601 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:02.601 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.601 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.601 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.601 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-19T09:20:02.602 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:02.602 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.602 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.602 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:02.602 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.602 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.602 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-19T09:20:02.602 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:02.602 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.602 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.602 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.602 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-19T09:20:02.603 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:02.603 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.603 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.603 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:02.603 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.603 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.603 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-19T09:20:02.603 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:02.603 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.603 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.603 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.603 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-19T09:20:02.604 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:02.604 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.604 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.604 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:02.604 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.604 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.604 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-19T09:20:02.604 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:02.604 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.604 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.604 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.604 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-19T09:20:02.605 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:02.605 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.605 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.605 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/4163178582", 2024-09-19T09:20:02.605 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/4163178582", 2024-09-19T09:20:02.605 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/4163178582", 2024-09-19T09:20:02.605 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/4163178582", 2024-09-19T09:20:02.605 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:02.605 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:02.605 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:02.605 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.605 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.605 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.606 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:20:02.606 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:02.608 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:02.609 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:02.609 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:02.609 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:02.609 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:02.609 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:02.609 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:02.609 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:02.609 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:02.609 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:02.609 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:02.609 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.609 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.609 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.610 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6822", 2024-09-19T09:20:02.610 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:02.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.610 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.610 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6824", 2024-09-19T09:20:02.610 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:02.610 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.610 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.610 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.610 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:02.610 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.610 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.610 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.611 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6826", 2024-09-19T09:20:02.611 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:02.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.611 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.611 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6827", 2024-09-19T09:20:02.611 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:02.611 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.611 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.611 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.611 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:02.611 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.611 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.611 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.612 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6830", 2024-09-19T09:20:02.612 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:02.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.612 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.612 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6831", 2024-09-19T09:20:02.612 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:02.612 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.612 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.612 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.612 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:02.612 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.612 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.612 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.613 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6828", 2024-09-19T09:20:02.613 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:02.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.613 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.613 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.613 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6829", 2024-09-19T09:20:02.613 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:02.613 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.613 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.613 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.613 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6824/3538482215", 2024-09-19T09:20:02.613 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6827/3538482215", 2024-09-19T09:20:02.613 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6831/3538482215", 2024-09-19T09:20:02.614 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6829/3538482215", 2024-09-19T09:20:02.614 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:02.614 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:02.614 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:02.614 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.614 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.614 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.614 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:20:02.614 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:02.614 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:02.614 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:02.614 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:02.614 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:02.614 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:02.615 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:02.615 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:02.615 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:02.615 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:02.615 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:02.615 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:02.615 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.615 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.615 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6800", 2024-09-19T09:20:02.615 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:02.615 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.615 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.615 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.615 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6801", 2024-09-19T09:20:02.616 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:02.616 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.616 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.616 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:02.616 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.616 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.616 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6802", 2024-09-19T09:20:02.616 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:02.616 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.616 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.616 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.617 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6803", 2024-09-19T09:20:02.617 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:02.617 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.617 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.617 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:02.617 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.617 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.617 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6806", 2024-09-19T09:20:02.617 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:02.617 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.617 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.618 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.618 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6807", 2024-09-19T09:20:02.618 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:02.618 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.618 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.618 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:02.618 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.618 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.618 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6804", 2024-09-19T09:20:02.618 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:02.618 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.618 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.619 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.619 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6805", 2024-09-19T09:20:02.619 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:02.619 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.619 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.619 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.619 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6801/2408698413", 2024-09-19T09:20:02.619 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6803/2408698413", 2024-09-19T09:20:02.619 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6807/2408698413", 2024-09-19T09:20:02.619 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6805/2408698413", 2024-09-19T09:20:02.619 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:02.619 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:02.619 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:02.620 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.620 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.620 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.620 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:20:02.620 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:02.620 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:02.620 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:02.620 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:02.620 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:02.620 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:02.620 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:02.620 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:02.620 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:02.621 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:02.621 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:02.621 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:02.621 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.621 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.621 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6808", 2024-09-19T09:20:02.621 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:02.621 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.621 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.621 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.621 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6809", 2024-09-19T09:20:02.621 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:02.622 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.622 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.622 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:02.622 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.622 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.622 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6810", 2024-09-19T09:20:02.622 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:02.622 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.622 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.622 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.622 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6811", 2024-09-19T09:20:02.622 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:02.623 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.623 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.623 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:02.623 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.623 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.623 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6814", 2024-09-19T09:20:02.623 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:02.623 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.623 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.623 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.623 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6815", 2024-09-19T09:20:02.623 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:02.623 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.624 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.624 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:02.624 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.624 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.624 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6812", 2024-09-19T09:20:02.624 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:02.624 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.624 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.624 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.624 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6813", 2024-09-19T09:20:02.624 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:02.624 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.625 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.625 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6809/2596207948", 2024-09-19T09:20:02.625 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6811/2596207948", 2024-09-19T09:20:02.625 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6815/2596207948", 2024-09-19T09:20:02.625 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6813/2596207948", 2024-09-19T09:20:02.625 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:02.625 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:02.625 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:02.625 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.625 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.625 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.625 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:20:02.625 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:02.626 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:02.626 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:02.626 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:02.626 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:02.626 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:02.626 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:02.626 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:02.626 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:02.626 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:02.626 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:02.626 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:02.626 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.626 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.627 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.627 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6816", 2024-09-19T09:20:02.627 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:02.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.627 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.627 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6817", 2024-09-19T09:20:02.627 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:02.627 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.627 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.627 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.627 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:02.627 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.627 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.628 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.628 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6818", 2024-09-19T09:20:02.628 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:02.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.628 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.628 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6819", 2024-09-19T09:20:02.628 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:02.628 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.628 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.628 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.628 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:02.628 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.628 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.629 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.629 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6823", 2024-09-19T09:20:02.629 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:02.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.629 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.629 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.629 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6825", 2024-09-19T09:20:02.629 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:02.629 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.629 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.629 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.629 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:02.629 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:02.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.630 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:02.630 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6820", 2024-09-19T09:20:02.630 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:02.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.630 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.630 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:02.630 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6821", 2024-09-19T09:20:02.630 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:02.630 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.630 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.630 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.630 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6817/1334618296", 2024-09-19T09:20:02.630 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6819/1334618296", 2024-09-19T09:20:02.631 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6825/1334618296", 2024-09-19T09:20:02.631 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6821/1334618296", 2024-09-19T09:20:02.631 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:02.631 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:02.631 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:02.631 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:02.631 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.631 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:20:02.631 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-19T09:20:02.631 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.631 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:20:02.631 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:02.631 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:02.632 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:02.632 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:02.632 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:02.632 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.580838+0000", 2024-09-19T09:20:02.632 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:02.632 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.632 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.632 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:20:02.632 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:02.632 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:02.632 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:02.632 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:02.632 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:02.632 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.599990+0000", 2024-09-19T09:20:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:20:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.503722+0000", 2024-09-19T09:20:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.633 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:20:02.634 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:02.634 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:02.634 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:02.634 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:02.634 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:02.634 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.607846+0000", 2024-09-19T09:20:02.634 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:02.634 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.634 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.634 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:20:02.634 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:02.634 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:02.634 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:02.634 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:02.634 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:02.635 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.616858+0000", 2024-09-19T09:20:02.635 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:02.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.635 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:20:02.635 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:02.635 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:02.635 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:02.635 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:02.635 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:02.635 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.542726+0000", 2024-09-19T09:20:02.635 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:02.635 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.635 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.635 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:20:02.636 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:02.636 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:02.636 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:02.636 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:02.636 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:02.636 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.534178+0000", 2024-09-19T09:20:02.636 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:02.636 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.636 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:02.636 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:20:02.636 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:02.636 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:02.636 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:02.636 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:02.637 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:02.637 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.612105+0000", 2024-09-19T09:20:02.637 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:02.637 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.637 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:20:02.637 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-19T09:20:02.637 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-19T09:20:02.637 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-19T09:20:02.637 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-19T09:20:02.637 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-19T09:20:02.637 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-19T09:20:02.637 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-19T09:20:02.637 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-19T09:20:02.637 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-19T09:20:02.638 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-19T09:20:02.638 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-19T09:20:02.638 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-19T09:20:02.638 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-19T09:20:02.638 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-19T09:20:02.638 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.638 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:02.638 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-19T09:20:02.638 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-19T09:20:02.638 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-19T09:20:02.638 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-19T09:20:02.638 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-19T09:20:02.638 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-19T09:20:02.638 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-19T09:20:02.639 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-19T09:20:02.639 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-19T09:20:02.639 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-19T09:20:02.639 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-19T09:20:02.639 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:02.639 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:20:02.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.563+0000 7fcafb84c640 1 -- 172.21.15.18:0/1970965674 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcad806c2b0 msgr2=0x7fcad806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:02.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.563+0000 7fcafb84c640 1 --2- 172.21.15.18:0/1970965674 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcad806c2b0 0x7fcad806e770 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fcaf0034000 tx=0x7fcaf002e000 comp rx=0 tx=0).stop 2024-09-19T09:20:02.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.563+0000 7fcafb84c640 1 -- 172.21.15.18:0/1970965674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcaf40b68e0 msgr2=0x7fcaf41554f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:02.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.563+0000 7fcafb84c640 1 --2- 172.21.15.18:0/1970965674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcaf40b68e0 0x7fcaf41554f0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fcae400c4b0 tx=0x7fcae400c970 comp rx=0 tx=0).stop 2024-09-19T09:20:02.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.563+0000 7fcafb84c640 1 -- 172.21.15.18:0/1970965674 shutdown_connections 2024-09-19T09:20:02.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.563+0000 7fcafb84c640 1 --2- 172.21.15.18:0/1970965674 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcad806c2b0 0x7fcad806e770 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.563+0000 7fcafb84c640 1 --2- 172.21.15.18:0/1970965674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcaf415ca00 0x7fcaf4152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.563+0000 7fcafb84c640 1 --2- 172.21.15.18:0/1970965674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcaf40b68e0 0x7fcaf41554f0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.563+0000 7fcafb84c640 1 --2- 172.21.15.18:0/1970965674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcaf406bc10 0x7fcaf41f6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:02.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.563+0000 7fcafb84c640 1 -- 172.21.15.18:0/1970965674 >> 172.21.15.18:0/1970965674 conn(0x7fcaf40d1970 msgr2=0x7fcaf40d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:02.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.563+0000 7fcafb84c640 1 -- 172.21.15.18:0/1970965674 shutdown_connections 2024-09-19T09:20:02.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:02.563+0000 7fcafb84c640 1 -- 172.21.15.18:0/1970965674 wait complete. 2024-09-19T09:20:02.642 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-19T09:20:07.643 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-19T09:20:07.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.759+0000 7f4e29b68640 1 Processor -- start 2024-09-19T09:20:07.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.759+0000 7f4e29b68640 1 -- start start 2024-09-19T09:20:07.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.760+0000 7f4e29b68640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e24160c50 0x7f4e24167680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:07.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.760+0000 7f4e29b68640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e24142650 con 0x7f4e2413fae0 2024-09-19T09:20:07.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.760+0000 7f4e29b68640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e24142930 con 0x7f4e24142150 2024-09-19T09:20:07.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.760+0000 7f4e29b68640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4e240ce780 con 0x7f4e24160c50 2024-09-19T09:20:07.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.760+0000 7f4e237fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f4e2413fae0 0x7f4e2406f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59402/0 (socket says 172.21.15.18:59402) 2024-09-19T09:20:07.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.760+0000 7f4e237fe640 1 -- 172.21.15.18:0/1728564114 learned_addr learned my addr 172.21.15.18:0/1728564114 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:20:07.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.760+0000 7f4e227fc640 1 -- 172.21.15.18:0/1728564114 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1779207374 0 0) 0x7f4e24142650 con 0x7f4e2413fae0 2024-09-19T09:20:07.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.760+0000 7f4e23fff640 1 --2- 172.21.15.18:0/1728564114 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e24160c50 0x7f4e24167680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:07.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.760+0000 7f4e227fc640 1 -- 172.21.15.18:0/1728564114 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e0c003520 con 0x7f4e2413fae0 2024-09-19T09:20:07.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.761+0000 7f4e227fc640 1 -- 172.21.15.18:0/1728564114 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 358390514 0 0) 0x7f4e0c003520 con 0x7f4e2413fae0 2024-09-19T09:20:07.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.761+0000 7f4e227fc640 1 -- 172.21.15.18:0/1728564114 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e24160c50 msgr2=0x7f4e24167680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:07.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.761+0000 7f4e227fc640 1 --2- 172.21.15.18:0/1728564114 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e24160c50 0x7f4e24167680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.761+0000 7f4e227fc640 1 -- 172.21.15.18:0/1728564114 >> v1:172.21.15.162:6789/0 conn(0x7f4e24142150 legacy=0x7f4e24160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:07.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.761+0000 7f4e227fc640 1 -- 172.21.15.18:0/1728564114 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e24142c10 con 0x7f4e2413fae0 2024-09-19T09:20:07.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.761+0000 7f4e227fc640 1 -- 172.21.15.18:0/1728564114 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f4e14001670 con 0x7f4e2413fae0 2024-09-19T09:20:07.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.761+0000 7f4e227fc640 1 -- 172.21.15.18:0/1728564114 >> v1:172.21.15.18:6789/0 conn(0x7f4e2413fae0 legacy=0x7f4e2406f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:07.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.761+0000 7f4e227fc640 1 --2- 172.21.15.18:0/1728564114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e0c0039e0 0x7f4e0c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:07.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.761+0000 7f4e227fc640 1 --2- 172.21.15.18:0/1728564114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e0c004800 0x7f4e0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:07.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.761+0000 7f4e227fc640 1 --2- 172.21.15.18:0/1728564114 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e24160c50 0x7f4e0c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:07.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.761+0000 7f4e227fc640 1 -- 172.21.15.18:0/1728564114 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0c00baf0 con 0x7f4e0c004800 2024-09-19T09:20:07.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.761+0000 7f4e227fc640 1 -- 172.21.15.18:0/1728564114 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0c00bca0 con 0x7f4e0c0039e0 2024-09-19T09:20:07.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.761+0000 7f4e227fc640 1 -- 172.21.15.18:0/1728564114 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4e0c00bea0 con 0x7f4e24160c50 2024-09-19T09:20:07.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.761+0000 7f4e22ffd640 1 --2- 172.21.15.18:0/1728564114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e0c004800 0x7f4e0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:07.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.761+0000 7f4e237fe640 1 --2- 172.21.15.18:0/1728564114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e0c0039e0 0x7f4e0c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:07.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.761+0000 7f4e23fff640 1 --2- 172.21.15.18:0/1728564114 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e24160c50 0x7f4e0c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:07.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.761+0000 7f4e22ffd640 1 -- 172.21.15.18:0/1728564114 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e24160c50 msgr2=0x7f4e0c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:07.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.761+0000 7f4e22ffd640 1 --2- 172.21.15.18:0/1728564114 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e24160c50 0x7f4e0c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.761+0000 7f4e22ffd640 1 -- 172.21.15.18:0/1728564114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e0c0039e0 msgr2=0x7f4e0c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:07.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.761+0000 7f4e22ffd640 1 --2- 172.21.15.18:0/1728564114 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e0c0039e0 0x7f4e0c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.761+0000 7f4e22ffd640 1 -- 172.21.15.18:0/1728564114 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0c003520 con 0x7f4e0c004800 2024-09-19T09:20:07.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.762+0000 7f4e22ffd640 1 --2- 172.21.15.18:0/1728564114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e0c004800 0x7f4e0c004c80 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f4e18001750 tx=0x7f4e0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e38f5e522639e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:07.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.762+0000 7f4e227fc640 1 -- 172.21.15.18:0/1728564114 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e18001370 con 0x7f4e0c004800 2024-09-19T09:20:07.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.762+0000 7f4e227fc640 1 -- 172.21.15.18:0/1728564114 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e180052d0 con 0x7f4e0c004800 2024-09-19T09:20:07.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.762+0000 7f4e227fc640 1 -- 172.21.15.18:0/1728564114 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1802abe0 con 0x7f4e0c004800 2024-09-19T09:20:07.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.763+0000 7f4e29b68640 1 -- 172.21.15.18:0/1728564114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e0c004800 msgr2=0x7f4e0c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:07.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.763+0000 7f4e29b68640 1 --2- 172.21.15.18:0/1728564114 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e0c004800 0x7f4e0c004c80 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f4e18001750 tx=0x7f4e0c005830 comp rx=0 tx=0).stop 2024-09-19T09:20:07.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.763+0000 7f4e23fff640 1 -- 172.21.15.18:0/1728564114 reap_dead start 2024-09-19T09:20:07.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.763+0000 7f4e29b68640 1 -- 172.21.15.18:0/1728564114 shutdown_connections 2024-09-19T09:20:07.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.763+0000 7f4e29b68640 1 -- 172.21.15.18:0/1728564114 >> 172.21.15.18:0/1728564114 conn(0x7f4e2406bc10 msgr2=0x7f4e2406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:07.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.763+0000 7f4e29b68640 1 -- 172.21.15.18:0/1728564114 shutdown_connections 2024-09-19T09:20:07.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.763+0000 7f4e29b68640 1 -- 172.21.15.18:0/1728564114 wait complete. 2024-09-19T09:20:07.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.764+0000 7f4e29b68640 1 Processor -- start 2024-09-19T09:20:07.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.764+0000 7f4e29b68640 1 -- start start 2024-09-19T09:20:07.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.765+0000 7f4e29b68640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e0c004800 0x7f4e2413e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:07.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.765+0000 7f4e29b68640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e24145310 0x7f4e241f3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:07.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.765+0000 7f4e29b68640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e241f3d50 0x7f4e24145ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:07.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.765+0000 7f4e29b68640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4e240cfda0 con 0x7f4e0c004800 2024-09-19T09:20:07.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.765+0000 7f4e29b68640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4e240cfc20 con 0x7f4e241f3d50 2024-09-19T09:20:07.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.765+0000 7f4e29b68640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4e240cff20 con 0x7f4e24145310 2024-09-19T09:20:07.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.765+0000 7f4e237fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e0c004800 0x7f4e2413e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:07.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.765+0000 7f4e237fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e0c004800 0x7f4e2413e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38560/0 (socket says 172.21.15.18:38560) 2024-09-19T09:20:07.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.765+0000 7f4e237fe640 1 -- 172.21.15.18:0/2157157840 learned_addr learned my addr 172.21.15.18:0/2157157840 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:07.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.765+0000 7f4e22ffd640 1 --2- 172.21.15.18:0/2157157840 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e24145310 0x7f4e241f3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:07.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.765+0000 7f4e23fff640 1 --2- 172.21.15.18:0/2157157840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e241f3d50 0x7f4e24145ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:07.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.766+0000 7f4e237fe640 1 -- 172.21.15.18:0/2157157840 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e24145310 msgr2=0x7f4e241f3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:07.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.766+0000 7f4e237fe640 1 --2- 172.21.15.18:0/2157157840 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e24145310 0x7f4e241f3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.766+0000 7f4e237fe640 1 -- 172.21.15.18:0/2157157840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e241f3d50 msgr2=0x7f4e24145ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:07.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.766+0000 7f4e237fe640 1 --2- 172.21.15.18:0/2157157840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e241f3d50 0x7f4e24145ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:07.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.766+0000 7f4e237fe640 1 -- 172.21.15.18:0/2157157840 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e2415b070 con 0x7f4e0c004800 2024-09-19T09:20:07.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.766+0000 7f4e23fff640 1 --2- 172.21.15.18:0/2157157840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e241f3d50 0x7f4e24145ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:07.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.766+0000 7f4e237fe640 1 --2- 172.21.15.18:0/2157157840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e0c004800 0x7f4e2413e540 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f4e14007340 tx=0x7f4e14007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:07.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.766+0000 7f4e0bfff640 1 -- 172.21.15.18:0/2157157840 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1400f8c0 con 0x7f4e0c004800 2024-09-19T09:20:07.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.766+0000 7f4e0bfff640 1 -- 172.21.15.18:0/2157157840 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e14018070 con 0x7f4e0c004800 2024-09-19T09:20:07.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.766+0000 7f4e0bfff640 1 -- 172.21.15.18:0/2157157840 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1400fca0 con 0x7f4e0c004800 2024-09-19T09:20:07.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.766+0000 7f4e29b68640 1 -- 172.21.15.18:0/2157157840 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e2415b350 con 0x7f4e0c004800 2024-09-19T09:20:07.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.766+0000 7f4e29b68640 1 -- 172.21.15.18:0/2157157840 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e2415b910 con 0x7f4e0c004800 2024-09-19T09:20:07.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.767+0000 7f4e29b68640 1 -- 172.21.15.18:0/2157157840 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e24160540 con 0x7f4e0c004800 2024-09-19T09:20:07.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.768+0000 7f4e0bfff640 1 -- 172.21.15.18:0/2157157840 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4e1401d460 con 0x7f4e0c004800 2024-09-19T09:20:07.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.768+0000 7f4e0bfff640 1 --2- 172.21.15.18:0/2157157840 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4e1006c2b0 0x7f4e1006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:07.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.768+0000 7f4e0bfff640 1 -- 172.21.15.18:0/2157157840 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5709+0+0 (secure 0 0 0) 0x7f4e1408b390 con 0x7f4e0c004800 2024-09-19T09:20:07.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.768+0000 7f4e0bfff640 1 -- 172.21.15.18:0/2157157840 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=141}) -- 0x7f4e10073e40 con 0x7f4e0c004800 2024-09-19T09:20:07.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.768+0000 7f4e22ffd640 1 --2- 172.21.15.18:0/2157157840 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4e1006c2b0 0x7f4e1006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:07.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.769+0000 7f4e22ffd640 1 --2- 172.21.15.18:0/2157157840 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4e1006c2b0 0x7f4e1006e770 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4e18032000 tx=0x7f4e1802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:07.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.773+0000 7f4e0bfff640 1 -- 172.21.15.18:0/2157157840 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f4e14059b90 con 0x7f4e0c004800 2024-09-19T09:20:07.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.950+0000 7f4e29b68640 1 -- 172.21.15.18:0/2157157840 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f4e2415ed40 con 0x7f4e0c004800 2024-09-19T09:20:07.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.951+0000 7f4e0bfff640 1 -- 172.21.15.18:0/2157157840 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v140) ==== 81+0+34313 (secure 0 0 0) 0x7f4e14059490 con 0x7f4e0c004800 2024-09-19T09:20:07.952 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:20:07.952 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:20:07.952 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 140, 2024-09-19T09:20:07.952 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:20:07.952 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-19T09:13:11.348786+0000", 2024-09-19T09:20:07.952 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-19T09:19:56.224151+0000", 2024-09-19T09:20:07.953 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-19T09:13:16.423937+0000", 2024-09-19T09:20:07.953 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-19T09:13:13.417141+0000", 2024-09-19T09:20:07.953 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-19T09:20:07.953 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-09-19T09:20:07.953 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-19T09:20:07.953 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-19T09:20:07.953 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-19T09:20:07.953 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-19T09:20:07.953 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-19T09:20:07.953 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:20:07.953 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-19T09:20:07.953 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.69999998807907104, 2024-09-19T09:20:07.953 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-19T09:20:07.953 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-19T09:20:07.954 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-19T09:20:07.954 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 17, 2024-09-19T09:20:07.954 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-19T09:20:07.954 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-19T09:20:07.954 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "jewel", 2024-09-19T09:20:07.954 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-19T09:20:07.954 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-19T09:20:07.954 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-19T09:20:07.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.954 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-19T09:20:07.954 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-19T09:20:07.954 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:13:17.564717+0000", 2024-09-19T09:20:07.954 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:20:07.955 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:20:07.955 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:20:07.955 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:20:07.955 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:20:07.955 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:20:07.955 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:20:07.955 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:20:07.955 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:20:07.955 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:20:07.955 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:20:07.955 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:20:07.955 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:20:07.955 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-19T09:20:07.955 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-19T09:20:07.956 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-19T09:20:07.956 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-19T09:20:07.956 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-19T09:20:07.956 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:20:07.956 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:20:07.956 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:20:07.956 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:20:07.956 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:20:07.956 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:20:07.956 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:20:07.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.956 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "111", 2024-09-19T09:20:07.956 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:20:07.956 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:20:07.957 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:20:07.957 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:20:07.957 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:20:07.957 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:20:07.957 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:20:07.957 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:20:07.957 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:20:07.957 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:20:07.957 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:20:07.957 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:20:07.957 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:20:07.957 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:20:07.957 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:20:07.958 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:20:07.958 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:20:07.958 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:20:07.958 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:20:07.958 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:20:07.958 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:20:07.958 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:20:07.958 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:20:07.958 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:20:07.958 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:20:07.958 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:20:07.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.958 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:20:07.959 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:20:07.959 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:20:07.959 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:20:07.959 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:20:07.959 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:20:07.959 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:20:07.959 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:20:07.959 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:20:07.959 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:20:07.959 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:20:07.959 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:20:07.959 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-19T09:20:07.959 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-19T09:20:07.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.960 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:20:07.960 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-19T09:20:07.960 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.960 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:20:07.960 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:20:07.960 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-19T09:20:07.960 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-19T09:20:07.960 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-19T09:20:07.960 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-19T09:20:07.960 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-19T09:20:07.960 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:20:07.960 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:20:07.960 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:20:07.960 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:07.961 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.961 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.961 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 16, 2024-09-19T09:20:07.961 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_metadata", 2024-09-19T09:20:07.961 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:19:38.333262+0000", 2024-09-19T09:20:07.961 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:20:07.961 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:20:07.961 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:20:07.961 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:20:07.961 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:20:07.961 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:20:07.961 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:20:07.961 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:20:07.961 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:20:07.962 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:20:07.962 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:20:07.962 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:20:07.962 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:20:07.962 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-19T09:20:07.962 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-19T09:20:07.962 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-19T09:20:07.962 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-19T09:20:07.962 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-19T09:20:07.962 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:20:07.962 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:20:07.962 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:20:07.962 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:20:07.962 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:20:07.963 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:20:07.963 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:20:07.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.963 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "137", 2024-09-19T09:20:07.963 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:20:07.963 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:20:07.963 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:20:07.963 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:20:07.963 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:20:07.963 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:20:07.963 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:20:07.963 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:20:07.963 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:20:07.963 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:20:07.964 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:20:07.964 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:20:07.964 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:20:07.964 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:20:07.964 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:20:07.964 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:20:07.964 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:20:07.964 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:20:07.964 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:20:07.964 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:20:07.964 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:20:07.964 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:20:07.964 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:20:07.965 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:20:07.965 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:20:07.965 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:20:07.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.965 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:20:07.965 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:20:07.965 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:20:07.965 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:20:07.965 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:20:07.965 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:20:07.965 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:20:07.965 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:20:07.965 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:20:07.965 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:20:07.966 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:20:07.966 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:20:07.966 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4, 2024-09-19T09:20:07.966 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 16, 2024-09-19T09:20:07.966 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_priority": 5 2024-09-19T09:20:07.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.966 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:20:07.966 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:20:07.966 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": "cephfs" 2024-09-19T09:20:07.966 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:07.966 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.966 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:20:07.966 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:20:07.966 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 2.25, 2024-09-19T09:20:07.967 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 2.25, 2024-09-19T09:20:07.967 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:20:07.967 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2.25, 2024-09-19T09:20:07.967 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2.25, 2024-09-19T09:20:07.967 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:20:07.967 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:20:07.967 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:20:07.967 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:07.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.967 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 17, 2024-09-19T09:20:07.967 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_data", 2024-09-19T09:20:07.967 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:19:38.727884+0000", 2024-09-19T09:20:07.968 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1027, 2024-09-19T09:20:07.968 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-19T09:20:07.968 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:20:07.968 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:20:07.968 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:20:07.968 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:20:07.968 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:20:07.968 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:20:07.968 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:20:07.968 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:20:07.968 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:20:07.968 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:20:07.968 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:20:07.968 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 64, 2024-09-19T09:20:07.969 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 64, 2024-09-19T09:20:07.969 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 64, 2024-09-19T09:20:07.969 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 64, 2024-09-19T09:20:07.969 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 64, 2024-09-19T09:20:07.969 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:20:07.969 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:20:07.969 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:20:07.969 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:20:07.969 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:20:07.969 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:20:07.969 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:20:07.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.969 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "140", 2024-09-19T09:20:07.969 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:20:07.970 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:20:07.970 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:20:07.970 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:20:07.970 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:20:07.970 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:20:07.970 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:20:07.970 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:20:07.970 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:20:07.970 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 33554432, 2024-09-19T09:20:07.970 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:20:07.970 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:20:07.970 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:20:07.970 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:20:07.970 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:20:07.971 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:20:07.971 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:20:07.971 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:20:07.971 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:20:07.971 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:20:07.971 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:20:07.971 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:20:07.971 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:20:07.971 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:20:07.971 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:20:07.971 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:20:07.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.971 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:20:07.971 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:20:07.971 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:20:07.972 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:20:07.972 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:20:07.972 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:20:07.972 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:20:07.972 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:20:07.972 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:20:07.972 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:20:07.972 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:20:07.972 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:20:07.972 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 64, 2024-09-19T09:20:07.972 INFO:teuthology.orchestra.run.smithi018.stdout: "target_size_ratio": 0.89999997615814209 2024-09-19T09:20:07.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.972 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:20:07.973 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:20:07.973 INFO:teuthology.orchestra.run.smithi018.stdout: "data": "cephfs" 2024-09-19T09:20:07.973 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:07.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.973 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:20:07.973 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:20:07.973 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.3799999952316284, 2024-09-19T09:20:07.973 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.3799999952316284, 2024-09-19T09:20:07.973 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:20:07.973 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-19T09:20:07.973 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-19T09:20:07.973 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:20:07.973 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:20:07.973 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:20:07.974 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:07.974 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:07.974 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:20:07.974 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-19T09:20:07.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.974 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:20:07.974 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:07.974 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:07.974 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:07.974 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:07.974 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:07.974 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:07.974 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:07.974 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:07.975 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:07.975 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:07.975 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:07.975 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:07.975 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:07.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.975 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:07.975 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-19T09:20:07.975 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:07.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.975 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:07.975 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-19T09:20:07.975 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:07.975 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:07.976 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:07.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.976 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:07.976 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:07.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.976 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:07.976 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-19T09:20:07.976 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:07.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.976 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:07.976 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-19T09:20:07.976 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:07.977 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:07.977 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:07.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.977 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:07.977 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:07.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.977 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:07.977 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-19T09:20:07.977 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:07.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.977 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:07.978 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-19T09:20:07.978 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:07.978 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:07.978 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:07.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.978 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:07.978 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:07.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.978 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:07.978 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-19T09:20:07.978 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:07.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.978 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:07.979 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-19T09:20:07.979 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:07.979 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:07.979 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:07.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.979 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/128722874", 2024-09-19T09:20:07.979 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/128722874", 2024-09-19T09:20:07.979 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/128722874", 2024-09-19T09:20:07.979 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/128722874", 2024-09-19T09:20:07.979 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:07.979 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:07.979 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:07.979 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:07.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.980 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:20:07.980 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:07.980 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:07.980 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:07.980 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:07.980 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:07.980 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:07.980 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:07.980 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:07.980 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:07.980 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:07.980 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:07.980 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:07.981 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:07.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.981 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:07.981 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-19T09:20:07.981 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:07.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.981 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:07.981 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-19T09:20:07.981 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:07.981 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:07.981 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:07.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.981 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:07.982 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:07.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.982 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:07.982 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-19T09:20:07.982 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:07.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.982 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.982 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:07.982 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-19T09:20:07.982 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:07.982 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:07.982 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:07.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.982 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:07.983 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:07.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.983 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:07.983 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-19T09:20:07.983 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:07.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.983 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:07.983 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-19T09:20:07.983 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:07.983 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:07.983 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:07.983 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.983 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:07.984 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:07.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.984 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:07.984 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-19T09:20:07.984 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:07.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.984 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:07.984 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-19T09:20:07.984 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:07.984 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:07.984 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:07.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.984 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/3672199638", 2024-09-19T09:20:07.985 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/3672199638", 2024-09-19T09:20:07.985 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/3672199638", 2024-09-19T09:20:07.985 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/3672199638", 2024-09-19T09:20:07.985 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:07.985 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:07.985 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:07.985 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:07.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.985 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:20:07.985 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:07.985 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:07.985 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:07.985 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:07.986 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:07.986 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:07.986 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:07.986 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:07.986 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:07.986 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:07.986 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:07.986 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:07.986 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:07.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.986 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:07.986 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T09:20:07.986 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:07.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.987 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:07.987 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T09:20:07.987 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:07.987 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:07.987 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:07.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.987 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:07.987 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:07.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.987 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:07.987 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-19T09:20:07.987 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:07.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.988 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:07.988 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-19T09:20:07.988 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:07.988 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:07.988 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:07.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.988 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:07.988 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:07.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.988 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:07.988 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-19T09:20:07.988 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:07.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.989 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:07.989 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-19T09:20:07.989 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:07.989 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:07.989 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:07.989 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.989 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:07.989 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:07.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.989 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:07.989 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-19T09:20:07.989 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:07.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.990 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:07.990 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-19T09:20:07.990 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:07.990 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:07.990 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:07.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.990 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3463367841", 2024-09-19T09:20:07.990 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3463367841", 2024-09-19T09:20:07.990 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3463367841", 2024-09-19T09:20:07.990 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3463367841", 2024-09-19T09:20:07.990 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:07.990 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:07.991 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:07.991 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:07.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.991 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:20:07.991 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:07.991 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:07.991 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:07.991 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:07.991 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:07.991 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:07.991 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:07.991 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:07.992 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:07.992 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:07.992 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:07.992 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:07.992 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:07.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.992 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:07.992 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-19T09:20:07.992 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:07.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.992 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:07.992 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-19T09:20:07.992 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:07.993 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:07.993 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:07.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.993 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:07.993 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:07.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.993 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:07.993 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-19T09:20:07.993 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:07.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.993 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:07.993 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-19T09:20:07.993 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:07.993 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:07.994 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:07.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.994 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:07.994 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:07.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.994 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:07.994 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-19T09:20:07.994 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:07.994 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.994 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:07.994 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-19T09:20:07.994 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:07.994 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:07.995 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:07.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.995 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:07.995 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:07.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.995 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:07.995 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-19T09:20:07.995 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:07.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.995 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:07.995 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-19T09:20:07.995 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:07.995 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:07.996 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:07.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.996 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/4163178582", 2024-09-19T09:20:07.996 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/4163178582", 2024-09-19T09:20:07.996 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/4163178582", 2024-09-19T09:20:07.996 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/4163178582", 2024-09-19T09:20:07.996 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:07.996 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:07.996 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:07.996 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:07.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.997 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:20:07.997 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:07.997 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:07.997 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:07.997 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:07.997 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:07.997 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:07.997 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:07.997 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:07.997 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:07.997 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:07.997 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:07.998 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:07.998 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:07.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.998 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:07.998 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6822", 2024-09-19T09:20:07.998 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:07.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.998 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:07.998 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6824", 2024-09-19T09:20:07.998 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:07.998 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:07.998 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:07.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.998 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:07.999 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:07.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.999 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:07.999 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6826", 2024-09-19T09:20:07.999 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:07.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:07.999 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:07.999 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6827", 2024-09-19T09:20:07.999 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:07.999 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:07.999 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:07.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:07.999 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:08.000 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:08.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.000 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:08.000 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6830", 2024-09-19T09:20:08.000 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:08.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.000 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.000 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:08.000 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6831", 2024-09-19T09:20:08.000 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:08.000 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:08.000 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:08.000 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.001 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:08.001 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:08.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.001 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:08.001 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6828", 2024-09-19T09:20:08.001 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:08.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.001 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.001 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:08.001 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6829", 2024-09-19T09:20:08.001 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:08.001 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:08.001 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:08.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.002 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6824/3538482215", 2024-09-19T09:20:08.002 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6827/3538482215", 2024-09-19T09:20:08.002 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6831/3538482215", 2024-09-19T09:20:08.002 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6829/3538482215", 2024-09-19T09:20:08.002 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:08.002 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:08.002 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:08.002 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:08.002 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.002 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.002 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:20:08.002 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:08.002 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:08.002 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:08.003 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:08.003 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:08.003 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:08.003 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:08.003 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:08.003 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:08.003 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:08.003 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:08.003 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:08.003 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:08.003 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.003 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:08.003 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6800", 2024-09-19T09:20:08.003 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:08.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.004 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:08.004 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6801", 2024-09-19T09:20:08.004 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:08.004 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:08.004 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:08.004 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.004 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:08.004 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:08.004 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.004 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:08.004 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6802", 2024-09-19T09:20:08.004 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:08.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.005 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:08.005 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6803", 2024-09-19T09:20:08.005 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:08.005 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:08.005 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:08.005 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.005 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:08.005 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:08.005 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.005 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:08.005 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6806", 2024-09-19T09:20:08.006 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:08.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.006 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:08.006 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6807", 2024-09-19T09:20:08.006 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:08.006 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:08.006 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:08.006 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.006 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:08.006 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:08.006 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.006 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:08.006 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6804", 2024-09-19T09:20:08.007 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:08.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.007 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.007 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:08.007 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6805", 2024-09-19T09:20:08.007 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:08.007 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:08.007 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:08.007 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.007 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6801/2408698413", 2024-09-19T09:20:08.007 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6803/2408698413", 2024-09-19T09:20:08.007 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6807/2408698413", 2024-09-19T09:20:08.007 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6805/2408698413", 2024-09-19T09:20:08.008 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:08.008 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:08.008 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:08.008 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:08.008 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.008 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.008 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:20:08.008 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:08.008 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:08.008 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:08.008 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:08.008 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:08.008 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:08.009 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:08.009 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:08.009 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:08.009 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:08.009 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:08.009 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:08.009 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:08.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.009 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:08.009 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6808", 2024-09-19T09:20:08.009 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:08.009 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.009 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.009 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:08.010 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6809", 2024-09-19T09:20:08.010 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:08.010 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:08.010 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:08.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.010 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:08.010 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:08.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.010 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:08.010 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6810", 2024-09-19T09:20:08.010 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:08.010 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.010 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.010 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:08.011 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6811", 2024-09-19T09:20:08.011 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:08.011 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:08.011 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:08.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.011 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:08.011 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:08.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.011 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:08.011 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6814", 2024-09-19T09:20:08.011 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:08.011 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.011 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.011 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:08.012 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6815", 2024-09-19T09:20:08.012 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:08.012 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:08.012 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:08.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.012 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:08.012 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:08.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.012 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:08.012 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6812", 2024-09-19T09:20:08.012 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:08.012 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.012 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.013 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:08.013 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6813", 2024-09-19T09:20:08.013 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:08.013 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:08.013 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:08.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.013 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6809/2596207948", 2024-09-19T09:20:08.013 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6811/2596207948", 2024-09-19T09:20:08.013 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6815/2596207948", 2024-09-19T09:20:08.013 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6813/2596207948", 2024-09-19T09:20:08.013 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:08.013 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:08.013 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:08.013 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:08.013 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.014 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.014 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:20:08.014 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:08.014 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:08.014 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:08.014 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:08.014 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:08.014 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:08.014 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:08.014 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:08.014 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:08.014 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:08.014 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:08.014 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:08.015 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:08.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.015 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:08.015 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6816", 2024-09-19T09:20:08.015 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:08.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.015 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.015 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:08.015 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6817", 2024-09-19T09:20:08.015 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:08.015 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:08.015 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:08.015 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.015 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:08.016 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:08.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.016 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:08.016 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6818", 2024-09-19T09:20:08.016 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:08.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.016 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.016 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:08.016 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6819", 2024-09-19T09:20:08.016 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:08.016 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:08.016 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:08.016 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.016 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:08.017 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:08.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.017 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:08.017 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6823", 2024-09-19T09:20:08.017 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:08.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.017 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.017 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:08.017 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6825", 2024-09-19T09:20:08.017 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:08.017 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:08.017 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:08.017 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.017 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:08.017 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6820", 2024-09-19T09:20:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6821", 2024-09-19T09:20:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6817/1334618296", 2024-09-19T09:20:08.019 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6819/1334618296", 2024-09-19T09:20:08.019 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6825/1334618296", 2024-09-19T09:20:08.019 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6821/1334618296", 2024-09-19T09:20:08.019 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:08.019 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:08.019 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:08.019 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:08.019 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:08.019 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:20:08.019 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-19T09:20:08.019 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.019 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:20:08.019 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:08.019 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:08.019 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:08.020 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:08.020 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:08.020 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.580838+0000", 2024-09-19T09:20:08.020 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:08.020 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.020 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.020 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:20:08.020 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:08.020 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:08.020 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:08.020 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:08.020 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:08.020 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.599990+0000", 2024-09-19T09:20:08.021 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:08.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.021 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:20:08.021 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:08.021 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:08.021 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:08.021 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:08.021 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:08.021 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.503722+0000", 2024-09-19T09:20:08.021 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:08.021 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.021 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.021 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:20:08.021 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:08.022 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:08.022 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:08.022 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:08.022 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:08.022 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.607846+0000", 2024-09-19T09:20:08.022 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:08.022 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.022 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.022 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:20:08.022 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:08.023 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:08.023 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:08.023 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:08.023 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:08.023 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.616858+0000", 2024-09-19T09:20:08.023 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:08.023 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.023 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.023 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:20:08.023 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:08.023 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:08.023 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:08.023 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:08.024 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:08.024 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.542726+0000", 2024-09-19T09:20:08.024 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:08.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.024 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.024 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:20:08.024 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:08.024 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:08.024 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:08.024 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:08.024 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:08.024 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.534178+0000", 2024-09-19T09:20:08.024 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:08.024 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.025 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:08.025 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:20:08.025 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:08.025 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:08.025 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:08.025 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:08.025 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:08.025 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.612105+0000", 2024-09-19T09:20:08.025 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:08.025 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:08.025 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:20:08.025 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-19T09:20:08.025 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-19T09:20:08.026 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-19T09:20:08.026 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-19T09:20:08.026 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-19T09:20:08.026 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-19T09:20:08.026 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-19T09:20:08.026 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-19T09:20:08.026 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-19T09:20:08.026 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-19T09:20:08.026 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-19T09:20:08.026 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-19T09:20:08.026 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-19T09:20:08.026 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-19T09:20:08.026 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:08.026 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:08.027 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-19T09:20:08.027 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-19T09:20:08.027 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-19T09:20:08.027 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-19T09:20:08.027 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-19T09:20:08.027 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-19T09:20:08.027 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-19T09:20:08.027 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-19T09:20:08.027 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-19T09:20:08.027 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-19T09:20:08.027 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-19T09:20:08.027 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:08.027 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:20:08.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.953+0000 7f4e29b68640 1 -- 172.21.15.18:0/2157157840 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4e1006c2b0 msgr2=0x7f4e1006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:08.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.953+0000 7f4e29b68640 1 --2- 172.21.15.18:0/2157157840 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4e1006c2b0 0x7f4e1006e770 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4e18032000 tx=0x7f4e1802e000 comp rx=0 tx=0).stop 2024-09-19T09:20:08.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.953+0000 7f4e29b68640 1 -- 172.21.15.18:0/2157157840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e0c004800 msgr2=0x7f4e2413e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:08.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.953+0000 7f4e29b68640 1 --2- 172.21.15.18:0/2157157840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e0c004800 0x7f4e2413e540 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f4e14007340 tx=0x7f4e14007800 comp rx=0 tx=0).stop 2024-09-19T09:20:08.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.953+0000 7f4e29b68640 1 -- 172.21.15.18:0/2157157840 shutdown_connections 2024-09-19T09:20:08.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.953+0000 7f4e29b68640 1 --2- 172.21.15.18:0/2157157840 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4e1006c2b0 0x7f4e1006e770 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:08.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.953+0000 7f4e29b68640 1 --2- 172.21.15.18:0/2157157840 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e241f3d50 0x7f4e24145ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:08.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.953+0000 7f4e29b68640 1 --2- 172.21.15.18:0/2157157840 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e24145310 0x7f4e241f3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:08.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.953+0000 7f4e29b68640 1 --2- 172.21.15.18:0/2157157840 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e0c004800 0x7f4e2413e540 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:08.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.953+0000 7f4e29b68640 1 -- 172.21.15.18:0/2157157840 >> 172.21.15.18:0/2157157840 conn(0x7f4e2406bc10 msgr2=0x7f4e240b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:08.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.953+0000 7f4e29b68640 1 -- 172.21.15.18:0/2157157840 shutdown_connections 2024-09-19T09:20:08.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:07.953+0000 7f4e29b68640 1 -- 172.21.15.18:0/2157157840 wait complete. 2024-09-19T09:20:08.031 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-19T09:20:13.031 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-19T09:20:13.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.146+0000 7f7b74c06640 1 Processor -- start 2024-09-19T09:20:13.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.146+0000 7f7b74c06640 1 -- start start 2024-09-19T09:20:13.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.147+0000 7f7b74c06640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7b7015ed50 0x7f7b700d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:13.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.147+0000 7f7b74c06640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b700d31b0 con 0x7f7b700d09d0 2024-09-19T09:20:13.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.147+0000 7f7b74c06640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b700d3490 con 0x7f7b700d1aa0 2024-09-19T09:20:13.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.147+0000 7f7b74c06640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f7b700d1ee0 con 0x7f7b7015ed50 2024-09-19T09:20:13.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.147+0000 7f7b6ed9d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f7b700d09d0 0x7f7b700b5200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59406/0 (socket says 172.21.15.18:59406) 2024-09-19T09:20:13.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.147+0000 7f7b6ed9d640 1 -- 172.21.15.18:0/1299496077 learned_addr learned my addr 172.21.15.18:0/1299496077 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:20:13.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.148+0000 7f7b6e59c640 1 --2- 172.21.15.18:0/1299496077 >> v2:172.21.15.162:3300/0 conn(0x7f7b7015ed50 0x7f7b700d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:13.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.148+0000 7f7b6d59a640 1 -- 172.21.15.18:0/1299496077 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1198010249 0 0) 0x7f7b700d31b0 con 0x7f7b700d09d0 2024-09-19T09:20:13.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.148+0000 7f7b6d59a640 1 -- 172.21.15.18:0/1299496077 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b58003520 con 0x7f7b700d09d0 2024-09-19T09:20:13.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.148+0000 7f7b6d59a640 1 -- 172.21.15.18:0/1299496077 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 756213434 0 0) 0x7f7b58003520 con 0x7f7b700d09d0 2024-09-19T09:20:13.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.148+0000 7f7b6d59a640 1 -- 172.21.15.18:0/1299496077 >> v2:172.21.15.162:3300/0 conn(0x7f7b7015ed50 msgr2=0x7f7b700d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:13.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.148+0000 7f7b6d59a640 1 --2- 172.21.15.18:0/1299496077 >> v2:172.21.15.162:3300/0 conn(0x7f7b7015ed50 0x7f7b700d1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:13.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.148+0000 7f7b6d59a640 1 -- 172.21.15.18:0/1299496077 >> v1:172.21.15.162:6789/0 conn(0x7f7b700d1aa0 legacy=0x7f7b700b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:13.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.148+0000 7f7b6d59a640 1 -- 172.21.15.18:0/1299496077 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b700d3770 con 0x7f7b700d09d0 2024-09-19T09:20:13.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.148+0000 7f7b6d59a640 1 -- 172.21.15.18:0/1299496077 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f7b680019f0 con 0x7f7b700d09d0 2024-09-19T09:20:13.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.148+0000 7f7b6d59a640 1 -- 172.21.15.18:0/1299496077 >> v1:172.21.15.18:6789/0 conn(0x7f7b700d09d0 legacy=0x7f7b700b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:13.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.148+0000 7f7b6d59a640 1 --2- 172.21.15.18:0/1299496077 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b580039b0 0x7f7b58003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:13.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.148+0000 7f7b6d59a640 1 --2- 172.21.15.18:0/1299496077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b58004800 0x7f7b58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:13.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.148+0000 7f7b6d59a640 1 --2- 172.21.15.18:0/1299496077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b580051c0 0x7f7b5800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:13.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.148+0000 7f7b6d59a640 1 -- 172.21.15.18:0/1299496077 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7b700d1ee0 con 0x7f7b580051c0 2024-09-19T09:20:13.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.148+0000 7f7b6d59a640 1 -- 172.21.15.18:0/1299496077 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5800c070 con 0x7f7b58004800 2024-09-19T09:20:13.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.148+0000 7f7b6d59a640 1 -- 172.21.15.18:0/1299496077 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7b5800c270 con 0x7f7b580039b0 2024-09-19T09:20:13.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.148+0000 7f7b6ed9d640 1 --2- 172.21.15.18:0/1299496077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b580051c0 0x7f7b5800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:13.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.148+0000 7f7b6e59c640 1 --2- 172.21.15.18:0/1299496077 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b580039b0 0x7f7b58003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:13.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.148+0000 7f7b6dd9b640 1 --2- 172.21.15.18:0/1299496077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b58004800 0x7f7b58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:13.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.149+0000 7f7b6ed9d640 1 -- 172.21.15.18:0/1299496077 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b580039b0 msgr2=0x7f7b58003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:13.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.149+0000 7f7b6ed9d640 1 --2- 172.21.15.18:0/1299496077 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b580039b0 0x7f7b58003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:13.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.149+0000 7f7b6ed9d640 1 -- 172.21.15.18:0/1299496077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b58004800 msgr2=0x7f7b58004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:13.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.149+0000 7f7b6ed9d640 1 --2- 172.21.15.18:0/1299496077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b58004800 0x7f7b58004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:13.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.149+0000 7f7b6ed9d640 1 -- 172.21.15.18:0/1299496077 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b58003520 con 0x7f7b580051c0 2024-09-19T09:20:13.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.149+0000 7f7b6ed9d640 1 -- 172.21.15.18:0/1299496077 reap_dead start 2024-09-19T09:20:13.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.149+0000 7f7b6ed9d640 1 --2- 172.21.15.18:0/1299496077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b580051c0 0x7f7b5800b9c0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f7b6800a840 tx=0x7f7b58005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd8cf5962c6e74c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:13.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.149+0000 7f7b6d59a640 1 -- 172.21.15.18:0/1299496077 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6800a460 con 0x7f7b580051c0 2024-09-19T09:20:13.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.149+0000 7f7b6d59a640 1 -- 172.21.15.18:0/1299496077 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b6802f070 con 0x7f7b580051c0 2024-09-19T09:20:13.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.149+0000 7f7b6d59a640 1 -- 172.21.15.18:0/1299496077 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6802bcb0 con 0x7f7b580051c0 2024-09-19T09:20:13.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.150+0000 7f7b74c06640 1 -- 172.21.15.18:0/1299496077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b580051c0 msgr2=0x7f7b5800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:13.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.150+0000 7f7b74c06640 1 --2- 172.21.15.18:0/1299496077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b580051c0 0x7f7b5800b9c0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f7b6800a840 tx=0x7f7b58005830 comp rx=0 tx=0).stop 2024-09-19T09:20:13.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.150+0000 7f7b74c06640 1 -- 172.21.15.18:0/1299496077 shutdown_connections 2024-09-19T09:20:13.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.150+0000 7f7b74c06640 1 --2- 172.21.15.18:0/1299496077 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b580051c0 0x7f7b5800b9c0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:13.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.150+0000 7f7b74c06640 1 -- 172.21.15.18:0/1299496077 >> 172.21.15.18:0/1299496077 conn(0x7f7b700d4bd0 msgr2=0x7f7b700d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:13.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.150+0000 7f7b74c06640 1 -- 172.21.15.18:0/1299496077 shutdown_connections 2024-09-19T09:20:13.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.150+0000 7f7b74c06640 1 -- 172.21.15.18:0/1299496077 wait complete. 2024-09-19T09:20:13.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.152+0000 7f7b74c06640 1 Processor -- start 2024-09-19T09:20:13.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.152+0000 7f7b74c06640 1 -- start start 2024-09-19T09:20:13.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.152+0000 7f7b74c06640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b580051c0 0x7f7b700b9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:13.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.152+0000 7f7b74c06640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b700cd470 0x7f7b700cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:13.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.152+0000 7f7b74c06640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b70153dc0 0x7f7b700ce040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:13.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.152+0000 7f7b74c06640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7b700d3d30 con 0x7f7b700cd470 2024-09-19T09:20:13.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.152+0000 7f7b74c06640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7b700b45d0 con 0x7f7b70153dc0 2024-09-19T09:20:13.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.152+0000 7f7b74c06640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7b7015f130 con 0x7f7b580051c0 2024-09-19T09:20:13.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.153+0000 7f7b6dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b700cd470 0x7f7b700cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:13.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.153+0000 7f7b6dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b700cd470 0x7f7b700cbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38582/0 (socket says 172.21.15.18:38582) 2024-09-19T09:20:13.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.153+0000 7f7b6dd9b640 1 -- 172.21.15.18:0/900085080 learned_addr learned my addr 172.21.15.18:0/900085080 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:13.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.153+0000 7f7b6e59c640 1 --2- 172.21.15.18:0/900085080 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b580051c0 0x7f7b700b9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:13.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.153+0000 7f7b6ed9d640 1 --2- 172.21.15.18:0/900085080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b70153dc0 0x7f7b700ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:13.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.153+0000 7f7b6dd9b640 1 -- 172.21.15.18:0/900085080 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b580051c0 msgr2=0x7f7b700b9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:13.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.153+0000 7f7b6dd9b640 1 --2- 172.21.15.18:0/900085080 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b580051c0 0x7f7b700b9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:13.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.153+0000 7f7b6dd9b640 1 -- 172.21.15.18:0/900085080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b70153dc0 msgr2=0x7f7b700ce040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:13.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.153+0000 7f7b6dd9b640 1 --2- 172.21.15.18:0/900085080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b70153dc0 0x7f7b700ce040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:13.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.153+0000 7f7b6dd9b640 1 -- 172.21.15.18:0/900085080 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b700cc3d0 con 0x7f7b700cd470 2024-09-19T09:20:13.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.153+0000 7f7b6dd9b640 1 --2- 172.21.15.18:0/900085080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b700cd470 0x7f7b700cbca0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f7b6400f650 tx=0x7f7b6400fa50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:13.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.153+0000 7f7b5effd640 1 -- 172.21.15.18:0/900085080 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b640052e0 con 0x7f7b700cd470 2024-09-19T09:20:13.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.153+0000 7f7b5effd640 1 -- 172.21.15.18:0/900085080 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b64018070 con 0x7f7b700cd470 2024-09-19T09:20:13.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.153+0000 7f7b5effd640 1 -- 172.21.15.18:0/900085080 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b64003810 con 0x7f7b700cd470 2024-09-19T09:20:13.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.153+0000 7f7b74c06640 1 -- 172.21.15.18:0/900085080 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b700cc6b0 con 0x7f7b700cd470 2024-09-19T09:20:13.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.153+0000 7f7b74c06640 1 -- 172.21.15.18:0/900085080 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b700ccc70 con 0x7f7b700cd470 2024-09-19T09:20:13.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.154+0000 7f7b74c06640 1 -- 172.21.15.18:0/900085080 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b700d0e60 con 0x7f7b700cd470 2024-09-19T09:20:13.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.155+0000 7f7b5effd640 1 -- 172.21.15.18:0/900085080 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7b640039b0 con 0x7f7b700cd470 2024-09-19T09:20:13.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.155+0000 7f7b5effd640 1 --2- 172.21.15.18:0/900085080 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7b5006c2b0 0x7f7b5006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:13.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.155+0000 7f7b5effd640 1 -- 172.21.15.18:0/900085080 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5709+0+0 (secure 0 0 0) 0x7f7b6408afd0 con 0x7f7b700cd470 2024-09-19T09:20:13.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.156+0000 7f7b6e59c640 1 --2- 172.21.15.18:0/900085080 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7b5006c2b0 0x7f7b5006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:13.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.156+0000 7f7b6e59c640 1 --2- 172.21.15.18:0/900085080 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7b5006c2b0 0x7f7b5006e770 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7b60009b40 tx=0x7f7b60009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:13.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.160+0000 7f7b5effd640 1 -- 172.21.15.18:0/900085080 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7b640597d0 con 0x7f7b700cd470 2024-09-19T09:20:13.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.339+0000 7f7b74c06640 1 -- 172.21.15.18:0/900085080 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f7b700d3160 con 0x7f7b700cd470 2024-09-19T09:20:13.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.340+0000 7f7b5effd640 1 -- 172.21.15.18:0/900085080 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v141) ==== 81+0+34294 (secure 0 0 0) 0x7f7b640590d0 con 0x7f7b700cd470 2024-09-19T09:20:13.341 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:20:13.342 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:20:13.342 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 141, 2024-09-19T09:20:13.342 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:20:13.342 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-19T09:13:11.348786+0000", 2024-09-19T09:20:13.342 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-19T09:20:11.226994+0000", 2024-09-19T09:20:13.342 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-19T09:13:16.423937+0000", 2024-09-19T09:20:13.342 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-19T09:13:13.417141+0000", 2024-09-19T09:20:13.342 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-19T09:20:13.343 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-09-19T09:20:13.343 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-19T09:20:13.343 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-19T09:20:13.343 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-19T09:20:13.343 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-19T09:20:13.343 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-19T09:20:13.343 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:20:13.343 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-19T09:20:13.344 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.69999998807907104, 2024-09-19T09:20:13.344 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-19T09:20:13.344 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-19T09:20:13.344 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-19T09:20:13.344 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 17, 2024-09-19T09:20:13.344 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-19T09:20:13.344 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-19T09:20:13.345 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "jewel", 2024-09-19T09:20:13.345 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-19T09:20:13.345 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-19T09:20:13.345 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-19T09:20:13.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.345 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-19T09:20:13.346 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-19T09:20:13.346 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:13:17.564717+0000", 2024-09-19T09:20:13.346 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:20:13.346 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:20:13.347 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:20:13.347 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:20:13.347 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:20:13.348 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:20:13.348 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:20:13.348 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:20:13.348 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:20:13.349 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:20:13.349 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:20:13.349 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:20:13.349 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:20:13.349 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-19T09:20:13.349 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-19T09:20:13.350 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-19T09:20:13.350 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-19T09:20:13.350 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-19T09:20:13.350 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:20:13.350 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:20:13.350 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:20:13.351 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:20:13.351 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:20:13.351 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:20:13.351 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:20:13.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.351 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "111", 2024-09-19T09:20:13.351 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:20:13.351 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:20:13.352 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:20:13.352 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:20:13.352 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:20:13.352 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:20:13.352 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:20:13.352 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:20:13.352 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:20:13.353 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:20:13.353 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:20:13.353 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:20:13.353 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:20:13.353 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:20:13.353 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:20:13.353 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:20:13.353 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:20:13.353 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:20:13.354 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:20:13.354 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:20:13.354 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:20:13.354 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:20:13.354 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:20:13.354 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:20:13.354 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:20:13.355 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:20:13.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.355 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:20:13.355 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:20:13.355 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:20:13.355 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:20:13.355 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:20:13.356 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:20:13.356 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:20:13.356 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:20:13.356 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:20:13.356 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:20:13.356 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:20:13.356 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:20:13.356 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-19T09:20:13.357 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-19T09:20:13.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.357 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:20:13.357 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-19T09:20:13.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.357 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:20:13.357 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:20:13.357 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-19T09:20:13.358 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-19T09:20:13.358 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-19T09:20:13.358 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-19T09:20:13.358 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-19T09:20:13.358 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:20:13.358 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:20:13.358 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:20:13.359 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.359 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 16, 2024-09-19T09:20:13.359 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_metadata", 2024-09-19T09:20:13.359 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:19:38.333262+0000", 2024-09-19T09:20:13.359 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:20:13.360 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:20:13.360 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:20:13.360 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:20:13.361 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:20:13.361 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:20:13.361 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:20:13.361 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:20:13.361 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:20:13.361 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:20:13.362 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:20:13.362 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:20:13.362 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:20:13.362 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-19T09:20:13.362 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-19T09:20:13.362 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-19T09:20:13.362 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-19T09:20:13.362 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-19T09:20:13.362 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:20:13.362 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:20:13.363 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:20:13.363 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:20:13.363 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:20:13.363 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:20:13.363 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:20:13.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.363 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "137", 2024-09-19T09:20:13.363 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:20:13.363 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:20:13.363 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:20:13.363 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:20:13.363 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:20:13.363 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:20:13.363 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:20:13.364 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:20:13.364 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:20:13.364 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:20:13.364 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:20:13.364 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:20:13.364 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:20:13.364 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:20:13.364 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:20:13.365 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:20:13.365 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:20:13.365 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:20:13.365 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:20:13.365 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:20:13.365 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:20:13.365 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:20:13.365 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:20:13.366 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:20:13.366 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:20:13.366 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:20:13.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.366 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:20:13.366 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:20:13.366 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:20:13.366 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:20:13.366 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:20:13.366 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:20:13.366 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:20:13.366 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:20:13.366 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:20:13.366 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:20:13.367 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:20:13.367 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:20:13.367 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4, 2024-09-19T09:20:13.367 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 16, 2024-09-19T09:20:13.367 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_priority": 5 2024-09-19T09:20:13.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.367 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:20:13.367 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:20:13.367 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": "cephfs" 2024-09-19T09:20:13.367 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.367 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:20:13.367 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:20:13.367 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 2.25, 2024-09-19T09:20:13.368 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 2.25, 2024-09-19T09:20:13.368 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:20:13.368 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2.25, 2024-09-19T09:20:13.368 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2.25, 2024-09-19T09:20:13.368 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:20:13.368 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:20:13.368 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:20:13.368 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.368 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 17, 2024-09-19T09:20:13.368 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_data", 2024-09-19T09:20:13.368 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:19:38.727884+0000", 2024-09-19T09:20:13.369 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:20:13.369 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:20:13.369 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:20:13.369 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:20:13.369 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:20:13.369 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:20:13.369 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:20:13.369 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:20:13.369 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:20:13.369 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:20:13.369 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:20:13.369 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:20:13.369 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:20:13.370 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 64, 2024-09-19T09:20:13.370 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 64, 2024-09-19T09:20:13.370 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 64, 2024-09-19T09:20:13.370 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 64, 2024-09-19T09:20:13.370 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 64, 2024-09-19T09:20:13.370 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:20:13.370 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:20:13.370 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:20:13.370 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:20:13.370 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:20:13.370 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:20:13.370 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:20:13.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.370 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "141", 2024-09-19T09:20:13.371 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:20:13.371 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:20:13.371 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:20:13.371 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:20:13.371 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:20:13.371 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:20:13.371 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:20:13.371 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:20:13.371 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:20:13.371 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 33554432, 2024-09-19T09:20:13.371 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:20:13.371 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:20:13.371 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:20:13.371 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:20:13.372 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:20:13.372 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:20:13.372 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:20:13.372 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:20:13.372 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:20:13.372 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:20:13.372 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:20:13.372 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:20:13.372 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:20:13.372 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:20:13.372 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:20:13.373 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:20:13.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.373 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:20:13.373 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:20:13.373 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:20:13.373 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:20:13.374 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:20:13.374 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:20:13.374 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:20:13.374 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:20:13.375 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:20:13.375 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:20:13.375 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:20:13.375 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:20:13.375 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 64, 2024-09-19T09:20:13.375 INFO:teuthology.orchestra.run.smithi018.stdout: "target_size_ratio": 0.89999997615814209 2024-09-19T09:20:13.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.375 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:20:13.375 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:20:13.375 INFO:teuthology.orchestra.run.smithi018.stdout: "data": "cephfs" 2024-09-19T09:20:13.376 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.376 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:20:13.376 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:20:13.376 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.3799999952316284, 2024-09-19T09:20:13.377 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.3799999952316284, 2024-09-19T09:20:13.377 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:20:13.377 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-19T09:20:13.377 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-19T09:20:13.377 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:20:13.377 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:20:13.377 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:20:13.377 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.377 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.377 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:20:13.377 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-19T09:20:13.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.378 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:20:13.378 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:13.378 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:13.378 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:13.378 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:13.378 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:13.378 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:13.379 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:13.379 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:13.379 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:13.379 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:13.379 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:13.379 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:13.379 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.379 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.380 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-19T09:20:13.380 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:13.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.380 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.380 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-19T09:20:13.380 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:13.380 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.380 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.381 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:13.381 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.381 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.381 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-19T09:20:13.381 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:13.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.381 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.381 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-19T09:20:13.381 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:13.381 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.381 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.382 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:13.382 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.382 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.382 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-19T09:20:13.382 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:13.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.382 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.382 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-19T09:20:13.382 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:13.382 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.383 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.383 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:13.383 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.383 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.383 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-19T09:20:13.383 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:13.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.383 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.383 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-19T09:20:13.383 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:13.383 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.384 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.384 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/128722874", 2024-09-19T09:20:13.384 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/128722874", 2024-09-19T09:20:13.384 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/128722874", 2024-09-19T09:20:13.384 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/128722874", 2024-09-19T09:20:13.384 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:13.384 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:13.384 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:13.384 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.384 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:20:13.385 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:13.385 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:13.385 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:13.385 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:13.385 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:13.385 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:13.385 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:13.385 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:13.385 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:13.385 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:13.386 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:13.386 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:13.386 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.386 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.386 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-19T09:20:13.386 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:13.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.386 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.386 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-19T09:20:13.386 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:13.386 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.387 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.387 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:13.387 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.387 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.387 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-19T09:20:13.387 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:13.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.387 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.387 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-19T09:20:13.387 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:13.388 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.388 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.388 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:13.388 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.388 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.388 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-19T09:20:13.388 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:13.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.389 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.389 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-19T09:20:13.389 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:13.389 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.389 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.389 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:13.389 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.389 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.389 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-19T09:20:13.389 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:13.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.390 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.390 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-19T09:20:13.390 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:13.390 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.390 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.390 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/3672199638", 2024-09-19T09:20:13.390 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/3672199638", 2024-09-19T09:20:13.390 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/3672199638", 2024-09-19T09:20:13.390 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/3672199638", 2024-09-19T09:20:13.390 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:13.390 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:13.390 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:13.391 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.391 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:20:13.391 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:13.391 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:13.391 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:13.391 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:13.391 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:13.391 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:13.391 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:13.391 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:13.391 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:13.391 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:13.392 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:13.392 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:13.392 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.392 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.392 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T09:20:13.392 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:13.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.392 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.392 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T09:20:13.392 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:13.392 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.393 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.393 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:13.393 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.393 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.393 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-19T09:20:13.393 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:13.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.393 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.394 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-19T09:20:13.394 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:13.394 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.394 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.394 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:13.394 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.394 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.394 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-19T09:20:13.394 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:13.394 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.395 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.395 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-19T09:20:13.395 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:13.395 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.395 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.395 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:13.395 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.395 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.395 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-19T09:20:13.396 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:13.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.396 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.396 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-19T09:20:13.396 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:13.396 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.396 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.396 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3463367841", 2024-09-19T09:20:13.396 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3463367841", 2024-09-19T09:20:13.396 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3463367841", 2024-09-19T09:20:13.397 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3463367841", 2024-09-19T09:20:13.397 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:13.397 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:13.397 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:13.397 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.397 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:20:13.397 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:13.397 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:13.397 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:13.397 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:13.398 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:13.398 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:13.398 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:13.398 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:13.398 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:13.398 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:13.398 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:13.398 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:13.398 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.398 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.398 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-19T09:20:13.398 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:13.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.399 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.399 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-19T09:20:13.399 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:13.399 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.399 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.399 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:13.399 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.399 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.399 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-19T09:20:13.399 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:13.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.400 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.400 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-19T09:20:13.400 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:13.400 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.400 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.400 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:13.400 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.400 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.400 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-19T09:20:13.401 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:13.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.401 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.401 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-19T09:20:13.401 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:13.401 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.401 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.401 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:13.401 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.401 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.402 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-19T09:20:13.402 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:13.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.402 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.402 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-19T09:20:13.402 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:13.402 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.402 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.402 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/4163178582", 2024-09-19T09:20:13.402 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/4163178582", 2024-09-19T09:20:13.402 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/4163178582", 2024-09-19T09:20:13.402 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/4163178582", 2024-09-19T09:20:13.403 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:13.403 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:13.403 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:13.403 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.403 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:20:13.403 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:13.403 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:13.403 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:13.403 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:13.403 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:13.403 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:13.403 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:13.404 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:13.404 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:13.404 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:13.404 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:13.404 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:13.404 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.405 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.405 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6822", 2024-09-19T09:20:13.405 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:13.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.405 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.405 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6824", 2024-09-19T09:20:13.405 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:13.405 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.405 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.405 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:13.406 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.406 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.406 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6826", 2024-09-19T09:20:13.406 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:13.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.406 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.406 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6827", 2024-09-19T09:20:13.406 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:13.406 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.406 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.407 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:13.407 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.407 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.407 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6830", 2024-09-19T09:20:13.407 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:13.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.407 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.407 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6831", 2024-09-19T09:20:13.407 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:13.407 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.407 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.408 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:13.408 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.408 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.408 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6828", 2024-09-19T09:20:13.408 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:13.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.408 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.408 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6829", 2024-09-19T09:20:13.408 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:13.408 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.409 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.409 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6824/3538482215", 2024-09-19T09:20:13.409 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6827/3538482215", 2024-09-19T09:20:13.409 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6831/3538482215", 2024-09-19T09:20:13.409 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6829/3538482215", 2024-09-19T09:20:13.409 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:13.409 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:13.409 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:13.409 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.410 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:20:13.410 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:13.410 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:13.410 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:13.410 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:13.410 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:13.410 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:13.410 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:13.410 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:13.410 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:13.410 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:13.410 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:13.410 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:13.410 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.411 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.411 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6800", 2024-09-19T09:20:13.411 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:13.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.411 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.411 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.411 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6801", 2024-09-19T09:20:13.411 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:13.411 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.411 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.412 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:13.412 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.412 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.412 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6802", 2024-09-19T09:20:13.413 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:13.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.413 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.413 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6803", 2024-09-19T09:20:13.413 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:13.413 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.413 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.414 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:13.414 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.414 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.414 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6806", 2024-09-19T09:20:13.414 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:13.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.415 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.415 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6807", 2024-09-19T09:20:13.415 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:13.415 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.415 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.415 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:13.415 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.415 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.415 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6804", 2024-09-19T09:20:13.416 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:13.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.416 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.416 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6805", 2024-09-19T09:20:13.416 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:13.416 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.416 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.416 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.416 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6801/2408698413", 2024-09-19T09:20:13.416 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6803/2408698413", 2024-09-19T09:20:13.416 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6807/2408698413", 2024-09-19T09:20:13.416 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6805/2408698413", 2024-09-19T09:20:13.416 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:13.417 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:13.417 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:13.417 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.417 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:20:13.417 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:13.417 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:13.417 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:13.417 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:13.417 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:13.417 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:13.417 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:13.418 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:13.418 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:13.418 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:13.418 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:13.418 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:13.418 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.418 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.418 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6808", 2024-09-19T09:20:13.418 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:13.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.419 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.419 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6809", 2024-09-19T09:20:13.419 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:13.419 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.419 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.419 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:13.419 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.419 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.420 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6810", 2024-09-19T09:20:13.420 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:13.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.420 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.420 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6811", 2024-09-19T09:20:13.420 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:13.420 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.420 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.420 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:13.420 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.421 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.421 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6814", 2024-09-19T09:20:13.421 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:13.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.421 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.421 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6815", 2024-09-19T09:20:13.422 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:13.422 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.422 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.422 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:13.422 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.422 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.422 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6812", 2024-09-19T09:20:13.422 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:13.422 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.422 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.422 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.422 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6813", 2024-09-19T09:20:13.423 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:13.423 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.423 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.423 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6809/2596207948", 2024-09-19T09:20:13.423 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6811/2596207948", 2024-09-19T09:20:13.423 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6815/2596207948", 2024-09-19T09:20:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6813/2596207948", 2024-09-19T09:20:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:20:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:13.424 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:13.425 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:13.425 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:13.425 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:13.425 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:13.425 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:13.425 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:13.425 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.425 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.426 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.426 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6816", 2024-09-19T09:20:13.426 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:13.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.426 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.426 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.426 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6817", 2024-09-19T09:20:13.426 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:13.426 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.426 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.426 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.426 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:13.427 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.427 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.427 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6818", 2024-09-19T09:20:13.427 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:13.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.427 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.427 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.427 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6819", 2024-09-19T09:20:13.427 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:13.427 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.427 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.427 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.428 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:13.428 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.428 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.428 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6823", 2024-09-19T09:20:13.428 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:13.428 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.428 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.428 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.428 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6825", 2024-09-19T09:20:13.428 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:13.428 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.429 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.429 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:13.429 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.429 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.429 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6820", 2024-09-19T09:20:13.429 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:13.429 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.429 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.429 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.429 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6821", 2024-09-19T09:20:13.429 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6817/1334618296", 2024-09-19T09:20:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6819/1334618296", 2024-09-19T09:20:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6825/1334618296", 2024-09-19T09:20:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6821/1334618296", 2024-09-19T09:20:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:20:13.430 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-19T09:20:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:20:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.580838+0000", 2024-09-19T09:20:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:20:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:13.431 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:13.432 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:13.432 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:13.432 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:13.432 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.599990+0000", 2024-09-19T09:20:13.432 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:13.432 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.432 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.432 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:20:13.432 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:13.432 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:13.432 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:13.432 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:13.432 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:13.433 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.503722+0000", 2024-09-19T09:20:13.433 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:13.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.433 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:20:13.433 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:13.433 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:13.433 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:13.433 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:13.433 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:13.433 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.607846+0000", 2024-09-19T09:20:13.433 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:13.433 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.433 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.433 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:20:13.434 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:13.434 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:13.434 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:13.434 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:13.434 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:13.434 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.616858+0000", 2024-09-19T09:20:13.434 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:13.434 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.434 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.434 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:20:13.434 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:13.434 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:13.434 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:13.434 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:13.435 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:13.435 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.542726+0000", 2024-09-19T09:20:13.435 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:13.435 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.435 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.435 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:20:13.435 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:13.435 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:13.435 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:13.435 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:13.436 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:13.436 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.534178+0000", 2024-09-19T09:20:13.436 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:13.436 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.436 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.436 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:20:13.436 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:13.436 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:13.436 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:13.436 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:13.436 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:13.437 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.612105+0000", 2024-09-19T09:20:13.437 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:13.437 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.437 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:20:13.437 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-19T09:20:13.437 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-19T09:20:13.437 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-19T09:20:13.437 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-19T09:20:13.437 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-19T09:20:13.437 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-19T09:20:13.437 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-19T09:20:13.437 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-19T09:20:13.437 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-19T09:20:13.438 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-19T09:20:13.438 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-19T09:20:13.438 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-19T09:20:13.438 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-19T09:20:13.438 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-19T09:20:13.438 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.438 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.438 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-19T09:20:13.438 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-19T09:20:13.438 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-19T09:20:13.438 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-19T09:20:13.438 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-19T09:20:13.439 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-19T09:20:13.439 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-19T09:20:13.439 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-19T09:20:13.439 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-19T09:20:13.439 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-19T09:20:13.439 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-19T09:20:13.439 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.439 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:20:13.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.342+0000 7f7b74c06640 1 -- 172.21.15.18:0/900085080 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7b5006c2b0 msgr2=0x7f7b5006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:13.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.342+0000 7f7b74c06640 1 --2- 172.21.15.18:0/900085080 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7b5006c2b0 0x7f7b5006e770 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7b60009b40 tx=0x7f7b60009190 comp rx=0 tx=0).stop 2024-09-19T09:20:13.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.342+0000 7f7b74c06640 1 -- 172.21.15.18:0/900085080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b700cd470 msgr2=0x7f7b700cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:13.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.342+0000 7f7b74c06640 1 --2- 172.21.15.18:0/900085080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b700cd470 0x7f7b700cbca0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f7b6400f650 tx=0x7f7b6400fa50 comp rx=0 tx=0).stop 2024-09-19T09:20:13.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.342+0000 7f7b74c06640 1 -- 172.21.15.18:0/900085080 shutdown_connections 2024-09-19T09:20:13.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.342+0000 7f7b74c06640 1 --2- 172.21.15.18:0/900085080 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7b5006c2b0 0x7f7b5006e770 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:13.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.342+0000 7f7b74c06640 1 --2- 172.21.15.18:0/900085080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b70153dc0 0x7f7b700ce040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:13.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.342+0000 7f7b74c06640 1 --2- 172.21.15.18:0/900085080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b700cd470 0x7f7b700cbca0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:13.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.342+0000 7f7b74c06640 1 --2- 172.21.15.18:0/900085080 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b580051c0 0x7f7b700b9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:13.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.342+0000 7f7b74c06640 1 -- 172.21.15.18:0/900085080 >> 172.21.15.18:0/900085080 conn(0x7f7b700d4bd0 msgr2=0x7f7b700b3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:13.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.342+0000 7f7b74c06640 1 -- 172.21.15.18:0/900085080 shutdown_connections 2024-09-19T09:20:13.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.342+0000 7f7b74c06640 1 -- 172.21.15.18:0/900085080 wait complete. 2024-09-19T09:20:13.442 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-09-19T09:20:13.443 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-19T09:20:13.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.544+0000 7f8c7d911640 1 Processor -- start 2024-09-19T09:20:13.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.544+0000 7f8c7d911640 1 -- start start 2024-09-19T09:20:13.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.545+0000 7f8c7d911640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c780b5b00 0x7f8c78169980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:13.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.545+0000 7f8c7d911640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c780d31b0 con 0x7f8c780d1c70 2024-09-19T09:20:13.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.545+0000 7f8c7d911640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c780d3490 con 0x7f8c7815ed50 2024-09-19T09:20:13.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.545+0000 7f8c7d911640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8c780d3770 con 0x7f8c780b5b00 2024-09-19T09:20:13.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.545+0000 7f8c767fc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f8c780d1c70 0x7f8c780cf9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:59412/0 (socket says 172.21.15.18:59412) 2024-09-19T09:20:13.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.545+0000 7f8c767fc640 1 -- 172.21.15.18:0/1469020319 learned_addr learned my addr 172.21.15.18:0/1469020319 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:20:13.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.546+0000 7f8c777fe640 1 --2- 172.21.15.18:0/1469020319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c780b5b00 0x7f8c78169980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:13.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.546+0000 7f8c75ffb640 1 -- 172.21.15.18:0/1469020319 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1627776798 0 0) 0x7f8c780d31b0 con 0x7f8c780d1c70 2024-09-19T09:20:13.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.546+0000 7f8c75ffb640 1 -- 172.21.15.18:0/1469020319 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c60003520 con 0x7f8c780d1c70 2024-09-19T09:20:13.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.546+0000 7f8c75ffb640 1 -- 172.21.15.18:0/1469020319 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1055593662 0 0) 0x7f8c60003520 con 0x7f8c780d1c70 2024-09-19T09:20:13.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.546+0000 7f8c75ffb640 1 -- 172.21.15.18:0/1469020319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c780b5b00 msgr2=0x7f8c78169980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:13.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.546+0000 7f8c75ffb640 1 --2- 172.21.15.18:0/1469020319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c780b5b00 0x7f8c78169980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:13.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.546+0000 7f8c75ffb640 1 -- 172.21.15.18:0/1469020319 >> v1:172.21.15.162:6789/0 conn(0x7f8c7815ed50 legacy=0x7f8c780d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:13.561 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.546+0000 7f8c75ffb640 1 -- 172.21.15.18:0/1469020319 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c780d3a50 con 0x7f8c780d1c70 2024-09-19T09:20:13.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.546+0000 7f8c75ffb640 1 -- 172.21.15.18:0/1469020319 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f8c6c001670 con 0x7f8c780d1c70 2024-09-19T09:20:13.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.546+0000 7f8c75ffb640 1 -- 172.21.15.18:0/1469020319 >> v1:172.21.15.18:6789/0 conn(0x7f8c780d1c70 legacy=0x7f8c780cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:13.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.546+0000 7f8c75ffb640 1 --2- 172.21.15.18:0/1469020319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c780b5b00 0x7f8c600039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:13.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.546+0000 7f8c75ffb640 1 --2- 172.21.15.18:0/1469020319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c60003f60 0x7f8c60004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:13.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.546+0000 7f8c75ffb640 1 --2- 172.21.15.18:0/1469020319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c60004d40 0x7f8c600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:13.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.546+0000 7f8c75ffb640 1 -- 172.21.15.18:0/1469020319 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8c780d3770 con 0x7f8c60003f60 2024-09-19T09:20:13.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.546+0000 7f8c75ffb640 1 -- 172.21.15.18:0/1469020319 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6000bb30 con 0x7f8c60004d40 2024-09-19T09:20:13.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.546+0000 7f8c75ffb640 1 -- 172.21.15.18:0/1469020319 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8c6000bd30 con 0x7f8c780b5b00 2024-09-19T09:20:13.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.546+0000 7f8c767fc640 1 --2- 172.21.15.18:0/1469020319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c60003f60 0x7f8c60004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:13.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.546+0000 7f8c76ffd640 1 --2- 172.21.15.18:0/1469020319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c780b5b00 0x7f8c600039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:13.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.546+0000 7f8c777fe640 1 --2- 172.21.15.18:0/1469020319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c60004d40 0x7f8c600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:13.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.546+0000 7f8c767fc640 1 -- 172.21.15.18:0/1469020319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c780b5b00 msgr2=0x7f8c600039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:13.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.546+0000 7f8c767fc640 1 --2- 172.21.15.18:0/1469020319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c780b5b00 0x7f8c600039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:13.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.546+0000 7f8c767fc640 1 -- 172.21.15.18:0/1469020319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c60004d40 msgr2=0x7f8c600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:13.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.546+0000 7f8c767fc640 1 --2- 172.21.15.18:0/1469020319 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c60004d40 0x7f8c600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:13.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.546+0000 7f8c767fc640 1 -- 172.21.15.18:0/1469020319 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c60003520 con 0x7f8c60003f60 2024-09-19T09:20:13.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.546+0000 7f8c76ffd640 1 --2- 172.21.15.18:0/1469020319 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c780b5b00 0x7f8c600039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:13.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.547+0000 7f8c767fc640 1 --2- 172.21.15.18:0/1469020319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c60003f60 0x7f8c60004800 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c00c240 tx=0x7f8c60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1599fc220ab372f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:13.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.547+0000 7f8c75ffb640 1 -- 172.21.15.18:0/1469020319 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c007cf0 con 0x7f8c60003f60 2024-09-19T09:20:13.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.547+0000 7f8c75ffb640 1 -- 172.21.15.18:0/1469020319 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c6c0058d0 con 0x7f8c60003f60 2024-09-19T09:20:13.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.547+0000 7f8c75ffb640 1 -- 172.21.15.18:0/1469020319 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c005ca0 con 0x7f8c60003f60 2024-09-19T09:20:13.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.548+0000 7f8c7d911640 1 -- 172.21.15.18:0/1469020319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c60003f60 msgr2=0x7f8c60004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:13.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.548+0000 7f8c7d911640 1 --2- 172.21.15.18:0/1469020319 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c60003f60 0x7f8c60004800 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c00c240 tx=0x7f8c60005830 comp rx=0 tx=0).stop 2024-09-19T09:20:13.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.548+0000 7f8c777fe640 1 -- 172.21.15.18:0/1469020319 reap_dead start 2024-09-19T09:20:13.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.548+0000 7f8c7d911640 1 -- 172.21.15.18:0/1469020319 shutdown_connections 2024-09-19T09:20:13.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.548+0000 7f8c7d911640 1 -- 172.21.15.18:0/1469020319 >> 172.21.15.18:0/1469020319 conn(0x7f8c780d4bd0 msgr2=0x7f8c780d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:13.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.548+0000 7f8c7d911640 1 -- 172.21.15.18:0/1469020319 shutdown_connections 2024-09-19T09:20:13.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.548+0000 7f8c7d911640 1 -- 172.21.15.18:0/1469020319 wait complete. 2024-09-19T09:20:13.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.549+0000 7f8c7d911640 1 Processor -- start 2024-09-19T09:20:13.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.549+0000 7f8c7d911640 1 -- start start 2024-09-19T09:20:13.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.550+0000 7f8c7d911640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c60003f60 0x7f8c781541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:13.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.550+0000 7f8c7d911640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c78160e00 0x7f8c780ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:13.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.550+0000 7f8c7d911640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c7806d1b0 0x7f8c7806d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:13.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.550+0000 7f8c7d911640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8c7815f130 con 0x7f8c7806d1b0 2024-09-19T09:20:13.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.550+0000 7f8c7d911640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8c780d3d30 con 0x7f8c60003f60 2024-09-19T09:20:13.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.550+0000 7f8c7d911640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8c78154730 con 0x7f8c78160e00 2024-09-19T09:20:13.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.550+0000 7f8c777fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c7806d1b0 0x7f8c7806d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:13.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.550+0000 7f8c777fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c7806d1b0 0x7f8c7806d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38590/0 (socket says 172.21.15.18:38590) 2024-09-19T09:20:13.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.550+0000 7f8c777fe640 1 -- 172.21.15.18:0/3430030118 learned_addr learned my addr 172.21.15.18:0/3430030118 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:13.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.550+0000 7f8c76ffd640 1 --2- 172.21.15.18:0/3430030118 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c60003f60 0x7f8c781541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:13.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.550+0000 7f8c767fc640 1 --2- 172.21.15.18:0/3430030118 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c78160e00 0x7f8c780ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:13.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.550+0000 7f8c777fe640 1 -- 172.21.15.18:0/3430030118 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c78160e00 msgr2=0x7f8c780ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:13.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.550+0000 7f8c777fe640 1 --2- 172.21.15.18:0/3430030118 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c78160e00 0x7f8c780ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:13.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.550+0000 7f8c777fe640 1 -- 172.21.15.18:0/3430030118 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c60003f60 msgr2=0x7f8c781541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:13.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.550+0000 7f8c777fe640 1 --2- 172.21.15.18:0/3430030118 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c60003f60 0x7f8c781541f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:13.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.550+0000 7f8c777fe640 1 -- 172.21.15.18:0/3430030118 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c780b8a80 con 0x7f8c7806d1b0 2024-09-19T09:20:13.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.550+0000 7f8c767fc640 1 --2- 172.21.15.18:0/3430030118 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c78160e00 0x7f8c780ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:13.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.551+0000 7f8c777fe640 1 --2- 172.21.15.18:0/3430030118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c7806d1b0 0x7f8c7806d660 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f8c780b5f90 tx=0x7f8c700115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:13.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.551+0000 7f8c5ffff640 1 -- 172.21.15.18:0/3430030118 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c70011e40 con 0x7f8c7806d1b0 2024-09-19T09:20:13.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.551+0000 7f8c5ffff640 1 -- 172.21.15.18:0/3430030118 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c7001b070 con 0x7f8c7806d1b0 2024-09-19T09:20:13.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.551+0000 7f8c7d911640 1 -- 172.21.15.18:0/3430030118 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c78161300 con 0x7f8c7806d1b0 2024-09-19T09:20:13.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.551+0000 7f8c5ffff640 1 -- 172.21.15.18:0/3430030118 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c70003990 con 0x7f8c7806d1b0 2024-09-19T09:20:13.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.551+0000 7f8c7d911640 1 -- 172.21.15.18:0/3430030118 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c781618c0 con 0x7f8c7806d1b0 2024-09-19T09:20:13.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.552+0000 7f8c7d911640 1 -- 172.21.15.18:0/3430030118 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c780d21e0 con 0x7f8c7806d1b0 2024-09-19T09:20:13.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.552+0000 7f8c5ffff640 1 -- 172.21.15.18:0/3430030118 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8c70003b30 con 0x7f8c7806d1b0 2024-09-19T09:20:13.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.553+0000 7f8c5ffff640 1 --2- 172.21.15.18:0/3430030118 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8c6406c2e0 0x7f8c6406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:13.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.553+0000 7f8c5ffff640 1 -- 172.21.15.18:0/3430030118 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5709+0+0 (secure 0 0 0) 0x7f8c7008bb20 con 0x7f8c7806d1b0 2024-09-19T09:20:13.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.553+0000 7f8c76ffd640 1 --2- 172.21.15.18:0/3430030118 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8c6406c2e0 0x7f8c6406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:13.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.554+0000 7f8c76ffd640 1 --2- 172.21.15.18:0/3430030118 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8c6406c2e0 0x7f8c6406e7a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8c7815bd00 tx=0x7f8c68009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:13.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.557+0000 7f8c5ffff640 1 -- 172.21.15.18:0/3430030118 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8c70003e20 con 0x7f8c7806d1b0 2024-09-19T09:20:13.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.737+0000 7f8c7d911640 1 -- 172.21.15.18:0/3430030118 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f8c780d0b60 con 0x7f8c7806d1b0 2024-09-19T09:20:13.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.739+0000 7f8c5ffff640 1 -- 172.21.15.18:0/3430030118 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v141) ==== 81+0+34294 (secure 0 0 0) 0x7f8c7005a320 con 0x7f8c7806d1b0 2024-09-19T09:20:13.740 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:20:13.740 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:20:13.740 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 141, 2024-09-19T09:20:13.740 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:20:13.740 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-19T09:13:11.348786+0000", 2024-09-19T09:20:13.740 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-19T09:20:11.226994+0000", 2024-09-19T09:20:13.740 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-19T09:13:16.423937+0000", 2024-09-19T09:20:13.740 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-19T09:13:13.417141+0000", 2024-09-19T09:20:13.741 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-19T09:20:13.741 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-09-19T09:20:13.741 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-19T09:20:13.741 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-19T09:20:13.741 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-19T09:20:13.741 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-19T09:20:13.741 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-19T09:20:13.741 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:20:13.741 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-19T09:20:13.741 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.69999998807907104, 2024-09-19T09:20:13.741 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-19T09:20:13.742 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-19T09:20:13.742 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-19T09:20:13.742 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 17, 2024-09-19T09:20:13.742 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-19T09:20:13.742 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-19T09:20:13.742 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "jewel", 2024-09-19T09:20:13.742 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-19T09:20:13.742 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-19T09:20:13.742 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-19T09:20:13.742 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.742 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-19T09:20:13.742 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-19T09:20:13.742 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:13:17.564717+0000", 2024-09-19T09:20:13.743 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:20:13.743 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:20:13.743 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:20:13.743 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:20:13.743 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:20:13.743 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:20:13.743 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:20:13.743 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:20:13.743 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:20:13.743 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:20:13.743 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:20:13.743 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:20:13.743 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:20:13.743 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-19T09:20:13.743 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-19T09:20:13.744 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-19T09:20:13.744 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-19T09:20:13.744 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-19T09:20:13.744 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:20:13.744 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:20:13.744 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:20:13.744 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:20:13.744 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:20:13.744 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:20:13.744 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:20:13.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.744 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "111", 2024-09-19T09:20:13.744 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:20:13.744 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:20:13.745 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:20:13.745 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:20:13.745 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:20:13.745 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:20:13.745 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:20:13.745 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:20:13.745 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:20:13.745 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:20:13.745 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:20:13.745 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:20:13.745 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:20:13.746 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:20:13.746 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:20:13.746 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:20:13.746 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:20:13.746 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:20:13.746 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:20:13.746 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:20:13.746 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:20:13.746 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:20:13.746 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:20:13.747 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:20:13.747 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:20:13.747 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:20:13.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.747 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:20:13.747 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:20:13.747 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:20:13.747 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:20:13.747 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:20:13.747 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:20:13.747 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:20:13.747 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:20:13.748 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:20:13.748 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:20:13.748 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:20:13.748 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:20:13.748 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-19T09:20:13.748 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-19T09:20:13.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.749 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:20:13.749 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-19T09:20:13.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.749 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:20:13.749 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:20:13.749 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-19T09:20:13.749 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-19T09:20:13.749 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-19T09:20:13.750 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-19T09:20:13.750 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-19T09:20:13.750 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:20:13.750 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:20:13.750 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:20:13.750 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.751 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.751 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 16, 2024-09-19T09:20:13.751 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_metadata", 2024-09-19T09:20:13.751 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:19:38.333262+0000", 2024-09-19T09:20:13.751 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:20:13.751 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:20:13.751 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:20:13.751 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:20:13.751 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:20:13.751 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:20:13.751 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:20:13.751 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:20:13.751 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:20:13.752 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:20:13.752 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:20:13.752 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:20:13.752 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:20:13.752 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-19T09:20:13.752 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-19T09:20:13.752 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-19T09:20:13.752 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-19T09:20:13.752 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-19T09:20:13.752 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:20:13.752 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:20:13.752 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:20:13.752 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:20:13.753 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:20:13.753 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:20:13.753 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:20:13.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.753 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "137", 2024-09-19T09:20:13.753 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:20:13.753 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:20:13.753 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:20:13.753 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:20:13.753 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:20:13.753 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:20:13.753 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:20:13.753 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:20:13.753 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:20:13.754 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:20:13.754 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:20:13.754 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:20:13.754 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:20:13.754 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:20:13.754 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:20:13.754 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:20:13.754 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:20:13.754 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:20:13.754 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:20:13.754 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:20:13.754 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:20:13.754 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:20:13.754 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:20:13.755 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:20:13.755 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:20:13.755 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:20:13.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.755 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:20:13.755 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:20:13.755 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:20:13.755 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:20:13.755 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:20:13.755 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:20:13.755 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:20:13.755 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:20:13.755 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:20:13.755 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:20:13.756 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:20:13.756 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:20:13.756 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4, 2024-09-19T09:20:13.756 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 16, 2024-09-19T09:20:13.756 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_priority": 5 2024-09-19T09:20:13.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.756 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:20:13.756 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:20:13.756 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": "cephfs" 2024-09-19T09:20:13.756 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.756 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:20:13.756 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:20:13.757 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 2.25, 2024-09-19T09:20:13.757 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 2.25, 2024-09-19T09:20:13.757 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:20:13.757 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2.25, 2024-09-19T09:20:13.757 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2.25, 2024-09-19T09:20:13.757 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:20:13.757 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:20:13.757 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:20:13.757 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.758 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 17, 2024-09-19T09:20:13.758 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_data", 2024-09-19T09:20:13.758 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:19:38.727884+0000", 2024-09-19T09:20:13.758 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:20:13.758 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:20:13.758 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:20:13.758 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:20:13.758 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:20:13.758 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:20:13.758 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:20:13.758 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:20:13.758 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:20:13.759 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:20:13.759 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:20:13.759 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:20:13.759 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:20:13.759 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 64, 2024-09-19T09:20:13.759 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 64, 2024-09-19T09:20:13.759 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 64, 2024-09-19T09:20:13.759 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 64, 2024-09-19T09:20:13.759 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 64, 2024-09-19T09:20:13.759 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:20:13.759 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:20:13.759 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:20:13.759 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:20:13.760 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:20:13.760 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:20:13.760 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:20:13.760 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.760 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "141", 2024-09-19T09:20:13.760 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:20:13.760 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:20:13.760 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:20:13.761 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:20:13.761 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:20:13.761 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:20:13.761 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:20:13.761 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:20:13.761 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:20:13.761 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 33554432, 2024-09-19T09:20:13.761 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:20:13.761 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:20:13.761 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:20:13.761 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:20:13.762 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:20:13.762 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:20:13.762 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:20:13.762 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:20:13.762 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:20:13.762 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:20:13.762 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:20:13.762 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:20:13.762 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:20:13.762 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:20:13.763 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:20:13.763 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:20:13.763 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.763 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:20:13.763 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:20:13.763 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:20:13.763 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:20:13.763 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:20:13.763 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:20:13.763 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:20:13.763 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:20:13.763 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:20:13.763 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:20:13.763 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:20:13.764 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:20:13.764 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 64, 2024-09-19T09:20:13.764 INFO:teuthology.orchestra.run.smithi018.stdout: "target_size_ratio": 0.89999997615814209 2024-09-19T09:20:13.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.764 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:20:13.764 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:20:13.764 INFO:teuthology.orchestra.run.smithi018.stdout: "data": "cephfs" 2024-09-19T09:20:13.764 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.764 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:20:13.764 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:20:13.764 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.3799999952316284, 2024-09-19T09:20:13.764 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.3799999952316284, 2024-09-19T09:20:13.765 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:20:13.765 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-19T09:20:13.765 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-19T09:20:13.765 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:20:13.765 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:20:13.765 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:20:13.765 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.765 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.765 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:20:13.765 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-19T09:20:13.765 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.766 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:20:13.766 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:13.766 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:13.766 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:13.766 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:13.766 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:13.766 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:13.766 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:13.766 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:13.766 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:13.766 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:13.766 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:13.766 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:13.766 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.767 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.767 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-19T09:20:13.767 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:13.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.767 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.767 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.767 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-19T09:20:13.767 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:13.767 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.768 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.768 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:13.768 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.768 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.768 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-19T09:20:13.768 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:13.768 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.768 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.768 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-19T09:20:13.768 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:13.768 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.769 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.769 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:13.769 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.769 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.769 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-19T09:20:13.769 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:13.769 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.769 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.769 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-19T09:20:13.770 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:13.770 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.770 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.770 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:13.770 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.770 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.770 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.770 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-19T09:20:13.770 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:13.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.770 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.770 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.770 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-19T09:20:13.771 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:20:13.771 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.771 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.771 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/128722874", 2024-09-19T09:20:13.771 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/128722874", 2024-09-19T09:20:13.771 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/128722874", 2024-09-19T09:20:13.771 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/128722874", 2024-09-19T09:20:13.771 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:13.771 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:13.771 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:13.771 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.771 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.771 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:20:13.772 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:13.772 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:13.772 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:13.772 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:13.772 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:13.772 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:13.772 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:13.772 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:13.772 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:13.773 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:13.773 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:13.773 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:13.773 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.773 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.773 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-19T09:20:13.773 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:13.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.774 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.774 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-19T09:20:13.774 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:13.774 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.774 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.775 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:13.775 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.775 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.775 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-19T09:20:13.775 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:13.775 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.775 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.776 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.776 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-19T09:20:13.776 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:13.776 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.776 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.776 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:13.776 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.777 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.777 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-19T09:20:13.777 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:13.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.777 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.777 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-19T09:20:13.777 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:13.778 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.778 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.778 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:13.778 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.778 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.778 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-19T09:20:13.779 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:13.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.779 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.779 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-19T09:20:13.779 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:20:13.779 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.779 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.780 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/3672199638", 2024-09-19T09:20:13.780 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/3672199638", 2024-09-19T09:20:13.780 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/3672199638", 2024-09-19T09:20:13.780 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/3672199638", 2024-09-19T09:20:13.780 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:13.780 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:13.780 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:13.781 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.781 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.781 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:20:13.781 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:13.781 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:13.781 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:13.781 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:13.781 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:13.782 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:13.782 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:13.782 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:13.782 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:13.782 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:13.782 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:13.782 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:13.782 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.783 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.783 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T09:20:13.783 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:13.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.783 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.783 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T09:20:13.783 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:13.784 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.784 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.784 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:13.784 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.784 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.784 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.784 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-19T09:20:13.785 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:13.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.785 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.785 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-19T09:20:13.785 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:13.785 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.785 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.785 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:13.785 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.786 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.786 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-19T09:20:13.786 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:13.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.786 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.786 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-19T09:20:13.786 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:13.786 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.786 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.786 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:13.786 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.786 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.787 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.787 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-19T09:20:13.787 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:13.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.787 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.787 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-19T09:20:13.787 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:20:13.787 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.788 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.788 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3463367841", 2024-09-19T09:20:13.788 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3463367841", 2024-09-19T09:20:13.788 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3463367841", 2024-09-19T09:20:13.788 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3463367841", 2024-09-19T09:20:13.788 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:13.788 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:13.788 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:13.788 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.788 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:20:13.789 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:13.789 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:13.789 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:13.789 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:13.789 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:13.789 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:13.789 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:13.789 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:13.789 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:13.789 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:13.789 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:13.789 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:13.789 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.790 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.790 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-19T09:20:13.790 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:13.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.790 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.790 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-19T09:20:13.790 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:13.790 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.790 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.791 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:13.791 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.791 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.791 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-19T09:20:13.791 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:13.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.791 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.791 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-19T09:20:13.791 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:13.791 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.792 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.792 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:13.792 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.792 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.792 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-19T09:20:13.792 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:13.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.792 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.792 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-19T09:20:13.792 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:13.793 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.793 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.793 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:13.793 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.793 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.793 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-19T09:20:13.793 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:13.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.793 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.793 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-19T09:20:13.794 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:20:13.794 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.794 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.794 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/4163178582", 2024-09-19T09:20:13.794 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/4163178582", 2024-09-19T09:20:13.794 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/4163178582", 2024-09-19T09:20:13.794 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/4163178582", 2024-09-19T09:20:13.794 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:13.794 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:13.794 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:13.794 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.795 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:20:13.795 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:13.795 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:13.795 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:13.795 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:13.795 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:13.795 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:13.795 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:13.795 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:13.795 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:13.795 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:13.795 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:13.795 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:13.795 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.796 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.796 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6822", 2024-09-19T09:20:13.796 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:13.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.796 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.796 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6824", 2024-09-19T09:20:13.796 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:13.796 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.796 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.796 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:13.797 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.797 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.797 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6826", 2024-09-19T09:20:13.797 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:13.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.797 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.797 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6827", 2024-09-19T09:20:13.797 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:13.797 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.797 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.797 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:13.798 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.798 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.798 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6830", 2024-09-19T09:20:13.798 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:13.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.798 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.798 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.798 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6831", 2024-09-19T09:20:13.798 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:13.798 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.798 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.798 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:13.799 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.799 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.799 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6828", 2024-09-19T09:20:13.799 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:13.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.799 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.799 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6829", 2024-09-19T09:20:13.799 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:20:13.799 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.799 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.799 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6824/3538482215", 2024-09-19T09:20:13.800 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6827/3538482215", 2024-09-19T09:20:13.800 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6831/3538482215", 2024-09-19T09:20:13.800 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6829/3538482215", 2024-09-19T09:20:13.800 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:13.800 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:13.800 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:13.800 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.800 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.800 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:20:13.800 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:13.800 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:13.800 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:13.801 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:13.801 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:13.801 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:13.801 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:13.801 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:13.801 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:13.802 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:13.802 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:13.802 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:13.802 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.802 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.803 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6800", 2024-09-19T09:20:13.803 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:13.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.803 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.803 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6801", 2024-09-19T09:20:13.804 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:13.804 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.804 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.804 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:13.805 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.805 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.805 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6802", 2024-09-19T09:20:13.805 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:13.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.806 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.806 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.806 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6803", 2024-09-19T09:20:13.806 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:13.806 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.806 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.807 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:13.807 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.807 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.807 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6806", 2024-09-19T09:20:13.808 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:13.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.808 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.808 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6807", 2024-09-19T09:20:13.809 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:13.809 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.809 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.809 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:13.809 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.810 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.810 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6804", 2024-09-19T09:20:13.810 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:13.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.810 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.810 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6805", 2024-09-19T09:20:13.810 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:20:13.810 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.810 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.811 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6801/2408698413", 2024-09-19T09:20:13.811 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6803/2408698413", 2024-09-19T09:20:13.811 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6807/2408698413", 2024-09-19T09:20:13.811 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6805/2408698413", 2024-09-19T09:20:13.811 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:13.811 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:13.811 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:13.811 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.811 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:20:13.811 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:13.811 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:13.812 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:13.812 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:13.812 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:13.812 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:13.812 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:13.812 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:13.812 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:13.812 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:13.812 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:13.812 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:13.812 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.813 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.813 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6808", 2024-09-19T09:20:13.813 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:13.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.814 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.814 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6809", 2024-09-19T09:20:13.814 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:13.814 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.814 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.814 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:13.814 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.815 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.815 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6810", 2024-09-19T09:20:13.815 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:13.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.815 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.815 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6811", 2024-09-19T09:20:13.816 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:13.816 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.816 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.816 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:13.816 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.816 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.816 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6814", 2024-09-19T09:20:13.816 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:13.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.817 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.817 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6815", 2024-09-19T09:20:13.817 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:13.817 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.817 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.817 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:13.817 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.817 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.817 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6812", 2024-09-19T09:20:13.818 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:13.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.818 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.818 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6813", 2024-09-19T09:20:13.818 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:20:13.818 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.818 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.818 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6809/2596207948", 2024-09-19T09:20:13.818 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6811/2596207948", 2024-09-19T09:20:13.818 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6815/2596207948", 2024-09-19T09:20:13.818 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6813/2596207948", 2024-09-19T09:20:13.818 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:13.819 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:13.819 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:13.819 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.819 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:20:13.819 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:20:13.819 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:20:13.819 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:20:13.819 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:20:13.819 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:20:13.819 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:20:13.820 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:20:13.820 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:20:13.820 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 136, 2024-09-19T09:20:13.820 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:20:13.820 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:20:13.820 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:20:13.820 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.820 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.820 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6816", 2024-09-19T09:20:13.820 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:13.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.821 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.821 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6817", 2024-09-19T09:20:13.821 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:13.821 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.821 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.821 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:20:13.821 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.822 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.822 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6818", 2024-09-19T09:20:13.822 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:13.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.822 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.822 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6819", 2024-09-19T09:20:13.822 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:13.822 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.822 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.822 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:20:13.822 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.823 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.823 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6823", 2024-09-19T09:20:13.823 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:13.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.823 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.823 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6825", 2024-09-19T09:20:13.823 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:13.823 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.823 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.823 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:20:13.824 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:20:13.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.824 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:20:13.824 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6820", 2024-09-19T09:20:13.824 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:13.824 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.824 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:20:13.824 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6821", 2024-09-19T09:20:13.824 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:20:13.825 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.825 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.825 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.825 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6817/1334618296", 2024-09-19T09:20:13.825 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6819/1334618296", 2024-09-19T09:20:13.825 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6825/1334618296", 2024-09-19T09:20:13.825 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6821/1334618296", 2024-09-19T09:20:13.826 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:20:13.826 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:20:13.826 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:20:13.826 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:13.826 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.826 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:20:13.826 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-19T09:20:13.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.827 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:20:13.827 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:13.827 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:13.827 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:13.827 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:13.827 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:13.827 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.580838+0000", 2024-09-19T09:20:13.827 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:13.827 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.827 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.827 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:20:13.827 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:13.827 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:13.828 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:13.828 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:13.828 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:13.828 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.599990+0000", 2024-09-19T09:20:13.828 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:13.829 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.829 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.829 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:20:13.829 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:13.829 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:13.830 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:13.830 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:13.830 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:13.830 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.503722+0000", 2024-09-19T09:20:13.830 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:13.830 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.831 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.831 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:20:13.831 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:13.831 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:13.831 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:13.831 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:13.831 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:13.831 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.607846+0000", 2024-09-19T09:20:13.831 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:13.832 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.832 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.832 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:20:13.832 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:13.832 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:13.832 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:13.833 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:13.833 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:13.833 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.616858+0000", 2024-09-19T09:20:13.833 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:13.833 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.833 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.833 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:20:13.833 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:13.833 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:13.833 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:13.833 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:13.834 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:13.834 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.542726+0000", 2024-09-19T09:20:13.834 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:13.834 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.834 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.834 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:20:13.834 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:13.834 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:13.834 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:13.834 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:13.834 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:13.834 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.534178+0000", 2024-09-19T09:20:13.835 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:13.835 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.835 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:13.835 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:20:13.835 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:20:13.835 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:20:13.835 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:20:13.835 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:20:13.835 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:20:13.835 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.612105+0000", 2024-09-19T09:20:13.835 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:20:13.835 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.835 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:20:13.836 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-19T09:20:13.836 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-19T09:20:13.836 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-19T09:20:13.836 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-19T09:20:13.836 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-19T09:20:13.836 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-19T09:20:13.836 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-19T09:20:13.836 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-19T09:20:13.836 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-19T09:20:13.836 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-19T09:20:13.836 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-19T09:20:13.836 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-19T09:20:13.836 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-19T09:20:13.837 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-19T09:20:13.837 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.837 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:13.837 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-19T09:20:13.837 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-19T09:20:13.837 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-19T09:20:13.837 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-19T09:20:13.837 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-19T09:20:13.837 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-19T09:20:13.837 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-19T09:20:13.837 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-19T09:20:13.837 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-19T09:20:13.837 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-19T09:20:13.838 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-19T09:20:13.838 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:13.838 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:20:13.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.741+0000 7f8c7d911640 1 -- 172.21.15.18:0/3430030118 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8c6406c2e0 msgr2=0x7f8c6406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:13.839 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.741+0000 7f8c7d911640 1 --2- 172.21.15.18:0/3430030118 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8c6406c2e0 0x7f8c6406e7a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8c7815bd00 tx=0x7f8c68009040 comp rx=0 tx=0).stop 2024-09-19T09:20:13.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.741+0000 7f8c7d911640 1 -- 172.21.15.18:0/3430030118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c7806d1b0 msgr2=0x7f8c7806d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:13.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.741+0000 7f8c7d911640 1 --2- 172.21.15.18:0/3430030118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c7806d1b0 0x7f8c7806d660 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f8c780b5f90 tx=0x7f8c700115a0 comp rx=0 tx=0).stop 2024-09-19T09:20:13.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.741+0000 7f8c7d911640 1 -- 172.21.15.18:0/3430030118 shutdown_connections 2024-09-19T09:20:13.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.741+0000 7f8c7d911640 1 --2- 172.21.15.18:0/3430030118 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8c6406c2e0 0x7f8c6406e7a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:13.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.741+0000 7f8c7d911640 1 --2- 172.21.15.18:0/3430030118 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c7806d1b0 0x7f8c7806d660 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:13.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.741+0000 7f8c7d911640 1 --2- 172.21.15.18:0/3430030118 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c78160e00 0x7f8c780ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:13.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.741+0000 7f8c7d911640 1 --2- 172.21.15.18:0/3430030118 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c60003f60 0x7f8c781541f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:13.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.741+0000 7f8c7d911640 1 -- 172.21.15.18:0/3430030118 >> 172.21.15.18:0/3430030118 conn(0x7f8c780d4bd0 msgr2=0x7f8c780b3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:13.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.741+0000 7f8c7d911640 1 -- 172.21.15.18:0/3430030118 shutdown_connections 2024-09-19T09:20:13.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.741+0000 7f8c7d911640 1 -- 172.21.15.18:0/3430030118 wait complete. 2024-09-19T09:20:13.841 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:20:13.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.943+0000 7f003c480640 1 Processor -- start 2024-09-19T09:20:13.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.943+0000 7f003c480640 1 -- start start 2024-09-19T09:20:13.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.944+0000 7f003c480640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f00340d1c70 0x7f00340cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:13.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.944+0000 7f003c480640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00340b5b00 0x7f00340cff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:13.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.944+0000 7f003c480640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00340d31b0 con 0x7f003415ed50 2024-09-19T09:20:13.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.944+0000 7f003c480640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f00340d3490 con 0x7f00340d1c70 2024-09-19T09:20:13.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.944+0000 7f003c480640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f00340d3770 con 0x7f00340b5b00 2024-09-19T09:20:13.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.944+0000 7f0039a1b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f00340d1c70 0x7f00340cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:13.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.944+0000 7f0039a1b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f00340d1c70 0x7f00340cf9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38604/0 (socket says 172.21.15.18:38604) 2024-09-19T09:20:13.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.944+0000 7f0039a1b640 1 -- 172.21.15.18:0/2447007603 learned_addr learned my addr 172.21.15.18:0/2447007603 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:13.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.944+0000 7f003aa1d640 1 --2- 172.21.15.18:0/2447007603 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00340b5b00 0x7f00340cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:13.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.944+0000 7f0039a1b640 1 -- 172.21.15.18:0/2447007603 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00340b5b00 msgr2=0x7f00340cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:13.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.944+0000 7f0039a1b640 1 --2- 172.21.15.18:0/2447007603 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00340b5b00 0x7f00340cff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:13.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.944+0000 7f0039a1b640 1 -- 172.21.15.18:0/2447007603 >> v1:172.21.15.162:6789/0 conn(0x7f003415ed50 legacy=0x7f00340d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:13.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.944+0000 7f0039a1b640 1 -- 172.21.15.18:0/2447007603 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00340d3a50 con 0x7f00340d1c70 2024-09-19T09:20:13.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.945+0000 7f0039a1b640 1 --2- 172.21.15.18:0/2447007603 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00340d1c70 0x7f00340cf9c0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f0024009870 tx=0x7f002402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44cf53fb7be94661 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:13.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.945+0000 7f003921a640 1 -- 172.21.15.18:0/2447007603 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0024037070 con 0x7f00340d1c70 2024-09-19T09:20:13.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.945+0000 7f003921a640 1 -- 172.21.15.18:0/2447007603 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f002402ae50 con 0x7f00340d1c70 2024-09-19T09:20:13.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.945+0000 7f003921a640 1 -- 172.21.15.18:0/2447007603 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0024032860 con 0x7f00340d1c70 2024-09-19T09:20:13.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.946+0000 7f003c480640 1 -- 172.21.15.18:0/2447007603 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00340d1c70 msgr2=0x7f00340cf9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:13.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.946+0000 7f003c480640 1 --2- 172.21.15.18:0/2447007603 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00340d1c70 0x7f00340cf9c0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f0024009870 tx=0x7f002402a300 comp rx=0 tx=0).stop 2024-09-19T09:20:13.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.946+0000 7f003c480640 1 -- 172.21.15.18:0/2447007603 shutdown_connections 2024-09-19T09:20:13.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.946+0000 7f003c480640 1 --2- 172.21.15.18:0/2447007603 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f00340b5b00 0x7f00340cff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:13.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.946+0000 7f003c480640 1 --2- 172.21.15.18:0/2447007603 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00340d1c70 0x7f00340cf9c0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:13.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.946+0000 7f003c480640 1 -- 172.21.15.18:0/2447007603 >> 172.21.15.18:0/2447007603 conn(0x7f00340d4bd0 msgr2=0x7f00340d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:13.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.946+0000 7f003c480640 1 -- 172.21.15.18:0/2447007603 shutdown_connections 2024-09-19T09:20:13.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.946+0000 7f003c480640 1 -- 172.21.15.18:0/2447007603 wait complete. 2024-09-19T09:20:13.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.947+0000 7f003c480640 1 Processor -- start 2024-09-19T09:20:13.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.947+0000 7f003c480640 1 -- start start 2024-09-19T09:20:13.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.948+0000 7f003c480640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00340b5b00 0x7f0034153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:13.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.948+0000 7f003c480640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00340d1c70 0x7f00340cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:13.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.948+0000 7f003c480640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f003415ed50 0x7f00340cd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:13.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.948+0000 7f003c480640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f003415f130 con 0x7f00340b5b00 2024-09-19T09:20:13.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.948+0000 7f003c480640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f00340d3d30 con 0x7f00340d1c70 2024-09-19T09:20:13.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.948+0000 7f003c480640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f00340ba550 con 0x7f003415ed50 2024-09-19T09:20:13.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.948+0000 7f003a21c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00340b5b00 0x7f0034153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:13.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.948+0000 7f003a21c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00340b5b00 0x7f0034153e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38614/0 (socket says 172.21.15.18:38614) 2024-09-19T09:20:13.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.948+0000 7f003a21c640 1 -- 172.21.15.18:0/4223783394 learned_addr learned my addr 172.21.15.18:0/4223783394 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:13.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.948+0000 7f0039a1b640 1 --2- 172.21.15.18:0/4223783394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00340d1c70 0x7f00340cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:13.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.948+0000 7f003aa1d640 1 --2- 172.21.15.18:0/4223783394 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f003415ed50 0x7f00340cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:13.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.948+0000 7f003a21c640 1 -- 172.21.15.18:0/4223783394 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f003415ed50 msgr2=0x7f00340cd720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:13.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.948+0000 7f003a21c640 1 --2- 172.21.15.18:0/4223783394 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f003415ed50 0x7f00340cd720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:13.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.948+0000 7f003a21c640 1 -- 172.21.15.18:0/4223783394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00340d1c70 msgr2=0x7f00340cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:13.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.948+0000 7f003a21c640 1 --2- 172.21.15.18:0/4223783394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00340d1c70 0x7f00340cd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:13.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.948+0000 7f003a21c640 1 -- 172.21.15.18:0/4223783394 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00340b9940 con 0x7f00340b5b00 2024-09-19T09:20:13.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.948+0000 7f003aa1d640 1 --2- 172.21.15.18:0/4223783394 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f003415ed50 0x7f00340cd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:13.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.948+0000 7f003a21c640 1 --2- 172.21.15.18:0/4223783394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00340b5b00 0x7f0034153e30 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f003000c3c0 tx=0x7f003000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:13.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.948+0000 7f002affd640 1 -- 172.21.15.18:0/4223783394 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00300052d0 con 0x7f00340b5b00 2024-09-19T09:20:13.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.948+0000 7f002affd640 1 -- 172.21.15.18:0/4223783394 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0030005490 con 0x7f00340b5b00 2024-09-19T09:20:13.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.948+0000 7f003c480640 1 -- 172.21.15.18:0/4223783394 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00340b9c20 con 0x7f00340b5b00 2024-09-19T09:20:13.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.948+0000 7f002affd640 1 -- 172.21.15.18:0/4223783394 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0030007260 con 0x7f00340b5b00 2024-09-19T09:20:13.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.949+0000 7f003c480640 1 -- 172.21.15.18:0/4223783394 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00340ba1e0 con 0x7f00340b5b00 2024-09-19T09:20:13.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.949+0000 7f003c480640 1 -- 172.21.15.18:0/4223783394 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00340d2300 con 0x7f00340b5b00 2024-09-19T09:20:13.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.950+0000 7f002affd640 1 -- 172.21.15.18:0/4223783394 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0030007400 con 0x7f00340b5b00 2024-09-19T09:20:13.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.950+0000 7f002affd640 1 --2- 172.21.15.18:0/4223783394 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f001806c2b0 0x7f001806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:13.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.951+0000 7f002affd640 1 -- 172.21.15.18:0/4223783394 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5709+0+0 (secure 0 0 0) 0x7f003008a7a0 con 0x7f00340b5b00 2024-09-19T09:20:13.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.951+0000 7f0039a1b640 1 --2- 172.21.15.18:0/4223783394 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f001806c2b0 0x7f001806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:13.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.951+0000 7f0039a1b640 1 --2- 172.21.15.18:0/4223783394 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f001806c2b0 0x7f001806e770 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0024034000 tx=0x7f002402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:13.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:13.955+0000 7f002affd640 1 -- 172.21.15.18:0/4223783394 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0030058950 con 0x7f00340b5b00 2024-09-19T09:20:14.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.165+0000 7f003c480640 1 -- 172.21.15.18:0/4223783394 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00340b6de0 con 0x7f00340b5b00 2024-09-19T09:20:14.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.166+0000 7f002affd640 1 -- 172.21.15.18:0/4223783394 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5231 (secure 0 0 0) 0x7f003005cc50 con 0x7f00340b5b00 2024-09-19T09:20:14.167 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:20:14.167 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":56,"btime":"2024-09-19T09:19:43:414636+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5846,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1876507362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1876507362},{"type":"v1","addr":"172.21.15.162:6837","nonce":1876507362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2245870616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2245870616},{"type":"v1","addr":"172.21.15.162:6835","nonce":2245870616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6858,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1245398837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1245398837},{"type":"v1","addr":"172.21.15.18:6834","nonce":1245398837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:19:39.754151+0000","modified":"2024-09-19T09:19:42.581316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6861":{"gid":6861,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/2894746570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2894746570},{"type":"v1","addr":"172.21.15.18:6835","nonce":2894746570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6861,"qdb_cluster":[6861]},"id":8}]} 2024-09-19T09:20:14.167 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 56 2024-09-19T09:20:14.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.168+0000 7f003c480640 1 -- 172.21.15.18:0/4223783394 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f001806c2b0 msgr2=0x7f001806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:14.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.168+0000 7f003c480640 1 --2- 172.21.15.18:0/4223783394 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f001806c2b0 0x7f001806e770 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0024034000 tx=0x7f002402e000 comp rx=0 tx=0).stop 2024-09-19T09:20:14.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.168+0000 7f003c480640 1 -- 172.21.15.18:0/4223783394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00340b5b00 msgr2=0x7f0034153e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:14.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.168+0000 7f003c480640 1 --2- 172.21.15.18:0/4223783394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00340b5b00 0x7f0034153e30 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f003000c3c0 tx=0x7f003000c880 comp rx=0 tx=0).stop 2024-09-19T09:20:14.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.168+0000 7f003c480640 1 -- 172.21.15.18:0/4223783394 shutdown_connections 2024-09-19T09:20:14.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.168+0000 7f003c480640 1 --2- 172.21.15.18:0/4223783394 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f001806c2b0 0x7f001806e770 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:14.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.168+0000 7f003c480640 1 --2- 172.21.15.18:0/4223783394 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f003415ed50 0x7f00340cd720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:14.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.168+0000 7f003c480640 1 --2- 172.21.15.18:0/4223783394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00340d1c70 0x7f00340cd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:14.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.168+0000 7f003c480640 1 --2- 172.21.15.18:0/4223783394 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f00340b5b00 0x7f0034153e30 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:14.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.168+0000 7f003c480640 1 -- 172.21.15.18:0/4223783394 >> 172.21.15.18:0/4223783394 conn(0x7f00340d4bd0 msgr2=0x7f003406d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:14.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.168+0000 7f003c480640 1 -- 172.21.15.18:0/4223783394 shutdown_connections 2024-09-19T09:20:14.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.168+0000 7f003c480640 1 -- 172.21.15.18:0/4223783394 wait complete. 2024-09-19T09:20:14.180 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-19T09:20:14.301 INFO:teuthology.orchestra.run.smithi018.stdout:{"cluster_fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","whoami":0,"id":6861,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":33.899600341999999,"mdsmap_epoch":56,"osdmap_epoch":141,"osdmap_epoch_barrier":140,"uptime":44.008573243000001} 2024-09-19T09:20:14.302 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", "fs_name": "cephfs", "id": 6861, "mdsmap_epoch": 56, "osdmap_epoch": 141, "osdmap_epoch_barrier": 140, "rank_uptime": 33.899600342, "state": "up:active", "uptime": 44.008573243, "want_state": "up:active", "whoami": 0 } 2024-09-19T09:20:14.302 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-19T09:20:14.302 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:20:14.302 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:20:14.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:20:14.321 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2024-09-19T09:20:14.542 INFO:teuthology.orchestra.run.smithi018.stderr:50+0 records in 2024-09-19T09:20:14.542 INFO:teuthology.orchestra.run.smithi018.stderr:50+0 records out 2024-09-19T09:20:14.542 INFO:teuthology.orchestra.run.smithi018.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.166145 s, 316 MB/s 2024-09-19T09:20:14.543 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T09:20:14.543 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:20:14.591 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:20:14.635 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T09:20:14.635 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:20:14.635 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:20:14.636 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:20:14.655 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:20:14.655 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:20:14.712 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T09:20:14.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.855+0000 7f775063c640 1 Processor -- start 2024-09-19T09:20:14.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.856+0000 7f775063c640 1 -- start start 2024-09-19T09:20:14.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.856+0000 7f775063c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f774815eda0 0x7f77480d5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:14.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.856+0000 7f775063c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77480d0480 0x7f77480d35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:14.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.857+0000 7f775063c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77480d0bf0 con 0x7f77480d3af0 2024-09-19T09:20:14.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.857+0000 7f775063c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f77480d2880 con 0x7f774815eda0 2024-09-19T09:20:14.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.857+0000 7f775063c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f77480d3120 con 0x7f77480d0480 2024-09-19T09:20:14.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.857+0000 7f774dbd7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77480d0480 0x7f77480d35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:14.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.857+0000 7f774e3d8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f774815eda0 0x7f77480d5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:14.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.857+0000 7f774ebd9640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f77480d3af0 0x7f77480d1630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:39200/0 (socket says 172.21.15.18:39200) 2024-09-19T09:20:14.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.857+0000 7f774dbd7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77480d0480 0x7f77480d35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:36458/0 (socket says 172.21.15.18:36458) 2024-09-19T09:20:14.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.857+0000 7f774ebd9640 1 -- 172.21.15.18:0/2329885089 learned_addr learned my addr 172.21.15.18:0/2329885089 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:20:14.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.857+0000 7f774dbd7640 1 -- 172.21.15.18:0/2329885089 >> v2:172.21.15.162:3300/0 conn(0x7f774815eda0 msgr2=0x7f77480d5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:14.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.857+0000 7f774dbd7640 1 --2- 172.21.15.18:0/2329885089 >> v2:172.21.15.162:3300/0 conn(0x7f774815eda0 0x7f77480d5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:14.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.857+0000 7f774dbd7640 1 -- 172.21.15.18:0/2329885089 >> v1:172.21.15.162:6789/0 conn(0x7f77480d3af0 legacy=0x7f77480d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:14.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.857+0000 7f774dbd7640 1 -- 172.21.15.18:0/2329885089 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77480d2ad0 con 0x7f77480d0480 2024-09-19T09:20:14.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.857+0000 7f774e3d8640 1 --2- 172.21.15.18:0/2329885089 >> v2:172.21.15.162:3300/0 conn(0x7f774815eda0 0x7f77480d5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:14.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.858+0000 7f774dbd7640 1 --2- 172.21.15.18:0/2329885089 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77480d0480 0x7f77480d35b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f77380097a0 tx=0x7f773802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8bbb25db28b17fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:14.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.858+0000 7f774d3d6640 1 -- 172.21.15.18:0/2329885089 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7738037070 con 0x7f77480d0480 2024-09-19T09:20:14.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.858+0000 7f774d3d6640 1 -- 172.21.15.18:0/2329885089 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7738032440 con 0x7f77480d0480 2024-09-19T09:20:14.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.858+0000 7f774d3d6640 1 -- 172.21.15.18:0/2329885089 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7738032810 con 0x7f77480d0480 2024-09-19T09:20:14.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.859+0000 7f775063c640 1 -- 172.21.15.18:0/2329885089 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77480d0480 msgr2=0x7f77480d35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:14.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.859+0000 7f775063c640 1 --2- 172.21.15.18:0/2329885089 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77480d0480 0x7f77480d35b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f77380097a0 tx=0x7f773802a180 comp rx=0 tx=0).stop 2024-09-19T09:20:14.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.859+0000 7f775063c640 1 -- 172.21.15.18:0/2329885089 shutdown_connections 2024-09-19T09:20:14.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.859+0000 7f775063c640 1 --2- 172.21.15.18:0/2329885089 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77480d0480 0x7f77480d35b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:14.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.859+0000 7f775063c640 1 --2- 172.21.15.18:0/2329885089 >> v2:172.21.15.162:3300/0 conn(0x7f774815eda0 0x7f77480d5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:14.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.859+0000 7f775063c640 1 -- 172.21.15.18:0/2329885089 >> 172.21.15.18:0/2329885089 conn(0x7f774809df40 msgr2=0x7f77480d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:14.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.859+0000 7f775063c640 1 -- 172.21.15.18:0/2329885089 shutdown_connections 2024-09-19T09:20:14.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.859+0000 7f775063c640 1 -- 172.21.15.18:0/2329885089 wait complete. 2024-09-19T09:20:14.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.860+0000 7f775063c640 1 Processor -- start 2024-09-19T09:20:14.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.860+0000 7f775063c640 1 -- start start 2024-09-19T09:20:14.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.861+0000 7f775063c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77480d0480 0x7f774814d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:14.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.861+0000 7f775063c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f774815eda0 0x7f77480a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:14.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.861+0000 7f775063c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77480a1ac0 0x7f774809e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:14.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.861+0000 7f775063c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f774815f180 con 0x7f77480d0480 2024-09-19T09:20:14.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.861+0000 7f775063c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f77480d08c0 con 0x7f774815eda0 2024-09-19T09:20:14.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.861+0000 7f775063c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f774815f300 con 0x7f77480a1ac0 2024-09-19T09:20:14.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.861+0000 7f774e3d8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77480d0480 0x7f774814d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:14.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.861+0000 7f774e3d8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77480d0480 0x7f774814d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:38628/0 (socket says 172.21.15.18:38628) 2024-09-19T09:20:14.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.861+0000 7f774e3d8640 1 -- 172.21.15.18:0/3807003519 learned_addr learned my addr 172.21.15.18:0/3807003519 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:14.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.861+0000 7f774ebd9640 1 --2- 172.21.15.18:0/3807003519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77480a1ac0 0x7f774809e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:14.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.861+0000 7f774dbd7640 1 --2- 172.21.15.18:0/3807003519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f774815eda0 0x7f77480a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:14.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.861+0000 7f774e3d8640 1 -- 172.21.15.18:0/3807003519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77480a1ac0 msgr2=0x7f774809e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:14.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.861+0000 7f774e3d8640 1 --2- 172.21.15.18:0/3807003519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77480a1ac0 0x7f774809e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:14.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.861+0000 7f774e3d8640 1 -- 172.21.15.18:0/3807003519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f774815eda0 msgr2=0x7f77480a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:14.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.861+0000 7f774e3d8640 1 --2- 172.21.15.18:0/3807003519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f774815eda0 0x7f77480a1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:14.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.861+0000 7f774e3d8640 1 -- 172.21.15.18:0/3807003519 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77480c9a60 con 0x7f77480d0480 2024-09-19T09:20:14.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.862+0000 7f774e3d8640 1 --2- 172.21.15.18:0/3807003519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77480d0480 0x7f774814d140 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f774400e960 tx=0x7f774400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:14.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.862+0000 7f773effd640 1 -- 172.21.15.18:0/3807003519 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7744017070 con 0x7f77480d0480 2024-09-19T09:20:14.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.862+0000 7f773effd640 1 -- 172.21.15.18:0/3807003519 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f774400ca00 con 0x7f77480d0480 2024-09-19T09:20:14.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.862+0000 7f773effd640 1 -- 172.21.15.18:0/3807003519 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f774400cdd0 con 0x7f77480d0480 2024-09-19T09:20:14.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.862+0000 7f775063c640 1 -- 172.21.15.18:0/3807003519 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77480a2070 con 0x7f77480d0480 2024-09-19T09:20:14.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.862+0000 7f775063c640 1 -- 172.21.15.18:0/3807003519 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77480c9d00 con 0x7f77480d0480 2024-09-19T09:20:14.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.863+0000 7f775063c640 1 -- 172.21.15.18:0/3807003519 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77480d35b0 con 0x7f77480d0480 2024-09-19T09:20:14.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.863+0000 7f773effd640 1 -- 172.21.15.18:0/3807003519 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f774401a070 con 0x7f77480d0480 2024-09-19T09:20:14.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.864+0000 7f773effd640 1 --2- 172.21.15.18:0/3807003519 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f772c06c2e0 0x7f772c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:14.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.864+0000 7f773effd640 1 -- 172.21.15.18:0/3807003519 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5709+0+0 (secure 0 0 0) 0x7f774408b3a0 con 0x7f77480d0480 2024-09-19T09:20:14.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.864+0000 7f774dbd7640 1 --2- 172.21.15.18:0/3807003519 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f772c06c2e0 0x7f772c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:14.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.865+0000 7f774dbd7640 1 --2- 172.21.15.18:0/3807003519 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f772c06c2e0 0x7f772c06e7a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7738034000 tx=0x7f773802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:14.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:14.868+0000 7f773effd640 1 -- 172.21.15.18:0/3807003519 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7744059a70 con 0x7f77480d0480 2024-09-19T09:20:15.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.058+0000 7f775063c640 1 -- 172.21.15.18:0/3807003519 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f77480d2330 con 0x7f77480d0480 2024-09-19T09:20:15.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.059+0000 7f773effd640 1 -- 172.21.15.18:0/3807003519 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v141) ==== 80+0+0 (secure 0 0 0) 0x7f7744059370 con 0x7f77480d0480 2024-09-19T09:20:15.060 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-09-19T09:20:15.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.061+0000 7f775063c640 1 -- 172.21.15.18:0/3807003519 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f772c06c2e0 msgr2=0x7f772c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:15.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.061+0000 7f775063c640 1 --2- 172.21.15.18:0/3807003519 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f772c06c2e0 0x7f772c06e7a0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f7738034000 tx=0x7f773802e000 comp rx=0 tx=0).stop 2024-09-19T09:20:15.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.061+0000 7f775063c640 1 -- 172.21.15.18:0/3807003519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77480d0480 msgr2=0x7f774814d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:15.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.061+0000 7f775063c640 1 --2- 172.21.15.18:0/3807003519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77480d0480 0x7f774814d140 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f774400e960 tx=0x7f774400ee20 comp rx=0 tx=0).stop 2024-09-19T09:20:15.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.061+0000 7f775063c640 1 -- 172.21.15.18:0/3807003519 shutdown_connections 2024-09-19T09:20:15.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.061+0000 7f775063c640 1 --2- 172.21.15.18:0/3807003519 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f772c06c2e0 0x7f772c06e7a0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:15.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.061+0000 7f775063c640 1 --2- 172.21.15.18:0/3807003519 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77480a1ac0 0x7f774809e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:15.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.061+0000 7f775063c640 1 --2- 172.21.15.18:0/3807003519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f774815eda0 0x7f77480a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:15.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.061+0000 7f775063c640 1 --2- 172.21.15.18:0/3807003519 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77480d0480 0x7f774814d140 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:15.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.061+0000 7f775063c640 1 -- 172.21.15.18:0/3807003519 >> 172.21.15.18:0/3807003519 conn(0x7f774809df40 msgr2=0x7f77480b84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:15.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.061+0000 7f775063c640 1 -- 172.21.15.18:0/3807003519 shutdown_connections 2024-09-19T09:20:15.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.061+0000 7f775063c640 1 -- 172.21.15.18:0/3807003519 wait complete. 2024-09-19T09:20:15.073 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T09:20:15.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:20:15.073 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-19T09:20:15.129 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T09:20:15.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:20:15.130 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T09:20:15.150 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:20:15.150 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:20:15.150 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:20:15.169 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:20:15.169 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:20:15.228 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T09:20:15.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.331+0000 7fd2216f1640 1 Processor -- start 2024-09-19T09:20:15.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.331+0000 7fd2216f1640 1 -- start start 2024-09-19T09:20:15.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.331+0000 7fd2216f1640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd21c0ce070 0x7fd21c0b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:15.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.331+0000 7fd2216f1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd21c0cf890 0x7fd21c0cfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:15.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.331+0000 7fd2216f1640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd21c15d880 con 0x7fd21c15bfb0 2024-09-19T09:20:15.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.331+0000 7fd2216f1640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fd21c0d0240 con 0x7fd21c0cf890 2024-09-19T09:20:15.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.331+0000 7fd2216f1640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd21c0ce450 con 0x7fd21c0ce070 2024-09-19T09:20:15.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.332+0000 7fd21b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd21c0cf890 0x7fd21c0cfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:15.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.332+0000 7fd21b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd21c0cf890 0x7fd21c0cfd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53060/0 (socket says 172.21.15.18:53060) 2024-09-19T09:20:15.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.332+0000 7fd21b7fe640 1 -- 172.21.15.18:0/400438285 learned_addr learned my addr 172.21.15.18:0/400438285 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:15.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.332+0000 7fd21affd640 1 --2- 172.21.15.18:0/400438285 >> v2:172.21.15.162:3300/0 conn(0x7fd21c0ce070 0x7fd21c0b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:15.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.332+0000 7fd21b7fe640 1 -- 172.21.15.18:0/400438285 >> v2:172.21.15.162:3300/0 conn(0x7fd21c0ce070 msgr2=0x7fd21c0b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:15.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.332+0000 7fd21b7fe640 1 --2- 172.21.15.18:0/400438285 >> v2:172.21.15.162:3300/0 conn(0x7fd21c0ce070 0x7fd21c0b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:15.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.332+0000 7fd21b7fe640 1 -- 172.21.15.18:0/400438285 >> v1:172.21.15.162:6789/0 conn(0x7fd21c15bfb0 legacy=0x7fd21c15d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:15.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.332+0000 7fd21b7fe640 1 -- 172.21.15.18:0/400438285 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21c15c800 con 0x7fd21c0cf890 2024-09-19T09:20:15.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.333+0000 7fd21b7fe640 1 --2- 172.21.15.18:0/400438285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd21c0cf890 0x7fd21c0cfd00 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fd21c06d030 tx=0x7fd21402a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f43803b4421a3c52 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:15.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.333+0000 7fd219ffb640 1 -- 172.21.15.18:0/400438285 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd214036070 con 0x7fd21c0cf890 2024-09-19T09:20:15.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.333+0000 7fd219ffb640 1 -- 172.21.15.18:0/400438285 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd214031600 con 0x7fd21c0cf890 2024-09-19T09:20:15.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.333+0000 7fd219ffb640 1 -- 172.21.15.18:0/400438285 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2140319d0 con 0x7fd21c0cf890 2024-09-19T09:20:15.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.333+0000 7fd2216f1640 1 -- 172.21.15.18:0/400438285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd21c0cf890 msgr2=0x7fd21c0cfd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:15.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.333+0000 7fd2216f1640 1 --2- 172.21.15.18:0/400438285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd21c0cf890 0x7fd21c0cfd00 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fd21c06d030 tx=0x7fd21402a730 comp rx=0 tx=0).stop 2024-09-19T09:20:15.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.333+0000 7fd2216f1640 1 -- 172.21.15.18:0/400438285 shutdown_connections 2024-09-19T09:20:15.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.333+0000 7fd2216f1640 1 --2- 172.21.15.18:0/400438285 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd21c0cf890 0x7fd21c0cfd00 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:15.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.333+0000 7fd2216f1640 1 --2- 172.21.15.18:0/400438285 >> v2:172.21.15.162:3300/0 conn(0x7fd21c0ce070 0x7fd21c0b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:15.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.333+0000 7fd2216f1640 1 -- 172.21.15.18:0/400438285 >> 172.21.15.18:0/400438285 conn(0x7fd21c0b2630 msgr2=0x7fd21c0b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:15.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.333+0000 7fd2216f1640 1 -- 172.21.15.18:0/400438285 shutdown_connections 2024-09-19T09:20:15.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.333+0000 7fd2216f1640 1 -- 172.21.15.18:0/400438285 wait complete. 2024-09-19T09:20:15.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.335+0000 7fd2216f1640 1 Processor -- start 2024-09-19T09:20:15.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.335+0000 7fd2216f1640 1 -- start start 2024-09-19T09:20:15.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.335+0000 7fd2216f1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd21c0ce070 0x7fd21c148370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:15.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.335+0000 7fd2216f1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd21c0cf890 0x7fd21c1e63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:15.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.335+0000 7fd2216f1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd21c15bfb0 0x7fd21c15aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:15.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.335+0000 7fd2216f1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c15c410 con 0x7fd21c0ce070 2024-09-19T09:20:15.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.335+0000 7fd2216f1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd21c15cdc0 con 0x7fd21c15bfb0 2024-09-19T09:20:15.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.335+0000 7fd2216f1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd21c15c590 con 0x7fd21c0cf890 2024-09-19T09:20:15.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.336+0000 7fd21affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd21c0ce070 0x7fd21c148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:15.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.336+0000 7fd21affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd21c0ce070 0x7fd21c148370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53076/0 (socket says 172.21.15.18:53076) 2024-09-19T09:20:15.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.336+0000 7fd21affd640 1 -- 172.21.15.18:0/1815570507 learned_addr learned my addr 172.21.15.18:0/1815570507 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:15.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.336+0000 7fd21b7fe640 1 --2- 172.21.15.18:0/1815570507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd21c15bfb0 0x7fd21c15aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:15.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.336+0000 7fd21affd640 1 -- 172.21.15.18:0/1815570507 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd21c0cf890 msgr2=0x7fd21c1e63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:15.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.336+0000 7fd21affd640 1 --2- 172.21.15.18:0/1815570507 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd21c0cf890 0x7fd21c1e63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:15.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.336+0000 7fd21affd640 1 -- 172.21.15.18:0/1815570507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd21c15bfb0 msgr2=0x7fd21c15aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:15.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.336+0000 7fd21affd640 1 --2- 172.21.15.18:0/1815570507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd21c15bfb0 0x7fd21c15aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:15.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.336+0000 7fd21affd640 1 -- 172.21.15.18:0/1815570507 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd21c1e5630 con 0x7fd21c0ce070 2024-09-19T09:20:15.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.336+0000 7fd21affd640 1 --2- 172.21.15.18:0/1815570507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd21c0ce070 0x7fd21c148370 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fd20c00e870 tx=0x7fd20c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:15.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.336+0000 7fd2037fe640 1 -- 172.21.15.18:0/1815570507 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20c017070 con 0x7fd21c0ce070 2024-09-19T09:20:15.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.336+0000 7fd2037fe640 1 -- 172.21.15.18:0/1815570507 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd20c00c940 con 0x7fd21c0ce070 2024-09-19T09:20:15.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.336+0000 7fd2037fe640 1 -- 172.21.15.18:0/1815570507 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20c00cd30 con 0x7fd21c0ce070 2024-09-19T09:20:15.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.336+0000 7fd2216f1640 1 -- 172.21.15.18:0/1815570507 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd21c1e5910 con 0x7fd21c0ce070 2024-09-19T09:20:15.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.336+0000 7fd2216f1640 1 -- 172.21.15.18:0/1815570507 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd21c1e5ed0 con 0x7fd21c0ce070 2024-09-19T09:20:15.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.337+0000 7fd2216f1640 1 -- 172.21.15.18:0/1815570507 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd21c0b5750 con 0x7fd21c0ce070 2024-09-19T09:20:15.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.338+0000 7fd2037fe640 1 -- 172.21.15.18:0/1815570507 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd20c01a070 con 0x7fd21c0ce070 2024-09-19T09:20:15.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.338+0000 7fd2037fe640 1 --2- 172.21.15.18:0/1815570507 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd20806c2b0 0x7fd20806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:15.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.338+0000 7fd2037fe640 1 -- 172.21.15.18:0/1815570507 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5709+0+0 (secure 0 0 0) 0x7fd20c08b6b0 con 0x7fd21c0ce070 2024-09-19T09:20:15.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.339+0000 7fd21a7fc640 1 --2- 172.21.15.18:0/1815570507 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd20806c2b0 0x7fd20806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:15.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.339+0000 7fd21a7fc640 1 --2- 172.21.15.18:0/1815570507 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd20806c2b0 0x7fd20806e770 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd210000f60 tx=0x7fd2100079d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:15.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.342+0000 7fd2037fe640 1 -- 172.21.15.18:0/1815570507 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd20c059e10 con 0x7fd21c0ce070 2024-09-19T09:20:15.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.532+0000 7fd2216f1640 1 -- 172.21.15.18:0/1815570507 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd21c0d0420 con 0x7fd21c0ce070 2024-09-19T09:20:15.533 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.532+0000 7fd2037fe640 1 -- 172.21.15.18:0/1815570507 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v141) ==== 80+0+0 (secure 0 0 0) 0x7fd20c059710 con 0x7fd21c0ce070 2024-09-19T09:20:15.533 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-09-19T09:20:15.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.535+0000 7fd2216f1640 1 -- 172.21.15.18:0/1815570507 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd20806c2b0 msgr2=0x7fd20806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:15.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.535+0000 7fd2216f1640 1 --2- 172.21.15.18:0/1815570507 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd20806c2b0 0x7fd20806e770 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd210000f60 tx=0x7fd2100079d0 comp rx=0 tx=0).stop 2024-09-19T09:20:15.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.535+0000 7fd2216f1640 1 -- 172.21.15.18:0/1815570507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd21c0ce070 msgr2=0x7fd21c148370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:15.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.535+0000 7fd2216f1640 1 --2- 172.21.15.18:0/1815570507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd21c0ce070 0x7fd21c148370 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7fd20c00e870 tx=0x7fd20c00ed30 comp rx=0 tx=0).stop 2024-09-19T09:20:15.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.535+0000 7fd2216f1640 1 -- 172.21.15.18:0/1815570507 shutdown_connections 2024-09-19T09:20:15.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.535+0000 7fd2216f1640 1 --2- 172.21.15.18:0/1815570507 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd20806c2b0 0x7fd20806e770 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:15.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.535+0000 7fd2216f1640 1 --2- 172.21.15.18:0/1815570507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd21c15bfb0 0x7fd21c15aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:15.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.535+0000 7fd2216f1640 1 --2- 172.21.15.18:0/1815570507 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd21c0cf890 0x7fd21c1e63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:15.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.535+0000 7fd2216f1640 1 --2- 172.21.15.18:0/1815570507 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd21c0ce070 0x7fd21c148370 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:15.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.535+0000 7fd2216f1640 1 -- 172.21.15.18:0/1815570507 >> 172.21.15.18:0/1815570507 conn(0x7fd21c0b2630 msgr2=0x7fd21c0b3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:15.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.535+0000 7fd2216f1640 1 -- 172.21.15.18:0/1815570507 shutdown_connections 2024-09-19T09:20:15.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.535+0000 7fd2216f1640 1 -- 172.21.15.18:0/1815570507 wait complete. 2024-09-19T09:20:15.546 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-19T09:20:15.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:20:15.547 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-19T09:20:15.584 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-09-19T09:20:15.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:20:15.585 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-19T09:20:15.643 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:20:15.643 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:20:15.643 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:20:15.660 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17075 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T09:20:15.660 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:20:15.660 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:20:15.660 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:20:15.702 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3252 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T09:20:15.702 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:20:15.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.803+0000 7f2843d4b640 1 Processor -- start 2024-09-19T09:20:15.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.803+0000 7f2843d4b640 1 -- start start 2024-09-19T09:20:15.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.804+0000 7f2843d4b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f283c0ce780 0x7f283c06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:15.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.804+0000 7f2843d4b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f283c06e3d0 con 0x7f283c145290 2024-09-19T09:20:15.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.804+0000 7f2843d4b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f283c06e6b0 con 0x7f283c072f40 2024-09-19T09:20:15.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.804+0000 7f2843d4b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f283c06efe0 con 0x7f283c0ce780 2024-09-19T09:20:15.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.804+0000 7f2841ae7640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f283c145290 0x7f283c072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34902/0 (socket says 172.21.15.18:34902) 2024-09-19T09:20:15.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.804+0000 7f2841ae7640 1 -- 172.21.15.18:0/1042818325 learned_addr learned my addr 172.21.15.18:0/1042818325 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:20:15.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.804+0000 7f28422e8640 1 --2- 172.21.15.18:0/1042818325 >> v2:172.21.15.162:3300/0 conn(0x7f283c0ce780 0x7f283c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:15.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.805+0000 7f2840ae5640 1 -- 172.21.15.18:0/1042818325 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 248093373 0 0) 0x7f283c06e3d0 con 0x7f283c145290 2024-09-19T09:20:15.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.805+0000 7f2840ae5640 1 -- 172.21.15.18:0/1042818325 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2824003520 con 0x7f283c145290 2024-09-19T09:20:15.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.805+0000 7f2840ae5640 1 -- 172.21.15.18:0/1042818325 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2790886476 0 0) 0x7f2824003520 con 0x7f283c145290 2024-09-19T09:20:15.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.805+0000 7f2840ae5640 1 -- 172.21.15.18:0/1042818325 >> v2:172.21.15.162:3300/0 conn(0x7f283c0ce780 msgr2=0x7f283c06f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:15.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.805+0000 7f2840ae5640 1 --2- 172.21.15.18:0/1042818325 >> v2:172.21.15.162:3300/0 conn(0x7f283c0ce780 0x7f283c06f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:15.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.805+0000 7f2840ae5640 1 -- 172.21.15.18:0/1042818325 >> v1:172.21.15.162:6789/0 conn(0x7f283c072f40 legacy=0x7f283c0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:15.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.805+0000 7f2840ae5640 1 -- 172.21.15.18:0/1042818325 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f283c06e990 con 0x7f283c145290 2024-09-19T09:20:15.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.805+0000 7f2840ae5640 1 -- 172.21.15.18:0/1042818325 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f2834001670 con 0x7f283c145290 2024-09-19T09:20:15.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.805+0000 7f2840ae5640 1 -- 172.21.15.18:0/1042818325 >> v1:172.21.15.18:6789/0 conn(0x7f283c145290 legacy=0x7f283c072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:15.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.805+0000 7f2840ae5640 1 --2- 172.21.15.18:0/1042818325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28240039b0 0x7f2824003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:15.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.805+0000 7f2840ae5640 1 --2- 172.21.15.18:0/1042818325 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28240043b0 0x7f2824004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:15.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.805+0000 7f2840ae5640 1 --2- 172.21.15.18:0/1042818325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2824005080 0x7f282400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:15.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.805+0000 7f2840ae5640 1 -- 172.21.15.18:0/1042818325 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f283c06efe0 con 0x7f28240039b0 2024-09-19T09:20:15.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.805+0000 7f2840ae5640 1 -- 172.21.15.18:0/1042818325 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f282400bfe0 con 0x7f2824005080 2024-09-19T09:20:15.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.805+0000 7f2840ae5640 1 -- 172.21.15.18:0/1042818325 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f282400c1e0 con 0x7f28240043b0 2024-09-19T09:20:15.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.805+0000 7f2841ae7640 1 --2- 172.21.15.18:0/1042818325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28240039b0 0x7f2824003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:15.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.805+0000 7f28422e8640 1 --2- 172.21.15.18:0/1042818325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2824005080 0x7f282400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:15.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.805+0000 7f28412e6640 1 --2- 172.21.15.18:0/1042818325 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28240043b0 0x7f2824004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:15.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.805+0000 7f2841ae7640 1 -- 172.21.15.18:0/1042818325 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28240043b0 msgr2=0x7f2824004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:15.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.805+0000 7f2841ae7640 1 --2- 172.21.15.18:0/1042818325 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f28240043b0 0x7f2824004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:15.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.805+0000 7f2841ae7640 1 -- 172.21.15.18:0/1042818325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2824005080 msgr2=0x7f282400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:15.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.805+0000 7f2841ae7640 1 --2- 172.21.15.18:0/1042818325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2824005080 0x7f282400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:15.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.805+0000 7f2841ae7640 1 -- 172.21.15.18:0/1042818325 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2824003520 con 0x7f28240039b0 2024-09-19T09:20:15.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.805+0000 7f28422e8640 1 -- 172.21.15.18:0/1042818325 reap_dead start 2024-09-19T09:20:15.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.806+0000 7f2841ae7640 1 --2- 172.21.15.18:0/1042818325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28240039b0 0x7f2824003d90 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f283400c240 tx=0x7f2824005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff68ae6c65bc195 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:15.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.806+0000 7f2840ae5640 1 -- 172.21.15.18:0/1042818325 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2834007d30 con 0x7f28240039b0 2024-09-19T09:20:15.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.806+0000 7f2840ae5640 1 -- 172.21.15.18:0/1042818325 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2834005af0 con 0x7f28240039b0 2024-09-19T09:20:15.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.806+0000 7f2840ae5640 1 -- 172.21.15.18:0/1042818325 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2834007070 con 0x7f28240039b0 2024-09-19T09:20:15.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.807+0000 7f2843d4b640 1 -- 172.21.15.18:0/1042818325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28240039b0 msgr2=0x7f2824003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:15.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.807+0000 7f2843d4b640 1 --2- 172.21.15.18:0/1042818325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28240039b0 0x7f2824003d90 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f283400c240 tx=0x7f2824005830 comp rx=0 tx=0).stop 2024-09-19T09:20:15.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.807+0000 7f2843d4b640 1 -- 172.21.15.18:0/1042818325 shutdown_connections 2024-09-19T09:20:15.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.807+0000 7f2843d4b640 1 --2- 172.21.15.18:0/1042818325 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f28240039b0 0x7f2824003d90 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:15.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.807+0000 7f2843d4b640 1 -- 172.21.15.18:0/1042818325 >> 172.21.15.18:0/1042818325 conn(0x7f283c06bc10 msgr2=0x7f283c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:15.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.807+0000 7f2843d4b640 1 -- 172.21.15.18:0/1042818325 shutdown_connections 2024-09-19T09:20:15.811 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.807+0000 7f2843d4b640 1 -- 172.21.15.18:0/1042818325 wait complete. 2024-09-19T09:20:15.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.808+0000 7f2843d4b640 1 Processor -- start 2024-09-19T09:20:15.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.808+0000 7f2843d4b640 1 -- start start 2024-09-19T09:20:15.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.809+0000 7f2843d4b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28240039b0 0x7f283c15e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:15.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.809+0000 7f2843d4b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f283c15b120 0x7f283c13d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:15.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.809+0000 7f2843d4b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f283c13da60 0x7f283c13b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:15.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.809+0000 7f2843d4b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f283c06df80 con 0x7f283c13da60 2024-09-19T09:20:15.814 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.809+0000 7f2843d4b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f283c145670 con 0x7f28240039b0 2024-09-19T09:20:15.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.809+0000 7f2843d4b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f283c06e100 con 0x7f283c15b120 2024-09-19T09:20:15.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.809+0000 7f28422e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f283c13da60 0x7f283c13b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:15.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.809+0000 7f28422e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f283c13da60 0x7f283c13b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53104/0 (socket says 172.21.15.18:53104) 2024-09-19T09:20:15.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.809+0000 7f28422e8640 1 -- 172.21.15.18:0/3644074789 learned_addr learned my addr 172.21.15.18:0/3644074789 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:15.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.809+0000 7f28412e6640 1 --2- 172.21.15.18:0/3644074789 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f283c15b120 0x7f283c13d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:15.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.809+0000 7f2841ae7640 1 --2- 172.21.15.18:0/3644074789 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28240039b0 0x7f283c15e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:15.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.809+0000 7f28422e8640 1 -- 172.21.15.18:0/3644074789 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f283c15b120 msgr2=0x7f283c13d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:15.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.809+0000 7f28422e8640 1 --2- 172.21.15.18:0/3644074789 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f283c15b120 0x7f283c13d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:15.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.809+0000 7f28422e8640 1 -- 172.21.15.18:0/3644074789 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28240039b0 msgr2=0x7f283c15e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:15.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.809+0000 7f28422e8640 1 --2- 172.21.15.18:0/3644074789 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28240039b0 0x7f283c15e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:15.815 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.809+0000 7f28422e8640 1 -- 172.21.15.18:0/3644074789 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f283c15c9b0 con 0x7f283c13da60 2024-09-19T09:20:15.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.809+0000 7f28422e8640 1 --2- 172.21.15.18:0/3644074789 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f283c13da60 0x7f283c13b680 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f282c011bf0 tx=0x7f282c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:15.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.810+0000 7f283a7fc640 1 -- 172.21.15.18:0/3644074789 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282c00fe10 con 0x7f283c13da60 2024-09-19T09:20:15.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.810+0000 7f283a7fc640 1 -- 172.21.15.18:0/3644074789 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f282c01d070 con 0x7f283c13da60 2024-09-19T09:20:15.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.810+0000 7f2843d4b640 1 -- 172.21.15.18:0/3644074789 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f283c15cc90 con 0x7f283c13da60 2024-09-19T09:20:15.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.810+0000 7f283a7fc640 1 -- 172.21.15.18:0/3644074789 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282c015670 con 0x7f283c13da60 2024-09-19T09:20:15.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.810+0000 7f2843d4b640 1 -- 172.21.15.18:0/3644074789 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f283c15d250 con 0x7f283c13da60 2024-09-19T09:20:15.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.811+0000 7f2843d4b640 1 -- 172.21.15.18:0/3644074789 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f283c071510 con 0x7f283c13da60 2024-09-19T09:20:15.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.811+0000 7f283a7fc640 1 -- 172.21.15.18:0/3644074789 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f282c015810 con 0x7f283c13da60 2024-09-19T09:20:15.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.812+0000 7f283a7fc640 1 --2- 172.21.15.18:0/3644074789 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f282806c2b0 0x7f282806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:15.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.812+0000 7f283a7fc640 1 -- 172.21.15.18:0/3644074789 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5709+0+0 (secure 0 0 0) 0x7f282c08bd30 con 0x7f283c13da60 2024-09-19T09:20:15.816 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.812+0000 7f2841ae7640 1 --2- 172.21.15.18:0/3644074789 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f282806c2b0 0x7f282806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:15.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.813+0000 7f2841ae7640 1 --2- 172.21.15.18:0/3644074789 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f282806c2b0 0x7f282806e770 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2834032000 tx=0x7f283402d000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:15.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:15.816+0000 7f283a7fc640 1 -- 172.21.15.18:0/3644074789 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f282c010040 con 0x7f283c13da60 2024-09-19T09:20:16.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.027+0000 7f2843d4b640 1 -- 172.21.15.18:0/3644074789 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f283c13f320 con 0x7f283c13da60 2024-09-19T09:20:16.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.027+0000 7f283a7fc640 1 -- 172.21.15.18:0/3644074789 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5231 (secure 0 0 0) 0x7f282c05a4a0 con 0x7f283c13da60 2024-09-19T09:20:16.028 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:20:16.029 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":56,"btime":"2024-09-19T09:19:43:414636+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5846,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1876507362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1876507362},{"type":"v1","addr":"172.21.15.162:6837","nonce":1876507362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2245870616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2245870616},{"type":"v1","addr":"172.21.15.162:6835","nonce":2245870616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6858,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1245398837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1245398837},{"type":"v1","addr":"172.21.15.18:6834","nonce":1245398837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:19:39.754151+0000","modified":"2024-09-19T09:19:42.581316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6861":{"gid":6861,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/2894746570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2894746570},{"type":"v1","addr":"172.21.15.18:6835","nonce":2894746570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6861,"qdb_cluster":[6861]},"id":8}]} 2024-09-19T09:20:16.029 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 56 2024-09-19T09:20:16.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.029+0000 7f2843d4b640 1 -- 172.21.15.18:0/3644074789 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f282806c2b0 msgr2=0x7f282806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:16.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.029+0000 7f2843d4b640 1 --2- 172.21.15.18:0/3644074789 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f282806c2b0 0x7f282806e770 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2834032000 tx=0x7f283402d000 comp rx=0 tx=0).stop 2024-09-19T09:20:16.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.029+0000 7f2843d4b640 1 -- 172.21.15.18:0/3644074789 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f283c13da60 msgr2=0x7f283c13b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:16.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.029+0000 7f2843d4b640 1 --2- 172.21.15.18:0/3644074789 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f283c13da60 0x7f283c13b680 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f282c011bf0 tx=0x7f282c00f580 comp rx=0 tx=0).stop 2024-09-19T09:20:16.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.029+0000 7f2843d4b640 1 -- 172.21.15.18:0/3644074789 shutdown_connections 2024-09-19T09:20:16.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.029+0000 7f2843d4b640 1 --2- 172.21.15.18:0/3644074789 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f282806c2b0 0x7f282806e770 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.029+0000 7f2843d4b640 1 --2- 172.21.15.18:0/3644074789 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f283c13da60 0x7f283c13b680 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.029+0000 7f2843d4b640 1 --2- 172.21.15.18:0/3644074789 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f283c15b120 0x7f283c13d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.029+0000 7f2843d4b640 1 --2- 172.21.15.18:0/3644074789 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f28240039b0 0x7f283c15e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.029+0000 7f2843d4b640 1 -- 172.21.15.18:0/3644074789 >> 172.21.15.18:0/3644074789 conn(0x7f283c06bc10 msgr2=0x7f283c0cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:16.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.029+0000 7f2843d4b640 1 -- 172.21.15.18:0/3644074789 shutdown_connections 2024-09-19T09:20:16.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.029+0000 7f2843d4b640 1 -- 172.21.15.18:0/3644074789 wait complete. 2024-09-19T09:20:16.041 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:20:16.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.143+0000 7fbc864d0640 1 Processor -- start 2024-09-19T09:20:16.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.143+0000 7fbc864d0640 1 -- start start 2024-09-19T09:20:16.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.143+0000 7fbc864d0640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbc800d3240 0x7fbc800b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:16.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.143+0000 7fbc864d0640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc800b7a90 con 0x7fbc800d1ab0 2024-09-19T09:20:16.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.143+0000 7fbc864d0640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc800d3740 con 0x7fbc8015ef50 2024-09-19T09:20:16.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.143+0000 7fbc864d0640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fbc800d3a20 con 0x7fbc800d3240 2024-09-19T09:20:16.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.144+0000 7fbc84a6d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbc800d3240 0x7fbc800b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:16.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.144+0000 7fbc7f7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fbc800d1ab0 0x7fbc800b8500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34918/0 (socket says 172.21.15.18:34918) 2024-09-19T09:20:16.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.144+0000 7fbc7f7fe640 1 -- 172.21.15.18:0/2115318420 learned_addr learned my addr 172.21.15.18:0/2115318420 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:20:16.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.144+0000 7fbc84a6d640 1 -- 172.21.15.18:0/2115318420 >> v1:172.21.15.162:6789/0 conn(0x7fbc8015ef50 legacy=0x7fbc800d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:16.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.144+0000 7fbc84a6d640 1 -- 172.21.15.18:0/2115318420 >> v1:172.21.15.18:6789/0 conn(0x7fbc800d1ab0 legacy=0x7fbc800b8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:16.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.144+0000 7fbc7effd640 1 -- 172.21.15.18:0/2115318420 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2072283655 0 0) 0x7fbc800b7a90 con 0x7fbc800d1ab0 2024-09-19T09:20:16.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.144+0000 7fbc84a6d640 1 -- 172.21.15.18:0/2115318420 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc800b7d00 con 0x7fbc800d3240 2024-09-19T09:20:16.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.145+0000 7fbc84a6d640 1 --2- 172.21.15.18:0/2115318420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc800d3240 0x7fbc800b8c10 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fbc78009d90 tx=0x7fbc7802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccb4b59aa52df0a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:16.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.145+0000 7fbc7effd640 1 -- 172.21.15.18:0/2115318420 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc78007740 con 0x7fbc800d3240 2024-09-19T09:20:16.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.145+0000 7fbc7effd640 1 -- 172.21.15.18:0/2115318420 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc780078e0 con 0x7fbc800d3240 2024-09-19T09:20:16.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.145+0000 7fbc7effd640 1 -- 172.21.15.18:0/2115318420 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc78007cb0 con 0x7fbc800d3240 2024-09-19T09:20:16.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.145+0000 7fbc864d0640 1 -- 172.21.15.18:0/2115318420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc800d3240 msgr2=0x7fbc800b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:16.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.145+0000 7fbc864d0640 1 --2- 172.21.15.18:0/2115318420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc800d3240 0x7fbc800b8c10 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fbc78009d90 tx=0x7fbc7802a660 comp rx=0 tx=0).stop 2024-09-19T09:20:16.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.145+0000 7fbc864d0640 1 -- 172.21.15.18:0/2115318420 shutdown_connections 2024-09-19T09:20:16.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.145+0000 7fbc864d0640 1 --2- 172.21.15.18:0/2115318420 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc800d3240 0x7fbc800b8c10 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.145+0000 7fbc864d0640 1 -- 172.21.15.18:0/2115318420 >> 172.21.15.18:0/2115318420 conn(0x7fbc800d4c60 msgr2=0x7fbc800d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:16.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.145+0000 7fbc864d0640 1 -- 172.21.15.18:0/2115318420 shutdown_connections 2024-09-19T09:20:16.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.145+0000 7fbc864d0640 1 -- 172.21.15.18:0/2115318420 wait complete. 2024-09-19T09:20:16.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.146+0000 7fbc864d0640 1 Processor -- start 2024-09-19T09:20:16.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.147+0000 7fbc864d0640 1 -- start start 2024-09-19T09:20:16.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.147+0000 7fbc864d0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc800d1ab0 0x7fbc800c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:16.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.147+0000 7fbc864d0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc800d3240 0x7fbc800c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:16.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.147+0000 7fbc864d0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc8015ef50 0x7fbc800b89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:16.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.147+0000 7fbc864d0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbc800d21a0 con 0x7fbc800d1ab0 2024-09-19T09:20:16.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.147+0000 7fbc864d0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbc800d2020 con 0x7fbc8015ef50 2024-09-19T09:20:16.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.147+0000 7fbc864d0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbc800d5780 con 0x7fbc800d3240 2024-09-19T09:20:16.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.147+0000 7fbc7ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc800d1ab0 0x7fbc800c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:16.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.148+0000 7fbc7ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc800d1ab0 0x7fbc800c79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53126/0 (socket says 172.21.15.18:53126) 2024-09-19T09:20:16.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.148+0000 7fbc7ffff640 1 -- 172.21.15.18:0/2147379201 learned_addr learned my addr 172.21.15.18:0/2147379201 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:16.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.148+0000 7fbc7f7fe640 1 --2- 172.21.15.18:0/2147379201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc800d3240 0x7fbc800c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:16.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.148+0000 7fbc84a6d640 1 --2- 172.21.15.18:0/2147379201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc8015ef50 0x7fbc800b89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:16.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.148+0000 7fbc7ffff640 1 -- 172.21.15.18:0/2147379201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc800d3240 msgr2=0x7fbc800c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:16.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.148+0000 7fbc7ffff640 1 --2- 172.21.15.18:0/2147379201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc800d3240 0x7fbc800c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.148+0000 7fbc7ffff640 1 -- 172.21.15.18:0/2147379201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc8015ef50 msgr2=0x7fbc800b89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:16.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.148+0000 7fbc7ffff640 1 --2- 172.21.15.18:0/2147379201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc8015ef50 0x7fbc800b89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.148+0000 7fbc7ffff640 1 -- 172.21.15.18:0/2147379201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc800c7f00 con 0x7fbc800d1ab0 2024-09-19T09:20:16.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.148+0000 7fbc7ffff640 1 --2- 172.21.15.18:0/2147379201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc800d1ab0 0x7fbc800c79c0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fbc7000c400 tx=0x7fbc7000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:16.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.148+0000 7fbc7cff9640 1 -- 172.21.15.18:0/2147379201 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc70017070 con 0x7fbc800d1ab0 2024-09-19T09:20:16.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.148+0000 7fbc7cff9640 1 -- 172.21.15.18:0/2147379201 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc700052d0 con 0x7fbc800d1ab0 2024-09-19T09:20:16.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.148+0000 7fbc864d0640 1 -- 172.21.15.18:0/2147379201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc800cadd0 con 0x7fbc800d1ab0 2024-09-19T09:20:16.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.148+0000 7fbc7cff9640 1 -- 172.21.15.18:0/2147379201 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc70003830 con 0x7fbc800d1ab0 2024-09-19T09:20:16.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.148+0000 7fbc864d0640 1 -- 172.21.15.18:0/2147379201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc800cb390 con 0x7fbc800d1ab0 2024-09-19T09:20:16.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.149+0000 7fbc864d0640 1 -- 172.21.15.18:0/2147379201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc800d13a0 con 0x7fbc800d1ab0 2024-09-19T09:20:16.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.150+0000 7fbc7cff9640 1 -- 172.21.15.18:0/2147379201 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbc7001a070 con 0x7fbc800d1ab0 2024-09-19T09:20:16.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.150+0000 7fbc7cff9640 1 --2- 172.21.15.18:0/2147379201 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbc6c06c2b0 0x7fbc6c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:16.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.150+0000 7fbc7cff9640 1 -- 172.21.15.18:0/2147379201 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5709+0+0 (secure 0 0 0) 0x7fbc7008a730 con 0x7fbc800d1ab0 2024-09-19T09:20:16.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.150+0000 7fbc7f7fe640 1 --2- 172.21.15.18:0/2147379201 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbc6c06c2b0 0x7fbc6c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:16.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.151+0000 7fbc7f7fe640 1 --2- 172.21.15.18:0/2147379201 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbc6c06c2b0 0x7fbc6c06e770 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbc8015cff0 tx=0x7fbc74007bb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:16.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.155+0000 7fbc7cff9640 1 -- 172.21.15.18:0/2147379201 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fbc800c7f00 con 0x7fbc800d1ab0 2024-09-19T09:20:16.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.369+0000 7fbc864d0640 1 -- 172.21.15.18:0/2147379201 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbc8006cfe0 con 0x7fbc800d1ab0 2024-09-19T09:20:16.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.370+0000 7fbc7cff9640 1 -- 172.21.15.18:0/2147379201 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5231 (secure 0 0 0) 0x7fbc70058f30 con 0x7fbc800d1ab0 2024-09-19T09:20:16.371 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:20:16.371 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":56,"btime":"2024-09-19T09:19:43:414636+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5846,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1876507362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1876507362},{"type":"v1","addr":"172.21.15.162:6837","nonce":1876507362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2245870616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2245870616},{"type":"v1","addr":"172.21.15.162:6835","nonce":2245870616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6858,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1245398837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1245398837},{"type":"v1","addr":"172.21.15.18:6834","nonce":1245398837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:19:39.754151+0000","modified":"2024-09-19T09:19:42.581316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6861":{"gid":6861,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/2894746570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2894746570},{"type":"v1","addr":"172.21.15.18:6835","nonce":2894746570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6861,"qdb_cluster":[6861]},"id":8}]} 2024-09-19T09:20:16.371 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 56 2024-09-19T09:20:16.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.372+0000 7fbc864d0640 1 -- 172.21.15.18:0/2147379201 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbc6c06c2b0 msgr2=0x7fbc6c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:16.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.372+0000 7fbc864d0640 1 --2- 172.21.15.18:0/2147379201 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbc6c06c2b0 0x7fbc6c06e770 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbc8015cff0 tx=0x7fbc74007bb0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.372+0000 7fbc864d0640 1 -- 172.21.15.18:0/2147379201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc800d1ab0 msgr2=0x7fbc800c79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:16.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.372+0000 7fbc864d0640 1 --2- 172.21.15.18:0/2147379201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc800d1ab0 0x7fbc800c79c0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fbc7000c400 tx=0x7fbc7000c8c0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.372+0000 7fbc864d0640 1 -- 172.21.15.18:0/2147379201 shutdown_connections 2024-09-19T09:20:16.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.372+0000 7fbc864d0640 1 --2- 172.21.15.18:0/2147379201 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbc6c06c2b0 0x7fbc6c06e770 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.372+0000 7fbc864d0640 1 --2- 172.21.15.18:0/2147379201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbc8015ef50 0x7fbc800b89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.372+0000 7fbc864d0640 1 --2- 172.21.15.18:0/2147379201 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbc800d3240 0x7fbc800c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.372+0000 7fbc864d0640 1 --2- 172.21.15.18:0/2147379201 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbc800d1ab0 0x7fbc800c79c0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.372+0000 7fbc864d0640 1 -- 172.21.15.18:0/2147379201 >> 172.21.15.18:0/2147379201 conn(0x7fbc800d4c60 msgr2=0x7fbc8006c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:16.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.372+0000 7fbc864d0640 1 -- 172.21.15.18:0/2147379201 shutdown_connections 2024-09-19T09:20:16.374 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.372+0000 7fbc864d0640 1 -- 172.21.15.18:0/2147379201 wait complete. 2024-09-19T09:20:16.384 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:20:16.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.485+0000 7ff208edd640 1 Processor -- start 2024-09-19T09:20:16.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.485+0000 7ff208edd640 1 -- start start 2024-09-19T09:20:16.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.486+0000 7ff208edd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff2040d10a0 0x7ff2040d1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:16.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.486+0000 7ff208edd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff2040ce7b0 0x7ff204067950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:16.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.486+0000 7ff208edd640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2040cd710 con 0x7ff20415cd60 2024-09-19T09:20:16.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.486+0000 7ff208edd640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7ff2040b1f20 con 0x7ff2040d10a0 2024-09-19T09:20:16.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.486+0000 7ff208edd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff2040cd9f0 con 0x7ff2040ce7b0 2024-09-19T09:20:16.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.487+0000 7ff20259c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff2040d10a0 0x7ff2040d1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:16.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.487+0000 7ff201d9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff20415cd60 0x7ff2040d1480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34934/0 (socket says 172.21.15.18:34934) 2024-09-19T09:20:16.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.487+0000 7ff201d9b640 1 -- 172.21.15.18:0/4191622843 learned_addr learned my addr 172.21.15.18:0/4191622843 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:20:16.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.487+0000 7ff202d9d640 1 --2- 172.21.15.18:0/4191622843 >> v2:172.21.15.162:3300/0 conn(0x7ff2040ce7b0 0x7ff204067950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:16.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.487+0000 7ff20259c640 1 -- 172.21.15.18:0/4191622843 >> v2:172.21.15.162:3300/0 conn(0x7ff2040ce7b0 msgr2=0x7ff204067950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:16.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.487+0000 7ff20259c640 1 --2- 172.21.15.18:0/4191622843 >> v2:172.21.15.162:3300/0 conn(0x7ff2040ce7b0 0x7ff204067950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.487+0000 7ff20259c640 1 -- 172.21.15.18:0/4191622843 >> v1:172.21.15.18:6789/0 conn(0x7ff20415cd60 legacy=0x7ff2040d1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:16.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.487+0000 7ff20259c640 1 -- 172.21.15.18:0/4191622843 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2040cdcd0 con 0x7ff2040d10a0 2024-09-19T09:20:16.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.487+0000 7ff20159a640 1 -- 172.21.15.18:0/4191622843 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 670924030 0 0) 0x7ff2040cd710 con 0x7ff20415cd60 2024-09-19T09:20:16.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.488+0000 7ff20259c640 1 --2- 172.21.15.18:0/4191622843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2040d10a0 0x7ff2040d1d20 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7ff2040707b0 tx=0x7ff1f402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422a95606ac09837 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:16.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.488+0000 7ff20159a640 1 -- 172.21.15.18:0/4191622843 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4037070 con 0x7ff2040d10a0 2024-09-19T09:20:16.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.488+0000 7ff20159a640 1 -- 172.21.15.18:0/4191622843 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1f4032440 con 0x7ff2040d10a0 2024-09-19T09:20:16.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.488+0000 7ff20159a640 1 -- 172.21.15.18:0/4191622843 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4032810 con 0x7ff2040d10a0 2024-09-19T09:20:16.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.488+0000 7ff208edd640 1 -- 172.21.15.18:0/4191622843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2040d10a0 msgr2=0x7ff2040d1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:16.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.488+0000 7ff208edd640 1 --2- 172.21.15.18:0/4191622843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2040d10a0 0x7ff2040d1d20 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7ff2040707b0 tx=0x7ff1f402a1a0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.488+0000 7ff208edd640 1 -- 172.21.15.18:0/4191622843 shutdown_connections 2024-09-19T09:20:16.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.488+0000 7ff208edd640 1 --2- 172.21.15.18:0/4191622843 >> v2:172.21.15.162:3300/0 conn(0x7ff2040ce7b0 0x7ff204067950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.488+0000 7ff208edd640 1 --2- 172.21.15.18:0/4191622843 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2040d10a0 0x7ff2040d1d20 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.488+0000 7ff208edd640 1 -- 172.21.15.18:0/4191622843 >> 172.21.15.18:0/4191622843 conn(0x7ff2040731b0 msgr2=0x7ff2040735c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:16.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.488+0000 7ff208edd640 1 -- 172.21.15.18:0/4191622843 shutdown_connections 2024-09-19T09:20:16.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.489+0000 7ff208edd640 1 -- 172.21.15.18:0/4191622843 wait complete. 2024-09-19T09:20:16.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.490+0000 7ff208edd640 1 Processor -- start 2024-09-19T09:20:16.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.490+0000 7ff208edd640 1 -- start start 2024-09-19T09:20:16.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.491+0000 7ff208edd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2040ce7b0 0x7ff2040ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:16.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.491+0000 7ff208edd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2040d10a0 0x7ff20415d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:16.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.491+0000 7ff208edd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff20415cd60 0x7ff204149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:16.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.491+0000 7ff208edd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff204067e90 con 0x7ff2040d10a0 2024-09-19T09:20:16.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.491+0000 7ff208edd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff2040ce290 con 0x7ff20415cd60 2024-09-19T09:20:16.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.491+0000 7ff208edd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff2040b0f10 con 0x7ff2040ce7b0 2024-09-19T09:20:16.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.491+0000 7ff201d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2040d10a0 0x7ff20415d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:16.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.491+0000 7ff201d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2040d10a0 0x7ff20415d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53144/0 (socket says 172.21.15.18:53144) 2024-09-19T09:20:16.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.491+0000 7ff201d9b640 1 -- 172.21.15.18:0/3207089955 learned_addr learned my addr 172.21.15.18:0/3207089955 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:16.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.491+0000 7ff202d9d640 1 --2- 172.21.15.18:0/3207089955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff20415cd60 0x7ff204149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:16.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.491+0000 7ff20259c640 1 --2- 172.21.15.18:0/3207089955 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2040ce7b0 0x7ff2040ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:16.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.491+0000 7ff201d9b640 1 -- 172.21.15.18:0/3207089955 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2040ce7b0 msgr2=0x7ff2040ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:16.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.491+0000 7ff201d9b640 1 --2- 172.21.15.18:0/3207089955 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2040ce7b0 0x7ff2040ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.491+0000 7ff201d9b640 1 -- 172.21.15.18:0/3207089955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff20415cd60 msgr2=0x7ff204149820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:16.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.491+0000 7ff201d9b640 1 --2- 172.21.15.18:0/3207089955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff20415cd60 0x7ff204149820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.491+0000 7ff201d9b640 1 -- 172.21.15.18:0/3207089955 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2040cd2d0 con 0x7ff2040d10a0 2024-09-19T09:20:16.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.491+0000 7ff202d9d640 1 --2- 172.21.15.18:0/3207089955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff20415cd60 0x7ff204149820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:16.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.491+0000 7ff20259c640 1 --2- 172.21.15.18:0/3207089955 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2040ce7b0 0x7ff2040ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:16.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.491+0000 7ff201d9b640 1 --2- 172.21.15.18:0/3207089955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2040d10a0 0x7ff20415d140 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00c430 tx=0x7ff1ec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:16.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.491+0000 7ff1faffd640 1 -- 172.21.15.18:0/3207089955 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec0074e0 con 0x7ff2040d10a0 2024-09-19T09:20:16.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.491+0000 7ff1faffd640 1 -- 172.21.15.18:0/3207089955 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1ec0047e0 con 0x7ff2040d10a0 2024-09-19T09:20:16.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.491+0000 7ff208edd640 1 -- 172.21.15.18:0/3207089955 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2040cf840 con 0x7ff2040d10a0 2024-09-19T09:20:16.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.491+0000 7ff1faffd640 1 -- 172.21.15.18:0/3207089955 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec004bd0 con 0x7ff2040d10a0 2024-09-19T09:20:16.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.491+0000 7ff208edd640 1 -- 172.21.15.18:0/3207089955 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2040cfe00 con 0x7ff2040d10a0 2024-09-19T09:20:16.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.493+0000 7ff208edd640 1 -- 172.21.15.18:0/3207089955 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff204067950 con 0x7ff2040d10a0 2024-09-19T09:20:16.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.493+0000 7ff1faffd640 1 -- 172.21.15.18:0/3207089955 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff1ec011070 con 0x7ff2040d10a0 2024-09-19T09:20:16.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.493+0000 7ff1faffd640 1 --2- 172.21.15.18:0/3207089955 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff1e406c2b0 0x7ff1e406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:16.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.494+0000 7ff1faffd640 1 -- 172.21.15.18:0/3207089955 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5709+0+0 (secure 0 0 0) 0x7ff1ec08b000 con 0x7ff2040d10a0 2024-09-19T09:20:16.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.494+0000 7ff20259c640 1 --2- 172.21.15.18:0/3207089955 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff1e406c2b0 0x7ff1e406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:16.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.494+0000 7ff20259c640 1 --2- 172.21.15.18:0/3207089955 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff1e406c2b0 0x7ff1e406e770 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4034000 tx=0x7ff1f402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:16.498 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.498+0000 7ff1faffd640 1 -- 172.21.15.18:0/3207089955 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff1ec00e280 con 0x7ff2040d10a0 2024-09-19T09:20:16.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.674+0000 7ff208edd640 1 -- 172.21.15.18:0/3207089955 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff20406ca30 con 0x7ff2040d10a0 2024-09-19T09:20:16.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.676+0000 7ff1faffd640 1 -- 172.21.15.18:0/3207089955 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) ==== 74+0+16763 (secure 0 0 0) 0x7ff1ec059800 con 0x7ff2040d10a0 2024-09-19T09:20:16.676 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:20:16.677 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":141,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:20:11.226994+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:19:38.333262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-19T09:19:38.727884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:20:16.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.678+0000 7ff208edd640 1 -- 172.21.15.18:0/3207089955 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff1e406c2b0 msgr2=0x7ff1e406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:16.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.678+0000 7ff208edd640 1 --2- 172.21.15.18:0/3207089955 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff1e406c2b0 0x7ff1e406e770 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4034000 tx=0x7ff1f402e000 comp rx=0 tx=0).stop 2024-09-19T09:20:16.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.678+0000 7ff208edd640 1 -- 172.21.15.18:0/3207089955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2040d10a0 msgr2=0x7ff20415d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:16.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.678+0000 7ff208edd640 1 --2- 172.21.15.18:0/3207089955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2040d10a0 0x7ff20415d140 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00c430 tx=0x7ff1ec00c8f0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.678+0000 7ff208edd640 1 -- 172.21.15.18:0/3207089955 shutdown_connections 2024-09-19T09:20:16.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.678+0000 7ff208edd640 1 --2- 172.21.15.18:0/3207089955 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff1e406c2b0 0x7ff1e406e770 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.678+0000 7ff208edd640 1 --2- 172.21.15.18:0/3207089955 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff20415cd60 0x7ff204149820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.678+0000 7ff208edd640 1 --2- 172.21.15.18:0/3207089955 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff2040d10a0 0x7ff20415d140 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.679 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.678+0000 7ff208edd640 1 --2- 172.21.15.18:0/3207089955 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff2040ce7b0 0x7ff2040ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.678+0000 7ff208edd640 1 -- 172.21.15.18:0/3207089955 >> 172.21.15.18:0/3207089955 conn(0x7ff2040731b0 msgr2=0x7ff20406bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:16.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.678+0000 7ff208edd640 1 -- 172.21.15.18:0/3207089955 shutdown_connections 2024-09-19T09:20:16.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.678+0000 7ff208edd640 1 -- 172.21.15.18:0/3207089955 wait complete. 2024-09-19T09:20:16.690 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T09:20:16.690 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:20:16.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.791+0000 7f6585d31640 1 Processor -- start 2024-09-19T09:20:16.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.791+0000 7f6585d31640 1 -- start start 2024-09-19T09:20:16.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.792+0000 7f6585d31640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f65800d0050 0x7f65800cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:16.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.792+0000 7f6585d31640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65800d0e10 con 0x7f65800cf560 2024-09-19T09:20:16.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.792+0000 7f6585d31640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65800d0850 con 0x7f65800b3ce0 2024-09-19T09:20:16.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.792+0000 7f6585d31640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f65800d0b30 con 0x7f65800d0050 2024-09-19T09:20:16.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.792+0000 7f657f7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f65800cf560 0x7f65800cf940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34948/0 (socket says 172.21.15.18:34948) 2024-09-19T09:20:16.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.792+0000 7f657f7fe640 1 -- 172.21.15.18:0/2810971562 learned_addr learned my addr 172.21.15.18:0/2810971562 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:20:16.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.792+0000 7f657ffff640 1 --2- 172.21.15.18:0/2810971562 >> v2:172.21.15.162:3300/0 conn(0x7f65800d0050 0x7f65800cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:16.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.792+0000 7f657e7fc640 1 -- 172.21.15.18:0/2810971562 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2829714298 0 0) 0x7f65800d0e10 con 0x7f65800cf560 2024-09-19T09:20:16.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.793+0000 7f657e7fc640 1 -- 172.21.15.18:0/2810971562 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6568003520 con 0x7f65800cf560 2024-09-19T09:20:16.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.793+0000 7f657e7fc640 1 -- 172.21.15.18:0/2810971562 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2043086386 0 0) 0x7f6568003520 con 0x7f65800cf560 2024-09-19T09:20:16.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.793+0000 7f657e7fc640 1 -- 172.21.15.18:0/2810971562 >> v2:172.21.15.162:3300/0 conn(0x7f65800d0050 msgr2=0x7f65800cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:16.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.793+0000 7f657e7fc640 1 --2- 172.21.15.18:0/2810971562 >> v2:172.21.15.162:3300/0 conn(0x7f65800d0050 0x7f65800cdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.793+0000 7f657e7fc640 1 -- 172.21.15.18:0/2810971562 >> v1:172.21.15.162:6789/0 conn(0x7f65800b3ce0 legacy=0x7f65800cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:16.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.793+0000 7f657e7fc640 1 -- 172.21.15.18:0/2810971562 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65800b24d0 con 0x7f65800cf560 2024-09-19T09:20:16.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.793+0000 7f657e7fc640 1 -- 172.21.15.18:0/2810971562 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f6570001670 con 0x7f65800cf560 2024-09-19T09:20:16.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.793+0000 7f657e7fc640 1 -- 172.21.15.18:0/2810971562 >> v1:172.21.15.18:6789/0 conn(0x7f65800cf560 legacy=0x7f65800cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:16.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.793+0000 7f657e7fc640 1 --2- 172.21.15.18:0/2810971562 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65680039b0 0x7f6568003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:16.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.793+0000 7f657e7fc640 1 --2- 172.21.15.18:0/2810971562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6568004800 0x7f6568004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:16.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.793+0000 7f657e7fc640 1 --2- 172.21.15.18:0/2810971562 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65680052e0 0x7f656800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:16.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.793+0000 7f657e7fc640 1 -- 172.21.15.18:0/2810971562 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f65800d0b30 con 0x7f65680039b0 2024-09-19T09:20:16.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.793+0000 7f657e7fc640 1 -- 172.21.15.18:0/2810971562 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f656800c1b0 con 0x7f6568004800 2024-09-19T09:20:16.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.793+0000 7f657e7fc640 1 -- 172.21.15.18:0/2810971562 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f656800c3b0 con 0x7f65680052e0 2024-09-19T09:20:16.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.793+0000 7f657f7fe640 1 --2- 172.21.15.18:0/2810971562 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65680039b0 0x7f6568003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:16.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.793+0000 7f657effd640 1 --2- 172.21.15.18:0/2810971562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6568004800 0x7f6568004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:16.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.793+0000 7f657ffff640 1 --2- 172.21.15.18:0/2810971562 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65680052e0 0x7f656800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:16.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.793+0000 7f657f7fe640 1 -- 172.21.15.18:0/2810971562 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65680052e0 msgr2=0x7f656800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:16.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.793+0000 7f657f7fe640 1 --2- 172.21.15.18:0/2810971562 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65680052e0 0x7f656800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.793+0000 7f657f7fe640 1 -- 172.21.15.18:0/2810971562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6568004800 msgr2=0x7f6568004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:16.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.793+0000 7f657f7fe640 1 --2- 172.21.15.18:0/2810971562 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6568004800 0x7f6568004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.793+0000 7f657f7fe640 1 -- 172.21.15.18:0/2810971562 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6568003520 con 0x7f65680039b0 2024-09-19T09:20:16.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.793+0000 7f657ffff640 1 -- 172.21.15.18:0/2810971562 reap_dead start 2024-09-19T09:20:16.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.794+0000 7f657f7fe640 1 --2- 172.21.15.18:0/2810971562 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65680039b0 0x7f6568003dd0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f6570001eb0 tx=0x7f6568005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=293d9d88f36d5234 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:16.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.794+0000 7f657e7fc640 1 -- 172.21.15.18:0/2810971562 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6570007d30 con 0x7f65680039b0 2024-09-19T09:20:16.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.794+0000 7f657e7fc640 1 -- 172.21.15.18:0/2810971562 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6570005af0 con 0x7f65680039b0 2024-09-19T09:20:16.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.794+0000 7f657e7fc640 1 -- 172.21.15.18:0/2810971562 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6570007070 con 0x7f65680039b0 2024-09-19T09:20:16.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.795+0000 7f6585d31640 1 -- 172.21.15.18:0/2810971562 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65680039b0 msgr2=0x7f6568003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:16.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.795+0000 7f6585d31640 1 --2- 172.21.15.18:0/2810971562 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65680039b0 0x7f6568003dd0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f6570001eb0 tx=0x7f6568005830 comp rx=0 tx=0).stop 2024-09-19T09:20:16.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.795+0000 7f6585d31640 1 -- 172.21.15.18:0/2810971562 shutdown_connections 2024-09-19T09:20:16.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.795+0000 7f6585d31640 1 --2- 172.21.15.18:0/2810971562 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65680039b0 0x7f6568003dd0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.795+0000 7f6585d31640 1 -- 172.21.15.18:0/2810971562 >> 172.21.15.18:0/2810971562 conn(0x7f65800b4700 msgr2=0x7f65800b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:16.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.795+0000 7f6585d31640 1 -- 172.21.15.18:0/2810971562 shutdown_connections 2024-09-19T09:20:16.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.795+0000 7f6585d31640 1 -- 172.21.15.18:0/2810971562 wait complete. 2024-09-19T09:20:16.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.796+0000 7f6585d31640 1 Processor -- start 2024-09-19T09:20:16.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.796+0000 7f6585d31640 1 -- start start 2024-09-19T09:20:16.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.797+0000 7f6585d31640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65680039b0 0x7f658015a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:16.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.797+0000 7f6585d31640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65800c9150 0x7f658015ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:16.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.797+0000 7f6585d31640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65800b7ab0 0x7f65800b7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:16.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.797+0000 7f6585d31640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f65800b55a0 con 0x7f65800b7ab0 2024-09-19T09:20:16.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.797+0000 7f6585d31640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f65800b5420 con 0x7f65680039b0 2024-09-19T09:20:16.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.797+0000 7f6585d31640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f658015d090 con 0x7f65800c9150 2024-09-19T09:20:16.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.797+0000 7f657ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65800b7ab0 0x7f65800b7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:16.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.797+0000 7f657ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65800b7ab0 0x7f65800b7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53162/0 (socket says 172.21.15.18:53162) 2024-09-19T09:20:16.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.797+0000 7f657ffff640 1 -- 172.21.15.18:0/1495509044 learned_addr learned my addr 172.21.15.18:0/1495509044 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:16.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.797+0000 7f657effd640 1 --2- 172.21.15.18:0/1495509044 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65800c9150 0x7f658015ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:16.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.797+0000 7f657f7fe640 1 --2- 172.21.15.18:0/1495509044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65680039b0 0x7f658015a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:16.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.797+0000 7f657ffff640 1 -- 172.21.15.18:0/1495509044 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65800c9150 msgr2=0x7f658015ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:16.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.797+0000 7f657ffff640 1 --2- 172.21.15.18:0/1495509044 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65800c9150 0x7f658015ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.797+0000 7f657ffff640 1 -- 172.21.15.18:0/1495509044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65680039b0 msgr2=0x7f658015a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:16.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.797+0000 7f657ffff640 1 --2- 172.21.15.18:0/1495509044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65680039b0 0x7f658015a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:16.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.797+0000 7f657ffff640 1 -- 172.21.15.18:0/1495509044 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f658015e740 con 0x7f65800b7ab0 2024-09-19T09:20:16.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.797+0000 7f657ffff640 1 --2- 172.21.15.18:0/1495509044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65800b7ab0 0x7f65800b7f30 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f6580073b00 tx=0x7f65780115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:16.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.798+0000 7f6567fff640 1 -- 172.21.15.18:0/1495509044 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6578011de0 con 0x7f65800b7ab0 2024-09-19T09:20:16.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.798+0000 7f6567fff640 1 -- 172.21.15.18:0/1495509044 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f657801b070 con 0x7f65800b7ab0 2024-09-19T09:20:16.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.798+0000 7f6585d31640 1 -- 172.21.15.18:0/1495509044 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f658015ea20 con 0x7f65800b7ab0 2024-09-19T09:20:16.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.798+0000 7f6567fff640 1 -- 172.21.15.18:0/1495509044 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6578003990 con 0x7f65800b7ab0 2024-09-19T09:20:16.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.798+0000 7f6585d31640 1 -- 172.21.15.18:0/1495509044 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f658015efe0 con 0x7f65800b7ab0 2024-09-19T09:20:16.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.799+0000 7f6585d31640 1 -- 172.21.15.18:0/1495509044 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65800cf940 con 0x7f65800b7ab0 2024-09-19T09:20:16.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.799+0000 7f6567fff640 1 -- 172.21.15.18:0/1495509044 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6578005d10 con 0x7f65800b7ab0 2024-09-19T09:20:16.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.800+0000 7f6567fff640 1 --2- 172.21.15.18:0/1495509044 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f656c06c2e0 0x7f656c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:16.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.800+0000 7f6567fff640 1 -- 172.21.15.18:0/1495509044 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5709+0+0 (secure 0 0 0) 0x7f657808b7b0 con 0x7f65800b7ab0 2024-09-19T09:20:16.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.800+0000 7f657f7fe640 1 --2- 172.21.15.18:0/1495509044 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f656c06c2e0 0x7f656c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:16.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.800+0000 7f657f7fe640 1 --2- 172.21.15.18:0/1495509044 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f656c06c2e0 0x7f656c06e7a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6570032000 tx=0x7f6570009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:16.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:16.804+0000 7f6567fff640 1 -- 172.21.15.18:0/1495509044 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6578025020 con 0x7f65800b7ab0 2024-09-19T09:20:17.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.017+0000 7f6585d31640 1 -- 172.21.15.18:0/1495509044 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65800cd1f0 con 0x7f65800b7ab0 2024-09-19T09:20:17.018 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.018+0000 7f6567fff640 1 -- 172.21.15.18:0/1495509044 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5231 (secure 0 0 0) 0x7f65780598d0 con 0x7f65800b7ab0 2024-09-19T09:20:17.019 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:20:17.019 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":56,"btime":"2024-09-19T09:19:43:414636+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5846,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1876507362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1876507362},{"type":"v1","addr":"172.21.15.162:6837","nonce":1876507362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2245870616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2245870616},{"type":"v1","addr":"172.21.15.162:6835","nonce":2245870616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6858,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1245398837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1245398837},{"type":"v1","addr":"172.21.15.18:6834","nonce":1245398837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:19:39.754151+0000","modified":"2024-09-19T09:19:42.581316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6861":{"gid":6861,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/2894746570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2894746570},{"type":"v1","addr":"172.21.15.18:6835","nonce":2894746570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6861,"qdb_cluster":[6861]},"id":8}]} 2024-09-19T09:20:17.019 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 56 2024-09-19T09:20:17.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.020+0000 7f6585d31640 1 -- 172.21.15.18:0/1495509044 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f656c06c2e0 msgr2=0x7f656c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:17.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.020+0000 7f6585d31640 1 --2- 172.21.15.18:0/1495509044 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f656c06c2e0 0x7f656c06e7a0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6570032000 tx=0x7f6570009030 comp rx=0 tx=0).stop 2024-09-19T09:20:17.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.020+0000 7f6585d31640 1 -- 172.21.15.18:0/1495509044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65800b7ab0 msgr2=0x7f65800b7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:17.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.020+0000 7f6585d31640 1 --2- 172.21.15.18:0/1495509044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65800b7ab0 0x7f65800b7f30 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f6580073b00 tx=0x7f65780115a0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.020+0000 7f6585d31640 1 -- 172.21.15.18:0/1495509044 shutdown_connections 2024-09-19T09:20:17.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.020+0000 7f6585d31640 1 --2- 172.21.15.18:0/1495509044 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f656c06c2e0 0x7f656c06e7a0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.020+0000 7f6585d31640 1 --2- 172.21.15.18:0/1495509044 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f65800b7ab0 0x7f65800b7f30 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.020+0000 7f6585d31640 1 --2- 172.21.15.18:0/1495509044 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f65800c9150 0x7f658015ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.020+0000 7f6585d31640 1 --2- 172.21.15.18:0/1495509044 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f65680039b0 0x7f658015a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.020+0000 7f6585d31640 1 -- 172.21.15.18:0/1495509044 >> 172.21.15.18:0/1495509044 conn(0x7f65800b4700 msgr2=0x7f65800b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:17.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.020+0000 7f6585d31640 1 -- 172.21.15.18:0/1495509044 shutdown_connections 2024-09-19T09:20:17.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.020+0000 7f6585d31640 1 -- 172.21.15.18:0/1495509044 wait complete. 2024-09-19T09:20:17.032 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:20:17.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.133+0000 7fa930ae4640 1 Processor -- start 2024-09-19T09:20:17.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.133+0000 7fa930ae4640 1 -- start start 2024-09-19T09:20:17.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.134+0000 7fa930ae4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa92c13fae0 0x7fa92c06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:17.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.134+0000 7fa930ae4640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa92c160c50 0x7fa92c0cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:17.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.134+0000 7fa930ae4640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa92c142650 con 0x7fa92c142150 2024-09-19T09:20:17.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.134+0000 7fa930ae4640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fa92c0ce780 con 0x7fa92c13fae0 2024-09-19T09:20:17.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.134+0000 7fa930ae4640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa92c142930 con 0x7fa92c160c50 2024-09-19T09:20:17.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.134+0000 7fa92a59c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa92c13fae0 0x7fa92c06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:17.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.134+0000 7fa92a59c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa92c13fae0 0x7fa92c06f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53178/0 (socket says 172.21.15.18:53178) 2024-09-19T09:20:17.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.134+0000 7fa92a59c640 1 -- 172.21.15.18:0/1653614250 learned_addr learned my addr 172.21.15.18:0/1653614250 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:17.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.134+0000 7fa92ad9d640 1 --2- 172.21.15.18:0/1653614250 >> v2:172.21.15.162:3300/0 conn(0x7fa92c160c50 0x7fa92c0cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:17.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.134+0000 7fa92a59c640 1 -- 172.21.15.18:0/1653614250 >> v2:172.21.15.162:3300/0 conn(0x7fa92c160c50 msgr2=0x7fa92c0cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:17.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.134+0000 7fa92a59c640 1 --2- 172.21.15.18:0/1653614250 >> v2:172.21.15.162:3300/0 conn(0x7fa92c160c50 0x7fa92c0cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.134+0000 7fa92a59c640 1 -- 172.21.15.18:0/1653614250 >> v1:172.21.15.162:6789/0 conn(0x7fa92c142150 legacy=0x7fa92c160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:17.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.134+0000 7fa92a59c640 1 -- 172.21.15.18:0/1653614250 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa92c142c10 con 0x7fa92c13fae0 2024-09-19T09:20:17.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.135+0000 7fa92a59c640 1 --2- 172.21.15.18:0/1653614250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa92c13fae0 0x7fa92c06f1b0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fa92c0b39c0 tx=0x7fa91c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa70337acecaa594 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:17.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.135+0000 7fa92959a640 1 -- 172.21.15.18:0/1653614250 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91c036070 con 0x7fa92c13fae0 2024-09-19T09:20:17.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.135+0000 7fa92959a640 1 -- 172.21.15.18:0/1653614250 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa91c031600 con 0x7fa92c13fae0 2024-09-19T09:20:17.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.135+0000 7fa92959a640 1 -- 172.21.15.18:0/1653614250 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa91c0319d0 con 0x7fa92c13fae0 2024-09-19T09:20:17.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.136+0000 7fa930ae4640 1 -- 172.21.15.18:0/1653614250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa92c13fae0 msgr2=0x7fa92c06f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:17.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.136+0000 7fa930ae4640 1 --2- 172.21.15.18:0/1653614250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa92c13fae0 0x7fa92c06f1b0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fa92c0b39c0 tx=0x7fa91c02a660 comp rx=0 tx=0).stop 2024-09-19T09:20:17.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.136+0000 7fa930ae4640 1 -- 172.21.15.18:0/1653614250 shutdown_connections 2024-09-19T09:20:17.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.136+0000 7fa930ae4640 1 --2- 172.21.15.18:0/1653614250 >> v2:172.21.15.162:3300/0 conn(0x7fa92c160c50 0x7fa92c0cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.136+0000 7fa930ae4640 1 --2- 172.21.15.18:0/1653614250 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa92c13fae0 0x7fa92c06f1b0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.136+0000 7fa930ae4640 1 -- 172.21.15.18:0/1653614250 >> 172.21.15.18:0/1653614250 conn(0x7fa92c06bc10 msgr2=0x7fa92c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:17.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.136+0000 7fa930ae4640 1 -- 172.21.15.18:0/1653614250 shutdown_connections 2024-09-19T09:20:17.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.136+0000 7fa930ae4640 1 -- 172.21.15.18:0/1653614250 wait complete. 2024-09-19T09:20:17.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.137+0000 7fa930ae4640 1 Processor -- start 2024-09-19T09:20:17.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.137+0000 7fa930ae4640 1 -- start start 2024-09-19T09:20:17.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.138+0000 7fa930ae4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa92c13fae0 0x7fa92c145d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:17.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.138+0000 7fa930ae4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa92c142150 0x7fa92c1f60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:17.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.138+0000 7fa930ae4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa92c160c50 0x7fa92c1f6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:17.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.138+0000 7fa930ae4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa92c06f870 con 0x7fa92c142150 2024-09-19T09:20:17.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.138+0000 7fa930ae4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa92c06f6f0 con 0x7fa92c160c50 2024-09-19T09:20:17.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.138+0000 7fa930ae4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa92c0cf150 con 0x7fa92c13fae0 2024-09-19T09:20:17.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.138+0000 7fa929d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa92c142150 0x7fa92c1f60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:17.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.138+0000 7fa929d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa92c142150 0x7fa92c1f60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53188/0 (socket says 172.21.15.18:53188) 2024-09-19T09:20:17.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.138+0000 7fa929d9b640 1 -- 172.21.15.18:0/3964017908 learned_addr learned my addr 172.21.15.18:0/3964017908 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:17.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.138+0000 7fa92ad9d640 1 --2- 172.21.15.18:0/3964017908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa92c160c50 0x7fa92c1f6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:17.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.138+0000 7fa92a59c640 1 --2- 172.21.15.18:0/3964017908 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa92c13fae0 0x7fa92c145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:17.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.138+0000 7fa929d9b640 1 -- 172.21.15.18:0/3964017908 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa92c13fae0 msgr2=0x7fa92c145d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:17.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.138+0000 7fa929d9b640 1 --2- 172.21.15.18:0/3964017908 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa92c13fae0 0x7fa92c145d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.138+0000 7fa929d9b640 1 -- 172.21.15.18:0/3964017908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa92c160c50 msgr2=0x7fa92c1f6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:17.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.138+0000 7fa929d9b640 1 --2- 172.21.15.18:0/3964017908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa92c160c50 0x7fa92c1f6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.138+0000 7fa929d9b640 1 -- 172.21.15.18:0/3964017908 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa92c144cc0 con 0x7fa92c142150 2024-09-19T09:20:17.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.138+0000 7fa92ad9d640 1 --2- 172.21.15.18:0/3964017908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa92c160c50 0x7fa92c1f6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:17.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.138+0000 7fa92a59c640 1 --2- 172.21.15.18:0/3964017908 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa92c13fae0 0x7fa92c145d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:17.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.139+0000 7fa929d9b640 1 --2- 172.21.15.18:0/3964017908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa92c142150 0x7fa92c1f60c0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fa92000c430 tx=0x7fa92000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:17.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.139+0000 7fa91affd640 1 -- 172.21.15.18:0/3964017908 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa920011790 con 0x7fa92c142150 2024-09-19T09:20:17.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.139+0000 7fa91affd640 1 -- 172.21.15.18:0/3964017908 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa920017070 con 0x7fa92c142150 2024-09-19T09:20:17.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.139+0000 7fa930ae4640 1 -- 172.21.15.18:0/3964017908 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa92c144f60 con 0x7fa92c142150 2024-09-19T09:20:17.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.139+0000 7fa91affd640 1 -- 172.21.15.18:0/3964017908 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa920011bb0 con 0x7fa92c142150 2024-09-19T09:20:17.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.139+0000 7fa930ae4640 1 -- 172.21.15.18:0/3964017908 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa92c145520 con 0x7fa92c142150 2024-09-19T09:20:17.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.140+0000 7fa930ae4640 1 -- 172.21.15.18:0/3964017908 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa92c06f1b0 con 0x7fa92c142150 2024-09-19T09:20:17.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.140+0000 7fa91affd640 1 -- 172.21.15.18:0/3964017908 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa92001c460 con 0x7fa92c142150 2024-09-19T09:20:17.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.141+0000 7fa91affd640 1 --2- 172.21.15.18:0/3964017908 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa90c06c2b0 0x7fa90c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:17.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.141+0000 7fa91affd640 1 -- 172.21.15.18:0/3964017908 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5709+0+0 (secure 0 0 0) 0x7fa92008b3b0 con 0x7fa92c142150 2024-09-19T09:20:17.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.141+0000 7fa92a59c640 1 --2- 172.21.15.18:0/3964017908 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa90c06c2b0 0x7fa90c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:17.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.142+0000 7fa92a59c640 1 --2- 172.21.15.18:0/3964017908 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa90c06c2b0 0x7fa90c06e770 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa91c033000 tx=0x7fa91c009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:17.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.145+0000 7fa91affd640 1 -- 172.21.15.18:0/3964017908 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa920059a80 con 0x7fa92c142150 2024-09-19T09:20:17.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.361+0000 7fa930ae4640 1 -- 172.21.15.18:0/3964017908 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa92c06d4a0 con 0x7fa92c142150 2024-09-19T09:20:17.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.362+0000 7fa91affd640 1 -- 172.21.15.18:0/3964017908 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+5231 (secure 0 0 0) 0x7fa920059380 con 0x7fa92c142150 2024-09-19T09:20:17.363 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:20:17.363 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":56,"btime":"2024-09-19T09:19:43:414636+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5846,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1876507362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1876507362},{"type":"v1","addr":"172.21.15.162:6837","nonce":1876507362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2245870616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2245870616},{"type":"v1","addr":"172.21.15.162:6835","nonce":2245870616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6858,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1245398837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1245398837},{"type":"v1","addr":"172.21.15.18:6834","nonce":1245398837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51}],"filesystems":[{"mdsmap":{"epoch":56,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:19:39.754151+0000","modified":"2024-09-19T09:19:42.581316+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6861},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6861":{"gid":6861,"name":"a","rank":0,"incarnation":53,"state":"up:active","state_seq":4,"addr":"172.21.15.18:6835/2894746570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2894746570},{"type":"v1","addr":"172.21.15.18:6835","nonce":2894746570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6861,"qdb_cluster":[6861]},"id":8}]} 2024-09-19T09:20:17.363 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 56 2024-09-19T09:20:17.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.364+0000 7fa930ae4640 1 -- 172.21.15.18:0/3964017908 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa90c06c2b0 msgr2=0x7fa90c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:17.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.364+0000 7fa930ae4640 1 --2- 172.21.15.18:0/3964017908 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa90c06c2b0 0x7fa90c06e770 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa91c033000 tx=0x7fa91c009000 comp rx=0 tx=0).stop 2024-09-19T09:20:17.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.364+0000 7fa930ae4640 1 -- 172.21.15.18:0/3964017908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa92c142150 msgr2=0x7fa92c1f60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:17.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.364+0000 7fa930ae4640 1 --2- 172.21.15.18:0/3964017908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa92c142150 0x7fa92c1f60c0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7fa92000c430 tx=0x7fa92000c8f0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.364+0000 7fa930ae4640 1 -- 172.21.15.18:0/3964017908 shutdown_connections 2024-09-19T09:20:17.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.364+0000 7fa930ae4640 1 --2- 172.21.15.18:0/3964017908 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa90c06c2b0 0x7fa90c06e770 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.364+0000 7fa930ae4640 1 --2- 172.21.15.18:0/3964017908 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa92c160c50 0x7fa92c1f6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.364+0000 7fa930ae4640 1 --2- 172.21.15.18:0/3964017908 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa92c142150 0x7fa92c1f60c0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.364+0000 7fa930ae4640 1 --2- 172.21.15.18:0/3964017908 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa92c13fae0 0x7fa92c145d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.364+0000 7fa930ae4640 1 -- 172.21.15.18:0/3964017908 >> 172.21.15.18:0/3964017908 conn(0x7fa92c06bc10 msgr2=0x7fa92c0cd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:17.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.364+0000 7fa930ae4640 1 -- 172.21.15.18:0/3964017908 shutdown_connections 2024-09-19T09:20:17.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.364+0000 7fa930ae4640 1 -- 172.21.15.18:0/3964017908 wait complete. 2024-09-19T09:20:17.376 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:20:17.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.477+0000 7f991eaae640 1 Processor -- start 2024-09-19T09:20:17.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.477+0000 7f991eaae640 1 -- start start 2024-09-19T09:20:17.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.478+0000 7f991eaae640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f99180b5200 0x7f99181629e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:17.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.478+0000 7f991eaae640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9918162f20 0x7f99180cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:17.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.478+0000 7f991eaae640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99180d0a10 con 0x7f991815ed30 2024-09-19T09:20:17.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.478+0000 7f991eaae640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f9918070ab0 con 0x7f9918162f20 2024-09-19T09:20:17.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.478+0000 7f991eaae640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f99180d0cb0 con 0x7f99180b5200 2024-09-19T09:20:17.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.478+0000 7f991d04b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9918162f20 0x7f99180cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:17.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.478+0000 7f991d04b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9918162f20 0x7f99180cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53194/0 (socket says 172.21.15.18:53194) 2024-09-19T09:20:17.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.478+0000 7f991d04b640 1 -- 172.21.15.18:0/1633177950 learned_addr learned my addr 172.21.15.18:0/1633177950 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:17.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.478+0000 7f9917fff640 1 --2- 172.21.15.18:0/1633177950 >> v2:172.21.15.162:3300/0 conn(0x7f99180b5200 0x7f99181629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:17.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.479+0000 7f991d04b640 1 -- 172.21.15.18:0/1633177950 >> v2:172.21.15.162:3300/0 conn(0x7f99180b5200 msgr2=0x7f99181629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:17.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.479+0000 7f991d04b640 1 --2- 172.21.15.18:0/1633177950 >> v2:172.21.15.162:3300/0 conn(0x7f99180b5200 0x7f99181629e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.479+0000 7f991d04b640 1 -- 172.21.15.18:0/1633177950 >> v1:172.21.15.162:6789/0 conn(0x7f991815ed30 legacy=0x7f9918070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:17.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.479+0000 7f991d04b640 1 -- 172.21.15.18:0/1633177950 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99180d0f90 con 0x7f9918162f20 2024-09-19T09:20:17.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.479+0000 7f991d04b640 1 --2- 172.21.15.18:0/1633177950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9918162f20 0x7f99180cf1e0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f99180b2540 tx=0x7f991002a7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af365018f0b2b324 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:17.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.479+0000 7f99177fe640 1 -- 172.21.15.18:0/1633177950 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9910036070 con 0x7f9918162f20 2024-09-19T09:20:17.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.479+0000 7f99177fe640 1 -- 172.21.15.18:0/1633177950 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9910031600 con 0x7f9918162f20 2024-09-19T09:20:17.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.479+0000 7f99177fe640 1 -- 172.21.15.18:0/1633177950 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99100319f0 con 0x7f9918162f20 2024-09-19T09:20:17.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.480+0000 7f991eaae640 1 -- 172.21.15.18:0/1633177950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9918162f20 msgr2=0x7f99180cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:17.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.480+0000 7f991eaae640 1 --2- 172.21.15.18:0/1633177950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9918162f20 0x7f99180cf1e0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f99180b2540 tx=0x7f991002a7c0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.480+0000 7f991eaae640 1 -- 172.21.15.18:0/1633177950 shutdown_connections 2024-09-19T09:20:17.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.480+0000 7f991eaae640 1 --2- 172.21.15.18:0/1633177950 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9918162f20 0x7f99180cf1e0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.480+0000 7f991eaae640 1 --2- 172.21.15.18:0/1633177950 >> v2:172.21.15.162:3300/0 conn(0x7f99180b5200 0x7f99181629e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.480+0000 7f991eaae640 1 -- 172.21.15.18:0/1633177950 >> 172.21.15.18:0/1633177950 conn(0x7f99180b4600 msgr2=0x7f99180b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:17.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.480+0000 7f991eaae640 1 -- 172.21.15.18:0/1633177950 shutdown_connections 2024-09-19T09:20:17.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.480+0000 7f991eaae640 1 -- 172.21.15.18:0/1633177950 wait complete. 2024-09-19T09:20:17.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.481+0000 7f991eaae640 1 Processor -- start 2024-09-19T09:20:17.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.481+0000 7f991eaae640 1 -- start start 2024-09-19T09:20:17.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.482+0000 7f991eaae640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99180b5200 0x7f9918161c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:17.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.482+0000 7f991eaae640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f991815ed30 0x7f99180b5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:17.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.482+0000 7f991eaae640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9918162f20 0x7f99181e91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:17.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.482+0000 7f991eaae640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f991815f290 con 0x7f991815ed30 2024-09-19T09:20:17.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.482+0000 7f991eaae640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f991815f110 con 0x7f9918162f20 2024-09-19T09:20:17.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.482+0000 7f991eaae640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f99180cf720 con 0x7f99180b5200 2024-09-19T09:20:17.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.482+0000 7f9917fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f991815ed30 0x7f99180b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:17.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.482+0000 7f9917fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f991815ed30 0x7f99180b5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53204/0 (socket says 172.21.15.18:53204) 2024-09-19T09:20:17.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.482+0000 7f9917fff640 1 -- 172.21.15.18:0/1241120855 learned_addr learned my addr 172.21.15.18:0/1241120855 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:17.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.482+0000 7f991d04b640 1 --2- 172.21.15.18:0/1241120855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9918162f20 0x7f99181e91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:17.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.482+0000 7f991c84a640 1 --2- 172.21.15.18:0/1241120855 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99180b5200 0x7f9918161c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:17.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.483+0000 7f9917fff640 1 -- 172.21.15.18:0/1241120855 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99180b5200 msgr2=0x7f9918161c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:17.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.483+0000 7f9917fff640 1 --2- 172.21.15.18:0/1241120855 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99180b5200 0x7f9918161c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.483+0000 7f9917fff640 1 -- 172.21.15.18:0/1241120855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9918162f20 msgr2=0x7f99181e91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:17.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.483+0000 7f9917fff640 1 --2- 172.21.15.18:0/1241120855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9918162f20 0x7f99181e91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.483+0000 7f9917fff640 1 -- 172.21.15.18:0/1241120855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9918162260 con 0x7f991815ed30 2024-09-19T09:20:17.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.483+0000 7f9917fff640 1 --2- 172.21.15.18:0/1241120855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f991815ed30 0x7f99180b5900 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f990c00d830 tx=0x7f990c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:17.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.483+0000 7f99157fa640 1 -- 172.21.15.18:0/1241120855 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f990c00b6c0 con 0x7f991815ed30 2024-09-19T09:20:17.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.483+0000 7f99157fa640 1 -- 172.21.15.18:0/1241120855 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f990c019070 con 0x7f991815ed30 2024-09-19T09:20:17.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.483+0000 7f991eaae640 1 -- 172.21.15.18:0/1241120855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f991815ff10 con 0x7f991815ed30 2024-09-19T09:20:17.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.483+0000 7f99157fa640 1 -- 172.21.15.18:0/1241120855 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f990c00ba80 con 0x7f991815ed30 2024-09-19T09:20:17.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.483+0000 7f991eaae640 1 -- 172.21.15.18:0/1241120855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99181604d0 con 0x7f991815ed30 2024-09-19T09:20:17.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.484+0000 7f991eaae640 1 -- 172.21.15.18:0/1241120855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99180686d0 con 0x7f991815ed30 2024-09-19T09:20:17.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.484+0000 7f99157fa640 1 -- 172.21.15.18:0/1241120855 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f990c01e460 con 0x7f991815ed30 2024-09-19T09:20:17.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.485+0000 7f99157fa640 1 --2- 172.21.15.18:0/1241120855 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f990406c2b0 0x7f990406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:17.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.485+0000 7f99157fa640 1 -- 172.21.15.18:0/1241120855 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5796+0+0 (secure 0 0 0) 0x7f990c08bb30 con 0x7f991815ed30 2024-09-19T09:20:17.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.485+0000 7f991c84a640 1 --2- 172.21.15.18:0/1241120855 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f990406c2b0 0x7f990406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.486+0000 7f991c84a640 1 --2- 172.21.15.18:0/1241120855 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f990406c2b0 0x7f990406e770 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9908001640 tx=0x7f9908009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:17.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.489+0000 7f99157fa640 1 -- 172.21.15.18:0/1241120855 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f990c05a2d0 con 0x7f991815ed30 2024-09-19T09:20:17.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.665+0000 7f991eaae640 1 -- 172.21.15.18:0/1241120855 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f99180cdda0 con 0x7f991815ed30 2024-09-19T09:20:17.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.666+0000 7f99157fa640 1 -- 172.21.15.18:0/1241120855 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v142) ==== 74+0+16896 (secure 0 0 0) 0x7f990c059bd0 con 0x7f991815ed30 2024-09-19T09:20:17.667 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:20:17.667 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":142,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:20:17.240880+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:19:38.333262+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-19T09:19:38.727884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"16.9","mappings":[{"from":4,"to":3}]},{"pgid":"17.28","mappings":[{"from":6,"to":5}]},{"pgid":"17.3f","mappings":[{"from":6,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:20:17.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.669+0000 7f991eaae640 1 -- 172.21.15.18:0/1241120855 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f990406c2b0 msgr2=0x7f990406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:17.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.669+0000 7f991eaae640 1 --2- 172.21.15.18:0/1241120855 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f990406c2b0 0x7f990406e770 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f9908001640 tx=0x7f9908009040 comp rx=0 tx=0).stop 2024-09-19T09:20:17.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.669+0000 7f991eaae640 1 -- 172.21.15.18:0/1241120855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f991815ed30 msgr2=0x7f99180b5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:17.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.669+0000 7f991eaae640 1 --2- 172.21.15.18:0/1241120855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f991815ed30 0x7f99180b5900 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f990c00d830 tx=0x7f990c00dcf0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.669+0000 7f991eaae640 1 -- 172.21.15.18:0/1241120855 shutdown_connections 2024-09-19T09:20:17.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.669+0000 7f991eaae640 1 --2- 172.21.15.18:0/1241120855 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f990406c2b0 0x7f990406e770 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.669+0000 7f991eaae640 1 --2- 172.21.15.18:0/1241120855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9918162f20 0x7f99181e91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.669+0000 7f991eaae640 1 --2- 172.21.15.18:0/1241120855 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f991815ed30 0x7f99180b5900 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.669+0000 7f991eaae640 1 --2- 172.21.15.18:0/1241120855 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f99180b5200 0x7f9918161c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.669+0000 7f991eaae640 1 -- 172.21.15.18:0/1241120855 >> 172.21.15.18:0/1241120855 conn(0x7f99180b4600 msgr2=0x7f99180ce2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:17.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.669+0000 7f991eaae640 1 -- 172.21.15.18:0/1241120855 shutdown_connections 2024-09-19T09:20:17.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.669+0000 7f991eaae640 1 -- 172.21.15.18:0/1241120855 wait complete. 2024-09-19T09:20:17.681 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-19T09:20:17.784 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.784+0000 7fa3ebde4640 1 Processor -- start 2024-09-19T09:20:17.785 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.784+0000 7fa3ebde4640 1 -- start start 2024-09-19T09:20:17.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.785+0000 7fa3ebde4640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa3e4162460 0x7fa3e40d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:17.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.785+0000 7fa3ebde4640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3e40b50a0 con 0x7fa3e40d56f0 2024-09-19T09:20:17.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.785+0000 7fa3ebde4640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3e40b5380 con 0x7fa3e40d1ac0 2024-09-19T09:20:17.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.785+0000 7fa3ebde4640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa3e40b5940 con 0x7fa3e4162460 2024-09-19T09:20:17.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.785+0000 7fa3e937f640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa3e40d56f0 0x7fa3e40d2b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34956/0 (socket says 172.21.15.18:34956) 2024-09-19T09:20:17.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.785+0000 7fa3e937f640 1 -- 172.21.15.18:0/3879225555 learned_addr learned my addr 172.21.15.18:0/3879225555 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:20:17.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.785+0000 7fa3e8b7e640 1 -- 172.21.15.18:0/3879225555 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4212533938 0 0) 0x7fa3e40b50a0 con 0x7fa3e40d56f0 2024-09-19T09:20:17.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.785+0000 7fa3e9b80640 1 --2- 172.21.15.18:0/3879225555 >> v2:172.21.15.162:3300/0 conn(0x7fa3e4162460 0x7fa3e40d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:17.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.785+0000 7fa3e8b7e640 1 -- 172.21.15.18:0/3879225555 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3d0003520 con 0x7fa3e40d56f0 2024-09-19T09:20:17.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.785+0000 7fa3e8b7e640 1 -- 172.21.15.18:0/3879225555 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1276580222 0 0) 0x7fa3d0003520 con 0x7fa3e40d56f0 2024-09-19T09:20:17.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.785+0000 7fa3e8b7e640 1 -- 172.21.15.18:0/3879225555 >> v2:172.21.15.162:3300/0 conn(0x7fa3e4162460 msgr2=0x7fa3e40d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:17.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.785+0000 7fa3e8b7e640 1 --2- 172.21.15.18:0/3879225555 >> v2:172.21.15.162:3300/0 conn(0x7fa3e4162460 0x7fa3e40d1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.785+0000 7fa3e8b7e640 1 -- 172.21.15.18:0/3879225555 >> v1:172.21.15.162:6789/0 conn(0x7fa3e40d1ac0 legacy=0x7fa3e40d3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:17.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.785+0000 7fa3e8b7e640 1 -- 172.21.15.18:0/3879225555 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e40b5660 con 0x7fa3e40d56f0 2024-09-19T09:20:17.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.785+0000 7fa3e8b7e640 1 -- 172.21.15.18:0/3879225555 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fa3d4001670 con 0x7fa3e40d56f0 2024-09-19T09:20:17.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.785+0000 7fa3e8b7e640 1 -- 172.21.15.18:0/3879225555 >> v1:172.21.15.18:6789/0 conn(0x7fa3e40d56f0 legacy=0x7fa3e40d2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:17.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.785+0000 7fa3e8b7e640 1 --2- 172.21.15.18:0/3879225555 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3d00039b0 0x7fa3d0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:17.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.785+0000 7fa3e8b7e640 1 --2- 172.21.15.18:0/3879225555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3d00043b0 0x7fa3d0004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:17.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.786+0000 7fa3e8b7e640 1 --2- 172.21.15.18:0/3879225555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3d0005080 0x7fa3d000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:17.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.786+0000 7fa3e8b7e640 1 -- 172.21.15.18:0/3879225555 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e40b5940 con 0x7fa3d00043b0 2024-09-19T09:20:17.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.786+0000 7fa3e8b7e640 1 -- 172.21.15.18:0/3879225555 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d000bfe0 con 0x7fa3d0005080 2024-09-19T09:20:17.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.786+0000 7fa3e8b7e640 1 -- 172.21.15.18:0/3879225555 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa3d000c1e0 con 0x7fa3d00039b0 2024-09-19T09:20:17.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.786+0000 7fa3e937f640 1 --2- 172.21.15.18:0/3879225555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3d00043b0 0x7fa3d0004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:17.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.786+0000 7fa3e9b80640 1 --2- 172.21.15.18:0/3879225555 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3d00039b0 0x7fa3d0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:17.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.786+0000 7fa3ea381640 1 --2- 172.21.15.18:0/3879225555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3d0005080 0x7fa3d000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:17.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.786+0000 7fa3e937f640 1 -- 172.21.15.18:0/3879225555 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3d00039b0 msgr2=0x7fa3d0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:17.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.786+0000 7fa3e937f640 1 --2- 172.21.15.18:0/3879225555 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3d00039b0 0x7fa3d0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.786+0000 7fa3e937f640 1 -- 172.21.15.18:0/3879225555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3d0005080 msgr2=0x7fa3d000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:17.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.786+0000 7fa3e937f640 1 --2- 172.21.15.18:0/3879225555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3d0005080 0x7fa3d000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.786+0000 7fa3e937f640 1 -- 172.21.15.18:0/3879225555 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d0003520 con 0x7fa3d00043b0 2024-09-19T09:20:17.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.786+0000 7fa3ea381640 1 --2- 172.21.15.18:0/3879225555 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3d0005080 0x7fa3d000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:17.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.786+0000 7fa3ea381640 1 -- 172.21.15.18:0/3879225555 reap_dead start 2024-09-19T09:20:17.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.787+0000 7fa3e937f640 1 --2- 172.21.15.18:0/3879225555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3d00043b0 0x7fa3d0004880 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400c290 tx=0x7fa3d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d270e4e299e16d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:17.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.787+0000 7fa3e8b7e640 1 -- 172.21.15.18:0/3879225555 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4007d50 con 0x7fa3d00043b0 2024-09-19T09:20:17.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.787+0000 7fa3e8b7e640 1 -- 172.21.15.18:0/3879225555 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d4005af0 con 0x7fa3d00043b0 2024-09-19T09:20:17.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.787+0000 7fa3e8b7e640 1 -- 172.21.15.18:0/3879225555 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4007070 con 0x7fa3d00043b0 2024-09-19T09:20:17.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.787+0000 7fa3ebde4640 1 -- 172.21.15.18:0/3879225555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3d00043b0 msgr2=0x7fa3d0004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:17.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.787+0000 7fa3ebde4640 1 --2- 172.21.15.18:0/3879225555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3d00043b0 0x7fa3d0004880 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400c290 tx=0x7fa3d0005830 comp rx=0 tx=0).stop 2024-09-19T09:20:17.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.787+0000 7fa3ebde4640 1 -- 172.21.15.18:0/3879225555 shutdown_connections 2024-09-19T09:20:17.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.787+0000 7fa3ebde4640 1 --2- 172.21.15.18:0/3879225555 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3d00043b0 0x7fa3d0004880 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.787+0000 7fa3ebde4640 1 -- 172.21.15.18:0/3879225555 >> 172.21.15.18:0/3879225555 conn(0x7fa3e40d4bd0 msgr2=0x7fa3e40d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:17.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.787+0000 7fa3ebde4640 1 -- 172.21.15.18:0/3879225555 shutdown_connections 2024-09-19T09:20:17.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.787+0000 7fa3ebde4640 1 -- 172.21.15.18:0/3879225555 wait complete. 2024-09-19T09:20:17.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.789+0000 7fa3ebde4640 1 Processor -- start 2024-09-19T09:20:17.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.789+0000 7fa3ebde4640 1 -- start start 2024-09-19T09:20:17.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.789+0000 7fa3ebde4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3d00043b0 0x7fa3e41f4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:17.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.789+0000 7fa3ebde4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3e40cebd0 0x7fa3e40b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:17.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.789+0000 7fa3ebde4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e41f8810 0x7fa3e4160d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:17.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.789+0000 7fa3ebde4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e40b5e40 con 0x7fa3d00043b0 2024-09-19T09:20:17.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.789+0000 7fa3ebde4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa3e40b5cc0 con 0x7fa3e41f8810 2024-09-19T09:20:17.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.789+0000 7fa3ebde4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa3e4162840 con 0x7fa3e40cebd0 2024-09-19T09:20:17.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.789+0000 7fa3e9b80640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3d00043b0 0x7fa3e41f4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:17.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.789+0000 7fa3e9b80640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3d00043b0 0x7fa3e41f4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53210/0 (socket says 172.21.15.18:53210) 2024-09-19T09:20:17.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.789+0000 7fa3e9b80640 1 -- 172.21.15.18:0/88740576 learned_addr learned my addr 172.21.15.18:0/88740576 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:17.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.790+0000 7fa3ea381640 1 --2- 172.21.15.18:0/88740576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e41f8810 0x7fa3e4160d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:17.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.790+0000 7fa3e937f640 1 --2- 172.21.15.18:0/88740576 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3e40cebd0 0x7fa3e40b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:17.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.790+0000 7fa3e9b80640 1 -- 172.21.15.18:0/88740576 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3e40cebd0 msgr2=0x7fa3e40b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:17.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.790+0000 7fa3e9b80640 1 --2- 172.21.15.18:0/88740576 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3e40cebd0 0x7fa3e40b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.790+0000 7fa3e9b80640 1 -- 172.21.15.18:0/88740576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e41f8810 msgr2=0x7fa3e4160d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:17.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.790+0000 7fa3e9b80640 1 --2- 172.21.15.18:0/88740576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e41f8810 0x7fa3e4160d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:17.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.790+0000 7fa3e9b80640 1 -- 172.21.15.18:0/88740576 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3e41508d0 con 0x7fa3d00043b0 2024-09-19T09:20:17.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.790+0000 7fa3e9b80640 1 --2- 172.21.15.18:0/88740576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3d00043b0 0x7fa3e41f4320 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0011a70 tx=0x7fa3e0011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:17.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.790+0000 7fa3da7fc640 1 -- 172.21.15.18:0/88740576 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e000fb50 con 0x7fa3d00043b0 2024-09-19T09:20:17.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.790+0000 7fa3da7fc640 1 -- 172.21.15.18:0/88740576 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3e000fcf0 con 0x7fa3d00043b0 2024-09-19T09:20:17.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.790+0000 7fa3da7fc640 1 -- 172.21.15.18:0/88740576 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3e000fea0 con 0x7fa3d00043b0 2024-09-19T09:20:17.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.790+0000 7fa3ebde4640 1 -- 172.21.15.18:0/88740576 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3e4150b60 con 0x7fa3d00043b0 2024-09-19T09:20:17.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.790+0000 7fa3ebde4640 1 -- 172.21.15.18:0/88740576 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3e4151120 con 0x7fa3d00043b0 2024-09-19T09:20:17.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.791+0000 7fa3ebde4640 1 -- 172.21.15.18:0/88740576 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3e40b5380 con 0x7fa3d00043b0 2024-09-19T09:20:17.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.792+0000 7fa3da7fc640 1 -- 172.21.15.18:0/88740576 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa3e0012040 con 0x7fa3d00043b0 2024-09-19T09:20:17.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.792+0000 7fa3da7fc640 1 --2- 172.21.15.18:0/88740576 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa3c806c2e0 0x7fa3c806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:17.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.792+0000 7fa3da7fc640 1 -- 172.21.15.18:0/88740576 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5796+0+0 (secure 0 0 0) 0x7fa3e008bb80 con 0x7fa3d00043b0 2024-09-19T09:20:17.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.792+0000 7fa3e937f640 1 --2- 172.21.15.18:0/88740576 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa3c806c2e0 0x7fa3c806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:17.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.793+0000 7fa3e937f640 1 --2- 172.21.15.18:0/88740576 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa3c806c2e0 0x7fa3c806e7a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4033000 tx=0x7fa3d402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:17.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:17.796+0000 7fa3da7fc640 1 -- 172.21.15.18:0/88740576 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa3e0019030 con 0x7fa3d00043b0 2024-09-19T09:20:18.009 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.009+0000 7fa3ebde4640 1 -- 172.21.15.18:0/88740576 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa3e40d41c0 con 0x7fa3d00043b0 2024-09-19T09:20:18.010 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-19T09:20:18.009+0000 7fca8a79c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:20:18.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.011+0000 7fa3da7fc640 1 -- 172.21.15.18:0/88740576 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v57) ==== 161+0+0 (secure 0 0 0) 0x7fa3e0059c40 con 0x7fa3d00043b0 2024-09-19T09:20:18.013 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T09:20:18.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.013+0000 7fa3ebde4640 1 -- 172.21.15.18:0/88740576 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa3c806c2e0 msgr2=0x7fa3c806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:18.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.013+0000 7fa3ebde4640 1 --2- 172.21.15.18:0/88740576 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa3c806c2e0 0x7fa3c806e7a0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4033000 tx=0x7fa3d402e000 comp rx=0 tx=0).stop 2024-09-19T09:20:18.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.013+0000 7fa3ebde4640 1 -- 172.21.15.18:0/88740576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3d00043b0 msgr2=0x7fa3e41f4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:18.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.013+0000 7fa3ebde4640 1 --2- 172.21.15.18:0/88740576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3d00043b0 0x7fa3e41f4320 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0011a70 tx=0x7fa3e0011f30 comp rx=0 tx=0).stop 2024-09-19T09:20:18.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.014+0000 7fa3ebde4640 1 -- 172.21.15.18:0/88740576 shutdown_connections 2024-09-19T09:20:18.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.014+0000 7fa3ebde4640 1 --2- 172.21.15.18:0/88740576 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa3c806c2e0 0x7fa3c806e7a0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:18.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.014+0000 7fa3ebde4640 1 --2- 172.21.15.18:0/88740576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3e41f8810 0x7fa3e4160d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:18.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.014+0000 7fa3ebde4640 1 --2- 172.21.15.18:0/88740576 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa3e40cebd0 0x7fa3e40b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:18.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.014+0000 7fa3ebde4640 1 --2- 172.21.15.18:0/88740576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa3d00043b0 0x7fa3e41f4320 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:18.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.014+0000 7fa3ebde4640 1 -- 172.21.15.18:0/88740576 >> 172.21.15.18:0/88740576 conn(0x7fa3e40d4bd0 msgr2=0x7fa3e40d0140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:18.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.014+0000 7fa3ebde4640 1 -- 172.21.15.18:0/88740576 shutdown_connections 2024-09-19T09:20:18.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.014+0000 7fa3ebde4640 1 -- 172.21.15.18:0/88740576 wait complete. 2024-09-19T09:20:18.018 INFO:tasks.ceph.mds.a.smithi018.stderr: -9689> 2024-09-19T09:19:41.287+0000 7fd37efec640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T09:20:18.028 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T09:20:18.053 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-09-19T09:20:18.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.133+0000 7f07d3f31640 1 Processor -- start 2024-09-19T09:20:18.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.133+0000 7f07d3f31640 1 -- start start 2024-09-19T09:20:18.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.134+0000 7f07d3f31640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07cc0d17f0 0x7f07cc0b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:18.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.134+0000 7f07d3f31640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f07cc1626c0 0x7f07cc0b5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:18.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.134+0000 7f07d3f31640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07cc0d5c20 con 0x7f07cc0d1bd0 2024-09-19T09:20:18.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.134+0000 7f07d3f31640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f07cc0b5020 con 0x7f07cc1626c0 2024-09-19T09:20:18.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.134+0000 7f07d3f31640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f07cc0d2150 con 0x7f07cc0d17f0 2024-09-19T09:20:18.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.134+0000 7f07d24ce640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f07cc1626c0 0x7f07cc0b5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:18.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.134+0000 7f07d14cc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f07cc0d1bd0 0x7f07cc161fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34968/0 (socket says 172.21.15.18:34968) 2024-09-19T09:20:18.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.134+0000 7f07d14cc640 1 -- 172.21.15.18:0/86901355 learned_addr learned my addr 172.21.15.18:0/86901355 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:20:18.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.134+0000 7f07d1ccd640 1 --2- 172.21.15.18:0/86901355 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07cc0d17f0 0x7f07cc0b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:18.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.134+0000 7f07d24ce640 1 -- 172.21.15.18:0/86901355 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07cc0d17f0 msgr2=0x7f07cc0b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:18.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.134+0000 7f07d24ce640 1 --2- 172.21.15.18:0/86901355 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07cc0d17f0 0x7f07cc0b54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:18.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.134+0000 7f07d24ce640 1 -- 172.21.15.18:0/86901355 >> v1:172.21.15.18:6789/0 conn(0x7f07cc0d1bd0 legacy=0x7f07cc161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:18.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.134+0000 7f07d24ce640 1 -- 172.21.15.18:0/86901355 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07cc0d2430 con 0x7f07cc1626c0 2024-09-19T09:20:18.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.134+0000 7f07d0ccb640 1 -- 172.21.15.18:0/86901355 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1362427239 0 0) 0x7f07cc0d5c20 con 0x7f07cc0d1bd0 2024-09-19T09:20:18.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.134+0000 7f07d1ccd640 1 --2- 172.21.15.18:0/86901355 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07cc0d17f0 0x7f07cc0b54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:18.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.135+0000 7f07d24ce640 1 --2- 172.21.15.18:0/86901355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07cc1626c0 0x7f07cc0b5a20 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f07c4009d90 tx=0x7f07c402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb759dfbe02383 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:18.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.135+0000 7f07d0ccb640 1 -- 172.21.15.18:0/86901355 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c4007740 con 0x7f07cc1626c0 2024-09-19T09:20:18.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.135+0000 7f07d0ccb640 1 -- 172.21.15.18:0/86901355 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07c40078e0 con 0x7f07cc1626c0 2024-09-19T09:20:18.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.135+0000 7f07d0ccb640 1 -- 172.21.15.18:0/86901355 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07c4007cb0 con 0x7f07cc1626c0 2024-09-19T09:20:18.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.136+0000 7f07d3f31640 1 -- 172.21.15.18:0/86901355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07cc1626c0 msgr2=0x7f07cc0b5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:18.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.136+0000 7f07d3f31640 1 --2- 172.21.15.18:0/86901355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07cc1626c0 0x7f07cc0b5a20 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f07c4009d90 tx=0x7f07c402a660 comp rx=0 tx=0).stop 2024-09-19T09:20:18.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.136+0000 7f07d3f31640 1 -- 172.21.15.18:0/86901355 shutdown_connections 2024-09-19T09:20:18.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.136+0000 7f07d3f31640 1 --2- 172.21.15.18:0/86901355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07cc1626c0 0x7f07cc0b5a20 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:18.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.136+0000 7f07d3f31640 1 --2- 172.21.15.18:0/86901355 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07cc0d17f0 0x7f07cc0b54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:18.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.136+0000 7f07d3f31640 1 -- 172.21.15.18:0/86901355 >> 172.21.15.18:0/86901355 conn(0x7f07cc0d4d20 msgr2=0x7f07cc0d5130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:18.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.136+0000 7f07d3f31640 1 -- 172.21.15.18:0/86901355 shutdown_connections 2024-09-19T09:20:18.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.136+0000 7f07d3f31640 1 -- 172.21.15.18:0/86901355 wait complete. 2024-09-19T09:20:18.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.137+0000 7f07d3f31640 1 Processor -- start 2024-09-19T09:20:18.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.137+0000 7f07d3f31640 1 -- start start 2024-09-19T09:20:18.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.138+0000 7f07d3f31640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07cc0d17f0 0x7f07cc0b9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:18.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.138+0000 7f07d3f31640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07cc0d1bd0 0x7f07cc0b7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:18.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.138+0000 7f07d3f31640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07cc1626c0 0x7f07cc0ca490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:18.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.138+0000 7f07d3f31640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f07cc0d0b70 con 0x7f07cc0d1bd0 2024-09-19T09:20:18.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.138+0000 7f07d3f31640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f07cc0d09f0 con 0x7f07cc0d17f0 2024-09-19T09:20:18.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.138+0000 7f07d3f31640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f07cc0d0cf0 con 0x7f07cc1626c0 2024-09-19T09:20:18.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.138+0000 7f07d14cc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07cc0d1bd0 0x7f07cc0b7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:18.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.138+0000 7f07d14cc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07cc0d1bd0 0x7f07cc0b7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53262/0 (socket says 172.21.15.18:53262) 2024-09-19T09:20:18.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.138+0000 7f07d14cc640 1 -- 172.21.15.18:0/1263481973 learned_addr learned my addr 172.21.15.18:0/1263481973 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:18.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.138+0000 7f07d1ccd640 1 --2- 172.21.15.18:0/1263481973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07cc0d17f0 0x7f07cc0b9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:18.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.138+0000 7f07d24ce640 1 --2- 172.21.15.18:0/1263481973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07cc1626c0 0x7f07cc0ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:18.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.138+0000 7f07d14cc640 1 -- 172.21.15.18:0/1263481973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07cc1626c0 msgr2=0x7f07cc0ca490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:18.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.138+0000 7f07d14cc640 1 --2- 172.21.15.18:0/1263481973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07cc1626c0 0x7f07cc0ca490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:18.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.138+0000 7f07d14cc640 1 -- 172.21.15.18:0/1263481973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07cc0d17f0 msgr2=0x7f07cc0b9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:18.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.138+0000 7f07d14cc640 1 --2- 172.21.15.18:0/1263481973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07cc0d17f0 0x7f07cc0b9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:18.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.138+0000 7f07d14cc640 1 -- 172.21.15.18:0/1263481973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07cc1f4a00 con 0x7f07cc0d1bd0 2024-09-19T09:20:18.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.138+0000 7f07d1ccd640 1 --2- 172.21.15.18:0/1263481973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07cc0d17f0 0x7f07cc0b9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:18.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.139+0000 7f07d14cc640 1 --2- 172.21.15.18:0/1263481973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07cc0d1bd0 0x7f07cc0b7b50 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f07bc00c4b0 tx=0x7f07bc00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:18.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.139+0000 7f07c27fc640 1 -- 172.21.15.18:0/1263481973 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc018070 con 0x7f07cc0d1bd0 2024-09-19T09:20:18.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.139+0000 7f07c27fc640 1 -- 172.21.15.18:0/1263481973 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07bc007500 con 0x7f07cc0d1bd0 2024-09-19T09:20:18.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.139+0000 7f07c27fc640 1 -- 172.21.15.18:0/1263481973 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07bc004a20 con 0x7f07cc0d1bd0 2024-09-19T09:20:18.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.139+0000 7f07d3f31640 1 -- 172.21.15.18:0/1263481973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07cc1f8440 con 0x7f07cc0d1bd0 2024-09-19T09:20:18.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.139+0000 7f07d3f31640 1 -- 172.21.15.18:0/1263481973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07cc1f8a00 con 0x7f07cc0d1bd0 2024-09-19T09:20:18.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.140+0000 7f07d3f31640 1 -- 172.21.15.18:0/1263481973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07cc0696e0 con 0x7f07cc0d1bd0 2024-09-19T09:20:18.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.140+0000 7f07c27fc640 1 -- 172.21.15.18:0/1263481973 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f07bc01b070 con 0x7f07cc0d1bd0 2024-09-19T09:20:18.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.141+0000 7f07c27fc640 1 --2- 172.21.15.18:0/1263481973 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f07b006c2b0 0x7f07b006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:18.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.141+0000 7f07c27fc640 1 -- 172.21.15.18:0/1263481973 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5882+0+0 (secure 0 0 0) 0x7f07bc08a810 con 0x7f07cc0d1bd0 2024-09-19T09:20:18.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.141+0000 7f07d1ccd640 1 --2- 172.21.15.18:0/1263481973 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f07b006c2b0 0x7f07b006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:18.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.141+0000 7f07d1ccd640 1 --2- 172.21.15.18:0/1263481973 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f07b006c2b0 0x7f07b006e770 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f07cc06d1a0 tx=0x7f07c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:18.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.145+0000 7f07c27fc640 1 -- 172.21.15.18:0/1263481973 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f07cc0696e0 con 0x7f07cc0d1bd0 2024-09-19T09:20:18.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:18.358+0000 7f07d3f31640 1 -- 172.21.15.18:0/1263481973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f07cc1f4bd0 con 0x7f07cc0d1bd0 2024-09-19T09:20:19.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.012+0000 7f07c27fc640 1 -- 172.21.15.18:0/1263481973 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v58) ==== 104+0+0 (secure 0 0 0) 0x7f07bc058f90 con 0x7f07cc0d1bd0 2024-09-19T09:20:19.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.015+0000 7f07d3f31640 1 -- 172.21.15.18:0/1263481973 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f07b006c2b0 msgr2=0x7f07b006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:19.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.015+0000 7f07d3f31640 1 --2- 172.21.15.18:0/1263481973 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f07b006c2b0 0x7f07b006e770 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f07cc06d1a0 tx=0x7f07c8008040 comp rx=0 tx=0).stop 2024-09-19T09:20:19.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.015+0000 7f07d3f31640 1 -- 172.21.15.18:0/1263481973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07cc0d1bd0 msgr2=0x7f07cc0b7b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:19.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.015+0000 7f07d3f31640 1 --2- 172.21.15.18:0/1263481973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07cc0d1bd0 0x7f07cc0b7b50 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f07bc00c4b0 tx=0x7f07bc00c970 comp rx=0 tx=0).stop 2024-09-19T09:20:19.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.015+0000 7f07d3f31640 1 -- 172.21.15.18:0/1263481973 shutdown_connections 2024-09-19T09:20:19.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.015+0000 7f07d3f31640 1 --2- 172.21.15.18:0/1263481973 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f07b006c2b0 0x7f07b006e770 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:19.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.015+0000 7f07d3f31640 1 --2- 172.21.15.18:0/1263481973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f07cc1626c0 0x7f07cc0ca490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:19.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.015+0000 7f07d3f31640 1 --2- 172.21.15.18:0/1263481973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f07cc0d1bd0 0x7f07cc0b7b50 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:19.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.015+0000 7f07d3f31640 1 --2- 172.21.15.18:0/1263481973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f07cc0d17f0 0x7f07cc0b9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:19.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.015+0000 7f07d3f31640 1 -- 172.21.15.18:0/1263481973 >> 172.21.15.18:0/1263481973 conn(0x7f07cc0d4d20 msgr2=0x7f07cc0d3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:19.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.015+0000 7f07d3f31640 1 -- 172.21.15.18:0/1263481973 shutdown_connections 2024-09-19T09:20:19.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.015+0000 7f07d3f31640 1 -- 172.21.15.18:0/1263481973 wait complete. 2024-09-19T09:20:19.030 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T09:20:19.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.184+0000 7fc37d79a640 1 Processor -- start 2024-09-19T09:20:19.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.184+0000 7fc37d79a640 1 -- start start 2024-09-19T09:20:19.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.185+0000 7fc37d79a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc3780b3c90 0x7fc3780b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:19.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.185+0000 7fc37d79a640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3780d0310 con 0x7fc37815edc0 2024-09-19T09:20:19.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.185+0000 7fc37d79a640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3780d05d0 con 0x7fc3780d3080 2024-09-19T09:20:19.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.185+0000 7fc37d79a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc3780d08b0 con 0x7fc3780b3c90 2024-09-19T09:20:19.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.185+0000 7fc376ffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc37815edc0 0x7fc3780d2830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34970/0 (socket says 172.21.15.18:34970) 2024-09-19T09:20:19.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.185+0000 7fc376ffd640 1 -- 172.21.15.18:0/293750345 learned_addr learned my addr 172.21.15.18:0/293750345 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:20:19.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.185+0000 7fc3767fc640 1 --2- 172.21.15.18:0/293750345 >> v2:172.21.15.162:3300/0 conn(0x7fc3780b3c90 0x7fc3780b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:19.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.186+0000 7fc375ffb640 1 -- 172.21.15.18:0/293750345 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1076798042 0 0) 0x7fc3780d0310 con 0x7fc37815edc0 2024-09-19T09:20:19.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.186+0000 7fc375ffb640 1 -- 172.21.15.18:0/293750345 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc364003520 con 0x7fc37815edc0 2024-09-19T09:20:19.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.186+0000 7fc375ffb640 1 -- 172.21.15.18:0/293750345 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4029317457 0 0) 0x7fc364003520 con 0x7fc37815edc0 2024-09-19T09:20:19.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.186+0000 7fc375ffb640 1 -- 172.21.15.18:0/293750345 >> v2:172.21.15.162:3300/0 conn(0x7fc3780b3c90 msgr2=0x7fc3780b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:19.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.186+0000 7fc375ffb640 1 --2- 172.21.15.18:0/293750345 >> v2:172.21.15.162:3300/0 conn(0x7fc3780b3c90 0x7fc3780b1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:19.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.186+0000 7fc375ffb640 1 -- 172.21.15.18:0/293750345 >> v1:172.21.15.162:6789/0 conn(0x7fc3780d3080 legacy=0x7fc3780d3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:19.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.186+0000 7fc375ffb640 1 -- 172.21.15.18:0/293750345 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3780d0b90 con 0x7fc37815edc0 2024-09-19T09:20:19.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.186+0000 7fc375ffb640 1 -- 172.21.15.18:0/293750345 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fc3680019f0 con 0x7fc37815edc0 2024-09-19T09:20:19.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.186+0000 7fc375ffb640 1 -- 172.21.15.18:0/293750345 >> v1:172.21.15.18:6789/0 conn(0x7fc37815edc0 legacy=0x7fc3780d2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:19.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.186+0000 7fc375ffb640 1 --2- 172.21.15.18:0/293750345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3640039b0 0x7fc364003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:19.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.186+0000 7fc375ffb640 1 --2- 172.21.15.18:0/293750345 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3640043b0 0x7fc364004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:19.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.186+0000 7fc375ffb640 1 --2- 172.21.15.18:0/293750345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc364005080 0x7fc36400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:19.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.186+0000 7fc375ffb640 1 -- 172.21.15.18:0/293750345 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc3780d08b0 con 0x7fc364005080 2024-09-19T09:20:19.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.186+0000 7fc375ffb640 1 -- 172.21.15.18:0/293750345 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc36400bfe0 con 0x7fc3640039b0 2024-09-19T09:20:19.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.186+0000 7fc375ffb640 1 -- 172.21.15.18:0/293750345 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc36400c1e0 con 0x7fc3640043b0 2024-09-19T09:20:19.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.186+0000 7fc3777fe640 1 --2- 172.21.15.18:0/293750345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc364005080 0x7fc36400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:19.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.186+0000 7fc376ffd640 1 --2- 172.21.15.18:0/293750345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3640039b0 0x7fc364003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:19.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.186+0000 7fc3767fc640 1 --2- 172.21.15.18:0/293750345 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3640043b0 0x7fc364004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:19.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.186+0000 7fc3777fe640 1 -- 172.21.15.18:0/293750345 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3640043b0 msgr2=0x7fc364004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:19.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.186+0000 7fc3777fe640 1 --2- 172.21.15.18:0/293750345 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3640043b0 0x7fc364004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:19.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.186+0000 7fc3777fe640 1 -- 172.21.15.18:0/293750345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3640039b0 msgr2=0x7fc364003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:19.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.186+0000 7fc3777fe640 1 --2- 172.21.15.18:0/293750345 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc3640039b0 0x7fc364003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:19.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.186+0000 7fc3777fe640 1 -- 172.21.15.18:0/293750345 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc364003520 con 0x7fc364005080 2024-09-19T09:20:19.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.187+0000 7fc3777fe640 1 -- 172.21.15.18:0/293750345 reap_dead start 2024-09-19T09:20:19.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.187+0000 7fc3777fe640 1 --2- 172.21.15.18:0/293750345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc364005080 0x7fc36400b9c0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fc370001860 tx=0x7fc364005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af6fdd40f490f8ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:19.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.187+0000 7fc375ffb640 1 -- 172.21.15.18:0/293750345 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc370001430 con 0x7fc364005080 2024-09-19T09:20:19.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.187+0000 7fc375ffb640 1 -- 172.21.15.18:0/293750345 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc370005330 con 0x7fc364005080 2024-09-19T09:20:19.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.187+0000 7fc375ffb640 1 -- 172.21.15.18:0/293750345 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc37002ac10 con 0x7fc364005080 2024-09-19T09:20:19.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.188+0000 7fc37d79a640 1 -- 172.21.15.18:0/293750345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc364005080 msgr2=0x7fc36400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:19.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.188+0000 7fc37d79a640 1 --2- 172.21.15.18:0/293750345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc364005080 0x7fc36400b9c0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fc370001860 tx=0x7fc364005830 comp rx=0 tx=0).stop 2024-09-19T09:20:19.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.188+0000 7fc37d79a640 1 -- 172.21.15.18:0/293750345 shutdown_connections 2024-09-19T09:20:19.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.188+0000 7fc37d79a640 1 --2- 172.21.15.18:0/293750345 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc364005080 0x7fc36400b9c0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:19.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.188+0000 7fc37d79a640 1 -- 172.21.15.18:0/293750345 >> 172.21.15.18:0/293750345 conn(0x7fc3780d4c60 msgr2=0x7fc3780d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:19.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.188+0000 7fc37d79a640 1 -- 172.21.15.18:0/293750345 shutdown_connections 2024-09-19T09:20:19.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.188+0000 7fc37d79a640 1 -- 172.21.15.18:0/293750345 wait complete. 2024-09-19T09:20:19.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.189+0000 7fc37d79a640 1 Processor -- start 2024-09-19T09:20:19.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.189+0000 7fc37d79a640 1 -- start start 2024-09-19T09:20:19.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.190+0000 7fc37d79a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc364005080 0x7fc3781f4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:19.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.190+0000 7fc37d79a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3781ee960 0x7fc378158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:19.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.190+0000 7fc37d79a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc37815b260 0x7fc37815b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:19.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.190+0000 7fc37d79a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc3780b1a10 con 0x7fc364005080 2024-09-19T09:20:19.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.190+0000 7fc37d79a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc3780b1890 con 0x7fc37815b260 2024-09-19T09:20:19.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.190+0000 7fc37d79a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc3780b1b90 con 0x7fc3781ee960 2024-09-19T09:20:19.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.190+0000 7fc376ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc364005080 0x7fc3781f4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:19.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.190+0000 7fc376ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc364005080 0x7fc3781f4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53284/0 (socket says 172.21.15.18:53284) 2024-09-19T09:20:19.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.190+0000 7fc376ffd640 1 -- 172.21.15.18:0/4294143700 learned_addr learned my addr 172.21.15.18:0/4294143700 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:19.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.190+0000 7fc3767fc640 1 --2- 172.21.15.18:0/4294143700 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3781ee960 0x7fc378158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:19.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.191+0000 7fc3777fe640 1 --2- 172.21.15.18:0/4294143700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc37815b260 0x7fc37815b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:19.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.191+0000 7fc376ffd640 1 -- 172.21.15.18:0/4294143700 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3781ee960 msgr2=0x7fc378158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:19.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.191+0000 7fc376ffd640 1 --2- 172.21.15.18:0/4294143700 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3781ee960 0x7fc378158b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:19.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.191+0000 7fc376ffd640 1 -- 172.21.15.18:0/4294143700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc37815b260 msgr2=0x7fc37815b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:19.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.191+0000 7fc376ffd640 1 --2- 172.21.15.18:0/4294143700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc37815b260 0x7fc37815b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:19.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.191+0000 7fc376ffd640 1 -- 172.21.15.18:0/4294143700 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3781f4e50 con 0x7fc364005080 2024-09-19T09:20:19.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.191+0000 7fc3777fe640 1 --2- 172.21.15.18:0/4294143700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc37815b260 0x7fc37815b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:19.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.191+0000 7fc3767fc640 1 --2- 172.21.15.18:0/4294143700 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3781ee960 0x7fc378158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:19.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.191+0000 7fc376ffd640 1 --2- 172.21.15.18:0/4294143700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc364005080 0x7fc3781f4820 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fc368007a50 tx=0x7fc36800a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:19.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.191+0000 7fc36f7fe640 1 -- 172.21.15.18:0/4294143700 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3680133f0 con 0x7fc364005080 2024-09-19T09:20:19.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.191+0000 7fc36f7fe640 1 -- 172.21.15.18:0/4294143700 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc368018070 con 0x7fc364005080 2024-09-19T09:20:19.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.191+0000 7fc36f7fe640 1 -- 172.21.15.18:0/4294143700 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3680137d0 con 0x7fc364005080 2024-09-19T09:20:19.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.191+0000 7fc37d79a640 1 -- 172.21.15.18:0/4294143700 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3781f5130 con 0x7fc364005080 2024-09-19T09:20:19.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.191+0000 7fc37d79a640 1 -- 172.21.15.18:0/4294143700 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3781f56f0 con 0x7fc364005080 2024-09-19T09:20:19.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.192+0000 7fc37d79a640 1 -- 172.21.15.18:0/4294143700 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3781eed40 con 0x7fc364005080 2024-09-19T09:20:19.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.192+0000 7fc36f7fe640 1 -- 172.21.15.18:0/4294143700 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc368013b80 con 0x7fc364005080 2024-09-19T09:20:19.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.193+0000 7fc36f7fe640 1 --2- 172.21.15.18:0/4294143700 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc35806c2b0 0x7fc35806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:19.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.193+0000 7fc36f7fe640 1 -- 172.21.15.18:0/4294143700 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5882+0+0 (secure 0 0 0) 0x7fc36808c030 con 0x7fc364005080 2024-09-19T09:20:19.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.193+0000 7fc3767fc640 1 --2- 172.21.15.18:0/4294143700 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc35806c2b0 0x7fc35806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:19.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.194+0000 7fc3767fc640 1 --2- 172.21.15.18:0/4294143700 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc35806c2b0 0x7fc35806e770 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc3600093d0 tx=0x7fc360008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:19.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.197+0000 7fc36f7fe640 1 -- 172.21.15.18:0/4294143700 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc36805a6f0 con 0x7fc364005080 2024-09-19T09:20:19.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:19.380+0000 7fc37d79a640 1 -- 172.21.15.18:0/4294143700 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc378069760 con 0x7fc364005080 2024-09-19T09:20:20.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.256+0000 7fc36f7fe640 1 -- 172.21.15.18:0/4294143700 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v144) ==== 181+0+0 (secure 0 0 0) 0x7fc368059ff0 con 0x7fc364005080 2024-09-19T09:20:20.257 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' removed 2024-09-19T09:20:20.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.260+0000 7fc37d79a640 1 -- 172.21.15.18:0/4294143700 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc35806c2b0 msgr2=0x7fc35806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:20.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.260+0000 7fc37d79a640 1 --2- 172.21.15.18:0/4294143700 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc35806c2b0 0x7fc35806e770 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc3600093d0 tx=0x7fc360008040 comp rx=0 tx=0).stop 2024-09-19T09:20:20.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.260+0000 7fc37d79a640 1 -- 172.21.15.18:0/4294143700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc364005080 msgr2=0x7fc3781f4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:20.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.260+0000 7fc37d79a640 1 --2- 172.21.15.18:0/4294143700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc364005080 0x7fc3781f4820 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fc368007a50 tx=0x7fc36800a730 comp rx=0 tx=0).stop 2024-09-19T09:20:20.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.260+0000 7fc37d79a640 1 -- 172.21.15.18:0/4294143700 shutdown_connections 2024-09-19T09:20:20.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.260+0000 7fc37d79a640 1 --2- 172.21.15.18:0/4294143700 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc35806c2b0 0x7fc35806e770 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:20.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.260+0000 7fc37d79a640 1 --2- 172.21.15.18:0/4294143700 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc37815b260 0x7fc37815b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:20.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.260+0000 7fc37d79a640 1 --2- 172.21.15.18:0/4294143700 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc3781ee960 0x7fc378158b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:20.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.260+0000 7fc37d79a640 1 --2- 172.21.15.18:0/4294143700 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc364005080 0x7fc3781f4820 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:20.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.260+0000 7fc37d79a640 1 -- 172.21.15.18:0/4294143700 >> 172.21.15.18:0/4294143700 conn(0x7fc3780d4c60 msgr2=0x7fc3780cf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:20.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.260+0000 7fc37d79a640 1 -- 172.21.15.18:0/4294143700 shutdown_connections 2024-09-19T09:20:20.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.260+0000 7fc37d79a640 1 -- 172.21.15.18:0/4294143700 wait complete. 2024-09-19T09:20:20.275 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T09:20:20.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.387+0000 7fe249111640 1 Processor -- start 2024-09-19T09:20:20.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.387+0000 7fe249111640 1 -- start start 2024-09-19T09:20:20.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.387+0000 7fe249111640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe24415edc0 0x7fe2440b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:20.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.387+0000 7fe249111640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe2440b3c90 0x7fe2440d2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:20.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.387+0000 7fe249111640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe2440d3080 0x7fe2440d34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:20.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.387+0000 7fe249111640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fe2440d3a30 con 0x7fe2440d3080 2024-09-19T09:20:20.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.387+0000 7fe249111640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe2440d0310 con 0x7fe2440b3c90 2024-09-19T09:20:20.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.387+0000 7fe249111640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe2440d05d0 con 0x7fe24415edc0 2024-09-19T09:20:20.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.388+0000 7fe24359e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe2440d3080 0x7fe2440d34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:20.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.388+0000 7fe24359e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe2440d3080 0x7fe2440d34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53290/0 (socket says 172.21.15.18:53290) 2024-09-19T09:20:20.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.388+0000 7fe24359e640 1 -- 172.21.15.18:0/912336811 learned_addr learned my addr 172.21.15.18:0/912336811 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:20.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.388+0000 7fe24359e640 1 -- 172.21.15.18:0/912336811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe24415edc0 msgr2=0x7fe2440b1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:20.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.388+0000 7fe24259c640 1 --2- 172.21.15.18:0/912336811 >> v2:172.21.15.162:3300/0 conn(0x7fe2440b3c90 0x7fe2440d2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:20.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.388+0000 7fe242d9d640 1 --2- 172.21.15.18:0/912336811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe24415edc0 0x7fe2440b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:20.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.388+0000 7fe24359e640 1 --2- 172.21.15.18:0/912336811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe24415edc0 0x7fe2440b1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:20.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.388+0000 7fe24359e640 1 -- 172.21.15.18:0/912336811 >> v2:172.21.15.162:3300/0 conn(0x7fe2440b3c90 msgr2=0x7fe2440d2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:20.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.388+0000 7fe24359e640 1 --2- 172.21.15.18:0/912336811 >> v2:172.21.15.162:3300/0 conn(0x7fe2440b3c90 0x7fe2440d2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:20.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.388+0000 7fe24359e640 1 -- 172.21.15.18:0/912336811 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2440d08b0 con 0x7fe2440d3080 2024-09-19T09:20:20.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.389+0000 7fe24359e640 1 --2- 172.21.15.18:0/912336811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2440d3080 0x7fe2440d34f0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fe24408d460 tx=0x7fe23c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d1b9964097aef9a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:20.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.389+0000 7fe241d9b640 1 -- 172.21.15.18:0/912336811 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c036070 con 0x7fe2440d3080 2024-09-19T09:20:20.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.389+0000 7fe241d9b640 1 -- 172.21.15.18:0/912336811 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe23c031600 con 0x7fe2440d3080 2024-09-19T09:20:20.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.389+0000 7fe241d9b640 1 -- 172.21.15.18:0/912336811 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe23c0319d0 con 0x7fe2440d3080 2024-09-19T09:20:20.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.389+0000 7fe249111640 1 -- 172.21.15.18:0/912336811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2440d3080 msgr2=0x7fe2440d34f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:20.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.389+0000 7fe249111640 1 --2- 172.21.15.18:0/912336811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2440d3080 0x7fe2440d34f0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fe24408d460 tx=0x7fe23c02a6a0 comp rx=0 tx=0).stop 2024-09-19T09:20:20.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.389+0000 7fe249111640 1 -- 172.21.15.18:0/912336811 shutdown_connections 2024-09-19T09:20:20.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.389+0000 7fe249111640 1 --2- 172.21.15.18:0/912336811 >> v2:172.21.15.162:3300/0 conn(0x7fe2440b3c90 0x7fe2440d2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:20.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.389+0000 7fe249111640 1 --2- 172.21.15.18:0/912336811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2440d3080 0x7fe2440d34f0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:20.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.389+0000 7fe249111640 1 --2- 172.21.15.18:0/912336811 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe24415edc0 0x7fe2440b1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:20.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.389+0000 7fe249111640 1 -- 172.21.15.18:0/912336811 >> 172.21.15.18:0/912336811 conn(0x7fe2440d4c60 msgr2=0x7fe2440d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:20.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.389+0000 7fe249111640 1 -- 172.21.15.18:0/912336811 shutdown_connections 2024-09-19T09:20:20.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.389+0000 7fe249111640 1 -- 172.21.15.18:0/912336811 wait complete. 2024-09-19T09:20:20.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.391+0000 7fe249111640 1 Processor -- start 2024-09-19T09:20:20.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.391+0000 7fe249111640 1 -- start start 2024-09-19T09:20:20.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.392+0000 7fe249111640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2440b3c90 0x7fe2440cc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:20.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.392+0000 7fe249111640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2440d3080 0x7fe244158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:20.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.392+0000 7fe249111640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe24415edc0 0x7fe2440c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:20.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.392+0000 7fe249111640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe2440d2d70 con 0x7fe2440b3c90 2024-09-19T09:20:20.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.392+0000 7fe249111640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe2440d1310 con 0x7fe2440d3080 2024-09-19T09:20:20.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.392+0000 7fe249111640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe2440d1810 con 0x7fe24415edc0 2024-09-19T09:20:20.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.392+0000 7fe242d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2440b3c90 0x7fe2440cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:20.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.392+0000 7fe242d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2440b3c90 0x7fe2440cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53292/0 (socket says 172.21.15.18:53292) 2024-09-19T09:20:20.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.392+0000 7fe242d9d640 1 -- 172.21.15.18:0/1582280734 learned_addr learned my addr 172.21.15.18:0/1582280734 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:20.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.392+0000 7fe24259c640 1 --2- 172.21.15.18:0/1582280734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2440d3080 0x7fe244158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:20.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.392+0000 7fe24359e640 1 --2- 172.21.15.18:0/1582280734 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe24415edc0 0x7fe2440c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:20.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.392+0000 7fe242d9d640 1 -- 172.21.15.18:0/1582280734 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe24415edc0 msgr2=0x7fe2440c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:20.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.392+0000 7fe242d9d640 1 --2- 172.21.15.18:0/1582280734 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe24415edc0 0x7fe2440c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:20.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.392+0000 7fe242d9d640 1 -- 172.21.15.18:0/1582280734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2440d3080 msgr2=0x7fe244158b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:20.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.392+0000 7fe242d9d640 1 --2- 172.21.15.18:0/1582280734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2440d3080 0x7fe244158b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:20.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.392+0000 7fe242d9d640 1 -- 172.21.15.18:0/1582280734 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe24415aa70 con 0x7fe2440b3c90 2024-09-19T09:20:20.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.392+0000 7fe24359e640 1 --2- 172.21.15.18:0/1582280734 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe24415edc0 0x7fe2440c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:20.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.392+0000 7fe24259c640 1 --2- 172.21.15.18:0/1582280734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2440d3080 0x7fe244158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:20.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.392+0000 7fe242d9d640 1 --2- 172.21.15.18:0/1582280734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2440b3c90 0x7fe2440cc890 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fe23400c7f0 tx=0x7fe23400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:20.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.392+0000 7fe22b7fe640 1 -- 172.21.15.18:0/1582280734 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe234015070 con 0x7fe2440b3c90 2024-09-19T09:20:20.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.393+0000 7fe22b7fe640 1 -- 172.21.15.18:0/1582280734 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe234004220 con 0x7fe2440b3c90 2024-09-19T09:20:20.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.393+0000 7fe249111640 1 -- 172.21.15.18:0/1582280734 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe24415ad50 con 0x7fe2440b3c90 2024-09-19T09:20:20.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.393+0000 7fe22b7fe640 1 -- 172.21.15.18:0/1582280734 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe234007620 con 0x7fe2440b3c90 2024-09-19T09:20:20.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.393+0000 7fe249111640 1 -- 172.21.15.18:0/1582280734 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe24415b310 con 0x7fe2440b3c90 2024-09-19T09:20:20.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.393+0000 7fe249111640 1 -- 172.21.15.18:0/1582280734 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2440d34f0 con 0x7fe2440b3c90 2024-09-19T09:20:20.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.394+0000 7fe22b7fe640 1 -- 172.21.15.18:0/1582280734 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe2340077c0 con 0x7fe2440b3c90 2024-09-19T09:20:20.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.394+0000 7fe22b7fe640 1 --2- 172.21.15.18:0/1582280734 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe23006c2b0 0x7fe23006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:20.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.395+0000 7fe22b7fe640 1 -- 172.21.15.18:0/1582280734 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(144..144 src has 1..144) ==== 5415+0+0 (secure 0 0 0) 0x7fe23408b4f0 con 0x7fe2440b3c90 2024-09-19T09:20:20.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.395+0000 7fe24259c640 1 --2- 172.21.15.18:0/1582280734 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe23006c2b0 0x7fe23006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:20.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.395+0000 7fe24259c640 1 --2- 172.21.15.18:0/1582280734 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe23006c2b0 0x7fe23006e770 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe238006fd0 tx=0x7fe238008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:20.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.399+0000 7fe22b7fe640 1 -- 172.21.15.18:0/1582280734 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe234059d00 con 0x7fe2440b3c90 2024-09-19T09:20:20.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:20.577+0000 7fe249111640 1 -- 172.21.15.18:0/1582280734 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe2440b3300 con 0x7fe2440b3c90 2024-09-19T09:20:21.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.229+0000 7fe22b7fe640 1 -- 172.21.15.18:0/1582280734 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v145) ==== 169+0+0 (secure 0 0 0) 0x7fe234059600 con 0x7fe2440b3c90 2024-09-19T09:20:21.230 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' removed 2024-09-19T09:20:21.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.232+0000 7fe249111640 1 -- 172.21.15.18:0/1582280734 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe23006c2b0 msgr2=0x7fe23006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:21.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.232+0000 7fe249111640 1 --2- 172.21.15.18:0/1582280734 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe23006c2b0 0x7fe23006e770 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe238006fd0 tx=0x7fe238008040 comp rx=0 tx=0).stop 2024-09-19T09:20:21.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.232+0000 7fe249111640 1 -- 172.21.15.18:0/1582280734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2440b3c90 msgr2=0x7fe2440cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:21.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.232+0000 7fe249111640 1 --2- 172.21.15.18:0/1582280734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2440b3c90 0x7fe2440cc890 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fe23400c7f0 tx=0x7fe23400ccb0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.232+0000 7fe249111640 1 -- 172.21.15.18:0/1582280734 shutdown_connections 2024-09-19T09:20:21.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.232+0000 7fe249111640 1 --2- 172.21.15.18:0/1582280734 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe23006c2b0 0x7fe23006e770 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.232+0000 7fe249111640 1 --2- 172.21.15.18:0/1582280734 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe24415edc0 0x7fe2440c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.233 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.232+0000 7fe249111640 1 --2- 172.21.15.18:0/1582280734 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe2440d3080 0x7fe244158b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.232+0000 7fe249111640 1 --2- 172.21.15.18:0/1582280734 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe2440b3c90 0x7fe2440cc890 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.232+0000 7fe249111640 1 -- 172.21.15.18:0/1582280734 >> 172.21.15.18:0/1582280734 conn(0x7fe2440d4c60 msgr2=0x7fe2440b7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:21.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.232+0000 7fe249111640 1 -- 172.21.15.18:0/1582280734 shutdown_connections 2024-09-19T09:20:21.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.232+0000 7fe249111640 1 -- 172.21.15.18:0/1582280734 wait complete. 2024-09-19T09:20:21.246 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-19T09:20:21.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.354+0000 7f44b061e640 1 Processor -- start 2024-09-19T09:20:21.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.354+0000 7f44b061e640 1 -- start start 2024-09-19T09:20:21.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.355+0000 7f44b061e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44a80b9460 0x7f44a8169900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.355+0000 7f44b061e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44a80d36d0 con 0x7f44a80d3240 2024-09-19T09:20:21.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.355+0000 7f44b061e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44a80d39b0 con 0x7f44a815ef00 2024-09-19T09:20:21.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.355+0000 7f44b061e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f44a80d5ad0 con 0x7f44a80b9460 2024-09-19T09:20:21.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.355+0000 7f44adbb9640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f44a80d3240 0x7f44a80cfe80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34986/0 (socket says 172.21.15.18:34986) 2024-09-19T09:20:21.356 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.355+0000 7f44adbb9640 1 -- 172.21.15.18:0/278076427 learned_addr learned my addr 172.21.15.18:0/278076427 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:20:21.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.356+0000 7f44ad3b8640 1 -- 172.21.15.18:0/278076427 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 767967605 0 0) 0x7f44a80d36d0 con 0x7f44a80d3240 2024-09-19T09:20:21.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.356+0000 7f44ad3b8640 1 -- 172.21.15.18:0/278076427 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4490003520 con 0x7f44a80d3240 2024-09-19T09:20:21.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.356+0000 7f44aebbb640 1 --2- 172.21.15.18:0/278076427 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44a80b9460 0x7f44a8169900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.356+0000 7f44ad3b8640 1 -- 172.21.15.18:0/278076427 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1674605496 0 0) 0x7f4490003520 con 0x7f44a80d3240 2024-09-19T09:20:21.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.356+0000 7f44ad3b8640 1 -- 172.21.15.18:0/278076427 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44a80b9460 msgr2=0x7f44a8169900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:21.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.356+0000 7f44ad3b8640 1 --2- 172.21.15.18:0/278076427 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44a80b9460 0x7f44a8169900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.356+0000 7f44ad3b8640 1 -- 172.21.15.18:0/278076427 >> v1:172.21.15.162:6789/0 conn(0x7f44a815ef00 legacy=0x7f44a80cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:21.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.356+0000 7f44ad3b8640 1 -- 172.21.15.18:0/278076427 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a80b7c50 con 0x7f44a80d3240 2024-09-19T09:20:21.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.356+0000 7f44ad3b8640 1 -- 172.21.15.18:0/278076427 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f449c001670 con 0x7f44a80d3240 2024-09-19T09:20:21.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.356+0000 7f44ad3b8640 1 -- 172.21.15.18:0/278076427 >> v1:172.21.15.18:6789/0 conn(0x7f44a80d3240 legacy=0x7f44a80cfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:21.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.356+0000 7f44ad3b8640 1 --2- 172.21.15.18:0/278076427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44900039e0 0x7f4490003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.356+0000 7f44ad3b8640 1 --2- 172.21.15.18:0/278076427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4490004800 0x7f4490004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.356+0000 7f44ad3b8640 1 --2- 172.21.15.18:0/278076427 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44a80b9460 0x7f44900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.356+0000 7f44ad3b8640 1 -- 172.21.15.18:0/278076427 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f449000ba70 con 0x7f44900039e0 2024-09-19T09:20:21.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.356+0000 7f44ad3b8640 1 -- 172.21.15.18:0/278076427 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f449000bbf0 con 0x7f4490004800 2024-09-19T09:20:21.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.356+0000 7f44ad3b8640 1 -- 172.21.15.18:0/278076427 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f449000bdf0 con 0x7f44a80b9460 2024-09-19T09:20:21.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.356+0000 7f44ae3ba640 1 --2- 172.21.15.18:0/278076427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44900039e0 0x7f4490003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.356+0000 7f44aebbb640 1 --2- 172.21.15.18:0/278076427 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44a80b9460 0x7f44900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.356+0000 7f44adbb9640 1 --2- 172.21.15.18:0/278076427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4490004800 0x7f4490004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.356+0000 7f44ae3ba640 1 -- 172.21.15.18:0/278076427 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44a80b9460 msgr2=0x7f44900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:21.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.356+0000 7f44ae3ba640 1 --2- 172.21.15.18:0/278076427 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44a80b9460 0x7f44900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.356+0000 7f44ae3ba640 1 -- 172.21.15.18:0/278076427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4490004800 msgr2=0x7f4490004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:21.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.356+0000 7f44ae3ba640 1 --2- 172.21.15.18:0/278076427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4490004800 0x7f4490004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.356+0000 7f44ae3ba640 1 -- 172.21.15.18:0/278076427 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4490003520 con 0x7f44900039e0 2024-09-19T09:20:21.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.356+0000 7f44adbb9640 1 --2- 172.21.15.18:0/278076427 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4490004800 0x7f4490004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:21.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.357+0000 7f44ae3ba640 1 --2- 172.21.15.18:0/278076427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44900039e0 0x7f4490003e00 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f4498001e20 tx=0x7f4490005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad5a57c8d70bfa1c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:21.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.357+0000 7f44ad3b8640 1 -- 172.21.15.18:0/278076427 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4498001a70 con 0x7f44900039e0 2024-09-19T09:20:21.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.357+0000 7f44ad3b8640 1 -- 172.21.15.18:0/278076427 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f449802ae10 con 0x7f44900039e0 2024-09-19T09:20:21.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.357+0000 7f44ad3b8640 1 -- 172.21.15.18:0/278076427 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4498003bb0 con 0x7f44900039e0 2024-09-19T09:20:21.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.358+0000 7f44b061e640 1 -- 172.21.15.18:0/278076427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44900039e0 msgr2=0x7f4490003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:21.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.358+0000 7f44b061e640 1 --2- 172.21.15.18:0/278076427 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44900039e0 0x7f4490003e00 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f4498001e20 tx=0x7f4490005830 comp rx=0 tx=0).stop 2024-09-19T09:20:21.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.358+0000 7f44aebbb640 1 -- 172.21.15.18:0/278076427 reap_dead start 2024-09-19T09:20:21.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.358+0000 7f44b061e640 1 -- 172.21.15.18:0/278076427 shutdown_connections 2024-09-19T09:20:21.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.358+0000 7f44b061e640 1 -- 172.21.15.18:0/278076427 >> 172.21.15.18:0/278076427 conn(0x7f44a80d4c60 msgr2=0x7f44a80d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:21.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.358+0000 7f44b061e640 1 -- 172.21.15.18:0/278076427 shutdown_connections 2024-09-19T09:20:21.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.358+0000 7f44b061e640 1 -- 172.21.15.18:0/278076427 wait complete. 2024-09-19T09:20:21.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.359+0000 7f44b061e640 1 Processor -- start 2024-09-19T09:20:21.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.359+0000 7f44b061e640 1 -- start start 2024-09-19T09:20:21.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.360+0000 7f44b061e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44900039e0 0x7f44a81606d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.360+0000 7f44b061e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44a815b2b0 0x7f44a815b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.360+0000 7f44b061e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44a80ce3e0 0x7f44a80ce840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.360+0000 7f44b061e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f44a80b7fc0 con 0x7f44a815b2b0 2024-09-19T09:20:21.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.360+0000 7f44b061e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f44a80d3c90 con 0x7f44a80ce3e0 2024-09-19T09:20:21.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.360+0000 7f44b061e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f44a80d0590 con 0x7f44900039e0 2024-09-19T09:20:21.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.360+0000 7f44adbb9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44a815b2b0 0x7f44a815b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.360+0000 7f44adbb9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44a815b2b0 0x7f44a815b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53304/0 (socket says 172.21.15.18:53304) 2024-09-19T09:20:21.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.360+0000 7f44adbb9640 1 -- 172.21.15.18:0/2996404231 learned_addr learned my addr 172.21.15.18:0/2996404231 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:21.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.360+0000 7f44aebbb640 1 --2- 172.21.15.18:0/2996404231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44a80ce3e0 0x7f44a80ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.360+0000 7f44ae3ba640 1 --2- 172.21.15.18:0/2996404231 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44900039e0 0x7f44a81606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.360+0000 7f44adbb9640 1 -- 172.21.15.18:0/2996404231 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44900039e0 msgr2=0x7f44a81606d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:21.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.360+0000 7f44adbb9640 1 --2- 172.21.15.18:0/2996404231 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44900039e0 0x7f44a81606d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.360+0000 7f44adbb9640 1 -- 172.21.15.18:0/2996404231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44a80ce3e0 msgr2=0x7f44a80ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:21.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.360+0000 7f44adbb9640 1 --2- 172.21.15.18:0/2996404231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44a80ce3e0 0x7f44a80ce840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.360+0000 7f44adbb9640 1 -- 172.21.15.18:0/2996404231 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a80ced80 con 0x7f44a815b2b0 2024-09-19T09:20:21.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.361+0000 7f44adbb9640 1 --2- 172.21.15.18:0/2996404231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44a815b2b0 0x7f44a815b710 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f449c000fb0 tx=0x7f449c00ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:21.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.361+0000 7f44a6ffd640 1 -- 172.21.15.18:0/2996404231 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449c00c8d0 con 0x7f44a815b2b0 2024-09-19T09:20:21.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.361+0000 7f44a6ffd640 1 -- 172.21.15.18:0/2996404231 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f449c018070 con 0x7f44a815b2b0 2024-09-19T09:20:21.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.361+0000 7f44b061e640 1 -- 172.21.15.18:0/2996404231 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44a8159e20 con 0x7f44a815b2b0 2024-09-19T09:20:21.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.361+0000 7f44a6ffd640 1 -- 172.21.15.18:0/2996404231 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449c00ccb0 con 0x7f44a815b2b0 2024-09-19T09:20:21.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.361+0000 7f44b061e640 1 -- 172.21.15.18:0/2996404231 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44a81f84b0 con 0x7f44a815b2b0 2024-09-19T09:20:21.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.362+0000 7f44b061e640 1 -- 172.21.15.18:0/2996404231 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44a80cf770 con 0x7f44a815b2b0 2024-09-19T09:20:21.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.363+0000 7f44a6ffd640 1 -- 172.21.15.18:0/2996404231 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f449c01d460 con 0x7f44a815b2b0 2024-09-19T09:20:21.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.363+0000 7f44a6ffd640 1 --2- 172.21.15.18:0/2996404231 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f449406c2b0 0x7f449406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.363+0000 7f44a6ffd640 1 -- 172.21.15.18:0/2996404231 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7f449c08afb0 con 0x7f44a815b2b0 2024-09-19T09:20:21.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.363+0000 7f44ae3ba640 1 --2- 172.21.15.18:0/2996404231 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f449406c2b0 0x7f449406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.364+0000 7f44ae3ba640 1 --2- 172.21.15.18:0/2996404231 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f449406c2b0 0x7f449406e770 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4498032000 tx=0x7f449802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:21.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.367+0000 7f44a6ffd640 1 -- 172.21.15.18:0/2996404231 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f44a80ced80 con 0x7f44a815b2b0 2024-09-19T09:20:21.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.544+0000 7f44b061e640 1 -- 172.21.15.18:0/2996404231 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f44a80c80e0 con 0x7f44a815b2b0 2024-09-19T09:20:21.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.548+0000 7f44a6ffd640 1 -- 172.21.15.18:0/2996404231 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) ==== 104+0+0 (secure 0 0 0) 0x7f449c059ab0 con 0x7f44a815b2b0 2024-09-19T09:20:21.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.550+0000 7f44b061e640 1 -- 172.21.15.18:0/2996404231 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f449406c2b0 msgr2=0x7f449406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:21.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.550+0000 7f44b061e640 1 --2- 172.21.15.18:0/2996404231 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f449406c2b0 0x7f449406e770 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f4498032000 tx=0x7f449802e000 comp rx=0 tx=0).stop 2024-09-19T09:20:21.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.550+0000 7f44b061e640 1 -- 172.21.15.18:0/2996404231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44a815b2b0 msgr2=0x7f44a815b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:21.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.550+0000 7f44b061e640 1 --2- 172.21.15.18:0/2996404231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44a815b2b0 0x7f44a815b710 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f449c000fb0 tx=0x7f449c00ec90 comp rx=0 tx=0).stop 2024-09-19T09:20:21.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.550+0000 7f44b061e640 1 -- 172.21.15.18:0/2996404231 shutdown_connections 2024-09-19T09:20:21.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.550+0000 7f44b061e640 1 --2- 172.21.15.18:0/2996404231 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f449406c2b0 0x7f449406e770 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.550+0000 7f44b061e640 1 --2- 172.21.15.18:0/2996404231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f44a80ce3e0 0x7f44a80ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.550+0000 7f44b061e640 1 --2- 172.21.15.18:0/2996404231 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f44a815b2b0 0x7f44a815b710 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.550+0000 7f44b061e640 1 --2- 172.21.15.18:0/2996404231 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f44900039e0 0x7f44a81606d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.550+0000 7f44b061e640 1 -- 172.21.15.18:0/2996404231 >> 172.21.15.18:0/2996404231 conn(0x7f44a80d4c60 msgr2=0x7f44a80cf980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:21.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.550+0000 7f44b061e640 1 -- 172.21.15.18:0/2996404231 shutdown_connections 2024-09-19T09:20:21.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.550+0000 7f44b061e640 1 -- 172.21.15.18:0/2996404231 wait complete. 2024-09-19T09:20:21.562 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2024-09-19T09:20:21.664 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.664+0000 7f67860dd640 1 Processor -- start 2024-09-19T09:20:21.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.664+0000 7f67860dd640 1 -- start start 2024-09-19T09:20:21.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.664+0000 7f67860dd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67800b5200 0x7f67801629e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.664+0000 7f67860dd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6780162f20 0x7f67800cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.665+0000 7f67860dd640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67800d0a10 con 0x7f678015ed30 2024-09-19T09:20:21.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.665+0000 7f67860dd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6780070ab0 con 0x7f6780162f20 2024-09-19T09:20:21.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.665+0000 7f67860dd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f67800d0cb0 con 0x7f67800b5200 2024-09-19T09:20:21.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.665+0000 7f677effd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67800b5200 0x7f67801629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.665+0000 7f677ffff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6780162f20 0x7f67800cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.665+0000 7f677f7fe640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f678015ed30 0x7f6780070260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:48898/0 (socket says 172.21.15.18:48898) 2024-09-19T09:20:21.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.665+0000 7f677f7fe640 1 -- 172.21.15.18:0/1373754233 learned_addr learned my addr 172.21.15.18:0/1373754233 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:20:21.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.665+0000 7f677ffff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6780162f20 0x7f67800cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:39384/0 (socket says 172.21.15.18:39384) 2024-09-19T09:20:21.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.665+0000 7f677effd640 1 -- 172.21.15.18:0/1373754233 >> v2:172.21.15.162:3300/0 conn(0x7f6780162f20 msgr2=0x7f67800cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:21.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.665+0000 7f677effd640 1 --2- 172.21.15.18:0/1373754233 >> v2:172.21.15.162:3300/0 conn(0x7f6780162f20 0x7f67800cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.665+0000 7f677effd640 1 -- 172.21.15.18:0/1373754233 >> v1:172.21.15.162:6789/0 conn(0x7f678015ed30 legacy=0x7f6780070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:21.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.665+0000 7f677e7fc640 1 -- 172.21.15.18:0/1373754233 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2081714319 0 0) 0x7f67800d0a10 con 0x7f678015ed30 2024-09-19T09:20:21.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.665+0000 7f677effd640 1 -- 172.21.15.18:0/1373754233 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67800d0f90 con 0x7f67800b5200 2024-09-19T09:20:21.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.665+0000 7f677ffff640 1 --2- 172.21.15.18:0/1373754233 >> v2:172.21.15.162:3300/0 conn(0x7f6780162f20 0x7f67800cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:21.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.666+0000 7f677effd640 1 --2- 172.21.15.18:0/1373754233 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67800b5200 0x7f67801629e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f67740097a0 tx=0x7f677402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a31f5107ad86f72e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:21.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.667+0000 7f677e7fc640 1 -- 172.21.15.18:0/1373754233 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6774037070 con 0x7f67800b5200 2024-09-19T09:20:21.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.667+0000 7f677e7fc640 1 -- 172.21.15.18:0/1373754233 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6774032440 con 0x7f67800b5200 2024-09-19T09:20:21.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.667+0000 7f677e7fc640 1 -- 172.21.15.18:0/1373754233 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6774032810 con 0x7f67800b5200 2024-09-19T09:20:21.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.667+0000 7f67860dd640 1 -- 172.21.15.18:0/1373754233 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67800b5200 msgr2=0x7f67801629e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:21.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.667+0000 7f67860dd640 1 --2- 172.21.15.18:0/1373754233 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67800b5200 0x7f67801629e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f67740097a0 tx=0x7f677402a210 comp rx=0 tx=0).stop 2024-09-19T09:20:21.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.667+0000 7f67860dd640 1 -- 172.21.15.18:0/1373754233 shutdown_connections 2024-09-19T09:20:21.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.667+0000 7f67860dd640 1 --2- 172.21.15.18:0/1373754233 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f67800b5200 0x7f67801629e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.667+0000 7f67860dd640 1 --2- 172.21.15.18:0/1373754233 >> v2:172.21.15.162:3300/0 conn(0x7f6780162f20 0x7f67800cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.667+0000 7f67860dd640 1 -- 172.21.15.18:0/1373754233 >> 172.21.15.18:0/1373754233 conn(0x7f67800b4600 msgr2=0x7f67800b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:21.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.667+0000 7f67860dd640 1 -- 172.21.15.18:0/1373754233 shutdown_connections 2024-09-19T09:20:21.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.667+0000 7f67860dd640 1 -- 172.21.15.18:0/1373754233 wait complete. 2024-09-19T09:20:21.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.668+0000 7f67860dd640 1 Processor -- start 2024-09-19T09:20:21.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.668+0000 7f67860dd640 1 -- start start 2024-09-19T09:20:21.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.669+0000 7f67860dd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67800b5200 0x7f67800b8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.669+0000 7f67860dd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f678015ed30 0x7f67800cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.669+0000 7f67860dd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6780162f20 0x7f67800c85d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.669+0000 7f67860dd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f678015f290 con 0x7f67800b5200 2024-09-19T09:20:21.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.669+0000 7f67860dd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f678015f110 con 0x7f6780162f20 2024-09-19T09:20:21.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.669+0000 7f67860dd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f67800cf720 con 0x7f678015ed30 2024-09-19T09:20:21.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.669+0000 7f677f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67800b5200 0x7f67800b8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.669+0000 7f677f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67800b5200 0x7f67800b8020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53314/0 (socket says 172.21.15.18:53314) 2024-09-19T09:20:21.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.669+0000 7f677f7fe640 1 -- 172.21.15.18:0/615688986 learned_addr learned my addr 172.21.15.18:0/615688986 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:21.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.670+0000 7f677effd640 1 --2- 172.21.15.18:0/615688986 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f678015ed30 0x7f67800cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.670+0000 7f677f7fe640 1 -- 172.21.15.18:0/615688986 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f678015ed30 msgr2=0x7f67800cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:21.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.670+0000 7f677ffff640 1 --2- 172.21.15.18:0/615688986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6780162f20 0x7f67800c85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.670+0000 7f677f7fe640 1 --2- 172.21.15.18:0/615688986 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f678015ed30 0x7f67800cbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.670+0000 7f677f7fe640 1 -- 172.21.15.18:0/615688986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6780162f20 msgr2=0x7f67800c85d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:21.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.670+0000 7f677f7fe640 1 --2- 172.21.15.18:0/615688986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6780162f20 0x7f67800c85d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:21.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.670+0000 7f677f7fe640 1 -- 172.21.15.18:0/615688986 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67800b6f80 con 0x7f67800b5200 2024-09-19T09:20:21.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.670+0000 7f677f7fe640 1 --2- 172.21.15.18:0/615688986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67800b5200 0x7f67800b8020 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f677000c500 tx=0x7f677000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:21.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.670+0000 7f6767fff640 1 -- 172.21.15.18:0/615688986 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6770018070 con 0x7f67800b5200 2024-09-19T09:20:21.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.670+0000 7f6767fff640 1 -- 172.21.15.18:0/615688986 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6770007580 con 0x7f67800b5200 2024-09-19T09:20:21.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.670+0000 7f67860dd640 1 -- 172.21.15.18:0/615688986 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67800b7260 con 0x7f67800b5200 2024-09-19T09:20:21.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.670+0000 7f6767fff640 1 -- 172.21.15.18:0/615688986 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6770004a20 con 0x7f67800b5200 2024-09-19T09:20:21.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.670+0000 7f67860dd640 1 -- 172.21.15.18:0/615688986 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67800b7820 con 0x7f67800b5200 2024-09-19T09:20:21.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.671+0000 7f67860dd640 1 -- 172.21.15.18:0/615688986 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67800cf1e0 con 0x7f67800b5200 2024-09-19T09:20:21.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.672+0000 7f6767fff640 1 -- 172.21.15.18:0/615688986 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f677001b070 con 0x7f67800b5200 2024-09-19T09:20:21.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.672+0000 7f6767fff640 1 --2- 172.21.15.18:0/615688986 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f676c06c2b0 0x7f676c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:21.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.672+0000 7f6767fff640 1 -- 172.21.15.18:0/615688986 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7f677008a410 con 0x7f67800b5200 2024-09-19T09:20:21.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.672+0000 7f677effd640 1 --2- 172.21.15.18:0/615688986 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f676c06c2b0 0x7f676c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:21.674 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.673+0000 7f677effd640 1 --2- 172.21.15.18:0/615688986 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f676c06c2b0 0x7f676c06e770 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6774034000 tx=0x7f677402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:21.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.676+0000 7f6767fff640 1 -- 172.21.15.18:0/615688986 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6770058f10 con 0x7f67800b5200 2024-09-19T09:20:21.926 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:21.926+0000 7f67860dd640 1 -- 172.21.15.18:0/615688986 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) -- 0x7f67800ce510 con 0x7f67800b5200 2024-09-19T09:20:22.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.258+0000 7f6767fff640 1 -- 172.21.15.18:0/615688986 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v356) ==== 140+0+0 (secure 0 0 0) 0x7f6770058810 con 0x7f67800b5200 2024-09-19T09:20:22.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.261+0000 7f67860dd640 1 -- 172.21.15.18:0/615688986 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f676c06c2b0 msgr2=0x7f676c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:22.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.261+0000 7f67860dd640 1 --2- 172.21.15.18:0/615688986 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f676c06c2b0 0x7f676c06e770 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6774034000 tx=0x7f677402e000 comp rx=0 tx=0).stop 2024-09-19T09:20:22.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.261+0000 7f67860dd640 1 -- 172.21.15.18:0/615688986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67800b5200 msgr2=0x7f67800b8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:22.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.261+0000 7f67860dd640 1 --2- 172.21.15.18:0/615688986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67800b5200 0x7f67800b8020 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f677000c500 tx=0x7f677000c9c0 comp rx=0 tx=0).stop 2024-09-19T09:20:22.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.261+0000 7f67860dd640 1 -- 172.21.15.18:0/615688986 shutdown_connections 2024-09-19T09:20:22.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.261+0000 7f67860dd640 1 --2- 172.21.15.18:0/615688986 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f676c06c2b0 0x7f676c06e770 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:22.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.261+0000 7f67860dd640 1 --2- 172.21.15.18:0/615688986 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6780162f20 0x7f67800c85d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:22.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.261+0000 7f67860dd640 1 --2- 172.21.15.18:0/615688986 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f678015ed30 0x7f67800cbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:22.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.261+0000 7f67860dd640 1 --2- 172.21.15.18:0/615688986 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f67800b5200 0x7f67800b8020 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:22.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.261+0000 7f67860dd640 1 -- 172.21.15.18:0/615688986 >> 172.21.15.18:0/615688986 conn(0x7f67800b4600 msgr2=0x7f67800b18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:22.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.261+0000 7f67860dd640 1 -- 172.21.15.18:0/615688986 shutdown_connections 2024-09-19T09:20:22.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.261+0000 7f67860dd640 1 -- 172.21.15.18:0/615688986 wait complete. 2024-09-19T09:20:22.274 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2024-09-19T09:20:22.274 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) 2024-09-19T09:20:22.275 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:20:22.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.378+0000 7feba2581640 1 Processor -- start 2024-09-19T09:20:22.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.378+0000 7feba2581640 1 -- start start 2024-09-19T09:20:22.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.379+0000 7feba2581640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7feb9c0d57a0 0x7feb9c0d1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:22.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.379+0000 7feba2581640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb9c0d1990 0x7feb9c0b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:22.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.379+0000 7feba2581640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb9c0d3880 con 0x7feb9c15ecc0 2024-09-19T09:20:22.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.379+0000 7feba2581640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7feb9c0d3b20 con 0x7feb9c0d57a0 2024-09-19T09:20:22.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.379+0000 7feba2581640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7feb9c0b42f0 con 0x7feb9c0d1990 2024-09-19T09:20:22.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.379+0000 7feb9bfff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7feb9c15ecc0 0x7feb9c0d3170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:34998/0 (socket says 172.21.15.18:34998) 2024-09-19T09:20:22.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.379+0000 7feb9bfff640 1 -- 172.21.15.18:0/2902601852 learned_addr learned my addr 172.21.15.18:0/2902601852 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:20:22.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.380+0000 7feb9b7fe640 1 --2- 172.21.15.18:0/2902601852 >> v2:172.21.15.162:3300/0 conn(0x7feb9c0d57a0 0x7feb9c0d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:22.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.380+0000 7feba0b1e640 1 --2- 172.21.15.18:0/2902601852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb9c0d1990 0x7feb9c0b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:22.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.380+0000 7feb9affd640 1 -- 172.21.15.18:0/2902601852 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2549769313 0 0) 0x7feb9c0d3880 con 0x7feb9c15ecc0 2024-09-19T09:20:22.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.380+0000 7feb9affd640 1 -- 172.21.15.18:0/2902601852 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb84003520 con 0x7feb9c15ecc0 2024-09-19T09:20:22.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.380+0000 7feb9affd640 1 -- 172.21.15.18:0/2902601852 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 443072592 0 0) 0x7feb84003520 con 0x7feb9c15ecc0 2024-09-19T09:20:22.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.380+0000 7feb9affd640 1 -- 172.21.15.18:0/2902601852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb9c0d1990 msgr2=0x7feb9c0b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:22.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.380+0000 7feb9affd640 1 --2- 172.21.15.18:0/2902601852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb9c0d1990 0x7feb9c0b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:22.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.380+0000 7feb9affd640 1 -- 172.21.15.18:0/2902601852 >> v2:172.21.15.162:3300/0 conn(0x7feb9c0d57a0 msgr2=0x7feb9c0d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:22.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.380+0000 7feb9affd640 1 --2- 172.21.15.18:0/2902601852 >> v2:172.21.15.162:3300/0 conn(0x7feb9c0d57a0 0x7feb9c0d1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:22.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.380+0000 7feb9affd640 1 -- 172.21.15.18:0/2902601852 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb9c0b45d0 con 0x7feb9c15ecc0 2024-09-19T09:20:22.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.380+0000 7feb9affd640 1 -- 172.21.15.18:0/2902601852 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7feb8c001670 con 0x7feb9c15ecc0 2024-09-19T09:20:22.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.380+0000 7feb9affd640 1 -- 172.21.15.18:0/2902601852 >> v1:172.21.15.18:6789/0 conn(0x7feb9c15ecc0 legacy=0x7feb9c0d3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:22.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.380+0000 7feb9affd640 1 --2- 172.21.15.18:0/2902601852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb840039b0 0x7feb84003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:22.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.380+0000 7feb9affd640 1 --2- 172.21.15.18:0/2902601852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb84004800 0x7feb84004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:22.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.380+0000 7feb9affd640 1 --2- 172.21.15.18:0/2902601852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb9c0d1990 0x7feb840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:22.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.380+0000 7feb9affd640 1 -- 172.21.15.18:0/2902601852 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feb9c0d3b20 con 0x7feb84004800 2024-09-19T09:20:22.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.380+0000 7feb9affd640 1 -- 172.21.15.18:0/2902601852 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feb9c0b42f0 con 0x7feb840039b0 2024-09-19T09:20:22.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.380+0000 7feb9affd640 1 -- 172.21.15.18:0/2902601852 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7feb8400b9c0 con 0x7feb9c0d1990 2024-09-19T09:20:22.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.380+0000 7feb9b7fe640 1 --2- 172.21.15.18:0/2902601852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb84004800 0x7feb84004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:22.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.380+0000 7feb9bfff640 1 --2- 172.21.15.18:0/2902601852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb840039b0 0x7feb84003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:22.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.380+0000 7feba0b1e640 1 --2- 172.21.15.18:0/2902601852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb9c0d1990 0x7feb840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:22.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.380+0000 7feb9b7fe640 1 -- 172.21.15.18:0/2902601852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb9c0d1990 msgr2=0x7feb840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:22.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.380+0000 7feb9b7fe640 1 --2- 172.21.15.18:0/2902601852 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb9c0d1990 0x7feb840051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:22.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.380+0000 7feb9b7fe640 1 -- 172.21.15.18:0/2902601852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb840039b0 msgr2=0x7feb84003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:22.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.380+0000 7feb9b7fe640 1 --2- 172.21.15.18:0/2902601852 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb840039b0 0x7feb84003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:22.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.380+0000 7feb9b7fe640 1 -- 172.21.15.18:0/2902601852 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb84003520 con 0x7feb84004800 2024-09-19T09:20:22.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.381+0000 7feb9b7fe640 1 --2- 172.21.15.18:0/2902601852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb84004800 0x7feb84004c80 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7feb90009ac0 tx=0x7feb84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b655fae2b43ffa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:22.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.381+0000 7feb9affd640 1 -- 172.21.15.18:0/2902601852 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb90036070 con 0x7feb84004800 2024-09-19T09:20:22.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.381+0000 7feb9affd640 1 -- 172.21.15.18:0/2902601852 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb90031400 con 0x7feb84004800 2024-09-19T09:20:22.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.381+0000 7feb9affd640 1 -- 172.21.15.18:0/2902601852 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb90009690 con 0x7feb84004800 2024-09-19T09:20:22.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.382+0000 7feba2581640 1 -- 172.21.15.18:0/2902601852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb84004800 msgr2=0x7feb84004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:22.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.382+0000 7feba2581640 1 --2- 172.21.15.18:0/2902601852 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb84004800 0x7feb84004c80 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7feb90009ac0 tx=0x7feb84005830 comp rx=0 tx=0).stop 2024-09-19T09:20:22.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.382+0000 7feba0b1e640 1 -- 172.21.15.18:0/2902601852 reap_dead start 2024-09-19T09:20:22.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.382+0000 7feba2581640 1 -- 172.21.15.18:0/2902601852 shutdown_connections 2024-09-19T09:20:22.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.382+0000 7feba2581640 1 -- 172.21.15.18:0/2902601852 >> 172.21.15.18:0/2902601852 conn(0x7feb9c0d4bd0 msgr2=0x7feb9c0d4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:22.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.382+0000 7feba2581640 1 -- 172.21.15.18:0/2902601852 shutdown_connections 2024-09-19T09:20:22.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.382+0000 7feba2581640 1 -- 172.21.15.18:0/2902601852 wait complete. 2024-09-19T09:20:22.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.383+0000 7feba2581640 1 Processor -- start 2024-09-19T09:20:22.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.383+0000 7feba2581640 1 -- start start 2024-09-19T09:20:22.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.384+0000 7feba2581640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb84004800 0x7feb9c0ba430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:22.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.384+0000 7feba2581640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb9c0c9360 0x7feb9c0cd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:22.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.384+0000 7feba2581640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb9c0c97e0 0x7feb9c0cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:22.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.384+0000 7feba2581640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7feb9c15f0a0 con 0x7feb9c0c9360 2024-09-19T09:20:22.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.384+0000 7feba2581640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feb9c0b4b90 con 0x7feb9c0c97e0 2024-09-19T09:20:22.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.384+0000 7feba2581640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7feb9c15f220 con 0x7feb84004800 2024-09-19T09:20:22.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.384+0000 7feb9b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb9c0c9360 0x7feb9c0cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:22.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.384+0000 7feb9b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb9c0c9360 0x7feb9c0cd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53332/0 (socket says 172.21.15.18:53332) 2024-09-19T09:20:22.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.384+0000 7feb9b7fe640 1 -- 172.21.15.18:0/3209790113 learned_addr learned my addr 172.21.15.18:0/3209790113 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:22.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.384+0000 7feb9b7fe640 1 -- 172.21.15.18:0/3209790113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb84004800 msgr2=0x7feb9c0ba430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:22.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.384+0000 7feb9b7fe640 1 --2- 172.21.15.18:0/3209790113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb84004800 0x7feb9c0ba430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:22.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.384+0000 7feb9b7fe640 1 -- 172.21.15.18:0/3209790113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb9c0c97e0 msgr2=0x7feb9c0cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:22.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.384+0000 7feba0b1e640 1 --2- 172.21.15.18:0/3209790113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb9c0c97e0 0x7feb9c0cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:22.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.385+0000 7feb9b7fe640 1 --2- 172.21.15.18:0/3209790113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb9c0c97e0 0x7feb9c0cdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:22.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.385+0000 7feb9b7fe640 1 -- 172.21.15.18:0/3209790113 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb9c1e68c0 con 0x7feb9c0c9360 2024-09-19T09:20:22.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.385+0000 7feb9b7fe640 1 --2- 172.21.15.18:0/3209790113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb9c0c9360 0x7feb9c0cd840 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7feb90034040 tx=0x7feb90004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:22.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.385+0000 7feb98ff9640 1 -- 172.21.15.18:0/3209790113 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb90040020 con 0x7feb9c0c9360 2024-09-19T09:20:22.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.385+0000 7feb98ff9640 1 -- 172.21.15.18:0/3209790113 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb90003950 con 0x7feb9c0c9360 2024-09-19T09:20:22.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.385+0000 7feba2581640 1 -- 172.21.15.18:0/3209790113 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb9c1e5820 con 0x7feb9c0c9360 2024-09-19T09:20:22.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.385+0000 7feb98ff9640 1 -- 172.21.15.18:0/3209790113 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb90036040 con 0x7feb9c0c9360 2024-09-19T09:20:22.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.385+0000 7feba2581640 1 -- 172.21.15.18:0/3209790113 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb9c1e5de0 con 0x7feb9c0c9360 2024-09-19T09:20:22.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.386+0000 7feba2581640 1 -- 172.21.15.18:0/3209790113 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb9c0d1450 con 0x7feb9c0c9360 2024-09-19T09:20:22.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.386+0000 7feb98ff9640 1 -- 172.21.15.18:0/3209790113 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7feb90043020 con 0x7feb9c0c9360 2024-09-19T09:20:22.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.387+0000 7feb98ff9640 1 --2- 172.21.15.18:0/3209790113 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7feb8806c2e0 0x7feb8806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:22.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.387+0000 7feb98ff9640 1 -- 172.21.15.18:0/3209790113 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7feb900ab5a0 con 0x7feb9c0c9360 2024-09-19T09:20:22.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.387+0000 7feb9bfff640 1 --2- 172.21.15.18:0/3209790113 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7feb8806c2e0 0x7feb8806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:22.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.388+0000 7feb9bfff640 1 --2- 172.21.15.18:0/3209790113 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7feb8806c2e0 0x7feb8806e7a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7feb8c001510 tx=0x7feb8c007c10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:22.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.391+0000 7feb98ff9640 1 -- 172.21.15.18:0/3209790113 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7feb9004a030 con 0x7feb9c0c9360 2024-09-19T09:20:22.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.568+0000 7feba2581640 1 -- 172.21.15.18:0/3209790113 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb9c08e3c0 con 0x7feb9c0c9360 2024-09-19T09:20:22.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.569+0000 7feb98ff9640 1 -- 172.21.15.18:0/3209790113 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) ==== 74+0+13055 (secure 0 0 0) 0x7feb9007a010 con 0x7feb9c0c9360 2024-09-19T09:20:22.570 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:20:22.570 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":145,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:20:21.228930+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":142,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":136,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6835/2894746570":"2024-09-20T09:20:18.010439+0000","172.21.15.18:6833/2894746570":"2024-09-20T09:20:18.010439+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:20:22.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.572+0000 7feba2581640 1 -- 172.21.15.18:0/3209790113 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7feb8806c2e0 msgr2=0x7feb8806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:22.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.572+0000 7feba2581640 1 --2- 172.21.15.18:0/3209790113 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7feb8806c2e0 0x7feb8806e7a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7feb8c001510 tx=0x7feb8c007c10 comp rx=0 tx=0).stop 2024-09-19T09:20:22.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.572+0000 7feba2581640 1 -- 172.21.15.18:0/3209790113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb9c0c9360 msgr2=0x7feb9c0cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:22.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.572+0000 7feba2581640 1 --2- 172.21.15.18:0/3209790113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb9c0c9360 0x7feb9c0cd840 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7feb90034040 tx=0x7feb90004730 comp rx=0 tx=0).stop 2024-09-19T09:20:22.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.572+0000 7feba2581640 1 -- 172.21.15.18:0/3209790113 shutdown_connections 2024-09-19T09:20:22.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.572+0000 7feba2581640 1 --2- 172.21.15.18:0/3209790113 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7feb8806c2e0 0x7feb8806e7a0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:22.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.572+0000 7feba2581640 1 --2- 172.21.15.18:0/3209790113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb9c0c97e0 0x7feb9c0cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:22.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.572+0000 7feba2581640 1 --2- 172.21.15.18:0/3209790113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7feb9c0c9360 0x7feb9c0cd840 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:22.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.572+0000 7feba2581640 1 --2- 172.21.15.18:0/3209790113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7feb84004800 0x7feb9c0ba430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:22.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.572+0000 7feba2581640 1 -- 172.21.15.18:0/3209790113 >> 172.21.15.18:0/3209790113 conn(0x7feb9c0d4bd0 msgr2=0x7feb9c06ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:22.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.572+0000 7feba2581640 1 -- 172.21.15.18:0/3209790113 shutdown_connections 2024-09-19T09:20:22.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.572+0000 7feba2581640 1 -- 172.21.15.18:0/3209790113 wait complete. 2024-09-19T09:20:22.584 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T09:13:17.564717+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T09:20:22.584 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T09:20:22.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.688+0000 7fa1fa5a8640 1 Processor -- start 2024-09-19T09:20:22.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.688+0000 7fa1fa5a8640 1 -- start start 2024-09-19T09:20:22.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.689+0000 7fa1fa5a8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa1f40d14e0 0x7fa1f40d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:22.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.689+0000 7fa1fa5a8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa1f40b47e0 0x7fa1f40b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:22.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.689+0000 7fa1fa5a8640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1f40d3270 con 0x7fa1f415ede0 2024-09-19T09:20:22.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.689+0000 7fa1fa5a8640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fa1f40d1e60 con 0x7fa1f40d14e0 2024-09-19T09:20:22.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.689+0000 7fa1fa5a8640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa1f40d34e0 con 0x7fa1f40b47e0 2024-09-19T09:20:22.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.689+0000 7fa1f37fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa1f40d14e0 0x7fa1f40d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:22.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.689+0000 7fa1f37fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa1f40d14e0 0x7fa1f40d1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53340/0 (socket says 172.21.15.18:53340) 2024-09-19T09:20:22.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.689+0000 7fa1f37fe640 1 -- 172.21.15.18:0/1656669612 learned_addr learned my addr 172.21.15.18:0/1656669612 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:22.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.689+0000 7fa1f8b45640 1 --2- 172.21.15.18:0/1656669612 >> v2:172.21.15.162:3300/0 conn(0x7fa1f40b47e0 0x7fa1f40b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:22.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.689+0000 7fa1f37fe640 1 -- 172.21.15.18:0/1656669612 >> v2:172.21.15.162:3300/0 conn(0x7fa1f40b47e0 msgr2=0x7fa1f40b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:22.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.689+0000 7fa1f37fe640 1 --2- 172.21.15.18:0/1656669612 >> v2:172.21.15.162:3300/0 conn(0x7fa1f40b47e0 0x7fa1f40b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:22.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.689+0000 7fa1f37fe640 1 -- 172.21.15.18:0/1656669612 >> v1:172.21.15.162:6789/0 conn(0x7fa1f415ede0 legacy=0x7fa1f40d5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:22.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.690+0000 7fa1f37fe640 1 -- 172.21.15.18:0/1656669612 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f40d37c0 con 0x7fa1f40d14e0 2024-09-19T09:20:22.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.690+0000 7fa1f37fe640 1 --2- 172.21.15.18:0/1656669612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1f40d14e0 0x7fa1f40d1920 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fa1f40cf1d0 tx=0x7fa1e802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=724caa28453da6b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:22.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.690+0000 7fa1f2ffd640 1 -- 172.21.15.18:0/1656669612 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8037070 con 0x7fa1f40d14e0 2024-09-19T09:20:22.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.690+0000 7fa1f2ffd640 1 -- 172.21.15.18:0/1656669612 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e802ae50 con 0x7fa1f40d14e0 2024-09-19T09:20:22.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.690+0000 7fa1f2ffd640 1 -- 172.21.15.18:0/1656669612 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e8032860 con 0x7fa1f40d14e0 2024-09-19T09:20:22.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.691+0000 7fa1fa5a8640 1 -- 172.21.15.18:0/1656669612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1f40d14e0 msgr2=0x7fa1f40d1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:22.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.691+0000 7fa1fa5a8640 1 --2- 172.21.15.18:0/1656669612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1f40d14e0 0x7fa1f40d1920 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fa1f40cf1d0 tx=0x7fa1e802a300 comp rx=0 tx=0).stop 2024-09-19T09:20:22.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.691+0000 7fa1fa5a8640 1 -- 172.21.15.18:0/1656669612 shutdown_connections 2024-09-19T09:20:22.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.691+0000 7fa1fa5a8640 1 --2- 172.21.15.18:0/1656669612 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1f40d14e0 0x7fa1f40d1920 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:22.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.691+0000 7fa1fa5a8640 1 --2- 172.21.15.18:0/1656669612 >> v2:172.21.15.162:3300/0 conn(0x7fa1f40b47e0 0x7fa1f40b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:22.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.691+0000 7fa1fa5a8640 1 -- 172.21.15.18:0/1656669612 >> 172.21.15.18:0/1656669612 conn(0x7fa1f409df30 msgr2=0x7fa1f40d4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:22.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.691+0000 7fa1fa5a8640 1 -- 172.21.15.18:0/1656669612 shutdown_connections 2024-09-19T09:20:22.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.691+0000 7fa1fa5a8640 1 -- 172.21.15.18:0/1656669612 wait complete. 2024-09-19T09:20:22.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.692+0000 7fa1fa5a8640 1 Processor -- start 2024-09-19T09:20:22.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.692+0000 7fa1fa5a8640 1 -- start start 2024-09-19T09:20:22.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.693+0000 7fa1fa5a8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1f40b47e0 0x7fa1f4156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:22.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.693+0000 7fa1fa5a8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1f40d14e0 0x7fa1f415d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:22.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.693+0000 7fa1fa5a8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1f415ede0 0x7fa1f415d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:22.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.693+0000 7fa1fa5a8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f40d5a10 con 0x7fa1f415ede0 2024-09-19T09:20:22.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.693+0000 7fa1fa5a8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f415f1c0 con 0x7fa1f40b47e0 2024-09-19T09:20:22.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.693+0000 7fa1fa5a8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa1f40b4020 con 0x7fa1f40d14e0 2024-09-19T09:20:22.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.693+0000 7fa1f8b45640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1f415ede0 0x7fa1f415d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:22.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.693+0000 7fa1f8b45640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1f415ede0 0x7fa1f415d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53356/0 (socket says 172.21.15.18:53356) 2024-09-19T09:20:22.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.693+0000 7fa1f8b45640 1 -- 172.21.15.18:0/3461530736 learned_addr learned my addr 172.21.15.18:0/3461530736 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:22.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.693+0000 7fa1f37fe640 1 --2- 172.21.15.18:0/3461530736 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1f40d14e0 0x7fa1f415d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:22.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.693+0000 7fa1f3fff640 1 --2- 172.21.15.18:0/3461530736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1f40b47e0 0x7fa1f4156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:22.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.693+0000 7fa1f8b45640 1 -- 172.21.15.18:0/3461530736 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1f40d14e0 msgr2=0x7fa1f415d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:22.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.693+0000 7fa1f8b45640 1 --2- 172.21.15.18:0/3461530736 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1f40d14e0 0x7fa1f415d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:22.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.694+0000 7fa1f8b45640 1 -- 172.21.15.18:0/3461530736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1f40b47e0 msgr2=0x7fa1f4156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:22.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.694+0000 7fa1f8b45640 1 --2- 172.21.15.18:0/3461530736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1f40b47e0 0x7fa1f4156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:22.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.694+0000 7fa1f8b45640 1 -- 172.21.15.18:0/3461530736 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f415f4e0 con 0x7fa1f415ede0 2024-09-19T09:20:22.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.694+0000 7fa1f3fff640 1 --2- 172.21.15.18:0/3461530736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1f40b47e0 0x7fa1f4156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:22.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.694+0000 7fa1f37fe640 1 --2- 172.21.15.18:0/3461530736 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1f40d14e0 0x7fa1f415d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:22.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.694+0000 7fa1f8b45640 1 --2- 172.21.15.18:0/3461530736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1f415ede0 0x7fa1f415d990 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec007e60 tx=0x7fa1ec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:22.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.694+0000 7fa1f0ff9640 1 -- 172.21.15.18:0/3461530736 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec014420 con 0x7fa1f415ede0 2024-09-19T09:20:22.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.694+0000 7fa1f0ff9640 1 -- 172.21.15.18:0/3461530736 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1ec019070 con 0x7fa1f415ede0 2024-09-19T09:20:22.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.694+0000 7fa1fa5a8640 1 -- 172.21.15.18:0/3461530736 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1f4161420 con 0x7fa1f415ede0 2024-09-19T09:20:22.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.694+0000 7fa1f0ff9640 1 -- 172.21.15.18:0/3461530736 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec014820 con 0x7fa1f415ede0 2024-09-19T09:20:22.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.694+0000 7fa1fa5a8640 1 -- 172.21.15.18:0/3461530736 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1f415f780 con 0x7fa1f415ede0 2024-09-19T09:20:22.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.695+0000 7fa1fa5a8640 1 -- 172.21.15.18:0/3461530736 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1f40cba00 con 0x7fa1f415ede0 2024-09-19T09:20:22.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.695+0000 7fa1f0ff9640 1 -- 172.21.15.18:0/3461530736 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa1ec0149c0 con 0x7fa1f415ede0 2024-09-19T09:20:22.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.696+0000 7fa1f0ff9640 1 --2- 172.21.15.18:0/3461530736 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa1e006c2b0 0x7fa1e006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:22.697 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.696+0000 7fa1f0ff9640 1 -- 172.21.15.18:0/3461530736 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7fa1ec08b940 con 0x7fa1f415ede0 2024-09-19T09:20:22.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.696+0000 7fa1f3fff640 1 --2- 172.21.15.18:0/3461530736 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa1e006c2b0 0x7fa1e006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:22.698 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.697+0000 7fa1f3fff640 1 --2- 172.21.15.18:0/3461530736 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa1e006c2b0 0x7fa1e006e770 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4001700 tx=0x7fa1e4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:22.701 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.700+0000 7fa1f0ff9640 1 -- 172.21.15.18:0/3461530736 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa1ec05a3b0 con 0x7fa1f415ede0 2024-09-19T09:20:22.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.877+0000 7fa1fa5a8640 1 -- 172.21.15.18:0/3461530736 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa1f40d0700 con 0x7fa1f415ede0 2024-09-19T09:20:22.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.878+0000 7fa1f0ff9640 1 -- 172.21.15.18:0/3461530736 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v145) ==== 93+0+10 (secure 0 0 0) 0x7fa1ec059cb0 con 0x7fa1f415ede0 2024-09-19T09:20:22.879 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-09-19T09:20:22.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.880+0000 7fa1fa5a8640 1 -- 172.21.15.18:0/3461530736 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa1e006c2b0 msgr2=0x7fa1e006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:22.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.880+0000 7fa1fa5a8640 1 --2- 172.21.15.18:0/3461530736 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa1e006c2b0 0x7fa1e006e770 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4001700 tx=0x7fa1e4009040 comp rx=0 tx=0).stop 2024-09-19T09:20:22.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.880+0000 7fa1fa5a8640 1 -- 172.21.15.18:0/3461530736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1f415ede0 msgr2=0x7fa1f415d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:22.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.880+0000 7fa1fa5a8640 1 --2- 172.21.15.18:0/3461530736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1f415ede0 0x7fa1f415d990 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec007e60 tx=0x7fa1ec00e4b0 comp rx=0 tx=0).stop 2024-09-19T09:20:22.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.880+0000 7fa1fa5a8640 1 -- 172.21.15.18:0/3461530736 shutdown_connections 2024-09-19T09:20:22.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.880+0000 7fa1fa5a8640 1 --2- 172.21.15.18:0/3461530736 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa1e006c2b0 0x7fa1e006e770 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:22.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.880+0000 7fa1fa5a8640 1 --2- 172.21.15.18:0/3461530736 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa1f415ede0 0x7fa1f415d990 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:22.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.880+0000 7fa1fa5a8640 1 --2- 172.21.15.18:0/3461530736 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa1f40d14e0 0x7fa1f415d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:22.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.880+0000 7fa1fa5a8640 1 --2- 172.21.15.18:0/3461530736 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa1f40b47e0 0x7fa1f4156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:22.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.880+0000 7fa1fa5a8640 1 -- 172.21.15.18:0/3461530736 >> 172.21.15.18:0/3461530736 conn(0x7fa1f409df30 msgr2=0x7fa1f406d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:22.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.880+0000 7fa1fa5a8640 1 -- 172.21.15.18:0/3461530736 shutdown_connections 2024-09-19T09:20:22.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.880+0000 7fa1fa5a8640 1 -- 172.21.15.18:0/3461530736 wait complete. 2024-09-19T09:20:22.892 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2024-09-19T09:20:22.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.994+0000 7fd16274b640 1 Processor -- start 2024-09-19T09:20:22.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.994+0000 7fd16274b640 1 -- start start 2024-09-19T09:20:22.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.994+0000 7fd16274b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd15c15ed30 0x7fd15c070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:22.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.994+0000 7fd16274b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd15c0b5200 0x7fd15c1629e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:22.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.994+0000 7fd16274b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd15c0d0a10 con 0x7fd15c162f20 2024-09-19T09:20:22.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.994+0000 7fd16274b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd15c070ab0 con 0x7fd15c15ed30 2024-09-19T09:20:22.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.994+0000 7fd16274b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd15c0d0cb0 con 0x7fd15c0b5200 2024-09-19T09:20:22.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.995+0000 7fd15bfff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd15c15ed30 0x7fd15c070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:22.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.995+0000 7fd15b7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd15c0b5200 0x7fd15c1629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:22.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.995+0000 7fd160ce8640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fd15c162f20 0x7fd15c0cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:48918/0 (socket says 172.21.15.18:48918) 2024-09-19T09:20:22.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.995+0000 7fd160ce8640 1 -- 172.21.15.18:0/2412730583 learned_addr learned my addr 172.21.15.18:0/2412730583 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:20:22.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.995+0000 7fd15bfff640 1 -- 172.21.15.18:0/2412730583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd15c0b5200 msgr2=0x7fd15c1629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:22.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.995+0000 7fd15bfff640 1 --2- 172.21.15.18:0/2412730583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd15c0b5200 0x7fd15c1629e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:22.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.995+0000 7fd15bfff640 1 -- 172.21.15.18:0/2412730583 >> v1:172.21.15.162:6789/0 conn(0x7fd15c162f20 legacy=0x7fd15c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:22.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.995+0000 7fd15bfff640 1 -- 172.21.15.18:0/2412730583 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd15c0d0f90 con 0x7fd15c15ed30 2024-09-19T09:20:22.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.995+0000 7fd15affd640 1 -- 172.21.15.18:0/2412730583 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 779155521 0 0) 0x7fd15c0d0a10 con 0x7fd15c162f20 2024-09-19T09:20:22.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.996+0000 7fd15bfff640 1 --2- 172.21.15.18:0/2412730583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd15c15ed30 0x7fd15c070260 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd14c0097a0 tx=0x7fd14c02a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1a1717d15c11c3d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:22.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.996+0000 7fd15affd640 1 -- 172.21.15.18:0/2412730583 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14c037070 con 0x7fd15c15ed30 2024-09-19T09:20:22.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.996+0000 7fd15affd640 1 -- 172.21.15.18:0/2412730583 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd14c032440 con 0x7fd15c15ed30 2024-09-19T09:20:22.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.996+0000 7fd15affd640 1 -- 172.21.15.18:0/2412730583 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14c032810 con 0x7fd15c15ed30 2024-09-19T09:20:22.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.997+0000 7fd16274b640 1 -- 172.21.15.18:0/2412730583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd15c15ed30 msgr2=0x7fd15c070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:22.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.997+0000 7fd16274b640 1 --2- 172.21.15.18:0/2412730583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd15c15ed30 0x7fd15c070260 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd14c0097a0 tx=0x7fd14c02a210 comp rx=0 tx=0).stop 2024-09-19T09:20:22.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.997+0000 7fd16274b640 1 -- 172.21.15.18:0/2412730583 shutdown_connections 2024-09-19T09:20:22.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.997+0000 7fd16274b640 1 --2- 172.21.15.18:0/2412730583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd15c0b5200 0x7fd15c1629e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:22.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.997+0000 7fd16274b640 1 --2- 172.21.15.18:0/2412730583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd15c15ed30 0x7fd15c070260 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:22.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.997+0000 7fd16274b640 1 -- 172.21.15.18:0/2412730583 >> 172.21.15.18:0/2412730583 conn(0x7fd15c0b4600 msgr2=0x7fd15c0b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:22.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.997+0000 7fd16274b640 1 -- 172.21.15.18:0/2412730583 shutdown_connections 2024-09-19T09:20:22.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.997+0000 7fd16274b640 1 -- 172.21.15.18:0/2412730583 wait complete. 2024-09-19T09:20:23.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.998+0000 7fd16274b640 1 Processor -- start 2024-09-19T09:20:23.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.998+0000 7fd16274b640 1 -- start start 2024-09-19T09:20:23.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.999+0000 7fd16274b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd15c0b5200 0x7fd15c0cf090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:23.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.999+0000 7fd16274b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd15c15ed30 0x7fd15c1604c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:23.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.999+0000 7fd16274b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd15c162f20 0x7fd15c0cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:23.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.999+0000 7fd16274b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd15c070f10 con 0x7fd15c162f20 2024-09-19T09:20:23.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.999+0000 7fd16274b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd15c070d90 con 0x7fd15c0b5200 2024-09-19T09:20:23.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.999+0000 7fd16274b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd15c15f110 con 0x7fd15c15ed30 2024-09-19T09:20:23.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.999+0000 7fd160ce8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd15c162f20 0x7fd15c0cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:23.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.999+0000 7fd160ce8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd15c162f20 0x7fd15c0cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53366/0 (socket says 172.21.15.18:53366) 2024-09-19T09:20:23.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.999+0000 7fd160ce8640 1 -- 172.21.15.18:0/2632528940 learned_addr learned my addr 172.21.15.18:0/2632528940 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:23.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.999+0000 7fd15bfff640 1 --2- 172.21.15.18:0/2632528940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd15c0b5200 0x7fd15c0cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:23.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.999+0000 7fd15b7fe640 1 --2- 172.21.15.18:0/2632528940 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd15c15ed30 0x7fd15c1604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:23.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.999+0000 7fd160ce8640 1 -- 172.21.15.18:0/2632528940 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd15c15ed30 msgr2=0x7fd15c1604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:23.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.999+0000 7fd160ce8640 1 --2- 172.21.15.18:0/2632528940 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd15c15ed30 0x7fd15c1604c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.999+0000 7fd160ce8640 1 -- 172.21.15.18:0/2632528940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd15c0b5200 msgr2=0x7fd15c0cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:23.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.999+0000 7fd160ce8640 1 --2- 172.21.15.18:0/2632528940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd15c0b5200 0x7fd15c0cf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:22.999+0000 7fd160ce8640 1 -- 172.21.15.18:0/2632528940 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd15c160b50 con 0x7fd15c162f20 2024-09-19T09:20:23.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.000+0000 7fd160ce8640 1 --2- 172.21.15.18:0/2632528940 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd15c162f20 0x7fd15c0cfb10 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fd15400c730 tx=0x7fd15400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:23.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.000+0000 7fd158ff9640 1 -- 172.21.15.18:0/2632528940 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd154018070 con 0x7fd15c162f20 2024-09-19T09:20:23.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.000+0000 7fd158ff9640 1 -- 172.21.15.18:0/2632528940 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd15400ce40 con 0x7fd15c162f20 2024-09-19T09:20:23.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.000+0000 7fd158ff9640 1 -- 172.21.15.18:0/2632528940 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd15400a860 con 0x7fd15c162f20 2024-09-19T09:20:23.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.000+0000 7fd16274b640 1 -- 172.21.15.18:0/2632528940 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd15c160e30 con 0x7fd15c162f20 2024-09-19T09:20:23.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.000+0000 7fd16274b640 1 -- 172.21.15.18:0/2632528940 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd15c1613f0 con 0x7fd15c162f20 2024-09-19T09:20:23.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.001+0000 7fd16274b640 1 -- 172.21.15.18:0/2632528940 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd15c06e4f0 con 0x7fd15c162f20 2024-09-19T09:20:23.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.001+0000 7fd158ff9640 1 -- 172.21.15.18:0/2632528940 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd15400aa00 con 0x7fd15c162f20 2024-09-19T09:20:23.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.002+0000 7fd158ff9640 1 --2- 172.21.15.18:0/2632528940 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd14806c2b0 0x7fd14806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:23.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.002+0000 7fd158ff9640 1 -- 172.21.15.18:0/2632528940 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7fd15408a7c0 con 0x7fd15c162f20 2024-09-19T09:20:23.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.002+0000 7fd15bfff640 1 --2- 172.21.15.18:0/2632528940 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd14806c2b0 0x7fd14806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:23.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.002+0000 7fd15bfff640 1 --2- 172.21.15.18:0/2632528940 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd14806c2b0 0x7fd14806e770 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd14c034000 tx=0x7fd14c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:23.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.006+0000 7fd158ff9640 1 -- 172.21.15.18:0/2632528940 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd15c06e4f0 con 0x7fd15c162f20 2024-09-19T09:20:23.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.247+0000 7fd16274b640 1 -- 172.21.15.18:0/2632528940 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) -- 0x7fd15c1629e0 con 0x7fd15c162f20 2024-09-19T09:20:23.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.260+0000 7fd158ff9640 1 -- 172.21.15.18:0/2632528940 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v357) ==== 135+0+0 (secure 0 0 0) 0x7fd1540591b0 con 0x7fd15c162f20 2024-09-19T09:20:23.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.262+0000 7fd16274b640 1 -- 172.21.15.18:0/2632528940 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd14806c2b0 msgr2=0x7fd14806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:23.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.262+0000 7fd16274b640 1 --2- 172.21.15.18:0/2632528940 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd14806c2b0 0x7fd14806e770 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd14c034000 tx=0x7fd14c02e000 comp rx=0 tx=0).stop 2024-09-19T09:20:23.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.262+0000 7fd16274b640 1 -- 172.21.15.18:0/2632528940 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd15c162f20 msgr2=0x7fd15c0cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:23.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.262+0000 7fd16274b640 1 --2- 172.21.15.18:0/2632528940 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd15c162f20 0x7fd15c0cfb10 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fd15400c730 tx=0x7fd15400cbf0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.262+0000 7fd16274b640 1 -- 172.21.15.18:0/2632528940 shutdown_connections 2024-09-19T09:20:23.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.262+0000 7fd16274b640 1 --2- 172.21.15.18:0/2632528940 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd14806c2b0 0x7fd14806e770 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.262+0000 7fd16274b640 1 --2- 172.21.15.18:0/2632528940 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd15c162f20 0x7fd15c0cfb10 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.262+0000 7fd16274b640 1 --2- 172.21.15.18:0/2632528940 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd15c15ed30 0x7fd15c1604c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.262+0000 7fd16274b640 1 --2- 172.21.15.18:0/2632528940 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd15c0b5200 0x7fd15c0cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.262+0000 7fd16274b640 1 -- 172.21.15.18:0/2632528940 >> 172.21.15.18:0/2632528940 conn(0x7fd15c0b4600 msgr2=0x7fd15c0b2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:23.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.262+0000 7fd16274b640 1 -- 172.21.15.18:0/2632528940 shutdown_connections 2024-09-19T09:20:23.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.262+0000 7fd16274b640 1 -- 172.21.15.18:0/2632528940 wait complete. 2024-09-19T09:20:23.276 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-19T09:20:23.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.381+0000 7fd88e85e640 1 Processor -- start 2024-09-19T09:20:23.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.381+0000 7fd88e85e640 1 -- start start 2024-09-19T09:20:23.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.382+0000 7fd88e85e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd88806e280 0x7fd888073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:23.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.382+0000 7fd88e85e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd888071df0 0x7fd88806e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:23.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.382+0000 7fd88e85e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd88806eba0 con 0x7fd8880d1010 2024-09-19T09:20:23.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.382+0000 7fd88e85e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fd8880738b0 con 0x7fd88806e280 2024-09-19T09:20:23.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.382+0000 7fd88e85e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd8880722d0 con 0x7fd888071df0 2024-09-19T09:20:23.383 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.382+0000 7fd887fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd88806e280 0x7fd888073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:23.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.382+0000 7fd88cdfb640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd8880d1010 0x7fd8880ce3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:35012/0 (socket says 172.21.15.18:35012) 2024-09-19T09:20:23.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.382+0000 7fd88cdfb640 1 -- 172.21.15.18:0/2358302166 learned_addr learned my addr 172.21.15.18:0/2358302166 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:20:23.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.382+0000 7fd8877fe640 1 --2- 172.21.15.18:0/2358302166 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd888071df0 0x7fd88806e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:23.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.383+0000 7fd887fff640 1 -- 172.21.15.18:0/2358302166 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd888071df0 msgr2=0x7fd88806e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:23.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.383+0000 7fd887fff640 1 --2- 172.21.15.18:0/2358302166 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd888071df0 0x7fd88806e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.383+0000 7fd887fff640 1 -- 172.21.15.18:0/2358302166 >> v1:172.21.15.18:6789/0 conn(0x7fd8880d1010 legacy=0x7fd8880ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:23.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.383+0000 7fd887fff640 1 -- 172.21.15.18:0/2358302166 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8880725b0 con 0x7fd88806e280 2024-09-19T09:20:23.384 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.383+0000 7fd886ffd640 1 -- 172.21.15.18:0/2358302166 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1870235635 0 0) 0x7fd88806eba0 con 0x7fd8880d1010 2024-09-19T09:20:23.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.383+0000 7fd887fff640 1 --2- 172.21.15.18:0/2358302166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd88806e280 0x7fd888073370 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fd8780097a0 tx=0x7fd87802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b91bb80ab4fa66 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:23.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.383+0000 7fd886ffd640 1 -- 172.21.15.18:0/2358302166 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd878037070 con 0x7fd88806e280 2024-09-19T09:20:23.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.384+0000 7fd886ffd640 1 -- 172.21.15.18:0/2358302166 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd878032440 con 0x7fd88806e280 2024-09-19T09:20:23.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.384+0000 7fd886ffd640 1 -- 172.21.15.18:0/2358302166 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd878032810 con 0x7fd88806e280 2024-09-19T09:20:23.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.384+0000 7fd88e85e640 1 -- 172.21.15.18:0/2358302166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd88806e280 msgr2=0x7fd888073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:23.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.384+0000 7fd88e85e640 1 --2- 172.21.15.18:0/2358302166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd88806e280 0x7fd888073370 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fd8780097a0 tx=0x7fd87802a180 comp rx=0 tx=0).stop 2024-09-19T09:20:23.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.384+0000 7fd88e85e640 1 -- 172.21.15.18:0/2358302166 shutdown_connections 2024-09-19T09:20:23.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.384+0000 7fd88e85e640 1 --2- 172.21.15.18:0/2358302166 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd888071df0 0x7fd88806e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.384+0000 7fd88e85e640 1 --2- 172.21.15.18:0/2358302166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd88806e280 0x7fd888073370 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.384+0000 7fd88e85e640 1 -- 172.21.15.18:0/2358302166 >> 172.21.15.18:0/2358302166 conn(0x7fd88806bc10 msgr2=0x7fd88806c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:23.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.384+0000 7fd88e85e640 1 -- 172.21.15.18:0/2358302166 shutdown_connections 2024-09-19T09:20:23.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.384+0000 7fd88e85e640 1 -- 172.21.15.18:0/2358302166 wait complete. 2024-09-19T09:20:23.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.385+0000 7fd88e85e640 1 Processor -- start 2024-09-19T09:20:23.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.385+0000 7fd88e85e640 1 -- start start 2024-09-19T09:20:23.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.386+0000 7fd88e85e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd88806e280 0x7fd888149440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:23.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.386+0000 7fd88e85e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd888071df0 0x7fd8880cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:23.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.386+0000 7fd88e85e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8880d1010 0x7fd8880cfa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:23.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.386+0000 7fd88e85e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd888072e50 con 0x7fd8880d1010 2024-09-19T09:20:23.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.386+0000 7fd88e85e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd888072b70 con 0x7fd888071df0 2024-09-19T09:20:23.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.386+0000 7fd88e85e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd88815db60 con 0x7fd88806e280 2024-09-19T09:20:23.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.386+0000 7fd88cdfb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8880d1010 0x7fd8880cfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:23.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.386+0000 7fd88cdfb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8880d1010 0x7fd8880cfa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53386/0 (socket says 172.21.15.18:53386) 2024-09-19T09:20:23.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.386+0000 7fd88cdfb640 1 -- 172.21.15.18:0/1504993068 learned_addr learned my addr 172.21.15.18:0/1504993068 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:23.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.386+0000 7fd887fff640 1 --2- 172.21.15.18:0/1504993068 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd88806e280 0x7fd888149440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:23.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.386+0000 7fd8877fe640 1 --2- 172.21.15.18:0/1504993068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd888071df0 0x7fd8880cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:23.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.387+0000 7fd88cdfb640 1 -- 172.21.15.18:0/1504993068 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd88806e280 msgr2=0x7fd888149440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:23.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.387+0000 7fd88cdfb640 1 --2- 172.21.15.18:0/1504993068 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd88806e280 0x7fd888149440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.387+0000 7fd88cdfb640 1 -- 172.21.15.18:0/1504993068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd888071df0 msgr2=0x7fd8880cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:23.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.387+0000 7fd88cdfb640 1 --2- 172.21.15.18:0/1504993068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd888071df0 0x7fd8880cf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.387+0000 7fd88cdfb640 1 -- 172.21.15.18:0/1504993068 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8880aa4d0 con 0x7fd8880d1010 2024-09-19T09:20:23.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.387+0000 7fd88cdfb640 1 --2- 172.21.15.18:0/1504993068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8880d1010 0x7fd8880cfa20 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fd88000c7a0 tx=0x7fd88000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:23.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.387+0000 7fd884ff9640 1 -- 172.21.15.18:0/1504993068 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd880018070 con 0x7fd8880d1010 2024-09-19T09:20:23.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.387+0000 7fd884ff9640 1 -- 172.21.15.18:0/1504993068 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd88000a640 con 0x7fd8880d1010 2024-09-19T09:20:23.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.387+0000 7fd884ff9640 1 -- 172.21.15.18:0/1504993068 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88000aab0 con 0x7fd8880d1010 2024-09-19T09:20:23.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.387+0000 7fd88e85e640 1 -- 172.21.15.18:0/1504993068 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8880aa770 con 0x7fd8880d1010 2024-09-19T09:20:23.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.387+0000 7fd88e85e640 1 -- 172.21.15.18:0/1504993068 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8880aad30 con 0x7fd8880d1010 2024-09-19T09:20:23.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.388+0000 7fd88e85e640 1 -- 172.21.15.18:0/1504993068 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8880d1490 con 0x7fd8880d1010 2024-09-19T09:20:23.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.388+0000 7fd884ff9640 1 -- 172.21.15.18:0/1504993068 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd88000ac50 con 0x7fd8880d1010 2024-09-19T09:20:23.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.389+0000 7fd884ff9640 1 --2- 172.21.15.18:0/1504993068 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd87406c2b0 0x7fd87406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:23.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.389+0000 7fd884ff9640 1 -- 172.21.15.18:0/1504993068 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7fd88008a7c0 con 0x7fd8880d1010 2024-09-19T09:20:23.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.389+0000 7fd887fff640 1 --2- 172.21.15.18:0/1504993068 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd87406c2b0 0x7fd87406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:23.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.390+0000 7fd887fff640 1 --2- 172.21.15.18:0/1504993068 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd87406c2b0 0x7fd87406e770 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd878034000 tx=0x7fd87802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:23.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.393+0000 7fd884ff9640 1 -- 172.21.15.18:0/1504993068 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd880059230 con 0x7fd8880d1010 2024-09-19T09:20:23.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.570+0000 7fd88e85e640 1 -- 172.21.15.18:0/1504993068 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd8880aaf00 con 0x7fd8880d1010 2024-09-19T09:20:23.574 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.574+0000 7fd884ff9640 1 -- 172.21.15.18:0/1504993068 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7fd880058b30 con 0x7fd8880d1010 2024-09-19T09:20:23.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.576+0000 7fd88e85e640 1 -- 172.21.15.18:0/1504993068 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd87406c2b0 msgr2=0x7fd87406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:23.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.576+0000 7fd88e85e640 1 --2- 172.21.15.18:0/1504993068 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd87406c2b0 0x7fd87406e770 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd878034000 tx=0x7fd87802e000 comp rx=0 tx=0).stop 2024-09-19T09:20:23.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.576+0000 7fd88e85e640 1 -- 172.21.15.18:0/1504993068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8880d1010 msgr2=0x7fd8880cfa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:23.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.576+0000 7fd88e85e640 1 --2- 172.21.15.18:0/1504993068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8880d1010 0x7fd8880cfa20 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fd88000c7a0 tx=0x7fd88000cc60 comp rx=0 tx=0).stop 2024-09-19T09:20:23.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.576+0000 7fd88e85e640 1 -- 172.21.15.18:0/1504993068 shutdown_connections 2024-09-19T09:20:23.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.576+0000 7fd88e85e640 1 --2- 172.21.15.18:0/1504993068 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd87406c2b0 0x7fd87406e770 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.576+0000 7fd88e85e640 1 --2- 172.21.15.18:0/1504993068 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd8880d1010 0x7fd8880cfa20 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.576+0000 7fd88e85e640 1 --2- 172.21.15.18:0/1504993068 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd888071df0 0x7fd8880cf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.576+0000 7fd88e85e640 1 --2- 172.21.15.18:0/1504993068 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd88806e280 0x7fd888149440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.576+0000 7fd88e85e640 1 -- 172.21.15.18:0/1504993068 >> 172.21.15.18:0/1504993068 conn(0x7fd88806bc10 msgr2=0x7fd8880cd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:23.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.576+0000 7fd88e85e640 1 -- 172.21.15.18:0/1504993068 shutdown_connections 2024-09-19T09:20:23.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.576+0000 7fd88e85e640 1 -- 172.21.15.18:0/1504993068 wait complete. 2024-09-19T09:20:23.588 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T09:20:23.589 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:20:23.625 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:20:23.673 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T09:20:23.674 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:20:23.674 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:20:23.692 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17075 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T09:20:23.692 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:20:23.692 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:20:23.710 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3252 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T09:20:23.711 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:20:23.711 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:20:23.746 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17075 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T09:20:23.747 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:20:23.747 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:20:23.768 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3252 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T09:20:23.768 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-19T09:20:23.768 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:20:23.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.888+0000 7f6eb946e640 1 Processor -- start 2024-09-19T09:20:23.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.888+0000 7f6eb946e640 1 -- start start 2024-09-19T09:20:23.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.889+0000 7f6eb946e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6eb413fae0 0x7f6eb406f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:23.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.889+0000 7f6eb946e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6eb4142150 0x7f6eb4160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:23.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.889+0000 7f6eb946e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6eb4142650 con 0x7f6eb4160a80 2024-09-19T09:20:23.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.889+0000 7f6eb946e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f6eb40ce780 con 0x7f6eb4142150 2024-09-19T09:20:23.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.889+0000 7f6eb946e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6eb4142930 con 0x7f6eb413fae0 2024-09-19T09:20:23.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.889+0000 7f6eb27fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6eb4142150 0x7f6eb4160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:23.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.889+0000 7f6eb27fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6eb4142150 0x7f6eb4160540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53390/0 (socket says 172.21.15.18:53390) 2024-09-19T09:20:23.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.889+0000 7f6eb27fc640 1 -- 172.21.15.18:0/352272243 learned_addr learned my addr 172.21.15.18:0/352272243 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:23.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.889+0000 7f6eb2ffd640 1 --2- 172.21.15.18:0/352272243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6eb413fae0 0x7f6eb406f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:23.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.889+0000 7f6eb27fc640 1 -- 172.21.15.18:0/352272243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6eb413fae0 msgr2=0x7f6eb406f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:23.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.889+0000 7f6eb27fc640 1 --2- 172.21.15.18:0/352272243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6eb413fae0 0x7f6eb406f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.889+0000 7f6eb27fc640 1 -- 172.21.15.18:0/352272243 >> v1:172.21.15.162:6789/0 conn(0x7f6eb4160a80 legacy=0x7f6eb415cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:23.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.889+0000 7f6eb27fc640 1 -- 172.21.15.18:0/352272243 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb4142c10 con 0x7f6eb4142150 2024-09-19T09:20:23.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.890+0000 7f6eb27fc640 1 --2- 172.21.15.18:0/352272243 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6eb4142150 0x7f6eb4160540 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c009870 tx=0x7f6e9c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e1f7bc9f1967f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:23.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.890+0000 7f6eb1ffb640 1 -- 172.21.15.18:0/352272243 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c037070 con 0x7f6eb4142150 2024-09-19T09:20:23.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.890+0000 7f6eb1ffb640 1 -- 172.21.15.18:0/352272243 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e9c032440 con 0x7f6eb4142150 2024-09-19T09:20:23.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.890+0000 7f6eb1ffb640 1 -- 172.21.15.18:0/352272243 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c032810 con 0x7f6eb4142150 2024-09-19T09:20:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.891+0000 7f6eb946e640 1 -- 172.21.15.18:0/352272243 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6eb4142150 msgr2=0x7f6eb4160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.891+0000 7f6eb946e640 1 --2- 172.21.15.18:0/352272243 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6eb4142150 0x7f6eb4160540 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c009870 tx=0x7f6e9c02a1c0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.891+0000 7f6eb946e640 1 -- 172.21.15.18:0/352272243 shutdown_connections 2024-09-19T09:20:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.891+0000 7f6eb946e640 1 --2- 172.21.15.18:0/352272243 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6eb4142150 0x7f6eb4160540 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.891+0000 7f6eb946e640 1 --2- 172.21.15.18:0/352272243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6eb413fae0 0x7f6eb406f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.891+0000 7f6eb946e640 1 -- 172.21.15.18:0/352272243 >> 172.21.15.18:0/352272243 conn(0x7f6eb406bc10 msgr2=0x7f6eb406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:23.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.891+0000 7f6eb946e640 1 -- 172.21.15.18:0/352272243 shutdown_connections 2024-09-19T09:20:23.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.891+0000 7f6eb946e640 1 -- 172.21.15.18:0/352272243 wait complete. 2024-09-19T09:20:23.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.892+0000 7f6eb946e640 1 Processor -- start 2024-09-19T09:20:23.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.892+0000 7f6eb946e640 1 -- start start 2024-09-19T09:20:23.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.893+0000 7f6eb946e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6eb413fae0 0x7f6eb415bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:23.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.893+0000 7f6eb946e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6eb4142150 0x7f6eb41456a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:23.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.893+0000 7f6eb946e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6eb4160a80 0x7f6eb4145be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:23.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.893+0000 7f6eb946e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb406f870 con 0x7f6eb4160a80 2024-09-19T09:20:23.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.893+0000 7f6eb946e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb406f6f0 con 0x7f6eb4142150 2024-09-19T09:20:23.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.893+0000 7f6eb946e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6eb40cfc20 con 0x7f6eb413fae0 2024-09-19T09:20:23.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.893+0000 7f6eb37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6eb4160a80 0x7f6eb4145be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:23.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.893+0000 7f6eb37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6eb4160a80 0x7f6eb4145be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53394/0 (socket says 172.21.15.18:53394) 2024-09-19T09:20:23.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.893+0000 7f6eb37fe640 1 -- 172.21.15.18:0/774647807 learned_addr learned my addr 172.21.15.18:0/774647807 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:23.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.893+0000 7f6eb27fc640 1 --2- 172.21.15.18:0/774647807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6eb4142150 0x7f6eb41456a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:23.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.893+0000 7f6eb2ffd640 1 --2- 172.21.15.18:0/774647807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6eb413fae0 0x7f6eb415bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:23.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.893+0000 7f6eb37fe640 1 -- 172.21.15.18:0/774647807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6eb413fae0 msgr2=0x7f6eb415bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:23.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.893+0000 7f6eb37fe640 1 --2- 172.21.15.18:0/774647807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6eb413fae0 0x7f6eb415bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.893+0000 7f6eb37fe640 1 -- 172.21.15.18:0/774647807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6eb4142150 msgr2=0x7f6eb41456a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:23.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.893+0000 7f6eb37fe640 1 --2- 172.21.15.18:0/774647807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6eb4142150 0x7f6eb41456a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:23.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.893+0000 7f6eb37fe640 1 -- 172.21.15.18:0/774647807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb4146360 con 0x7f6eb4160a80 2024-09-19T09:20:23.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.894+0000 7f6eb37fe640 1 --2- 172.21.15.18:0/774647807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6eb4160a80 0x7f6eb4145be0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f6eac00c3c0 tx=0x7f6eac00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:23.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.894+0000 7f6eab7fe640 1 -- 172.21.15.18:0/774647807 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eac017070 con 0x7f6eb4160a80 2024-09-19T09:20:23.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.894+0000 7f6eab7fe640 1 -- 172.21.15.18:0/774647807 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eac0052d0 con 0x7f6eb4160a80 2024-09-19T09:20:23.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.894+0000 7f6eb946e640 1 -- 172.21.15.18:0/774647807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eb413ff60 con 0x7f6eb4160a80 2024-09-19T09:20:23.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.894+0000 7f6eab7fe640 1 -- 172.21.15.18:0/774647807 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eac003810 con 0x7f6eb4160a80 2024-09-19T09:20:23.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.894+0000 7f6eb946e640 1 -- 172.21.15.18:0/774647807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eb4140520 con 0x7f6eb4160a80 2024-09-19T09:20:23.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.895+0000 7f6eb946e640 1 -- 172.21.15.18:0/774647807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eb406f1b0 con 0x7f6eb4160a80 2024-09-19T09:20:23.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.895+0000 7f6eab7fe640 1 -- 172.21.15.18:0/774647807 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6eac01a070 con 0x7f6eb4160a80 2024-09-19T09:20:23.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.896+0000 7f6eab7fe640 1 --2- 172.21.15.18:0/774647807 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6e9406c2b0 0x7f6e9406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:23.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.896+0000 7f6eab7fe640 1 -- 172.21.15.18:0/774647807 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(145..145 src has 1..145) ==== 4943+0+0 (secure 0 0 0) 0x7f6eac08a420 con 0x7f6eb4160a80 2024-09-19T09:20:23.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.896+0000 7f6eb2ffd640 1 --2- 172.21.15.18:0/774647807 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6e9406c2b0 0x7f6e9406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:23.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.897+0000 7f6eb2ffd640 1 --2- 172.21.15.18:0/774647807 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6e9406c2b0 0x7f6e9406e770 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4003b80 tx=0x7f6ea40098d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:23.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:23.900+0000 7f6eab7fe640 1 -- 172.21.15.18:0/774647807 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6eac0587a0 con 0x7f6eb4160a80 2024-09-19T09:20:24.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:24.111+0000 7f6eb946e640 1 -- 172.21.15.18:0/774647807 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6eb406e960 con 0x7f6eb4160a80 2024-09-19T09:20:24.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:24.111+0000 7f6eab7fe640 1 -- 172.21.15.18:0/774647807 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) ==== 94+0+3917 (secure 0 0 0) 0x7f6eac05caa0 con 0x7f6eb4160a80 2024-09-19T09:20:24.112 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:20:24.112 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":58,"btime":"2024-09-19T09:20:19:012047+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5846,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1876507362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1876507362},{"type":"v1","addr":"172.21.15.162:6837","nonce":1876507362}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6487,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/2245870616","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2245870616},{"type":"v1","addr":"172.21.15.162:6835","nonce":2245870616}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":6858,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1245398837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1245398837},{"type":"v1","addr":"172.21.15.18:6834","nonce":1245398837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":51},{"gid":7155,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/4238378531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":4238378531},{"type":"v1","addr":"172.21.15.18:6835","nonce":4238378531}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":58}],"filesystems":[]} 2024-09-19T09:20:24.113 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 58 2024-09-19T09:20:24.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:24.113+0000 7f6eb946e640 1 -- 172.21.15.18:0/774647807 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6e9406c2b0 msgr2=0x7f6e9406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:24.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:24.113+0000 7f6eb946e640 1 --2- 172.21.15.18:0/774647807 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6e9406c2b0 0x7f6e9406e770 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4003b80 tx=0x7f6ea40098d0 comp rx=0 tx=0).stop 2024-09-19T09:20:24.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:24.113+0000 7f6eb946e640 1 -- 172.21.15.18:0/774647807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6eb4160a80 msgr2=0x7f6eb4145be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:24.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:24.113+0000 7f6eb946e640 1 --2- 172.21.15.18:0/774647807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6eb4160a80 0x7f6eb4145be0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f6eac00c3c0 tx=0x7f6eac00c880 comp rx=0 tx=0).stop 2024-09-19T09:20:24.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:24.113+0000 7f6eb946e640 1 -- 172.21.15.18:0/774647807 shutdown_connections 2024-09-19T09:20:24.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:24.113+0000 7f6eb946e640 1 --2- 172.21.15.18:0/774647807 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6e9406c2b0 0x7f6e9406e770 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:24.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:24.113+0000 7f6eb946e640 1 --2- 172.21.15.18:0/774647807 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6eb4160a80 0x7f6eb4145be0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:24.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:24.113+0000 7f6eb946e640 1 --2- 172.21.15.18:0/774647807 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6eb4142150 0x7f6eb41456a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:24.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:24.113+0000 7f6eb946e640 1 --2- 172.21.15.18:0/774647807 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6eb413fae0 0x7f6eb415bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:24.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:24.113+0000 7f6eb946e640 1 -- 172.21.15.18:0/774647807 >> 172.21.15.18:0/774647807 conn(0x7f6eb406bc10 msgr2=0x7f6eb415cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:24.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:24.113+0000 7f6eb946e640 1 -- 172.21.15.18:0/774647807 shutdown_connections 2024-09-19T09:20:24.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:24.113+0000 7f6eb946e640 1 -- 172.21.15.18:0/774647807 wait complete. 2024-09-19T09:20:24.125 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T09:20:24.125 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-19T09:20:24.126 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T09:20:24.126 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:20:24.126 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T09:20:24.126 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-19T09:20:24.126 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T09:20:24.126 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:20:24.127 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T09:20:24.127 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-19T09:20:24.127 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T09:20:24.127 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:20:24.127 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T09:20:24.127 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-19T09:20:24.127 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T09:20:24.127 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:20:24.136 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T09:20:24.136 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T09:20:24.138 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T09:20:24.138 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T09:20:24.139 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T09:20:24.139 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T09:20:24.178 INFO:tasks.ceph.mds.c:Started 2024-09-19T09:20:24.178 DEBUG:teuthology.parallel:result is None 2024-09-19T09:20:24.181 INFO:tasks.ceph.mds.b:Started 2024-09-19T09:20:24.181 DEBUG:teuthology.parallel:result is None 2024-09-19T09:20:24.182 INFO:tasks.ceph.mds.d:Started 2024-09-19T09:20:24.182 DEBUG:teuthology.parallel:result is None 2024-09-19T09:20:24.255 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2024-09-19T09:20:24.262 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-09-19T09:20:24.262 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-09-19T09:20:26.544 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-09-19T09:20:30.136 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T09:20:30.136 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T09:20:30.139 INFO:tasks.ceph.mds.a:Started 2024-09-19T09:20:30.139 DEBUG:teuthology.parallel:result is None 2024-09-19T09:20:30.140 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-19T09:20:30.229 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-09-19T09:20:30.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.255+0000 7f9ea65cf640 1 Processor -- start 2024-09-19T09:20:30.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.255+0000 7f9ea65cf640 1 -- start start 2024-09-19T09:20:30.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.256+0000 7f9ea65cf640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9ea006bc10 0x7f9ea00b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:30.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.256+0000 7f9ea65cf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9ea00b4b90 0x7f9ea006bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:30.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.256+0000 7f9ea65cf640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9ea0162750 0x7f9ea0162be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:30.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.256+0000 7f9ea65cf640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f9ea006c530 con 0x7f9ea0162750 2024-09-19T09:20:30.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.256+0000 7f9ea65cf640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9ea01600c0 con 0x7f9ea006bc10 2024-09-19T09:20:30.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.256+0000 7f9ea65cf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea00d1920 con 0x7f9ea00b4b90 2024-09-19T09:20:30.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.256+0000 7f9ea4b6c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9ea0162750 0x7f9ea0162be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:30.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.256+0000 7f9ea4b6c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9ea0162750 0x7f9ea0162be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33630/0 (socket says 172.21.15.18:33630) 2024-09-19T09:20:30.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.256+0000 7f9ea4b6c640 1 -- 172.21.15.18:0/1242219795 learned_addr learned my addr 172.21.15.18:0/1242219795 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:30.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.256+0000 7f9e9ffff640 1 --2- 172.21.15.18:0/1242219795 >> v2:172.21.15.162:3300/0 conn(0x7f9ea006bc10 0x7f9ea00b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:30.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.256+0000 7f9e9f7fe640 1 --2- 172.21.15.18:0/1242219795 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9ea00b4b90 0x7f9ea006bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:30.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.257+0000 7f9ea4b6c640 1 -- 172.21.15.18:0/1242219795 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9ea00b4b90 msgr2=0x7f9ea006bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:30.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.257+0000 7f9ea4b6c640 1 --2- 172.21.15.18:0/1242219795 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9ea00b4b90 0x7f9ea006bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:30.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.257+0000 7f9ea4b6c640 1 -- 172.21.15.18:0/1242219795 >> v2:172.21.15.162:3300/0 conn(0x7f9ea006bc10 msgr2=0x7f9ea00b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:30.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.257+0000 7f9ea4b6c640 1 --2- 172.21.15.18:0/1242219795 >> v2:172.21.15.162:3300/0 conn(0x7f9ea006bc10 0x7f9ea00b6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:30.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.257+0000 7f9ea4b6c640 1 -- 172.21.15.18:0/1242219795 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea015f300 con 0x7f9ea0162750 2024-09-19T09:20:30.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.257+0000 7f9ea4b6c640 1 --2- 172.21.15.18:0/1242219795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ea0162750 0x7f9ea0162be0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f9ea00712a0 tx=0x7f9e9802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1420c8669806b76d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:30.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.258+0000 7f9e9effd640 1 -- 172.21.15.18:0/1242219795 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e98036070 con 0x7f9ea0162750 2024-09-19T09:20:30.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.258+0000 7f9e9effd640 1 -- 172.21.15.18:0/1242219795 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e98031600 con 0x7f9ea0162750 2024-09-19T09:20:30.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.258+0000 7f9e9effd640 1 -- 172.21.15.18:0/1242219795 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e980319d0 con 0x7f9ea0162750 2024-09-19T09:20:30.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.258+0000 7f9ea65cf640 1 -- 172.21.15.18:0/1242219795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ea0162750 msgr2=0x7f9ea0162be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:30.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.258+0000 7f9ea65cf640 1 --2- 172.21.15.18:0/1242219795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ea0162750 0x7f9ea0162be0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f9ea00712a0 tx=0x7f9e9802a610 comp rx=0 tx=0).stop 2024-09-19T09:20:30.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.258+0000 7f9ea65cf640 1 -- 172.21.15.18:0/1242219795 shutdown_connections 2024-09-19T09:20:30.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.258+0000 7f9ea65cf640 1 --2- 172.21.15.18:0/1242219795 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ea0162750 0x7f9ea0162be0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:30.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.258+0000 7f9ea65cf640 1 --2- 172.21.15.18:0/1242219795 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9ea00b4b90 0x7f9ea006bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:30.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.258+0000 7f9ea65cf640 1 --2- 172.21.15.18:0/1242219795 >> v2:172.21.15.162:3300/0 conn(0x7f9ea006bc10 0x7f9ea00b6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:30.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.258+0000 7f9ea65cf640 1 -- 172.21.15.18:0/1242219795 >> 172.21.15.18:0/1242219795 conn(0x7f9ea00b3890 msgr2=0x7f9ea00b3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:30.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.258+0000 7f9ea65cf640 1 -- 172.21.15.18:0/1242219795 shutdown_connections 2024-09-19T09:20:30.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.258+0000 7f9ea65cf640 1 -- 172.21.15.18:0/1242219795 wait complete. 2024-09-19T09:20:30.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.259+0000 7f9ea65cf640 1 Processor -- start 2024-09-19T09:20:30.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.260+0000 7f9ea65cf640 1 -- start start 2024-09-19T09:20:30.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.260+0000 7f9ea65cf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9ea006bc10 0x7f9ea013c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:30.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.260+0000 7f9ea65cf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ea00b4b90 0x7f9ea0140c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:30.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.260+0000 7f9ea65cf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ea0162750 0x7f9ea0162b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:30.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.260+0000 7f9ea65cf640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea015fba0 con 0x7f9ea0162750 2024-09-19T09:20:30.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.260+0000 7f9ea65cf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea015f8c0 con 0x7f9ea00b4b90 2024-09-19T09:20:30.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.260+0000 7f9ea65cf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea00b5000 con 0x7f9ea006bc10 2024-09-19T09:20:30.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.261+0000 7f9ea4b6c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ea0162750 0x7f9ea0162b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:30.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.261+0000 7f9ea4b6c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ea0162750 0x7f9ea0162b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33646/0 (socket says 172.21.15.18:33646) 2024-09-19T09:20:30.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.261+0000 7f9ea4b6c640 1 -- 172.21.15.18:0/1809382688 learned_addr learned my addr 172.21.15.18:0/1809382688 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:30.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.261+0000 7f9e9f7fe640 1 --2- 172.21.15.18:0/1809382688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ea00b4b90 0x7f9ea0140c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:30.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.261+0000 7f9e9ffff640 1 --2- 172.21.15.18:0/1809382688 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9ea006bc10 0x7f9ea013c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:30.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.261+0000 7f9ea4b6c640 1 -- 172.21.15.18:0/1809382688 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9ea006bc10 msgr2=0x7f9ea013c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:30.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.261+0000 7f9ea4b6c640 1 --2- 172.21.15.18:0/1809382688 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9ea006bc10 0x7f9ea013c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:30.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.261+0000 7f9ea4b6c640 1 -- 172.21.15.18:0/1809382688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ea00b4b90 msgr2=0x7f9ea0140c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:30.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.261+0000 7f9ea4b6c640 1 --2- 172.21.15.18:0/1809382688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ea00b4b90 0x7f9ea0140c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:30.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.261+0000 7f9ea4b6c640 1 -- 172.21.15.18:0/1809382688 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea01415e0 con 0x7f9ea0162750 2024-09-19T09:20:30.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.261+0000 7f9ea4b6c640 1 --2- 172.21.15.18:0/1809382688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ea0162750 0x7f9ea0162b60 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f9e9802ac00 tx=0x7f9e98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:30.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.261+0000 7f9e9cff9640 1 -- 172.21.15.18:0/1809382688 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e98041020 con 0x7f9ea0162750 2024-09-19T09:20:30.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.261+0000 7f9e9cff9640 1 -- 172.21.15.18:0/1809382688 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e98007780 con 0x7f9ea0162750 2024-09-19T09:20:30.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.261+0000 7f9ea65cf640 1 -- 172.21.15.18:0/1809382688 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ea01418c0 con 0x7f9ea0162750 2024-09-19T09:20:30.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.261+0000 7f9e9cff9640 1 -- 172.21.15.18:0/1809382688 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e98036040 con 0x7f9ea0162750 2024-09-19T09:20:30.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.261+0000 7f9ea65cf640 1 -- 172.21.15.18:0/1809382688 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ea0141e80 con 0x7f9ea0162750 2024-09-19T09:20:30.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.262+0000 7f9ea65cf640 1 -- 172.21.15.18:0/1809382688 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ea00b52e0 con 0x7f9ea0162750 2024-09-19T09:20:30.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.263+0000 7f9e9cff9640 1 -- 172.21.15.18:0/1809382688 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9e98044020 con 0x7f9ea0162750 2024-09-19T09:20:30.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.263+0000 7f9e9cff9640 1 --2- 172.21.15.18:0/1809382688 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9e8c06c2b0 0x7f9e8c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:30.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.264+0000 7f9e9cff9640 1 -- 172.21.15.18:0/1809382688 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 4943+0+0 (secure 0 0 0) 0x7f9e980abe20 con 0x7f9ea0162750 2024-09-19T09:20:30.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.264+0000 7f9e9ffff640 1 --2- 172.21.15.18:0/1809382688 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9e8c06c2b0 0x7f9e8c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:30.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.264+0000 7f9e9ffff640 1 --2- 172.21.15.18:0/1809382688 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9e8c06c2b0 0x7f9e8c06e770 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f9e90006fd0 tx=0x7f9e90008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:30.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.268+0000 7f9e9cff9640 1 -- 172.21.15.18:0/1809382688 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9e9804b030 con 0x7f9ea0162750 2024-09-19T09:20:30.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:30.454+0000 7f9ea65cf640 1 -- 172.21.15.18:0/1809382688 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f9ea00b4760 con 0x7f9ea0162750 2024-09-19T09:20:31.334 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:20:31.337 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:20:31.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.691+0000 7f9e9cff9640 1 -- 172.21.15.18:0/1809382688 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v150) ==== 97+0+0 (secure 0 0 0) 0x7f9e9807a110 con 0x7f9ea0162750 2024-09-19T09:20:31.693 INFO:teuthology.orchestra.run.smithi018.stderr: removed all blocklist entries 2024-09-19T09:20:31.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.694+0000 7f9ea65cf640 1 -- 172.21.15.18:0/1809382688 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9e8c06c2b0 msgr2=0x7f9e8c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:31.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.694+0000 7f9ea65cf640 1 --2- 172.21.15.18:0/1809382688 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9e8c06c2b0 0x7f9e8c06e770 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f9e90006fd0 tx=0x7f9e90008040 comp rx=0 tx=0).stop 2024-09-19T09:20:31.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.694+0000 7f9ea65cf640 1 -- 172.21.15.18:0/1809382688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ea0162750 msgr2=0x7f9ea0162b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:31.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.694+0000 7f9ea65cf640 1 --2- 172.21.15.18:0/1809382688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ea0162750 0x7f9ea0162b60 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f9e9802ac00 tx=0x7f9e98004a40 comp rx=0 tx=0).stop 2024-09-19T09:20:31.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.694+0000 7f9ea65cf640 1 -- 172.21.15.18:0/1809382688 shutdown_connections 2024-09-19T09:20:31.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.694+0000 7f9ea65cf640 1 --2- 172.21.15.18:0/1809382688 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9e8c06c2b0 0x7f9e8c06e770 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.694+0000 7f9ea65cf640 1 --2- 172.21.15.18:0/1809382688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9ea0162750 0x7f9ea0162b60 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.694+0000 7f9ea65cf640 1 --2- 172.21.15.18:0/1809382688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ea00b4b90 0x7f9ea0140c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.694+0000 7f9ea65cf640 1 --2- 172.21.15.18:0/1809382688 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9ea006bc10 0x7f9ea013c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.694+0000 7f9ea65cf640 1 -- 172.21.15.18:0/1809382688 >> 172.21.15.18:0/1809382688 conn(0x7f9ea00b3890 msgr2=0x7f9ea01615f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:31.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.694+0000 7f9ea65cf640 1 -- 172.21.15.18:0/1809382688 shutdown_connections 2024-09-19T09:20:31.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.694+0000 7f9ea65cf640 1 -- 172.21.15.18:0/1809382688 wait complete. 2024-09-19T09:20:31.710 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-19T09:20:31.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.816+0000 7f77df39f640 1 Processor -- start 2024-09-19T09:20:31.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.817+0000 7f77df39f640 1 -- start start 2024-09-19T09:20:31.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.817+0000 7f77df39f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f77d80cf000 0x7f77d80cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:31.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.817+0000 7f77df39f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77d80b1bf0 0x7f77d80cd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:31.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.817+0000 7f77df39f640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77d80cf920 con 0x7f77d80cd8d0 2024-09-19T09:20:31.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.818+0000 7f77df39f640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f77d80ccf00 con 0x7f77d80cf000 2024-09-19T09:20:31.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.818+0000 7f77df39f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f77d80700e0 con 0x7f77d80b1bf0 2024-09-19T09:20:31.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.818+0000 7f77deb9e640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f77d80cd8d0 0x7f77d80cdd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52360/0 (socket says 172.21.15.18:52360) 2024-09-19T09:20:31.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.818+0000 7f77deb9e640 1 -- 172.21.15.18:0/2233737402 learned_addr learned my addr 172.21.15.18:0/2233737402 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:20:31.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.818+0000 7f77de39d640 1 --2- 172.21.15.18:0/2233737402 >> v2:172.21.15.162:3300/0 conn(0x7f77d80cf000 0x7f77d80cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:31.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.818+0000 7f77ddb9c640 1 --2- 172.21.15.18:0/2233737402 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77d80b1bf0 0x7f77d80cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:31.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.818+0000 7f77dd39b640 1 -- 172.21.15.18:0/2233737402 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1354285897 0 0) 0x7f77d80cf920 con 0x7f77d80cd8d0 2024-09-19T09:20:31.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.818+0000 7f77dd39b640 1 -- 172.21.15.18:0/2233737402 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77c4003520 con 0x7f77d80cd8d0 2024-09-19T09:20:31.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.818+0000 7f77dd39b640 1 -- 172.21.15.18:0/2233737402 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4050176192 0 0) 0x7f77c4003520 con 0x7f77d80cd8d0 2024-09-19T09:20:31.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.818+0000 7f77dd39b640 1 -- 172.21.15.18:0/2233737402 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77d80b1bf0 msgr2=0x7f77d80cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:31.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.818+0000 7f77dd39b640 1 --2- 172.21.15.18:0/2233737402 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77d80b1bf0 0x7f77d80cd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.818+0000 7f77dd39b640 1 -- 172.21.15.18:0/2233737402 >> v2:172.21.15.162:3300/0 conn(0x7f77d80cf000 msgr2=0x7f77d80cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:31.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.818+0000 7f77dd39b640 1 --2- 172.21.15.18:0/2233737402 >> v2:172.21.15.162:3300/0 conn(0x7f77d80cf000 0x7f77d80cf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.818+0000 7f77dd39b640 1 -- 172.21.15.18:0/2233737402 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d80703c0 con 0x7f77d80cd8d0 2024-09-19T09:20:31.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.818+0000 7f77dd39b640 1 -- 172.21.15.18:0/2233737402 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f77d00019f0 con 0x7f77d80cd8d0 2024-09-19T09:20:31.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.818+0000 7f77dd39b640 1 -- 172.21.15.18:0/2233737402 >> v1:172.21.15.18:6789/0 conn(0x7f77d80cd8d0 legacy=0x7f77d80cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:31.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.818+0000 7f77dd39b640 1 --2- 172.21.15.18:0/2233737402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77c40039b0 0x7f77c4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:31.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.818+0000 7f77dd39b640 1 --2- 172.21.15.18:0/2233737402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77c4004800 0x7f77c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:31.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.818+0000 7f77dd39b640 1 --2- 172.21.15.18:0/2233737402 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77d80b1bf0 0x7f77c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:31.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.818+0000 7f77dd39b640 1 -- 172.21.15.18:0/2233737402 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f77d80ccf00 con 0x7f77c40039b0 2024-09-19T09:20:31.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.818+0000 7f77dd39b640 1 -- 172.21.15.18:0/2233737402 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f77d80700e0 con 0x7f77c4004800 2024-09-19T09:20:31.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.818+0000 7f77dd39b640 1 -- 172.21.15.18:0/2233737402 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f77c400baa0 con 0x7f77d80b1bf0 2024-09-19T09:20:31.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.818+0000 7f77de39d640 1 --2- 172.21.15.18:0/2233737402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77c40039b0 0x7f77c4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:31.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.819+0000 7f77ddb9c640 1 --2- 172.21.15.18:0/2233737402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77c4004800 0x7f77c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:31.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.819+0000 7f77deb9e640 1 --2- 172.21.15.18:0/2233737402 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77d80b1bf0 0x7f77c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:31.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.819+0000 7f77de39d640 1 -- 172.21.15.18:0/2233737402 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77d80b1bf0 msgr2=0x7f77c40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:31.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.819+0000 7f77de39d640 1 --2- 172.21.15.18:0/2233737402 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77d80b1bf0 0x7f77c40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.819+0000 7f77de39d640 1 -- 172.21.15.18:0/2233737402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77c4004800 msgr2=0x7f77c4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:31.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.819+0000 7f77de39d640 1 --2- 172.21.15.18:0/2233737402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77c4004800 0x7f77c4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.819+0000 7f77de39d640 1 -- 172.21.15.18:0/2233737402 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c4003520 con 0x7f77c40039b0 2024-09-19T09:20:31.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.819+0000 7f77ddb9c640 1 --2- 172.21.15.18:0/2233737402 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77c4004800 0x7f77c4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:31.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.820+0000 7f77de39d640 1 --2- 172.21.15.18:0/2233737402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77c40039b0 0x7f77c4003dd0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f77d4009a90 tx=0x7f77c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f71dbd6e268c1d0f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:31.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.820+0000 7f77dd39b640 1 -- 172.21.15.18:0/2233737402 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d4036070 con 0x7f77c40039b0 2024-09-19T09:20:31.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.820+0000 7f77dd39b640 1 -- 172.21.15.18:0/2233737402 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77d4031400 con 0x7f77c40039b0 2024-09-19T09:20:31.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.820+0000 7f77dd39b640 1 -- 172.21.15.18:0/2233737402 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d4009690 con 0x7f77c40039b0 2024-09-19T09:20:31.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.820+0000 7f77df39f640 1 -- 172.21.15.18:0/2233737402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77c40039b0 msgr2=0x7f77c4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:31.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.820+0000 7f77df39f640 1 --2- 172.21.15.18:0/2233737402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77c40039b0 0x7f77c4003dd0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f77d4009a90 tx=0x7f77c4005830 comp rx=0 tx=0).stop 2024-09-19T09:20:31.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.820+0000 7f77deb9e640 1 -- 172.21.15.18:0/2233737402 reap_dead start 2024-09-19T09:20:31.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.820+0000 7f77df39f640 1 -- 172.21.15.18:0/2233737402 shutdown_connections 2024-09-19T09:20:31.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.820+0000 7f77df39f640 1 -- 172.21.15.18:0/2233737402 >> 172.21.15.18:0/2233737402 conn(0x7f77d80b4330 msgr2=0x7f77d80b4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:31.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.820+0000 7f77df39f640 1 -- 172.21.15.18:0/2233737402 shutdown_connections 2024-09-19T09:20:31.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.820+0000 7f77df39f640 1 -- 172.21.15.18:0/2233737402 wait complete. 2024-09-19T09:20:31.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.821+0000 7f77df39f640 1 Processor -- start 2024-09-19T09:20:31.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.822+0000 7f77df39f640 1 -- start start 2024-09-19T09:20:31.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.822+0000 7f77df39f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77c40039b0 0x7f77d81f5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:31.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.822+0000 7f77df39f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77d80c9a10 0x7f77d8154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:31.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.822+0000 7f77df39f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77d80ca3d0 0x7f77d80ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:31.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.822+0000 7f77df39f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f77d80cfbe0 con 0x7f77d80ca3d0 2024-09-19T09:20:31.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.822+0000 7f77df39f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f77d8070980 con 0x7f77d80c9a10 2024-09-19T09:20:31.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.822+0000 7f77df39f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f77d80cfd60 con 0x7f77c40039b0 2024-09-19T09:20:31.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.822+0000 7f77deb9e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77d80ca3d0 0x7f77d80ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:31.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.822+0000 7f77deb9e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77d80ca3d0 0x7f77d80ca860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33668/0 (socket says 172.21.15.18:33668) 2024-09-19T09:20:31.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.822+0000 7f77deb9e640 1 -- 172.21.15.18:0/1508052366 learned_addr learned my addr 172.21.15.18:0/1508052366 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:31.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.823+0000 7f77de39d640 1 --2- 172.21.15.18:0/1508052366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77c40039b0 0x7f77d81f5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:31.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.823+0000 7f77deb9e640 1 -- 172.21.15.18:0/1508052366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77c40039b0 msgr2=0x7f77d81f5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:31.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.823+0000 7f77deb9e640 1 --2- 172.21.15.18:0/1508052366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77c40039b0 0x7f77d81f5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.823+0000 7f77deb9e640 1 -- 172.21.15.18:0/1508052366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77d80c9a10 msgr2=0x7f77d8154c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:31.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.823+0000 7f77deb9e640 1 --2- 172.21.15.18:0/1508052366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77d80c9a10 0x7f77d8154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:31.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.823+0000 7f77deb9e640 1 -- 172.21.15.18:0/1508052366 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d81f5670 con 0x7f77d80ca3d0 2024-09-19T09:20:31.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.823+0000 7f77deb9e640 1 --2- 172.21.15.18:0/1508052366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77d80ca3d0 0x7f77d80ca860 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f77d80758c0 tx=0x7f77d000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:31.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.823+0000 7f77caffd640 1 -- 172.21.15.18:0/1508052366 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d000eb90 con 0x7f77d80ca3d0 2024-09-19T09:20:31.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.823+0000 7f77caffd640 1 -- 172.21.15.18:0/1508052366 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77d0018070 con 0x7f77d80ca3d0 2024-09-19T09:20:31.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.823+0000 7f77df39f640 1 -- 172.21.15.18:0/1508052366 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77d80d1c40 con 0x7f77d80ca3d0 2024-09-19T09:20:31.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.823+0000 7f77caffd640 1 -- 172.21.15.18:0/1508052366 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d0013420 con 0x7f77d80ca3d0 2024-09-19T09:20:31.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.823+0000 7f77df39f640 1 -- 172.21.15.18:0/1508052366 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77d80cc660 con 0x7f77d80ca3d0 2024-09-19T09:20:31.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.824+0000 7f77df39f640 1 -- 172.21.15.18:0/1508052366 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77d815ede0 con 0x7f77d80ca3d0 2024-09-19T09:20:31.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.825+0000 7f77caffd640 1 -- 172.21.15.18:0/1508052366 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f77d00135c0 con 0x7f77d80ca3d0 2024-09-19T09:20:31.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.825+0000 7f77caffd640 1 --2- 172.21.15.18:0/1508052366 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f77bc06c2b0 0x7f77bc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:31.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.825+0000 7f77caffd640 1 -- 172.21.15.18:0/1508052366 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 4857+0+0 (secure 0 0 0) 0x7f77d008b440 con 0x7f77d80ca3d0 2024-09-19T09:20:31.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.826+0000 7f77de39d640 1 --2- 172.21.15.18:0/1508052366 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f77bc06c2b0 0x7f77bc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:31.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.828+0000 7f77de39d640 1 --2- 172.21.15.18:0/1508052366 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f77bc06c2b0 0x7f77bc06e770 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f77d4033000 tx=0x7f77d4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:31.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:31.830+0000 7f77caffd640 1 -- 172.21.15.18:0/1508052366 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f77d0059f00 con 0x7f77d80ca3d0 2024-09-19T09:20:32.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.077+0000 7f77df39f640 1 -- 172.21.15.18:0/1508052366 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f77d80737e0 con 0x7f77d80ca3d0 2024-09-19T09:20:32.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.077+0000 7f77caffd640 1 -- 172.21.15.18:0/1508052366 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) ==== 80+0+5304 (secure 0 0 0) 0x7f77d00600d0 con 0x7f77d80ca3d0 2024-09-19T09:20:32.079 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:20:32.079 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:20:32.079 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_dump": [ 2024-09-19T09:20:32.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:32.079 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.a", 2024-09-19T09:20:32.079 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmDY7cHhAALxtxGq6eR3A2QXYp+nW0FA==", 2024-09-19T09:20:32.080 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:20:32.080 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:20:32.080 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:20:32.080 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:20:32.080 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:20:32.080 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:32.080 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:32.080 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:32.080 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.b", 2024-09-19T09:20:32.080 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tm9ILFKhAABEtgvzO5YBXqzYaeBZ0qZg==", 2024-09-19T09:20:32.080 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:20:32.080 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:20:32.080 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:20:32.081 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:20:32.081 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:20:32.081 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:32.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:32.081 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:32.081 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.c", 2024-09-19T09:20:32.081 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmwPkOJhAADt/0XVei2kl79pIw55wu1A==", 2024-09-19T09:20:32.081 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:20:32.081 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:20:32.081 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:20:32.081 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:20:32.081 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:20:32.081 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:32.081 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:32.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:32.082 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.d", 2024-09-19T09:20:32.082 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tm35XYMRAA/OSE5iv8M+TekEJVTARETw==", 2024-09-19T09:20:32.082 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:20:32.082 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:20:32.082 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:20:32.082 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:20:32.082 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:20:32.082 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:32.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:32.082 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:32.082 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.0", 2024-09-19T09:20:32.082 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmkUBiGhAATWtnqNPWyZJ+tnQcZOtT5A==", 2024-09-19T09:20:32.082 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:20:32.083 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:20:32.083 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:20:32.083 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:20:32.083 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:32.083 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:32.083 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:32.083 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.1", 2024-09-19T09:20:32.083 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmir5wIRAA9QumyCr8yLHtNj/YqQ1d0A==", 2024-09-19T09:20:32.083 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:20:32.083 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:20:32.083 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:20:32.083 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:20:32.083 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:32.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:32.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:32.084 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.2", 2024-09-19T09:20:32.084 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmfQJ6KBAAfTerKv1zCzFf6UfAVUikxA==", 2024-09-19T09:20:32.084 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:20:32.084 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:20:32.084 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:20:32.084 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:20:32.084 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:32.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:32.084 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:32.084 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.3", 2024-09-19T09:20:32.084 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmSeSOLxAACqCpiIQO4cDyjXUmoGPKAQ==", 2024-09-19T09:20:32.084 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:20:32.085 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:20:32.085 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:20:32.085 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:20:32.085 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:32.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:32.085 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:32.085 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.4", 2024-09-19T09:20:32.085 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmrsoFAhAArI7cRPVe/jrnSdmyE8jCsQ==", 2024-09-19T09:20:32.085 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:20:32.085 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:20:32.085 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:20:32.085 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:20:32.085 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:32.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:32.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:32.086 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.5", 2024-09-19T09:20:32.086 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmudM3CRAAXF3uI58SNJE6qtYX2wNQeQ==", 2024-09-19T09:20:32.086 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:20:32.086 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:20:32.086 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:20:32.086 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:20:32.086 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:32.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:32.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:32.086 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.6", 2024-09-19T09:20:32.086 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmqEQmEBAAm4h/8p91HwX84pl/U80Q9Q==", 2024-09-19T09:20:32.086 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:20:32.087 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:20:32.087 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:20:32.087 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:20:32.087 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:32.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:32.087 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:32.087 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.7", 2024-09-19T09:20:32.087 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmhDs0FxAAxZvRVkBoWqsdmyifRZzgwg==", 2024-09-19T09:20:32.087 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:20:32.087 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:20:32.087 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:20:32.087 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:20:32.087 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:32.087 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:32.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:32.088 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.0", 2024-09-19T09:20:32.088 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmcbwDNhAAaG0+wu96Locwws+h0zeh8Q==", 2024-09-19T09:20:32.088 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:20:32.088 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:20:32.088 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow r", 2024-09-19T09:20:32.088 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-19T09:20:32.088 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:32.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:32.088 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:32.088 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.1", 2024-09-19T09:20:32.088 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAf6+tmb4FeAxAAU+nZN/Vb33HrU0yfXmU9gA==", 2024-09-19T09:20:32.088 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:20:32.088 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:20:32.089 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-19T09:20:32.089 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-19T09:20:32.089 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-19T09:20:32.089 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:32.089 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:32.089 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:32.089 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.2", 2024-09-19T09:20:32.089 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAf6+tmc34kABAAC5b4Kkm2dJvxxyXva6PT2g==", 2024-09-19T09:20:32.089 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:20:32.089 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:20:32.089 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-19T09:20:32.089 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-19T09:20:32.089 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-19T09:20:32.089 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:32.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:32.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:32.090 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.3", 2024-09-19T09:20:32.090 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAf6+tmx4vzCBAAZ7ZrdGI2s8LqT0MjjzOCjw==", 2024-09-19T09:20:32.090 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:20:32.090 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:20:32.090 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-19T09:20:32.090 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-19T09:20:32.090 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-19T09:20:32.090 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:32.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:32.090 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:32.090 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.admin", 2024-09-19T09:20:32.090 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmZaWgAhAAx7MUazt6rS+wa/ZMSGC97Q==", 2024-09-19T09:20:32.091 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:20:32.091 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-19T09:20:32.091 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:20:32.091 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:20:32.091 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:20:32.091 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:32.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:32.091 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:32.091 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.x", 2024-09-19T09:20:32.091 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmwr6NGxAA3M5NZKkjc36L25teWJS7bQ==", 2024-09-19T09:20:32.091 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:20:32.091 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-19T09:20:32.091 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-09-19T09:20:32.092 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:20:32.092 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:32.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:20:32.092 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:32.092 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.y", 2024-09-19T09:20:32.092 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmBWOWFxAAEYKCroBhMcqoIe6WzXnNCg==", 2024-09-19T09:20:32.092 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:20:32.092 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-19T09:20:32.092 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-09-19T09:20:32.092 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:20:32.092 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:32.092 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:32.092 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:20:32.092 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:20:32.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.079+0000 7f77df39f640 1 -- 172.21.15.18:0/1508052366 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f77bc06c2b0 msgr2=0x7f77bc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:32.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.079+0000 7f77df39f640 1 --2- 172.21.15.18:0/1508052366 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f77bc06c2b0 0x7f77bc06e770 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f77d4033000 tx=0x7f77d4008030 comp rx=0 tx=0).stop 2024-09-19T09:20:32.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.079+0000 7f77df39f640 1 -- 172.21.15.18:0/1508052366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77d80ca3d0 msgr2=0x7f77d80ca860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:32.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.079+0000 7f77df39f640 1 --2- 172.21.15.18:0/1508052366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77d80ca3d0 0x7f77d80ca860 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f77d80758c0 tx=0x7f77d000e530 comp rx=0 tx=0).stop 2024-09-19T09:20:32.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.079+0000 7f77df39f640 1 -- 172.21.15.18:0/1508052366 shutdown_connections 2024-09-19T09:20:32.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.079+0000 7f77df39f640 1 --2- 172.21.15.18:0/1508052366 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f77bc06c2b0 0x7f77bc06e770 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.079+0000 7f77df39f640 1 --2- 172.21.15.18:0/1508052366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f77d80ca3d0 0x7f77d80ca860 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.079+0000 7f77df39f640 1 --2- 172.21.15.18:0/1508052366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77d80c9a10 0x7f77d8154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.079+0000 7f77df39f640 1 --2- 172.21.15.18:0/1508052366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f77c40039b0 0x7f77d81f5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.080+0000 7f77df39f640 1 -- 172.21.15.18:0/1508052366 >> 172.21.15.18:0/1508052366 conn(0x7f77d80b4330 msgr2=0x7f77d80d2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:32.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.080+0000 7f77df39f640 1 -- 172.21.15.18:0/1508052366 shutdown_connections 2024-09-19T09:20:32.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.080+0000 7f77df39f640 1 -- 172.21.15.18:0/1508052366 wait complete. 2024-09-19T09:20:32.095 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-19T09:20:32.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.195+0000 7f0c30f81640 1 Processor -- start 2024-09-19T09:20:32.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.195+0000 7f0c30f81640 1 -- start start 2024-09-19T09:20:32.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.196+0000 7f0c30f81640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0c2c15ef80 0x7f0c2c0b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:32.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.196+0000 7f0c30f81640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0c2c06d730 0x7f0c2c0cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:32.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.196+0000 7f0c30f81640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c2c0cd1a0 con 0x7f0c2c0cf910 2024-09-19T09:20:32.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.196+0000 7f0c30f81640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f0c2c0cd7d0 con 0x7f0c2c15ef80 2024-09-19T09:20:32.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.196+0000 7f0c30f81640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f0c2c06dc30 con 0x7f0c2c06d730 2024-09-19T09:20:32.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.196+0000 7f0c2a59c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0c2c15ef80 0x7f0c2c0b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:32.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.196+0000 7f0c2a59c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f0c2c15ef80 0x7f0c2c0b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33680/0 (socket says 172.21.15.18:33680) 2024-09-19T09:20:32.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.196+0000 7f0c2a59c640 1 -- 172.21.15.18:0/3375285355 learned_addr learned my addr 172.21.15.18:0/3375285355 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:32.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.196+0000 7f0c29d9b640 1 --2- 172.21.15.18:0/3375285355 >> v2:172.21.15.162:3300/0 conn(0x7f0c2c06d730 0x7f0c2c0cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:32.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.196+0000 7f0c2a59c640 1 -- 172.21.15.18:0/3375285355 >> v2:172.21.15.162:3300/0 conn(0x7f0c2c06d730 msgr2=0x7f0c2c0cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:32.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.196+0000 7f0c2a59c640 1 --2- 172.21.15.18:0/3375285355 >> v2:172.21.15.162:3300/0 conn(0x7f0c2c06d730 0x7f0c2c0cf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.196+0000 7f0c2a59c640 1 -- 172.21.15.18:0/3375285355 >> v1:172.21.15.18:6789/0 conn(0x7f0c2c0cf910 legacy=0x7f0c2c0d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:32.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.197+0000 7f0c2959a640 1 -- 172.21.15.18:0/3375285355 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2096636962 0 0) 0x7f0c2c0cd1a0 con 0x7f0c2c0cf910 2024-09-19T09:20:32.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.197+0000 7f0c2a59c640 1 -- 172.21.15.18:0/3375285355 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2c06df10 con 0x7f0c2c15ef80 2024-09-19T09:20:32.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.197+0000 7f0c2a59c640 1 --2- 172.21.15.18:0/3375285355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c2c15ef80 0x7f0c2c0b5220 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c0b57c0 tx=0x7f0c1c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60c798789cb967d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:32.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.197+0000 7f0c2959a640 1 -- 172.21.15.18:0/3375285355 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c037070 con 0x7f0c2c15ef80 2024-09-19T09:20:32.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.197+0000 7f0c2959a640 1 -- 172.21.15.18:0/3375285355 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c1c032440 con 0x7f0c2c15ef80 2024-09-19T09:20:32.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.197+0000 7f0c2959a640 1 -- 172.21.15.18:0/3375285355 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c1c032810 con 0x7f0c2c15ef80 2024-09-19T09:20:32.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.198+0000 7f0c30f81640 1 -- 172.21.15.18:0/3375285355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c2c15ef80 msgr2=0x7f0c2c0b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:32.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.198+0000 7f0c30f81640 1 --2- 172.21.15.18:0/3375285355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c2c15ef80 0x7f0c2c0b5220 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c0b57c0 tx=0x7f0c1c02a270 comp rx=0 tx=0).stop 2024-09-19T09:20:32.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.198+0000 7f0c30f81640 1 -- 172.21.15.18:0/3375285355 shutdown_connections 2024-09-19T09:20:32.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.198+0000 7f0c30f81640 1 --2- 172.21.15.18:0/3375285355 >> v2:172.21.15.162:3300/0 conn(0x7f0c2c06d730 0x7f0c2c0cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.198+0000 7f0c30f81640 1 --2- 172.21.15.18:0/3375285355 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c2c15ef80 0x7f0c2c0b5220 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.198+0000 7f0c30f81640 1 -- 172.21.15.18:0/3375285355 >> 172.21.15.18:0/3375285355 conn(0x7f0c2c0b4700 msgr2=0x7f0c2c0b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:32.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.198+0000 7f0c30f81640 1 -- 172.21.15.18:0/3375285355 shutdown_connections 2024-09-19T09:20:32.201 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.198+0000 7f0c30f81640 1 -- 172.21.15.18:0/3375285355 wait complete. 2024-09-19T09:20:32.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.199+0000 7f0c30f81640 1 Processor -- start 2024-09-19T09:20:32.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.199+0000 7f0c30f81640 1 -- start start 2024-09-19T09:20:32.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.200+0000 7f0c30f81640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c2c06d730 0x7f0c2c1581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:32.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.200+0000 7f0c30f81640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c2c0cf910 0x7f0c2c0b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:32.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.200+0000 7f0c30f81640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c2c15ef80 0x7f0c2c0b6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:32.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.200+0000 7f0c30f81640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c0d0120 con 0x7f0c2c15ef80 2024-09-19T09:20:32.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.200+0000 7f0c30f81640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f0c2c15f360 con 0x7f0c2c0cf910 2024-09-19T09:20:32.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.200+0000 7f0c30f81640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0c2c0cec70 con 0x7f0c2c06d730 2024-09-19T09:20:32.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.200+0000 7f0c2ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c2c15ef80 0x7f0c2c0b6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:32.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.200+0000 7f0c2ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c2c15ef80 0x7f0c2c0b6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33688/0 (socket says 172.21.15.18:33688) 2024-09-19T09:20:32.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.200+0000 7f0c2ad9d640 1 -- 172.21.15.18:0/1259451055 learned_addr learned my addr 172.21.15.18:0/1259451055 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:32.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.201+0000 7f0c29d9b640 1 --2- 172.21.15.18:0/1259451055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c2c0cf910 0x7f0c2c0b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:32.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.201+0000 7f0c2a59c640 1 --2- 172.21.15.18:0/1259451055 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c2c06d730 0x7f0c2c1581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.201+0000 7f0c2ad9d640 1 -- 172.21.15.18:0/1259451055 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c2c06d730 msgr2=0x7f0c2c1581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.201+0000 7f0c2ad9d640 1 --2- 172.21.15.18:0/1259451055 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c2c06d730 0x7f0c2c1581e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.201+0000 7f0c2ad9d640 1 -- 172.21.15.18:0/1259451055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c2c0cf910 msgr2=0x7f0c2c0b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.201+0000 7f0c2ad9d640 1 --2- 172.21.15.18:0/1259451055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c2c0cf910 0x7f0c2c0b6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.201+0000 7f0c2ad9d640 1 -- 172.21.15.18:0/1259451055 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c2c159380 con 0x7f0c2c15ef80 2024-09-19T09:20:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.201+0000 7f0c2ad9d640 1 --2- 172.21.15.18:0/1259451055 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c2c15ef80 0x7f0c2c0b6f90 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f0c2400c790 tx=0x7f0c2400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.201+0000 7f0c1affd640 1 -- 172.21.15.18:0/1259451055 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c24003da0 con 0x7f0c2c15ef80 2024-09-19T09:20:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.201+0000 7f0c1affd640 1 -- 172.21.15.18:0/1259451055 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c24005070 con 0x7f0c2c15ef80 2024-09-19T09:20:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.201+0000 7f0c30f81640 1 -- 172.21.15.18:0/1259451055 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c2c159660 con 0x7f0c2c15ef80 2024-09-19T09:20:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.201+0000 7f0c1affd640 1 -- 172.21.15.18:0/1259451055 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c24005460 con 0x7f0c2c15ef80 2024-09-19T09:20:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.201+0000 7f0c30f81640 1 -- 172.21.15.18:0/1259451055 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c2c159c20 con 0x7f0c2c15ef80 2024-09-19T09:20:32.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.202+0000 7f0c30f81640 1 -- 172.21.15.18:0/1259451055 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c2c0cff00 con 0x7f0c2c15ef80 2024-09-19T09:20:32.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.203+0000 7f0c1affd640 1 -- 172.21.15.18:0/1259451055 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0c24005600 con 0x7f0c2c15ef80 2024-09-19T09:20:32.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.203+0000 7f0c1affd640 1 --2- 172.21.15.18:0/1259451055 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0c0c06c2b0 0x7f0c0c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:32.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.203+0000 7f0c1affd640 1 -- 172.21.15.18:0/1259451055 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 4857+0+0 (secure 0 0 0) 0x7f0c2408afd0 con 0x7f0c2c15ef80 2024-09-19T09:20:32.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.204+0000 7f0c2a59c640 1 --2- 172.21.15.18:0/1259451055 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0c0c06c2b0 0x7f0c0c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:32.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.204+0000 7f0c2a59c640 1 --2- 172.21.15.18:0/1259451055 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0c0c06c2b0 0x7f0c0c06e770 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c034000 tx=0x7f0c1c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:32.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.208+0000 7f0c1affd640 1 -- 172.21.15.18:0/1259451055 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0c24059b20 con 0x7f0c2c15ef80 2024-09-19T09:20:32.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.386+0000 7f0c30f81640 1 -- 172.21.15.18:0/1259451055 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f0c2c15c140 con 0x7f0c2c15ef80 2024-09-19T09:20:32.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.386+0000 7f0c1affd640 1 -- 172.21.15.18:0/1259451055 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v150) ==== 84+0+65 (secure 0 0 0) 0x7f0c24059420 con 0x7f0c2c15ef80 2024-09-19T09:20:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:20:32.388 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-09-19T09:20:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:20:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 1, 2024-09-19T09:20:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": ".mgr" 2024-09-19T09:20:32.388 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:20:32.388 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-09-19T09:20:32.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.388+0000 7f0c30f81640 1 -- 172.21.15.18:0/1259451055 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0c0c06c2b0 msgr2=0x7f0c0c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:32.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.388+0000 7f0c30f81640 1 --2- 172.21.15.18:0/1259451055 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0c0c06c2b0 0x7f0c0c06e770 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0c1c034000 tx=0x7f0c1c02e000 comp rx=0 tx=0).stop 2024-09-19T09:20:32.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.388+0000 7f0c30f81640 1 -- 172.21.15.18:0/1259451055 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c2c15ef80 msgr2=0x7f0c2c0b6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:32.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.388+0000 7f0c30f81640 1 --2- 172.21.15.18:0/1259451055 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c2c15ef80 0x7f0c2c0b6f90 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f0c2400c790 tx=0x7f0c2400cc50 comp rx=0 tx=0).stop 2024-09-19T09:20:32.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.388+0000 7f0c30f81640 1 -- 172.21.15.18:0/1259451055 shutdown_connections 2024-09-19T09:20:32.390 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.388+0000 7f0c30f81640 1 --2- 172.21.15.18:0/1259451055 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f0c0c06c2b0 0x7f0c0c06e770 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.388+0000 7f0c30f81640 1 --2- 172.21.15.18:0/1259451055 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0c2c15ef80 0x7f0c2c0b6f90 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.388+0000 7f0c30f81640 1 --2- 172.21.15.18:0/1259451055 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0c2c0cf910 0x7f0c2c0b6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.388+0000 7f0c30f81640 1 --2- 172.21.15.18:0/1259451055 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0c2c06d730 0x7f0c2c1581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.388+0000 7f0c30f81640 1 -- 172.21.15.18:0/1259451055 >> 172.21.15.18:0/1259451055 conn(0x7f0c2c0b4700 msgr2=0x7f0c2c161ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:32.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.388+0000 7f0c30f81640 1 -- 172.21.15.18:0/1259451055 shutdown_connections 2024-09-19T09:20:32.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.388+0000 7f0c30f81640 1 -- 172.21.15.18:0/1259451055 wait complete. 2024-09-19T09:20:32.401 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T09:20:32.401 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T09:20:32.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.506+0000 7f7ee0817640 1 Processor -- start 2024-09-19T09:20:32.507 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.506+0000 7f7ee0817640 1 -- start start 2024-09-19T09:20:32.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.507+0000 7f7ee0817640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7edc15edb0 0x7f7edc0d29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:32.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.507+0000 7f7ee0817640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7edc0d3990 0x7f7edc0b5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:32.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.507+0000 7f7ee0817640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7edc0d0870 con 0x7f7edc0d0370 2024-09-19T09:20:32.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.507+0000 7f7ee0817640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f7edc0b4400 con 0x7f7edc0d3990 2024-09-19T09:20:32.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.507+0000 7f7ee0817640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7edc0d0b50 con 0x7f7edc15edb0 2024-09-19T09:20:32.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.507+0000 7f7edad9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7edc0d3990 0x7f7edc0b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:32.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.507+0000 7f7ed9d9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f7edc0d0370 0x7f7edc0d3280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52388/0 (socket says 172.21.15.18:52388) 2024-09-19T09:20:32.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.507+0000 7f7edad9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7edc0d3990 0x7f7edc0b5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33692/0 (socket says 172.21.15.18:33692) 2024-09-19T09:20:32.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.507+0000 7f7ed9d9b640 1 -- 172.21.15.18:0/2242562291 learned_addr learned my addr 172.21.15.18:0/2242562291 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:20:32.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.507+0000 7f7eda59c640 1 --2- 172.21.15.18:0/2242562291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7edc15edb0 0x7f7edc0d29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:32.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.507+0000 7f7edad9d640 1 -- 172.21.15.18:0/2242562291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7edc15edb0 msgr2=0x7f7edc0d29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:32.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.507+0000 7f7edad9d640 1 --2- 172.21.15.18:0/2242562291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7edc15edb0 0x7f7edc0d29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.507+0000 7f7edad9d640 1 -- 172.21.15.18:0/2242562291 >> v1:172.21.15.18:6789/0 conn(0x7f7edc0d0370 legacy=0x7f7edc0d3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:32.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.507+0000 7f7ed959a640 1 -- 172.21.15.18:0/2242562291 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 995097423 0 0) 0x7f7edc0d0870 con 0x7f7edc0d0370 2024-09-19T09:20:32.510 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.507+0000 7f7edad9d640 1 -- 172.21.15.18:0/2242562291 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7edc0b4620 con 0x7f7edc0d3990 2024-09-19T09:20:32.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.508+0000 7f7edad9d640 1 --2- 172.21.15.18:0/2242562291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7edc0d3990 0x7f7edc0b5100 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4009d90 tx=0x7f7ed402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=908aa961bcc43a7d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:32.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.508+0000 7f7ed959a640 1 -- 172.21.15.18:0/2242562291 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed4007740 con 0x7f7edc0d3990 2024-09-19T09:20:32.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.508+0000 7f7ed959a640 1 -- 172.21.15.18:0/2242562291 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ed40078e0 con 0x7f7edc0d3990 2024-09-19T09:20:32.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.508+0000 7f7ed959a640 1 -- 172.21.15.18:0/2242562291 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed4007cb0 con 0x7f7edc0d3990 2024-09-19T09:20:32.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.509+0000 7f7ee0817640 1 -- 172.21.15.18:0/2242562291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7edc0d3990 msgr2=0x7f7edc0b5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:32.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.509+0000 7f7ee0817640 1 --2- 172.21.15.18:0/2242562291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7edc0d3990 0x7f7edc0b5100 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f7ed4009d90 tx=0x7f7ed402a660 comp rx=0 tx=0).stop 2024-09-19T09:20:32.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.509+0000 7f7ee0817640 1 -- 172.21.15.18:0/2242562291 shutdown_connections 2024-09-19T09:20:32.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.509+0000 7f7ee0817640 1 --2- 172.21.15.18:0/2242562291 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7edc0d3990 0x7f7edc0b5100 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.509+0000 7f7ee0817640 1 --2- 172.21.15.18:0/2242562291 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7edc15edb0 0x7f7edc0d29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.509+0000 7f7ee0817640 1 -- 172.21.15.18:0/2242562291 >> 172.21.15.18:0/2242562291 conn(0x7f7edc09df30 msgr2=0x7f7edc0d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:32.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.509+0000 7f7ee0817640 1 -- 172.21.15.18:0/2242562291 shutdown_connections 2024-09-19T09:20:32.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.509+0000 7f7ee0817640 1 -- 172.21.15.18:0/2242562291 wait complete. 2024-09-19T09:20:32.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.510+0000 7f7ee0817640 1 Processor -- start 2024-09-19T09:20:32.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.510+0000 7f7ee0817640 1 -- start start 2024-09-19T09:20:32.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.511+0000 7f7ee0817640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7edc0d0370 0x7f7edc154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:32.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.511+0000 7f7ee0817640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7edc0d3990 0x7f7edc0cd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:32.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.511+0000 7f7ee0817640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7edc15edb0 0x7f7edc0cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:32.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.511+0000 7f7ee0817640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7edc15f190 con 0x7f7edc0d3990 2024-09-19T09:20:32.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.511+0000 7f7ee0817640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7edc0b4be0 con 0x7f7edc0d0370 2024-09-19T09:20:32.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.511+0000 7f7ee0817640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7edc0d2f20 con 0x7f7edc15edb0 2024-09-19T09:20:32.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.511+0000 7f7ed9d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7edc0d3990 0x7f7edc0cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:32.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.511+0000 7f7ed9d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7edc0d3990 0x7f7edc0cd570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33700/0 (socket says 172.21.15.18:33700) 2024-09-19T09:20:32.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.511+0000 7f7ed9d9b640 1 -- 172.21.15.18:0/3460679590 learned_addr learned my addr 172.21.15.18:0/3460679590 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:32.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.511+0000 7f7eda59c640 1 --2- 172.21.15.18:0/3460679590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7edc0d0370 0x7f7edc154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:32.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.511+0000 7f7edad9d640 1 --2- 172.21.15.18:0/3460679590 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7edc15edb0 0x7f7edc0cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:32.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.511+0000 7f7ed9d9b640 1 -- 172.21.15.18:0/3460679590 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7edc15edb0 msgr2=0x7f7edc0cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:32.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.511+0000 7f7ed9d9b640 1 --2- 172.21.15.18:0/3460679590 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7edc15edb0 0x7f7edc0cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.511+0000 7f7ed9d9b640 1 -- 172.21.15.18:0/3460679590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7edc0d0370 msgr2=0x7f7edc154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:32.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.511+0000 7f7ed9d9b640 1 --2- 172.21.15.18:0/3460679590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7edc0d0370 0x7f7edc154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:32.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.511+0000 7f7ed9d9b640 1 -- 172.21.15.18:0/3460679590 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7edc0ccd60 con 0x7f7edc0d3990 2024-09-19T09:20:32.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.511+0000 7f7edad9d640 1 --2- 172.21.15.18:0/3460679590 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7edc15edb0 0x7f7edc0cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:32.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.511+0000 7f7ed9d9b640 1 --2- 172.21.15.18:0/3460679590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7edc0d3990 0x7f7edc0cd570 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f7ed000c3e0 tx=0x7f7ed000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:32.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.512+0000 7f7ecaffd640 1 -- 172.21.15.18:0/3460679590 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed00074e0 con 0x7f7edc0d3990 2024-09-19T09:20:32.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.512+0000 7f7ecaffd640 1 -- 172.21.15.18:0/3460679590 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ed00047e0 con 0x7f7edc0d3990 2024-09-19T09:20:32.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.512+0000 7f7ee0817640 1 -- 172.21.15.18:0/3460679590 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7edc0cca80 con 0x7f7edc0d3990 2024-09-19T09:20:32.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.512+0000 7f7ecaffd640 1 -- 172.21.15.18:0/3460679590 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed0004bd0 con 0x7f7edc0d3990 2024-09-19T09:20:32.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.512+0000 7f7ee0817640 1 -- 172.21.15.18:0/3460679590 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7edc0b7e70 con 0x7f7edc0d3990 2024-09-19T09:20:32.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.513+0000 7f7ee0817640 1 -- 172.21.15.18:0/3460679590 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7edc0d29e0 con 0x7f7edc0d3990 2024-09-19T09:20:32.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.513+0000 7f7ecaffd640 1 -- 172.21.15.18:0/3460679590 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7ed0011070 con 0x7f7edc0d3990 2024-09-19T09:20:32.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.514+0000 7f7ecaffd640 1 --2- 172.21.15.18:0/3460679590 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7ebc06c2b0 0x7f7ebc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:32.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.514+0000 7f7ecaffd640 1 -- 172.21.15.18:0/3460679590 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 4857+0+0 (secure 0 0 0) 0x7f7ed008ac20 con 0x7f7edc0d3990 2024-09-19T09:20:32.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.514+0000 7f7eda59c640 1 --2- 172.21.15.18:0/3460679590 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7ebc06c2b0 0x7f7ebc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:32.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.514+0000 7f7eda59c640 1 --2- 172.21.15.18:0/3460679590 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7ebc06c2b0 0x7f7ebc06e770 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc009b40 tx=0x7f7ecc009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:32.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.518+0000 7f7ecaffd640 1 -- 172.21.15.18:0/3460679590 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7ed00596e0 con 0x7f7edc0d3990 2024-09-19T09:20:32.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:32.697+0000 7f7ee0817640 1 -- 172.21.15.18:0/3460679590 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f7edc154570 con 0x7f7edc0d3990 2024-09-19T09:20:33.256 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-09-19T09:20:33.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.698+0000 7f7ecaffd640 1 -- 172.21.15.18:0/3460679590 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v151) ==== 138+0+0 (secure 0 0 0) 0x7f7ed0058fe0 con 0x7f7edc0d3990 2024-09-19T09:20:33.700 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' created 2024-09-19T09:20:33.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.702+0000 7f7ee0817640 1 -- 172.21.15.18:0/3460679590 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7ebc06c2b0 msgr2=0x7f7ebc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:33.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.702+0000 7f7ee0817640 1 --2- 172.21.15.18:0/3460679590 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7ebc06c2b0 0x7f7ebc06e770 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc009b40 tx=0x7f7ecc009190 comp rx=0 tx=0).stop 2024-09-19T09:20:33.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.702+0000 7f7ee0817640 1 -- 172.21.15.18:0/3460679590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7edc0d3990 msgr2=0x7f7edc0cd570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:33.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.702+0000 7f7ee0817640 1 --2- 172.21.15.18:0/3460679590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7edc0d3990 0x7f7edc0cd570 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f7ed000c3e0 tx=0x7f7ed000c8a0 comp rx=0 tx=0).stop 2024-09-19T09:20:33.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.702+0000 7f7ee0817640 1 -- 172.21.15.18:0/3460679590 shutdown_connections 2024-09-19T09:20:33.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.702+0000 7f7ee0817640 1 --2- 172.21.15.18:0/3460679590 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7ebc06c2b0 0x7f7ebc06e770 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:33.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.702+0000 7f7ee0817640 1 --2- 172.21.15.18:0/3460679590 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7edc15edb0 0x7f7edc0cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:33.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.702+0000 7f7ee0817640 1 --2- 172.21.15.18:0/3460679590 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7edc0d3990 0x7f7edc0cd570 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:33.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.702+0000 7f7ee0817640 1 --2- 172.21.15.18:0/3460679590 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7edc0d0370 0x7f7edc154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:33.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.702+0000 7f7ee0817640 1 -- 172.21.15.18:0/3460679590 >> 172.21.15.18:0/3460679590 conn(0x7f7edc09df30 msgr2=0x7f7edc0cb550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:33.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.703+0000 7f7ee0817640 1 -- 172.21.15.18:0/3460679590 shutdown_connections 2024-09-19T09:20:33.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.703+0000 7f7ee0817640 1 -- 172.21.15.18:0/3460679590 wait complete. 2024-09-19T09:20:33.718 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T09:20:33.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.832+0000 7f8c7834b640 1 Processor -- start 2024-09-19T09:20:33.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.832+0000 7f8c7834b640 1 -- start start 2024-09-19T09:20:33.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.833+0000 7f8c7834b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8c701623c0 0x7f8c700b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:33.835 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.833+0000 7f8c7834b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c700d56b0 0x7f8c700d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:33.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.833+0000 7f8c7834b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c700d3700 con 0x7f8c700d0a50 2024-09-19T09:20:33.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.833+0000 7f8c7834b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f8c700d21a0 con 0x7f8c701623c0 2024-09-19T09:20:33.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.833+0000 7f8c7834b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8c700d0080 con 0x7f8c700d56b0 2024-09-19T09:20:33.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.833+0000 7f8c760e7640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8c701623c0 0x7f8c700b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:33.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.833+0000 7f8c760e7640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8c701623c0 0x7f8c700b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33708/0 (socket says 172.21.15.18:33708) 2024-09-19T09:20:33.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.833+0000 7f8c760e7640 1 -- 172.21.15.18:0/4164731484 learned_addr learned my addr 172.21.15.18:0/4164731484 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:33.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.833+0000 7f8c768e8640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f8c700d0a50 0x7f8c700d1470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52394/0 (socket says 172.21.15.18:52394) 2024-09-19T09:20:33.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.834+0000 7f8c760e7640 1 -- 172.21.15.18:0/4164731484 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c700d56b0 msgr2=0x7f8c700d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:33.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.834+0000 7f8c760e7640 1 --2- 172.21.15.18:0/4164731484 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c700d56b0 0x7f8c700d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:33.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.834+0000 7f8c760e7640 1 -- 172.21.15.18:0/4164731484 >> v1:172.21.15.18:6789/0 conn(0x7f8c700d0a50 legacy=0x7f8c700d1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:33.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.834+0000 7f8c760e7640 1 -- 172.21.15.18:0/4164731484 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c700cfa70 con 0x7f8c701623c0 2024-09-19T09:20:33.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.834+0000 7f8c750e5640 1 -- 172.21.15.18:0/4164731484 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2840143077 0 0) 0x7f8c700d3700 con 0x7f8c700d0a50 2024-09-19T09:20:33.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.834+0000 7f8c760e7640 1 --2- 172.21.15.18:0/4164731484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c701623c0 0x7f8c700b6260 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f8c68009870 tx=0x7f8c6802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63debdb4d977e25c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:33.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.835+0000 7f8c750e5640 1 -- 172.21.15.18:0/4164731484 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c68037070 con 0x7f8c701623c0 2024-09-19T09:20:33.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.835+0000 7f8c750e5640 1 -- 172.21.15.18:0/4164731484 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c68032440 con 0x7f8c701623c0 2024-09-19T09:20:33.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.835+0000 7f8c750e5640 1 -- 172.21.15.18:0/4164731484 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c68032810 con 0x7f8c701623c0 2024-09-19T09:20:33.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.835+0000 7f8c7834b640 1 -- 172.21.15.18:0/4164731484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c701623c0 msgr2=0x7f8c700b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:33.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.835+0000 7f8c7834b640 1 --2- 172.21.15.18:0/4164731484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c701623c0 0x7f8c700b6260 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f8c68009870 tx=0x7f8c6802a270 comp rx=0 tx=0).stop 2024-09-19T09:20:33.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.835+0000 7f8c7834b640 1 -- 172.21.15.18:0/4164731484 shutdown_connections 2024-09-19T09:20:33.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.835+0000 7f8c7834b640 1 --2- 172.21.15.18:0/4164731484 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c700d56b0 0x7f8c700d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:33.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.835+0000 7f8c7834b640 1 --2- 172.21.15.18:0/4164731484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c701623c0 0x7f8c700b6260 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:33.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.835+0000 7f8c7834b640 1 -- 172.21.15.18:0/4164731484 >> 172.21.15.18:0/4164731484 conn(0x7f8c7009df30 msgr2=0x7f8c700d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:33.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.835+0000 7f8c7834b640 1 -- 172.21.15.18:0/4164731484 shutdown_connections 2024-09-19T09:20:33.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.835+0000 7f8c7834b640 1 -- 172.21.15.18:0/4164731484 wait complete. 2024-09-19T09:20:33.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.837+0000 7f8c7834b640 1 Processor -- start 2024-09-19T09:20:33.840 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.837+0000 7f8c7834b640 1 -- start start 2024-09-19T09:20:33.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.837+0000 7f8c7834b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c700d56b0 0x7f8c700cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:33.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.837+0000 7f8c7834b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c701623c0 0x7f8c700b9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:33.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.837+0000 7f8c7834b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c70157fd0 0x7f8c700c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:33.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.837+0000 7f8c7834b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8c701627a0 con 0x7f8c70157fd0 2024-09-19T09:20:33.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.837+0000 7f8c7834b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8c700cfd10 con 0x7f8c701623c0 2024-09-19T09:20:33.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.837+0000 7f8c7834b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8c700d3c80 con 0x7f8c700d56b0 2024-09-19T09:20:33.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.838+0000 7f8c768e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c70157fd0 0x7f8c700c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:33.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.838+0000 7f8c768e8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c70157fd0 0x7f8c700c8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33710/0 (socket says 172.21.15.18:33710) 2024-09-19T09:20:33.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.838+0000 7f8c768e8640 1 -- 172.21.15.18:0/1672409363 learned_addr learned my addr 172.21.15.18:0/1672409363 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:33.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.838+0000 7f8c760e7640 1 --2- 172.21.15.18:0/1672409363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c700d56b0 0x7f8c700cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:33.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.838+0000 7f8c758e6640 1 --2- 172.21.15.18:0/1672409363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c701623c0 0x7f8c700b9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:33.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.838+0000 7f8c768e8640 1 -- 172.21.15.18:0/1672409363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c700d56b0 msgr2=0x7f8c700cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:33.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.838+0000 7f8c768e8640 1 --2- 172.21.15.18:0/1672409363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c700d56b0 0x7f8c700cb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:33.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.838+0000 7f8c768e8640 1 -- 172.21.15.18:0/1672409363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c701623c0 msgr2=0x7f8c700b9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:33.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.838+0000 7f8c768e8640 1 --2- 172.21.15.18:0/1672409363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c701623c0 0x7f8c700b9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:33.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.838+0000 7f8c768e8640 1 -- 172.21.15.18:0/1672409363 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c700c9f10 con 0x7f8c70157fd0 2024-09-19T09:20:33.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.838+0000 7f8c758e6640 1 --2- 172.21.15.18:0/1672409363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c701623c0 0x7f8c700b9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:33.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.838+0000 7f8c768e8640 1 --2- 172.21.15.18:0/1672409363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c70157fd0 0x7f8c700c8a90 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f8c6000c780 tx=0x7f8c6000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:33.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.838+0000 7f8c6effd640 1 -- 172.21.15.18:0/1672409363 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c60018070 con 0x7f8c70157fd0 2024-09-19T09:20:33.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.838+0000 7f8c6effd640 1 -- 172.21.15.18:0/1672409363 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c6000a640 con 0x7f8c70157fd0 2024-09-19T09:20:33.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.838+0000 7f8c7834b640 1 -- 172.21.15.18:0/1672409363 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c700c8fd0 con 0x7f8c70157fd0 2024-09-19T09:20:33.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.838+0000 7f8c6effd640 1 -- 172.21.15.18:0/1672409363 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6000aab0 con 0x7f8c70157fd0 2024-09-19T09:20:33.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.838+0000 7f8c7834b640 1 -- 172.21.15.18:0/1672409363 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c700b9490 con 0x7f8c70157fd0 2024-09-19T09:20:33.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.839+0000 7f8c7834b640 1 -- 172.21.15.18:0/1672409363 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c700d2340 con 0x7f8c70157fd0 2024-09-19T09:20:33.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.840+0000 7f8c6effd640 1 -- 172.21.15.18:0/1672409363 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8c6001b070 con 0x7f8c70157fd0 2024-09-19T09:20:33.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.840+0000 7f8c6effd640 1 --2- 172.21.15.18:0/1672409363 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8c5c06c2b0 0x7f8c5c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:33.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.841+0000 7f8c6effd640 1 -- 172.21.15.18:0/1672409363 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5227+0+0 (secure 0 0 0) 0x7f8c6008a800 con 0x7f8c70157fd0 2024-09-19T09:20:33.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.841+0000 7f8c760e7640 1 --2- 172.21.15.18:0/1672409363 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8c5c06c2b0 0x7f8c5c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:33.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.842+0000 7f8c760e7640 1 --2- 172.21.15.18:0/1672409363 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8c5c06c2b0 0x7f8c5c06e770 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f8c68034000 tx=0x7f8c6802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:33.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:33.845+0000 7f8c6effd640 1 -- 172.21.15.18:0/1672409363 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8c60059140 con 0x7f8c70157fd0 2024-09-19T09:20:34.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.020+0000 7f8c7834b640 1 -- 172.21.15.18:0/1672409363 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f8c700d04f0 con 0x7f8c70157fd0 2024-09-19T09:20:34.702 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.700+0000 7f8c6effd640 1 -- 172.21.15.18:0/1672409363 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v152) ==== 170+0+0 (secure 0 0 0) 0x7f8c60058a40 con 0x7f8c70157fd0 2024-09-19T09:20:34.702 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' created 2024-09-19T09:20:34.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.704+0000 7f8c7834b640 1 -- 172.21.15.18:0/1672409363 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8c5c06c2b0 msgr2=0x7f8c5c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:34.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.704+0000 7f8c7834b640 1 --2- 172.21.15.18:0/1672409363 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8c5c06c2b0 0x7f8c5c06e770 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f8c68034000 tx=0x7f8c6802e000 comp rx=0 tx=0).stop 2024-09-19T09:20:34.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.704+0000 7f8c7834b640 1 -- 172.21.15.18:0/1672409363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c70157fd0 msgr2=0x7f8c700c8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:34.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.704+0000 7f8c7834b640 1 --2- 172.21.15.18:0/1672409363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c70157fd0 0x7f8c700c8a90 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f8c6000c780 tx=0x7f8c6000cc40 comp rx=0 tx=0).stop 2024-09-19T09:20:34.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.708+0000 7f8c7834b640 1 -- 172.21.15.18:0/1672409363 shutdown_connections 2024-09-19T09:20:34.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.708+0000 7f8c7834b640 1 --2- 172.21.15.18:0/1672409363 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8c5c06c2b0 0x7f8c5c06e770 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.708+0000 7f8c7834b640 1 --2- 172.21.15.18:0/1672409363 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c70157fd0 0x7f8c700c8a90 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.708+0000 7f8c7834b640 1 --2- 172.21.15.18:0/1672409363 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c701623c0 0x7f8c700b9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.708+0000 7f8c7834b640 1 --2- 172.21.15.18:0/1672409363 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c700d56b0 0x7f8c700cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.708+0000 7f8c7834b640 1 -- 172.21.15.18:0/1672409363 >> 172.21.15.18:0/1672409363 conn(0x7f8c7009df30 msgr2=0x7f8c700b6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:34.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.714+0000 7f8c7834b640 1 -- 172.21.15.18:0/1672409363 shutdown_connections 2024-09-19T09:20:34.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.715+0000 7f8c7834b640 1 -- 172.21.15.18:0/1672409363 wait complete. 2024-09-19T09:20:34.731 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T09:20:34.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.840+0000 7faf4229b640 1 Processor -- start 2024-09-19T09:20:34.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.840+0000 7faf4229b640 1 -- start start 2024-09-19T09:20:34.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.841+0000 7faf4229b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7faf3c15a670 0x7faf3c15dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.841+0000 7faf4229b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf3c0b5970 0x7faf3c0b6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.841+0000 7faf4229b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf3c15aa50 con 0x7faf3c0b69c0 2024-09-19T09:20:34.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.841+0000 7faf4229b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7faf3c0b6150 con 0x7faf3c15a670 2024-09-19T09:20:34.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.841+0000 7faf4229b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faf3c15e310 con 0x7faf3c0b5970 2024-09-19T09:20:34.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.841+0000 7faf3bfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7faf3c15a670 0x7faf3c15dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.841+0000 7faf40838640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7faf3c0b69c0 0x7faf3c160610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:52410/0 (socket says 172.21.15.18:52410) 2024-09-19T09:20:34.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.841+0000 7faf40838640 1 -- 172.21.15.18:0/4226122211 learned_addr learned my addr 172.21.15.18:0/4226122211 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:20:34.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.841+0000 7faf3bfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7faf3c15a670 0x7faf3c15dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33718/0 (socket says 172.21.15.18:33718) 2024-09-19T09:20:34.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.841+0000 7faf3b7fe640 1 --2- 172.21.15.18:0/4226122211 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf3c0b5970 0x7faf3c0b6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.841+0000 7faf3bfff640 1 -- 172.21.15.18:0/4226122211 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf3c0b5970 msgr2=0x7faf3c0b6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:34.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.841+0000 7faf3bfff640 1 --2- 172.21.15.18:0/4226122211 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf3c0b5970 0x7faf3c0b6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.841+0000 7faf3bfff640 1 -- 172.21.15.18:0/4226122211 >> v1:172.21.15.18:6789/0 conn(0x7faf3c0b69c0 legacy=0x7faf3c160610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:34.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.841+0000 7faf3bfff640 1 -- 172.21.15.18:0/4226122211 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf3c15e5f0 con 0x7faf3c15a670 2024-09-19T09:20:34.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.841+0000 7faf3affd640 1 -- 172.21.15.18:0/4226122211 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2452601619 0 0) 0x7faf3c15aa50 con 0x7faf3c0b69c0 2024-09-19T09:20:34.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.842+0000 7faf3bfff640 1 --2- 172.21.15.18:0/4226122211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf3c15a670 0x7faf3c15dc30 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7faf2c0097a0 tx=0x7faf2c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89ea7cdedbeac4b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:34.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.842+0000 7faf3affd640 1 -- 172.21.15.18:0/4226122211 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2c037070 con 0x7faf3c15a670 2024-09-19T09:20:34.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.842+0000 7faf3affd640 1 -- 172.21.15.18:0/4226122211 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf2c02ae50 con 0x7faf3c15a670 2024-09-19T09:20:34.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.842+0000 7faf3affd640 1 -- 172.21.15.18:0/4226122211 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2c032660 con 0x7faf3c15a670 2024-09-19T09:20:34.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.843+0000 7faf4229b640 1 -- 172.21.15.18:0/4226122211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf3c15a670 msgr2=0x7faf3c15dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:34.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.843+0000 7faf4229b640 1 --2- 172.21.15.18:0/4226122211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf3c15a670 0x7faf3c15dc30 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7faf2c0097a0 tx=0x7faf2c02a100 comp rx=0 tx=0).stop 2024-09-19T09:20:34.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.843+0000 7faf4229b640 1 -- 172.21.15.18:0/4226122211 shutdown_connections 2024-09-19T09:20:34.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.843+0000 7faf4229b640 1 --2- 172.21.15.18:0/4226122211 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf3c0b5970 0x7faf3c0b6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.843+0000 7faf4229b640 1 --2- 172.21.15.18:0/4226122211 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf3c15a670 0x7faf3c15dc30 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.843+0000 7faf4229b640 1 -- 172.21.15.18:0/4226122211 >> 172.21.15.18:0/4226122211 conn(0x7faf3c09b9d0 msgr2=0x7faf3c09bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:34.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.843+0000 7faf4229b640 1 -- 172.21.15.18:0/4226122211 shutdown_connections 2024-09-19T09:20:34.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.843+0000 7faf4229b640 1 -- 172.21.15.18:0/4226122211 wait complete. 2024-09-19T09:20:34.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.844+0000 7faf4229b640 1 Processor -- start 2024-09-19T09:20:34.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.844+0000 7faf4229b640 1 -- start start 2024-09-19T09:20:34.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.845+0000 7faf4229b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf3c0b5970 0x7faf3c1f2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.845+0000 7faf4229b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf3c0b69c0 0x7faf3c148020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.845+0000 7faf4229b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf3c15a670 0x7faf3c148560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.845+0000 7faf4229b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faf3c1600e0 con 0x7faf3c0b69c0 2024-09-19T09:20:34.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.845+0000 7faf4229b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faf3c0b5dd0 con 0x7faf3c15a670 2024-09-19T09:20:34.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.845+0000 7faf4229b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faf3c160260 con 0x7faf3c0b5970 2024-09-19T09:20:34.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.845+0000 7faf3b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf3c0b69c0 0x7faf3c148020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.845+0000 7faf3b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf3c0b69c0 0x7faf3c148020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:33732/0 (socket says 172.21.15.18:33732) 2024-09-19T09:20:34.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.845+0000 7faf3b7fe640 1 -- 172.21.15.18:0/2554667082 learned_addr learned my addr 172.21.15.18:0/2554667082 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:34.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.845+0000 7faf3bfff640 1 --2- 172.21.15.18:0/2554667082 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf3c0b5970 0x7faf3c1f2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.845+0000 7faf40838640 1 --2- 172.21.15.18:0/2554667082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf3c15a670 0x7faf3c148560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.845+0000 7faf3b7fe640 1 -- 172.21.15.18:0/2554667082 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf3c0b5970 msgr2=0x7faf3c1f2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.845+0000 7faf3b7fe640 1 --2- 172.21.15.18:0/2554667082 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf3c0b5970 0x7faf3c1f2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.845+0000 7faf3b7fe640 1 -- 172.21.15.18:0/2554667082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf3c15a670 msgr2=0x7faf3c148560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.845+0000 7faf3b7fe640 1 --2- 172.21.15.18:0/2554667082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf3c15a670 0x7faf3c148560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.845+0000 7faf3b7fe640 1 -- 172.21.15.18:0/2554667082 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf3c09d0e0 con 0x7faf3c0b69c0 2024-09-19T09:20:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.846+0000 7faf3b7fe640 1 --2- 172.21.15.18:0/2554667082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf3c0b69c0 0x7faf3c148020 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7faf3000d5d0 tx=0x7faf3000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.846+0000 7faf38ff9640 1 -- 172.21.15.18:0/2554667082 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf30004240 con 0x7faf3c0b69c0 2024-09-19T09:20:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.846+0000 7faf38ff9640 1 -- 172.21.15.18:0/2554667082 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf300043e0 con 0x7faf3c0b69c0 2024-09-19T09:20:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.846+0000 7faf4229b640 1 -- 172.21.15.18:0/2554667082 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf3c09d3c0 con 0x7faf3c0b69c0 2024-09-19T09:20:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.846+0000 7faf38ff9640 1 -- 172.21.15.18:0/2554667082 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf30003830 con 0x7faf3c0b69c0 2024-09-19T09:20:34.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.846+0000 7faf4229b640 1 -- 172.21.15.18:0/2554667082 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf3c09dc60 con 0x7faf3c0b69c0 2024-09-19T09:20:34.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.847+0000 7faf4229b640 1 -- 172.21.15.18:0/2554667082 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf3c0b6480 con 0x7faf3c0b69c0 2024-09-19T09:20:34.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.848+0000 7faf38ff9640 1 -- 172.21.15.18:0/2554667082 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7faf300039d0 con 0x7faf3c0b69c0 2024-09-19T09:20:34.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.848+0000 7faf38ff9640 1 --2- 172.21.15.18:0/2554667082 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faf2806c2b0 0x7faf2806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:34.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.848+0000 7faf38ff9640 1 -- 172.21.15.18:0/2554667082 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5609+0+0 (secure 0 0 0) 0x7faf3008b630 con 0x7faf3c0b69c0 2024-09-19T09:20:34.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.848+0000 7faf3bfff640 1 --2- 172.21.15.18:0/2554667082 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faf2806c2b0 0x7faf2806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:34.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.849+0000 7faf3bfff640 1 --2- 172.21.15.18:0/2554667082 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faf2806c2b0 0x7faf2806e770 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7faf2c034000 tx=0x7faf2c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:34.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:34.853+0000 7faf38ff9640 1 -- 172.21.15.18:0/2554667082 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7faf30059720 con 0x7faf3c0b69c0 2024-09-19T09:20:35.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.065+0000 7faf4229b640 1 -- 172.21.15.18:0/2554667082 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7faf3c09c5f0 con 0x7faf3c0b69c0 2024-09-19T09:20:35.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.720+0000 7faf38ff9640 1 -- 172.21.15.18:0/2554667082 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v62) ==== 174+0+0 (secure 0 0 0) 0x7faf3005da20 con 0x7faf3c0b69c0 2024-09-19T09:20:35.722 INFO:teuthology.orchestra.run.smithi018.stderr:new fs with metadata pool 18 and data pool 19 2024-09-19T09:20:35.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.731+0000 7faf4229b640 1 -- 172.21.15.18:0/2554667082 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faf2806c2b0 msgr2=0x7faf2806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:35.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.731+0000 7faf4229b640 1 --2- 172.21.15.18:0/2554667082 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faf2806c2b0 0x7faf2806e770 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7faf2c034000 tx=0x7faf2c02e000 comp rx=0 tx=0).stop 2024-09-19T09:20:35.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.732+0000 7faf4229b640 1 -- 172.21.15.18:0/2554667082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf3c0b69c0 msgr2=0x7faf3c148020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:35.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.732+0000 7faf4229b640 1 --2- 172.21.15.18:0/2554667082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf3c0b69c0 0x7faf3c148020 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7faf3000d5d0 tx=0x7faf3000da90 comp rx=0 tx=0).stop 2024-09-19T09:20:35.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.734+0000 7faf4229b640 1 -- 172.21.15.18:0/2554667082 shutdown_connections 2024-09-19T09:20:35.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.734+0000 7faf4229b640 1 --2- 172.21.15.18:0/2554667082 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faf2806c2b0 0x7faf2806e770 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:35.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.734+0000 7faf4229b640 1 --2- 172.21.15.18:0/2554667082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faf3c15a670 0x7faf3c148560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:35.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.734+0000 7faf4229b640 1 --2- 172.21.15.18:0/2554667082 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faf3c0b69c0 0x7faf3c148020 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:35.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.734+0000 7faf4229b640 1 --2- 172.21.15.18:0/2554667082 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faf3c0b5970 0x7faf3c1f2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:35.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.734+0000 7faf4229b640 1 -- 172.21.15.18:0/2554667082 >> 172.21.15.18:0/2554667082 conn(0x7faf3c09b9d0 msgr2=0x7faf3c070840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:35.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.736+0000 7faf4229b640 1 -- 172.21.15.18:0/2554667082 shutdown_connections 2024-09-19T09:20:35.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.737+0000 7faf4229b640 1 -- 172.21.15.18:0/2554667082 wait complete. 2024-09-19T09:20:35.755 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:20:35.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.861+0000 7f804fe77640 1 Processor -- start 2024-09-19T09:20:35.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.861+0000 7f804fe77640 1 -- start start 2024-09-19T09:20:35.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.862+0000 7f804fe77640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80480b5200 0x7f80481629e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:35.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.862+0000 7f804fe77640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8048162f20 0x7f80480cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:35.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.862+0000 7f804fe77640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80480d0a10 con 0x7f804815ed30 2024-09-19T09:20:35.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.862+0000 7f804fe77640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8048070ab0 con 0x7f8048162f20 2024-09-19T09:20:35.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.862+0000 7f804fe77640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f80480d0cb0 con 0x7f80480b5200 2024-09-19T09:20:35.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.862+0000 7f804d412640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80480b5200 0x7f80481629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:35.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.862+0000 7f804dc13640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f804815ed30 0x7f8048070260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:49876/0 (socket says 172.21.15.18:49876) 2024-09-19T09:20:35.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.862+0000 7f804dc13640 1 -- 172.21.15.18:0/2779565803 learned_addr learned my addr 172.21.15.18:0/2779565803 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:20:35.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.862+0000 7f804e414640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8048162f20 0x7f80480cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:35.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.862+0000 7f804d412640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80480b5200 0x7f80481629e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:37526/0 (socket says 172.21.15.18:37526) 2024-09-19T09:20:35.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.862+0000 7f804d412640 1 -- 172.21.15.18:0/2779565803 >> v2:172.21.15.162:3300/0 conn(0x7f8048162f20 msgr2=0x7f80480cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:35.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.862+0000 7f804d412640 1 --2- 172.21.15.18:0/2779565803 >> v2:172.21.15.162:3300/0 conn(0x7f8048162f20 0x7f80480cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:35.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.862+0000 7f804d412640 1 -- 172.21.15.18:0/2779565803 >> v1:172.21.15.162:6789/0 conn(0x7f804815ed30 legacy=0x7f8048070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:35.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.862+0000 7f804d412640 1 -- 172.21.15.18:0/2779565803 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80480d0f90 con 0x7f80480b5200 2024-09-19T09:20:35.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.862+0000 7f804e414640 1 --2- 172.21.15.18:0/2779565803 >> v2:172.21.15.162:3300/0 conn(0x7f8048162f20 0x7f80480cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:35.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.863+0000 7f804d412640 1 --2- 172.21.15.18:0/2779565803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80480b5200 0x7f80481629e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f80380097a0 tx=0x7f803802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48d583bd50231cf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:35.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.863+0000 7f804cc11640 1 -- 172.21.15.18:0/2779565803 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8038037070 con 0x7f80480b5200 2024-09-19T09:20:35.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.863+0000 7f804cc11640 1 -- 172.21.15.18:0/2779565803 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8038032440 con 0x7f80480b5200 2024-09-19T09:20:35.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.863+0000 7f804cc11640 1 -- 172.21.15.18:0/2779565803 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8038032810 con 0x7f80480b5200 2024-09-19T09:20:35.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.864+0000 7f804fe77640 1 -- 172.21.15.18:0/2779565803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80480b5200 msgr2=0x7f80481629e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:35.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.864+0000 7f804fe77640 1 --2- 172.21.15.18:0/2779565803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80480b5200 0x7f80481629e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f80380097a0 tx=0x7f803802a210 comp rx=0 tx=0).stop 2024-09-19T09:20:35.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.864+0000 7f804fe77640 1 -- 172.21.15.18:0/2779565803 shutdown_connections 2024-09-19T09:20:35.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.864+0000 7f804fe77640 1 --2- 172.21.15.18:0/2779565803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80480b5200 0x7f80481629e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:35.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.864+0000 7f804fe77640 1 --2- 172.21.15.18:0/2779565803 >> v2:172.21.15.162:3300/0 conn(0x7f8048162f20 0x7f80480cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:35.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.864+0000 7f804fe77640 1 -- 172.21.15.18:0/2779565803 >> 172.21.15.18:0/2779565803 conn(0x7f80480b4600 msgr2=0x7f80480b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:35.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.864+0000 7f804fe77640 1 -- 172.21.15.18:0/2779565803 shutdown_connections 2024-09-19T09:20:35.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.864+0000 7f804fe77640 1 -- 172.21.15.18:0/2779565803 wait complete. 2024-09-19T09:20:35.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.865+0000 7f804fe77640 1 Processor -- start 2024-09-19T09:20:35.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.865+0000 7f804fe77640 1 -- start start 2024-09-19T09:20:35.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.866+0000 7f804fe77640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80480b5200 0x7f80480c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:35.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.866+0000 7f804fe77640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f804815ed30 0x7f80481e9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:35.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.866+0000 7f804fe77640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8048162f20 0x7f80481e9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:35.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.866+0000 7f804fe77640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f804815f290 con 0x7f804815ed30 2024-09-19T09:20:35.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.866+0000 7f804fe77640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f804815f110 con 0x7f80480b5200 2024-09-19T09:20:35.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.866+0000 7f804fe77640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f80480cf720 con 0x7f8048162f20 2024-09-19T09:20:35.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.866+0000 7f804d412640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f804815ed30 0x7f80481e9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:35.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.866+0000 7f804d412640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f804815ed30 0x7f80481e9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53102/0 (socket says 172.21.15.18:53102) 2024-09-19T09:20:35.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.866+0000 7f804dc13640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80480b5200 0x7f80480c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:35.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.866+0000 7f804d412640 1 -- 172.21.15.18:0/1774793683 learned_addr learned my addr 172.21.15.18:0/1774793683 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:35.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.866+0000 7f804e414640 1 --2- 172.21.15.18:0/1774793683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8048162f20 0x7f80481e9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:35.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.866+0000 7f804d412640 1 -- 172.21.15.18:0/1774793683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8048162f20 msgr2=0x7f80481e9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:35.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.866+0000 7f804d412640 1 --2- 172.21.15.18:0/1774793683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8048162f20 0x7f80481e9360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:35.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.867+0000 7f804d412640 1 -- 172.21.15.18:0/1774793683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80480b5200 msgr2=0x7f80480c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:35.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.867+0000 7f804d412640 1 --2- 172.21.15.18:0/1774793683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80480b5200 0x7f80480c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:35.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.867+0000 7f804d412640 1 -- 172.21.15.18:0/1774793683 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80481e98a0 con 0x7f804815ed30 2024-09-19T09:20:35.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.867+0000 7f804dc13640 1 --2- 172.21.15.18:0/1774793683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80480b5200 0x7f80480c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:35.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.867+0000 7f804d412640 1 --2- 172.21.15.18:0/1774793683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f804815ed30 0x7f80481e9ae0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f8038000c00 tx=0x7f80380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:35.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.867+0000 7f803e7fc640 1 -- 172.21.15.18:0/1774793683 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8038041070 con 0x7f804815ed30 2024-09-19T09:20:35.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.867+0000 7f803e7fc640 1 -- 172.21.15.18:0/1774793683 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f803803c870 con 0x7f804815ed30 2024-09-19T09:20:35.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.867+0000 7f804fe77640 1 -- 172.21.15.18:0/1774793683 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80481ea250 con 0x7f804815ed30 2024-09-19T09:20:35.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.867+0000 7f803e7fc640 1 -- 172.21.15.18:0/1774793683 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8038037040 con 0x7f804815ed30 2024-09-19T09:20:35.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.867+0000 7f804fe77640 1 -- 172.21.15.18:0/1774793683 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80481e8b60 con 0x7f804815ed30 2024-09-19T09:20:35.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.868+0000 7f804fe77640 1 -- 172.21.15.18:0/1774793683 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80480cf1e0 con 0x7f804815ed30 2024-09-19T09:20:35.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.868+0000 7f803e7fc640 1 -- 172.21.15.18:0/1774793683 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8038044070 con 0x7f804815ed30 2024-09-19T09:20:35.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.869+0000 7f803e7fc640 1 --2- 172.21.15.18:0/1774793683 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f802c06c2b0 0x7f802c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:35.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.869+0000 7f803e7fc640 1 -- 172.21.15.18:0/1774793683 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f80380abf20 con 0x7f804815ed30 2024-09-19T09:20:35.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.869+0000 7f804dc13640 1 --2- 172.21.15.18:0/1774793683 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f802c06c2b0 0x7f802c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:35.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.870+0000 7f804dc13640 1 --2- 172.21.15.18:0/1774793683 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f802c06c2b0 0x7f802c06e770 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f804806e8b0 tx=0x7f8044009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:35.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:35.873+0000 7f803e7fc640 1 -- 172.21.15.18:0/1774793683 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f803807a0c0 con 0x7f804815ed30 2024-09-19T09:20:36.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.052+0000 7f804fe77640 1 -- 172.21.15.18:0/1774793683 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f804806fcd0 con 0x7f804815ed30 2024-09-19T09:20:36.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.053+0000 7f803e7fc640 1 -- 172.21.15.18:0/1774793683 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) ==== 74+0+16713 (secure 0 0 0) 0x7f803807e3c0 con 0x7f804815ed30 2024-09-19T09:20:36.055 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:20:36.056 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":153,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:20:35.067778+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:20:32.729922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-19T09:20:34.052744+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:20:36.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.056+0000 7f804fe77640 1 -- 172.21.15.18:0/1774793683 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f802c06c2b0 msgr2=0x7f802c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:36.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.056+0000 7f804fe77640 1 --2- 172.21.15.18:0/1774793683 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f802c06c2b0 0x7f802c06e770 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f804806e8b0 tx=0x7f8044009040 comp rx=0 tx=0).stop 2024-09-19T09:20:36.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.056+0000 7f804fe77640 1 -- 172.21.15.18:0/1774793683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f804815ed30 msgr2=0x7f80481e9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:36.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.056+0000 7f804fe77640 1 --2- 172.21.15.18:0/1774793683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f804815ed30 0x7f80481e9ae0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f8038000c00 tx=0x7f80380046c0 comp rx=0 tx=0).stop 2024-09-19T09:20:36.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.056+0000 7f804fe77640 1 -- 172.21.15.18:0/1774793683 shutdown_connections 2024-09-19T09:20:36.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.056+0000 7f804fe77640 1 --2- 172.21.15.18:0/1774793683 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f802c06c2b0 0x7f802c06e770 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:36.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.056+0000 7f804fe77640 1 --2- 172.21.15.18:0/1774793683 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8048162f20 0x7f80481e9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:36.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.056+0000 7f804fe77640 1 --2- 172.21.15.18:0/1774793683 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f804815ed30 0x7f80481e9ae0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:36.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.056+0000 7f804fe77640 1 --2- 172.21.15.18:0/1774793683 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80480b5200 0x7f80480c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:36.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.056+0000 7f804fe77640 1 -- 172.21.15.18:0/1774793683 >> 172.21.15.18:0/1774793683 conn(0x7f80480b4600 msgr2=0x7f80480d1c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:36.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.056+0000 7f804fe77640 1 -- 172.21.15.18:0/1774793683 shutdown_connections 2024-09-19T09:20:36.058 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.056+0000 7f804fe77640 1 -- 172.21.15.18:0/1774793683 wait complete. 2024-09-19T09:20:36.069 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:20:36.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.170+0000 7f6efce1e640 1 Processor -- start 2024-09-19T09:20:36.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.170+0000 7f6efce1e640 1 -- start start 2024-09-19T09:20:36.174 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.171+0000 7f6efce1e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6ef815ef80 0x7f6ef80b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:36.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.171+0000 7f6efce1e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6ef806d730 0x7f6ef80cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:36.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.171+0000 7f6efce1e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ef80cd1a0 con 0x7f6ef80cf910 2024-09-19T09:20:36.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.171+0000 7f6efce1e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f6ef80cd7d0 con 0x7f6ef806d730 2024-09-19T09:20:36.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.171+0000 7f6efce1e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6ef806dc30 con 0x7f6ef815ef80 2024-09-19T09:20:36.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.171+0000 7f6ef5d9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6ef806d730 0x7f6ef80cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:36.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.171+0000 7f6ef6d9d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6ef80cf910 0x7f6ef80d0ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55020/0 (socket says 172.21.15.18:55020) 2024-09-19T09:20:36.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.171+0000 7f6ef6d9d640 1 -- 172.21.15.18:0/3375623554 learned_addr learned my addr 172.21.15.18:0/3375623554 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:20:36.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.171+0000 7f6ef5d9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6ef806d730 0x7f6ef80cf3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53118/0 (socket says 172.21.15.18:53118) 2024-09-19T09:20:36.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.171+0000 7f6ef659c640 1 --2- 172.21.15.18:0/3375623554 >> v2:172.21.15.162:3300/0 conn(0x7f6ef815ef80 0x7f6ef80b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:36.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.171+0000 7f6ef5d9b640 1 -- 172.21.15.18:0/3375623554 >> v2:172.21.15.162:3300/0 conn(0x7f6ef815ef80 msgr2=0x7f6ef80b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:36.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.171+0000 7f6ef5d9b640 1 --2- 172.21.15.18:0/3375623554 >> v2:172.21.15.162:3300/0 conn(0x7f6ef815ef80 0x7f6ef80b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:36.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.171+0000 7f6ef5d9b640 1 -- 172.21.15.18:0/3375623554 >> v1:172.21.15.18:6789/0 conn(0x7f6ef80cf910 legacy=0x7f6ef80d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:36.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.171+0000 7f6ef5d9b640 1 -- 172.21.15.18:0/3375623554 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef806df10 con 0x7f6ef806d730 2024-09-19T09:20:36.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.171+0000 7f6ef559a640 1 -- 172.21.15.18:0/3375623554 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3228370933 0 0) 0x7f6ef80cd1a0 con 0x7f6ef80cf910 2024-09-19T09:20:36.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.172+0000 7f6ef5d9b640 1 --2- 172.21.15.18:0/3375623554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ef806d730 0x7f6ef80cf3d0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f6ef806f6e0 tx=0x7f6eec02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d16c05a4d2cfba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:36.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.172+0000 7f6ef559a640 1 -- 172.21.15.18:0/3375623554 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec037070 con 0x7f6ef806d730 2024-09-19T09:20:36.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.172+0000 7f6ef559a640 1 -- 172.21.15.18:0/3375623554 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eec032440 con 0x7f6ef806d730 2024-09-19T09:20:36.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.172+0000 7f6ef559a640 1 -- 172.21.15.18:0/3375623554 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eec032810 con 0x7f6ef806d730 2024-09-19T09:20:36.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.173+0000 7f6efce1e640 1 -- 172.21.15.18:0/3375623554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ef806d730 msgr2=0x7f6ef80cf3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:36.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.173+0000 7f6efce1e640 1 --2- 172.21.15.18:0/3375623554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ef806d730 0x7f6ef80cf3d0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f6ef806f6e0 tx=0x7f6eec02a1a0 comp rx=0 tx=0).stop 2024-09-19T09:20:36.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.173+0000 7f6efce1e640 1 -- 172.21.15.18:0/3375623554 shutdown_connections 2024-09-19T09:20:36.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.173+0000 7f6efce1e640 1 --2- 172.21.15.18:0/3375623554 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ef806d730 0x7f6ef80cf3d0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:36.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.173+0000 7f6efce1e640 1 --2- 172.21.15.18:0/3375623554 >> v2:172.21.15.162:3300/0 conn(0x7f6ef815ef80 0x7f6ef80b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:36.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.173+0000 7f6efce1e640 1 -- 172.21.15.18:0/3375623554 >> 172.21.15.18:0/3375623554 conn(0x7f6ef80b4700 msgr2=0x7f6ef80b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:36.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.173+0000 7f6efce1e640 1 -- 172.21.15.18:0/3375623554 shutdown_connections 2024-09-19T09:20:36.176 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.173+0000 7f6efce1e640 1 -- 172.21.15.18:0/3375623554 wait complete. 2024-09-19T09:20:36.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.174+0000 7f6efce1e640 1 Processor -- start 2024-09-19T09:20:36.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.174+0000 7f6efce1e640 1 -- start start 2024-09-19T09:20:36.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.175+0000 7f6efce1e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ef806d730 0x7f6ef81581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:36.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.175+0000 7f6efce1e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ef80cf910 0x7f6ef815b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:36.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.175+0000 7f6efce1e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ef815ef80 0x7f6ef8158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:36.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.175+0000 7f6efce1e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef80d0120 con 0x7f6ef806d730 2024-09-19T09:20:36.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.175+0000 7f6efce1e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef815f360 con 0x7f6ef80cf910 2024-09-19T09:20:36.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.175+0000 7f6efce1e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6ef80cec70 con 0x7f6ef815ef80 2024-09-19T09:20:36.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.175+0000 7f6ef659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ef806d730 0x7f6ef81581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:36.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.175+0000 7f6ef659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ef806d730 0x7f6ef81581d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53132/0 (socket says 172.21.15.18:53132) 2024-09-19T09:20:36.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.175+0000 7f6ef659c640 1 -- 172.21.15.18:0/2328882813 learned_addr learned my addr 172.21.15.18:0/2328882813 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:36.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.175+0000 7f6ef5d9b640 1 --2- 172.21.15.18:0/2328882813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ef80cf910 0x7f6ef815b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:36.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.175+0000 7f6ef6d9d640 1 --2- 172.21.15.18:0/2328882813 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ef815ef80 0x7f6ef8158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:36.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.175+0000 7f6ef659c640 1 -- 172.21.15.18:0/2328882813 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ef815ef80 msgr2=0x7f6ef8158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:36.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.175+0000 7f6ef659c640 1 --2- 172.21.15.18:0/2328882813 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ef815ef80 0x7f6ef8158c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:36.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.175+0000 7f6ef659c640 1 -- 172.21.15.18:0/2328882813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ef80cf910 msgr2=0x7f6ef815b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:36.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.175+0000 7f6ef659c640 1 --2- 172.21.15.18:0/2328882813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ef80cf910 0x7f6ef815b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:36.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.175+0000 7f6ef659c640 1 -- 172.21.15.18:0/2328882813 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef8159160 con 0x7f6ef806d730 2024-09-19T09:20:36.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.176+0000 7f6ef659c640 1 --2- 172.21.15.18:0/2328882813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ef806d730 0x7f6ef81581d0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f6ee800e870 tx=0x7f6ee800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:36.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.176+0000 7f6ee6ffd640 1 -- 172.21.15.18:0/2328882813 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8017070 con 0x7f6ef806d730 2024-09-19T09:20:36.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.176+0000 7f6ee6ffd640 1 -- 172.21.15.18:0/2328882813 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ee800c940 con 0x7f6ef806d730 2024-09-19T09:20:36.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.176+0000 7f6efce1e640 1 -- 172.21.15.18:0/2328882813 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef815b820 con 0x7f6ef806d730 2024-09-19T09:20:36.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.176+0000 7f6ee6ffd640 1 -- 172.21.15.18:0/2328882813 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee800cd30 con 0x7f6ef806d730 2024-09-19T09:20:36.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.176+0000 7f6efce1e640 1 -- 172.21.15.18:0/2328882813 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ef80c9e50 con 0x7f6ef806d730 2024-09-19T09:20:36.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.177+0000 7f6efce1e640 1 -- 172.21.15.18:0/2328882813 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ef80cff00 con 0x7f6ef806d730 2024-09-19T09:20:36.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.177+0000 7f6ee6ffd640 1 -- 172.21.15.18:0/2328882813 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6ee801a070 con 0x7f6ef806d730 2024-09-19T09:20:36.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.178+0000 7f6ee6ffd640 1 --2- 172.21.15.18:0/2328882813 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6ed806c2b0 0x7f6ed806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:36.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.178+0000 7f6ee6ffd640 1 -- 172.21.15.18:0/2328882813 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f6ee808b2c0 con 0x7f6ef806d730 2024-09-19T09:20:36.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.178+0000 7f6ef5d9b640 1 --2- 172.21.15.18:0/2328882813 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6ed806c2b0 0x7f6ed806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:36.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.179+0000 7f6ef5d9b640 1 --2- 172.21.15.18:0/2328882813 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6ed806c2b0 0x7f6ed806e770 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6eec034000 tx=0x7f6eec02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:36.184 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.182+0000 7f6ee6ffd640 1 -- 172.21.15.18:0/2328882813 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6ee8059a30 con 0x7f6ef806d730 2024-09-19T09:20:36.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.361+0000 7f6efce1e640 1 -- 172.21.15.18:0/2328882813 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6ef80cd1a0 con 0x7f6ef806d730 2024-09-19T09:20:36.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.362+0000 7f6ee6ffd640 1 -- 172.21.15.18:0/2328882813 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) ==== 74+0+16713 (secure 0 0 0) 0x7f6ee8059330 con 0x7f6ef806d730 2024-09-19T09:20:36.364 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:20:36.364 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":153,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:20:35.067778+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:20:32.729922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-19T09:20:34.052744+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:20:36.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.365+0000 7f6efce1e640 1 -- 172.21.15.18:0/2328882813 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6ed806c2b0 msgr2=0x7f6ed806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:36.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.365+0000 7f6efce1e640 1 --2- 172.21.15.18:0/2328882813 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6ed806c2b0 0x7f6ed806e770 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6eec034000 tx=0x7f6eec02e000 comp rx=0 tx=0).stop 2024-09-19T09:20:36.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.365+0000 7f6efce1e640 1 -- 172.21.15.18:0/2328882813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ef806d730 msgr2=0x7f6ef81581d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:36.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.365+0000 7f6efce1e640 1 --2- 172.21.15.18:0/2328882813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ef806d730 0x7f6ef81581d0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f6ee800e870 tx=0x7f6ee800ed30 comp rx=0 tx=0).stop 2024-09-19T09:20:36.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.365+0000 7f6efce1e640 1 -- 172.21.15.18:0/2328882813 shutdown_connections 2024-09-19T09:20:36.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.365+0000 7f6efce1e640 1 --2- 172.21.15.18:0/2328882813 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6ed806c2b0 0x7f6ed806e770 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:36.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.365+0000 7f6efce1e640 1 --2- 172.21.15.18:0/2328882813 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6ef815ef80 0x7f6ef8158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:36.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.365+0000 7f6efce1e640 1 --2- 172.21.15.18:0/2328882813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6ef80cf910 0x7f6ef815b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:36.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.365+0000 7f6efce1e640 1 --2- 172.21.15.18:0/2328882813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6ef806d730 0x7f6ef81581d0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:36.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.365+0000 7f6efce1e640 1 -- 172.21.15.18:0/2328882813 >> 172.21.15.18:0/2328882813 conn(0x7f6ef80b4700 msgr2=0x7f6ef8161b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:36.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.365+0000 7f6efce1e640 1 -- 172.21.15.18:0/2328882813 shutdown_connections 2024-09-19T09:20:36.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.365+0000 7f6efce1e640 1 -- 172.21.15.18:0/2328882813 wait complete. 2024-09-19T09:20:36.378 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-19T09:20:36.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.482+0000 7f7f429b9640 1 Processor -- start 2024-09-19T09:20:36.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.482+0000 7f7f429b9640 1 -- start start 2024-09-19T09:20:36.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.483+0000 7f7f429b9640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7f3c0d0630 0x7f7f3c0d0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:36.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.483+0000 7f7f429b9640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f3c0b4300 con 0x7f7f3c0afa90 2024-09-19T09:20:36.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.483+0000 7f7f429b9640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f3c0d0fa0 con 0x7f7f3c15b760 2024-09-19T09:20:36.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.483+0000 7f7f429b9640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f7f3c06d700 con 0x7f7f3c0d0630 2024-09-19T09:20:36.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.483+0000 7f7f3b7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f7f3c0afa90 0x7f7f3c06f290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55030/0 (socket says 172.21.15.18:55030) 2024-09-19T09:20:36.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.483+0000 7f7f3b7fe640 1 -- 172.21.15.18:0/2379990340 learned_addr learned my addr 172.21.15.18:0/2379990340 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:20:36.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.483+0000 7f7f3affd640 1 -- 172.21.15.18:0/2379990340 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4150757829 0 0) 0x7f7f3c0b4300 con 0x7f7f3c0afa90 2024-09-19T09:20:36.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.483+0000 7f7f3affd640 1 -- 172.21.15.18:0/2379990340 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f24003520 con 0x7f7f3c0afa90 2024-09-19T09:20:36.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.483+0000 7f7f40f56640 1 --2- 172.21.15.18:0/2379990340 >> v2:172.21.15.162:3300/0 conn(0x7f7f3c0d0630 0x7f7f3c0d0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:36.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.483+0000 7f7f3affd640 1 -- 172.21.15.18:0/2379990340 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4117694632 0 0) 0x7f7f24003520 con 0x7f7f3c0afa90 2024-09-19T09:20:36.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.483+0000 7f7f3affd640 1 -- 172.21.15.18:0/2379990340 >> v2:172.21.15.162:3300/0 conn(0x7f7f3c0d0630 msgr2=0x7f7f3c0d0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:36.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.483+0000 7f7f3affd640 1 --2- 172.21.15.18:0/2379990340 >> v2:172.21.15.162:3300/0 conn(0x7f7f3c0d0630 0x7f7f3c0d0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:36.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.483+0000 7f7f3affd640 1 -- 172.21.15.18:0/2379990340 >> v1:172.21.15.162:6789/0 conn(0x7f7f3c15b760 legacy=0x7f7f3c0b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:36.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.483+0000 7f7f3affd640 1 -- 172.21.15.18:0/2379990340 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f3c06d9e0 con 0x7f7f3c0afa90 2024-09-19T09:20:36.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.483+0000 7f7f3affd640 1 -- 172.21.15.18:0/2379990340 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f7f30001670 con 0x7f7f3c0afa90 2024-09-19T09:20:36.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.484+0000 7f7f3affd640 1 -- 172.21.15.18:0/2379990340 >> v1:172.21.15.18:6789/0 conn(0x7f7f3c0afa90 legacy=0x7f7f3c06f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:36.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.484+0000 7f7f3affd640 1 --2- 172.21.15.18:0/2379990340 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f240039b0 0x7f7f24003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:36.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.484+0000 7f7f3affd640 1 --2- 172.21.15.18:0/2379990340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f24004800 0x7f7f24004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.484+0000 7f7f3affd640 1 --2- 172.21.15.18:0/2379990340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f240053c0 0x7f7f2400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.484+0000 7f7f3affd640 1 -- 172.21.15.18:0/2379990340 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7f3c06d700 con 0x7f7f240053c0 2024-09-19T09:20:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.484+0000 7f7f3affd640 1 -- 172.21.15.18:0/2379990340 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7f2400c250 con 0x7f7f24004800 2024-09-19T09:20:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.484+0000 7f7f3affd640 1 -- 172.21.15.18:0/2379990340 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7f2400e660 con 0x7f7f240039b0 2024-09-19T09:20:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.484+0000 7f7f40f56640 1 --2- 172.21.15.18:0/2379990340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f240053c0 0x7f7f2400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.484+0000 7f7f3b7fe640 1 --2- 172.21.15.18:0/2379990340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f24004800 0x7f7f24004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.484+0000 7f7f3bfff640 1 --2- 172.21.15.18:0/2379990340 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f240039b0 0x7f7f24003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.484+0000 7f7f40f56640 1 -- 172.21.15.18:0/2379990340 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f240039b0 msgr2=0x7f7f24003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.484+0000 7f7f40f56640 1 --2- 172.21.15.18:0/2379990340 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f240039b0 0x7f7f24003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.484+0000 7f7f40f56640 1 -- 172.21.15.18:0/2379990340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f24004800 msgr2=0x7f7f24004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.484+0000 7f7f40f56640 1 --2- 172.21.15.18:0/2379990340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f24004800 0x7f7f24004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.484+0000 7f7f40f56640 1 -- 172.21.15.18:0/2379990340 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f24003520 con 0x7f7f240053c0 2024-09-19T09:20:36.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.484+0000 7f7f3bfff640 1 --2- 172.21.15.18:0/2379990340 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f240039b0 0x7f7f24003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.484+0000 7f7f3b7fe640 1 --2- 172.21.15.18:0/2379990340 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f24004800 0x7f7f24004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.485+0000 7f7f40f56640 1 -- 172.21.15.18:0/2379990340 reap_dead start 2024-09-19T09:20:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.485+0000 7f7f40f56640 1 --2- 172.21.15.18:0/2379990340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f240053c0 0x7f7f2400b9c0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f7f34007360 tx=0x7f7f24005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a285a82961f242 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.485+0000 7f7f3affd640 1 -- 172.21.15.18:0/2379990340 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f34009be0 con 0x7f7f240053c0 2024-09-19T09:20:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.485+0000 7f7f3affd640 1 -- 172.21.15.18:0/2379990340 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f34003bd0 con 0x7f7f240053c0 2024-09-19T09:20:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.485+0000 7f7f3affd640 1 -- 172.21.15.18:0/2379990340 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f34004020 con 0x7f7f240053c0 2024-09-19T09:20:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.485+0000 7f7f429b9640 1 -- 172.21.15.18:0/2379990340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f240053c0 msgr2=0x7f7f2400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.485+0000 7f7f429b9640 1 --2- 172.21.15.18:0/2379990340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f240053c0 0x7f7f2400b9c0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f7f34007360 tx=0x7f7f24005830 comp rx=0 tx=0).stop 2024-09-19T09:20:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.485+0000 7f7f429b9640 1 -- 172.21.15.18:0/2379990340 shutdown_connections 2024-09-19T09:20:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.485+0000 7f7f429b9640 1 --2- 172.21.15.18:0/2379990340 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f240053c0 0x7f7f2400b9c0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.485+0000 7f7f429b9640 1 -- 172.21.15.18:0/2379990340 >> 172.21.15.18:0/2379990340 conn(0x7f7f3c06bc10 msgr2=0x7f7f3c06c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.485+0000 7f7f429b9640 1 -- 172.21.15.18:0/2379990340 shutdown_connections 2024-09-19T09:20:36.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.485+0000 7f7f429b9640 1 -- 172.21.15.18:0/2379990340 wait complete. 2024-09-19T09:20:36.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.487+0000 7f7f429b9640 1 Processor -- start 2024-09-19T09:20:36.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.487+0000 7f7f429b9640 1 -- start start 2024-09-19T09:20:36.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.487+0000 7f7f429b9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f240053c0 0x7f7f3c14c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:36.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.487+0000 7f7f429b9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f3c156370 0x7f7f3c0ada20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:36.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.488+0000 7f7f429b9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f3c0b14d0 0x7f7f3c0b1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:36.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.488+0000 7f7f429b9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7f3c15bcc0 con 0x7f7f240053c0 2024-09-19T09:20:36.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.488+0000 7f7f429b9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7f3c15bb40 con 0x7f7f3c0b14d0 2024-09-19T09:20:36.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.488+0000 7f7f429b9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7f3c06dcc0 con 0x7f7f3c156370 2024-09-19T09:20:36.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.488+0000 7f7f3bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f240053c0 0x7f7f3c14c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:36.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.488+0000 7f7f3bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f240053c0 0x7f7f3c14c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53138/0 (socket says 172.21.15.18:53138) 2024-09-19T09:20:36.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.488+0000 7f7f3bfff640 1 -- 172.21.15.18:0/2358564476 learned_addr learned my addr 172.21.15.18:0/2358564476 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:36.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.488+0000 7f7f3bfff640 1 -- 172.21.15.18:0/2358564476 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f3c156370 msgr2=0x7f7f3c0ada20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:36.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.488+0000 7f7f3bfff640 1 --2- 172.21.15.18:0/2358564476 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f3c156370 0x7f7f3c0ada20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:36.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.488+0000 7f7f3bfff640 1 -- 172.21.15.18:0/2358564476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f3c0b14d0 msgr2=0x7f7f3c0b1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:36.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.488+0000 7f7f3bfff640 1 --2- 172.21.15.18:0/2358564476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f3c0b14d0 0x7f7f3c0b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:36.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.488+0000 7f7f3bfff640 1 -- 172.21.15.18:0/2358564476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f3c14c820 con 0x7f7f240053c0 2024-09-19T09:20:36.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.488+0000 7f7f3bfff640 1 --2- 172.21.15.18:0/2358564476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f240053c0 0x7f7f3c14c2e0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c00e4d0 tx=0x7f7f2c00e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:36.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.488+0000 7f7f38ff9640 1 -- 172.21.15.18:0/2358564476 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c0052e0 con 0x7f7f240053c0 2024-09-19T09:20:36.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.488+0000 7f7f38ff9640 1 -- 172.21.15.18:0/2358564476 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f2c018070 con 0x7f7f240053c0 2024-09-19T09:20:36.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.488+0000 7f7f38ff9640 1 -- 172.21.15.18:0/2358564476 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c003810 con 0x7f7f240053c0 2024-09-19T09:20:36.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.488+0000 7f7f429b9640 1 -- 172.21.15.18:0/2358564476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f3c0ae370 con 0x7f7f240053c0 2024-09-19T09:20:36.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.488+0000 7f7f429b9640 1 -- 172.21.15.18:0/2358564476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f3c0ae930 con 0x7f7f240053c0 2024-09-19T09:20:36.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.489+0000 7f7f429b9640 1 -- 172.21.15.18:0/2358564476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f3c0d0a60 con 0x7f7f240053c0 2024-09-19T09:20:36.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.490+0000 7f7f38ff9640 1 -- 172.21.15.18:0/2358564476 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7f2c0039b0 con 0x7f7f240053c0 2024-09-19T09:20:36.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.490+0000 7f7f38ff9640 1 --2- 172.21.15.18:0/2358564476 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7f2806c2b0 0x7f7f2806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:36.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.490+0000 7f7f38ff9640 1 -- 172.21.15.18:0/2358564476 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5709+0+0 (secure 0 0 0) 0x7f7f2c08afc0 con 0x7f7f240053c0 2024-09-19T09:20:36.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.491+0000 7f7f3b7fe640 1 --2- 172.21.15.18:0/2358564476 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7f2806c2b0 0x7f7f2806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:36.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.491+0000 7f7f3b7fe640 1 --2- 172.21.15.18:0/2358564476 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7f2806c2b0 0x7f7f2806e770 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c156ea0 tx=0x7f7f30001080 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:36.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.494+0000 7f7f38ff9640 1 -- 172.21.15.18:0/2358564476 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7f3c14c820 con 0x7f7f240053c0 2024-09-19T09:20:36.708 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:36.707+0000 7f7f429b9640 1 -- 172.21.15.18:0/2358564476 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f7f3c0ce9c0 con 0x7f7f240053c0 2024-09-19T09:20:37.234 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.233+0000 7f7f38ff9640 1 -- 172.21.15.18:0/2358564476 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v64) ==== 118+0+0 (secure 0 0 0) 0x7f7f2c0597c0 con 0x7f7f240053c0 2024-09-19T09:20:37.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.235+0000 7f7f429b9640 1 -- 172.21.15.18:0/2358564476 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7f2806c2b0 msgr2=0x7f7f2806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:37.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.235+0000 7f7f429b9640 1 --2- 172.21.15.18:0/2358564476 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7f2806c2b0 0x7f7f2806e770 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c156ea0 tx=0x7f7f30001080 comp rx=0 tx=0).stop 2024-09-19T09:20:37.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.235+0000 7f7f429b9640 1 -- 172.21.15.18:0/2358564476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f240053c0 msgr2=0x7f7f3c14c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:37.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.235+0000 7f7f429b9640 1 --2- 172.21.15.18:0/2358564476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f240053c0 0x7f7f3c14c2e0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c00e4d0 tx=0x7f7f2c00e990 comp rx=0 tx=0).stop 2024-09-19T09:20:37.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.235+0000 7f7f429b9640 1 -- 172.21.15.18:0/2358564476 shutdown_connections 2024-09-19T09:20:37.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.235+0000 7f7f429b9640 1 --2- 172.21.15.18:0/2358564476 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7f2806c2b0 0x7f7f2806e770 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:37.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.235+0000 7f7f429b9640 1 --2- 172.21.15.18:0/2358564476 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7f3c0b14d0 0x7f7f3c0b1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:37.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.235+0000 7f7f429b9640 1 --2- 172.21.15.18:0/2358564476 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7f3c156370 0x7f7f3c0ada20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:37.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.235+0000 7f7f429b9640 1 --2- 172.21.15.18:0/2358564476 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7f240053c0 0x7f7f3c14c2e0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:37.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.235+0000 7f7f429b9640 1 -- 172.21.15.18:0/2358564476 >> 172.21.15.18:0/2358564476 conn(0x7f7f3c06bc10 msgr2=0x7f7f3c0b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:37.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.235+0000 7f7f429b9640 1 -- 172.21.15.18:0/2358564476 shutdown_connections 2024-09-19T09:20:37.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.235+0000 7f7f429b9640 1 -- 172.21.15.18:0/2358564476 wait complete. 2024-09-19T09:20:37.249 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-19T09:20:37.250 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-19T09:20:37.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.357+0000 7f37bcc27640 1 Processor -- start 2024-09-19T09:20:37.358 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.357+0000 7f37bcc27640 1 -- start start 2024-09-19T09:20:37.359 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.358+0000 7f37bcc27640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f37b80d56b0 0x7f37b80b6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:37.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.358+0000 7f37bcc27640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37b80d3700 con 0x7f37b81623c0 2024-09-19T09:20:37.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.358+0000 7f37bcc27640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37b80cfa70 con 0x7f37b80d1470 2024-09-19T09:20:37.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.358+0000 7f37bcc27640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f37b80d21a0 con 0x7f37b80d56b0 2024-09-19T09:20:37.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.358+0000 7f37b5d9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f37b80d56b0 0x7f37b80b6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:37.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.358+0000 7f37b5d9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f37b80d56b0 0x7f37b80b6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53150/0 (socket says 172.21.15.18:53150) 2024-09-19T09:20:37.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.358+0000 7f37b5d9b640 1 -- 172.21.15.18:0/1622944396 learned_addr learned my addr 172.21.15.18:0/1622944396 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:37.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.358+0000 7f37b659c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f37b81623c0 0x7f37b80d0510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55044/0 (socket says 172.21.15.18:55044) 2024-09-19T09:20:37.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.358+0000 7f37b5d9b640 1 -- 172.21.15.18:0/1622944396 >> v1:172.21.15.162:6789/0 conn(0x7f37b80d1470 legacy=0x7f37b80b4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:37.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.358+0000 7f37b5d9b640 1 -- 172.21.15.18:0/1622944396 >> v1:172.21.15.18:6789/0 conn(0x7f37b81623c0 legacy=0x7f37b80d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:37.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.358+0000 7f37b5d9b640 1 -- 172.21.15.18:0/1622944396 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b80d0c20 con 0x7f37b80d56b0 2024-09-19T09:20:37.360 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.358+0000 7f37b559a640 1 -- 172.21.15.18:0/1622944396 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4061710956 0 0) 0x7f37b80d3700 con 0x7f37b81623c0 2024-09-19T09:20:37.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.359+0000 7f37b5d9b640 1 --2- 172.21.15.18:0/1622944396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37b80d56b0 0x7f37b80b6260 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f37b80b44e0 tx=0x7f37ac02a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=976c02438a6398e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:37.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.359+0000 7f37b559a640 1 -- 172.21.15.18:0/1622944396 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac037070 con 0x7f37b80d56b0 2024-09-19T09:20:37.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.359+0000 7f37b559a640 1 -- 172.21.15.18:0/1622944396 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37ac032440 con 0x7f37b80d56b0 2024-09-19T09:20:37.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.359+0000 7f37b559a640 1 -- 172.21.15.18:0/1622944396 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37ac032810 con 0x7f37b80d56b0 2024-09-19T09:20:37.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.359+0000 7f37bcc27640 1 -- 172.21.15.18:0/1622944396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37b80d56b0 msgr2=0x7f37b80b6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:37.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.359+0000 7f37bcc27640 1 --2- 172.21.15.18:0/1622944396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37b80d56b0 0x7f37b80b6260 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f37b80b44e0 tx=0x7f37ac02a290 comp rx=0 tx=0).stop 2024-09-19T09:20:37.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.360+0000 7f37bcc27640 1 -- 172.21.15.18:0/1622944396 shutdown_connections 2024-09-19T09:20:37.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.360+0000 7f37bcc27640 1 --2- 172.21.15.18:0/1622944396 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37b80d56b0 0x7f37b80b6260 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:37.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.360+0000 7f37bcc27640 1 -- 172.21.15.18:0/1622944396 >> 172.21.15.18:0/1622944396 conn(0x7f37b809df30 msgr2=0x7f37b80d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:37.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.360+0000 7f37bcc27640 1 -- 172.21.15.18:0/1622944396 shutdown_connections 2024-09-19T09:20:37.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.360+0000 7f37bcc27640 1 -- 172.21.15.18:0/1622944396 wait complete. 2024-09-19T09:20:37.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.361+0000 7f37bcc27640 1 Processor -- start 2024-09-19T09:20:37.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.361+0000 7f37bcc27640 1 -- start start 2024-09-19T09:20:37.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.362+0000 7f37bcc27640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37b80d1470 0x7f37b8152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:37.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.362+0000 7f37bcc27640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37b80d56b0 0x7f37b80ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:37.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.362+0000 7f37bcc27640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37b81623c0 0x7f37b80cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:37.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.362+0000 7f37bcc27640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f37b80cfd10 con 0x7f37b81623c0 2024-09-19T09:20:37.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.362+0000 7f37bcc27640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f37b80d0080 con 0x7f37b80d1470 2024-09-19T09:20:37.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.362+0000 7f37bcc27640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f37b81627a0 con 0x7f37b80d56b0 2024-09-19T09:20:37.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.362+0000 7f37b6d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37b81623c0 0x7f37b80cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:37.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.362+0000 7f37b6d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37b81623c0 0x7f37b80cac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53158/0 (socket says 172.21.15.18:53158) 2024-09-19T09:20:37.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.362+0000 7f37b6d9d640 1 -- 172.21.15.18:0/1429642337 learned_addr learned my addr 172.21.15.18:0/1429642337 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:37.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.362+0000 7f37b6d9d640 1 -- 172.21.15.18:0/1429642337 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37b80d56b0 msgr2=0x7f37b80ca710 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:20:37.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.362+0000 7f37b6d9d640 1 --2- 172.21.15.18:0/1429642337 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37b80d56b0 0x7f37b80ca710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:37.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.362+0000 7f37b6d9d640 1 -- 172.21.15.18:0/1429642337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37b80d1470 msgr2=0x7f37b8152430 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:20:37.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.362+0000 7f37b6d9d640 1 --2- 172.21.15.18:0/1429642337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37b80d1470 0x7f37b8152430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:37.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.362+0000 7f37b6d9d640 1 -- 172.21.15.18:0/1429642337 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b80c9b00 con 0x7f37b81623c0 2024-09-19T09:20:37.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.362+0000 7f37b6d9d640 1 --2- 172.21.15.18:0/1429642337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37b81623c0 0x7f37b80cac50 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f37b000c7b0 tx=0x7f37b000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:37.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.362+0000 7f37a6ffd640 1 -- 172.21.15.18:0/1429642337 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b0017070 con 0x7f37b81623c0 2024-09-19T09:20:37.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.362+0000 7f37a6ffd640 1 -- 172.21.15.18:0/1429642337 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b0003da0 con 0x7f37b81623c0 2024-09-19T09:20:37.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.362+0000 7f37bcc27640 1 -- 172.21.15.18:0/1429642337 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37b814fa30 con 0x7f37b81623c0 2024-09-19T09:20:37.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.362+0000 7f37a6ffd640 1 -- 172.21.15.18:0/1429642337 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b00052b0 con 0x7f37b81623c0 2024-09-19T09:20:37.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.362+0000 7f37bcc27640 1 -- 172.21.15.18:0/1429642337 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37b80b8be0 con 0x7f37b81623c0 2024-09-19T09:20:37.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.363+0000 7f37bcc27640 1 -- 172.21.15.18:0/1429642337 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37b80d3c80 con 0x7f37b81623c0 2024-09-19T09:20:37.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.364+0000 7f37a6ffd640 1 -- 172.21.15.18:0/1429642337 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f37b001a070 con 0x7f37b81623c0 2024-09-19T09:20:37.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.364+0000 7f37a6ffd640 1 --2- 172.21.15.18:0/1429642337 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f379806c2b0 0x7f379806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:37.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.365+0000 7f37a6ffd640 1 -- 172.21.15.18:0/1429642337 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f37b008aba0 con 0x7f37b81623c0 2024-09-19T09:20:37.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.365+0000 7f37b659c640 1 --2- 172.21.15.18:0/1429642337 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f379806c2b0 0x7f379806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:37.367 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.365+0000 7f37b659c640 1 --2- 172.21.15.18:0/1429642337 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f379806c2b0 0x7f379806e770 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f37a8007fd0 tx=0x7f37a8007960 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:37.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.370+0000 7f37a6ffd640 1 -- 172.21.15.18:0/1429642337 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f37b00591e0 con 0x7f37b81623c0 2024-09-19T09:20:37.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:37.582+0000 7f37bcc27640 1 -- 172.21.15.18:0/1429642337 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f37b80d2340 con 0x7f37b81623c0 2024-09-19T09:20:38.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.239+0000 7f37a6ffd640 1 -- 172.21.15.18:0/1429642337 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v65) ==== 122+0+0 (secure 0 0 0) 0x7f37b0058ae0 con 0x7f37b81623c0 2024-09-19T09:20:38.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.241+0000 7f37bcc27640 1 -- 172.21.15.18:0/1429642337 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f379806c2b0 msgr2=0x7f379806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:38.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.241+0000 7f37bcc27640 1 --2- 172.21.15.18:0/1429642337 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f379806c2b0 0x7f379806e770 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f37a8007fd0 tx=0x7f37a8007960 comp rx=0 tx=0).stop 2024-09-19T09:20:38.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.241+0000 7f37bcc27640 1 -- 172.21.15.18:0/1429642337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37b81623c0 msgr2=0x7f37b80cac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:38.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.241+0000 7f37bcc27640 1 --2- 172.21.15.18:0/1429642337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37b81623c0 0x7f37b80cac50 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f37b000c7b0 tx=0x7f37b000cc70 comp rx=0 tx=0).stop 2024-09-19T09:20:38.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.241+0000 7f37bcc27640 1 -- 172.21.15.18:0/1429642337 shutdown_connections 2024-09-19T09:20:38.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.241+0000 7f37bcc27640 1 --2- 172.21.15.18:0/1429642337 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f379806c2b0 0x7f379806e770 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.241+0000 7f37bcc27640 1 --2- 172.21.15.18:0/1429642337 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f37b81623c0 0x7f37b80cac50 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.241+0000 7f37bcc27640 1 --2- 172.21.15.18:0/1429642337 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f37b80d56b0 0x7f37b80ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.241+0000 7f37bcc27640 1 --2- 172.21.15.18:0/1429642337 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f37b80d1470 0x7f37b8152430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.241+0000 7f37bcc27640 1 -- 172.21.15.18:0/1429642337 >> 172.21.15.18:0/1429642337 conn(0x7f37b809df30 msgr2=0x7f37b80b4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:38.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.241+0000 7f37bcc27640 1 -- 172.21.15.18:0/1429642337 shutdown_connections 2024-09-19T09:20:38.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.241+0000 7f37bcc27640 1 -- 172.21.15.18:0/1429642337 wait complete. 2024-09-19T09:20:38.256 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-19T09:20:38.256 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:20:38.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.362+0000 7f3cd7d49640 1 Processor -- start 2024-09-19T09:20:38.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.362+0000 7f3cd7d49640 1 -- start start 2024-09-19T09:20:38.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.362+0000 7f3cd7d49640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3cd015ed50 0x7f3cd00d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.362+0000 7f3cd7d49640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3cd00d09d0 0x7f3cd00b5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.362+0000 7f3cd7d49640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cd00d31b0 con 0x7f3cd00d1aa0 2024-09-19T09:20:38.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.362+0000 7f3cd7d49640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f3cd00d1ee0 con 0x7f3cd015ed50 2024-09-19T09:20:38.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.362+0000 7f3cd7d49640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3cd00d3490 con 0x7f3cd00d09d0 2024-09-19T09:20:38.364 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.362+0000 7f3cd5ae5640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3cd015ed50 0x7f3cd00d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.362+0000 7f3cd5ae5640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3cd015ed50 0x7f3cd00d1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53168/0 (socket says 172.21.15.18:53168) 2024-09-19T09:20:38.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.362+0000 7f3cd5ae5640 1 -- 172.21.15.18:0/2808807828 learned_addr learned my addr 172.21.15.18:0/2808807828 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:38.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.362+0000 7f3cd5ae5640 1 -- 172.21.15.18:0/2808807828 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3cd00d09d0 msgr2=0x7f3cd00b5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:38.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.362+0000 7f3cd5ae5640 1 --2- 172.21.15.18:0/2808807828 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3cd00d09d0 0x7f3cd00b5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.362+0000 7f3cd5ae5640 1 -- 172.21.15.18:0/2808807828 >> v1:172.21.15.162:6789/0 conn(0x7f3cd00d1aa0 legacy=0x7f3cd00b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:38.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.362+0000 7f3cd5ae5640 1 -- 172.21.15.18:0/2808807828 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd00d3770 con 0x7f3cd015ed50 2024-09-19T09:20:38.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.363+0000 7f3cd5ae5640 1 --2- 172.21.15.18:0/2808807828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cd015ed50 0x7f3cd00d1560 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc009e50 tx=0x7f3ccc02a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986d66e58b4996bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:38.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.363+0000 7f3cd4ae3640 1 -- 172.21.15.18:0/2808807828 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc036070 con 0x7f3cd015ed50 2024-09-19T09:20:38.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.363+0000 7f3cd4ae3640 1 -- 172.21.15.18:0/2808807828 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ccc031600 con 0x7f3cd015ed50 2024-09-19T09:20:38.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.363+0000 7f3cd4ae3640 1 -- 172.21.15.18:0/2808807828 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ccc0319d0 con 0x7f3cd015ed50 2024-09-19T09:20:38.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.364+0000 7f3cd7d49640 1 -- 172.21.15.18:0/2808807828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cd015ed50 msgr2=0x7f3cd00d1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:38.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.364+0000 7f3cd7d49640 1 --2- 172.21.15.18:0/2808807828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cd015ed50 0x7f3cd00d1560 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc009e50 tx=0x7f3ccc02a750 comp rx=0 tx=0).stop 2024-09-19T09:20:38.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.364+0000 7f3cd7d49640 1 -- 172.21.15.18:0/2808807828 shutdown_connections 2024-09-19T09:20:38.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.364+0000 7f3cd7d49640 1 --2- 172.21.15.18:0/2808807828 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3cd00d09d0 0x7f3cd00b5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.364+0000 7f3cd7d49640 1 --2- 172.21.15.18:0/2808807828 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cd015ed50 0x7f3cd00d1560 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.364+0000 7f3cd7d49640 1 -- 172.21.15.18:0/2808807828 >> 172.21.15.18:0/2808807828 conn(0x7f3cd00d4bd0 msgr2=0x7f3cd00d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:38.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.364+0000 7f3cd7d49640 1 -- 172.21.15.18:0/2808807828 shutdown_connections 2024-09-19T09:20:38.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.364+0000 7f3cd7d49640 1 -- 172.21.15.18:0/2808807828 wait complete. 2024-09-19T09:20:38.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.365+0000 7f3cd7d49640 1 Processor -- start 2024-09-19T09:20:38.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.365+0000 7f3cd7d49640 1 -- start start 2024-09-19T09:20:38.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.366+0000 7f3cd7d49640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3cd00d09d0 0x7f3cd0154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.366+0000 7f3cd7d49640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cd00d1aa0 0x7f3cd00cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.366+0000 7f3cd7d49640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cd015ed50 0x7f3cd00c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.366+0000 7f3cd7d49640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd00d3d30 con 0x7f3cd015ed50 2024-09-19T09:20:38.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.366+0000 7f3cd7d49640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd00b45d0 con 0x7f3cd00d1aa0 2024-09-19T09:20:38.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.366+0000 7f3cd7d49640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3cd015f130 con 0x7f3cd00d09d0 2024-09-19T09:20:38.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.366+0000 7f3cd62e6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cd015ed50 0x7f3cd00c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.366+0000 7f3cd62e6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cd015ed50 0x7f3cd00c9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53174/0 (socket says 172.21.15.18:53174) 2024-09-19T09:20:38.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.366+0000 7f3cd62e6640 1 -- 172.21.15.18:0/745034368 learned_addr learned my addr 172.21.15.18:0/745034368 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:38.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.366+0000 7f3cd52e4640 1 --2- 172.21.15.18:0/745034368 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cd00d1aa0 0x7f3cd00cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.366+0000 7f3cd5ae5640 1 --2- 172.21.15.18:0/745034368 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3cd00d09d0 0x7f3cd0154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.366+0000 7f3cd62e6640 1 -- 172.21.15.18:0/745034368 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3cd00d09d0 msgr2=0x7f3cd0154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:38.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.366+0000 7f3cd62e6640 1 --2- 172.21.15.18:0/745034368 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3cd00d09d0 0x7f3cd0154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.366+0000 7f3cd62e6640 1 -- 172.21.15.18:0/745034368 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cd00d1aa0 msgr2=0x7f3cd00cd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:38.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.366+0000 7f3cd62e6640 1 --2- 172.21.15.18:0/745034368 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cd00d1aa0 0x7f3cd00cd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.366+0000 7f3cd62e6640 1 -- 172.21.15.18:0/745034368 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd00cc730 con 0x7f3cd015ed50 2024-09-19T09:20:38.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.367+0000 7f3cd62e6640 1 --2- 172.21.15.18:0/745034368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cd015ed50 0x7f3cd00c9720 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f3cc800b410 tx=0x7f3cc800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:38.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.367+0000 7f3cc67fc640 1 -- 172.21.15.18:0/745034368 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8015020 con 0x7f3cd015ed50 2024-09-19T09:20:38.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.367+0000 7f3cc67fc640 1 -- 172.21.15.18:0/745034368 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cc8011850 con 0x7f3cd015ed50 2024-09-19T09:20:38.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.367+0000 7f3cd7d49640 1 -- 172.21.15.18:0/745034368 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cd00cca10 con 0x7f3cd015ed50 2024-09-19T09:20:38.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.367+0000 7f3cc67fc640 1 -- 172.21.15.18:0/745034368 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8011c40 con 0x7f3cd015ed50 2024-09-19T09:20:38.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.367+0000 7f3cd7d49640 1 -- 172.21.15.18:0/745034368 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cd00cda30 con 0x7f3cd015ed50 2024-09-19T09:20:38.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.368+0000 7f3cd7d49640 1 -- 172.21.15.18:0/745034368 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cd00cdcf0 con 0x7f3cd015ed50 2024-09-19T09:20:38.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.368+0000 7f3cc67fc640 1 -- 172.21.15.18:0/745034368 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3cc8018020 con 0x7f3cd015ed50 2024-09-19T09:20:38.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.369+0000 7f3cc67fc640 1 --2- 172.21.15.18:0/745034368 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3cb406c2b0 0x7f3cb406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.369+0000 7f3cc67fc640 1 -- 172.21.15.18:0/745034368 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f3cc808b1e0 con 0x7f3cd015ed50 2024-09-19T09:20:38.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.369+0000 7f3cd5ae5640 1 --2- 172.21.15.18:0/745034368 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3cb406c2b0 0x7f3cb406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.370+0000 7f3cd5ae5640 1 --2- 172.21.15.18:0/745034368 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3cb406c2b0 0x7f3cb406e770 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc033000 tx=0x7f3ccc009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:38.375 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.373+0000 7f3cc67fc640 1 -- 172.21.15.18:0/745034368 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3cc801f020 con 0x7f3cd015ed50 2024-09-19T09:20:38.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.589+0000 7f3cd7d49640 1 -- 172.21.15.18:0/745034368 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3cd00d0e60 con 0x7f3cd015ed50 2024-09-19T09:20:38.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.590+0000 7f3cc67fc640 1 -- 172.21.15.18:0/745034368 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+5225 (secure 0 0 0) 0x7f3cc8059390 con 0x7f3cd015ed50 2024-09-19T09:20:38.590 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:20:38.591 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":65,"btime":"2024-09-19T09:20:38:235364+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6044,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2661639901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2661639901},{"type":"v1","addr":"172.21.15.162:6836","nonce":2661639901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":7221,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/56318264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":56318264},{"type":"v1","addr":"172.21.15.18:6833","nonce":56318264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":7239,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1783371939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1783371939},{"type":"v1","addr":"172.21.15.162:6837","nonce":1783371939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:20:35.068097+0000","modified":"2024-09-19T09:20:37.584812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7245":{"gid":7245,"name":"a","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/1201598209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1201598209},{"type":"v1","addr":"172.21.15.18:6835","nonce":1201598209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7245,"qdb_cluster":[7245]},"id":9}]} 2024-09-19T09:20:38.591 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 65 2024-09-19T09:20:38.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.591+0000 7f3cd7d49640 1 -- 172.21.15.18:0/745034368 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3cb406c2b0 msgr2=0x7f3cb406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:38.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.591+0000 7f3cd7d49640 1 --2- 172.21.15.18:0/745034368 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3cb406c2b0 0x7f3cb406e770 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f3ccc033000 tx=0x7f3ccc009000 comp rx=0 tx=0).stop 2024-09-19T09:20:38.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.591+0000 7f3cd7d49640 1 -- 172.21.15.18:0/745034368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cd015ed50 msgr2=0x7f3cd00c9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:38.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.591+0000 7f3cd7d49640 1 --2- 172.21.15.18:0/745034368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cd015ed50 0x7f3cd00c9720 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f3cc800b410 tx=0x7f3cc800b8d0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.592+0000 7f3cd7d49640 1 -- 172.21.15.18:0/745034368 shutdown_connections 2024-09-19T09:20:38.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.592+0000 7f3cd7d49640 1 --2- 172.21.15.18:0/745034368 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3cb406c2b0 0x7f3cb406e770 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.592+0000 7f3cd7d49640 1 --2- 172.21.15.18:0/745034368 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3cd015ed50 0x7f3cd00c9720 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.592+0000 7f3cd7d49640 1 --2- 172.21.15.18:0/745034368 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3cd00d1aa0 0x7f3cd00cd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.592+0000 7f3cd7d49640 1 --2- 172.21.15.18:0/745034368 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3cd00d09d0 0x7f3cd0154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.592+0000 7f3cd7d49640 1 -- 172.21.15.18:0/745034368 >> 172.21.15.18:0/745034368 conn(0x7f3cd00d4bd0 msgr2=0x7f3cd00b17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:38.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.592+0000 7f3cd7d49640 1 -- 172.21.15.18:0/745034368 shutdown_connections 2024-09-19T09:20:38.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.592+0000 7f3cd7d49640 1 -- 172.21.15.18:0/745034368 wait complete. 2024-09-19T09:20:38.603 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:20:38.705 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.705+0000 7f857624c640 1 Processor -- start 2024-09-19T09:20:38.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.705+0000 7f857624c640 1 -- start start 2024-09-19T09:20:38.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.705+0000 7f857624c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f85700d3240 0x7f85700b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.705+0000 7f857624c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85700b7a90 con 0x7f85700d1ab0 2024-09-19T09:20:38.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.705+0000 7f857624c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85700d3740 con 0x7f857015ef50 2024-09-19T09:20:38.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.705+0000 7f857624c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f85700d3a20 con 0x7f85700d3240 2024-09-19T09:20:38.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.706+0000 7f856effd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f85700d1ab0 0x7f85700b8500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55060/0 (socket says 172.21.15.18:55060) 2024-09-19T09:20:38.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.706+0000 7f856effd640 1 -- 172.21.15.18:0/2828327973 learned_addr learned my addr 172.21.15.18:0/2828327973 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:20:38.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.706+0000 7f856ffff640 1 --2- 172.21.15.18:0/2828327973 >> v2:172.21.15.162:3300/0 conn(0x7f85700d3240 0x7f85700b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.706+0000 7f856e7fc640 1 -- 172.21.15.18:0/2828327973 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1111027890 0 0) 0x7f85700b7a90 con 0x7f85700d1ab0 2024-09-19T09:20:38.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.706+0000 7f856e7fc640 1 -- 172.21.15.18:0/2828327973 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8558003520 con 0x7f85700d1ab0 2024-09-19T09:20:38.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.706+0000 7f856e7fc640 1 -- 172.21.15.18:0/2828327973 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 812558844 0 0) 0x7f85700d3740 con 0x7f857015ef50 2024-09-19T09:20:38.709 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.706+0000 7f856e7fc640 1 -- 172.21.15.18:0/2828327973 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85700b7a90 con 0x7f857015ef50 2024-09-19T09:20:38.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.706+0000 7f856e7fc640 1 -- 172.21.15.18:0/2828327973 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 40969818 0 0) 0x7f8558003520 con 0x7f85700d1ab0 2024-09-19T09:20:38.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.706+0000 7f856e7fc640 1 -- 172.21.15.18:0/2828327973 >> v2:172.21.15.162:3300/0 conn(0x7f85700d3240 msgr2=0x7f85700b8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:38.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.706+0000 7f856e7fc640 1 --2- 172.21.15.18:0/2828327973 >> v2:172.21.15.162:3300/0 conn(0x7f85700d3240 0x7f85700b8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.706+0000 7f856e7fc640 1 -- 172.21.15.18:0/2828327973 >> v1:172.21.15.162:6789/0 conn(0x7f857015ef50 legacy=0x7f85700d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:38.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.706+0000 7f856e7fc640 1 -- 172.21.15.18:0/2828327973 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85700b7d00 con 0x7f85700d1ab0 2024-09-19T09:20:38.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.706+0000 7f856e7fc640 1 -- 172.21.15.18:0/2828327973 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f8564001670 con 0x7f85700d1ab0 2024-09-19T09:20:38.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.706+0000 7f856ffff640 1 --2- 172.21.15.18:0/2828327973 >> v2:172.21.15.162:3300/0 conn(0x7f85700d3240 0x7f85700b8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:38.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.706+0000 7f856e7fc640 1 -- 172.21.15.18:0/2828327973 >> v1:172.21.15.18:6789/0 conn(0x7f85700d1ab0 legacy=0x7f85700b8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:38.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.706+0000 7f856e7fc640 1 --2- 172.21.15.18:0/2828327973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8558003b40 0x7f8558003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.706+0000 7f856e7fc640 1 --2- 172.21.15.18:0/2828327973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8558004800 0x7f8558004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.706+0000 7f856e7fc640 1 --2- 172.21.15.18:0/2828327973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85580051c0 0x7f855800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.706+0000 7f856e7fc640 1 -- 172.21.15.18:0/2828327973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f85700d3a20 con 0x7f8558003b40 2024-09-19T09:20:38.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.706+0000 7f856e7fc640 1 -- 172.21.15.18:0/2828327973 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f855800c0f0 con 0x7f85580051c0 2024-09-19T09:20:38.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.706+0000 7f856e7fc640 1 -- 172.21.15.18:0/2828327973 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f855800c2f0 con 0x7f8558004800 2024-09-19T09:20:38.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.706+0000 7f856f7fe640 1 --2- 172.21.15.18:0/2828327973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8558003b40 0x7f8558003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.707+0000 7f856ffff640 1 --2- 172.21.15.18:0/2828327973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85580051c0 0x7f855800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.707+0000 7f856effd640 1 --2- 172.21.15.18:0/2828327973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8558004800 0x7f8558004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.707+0000 7f856f7fe640 1 -- 172.21.15.18:0/2828327973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8558004800 msgr2=0x7f8558004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:38.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.707+0000 7f856f7fe640 1 --2- 172.21.15.18:0/2828327973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8558004800 0x7f8558004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.707+0000 7f856f7fe640 1 -- 172.21.15.18:0/2828327973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85580051c0 msgr2=0x7f855800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:38.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.707+0000 7f856f7fe640 1 --2- 172.21.15.18:0/2828327973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85580051c0 0x7f855800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.707+0000 7f856f7fe640 1 -- 172.21.15.18:0/2828327973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8558003520 con 0x7f8558003b40 2024-09-19T09:20:38.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.707+0000 7f856ffff640 1 --2- 172.21.15.18:0/2828327973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f85580051c0 0x7f855800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:38.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.707+0000 7f856ffff640 1 -- 172.21.15.18:0/2828327973 reap_dead start 2024-09-19T09:20:38.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.707+0000 7f856f7fe640 1 --2- 172.21.15.18:0/2828327973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8558003b40 0x7f8558003f40 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f85600018d0 tx=0x7f8558005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8939b45db1fc53d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:38.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.708+0000 7f856e7fc640 1 -- 172.21.15.18:0/2828327973 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85600014f0 con 0x7f8558003b40 2024-09-19T09:20:38.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.708+0000 7f856e7fc640 1 -- 172.21.15.18:0/2828327973 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85600052d0 con 0x7f8558003b40 2024-09-19T09:20:38.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.708+0000 7f856e7fc640 1 -- 172.21.15.18:0/2828327973 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856002ac40 con 0x7f8558003b40 2024-09-19T09:20:38.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.708+0000 7f857624c640 1 -- 172.21.15.18:0/2828327973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8558003b40 msgr2=0x7f8558003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:38.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.708+0000 7f857624c640 1 --2- 172.21.15.18:0/2828327973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8558003b40 0x7f8558003f40 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f85600018d0 tx=0x7f8558005830 comp rx=0 tx=0).stop 2024-09-19T09:20:38.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.708+0000 7f857624c640 1 -- 172.21.15.18:0/2828327973 shutdown_connections 2024-09-19T09:20:38.712 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.708+0000 7f857624c640 1 --2- 172.21.15.18:0/2828327973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8558003b40 0x7f8558003f40 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.708+0000 7f857624c640 1 -- 172.21.15.18:0/2828327973 >> 172.21.15.18:0/2828327973 conn(0x7f85700d4c60 msgr2=0x7f85700d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:38.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.708+0000 7f857624c640 1 -- 172.21.15.18:0/2828327973 shutdown_connections 2024-09-19T09:20:38.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.708+0000 7f857624c640 1 -- 172.21.15.18:0/2828327973 wait complete. 2024-09-19T09:20:38.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.709+0000 7f857624c640 1 Processor -- start 2024-09-19T09:20:38.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.710+0000 7f857624c640 1 -- start start 2024-09-19T09:20:38.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.710+0000 7f857624c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8558003b40 0x7f85701f5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.710+0000 7f857624c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8570158fd0 0x7f85701572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.710+0000 7f857624c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8570161590 0x7f85701619f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.710+0000 7f857624c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f85700d21a0 con 0x7f8570158fd0 2024-09-19T09:20:38.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.710+0000 7f857624c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f85700d2020 con 0x7f8558003b40 2024-09-19T09:20:38.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.710+0000 7f857624c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f85700d5780 con 0x7f8570161590 2024-09-19T09:20:38.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.710+0000 7f856effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8570158fd0 0x7f85701572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.710+0000 7f856effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8570158fd0 0x7f85701572b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53202/0 (socket says 172.21.15.18:53202) 2024-09-19T09:20:38.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.710+0000 7f856effd640 1 -- 172.21.15.18:0/497565 learned_addr learned my addr 172.21.15.18:0/497565 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:38.716 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.711+0000 7f856f7fe640 1 --2- 172.21.15.18:0/497565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8558003b40 0x7f85701f5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.711+0000 7f856effd640 1 -- 172.21.15.18:0/497565 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8570161590 msgr2=0x7f85701619f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:38.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.711+0000 7f856effd640 1 --2- 172.21.15.18:0/497565 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8570161590 0x7f85701619f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.711+0000 7f856effd640 1 -- 172.21.15.18:0/497565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8558003b40 msgr2=0x7f85701f5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:38.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.711+0000 7f856effd640 1 --2- 172.21.15.18:0/497565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8558003b40 0x7f85701f5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.711+0000 7f856effd640 1 -- 172.21.15.18:0/497565 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8570159740 con 0x7f8570158fd0 2024-09-19T09:20:38.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.711+0000 7f856effd640 1 --2- 172.21.15.18:0/497565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8570158fd0 0x7f85701572b0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f856400e730 tx=0x7f856400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:38.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.711+0000 7f8557fff640 1 -- 172.21.15.18:0/497565 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856400ee40 con 0x7f8570158fd0 2024-09-19T09:20:38.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.711+0000 7f8557fff640 1 -- 172.21.15.18:0/497565 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8564018070 con 0x7f8570158fd0 2024-09-19T09:20:38.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.711+0000 7f8557fff640 1 -- 172.21.15.18:0/497565 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856400c9d0 con 0x7f8570158fd0 2024-09-19T09:20:38.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.711+0000 7f857624c640 1 -- 172.21.15.18:0/497565 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8570159a20 con 0x7f8570158fd0 2024-09-19T09:20:38.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.711+0000 7f857624c640 1 -- 172.21.15.18:0/497565 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8570159fe0 con 0x7f8570158fd0 2024-09-19T09:20:38.717 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.712+0000 7f857624c640 1 -- 172.21.15.18:0/497565 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8570161f30 con 0x7f8570158fd0 2024-09-19T09:20:38.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.713+0000 7f8557fff640 1 -- 172.21.15.18:0/497565 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f856400cb70 con 0x7f8570158fd0 2024-09-19T09:20:38.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.713+0000 7f8557fff640 1 --2- 172.21.15.18:0/497565 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f855c06c2e0 0x7f855c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:38.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.713+0000 7f8557fff640 1 -- 172.21.15.18:0/497565 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f856408ae90 con 0x7f8570158fd0 2024-09-19T09:20:38.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.713+0000 7f856f7fe640 1 --2- 172.21.15.18:0/497565 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f855c06c2e0 0x7f855c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:38.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.714+0000 7f856f7fe640 1 --2- 172.21.15.18:0/497565 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f855c06c2e0 0x7f855c06e7a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8560032000 tx=0x7f8560009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:38.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.717+0000 7f8557fff640 1 -- 172.21.15.18:0/497565 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8564059600 con 0x7f8570158fd0 2024-09-19T09:20:38.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.895+0000 7f857624c640 1 -- 172.21.15.18:0/497565 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f85700d13a0 con 0x7f8570158fd0 2024-09-19T09:20:38.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.897+0000 7f8557fff640 1 -- 172.21.15.18:0/497565 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) ==== 74+0+16700 (secure 0 0 0) 0x7f8564058f00 con 0x7f8570158fd0 2024-09-19T09:20:38.898 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:20:38.898 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":154,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:20:36.720854+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:20:32.729922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-19T09:20:34.052744+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"154","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:20:38.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.899+0000 7f857624c640 1 -- 172.21.15.18:0/497565 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f855c06c2e0 msgr2=0x7f855c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:38.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.899+0000 7f857624c640 1 --2- 172.21.15.18:0/497565 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f855c06c2e0 0x7f855c06e7a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f8560032000 tx=0x7f8560009030 comp rx=0 tx=0).stop 2024-09-19T09:20:38.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.899+0000 7f857624c640 1 -- 172.21.15.18:0/497565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8570158fd0 msgr2=0x7f85701572b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:38.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.899+0000 7f857624c640 1 --2- 172.21.15.18:0/497565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8570158fd0 0x7f85701572b0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f856400e730 tx=0x7f856400ebf0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.899+0000 7f857624c640 1 -- 172.21.15.18:0/497565 shutdown_connections 2024-09-19T09:20:38.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.899+0000 7f857624c640 1 --2- 172.21.15.18:0/497565 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f855c06c2e0 0x7f855c06e7a0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.899+0000 7f857624c640 1 --2- 172.21.15.18:0/497565 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8570161590 0x7f85701619f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.899+0000 7f857624c640 1 --2- 172.21.15.18:0/497565 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8570158fd0 0x7f85701572b0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.899+0000 7f857624c640 1 --2- 172.21.15.18:0/497565 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8558003b40 0x7f85701f5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:38.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.899+0000 7f857624c640 1 -- 172.21.15.18:0/497565 >> 172.21.15.18:0/497565 conn(0x7f85700d4c60 msgr2=0x7f85700b8f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:38.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.899+0000 7f857624c640 1 -- 172.21.15.18:0/497565 shutdown_connections 2024-09-19T09:20:38.901 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:38.899+0000 7f857624c640 1 -- 172.21.15.18:0/497565 wait complete. 2024-09-19T09:20:38.911 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T09:20:38.911 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:20:39.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.012+0000 7f1c2bc17640 1 Processor -- start 2024-09-19T09:20:39.013 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.012+0000 7f1c2bc17640 1 -- start start 2024-09-19T09:20:39.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.013+0000 7f1c2bc17640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1c2413fae0 0x7f1c2406f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.013+0000 7f1c2bc17640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c24160c50 0x7f1c240cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.013+0000 7f1c2bc17640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c24142650 con 0x7f1c24142150 2024-09-19T09:20:39.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.013+0000 7f1c2bc17640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f1c240ce780 con 0x7f1c2413fae0 2024-09-19T09:20:39.014 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.013+0000 7f1c2bc17640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1c24142930 con 0x7f1c24160c50 2024-09-19T09:20:39.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.013+0000 7f1c299b3640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1c2413fae0 0x7f1c2406f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.013+0000 7f1c291b2640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f1c24142150 0x7f1c24160540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55072/0 (socket says 172.21.15.18:55072) 2024-09-19T09:20:39.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.013+0000 7f1c291b2640 1 -- 172.21.15.18:0/3560214879 learned_addr learned my addr 172.21.15.18:0/3560214879 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:20:39.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.013+0000 7f1c299b3640 1 -- 172.21.15.18:0/3560214879 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c24160c50 msgr2=0x7f1c240cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:39.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.013+0000 7f1c2a1b4640 1 --2- 172.21.15.18:0/3560214879 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c24160c50 0x7f1c240cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.013+0000 7f1c299b3640 1 --2- 172.21.15.18:0/3560214879 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c24160c50 0x7f1c240cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.013+0000 7f1c299b3640 1 -- 172.21.15.18:0/3560214879 >> v1:172.21.15.18:6789/0 conn(0x7f1c24142150 legacy=0x7f1c24160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:39.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.014+0000 7f1c299b3640 1 -- 172.21.15.18:0/3560214879 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c24142c10 con 0x7f1c2413fae0 2024-09-19T09:20:39.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.013+0000 7f1c289b1640 1 -- 172.21.15.18:0/3560214879 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 584736000 0 0) 0x7f1c24142650 con 0x7f1c24142150 2024-09-19T09:20:39.015 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.014+0000 7f1c2a1b4640 1 --2- 172.21.15.18:0/3560214879 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c24160c50 0x7f1c240cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:39.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.014+0000 7f1c299b3640 1 --2- 172.21.15.18:0/3560214879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c2413fae0 0x7f1c2406f1b0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0097a0 tx=0x7f1c1c02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e637c5fa1671e68c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:39.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.014+0000 7f1c289b1640 1 -- 172.21.15.18:0/3560214879 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c037070 con 0x7f1c2413fae0 2024-09-19T09:20:39.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.014+0000 7f1c289b1640 1 -- 172.21.15.18:0/3560214879 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c1c02ae50 con 0x7f1c2413fae0 2024-09-19T09:20:39.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.014+0000 7f1c289b1640 1 -- 172.21.15.18:0/3560214879 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c032660 con 0x7f1c2413fae0 2024-09-19T09:20:39.016 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.015+0000 7f1c2bc17640 1 -- 172.21.15.18:0/3560214879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c2413fae0 msgr2=0x7f1c2406f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:39.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.015+0000 7f1c2bc17640 1 --2- 172.21.15.18:0/3560214879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c2413fae0 0x7f1c2406f1b0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0097a0 tx=0x7f1c1c02a100 comp rx=0 tx=0).stop 2024-09-19T09:20:39.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.015+0000 7f1c2bc17640 1 -- 172.21.15.18:0/3560214879 shutdown_connections 2024-09-19T09:20:39.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.015+0000 7f1c2bc17640 1 --2- 172.21.15.18:0/3560214879 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c24160c50 0x7f1c240cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.015+0000 7f1c2bc17640 1 --2- 172.21.15.18:0/3560214879 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c2413fae0 0x7f1c2406f1b0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.015+0000 7f1c2bc17640 1 -- 172.21.15.18:0/3560214879 >> 172.21.15.18:0/3560214879 conn(0x7f1c2406bc10 msgr2=0x7f1c2406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:39.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.015+0000 7f1c2bc17640 1 -- 172.21.15.18:0/3560214879 shutdown_connections 2024-09-19T09:20:39.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.015+0000 7f1c2bc17640 1 -- 172.21.15.18:0/3560214879 wait complete. 2024-09-19T09:20:39.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.016+0000 7f1c2bc17640 1 Processor -- start 2024-09-19T09:20:39.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.016+0000 7f1c2bc17640 1 -- start start 2024-09-19T09:20:39.019 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.017+0000 7f1c2bc17640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c2413fae0 0x7f1c241564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.017+0000 7f1c2bc17640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c24142150 0x7f1c241411b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.017+0000 7f1c2bc17640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c24160c50 0x7f1c241416f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.017+0000 7f1c2bc17640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2406f870 con 0x7f1c24142150 2024-09-19T09:20:39.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.017+0000 7f1c2bc17640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1c2406f6f0 con 0x7f1c2413fae0 2024-09-19T09:20:39.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.017+0000 7f1c2bc17640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1c240cf150 con 0x7f1c24160c50 2024-09-19T09:20:39.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.017+0000 7f1c291b2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c24142150 0x7f1c241411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.017+0000 7f1c291b2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c24142150 0x7f1c241411b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53218/0 (socket says 172.21.15.18:53218) 2024-09-19T09:20:39.020 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.017+0000 7f1c291b2640 1 -- 172.21.15.18:0/3463882199 learned_addr learned my addr 172.21.15.18:0/3463882199 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:39.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.017+0000 7f1c299b3640 1 --2- 172.21.15.18:0/3463882199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c2413fae0 0x7f1c241564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.017+0000 7f1c291b2640 1 -- 172.21.15.18:0/3463882199 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c24160c50 msgr2=0x7f1c241416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:39.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.017+0000 7f1c2a1b4640 1 --2- 172.21.15.18:0/3463882199 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c24160c50 0x7f1c241416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.017+0000 7f1c291b2640 1 --2- 172.21.15.18:0/3463882199 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c24160c50 0x7f1c241416f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.017+0000 7f1c291b2640 1 -- 172.21.15.18:0/3463882199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c2413fae0 msgr2=0x7f1c241564b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:39.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.017+0000 7f1c291b2640 1 --2- 172.21.15.18:0/3463882199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c2413fae0 0x7f1c241564b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.017+0000 7f1c291b2640 1 -- 172.21.15.18:0/3463882199 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c241569f0 con 0x7f1c24142150 2024-09-19T09:20:39.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.017+0000 7f1c299b3640 1 --2- 172.21.15.18:0/3463882199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c2413fae0 0x7f1c241564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:39.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.018+0000 7f1c291b2640 1 --2- 172.21.15.18:0/3463882199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c24142150 0x7f1c241411b0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f1c1800c4d0 tx=0x7f1c1800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:39.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.018+0000 7f1c227fc640 1 -- 172.21.15.18:0/3463882199 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c18018070 con 0x7f1c24142150 2024-09-19T09:20:39.021 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.018+0000 7f1c227fc640 1 -- 172.21.15.18:0/3463882199 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c18007500 con 0x7f1c24142150 2024-09-19T09:20:39.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.018+0000 7f1c227fc640 1 -- 172.21.15.18:0/3463882199 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c18004a20 con 0x7f1c24142150 2024-09-19T09:20:39.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.018+0000 7f1c2bc17640 1 -- 172.21.15.18:0/3463882199 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c2413cd10 con 0x7f1c24142150 2024-09-19T09:20:39.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.018+0000 7f1c2bc17640 1 -- 172.21.15.18:0/3463882199 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c2413d2d0 con 0x7f1c24142150 2024-09-19T09:20:39.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.019+0000 7f1c2bc17640 1 -- 172.21.15.18:0/3463882199 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c2406f1b0 con 0x7f1c24142150 2024-09-19T09:20:39.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.019+0000 7f1c227fc640 1 -- 172.21.15.18:0/3463882199 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1c18004bc0 con 0x7f1c24142150 2024-09-19T09:20:39.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.020+0000 7f1c227fc640 1 --2- 172.21.15.18:0/3463882199 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1c1006c2b0 0x7f1c1006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.020+0000 7f1c227fc640 1 -- 172.21.15.18:0/3463882199 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f1c1808a670 con 0x7f1c24142150 2024-09-19T09:20:39.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.020+0000 7f1c299b3640 1 --2- 172.21.15.18:0/3463882199 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1c1006c2b0 0x7f1c1006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.021+0000 7f1c299b3640 1 --2- 172.21.15.18:0/3463882199 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1c1006c2b0 0x7f1c1006e770 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c034000 tx=0x7f1c1c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:39.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.024+0000 7f1c227fc640 1 -- 172.21.15.18:0/3463882199 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1c18058e70 con 0x7f1c24142150 2024-09-19T09:20:39.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.195+0000 7f1c2bc17640 1 -- 172.21.15.18:0/3463882199 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1c2413cac0 con 0x7f1c1006c2b0 2024-09-19T09:20:39.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.202+0000 7f1c227fc640 1 -- 172.21.15.18:0/3463882199 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247925 (secure 0 0 0) 0x7f1c2413cac0 con 0x7f1c1006c2b0 2024-09-19T09:20:39.206 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:20:39.209 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:20:39.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.205+0000 7f1c2bc17640 1 -- 172.21.15.18:0/3463882199 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1c1006c2b0 msgr2=0x7f1c1006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:39.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.205+0000 7f1c2bc17640 1 --2- 172.21.15.18:0/3463882199 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1c1006c2b0 0x7f1c1006e770 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c034000 tx=0x7f1c1c02e000 comp rx=0 tx=0).stop 2024-09-19T09:20:39.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.205+0000 7f1c2bc17640 1 -- 172.21.15.18:0/3463882199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c24142150 msgr2=0x7f1c241411b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:39.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.205+0000 7f1c2bc17640 1 --2- 172.21.15.18:0/3463882199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c24142150 0x7f1c241411b0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f1c1800c4d0 tx=0x7f1c1800c990 comp rx=0 tx=0).stop 2024-09-19T09:20:39.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.205+0000 7f1c2bc17640 1 -- 172.21.15.18:0/3463882199 shutdown_connections 2024-09-19T09:20:39.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.205+0000 7f1c2bc17640 1 --2- 172.21.15.18:0/3463882199 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1c1006c2b0 0x7f1c1006e770 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.205+0000 7f1c2bc17640 1 --2- 172.21.15.18:0/3463882199 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1c24160c50 0x7f1c241416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.205+0000 7f1c2bc17640 1 --2- 172.21.15.18:0/3463882199 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1c24142150 0x7f1c241411b0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.205+0000 7f1c2bc17640 1 --2- 172.21.15.18:0/3463882199 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1c2413fae0 0x7f1c241564b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.205+0000 7f1c2bc17640 1 -- 172.21.15.18:0/3463882199 >> 172.21.15.18:0/3463882199 conn(0x7f1c2406bc10 msgr2=0x7f1c240cf530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:39.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.205+0000 7f1c2bc17640 1 -- 172.21.15.18:0/3463882199 shutdown_connections 2024-09-19T09:20:39.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.205+0000 7f1c2bc17640 1 -- 172.21.15.18:0/3463882199 wait complete. 2024-09-19T09:20:39.218 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":366,"stamp":"2024-09-19T09:20:37.627802+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":126,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7817,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554682,"statfs":{"total":1600000000,"available":1591995004,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000849"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.730476+0000","last_change":"2024-09-19T09:20:35.730369+0000","last_active":"2024-09-19T09:20:35.730476+0000","last_peered":"2024-09-19T09:20:35.730476+0000","last_clean":"2024-09-19T09:20:35.730476+0000","last_became_active":"2024-09-19T09:20:35.729745+0000","last_became_peered":"2024-09-19T09:20:35.729745+0000","last_unstale":"2024-09-19T09:20:35.730476+0000","last_undegraded":"2024-09-19T09:20:35.730476+0000","last_fullsized":"2024-09-19T09:20:35.730476+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:15.963387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.732488+0000","last_change":"2024-09-19T09:20:35.732320+0000","last_active":"2024-09-19T09:20:35.732488+0000","last_peered":"2024-09-19T09:20:35.732488+0000","last_clean":"2024-09-19T09:20:35.732488+0000","last_became_active":"2024-09-19T09:20:35.731898+0000","last_became_peered":"2024-09-19T09:20:35.731898+0000","last_unstale":"2024-09-19T09:20:35.732488+0000","last_undegraded":"2024-09-19T09:20:35.732488+0000","last_fullsized":"2024-09-19T09:20:35.732488+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:42.150086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.731838+0000","last_change":"2024-09-19T09:20:35.731696+0000","last_active":"2024-09-19T09:20:35.731838+0000","last_peered":"2024-09-19T09:20:35.731838+0000","last_clean":"2024-09-19T09:20:35.731838+0000","last_became_active":"2024-09-19T09:20:35.731413+0000","last_became_peered":"2024-09-19T09:20:35.731413+0000","last_unstale":"2024-09-19T09:20:35.731838+0000","last_undegraded":"2024-09-19T09:20:35.731838+0000","last_fullsized":"2024-09-19T09:20:35.731838+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:18.128538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.724818+0000","last_change":"2024-09-19T09:20:35.724537+0000","last_active":"2024-09-19T09:20:35.724818+0000","last_peered":"2024-09-19T09:20:35.724818+0000","last_clean":"2024-09-19T09:20:35.724818+0000","last_became_active":"2024-09-19T09:20:35.724212+0000","last_became_peered":"2024-09-19T09:20:35.724212+0000","last_unstale":"2024-09-19T09:20:35.724818+0000","last_undegraded":"2024-09-19T09:20:35.724818+0000","last_fullsized":"2024-09-19T09:20:35.724818+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:14:40.788397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.737265+0000","last_change":"2024-09-19T09:20:35.737144+0000","last_active":"2024-09-19T09:20:35.737265+0000","last_peered":"2024-09-19T09:20:35.737265+0000","last_clean":"2024-09-19T09:20:35.737265+0000","last_became_active":"2024-09-19T09:20:35.736907+0000","last_became_peered":"2024-09-19T09:20:35.736907+0000","last_unstale":"2024-09-19T09:20:35.737265+0000","last_undegraded":"2024-09-19T09:20:35.737265+0000","last_fullsized":"2024-09-19T09:20:35.737265+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:14.206042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.724953+0000","last_change":"2024-09-19T09:20:35.724818+0000","last_active":"2024-09-19T09:20:35.724953+0000","last_peered":"2024-09-19T09:20:35.724953+0000","last_clean":"2024-09-19T09:20:35.724953+0000","last_became_active":"2024-09-19T09:20:35.724188+0000","last_became_peered":"2024-09-19T09:20:35.724188+0000","last_unstale":"2024-09-19T09:20:35.724953+0000","last_undegraded":"2024-09-19T09:20:35.724953+0000","last_fullsized":"2024-09-19T09:20:35.724953+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:18:01.447466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.733055+0000","last_change":"2024-09-19T09:20:35.732550+0000","last_active":"2024-09-19T09:20:35.733055+0000","last_peered":"2024-09-19T09:20:35.733055+0000","last_clean":"2024-09-19T09:20:35.733055+0000","last_became_active":"2024-09-19T09:20:35.732211+0000","last_became_peered":"2024-09-19T09:20:35.732211+0000","last_unstale":"2024-09-19T09:20:35.733055+0000","last_undegraded":"2024-09-19T09:20:35.733055+0000","last_fullsized":"2024-09-19T09:20:35.733055+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:33.786302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.726088+0000","last_change":"2024-09-19T09:20:35.724245+0000","last_active":"2024-09-19T09:20:35.726088+0000","last_peered":"2024-09-19T09:20:35.726088+0000","last_clean":"2024-09-19T09:20:35.726088+0000","last_became_active":"2024-09-19T09:20:35.723967+0000","last_became_peered":"2024-09-19T09:20:35.723967+0000","last_unstale":"2024-09-19T09:20:35.726088+0000","last_undegraded":"2024-09-19T09:20:35.726088+0000","last_fullsized":"2024-09-19T09:20:35.726088+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:07.472140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.737423+0000","last_change":"2024-09-19T09:20:35.737184+0000","last_active":"2024-09-19T09:20:35.737423+0000","last_peered":"2024-09-19T09:20:35.737423+0000","last_clean":"2024-09-19T09:20:35.737423+0000","last_became_active":"2024-09-19T09:20:35.736684+0000","last_became_peered":"2024-09-19T09:20:35.736684+0000","last_unstale":"2024-09-19T09:20:35.737423+0000","last_undegraded":"2024-09-19T09:20:35.737423+0000","last_fullsized":"2024-09-19T09:20:35.737423+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:00.417484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.736493+0000","last_change":"2024-09-19T09:20:35.736379+0000","last_active":"2024-09-19T09:20:35.736493+0000","last_peered":"2024-09-19T09:20:35.736493+0000","last_clean":"2024-09-19T09:20:35.736493+0000","last_became_active":"2024-09-19T09:20:35.736103+0000","last_became_peered":"2024-09-19T09:20:35.736103+0000","last_unstale":"2024-09-19T09:20:35.736493+0000","last_undegraded":"2024-09-19T09:20:35.736493+0000","last_fullsized":"2024-09-19T09:20:35.736493+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:37.244871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.730078+0000","last_change":"2024-09-19T09:20:35.729966+0000","last_active":"2024-09-19T09:20:35.730078+0000","last_peered":"2024-09-19T09:20:35.730078+0000","last_clean":"2024-09-19T09:20:35.730078+0000","last_became_active":"2024-09-19T09:20:35.729736+0000","last_became_peered":"2024-09-19T09:20:35.729736+0000","last_unstale":"2024-09-19T09:20:35.730078+0000","last_undegraded":"2024-09-19T09:20:35.730078+0000","last_fullsized":"2024-09-19T09:20:35.730078+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:53.097249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.731814+0000","last_change":"2024-09-19T09:20:35.731696+0000","last_active":"2024-09-19T09:20:35.731814+0000","last_peered":"2024-09-19T09:20:35.731814+0000","last_clean":"2024-09-19T09:20:35.731814+0000","last_became_active":"2024-09-19T09:20:35.731464+0000","last_became_peered":"2024-09-19T09:20:35.731464+0000","last_unstale":"2024-09-19T09:20:35.731814+0000","last_undegraded":"2024-09-19T09:20:35.731814+0000","last_fullsized":"2024-09-19T09:20:35.731814+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:29.565125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.733149+0000","last_change":"2024-09-19T09:20:35.733024+0000","last_active":"2024-09-19T09:20:35.733149+0000","last_peered":"2024-09-19T09:20:35.733149+0000","last_clean":"2024-09-19T09:20:35.733149+0000","last_became_active":"2024-09-19T09:20:35.732785+0000","last_became_peered":"2024-09-19T09:20:35.732785+0000","last_unstale":"2024-09-19T09:20:35.733149+0000","last_undegraded":"2024-09-19T09:20:35.733149+0000","last_fullsized":"2024-09-19T09:20:35.733149+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:49.820960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.728651+0000","last_change":"2024-09-19T09:20:35.728544+0000","last_active":"2024-09-19T09:20:35.728651+0000","last_peered":"2024-09-19T09:20:35.728651+0000","last_clean":"2024-09-19T09:20:35.728651+0000","last_became_active":"2024-09-19T09:20:35.726697+0000","last_became_peered":"2024-09-19T09:20:35.726697+0000","last_unstale":"2024-09-19T09:20:35.728651+0000","last_undegraded":"2024-09-19T09:20:35.728651+0000","last_fullsized":"2024-09-19T09:20:35.728651+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:10:35.560486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.725983+0000","last_change":"2024-09-19T09:20:35.722583+0000","last_active":"2024-09-19T09:20:35.725983+0000","last_peered":"2024-09-19T09:20:35.725983+0000","last_clean":"2024-09-19T09:20:35.725983+0000","last_became_active":"2024-09-19T09:20:35.722339+0000","last_became_peered":"2024-09-19T09:20:35.722339+0000","last_unstale":"2024-09-19T09:20:35.725983+0000","last_undegraded":"2024-09-19T09:20:35.725983+0000","last_fullsized":"2024-09-19T09:20:35.725983+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:24.196075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.735003+0000","last_change":"2024-09-19T09:20:35.734914+0000","last_active":"2024-09-19T09:20:35.735003+0000","last_peered":"2024-09-19T09:20:35.735003+0000","last_clean":"2024-09-19T09:20:35.735003+0000","last_became_active":"2024-09-19T09:20:35.734678+0000","last_became_peered":"2024-09-19T09:20:35.734678+0000","last_unstale":"2024-09-19T09:20:35.735003+0000","last_undegraded":"2024-09-19T09:20:35.735003+0000","last_fullsized":"2024-09-19T09:20:35.735003+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:10:48.362502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.736974+0000","last_change":"2024-09-19T09:20:35.732910+0000","last_active":"2024-09-19T09:20:35.736974+0000","last_peered":"2024-09-19T09:20:35.736974+0000","last_clean":"2024-09-19T09:20:35.736974+0000","last_became_active":"2024-09-19T09:20:35.732340+0000","last_became_peered":"2024-09-19T09:20:35.732340+0000","last_unstale":"2024-09-19T09:20:35.736974+0000","last_undegraded":"2024-09-19T09:20:35.736974+0000","last_fullsized":"2024-09-19T09:20:35.736974+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:55:56.708820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.732098+0000","last_change":"2024-09-19T09:20:35.731768+0000","last_active":"2024-09-19T09:20:35.732098+0000","last_peered":"2024-09-19T09:20:35.732098+0000","last_clean":"2024-09-19T09:20:35.732098+0000","last_became_active":"2024-09-19T09:20:35.731537+0000","last_became_peered":"2024-09-19T09:20:35.731537+0000","last_unstale":"2024-09-19T09:20:35.732098+0000","last_undegraded":"2024-09-19T09:20:35.732098+0000","last_fullsized":"2024-09-19T09:20:35.732098+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:11.717331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.729512+0000","last_change":"2024-09-19T09:20:35.727595+0000","last_active":"2024-09-19T09:20:35.729512+0000","last_peered":"2024-09-19T09:20:35.729512+0000","last_clean":"2024-09-19T09:20:35.729512+0000","last_became_active":"2024-09-19T09:20:35.724969+0000","last_became_peered":"2024-09-19T09:20:35.724969+0000","last_unstale":"2024-09-19T09:20:35.729512+0000","last_undegraded":"2024-09-19T09:20:35.729512+0000","last_fullsized":"2024-09-19T09:20:35.729512+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:00.570871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.719377+0000","last_change":"2024-09-19T09:20:35.719244+0000","last_active":"2024-09-19T09:20:35.719377+0000","last_peered":"2024-09-19T09:20:35.719377+0000","last_clean":"2024-09-19T09:20:35.719377+0000","last_became_active":"2024-09-19T09:20:35.718964+0000","last_became_peered":"2024-09-19T09:20:35.718964+0000","last_unstale":"2024-09-19T09:20:35.719377+0000","last_undegraded":"2024-09-19T09:20:35.719377+0000","last_fullsized":"2024-09-19T09:20:35.719377+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:19:10.616606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.730978+0000","last_change":"2024-09-19T09:20:35.730114+0000","last_active":"2024-09-19T09:20:35.730978+0000","last_peered":"2024-09-19T09:20:35.730978+0000","last_clean":"2024-09-19T09:20:35.730978+0000","last_became_active":"2024-09-19T09:20:35.729826+0000","last_became_peered":"2024-09-19T09:20:35.729826+0000","last_unstale":"2024-09-19T09:20:35.730978+0000","last_undegraded":"2024-09-19T09:20:35.730978+0000","last_fullsized":"2024-09-19T09:20:35.730978+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:17.531800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.731542+0000","last_change":"2024-09-19T09:20:35.731399+0000","last_active":"2024-09-19T09:20:35.731542+0000","last_peered":"2024-09-19T09:20:35.731542+0000","last_clean":"2024-09-19T09:20:35.731542+0000","last_became_active":"2024-09-19T09:20:35.730897+0000","last_became_peered":"2024-09-19T09:20:35.730897+0000","last_unstale":"2024-09-19T09:20:35.731542+0000","last_undegraded":"2024-09-19T09:20:35.731542+0000","last_fullsized":"2024-09-19T09:20:35.731542+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:01.702729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.739653+0000","last_change":"2024-09-19T09:20:35.739216+0000","last_active":"2024-09-19T09:20:35.739653+0000","last_peered":"2024-09-19T09:20:35.739653+0000","last_clean":"2024-09-19T09:20:35.739653+0000","last_became_active":"2024-09-19T09:20:35.738026+0000","last_became_peered":"2024-09-19T09:20:35.738026+0000","last_unstale":"2024-09-19T09:20:35.739653+0000","last_undegraded":"2024-09-19T09:20:35.739653+0000","last_fullsized":"2024-09-19T09:20:35.739653+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:37.702986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.726043+0000","last_change":"2024-09-19T09:20:35.724839+0000","last_active":"2024-09-19T09:20:35.726043+0000","last_peered":"2024-09-19T09:20:35.726043+0000","last_clean":"2024-09-19T09:20:35.726043+0000","last_became_active":"2024-09-19T09:20:35.724644+0000","last_became_peered":"2024-09-19T09:20:35.724644+0000","last_unstale":"2024-09-19T09:20:35.726043+0000","last_undegraded":"2024-09-19T09:20:35.726043+0000","last_fullsized":"2024-09-19T09:20:35.726043+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:16.347281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.724796+0000","last_change":"2024-09-19T09:20:35.724497+0000","last_active":"2024-09-19T09:20:35.724796+0000","last_peered":"2024-09-19T09:20:35.724796+0000","last_clean":"2024-09-19T09:20:35.724796+0000","last_became_active":"2024-09-19T09:20:35.723988+0000","last_became_peered":"2024-09-19T09:20:35.723988+0000","last_unstale":"2024-09-19T09:20:35.724796+0000","last_undegraded":"2024-09-19T09:20:35.724796+0000","last_fullsized":"2024-09-19T09:20:35.724796+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:52.674176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.730213+0000","last_change":"2024-09-19T09:20:35.730080+0000","last_active":"2024-09-19T09:20:35.730213+0000","last_peered":"2024-09-19T09:20:35.730213+0000","last_clean":"2024-09-19T09:20:35.730213+0000","last_became_active":"2024-09-19T09:20:35.729372+0000","last_became_peered":"2024-09-19T09:20:35.729372+0000","last_unstale":"2024-09-19T09:20:35.730213+0000","last_undegraded":"2024-09-19T09:20:35.730213+0000","last_fullsized":"2024-09-19T09:20:35.730213+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:56.430610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.725960+0000","last_change":"2024-09-19T09:20:35.724769+0000","last_active":"2024-09-19T09:20:35.725960+0000","last_peered":"2024-09-19T09:20:35.725960+0000","last_clean":"2024-09-19T09:20:35.725960+0000","last_became_active":"2024-09-19T09:20:35.724545+0000","last_became_peered":"2024-09-19T09:20:35.724545+0000","last_unstale":"2024-09-19T09:20:35.725960+0000","last_undegraded":"2024-09-19T09:20:35.725960+0000","last_fullsized":"2024-09-19T09:20:35.725960+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:21.691899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.739558+0000","last_change":"2024-09-19T09:20:35.738542+0000","last_active":"2024-09-19T09:20:35.739558+0000","last_peered":"2024-09-19T09:20:35.739558+0000","last_clean":"2024-09-19T09:20:35.739558+0000","last_became_active":"2024-09-19T09:20:35.736744+0000","last_became_peered":"2024-09-19T09:20:35.736744+0000","last_unstale":"2024-09-19T09:20:35.739558+0000","last_undegraded":"2024-09-19T09:20:35.739558+0000","last_fullsized":"2024-09-19T09:20:35.739558+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:20.539492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.730234+0000","last_change":"2024-09-19T09:20:35.730140+0000","last_active":"2024-09-19T09:20:35.730234+0000","last_peered":"2024-09-19T09:20:35.730234+0000","last_clean":"2024-09-19T09:20:35.730234+0000","last_became_active":"2024-09-19T09:20:35.729848+0000","last_became_peered":"2024-09-19T09:20:35.729848+0000","last_unstale":"2024-09-19T09:20:35.730234+0000","last_undegraded":"2024-09-19T09:20:35.730234+0000","last_fullsized":"2024-09-19T09:20:35.730234+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:14.762991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.726877+0000","last_change":"2024-09-19T09:20:35.726763+0000","last_active":"2024-09-19T09:20:35.726877+0000","last_peered":"2024-09-19T09:20:35.726877+0000","last_clean":"2024-09-19T09:20:35.726877+0000","last_became_active":"2024-09-19T09:20:35.726539+0000","last_became_peered":"2024-09-19T09:20:35.726539+0000","last_unstale":"2024-09-19T09:20:35.726877+0000","last_undegraded":"2024-09-19T09:20:35.726877+0000","last_fullsized":"2024-09-19T09:20:35.726877+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:23.746831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.729247+0000","last_change":"2024-09-19T09:20:35.728628+0000","last_active":"2024-09-19T09:20:35.729247+0000","last_peered":"2024-09-19T09:20:35.729247+0000","last_clean":"2024-09-19T09:20:35.729247+0000","last_became_active":"2024-09-19T09:20:35.728378+0000","last_became_peered":"2024-09-19T09:20:35.728378+0000","last_unstale":"2024-09-19T09:20:35.729247+0000","last_undegraded":"2024-09-19T09:20:35.729247+0000","last_fullsized":"2024-09-19T09:20:35.729247+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:19.788225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.737401+0000","last_change":"2024-09-19T09:20:35.737164+0000","last_active":"2024-09-19T09:20:35.737401+0000","last_peered":"2024-09-19T09:20:35.737401+0000","last_clean":"2024-09-19T09:20:35.737401+0000","last_became_active":"2024-09-19T09:20:35.732671+0000","last_became_peered":"2024-09-19T09:20:35.732671+0000","last_unstale":"2024-09-19T09:20:35.737401+0000","last_undegraded":"2024-09-19T09:20:35.737401+0000","last_fullsized":"2024-09-19T09:20:35.737401+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:00.428526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.737119+0000","last_change":"2024-09-19T09:20:35.736993+0000","last_active":"2024-09-19T09:20:35.737119+0000","last_peered":"2024-09-19T09:20:35.737119+0000","last_clean":"2024-09-19T09:20:35.737119+0000","last_became_active":"2024-09-19T09:20:35.736698+0000","last_became_peered":"2024-09-19T09:20:35.736698+0000","last_unstale":"2024-09-19T09:20:35.737119+0000","last_undegraded":"2024-09-19T09:20:35.737119+0000","last_fullsized":"2024-09-19T09:20:35.737119+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:20.851884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"153'4","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.743868+0000","last_change":"2024-09-19T09:20:34.717241+0000","last_active":"2024-09-19T09:20:35.743868+0000","last_peered":"2024-09-19T09:20:35.743868+0000","last_clean":"2024-09-19T09:20:35.743868+0000","last_became_active":"2024-09-19T09:20:34.716343+0000","last_became_peered":"2024-09-19T09:20:34.716343+0000","last_unstale":"2024-09-19T09:20:35.743868+0000","last_undegraded":"2024-09-19T09:20:35.743868+0000","last_fullsized":"2024-09-19T09:20:35.743868+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:07.142150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.733344+0000","last_change":"2024-09-19T09:20:35.732560+0000","last_active":"2024-09-19T09:20:35.733344+0000","last_peered":"2024-09-19T09:20:35.733344+0000","last_clean":"2024-09-19T09:20:35.733344+0000","last_became_active":"2024-09-19T09:20:35.732303+0000","last_became_peered":"2024-09-19T09:20:35.732303+0000","last_unstale":"2024-09-19T09:20:35.733344+0000","last_undegraded":"2024-09-19T09:20:35.733344+0000","last_fullsized":"2024-09-19T09:20:35.733344+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:37:54.379424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"153'1","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.742732+0000","last_change":"2024-09-19T09:20:34.714290+0000","last_active":"2024-09-19T09:20:35.742732+0000","last_peered":"2024-09-19T09:20:35.742732+0000","last_clean":"2024-09-19T09:20:35.742732+0000","last_became_active":"2024-09-19T09:20:34.713628+0000","last_became_peered":"2024-09-19T09:20:34.713628+0000","last_unstale":"2024-09-19T09:20:35.742732+0000","last_undegraded":"2024-09-19T09:20:35.742732+0000","last_fullsized":"2024-09-19T09:20:35.742732+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:32.391640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.735586+0000","last_change":"2024-09-19T09:20:35.735467+0000","last_active":"2024-09-19T09:20:35.735586+0000","last_peered":"2024-09-19T09:20:35.735586+0000","last_clean":"2024-09-19T09:20:35.735586+0000","last_became_active":"2024-09-19T09:20:35.734833+0000","last_became_peered":"2024-09-19T09:20:35.734833+0000","last_unstale":"2024-09-19T09:20:35.735586+0000","last_undegraded":"2024-09-19T09:20:35.735586+0000","last_fullsized":"2024-09-19T09:20:35.735586+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:57.745780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1d","version":"153'2","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.737263+0000","last_change":"2024-09-19T09:20:34.713417+0000","last_active":"2024-09-19T09:20:35.737263+0000","last_peered":"2024-09-19T09:20:35.737263+0000","last_clean":"2024-09-19T09:20:35.737263+0000","last_became_active":"2024-09-19T09:20:34.713173+0000","last_became_peered":"2024-09-19T09:20:34.713173+0000","last_unstale":"2024-09-19T09:20:35.737263+0000","last_undegraded":"2024-09-19T09:20:35.737263+0000","last_fullsized":"2024-09-19T09:20:35.737263+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:11.683428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.735746+0000","last_change":"2024-09-19T09:20:35.735626+0000","last_active":"2024-09-19T09:20:35.735746+0000","last_peered":"2024-09-19T09:20:35.735746+0000","last_clean":"2024-09-19T09:20:35.735746+0000","last_became_active":"2024-09-19T09:20:35.734579+0000","last_became_peered":"2024-09-19T09:20:35.734579+0000","last_unstale":"2024-09-19T09:20:35.735746+0000","last_undegraded":"2024-09-19T09:20:35.735746+0000","last_fullsized":"2024-09-19T09:20:35.735746+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:47:00.408921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1c","version":"153'2","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.740032+0000","last_change":"2024-09-19T09:20:34.713768+0000","last_active":"2024-09-19T09:20:35.740032+0000","last_peered":"2024-09-19T09:20:35.740032+0000","last_clean":"2024-09-19T09:20:35.740032+0000","last_became_active":"2024-09-19T09:20:34.713343+0000","last_became_peered":"2024-09-19T09:20:34.713343+0000","last_unstale":"2024-09-19T09:20:35.740032+0000","last_undegraded":"2024-09-19T09:20:35.740032+0000","last_fullsized":"2024-09-19T09:20:35.740032+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:50.508570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.726026+0000","last_change":"2024-09-19T09:20:35.724426+0000","last_active":"2024-09-19T09:20:35.726026+0000","last_peered":"2024-09-19T09:20:35.726026+0000","last_clean":"2024-09-19T09:20:35.726026+0000","last_became_active":"2024-09-19T09:20:35.724173+0000","last_became_peered":"2024-09-19T09:20:35.724173+0000","last_unstale":"2024-09-19T09:20:35.726026+0000","last_undegraded":"2024-09-19T09:20:35.726026+0000","last_fullsized":"2024-09-19T09:20:35.726026+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:30.440307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"153'1","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.740546+0000","last_change":"2024-09-19T09:20:34.712966+0000","last_active":"2024-09-19T09:20:35.740546+0000","last_peered":"2024-09-19T09:20:35.740546+0000","last_clean":"2024-09-19T09:20:35.740546+0000","last_became_active":"2024-09-19T09:20:34.712458+0000","last_became_peered":"2024-09-19T09:20:34.712458+0000","last_unstale":"2024-09-19T09:20:35.740546+0000","last_undegraded":"2024-09-19T09:20:35.740546+0000","last_fullsized":"2024-09-19T09:20:35.740546+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:02.706947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.727762+0000","last_change":"2024-09-19T09:20:35.727262+0000","last_active":"2024-09-19T09:20:35.727762+0000","last_peered":"2024-09-19T09:20:35.727762+0000","last_clean":"2024-09-19T09:20:35.727762+0000","last_became_active":"2024-09-19T09:20:35.727025+0000","last_became_peered":"2024-09-19T09:20:35.727025+0000","last_unstale":"2024-09-19T09:20:35.727762+0000","last_undegraded":"2024-09-19T09:20:35.727762+0000","last_fullsized":"2024-09-19T09:20:35.727762+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:42.818527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"153'1","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.738308+0000","last_change":"2024-09-19T09:20:34.714109+0000","last_active":"2024-09-19T09:20:35.738308+0000","last_peered":"2024-09-19T09:20:35.738308+0000","last_clean":"2024-09-19T09:20:35.738308+0000","last_became_active":"2024-09-19T09:20:34.713865+0000","last_became_peered":"2024-09-19T09:20:34.713865+0000","last_unstale":"2024-09-19T09:20:35.738308+0000","last_undegraded":"2024-09-19T09:20:35.738308+0000","last_fullsized":"2024-09-19T09:20:35.738308+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:32.323414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.736187+0000","last_change":"2024-09-19T09:20:35.736078+0000","last_active":"2024-09-19T09:20:35.736187+0000","last_peered":"2024-09-19T09:20:35.736187+0000","last_clean":"2024-09-19T09:20:35.736187+0000","last_became_active":"2024-09-19T09:20:35.735397+0000","last_became_peered":"2024-09-19T09:20:35.735397+0000","last_unstale":"2024-09-19T09:20:35.736187+0000","last_undegraded":"2024-09-19T09:20:35.736187+0000","last_fullsized":"2024-09-19T09:20:35.736187+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:09.771361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.736037+0000","last_change":"2024-09-19T09:20:34.713251+0000","last_active":"2024-09-19T09:20:35.736037+0000","last_peered":"2024-09-19T09:20:35.736037+0000","last_clean":"2024-09-19T09:20:35.736037+0000","last_became_active":"2024-09-19T09:20:34.712998+0000","last_became_peered":"2024-09-19T09:20:34.712998+0000","last_unstale":"2024-09-19T09:20:35.736037+0000","last_undegraded":"2024-09-19T09:20:35.736037+0000","last_fullsized":"2024-09-19T09:20:35.736037+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:57.611422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.729493+0000","last_change":"2024-09-19T09:20:35.727368+0000","last_active":"2024-09-19T09:20:35.729493+0000","last_peered":"2024-09-19T09:20:35.729493+0000","last_clean":"2024-09-19T09:20:35.729493+0000","last_became_active":"2024-09-19T09:20:35.724655+0000","last_became_peered":"2024-09-19T09:20:35.724655+0000","last_unstale":"2024-09-19T09:20:35.729493+0000","last_undegraded":"2024-09-19T09:20:35.729493+0000","last_fullsized":"2024-09-19T09:20:35.729493+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:01.443831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.723673+0000","last_change":"2024-09-19T09:20:34.712185+0000","last_active":"2024-09-19T09:20:35.723673+0000","last_peered":"2024-09-19T09:20:35.723673+0000","last_clean":"2024-09-19T09:20:35.723673+0000","last_became_active":"2024-09-19T09:20:34.711184+0000","last_became_peered":"2024-09-19T09:20:34.711184+0000","last_unstale":"2024-09-19T09:20:35.723673+0000","last_undegraded":"2024-09-19T09:20:35.723673+0000","last_fullsized":"2024-09-19T09:20:35.723673+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:59.515122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.731503+0000","last_change":"2024-09-19T09:20:35.731186+0000","last_active":"2024-09-19T09:20:35.731503+0000","last_peered":"2024-09-19T09:20:35.731503+0000","last_clean":"2024-09-19T09:20:35.731503+0000","last_became_active":"2024-09-19T09:20:35.730539+0000","last_became_peered":"2024-09-19T09:20:35.730539+0000","last_unstale":"2024-09-19T09:20:35.731503+0000","last_undegraded":"2024-09-19T09:20:35.731503+0000","last_fullsized":"2024-09-19T09:20:35.731503+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:42.641523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.721022+0000","last_change":"2024-09-19T09:20:34.716878+0000","last_active":"2024-09-19T09:20:35.721022+0000","last_peered":"2024-09-19T09:20:35.721022+0000","last_clean":"2024-09-19T09:20:35.721022+0000","last_became_active":"2024-09-19T09:20:34.716295+0000","last_became_peered":"2024-09-19T09:20:34.716295+0000","last_unstale":"2024-09-19T09:20:35.721022+0000","last_undegraded":"2024-09-19T09:20:35.721022+0000","last_fullsized":"2024-09-19T09:20:35.721022+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:45:22.730590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.729638+0000","last_change":"2024-09-19T09:20:35.729389+0000","last_active":"2024-09-19T09:20:35.729638+0000","last_peered":"2024-09-19T09:20:35.729638+0000","last_clean":"2024-09-19T09:20:35.729638+0000","last_became_active":"2024-09-19T09:20:35.729158+0000","last_became_peered":"2024-09-19T09:20:35.729158+0000","last_unstale":"2024-09-19T09:20:35.729638+0000","last_undegraded":"2024-09-19T09:20:35.729638+0000","last_fullsized":"2024-09-19T09:20:35.729638+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:37:15.957997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.716456+0000","last_change":"2024-09-19T09:20:34.712526+0000","last_active":"2024-09-19T09:20:35.716456+0000","last_peered":"2024-09-19T09:20:35.716456+0000","last_clean":"2024-09-19T09:20:35.716456+0000","last_became_active":"2024-09-19T09:20:34.711857+0000","last_became_peered":"2024-09-19T09:20:34.711857+0000","last_unstale":"2024-09-19T09:20:35.716456+0000","last_undegraded":"2024-09-19T09:20:35.716456+0000","last_fullsized":"2024-09-19T09:20:35.716456+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:29.191878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.732774+0000","last_change":"2024-09-19T09:20:35.732542+0000","last_active":"2024-09-19T09:20:35.732774+0000","last_peered":"2024-09-19T09:20:35.732774+0000","last_clean":"2024-09-19T09:20:35.732774+0000","last_became_active":"2024-09-19T09:20:35.732283+0000","last_became_peered":"2024-09-19T09:20:35.732283+0000","last_unstale":"2024-09-19T09:20:35.732774+0000","last_undegraded":"2024-09-19T09:20:35.732774+0000","last_fullsized":"2024-09-19T09:20:35.732774+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:23.441278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.15","version":"153'3","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.743033+0000","last_change":"2024-09-19T09:20:34.716968+0000","last_active":"2024-09-19T09:20:35.743033+0000","last_peered":"2024-09-19T09:20:35.743033+0000","last_clean":"2024-09-19T09:20:35.743033+0000","last_became_active":"2024-09-19T09:20:34.715981+0000","last_became_peered":"2024-09-19T09:20:34.715981+0000","last_unstale":"2024-09-19T09:20:35.743033+0000","last_undegraded":"2024-09-19T09:20:35.743033+0000","last_fullsized":"2024-09-19T09:20:35.743033+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:26.878874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.739599+0000","last_change":"2024-09-19T09:20:35.738991+0000","last_active":"2024-09-19T09:20:35.739599+0000","last_peered":"2024-09-19T09:20:35.739599+0000","last_clean":"2024-09-19T09:20:35.739599+0000","last_became_active":"2024-09-19T09:20:35.737680+0000","last_became_peered":"2024-09-19T09:20:35.737680+0000","last_unstale":"2024-09-19T09:20:35.739599+0000","last_undegraded":"2024-09-19T09:20:35.739599+0000","last_fullsized":"2024-09-19T09:20:35.739599+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:55.250255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.14","version":"153'6","reported_seq":18,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.743730+0000","last_change":"2024-09-19T09:20:34.714438+0000","last_active":"2024-09-19T09:20:35.743730+0000","last_peered":"2024-09-19T09:20:35.743730+0000","last_clean":"2024-09-19T09:20:35.743730+0000","last_became_active":"2024-09-19T09:20:34.714067+0000","last_became_peered":"2024-09-19T09:20:34.714067+0000","last_unstale":"2024-09-19T09:20:35.743730+0000","last_undegraded":"2024-09-19T09:20:35.743730+0000","last_fullsized":"2024-09-19T09:20:35.743730+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:53:56.899061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.729863+0000","last_change":"2024-09-19T09:20:35.729114+0000","last_active":"2024-09-19T09:20:35.729863+0000","last_peered":"2024-09-19T09:20:35.729863+0000","last_clean":"2024-09-19T09:20:35.729863+0000","last_became_active":"2024-09-19T09:20:35.728895+0000","last_became_peered":"2024-09-19T09:20:35.728895+0000","last_unstale":"2024-09-19T09:20:35.729863+0000","last_undegraded":"2024-09-19T09:20:35.729863+0000","last_fullsized":"2024-09-19T09:20:35.729863+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:08.715021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.724030+0000","last_change":"2024-09-19T09:20:34.711351+0000","last_active":"2024-09-19T09:20:35.724030+0000","last_peered":"2024-09-19T09:20:35.724030+0000","last_clean":"2024-09-19T09:20:35.724030+0000","last_became_active":"2024-09-19T09:20:34.711130+0000","last_became_peered":"2024-09-19T09:20:34.711130+0000","last_unstale":"2024-09-19T09:20:35.724030+0000","last_undegraded":"2024-09-19T09:20:35.724030+0000","last_fullsized":"2024-09-19T09:20:35.724030+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:40:44.354509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.732326+0000","last_change":"2024-09-19T09:20:35.732209+0000","last_active":"2024-09-19T09:20:35.732326+0000","last_peered":"2024-09-19T09:20:35.732326+0000","last_clean":"2024-09-19T09:20:35.732326+0000","last_became_active":"2024-09-19T09:20:35.731973+0000","last_became_peered":"2024-09-19T09:20:35.731973+0000","last_unstale":"2024-09-19T09:20:35.732326+0000","last_undegraded":"2024-09-19T09:20:35.732326+0000","last_fullsized":"2024-09-19T09:20:35.732326+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:46.268628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.716595+0000","last_change":"2024-09-19T09:20:34.715595+0000","last_active":"2024-09-19T09:20:35.716595+0000","last_peered":"2024-09-19T09:20:35.716595+0000","last_clean":"2024-09-19T09:20:35.716595+0000","last_became_active":"2024-09-19T09:20:34.715312+0000","last_became_peered":"2024-09-19T09:20:34.715312+0000","last_unstale":"2024-09-19T09:20:35.716595+0000","last_undegraded":"2024-09-19T09:20:35.716595+0000","last_fullsized":"2024-09-19T09:20:35.716595+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:25.059187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.731124+0000","last_change":"2024-09-19T09:20:35.730980+0000","last_active":"2024-09-19T09:20:35.731124+0000","last_peered":"2024-09-19T09:20:35.731124+0000","last_clean":"2024-09-19T09:20:35.731124+0000","last_became_active":"2024-09-19T09:20:35.730716+0000","last_became_peered":"2024-09-19T09:20:35.730716+0000","last_unstale":"2024-09-19T09:20:35.731124+0000","last_undegraded":"2024-09-19T09:20:35.731124+0000","last_fullsized":"2024-09-19T09:20:35.731124+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:29.136284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"153'8","reported_seq":20,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.744364+0000","last_change":"2024-09-19T09:20:34.709713+0000","last_active":"2024-09-19T09:20:35.744364+0000","last_peered":"2024-09-19T09:20:35.744364+0000","last_clean":"2024-09-19T09:20:35.744364+0000","last_became_active":"2024-09-19T09:20:34.709471+0000","last_became_peered":"2024-09-19T09:20:34.709471+0000","last_unstale":"2024-09-19T09:20:35.744364+0000","last_undegraded":"2024-09-19T09:20:35.744364+0000","last_fullsized":"2024-09-19T09:20:35.744364+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:21.547230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.729619+0000","last_change":"2024-09-19T09:20:35.728649+0000","last_active":"2024-09-19T09:20:35.729619+0000","last_peered":"2024-09-19T09:20:35.729619+0000","last_clean":"2024-09-19T09:20:35.729619+0000","last_became_active":"2024-09-19T09:20:35.728393+0000","last_became_peered":"2024-09-19T09:20:35.728393+0000","last_unstale":"2024-09-19T09:20:35.729619+0000","last_undegraded":"2024-09-19T09:20:35.729619+0000","last_fullsized":"2024-09-19T09:20:35.729619+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:50.700527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.f","version":"153'1","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.743031+0000","last_change":"2024-09-19T09:20:34.714119+0000","last_active":"2024-09-19T09:20:35.743031+0000","last_peered":"2024-09-19T09:20:35.743031+0000","last_clean":"2024-09-19T09:20:35.743031+0000","last_became_active":"2024-09-19T09:20:34.712855+0000","last_became_peered":"2024-09-19T09:20:34.712855+0000","last_unstale":"2024-09-19T09:20:35.743031+0000","last_undegraded":"2024-09-19T09:20:35.743031+0000","last_fullsized":"2024-09-19T09:20:35.743031+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:53.697811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.722681+0000","last_change":"2024-09-19T09:20:35.722552+0000","last_active":"2024-09-19T09:20:35.722681+0000","last_peered":"2024-09-19T09:20:35.722681+0000","last_clean":"2024-09-19T09:20:35.722681+0000","last_became_active":"2024-09-19T09:20:35.722259+0000","last_became_peered":"2024-09-19T09:20:35.722259+0000","last_unstale":"2024-09-19T09:20:35.722681+0000","last_undegraded":"2024-09-19T09:20:35.722681+0000","last_fullsized":"2024-09-19T09:20:35.722681+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:22.925705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"153'2","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.740466+0000","last_change":"2024-09-19T09:20:34.706991+0000","last_active":"2024-09-19T09:20:35.740466+0000","last_peered":"2024-09-19T09:20:35.740466+0000","last_clean":"2024-09-19T09:20:35.740466+0000","last_became_active":"2024-09-19T09:20:34.706545+0000","last_became_peered":"2024-09-19T09:20:34.706545+0000","last_unstale":"2024-09-19T09:20:35.740466+0000","last_undegraded":"2024-09-19T09:20:35.740466+0000","last_fullsized":"2024-09-19T09:20:35.740466+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:40.310785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.729987+0000","last_change":"2024-09-19T09:20:35.729654+0000","last_active":"2024-09-19T09:20:35.729987+0000","last_peered":"2024-09-19T09:20:35.729987+0000","last_clean":"2024-09-19T09:20:35.729987+0000","last_became_active":"2024-09-19T09:20:35.729208+0000","last_became_peered":"2024-09-19T09:20:35.729208+0000","last_unstale":"2024-09-19T09:20:35.729987+0000","last_undegraded":"2024-09-19T09:20:35.729987+0000","last_fullsized":"2024-09-19T09:20:35.729987+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:28:42.929394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.d","version":"153'1","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.739863+0000","last_change":"2024-09-19T09:20:34.712248+0000","last_active":"2024-09-19T09:20:35.739863+0000","last_peered":"2024-09-19T09:20:35.739863+0000","last_clean":"2024-09-19T09:20:35.739863+0000","last_became_active":"2024-09-19T09:20:34.711647+0000","last_became_peered":"2024-09-19T09:20:34.711647+0000","last_unstale":"2024-09-19T09:20:35.739863+0000","last_undegraded":"2024-09-19T09:20:35.739863+0000","last_fullsized":"2024-09-19T09:20:35.739863+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:34.983811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.727202+0000","last_change":"2024-09-19T09:20:35.726955+0000","last_active":"2024-09-19T09:20:35.727202+0000","last_peered":"2024-09-19T09:20:35.727202+0000","last_clean":"2024-09-19T09:20:35.727202+0000","last_became_active":"2024-09-19T09:20:35.726712+0000","last_became_peered":"2024-09-19T09:20:35.726712+0000","last_unstale":"2024-09-19T09:20:35.727202+0000","last_undegraded":"2024-09-19T09:20:35.727202+0000","last_fullsized":"2024-09-19T09:20:35.727202+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:09.872830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.723670+0000","last_change":"2024-09-19T09:20:34.717605+0000","last_active":"2024-09-19T09:20:35.723670+0000","last_peered":"2024-09-19T09:20:35.723670+0000","last_clean":"2024-09-19T09:20:35.723670+0000","last_became_active":"2024-09-19T09:20:34.717385+0000","last_became_peered":"2024-09-19T09:20:34.717385+0000","last_unstale":"2024-09-19T09:20:35.723670+0000","last_undegraded":"2024-09-19T09:20:35.723670+0000","last_fullsized":"2024-09-19T09:20:35.723670+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:56.301330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.724454+0000","last_change":"2024-09-19T09:20:35.723720+0000","last_active":"2024-09-19T09:20:35.724454+0000","last_peered":"2024-09-19T09:20:35.724454+0000","last_clean":"2024-09-19T09:20:35.724454+0000","last_became_active":"2024-09-19T09:20:35.723498+0000","last_became_peered":"2024-09-19T09:20:35.723498+0000","last_unstale":"2024-09-19T09:20:35.724454+0000","last_undegraded":"2024-09-19T09:20:35.724454+0000","last_fullsized":"2024-09-19T09:20:35.724454+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:55.833877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.b","version":"153'2","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.741217+0000","last_change":"2024-09-19T09:20:34.713036+0000","last_active":"2024-09-19T09:20:35.741217+0000","last_peered":"2024-09-19T09:20:35.741217+0000","last_clean":"2024-09-19T09:20:35.741217+0000","last_became_active":"2024-09-19T09:20:34.712787+0000","last_became_peered":"2024-09-19T09:20:34.712787+0000","last_unstale":"2024-09-19T09:20:35.741217+0000","last_undegraded":"2024-09-19T09:20:35.741217+0000","last_fullsized":"2024-09-19T09:20:35.741217+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:55.022640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.739538+0000","last_change":"2024-09-19T09:20:35.738291+0000","last_active":"2024-09-19T09:20:35.739538+0000","last_peered":"2024-09-19T09:20:35.739538+0000","last_clean":"2024-09-19T09:20:35.739538+0000","last_became_active":"2024-09-19T09:20:35.736194+0000","last_became_peered":"2024-09-19T09:20:35.736194+0000","last_unstale":"2024-09-19T09:20:35.739538+0000","last_undegraded":"2024-09-19T09:20:35.739538+0000","last_fullsized":"2024-09-19T09:20:35.739538+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:48.288965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.717536+0000","last_change":"2024-09-19T09:20:34.717993+0000","last_active":"2024-09-19T09:20:35.717536+0000","last_peered":"2024-09-19T09:20:35.717536+0000","last_clean":"2024-09-19T09:20:35.717536+0000","last_became_active":"2024-09-19T09:20:34.717738+0000","last_became_peered":"2024-09-19T09:20:34.717738+0000","last_unstale":"2024-09-19T09:20:35.717536+0000","last_undegraded":"2024-09-19T09:20:35.717536+0000","last_fullsized":"2024-09-19T09:20:35.717536+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:43.699217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.727604+0000","last_change":"2024-09-19T09:20:35.727483+0000","last_active":"2024-09-19T09:20:35.727604+0000","last_peered":"2024-09-19T09:20:35.727604+0000","last_clean":"2024-09-19T09:20:35.727604+0000","last_became_active":"2024-09-19T09:20:35.727170+0000","last_became_peered":"2024-09-19T09:20:35.727170+0000","last_unstale":"2024-09-19T09:20:35.727604+0000","last_undegraded":"2024-09-19T09:20:35.727604+0000","last_fullsized":"2024-09-19T09:20:35.727604+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:57.311663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.725866+0000","last_change":"2024-09-19T09:20:34.715220+0000","last_active":"2024-09-19T09:20:35.725866+0000","last_peered":"2024-09-19T09:20:35.725866+0000","last_clean":"2024-09-19T09:20:35.725866+0000","last_became_active":"2024-09-19T09:20:34.714981+0000","last_became_peered":"2024-09-19T09:20:34.714981+0000","last_unstale":"2024-09-19T09:20:35.725866+0000","last_undegraded":"2024-09-19T09:20:35.725866+0000","last_fullsized":"2024-09-19T09:20:35.725866+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:18:55.706504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.722389+0000","last_change":"2024-09-19T09:20:35.722185+0000","last_active":"2024-09-19T09:20:35.722389+0000","last_peered":"2024-09-19T09:20:35.722389+0000","last_clean":"2024-09-19T09:20:35.722389+0000","last_became_active":"2024-09-19T09:20:35.721937+0000","last_became_peered":"2024-09-19T09:20:35.721937+0000","last_unstale":"2024-09-19T09:20:35.722389+0000","last_undegraded":"2024-09-19T09:20:35.722389+0000","last_fullsized":"2024-09-19T09:20:35.722389+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:56:31.535021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.717295+0000","last_change":"2024-09-19T09:20:34.711013+0000","last_active":"2024-09-19T09:20:35.717295+0000","last_peered":"2024-09-19T09:20:35.717295+0000","last_clean":"2024-09-19T09:20:35.717295+0000","last_became_active":"2024-09-19T09:20:34.710770+0000","last_became_peered":"2024-09-19T09:20:34.710770+0000","last_unstale":"2024-09-19T09:20:35.717295+0000","last_undegraded":"2024-09-19T09:20:35.717295+0000","last_fullsized":"2024-09-19T09:20:35.717295+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:01.765494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.739576+0000","last_change":"2024-09-19T09:20:35.738760+0000","last_active":"2024-09-19T09:20:35.739576+0000","last_peered":"2024-09-19T09:20:35.739576+0000","last_clean":"2024-09-19T09:20:35.739576+0000","last_became_active":"2024-09-19T09:20:35.737336+0000","last_became_peered":"2024-09-19T09:20:35.737336+0000","last_unstale":"2024-09-19T09:20:35.739576+0000","last_undegraded":"2024-09-19T09:20:35.739576+0000","last_fullsized":"2024-09-19T09:20:35.739576+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:11.428914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.7","version":"153'2","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.739786+0000","last_change":"2024-09-19T09:20:34.717844+0000","last_active":"2024-09-19T09:20:35.739786+0000","last_peered":"2024-09-19T09:20:35.739786+0000","last_clean":"2024-09-19T09:20:35.739786+0000","last_became_active":"2024-09-19T09:20:34.717615+0000","last_became_peered":"2024-09-19T09:20:34.717615+0000","last_unstale":"2024-09-19T09:20:35.739786+0000","last_undegraded":"2024-09-19T09:20:35.739786+0000","last_fullsized":"2024-09-19T09:20:35.739786+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:44.743933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.729970+0000","last_change":"2024-09-19T09:20:35.729445+0000","last_active":"2024-09-19T09:20:35.729970+0000","last_peered":"2024-09-19T09:20:35.729970+0000","last_clean":"2024-09-19T09:20:35.729970+0000","last_became_active":"2024-09-19T09:20:35.728432+0000","last_became_peered":"2024-09-19T09:20:35.728432+0000","last_unstale":"2024-09-19T09:20:35.729970+0000","last_undegraded":"2024-09-19T09:20:35.729970+0000","last_fullsized":"2024-09-19T09:20:35.729970+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:49.300676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.723174+0000","last_change":"2024-09-19T09:20:34.717452+0000","last_active":"2024-09-19T09:20:35.723174+0000","last_peered":"2024-09-19T09:20:35.723174+0000","last_clean":"2024-09-19T09:20:35.723174+0000","last_became_active":"2024-09-19T09:20:34.716690+0000","last_became_peered":"2024-09-19T09:20:34.716690+0000","last_unstale":"2024-09-19T09:20:35.723174+0000","last_undegraded":"2024-09-19T09:20:35.723174+0000","last_fullsized":"2024-09-19T09:20:35.723174+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:40.956965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.728495+0000","last_change":"2024-09-19T09:20:35.728149+0000","last_active":"2024-09-19T09:20:35.728495+0000","last_peered":"2024-09-19T09:20:35.728495+0000","last_clean":"2024-09-19T09:20:35.728495+0000","last_became_active":"2024-09-19T09:20:35.727470+0000","last_became_peered":"2024-09-19T09:20:35.727470+0000","last_unstale":"2024-09-19T09:20:35.728495+0000","last_undegraded":"2024-09-19T09:20:35.728495+0000","last_fullsized":"2024-09-19T09:20:35.728495+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:11.204392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.717700+0000","last_change":"2024-09-19T09:20:34.715754+0000","last_active":"2024-09-19T09:20:35.717700+0000","last_peered":"2024-09-19T09:20:35.717700+0000","last_clean":"2024-09-19T09:20:35.717700+0000","last_became_active":"2024-09-19T09:20:34.715474+0000","last_became_peered":"2024-09-19T09:20:34.715474+0000","last_unstale":"2024-09-19T09:20:35.717700+0000","last_undegraded":"2024-09-19T09:20:35.717700+0000","last_fullsized":"2024-09-19T09:20:35.717700+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:39.022588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.737073+0000","last_change":"2024-09-19T09:20:35.736956+0000","last_active":"2024-09-19T09:20:35.737073+0000","last_peered":"2024-09-19T09:20:35.737073+0000","last_clean":"2024-09-19T09:20:35.737073+0000","last_became_active":"2024-09-19T09:20:35.736338+0000","last_became_peered":"2024-09-19T09:20:35.736338+0000","last_unstale":"2024-09-19T09:20:35.737073+0000","last_undegraded":"2024-09-19T09:20:35.737073+0000","last_fullsized":"2024-09-19T09:20:35.737073+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:33.204446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.726075+0000","last_change":"2024-09-19T09:20:34.711507+0000","last_active":"2024-09-19T09:20:35.726075+0000","last_peered":"2024-09-19T09:20:35.726075+0000","last_clean":"2024-09-19T09:20:35.726075+0000","last_became_active":"2024-09-19T09:20:34.711050+0000","last_became_peered":"2024-09-19T09:20:34.711050+0000","last_unstale":"2024-09-19T09:20:35.726075+0000","last_undegraded":"2024-09-19T09:20:35.726075+0000","last_fullsized":"2024-09-19T09:20:35.726075+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:43.265375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.729792+0000","last_change":"2024-09-19T09:20:35.729277+0000","last_active":"2024-09-19T09:20:35.729792+0000","last_peered":"2024-09-19T09:20:35.729792+0000","last_clean":"2024-09-19T09:20:35.729792+0000","last_became_active":"2024-09-19T09:20:35.729016+0000","last_became_peered":"2024-09-19T09:20:35.729016+0000","last_unstale":"2024-09-19T09:20:35.729792+0000","last_undegraded":"2024-09-19T09:20:35.729792+0000","last_fullsized":"2024-09-19T09:20:35.729792+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:36.149605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.721928+0000","last_change":"2024-09-19T09:20:34.715703+0000","last_active":"2024-09-19T09:20:35.721928+0000","last_peered":"2024-09-19T09:20:35.721928+0000","last_clean":"2024-09-19T09:20:35.721928+0000","last_became_active":"2024-09-19T09:20:34.715424+0000","last_became_peered":"2024-09-19T09:20:34.715424+0000","last_unstale":"2024-09-19T09:20:35.721928+0000","last_undegraded":"2024-09-19T09:20:35.721928+0000","last_fullsized":"2024-09-19T09:20:35.721928+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:15.433261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.725134+0000","last_change":"2024-09-19T09:20:35.725025+0000","last_active":"2024-09-19T09:20:35.725134+0000","last_peered":"2024-09-19T09:20:35.725134+0000","last_clean":"2024-09-19T09:20:35.725134+0000","last_became_active":"2024-09-19T09:20:35.724507+0000","last_became_peered":"2024-09-19T09:20:35.724507+0000","last_unstale":"2024-09-19T09:20:35.725134+0000","last_undegraded":"2024-09-19T09:20:35.725134+0000","last_fullsized":"2024-09-19T09:20:35.725134+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:02.681874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.721843+0000","last_change":"2024-09-19T09:20:34.713767+0000","last_active":"2024-09-19T09:20:35.721843+0000","last_peered":"2024-09-19T09:20:35.721843+0000","last_clean":"2024-09-19T09:20:35.721843+0000","last_became_active":"2024-09-19T09:20:34.713515+0000","last_became_peered":"2024-09-19T09:20:34.713515+0000","last_unstale":"2024-09-19T09:20:35.721843+0000","last_undegraded":"2024-09-19T09:20:35.721843+0000","last_fullsized":"2024-09-19T09:20:35.721843+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:25.223631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.726007+0000","last_change":"2024-09-19T09:20:35.723387+0000","last_active":"2024-09-19T09:20:35.726007+0000","last_peered":"2024-09-19T09:20:35.726007+0000","last_clean":"2024-09-19T09:20:35.726007+0000","last_became_active":"2024-09-19T09:20:35.723126+0000","last_became_peered":"2024-09-19T09:20:35.723126+0000","last_unstale":"2024-09-19T09:20:35.726007+0000","last_undegraded":"2024-09-19T09:20:35.726007+0000","last_fullsized":"2024-09-19T09:20:35.726007+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:39.240315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.718331+0000","last_change":"2024-09-19T09:20:34.717005+0000","last_active":"2024-09-19T09:20:35.718331+0000","last_peered":"2024-09-19T09:20:35.718331+0000","last_clean":"2024-09-19T09:20:35.718331+0000","last_became_active":"2024-09-19T09:20:34.716275+0000","last_became_peered":"2024-09-19T09:20:34.716275+0000","last_unstale":"2024-09-19T09:20:35.718331+0000","last_undegraded":"2024-09-19T09:20:35.718331+0000","last_fullsized":"2024-09-19T09:20:35.718331+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:02.640467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.737311+0000","last_change":"2024-09-19T09:20:35.737197+0000","last_active":"2024-09-19T09:20:35.737311+0000","last_peered":"2024-09-19T09:20:35.737311+0000","last_clean":"2024-09-19T09:20:35.737311+0000","last_became_active":"2024-09-19T09:20:35.736955+0000","last_became_peered":"2024-09-19T09:20:35.736955+0000","last_unstale":"2024-09-19T09:20:35.737311+0000","last_undegraded":"2024-09-19T09:20:35.737311+0000","last_fullsized":"2024-09-19T09:20:35.737311+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:19.877545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.723328+0000","last_change":"2024-09-19T09:20:34.716693+0000","last_active":"2024-09-19T09:20:35.723328+0000","last_peered":"2024-09-19T09:20:35.723328+0000","last_clean":"2024-09-19T09:20:35.723328+0000","last_became_active":"2024-09-19T09:20:34.716408+0000","last_became_peered":"2024-09-19T09:20:34.716408+0000","last_unstale":"2024-09-19T09:20:35.723328+0000","last_undegraded":"2024-09-19T09:20:35.723328+0000","last_fullsized":"2024-09-19T09:20:35.723328+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:26:50.827593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.735237+0000","last_change":"2024-09-19T09:20:35.735094+0000","last_active":"2024-09-19T09:20:35.735237+0000","last_peered":"2024-09-19T09:20:35.735237+0000","last_clean":"2024-09-19T09:20:35.735237+0000","last_became_active":"2024-09-19T09:20:35.734494+0000","last_became_peered":"2024-09-19T09:20:35.734494+0000","last_unstale":"2024-09-19T09:20:35.735237+0000","last_undegraded":"2024-09-19T09:20:35.735237+0000","last_fullsized":"2024-09-19T09:20:35.735237+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:20.604707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"153'2","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.741972+0000","last_change":"2024-09-19T09:20:34.713520+0000","last_active":"2024-09-19T09:20:35.741972+0000","last_peered":"2024-09-19T09:20:35.741972+0000","last_clean":"2024-09-19T09:20:35.741972+0000","last_became_active":"2024-09-19T09:20:34.713096+0000","last_became_peered":"2024-09-19T09:20:34.713096+0000","last_unstale":"2024-09-19T09:20:35.741972+0000","last_undegraded":"2024-09-19T09:20:35.741972+0000","last_fullsized":"2024-09-19T09:20:35.741972+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:04.239190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":429,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.722919+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:20:35.722919+0000","last_peered":"2024-09-19T09:20:35.722919+0000","last_clean":"2024-09-19T09:20:35.722919+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:20:35.722919+0000","last_undegraded":"2024-09-19T09:20:35.722919+0000","last_fullsized":"2024-09-19T09:20:35.722919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:28.823470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574938,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":832,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194480,"statfs":{"total":200000000,"available":199147536,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":832,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194480,"statfs":{"total":200000000,"available":199147570,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574938,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1409,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193902,"statfs":{"total":200000000,"available":198556460,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574938,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":832,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194480,"statfs":{"total":200000000,"available":199147570,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574938,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":832,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194479,"statfs":{"total":200000000,"available":199147500,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":833,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194479,"statfs":{"total":200000000,"available":199146898,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1410,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193901,"statfs":{"total":200000000,"available":198555568,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574938,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":834,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194478,"statfs":{"total":200000000,"available":199145902,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:20:39.223 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:20:39.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.361+0000 7f8f1015b640 1 Processor -- start 2024-09-19T09:20:39.361 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.361+0000 7f8f1015b640 1 -- start start 2024-09-19T09:20:39.362 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.361+0000 7f8f1015b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f0815ef50 0x7f8f080d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.361+0000 7f8f1015b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8f080d3240 0x7f8f080d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.362+0000 7f8f1015b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8f080d5780 0x7f8f080cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.362+0000 7f8f1015b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f8f080b7a90 con 0x7f8f080d3240 2024-09-19T09:20:39.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.362+0000 7f8f1015b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8f080d3740 con 0x7f8f080d5780 2024-09-19T09:20:39.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.362+0000 7f8f1015b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8f080d3a20 con 0x7f8f0815ef50 2024-09-19T09:20:39.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.362+0000 7f8f0d6f6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8f080d3240 0x7f8f080d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.362+0000 7f8f0d6f6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8f080d3240 0x7f8f080d18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53234/0 (socket says 172.21.15.18:53234) 2024-09-19T09:20:39.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.362+0000 7f8f0d6f6640 1 -- 172.21.15.18:0/4059614001 learned_addr learned my addr 172.21.15.18:0/4059614001 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:39.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.362+0000 7f8f0d6f6640 1 -- 172.21.15.18:0/4059614001 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f0815ef50 msgr2=0x7f8f080d13a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:20:39.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.362+0000 7f8f0d6f6640 1 --2- 172.21.15.18:0/4059614001 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f0815ef50 0x7f8f080d13a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.362+0000 7f8f0d6f6640 1 -- 172.21.15.18:0/4059614001 >> v2:172.21.15.162:3300/0 conn(0x7f8f080d5780 msgr2=0x7f8f080cf770 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:20:39.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.362+0000 7f8f0d6f6640 1 --2- 172.21.15.18:0/4059614001 >> v2:172.21.15.162:3300/0 conn(0x7f8f080d5780 0x7f8f080cf770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.363 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.362+0000 7f8f0d6f6640 1 -- 172.21.15.18:0/4059614001 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f080b7d00 con 0x7f8f080d3240 2024-09-19T09:20:39.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.363+0000 7f8f0d6f6640 1 --2- 172.21.15.18:0/4059614001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f080d3240 0x7f8f080d18e0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f8f0808d790 tx=0x7f8efc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d1ac2fbbbab805 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:39.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.363+0000 7f8f0cef5640 1 -- 172.21.15.18:0/4059614001 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8efc037070 con 0x7f8f080d3240 2024-09-19T09:20:39.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.363+0000 7f8f0cef5640 1 -- 172.21.15.18:0/4059614001 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8efc032440 con 0x7f8f080d3240 2024-09-19T09:20:39.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.363+0000 7f8f0cef5640 1 -- 172.21.15.18:0/4059614001 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8efc032810 con 0x7f8f080d3240 2024-09-19T09:20:39.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.363+0000 7f8f1015b640 1 -- 172.21.15.18:0/4059614001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f080d3240 msgr2=0x7f8f080d18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:39.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.363+0000 7f8f1015b640 1 --2- 172.21.15.18:0/4059614001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f080d3240 0x7f8f080d18e0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f8f0808d790 tx=0x7f8efc02a180 comp rx=0 tx=0).stop 2024-09-19T09:20:39.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.363+0000 7f8f1015b640 1 -- 172.21.15.18:0/4059614001 shutdown_connections 2024-09-19T09:20:39.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.363+0000 7f8f1015b640 1 --2- 172.21.15.18:0/4059614001 >> v2:172.21.15.162:3300/0 conn(0x7f8f080d5780 0x7f8f080cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.363+0000 7f8f1015b640 1 --2- 172.21.15.18:0/4059614001 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f080d3240 0x7f8f080d18e0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.363+0000 7f8f1015b640 1 --2- 172.21.15.18:0/4059614001 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f0815ef50 0x7f8f080d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.363+0000 7f8f1015b640 1 -- 172.21.15.18:0/4059614001 >> 172.21.15.18:0/4059614001 conn(0x7f8f080d4c60 msgr2=0x7f8f080d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:39.365 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.363+0000 7f8f1015b640 1 -- 172.21.15.18:0/4059614001 shutdown_connections 2024-09-19T09:20:39.366 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.363+0000 7f8f1015b640 1 -- 172.21.15.18:0/4059614001 wait complete. 2024-09-19T09:20:39.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.365+0000 7f8f1015b640 1 Processor -- start 2024-09-19T09:20:39.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.365+0000 7f8f1015b640 1 -- start start 2024-09-19T09:20:39.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.365+0000 7f8f1015b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f080d3240 0x7f8f080cd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.365+0000 7f8f1015b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f080d5780 0x7f8f081f5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.365+0000 7f8f1015b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f0815ef50 0x7f8f080cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.365+0000 7f8f1015b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8f080d21a0 con 0x7f8f080d3240 2024-09-19T09:20:39.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.365+0000 7f8f1015b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8f080d2020 con 0x7f8f0815ef50 2024-09-19T09:20:39.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.365+0000 7f8f1015b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8f080cfcb0 con 0x7f8f080d5780 2024-09-19T09:20:39.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.365+0000 7f8f0def7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f080d3240 0x7f8f080cd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.365+0000 7f8f0def7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f080d3240 0x7f8f080cd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53242/0 (socket says 172.21.15.18:53242) 2024-09-19T09:20:39.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.365+0000 7f8f0def7640 1 -- 172.21.15.18:0/4176556774 learned_addr learned my addr 172.21.15.18:0/4176556774 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:39.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.366+0000 7f8f0e6f8640 1 --2- 172.21.15.18:0/4176556774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f0815ef50 0x7f8f080cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.368 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.366+0000 7f8f0def7640 1 -- 172.21.15.18:0/4176556774 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f080d5780 msgr2=0x7f8f081f5960 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:20:39.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.366+0000 7f8f0def7640 1 --2- 172.21.15.18:0/4176556774 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f080d5780 0x7f8f081f5960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.366+0000 7f8f0def7640 1 -- 172.21.15.18:0/4176556774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f0815ef50 msgr2=0x7f8f080cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:39.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.366+0000 7f8f0def7640 1 --2- 172.21.15.18:0/4176556774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f0815ef50 0x7f8f080cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.366+0000 7f8f0def7640 1 -- 172.21.15.18:0/4176556774 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f080cc1c0 con 0x7f8f080d3240 2024-09-19T09:20:39.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.366+0000 7f8f0e6f8640 1 --2- 172.21.15.18:0/4176556774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f0815ef50 0x7f8f080cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:39.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.366+0000 7f8f0def7640 1 --2- 172.21.15.18:0/4176556774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f080d3240 0x7f8f080cd260 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f8ef800ba50 tx=0x7f8ef800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:39.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.366+0000 7f8f067fc640 1 -- 172.21.15.18:0/4176556774 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8019070 con 0x7f8f080d3240 2024-09-19T09:20:39.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.366+0000 7f8f067fc640 1 -- 172.21.15.18:0/4176556774 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ef800cbb0 con 0x7f8f080d3240 2024-09-19T09:20:39.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.366+0000 7f8f1015b640 1 -- 172.21.15.18:0/4176556774 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f080cc4a0 con 0x7f8f080d3240 2024-09-19T09:20:39.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.366+0000 7f8f067fc640 1 -- 172.21.15.18:0/4176556774 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ef8014440 con 0x7f8f080d3240 2024-09-19T09:20:39.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.366+0000 7f8f1015b640 1 -- 172.21.15.18:0/4176556774 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f080cca60 con 0x7f8f080d3240 2024-09-19T09:20:39.369 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.367+0000 7f8f1015b640 1 -- 172.21.15.18:0/4176556774 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f080cf770 con 0x7f8f080d3240 2024-09-19T09:20:39.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.368+0000 7f8f067fc640 1 -- 172.21.15.18:0/4176556774 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8ef8007370 con 0x7f8f080d3240 2024-09-19T09:20:39.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.368+0000 7f8f067fc640 1 --2- 172.21.15.18:0/4176556774 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8ef406c2e0 0x7f8ef406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.368+0000 7f8f067fc640 1 -- 172.21.15.18:0/4176556774 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f8ef808af70 con 0x7f8f080d3240 2024-09-19T09:20:39.371 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.368+0000 7f8f0d6f6640 1 --2- 172.21.15.18:0/4176556774 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8ef406c2e0 0x7f8ef406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.372 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.369+0000 7f8f0d6f6640 1 --2- 172.21.15.18:0/4176556774 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8ef406c2e0 0x7f8ef406e7a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8efc034000 tx=0x7f8efc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:39.373 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.373+0000 7f8f067fc640 1 -- 172.21.15.18:0/4176556774 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8ef8059770 con 0x7f8f080d3240 2024-09-19T09:20:39.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.545+0000 7f8f1015b640 1 -- 172.21.15.18:0/4176556774 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8f080b5f10 con 0x7f8ef406c2e0 2024-09-19T09:20:39.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.553+0000 7f8f067fc640 1 -- 172.21.15.18:0/4176556774 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247925 (secure 0 0 0) 0x7f8f080b5f10 con 0x7f8ef406c2e0 2024-09-19T09:20:39.557 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:20:39.558 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:20:39.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.556+0000 7f8f1015b640 1 -- 172.21.15.18:0/4176556774 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8ef406c2e0 msgr2=0x7f8ef406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:39.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.556+0000 7f8f1015b640 1 --2- 172.21.15.18:0/4176556774 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8ef406c2e0 0x7f8ef406e7a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8efc034000 tx=0x7f8efc02e000 comp rx=0 tx=0).stop 2024-09-19T09:20:39.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.556+0000 7f8f1015b640 1 -- 172.21.15.18:0/4176556774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f080d3240 msgr2=0x7f8f080cd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:39.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.556+0000 7f8f1015b640 1 --2- 172.21.15.18:0/4176556774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f080d3240 0x7f8f080cd260 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f8ef800ba50 tx=0x7f8ef800bf10 comp rx=0 tx=0).stop 2024-09-19T09:20:39.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.556+0000 7f8f1015b640 1 -- 172.21.15.18:0/4176556774 shutdown_connections 2024-09-19T09:20:39.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.556+0000 7f8f1015b640 1 --2- 172.21.15.18:0/4176556774 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8ef406c2e0 0x7f8ef406e7a0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.556+0000 7f8f1015b640 1 --2- 172.21.15.18:0/4176556774 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8f0815ef50 0x7f8f080cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.556+0000 7f8f1015b640 1 --2- 172.21.15.18:0/4176556774 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8f080d5780 0x7f8f081f5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.556+0000 7f8f1015b640 1 --2- 172.21.15.18:0/4176556774 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8f080d3240 0x7f8f080cd260 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.556+0000 7f8f1015b640 1 -- 172.21.15.18:0/4176556774 >> 172.21.15.18:0/4176556774 conn(0x7f8f080d4c60 msgr2=0x7f8f080cb320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:39.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.557+0000 7f8f1015b640 1 -- 172.21.15.18:0/4176556774 shutdown_connections 2024-09-19T09:20:39.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.557+0000 7f8f1015b640 1 -- 172.21.15.18:0/4176556774 wait complete. 2024-09-19T09:20:39.568 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":366,"stamp":"2024-09-19T09:20:37.627802+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":126,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7817,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554682,"statfs":{"total":1600000000,"available":1591995004,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000849"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.730476+0000","last_change":"2024-09-19T09:20:35.730369+0000","last_active":"2024-09-19T09:20:35.730476+0000","last_peered":"2024-09-19T09:20:35.730476+0000","last_clean":"2024-09-19T09:20:35.730476+0000","last_became_active":"2024-09-19T09:20:35.729745+0000","last_became_peered":"2024-09-19T09:20:35.729745+0000","last_unstale":"2024-09-19T09:20:35.730476+0000","last_undegraded":"2024-09-19T09:20:35.730476+0000","last_fullsized":"2024-09-19T09:20:35.730476+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:15.963387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.732488+0000","last_change":"2024-09-19T09:20:35.732320+0000","last_active":"2024-09-19T09:20:35.732488+0000","last_peered":"2024-09-19T09:20:35.732488+0000","last_clean":"2024-09-19T09:20:35.732488+0000","last_became_active":"2024-09-19T09:20:35.731898+0000","last_became_peered":"2024-09-19T09:20:35.731898+0000","last_unstale":"2024-09-19T09:20:35.732488+0000","last_undegraded":"2024-09-19T09:20:35.732488+0000","last_fullsized":"2024-09-19T09:20:35.732488+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:42.150086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.731838+0000","last_change":"2024-09-19T09:20:35.731696+0000","last_active":"2024-09-19T09:20:35.731838+0000","last_peered":"2024-09-19T09:20:35.731838+0000","last_clean":"2024-09-19T09:20:35.731838+0000","last_became_active":"2024-09-19T09:20:35.731413+0000","last_became_peered":"2024-09-19T09:20:35.731413+0000","last_unstale":"2024-09-19T09:20:35.731838+0000","last_undegraded":"2024-09-19T09:20:35.731838+0000","last_fullsized":"2024-09-19T09:20:35.731838+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:18.128538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.724818+0000","last_change":"2024-09-19T09:20:35.724537+0000","last_active":"2024-09-19T09:20:35.724818+0000","last_peered":"2024-09-19T09:20:35.724818+0000","last_clean":"2024-09-19T09:20:35.724818+0000","last_became_active":"2024-09-19T09:20:35.724212+0000","last_became_peered":"2024-09-19T09:20:35.724212+0000","last_unstale":"2024-09-19T09:20:35.724818+0000","last_undegraded":"2024-09-19T09:20:35.724818+0000","last_fullsized":"2024-09-19T09:20:35.724818+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:14:40.788397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.737265+0000","last_change":"2024-09-19T09:20:35.737144+0000","last_active":"2024-09-19T09:20:35.737265+0000","last_peered":"2024-09-19T09:20:35.737265+0000","last_clean":"2024-09-19T09:20:35.737265+0000","last_became_active":"2024-09-19T09:20:35.736907+0000","last_became_peered":"2024-09-19T09:20:35.736907+0000","last_unstale":"2024-09-19T09:20:35.737265+0000","last_undegraded":"2024-09-19T09:20:35.737265+0000","last_fullsized":"2024-09-19T09:20:35.737265+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:14.206042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.724953+0000","last_change":"2024-09-19T09:20:35.724818+0000","last_active":"2024-09-19T09:20:35.724953+0000","last_peered":"2024-09-19T09:20:35.724953+0000","last_clean":"2024-09-19T09:20:35.724953+0000","last_became_active":"2024-09-19T09:20:35.724188+0000","last_became_peered":"2024-09-19T09:20:35.724188+0000","last_unstale":"2024-09-19T09:20:35.724953+0000","last_undegraded":"2024-09-19T09:20:35.724953+0000","last_fullsized":"2024-09-19T09:20:35.724953+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:18:01.447466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.733055+0000","last_change":"2024-09-19T09:20:35.732550+0000","last_active":"2024-09-19T09:20:35.733055+0000","last_peered":"2024-09-19T09:20:35.733055+0000","last_clean":"2024-09-19T09:20:35.733055+0000","last_became_active":"2024-09-19T09:20:35.732211+0000","last_became_peered":"2024-09-19T09:20:35.732211+0000","last_unstale":"2024-09-19T09:20:35.733055+0000","last_undegraded":"2024-09-19T09:20:35.733055+0000","last_fullsized":"2024-09-19T09:20:35.733055+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:27:33.786302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.726088+0000","last_change":"2024-09-19T09:20:35.724245+0000","last_active":"2024-09-19T09:20:35.726088+0000","last_peered":"2024-09-19T09:20:35.726088+0000","last_clean":"2024-09-19T09:20:35.726088+0000","last_became_active":"2024-09-19T09:20:35.723967+0000","last_became_peered":"2024-09-19T09:20:35.723967+0000","last_unstale":"2024-09-19T09:20:35.726088+0000","last_undegraded":"2024-09-19T09:20:35.726088+0000","last_fullsized":"2024-09-19T09:20:35.726088+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:07.472140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.737423+0000","last_change":"2024-09-19T09:20:35.737184+0000","last_active":"2024-09-19T09:20:35.737423+0000","last_peered":"2024-09-19T09:20:35.737423+0000","last_clean":"2024-09-19T09:20:35.737423+0000","last_became_active":"2024-09-19T09:20:35.736684+0000","last_became_peered":"2024-09-19T09:20:35.736684+0000","last_unstale":"2024-09-19T09:20:35.737423+0000","last_undegraded":"2024-09-19T09:20:35.737423+0000","last_fullsized":"2024-09-19T09:20:35.737423+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:00.417484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.736493+0000","last_change":"2024-09-19T09:20:35.736379+0000","last_active":"2024-09-19T09:20:35.736493+0000","last_peered":"2024-09-19T09:20:35.736493+0000","last_clean":"2024-09-19T09:20:35.736493+0000","last_became_active":"2024-09-19T09:20:35.736103+0000","last_became_peered":"2024-09-19T09:20:35.736103+0000","last_unstale":"2024-09-19T09:20:35.736493+0000","last_undegraded":"2024-09-19T09:20:35.736493+0000","last_fullsized":"2024-09-19T09:20:35.736493+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:03:37.244871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.730078+0000","last_change":"2024-09-19T09:20:35.729966+0000","last_active":"2024-09-19T09:20:35.730078+0000","last_peered":"2024-09-19T09:20:35.730078+0000","last_clean":"2024-09-19T09:20:35.730078+0000","last_became_active":"2024-09-19T09:20:35.729736+0000","last_became_peered":"2024-09-19T09:20:35.729736+0000","last_unstale":"2024-09-19T09:20:35.730078+0000","last_undegraded":"2024-09-19T09:20:35.730078+0000","last_fullsized":"2024-09-19T09:20:35.730078+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:53.097249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.731814+0000","last_change":"2024-09-19T09:20:35.731696+0000","last_active":"2024-09-19T09:20:35.731814+0000","last_peered":"2024-09-19T09:20:35.731814+0000","last_clean":"2024-09-19T09:20:35.731814+0000","last_became_active":"2024-09-19T09:20:35.731464+0000","last_became_peered":"2024-09-19T09:20:35.731464+0000","last_unstale":"2024-09-19T09:20:35.731814+0000","last_undegraded":"2024-09-19T09:20:35.731814+0000","last_fullsized":"2024-09-19T09:20:35.731814+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:36:29.565125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.733149+0000","last_change":"2024-09-19T09:20:35.733024+0000","last_active":"2024-09-19T09:20:35.733149+0000","last_peered":"2024-09-19T09:20:35.733149+0000","last_clean":"2024-09-19T09:20:35.733149+0000","last_became_active":"2024-09-19T09:20:35.732785+0000","last_became_peered":"2024-09-19T09:20:35.732785+0000","last_unstale":"2024-09-19T09:20:35.733149+0000","last_undegraded":"2024-09-19T09:20:35.733149+0000","last_fullsized":"2024-09-19T09:20:35.733149+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:53:49.820960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.728651+0000","last_change":"2024-09-19T09:20:35.728544+0000","last_active":"2024-09-19T09:20:35.728651+0000","last_peered":"2024-09-19T09:20:35.728651+0000","last_clean":"2024-09-19T09:20:35.728651+0000","last_became_active":"2024-09-19T09:20:35.726697+0000","last_became_peered":"2024-09-19T09:20:35.726697+0000","last_unstale":"2024-09-19T09:20:35.728651+0000","last_undegraded":"2024-09-19T09:20:35.728651+0000","last_fullsized":"2024-09-19T09:20:35.728651+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:10:35.560486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.725983+0000","last_change":"2024-09-19T09:20:35.722583+0000","last_active":"2024-09-19T09:20:35.725983+0000","last_peered":"2024-09-19T09:20:35.725983+0000","last_clean":"2024-09-19T09:20:35.725983+0000","last_became_active":"2024-09-19T09:20:35.722339+0000","last_became_peered":"2024-09-19T09:20:35.722339+0000","last_unstale":"2024-09-19T09:20:35.725983+0000","last_undegraded":"2024-09-19T09:20:35.725983+0000","last_fullsized":"2024-09-19T09:20:35.725983+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:21:24.196075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.735003+0000","last_change":"2024-09-19T09:20:35.734914+0000","last_active":"2024-09-19T09:20:35.735003+0000","last_peered":"2024-09-19T09:20:35.735003+0000","last_clean":"2024-09-19T09:20:35.735003+0000","last_became_active":"2024-09-19T09:20:35.734678+0000","last_became_peered":"2024-09-19T09:20:35.734678+0000","last_unstale":"2024-09-19T09:20:35.735003+0000","last_undegraded":"2024-09-19T09:20:35.735003+0000","last_fullsized":"2024-09-19T09:20:35.735003+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:10:48.362502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.736974+0000","last_change":"2024-09-19T09:20:35.732910+0000","last_active":"2024-09-19T09:20:35.736974+0000","last_peered":"2024-09-19T09:20:35.736974+0000","last_clean":"2024-09-19T09:20:35.736974+0000","last_became_active":"2024-09-19T09:20:35.732340+0000","last_became_peered":"2024-09-19T09:20:35.732340+0000","last_unstale":"2024-09-19T09:20:35.736974+0000","last_undegraded":"2024-09-19T09:20:35.736974+0000","last_fullsized":"2024-09-19T09:20:35.736974+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:55:56.708820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.732098+0000","last_change":"2024-09-19T09:20:35.731768+0000","last_active":"2024-09-19T09:20:35.732098+0000","last_peered":"2024-09-19T09:20:35.732098+0000","last_clean":"2024-09-19T09:20:35.732098+0000","last_became_active":"2024-09-19T09:20:35.731537+0000","last_became_peered":"2024-09-19T09:20:35.731537+0000","last_unstale":"2024-09-19T09:20:35.732098+0000","last_undegraded":"2024-09-19T09:20:35.732098+0000","last_fullsized":"2024-09-19T09:20:35.732098+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:11.717331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.729512+0000","last_change":"2024-09-19T09:20:35.727595+0000","last_active":"2024-09-19T09:20:35.729512+0000","last_peered":"2024-09-19T09:20:35.729512+0000","last_clean":"2024-09-19T09:20:35.729512+0000","last_became_active":"2024-09-19T09:20:35.724969+0000","last_became_peered":"2024-09-19T09:20:35.724969+0000","last_unstale":"2024-09-19T09:20:35.729512+0000","last_undegraded":"2024-09-19T09:20:35.729512+0000","last_fullsized":"2024-09-19T09:20:35.729512+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:00.570871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.719377+0000","last_change":"2024-09-19T09:20:35.719244+0000","last_active":"2024-09-19T09:20:35.719377+0000","last_peered":"2024-09-19T09:20:35.719377+0000","last_clean":"2024-09-19T09:20:35.719377+0000","last_became_active":"2024-09-19T09:20:35.718964+0000","last_became_peered":"2024-09-19T09:20:35.718964+0000","last_unstale":"2024-09-19T09:20:35.719377+0000","last_undegraded":"2024-09-19T09:20:35.719377+0000","last_fullsized":"2024-09-19T09:20:35.719377+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:19:10.616606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.730978+0000","last_change":"2024-09-19T09:20:35.730114+0000","last_active":"2024-09-19T09:20:35.730978+0000","last_peered":"2024-09-19T09:20:35.730978+0000","last_clean":"2024-09-19T09:20:35.730978+0000","last_became_active":"2024-09-19T09:20:35.729826+0000","last_became_peered":"2024-09-19T09:20:35.729826+0000","last_unstale":"2024-09-19T09:20:35.730978+0000","last_undegraded":"2024-09-19T09:20:35.730978+0000","last_fullsized":"2024-09-19T09:20:35.730978+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:46:17.531800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.731542+0000","last_change":"2024-09-19T09:20:35.731399+0000","last_active":"2024-09-19T09:20:35.731542+0000","last_peered":"2024-09-19T09:20:35.731542+0000","last_clean":"2024-09-19T09:20:35.731542+0000","last_became_active":"2024-09-19T09:20:35.730897+0000","last_became_peered":"2024-09-19T09:20:35.730897+0000","last_unstale":"2024-09-19T09:20:35.731542+0000","last_undegraded":"2024-09-19T09:20:35.731542+0000","last_fullsized":"2024-09-19T09:20:35.731542+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:32:01.702729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.739653+0000","last_change":"2024-09-19T09:20:35.739216+0000","last_active":"2024-09-19T09:20:35.739653+0000","last_peered":"2024-09-19T09:20:35.739653+0000","last_clean":"2024-09-19T09:20:35.739653+0000","last_became_active":"2024-09-19T09:20:35.738026+0000","last_became_peered":"2024-09-19T09:20:35.738026+0000","last_unstale":"2024-09-19T09:20:35.739653+0000","last_undegraded":"2024-09-19T09:20:35.739653+0000","last_fullsized":"2024-09-19T09:20:35.739653+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:37.702986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.726043+0000","last_change":"2024-09-19T09:20:35.724839+0000","last_active":"2024-09-19T09:20:35.726043+0000","last_peered":"2024-09-19T09:20:35.726043+0000","last_clean":"2024-09-19T09:20:35.726043+0000","last_became_active":"2024-09-19T09:20:35.724644+0000","last_became_peered":"2024-09-19T09:20:35.724644+0000","last_unstale":"2024-09-19T09:20:35.726043+0000","last_undegraded":"2024-09-19T09:20:35.726043+0000","last_fullsized":"2024-09-19T09:20:35.726043+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:16.347281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.724796+0000","last_change":"2024-09-19T09:20:35.724497+0000","last_active":"2024-09-19T09:20:35.724796+0000","last_peered":"2024-09-19T09:20:35.724796+0000","last_clean":"2024-09-19T09:20:35.724796+0000","last_became_active":"2024-09-19T09:20:35.723988+0000","last_became_peered":"2024-09-19T09:20:35.723988+0000","last_unstale":"2024-09-19T09:20:35.724796+0000","last_undegraded":"2024-09-19T09:20:35.724796+0000","last_fullsized":"2024-09-19T09:20:35.724796+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:52.674176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.730213+0000","last_change":"2024-09-19T09:20:35.730080+0000","last_active":"2024-09-19T09:20:35.730213+0000","last_peered":"2024-09-19T09:20:35.730213+0000","last_clean":"2024-09-19T09:20:35.730213+0000","last_became_active":"2024-09-19T09:20:35.729372+0000","last_became_peered":"2024-09-19T09:20:35.729372+0000","last_unstale":"2024-09-19T09:20:35.730213+0000","last_undegraded":"2024-09-19T09:20:35.730213+0000","last_fullsized":"2024-09-19T09:20:35.730213+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:56.430610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.725960+0000","last_change":"2024-09-19T09:20:35.724769+0000","last_active":"2024-09-19T09:20:35.725960+0000","last_peered":"2024-09-19T09:20:35.725960+0000","last_clean":"2024-09-19T09:20:35.725960+0000","last_became_active":"2024-09-19T09:20:35.724545+0000","last_became_peered":"2024-09-19T09:20:35.724545+0000","last_unstale":"2024-09-19T09:20:35.725960+0000","last_undegraded":"2024-09-19T09:20:35.725960+0000","last_fullsized":"2024-09-19T09:20:35.725960+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:21.691899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.739558+0000","last_change":"2024-09-19T09:20:35.738542+0000","last_active":"2024-09-19T09:20:35.739558+0000","last_peered":"2024-09-19T09:20:35.739558+0000","last_clean":"2024-09-19T09:20:35.739558+0000","last_became_active":"2024-09-19T09:20:35.736744+0000","last_became_peered":"2024-09-19T09:20:35.736744+0000","last_unstale":"2024-09-19T09:20:35.739558+0000","last_undegraded":"2024-09-19T09:20:35.739558+0000","last_fullsized":"2024-09-19T09:20:35.739558+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:20.539492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.730234+0000","last_change":"2024-09-19T09:20:35.730140+0000","last_active":"2024-09-19T09:20:35.730234+0000","last_peered":"2024-09-19T09:20:35.730234+0000","last_clean":"2024-09-19T09:20:35.730234+0000","last_became_active":"2024-09-19T09:20:35.729848+0000","last_became_peered":"2024-09-19T09:20:35.729848+0000","last_unstale":"2024-09-19T09:20:35.730234+0000","last_undegraded":"2024-09-19T09:20:35.730234+0000","last_fullsized":"2024-09-19T09:20:35.730234+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:02:14.762991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.726877+0000","last_change":"2024-09-19T09:20:35.726763+0000","last_active":"2024-09-19T09:20:35.726877+0000","last_peered":"2024-09-19T09:20:35.726877+0000","last_clean":"2024-09-19T09:20:35.726877+0000","last_became_active":"2024-09-19T09:20:35.726539+0000","last_became_peered":"2024-09-19T09:20:35.726539+0000","last_unstale":"2024-09-19T09:20:35.726877+0000","last_undegraded":"2024-09-19T09:20:35.726877+0000","last_fullsized":"2024-09-19T09:20:35.726877+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:23.746831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.729247+0000","last_change":"2024-09-19T09:20:35.728628+0000","last_active":"2024-09-19T09:20:35.729247+0000","last_peered":"2024-09-19T09:20:35.729247+0000","last_clean":"2024-09-19T09:20:35.729247+0000","last_became_active":"2024-09-19T09:20:35.728378+0000","last_became_peered":"2024-09-19T09:20:35.728378+0000","last_unstale":"2024-09-19T09:20:35.729247+0000","last_undegraded":"2024-09-19T09:20:35.729247+0000","last_fullsized":"2024-09-19T09:20:35.729247+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:19.788225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.737401+0000","last_change":"2024-09-19T09:20:35.737164+0000","last_active":"2024-09-19T09:20:35.737401+0000","last_peered":"2024-09-19T09:20:35.737401+0000","last_clean":"2024-09-19T09:20:35.737401+0000","last_became_active":"2024-09-19T09:20:35.732671+0000","last_became_peered":"2024-09-19T09:20:35.732671+0000","last_unstale":"2024-09-19T09:20:35.737401+0000","last_undegraded":"2024-09-19T09:20:35.737401+0000","last_fullsized":"2024-09-19T09:20:35.737401+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:00.428526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.737119+0000","last_change":"2024-09-19T09:20:35.736993+0000","last_active":"2024-09-19T09:20:35.737119+0000","last_peered":"2024-09-19T09:20:35.737119+0000","last_clean":"2024-09-19T09:20:35.737119+0000","last_became_active":"2024-09-19T09:20:35.736698+0000","last_became_peered":"2024-09-19T09:20:35.736698+0000","last_unstale":"2024-09-19T09:20:35.737119+0000","last_undegraded":"2024-09-19T09:20:35.737119+0000","last_fullsized":"2024-09-19T09:20:35.737119+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:20.851884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"153'4","reported_seq":16,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.743868+0000","last_change":"2024-09-19T09:20:34.717241+0000","last_active":"2024-09-19T09:20:35.743868+0000","last_peered":"2024-09-19T09:20:35.743868+0000","last_clean":"2024-09-19T09:20:35.743868+0000","last_became_active":"2024-09-19T09:20:34.716343+0000","last_became_peered":"2024-09-19T09:20:34.716343+0000","last_unstale":"2024-09-19T09:20:35.743868+0000","last_undegraded":"2024-09-19T09:20:35.743868+0000","last_fullsized":"2024-09-19T09:20:35.743868+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:07.142150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.733344+0000","last_change":"2024-09-19T09:20:35.732560+0000","last_active":"2024-09-19T09:20:35.733344+0000","last_peered":"2024-09-19T09:20:35.733344+0000","last_clean":"2024-09-19T09:20:35.733344+0000","last_became_active":"2024-09-19T09:20:35.732303+0000","last_became_peered":"2024-09-19T09:20:35.732303+0000","last_unstale":"2024-09-19T09:20:35.733344+0000","last_undegraded":"2024-09-19T09:20:35.733344+0000","last_fullsized":"2024-09-19T09:20:35.733344+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:37:54.379424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"153'1","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.742732+0000","last_change":"2024-09-19T09:20:34.714290+0000","last_active":"2024-09-19T09:20:35.742732+0000","last_peered":"2024-09-19T09:20:35.742732+0000","last_clean":"2024-09-19T09:20:35.742732+0000","last_became_active":"2024-09-19T09:20:34.713628+0000","last_became_peered":"2024-09-19T09:20:34.713628+0000","last_unstale":"2024-09-19T09:20:35.742732+0000","last_undegraded":"2024-09-19T09:20:35.742732+0000","last_fullsized":"2024-09-19T09:20:35.742732+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:17:32.391640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.735586+0000","last_change":"2024-09-19T09:20:35.735467+0000","last_active":"2024-09-19T09:20:35.735586+0000","last_peered":"2024-09-19T09:20:35.735586+0000","last_clean":"2024-09-19T09:20:35.735586+0000","last_became_active":"2024-09-19T09:20:35.734833+0000","last_became_peered":"2024-09-19T09:20:35.734833+0000","last_unstale":"2024-09-19T09:20:35.735586+0000","last_undegraded":"2024-09-19T09:20:35.735586+0000","last_fullsized":"2024-09-19T09:20:35.735586+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:57.745780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1d","version":"153'2","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.737263+0000","last_change":"2024-09-19T09:20:34.713417+0000","last_active":"2024-09-19T09:20:35.737263+0000","last_peered":"2024-09-19T09:20:35.737263+0000","last_clean":"2024-09-19T09:20:35.737263+0000","last_became_active":"2024-09-19T09:20:34.713173+0000","last_became_peered":"2024-09-19T09:20:34.713173+0000","last_unstale":"2024-09-19T09:20:35.737263+0000","last_undegraded":"2024-09-19T09:20:35.737263+0000","last_fullsized":"2024-09-19T09:20:35.737263+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:11.683428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.735746+0000","last_change":"2024-09-19T09:20:35.735626+0000","last_active":"2024-09-19T09:20:35.735746+0000","last_peered":"2024-09-19T09:20:35.735746+0000","last_clean":"2024-09-19T09:20:35.735746+0000","last_became_active":"2024-09-19T09:20:35.734579+0000","last_became_peered":"2024-09-19T09:20:35.734579+0000","last_unstale":"2024-09-19T09:20:35.735746+0000","last_undegraded":"2024-09-19T09:20:35.735746+0000","last_fullsized":"2024-09-19T09:20:35.735746+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:47:00.408921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1c","version":"153'2","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.740032+0000","last_change":"2024-09-19T09:20:34.713768+0000","last_active":"2024-09-19T09:20:35.740032+0000","last_peered":"2024-09-19T09:20:35.740032+0000","last_clean":"2024-09-19T09:20:35.740032+0000","last_became_active":"2024-09-19T09:20:34.713343+0000","last_became_peered":"2024-09-19T09:20:34.713343+0000","last_unstale":"2024-09-19T09:20:35.740032+0000","last_undegraded":"2024-09-19T09:20:35.740032+0000","last_fullsized":"2024-09-19T09:20:35.740032+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:50.508570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.726026+0000","last_change":"2024-09-19T09:20:35.724426+0000","last_active":"2024-09-19T09:20:35.726026+0000","last_peered":"2024-09-19T09:20:35.726026+0000","last_clean":"2024-09-19T09:20:35.726026+0000","last_became_active":"2024-09-19T09:20:35.724173+0000","last_became_peered":"2024-09-19T09:20:35.724173+0000","last_unstale":"2024-09-19T09:20:35.726026+0000","last_undegraded":"2024-09-19T09:20:35.726026+0000","last_fullsized":"2024-09-19T09:20:35.726026+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:30.440307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"153'1","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.740546+0000","last_change":"2024-09-19T09:20:34.712966+0000","last_active":"2024-09-19T09:20:35.740546+0000","last_peered":"2024-09-19T09:20:35.740546+0000","last_clean":"2024-09-19T09:20:35.740546+0000","last_became_active":"2024-09-19T09:20:34.712458+0000","last_became_peered":"2024-09-19T09:20:34.712458+0000","last_unstale":"2024-09-19T09:20:35.740546+0000","last_undegraded":"2024-09-19T09:20:35.740546+0000","last_fullsized":"2024-09-19T09:20:35.740546+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:02.706947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.727762+0000","last_change":"2024-09-19T09:20:35.727262+0000","last_active":"2024-09-19T09:20:35.727762+0000","last_peered":"2024-09-19T09:20:35.727762+0000","last_clean":"2024-09-19T09:20:35.727762+0000","last_became_active":"2024-09-19T09:20:35.727025+0000","last_became_peered":"2024-09-19T09:20:35.727025+0000","last_unstale":"2024-09-19T09:20:35.727762+0000","last_undegraded":"2024-09-19T09:20:35.727762+0000","last_fullsized":"2024-09-19T09:20:35.727762+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:42.818527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"153'1","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.738308+0000","last_change":"2024-09-19T09:20:34.714109+0000","last_active":"2024-09-19T09:20:35.738308+0000","last_peered":"2024-09-19T09:20:35.738308+0000","last_clean":"2024-09-19T09:20:35.738308+0000","last_became_active":"2024-09-19T09:20:34.713865+0000","last_became_peered":"2024-09-19T09:20:34.713865+0000","last_unstale":"2024-09-19T09:20:35.738308+0000","last_undegraded":"2024-09-19T09:20:35.738308+0000","last_fullsized":"2024-09-19T09:20:35.738308+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:31:32.323414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.736187+0000","last_change":"2024-09-19T09:20:35.736078+0000","last_active":"2024-09-19T09:20:35.736187+0000","last_peered":"2024-09-19T09:20:35.736187+0000","last_clean":"2024-09-19T09:20:35.736187+0000","last_became_active":"2024-09-19T09:20:35.735397+0000","last_became_peered":"2024-09-19T09:20:35.735397+0000","last_unstale":"2024-09-19T09:20:35.736187+0000","last_undegraded":"2024-09-19T09:20:35.736187+0000","last_fullsized":"2024-09-19T09:20:35.736187+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:09.771361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.736037+0000","last_change":"2024-09-19T09:20:34.713251+0000","last_active":"2024-09-19T09:20:35.736037+0000","last_peered":"2024-09-19T09:20:35.736037+0000","last_clean":"2024-09-19T09:20:35.736037+0000","last_became_active":"2024-09-19T09:20:34.712998+0000","last_became_peered":"2024-09-19T09:20:34.712998+0000","last_unstale":"2024-09-19T09:20:35.736037+0000","last_undegraded":"2024-09-19T09:20:35.736037+0000","last_fullsized":"2024-09-19T09:20:35.736037+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:20:57.611422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.729493+0000","last_change":"2024-09-19T09:20:35.727368+0000","last_active":"2024-09-19T09:20:35.729493+0000","last_peered":"2024-09-19T09:20:35.729493+0000","last_clean":"2024-09-19T09:20:35.729493+0000","last_became_active":"2024-09-19T09:20:35.724655+0000","last_became_peered":"2024-09-19T09:20:35.724655+0000","last_unstale":"2024-09-19T09:20:35.729493+0000","last_undegraded":"2024-09-19T09:20:35.729493+0000","last_fullsized":"2024-09-19T09:20:35.729493+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:54:01.443831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.723673+0000","last_change":"2024-09-19T09:20:34.712185+0000","last_active":"2024-09-19T09:20:35.723673+0000","last_peered":"2024-09-19T09:20:35.723673+0000","last_clean":"2024-09-19T09:20:35.723673+0000","last_became_active":"2024-09-19T09:20:34.711184+0000","last_became_peered":"2024-09-19T09:20:34.711184+0000","last_unstale":"2024-09-19T09:20:35.723673+0000","last_undegraded":"2024-09-19T09:20:35.723673+0000","last_fullsized":"2024-09-19T09:20:35.723673+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:59.515122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.731503+0000","last_change":"2024-09-19T09:20:35.731186+0000","last_active":"2024-09-19T09:20:35.731503+0000","last_peered":"2024-09-19T09:20:35.731503+0000","last_clean":"2024-09-19T09:20:35.731503+0000","last_became_active":"2024-09-19T09:20:35.730539+0000","last_became_peered":"2024-09-19T09:20:35.730539+0000","last_unstale":"2024-09-19T09:20:35.731503+0000","last_undegraded":"2024-09-19T09:20:35.731503+0000","last_fullsized":"2024-09-19T09:20:35.731503+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:42.641523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.721022+0000","last_change":"2024-09-19T09:20:34.716878+0000","last_active":"2024-09-19T09:20:35.721022+0000","last_peered":"2024-09-19T09:20:35.721022+0000","last_clean":"2024-09-19T09:20:35.721022+0000","last_became_active":"2024-09-19T09:20:34.716295+0000","last_became_peered":"2024-09-19T09:20:34.716295+0000","last_unstale":"2024-09-19T09:20:35.721022+0000","last_undegraded":"2024-09-19T09:20:35.721022+0000","last_fullsized":"2024-09-19T09:20:35.721022+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:45:22.730590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.729638+0000","last_change":"2024-09-19T09:20:35.729389+0000","last_active":"2024-09-19T09:20:35.729638+0000","last_peered":"2024-09-19T09:20:35.729638+0000","last_clean":"2024-09-19T09:20:35.729638+0000","last_became_active":"2024-09-19T09:20:35.729158+0000","last_became_peered":"2024-09-19T09:20:35.729158+0000","last_unstale":"2024-09-19T09:20:35.729638+0000","last_undegraded":"2024-09-19T09:20:35.729638+0000","last_fullsized":"2024-09-19T09:20:35.729638+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:37:15.957997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.716456+0000","last_change":"2024-09-19T09:20:34.712526+0000","last_active":"2024-09-19T09:20:35.716456+0000","last_peered":"2024-09-19T09:20:35.716456+0000","last_clean":"2024-09-19T09:20:35.716456+0000","last_became_active":"2024-09-19T09:20:34.711857+0000","last_became_peered":"2024-09-19T09:20:34.711857+0000","last_unstale":"2024-09-19T09:20:35.716456+0000","last_undegraded":"2024-09-19T09:20:35.716456+0000","last_fullsized":"2024-09-19T09:20:35.716456+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:16:29.191878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.732774+0000","last_change":"2024-09-19T09:20:35.732542+0000","last_active":"2024-09-19T09:20:35.732774+0000","last_peered":"2024-09-19T09:20:35.732774+0000","last_clean":"2024-09-19T09:20:35.732774+0000","last_became_active":"2024-09-19T09:20:35.732283+0000","last_became_peered":"2024-09-19T09:20:35.732283+0000","last_unstale":"2024-09-19T09:20:35.732774+0000","last_undegraded":"2024-09-19T09:20:35.732774+0000","last_fullsized":"2024-09-19T09:20:35.732774+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:23.441278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.15","version":"153'3","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.743033+0000","last_change":"2024-09-19T09:20:34.716968+0000","last_active":"2024-09-19T09:20:35.743033+0000","last_peered":"2024-09-19T09:20:35.743033+0000","last_clean":"2024-09-19T09:20:35.743033+0000","last_became_active":"2024-09-19T09:20:34.715981+0000","last_became_peered":"2024-09-19T09:20:34.715981+0000","last_unstale":"2024-09-19T09:20:35.743033+0000","last_undegraded":"2024-09-19T09:20:35.743033+0000","last_fullsized":"2024-09-19T09:20:35.743033+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:26.878874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.739599+0000","last_change":"2024-09-19T09:20:35.738991+0000","last_active":"2024-09-19T09:20:35.739599+0000","last_peered":"2024-09-19T09:20:35.739599+0000","last_clean":"2024-09-19T09:20:35.739599+0000","last_became_active":"2024-09-19T09:20:35.737680+0000","last_became_peered":"2024-09-19T09:20:35.737680+0000","last_unstale":"2024-09-19T09:20:35.739599+0000","last_undegraded":"2024-09-19T09:20:35.739599+0000","last_fullsized":"2024-09-19T09:20:35.739599+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:36:55.250255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.14","version":"153'6","reported_seq":18,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.743730+0000","last_change":"2024-09-19T09:20:34.714438+0000","last_active":"2024-09-19T09:20:35.743730+0000","last_peered":"2024-09-19T09:20:35.743730+0000","last_clean":"2024-09-19T09:20:35.743730+0000","last_became_active":"2024-09-19T09:20:34.714067+0000","last_became_peered":"2024-09-19T09:20:34.714067+0000","last_unstale":"2024-09-19T09:20:35.743730+0000","last_undegraded":"2024-09-19T09:20:35.743730+0000","last_fullsized":"2024-09-19T09:20:35.743730+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:53:56.899061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.729863+0000","last_change":"2024-09-19T09:20:35.729114+0000","last_active":"2024-09-19T09:20:35.729863+0000","last_peered":"2024-09-19T09:20:35.729863+0000","last_clean":"2024-09-19T09:20:35.729863+0000","last_became_active":"2024-09-19T09:20:35.728895+0000","last_became_peered":"2024-09-19T09:20:35.728895+0000","last_unstale":"2024-09-19T09:20:35.729863+0000","last_undegraded":"2024-09-19T09:20:35.729863+0000","last_fullsized":"2024-09-19T09:20:35.729863+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:04:08.715021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.724030+0000","last_change":"2024-09-19T09:20:34.711351+0000","last_active":"2024-09-19T09:20:35.724030+0000","last_peered":"2024-09-19T09:20:35.724030+0000","last_clean":"2024-09-19T09:20:35.724030+0000","last_became_active":"2024-09-19T09:20:34.711130+0000","last_became_peered":"2024-09-19T09:20:34.711130+0000","last_unstale":"2024-09-19T09:20:35.724030+0000","last_undegraded":"2024-09-19T09:20:35.724030+0000","last_fullsized":"2024-09-19T09:20:35.724030+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:40:44.354509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.732326+0000","last_change":"2024-09-19T09:20:35.732209+0000","last_active":"2024-09-19T09:20:35.732326+0000","last_peered":"2024-09-19T09:20:35.732326+0000","last_clean":"2024-09-19T09:20:35.732326+0000","last_became_active":"2024-09-19T09:20:35.731973+0000","last_became_peered":"2024-09-19T09:20:35.731973+0000","last_unstale":"2024-09-19T09:20:35.732326+0000","last_undegraded":"2024-09-19T09:20:35.732326+0000","last_fullsized":"2024-09-19T09:20:35.732326+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:39:46.268628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.716595+0000","last_change":"2024-09-19T09:20:34.715595+0000","last_active":"2024-09-19T09:20:35.716595+0000","last_peered":"2024-09-19T09:20:35.716595+0000","last_clean":"2024-09-19T09:20:35.716595+0000","last_became_active":"2024-09-19T09:20:34.715312+0000","last_became_peered":"2024-09-19T09:20:34.715312+0000","last_unstale":"2024-09-19T09:20:35.716595+0000","last_undegraded":"2024-09-19T09:20:35.716595+0000","last_fullsized":"2024-09-19T09:20:35.716595+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:25.059187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.731124+0000","last_change":"2024-09-19T09:20:35.730980+0000","last_active":"2024-09-19T09:20:35.731124+0000","last_peered":"2024-09-19T09:20:35.731124+0000","last_clean":"2024-09-19T09:20:35.731124+0000","last_became_active":"2024-09-19T09:20:35.730716+0000","last_became_peered":"2024-09-19T09:20:35.730716+0000","last_unstale":"2024-09-19T09:20:35.731124+0000","last_undegraded":"2024-09-19T09:20:35.731124+0000","last_fullsized":"2024-09-19T09:20:35.731124+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:51:29.136284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"153'8","reported_seq":20,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.744364+0000","last_change":"2024-09-19T09:20:34.709713+0000","last_active":"2024-09-19T09:20:35.744364+0000","last_peered":"2024-09-19T09:20:35.744364+0000","last_clean":"2024-09-19T09:20:35.744364+0000","last_became_active":"2024-09-19T09:20:34.709471+0000","last_became_peered":"2024-09-19T09:20:34.709471+0000","last_unstale":"2024-09-19T09:20:35.744364+0000","last_undegraded":"2024-09-19T09:20:35.744364+0000","last_fullsized":"2024-09-19T09:20:35.744364+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:21.547230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.729619+0000","last_change":"2024-09-19T09:20:35.728649+0000","last_active":"2024-09-19T09:20:35.729619+0000","last_peered":"2024-09-19T09:20:35.729619+0000","last_clean":"2024-09-19T09:20:35.729619+0000","last_became_active":"2024-09-19T09:20:35.728393+0000","last_became_peered":"2024-09-19T09:20:35.728393+0000","last_unstale":"2024-09-19T09:20:35.729619+0000","last_undegraded":"2024-09-19T09:20:35.729619+0000","last_fullsized":"2024-09-19T09:20:35.729619+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:05:50.700527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.f","version":"153'1","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.743031+0000","last_change":"2024-09-19T09:20:34.714119+0000","last_active":"2024-09-19T09:20:35.743031+0000","last_peered":"2024-09-19T09:20:35.743031+0000","last_clean":"2024-09-19T09:20:35.743031+0000","last_became_active":"2024-09-19T09:20:34.712855+0000","last_became_peered":"2024-09-19T09:20:34.712855+0000","last_unstale":"2024-09-19T09:20:35.743031+0000","last_undegraded":"2024-09-19T09:20:35.743031+0000","last_fullsized":"2024-09-19T09:20:35.743031+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:43:53.697811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.722681+0000","last_change":"2024-09-19T09:20:35.722552+0000","last_active":"2024-09-19T09:20:35.722681+0000","last_peered":"2024-09-19T09:20:35.722681+0000","last_clean":"2024-09-19T09:20:35.722681+0000","last_became_active":"2024-09-19T09:20:35.722259+0000","last_became_peered":"2024-09-19T09:20:35.722259+0000","last_unstale":"2024-09-19T09:20:35.722681+0000","last_undegraded":"2024-09-19T09:20:35.722681+0000","last_fullsized":"2024-09-19T09:20:35.722681+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:22.925705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"153'2","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.740466+0000","last_change":"2024-09-19T09:20:34.706991+0000","last_active":"2024-09-19T09:20:35.740466+0000","last_peered":"2024-09-19T09:20:35.740466+0000","last_clean":"2024-09-19T09:20:35.740466+0000","last_became_active":"2024-09-19T09:20:34.706545+0000","last_became_peered":"2024-09-19T09:20:34.706545+0000","last_unstale":"2024-09-19T09:20:35.740466+0000","last_undegraded":"2024-09-19T09:20:35.740466+0000","last_fullsized":"2024-09-19T09:20:35.740466+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:40.310785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.729987+0000","last_change":"2024-09-19T09:20:35.729654+0000","last_active":"2024-09-19T09:20:35.729987+0000","last_peered":"2024-09-19T09:20:35.729987+0000","last_clean":"2024-09-19T09:20:35.729987+0000","last_became_active":"2024-09-19T09:20:35.729208+0000","last_became_peered":"2024-09-19T09:20:35.729208+0000","last_unstale":"2024-09-19T09:20:35.729987+0000","last_undegraded":"2024-09-19T09:20:35.729987+0000","last_fullsized":"2024-09-19T09:20:35.729987+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:28:42.929394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.d","version":"153'1","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.739863+0000","last_change":"2024-09-19T09:20:34.712248+0000","last_active":"2024-09-19T09:20:35.739863+0000","last_peered":"2024-09-19T09:20:35.739863+0000","last_clean":"2024-09-19T09:20:35.739863+0000","last_became_active":"2024-09-19T09:20:34.711647+0000","last_became_peered":"2024-09-19T09:20:34.711647+0000","last_unstale":"2024-09-19T09:20:35.739863+0000","last_undegraded":"2024-09-19T09:20:35.739863+0000","last_fullsized":"2024-09-19T09:20:35.739863+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:34.983811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.727202+0000","last_change":"2024-09-19T09:20:35.726955+0000","last_active":"2024-09-19T09:20:35.727202+0000","last_peered":"2024-09-19T09:20:35.727202+0000","last_clean":"2024-09-19T09:20:35.727202+0000","last_became_active":"2024-09-19T09:20:35.726712+0000","last_became_peered":"2024-09-19T09:20:35.726712+0000","last_unstale":"2024-09-19T09:20:35.727202+0000","last_undegraded":"2024-09-19T09:20:35.727202+0000","last_fullsized":"2024-09-19T09:20:35.727202+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:09.872830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.723670+0000","last_change":"2024-09-19T09:20:34.717605+0000","last_active":"2024-09-19T09:20:35.723670+0000","last_peered":"2024-09-19T09:20:35.723670+0000","last_clean":"2024-09-19T09:20:35.723670+0000","last_became_active":"2024-09-19T09:20:34.717385+0000","last_became_peered":"2024-09-19T09:20:34.717385+0000","last_unstale":"2024-09-19T09:20:35.723670+0000","last_undegraded":"2024-09-19T09:20:35.723670+0000","last_fullsized":"2024-09-19T09:20:35.723670+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:56.301330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.724454+0000","last_change":"2024-09-19T09:20:35.723720+0000","last_active":"2024-09-19T09:20:35.724454+0000","last_peered":"2024-09-19T09:20:35.724454+0000","last_clean":"2024-09-19T09:20:35.724454+0000","last_became_active":"2024-09-19T09:20:35.723498+0000","last_became_peered":"2024-09-19T09:20:35.723498+0000","last_unstale":"2024-09-19T09:20:35.724454+0000","last_undegraded":"2024-09-19T09:20:35.724454+0000","last_fullsized":"2024-09-19T09:20:35.724454+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:55.833877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.b","version":"153'2","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.741217+0000","last_change":"2024-09-19T09:20:34.713036+0000","last_active":"2024-09-19T09:20:35.741217+0000","last_peered":"2024-09-19T09:20:35.741217+0000","last_clean":"2024-09-19T09:20:35.741217+0000","last_became_active":"2024-09-19T09:20:34.712787+0000","last_became_peered":"2024-09-19T09:20:34.712787+0000","last_unstale":"2024-09-19T09:20:35.741217+0000","last_undegraded":"2024-09-19T09:20:35.741217+0000","last_fullsized":"2024-09-19T09:20:35.741217+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:55.022640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.739538+0000","last_change":"2024-09-19T09:20:35.738291+0000","last_active":"2024-09-19T09:20:35.739538+0000","last_peered":"2024-09-19T09:20:35.739538+0000","last_clean":"2024-09-19T09:20:35.739538+0000","last_became_active":"2024-09-19T09:20:35.736194+0000","last_became_peered":"2024-09-19T09:20:35.736194+0000","last_unstale":"2024-09-19T09:20:35.739538+0000","last_undegraded":"2024-09-19T09:20:35.739538+0000","last_fullsized":"2024-09-19T09:20:35.739538+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:48.288965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.717536+0000","last_change":"2024-09-19T09:20:34.717993+0000","last_active":"2024-09-19T09:20:35.717536+0000","last_peered":"2024-09-19T09:20:35.717536+0000","last_clean":"2024-09-19T09:20:35.717536+0000","last_became_active":"2024-09-19T09:20:34.717738+0000","last_became_peered":"2024-09-19T09:20:34.717738+0000","last_unstale":"2024-09-19T09:20:35.717536+0000","last_undegraded":"2024-09-19T09:20:35.717536+0000","last_fullsized":"2024-09-19T09:20:35.717536+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:14:43.699217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.727604+0000","last_change":"2024-09-19T09:20:35.727483+0000","last_active":"2024-09-19T09:20:35.727604+0000","last_peered":"2024-09-19T09:20:35.727604+0000","last_clean":"2024-09-19T09:20:35.727604+0000","last_became_active":"2024-09-19T09:20:35.727170+0000","last_became_peered":"2024-09-19T09:20:35.727170+0000","last_unstale":"2024-09-19T09:20:35.727604+0000","last_undegraded":"2024-09-19T09:20:35.727604+0000","last_fullsized":"2024-09-19T09:20:35.727604+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:05:57.311663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.725866+0000","last_change":"2024-09-19T09:20:34.715220+0000","last_active":"2024-09-19T09:20:35.725866+0000","last_peered":"2024-09-19T09:20:35.725866+0000","last_clean":"2024-09-19T09:20:35.725866+0000","last_became_active":"2024-09-19T09:20:34.714981+0000","last_became_peered":"2024-09-19T09:20:34.714981+0000","last_unstale":"2024-09-19T09:20:35.725866+0000","last_undegraded":"2024-09-19T09:20:35.725866+0000","last_fullsized":"2024-09-19T09:20:35.725866+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:18:55.706504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.722389+0000","last_change":"2024-09-19T09:20:35.722185+0000","last_active":"2024-09-19T09:20:35.722389+0000","last_peered":"2024-09-19T09:20:35.722389+0000","last_clean":"2024-09-19T09:20:35.722389+0000","last_became_active":"2024-09-19T09:20:35.721937+0000","last_became_peered":"2024-09-19T09:20:35.721937+0000","last_unstale":"2024-09-19T09:20:35.722389+0000","last_undegraded":"2024-09-19T09:20:35.722389+0000","last_fullsized":"2024-09-19T09:20:35.722389+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:56:31.535021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.717295+0000","last_change":"2024-09-19T09:20:34.711013+0000","last_active":"2024-09-19T09:20:35.717295+0000","last_peered":"2024-09-19T09:20:35.717295+0000","last_clean":"2024-09-19T09:20:35.717295+0000","last_became_active":"2024-09-19T09:20:34.710770+0000","last_became_peered":"2024-09-19T09:20:34.710770+0000","last_unstale":"2024-09-19T09:20:35.717295+0000","last_undegraded":"2024-09-19T09:20:35.717295+0000","last_fullsized":"2024-09-19T09:20:35.717295+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:01.765494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.739576+0000","last_change":"2024-09-19T09:20:35.738760+0000","last_active":"2024-09-19T09:20:35.739576+0000","last_peered":"2024-09-19T09:20:35.739576+0000","last_clean":"2024-09-19T09:20:35.739576+0000","last_became_active":"2024-09-19T09:20:35.737336+0000","last_became_peered":"2024-09-19T09:20:35.737336+0000","last_unstale":"2024-09-19T09:20:35.739576+0000","last_undegraded":"2024-09-19T09:20:35.739576+0000","last_fullsized":"2024-09-19T09:20:35.739576+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:11.428914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.7","version":"153'2","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.739786+0000","last_change":"2024-09-19T09:20:34.717844+0000","last_active":"2024-09-19T09:20:35.739786+0000","last_peered":"2024-09-19T09:20:35.739786+0000","last_clean":"2024-09-19T09:20:35.739786+0000","last_became_active":"2024-09-19T09:20:34.717615+0000","last_became_peered":"2024-09-19T09:20:34.717615+0000","last_unstale":"2024-09-19T09:20:35.739786+0000","last_undegraded":"2024-09-19T09:20:35.739786+0000","last_fullsized":"2024-09-19T09:20:35.739786+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:44.743933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.729970+0000","last_change":"2024-09-19T09:20:35.729445+0000","last_active":"2024-09-19T09:20:35.729970+0000","last_peered":"2024-09-19T09:20:35.729970+0000","last_clean":"2024-09-19T09:20:35.729970+0000","last_became_active":"2024-09-19T09:20:35.728432+0000","last_became_peered":"2024-09-19T09:20:35.728432+0000","last_unstale":"2024-09-19T09:20:35.729970+0000","last_undegraded":"2024-09-19T09:20:35.729970+0000","last_fullsized":"2024-09-19T09:20:35.729970+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:49.300676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.723174+0000","last_change":"2024-09-19T09:20:34.717452+0000","last_active":"2024-09-19T09:20:35.723174+0000","last_peered":"2024-09-19T09:20:35.723174+0000","last_clean":"2024-09-19T09:20:35.723174+0000","last_became_active":"2024-09-19T09:20:34.716690+0000","last_became_peered":"2024-09-19T09:20:34.716690+0000","last_unstale":"2024-09-19T09:20:35.723174+0000","last_undegraded":"2024-09-19T09:20:35.723174+0000","last_fullsized":"2024-09-19T09:20:35.723174+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:40.956965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.728495+0000","last_change":"2024-09-19T09:20:35.728149+0000","last_active":"2024-09-19T09:20:35.728495+0000","last_peered":"2024-09-19T09:20:35.728495+0000","last_clean":"2024-09-19T09:20:35.728495+0000","last_became_active":"2024-09-19T09:20:35.727470+0000","last_became_peered":"2024-09-19T09:20:35.727470+0000","last_unstale":"2024-09-19T09:20:35.728495+0000","last_undegraded":"2024-09-19T09:20:35.728495+0000","last_fullsized":"2024-09-19T09:20:35.728495+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:11.204392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.717700+0000","last_change":"2024-09-19T09:20:34.715754+0000","last_active":"2024-09-19T09:20:35.717700+0000","last_peered":"2024-09-19T09:20:35.717700+0000","last_clean":"2024-09-19T09:20:35.717700+0000","last_became_active":"2024-09-19T09:20:34.715474+0000","last_became_peered":"2024-09-19T09:20:34.715474+0000","last_unstale":"2024-09-19T09:20:35.717700+0000","last_undegraded":"2024-09-19T09:20:35.717700+0000","last_fullsized":"2024-09-19T09:20:35.717700+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:57:39.022588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.737073+0000","last_change":"2024-09-19T09:20:35.736956+0000","last_active":"2024-09-19T09:20:35.737073+0000","last_peered":"2024-09-19T09:20:35.737073+0000","last_clean":"2024-09-19T09:20:35.737073+0000","last_became_active":"2024-09-19T09:20:35.736338+0000","last_became_peered":"2024-09-19T09:20:35.736338+0000","last_unstale":"2024-09-19T09:20:35.737073+0000","last_undegraded":"2024-09-19T09:20:35.737073+0000","last_fullsized":"2024-09-19T09:20:35.737073+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:33.204446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.726075+0000","last_change":"2024-09-19T09:20:34.711507+0000","last_active":"2024-09-19T09:20:35.726075+0000","last_peered":"2024-09-19T09:20:35.726075+0000","last_clean":"2024-09-19T09:20:35.726075+0000","last_became_active":"2024-09-19T09:20:34.711050+0000","last_became_peered":"2024-09-19T09:20:34.711050+0000","last_unstale":"2024-09-19T09:20:35.726075+0000","last_undegraded":"2024-09-19T09:20:35.726075+0000","last_fullsized":"2024-09-19T09:20:35.726075+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:43.265375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.729792+0000","last_change":"2024-09-19T09:20:35.729277+0000","last_active":"2024-09-19T09:20:35.729792+0000","last_peered":"2024-09-19T09:20:35.729792+0000","last_clean":"2024-09-19T09:20:35.729792+0000","last_became_active":"2024-09-19T09:20:35.729016+0000","last_became_peered":"2024-09-19T09:20:35.729016+0000","last_unstale":"2024-09-19T09:20:35.729792+0000","last_undegraded":"2024-09-19T09:20:35.729792+0000","last_fullsized":"2024-09-19T09:20:35.729792+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:36.149605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.721928+0000","last_change":"2024-09-19T09:20:34.715703+0000","last_active":"2024-09-19T09:20:35.721928+0000","last_peered":"2024-09-19T09:20:35.721928+0000","last_clean":"2024-09-19T09:20:35.721928+0000","last_became_active":"2024-09-19T09:20:34.715424+0000","last_became_peered":"2024-09-19T09:20:34.715424+0000","last_unstale":"2024-09-19T09:20:35.721928+0000","last_undegraded":"2024-09-19T09:20:35.721928+0000","last_fullsized":"2024-09-19T09:20:35.721928+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:15.433261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.725134+0000","last_change":"2024-09-19T09:20:35.725025+0000","last_active":"2024-09-19T09:20:35.725134+0000","last_peered":"2024-09-19T09:20:35.725134+0000","last_clean":"2024-09-19T09:20:35.725134+0000","last_became_active":"2024-09-19T09:20:35.724507+0000","last_became_peered":"2024-09-19T09:20:35.724507+0000","last_unstale":"2024-09-19T09:20:35.725134+0000","last_undegraded":"2024-09-19T09:20:35.725134+0000","last_fullsized":"2024-09-19T09:20:35.725134+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:02.681874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.721843+0000","last_change":"2024-09-19T09:20:34.713767+0000","last_active":"2024-09-19T09:20:35.721843+0000","last_peered":"2024-09-19T09:20:35.721843+0000","last_clean":"2024-09-19T09:20:35.721843+0000","last_became_active":"2024-09-19T09:20:34.713515+0000","last_became_peered":"2024-09-19T09:20:34.713515+0000","last_unstale":"2024-09-19T09:20:35.721843+0000","last_undegraded":"2024-09-19T09:20:35.721843+0000","last_fullsized":"2024-09-19T09:20:35.721843+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:52:25.223631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.726007+0000","last_change":"2024-09-19T09:20:35.723387+0000","last_active":"2024-09-19T09:20:35.726007+0000","last_peered":"2024-09-19T09:20:35.726007+0000","last_clean":"2024-09-19T09:20:35.726007+0000","last_became_active":"2024-09-19T09:20:35.723126+0000","last_became_peered":"2024-09-19T09:20:35.723126+0000","last_unstale":"2024-09-19T09:20:35.726007+0000","last_undegraded":"2024-09-19T09:20:35.726007+0000","last_fullsized":"2024-09-19T09:20:35.726007+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:39.240315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.718331+0000","last_change":"2024-09-19T09:20:34.717005+0000","last_active":"2024-09-19T09:20:35.718331+0000","last_peered":"2024-09-19T09:20:35.718331+0000","last_clean":"2024-09-19T09:20:35.718331+0000","last_became_active":"2024-09-19T09:20:34.716275+0000","last_became_peered":"2024-09-19T09:20:34.716275+0000","last_unstale":"2024-09-19T09:20:35.718331+0000","last_undegraded":"2024-09-19T09:20:35.718331+0000","last_fullsized":"2024-09-19T09:20:35.718331+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:02.640467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.737311+0000","last_change":"2024-09-19T09:20:35.737197+0000","last_active":"2024-09-19T09:20:35.737311+0000","last_peered":"2024-09-19T09:20:35.737311+0000","last_clean":"2024-09-19T09:20:35.737311+0000","last_became_active":"2024-09-19T09:20:35.736955+0000","last_became_peered":"2024-09-19T09:20:35.736955+0000","last_unstale":"2024-09-19T09:20:35.737311+0000","last_undegraded":"2024-09-19T09:20:35.737311+0000","last_fullsized":"2024-09-19T09:20:35.737311+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:19.877545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.723328+0000","last_change":"2024-09-19T09:20:34.716693+0000","last_active":"2024-09-19T09:20:35.723328+0000","last_peered":"2024-09-19T09:20:35.723328+0000","last_clean":"2024-09-19T09:20:35.723328+0000","last_became_active":"2024-09-19T09:20:34.716408+0000","last_became_peered":"2024-09-19T09:20:34.716408+0000","last_unstale":"2024-09-19T09:20:35.723328+0000","last_undegraded":"2024-09-19T09:20:35.723328+0000","last_fullsized":"2024-09-19T09:20:35.723328+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:26:50.827593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.735237+0000","last_change":"2024-09-19T09:20:35.735094+0000","last_active":"2024-09-19T09:20:35.735237+0000","last_peered":"2024-09-19T09:20:35.735237+0000","last_clean":"2024-09-19T09:20:35.735237+0000","last_became_active":"2024-09-19T09:20:35.734494+0000","last_became_peered":"2024-09-19T09:20:35.734494+0000","last_unstale":"2024-09-19T09:20:35.735237+0000","last_undegraded":"2024-09-19T09:20:35.735237+0000","last_fullsized":"2024-09-19T09:20:35.735237+0000","mapping_epoch":152,"log_start":"0'0","ondisk_log_start":"0'0","created":152,"last_epoch_clean":153,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:34.699815+0000","last_clean_scrub_stamp":"2024-09-19T09:20:34.699815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:22:20.604707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"153'2","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.741972+0000","last_change":"2024-09-19T09:20:34.713520+0000","last_active":"2024-09-19T09:20:35.741972+0000","last_peered":"2024-09-19T09:20:35.741972+0000","last_clean":"2024-09-19T09:20:35.741972+0000","last_became_active":"2024-09-19T09:20:34.713096+0000","last_became_peered":"2024-09-19T09:20:34.713096+0000","last_unstale":"2024-09-19T09:20:35.741972+0000","last_undegraded":"2024-09-19T09:20:35.741972+0000","last_fullsized":"2024-09-19T09:20:35.741972+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:20:33.694357+0000","last_clean_scrub_stamp":"2024-09-19T09:20:33.694357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:42:04.239190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":429,"reported_epoch":153,"state":"active+clean","last_fresh":"2024-09-19T09:20:35.722919+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:20:35.722919+0000","last_peered":"2024-09-19T09:20:35.722919+0000","last_clean":"2024-09-19T09:20:35.722919+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:20:35.722919+0000","last_undegraded":"2024-09-19T09:20:35.722919+0000","last_fullsized":"2024-09-19T09:20:35.722919+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:28.823470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574938,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":832,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194480,"statfs":{"total":200000000,"available":199147536,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":832,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194480,"statfs":{"total":200000000,"available":199147570,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574938,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1409,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193902,"statfs":{"total":200000000,"available":198556460,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574938,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":832,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194480,"statfs":{"total":200000000,"available":199147570,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574938,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":832,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194479,"statfs":{"total":200000000,"available":199147500,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574938,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":833,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194479,"statfs":{"total":200000000,"available":199146898,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1410,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193901,"statfs":{"total":200000000,"available":198555568,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574938,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":834,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194478,"statfs":{"total":200000000,"available":199145902,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:20:39.572 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T09:20:39.572 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-19T09:20:39.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.718+0000 7f2b62552640 1 Processor -- start 2024-09-19T09:20:39.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.718+0000 7f2b62552640 1 -- start start 2024-09-19T09:20:39.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.719+0000 7f2b62552640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2b5c15c670 0x7f2b5c0b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.719+0000 7f2b62552640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b5c06deb0 0x7f2b5c160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.719+0000 7f2b62552640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b5c0b6a60 con 0x7f2b5c15f1a0 2024-09-19T09:20:39.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.719+0000 7f2b62552640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2b5c0b6d40 con 0x7f2b5c15c670 2024-09-19T09:20:39.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.719+0000 7f2b62552640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2b5c0b7020 con 0x7f2b5c06deb0 2024-09-19T09:20:39.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.719+0000 7f2b60aef640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b5c06deb0 0x7f2b5c160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.719+0000 7f2b5bfff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2b5c15c670 0x7f2b5c0b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.719+0000 7f2b5b7fe640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f2b5c15f1a0 0x7f2b5c06d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:49912/0 (socket says 172.21.15.18:49912) 2024-09-19T09:20:39.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.719+0000 7f2b5b7fe640 1 -- 172.21.15.18:0/3422113782 learned_addr learned my addr 172.21.15.18:0/3422113782 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:20:39.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.720+0000 7f2b5affd640 1 -- 172.21.15.18:0/3422113782 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 677191840 0 0) 0x7f2b5c0b6a60 con 0x7f2b5c15f1a0 2024-09-19T09:20:39.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.720+0000 7f2b5affd640 1 -- 172.21.15.18:0/3422113782 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b44003520 con 0x7f2b5c15f1a0 2024-09-19T09:20:39.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.720+0000 7f2b60aef640 1 -- 172.21.15.18:0/3422113782 >> v2:172.21.15.162:3300/0 conn(0x7f2b5c15c670 msgr2=0x7f2b5c0b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:39.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.720+0000 7f2b60aef640 1 --2- 172.21.15.18:0/3422113782 >> v2:172.21.15.162:3300/0 conn(0x7f2b5c15c670 0x7f2b5c0b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.720+0000 7f2b60aef640 1 -- 172.21.15.18:0/3422113782 >> v1:172.21.15.162:6789/0 conn(0x7f2b5c15f1a0 legacy=0x7f2b5c06d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:39.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.720+0000 7f2b60aef640 1 -- 172.21.15.18:0/3422113782 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b5c0b7300 con 0x7f2b5c06deb0 2024-09-19T09:20:39.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.721+0000 7f2b60aef640 1 --2- 172.21.15.18:0/3422113782 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b5c06deb0 0x7f2b5c160300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2b54009d90 tx=0x7f2b5402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d85419db91b3ecb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:39.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.721+0000 7f2b5affd640 1 -- 172.21.15.18:0/3422113782 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b54007740 con 0x7f2b5c06deb0 2024-09-19T09:20:39.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.721+0000 7f2b5affd640 1 -- 172.21.15.18:0/3422113782 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b540078e0 con 0x7f2b5c06deb0 2024-09-19T09:20:39.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.721+0000 7f2b5affd640 1 -- 172.21.15.18:0/3422113782 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b54007cb0 con 0x7f2b5c06deb0 2024-09-19T09:20:39.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.721+0000 7f2b62552640 1 -- 172.21.15.18:0/3422113782 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b5c06deb0 msgr2=0x7f2b5c160300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:39.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.721+0000 7f2b62552640 1 --2- 172.21.15.18:0/3422113782 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b5c06deb0 0x7f2b5c160300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2b54009d90 tx=0x7f2b5402a660 comp rx=0 tx=0).stop 2024-09-19T09:20:39.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.721+0000 7f2b62552640 1 -- 172.21.15.18:0/3422113782 shutdown_connections 2024-09-19T09:20:39.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.721+0000 7f2b62552640 1 --2- 172.21.15.18:0/3422113782 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b5c06deb0 0x7f2b5c160300 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.721+0000 7f2b62552640 1 --2- 172.21.15.18:0/3422113782 >> v2:172.21.15.162:3300/0 conn(0x7f2b5c15c670 0x7f2b5c0b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.721+0000 7f2b62552640 1 -- 172.21.15.18:0/3422113782 >> 172.21.15.18:0/3422113782 conn(0x7f2b5c09b9d0 msgr2=0x7f2b5c09bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:39.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.721+0000 7f2b62552640 1 -- 172.21.15.18:0/3422113782 shutdown_connections 2024-09-19T09:20:39.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.721+0000 7f2b62552640 1 -- 172.21.15.18:0/3422113782 wait complete. 2024-09-19T09:20:39.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.723+0000 7f2b62552640 1 Processor -- start 2024-09-19T09:20:39.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.723+0000 7f2b62552640 1 -- start start 2024-09-19T09:20:39.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.724+0000 7f2b62552640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b5c06deb0 0x7f2b5c14c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.724+0000 7f2b62552640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b5c15c670 0x7f2b5c158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.724+0000 7f2b62552640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b5c15f1a0 0x7f2b5c09e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.724+0000 7f2b62552640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5c0b7b00 con 0x7f2b5c06deb0 2024-09-19T09:20:39.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.724+0000 7f2b62552640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2b5c09c560 con 0x7f2b5c15c670 2024-09-19T09:20:39.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.724+0000 7f2b62552640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2b5c14c8a0 con 0x7f2b5c15f1a0 2024-09-19T09:20:39.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.724+0000 7f2b5bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b5c06deb0 0x7f2b5c14c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.724+0000 7f2b5bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b5c06deb0 0x7f2b5c14c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53256/0 (socket says 172.21.15.18:53256) 2024-09-19T09:20:39.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.724+0000 7f2b5bfff640 1 -- 172.21.15.18:0/1174537074 learned_addr learned my addr 172.21.15.18:0/1174537074 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:39.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.724+0000 7f2b5b7fe640 1 --2- 172.21.15.18:0/1174537074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b5c15c670 0x7f2b5c158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.724+0000 7f2b60aef640 1 --2- 172.21.15.18:0/1174537074 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b5c15f1a0 0x7f2b5c09e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.724+0000 7f2b5bfff640 1 -- 172.21.15.18:0/1174537074 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b5c15f1a0 msgr2=0x7f2b5c09e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:39.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.724+0000 7f2b5bfff640 1 --2- 172.21.15.18:0/1174537074 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b5c15f1a0 0x7f2b5c09e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.724+0000 7f2b5bfff640 1 -- 172.21.15.18:0/1174537074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b5c15c670 msgr2=0x7f2b5c158bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:39.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.724+0000 7f2b5bfff640 1 --2- 172.21.15.18:0/1174537074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b5c15c670 0x7f2b5c158bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.724+0000 7f2b5bfff640 1 -- 172.21.15.18:0/1174537074 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b5c157090 con 0x7f2b5c06deb0 2024-09-19T09:20:39.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.724+0000 7f2b5bfff640 1 --2- 172.21.15.18:0/1174537074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b5c06deb0 0x7f2b5c14c360 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c00e9b0 tx=0x7f2b4c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:39.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.724+0000 7f2b58ff9640 1 -- 172.21.15.18:0/1174537074 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c017070 con 0x7f2b5c06deb0 2024-09-19T09:20:39.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.724+0000 7f2b58ff9640 1 -- 172.21.15.18:0/1174537074 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b4c00c9a0 con 0x7f2b5c06deb0 2024-09-19T09:20:39.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.724+0000 7f2b62552640 1 -- 172.21.15.18:0/1174537074 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b5c157370 con 0x7f2b5c06deb0 2024-09-19T09:20:39.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.724+0000 7f2b58ff9640 1 -- 172.21.15.18:0/1174537074 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c00cd90 con 0x7f2b5c06deb0 2024-09-19T09:20:39.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.725+0000 7f2b62552640 1 -- 172.21.15.18:0/1174537074 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b5c157930 con 0x7f2b5c06deb0 2024-09-19T09:20:39.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.725+0000 7f2b62552640 1 -- 172.21.15.18:0/1174537074 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b5c15ca50 con 0x7f2b5c06deb0 2024-09-19T09:20:39.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.726+0000 7f2b58ff9640 1 -- 172.21.15.18:0/1174537074 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2b4c01a070 con 0x7f2b5c06deb0 2024-09-19T09:20:39.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.726+0000 7f2b58ff9640 1 --2- 172.21.15.18:0/1174537074 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2b4806c2e0 0x7f2b4806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:39.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.727+0000 7f2b58ff9640 1 -- 172.21.15.18:0/1174537074 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f2b4c08b700 con 0x7f2b5c06deb0 2024-09-19T09:20:39.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.727+0000 7f2b5b7fe640 1 --2- 172.21.15.18:0/1174537074 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2b4806c2e0 0x7f2b4806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:39.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.727+0000 7f2b5b7fe640 1 --2- 172.21.15.18:0/1174537074 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2b4806c2e0 0x7f2b4806e7a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c155eb0 tx=0x7f2b50009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:39.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.731+0000 7f2b58ff9640 1 -- 172.21.15.18:0/1174537074 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2b4c059820 con 0x7f2b5c06deb0 2024-09-19T09:20:39.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.972+0000 7f2b62552640 1 -- 172.21.15.18:0/1174537074 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f2b5c159a20 con 0x7f2b5c06deb0 2024-09-19T09:20:39.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.975+0000 7f2b58ff9640 1 -- 172.21.15.18:0/1174537074 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) ==== 190+0+147 (secure 0 0 0) 0x7f2b4c05db20 con 0x7f2b5c06deb0 2024-09-19T09:20:39.975 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-09-19T09:20:39.976 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAe6+tmcbwDNhAAaG0+wu96Locwws+h0zeh8Q== 2024-09-19T09:20:39.976 INFO:teuthology.orchestra.run.smithi018.stdout: caps mds = "allow" 2024-09-19T09:20:39.976 INFO:teuthology.orchestra.run.smithi018.stdout: caps mon = "allow r" 2024-09-19T09:20:39.976 INFO:teuthology.orchestra.run.smithi018.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-19T09:20:39.976 INFO:teuthology.orchestra.run.smithi018.stderr:updated caps for client.0 2024-09-19T09:20:39.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.977+0000 7f2b62552640 1 -- 172.21.15.18:0/1174537074 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2b4806c2e0 msgr2=0x7f2b4806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:39.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.977+0000 7f2b62552640 1 --2- 172.21.15.18:0/1174537074 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2b4806c2e0 0x7f2b4806e7a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2b5c155eb0 tx=0x7f2b50009040 comp rx=0 tx=0).stop 2024-09-19T09:20:39.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.977+0000 7f2b62552640 1 -- 172.21.15.18:0/1174537074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b5c06deb0 msgr2=0x7f2b5c14c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:39.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.977+0000 7f2b62552640 1 --2- 172.21.15.18:0/1174537074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b5c06deb0 0x7f2b5c14c360 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c00e9b0 tx=0x7f2b4c00ee70 comp rx=0 tx=0).stop 2024-09-19T09:20:39.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.977+0000 7f2b62552640 1 -- 172.21.15.18:0/1174537074 shutdown_connections 2024-09-19T09:20:39.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.977+0000 7f2b62552640 1 --2- 172.21.15.18:0/1174537074 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2b4806c2e0 0x7f2b4806e7a0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.977+0000 7f2b62552640 1 --2- 172.21.15.18:0/1174537074 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2b5c15f1a0 0x7f2b5c09e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.977+0000 7f2b62552640 1 --2- 172.21.15.18:0/1174537074 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2b5c15c670 0x7f2b5c158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.977+0000 7f2b62552640 1 --2- 172.21.15.18:0/1174537074 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2b5c06deb0 0x7f2b5c14c360 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:39.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.977+0000 7f2b62552640 1 -- 172.21.15.18:0/1174537074 >> 172.21.15.18:0/1174537074 conn(0x7f2b5c09b9d0 msgr2=0x7f2b5c06d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:39.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.977+0000 7f2b62552640 1 -- 172.21.15.18:0/1174537074 shutdown_connections 2024-09-19T09:20:39.978 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:39.977+0000 7f2b62552640 1 -- 172.21.15.18:0/1174537074 wait complete. 2024-09-19T09:20:39.989 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:20:40.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.090+0000 7f2e371f8640 1 Processor -- start 2024-09-19T09:20:40.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.090+0000 7f2e371f8640 1 -- start start 2024-09-19T09:20:40.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.091+0000 7f2e371f8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2e300b5200 0x7f2e301629e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.091+0000 7f2e371f8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2e30162f20 0x7f2e300cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.091+0000 7f2e371f8640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e300d0a10 con 0x7f2e3015ed30 2024-09-19T09:20:40.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.091+0000 7f2e371f8640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f2e30070ab0 con 0x7f2e30162f20 2024-09-19T09:20:40.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.091+0000 7f2e371f8640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2e300d0cb0 con 0x7f2e300b5200 2024-09-19T09:20:40.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.091+0000 7f2e35795640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2e30162f20 0x7f2e300cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:40.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.091+0000 7f2e35795640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2e30162f20 0x7f2e300cf1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53258/0 (socket says 172.21.15.18:53258) 2024-09-19T09:20:40.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.091+0000 7f2e35795640 1 -- 172.21.15.18:0/1073458366 learned_addr learned my addr 172.21.15.18:0/1073458366 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:40.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.092+0000 7f2e35795640 1 -- 172.21.15.18:0/1073458366 >> v2:172.21.15.162:3300/0 conn(0x7f2e300b5200 msgr2=0x7f2e301629e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:20:40.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.092+0000 7f2e35795640 1 --2- 172.21.15.18:0/1073458366 >> v2:172.21.15.162:3300/0 conn(0x7f2e300b5200 0x7f2e301629e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.092+0000 7f2e35795640 1 -- 172.21.15.18:0/1073458366 >> v1:172.21.15.162:6789/0 conn(0x7f2e3015ed30 legacy=0x7f2e30070260 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:20:40.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.092+0000 7f2e35795640 1 -- 172.21.15.18:0/1073458366 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e300d0f90 con 0x7f2e30162f20 2024-09-19T09:20:40.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.092+0000 7f2e35795640 1 --2- 172.21.15.18:0/1073458366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e30162f20 0x7f2e300cf1e0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f2e300b2540 tx=0x7f2e1802a2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=769c470741872094 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:40.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.092+0000 7f2e2f7fe640 1 -- 172.21.15.18:0/1073458366 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e18037070 con 0x7f2e30162f20 2024-09-19T09:20:40.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.093+0000 7f2e2f7fe640 1 -- 172.21.15.18:0/1073458366 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e18032440 con 0x7f2e30162f20 2024-09-19T09:20:40.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.093+0000 7f2e2f7fe640 1 -- 172.21.15.18:0/1073458366 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e18032810 con 0x7f2e30162f20 2024-09-19T09:20:40.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.093+0000 7f2e371f8640 1 -- 172.21.15.18:0/1073458366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e30162f20 msgr2=0x7f2e300cf1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:40.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.093+0000 7f2e371f8640 1 --2- 172.21.15.18:0/1073458366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e30162f20 0x7f2e300cf1e0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f2e300b2540 tx=0x7f2e1802a2e0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.093+0000 7f2e371f8640 1 -- 172.21.15.18:0/1073458366 shutdown_connections 2024-09-19T09:20:40.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.093+0000 7f2e371f8640 1 --2- 172.21.15.18:0/1073458366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e30162f20 0x7f2e300cf1e0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.093+0000 7f2e371f8640 1 --2- 172.21.15.18:0/1073458366 >> v2:172.21.15.162:3300/0 conn(0x7f2e300b5200 0x7f2e301629e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.093+0000 7f2e371f8640 1 -- 172.21.15.18:0/1073458366 >> 172.21.15.18:0/1073458366 conn(0x7f2e300b4600 msgr2=0x7f2e300b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:40.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.093+0000 7f2e371f8640 1 -- 172.21.15.18:0/1073458366 shutdown_connections 2024-09-19T09:20:40.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.093+0000 7f2e371f8640 1 -- 172.21.15.18:0/1073458366 wait complete. 2024-09-19T09:20:40.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.094+0000 7f2e371f8640 1 Processor -- start 2024-09-19T09:20:40.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.094+0000 7f2e371f8640 1 -- start start 2024-09-19T09:20:40.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.095+0000 7f2e371f8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e300b5200 0x7f2e300b02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.095+0000 7f2e371f8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e3015ed30 0x7f2e3015c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.095+0000 7f2e371f8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e30162f20 0x7f2e301f8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.095+0000 7f2e371f8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3015f290 con 0x7f2e30162f20 2024-09-19T09:20:40.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.095+0000 7f2e371f8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3015f110 con 0x7f2e300b5200 2024-09-19T09:20:40.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.095+0000 7f2e371f8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2e300cf720 con 0x7f2e3015ed30 2024-09-19T09:20:40.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.095+0000 7f2e35795640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e30162f20 0x7f2e301f8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:40.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.095+0000 7f2e35795640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e30162f20 0x7f2e301f8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53264/0 (socket says 172.21.15.18:53264) 2024-09-19T09:20:40.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.095+0000 7f2e35795640 1 -- 172.21.15.18:0/2287642973 learned_addr learned my addr 172.21.15.18:0/2287642973 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:40.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.096+0000 7f2e34f94640 1 --2- 172.21.15.18:0/2287642973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e300b5200 0x7f2e300b02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:40.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.096+0000 7f2e35795640 1 -- 172.21.15.18:0/2287642973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e3015ed30 msgr2=0x7f2e3015c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:40.098 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.096+0000 7f2e2ffff640 1 --2- 172.21.15.18:0/2287642973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e3015ed30 0x7f2e3015c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:40.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.096+0000 7f2e35795640 1 --2- 172.21.15.18:0/2287642973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e3015ed30 0x7f2e3015c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.096+0000 7f2e35795640 1 -- 172.21.15.18:0/2287642973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e300b5200 msgr2=0x7f2e300b02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:40.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.096+0000 7f2e35795640 1 --2- 172.21.15.18:0/2287642973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e300b5200 0x7f2e300b02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.096+0000 7f2e35795640 1 -- 172.21.15.18:0/2287642973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e300b0830 con 0x7f2e30162f20 2024-09-19T09:20:40.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.096+0000 7f2e34f94640 1 --2- 172.21.15.18:0/2287642973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e300b5200 0x7f2e300b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:40.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.096+0000 7f2e35795640 1 --2- 172.21.15.18:0/2287642973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e30162f20 0x7f2e301f8090 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f2e180090b0 tx=0x7f2e180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:40.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.096+0000 7f2e2d7fa640 1 -- 172.21.15.18:0/2287642973 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e18041070 con 0x7f2e30162f20 2024-09-19T09:20:40.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.096+0000 7f2e2d7fa640 1 -- 172.21.15.18:0/2287642973 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e1803c890 con 0x7f2e30162f20 2024-09-19T09:20:40.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.096+0000 7f2e371f8640 1 -- 172.21.15.18:0/2287642973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e301f8b50 con 0x7f2e30162f20 2024-09-19T09:20:40.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.096+0000 7f2e2d7fa640 1 -- 172.21.15.18:0/2287642973 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e18037040 con 0x7f2e30162f20 2024-09-19T09:20:40.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.096+0000 7f2e371f8640 1 -- 172.21.15.18:0/2287642973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e300afaf0 con 0x7f2e30162f20 2024-09-19T09:20:40.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.097+0000 7f2e371f8640 1 -- 172.21.15.18:0/2287642973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e300cf1e0 con 0x7f2e30162f20 2024-09-19T09:20:40.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.098+0000 7f2e2d7fa640 1 -- 172.21.15.18:0/2287642973 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2e18044070 con 0x7f2e30162f20 2024-09-19T09:20:40.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.098+0000 7f2e2d7fa640 1 --2- 172.21.15.18:0/2287642973 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2e1006c2e0 0x7f2e1006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.098+0000 7f2e2d7fa640 1 -- 172.21.15.18:0/2287642973 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f2e180abd80 con 0x7f2e30162f20 2024-09-19T09:20:40.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.098+0000 7f2e34f94640 1 --2- 172.21.15.18:0/2287642973 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2e1006c2e0 0x7f2e1006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:40.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.099+0000 7f2e34f94640 1 --2- 172.21.15.18:0/2287642973 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2e1006c2e0 0x7f2e1006e7a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800a8b0 tx=0x7f2e28008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:40.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.102+0000 7f2e2d7fa640 1 -- 172.21.15.18:0/2287642973 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2e1807a4f0 con 0x7f2e30162f20 2024-09-19T09:20:40.316 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.316+0000 7f2e371f8640 1 -- 172.21.15.18:0/2287642973 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e300686d0 con 0x7f2e30162f20 2024-09-19T09:20:40.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.316+0000 7f2e2d7fa640 1 -- 172.21.15.18:0/2287642973 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+5225 (secure 0 0 0) 0x7f2e18079df0 con 0x7f2e30162f20 2024-09-19T09:20:40.317 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:20:40.317 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":65,"btime":"2024-09-19T09:20:38:235364+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6044,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2661639901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2661639901},{"type":"v1","addr":"172.21.15.162:6836","nonce":2661639901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":7221,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/56318264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":56318264},{"type":"v1","addr":"172.21.15.18:6833","nonce":56318264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":7239,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1783371939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1783371939},{"type":"v1","addr":"172.21.15.162:6837","nonce":1783371939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:20:35.068097+0000","modified":"2024-09-19T09:20:37.584812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7245":{"gid":7245,"name":"a","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/1201598209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1201598209},{"type":"v1","addr":"172.21.15.18:6835","nonce":1201598209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7245,"qdb_cluster":[7245]},"id":9}]} 2024-09-19T09:20:40.317 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 65 2024-09-19T09:20:40.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.318+0000 7f2e371f8640 1 -- 172.21.15.18:0/2287642973 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2e1006c2e0 msgr2=0x7f2e1006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:40.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.318+0000 7f2e371f8640 1 --2- 172.21.15.18:0/2287642973 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2e1006c2e0 0x7f2e1006e7a0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800a8b0 tx=0x7f2e28008040 comp rx=0 tx=0).stop 2024-09-19T09:20:40.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.318+0000 7f2e371f8640 1 -- 172.21.15.18:0/2287642973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e30162f20 msgr2=0x7f2e301f8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:40.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.318+0000 7f2e371f8640 1 --2- 172.21.15.18:0/2287642973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e30162f20 0x7f2e301f8090 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f2e180090b0 tx=0x7f2e180046c0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.318+0000 7f2e371f8640 1 -- 172.21.15.18:0/2287642973 shutdown_connections 2024-09-19T09:20:40.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.318+0000 7f2e371f8640 1 --2- 172.21.15.18:0/2287642973 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2e1006c2e0 0x7f2e1006e7a0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.318+0000 7f2e371f8640 1 --2- 172.21.15.18:0/2287642973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2e30162f20 0x7f2e301f8090 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.318+0000 7f2e371f8640 1 --2- 172.21.15.18:0/2287642973 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2e3015ed30 0x7f2e3015c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.318+0000 7f2e371f8640 1 --2- 172.21.15.18:0/2287642973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e300b5200 0x7f2e300b02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.318+0000 7f2e371f8640 1 -- 172.21.15.18:0/2287642973 >> 172.21.15.18:0/2287642973 conn(0x7f2e300b4600 msgr2=0x7f2e300cfae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:40.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.319+0000 7f2e371f8640 1 -- 172.21.15.18:0/2287642973 shutdown_connections 2024-09-19T09:20:40.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.319+0000 7f2e371f8640 1 -- 172.21.15.18:0/2287642973 wait complete. 2024-09-19T09:20:40.696 INFO:tasks.ceph.mds.a.smithi018.stderr:2024-09-19T09:20:40.696+0000 7fa1f0b83640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T09:20:40.733 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 65, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T09:20:35.068097+0000', 'modified': '2024-09-19T09:20:37.584812+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7245}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7245': {'gid': 7245, 'name': 'a', 'rank': 0, 'incarnation': 62, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.18:6835/1201598209', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6834', 'nonce': 1201598209}, {'type': 'v1', 'addr': '172.21.15.18:6835', 'nonce': 1201598209}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7245, 'qdb_cluster': [7245]} 2024-09-19T09:20:40.733 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T09:20:40.733 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-19T09:20:40.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.840+0000 7f27fffd8640 1 Processor -- start 2024-09-19T09:20:40.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.840+0000 7f27fffd8640 1 -- start start 2024-09-19T09:20:40.841 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.841+0000 7f27fffd8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27f815c950 0x7f27f8160c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.841+0000 7f27fffd8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f27f806ef40 0x7f27f80727d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.841+0000 7f27fffd8640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27f8070260 con 0x7f27f8161140 2024-09-19T09:20:40.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.841+0000 7f27fffd8640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f27f8160480 con 0x7f27f806ef40 2024-09-19T09:20:40.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.841+0000 7f27fffd8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f27f80704d0 con 0x7f27f815c950 2024-09-19T09:20:40.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.841+0000 7f27fe575640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f27f806ef40 0x7f27f80727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:40.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.841+0000 7f27fdd74640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27f815c950 0x7f27f8160c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:40.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.841+0000 7f27fe575640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f27f806ef40 0x7f27f80727d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:52062/0 (socket says 172.21.15.18:52062) 2024-09-19T09:20:40.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.841+0000 7f27fd573640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f27f8161140 0x7f27f806e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:49922/0 (socket says 172.21.15.18:49922) 2024-09-19T09:20:40.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.841+0000 7f27fe575640 1 -- 172.21.15.18:0/3995512918 learned_addr learned my addr 172.21.15.18:0/3995512918 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:40.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.842+0000 7f27fe575640 1 -- 172.21.15.18:0/3995512918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27f815c950 msgr2=0x7f27f8160c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:40.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.842+0000 7f27fe575640 1 --2- 172.21.15.18:0/3995512918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27f815c950 0x7f27f8160c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.842+0000 7f27fe575640 1 -- 172.21.15.18:0/3995512918 >> v1:172.21.15.162:6789/0 conn(0x7f27f8161140 legacy=0x7f27f806e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:40.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.842+0000 7f27fcd72640 1 -- 172.21.15.18:0/3995512918 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 373374587 0 0) 0x7f27f8070260 con 0x7f27f8161140 2024-09-19T09:20:40.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.842+0000 7f27fe575640 1 -- 172.21.15.18:0/3995512918 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f81606e0 con 0x7f27f806ef40 2024-09-19T09:20:40.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.842+0000 7f27fdd74640 1 --2- 172.21.15.18:0/3995512918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27f815c950 0x7f27f8160c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:40.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.843+0000 7f27fe575640 1 --2- 172.21.15.18:0/3995512918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27f806ef40 0x7f27f80727d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009e80 tx=0x7f27f002a760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dc793cdfc54eccf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:40.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.843+0000 7f27fcd72640 1 -- 172.21.15.18:0/3995512918 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f0036070 con 0x7f27f806ef40 2024-09-19T09:20:40.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.843+0000 7f27fcd72640 1 -- 172.21.15.18:0/3995512918 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27f0031600 con 0x7f27f806ef40 2024-09-19T09:20:40.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.843+0000 7f27fcd72640 1 -- 172.21.15.18:0/3995512918 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f00319d0 con 0x7f27f806ef40 2024-09-19T09:20:40.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.843+0000 7f27fffd8640 1 -- 172.21.15.18:0/3995512918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27f806ef40 msgr2=0x7f27f80727d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:40.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.843+0000 7f27fffd8640 1 --2- 172.21.15.18:0/3995512918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27f806ef40 0x7f27f80727d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f27f0009e80 tx=0x7f27f002a760 comp rx=0 tx=0).stop 2024-09-19T09:20:40.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.843+0000 7f27fffd8640 1 -- 172.21.15.18:0/3995512918 shutdown_connections 2024-09-19T09:20:40.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.843+0000 7f27fffd8640 1 --2- 172.21.15.18:0/3995512918 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27f806ef40 0x7f27f80727d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.843+0000 7f27fffd8640 1 --2- 172.21.15.18:0/3995512918 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27f815c950 0x7f27f8160c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.843+0000 7f27fffd8640 1 -- 172.21.15.18:0/3995512918 >> 172.21.15.18:0/3995512918 conn(0x7f27f80b3890 msgr2=0x7f27f80b3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:40.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.844+0000 7f27fffd8640 1 -- 172.21.15.18:0/3995512918 shutdown_connections 2024-09-19T09:20:40.846 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.844+0000 7f27fffd8640 1 -- 172.21.15.18:0/3995512918 wait complete. 2024-09-19T09:20:40.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.845+0000 7f27fffd8640 1 Processor -- start 2024-09-19T09:20:40.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.845+0000 7f27fffd8640 1 -- start start 2024-09-19T09:20:40.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.845+0000 7f27fffd8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27f806ef40 0x7f27f8159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.845+0000 7f27fffd8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27f815c950 0x7f27f8153230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.845+0000 7f27fffd8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27f8161140 0x7f27f80af230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.845+0000 7f27fffd8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f27f806c620 con 0x7f27f806ef40 2024-09-19T09:20:40.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.845+0000 7f27fffd8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f27f806ca00 con 0x7f27f8161140 2024-09-19T09:20:40.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.845+0000 7f27fffd8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f27f806c7a0 con 0x7f27f815c950 2024-09-19T09:20:40.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.846+0000 7f27fdd74640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27f806ef40 0x7f27f8159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:40.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.846+0000 7f27fdd74640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27f806ef40 0x7f27f8159260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53278/0 (socket says 172.21.15.18:53278) 2024-09-19T09:20:40.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.846+0000 7f27fdd74640 1 -- 172.21.15.18:0/871293272 learned_addr learned my addr 172.21.15.18:0/871293272 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:40.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.846+0000 7f27fdd74640 1 -- 172.21.15.18:0/871293272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27f815c950 msgr2=0x7f27f8153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:40.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.846+0000 7f27fd573640 1 --2- 172.21.15.18:0/871293272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27f815c950 0x7f27f8153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:40.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.846+0000 7f27fdd74640 1 --2- 172.21.15.18:0/871293272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27f815c950 0x7f27f8153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.846+0000 7f27fdd74640 1 -- 172.21.15.18:0/871293272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27f8161140 msgr2=0x7f27f80af230 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T09:20:40.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.846+0000 7f27fdd74640 1 --2- 172.21.15.18:0/871293272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27f8161140 0x7f27f80af230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.846+0000 7f27fdd74640 1 -- 172.21.15.18:0/871293272 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f81597a0 con 0x7f27f806ef40 2024-09-19T09:20:40.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.846+0000 7f27fd573640 1 --2- 172.21.15.18:0/871293272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27f815c950 0x7f27f8153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:40.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.846+0000 7f27fdd74640 1 --2- 172.21.15.18:0/871293272 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27f806ef40 0x7f27f8159260 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f27f400ebe0 tx=0x7f27f400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:40.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.846+0000 7f27ee7fc640 1 -- 172.21.15.18:0/871293272 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f4017070 con 0x7f27f806ef40 2024-09-19T09:20:40.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.846+0000 7f27ee7fc640 1 -- 172.21.15.18:0/871293272 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27f400cc30 con 0x7f27f806ef40 2024-09-19T09:20:40.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.846+0000 7f27fffd8640 1 -- 172.21.15.18:0/871293272 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27f81581c0 con 0x7f27f806ef40 2024-09-19T09:20:40.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.846+0000 7f27ee7fc640 1 -- 172.21.15.18:0/871293272 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f4013470 con 0x7f27f806ef40 2024-09-19T09:20:40.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.846+0000 7f27fffd8640 1 -- 172.21.15.18:0/871293272 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27f8158780 con 0x7f27f806ef40 2024-09-19T09:20:40.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.848+0000 7f27ee7fc640 1 -- 172.21.15.18:0/871293272 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f27f401a070 con 0x7f27f806ef40 2024-09-19T09:20:40.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.848+0000 7f27ee7fc640 1 --2- 172.21.15.18:0/871293272 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f27dc06c2b0 0x7f27dc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.848+0000 7f27ee7fc640 1 -- 172.21.15.18:0/871293272 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f27f408b420 con 0x7f27f806ef40 2024-09-19T09:20:40.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.849+0000 7f2802e4d740 1 Processor -- start 2024-09-19T09:20:40.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.849+0000 7f2802e4d740 1 -- start start 2024-09-19T09:20:40.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.850+0000 7f2802e4d740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5614e1c992c0 0x5614e1cdea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.850+0000 7f2802e4d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614e1c96a80 0x5614e1c996a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.850+0000 7f2802e4d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5614e1c9aa50 0x5614e1c938b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.850+0000 7f2802e4d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5614e1bfb520 con 0x5614e1c96a80 2024-09-19T09:20:40.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.850+0000 7f2802e4d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5614e1ba33e0 con 0x5614e1c9aa50 2024-09-19T09:20:40.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.850+0000 7f2802e4d740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5614e1bf74e0 con 0x5614e1c992c0 2024-09-19T09:20:40.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.850+0000 7f27fd573640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614e1c96a80 0x5614e1c996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:40.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.850+0000 7f27fd573640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614e1c96a80 0x5614e1c996a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53282/0 (socket says 172.21.15.18:53282) 2024-09-19T09:20:40.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.850+0000 7f27fd573640 1 -- 172.21.15.18:0/1730918080 learned_addr learned my addr 172.21.15.18:0/1730918080 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:40.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.850+0000 7f27fd573640 1 --2- 172.21.15.18:0/871293272 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f27dc06c2b0 0x7f27dc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:40.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.850+0000 7f27fe575640 1 --2- 172.21.15.18:0/1730918080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5614e1c9aa50 0x5614e1c938b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:40.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.850+0000 7f27fd573640 1 -- 172.21.15.18:0/1730918080 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5614e1c992c0 msgr2=0x5614e1cdea60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:20:40.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.850+0000 7f27fd573640 1 --2- 172.21.15.18:0/1730918080 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5614e1c992c0 0x5614e1cdea60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.850+0000 7f27fd573640 1 -- 172.21.15.18:0/1730918080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5614e1c9aa50 msgr2=0x5614e1c938b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:40.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.850+0000 7f27fd573640 1 --2- 172.21.15.18:0/1730918080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5614e1c9aa50 0x5614e1c938b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.850+0000 7f27fd573640 1 -- 172.21.15.18:0/1730918080 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614e1bbe2f0 con 0x5614e1c96a80 2024-09-19T09:20:40.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.850+0000 7f27fe575640 1 --2- 172.21.15.18:0/1730918080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5614e1c9aa50 0x5614e1c938b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:40.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.851+0000 7f27fd573640 1 --2- 172.21.15.18:0/1730918080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614e1c96a80 0x5614e1c996a0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f27e8001eb0 tx=0x7f27e8014710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ac500f24c883ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:40.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.851+0000 7f27db7fe640 1 -- 172.21.15.18:0/1730918080 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e800d070 con 0x5614e1c96a80 2024-09-19T09:20:40.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.851+0000 7f27db7fe640 1 -- 172.21.15.18:0/1730918080 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27e801c070 con 0x5614e1c96a80 2024-09-19T09:20:40.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.851+0000 7f27db7fe640 1 -- 172.21.15.18:0/1730918080 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e8010040 con 0x5614e1c96a80 2024-09-19T09:20:40.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.851+0000 7f2802e4d740 1 -- 172.21.15.18:0/1730918080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614e1c96a80 msgr2=0x5614e1c996a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:40.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.851+0000 7f2802e4d740 1 --2- 172.21.15.18:0/1730918080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614e1c96a80 0x5614e1c996a0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f27e8001eb0 tx=0x7f27e8014710 comp rx=0 tx=0).stop 2024-09-19T09:20:40.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.851+0000 7f2802e4d740 1 -- 172.21.15.18:0/1730918080 shutdown_connections 2024-09-19T09:20:40.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.851+0000 7f2802e4d740 1 --2- 172.21.15.18:0/1730918080 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5614e1c9aa50 0x5614e1c938b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.851+0000 7f2802e4d740 1 --2- 172.21.15.18:0/1730918080 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614e1c96a80 0x5614e1c996a0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.851+0000 7f2802e4d740 1 --2- 172.21.15.18:0/1730918080 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5614e1c992c0 0x5614e1cdea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.851+0000 7f2802e4d740 1 -- 172.21.15.18:0/1730918080 >> 172.21.15.18:0/1730918080 conn(0x5614e1c95a80 msgr2=0x5614e1cddf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:40.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.851+0000 7f2802e4d740 1 -- 172.21.15.18:0/1730918080 shutdown_connections 2024-09-19T09:20:40.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.852+0000 7f2802e4d740 1 -- 172.21.15.18:0/1730918080 wait complete. 2024-09-19T09:20:40.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.852+0000 7f27fd573640 1 --2- 172.21.15.18:0/871293272 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f27dc06c2b0 0x7f27dc06e770 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f27e8001eb0 tx=0x7f27e80012f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:40.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.852+0000 7f2802e4d740 1 -- start start 2024-09-19T09:20:40.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.852+0000 7f2802e4d740 1 Processor -- start 2024-09-19T09:20:40.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.853+0000 7f2802e4d740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5614e1c992c0 0x5614e1cef010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.853+0000 7f2802e4d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614e1c9aa50 0x5614e1cba1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.853+0000 7f2802e4d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5614e1cc1f00 0x5614e1cc2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.853+0000 7f2802e4d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5614e1c94f20 con 0x5614e1c9aa50 2024-09-19T09:20:40.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.853+0000 7f2802e4d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5614e1b84450 con 0x5614e1cc1f00 2024-09-19T09:20:40.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.853+0000 7f2802e4d740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5614e1cdf290 con 0x5614e1c992c0 2024-09-19T09:20:40.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.853+0000 7f2802e4d740 10 client.0 _ll_register_callbacks cb 0x5614e190dac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:40.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.853+0000 7f27fd573640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614e1c9aa50 0x5614e1cba1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:40.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.853+0000 7f27fd573640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614e1c9aa50 0x5614e1cba1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53294/0 (socket says 172.21.15.18:53294) 2024-09-19T09:20:40.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.853+0000 7f27fd573640 1 -- 172.21.15.18:0/520487866 learned_addr learned my addr 172.21.15.18:0/520487866 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:40.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.853+0000 7f27fe575640 1 --2- 172.21.15.18:0/520487866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5614e1cc1f00 0x5614e1cc2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:40.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.853+0000 7f27fdd74640 1 --2- 172.21.15.18:0/520487866 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5614e1c992c0 0x5614e1cef010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:40.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.853+0000 7f27fd573640 1 -- 172.21.15.18:0/520487866 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5614e1c992c0 msgr2=0x5614e1cef010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:40.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.853+0000 7f27fd573640 1 --2- 172.21.15.18:0/520487866 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5614e1c992c0 0x5614e1cef010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.853+0000 7f27fd573640 1 -- 172.21.15.18:0/520487866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5614e1cc1f00 msgr2=0x5614e1cc2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:40.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.853+0000 7f27fd573640 1 --2- 172.21.15.18:0/520487866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5614e1cc1f00 0x5614e1cc2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.853+0000 7f27fd573640 1 -- 172.21.15.18:0/520487866 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614e190e2d0 con 0x5614e1c9aa50 2024-09-19T09:20:40.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.853+0000 7f27fe575640 1 --2- 172.21.15.18:0/520487866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5614e1cc1f00 0x5614e1cc2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:40.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.853+0000 7f27fdd74640 1 --2- 172.21.15.18:0/520487866 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5614e1c992c0 0x5614e1cef010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:40.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.854+0000 7f27fd573640 1 --2- 172.21.15.18:0/520487866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614e1c9aa50 0x5614e1cba1e0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f27e8014c10 tx=0x7f27e8007970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d0d7070e677472 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:40.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.854+0000 7f27d8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:20:40.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.854+0000 7f27d8ff9640 1 -- 172.21.15.18:0/520487866 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e8030060 con 0x5614e1c9aa50 2024-09-19T09:20:40.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.854+0000 7f27d8ff9640 1 -- 172.21.15.18:0/520487866 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f27e80065a0 con 0x5614e1c9aa50 2024-09-19T09:20:40.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.854+0000 7f2802e4d740 1 -- 172.21.15.18:0/520487866 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27e801c070 con 0x5614e1c9aa50 2024-09-19T09:20:40.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.854+0000 7f27d8ff9640 1 -- 172.21.15.18:0/520487866 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7f27e8036050 con 0x5614e1c9aa50 2024-09-19T09:20:40.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.854+0000 7f2802e4d740 10 client.7365 fetch_fsmap learned FSMap version 65 2024-09-19T09:20:40.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.854+0000 7f2802e4d740 1 -- 172.21.15.18:0/520487866 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) -- 0x5614e19d86b0 con 0x5614e1c9aa50 2024-09-19T09:20:40.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.854+0000 7f27d8ff9640 1 -- 172.21.15.18:0/520487866 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27e801c070 con 0x5614e1c9aa50 2024-09-19T09:20:40.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.854+0000 7f27d8ff9640 1 -- 172.21.15.18:0/520487866 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 65) ==== 3502+0+0 (secure 0 0 0) 0x7f27e8039020 con 0x5614e1c9aa50 2024-09-19T09:20:40.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.854+0000 7f2802e4d740 10 client.7365 fetch_fsmap finished waiting for FSMap version 65 2024-09-19T09:20:40.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.854+0000 7f2802e4d740 10 client.7365 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T09:20:40.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.854+0000 7f2802e4d740 20 client.7365 populate_metadata read hostname 'smithi018' 2024-09-19T09:20:40.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.854+0000 7f2802e4d740 1 --2- 172.21.15.18:0/520487866 >> [v2:172.21.15.18:6834/1201598209,v1:172.21.15.18:6835/1201598209] conn(0x5614e1cc3270 0x5614e1cc3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.854+0000 7f2802e4d740 4 client.7365 mds_command: new command op to 7245 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:20:40.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.854+0000 7f2802e4d740 1 -- 172.21.15.18:0/520487866 --> [v2:172.21.15.18:6834/1201598209,v1:172.21.15.18:6835/1201598209] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5614e1c08c50 con 0x5614e1cc3270 2024-09-19T09:20:40.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.854+0000 7f27fdd74640 1 --2- 172.21.15.18:0/520487866 >> [v2:172.21.15.18:6834/1201598209,v1:172.21.15.18:6835/1201598209] conn(0x5614e1cc3270 0x5614e1cc3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:40.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.855+0000 7f27fdd74640 1 --2- 172.21.15.18:0/520487866 >> [v2:172.21.15.18:6834/1201598209,v1:172.21.15.18:6835/1201598209] conn(0x5614e1cc3270 0x5614e1cc3650 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b490a34c3587d26 server_cookie=97b00f86f0d8f929 in_seq=0 out_seq=0 2024-09-19T09:20:40.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.855+0000 7f27d8ff9640 10 client.7365 ms_handle_connect on v2:172.21.15.18:6834/1201598209 2024-09-19T09:20:40.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.855+0000 7f27d8ff9640 1 -- 172.21.15.18:0/520487866 <== mds.0 v2:172.21.15.18:6834/1201598209 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5614e1c08c50 con 0x5614e1cc3270 2024-09-19T09:20:40.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.855+0000 7f27d8ff9640 10 client.7365 handle_command_reply: tid=0 2024-09-19T09:20:40.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.855+0000 7f2802e4d740 1 client.7365 shutdown 2024-09-19T09:20:40.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.856+0000 7f2802e4d740 1 -- 172.21.15.18:0/520487866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614e1c9aa50 msgr2=0x5614e1cba1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:40.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.856+0000 7f2802e4d740 1 --2- 172.21.15.18:0/520487866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614e1c9aa50 0x5614e1cba1e0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7f27e8014c10 tx=0x7f27e8007970 comp rx=0 tx=0).stop 2024-09-19T09:20:40.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.856+0000 7f2802e4d740 1 -- 172.21.15.18:0/520487866 shutdown_connections 2024-09-19T09:20:40.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.856+0000 7f2802e4d740 1 --2- 172.21.15.18:0/520487866 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5614e1cc1f00 0x5614e1cc2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.856+0000 7f2802e4d740 1 --2- 172.21.15.18:0/520487866 >> [v2:172.21.15.18:6834/1201598209,v1:172.21.15.18:6835/1201598209] conn(0x5614e1cc3270 0x5614e1cc3650 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.856+0000 7f2802e4d740 1 --2- 172.21.15.18:0/520487866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614e1c9aa50 0x5614e1cba1e0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.856+0000 7f2802e4d740 1 --2- 172.21.15.18:0/520487866 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5614e1c992c0 0x5614e1cef010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.856+0000 7f27d8ff9640 0 client.7365 ms_handle_reset on v2:172.21.15.18:6834/1201598209 2024-09-19T09:20:40.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.856+0000 7f2802e4d740 1 -- 172.21.15.18:0/520487866 >> 172.21.15.18:0/520487866 conn(0x5614e1c96a80 msgr2=0x5614e1cdd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:40.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.856+0000 7f2802e4d740 1 -- 172.21.15.18:0/520487866 shutdown_connections 2024-09-19T09:20:40.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.856+0000 7f2802e4d740 1 -- 172.21.15.18:0/520487866 wait complete. 2024-09-19T09:20:40.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.856+0000 7f2802e4d740 20 client.7365 trim_cache size 0 max 16384 2024-09-19T09:20:40.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.874+0000 7f2802e4d740 1 Processor -- start 2024-09-19T09:20:40.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.874+0000 7f2802e4d740 1 -- start start 2024-09-19T09:20:40.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.875+0000 7f2802e4d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5614e1c992c0 0x5614e1cdbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.875+0000 7f2802e4d740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5614e1c9aa50 0x5614e1cbab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.875+0000 7f2802e4d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614e1cc1f00 0x5614e1d017e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.875+0000 7f2802e4d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f27f81ffed0 con 0x5614e1cc1f00 2024-09-19T09:20:40.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.875+0000 7f2802e4d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f27f80b5c30 con 0x5614e1c992c0 2024-09-19T09:20:40.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.875+0000 7f2802e4d740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f27f80b6280 con 0x5614e1c9aa50 2024-09-19T09:20:40.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.875+0000 7f27fe575640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614e1cc1f00 0x5614e1d017e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:40.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.875+0000 7f27fe575640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614e1cc1f00 0x5614e1d017e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53296/0 (socket says 172.21.15.18:53296) 2024-09-19T09:20:40.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.875+0000 7f27fe575640 1 -- 172.21.15.18:0/4004339951 learned_addr learned my addr 172.21.15.18:0/4004339951 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:40.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.875+0000 7f27fdd74640 1 --2- 172.21.15.18:0/4004339951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5614e1c992c0 0x5614e1cdbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:40.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.875+0000 7f27fe575640 1 -- 172.21.15.18:0/4004339951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5614e1c9aa50 msgr2=0x5614e1cbab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:40.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.875+0000 7f27fe575640 1 --2- 172.21.15.18:0/4004339951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5614e1c9aa50 0x5614e1cbab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.875+0000 7f27fe575640 1 -- 172.21.15.18:0/4004339951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5614e1c992c0 msgr2=0x5614e1cdbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:40.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.875+0000 7f27fe575640 1 --2- 172.21.15.18:0/4004339951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5614e1c992c0 0x5614e1cdbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.875+0000 7f27fe575640 1 -- 172.21.15.18:0/4004339951 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614e1bfd9c0 con 0x5614e1cc1f00 2024-09-19T09:20:40.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.875+0000 7f27fdd74640 1 --2- 172.21.15.18:0/4004339951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5614e1c992c0 0x5614e1cdbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:20:40.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.875+0000 7f27fe575640 1 --2- 172.21.15.18:0/4004339951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614e1cc1f00 0x5614e1d017e0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f27f002ad50 tx=0x7f27f002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa1ca58ad5007537 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:40.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.876+0000 7f27daffd640 1 -- 172.21.15.18:0/4004339951 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f0040030 con 0x5614e1cc1f00 2024-09-19T09:20:40.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.876+0000 7f27daffd640 1 -- 172.21.15.18:0/4004339951 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27f0003990 con 0x5614e1cc1f00 2024-09-19T09:20:40.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.876+0000 7f27daffd640 1 -- 172.21.15.18:0/4004339951 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f0036040 con 0x5614e1cc1f00 2024-09-19T09:20:40.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.876+0000 7f2802e4d740 1 -- 172.21.15.18:0/4004339951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614e1cc1f00 msgr2=0x5614e1d017e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:40.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.876+0000 7f2802e4d740 1 --2- 172.21.15.18:0/4004339951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614e1cc1f00 0x5614e1d017e0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f27f002ad50 tx=0x7f27f002e000 comp rx=0 tx=0).stop 2024-09-19T09:20:40.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.876+0000 7f2802e4d740 1 -- 172.21.15.18:0/4004339951 shutdown_connections 2024-09-19T09:20:40.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.876+0000 7f2802e4d740 1 --2- 172.21.15.18:0/4004339951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614e1cc1f00 0x5614e1d017e0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.876+0000 7f2802e4d740 1 --2- 172.21.15.18:0/4004339951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5614e1c9aa50 0x5614e1cbab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.876+0000 7f2802e4d740 1 --2- 172.21.15.18:0/4004339951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5614e1c992c0 0x5614e1cdbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.876+0000 7f2802e4d740 1 -- 172.21.15.18:0/4004339951 >> 172.21.15.18:0/4004339951 conn(0x5614e1c96a80 msgr2=0x5614e1cde0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:40.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.876+0000 7f2802e4d740 1 -- 172.21.15.18:0/4004339951 shutdown_connections 2024-09-19T09:20:40.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.876+0000 7f2802e4d740 1 -- 172.21.15.18:0/4004339951 wait complete. 2024-09-19T09:20:40.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.877+0000 7f2802e4d740 1 -- start start 2024-09-19T09:20:40.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.877+0000 7f2802e4d740 1 Processor -- start 2024-09-19T09:20:40.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.878+0000 7f2802e4d740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614e1c992c0 0x5614e1d5ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.878+0000 7f2802e4d740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5614e1c9aa50 0x5614e1cee580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.878+0000 7f2802e4d740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5614e1cc1f00 0x5614e1ceeac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.878+0000 7f2802e4d740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x5614e1cbba50 con 0x5614e1c992c0 2024-09-19T09:20:40.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.878+0000 7f2802e4d740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5614e1cc1750 con 0x5614e1c9aa50 2024-09-19T09:20:40.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.878+0000 7f2802e4d740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x5614e1cbc400 con 0x5614e1cc1f00 2024-09-19T09:20:40.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.878+0000 7f2802e4d740 10 client.0 _ll_register_callbacks cb 0x7f27e8001c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:20:40.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.878+0000 7f27fdd74640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614e1c992c0 0x5614e1d5ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:40.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.878+0000 7f27fdd74640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614e1c992c0 0x5614e1d5ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53306/0 (socket says 172.21.15.18:53306) 2024-09-19T09:20:40.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.878+0000 7f27fdd74640 1 -- 172.21.15.18:0/3836554057 learned_addr learned my addr 172.21.15.18:0/3836554057 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:40.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.878+0000 7f27fdd74640 1 -- 172.21.15.18:0/3836554057 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5614e1cc1f00 msgr2=0x5614e1ceeac0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:20:40.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.878+0000 7f27fdd74640 1 --2- 172.21.15.18:0/3836554057 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5614e1cc1f00 0x5614e1ceeac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.878+0000 7f27fdd74640 1 -- 172.21.15.18:0/3836554057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5614e1c9aa50 msgr2=0x5614e1cee580 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:20:40.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.878+0000 7f27fdd74640 1 --2- 172.21.15.18:0/3836554057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5614e1c9aa50 0x5614e1cee580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.878+0000 7f27fdd74640 1 -- 172.21.15.18:0/3836554057 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614e1cba670 con 0x5614e1c992c0 2024-09-19T09:20:40.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.878+0000 7f27fdd74640 1 --2- 172.21.15.18:0/3836554057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614e1c992c0 0x5614e1d5ecd0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f27f4055870 tx=0x7f27f4009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91176433690bb1c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:40.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.878+0000 7f27d8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:20:40.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.878+0000 7f27d8ff9640 1 -- 172.21.15.18:0/3836554057 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27f4021040 con 0x5614e1c992c0 2024-09-19T09:20:40.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.878+0000 7f27d8ff9640 1 -- 172.21.15.18:0/3836554057 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f27f4057710 con 0x5614e1c992c0 2024-09-19T09:20:40.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.878+0000 7f2802e4d740 1 -- 172.21.15.18:0/3836554057 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27f0003990 con 0x5614e1c992c0 2024-09-19T09:20:40.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.879+0000 7f27d8ff9640 1 -- 172.21.15.18:0/3836554057 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7f27f405d7c0 con 0x5614e1c992c0 2024-09-19T09:20:40.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.879+0000 7f2802e4d740 10 client.7371 fetch_fsmap learned FSMap version 65 2024-09-19T09:20:40.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.879+0000 7f2802e4d740 1 -- 172.21.15.18:0/3836554057 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=2+}) -- 0x5614e1cfc380 con 0x5614e1c992c0 2024-09-19T09:20:40.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.879+0000 7f27d8ff9640 1 -- 172.21.15.18:0/3836554057 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27f0003990 con 0x5614e1c992c0 2024-09-19T09:20:40.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.879+0000 7f27d8ff9640 1 -- 172.21.15.18:0/3836554057 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 65) ==== 3502+0+0 (secure 0 0 0) 0x7f27f4024060 con 0x5614e1c992c0 2024-09-19T09:20:40.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.879+0000 7f2802e4d740 10 client.7371 fetch_fsmap finished waiting for FSMap version 65 2024-09-19T09:20:40.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.879+0000 7f2802e4d740 10 client.7371 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T09:20:40.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.879+0000 7f2802e4d740 20 client.7371 populate_metadata read hostname 'smithi018' 2024-09-19T09:20:40.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.879+0000 7f2802e4d740 1 --2- 172.21.15.18:0/3836554057 >> [v2:172.21.15.18:6834/1201598209,v1:172.21.15.18:6835/1201598209] conn(0x5614e1cfbf20 0x5614e1d67590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.879+0000 7f2802e4d740 4 client.7371 mds_command: new command op to 7245 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:20:40.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.879+0000 7f2802e4d740 1 -- 172.21.15.18:0/3836554057 --> [v2:172.21.15.18:6834/1201598209,v1:172.21.15.18:6835/1201598209] -- command(tid 0: {"prefix": "status"}) -- 0x5614e1c02fa0 con 0x5614e1cfbf20 2024-09-19T09:20:40.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.879+0000 7f27fd573640 1 --2- 172.21.15.18:0/3836554057 >> [v2:172.21.15.18:6834/1201598209,v1:172.21.15.18:6835/1201598209] conn(0x5614e1cfbf20 0x5614e1d67590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:40.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.879+0000 7f27d8ff9640 10 client.7371 ms_handle_connect on v2:172.21.15.18:6834/1201598209 2024-09-19T09:20:40.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.879+0000 7f27fd573640 1 --2- 172.21.15.18:0/3836554057 >> [v2:172.21.15.18:6834/1201598209,v1:172.21.15.18:6835/1201598209] conn(0x5614e1cfbf20 0x5614e1d67590 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c09d323a1e2788d4 server_cookie=dd4d70941901fbeb in_seq=0 out_seq=0 2024-09-19T09:20:40.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.879+0000 7f27d8ff9640 1 -- 172.21.15.18:0/3836554057 <== mds.0 v2:172.21.15.18:6834/1201598209 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x5614e1c02fa0 con 0x5614e1cfbf20 2024-09-19T09:20:40.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.879+0000 7f27d8ff9640 10 client.7371 handle_command_reply: tid=0 2024-09-19T09:20:40.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.880+0000 7f2802e4d740 1 client.7371 shutdown 2024-09-19T09:20:40.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.880+0000 7f2802e4d740 1 -- 172.21.15.18:0/3836554057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614e1c992c0 msgr2=0x5614e1d5ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:40.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.880+0000 7f2802e4d740 1 --2- 172.21.15.18:0/3836554057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614e1c992c0 0x5614e1d5ecd0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f27f4055870 tx=0x7f27f4009850 comp rx=0 tx=0).stop 2024-09-19T09:20:40.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.880+0000 7f2802e4d740 1 -- 172.21.15.18:0/3836554057 shutdown_connections 2024-09-19T09:20:40.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.880+0000 7f2802e4d740 1 --2- 172.21.15.18:0/3836554057 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x5614e1cc1f00 0x5614e1ceeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.880+0000 7f2802e4d740 1 --2- 172.21.15.18:0/3836554057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5614e1c9aa50 0x5614e1cee580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.880+0000 7f2802e4d740 1 --2- 172.21.15.18:0/3836554057 >> [v2:172.21.15.18:6834/1201598209,v1:172.21.15.18:6835/1201598209] conn(0x5614e1cfbf20 0x5614e1d67590 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.880+0000 7f2802e4d740 1 --2- 172.21.15.18:0/3836554057 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x5614e1c992c0 0x5614e1d5ecd0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.880+0000 7f27d8ff9640 0 client.7371 ms_handle_reset on v2:172.21.15.18:6834/1201598209 2024-09-19T09:20:40.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.880+0000 7f2802e4d740 1 -- 172.21.15.18:0/3836554057 >> 172.21.15.18:0/3836554057 conn(0x5614e1c96a80 msgr2=0x5614e1cde090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:40.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.880+0000 7f2802e4d740 1 -- 172.21.15.18:0/3836554057 shutdown_connections 2024-09-19T09:20:40.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.880+0000 7f2802e4d740 1 -- 172.21.15.18:0/3836554057 wait complete. 2024-09-19T09:20:40.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.880+0000 7f2802e4d740 20 client.7371 trim_cache size 0 max 16384 2024-09-19T09:20:40.887 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:20:40.887 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:20:40.887 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-09-19T09:20:40.887 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 7245, 2024-09-19T09:20:40.887 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-19T09:20:40.887 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-19T09:20:40.887 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-19T09:20:40.887 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 5.1580231469999998, 2024-09-19T09:20:40.887 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 65, 2024-09-19T09:20:40.887 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 154, 2024-09-19T09:20:40.888 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 154, 2024-09-19T09:20:40.888 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 10.649287684999999 2024-09-19T09:20:40.888 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:20:40.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.880+0000 7f27fffd8640 1 -- 172.21.15.18:0/871293272 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f27dc06c2b0 msgr2=0x7f27dc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:40.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.880+0000 7f27fffd8640 1 --2- 172.21.15.18:0/871293272 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f27dc06c2b0 0x7f27dc06e770 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f27e8001eb0 tx=0x7f27e80012f0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.880+0000 7f27fffd8640 1 -- 172.21.15.18:0/871293272 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27f806ef40 msgr2=0x7f27f8159260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:40.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.880+0000 7f27fffd8640 1 --2- 172.21.15.18:0/871293272 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27f806ef40 0x7f27f8159260 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f27f400ebe0 tx=0x7f27f400c520 comp rx=0 tx=0).stop 2024-09-19T09:20:40.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.880+0000 7f27fffd8640 1 -- 172.21.15.18:0/871293272 shutdown_connections 2024-09-19T09:20:40.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.880+0000 7f27fffd8640 1 --2- 172.21.15.18:0/871293272 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f27dc06c2b0 0x7f27dc06e770 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.880+0000 7f27fffd8640 1 --2- 172.21.15.18:0/871293272 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f27f8161140 0x7f27f80af230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.880+0000 7f27fffd8640 1 --2- 172.21.15.18:0/871293272 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f27f815c950 0x7f27f8153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.880+0000 7f27fffd8640 1 --2- 172.21.15.18:0/871293272 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f27f806ef40 0x7f27f8159260 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.880+0000 7f27fffd8640 1 -- 172.21.15.18:0/871293272 >> 172.21.15.18:0/871293272 conn(0x7f27f80b3890 msgr2=0x7f27f8072ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:40.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.881+0000 7f27fffd8640 1 -- 172.21.15.18:0/871293272 shutdown_connections 2024-09-19T09:20:40.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.881+0000 7f27fffd8640 1 -- 172.21.15.18:0/871293272 wait complete. 2024-09-19T09:20:40.892 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T09:20:40.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.993+0000 7f6ab40f1640 1 Processor -- start 2024-09-19T09:20:40.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.993+0000 7f6ab40f1640 1 -- start start 2024-09-19T09:20:40.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.994+0000 7f6ab40f1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6aac06fff0 0x7f6aac06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.994+0000 7f6ab40f1640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6aac0b4f60 0x7f6aac0b53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:40.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.994+0000 7f6ab40f1640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6aac0703d0 con 0x7f6aac0b60d0 2024-09-19T09:20:40.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.994+0000 7f6ab40f1640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6aac15c530 con 0x7f6aac0b4f60 2024-09-19T09:20:40.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.994+0000 7f6ab40f1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6aac15cd30 con 0x7f6aac06fff0 2024-09-19T09:20:40.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.994+0000 7f6ab1e8d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6aac06fff0 0x7f6aac06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:40.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.994+0000 7f6ab268e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6aac0b4f60 0x7f6aac0b53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:40.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.994+0000 7f6ab268e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6aac0b4f60 0x7f6aac0b53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:52140/0 (socket says 172.21.15.18:52140) 2024-09-19T09:20:40.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.994+0000 7f6ab268e640 1 -- 172.21.15.18:0/4283290707 learned_addr learned my addr 172.21.15.18:0/4283290707 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:40.996 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.994+0000 7f6ab168c640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f6aac0b60d0 0x7f6aac15be20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:49924/0 (socket says 172.21.15.18:49924) 2024-09-19T09:20:40.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.995+0000 7f6ab268e640 1 -- 172.21.15.18:0/4283290707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6aac06fff0 msgr2=0x7f6aac06ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:40.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.995+0000 7f6ab268e640 1 --2- 172.21.15.18:0/4283290707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6aac06fff0 0x7f6aac06ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.995+0000 7f6ab268e640 1 -- 172.21.15.18:0/4283290707 >> v1:172.21.15.162:6789/0 conn(0x7f6aac0b60d0 legacy=0x7f6aac15be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:40.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.995+0000 7f6ab268e640 1 -- 172.21.15.18:0/4283290707 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aac15c770 con 0x7f6aac0b4f60 2024-09-19T09:20:40.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.996+0000 7f6ab268e640 1 --2- 172.21.15.18:0/4283290707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6aac0b4f60 0x7f6aac0b53d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6aa400d150 tx=0x7f6aa402c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55437eb9af5d2dd3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:40.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.996+0000 7f6ab0e8b640 1 -- 172.21.15.18:0/4283290707 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4039070 con 0x7f6aac0b4f60 2024-09-19T09:20:40.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.996+0000 7f6ab0e8b640 1 -- 172.21.15.18:0/4283290707 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aa4009600 con 0x7f6aac0b4f60 2024-09-19T09:20:40.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.996+0000 7f6ab0e8b640 1 -- 172.21.15.18:0/4283290707 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa40099d0 con 0x7f6aac0b4f60 2024-09-19T09:20:40.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.996+0000 7f6ab40f1640 1 -- 172.21.15.18:0/4283290707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6aac0b4f60 msgr2=0x7f6aac0b53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:40.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.996+0000 7f6ab40f1640 1 --2- 172.21.15.18:0/4283290707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6aac0b4f60 0x7f6aac0b53d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6aa400d150 tx=0x7f6aa402c890 comp rx=0 tx=0).stop 2024-09-19T09:20:40.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.996+0000 7f6ab40f1640 1 -- 172.21.15.18:0/4283290707 shutdown_connections 2024-09-19T09:20:40.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.996+0000 7f6ab40f1640 1 --2- 172.21.15.18:0/4283290707 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6aac0b4f60 0x7f6aac0b53d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.996+0000 7f6ab40f1640 1 --2- 172.21.15.18:0/4283290707 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6aac06fff0 0x7f6aac06ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:40.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.996+0000 7f6ab40f1640 1 -- 172.21.15.18:0/4283290707 >> 172.21.15.18:0/4283290707 conn(0x7f6aac0b2b50 msgr2=0x7f6aac0b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:40.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.997+0000 7f6ab40f1640 1 -- 172.21.15.18:0/4283290707 shutdown_connections 2024-09-19T09:20:40.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.997+0000 7f6ab40f1640 1 -- 172.21.15.18:0/4283290707 wait complete. 2024-09-19T09:20:41.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.998+0000 7f6ab40f1640 1 Processor -- start 2024-09-19T09:20:41.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.998+0000 7f6ab40f1640 1 -- start start 2024-09-19T09:20:41.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.998+0000 7f6ab40f1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6aac06fff0 0x7f6aac0cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:41.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.998+0000 7f6ab40f1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6aac0b4f60 0x7f6aac152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:41.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.998+0000 7f6ab40f1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6aac0b60d0 0x7f6aac1534f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:41.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.998+0000 7f6ab40f1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6aac06e220 con 0x7f6aac0b60d0 2024-09-19T09:20:41.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.998+0000 7f6ab40f1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6aac0b5910 con 0x7f6aac0b4f60 2024-09-19T09:20:41.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.998+0000 7f6ab40f1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6aac06e500 con 0x7f6aac06fff0 2024-09-19T09:20:41.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.999+0000 7f6ab268e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6aac0b60d0 0x7f6aac1534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:41.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.999+0000 7f6ab268e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6aac0b60d0 0x7f6aac1534f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53308/0 (socket says 172.21.15.18:53308) 2024-09-19T09:20:41.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.999+0000 7f6ab268e640 1 -- 172.21.15.18:0/3115806998 learned_addr learned my addr 172.21.15.18:0/3115806998 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:41.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.999+0000 7f6ab1e8d640 1 --2- 172.21.15.18:0/3115806998 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6aac06fff0 0x7f6aac0cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:41.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.999+0000 7f6ab168c640 1 --2- 172.21.15.18:0/3115806998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6aac0b4f60 0x7f6aac152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:41.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.999+0000 7f6ab268e640 1 -- 172.21.15.18:0/3115806998 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6aac06fff0 msgr2=0x7f6aac0cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:41.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.999+0000 7f6ab268e640 1 --2- 172.21.15.18:0/3115806998 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6aac06fff0 0x7f6aac0cd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.001 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.999+0000 7f6ab268e640 1 -- 172.21.15.18:0/3115806998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6aac0b4f60 msgr2=0x7f6aac152fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:41.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.999+0000 7f6ab268e640 1 --2- 172.21.15.18:0/3115806998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6aac0b4f60 0x7f6aac152fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.999+0000 7f6ab268e640 1 -- 172.21.15.18:0/3115806998 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6aac0cdbf0 con 0x7f6aac0b60d0 2024-09-19T09:20:41.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.999+0000 7f6ab268e640 1 --2- 172.21.15.18:0/3115806998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6aac0b60d0 0x7f6aac1534f0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4037040 tx=0x7f6aa4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:41.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.999+0000 7f6aa27fc640 1 -- 172.21.15.18:0/3115806998 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4039050 con 0x7f6aac0b60d0 2024-09-19T09:20:41.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.999+0000 7f6aa27fc640 1 -- 172.21.15.18:0/3115806998 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aa4045070 con 0x7f6aac0b60d0 2024-09-19T09:20:41.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.999+0000 7f6ab40f1640 1 -- 172.21.15.18:0/3115806998 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6aac14f460 con 0x7f6aac0b60d0 2024-09-19T09:20:41.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.999+0000 7f6aa27fc640 1 -- 172.21.15.18:0/3115806998 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aa40346c0 con 0x7f6aac0b60d0 2024-09-19T09:20:41.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:40.999+0000 7f6ab40f1640 1 -- 172.21.15.18:0/3115806998 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6aac14fa20 con 0x7f6aac0b60d0 2024-09-19T09:20:41.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:41.001+0000 7f6ab40f1640 1 -- 172.21.15.18:0/3115806998 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6aac0b53d0 con 0x7f6aac0b60d0 2024-09-19T09:20:41.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:41.001+0000 7f6aa27fc640 1 -- 172.21.15.18:0/3115806998 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6aa4034860 con 0x7f6aac0b60d0 2024-09-19T09:20:41.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:41.001+0000 7f6aa27fc640 1 --2- 172.21.15.18:0/3115806998 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6a9006c2b0 0x7f6a9006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:41.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:41.001+0000 7f6aa27fc640 1 -- 172.21.15.18:0/3115806998 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f6aa40ae320 con 0x7f6aac0b60d0 2024-09-19T09:20:41.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:41.002+0000 7f6ab1e8d640 1 --2- 172.21.15.18:0/3115806998 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6a9006c2b0 0x7f6a9006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:41.003 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:41.002+0000 7f6ab1e8d640 1 --2- 172.21.15.18:0/3115806998 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6a9006c2b0 0x7f6a9006e770 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8009a30 tx=0x7f6aa8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:41.006 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:41.006+0000 7f6aa27fc640 1 -- 172.21.15.18:0/3115806998 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6aa407c570 con 0x7f6aac0b60d0 2024-09-19T09:20:41.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:41.222+0000 7f6ab40f1640 1 -- 172.21.15.18:0/3115806998 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6aac071da0 con 0x7f6aac0b60d0 2024-09-19T09:20:41.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:41.222+0000 7f6aa27fc640 1 -- 172.21.15.18:0/3115806998 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v65) ==== 53+0+73 (secure 0 0 0) 0x7f6aa4080870 con 0x7f6aac0b60d0 2024-09-19T09:20:41.223 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T09:20:41.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:41.225+0000 7f6ab40f1640 1 -- 172.21.15.18:0/3115806998 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6a9006c2b0 msgr2=0x7f6a9006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:41.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:41.225+0000 7f6ab40f1640 1 --2- 172.21.15.18:0/3115806998 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6a9006c2b0 0x7f6a9006e770 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8009a30 tx=0x7f6aa8008040 comp rx=0 tx=0).stop 2024-09-19T09:20:41.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:41.225+0000 7f6ab40f1640 1 -- 172.21.15.18:0/3115806998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6aac0b60d0 msgr2=0x7f6aac1534f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:41.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:41.225+0000 7f6ab40f1640 1 --2- 172.21.15.18:0/3115806998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6aac0b60d0 0x7f6aac1534f0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4037040 tx=0x7f6aa4004a40 comp rx=0 tx=0).stop 2024-09-19T09:20:41.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:41.225+0000 7f6ab40f1640 1 -- 172.21.15.18:0/3115806998 shutdown_connections 2024-09-19T09:20:41.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:41.225+0000 7f6ab40f1640 1 --2- 172.21.15.18:0/3115806998 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6a9006c2b0 0x7f6a9006e770 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:41.225+0000 7f6ab40f1640 1 --2- 172.21.15.18:0/3115806998 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6aac0b60d0 0x7f6aac1534f0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:41.225+0000 7f6ab40f1640 1 --2- 172.21.15.18:0/3115806998 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6aac0b4f60 0x7f6aac152fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.226 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:41.225+0000 7f6ab40f1640 1 --2- 172.21.15.18:0/3115806998 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6aac06fff0 0x7f6aac0cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:41.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:41.225+0000 7f6ab40f1640 1 -- 172.21.15.18:0/3115806998 >> 172.21.15.18:0/3115806998 conn(0x7f6aac0b2b50 msgr2=0x7f6aac073220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:41.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:41.225+0000 7f6ab40f1640 1 -- 172.21.15.18:0/3115806998 shutdown_connections 2024-09-19T09:20:41.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:41.225+0000 7f6ab40f1640 1 -- 172.21.15.18:0/3115806998 wait complete. 2024-09-19T09:20:41.236 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-19T09:20:41.236 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:20:41.237 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-09-19T09:20:41.237 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T09:20:41.237 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:20:41.237 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-19T09:20:41.237 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-19T09:20:41.237 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:20:41.237 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:20:41.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:20:41.237 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-09-19T09:20:41.253 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:20:41.254 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:20:41.254 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:20:41.254 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:20:41.254 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-09-19T09:20:41.254 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:20:41.254 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:20:41.254 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:20:41.254 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-09-19T09:20:41.254 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:20:41.254 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:20:41.254 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-09-19T09:20:41.254 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:20:41.255 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:20:41.255 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-09-19T09:20:41.255 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T09:20:41.255 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42356sec preferred_lft 42356sec 2024-09-19T09:20:41.255 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-09-19T09:20:41.255 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:20:41.255 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:20:41.255 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:20:41.255 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-09-19T09:20:41.255 INFO:teuthology.orchestra.run.smithi018.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T09:20:41.255 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:44:1b:02:86:87 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:20:41.255 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T09:20:41.255 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:20:41.255 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::a0ce:faff:feaa:13ec/64 scope link 2024-09-19T09:20:41.256 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:20:41.256 INFO:teuthology.orchestra.run.smithi018.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:20:41.256 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:44:1b:02:86:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:20:41.256 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::44:1bff:fe02:8687/64 scope link 2024-09-19T09:20:41.256 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:20:41.256 INFO:teuthology.orchestra.run.smithi018.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:20:41.256 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether e2:6d:c4:af:6a:8b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T09:20:41.256 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::e06d:c4ff:feaf:6a8b/64 scope link 2024-09-19T09:20:41.256 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:20:41.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:20:41.257 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:20:41.318 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-09-19T09:20:41.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:20:41.319 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-09-19T09:20:41.376 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-09-19T09:20:41.376 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:20:41.376 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T09:20:41.376 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T09:20:41.377 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:20:41.377 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:20:41.377 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T09:20:41.377 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T09:20:41.377 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T09:20:41.377 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T09:20:41.377 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T09:20:41.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:20:41.500 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:20:41.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:20:41.506 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-19T09:20:41.522 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-19T09:20:41.522 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T09:20:41.523 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:20:41.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:20:41.523 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-09-19T09:20:41.588 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:20:41.588 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T09:20:41.644 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:20:41.644 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:20:41.644 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:20:41.700 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-19T09:20:41.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:20:41.700 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:20:41.785 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:20:41.786 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:20:41.786 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:20:41.795 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:20:41.795 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:20:41.795 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:20:41.795 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:20:41.795 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:20:41.799 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:20:41.799 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:20:41.799 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:20:41.799 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:20:41.799 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:20:41.799 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-19T09:20:41.800 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-19T09:20:41.800 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fec66d7e-50e5-42ed-81de-ad141a2f0f4e" will pass to kernel 2024-09-19T09:20:41.800 INFO:teuthology.orchestra.run.smithi018.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-19T09:20:41.800 INFO:teuthology.orchestra.run.smithi018.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:20:41.800 INFO:teuthology.orchestra.run.smithi018.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:20:41.800 INFO:teuthology.orchestra.run.smithi018.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:20:41.800 INFO:teuthology.orchestra.run.smithi018.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:20:41.802 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:20:41.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:20:41.802 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:20:41.828 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:20:41.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:20:41.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:20:41.930 INFO:teuthology.orchestra.run.smithi018.stdout:client6910 2024-09-19T09:20:41.930 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:20:41.930 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:20:41.946 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T09:20:42.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.089+0000 7fe077665640 1 Processor -- start 2024-09-19T09:20:42.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.089+0000 7fe077665640 1 -- start start 2024-09-19T09:20:42.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.090+0000 7fe077665640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe07015ef50 0x7fe0700d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:42.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.090+0000 7fe077665640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0700b7a90 con 0x7fe0700d3240 2024-09-19T09:20:42.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.090+0000 7fe077665640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0700d3740 con 0x7fe0700b9510 2024-09-19T09:20:42.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.090+0000 7fe077665640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe0700d3a20 con 0x7fe07015ef50 2024-09-19T09:20:42.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.090+0000 7fe074c00640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe0700d3240 0x7fe0700cf770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55086/0 (socket says 172.21.15.18:55086) 2024-09-19T09:20:42.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.090+0000 7fe074c00640 1 -- 172.21.15.18:0/4248806738 learned_addr learned my addr 172.21.15.18:0/4248806738 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:20:42.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.090+0000 7fe075401640 1 --2- 172.21.15.18:0/4248806738 >> v2:172.21.15.162:3300/0 conn(0x7fe07015ef50 0x7fe0700d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:42.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.090+0000 7fe067fff640 1 -- 172.21.15.18:0/4248806738 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1099037074 0 0) 0x7fe0700b7a90 con 0x7fe0700d3240 2024-09-19T09:20:42.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.090+0000 7fe067fff640 1 -- 172.21.15.18:0/4248806738 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe05c003520 con 0x7fe0700d3240 2024-09-19T09:20:42.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.091+0000 7fe067fff640 1 -- 172.21.15.18:0/4248806738 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1222179757 0 0) 0x7fe0700d3740 con 0x7fe0700b9510 2024-09-19T09:20:42.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.091+0000 7fe067fff640 1 -- 172.21.15.18:0/4248806738 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0700b7a90 con 0x7fe0700b9510 2024-09-19T09:20:42.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.091+0000 7fe067fff640 1 -- 172.21.15.18:0/4248806738 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 734648049 0 0) 0x7fe05c003520 con 0x7fe0700d3240 2024-09-19T09:20:42.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.091+0000 7fe067fff640 1 -- 172.21.15.18:0/4248806738 >> v2:172.21.15.162:3300/0 conn(0x7fe07015ef50 msgr2=0x7fe0700d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:42.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.091+0000 7fe067fff640 1 --2- 172.21.15.18:0/4248806738 >> v2:172.21.15.162:3300/0 conn(0x7fe07015ef50 0x7fe0700d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:42.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.091+0000 7fe067fff640 1 -- 172.21.15.18:0/4248806738 >> v1:172.21.15.162:6789/0 conn(0x7fe0700b9510 legacy=0x7fe0700cfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:42.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.091+0000 7fe067fff640 1 -- 172.21.15.18:0/4248806738 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0700b7d00 con 0x7fe0700d3240 2024-09-19T09:20:42.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.091+0000 7fe067fff640 1 -- 172.21.15.18:0/4248806738 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fe060001670 con 0x7fe0700d3240 2024-09-19T09:20:42.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.091+0000 7fe075401640 1 --2- 172.21.15.18:0/4248806738 >> v2:172.21.15.162:3300/0 conn(0x7fe07015ef50 0x7fe0700d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:42.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.091+0000 7fe067fff640 1 -- 172.21.15.18:0/4248806738 >> v1:172.21.15.18:6789/0 conn(0x7fe0700d3240 legacy=0x7fe0700cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:42.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.091+0000 7fe067fff640 1 --2- 172.21.15.18:0/4248806738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe05c003b40 0x7fe05c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:42.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.091+0000 7fe067fff640 1 --2- 172.21.15.18:0/4248806738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe05c004800 0x7fe05c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:42.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.091+0000 7fe067fff640 1 --2- 172.21.15.18:0/4248806738 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe05c0051c0 0x7fe05c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:42.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.091+0000 7fe067fff640 1 -- 172.21.15.18:0/4248806738 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe0700d3a20 con 0x7fe05c004800 2024-09-19T09:20:42.094 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.091+0000 7fe067fff640 1 -- 172.21.15.18:0/4248806738 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c00c0f0 con 0x7fe05c003b40 2024-09-19T09:20:42.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.091+0000 7fe067fff640 1 -- 172.21.15.18:0/4248806738 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe05c00c2f0 con 0x7fe05c0051c0 2024-09-19T09:20:42.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.091+0000 7fe074c00640 1 --2- 172.21.15.18:0/4248806738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe05c004800 0x7fe05c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:42.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.091+0000 7fe075401640 1 --2- 172.21.15.18:0/4248806738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe05c003b40 0x7fe05c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:42.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.091+0000 7fe075c02640 1 --2- 172.21.15.18:0/4248806738 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe05c0051c0 0x7fe05c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:42.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.091+0000 7fe074c00640 1 -- 172.21.15.18:0/4248806738 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe05c0051c0 msgr2=0x7fe05c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:42.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.091+0000 7fe074c00640 1 --2- 172.21.15.18:0/4248806738 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe05c0051c0 0x7fe05c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:42.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.091+0000 7fe074c00640 1 -- 172.21.15.18:0/4248806738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe05c003b40 msgr2=0x7fe05c003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:42.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.091+0000 7fe074c00640 1 --2- 172.21.15.18:0/4248806738 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe05c003b40 0x7fe05c003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:42.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.091+0000 7fe074c00640 1 -- 172.21.15.18:0/4248806738 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe05c003520 con 0x7fe05c004800 2024-09-19T09:20:42.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.091+0000 7fe075c02640 1 -- 172.21.15.18:0/4248806738 reap_dead start 2024-09-19T09:20:42.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.092+0000 7fe074c00640 1 --2- 172.21.15.18:0/4248806738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe05c004800 0x7fe05c004c80 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fe06000c190 tx=0x7fe05c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21abd999ac0718b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:42.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.092+0000 7fe067fff640 1 -- 172.21.15.18:0/4248806738 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe060007ce0 con 0x7fe05c004800 2024-09-19T09:20:42.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.092+0000 7fe067fff640 1 -- 172.21.15.18:0/4248806738 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe060005ad0 con 0x7fe05c004800 2024-09-19T09:20:42.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.092+0000 7fe067fff640 1 -- 172.21.15.18:0/4248806738 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe060007070 con 0x7fe05c004800 2024-09-19T09:20:42.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.093+0000 7fe077665640 1 -- 172.21.15.18:0/4248806738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe05c004800 msgr2=0x7fe05c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:42.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.093+0000 7fe077665640 1 --2- 172.21.15.18:0/4248806738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe05c004800 0x7fe05c004c80 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fe06000c190 tx=0x7fe05c005830 comp rx=0 tx=0).stop 2024-09-19T09:20:42.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.093+0000 7fe077665640 1 -- 172.21.15.18:0/4248806738 shutdown_connections 2024-09-19T09:20:42.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.093+0000 7fe077665640 1 --2- 172.21.15.18:0/4248806738 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe05c004800 0x7fe05c004c80 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:42.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.093+0000 7fe077665640 1 -- 172.21.15.18:0/4248806738 >> 172.21.15.18:0/4248806738 conn(0x7fe0700d4c60 msgr2=0x7fe0700d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:42.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.093+0000 7fe077665640 1 -- 172.21.15.18:0/4248806738 shutdown_connections 2024-09-19T09:20:42.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.093+0000 7fe077665640 1 -- 172.21.15.18:0/4248806738 wait complete. 2024-09-19T09:20:42.099 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.094+0000 7fe077665640 1 Processor -- start 2024-09-19T09:20:42.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.094+0000 7fe077665640 1 -- start start 2024-09-19T09:20:42.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.095+0000 7fe077665640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe05c004800 0x7fe0700c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:42.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.095+0000 7fe077665640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0701581a0 0x7fe0700ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:42.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.095+0000 7fe077665640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0700d0040 0x7fe0700d04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:42.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.095+0000 7fe077665640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe0700d21a0 con 0x7fe05c004800 2024-09-19T09:20:42.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.095+0000 7fe077665640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe0700d2020 con 0x7fe0701581a0 2024-09-19T09:20:42.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.095+0000 7fe077665640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe0700d5780 con 0x7fe0700d0040 2024-09-19T09:20:42.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.095+0000 7fe075401640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe05c004800 0x7fe0700c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:42.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.095+0000 7fe075401640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe05c004800 0x7fe0700c82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53326/0 (socket says 172.21.15.18:53326) 2024-09-19T09:20:42.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.095+0000 7fe075401640 1 -- 172.21.15.18:0/260345831 learned_addr learned my addr 172.21.15.18:0/260345831 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:42.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.095+0000 7fe074c00640 1 --2- 172.21.15.18:0/260345831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0701581a0 0x7fe0700ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:42.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.095+0000 7fe075c02640 1 --2- 172.21.15.18:0/260345831 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0700d0040 0x7fe0700d04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:42.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.095+0000 7fe075401640 1 -- 172.21.15.18:0/260345831 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0700d0040 msgr2=0x7fe0700d04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:42.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.095+0000 7fe075401640 1 --2- 172.21.15.18:0/260345831 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0700d0040 0x7fe0700d04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:42.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.095+0000 7fe075401640 1 -- 172.21.15.18:0/260345831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0701581a0 msgr2=0x7fe0700ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:42.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.095+0000 7fe075401640 1 --2- 172.21.15.18:0/260345831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0701581a0 0x7fe0700ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:42.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.095+0000 7fe075401640 1 -- 172.21.15.18:0/260345831 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0700caa00 con 0x7fe05c004800 2024-09-19T09:20:42.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.095+0000 7fe075401640 1 --2- 172.21.15.18:0/260345831 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe05c004800 0x7fe0700c82f0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fe06c011c00 tx=0x7fe06c00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:42.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.096+0000 7fe065ffb640 1 -- 172.21.15.18:0/260345831 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06c011cf0 con 0x7fe05c004800 2024-09-19T09:20:42.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.096+0000 7fe065ffb640 1 -- 172.21.15.18:0/260345831 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe06c011e90 con 0x7fe05c004800 2024-09-19T09:20:42.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.096+0000 7fe077665640 1 -- 172.21.15.18:0/260345831 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0700c8980 con 0x7fe05c004800 2024-09-19T09:20:42.101 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.096+0000 7fe065ffb640 1 -- 172.21.15.18:0/260345831 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06c004270 con 0x7fe05c004800 2024-09-19T09:20:42.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.096+0000 7fe077665640 1 -- 172.21.15.18:0/260345831 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0700c8f40 con 0x7fe05c004800 2024-09-19T09:20:42.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.097+0000 7fe077665640 1 -- 172.21.15.18:0/260345831 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0700d13a0 con 0x7fe05c004800 2024-09-19T09:20:42.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.097+0000 7fe065ffb640 1 -- 172.21.15.18:0/260345831 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe06c012040 con 0x7fe05c004800 2024-09-19T09:20:42.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.098+0000 7fe065ffb640 1 --2- 172.21.15.18:0/260345831 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe05406c2e0 0x7fe05406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:42.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.098+0000 7fe065ffb640 1 -- 172.21.15.18:0/260345831 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7fe06c08b8d0 con 0x7fe05c004800 2024-09-19T09:20:42.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.098+0000 7fe074c00640 1 --2- 172.21.15.18:0/260345831 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe05406c2e0 0x7fe05406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:42.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.099+0000 7fe074c00640 1 --2- 172.21.15.18:0/260345831 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe05406c2e0 0x7fe05406e7a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe060007fd0 tx=0x7fe060009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:42.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.102+0000 7fe065ffb640 1 -- 172.21.15.18:0/260345831 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe06c019070 con 0x7fe05c004800 2024-09-19T09:20:42.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.314+0000 7fe077665640 1 -- 172.21.15.18:0/260345831 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe0700cf840 con 0x7fe05c004800 2024-09-19T09:20:42.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.315+0000 7fe065ffb640 1 -- 172.21.15.18:0/260345831 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v65) ==== 53+0+73 (secure 0 0 0) 0x7fe06c05a040 con 0x7fe05c004800 2024-09-19T09:20:42.315 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T09:20:42.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.317+0000 7fe077665640 1 -- 172.21.15.18:0/260345831 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe05406c2e0 msgr2=0x7fe05406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:42.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.317+0000 7fe077665640 1 --2- 172.21.15.18:0/260345831 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe05406c2e0 0x7fe05406e7a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe060007fd0 tx=0x7fe060009030 comp rx=0 tx=0).stop 2024-09-19T09:20:42.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.317+0000 7fe077665640 1 -- 172.21.15.18:0/260345831 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe05c004800 msgr2=0x7fe0700c82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:42.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.317+0000 7fe077665640 1 --2- 172.21.15.18:0/260345831 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe05c004800 0x7fe0700c82f0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fe06c011c00 tx=0x7fe06c00f610 comp rx=0 tx=0).stop 2024-09-19T09:20:42.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.317+0000 7fe077665640 1 -- 172.21.15.18:0/260345831 shutdown_connections 2024-09-19T09:20:42.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.317+0000 7fe077665640 1 --2- 172.21.15.18:0/260345831 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe05406c2e0 0x7fe05406e7a0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:42.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.317+0000 7fe077665640 1 --2- 172.21.15.18:0/260345831 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0700d0040 0x7fe0700d04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:42.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.317+0000 7fe077665640 1 --2- 172.21.15.18:0/260345831 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0701581a0 0x7fe0700ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:42.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.317+0000 7fe077665640 1 --2- 172.21.15.18:0/260345831 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe05c004800 0x7fe0700c82f0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:42.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.317+0000 7fe077665640 1 -- 172.21.15.18:0/260345831 >> 172.21.15.18:0/260345831 conn(0x7fe0700d4c60 msgr2=0x7fe0700ce3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:42.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.317+0000 7fe077665640 1 -- 172.21.15.18:0/260345831 shutdown_connections 2024-09-19T09:20:42.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:42.317+0000 7fe077665640 1 -- 172.21.15.18:0/260345831 wait complete. 2024-09-19T09:20:42.329 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-19T09:20:42.329 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:20:42.329 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-09-19T09:20:42.329 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-19T09:20:42.329 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-19T09:20:42.329 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-19T09:20:42.329 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-19T09:20:42.329 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:20:42.329 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:20:42.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:20:42.330 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-09-19T09:20:42.350 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:20:42.350 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:20:42.350 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:20:42.350 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:20:42.350 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-09-19T09:20:42.350 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:20:42.351 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:20:42.351 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:20:42.351 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-09-19T09:20:42.351 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:20:42.351 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:20:42.351 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-09-19T09:20:42.351 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:20:42.352 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:20:42.352 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:20:42.352 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:20:42.352 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T09:20:42.352 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42366sec preferred_lft 42366sec 2024-09-19T09:20:42.352 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link noprefixroute 2024-09-19T09:20:42.352 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:20:42.352 INFO:teuthology.orchestra.run.smithi162.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T09:20:42.353 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 5e:4d:7e:1d:19:f9 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:20:42.353 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T09:20:42.353 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:20:42.353 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::5829:65ff:fe01:6bc7/64 scope link 2024-09-19T09:20:42.353 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:20:42.353 INFO:teuthology.orchestra.run.smithi162.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:20:42.353 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 86:86:3e:32:67:c5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T09:20:42.353 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::8486:3eff:fe32:67c5/64 scope link 2024-09-19T09:20:42.353 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:20:42.353 INFO:teuthology.orchestra.run.smithi162.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:20:42.353 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 5e:4d:7e:1d:19:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-19T09:20:42.353 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::5c4d:7eff:fe1d:19f9/64 scope link 2024-09-19T09:20:42.354 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:20:42.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:20:42.354 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:20:42.419 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-09-19T09:20:42.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:20:42.421 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-09-19T09:20:42.480 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-09-19T09:20:42.480 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:20:42.480 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T09:20:42.480 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T09:20:42.481 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:20:42.481 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:20:42.481 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-19T09:20:42.481 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T09:20:42.481 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T09:20:42.481 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T09:20:42.481 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-19T09:20:42.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:20:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:20:42.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:20:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:20:42.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:20:42.612 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-19T09:20:42.628 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-19T09:20:42.628 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-19T09:20:42.628 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:20:42.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:20:42.628 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2024-09-19T09:20:42.695 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:20:42.695 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-19T09:20:42.750 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:20:42.750 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:20:42.750 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-19T09:20:42.806 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-19T09:20:42.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:20:42.806 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:20:42.890 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:20:42.890 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:20:42.890 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:20:42.899 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:20:42.899 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:20:42.899 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:20:42.899 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:20:42.899 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:20:42.904 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:20:42.904 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:20:42.904 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:20:42.904 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:20:42.904 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:20:42.904 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-19T09:20:42.904 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-19T09:20:42.904 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=fec66d7e-50e5-42ed-81de-ad141a2f0f4e" will pass to kernel 2024-09-19T09:20:42.904 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-19T09:20:42.905 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:20:42.905 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:20:42.905 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:20:42.905 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:20:42.906 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:20:42.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:20:42.907 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-19T09:20:42.971 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:20:43.061 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:20:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:20:43.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:20:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:20:43.069 INFO:teuthology.orchestra.run.smithi162.stdout:client6107 2024-09-19T09:20:43.069 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:20:43.069 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:20:43.086 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:20:43.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.199+0000 7f14683cf640 1 Processor -- start 2024-09-19T09:20:43.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.199+0000 7f14683cf640 1 -- start start 2024-09-19T09:20:43.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.200+0000 7f14683cf640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f14600cf560 0x7f14600cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.200+0000 7f14683cf640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14600d0e10 con 0x7f14600ce600 2024-09-19T09:20:43.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.200+0000 7f14683cf640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14600d0310 con 0x7f14600cfe80 2024-09-19T09:20:43.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.200+0000 7f14683cf640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f14600d0850 con 0x7f14600cf560 2024-09-19T09:20:43.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.200+0000 7f146696c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f14600ce600 0x7f14600b33e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55088/0 (socket says 172.21.15.18:55088) 2024-09-19T09:20:43.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.200+0000 7f146696c640 1 -- 172.21.15.18:0/251366990 learned_addr learned my addr 172.21.15.18:0/251366990 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:20:43.203 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.200+0000 7f146616b640 1 --2- 172.21.15.18:0/251366990 >> v2:172.21.15.162:3300/0 conn(0x7f14600cf560 0x7f14600cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.200+0000 7f1465169640 1 -- 172.21.15.18:0/251366990 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2193500720 0 0) 0x7f14600d0e10 con 0x7f14600ce600 2024-09-19T09:20:43.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.201+0000 7f1465169640 1 -- 172.21.15.18:0/251366990 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f144c003520 con 0x7f14600ce600 2024-09-19T09:20:43.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.201+0000 7f1465169640 1 -- 172.21.15.18:0/251366990 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2008876646 0 0) 0x7f14600d0310 con 0x7f14600cfe80 2024-09-19T09:20:43.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.201+0000 7f1465169640 1 -- 172.21.15.18:0/251366990 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14600d0e10 con 0x7f14600cfe80 2024-09-19T09:20:43.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.201+0000 7f1465169640 1 -- 172.21.15.18:0/251366990 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 117293698 0 0) 0x7f144c003520 con 0x7f14600ce600 2024-09-19T09:20:43.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.201+0000 7f1465169640 1 -- 172.21.15.18:0/251366990 >> v2:172.21.15.162:3300/0 conn(0x7f14600cf560 msgr2=0x7f14600cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:43.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.201+0000 7f1465169640 1 --2- 172.21.15.18:0/251366990 >> v2:172.21.15.162:3300/0 conn(0x7f14600cf560 0x7f14600cf940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.201+0000 7f1465169640 1 -- 172.21.15.18:0/251366990 >> v1:172.21.15.162:6789/0 conn(0x7f14600cfe80 legacy=0x7f14600b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:43.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.201+0000 7f1465169640 1 -- 172.21.15.18:0/251366990 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14600d0b30 con 0x7f14600ce600 2024-09-19T09:20:43.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.201+0000 7f1465169640 1 -- 172.21.15.18:0/251366990 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f14580019f0 con 0x7f14600ce600 2024-09-19T09:20:43.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.201+0000 7f146616b640 1 --2- 172.21.15.18:0/251366990 >> v2:172.21.15.162:3300/0 conn(0x7f14600cf560 0x7f14600cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:20:43.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.201+0000 7f1465169640 1 -- 172.21.15.18:0/251366990 >> v1:172.21.15.18:6789/0 conn(0x7f14600ce600 legacy=0x7f14600b33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:43.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.201+0000 7f1465169640 1 --2- 172.21.15.18:0/251366990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f144c003b40 0x7f144c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.201+0000 7f1465169640 1 --2- 172.21.15.18:0/251366990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f144c004800 0x7f144c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.201+0000 7f1465169640 1 --2- 172.21.15.18:0/251366990 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f144c005230 0x7f144c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.201+0000 7f1465169640 1 -- 172.21.15.18:0/251366990 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f14600d0850 con 0x7f144c004800 2024-09-19T09:20:43.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.201+0000 7f1465169640 1 -- 172.21.15.18:0/251366990 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f144c00c190 con 0x7f144c003b40 2024-09-19T09:20:43.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.201+0000 7f1465169640 1 -- 172.21.15.18:0/251366990 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f144c00c390 con 0x7f144c005230 2024-09-19T09:20:43.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.201+0000 7f146596a640 1 --2- 172.21.15.18:0/251366990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f144c004800 0x7f144c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.201+0000 7f146616b640 1 --2- 172.21.15.18:0/251366990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f144c003b40 0x7f144c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.201+0000 7f146696c640 1 --2- 172.21.15.18:0/251366990 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f144c005230 0x7f144c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.201+0000 7f146596a640 1 -- 172.21.15.18:0/251366990 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f144c005230 msgr2=0x7f144c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:43.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.201+0000 7f146596a640 1 --2- 172.21.15.18:0/251366990 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f144c005230 0x7f144c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.201+0000 7f146596a640 1 -- 172.21.15.18:0/251366990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f144c003b40 msgr2=0x7f144c003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:43.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.201+0000 7f146596a640 1 --2- 172.21.15.18:0/251366990 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f144c003b40 0x7f144c003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.201+0000 7f146596a640 1 -- 172.21.15.18:0/251366990 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f144c003520 con 0x7f144c004800 2024-09-19T09:20:43.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.201+0000 7f146696c640 1 -- 172.21.15.18:0/251366990 reap_dead start 2024-09-19T09:20:43.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.202+0000 7f146596a640 1 --2- 172.21.15.18:0/251366990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f144c004800 0x7f144c004c80 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f14500018d0 tx=0x7f144c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68664c5e86a82226 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:43.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.202+0000 7f1465169640 1 -- 172.21.15.18:0/251366990 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14500014f0 con 0x7f144c004800 2024-09-19T09:20:43.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.202+0000 7f1465169640 1 -- 172.21.15.18:0/251366990 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14500052d0 con 0x7f144c004800 2024-09-19T09:20:43.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.202+0000 7f1465169640 1 -- 172.21.15.18:0/251366990 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145002ac60 con 0x7f144c004800 2024-09-19T09:20:43.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.203+0000 7f14683cf640 1 -- 172.21.15.18:0/251366990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f144c004800 msgr2=0x7f144c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:43.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.203+0000 7f14683cf640 1 --2- 172.21.15.18:0/251366990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f144c004800 0x7f144c004c80 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f14500018d0 tx=0x7f144c005830 comp rx=0 tx=0).stop 2024-09-19T09:20:43.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.203+0000 7f14683cf640 1 -- 172.21.15.18:0/251366990 shutdown_connections 2024-09-19T09:20:43.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.203+0000 7f14683cf640 1 --2- 172.21.15.18:0/251366990 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f144c004800 0x7f144c004c80 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.203+0000 7f14683cf640 1 -- 172.21.15.18:0/251366990 >> 172.21.15.18:0/251366990 conn(0x7f14600b4700 msgr2=0x7f14600b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:43.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.203+0000 7f14683cf640 1 -- 172.21.15.18:0/251366990 shutdown_connections 2024-09-19T09:20:43.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.203+0000 7f14683cf640 1 -- 172.21.15.18:0/251366990 wait complete. 2024-09-19T09:20:43.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.204+0000 7f14683cf640 1 Processor -- start 2024-09-19T09:20:43.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.204+0000 7f14683cf640 1 -- start start 2024-09-19T09:20:43.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.205+0000 7f14683cf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f144c004800 0x7f14600c5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.205+0000 7f14683cf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14601518c0 0x7f146006cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.205+0000 7f14683cf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f146015d090 0x7f146015d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.205+0000 7f14683cf640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f14600b5420 con 0x7f146015d090 2024-09-19T09:20:43.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.205+0000 7f14683cf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f14600b27b0 con 0x7f14601518c0 2024-09-19T09:20:43.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.205+0000 7f14683cf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f14600b55a0 con 0x7f144c004800 2024-09-19T09:20:43.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.205+0000 7f146696c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f146015d090 0x7f146015d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.205+0000 7f146696c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f146015d090 0x7f146015d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53344/0 (socket says 172.21.15.18:53344) 2024-09-19T09:20:43.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.205+0000 7f146696c640 1 -- 172.21.15.18:0/4202486032 learned_addr learned my addr 172.21.15.18:0/4202486032 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:43.210 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.205+0000 7f146616b640 1 --2- 172.21.15.18:0/4202486032 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f144c004800 0x7f14600c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.205+0000 7f146696c640 1 -- 172.21.15.18:0/4202486032 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f144c004800 msgr2=0x7f14600c5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:43.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.205+0000 7f146696c640 1 --2- 172.21.15.18:0/4202486032 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f144c004800 0x7f14600c5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.205+0000 7f146696c640 1 -- 172.21.15.18:0/4202486032 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14601518c0 msgr2=0x7f146006cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:43.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.205+0000 7f146696c640 1 --2- 172.21.15.18:0/4202486032 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14601518c0 0x7f146006cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.205+0000 7f146696c640 1 -- 172.21.15.18:0/4202486032 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f146006d620 con 0x7f146015d090 2024-09-19T09:20:43.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.205+0000 7f146696c640 1 --2- 172.21.15.18:0/4202486032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f146015d090 0x7f146015d520 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f1460160820 tx=0x7f1458007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:43.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.206+0000 7f1456ffd640 1 -- 172.21.15.18:0/4202486032 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1458017020 con 0x7f146015d090 2024-09-19T09:20:43.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.206+0000 7f1456ffd640 1 -- 172.21.15.18:0/4202486032 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f145800ab70 con 0x7f146015d090 2024-09-19T09:20:43.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.206+0000 7f14683cf640 1 -- 172.21.15.18:0/4202486032 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f146006d900 con 0x7f146015d090 2024-09-19T09:20:43.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.206+0000 7f1456ffd640 1 -- 172.21.15.18:0/4202486032 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14580133f0 con 0x7f146015d090 2024-09-19T09:20:43.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.206+0000 7f14683cf640 1 -- 172.21.15.18:0/4202486032 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f146006dec0 con 0x7f146015d090 2024-09-19T09:20:43.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.207+0000 7f14683cf640 1 -- 172.21.15.18:0/4202486032 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14600d0310 con 0x7f146015d090 2024-09-19T09:20:43.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.207+0000 7f1456ffd640 1 -- 172.21.15.18:0/4202486032 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f145801a020 con 0x7f146015d090 2024-09-19T09:20:43.211 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.208+0000 7f1456ffd640 1 --2- 172.21.15.18:0/4202486032 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f144406c2b0 0x7f144406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.208+0000 7f1456ffd640 1 -- 172.21.15.18:0/4202486032 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f145808bb70 con 0x7f146015d090 2024-09-19T09:20:43.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.208+0000 7f146616b640 1 --2- 172.21.15.18:0/4202486032 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f144406c2b0 0x7f144406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.208+0000 7f146616b640 1 --2- 172.21.15.18:0/4202486032 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f144406c2b0 0x7f144406e770 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f1460077320 tx=0x7f145c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:43.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.212+0000 7f1456ffd640 1 -- 172.21.15.18:0/4202486032 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1458021020 con 0x7f146015d090 2024-09-19T09:20:43.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.425+0000 7f14683cf640 1 -- 172.21.15.18:0/4202486032 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f14600b3d80 con 0x7f146015d090 2024-09-19T09:20:43.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.425+0000 7f1456ffd640 1 -- 172.21.15.18:0/4202486032 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+5225 (secure 0 0 0) 0x7f1458060020 con 0x7f146015d090 2024-09-19T09:20:43.427 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:20:43.427 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":65,"btime":"2024-09-19T09:20:38:235364+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6044,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2661639901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2661639901},{"type":"v1","addr":"172.21.15.162:6836","nonce":2661639901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":7221,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/56318264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":56318264},{"type":"v1","addr":"172.21.15.18:6833","nonce":56318264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":7239,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1783371939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1783371939},{"type":"v1","addr":"172.21.15.162:6837","nonce":1783371939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:20:35.068097+0000","modified":"2024-09-19T09:20:37.584812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7245":{"gid":7245,"name":"a","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/1201598209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1201598209},{"type":"v1","addr":"172.21.15.18:6835","nonce":1201598209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7245,"qdb_cluster":[7245]},"id":9}]} 2024-09-19T09:20:43.427 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 65 2024-09-19T09:20:43.428 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.428+0000 7f14683cf640 1 -- 172.21.15.18:0/4202486032 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f144406c2b0 msgr2=0x7f144406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:43.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.428+0000 7f14683cf640 1 --2- 172.21.15.18:0/4202486032 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f144406c2b0 0x7f144406e770 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f1460077320 tx=0x7f145c009190 comp rx=0 tx=0).stop 2024-09-19T09:20:43.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.428+0000 7f14683cf640 1 -- 172.21.15.18:0/4202486032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f146015d090 msgr2=0x7f146015d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:43.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.428+0000 7f14683cf640 1 --2- 172.21.15.18:0/4202486032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f146015d090 0x7f146015d520 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f1460160820 tx=0x7f1458007b00 comp rx=0 tx=0).stop 2024-09-19T09:20:43.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.428+0000 7f14683cf640 1 -- 172.21.15.18:0/4202486032 shutdown_connections 2024-09-19T09:20:43.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.428+0000 7f14683cf640 1 --2- 172.21.15.18:0/4202486032 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f144406c2b0 0x7f144406e770 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.428+0000 7f14683cf640 1 --2- 172.21.15.18:0/4202486032 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f146015d090 0x7f146015d520 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.428+0000 7f14683cf640 1 --2- 172.21.15.18:0/4202486032 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14601518c0 0x7f146006cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.428+0000 7f14683cf640 1 --2- 172.21.15.18:0/4202486032 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f144c004800 0x7f14600c5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.428+0000 7f14683cf640 1 -- 172.21.15.18:0/4202486032 >> 172.21.15.18:0/4202486032 conn(0x7f14600b4700 msgr2=0x7f14600b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:43.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.428+0000 7f14683cf640 1 -- 172.21.15.18:0/4202486032 shutdown_connections 2024-09-19T09:20:43.429 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.428+0000 7f14683cf640 1 -- 172.21.15.18:0/4202486032 wait complete. 2024-09-19T09:20:43.440 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-19T09:20:43.560 INFO:teuthology.orchestra.run.smithi018.stdout:{"cluster_fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","whoami":0,"id":7245,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":7.8295351030000004,"mdsmap_epoch":65,"osdmap_epoch":154,"osdmap_epoch_barrier":154,"uptime":13.320801672} 2024-09-19T09:20:43.561 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", "fs_name": "cephfs", "id": 7245, "mdsmap_epoch": 65, "osdmap_epoch": 154, "osdmap_epoch_barrier": 154, "rank_uptime": 7.829535103, "state": "up:active", "uptime": 13.320801672, "want_state": "up:active", "whoami": 0 } 2024-09-19T09:20:43.561 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2024-09-19T09:20:43.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.668+0000 7f80defa6640 1 Processor -- start 2024-09-19T09:20:43.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.668+0000 7f80defa6640 1 -- start start 2024-09-19T09:20:43.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.669+0000 7f80defa6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f80d81445a0 0x7f80d80cd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.669+0000 7f80defa6640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f80d80ced50 0x7f80d8072680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.669+0000 7f80defa6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80d80cd8c0 con 0x7f80d8144980 2024-09-19T09:20:43.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.669+0000 7f80defa6640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f80d80b4d20 con 0x7f80d81445a0 2024-09-19T09:20:43.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.669+0000 7f80defa6640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f80d815fdd0 con 0x7f80d80ced50 2024-09-19T09:20:43.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.669+0000 7f80dcd42640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f80d81445a0 0x7f80d80cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.669+0000 7f80dcd42640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f80d81445a0 0x7f80d80cd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53358/0 (socket says 172.21.15.18:53358) 2024-09-19T09:20:43.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.669+0000 7f80dcd42640 1 -- 172.21.15.18:0/1524900489 learned_addr learned my addr 172.21.15.18:0/1524900489 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:43.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.669+0000 7f80dcd42640 1 -- 172.21.15.18:0/1524900489 >> v2:172.21.15.162:3300/0 conn(0x7f80d80ced50 msgr2=0x7f80d8072680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:43.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.669+0000 7f80dcd42640 1 --2- 172.21.15.18:0/1524900489 >> v2:172.21.15.162:3300/0 conn(0x7f80d80ced50 0x7f80d8072680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.669+0000 7f80dcd42640 1 -- 172.21.15.18:0/1524900489 >> v1:172.21.15.162:6789/0 conn(0x7f80d8144980 legacy=0x7f80d806e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:20:43.671 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.669+0000 7f80dcd42640 1 -- 172.21.15.18:0/1524900489 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80d8160310 con 0x7f80d81445a0 2024-09-19T09:20:43.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.670+0000 7f80dcd42640 1 --2- 172.21.15.18:0/1524900489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80d81445a0 0x7f80d80cd380 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f80cc0098a0 tx=0x7f80cc02a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbacbc86a46a61b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:43.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.670+0000 7f80d77fe640 1 -- 172.21.15.18:0/1524900489 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80cc037070 con 0x7f80d81445a0 2024-09-19T09:20:43.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.670+0000 7f80d77fe640 1 -- 172.21.15.18:0/1524900489 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80cc032440 con 0x7f80d81445a0 2024-09-19T09:20:43.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.670+0000 7f80d77fe640 1 -- 172.21.15.18:0/1524900489 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80cc032810 con 0x7f80d81445a0 2024-09-19T09:20:43.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.671+0000 7f80defa6640 1 -- 172.21.15.18:0/1524900489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80d81445a0 msgr2=0x7f80d80cd380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:43.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.671+0000 7f80defa6640 1 --2- 172.21.15.18:0/1524900489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80d81445a0 0x7f80d80cd380 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f80cc0098a0 tx=0x7f80cc02a160 comp rx=0 tx=0).stop 2024-09-19T09:20:43.672 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.671+0000 7f80defa6640 1 -- 172.21.15.18:0/1524900489 shutdown_connections 2024-09-19T09:20:43.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.671+0000 7f80defa6640 1 --2- 172.21.15.18:0/1524900489 >> v2:172.21.15.162:3300/0 conn(0x7f80d80ced50 0x7f80d8072680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.671+0000 7f80defa6640 1 --2- 172.21.15.18:0/1524900489 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80d81445a0 0x7f80d80cd380 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.671+0000 7f80defa6640 1 -- 172.21.15.18:0/1524900489 >> 172.21.15.18:0/1524900489 conn(0x7f80d80b26a0 msgr2=0x7f80d80b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:43.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.671+0000 7f80defa6640 1 -- 172.21.15.18:0/1524900489 shutdown_connections 2024-09-19T09:20:43.673 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.671+0000 7f80defa6640 1 -- 172.21.15.18:0/1524900489 wait complete. 2024-09-19T09:20:43.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.672+0000 7f80defa6640 1 Processor -- start 2024-09-19T09:20:43.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.672+0000 7f80defa6640 1 -- start start 2024-09-19T09:20:43.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.673+0000 7f80defa6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80d80ced50 0x7f80d815b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.673+0000 7f80defa6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80d81445a0 0x7f80d815bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.673+0000 7f80defa6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80d8144980 0x7f80d813bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.673+0000 7f80defa6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f80d80b5c20 con 0x7f80d8144980 2024-09-19T09:20:43.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.673+0000 7f80defa6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f80d80b5940 con 0x7f80d81445a0 2024-09-19T09:20:43.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.673+0000 7f80defa6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f80d8144ec0 con 0x7f80d80ced50 2024-09-19T09:20:43.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.673+0000 7f80dd543640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80d8144980 0x7f80d813bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.673+0000 7f80dd543640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80d8144980 0x7f80d813bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53368/0 (socket says 172.21.15.18:53368) 2024-09-19T09:20:43.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.673+0000 7f80dd543640 1 -- 172.21.15.18:0/4235114550 learned_addr learned my addr 172.21.15.18:0/4235114550 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:20:43.675 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.673+0000 7f80dcd42640 1 --2- 172.21.15.18:0/4235114550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80d80ced50 0x7f80d815b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.673+0000 7f80dd543640 1 -- 172.21.15.18:0/4235114550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80d80ced50 msgr2=0x7f80d815b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:43.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.673+0000 7f80d7fff640 1 --2- 172.21.15.18:0/4235114550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80d81445a0 0x7f80d815bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.673+0000 7f80dd543640 1 --2- 172.21.15.18:0/4235114550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80d80ced50 0x7f80d815b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.673+0000 7f80dd543640 1 -- 172.21.15.18:0/4235114550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80d81445a0 msgr2=0x7f80d815bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:43.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.673+0000 7f80dd543640 1 --2- 172.21.15.18:0/4235114550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80d81445a0 0x7f80d815bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:43.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.673+0000 7f80dd543640 1 -- 172.21.15.18:0/4235114550 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80d815c4f0 con 0x7f80d8144980 2024-09-19T09:20:43.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.673+0000 7f80dcd42640 1 --2- 172.21.15.18:0/4235114550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80d80ced50 0x7f80d815b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:20:43.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.674+0000 7f80dd543640 1 --2- 172.21.15.18:0/4235114550 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80d8144980 0x7f80d813bed0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f80d000b9e0 tx=0x7f80d000bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:43.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.674+0000 7f80d57fa640 1 -- 172.21.15.18:0/4235114550 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d0019070 con 0x7f80d8144980 2024-09-19T09:20:43.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.674+0000 7f80d57fa640 1 -- 172.21.15.18:0/4235114550 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80d000cb20 con 0x7f80d8144980 2024-09-19T09:20:43.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.674+0000 7f80defa6640 1 -- 172.21.15.18:0/4235114550 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80d81675a0 con 0x7f80d8144980 2024-09-19T09:20:43.676 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.674+0000 7f80d57fa640 1 -- 172.21.15.18:0/4235114550 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d0014440 con 0x7f80d8144980 2024-09-19T09:20:43.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.674+0000 7f80defa6640 1 -- 172.21.15.18:0/4235114550 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80d8167b60 con 0x7f80d8144980 2024-09-19T09:20:43.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.675+0000 7f80defa6640 1 -- 172.21.15.18:0/4235114550 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80d815f900 con 0x7f80d8144980 2024-09-19T09:20:43.677 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.675+0000 7f80d57fa640 1 -- 172.21.15.18:0/4235114550 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f80d001c070 con 0x7f80d8144980 2024-09-19T09:20:43.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.676+0000 7f80d57fa640 1 --2- 172.21.15.18:0/4235114550 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f80bc06c2b0 0x7f80bc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:20:43.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.676+0000 7f80d57fa640 1 -- 172.21.15.18:0/4235114550 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5709+0+0 (secure 0 0 0) 0x7f80d008b140 con 0x7f80d8144980 2024-09-19T09:20:43.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.676+0000 7f80dcd42640 1 --2- 172.21.15.18:0/4235114550 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f80bc06c2b0 0x7f80bc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:20:43.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.677+0000 7f80dcd42640 1 --2- 172.21.15.18:0/4235114550 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f80bc06c2b0 0x7f80bc06e770 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f80cc034000 tx=0x7f80cc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:20:43.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.680+0000 7f80d57fa640 1 -- 172.21.15.18:0/4235114550 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f80d00598b0 con 0x7f80d8144980 2024-09-19T09:20:43.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:43.857+0000 7f80defa6640 1 -- 172.21.15.18:0/4235114550 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) -- 0x7f80d8143d60 con 0x7f80d8144980 2024-09-19T09:20:44.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:44.758+0000 7f80d57fa640 1 -- 172.21.15.18:0/4235114550 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v155) ==== 181+0+0 (secure 0 0 0) 0x7f80d00591b0 con 0x7f80d8144980 2024-09-19T09:20:44.761 INFO:teuthology.orchestra.run.smithi018.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2024-09-19T09:20:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:44.761+0000 7f80defa6640 1 -- 172.21.15.18:0/4235114550 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f80bc06c2b0 msgr2=0x7f80bc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:44.761+0000 7f80defa6640 1 --2- 172.21.15.18:0/4235114550 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f80bc06c2b0 0x7f80bc06e770 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f80cc034000 tx=0x7f80cc02e000 comp rx=0 tx=0).stop 2024-09-19T09:20:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:44.761+0000 7f80defa6640 1 -- 172.21.15.18:0/4235114550 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80d8144980 msgr2=0x7f80d813bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:20:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:44.761+0000 7f80defa6640 1 --2- 172.21.15.18:0/4235114550 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80d8144980 0x7f80d813bed0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f80d000b9e0 tx=0x7f80d000bea0 comp rx=0 tx=0).stop 2024-09-19T09:20:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:44.761+0000 7f80defa6640 1 -- 172.21.15.18:0/4235114550 shutdown_connections 2024-09-19T09:20:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:44.761+0000 7f80defa6640 1 --2- 172.21.15.18:0/4235114550 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f80bc06c2b0 0x7f80bc06e770 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:44.761+0000 7f80defa6640 1 --2- 172.21.15.18:0/4235114550 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80d8144980 0x7f80d813bed0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:44.761+0000 7f80defa6640 1 --2- 172.21.15.18:0/4235114550 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80d81445a0 0x7f80d815bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:44.761+0000 7f80defa6640 1 --2- 172.21.15.18:0/4235114550 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f80d80ced50 0x7f80d815b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:20:44.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:44.761+0000 7f80defa6640 1 -- 172.21.15.18:0/4235114550 >> 172.21.15.18:0/4235114550 conn(0x7f80d80b26a0 msgr2=0x7f80d8166960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:20:44.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:44.761+0000 7f80defa6640 1 -- 172.21.15.18:0/4235114550 shutdown_connections 2024-09-19T09:20:44.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:20:44.761+0000 7f80defa6640 1 -- 172.21.15.18:0/4235114550 wait complete. 2024-09-19T09:20:44.775 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-19T09:20:44.896 INFO:teuthology.orchestra.run.smithi018.stdout:{"osd_mon_report_interval":"5"} 2024-09-19T09:20:44.897 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-19T09:20:44.897 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2024-09-19T09:20:45.005 INFO:teuthology.orchestra.run.smithi018.stdout:{"mon_tick_interval":"5"} 2024-09-19T09:20:45.005 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2024-09-19T09:20:45.006 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2024-09-19T09:20:45.006 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-09-19T09:20:45.006 DEBUG:teuthology.orchestra.run.smithi018:> import time 2024-09-19T09:20:45.006 DEBUG:teuthology.orchestra.run.smithi018:> import datetime 2024-09-19T09:20:45.006 DEBUG:teuthology.orchestra.run.smithi018:> import subprocess 2024-09-19T09:20:45.006 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-09-19T09:20:45.006 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:20:45.007 DEBUG:teuthology.orchestra.run.smithi018:> # Write some buffered data through before going full, all should be well 2024-09-19T09:20:45.007 DEBUG:teuthology.orchestra.run.smithi018:> print("writing some data through which we expect to succeed") 2024-09-19T09:20:45.007 DEBUG:teuthology.orchestra.run.smithi018:> bytes = 0 2024-09-19T09:20:45.007 DEBUG:teuthology.orchestra.run.smithi018:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2024-09-19T09:20:45.007 DEBUG:teuthology.orchestra.run.smithi018:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2024-09-19T09:20:45.007 DEBUG:teuthology.orchestra.run.smithi018:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2024-09-19T09:20:45.007 DEBUG:teuthology.orchestra.run.smithi018:> os.fsync(f) 2024-09-19T09:20:45.007 DEBUG:teuthology.orchestra.run.smithi018:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2024-09-19T09:20:45.007 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:20:45.008 DEBUG:teuthology.orchestra.run.smithi018:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2024-09-19T09:20:45.008 DEBUG:teuthology.orchestra.run.smithi018:> # writing until we see an error from fsync. As long as we'"'"'re doing 2024-09-19T09:20:45.008 DEBUG:teuthology.orchestra.run.smithi018:> # buffered IO, the error should always only appear from fsync and not 2024-09-19T09:20:45.008 DEBUG:teuthology.orchestra.run.smithi018:> # from write 2024-09-19T09:20:45.008 DEBUG:teuthology.orchestra.run.smithi018:> full = False 2024-09-19T09:20:45.008 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:20:45.008 DEBUG:teuthology.orchestra.run.smithi018:> for n in range(0, int(32 * 0.9)): 2024-09-19T09:20:45.008 DEBUG:teuthology.orchestra.run.smithi018:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-19T09:20:45.008 DEBUG:teuthology.orchestra.run.smithi018:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2024-09-19T09:20:45.008 DEBUG:teuthology.orchestra.run.smithi018:> print("done writing {0} bytes".format(bytes)) 2024-09-19T09:20:45.008 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:20:45.009 DEBUG:teuthology.orchestra.run.smithi018:> # OK, now we should sneak in under the full condition 2024-09-19T09:20:45.009 DEBUG:teuthology.orchestra.run.smithi018:> # due to the time it takes the OSDs to report to the 2024-09-19T09:20:45.009 DEBUG:teuthology.orchestra.run.smithi018:> # mons, and get a successful fsync on our full-making data 2024-09-19T09:20:45.009 DEBUG:teuthology.orchestra.run.smithi018:> os.fsync(f) 2024-09-19T09:20:45.009 DEBUG:teuthology.orchestra.run.smithi018:> print("successfully fsync'"'"'ed prior to getting full state reported") 2024-09-19T09:20:45.009 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:20:45.009 DEBUG:teuthology.orchestra.run.smithi018:> # buffered write, add more dirty data to the buffer 2024-09-19T09:20:45.009 DEBUG:teuthology.orchestra.run.smithi018:> print("starting buffered write") 2024-09-19T09:20:45.009 DEBUG:teuthology.orchestra.run.smithi018:> try: 2024-09-19T09:20:45.009 DEBUG:teuthology.orchestra.run.smithi018:> for n in range(0, int(32 * 0.2)): 2024-09-19T09:20:45.009 DEBUG:teuthology.orchestra.run.smithi018:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-19T09:20:45.009 DEBUG:teuthology.orchestra.run.smithi018:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2024-09-19T09:20:45.009 DEBUG:teuthology.orchestra.run.smithi018:> time.sleep(15.0) 2024-09-19T09:20:45.009 DEBUG:teuthology.orchestra.run.smithi018:> except OSError: 2024-09-19T09:20:45.009 DEBUG:teuthology.orchestra.run.smithi018:> pass; 2024-09-19T09:20:45.009 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:20:45.010 DEBUG:teuthology.orchestra.run.smithi018:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2024-09-19T09:20:45.010 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:20:45.010 DEBUG:teuthology.orchestra.run.smithi018:> # Wait long enough for a background flush that should fail 2024-09-19T09:20:45.010 DEBUG:teuthology.orchestra.run.smithi018:> time.sleep(30) 2024-09-19T09:20:45.010 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:20:45.010 DEBUG:teuthology.orchestra.run.smithi018:> if False: 2024-09-19T09:20:45.010 DEBUG:teuthology.orchestra.run.smithi018:> # ...and check that the failed background flush is reflected in fclose 2024-09-19T09:20:45.010 DEBUG:teuthology.orchestra.run.smithi018:> try: 2024-09-19T09:20:45.010 DEBUG:teuthology.orchestra.run.smithi018:> os.close(f) 2024-09-19T09:20:45.010 DEBUG:teuthology.orchestra.run.smithi018:> except OSError: 2024-09-19T09:20:45.010 DEBUG:teuthology.orchestra.run.smithi018:> print("close() returned an error as expected") 2024-09-19T09:20:45.010 DEBUG:teuthology.orchestra.run.smithi018:> else: 2024-09-19T09:20:45.011 DEBUG:teuthology.orchestra.run.smithi018:> raise RuntimeError("close() failed to raise error") 2024-09-19T09:20:45.011 DEBUG:teuthology.orchestra.run.smithi018:> else: 2024-09-19T09:20:45.011 DEBUG:teuthology.orchestra.run.smithi018:> # The kernel cephfs client does not raise errors on fclose 2024-09-19T09:20:45.011 DEBUG:teuthology.orchestra.run.smithi018:> os.close(f) 2024-09-19T09:20:45.011 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:20:45.011 DEBUG:teuthology.orchestra.run.smithi018:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2024-09-19T09:20:45.011 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-09-19T09:21:01.398 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:21:01.403 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:21:31.527 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:21:31.531 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:22:01.671 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:22:01.675 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:22:31.808 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:22:31.812 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:22:45.409 INFO:teuthology.orchestra.run.smithi018.stdout:writing some data through which we expect to succeed 2024-09-19T09:22:45.410 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed data successfully, will now attempt to fill fs 2024-09-19T09:22:45.410 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 1572864 bytes via buffered write, may repeat 2024-09-19T09:22:45.410 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 2621440 bytes via buffered write, may repeat 2024-09-19T09:22:45.410 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 3670016 bytes via buffered write, may repeat 2024-09-19T09:22:45.410 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 4718592 bytes via buffered write, may repeat 2024-09-19T09:22:45.410 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 5767168 bytes via buffered write, may repeat 2024-09-19T09:22:45.410 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 6815744 bytes via buffered write, may repeat 2024-09-19T09:22:45.410 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 7864320 bytes via buffered write, may repeat 2024-09-19T09:22:45.410 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 8912896 bytes via buffered write, may repeat 2024-09-19T09:22:45.410 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 9961472 bytes via buffered write, may repeat 2024-09-19T09:22:45.411 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 11010048 bytes via buffered write, may repeat 2024-09-19T09:22:45.411 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 12058624 bytes via buffered write, may repeat 2024-09-19T09:22:45.411 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 13107200 bytes via buffered write, may repeat 2024-09-19T09:22:45.411 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 14155776 bytes via buffered write, may repeat 2024-09-19T09:22:45.411 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 15204352 bytes via buffered write, may repeat 2024-09-19T09:22:45.411 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 16252928 bytes via buffered write, may repeat 2024-09-19T09:22:45.411 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 17301504 bytes via buffered write, may repeat 2024-09-19T09:22:45.411 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 18350080 bytes via buffered write, may repeat 2024-09-19T09:22:45.411 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 19398656 bytes via buffered write, may repeat 2024-09-19T09:22:45.411 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 20447232 bytes via buffered write, may repeat 2024-09-19T09:22:45.411 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 21495808 bytes via buffered write, may repeat 2024-09-19T09:22:45.411 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 22544384 bytes via buffered write, may repeat 2024-09-19T09:22:45.411 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 23592960 bytes via buffered write, may repeat 2024-09-19T09:22:45.412 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 24641536 bytes via buffered write, may repeat 2024-09-19T09:22:45.412 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 25690112 bytes via buffered write, may repeat 2024-09-19T09:22:45.412 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 26738688 bytes via buffered write, may repeat 2024-09-19T09:22:45.412 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 27787264 bytes via buffered write, may repeat 2024-09-19T09:22:45.412 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 28835840 bytes via buffered write, may repeat 2024-09-19T09:22:45.412 INFO:teuthology.orchestra.run.smithi018.stdout:wrote 29884416 bytes via buffered write, may repeat 2024-09-19T09:22:45.412 INFO:teuthology.orchestra.run.smithi018.stdout:done writing 29884416 bytes 2024-09-19T09:22:45.412 INFO:teuthology.orchestra.run.smithi018.stdout:successfully fsync'ed prior to getting full state reported 2024-09-19T09:22:45.412 INFO:teuthology.orchestra.run.smithi018.stdout:starting buffered write 2024-09-19T09:22:45.412 INFO:teuthology.orchestra.run.smithi018.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-19T09:22:45.412 INFO:teuthology.orchestra.run.smithi018.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-19T09:22:45.412 INFO:teuthology.orchestra.run.smithi018.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-19T09:22:45.413 INFO:teuthology.orchestra.run.smithi018.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-19T09:22:45.413 INFO:teuthology.orchestra.run.smithi018.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-19T09:22:45.413 INFO:teuthology.orchestra.run.smithi018.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-19T09:22:45.413 INFO:teuthology.orchestra.run.smithi018.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2024-09-19T09:22:45.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:22:45.424 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T09:22:45.424 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:22:45.479 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:22:45.536 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T09:22:45.536 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:22:45.536 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:22:45.536 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:22:45.556 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:22:45.556 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:22:45.616 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T09:22:45.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.768+0000 7ff0e9f68640 1 Processor -- start 2024-09-19T09:22:45.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.768+0000 7ff0e9f68640 1 -- start start 2024-09-19T09:22:45.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.769+0000 7ff0e9f68640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0e415c720 0x7ff0e406f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:45.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.769+0000 7ff0e9f68640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff0e4073140 0x7ff0e4073560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:45.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.769+0000 7ff0e9f68640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0e40b6fa0 con 0x7ff0e4073aa0 2024-09-19T09:22:45.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.769+0000 7ff0e9f68640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7ff0e4160480 con 0x7ff0e4073140 2024-09-19T09:22:45.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.769+0000 7ff0e9f68640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff0e415fa50 con 0x7ff0e415c720 2024-09-19T09:22:45.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.769+0000 7ff0e2ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff0e4073140 0x7ff0e4073560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:45.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.769+0000 7ff0e3fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff0e4073aa0 0x7ff0e406bc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56254/0 (socket says 172.21.15.18:56254) 2024-09-19T09:22:45.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.769+0000 7ff0e3fff640 1 -- 172.21.15.18:0/2162694462 learned_addr learned my addr 172.21.15.18:0/2162694462 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:22:45.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.769+0000 7ff0e2ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff0e4073140 0x7ff0e4073560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50222/0 (socket says 172.21.15.18:50222) 2024-09-19T09:22:45.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.769+0000 7ff0e37fe640 1 --2- 172.21.15.18:0/2162694462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0e415c720 0x7ff0e406f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:45.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.769+0000 7ff0e2ffd640 1 -- 172.21.15.18:0/2162694462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0e415c720 msgr2=0x7ff0e406f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:45.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.769+0000 7ff0e2ffd640 1 --2- 172.21.15.18:0/2162694462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0e415c720 0x7ff0e406f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:45.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.769+0000 7ff0e2ffd640 1 -- 172.21.15.18:0/2162694462 >> v1:172.21.15.18:6789/0 conn(0x7ff0e4073aa0 legacy=0x7ff0e406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:45.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.769+0000 7ff0e27fc640 1 -- 172.21.15.18:0/2162694462 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 641824419 0 0) 0x7ff0dc001490 con 0x7ff0e4073aa0 2024-09-19T09:22:45.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.769+0000 7ff0e2ffd640 1 -- 172.21.15.18:0/2162694462 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e4073f50 con 0x7ff0e4073140 2024-09-19T09:22:45.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.770+0000 7ff0e2ffd640 1 --2- 172.21.15.18:0/2162694462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0e4073140 0x7ff0e4073560 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc0097a0 tx=0x7ff0cc02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d48f1996ab91b37 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:45.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.770+0000 7ff0e27fc640 1 -- 172.21.15.18:0/2162694462 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc037070 con 0x7ff0e4073140 2024-09-19T09:22:45.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.770+0000 7ff0e27fc640 1 -- 172.21.15.18:0/2162694462 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0cc032440 con 0x7ff0e4073140 2024-09-19T09:22:45.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.770+0000 7ff0e27fc640 1 -- 172.21.15.18:0/2162694462 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc032810 con 0x7ff0e4073140 2024-09-19T09:22:45.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.771+0000 7ff0e9f68640 1 -- 172.21.15.18:0/2162694462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0e4073140 msgr2=0x7ff0e4073560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:45.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.771+0000 7ff0e9f68640 1 --2- 172.21.15.18:0/2162694462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0e4073140 0x7ff0e4073560 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc0097a0 tx=0x7ff0cc02a210 comp rx=0 tx=0).stop 2024-09-19T09:22:45.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.771+0000 7ff0e9f68640 1 -- 172.21.15.18:0/2162694462 shutdown_connections 2024-09-19T09:22:45.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.771+0000 7ff0e9f68640 1 --2- 172.21.15.18:0/2162694462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0e4073140 0x7ff0e4073560 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:45.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.771+0000 7ff0e9f68640 1 --2- 172.21.15.18:0/2162694462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0e415c720 0x7ff0e406f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:45.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.771+0000 7ff0e9f68640 1 -- 172.21.15.18:0/2162694462 >> 172.21.15.18:0/2162694462 conn(0x7ff0e40b5eb0 msgr2=0x7ff0e40b6570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:45.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.771+0000 7ff0e9f68640 1 -- 172.21.15.18:0/2162694462 shutdown_connections 2024-09-19T09:22:45.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.771+0000 7ff0e9f68640 1 -- 172.21.15.18:0/2162694462 wait complete. 2024-09-19T09:22:45.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.772+0000 7ff0e9f68640 1 Processor -- start 2024-09-19T09:22:45.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.772+0000 7ff0e9f68640 1 -- start start 2024-09-19T09:22:45.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.773+0000 7ff0e9f68640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0e4073140 0x7ff0e40ae340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:45.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.773+0000 7ff0e9f68640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0e4073aa0 0x7ff0e40af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:45.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.773+0000 7ff0e9f68640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0e415c720 0x7ff0e40b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:45.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.773+0000 7ff0e9f68640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e415f6e0 con 0x7ff0e4073aa0 2024-09-19T09:22:45.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.773+0000 7ff0e9f68640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff0e415f400 con 0x7ff0e4073140 2024-09-19T09:22:45.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.773+0000 7ff0e9f68640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff0e415f0b0 con 0x7ff0e415c720 2024-09-19T09:22:45.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.773+0000 7ff0e2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0e4073aa0 0x7ff0e40af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:45.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.773+0000 7ff0e2ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0e4073aa0 0x7ff0e40af9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50234/0 (socket says 172.21.15.18:50234) 2024-09-19T09:22:45.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.773+0000 7ff0e2ffd640 1 -- 172.21.15.18:0/3225752547 learned_addr learned my addr 172.21.15.18:0/3225752547 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:45.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.774+0000 7ff0e2ffd640 1 -- 172.21.15.18:0/3225752547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0e415c720 msgr2=0x7ff0e40b0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:45.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.774+0000 7ff0e2ffd640 1 --2- 172.21.15.18:0/3225752547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0e415c720 0x7ff0e40b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:45.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.774+0000 7ff0e2ffd640 1 -- 172.21.15.18:0/3225752547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0e4073140 msgr2=0x7ff0e40ae340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:45.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.774+0000 7ff0e2ffd640 1 --2- 172.21.15.18:0/3225752547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0e4073140 0x7ff0e40ae340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:45.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.774+0000 7ff0e2ffd640 1 -- 172.21.15.18:0/3225752547 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0e40aff00 con 0x7ff0e4073aa0 2024-09-19T09:22:45.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.774+0000 7ff0e2ffd640 1 --2- 172.21.15.18:0/3225752547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0e4073aa0 0x7ff0e40af9c0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc0097a0 tx=0x7ff0cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:45.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.774+0000 7ff0dbfff640 1 -- 172.21.15.18:0/3225752547 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc037050 con 0x7ff0e4073aa0 2024-09-19T09:22:45.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.774+0000 7ff0dbfff640 1 -- 172.21.15.18:0/3225752547 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0cc038040 con 0x7ff0e4073aa0 2024-09-19T09:22:45.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.774+0000 7ff0e9f68640 1 -- 172.21.15.18:0/3225752547 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0e40ae920 con 0x7ff0e4073aa0 2024-09-19T09:22:45.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.774+0000 7ff0dbfff640 1 -- 172.21.15.18:0/3225752547 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc004470 con 0x7ff0e4073aa0 2024-09-19T09:22:45.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.774+0000 7ff0e9f68640 1 -- 172.21.15.18:0/3225752547 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0e40af1c0 con 0x7ff0e4073aa0 2024-09-19T09:22:45.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.775+0000 7ff0e9f68640 1 -- 172.21.15.18:0/3225752547 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0e415fee0 con 0x7ff0e4073aa0 2024-09-19T09:22:45.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.775+0000 7ff0dbfff640 1 -- 172.21.15.18:0/3225752547 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff0cc030900 con 0x7ff0e4073aa0 2024-09-19T09:22:45.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.776+0000 7ff0dbfff640 1 --2- 172.21.15.18:0/3225752547 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff0c406c2b0 0x7ff0c406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:45.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.776+0000 7ff0dbfff640 1 -- 172.21.15.18:0/3225752547 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7ff0cc0abe90 con 0x7ff0e4073aa0 2024-09-19T09:22:45.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.776+0000 7ff0dbfff640 1 -- 172.21.15.18:0/3225752547 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=157}) -- 0x7ff0c4073de0 con 0x7ff0e4073aa0 2024-09-19T09:22:45.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.776+0000 7ff0e37fe640 1 --2- 172.21.15.18:0/3225752547 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff0c406c2b0 0x7ff0c406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:45.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.777+0000 7ff0e37fe640 1 --2- 172.21.15.18:0/3225752547 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff0c406c2b0 0x7ff0c406e770 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4006fd0 tx=0x7ff0d4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:45.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.781+0000 7ff0dbfff640 1 -- 172.21.15.18:0/3225752547 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff0cc07a690 con 0x7ff0e4073aa0 2024-09-19T09:22:45.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.969+0000 7ff0e9f68640 1 -- 172.21.15.18:0/3225752547 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff0e4072960 con 0x7ff0e4073aa0 2024-09-19T09:22:45.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.969+0000 7ff0dbfff640 1 -- 172.21.15.18:0/3225752547 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v156) ==== 80+0+0 (secure 0 0 0) 0x7ff0cc079f90 con 0x7ff0e4073aa0 2024-09-19T09:22:45.970 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-09-19T09:22:45.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.971+0000 7ff0e9f68640 1 -- 172.21.15.18:0/3225752547 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff0c406c2b0 msgr2=0x7ff0c406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:45.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.971+0000 7ff0e9f68640 1 --2- 172.21.15.18:0/3225752547 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff0c406c2b0 0x7ff0c406e770 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4006fd0 tx=0x7ff0d4008040 comp rx=0 tx=0).stop 2024-09-19T09:22:45.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.971+0000 7ff0e9f68640 1 -- 172.21.15.18:0/3225752547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0e4073aa0 msgr2=0x7ff0e40af9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:45.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.971+0000 7ff0e9f68640 1 --2- 172.21.15.18:0/3225752547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0e4073aa0 0x7ff0e40af9c0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc0097a0 tx=0x7ff0cc0046c0 comp rx=0 tx=0).stop 2024-09-19T09:22:45.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.971+0000 7ff0e9f68640 1 -- 172.21.15.18:0/3225752547 shutdown_connections 2024-09-19T09:22:45.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.971+0000 7ff0e9f68640 1 --2- 172.21.15.18:0/3225752547 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff0c406c2b0 0x7ff0c406e770 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:45.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.971+0000 7ff0e9f68640 1 --2- 172.21.15.18:0/3225752547 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff0e415c720 0x7ff0e40b0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:45.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.971+0000 7ff0e9f68640 1 --2- 172.21.15.18:0/3225752547 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff0e4073aa0 0x7ff0e40af9c0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:45.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.971+0000 7ff0e9f68640 1 --2- 172.21.15.18:0/3225752547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff0e4073140 0x7ff0e40ae340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:45.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.971+0000 7ff0e9f68640 1 -- 172.21.15.18:0/3225752547 >> 172.21.15.18:0/3225752547 conn(0x7ff0e40b5eb0 msgr2=0x7ff0e409e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:45.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.971+0000 7ff0e9f68640 1 -- 172.21.15.18:0/3225752547 shutdown_connections 2024-09-19T09:22:45.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:45.971+0000 7ff0e9f68640 1 -- 172.21.15.18:0/3225752547 wait complete. 2024-09-19T09:22:45.983 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T09:22:45.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:22:45.983 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-19T09:22:46.013 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T09:22:46.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:22:46.013 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T09:22:46.070 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:22:46.071 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:22:46.071 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:22:46.091 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:22:46.091 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:22:46.150 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T09:22:46.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.252+0000 7f2cffe9b640 1 Processor -- start 2024-09-19T09:22:46.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.252+0000 7f2cffe9b640 1 -- start start 2024-09-19T09:22:46.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.253+0000 7f2cffe9b640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2cf80b7270 0x7f2cf80b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:46.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.253+0000 7f2cffe9b640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cf80b7890 con 0x7f2cf806d730 2024-09-19T09:22:46.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.253+0000 7f2cffe9b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cf80b7b70 con 0x7f2cf80cc7f0 2024-09-19T09:22:46.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.253+0000 7f2cffe9b640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f2cf80cbd10 con 0x7f2cf80b7270 2024-09-19T09:22:46.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.253+0000 7f2cfd436640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2cf80b7270 0x7f2cf80b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:46.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.253+0000 7f2cfdc37640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f2cf806d730 0x7f2cf806db10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56260/0 (socket says 172.21.15.18:56260) 2024-09-19T09:22:46.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.253+0000 7f2cfdc37640 1 -- 172.21.15.18:0/7717533 learned_addr learned my addr 172.21.15.18:0/7717533 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:22:46.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.253+0000 7f2cfd436640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2cf80b7270 0x7f2cf80b6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50248/0 (socket says 172.21.15.18:50248) 2024-09-19T09:22:46.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.253+0000 7f2cfd436640 1 -- 172.21.15.18:0/7717533 >> v1:172.21.15.162:6789/0 conn(0x7f2cf80cc7f0 legacy=0x7f2cf80ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:46.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.253+0000 7f2cfd436640 1 -- 172.21.15.18:0/7717533 >> v1:172.21.15.18:6789/0 conn(0x7f2cf806d730 legacy=0x7f2cf806db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:46.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.253+0000 7f2cfd436640 1 -- 172.21.15.18:0/7717533 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cf80cbff0 con 0x7f2cf80b7270 2024-09-19T09:22:46.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.254+0000 7f2cfd436640 1 --2- 172.21.15.18:0/7717533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2cf80b7270 0x7f2cf80b6290 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80097d0 tx=0x7f2ce802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fdeb44bcca4bcf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:46.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.254+0000 7f2cfcc35640 1 -- 172.21.15.18:0/7717533 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce8037070 con 0x7f2cf80b7270 2024-09-19T09:22:46.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.254+0000 7f2cfcc35640 1 -- 172.21.15.18:0/7717533 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ce8032440 con 0x7f2cf80b7270 2024-09-19T09:22:46.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.254+0000 7f2cfcc35640 1 -- 172.21.15.18:0/7717533 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce8032810 con 0x7f2cf80b7270 2024-09-19T09:22:46.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.255+0000 7f2cffe9b640 1 -- 172.21.15.18:0/7717533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2cf80b7270 msgr2=0x7f2cf80b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:46.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.255+0000 7f2cffe9b640 1 --2- 172.21.15.18:0/7717533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2cf80b7270 0x7f2cf80b6290 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80097d0 tx=0x7f2ce802a210 comp rx=0 tx=0).stop 2024-09-19T09:22:46.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.255+0000 7f2cffe9b640 1 -- 172.21.15.18:0/7717533 shutdown_connections 2024-09-19T09:22:46.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.255+0000 7f2cffe9b640 1 --2- 172.21.15.18:0/7717533 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2cf80b7270 0x7f2cf80b6290 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:46.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.255+0000 7f2cffe9b640 1 -- 172.21.15.18:0/7717533 >> 172.21.15.18:0/7717533 conn(0x7f2cf80b7e10 msgr2=0x7f2cf80b8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:46.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.255+0000 7f2cffe9b640 1 -- 172.21.15.18:0/7717533 shutdown_connections 2024-09-19T09:22:46.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.255+0000 7f2cffe9b640 1 -- 172.21.15.18:0/7717533 wait complete. 2024-09-19T09:22:46.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.256+0000 7f2cffe9b640 1 Processor -- start 2024-09-19T09:22:46.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.256+0000 7f2cffe9b640 1 -- start start 2024-09-19T09:22:46.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.257+0000 7f2cffe9b640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2cf806d730 0x7f2cf81565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:46.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.257+0000 7f2cffe9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cf80b7270 0x7f2cf80b4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:46.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.257+0000 7f2cffe9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2cf80cc7f0 0x7f2cf80b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:46.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.257+0000 7f2cffe9b640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf815efe0 con 0x7f2cf80cc7f0 2024-09-19T09:22:46.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.257+0000 7f2cffe9b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2cf80b4310 con 0x7f2cf80b7270 2024-09-19T09:22:46.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.257+0000 7f2cffe9b640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2cf80cd370 con 0x7f2cf806d730 2024-09-19T09:22:46.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.257+0000 7f2cfe438640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2cf80cc7f0 0x7f2cf80b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:46.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.257+0000 7f2cfe438640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2cf80cc7f0 0x7f2cf80b49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50254/0 (socket says 172.21.15.18:50254) 2024-09-19T09:22:46.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.257+0000 7f2cfe438640 1 -- 172.21.15.18:0/3120213393 learned_addr learned my addr 172.21.15.18:0/3120213393 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:46.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.257+0000 7f2cfd436640 1 --2- 172.21.15.18:0/3120213393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cf80b7270 0x7f2cf80b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:46.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.257+0000 7f2cfe438640 1 -- 172.21.15.18:0/3120213393 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2cf806d730 msgr2=0x7f2cf81565e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:46.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.257+0000 7f2cfe438640 1 --2- 172.21.15.18:0/3120213393 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2cf806d730 0x7f2cf81565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:46.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.257+0000 7f2cfe438640 1 -- 172.21.15.18:0/3120213393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cf80b7270 msgr2=0x7f2cf80b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:46.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.257+0000 7f2cfe438640 1 --2- 172.21.15.18:0/3120213393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cf80b7270 0x7f2cf80b4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:46.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.257+0000 7f2cfe438640 1 -- 172.21.15.18:0/3120213393 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cf8156b20 con 0x7f2cf80cc7f0 2024-09-19T09:22:46.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.258+0000 7f2cfe438640 1 --2- 172.21.15.18:0/3120213393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2cf80cc7f0 0x7f2cf80b49d0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000b970 tx=0x7f2cf000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:46.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.258+0000 7f2cee7fc640 1 -- 172.21.15.18:0/3120213393 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0019070 con 0x7f2cf80cc7f0 2024-09-19T09:22:46.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.258+0000 7f2cee7fc640 1 -- 172.21.15.18:0/3120213393 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cf000cb40 con 0x7f2cf80cc7f0 2024-09-19T09:22:46.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.258+0000 7f2cffe9b640 1 -- 172.21.15.18:0/3120213393 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cf809fba0 con 0x7f2cf80cc7f0 2024-09-19T09:22:46.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.258+0000 7f2cee7fc640 1 -- 172.21.15.18:0/3120213393 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0014440 con 0x7f2cf80cc7f0 2024-09-19T09:22:46.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.258+0000 7f2cffe9b640 1 -- 172.21.15.18:0/3120213393 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cf80a0160 con 0x7f2cf80cc7f0 2024-09-19T09:22:46.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.259+0000 7f2cffe9b640 1 -- 172.21.15.18:0/3120213393 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cf80cd730 con 0x7f2cf80cc7f0 2024-09-19T09:22:46.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.259+0000 7f2cee7fc640 1 -- 172.21.15.18:0/3120213393 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2cf001c070 con 0x7f2cf80cc7f0 2024-09-19T09:22:46.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.260+0000 7f2cee7fc640 1 --2- 172.21.15.18:0/3120213393 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2cdc06c2b0 0x7f2cdc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:46.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.260+0000 7f2cee7fc640 1 -- 172.21.15.18:0/3120213393 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f2cf008b1d0 con 0x7f2cf80cc7f0 2024-09-19T09:22:46.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.260+0000 7f2cfdc37640 1 --2- 172.21.15.18:0/3120213393 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2cdc06c2b0 0x7f2cdc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:46.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.260+0000 7f2cee7fc640 1 -- 172.21.15.18:0/3120213393 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=157}) -- 0x7f2cdc073de0 con 0x7f2cf80cc7f0 2024-09-19T09:22:46.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.260+0000 7f2cfdc37640 1 --2- 172.21.15.18:0/3120213393 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2cdc06c2b0 0x7f2cdc06e770 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4000f60 tx=0x7f2cf4007a80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:46.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.264+0000 7f2cee7fc640 1 -- 172.21.15.18:0/3120213393 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2cf00598b0 con 0x7f2cf80cc7f0 2024-09-19T09:22:46.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.455+0000 7f2cffe9b640 1 -- 172.21.15.18:0/3120213393 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2cf8073970 con 0x7f2cf80cc7f0 2024-09-19T09:22:46.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.455+0000 7f2cee7fc640 1 -- 172.21.15.18:0/3120213393 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v156) ==== 80+0+0 (secure 0 0 0) 0x7f2cf00591b0 con 0x7f2cf80cc7f0 2024-09-19T09:22:46.456 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-09-19T09:22:46.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.457+0000 7f2cffe9b640 1 -- 172.21.15.18:0/3120213393 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2cdc06c2b0 msgr2=0x7f2cdc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:46.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.457+0000 7f2cffe9b640 1 --2- 172.21.15.18:0/3120213393 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2cdc06c2b0 0x7f2cdc06e770 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4000f60 tx=0x7f2cf4007a80 comp rx=0 tx=0).stop 2024-09-19T09:22:46.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.457+0000 7f2cffe9b640 1 -- 172.21.15.18:0/3120213393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2cf80cc7f0 msgr2=0x7f2cf80b49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:46.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.457+0000 7f2cffe9b640 1 --2- 172.21.15.18:0/3120213393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2cf80cc7f0 0x7f2cf80b49d0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000b970 tx=0x7f2cf000be30 comp rx=0 tx=0).stop 2024-09-19T09:22:46.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.457+0000 7f2cffe9b640 1 -- 172.21.15.18:0/3120213393 shutdown_connections 2024-09-19T09:22:46.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.457+0000 7f2cffe9b640 1 --2- 172.21.15.18:0/3120213393 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2cdc06c2b0 0x7f2cdc06e770 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:46.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.457+0000 7f2cffe9b640 1 --2- 172.21.15.18:0/3120213393 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2cf80cc7f0 0x7f2cf80b49d0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:46.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.457+0000 7f2cffe9b640 1 --2- 172.21.15.18:0/3120213393 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2cf80b7270 0x7f2cf80b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:46.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.457+0000 7f2cffe9b640 1 --2- 172.21.15.18:0/3120213393 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2cf806d730 0x7f2cf81565e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:46.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.457+0000 7f2cffe9b640 1 -- 172.21.15.18:0/3120213393 >> 172.21.15.18:0/3120213393 conn(0x7f2cf80b7e10 msgr2=0x7f2cf806db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:46.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.457+0000 7f2cffe9b640 1 -- 172.21.15.18:0/3120213393 shutdown_connections 2024-09-19T09:22:46.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.457+0000 7f2cffe9b640 1 -- 172.21.15.18:0/3120213393 wait complete. 2024-09-19T09:22:46.469 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-19T09:22:46.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:22:46.469 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-19T09:22:46.502 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-09-19T09:22:46.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:22:46.503 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-19T09:22:46.561 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:22:46.561 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:22:46.562 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:22:46.578 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17075 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T09:22:46.578 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:22:46.578 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:22:46.578 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:22:46.620 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3252 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T09:22:46.620 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:22:46.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.721+0000 7f21ebc1e640 1 Processor -- start 2024-09-19T09:22:46.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.722+0000 7f21ebc1e640 1 -- start start 2024-09-19T09:22:46.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.722+0000 7f21ebc1e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21e40d1ab0 0x7f21e40b8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:46.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.722+0000 7f21ebc1e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f21e40d3240 0x7f21e40b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:46.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.722+0000 7f21ebc1e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21e40b7a90 con 0x7f21e415ef50 2024-09-19T09:22:46.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.722+0000 7f21ebc1e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f21e40d3740 con 0x7f21e40d3240 2024-09-19T09:22:46.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.722+0000 7f21ebc1e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f21e40d3a20 con 0x7f21e40d1ab0 2024-09-19T09:22:46.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.723+0000 7f21e91b9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21e40d1ab0 0x7f21e40b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:46.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.723+0000 7f21ea1bb640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f21e40d3240 0x7f21e40b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:46.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.723+0000 7f21e99ba640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f21e415ef50 0x7f21e40d13a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:50086/0 (socket says 172.21.15.18:50086) 2024-09-19T09:22:46.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.723+0000 7f21e91b9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21e40d1ab0 0x7f21e40b8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:37390/0 (socket says 172.21.15.18:37390) 2024-09-19T09:22:46.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.723+0000 7f21e99ba640 1 -- 172.21.15.18:0/3553565779 learned_addr learned my addr 172.21.15.18:0/3553565779 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:22:46.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.723+0000 7f21e91b9640 1 -- 172.21.15.18:0/3553565779 >> v2:172.21.15.162:3300/0 conn(0x7f21e40d3240 msgr2=0x7f21e40b8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:46.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.723+0000 7f21e91b9640 1 --2- 172.21.15.18:0/3553565779 >> v2:172.21.15.162:3300/0 conn(0x7f21e40d3240 0x7f21e40b8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:46.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.723+0000 7f21e91b9640 1 -- 172.21.15.18:0/3553565779 >> v1:172.21.15.162:6789/0 conn(0x7f21e415ef50 legacy=0x7f21e40d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:46.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.723+0000 7f21e89b8640 1 -- 172.21.15.18:0/3553565779 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1810411897 0 0) 0x7f21e40b7a90 con 0x7f21e415ef50 2024-09-19T09:22:46.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.723+0000 7f21e91b9640 1 -- 172.21.15.18:0/3553565779 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e40b7d00 con 0x7f21e40d1ab0 2024-09-19T09:22:46.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.723+0000 7f21ea1bb640 1 --2- 172.21.15.18:0/3553565779 >> v2:172.21.15.162:3300/0 conn(0x7f21e40d3240 0x7f21e40b8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:22:46.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.724+0000 7f21e91b9640 1 --2- 172.21.15.18:0/3553565779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21e40d1ab0 0x7f21e40b8500 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f21d40097a0 tx=0x7f21d402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e072e135aa7ac97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:46.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.724+0000 7f21e89b8640 1 -- 172.21.15.18:0/3553565779 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d4037070 con 0x7f21e40d1ab0 2024-09-19T09:22:46.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.724+0000 7f21e89b8640 1 -- 172.21.15.18:0/3553565779 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21d402ae50 con 0x7f21e40d1ab0 2024-09-19T09:22:46.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.725+0000 7f21e89b8640 1 -- 172.21.15.18:0/3553565779 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d4032660 con 0x7f21e40d1ab0 2024-09-19T09:22:46.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.725+0000 7f21ebc1e640 1 -- 172.21.15.18:0/3553565779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21e40d1ab0 msgr2=0x7f21e40b8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:46.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.725+0000 7f21ebc1e640 1 --2- 172.21.15.18:0/3553565779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21e40d1ab0 0x7f21e40b8500 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f21d40097a0 tx=0x7f21d402a100 comp rx=0 tx=0).stop 2024-09-19T09:22:46.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.725+0000 7f21ebc1e640 1 -- 172.21.15.18:0/3553565779 shutdown_connections 2024-09-19T09:22:46.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.725+0000 7f21ebc1e640 1 --2- 172.21.15.18:0/3553565779 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21e40d1ab0 0x7f21e40b8500 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:46.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.725+0000 7f21ebc1e640 1 --2- 172.21.15.18:0/3553565779 >> v2:172.21.15.162:3300/0 conn(0x7f21e40d3240 0x7f21e40b8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:46.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.725+0000 7f21ebc1e640 1 -- 172.21.15.18:0/3553565779 >> 172.21.15.18:0/3553565779 conn(0x7f21e40d4c60 msgr2=0x7f21e40d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:46.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.725+0000 7f21ebc1e640 1 -- 172.21.15.18:0/3553565779 shutdown_connections 2024-09-19T09:22:46.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.725+0000 7f21ebc1e640 1 -- 172.21.15.18:0/3553565779 wait complete. 2024-09-19T09:22:46.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.726+0000 7f21ebc1e640 1 Processor -- start 2024-09-19T09:22:46.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.727+0000 7f21ebc1e640 1 -- start start 2024-09-19T09:22:46.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.727+0000 7f21ebc1e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21e40d1ab0 0x7f21e4157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:46.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.727+0000 7f21ebc1e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21e40d3240 0x7f21e40cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:46.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.727+0000 7f21ebc1e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21e415ef50 0x7f21e40ce440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:46.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.727+0000 7f21ebc1e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f21e40d21a0 con 0x7f21e40d1ab0 2024-09-19T09:22:46.729 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.727+0000 7f21ebc1e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f21e40d2020 con 0x7f21e40d3240 2024-09-19T09:22:46.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.727+0000 7f21ebc1e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f21e40d5780 con 0x7f21e415ef50 2024-09-19T09:22:46.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.727+0000 7f21e99ba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21e40d1ab0 0x7f21e4157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:46.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.727+0000 7f21e99ba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21e40d1ab0 0x7f21e4157ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50264/0 (socket says 172.21.15.18:50264) 2024-09-19T09:22:46.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.727+0000 7f21e99ba640 1 -- 172.21.15.18:0/2872681718 learned_addr learned my addr 172.21.15.18:0/2872681718 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:46.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.728+0000 7f21ea1bb640 1 --2- 172.21.15.18:0/2872681718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21e415ef50 0x7f21e40ce440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:46.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.728+0000 7f21e91b9640 1 --2- 172.21.15.18:0/2872681718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21e40d3240 0x7f21e40cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:46.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.728+0000 7f21e99ba640 1 -- 172.21.15.18:0/2872681718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21e415ef50 msgr2=0x7f21e40ce440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:46.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.728+0000 7f21e99ba640 1 --2- 172.21.15.18:0/2872681718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21e415ef50 0x7f21e40ce440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:46.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.728+0000 7f21e99ba640 1 -- 172.21.15.18:0/2872681718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21e40d3240 msgr2=0x7f21e40cdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:46.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.728+0000 7f21e99ba640 1 --2- 172.21.15.18:0/2872681718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21e40d3240 0x7f21e40cdf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:46.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.728+0000 7f21e99ba640 1 -- 172.21.15.18:0/2872681718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e4162530 con 0x7f21e40d1ab0 2024-09-19T09:22:46.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.728+0000 7f21e99ba640 1 --2- 172.21.15.18:0/2872681718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21e40d1ab0 0x7f21e4157ab0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f21e000c430 tx=0x7f21e000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:46.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.728+0000 7f21da7fc640 1 -- 172.21.15.18:0/2872681718 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e00074e0 con 0x7f21e40d1ab0 2024-09-19T09:22:46.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.728+0000 7f21da7fc640 1 -- 172.21.15.18:0/2872681718 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21e00047e0 con 0x7f21e40d1ab0 2024-09-19T09:22:46.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.728+0000 7f21ebc1e640 1 -- 172.21.15.18:0/2872681718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21e4161f70 con 0x7f21e40d1ab0 2024-09-19T09:22:46.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.728+0000 7f21da7fc640 1 -- 172.21.15.18:0/2872681718 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21e0004bd0 con 0x7f21e40d1ab0 2024-09-19T09:22:46.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.728+0000 7f21ebc1e640 1 -- 172.21.15.18:0/2872681718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21e40c8400 con 0x7f21e40d1ab0 2024-09-19T09:22:46.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.729+0000 7f21ebc1e640 1 -- 172.21.15.18:0/2872681718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21e40d0280 con 0x7f21e40d1ab0 2024-09-19T09:22:46.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.730+0000 7f21da7fc640 1 -- 172.21.15.18:0/2872681718 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f21e0011070 con 0x7f21e40d1ab0 2024-09-19T09:22:46.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.730+0000 7f21da7fc640 1 --2- 172.21.15.18:0/2872681718 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f21c806c2b0 0x7f21c806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:46.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.730+0000 7f21da7fc640 1 -- 172.21.15.18:0/2872681718 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f21e008af60 con 0x7f21e40d1ab0 2024-09-19T09:22:46.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.730+0000 7f21da7fc640 1 -- 172.21.15.18:0/2872681718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=157}) -- 0x7f21c8073de0 con 0x7f21e40d1ab0 2024-09-19T09:22:46.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.731+0000 7f21e91b9640 1 --2- 172.21.15.18:0/2872681718 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f21c806c2b0 0x7f21c806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:46.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.731+0000 7f21e91b9640 1 --2- 172.21.15.18:0/2872681718 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f21c806c2b0 0x7f21c806e770 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f21d4034000 tx=0x7f21d402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:46.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.735+0000 7f21da7fc640 1 -- 172.21.15.18:0/2872681718 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f21e40d0280 con 0x7f21e40d1ab0 2024-09-19T09:22:46.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.955+0000 7f21ebc1e640 1 -- 172.21.15.18:0/2872681718 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f21e40d0490 con 0x7f21e40d1ab0 2024-09-19T09:22:46.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.956+0000 7f21da7fc640 1 -- 172.21.15.18:0/2872681718 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+5225 (secure 0 0 0) 0x7f21e40d0490 con 0x7f21e40d1ab0 2024-09-19T09:22:46.957 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:22:46.957 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":65,"btime":"2024-09-19T09:20:38:235364+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6044,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2661639901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2661639901},{"type":"v1","addr":"172.21.15.162:6836","nonce":2661639901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":7221,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/56318264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":56318264},{"type":"v1","addr":"172.21.15.18:6833","nonce":56318264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":7239,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1783371939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1783371939},{"type":"v1","addr":"172.21.15.162:6837","nonce":1783371939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:20:35.068097+0000","modified":"2024-09-19T09:20:37.584812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7245":{"gid":7245,"name":"a","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/1201598209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1201598209},{"type":"v1","addr":"172.21.15.18:6835","nonce":1201598209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7245,"qdb_cluster":[7245]},"id":9}]} 2024-09-19T09:22:46.957 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 65 2024-09-19T09:22:46.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.958+0000 7f21ebc1e640 1 -- 172.21.15.18:0/2872681718 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f21c806c2b0 msgr2=0x7f21c806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:46.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.958+0000 7f21ebc1e640 1 --2- 172.21.15.18:0/2872681718 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f21c806c2b0 0x7f21c806e770 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f21d4034000 tx=0x7f21d402e000 comp rx=0 tx=0).stop 2024-09-19T09:22:46.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.958+0000 7f21ebc1e640 1 -- 172.21.15.18:0/2872681718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21e40d1ab0 msgr2=0x7f21e4157ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:46.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.958+0000 7f21ebc1e640 1 --2- 172.21.15.18:0/2872681718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21e40d1ab0 0x7f21e4157ab0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f21e000c430 tx=0x7f21e000c830 comp rx=0 tx=0).stop 2024-09-19T09:22:46.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.958+0000 7f21ebc1e640 1 -- 172.21.15.18:0/2872681718 shutdown_connections 2024-09-19T09:22:46.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.958+0000 7f21ebc1e640 1 --2- 172.21.15.18:0/2872681718 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f21c806c2b0 0x7f21c806e770 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:46.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.958+0000 7f21ebc1e640 1 --2- 172.21.15.18:0/2872681718 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f21e415ef50 0x7f21e40ce440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:46.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.958+0000 7f21ebc1e640 1 --2- 172.21.15.18:0/2872681718 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f21e40d3240 0x7f21e40cdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:46.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.958+0000 7f21ebc1e640 1 --2- 172.21.15.18:0/2872681718 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f21e40d1ab0 0x7f21e4157ab0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:46.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.958+0000 7f21ebc1e640 1 -- 172.21.15.18:0/2872681718 >> 172.21.15.18:0/2872681718 conn(0x7f21e40d4c60 msgr2=0x7f21e406dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:46.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.958+0000 7f21ebc1e640 1 -- 172.21.15.18:0/2872681718 shutdown_connections 2024-09-19T09:22:46.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:46.958+0000 7f21ebc1e640 1 -- 172.21.15.18:0/2872681718 wait complete. 2024-09-19T09:22:46.970 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:22:47.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.071+0000 7f4c85549640 1 Processor -- start 2024-09-19T09:22:47.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.071+0000 7f4c85549640 1 -- start start 2024-09-19T09:22:47.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.072+0000 7f4c85549640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4c8015ef80 0x7f4c800b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.072+0000 7f4c85549640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c800cd1a0 con 0x7f4c8006d730 2024-09-19T09:22:47.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.072+0000 7f4c85549640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c8006dc30 con 0x7f4c800cfae0 2024-09-19T09:22:47.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.072+0000 7f4c85549640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f4c800cd7d0 con 0x7f4c8015ef80 2024-09-19T09:22:47.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.072+0000 7f4c7effd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4c8015ef80 0x7f4c800b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.072+0000 7f4c7e7fc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f4c8006d730 0x7f4c800cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56262/0 (socket says 172.21.15.18:56262) 2024-09-19T09:22:47.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.072+0000 7f4c7effd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4c8015ef80 0x7f4c800b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50270/0 (socket says 172.21.15.18:50270) 2024-09-19T09:22:47.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.072+0000 7f4c7e7fc640 1 -- 172.21.15.18:0/2111050996 learned_addr learned my addr 172.21.15.18:0/2111050996 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:22:47.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.072+0000 7f4c7effd640 1 -- 172.21.15.18:0/2111050996 >> v1:172.21.15.162:6789/0 conn(0x7f4c800cfae0 legacy=0x7f4c800cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:47.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.072+0000 7f4c7effd640 1 -- 172.21.15.18:0/2111050996 >> v1:172.21.15.18:6789/0 conn(0x7f4c8006d730 legacy=0x7f4c800cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.072+0000 7f4c7effd640 1 -- 172.21.15.18:0/2111050996 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c8006df10 con 0x7f4c8015ef80 2024-09-19T09:22:47.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.072+0000 7f4c7dffb640 1 -- 172.21.15.18:0/2111050996 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2620451762 0 0) 0x7f4c800cd1a0 con 0x7f4c8006d730 2024-09-19T09:22:47.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.073+0000 7f4c7effd640 1 --2- 172.21.15.18:0/2111050996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c8015ef80 0x7f4c800b5220 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f4c700097a0 tx=0x7f4c7002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26962eda0166547 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:47.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.073+0000 7f4c7dffb640 1 -- 172.21.15.18:0/2111050996 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70037070 con 0x7f4c8015ef80 2024-09-19T09:22:47.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.073+0000 7f4c7dffb640 1 -- 172.21.15.18:0/2111050996 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c70032440 con 0x7f4c8015ef80 2024-09-19T09:22:47.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.073+0000 7f4c7dffb640 1 -- 172.21.15.18:0/2111050996 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70032810 con 0x7f4c8015ef80 2024-09-19T09:22:47.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.074+0000 7f4c85549640 1 -- 172.21.15.18:0/2111050996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c8015ef80 msgr2=0x7f4c800b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.074+0000 7f4c85549640 1 --2- 172.21.15.18:0/2111050996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c8015ef80 0x7f4c800b5220 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f4c700097a0 tx=0x7f4c7002a1e0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.074+0000 7f4c85549640 1 -- 172.21.15.18:0/2111050996 shutdown_connections 2024-09-19T09:22:47.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.074+0000 7f4c85549640 1 --2- 172.21.15.18:0/2111050996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c8015ef80 0x7f4c800b5220 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.074+0000 7f4c85549640 1 -- 172.21.15.18:0/2111050996 >> 172.21.15.18:0/2111050996 conn(0x7f4c800b4700 msgr2=0x7f4c800b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:47.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.074+0000 7f4c85549640 1 -- 172.21.15.18:0/2111050996 shutdown_connections 2024-09-19T09:22:47.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.074+0000 7f4c85549640 1 -- 172.21.15.18:0/2111050996 wait complete. 2024-09-19T09:22:47.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.075+0000 7f4c85549640 1 Processor -- start 2024-09-19T09:22:47.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.075+0000 7f4c85549640 1 -- start start 2024-09-19T09:22:47.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.076+0000 7f4c85549640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c8006d730 0x7f4c800cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.076+0000 7f4c85549640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c800cfae0 0x7f4c800cc860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.076+0000 7f4c85549640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c8015ef80 0x7f4c80157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.076+0000 7f4c85549640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4c800d0120 con 0x7f4c8006d730 2024-09-19T09:22:47.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.076+0000 7f4c85549640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8015f360 con 0x7f4c8015ef80 2024-09-19T09:22:47.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.076+0000 7f4c85549640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4c800ce370 con 0x7f4c800cfae0 2024-09-19T09:22:47.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.076+0000 7f4c7effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c8006d730 0x7f4c800cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.076+0000 7f4c7effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c8006d730 0x7f4c800cc320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50282/0 (socket says 172.21.15.18:50282) 2024-09-19T09:22:47.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.076+0000 7f4c7effd640 1 -- 172.21.15.18:0/2541804031 learned_addr learned my addr 172.21.15.18:0/2541804031 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:47.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.076+0000 7f4c7f7fe640 1 --2- 172.21.15.18:0/2541804031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c8015ef80 0x7f4c80157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.076+0000 7f4c7effd640 1 -- 172.21.15.18:0/2541804031 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c800cfae0 msgr2=0x7f4c800cc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.076+0000 7f4c7effd640 1 --2- 172.21.15.18:0/2541804031 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c800cfae0 0x7f4c800cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.076+0000 7f4c7effd640 1 -- 172.21.15.18:0/2541804031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c8015ef80 msgr2=0x7f4c80157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.076+0000 7f4c7effd640 1 --2- 172.21.15.18:0/2541804031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c8015ef80 0x7f4c80157bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.076+0000 7f4c7effd640 1 -- 172.21.15.18:0/2541804031 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c80158e70 con 0x7f4c8006d730 2024-09-19T09:22:47.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.077+0000 7f4c7effd640 1 --2- 172.21.15.18:0/2541804031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c8006d730 0x7f4c800cc320 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f4c70000c00 tx=0x7f4c700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:47.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.077+0000 7f4c677fe640 1 -- 172.21.15.18:0/2541804031 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70041070 con 0x7f4c8006d730 2024-09-19T09:22:47.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.077+0000 7f4c677fe640 1 -- 172.21.15.18:0/2541804031 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c7003c930 con 0x7f4c8006d730 2024-09-19T09:22:47.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.077+0000 7f4c85549640 1 -- 172.21.15.18:0/2541804031 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c8015b200 con 0x7f4c8006d730 2024-09-19T09:22:47.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.077+0000 7f4c677fe640 1 -- 172.21.15.18:0/2541804031 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70037040 con 0x7f4c8006d730 2024-09-19T09:22:47.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.077+0000 7f4c85549640 1 -- 172.21.15.18:0/2541804031 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c8015b7c0 con 0x7f4c8006d730 2024-09-19T09:22:47.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.078+0000 7f4c85549640 1 -- 172.21.15.18:0/2541804031 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c800ca0c0 con 0x7f4c8006d730 2024-09-19T09:22:47.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.078+0000 7f4c677fe640 1 -- 172.21.15.18:0/2541804031 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4c70044070 con 0x7f4c8006d730 2024-09-19T09:22:47.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.079+0000 7f4c677fe640 1 --2- 172.21.15.18:0/2541804031 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4c6c06c2b0 0x7f4c6c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.079+0000 7f4c677fe640 1 -- 172.21.15.18:0/2541804031 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f4c700ac1e0 con 0x7f4c8006d730 2024-09-19T09:22:47.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.079+0000 7f4c7e7fc640 1 --2- 172.21.15.18:0/2541804031 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4c6c06c2b0 0x7f4c6c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.079+0000 7f4c677fe640 1 -- 172.21.15.18:0/2541804031 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=157}) -- 0x7f4c6c073de0 con 0x7f4c8006d730 2024-09-19T09:22:47.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.080+0000 7f4c7e7fc640 1 --2- 172.21.15.18:0/2541804031 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4c6c06c2b0 0x7f4c6c06e770 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4c74007fd0 tx=0x7f4c74007920 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:47.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.083+0000 7f4c677fe640 1 -- 172.21.15.18:0/2541804031 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f4c80158e70 con 0x7f4c8006d730 2024-09-19T09:22:47.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.294+0000 7f4c85549640 1 -- 172.21.15.18:0/2541804031 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c800cff00 con 0x7f4c8006d730 2024-09-19T09:22:47.296 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.295+0000 7f4c677fe640 1 -- 172.21.15.18:0/2541804031 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+5225 (secure 0 0 0) 0x7f4c7007ab00 con 0x7f4c8006d730 2024-09-19T09:22:47.296 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:22:47.296 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":65,"btime":"2024-09-19T09:20:38:235364+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6044,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2661639901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2661639901},{"type":"v1","addr":"172.21.15.162:6836","nonce":2661639901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":7221,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/56318264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":56318264},{"type":"v1","addr":"172.21.15.18:6833","nonce":56318264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":7239,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1783371939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1783371939},{"type":"v1","addr":"172.21.15.162:6837","nonce":1783371939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:20:35.068097+0000","modified":"2024-09-19T09:20:37.584812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7245":{"gid":7245,"name":"a","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/1201598209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1201598209},{"type":"v1","addr":"172.21.15.18:6835","nonce":1201598209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7245,"qdb_cluster":[7245]},"id":9}]} 2024-09-19T09:22:47.296 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 65 2024-09-19T09:22:47.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.297+0000 7f4c85549640 1 -- 172.21.15.18:0/2541804031 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4c6c06c2b0 msgr2=0x7f4c6c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.297+0000 7f4c85549640 1 --2- 172.21.15.18:0/2541804031 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4c6c06c2b0 0x7f4c6c06e770 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f4c74007fd0 tx=0x7f4c74007920 comp rx=0 tx=0).stop 2024-09-19T09:22:47.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.297+0000 7f4c85549640 1 -- 172.21.15.18:0/2541804031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c8006d730 msgr2=0x7f4c800cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.297+0000 7f4c85549640 1 --2- 172.21.15.18:0/2541804031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c8006d730 0x7f4c800cc320 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f4c70000c00 tx=0x7f4c700046c0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.297+0000 7f4c85549640 1 -- 172.21.15.18:0/2541804031 shutdown_connections 2024-09-19T09:22:47.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.297+0000 7f4c85549640 1 --2- 172.21.15.18:0/2541804031 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4c6c06c2b0 0x7f4c6c06e770 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.297+0000 7f4c85549640 1 --2- 172.21.15.18:0/2541804031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c8015ef80 0x7f4c80157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.297+0000 7f4c85549640 1 --2- 172.21.15.18:0/2541804031 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4c800cfae0 0x7f4c800cc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.297+0000 7f4c85549640 1 --2- 172.21.15.18:0/2541804031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4c8006d730 0x7f4c800cc320 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.297+0000 7f4c85549640 1 -- 172.21.15.18:0/2541804031 >> 172.21.15.18:0/2541804031 conn(0x7f4c800b4700 msgr2=0x7f4c800d34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:47.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.297+0000 7f4c85549640 1 -- 172.21.15.18:0/2541804031 shutdown_connections 2024-09-19T09:22:47.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.297+0000 7f4c85549640 1 -- 172.21.15.18:0/2541804031 wait complete. 2024-09-19T09:22:47.309 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:22:47.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.410+0000 7fd6857e4640 1 Processor -- start 2024-09-19T09:22:47.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.411+0000 7fd6857e4640 1 -- start start 2024-09-19T09:22:47.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.411+0000 7fd6857e4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd6800d1ab0 0x7fd6800b8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.411+0000 7fd6857e4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6800d3240 0x7fd6800b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.411+0000 7fd6857e4640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6800b7a90 con 0x7fd68015ef50 2024-09-19T09:22:47.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.411+0000 7fd6857e4640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fd6800d3740 con 0x7fd6800d1ab0 2024-09-19T09:22:47.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.411+0000 7fd6857e4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd6800d3a20 con 0x7fd6800d3240 2024-09-19T09:22:47.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.412+0000 7fd67e7fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd6800d1ab0 0x7fd6800b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.412+0000 7fd67e7fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd6800d1ab0 0x7fd6800b8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50288/0 (socket says 172.21.15.18:50288) 2024-09-19T09:22:47.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.412+0000 7fd67effd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd68015ef50 0x7fd6800d13a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56266/0 (socket says 172.21.15.18:56266) 2024-09-19T09:22:47.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.412+0000 7fd67e7fc640 1 -- 172.21.15.18:0/50762897 learned_addr learned my addr 172.21.15.18:0/50762897 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:47.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.412+0000 7fd67e7fc640 1 -- 172.21.15.18:0/50762897 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6800d3240 msgr2=0x7fd6800b8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:47.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.412+0000 7fd67f7fe640 1 --2- 172.21.15.18:0/50762897 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6800d3240 0x7fd6800b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.412+0000 7fd67e7fc640 1 --2- 172.21.15.18:0/50762897 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6800d3240 0x7fd6800b8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.412+0000 7fd67dffb640 1 -- 172.21.15.18:0/50762897 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 390863380 0 0) 0x7fd6800b7a90 con 0x7fd68015ef50 2024-09-19T09:22:47.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.412+0000 7fd67e7fc640 1 -- 172.21.15.18:0/50762897 >> v1:172.21.15.18:6789/0 conn(0x7fd68015ef50 legacy=0x7fd6800d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.412+0000 7fd67e7fc640 1 -- 172.21.15.18:0/50762897 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6800b7d00 con 0x7fd6800d1ab0 2024-09-19T09:22:47.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.412+0000 7fd67f7fe640 1 --2- 172.21.15.18:0/50762897 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6800d3240 0x7fd6800b8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:22:47.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.413+0000 7fd67e7fc640 1 --2- 172.21.15.18:0/50762897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6800d1ab0 0x7fd6800b8500 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fd668009870 tx=0x7fd66802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a6d69fd60e5493 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:47.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.413+0000 7fd67dffb640 1 -- 172.21.15.18:0/50762897 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd668037070 con 0x7fd6800d1ab0 2024-09-19T09:22:47.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.413+0000 7fd67dffb640 1 -- 172.21.15.18:0/50762897 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd668032440 con 0x7fd6800d1ab0 2024-09-19T09:22:47.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.413+0000 7fd67dffb640 1 -- 172.21.15.18:0/50762897 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd668032810 con 0x7fd6800d1ab0 2024-09-19T09:22:47.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.413+0000 7fd6857e4640 1 -- 172.21.15.18:0/50762897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6800d1ab0 msgr2=0x7fd6800b8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.413+0000 7fd6857e4640 1 --2- 172.21.15.18:0/50762897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6800d1ab0 0x7fd6800b8500 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fd668009870 tx=0x7fd66802a1c0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.413+0000 7fd6857e4640 1 -- 172.21.15.18:0/50762897 shutdown_connections 2024-09-19T09:22:47.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.413+0000 7fd6857e4640 1 --2- 172.21.15.18:0/50762897 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6800d3240 0x7fd6800b8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.413+0000 7fd6857e4640 1 --2- 172.21.15.18:0/50762897 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6800d1ab0 0x7fd6800b8500 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.413+0000 7fd6857e4640 1 -- 172.21.15.18:0/50762897 >> 172.21.15.18:0/50762897 conn(0x7fd6800d4c60 msgr2=0x7fd6800d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:47.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.413+0000 7fd6857e4640 1 -- 172.21.15.18:0/50762897 shutdown_connections 2024-09-19T09:22:47.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.413+0000 7fd6857e4640 1 -- 172.21.15.18:0/50762897 wait complete. 2024-09-19T09:22:47.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.415+0000 7fd6857e4640 1 Processor -- start 2024-09-19T09:22:47.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.415+0000 7fd6857e4640 1 -- start start 2024-09-19T09:22:47.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.415+0000 7fd6857e4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6800d1ab0 0x7fd680154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.415+0000 7fd6857e4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6800d3240 0x7fd6800cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.415+0000 7fd6857e4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd68015ef50 0x7fd680160c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.415+0000 7fd6857e4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd6800d21a0 con 0x7fd68015ef50 2024-09-19T09:22:47.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.415+0000 7fd6857e4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd6800d2020 con 0x7fd6800d1ab0 2024-09-19T09:22:47.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.415+0000 7fd6857e4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd6800d5780 con 0x7fd6800d3240 2024-09-19T09:22:47.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.416+0000 7fd67f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd68015ef50 0x7fd680160c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.416+0000 7fd67f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd68015ef50 0x7fd680160c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50296/0 (socket says 172.21.15.18:50296) 2024-09-19T09:22:47.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.416+0000 7fd67f7fe640 1 -- 172.21.15.18:0/1357269037 learned_addr learned my addr 172.21.15.18:0/1357269037 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:47.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.416+0000 7fd67e7fc640 1 --2- 172.21.15.18:0/1357269037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6800d3240 0x7fd6800cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.416+0000 7fd67effd640 1 --2- 172.21.15.18:0/1357269037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6800d1ab0 0x7fd680154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.416+0000 7fd67f7fe640 1 -- 172.21.15.18:0/1357269037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6800d3240 msgr2=0x7fd6800cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.416+0000 7fd67f7fe640 1 --2- 172.21.15.18:0/1357269037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6800d3240 0x7fd6800cd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.416+0000 7fd67f7fe640 1 -- 172.21.15.18:0/1357269037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6800d1ab0 msgr2=0x7fd680154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.416+0000 7fd67f7fe640 1 --2- 172.21.15.18:0/1357269037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6800d1ab0 0x7fd680154fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.416+0000 7fd67f7fe640 1 -- 172.21.15.18:0/1357269037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd680161440 con 0x7fd68015ef50 2024-09-19T09:22:47.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.416+0000 7fd67f7fe640 1 --2- 172.21.15.18:0/1357269037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd68015ef50 0x7fd680160c10 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fd67800c7f0 tx=0x7fd67800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:47.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.416+0000 7fd6777fe640 1 -- 172.21.15.18:0/1357269037 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd678015070 con 0x7fd68015ef50 2024-09-19T09:22:47.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.416+0000 7fd6777fe640 1 -- 172.21.15.18:0/1357269037 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd678007820 con 0x7fd68015ef50 2024-09-19T09:22:47.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.416+0000 7fd6857e4640 1 -- 172.21.15.18:0/1357269037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd680161720 con 0x7fd68015ef50 2024-09-19T09:22:47.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.416+0000 7fd6777fe640 1 -- 172.21.15.18:0/1357269037 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd678007c10 con 0x7fd68015ef50 2024-09-19T09:22:47.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.416+0000 7fd6857e4640 1 -- 172.21.15.18:0/1357269037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd680161ce0 con 0x7fd68015ef50 2024-09-19T09:22:47.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.417+0000 7fd6857e4640 1 -- 172.21.15.18:0/1357269037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6800d13a0 con 0x7fd68015ef50 2024-09-19T09:22:47.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.418+0000 7fd6777fe640 1 -- 172.21.15.18:0/1357269037 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd678018070 con 0x7fd68015ef50 2024-09-19T09:22:47.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.418+0000 7fd6777fe640 1 --2- 172.21.15.18:0/1357269037 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd66006c2b0 0x7fd66006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.418+0000 7fd6777fe640 1 -- 172.21.15.18:0/1357269037 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7fd67808b480 con 0x7fd68015ef50 2024-09-19T09:22:47.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.418+0000 7fd67effd640 1 --2- 172.21.15.18:0/1357269037 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd66006c2b0 0x7fd66006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.418+0000 7fd6777fe640 1 -- 172.21.15.18:0/1357269037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=157}) -- 0x7fd660073de0 con 0x7fd68015ef50 2024-09-19T09:22:47.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.419+0000 7fd67effd640 1 --2- 172.21.15.18:0/1357269037 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd66006c2b0 0x7fd66006e770 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd6700012e0 tx=0x7fd670001630 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:47.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.422+0000 7fd6777fe640 1 -- 172.21.15.18:0/1357269037 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd678059630 con 0x7fd68015ef50 2024-09-19T09:22:47.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.600+0000 7fd6857e4640 1 -- 172.21.15.18:0/1357269037 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd6800d29b0 con 0x7fd68015ef50 2024-09-19T09:22:47.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.601+0000 7fd6777fe640 1 -- 172.21.15.18:0/1357269037 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) ==== 74+0+16726 (secure 0 0 0) 0x7fd67805d930 con 0x7fd68015ef50 2024-09-19T09:22:47.602 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:22:47.602 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":156,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:22:06.249357+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:20:32.729922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-19T09:20:34.052744+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:22:47.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.603+0000 7fd6857e4640 1 -- 172.21.15.18:0/1357269037 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd66006c2b0 msgr2=0x7fd66006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.603+0000 7fd6857e4640 1 --2- 172.21.15.18:0/1357269037 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd66006c2b0 0x7fd66006e770 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fd6700012e0 tx=0x7fd670001630 comp rx=0 tx=0).stop 2024-09-19T09:22:47.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.603+0000 7fd6857e4640 1 -- 172.21.15.18:0/1357269037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd68015ef50 msgr2=0x7fd680160c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.603+0000 7fd6857e4640 1 --2- 172.21.15.18:0/1357269037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd68015ef50 0x7fd680160c10 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fd67800c7f0 tx=0x7fd67800ccb0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.603+0000 7fd6857e4640 1 -- 172.21.15.18:0/1357269037 shutdown_connections 2024-09-19T09:22:47.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.603+0000 7fd6857e4640 1 --2- 172.21.15.18:0/1357269037 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd66006c2b0 0x7fd66006e770 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.603+0000 7fd6857e4640 1 --2- 172.21.15.18:0/1357269037 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd68015ef50 0x7fd680160c10 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.603+0000 7fd6857e4640 1 --2- 172.21.15.18:0/1357269037 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6800d3240 0x7fd6800cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.603+0000 7fd6857e4640 1 --2- 172.21.15.18:0/1357269037 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6800d1ab0 0x7fd680154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.603+0000 7fd6857e4640 1 -- 172.21.15.18:0/1357269037 >> 172.21.15.18:0/1357269037 conn(0x7fd6800d4c60 msgr2=0x7fd6800b98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:47.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.603+0000 7fd6857e4640 1 -- 172.21.15.18:0/1357269037 shutdown_connections 2024-09-19T09:22:47.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.603+0000 7fd6857e4640 1 -- 172.21.15.18:0/1357269037 wait complete. 2024-09-19T09:22:47.615 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T09:22:47.615 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:22:47.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.717+0000 7f92991b7640 1 Processor -- start 2024-09-19T09:22:47.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.717+0000 7f92991b7640 1 -- start start 2024-09-19T09:22:47.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.718+0000 7f92991b7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f929413fae0 0x7f929406f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.718+0000 7f92991b7640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9294142150 0x7f9294160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.718+0000 7f92991b7640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9294142650 con 0x7f9294160a80 2024-09-19T09:22:47.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.718+0000 7f92991b7640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f92940ce780 con 0x7f9294142150 2024-09-19T09:22:47.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.718+0000 7f92991b7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9294142930 con 0x7f929413fae0 2024-09-19T09:22:47.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.718+0000 7f929259c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9294142150 0x7f9294160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.718+0000 7f929359e640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f9294160a80 0x7f929415cf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56278/0 (socket says 172.21.15.18:56278) 2024-09-19T09:22:47.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.718+0000 7f929359e640 1 -- 172.21.15.18:0/1363939549 learned_addr learned my addr 172.21.15.18:0/1363939549 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:22:47.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.718+0000 7f9292d9d640 1 --2- 172.21.15.18:0/1363939549 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f929413fae0 0x7f929406f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.718+0000 7f929259c640 1 -- 172.21.15.18:0/1363939549 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f929413fae0 msgr2=0x7f929406f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:47.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.718+0000 7f929259c640 1 --2- 172.21.15.18:0/1363939549 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f929413fae0 0x7f929406f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.718+0000 7f929259c640 1 -- 172.21.15.18:0/1363939549 >> v1:172.21.15.18:6789/0 conn(0x7f9294160a80 legacy=0x7f929415cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.718+0000 7f929259c640 1 -- 172.21.15.18:0/1363939549 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9294142c10 con 0x7f9294142150 2024-09-19T09:22:47.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.719+0000 7f929259c640 1 --2- 172.21.15.18:0/1363939549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9294142150 0x7f9294160540 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f92880097a0 tx=0x7f928802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2e41955cf13178 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:47.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.719+0000 7f9291d9b640 1 -- 172.21.15.18:0/1363939549 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9288037070 con 0x7f9294142150 2024-09-19T09:22:47.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.719+0000 7f9291d9b640 1 -- 172.21.15.18:0/1363939549 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f928802ae50 con 0x7f9294142150 2024-09-19T09:22:47.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.719+0000 7f9291d9b640 1 -- 172.21.15.18:0/1363939549 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9288032660 con 0x7f9294142150 2024-09-19T09:22:47.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.720+0000 7f92991b7640 1 -- 172.21.15.18:0/1363939549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9294142150 msgr2=0x7f9294160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.720+0000 7f92991b7640 1 --2- 172.21.15.18:0/1363939549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9294142150 0x7f9294160540 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f92880097a0 tx=0x7f928802a100 comp rx=0 tx=0).stop 2024-09-19T09:22:47.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.720+0000 7f92991b7640 1 -- 172.21.15.18:0/1363939549 shutdown_connections 2024-09-19T09:22:47.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.720+0000 7f92991b7640 1 --2- 172.21.15.18:0/1363939549 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9294142150 0x7f9294160540 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.720+0000 7f92991b7640 1 --2- 172.21.15.18:0/1363939549 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f929413fae0 0x7f929406f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.720+0000 7f92991b7640 1 -- 172.21.15.18:0/1363939549 >> 172.21.15.18:0/1363939549 conn(0x7f929406bc10 msgr2=0x7f929406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:47.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.720+0000 7f92991b7640 1 -- 172.21.15.18:0/1363939549 shutdown_connections 2024-09-19T09:22:47.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.720+0000 7f92991b7640 1 -- 172.21.15.18:0/1363939549 wait complete. 2024-09-19T09:22:47.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.721+0000 7f92991b7640 1 Processor -- start 2024-09-19T09:22:47.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.721+0000 7f92991b7640 1 -- start start 2024-09-19T09:22:47.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.722+0000 7f92991b7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f929413fae0 0x7f929413f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.722+0000 7f92991b7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9294142150 0x7f9294144610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.722+0000 7f92991b7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9294160a80 0x7f9294157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.722+0000 7f92991b7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f929406f870 con 0x7f9294160a80 2024-09-19T09:22:47.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.722+0000 7f92991b7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f929406f6f0 con 0x7f9294142150 2024-09-19T09:22:47.724 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.722+0000 7f92991b7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f92940cfc20 con 0x7f929413fae0 2024-09-19T09:22:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.722+0000 7f929359e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9294160a80 0x7f9294157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.722+0000 7f929359e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9294160a80 0x7f9294157580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50304/0 (socket says 172.21.15.18:50304) 2024-09-19T09:22:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.722+0000 7f929359e640 1 -- 172.21.15.18:0/2383443456 learned_addr learned my addr 172.21.15.18:0/2383443456 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.722+0000 7f929259c640 1 --2- 172.21.15.18:0/2383443456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9294142150 0x7f9294144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.722+0000 7f9292d9d640 1 --2- 172.21.15.18:0/2383443456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f929413fae0 0x7f929413f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.723+0000 7f929359e640 1 -- 172.21.15.18:0/2383443456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f929413fae0 msgr2=0x7f929413f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.723+0000 7f929359e640 1 --2- 172.21.15.18:0/2383443456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f929413fae0 0x7f929413f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.723+0000 7f929359e640 1 -- 172.21.15.18:0/2383443456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9294142150 msgr2=0x7f9294144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.723+0000 7f929359e640 1 --2- 172.21.15.18:0/2383443456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9294142150 0x7f9294144610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.723+0000 7f929359e640 1 -- 172.21.15.18:0/2383443456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9294145060 con 0x7f9294160a80 2024-09-19T09:22:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.723+0000 7f929359e640 1 --2- 172.21.15.18:0/2383443456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9294160a80 0x7f9294157580 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f928c00cab0 tx=0x7f928c00cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.723+0000 7f927b7fe640 1 -- 172.21.15.18:0/2383443456 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928c017070 con 0x7f9294160a80 2024-09-19T09:22:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.723+0000 7f927b7fe640 1 -- 172.21.15.18:0/2383443456 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f928c00ac30 con 0x7f9294160a80 2024-09-19T09:22:47.725 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.723+0000 7f92991b7640 1 -- 172.21.15.18:0/2383443456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9294145340 con 0x7f9294160a80 2024-09-19T09:22:47.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.723+0000 7f927b7fe640 1 -- 172.21.15.18:0/2383443456 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928c012400 con 0x7f9294160a80 2024-09-19T09:22:47.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.723+0000 7f92991b7640 1 -- 172.21.15.18:0/2383443456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9294145900 con 0x7f9294160a80 2024-09-19T09:22:47.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.724+0000 7f92991b7640 1 -- 172.21.15.18:0/2383443456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f929406f1b0 con 0x7f9294160a80 2024-09-19T09:22:47.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.724+0000 7f927b7fe640 1 -- 172.21.15.18:0/2383443456 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f928c01a070 con 0x7f9294160a80 2024-09-19T09:22:47.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.725+0000 7f927b7fe640 1 --2- 172.21.15.18:0/2383443456 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f928006c2b0 0x7f928006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:47.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.725+0000 7f927b7fe640 1 -- 172.21.15.18:0/2383443456 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f928c08af90 con 0x7f9294160a80 2024-09-19T09:22:47.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.725+0000 7f927b7fe640 1 -- 172.21.15.18:0/2383443456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=157}) -- 0x7f9280073e40 con 0x7f9294160a80 2024-09-19T09:22:47.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.725+0000 7f9292d9d640 1 --2- 172.21.15.18:0/2383443456 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f928006c2b0 0x7f928006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:47.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.726+0000 7f9292d9d640 1 --2- 172.21.15.18:0/2383443456 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f928006c2b0 0x7f928006e770 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9284006fd0 tx=0x7f9284008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:47.730 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.729+0000 7f927b7fe640 1 -- 172.21.15.18:0/2383443456 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f928c059140 con 0x7f9294160a80 2024-09-19T09:22:47.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.943+0000 7f92991b7640 1 -- 172.21.15.18:0/2383443456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f929413f5e0 con 0x7f9294160a80 2024-09-19T09:22:47.944 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.943+0000 7f927b7fe640 1 -- 172.21.15.18:0/2383443456 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+5225 (secure 0 0 0) 0x7f928c05d440 con 0x7f9294160a80 2024-09-19T09:22:47.944 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:22:47.944 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":65,"btime":"2024-09-19T09:20:38:235364+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6044,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2661639901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2661639901},{"type":"v1","addr":"172.21.15.162:6836","nonce":2661639901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":7221,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/56318264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":56318264},{"type":"v1","addr":"172.21.15.18:6833","nonce":56318264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":7239,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1783371939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1783371939},{"type":"v1","addr":"172.21.15.162:6837","nonce":1783371939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:20:35.068097+0000","modified":"2024-09-19T09:20:37.584812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7245":{"gid":7245,"name":"a","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/1201598209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1201598209},{"type":"v1","addr":"172.21.15.18:6835","nonce":1201598209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7245,"qdb_cluster":[7245]},"id":9}]} 2024-09-19T09:22:47.945 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 65 2024-09-19T09:22:47.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.945+0000 7f92991b7640 1 -- 172.21.15.18:0/2383443456 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f928006c2b0 msgr2=0x7f928006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.945+0000 7f92991b7640 1 --2- 172.21.15.18:0/2383443456 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f928006c2b0 0x7f928006e770 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9284006fd0 tx=0x7f9284008040 comp rx=0 tx=0).stop 2024-09-19T09:22:47.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.945+0000 7f92991b7640 1 -- 172.21.15.18:0/2383443456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9294160a80 msgr2=0x7f9294157580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:47.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.945+0000 7f92991b7640 1 --2- 172.21.15.18:0/2383443456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9294160a80 0x7f9294157580 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f928c00cab0 tx=0x7f928c00cf70 comp rx=0 tx=0).stop 2024-09-19T09:22:47.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.945+0000 7f92991b7640 1 -- 172.21.15.18:0/2383443456 shutdown_connections 2024-09-19T09:22:47.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.945+0000 7f92991b7640 1 --2- 172.21.15.18:0/2383443456 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f928006c2b0 0x7f928006e770 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.945+0000 7f92991b7640 1 --2- 172.21.15.18:0/2383443456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9294160a80 0x7f9294157580 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.945+0000 7f92991b7640 1 --2- 172.21.15.18:0/2383443456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9294142150 0x7f9294144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.945+0000 7f92991b7640 1 --2- 172.21.15.18:0/2383443456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f929413fae0 0x7f929413f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:47.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.945+0000 7f92991b7640 1 -- 172.21.15.18:0/2383443456 >> 172.21.15.18:0/2383443456 conn(0x7f929406bc10 msgr2=0x7f929415cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:47.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.945+0000 7f92991b7640 1 -- 172.21.15.18:0/2383443456 shutdown_connections 2024-09-19T09:22:47.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:47.945+0000 7f92991b7640 1 -- 172.21.15.18:0/2383443456 wait complete. 2024-09-19T09:22:47.957 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:22:48.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.058+0000 7f6b15f31640 1 Processor -- start 2024-09-19T09:22:48.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.058+0000 7f6b15f31640 1 -- start start 2024-09-19T09:22:48.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.059+0000 7f6b15f31640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b1015fd50 0x7f6b100b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:48.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.059+0000 7f6b15f31640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6b100ce960 0x7f6b100cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:48.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.059+0000 7f6b15f31640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b1015cfa0 con 0x7f6b100b54a0 2024-09-19T09:22:48.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.059+0000 7f6b15f31640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f6b100b58e0 con 0x7f6b100ce960 2024-09-19T09:22:48.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.059+0000 7f6b15f31640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6b1015d280 con 0x7f6b1015fd50 2024-09-19T09:22:48.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.059+0000 7f6b0ffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6b100ce960 0x7f6b100cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:48.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.059+0000 7f6b0ffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6b100ce960 0x7f6b100cce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50320/0 (socket says 172.21.15.18:50320) 2024-09-19T09:22:48.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.059+0000 7f6b0ffff640 1 -- 172.21.15.18:0/1300349483 learned_addr learned my addr 172.21.15.18:0/1300349483 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:48.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.059+0000 7f6b0f7fe640 1 --2- 172.21.15.18:0/1300349483 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b1015fd50 0x7f6b100b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:48.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.059+0000 7f6b0ffff640 1 -- 172.21.15.18:0/1300349483 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b1015fd50 msgr2=0x7f6b100b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:48.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.059+0000 7f6b0ffff640 1 --2- 172.21.15.18:0/1300349483 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b1015fd50 0x7f6b100b4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:48.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.059+0000 7f6b0ffff640 1 -- 172.21.15.18:0/1300349483 >> v1:172.21.15.162:6789/0 conn(0x7f6b100b54a0 legacy=0x7f6b100ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:48.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.059+0000 7f6b0ffff640 1 -- 172.21.15.18:0/1300349483 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b1015d560 con 0x7f6b100ce960 2024-09-19T09:22:48.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.060+0000 7f6b0ffff640 1 --2- 172.21.15.18:0/1300349483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b100ce960 0x7f6b100cce30 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f6b08009e50 tx=0x7f6b0802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b5d09af04dbc47e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:48.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.060+0000 7f6b0e7fc640 1 -- 172.21.15.18:0/1300349483 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b08036070 con 0x7f6b100ce960 2024-09-19T09:22:48.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.060+0000 7f6b0e7fc640 1 -- 172.21.15.18:0/1300349483 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b08031600 con 0x7f6b100ce960 2024-09-19T09:22:48.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.060+0000 7f6b0e7fc640 1 -- 172.21.15.18:0/1300349483 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b080319d0 con 0x7f6b100ce960 2024-09-19T09:22:48.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.061+0000 7f6b15f31640 1 -- 172.21.15.18:0/1300349483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b100ce960 msgr2=0x7f6b100cce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:48.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.061+0000 7f6b15f31640 1 --2- 172.21.15.18:0/1300349483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b100ce960 0x7f6b100cce30 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f6b08009e50 tx=0x7f6b0802a710 comp rx=0 tx=0).stop 2024-09-19T09:22:48.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.061+0000 7f6b15f31640 1 -- 172.21.15.18:0/1300349483 shutdown_connections 2024-09-19T09:22:48.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.061+0000 7f6b15f31640 1 --2- 172.21.15.18:0/1300349483 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b100ce960 0x7f6b100cce30 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:48.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.061+0000 7f6b15f31640 1 --2- 172.21.15.18:0/1300349483 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b1015fd50 0x7f6b100b4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:48.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.061+0000 7f6b15f31640 1 -- 172.21.15.18:0/1300349483 >> 172.21.15.18:0/1300349483 conn(0x7f6b100b2b50 msgr2=0x7f6b100b2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:48.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.061+0000 7f6b15f31640 1 -- 172.21.15.18:0/1300349483 shutdown_connections 2024-09-19T09:22:48.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.061+0000 7f6b15f31640 1 -- 172.21.15.18:0/1300349483 wait complete. 2024-09-19T09:22:48.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.062+0000 7f6b15f31640 1 Processor -- start 2024-09-19T09:22:48.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.062+0000 7f6b15f31640 1 -- start start 2024-09-19T09:22:48.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.063+0000 7f6b15f31640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b100b54a0 0x7f6b100abe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:48.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.063+0000 7f6b15f31640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b100ce960 0x7f6b100aeb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:48.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.063+0000 7f6b15f31640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b1015fd50 0x7f6b1015a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:48.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.063+0000 7f6b15f31640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6b10160130 con 0x7f6b1015fd50 2024-09-19T09:22:48.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.063+0000 7f6b15f31640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6b1015db20 con 0x7f6b100b54a0 2024-09-19T09:22:48.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.063+0000 7f6b15f31640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6b100cd370 con 0x7f6b100ce960 2024-09-19T09:22:48.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.063+0000 7f6b0ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b1015fd50 0x7f6b1015a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:48.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.063+0000 7f6b0ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b1015fd50 0x7f6b1015a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50330/0 (socket says 172.21.15.18:50330) 2024-09-19T09:22:48.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.063+0000 7f6b0ffff640 1 -- 172.21.15.18:0/2240100624 learned_addr learned my addr 172.21.15.18:0/2240100624 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:48.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.063+0000 7f6b0f7fe640 1 --2- 172.21.15.18:0/2240100624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b100b54a0 0x7f6b100abe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:48.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.063+0000 7f6b0effd640 1 --2- 172.21.15.18:0/2240100624 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b100ce960 0x7f6b100aeb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:48.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.064+0000 7f6b0ffff640 1 -- 172.21.15.18:0/2240100624 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b100ce960 msgr2=0x7f6b100aeb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:48.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.064+0000 7f6b0ffff640 1 --2- 172.21.15.18:0/2240100624 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b100ce960 0x7f6b100aeb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:48.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.064+0000 7f6b0ffff640 1 -- 172.21.15.18:0/2240100624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b100b54a0 msgr2=0x7f6b100abe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:48.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.064+0000 7f6b0ffff640 1 --2- 172.21.15.18:0/2240100624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b100b54a0 0x7f6b100abe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:48.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.064+0000 7f6b0ffff640 1 -- 172.21.15.18:0/2240100624 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b100addc0 con 0x7f6b1015fd50 2024-09-19T09:22:48.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.064+0000 7f6b0ffff640 1 --2- 172.21.15.18:0/2240100624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b1015fd50 0x7f6b1015a520 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f6b08034040 tx=0x7f6b08004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:48.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.064+0000 7f6af7fff640 1 -- 172.21.15.18:0/2240100624 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b08036050 con 0x7f6b1015fd50 2024-09-19T09:22:48.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.064+0000 7f6af7fff640 1 -- 172.21.15.18:0/2240100624 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b08042070 con 0x7f6b1015fd50 2024-09-19T09:22:48.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.064+0000 7f6af7fff640 1 -- 172.21.15.18:0/2240100624 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b08009510 con 0x7f6b1015fd50 2024-09-19T09:22:48.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.064+0000 7f6b15f31640 1 -- 172.21.15.18:0/2240100624 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b100ae060 con 0x7f6b1015fd50 2024-09-19T09:22:48.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.064+0000 7f6b15f31640 1 -- 172.21.15.18:0/2240100624 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b1015c740 con 0x7f6b1015fd50 2024-09-19T09:22:48.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.065+0000 7f6b15f31640 1 -- 172.21.15.18:0/2240100624 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b10075500 con 0x7f6b1015fd50 2024-09-19T09:22:48.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.065+0000 7f6af7fff640 1 -- 172.21.15.18:0/2240100624 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6b08007bd0 con 0x7f6b1015fd50 2024-09-19T09:22:48.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.066+0000 7f6af7fff640 1 --2- 172.21.15.18:0/2240100624 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6afc06c2e0 0x7f6afc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:48.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.066+0000 7f6af7fff640 1 -- 172.21.15.18:0/2240100624 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f6b080ac110 con 0x7f6b1015fd50 2024-09-19T09:22:48.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.066+0000 7f6af7fff640 1 -- 172.21.15.18:0/2240100624 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=157}) -- 0x7f6afc073e10 con 0x7f6b1015fd50 2024-09-19T09:22:48.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.066+0000 7f6b0f7fe640 1 --2- 172.21.15.18:0/2240100624 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6afc06c2e0 0x7f6afc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:48.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.067+0000 7f6b0f7fe640 1 --2- 172.21.15.18:0/2240100624 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6afc06c2e0 0x7f6afc06e7a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6b000079a0 tx=0x7f6b00008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:48.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.070+0000 7f6af7fff640 1 -- 172.21.15.18:0/2240100624 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6b0807a2c0 con 0x7f6b1015fd50 2024-09-19T09:22:48.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.284+0000 7f6b15f31640 1 -- 172.21.15.18:0/2240100624 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b100afcf0 con 0x7f6b1015fd50 2024-09-19T09:22:48.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.285+0000 7f6af7fff640 1 -- 172.21.15.18:0/2240100624 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+5225 (secure 0 0 0) 0x7f6b0807e5c0 con 0x7f6b1015fd50 2024-09-19T09:22:48.286 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:22:48.286 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":65,"btime":"2024-09-19T09:20:38:235364+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6044,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2661639901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2661639901},{"type":"v1","addr":"172.21.15.162:6836","nonce":2661639901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":7221,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/56318264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":56318264},{"type":"v1","addr":"172.21.15.18:6833","nonce":56318264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":7239,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1783371939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1783371939},{"type":"v1","addr":"172.21.15.162:6837","nonce":1783371939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:20:35.068097+0000","modified":"2024-09-19T09:20:37.584812+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7245":{"gid":7245,"name":"a","rank":0,"incarnation":62,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/1201598209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":1201598209},{"type":"v1","addr":"172.21.15.18:6835","nonce":1201598209}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7245,"qdb_cluster":[7245]},"id":9}]} 2024-09-19T09:22:48.286 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 65 2024-09-19T09:22:48.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.287+0000 7f6b15f31640 1 -- 172.21.15.18:0/2240100624 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6afc06c2e0 msgr2=0x7f6afc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:48.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.287+0000 7f6b15f31640 1 --2- 172.21.15.18:0/2240100624 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6afc06c2e0 0x7f6afc06e7a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6b000079a0 tx=0x7f6b00008040 comp rx=0 tx=0).stop 2024-09-19T09:22:48.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.287+0000 7f6b15f31640 1 -- 172.21.15.18:0/2240100624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b1015fd50 msgr2=0x7f6b1015a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:48.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.287+0000 7f6b15f31640 1 --2- 172.21.15.18:0/2240100624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b1015fd50 0x7f6b1015a520 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f6b08034040 tx=0x7f6b08004a40 comp rx=0 tx=0).stop 2024-09-19T09:22:48.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.287+0000 7f6b15f31640 1 -- 172.21.15.18:0/2240100624 shutdown_connections 2024-09-19T09:22:48.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.287+0000 7f6b15f31640 1 --2- 172.21.15.18:0/2240100624 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6afc06c2e0 0x7f6afc06e7a0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:48.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.287+0000 7f6b15f31640 1 --2- 172.21.15.18:0/2240100624 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6b1015fd50 0x7f6b1015a520 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:48.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.287+0000 7f6b15f31640 1 --2- 172.21.15.18:0/2240100624 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6b100ce960 0x7f6b100aeb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:48.288 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.287+0000 7f6b15f31640 1 --2- 172.21.15.18:0/2240100624 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6b100b54a0 0x7f6b100abe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:48.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.287+0000 7f6b15f31640 1 -- 172.21.15.18:0/2240100624 >> 172.21.15.18:0/2240100624 conn(0x7f6b100b2b50 msgr2=0x7f6b100b1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:48.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.287+0000 7f6b15f31640 1 -- 172.21.15.18:0/2240100624 shutdown_connections 2024-09-19T09:22:48.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.287+0000 7f6b15f31640 1 -- 172.21.15.18:0/2240100624 wait complete. 2024-09-19T09:22:48.299 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:22:48.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.401+0000 7f84ba4f1640 1 Processor -- start 2024-09-19T09:22:48.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.401+0000 7f84ba4f1640 1 -- start start 2024-09-19T09:22:48.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.401+0000 7f84ba4f1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84b415c840 0x7f84b40b55d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:48.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.401+0000 7f84ba4f1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f84b406ef30 0x7f84b406f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:48.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.401+0000 7f84ba4f1640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84b40b5eb0 con 0x7f84b40725b0 2024-09-19T09:22:48.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.401+0000 7f84ba4f1640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f84b40b6190 con 0x7f84b406ef30 2024-09-19T09:22:48.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.401+0000 7f84ba4f1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f84b406e450 con 0x7f84b415c840 2024-09-19T09:22:48.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.402+0000 7f84b8a8e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f84b406ef30 0x7f84b406f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:48.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.402+0000 7f84b8a8e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f84b406ef30 0x7f84b406f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50332/0 (socket says 172.21.15.18:50332) 2024-09-19T09:22:48.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.402+0000 7f84b8a8e640 1 -- 172.21.15.18:0/2849545494 learned_addr learned my addr 172.21.15.18:0/2849545494 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:48.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.402+0000 7f84b3fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f84b40725b0 0x7f84b4072990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56292/0 (socket says 172.21.15.18:56292) 2024-09-19T09:22:48.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.402+0000 7f84b8a8e640 1 -- 172.21.15.18:0/2849545494 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84b415c840 msgr2=0x7f84b40b55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:48.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.402+0000 7f84b8a8e640 1 --2- 172.21.15.18:0/2849545494 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84b415c840 0x7f84b40b55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:48.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.402+0000 7f84b8a8e640 1 -- 172.21.15.18:0/2849545494 >> v1:172.21.15.18:6789/0 conn(0x7f84b40725b0 legacy=0x7f84b4072990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:48.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.402+0000 7f84b37fe640 1 -- 172.21.15.18:0/2849545494 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1926716252 0 0) 0x7f84b40b5eb0 con 0x7f84b40725b0 2024-09-19T09:22:48.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.402+0000 7f84b8a8e640 1 -- 172.21.15.18:0/2849545494 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b406e730 con 0x7f84b406ef30 2024-09-19T09:22:48.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.403+0000 7f84b8a8e640 1 --2- 172.21.15.18:0/2849545494 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84b406ef30 0x7f84b406f3c0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f84ac009e50 tx=0x7f84ac02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90de521b2449ecf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:48.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.403+0000 7f84b37fe640 1 -- 172.21.15.18:0/2849545494 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac036070 con 0x7f84b406ef30 2024-09-19T09:22:48.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.403+0000 7f84b37fe640 1 -- 172.21.15.18:0/2849545494 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84ac031600 con 0x7f84b406ef30 2024-09-19T09:22:48.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.403+0000 7f84b37fe640 1 -- 172.21.15.18:0/2849545494 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac0319d0 con 0x7f84b406ef30 2024-09-19T09:22:48.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.403+0000 7f84ba4f1640 1 -- 172.21.15.18:0/2849545494 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84b406ef30 msgr2=0x7f84b406f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:48.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.403+0000 7f84ba4f1640 1 --2- 172.21.15.18:0/2849545494 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84b406ef30 0x7f84b406f3c0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f84ac009e50 tx=0x7f84ac02a710 comp rx=0 tx=0).stop 2024-09-19T09:22:48.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.403+0000 7f84ba4f1640 1 -- 172.21.15.18:0/2849545494 shutdown_connections 2024-09-19T09:22:48.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.403+0000 7f84ba4f1640 1 --2- 172.21.15.18:0/2849545494 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84b406ef30 0x7f84b406f3c0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:48.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.403+0000 7f84ba4f1640 1 --2- 172.21.15.18:0/2849545494 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84b415c840 0x7f84b40b55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:48.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.403+0000 7f84ba4f1640 1 -- 172.21.15.18:0/2849545494 >> 172.21.15.18:0/2849545494 conn(0x7f84b40d1970 msgr2=0x7f84b40d1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:48.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.404+0000 7f84ba4f1640 1 -- 172.21.15.18:0/2849545494 shutdown_connections 2024-09-19T09:22:48.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.404+0000 7f84ba4f1640 1 -- 172.21.15.18:0/2849545494 wait complete. 2024-09-19T09:22:48.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.405+0000 7f84ba4f1640 1 Processor -- start 2024-09-19T09:22:48.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.405+0000 7f84ba4f1640 1 -- start start 2024-09-19T09:22:48.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.405+0000 7f84ba4f1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84b406ef30 0x7f84b4146570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:48.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.405+0000 7f84ba4f1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84b40725b0 0x7f84b40b1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:48.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.405+0000 7f84ba4f1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84b415c840 0x7f84b40b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:48.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.405+0000 7f84ba4f1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f84b40b5b10 con 0x7f84b415c840 2024-09-19T09:22:48.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.405+0000 7f84ba4f1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f84b415cc80 con 0x7f84b406ef30 2024-09-19T09:22:48.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.405+0000 7f84ba4f1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f84b40b5c90 con 0x7f84b40725b0 2024-09-19T09:22:48.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.406+0000 7f84b8a8e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84b415c840 0x7f84b40b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:48.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.406+0000 7f84b8a8e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84b415c840 0x7f84b40b1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50344/0 (socket says 172.21.15.18:50344) 2024-09-19T09:22:48.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.406+0000 7f84b8a8e640 1 -- 172.21.15.18:0/258499731 learned_addr learned my addr 172.21.15.18:0/258499731 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:48.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.406+0000 7f84abfff640 1 --2- 172.21.15.18:0/258499731 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84b40725b0 0x7f84b40b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:48.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.406+0000 7f84b3fff640 1 --2- 172.21.15.18:0/258499731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84b406ef30 0x7f84b4146570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:48.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.406+0000 7f84b8a8e640 1 -- 172.21.15.18:0/258499731 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84b40725b0 msgr2=0x7f84b40b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:48.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.406+0000 7f84b8a8e640 1 --2- 172.21.15.18:0/258499731 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84b40725b0 0x7f84b40b1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:48.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.406+0000 7f84b8a8e640 1 -- 172.21.15.18:0/258499731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84b406ef30 msgr2=0x7f84b4146570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:48.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.406+0000 7f84b8a8e640 1 --2- 172.21.15.18:0/258499731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84b406ef30 0x7f84b4146570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:48.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.406+0000 7f84b8a8e640 1 -- 172.21.15.18:0/258499731 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b40cf040 con 0x7f84b415c840 2024-09-19T09:22:48.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.406+0000 7f84abfff640 1 --2- 172.21.15.18:0/258499731 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84b40725b0 0x7f84b40b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:22:48.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.406+0000 7f84b3fff640 1 --2- 172.21.15.18:0/258499731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84b406ef30 0x7f84b4146570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:22:48.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.406+0000 7f84b8a8e640 1 --2- 172.21.15.18:0/258499731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84b415c840 0x7f84b40b1ad0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f84ac034040 tx=0x7f84ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:48.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.406+0000 7f84b17fa640 1 -- 172.21.15.18:0/258499731 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac041020 con 0x7f84b415c840 2024-09-19T09:22:48.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.406+0000 7f84b17fa640 1 -- 172.21.15.18:0/258499731 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84ac0077a0 con 0x7f84b415c840 2024-09-19T09:22:48.410 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.406+0000 7f84b17fa640 1 -- 172.21.15.18:0/258499731 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac036040 con 0x7f84b415c840 2024-09-19T09:22:48.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.406+0000 7f84ba4f1640 1 -- 172.21.15.18:0/258499731 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84b414e6e0 con 0x7f84b415c840 2024-09-19T09:22:48.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.406+0000 7f84ba4f1640 1 -- 172.21.15.18:0/258499731 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84b40cf5c0 con 0x7f84b415c840 2024-09-19T09:22:48.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.407+0000 7f84ba4f1640 1 -- 172.21.15.18:0/258499731 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84b40b55d0 con 0x7f84b415c840 2024-09-19T09:22:48.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.408+0000 7f84b17fa640 1 -- 172.21.15.18:0/258499731 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f84ac044020 con 0x7f84b415c840 2024-09-19T09:22:48.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.408+0000 7f84b17fa640 1 --2- 172.21.15.18:0/258499731 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f849406c2b0 0x7f849406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:48.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.408+0000 7f84b17fa640 1 -- 172.21.15.18:0/258499731 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7f84ac0ac2e0 con 0x7f84b415c840 2024-09-19T09:22:48.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.408+0000 7f84b17fa640 1 -- 172.21.15.18:0/258499731 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=157}) -- 0x7f8494073de0 con 0x7f84b415c840 2024-09-19T09:22:48.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.409+0000 7f84b3fff640 1 --2- 172.21.15.18:0/258499731 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f849406c2b0 0x7f849406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:48.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.409+0000 7f84b3fff640 1 --2- 172.21.15.18:0/258499731 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f849406c2b0 0x7f849406e770 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f84a4000f60 tx=0x7f84a4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:48.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.413+0000 7f84b17fa640 1 -- 172.21.15.18:0/258499731 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f84ac04b030 con 0x7f84b415c840 2024-09-19T09:22:48.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.591+0000 7f84ba4f1640 1 -- 172.21.15.18:0/258499731 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f84b4073290 con 0x7f84b415c840 2024-09-19T09:22:48.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.592+0000 7f84b17fa640 1 -- 172.21.15.18:0/258499731 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) ==== 74+0+16726 (secure 0 0 0) 0x7f84ac07aa50 con 0x7f84b415c840 2024-09-19T09:22:48.594 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:22:48.594 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":156,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:22:06.249357+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:20:32.729922+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-19T09:20:34.052744+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:22:48.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.595+0000 7f84ba4f1640 1 -- 172.21.15.18:0/258499731 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f849406c2b0 msgr2=0x7f849406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:48.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.595+0000 7f84ba4f1640 1 --2- 172.21.15.18:0/258499731 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f849406c2b0 0x7f849406e770 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f84a4000f60 tx=0x7f84a4009040 comp rx=0 tx=0).stop 2024-09-19T09:22:48.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.595+0000 7f84ba4f1640 1 -- 172.21.15.18:0/258499731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84b415c840 msgr2=0x7f84b40b1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:48.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.595+0000 7f84ba4f1640 1 --2- 172.21.15.18:0/258499731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84b415c840 0x7f84b40b1ad0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f84ac034040 tx=0x7f84ac004a40 comp rx=0 tx=0).stop 2024-09-19T09:22:48.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.595+0000 7f84ba4f1640 1 -- 172.21.15.18:0/258499731 shutdown_connections 2024-09-19T09:22:48.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.595+0000 7f84ba4f1640 1 --2- 172.21.15.18:0/258499731 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f849406c2b0 0x7f849406e770 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:48.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.595+0000 7f84ba4f1640 1 --2- 172.21.15.18:0/258499731 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f84b415c840 0x7f84b40b1ad0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:48.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.595+0000 7f84ba4f1640 1 --2- 172.21.15.18:0/258499731 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f84b40725b0 0x7f84b40b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:48.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.595+0000 7f84ba4f1640 1 --2- 172.21.15.18:0/258499731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f84b406ef30 0x7f84b4146570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:48.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.595+0000 7f84ba4f1640 1 -- 172.21.15.18:0/258499731 >> 172.21.15.18:0/258499731 conn(0x7f84b40d1970 msgr2=0x7f84b41ea3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:48.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.595+0000 7f84ba4f1640 1 -- 172.21.15.18:0/258499731 shutdown_connections 2024-09-19T09:22:48.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.595+0000 7f84ba4f1640 1 -- 172.21.15.18:0/258499731 wait complete. 2024-09-19T09:22:48.607 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-19T09:22:48.710 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.709+0000 7fab31391640 1 Processor -- start 2024-09-19T09:22:48.711 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.709+0000 7fab31391640 1 -- start start 2024-09-19T09:22:48.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.710+0000 7fab31391640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fab2c15eda0 0x7fab2c0d5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:48.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.710+0000 7fab31391640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab2c0d0480 0x7fab2c0d35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:48.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.710+0000 7fab31391640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fab2c0d3af0 0x7fab2c0d1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:48.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.710+0000 7fab31391640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fab2c0d2880 con 0x7fab2c0d3af0 2024-09-19T09:22:48.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.710+0000 7fab31391640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fab2c0d3120 con 0x7fab2c15eda0 2024-09-19T09:22:48.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.710+0000 7fab31391640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fab2c0d0bf0 con 0x7fab2c0d0480 2024-09-19T09:22:48.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.710+0000 7fab2b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fab2c0d3af0 0x7fab2c0d1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:48.713 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.710+0000 7fab2b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fab2c0d3af0 0x7fab2c0d1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50360/0 (socket says 172.21.15.18:50360) 2024-09-19T09:22:48.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.710+0000 7fab2b7fe640 1 -- 172.21.15.18:0/3162573458 learned_addr learned my addr 172.21.15.18:0/3162573458 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:48.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.711+0000 7fab2affd640 1 --2- 172.21.15.18:0/3162573458 >> v2:172.21.15.162:3300/0 conn(0x7fab2c15eda0 0x7fab2c0d5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:48.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.711+0000 7fab2a7fc640 1 --2- 172.21.15.18:0/3162573458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab2c0d0480 0x7fab2c0d35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:48.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.711+0000 7fab2b7fe640 1 -- 172.21.15.18:0/3162573458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab2c0d0480 msgr2=0x7fab2c0d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:48.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.711+0000 7fab2b7fe640 1 --2- 172.21.15.18:0/3162573458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab2c0d0480 0x7fab2c0d35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:48.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.711+0000 7fab2b7fe640 1 -- 172.21.15.18:0/3162573458 >> v2:172.21.15.162:3300/0 conn(0x7fab2c15eda0 msgr2=0x7fab2c0d5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:48.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.711+0000 7fab2b7fe640 1 --2- 172.21.15.18:0/3162573458 >> v2:172.21.15.162:3300/0 conn(0x7fab2c15eda0 0x7fab2c0d5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:48.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.711+0000 7fab2b7fe640 1 -- 172.21.15.18:0/3162573458 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab2c0d2ad0 con 0x7fab2c0d3af0 2024-09-19T09:22:48.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.711+0000 7fab2b7fe640 1 --2- 172.21.15.18:0/3162573458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab2c0d3af0 0x7fab2c0d1630 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fab2c06ec20 tx=0x7fab1c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7200ae6acd74e91d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:48.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.712+0000 7fab29ffb640 1 -- 172.21.15.18:0/3162573458 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab1c036070 con 0x7fab2c0d3af0 2024-09-19T09:22:48.714 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.712+0000 7fab29ffb640 1 -- 172.21.15.18:0/3162573458 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab1c031600 con 0x7fab2c0d3af0 2024-09-19T09:22:48.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.712+0000 7fab29ffb640 1 -- 172.21.15.18:0/3162573458 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab1c0319d0 con 0x7fab2c0d3af0 2024-09-19T09:22:48.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.712+0000 7fab31391640 1 -- 172.21.15.18:0/3162573458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab2c0d3af0 msgr2=0x7fab2c0d1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:48.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.712+0000 7fab31391640 1 --2- 172.21.15.18:0/3162573458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab2c0d3af0 0x7fab2c0d1630 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fab2c06ec20 tx=0x7fab1c02a6a0 comp rx=0 tx=0).stop 2024-09-19T09:22:48.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.712+0000 7fab31391640 1 -- 172.21.15.18:0/3162573458 shutdown_connections 2024-09-19T09:22:48.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.712+0000 7fab31391640 1 --2- 172.21.15.18:0/3162573458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab2c0d3af0 0x7fab2c0d1630 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:48.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.712+0000 7fab31391640 1 --2- 172.21.15.18:0/3162573458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab2c0d0480 0x7fab2c0d35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:48.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.712+0000 7fab31391640 1 --2- 172.21.15.18:0/3162573458 >> v2:172.21.15.162:3300/0 conn(0x7fab2c15eda0 0x7fab2c0d5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:48.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.712+0000 7fab31391640 1 -- 172.21.15.18:0/3162573458 >> 172.21.15.18:0/3162573458 conn(0x7fab2c09df40 msgr2=0x7fab2c0d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:48.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.712+0000 7fab31391640 1 -- 172.21.15.18:0/3162573458 shutdown_connections 2024-09-19T09:22:48.715 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.712+0000 7fab31391640 1 -- 172.21.15.18:0/3162573458 wait complete. 2024-09-19T09:22:48.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.713+0000 7fab31391640 1 Processor -- start 2024-09-19T09:22:48.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.714+0000 7fab31391640 1 -- start start 2024-09-19T09:22:48.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.714+0000 7fab31391640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab2c0d0480 0x7fab2c150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:48.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.714+0000 7fab31391640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab2c15eda0 0x7fab2c161dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:48.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.714+0000 7fab31391640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab2c15b2e0 0x7fab2c06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:48.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.714+0000 7fab31391640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fab2c15f180 con 0x7fab2c15eda0 2024-09-19T09:22:48.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.714+0000 7fab31391640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fab2c0d08c0 con 0x7fab2c0d0480 2024-09-19T09:22:48.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.714+0000 7fab31391640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fab2c15f300 con 0x7fab2c15b2e0 2024-09-19T09:22:48.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.714+0000 7fab2a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab2c15eda0 0x7fab2c161dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:48.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.714+0000 7fab2a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab2c15eda0 0x7fab2c161dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50364/0 (socket says 172.21.15.18:50364) 2024-09-19T09:22:48.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.714+0000 7fab2a7fc640 1 -- 172.21.15.18:0/352012194 learned_addr learned my addr 172.21.15.18:0/352012194 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:48.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.714+0000 7fab2affd640 1 --2- 172.21.15.18:0/352012194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab2c0d0480 0x7fab2c150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:48.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.714+0000 7fab2b7fe640 1 --2- 172.21.15.18:0/352012194 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab2c15b2e0 0x7fab2c06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:48.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.715+0000 7fab2a7fc640 1 -- 172.21.15.18:0/352012194 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab2c15b2e0 msgr2=0x7fab2c06d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:48.719 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.715+0000 7fab2a7fc640 1 --2- 172.21.15.18:0/352012194 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab2c15b2e0 0x7fab2c06d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:48.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.715+0000 7fab2a7fc640 1 -- 172.21.15.18:0/352012194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab2c0d0480 msgr2=0x7fab2c150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:48.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.715+0000 7fab2a7fc640 1 --2- 172.21.15.18:0/352012194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab2c0d0480 0x7fab2c150ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:48.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.715+0000 7fab2a7fc640 1 -- 172.21.15.18:0/352012194 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab2c1628b0 con 0x7fab2c15eda0 2024-09-19T09:22:48.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.715+0000 7fab2a7fc640 1 --2- 172.21.15.18:0/352012194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab2c15eda0 0x7fab2c161dd0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fab1400d7d0 tx=0x7fab1400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:48.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.715+0000 7fab237fe640 1 -- 172.21.15.18:0/352012194 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab14018030 con 0x7fab2c15eda0 2024-09-19T09:22:48.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.715+0000 7fab237fe640 1 -- 172.21.15.18:0/352012194 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab14004020 con 0x7fab2c15eda0 2024-09-19T09:22:48.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.715+0000 7fab31391640 1 -- 172.21.15.18:0/352012194 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab2c162b90 con 0x7fab2c15eda0 2024-09-19T09:22:48.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.715+0000 7fab237fe640 1 -- 172.21.15.18:0/352012194 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab14004230 con 0x7fab2c15eda0 2024-09-19T09:22:48.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.715+0000 7fab31391640 1 -- 172.21.15.18:0/352012194 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab2c163150 con 0x7fab2c15eda0 2024-09-19T09:22:48.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.716+0000 7fab31391640 1 -- 172.21.15.18:0/352012194 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab2c0d35b0 con 0x7fab2c15eda0 2024-09-19T09:22:48.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.717+0000 7fab237fe640 1 -- 172.21.15.18:0/352012194 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fab1401b070 con 0x7fab2c15eda0 2024-09-19T09:22:48.720 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.717+0000 7fab237fe640 1 --2- 172.21.15.18:0/352012194 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fab0c06c2b0 0x7fab0c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:48.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.717+0000 7fab237fe640 1 -- 172.21.15.18:0/352012194 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(156..156 src has 1..156) ==== 5709+0+0 (secure 0 0 0) 0x7fab1408b460 con 0x7fab2c15eda0 2024-09-19T09:22:48.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.717+0000 7fab237fe640 1 -- 172.21.15.18:0/352012194 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=157}) -- 0x7fab0c073de0 con 0x7fab2c15eda0 2024-09-19T09:22:48.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.717+0000 7fab2affd640 1 --2- 172.21.15.18:0/352012194 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fab0c06c2b0 0x7fab0c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:48.721 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.718+0000 7fab2affd640 1 --2- 172.21.15.18:0/352012194 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fab0c06c2b0 0x7fab0c06e770 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fab24009aa0 tx=0x7fab24009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:48.722 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.721+0000 7fab237fe640 1 -- 172.21.15.18:0/352012194 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fab14059580 con 0x7fab2c15eda0 2024-09-19T09:22:48.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.932+0000 7fab31391640 1 -- 172.21.15.18:0/352012194 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fab2c0d2330 con 0x7fab2c15eda0 2024-09-19T09:22:48.933 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-19T09:22:48.932+0000 7fca8a79c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:22:48.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.934+0000 7fab237fe640 1 -- 172.21.15.18:0/352012194 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v66) ==== 161+0+0 (secure 0 0 0) 0x7fab1405d880 con 0x7fab2c15eda0 2024-09-19T09:22:48.935 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T09:22:48.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.934+0000 7fab237fe640 1 -- 172.21.15.18:0/352012194 <== mon.0 v2:172.21.15.18:3300/0 8 ==== osd_map(157..157 src has 1..157) ==== 374+0+0 (secure 0 0 0) 0x7fab140bfda0 con 0x7fab2c15eda0 2024-09-19T09:22:48.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.934+0000 7fab237fe640 1 -- 172.21.15.18:0/352012194 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=158}) -- 0x7fab0c0747b0 con 0x7fab2c15eda0 2024-09-19T09:22:48.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.937+0000 7fab31391640 1 -- 172.21.15.18:0/352012194 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fab0c06c2b0 msgr2=0x7fab0c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:48.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.937+0000 7fab31391640 1 --2- 172.21.15.18:0/352012194 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fab0c06c2b0 0x7fab0c06e770 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fab24009aa0 tx=0x7fab24009190 comp rx=0 tx=0).stop 2024-09-19T09:22:48.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.937+0000 7fab31391640 1 -- 172.21.15.18:0/352012194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab2c15eda0 msgr2=0x7fab2c161dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:48.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.937+0000 7fab31391640 1 --2- 172.21.15.18:0/352012194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab2c15eda0 0x7fab2c161dd0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fab1400d7d0 tx=0x7fab1400dc90 comp rx=0 tx=0).stop 2024-09-19T09:22:48.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.937+0000 7fab31391640 1 -- 172.21.15.18:0/352012194 shutdown_connections 2024-09-19T09:22:48.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.937+0000 7fab31391640 1 --2- 172.21.15.18:0/352012194 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fab0c06c2b0 0x7fab0c06e770 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:48.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.937+0000 7fab31391640 1 --2- 172.21.15.18:0/352012194 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab2c15b2e0 0x7fab2c06d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:48.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.937+0000 7fab31391640 1 --2- 172.21.15.18:0/352012194 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab2c15eda0 0x7fab2c161dd0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:48.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.937+0000 7fab31391640 1 --2- 172.21.15.18:0/352012194 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab2c0d0480 0x7fab2c150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:48.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.937+0000 7fab31391640 1 -- 172.21.15.18:0/352012194 >> 172.21.15.18:0/352012194 conn(0x7fab2c09df40 msgr2=0x7fab2c0b5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:48.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.937+0000 7fab31391640 1 -- 172.21.15.18:0/352012194 shutdown_connections 2024-09-19T09:22:48.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:48.937+0000 7fab31391640 1 -- 172.21.15.18:0/352012194 wait complete. 2024-09-19T09:22:48.950 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T09:22:48.976 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-09-19T09:22:49.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.055+0000 7fef0792c640 1 Processor -- start 2024-09-19T09:22:49.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.055+0000 7fef0792c640 1 -- start start 2024-09-19T09:22:49.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.056+0000 7fef0792c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fef000af9b0 0x7fef00072180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:49.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.056+0000 7fef0792c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef000b02c0 con 0x7fef0015aff0 2024-09-19T09:22:49.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.056+0000 7fef0792c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef000affe0 con 0x7fef000726c0 2024-09-19T09:22:49.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.056+0000 7fef0792c640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fef0015b3d0 con 0x7fef000af9b0 2024-09-19T09:22:49.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.056+0000 7fef04ec7640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fef000af9b0 0x7fef00072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:49.059 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.056+0000 7fef056c8640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fef0015aff0 0x7fef000ce3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56312/0 (socket says 172.21.15.18:56312) 2024-09-19T09:22:49.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.056+0000 7fef056c8640 1 -- 172.21.15.18:0/430768792 learned_addr learned my addr 172.21.15.18:0/430768792 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:22:49.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.057+0000 7fef04ec7640 1 -- 172.21.15.18:0/430768792 >> v1:172.21.15.162:6789/0 conn(0x7fef000726c0 legacy=0x7fef0006e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:49.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.057+0000 7fef04ec7640 1 -- 172.21.15.18:0/430768792 >> v1:172.21.15.18:6789/0 conn(0x7fef0015aff0 legacy=0x7fef000ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:49.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.057+0000 7fef04ec7640 1 -- 172.21.15.18:0/430768792 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef000716a0 con 0x7fef000af9b0 2024-09-19T09:22:49.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.057+0000 7feef3fff640 1 -- 172.21.15.18:0/430768792 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2467635803 0 0) 0x7fef000b02c0 con 0x7fef0015aff0 2024-09-19T09:22:49.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.057+0000 7fef04ec7640 1 --2- 172.21.15.18:0/430768792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef000af9b0 0x7fef00072180 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7feef40097a0 tx=0x7feef402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cbf06630f7fb2f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:49.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.058+0000 7feef3fff640 1 -- 172.21.15.18:0/430768792 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef4037070 con 0x7fef000af9b0 2024-09-19T09:22:49.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.058+0000 7feef3fff640 1 -- 172.21.15.18:0/430768792 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feef402ae50 con 0x7fef000af9b0 2024-09-19T09:22:49.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.058+0000 7feef3fff640 1 -- 172.21.15.18:0/430768792 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef4032660 con 0x7fef000af9b0 2024-09-19T09:22:49.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.058+0000 7fef0792c640 1 -- 172.21.15.18:0/430768792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef000af9b0 msgr2=0x7fef00072180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:49.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.058+0000 7fef0792c640 1 --2- 172.21.15.18:0/430768792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef000af9b0 0x7fef00072180 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7feef40097a0 tx=0x7feef402a140 comp rx=0 tx=0).stop 2024-09-19T09:22:49.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.058+0000 7fef0792c640 1 -- 172.21.15.18:0/430768792 shutdown_connections 2024-09-19T09:22:49.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.058+0000 7fef0792c640 1 --2- 172.21.15.18:0/430768792 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef000af9b0 0x7fef00072180 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.058+0000 7fef0792c640 1 -- 172.21.15.18:0/430768792 >> 172.21.15.18:0/430768792 conn(0x7fef0006bc10 msgr2=0x7fef0006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:49.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.058+0000 7fef0792c640 1 -- 172.21.15.18:0/430768792 shutdown_connections 2024-09-19T09:22:49.061 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.058+0000 7fef0792c640 1 -- 172.21.15.18:0/430768792 wait complete. 2024-09-19T09:22:49.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.059+0000 7fef0792c640 1 Processor -- start 2024-09-19T09:22:49.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.059+0000 7fef0792c640 1 -- start start 2024-09-19T09:22:49.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.060+0000 7fef0792c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef000726c0 0x7fef0014a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:49.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.060+0000 7fef0792c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef000af9b0 0x7fef00147370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:49.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.060+0000 7fef0792c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef0015aff0 0x7fef000b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:49.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.060+0000 7fef0792c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fef000d12c0 con 0x7fef0015aff0 2024-09-19T09:22:49.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.060+0000 7fef0792c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fef00071cf0 con 0x7fef000726c0 2024-09-19T09:22:49.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.060+0000 7fef0792c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fef000ceae0 con 0x7fef000af9b0 2024-09-19T09:22:49.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.060+0000 7fef05ec9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef0015aff0 0x7fef000b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:49.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.060+0000 7fef05ec9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef0015aff0 0x7fef000b14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50388/0 (socket says 172.21.15.18:50388) 2024-09-19T09:22:49.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.060+0000 7fef05ec9640 1 -- 172.21.15.18:0/2298403113 learned_addr learned my addr 172.21.15.18:0/2298403113 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:49.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.060+0000 7fef04ec7640 1 --2- 172.21.15.18:0/2298403113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef000af9b0 0x7fef00147370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:49.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.060+0000 7fef056c8640 1 --2- 172.21.15.18:0/2298403113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef000726c0 0x7fef0014a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:49.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.061+0000 7fef05ec9640 1 -- 172.21.15.18:0/2298403113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef000af9b0 msgr2=0x7fef00147370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:49.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.061+0000 7fef05ec9640 1 --2- 172.21.15.18:0/2298403113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef000af9b0 0x7fef00147370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.061+0000 7fef05ec9640 1 -- 172.21.15.18:0/2298403113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef000726c0 msgr2=0x7fef0014a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:49.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.061+0000 7fef05ec9640 1 --2- 172.21.15.18:0/2298403113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef000726c0 0x7fef0014a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.061+0000 7fef05ec9640 1 -- 172.21.15.18:0/2298403113 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef000adcc0 con 0x7fef0015aff0 2024-09-19T09:22:49.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.061+0000 7fef056c8640 1 --2- 172.21.15.18:0/2298403113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef000726c0 0x7fef0014a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:49.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.061+0000 7fef05ec9640 1 --2- 172.21.15.18:0/2298403113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef0015aff0 0x7fef000b14c0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7feef800c7a0 tx=0x7feef800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:49.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.061+0000 7feef1ffb640 1 -- 172.21.15.18:0/2298403113 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef8016020 con 0x7fef0015aff0 2024-09-19T09:22:49.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.061+0000 7feef1ffb640 1 -- 172.21.15.18:0/2298403113 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feef800aa50 con 0x7fef0015aff0 2024-09-19T09:22:49.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.061+0000 7feef1ffb640 1 -- 172.21.15.18:0/2298403113 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef8012420 con 0x7fef0015aff0 2024-09-19T09:22:49.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.061+0000 7fef0792c640 1 -- 172.21.15.18:0/2298403113 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef000adfa0 con 0x7fef0015aff0 2024-09-19T09:22:49.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.061+0000 7fef0792c640 1 -- 172.21.15.18:0/2298403113 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef000ae560 con 0x7fef0015aff0 2024-09-19T09:22:49.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.062+0000 7fef0792c640 1 -- 172.21.15.18:0/2298403113 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef0006df70 con 0x7fef0015aff0 2024-09-19T09:22:49.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.062+0000 7feef1ffb640 1 -- 172.21.15.18:0/2298403113 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7feef8019020 con 0x7fef0015aff0 2024-09-19T09:22:49.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.063+0000 7feef1ffb640 1 --2- 172.21.15.18:0/2298403113 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7feee406c2b0 0x7feee406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:49.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.063+0000 7feef1ffb640 1 -- 172.21.15.18:0/2298403113 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5795+0+0 (secure 0 0 0) 0x7feef808af20 con 0x7fef0015aff0 2024-09-19T09:22:49.066 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.063+0000 7feef1ffb640 1 -- 172.21.15.18:0/2298403113 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=158}) -- 0x7feee4073ef0 con 0x7fef0015aff0 2024-09-19T09:22:49.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.063+0000 7fef056c8640 1 --2- 172.21.15.18:0/2298403113 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7feee406c2b0 0x7feee406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:49.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.064+0000 7fef056c8640 1 --2- 172.21.15.18:0/2298403113 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7feee406c2b0 0x7feee406e770 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7feefc007fd0 tx=0x7feefc007dc0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:49.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.067+0000 7feef1ffb640 1 -- 172.21.15.18:0/2298403113 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7feef8020020 con 0x7fef0015aff0 2024-09-19T09:22:49.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.277+0000 7fef0792c640 1 -- 172.21.15.18:0/2298403113 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fef000cd010 con 0x7fef0015aff0 2024-09-19T09:22:49.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.935+0000 7feef1ffb640 1 -- 172.21.15.18:0/2298403113 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v67) ==== 104+0+0 (secure 0 0 0) 0x7feef8059630 con 0x7fef0015aff0 2024-09-19T09:22:49.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.938+0000 7fef0792c640 1 -- 172.21.15.18:0/2298403113 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7feee406c2b0 msgr2=0x7feee406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:49.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.938+0000 7fef0792c640 1 --2- 172.21.15.18:0/2298403113 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7feee406c2b0 0x7feee406e770 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7feefc007fd0 tx=0x7feefc007dc0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.938+0000 7fef0792c640 1 -- 172.21.15.18:0/2298403113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef0015aff0 msgr2=0x7fef000b14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:49.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.938+0000 7fef0792c640 1 --2- 172.21.15.18:0/2298403113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef0015aff0 0x7fef000b14c0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7feef800c7a0 tx=0x7feef800cc60 comp rx=0 tx=0).stop 2024-09-19T09:22:49.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.938+0000 7fef0792c640 1 -- 172.21.15.18:0/2298403113 shutdown_connections 2024-09-19T09:22:49.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.938+0000 7fef0792c640 1 --2- 172.21.15.18:0/2298403113 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7feee406c2b0 0x7feee406e770 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.938+0000 7fef0792c640 1 --2- 172.21.15.18:0/2298403113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fef0015aff0 0x7fef000b14c0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.938+0000 7fef0792c640 1 --2- 172.21.15.18:0/2298403113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fef000af9b0 0x7fef00147370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.938+0000 7fef0792c640 1 --2- 172.21.15.18:0/2298403113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef000726c0 0x7fef0014a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:49.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.938+0000 7fef0792c640 1 -- 172.21.15.18:0/2298403113 >> 172.21.15.18:0/2298403113 conn(0x7fef0006bc10 msgr2=0x7fef00151330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:49.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.938+0000 7fef0792c640 1 -- 172.21.15.18:0/2298403113 shutdown_connections 2024-09-19T09:22:49.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:49.938+0000 7fef0792c640 1 -- 172.21.15.18:0/2298403113 wait complete. 2024-09-19T09:22:49.952 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T09:22:50.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.104+0000 7f572497f640 1 Processor -- start 2024-09-19T09:22:50.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.104+0000 7f572497f640 1 -- start start 2024-09-19T09:22:50.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.105+0000 7f572497f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f572015a950 0x7f57200713e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:50.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.105+0000 7f572497f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f57200d0910 0x7f5720166790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:50.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.105+0000 7f572497f640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f572015e080 con 0x7f572015dbf0 2024-09-19T09:22:50.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.105+0000 7f572497f640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f5720071920 con 0x7f57200d0910 2024-09-19T09:22:50.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.105+0000 7f572497f640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f572006f8f0 con 0x7f572015a950 2024-09-19T09:22:50.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.105+0000 7f571ed9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f57200d0910 0x7f5720166790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:50.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.105+0000 7f571ed9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f57200d0910 0x7f5720166790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50394/0 (socket says 172.21.15.18:50394) 2024-09-19T09:22:50.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.105+0000 7f571ed9d640 1 -- 172.21.15.18:0/3655950304 learned_addr learned my addr 172.21.15.18:0/3655950304 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:50.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.105+0000 7f571e59c640 1 --2- 172.21.15.18:0/3655950304 >> v2:172.21.15.162:3300/0 conn(0x7f572015a950 0x7f57200713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:50.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.105+0000 7f571ed9d640 1 -- 172.21.15.18:0/3655950304 >> v2:172.21.15.162:3300/0 conn(0x7f572015a950 msgr2=0x7f57200713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:50.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.105+0000 7f571ed9d640 1 --2- 172.21.15.18:0/3655950304 >> v2:172.21.15.162:3300/0 conn(0x7f572015a950 0x7f57200713e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.105+0000 7f571ed9d640 1 -- 172.21.15.18:0/3655950304 >> v1:172.21.15.162:6789/0 conn(0x7f572015dbf0 legacy=0x7f57200cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:50.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.105+0000 7f571ed9d640 1 -- 172.21.15.18:0/3655950304 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f572006fbd0 con 0x7f57200d0910 2024-09-19T09:22:50.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.105+0000 7f571e59c640 1 --2- 172.21.15.18:0/3655950304 >> v2:172.21.15.162:3300/0 conn(0x7f572015a950 0x7f57200713e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:50.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.106+0000 7f571ed9d640 1 --2- 172.21.15.18:0/3655950304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57200d0910 0x7f5720166790 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f57200b56c0 tx=0x7f571802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dde656b30301656 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:50.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.106+0000 7f571d59a640 1 -- 172.21.15.18:0/3655950304 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5718036070 con 0x7f57200d0910 2024-09-19T09:22:50.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.106+0000 7f571d59a640 1 -- 172.21.15.18:0/3655950304 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5718031600 con 0x7f57200d0910 2024-09-19T09:22:50.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.106+0000 7f571d59a640 1 -- 172.21.15.18:0/3655950304 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57180319d0 con 0x7f57200d0910 2024-09-19T09:22:50.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.107+0000 7f572497f640 1 -- 172.21.15.18:0/3655950304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57200d0910 msgr2=0x7f5720166790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:50.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.107+0000 7f572497f640 1 --2- 172.21.15.18:0/3655950304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57200d0910 0x7f5720166790 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f57200b56c0 tx=0x7f571802a6a0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.107+0000 7f572497f640 1 -- 172.21.15.18:0/3655950304 shutdown_connections 2024-09-19T09:22:50.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.107+0000 7f572497f640 1 --2- 172.21.15.18:0/3655950304 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f57200d0910 0x7f5720166790 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.107+0000 7f572497f640 1 --2- 172.21.15.18:0/3655950304 >> v2:172.21.15.162:3300/0 conn(0x7f572015a950 0x7f57200713e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.107+0000 7f572497f640 1 -- 172.21.15.18:0/3655950304 >> 172.21.15.18:0/3655950304 conn(0x7f572009b9d0 msgr2=0x7f572009bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:50.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.107+0000 7f572497f640 1 -- 172.21.15.18:0/3655950304 shutdown_connections 2024-09-19T09:22:50.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.107+0000 7f572497f640 1 -- 172.21.15.18:0/3655950304 wait complete. 2024-09-19T09:22:50.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.108+0000 7f572497f640 1 Processor -- start 2024-09-19T09:22:50.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.108+0000 7f572497f640 1 -- start start 2024-09-19T09:22:50.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.109+0000 7f572497f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57200d0910 0x7f5720144440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:50.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.109+0000 7f572497f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f572015a950 0x7f57200b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:50.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.109+0000 7f572497f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57200b7400 0x7f5720144c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:50.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.109+0000 7f572497f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f57200d0110 con 0x7f572015a950 2024-09-19T09:22:50.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.109+0000 7f572497f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f572006feb0 con 0x7f57200d0910 2024-09-19T09:22:50.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.109+0000 7f572497f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f57200d0290 con 0x7f57200b7400 2024-09-19T09:22:50.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.109+0000 7f571dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f572015a950 0x7f57200b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:50.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.109+0000 7f571dd9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f572015a950 0x7f57200b22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50410/0 (socket says 172.21.15.18:50410) 2024-09-19T09:22:50.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.109+0000 7f571dd9b640 1 -- 172.21.15.18:0/104947195 learned_addr learned my addr 172.21.15.18:0/104947195 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:50.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.109+0000 7f571e59c640 1 --2- 172.21.15.18:0/104947195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57200d0910 0x7f5720144440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:50.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.109+0000 7f571ed9d640 1 --2- 172.21.15.18:0/104947195 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57200b7400 0x7f5720144c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:50.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.109+0000 7f571dd9b640 1 -- 172.21.15.18:0/104947195 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57200b7400 msgr2=0x7f5720144c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:50.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.109+0000 7f571dd9b640 1 --2- 172.21.15.18:0/104947195 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57200b7400 0x7f5720144c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.109+0000 7f571dd9b640 1 -- 172.21.15.18:0/104947195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57200d0910 msgr2=0x7f5720144440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:50.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.109+0000 7f571dd9b640 1 --2- 172.21.15.18:0/104947195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57200d0910 0x7f5720144440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.109+0000 7f571dd9b640 1 -- 172.21.15.18:0/104947195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5720144980 con 0x7f572015a950 2024-09-19T09:22:50.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.110+0000 7f571dd9b640 1 --2- 172.21.15.18:0/104947195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f572015a950 0x7f57200b22a0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f571400c480 tx=0x7f571400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:50.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.110+0000 7f570effd640 1 -- 172.21.15.18:0/104947195 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57140052d0 con 0x7f572015a950 2024-09-19T09:22:50.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.110+0000 7f570effd640 1 -- 172.21.15.18:0/104947195 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5714005470 con 0x7f572015a950 2024-09-19T09:22:50.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.110+0000 7f572497f640 1 -- 172.21.15.18:0/104947195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57200b27e0 con 0x7f572015a950 2024-09-19T09:22:50.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.110+0000 7f570effd640 1 -- 172.21.15.18:0/104947195 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5714012870 con 0x7f572015a950 2024-09-19T09:22:50.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.110+0000 7f572497f640 1 -- 172.21.15.18:0/104947195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57200b6360 con 0x7f572015a950 2024-09-19T09:22:50.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.111+0000 7f572497f640 1 -- 172.21.15.18:0/104947195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57200cfb80 con 0x7f572015a950 2024-09-19T09:22:50.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.111+0000 7f570effd640 1 -- 172.21.15.18:0/104947195 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5714012a10 con 0x7f572015a950 2024-09-19T09:22:50.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.112+0000 7f570effd640 1 --2- 172.21.15.18:0/104947195 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f570006c2b0 0x7f570006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:50.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.112+0000 7f570effd640 1 -- 172.21.15.18:0/104947195 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(157..157 src has 1..157) ==== 5795+0+0 (secure 0 0 0) 0x7f571408b050 con 0x7f572015a950 2024-09-19T09:22:50.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.112+0000 7f571e59c640 1 --2- 172.21.15.18:0/104947195 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f570006c2b0 0x7f570006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:50.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.112+0000 7f570effd640 1 -- 172.21.15.18:0/104947195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=158}) -- 0x7f5700073ef0 con 0x7f572015a950 2024-09-19T09:22:50.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.112+0000 7f571e59c640 1 --2- 172.21.15.18:0/104947195 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f570006c2b0 0x7f570006e770 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5710006fd0 tx=0x7f5710008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:50.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.116+0000 7f570effd640 1 -- 172.21.15.18:0/104947195 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5720144980 con 0x7f572015a950 2024-09-19T09:22:50.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.289+0000 7f572497f640 1 -- 172.21.15.18:0/104947195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f57200d11e0 con 0x7f572015a950 2024-09-19T09:22:50.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.937+0000 7f570effd640 1 -- 172.21.15.18:0/104947195 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v158) ==== 181+0+0 (secure 0 0 0) 0x7f5714059770 con 0x7f572015a950 2024-09-19T09:22:50.938 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' removed 2024-09-19T09:22:50.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.937+0000 7f570effd640 1 -- 172.21.15.18:0/104947195 <== mon.0 v2:172.21.15.18:3300/0 8 ==== osd_map(158..158 src has 1..158) ==== 296+0+0 (secure 0 0 0) 0x7f57140bfda0 con 0x7f572015a950 2024-09-19T09:22:50.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.937+0000 7f570effd640 1 -- 172.21.15.18:0/104947195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=159}) -- 0x7f5700072320 con 0x7f572015a950 2024-09-19T09:22:50.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.945+0000 7f572497f640 1 -- 172.21.15.18:0/104947195 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f570006c2b0 msgr2=0x7f570006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:50.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.945+0000 7f572497f640 1 --2- 172.21.15.18:0/104947195 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f570006c2b0 0x7f570006e770 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5710006fd0 tx=0x7f5710008040 comp rx=0 tx=0).stop 2024-09-19T09:22:50.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.945+0000 7f572497f640 1 -- 172.21.15.18:0/104947195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f572015a950 msgr2=0x7f57200b22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:50.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.945+0000 7f572497f640 1 --2- 172.21.15.18:0/104947195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f572015a950 0x7f57200b22a0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f571400c480 tx=0x7f571400c940 comp rx=0 tx=0).stop 2024-09-19T09:22:50.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.945+0000 7f572497f640 1 -- 172.21.15.18:0/104947195 shutdown_connections 2024-09-19T09:22:50.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.945+0000 7f572497f640 1 --2- 172.21.15.18:0/104947195 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f570006c2b0 0x7f570006e770 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.945+0000 7f572497f640 1 --2- 172.21.15.18:0/104947195 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f57200b7400 0x7f5720144c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.945+0000 7f572497f640 1 --2- 172.21.15.18:0/104947195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f572015a950 0x7f57200b22a0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.945+0000 7f572497f640 1 --2- 172.21.15.18:0/104947195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f57200d0910 0x7f5720144440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:50.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.945+0000 7f572497f640 1 -- 172.21.15.18:0/104947195 >> 172.21.15.18:0/104947195 conn(0x7f572009b9d0 msgr2=0x7f572009bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:50.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.945+0000 7f572497f640 1 -- 172.21.15.18:0/104947195 shutdown_connections 2024-09-19T09:22:50.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:50.945+0000 7f572497f640 1 -- 172.21.15.18:0/104947195 wait complete. 2024-09-19T09:22:50.959 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T09:22:51.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.069+0000 7fb287bb7640 1 Processor -- start 2024-09-19T09:22:51.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.069+0000 7fb287bb7640 1 -- start start 2024-09-19T09:22:51.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.070+0000 7fb287bb7640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb2800cfa60 0x7fb2800b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:51.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.070+0000 7fb287bb7640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2800b3bf0 con 0x7fb280162410 2024-09-19T09:22:51.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.070+0000 7fb287bb7640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb28006d8d0 con 0x7fb2800b5180 2024-09-19T09:22:51.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.070+0000 7fb287bb7640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb28006df20 con 0x7fb2800cfa60 2024-09-19T09:22:51.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.070+0000 7fb285953640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb280162410 0x7fb2800cf350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56320/0 (socket says 172.21.15.18:56320) 2024-09-19T09:22:51.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.070+0000 7fb285953640 1 -- 172.21.15.18:0/2588269124 learned_addr learned my addr 172.21.15.18:0/2588269124 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:22:51.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.071+0000 7fb284951640 1 -- 172.21.15.18:0/2588269124 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1923584569 0 0) 0x7fb2800b3bf0 con 0x7fb280162410 2024-09-19T09:22:51.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.071+0000 7fb285152640 1 --2- 172.21.15.18:0/2588269124 >> v2:172.21.15.162:3300/0 conn(0x7fb2800cfa60 0x7fb2800b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:51.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.071+0000 7fb284951640 1 -- 172.21.15.18:0/2588269124 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb26c003520 con 0x7fb280162410 2024-09-19T09:22:51.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.071+0000 7fb284951640 1 -- 172.21.15.18:0/2588269124 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3411874862 0 0) 0x7fb26c003520 con 0x7fb280162410 2024-09-19T09:22:51.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.071+0000 7fb284951640 1 -- 172.21.15.18:0/2588269124 >> v2:172.21.15.162:3300/0 conn(0x7fb2800cfa60 msgr2=0x7fb2800b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:51.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.071+0000 7fb284951640 1 --2- 172.21.15.18:0/2588269124 >> v2:172.21.15.162:3300/0 conn(0x7fb2800cfa60 0x7fb2800b35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.071+0000 7fb284951640 1 -- 172.21.15.18:0/2588269124 >> v1:172.21.15.162:6789/0 conn(0x7fb2800b5180 legacy=0x7fb2800d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:51.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.071+0000 7fb284951640 1 -- 172.21.15.18:0/2588269124 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28006dbb0 con 0x7fb280162410 2024-09-19T09:22:51.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.071+0000 7fb284951640 1 -- 172.21.15.18:0/2588269124 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fb27c001670 con 0x7fb280162410 2024-09-19T09:22:51.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.071+0000 7fb284951640 1 -- 172.21.15.18:0/2588269124 >> v1:172.21.15.18:6789/0 conn(0x7fb280162410 legacy=0x7fb2800cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:51.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.071+0000 7fb284951640 1 --2- 172.21.15.18:0/2588269124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb26c0039b0 0x7fb26c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:51.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.071+0000 7fb284951640 1 --2- 172.21.15.18:0/2588269124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb26c004800 0x7fb26c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:51.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.071+0000 7fb284951640 1 --2- 172.21.15.18:0/2588269124 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb26c0051c0 0x7fb26c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:51.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.071+0000 7fb284951640 1 -- 172.21.15.18:0/2588269124 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb28006df20 con 0x7fb26c004800 2024-09-19T09:22:51.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.071+0000 7fb284951640 1 -- 172.21.15.18:0/2588269124 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb26c00c060 con 0x7fb26c0039b0 2024-09-19T09:22:51.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.071+0000 7fb284951640 1 -- 172.21.15.18:0/2588269124 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb26c00c260 con 0x7fb26c0051c0 2024-09-19T09:22:51.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.071+0000 7fb285152640 1 --2- 172.21.15.18:0/2588269124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb26c004800 0x7fb26c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:51.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.071+0000 7fb285953640 1 --2- 172.21.15.18:0/2588269124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb26c0039b0 0x7fb26c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:51.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.071+0000 7fb286154640 1 --2- 172.21.15.18:0/2588269124 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb26c0051c0 0x7fb26c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:51.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.071+0000 7fb285152640 1 -- 172.21.15.18:0/2588269124 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb26c0051c0 msgr2=0x7fb26c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:51.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.071+0000 7fb285152640 1 --2- 172.21.15.18:0/2588269124 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb26c0051c0 0x7fb26c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.071+0000 7fb285152640 1 -- 172.21.15.18:0/2588269124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb26c0039b0 msgr2=0x7fb26c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:51.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.071+0000 7fb285152640 1 --2- 172.21.15.18:0/2588269124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb26c0039b0 0x7fb26c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.071+0000 7fb285152640 1 -- 172.21.15.18:0/2588269124 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb26c003520 con 0x7fb26c004800 2024-09-19T09:22:51.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.071+0000 7fb286154640 1 -- 172.21.15.18:0/2588269124 reap_dead start 2024-09-19T09:22:51.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.071+0000 7fb285953640 1 --2- 172.21.15.18:0/2588269124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb26c0039b0 0x7fb26c003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:51.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.072+0000 7fb285152640 1 --2- 172.21.15.18:0/2588269124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb26c004800 0x7fb26c004c80 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fb274009ac0 tx=0x7fb26c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a81a74e024483e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:51.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.072+0000 7fb284951640 1 -- 172.21.15.18:0/2588269124 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb274036070 con 0x7fb26c004800 2024-09-19T09:22:51.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.072+0000 7fb284951640 1 -- 172.21.15.18:0/2588269124 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb274031400 con 0x7fb26c004800 2024-09-19T09:22:51.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.072+0000 7fb284951640 1 -- 172.21.15.18:0/2588269124 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb274009690 con 0x7fb26c004800 2024-09-19T09:22:51.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.073+0000 7fb287bb7640 1 -- 172.21.15.18:0/2588269124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb26c004800 msgr2=0x7fb26c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:51.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.073+0000 7fb287bb7640 1 --2- 172.21.15.18:0/2588269124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb26c004800 0x7fb26c004c80 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7fb274009ac0 tx=0x7fb26c005830 comp rx=0 tx=0).stop 2024-09-19T09:22:51.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.073+0000 7fb287bb7640 1 -- 172.21.15.18:0/2588269124 shutdown_connections 2024-09-19T09:22:51.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.073+0000 7fb287bb7640 1 --2- 172.21.15.18:0/2588269124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb26c004800 0x7fb26c004c80 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.073+0000 7fb287bb7640 1 -- 172.21.15.18:0/2588269124 >> 172.21.15.18:0/2588269124 conn(0x7fb2800b4660 msgr2=0x7fb2800b4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:51.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.073+0000 7fb287bb7640 1 -- 172.21.15.18:0/2588269124 shutdown_connections 2024-09-19T09:22:51.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.073+0000 7fb287bb7640 1 -- 172.21.15.18:0/2588269124 wait complete. 2024-09-19T09:22:51.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.074+0000 7fb287bb7640 1 Processor -- start 2024-09-19T09:22:51.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.074+0000 7fb287bb7640 1 -- start start 2024-09-19T09:22:51.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.075+0000 7fb287bb7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb26c004800 0x7fb2800d14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:51.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.075+0000 7fb287bb7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb280161220 0x7fb28014d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:51.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.075+0000 7fb287bb7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb28014d7f0 0x7fb28014a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:51.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.075+0000 7fb287bb7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb2800d00e0 con 0x7fb280161220 2024-09-19T09:22:51.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.075+0000 7fb287bb7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb2800cff60 con 0x7fb26c004800 2024-09-19T09:22:51.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.075+0000 7fb287bb7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb2800cf350 con 0x7fb28014d7f0 2024-09-19T09:22:51.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.075+0000 7fb285152640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb280161220 0x7fb28014d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:51.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.075+0000 7fb285152640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb280161220 0x7fb28014d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50428/0 (socket says 172.21.15.18:50428) 2024-09-19T09:22:51.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.075+0000 7fb285152640 1 -- 172.21.15.18:0/119867964 learned_addr learned my addr 172.21.15.18:0/119867964 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:51.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.075+0000 7fb285953640 1 --2- 172.21.15.18:0/119867964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb26c004800 0x7fb2800d14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:51.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.075+0000 7fb286154640 1 --2- 172.21.15.18:0/119867964 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb28014d7f0 0x7fb28014a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:51.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.075+0000 7fb285152640 1 -- 172.21.15.18:0/119867964 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb28014d7f0 msgr2=0x7fb28014a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:51.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.075+0000 7fb285152640 1 --2- 172.21.15.18:0/119867964 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb28014d7f0 0x7fb28014a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.075+0000 7fb285152640 1 -- 172.21.15.18:0/119867964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb26c004800 msgr2=0x7fb2800d14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:51.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.075+0000 7fb285152640 1 --2- 172.21.15.18:0/119867964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb26c004800 0x7fb2800d14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.075+0000 7fb285152640 1 -- 172.21.15.18:0/119867964 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28014dd30 con 0x7fb280161220 2024-09-19T09:22:51.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.075+0000 7fb285953640 1 --2- 172.21.15.18:0/119867964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb26c004800 0x7fb2800d14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:51.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.075+0000 7fb285152640 1 --2- 172.21.15.18:0/119867964 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb280161220 0x7fb28014d2b0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fb274034040 tx=0x7fb274004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:51.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.076+0000 7fb2727fc640 1 -- 172.21.15.18:0/119867964 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27403f020 con 0x7fb280161220 2024-09-19T09:22:51.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.076+0000 7fb2727fc640 1 -- 172.21.15.18:0/119867964 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb274037040 con 0x7fb280161220 2024-09-19T09:22:51.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.076+0000 7fb287bb7640 1 -- 172.21.15.18:0/119867964 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb28014e010 con 0x7fb280161220 2024-09-19T09:22:51.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.076+0000 7fb2727fc640 1 -- 172.21.15.18:0/119867964 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb274036070 con 0x7fb280161220 2024-09-19T09:22:51.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.076+0000 7fb287bb7640 1 -- 172.21.15.18:0/119867964 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2801514b0 con 0x7fb280161220 2024-09-19T09:22:51.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.077+0000 7fb287bb7640 1 -- 172.21.15.18:0/119867964 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2800cf650 con 0x7fb280161220 2024-09-19T09:22:51.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.077+0000 7fb2727fc640 1 -- 172.21.15.18:0/119867964 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb274042020 con 0x7fb280161220 2024-09-19T09:22:51.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.078+0000 7fb2727fc640 1 --2- 172.21.15.18:0/119867964 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb26406c2e0 0x7fb26406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:51.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.078+0000 7fb2727fc640 1 -- 172.21.15.18:0/119867964 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 5357+0+0 (secure 0 0 0) 0x7fb2740ab370 con 0x7fb280161220 2024-09-19T09:22:51.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.078+0000 7fb285953640 1 --2- 172.21.15.18:0/119867964 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb26406c2e0 0x7fb26406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:51.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.078+0000 7fb2727fc640 1 -- 172.21.15.18:0/119867964 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=159}) -- 0x7fb2640730b0 con 0x7fb280161220 2024-09-19T09:22:51.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.079+0000 7fb285953640 1 --2- 172.21.15.18:0/119867964 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb26406c2e0 0x7fb26406e7a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb27c001cd0 tx=0x7fb27c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:51.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.082+0000 7fb2727fc640 1 -- 172.21.15.18:0/119867964 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb274049030 con 0x7fb280161220 2024-09-19T09:22:51.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.260+0000 7fb287bb7640 1 -- 172.21.15.18:0/119867964 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb2800d28b0 con 0x7fb280161220 2024-09-19T09:22:51.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.938+0000 7fb2727fc640 1 -- 172.21.15.18:0/119867964 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v159) ==== 169+0+0 (secure 0 0 0) 0x7fb274079cf0 con 0x7fb280161220 2024-09-19T09:22:51.940 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' removed 2024-09-19T09:22:51.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.939+0000 7fb2727fc640 1 -- 172.21.15.18:0/119867964 <== mon.0 v2:172.21.15.18:3300/0 8 ==== osd_map(159..159 src has 1..159) ==== 296+0+0 (secure 0 0 0) 0x7fb2740dfda0 con 0x7fb280161220 2024-09-19T09:22:51.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.939+0000 7fb2727fc640 1 -- 172.21.15.18:0/119867964 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=160}) -- 0x7fb264071ea0 con 0x7fb280161220 2024-09-19T09:22:51.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.941+0000 7fb287bb7640 1 -- 172.21.15.18:0/119867964 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb26406c2e0 msgr2=0x7fb26406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:51.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.941+0000 7fb287bb7640 1 --2- 172.21.15.18:0/119867964 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb26406c2e0 0x7fb26406e7a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fb27c001cd0 tx=0x7fb27c009040 comp rx=0 tx=0).stop 2024-09-19T09:22:51.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.941+0000 7fb287bb7640 1 -- 172.21.15.18:0/119867964 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb280161220 msgr2=0x7fb28014d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:51.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.941+0000 7fb287bb7640 1 --2- 172.21.15.18:0/119867964 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb280161220 0x7fb28014d2b0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fb274034040 tx=0x7fb274004730 comp rx=0 tx=0).stop 2024-09-19T09:22:51.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.941+0000 7fb287bb7640 1 -- 172.21.15.18:0/119867964 shutdown_connections 2024-09-19T09:22:51.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.941+0000 7fb287bb7640 1 --2- 172.21.15.18:0/119867964 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb26406c2e0 0x7fb26406e7a0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.941+0000 7fb287bb7640 1 --2- 172.21.15.18:0/119867964 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb28014d7f0 0x7fb28014a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.941+0000 7fb287bb7640 1 --2- 172.21.15.18:0/119867964 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb280161220 0x7fb28014d2b0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.941+0000 7fb287bb7640 1 --2- 172.21.15.18:0/119867964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb26c004800 0x7fb2800d14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:51.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.941+0000 7fb287bb7640 1 -- 172.21.15.18:0/119867964 >> 172.21.15.18:0/119867964 conn(0x7fb2800b4660 msgr2=0x7fb2800ce9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:51.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.948+0000 7fb287bb7640 1 -- 172.21.15.18:0/119867964 shutdown_connections 2024-09-19T09:22:51.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:51.948+0000 7fb287bb7640 1 -- 172.21.15.18:0/119867964 wait complete. 2024-09-19T09:22:51.963 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-19T09:22:52.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.069+0000 7fca7784c640 1 Processor -- start 2024-09-19T09:22:52.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.070+0000 7fca7784c640 1 -- start start 2024-09-19T09:22:52.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.070+0000 7fca7784c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fca7015b760 0x7fca700afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.070+0000 7fca7784c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fca700b4a90 0x7fca7006f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.070+0000 7fca7784c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca700b4300 con 0x7fca700d0630 2024-09-19T09:22:52.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.070+0000 7fca7784c640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fca7006d700 con 0x7fca7015b760 2024-09-19T09:22:52.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.070+0000 7fca7784c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fca7006d9e0 con 0x7fca700b4a90 2024-09-19T09:22:52.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.071+0000 7fca755e8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fca7015b760 0x7fca700afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:52.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.071+0000 7fca755e8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fca7015b760 0x7fca700afa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50444/0 (socket says 172.21.15.18:50444) 2024-09-19T09:22:52.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.071+0000 7fca75de9640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fca700d0630 0x7fca700d0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56332/0 (socket says 172.21.15.18:56332) 2024-09-19T09:22:52.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.071+0000 7fca755e8640 1 -- 172.21.15.18:0/1173912493 learned_addr learned my addr 172.21.15.18:0/1173912493 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:52.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.071+0000 7fca74de7640 1 --2- 172.21.15.18:0/1173912493 >> v2:172.21.15.162:3300/0 conn(0x7fca700b4a90 0x7fca7006f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:52.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.071+0000 7fca755e8640 1 -- 172.21.15.18:0/1173912493 >> v2:172.21.15.162:3300/0 conn(0x7fca700b4a90 msgr2=0x7fca7006f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:52.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.071+0000 7fca755e8640 1 --2- 172.21.15.18:0/1173912493 >> v2:172.21.15.162:3300/0 conn(0x7fca700b4a90 0x7fca7006f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.071+0000 7fca755e8640 1 -- 172.21.15.18:0/1173912493 >> v1:172.21.15.18:6789/0 conn(0x7fca700d0630 legacy=0x7fca700d0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:52.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.071+0000 7fca755e8640 1 -- 172.21.15.18:0/1173912493 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca700b4570 con 0x7fca7015b760 2024-09-19T09:22:52.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.071+0000 7fca67fff640 1 -- 172.21.15.18:0/1173912493 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 989129352 0 0) 0x7fca700b4300 con 0x7fca700d0630 2024-09-19T09:22:52.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.071+0000 7fca74de7640 1 --2- 172.21.15.18:0/1173912493 >> v2:172.21.15.162:3300/0 conn(0x7fca700b4a90 0x7fca7006f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:22:52.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.072+0000 7fca755e8640 1 --2- 172.21.15.18:0/1173912493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca7015b760 0x7fca700afa90 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fca700d1500 tx=0x7fca6c02a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ea3218f5556903f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:52.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.072+0000 7fca67fff640 1 -- 172.21.15.18:0/1173912493 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c037070 con 0x7fca7015b760 2024-09-19T09:22:52.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.072+0000 7fca67fff640 1 -- 172.21.15.18:0/1173912493 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca6c032440 con 0x7fca7015b760 2024-09-19T09:22:52.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.072+0000 7fca67fff640 1 -- 172.21.15.18:0/1173912493 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c032810 con 0x7fca7015b760 2024-09-19T09:22:52.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.072+0000 7fca7784c640 1 -- 172.21.15.18:0/1173912493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca7015b760 msgr2=0x7fca700afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:52.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.072+0000 7fca7784c640 1 --2- 172.21.15.18:0/1173912493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca7015b760 0x7fca700afa90 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fca700d1500 tx=0x7fca6c02a150 comp rx=0 tx=0).stop 2024-09-19T09:22:52.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.072+0000 7fca7784c640 1 -- 172.21.15.18:0/1173912493 shutdown_connections 2024-09-19T09:22:52.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.072+0000 7fca7784c640 1 --2- 172.21.15.18:0/1173912493 >> v2:172.21.15.162:3300/0 conn(0x7fca700b4a90 0x7fca7006f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.072+0000 7fca7784c640 1 --2- 172.21.15.18:0/1173912493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca7015b760 0x7fca700afa90 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.072+0000 7fca7784c640 1 -- 172.21.15.18:0/1173912493 >> 172.21.15.18:0/1173912493 conn(0x7fca7006bc10 msgr2=0x7fca7006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:52.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.073+0000 7fca7784c640 1 -- 172.21.15.18:0/1173912493 shutdown_connections 2024-09-19T09:22:52.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.073+0000 7fca7784c640 1 -- 172.21.15.18:0/1173912493 wait complete. 2024-09-19T09:22:52.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.074+0000 7fca7784c640 1 Processor -- start 2024-09-19T09:22:52.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.074+0000 7fca7784c640 1 -- start start 2024-09-19T09:22:52.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.074+0000 7fca7784c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca700b4a90 0x7fca701f3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.074+0000 7fca7784c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca700d0630 0x7fca7014d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.074+0000 7fca7784c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca7015b760 0x7fca701efde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.074+0000 7fca7784c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fca700b4f20 con 0x7fca700d0630 2024-09-19T09:22:52.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.074+0000 7fca7784c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fca7015bb40 con 0x7fca7015b760 2024-09-19T09:22:52.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.074+0000 7fca7784c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fca701f42d0 con 0x7fca700b4a90 2024-09-19T09:22:52.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.075+0000 7fca74de7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca700d0630 0x7fca7014d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:52.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.075+0000 7fca74de7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca700d0630 0x7fca7014d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50460/0 (socket says 172.21.15.18:50460) 2024-09-19T09:22:52.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.075+0000 7fca74de7640 1 -- 172.21.15.18:0/4178974124 learned_addr learned my addr 172.21.15.18:0/4178974124 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:52.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.075+0000 7fca75de9640 1 --2- 172.21.15.18:0/4178974124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca7015b760 0x7fca701efde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:52.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.075+0000 7fca74de7640 1 -- 172.21.15.18:0/4178974124 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca700b4a90 msgr2=0x7fca701f3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:52.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.075+0000 7fca74de7640 1 --2- 172.21.15.18:0/4178974124 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca700b4a90 0x7fca701f3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.075+0000 7fca74de7640 1 -- 172.21.15.18:0/4178974124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca7015b760 msgr2=0x7fca701efde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:52.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.075+0000 7fca74de7640 1 --2- 172.21.15.18:0/4178974124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca7015b760 0x7fca701efde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.075+0000 7fca74de7640 1 -- 172.21.15.18:0/4178974124 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca701f0800 con 0x7fca700d0630 2024-09-19T09:22:52.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.075+0000 7fca75de9640 1 --2- 172.21.15.18:0/4178974124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca7015b760 0x7fca701efde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:22:52.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.075+0000 7fca74de7640 1 --2- 172.21.15.18:0/4178974124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca700d0630 0x7fca7014d2f0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fca6000c820 tx=0x7fca6000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:52.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.075+0000 7fca65ffb640 1 -- 172.21.15.18:0/4178974124 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca60015070 con 0x7fca700d0630 2024-09-19T09:22:52.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.075+0000 7fca65ffb640 1 -- 172.21.15.18:0/4178974124 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca600079d0 con 0x7fca700d0630 2024-09-19T09:22:52.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.075+0000 7fca7784c640 1 -- 172.21.15.18:0/4178974124 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca701f0ae0 con 0x7fca700d0630 2024-09-19T09:22:52.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.075+0000 7fca65ffb640 1 -- 172.21.15.18:0/4178974124 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca60007da0 con 0x7fca700d0630 2024-09-19T09:22:52.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.075+0000 7fca7784c640 1 -- 172.21.15.18:0/4178974124 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca7014d830 con 0x7fca700d0630 2024-09-19T09:22:52.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.076+0000 7fca7784c640 1 -- 172.21.15.18:0/4178974124 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca7006dcc0 con 0x7fca700d0630 2024-09-19T09:22:52.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.077+0000 7fca65ffb640 1 -- 172.21.15.18:0/4178974124 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fca60018070 con 0x7fca700d0630 2024-09-19T09:22:52.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.077+0000 7fca65ffb640 1 --2- 172.21.15.18:0/4178974124 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fca5406c2b0 0x7fca5406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.077+0000 7fca65ffb640 1 -- 172.21.15.18:0/4178974124 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 4943+0+0 (secure 0 0 0) 0x7fca6008b140 con 0x7fca700d0630 2024-09-19T09:22:52.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.078+0000 7fca755e8640 1 --2- 172.21.15.18:0/4178974124 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fca5406c2b0 0x7fca5406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:52.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.078+0000 7fca755e8640 1 --2- 172.21.15.18:0/4178974124 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fca5406c2b0 0x7fca5406e770 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fca6c034000 tx=0x7fca6c02c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:52.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.082+0000 7fca65ffb640 1 -- 172.21.15.18:0/4178974124 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fca60059b10 con 0x7fca700d0630 2024-09-19T09:22:52.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.256+0000 7fca7784c640 1 -- 172.21.15.18:0/4178974124 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7fca700aff00 con 0x7fca700d0630 2024-09-19T09:22:52.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.259+0000 7fca65ffb640 1 -- 172.21.15.18:0/4178974124 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7fca60059410 con 0x7fca700d0630 2024-09-19T09:22:52.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.261+0000 7fca7784c640 1 -- 172.21.15.18:0/4178974124 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fca5406c2b0 msgr2=0x7fca5406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:52.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.261+0000 7fca7784c640 1 --2- 172.21.15.18:0/4178974124 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fca5406c2b0 0x7fca5406e770 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fca6c034000 tx=0x7fca6c02c000 comp rx=0 tx=0).stop 2024-09-19T09:22:52.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.261+0000 7fca7784c640 1 -- 172.21.15.18:0/4178974124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca700d0630 msgr2=0x7fca7014d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:52.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.261+0000 7fca7784c640 1 --2- 172.21.15.18:0/4178974124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca700d0630 0x7fca7014d2f0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fca6000c820 tx=0x7fca6000cc20 comp rx=0 tx=0).stop 2024-09-19T09:22:52.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.261+0000 7fca7784c640 1 -- 172.21.15.18:0/4178974124 shutdown_connections 2024-09-19T09:22:52.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.261+0000 7fca7784c640 1 --2- 172.21.15.18:0/4178974124 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fca5406c2b0 0x7fca5406e770 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.261+0000 7fca7784c640 1 --2- 172.21.15.18:0/4178974124 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca7015b760 0x7fca701efde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.261+0000 7fca7784c640 1 --2- 172.21.15.18:0/4178974124 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca700d0630 0x7fca7014d2f0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.261+0000 7fca7784c640 1 --2- 172.21.15.18:0/4178974124 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca700b4a90 0x7fca701f3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.261+0000 7fca7784c640 1 -- 172.21.15.18:0/4178974124 >> 172.21.15.18:0/4178974124 conn(0x7fca7006bc10 msgr2=0x7fca70158d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:52.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.261+0000 7fca7784c640 1 -- 172.21.15.18:0/4178974124 shutdown_connections 2024-09-19T09:22:52.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.261+0000 7fca7784c640 1 -- 172.21.15.18:0/4178974124 wait complete. 2024-09-19T09:22:52.273 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2024-09-19T09:22:52.376 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.375+0000 7f4d6485c640 1 Processor -- start 2024-09-19T09:22:52.377 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.375+0000 7f4d6485c640 1 -- start start 2024-09-19T09:22:52.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.376+0000 7f4d6485c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d6015ecc0 0x7f4d600d3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.376+0000 7f4d6485c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4d600d57a0 0x7f4d600d1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.376+0000 7f4d6485c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d600d3b20 con 0x7f4d600d1990 2024-09-19T09:22:52.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.376+0000 7f4d6485c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4d600b42f0 con 0x7f4d600d57a0 2024-09-19T09:22:52.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.376+0000 7f4d6485c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4d600b45d0 con 0x7f4d6015ecc0 2024-09-19T09:22:52.379 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.376+0000 7f4d5ed9d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f4d600d1990 0x7f4d600cf820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56346/0 (socket says 172.21.15.18:56346) 2024-09-19T09:22:52.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.376+0000 7f4d5ed9d640 1 -- 172.21.15.18:0/2431725663 learned_addr learned my addr 172.21.15.18:0/2431725663 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:22:52.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.377+0000 7f4d5e59c640 1 --2- 172.21.15.18:0/2431725663 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d6015ecc0 0x7f4d600d3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:52.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.377+0000 7f4d5dd9b640 1 --2- 172.21.15.18:0/2431725663 >> v2:172.21.15.162:3300/0 conn(0x7f4d600d57a0 0x7f4d600d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:52.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.377+0000 7f4d5d59a640 1 -- 172.21.15.18:0/2431725663 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1009369121 0 0) 0x7f4d600d3b20 con 0x7f4d600d1990 2024-09-19T09:22:52.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.377+0000 7f4d5d59a640 1 -- 172.21.15.18:0/2431725663 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d4c003520 con 0x7f4d600d1990 2024-09-19T09:22:52.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.377+0000 7f4d5d59a640 1 -- 172.21.15.18:0/2431725663 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 630929609 0 0) 0x7f4d4c003520 con 0x7f4d600d1990 2024-09-19T09:22:52.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.377+0000 7f4d5d59a640 1 -- 172.21.15.18:0/2431725663 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d6015ecc0 msgr2=0x7f4d600d3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:52.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.377+0000 7f4d5d59a640 1 --2- 172.21.15.18:0/2431725663 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d6015ecc0 0x7f4d600d3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.377+0000 7f4d5d59a640 1 -- 172.21.15.18:0/2431725663 >> v2:172.21.15.162:3300/0 conn(0x7f4d600d57a0 msgr2=0x7f4d600d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:52.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.377+0000 7f4d5d59a640 1 --2- 172.21.15.18:0/2431725663 >> v2:172.21.15.162:3300/0 conn(0x7f4d600d57a0 0x7f4d600d1450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.377+0000 7f4d5d59a640 1 -- 172.21.15.18:0/2431725663 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d600b48b0 con 0x7f4d600d1990 2024-09-19T09:22:52.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.377+0000 7f4d5d59a640 1 -- 172.21.15.18:0/2431725663 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f4d58001670 con 0x7f4d600d1990 2024-09-19T09:22:52.380 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.377+0000 7f4d5d59a640 1 -- 172.21.15.18:0/2431725663 >> v1:172.21.15.18:6789/0 conn(0x7f4d600d1990 legacy=0x7f4d600cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:52.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.377+0000 7f4d5d59a640 1 --2- 172.21.15.18:0/2431725663 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d6015ecc0 0x7f4d4c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.377+0000 7f4d5d59a640 1 --2- 172.21.15.18:0/2431725663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d4c003f30 0x7f4d4c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.377+0000 7f4d5d59a640 1 --2- 172.21.15.18:0/2431725663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d4c004d40 0x7f4d4c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.377+0000 7f4d5d59a640 1 -- 172.21.15.18:0/2431725663 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4d600b42f0 con 0x7f4d4c004d40 2024-09-19T09:22:52.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.377+0000 7f4d5d59a640 1 -- 172.21.15.18:0/2431725663 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4d600b45d0 con 0x7f4d4c003f30 2024-09-19T09:22:52.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.377+0000 7f4d5d59a640 1 -- 172.21.15.18:0/2431725663 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4d4c00b9c0 con 0x7f4d6015ecc0 2024-09-19T09:22:52.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.377+0000 7f4d5ed9d640 1 --2- 172.21.15.18:0/2431725663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d4c004d40 0x7f4d4c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:52.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.377+0000 7f4d5e59c640 1 --2- 172.21.15.18:0/2431725663 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d6015ecc0 0x7f4d4c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:52.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.377+0000 7f4d5dd9b640 1 --2- 172.21.15.18:0/2431725663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d4c003f30 0x7f4d4c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:52.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.378+0000 7f4d5ed9d640 1 -- 172.21.15.18:0/2431725663 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d6015ecc0 msgr2=0x7f4d4c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:52.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.378+0000 7f4d5ed9d640 1 --2- 172.21.15.18:0/2431725663 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d6015ecc0 0x7f4d4c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.378+0000 7f4d5ed9d640 1 -- 172.21.15.18:0/2431725663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d4c003f30 msgr2=0x7f4d4c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:52.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.378+0000 7f4d5ed9d640 1 --2- 172.21.15.18:0/2431725663 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d4c003f30 0x7f4d4c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.381 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.378+0000 7f4d5ed9d640 1 -- 172.21.15.18:0/2431725663 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d4c003520 con 0x7f4d4c004d40 2024-09-19T09:22:52.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.378+0000 7f4d5ed9d640 1 --2- 172.21.15.18:0/2431725663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d4c004d40 0x7f4d4c0051c0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f4d58001050 tx=0x7f4d4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364c0e2a1d3c5122 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:52.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.378+0000 7f4d5d59a640 1 -- 172.21.15.18:0/2431725663 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d58007d70 con 0x7f4d4c004d40 2024-09-19T09:22:52.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.378+0000 7f4d5d59a640 1 -- 172.21.15.18:0/2431725663 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d58005af0 con 0x7f4d4c004d40 2024-09-19T09:22:52.382 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.378+0000 7f4d5d59a640 1 -- 172.21.15.18:0/2431725663 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d58007070 con 0x7f4d4c004d40 2024-09-19T09:22:52.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.379+0000 7f4d6485c640 1 -- 172.21.15.18:0/2431725663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d4c004d40 msgr2=0x7f4d4c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:52.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.379+0000 7f4d6485c640 1 --2- 172.21.15.18:0/2431725663 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d4c004d40 0x7f4d4c0051c0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f4d58001050 tx=0x7f4d4c005830 comp rx=0 tx=0).stop 2024-09-19T09:22:52.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.379+0000 7f4d5ed9d640 1 -- 172.21.15.18:0/2431725663 reap_dead start 2024-09-19T09:22:52.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.379+0000 7f4d6485c640 1 -- 172.21.15.18:0/2431725663 shutdown_connections 2024-09-19T09:22:52.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.379+0000 7f4d6485c640 1 -- 172.21.15.18:0/2431725663 >> 172.21.15.18:0/2431725663 conn(0x7f4d600d4bd0 msgr2=0x7f4d600d4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:52.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.379+0000 7f4d6485c640 1 -- 172.21.15.18:0/2431725663 shutdown_connections 2024-09-19T09:22:52.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.379+0000 7f4d6485c640 1 -- 172.21.15.18:0/2431725663 wait complete. 2024-09-19T09:22:52.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.381+0000 7f4d6485c640 1 Processor -- start 2024-09-19T09:22:52.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.381+0000 7f4d6485c640 1 -- start start 2024-09-19T09:22:52.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.381+0000 7f4d6485c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d4c004d40 0x7f4d60158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.381+0000 7f4d6485c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d600ceb70 0x7f4d601f4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.381+0000 7f4d6485c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d6015a770 0x7f4d6015ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.381+0000 7f4d6485c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6015f220 con 0x7f4d6015a770 2024-09-19T09:22:52.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.381+0000 7f4d6485c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4d6015f0a0 con 0x7f4d4c004d40 2024-09-19T09:22:52.386 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.381+0000 7f4d6485c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4d600b60c0 con 0x7f4d600ceb70 2024-09-19T09:22:52.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.381+0000 7f4d5ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d6015a770 0x7f4d6015ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:52.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.382+0000 7f4d5ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d6015a770 0x7f4d6015ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50486/0 (socket says 172.21.15.18:50486) 2024-09-19T09:22:52.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.382+0000 7f4d5ed9d640 1 -- 172.21.15.18:0/4276414413 learned_addr learned my addr 172.21.15.18:0/4276414413 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:52.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.382+0000 7f4d5dd9b640 1 --2- 172.21.15.18:0/4276414413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d600ceb70 0x7f4d601f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:52.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.382+0000 7f4d5e59c640 1 --2- 172.21.15.18:0/4276414413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d4c004d40 0x7f4d60158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:52.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.382+0000 7f4d5ed9d640 1 -- 172.21.15.18:0/4276414413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d600ceb70 msgr2=0x7f4d601f4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:52.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.382+0000 7f4d5ed9d640 1 --2- 172.21.15.18:0/4276414413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d600ceb70 0x7f4d601f4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.382+0000 7f4d5ed9d640 1 -- 172.21.15.18:0/4276414413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d4c004d40 msgr2=0x7f4d60158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:52.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.382+0000 7f4d5ed9d640 1 --2- 172.21.15.18:0/4276414413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d4c004d40 0x7f4d60158da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:52.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.382+0000 7f4d5ed9d640 1 -- 172.21.15.18:0/4276414413 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d6015b680 con 0x7f4d6015a770 2024-09-19T09:22:52.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.382+0000 7f4d5e59c640 1 --2- 172.21.15.18:0/4276414413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d4c004d40 0x7f4d60158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:22:52.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.382+0000 7f4d5ed9d640 1 --2- 172.21.15.18:0/4276414413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d6015a770 0x7f4d6015ac20 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f4d58000c00 tx=0x7f4d58000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:52.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.382+0000 7f4d56ffd640 1 -- 172.21.15.18:0/4276414413 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d58007480 con 0x7f4d6015a770 2024-09-19T09:22:52.387 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.382+0000 7f4d56ffd640 1 -- 172.21.15.18:0/4276414413 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d58044070 con 0x7f4d6015a770 2024-09-19T09:22:52.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.382+0000 7f4d6485c640 1 -- 172.21.15.18:0/4276414413 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d6015b960 con 0x7f4d6015a770 2024-09-19T09:22:52.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.382+0000 7f4d56ffd640 1 -- 172.21.15.18:0/4276414413 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d5803e480 con 0x7f4d6015a770 2024-09-19T09:22:52.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.382+0000 7f4d6485c640 1 -- 172.21.15.18:0/4276414413 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d600cc050 con 0x7f4d6015a770 2024-09-19T09:22:52.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.383+0000 7f4d6485c640 1 -- 172.21.15.18:0/4276414413 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d600d1450 con 0x7f4d6015a770 2024-09-19T09:22:52.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.384+0000 7f4d56ffd640 1 -- 172.21.15.18:0/4276414413 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4d5803e620 con 0x7f4d6015a770 2024-09-19T09:22:52.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.384+0000 7f4d56ffd640 1 --2- 172.21.15.18:0/4276414413 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4d4006c2e0 0x7f4d4006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:52.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.384+0000 7f4d56ffd640 1 -- 172.21.15.18:0/4276414413 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 4943+0+0 (secure 0 0 0) 0x7f4d580abbd0 con 0x7f4d6015a770 2024-09-19T09:22:52.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.384+0000 7f4d5e59c640 1 --2- 172.21.15.18:0/4276414413 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4d4006c2e0 0x7f4d4006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:52.388 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.385+0000 7f4d5e59c640 1 --2- 172.21.15.18:0/4276414413 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4d4006c2e0 0x7f4d4006e7a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4d50007440 tx=0x7f4d5000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:52.389 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.389+0000 7f4d56ffd640 1 -- 172.21.15.18:0/4276414413 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f4d5807a760 con 0x7f4d6015a770 2024-09-19T09:22:52.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:52.631+0000 7f4d6485c640 1 -- 172.21.15.18:0/4276414413 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) -- 0x7f4d6008e3c0 con 0x7f4d6015a770 2024-09-19T09:22:53.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.404+0000 7f4d56ffd640 1 -- 172.21.15.18:0/4276414413 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v446) ==== 132+0+0 (secure 0 0 0) 0x7f4d5807a060 con 0x7f4d6015a770 2024-09-19T09:22:53.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.407+0000 7f4d6485c640 1 -- 172.21.15.18:0/4276414413 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4d4006c2e0 msgr2=0x7f4d4006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:53.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.407+0000 7f4d6485c640 1 --2- 172.21.15.18:0/4276414413 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4d4006c2e0 0x7f4d4006e7a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4d50007440 tx=0x7f4d5000b040 comp rx=0 tx=0).stop 2024-09-19T09:22:53.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.407+0000 7f4d6485c640 1 -- 172.21.15.18:0/4276414413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d6015a770 msgr2=0x7f4d6015ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:53.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.407+0000 7f4d6485c640 1 --2- 172.21.15.18:0/4276414413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d6015a770 0x7f4d6015ac20 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f4d58000c00 tx=0x7f4d58000fe0 comp rx=0 tx=0).stop 2024-09-19T09:22:53.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.407+0000 7f4d6485c640 1 -- 172.21.15.18:0/4276414413 shutdown_connections 2024-09-19T09:22:53.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.407+0000 7f4d6485c640 1 --2- 172.21.15.18:0/4276414413 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4d4006c2e0 0x7f4d4006e7a0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:53.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.407+0000 7f4d6485c640 1 --2- 172.21.15.18:0/4276414413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4d6015a770 0x7f4d6015ac20 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:53.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.407+0000 7f4d6485c640 1 --2- 172.21.15.18:0/4276414413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4d600ceb70 0x7f4d601f4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:53.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.407+0000 7f4d6485c640 1 --2- 172.21.15.18:0/4276414413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4d4c004d40 0x7f4d60158da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:53.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.407+0000 7f4d6485c640 1 -- 172.21.15.18:0/4276414413 >> 172.21.15.18:0/4276414413 conn(0x7f4d600d4bd0 msgr2=0x7f4d60154a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:53.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.407+0000 7f4d6485c640 1 -- 172.21.15.18:0/4276414413 shutdown_connections 2024-09-19T09:22:53.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.407+0000 7f4d6485c640 1 -- 172.21.15.18:0/4276414413 wait complete. 2024-09-19T09:22:53.422 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) ... ok 2024-09-19T09:22:53.422 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) That when the full flag is encountered during asynchronous 2024-09-19T09:22:53.422 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) 2024-09-19T09:22:53.423 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:22:53.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.531+0000 7f02f04ba640 1 Processor -- start 2024-09-19T09:22:53.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.531+0000 7f02f04ba640 1 -- start start 2024-09-19T09:22:53.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.532+0000 7f02f04ba640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f02e806c320 0x7f02e80b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:53.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.532+0000 7f02f04ba640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02e80b6db0 con 0x7f02e80ced00 2024-09-19T09:22:53.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.532+0000 7f02f04ba640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02e80b7070 con 0x7f02e815eea0 2024-09-19T09:22:53.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.532+0000 7f02f04ba640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f02e80b1390 con 0x7f02e806c320 2024-09-19T09:22:53.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.532+0000 7f02eea57640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f02e80ced00 0x7f02e80b65e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56350/0 (socket says 172.21.15.18:56350) 2024-09-19T09:22:53.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.532+0000 7f02eea57640 1 -- 172.21.15.18:0/1738401904 learned_addr learned my addr 172.21.15.18:0/1738401904 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:22:53.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.532+0000 7f02ed254640 1 -- 172.21.15.18:0/1738401904 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3033249918 0 0) 0x7f02e80b6db0 con 0x7f02e80ced00 2024-09-19T09:22:53.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.532+0000 7f02eda55640 1 --2- 172.21.15.18:0/1738401904 >> v2:172.21.15.162:3300/0 conn(0x7f02e806c320 0x7f02e80b60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:53.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.532+0000 7f02ed254640 1 -- 172.21.15.18:0/1738401904 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02d4003520 con 0x7f02e80ced00 2024-09-19T09:22:53.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.533+0000 7f02ed254640 1 -- 172.21.15.18:0/1738401904 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2644573575 0 0) 0x7f02d4003520 con 0x7f02e80ced00 2024-09-19T09:22:53.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.533+0000 7f02ed254640 1 -- 172.21.15.18:0/1738401904 >> v2:172.21.15.162:3300/0 conn(0x7f02e806c320 msgr2=0x7f02e80b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:53.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.533+0000 7f02ed254640 1 --2- 172.21.15.18:0/1738401904 >> v2:172.21.15.162:3300/0 conn(0x7f02e806c320 0x7f02e80b60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:53.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.533+0000 7f02ed254640 1 -- 172.21.15.18:0/1738401904 >> v1:172.21.15.162:6789/0 conn(0x7f02e815eea0 legacy=0x7f02e806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:53.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.533+0000 7f02ed254640 1 -- 172.21.15.18:0/1738401904 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e80b1670 con 0x7f02e80ced00 2024-09-19T09:22:53.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.533+0000 7f02ed254640 1 -- 172.21.15.18:0/1738401904 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f02e00019f0 con 0x7f02e80ced00 2024-09-19T09:22:53.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.533+0000 7f02ed254640 1 -- 172.21.15.18:0/1738401904 >> v1:172.21.15.18:6789/0 conn(0x7f02e80ced00 legacy=0x7f02e80b65e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:53.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.533+0000 7f02ed254640 1 --2- 172.21.15.18:0/1738401904 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02d40039b0 0x7f02d4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:53.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.533+0000 7f02ed254640 1 --2- 172.21.15.18:0/1738401904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02d4004800 0x7f02d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:53.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.533+0000 7f02ed254640 1 --2- 172.21.15.18:0/1738401904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02d40051c0 0x7f02d400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:53.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.533+0000 7f02ed254640 1 -- 172.21.15.18:0/1738401904 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f02e80b1390 con 0x7f02d4004800 2024-09-19T09:22:53.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.533+0000 7f02ed254640 1 -- 172.21.15.18:0/1738401904 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f02d400c060 con 0x7f02d40051c0 2024-09-19T09:22:53.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.533+0000 7f02ed254640 1 -- 172.21.15.18:0/1738401904 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f02d400c260 con 0x7f02d40039b0 2024-09-19T09:22:53.536 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.533+0000 7f02eda55640 1 --2- 172.21.15.18:0/1738401904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02d4004800 0x7f02d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:53.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.533+0000 7f02ee256640 1 --2- 172.21.15.18:0/1738401904 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02d40039b0 0x7f02d4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:53.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.533+0000 7f02eea57640 1 --2- 172.21.15.18:0/1738401904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02d40051c0 0x7f02d400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:53.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.533+0000 7f02eda55640 1 -- 172.21.15.18:0/1738401904 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02d40039b0 msgr2=0x7f02d4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:53.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.533+0000 7f02eda55640 1 --2- 172.21.15.18:0/1738401904 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02d40039b0 0x7f02d4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:53.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.533+0000 7f02eda55640 1 -- 172.21.15.18:0/1738401904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02d40051c0 msgr2=0x7f02d400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:53.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.533+0000 7f02eda55640 1 --2- 172.21.15.18:0/1738401904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02d40051c0 0x7f02d400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:53.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.533+0000 7f02eda55640 1 -- 172.21.15.18:0/1738401904 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d4003520 con 0x7f02d4004800 2024-09-19T09:22:53.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.533+0000 7f02eea57640 1 --2- 172.21.15.18:0/1738401904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02d40051c0 0x7f02d400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:53.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.533+0000 7f02ee256640 1 --2- 172.21.15.18:0/1738401904 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02d40039b0 0x7f02d4003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:53.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.533+0000 7f02eea57640 1 -- 172.21.15.18:0/1738401904 reap_dead start 2024-09-19T09:22:53.537 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.534+0000 7f02eda55640 1 --2- 172.21.15.18:0/1738401904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02d4004800 0x7f02d4004c80 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f02d8009ac0 tx=0x7f02d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87f26755d6f4f634 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:53.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.534+0000 7f02ed254640 1 -- 172.21.15.18:0/1738401904 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d8036070 con 0x7f02d4004800 2024-09-19T09:22:53.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.534+0000 7f02ed254640 1 -- 172.21.15.18:0/1738401904 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02d8031400 con 0x7f02d4004800 2024-09-19T09:22:53.538 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.534+0000 7f02ed254640 1 -- 172.21.15.18:0/1738401904 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d8009690 con 0x7f02d4004800 2024-09-19T09:22:53.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.534+0000 7f02f04ba640 1 -- 172.21.15.18:0/1738401904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02d4004800 msgr2=0x7f02d4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:53.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.534+0000 7f02f04ba640 1 --2- 172.21.15.18:0/1738401904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02d4004800 0x7f02d4004c80 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f02d8009ac0 tx=0x7f02d4005830 comp rx=0 tx=0).stop 2024-09-19T09:22:53.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.535+0000 7f02f04ba640 1 -- 172.21.15.18:0/1738401904 shutdown_connections 2024-09-19T09:22:53.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.535+0000 7f02f04ba640 1 --2- 172.21.15.18:0/1738401904 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02d4004800 0x7f02d4004c80 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:53.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.535+0000 7f02f04ba640 1 -- 172.21.15.18:0/1738401904 >> 172.21.15.18:0/1738401904 conn(0x7f02e80731b0 msgr2=0x7f02e80735c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:53.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.535+0000 7f02f04ba640 1 -- 172.21.15.18:0/1738401904 shutdown_connections 2024-09-19T09:22:53.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.535+0000 7f02f04ba640 1 -- 172.21.15.18:0/1738401904 wait complete. 2024-09-19T09:22:53.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.536+0000 7f02f04ba640 1 Processor -- start 2024-09-19T09:22:53.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.536+0000 7f02f04ba640 1 -- start start 2024-09-19T09:22:53.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.537+0000 7f02f04ba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02d4004800 0x7f02e81525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:53.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.537+0000 7f02f04ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02e81603b0 0x7f02e80cf270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:53.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.537+0000 7f02f04ba640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02e80cf7b0 0x7f02e80af190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:53.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.537+0000 7f02f04ba640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f02e806bc10 con 0x7f02d4004800 2024-09-19T09:22:53.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.537+0000 7f02f04ba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f02e80b1040 con 0x7f02e81603b0 2024-09-19T09:22:53.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.537+0000 7f02f04ba640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f02e806bd90 con 0x7f02e80cf7b0 2024-09-19T09:22:53.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.537+0000 7f02ee256640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02d4004800 0x7f02e81525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:53.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.537+0000 7f02ee256640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02d4004800 0x7f02e81525e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50500/0 (socket says 172.21.15.18:50500) 2024-09-19T09:22:53.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.537+0000 7f02ee256640 1 -- 172.21.15.18:0/1523707474 learned_addr learned my addr 172.21.15.18:0/1523707474 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:53.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.537+0000 7f02eda55640 1 --2- 172.21.15.18:0/1523707474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02e81603b0 0x7f02e80cf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:53.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.537+0000 7f02eea57640 1 --2- 172.21.15.18:0/1523707474 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02e80cf7b0 0x7f02e80af190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:53.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.537+0000 7f02ee256640 1 -- 172.21.15.18:0/1523707474 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02e80cf7b0 msgr2=0x7f02e80af190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:53.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.537+0000 7f02ee256640 1 --2- 172.21.15.18:0/1523707474 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02e80cf7b0 0x7f02e80af190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:53.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.537+0000 7f02ee256640 1 -- 172.21.15.18:0/1523707474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02e81603b0 msgr2=0x7f02e80cf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:53.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.537+0000 7f02ee256640 1 --2- 172.21.15.18:0/1523707474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02e81603b0 0x7f02e80cf270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:53.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.537+0000 7f02ee256640 1 -- 172.21.15.18:0/1523707474 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e8161180 con 0x7f02d4004800 2024-09-19T09:22:53.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.537+0000 7f02ee256640 1 --2- 172.21.15.18:0/1523707474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02d4004800 0x7f02e81525e0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f02e400e4e0 tx=0x7f02e400e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:53.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.537+0000 7f02deffd640 1 -- 172.21.15.18:0/1523707474 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e40052e0 con 0x7f02d4004800 2024-09-19T09:22:53.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.537+0000 7f02deffd640 1 -- 172.21.15.18:0/1523707474 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02e4007020 con 0x7f02d4004800 2024-09-19T09:22:53.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.538+0000 7f02deffd640 1 -- 172.21.15.18:0/1523707474 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e4007210 con 0x7f02d4004800 2024-09-19T09:22:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.538+0000 7f02f04ba640 1 -- 172.21.15.18:0/1523707474 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02e8161460 con 0x7f02d4004800 2024-09-19T09:22:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.538+0000 7f02f04ba640 1 -- 172.21.15.18:0/1523707474 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02e8161a20 con 0x7f02d4004800 2024-09-19T09:22:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.539+0000 7f02f04ba640 1 -- 172.21.15.18:0/1523707474 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02e80b60a0 con 0x7f02d4004800 2024-09-19T09:22:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.539+0000 7f02deffd640 1 -- 172.21.15.18:0/1523707474 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f02e401a020 con 0x7f02d4004800 2024-09-19T09:22:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.539+0000 7f02deffd640 1 --2- 172.21.15.18:0/1523707474 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f02cc06c2b0 0x7f02cc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:53.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.540+0000 7f02deffd640 1 -- 172.21.15.18:0/1523707474 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 4943+0+0 (secure 0 0 0) 0x7f02e408a5b0 con 0x7f02d4004800 2024-09-19T09:22:53.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.540+0000 7f02eda55640 1 --2- 172.21.15.18:0/1523707474 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f02cc06c2b0 0x7f02cc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:53.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.540+0000 7f02eda55640 1 --2- 172.21.15.18:0/1523707474 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f02cc06c2b0 0x7f02cc06e770 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f02d8033000 tx=0x7f02d8008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:53.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.544+0000 7f02deffd640 1 -- 172.21.15.18:0/1523707474 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f02e4058f80 con 0x7f02d4004800 2024-09-19T09:22:53.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.722+0000 7f02f04ba640 1 -- 172.21.15.18:0/1523707474 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f02e8074080 con 0x7f02d4004800 2024-09-19T09:22:53.723 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.723+0000 7f02deffd640 1 -- 172.21.15.18:0/1523707474 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v159) ==== 74+0+13055 (secure 0 0 0) 0x7f02e4058880 con 0x7f02d4004800 2024-09-19T09:22:53.724 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:22:53.724 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":159,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:22:51.938088+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":152,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6835/1201598209":"2024-09-20T09:22:48.933565+0000","172.21.15.18:6834/1201598209":"2024-09-20T09:22:48.933565+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:22:53.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.725+0000 7f02f04ba640 1 -- 172.21.15.18:0/1523707474 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f02cc06c2b0 msgr2=0x7f02cc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:53.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.725+0000 7f02f04ba640 1 --2- 172.21.15.18:0/1523707474 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f02cc06c2b0 0x7f02cc06e770 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f02d8033000 tx=0x7f02d8008030 comp rx=0 tx=0).stop 2024-09-19T09:22:53.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.725+0000 7f02f04ba640 1 -- 172.21.15.18:0/1523707474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02d4004800 msgr2=0x7f02e81525e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:53.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.725+0000 7f02f04ba640 1 --2- 172.21.15.18:0/1523707474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02d4004800 0x7f02e81525e0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f02e400e4e0 tx=0x7f02e400e9a0 comp rx=0 tx=0).stop 2024-09-19T09:22:53.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.725+0000 7f02f04ba640 1 -- 172.21.15.18:0/1523707474 shutdown_connections 2024-09-19T09:22:53.726 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.725+0000 7f02f04ba640 1 --2- 172.21.15.18:0/1523707474 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f02cc06c2b0 0x7f02cc06e770 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:53.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.725+0000 7f02f04ba640 1 --2- 172.21.15.18:0/1523707474 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f02e80cf7b0 0x7f02e80af190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:53.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.725+0000 7f02f04ba640 1 --2- 172.21.15.18:0/1523707474 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02e81603b0 0x7f02e80cf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:53.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.725+0000 7f02f04ba640 1 --2- 172.21.15.18:0/1523707474 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f02d4004800 0x7f02e81525e0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:53.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.725+0000 7f02f04ba640 1 -- 172.21.15.18:0/1523707474 >> 172.21.15.18:0/1523707474 conn(0x7f02e80731b0 msgr2=0x7f02e806de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:53.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.725+0000 7f02f04ba640 1 -- 172.21.15.18:0/1523707474 shutdown_connections 2024-09-19T09:22:53.727 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.725+0000 7f02f04ba640 1 -- 172.21.15.18:0/1523707474 wait complete. 2024-09-19T09:22:53.737 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T09:13:17.564717+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T09:22:53.737 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T09:22:53.842 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.842+0000 7fa2fc30a640 1 Processor -- start 2024-09-19T09:22:53.843 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.842+0000 7fa2fc30a640 1 -- start start 2024-09-19T09:22:53.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.843+0000 7fa2fc30a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2f406e280 0x7fa2f4073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:53.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.843+0000 7fa2fc30a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa2f4071df0 0x7fa2f406e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:53.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.843+0000 7fa2fc30a640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2f406eba0 con 0x7fa2f40d1010 2024-09-19T09:22:53.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.843+0000 7fa2fc30a640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fa2f40738b0 con 0x7fa2f4071df0 2024-09-19T09:22:53.844 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.843+0000 7fa2fc30a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa2f40722d0 con 0x7fa2f406e280 2024-09-19T09:22:53.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.843+0000 7fa2f98a5640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa2f4071df0 0x7fa2f406e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:53.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.843+0000 7fa2f98a5640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa2f4071df0 0x7fa2f406e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50508/0 (socket says 172.21.15.18:50508) 2024-09-19T09:22:53.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.843+0000 7fa2f98a5640 1 -- 172.21.15.18:0/963253042 learned_addr learned my addr 172.21.15.18:0/963253042 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:53.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.843+0000 7fa2fa0a6640 1 --2- 172.21.15.18:0/963253042 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2f406e280 0x7fa2f4073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:53.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.843+0000 7fa2f98a5640 1 -- 172.21.15.18:0/963253042 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2f406e280 msgr2=0x7fa2f4073370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:53.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.843+0000 7fa2f98a5640 1 --2- 172.21.15.18:0/963253042 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2f406e280 0x7fa2f4073370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:53.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.843+0000 7fa2f98a5640 1 -- 172.21.15.18:0/963253042 >> v1:172.21.15.162:6789/0 conn(0x7fa2f40d1010 legacy=0x7fa2f40ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:53.845 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.843+0000 7fa2f98a5640 1 -- 172.21.15.18:0/963253042 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f40725b0 con 0x7fa2f4071df0 2024-09-19T09:22:53.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.844+0000 7fa2f98a5640 1 --2- 172.21.15.18:0/963253042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2f4071df0 0x7fa2f406e660 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4009870 tx=0x7fa2e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c2b4dfb4d9626d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:53.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.844+0000 7fa2f90a4640 1 -- 172.21.15.18:0/963253042 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e4037070 con 0x7fa2f4071df0 2024-09-19T09:22:53.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.844+0000 7fa2f90a4640 1 -- 172.21.15.18:0/963253042 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2e4032440 con 0x7fa2f4071df0 2024-09-19T09:22:53.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.844+0000 7fa2f90a4640 1 -- 172.21.15.18:0/963253042 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e4032810 con 0x7fa2f4071df0 2024-09-19T09:22:53.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.845+0000 7fa2fc30a640 1 -- 172.21.15.18:0/963253042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2f4071df0 msgr2=0x7fa2f406e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:53.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.845+0000 7fa2fc30a640 1 --2- 172.21.15.18:0/963253042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2f4071df0 0x7fa2f406e660 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4009870 tx=0x7fa2e402a270 comp rx=0 tx=0).stop 2024-09-19T09:22:53.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.845+0000 7fa2fc30a640 1 -- 172.21.15.18:0/963253042 shutdown_connections 2024-09-19T09:22:53.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.845+0000 7fa2fc30a640 1 --2- 172.21.15.18:0/963253042 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2f4071df0 0x7fa2f406e660 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:53.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.845+0000 7fa2fc30a640 1 --2- 172.21.15.18:0/963253042 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2f406e280 0x7fa2f4073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:53.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.845+0000 7fa2fc30a640 1 -- 172.21.15.18:0/963253042 >> 172.21.15.18:0/963253042 conn(0x7fa2f406bc10 msgr2=0x7fa2f406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:53.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.845+0000 7fa2fc30a640 1 -- 172.21.15.18:0/963253042 shutdown_connections 2024-09-19T09:22:53.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.845+0000 7fa2fc30a640 1 -- 172.21.15.18:0/963253042 wait complete. 2024-09-19T09:22:53.847 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.846+0000 7fa2fc30a640 1 Processor -- start 2024-09-19T09:22:53.848 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.846+0000 7fa2fc30a640 1 -- start start 2024-09-19T09:22:53.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.847+0000 7fa2fc30a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2f406e280 0x7fa2f4148e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:53.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.847+0000 7fa2fc30a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2f4071df0 0x7fa2f4149720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:53.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.847+0000 7fa2fc30a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2f40d1010 0x7fa2f4149c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:53.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.847+0000 7fa2fc30a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f4072e50 con 0x7fa2f4071df0 2024-09-19T09:22:53.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.847+0000 7fa2fc30a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f4072b70 con 0x7fa2f406e280 2024-09-19T09:22:53.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.847+0000 7fa2fc30a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa2f415db60 con 0x7fa2f40d1010 2024-09-19T09:22:53.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.847+0000 7fa2f98a5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2f4071df0 0x7fa2f4149720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:53.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.847+0000 7fa2f98a5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2f4071df0 0x7fa2f4149720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50514/0 (socket says 172.21.15.18:50514) 2024-09-19T09:22:53.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.847+0000 7fa2f98a5640 1 -- 172.21.15.18:0/3435335294 learned_addr learned my addr 172.21.15.18:0/3435335294 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:53.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.847+0000 7fa2fa0a6640 1 --2- 172.21.15.18:0/3435335294 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2f406e280 0x7fa2f4148e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:53.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.847+0000 7fa2fa8a7640 1 --2- 172.21.15.18:0/3435335294 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2f40d1010 0x7fa2f4149c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:53.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.847+0000 7fa2f98a5640 1 -- 172.21.15.18:0/3435335294 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2f40d1010 msgr2=0x7fa2f4149c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:53.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.847+0000 7fa2f98a5640 1 --2- 172.21.15.18:0/3435335294 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2f40d1010 0x7fa2f4149c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:53.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.847+0000 7fa2f98a5640 1 -- 172.21.15.18:0/3435335294 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2f406e280 msgr2=0x7fa2f4148e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:53.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.847+0000 7fa2f98a5640 1 --2- 172.21.15.18:0/3435335294 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2f406e280 0x7fa2f4148e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:53.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.847+0000 7fa2f98a5640 1 -- 172.21.15.18:0/3435335294 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f4158ac0 con 0x7fa2f4071df0 2024-09-19T09:22:53.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.847+0000 7fa2fa8a7640 1 --2- 172.21.15.18:0/3435335294 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2f40d1010 0x7fa2f4149c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:53.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.847+0000 7fa2f98a5640 1 --2- 172.21.15.18:0/3435335294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2f4071df0 0x7fa2f4149720 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4009870 tx=0x7fa2e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:53.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.848+0000 7fa2eaffd640 1 -- 172.21.15.18:0/3435335294 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e4041070 con 0x7fa2f4071df0 2024-09-19T09:22:53.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.848+0000 7fa2eaffd640 1 -- 172.21.15.18:0/3435335294 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2e403c870 con 0x7fa2f4071df0 2024-09-19T09:22:53.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.848+0000 7fa2fc30a640 1 -- 172.21.15.18:0/3435335294 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2f414a250 con 0x7fa2f4071df0 2024-09-19T09:22:53.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.848+0000 7fa2eaffd640 1 -- 172.21.15.18:0/3435335294 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e4037040 con 0x7fa2f4071df0 2024-09-19T09:22:53.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.848+0000 7fa2fc30a640 1 -- 172.21.15.18:0/3435335294 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2f414a810 con 0x7fa2f4071df0 2024-09-19T09:22:53.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.849+0000 7fa2fc30a640 1 -- 172.21.15.18:0/3435335294 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2f40d14c0 con 0x7fa2f4071df0 2024-09-19T09:22:53.851 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.849+0000 7fa2eaffd640 1 -- 172.21.15.18:0/3435335294 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa2e4044070 con 0x7fa2f4071df0 2024-09-19T09:22:53.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.849+0000 7fa2eaffd640 1 --2- 172.21.15.18:0/3435335294 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa2d806c2b0 0x7fa2d806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:53.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.850+0000 7fa2eaffd640 1 -- 172.21.15.18:0/3435335294 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 4943+0+0 (secure 0 0 0) 0x7fa2e40abb20 con 0x7fa2f4071df0 2024-09-19T09:22:53.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.850+0000 7fa2fa0a6640 1 --2- 172.21.15.18:0/3435335294 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa2d806c2b0 0x7fa2d806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:53.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.850+0000 7fa2fa0a6640 1 --2- 172.21.15.18:0/3435335294 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa2d806c2b0 0x7fa2d806e770 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0003b80 tx=0x7fa2f00098d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:53.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:53.854+0000 7fa2eaffd640 1 -- 172.21.15.18:0/3435335294 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa2e407a060 con 0x7fa2f4071df0 2024-09-19T09:22:54.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.028+0000 7fa2fc30a640 1 -- 172.21.15.18:0/3435335294 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa2f415fd60 con 0x7fa2f4071df0 2024-09-19T09:22:54.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.029+0000 7fa2eaffd640 1 -- 172.21.15.18:0/3435335294 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v159) ==== 93+0+10 (secure 0 0 0) 0x7fa2e407e360 con 0x7fa2f4071df0 2024-09-19T09:22:54.030 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-09-19T09:22:54.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.031+0000 7fa2fc30a640 1 -- 172.21.15.18:0/3435335294 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa2d806c2b0 msgr2=0x7fa2d806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:54.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.031+0000 7fa2fc30a640 1 --2- 172.21.15.18:0/3435335294 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa2d806c2b0 0x7fa2d806e770 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0003b80 tx=0x7fa2f00098d0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.031+0000 7fa2fc30a640 1 -- 172.21.15.18:0/3435335294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2f4071df0 msgr2=0x7fa2f4149720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:54.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.031+0000 7fa2fc30a640 1 --2- 172.21.15.18:0/3435335294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2f4071df0 0x7fa2f4149720 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4009870 tx=0x7fa2e40046c0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.031+0000 7fa2fc30a640 1 -- 172.21.15.18:0/3435335294 shutdown_connections 2024-09-19T09:22:54.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.031+0000 7fa2fc30a640 1 --2- 172.21.15.18:0/3435335294 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa2d806c2b0 0x7fa2d806e770 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.031+0000 7fa2fc30a640 1 --2- 172.21.15.18:0/3435335294 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2f40d1010 0x7fa2f4149c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.031+0000 7fa2fc30a640 1 --2- 172.21.15.18:0/3435335294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2f4071df0 0x7fa2f4149720 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.031+0000 7fa2fc30a640 1 --2- 172.21.15.18:0/3435335294 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2f406e280 0x7fa2f4148e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.031+0000 7fa2fc30a640 1 -- 172.21.15.18:0/3435335294 >> 172.21.15.18:0/3435335294 conn(0x7fa2f406bc10 msgr2=0x7fa2f415bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:54.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.031+0000 7fa2fc30a640 1 -- 172.21.15.18:0/3435335294 shutdown_connections 2024-09-19T09:22:54.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.031+0000 7fa2fc30a640 1 -- 172.21.15.18:0/3435335294 wait complete. 2024-09-19T09:22:54.043 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2024-09-19T09:22:54.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.145+0000 7fd6366b7640 1 Processor -- start 2024-09-19T09:22:54.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.145+0000 7fd6366b7640 1 -- start start 2024-09-19T09:22:54.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.146+0000 7fd6366b7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6300d3240 0x7fd6300b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:54.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.146+0000 7fd6366b7640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6300b7a90 con 0x7fd6300d1ab0 2024-09-19T09:22:54.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.146+0000 7fd6366b7640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6300d3740 con 0x7fd63015ef50 2024-09-19T09:22:54.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.146+0000 7fd6366b7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd6300d3a20 con 0x7fd6300d3240 2024-09-19T09:22:54.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.146+0000 7fd62f7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd6300d1ab0 0x7fd6300b8500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:56362/0 (socket says 172.21.15.18:56362) 2024-09-19T09:22:54.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.146+0000 7fd62f7fe640 1 -- 172.21.15.18:0/1622880844 learned_addr learned my addr 172.21.15.18:0/1622880844 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:22:54.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.146+0000 7fd634c54640 1 --2- 172.21.15.18:0/1622880844 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6300d3240 0x7fd6300b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:54.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.146+0000 7fd62effd640 1 -- 172.21.15.18:0/1622880844 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3324838667 0 0) 0x7fd6300b7a90 con 0x7fd6300d1ab0 2024-09-19T09:22:54.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.146+0000 7fd62effd640 1 -- 172.21.15.18:0/1622880844 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd618003520 con 0x7fd6300d1ab0 2024-09-19T09:22:54.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.146+0000 7fd62effd640 1 -- 172.21.15.18:0/1622880844 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 133540613 0 0) 0x7fd6300d3740 con 0x7fd63015ef50 2024-09-19T09:22:54.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.146+0000 7fd62effd640 1 -- 172.21.15.18:0/1622880844 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6300b7a90 con 0x7fd63015ef50 2024-09-19T09:22:54.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.146+0000 7fd62effd640 1 -- 172.21.15.18:0/1622880844 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1827914998 0 0) 0x7fd618003520 con 0x7fd6300d1ab0 2024-09-19T09:22:54.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.146+0000 7fd62effd640 1 -- 172.21.15.18:0/1622880844 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6300d3240 msgr2=0x7fd6300b8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:54.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.146+0000 7fd62effd640 1 --2- 172.21.15.18:0/1622880844 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6300d3240 0x7fd6300b8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.146+0000 7fd62effd640 1 -- 172.21.15.18:0/1622880844 >> v1:172.21.15.162:6789/0 conn(0x7fd63015ef50 legacy=0x7fd6300d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:54.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.146+0000 7fd62effd640 1 -- 172.21.15.18:0/1622880844 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6300b7d00 con 0x7fd6300d1ab0 2024-09-19T09:22:54.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.146+0000 7fd62effd640 1 -- 172.21.15.18:0/1622880844 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fd624001670 con 0x7fd6300d1ab0 2024-09-19T09:22:54.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.146+0000 7fd62effd640 1 -- 172.21.15.18:0/1622880844 >> v1:172.21.15.18:6789/0 conn(0x7fd6300d1ab0 legacy=0x7fd6300b8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:54.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.146+0000 7fd62effd640 1 --2- 172.21.15.18:0/1622880844 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6300d3240 0x7fd618003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:54.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.146+0000 7fd62effd640 1 --2- 172.21.15.18:0/1622880844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd618004120 0x7fd618004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:54.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.146+0000 7fd62effd640 1 --2- 172.21.15.18:0/1622880844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd618004d40 0x7fd6180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:54.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.146+0000 7fd62effd640 1 -- 172.21.15.18:0/1622880844 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd6300d3a20 con 0x7fd618004d40 2024-09-19T09:22:54.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.146+0000 7fd62effd640 1 -- 172.21.15.18:0/1622880844 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd61800bb80 con 0x7fd618004120 2024-09-19T09:22:54.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.146+0000 7fd62effd640 1 -- 172.21.15.18:0/1622880844 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd61800bd80 con 0x7fd6300d3240 2024-09-19T09:22:54.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.147+0000 7fd634c54640 1 --2- 172.21.15.18:0/1622880844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd618004d40 0x7fd6180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:54.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.147+0000 7fd62ffff640 1 --2- 172.21.15.18:0/1622880844 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6300d3240 0x7fd618003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:54.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.147+0000 7fd62f7fe640 1 --2- 172.21.15.18:0/1622880844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd618004120 0x7fd618004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:54.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.147+0000 7fd634c54640 1 -- 172.21.15.18:0/1622880844 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6300d3240 msgr2=0x7fd618003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:54.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.147+0000 7fd634c54640 1 --2- 172.21.15.18:0/1622880844 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6300d3240 0x7fd618003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.147+0000 7fd634c54640 1 -- 172.21.15.18:0/1622880844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd618004120 msgr2=0x7fd618004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:54.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.147+0000 7fd634c54640 1 --2- 172.21.15.18:0/1622880844 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd618004120 0x7fd618004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.147+0000 7fd634c54640 1 -- 172.21.15.18:0/1622880844 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd618003520 con 0x7fd618004d40 2024-09-19T09:22:54.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.148+0000 7fd634c54640 1 --2- 172.21.15.18:0/1622880844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd618004d40 0x7fd6180051c0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fd628009f90 tx=0x7fd618005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64adb26b7c844517 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:54.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.148+0000 7fd62effd640 1 -- 172.21.15.18:0/1622880844 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd628009c10 con 0x7fd618004d40 2024-09-19T09:22:54.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.148+0000 7fd62effd640 1 -- 172.21.15.18:0/1622880844 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd628036070 con 0x7fd618004d40 2024-09-19T09:22:54.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.148+0000 7fd62effd640 1 -- 172.21.15.18:0/1622880844 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd628031850 con 0x7fd618004d40 2024-09-19T09:22:54.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.148+0000 7fd6366b7640 1 -- 172.21.15.18:0/1622880844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd618004d40 msgr2=0x7fd6180051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:54.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.148+0000 7fd6366b7640 1 --2- 172.21.15.18:0/1622880844 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd618004d40 0x7fd6180051c0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7fd628009f90 tx=0x7fd618005830 comp rx=0 tx=0).stop 2024-09-19T09:22:54.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.148+0000 7fd634c54640 1 -- 172.21.15.18:0/1622880844 reap_dead start 2024-09-19T09:22:54.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.148+0000 7fd6366b7640 1 -- 172.21.15.18:0/1622880844 shutdown_connections 2024-09-19T09:22:54.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.148+0000 7fd6366b7640 1 -- 172.21.15.18:0/1622880844 >> 172.21.15.18:0/1622880844 conn(0x7fd6300d4c60 msgr2=0x7fd6300d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:54.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.148+0000 7fd6366b7640 1 -- 172.21.15.18:0/1622880844 shutdown_connections 2024-09-19T09:22:54.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.148+0000 7fd6366b7640 1 -- 172.21.15.18:0/1622880844 wait complete. 2024-09-19T09:22:54.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.150+0000 7fd6366b7640 1 Processor -- start 2024-09-19T09:22:54.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.150+0000 7fd6366b7640 1 -- start start 2024-09-19T09:22:54.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.150+0000 7fd6366b7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd618004d40 0x7fd6300c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:54.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.151+0000 7fd6366b7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6301f4c70 0x7fd63014aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:54.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.151+0000 7fd6366b7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6300cc540 0x7fd63015c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:54.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.151+0000 7fd6366b7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd6300d21a0 con 0x7fd6301f4c70 2024-09-19T09:22:54.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.151+0000 7fd6366b7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd6300d2020 con 0x7fd6300cc540 2024-09-19T09:22:54.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.151+0000 7fd6366b7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd6300d5780 con 0x7fd618004d40 2024-09-19T09:22:54.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.151+0000 7fd62f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6301f4c70 0x7fd63014aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:54.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.151+0000 7fd62f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6301f4c70 0x7fd63014aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:50530/0 (socket says 172.21.15.18:50530) 2024-09-19T09:22:54.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.151+0000 7fd62f7fe640 1 -- 172.21.15.18:0/985081331 learned_addr learned my addr 172.21.15.18:0/985081331 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:54.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.151+0000 7fd62ffff640 1 --2- 172.21.15.18:0/985081331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd618004d40 0x7fd6300c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:54.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.151+0000 7fd634c54640 1 --2- 172.21.15.18:0/985081331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6300cc540 0x7fd63015c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:54.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.151+0000 7fd62f7fe640 1 -- 172.21.15.18:0/985081331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd618004d40 msgr2=0x7fd6300c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:54.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.151+0000 7fd62f7fe640 1 --2- 172.21.15.18:0/985081331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd618004d40 0x7fd6300c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.151+0000 7fd62f7fe640 1 -- 172.21.15.18:0/985081331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6300cc540 msgr2=0x7fd63015c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:54.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.151+0000 7fd62f7fe640 1 --2- 172.21.15.18:0/985081331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6300cc540 0x7fd63015c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:54.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.151+0000 7fd62f7fe640 1 -- 172.21.15.18:0/985081331 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd63015ce30 con 0x7fd6301f4c70 2024-09-19T09:22:54.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.151+0000 7fd62f7fe640 1 --2- 172.21.15.18:0/985081331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6301f4c70 0x7fd63014aec0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fd624004ec0 tx=0x7fd624007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:54.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.151+0000 7fd62cff9640 1 -- 172.21.15.18:0/985081331 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62400f7b0 con 0x7fd6301f4c70 2024-09-19T09:22:54.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.151+0000 7fd62cff9640 1 -- 172.21.15.18:0/985081331 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd624018070 con 0x7fd6301f4c70 2024-09-19T09:22:54.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.151+0000 7fd6366b7640 1 -- 172.21.15.18:0/985081331 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6300c9390 con 0x7fd6301f4c70 2024-09-19T09:22:54.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.151+0000 7fd62cff9640 1 -- 172.21.15.18:0/985081331 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62400fbb0 con 0x7fd6301f4c70 2024-09-19T09:22:54.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.151+0000 7fd6366b7640 1 -- 172.21.15.18:0/985081331 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6300c9950 con 0x7fd6301f4c70 2024-09-19T09:22:54.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.152+0000 7fd6366b7640 1 -- 172.21.15.18:0/985081331 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd63006d250 con 0x7fd6301f4c70 2024-09-19T09:22:54.156 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.153+0000 7fd62cff9640 1 -- 172.21.15.18:0/985081331 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd62400fd50 con 0x7fd6301f4c70 2024-09-19T09:22:54.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.154+0000 7fd62cff9640 1 --2- 172.21.15.18:0/985081331 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd61c06c2b0 0x7fd61c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:54.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.154+0000 7fd62cff9640 1 -- 172.21.15.18:0/985081331 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 4943+0+0 (secure 0 0 0) 0x7fd62408afd0 con 0x7fd6301f4c70 2024-09-19T09:22:54.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.154+0000 7fd62ffff640 1 --2- 172.21.15.18:0/985081331 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd61c06c2b0 0x7fd61c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:54.157 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.156+0000 7fd62ffff640 1 --2- 172.21.15.18:0/985081331 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd61c06c2b0 0x7fd61c06e770 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd620000c00 tx=0x7fd620009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:54.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.158+0000 7fd62cff9640 1 -- 172.21.15.18:0/985081331 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd6240593f0 con 0x7fd6301f4c70 2024-09-19T09:22:54.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:54.404+0000 7fd6366b7640 1 -- 172.21.15.18:0/985081331 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) -- 0x7fd63006cf70 con 0x7fd6301f4c70 2024-09-19T09:22:55.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.410+0000 7fd62cff9640 1 -- 172.21.15.18:0/985081331 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v448) ==== 134+0+0 (secure 0 0 0) 0x7fd62405d6f0 con 0x7fd6301f4c70 2024-09-19T09:22:55.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.413+0000 7fd6366b7640 1 -- 172.21.15.18:0/985081331 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd61c06c2b0 msgr2=0x7fd61c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:55.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.413+0000 7fd6366b7640 1 --2- 172.21.15.18:0/985081331 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd61c06c2b0 0x7fd61c06e770 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd620000c00 tx=0x7fd620009040 comp rx=0 tx=0).stop 2024-09-19T09:22:55.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.413+0000 7fd6366b7640 1 -- 172.21.15.18:0/985081331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6301f4c70 msgr2=0x7fd63014aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:55.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.413+0000 7fd6366b7640 1 --2- 172.21.15.18:0/985081331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6301f4c70 0x7fd63014aec0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fd624004ec0 tx=0x7fd624007430 comp rx=0 tx=0).stop 2024-09-19T09:22:55.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.413+0000 7fd6366b7640 1 -- 172.21.15.18:0/985081331 shutdown_connections 2024-09-19T09:22:55.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.413+0000 7fd6366b7640 1 --2- 172.21.15.18:0/985081331 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd61c06c2b0 0x7fd61c06e770 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:55.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.413+0000 7fd6366b7640 1 --2- 172.21.15.18:0/985081331 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd6300cc540 0x7fd63015c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:55.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.413+0000 7fd6366b7640 1 --2- 172.21.15.18:0/985081331 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6301f4c70 0x7fd63014aec0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:55.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.413+0000 7fd6366b7640 1 --2- 172.21.15.18:0/985081331 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd618004d40 0x7fd6300c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:55.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.413+0000 7fd6366b7640 1 -- 172.21.15.18:0/985081331 >> 172.21.15.18:0/985081331 conn(0x7fd6300d4c60 msgr2=0x7fd6300b5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:55.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.414+0000 7fd6366b7640 1 -- 172.21.15.18:0/985081331 shutdown_connections 2024-09-19T09:22:55.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.414+0000 7fd6366b7640 1 -- 172.21.15.18:0/985081331 wait complete. 2024-09-19T09:22:55.428 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-19T09:22:55.540 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.540+0000 7f0395bd6640 1 Processor -- start 2024-09-19T09:22:55.541 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.540+0000 7f0395bd6640 1 -- start start 2024-09-19T09:22:55.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.540+0000 7f0395bd6640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f0390159000 0x7f039015f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:55.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.540+0000 7f0395bd6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0390073610 0x7f039006e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:55.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.540+0000 7f0395bd6640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03900b4c50 con 0x7f039006bc10 2024-09-19T09:22:55.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.540+0000 7f0395bd6640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f03900d1820 con 0x7f0390159000 2024-09-19T09:22:55.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.540+0000 7f0395bd6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f039015f740 con 0x7f0390073610 2024-09-19T09:22:55.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.541+0000 7f038ffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f039006bc10 0x7f039006c030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39698/0 (socket says 172.21.15.18:39698) 2024-09-19T09:22:55.542 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.541+0000 7f038ffff640 1 -- 172.21.15.18:0/3863271790 learned_addr learned my addr 172.21.15.18:0/3863271790 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:22:55.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.541+0000 7f038f7fe640 1 --2- 172.21.15.18:0/3863271790 >> v2:172.21.15.162:3300/0 conn(0x7f0390159000 0x7f039015f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:55.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.541+0000 7f038effd640 1 --2- 172.21.15.18:0/3863271790 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0390073610 0x7f039006e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:55.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.541+0000 7f038e7fc640 1 -- 172.21.15.18:0/3863271790 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3694578577 0 0) 0x7f03900b4c50 con 0x7f039006bc10 2024-09-19T09:22:55.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.541+0000 7f038e7fc640 1 -- 172.21.15.18:0/3863271790 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0378003520 con 0x7f039006bc10 2024-09-19T09:22:55.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.541+0000 7f038f7fe640 1 -- 172.21.15.18:0/3863271790 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0390073610 msgr2=0x7f039006e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:55.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.541+0000 7f038f7fe640 1 --2- 172.21.15.18:0/3863271790 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0390073610 0x7f039006e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:55.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.541+0000 7f038e7fc640 1 -- 172.21.15.18:0/3863271790 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1552743353 0 0) 0x7f0378003520 con 0x7f039006bc10 2024-09-19T09:22:55.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.541+0000 7f038f7fe640 1 -- 172.21.15.18:0/3863271790 >> v1:172.21.15.18:6789/0 conn(0x7f039006bc10 legacy=0x7f039006c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:55.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.541+0000 7f038f7fe640 1 -- 172.21.15.18:0/3863271790 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f039015fa20 con 0x7f0390159000 2024-09-19T09:22:55.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.542+0000 7f038f7fe640 1 --2- 172.21.15.18:0/3863271790 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0390159000 0x7f039015f080 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f03800097a0 tx=0x7f038002a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67b150ebb5ab992e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:55.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.542+0000 7f038e7fc640 1 -- 172.21.15.18:0/3863271790 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0380037070 con 0x7f0390159000 2024-09-19T09:22:55.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.542+0000 7f038e7fc640 1 -- 172.21.15.18:0/3863271790 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f038002aba0 con 0x7f0390159000 2024-09-19T09:22:55.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.542+0000 7f038e7fc640 1 -- 172.21.15.18:0/3863271790 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0388001a10 con 0x7f0390159000 2024-09-19T09:22:55.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.543+0000 7f0395bd6640 1 -- 172.21.15.18:0/3863271790 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0390159000 msgr2=0x7f039015f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:55.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.543+0000 7f0395bd6640 1 --2- 172.21.15.18:0/3863271790 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0390159000 0x7f039015f080 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f03800097a0 tx=0x7f038002a110 comp rx=0 tx=0).stop 2024-09-19T09:22:55.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.543+0000 7f0395bd6640 1 -- 172.21.15.18:0/3863271790 shutdown_connections 2024-09-19T09:22:55.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.543+0000 7f0395bd6640 1 --2- 172.21.15.18:0/3863271790 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0390073610 0x7f039006e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:55.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.543+0000 7f0395bd6640 1 --2- 172.21.15.18:0/3863271790 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0390159000 0x7f039015f080 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:55.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.543+0000 7f0395bd6640 1 -- 172.21.15.18:0/3863271790 >> 172.21.15.18:0/3863271790 conn(0x7f039006cd20 msgr2=0x7f039006d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:55.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.543+0000 7f0395bd6640 1 -- 172.21.15.18:0/3863271790 shutdown_connections 2024-09-19T09:22:55.545 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.543+0000 7f0395bd6640 1 -- 172.21.15.18:0/3863271790 wait complete. 2024-09-19T09:22:55.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.544+0000 7f0395bd6640 1 Processor -- start 2024-09-19T09:22:55.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.544+0000 7f0395bd6640 1 -- start start 2024-09-19T09:22:55.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.545+0000 7f0395bd6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f039006bc10 0x7f0390151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:55.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.545+0000 7f0395bd6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0390073610 0x7f03901e8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:55.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.545+0000 7f0395bd6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0390159000 0x7f039006f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:55.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.545+0000 7f0395bd6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f03901593e0 con 0x7f039006bc10 2024-09-19T09:22:55.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.545+0000 7f0395bd6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f039015ffe0 con 0x7f0390159000 2024-09-19T09:22:55.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.545+0000 7f0395bd6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0390159560 con 0x7f0390073610 2024-09-19T09:22:55.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.545+0000 7f038f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f039006bc10 0x7f0390151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:55.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.545+0000 7f038f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f039006bc10 0x7f0390151210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51194/0 (socket says 172.21.15.18:51194) 2024-09-19T09:22:55.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.545+0000 7f038f7fe640 1 -- 172.21.15.18:0/592389627 learned_addr learned my addr 172.21.15.18:0/592389627 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:55.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.545+0000 7f038ffff640 1 --2- 172.21.15.18:0/592389627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0390159000 0x7f039006f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:55.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.545+0000 7f038effd640 1 --2- 172.21.15.18:0/592389627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0390073610 0x7f03901e8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:55.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.546+0000 7f038f7fe640 1 -- 172.21.15.18:0/592389627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0390073610 msgr2=0x7f03901e8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:55.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.546+0000 7f038f7fe640 1 --2- 172.21.15.18:0/592389627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0390073610 0x7f03901e8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:55.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.546+0000 7f038f7fe640 1 -- 172.21.15.18:0/592389627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0390159000 msgr2=0x7f039006f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:55.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.546+0000 7f038f7fe640 1 --2- 172.21.15.18:0/592389627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0390159000 0x7f039006f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:55.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.546+0000 7f038f7fe640 1 -- 172.21.15.18:0/592389627 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f039015ae80 con 0x7f039006bc10 2024-09-19T09:22:55.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.546+0000 7f038f7fe640 1 --2- 172.21.15.18:0/592389627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f039006bc10 0x7f0390151210 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f0380035040 tx=0x7f03800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:55.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.546+0000 7f0377fff640 1 -- 172.21.15.18:0/592389627 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0380037050 con 0x7f039006bc10 2024-09-19T09:22:55.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.546+0000 7f0377fff640 1 -- 172.21.15.18:0/592389627 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0380043070 con 0x7f039006bc10 2024-09-19T09:22:55.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.546+0000 7f0395bd6640 1 -- 172.21.15.18:0/592389627 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f039015b160 con 0x7f039006bc10 2024-09-19T09:22:55.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.546+0000 7f0377fff640 1 -- 172.21.15.18:0/592389627 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0380006e10 con 0x7f039006bc10 2024-09-19T09:22:55.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.546+0000 7f0395bd6640 1 -- 172.21.15.18:0/592389627 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f039015b720 con 0x7f039006bc10 2024-09-19T09:22:55.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.547+0000 7f0395bd6640 1 -- 172.21.15.18:0/592389627 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f039015f080 con 0x7f039006bc10 2024-09-19T09:22:55.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.548+0000 7f0377fff640 1 -- 172.21.15.18:0/592389627 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0380048460 con 0x7f039006bc10 2024-09-19T09:22:55.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.548+0000 7f0377fff640 1 --2- 172.21.15.18:0/592389627 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f037c06c2b0 0x7f037c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:55.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.548+0000 7f0377fff640 1 -- 172.21.15.18:0/592389627 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 4943+0+0 (secure 0 0 0) 0x7f03800ab7a0 con 0x7f039006bc10 2024-09-19T09:22:55.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.549+0000 7f038effd640 1 --2- 172.21.15.18:0/592389627 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f037c06c2b0 0x7f037c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:55.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.549+0000 7f038effd640 1 --2- 172.21.15.18:0/592389627 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f037c06c2b0 0x7f037c06e770 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f03901f8220 tx=0x7f0384009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:55.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.553+0000 7f0377fff640 1 -- 172.21.15.18:0/592389627 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0380079c50 con 0x7f039006bc10 2024-09-19T09:22:55.728 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.727+0000 7f0395bd6640 1 -- 172.21.15.18:0/592389627 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f03900b21c0 con 0x7f039006bc10 2024-09-19T09:22:55.731 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.730+0000 7f0377fff640 1 -- 172.21.15.18:0/592389627 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7f038007df50 con 0x7f039006bc10 2024-09-19T09:22:55.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.732+0000 7f0395bd6640 1 -- 172.21.15.18:0/592389627 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f037c06c2b0 msgr2=0x7f037c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:55.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.732+0000 7f0395bd6640 1 --2- 172.21.15.18:0/592389627 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f037c06c2b0 0x7f037c06e770 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f03901f8220 tx=0x7f0384009190 comp rx=0 tx=0).stop 2024-09-19T09:22:55.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.732+0000 7f0395bd6640 1 -- 172.21.15.18:0/592389627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f039006bc10 msgr2=0x7f0390151210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:55.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.732+0000 7f0395bd6640 1 --2- 172.21.15.18:0/592389627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f039006bc10 0x7f0390151210 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f0380035040 tx=0x7f03800046c0 comp rx=0 tx=0).stop 2024-09-19T09:22:55.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.732+0000 7f0395bd6640 1 -- 172.21.15.18:0/592389627 shutdown_connections 2024-09-19T09:22:55.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.732+0000 7f0395bd6640 1 --2- 172.21.15.18:0/592389627 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f037c06c2b0 0x7f037c06e770 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:55.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.732+0000 7f0395bd6640 1 --2- 172.21.15.18:0/592389627 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0390159000 0x7f039006f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:55.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.732+0000 7f0395bd6640 1 --2- 172.21.15.18:0/592389627 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f0390073610 0x7f03901e8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:55.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.732+0000 7f0395bd6640 1 --2- 172.21.15.18:0/592389627 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f039006bc10 0x7f0390151210 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:55.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.732+0000 7f0395bd6640 1 -- 172.21.15.18:0/592389627 >> 172.21.15.18:0/592389627 conn(0x7f039006cd20 msgr2=0x7f03900b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:55.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.732+0000 7f0395bd6640 1 -- 172.21.15.18:0/592389627 shutdown_connections 2024-09-19T09:22:55.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:55.732+0000 7f0395bd6640 1 -- 172.21.15.18:0/592389627 wait complete. 2024-09-19T09:22:55.744 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T09:22:55.744 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:22:55.795 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:22:55.857 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T09:22:55.858 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:22:55.858 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:22:55.874 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17075 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T09:22:55.874 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:22:55.874 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:22:55.892 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3252 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T09:22:55.892 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:22:55.892 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:22:55.930 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17075 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T09:22:55.931 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:22:55.931 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:22:55.950 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3252 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T09:22:55.950 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-19T09:22:55.951 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:22:56.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.071+0000 7fccef591640 1 Processor -- start 2024-09-19T09:22:56.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.072+0000 7fccef591640 1 -- start start 2024-09-19T09:22:56.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.072+0000 7fccef591640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcce8152210 0x7fcce8071e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:56.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.072+0000 7fccef591640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcce80723d0 0x7fcce80cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:56.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.072+0000 7fccef591640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcce80cf550 0x7fcce806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:56.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.072+0000 7fccef591640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fcce80cf9c0 con 0x7fcce80cf550 2024-09-19T09:22:56.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.072+0000 7fccef591640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fcce815c4f0 con 0x7fcce80723d0 2024-09-19T09:22:56.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.072+0000 7fccef591640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcce815b730 con 0x7fcce8152210 2024-09-19T09:22:56.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.073+0000 7fccedb2e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcce80cf550 0x7fcce806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:56.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.073+0000 7fccedb2e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcce80cf550 0x7fcce806d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51204/0 (socket says 172.21.15.18:51204) 2024-09-19T09:22:56.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.073+0000 7fccedb2e640 1 -- 172.21.15.18:0/1029202995 learned_addr learned my addr 172.21.15.18:0/1029202995 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:56.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.073+0000 7fccecb2c640 1 --2- 172.21.15.18:0/1029202995 >> v2:172.21.15.162:3300/0 conn(0x7fcce80723d0 0x7fcce80cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:56.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.073+0000 7fcced32d640 1 --2- 172.21.15.18:0/1029202995 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcce8152210 0x7fcce8071e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:56.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.073+0000 7fccedb2e640 1 -- 172.21.15.18:0/1029202995 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcce8152210 msgr2=0x7fcce8071e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:56.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.073+0000 7fccedb2e640 1 --2- 172.21.15.18:0/1029202995 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcce8152210 0x7fcce8071e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:56.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.073+0000 7fccedb2e640 1 -- 172.21.15.18:0/1029202995 >> v2:172.21.15.162:3300/0 conn(0x7fcce80723d0 msgr2=0x7fcce80cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:56.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.073+0000 7fccedb2e640 1 --2- 172.21.15.18:0/1029202995 >> v2:172.21.15.162:3300/0 conn(0x7fcce80723d0 0x7fcce80cf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:56.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.073+0000 7fccedb2e640 1 -- 172.21.15.18:0/1029202995 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce815ba10 con 0x7fcce80cf550 2024-09-19T09:22:56.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.073+0000 7fccecb2c640 1 --2- 172.21.15.18:0/1029202995 >> v2:172.21.15.162:3300/0 conn(0x7fcce80723d0 0x7fcce80cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:22:56.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.073+0000 7fcced32d640 1 --2- 172.21.15.18:0/1029202995 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcce8152210 0x7fcce8071e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:22:56.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.074+0000 7fccedb2e640 1 --2- 172.21.15.18:0/1029202995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcce80cf550 0x7fcce806d6b0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fcce80759a0 tx=0x7fccd802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a21e378053253e7b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:56.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.074+0000 7fcce7fff640 1 -- 172.21.15.18:0/1029202995 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd8036070 con 0x7fcce80cf550 2024-09-19T09:22:56.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.074+0000 7fcce7fff640 1 -- 172.21.15.18:0/1029202995 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccd8031600 con 0x7fcce80cf550 2024-09-19T09:22:56.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.074+0000 7fcce7fff640 1 -- 172.21.15.18:0/1029202995 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccd80319d0 con 0x7fcce80cf550 2024-09-19T09:22:56.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.074+0000 7fccef591640 1 -- 172.21.15.18:0/1029202995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcce80cf550 msgr2=0x7fcce806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:56.078 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.074+0000 7fccef591640 1 --2- 172.21.15.18:0/1029202995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcce80cf550 0x7fcce806d6b0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fcce80759a0 tx=0x7fccd802a6a0 comp rx=0 tx=0).stop 2024-09-19T09:22:56.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.074+0000 7fccef591640 1 -- 172.21.15.18:0/1029202995 shutdown_connections 2024-09-19T09:22:56.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.074+0000 7fccef591640 1 --2- 172.21.15.18:0/1029202995 >> v2:172.21.15.162:3300/0 conn(0x7fcce80723d0 0x7fcce80cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:56.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.074+0000 7fccef591640 1 --2- 172.21.15.18:0/1029202995 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcce80cf550 0x7fcce806d6b0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:56.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.074+0000 7fccef591640 1 --2- 172.21.15.18:0/1029202995 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcce8152210 0x7fcce8071e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:56.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.074+0000 7fccef591640 1 -- 172.21.15.18:0/1029202995 >> 172.21.15.18:0/1029202995 conn(0x7fcce806bc10 msgr2=0x7fcce806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:56.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.075+0000 7fccef591640 1 -- 172.21.15.18:0/1029202995 shutdown_connections 2024-09-19T09:22:56.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.075+0000 7fccef591640 1 -- 172.21.15.18:0/1029202995 wait complete. 2024-09-19T09:22:56.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.076+0000 7fccef591640 1 Processor -- start 2024-09-19T09:22:56.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.076+0000 7fccef591640 1 -- start start 2024-09-19T09:22:56.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.076+0000 7fccef591640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcce80723d0 0x7fcce8141890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:56.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.076+0000 7fccef591640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcce80cf550 0x7fcce81f43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:56.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.076+0000 7fccef591640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcce8152210 0x7fcce81e5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:56.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.076+0000 7fccef591640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcce806f380 con 0x7fcce80723d0 2024-09-19T09:22:56.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.076+0000 7fccef591640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcce815bfd0 con 0x7fcce80cf550 2024-09-19T09:22:56.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.076+0000 7fccef591640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcce80ce780 con 0x7fcce8152210 2024-09-19T09:22:56.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.076+0000 7fcced32d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcce80723d0 0x7fcce8141890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:56.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.077+0000 7fcced32d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcce80723d0 0x7fcce8141890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51214/0 (socket says 172.21.15.18:51214) 2024-09-19T09:22:56.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.077+0000 7fcced32d640 1 -- 172.21.15.18:0/1901516996 learned_addr learned my addr 172.21.15.18:0/1901516996 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:56.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.077+0000 7fccedb2e640 1 --2- 172.21.15.18:0/1901516996 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcce8152210 0x7fcce81e5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:56.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.077+0000 7fccecb2c640 1 --2- 172.21.15.18:0/1901516996 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcce80cf550 0x7fcce81f43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:56.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.077+0000 7fcced32d640 1 -- 172.21.15.18:0/1901516996 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcce8152210 msgr2=0x7fcce81e5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:56.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.077+0000 7fcced32d640 1 --2- 172.21.15.18:0/1901516996 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcce8152210 0x7fcce81e5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:56.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.077+0000 7fcced32d640 1 -- 172.21.15.18:0/1901516996 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcce80cf550 msgr2=0x7fcce81f43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:56.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.077+0000 7fcced32d640 1 --2- 172.21.15.18:0/1901516996 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcce80cf550 0x7fcce81f43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:56.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.077+0000 7fcced32d640 1 -- 172.21.15.18:0/1901516996 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce81f3c20 con 0x7fcce80723d0 2024-09-19T09:22:56.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.077+0000 7fcced32d640 1 --2- 172.21.15.18:0/1901516996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcce80723d0 0x7fcce8141890 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fcce000c7f0 tx=0x7fcce000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:56.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.077+0000 7fcce5ffb640 1 -- 172.21.15.18:0/1901516996 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce0015070 con 0x7fcce80723d0 2024-09-19T09:22:56.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.077+0000 7fcce5ffb640 1 -- 172.21.15.18:0/1901516996 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcce0007820 con 0x7fcce80723d0 2024-09-19T09:22:56.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.077+0000 7fcce5ffb640 1 -- 172.21.15.18:0/1901516996 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcce0007bd0 con 0x7fcce80723d0 2024-09-19T09:22:56.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.077+0000 7fccef591640 1 -- 172.21.15.18:0/1901516996 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcce814e330 con 0x7fcce80723d0 2024-09-19T09:22:56.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.077+0000 7fccef591640 1 -- 172.21.15.18:0/1901516996 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcce8141dd0 con 0x7fcce80723d0 2024-09-19T09:22:56.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.078+0000 7fccef591640 1 -- 172.21.15.18:0/1901516996 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcce80b5330 con 0x7fcce80723d0 2024-09-19T09:22:56.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.079+0000 7fcce5ffb640 1 -- 172.21.15.18:0/1901516996 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcce0018070 con 0x7fcce80723d0 2024-09-19T09:22:56.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.079+0000 7fcce5ffb640 1 --2- 172.21.15.18:0/1901516996 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fccd406c2b0 0x7fccd406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:56.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.079+0000 7fcce5ffb640 1 -- 172.21.15.18:0/1901516996 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 4943+0+0 (secure 0 0 0) 0x7fcce008b160 con 0x7fcce80723d0 2024-09-19T09:22:56.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.079+0000 7fccecb2c640 1 --2- 172.21.15.18:0/1901516996 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fccd406c2b0 0x7fccd406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:56.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.080+0000 7fccecb2c640 1 --2- 172.21.15.18:0/1901516996 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fccd406c2b0 0x7fccd406e770 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fcce80cca30 tx=0x7fccdc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:56.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.083+0000 7fcce5ffb640 1 -- 172.21.15.18:0/1901516996 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fcce80b5330 con 0x7fcce80723d0 2024-09-19T09:22:56.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.296+0000 7fccef591640 1 -- 172.21.15.18:0/1901516996 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcce8071e90 con 0x7fcce80723d0 2024-09-19T09:22:56.298 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.296+0000 7fcce5ffb640 1 -- 172.21.15.18:0/1901516996 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) ==== 94+0+3911 (secure 0 0 0) 0x7fcce0059bd0 con 0x7fcce80723d0 2024-09-19T09:22:56.299 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:22:56.299 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":67,"btime":"2024-09-19T09:22:49:935089+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6044,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/2661639901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":2661639901},{"type":"v1","addr":"172.21.15.162:6836","nonce":2661639901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":7221,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6833/56318264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":56318264},{"type":"v1","addr":"172.21.15.18:6833","nonce":56318264}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":59},{"gid":7239,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1783371939","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1783371939},{"type":"v1","addr":"172.21.15.162:6837","nonce":1783371939}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":60},{"gid":7467,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/2812390965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6834","nonce":2812390965},{"type":"v1","addr":"172.21.15.18:6835","nonce":2812390965}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":67}],"filesystems":[]} 2024-09-19T09:22:56.299 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 67 2024-09-19T09:22:56.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.299+0000 7fccef591640 1 -- 172.21.15.18:0/1901516996 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fccd406c2b0 msgr2=0x7fccd406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:56.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.299+0000 7fccef591640 1 --2- 172.21.15.18:0/1901516996 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fccd406c2b0 0x7fccd406e770 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fcce80cca30 tx=0x7fccdc008040 comp rx=0 tx=0).stop 2024-09-19T09:22:56.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.299+0000 7fccef591640 1 -- 172.21.15.18:0/1901516996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcce80723d0 msgr2=0x7fcce8141890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:56.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.299+0000 7fccef591640 1 --2- 172.21.15.18:0/1901516996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcce80723d0 0x7fcce8141890 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fcce000c7f0 tx=0x7fcce000ccb0 comp rx=0 tx=0).stop 2024-09-19T09:22:56.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.299+0000 7fccef591640 1 -- 172.21.15.18:0/1901516996 shutdown_connections 2024-09-19T09:22:56.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.299+0000 7fccef591640 1 --2- 172.21.15.18:0/1901516996 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fccd406c2b0 0x7fccd406e770 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:56.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.299+0000 7fccef591640 1 --2- 172.21.15.18:0/1901516996 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcce8152210 0x7fcce81e5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:56.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.299+0000 7fccef591640 1 --2- 172.21.15.18:0/1901516996 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcce80cf550 0x7fcce81f43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:56.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.299+0000 7fccef591640 1 --2- 172.21.15.18:0/1901516996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcce80723d0 0x7fcce8141890 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:56.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.299+0000 7fccef591640 1 -- 172.21.15.18:0/1901516996 >> 172.21.15.18:0/1901516996 conn(0x7fcce806bc10 msgr2=0x7fcce815c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:56.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.299+0000 7fccef591640 1 -- 172.21.15.18:0/1901516996 shutdown_connections 2024-09-19T09:22:56.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.299+0000 7fccef591640 1 -- 172.21.15.18:0/1901516996 wait complete. 2024-09-19T09:22:56.312 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T09:22:56.312 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-19T09:22:56.312 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T09:22:56.312 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:22:56.312 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T09:22:56.313 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-19T09:22:56.313 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T09:22:56.313 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:22:56.313 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T09:22:56.313 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-19T09:22:56.313 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T09:22:56.313 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:22:56.314 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T09:22:56.314 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-19T09:22:56.314 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T09:22:56.314 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:22:56.322 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T09:22:56.322 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T09:22:56.322 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T09:22:56.323 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T09:22:56.325 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T09:22:56.326 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T09:22:56.326 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T09:22:56.326 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T09:22:56.364 INFO:tasks.ceph.mds.c:Started 2024-09-19T09:22:56.365 DEBUG:teuthology.parallel:result is None 2024-09-19T09:22:56.365 INFO:tasks.ceph.mds.a:Started 2024-09-19T09:22:56.365 DEBUG:teuthology.parallel:result is None 2024-09-19T09:22:56.368 INFO:tasks.ceph.mds.b:Started 2024-09-19T09:22:56.368 DEBUG:teuthology.parallel:result is None 2024-09-19T09:22:56.369 INFO:tasks.ceph.mds.d:Started 2024-09-19T09:22:56.369 DEBUG:teuthology.parallel:result is None 2024-09-19T09:22:56.369 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-19T09:22:56.443 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2024-09-19T09:22:56.444 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-09-19T09:22:56.454 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-09-19T09:22:56.454 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-09-19T09:22:56.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.476+0000 7f20213f8640 1 Processor -- start 2024-09-19T09:22:56.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.476+0000 7f20213f8640 1 -- start start 2024-09-19T09:22:56.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.477+0000 7f20213f8640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f201c0d1d40 0x7f201c0d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:56.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.477+0000 7f20213f8640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f201c0d3cc0 con 0x7f201c15eda0 2024-09-19T09:22:56.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.477+0000 7f201b7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f201c0d1d40 0x7f201c0d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:56.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.477+0000 7f201affd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f201c15eda0 0x7f201c0d35b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39720/0 (socket says 172.21.15.18:39720) 2024-09-19T09:22:56.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.477+0000 7f201affd640 1 -- 172.21.15.18:0/2913470352 learned_addr learned my addr 172.21.15.18:0/2913470352 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:22:56.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.477+0000 7f20213f8640 1 -- 172.21.15.18:0/2913470352 --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f201c0d0bf0 con 0x7f201c0d5790 2024-09-19T09:22:56.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.477+0000 7f20213f8640 1 -- 172.21.15.18:0/2913470352 --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f201c0d5c00 con 0x7f201c0d1d40 2024-09-19T09:22:56.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.477+0000 7f201b7fe640 1 -- 172.21.15.18:0/2913470352 >> v1:172.21.15.162:6789/0 conn(0x7f201c0d5790 legacy=0x7f201c0d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:56.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.477+0000 7f201b7fe640 1 -- 172.21.15.18:0/2913470352 >> v1:172.21.15.18:6789/0 conn(0x7f201c15eda0 legacy=0x7f201c0d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:56.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.477+0000 7f201b7fe640 1 -- 172.21.15.18:0/2913470352 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f201c0d2ad0 con 0x7f201c0d1d40 2024-09-19T09:22:56.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.477+0000 7f2019ffb640 1 -- 172.21.15.18:0/2913470352 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 270971690 0 0) 0x7f201c0d3cc0 con 0x7f201c15eda0 2024-09-19T09:22:56.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.478+0000 7f201b7fe640 1 --2- 172.21.15.18:0/2913470352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f201c0d1d40 0x7f201c0d0480 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f2014009d90 tx=0x7f201402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb219116c52fb90 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:56.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.478+0000 7f2019ffb640 1 -- 172.21.15.18:0/2913470352 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2014007740 con 0x7f201c0d1d40 2024-09-19T09:22:56.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.478+0000 7f2019ffb640 1 -- 172.21.15.18:0/2913470352 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20140078e0 con 0x7f201c0d1d40 2024-09-19T09:22:56.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.478+0000 7f2019ffb640 1 -- 172.21.15.18:0/2913470352 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2014007cb0 con 0x7f201c0d1d40 2024-09-19T09:22:56.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.479+0000 7f20213f8640 1 -- 172.21.15.18:0/2913470352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f201c0d1d40 msgr2=0x7f201c0d0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:56.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.479+0000 7f20213f8640 1 --2- 172.21.15.18:0/2913470352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f201c0d1d40 0x7f201c0d0480 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f2014009d90 tx=0x7f201402a6f0 comp rx=0 tx=0).stop 2024-09-19T09:22:56.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.479+0000 7f20213f8640 1 -- 172.21.15.18:0/2913470352 shutdown_connections 2024-09-19T09:22:56.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.479+0000 7f20213f8640 1 --2- 172.21.15.18:0/2913470352 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f201c0d1d40 0x7f201c0d0480 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:56.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.479+0000 7f20213f8640 1 -- 172.21.15.18:0/2913470352 >> 172.21.15.18:0/2913470352 conn(0x7f201c09df40 msgr2=0x7f201c0d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:56.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.479+0000 7f20213f8640 1 -- 172.21.15.18:0/2913470352 shutdown_connections 2024-09-19T09:22:56.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.479+0000 7f20213f8640 1 -- 172.21.15.18:0/2913470352 wait complete. 2024-09-19T09:22:56.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.480+0000 7f20213f8640 1 Processor -- start 2024-09-19T09:22:56.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.480+0000 7f20213f8640 1 -- start start 2024-09-19T09:22:56.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.481+0000 7f20213f8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f201c0d1d40 0x7f201c160e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:56.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.481+0000 7f20213f8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f201c0d5790 0x7f201c162070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:56.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.481+0000 7f20213f8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f201c15eda0 0x7f201c1f5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:56.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.481+0000 7f20213f8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f201c0d2880 con 0x7f201c0d1d40 2024-09-19T09:22:56.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.481+0000 7f20213f8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f201c0d3120 con 0x7f201c0d5790 2024-09-19T09:22:56.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.481+0000 7f20213f8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f201c15f180 con 0x7f201c15eda0 2024-09-19T09:22:56.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.481+0000 7f201affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f201c0d1d40 0x7f201c160e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:56.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.481+0000 7f201affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f201c0d1d40 0x7f201c160e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51266/0 (socket says 172.21.15.18:51266) 2024-09-19T09:22:56.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.481+0000 7f201affd640 1 -- 172.21.15.18:0/1258922094 learned_addr learned my addr 172.21.15.18:0/1258922094 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:56.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.481+0000 7f201b7fe640 1 --2- 172.21.15.18:0/1258922094 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f201c15eda0 0x7f201c1f5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:56.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.481+0000 7f201a7fc640 1 --2- 172.21.15.18:0/1258922094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f201c0d5790 0x7f201c162070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:56.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.481+0000 7f201affd640 1 -- 172.21.15.18:0/1258922094 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f201c15eda0 msgr2=0x7f201c1f5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:56.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.481+0000 7f201affd640 1 --2- 172.21.15.18:0/1258922094 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f201c15eda0 0x7f201c1f5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:56.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.481+0000 7f201affd640 1 -- 172.21.15.18:0/1258922094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f201c0d5790 msgr2=0x7f201c162070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:56.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.481+0000 7f201affd640 1 --2- 172.21.15.18:0/1258922094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f201c0d5790 0x7f201c162070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:56.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.481+0000 7f201affd640 1 -- 172.21.15.18:0/1258922094 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f201c09ec90 con 0x7f201c0d1d40 2024-09-19T09:22:56.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.481+0000 7f201a7fc640 1 --2- 172.21.15.18:0/1258922094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f201c0d5790 0x7f201c162070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:56.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.481+0000 7f201affd640 1 --2- 172.21.15.18:0/1258922094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f201c0d1d40 0x7f201c160e60 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f200c00c4a0 tx=0x7f200c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:56.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.482+0000 7f20037fe640 1 -- 172.21.15.18:0/1258922094 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c018070 con 0x7f201c0d1d40 2024-09-19T09:22:56.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.482+0000 7f20037fe640 1 -- 172.21.15.18:0/1258922094 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f200c0074e0 con 0x7f201c0d1d40 2024-09-19T09:22:56.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.482+0000 7f20037fe640 1 -- 172.21.15.18:0/1258922094 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c004a20 con 0x7f201c0d1d40 2024-09-19T09:22:56.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.482+0000 7f20213f8640 1 -- 172.21.15.18:0/1258922094 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f201c15fdc0 con 0x7f201c0d1d40 2024-09-19T09:22:56.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.482+0000 7f20213f8640 1 -- 172.21.15.18:0/1258922094 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f201c160380 con 0x7f201c0d1d40 2024-09-19T09:22:56.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.483+0000 7f20213f8640 1 -- 172.21.15.18:0/1258922094 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f201c160b50 con 0x7f201c0d1d40 2024-09-19T09:22:56.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.483+0000 7f20037fe640 1 -- 172.21.15.18:0/1258922094 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f200c01b070 con 0x7f201c0d1d40 2024-09-19T09:22:56.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.484+0000 7f20037fe640 1 --2- 172.21.15.18:0/1258922094 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f200806c2b0 0x7f200806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:56.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.484+0000 7f20037fe640 1 -- 172.21.15.18:0/1258922094 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 4943+0+0 (secure 0 0 0) 0x7f200c08a3a0 con 0x7f201c0d1d40 2024-09-19T09:22:56.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.484+0000 7f201a7fc640 1 --2- 172.21.15.18:0/1258922094 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f200806c2b0 0x7f200806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:56.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.485+0000 7f201a7fc640 1 --2- 172.21.15.18:0/1258922094 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f200806c2b0 0x7f200806e770 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2010007fd0 tx=0x7f2010009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:56.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.488+0000 7f20037fe640 1 -- 172.21.15.18:0/1258922094 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f200c058ea0 con 0x7f201c0d1d40 2024-09-19T09:22:56.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:56.676+0000 7f20213f8640 1 -- 172.21.15.18:0/1258922094 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f201c0d0480 con 0x7f201c0d1d40 2024-09-19T09:22:57.430 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.428+0000 7f20037fe640 1 -- 172.21.15.18:0/1258922094 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v161) ==== 97+0+0 (secure 0 0 0) 0x7f200c0587a0 con 0x7f201c0d1d40 2024-09-19T09:22:57.430 INFO:teuthology.orchestra.run.smithi018.stderr: removed all blocklist entries 2024-09-19T09:22:57.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.431+0000 7f20213f8640 1 -- 172.21.15.18:0/1258922094 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f200806c2b0 msgr2=0x7f200806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:57.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.431+0000 7f20213f8640 1 --2- 172.21.15.18:0/1258922094 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f200806c2b0 0x7f200806e770 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2010007fd0 tx=0x7f2010009040 comp rx=0 tx=0).stop 2024-09-19T09:22:57.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.431+0000 7f20213f8640 1 -- 172.21.15.18:0/1258922094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f201c0d1d40 msgr2=0x7f201c160e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:57.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.431+0000 7f20213f8640 1 --2- 172.21.15.18:0/1258922094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f201c0d1d40 0x7f201c160e60 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f200c00c4a0 tx=0x7f200c00c960 comp rx=0 tx=0).stop 2024-09-19T09:22:57.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.431+0000 7f20213f8640 1 -- 172.21.15.18:0/1258922094 shutdown_connections 2024-09-19T09:22:57.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.431+0000 7f20213f8640 1 --2- 172.21.15.18:0/1258922094 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f200806c2b0 0x7f200806e770 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:57.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.431+0000 7f20213f8640 1 --2- 172.21.15.18:0/1258922094 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f201c15eda0 0x7f201c1f5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:57.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.431+0000 7f20213f8640 1 --2- 172.21.15.18:0/1258922094 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f201c0d5790 0x7f201c162070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:57.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.431+0000 7f20213f8640 1 --2- 172.21.15.18:0/1258922094 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f201c0d1d40 0x7f201c160e60 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:57.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.431+0000 7f20213f8640 1 -- 172.21.15.18:0/1258922094 >> 172.21.15.18:0/1258922094 conn(0x7f201c09df40 msgr2=0x7f201c0b7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:57.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.431+0000 7f20213f8640 1 -- 172.21.15.18:0/1258922094 shutdown_connections 2024-09-19T09:22:57.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.431+0000 7f20213f8640 1 -- 172.21.15.18:0/1258922094 wait complete. 2024-09-19T09:22:57.447 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-19T09:22:57.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.554+0000 7f7a1dfc4640 1 Processor -- start 2024-09-19T09:22:57.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.554+0000 7f7a1dfc4640 1 -- start start 2024-09-19T09:22:57.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.555+0000 7f7a1dfc4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a1813fae0 0x7f7a1806f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:57.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.555+0000 7f7a1dfc4640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7a18142150 0x7f7a18160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:57.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.555+0000 7f7a1dfc4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7a18160a80 0x7f7a1815cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:57.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.555+0000 7f7a1dfc4640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f7a180ce780 con 0x7f7a18160a80 2024-09-19T09:22:57.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.555+0000 7f7a1dfc4640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f7a18142650 con 0x7f7a18142150 2024-09-19T09:22:57.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.555+0000 7f7a1dfc4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7a18142930 con 0x7f7a1813fae0 2024-09-19T09:22:57.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.555+0000 7f7a17fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7a18160a80 0x7f7a1815cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:57.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.555+0000 7f7a17fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7a18160a80 0x7f7a1815cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51274/0 (socket says 172.21.15.18:51274) 2024-09-19T09:22:57.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.555+0000 7f7a17fff640 1 -- 172.21.15.18:0/1741154402 learned_addr learned my addr 172.21.15.18:0/1741154402 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:57.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.555+0000 7f7a17fff640 1 -- 172.21.15.18:0/1741154402 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a1813fae0 msgr2=0x7f7a1806f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:57.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.555+0000 7f7a17fff640 1 --2- 172.21.15.18:0/1741154402 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a1813fae0 0x7f7a1806f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:57.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.555+0000 7f7a17fff640 1 -- 172.21.15.18:0/1741154402 >> v2:172.21.15.162:3300/0 conn(0x7f7a18142150 msgr2=0x7f7a18160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:57.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.555+0000 7f7a17fff640 1 --2- 172.21.15.18:0/1741154402 >> v2:172.21.15.162:3300/0 conn(0x7f7a18142150 0x7f7a18160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:57.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.555+0000 7f7a17fff640 1 -- 172.21.15.18:0/1741154402 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a18142c10 con 0x7f7a18160a80 2024-09-19T09:22:57.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.556+0000 7f7a17fff640 1 --2- 172.21.15.18:0/1741154402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a18160a80 0x7f7a1815cf50 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f7a180d06f0 tx=0x7f7a1002a630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caae2d53b78e3506 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:57.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.556+0000 7f7a167fc640 1 -- 172.21.15.18:0/1741154402 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a10036070 con 0x7f7a18160a80 2024-09-19T09:22:57.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.556+0000 7f7a167fc640 1 -- 172.21.15.18:0/1741154402 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a1002ae50 con 0x7f7a18160a80 2024-09-19T09:22:57.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.556+0000 7f7a167fc640 1 -- 172.21.15.18:0/1741154402 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a10031820 con 0x7f7a18160a80 2024-09-19T09:22:57.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.557+0000 7f7a1dfc4640 1 -- 172.21.15.18:0/1741154402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a18160a80 msgr2=0x7f7a1815cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:57.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.557+0000 7f7a1dfc4640 1 --2- 172.21.15.18:0/1741154402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a18160a80 0x7f7a1815cf50 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f7a180d06f0 tx=0x7f7a1002a630 comp rx=0 tx=0).stop 2024-09-19T09:22:57.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.557+0000 7f7a1dfc4640 1 -- 172.21.15.18:0/1741154402 shutdown_connections 2024-09-19T09:22:57.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.557+0000 7f7a1dfc4640 1 --2- 172.21.15.18:0/1741154402 >> v2:172.21.15.162:3300/0 conn(0x7f7a18142150 0x7f7a18160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:57.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.557+0000 7f7a1dfc4640 1 --2- 172.21.15.18:0/1741154402 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a18160a80 0x7f7a1815cf50 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:57.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.557+0000 7f7a1dfc4640 1 --2- 172.21.15.18:0/1741154402 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a1813fae0 0x7f7a1806f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:57.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.557+0000 7f7a1dfc4640 1 -- 172.21.15.18:0/1741154402 >> 172.21.15.18:0/1741154402 conn(0x7f7a1806bc10 msgr2=0x7f7a1806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:57.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.557+0000 7f7a1dfc4640 1 -- 172.21.15.18:0/1741154402 shutdown_connections 2024-09-19T09:22:57.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.557+0000 7f7a1dfc4640 1 -- 172.21.15.18:0/1741154402 wait complete. 2024-09-19T09:22:57.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.558+0000 7f7a1dfc4640 1 Processor -- start 2024-09-19T09:22:57.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.558+0000 7f7a1dfc4640 1 -- start start 2024-09-19T09:22:57.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.559+0000 7f7a1dfc4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a1813fae0 0x7f7a18143130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:57.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.559+0000 7f7a1dfc4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a18142150 0x7f7a18134e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:57.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.559+0000 7f7a1dfc4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a18160a80 0x7f7a1815b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:57.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.559+0000 7f7a1dfc4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1806f870 con 0x7f7a18160a80 2024-09-19T09:22:57.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.559+0000 7f7a1dfc4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1806f6f0 con 0x7f7a1813fae0 2024-09-19T09:22:57.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.559+0000 7f7a1dfc4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7a1815d490 con 0x7f7a18142150 2024-09-19T09:22:57.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.559+0000 7f7a17fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a18160a80 0x7f7a1815b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:57.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.559+0000 7f7a17fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a18160a80 0x7f7a1815b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51290/0 (socket says 172.21.15.18:51290) 2024-09-19T09:22:57.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.559+0000 7f7a17fff640 1 -- 172.21.15.18:0/3442098173 learned_addr learned my addr 172.21.15.18:0/3442098173 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:57.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.559+0000 7f7a177fe640 1 --2- 172.21.15.18:0/3442098173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a1813fae0 0x7f7a18143130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:57.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.559+0000 7f7a16ffd640 1 --2- 172.21.15.18:0/3442098173 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a18142150 0x7f7a18134e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:57.563 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.559+0000 7f7a17fff640 1 -- 172.21.15.18:0/3442098173 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a18142150 msgr2=0x7f7a18134e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:57.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.559+0000 7f7a17fff640 1 --2- 172.21.15.18:0/3442098173 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a18142150 0x7f7a18134e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:57.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.559+0000 7f7a17fff640 1 -- 172.21.15.18:0/3442098173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a1813fae0 msgr2=0x7f7a18143130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:57.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.559+0000 7f7a17fff640 1 --2- 172.21.15.18:0/3442098173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a1813fae0 0x7f7a18143130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:57.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.559+0000 7f7a17fff640 1 -- 172.21.15.18:0/3442098173 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a180b3df0 con 0x7f7a18160a80 2024-09-19T09:22:57.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.559+0000 7f7a16ffd640 1 --2- 172.21.15.18:0/3442098173 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a18142150 0x7f7a18134e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:57.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.559+0000 7f7a177fe640 1 --2- 172.21.15.18:0/3442098173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a1813fae0 0x7f7a18143130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:57.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.560+0000 7f7a17fff640 1 --2- 172.21.15.18:0/3442098173 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a18160a80 0x7f7a1815b990 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f7a10034040 tx=0x7f7a10004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:57.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.560+0000 7f7a0ffff640 1 -- 172.21.15.18:0/3442098173 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a10041020 con 0x7f7a18160a80 2024-09-19T09:22:57.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.560+0000 7f7a0ffff640 1 -- 172.21.15.18:0/3442098173 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a1003c690 con 0x7f7a18160a80 2024-09-19T09:22:57.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.560+0000 7f7a0ffff640 1 -- 172.21.15.18:0/3442098173 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a10036040 con 0x7f7a18160a80 2024-09-19T09:22:57.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.560+0000 7f7a1dfc4640 1 -- 172.21.15.18:0/3442098173 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a180b40d0 con 0x7f7a18160a80 2024-09-19T09:22:57.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.560+0000 7f7a1dfc4640 1 -- 172.21.15.18:0/3442098173 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a180b4690 con 0x7f7a18160a80 2024-09-19T09:22:57.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.561+0000 7f7a1dfc4640 1 -- 172.21.15.18:0/3442098173 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a18160540 con 0x7f7a18160a80 2024-09-19T09:22:57.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.561+0000 7f7a0ffff640 1 -- 172.21.15.18:0/3442098173 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7a10044020 con 0x7f7a18160a80 2024-09-19T09:22:57.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.562+0000 7f7a0ffff640 1 --2- 172.21.15.18:0/3442098173 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f79f806c2b0 0x7f79f806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:57.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.562+0000 7f7a0ffff640 1 -- 172.21.15.18:0/3442098173 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 4857+0+0 (secure 0 0 0) 0x7f7a100abd20 con 0x7f7a18160a80 2024-09-19T09:22:57.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.562+0000 7f7a177fe640 1 --2- 172.21.15.18:0/3442098173 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f79f806c2b0 0x7f79f806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:57.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.563+0000 7f7a177fe640 1 --2- 172.21.15.18:0/3442098173 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f79f806c2b0 0x7f79f806e770 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009930 tx=0x7f7a00008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:57.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.567+0000 7f7a0ffff640 1 -- 172.21.15.18:0/3442098173 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7a1004b030 con 0x7f7a18160a80 2024-09-19T09:22:57.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.806+0000 7f7a1dfc4640 1 -- 172.21.15.18:0/3442098173 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f7a1815d960 con 0x7f7a18160a80 2024-09-19T09:22:57.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.807+0000 7f7a0ffff640 1 -- 172.21.15.18:0/3442098173 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) ==== 80+0+5304 (secure 0 0 0) 0x7f7a1007a8a0 con 0x7f7a18160a80 2024-09-19T09:22:57.809 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:22:57.809 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:22:57.809 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_dump": [ 2024-09-19T09:22:57.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:22:57.809 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.a", 2024-09-19T09:22:57.809 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmDY7cHhAALxtxGq6eR3A2QXYp+nW0FA==", 2024-09-19T09:22:57.809 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:22:57.809 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:22:57.809 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:22:57.809 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:22:57.809 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:22:57.810 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:22:57.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:22:57.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:22:57.810 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.b", 2024-09-19T09:22:57.810 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tm9ILFKhAABEtgvzO5YBXqzYaeBZ0qZg==", 2024-09-19T09:22:57.810 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:22:57.810 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:22:57.810 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:22:57.810 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:22:57.810 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:22:57.810 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:22:57.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:22:57.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:22:57.811 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.c", 2024-09-19T09:22:57.811 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmwPkOJhAADt/0XVei2kl79pIw55wu1A==", 2024-09-19T09:22:57.811 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:22:57.811 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:22:57.811 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:22:57.811 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:22:57.811 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:22:57.811 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:22:57.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:22:57.811 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:22:57.811 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.d", 2024-09-19T09:22:57.811 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tm35XYMRAA/OSE5iv8M+TekEJVTARETw==", 2024-09-19T09:22:57.811 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:22:57.812 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:22:57.812 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:22:57.812 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:22:57.812 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:22:57.812 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:22:57.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:22:57.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:22:57.812 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.0", 2024-09-19T09:22:57.812 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmkUBiGhAATWtnqNPWyZJ+tnQcZOtT5A==", 2024-09-19T09:22:57.812 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:22:57.812 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:22:57.812 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:22:57.812 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:22:57.813 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:22:57.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:22:57.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:22:57.813 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.1", 2024-09-19T09:22:57.813 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmir5wIRAA9QumyCr8yLHtNj/YqQ1d0A==", 2024-09-19T09:22:57.813 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:22:57.813 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:22:57.813 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:22:57.813 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:22:57.813 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:22:57.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:22:57.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:22:57.813 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.2", 2024-09-19T09:22:57.814 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmfQJ6KBAAfTerKv1zCzFf6UfAVUikxA==", 2024-09-19T09:22:57.814 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:22:57.814 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:22:57.814 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:22:57.814 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:22:57.814 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:22:57.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:22:57.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:22:57.814 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.3", 2024-09-19T09:22:57.814 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmSeSOLxAACqCpiIQO4cDyjXUmoGPKAQ==", 2024-09-19T09:22:57.814 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:22:57.814 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:22:57.814 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:22:57.814 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:22:57.815 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:22:57.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:22:57.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:22:57.815 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.4", 2024-09-19T09:22:57.815 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmrsoFAhAArI7cRPVe/jrnSdmyE8jCsQ==", 2024-09-19T09:22:57.815 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:22:57.815 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:22:57.815 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:22:57.815 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:22:57.815 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:22:57.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:22:57.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:22:57.815 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.5", 2024-09-19T09:22:57.816 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmudM3CRAAXF3uI58SNJE6qtYX2wNQeQ==", 2024-09-19T09:22:57.816 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:22:57.816 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:22:57.816 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:22:57.816 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:22:57.816 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:22:57.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:22:57.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:22:57.816 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.6", 2024-09-19T09:22:57.816 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmqEQmEBAAm4h/8p91HwX84pl/U80Q9Q==", 2024-09-19T09:22:57.816 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:22:57.816 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:22:57.816 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:22:57.817 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:22:57.817 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:22:57.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:22:57.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:22:57.817 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.7", 2024-09-19T09:22:57.817 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmhDs0FxAAxZvRVkBoWqsdmyifRZzgwg==", 2024-09-19T09:22:57.817 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:22:57.817 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:22:57.817 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:22:57.817 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:22:57.817 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:22:57.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:22:57.817 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:22:57.818 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.0", 2024-09-19T09:22:57.818 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmcbwDNhAAaG0+wu96Locwws+h0zeh8Q==", 2024-09-19T09:22:57.818 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:22:57.818 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:22:57.818 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow r", 2024-09-19T09:22:57.818 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-19T09:22:57.818 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:22:57.818 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:22:57.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:22:57.818 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.1", 2024-09-19T09:22:57.818 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAf6+tmb4FeAxAAU+nZN/Vb33HrU0yfXmU9gA==", 2024-09-19T09:22:57.818 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:22:57.818 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:22:57.818 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-19T09:22:57.819 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-19T09:22:57.819 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-19T09:22:57.819 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:22:57.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:22:57.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:22:57.819 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.2", 2024-09-19T09:22:57.819 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAf6+tmc34kABAAC5b4Kkm2dJvxxyXva6PT2g==", 2024-09-19T09:22:57.819 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:22:57.819 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:22:57.819 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-19T09:22:57.819 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-19T09:22:57.819 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-19T09:22:57.819 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:22:57.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:22:57.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:22:57.820 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.3", 2024-09-19T09:22:57.820 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAf6+tmx4vzCBAAZ7ZrdGI2s8LqT0MjjzOCjw==", 2024-09-19T09:22:57.820 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:22:57.820 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:22:57.820 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-19T09:22:57.820 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-19T09:22:57.820 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-19T09:22:57.820 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:22:57.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:22:57.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:22:57.820 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.admin", 2024-09-19T09:22:57.820 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmZaWgAhAAx7MUazt6rS+wa/ZMSGC97Q==", 2024-09-19T09:22:57.821 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:22:57.821 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-19T09:22:57.821 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:22:57.821 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:22:57.821 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:22:57.821 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:22:57.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:22:57.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:22:57.821 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.x", 2024-09-19T09:22:57.821 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmwr6NGxAA3M5NZKkjc36L25teWJS7bQ==", 2024-09-19T09:22:57.821 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:22:57.821 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-19T09:22:57.821 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-09-19T09:22:57.821 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:22:57.822 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:22:57.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:22:57.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:22:57.822 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.y", 2024-09-19T09:22:57.822 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmBWOWFxAAEYKCroBhMcqoIe6WzXnNCg==", 2024-09-19T09:22:57.822 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:22:57.822 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-19T09:22:57.822 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-09-19T09:22:57.822 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:22:57.822 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:22:57.822 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:22:57.822 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:22:57.822 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:22:57.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.809+0000 7f7a1dfc4640 1 -- 172.21.15.18:0/3442098173 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f79f806c2b0 msgr2=0x7f79f806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:57.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.809+0000 7f7a1dfc4640 1 --2- 172.21.15.18:0/3442098173 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f79f806c2b0 0x7f79f806e770 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009930 tx=0x7f7a00008040 comp rx=0 tx=0).stop 2024-09-19T09:22:57.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.809+0000 7f7a1dfc4640 1 -- 172.21.15.18:0/3442098173 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a18160a80 msgr2=0x7f7a1815b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:57.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.809+0000 7f7a1dfc4640 1 --2- 172.21.15.18:0/3442098173 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a18160a80 0x7f7a1815b990 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f7a10034040 tx=0x7f7a10004a40 comp rx=0 tx=0).stop 2024-09-19T09:22:57.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.809+0000 7f7a1dfc4640 1 -- 172.21.15.18:0/3442098173 shutdown_connections 2024-09-19T09:22:57.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.809+0000 7f7a1dfc4640 1 --2- 172.21.15.18:0/3442098173 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f79f806c2b0 0x7f79f806e770 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:57.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.809+0000 7f7a1dfc4640 1 --2- 172.21.15.18:0/3442098173 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a18160a80 0x7f7a1815b990 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:57.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.809+0000 7f7a1dfc4640 1 --2- 172.21.15.18:0/3442098173 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a18142150 0x7f7a18134e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:57.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.809+0000 7f7a1dfc4640 1 --2- 172.21.15.18:0/3442098173 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a1813fae0 0x7f7a18143130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:57.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.809+0000 7f7a1dfc4640 1 -- 172.21.15.18:0/3442098173 >> 172.21.15.18:0/3442098173 conn(0x7f7a1806bc10 msgr2=0x7f7a1815f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:57.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.809+0000 7f7a1dfc4640 1 -- 172.21.15.18:0/3442098173 shutdown_connections 2024-09-19T09:22:57.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.809+0000 7f7a1dfc4640 1 -- 172.21.15.18:0/3442098173 wait complete. 2024-09-19T09:22:57.825 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-19T09:22:57.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.925+0000 7f7a6d0ba640 1 Processor -- start 2024-09-19T09:22:57.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.925+0000 7f7a6d0ba640 1 -- start start 2024-09-19T09:22:57.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.926+0000 7f7a6d0ba640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7a680d1ab0 0x7f7a680b8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:57.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.926+0000 7f7a6d0ba640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a680b7a90 con 0x7f7a6815ef50 2024-09-19T09:22:57.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.926+0000 7f7a6d0ba640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a680d3740 con 0x7f7a680d3240 2024-09-19T09:22:57.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.926+0000 7f7a6d0ba640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f7a680d3a20 con 0x7f7a680d1ab0 2024-09-19T09:22:57.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.926+0000 7f7a66d9d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f7a6815ef50 0x7f7a680d13a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39734/0 (socket says 172.21.15.18:39734) 2024-09-19T09:22:57.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.926+0000 7f7a66d9d640 1 -- 172.21.15.18:0/4244131709 learned_addr learned my addr 172.21.15.18:0/4244131709 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:22:57.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.927+0000 7f7a65d9b640 1 -- 172.21.15.18:0/4244131709 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3067219679 0 0) 0x7f7a680b7a90 con 0x7f7a6815ef50 2024-09-19T09:22:57.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.927+0000 7f7a6659c640 1 --2- 172.21.15.18:0/4244131709 >> v2:172.21.15.162:3300/0 conn(0x7f7a680d1ab0 0x7f7a680b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:57.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.927+0000 7f7a65d9b640 1 -- 172.21.15.18:0/4244131709 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a50003520 con 0x7f7a6815ef50 2024-09-19T09:22:57.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.927+0000 7f7a65d9b640 1 -- 172.21.15.18:0/4244131709 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2541462874 0 0) 0x7f7a50003520 con 0x7f7a6815ef50 2024-09-19T09:22:57.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.927+0000 7f7a65d9b640 1 -- 172.21.15.18:0/4244131709 >> v2:172.21.15.162:3300/0 conn(0x7f7a680d1ab0 msgr2=0x7f7a680b8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:57.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.927+0000 7f7a65d9b640 1 --2- 172.21.15.18:0/4244131709 >> v2:172.21.15.162:3300/0 conn(0x7f7a680d1ab0 0x7f7a680b8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:57.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.927+0000 7f7a65d9b640 1 -- 172.21.15.18:0/4244131709 >> v1:172.21.15.162:6789/0 conn(0x7f7a680d3240 legacy=0x7f7a680b8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:57.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.927+0000 7f7a65d9b640 1 -- 172.21.15.18:0/4244131709 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a680b7d00 con 0x7f7a6815ef50 2024-09-19T09:22:57.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.927+0000 7f7a65d9b640 1 -- 172.21.15.18:0/4244131709 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f7a58001670 con 0x7f7a6815ef50 2024-09-19T09:22:57.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.927+0000 7f7a65d9b640 1 -- 172.21.15.18:0/4244131709 >> v1:172.21.15.18:6789/0 conn(0x7f7a6815ef50 legacy=0x7f7a680d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:57.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.927+0000 7f7a65d9b640 1 --2- 172.21.15.18:0/4244131709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a500039b0 0x7f7a50003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:57.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.927+0000 7f7a65d9b640 1 --2- 172.21.15.18:0/4244131709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a50004800 0x7f7a50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:57.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.927+0000 7f7a65d9b640 1 --2- 172.21.15.18:0/4244131709 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a500051c0 0x7f7a5000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:57.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.927+0000 7f7a65d9b640 1 -- 172.21.15.18:0/4244131709 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7a680d3a20 con 0x7f7a500039b0 2024-09-19T09:22:57.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.927+0000 7f7a65d9b640 1 -- 172.21.15.18:0/4244131709 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5000c160 con 0x7f7a50004800 2024-09-19T09:22:57.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.927+0000 7f7a65d9b640 1 -- 172.21.15.18:0/4244131709 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7a5000c360 con 0x7f7a500051c0 2024-09-19T09:22:57.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.927+0000 7f7a66d9d640 1 --2- 172.21.15.18:0/4244131709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a500039b0 0x7f7a50003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:57.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.927+0000 7f7a6659c640 1 --2- 172.21.15.18:0/4244131709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a50004800 0x7f7a50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:57.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.927+0000 7f7a6759e640 1 --2- 172.21.15.18:0/4244131709 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a500051c0 0x7f7a5000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:57.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.928+0000 7f7a66d9d640 1 -- 172.21.15.18:0/4244131709 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a500051c0 msgr2=0x7f7a5000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:57.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.928+0000 7f7a66d9d640 1 --2- 172.21.15.18:0/4244131709 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a500051c0 0x7f7a5000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:57.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.928+0000 7f7a66d9d640 1 -- 172.21.15.18:0/4244131709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a50004800 msgr2=0x7f7a50004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:57.933 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.928+0000 7f7a66d9d640 1 --2- 172.21.15.18:0/4244131709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a50004800 0x7f7a50004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:57.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.928+0000 7f7a66d9d640 1 -- 172.21.15.18:0/4244131709 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a50003520 con 0x7f7a500039b0 2024-09-19T09:22:57.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.928+0000 7f7a6759e640 1 -- 172.21.15.18:0/4244131709 reap_dead start 2024-09-19T09:22:57.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.928+0000 7f7a6659c640 1 --2- 172.21.15.18:0/4244131709 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a50004800 0x7f7a50004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:22:57.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.928+0000 7f7a66d9d640 1 --2- 172.21.15.18:0/4244131709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a500039b0 0x7f7a50003dd0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f7a5800c240 tx=0x7f7a50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b49dc176efa6568 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:57.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.928+0000 7f7a65d9b640 1 -- 172.21.15.18:0/4244131709 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a58007d10 con 0x7f7a500039b0 2024-09-19T09:22:57.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.928+0000 7f7a65d9b640 1 -- 172.21.15.18:0/4244131709 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a58005ad0 con 0x7f7a500039b0 2024-09-19T09:22:57.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.928+0000 7f7a65d9b640 1 -- 172.21.15.18:0/4244131709 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a58007070 con 0x7f7a500039b0 2024-09-19T09:22:57.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.929+0000 7f7a6d0ba640 1 -- 172.21.15.18:0/4244131709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a500039b0 msgr2=0x7f7a50003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:57.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.929+0000 7f7a6d0ba640 1 --2- 172.21.15.18:0/4244131709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a500039b0 0x7f7a50003dd0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f7a5800c240 tx=0x7f7a50005830 comp rx=0 tx=0).stop 2024-09-19T09:22:57.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.929+0000 7f7a6d0ba640 1 -- 172.21.15.18:0/4244131709 shutdown_connections 2024-09-19T09:22:57.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.929+0000 7f7a6d0ba640 1 --2- 172.21.15.18:0/4244131709 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a500039b0 0x7f7a50003dd0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:57.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.929+0000 7f7a6d0ba640 1 -- 172.21.15.18:0/4244131709 >> 172.21.15.18:0/4244131709 conn(0x7f7a680d4c60 msgr2=0x7f7a680d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:57.934 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.929+0000 7f7a6d0ba640 1 -- 172.21.15.18:0/4244131709 shutdown_connections 2024-09-19T09:22:57.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.929+0000 7f7a6d0ba640 1 -- 172.21.15.18:0/4244131709 wait complete. 2024-09-19T09:22:57.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.930+0000 7f7a6d0ba640 1 Processor -- start 2024-09-19T09:22:57.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.930+0000 7f7a6d0ba640 1 -- start start 2024-09-19T09:22:57.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.931+0000 7f7a6d0ba640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a500039b0 0x7f7a68152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:57.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.931+0000 7f7a6d0ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a681477f0 0x7f7a681f48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:57.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.931+0000 7f7a6d0ba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a68144bd0 0x7f7a68145050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:57.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.931+0000 7f7a6d0ba640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7a680d21a0 con 0x7f7a68144bd0 2024-09-19T09:22:57.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.931+0000 7f7a6d0ba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7a680d2020 con 0x7f7a681477f0 2024-09-19T09:22:57.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.931+0000 7f7a6d0ba640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7a680d5780 con 0x7f7a500039b0 2024-09-19T09:22:57.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.931+0000 7f7a6759e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a68144bd0 0x7f7a68145050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:57.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.931+0000 7f7a6759e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a68144bd0 0x7f7a68145050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51300/0 (socket says 172.21.15.18:51300) 2024-09-19T09:22:57.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.931+0000 7f7a6759e640 1 -- 172.21.15.18:0/1473709674 learned_addr learned my addr 172.21.15.18:0/1473709674 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:57.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.932+0000 7f7a66d9d640 1 --2- 172.21.15.18:0/1473709674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a500039b0 0x7f7a68152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:57.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.932+0000 7f7a6659c640 1 --2- 172.21.15.18:0/1473709674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a681477f0 0x7f7a681f48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:57.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.932+0000 7f7a6759e640 1 -- 172.21.15.18:0/1473709674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a500039b0 msgr2=0x7f7a68152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:57.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.932+0000 7f7a6759e640 1 --2- 172.21.15.18:0/1473709674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a500039b0 0x7f7a68152200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:57.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.932+0000 7f7a6759e640 1 -- 172.21.15.18:0/1473709674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a681477f0 msgr2=0x7f7a681f48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:57.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.932+0000 7f7a6759e640 1 --2- 172.21.15.18:0/1473709674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a681477f0 0x7f7a681f48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:57.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.932+0000 7f7a6759e640 1 -- 172.21.15.18:0/1473709674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a68151760 con 0x7f7a68144bd0 2024-09-19T09:22:57.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.932+0000 7f7a6659c640 1 --2- 172.21.15.18:0/1473709674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a681477f0 0x7f7a681f48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:22:57.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.932+0000 7f7a66d9d640 1 --2- 172.21.15.18:0/1473709674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a500039b0 0x7f7a68152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:22:57.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.932+0000 7f7a6759e640 1 --2- 172.21.15.18:0/1473709674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a68144bd0 0x7f7a68145050 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f7a60007fd0 tx=0x7f7a6000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:57.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.932+0000 7f7a4f7fe640 1 -- 172.21.15.18:0/1473709674 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a60003970 con 0x7f7a68144bd0 2024-09-19T09:22:57.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.932+0000 7f7a4f7fe640 1 -- 172.21.15.18:0/1473709674 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a60018070 con 0x7f7a68144bd0 2024-09-19T09:22:57.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.932+0000 7f7a6d0ba640 1 -- 172.21.15.18:0/1473709674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a680c82f0 con 0x7f7a68144bd0 2024-09-19T09:22:57.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.932+0000 7f7a4f7fe640 1 -- 172.21.15.18:0/1473709674 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a60003d70 con 0x7f7a68144bd0 2024-09-19T09:22:57.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.932+0000 7f7a6d0ba640 1 -- 172.21.15.18:0/1473709674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a68151a00 con 0x7f7a68144bd0 2024-09-19T09:22:57.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.933+0000 7f7a6d0ba640 1 -- 172.21.15.18:0/1473709674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a6808e610 con 0x7f7a68144bd0 2024-09-19T09:22:57.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.934+0000 7f7a4f7fe640 1 -- 172.21.15.18:0/1473709674 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7a600050d0 con 0x7f7a68144bd0 2024-09-19T09:22:57.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.934+0000 7f7a4f7fe640 1 --2- 172.21.15.18:0/1473709674 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7a5406c2b0 0x7f7a5406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:57.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.934+0000 7f7a4f7fe640 1 -- 172.21.15.18:0/1473709674 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 4857+0+0 (secure 0 0 0) 0x7f7a6008ad50 con 0x7f7a68144bd0 2024-09-19T09:22:57.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.934+0000 7f7a66d9d640 1 --2- 172.21.15.18:0/1473709674 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7a5406c2b0 0x7f7a5406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:57.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.935+0000 7f7a66d9d640 1 --2- 172.21.15.18:0/1473709674 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7a5406c2b0 0x7f7a5406e770 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7a58033000 tx=0x7f7a5802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:57.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:57.938+0000 7f7a4f7fe640 1 -- 172.21.15.18:0/1473709674 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7a6808e610 con 0x7f7a68144bd0 2024-09-19T09:22:58.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.117+0000 7f7a6d0ba640 1 -- 172.21.15.18:0/1473709674 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f7a680d13a0 con 0x7f7a68144bd0 2024-09-19T09:22:58.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.117+0000 7f7a4f7fe640 1 -- 172.21.15.18:0/1473709674 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v163) ==== 84+0+65 (secure 0 0 0) 0x7f7a6008e030 con 0x7f7a68144bd0 2024-09-19T09:22:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:22:58.119 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-09-19T09:22:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:22:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 1, 2024-09-19T09:22:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": ".mgr" 2024-09-19T09:22:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:22:58.119 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-09-19T09:22:58.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.119+0000 7f7a6d0ba640 1 -- 172.21.15.18:0/1473709674 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7a5406c2b0 msgr2=0x7f7a5406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:58.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.119+0000 7f7a6d0ba640 1 --2- 172.21.15.18:0/1473709674 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7a5406c2b0 0x7f7a5406e770 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f7a58033000 tx=0x7f7a5802e000 comp rx=0 tx=0).stop 2024-09-19T09:22:58.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.119+0000 7f7a6d0ba640 1 -- 172.21.15.18:0/1473709674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a68144bd0 msgr2=0x7f7a68145050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:58.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.119+0000 7f7a6d0ba640 1 --2- 172.21.15.18:0/1473709674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a68144bd0 0x7f7a68145050 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f7a60007fd0 tx=0x7f7a6000ec10 comp rx=0 tx=0).stop 2024-09-19T09:22:58.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.119+0000 7f7a6d0ba640 1 -- 172.21.15.18:0/1473709674 shutdown_connections 2024-09-19T09:22:58.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.119+0000 7f7a6d0ba640 1 --2- 172.21.15.18:0/1473709674 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7a5406c2b0 0x7f7a5406e770 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.119+0000 7f7a6d0ba640 1 --2- 172.21.15.18:0/1473709674 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7a68144bd0 0x7f7a68145050 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.119+0000 7f7a6d0ba640 1 --2- 172.21.15.18:0/1473709674 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a681477f0 0x7f7a681f48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.119+0000 7f7a6d0ba640 1 --2- 172.21.15.18:0/1473709674 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7a500039b0 0x7f7a68152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.119+0000 7f7a6d0ba640 1 -- 172.21.15.18:0/1473709674 >> 172.21.15.18:0/1473709674 conn(0x7f7a680d4c60 msgr2=0x7f7a680d2810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:58.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.119+0000 7f7a6d0ba640 1 -- 172.21.15.18:0/1473709674 shutdown_connections 2024-09-19T09:22:58.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.119+0000 7f7a6d0ba640 1 -- 172.21.15.18:0/1473709674 wait complete. 2024-09-19T09:22:58.131 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T09:22:58.131 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T09:22:58.237 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.236+0000 7f8946511640 1 Processor -- start 2024-09-19T09:22:58.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.236+0000 7f8946511640 1 -- start start 2024-09-19T09:22:58.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.237+0000 7f8946511640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f894006ea40 0x7f894015eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:58.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.237+0000 7f8946511640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f894015dfc0 con 0x7f894006e5e0 2024-09-19T09:22:58.240 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.237+0000 7f8946511640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f894015d3b0 con 0x7f89400ce460 2024-09-19T09:22:58.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.237+0000 7f8946511640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f894015d690 con 0x7f894006ea40 2024-09-19T09:22:58.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.237+0000 7f893f7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f894006e5e0 0x7f894015e470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39744/0 (socket says 172.21.15.18:39744) 2024-09-19T09:22:58.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.237+0000 7f893f7fe640 1 -- 172.21.15.18:0/994472902 learned_addr learned my addr 172.21.15.18:0/994472902 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:22:58.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.237+0000 7f8944aae640 1 --2- 172.21.15.18:0/994472902 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f894006ea40 0x7f894015eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:58.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.237+0000 7f893effd640 1 -- 172.21.15.18:0/994472902 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1363479698 0 0) 0x7f894015dfc0 con 0x7f894006e5e0 2024-09-19T09:22:58.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.237+0000 7f893effd640 1 -- 172.21.15.18:0/994472902 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8928003520 con 0x7f894006e5e0 2024-09-19T09:22:58.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.237+0000 7f893effd640 1 -- 172.21.15.18:0/994472902 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2008542328 0 0) 0x7f8928003520 con 0x7f894006e5e0 2024-09-19T09:22:58.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.237+0000 7f893effd640 1 -- 172.21.15.18:0/994472902 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f894006ea40 msgr2=0x7f894015eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:58.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.237+0000 7f893effd640 1 --2- 172.21.15.18:0/994472902 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f894006ea40 0x7f894015eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.237+0000 7f893effd640 1 -- 172.21.15.18:0/994472902 >> v1:172.21.15.162:6789/0 conn(0x7f89400ce460 legacy=0x7f89400cfee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:58.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.237+0000 7f893effd640 1 -- 172.21.15.18:0/994472902 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f894015d970 con 0x7f894006e5e0 2024-09-19T09:22:58.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.237+0000 7f893effd640 1 -- 172.21.15.18:0/994472902 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f8934001670 con 0x7f894006e5e0 2024-09-19T09:22:58.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.237+0000 7f893effd640 1 -- 172.21.15.18:0/994472902 >> v1:172.21.15.18:6789/0 conn(0x7f894006e5e0 legacy=0x7f894015e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:58.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.237+0000 7f893effd640 1 --2- 172.21.15.18:0/994472902 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f894006ea40 0x7f89280039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:58.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.237+0000 7f893effd640 1 --2- 172.21.15.18:0/994472902 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8928003f20 0x7f8928004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:58.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.237+0000 7f893effd640 1 --2- 172.21.15.18:0/994472902 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8928004d40 0x7f89280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:58.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.237+0000 7f893effd640 1 -- 172.21.15.18:0/994472902 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f894015d690 con 0x7f8928004d40 2024-09-19T09:22:58.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.237+0000 7f893effd640 1 -- 172.21.15.18:0/994472902 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f892800ba20 con 0x7f8928003f20 2024-09-19T09:22:58.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.237+0000 7f893effd640 1 -- 172.21.15.18:0/994472902 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f892800bc20 con 0x7f894006ea40 2024-09-19T09:22:58.242 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.238+0000 7f8944aae640 1 --2- 172.21.15.18:0/994472902 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8928004d40 0x7f89280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:58.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.238+0000 7f893f7fe640 1 --2- 172.21.15.18:0/994472902 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8928003f20 0x7f8928004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:58.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.238+0000 7f893ffff640 1 --2- 172.21.15.18:0/994472902 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f894006ea40 0x7f89280039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:58.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.238+0000 7f8944aae640 1 -- 172.21.15.18:0/994472902 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f894006ea40 msgr2=0x7f89280039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:58.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.238+0000 7f8944aae640 1 --2- 172.21.15.18:0/994472902 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f894006ea40 0x7f89280039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.238+0000 7f8944aae640 1 -- 172.21.15.18:0/994472902 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8928003f20 msgr2=0x7f8928004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:22:58.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.238+0000 7f8944aae640 1 --2- 172.21.15.18:0/994472902 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8928003f20 0x7f8928004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.238+0000 7f8944aae640 1 -- 172.21.15.18:0/994472902 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8928003520 con 0x7f8928004d40 2024-09-19T09:22:58.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.239+0000 7f8944aae640 1 --2- 172.21.15.18:0/994472902 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8928004d40 0x7f89280051c0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f8938009fc0 tx=0x7f8928005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6609148d2425c8aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:58.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.239+0000 7f893effd640 1 -- 172.21.15.18:0/994472902 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8938009c10 con 0x7f8928004d40 2024-09-19T09:22:58.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.239+0000 7f893effd640 1 -- 172.21.15.18:0/994472902 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8938036070 con 0x7f8928004d40 2024-09-19T09:22:58.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.239+0000 7f893effd640 1 -- 172.21.15.18:0/994472902 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8938031880 con 0x7f8928004d40 2024-09-19T09:22:58.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.239+0000 7f8946511640 1 -- 172.21.15.18:0/994472902 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8928004d40 msgr2=0x7f89280051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:58.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.239+0000 7f8946511640 1 --2- 172.21.15.18:0/994472902 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8928004d40 0x7f89280051c0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f8938009fc0 tx=0x7f8928005830 comp rx=0 tx=0).stop 2024-09-19T09:22:58.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.239+0000 7f8944aae640 1 -- 172.21.15.18:0/994472902 reap_dead start 2024-09-19T09:22:58.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.239+0000 7f8946511640 1 -- 172.21.15.18:0/994472902 shutdown_connections 2024-09-19T09:22:58.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.239+0000 7f8946511640 1 -- 172.21.15.18:0/994472902 >> 172.21.15.18:0/994472902 conn(0x7f89400b26a0 msgr2=0x7f89400b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:58.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.239+0000 7f8946511640 1 -- 172.21.15.18:0/994472902 shutdown_connections 2024-09-19T09:22:58.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.239+0000 7f8946511640 1 -- 172.21.15.18:0/994472902 wait complete. 2024-09-19T09:22:58.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.240+0000 7f8946511640 1 Processor -- start 2024-09-19T09:22:58.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.241+0000 7f8946511640 1 -- start start 2024-09-19T09:22:58.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.241+0000 7f8946511640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8928004d40 0x7f89400b1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:58.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.241+0000 7f8946511640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89401f16c0 0x7f89401f1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:58.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.241+0000 7f8946511640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f894013ada0 0x7f894013b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:58.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.241+0000 7f8946511640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f89400ce840 con 0x7f8928004d40 2024-09-19T09:22:58.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.241+0000 7f8946511640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f894006eed0 con 0x7f89401f16c0 2024-09-19T09:22:58.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.241+0000 7f8946511640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f89400d05f0 con 0x7f894013ada0 2024-09-19T09:22:58.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.242+0000 7f893ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8928004d40 0x7f89400b1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:58.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.242+0000 7f893ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8928004d40 0x7f89400b1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51312/0 (socket says 172.21.15.18:51312) 2024-09-19T09:22:58.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.242+0000 7f893ffff640 1 -- 172.21.15.18:0/1319131398 learned_addr learned my addr 172.21.15.18:0/1319131398 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:58.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.242+0000 7f893f7fe640 1 --2- 172.21.15.18:0/1319131398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89401f16c0 0x7f89401f1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:58.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.242+0000 7f8944aae640 1 --2- 172.21.15.18:0/1319131398 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f894013ada0 0x7f894013b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:58.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.242+0000 7f893ffff640 1 -- 172.21.15.18:0/1319131398 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f894013ada0 msgr2=0x7f894013b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:58.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.242+0000 7f893ffff640 1 --2- 172.21.15.18:0/1319131398 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f894013ada0 0x7f894013b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.242+0000 7f893ffff640 1 -- 172.21.15.18:0/1319131398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89401f16c0 msgr2=0x7f89401f1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:58.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.242+0000 7f893ffff640 1 --2- 172.21.15.18:0/1319131398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89401f16c0 0x7f89401f1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:58.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.242+0000 7f893ffff640 1 -- 172.21.15.18:0/1319131398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89401f2080 con 0x7f8928004d40 2024-09-19T09:22:58.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.242+0000 7f893ffff640 1 --2- 172.21.15.18:0/1319131398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8928004d40 0x7f89400b1a00 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f893000f7c0 tx=0x7f893000fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:58.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.242+0000 7f893cff9640 1 -- 172.21.15.18:0/1319131398 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89300052e0 con 0x7f8928004d40 2024-09-19T09:22:58.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.242+0000 7f893cff9640 1 -- 172.21.15.18:0/1319131398 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8930018070 con 0x7f8928004d40 2024-09-19T09:22:58.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.242+0000 7f893cff9640 1 -- 172.21.15.18:0/1319131398 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f893000d970 con 0x7f8928004d40 2024-09-19T09:22:58.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.242+0000 7f8946511640 1 -- 172.21.15.18:0/1319131398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f894013bb10 con 0x7f8928004d40 2024-09-19T09:22:58.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.242+0000 7f8946511640 1 -- 172.21.15.18:0/1319131398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8940138f10 con 0x7f8928004d40 2024-09-19T09:22:58.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.243+0000 7f8946511640 1 -- 172.21.15.18:0/1319131398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f894015cfd0 con 0x7f8928004d40 2024-09-19T09:22:58.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.244+0000 7f893cff9640 1 -- 172.21.15.18:0/1319131398 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f893000db10 con 0x7f8928004d40 2024-09-19T09:22:58.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.244+0000 7f893cff9640 1 --2- 172.21.15.18:0/1319131398 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f892c06c2b0 0x7f892c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:58.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.244+0000 7f893cff9640 1 -- 172.21.15.18:0/1319131398 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 4857+0+0 (secure 0 0 0) 0x7f893008afd0 con 0x7f8928004d40 2024-09-19T09:22:58.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.244+0000 7f893f7fe640 1 --2- 172.21.15.18:0/1319131398 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f892c06c2b0 0x7f892c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:58.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.245+0000 7f893f7fe640 1 --2- 172.21.15.18:0/1319131398 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f892c06c2b0 0x7f892c06e770 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8934001050 tx=0x7f8934000f80 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:58.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.248+0000 7f893cff9640 1 -- 172.21.15.18:0/1319131398 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8930059a90 con 0x7f8928004d40 2024-09-19T09:22:58.425 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:58.423+0000 7f8946511640 1 -- 172.21.15.18:0/1319131398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f89400cffe0 con 0x7f8928004d40 2024-09-19T09:22:59.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.430+0000 7f893cff9640 1 -- 172.21.15.18:0/1319131398 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v164) ==== 138+0+0 (secure 0 0 0) 0x7f8930059390 con 0x7f8928004d40 2024-09-19T09:22:59.432 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' created 2024-09-19T09:22:59.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.435+0000 7f8946511640 1 -- 172.21.15.18:0/1319131398 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f892c06c2b0 msgr2=0x7f892c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:59.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.435+0000 7f8946511640 1 --2- 172.21.15.18:0/1319131398 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f892c06c2b0 0x7f892c06e770 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f8934001050 tx=0x7f8934000f80 comp rx=0 tx=0).stop 2024-09-19T09:22:59.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.435+0000 7f8946511640 1 -- 172.21.15.18:0/1319131398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8928004d40 msgr2=0x7f89400b1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:59.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.435+0000 7f8946511640 1 --2- 172.21.15.18:0/1319131398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8928004d40 0x7f89400b1a00 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f893000f7c0 tx=0x7f893000fc80 comp rx=0 tx=0).stop 2024-09-19T09:22:59.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.435+0000 7f8946511640 1 -- 172.21.15.18:0/1319131398 shutdown_connections 2024-09-19T09:22:59.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.435+0000 7f8946511640 1 --2- 172.21.15.18:0/1319131398 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f892c06c2b0 0x7f892c06e770 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:59.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.435+0000 7f8946511640 1 --2- 172.21.15.18:0/1319131398 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f894013ada0 0x7f894013b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:59.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.435+0000 7f8946511640 1 --2- 172.21.15.18:0/1319131398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89401f16c0 0x7f89401f1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:59.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.435+0000 7f8946511640 1 --2- 172.21.15.18:0/1319131398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8928004d40 0x7f89400b1a00 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:59.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.435+0000 7f8946511640 1 -- 172.21.15.18:0/1319131398 >> 172.21.15.18:0/1319131398 conn(0x7f89400b26a0 msgr2=0x7f8940071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:59.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.435+0000 7f8946511640 1 -- 172.21.15.18:0/1319131398 shutdown_connections 2024-09-19T09:22:59.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.435+0000 7f8946511640 1 -- 172.21.15.18:0/1319131398 wait complete. 2024-09-19T09:22:59.451 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T09:22:59.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.565+0000 7fc086326640 1 Processor -- start 2024-09-19T09:22:59.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.565+0000 7fc086326640 1 -- start start 2024-09-19T09:22:59.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.566+0000 7fc086326640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc08006e280 0x7fc080073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:59.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.566+0000 7fc086326640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0800722d0 con 0x7fc0800d1010 2024-09-19T09:22:59.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.566+0000 7fc086326640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0800725b0 con 0x7fc080071df0 2024-09-19T09:22:59.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.566+0000 7fc086326640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc0800738b0 con 0x7fc08006e280 2024-09-19T09:22:59.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.566+0000 7fc0848c3640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc0800d1010 0x7fc0800ce3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39760/0 (socket says 172.21.15.18:39760) 2024-09-19T09:22:59.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.566+0000 7fc0848c3640 1 -- 172.21.15.18:0/232691699 learned_addr learned my addr 172.21.15.18:0/232691699 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:22:59.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.566+0000 7fc07ffff640 1 --2- 172.21.15.18:0/232691699 >> v2:172.21.15.162:3300/0 conn(0x7fc08006e280 0x7fc080073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:59.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.566+0000 7fc07effd640 1 -- 172.21.15.18:0/232691699 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 225220227 0 0) 0x7fc0800722d0 con 0x7fc0800d1010 2024-09-19T09:22:59.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.566+0000 7fc07effd640 1 -- 172.21.15.18:0/232691699 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc068003520 con 0x7fc0800d1010 2024-09-19T09:22:59.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.566+0000 7fc07effd640 1 -- 172.21.15.18:0/232691699 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2928770384 0 0) 0x7fc0800725b0 con 0x7fc080071df0 2024-09-19T09:22:59.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.566+0000 7fc07effd640 1 -- 172.21.15.18:0/232691699 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0800722d0 con 0x7fc080071df0 2024-09-19T09:22:59.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.566+0000 7fc07ffff640 1 -- 172.21.15.18:0/232691699 >> v1:172.21.15.162:6789/0 conn(0x7fc080071df0 legacy=0x7fc08006e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:59.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.566+0000 7fc07effd640 1 -- 172.21.15.18:0/232691699 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1647070921 0 0) 0x7fc068003520 con 0x7fc0800d1010 2024-09-19T09:22:59.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.566+0000 7fc07ffff640 1 -- 172.21.15.18:0/232691699 >> v1:172.21.15.18:6789/0 conn(0x7fc0800d1010 legacy=0x7fc0800ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:59.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.566+0000 7fc07ffff640 1 -- 172.21.15.18:0/232691699 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc080072890 con 0x7fc08006e280 2024-09-19T09:22:59.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.567+0000 7fc07ffff640 1 --2- 172.21.15.18:0/232691699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc08006e280 0x7fc080073370 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc0700097a0 tx=0x7fc07002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f05448121941d3db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:59.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.567+0000 7fc07effd640 1 -- 172.21.15.18:0/232691699 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc070037070 con 0x7fc08006e280 2024-09-19T09:22:59.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.567+0000 7fc07effd640 1 -- 172.21.15.18:0/232691699 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc07002ac50 con 0x7fc08006e280 2024-09-19T09:22:59.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.567+0000 7fc07effd640 1 -- 172.21.15.18:0/232691699 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0780019f0 con 0x7fc08006e280 2024-09-19T09:22:59.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.568+0000 7fc086326640 1 -- 172.21.15.18:0/232691699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc08006e280 msgr2=0x7fc080073370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:59.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.568+0000 7fc086326640 1 --2- 172.21.15.18:0/232691699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc08006e280 0x7fc080073370 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc0700097a0 tx=0x7fc07002a1c0 comp rx=0 tx=0).stop 2024-09-19T09:22:59.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.568+0000 7fc086326640 1 -- 172.21.15.18:0/232691699 shutdown_connections 2024-09-19T09:22:59.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.568+0000 7fc086326640 1 --2- 172.21.15.18:0/232691699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc08006e280 0x7fc080073370 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:59.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.568+0000 7fc086326640 1 -- 172.21.15.18:0/232691699 >> 172.21.15.18:0/232691699 conn(0x7fc08006bc10 msgr2=0x7fc08006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:22:59.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.568+0000 7fc086326640 1 -- 172.21.15.18:0/232691699 shutdown_connections 2024-09-19T09:22:59.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.568+0000 7fc086326640 1 -- 172.21.15.18:0/232691699 wait complete. 2024-09-19T09:22:59.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.569+0000 7fc086326640 1 Processor -- start 2024-09-19T09:22:59.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.569+0000 7fc086326640 1 -- start start 2024-09-19T09:22:59.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.570+0000 7fc086326640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc08006e280 0x7fc080153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:59.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.570+0000 7fc086326640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc080071df0 0x7fc0800ce360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:59.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.570+0000 7fc086326640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0800d1010 0x7fc0800ce8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:59.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.570+0000 7fc086326640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc08015db60 con 0x7fc08006e280 2024-09-19T09:22:59.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.570+0000 7fc086326640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc080072e50 con 0x7fc0800d1010 2024-09-19T09:22:59.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.570+0000 7fc086326640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc0800d14c0 con 0x7fc080071df0 2024-09-19T09:22:59.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.570+0000 7fc07ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc08006e280 0x7fc080153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:59.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.570+0000 7fc07ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc08006e280 0x7fc080153ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51316/0 (socket says 172.21.15.18:51316) 2024-09-19T09:22:59.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.570+0000 7fc07ffff640 1 -- 172.21.15.18:0/2388445891 learned_addr learned my addr 172.21.15.18:0/2388445891 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:22:59.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.570+0000 7fc0848c3640 1 --2- 172.21.15.18:0/2388445891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0800d1010 0x7fc0800ce8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:59.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.570+0000 7fc07f7fe640 1 --2- 172.21.15.18:0/2388445891 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc080071df0 0x7fc0800ce360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:59.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.571+0000 7fc07ffff640 1 -- 172.21.15.18:0/2388445891 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc080071df0 msgr2=0x7fc0800ce360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:59.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.571+0000 7fc07ffff640 1 --2- 172.21.15.18:0/2388445891 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc080071df0 0x7fc0800ce360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:59.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.571+0000 7fc07ffff640 1 -- 172.21.15.18:0/2388445891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0800d1010 msgr2=0x7fc0800ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:22:59.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.571+0000 7fc07ffff640 1 --2- 172.21.15.18:0/2388445891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0800d1010 0x7fc0800ce8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:22:59.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.571+0000 7fc07ffff640 1 -- 172.21.15.18:0/2388445891 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0800af3c0 con 0x7fc08006e280 2024-09-19T09:22:59.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.571+0000 7fc07f7fe640 1 --2- 172.21.15.18:0/2388445891 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc080071df0 0x7fc0800ce360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:22:59.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.571+0000 7fc07ffff640 1 --2- 172.21.15.18:0/2388445891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc08006e280 0x7fc080153ce0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fc0700097a0 tx=0x7fc0700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:59.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.571+0000 7fc07cff9640 1 -- 172.21.15.18:0/2388445891 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc070037040 con 0x7fc08006e280 2024-09-19T09:22:59.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.571+0000 7fc07cff9640 1 -- 172.21.15.18:0/2388445891 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc070004030 con 0x7fc08006e280 2024-09-19T09:22:59.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.571+0000 7fc07cff9640 1 -- 172.21.15.18:0/2388445891 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc070006e10 con 0x7fc08006e280 2024-09-19T09:22:59.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.571+0000 7fc086326640 1 -- 172.21.15.18:0/2388445891 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0800af6a0 con 0x7fc08006e280 2024-09-19T09:22:59.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.571+0000 7fc086326640 1 -- 172.21.15.18:0/2388445891 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0801549f0 con 0x7fc08006e280 2024-09-19T09:22:59.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.572+0000 7fc086326640 1 -- 172.21.15.18:0/2388445891 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc080073370 con 0x7fc08006e280 2024-09-19T09:22:59.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.573+0000 7fc07cff9640 1 -- 172.21.15.18:0/2388445891 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc070003610 con 0x7fc08006e280 2024-09-19T09:22:59.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.573+0000 7fc07cff9640 1 --2- 172.21.15.18:0/2388445891 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc06c06c2b0 0x7fc06c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:22:59.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.573+0000 7fc07cff9640 1 -- 172.21.15.18:0/2388445891 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(164..164 src has 1..164) ==== 5227+0+0 (secure 0 0 0) 0x7fc0700abe00 con 0x7fc08006e280 2024-09-19T09:22:59.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.573+0000 7fc07f7fe640 1 --2- 172.21.15.18:0/2388445891 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc06c06c2b0 0x7fc06c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:22:59.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.574+0000 7fc07f7fe640 1 --2- 172.21.15.18:0/2388445891 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc06c06c2b0 0x7fc06c06e770 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc0800aebc0 tx=0x7fc074009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:22:59.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.578+0000 7fc07cff9640 1 -- 172.21.15.18:0/2388445891 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fc07007a900 con 0x7fc08006e280 2024-09-19T09:22:59.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:22:59.753+0000 7fc086326640 1 -- 172.21.15.18:0/2388445891 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc0800cda50 con 0x7fc08006e280 2024-09-19T09:23:00.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.435+0000 7fc07cff9640 1 -- 172.21.15.18:0/2388445891 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v165) ==== 170+0+0 (secure 0 0 0) 0x7fc07007a200 con 0x7fc08006e280 2024-09-19T09:23:00.437 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' created 2024-09-19T09:23:00.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.437+0000 7fc086326640 1 -- 172.21.15.18:0/2388445891 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc06c06c2b0 msgr2=0x7fc06c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:00.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.437+0000 7fc086326640 1 --2- 172.21.15.18:0/2388445891 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc06c06c2b0 0x7fc06c06e770 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc0800aebc0 tx=0x7fc074009040 comp rx=0 tx=0).stop 2024-09-19T09:23:00.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.437+0000 7fc086326640 1 -- 172.21.15.18:0/2388445891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc08006e280 msgr2=0x7fc080153ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:00.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.437+0000 7fc086326640 1 --2- 172.21.15.18:0/2388445891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc08006e280 0x7fc080153ce0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fc0700097a0 tx=0x7fc0700046c0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.437+0000 7fc086326640 1 -- 172.21.15.18:0/2388445891 shutdown_connections 2024-09-19T09:23:00.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.437+0000 7fc086326640 1 --2- 172.21.15.18:0/2388445891 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc06c06c2b0 0x7fc06c06e770 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.437+0000 7fc086326640 1 --2- 172.21.15.18:0/2388445891 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc0800d1010 0x7fc0800ce8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.437+0000 7fc086326640 1 --2- 172.21.15.18:0/2388445891 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc080071df0 0x7fc0800ce360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.437+0000 7fc086326640 1 --2- 172.21.15.18:0/2388445891 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc08006e280 0x7fc080153ce0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.437+0000 7fc086326640 1 -- 172.21.15.18:0/2388445891 >> 172.21.15.18:0/2388445891 conn(0x7fc08006bc10 msgr2=0x7fc0800b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:00.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.438+0000 7fc086326640 1 -- 172.21.15.18:0/2388445891 shutdown_connections 2024-09-19T09:23:00.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.438+0000 7fc086326640 1 -- 172.21.15.18:0/2388445891 wait complete. 2024-09-19T09:23:00.458 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T09:23:00.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.566+0000 7f03ec047640 1 Processor -- start 2024-09-19T09:23:00.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.566+0000 7f03ec047640 1 -- start start 2024-09-19T09:23:00.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.567+0000 7f03ec047640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f03e40af8d0 0x7f03e40afd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:00.569 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.567+0000 7f03ec047640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f03e40b73b0 0x7f03e40b7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:00.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.567+0000 7f03ec047640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03e415fef0 con 0x7f03e406f7e0 2024-09-19T09:23:00.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.567+0000 7f03ec047640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f03e40b6f20 con 0x7f03e40af8d0 2024-09-19T09:23:00.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.567+0000 7f03ec047640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f03e40b68d0 con 0x7f03e40b73b0 2024-09-19T09:23:00.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.567+0000 7f03e95e2640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f03e40af8d0 0x7f03e40afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:00.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.567+0000 7f03e9de3640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f03e406f7e0 0x7f03e406fbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39770/0 (socket says 172.21.15.18:39770) 2024-09-19T09:23:00.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.567+0000 7f03e9de3640 1 -- 172.21.15.18:0/2566029294 learned_addr learned my addr 172.21.15.18:0/2566029294 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:23:00.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.568+0000 7f03ea5e4640 1 --2- 172.21.15.18:0/2566029294 >> v2:172.21.15.162:3300/0 conn(0x7f03e40b73b0 0x7f03e40b7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:00.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.568+0000 7f03e95e2640 1 -- 172.21.15.18:0/2566029294 >> v2:172.21.15.162:3300/0 conn(0x7f03e40b73b0 msgr2=0x7f03e40b7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:00.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.568+0000 7f03e95e2640 1 --2- 172.21.15.18:0/2566029294 >> v2:172.21.15.162:3300/0 conn(0x7f03e40b73b0 0x7f03e40b7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.568+0000 7f03e95e2640 1 -- 172.21.15.18:0/2566029294 >> v1:172.21.15.18:6789/0 conn(0x7f03e406f7e0 legacy=0x7f03e406fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:00.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.568+0000 7f03e8de1640 1 -- 172.21.15.18:0/2566029294 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3089497536 0 0) 0x7f03e415fef0 con 0x7f03e406f7e0 2024-09-19T09:23:00.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.568+0000 7f03e95e2640 1 -- 172.21.15.18:0/2566029294 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03e40b6bb0 con 0x7f03e40af8d0 2024-09-19T09:23:00.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.568+0000 7f03e95e2640 1 --2- 172.21.15.18:0/2566029294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03e40af8d0 0x7f03e40afd30 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f03e415ccb0 tx=0x7f03d402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e9705077f512c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:00.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.569+0000 7f03e8de1640 1 -- 172.21.15.18:0/2566029294 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d4037070 con 0x7f03e40af8d0 2024-09-19T09:23:00.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.569+0000 7f03e8de1640 1 -- 172.21.15.18:0/2566029294 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03d4032440 con 0x7f03e40af8d0 2024-09-19T09:23:00.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.569+0000 7f03e8de1640 1 -- 172.21.15.18:0/2566029294 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03d4032810 con 0x7f03e40af8d0 2024-09-19T09:23:00.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.569+0000 7f03ec047640 1 -- 172.21.15.18:0/2566029294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03e40af8d0 msgr2=0x7f03e40afd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:00.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.569+0000 7f03ec047640 1 --2- 172.21.15.18:0/2566029294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03e40af8d0 0x7f03e40afd30 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f03e415ccb0 tx=0x7f03d402a1a0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.569+0000 7f03ec047640 1 -- 172.21.15.18:0/2566029294 shutdown_connections 2024-09-19T09:23:00.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.569+0000 7f03ec047640 1 --2- 172.21.15.18:0/2566029294 >> v2:172.21.15.162:3300/0 conn(0x7f03e40b73b0 0x7f03e40b7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.569+0000 7f03ec047640 1 --2- 172.21.15.18:0/2566029294 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03e40af8d0 0x7f03e40afd30 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.569+0000 7f03ec047640 1 -- 172.21.15.18:0/2566029294 >> 172.21.15.18:0/2566029294 conn(0x7f03e4073c80 msgr2=0x7f03e409b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:00.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.569+0000 7f03ec047640 1 -- 172.21.15.18:0/2566029294 shutdown_connections 2024-09-19T09:23:00.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.569+0000 7f03ec047640 1 -- 172.21.15.18:0/2566029294 wait complete. 2024-09-19T09:23:00.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.571+0000 7f03ec047640 1 Processor -- start 2024-09-19T09:23:00.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.571+0000 7f03ec047640 1 -- start start 2024-09-19T09:23:00.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.571+0000 7f03ec047640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03e406f7e0 0x7f03e40b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:00.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.571+0000 7f03ec047640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03e40af8d0 0x7f03e40ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:00.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.571+0000 7f03ec047640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03e40b73b0 0x7f03e414f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:00.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.571+0000 7f03ec047640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f03e4159620 con 0x7f03e40b73b0 2024-09-19T09:23:00.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.571+0000 7f03ec047640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f03e41594a0 con 0x7f03e40af8d0 2024-09-19T09:23:00.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.571+0000 7f03ec047640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f03e415f170 con 0x7f03e406f7e0 2024-09-19T09:23:00.575 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.571+0000 7f03ea5e4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03e40b73b0 0x7f03e414f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:00.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.571+0000 7f03ea5e4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03e40b73b0 0x7f03e414f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51342/0 (socket says 172.21.15.18:51342) 2024-09-19T09:23:00.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.571+0000 7f03ea5e4640 1 -- 172.21.15.18:0/307315872 learned_addr learned my addr 172.21.15.18:0/307315872 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:23:00.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.572+0000 7f03e95e2640 1 --2- 172.21.15.18:0/307315872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03e40af8d0 0x7f03e40ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:00.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.572+0000 7f03e9de3640 1 --2- 172.21.15.18:0/307315872 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03e406f7e0 0x7f03e40b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:00.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.572+0000 7f03ea5e4640 1 -- 172.21.15.18:0/307315872 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03e406f7e0 msgr2=0x7f03e40b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:00.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.572+0000 7f03ea5e4640 1 --2- 172.21.15.18:0/307315872 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03e406f7e0 0x7f03e40b4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.572+0000 7f03ea5e4640 1 -- 172.21.15.18:0/307315872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03e40af8d0 msgr2=0x7f03e40ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:00.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.572+0000 7f03ea5e4640 1 --2- 172.21.15.18:0/307315872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03e40af8d0 0x7f03e40ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:00.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.572+0000 7f03ea5e4640 1 -- 172.21.15.18:0/307315872 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03e414f7d0 con 0x7f03e40b73b0 2024-09-19T09:23:00.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.572+0000 7f03e95e2640 1 --2- 172.21.15.18:0/307315872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03e40af8d0 0x7f03e40ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:00.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.572+0000 7f03e9de3640 1 --2- 172.21.15.18:0/307315872 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03e406f7e0 0x7f03e40b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:00.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.572+0000 7f03ea5e4640 1 --2- 172.21.15.18:0/307315872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03e40b73b0 0x7f03e414f290 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f03dc00efc0 tx=0x7f03dc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:00.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.572+0000 7f03da7fc640 1 -- 172.21.15.18:0/307315872 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03dc018020 con 0x7f03e40b73b0 2024-09-19T09:23:00.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.572+0000 7f03da7fc640 1 -- 172.21.15.18:0/307315872 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03dc014480 con 0x7f03e40b73b0 2024-09-19T09:23:00.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.572+0000 7f03ec047640 1 -- 172.21.15.18:0/307315872 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03e40cd710 con 0x7f03e40b73b0 2024-09-19T09:23:00.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.572+0000 7f03da7fc640 1 -- 172.21.15.18:0/307315872 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03dc014870 con 0x7f03e40b73b0 2024-09-19T09:23:00.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.572+0000 7f03ec047640 1 -- 172.21.15.18:0/307315872 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03e40cdcd0 con 0x7f03e40b73b0 2024-09-19T09:23:00.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.573+0000 7f03ec047640 1 -- 172.21.15.18:0/307315872 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03e40afd30 con 0x7f03e40b73b0 2024-09-19T09:23:00.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.574+0000 7f03da7fc640 1 -- 172.21.15.18:0/307315872 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f03dc005d10 con 0x7f03e40b73b0 2024-09-19T09:23:00.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.574+0000 7f03da7fc640 1 --2- 172.21.15.18:0/307315872 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f03c806c2b0 0x7f03c806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:00.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.574+0000 7f03da7fc640 1 -- 172.21.15.18:0/307315872 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5609+0+0 (secure 0 0 0) 0x7f03dc08be90 con 0x7f03e40b73b0 2024-09-19T09:23:00.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.575+0000 7f03e9de3640 1 --2- 172.21.15.18:0/307315872 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f03c806c2b0 0x7f03c806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:00.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.575+0000 7f03e9de3640 1 --2- 172.21.15.18:0/307315872 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f03c806c2b0 0x7f03c806e770 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f03e0000f60 tx=0x7f03e0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:00.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.579+0000 7f03da7fc640 1 -- 172.21.15.18:0/307315872 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f03dc022070 con 0x7f03e40b73b0 2024-09-19T09:23:00.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:00.794+0000 7f03ec047640 1 -- 172.21.15.18:0/307315872 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f03e40b7e60 con 0x7f03e40b73b0 2024-09-19T09:23:01.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.437+0000 7f03da7fc640 1 -- 172.21.15.18:0/307315872 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v70) ==== 174+0+0 (secure 0 0 0) 0x7f03dc010040 con 0x7f03e40b73b0 2024-09-19T09:23:01.439 INFO:teuthology.orchestra.run.smithi018.stderr:new fs with metadata pool 20 and data pool 21 2024-09-19T09:23:01.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.443+0000 7f03ec047640 1 -- 172.21.15.18:0/307315872 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f03c806c2b0 msgr2=0x7f03c806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:01.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.443+0000 7f03ec047640 1 --2- 172.21.15.18:0/307315872 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f03c806c2b0 0x7f03c806e770 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f03e0000f60 tx=0x7f03e0009040 comp rx=0 tx=0).stop 2024-09-19T09:23:01.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.443+0000 7f03ec047640 1 -- 172.21.15.18:0/307315872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03e40b73b0 msgr2=0x7f03e414f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:01.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.443+0000 7f03ec047640 1 --2- 172.21.15.18:0/307315872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03e40b73b0 0x7f03e414f290 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f03dc00efc0 tx=0x7f03dc00c490 comp rx=0 tx=0).stop 2024-09-19T09:23:01.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.446+0000 7f03ec047640 1 -- 172.21.15.18:0/307315872 shutdown_connections 2024-09-19T09:23:01.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.446+0000 7f03ec047640 1 --2- 172.21.15.18:0/307315872 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f03c806c2b0 0x7f03c806e770 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.446+0000 7f03ec047640 1 --2- 172.21.15.18:0/307315872 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f03e40b73b0 0x7f03e414f290 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.446+0000 7f03ec047640 1 --2- 172.21.15.18:0/307315872 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f03e40af8d0 0x7f03e40ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.446+0000 7f03ec047640 1 --2- 172.21.15.18:0/307315872 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f03e406f7e0 0x7f03e40b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.447+0000 7f03ec047640 1 -- 172.21.15.18:0/307315872 >> 172.21.15.18:0/307315872 conn(0x7f03e4073c80 msgr2=0x7f03e406dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:01.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.450+0000 7f03ec047640 1 -- 172.21.15.18:0/307315872 shutdown_connections 2024-09-19T09:23:01.456 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.454+0000 7f03ec047640 1 -- 172.21.15.18:0/307315872 wait complete. 2024-09-19T09:23:01.475 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:23:01.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.581+0000 7f8bbf480640 1 Processor -- start 2024-09-19T09:23:01.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.581+0000 7f8bbf480640 1 -- start start 2024-09-19T09:23:01.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.582+0000 7f8bbf480640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8bb80cfae0 0x7f8bb80b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:01.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.582+0000 7f8bbf480640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8bb806d730 0x7f8bb80cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:01.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.582+0000 7f8bbf480640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bb80cd1a0 con 0x7f8bb815ef80 2024-09-19T09:23:01.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.582+0000 7f8bbf480640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f8bb80cd7d0 con 0x7f8bb80cfae0 2024-09-19T09:23:01.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.582+0000 7f8bbf480640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8bb806dc30 con 0x7f8bb806d730 2024-09-19T09:23:01.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.582+0000 7f8bbd21c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f8bb815ef80 0x7f8bb80cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39786/0 (socket says 172.21.15.18:39786) 2024-09-19T09:23:01.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.582+0000 7f8bbd21c640 1 -- 172.21.15.18:0/1996818772 learned_addr learned my addr 172.21.15.18:0/1996818772 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:23:01.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.582+0000 7f8bbca1b640 1 --2- 172.21.15.18:0/1996818772 >> v2:172.21.15.18:3300/0 conn(0x7f8bb80cfae0 0x7f8bb80b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:01.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.582+0000 7f8baffff640 1 -- 172.21.15.18:0/1996818772 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2821592909 0 0) 0x7f8bb80cd1a0 con 0x7f8bb815ef80 2024-09-19T09:23:01.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.583+0000 7f8baffff640 1 -- 172.21.15.18:0/1996818772 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ba4003520 con 0x7f8bb815ef80 2024-09-19T09:23:01.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.583+0000 7f8bbda1d640 1 --2- 172.21.15.18:0/1996818772 >> v2:172.21.15.162:3300/0 conn(0x7f8bb806d730 0x7f8bb80cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:01.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.583+0000 7f8bbca1b640 1 -- 172.21.15.18:0/1996818772 >> v2:172.21.15.162:3300/0 conn(0x7f8bb806d730 msgr2=0x7f8bb80cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:01.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.583+0000 7f8bbca1b640 1 --2- 172.21.15.18:0/1996818772 >> v2:172.21.15.162:3300/0 conn(0x7f8bb806d730 0x7f8bb80cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.583+0000 7f8bbca1b640 1 -- 172.21.15.18:0/1996818772 >> v1:172.21.15.18:6789/0 conn(0x7f8bb815ef80 legacy=0x7f8bb80cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:01.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.583+0000 7f8bbca1b640 1 -- 172.21.15.18:0/1996818772 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb806df10 con 0x7f8bb80cfae0 2024-09-19T09:23:01.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.583+0000 7f8bbda1d640 1 --2- 172.21.15.18:0/1996818772 >> v2:172.21.15.162:3300/0 conn(0x7f8bb806d730 0x7f8bb80cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:01.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.583+0000 7f8bbca1b640 1 --2- 172.21.15.18:0/1996818772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8bb80cfae0 0x7f8bb80b5220 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f8bb806f360 tx=0x7f8ba802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ffd38f293589ac6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:01.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.584+0000 7f8baffff640 1 -- 172.21.15.18:0/1996818772 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8037070 con 0x7f8bb80cfae0 2024-09-19T09:23:01.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.584+0000 7f8baffff640 1 -- 172.21.15.18:0/1996818772 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba8032440 con 0x7f8bb80cfae0 2024-09-19T09:23:01.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.584+0000 7f8baffff640 1 -- 172.21.15.18:0/1996818772 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8032810 con 0x7f8bb80cfae0 2024-09-19T09:23:01.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.584+0000 7f8bbf480640 1 -- 172.21.15.18:0/1996818772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8bb80cfae0 msgr2=0x7f8bb80b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:01.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.584+0000 7f8bbf480640 1 --2- 172.21.15.18:0/1996818772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8bb80cfae0 0x7f8bb80b5220 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f8bb806f360 tx=0x7f8ba802a1a0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.584+0000 7f8bbf480640 1 -- 172.21.15.18:0/1996818772 shutdown_connections 2024-09-19T09:23:01.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.584+0000 7f8bbf480640 1 --2- 172.21.15.18:0/1996818772 >> v2:172.21.15.162:3300/0 conn(0x7f8bb806d730 0x7f8bb80cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.584+0000 7f8bbf480640 1 --2- 172.21.15.18:0/1996818772 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8bb80cfae0 0x7f8bb80b5220 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.584+0000 7f8bbf480640 1 -- 172.21.15.18:0/1996818772 >> 172.21.15.18:0/1996818772 conn(0x7f8bb80b4700 msgr2=0x7f8bb80b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:01.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.584+0000 7f8bbf480640 1 -- 172.21.15.18:0/1996818772 shutdown_connections 2024-09-19T09:23:01.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.584+0000 7f8bbf480640 1 -- 172.21.15.18:0/1996818772 wait complete. 2024-09-19T09:23:01.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.585+0000 7f8bbf480640 1 Processor -- start 2024-09-19T09:23:01.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.586+0000 7f8bbf480640 1 -- start start 2024-09-19T09:23:01.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.586+0000 7f8bbf480640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8bb806d730 0x7f8bb81e7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:01.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.586+0000 7f8bbf480640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8bb80cfae0 0x7f8bb81e8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:01.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.586+0000 7f8bbf480640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bb815ef80 0x7f8bb80cc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:01.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.586+0000 7f8bbf480640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb80d0120 con 0x7f8bb806d730 2024-09-19T09:23:01.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.586+0000 7f8bbf480640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb815f360 con 0x7f8bb80cfae0 2024-09-19T09:23:01.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.586+0000 7f8bbf480640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8bb80ce1a0 con 0x7f8bb815ef80 2024-09-19T09:23:01.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.586+0000 7f8bbd21c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8bb806d730 0x7f8bb81e7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:01.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.586+0000 7f8bbd21c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8bb806d730 0x7f8bb81e7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51350/0 (socket says 172.21.15.18:51350) 2024-09-19T09:23:01.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.586+0000 7f8bbd21c640 1 -- 172.21.15.18:0/371296687 learned_addr learned my addr 172.21.15.18:0/371296687 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:23:01.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.587+0000 7f8bbd21c640 1 -- 172.21.15.18:0/371296687 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bb815ef80 msgr2=0x7f8bb80cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:01.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.587+0000 7f8bbd21c640 1 --2- 172.21.15.18:0/371296687 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bb815ef80 0x7f8bb80cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.587+0000 7f8bbd21c640 1 -- 172.21.15.18:0/371296687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8bb80cfae0 msgr2=0x7f8bb81e8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:01.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.587+0000 7f8bbd21c640 1 --2- 172.21.15.18:0/371296687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8bb80cfae0 0x7f8bb81e8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.587+0000 7f8bbd21c640 1 -- 172.21.15.18:0/371296687 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb80b7000 con 0x7f8bb806d730 2024-09-19T09:23:01.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.587+0000 7f8bbd21c640 1 --2- 172.21.15.18:0/371296687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8bb806d730 0x7f8bb81e7580 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f8bb400c390 tx=0x7f8bb400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:01.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.587+0000 7f8badffb640 1 -- 172.21.15.18:0/371296687 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb4017070 con 0x7f8bb806d730 2024-09-19T09:23:01.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.587+0000 7f8badffb640 1 -- 172.21.15.18:0/371296687 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bb4005ce0 con 0x7f8bb806d730 2024-09-19T09:23:01.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.587+0000 7f8bbf480640 1 -- 172.21.15.18:0/371296687 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bb80b72e0 con 0x7f8bb806d730 2024-09-19T09:23:01.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.587+0000 7f8badffb640 1 -- 172.21.15.18:0/371296687 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bb40072f0 con 0x7f8bb806d730 2024-09-19T09:23:01.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.587+0000 7f8bbf480640 1 -- 172.21.15.18:0/371296687 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bb80b78a0 con 0x7f8bb806d730 2024-09-19T09:23:01.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.588+0000 7f8bbf480640 1 -- 172.21.15.18:0/371296687 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bb80cff00 con 0x7f8bb806d730 2024-09-19T09:23:01.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.589+0000 7f8badffb640 1 -- 172.21.15.18:0/371296687 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8bb401a070 con 0x7f8bb806d730 2024-09-19T09:23:01.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.589+0000 7f8badffb640 1 --2- 172.21.15.18:0/371296687 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8b9c06c2b0 0x7f8b9c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:01.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.589+0000 7f8badffb640 1 -- 172.21.15.18:0/371296687 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7f8bb408a7e0 con 0x7f8bb806d730 2024-09-19T09:23:01.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.589+0000 7f8bbca1b640 1 --2- 172.21.15.18:0/371296687 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8b9c06c2b0 0x7f8b9c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:01.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.590+0000 7f8bbca1b640 1 --2- 172.21.15.18:0/371296687 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8b9c06c2b0 0x7f8b9c06e770 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8034000 tx=0x7f8ba802c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:01.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.594+0000 7f8badffb640 1 -- 172.21.15.18:0/371296687 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8bb4058fe0 con 0x7f8bb806d730 2024-09-19T09:23:01.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.770+0000 7f8bbf480640 1 -- 172.21.15.18:0/371296687 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8bb80cd1a0 con 0x7f8bb806d730 2024-09-19T09:23:01.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.771+0000 7f8badffb640 1 -- 172.21.15.18:0/371296687 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) ==== 74+0+16765 (secure 0 0 0) 0x7f8bb405de20 con 0x7f8bb806d730 2024-09-19T09:23:01.773 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:23:01.773 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":166,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:23:00.796694+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:22:58.457161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-19T09:22:59.786310+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:23:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.774+0000 7f8bbf480640 1 -- 172.21.15.18:0/371296687 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8b9c06c2b0 msgr2=0x7f8b9c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.774+0000 7f8bbf480640 1 --2- 172.21.15.18:0/371296687 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8b9c06c2b0 0x7f8b9c06e770 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8034000 tx=0x7f8ba802c000 comp rx=0 tx=0).stop 2024-09-19T09:23:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.774+0000 7f8bbf480640 1 -- 172.21.15.18:0/371296687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8bb806d730 msgr2=0x7f8bb81e7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.774+0000 7f8bbf480640 1 --2- 172.21.15.18:0/371296687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8bb806d730 0x7f8bb81e7580 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f8bb400c390 tx=0x7f8bb400c850 comp rx=0 tx=0).stop 2024-09-19T09:23:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.774+0000 7f8bbf480640 1 -- 172.21.15.18:0/371296687 shutdown_connections 2024-09-19T09:23:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.774+0000 7f8bbf480640 1 --2- 172.21.15.18:0/371296687 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8b9c06c2b0 0x7f8b9c06e770 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.774+0000 7f8bbf480640 1 --2- 172.21.15.18:0/371296687 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8bb815ef80 0x7f8bb80cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.774+0000 7f8bbf480640 1 --2- 172.21.15.18:0/371296687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8bb80cfae0 0x7f8bb81e8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.774+0000 7f8bbf480640 1 --2- 172.21.15.18:0/371296687 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8bb806d730 0x7f8bb81e7580 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.774+0000 7f8bbf480640 1 -- 172.21.15.18:0/371296687 >> 172.21.15.18:0/371296687 conn(0x7f8bb80b4700 msgr2=0x7f8bb80ce500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.774+0000 7f8bbf480640 1 -- 172.21.15.18:0/371296687 shutdown_connections 2024-09-19T09:23:01.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.774+0000 7f8bbf480640 1 -- 172.21.15.18:0/371296687 wait complete. 2024-09-19T09:23:01.787 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:23:01.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.888+0000 7f2ece6dd640 1 Processor -- start 2024-09-19T09:23:01.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.888+0000 7f2ece6dd640 1 -- start start 2024-09-19T09:23:01.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.889+0000 7f2ece6dd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ec8145e80 0x7f2ec815d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:01.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.889+0000 7f2ece6dd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2ec80d1500 0x7f2ec80d0240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:01.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.889+0000 7f2ece6dd640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ec806e550 con 0x7f2ec806bc10 2024-09-19T09:23:01.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.889+0000 7f2ece6dd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2ec80704e0 con 0x7f2ec80d1500 2024-09-19T09:23:01.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.889+0000 7f2ece6dd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2ec806e830 con 0x7f2ec8145e80 2024-09-19T09:23:01.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.889+0000 7f2eccc7a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2ec80d1500 0x7f2ec80d0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:01.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.889+0000 7f2ec77fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ec8145e80 0x7f2ec815d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:01.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.889+0000 7f2ec77fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ec8145e80 0x7f2ec815d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:54114/0 (socket says 172.21.15.18:54114) 2024-09-19T09:23:01.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.889+0000 7f2ec77fe640 1 -- 172.21.15.18:0/1266702924 learned_addr learned my addr 172.21.15.18:0/1266702924 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:23:01.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.889+0000 7f2eccc7a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2ec80d1500 0x7f2ec80d0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:58574/0 (socket says 172.21.15.18:58574) 2024-09-19T09:23:01.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.890+0000 7f2ec6ffd640 1 -- 172.21.15.18:0/1266702924 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2946166873 0 0) 0x7f2ec806e550 con 0x7f2ec806bc10 2024-09-19T09:23:01.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.890+0000 7f2ec77fe640 1 -- 172.21.15.18:0/1266702924 >> v2:172.21.15.162:3300/0 conn(0x7f2ec80d1500 msgr2=0x7f2ec80d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:01.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.890+0000 7f2ec77fe640 1 --2- 172.21.15.18:0/1266702924 >> v2:172.21.15.162:3300/0 conn(0x7f2ec80d1500 0x7f2ec80d0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.890+0000 7f2ec77fe640 1 -- 172.21.15.18:0/1266702924 >> v1:172.21.15.162:6789/0 conn(0x7f2ec806bc10 legacy=0x7f2ec806bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:01.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.890+0000 7f2ec77fe640 1 -- 172.21.15.18:0/1266702924 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec8070200 con 0x7f2ec8145e80 2024-09-19T09:23:01.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.890+0000 7f2ec77fe640 1 --2- 172.21.15.18:0/1266702924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ec8145e80 0x7f2ec815d0f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc009870 tx=0x7f2ebc02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6538cf17d466935d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:01.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.891+0000 7f2ec6ffd640 1 -- 172.21.15.18:0/1266702924 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc037070 con 0x7f2ec8145e80 2024-09-19T09:23:01.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.891+0000 7f2ec6ffd640 1 -- 172.21.15.18:0/1266702924 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ebc032440 con 0x7f2ec8145e80 2024-09-19T09:23:01.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.891+0000 7f2ec6ffd640 1 -- 172.21.15.18:0/1266702924 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc032810 con 0x7f2ec8145e80 2024-09-19T09:23:01.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.891+0000 7f2ece6dd640 1 -- 172.21.15.18:0/1266702924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ec8145e80 msgr2=0x7f2ec815d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:01.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.891+0000 7f2ece6dd640 1 --2- 172.21.15.18:0/1266702924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ec8145e80 0x7f2ec815d0f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc009870 tx=0x7f2ebc02a1c0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.891+0000 7f2ece6dd640 1 -- 172.21.15.18:0/1266702924 shutdown_connections 2024-09-19T09:23:01.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.891+0000 7f2ece6dd640 1 --2- 172.21.15.18:0/1266702924 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ec8145e80 0x7f2ec815d0f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.891+0000 7f2ece6dd640 1 --2- 172.21.15.18:0/1266702924 >> v2:172.21.15.162:3300/0 conn(0x7f2ec80d1500 0x7f2ec80d0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.891+0000 7f2ece6dd640 1 -- 172.21.15.18:0/1266702924 >> 172.21.15.18:0/1266702924 conn(0x7f2ec806cd20 msgr2=0x7f2ec806d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:01.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.891+0000 7f2ece6dd640 1 -- 172.21.15.18:0/1266702924 shutdown_connections 2024-09-19T09:23:01.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.891+0000 7f2ece6dd640 1 -- 172.21.15.18:0/1266702924 wait complete. 2024-09-19T09:23:01.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.892+0000 7f2ece6dd640 1 Processor -- start 2024-09-19T09:23:01.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.893+0000 7f2ece6dd640 1 -- start start 2024-09-19T09:23:01.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.893+0000 7f2ece6dd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ec806bc10 0x7f2ec81e5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:01.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.893+0000 7f2ece6dd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ec80d1500 0x7f2ec81e99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:01.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.893+0000 7f2ece6dd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ec8145e80 0x7f2ec81e9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:01.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.893+0000 7f2ece6dd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec815d630 con 0x7f2ec806bc10 2024-09-19T09:23:01.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.893+0000 7f2ece6dd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec806feb0 con 0x7f2ec80d1500 2024-09-19T09:23:01.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.893+0000 7f2ece6dd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2ec806d880 con 0x7f2ec8145e80 2024-09-19T09:23:01.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.893+0000 7f2ec7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ec806bc10 0x7f2ec81e5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:01.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.893+0000 7f2ec7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ec806bc10 0x7f2ec81e5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51364/0 (socket says 172.21.15.18:51364) 2024-09-19T09:23:01.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.893+0000 7f2ec7fff640 1 -- 172.21.15.18:0/1080613874 learned_addr learned my addr 172.21.15.18:0/1080613874 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:23:01.897 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.894+0000 7f2ec77fe640 1 --2- 172.21.15.18:0/1080613874 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ec80d1500 0x7f2ec81e99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:01.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.894+0000 7f2eccc7a640 1 --2- 172.21.15.18:0/1080613874 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ec8145e80 0x7f2ec81e9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:01.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.894+0000 7f2ec7fff640 1 -- 172.21.15.18:0/1080613874 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ec8145e80 msgr2=0x7f2ec81e9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:01.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.894+0000 7f2ec7fff640 1 --2- 172.21.15.18:0/1080613874 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ec8145e80 0x7f2ec81e9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.894+0000 7f2ec7fff640 1 -- 172.21.15.18:0/1080613874 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ec80d1500 msgr2=0x7f2ec81e99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:01.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.894+0000 7f2ec7fff640 1 --2- 172.21.15.18:0/1080613874 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ec80d1500 0x7f2ec81e99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:01.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.894+0000 7f2ec7fff640 1 -- 172.21.15.18:0/1080613874 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec81e5d10 con 0x7f2ec806bc10 2024-09-19T09:23:01.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.894+0000 7f2ec7fff640 1 --2- 172.21.15.18:0/1080613874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ec806bc10 0x7f2ec81e5330 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f2eb800c440 tx=0x7f2eb800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:01.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.894+0000 7f2ec4ff9640 1 -- 172.21.15.18:0/1080613874 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb8017070 con 0x7f2ec806bc10 2024-09-19T09:23:01.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.894+0000 7f2ec4ff9640 1 -- 172.21.15.18:0/1080613874 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2eb8005480 con 0x7f2ec806bc10 2024-09-19T09:23:01.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.894+0000 7f2ece6dd640 1 -- 172.21.15.18:0/1080613874 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ec81e5ff0 con 0x7f2ec806bc10 2024-09-19T09:23:01.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.894+0000 7f2ec4ff9640 1 -- 172.21.15.18:0/1080613874 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb8003830 con 0x7f2ec806bc10 2024-09-19T09:23:01.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.894+0000 7f2ece6dd640 1 -- 172.21.15.18:0/1080613874 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ec81e65b0 con 0x7f2ec806bc10 2024-09-19T09:23:01.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.895+0000 7f2ece6dd640 1 -- 172.21.15.18:0/1080613874 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ec81463d0 con 0x7f2ec806bc10 2024-09-19T09:23:01.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.896+0000 7f2ec4ff9640 1 -- 172.21.15.18:0/1080613874 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2eb801a070 con 0x7f2ec806bc10 2024-09-19T09:23:01.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.896+0000 7f2ec4ff9640 1 --2- 172.21.15.18:0/1080613874 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2eb406c2b0 0x7f2eb406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:01.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.896+0000 7f2ec4ff9640 1 -- 172.21.15.18:0/1080613874 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7f2eb808a7a0 con 0x7f2ec806bc10 2024-09-19T09:23:01.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.896+0000 7f2ec77fe640 1 --2- 172.21.15.18:0/1080613874 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2eb406c2b0 0x7f2eb406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:01.900 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.897+0000 7f2ec77fe640 1 --2- 172.21.15.18:0/1080613874 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2eb406c2b0 0x7f2eb406e770 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc034000 tx=0x7f2ebc02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:01.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:01.901+0000 7f2ec4ff9640 1 -- 172.21.15.18:0/1080613874 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2eb8058f20 con 0x7f2ec806bc10 2024-09-19T09:23:02.022 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:23:02.025 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:23:02.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.079+0000 7f2ece6dd640 1 -- 172.21.15.18:0/1080613874 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2ec8073850 con 0x7f2ec806bc10 2024-09-19T09:23:02.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.080+0000 7f2ec4ff9640 1 -- 172.21.15.18:0/1080613874 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v166) ==== 74+0+16765 (secure 0 0 0) 0x7f2eb8058820 con 0x7f2ec806bc10 2024-09-19T09:23:02.082 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:23:02.082 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":166,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:23:00.796694+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:22:58.457161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-19T09:22:59.786310+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:23:02.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.082+0000 7f2ece6dd640 1 -- 172.21.15.18:0/1080613874 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2eb406c2b0 msgr2=0x7f2eb406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:02.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.082+0000 7f2ece6dd640 1 --2- 172.21.15.18:0/1080613874 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2eb406c2b0 0x7f2eb406e770 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc034000 tx=0x7f2ebc02e000 comp rx=0 tx=0).stop 2024-09-19T09:23:02.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.082+0000 7f2ece6dd640 1 -- 172.21.15.18:0/1080613874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ec806bc10 msgr2=0x7f2ec81e5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:02.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.082+0000 7f2ece6dd640 1 --2- 172.21.15.18:0/1080613874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ec806bc10 0x7f2ec81e5330 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f2eb800c440 tx=0x7f2eb800c900 comp rx=0 tx=0).stop 2024-09-19T09:23:02.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.082+0000 7f2ece6dd640 1 -- 172.21.15.18:0/1080613874 shutdown_connections 2024-09-19T09:23:02.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.082+0000 7f2ece6dd640 1 --2- 172.21.15.18:0/1080613874 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2eb406c2b0 0x7f2eb406e770 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.082+0000 7f2ece6dd640 1 --2- 172.21.15.18:0/1080613874 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2ec8145e80 0x7f2ec81e9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.082+0000 7f2ece6dd640 1 --2- 172.21.15.18:0/1080613874 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ec80d1500 0x7f2ec81e99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.082+0000 7f2ece6dd640 1 --2- 172.21.15.18:0/1080613874 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2ec806bc10 0x7f2ec81e5330 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.082+0000 7f2ece6dd640 1 -- 172.21.15.18:0/1080613874 >> 172.21.15.18:0/1080613874 conn(0x7f2ec806cd20 msgr2=0x7f2ec815f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:02.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.082+0000 7f2ece6dd640 1 -- 172.21.15.18:0/1080613874 shutdown_connections 2024-09-19T09:23:02.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.082+0000 7f2ece6dd640 1 -- 172.21.15.18:0/1080613874 wait complete. 2024-09-19T09:23:02.095 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-19T09:23:02.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.239+0000 7f92fca42640 1 Processor -- start 2024-09-19T09:23:02.241 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.239+0000 7f92fca42640 1 -- start start 2024-09-19T09:23:02.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.240+0000 7f92fca42640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f92f815c670 0x7f92f80b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:02.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.240+0000 7f92fca42640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f92f806deb0 0x7f92f8160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:02.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.240+0000 7f92fca42640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92f80b6a60 con 0x7f92f815f1a0 2024-09-19T09:23:02.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.240+0000 7f92fca42640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f92f80b6d40 con 0x7f92f806deb0 2024-09-19T09:23:02.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.240+0000 7f92fca42640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f92f80b7020 con 0x7f92f815c670 2024-09-19T09:23:02.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.240+0000 7f92f6d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f92f806deb0 0x7f92f8160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:02.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.240+0000 7f92f5d9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f92f815f1a0 0x7f92f806d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39792/0 (socket says 172.21.15.18:39792) 2024-09-19T09:23:02.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.240+0000 7f92f5d9b640 1 -- 172.21.15.18:0/1932396564 learned_addr learned my addr 172.21.15.18:0/1932396564 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:23:02.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.241+0000 7f92f659c640 1 --2- 172.21.15.18:0/1932396564 >> v2:172.21.15.162:3300/0 conn(0x7f92f815c670 0x7f92f80b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:02.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.241+0000 7f92f6d9d640 1 -- 172.21.15.18:0/1932396564 >> v2:172.21.15.162:3300/0 conn(0x7f92f815c670 msgr2=0x7f92f80b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:02.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.241+0000 7f92f6d9d640 1 --2- 172.21.15.18:0/1932396564 >> v2:172.21.15.162:3300/0 conn(0x7f92f815c670 0x7f92f80b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.241+0000 7f92f6d9d640 1 -- 172.21.15.18:0/1932396564 >> v1:172.21.15.18:6789/0 conn(0x7f92f815f1a0 legacy=0x7f92f806d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:02.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.241+0000 7f92f6d9d640 1 -- 172.21.15.18:0/1932396564 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f80b7300 con 0x7f92f806deb0 2024-09-19T09:23:02.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.241+0000 7f92f559a640 1 -- 172.21.15.18:0/1932396564 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1890880296 0 0) 0x7f92f80b6a60 con 0x7f92f815f1a0 2024-09-19T09:23:02.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.241+0000 7f92f659c640 1 --2- 172.21.15.18:0/1932396564 >> v2:172.21.15.162:3300/0 conn(0x7f92f815c670 0x7f92f80b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:02.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.241+0000 7f92f6d9d640 1 --2- 172.21.15.18:0/1932396564 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92f806deb0 0x7f92f8160300 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f92f80728c0 tx=0x7f92f002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd37ae4c304c56e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:02.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.241+0000 7f92f559a640 1 -- 172.21.15.18:0/1932396564 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f0007740 con 0x7f92f806deb0 2024-09-19T09:23:02.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.241+0000 7f92f559a640 1 -- 172.21.15.18:0/1932396564 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92f00078e0 con 0x7f92f806deb0 2024-09-19T09:23:02.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.242+0000 7f92f559a640 1 -- 172.21.15.18:0/1932396564 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f0007cb0 con 0x7f92f806deb0 2024-09-19T09:23:02.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.242+0000 7f92fca42640 1 -- 172.21.15.18:0/1932396564 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92f806deb0 msgr2=0x7f92f8160300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:02.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.242+0000 7f92fca42640 1 --2- 172.21.15.18:0/1932396564 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92f806deb0 0x7f92f8160300 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f92f80728c0 tx=0x7f92f002a680 comp rx=0 tx=0).stop 2024-09-19T09:23:02.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.242+0000 7f92fca42640 1 -- 172.21.15.18:0/1932396564 shutdown_connections 2024-09-19T09:23:02.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.242+0000 7f92fca42640 1 --2- 172.21.15.18:0/1932396564 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92f806deb0 0x7f92f8160300 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.242+0000 7f92fca42640 1 --2- 172.21.15.18:0/1932396564 >> v2:172.21.15.162:3300/0 conn(0x7f92f815c670 0x7f92f80b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.242+0000 7f92fca42640 1 -- 172.21.15.18:0/1932396564 >> 172.21.15.18:0/1932396564 conn(0x7f92f809b9d0 msgr2=0x7f92f809bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:02.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.242+0000 7f92fca42640 1 -- 172.21.15.18:0/1932396564 shutdown_connections 2024-09-19T09:23:02.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.242+0000 7f92fca42640 1 -- 172.21.15.18:0/1932396564 wait complete. 2024-09-19T09:23:02.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.243+0000 7f92fca42640 1 Processor -- start 2024-09-19T09:23:02.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.244+0000 7f92fca42640 1 -- start start 2024-09-19T09:23:02.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.244+0000 7f92fca42640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92f806deb0 0x7f92f80a03a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:02.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.244+0000 7f92fca42640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92f815c670 0x7f92f8154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:02.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.244+0000 7f92fca42640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92f815f1a0 0x7f92f815dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:02.249 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.244+0000 7f92fca42640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f92f80b7b00 con 0x7f92f806deb0 2024-09-19T09:23:02.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.244+0000 7f92fca42640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f92f809c560 con 0x7f92f815c670 2024-09-19T09:23:02.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.244+0000 7f92fca42640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f92f80cced0 con 0x7f92f815f1a0 2024-09-19T09:23:02.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.244+0000 7f92f659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92f806deb0 0x7f92f80a03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:02.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.244+0000 7f92f659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92f806deb0 0x7f92f80a03a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51382/0 (socket says 172.21.15.18:51382) 2024-09-19T09:23:02.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.244+0000 7f92f659c640 1 -- 172.21.15.18:0/3852031456 learned_addr learned my addr 172.21.15.18:0/3852031456 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:23:02.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.245+0000 7f92f659c640 1 -- 172.21.15.18:0/3852031456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92f815f1a0 msgr2=0x7f92f815dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:02.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.245+0000 7f92f659c640 1 --2- 172.21.15.18:0/3852031456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92f815f1a0 0x7f92f815dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.245+0000 7f92f659c640 1 -- 172.21.15.18:0/3852031456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92f815c670 msgr2=0x7f92f8154510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:02.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.245+0000 7f92f659c640 1 --2- 172.21.15.18:0/3852031456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92f815c670 0x7f92f8154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:02.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.245+0000 7f92f659c640 1 -- 172.21.15.18:0/3852031456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f8155c20 con 0x7f92f806deb0 2024-09-19T09:23:02.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.245+0000 7f92f659c640 1 --2- 172.21.15.18:0/3852031456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92f806deb0 0x7f92f80a03a0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f92e800c7f0 tx=0x7f92e800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:02.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.245+0000 7f92e6ffd640 1 -- 172.21.15.18:0/3852031456 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e8015070 con 0x7f92f806deb0 2024-09-19T09:23:02.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.245+0000 7f92e6ffd640 1 -- 172.21.15.18:0/3852031456 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92e8007a30 con 0x7f92f806deb0 2024-09-19T09:23:02.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.245+0000 7f92fca42640 1 -- 172.21.15.18:0/3852031456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92f80cc880 con 0x7f92f806deb0 2024-09-19T09:23:02.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.245+0000 7f92e6ffd640 1 -- 172.21.15.18:0/3852031456 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e8007e00 con 0x7f92f806deb0 2024-09-19T09:23:02.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.245+0000 7f92fca42640 1 -- 172.21.15.18:0/3852031456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92f81558d0 con 0x7f92f806deb0 2024-09-19T09:23:02.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.246+0000 7f92fca42640 1 -- 172.21.15.18:0/3852031456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92f815dbd0 con 0x7f92f806deb0 2024-09-19T09:23:02.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.247+0000 7f92e6ffd640 1 -- 172.21.15.18:0/3852031456 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f92e8018070 con 0x7f92f806deb0 2024-09-19T09:23:02.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.247+0000 7f92e6ffd640 1 --2- 172.21.15.18:0/3852031456 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f92d806c2e0 0x7f92d806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:02.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.247+0000 7f92e6ffd640 1 -- 172.21.15.18:0/3852031456 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(166..166 src has 1..166) ==== 5709+0+0 (secure 0 0 0) 0x7f92e808b390 con 0x7f92f806deb0 2024-09-19T09:23:02.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.247+0000 7f92f5d9b640 1 --2- 172.21.15.18:0/3852031456 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f92d806c2e0 0x7f92d806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:02.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.248+0000 7f92f5d9b640 1 --2- 172.21.15.18:0/3852031456 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f92d806c2e0 0x7f92d806e7a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f92ec007fd0 tx=0x7f92ec007960 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:02.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.251+0000 7f92e6ffd640 1 -- 172.21.15.18:0/3852031456 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f92e8059b90 con 0x7f92f806deb0 2024-09-19T09:23:02.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:02.464+0000 7f92fca42640 1 -- 172.21.15.18:0/3852031456 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f92f80755b0 con 0x7f92f806deb0 2024-09-19T09:23:03.462 INFO:tasks.ceph.mds.a.smithi018.stderr:2024-09-19T09:23:03.460+0000 7fe2a4a83640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T09:23:03.468 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.467+0000 7f92e6ffd640 1 -- 172.21.15.18:0/3852031456 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v73) ==== 118+0+0 (secure 0 0 0) 0x7f92e8059490 con 0x7f92f806deb0 2024-09-19T09:23:03.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.469+0000 7f92fca42640 1 -- 172.21.15.18:0/3852031456 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f92d806c2e0 msgr2=0x7f92d806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:03.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.469+0000 7f92fca42640 1 --2- 172.21.15.18:0/3852031456 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f92d806c2e0 0x7f92d806e7a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f92ec007fd0 tx=0x7f92ec007960 comp rx=0 tx=0).stop 2024-09-19T09:23:03.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.469+0000 7f92fca42640 1 -- 172.21.15.18:0/3852031456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92f806deb0 msgr2=0x7f92f80a03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:03.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.469+0000 7f92fca42640 1 --2- 172.21.15.18:0/3852031456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92f806deb0 0x7f92f80a03a0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f92e800c7f0 tx=0x7f92e800cbf0 comp rx=0 tx=0).stop 2024-09-19T09:23:03.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.469+0000 7f92fca42640 1 -- 172.21.15.18:0/3852031456 shutdown_connections 2024-09-19T09:23:03.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.469+0000 7f92fca42640 1 --2- 172.21.15.18:0/3852031456 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f92d806c2e0 0x7f92d806e7a0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:03.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.469+0000 7f92fca42640 1 --2- 172.21.15.18:0/3852031456 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f92f815f1a0 0x7f92f815dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:03.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.469+0000 7f92fca42640 1 --2- 172.21.15.18:0/3852031456 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f92f815c670 0x7f92f8154510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:03.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.469+0000 7f92fca42640 1 --2- 172.21.15.18:0/3852031456 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f92f806deb0 0x7f92f80a03a0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:03.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.469+0000 7f92fca42640 1 -- 172.21.15.18:0/3852031456 >> 172.21.15.18:0/3852031456 conn(0x7f92f809b9d0 msgr2=0x7f92f8160300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:03.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.469+0000 7f92fca42640 1 -- 172.21.15.18:0/3852031456 shutdown_connections 2024-09-19T09:23:03.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.469+0000 7f92fca42640 1 -- 172.21.15.18:0/3852031456 wait complete. 2024-09-19T09:23:03.485 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-19T09:23:03.485 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-19T09:23:03.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.596+0000 7f126c768640 1 Processor -- start 2024-09-19T09:23:03.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.596+0000 7f126c768640 1 -- start start 2024-09-19T09:23:03.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.597+0000 7f126c768640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f12640afa90 0x7f126406f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:03.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.597+0000 7f126c768640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12640d0630 0x7f12640d0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:03.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.597+0000 7f126c768640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12640b4300 con 0x7f126415b760 2024-09-19T09:23:03.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.597+0000 7f126c768640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f12640d0fa0 con 0x7f12640afa90 2024-09-19T09:23:03.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.597+0000 7f126c768640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f126406d700 con 0x7f12640d0630 2024-09-19T09:23:03.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.597+0000 7f1269d03640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f12640afa90 0x7f126406f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:03.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.597+0000 7f126ad05640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12640d0630 0x7f12640d0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:03.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.597+0000 7f126ad05640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12640d0630 0x7f12640d0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:54134/0 (socket says 172.21.15.18:54134) 2024-09-19T09:23:03.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.597+0000 7f126ad05640 1 -- 172.21.15.18:0/3493531453 learned_addr learned my addr 172.21.15.18:0/3493531453 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:23:03.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.598+0000 7f126ad05640 1 -- 172.21.15.18:0/3493531453 >> v2:172.21.15.162:3300/0 conn(0x7f12640afa90 msgr2=0x7f126406f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:03.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.598+0000 7f126ad05640 1 --2- 172.21.15.18:0/3493531453 >> v2:172.21.15.162:3300/0 conn(0x7f12640afa90 0x7f126406f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:03.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.598+0000 7f126ad05640 1 -- 172.21.15.18:0/3493531453 >> v1:172.21.15.162:6789/0 conn(0x7f126415b760 legacy=0x7f12640b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:03.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.598+0000 7f126ad05640 1 -- 172.21.15.18:0/3493531453 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126406d9e0 con 0x7f12640d0630 2024-09-19T09:23:03.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.599+0000 7f126ad05640 1 --2- 172.21.15.18:0/3493531453 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12640d0630 0x7f12640d0a60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f125c009e50 tx=0x7f125c02a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d104ac29cf8795e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:03.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.599+0000 7f1269502640 1 -- 172.21.15.18:0/3493531453 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125c036070 con 0x7f12640d0630 2024-09-19T09:23:03.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.599+0000 7f1269502640 1 -- 172.21.15.18:0/3493531453 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f125c031600 con 0x7f12640d0630 2024-09-19T09:23:03.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.599+0000 7f1269502640 1 -- 172.21.15.18:0/3493531453 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125c0319d0 con 0x7f12640d0630 2024-09-19T09:23:03.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.599+0000 7f126c768640 1 -- 172.21.15.18:0/3493531453 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12640d0630 msgr2=0x7f12640d0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:03.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.599+0000 7f126c768640 1 --2- 172.21.15.18:0/3493531453 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12640d0630 0x7f12640d0a60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f125c009e50 tx=0x7f125c02a5f0 comp rx=0 tx=0).stop 2024-09-19T09:23:03.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.599+0000 7f126c768640 1 -- 172.21.15.18:0/3493531453 shutdown_connections 2024-09-19T09:23:03.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.599+0000 7f126c768640 1 --2- 172.21.15.18:0/3493531453 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12640d0630 0x7f12640d0a60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:03.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.599+0000 7f126c768640 1 --2- 172.21.15.18:0/3493531453 >> v2:172.21.15.162:3300/0 conn(0x7f12640afa90 0x7f126406f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:03.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.599+0000 7f126c768640 1 -- 172.21.15.18:0/3493531453 >> 172.21.15.18:0/3493531453 conn(0x7f126406bc10 msgr2=0x7f126406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:03.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.599+0000 7f126c768640 1 -- 172.21.15.18:0/3493531453 shutdown_connections 2024-09-19T09:23:03.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.599+0000 7f126c768640 1 -- 172.21.15.18:0/3493531453 wait complete. 2024-09-19T09:23:03.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.601+0000 7f126c768640 1 Processor -- start 2024-09-19T09:23:03.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.601+0000 7f126c768640 1 -- start start 2024-09-19T09:23:03.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.601+0000 7f126c768640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12640afa90 0x7f126415e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:03.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.601+0000 7f126c768640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12640d0630 0x7f1264149180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:03.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.601+0000 7f126c768640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f126415b760 0x7f12640ae840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:03.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.601+0000 7f126c768640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f126415bb40 con 0x7f12640afa90 2024-09-19T09:23:03.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.601+0000 7f126c768640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f126406f7d0 con 0x7f126415b760 2024-09-19T09:23:03.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.601+0000 7f126c768640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f126415bcc0 con 0x7f12640d0630 2024-09-19T09:23:03.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.602+0000 7f126a504640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12640afa90 0x7f126415e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:03.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.602+0000 7f126a504640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12640afa90 0x7f126415e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51398/0 (socket says 172.21.15.18:51398) 2024-09-19T09:23:03.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.602+0000 7f126a504640 1 -- 172.21.15.18:0/3883654927 learned_addr learned my addr 172.21.15.18:0/3883654927 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:23:03.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.602+0000 7f126ad05640 1 --2- 172.21.15.18:0/3883654927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f126415b760 0x7f12640ae840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:03.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.602+0000 7f1269d03640 1 --2- 172.21.15.18:0/3883654927 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12640d0630 0x7f1264149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:03.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.602+0000 7f126a504640 1 -- 172.21.15.18:0/3883654927 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12640d0630 msgr2=0x7f1264149180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:03.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.602+0000 7f126a504640 1 --2- 172.21.15.18:0/3883654927 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12640d0630 0x7f1264149180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:03.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.602+0000 7f126a504640 1 -- 172.21.15.18:0/3883654927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f126415b760 msgr2=0x7f12640ae840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:03.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.602+0000 7f126a504640 1 --2- 172.21.15.18:0/3883654927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f126415b760 0x7f12640ae840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:03.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.602+0000 7f126a504640 1 -- 172.21.15.18:0/3883654927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126415e920 con 0x7f12640afa90 2024-09-19T09:23:03.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.602+0000 7f126ad05640 1 --2- 172.21.15.18:0/3883654927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f126415b760 0x7f12640ae840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:23:03.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.602+0000 7f126a504640 1 --2- 172.21.15.18:0/3883654927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12640afa90 0x7f126415e060 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f126000c3c0 tx=0x7f126000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:03.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.602+0000 7f125affd640 1 -- 172.21.15.18:0/3883654927 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12600052d0 con 0x7f12640afa90 2024-09-19T09:23:03.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.602+0000 7f125affd640 1 -- 172.21.15.18:0/3883654927 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1260005490 con 0x7f12640afa90 2024-09-19T09:23:03.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.602+0000 7f126c768640 1 -- 172.21.15.18:0/3883654927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1264167580 con 0x7f12640afa90 2024-09-19T09:23:03.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.602+0000 7f125affd640 1 -- 172.21.15.18:0/3883654927 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1260007260 con 0x7f12640afa90 2024-09-19T09:23:03.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.602+0000 7f126c768640 1 -- 172.21.15.18:0/3883654927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f126415e5a0 con 0x7f12640afa90 2024-09-19T09:23:03.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.603+0000 7f126c768640 1 -- 172.21.15.18:0/3883654927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f126406dcc0 con 0x7f12640afa90 2024-09-19T09:23:03.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.604+0000 7f125affd640 1 -- 172.21.15.18:0/3883654927 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1260007400 con 0x7f12640afa90 2024-09-19T09:23:03.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.604+0000 7f125affd640 1 --2- 172.21.15.18:0/3883654927 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f124806c2b0 0x7f124806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:03.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.604+0000 7f125affd640 1 -- 172.21.15.18:0/3883654927 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f126008a910 con 0x7f12640afa90 2024-09-19T09:23:03.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.605+0000 7f1269d03640 1 --2- 172.21.15.18:0/3883654927 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f124806c2b0 0x7f124806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:03.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.605+0000 7f1269d03640 1 --2- 172.21.15.18:0/3883654927 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f124806c2b0 0x7f124806e770 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f12640af510 tx=0x7f1254008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:03.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.609+0000 7f125affd640 1 -- 172.21.15.18:0/3883654927 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1260059080 con 0x7f12640afa90 2024-09-19T09:23:03.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:03.821+0000 7f126c768640 1 -- 172.21.15.18:0/3883654927 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f12640b40e0 con 0x7f12640afa90 2024-09-19T09:23:04.474 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.472+0000 7f125affd640 1 -- 172.21.15.18:0/3883654927 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v74) ==== 122+0+0 (secure 0 0 0) 0x7f1260058980 con 0x7f12640afa90 2024-09-19T09:23:04.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.474+0000 7f126c768640 1 -- 172.21.15.18:0/3883654927 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f124806c2b0 msgr2=0x7f124806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:04.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.474+0000 7f126c768640 1 --2- 172.21.15.18:0/3883654927 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f124806c2b0 0x7f124806e770 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f12640af510 tx=0x7f1254008040 comp rx=0 tx=0).stop 2024-09-19T09:23:04.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.474+0000 7f126c768640 1 -- 172.21.15.18:0/3883654927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12640afa90 msgr2=0x7f126415e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:04.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.474+0000 7f126c768640 1 --2- 172.21.15.18:0/3883654927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12640afa90 0x7f126415e060 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f126000c3c0 tx=0x7f126000c880 comp rx=0 tx=0).stop 2024-09-19T09:23:04.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.474+0000 7f126c768640 1 -- 172.21.15.18:0/3883654927 shutdown_connections 2024-09-19T09:23:04.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.475+0000 7f126c768640 1 --2- 172.21.15.18:0/3883654927 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f124806c2b0 0x7f124806e770 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.475+0000 7f126c768640 1 --2- 172.21.15.18:0/3883654927 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f126415b760 0x7f12640ae840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.475+0000 7f126c768640 1 --2- 172.21.15.18:0/3883654927 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12640d0630 0x7f1264149180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.477 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.475+0000 7f126c768640 1 --2- 172.21.15.18:0/3883654927 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f12640afa90 0x7f126415e060 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.475+0000 7f126c768640 1 -- 172.21.15.18:0/3883654927 >> 172.21.15.18:0/3883654927 conn(0x7f126406bc10 msgr2=0x7f12640ce360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:04.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.475+0000 7f126c768640 1 -- 172.21.15.18:0/3883654927 shutdown_connections 2024-09-19T09:23:04.478 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.475+0000 7f126c768640 1 -- 172.21.15.18:0/3883654927 wait complete. 2024-09-19T09:23:04.490 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-19T09:23:04.490 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:23:04.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.596+0000 7f193745e640 1 Processor -- start 2024-09-19T09:23:04.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.596+0000 7f193745e640 1 -- start start 2024-09-19T09:23:04.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.597+0000 7f193745e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f193013fae0 0x7f193006f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.597+0000 7f193745e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1930160c50 0x7f19300cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.597+0000 7f193745e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1930142650 con 0x7f1930142150 2024-09-19T09:23:04.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.597+0000 7f193745e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f19300ce780 con 0x7f1930160c50 2024-09-19T09:23:04.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.597+0000 7f193745e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1930142930 con 0x7f193013fae0 2024-09-19T09:23:04.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.597+0000 7f19359fb640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1930160c50 0x7f19300cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.597+0000 7f19359fb640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1930160c50 0x7f19300cec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51412/0 (socket says 172.21.15.18:51412) 2024-09-19T09:23:04.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.597+0000 7f19359fb640 1 -- 172.21.15.18:0/3383348367 learned_addr learned my addr 172.21.15.18:0/3383348367 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:23:04.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.597+0000 7f19351fa640 1 --2- 172.21.15.18:0/3383348367 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f193013fae0 0x7f193006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.598+0000 7f19359fb640 1 -- 172.21.15.18:0/3383348367 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f193013fae0 msgr2=0x7f193006f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:04.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.598+0000 7f19359fb640 1 --2- 172.21.15.18:0/3383348367 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f193013fae0 0x7f193006f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.598+0000 7f19359fb640 1 -- 172.21.15.18:0/3383348367 >> v1:172.21.15.162:6789/0 conn(0x7f1930142150 legacy=0x7f1930160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:04.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.598+0000 7f19359fb640 1 -- 172.21.15.18:0/3383348367 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1930142c10 con 0x7f1930160c50 2024-09-19T09:23:04.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.598+0000 7f19359fb640 1 --2- 172.21.15.18:0/3383348367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1930160c50 0x7f19300cec10 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f1920009e50 tx=0x7f192002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb6ba74223dd0c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:04.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.598+0000 7f192ffff640 1 -- 172.21.15.18:0/3383348367 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1920036070 con 0x7f1930160c50 2024-09-19T09:23:04.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.599+0000 7f192ffff640 1 -- 172.21.15.18:0/3383348367 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1920031600 con 0x7f1930160c50 2024-09-19T09:23:04.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.599+0000 7f192ffff640 1 -- 172.21.15.18:0/3383348367 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19200319d0 con 0x7f1930160c50 2024-09-19T09:23:04.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.599+0000 7f193745e640 1 -- 172.21.15.18:0/3383348367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1930160c50 msgr2=0x7f19300cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:04.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.599+0000 7f193745e640 1 --2- 172.21.15.18:0/3383348367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1930160c50 0x7f19300cec10 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f1920009e50 tx=0x7f192002a680 comp rx=0 tx=0).stop 2024-09-19T09:23:04.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.599+0000 7f193745e640 1 -- 172.21.15.18:0/3383348367 shutdown_connections 2024-09-19T09:23:04.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.599+0000 7f193745e640 1 --2- 172.21.15.18:0/3383348367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1930160c50 0x7f19300cec10 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.599+0000 7f193745e640 1 --2- 172.21.15.18:0/3383348367 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f193013fae0 0x7f193006f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.599+0000 7f193745e640 1 -- 172.21.15.18:0/3383348367 >> 172.21.15.18:0/3383348367 conn(0x7f193006bc10 msgr2=0x7f193006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:04.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.599+0000 7f193745e640 1 -- 172.21.15.18:0/3383348367 shutdown_connections 2024-09-19T09:23:04.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.599+0000 7f193745e640 1 -- 172.21.15.18:0/3383348367 wait complete. 2024-09-19T09:23:04.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.600+0000 7f193745e640 1 Processor -- start 2024-09-19T09:23:04.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.600+0000 7f193745e640 1 -- start start 2024-09-19T09:23:04.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.601+0000 7f193745e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f193013fae0 0x7f193013df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.601+0000 7f193745e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1930142150 0x7f193013b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.601+0000 7f193745e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1930160c50 0x7f193013b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.601+0000 7f193745e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f193006f870 con 0x7f193013fae0 2024-09-19T09:23:04.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.601+0000 7f193745e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f193006f6f0 con 0x7f1930142150 2024-09-19T09:23:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.601+0000 7f193745e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f19300cf150 con 0x7f1930160c50 2024-09-19T09:23:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.601+0000 7f19351fa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f193013fae0 0x7f193013df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.601+0000 7f19351fa640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f193013fae0 0x7f193013df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51414/0 (socket says 172.21.15.18:51414) 2024-09-19T09:23:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.601+0000 7f19351fa640 1 -- 172.21.15.18:0/3065374301 learned_addr learned my addr 172.21.15.18:0/3065374301 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:23:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.601+0000 7f19359fb640 1 --2- 172.21.15.18:0/3065374301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1930160c50 0x7f193013b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.601+0000 7f19351fa640 1 -- 172.21.15.18:0/3065374301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1930160c50 msgr2=0x7f193013b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.602+0000 7f19351fa640 1 --2- 172.21.15.18:0/3065374301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1930160c50 0x7f193013b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.602+0000 7f19351fa640 1 -- 172.21.15.18:0/3065374301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1930142150 msgr2=0x7f193013b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.602+0000 7f19351fa640 1 --2- 172.21.15.18:0/3065374301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1930142150 0x7f193013b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.602+0000 7f19351fa640 1 -- 172.21.15.18:0/3065374301 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19301442d0 con 0x7f193013fae0 2024-09-19T09:23:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.602+0000 7f19351fa640 1 --2- 172.21.15.18:0/3065374301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f193013fae0 0x7f193013df50 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f192800e9b0 tx=0x7f192800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.602+0000 7f192dffb640 1 -- 172.21.15.18:0/3065374301 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1928017070 con 0x7f193013fae0 2024-09-19T09:23:04.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.602+0000 7f192dffb640 1 -- 172.21.15.18:0/3065374301 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f192800c9a0 con 0x7f193013fae0 2024-09-19T09:23:04.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.602+0000 7f193745e640 1 -- 172.21.15.18:0/3065374301 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1930157960 con 0x7f193013fae0 2024-09-19T09:23:04.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.602+0000 7f192dffb640 1 -- 172.21.15.18:0/3065374301 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f192800cd90 con 0x7f193013fae0 2024-09-19T09:23:04.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.602+0000 7f193745e640 1 -- 172.21.15.18:0/3065374301 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1930157f20 con 0x7f193013fae0 2024-09-19T09:23:04.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.603+0000 7f193745e640 1 -- 172.21.15.18:0/3065374301 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f193006f1b0 con 0x7f193013fae0 2024-09-19T09:23:04.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.604+0000 7f192dffb640 1 -- 172.21.15.18:0/3065374301 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f192801a070 con 0x7f193013fae0 2024-09-19T09:23:04.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.604+0000 7f192dffb640 1 --2- 172.21.15.18:0/3065374301 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f191c06c2b0 0x7f191c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.604+0000 7f192dffb640 1 -- 172.21.15.18:0/3065374301 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f192808b3d0 con 0x7f193013fae0 2024-09-19T09:23:04.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.604+0000 7f19349f9640 1 --2- 172.21.15.18:0/3065374301 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f191c06c2b0 0x7f191c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.605+0000 7f19349f9640 1 --2- 172.21.15.18:0/3065374301 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f191c06c2b0 0x7f191c06e770 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1924000f60 tx=0x7f19240079d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:04.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.609+0000 7f192dffb640 1 -- 172.21.15.18:0/3065374301 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1928059bd0 con 0x7f193013fae0 2024-09-19T09:23:04.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.819+0000 7f193745e640 1 -- 172.21.15.18:0/3065374301 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19300b20e0 con 0x7f193013fae0 2024-09-19T09:23:04.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.820+0000 7f192dffb640 1 -- 172.21.15.18:0/3065374301 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5230 (secure 0 0 0) 0x7f19280594d0 con 0x7f193013fae0 2024-09-19T09:23:04.822 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:23:04.822 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":74,"btime":"2024-09-19T09:23:04:468698+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1145590197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1145590197},{"type":"v1","addr":"172.21.15.162:6837","nonce":1145590197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/200393908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":200393908},{"type":"v1","addr":"172.21.15.162:6836","nonce":200393908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7542,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1236184741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1236184741},{"type":"v1","addr":"172.21.15.18:6834","nonce":1236184741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:23:00.797014+0000","modified":"2024-09-19T09:23:03.823915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7545":{"gid":7545,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2876222862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2876222862},{"type":"v1","addr":"172.21.15.18:6835","nonce":2876222862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7545,"qdb_cluster":[7545]},"id":10}]} 2024-09-19T09:23:04.822 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 74 2024-09-19T09:23:04.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.823+0000 7f193745e640 1 -- 172.21.15.18:0/3065374301 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f191c06c2b0 msgr2=0x7f191c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:04.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.823+0000 7f193745e640 1 --2- 172.21.15.18:0/3065374301 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f191c06c2b0 0x7f191c06e770 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f1924000f60 tx=0x7f19240079d0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.823+0000 7f193745e640 1 -- 172.21.15.18:0/3065374301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f193013fae0 msgr2=0x7f193013df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:04.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.823+0000 7f193745e640 1 --2- 172.21.15.18:0/3065374301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f193013fae0 0x7f193013df50 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f192800e9b0 tx=0x7f192800ee70 comp rx=0 tx=0).stop 2024-09-19T09:23:04.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.823+0000 7f193745e640 1 -- 172.21.15.18:0/3065374301 shutdown_connections 2024-09-19T09:23:04.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.823+0000 7f193745e640 1 --2- 172.21.15.18:0/3065374301 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f191c06c2b0 0x7f191c06e770 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.823+0000 7f193745e640 1 --2- 172.21.15.18:0/3065374301 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1930160c50 0x7f193013b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.823+0000 7f193745e640 1 --2- 172.21.15.18:0/3065374301 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1930142150 0x7f193013b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.823+0000 7f193745e640 1 --2- 172.21.15.18:0/3065374301 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f193013fae0 0x7f193013df50 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.823+0000 7f193745e640 1 -- 172.21.15.18:0/3065374301 >> 172.21.15.18:0/3065374301 conn(0x7f193006bc10 msgr2=0x7f193015fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:04.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.823+0000 7f193745e640 1 -- 172.21.15.18:0/3065374301 shutdown_connections 2024-09-19T09:23:04.825 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.823+0000 7f193745e640 1 -- 172.21.15.18:0/3065374301 wait complete. 2024-09-19T09:23:04.835 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:23:04.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.935+0000 7fe105f49640 1 Processor -- start 2024-09-19T09:23:04.937 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.935+0000 7fe105f49640 1 -- start start 2024-09-19T09:23:04.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.936+0000 7fe105f49640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe10006d730 0x7fe1000b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.936+0000 7fe105f49640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1000cd1a0 con 0x7fe10015ef80 2024-09-19T09:23:04.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.936+0000 7fe105f49640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe10006dc30 con 0x7fe1000cfae0 2024-09-19T09:23:04.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.936+0000 7fe105f49640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe1000cd7d0 con 0x7fe10006d730 2024-09-19T09:23:04.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.936+0000 7fe0ff7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe10015ef80 0x7fe1000cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39804/0 (socket says 172.21.15.18:39804) 2024-09-19T09:23:04.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.936+0000 7fe0ff7fe640 1 -- 172.21.15.18:0/1548216751 learned_addr learned my addr 172.21.15.18:0/1548216751 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:23:04.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.936+0000 7fe0fe7fc640 1 -- 172.21.15.18:0/1548216751 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2555324894 0 0) 0x7fe1000cd1a0 con 0x7fe10015ef80 2024-09-19T09:23:04.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.936+0000 7fe0fe7fc640 1 -- 172.21.15.18:0/1548216751 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0ec003520 con 0x7fe10015ef80 2024-09-19T09:23:04.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.936+0000 7fe0fffff640 1 --2- 172.21.15.18:0/1548216751 >> v2:172.21.15.162:3300/0 conn(0x7fe10006d730 0x7fe1000b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.936+0000 7fe0fe7fc640 1 -- 172.21.15.18:0/1548216751 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1660279627 0 0) 0x7fe0ec003520 con 0x7fe10015ef80 2024-09-19T09:23:04.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.936+0000 7fe0fe7fc640 1 -- 172.21.15.18:0/1548216751 >> v2:172.21.15.162:3300/0 conn(0x7fe10006d730 msgr2=0x7fe1000b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:04.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.936+0000 7fe0fe7fc640 1 --2- 172.21.15.18:0/1548216751 >> v2:172.21.15.162:3300/0 conn(0x7fe10006d730 0x7fe1000b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.936+0000 7fe0fe7fc640 1 -- 172.21.15.18:0/1548216751 >> v1:172.21.15.162:6789/0 conn(0x7fe1000cfae0 legacy=0x7fe1000cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:04.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.936+0000 7fe0fe7fc640 1 -- 172.21.15.18:0/1548216751 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10006df10 con 0x7fe10015ef80 2024-09-19T09:23:04.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.936+0000 7fe0fe7fc640 1 -- 172.21.15.18:0/1548216751 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fe0e8001670 con 0x7fe10015ef80 2024-09-19T09:23:04.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.936+0000 7fe0fe7fc640 1 -- 172.21.15.18:0/1548216751 >> v1:172.21.15.18:6789/0 conn(0x7fe10015ef80 legacy=0x7fe1000cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:04.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.937+0000 7fe0fe7fc640 1 --2- 172.21.15.18:0/1548216751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0ec0039b0 0x7fe0ec003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.937+0000 7fe0fe7fc640 1 --2- 172.21.15.18:0/1548216751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0ec004800 0x7fe0ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.937+0000 7fe0fe7fc640 1 --2- 172.21.15.18:0/1548216751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0ec0051c0 0x7fe0ec00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.937+0000 7fe0fe7fc640 1 -- 172.21.15.18:0/1548216751 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe1000cd7d0 con 0x7fe0ec0039b0 2024-09-19T09:23:04.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.937+0000 7fe0fe7fc640 1 -- 172.21.15.18:0/1548216751 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe0ec00c060 con 0x7fe0ec0051c0 2024-09-19T09:23:04.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.937+0000 7fe0fe7fc640 1 -- 172.21.15.18:0/1548216751 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe0ec00c260 con 0x7fe0ec004800 2024-09-19T09:23:04.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.937+0000 7fe0ff7fe640 1 --2- 172.21.15.18:0/1548216751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0ec0039b0 0x7fe0ec003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.937+0000 7fe0fffff640 1 --2- 172.21.15.18:0/1548216751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0ec0051c0 0x7fe0ec00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.937+0000 7fe0feffd640 1 --2- 172.21.15.18:0/1548216751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0ec004800 0x7fe0ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.937+0000 7fe0ff7fe640 1 -- 172.21.15.18:0/1548216751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0ec004800 msgr2=0x7fe0ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:04.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.937+0000 7fe0ff7fe640 1 --2- 172.21.15.18:0/1548216751 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe0ec004800 0x7fe0ec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.937+0000 7fe0ff7fe640 1 -- 172.21.15.18:0/1548216751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0ec0051c0 msgr2=0x7fe0ec00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:04.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.937+0000 7fe0ff7fe640 1 --2- 172.21.15.18:0/1548216751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0ec0051c0 0x7fe0ec00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.937+0000 7fe0ff7fe640 1 -- 172.21.15.18:0/1548216751 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0ec003520 con 0x7fe0ec0039b0 2024-09-19T09:23:04.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.937+0000 7fe0fffff640 1 --2- 172.21.15.18:0/1548216751 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0ec0051c0 0x7fe0ec00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:04.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.937+0000 7fe0fffff640 1 -- 172.21.15.18:0/1548216751 reap_dead start 2024-09-19T09:23:04.942 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.938+0000 7fe0ff7fe640 1 --2- 172.21.15.18:0/1548216751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0ec0039b0 0x7fe0ec003dd0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fe0e800c210 tx=0x7fe0ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42859dcc1a604bcd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:04.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.938+0000 7fe0fe7fc640 1 -- 172.21.15.18:0/1548216751 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e8007d30 con 0x7fe0ec0039b0 2024-09-19T09:23:04.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.938+0000 7fe0fe7fc640 1 -- 172.21.15.18:0/1548216751 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0e80058d0 con 0x7fe0ec0039b0 2024-09-19T09:23:04.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.938+0000 7fe0fe7fc640 1 -- 172.21.15.18:0/1548216751 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e8005d20 con 0x7fe0ec0039b0 2024-09-19T09:23:04.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.938+0000 7fe105f49640 1 -- 172.21.15.18:0/1548216751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0ec0039b0 msgr2=0x7fe0ec003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:04.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.938+0000 7fe105f49640 1 --2- 172.21.15.18:0/1548216751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0ec0039b0 0x7fe0ec003dd0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fe0e800c210 tx=0x7fe0ec005830 comp rx=0 tx=0).stop 2024-09-19T09:23:04.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.938+0000 7fe105f49640 1 -- 172.21.15.18:0/1548216751 shutdown_connections 2024-09-19T09:23:04.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.938+0000 7fe105f49640 1 --2- 172.21.15.18:0/1548216751 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0ec0039b0 0x7fe0ec003dd0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.938+0000 7fe105f49640 1 -- 172.21.15.18:0/1548216751 >> 172.21.15.18:0/1548216751 conn(0x7fe1000b4700 msgr2=0x7fe1000b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:04.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.938+0000 7fe105f49640 1 -- 172.21.15.18:0/1548216751 shutdown_connections 2024-09-19T09:23:04.943 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.938+0000 7fe105f49640 1 -- 172.21.15.18:0/1548216751 wait complete. 2024-09-19T09:23:04.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.940+0000 7fe105f49640 1 Processor -- start 2024-09-19T09:23:04.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.940+0000 7fe105f49640 1 -- start start 2024-09-19T09:23:04.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.941+0000 7fe105f49640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0ec0039b0 0x7fe10015db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.941+0000 7fe105f49640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1000ca630 0x7fe1000b8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.941+0000 7fe105f49640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1000cbc40 0x7fe1000cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.941+0000 7fe105f49640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe1000d0120 con 0x7fe0ec0039b0 2024-09-19T09:23:04.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.941+0000 7fe105f49640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe10015f360 con 0x7fe1000ca630 2024-09-19T09:23:04.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.941+0000 7fe105f49640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe1000b5220 con 0x7fe1000cbc40 2024-09-19T09:23:04.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.941+0000 7fe0ff7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0ec0039b0 0x7fe10015db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.946 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.941+0000 7fe0ff7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0ec0039b0 0x7fe10015db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51438/0 (socket says 172.21.15.18:51438) 2024-09-19T09:23:04.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.941+0000 7fe0ff7fe640 1 -- 172.21.15.18:0/454186812 learned_addr learned my addr 172.21.15.18:0/454186812 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:23:04.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.941+0000 7fe0feffd640 1 --2- 172.21.15.18:0/454186812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1000ca630 0x7fe1000b8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.941+0000 7fe0fffff640 1 --2- 172.21.15.18:0/454186812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1000cbc40 0x7fe1000cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.941+0000 7fe0ff7fe640 1 -- 172.21.15.18:0/454186812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1000cbc40 msgr2=0x7fe1000cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:04.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.941+0000 7fe0ff7fe640 1 --2- 172.21.15.18:0/454186812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1000cbc40 0x7fe1000cc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.941+0000 7fe0ff7fe640 1 -- 172.21.15.18:0/454186812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1000ca630 msgr2=0x7fe1000b8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:04.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.941+0000 7fe0ff7fe640 1 --2- 172.21.15.18:0/454186812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1000ca630 0x7fe1000b8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:04.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.941+0000 7fe0ff7fe640 1 -- 172.21.15.18:0/454186812 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10015e070 con 0x7fe0ec0039b0 2024-09-19T09:23:04.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.941+0000 7fe0ff7fe640 1 --2- 172.21.15.18:0/454186812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0ec0039b0 0x7fe10015db30 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fe0e800c330 tx=0x7fe0e8001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:04.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.941+0000 7fe0f7fff640 1 -- 172.21.15.18:0/454186812 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e8007d30 con 0x7fe0ec0039b0 2024-09-19T09:23:04.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.941+0000 7fe0f7fff640 1 -- 172.21.15.18:0/454186812 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0e8041070 con 0x7fe0ec0039b0 2024-09-19T09:23:04.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.941+0000 7fe105f49640 1 -- 172.21.15.18:0/454186812 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1000caaf0 con 0x7fe0ec0039b0 2024-09-19T09:23:04.947 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.941+0000 7fe0f7fff640 1 -- 172.21.15.18:0/454186812 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0e8004c10 con 0x7fe0ec0039b0 2024-09-19T09:23:04.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.942+0000 7fe105f49640 1 -- 172.21.15.18:0/454186812 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1000cb0b0 con 0x7fe0ec0039b0 2024-09-19T09:23:04.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.943+0000 7fe105f49640 1 -- 172.21.15.18:0/454186812 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1000b5550 con 0x7fe0ec0039b0 2024-09-19T09:23:04.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.943+0000 7fe0f7fff640 1 -- 172.21.15.18:0/454186812 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe0e803b070 con 0x7fe0ec0039b0 2024-09-19T09:23:04.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.943+0000 7fe0f7fff640 1 --2- 172.21.15.18:0/454186812 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe0e006c2e0 0x7fe0e006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:04.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.944+0000 7fe0f7fff640 1 -- 172.21.15.18:0/454186812 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7fe0e80aaa20 con 0x7fe0ec0039b0 2024-09-19T09:23:04.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.944+0000 7fe0feffd640 1 --2- 172.21.15.18:0/454186812 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe0e006c2e0 0x7fe0e006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:04.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.944+0000 7fe0feffd640 1 --2- 172.21.15.18:0/454186812 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe0e006c2e0 0x7fe0e006e7a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe1000a0f40 tx=0x7fe0f0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:04.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:04.948+0000 7fe0f7fff640 1 -- 172.21.15.18:0/454186812 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe0e8078bd0 con 0x7fe0ec0039b0 2024-09-19T09:23:05.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.124+0000 7fe105f49640 1 -- 172.21.15.18:0/454186812 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe1000cff00 con 0x7fe0ec0039b0 2024-09-19T09:23:05.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.125+0000 7fe0f7fff640 1 -- 172.21.15.18:0/454186812 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) ==== 74+0+16752 (secure 0 0 0) 0x7fe0e807ced0 con 0x7fe0ec0039b0 2024-09-19T09:23:05.127 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:23:05.127 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":167,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:23:02.439115+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:22:58.457161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-19T09:22:59.786310+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:23:05.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.127+0000 7fe105f49640 1 -- 172.21.15.18:0/454186812 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe0e006c2e0 msgr2=0x7fe0e006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.127+0000 7fe105f49640 1 --2- 172.21.15.18:0/454186812 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe0e006c2e0 0x7fe0e006e7a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe1000a0f40 tx=0x7fe0f0009040 comp rx=0 tx=0).stop 2024-09-19T09:23:05.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.127+0000 7fe105f49640 1 -- 172.21.15.18:0/454186812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0ec0039b0 msgr2=0x7fe10015db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.127+0000 7fe105f49640 1 --2- 172.21.15.18:0/454186812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0ec0039b0 0x7fe10015db30 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fe0e800c330 tx=0x7fe0e8001a40 comp rx=0 tx=0).stop 2024-09-19T09:23:05.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.127+0000 7fe105f49640 1 -- 172.21.15.18:0/454186812 shutdown_connections 2024-09-19T09:23:05.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.127+0000 7fe105f49640 1 --2- 172.21.15.18:0/454186812 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe0e006c2e0 0x7fe0e006e7a0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.127+0000 7fe105f49640 1 --2- 172.21.15.18:0/454186812 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe1000cbc40 0x7fe1000cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.127+0000 7fe105f49640 1 --2- 172.21.15.18:0/454186812 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe1000ca630 0x7fe1000b8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.127+0000 7fe105f49640 1 --2- 172.21.15.18:0/454186812 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe0ec0039b0 0x7fe10015db30 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.127+0000 7fe105f49640 1 -- 172.21.15.18:0/454186812 >> 172.21.15.18:0/454186812 conn(0x7fe1000b4700 msgr2=0x7fe1000cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:05.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.127+0000 7fe105f49640 1 -- 172.21.15.18:0/454186812 shutdown_connections 2024-09-19T09:23:05.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.127+0000 7fe105f49640 1 -- 172.21.15.18:0/454186812 wait complete. 2024-09-19T09:23:05.141 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T09:23:05.141 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:23:05.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.242+0000 7f34d34f8640 1 Processor -- start 2024-09-19T09:23:05.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.242+0000 7f34d34f8640 1 -- start start 2024-09-19T09:23:05.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.243+0000 7f34d34f8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f34cc145290 0x7f34cc06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.243+0000 7f34d34f8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34cc0ce780 0x7f34cc072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.243+0000 7f34d34f8640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34cc06e3d0 con 0x7f34cc071510 2024-09-19T09:23:05.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.243+0000 7f34d34f8640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f34cc06efe0 con 0x7f34cc145290 2024-09-19T09:23:05.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.243+0000 7f34d34f8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f34cc06e6b0 con 0x7f34cc0ce780 2024-09-19T09:23:05.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.243+0000 7f34d0a93640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34cc0ce780 0x7f34cc072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.243+0000 7f34d1294640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f34cc145290 0x7f34cc06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.243+0000 7f34d1a95640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f34cc071510 0x7f34cc0b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:50992/0 (socket says 172.21.15.18:50992) 2024-09-19T09:23:05.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.243+0000 7f34d1a95640 1 -- 172.21.15.18:0/1303534258 learned_addr learned my addr 172.21.15.18:0/1303534258 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:23:05.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.244+0000 7f34d0a93640 1 -- 172.21.15.18:0/1303534258 >> v2:172.21.15.162:3300/0 conn(0x7f34cc145290 msgr2=0x7f34cc06f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:05.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.244+0000 7f34d0a93640 1 --2- 172.21.15.18:0/1303534258 >> v2:172.21.15.162:3300/0 conn(0x7f34cc145290 0x7f34cc06f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.244+0000 7f34d0a93640 1 -- 172.21.15.18:0/1303534258 >> v1:172.21.15.162:6789/0 conn(0x7f34cc071510 legacy=0x7f34cc0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.244+0000 7f34d0a93640 1 -- 172.21.15.18:0/1303534258 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34cc06e990 con 0x7f34cc0ce780 2024-09-19T09:23:05.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.244+0000 7f34d0a93640 1 --2- 172.21.15.18:0/1303534258 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34cc0ce780 0x7f34cc072830 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f34bc0097a0 tx=0x7f34bc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52a43ab0ed82e588 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:05.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.245+0000 7f34c3fff640 1 -- 172.21.15.18:0/1303534258 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34bc037070 con 0x7f34cc0ce780 2024-09-19T09:23:05.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.245+0000 7f34c3fff640 1 -- 172.21.15.18:0/1303534258 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34bc032440 con 0x7f34cc0ce780 2024-09-19T09:23:05.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.245+0000 7f34c3fff640 1 -- 172.21.15.18:0/1303534258 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34bc032810 con 0x7f34cc0ce780 2024-09-19T09:23:05.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.245+0000 7f34d34f8640 1 -- 172.21.15.18:0/1303534258 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34cc0ce780 msgr2=0x7f34cc072830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.245+0000 7f34d34f8640 1 --2- 172.21.15.18:0/1303534258 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34cc0ce780 0x7f34cc072830 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f34bc0097a0 tx=0x7f34bc02a180 comp rx=0 tx=0).stop 2024-09-19T09:23:05.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.245+0000 7f34d34f8640 1 -- 172.21.15.18:0/1303534258 shutdown_connections 2024-09-19T09:23:05.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.245+0000 7f34d34f8640 1 --2- 172.21.15.18:0/1303534258 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34cc0ce780 0x7f34cc072830 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.245+0000 7f34d34f8640 1 --2- 172.21.15.18:0/1303534258 >> v2:172.21.15.162:3300/0 conn(0x7f34cc145290 0x7f34cc06f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.245+0000 7f34d34f8640 1 -- 172.21.15.18:0/1303534258 >> 172.21.15.18:0/1303534258 conn(0x7f34cc06bc10 msgr2=0x7f34cc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:05.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.245+0000 7f34d34f8640 1 -- 172.21.15.18:0/1303534258 shutdown_connections 2024-09-19T09:23:05.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.245+0000 7f34d34f8640 1 -- 172.21.15.18:0/1303534258 wait complete. 2024-09-19T09:23:05.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.246+0000 7f34d34f8640 1 Processor -- start 2024-09-19T09:23:05.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.246+0000 7f34d34f8640 1 -- start start 2024-09-19T09:23:05.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.247+0000 7f34d34f8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34cc071510 0x7f34cc15ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.247+0000 7f34d34f8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34cc0ce780 0x7f34cc1f2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.247+0000 7f34d34f8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34cc145290 0x7f34cc1e52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.247+0000 7f34d34f8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc06df80 con 0x7f34cc0ce780 2024-09-19T09:23:05.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.247+0000 7f34d34f8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f34cc145670 con 0x7f34cc145290 2024-09-19T09:23:05.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.247+0000 7f34d34f8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f34cc06e100 con 0x7f34cc071510 2024-09-19T09:23:05.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.247+0000 7f34d0a93640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34cc0ce780 0x7f34cc1f2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.247+0000 7f34d0a93640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34cc0ce780 0x7f34cc1f2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51442/0 (socket says 172.21.15.18:51442) 2024-09-19T09:23:05.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.247+0000 7f34d0a93640 1 -- 172.21.15.18:0/3166940608 learned_addr learned my addr 172.21.15.18:0/3166940608 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:23:05.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.247+0000 7f34d1294640 1 --2- 172.21.15.18:0/3166940608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34cc071510 0x7f34cc15ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.247+0000 7f34d1a95640 1 --2- 172.21.15.18:0/3166940608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34cc145290 0x7f34cc1e52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.248+0000 7f34d0a93640 1 -- 172.21.15.18:0/3166940608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34cc071510 msgr2=0x7f34cc15ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.248+0000 7f34d0a93640 1 --2- 172.21.15.18:0/3166940608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34cc071510 0x7f34cc15ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.248+0000 7f34d0a93640 1 -- 172.21.15.18:0/3166940608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34cc145290 msgr2=0x7f34cc1e52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.248+0000 7f34d0a93640 1 --2- 172.21.15.18:0/3166940608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34cc145290 0x7f34cc1e52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.248+0000 7f34d0a93640 1 -- 172.21.15.18:0/3166940608 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34cc15b3b0 con 0x7f34cc0ce780 2024-09-19T09:23:05.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.248+0000 7f34d0a93640 1 --2- 172.21.15.18:0/3166940608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34cc0ce780 0x7f34cc1f2b30 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f34bc035040 tx=0x7f34bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:05.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.248+0000 7f34c1ffb640 1 -- 172.21.15.18:0/3166940608 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34bc037040 con 0x7f34cc0ce780 2024-09-19T09:23:05.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.248+0000 7f34c1ffb640 1 -- 172.21.15.18:0/3166940608 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34bc030500 con 0x7f34cc0ce780 2024-09-19T09:23:05.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.248+0000 7f34d34f8640 1 -- 172.21.15.18:0/3166940608 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34cc142f60 con 0x7f34cc0ce780 2024-09-19T09:23:05.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.248+0000 7f34c1ffb640 1 -- 172.21.15.18:0/3166940608 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34bc030910 con 0x7f34cc0ce780 2024-09-19T09:23:05.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.248+0000 7f34d34f8640 1 -- 172.21.15.18:0/3166940608 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34cc143520 con 0x7f34cc0ce780 2024-09-19T09:23:05.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.249+0000 7f34d34f8640 1 -- 172.21.15.18:0/3166940608 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34cc06f470 con 0x7f34cc0ce780 2024-09-19T09:23:05.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.250+0000 7f34c1ffb640 1 -- 172.21.15.18:0/3166940608 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f34bc044020 con 0x7f34cc0ce780 2024-09-19T09:23:05.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.250+0000 7f34c1ffb640 1 --2- 172.21.15.18:0/3166940608 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f34b006c2b0 0x7f34b006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.250+0000 7f34c1ffb640 1 -- 172.21.15.18:0/3166940608 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f34bc0ab600 con 0x7f34cc0ce780 2024-09-19T09:23:05.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.250+0000 7f34d1294640 1 --2- 172.21.15.18:0/3166940608 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f34b006c2b0 0x7f34b006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.251+0000 7f34d1294640 1 --2- 172.21.15.18:0/3166940608 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f34b006c2b0 0x7f34b006e770 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009b40 tx=0x7f34c8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:05.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.254+0000 7f34c1ffb640 1 -- 172.21.15.18:0/3166940608 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f34bc0796a0 con 0x7f34cc0ce780 2024-09-19T09:23:05.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.424+0000 7f34d34f8640 1 -- 172.21.15.18:0/3166940608 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f34cc13f250 con 0x7f34b006c2b0 2024-09-19T09:23:05.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.432+0000 7f34c1ffb640 1 -- 172.21.15.18:0/3166940608 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247921 (secure 0 0 0) 0x7f34cc13f250 con 0x7f34b006c2b0 2024-09-19T09:23:05.435 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:23:05.437 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:23:05.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.434+0000 7f34d34f8640 1 -- 172.21.15.18:0/3166940608 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f34b006c2b0 msgr2=0x7f34b006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.434+0000 7f34d34f8640 1 --2- 172.21.15.18:0/3166940608 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f34b006c2b0 0x7f34b006e770 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f34c8009b40 tx=0x7f34c8009190 comp rx=0 tx=0).stop 2024-09-19T09:23:05.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.434+0000 7f34d34f8640 1 -- 172.21.15.18:0/3166940608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34cc0ce780 msgr2=0x7f34cc1f2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.434+0000 7f34d34f8640 1 --2- 172.21.15.18:0/3166940608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34cc0ce780 0x7f34cc1f2b30 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f34bc035040 tx=0x7f34bc0046c0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.434+0000 7f34d34f8640 1 -- 172.21.15.18:0/3166940608 shutdown_connections 2024-09-19T09:23:05.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.434+0000 7f34d34f8640 1 --2- 172.21.15.18:0/3166940608 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f34b006c2b0 0x7f34b006e770 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.434+0000 7f34d34f8640 1 --2- 172.21.15.18:0/3166940608 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34cc145290 0x7f34cc1e52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.434+0000 7f34d34f8640 1 --2- 172.21.15.18:0/3166940608 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f34cc0ce780 0x7f34cc1f2b30 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.434+0000 7f34d34f8640 1 --2- 172.21.15.18:0/3166940608 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f34cc071510 0x7f34cc15ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.434+0000 7f34d34f8640 1 -- 172.21.15.18:0/3166940608 >> 172.21.15.18:0/3166940608 conn(0x7f34cc06bc10 msgr2=0x7f34cc15e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:05.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.434+0000 7f34d34f8640 1 -- 172.21.15.18:0/3166940608 shutdown_connections 2024-09-19T09:23:05.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.434+0000 7f34d34f8640 1 -- 172.21.15.18:0/3166940608 wait complete. 2024-09-19T09:23:05.447 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":452,"stamp":"2024-09-19T09:23:03.665659+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":63,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8351,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554148,"statfs":{"total":1600000000,"available":1591447624,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.232922"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.448715+0000","last_change":"2024-09-19T09:23:01.448588+0000","last_active":"2024-09-19T09:23:01.448715+0000","last_peered":"2024-09-19T09:23:01.448715+0000","last_clean":"2024-09-19T09:23:01.448715+0000","last_became_active":"2024-09-19T09:23:01.448302+0000","last_became_peered":"2024-09-19T09:23:01.448302+0000","last_unstale":"2024-09-19T09:23:01.448715+0000","last_undegraded":"2024-09-19T09:23:01.448715+0000","last_fullsized":"2024-09-19T09:23:01.448715+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:08.537674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.453038+0000","last_change":"2024-09-19T09:23:01.452913+0000","last_active":"2024-09-19T09:23:01.453038+0000","last_peered":"2024-09-19T09:23:01.453038+0000","last_clean":"2024-09-19T09:23:01.453038+0000","last_became_active":"2024-09-19T09:23:01.452700+0000","last_became_peered":"2024-09-19T09:23:01.452700+0000","last_unstale":"2024-09-19T09:23:01.453038+0000","last_undegraded":"2024-09-19T09:23:01.453038+0000","last_fullsized":"2024-09-19T09:23:01.453038+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:03.876859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.457992+0000","last_change":"2024-09-19T09:23:01.453706+0000","last_active":"2024-09-19T09:23:01.457992+0000","last_peered":"2024-09-19T09:23:01.457992+0000","last_clean":"2024-09-19T09:23:01.457992+0000","last_became_active":"2024-09-19T09:23:01.453473+0000","last_became_peered":"2024-09-19T09:23:01.453473+0000","last_unstale":"2024-09-19T09:23:01.457992+0000","last_undegraded":"2024-09-19T09:23:01.457992+0000","last_fullsized":"2024-09-19T09:23:01.457992+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:54.235458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.445197+0000","last_change":"2024-09-19T09:23:01.445083+0000","last_active":"2024-09-19T09:23:01.445197+0000","last_peered":"2024-09-19T09:23:01.445197+0000","last_clean":"2024-09-19T09:23:01.445197+0000","last_became_active":"2024-09-19T09:23:01.444807+0000","last_became_peered":"2024-09-19T09:23:01.444807+0000","last_unstale":"2024-09-19T09:23:01.445197+0000","last_undegraded":"2024-09-19T09:23:01.445197+0000","last_fullsized":"2024-09-19T09:23:01.445197+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:40.289429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.455907+0000","last_change":"2024-09-19T09:23:01.455581+0000","last_active":"2024-09-19T09:23:01.455907+0000","last_peered":"2024-09-19T09:23:01.455907+0000","last_clean":"2024-09-19T09:23:01.455907+0000","last_became_active":"2024-09-19T09:23:01.454581+0000","last_became_peered":"2024-09-19T09:23:01.454581+0000","last_unstale":"2024-09-19T09:23:01.455907+0000","last_undegraded":"2024-09-19T09:23:01.455907+0000","last_fullsized":"2024-09-19T09:23:01.455907+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:30.688211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.452921+0000","last_change":"2024-09-19T09:23:01.452797+0000","last_active":"2024-09-19T09:23:01.452921+0000","last_peered":"2024-09-19T09:23:01.452921+0000","last_clean":"2024-09-19T09:23:01.452921+0000","last_became_active":"2024-09-19T09:23:01.452576+0000","last_became_peered":"2024-09-19T09:23:01.452576+0000","last_unstale":"2024-09-19T09:23:01.452921+0000","last_undegraded":"2024-09-19T09:23:01.452921+0000","last_fullsized":"2024-09-19T09:23:01.452921+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:24.250360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.461216+0000","last_change":"2024-09-19T09:23:01.461087+0000","last_active":"2024-09-19T09:23:01.461216+0000","last_peered":"2024-09-19T09:23:01.461216+0000","last_clean":"2024-09-19T09:23:01.461216+0000","last_became_active":"2024-09-19T09:23:01.460845+0000","last_became_peered":"2024-09-19T09:23:01.460845+0000","last_unstale":"2024-09-19T09:23:01.461216+0000","last_undegraded":"2024-09-19T09:23:01.461216+0000","last_fullsized":"2024-09-19T09:23:01.461216+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:13.946602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.454684+0000","last_change":"2024-09-19T09:23:01.454370+0000","last_active":"2024-09-19T09:23:01.454684+0000","last_peered":"2024-09-19T09:23:01.454684+0000","last_clean":"2024-09-19T09:23:01.454684+0000","last_became_active":"2024-09-19T09:23:01.454110+0000","last_became_peered":"2024-09-19T09:23:01.454110+0000","last_unstale":"2024-09-19T09:23:01.454684+0000","last_undegraded":"2024-09-19T09:23:01.454684+0000","last_fullsized":"2024-09-19T09:23:01.454684+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:27.810256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.451962+0000","last_change":"2024-09-19T09:23:01.451764+0000","last_active":"2024-09-19T09:23:01.451962+0000","last_peered":"2024-09-19T09:23:01.451962+0000","last_clean":"2024-09-19T09:23:01.451962+0000","last_became_active":"2024-09-19T09:23:01.451536+0000","last_became_peered":"2024-09-19T09:23:01.451536+0000","last_unstale":"2024-09-19T09:23:01.451962+0000","last_undegraded":"2024-09-19T09:23:01.451962+0000","last_fullsized":"2024-09-19T09:23:01.451962+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:29.559064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.458680+0000","last_change":"2024-09-19T09:23:01.458558+0000","last_active":"2024-09-19T09:23:01.458680+0000","last_peered":"2024-09-19T09:23:01.458680+0000","last_clean":"2024-09-19T09:23:01.458680+0000","last_became_active":"2024-09-19T09:23:01.458296+0000","last_became_peered":"2024-09-19T09:23:01.458296+0000","last_unstale":"2024-09-19T09:23:01.458680+0000","last_undegraded":"2024-09-19T09:23:01.458680+0000","last_fullsized":"2024-09-19T09:23:01.458680+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:48.979585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.459061+0000","last_change":"2024-09-19T09:23:01.458498+0000","last_active":"2024-09-19T09:23:01.459061+0000","last_peered":"2024-09-19T09:23:01.459061+0000","last_clean":"2024-09-19T09:23:01.459061+0000","last_became_active":"2024-09-19T09:23:01.458176+0000","last_became_peered":"2024-09-19T09:23:01.458176+0000","last_unstale":"2024-09-19T09:23:01.459061+0000","last_undegraded":"2024-09-19T09:23:01.459061+0000","last_fullsized":"2024-09-19T09:23:01.459061+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:45.306053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.450730+0000","last_change":"2024-09-19T09:23:01.450592+0000","last_active":"2024-09-19T09:23:01.450730+0000","last_peered":"2024-09-19T09:23:01.450730+0000","last_clean":"2024-09-19T09:23:01.450730+0000","last_became_active":"2024-09-19T09:23:01.450359+0000","last_became_peered":"2024-09-19T09:23:01.450359+0000","last_unstale":"2024-09-19T09:23:01.450730+0000","last_undegraded":"2024-09-19T09:23:01.450730+0000","last_fullsized":"2024-09-19T09:23:01.450730+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:46.813607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.456928+0000","last_change":"2024-09-19T09:23:01.456612+0000","last_active":"2024-09-19T09:23:01.456928+0000","last_peered":"2024-09-19T09:23:01.456928+0000","last_clean":"2024-09-19T09:23:01.456928+0000","last_became_active":"2024-09-19T09:23:01.456374+0000","last_became_peered":"2024-09-19T09:23:01.456374+0000","last_unstale":"2024-09-19T09:23:01.456928+0000","last_undegraded":"2024-09-19T09:23:01.456928+0000","last_fullsized":"2024-09-19T09:23:01.456928+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:36:45.381197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.463254+0000","last_change":"2024-09-19T09:23:01.462920+0000","last_active":"2024-09-19T09:23:01.463254+0000","last_peered":"2024-09-19T09:23:01.463254+0000","last_clean":"2024-09-19T09:23:01.463254+0000","last_became_active":"2024-09-19T09:23:01.462621+0000","last_became_peered":"2024-09-19T09:23:01.462621+0000","last_unstale":"2024-09-19T09:23:01.463254+0000","last_undegraded":"2024-09-19T09:23:01.463254+0000","last_fullsized":"2024-09-19T09:23:01.463254+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:26:53.629801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.456001+0000","last_change":"2024-09-19T09:23:01.455815+0000","last_active":"2024-09-19T09:23:01.456001+0000","last_peered":"2024-09-19T09:23:01.456001+0000","last_clean":"2024-09-19T09:23:01.456001+0000","last_became_active":"2024-09-19T09:23:01.454966+0000","last_became_peered":"2024-09-19T09:23:01.454966+0000","last_unstale":"2024-09-19T09:23:01.456001+0000","last_undegraded":"2024-09-19T09:23:01.456001+0000","last_fullsized":"2024-09-19T09:23:01.456001+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:59.250509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.453778+0000","last_change":"2024-09-19T09:23:01.453666+0000","last_active":"2024-09-19T09:23:01.453778+0000","last_peered":"2024-09-19T09:23:01.453778+0000","last_clean":"2024-09-19T09:23:01.453778+0000","last_became_active":"2024-09-19T09:23:01.453419+0000","last_became_peered":"2024-09-19T09:23:01.453419+0000","last_unstale":"2024-09-19T09:23:01.453778+0000","last_undegraded":"2024-09-19T09:23:01.453778+0000","last_fullsized":"2024-09-19T09:23:01.453778+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:29.832541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.446613+0000","last_change":"2024-09-19T09:23:01.446484+0000","last_active":"2024-09-19T09:23:01.446613+0000","last_peered":"2024-09-19T09:23:01.446613+0000","last_clean":"2024-09-19T09:23:01.446613+0000","last_became_active":"2024-09-19T09:23:01.446169+0000","last_became_peered":"2024-09-19T09:23:01.446169+0000","last_unstale":"2024-09-19T09:23:01.446613+0000","last_undegraded":"2024-09-19T09:23:01.446613+0000","last_fullsized":"2024-09-19T09:23:01.446613+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:31.255126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.460032+0000","last_change":"2024-09-19T09:23:01.459553+0000","last_active":"2024-09-19T09:23:01.460032+0000","last_peered":"2024-09-19T09:23:01.460032+0000","last_clean":"2024-09-19T09:23:01.460032+0000","last_became_active":"2024-09-19T09:23:01.459305+0000","last_became_peered":"2024-09-19T09:23:01.459305+0000","last_unstale":"2024-09-19T09:23:01.460032+0000","last_undegraded":"2024-09-19T09:23:01.460032+0000","last_fullsized":"2024-09-19T09:23:01.460032+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:21.168161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.451907+0000","last_change":"2024-09-19T09:23:01.451779+0000","last_active":"2024-09-19T09:23:01.451907+0000","last_peered":"2024-09-19T09:23:01.451907+0000","last_clean":"2024-09-19T09:23:01.451907+0000","last_became_active":"2024-09-19T09:23:01.451552+0000","last_became_peered":"2024-09-19T09:23:01.451552+0000","last_unstale":"2024-09-19T09:23:01.451907+0000","last_undegraded":"2024-09-19T09:23:01.451907+0000","last_fullsized":"2024-09-19T09:23:01.451907+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:41.464147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.460080+0000","last_change":"2024-09-19T09:23:01.459957+0000","last_active":"2024-09-19T09:23:01.460080+0000","last_peered":"2024-09-19T09:23:01.460080+0000","last_clean":"2024-09-19T09:23:01.460080+0000","last_became_active":"2024-09-19T09:23:01.459716+0000","last_became_peered":"2024-09-19T09:23:01.459716+0000","last_unstale":"2024-09-19T09:23:01.460080+0000","last_undegraded":"2024-09-19T09:23:01.460080+0000","last_fullsized":"2024-09-19T09:23:01.460080+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:02:14.480411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.446951+0000","last_change":"2024-09-19T09:23:01.446824+0000","last_active":"2024-09-19T09:23:01.446951+0000","last_peered":"2024-09-19T09:23:01.446951+0000","last_clean":"2024-09-19T09:23:01.446951+0000","last_became_active":"2024-09-19T09:23:01.445986+0000","last_became_peered":"2024-09-19T09:23:01.445986+0000","last_unstale":"2024-09-19T09:23:01.446951+0000","last_undegraded":"2024-09-19T09:23:01.446951+0000","last_fullsized":"2024-09-19T09:23:01.446951+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:03.266222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.454954+0000","last_change":"2024-09-19T09:23:01.454696+0000","last_active":"2024-09-19T09:23:01.454954+0000","last_peered":"2024-09-19T09:23:01.454954+0000","last_clean":"2024-09-19T09:23:01.454954+0000","last_became_active":"2024-09-19T09:23:01.454218+0000","last_became_peered":"2024-09-19T09:23:01.454218+0000","last_unstale":"2024-09-19T09:23:01.454954+0000","last_undegraded":"2024-09-19T09:23:01.454954+0000","last_fullsized":"2024-09-19T09:23:01.454954+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:54:48.733829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.453913+0000","last_change":"2024-09-19T09:23:01.453564+0000","last_active":"2024-09-19T09:23:01.453913+0000","last_peered":"2024-09-19T09:23:01.453913+0000","last_clean":"2024-09-19T09:23:01.453913+0000","last_became_active":"2024-09-19T09:23:01.452567+0000","last_became_peered":"2024-09-19T09:23:01.452567+0000","last_unstale":"2024-09-19T09:23:01.453913+0000","last_undegraded":"2024-09-19T09:23:01.453913+0000","last_fullsized":"2024-09-19T09:23:01.453913+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:45.929874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.454138+0000","last_change":"2024-09-19T09:23:01.453072+0000","last_active":"2024-09-19T09:23:01.454138+0000","last_peered":"2024-09-19T09:23:01.454138+0000","last_clean":"2024-09-19T09:23:01.454138+0000","last_became_active":"2024-09-19T09:23:01.452793+0000","last_became_peered":"2024-09-19T09:23:01.452793+0000","last_unstale":"2024-09-19T09:23:01.454138+0000","last_undegraded":"2024-09-19T09:23:01.454138+0000","last_fullsized":"2024-09-19T09:23:01.454138+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:08:54.734642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.455308+0000","last_change":"2024-09-19T09:23:01.454729+0000","last_active":"2024-09-19T09:23:01.455308+0000","last_peered":"2024-09-19T09:23:01.455308+0000","last_clean":"2024-09-19T09:23:01.455308+0000","last_became_active":"2024-09-19T09:23:01.454112+0000","last_became_peered":"2024-09-19T09:23:01.454112+0000","last_unstale":"2024-09-19T09:23:01.455308+0000","last_undegraded":"2024-09-19T09:23:01.455308+0000","last_fullsized":"2024-09-19T09:23:01.455308+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:17.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.458113+0000","last_change":"2024-09-19T09:23:01.457997+0000","last_active":"2024-09-19T09:23:01.458113+0000","last_peered":"2024-09-19T09:23:01.458113+0000","last_clean":"2024-09-19T09:23:01.458113+0000","last_became_active":"2024-09-19T09:23:01.457621+0000","last_became_peered":"2024-09-19T09:23:01.457621+0000","last_unstale":"2024-09-19T09:23:01.458113+0000","last_undegraded":"2024-09-19T09:23:01.458113+0000","last_fullsized":"2024-09-19T09:23:01.458113+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:15.253786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.454371+0000","last_change":"2024-09-19T09:23:01.454252+0000","last_active":"2024-09-19T09:23:01.454371+0000","last_peered":"2024-09-19T09:23:01.454371+0000","last_clean":"2024-09-19T09:23:01.454371+0000","last_became_active":"2024-09-19T09:23:01.454020+0000","last_became_peered":"2024-09-19T09:23:01.454020+0000","last_unstale":"2024-09-19T09:23:01.454371+0000","last_undegraded":"2024-09-19T09:23:01.454371+0000","last_fullsized":"2024-09-19T09:23:01.454371+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:24.350049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.453057+0000","last_change":"2024-09-19T09:23:01.452913+0000","last_active":"2024-09-19T09:23:01.453057+0000","last_peered":"2024-09-19T09:23:01.453057+0000","last_clean":"2024-09-19T09:23:01.453057+0000","last_became_active":"2024-09-19T09:23:01.452670+0000","last_became_peered":"2024-09-19T09:23:01.452670+0000","last_unstale":"2024-09-19T09:23:01.453057+0000","last_undegraded":"2024-09-19T09:23:01.453057+0000","last_fullsized":"2024-09-19T09:23:01.453057+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:19.952758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.457921+0000","last_change":"2024-09-19T09:23:01.457786+0000","last_active":"2024-09-19T09:23:01.457921+0000","last_peered":"2024-09-19T09:23:01.457921+0000","last_clean":"2024-09-19T09:23:01.457921+0000","last_became_active":"2024-09-19T09:23:01.457360+0000","last_became_peered":"2024-09-19T09:23:01.457360+0000","last_unstale":"2024-09-19T09:23:01.457921+0000","last_undegraded":"2024-09-19T09:23:01.457921+0000","last_fullsized":"2024-09-19T09:23:01.457921+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:25.294390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.456500+0000","last_change":"2024-09-19T09:23:01.456392+0000","last_active":"2024-09-19T09:23:01.456500+0000","last_peered":"2024-09-19T09:23:01.456500+0000","last_clean":"2024-09-19T09:23:01.456500+0000","last_became_active":"2024-09-19T09:23:01.456001+0000","last_became_peered":"2024-09-19T09:23:01.456001+0000","last_unstale":"2024-09-19T09:23:01.456500+0000","last_undegraded":"2024-09-19T09:23:01.456500+0000","last_fullsized":"2024-09-19T09:23:01.456500+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:19.479919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.453591+0000","last_change":"2024-09-19T09:23:01.453475+0000","last_active":"2024-09-19T09:23:01.453591+0000","last_peered":"2024-09-19T09:23:01.453591+0000","last_clean":"2024-09-19T09:23:01.453591+0000","last_became_active":"2024-09-19T09:23:01.453258+0000","last_became_peered":"2024-09-19T09:23:01.453258+0000","last_unstale":"2024-09-19T09:23:01.453591+0000","last_undegraded":"2024-09-19T09:23:01.453591+0000","last_fullsized":"2024-09-19T09:23:01.453591+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:00.313206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.452378+0000","last_change":"2024-09-19T09:23:01.452267+0000","last_active":"2024-09-19T09:23:01.452378+0000","last_peered":"2024-09-19T09:23:01.452378+0000","last_clean":"2024-09-19T09:23:01.452378+0000","last_became_active":"2024-09-19T09:23:01.452028+0000","last_became_peered":"2024-09-19T09:23:01.452028+0000","last_unstale":"2024-09-19T09:23:01.452378+0000","last_undegraded":"2024-09-19T09:23:01.452378+0000","last_fullsized":"2024-09-19T09:23:01.452378+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:22.228773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.457310+0000","last_change":"2024-09-19T09:23:01.457186+0000","last_active":"2024-09-19T09:23:01.457310+0000","last_peered":"2024-09-19T09:23:01.457310+0000","last_clean":"2024-09-19T09:23:01.457310+0000","last_became_active":"2024-09-19T09:23:01.456932+0000","last_became_peered":"2024-09-19T09:23:01.456932+0000","last_unstale":"2024-09-19T09:23:01.457310+0000","last_undegraded":"2024-09-19T09:23:01.457310+0000","last_fullsized":"2024-09-19T09:23:01.457310+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:40.805087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"166'4","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.465042+0000","last_change":"2024-09-19T09:23:00.452733+0000","last_active":"2024-09-19T09:23:01.465042+0000","last_peered":"2024-09-19T09:23:01.465042+0000","last_clean":"2024-09-19T09:23:01.465042+0000","last_became_active":"2024-09-19T09:23:00.452495+0000","last_became_peered":"2024-09-19T09:23:00.452495+0000","last_unstale":"2024-09-19T09:23:01.465042+0000","last_undegraded":"2024-09-19T09:23:01.465042+0000","last_fullsized":"2024-09-19T09:23:01.465042+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:02:30.427609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.454175+0000","last_change":"2024-09-19T09:23:01.454004+0000","last_active":"2024-09-19T09:23:01.454175+0000","last_peered":"2024-09-19T09:23:01.454175+0000","last_clean":"2024-09-19T09:23:01.454175+0000","last_became_active":"2024-09-19T09:23:01.453562+0000","last_became_peered":"2024-09-19T09:23:01.453562+0000","last_unstale":"2024-09-19T09:23:01.454175+0000","last_undegraded":"2024-09-19T09:23:01.454175+0000","last_fullsized":"2024-09-19T09:23:01.454175+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:12:26.736049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.1e","version":"166'1","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.464247+0000","last_change":"2024-09-19T09:23:00.453927+0000","last_active":"2024-09-19T09:23:01.464247+0000","last_peered":"2024-09-19T09:23:01.464247+0000","last_clean":"2024-09-19T09:23:01.464247+0000","last_became_active":"2024-09-19T09:23:00.453031+0000","last_became_peered":"2024-09-19T09:23:00.453031+0000","last_unstale":"2024-09-19T09:23:01.464247+0000","last_undegraded":"2024-09-19T09:23:01.464247+0000","last_fullsized":"2024-09-19T09:23:01.464247+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:24.973657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.457420+0000","last_change":"2024-09-19T09:23:01.456996+0000","last_active":"2024-09-19T09:23:01.457420+0000","last_peered":"2024-09-19T09:23:01.457420+0000","last_clean":"2024-09-19T09:23:01.457420+0000","last_became_active":"2024-09-19T09:23:01.456153+0000","last_became_peered":"2024-09-19T09:23:01.456153+0000","last_unstale":"2024-09-19T09:23:01.457420+0000","last_undegraded":"2024-09-19T09:23:01.457420+0000","last_fullsized":"2024-09-19T09:23:01.457420+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:56:51.854083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.1d","version":"166'2","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.463157+0000","last_change":"2024-09-19T09:23:00.448028+0000","last_active":"2024-09-19T09:23:01.463157+0000","last_peered":"2024-09-19T09:23:01.463157+0000","last_clean":"2024-09-19T09:23:01.463157+0000","last_became_active":"2024-09-19T09:23:00.447774+0000","last_became_peered":"2024-09-19T09:23:00.447774+0000","last_unstale":"2024-09-19T09:23:01.463157+0000","last_undegraded":"2024-09-19T09:23:01.463157+0000","last_fullsized":"2024-09-19T09:23:01.463157+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:31.019005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.449184+0000","last_change":"2024-09-19T09:23:01.449061+0000","last_active":"2024-09-19T09:23:01.449184+0000","last_peered":"2024-09-19T09:23:01.449184+0000","last_clean":"2024-09-19T09:23:01.449184+0000","last_became_active":"2024-09-19T09:23:01.448795+0000","last_became_peered":"2024-09-19T09:23:01.448795+0000","last_unstale":"2024-09-19T09:23:01.449184+0000","last_undegraded":"2024-09-19T09:23:01.449184+0000","last_fullsized":"2024-09-19T09:23:01.449184+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:33.762091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1c","version":"166'2","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.460802+0000","last_change":"2024-09-19T09:23:00.449805+0000","last_active":"2024-09-19T09:23:01.460802+0000","last_peered":"2024-09-19T09:23:01.460802+0000","last_clean":"2024-09-19T09:23:01.460802+0000","last_became_active":"2024-09-19T09:23:00.449130+0000","last_became_peered":"2024-09-19T09:23:00.449130+0000","last_unstale":"2024-09-19T09:23:01.460802+0000","last_undegraded":"2024-09-19T09:23:01.460802+0000","last_fullsized":"2024-09-19T09:23:01.460802+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:17:35.860580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.451766+0000","last_change":"2024-09-19T09:23:01.451634+0000","last_active":"2024-09-19T09:23:01.451766+0000","last_peered":"2024-09-19T09:23:01.451766+0000","last_clean":"2024-09-19T09:23:01.451766+0000","last_became_active":"2024-09-19T09:23:01.451407+0000","last_became_peered":"2024-09-19T09:23:01.451407+0000","last_unstale":"2024-09-19T09:23:01.451766+0000","last_undegraded":"2024-09-19T09:23:01.451766+0000","last_fullsized":"2024-09-19T09:23:01.451766+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:58.471413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"166'1","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.464134+0000","last_change":"2024-09-19T09:23:00.453669+0000","last_active":"2024-09-19T09:23:01.464134+0000","last_peered":"2024-09-19T09:23:01.464134+0000","last_clean":"2024-09-19T09:23:01.464134+0000","last_became_active":"2024-09-19T09:23:00.453401+0000","last_became_peered":"2024-09-19T09:23:00.453401+0000","last_unstale":"2024-09-19T09:23:01.464134+0000","last_undegraded":"2024-09-19T09:23:01.464134+0000","last_fullsized":"2024-09-19T09:23:01.464134+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:32.892683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.447155+0000","last_change":"2024-09-19T09:23:01.447009+0000","last_active":"2024-09-19T09:23:01.447155+0000","last_peered":"2024-09-19T09:23:01.447155+0000","last_clean":"2024-09-19T09:23:01.447155+0000","last_became_active":"2024-09-19T09:23:01.446757+0000","last_became_peered":"2024-09-19T09:23:01.446757+0000","last_unstale":"2024-09-19T09:23:01.447155+0000","last_undegraded":"2024-09-19T09:23:01.447155+0000","last_fullsized":"2024-09-19T09:23:01.447155+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:04.793870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1a","version":"166'1","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.460428+0000","last_change":"2024-09-19T09:23:00.449654+0000","last_active":"2024-09-19T09:23:01.460428+0000","last_peered":"2024-09-19T09:23:01.460428+0000","last_clean":"2024-09-19T09:23:01.460428+0000","last_became_active":"2024-09-19T09:23:00.449217+0000","last_became_peered":"2024-09-19T09:23:00.449217+0000","last_unstale":"2024-09-19T09:23:01.460428+0000","last_undegraded":"2024-09-19T09:23:01.460428+0000","last_fullsized":"2024-09-19T09:23:01.460428+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:46.907132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.452406+0000","last_change":"2024-09-19T09:23:01.452320+0000","last_active":"2024-09-19T09:23:01.452406+0000","last_peered":"2024-09-19T09:23:01.452406+0000","last_clean":"2024-09-19T09:23:01.452406+0000","last_became_active":"2024-09-19T09:23:01.452096+0000","last_became_peered":"2024-09-19T09:23:01.452096+0000","last_unstale":"2024-09-19T09:23:01.452406+0000","last_undegraded":"2024-09-19T09:23:01.452406+0000","last_fullsized":"2024-09-19T09:23:01.452406+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:48.449032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.450000+0000","last_change":"2024-09-19T09:23:00.454168+0000","last_active":"2024-09-19T09:23:01.450000+0000","last_peered":"2024-09-19T09:23:01.450000+0000","last_clean":"2024-09-19T09:23:01.450000+0000","last_became_active":"2024-09-19T09:23:00.453412+0000","last_became_peered":"2024-09-19T09:23:00.453412+0000","last_unstale":"2024-09-19T09:23:01.450000+0000","last_undegraded":"2024-09-19T09:23:01.450000+0000","last_fullsized":"2024-09-19T09:23:01.450000+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:51.276700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.455785+0000","last_change":"2024-09-19T09:23:01.455615+0000","last_active":"2024-09-19T09:23:01.455785+0000","last_peered":"2024-09-19T09:23:01.455785+0000","last_clean":"2024-09-19T09:23:01.455785+0000","last_became_active":"2024-09-19T09:23:01.455132+0000","last_became_peered":"2024-09-19T09:23:01.455132+0000","last_unstale":"2024-09-19T09:23:01.455785+0000","last_undegraded":"2024-09-19T09:23:01.455785+0000","last_fullsized":"2024-09-19T09:23:01.455785+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:12.066774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.444142+0000","last_change":"2024-09-19T09:23:00.452934+0000","last_active":"2024-09-19T09:23:01.444142+0000","last_peered":"2024-09-19T09:23:01.444142+0000","last_clean":"2024-09-19T09:23:01.444142+0000","last_became_active":"2024-09-19T09:23:00.452536+0000","last_became_peered":"2024-09-19T09:23:00.452536+0000","last_unstale":"2024-09-19T09:23:01.444142+0000","last_undegraded":"2024-09-19T09:23:01.444142+0000","last_fullsized":"2024-09-19T09:23:01.444142+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:03.747500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.452731+0000","last_change":"2024-09-19T09:23:01.452607+0000","last_active":"2024-09-19T09:23:01.452731+0000","last_peered":"2024-09-19T09:23:01.452731+0000","last_clean":"2024-09-19T09:23:01.452731+0000","last_became_active":"2024-09-19T09:23:01.452102+0000","last_became_peered":"2024-09-19T09:23:01.452102+0000","last_unstale":"2024-09-19T09:23:01.452731+0000","last_undegraded":"2024-09-19T09:23:01.452731+0000","last_fullsized":"2024-09-19T09:23:01.452731+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:55.807101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.451405+0000","last_change":"2024-09-19T09:23:00.454633+0000","last_active":"2024-09-19T09:23:01.451405+0000","last_peered":"2024-09-19T09:23:01.451405+0000","last_clean":"2024-09-19T09:23:01.451405+0000","last_became_active":"2024-09-19T09:23:00.452709+0000","last_became_peered":"2024-09-19T09:23:00.452709+0000","last_unstale":"2024-09-19T09:23:01.451405+0000","last_undegraded":"2024-09-19T09:23:01.451405+0000","last_fullsized":"2024-09-19T09:23:01.451405+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:09.848844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.459290+0000","last_change":"2024-09-19T09:23:01.459171+0000","last_active":"2024-09-19T09:23:01.459290+0000","last_peered":"2024-09-19T09:23:01.459290+0000","last_clean":"2024-09-19T09:23:01.459290+0000","last_became_active":"2024-09-19T09:23:01.458836+0000","last_became_peered":"2024-09-19T09:23:01.458836+0000","last_unstale":"2024-09-19T09:23:01.459290+0000","last_undegraded":"2024-09-19T09:23:01.459290+0000","last_fullsized":"2024-09-19T09:23:01.459290+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:19.065665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.453002+0000","last_change":"2024-09-19T09:23:00.447496+0000","last_active":"2024-09-19T09:23:01.453002+0000","last_peered":"2024-09-19T09:23:01.453002+0000","last_clean":"2024-09-19T09:23:01.453002+0000","last_became_active":"2024-09-19T09:23:00.447155+0000","last_became_peered":"2024-09-19T09:23:00.447155+0000","last_unstale":"2024-09-19T09:23:01.453002+0000","last_undegraded":"2024-09-19T09:23:01.453002+0000","last_fullsized":"2024-09-19T09:23:01.453002+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:17.671008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.454104+0000","last_change":"2024-09-19T09:23:01.453792+0000","last_active":"2024-09-19T09:23:01.454104+0000","last_peered":"2024-09-19T09:23:01.454104+0000","last_clean":"2024-09-19T09:23:01.454104+0000","last_became_active":"2024-09-19T09:23:01.453221+0000","last_became_peered":"2024-09-19T09:23:01.453221+0000","last_unstale":"2024-09-19T09:23:01.454104+0000","last_undegraded":"2024-09-19T09:23:01.454104+0000","last_fullsized":"2024-09-19T09:23:01.454104+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:16.149132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.14","version":"166'6","reported_seq":18,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.465604+0000","last_change":"2024-09-19T09:23:00.455515+0000","last_active":"2024-09-19T09:23:01.465604+0000","last_peered":"2024-09-19T09:23:01.465604+0000","last_clean":"2024-09-19T09:23:01.465604+0000","last_became_active":"2024-09-19T09:23:00.454330+0000","last_became_peered":"2024-09-19T09:23:00.454330+0000","last_unstale":"2024-09-19T09:23:01.465604+0000","last_undegraded":"2024-09-19T09:23:01.465604+0000","last_fullsized":"2024-09-19T09:23:01.465604+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:29.384902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.453890+0000","last_change":"2024-09-19T09:23:01.453279+0000","last_active":"2024-09-19T09:23:01.453890+0000","last_peered":"2024-09-19T09:23:01.453890+0000","last_clean":"2024-09-19T09:23:01.453890+0000","last_became_active":"2024-09-19T09:23:01.453007+0000","last_became_peered":"2024-09-19T09:23:01.453007+0000","last_unstale":"2024-09-19T09:23:01.453890+0000","last_undegraded":"2024-09-19T09:23:01.453890+0000","last_fullsized":"2024-09-19T09:23:01.453890+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:56.488009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.13","version":"166'2","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.463413+0000","last_change":"2024-09-19T09:23:00.450360+0000","last_active":"2024-09-19T09:23:01.463413+0000","last_peered":"2024-09-19T09:23:01.463413+0000","last_clean":"2024-09-19T09:23:01.463413+0000","last_became_active":"2024-09-19T09:23:00.450081+0000","last_became_peered":"2024-09-19T09:23:00.450081+0000","last_unstale":"2024-09-19T09:23:01.463413+0000","last_undegraded":"2024-09-19T09:23:01.463413+0000","last_fullsized":"2024-09-19T09:23:01.463413+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:47.399272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.458381+0000","last_change":"2024-09-19T09:23:01.458199+0000","last_active":"2024-09-19T09:23:01.458381+0000","last_peered":"2024-09-19T09:23:01.458381+0000","last_clean":"2024-09-19T09:23:01.458381+0000","last_became_active":"2024-09-19T09:23:01.457372+0000","last_became_peered":"2024-09-19T09:23:01.457372+0000","last_unstale":"2024-09-19T09:23:01.458381+0000","last_undegraded":"2024-09-19T09:23:01.458381+0000","last_fullsized":"2024-09-19T09:23:01.458381+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:01.047945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.448255+0000","last_change":"2024-09-19T09:23:00.449492+0000","last_active":"2024-09-19T09:23:01.448255+0000","last_peered":"2024-09-19T09:23:01.448255+0000","last_clean":"2024-09-19T09:23:01.448255+0000","last_became_active":"2024-09-19T09:23:00.449250+0000","last_became_peered":"2024-09-19T09:23:00.449250+0000","last_unstale":"2024-09-19T09:23:01.448255+0000","last_undegraded":"2024-09-19T09:23:01.448255+0000","last_fullsized":"2024-09-19T09:23:01.448255+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:34.158850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.447388+0000","last_change":"2024-09-19T09:23:01.447258+0000","last_active":"2024-09-19T09:23:01.447388+0000","last_peered":"2024-09-19T09:23:01.447388+0000","last_clean":"2024-09-19T09:23:01.447388+0000","last_became_active":"2024-09-19T09:23:01.446652+0000","last_became_peered":"2024-09-19T09:23:01.446652+0000","last_unstale":"2024-09-19T09:23:01.447388+0000","last_undegraded":"2024-09-19T09:23:01.447388+0000","last_fullsized":"2024-09-19T09:23:01.447388+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:33.862563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.447857+0000","last_change":"2024-09-19T09:23:00.452494+0000","last_active":"2024-09-19T09:23:01.447857+0000","last_peered":"2024-09-19T09:23:01.447857+0000","last_clean":"2024-09-19T09:23:01.447857+0000","last_became_active":"2024-09-19T09:23:00.451899+0000","last_became_peered":"2024-09-19T09:23:00.451899+0000","last_unstale":"2024-09-19T09:23:01.447857+0000","last_undegraded":"2024-09-19T09:23:01.447857+0000","last_fullsized":"2024-09-19T09:23:01.447857+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:12.769760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.452459+0000","last_change":"2024-09-19T09:23:01.452334+0000","last_active":"2024-09-19T09:23:01.452459+0000","last_peered":"2024-09-19T09:23:01.452459+0000","last_clean":"2024-09-19T09:23:01.452459+0000","last_became_active":"2024-09-19T09:23:01.451685+0000","last_became_peered":"2024-09-19T09:23:01.451685+0000","last_unstale":"2024-09-19T09:23:01.452459+0000","last_undegraded":"2024-09-19T09:23:01.452459+0000","last_fullsized":"2024-09-19T09:23:01.452459+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:53.444171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.10","version":"166'8","reported_seq":20,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.463873+0000","last_change":"2024-09-19T09:23:00.456228+0000","last_active":"2024-09-19T09:23:01.463873+0000","last_peered":"2024-09-19T09:23:01.463873+0000","last_clean":"2024-09-19T09:23:01.463873+0000","last_became_active":"2024-09-19T09:23:00.455953+0000","last_became_peered":"2024-09-19T09:23:00.455953+0000","last_unstale":"2024-09-19T09:23:01.463873+0000","last_undegraded":"2024-09-19T09:23:01.463873+0000","last_fullsized":"2024-09-19T09:23:01.463873+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:12:55.791486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.456839+0000","last_change":"2024-09-19T09:23:01.456084+0000","last_active":"2024-09-19T09:23:01.456839+0000","last_peered":"2024-09-19T09:23:01.456839+0000","last_clean":"2024-09-19T09:23:01.456839+0000","last_became_active":"2024-09-19T09:23:01.455316+0000","last_became_peered":"2024-09-19T09:23:01.455316+0000","last_unstale":"2024-09-19T09:23:01.456839+0000","last_undegraded":"2024-09-19T09:23:01.456839+0000","last_fullsized":"2024-09-19T09:23:01.456839+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:46.840353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.f","version":"166'1","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.465555+0000","last_change":"2024-09-19T09:23:00.456349+0000","last_active":"2024-09-19T09:23:01.465555+0000","last_peered":"2024-09-19T09:23:01.465555+0000","last_clean":"2024-09-19T09:23:01.465555+0000","last_became_active":"2024-09-19T09:23:00.456113+0000","last_became_peered":"2024-09-19T09:23:00.456113+0000","last_unstale":"2024-09-19T09:23:01.465555+0000","last_undegraded":"2024-09-19T09:23:01.465555+0000","last_fullsized":"2024-09-19T09:23:01.465555+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:27.390936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.453610+0000","last_change":"2024-09-19T09:23:01.453485+0000","last_active":"2024-09-19T09:23:01.453610+0000","last_peered":"2024-09-19T09:23:01.453610+0000","last_clean":"2024-09-19T09:23:01.453610+0000","last_became_active":"2024-09-19T09:23:01.453291+0000","last_became_peered":"2024-09-19T09:23:01.453291+0000","last_unstale":"2024-09-19T09:23:01.453610+0000","last_undegraded":"2024-09-19T09:23:01.453610+0000","last_fullsized":"2024-09-19T09:23:01.453610+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:31.847117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.e","version":"166'2","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.462533+0000","last_change":"2024-09-19T09:23:00.452897+0000","last_active":"2024-09-19T09:23:01.462533+0000","last_peered":"2024-09-19T09:23:01.462533+0000","last_clean":"2024-09-19T09:23:01.462533+0000","last_became_active":"2024-09-19T09:23:00.452629+0000","last_became_peered":"2024-09-19T09:23:00.452629+0000","last_unstale":"2024-09-19T09:23:01.462533+0000","last_undegraded":"2024-09-19T09:23:01.462533+0000","last_fullsized":"2024-09-19T09:23:01.462533+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:02.160125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.454174+0000","last_change":"2024-09-19T09:23:01.453952+0000","last_active":"2024-09-19T09:23:01.454174+0000","last_peered":"2024-09-19T09:23:01.454174+0000","last_clean":"2024-09-19T09:23:01.454174+0000","last_became_active":"2024-09-19T09:23:01.453640+0000","last_became_peered":"2024-09-19T09:23:01.453640+0000","last_unstale":"2024-09-19T09:23:01.454174+0000","last_undegraded":"2024-09-19T09:23:01.454174+0000","last_fullsized":"2024-09-19T09:23:01.454174+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:28:42.237264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"166'1","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.457660+0000","last_change":"2024-09-19T09:23:00.448560+0000","last_active":"2024-09-19T09:23:01.457660+0000","last_peered":"2024-09-19T09:23:01.457660+0000","last_clean":"2024-09-19T09:23:01.457660+0000","last_became_active":"2024-09-19T09:23:00.448326+0000","last_became_peered":"2024-09-19T09:23:00.448326+0000","last_unstale":"2024-09-19T09:23:01.457660+0000","last_undegraded":"2024-09-19T09:23:01.457660+0000","last_fullsized":"2024-09-19T09:23:01.457660+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:34.868383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.457447+0000","last_change":"2024-09-19T09:23:01.457231+0000","last_active":"2024-09-19T09:23:01.457447+0000","last_peered":"2024-09-19T09:23:01.457447+0000","last_clean":"2024-09-19T09:23:01.457447+0000","last_became_active":"2024-09-19T09:23:01.456584+0000","last_became_peered":"2024-09-19T09:23:01.456584+0000","last_unstale":"2024-09-19T09:23:01.457447+0000","last_undegraded":"2024-09-19T09:23:01.457447+0000","last_fullsized":"2024-09-19T09:23:01.457447+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:59:52.609722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.448015+0000","last_change":"2024-09-19T09:23:00.453620+0000","last_active":"2024-09-19T09:23:01.448015+0000","last_peered":"2024-09-19T09:23:01.448015+0000","last_clean":"2024-09-19T09:23:01.448015+0000","last_became_active":"2024-09-19T09:23:00.453388+0000","last_became_peered":"2024-09-19T09:23:00.453388+0000","last_unstale":"2024-09-19T09:23:01.448015+0000","last_undegraded":"2024-09-19T09:23:01.448015+0000","last_fullsized":"2024-09-19T09:23:01.448015+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:34.726054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.454093+0000","last_change":"2024-09-19T09:23:01.453978+0000","last_active":"2024-09-19T09:23:01.454093+0000","last_peered":"2024-09-19T09:23:01.454093+0000","last_clean":"2024-09-19T09:23:01.454093+0000","last_became_active":"2024-09-19T09:23:01.453647+0000","last_became_peered":"2024-09-19T09:23:01.453647+0000","last_unstale":"2024-09-19T09:23:01.454093+0000","last_undegraded":"2024-09-19T09:23:01.454093+0000","last_fullsized":"2024-09-19T09:23:01.454093+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:08.881085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.b","version":"166'2","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.464770+0000","last_change":"2024-09-19T09:23:00.452061+0000","last_active":"2024-09-19T09:23:01.464770+0000","last_peered":"2024-09-19T09:23:01.464770+0000","last_clean":"2024-09-19T09:23:01.464770+0000","last_became_active":"2024-09-19T09:23:00.451753+0000","last_became_peered":"2024-09-19T09:23:00.451753+0000","last_unstale":"2024-09-19T09:23:01.464770+0000","last_undegraded":"2024-09-19T09:23:01.464770+0000","last_fullsized":"2024-09-19T09:23:01.464770+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:00.187365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.456030+0000","last_change":"2024-09-19T09:23:01.455904+0000","last_active":"2024-09-19T09:23:01.456030+0000","last_peered":"2024-09-19T09:23:01.456030+0000","last_clean":"2024-09-19T09:23:01.456030+0000","last_became_active":"2024-09-19T09:23:01.455623+0000","last_became_peered":"2024-09-19T09:23:01.455623+0000","last_unstale":"2024-09-19T09:23:01.456030+0000","last_undegraded":"2024-09-19T09:23:01.456030+0000","last_fullsized":"2024-09-19T09:23:01.456030+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:03.310078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.442744+0000","last_change":"2024-09-19T09:23:00.457121+0000","last_active":"2024-09-19T09:23:01.442744+0000","last_peered":"2024-09-19T09:23:01.442744+0000","last_clean":"2024-09-19T09:23:01.442744+0000","last_became_active":"2024-09-19T09:23:00.456853+0000","last_became_peered":"2024-09-19T09:23:00.456853+0000","last_unstale":"2024-09-19T09:23:01.442744+0000","last_undegraded":"2024-09-19T09:23:01.442744+0000","last_fullsized":"2024-09-19T09:23:01.442744+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:35.084224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.456341+0000","last_change":"2024-09-19T09:23:01.456224+0000","last_active":"2024-09-19T09:23:01.456341+0000","last_peered":"2024-09-19T09:23:01.456341+0000","last_clean":"2024-09-19T09:23:01.456341+0000","last_became_active":"2024-09-19T09:23:01.455966+0000","last_became_peered":"2024-09-19T09:23:01.455966+0000","last_unstale":"2024-09-19T09:23:01.456341+0000","last_undegraded":"2024-09-19T09:23:01.456341+0000","last_fullsized":"2024-09-19T09:23:01.456341+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:44.405947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.441639+0000","last_change":"2024-09-19T09:23:00.452972+0000","last_active":"2024-09-19T09:23:01.441639+0000","last_peered":"2024-09-19T09:23:01.441639+0000","last_clean":"2024-09-19T09:23:01.441639+0000","last_became_active":"2024-09-19T09:23:00.452730+0000","last_became_peered":"2024-09-19T09:23:00.452730+0000","last_unstale":"2024-09-19T09:23:01.441639+0000","last_undegraded":"2024-09-19T09:23:01.441639+0000","last_fullsized":"2024-09-19T09:23:01.441639+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:10.847425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.454697+0000","last_change":"2024-09-19T09:23:01.454529+0000","last_active":"2024-09-19T09:23:01.454697+0000","last_peered":"2024-09-19T09:23:01.454697+0000","last_clean":"2024-09-19T09:23:01.454697+0000","last_became_active":"2024-09-19T09:23:01.453798+0000","last_became_peered":"2024-09-19T09:23:01.453798+0000","last_unstale":"2024-09-19T09:23:01.454697+0000","last_undegraded":"2024-09-19T09:23:01.454697+0000","last_fullsized":"2024-09-19T09:23:01.454697+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:57:26.817603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.441838+0000","last_change":"2024-09-19T09:23:00.452274+0000","last_active":"2024-09-19T09:23:01.441838+0000","last_peered":"2024-09-19T09:23:01.441838+0000","last_clean":"2024-09-19T09:23:01.441838+0000","last_became_active":"2024-09-19T09:23:00.452033+0000","last_became_peered":"2024-09-19T09:23:00.452033+0000","last_unstale":"2024-09-19T09:23:01.441838+0000","last_undegraded":"2024-09-19T09:23:01.441838+0000","last_fullsized":"2024-09-19T09:23:01.441838+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:29.216333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.447675+0000","last_change":"2024-09-19T09:23:01.447515+0000","last_active":"2024-09-19T09:23:01.447675+0000","last_peered":"2024-09-19T09:23:01.447675+0000","last_clean":"2024-09-19T09:23:01.447675+0000","last_became_active":"2024-09-19T09:23:01.447001+0000","last_became_peered":"2024-09-19T09:23:01.447001+0000","last_unstale":"2024-09-19T09:23:01.447675+0000","last_undegraded":"2024-09-19T09:23:01.447675+0000","last_fullsized":"2024-09-19T09:23:01.447675+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:12.676702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.7","version":"166'2","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.465810+0000","last_change":"2024-09-19T09:23:00.455531+0000","last_active":"2024-09-19T09:23:01.465810+0000","last_peered":"2024-09-19T09:23:01.465810+0000","last_clean":"2024-09-19T09:23:01.465810+0000","last_became_active":"2024-09-19T09:23:00.455289+0000","last_became_peered":"2024-09-19T09:23:00.455289+0000","last_unstale":"2024-09-19T09:23:01.465810+0000","last_undegraded":"2024-09-19T09:23:01.465810+0000","last_fullsized":"2024-09-19T09:23:01.465810+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:35.394665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.448010+0000","last_change":"2024-09-19T09:23:01.447860+0000","last_active":"2024-09-19T09:23:01.448010+0000","last_peered":"2024-09-19T09:23:01.448010+0000","last_clean":"2024-09-19T09:23:01.448010+0000","last_became_active":"2024-09-19T09:23:01.447556+0000","last_became_peered":"2024-09-19T09:23:01.447556+0000","last_unstale":"2024-09-19T09:23:01.448010+0000","last_undegraded":"2024-09-19T09:23:01.448010+0000","last_fullsized":"2024-09-19T09:23:01.448010+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:08.004862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.448728+0000","last_change":"2024-09-19T09:23:00.456955+0000","last_active":"2024-09-19T09:23:01.448728+0000","last_peered":"2024-09-19T09:23:01.448728+0000","last_clean":"2024-09-19T09:23:01.448728+0000","last_became_active":"2024-09-19T09:23:00.456699+0000","last_became_peered":"2024-09-19T09:23:00.456699+0000","last_unstale":"2024-09-19T09:23:01.448728+0000","last_undegraded":"2024-09-19T09:23:01.448728+0000","last_fullsized":"2024-09-19T09:23:01.448728+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:48.425624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.458576+0000","last_change":"2024-09-19T09:23:01.458440+0000","last_active":"2024-09-19T09:23:01.458576+0000","last_peered":"2024-09-19T09:23:01.458576+0000","last_clean":"2024-09-19T09:23:01.458576+0000","last_became_active":"2024-09-19T09:23:01.457723+0000","last_became_peered":"2024-09-19T09:23:01.457723+0000","last_unstale":"2024-09-19T09:23:01.458576+0000","last_undegraded":"2024-09-19T09:23:01.458576+0000","last_fullsized":"2024-09-19T09:23:01.458576+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:17.757155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.451477+0000","last_change":"2024-09-19T09:23:00.455239+0000","last_active":"2024-09-19T09:23:01.451477+0000","last_peered":"2024-09-19T09:23:01.451477+0000","last_clean":"2024-09-19T09:23:01.451477+0000","last_became_active":"2024-09-19T09:23:00.453512+0000","last_became_peered":"2024-09-19T09:23:00.453512+0000","last_unstale":"2024-09-19T09:23:01.451477+0000","last_undegraded":"2024-09-19T09:23:01.451477+0000","last_fullsized":"2024-09-19T09:23:01.451477+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:10.616087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.458774+0000","last_change":"2024-09-19T09:23:01.458650+0000","last_active":"2024-09-19T09:23:01.458774+0000","last_peered":"2024-09-19T09:23:01.458774+0000","last_clean":"2024-09-19T09:23:01.458774+0000","last_became_active":"2024-09-19T09:23:01.458178+0000","last_became_peered":"2024-09-19T09:23:01.458178+0000","last_unstale":"2024-09-19T09:23:01.458774+0000","last_undegraded":"2024-09-19T09:23:01.458774+0000","last_fullsized":"2024-09-19T09:23:01.458774+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:47.007646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.452219+0000","last_change":"2024-09-19T09:23:00.454207+0000","last_active":"2024-09-19T09:23:01.452219+0000","last_peered":"2024-09-19T09:23:01.452219+0000","last_clean":"2024-09-19T09:23:01.452219+0000","last_became_active":"2024-09-19T09:23:00.453975+0000","last_became_peered":"2024-09-19T09:23:00.453975+0000","last_unstale":"2024-09-19T09:23:01.452219+0000","last_undegraded":"2024-09-19T09:23:01.452219+0000","last_fullsized":"2024-09-19T09:23:01.452219+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:25.742421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.458247+0000","last_change":"2024-09-19T09:23:01.457225+0000","last_active":"2024-09-19T09:23:01.458247+0000","last_peered":"2024-09-19T09:23:01.458247+0000","last_clean":"2024-09-19T09:23:01.458247+0000","last_became_active":"2024-09-19T09:23:01.456988+0000","last_became_peered":"2024-09-19T09:23:01.456988+0000","last_unstale":"2024-09-19T09:23:01.458247+0000","last_undegraded":"2024-09-19T09:23:01.458247+0000","last_fullsized":"2024-09-19T09:23:01.458247+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:49.656570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.448953+0000","last_change":"2024-09-19T09:23:00.452384+0000","last_active":"2024-09-19T09:23:01.448953+0000","last_peered":"2024-09-19T09:23:01.448953+0000","last_clean":"2024-09-19T09:23:01.448953+0000","last_became_active":"2024-09-19T09:23:00.452123+0000","last_became_peered":"2024-09-19T09:23:00.452123+0000","last_unstale":"2024-09-19T09:23:01.448953+0000","last_undegraded":"2024-09-19T09:23:01.448953+0000","last_fullsized":"2024-09-19T09:23:01.448953+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:13.911455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.456442+0000","last_change":"2024-09-19T09:23:01.456253+0000","last_active":"2024-09-19T09:23:01.456442+0000","last_peered":"2024-09-19T09:23:01.456442+0000","last_clean":"2024-09-19T09:23:01.456442+0000","last_became_active":"2024-09-19T09:23:01.456001+0000","last_became_peered":"2024-09-19T09:23:01.456001+0000","last_unstale":"2024-09-19T09:23:01.456442+0000","last_undegraded":"2024-09-19T09:23:01.456442+0000","last_fullsized":"2024-09-19T09:23:01.456442+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:48.794284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.443047+0000","last_change":"2024-09-19T09:23:00.448653+0000","last_active":"2024-09-19T09:23:01.443047+0000","last_peered":"2024-09-19T09:23:01.443047+0000","last_clean":"2024-09-19T09:23:01.443047+0000","last_became_active":"2024-09-19T09:23:00.448411+0000","last_became_peered":"2024-09-19T09:23:00.448411+0000","last_unstale":"2024-09-19T09:23:01.443047+0000","last_undegraded":"2024-09-19T09:23:01.443047+0000","last_fullsized":"2024-09-19T09:23:01.443047+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:00.961580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.455662+0000","last_change":"2024-09-19T09:23:01.455419+0000","last_active":"2024-09-19T09:23:01.455662+0000","last_peered":"2024-09-19T09:23:01.455662+0000","last_clean":"2024-09-19T09:23:01.455662+0000","last_became_active":"2024-09-19T09:23:01.454798+0000","last_became_peered":"2024-09-19T09:23:01.454798+0000","last_unstale":"2024-09-19T09:23:01.455662+0000","last_undegraded":"2024-09-19T09:23:01.455662+0000","last_fullsized":"2024-09-19T09:23:01.455662+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:34.925089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.446542+0000","last_change":"2024-09-19T09:23:00.451376+0000","last_active":"2024-09-19T09:23:01.446542+0000","last_peered":"2024-09-19T09:23:01.446542+0000","last_clean":"2024-09-19T09:23:01.446542+0000","last_became_active":"2024-09-19T09:23:00.451094+0000","last_became_peered":"2024-09-19T09:23:00.451094+0000","last_unstale":"2024-09-19T09:23:01.446542+0000","last_undegraded":"2024-09-19T09:23:01.446542+0000","last_fullsized":"2024-09-19T09:23:01.446542+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:49.866359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.448732+0000","last_change":"2024-09-19T09:23:01.448303+0000","last_active":"2024-09-19T09:23:01.448732+0000","last_peered":"2024-09-19T09:23:01.448732+0000","last_clean":"2024-09-19T09:23:01.448732+0000","last_became_active":"2024-09-19T09:23:01.448069+0000","last_became_peered":"2024-09-19T09:23:01.448069+0000","last_unstale":"2024-09-19T09:23:01.448732+0000","last_undegraded":"2024-09-19T09:23:01.448732+0000","last_fullsized":"2024-09-19T09:23:01.448732+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:22.797530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.450149+0000","last_change":"2024-09-19T09:23:00.453692+0000","last_active":"2024-09-19T09:23:01.450149+0000","last_peered":"2024-09-19T09:23:01.450149+0000","last_clean":"2024-09-19T09:23:01.450149+0000","last_became_active":"2024-09-19T09:23:00.452662+0000","last_became_peered":"2024-09-19T09:23:00.452662+0000","last_unstale":"2024-09-19T09:23:01.450149+0000","last_undegraded":"2024-09-19T09:23:01.450149+0000","last_fullsized":"2024-09-19T09:23:01.450149+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:40.707952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.460380+0000","last_change":"2024-09-19T09:23:01.460036+0000","last_active":"2024-09-19T09:23:01.460380+0000","last_peered":"2024-09-19T09:23:01.460380+0000","last_clean":"2024-09-19T09:23:01.460380+0000","last_became_active":"2024-09-19T09:23:01.459765+0000","last_became_peered":"2024-09-19T09:23:01.459765+0000","last_unstale":"2024-09-19T09:23:01.460380+0000","last_undegraded":"2024-09-19T09:23:01.460380+0000","last_fullsized":"2024-09-19T09:23:01.460380+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:53.593459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.15","version":"166'3","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.462064+0000","last_change":"2024-09-19T09:23:00.452768+0000","last_active":"2024-09-19T09:23:01.462064+0000","last_peered":"2024-09-19T09:23:01.462064+0000","last_clean":"2024-09-19T09:23:01.462064+0000","last_became_active":"2024-09-19T09:23:00.452541+0000","last_became_peered":"2024-09-19T09:23:00.452541+0000","last_unstale":"2024-09-19T09:23:01.462064+0000","last_undegraded":"2024-09-19T09:23:01.462064+0000","last_fullsized":"2024-09-19T09:23:01.462064+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:11.104801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":454,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.449183+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:23:01.449183+0000","last_peered":"2024-09-19T09:23:01.449183+0000","last_clean":"2024-09-19T09:23:01.449183+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:23:01.449183+0000","last_undegraded":"2024-09-19T09:23:01.449183+0000","last_fullsized":"2024-09-19T09:23:01.449183+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:28.823470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574967,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":899,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194412,"statfs":{"total":200000000,"available":199078545,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574967,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":899,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194412,"statfs":{"total":200000000,"available":199078545,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574967,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1476,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193836,"statfs":{"total":200000000,"available":198488177,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574967,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":899,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194412,"statfs":{"total":200000000,"available":199078545,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574967,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":899,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194412,"statfs":{"total":200000000,"available":199078545,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574967,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":899,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194412,"statfs":{"total":200000000,"available":199078545,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574967,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1476,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193836,"statfs":{"total":200000000,"available":198488177,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574967,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":899,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194412,"statfs":{"total":200000000,"available":199078545,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:23:05.451 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:23:05.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.589+0000 7fb2ab38d640 1 Processor -- start 2024-09-19T09:23:05.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.589+0000 7fb2ab38d640 1 -- start start 2024-09-19T09:23:05.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.589+0000 7fb2ab38d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb2a413fae0 0x7fb2a406f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.589+0000 7fb2ab38d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2a4142150 0x7fb2a4160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.589+0000 7fb2ab38d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2a4142650 con 0x7fb2a4160a80 2024-09-19T09:23:05.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.589+0000 7fb2ab38d640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fb2a40ce780 con 0x7fb2a413fae0 2024-09-19T09:23:05.591 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.589+0000 7fb2ab38d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb2a4142930 con 0x7fb2a4142150 2024-09-19T09:23:05.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.589+0000 7fb2a9129640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fb2a413fae0 0x7fb2a406f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.589+0000 7fb2a992a640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fb2a4160a80 0x7fb2a415cf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55832/0 (socket says 172.21.15.18:55832) 2024-09-19T09:23:05.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.589+0000 7fb2a992a640 1 -- 172.21.15.18:0/3596528742 learned_addr learned my addr 172.21.15.18:0/3596528742 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:23:05.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.589+0000 7fb2a8928640 1 --2- 172.21.15.18:0/3596528742 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2a4142150 0x7fb2a4160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.589+0000 7fb2a9129640 1 -- 172.21.15.18:0/3596528742 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2a4142150 msgr2=0x7fb2a4160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:05.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.589+0000 7fb2a9129640 1 --2- 172.21.15.18:0/3596528742 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2a4142150 0x7fb2a4160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.589+0000 7fb2a9129640 1 -- 172.21.15.18:0/3596528742 >> v1:172.21.15.18:6789/0 conn(0x7fb2a4160a80 legacy=0x7fb2a415cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.589+0000 7fb29bfff640 1 -- 172.21.15.18:0/3596528742 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4287774895 0 0) 0x7fb2a4142650 con 0x7fb2a4160a80 2024-09-19T09:23:05.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.589+0000 7fb2a9129640 1 -- 172.21.15.18:0/3596528742 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a4142c10 con 0x7fb2a413fae0 2024-09-19T09:23:05.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.591+0000 7fb2a9129640 1 --2- 172.21.15.18:0/3596528742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2a413fae0 0x7fb2a406f1b0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fb2a00097a0 tx=0x7fb2a002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7587cd45f74de909 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:05.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.591+0000 7fb29bfff640 1 -- 172.21.15.18:0/3596528742 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a0037070 con 0x7fb2a413fae0 2024-09-19T09:23:05.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.591+0000 7fb29bfff640 1 -- 172.21.15.18:0/3596528742 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a002ae50 con 0x7fb2a413fae0 2024-09-19T09:23:05.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.591+0000 7fb29bfff640 1 -- 172.21.15.18:0/3596528742 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a0032660 con 0x7fb2a413fae0 2024-09-19T09:23:05.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.592+0000 7fb2ab38d640 1 -- 172.21.15.18:0/3596528742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2a413fae0 msgr2=0x7fb2a406f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.592+0000 7fb2ab38d640 1 --2- 172.21.15.18:0/3596528742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2a413fae0 0x7fb2a406f1b0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fb2a00097a0 tx=0x7fb2a002a100 comp rx=0 tx=0).stop 2024-09-19T09:23:05.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.592+0000 7fb2ab38d640 1 -- 172.21.15.18:0/3596528742 shutdown_connections 2024-09-19T09:23:05.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.592+0000 7fb2ab38d640 1 --2- 172.21.15.18:0/3596528742 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2a4142150 0x7fb2a4160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.592+0000 7fb2ab38d640 1 --2- 172.21.15.18:0/3596528742 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2a413fae0 0x7fb2a406f1b0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.592+0000 7fb2ab38d640 1 -- 172.21.15.18:0/3596528742 >> 172.21.15.18:0/3596528742 conn(0x7fb2a406bc10 msgr2=0x7fb2a406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:05.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.592+0000 7fb2ab38d640 1 -- 172.21.15.18:0/3596528742 shutdown_connections 2024-09-19T09:23:05.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.592+0000 7fb2ab38d640 1 -- 172.21.15.18:0/3596528742 wait complete. 2024-09-19T09:23:05.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.593+0000 7fb2ab38d640 1 Processor -- start 2024-09-19T09:23:05.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.593+0000 7fb2ab38d640 1 -- start start 2024-09-19T09:23:05.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.593+0000 7fb2ab38d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2a413fae0 0x7fb2a41f2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.593+0000 7fb2ab38d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2a4142150 0x7fb2a4145870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.593+0000 7fb2ab38d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2a4160a80 0x7fb2a41592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.593+0000 7fb2ab38d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a406f870 con 0x7fb2a4160a80 2024-09-19T09:23:05.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.593+0000 7fb2ab38d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a406f6f0 con 0x7fb2a4142150 2024-09-19T09:23:05.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.593+0000 7fb2ab38d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fb2a40cfc20 con 0x7fb2a413fae0 2024-09-19T09:23:05.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.593+0000 7fb2a992a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2a4160a80 0x7fb2a41592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.593+0000 7fb2a992a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2a4160a80 0x7fb2a41592d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36136/0 (socket says 172.21.15.18:36136) 2024-09-19T09:23:05.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.593+0000 7fb2a992a640 1 -- 172.21.15.18:0/2541718963 learned_addr learned my addr 172.21.15.18:0/2541718963 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:23:05.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.593+0000 7fb2a8928640 1 --2- 172.21.15.18:0/2541718963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2a4142150 0x7fb2a4145870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.593+0000 7fb2a9129640 1 --2- 172.21.15.18:0/2541718963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2a413fae0 0x7fb2a41f2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.593+0000 7fb2a992a640 1 -- 172.21.15.18:0/2541718963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2a413fae0 msgr2=0x7fb2a41f2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.593+0000 7fb2a992a640 1 --2- 172.21.15.18:0/2541718963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2a413fae0 0x7fb2a41f2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.593+0000 7fb2a992a640 1 -- 172.21.15.18:0/2541718963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2a4142150 msgr2=0x7fb2a4145870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.593+0000 7fb2a992a640 1 --2- 172.21.15.18:0/2541718963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2a4142150 0x7fb2a4145870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.593+0000 7fb2a992a640 1 -- 172.21.15.18:0/2541718963 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a41577d0 con 0x7fb2a4160a80 2024-09-19T09:23:05.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.594+0000 7fb2a992a640 1 --2- 172.21.15.18:0/2541718963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2a4160a80 0x7fb2a41592d0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fb29c00c730 tx=0x7fb29c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:05.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.594+0000 7fb299ffb640 1 -- 172.21.15.18:0/2541718963 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29c018070 con 0x7fb2a4160a80 2024-09-19T09:23:05.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.594+0000 7fb299ffb640 1 -- 172.21.15.18:0/2541718963 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb29c00ce40 con 0x7fb2a4160a80 2024-09-19T09:23:05.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.594+0000 7fb2ab38d640 1 -- 172.21.15.18:0/2541718963 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2a4157ab0 con 0x7fb2a4160a80 2024-09-19T09:23:05.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.594+0000 7fb299ffb640 1 -- 172.21.15.18:0/2541718963 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29c00a880 con 0x7fb2a4160a80 2024-09-19T09:23:05.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.594+0000 7fb2ab38d640 1 -- 172.21.15.18:0/2541718963 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2a4158070 con 0x7fb2a4160a80 2024-09-19T09:23:05.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.596+0000 7fb2ab38d640 1 -- 172.21.15.18:0/2541718963 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2a406f1b0 con 0x7fb2a4160a80 2024-09-19T09:23:05.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.597+0000 7fb299ffb640 1 -- 172.21.15.18:0/2541718963 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fb29c01b070 con 0x7fb2a4160a80 2024-09-19T09:23:05.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.597+0000 7fb299ffb640 1 --2- 172.21.15.18:0/2541718963 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb28806c2b0 0x7fb28806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.597+0000 7fb299ffb640 1 -- 172.21.15.18:0/2541718963 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7fb29c08a890 con 0x7fb2a4160a80 2024-09-19T09:23:05.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.597+0000 7fb2a9129640 1 --2- 172.21.15.18:0/2541718963 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb28806c2b0 0x7fb28806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.598+0000 7fb2a9129640 1 --2- 172.21.15.18:0/2541718963 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb28806c2b0 0x7fb28806e770 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0034000 tx=0x7fb2a002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:05.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.600+0000 7fb299ffb640 1 -- 172.21.15.18:0/2541718963 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fb29c058a40 con 0x7fb2a4160a80 2024-09-19T09:23:05.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.774+0000 7fb2ab38d640 1 -- 172.21.15.18:0/2541718963 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb2a40d0640 con 0x7fb28806c2b0 2024-09-19T09:23:05.781 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.781+0000 7fb299ffb640 1 -- 172.21.15.18:0/2541718963 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247921 (secure 0 0 0) 0x7fb2a40d0640 con 0x7fb28806c2b0 2024-09-19T09:23:05.784 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:23:05.785 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:23:05.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.784+0000 7fb2ab38d640 1 -- 172.21.15.18:0/2541718963 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb28806c2b0 msgr2=0x7fb28806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.784+0000 7fb2ab38d640 1 --2- 172.21.15.18:0/2541718963 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb28806c2b0 0x7fb28806e770 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fb2a0034000 tx=0x7fb2a002e000 comp rx=0 tx=0).stop 2024-09-19T09:23:05.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.784+0000 7fb2ab38d640 1 -- 172.21.15.18:0/2541718963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2a4160a80 msgr2=0x7fb2a41592d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.784+0000 7fb2ab38d640 1 --2- 172.21.15.18:0/2541718963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2a4160a80 0x7fb2a41592d0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fb29c00c730 tx=0x7fb29c00cbf0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.784+0000 7fb2ab38d640 1 -- 172.21.15.18:0/2541718963 shutdown_connections 2024-09-19T09:23:05.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.784+0000 7fb2ab38d640 1 --2- 172.21.15.18:0/2541718963 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fb28806c2b0 0x7fb28806e770 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.784+0000 7fb2ab38d640 1 --2- 172.21.15.18:0/2541718963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fb2a4160a80 0x7fb2a41592d0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.784+0000 7fb2ab38d640 1 --2- 172.21.15.18:0/2541718963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb2a4142150 0x7fb2a4145870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.784+0000 7fb2ab38d640 1 --2- 172.21.15.18:0/2541718963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fb2a413fae0 0x7fb2a41f2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.784+0000 7fb2ab38d640 1 -- 172.21.15.18:0/2541718963 >> 172.21.15.18:0/2541718963 conn(0x7fb2a406bc10 msgr2=0x7fb2a415f180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:05.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.784+0000 7fb2ab38d640 1 -- 172.21.15.18:0/2541718963 shutdown_connections 2024-09-19T09:23:05.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.784+0000 7fb2ab38d640 1 -- 172.21.15.18:0/2541718963 wait complete. 2024-09-19T09:23:05.796 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":453,"stamp":"2024-09-19T09:23:05.666045+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":63,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8351,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554148,"statfs":{"total":1600000000,"available":1591447624,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001462"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.448715+0000","last_change":"2024-09-19T09:23:01.448588+0000","last_active":"2024-09-19T09:23:01.448715+0000","last_peered":"2024-09-19T09:23:01.448715+0000","last_clean":"2024-09-19T09:23:01.448715+0000","last_became_active":"2024-09-19T09:23:01.448302+0000","last_became_peered":"2024-09-19T09:23:01.448302+0000","last_unstale":"2024-09-19T09:23:01.448715+0000","last_undegraded":"2024-09-19T09:23:01.448715+0000","last_fullsized":"2024-09-19T09:23:01.448715+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:08.537674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.453038+0000","last_change":"2024-09-19T09:23:01.452913+0000","last_active":"2024-09-19T09:23:01.453038+0000","last_peered":"2024-09-19T09:23:01.453038+0000","last_clean":"2024-09-19T09:23:01.453038+0000","last_became_active":"2024-09-19T09:23:01.452700+0000","last_became_peered":"2024-09-19T09:23:01.452700+0000","last_unstale":"2024-09-19T09:23:01.453038+0000","last_undegraded":"2024-09-19T09:23:01.453038+0000","last_fullsized":"2024-09-19T09:23:01.453038+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:03.876859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.457992+0000","last_change":"2024-09-19T09:23:01.453706+0000","last_active":"2024-09-19T09:23:01.457992+0000","last_peered":"2024-09-19T09:23:01.457992+0000","last_clean":"2024-09-19T09:23:01.457992+0000","last_became_active":"2024-09-19T09:23:01.453473+0000","last_became_peered":"2024-09-19T09:23:01.453473+0000","last_unstale":"2024-09-19T09:23:01.457992+0000","last_undegraded":"2024-09-19T09:23:01.457992+0000","last_fullsized":"2024-09-19T09:23:01.457992+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:22:54.235458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.445197+0000","last_change":"2024-09-19T09:23:01.445083+0000","last_active":"2024-09-19T09:23:01.445197+0000","last_peered":"2024-09-19T09:23:01.445197+0000","last_clean":"2024-09-19T09:23:01.445197+0000","last_became_active":"2024-09-19T09:23:01.444807+0000","last_became_peered":"2024-09-19T09:23:01.444807+0000","last_unstale":"2024-09-19T09:23:01.445197+0000","last_undegraded":"2024-09-19T09:23:01.445197+0000","last_fullsized":"2024-09-19T09:23:01.445197+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:40.289429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.455907+0000","last_change":"2024-09-19T09:23:01.455581+0000","last_active":"2024-09-19T09:23:01.455907+0000","last_peered":"2024-09-19T09:23:01.455907+0000","last_clean":"2024-09-19T09:23:01.455907+0000","last_became_active":"2024-09-19T09:23:01.454581+0000","last_became_peered":"2024-09-19T09:23:01.454581+0000","last_unstale":"2024-09-19T09:23:01.455907+0000","last_undegraded":"2024-09-19T09:23:01.455907+0000","last_fullsized":"2024-09-19T09:23:01.455907+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:30.688211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.452921+0000","last_change":"2024-09-19T09:23:01.452797+0000","last_active":"2024-09-19T09:23:01.452921+0000","last_peered":"2024-09-19T09:23:01.452921+0000","last_clean":"2024-09-19T09:23:01.452921+0000","last_became_active":"2024-09-19T09:23:01.452576+0000","last_became_peered":"2024-09-19T09:23:01.452576+0000","last_unstale":"2024-09-19T09:23:01.452921+0000","last_undegraded":"2024-09-19T09:23:01.452921+0000","last_fullsized":"2024-09-19T09:23:01.452921+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:24.250360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.461216+0000","last_change":"2024-09-19T09:23:01.461087+0000","last_active":"2024-09-19T09:23:01.461216+0000","last_peered":"2024-09-19T09:23:01.461216+0000","last_clean":"2024-09-19T09:23:01.461216+0000","last_became_active":"2024-09-19T09:23:01.460845+0000","last_became_peered":"2024-09-19T09:23:01.460845+0000","last_unstale":"2024-09-19T09:23:01.461216+0000","last_undegraded":"2024-09-19T09:23:01.461216+0000","last_fullsized":"2024-09-19T09:23:01.461216+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:58:13.946602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.454684+0000","last_change":"2024-09-19T09:23:01.454370+0000","last_active":"2024-09-19T09:23:01.454684+0000","last_peered":"2024-09-19T09:23:01.454684+0000","last_clean":"2024-09-19T09:23:01.454684+0000","last_became_active":"2024-09-19T09:23:01.454110+0000","last_became_peered":"2024-09-19T09:23:01.454110+0000","last_unstale":"2024-09-19T09:23:01.454684+0000","last_undegraded":"2024-09-19T09:23:01.454684+0000","last_fullsized":"2024-09-19T09:23:01.454684+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:40:27.810256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.451962+0000","last_change":"2024-09-19T09:23:01.451764+0000","last_active":"2024-09-19T09:23:01.451962+0000","last_peered":"2024-09-19T09:23:01.451962+0000","last_clean":"2024-09-19T09:23:01.451962+0000","last_became_active":"2024-09-19T09:23:01.451536+0000","last_became_peered":"2024-09-19T09:23:01.451536+0000","last_unstale":"2024-09-19T09:23:01.451962+0000","last_undegraded":"2024-09-19T09:23:01.451962+0000","last_fullsized":"2024-09-19T09:23:01.451962+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:03:29.559064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.458680+0000","last_change":"2024-09-19T09:23:01.458558+0000","last_active":"2024-09-19T09:23:01.458680+0000","last_peered":"2024-09-19T09:23:01.458680+0000","last_clean":"2024-09-19T09:23:01.458680+0000","last_became_active":"2024-09-19T09:23:01.458296+0000","last_became_peered":"2024-09-19T09:23:01.458296+0000","last_unstale":"2024-09-19T09:23:01.458680+0000","last_undegraded":"2024-09-19T09:23:01.458680+0000","last_fullsized":"2024-09-19T09:23:01.458680+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:34:48.979585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.459061+0000","last_change":"2024-09-19T09:23:01.458498+0000","last_active":"2024-09-19T09:23:01.459061+0000","last_peered":"2024-09-19T09:23:01.459061+0000","last_clean":"2024-09-19T09:23:01.459061+0000","last_became_active":"2024-09-19T09:23:01.458176+0000","last_became_peered":"2024-09-19T09:23:01.458176+0000","last_unstale":"2024-09-19T09:23:01.459061+0000","last_undegraded":"2024-09-19T09:23:01.459061+0000","last_fullsized":"2024-09-19T09:23:01.459061+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:45.306053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.450730+0000","last_change":"2024-09-19T09:23:01.450592+0000","last_active":"2024-09-19T09:23:01.450730+0000","last_peered":"2024-09-19T09:23:01.450730+0000","last_clean":"2024-09-19T09:23:01.450730+0000","last_became_active":"2024-09-19T09:23:01.450359+0000","last_became_peered":"2024-09-19T09:23:01.450359+0000","last_unstale":"2024-09-19T09:23:01.450730+0000","last_undegraded":"2024-09-19T09:23:01.450730+0000","last_fullsized":"2024-09-19T09:23:01.450730+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:46.813607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.456928+0000","last_change":"2024-09-19T09:23:01.456612+0000","last_active":"2024-09-19T09:23:01.456928+0000","last_peered":"2024-09-19T09:23:01.456928+0000","last_clean":"2024-09-19T09:23:01.456928+0000","last_became_active":"2024-09-19T09:23:01.456374+0000","last_became_peered":"2024-09-19T09:23:01.456374+0000","last_unstale":"2024-09-19T09:23:01.456928+0000","last_undegraded":"2024-09-19T09:23:01.456928+0000","last_fullsized":"2024-09-19T09:23:01.456928+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:36:45.381197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.463254+0000","last_change":"2024-09-19T09:23:01.462920+0000","last_active":"2024-09-19T09:23:01.463254+0000","last_peered":"2024-09-19T09:23:01.463254+0000","last_clean":"2024-09-19T09:23:01.463254+0000","last_became_active":"2024-09-19T09:23:01.462621+0000","last_became_peered":"2024-09-19T09:23:01.462621+0000","last_unstale":"2024-09-19T09:23:01.463254+0000","last_undegraded":"2024-09-19T09:23:01.463254+0000","last_fullsized":"2024-09-19T09:23:01.463254+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:26:53.629801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.456001+0000","last_change":"2024-09-19T09:23:01.455815+0000","last_active":"2024-09-19T09:23:01.456001+0000","last_peered":"2024-09-19T09:23:01.456001+0000","last_clean":"2024-09-19T09:23:01.456001+0000","last_became_active":"2024-09-19T09:23:01.454966+0000","last_became_peered":"2024-09-19T09:23:01.454966+0000","last_unstale":"2024-09-19T09:23:01.456001+0000","last_undegraded":"2024-09-19T09:23:01.456001+0000","last_fullsized":"2024-09-19T09:23:01.456001+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:53:59.250509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.453778+0000","last_change":"2024-09-19T09:23:01.453666+0000","last_active":"2024-09-19T09:23:01.453778+0000","last_peered":"2024-09-19T09:23:01.453778+0000","last_clean":"2024-09-19T09:23:01.453778+0000","last_became_active":"2024-09-19T09:23:01.453419+0000","last_became_peered":"2024-09-19T09:23:01.453419+0000","last_unstale":"2024-09-19T09:23:01.453778+0000","last_undegraded":"2024-09-19T09:23:01.453778+0000","last_fullsized":"2024-09-19T09:23:01.453778+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:29.832541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.446613+0000","last_change":"2024-09-19T09:23:01.446484+0000","last_active":"2024-09-19T09:23:01.446613+0000","last_peered":"2024-09-19T09:23:01.446613+0000","last_clean":"2024-09-19T09:23:01.446613+0000","last_became_active":"2024-09-19T09:23:01.446169+0000","last_became_peered":"2024-09-19T09:23:01.446169+0000","last_unstale":"2024-09-19T09:23:01.446613+0000","last_undegraded":"2024-09-19T09:23:01.446613+0000","last_fullsized":"2024-09-19T09:23:01.446613+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:51:31.255126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.460032+0000","last_change":"2024-09-19T09:23:01.459553+0000","last_active":"2024-09-19T09:23:01.460032+0000","last_peered":"2024-09-19T09:23:01.460032+0000","last_clean":"2024-09-19T09:23:01.460032+0000","last_became_active":"2024-09-19T09:23:01.459305+0000","last_became_peered":"2024-09-19T09:23:01.459305+0000","last_unstale":"2024-09-19T09:23:01.460032+0000","last_undegraded":"2024-09-19T09:23:01.460032+0000","last_fullsized":"2024-09-19T09:23:01.460032+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:05:21.168161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.451907+0000","last_change":"2024-09-19T09:23:01.451779+0000","last_active":"2024-09-19T09:23:01.451907+0000","last_peered":"2024-09-19T09:23:01.451907+0000","last_clean":"2024-09-19T09:23:01.451907+0000","last_became_active":"2024-09-19T09:23:01.451552+0000","last_became_peered":"2024-09-19T09:23:01.451552+0000","last_unstale":"2024-09-19T09:23:01.451907+0000","last_undegraded":"2024-09-19T09:23:01.451907+0000","last_fullsized":"2024-09-19T09:23:01.451907+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:37:41.464147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.460080+0000","last_change":"2024-09-19T09:23:01.459957+0000","last_active":"2024-09-19T09:23:01.460080+0000","last_peered":"2024-09-19T09:23:01.460080+0000","last_clean":"2024-09-19T09:23:01.460080+0000","last_became_active":"2024-09-19T09:23:01.459716+0000","last_became_peered":"2024-09-19T09:23:01.459716+0000","last_unstale":"2024-09-19T09:23:01.460080+0000","last_undegraded":"2024-09-19T09:23:01.460080+0000","last_fullsized":"2024-09-19T09:23:01.460080+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:02:14.480411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.446951+0000","last_change":"2024-09-19T09:23:01.446824+0000","last_active":"2024-09-19T09:23:01.446951+0000","last_peered":"2024-09-19T09:23:01.446951+0000","last_clean":"2024-09-19T09:23:01.446951+0000","last_became_active":"2024-09-19T09:23:01.445986+0000","last_became_peered":"2024-09-19T09:23:01.445986+0000","last_unstale":"2024-09-19T09:23:01.446951+0000","last_undegraded":"2024-09-19T09:23:01.446951+0000","last_fullsized":"2024-09-19T09:23:01.446951+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:48:03.266222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.454954+0000","last_change":"2024-09-19T09:23:01.454696+0000","last_active":"2024-09-19T09:23:01.454954+0000","last_peered":"2024-09-19T09:23:01.454954+0000","last_clean":"2024-09-19T09:23:01.454954+0000","last_became_active":"2024-09-19T09:23:01.454218+0000","last_became_peered":"2024-09-19T09:23:01.454218+0000","last_unstale":"2024-09-19T09:23:01.454954+0000","last_undegraded":"2024-09-19T09:23:01.454954+0000","last_fullsized":"2024-09-19T09:23:01.454954+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:54:48.733829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.453913+0000","last_change":"2024-09-19T09:23:01.453564+0000","last_active":"2024-09-19T09:23:01.453913+0000","last_peered":"2024-09-19T09:23:01.453913+0000","last_clean":"2024-09-19T09:23:01.453913+0000","last_became_active":"2024-09-19T09:23:01.452567+0000","last_became_peered":"2024-09-19T09:23:01.452567+0000","last_unstale":"2024-09-19T09:23:01.453913+0000","last_undegraded":"2024-09-19T09:23:01.453913+0000","last_fullsized":"2024-09-19T09:23:01.453913+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:45.929874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.454138+0000","last_change":"2024-09-19T09:23:01.453072+0000","last_active":"2024-09-19T09:23:01.454138+0000","last_peered":"2024-09-19T09:23:01.454138+0000","last_clean":"2024-09-19T09:23:01.454138+0000","last_became_active":"2024-09-19T09:23:01.452793+0000","last_became_peered":"2024-09-19T09:23:01.452793+0000","last_unstale":"2024-09-19T09:23:01.454138+0000","last_undegraded":"2024-09-19T09:23:01.454138+0000","last_fullsized":"2024-09-19T09:23:01.454138+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:08:54.734642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.455308+0000","last_change":"2024-09-19T09:23:01.454729+0000","last_active":"2024-09-19T09:23:01.455308+0000","last_peered":"2024-09-19T09:23:01.455308+0000","last_clean":"2024-09-19T09:23:01.455308+0000","last_became_active":"2024-09-19T09:23:01.454112+0000","last_became_peered":"2024-09-19T09:23:01.454112+0000","last_unstale":"2024-09-19T09:23:01.455308+0000","last_undegraded":"2024-09-19T09:23:01.455308+0000","last_fullsized":"2024-09-19T09:23:01.455308+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:35:17.445732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.458113+0000","last_change":"2024-09-19T09:23:01.457997+0000","last_active":"2024-09-19T09:23:01.458113+0000","last_peered":"2024-09-19T09:23:01.458113+0000","last_clean":"2024-09-19T09:23:01.458113+0000","last_became_active":"2024-09-19T09:23:01.457621+0000","last_became_peered":"2024-09-19T09:23:01.457621+0000","last_unstale":"2024-09-19T09:23:01.458113+0000","last_undegraded":"2024-09-19T09:23:01.458113+0000","last_fullsized":"2024-09-19T09:23:01.458113+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:15.253786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.454371+0000","last_change":"2024-09-19T09:23:01.454252+0000","last_active":"2024-09-19T09:23:01.454371+0000","last_peered":"2024-09-19T09:23:01.454371+0000","last_clean":"2024-09-19T09:23:01.454371+0000","last_became_active":"2024-09-19T09:23:01.454020+0000","last_became_peered":"2024-09-19T09:23:01.454020+0000","last_unstale":"2024-09-19T09:23:01.454371+0000","last_undegraded":"2024-09-19T09:23:01.454371+0000","last_fullsized":"2024-09-19T09:23:01.454371+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:34:24.350049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.453057+0000","last_change":"2024-09-19T09:23:01.452913+0000","last_active":"2024-09-19T09:23:01.453057+0000","last_peered":"2024-09-19T09:23:01.453057+0000","last_clean":"2024-09-19T09:23:01.453057+0000","last_became_active":"2024-09-19T09:23:01.452670+0000","last_became_peered":"2024-09-19T09:23:01.452670+0000","last_unstale":"2024-09-19T09:23:01.453057+0000","last_undegraded":"2024-09-19T09:23:01.453057+0000","last_fullsized":"2024-09-19T09:23:01.453057+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:50:19.952758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.457921+0000","last_change":"2024-09-19T09:23:01.457786+0000","last_active":"2024-09-19T09:23:01.457921+0000","last_peered":"2024-09-19T09:23:01.457921+0000","last_clean":"2024-09-19T09:23:01.457921+0000","last_became_active":"2024-09-19T09:23:01.457360+0000","last_became_peered":"2024-09-19T09:23:01.457360+0000","last_unstale":"2024-09-19T09:23:01.457921+0000","last_undegraded":"2024-09-19T09:23:01.457921+0000","last_fullsized":"2024-09-19T09:23:01.457921+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:22:25.294390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.456500+0000","last_change":"2024-09-19T09:23:01.456392+0000","last_active":"2024-09-19T09:23:01.456500+0000","last_peered":"2024-09-19T09:23:01.456500+0000","last_clean":"2024-09-19T09:23:01.456500+0000","last_became_active":"2024-09-19T09:23:01.456001+0000","last_became_peered":"2024-09-19T09:23:01.456001+0000","last_unstale":"2024-09-19T09:23:01.456500+0000","last_undegraded":"2024-09-19T09:23:01.456500+0000","last_fullsized":"2024-09-19T09:23:01.456500+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:19.479919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.453591+0000","last_change":"2024-09-19T09:23:01.453475+0000","last_active":"2024-09-19T09:23:01.453591+0000","last_peered":"2024-09-19T09:23:01.453591+0000","last_clean":"2024-09-19T09:23:01.453591+0000","last_became_active":"2024-09-19T09:23:01.453258+0000","last_became_peered":"2024-09-19T09:23:01.453258+0000","last_unstale":"2024-09-19T09:23:01.453591+0000","last_undegraded":"2024-09-19T09:23:01.453591+0000","last_fullsized":"2024-09-19T09:23:01.453591+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:00.313206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.452378+0000","last_change":"2024-09-19T09:23:01.452267+0000","last_active":"2024-09-19T09:23:01.452378+0000","last_peered":"2024-09-19T09:23:01.452378+0000","last_clean":"2024-09-19T09:23:01.452378+0000","last_became_active":"2024-09-19T09:23:01.452028+0000","last_became_peered":"2024-09-19T09:23:01.452028+0000","last_unstale":"2024-09-19T09:23:01.452378+0000","last_undegraded":"2024-09-19T09:23:01.452378+0000","last_fullsized":"2024-09-19T09:23:01.452378+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:22.228773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.457310+0000","last_change":"2024-09-19T09:23:01.457186+0000","last_active":"2024-09-19T09:23:01.457310+0000","last_peered":"2024-09-19T09:23:01.457310+0000","last_clean":"2024-09-19T09:23:01.457310+0000","last_became_active":"2024-09-19T09:23:01.456932+0000","last_became_peered":"2024-09-19T09:23:01.456932+0000","last_unstale":"2024-09-19T09:23:01.457310+0000","last_undegraded":"2024-09-19T09:23:01.457310+0000","last_fullsized":"2024-09-19T09:23:01.457310+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:40.805087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"166'4","reported_seq":16,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.465042+0000","last_change":"2024-09-19T09:23:00.452733+0000","last_active":"2024-09-19T09:23:01.465042+0000","last_peered":"2024-09-19T09:23:01.465042+0000","last_clean":"2024-09-19T09:23:01.465042+0000","last_became_active":"2024-09-19T09:23:00.452495+0000","last_became_peered":"2024-09-19T09:23:00.452495+0000","last_unstale":"2024-09-19T09:23:01.465042+0000","last_undegraded":"2024-09-19T09:23:01.465042+0000","last_fullsized":"2024-09-19T09:23:01.465042+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:02:30.427609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.454175+0000","last_change":"2024-09-19T09:23:01.454004+0000","last_active":"2024-09-19T09:23:01.454175+0000","last_peered":"2024-09-19T09:23:01.454175+0000","last_clean":"2024-09-19T09:23:01.454175+0000","last_became_active":"2024-09-19T09:23:01.453562+0000","last_became_peered":"2024-09-19T09:23:01.453562+0000","last_unstale":"2024-09-19T09:23:01.454175+0000","last_undegraded":"2024-09-19T09:23:01.454175+0000","last_fullsized":"2024-09-19T09:23:01.454175+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:12:26.736049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.1e","version":"166'1","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.464247+0000","last_change":"2024-09-19T09:23:00.453927+0000","last_active":"2024-09-19T09:23:01.464247+0000","last_peered":"2024-09-19T09:23:01.464247+0000","last_clean":"2024-09-19T09:23:01.464247+0000","last_became_active":"2024-09-19T09:23:00.453031+0000","last_became_peered":"2024-09-19T09:23:00.453031+0000","last_unstale":"2024-09-19T09:23:01.464247+0000","last_undegraded":"2024-09-19T09:23:01.464247+0000","last_fullsized":"2024-09-19T09:23:01.464247+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:24.973657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.457420+0000","last_change":"2024-09-19T09:23:01.456996+0000","last_active":"2024-09-19T09:23:01.457420+0000","last_peered":"2024-09-19T09:23:01.457420+0000","last_clean":"2024-09-19T09:23:01.457420+0000","last_became_active":"2024-09-19T09:23:01.456153+0000","last_became_peered":"2024-09-19T09:23:01.456153+0000","last_unstale":"2024-09-19T09:23:01.457420+0000","last_undegraded":"2024-09-19T09:23:01.457420+0000","last_fullsized":"2024-09-19T09:23:01.457420+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:56:51.854083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.1d","version":"166'2","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.463157+0000","last_change":"2024-09-19T09:23:00.448028+0000","last_active":"2024-09-19T09:23:01.463157+0000","last_peered":"2024-09-19T09:23:01.463157+0000","last_clean":"2024-09-19T09:23:01.463157+0000","last_became_active":"2024-09-19T09:23:00.447774+0000","last_became_peered":"2024-09-19T09:23:00.447774+0000","last_unstale":"2024-09-19T09:23:01.463157+0000","last_undegraded":"2024-09-19T09:23:01.463157+0000","last_fullsized":"2024-09-19T09:23:01.463157+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:31.019005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.449184+0000","last_change":"2024-09-19T09:23:01.449061+0000","last_active":"2024-09-19T09:23:01.449184+0000","last_peered":"2024-09-19T09:23:01.449184+0000","last_clean":"2024-09-19T09:23:01.449184+0000","last_became_active":"2024-09-19T09:23:01.448795+0000","last_became_peered":"2024-09-19T09:23:01.448795+0000","last_unstale":"2024-09-19T09:23:01.449184+0000","last_undegraded":"2024-09-19T09:23:01.449184+0000","last_fullsized":"2024-09-19T09:23:01.449184+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:57:33.762091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1c","version":"166'2","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.460802+0000","last_change":"2024-09-19T09:23:00.449805+0000","last_active":"2024-09-19T09:23:01.460802+0000","last_peered":"2024-09-19T09:23:01.460802+0000","last_clean":"2024-09-19T09:23:01.460802+0000","last_became_active":"2024-09-19T09:23:00.449130+0000","last_became_peered":"2024-09-19T09:23:00.449130+0000","last_unstale":"2024-09-19T09:23:01.460802+0000","last_undegraded":"2024-09-19T09:23:01.460802+0000","last_fullsized":"2024-09-19T09:23:01.460802+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:17:35.860580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.451766+0000","last_change":"2024-09-19T09:23:01.451634+0000","last_active":"2024-09-19T09:23:01.451766+0000","last_peered":"2024-09-19T09:23:01.451766+0000","last_clean":"2024-09-19T09:23:01.451766+0000","last_became_active":"2024-09-19T09:23:01.451407+0000","last_became_peered":"2024-09-19T09:23:01.451407+0000","last_unstale":"2024-09-19T09:23:01.451766+0000","last_undegraded":"2024-09-19T09:23:01.451766+0000","last_fullsized":"2024-09-19T09:23:01.451766+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:58.471413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"166'1","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.464134+0000","last_change":"2024-09-19T09:23:00.453669+0000","last_active":"2024-09-19T09:23:01.464134+0000","last_peered":"2024-09-19T09:23:01.464134+0000","last_clean":"2024-09-19T09:23:01.464134+0000","last_became_active":"2024-09-19T09:23:00.453401+0000","last_became_peered":"2024-09-19T09:23:00.453401+0000","last_unstale":"2024-09-19T09:23:01.464134+0000","last_undegraded":"2024-09-19T09:23:01.464134+0000","last_fullsized":"2024-09-19T09:23:01.464134+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:32.892683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.447155+0000","last_change":"2024-09-19T09:23:01.447009+0000","last_active":"2024-09-19T09:23:01.447155+0000","last_peered":"2024-09-19T09:23:01.447155+0000","last_clean":"2024-09-19T09:23:01.447155+0000","last_became_active":"2024-09-19T09:23:01.446757+0000","last_became_peered":"2024-09-19T09:23:01.446757+0000","last_unstale":"2024-09-19T09:23:01.447155+0000","last_undegraded":"2024-09-19T09:23:01.447155+0000","last_fullsized":"2024-09-19T09:23:01.447155+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:04.793870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1a","version":"166'1","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.460428+0000","last_change":"2024-09-19T09:23:00.449654+0000","last_active":"2024-09-19T09:23:01.460428+0000","last_peered":"2024-09-19T09:23:01.460428+0000","last_clean":"2024-09-19T09:23:01.460428+0000","last_became_active":"2024-09-19T09:23:00.449217+0000","last_became_peered":"2024-09-19T09:23:00.449217+0000","last_unstale":"2024-09-19T09:23:01.460428+0000","last_undegraded":"2024-09-19T09:23:01.460428+0000","last_fullsized":"2024-09-19T09:23:01.460428+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:46.907132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.452406+0000","last_change":"2024-09-19T09:23:01.452320+0000","last_active":"2024-09-19T09:23:01.452406+0000","last_peered":"2024-09-19T09:23:01.452406+0000","last_clean":"2024-09-19T09:23:01.452406+0000","last_became_active":"2024-09-19T09:23:01.452096+0000","last_became_peered":"2024-09-19T09:23:01.452096+0000","last_unstale":"2024-09-19T09:23:01.452406+0000","last_undegraded":"2024-09-19T09:23:01.452406+0000","last_fullsized":"2024-09-19T09:23:01.452406+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:48.449032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.450000+0000","last_change":"2024-09-19T09:23:00.454168+0000","last_active":"2024-09-19T09:23:01.450000+0000","last_peered":"2024-09-19T09:23:01.450000+0000","last_clean":"2024-09-19T09:23:01.450000+0000","last_became_active":"2024-09-19T09:23:00.453412+0000","last_became_peered":"2024-09-19T09:23:00.453412+0000","last_unstale":"2024-09-19T09:23:01.450000+0000","last_undegraded":"2024-09-19T09:23:01.450000+0000","last_fullsized":"2024-09-19T09:23:01.450000+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:42:51.276700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.455785+0000","last_change":"2024-09-19T09:23:01.455615+0000","last_active":"2024-09-19T09:23:01.455785+0000","last_peered":"2024-09-19T09:23:01.455785+0000","last_clean":"2024-09-19T09:23:01.455785+0000","last_became_active":"2024-09-19T09:23:01.455132+0000","last_became_peered":"2024-09-19T09:23:01.455132+0000","last_unstale":"2024-09-19T09:23:01.455785+0000","last_undegraded":"2024-09-19T09:23:01.455785+0000","last_fullsized":"2024-09-19T09:23:01.455785+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:12.066774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.444142+0000","last_change":"2024-09-19T09:23:00.452934+0000","last_active":"2024-09-19T09:23:01.444142+0000","last_peered":"2024-09-19T09:23:01.444142+0000","last_clean":"2024-09-19T09:23:01.444142+0000","last_became_active":"2024-09-19T09:23:00.452536+0000","last_became_peered":"2024-09-19T09:23:00.452536+0000","last_unstale":"2024-09-19T09:23:01.444142+0000","last_undegraded":"2024-09-19T09:23:01.444142+0000","last_fullsized":"2024-09-19T09:23:01.444142+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:29:03.747500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.452731+0000","last_change":"2024-09-19T09:23:01.452607+0000","last_active":"2024-09-19T09:23:01.452731+0000","last_peered":"2024-09-19T09:23:01.452731+0000","last_clean":"2024-09-19T09:23:01.452731+0000","last_became_active":"2024-09-19T09:23:01.452102+0000","last_became_peered":"2024-09-19T09:23:01.452102+0000","last_unstale":"2024-09-19T09:23:01.452731+0000","last_undegraded":"2024-09-19T09:23:01.452731+0000","last_fullsized":"2024-09-19T09:23:01.452731+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:55.807101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.451405+0000","last_change":"2024-09-19T09:23:00.454633+0000","last_active":"2024-09-19T09:23:01.451405+0000","last_peered":"2024-09-19T09:23:01.451405+0000","last_clean":"2024-09-19T09:23:01.451405+0000","last_became_active":"2024-09-19T09:23:00.452709+0000","last_became_peered":"2024-09-19T09:23:00.452709+0000","last_unstale":"2024-09-19T09:23:01.451405+0000","last_undegraded":"2024-09-19T09:23:01.451405+0000","last_fullsized":"2024-09-19T09:23:01.451405+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:09.848844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.459290+0000","last_change":"2024-09-19T09:23:01.459171+0000","last_active":"2024-09-19T09:23:01.459290+0000","last_peered":"2024-09-19T09:23:01.459290+0000","last_clean":"2024-09-19T09:23:01.459290+0000","last_became_active":"2024-09-19T09:23:01.458836+0000","last_became_peered":"2024-09-19T09:23:01.458836+0000","last_unstale":"2024-09-19T09:23:01.459290+0000","last_undegraded":"2024-09-19T09:23:01.459290+0000","last_fullsized":"2024-09-19T09:23:01.459290+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:19.065665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.453002+0000","last_change":"2024-09-19T09:23:00.447496+0000","last_active":"2024-09-19T09:23:01.453002+0000","last_peered":"2024-09-19T09:23:01.453002+0000","last_clean":"2024-09-19T09:23:01.453002+0000","last_became_active":"2024-09-19T09:23:00.447155+0000","last_became_peered":"2024-09-19T09:23:00.447155+0000","last_unstale":"2024-09-19T09:23:01.453002+0000","last_undegraded":"2024-09-19T09:23:01.453002+0000","last_fullsized":"2024-09-19T09:23:01.453002+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:17.671008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.454104+0000","last_change":"2024-09-19T09:23:01.453792+0000","last_active":"2024-09-19T09:23:01.454104+0000","last_peered":"2024-09-19T09:23:01.454104+0000","last_clean":"2024-09-19T09:23:01.454104+0000","last_became_active":"2024-09-19T09:23:01.453221+0000","last_became_peered":"2024-09-19T09:23:01.453221+0000","last_unstale":"2024-09-19T09:23:01.454104+0000","last_undegraded":"2024-09-19T09:23:01.454104+0000","last_fullsized":"2024-09-19T09:23:01.454104+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:16.149132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.14","version":"166'6","reported_seq":18,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.465604+0000","last_change":"2024-09-19T09:23:00.455515+0000","last_active":"2024-09-19T09:23:01.465604+0000","last_peered":"2024-09-19T09:23:01.465604+0000","last_clean":"2024-09-19T09:23:01.465604+0000","last_became_active":"2024-09-19T09:23:00.454330+0000","last_became_peered":"2024-09-19T09:23:00.454330+0000","last_unstale":"2024-09-19T09:23:01.465604+0000","last_undegraded":"2024-09-19T09:23:01.465604+0000","last_fullsized":"2024-09-19T09:23:01.465604+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:29.384902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.453890+0000","last_change":"2024-09-19T09:23:01.453279+0000","last_active":"2024-09-19T09:23:01.453890+0000","last_peered":"2024-09-19T09:23:01.453890+0000","last_clean":"2024-09-19T09:23:01.453890+0000","last_became_active":"2024-09-19T09:23:01.453007+0000","last_became_peered":"2024-09-19T09:23:01.453007+0000","last_unstale":"2024-09-19T09:23:01.453890+0000","last_undegraded":"2024-09-19T09:23:01.453890+0000","last_fullsized":"2024-09-19T09:23:01.453890+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:56.488009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.13","version":"166'2","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.463413+0000","last_change":"2024-09-19T09:23:00.450360+0000","last_active":"2024-09-19T09:23:01.463413+0000","last_peered":"2024-09-19T09:23:01.463413+0000","last_clean":"2024-09-19T09:23:01.463413+0000","last_became_active":"2024-09-19T09:23:00.450081+0000","last_became_peered":"2024-09-19T09:23:00.450081+0000","last_unstale":"2024-09-19T09:23:01.463413+0000","last_undegraded":"2024-09-19T09:23:01.463413+0000","last_fullsized":"2024-09-19T09:23:01.463413+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:47.399272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.458381+0000","last_change":"2024-09-19T09:23:01.458199+0000","last_active":"2024-09-19T09:23:01.458381+0000","last_peered":"2024-09-19T09:23:01.458381+0000","last_clean":"2024-09-19T09:23:01.458381+0000","last_became_active":"2024-09-19T09:23:01.457372+0000","last_became_peered":"2024-09-19T09:23:01.457372+0000","last_unstale":"2024-09-19T09:23:01.458381+0000","last_undegraded":"2024-09-19T09:23:01.458381+0000","last_fullsized":"2024-09-19T09:23:01.458381+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:01.047945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.448255+0000","last_change":"2024-09-19T09:23:00.449492+0000","last_active":"2024-09-19T09:23:01.448255+0000","last_peered":"2024-09-19T09:23:01.448255+0000","last_clean":"2024-09-19T09:23:01.448255+0000","last_became_active":"2024-09-19T09:23:00.449250+0000","last_became_peered":"2024-09-19T09:23:00.449250+0000","last_unstale":"2024-09-19T09:23:01.448255+0000","last_undegraded":"2024-09-19T09:23:01.448255+0000","last_fullsized":"2024-09-19T09:23:01.448255+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:38:34.158850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.447388+0000","last_change":"2024-09-19T09:23:01.447258+0000","last_active":"2024-09-19T09:23:01.447388+0000","last_peered":"2024-09-19T09:23:01.447388+0000","last_clean":"2024-09-19T09:23:01.447388+0000","last_became_active":"2024-09-19T09:23:01.446652+0000","last_became_peered":"2024-09-19T09:23:01.446652+0000","last_unstale":"2024-09-19T09:23:01.447388+0000","last_undegraded":"2024-09-19T09:23:01.447388+0000","last_fullsized":"2024-09-19T09:23:01.447388+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:33.862563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.447857+0000","last_change":"2024-09-19T09:23:00.452494+0000","last_active":"2024-09-19T09:23:01.447857+0000","last_peered":"2024-09-19T09:23:01.447857+0000","last_clean":"2024-09-19T09:23:01.447857+0000","last_became_active":"2024-09-19T09:23:00.451899+0000","last_became_peered":"2024-09-19T09:23:00.451899+0000","last_unstale":"2024-09-19T09:23:01.447857+0000","last_undegraded":"2024-09-19T09:23:01.447857+0000","last_fullsized":"2024-09-19T09:23:01.447857+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:12.769760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.452459+0000","last_change":"2024-09-19T09:23:01.452334+0000","last_active":"2024-09-19T09:23:01.452459+0000","last_peered":"2024-09-19T09:23:01.452459+0000","last_clean":"2024-09-19T09:23:01.452459+0000","last_became_active":"2024-09-19T09:23:01.451685+0000","last_became_peered":"2024-09-19T09:23:01.451685+0000","last_unstale":"2024-09-19T09:23:01.452459+0000","last_undegraded":"2024-09-19T09:23:01.452459+0000","last_fullsized":"2024-09-19T09:23:01.452459+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:53.444171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.10","version":"166'8","reported_seq":20,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.463873+0000","last_change":"2024-09-19T09:23:00.456228+0000","last_active":"2024-09-19T09:23:01.463873+0000","last_peered":"2024-09-19T09:23:01.463873+0000","last_clean":"2024-09-19T09:23:01.463873+0000","last_became_active":"2024-09-19T09:23:00.455953+0000","last_became_peered":"2024-09-19T09:23:00.455953+0000","last_unstale":"2024-09-19T09:23:01.463873+0000","last_undegraded":"2024-09-19T09:23:01.463873+0000","last_fullsized":"2024-09-19T09:23:01.463873+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:12:55.791486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.456839+0000","last_change":"2024-09-19T09:23:01.456084+0000","last_active":"2024-09-19T09:23:01.456839+0000","last_peered":"2024-09-19T09:23:01.456839+0000","last_clean":"2024-09-19T09:23:01.456839+0000","last_became_active":"2024-09-19T09:23:01.455316+0000","last_became_peered":"2024-09-19T09:23:01.455316+0000","last_unstale":"2024-09-19T09:23:01.456839+0000","last_undegraded":"2024-09-19T09:23:01.456839+0000","last_fullsized":"2024-09-19T09:23:01.456839+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:46.840353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.f","version":"166'1","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.465555+0000","last_change":"2024-09-19T09:23:00.456349+0000","last_active":"2024-09-19T09:23:01.465555+0000","last_peered":"2024-09-19T09:23:01.465555+0000","last_clean":"2024-09-19T09:23:01.465555+0000","last_became_active":"2024-09-19T09:23:00.456113+0000","last_became_peered":"2024-09-19T09:23:00.456113+0000","last_unstale":"2024-09-19T09:23:01.465555+0000","last_undegraded":"2024-09-19T09:23:01.465555+0000","last_fullsized":"2024-09-19T09:23:01.465555+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:27.390936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.453610+0000","last_change":"2024-09-19T09:23:01.453485+0000","last_active":"2024-09-19T09:23:01.453610+0000","last_peered":"2024-09-19T09:23:01.453610+0000","last_clean":"2024-09-19T09:23:01.453610+0000","last_became_active":"2024-09-19T09:23:01.453291+0000","last_became_peered":"2024-09-19T09:23:01.453291+0000","last_unstale":"2024-09-19T09:23:01.453610+0000","last_undegraded":"2024-09-19T09:23:01.453610+0000","last_fullsized":"2024-09-19T09:23:01.453610+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:31.847117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.e","version":"166'2","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.462533+0000","last_change":"2024-09-19T09:23:00.452897+0000","last_active":"2024-09-19T09:23:01.462533+0000","last_peered":"2024-09-19T09:23:01.462533+0000","last_clean":"2024-09-19T09:23:01.462533+0000","last_became_active":"2024-09-19T09:23:00.452629+0000","last_became_peered":"2024-09-19T09:23:00.452629+0000","last_unstale":"2024-09-19T09:23:01.462533+0000","last_undegraded":"2024-09-19T09:23:01.462533+0000","last_fullsized":"2024-09-19T09:23:01.462533+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:02.160125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.454174+0000","last_change":"2024-09-19T09:23:01.453952+0000","last_active":"2024-09-19T09:23:01.454174+0000","last_peered":"2024-09-19T09:23:01.454174+0000","last_clean":"2024-09-19T09:23:01.454174+0000","last_became_active":"2024-09-19T09:23:01.453640+0000","last_became_peered":"2024-09-19T09:23:01.453640+0000","last_unstale":"2024-09-19T09:23:01.454174+0000","last_undegraded":"2024-09-19T09:23:01.454174+0000","last_fullsized":"2024-09-19T09:23:01.454174+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:28:42.237264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"166'1","reported_seq":13,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.457660+0000","last_change":"2024-09-19T09:23:00.448560+0000","last_active":"2024-09-19T09:23:01.457660+0000","last_peered":"2024-09-19T09:23:01.457660+0000","last_clean":"2024-09-19T09:23:01.457660+0000","last_became_active":"2024-09-19T09:23:00.448326+0000","last_became_peered":"2024-09-19T09:23:00.448326+0000","last_unstale":"2024-09-19T09:23:01.457660+0000","last_undegraded":"2024-09-19T09:23:01.457660+0000","last_fullsized":"2024-09-19T09:23:01.457660+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:34.868383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.457447+0000","last_change":"2024-09-19T09:23:01.457231+0000","last_active":"2024-09-19T09:23:01.457447+0000","last_peered":"2024-09-19T09:23:01.457447+0000","last_clean":"2024-09-19T09:23:01.457447+0000","last_became_active":"2024-09-19T09:23:01.456584+0000","last_became_peered":"2024-09-19T09:23:01.456584+0000","last_unstale":"2024-09-19T09:23:01.457447+0000","last_undegraded":"2024-09-19T09:23:01.457447+0000","last_fullsized":"2024-09-19T09:23:01.457447+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:59:52.609722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.448015+0000","last_change":"2024-09-19T09:23:00.453620+0000","last_active":"2024-09-19T09:23:01.448015+0000","last_peered":"2024-09-19T09:23:01.448015+0000","last_clean":"2024-09-19T09:23:01.448015+0000","last_became_active":"2024-09-19T09:23:00.453388+0000","last_became_peered":"2024-09-19T09:23:00.453388+0000","last_unstale":"2024-09-19T09:23:01.448015+0000","last_undegraded":"2024-09-19T09:23:01.448015+0000","last_fullsized":"2024-09-19T09:23:01.448015+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:34.726054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.454093+0000","last_change":"2024-09-19T09:23:01.453978+0000","last_active":"2024-09-19T09:23:01.454093+0000","last_peered":"2024-09-19T09:23:01.454093+0000","last_clean":"2024-09-19T09:23:01.454093+0000","last_became_active":"2024-09-19T09:23:01.453647+0000","last_became_peered":"2024-09-19T09:23:01.453647+0000","last_unstale":"2024-09-19T09:23:01.454093+0000","last_undegraded":"2024-09-19T09:23:01.454093+0000","last_fullsized":"2024-09-19T09:23:01.454093+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:08.881085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.b","version":"166'2","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.464770+0000","last_change":"2024-09-19T09:23:00.452061+0000","last_active":"2024-09-19T09:23:01.464770+0000","last_peered":"2024-09-19T09:23:01.464770+0000","last_clean":"2024-09-19T09:23:01.464770+0000","last_became_active":"2024-09-19T09:23:00.451753+0000","last_became_peered":"2024-09-19T09:23:00.451753+0000","last_unstale":"2024-09-19T09:23:01.464770+0000","last_undegraded":"2024-09-19T09:23:01.464770+0000","last_fullsized":"2024-09-19T09:23:01.464770+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:04:00.187365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.456030+0000","last_change":"2024-09-19T09:23:01.455904+0000","last_active":"2024-09-19T09:23:01.456030+0000","last_peered":"2024-09-19T09:23:01.456030+0000","last_clean":"2024-09-19T09:23:01.456030+0000","last_became_active":"2024-09-19T09:23:01.455623+0000","last_became_peered":"2024-09-19T09:23:01.455623+0000","last_unstale":"2024-09-19T09:23:01.456030+0000","last_undegraded":"2024-09-19T09:23:01.456030+0000","last_fullsized":"2024-09-19T09:23:01.456030+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:03.310078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.442744+0000","last_change":"2024-09-19T09:23:00.457121+0000","last_active":"2024-09-19T09:23:01.442744+0000","last_peered":"2024-09-19T09:23:01.442744+0000","last_clean":"2024-09-19T09:23:01.442744+0000","last_became_active":"2024-09-19T09:23:00.456853+0000","last_became_peered":"2024-09-19T09:23:00.456853+0000","last_unstale":"2024-09-19T09:23:01.442744+0000","last_undegraded":"2024-09-19T09:23:01.442744+0000","last_fullsized":"2024-09-19T09:23:01.442744+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:35.084224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.456341+0000","last_change":"2024-09-19T09:23:01.456224+0000","last_active":"2024-09-19T09:23:01.456341+0000","last_peered":"2024-09-19T09:23:01.456341+0000","last_clean":"2024-09-19T09:23:01.456341+0000","last_became_active":"2024-09-19T09:23:01.455966+0000","last_became_peered":"2024-09-19T09:23:01.455966+0000","last_unstale":"2024-09-19T09:23:01.456341+0000","last_undegraded":"2024-09-19T09:23:01.456341+0000","last_fullsized":"2024-09-19T09:23:01.456341+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:44.405947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.441639+0000","last_change":"2024-09-19T09:23:00.452972+0000","last_active":"2024-09-19T09:23:01.441639+0000","last_peered":"2024-09-19T09:23:01.441639+0000","last_clean":"2024-09-19T09:23:01.441639+0000","last_became_active":"2024-09-19T09:23:00.452730+0000","last_became_peered":"2024-09-19T09:23:00.452730+0000","last_unstale":"2024-09-19T09:23:01.441639+0000","last_undegraded":"2024-09-19T09:23:01.441639+0000","last_fullsized":"2024-09-19T09:23:01.441639+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:10.847425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.454697+0000","last_change":"2024-09-19T09:23:01.454529+0000","last_active":"2024-09-19T09:23:01.454697+0000","last_peered":"2024-09-19T09:23:01.454697+0000","last_clean":"2024-09-19T09:23:01.454697+0000","last_became_active":"2024-09-19T09:23:01.453798+0000","last_became_peered":"2024-09-19T09:23:01.453798+0000","last_unstale":"2024-09-19T09:23:01.454697+0000","last_undegraded":"2024-09-19T09:23:01.454697+0000","last_fullsized":"2024-09-19T09:23:01.454697+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:57:26.817603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.441838+0000","last_change":"2024-09-19T09:23:00.452274+0000","last_active":"2024-09-19T09:23:01.441838+0000","last_peered":"2024-09-19T09:23:01.441838+0000","last_clean":"2024-09-19T09:23:01.441838+0000","last_became_active":"2024-09-19T09:23:00.452033+0000","last_became_peered":"2024-09-19T09:23:00.452033+0000","last_unstale":"2024-09-19T09:23:01.441838+0000","last_undegraded":"2024-09-19T09:23:01.441838+0000","last_fullsized":"2024-09-19T09:23:01.441838+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:29.216333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.447675+0000","last_change":"2024-09-19T09:23:01.447515+0000","last_active":"2024-09-19T09:23:01.447675+0000","last_peered":"2024-09-19T09:23:01.447675+0000","last_clean":"2024-09-19T09:23:01.447675+0000","last_became_active":"2024-09-19T09:23:01.447001+0000","last_became_peered":"2024-09-19T09:23:01.447001+0000","last_unstale":"2024-09-19T09:23:01.447675+0000","last_undegraded":"2024-09-19T09:23:01.447675+0000","last_fullsized":"2024-09-19T09:23:01.447675+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:56:12.676702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.7","version":"166'2","reported_seq":14,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.465810+0000","last_change":"2024-09-19T09:23:00.455531+0000","last_active":"2024-09-19T09:23:01.465810+0000","last_peered":"2024-09-19T09:23:01.465810+0000","last_clean":"2024-09-19T09:23:01.465810+0000","last_became_active":"2024-09-19T09:23:00.455289+0000","last_became_peered":"2024-09-19T09:23:00.455289+0000","last_unstale":"2024-09-19T09:23:01.465810+0000","last_undegraded":"2024-09-19T09:23:01.465810+0000","last_fullsized":"2024-09-19T09:23:01.465810+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:27:35.394665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.448010+0000","last_change":"2024-09-19T09:23:01.447860+0000","last_active":"2024-09-19T09:23:01.448010+0000","last_peered":"2024-09-19T09:23:01.448010+0000","last_clean":"2024-09-19T09:23:01.448010+0000","last_became_active":"2024-09-19T09:23:01.447556+0000","last_became_peered":"2024-09-19T09:23:01.447556+0000","last_unstale":"2024-09-19T09:23:01.448010+0000","last_undegraded":"2024-09-19T09:23:01.448010+0000","last_fullsized":"2024-09-19T09:23:01.448010+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:08.004862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.448728+0000","last_change":"2024-09-19T09:23:00.456955+0000","last_active":"2024-09-19T09:23:01.448728+0000","last_peered":"2024-09-19T09:23:01.448728+0000","last_clean":"2024-09-19T09:23:01.448728+0000","last_became_active":"2024-09-19T09:23:00.456699+0000","last_became_peered":"2024-09-19T09:23:00.456699+0000","last_unstale":"2024-09-19T09:23:01.448728+0000","last_undegraded":"2024-09-19T09:23:01.448728+0000","last_fullsized":"2024-09-19T09:23:01.448728+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:48.425624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.458576+0000","last_change":"2024-09-19T09:23:01.458440+0000","last_active":"2024-09-19T09:23:01.458576+0000","last_peered":"2024-09-19T09:23:01.458576+0000","last_clean":"2024-09-19T09:23:01.458576+0000","last_became_active":"2024-09-19T09:23:01.457723+0000","last_became_peered":"2024-09-19T09:23:01.457723+0000","last_unstale":"2024-09-19T09:23:01.458576+0000","last_undegraded":"2024-09-19T09:23:01.458576+0000","last_fullsized":"2024-09-19T09:23:01.458576+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:45:17.757155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.451477+0000","last_change":"2024-09-19T09:23:00.455239+0000","last_active":"2024-09-19T09:23:01.451477+0000","last_peered":"2024-09-19T09:23:01.451477+0000","last_clean":"2024-09-19T09:23:01.451477+0000","last_became_active":"2024-09-19T09:23:00.453512+0000","last_became_peered":"2024-09-19T09:23:00.453512+0000","last_unstale":"2024-09-19T09:23:01.451477+0000","last_undegraded":"2024-09-19T09:23:01.451477+0000","last_fullsized":"2024-09-19T09:23:01.451477+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:10.616087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.458774+0000","last_change":"2024-09-19T09:23:01.458650+0000","last_active":"2024-09-19T09:23:01.458774+0000","last_peered":"2024-09-19T09:23:01.458774+0000","last_clean":"2024-09-19T09:23:01.458774+0000","last_became_active":"2024-09-19T09:23:01.458178+0000","last_became_peered":"2024-09-19T09:23:01.458178+0000","last_unstale":"2024-09-19T09:23:01.458774+0000","last_undegraded":"2024-09-19T09:23:01.458774+0000","last_fullsized":"2024-09-19T09:23:01.458774+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:47.007646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.452219+0000","last_change":"2024-09-19T09:23:00.454207+0000","last_active":"2024-09-19T09:23:01.452219+0000","last_peered":"2024-09-19T09:23:01.452219+0000","last_clean":"2024-09-19T09:23:01.452219+0000","last_became_active":"2024-09-19T09:23:00.453975+0000","last_became_peered":"2024-09-19T09:23:00.453975+0000","last_unstale":"2024-09-19T09:23:01.452219+0000","last_undegraded":"2024-09-19T09:23:01.452219+0000","last_fullsized":"2024-09-19T09:23:01.452219+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:25.742421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.458247+0000","last_change":"2024-09-19T09:23:01.457225+0000","last_active":"2024-09-19T09:23:01.458247+0000","last_peered":"2024-09-19T09:23:01.458247+0000","last_clean":"2024-09-19T09:23:01.458247+0000","last_became_active":"2024-09-19T09:23:01.456988+0000","last_became_peered":"2024-09-19T09:23:01.456988+0000","last_unstale":"2024-09-19T09:23:01.458247+0000","last_undegraded":"2024-09-19T09:23:01.458247+0000","last_fullsized":"2024-09-19T09:23:01.458247+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:53:49.656570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.448953+0000","last_change":"2024-09-19T09:23:00.452384+0000","last_active":"2024-09-19T09:23:01.448953+0000","last_peered":"2024-09-19T09:23:01.448953+0000","last_clean":"2024-09-19T09:23:01.448953+0000","last_became_active":"2024-09-19T09:23:00.452123+0000","last_became_peered":"2024-09-19T09:23:00.452123+0000","last_unstale":"2024-09-19T09:23:01.448953+0000","last_undegraded":"2024-09-19T09:23:01.448953+0000","last_fullsized":"2024-09-19T09:23:01.448953+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:48:13.911455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.456442+0000","last_change":"2024-09-19T09:23:01.456253+0000","last_active":"2024-09-19T09:23:01.456442+0000","last_peered":"2024-09-19T09:23:01.456442+0000","last_clean":"2024-09-19T09:23:01.456442+0000","last_became_active":"2024-09-19T09:23:01.456001+0000","last_became_peered":"2024-09-19T09:23:01.456001+0000","last_unstale":"2024-09-19T09:23:01.456442+0000","last_undegraded":"2024-09-19T09:23:01.456442+0000","last_fullsized":"2024-09-19T09:23:01.456442+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:48.794284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.443047+0000","last_change":"2024-09-19T09:23:00.448653+0000","last_active":"2024-09-19T09:23:01.443047+0000","last_peered":"2024-09-19T09:23:01.443047+0000","last_clean":"2024-09-19T09:23:01.443047+0000","last_became_active":"2024-09-19T09:23:00.448411+0000","last_became_peered":"2024-09-19T09:23:00.448411+0000","last_unstale":"2024-09-19T09:23:01.443047+0000","last_undegraded":"2024-09-19T09:23:01.443047+0000","last_fullsized":"2024-09-19T09:23:01.443047+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:00.961580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.455662+0000","last_change":"2024-09-19T09:23:01.455419+0000","last_active":"2024-09-19T09:23:01.455662+0000","last_peered":"2024-09-19T09:23:01.455662+0000","last_clean":"2024-09-19T09:23:01.455662+0000","last_became_active":"2024-09-19T09:23:01.454798+0000","last_became_peered":"2024-09-19T09:23:01.454798+0000","last_unstale":"2024-09-19T09:23:01.455662+0000","last_undegraded":"2024-09-19T09:23:01.455662+0000","last_fullsized":"2024-09-19T09:23:01.455662+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:38:34.925089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.446542+0000","last_change":"2024-09-19T09:23:00.451376+0000","last_active":"2024-09-19T09:23:01.446542+0000","last_peered":"2024-09-19T09:23:01.446542+0000","last_clean":"2024-09-19T09:23:01.446542+0000","last_became_active":"2024-09-19T09:23:00.451094+0000","last_became_peered":"2024-09-19T09:23:00.451094+0000","last_unstale":"2024-09-19T09:23:01.446542+0000","last_undegraded":"2024-09-19T09:23:01.446542+0000","last_fullsized":"2024-09-19T09:23:01.446542+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:49.866359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.448732+0000","last_change":"2024-09-19T09:23:01.448303+0000","last_active":"2024-09-19T09:23:01.448732+0000","last_peered":"2024-09-19T09:23:01.448732+0000","last_clean":"2024-09-19T09:23:01.448732+0000","last_became_active":"2024-09-19T09:23:01.448069+0000","last_became_peered":"2024-09-19T09:23:01.448069+0000","last_unstale":"2024-09-19T09:23:01.448732+0000","last_undegraded":"2024-09-19T09:23:01.448732+0000","last_fullsized":"2024-09-19T09:23:01.448732+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:22.797530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":12,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.450149+0000","last_change":"2024-09-19T09:23:00.453692+0000","last_active":"2024-09-19T09:23:01.450149+0000","last_peered":"2024-09-19T09:23:01.450149+0000","last_clean":"2024-09-19T09:23:01.450149+0000","last_became_active":"2024-09-19T09:23:00.452662+0000","last_became_peered":"2024-09-19T09:23:00.452662+0000","last_unstale":"2024-09-19T09:23:01.450149+0000","last_undegraded":"2024-09-19T09:23:01.450149+0000","last_fullsized":"2024-09-19T09:23:01.450149+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:40.707952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.460380+0000","last_change":"2024-09-19T09:23:01.460036+0000","last_active":"2024-09-19T09:23:01.460380+0000","last_peered":"2024-09-19T09:23:01.460380+0000","last_clean":"2024-09-19T09:23:01.460380+0000","last_became_active":"2024-09-19T09:23:01.459765+0000","last_became_peered":"2024-09-19T09:23:01.459765+0000","last_unstale":"2024-09-19T09:23:01.460380+0000","last_undegraded":"2024-09-19T09:23:01.460380+0000","last_fullsized":"2024-09-19T09:23:01.460380+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:23:00.432238+0000","last_clean_scrub_stamp":"2024-09-19T09:23:00.432238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:46:53.593459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.15","version":"166'3","reported_seq":15,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.462064+0000","last_change":"2024-09-19T09:23:00.452768+0000","last_active":"2024-09-19T09:23:01.462064+0000","last_peered":"2024-09-19T09:23:01.462064+0000","last_clean":"2024-09-19T09:23:01.462064+0000","last_became_active":"2024-09-19T09:23:00.452541+0000","last_became_peered":"2024-09-19T09:23:00.452541+0000","last_unstale":"2024-09-19T09:23:01.462064+0000","last_undegraded":"2024-09-19T09:23:01.462064+0000","last_fullsized":"2024-09-19T09:23:01.462064+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":164,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:22:59.425661+0000","last_clean_scrub_stamp":"2024-09-19T09:22:59.425661+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:11.104801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":454,"reported_epoch":166,"state":"active+clean","last_fresh":"2024-09-19T09:23:01.449183+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:23:01.449183+0000","last_peered":"2024-09-19T09:23:01.449183+0000","last_clean":"2024-09-19T09:23:01.449183+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:23:01.449183+0000","last_undegraded":"2024-09-19T09:23:01.449183+0000","last_fullsized":"2024-09-19T09:23:01.449183+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:28.823470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574967,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":899,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194412,"statfs":{"total":200000000,"available":199078545,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574967,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":899,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194412,"statfs":{"total":200000000,"available":199078545,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574967,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1476,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193836,"statfs":{"total":200000000,"available":198488177,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574967,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":899,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194412,"statfs":{"total":200000000,"available":199078545,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574967,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":899,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194412,"statfs":{"total":200000000,"available":199078545,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574967,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":899,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194412,"statfs":{"total":200000000,"available":199078545,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574967,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1476,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193836,"statfs":{"total":200000000,"available":198488177,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574967,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":899,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194412,"statfs":{"total":200000000,"available":199078545,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:23:05.799 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T09:23:05.800 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-19T09:23:05.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.944+0000 7f5dd6d11640 1 Processor -- start 2024-09-19T09:23:05.945 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.944+0000 7f5dd6d11640 1 -- start start 2024-09-19T09:23:05.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.945+0000 7f5dd6d11640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5dd006e280 0x7f5dd0073370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.945+0000 7f5dd6d11640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dd00722d0 con 0x7f5dd0071df0 2024-09-19T09:23:05.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.945+0000 7f5dd6d11640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dd00725b0 con 0x7f5dd00d1010 2024-09-19T09:23:05.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.945+0000 7f5dd6d11640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f5dd00738b0 con 0x7f5dd006e280 2024-09-19T09:23:05.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.945+0000 7f5dc7fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f5dd0071df0 0x7f5dd006e660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55834/0 (socket says 172.21.15.18:55834) 2024-09-19T09:23:05.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.945+0000 7f5dc7fff640 1 -- 172.21.15.18:0/1222219899 learned_addr learned my addr 172.21.15.18:0/1222219899 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:23:05.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.945+0000 7f5dc77fe640 1 -- 172.21.15.18:0/1222219899 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3511501461 0 0) 0x7f5dd00722d0 con 0x7f5dd0071df0 2024-09-19T09:23:05.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.945+0000 7f5dd4aad640 1 --2- 172.21.15.18:0/1222219899 >> v2:172.21.15.162:3300/0 conn(0x7f5dd006e280 0x7f5dd0073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.945+0000 7f5dc77fe640 1 -- 172.21.15.18:0/1222219899 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5db8003520 con 0x7f5dd0071df0 2024-09-19T09:23:05.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.946+0000 7f5dc77fe640 1 -- 172.21.15.18:0/1222219899 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 807454356 0 0) 0x7f5db8003520 con 0x7f5dd0071df0 2024-09-19T09:23:05.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.946+0000 7f5dc77fe640 1 -- 172.21.15.18:0/1222219899 >> v2:172.21.15.162:3300/0 conn(0x7f5dd006e280 msgr2=0x7f5dd0073370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:05.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.946+0000 7f5dc77fe640 1 --2- 172.21.15.18:0/1222219899 >> v2:172.21.15.162:3300/0 conn(0x7f5dd006e280 0x7f5dd0073370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.946+0000 7f5dc77fe640 1 -- 172.21.15.18:0/1222219899 >> v1:172.21.15.162:6789/0 conn(0x7f5dd00d1010 legacy=0x7f5dd00ce3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.946+0000 7f5dc77fe640 1 -- 172.21.15.18:0/1222219899 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd0072890 con 0x7f5dd0071df0 2024-09-19T09:23:05.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.946+0000 7f5dc77fe640 1 -- 172.21.15.18:0/1222219899 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f5dc0001670 con 0x7f5dd0071df0 2024-09-19T09:23:05.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.946+0000 7f5dc77fe640 1 -- 172.21.15.18:0/1222219899 >> v1:172.21.15.18:6789/0 conn(0x7f5dd0071df0 legacy=0x7f5dd006e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.946+0000 7f5dc77fe640 1 --2- 172.21.15.18:0/1222219899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5db80039b0 0x7f5db8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.946+0000 7f5dc77fe640 1 --2- 172.21.15.18:0/1222219899 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5db8004800 0x7f5db8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.946+0000 7f5dc77fe640 1 --2- 172.21.15.18:0/1222219899 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5db80051c0 0x7f5db800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.946+0000 7f5dc77fe640 1 -- 172.21.15.18:0/1222219899 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd00738b0 con 0x7f5db80039b0 2024-09-19T09:23:05.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.946+0000 7f5dc77fe640 1 -- 172.21.15.18:0/1222219899 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5db800c060 con 0x7f5db8004800 2024-09-19T09:23:05.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.946+0000 7f5dc77fe640 1 -- 172.21.15.18:0/1222219899 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5db800c260 con 0x7f5db80051c0 2024-09-19T09:23:05.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.946+0000 7f5dd4aad640 1 --2- 172.21.15.18:0/1222219899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5db80039b0 0x7f5db8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.946+0000 7f5dc7fff640 1 --2- 172.21.15.18:0/1222219899 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5db8004800 0x7f5db8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.946+0000 7f5dd52ae640 1 --2- 172.21.15.18:0/1222219899 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5db80051c0 0x7f5db800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.946+0000 7f5dd4aad640 1 -- 172.21.15.18:0/1222219899 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5db80051c0 msgr2=0x7f5db800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:05.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.946+0000 7f5dd4aad640 1 --2- 172.21.15.18:0/1222219899 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5db80051c0 0x7f5db800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.946+0000 7f5dd4aad640 1 -- 172.21.15.18:0/1222219899 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5db8004800 msgr2=0x7f5db8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:05.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.946+0000 7f5dd4aad640 1 --2- 172.21.15.18:0/1222219899 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5db8004800 0x7f5db8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.946+0000 7f5dd4aad640 1 -- 172.21.15.18:0/1222219899 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db8003520 con 0x7f5db80039b0 2024-09-19T09:23:05.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.946+0000 7f5dd52ae640 1 -- 172.21.15.18:0/1222219899 reap_dead start 2024-09-19T09:23:05.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.947+0000 7f5dd4aad640 1 --2- 172.21.15.18:0/1222219899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5db80039b0 0x7f5db8003dd0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc009fc0 tx=0x7f5db8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d27b90c6135049 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:05.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.947+0000 7f5dc77fe640 1 -- 172.21.15.18:0/1222219899 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc009c10 con 0x7f5db80039b0 2024-09-19T09:23:05.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.947+0000 7f5dc77fe640 1 -- 172.21.15.18:0/1222219899 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dcc036070 con 0x7f5db80039b0 2024-09-19T09:23:05.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.947+0000 7f5dc77fe640 1 -- 172.21.15.18:0/1222219899 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc031880 con 0x7f5db80039b0 2024-09-19T09:23:05.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.948+0000 7f5dd6d11640 1 -- 172.21.15.18:0/1222219899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5db80039b0 msgr2=0x7f5db8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.948+0000 7f5dd6d11640 1 --2- 172.21.15.18:0/1222219899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5db80039b0 0x7f5db8003dd0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc009fc0 tx=0x7f5db8005830 comp rx=0 tx=0).stop 2024-09-19T09:23:05.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.948+0000 7f5dd6d11640 1 -- 172.21.15.18:0/1222219899 shutdown_connections 2024-09-19T09:23:05.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.948+0000 7f5dd6d11640 1 --2- 172.21.15.18:0/1222219899 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5db80039b0 0x7f5db8003dd0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.948+0000 7f5dd6d11640 1 -- 172.21.15.18:0/1222219899 >> 172.21.15.18:0/1222219899 conn(0x7f5dd006bc10 msgr2=0x7f5dd006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:05.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.948+0000 7f5dd6d11640 1 -- 172.21.15.18:0/1222219899 shutdown_connections 2024-09-19T09:23:05.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.948+0000 7f5dd6d11640 1 -- 172.21.15.18:0/1222219899 wait complete. 2024-09-19T09:23:05.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.949+0000 7f5dd6d11640 1 Processor -- start 2024-09-19T09:23:05.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.949+0000 7f5dd6d11640 1 -- start start 2024-09-19T09:23:05.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.950+0000 7f5dd6d11640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5db80039b0 0x7f5dd014a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.950+0000 7f5dd6d11640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dd01581e0 0x7f5dd01f4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.950+0000 7f5dd6d11640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5dd0155060 0x7f5dd015b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.950+0000 7f5dd6d11640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd00d14c0 con 0x7f5dd01581e0 2024-09-19T09:23:05.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.950+0000 7f5dd6d11640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd0072e50 con 0x7f5db80039b0 2024-09-19T09:23:05.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.950+0000 7f5dd6d11640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5dd00d1640 con 0x7f5dd0155060 2024-09-19T09:23:05.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.950+0000 7f5dc7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dd01581e0 0x7f5dd01f4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.950+0000 7f5dc7fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dd01581e0 0x7f5dd01f4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36162/0 (socket says 172.21.15.18:36162) 2024-09-19T09:23:05.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.950+0000 7f5dc7fff640 1 -- 172.21.15.18:0/515333530 learned_addr learned my addr 172.21.15.18:0/515333530 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:23:05.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.950+0000 7f5dd52ae640 1 --2- 172.21.15.18:0/515333530 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5dd0155060 0x7f5dd015b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.950+0000 7f5dd4aad640 1 --2- 172.21.15.18:0/515333530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5db80039b0 0x7f5dd014a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.950+0000 7f5dc7fff640 1 -- 172.21.15.18:0/515333530 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5dd0155060 msgr2=0x7f5dd015b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.950+0000 7f5dc7fff640 1 --2- 172.21.15.18:0/515333530 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5dd0155060 0x7f5dd015b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.950+0000 7f5dc7fff640 1 -- 172.21.15.18:0/515333530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5db80039b0 msgr2=0x7f5dd014a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:05.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.950+0000 7f5dc7fff640 1 --2- 172.21.15.18:0/515333530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5db80039b0 0x7f5dd014a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:05.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.950+0000 7f5dc7fff640 1 -- 172.21.15.18:0/515333530 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd014a6d0 con 0x7f5dd01581e0 2024-09-19T09:23:05.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.950+0000 7f5dd52ae640 1 --2- 172.21.15.18:0/515333530 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5dd0155060 0x7f5dd015b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:05.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.950+0000 7f5dd4aad640 1 --2- 172.21.15.18:0/515333530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5db80039b0 0x7f5dd014a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:05.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.950+0000 7f5dc7fff640 1 --2- 172.21.15.18:0/515333530 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dd01581e0 0x7f5dd01f4750 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f5dc00072c0 tx=0x7f5dc0007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:05.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.950+0000 7f5dc57fa640 1 -- 172.21.15.18:0/515333530 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc000f8e0 con 0x7f5dd01581e0 2024-09-19T09:23:05.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.951+0000 7f5dc57fa640 1 -- 172.21.15.18:0/515333530 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dc0018070 con 0x7f5dd01581e0 2024-09-19T09:23:05.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.951+0000 7f5dd6d11640 1 -- 172.21.15.18:0/515333530 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dd00b41c0 con 0x7f5dd01581e0 2024-09-19T09:23:05.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.951+0000 7f5dc57fa640 1 -- 172.21.15.18:0/515333530 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc000fcc0 con 0x7f5dd01581e0 2024-09-19T09:23:05.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.951+0000 7f5dd6d11640 1 -- 172.21.15.18:0/515333530 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dd00b4780 con 0x7f5dd01581e0 2024-09-19T09:23:05.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.952+0000 7f5dd6d11640 1 -- 172.21.15.18:0/515333530 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dd0073370 con 0x7f5dd01581e0 2024-09-19T09:23:05.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.952+0000 7f5dc57fa640 1 -- 172.21.15.18:0/515333530 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5dc001d460 con 0x7f5dd01581e0 2024-09-19T09:23:05.959 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.953+0000 7f5dc57fa640 1 --2- 172.21.15.18:0/515333530 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5dbc06c2b0 0x7f5dbc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:05.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.953+0000 7f5dc57fa640 1 -- 172.21.15.18:0/515333530 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f5dc008b470 con 0x7f5dd01581e0 2024-09-19T09:23:05.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.953+0000 7f5dd4aad640 1 --2- 172.21.15.18:0/515333530 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5dbc06c2b0 0x7f5dbc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:05.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.953+0000 7f5dd4aad640 1 --2- 172.21.15.18:0/515333530 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5dbc06c2b0 0x7f5dbc06e770 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc035000 tx=0x7f5dcc02f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:05.960 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:05.957+0000 7f5dc57fa640 1 -- 172.21.15.18:0/515333530 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5dc000fe60 con 0x7f5dd01581e0 2024-09-19T09:23:06.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.199+0000 7f5dd6d11640 1 -- 172.21.15.18:0/515333530 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f5dd00ce710 con 0x7f5dd01581e0 2024-09-19T09:23:06.202 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.201+0000 7f5dc57fa640 1 -- 172.21.15.18:0/515333530 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) ==== 190+0+147 (secure 0 0 0) 0x7f5dc0059c70 con 0x7f5dd01581e0 2024-09-19T09:23:06.202 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-09-19T09:23:06.202 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAe6+tmcbwDNhAAaG0+wu96Locwws+h0zeh8Q== 2024-09-19T09:23:06.202 INFO:teuthology.orchestra.run.smithi018.stdout: caps mds = "allow" 2024-09-19T09:23:06.202 INFO:teuthology.orchestra.run.smithi018.stdout: caps mon = "allow r" 2024-09-19T09:23:06.202 INFO:teuthology.orchestra.run.smithi018.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-19T09:23:06.203 INFO:teuthology.orchestra.run.smithi018.stderr:updated caps for client.0 2024-09-19T09:23:06.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.203+0000 7f5dd6d11640 1 -- 172.21.15.18:0/515333530 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5dbc06c2b0 msgr2=0x7f5dbc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:06.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.203+0000 7f5dd6d11640 1 --2- 172.21.15.18:0/515333530 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5dbc06c2b0 0x7f5dbc06e770 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc035000 tx=0x7f5dcc02f000 comp rx=0 tx=0).stop 2024-09-19T09:23:06.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.203+0000 7f5dd6d11640 1 -- 172.21.15.18:0/515333530 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dd01581e0 msgr2=0x7f5dd01f4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:06.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.203+0000 7f5dd6d11640 1 --2- 172.21.15.18:0/515333530 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dd01581e0 0x7f5dd01f4750 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f5dc00072c0 tx=0x7f5dc0007780 comp rx=0 tx=0).stop 2024-09-19T09:23:06.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.203+0000 7f5dd6d11640 1 -- 172.21.15.18:0/515333530 shutdown_connections 2024-09-19T09:23:06.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.203+0000 7f5dd6d11640 1 --2- 172.21.15.18:0/515333530 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5dbc06c2b0 0x7f5dbc06e770 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.203+0000 7f5dd6d11640 1 --2- 172.21.15.18:0/515333530 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5dd0155060 0x7f5dd015b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.203+0000 7f5dd6d11640 1 --2- 172.21.15.18:0/515333530 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5dd01581e0 0x7f5dd01f4750 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.203+0000 7f5dd6d11640 1 --2- 172.21.15.18:0/515333530 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5db80039b0 0x7f5dd014a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.203+0000 7f5dd6d11640 1 -- 172.21.15.18:0/515333530 >> 172.21.15.18:0/515333530 conn(0x7f5dd006bc10 msgr2=0x7f5dd015a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:06.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.203+0000 7f5dd6d11640 1 -- 172.21.15.18:0/515333530 shutdown_connections 2024-09-19T09:23:06.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.203+0000 7f5dd6d11640 1 -- 172.21.15.18:0/515333530 wait complete. 2024-09-19T09:23:06.217 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:23:06.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.318+0000 7f548518f640 1 Processor -- start 2024-09-19T09:23:06.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.318+0000 7f548518f640 1 -- start start 2024-09-19T09:23:06.322 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.319+0000 7f548518f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f548006d730 0x7f54800b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:06.323 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.319+0000 7f548518f640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54800cd1a0 con 0x7f548015ef80 2024-09-19T09:23:06.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.319+0000 7f548518f640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f548006dc30 con 0x7f54800cfae0 2024-09-19T09:23:06.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.319+0000 7f548518f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f54800cd7d0 con 0x7f548006d730 2024-09-19T09:23:06.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.319+0000 7f547ed9d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f548015ef80 0x7f54800cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55850/0 (socket says 172.21.15.18:55850) 2024-09-19T09:23:06.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.319+0000 7f547ed9d640 1 -- 172.21.15.18:0/3500006652 learned_addr learned my addr 172.21.15.18:0/3500006652 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:23:06.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.319+0000 7f547f59e640 1 --2- 172.21.15.18:0/3500006652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f548006d730 0x7f54800b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:06.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.319+0000 7f547dd9b640 1 -- 172.21.15.18:0/3500006652 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4080983872 0 0) 0x7f54800cd1a0 con 0x7f548015ef80 2024-09-19T09:23:06.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.319+0000 7f547dd9b640 1 -- 172.21.15.18:0/3500006652 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f546c003520 con 0x7f548015ef80 2024-09-19T09:23:06.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.320+0000 7f547dd9b640 1 -- 172.21.15.18:0/3500006652 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1270721597 0 0) 0x7f548006dc30 con 0x7f54800cfae0 2024-09-19T09:23:06.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.320+0000 7f547dd9b640 1 -- 172.21.15.18:0/3500006652 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54800cd1a0 con 0x7f54800cfae0 2024-09-19T09:23:06.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.320+0000 7f547dd9b640 1 -- 172.21.15.18:0/3500006652 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4251578672 0 0) 0x7f546c003520 con 0x7f548015ef80 2024-09-19T09:23:06.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.320+0000 7f547dd9b640 1 -- 172.21.15.18:0/3500006652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f548006d730 msgr2=0x7f54800b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:06.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.320+0000 7f547dd9b640 1 --2- 172.21.15.18:0/3500006652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f548006d730 0x7f54800b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.320+0000 7f547dd9b640 1 -- 172.21.15.18:0/3500006652 >> v1:172.21.15.162:6789/0 conn(0x7f54800cfae0 legacy=0x7f54800cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:06.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.320+0000 7f547dd9b640 1 -- 172.21.15.18:0/3500006652 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f548006df10 con 0x7f548015ef80 2024-09-19T09:23:06.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.320+0000 7f547dd9b640 1 -- 172.21.15.18:0/3500006652 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f54700019f0 con 0x7f548015ef80 2024-09-19T09:23:06.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.320+0000 7f547dd9b640 1 -- 172.21.15.18:0/3500006652 >> v1:172.21.15.18:6789/0 conn(0x7f548015ef80 legacy=0x7f54800cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:06.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.320+0000 7f547dd9b640 1 --2- 172.21.15.18:0/3500006652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f546c003b70 0x7f546c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:06.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.320+0000 7f547dd9b640 1 --2- 172.21.15.18:0/3500006652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f548006d730 0x7f546c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:06.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.320+0000 7f547dd9b640 1 --2- 172.21.15.18:0/3500006652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f546c004d40 0x7f546c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:06.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.320+0000 7f547dd9b640 1 -- 172.21.15.18:0/3500006652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f54800cd7d0 con 0x7f546c003b70 2024-09-19T09:23:06.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.320+0000 7f547dd9b640 1 -- 172.21.15.18:0/3500006652 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f546c00baa0 con 0x7f546c004d40 2024-09-19T09:23:06.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.320+0000 7f547dd9b640 1 -- 172.21.15.18:0/3500006652 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f546c00bca0 con 0x7f548006d730 2024-09-19T09:23:06.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.320+0000 7f547ed9d640 1 --2- 172.21.15.18:0/3500006652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f546c003b70 0x7f546c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:06.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.320+0000 7f547e59c640 1 --2- 172.21.15.18:0/3500006652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f548006d730 0x7f546c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:06.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.320+0000 7f547f59e640 1 --2- 172.21.15.18:0/3500006652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f546c004d40 0x7f546c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:06.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.320+0000 7f547ed9d640 1 -- 172.21.15.18:0/3500006652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f548006d730 msgr2=0x7f546c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:06.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.320+0000 7f547ed9d640 1 --2- 172.21.15.18:0/3500006652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f548006d730 0x7f546c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.320+0000 7f547ed9d640 1 -- 172.21.15.18:0/3500006652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f546c004d40 msgr2=0x7f546c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:06.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.320+0000 7f547ed9d640 1 --2- 172.21.15.18:0/3500006652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f546c004d40 0x7f546c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.320+0000 7f547ed9d640 1 -- 172.21.15.18:0/3500006652 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f546c003520 con 0x7f546c003b70 2024-09-19T09:23:06.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.320+0000 7f547f59e640 1 --2- 172.21.15.18:0/3500006652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f546c004d40 0x7f546c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:06.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.320+0000 7f547e59c640 1 --2- 172.21.15.18:0/3500006652 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f548006d730 0x7f546c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:06.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.321+0000 7f547ed9d640 1 --2- 172.21.15.18:0/3500006652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f546c003b70 0x7f546c003f70 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f547000a760 tx=0x7f546c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5497219049de02a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:06.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.321+0000 7f547dd9b640 1 -- 172.21.15.18:0/3500006652 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f547000a3b0 con 0x7f546c003b70 2024-09-19T09:23:06.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.321+0000 7f547dd9b640 1 -- 172.21.15.18:0/3500006652 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f547002f070 con 0x7f546c003b70 2024-09-19T09:23:06.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.321+0000 7f547dd9b640 1 -- 172.21.15.18:0/3500006652 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f547002bbe0 con 0x7f546c003b70 2024-09-19T09:23:06.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.322+0000 7f548518f640 1 -- 172.21.15.18:0/3500006652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f546c003b70 msgr2=0x7f546c003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:06.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.322+0000 7f548518f640 1 --2- 172.21.15.18:0/3500006652 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f546c003b70 0x7f546c003f70 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f547000a760 tx=0x7f546c005830 comp rx=0 tx=0).stop 2024-09-19T09:23:06.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.322+0000 7f547f59e640 1 -- 172.21.15.18:0/3500006652 reap_dead start 2024-09-19T09:23:06.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.322+0000 7f548518f640 1 -- 172.21.15.18:0/3500006652 shutdown_connections 2024-09-19T09:23:06.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.322+0000 7f548518f640 1 -- 172.21.15.18:0/3500006652 >> 172.21.15.18:0/3500006652 conn(0x7f54800b4700 msgr2=0x7f54800b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:06.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.322+0000 7f548518f640 1 -- 172.21.15.18:0/3500006652 shutdown_connections 2024-09-19T09:23:06.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.322+0000 7f548518f640 1 -- 172.21.15.18:0/3500006652 wait complete. 2024-09-19T09:23:06.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.323+0000 7f548518f640 1 Processor -- start 2024-09-19T09:23:06.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.323+0000 7f548518f640 1 -- start start 2024-09-19T09:23:06.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.324+0000 7f548518f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f546c003b70 0x7f54800c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:06.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.324+0000 7f548518f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54800c9100 0x7f54800cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:06.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.324+0000 7f548518f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f548015d0d0 0x7f548015d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:06.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.324+0000 7f548518f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f54800d0120 con 0x7f546c003b70 2024-09-19T09:23:06.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.324+0000 7f548518f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f548015f360 con 0x7f54800c9100 2024-09-19T09:23:06.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.324+0000 7f548518f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f54800b5220 con 0x7f548015d0d0 2024-09-19T09:23:06.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.324+0000 7f547ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f546c003b70 0x7f54800c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:06.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.324+0000 7f547ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f546c003b70 0x7f54800c7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36190/0 (socket says 172.21.15.18:36190) 2024-09-19T09:23:06.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.324+0000 7f547ed9d640 1 -- 172.21.15.18:0/935417270 learned_addr learned my addr 172.21.15.18:0/935417270 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:23:06.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.324+0000 7f547e59c640 1 --2- 172.21.15.18:0/935417270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54800c9100 0x7f54800cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:06.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.324+0000 7f547f59e640 1 --2- 172.21.15.18:0/935417270 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f548015d0d0 0x7f548015d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:06.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.324+0000 7f547ed9d640 1 -- 172.21.15.18:0/935417270 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f548015d0d0 msgr2=0x7f548015d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:06.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.324+0000 7f547ed9d640 1 --2- 172.21.15.18:0/935417270 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f548015d0d0 0x7f548015d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.324+0000 7f547ed9d640 1 -- 172.21.15.18:0/935417270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54800c9100 msgr2=0x7f54800cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:06.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.324+0000 7f547ed9d640 1 --2- 172.21.15.18:0/935417270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54800c9100 0x7f54800cb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.324+0000 7f547ed9d640 1 -- 172.21.15.18:0/935417270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f548015da90 con 0x7f546c003b70 2024-09-19T09:23:06.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.325+0000 7f547ed9d640 1 --2- 172.21.15.18:0/935417270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f546c003b70 0x7f54800c7bf0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f547000a760 tx=0x7f5470001cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:06.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.325+0000 7f54777fe640 1 -- 172.21.15.18:0/935417270 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f547000a3b0 con 0x7f546c003b70 2024-09-19T09:23:06.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.325+0000 7f54777fe640 1 -- 172.21.15.18:0/935417270 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5470004b60 con 0x7f546c003b70 2024-09-19T09:23:06.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.325+0000 7f548518f640 1 -- 172.21.15.18:0/935417270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54800c8130 con 0x7f546c003b70 2024-09-19T09:23:06.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.325+0000 7f54777fe640 1 -- 172.21.15.18:0/935417270 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5470005020 con 0x7f546c003b70 2024-09-19T09:23:06.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.325+0000 7f548518f640 1 -- 172.21.15.18:0/935417270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54800c7110 con 0x7f546c003b70 2024-09-19T09:23:06.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.326+0000 7f548518f640 1 -- 172.21.15.18:0/935417270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f548006dc30 con 0x7f546c003b70 2024-09-19T09:23:06.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.326+0000 7f54777fe640 1 -- 172.21.15.18:0/935417270 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f54700051c0 con 0x7f546c003b70 2024-09-19T09:23:06.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.327+0000 7f54777fe640 1 --2- 172.21.15.18:0/935417270 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f546006c2b0 0x7f546006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:06.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.327+0000 7f54777fe640 1 -- 172.21.15.18:0/935417270 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f54700ab9f0 con 0x7f546c003b70 2024-09-19T09:23:06.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.327+0000 7f547e59c640 1 --2- 172.21.15.18:0/935417270 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f546006c2b0 0x7f546006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:06.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.327+0000 7f547e59c640 1 --2- 172.21.15.18:0/935417270 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f546006c2b0 0x7f546006e770 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f5468007fd0 tx=0x7f5468009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:06.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.331+0000 7f54777fe640 1 -- 172.21.15.18:0/935417270 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f548015da90 con 0x7f546c003b70 2024-09-19T09:23:06.543 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.542+0000 7f548518f640 1 -- 172.21.15.18:0/935417270 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5480162440 con 0x7f546c003b70 2024-09-19T09:23:06.544 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.543+0000 7f54777fe640 1 -- 172.21.15.18:0/935417270 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5230 (secure 0 0 0) 0x7f547007a160 con 0x7f546c003b70 2024-09-19T09:23:06.544 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:23:06.544 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":74,"btime":"2024-09-19T09:23:04:468698+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1145590197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1145590197},{"type":"v1","addr":"172.21.15.162:6837","nonce":1145590197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/200393908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":200393908},{"type":"v1","addr":"172.21.15.162:6836","nonce":200393908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7542,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1236184741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1236184741},{"type":"v1","addr":"172.21.15.18:6834","nonce":1236184741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:23:00.797014+0000","modified":"2024-09-19T09:23:03.823915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7545":{"gid":7545,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2876222862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2876222862},{"type":"v1","addr":"172.21.15.18:6835","nonce":2876222862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7545,"qdb_cluster":[7545]},"id":10}]} 2024-09-19T09:23:06.544 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 74 2024-09-19T09:23:06.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.545+0000 7f548518f640 1 -- 172.21.15.18:0/935417270 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f546006c2b0 msgr2=0x7f546006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:06.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.545+0000 7f548518f640 1 --2- 172.21.15.18:0/935417270 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f546006c2b0 0x7f546006e770 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f5468007fd0 tx=0x7f5468009040 comp rx=0 tx=0).stop 2024-09-19T09:23:06.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.545+0000 7f548518f640 1 -- 172.21.15.18:0/935417270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f546c003b70 msgr2=0x7f54800c7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:06.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.545+0000 7f548518f640 1 --2- 172.21.15.18:0/935417270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f546c003b70 0x7f54800c7bf0 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f547000a760 tx=0x7f5470001cf0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.545+0000 7f548518f640 1 -- 172.21.15.18:0/935417270 shutdown_connections 2024-09-19T09:23:06.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.545+0000 7f548518f640 1 --2- 172.21.15.18:0/935417270 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f546006c2b0 0x7f546006e770 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.545+0000 7f548518f640 1 --2- 172.21.15.18:0/935417270 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f548015d0d0 0x7f548015d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.545+0000 7f548518f640 1 --2- 172.21.15.18:0/935417270 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54800c9100 0x7f54800cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.545+0000 7f548518f640 1 --2- 172.21.15.18:0/935417270 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f546c003b70 0x7f54800c7bf0 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:06.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.545+0000 7f548518f640 1 -- 172.21.15.18:0/935417270 >> 172.21.15.18:0/935417270 conn(0x7f54800b4700 msgr2=0x7f548015deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:06.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.545+0000 7f548518f640 1 -- 172.21.15.18:0/935417270 shutdown_connections 2024-09-19T09:23:06.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:06.545+0000 7f548518f640 1 -- 172.21.15.18:0/935417270 wait complete. 2024-09-19T09:23:06.961 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 74, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T09:23:00.797014+0000', 'modified': '2024-09-19T09:23:03.823915+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7545}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7545': {'gid': 7545, 'name': 'a', 'rank': 0, 'incarnation': 70, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.18:6835/2876222862', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6833', 'nonce': 2876222862}, {'type': 'v1', 'addr': '172.21.15.18:6835', 'nonce': 2876222862}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7545, 'qdb_cluster': [7545]} 2024-09-19T09:23:06.961 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T09:23:06.961 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-19T09:23:07.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.066+0000 7fdddf447640 1 Processor -- start 2024-09-19T09:23:07.067 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.066+0000 7fdddf447640 1 -- start start 2024-09-19T09:23:07.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.067+0000 7fdddf447640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fddd815eda0 0x7fddd80d5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.067+0000 7fdddf447640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fddd80d0480 0x7fddd80d35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.067+0000 7fdddf447640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddd80d0bf0 con 0x7fddd80d3af0 2024-09-19T09:23:07.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.067+0000 7fdddf447640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fddd80d2880 con 0x7fddd80d0480 2024-09-19T09:23:07.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.067+0000 7fdddf447640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fddd80d3120 con 0x7fddd815eda0 2024-09-19T09:23:07.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.067+0000 7fdddc9e2640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fddd80d0480 0x7fddd80d35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.067+0000 7fdddc9e2640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fddd80d0480 0x7fddd80d35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36194/0 (socket says 172.21.15.18:36194) 2024-09-19T09:23:07.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.067+0000 7fdddd9e4640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fddd80d3af0 0x7fddd80d1630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55854/0 (socket says 172.21.15.18:55854) 2024-09-19T09:23:07.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.067+0000 7fdddc9e2640 1 -- 172.21.15.18:0/2414840408 learned_addr learned my addr 172.21.15.18:0/2414840408 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:23:07.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.067+0000 7fdddd1e3640 1 --2- 172.21.15.18:0/2414840408 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fddd815eda0 0x7fddd80d5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.068+0000 7fdddc9e2640 1 -- 172.21.15.18:0/2414840408 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fddd815eda0 msgr2=0x7fddd80d5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:07.071 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.068+0000 7fdddc9e2640 1 --2- 172.21.15.18:0/2414840408 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fddd815eda0 0x7fddd80d5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.068+0000 7fdddc9e2640 1 -- 172.21.15.18:0/2414840408 >> v1:172.21.15.18:6789/0 conn(0x7fddd80d3af0 legacy=0x7fddd80d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:07.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.068+0000 7fdddc9e2640 1 -- 172.21.15.18:0/2414840408 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd80d2ad0 con 0x7fddd80d0480 2024-09-19T09:23:07.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.068+0000 7fddcffff640 1 -- 172.21.15.18:0/2414840408 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3020702944 0 0) 0x7fddd80d0bf0 con 0x7fddd80d3af0 2024-09-19T09:23:07.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.068+0000 7fdddd1e3640 1 --2- 172.21.15.18:0/2414840408 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fddd815eda0 0x7fddd80d5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:07.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.068+0000 7fdddc9e2640 1 --2- 172.21.15.18:0/2414840408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddd80d0480 0x7fddd80d35b0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009870 tx=0x7fddc802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ad3e0bfed57400 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:07.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.069+0000 7fddcffff640 1 -- 172.21.15.18:0/2414840408 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8037070 con 0x7fddd80d0480 2024-09-19T09:23:07.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.069+0000 7fddcffff640 1 -- 172.21.15.18:0/2414840408 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc8032440 con 0x7fddd80d0480 2024-09-19T09:23:07.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.069+0000 7fddcffff640 1 -- 172.21.15.18:0/2414840408 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8032810 con 0x7fddd80d0480 2024-09-19T09:23:07.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.069+0000 7fdddf447640 1 -- 172.21.15.18:0/2414840408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddd80d0480 msgr2=0x7fddd80d35b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:07.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.069+0000 7fdddf447640 1 --2- 172.21.15.18:0/2414840408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddd80d0480 0x7fddd80d35b0 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009870 tx=0x7fddc802a250 comp rx=0 tx=0).stop 2024-09-19T09:23:07.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.069+0000 7fdddf447640 1 -- 172.21.15.18:0/2414840408 shutdown_connections 2024-09-19T09:23:07.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.069+0000 7fdddf447640 1 --2- 172.21.15.18:0/2414840408 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddd80d0480 0x7fddd80d35b0 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.069+0000 7fdddf447640 1 --2- 172.21.15.18:0/2414840408 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fddd815eda0 0x7fddd80d5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.069+0000 7fdddf447640 1 -- 172.21.15.18:0/2414840408 >> 172.21.15.18:0/2414840408 conn(0x7fddd809df40 msgr2=0x7fddd80d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:07.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.069+0000 7fdddf447640 1 -- 172.21.15.18:0/2414840408 shutdown_connections 2024-09-19T09:23:07.073 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.069+0000 7fdddf447640 1 -- 172.21.15.18:0/2414840408 wait complete. 2024-09-19T09:23:07.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.070+0000 7fdddf447640 1 Processor -- start 2024-09-19T09:23:07.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.070+0000 7fdddf447640 1 -- start start 2024-09-19T09:23:07.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.071+0000 7fdddf447640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fddd80d0480 0x7fddd8149d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.071+0000 7fdddf447640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fddd815eda0 0x7fddd814b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.071+0000 7fdddf447640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddd80b7db0 0x7fddd80b8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.071+0000 7fdddf447640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fddd815f180 con 0x7fddd80b7db0 2024-09-19T09:23:07.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.071+0000 7fdddf447640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fddd80d08c0 con 0x7fddd80d0480 2024-09-19T09:23:07.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.071+0000 7fdddf447640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fddd815f300 con 0x7fddd815eda0 2024-09-19T09:23:07.084 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.071+0000 7fdddd9e4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddd80b7db0 0x7fddd80b8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.071+0000 7fdddd9e4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddd80b7db0 0x7fddd80b8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36208/0 (socket says 172.21.15.18:36208) 2024-09-19T09:23:07.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.071+0000 7fdddd9e4640 1 -- 172.21.15.18:0/2153482780 learned_addr learned my addr 172.21.15.18:0/2153482780 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:23:07.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.072+0000 7fdddd9e4640 1 -- 172.21.15.18:0/2153482780 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fddd815eda0 msgr2=0x7fddd814b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:07.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.072+0000 7fdddd9e4640 1 --2- 172.21.15.18:0/2153482780 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fddd815eda0 0x7fddd814b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.072+0000 7fdddd9e4640 1 -- 172.21.15.18:0/2153482780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fddd80d0480 msgr2=0x7fddd8149d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:07.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.072+0000 7fdddd9e4640 1 --2- 172.21.15.18:0/2153482780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fddd80d0480 0x7fddd8149d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.072+0000 7fdddd9e4640 1 -- 172.21.15.18:0/2153482780 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd814a260 con 0x7fddd80b7db0 2024-09-19T09:23:07.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.072+0000 7fdddd9e4640 1 --2- 172.21.15.18:0/2153482780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddd80b7db0 0x7fddd80b8260 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fddd000c7a0 tx=0x7fddd000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:07.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.072+0000 7fddcdffb640 1 -- 172.21.15.18:0/2153482780 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd0018070 con 0x7fddd80b7db0 2024-09-19T09:23:07.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.072+0000 7fddcdffb640 1 -- 172.21.15.18:0/2153482780 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddd000a5e0 con 0x7fddd80b7db0 2024-09-19T09:23:07.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.072+0000 7fddcdffb640 1 -- 172.21.15.18:0/2153482780 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd000aa50 con 0x7fddd80b7db0 2024-09-19T09:23:07.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.072+0000 7fdddf447640 1 -- 172.21.15.18:0/2153482780 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd814a500 con 0x7fddd80b7db0 2024-09-19T09:23:07.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.072+0000 7fdddf447640 1 -- 172.21.15.18:0/2153482780 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd814aac0 con 0x7fddd80b7db0 2024-09-19T09:23:07.085 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.074+0000 7fddcdffb640 1 -- 172.21.15.18:0/2153482780 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fddd000abf0 con 0x7fddd80b7db0 2024-09-19T09:23:07.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.074+0000 7fddcdffb640 1 --2- 172.21.15.18:0/2153482780 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fddbc06c2e0 0x7fddbc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.074+0000 7fddcdffb640 1 -- 172.21.15.18:0/2153482780 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7fddd008a890 con 0x7fddd80b7db0 2024-09-19T09:23:07.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.074+0000 7fdddd1e3640 1 --2- 172.21.15.18:0/2153482780 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fddbc06c2e0 0x7fddbc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.075+0000 7fdddd1e3640 1 --2- 172.21.15.18:0/2153482780 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fddbc06c2e0 0x7fddbc06e7a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fddd4006fd0 tx=0x7fddd4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:07.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.075+0000 7fdde21db740 1 Processor -- start 2024-09-19T09:23:07.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.075+0000 7fdde21db740 1 -- start start 2024-09-19T09:23:07.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.076+0000 7fdde21db740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d4228b92c0 0x55d4228fea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.076+0000 7fdde21db740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4228b6a80 0x55d4228b96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.076+0000 7fdde21db740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4228baa50 0x55d4228b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.076+0000 7fdde21db740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d42281b520 con 0x55d4228baa50 2024-09-19T09:23:07.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.076+0000 7fdde21db740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d4227c33e0 con 0x55d4228b6a80 2024-09-19T09:23:07.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.076+0000 7fdde21db740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55d4228174e0 con 0x55d4228b92c0 2024-09-19T09:23:07.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.076+0000 7fdddd9e4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4228baa50 0x55d4228b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.086 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.076+0000 7fdddd9e4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4228baa50 0x55d4228b38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36216/0 (socket says 172.21.15.18:36216) 2024-09-19T09:23:07.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.076+0000 7fdddd9e4640 1 -- 172.21.15.18:0/2783207922 learned_addr learned my addr 172.21.15.18:0/2783207922 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:23:07.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.076+0000 7fdddd1e3640 1 --2- 172.21.15.18:0/2783207922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d4228b92c0 0x55d4228fea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.076+0000 7fdddc9e2640 1 --2- 172.21.15.18:0/2783207922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4228b6a80 0x55d4228b96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.076+0000 7fdddd9e4640 1 -- 172.21.15.18:0/2783207922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d4228b92c0 msgr2=0x55d4228fea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:07.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.076+0000 7fdddd9e4640 1 --2- 172.21.15.18:0/2783207922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d4228b92c0 0x55d4228fea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.076+0000 7fdddd9e4640 1 -- 172.21.15.18:0/2783207922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4228b6a80 msgr2=0x55d4228b96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:07.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.076+0000 7fdddd9e4640 1 --2- 172.21.15.18:0/2783207922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4228b6a80 0x55d4228b96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.076+0000 7fdddd9e4640 1 -- 172.21.15.18:0/2783207922 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4227de2f0 con 0x55d4228baa50 2024-09-19T09:23:07.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.076+0000 7fdddc9e2640 1 --2- 172.21.15.18:0/2783207922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4228b6a80 0x55d4228b96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:07.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.076+0000 7fdddd9e4640 1 --2- 172.21.15.18:0/2783207922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4228baa50 0x55d4228b38b0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fddd0088dc0 tx=0x7fddd00583f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6911ba5171794414 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:07.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.077+0000 7fddbaffd640 1 -- 172.21.15.18:0/2783207922 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd0061570 con 0x55d4228baa50 2024-09-19T09:23:07.087 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.077+0000 7fddbaffd640 1 -- 172.21.15.18:0/2783207922 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddd0056a30 con 0x55d4228baa50 2024-09-19T09:23:07.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.077+0000 7fddbaffd640 1 -- 172.21.15.18:0/2783207922 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd0055000 con 0x55d4228baa50 2024-09-19T09:23:07.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.077+0000 7fdde21db740 1 -- 172.21.15.18:0/2783207922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4228baa50 msgr2=0x55d4228b38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:07.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.077+0000 7fdde21db740 1 --2- 172.21.15.18:0/2783207922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4228baa50 0x55d4228b38b0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fddd0088dc0 tx=0x7fddd00583f0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.077+0000 7fdde21db740 1 -- 172.21.15.18:0/2783207922 shutdown_connections 2024-09-19T09:23:07.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.077+0000 7fdde21db740 1 --2- 172.21.15.18:0/2783207922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4228baa50 0x55d4228b38b0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.077+0000 7fdde21db740 1 --2- 172.21.15.18:0/2783207922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4228b6a80 0x55d4228b96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.077+0000 7fdde21db740 1 --2- 172.21.15.18:0/2783207922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d4228b92c0 0x55d4228fea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.077+0000 7fdde21db740 1 -- 172.21.15.18:0/2783207922 >> 172.21.15.18:0/2783207922 conn(0x55d4228b5a80 msgr2=0x55d4228fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:07.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.077+0000 7fdde21db740 1 -- 172.21.15.18:0/2783207922 shutdown_connections 2024-09-19T09:23:07.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.077+0000 7fdde21db740 1 -- 172.21.15.18:0/2783207922 wait complete. 2024-09-19T09:23:07.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.078+0000 7fdde21db740 1 -- start start 2024-09-19T09:23:07.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.078+0000 7fdde21db740 1 Processor -- start 2024-09-19T09:23:07.088 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.079+0000 7fdde21db740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4228b92c0 0x55d4228cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.079+0000 7fdde21db740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d4228baa50 0x55d4228e4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.079+0000 7fdde21db740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4228e3270 0x55d4228e36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.079+0000 7fdde21db740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d4228b4f20 con 0x55d4228b92c0 2024-09-19T09:23:07.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.079+0000 7fdde21db740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d4227a4450 con 0x55d4228e3270 2024-09-19T09:23:07.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.079+0000 7fdde21db740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55d4228ff290 con 0x55d4228baa50 2024-09-19T09:23:07.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.079+0000 7fdde21db740 10 client.0 _ll_register_callbacks cb 0x55d42252dac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:07.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.079+0000 7fdddd1e3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4228b92c0 0x55d4228cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.079+0000 7fdddd1e3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4228b92c0 0x55d4228cfaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36226/0 (socket says 172.21.15.18:36226) 2024-09-19T09:23:07.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.079+0000 7fdddd1e3640 1 -- 172.21.15.18:0/2372855564 learned_addr learned my addr 172.21.15.18:0/2372855564 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:23:07.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.079+0000 7fdddd9e4640 1 --2- 172.21.15.18:0/2372855564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4228e3270 0x55d4228e36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.079+0000 7fdddc9e2640 1 --2- 172.21.15.18:0/2372855564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d4228baa50 0x55d4228e4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.079+0000 7fdddd1e3640 1 -- 172.21.15.18:0/2372855564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d4228baa50 msgr2=0x55d4228e4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:07.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.079+0000 7fdddd1e3640 1 --2- 172.21.15.18:0/2372855564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d4228baa50 0x55d4228e4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.089 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.079+0000 7fdddd1e3640 1 -- 172.21.15.18:0/2372855564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4228e3270 msgr2=0x55d4228e36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:07.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.079+0000 7fdddd1e3640 1 --2- 172.21.15.18:0/2372855564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4228e3270 0x55d4228e36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.079+0000 7fdddd1e3640 1 -- 172.21.15.18:0/2372855564 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d42252e2d0 con 0x55d4228b92c0 2024-09-19T09:23:07.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.079+0000 7fdddd9e4640 1 --2- 172.21.15.18:0/2372855564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4228e3270 0x55d4228e36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:07.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.079+0000 7fdddd1e3640 1 --2- 172.21.15.18:0/2372855564 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4228b92c0 0x55d4228cfaf0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fddd400da90 tx=0x7fddd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65754f2e5b9af78 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:07.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.079+0000 7fddb3fff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:23:07.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.080+0000 7fddb3fff640 1 -- 172.21.15.18:0/2372855564 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd4024020 con 0x55d4228b92c0 2024-09-19T09:23:07.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.080+0000 7fddb3fff640 1 -- 172.21.15.18:0/2372855564 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7fddd400f040 con 0x55d4228b92c0 2024-09-19T09:23:07.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.080+0000 7fdde21db740 1 -- 172.21.15.18:0/2372855564 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddd0056a30 con 0x55d4228b92c0 2024-09-19T09:23:07.090 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.080+0000 7fddb3fff640 1 -- 172.21.15.18:0/2372855564 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fddd402e050 con 0x55d4228b92c0 2024-09-19T09:23:07.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.080+0000 7fdde21db740 10 client.7674 fetch_fsmap learned FSMap version 74 2024-09-19T09:23:07.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.080+0000 7fdde21db740 1 -- 172.21.15.18:0/2372855564 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x55d4225f86b0 con 0x55d4228b92c0 2024-09-19T09:23:07.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.080+0000 7fddb3fff640 1 -- 172.21.15.18:0/2372855564 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddd0056a30 con 0x55d4228b92c0 2024-09-19T09:23:07.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.080+0000 7fddb3fff640 1 -- 172.21.15.18:0/2372855564 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 74) ==== 3502+0+0 (secure 0 0 0) 0x7fddd4031020 con 0x55d4228b92c0 2024-09-19T09:23:07.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.080+0000 7fdde21db740 10 client.7674 fetch_fsmap finished waiting for FSMap version 74 2024-09-19T09:23:07.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.080+0000 7fdde21db740 10 client.7674 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T09:23:07.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.080+0000 7fdde21db740 20 client.7674 populate_metadata read hostname 'smithi018' 2024-09-19T09:23:07.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.080+0000 7fdde21db740 1 --2- 172.21.15.18:0/2372855564 >> [v2:172.21.15.18:6833/2876222862,v1:172.21.15.18:6835/2876222862] conn(0x55d422919810 0x55d42291bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.080+0000 7fdde21db740 4 client.7674 mds_command: new command op to 7545 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:23:07.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.080+0000 7fdde21db740 1 -- 172.21.15.18:0/2372855564 --> [v2:172.21.15.18:6833/2876222862,v1:172.21.15.18:6835/2876222862] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d422828c50 con 0x55d422919810 2024-09-19T09:23:07.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.080+0000 7fdddc9e2640 1 --2- 172.21.15.18:0/2372855564 >> [v2:172.21.15.18:6833/2876222862,v1:172.21.15.18:6835/2876222862] conn(0x55d422919810 0x55d42291bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.081+0000 7fddb3fff640 10 client.7674 ms_handle_connect on v2:172.21.15.18:6833/2876222862 2024-09-19T09:23:07.091 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.081+0000 7fdddc9e2640 1 --2- 172.21.15.18:0/2372855564 >> [v2:172.21.15.18:6833/2876222862,v1:172.21.15.18:6835/2876222862] conn(0x55d422919810 0x55d42291bc00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55ccc07a93afb184 server_cookie=724ec39dd8e0232b in_seq=0 out_seq=0 2024-09-19T09:23:07.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.081+0000 7fddb3fff640 1 -- 172.21.15.18:0/2372855564 <== mds.0 v2:172.21.15.18:6833/2876222862 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d422828c50 con 0x55d422919810 2024-09-19T09:23:07.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.081+0000 7fddb3fff640 10 client.7674 handle_command_reply: tid=0 2024-09-19T09:23:07.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.081+0000 7fdde21db740 1 client.7674 shutdown 2024-09-19T09:23:07.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.081+0000 7fdde21db740 1 -- 172.21.15.18:0/2372855564 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4228b92c0 msgr2=0x55d4228cfaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:07.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.081+0000 7fdde21db740 1 --2- 172.21.15.18:0/2372855564 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4228b92c0 0x55d4228cfaf0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fddd400da90 tx=0x7fddd40046c0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.081+0000 7fdde21db740 1 -- 172.21.15.18:0/2372855564 shutdown_connections 2024-09-19T09:23:07.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.082+0000 7fdde21db740 1 --2- 172.21.15.18:0/2372855564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4228e3270 0x55d4228e36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.082+0000 7fdde21db740 1 --2- 172.21.15.18:0/2372855564 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d4228baa50 0x55d4228e4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.082+0000 7fdde21db740 1 --2- 172.21.15.18:0/2372855564 >> [v2:172.21.15.18:6833/2876222862,v1:172.21.15.18:6835/2876222862] conn(0x55d422919810 0x55d42291bc00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.082+0000 7fdde21db740 1 --2- 172.21.15.18:0/2372855564 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4228b92c0 0x55d4228cfaf0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.082+0000 7fddb3fff640 0 client.7674 ms_handle_reset on v2:172.21.15.18:6833/2876222862 2024-09-19T09:23:07.092 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.082+0000 7fdde21db740 1 -- 172.21.15.18:0/2372855564 >> 172.21.15.18:0/2372855564 conn(0x55d4228b6a80 msgr2=0x55d4228b7020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:07.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.082+0000 7fdde21db740 1 -- 172.21.15.18:0/2372855564 shutdown_connections 2024-09-19T09:23:07.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.082+0000 7fdde21db740 1 -- 172.21.15.18:0/2372855564 wait complete. 2024-09-19T09:23:07.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.082+0000 7fdde21db740 20 client.7674 trim_cache size 0 max 16384 2024-09-19T09:23:07.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.100+0000 7fdde21db740 1 Processor -- start 2024-09-19T09:23:07.100 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.100+0000 7fdde21db740 1 -- start start 2024-09-19T09:23:07.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.100+0000 7fdde21db740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d4228b92c0 0x55d422901440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.100+0000 7fdde21db740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4228baa50 0x55d4228fe0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.100+0000 7fdde21db740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4228e3270 0x55d422977d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.100+0000 7fdde21db740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fddd81611d0 con 0x55d4228baa50 2024-09-19T09:23:07.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.100+0000 7fdde21db740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fddd8160530 con 0x55d4228e3270 2024-09-19T09:23:07.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.100+0000 7fdde21db740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fddd8160b80 con 0x55d4228b92c0 2024-09-19T09:23:07.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.100+0000 7fdddc9e2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4228baa50 0x55d4228fe0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.100+0000 7fdddc9e2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4228baa50 0x55d4228fe0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36230/0 (socket says 172.21.15.18:36230) 2024-09-19T09:23:07.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.100+0000 7fdddc9e2640 1 -- 172.21.15.18:0/3584708630 learned_addr learned my addr 172.21.15.18:0/3584708630 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:23:07.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.101+0000 7fdddc9e2640 1 -- 172.21.15.18:0/3584708630 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d4228b92c0 msgr2=0x55d422901440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:07.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.101+0000 7fdddc9e2640 1 --2- 172.21.15.18:0/3584708630 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d4228b92c0 0x55d422901440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.101+0000 7fdddc9e2640 1 -- 172.21.15.18:0/3584708630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4228e3270 msgr2=0x55d422977d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:07.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.101+0000 7fdddc9e2640 1 --2- 172.21.15.18:0/3584708630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4228e3270 0x55d422977d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.101+0000 7fdddc9e2640 1 -- 172.21.15.18:0/3584708630 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d42281d9c0 con 0x55d4228baa50 2024-09-19T09:23:07.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.101+0000 7fdddc9e2640 1 --2- 172.21.15.18:0/3584708630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4228baa50 0x55d4228fe0e0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009870 tx=0x7fddc802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1794c89e73ab7328 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:07.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.101+0000 7fddba7fc640 1 -- 172.21.15.18:0/3584708630 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc804a070 con 0x55d4228baa50 2024-09-19T09:23:07.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.101+0000 7fddba7fc640 1 -- 172.21.15.18:0/3584708630 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc8004410 con 0x55d4228baa50 2024-09-19T09:23:07.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.101+0000 7fddba7fc640 1 -- 172.21.15.18:0/3584708630 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc8037040 con 0x55d4228baa50 2024-09-19T09:23:07.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.101+0000 7fdde21db740 1 -- 172.21.15.18:0/3584708630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4228baa50 msgr2=0x55d4228fe0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:07.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.101+0000 7fdde21db740 1 --2- 172.21.15.18:0/3584708630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4228baa50 0x55d4228fe0e0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fddc8009870 tx=0x7fddc802e000 comp rx=0 tx=0).stop 2024-09-19T09:23:07.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.101+0000 7fdde21db740 1 -- 172.21.15.18:0/3584708630 shutdown_connections 2024-09-19T09:23:07.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.101+0000 7fdde21db740 1 --2- 172.21.15.18:0/3584708630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4228e3270 0x55d422977d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.101+0000 7fdde21db740 1 --2- 172.21.15.18:0/3584708630 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4228baa50 0x55d4228fe0e0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.101+0000 7fdde21db740 1 --2- 172.21.15.18:0/3584708630 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d4228b92c0 0x55d422901440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.101+0000 7fdde21db740 1 -- 172.21.15.18:0/3584708630 >> 172.21.15.18:0/3584708630 conn(0x55d4228b6a80 msgr2=0x55d4228e66e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:07.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.102+0000 7fdde21db740 1 -- 172.21.15.18:0/3584708630 shutdown_connections 2024-09-19T09:23:07.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.102+0000 7fdde21db740 1 -- 172.21.15.18:0/3584708630 wait complete. 2024-09-19T09:23:07.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.102+0000 7fdde21db740 1 -- start start 2024-09-19T09:23:07.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.102+0000 7fdde21db740 1 Processor -- start 2024-09-19T09:23:07.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.103+0000 7fdde21db740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4228b92c0 0x55d422917f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.103+0000 7fdde21db740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4228baa50 0x55d4229123b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.103+0000 7fdde21db740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d4228e3270 0x55d422973000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.103+0000 7fdde21db740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55d4228e6500 con 0x55d4228b92c0 2024-09-19T09:23:07.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.103+0000 7fdde21db740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d4228e11e0 con 0x55d4228baa50 2024-09-19T09:23:07.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.103+0000 7fdde21db740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55d422911a20 con 0x55d4228e3270 2024-09-19T09:23:07.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.103+0000 7fdde21db740 10 client.0 _ll_register_callbacks cb 0x7fddd4004030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:23:07.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.103+0000 7fdddd1e3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4228b92c0 0x55d422917f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.103+0000 7fdddd1e3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4228b92c0 0x55d422917f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36246/0 (socket says 172.21.15.18:36246) 2024-09-19T09:23:07.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.103+0000 7fdddd1e3640 1 -- 172.21.15.18:0/74748780 learned_addr learned my addr 172.21.15.18:0/74748780 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:23:07.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.103+0000 7fdddd1e3640 1 -- 172.21.15.18:0/74748780 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d4228e3270 msgr2=0x55d422973000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:07.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.103+0000 7fdddd1e3640 1 --2- 172.21.15.18:0/74748780 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d4228e3270 0x55d422973000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.103+0000 7fdddd1e3640 1 -- 172.21.15.18:0/74748780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4228baa50 msgr2=0x55d4229123b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:07.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.103+0000 7fdddd1e3640 1 --2- 172.21.15.18:0/74748780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4228baa50 0x55d4229123b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.103+0000 7fdddd1e3640 1 -- 172.21.15.18:0/74748780 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d422914af0 con 0x55d4228b92c0 2024-09-19T09:23:07.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.104+0000 7fdddd1e3640 1 --2- 172.21.15.18:0/74748780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4228b92c0 0x55d422917f50 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fddd400d5a0 tx=0x7fddd4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=335eefa16e11a12d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:07.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.104+0000 7fddb3fff640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:23:07.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.104+0000 7fddb3fff640 1 -- 172.21.15.18:0/74748780 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd4037060 con 0x55d4228b92c0 2024-09-19T09:23:07.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.104+0000 7fddb3fff640 1 -- 172.21.15.18:0/74748780 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7fddd4014b90 con 0x55d4228b92c0 2024-09-19T09:23:07.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.104+0000 7fdde21db740 1 -- 172.21.15.18:0/74748780 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fddc8004410 con 0x55d4228b92c0 2024-09-19T09:23:07.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.104+0000 7fddb3fff640 1 -- 172.21.15.18:0/74748780 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) ==== 24+0+0 (secure 0 0 0) 0x7fddd403d050 con 0x55d4228b92c0 2024-09-19T09:23:07.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.104+0000 7fdde21db740 10 client.7680 fetch_fsmap learned FSMap version 74 2024-09-19T09:23:07.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.104+0000 7fdde21db740 1 -- 172.21.15.18:0/74748780 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=2+}) -- 0x55d4228fb9a0 con 0x55d4228b92c0 2024-09-19T09:23:07.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.104+0000 7fddb3fff640 1 -- 172.21.15.18:0/74748780 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddc8004410 con 0x55d4228b92c0 2024-09-19T09:23:07.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.104+0000 7fddb3fff640 1 -- 172.21.15.18:0/74748780 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 74) ==== 3502+0+0 (secure 0 0 0) 0x7fddd4040020 con 0x55d4228b92c0 2024-09-19T09:23:07.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.104+0000 7fdde21db740 10 client.7680 fetch_fsmap finished waiting for FSMap version 74 2024-09-19T09:23:07.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.104+0000 7fdde21db740 10 client.7680 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T09:23:07.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.104+0000 7fdde21db740 20 client.7680 populate_metadata read hostname 'smithi018' 2024-09-19T09:23:07.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.104+0000 7fdde21db740 1 --2- 172.21.15.18:0/74748780 >> [v2:172.21.15.18:6833/2876222862,v1:172.21.15.18:6835/2876222862] conn(0x55d42290cce0 0x55d4228fa210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.104+0000 7fdde21db740 4 client.7680 mds_command: new command op to 7545 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:23:07.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.104+0000 7fdde21db740 1 -- 172.21.15.18:0/74748780 --> [v2:172.21.15.18:6833/2876222862,v1:172.21.15.18:6835/2876222862] -- command(tid 0: {"prefix": "status"}) -- 0x55d422822fa0 con 0x55d42290cce0 2024-09-19T09:23:07.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.104+0000 7fdddc9e2640 1 --2- 172.21.15.18:0/74748780 >> [v2:172.21.15.18:6833/2876222862,v1:172.21.15.18:6835/2876222862] conn(0x55d42290cce0 0x55d4228fa210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.105+0000 7fddb3fff640 10 client.7680 ms_handle_connect on v2:172.21.15.18:6833/2876222862 2024-09-19T09:23:07.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.105+0000 7fdddc9e2640 1 --2- 172.21.15.18:0/74748780 >> [v2:172.21.15.18:6833/2876222862,v1:172.21.15.18:6835/2876222862] conn(0x55d42290cce0 0x55d4228fa210 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f634fca448b0811 server_cookie=6e4e42b96ec5ef83 in_seq=0 out_seq=0 2024-09-19T09:23:07.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.105+0000 7fddb3fff640 1 -- 172.21.15.18:0/74748780 <== mds.0 v2:172.21.15.18:6833/2876222862 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55d422822fa0 con 0x55d42290cce0 2024-09-19T09:23:07.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.105+0000 7fddb3fff640 10 client.7680 handle_command_reply: tid=0 2024-09-19T09:23:07.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.105+0000 7fdde21db740 1 client.7680 shutdown 2024-09-19T09:23:07.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.105+0000 7fdde21db740 1 -- 172.21.15.18:0/74748780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4228b92c0 msgr2=0x55d422917f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:07.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.105+0000 7fdde21db740 1 --2- 172.21.15.18:0/74748780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4228b92c0 0x55d422917f50 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fddd400d5a0 tx=0x7fddd4011000 comp rx=0 tx=0).stop 2024-09-19T09:23:07.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.105+0000 7fdde21db740 1 -- 172.21.15.18:0/74748780 shutdown_connections 2024-09-19T09:23:07.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.105+0000 7fdde21db740 1 --2- 172.21.15.18:0/74748780 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55d4228e3270 0x55d422973000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.105+0000 7fdde21db740 1 --2- 172.21.15.18:0/74748780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d4228baa50 0x55d4229123b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.105+0000 7fdde21db740 1 --2- 172.21.15.18:0/74748780 >> [v2:172.21.15.18:6833/2876222862,v1:172.21.15.18:6835/2876222862] conn(0x55d42290cce0 0x55d4228fa210 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.105+0000 7fdde21db740 1 --2- 172.21.15.18:0/74748780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55d4228b92c0 0x55d422917f50 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.105+0000 7fddb3fff640 0 client.7680 ms_handle_reset on v2:172.21.15.18:6833/2876222862 2024-09-19T09:23:07.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.105+0000 7fdde21db740 1 -- 172.21.15.18:0/74748780 >> 172.21.15.18:0/74748780 conn(0x55d4228b6a80 msgr2=0x55d422901920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:07.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.105+0000 7fdde21db740 1 -- 172.21.15.18:0/74748780 shutdown_connections 2024-09-19T09:23:07.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.105+0000 7fdde21db740 1 -- 172.21.15.18:0/74748780 wait complete. 2024-09-19T09:23:07.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.105+0000 7fdde21db740 20 client.7680 trim_cache size 0 max 16384 2024-09-19T09:23:07.112 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:23:07.113 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:23:07.113 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-09-19T09:23:07.113 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 7545, 2024-09-19T09:23:07.113 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-19T09:23:07.113 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-19T09:23:07.113 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-19T09:23:07.113 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 5.6663138069999999, 2024-09-19T09:23:07.113 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 74, 2024-09-19T09:23:07.113 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 167, 2024-09-19T09:23:07.113 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 167, 2024-09-19T09:23:07.113 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 10.65950254 2024-09-19T09:23:07.113 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:23:07.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.106+0000 7fdddf447640 1 -- 172.21.15.18:0/2153482780 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fddbc06c2e0 msgr2=0x7fddbc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:07.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.106+0000 7fdddf447640 1 --2- 172.21.15.18:0/2153482780 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fddbc06c2e0 0x7fddbc06e7a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fddd4006fd0 tx=0x7fddd4008040 comp rx=0 tx=0).stop 2024-09-19T09:23:07.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.106+0000 7fdddf447640 1 -- 172.21.15.18:0/2153482780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddd80b7db0 msgr2=0x7fddd80b8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:07.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.106+0000 7fdddf447640 1 --2- 172.21.15.18:0/2153482780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddd80b7db0 0x7fddd80b8260 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fddd000c7a0 tx=0x7fddd000cc60 comp rx=0 tx=0).stop 2024-09-19T09:23:07.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.106+0000 7fdddf447640 1 -- 172.21.15.18:0/2153482780 shutdown_connections 2024-09-19T09:23:07.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.106+0000 7fdddf447640 1 --2- 172.21.15.18:0/2153482780 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fddbc06c2e0 0x7fddbc06e7a0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.106+0000 7fdddf447640 1 --2- 172.21.15.18:0/2153482780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fddd80b7db0 0x7fddd80b8260 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.106+0000 7fdddf447640 1 --2- 172.21.15.18:0/2153482780 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fddd815eda0 0x7fddd814b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.106+0000 7fdddf447640 1 --2- 172.21.15.18:0/2153482780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fddd80d0480 0x7fddd8149d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.106+0000 7fdddf447640 1 -- 172.21.15.18:0/2153482780 >> 172.21.15.18:0/2153482780 conn(0x7fddd809df40 msgr2=0x7fddd815da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:07.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.106+0000 7fdddf447640 1 -- 172.21.15.18:0/2153482780 shutdown_connections 2024-09-19T09:23:07.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.106+0000 7fdddf447640 1 -- 172.21.15.18:0/2153482780 wait complete. 2024-09-19T09:23:07.118 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T09:23:07.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.219+0000 7f4726ba6640 1 Processor -- start 2024-09-19T09:23:07.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.219+0000 7f4726ba6640 1 -- start start 2024-09-19T09:23:07.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.220+0000 7f4726ba6640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f472015ef80 0x7f47200b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.220+0000 7f4726ba6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f472006d730 0x7f47200cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.220+0000 7f4726ba6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f47200cf910 0x7f47200d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.220+0000 7f4726ba6640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f47200cd7d0 con 0x7f47200cf910 2024-09-19T09:23:07.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.220+0000 7f4726ba6640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f47200cd1a0 con 0x7f472015ef80 2024-09-19T09:23:07.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.220+0000 7f4726ba6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f472006dc30 con 0x7f472006d730 2024-09-19T09:23:07.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.220+0000 7f4725143640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f47200cf910 0x7f47200d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.220+0000 7f4725143640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f47200cf910 0x7f47200d0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36256/0 (socket says 172.21.15.18:36256) 2024-09-19T09:23:07.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.220+0000 7f4725143640 1 -- 172.21.15.18:0/1394337842 learned_addr learned my addr 172.21.15.18:0/1394337842 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:23:07.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.220+0000 7f4724942640 1 --2- 172.21.15.18:0/1394337842 >> v2:172.21.15.162:3300/0 conn(0x7f472015ef80 0x7f47200b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.220+0000 7f471ffff640 1 --2- 172.21.15.18:0/1394337842 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f472006d730 0x7f47200cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.220+0000 7f4725143640 1 -- 172.21.15.18:0/1394337842 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f472006d730 msgr2=0x7f47200cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:07.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.220+0000 7f4725143640 1 --2- 172.21.15.18:0/1394337842 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f472006d730 0x7f47200cf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.220+0000 7f4725143640 1 -- 172.21.15.18:0/1394337842 >> v2:172.21.15.162:3300/0 conn(0x7f472015ef80 msgr2=0x7f47200b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:07.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.220+0000 7f4725143640 1 --2- 172.21.15.18:0/1394337842 >> v2:172.21.15.162:3300/0 conn(0x7f472015ef80 0x7f47200b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.220+0000 7f4725143640 1 -- 172.21.15.18:0/1394337842 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f472006df10 con 0x7f47200cf910 2024-09-19T09:23:07.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.221+0000 7f4725143640 1 --2- 172.21.15.18:0/1394337842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47200cf910 0x7f47200d0ce0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f472006f6e0 tx=0x7f471802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=739de326b6e25d1d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:07.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.221+0000 7f471f7fe640 1 -- 172.21.15.18:0/1394337842 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4718036070 con 0x7f47200cf910 2024-09-19T09:23:07.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.221+0000 7f471f7fe640 1 -- 172.21.15.18:0/1394337842 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4718031600 con 0x7f47200cf910 2024-09-19T09:23:07.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.221+0000 7f471f7fe640 1 -- 172.21.15.18:0/1394337842 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47180319d0 con 0x7f47200cf910 2024-09-19T09:23:07.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.222+0000 7f4726ba6640 1 -- 172.21.15.18:0/1394337842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47200cf910 msgr2=0x7f47200d0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:07.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.222+0000 7f4726ba6640 1 --2- 172.21.15.18:0/1394337842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47200cf910 0x7f47200d0ce0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f472006f6e0 tx=0x7f471802a6a0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.222+0000 7f4726ba6640 1 -- 172.21.15.18:0/1394337842 shutdown_connections 2024-09-19T09:23:07.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.222+0000 7f4726ba6640 1 --2- 172.21.15.18:0/1394337842 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f47200cf910 0x7f47200d0ce0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.222+0000 7f4726ba6640 1 --2- 172.21.15.18:0/1394337842 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f472006d730 0x7f47200cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.222+0000 7f4726ba6640 1 --2- 172.21.15.18:0/1394337842 >> v2:172.21.15.162:3300/0 conn(0x7f472015ef80 0x7f47200b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.222+0000 7f4726ba6640 1 -- 172.21.15.18:0/1394337842 >> 172.21.15.18:0/1394337842 conn(0x7f47200b4700 msgr2=0x7f47200b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:07.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.222+0000 7f4726ba6640 1 -- 172.21.15.18:0/1394337842 shutdown_connections 2024-09-19T09:23:07.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.222+0000 7f4726ba6640 1 -- 172.21.15.18:0/1394337842 wait complete. 2024-09-19T09:23:07.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.223+0000 7f4726ba6640 1 Processor -- start 2024-09-19T09:23:07.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.223+0000 7f4726ba6640 1 -- start start 2024-09-19T09:23:07.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.224+0000 7f4726ba6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f472006d730 0x7f4720154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.224+0000 7f4726ba6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47200cf910 0x7f47200c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.224+0000 7f4726ba6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f472015ef80 0x7f47200c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.224+0000 7f4726ba6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f47200d0120 con 0x7f472006d730 2024-09-19T09:23:07.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.224+0000 7f4726ba6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f472015f360 con 0x7f47200cf910 2024-09-19T09:23:07.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.224+0000 7f4726ba6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f47200d1220 con 0x7f472015ef80 2024-09-19T09:23:07.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.224+0000 7f4724942640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f472006d730 0x7f4720154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.224+0000 7f4724942640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f472006d730 0x7f4720154090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36258/0 (socket says 172.21.15.18:36258) 2024-09-19T09:23:07.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.224+0000 7f4724942640 1 -- 172.21.15.18:0/1808023806 learned_addr learned my addr 172.21.15.18:0/1808023806 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:23:07.227 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.224+0000 7f4725143640 1 --2- 172.21.15.18:0/1808023806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f472015ef80 0x7f47200c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.224+0000 7f471ffff640 1 --2- 172.21.15.18:0/1808023806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47200cf910 0x7f47200c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.224+0000 7f4724942640 1 -- 172.21.15.18:0/1808023806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f472015ef80 msgr2=0x7f47200c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:07.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.224+0000 7f4724942640 1 --2- 172.21.15.18:0/1808023806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f472015ef80 0x7f47200c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.224+0000 7f4724942640 1 -- 172.21.15.18:0/1808023806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47200cf910 msgr2=0x7f47200c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:07.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.224+0000 7f4724942640 1 --2- 172.21.15.18:0/1808023806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47200cf910 0x7f47200c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.224+0000 7f4724942640 1 -- 172.21.15.18:0/1808023806 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47200ca590 con 0x7f472006d730 2024-09-19T09:23:07.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.225+0000 7f4724942640 1 --2- 172.21.15.18:0/1808023806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f472006d730 0x7f4720154090 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f471000d5f0 tx=0x7f471000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:07.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.225+0000 7f471d7fa640 1 -- 172.21.15.18:0/1808023806 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47100125f0 con 0x7f472006d730 2024-09-19T09:23:07.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.225+0000 7f471d7fa640 1 -- 172.21.15.18:0/1808023806 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4710019070 con 0x7f472006d730 2024-09-19T09:23:07.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.225+0000 7f4726ba6640 1 -- 172.21.15.18:0/1808023806 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47200ca870 con 0x7f472006d730 2024-09-19T09:23:07.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.225+0000 7f471d7fa640 1 -- 172.21.15.18:0/1808023806 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47100129d0 con 0x7f472006d730 2024-09-19T09:23:07.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.225+0000 7f4726ba6640 1 -- 172.21.15.18:0/1808023806 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47200cae30 con 0x7f472006d730 2024-09-19T09:23:07.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.226+0000 7f4726ba6640 1 -- 172.21.15.18:0/1808023806 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47200d0ce0 con 0x7f472006d730 2024-09-19T09:23:07.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.226+0000 7f471d7fa640 1 -- 172.21.15.18:0/1808023806 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4710012b70 con 0x7f472006d730 2024-09-19T09:23:07.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.227+0000 7f471d7fa640 1 --2- 172.21.15.18:0/1808023806 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f470c06c2b0 0x7f470c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:07.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.227+0000 7f471d7fa640 1 -- 172.21.15.18:0/1808023806 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f471008b6c0 con 0x7f472006d730 2024-09-19T09:23:07.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.227+0000 7f471ffff640 1 --2- 172.21.15.18:0/1808023806 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f470c06c2b0 0x7f470c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:07.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.227+0000 7f471ffff640 1 --2- 172.21.15.18:0/1808023806 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f470c06c2b0 0x7f470c06e770 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f47200d2d00 tx=0x7f4714008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:07.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.231+0000 7f471d7fa640 1 -- 172.21.15.18:0/1808023806 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f4710059ec0 con 0x7f472006d730 2024-09-19T09:23:07.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.441+0000 7f4726ba6640 1 -- 172.21.15.18:0/1808023806 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f47200cff00 con 0x7f472006d730 2024-09-19T09:23:07.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.441+0000 7f471d7fa640 1 -- 172.21.15.18:0/1808023806 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v74) ==== 53+0+73 (secure 0 0 0) 0x7f47100597c0 con 0x7f472006d730 2024-09-19T09:23:07.442 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T09:23:07.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.443+0000 7f4726ba6640 1 -- 172.21.15.18:0/1808023806 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f470c06c2b0 msgr2=0x7f470c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:07.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.443+0000 7f4726ba6640 1 --2- 172.21.15.18:0/1808023806 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f470c06c2b0 0x7f470c06e770 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f47200d2d00 tx=0x7f4714008040 comp rx=0 tx=0).stop 2024-09-19T09:23:07.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.443+0000 7f4726ba6640 1 -- 172.21.15.18:0/1808023806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f472006d730 msgr2=0x7f4720154090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:07.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.443+0000 7f4726ba6640 1 --2- 172.21.15.18:0/1808023806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f472006d730 0x7f4720154090 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f471000d5f0 tx=0x7f471000dab0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.443+0000 7f4726ba6640 1 -- 172.21.15.18:0/1808023806 shutdown_connections 2024-09-19T09:23:07.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.443+0000 7f4726ba6640 1 --2- 172.21.15.18:0/1808023806 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f470c06c2b0 0x7f470c06e770 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.443+0000 7f4726ba6640 1 --2- 172.21.15.18:0/1808023806 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f472015ef80 0x7f47200c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.443+0000 7f4726ba6640 1 --2- 172.21.15.18:0/1808023806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f47200cf910 0x7f47200c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.443+0000 7f4726ba6640 1 --2- 172.21.15.18:0/1808023806 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f472006d730 0x7f4720154090 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:07.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.443+0000 7f4726ba6640 1 -- 172.21.15.18:0/1808023806 >> 172.21.15.18:0/1808023806 conn(0x7f47200b4700 msgr2=0x7f47200d34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:07.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.443+0000 7f4726ba6640 1 -- 172.21.15.18:0/1808023806 shutdown_connections 2024-09-19T09:23:07.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07.443+0000 7f4726ba6640 1 -- 172.21.15.18:0/1808023806 wait complete. 2024-09-19T09:23:07.455 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-19T09:23:07.455 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:23:07.455 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-09-19T09:23:07.455 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T09:23:07.455 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:23:07.455 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-19T09:23:07.456 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-19T09:23:07.456 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:23:07.456 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:23:07.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:23:07.456 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-09-19T09:23:07.473 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:23:07.473 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:23:07.473 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:23:07.473 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:23:07.473 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-09-19T09:23:07.473 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:23:07.473 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:23:07.473 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:23:07.473 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-09-19T09:23:07.473 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:23:07.474 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:23:07.474 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-09-19T09:23:07.474 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:23:07.474 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:23:07.474 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-09-19T09:23:07.474 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T09:23:07.474 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42210sec preferred_lft 42210sec 2024-09-19T09:23:07.474 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-09-19T09:23:07.474 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:23:07.474 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:23:07.474 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:23:07.474 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-09-19T09:23:07.474 INFO:teuthology.orchestra.run.smithi018.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T09:23:07.475 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:44:1b:02:86:87 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:23:07.475 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T09:23:07.475 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:23:07.475 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::a0ce:faff:feaa:13ec/64 scope link 2024-09-19T09:23:07.475 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:23:07.475 INFO:teuthology.orchestra.run.smithi018.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:23:07.475 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:44:1b:02:86:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:23:07.475 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::44:1bff:fe02:8687/64 scope link 2024-09-19T09:23:07.475 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:23:07.475 INFO:teuthology.orchestra.run.smithi018.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:23:07.475 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether e2:6d:c4:af:6a:8b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T09:23:07.475 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::e06d:c4ff:feaf:6a8b/64 scope link 2024-09-19T09:23:07.475 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:23:07.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:23:07.476 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:23:07.537 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-09-19T09:23:07.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:23:07.538 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-09-19T09:23:07.595 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-09-19T09:23:07.595 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:23:07.596 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T09:23:07.596 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T09:23:07.596 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:23:07.596 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:23:07.596 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T09:23:07.596 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T09:23:07.596 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T09:23:07.596 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T09:23:07.596 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T09:23:07.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:23:07.718 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:23:07.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:23:07.725 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-19T09:23:07.741 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-19T09:23:07.741 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T09:23:07.741 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:23:07.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:23:07.741 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-09-19T09:23:07.806 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:23:07.806 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T09:23:07.862 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:23:07.863 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:23:07.863 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:23:07.918 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-19T09:23:07.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:23:07.919 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:23:08.003 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:23:08.003 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:23:08.004 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:23:08.012 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:23:08.013 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:23:08.013 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:23:08.013 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:23:08.013 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:23:08.017 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:23:08.017 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:23:08.017 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:23:08.017 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:23:08.017 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:23:08.017 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-19T09:23:08.017 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-19T09:23:08.017 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fec66d7e-50e5-42ed-81de-ad141a2f0f4e" will pass to kernel 2024-09-19T09:23:08.017 INFO:teuthology.orchestra.run.smithi018.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-19T09:23:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:23:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:23:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:23:08.018 INFO:teuthology.orchestra.run.smithi018.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:23:08.019 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:23:08.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:23:08.019 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:23:08.045 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:23:08.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:23:08.141 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:23:08.147 INFO:teuthology.orchestra.run.smithi018.stdout:client7689 2024-09-19T09:23:08.147 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:23:08.147 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:23:08.163 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T09:23:08.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.304+0000 7ff731065640 1 Processor -- start 2024-09-19T09:23:08.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.305+0000 7ff731065640 1 -- start start 2024-09-19T09:23:08.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.305+0000 7ff731065640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff72c142150 0x7ff72c160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:08.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.305+0000 7ff731065640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff72c160a80 0x7ff72c0cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:08.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.305+0000 7ff731065640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff72c142650 con 0x7ff72c13fae0 2024-09-19T09:23:08.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.305+0000 7ff731065640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7ff72c0ce780 con 0x7ff72c160a80 2024-09-19T09:23:08.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.305+0000 7ff731065640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff72c142930 con 0x7ff72c142150 2024-09-19T09:23:08.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.306+0000 7ff72ad9d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff72c13fae0 0x7ff72c06f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55856/0 (socket says 172.21.15.18:55856) 2024-09-19T09:23:08.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.306+0000 7ff72ad9d640 1 -- 172.21.15.18:0/1959770189 learned_addr learned my addr 172.21.15.18:0/1959770189 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:23:08.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.306+0000 7ff72b59e640 1 --2- 172.21.15.18:0/1959770189 >> v2:172.21.15.18:3300/0 conn(0x7ff72c160a80 0x7ff72c0cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:08.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.306+0000 7ff729d9b640 1 -- 172.21.15.18:0/1959770189 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2019747222 0 0) 0x7ff72c142650 con 0x7ff72c13fae0 2024-09-19T09:23:08.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.306+0000 7ff729d9b640 1 -- 172.21.15.18:0/1959770189 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff718003520 con 0x7ff72c13fae0 2024-09-19T09:23:08.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.306+0000 7ff72a59c640 1 --2- 172.21.15.18:0/1959770189 >> v2:172.21.15.162:3300/0 conn(0x7ff72c142150 0x7ff72c160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:08.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.306+0000 7ff72b59e640 1 -- 172.21.15.18:0/1959770189 >> v2:172.21.15.162:3300/0 conn(0x7ff72c142150 msgr2=0x7ff72c160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:08.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.306+0000 7ff72b59e640 1 --2- 172.21.15.18:0/1959770189 >> v2:172.21.15.162:3300/0 conn(0x7ff72c142150 0x7ff72c160540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.306+0000 7ff72b59e640 1 -- 172.21.15.18:0/1959770189 >> v1:172.21.15.18:6789/0 conn(0x7ff72c13fae0 legacy=0x7ff72c06f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:08.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.306+0000 7ff72b59e640 1 -- 172.21.15.18:0/1959770189 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff72c142c10 con 0x7ff72c160a80 2024-09-19T09:23:08.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.307+0000 7ff72b59e640 1 --2- 172.21.15.18:0/1959770189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff72c160a80 0x7ff72c0cec10 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7ff72c075560 tx=0x7ff71c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47fda0c598cd793 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:08.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.307+0000 7ff729d9b640 1 -- 172.21.15.18:0/1959770189 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71c037070 con 0x7ff72c160a80 2024-09-19T09:23:08.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.307+0000 7ff729d9b640 1 -- 172.21.15.18:0/1959770189 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff71c032440 con 0x7ff72c160a80 2024-09-19T09:23:08.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.307+0000 7ff729d9b640 1 -- 172.21.15.18:0/1959770189 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71c02ae60 con 0x7ff72c160a80 2024-09-19T09:23:08.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.307+0000 7ff731065640 1 -- 172.21.15.18:0/1959770189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff72c160a80 msgr2=0x7ff72c0cec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:08.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.307+0000 7ff731065640 1 --2- 172.21.15.18:0/1959770189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff72c160a80 0x7ff72c0cec10 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7ff72c075560 tx=0x7ff71c02a110 comp rx=0 tx=0).stop 2024-09-19T09:23:08.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.307+0000 7ff731065640 1 -- 172.21.15.18:0/1959770189 shutdown_connections 2024-09-19T09:23:08.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.307+0000 7ff731065640 1 --2- 172.21.15.18:0/1959770189 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff72c160a80 0x7ff72c0cec10 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.307+0000 7ff731065640 1 --2- 172.21.15.18:0/1959770189 >> v2:172.21.15.162:3300/0 conn(0x7ff72c142150 0x7ff72c160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.307+0000 7ff731065640 1 -- 172.21.15.18:0/1959770189 >> 172.21.15.18:0/1959770189 conn(0x7ff72c06bc10 msgr2=0x7ff72c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:08.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.307+0000 7ff731065640 1 -- 172.21.15.18:0/1959770189 shutdown_connections 2024-09-19T09:23:08.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.307+0000 7ff731065640 1 -- 172.21.15.18:0/1959770189 wait complete. 2024-09-19T09:23:08.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.309+0000 7ff731065640 1 Processor -- start 2024-09-19T09:23:08.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.309+0000 7ff731065640 1 -- start start 2024-09-19T09:23:08.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.310+0000 7ff731065640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff72c13fae0 0x7ff72c1f1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:08.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.310+0000 7ff731065640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff72c142150 0x7ff72c1f2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:08.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.310+0000 7ff731065640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff72c160a80 0x7ff72c13a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:08.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.310+0000 7ff731065640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff72c0cf2d0 con 0x7ff72c142150 2024-09-19T09:23:08.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.310+0000 7ff731065640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff72c0cf150 con 0x7ff72c13fae0 2024-09-19T09:23:08.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.310+0000 7ff731065640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff72c0cf450 con 0x7ff72c160a80 2024-09-19T09:23:08.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.310+0000 7ff72a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff72c142150 0x7ff72c1f2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:08.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.310+0000 7ff72a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff72c142150 0x7ff72c1f2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36270/0 (socket says 172.21.15.18:36270) 2024-09-19T09:23:08.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.310+0000 7ff72a59c640 1 -- 172.21.15.18:0/3360266847 learned_addr learned my addr 172.21.15.18:0/3360266847 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:23:08.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.310+0000 7ff72ad9d640 1 --2- 172.21.15.18:0/3360266847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff72c13fae0 0x7ff72c1f1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:08.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.310+0000 7ff72b59e640 1 --2- 172.21.15.18:0/3360266847 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff72c160a80 0x7ff72c13a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:08.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.310+0000 7ff72a59c640 1 -- 172.21.15.18:0/3360266847 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff72c160a80 msgr2=0x7ff72c13a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:08.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.310+0000 7ff72a59c640 1 --2- 172.21.15.18:0/3360266847 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff72c160a80 0x7ff72c13a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.310+0000 7ff72a59c640 1 -- 172.21.15.18:0/3360266847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff72c13fae0 msgr2=0x7ff72c1f1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:08.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.310+0000 7ff72a59c640 1 --2- 172.21.15.18:0/3360266847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff72c13fae0 0x7ff72c1f1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.310+0000 7ff72a59c640 1 -- 172.21.15.18:0/3360266847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff72c13ad50 con 0x7ff72c142150 2024-09-19T09:23:08.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.310+0000 7ff72ad9d640 1 --2- 172.21.15.18:0/3360266847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff72c13fae0 0x7ff72c1f1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:08.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.310+0000 7ff72a59c640 1 --2- 172.21.15.18:0/3360266847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff72c142150 0x7ff72c1f2b40 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7ff71400c7f0 tx=0x7ff71400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:08.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.310+0000 7ff7237fe640 1 -- 172.21.15.18:0/3360266847 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff714015070 con 0x7ff72c142150 2024-09-19T09:23:08.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.310+0000 7ff7237fe640 1 -- 172.21.15.18:0/3360266847 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff714004240 con 0x7ff72c142150 2024-09-19T09:23:08.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.310+0000 7ff731065640 1 -- 172.21.15.18:0/3360266847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff72c13b030 con 0x7ff72c142150 2024-09-19T09:23:08.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.310+0000 7ff7237fe640 1 -- 172.21.15.18:0/3360266847 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff714007620 con 0x7ff72c142150 2024-09-19T09:23:08.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.310+0000 7ff731065640 1 -- 172.21.15.18:0/3360266847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff72c1f5980 con 0x7ff72c142150 2024-09-19T09:23:08.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.311+0000 7ff731065640 1 -- 172.21.15.18:0/3360266847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff72c160540 con 0x7ff72c142150 2024-09-19T09:23:08.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.312+0000 7ff7237fe640 1 -- 172.21.15.18:0/3360266847 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff7140077c0 con 0x7ff72c142150 2024-09-19T09:23:08.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.312+0000 7ff7237fe640 1 --2- 172.21.15.18:0/3360266847 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff70c06c2b0 0x7ff70c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:08.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.312+0000 7ff7237fe640 1 -- 172.21.15.18:0/3360266847 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7ff71408b650 con 0x7ff72c142150 2024-09-19T09:23:08.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.313+0000 7ff72ad9d640 1 --2- 172.21.15.18:0/3360266847 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff70c06c2b0 0x7ff70c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:08.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.313+0000 7ff72ad9d640 1 --2- 172.21.15.18:0/3360266847 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff70c06c2b0 0x7ff70c06e770 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff724005c00 tx=0x7ff724009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:08.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.317+0000 7ff7237fe640 1 -- 172.21.15.18:0/3360266847 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff714059e50 con 0x7ff72c142150 2024-09-19T09:23:08.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.531+0000 7ff731065640 1 -- 172.21.15.18:0/3360266847 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff72c075620 con 0x7ff72c142150 2024-09-19T09:23:08.532 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.531+0000 7ff7237fe640 1 -- 172.21.15.18:0/3360266847 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v74) ==== 53+0+73 (secure 0 0 0) 0x7ff714059750 con 0x7ff72c142150 2024-09-19T09:23:08.532 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T09:23:08.534 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.534+0000 7ff731065640 1 -- 172.21.15.18:0/3360266847 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff70c06c2b0 msgr2=0x7ff70c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:08.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.534+0000 7ff731065640 1 --2- 172.21.15.18:0/3360266847 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff70c06c2b0 0x7ff70c06e770 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ff724005c00 tx=0x7ff724009040 comp rx=0 tx=0).stop 2024-09-19T09:23:08.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.534+0000 7ff731065640 1 -- 172.21.15.18:0/3360266847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff72c142150 msgr2=0x7ff72c1f2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:08.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.534+0000 7ff731065640 1 --2- 172.21.15.18:0/3360266847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff72c142150 0x7ff72c1f2b40 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7ff71400c7f0 tx=0x7ff71400ccb0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.534+0000 7ff731065640 1 -- 172.21.15.18:0/3360266847 shutdown_connections 2024-09-19T09:23:08.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.534+0000 7ff731065640 1 --2- 172.21.15.18:0/3360266847 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff70c06c2b0 0x7ff70c06e770 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.534+0000 7ff731065640 1 --2- 172.21.15.18:0/3360266847 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff72c160a80 0x7ff72c13a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.534+0000 7ff731065640 1 --2- 172.21.15.18:0/3360266847 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff72c142150 0x7ff72c1f2b40 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.534+0000 7ff731065640 1 --2- 172.21.15.18:0/3360266847 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff72c13fae0 0x7ff72c1f1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:08.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.534+0000 7ff731065640 1 -- 172.21.15.18:0/3360266847 >> 172.21.15.18:0/3360266847 conn(0x7ff72c06bc10 msgr2=0x7ff72c0cf810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:08.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.534+0000 7ff731065640 1 -- 172.21.15.18:0/3360266847 shutdown_connections 2024-09-19T09:23:08.535 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:08.534+0000 7ff731065640 1 -- 172.21.15.18:0/3360266847 wait complete. 2024-09-19T09:23:08.545 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-19T09:23:08.545 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:23:08.546 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-09-19T09:23:08.546 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-19T09:23:08.546 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-19T09:23:08.546 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-19T09:23:08.546 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-19T09:23:08.546 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:23:08.546 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:23:08.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:23:08.546 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-09-19T09:23:08.565 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:23:08.566 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:23:08.566 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:23:08.566 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:23:08.566 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-09-19T09:23:08.566 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:23:08.566 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:23:08.566 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:23:08.566 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-09-19T09:23:08.566 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:23:08.566 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:23:08.566 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-09-19T09:23:08.566 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:23:08.567 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:23:08.567 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:23:08.567 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:23:08.567 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T09:23:08.567 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42220sec preferred_lft 42220sec 2024-09-19T09:23:08.567 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link noprefixroute 2024-09-19T09:23:08.567 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:23:08.567 INFO:teuthology.orchestra.run.smithi162.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T09:23:08.567 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 5e:4d:7e:1d:19:f9 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:23:08.567 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T09:23:08.567 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:23:08.567 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::5829:65ff:fe01:6bc7/64 scope link 2024-09-19T09:23:08.567 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:23:08.567 INFO:teuthology.orchestra.run.smithi162.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:23:08.568 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 86:86:3e:32:67:c5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T09:23:08.568 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::8486:3eff:fe32:67c5/64 scope link 2024-09-19T09:23:08.568 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:23:08.568 INFO:teuthology.orchestra.run.smithi162.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:23:08.568 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 5e:4d:7e:1d:19:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-19T09:23:08.568 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::5c4d:7eff:fe1d:19f9/64 scope link 2024-09-19T09:23:08.568 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:23:08.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:23:08.568 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:23:08.635 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-09-19T09:23:08.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:23:08.637 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-09-19T09:23:08.697 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-09-19T09:23:08.697 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:23:08.697 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T09:23:08.697 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T09:23:08.697 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:23:08.698 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:23:08.698 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-19T09:23:08.698 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T09:23:08.698 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T09:23:08.698 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T09:23:08.698 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-19T09:23:08.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:23:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:23:08.823 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:23:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:23:08.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:23:08.829 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-19T09:23:08.846 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-19T09:23:08.846 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-19T09:23:08.847 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:23:08.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:23:08.847 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2024-09-19T09:23:08.912 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:23:08.913 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-19T09:23:08.968 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:23:08.969 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:23:08.969 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-19T09:23:09.024 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-19T09:23:09.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:23:09.024 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:23:09.108 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:23:09.109 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:23:09.109 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:23:09.117 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:23:09.117 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:23:09.118 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:23:09.118 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:23:09.118 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:23:09.135 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:23:09.135 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:23:09.135 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:23:09.135 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:23:09.135 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:23:09.136 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-19T09:23:09.136 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-19T09:23:09.136 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=fec66d7e-50e5-42ed-81de-ad141a2f0f4e" will pass to kernel 2024-09-19T09:23:09.136 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-19T09:23:09.136 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:23:09.136 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:23:09.136 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:23:09.136 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:23:09.137 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:23:09.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:23:09.138 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-19T09:23:09.162 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:23:09.251 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:23:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:23:09.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:23:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:23:09.259 INFO:teuthology.orchestra.run.smithi162.stdout:client6275 2024-09-19T09:23:09.259 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:23:09.259 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:23:09.276 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:23:09.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.390+0000 7ff1ba359640 1 Processor -- start 2024-09-19T09:23:09.391 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.390+0000 7ff1ba359640 1 -- start start 2024-09-19T09:23:09.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.391+0000 7ff1ba359640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff1b406d730 0x7ff1b40b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.391+0000 7ff1ba359640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1b40cd1a0 con 0x7ff1b415ef80 2024-09-19T09:23:09.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.391+0000 7ff1ba359640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1b406dc30 con 0x7ff1b40cfae0 2024-09-19T09:23:09.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.391+0000 7ff1ba359640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff1b40cd7d0 con 0x7ff1b406d730 2024-09-19T09:23:09.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.391+0000 7ff1b3fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff1b415ef80 0x7ff1b40cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55870/0 (socket says 172.21.15.18:55870) 2024-09-19T09:23:09.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.391+0000 7ff1b3fff640 1 -- 172.21.15.18:0/2574283863 learned_addr learned my addr 172.21.15.18:0/2574283863 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:23:09.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.392+0000 7ff1b88f6640 1 --2- 172.21.15.18:0/2574283863 >> v2:172.21.15.162:3300/0 conn(0x7ff1b406d730 0x7ff1b40b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.392+0000 7ff1b2ffd640 1 -- 172.21.15.18:0/2574283863 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4287369764 0 0) 0x7ff1b40cd1a0 con 0x7ff1b415ef80 2024-09-19T09:23:09.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.392+0000 7ff1b2ffd640 1 -- 172.21.15.18:0/2574283863 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff19c003520 con 0x7ff1b415ef80 2024-09-19T09:23:09.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.392+0000 7ff1b2ffd640 1 -- 172.21.15.18:0/2574283863 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3325221454 0 0) 0x7ff19c003520 con 0x7ff1b415ef80 2024-09-19T09:23:09.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.392+0000 7ff1b2ffd640 1 -- 172.21.15.18:0/2574283863 >> v2:172.21.15.162:3300/0 conn(0x7ff1b406d730 msgr2=0x7ff1b40b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:09.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.392+0000 7ff1b2ffd640 1 --2- 172.21.15.18:0/2574283863 >> v2:172.21.15.162:3300/0 conn(0x7ff1b406d730 0x7ff1b40b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.392+0000 7ff1b2ffd640 1 -- 172.21.15.18:0/2574283863 >> v1:172.21.15.162:6789/0 conn(0x7ff1b40cfae0 legacy=0x7ff1b40cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:09.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.392+0000 7ff1b2ffd640 1 -- 172.21.15.18:0/2574283863 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1b406df10 con 0x7ff1b415ef80 2024-09-19T09:23:09.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.392+0000 7ff1b2ffd640 1 -- 172.21.15.18:0/2574283863 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7ff1a4001670 con 0x7ff1b415ef80 2024-09-19T09:23:09.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.392+0000 7ff1b88f6640 1 --2- 172.21.15.18:0/2574283863 >> v2:172.21.15.162:3300/0 conn(0x7ff1b406d730 0x7ff1b40b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:23:09.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.392+0000 7ff1b2ffd640 1 -- 172.21.15.18:0/2574283863 >> v1:172.21.15.18:6789/0 conn(0x7ff1b415ef80 legacy=0x7ff1b40cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:09.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.392+0000 7ff1b2ffd640 1 --2- 172.21.15.18:0/2574283863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff19c0039b0 0x7ff19c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.392+0000 7ff1b2ffd640 1 --2- 172.21.15.18:0/2574283863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff19c0043b0 0x7ff19c004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.392+0000 7ff1b2ffd640 1 --2- 172.21.15.18:0/2574283863 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff19c005080 0x7ff19c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.392+0000 7ff1b2ffd640 1 -- 172.21.15.18:0/2574283863 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b40cd7d0 con 0x7ff19c0039b0 2024-09-19T09:23:09.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.392+0000 7ff1b2ffd640 1 -- 172.21.15.18:0/2574283863 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff19c00bfe0 con 0x7ff19c0043b0 2024-09-19T09:23:09.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.392+0000 7ff1b2ffd640 1 -- 172.21.15.18:0/2574283863 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff19c00c1e0 con 0x7ff19c005080 2024-09-19T09:23:09.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.392+0000 7ff1b3fff640 1 --2- 172.21.15.18:0/2574283863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff19c0039b0 0x7ff19c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.392+0000 7ff1b37fe640 1 --2- 172.21.15.18:0/2574283863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff19c0043b0 0x7ff19c004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.392+0000 7ff1b88f6640 1 --2- 172.21.15.18:0/2574283863 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff19c005080 0x7ff19c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.393+0000 7ff1b3fff640 1 -- 172.21.15.18:0/2574283863 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff19c005080 msgr2=0x7ff19c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:09.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.393+0000 7ff1b3fff640 1 --2- 172.21.15.18:0/2574283863 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff19c005080 0x7ff19c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.393+0000 7ff1b3fff640 1 -- 172.21.15.18:0/2574283863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff19c0043b0 msgr2=0x7ff19c004880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:09.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.393+0000 7ff1b3fff640 1 --2- 172.21.15.18:0/2574283863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff19c0043b0 0x7ff19c004880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.393+0000 7ff1b3fff640 1 -- 172.21.15.18:0/2574283863 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff19c003520 con 0x7ff19c0039b0 2024-09-19T09:23:09.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.393+0000 7ff1b88f6640 1 -- 172.21.15.18:0/2574283863 reap_dead start 2024-09-19T09:23:09.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.393+0000 7ff1b3fff640 1 --2- 172.21.15.18:0/2574283863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff19c0039b0 0x7ff19c003d90 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400c290 tx=0x7ff19c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12fa15137515748 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:09.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.393+0000 7ff1b2ffd640 1 -- 172.21.15.18:0/2574283863 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4007d50 con 0x7ff19c0039b0 2024-09-19T09:23:09.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.393+0000 7ff1b2ffd640 1 -- 172.21.15.18:0/2574283863 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1a4005af0 con 0x7ff19c0039b0 2024-09-19T09:23:09.397 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.393+0000 7ff1b2ffd640 1 -- 172.21.15.18:0/2574283863 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4007070 con 0x7ff19c0039b0 2024-09-19T09:23:09.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.394+0000 7ff1ba359640 1 -- 172.21.15.18:0/2574283863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff19c0039b0 msgr2=0x7ff19c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:09.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.394+0000 7ff1ba359640 1 --2- 172.21.15.18:0/2574283863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff19c0039b0 0x7ff19c003d90 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7ff1a400c290 tx=0x7ff19c005830 comp rx=0 tx=0).stop 2024-09-19T09:23:09.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.394+0000 7ff1ba359640 1 -- 172.21.15.18:0/2574283863 shutdown_connections 2024-09-19T09:23:09.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.394+0000 7ff1ba359640 1 --2- 172.21.15.18:0/2574283863 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff19c0039b0 0x7ff19c003d90 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.394+0000 7ff1ba359640 1 -- 172.21.15.18:0/2574283863 >> 172.21.15.18:0/2574283863 conn(0x7ff1b40b4700 msgr2=0x7ff1b40b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:09.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.394+0000 7ff1ba359640 1 -- 172.21.15.18:0/2574283863 shutdown_connections 2024-09-19T09:23:09.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.394+0000 7ff1ba359640 1 -- 172.21.15.18:0/2574283863 wait complete. 2024-09-19T09:23:09.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.395+0000 7ff1ba359640 1 Processor -- start 2024-09-19T09:23:09.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.396+0000 7ff1ba359640 1 -- start start 2024-09-19T09:23:09.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.396+0000 7ff1ba359640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff19c0039b0 0x7ff1b40c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.396+0000 7ff1ba359640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1b41f7ca0 0x7ff1b41f8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.396+0000 7ff1ba359640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff1b415db50 0x7ff1b415dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.396+0000 7ff1ba359640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b40d0120 con 0x7ff19c0039b0 2024-09-19T09:23:09.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.396+0000 7ff1ba359640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff1b415f360 con 0x7ff1b41f7ca0 2024-09-19T09:23:09.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.396+0000 7ff1ba359640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff1b40b5220 con 0x7ff1b415db50 2024-09-19T09:23:09.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.396+0000 7ff1b3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff19c0039b0 0x7ff1b40c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.396+0000 7ff1b3fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff19c0039b0 0x7ff1b40c7f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36292/0 (socket says 172.21.15.18:36292) 2024-09-19T09:23:09.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.396+0000 7ff1b3fff640 1 -- 172.21.15.18:0/359782023 learned_addr learned my addr 172.21.15.18:0/359782023 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:23:09.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.396+0000 7ff1b88f6640 1 --2- 172.21.15.18:0/359782023 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff1b415db50 0x7ff1b415dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.397+0000 7ff1b37fe640 1 --2- 172.21.15.18:0/359782023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1b41f7ca0 0x7ff1b41f8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.397+0000 7ff1b3fff640 1 -- 172.21.15.18:0/359782023 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff1b415db50 msgr2=0x7ff1b415dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:09.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.397+0000 7ff1b3fff640 1 --2- 172.21.15.18:0/359782023 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff1b415db50 0x7ff1b415dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.397+0000 7ff1b3fff640 1 -- 172.21.15.18:0/359782023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1b41f7ca0 msgr2=0x7ff1b41f8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:09.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.397+0000 7ff1b3fff640 1 --2- 172.21.15.18:0/359782023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1b41f7ca0 0x7ff1b41f8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.397+0000 7ff1b3fff640 1 -- 172.21.15.18:0/359782023 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1b40b7eb0 con 0x7ff19c0039b0 2024-09-19T09:23:09.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.397+0000 7ff1b3fff640 1 --2- 172.21.15.18:0/359782023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff19c0039b0 0x7ff1b40c7f00 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4001200 tx=0x7ff1a4001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:09.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.397+0000 7ff1b0ff9640 1 -- 172.21.15.18:0/359782023 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4040030 con 0x7ff19c0039b0 2024-09-19T09:23:09.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.397+0000 7ff1b0ff9640 1 -- 172.21.15.18:0/359782023 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1a4001470 con 0x7ff19c0039b0 2024-09-19T09:23:09.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.397+0000 7ff1b0ff9640 1 -- 172.21.15.18:0/359782023 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1a4037040 con 0x7ff19c0039b0 2024-09-19T09:23:09.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.397+0000 7ff1ba359640 1 -- 172.21.15.18:0/359782023 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1b40b5aa0 con 0x7ff19c0039b0 2024-09-19T09:23:09.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.397+0000 7ff1ba359640 1 -- 172.21.15.18:0/359782023 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1b41f8880 con 0x7ff19c0039b0 2024-09-19T09:23:09.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.398+0000 7ff1ba359640 1 -- 172.21.15.18:0/359782023 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1b40b5550 con 0x7ff19c0039b0 2024-09-19T09:23:09.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.399+0000 7ff1b0ff9640 1 -- 172.21.15.18:0/359782023 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff1a4043070 con 0x7ff19c0039b0 2024-09-19T09:23:09.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.399+0000 7ff1b0ff9640 1 --2- 172.21.15.18:0/359782023 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff1a006c2e0 0x7ff1a006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.402 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.399+0000 7ff1b0ff9640 1 -- 172.21.15.18:0/359782023 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7ff1a40aafc0 con 0x7ff19c0039b0 2024-09-19T09:23:09.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.399+0000 7ff1b37fe640 1 --2- 172.21.15.18:0/359782023 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff1a006c2e0 0x7ff1a006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.403 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.400+0000 7ff1b37fe640 1 --2- 172.21.15.18:0/359782023 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff1a006c2e0 0x7ff1a006e7a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff1b40b4300 tx=0x7ff1a8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:09.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.404+0000 7ff1b0ff9640 1 -- 172.21.15.18:0/359782023 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff1b40b7eb0 con 0x7ff19c0039b0 2024-09-19T09:23:09.618 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.618+0000 7ff1ba359640 1 -- 172.21.15.18:0/359782023 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff1b40cff00 con 0x7ff19c0039b0 2024-09-19T09:23:09.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.618+0000 7ff1b0ff9640 1 -- 172.21.15.18:0/359782023 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5230 (secure 0 0 0) 0x7ff1a4078fc0 con 0x7ff19c0039b0 2024-09-19T09:23:09.619 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:23:09.619 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":74,"btime":"2024-09-19T09:23:04:468698+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1145590197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1145590197},{"type":"v1","addr":"172.21.15.162:6837","nonce":1145590197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/200393908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":200393908},{"type":"v1","addr":"172.21.15.162:6836","nonce":200393908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7542,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1236184741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1236184741},{"type":"v1","addr":"172.21.15.18:6834","nonce":1236184741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:23:00.797014+0000","modified":"2024-09-19T09:23:03.823915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7545":{"gid":7545,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2876222862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2876222862},{"type":"v1","addr":"172.21.15.18:6835","nonce":2876222862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7545,"qdb_cluster":[7545]},"id":10}]} 2024-09-19T09:23:09.620 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 74 2024-09-19T09:23:09.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.620+0000 7ff1ba359640 1 -- 172.21.15.18:0/359782023 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff1a006c2e0 msgr2=0x7ff1a006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:09.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.620+0000 7ff1ba359640 1 --2- 172.21.15.18:0/359782023 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff1a006c2e0 0x7ff1a006e7a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ff1b40b4300 tx=0x7ff1a8009040 comp rx=0 tx=0).stop 2024-09-19T09:23:09.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.620+0000 7ff1ba359640 1 -- 172.21.15.18:0/359782023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff19c0039b0 msgr2=0x7ff1b40c7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:09.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.620+0000 7ff1ba359640 1 --2- 172.21.15.18:0/359782023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff19c0039b0 0x7ff1b40c7f00 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4001200 tx=0x7ff1a4001a40 comp rx=0 tx=0).stop 2024-09-19T09:23:09.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.620+0000 7ff1ba359640 1 -- 172.21.15.18:0/359782023 shutdown_connections 2024-09-19T09:23:09.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.620+0000 7ff1ba359640 1 --2- 172.21.15.18:0/359782023 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff1a006c2e0 0x7ff1a006e7a0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.620+0000 7ff1ba359640 1 --2- 172.21.15.18:0/359782023 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff1b415db50 0x7ff1b415dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.620+0000 7ff1ba359640 1 --2- 172.21.15.18:0/359782023 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1b41f7ca0 0x7ff1b41f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.620+0000 7ff1ba359640 1 --2- 172.21.15.18:0/359782023 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff19c0039b0 0x7ff1b40c7f00 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.620+0000 7ff1ba359640 1 -- 172.21.15.18:0/359782023 >> 172.21.15.18:0/359782023 conn(0x7ff1b40b4700 msgr2=0x7ff1b415f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:09.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.620+0000 7ff1ba359640 1 -- 172.21.15.18:0/359782023 shutdown_connections 2024-09-19T09:23:09.622 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.620+0000 7ff1ba359640 1 -- 172.21.15.18:0/359782023 wait complete. 2024-09-19T09:23:09.632 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-19T09:23:09.753 INFO:teuthology.orchestra.run.smithi018.stdout:{"cluster_fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","whoami":0,"id":7545,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.304952986,"mdsmap_epoch":74,"osdmap_epoch":167,"osdmap_epoch_barrier":167,"uptime":13.298141876000001} 2024-09-19T09:23:09.754 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", "fs_name": "cephfs", "id": 7545, "mdsmap_epoch": 74, "osdmap_epoch": 167, "osdmap_epoch_barrier": 167, "rank_uptime": 8.304952986, "state": "up:active", "uptime": 13.298141876, "want_state": "up:active", "whoami": 0 } 2024-09-19T09:23:09.754 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2024-09-19T09:23:09.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.859+0000 7f8c46ad7640 1 Processor -- start 2024-09-19T09:23:09.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.859+0000 7f8c46ad7640 1 -- start start 2024-09-19T09:23:09.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.860+0000 7f8c46ad7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c400c90f0 0x7f8c400d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.860+0000 7f8c46ad7640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8c400d17c0 0x7f8c400cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.860+0000 7f8c46ad7640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c400d0be0 con 0x7f8c400d01a0 2024-09-19T09:23:09.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.860+0000 7f8c46ad7640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8c400c94d0 con 0x7f8c400d17c0 2024-09-19T09:23:09.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.860+0000 7f8c46ad7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8c400b5420 con 0x7f8c400c90f0 2024-09-19T09:23:09.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.860+0000 7f8c44873640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c400c90f0 0x7f8c400d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.860+0000 7f8c45074640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8c400d17c0 0x7f8c400cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.860+0000 7f8c3ffff640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f8c400d01a0 0x7f8c400d10b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:51482/0 (socket says 172.21.15.18:51482) 2024-09-19T09:23:09.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.860+0000 7f8c3ffff640 1 -- 172.21.15.18:0/1408410792 learned_addr learned my addr 172.21.15.18:0/1408410792 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:23:09.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.860+0000 7f8c45074640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8c400d17c0 0x7f8c400cd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:34524/0 (socket says 172.21.15.18:34524) 2024-09-19T09:23:09.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.860+0000 7f8c44873640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c400c90f0 0x7f8c400d06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:57750/0 (socket says 172.21.15.18:57750) 2024-09-19T09:23:09.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.861+0000 7f8c3f7fe640 1 -- 172.21.15.18:0/1408410792 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3431261567 0 0) 0x7f8c400d0be0 con 0x7f8c400d01a0 2024-09-19T09:23:09.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.861+0000 7f8c3f7fe640 1 -- 172.21.15.18:0/1408410792 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c28003520 con 0x7f8c400d01a0 2024-09-19T09:23:09.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.861+0000 7f8c45074640 1 -- 172.21.15.18:0/1408410792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c400c90f0 msgr2=0x7f8c400d06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:23:09.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.861+0000 7f8c45074640 1 --2- 172.21.15.18:0/1408410792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c400c90f0 0x7f8c400d06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.861+0000 7f8c45074640 1 -- 172.21.15.18:0/1408410792 >> v1:172.21.15.162:6789/0 conn(0x7f8c400d01a0 legacy=0x7f8c400d10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:09.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.861+0000 7f8c45074640 1 -- 172.21.15.18:0/1408410792 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c400b3a80 con 0x7f8c400d17c0 2024-09-19T09:23:09.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.861+0000 7f8c44873640 1 --2- 172.21.15.18:0/1408410792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c400c90f0 0x7f8c400d06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:23:09.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.862+0000 7f8c45074640 1 --2- 172.21.15.18:0/1408410792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c400d17c0 0x7f8c400cd5c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8c38009d90 tx=0x7f8c3802a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2bb90a7a5404b71 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:09.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.862+0000 7f8c3f7fe640 1 -- 172.21.15.18:0/1408410792 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c38031600 con 0x7f8c400d17c0 2024-09-19T09:23:09.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.862+0000 7f8c3f7fe640 1 -- 172.21.15.18:0/1408410792 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c380317a0 con 0x7f8c400d17c0 2024-09-19T09:23:09.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.862+0000 7f8c3f7fe640 1 -- 172.21.15.18:0/1408410792 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c38031b70 con 0x7f8c400d17c0 2024-09-19T09:23:09.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.862+0000 7f8c46ad7640 1 -- 172.21.15.18:0/1408410792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c400d17c0 msgr2=0x7f8c400cd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:09.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.862+0000 7f8c46ad7640 1 --2- 172.21.15.18:0/1408410792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c400d17c0 0x7f8c400cd5c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8c38009d90 tx=0x7f8c3802a5d0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.862+0000 7f8c46ad7640 1 -- 172.21.15.18:0/1408410792 shutdown_connections 2024-09-19T09:23:09.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.862+0000 7f8c46ad7640 1 --2- 172.21.15.18:0/1408410792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c400d17c0 0x7f8c400cd5c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.862+0000 7f8c46ad7640 1 --2- 172.21.15.18:0/1408410792 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c400c90f0 0x7f8c400d06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.862+0000 7f8c46ad7640 1 -- 172.21.15.18:0/1408410792 >> 172.21.15.18:0/1408410792 conn(0x7f8c400b4660 msgr2=0x7f8c400b4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:09.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.862+0000 7f8c46ad7640 1 -- 172.21.15.18:0/1408410792 shutdown_connections 2024-09-19T09:23:09.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.862+0000 7f8c46ad7640 1 -- 172.21.15.18:0/1408410792 wait complete. 2024-09-19T09:23:09.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.864+0000 7f8c46ad7640 1 Processor -- start 2024-09-19T09:23:09.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.864+0000 7f8c46ad7640 1 -- start start 2024-09-19T09:23:09.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.864+0000 7f8c46ad7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c400c90f0 0x7f8c4015a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.864+0000 7f8c46ad7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c400d01a0 0x7f8c4006d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.864+0000 7f8c46ad7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c400d17c0 0x7f8c4015f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.864+0000 7f8c46ad7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8c400cfc80 con 0x7f8c400d01a0 2024-09-19T09:23:09.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.864+0000 7f8c46ad7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8c400b4040 con 0x7f8c400d17c0 2024-09-19T09:23:09.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.864+0000 7f8c46ad7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8c400cdb00 con 0x7f8c400c90f0 2024-09-19T09:23:09.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.865+0000 7f8c3ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c400d01a0 0x7f8c4006d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.865+0000 7f8c3ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c400d01a0 0x7f8c4006d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:36294/0 (socket says 172.21.15.18:36294) 2024-09-19T09:23:09.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.865+0000 7f8c3ffff640 1 -- 172.21.15.18:0/1537745833 learned_addr learned my addr 172.21.15.18:0/1537745833 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:23:09.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.865+0000 7f8c45074640 1 --2- 172.21.15.18:0/1537745833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c400d17c0 0x7f8c4015f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.865+0000 7f8c44873640 1 --2- 172.21.15.18:0/1537745833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c400c90f0 0x7f8c4015a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.865+0000 7f8c3ffff640 1 -- 172.21.15.18:0/1537745833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c400c90f0 msgr2=0x7f8c4015a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:09.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.865+0000 7f8c3ffff640 1 --2- 172.21.15.18:0/1537745833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c400c90f0 0x7f8c4015a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.865+0000 7f8c3ffff640 1 -- 172.21.15.18:0/1537745833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c400d17c0 msgr2=0x7f8c4015f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:09.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.865+0000 7f8c3ffff640 1 --2- 172.21.15.18:0/1537745833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c400d17c0 0x7f8c4015f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:09.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.865+0000 7f8c3ffff640 1 -- 172.21.15.18:0/1537745833 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c4015baa0 con 0x7f8c400d01a0 2024-09-19T09:23:09.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.865+0000 7f8c45074640 1 --2- 172.21.15.18:0/1537745833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c400d17c0 0x7f8c4015f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:23:09.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.865+0000 7f8c3ffff640 1 --2- 172.21.15.18:0/1537745833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c400d01a0 0x7f8c4006d7a0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f8c3400c460 tx=0x7f8c3400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:09.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.865+0000 7f8c3d7fa640 1 -- 172.21.15.18:0/1537745833 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c34017070 con 0x7f8c400d01a0 2024-09-19T09:23:09.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.865+0000 7f8c3d7fa640 1 -- 172.21.15.18:0/1537745833 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c34005ce0 con 0x7f8c400d01a0 2024-09-19T09:23:09.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.865+0000 7f8c46ad7640 1 -- 172.21.15.18:0/1537745833 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c4006dce0 con 0x7f8c400d01a0 2024-09-19T09:23:09.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.865+0000 7f8c3d7fa640 1 -- 172.21.15.18:0/1537745833 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c34007290 con 0x7f8c400d01a0 2024-09-19T09:23:09.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.865+0000 7f8c46ad7640 1 -- 172.21.15.18:0/1537745833 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c400cbf20 con 0x7f8c400d01a0 2024-09-19T09:23:09.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.866+0000 7f8c46ad7640 1 -- 172.21.15.18:0/1537745833 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c400cd5c0 con 0x7f8c400d01a0 2024-09-19T09:23:09.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.867+0000 7f8c3d7fa640 1 -- 172.21.15.18:0/1537745833 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8c3401a070 con 0x7f8c400d01a0 2024-09-19T09:23:09.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.867+0000 7f8c3d7fa640 1 --2- 172.21.15.18:0/1537745833 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8c2c06c2b0 0x7f8c2c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:23:09.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.867+0000 7f8c3d7fa640 1 -- 172.21.15.18:0/1537745833 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(167..167 src has 1..167) ==== 5709+0+0 (secure 0 0 0) 0x7f8c3408a7c0 con 0x7f8c400d01a0 2024-09-19T09:23:09.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.867+0000 7f8c44873640 1 --2- 172.21.15.18:0/1537745833 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8c2c06c2b0 0x7f8c2c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:23:09.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.868+0000 7f8c44873640 1 --2- 172.21.15.18:0/1537745833 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8c2c06c2b0 0x7f8c2c06e770 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8c30009560 tx=0x7f8c30009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:23:09.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:09.872+0000 7f8c3d7fa640 1 -- 172.21.15.18:0/1537745833 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8c34058840 con 0x7f8c400d01a0 2024-09-19T09:23:10.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:10.046+0000 7f8c46ad7640 1 -- 172.21.15.18:0/1537745833 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) -- 0x7f8c4015bc70 con 0x7f8c400d01a0 2024-09-19T09:23:10.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:10.487+0000 7f8c3d7fa640 1 -- 172.21.15.18:0/1537745833 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v168) ==== 181+0+0 (secure 0 0 0) 0x7f8c3405cb40 con 0x7f8c400d01a0 2024-09-19T09:23:10.488 INFO:teuthology.orchestra.run.smithi018.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2024-09-19T09:23:10.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:10.489+0000 7f8c46ad7640 1 -- 172.21.15.18:0/1537745833 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8c2c06c2b0 msgr2=0x7f8c2c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:10.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:10.489+0000 7f8c46ad7640 1 --2- 172.21.15.18:0/1537745833 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8c2c06c2b0 0x7f8c2c06e770 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8c30009560 tx=0x7f8c30009190 comp rx=0 tx=0).stop 2024-09-19T09:23:10.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:10.489+0000 7f8c46ad7640 1 -- 172.21.15.18:0/1537745833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c400d01a0 msgr2=0x7f8c4006d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:23:10.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:10.489+0000 7f8c46ad7640 1 --2- 172.21.15.18:0/1537745833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c400d01a0 0x7f8c4006d7a0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f8c3400c460 tx=0x7f8c3400c920 comp rx=0 tx=0).stop 2024-09-19T09:23:10.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:10.490+0000 7f8c46ad7640 1 -- 172.21.15.18:0/1537745833 shutdown_connections 2024-09-19T09:23:10.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:10.490+0000 7f8c46ad7640 1 --2- 172.21.15.18:0/1537745833 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8c2c06c2b0 0x7f8c2c06e770 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:10.490+0000 7f8c46ad7640 1 --2- 172.21.15.18:0/1537745833 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c400d17c0 0x7f8c4015f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:10.490+0000 7f8c46ad7640 1 --2- 172.21.15.18:0/1537745833 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c400d01a0 0x7f8c4006d7a0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:10.490+0000 7f8c46ad7640 1 --2- 172.21.15.18:0/1537745833 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c400c90f0 0x7f8c4015a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:23:10.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:10.490+0000 7f8c46ad7640 1 -- 172.21.15.18:0/1537745833 >> 172.21.15.18:0/1537745833 conn(0x7f8c400b4660 msgr2=0x7f8c400c6600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:23:10.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:10.490+0000 7f8c46ad7640 1 -- 172.21.15.18:0/1537745833 shutdown_connections 2024-09-19T09:23:10.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:23:10.490+0000 7f8c46ad7640 1 -- 172.21.15.18:0/1537745833 wait complete. 2024-09-19T09:23:10.503 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-19T09:23:10.620 INFO:teuthology.orchestra.run.smithi018.stdout:{"osd_mon_report_interval":"5"} 2024-09-19T09:23:10.620 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-19T09:23:10.621 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2024-09-19T09:23:10.729 INFO:teuthology.orchestra.run.smithi018.stdout:{"mon_tick_interval":"5"} 2024-09-19T09:23:10.729 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2024-09-19T09:23:10.729 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2024-09-19T09:23:10.730 DEBUG:teuthology.orchestra.run.smithi018:> stdin-killer -- python3 -c ' 2024-09-19T09:23:10.730 DEBUG:teuthology.orchestra.run.smithi018:> import time 2024-09-19T09:23:10.730 DEBUG:teuthology.orchestra.run.smithi018:> import datetime 2024-09-19T09:23:10.730 DEBUG:teuthology.orchestra.run.smithi018:> import subprocess 2024-09-19T09:23:10.730 DEBUG:teuthology.orchestra.run.smithi018:> import os 2024-09-19T09:23:10.730 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:23:10.730 DEBUG:teuthology.orchestra.run.smithi018:> # Write some buffered data through before going full, all should be well 2024-09-19T09:23:10.730 DEBUG:teuthology.orchestra.run.smithi018:> print("writing some data through which we expect to succeed") 2024-09-19T09:23:10.730 DEBUG:teuthology.orchestra.run.smithi018:> bytes = 0 2024-09-19T09:23:10.730 DEBUG:teuthology.orchestra.run.smithi018:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2024-09-19T09:23:10.730 DEBUG:teuthology.orchestra.run.smithi018:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2024-09-19T09:23:10.731 DEBUG:teuthology.orchestra.run.smithi018:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2024-09-19T09:23:10.731 DEBUG:teuthology.orchestra.run.smithi018:> os.fsync(f) 2024-09-19T09:23:10.731 DEBUG:teuthology.orchestra.run.smithi018:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2024-09-19T09:23:10.731 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:23:10.731 DEBUG:teuthology.orchestra.run.smithi018:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2024-09-19T09:23:10.731 DEBUG:teuthology.orchestra.run.smithi018:> # writing until we see an error from fsync. As long as we'"'"'re doing 2024-09-19T09:23:10.731 DEBUG:teuthology.orchestra.run.smithi018:> # buffered IO, the error should always only appear from fsync and not 2024-09-19T09:23:10.731 DEBUG:teuthology.orchestra.run.smithi018:> # from write 2024-09-19T09:23:10.731 DEBUG:teuthology.orchestra.run.smithi018:> full = False 2024-09-19T09:23:10.731 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:23:10.731 DEBUG:teuthology.orchestra.run.smithi018:> for n in range(0, int(32 * 1.1)): 2024-09-19T09:23:10.731 DEBUG:teuthology.orchestra.run.smithi018:> try: 2024-09-19T09:23:10.731 DEBUG:teuthology.orchestra.run.smithi018:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-19T09:23:10.731 DEBUG:teuthology.orchestra.run.smithi018:> print("wrote bytes via buffered write, moving on to fsync") 2024-09-19T09:23:10.731 DEBUG:teuthology.orchestra.run.smithi018:> except OSError as e: 2024-09-19T09:23:10.732 DEBUG:teuthology.orchestra.run.smithi018:> if False: 2024-09-19T09:23:10.732 DEBUG:teuthology.orchestra.run.smithi018:> print("Unexpected error %s from write() instead of fsync()" % e) 2024-09-19T09:23:10.732 DEBUG:teuthology.orchestra.run.smithi018:> raise 2024-09-19T09:23:10.732 DEBUG:teuthology.orchestra.run.smithi018:> else: 2024-09-19T09:23:10.732 DEBUG:teuthology.orchestra.run.smithi018:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-19T09:23:10.732 DEBUG:teuthology.orchestra.run.smithi018:> full = True 2024-09-19T09:23:10.732 DEBUG:teuthology.orchestra.run.smithi018:> break 2024-09-19T09:23:10.732 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:23:10.732 DEBUG:teuthology.orchestra.run.smithi018:> try: 2024-09-19T09:23:10.732 DEBUG:teuthology.orchestra.run.smithi018:> os.fsync(f) 2024-09-19T09:23:10.732 DEBUG:teuthology.orchestra.run.smithi018:> print("fsync'"'"'ed successfully") 2024-09-19T09:23:10.732 DEBUG:teuthology.orchestra.run.smithi018:> except OSError as e: 2024-09-19T09:23:10.732 DEBUG:teuthology.orchestra.run.smithi018:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-19T09:23:10.732 DEBUG:teuthology.orchestra.run.smithi018:> full = True 2024-09-19T09:23:10.732 DEBUG:teuthology.orchestra.run.smithi018:> break 2024-09-19T09:23:10.733 DEBUG:teuthology.orchestra.run.smithi018:> else: 2024-09-19T09:23:10.733 DEBUG:teuthology.orchestra.run.smithi018:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-19T09:23:10.733 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:23:10.733 DEBUG:teuthology.orchestra.run.smithi018:> if n > 32 * 0.9: 2024-09-19T09:23:10.733 DEBUG:teuthology.orchestra.run.smithi018:> # Be cautious in the last region where we expect to hit 2024-09-19T09:23:10.733 DEBUG:teuthology.orchestra.run.smithi018:> # the full condition, so that we don'"'"'t overshoot too dramatically 2024-09-19T09:23:10.733 DEBUG:teuthology.orchestra.run.smithi018:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2024-09-19T09:23:10.733 DEBUG:teuthology.orchestra.run.smithi018:> time.sleep(15.0) 2024-09-19T09:23:10.733 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:23:10.733 DEBUG:teuthology.orchestra.run.smithi018:> if not full: 2024-09-19T09:23:10.733 DEBUG:teuthology.orchestra.run.smithi018:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2024-09-19T09:23:10.733 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:23:10.733 DEBUG:teuthology.orchestra.run.smithi018:> # close() should not raise an error because we already caught it in 2024-09-19T09:23:10.734 DEBUG:teuthology.orchestra.run.smithi018:> # fsync. There shouldn'"'"'t have been any more writeback errors 2024-09-19T09:23:10.734 DEBUG:teuthology.orchestra.run.smithi018:> # since then because all IOs got cancelled on the full flag. 2024-09-19T09:23:10.734 DEBUG:teuthology.orchestra.run.smithi018:> print("calling close") 2024-09-19T09:23:10.734 DEBUG:teuthology.orchestra.run.smithi018:> os.close(f) 2024-09-19T09:23:10.734 DEBUG:teuthology.orchestra.run.smithi018:> print("close() did not raise error") 2024-09-19T09:23:10.734 DEBUG:teuthology.orchestra.run.smithi018:> 2024-09-19T09:23:10.734 DEBUG:teuthology.orchestra.run.smithi018:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2024-09-19T09:23:10.734 DEBUG:teuthology.orchestra.run.smithi018:> ' 2024-09-19T09:23:32.091 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:23:32.095 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:24:02.171 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:24:02.174 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:24:11.602 INFO:teuthology.orchestra.run.smithi018.stdout:writing some data through which we expect to succeed 2024-09-19T09:24:11.602 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed data successfully, will now attempt to fill fs 2024-09-19T09:24:11.602 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.602 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.602 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 1.00 MB 2024-09-19T09:24:11.602 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.602 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.602 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 2.00 MB 2024-09-19T09:24:11.602 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.603 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.603 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 3.00 MB 2024-09-19T09:24:11.603 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.603 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.603 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 4.00 MB 2024-09-19T09:24:11.603 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.603 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.603 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 5.00 MB 2024-09-19T09:24:11.603 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.603 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.603 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 6.00 MB 2024-09-19T09:24:11.603 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.603 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.603 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 7.00 MB 2024-09-19T09:24:11.604 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.604 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.604 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 8.00 MB 2024-09-19T09:24:11.604 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.604 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.604 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 9.00 MB 2024-09-19T09:24:11.604 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.604 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.604 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 10.00 MB 2024-09-19T09:24:11.604 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.604 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.604 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 11.00 MB 2024-09-19T09:24:11.604 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.604 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.605 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 12.00 MB 2024-09-19T09:24:11.605 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.605 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.605 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 13.00 MB 2024-09-19T09:24:11.605 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.605 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.605 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 14.00 MB 2024-09-19T09:24:11.605 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.605 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.605 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 15.00 MB 2024-09-19T09:24:11.605 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.605 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.605 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 16.00 MB 2024-09-19T09:24:11.605 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.606 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.606 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 17.00 MB 2024-09-19T09:24:11.606 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.606 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.606 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 18.00 MB 2024-09-19T09:24:11.606 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.606 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.606 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 19.00 MB 2024-09-19T09:24:11.606 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.606 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.606 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 20.00 MB 2024-09-19T09:24:11.606 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.606 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.606 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 21.00 MB 2024-09-19T09:24:11.607 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.607 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.607 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 22.00 MB 2024-09-19T09:24:11.607 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.607 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.607 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 23.00 MB 2024-09-19T09:24:11.607 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.607 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.607 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 24.00 MB 2024-09-19T09:24:11.607 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.607 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.607 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 25.00 MB 2024-09-19T09:24:11.607 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.607 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.608 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 26.00 MB 2024-09-19T09:24:11.608 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.608 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.608 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 27.00 MB 2024-09-19T09:24:11.608 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.608 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.608 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 28.00 MB 2024-09-19T09:24:11.608 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.608 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.608 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 29.00 MB 2024-09-19T09:24:11.608 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.608 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.608 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 30.00 MB 2024-09-19T09:24:11.608 INFO:teuthology.orchestra.run.smithi018.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-19T09:24:11.609 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.609 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.609 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 31.00 MB 2024-09-19T09:24:11.609 INFO:teuthology.orchestra.run.smithi018.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-19T09:24:11.609 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.609 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.609 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 32.00 MB 2024-09-19T09:24:11.609 INFO:teuthology.orchestra.run.smithi018.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-19T09:24:11.609 INFO:teuthology.orchestra.run.smithi018.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-19T09:24:11.609 INFO:teuthology.orchestra.run.smithi018.stdout:fsync'ed successfully 2024-09-19T09:24:11.609 INFO:teuthology.orchestra.run.smithi018.stdout:Not full yet after 33.00 MB 2024-09-19T09:24:11.609 INFO:teuthology.orchestra.run.smithi018.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-19T09:24:11.609 INFO:teuthology.orchestra.run.smithi018.stdout:Reached fullness after 33.00 MB 2024-09-19T09:24:11.610 INFO:teuthology.orchestra.run.smithi018.stdout:calling close 2024-09-19T09:24:11.610 INFO:teuthology.orchestra.run.smithi018.stdout:close() did not raise error 2024-09-19T09:24:11.610 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:24:11.615 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T09:24:11.615 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:24:11.667 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:24:11.721 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T09:24:11.722 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:24:11.722 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:24:11.722 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:24:11.740 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:24:11.740 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:24:11.799 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T09:24:11.948 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.946+0000 7fdb83731640 1 Processor -- start 2024-09-19T09:24:11.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.947+0000 7fdb83731640 1 -- start start 2024-09-19T09:24:11.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.947+0000 7fdb83731640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdb7c0d1d40 0x7fdb7c0d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:11.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.947+0000 7fdb83731640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb7c0d3cc0 con 0x7fdb7c0d5790 2024-09-19T09:24:11.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.947+0000 7fdb83731640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb7c0d0bf0 con 0x7fdb7c15eda0 2024-09-19T09:24:11.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.947+0000 7fdb83731640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fdb7c0d5c00 con 0x7fdb7c0d1d40 2024-09-19T09:24:11.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.948+0000 7fdb81cce640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdb7c0d1d40 0x7fdb7c0d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:11.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.948+0000 7fdb80ccc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fdb7c0d5790 0x7fdb7c0d1630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:40524/0 (socket says 172.21.15.18:40524) 2024-09-19T09:24:11.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.948+0000 7fdb80ccc640 1 -- 172.21.15.18:0/2851268339 learned_addr learned my addr 172.21.15.18:0/2851268339 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:24:11.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.948+0000 7fdb81cce640 1 -- 172.21.15.18:0/2851268339 >> v1:172.21.15.162:6789/0 conn(0x7fdb7c15eda0 legacy=0x7fdb7c0d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:11.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.948+0000 7fdb81cce640 1 -- 172.21.15.18:0/2851268339 >> v1:172.21.15.18:6789/0 conn(0x7fdb7c0d5790 legacy=0x7fdb7c0d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:11.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.948+0000 7fdb81cce640 1 -- 172.21.15.18:0/2851268339 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7c0d2ad0 con 0x7fdb7c0d1d40 2024-09-19T09:24:11.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.948+0000 7fdb7bfff640 1 -- 172.21.15.18:0/2851268339 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2685448576 0 0) 0x7fdb7c0d3cc0 con 0x7fdb7c0d5790 2024-09-19T09:24:11.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.949+0000 7fdb81cce640 1 --2- 172.21.15.18:0/2851268339 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb7c0d1d40 0x7fdb7c0d0480 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fdb740097a0 tx=0x7fdb7402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c666436fae37875 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:11.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.949+0000 7fdb7bfff640 1 -- 172.21.15.18:0/2851268339 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb74037070 con 0x7fdb7c0d1d40 2024-09-19T09:24:11.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.949+0000 7fdb7bfff640 1 -- 172.21.15.18:0/2851268339 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb74032440 con 0x7fdb7c0d1d40 2024-09-19T09:24:11.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.949+0000 7fdb7bfff640 1 -- 172.21.15.18:0/2851268339 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb74032810 con 0x7fdb7c0d1d40 2024-09-19T09:24:11.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.949+0000 7fdb83731640 1 -- 172.21.15.18:0/2851268339 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb7c0d1d40 msgr2=0x7fdb7c0d0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:11.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.949+0000 7fdb83731640 1 --2- 172.21.15.18:0/2851268339 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb7c0d1d40 0x7fdb7c0d0480 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fdb740097a0 tx=0x7fdb7402a230 comp rx=0 tx=0).stop 2024-09-19T09:24:11.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.949+0000 7fdb83731640 1 -- 172.21.15.18:0/2851268339 shutdown_connections 2024-09-19T09:24:11.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.949+0000 7fdb83731640 1 --2- 172.21.15.18:0/2851268339 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb7c0d1d40 0x7fdb7c0d0480 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.949+0000 7fdb83731640 1 -- 172.21.15.18:0/2851268339 >> 172.21.15.18:0/2851268339 conn(0x7fdb7c09df40 msgr2=0x7fdb7c0d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:11.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.950+0000 7fdb83731640 1 -- 172.21.15.18:0/2851268339 shutdown_connections 2024-09-19T09:24:11.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.950+0000 7fdb83731640 1 -- 172.21.15.18:0/2851268339 wait complete. 2024-09-19T09:24:11.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.951+0000 7fdb83731640 1 Processor -- start 2024-09-19T09:24:11.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.951+0000 7fdb83731640 1 -- start start 2024-09-19T09:24:11.954 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.951+0000 7fdb83731640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb7c0d1d40 0x7fdb7c0ca770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:11.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.952+0000 7fdb83731640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb7c0d5790 0x7fdb7c0cd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:11.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.952+0000 7fdb83731640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb7c15eda0 0x7fdb7c1f4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:11.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.952+0000 7fdb83731640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7c0d2880 con 0x7fdb7c15eda0 2024-09-19T09:24:11.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.952+0000 7fdb83731640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7c0d3120 con 0x7fdb7c0d5790 2024-09-19T09:24:11.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.952+0000 7fdb83731640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdb7c15f180 con 0x7fdb7c0d1d40 2024-09-19T09:24:11.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.952+0000 7fdb81cce640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb7c15eda0 0x7fdb7c1f4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:11.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.952+0000 7fdb81cce640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb7c15eda0 0x7fdb7c1f4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47448/0 (socket says 172.21.15.18:47448) 2024-09-19T09:24:11.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.952+0000 7fdb81cce640 1 -- 172.21.15.18:0/3624471923 learned_addr learned my addr 172.21.15.18:0/3624471923 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:11.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.952+0000 7fdb80ccc640 1 --2- 172.21.15.18:0/3624471923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb7c0d5790 0x7fdb7c0cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:11.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.952+0000 7fdb814cd640 1 --2- 172.21.15.18:0/3624471923 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb7c0d1d40 0x7fdb7c0ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:11.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.952+0000 7fdb81cce640 1 -- 172.21.15.18:0/3624471923 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb7c0d1d40 msgr2=0x7fdb7c0ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:11.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.952+0000 7fdb81cce640 1 --2- 172.21.15.18:0/3624471923 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb7c0d1d40 0x7fdb7c0ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.952+0000 7fdb81cce640 1 -- 172.21.15.18:0/3624471923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb7c0d5790 msgr2=0x7fdb7c0cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:11.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.952+0000 7fdb81cce640 1 --2- 172.21.15.18:0/3624471923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb7c0d5790 0x7fdb7c0cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:11.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.952+0000 7fdb81cce640 1 -- 172.21.15.18:0/3624471923 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7c0cda30 con 0x7fdb7c15eda0 2024-09-19T09:24:11.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.952+0000 7fdb814cd640 1 --2- 172.21.15.18:0/3624471923 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb7c0d1d40 0x7fdb7c0ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:11.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.952+0000 7fdb80ccc640 1 --2- 172.21.15.18:0/3624471923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb7c0d5790 0x7fdb7c0cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:11.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.952+0000 7fdb81cce640 1 --2- 172.21.15.18:0/3624471923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb7c15eda0 0x7fdb7c1f4000 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fdb74035040 tx=0x7fdb740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:11.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.952+0000 7fdb79ffb640 1 -- 172.21.15.18:0/3624471923 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb74037040 con 0x7fdb7c15eda0 2024-09-19T09:24:11.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.952+0000 7fdb79ffb640 1 -- 172.21.15.18:0/3624471923 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb74042070 con 0x7fdb7c15eda0 2024-09-19T09:24:11.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.952+0000 7fdb79ffb640 1 -- 172.21.15.18:0/3624471923 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb74030b50 con 0x7fdb7c15eda0 2024-09-19T09:24:11.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.952+0000 7fdb83731640 1 -- 172.21.15.18:0/3624471923 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb7c0cdd10 con 0x7fdb7c15eda0 2024-09-19T09:24:11.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.953+0000 7fdb83731640 1 -- 172.21.15.18:0/3624471923 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb7c0ce2d0 con 0x7fdb7c15eda0 2024-09-19T09:24:11.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.954+0000 7fdb83731640 1 -- 172.21.15.18:0/3624471923 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb7c0d0480 con 0x7fdb7c15eda0 2024-09-19T09:24:11.957 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.954+0000 7fdb79ffb640 1 -- 172.21.15.18:0/3624471923 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdb74030cf0 con 0x7fdb7c15eda0 2024-09-19T09:24:11.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.955+0000 7fdb79ffb640 1 --2- 172.21.15.18:0/3624471923 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdb6806c2b0 0x7fdb6806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:11.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.955+0000 7fdb79ffb640 1 -- 172.21.15.18:0/3624471923 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5767+0+0 (secure 0 0 0) 0x7fdb740ac100 con 0x7fdb7c15eda0 2024-09-19T09:24:11.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.955+0000 7fdb79ffb640 1 -- 172.21.15.18:0/3624471923 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=172}) -- 0x7fdb68073ea0 con 0x7fdb7c15eda0 2024-09-19T09:24:11.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.955+0000 7fdb814cd640 1 --2- 172.21.15.18:0/3624471923 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdb6806c2b0 0x7fdb6806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:11.958 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.956+0000 7fdb814cd640 1 --2- 172.21.15.18:0/3624471923 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdb6806c2b0 0x7fdb6806e770 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c0012e0 tx=0x7fdb6c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:11.961 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:11.959+0000 7fdb79ffb640 1 -- 172.21.15.18:0/3624471923 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fdb74032e20 con 0x7fdb7c15eda0 2024-09-19T09:24:12.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.148+0000 7fdb83731640 1 -- 172.21.15.18:0/3624471923 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdb7c0d2330 con 0x7fdb7c15eda0 2024-09-19T09:24:12.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.149+0000 7fdb79ffb640 1 -- 172.21.15.18:0/3624471923 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v171) ==== 80+0+0 (secure 0 0 0) 0x7fdb74045360 con 0x7fdb7c15eda0 2024-09-19T09:24:12.151 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-09-19T09:24:12.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.151+0000 7fdb83731640 1 -- 172.21.15.18:0/3624471923 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdb6806c2b0 msgr2=0x7fdb6806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:12.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.151+0000 7fdb83731640 1 --2- 172.21.15.18:0/3624471923 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdb6806c2b0 0x7fdb6806e770 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c0012e0 tx=0x7fdb6c009040 comp rx=0 tx=0).stop 2024-09-19T09:24:12.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.151+0000 7fdb83731640 1 -- 172.21.15.18:0/3624471923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb7c15eda0 msgr2=0x7fdb7c1f4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:12.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.151+0000 7fdb83731640 1 --2- 172.21.15.18:0/3624471923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb7c15eda0 0x7fdb7c1f4000 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fdb74035040 tx=0x7fdb740046c0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.151+0000 7fdb83731640 1 -- 172.21.15.18:0/3624471923 shutdown_connections 2024-09-19T09:24:12.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.151+0000 7fdb83731640 1 --2- 172.21.15.18:0/3624471923 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdb6806c2b0 0x7fdb6806e770 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.151+0000 7fdb83731640 1 --2- 172.21.15.18:0/3624471923 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb7c15eda0 0x7fdb7c1f4000 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.151+0000 7fdb83731640 1 --2- 172.21.15.18:0/3624471923 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb7c0d5790 0x7fdb7c0cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.151+0000 7fdb83731640 1 --2- 172.21.15.18:0/3624471923 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb7c0d1d40 0x7fdb7c0ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.151+0000 7fdb83731640 1 -- 172.21.15.18:0/3624471923 >> 172.21.15.18:0/3624471923 conn(0x7fdb7c09df40 msgr2=0x7fdb7c0b8860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:12.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.151+0000 7fdb83731640 1 -- 172.21.15.18:0/3624471923 shutdown_connections 2024-09-19T09:24:12.154 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.151+0000 7fdb83731640 1 -- 172.21.15.18:0/3624471923 wait complete. 2024-09-19T09:24:12.165 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T09:24:12.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:24:12.165 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-19T09:24:12.195 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T09:24:12.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:24:12.196 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T09:24:12.252 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:24:12.252 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:24:12.252 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:24:12.271 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:24:12.271 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:24:12.331 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T09:24:12.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.433+0000 7f308d823640 1 Processor -- start 2024-09-19T09:24:12.435 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.433+0000 7f308d823640 1 -- start start 2024-09-19T09:24:12.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.434+0000 7f308d823640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f308806d730 0x7f30880b7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.434+0000 7f308d823640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f30880b6290 0x7f308806db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.434+0000 7f308d823640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f30881627a0 0x7f3088162c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.434+0000 7f308d823640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f30880b66d0 con 0x7f30880b6290 2024-09-19T09:24:12.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.434+0000 7f308d823640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f308806e050 con 0x7f30881627a0 2024-09-19T09:24:12.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.434+0000 7f308d823640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f30880b7890 con 0x7f308806d730 2024-09-19T09:24:12.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.434+0000 7f30867fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f30880b6290 0x7f308806db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.434+0000 7f30867fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f30880b6290 0x7f308806db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47452/0 (socket says 172.21.15.18:47452) 2024-09-19T09:24:12.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.434+0000 7f30867fc640 1 -- 172.21.15.18:0/1608574867 learned_addr learned my addr 172.21.15.18:0/1608574867 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:12.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.434+0000 7f3086ffd640 1 --2- 172.21.15.18:0/1608574867 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f308806d730 0x7f30880b7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.434+0000 7f30877fe640 1 --2- 172.21.15.18:0/1608574867 >> v2:172.21.15.162:3300/0 conn(0x7f30881627a0 0x7f3088162c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.434+0000 7f30867fc640 1 -- 172.21.15.18:0/1608574867 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f308806d730 msgr2=0x7f30880b7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:12.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.434+0000 7f30867fc640 1 --2- 172.21.15.18:0/1608574867 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f308806d730 0x7f30880b7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.434+0000 7f30867fc640 1 -- 172.21.15.18:0/1608574867 >> v2:172.21.15.162:3300/0 conn(0x7f30881627a0 msgr2=0x7f3088162c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:12.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.434+0000 7f30867fc640 1 --2- 172.21.15.18:0/1608574867 >> v2:172.21.15.162:3300/0 conn(0x7f30881627a0 0x7f3088162c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.434+0000 7f30867fc640 1 -- 172.21.15.18:0/1608574867 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30880b7b70 con 0x7f30880b6290 2024-09-19T09:24:12.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.434+0000 7f3086ffd640 1 --2- 172.21.15.18:0/1608574867 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f308806d730 0x7f30880b7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.435+0000 7f30867fc640 1 --2- 172.21.15.18:0/1608574867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30880b6290 0x7f308806db10 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f30880b5690 tx=0x7f307c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d621b901276e696c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.435+0000 7f3085ffb640 1 -- 172.21.15.18:0/1608574867 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307c037070 con 0x7f30880b6290 2024-09-19T09:24:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.435+0000 7f3085ffb640 1 -- 172.21.15.18:0/1608574867 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f307c032440 con 0x7f30880b6290 2024-09-19T09:24:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.435+0000 7f3085ffb640 1 -- 172.21.15.18:0/1608574867 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307c032810 con 0x7f30880b6290 2024-09-19T09:24:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.436+0000 7f308d823640 1 -- 172.21.15.18:0/1608574867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30880b6290 msgr2=0x7f308806db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.436+0000 7f308d823640 1 --2- 172.21.15.18:0/1608574867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30880b6290 0x7f308806db10 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f30880b5690 tx=0x7f307c02a1e0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.436+0000 7f308d823640 1 -- 172.21.15.18:0/1608574867 shutdown_connections 2024-09-19T09:24:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.436+0000 7f308d823640 1 --2- 172.21.15.18:0/1608574867 >> v2:172.21.15.162:3300/0 conn(0x7f30881627a0 0x7f3088162c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.436+0000 7f308d823640 1 --2- 172.21.15.18:0/1608574867 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f30880b6290 0x7f308806db10 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.436+0000 7f308d823640 1 --2- 172.21.15.18:0/1608574867 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f308806d730 0x7f30880b7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.436+0000 7f308d823640 1 -- 172.21.15.18:0/1608574867 >> 172.21.15.18:0/1608574867 conn(0x7f30880b7e10 msgr2=0x7f30880b8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:12.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.436+0000 7f308d823640 1 -- 172.21.15.18:0/1608574867 shutdown_connections 2024-09-19T09:24:12.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.436+0000 7f308d823640 1 -- 172.21.15.18:0/1608574867 wait complete. 2024-09-19T09:24:12.440 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.437+0000 7f308d823640 1 Processor -- start 2024-09-19T09:24:12.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.437+0000 7f308d823640 1 -- start start 2024-09-19T09:24:12.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.438+0000 7f308d823640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f308806d730 0x7f30881f4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.438+0000 7f308d823640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30880b6290 0x7f30880cd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.438+0000 7f308d823640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30881627a0 0x7f30880cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.438+0000 7f308d823640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f30880cc2d0 con 0x7f308806d730 2024-09-19T09:24:12.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.438+0000 7f308d823640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f30880cbff0 con 0x7f30881627a0 2024-09-19T09:24:12.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.438+0000 7f308d823640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f30880b4310 con 0x7f30880b6290 2024-09-19T09:24:12.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.438+0000 7f3086ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f308806d730 0x7f30881f4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.438+0000 7f3086ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f308806d730 0x7f30881f4d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47458/0 (socket says 172.21.15.18:47458) 2024-09-19T09:24:12.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.438+0000 7f3086ffd640 1 -- 172.21.15.18:0/2931595359 learned_addr learned my addr 172.21.15.18:0/2931595359 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:12.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.438+0000 7f30867fc640 1 --2- 172.21.15.18:0/2931595359 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30880b6290 0x7f30880cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.438+0000 7f30877fe640 1 --2- 172.21.15.18:0/2931595359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30881627a0 0x7f30880cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.438+0000 7f3086ffd640 1 -- 172.21.15.18:0/2931595359 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30880b6290 msgr2=0x7f30880cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:12.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.438+0000 7f3086ffd640 1 --2- 172.21.15.18:0/2931595359 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30880b6290 0x7f30880cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.438+0000 7f3086ffd640 1 -- 172.21.15.18:0/2931595359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30881627a0 msgr2=0x7f30880cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:12.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.438+0000 7f3086ffd640 1 --2- 172.21.15.18:0/2931595359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30881627a0 0x7f30880cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.438+0000 7f3086ffd640 1 -- 172.21.15.18:0/2931595359 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30881f52b0 con 0x7f308806d730 2024-09-19T09:24:12.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.439+0000 7f3086ffd640 1 --2- 172.21.15.18:0/2931595359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f308806d730 0x7f30881f4d70 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f307800d830 tx=0x7f307800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:12.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.439+0000 7f306ffff640 1 -- 172.21.15.18:0/2931595359 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3078018070 con 0x7f308806d730 2024-09-19T09:24:12.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.439+0000 7f306ffff640 1 -- 172.21.15.18:0/2931595359 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f307800be10 con 0x7f308806d730 2024-09-19T09:24:12.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.439+0000 7f308d823640 1 -- 172.21.15.18:0/2931595359 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30881f5520 con 0x7f308806d730 2024-09-19T09:24:12.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.439+0000 7f306ffff640 1 -- 172.21.15.18:0/2931595359 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3078004250 con 0x7f308806d730 2024-09-19T09:24:12.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.439+0000 7f308d823640 1 -- 172.21.15.18:0/2931595359 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30881f5ae0 con 0x7f308806d730 2024-09-19T09:24:12.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.440+0000 7f308d823640 1 -- 172.21.15.18:0/2931595359 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3088073970 con 0x7f308806d730 2024-09-19T09:24:12.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.440+0000 7f306ffff640 1 -- 172.21.15.18:0/2931595359 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f30780098b0 con 0x7f308806d730 2024-09-19T09:24:12.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.441+0000 7f306ffff640 1 --2- 172.21.15.18:0/2931595359 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f307406c2b0 0x7f307406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.441+0000 7f306ffff640 1 -- 172.21.15.18:0/2931595359 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5767+0+0 (secure 0 0 0) 0x7f307808b5d0 con 0x7f308806d730 2024-09-19T09:24:12.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.441+0000 7f306ffff640 1 -- 172.21.15.18:0/2931595359 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=172}) -- 0x7f3074073ea0 con 0x7f308806d730 2024-09-19T09:24:12.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.441+0000 7f30867fc640 1 --2- 172.21.15.18:0/2931595359 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f307406c2b0 0x7f307406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.442+0000 7f30867fc640 1 --2- 172.21.15.18:0/2931595359 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f307406c2b0 0x7f307406e770 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f307c034000 tx=0x7f307c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:12.449 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.445+0000 7f306ffff640 1 -- 172.21.15.18:0/2931595359 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f30780596b0 con 0x7f308806d730 2024-09-19T09:24:12.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.644+0000 7f308d823640 1 -- 172.21.15.18:0/2931595359 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f30880b5300 con 0x7f308806d730 2024-09-19T09:24:12.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.645+0000 7f306ffff640 1 -- 172.21.15.18:0/2931595359 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v171) ==== 80+0+0 (secure 0 0 0) 0x7f307805d9b0 con 0x7f308806d730 2024-09-19T09:24:12.647 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-09-19T09:24:12.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.647+0000 7f308d823640 1 -- 172.21.15.18:0/2931595359 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f307406c2b0 msgr2=0x7f307406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:12.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.647+0000 7f308d823640 1 --2- 172.21.15.18:0/2931595359 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f307406c2b0 0x7f307406e770 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f307c034000 tx=0x7f307c02e000 comp rx=0 tx=0).stop 2024-09-19T09:24:12.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.647+0000 7f308d823640 1 -- 172.21.15.18:0/2931595359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f308806d730 msgr2=0x7f30881f4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:12.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.647+0000 7f308d823640 1 --2- 172.21.15.18:0/2931595359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f308806d730 0x7f30881f4d70 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f307800d830 tx=0x7f307800dcf0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.647+0000 7f308d823640 1 -- 172.21.15.18:0/2931595359 shutdown_connections 2024-09-19T09:24:12.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.647+0000 7f308d823640 1 --2- 172.21.15.18:0/2931595359 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f307406c2b0 0x7f307406e770 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.647+0000 7f308d823640 1 --2- 172.21.15.18:0/2931595359 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30881627a0 0x7f30880cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.647+0000 7f308d823640 1 --2- 172.21.15.18:0/2931595359 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30880b6290 0x7f30880cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.647+0000 7f308d823640 1 --2- 172.21.15.18:0/2931595359 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f308806d730 0x7f30881f4d70 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.647+0000 7f308d823640 1 -- 172.21.15.18:0/2931595359 >> 172.21.15.18:0/2931595359 conn(0x7f30880b7e10 msgr2=0x7f308815e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:12.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.647+0000 7f308d823640 1 -- 172.21.15.18:0/2931595359 shutdown_connections 2024-09-19T09:24:12.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.647+0000 7f308d823640 1 -- 172.21.15.18:0/2931595359 wait complete. 2024-09-19T09:24:12.660 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-19T09:24:12.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:24:12.660 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-19T09:24:12.694 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-09-19T09:24:12.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:24:12.695 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-19T09:24:12.752 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:24:12.753 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:24:12.753 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:24:12.769 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17075 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T09:24:12.769 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:24:12.769 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:24:12.769 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:24:12.810 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3252 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T09:24:12.810 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:24:12.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.911+0000 7f0843111640 1 Processor -- start 2024-09-19T09:24:12.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.911+0000 7f0843111640 1 -- start start 2024-09-19T09:24:12.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.912+0000 7f0843111640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f083c0ce780 0x7f083c06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.912+0000 7f0843111640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f083c06e3d0 con 0x7f083c072f40 2024-09-19T09:24:12.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.912+0000 7f0843111640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f083c06e6b0 con 0x7f083c145290 2024-09-19T09:24:12.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.912+0000 7f0843111640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f083c06efe0 con 0x7f083c0ce780 2024-09-19T09:24:12.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.912+0000 7f083bfff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f083c072f40 0x7f083c0b3930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:40532/0 (socket says 172.21.15.18:40532) 2024-09-19T09:24:12.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.912+0000 7f083bfff640 1 -- 172.21.15.18:0/462929051 learned_addr learned my addr 172.21.15.18:0/462929051 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:24:12.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.912+0000 7f08416ae640 1 --2- 172.21.15.18:0/462929051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f083c0ce780 0x7f083c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.912+0000 7f083b7fe640 1 -- 172.21.15.18:0/462929051 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3281763579 0 0) 0x7f083c06e3d0 con 0x7f083c072f40 2024-09-19T09:24:12.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.913+0000 7f083b7fe640 1 -- 172.21.15.18:0/462929051 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0828005730 con 0x7f083c072f40 2024-09-19T09:24:12.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.913+0000 7f083b7fe640 1 -- 172.21.15.18:0/462929051 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 670205431 0 0) 0x7f083c06e6b0 con 0x7f083c145290 2024-09-19T09:24:12.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.913+0000 7f083b7fe640 1 -- 172.21.15.18:0/462929051 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f083c06e3d0 con 0x7f083c145290 2024-09-19T09:24:12.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.913+0000 7f083b7fe640 1 -- 172.21.15.18:0/462929051 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 652540520 0 0) 0x7f0828005730 con 0x7f083c072f40 2024-09-19T09:24:12.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.913+0000 7f083b7fe640 1 -- 172.21.15.18:0/462929051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f083c0ce780 msgr2=0x7f083c06f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:12.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.913+0000 7f083b7fe640 1 --2- 172.21.15.18:0/462929051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f083c0ce780 0x7f083c06f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.913+0000 7f083b7fe640 1 -- 172.21.15.18:0/462929051 >> v1:172.21.15.162:6789/0 conn(0x7f083c145290 legacy=0x7f083c072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:12.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.913+0000 7f083b7fe640 1 -- 172.21.15.18:0/462929051 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f083c06e990 con 0x7f083c072f40 2024-09-19T09:24:12.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.913+0000 7f083b7fe640 1 -- 172.21.15.18:0/462929051 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f08240019f0 con 0x7f083c072f40 2024-09-19T09:24:12.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.913+0000 7f083b7fe640 1 -- 172.21.15.18:0/462929051 >> v1:172.21.15.18:6789/0 conn(0x7f083c072f40 legacy=0x7f083c0b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:12.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.913+0000 7f083b7fe640 1 --2- 172.21.15.18:0/462929051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0828005d80 0x7f0828006180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.913+0000 7f083b7fe640 1 --2- 172.21.15.18:0/462929051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f083c0ce780 0x7f0828006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.913+0000 7f083b7fe640 1 --2- 172.21.15.18:0/462929051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0828006f50 0x7f08280073d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.913+0000 7f083b7fe640 1 -- 172.21.15.18:0/462929051 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f083c06efe0 con 0x7f0828005d80 2024-09-19T09:24:12.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.913+0000 7f083b7fe640 1 -- 172.21.15.18:0/462929051 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f082800dc80 con 0x7f0828006f50 2024-09-19T09:24:12.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.913+0000 7f083b7fe640 1 -- 172.21.15.18:0/462929051 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f082800de80 con 0x7f083c0ce780 2024-09-19T09:24:12.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.913+0000 7f0840ead640 1 --2- 172.21.15.18:0/462929051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0828005d80 0x7f0828006180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.913+0000 7f083bfff640 1 --2- 172.21.15.18:0/462929051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f083c0ce780 0x7f0828006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.913+0000 7f08416ae640 1 --2- 172.21.15.18:0/462929051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0828006f50 0x7f08280073d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.913+0000 7f0840ead640 1 -- 172.21.15.18:0/462929051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f083c0ce780 msgr2=0x7f0828006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:12.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.913+0000 7f0840ead640 1 --2- 172.21.15.18:0/462929051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f083c0ce780 0x7f0828006a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.913+0000 7f0840ead640 1 -- 172.21.15.18:0/462929051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0828006f50 msgr2=0x7f08280073d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:12.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.913+0000 7f0840ead640 1 --2- 172.21.15.18:0/462929051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0828006f50 0x7f08280073d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.913+0000 7f0840ead640 1 -- 172.21.15.18:0/462929051 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0828005730 con 0x7f0828005d80 2024-09-19T09:24:12.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.913+0000 7f08416ae640 1 --2- 172.21.15.18:0/462929051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0828006f50 0x7f08280073d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:12.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.914+0000 7f0840ead640 1 --2- 172.21.15.18:0/462929051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0828005d80 0x7f0828006180 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f082c0018d0 tx=0x7f0828007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e6fee58138d8b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:12.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.914+0000 7f083b7fe640 1 -- 172.21.15.18:0/462929051 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082c0014f0 con 0x7f0828005d80 2024-09-19T09:24:12.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.914+0000 7f083b7fe640 1 -- 172.21.15.18:0/462929051 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f082c0052d0 con 0x7f0828005d80 2024-09-19T09:24:12.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.914+0000 7f083b7fe640 1 -- 172.21.15.18:0/462929051 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082c02aca0 con 0x7f0828005d80 2024-09-19T09:24:12.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.915+0000 7f0843111640 1 -- 172.21.15.18:0/462929051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0828005d80 msgr2=0x7f0828006180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:12.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.915+0000 7f0843111640 1 --2- 172.21.15.18:0/462929051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f0828005d80 0x7f0828006180 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f082c0018d0 tx=0x7f0828007a40 comp rx=0 tx=0).stop 2024-09-19T09:24:12.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.915+0000 7f08416ae640 1 -- 172.21.15.18:0/462929051 reap_dead start 2024-09-19T09:24:12.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.915+0000 7f0843111640 1 -- 172.21.15.18:0/462929051 shutdown_connections 2024-09-19T09:24:12.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.915+0000 7f0843111640 1 -- 172.21.15.18:0/462929051 >> 172.21.15.18:0/462929051 conn(0x7f083c06bc10 msgr2=0x7f083c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:12.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.915+0000 7f0843111640 1 -- 172.21.15.18:0/462929051 shutdown_connections 2024-09-19T09:24:12.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.915+0000 7f0843111640 1 -- 172.21.15.18:0/462929051 wait complete. 2024-09-19T09:24:12.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.916+0000 7f0843111640 1 Processor -- start 2024-09-19T09:24:12.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.916+0000 7f0843111640 1 -- start start 2024-09-19T09:24:12.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.917+0000 7f0843111640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0828005d80 0x7f083c15b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.917+0000 7f0843111640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f083c15e080 0x7f083c15a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.917+0000 7f0843111640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f083c0b4f00 0x7f083c0b5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.917+0000 7f0843111640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f083c06df80 con 0x7f083c15e080 2024-09-19T09:24:12.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.917+0000 7f0843111640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f083c145670 con 0x7f0828005d80 2024-09-19T09:24:12.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.917+0000 7f0843111640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f083c06e100 con 0x7f083c0b4f00 2024-09-19T09:24:12.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.917+0000 7f083bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f083c15e080 0x7f083c15a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.917+0000 7f083bfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f083c15e080 0x7f083c15a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47480/0 (socket says 172.21.15.18:47480) 2024-09-19T09:24:12.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.917+0000 7f083bfff640 1 -- 172.21.15.18:0/3151389314 learned_addr learned my addr 172.21.15.18:0/3151389314 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:12.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.917+0000 7f0840ead640 1 --2- 172.21.15.18:0/3151389314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0828005d80 0x7f083c15b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.917+0000 7f08416ae640 1 --2- 172.21.15.18:0/3151389314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f083c0b4f00 0x7f083c0b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.917+0000 7f083bfff640 1 -- 172.21.15.18:0/3151389314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f083c0b4f00 msgr2=0x7f083c0b5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:12.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.917+0000 7f083bfff640 1 --2- 172.21.15.18:0/3151389314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f083c0b4f00 0x7f083c0b5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.917+0000 7f083bfff640 1 -- 172.21.15.18:0/3151389314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0828005d80 msgr2=0x7f083c15b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:12.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.917+0000 7f083bfff640 1 --2- 172.21.15.18:0/3151389314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0828005d80 0x7f083c15b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:12.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.917+0000 7f083bfff640 1 -- 172.21.15.18:0/3151389314 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f083c15b250 con 0x7f083c15e080 2024-09-19T09:24:12.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.917+0000 7f0840ead640 1 --2- 172.21.15.18:0/3151389314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0828005d80 0x7f083c15b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:12.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.917+0000 7f083bfff640 1 --2- 172.21.15.18:0/3151389314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f083c15e080 0x7f083c15a660 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f0824007970 tx=0x7f082400a600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:12.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.917+0000 7f08397fa640 1 -- 172.21.15.18:0/3151389314 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0824017020 con 0x7f083c15e080 2024-09-19T09:24:12.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.918+0000 7f08397fa640 1 -- 172.21.15.18:0/3151389314 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08240133f0 con 0x7f083c15e080 2024-09-19T09:24:12.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.918+0000 7f08397fa640 1 -- 172.21.15.18:0/3151389314 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08240137e0 con 0x7f083c15e080 2024-09-19T09:24:12.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.918+0000 7f0843111640 1 -- 172.21.15.18:0/3151389314 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f083c15ecd0 con 0x7f083c15e080 2024-09-19T09:24:12.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.918+0000 7f0843111640 1 -- 172.21.15.18:0/3151389314 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f083c15e9f0 con 0x7f083c15e080 2024-09-19T09:24:12.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.919+0000 7f0843111640 1 -- 172.21.15.18:0/3151389314 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f083c071510 con 0x7f083c15e080 2024-09-19T09:24:12.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.919+0000 7f08397fa640 1 -- 172.21.15.18:0/3151389314 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f082401a020 con 0x7f083c15e080 2024-09-19T09:24:12.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.919+0000 7f08397fa640 1 --2- 172.21.15.18:0/3151389314 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f081c06c2e0 0x7f081c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:12.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.920+0000 7f08397fa640 1 -- 172.21.15.18:0/3151389314 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5767+0+0 (secure 0 0 0) 0x7f082408be70 con 0x7f083c15e080 2024-09-19T09:24:12.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.920+0000 7f0840ead640 1 --2- 172.21.15.18:0/3151389314 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f081c06c2e0 0x7f081c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:12.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.920+0000 7f08397fa640 1 -- 172.21.15.18:0/3151389314 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=172}) -- 0x7f081c073ed0 con 0x7f083c15e080 2024-09-19T09:24:12.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.920+0000 7f0840ead640 1 --2- 172.21.15.18:0/3151389314 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f081c06c2e0 0x7f081c06e7a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f082c032000 tx=0x7f082c009030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:12.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:12.924+0000 7f08397fa640 1 -- 172.21.15.18:0/3151389314 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0824021020 con 0x7f083c15e080 2024-09-19T09:24:13.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.133+0000 7f0843111640 1 -- 172.21.15.18:0/3151389314 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f083c140f70 con 0x7f083c15e080 2024-09-19T09:24:13.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.134+0000 7f08397fa640 1 -- 172.21.15.18:0/3151389314 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5230 (secure 0 0 0) 0x7f083c15b250 con 0x7f083c15e080 2024-09-19T09:24:13.136 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:24:13.136 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":74,"btime":"2024-09-19T09:23:04:468698+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1145590197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1145590197},{"type":"v1","addr":"172.21.15.162:6837","nonce":1145590197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/200393908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":200393908},{"type":"v1","addr":"172.21.15.162:6836","nonce":200393908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7542,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1236184741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1236184741},{"type":"v1","addr":"172.21.15.18:6834","nonce":1236184741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:23:00.797014+0000","modified":"2024-09-19T09:23:03.823915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7545":{"gid":7545,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2876222862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2876222862},{"type":"v1","addr":"172.21.15.18:6835","nonce":2876222862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7545,"qdb_cluster":[7545]},"id":10}]} 2024-09-19T09:24:13.136 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 74 2024-09-19T09:24:13.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.136+0000 7f0843111640 1 -- 172.21.15.18:0/3151389314 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f081c06c2e0 msgr2=0x7f081c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:13.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.136+0000 7f0843111640 1 --2- 172.21.15.18:0/3151389314 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f081c06c2e0 0x7f081c06e7a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f082c032000 tx=0x7f082c009030 comp rx=0 tx=0).stop 2024-09-19T09:24:13.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.136+0000 7f0843111640 1 -- 172.21.15.18:0/3151389314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f083c15e080 msgr2=0x7f083c15a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:13.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.136+0000 7f0843111640 1 --2- 172.21.15.18:0/3151389314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f083c15e080 0x7f083c15a660 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f0824007970 tx=0x7f082400a600 comp rx=0 tx=0).stop 2024-09-19T09:24:13.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.136+0000 7f0843111640 1 -- 172.21.15.18:0/3151389314 shutdown_connections 2024-09-19T09:24:13.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.136+0000 7f0843111640 1 --2- 172.21.15.18:0/3151389314 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f081c06c2e0 0x7f081c06e7a0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:13.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.136+0000 7f0843111640 1 --2- 172.21.15.18:0/3151389314 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f083c0b4f00 0x7f083c0b5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:13.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.136+0000 7f0843111640 1 --2- 172.21.15.18:0/3151389314 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f083c15e080 0x7f083c15a660 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:13.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.136+0000 7f0843111640 1 --2- 172.21.15.18:0/3151389314 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0828005d80 0x7f083c15b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:13.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.136+0000 7f0843111640 1 -- 172.21.15.18:0/3151389314 >> 172.21.15.18:0/3151389314 conn(0x7f083c06bc10 msgr2=0x7f083c0cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:13.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.136+0000 7f0843111640 1 -- 172.21.15.18:0/3151389314 shutdown_connections 2024-09-19T09:24:13.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.136+0000 7f0843111640 1 -- 172.21.15.18:0/3151389314 wait complete. 2024-09-19T09:24:13.149 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:24:13.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.250+0000 7f3b2462e640 1 Processor -- start 2024-09-19T09:24:13.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.250+0000 7f3b2462e640 1 -- start start 2024-09-19T09:24:13.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.251+0000 7f3b2462e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3b1c15ed30 0x7f3b1c070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:13.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.251+0000 7f3b2462e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b1c0b5200 0x7f3b1c1629e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:13.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.251+0000 7f3b2462e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3b1c162f20 0x7f3b1c0cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:13.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.251+0000 7f3b2462e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f3b1c0d0a10 con 0x7f3b1c15ed30 2024-09-19T09:24:13.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.251+0000 7f3b2462e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f3b1c070ab0 con 0x7f3b1c162f20 2024-09-19T09:24:13.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.251+0000 7f3b2462e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3b1c0d0cb0 con 0x7f3b1c0b5200 2024-09-19T09:24:13.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.251+0000 7f3b223ca640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3b1c15ed30 0x7f3b1c070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:13.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.251+0000 7f3b223ca640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3b1c15ed30 0x7f3b1c070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47490/0 (socket says 172.21.15.18:47490) 2024-09-19T09:24:13.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.251+0000 7f3b223ca640 1 -- 172.21.15.18:0/3958501933 learned_addr learned my addr 172.21.15.18:0/3958501933 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:13.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.251+0000 7f3b21bc9640 1 --2- 172.21.15.18:0/3958501933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b1c0b5200 0x7f3b1c1629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:13.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.251+0000 7f3b22bcb640 1 --2- 172.21.15.18:0/3958501933 >> v2:172.21.15.162:3300/0 conn(0x7f3b1c162f20 0x7f3b1c0cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:13.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.251+0000 7f3b223ca640 1 -- 172.21.15.18:0/3958501933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b1c0b5200 msgr2=0x7f3b1c1629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:13.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.251+0000 7f3b223ca640 1 --2- 172.21.15.18:0/3958501933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b1c0b5200 0x7f3b1c1629e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:13.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.251+0000 7f3b223ca640 1 -- 172.21.15.18:0/3958501933 >> v2:172.21.15.162:3300/0 conn(0x7f3b1c162f20 msgr2=0x7f3b1c0cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:13.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.251+0000 7f3b223ca640 1 --2- 172.21.15.18:0/3958501933 >> v2:172.21.15.162:3300/0 conn(0x7f3b1c162f20 0x7f3b1c0cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:13.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.251+0000 7f3b223ca640 1 -- 172.21.15.18:0/3958501933 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b1c0d0f90 con 0x7f3b1c15ed30 2024-09-19T09:24:13.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.251+0000 7f3b21bc9640 1 --2- 172.21.15.18:0/3958501933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b1c0b5200 0x7f3b1c1629e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:13.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.251+0000 7f3b22bcb640 1 --2- 172.21.15.18:0/3958501933 >> v2:172.21.15.162:3300/0 conn(0x7f3b1c162f20 0x7f3b1c0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:13.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.252+0000 7f3b223ca640 1 --2- 172.21.15.18:0/3958501933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b1c15ed30 0x7f3b1c070260 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c073060 tx=0x7f3b1802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e53d3838979cc0c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:13.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.252+0000 7f3b213c8640 1 -- 172.21.15.18:0/3958501933 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b18037070 con 0x7f3b1c15ed30 2024-09-19T09:24:13.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.252+0000 7f3b213c8640 1 -- 172.21.15.18:0/3958501933 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b18032440 con 0x7f3b1c15ed30 2024-09-19T09:24:13.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.252+0000 7f3b213c8640 1 -- 172.21.15.18:0/3958501933 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b18032810 con 0x7f3b1c15ed30 2024-09-19T09:24:13.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.253+0000 7f3b2462e640 1 -- 172.21.15.18:0/3958501933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b1c15ed30 msgr2=0x7f3b1c070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:13.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.253+0000 7f3b2462e640 1 --2- 172.21.15.18:0/3958501933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b1c15ed30 0x7f3b1c070260 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c073060 tx=0x7f3b1802a270 comp rx=0 tx=0).stop 2024-09-19T09:24:13.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.253+0000 7f3b2462e640 1 -- 172.21.15.18:0/3958501933 shutdown_connections 2024-09-19T09:24:13.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.253+0000 7f3b2462e640 1 --2- 172.21.15.18:0/3958501933 >> v2:172.21.15.162:3300/0 conn(0x7f3b1c162f20 0x7f3b1c0cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:13.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.253+0000 7f3b2462e640 1 --2- 172.21.15.18:0/3958501933 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b1c0b5200 0x7f3b1c1629e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:13.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.253+0000 7f3b2462e640 1 --2- 172.21.15.18:0/3958501933 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b1c15ed30 0x7f3b1c070260 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:13.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.253+0000 7f3b2462e640 1 -- 172.21.15.18:0/3958501933 >> 172.21.15.18:0/3958501933 conn(0x7f3b1c0b4600 msgr2=0x7f3b1c0b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:13.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.253+0000 7f3b2462e640 1 -- 172.21.15.18:0/3958501933 shutdown_connections 2024-09-19T09:24:13.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.253+0000 7f3b2462e640 1 -- 172.21.15.18:0/3958501933 wait complete. 2024-09-19T09:24:13.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.254+0000 7f3b2462e640 1 Processor -- start 2024-09-19T09:24:13.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.254+0000 7f3b2462e640 1 -- start start 2024-09-19T09:24:13.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.255+0000 7f3b2462e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b1c0b5200 0x7f3b1c0b1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:13.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.255+0000 7f3b2462e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b1c15ed30 0x7f3b1c1f8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:13.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.255+0000 7f3b2462e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b1c162f20 0x7f3b1c159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:13.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.255+0000 7f3b2462e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c070f10 con 0x7f3b1c162f20 2024-09-19T09:24:13.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.255+0000 7f3b2462e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c070d90 con 0x7f3b1c15ed30 2024-09-19T09:24:13.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.255+0000 7f3b2462e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3b1c15f110 con 0x7f3b1c0b5200 2024-09-19T09:24:13.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.255+0000 7f3b22bcb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b1c162f20 0x7f3b1c159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:13.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.255+0000 7f3b22bcb640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b1c162f20 0x7f3b1c159690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47492/0 (socket says 172.21.15.18:47492) 2024-09-19T09:24:13.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.255+0000 7f3b22bcb640 1 -- 172.21.15.18:0/4161981397 learned_addr learned my addr 172.21.15.18:0/4161981397 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:13.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.255+0000 7f3b223ca640 1 --2- 172.21.15.18:0/4161981397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b1c0b5200 0x7f3b1c0b1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:13.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.255+0000 7f3b21bc9640 1 --2- 172.21.15.18:0/4161981397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b1c15ed30 0x7f3b1c1f8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:13.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.255+0000 7f3b22bcb640 1 -- 172.21.15.18:0/4161981397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b1c0b5200 msgr2=0x7f3b1c0b1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:13.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.255+0000 7f3b22bcb640 1 --2- 172.21.15.18:0/4161981397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b1c0b5200 0x7f3b1c0b1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:13.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.255+0000 7f3b22bcb640 1 -- 172.21.15.18:0/4161981397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b1c15ed30 msgr2=0x7f3b1c1f8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:13.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.255+0000 7f3b22bcb640 1 --2- 172.21.15.18:0/4161981397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b1c15ed30 0x7f3b1c1f8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:13.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.255+0000 7f3b22bcb640 1 -- 172.21.15.18:0/4161981397 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b1c15fe30 con 0x7f3b1c162f20 2024-09-19T09:24:13.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.255+0000 7f3b223ca640 1 --2- 172.21.15.18:0/4161981397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b1c0b5200 0x7f3b1c0b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:13.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.255+0000 7f3b22bcb640 1 --2- 172.21.15.18:0/4161981397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b1c162f20 0x7f3b1c159690 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f3b14007df0 tx=0x7f3b1400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:13.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.255+0000 7f3b12ffd640 1 -- 172.21.15.18:0/4161981397 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1401a070 con 0x7f3b1c162f20 2024-09-19T09:24:13.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.256+0000 7f3b12ffd640 1 -- 172.21.15.18:0/4161981397 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b14003990 con 0x7f3b1c162f20 2024-09-19T09:24:13.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.256+0000 7f3b2462e640 1 -- 172.21.15.18:0/4161981397 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b1c1600d0 con 0x7f3b1c162f20 2024-09-19T09:24:13.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.256+0000 7f3b12ffd640 1 -- 172.21.15.18:0/4161981397 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b14003d80 con 0x7f3b1c162f20 2024-09-19T09:24:13.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.256+0000 7f3b2462e640 1 -- 172.21.15.18:0/4161981397 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b1c160690 con 0x7f3b1c162f20 2024-09-19T09:24:13.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.257+0000 7f3b2462e640 1 -- 172.21.15.18:0/4161981397 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b1c1629e0 con 0x7f3b1c162f20 2024-09-19T09:24:13.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.257+0000 7f3b12ffd640 1 -- 172.21.15.18:0/4161981397 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3b1401d070 con 0x7f3b1c162f20 2024-09-19T09:24:13.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.258+0000 7f3b12ffd640 1 --2- 172.21.15.18:0/4161981397 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3b0006c2b0 0x7f3b0006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:13.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.258+0000 7f3b12ffd640 1 -- 172.21.15.18:0/4161981397 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5767+0+0 (secure 0 0 0) 0x7f3b1408b670 con 0x7f3b1c162f20 2024-09-19T09:24:13.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.258+0000 7f3b12ffd640 1 -- 172.21.15.18:0/4161981397 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=172}) -- 0x7f3b00073ea0 con 0x7f3b1c162f20 2024-09-19T09:24:13.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.258+0000 7f3b223ca640 1 --2- 172.21.15.18:0/4161981397 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3b0006c2b0 0x7f3b0006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:13.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.259+0000 7f3b223ca640 1 --2- 172.21.15.18:0/4161981397 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3b0006c2b0 0x7f3b0006e770 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f3b18034000 tx=0x7f3b1802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:13.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.262+0000 7f3b12ffd640 1 -- 172.21.15.18:0/4161981397 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3b14010070 con 0x7f3b1c162f20 2024-09-19T09:24:13.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.479+0000 7f3b2462e640 1 -- 172.21.15.18:0/4161981397 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b1c070410 con 0x7f3b1c162f20 2024-09-19T09:24:13.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.479+0000 7f3b12ffd640 1 -- 172.21.15.18:0/4161981397 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5230 (secure 0 0 0) 0x7f3b14059e30 con 0x7f3b1c162f20 2024-09-19T09:24:13.481 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:24:13.482 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":74,"btime":"2024-09-19T09:23:04:468698+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1145590197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1145590197},{"type":"v1","addr":"172.21.15.162:6837","nonce":1145590197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/200393908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":200393908},{"type":"v1","addr":"172.21.15.162:6836","nonce":200393908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7542,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1236184741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1236184741},{"type":"v1","addr":"172.21.15.18:6834","nonce":1236184741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:23:00.797014+0000","modified":"2024-09-19T09:23:03.823915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7545":{"gid":7545,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2876222862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2876222862},{"type":"v1","addr":"172.21.15.18:6835","nonce":2876222862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7545,"qdb_cluster":[7545]},"id":10}]} 2024-09-19T09:24:13.482 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 74 2024-09-19T09:24:13.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.482+0000 7f3b2462e640 1 -- 172.21.15.18:0/4161981397 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3b0006c2b0 msgr2=0x7f3b0006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:13.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.482+0000 7f3b2462e640 1 --2- 172.21.15.18:0/4161981397 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3b0006c2b0 0x7f3b0006e770 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f3b18034000 tx=0x7f3b1802e000 comp rx=0 tx=0).stop 2024-09-19T09:24:13.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.482+0000 7f3b2462e640 1 -- 172.21.15.18:0/4161981397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b1c162f20 msgr2=0x7f3b1c159690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:13.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.482+0000 7f3b2462e640 1 --2- 172.21.15.18:0/4161981397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b1c162f20 0x7f3b1c159690 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f3b14007df0 tx=0x7f3b1400d4a0 comp rx=0 tx=0).stop 2024-09-19T09:24:13.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.482+0000 7f3b2462e640 1 -- 172.21.15.18:0/4161981397 shutdown_connections 2024-09-19T09:24:13.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.482+0000 7f3b2462e640 1 --2- 172.21.15.18:0/4161981397 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3b0006c2b0 0x7f3b0006e770 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:13.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.482+0000 7f3b2462e640 1 --2- 172.21.15.18:0/4161981397 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3b1c162f20 0x7f3b1c159690 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:13.484 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.482+0000 7f3b2462e640 1 --2- 172.21.15.18:0/4161981397 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b1c15ed30 0x7f3b1c1f8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:13.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.482+0000 7f3b2462e640 1 --2- 172.21.15.18:0/4161981397 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3b1c0b5200 0x7f3b1c0b1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:13.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.482+0000 7f3b2462e640 1 -- 172.21.15.18:0/4161981397 >> 172.21.15.18:0/4161981397 conn(0x7f3b1c0b4600 msgr2=0x7f3b1c06e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:13.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.482+0000 7f3b2462e640 1 -- 172.21.15.18:0/4161981397 shutdown_connections 2024-09-19T09:24:13.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.482+0000 7f3b2462e640 1 -- 172.21.15.18:0/4161981397 wait complete. 2024-09-19T09:24:13.495 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:24:13.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.595+0000 7f3a9cf42640 1 Processor -- start 2024-09-19T09:24:13.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.595+0000 7f3a9cf42640 1 -- start start 2024-09-19T09:24:13.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.596+0000 7f3a9cf42640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3a9806d730 0x7f3a980b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:13.598 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.596+0000 7f3a9cf42640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a980cd1a0 con 0x7f3a9815ef80 2024-09-19T09:24:13.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.596+0000 7f3a9cf42640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a9806dc30 con 0x7f3a980cfae0 2024-09-19T09:24:13.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.596+0000 7f3a9cf42640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f3a980cd7d0 con 0x7f3a9806d730 2024-09-19T09:24:13.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.596+0000 7f3a96d9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3a9806d730 0x7f3a980b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:13.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.596+0000 7f3a9659c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3a9815ef80 0x7f3a980cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:40546/0 (socket says 172.21.15.18:40546) 2024-09-19T09:24:13.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.596+0000 7f3a9659c640 1 -- 172.21.15.18:0/2721058148 learned_addr learned my addr 172.21.15.18:0/2721058148 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:24:13.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.597+0000 7f3a96d9d640 1 -- 172.21.15.18:0/2721058148 >> v1:172.21.15.162:6789/0 conn(0x7f3a980cfae0 legacy=0x7f3a980cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:13.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.597+0000 7f3a96d9d640 1 -- 172.21.15.18:0/2721058148 >> v1:172.21.15.18:6789/0 conn(0x7f3a9815ef80 legacy=0x7f3a980cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:13.599 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.597+0000 7f3a96d9d640 1 -- 172.21.15.18:0/2721058148 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a9806df10 con 0x7f3a9806d730 2024-09-19T09:24:13.600 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.597+0000 7f3a96d9d640 1 --2- 172.21.15.18:0/2721058148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a9806d730 0x7f3a980b5220 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f3a90009d90 tx=0x7f3a9002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56a243fa93b2355f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:13.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.598+0000 7f3a95d9b640 1 -- 172.21.15.18:0/2721058148 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a90007740 con 0x7f3a9806d730 2024-09-19T09:24:13.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.598+0000 7f3a95d9b640 1 -- 172.21.15.18:0/2721058148 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a900078e0 con 0x7f3a9806d730 2024-09-19T09:24:13.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.598+0000 7f3a95d9b640 1 -- 172.21.15.18:0/2721058148 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a90007cb0 con 0x7f3a9806d730 2024-09-19T09:24:13.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.598+0000 7f3a9cf42640 1 -- 172.21.15.18:0/2721058148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a9806d730 msgr2=0x7f3a980b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:13.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.598+0000 7f3a9cf42640 1 --2- 172.21.15.18:0/2721058148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a9806d730 0x7f3a980b5220 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f3a90009d90 tx=0x7f3a9002a6a0 comp rx=0 tx=0).stop 2024-09-19T09:24:13.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.598+0000 7f3a9cf42640 1 -- 172.21.15.18:0/2721058148 shutdown_connections 2024-09-19T09:24:13.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.598+0000 7f3a9cf42640 1 --2- 172.21.15.18:0/2721058148 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a9806d730 0x7f3a980b5220 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:13.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.598+0000 7f3a9cf42640 1 -- 172.21.15.18:0/2721058148 >> 172.21.15.18:0/2721058148 conn(0x7f3a980b4700 msgr2=0x7f3a980b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:13.601 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.598+0000 7f3a9cf42640 1 -- 172.21.15.18:0/2721058148 shutdown_connections 2024-09-19T09:24:13.602 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.598+0000 7f3a9cf42640 1 -- 172.21.15.18:0/2721058148 wait complete. 2024-09-19T09:24:13.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.599+0000 7f3a9cf42640 1 Processor -- start 2024-09-19T09:24:13.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.600+0000 7f3a9cf42640 1 -- start start 2024-09-19T09:24:13.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.600+0000 7f3a9cf42640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a9806d730 0x7f3a980cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:13.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.600+0000 7f3a9cf42640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a980cfae0 0x7f3a981f4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:13.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.600+0000 7f3a9cf42640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a9815ef80 0x7f3a98160db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:13.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.600+0000 7f3a9cf42640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3a980d0120 con 0x7f3a9806d730 2024-09-19T09:24:13.604 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.600+0000 7f3a9cf42640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3a9815f360 con 0x7f3a980cfae0 2024-09-19T09:24:13.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.600+0000 7f3a9cf42640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3a980ce370 con 0x7f3a9815ef80 2024-09-19T09:24:13.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.600+0000 7f3a9659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a9806d730 0x7f3a980cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:13.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.600+0000 7f3a9659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a9806d730 0x7f3a980cc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47508/0 (socket says 172.21.15.18:47508) 2024-09-19T09:24:13.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.600+0000 7f3a9659c640 1 -- 172.21.15.18:0/2881328544 learned_addr learned my addr 172.21.15.18:0/2881328544 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:13.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.601+0000 7f3a96d9d640 1 --2- 172.21.15.18:0/2881328544 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a9815ef80 0x7f3a98160db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:13.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.601+0000 7f3a8ffff640 1 --2- 172.21.15.18:0/2881328544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a980cfae0 0x7f3a981f4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:13.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.601+0000 7f3a9659c640 1 -- 172.21.15.18:0/2881328544 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a9815ef80 msgr2=0x7f3a98160db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:13.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.601+0000 7f3a9659c640 1 --2- 172.21.15.18:0/2881328544 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a9815ef80 0x7f3a98160db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:13.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.601+0000 7f3a9659c640 1 -- 172.21.15.18:0/2881328544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a980cfae0 msgr2=0x7f3a981f4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:13.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.601+0000 7f3a9659c640 1 --2- 172.21.15.18:0/2881328544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a980cfae0 0x7f3a981f4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:13.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.601+0000 7f3a9659c640 1 -- 172.21.15.18:0/2881328544 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a980cca30 con 0x7f3a9806d730 2024-09-19T09:24:13.605 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.601+0000 7f3a96d9d640 1 --2- 172.21.15.18:0/2881328544 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a9815ef80 0x7f3a98160db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:13.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.601+0000 7f3a8ffff640 1 --2- 172.21.15.18:0/2881328544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a980cfae0 0x7f3a981f4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:13.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.601+0000 7f3a9659c640 1 --2- 172.21.15.18:0/2881328544 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a9806d730 0x7f3a980cc4f0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f3a8800c3c0 tx=0x7f3a8800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:13.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.601+0000 7f3a8effd640 1 -- 172.21.15.18:0/2881328544 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a88017070 con 0x7f3a9806d730 2024-09-19T09:24:13.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.601+0000 7f3a8effd640 1 -- 172.21.15.18:0/2881328544 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a88005ce0 con 0x7f3a9806d730 2024-09-19T09:24:13.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.601+0000 7f3a9cf42640 1 -- 172.21.15.18:0/2881328544 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a981f59f0 con 0x7f3a9806d730 2024-09-19T09:24:13.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.601+0000 7f3a8effd640 1 -- 172.21.15.18:0/2881328544 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a880072f0 con 0x7f3a9806d730 2024-09-19T09:24:13.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.601+0000 7f3a9cf42640 1 -- 172.21.15.18:0/2881328544 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a980c9dc0 con 0x7f3a9806d730 2024-09-19T09:24:13.606 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.602+0000 7f3a9cf42640 1 -- 172.21.15.18:0/2881328544 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a981625e0 con 0x7f3a9806d730 2024-09-19T09:24:13.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.603+0000 7f3a8effd640 1 -- 172.21.15.18:0/2881328544 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3a8801a070 con 0x7f3a9806d730 2024-09-19T09:24:13.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.603+0000 7f3a8effd640 1 --2- 172.21.15.18:0/2881328544 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3a7806c2e0 0x7f3a7806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:13.607 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.603+0000 7f3a8effd640 1 -- 172.21.15.18:0/2881328544 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5767+0+0 (secure 0 0 0) 0x7f3a8808a7d0 con 0x7f3a9806d730 2024-09-19T09:24:13.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.603+0000 7f3a8effd640 1 -- 172.21.15.18:0/2881328544 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=172}) -- 0x7f3a78073f30 con 0x7f3a9806d730 2024-09-19T09:24:13.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.603+0000 7f3a8ffff640 1 --2- 172.21.15.18:0/2881328544 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3a7806c2e0 0x7f3a7806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:13.608 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.604+0000 7f3a8ffff640 1 --2- 172.21.15.18:0/2881328544 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3a7806c2e0 0x7f3a7806e7a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f3a980b8bb0 tx=0x7f3a80009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:13.609 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.607+0000 7f3a8effd640 1 -- 172.21.15.18:0/2881328544 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3a88058f00 con 0x7f3a9806d730 2024-09-19T09:24:13.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.785+0000 7f3a9cf42640 1 -- 172.21.15.18:0/2881328544 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3a980b5220 con 0x7f3a9806d730 2024-09-19T09:24:13.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.786+0000 7f3a8effd640 1 -- 172.21.15.18:0/2881328544 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v171) ==== 74+0+16815 (secure 0 0 0) 0x7f3a8805f0d0 con 0x7f3a9806d730 2024-09-19T09:24:13.789 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:24:13.789 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":171,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:23:46.266420+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:22:58.457161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-19T09:22:59.786310+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.0","mappings":[{"from":2,"to":5}]},{"pgid":"21.1e","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:24:13.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.788+0000 7f3a9cf42640 1 -- 172.21.15.18:0/2881328544 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3a7806c2e0 msgr2=0x7f3a7806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:13.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.788+0000 7f3a9cf42640 1 --2- 172.21.15.18:0/2881328544 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3a7806c2e0 0x7f3a7806e7a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f3a980b8bb0 tx=0x7f3a80009040 comp rx=0 tx=0).stop 2024-09-19T09:24:13.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.788+0000 7f3a9cf42640 1 -- 172.21.15.18:0/2881328544 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a9806d730 msgr2=0x7f3a980cc4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:13.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.788+0000 7f3a9cf42640 1 --2- 172.21.15.18:0/2881328544 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a9806d730 0x7f3a980cc4f0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f3a8800c3c0 tx=0x7f3a8800c880 comp rx=0 tx=0).stop 2024-09-19T09:24:13.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.788+0000 7f3a9cf42640 1 -- 172.21.15.18:0/2881328544 shutdown_connections 2024-09-19T09:24:13.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.788+0000 7f3a9cf42640 1 --2- 172.21.15.18:0/2881328544 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3a7806c2e0 0x7f3a7806e7a0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:13.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.788+0000 7f3a9cf42640 1 --2- 172.21.15.18:0/2881328544 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3a9815ef80 0x7f3a98160db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:13.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.788+0000 7f3a9cf42640 1 --2- 172.21.15.18:0/2881328544 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3a980cfae0 0x7f3a981f4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:13.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.788+0000 7f3a9cf42640 1 --2- 172.21.15.18:0/2881328544 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3a9806d730 0x7f3a980cc4f0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:13.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.788+0000 7f3a9cf42640 1 -- 172.21.15.18:0/2881328544 >> 172.21.15.18:0/2881328544 conn(0x7f3a980b4700 msgr2=0x7f3a980d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:13.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.788+0000 7f3a9cf42640 1 -- 172.21.15.18:0/2881328544 shutdown_connections 2024-09-19T09:24:13.791 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.788+0000 7f3a9cf42640 1 -- 172.21.15.18:0/2881328544 wait complete. 2024-09-19T09:24:13.802 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T09:24:13.802 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:24:13.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.903+0000 7fd1a5378640 1 Processor -- start 2024-09-19T09:24:13.905 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.903+0000 7fd1a5378640 1 -- start start 2024-09-19T09:24:13.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.904+0000 7fd1a5378640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd1a015ef50 0x7fd1a00d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:13.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.904+0000 7fd1a5378640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd1a00d3240 0x7fd1a00d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:13.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.904+0000 7fd1a5378640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1a00d5780 0x7fd1a00cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:13.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.904+0000 7fd1a5378640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fd1a00b7a90 con 0x7fd1a015ef50 2024-09-19T09:24:13.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.904+0000 7fd1a5378640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd1a00d3740 con 0x7fd1a00d3240 2024-09-19T09:24:13.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.904+0000 7fd1a5378640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd1a00d3a20 con 0x7fd1a00d5780 2024-09-19T09:24:13.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.904+0000 7fd19effd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd1a015ef50 0x7fd1a00d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:13.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.904+0000 7fd19effd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd1a015ef50 0x7fd1a00d13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47522/0 (socket says 172.21.15.18:47522) 2024-09-19T09:24:13.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.904+0000 7fd19effd640 1 -- 172.21.15.18:0/960300688 learned_addr learned my addr 172.21.15.18:0/960300688 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:13.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.905+0000 7fd19effd640 1 -- 172.21.15.18:0/960300688 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1a00d5780 msgr2=0x7fd1a00cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:13.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.905+0000 7fd19effd640 1 --2- 172.21.15.18:0/960300688 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1a00d5780 0x7fd1a00cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:13.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.905+0000 7fd19effd640 1 -- 172.21.15.18:0/960300688 >> v2:172.21.15.162:3300/0 conn(0x7fd1a00d3240 msgr2=0x7fd1a00d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:13.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.905+0000 7fd19effd640 1 --2- 172.21.15.18:0/960300688 >> v2:172.21.15.162:3300/0 conn(0x7fd1a00d3240 0x7fd1a00d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:13.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.905+0000 7fd19effd640 1 -- 172.21.15.18:0/960300688 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1a00b7d00 con 0x7fd1a015ef50 2024-09-19T09:24:13.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.905+0000 7fd19effd640 1 --2- 172.21.15.18:0/960300688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1a015ef50 0x7fd1a00d13a0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fd1a008df60 tx=0x7fd19802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ae5fcddd7083b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:13.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.905+0000 7fd19dffb640 1 -- 172.21.15.18:0/960300688 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd198037070 con 0x7fd1a015ef50 2024-09-19T09:24:13.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.906+0000 7fd19dffb640 1 -- 172.21.15.18:0/960300688 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd198032440 con 0x7fd1a015ef50 2024-09-19T09:24:13.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.906+0000 7fd19dffb640 1 -- 172.21.15.18:0/960300688 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd198032810 con 0x7fd1a015ef50 2024-09-19T09:24:13.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.906+0000 7fd1a5378640 1 -- 172.21.15.18:0/960300688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1a015ef50 msgr2=0x7fd1a00d13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:13.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.906+0000 7fd1a5378640 1 --2- 172.21.15.18:0/960300688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1a015ef50 0x7fd1a00d13a0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fd1a008df60 tx=0x7fd19802a140 comp rx=0 tx=0).stop 2024-09-19T09:24:13.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.906+0000 7fd1a5378640 1 -- 172.21.15.18:0/960300688 shutdown_connections 2024-09-19T09:24:13.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.906+0000 7fd1a5378640 1 --2- 172.21.15.18:0/960300688 >> v2:172.21.15.162:3300/0 conn(0x7fd1a00d3240 0x7fd1a00d18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:13.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.906+0000 7fd1a5378640 1 --2- 172.21.15.18:0/960300688 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1a00d5780 0x7fd1a00cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:13.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.906+0000 7fd1a5378640 1 --2- 172.21.15.18:0/960300688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1a015ef50 0x7fd1a00d13a0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:13.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.906+0000 7fd1a5378640 1 -- 172.21.15.18:0/960300688 >> 172.21.15.18:0/960300688 conn(0x7fd1a00d4c60 msgr2=0x7fd1a00d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:13.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.906+0000 7fd1a5378640 1 -- 172.21.15.18:0/960300688 shutdown_connections 2024-09-19T09:24:13.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.906+0000 7fd1a5378640 1 -- 172.21.15.18:0/960300688 wait complete. 2024-09-19T09:24:13.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.907+0000 7fd1a5378640 1 Processor -- start 2024-09-19T09:24:13.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.907+0000 7fd1a5378640 1 -- start start 2024-09-19T09:24:13.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.908+0000 7fd1a5378640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1a00d3240 0x7fd1a01583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:13.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.908+0000 7fd1a5378640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1a00d5780 0x7fd1a00ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:13.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.908+0000 7fd1a5378640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1a015ef50 0x7fd1a00ce710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:13.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.908+0000 7fd1a5378640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a00d21a0 con 0x7fd1a00d3240 2024-09-19T09:24:13.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.908+0000 7fd1a5378640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd1a00d2020 con 0x7fd1a00d5780 2024-09-19T09:24:13.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.908+0000 7fd1a5378640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd1a00cfcb0 con 0x7fd1a015ef50 2024-09-19T09:24:13.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.908+0000 7fd19effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1a00d3240 0x7fd1a01583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:13.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.908+0000 7fd19effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1a00d3240 0x7fd1a01583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47534/0 (socket says 172.21.15.18:47534) 2024-09-19T09:24:13.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.908+0000 7fd19effd640 1 -- 172.21.15.18:0/4257011531 learned_addr learned my addr 172.21.15.18:0/4257011531 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:13.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.909+0000 7fd19effd640 1 -- 172.21.15.18:0/4257011531 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1a015ef50 msgr2=0x7fd1a00ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:13.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.909+0000 7fd19effd640 1 --2- 172.21.15.18:0/4257011531 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1a015ef50 0x7fd1a00ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:13.912 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.909+0000 7fd19effd640 1 -- 172.21.15.18:0/4257011531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1a00d5780 msgr2=0x7fd1a00ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:13.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.909+0000 7fd19effd640 1 --2- 172.21.15.18:0/4257011531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1a00d5780 0x7fd1a00ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:13.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.909+0000 7fd19effd640 1 -- 172.21.15.18:0/4257011531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1a0162230 con 0x7fd1a00d3240 2024-09-19T09:24:13.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.909+0000 7fd19effd640 1 --2- 172.21.15.18:0/4257011531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1a00d3240 0x7fd1a01583e0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fd198000c00 tx=0x7fd1980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:13.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.909+0000 7fd1977fe640 1 -- 172.21.15.18:0/4257011531 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd198041070 con 0x7fd1a00d3240 2024-09-19T09:24:13.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.909+0000 7fd1977fe640 1 -- 172.21.15.18:0/4257011531 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd19803c870 con 0x7fd1a00d3240 2024-09-19T09:24:13.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.909+0000 7fd1a5378640 1 -- 172.21.15.18:0/4257011531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1a01f51b0 con 0x7fd1a00d3240 2024-09-19T09:24:13.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.909+0000 7fd1977fe640 1 -- 172.21.15.18:0/4257011531 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd198037040 con 0x7fd1a00d3240 2024-09-19T09:24:13.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.909+0000 7fd1a5378640 1 -- 172.21.15.18:0/4257011531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1a01f4ec0 con 0x7fd1a00d3240 2024-09-19T09:24:13.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.910+0000 7fd1a5378640 1 -- 172.21.15.18:0/4257011531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1a00cf770 con 0x7fd1a00d3240 2024-09-19T09:24:13.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.910+0000 7fd1977fe640 1 -- 172.21.15.18:0/4257011531 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd198044070 con 0x7fd1a00d3240 2024-09-19T09:24:13.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.911+0000 7fd1977fe640 1 --2- 172.21.15.18:0/4257011531 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd18006c2b0 0x7fd18006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:13.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.911+0000 7fd1977fe640 1 -- 172.21.15.18:0/4257011531 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5767+0+0 (secure 0 0 0) 0x7fd1980ac210 con 0x7fd1a00d3240 2024-09-19T09:24:13.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.911+0000 7fd1977fe640 1 -- 172.21.15.18:0/4257011531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=172}) -- 0x7fd180073f00 con 0x7fd1a00d3240 2024-09-19T09:24:13.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.911+0000 7fd19e7fc640 1 --2- 172.21.15.18:0/4257011531 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd18006c2b0 0x7fd18006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:13.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.912+0000 7fd19e7fc640 1 --2- 172.21.15.18:0/4257011531 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd18006c2b0 0x7fd18006e770 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd1a00b5dd0 tx=0x7fd188006c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:13.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:13.915+0000 7fd1977fe640 1 -- 172.21.15.18:0/4257011531 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd19807aa60 con 0x7fd1a00d3240 2024-09-19T09:24:14.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.126+0000 7fd1a5378640 1 -- 172.21.15.18:0/4257011531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd1a00cef80 con 0x7fd1a00d3240 2024-09-19T09:24:14.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.126+0000 7fd1977fe640 1 -- 172.21.15.18:0/4257011531 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5230 (secure 0 0 0) 0x7fd19807a360 con 0x7fd1a00d3240 2024-09-19T09:24:14.128 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:24:14.129 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":74,"btime":"2024-09-19T09:23:04:468698+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1145590197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1145590197},{"type":"v1","addr":"172.21.15.162:6837","nonce":1145590197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/200393908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":200393908},{"type":"v1","addr":"172.21.15.162:6836","nonce":200393908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7542,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1236184741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1236184741},{"type":"v1","addr":"172.21.15.18:6834","nonce":1236184741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:23:00.797014+0000","modified":"2024-09-19T09:23:03.823915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7545":{"gid":7545,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2876222862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2876222862},{"type":"v1","addr":"172.21.15.18:6835","nonce":2876222862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7545,"qdb_cluster":[7545]},"id":10}]} 2024-09-19T09:24:14.129 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 74 2024-09-19T09:24:14.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.128+0000 7fd1a5378640 1 -- 172.21.15.18:0/4257011531 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd18006c2b0 msgr2=0x7fd18006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:14.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.128+0000 7fd1a5378640 1 --2- 172.21.15.18:0/4257011531 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd18006c2b0 0x7fd18006e770 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd1a00b5dd0 tx=0x7fd188006c90 comp rx=0 tx=0).stop 2024-09-19T09:24:14.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.129+0000 7fd1a5378640 1 -- 172.21.15.18:0/4257011531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1a00d3240 msgr2=0x7fd1a01583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:14.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.129+0000 7fd1a5378640 1 --2- 172.21.15.18:0/4257011531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1a00d3240 0x7fd1a01583e0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fd198000c00 tx=0x7fd1980046c0 comp rx=0 tx=0).stop 2024-09-19T09:24:14.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.129+0000 7fd1a5378640 1 -- 172.21.15.18:0/4257011531 shutdown_connections 2024-09-19T09:24:14.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.129+0000 7fd1a5378640 1 --2- 172.21.15.18:0/4257011531 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd18006c2b0 0x7fd18006e770 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:14.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.129+0000 7fd1a5378640 1 --2- 172.21.15.18:0/4257011531 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd1a015ef50 0x7fd1a00ce710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:14.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.129+0000 7fd1a5378640 1 --2- 172.21.15.18:0/4257011531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1a00d5780 0x7fd1a00ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:14.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.129+0000 7fd1a5378640 1 --2- 172.21.15.18:0/4257011531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd1a00d3240 0x7fd1a01583e0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:14.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.129+0000 7fd1a5378640 1 -- 172.21.15.18:0/4257011531 >> 172.21.15.18:0/4257011531 conn(0x7fd1a00d4c60 msgr2=0x7fd1a00d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:14.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.129+0000 7fd1a5378640 1 -- 172.21.15.18:0/4257011531 shutdown_connections 2024-09-19T09:24:14.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.129+0000 7fd1a5378640 1 -- 172.21.15.18:0/4257011531 wait complete. 2024-09-19T09:24:14.142 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:24:14.243 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.241+0000 7f5b70ddf640 1 Processor -- start 2024-09-19T09:24:14.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.241+0000 7f5b70ddf640 1 -- start start 2024-09-19T09:24:14.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.242+0000 7f5b70ddf640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5b6c0d1ab0 0x7f5b6c0b8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:14.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.242+0000 7f5b70ddf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b6c0d3240 0x7f5b6c0b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:14.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.242+0000 7f5b70ddf640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b6c0b7a90 con 0x7f5b6c15ef50 2024-09-19T09:24:14.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.242+0000 7f5b70ddf640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f5b6c0d3740 con 0x7f5b6c0d1ab0 2024-09-19T09:24:14.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.242+0000 7f5b70ddf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5b6c0d3a20 con 0x7f5b6c0d3240 2024-09-19T09:24:14.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.243+0000 7f5b69d9b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5b6c0d1ab0 0x7f5b6c0b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:14.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.243+0000 7f5b6ad9d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b6c0d3240 0x7f5b6c0b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:14.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.243+0000 7f5b6a59c640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f5b6c15ef50 0x7f5b6c0d13a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:57128/0 (socket says 172.21.15.18:57128) 2024-09-19T09:24:14.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.243+0000 7f5b6a59c640 1 -- 172.21.15.18:0/1670800126 learned_addr learned my addr 172.21.15.18:0/1670800126 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:24:14.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.243+0000 7f5b69d9b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5b6c0d1ab0 0x7f5b6c0b8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:51546/0 (socket says 172.21.15.18:51546) 2024-09-19T09:24:14.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.243+0000 7f5b69d9b640 1 -- 172.21.15.18:0/1670800126 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b6c0d3240 msgr2=0x7f5b6c0b8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:14.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.243+0000 7f5b69d9b640 1 --2- 172.21.15.18:0/1670800126 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b6c0d3240 0x7f5b6c0b8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:14.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.243+0000 7f5b69d9b640 1 -- 172.21.15.18:0/1670800126 >> v1:172.21.15.162:6789/0 conn(0x7f5b6c15ef50 legacy=0x7f5b6c0d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:14.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.243+0000 7f5b6959a640 1 -- 172.21.15.18:0/1670800126 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3908190749 0 0) 0x7f5b6c0b7a90 con 0x7f5b6c15ef50 2024-09-19T09:24:14.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.243+0000 7f5b69d9b640 1 -- 172.21.15.18:0/1670800126 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b6c0b7d00 con 0x7f5b6c0d1ab0 2024-09-19T09:24:14.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.244+0000 7f5b69d9b640 1 --2- 172.21.15.18:0/1670800126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b6c0d1ab0 0x7f5b6c0b8500 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5b540097a0 tx=0x7f5b5402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ceee007b9b14a0e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:14.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.244+0000 7f5b6959a640 1 -- 172.21.15.18:0/1670800126 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b54037070 con 0x7f5b6c0d1ab0 2024-09-19T09:24:14.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.244+0000 7f5b6959a640 1 -- 172.21.15.18:0/1670800126 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b5402ae50 con 0x7f5b6c0d1ab0 2024-09-19T09:24:14.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.244+0000 7f5b6959a640 1 -- 172.21.15.18:0/1670800126 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b54032660 con 0x7f5b6c0d1ab0 2024-09-19T09:24:14.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.245+0000 7f5b70ddf640 1 -- 172.21.15.18:0/1670800126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b6c0d1ab0 msgr2=0x7f5b6c0b8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:14.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.245+0000 7f5b70ddf640 1 --2- 172.21.15.18:0/1670800126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b6c0d1ab0 0x7f5b6c0b8500 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5b540097a0 tx=0x7f5b5402a100 comp rx=0 tx=0).stop 2024-09-19T09:24:14.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.245+0000 7f5b70ddf640 1 -- 172.21.15.18:0/1670800126 shutdown_connections 2024-09-19T09:24:14.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.245+0000 7f5b70ddf640 1 --2- 172.21.15.18:0/1670800126 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b6c0d3240 0x7f5b6c0b8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:14.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.245+0000 7f5b70ddf640 1 --2- 172.21.15.18:0/1670800126 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b6c0d1ab0 0x7f5b6c0b8500 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:14.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.245+0000 7f5b70ddf640 1 -- 172.21.15.18:0/1670800126 >> 172.21.15.18:0/1670800126 conn(0x7f5b6c0d4c60 msgr2=0x7f5b6c0d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:14.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.245+0000 7f5b70ddf640 1 -- 172.21.15.18:0/1670800126 shutdown_connections 2024-09-19T09:24:14.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.245+0000 7f5b70ddf640 1 -- 172.21.15.18:0/1670800126 wait complete. 2024-09-19T09:24:14.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.246+0000 7f5b70ddf640 1 Processor -- start 2024-09-19T09:24:14.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.246+0000 7f5b70ddf640 1 -- start start 2024-09-19T09:24:14.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.247+0000 7f5b70ddf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b6c0d1ab0 0x7f5b6c15c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:14.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.247+0000 7f5b70ddf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b6c0d3240 0x7f5b6c15c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:14.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.247+0000 7f5b70ddf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b6c15ef50 0x7f5b6c15cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:14.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.247+0000 7f5b70ddf640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c0d21a0 con 0x7f5b6c15ef50 2024-09-19T09:24:14.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.247+0000 7f5b70ddf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c0d2020 con 0x7f5b6c0d3240 2024-09-19T09:24:14.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.247+0000 7f5b70ddf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5b6c0d5780 con 0x7f5b6c0d1ab0 2024-09-19T09:24:14.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.247+0000 7f5b6ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b6c15ef50 0x7f5b6c15cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:14.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.247+0000 7f5b6ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b6c15ef50 0x7f5b6c15cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47536/0 (socket says 172.21.15.18:47536) 2024-09-19T09:24:14.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.247+0000 7f5b6ad9d640 1 -- 172.21.15.18:0/1614275279 learned_addr learned my addr 172.21.15.18:0/1614275279 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:14.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.247+0000 7f5b69d9b640 1 --2- 172.21.15.18:0/1614275279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b6c0d3240 0x7f5b6c15c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:14.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.247+0000 7f5b6a59c640 1 --2- 172.21.15.18:0/1614275279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b6c0d1ab0 0x7f5b6c15c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:14.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.247+0000 7f5b6ad9d640 1 -- 172.21.15.18:0/1614275279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b6c0d1ab0 msgr2=0x7f5b6c15c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:14.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.247+0000 7f5b6ad9d640 1 --2- 172.21.15.18:0/1614275279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b6c0d1ab0 0x7f5b6c15c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:14.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.247+0000 7f5b6ad9d640 1 -- 172.21.15.18:0/1614275279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b6c0d3240 msgr2=0x7f5b6c15c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:14.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.247+0000 7f5b6ad9d640 1 --2- 172.21.15.18:0/1614275279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b6c0d3240 0x7f5b6c15c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:14.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.247+0000 7f5b6ad9d640 1 -- 172.21.15.18:0/1614275279 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b6c0cb070 con 0x7f5b6c15ef50 2024-09-19T09:24:14.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.247+0000 7f5b6a59c640 1 --2- 172.21.15.18:0/1614275279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b6c0d1ab0 0x7f5b6c15c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:14.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.248+0000 7f5b6ad9d640 1 --2- 172.21.15.18:0/1614275279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b6c15ef50 0x7f5b6c15cdf0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f5b6400e850 tx=0x7f5b6400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:14.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.248+0000 7f5b62ffd640 1 -- 172.21.15.18:0/1614275279 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b64017070 con 0x7f5b6c15ef50 2024-09-19T09:24:14.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.248+0000 7f5b62ffd640 1 -- 172.21.15.18:0/1614275279 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b6400c940 con 0x7f5b6c15ef50 2024-09-19T09:24:14.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.248+0000 7f5b70ddf640 1 -- 172.21.15.18:0/1614275279 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b6c0cb350 con 0x7f5b6c15ef50 2024-09-19T09:24:14.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.248+0000 7f5b62ffd640 1 -- 172.21.15.18:0/1614275279 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6400cd30 con 0x7f5b6c15ef50 2024-09-19T09:24:14.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.248+0000 7f5b70ddf640 1 -- 172.21.15.18:0/1614275279 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b6c0ce5f0 con 0x7f5b6c15ef50 2024-09-19T09:24:14.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.249+0000 7f5b70ddf640 1 -- 172.21.15.18:0/1614275279 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b6c0d13a0 con 0x7f5b6c15ef50 2024-09-19T09:24:14.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.249+0000 7f5b62ffd640 1 -- 172.21.15.18:0/1614275279 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5b6401a070 con 0x7f5b6c15ef50 2024-09-19T09:24:14.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.250+0000 7f5b62ffd640 1 --2- 172.21.15.18:0/1614275279 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5b4c06c2b0 0x7f5b4c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:14.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.250+0000 7f5b62ffd640 1 -- 172.21.15.18:0/1614275279 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5767+0+0 (secure 0 0 0) 0x7f5b6408b730 con 0x7f5b6c15ef50 2024-09-19T09:24:14.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.250+0000 7f5b62ffd640 1 -- 172.21.15.18:0/1614275279 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=172}) -- 0x7f5b4c073ea0 con 0x7f5b6c15ef50 2024-09-19T09:24:14.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.250+0000 7f5b6a59c640 1 --2- 172.21.15.18:0/1614275279 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5b4c06c2b0 0x7f5b4c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:14.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.251+0000 7f5b6a59c640 1 --2- 172.21.15.18:0/1614275279 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5b4c06c2b0 0x7f5b4c06e770 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c0012e0 tx=0x7f5b5c005b90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:14.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.254+0000 7f5b62ffd640 1 -- 172.21.15.18:0/1614275279 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5b64059810 con 0x7f5b6c15ef50 2024-09-19T09:24:14.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.467+0000 7f5b70ddf640 1 -- 172.21.15.18:0/1614275279 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b6c075500 con 0x7f5b6c15ef50 2024-09-19T09:24:14.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.467+0000 7f5b62ffd640 1 -- 172.21.15.18:0/1614275279 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 74 v74) ==== 94+0+5230 (secure 0 0 0) 0x7f5b6405db10 con 0x7f5b6c15ef50 2024-09-19T09:24:14.470 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:24:14.470 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":74,"btime":"2024-09-19T09:23:04:468698+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1145590197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1145590197},{"type":"v1","addr":"172.21.15.162:6837","nonce":1145590197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/200393908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":200393908},{"type":"v1","addr":"172.21.15.162:6836","nonce":200393908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7542,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1236184741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1236184741},{"type":"v1","addr":"172.21.15.18:6834","nonce":1236184741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68}],"filesystems":[{"mdsmap":{"epoch":74,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:23:00.797014+0000","modified":"2024-09-19T09:23:03.823915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7545},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7545":{"gid":7545,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2876222862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2876222862},{"type":"v1","addr":"172.21.15.18:6835","nonce":2876222862}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7545,"qdb_cluster":[7545]},"id":10}]} 2024-09-19T09:24:14.470 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 74 2024-09-19T09:24:14.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.470+0000 7f5b70ddf640 1 -- 172.21.15.18:0/1614275279 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5b4c06c2b0 msgr2=0x7f5b4c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:14.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.470+0000 7f5b70ddf640 1 --2- 172.21.15.18:0/1614275279 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5b4c06c2b0 0x7f5b4c06e770 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c0012e0 tx=0x7f5b5c005b90 comp rx=0 tx=0).stop 2024-09-19T09:24:14.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.470+0000 7f5b70ddf640 1 -- 172.21.15.18:0/1614275279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b6c15ef50 msgr2=0x7f5b6c15cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:14.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.470+0000 7f5b70ddf640 1 --2- 172.21.15.18:0/1614275279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b6c15ef50 0x7f5b6c15cdf0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f5b6400e850 tx=0x7f5b6400ed10 comp rx=0 tx=0).stop 2024-09-19T09:24:14.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.470+0000 7f5b70ddf640 1 -- 172.21.15.18:0/1614275279 shutdown_connections 2024-09-19T09:24:14.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.470+0000 7f5b70ddf640 1 --2- 172.21.15.18:0/1614275279 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5b4c06c2b0 0x7f5b4c06e770 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:14.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.470+0000 7f5b70ddf640 1 --2- 172.21.15.18:0/1614275279 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5b6c15ef50 0x7f5b6c15cdf0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:14.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.470+0000 7f5b70ddf640 1 --2- 172.21.15.18:0/1614275279 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5b6c0d3240 0x7f5b6c15c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:14.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.470+0000 7f5b70ddf640 1 --2- 172.21.15.18:0/1614275279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5b6c0d1ab0 0x7f5b6c15c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:14.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.470+0000 7f5b70ddf640 1 -- 172.21.15.18:0/1614275279 >> 172.21.15.18:0/1614275279 conn(0x7f5b6c0d4c60 msgr2=0x7f5b6c0b89c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:14.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.470+0000 7f5b70ddf640 1 -- 172.21.15.18:0/1614275279 shutdown_connections 2024-09-19T09:24:14.473 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.470+0000 7f5b70ddf640 1 -- 172.21.15.18:0/1614275279 wait complete. 2024-09-19T09:24:14.483 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:24:14.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.583+0000 7f7aaf566640 1 Processor -- start 2024-09-19T09:24:14.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.583+0000 7f7aaf566640 1 -- start start 2024-09-19T09:24:14.586 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.584+0000 7f7aaf566640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7aa815ed30 0x7f7aa8070260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:14.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.584+0000 7f7aaf566640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7aa81630f0 0x7f7aa80cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:14.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.584+0000 7f7aaf566640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7aa80d0a10 con 0x7f7aa80b5200 2024-09-19T09:24:14.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.584+0000 7f7aaf566640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f7aa8070ab0 con 0x7f7aa815ed30 2024-09-19T09:24:14.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.584+0000 7f7aaf566640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7aa80d0cb0 con 0x7f7aa81630f0 2024-09-19T09:24:14.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.584+0000 7f7aad302640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7aa815ed30 0x7f7aa8070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:14.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.584+0000 7f7aad302640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7aa815ed30 0x7f7aa8070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47550/0 (socket says 172.21.15.18:47550) 2024-09-19T09:24:14.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.584+0000 7f7aad302640 1 -- 172.21.15.18:0/1306723514 learned_addr learned my addr 172.21.15.18:0/1306723514 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:14.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.585+0000 7f7aad302640 1 -- 172.21.15.18:0/1306723514 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7aa81630f0 msgr2=0x7f7aa80cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:14.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.585+0000 7f7aad302640 1 --2- 172.21.15.18:0/1306723514 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7aa81630f0 0x7f7aa80cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:14.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.585+0000 7f7aad302640 1 -- 172.21.15.18:0/1306723514 >> v1:172.21.15.162:6789/0 conn(0x7f7aa80b5200 legacy=0x7f7aa81629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:14.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.585+0000 7f7aad302640 1 -- 172.21.15.18:0/1306723514 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa80d0f90 con 0x7f7aa815ed30 2024-09-19T09:24:14.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.585+0000 7f7aad302640 1 --2- 172.21.15.18:0/1306723514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7aa815ed30 0x7f7aa8070260 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4009870 tx=0x7f7aa402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d00b698bfa77fd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:14.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.585+0000 7f7a9ffff640 1 -- 172.21.15.18:0/1306723514 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4037070 con 0x7f7aa815ed30 2024-09-19T09:24:14.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.585+0000 7f7a9ffff640 1 -- 172.21.15.18:0/1306723514 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aa4032440 con 0x7f7aa815ed30 2024-09-19T09:24:14.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.585+0000 7f7a9ffff640 1 -- 172.21.15.18:0/1306723514 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4032810 con 0x7f7aa815ed30 2024-09-19T09:24:14.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.586+0000 7f7aaf566640 1 -- 172.21.15.18:0/1306723514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7aa815ed30 msgr2=0x7f7aa8070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:14.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.586+0000 7f7aaf566640 1 --2- 172.21.15.18:0/1306723514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7aa815ed30 0x7f7aa8070260 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4009870 tx=0x7f7aa402a2a0 comp rx=0 tx=0).stop 2024-09-19T09:24:14.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.586+0000 7f7aaf566640 1 -- 172.21.15.18:0/1306723514 shutdown_connections 2024-09-19T09:24:14.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.586+0000 7f7aaf566640 1 --2- 172.21.15.18:0/1306723514 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7aa81630f0 0x7f7aa80cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:14.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.586+0000 7f7aaf566640 1 --2- 172.21.15.18:0/1306723514 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7aa815ed30 0x7f7aa8070260 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:14.589 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.586+0000 7f7aaf566640 1 -- 172.21.15.18:0/1306723514 >> 172.21.15.18:0/1306723514 conn(0x7f7aa80b4600 msgr2=0x7f7aa80b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:14.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.586+0000 7f7aaf566640 1 -- 172.21.15.18:0/1306723514 shutdown_connections 2024-09-19T09:24:14.590 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.586+0000 7f7aaf566640 1 -- 172.21.15.18:0/1306723514 wait complete. 2024-09-19T09:24:14.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.587+0000 7f7aaf566640 1 Processor -- start 2024-09-19T09:24:14.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.587+0000 7f7aaf566640 1 -- start start 2024-09-19T09:24:14.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.588+0000 7f7aaf566640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7aa80b5200 0x7f7aa81f4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:14.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.588+0000 7f7aaf566640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7aa815ed30 0x7f7aa81550e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:14.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.588+0000 7f7aaf566640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7aa81630f0 0x7f7aa80b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:14.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.588+0000 7f7aaf566640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa8070f10 con 0x7f7aa80b5200 2024-09-19T09:24:14.592 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.588+0000 7f7aaf566640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa8070d90 con 0x7f7aa81630f0 2024-09-19T09:24:14.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.588+0000 7f7aaf566640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7aa815f110 con 0x7f7aa815ed30 2024-09-19T09:24:14.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.588+0000 7f7aad302640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7aa80b5200 0x7f7aa81f4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:14.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.588+0000 7f7aad302640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7aa80b5200 0x7f7aa81f4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47552/0 (socket says 172.21.15.18:47552) 2024-09-19T09:24:14.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.588+0000 7f7aad302640 1 -- 172.21.15.18:0/605942758 learned_addr learned my addr 172.21.15.18:0/605942758 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:14.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.588+0000 7f7aadb03640 1 --2- 172.21.15.18:0/605942758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7aa81630f0 0x7f7aa80b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:14.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.588+0000 7f7aacb01640 1 --2- 172.21.15.18:0/605942758 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7aa815ed30 0x7f7aa81550e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:14.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.589+0000 7f7aad302640 1 -- 172.21.15.18:0/605942758 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7aa815ed30 msgr2=0x7f7aa81550e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:14.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.589+0000 7f7aad302640 1 --2- 172.21.15.18:0/605942758 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7aa815ed30 0x7f7aa81550e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:14.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.589+0000 7f7aad302640 1 -- 172.21.15.18:0/605942758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7aa81630f0 msgr2=0x7f7aa80b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:14.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.589+0000 7f7aad302640 1 --2- 172.21.15.18:0/605942758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7aa81630f0 0x7f7aa80b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:14.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.589+0000 7f7aad302640 1 -- 172.21.15.18:0/605942758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa81f4c50 con 0x7f7aa80b5200 2024-09-19T09:24:14.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.589+0000 7f7aacb01640 1 --2- 172.21.15.18:0/605942758 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7aa815ed30 0x7f7aa81550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:14.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.589+0000 7f7aad302640 1 --2- 172.21.15.18:0/605942758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7aa80b5200 0x7f7aa81f4710 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4009870 tx=0x7f7aa40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:14.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.589+0000 7f7a9dffb640 1 -- 172.21.15.18:0/605942758 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4041070 con 0x7f7aa80b5200 2024-09-19T09:24:14.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.589+0000 7f7a9dffb640 1 -- 172.21.15.18:0/605942758 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7aa403c870 con 0x7f7aa80b5200 2024-09-19T09:24:14.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.589+0000 7f7aaf566640 1 -- 172.21.15.18:0/605942758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aa8155b80 con 0x7f7aa80b5200 2024-09-19T09:24:14.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.589+0000 7f7a9dffb640 1 -- 172.21.15.18:0/605942758 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4037040 con 0x7f7aa80b5200 2024-09-19T09:24:14.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.589+0000 7f7aaf566640 1 -- 172.21.15.18:0/605942758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aa8156140 con 0x7f7aa80b5200 2024-09-19T09:24:14.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.590+0000 7f7aaf566640 1 -- 172.21.15.18:0/605942758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7aa8070260 con 0x7f7aa80b5200 2024-09-19T09:24:14.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.591+0000 7f7a9dffb640 1 -- 172.21.15.18:0/605942758 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7aa4044070 con 0x7f7aa80b5200 2024-09-19T09:24:14.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.591+0000 7f7a9dffb640 1 --2- 172.21.15.18:0/605942758 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7a8c06c2b0 0x7f7a8c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:14.595 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.591+0000 7f7a9dffb640 1 -- 172.21.15.18:0/605942758 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5767+0+0 (secure 0 0 0) 0x7f7aa40abe70 con 0x7f7aa80b5200 2024-09-19T09:24:14.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.591+0000 7f7a9dffb640 1 -- 172.21.15.18:0/605942758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=172}) -- 0x7f7a8c073ea0 con 0x7f7aa80b5200 2024-09-19T09:24:14.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.591+0000 7f7aacb01640 1 --2- 172.21.15.18:0/605942758 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7a8c06c2b0 0x7f7a8c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:14.596 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.592+0000 7f7aacb01640 1 --2- 172.21.15.18:0/605942758 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7a8c06c2b0 0x7f7a8c06e770 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7aa80b8a70 tx=0x7f7a98009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:14.597 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.595+0000 7f7a9dffb640 1 -- 172.21.15.18:0/605942758 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7aa4079fe0 con 0x7f7aa80b5200 2024-09-19T09:24:14.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.773+0000 7f7aaf566640 1 -- 172.21.15.18:0/605942758 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7aa806f8f0 con 0x7f7aa80b5200 2024-09-19T09:24:14.776 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.774+0000 7f7a9dffb640 1 -- 172.21.15.18:0/605942758 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v171) ==== 74+0+16815 (secure 0 0 0) 0x7f7aa407e2e0 con 0x7f7aa80b5200 2024-09-19T09:24:14.776 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:24:14.777 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":171,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:23:46.266420+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:22:58.457161+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"166","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-19T09:22:59.786310+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.0","mappings":[{"from":2,"to":5}]},{"pgid":"21.1e","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:24:14.778 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.776+0000 7f7aaf566640 1 -- 172.21.15.18:0/605942758 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7a8c06c2b0 msgr2=0x7f7a8c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:14.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.776+0000 7f7aaf566640 1 --2- 172.21.15.18:0/605942758 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7a8c06c2b0 0x7f7a8c06e770 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7aa80b8a70 tx=0x7f7a98009040 comp rx=0 tx=0).stop 2024-09-19T09:24:14.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.776+0000 7f7aaf566640 1 -- 172.21.15.18:0/605942758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7aa80b5200 msgr2=0x7f7aa81f4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:14.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.776+0000 7f7aaf566640 1 --2- 172.21.15.18:0/605942758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7aa80b5200 0x7f7aa81f4710 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f7aa4009870 tx=0x7f7aa40046c0 comp rx=0 tx=0).stop 2024-09-19T09:24:14.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.776+0000 7f7aaf566640 1 -- 172.21.15.18:0/605942758 shutdown_connections 2024-09-19T09:24:14.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.776+0000 7f7aaf566640 1 --2- 172.21.15.18:0/605942758 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7a8c06c2b0 0x7f7a8c06e770 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:14.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.776+0000 7f7aaf566640 1 --2- 172.21.15.18:0/605942758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7aa81630f0 0x7f7aa80b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:14.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.776+0000 7f7aaf566640 1 --2- 172.21.15.18:0/605942758 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7aa815ed30 0x7f7aa81550e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:14.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.776+0000 7f7aaf566640 1 --2- 172.21.15.18:0/605942758 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7aa80b5200 0x7f7aa81f4710 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:14.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.776+0000 7f7aaf566640 1 -- 172.21.15.18:0/605942758 >> 172.21.15.18:0/605942758 conn(0x7f7aa80b4600 msgr2=0x7f7aa80afc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:14.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.776+0000 7f7aaf566640 1 -- 172.21.15.18:0/605942758 shutdown_connections 2024-09-19T09:24:14.779 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.776+0000 7f7aaf566640 1 -- 172.21.15.18:0/605942758 wait complete. 2024-09-19T09:24:14.789 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-19T09:24:14.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.892+0000 7f6d2ae77640 1 Processor -- start 2024-09-19T09:24:14.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.892+0000 7f6d2ae77640 1 -- start start 2024-09-19T09:24:14.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.893+0000 7f6d2ae77640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6d2415ee60 0x7f6d2406cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:14.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.893+0000 7f6d2ae77640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d2406de10 0x7f6d240b27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:14.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.893+0000 7f6d2ae77640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d240d19b0 con 0x7f6d240b5180 2024-09-19T09:24:14.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.893+0000 7f6d2ae77640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6d2415f240 con 0x7f6d2415ee60 2024-09-19T09:24:14.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.893+0000 7f6d2ae77640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6d240d1c90 con 0x7f6d2406de10 2024-09-19T09:24:14.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.893+0000 7f6d29414640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d2406de10 0x7f6d240b27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:14.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.893+0000 7f6d28c13640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6d2415ee60 0x7f6d2406cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:14.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.893+0000 7f6d23fff640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f6d240b5180 0x7f6d2406d700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:57152/0 (socket says 172.21.15.18:57152) 2024-09-19T09:24:14.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.893+0000 7f6d23fff640 1 -- 172.21.15.18:0/2104340906 learned_addr learned my addr 172.21.15.18:0/2104340906 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:24:14.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.894+0000 7f6d28c13640 1 -- 172.21.15.18:0/2104340906 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d2406de10 msgr2=0x7f6d240b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:14.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.894+0000 7f6d28c13640 1 --2- 172.21.15.18:0/2104340906 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d2406de10 0x7f6d240b27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:14.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.894+0000 7f6d28c13640 1 -- 172.21.15.18:0/2104340906 >> v1:172.21.15.162:6789/0 conn(0x7f6d240b5180 legacy=0x7f6d2406d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:14.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.894+0000 7f6d28c13640 1 -- 172.21.15.18:0/2104340906 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d240d1f70 con 0x7f6d2415ee60 2024-09-19T09:24:14.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.894+0000 7f6d237fe640 1 -- 172.21.15.18:0/2104340906 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2221719073 0 0) 0x7f6d240d19b0 con 0x7f6d240b5180 2024-09-19T09:24:14.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.894+0000 7f6d29414640 1 --2- 172.21.15.18:0/2104340906 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d2406de10 0x7f6d240b27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:24:14.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.894+0000 7f6d28c13640 1 --2- 172.21.15.18:0/2104340906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d2415ee60 0x7f6d2406cd20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6d180097d0 tx=0x7f6d1802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6784d1ca63c0f677 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:14.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.894+0000 7f6d237fe640 1 -- 172.21.15.18:0/2104340906 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d18037070 con 0x7f6d2415ee60 2024-09-19T09:24:14.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.895+0000 7f6d237fe640 1 -- 172.21.15.18:0/2104340906 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d18032440 con 0x7f6d2415ee60 2024-09-19T09:24:14.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.895+0000 7f6d237fe640 1 -- 172.21.15.18:0/2104340906 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d18032810 con 0x7f6d2415ee60 2024-09-19T09:24:14.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.895+0000 7f6d2ae77640 1 -- 172.21.15.18:0/2104340906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d2415ee60 msgr2=0x7f6d2406cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:14.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.895+0000 7f6d2ae77640 1 --2- 172.21.15.18:0/2104340906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d2415ee60 0x7f6d2406cd20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f6d180097d0 tx=0x7f6d1802a1c0 comp rx=0 tx=0).stop 2024-09-19T09:24:14.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.895+0000 7f6d2ae77640 1 -- 172.21.15.18:0/2104340906 shutdown_connections 2024-09-19T09:24:14.898 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.895+0000 7f6d2ae77640 1 --2- 172.21.15.18:0/2104340906 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d2406de10 0x7f6d240b27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:14.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.895+0000 7f6d2ae77640 1 --2- 172.21.15.18:0/2104340906 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d2415ee60 0x7f6d2406cd20 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:14.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.895+0000 7f6d2ae77640 1 -- 172.21.15.18:0/2104340906 >> 172.21.15.18:0/2104340906 conn(0x7f6d240b45f0 msgr2=0x7f6d240b4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:14.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.895+0000 7f6d2ae77640 1 -- 172.21.15.18:0/2104340906 shutdown_connections 2024-09-19T09:24:14.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.895+0000 7f6d2ae77640 1 -- 172.21.15.18:0/2104340906 wait complete. 2024-09-19T09:24:14.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.896+0000 7f6d2ae77640 1 Processor -- start 2024-09-19T09:24:14.899 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.896+0000 7f6d2ae77640 1 -- start start 2024-09-19T09:24:14.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.897+0000 7f6d2ae77640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d2406de10 0x7f6d240b77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:14.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.897+0000 7f6d2ae77640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d240b5180 0x7f6d241eaa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:14.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.897+0000 7f6d2ae77640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d2415ee60 0x7f6d240b5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:14.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.897+0000 7f6d2ae77640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6d240b2e70 con 0x7f6d2415ee60 2024-09-19T09:24:14.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.897+0000 7f6d2ae77640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6d240b2cf0 con 0x7f6d240b5180 2024-09-19T09:24:14.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.897+0000 7f6d2ae77640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6d240b2ff0 con 0x7f6d2406de10 2024-09-19T09:24:14.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.897+0000 7f6d29414640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d2415ee60 0x7f6d240b5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:14.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.897+0000 7f6d29414640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d2415ee60 0x7f6d240b5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47566/0 (socket says 172.21.15.18:47566) 2024-09-19T09:24:14.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.897+0000 7f6d29414640 1 -- 172.21.15.18:0/2189364235 learned_addr learned my addr 172.21.15.18:0/2189364235 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:14.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.898+0000 7f6d28c13640 1 --2- 172.21.15.18:0/2189364235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d2406de10 0x7f6d240b77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:14.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.898+0000 7f6d23fff640 1 --2- 172.21.15.18:0/2189364235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d240b5180 0x7f6d241eaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:14.902 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.898+0000 7f6d29414640 1 -- 172.21.15.18:0/2189364235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d2406de10 msgr2=0x7f6d240b77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:14.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.898+0000 7f6d29414640 1 --2- 172.21.15.18:0/2189364235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d2406de10 0x7f6d240b77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:14.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.898+0000 7f6d29414640 1 -- 172.21.15.18:0/2189364235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d240b5180 msgr2=0x7f6d241eaa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:14.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.898+0000 7f6d29414640 1 --2- 172.21.15.18:0/2189364235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d240b5180 0x7f6d241eaa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:14.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.898+0000 7f6d29414640 1 -- 172.21.15.18:0/2189364235 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d241e90b0 con 0x7f6d2415ee60 2024-09-19T09:24:14.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.898+0000 7f6d29414640 1 --2- 172.21.15.18:0/2189364235 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d2415ee60 0x7f6d240b5910 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c00efc0 tx=0x7f6d1c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:14.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.898+0000 7f6d217fa640 1 -- 172.21.15.18:0/2189364235 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c018030 con 0x7f6d2415ee60 2024-09-19T09:24:14.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.898+0000 7f6d217fa640 1 -- 172.21.15.18:0/2189364235 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d1c00cdf0 con 0x7f6d2415ee60 2024-09-19T09:24:14.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.898+0000 7f6d217fa640 1 -- 172.21.15.18:0/2189364235 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d1c003bb0 con 0x7f6d2415ee60 2024-09-19T09:24:14.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.898+0000 7f6d2ae77640 1 -- 172.21.15.18:0/2189364235 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d241e9390 con 0x7f6d2415ee60 2024-09-19T09:24:14.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.898+0000 7f6d2ae77640 1 -- 172.21.15.18:0/2189364235 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d241e9950 con 0x7f6d2415ee60 2024-09-19T09:24:14.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.899+0000 7f6d2ae77640 1 -- 172.21.15.18:0/2189364235 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d240d19b0 con 0x7f6d2415ee60 2024-09-19T09:24:14.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.900+0000 7f6d217fa640 1 -- 172.21.15.18:0/2189364235 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6d1c01b070 con 0x7f6d2415ee60 2024-09-19T09:24:14.903 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.900+0000 7f6d217fa640 1 --2- 172.21.15.18:0/2189364235 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6d0806c2b0 0x7f6d0806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:14.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.900+0000 7f6d217fa640 1 -- 172.21.15.18:0/2189364235 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(171..171 src has 1..171) ==== 5767+0+0 (secure 0 0 0) 0x7f6d1c08bed0 con 0x7f6d2415ee60 2024-09-19T09:24:14.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.900+0000 7f6d217fa640 1 -- 172.21.15.18:0/2189364235 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=172}) -- 0x7f6d08073ea0 con 0x7f6d2415ee60 2024-09-19T09:24:14.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.900+0000 7f6d28c13640 1 --2- 172.21.15.18:0/2189364235 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6d0806c2b0 0x7f6d0806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:14.904 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.901+0000 7f6d28c13640 1 --2- 172.21.15.18:0/2189364235 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6d0806c2b0 0x7f6d0806e770 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f6d18034000 tx=0x7f6d1802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:14.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:14.905+0000 7f6d217fa640 1 -- 172.21.15.18:0/2189364235 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6d1c010040 con 0x7f6d2415ee60 2024-09-19T09:24:15.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.119+0000 7f6d2ae77640 1 -- 172.21.15.18:0/2189364235 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f6d240b8a40 con 0x7f6d2415ee60 2024-09-19T09:24:15.122 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-19T09:24:15.120+0000 7fca8a79c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:24:15.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.121+0000 7f6d217fa640 1 -- 172.21.15.18:0/2189364235 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v75) ==== 161+0+0 (secure 0 0 0) 0x7f6d1c05a600 con 0x7f6d2415ee60 2024-09-19T09:24:15.123 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T09:24:15.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.122+0000 7f6d217fa640 1 -- 172.21.15.18:0/2189364235 <== mon.0 v2:172.21.15.18:3300/0 8 ==== osd_map(172..172 src has 1..172) ==== 374+0+0 (secure 0 0 0) 0x7f6d1c08a4d0 con 0x7f6d2415ee60 2024-09-19T09:24:15.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.122+0000 7f6d217fa640 1 -- 172.21.15.18:0/2189364235 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=173}) -- 0x7f6d08074870 con 0x7f6d2415ee60 2024-09-19T09:24:15.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.125+0000 7f6d2ae77640 1 -- 172.21.15.18:0/2189364235 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6d0806c2b0 msgr2=0x7f6d0806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:15.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.125+0000 7f6d2ae77640 1 --2- 172.21.15.18:0/2189364235 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6d0806c2b0 0x7f6d0806e770 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f6d18034000 tx=0x7f6d1802e000 comp rx=0 tx=0).stop 2024-09-19T09:24:15.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.125+0000 7f6d2ae77640 1 -- 172.21.15.18:0/2189364235 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d2415ee60 msgr2=0x7f6d240b5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:15.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.125+0000 7f6d2ae77640 1 --2- 172.21.15.18:0/2189364235 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d2415ee60 0x7f6d240b5910 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f6d1c00efc0 tx=0x7f6d1c00c490 comp rx=0 tx=0).stop 2024-09-19T09:24:15.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.125+0000 7f6d2ae77640 1 -- 172.21.15.18:0/2189364235 shutdown_connections 2024-09-19T09:24:15.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.125+0000 7f6d2ae77640 1 --2- 172.21.15.18:0/2189364235 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6d0806c2b0 0x7f6d0806e770 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:15.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.125+0000 7f6d2ae77640 1 --2- 172.21.15.18:0/2189364235 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d2415ee60 0x7f6d240b5910 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:15.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.125+0000 7f6d2ae77640 1 --2- 172.21.15.18:0/2189364235 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d240b5180 0x7f6d241eaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:15.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.125+0000 7f6d2ae77640 1 --2- 172.21.15.18:0/2189364235 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d2406de10 0x7f6d240b77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:15.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.125+0000 7f6d2ae77640 1 -- 172.21.15.18:0/2189364235 >> 172.21.15.18:0/2189364235 conn(0x7f6d240b45f0 msgr2=0x7f6d240700a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:15.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.125+0000 7f6d2ae77640 1 -- 172.21.15.18:0/2189364235 shutdown_connections 2024-09-19T09:24:15.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.125+0000 7f6d2ae77640 1 -- 172.21.15.18:0/2189364235 wait complete. 2024-09-19T09:24:15.139 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T09:24:15.163 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-09-19T09:24:15.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.242+0000 7f0949e77640 1 Processor -- start 2024-09-19T09:24:15.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.242+0000 7f0949e77640 1 -- start start 2024-09-19T09:24:15.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.243+0000 7f0949e77640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f09440afa90 0x7f094406f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:15.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.243+0000 7f0949e77640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09440b4300 con 0x7f09440d0630 2024-09-19T09:24:15.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.243+0000 7f0949e77640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f094406d700 con 0x7f094415b760 2024-09-19T09:24:15.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.243+0000 7f0949e77640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f094406d9e0 con 0x7f09440afa90 2024-09-19T09:24:15.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.243+0000 7f0942ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f09440afa90 0x7f094406f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:15.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.243+0000 7f0943fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f09440d0630 0x7f09440d0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:40574/0 (socket says 172.21.15.18:40574) 2024-09-19T09:24:15.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.243+0000 7f0942ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f09440afa90 0x7f094406f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47590/0 (socket says 172.21.15.18:47590) 2024-09-19T09:24:15.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.243+0000 7f0943fff640 1 -- 172.21.15.18:0/3553814209 learned_addr learned my addr 172.21.15.18:0/3553814209 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:24:15.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.243+0000 7f0942ffd640 1 -- 172.21.15.18:0/3553814209 >> v1:172.21.15.162:6789/0 conn(0x7f094415b760 legacy=0x7f09440b4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:15.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.243+0000 7f0942ffd640 1 -- 172.21.15.18:0/3553814209 >> v1:172.21.15.18:6789/0 conn(0x7f09440d0630 legacy=0x7f09440d0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:15.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.243+0000 7f09427fc640 1 -- 172.21.15.18:0/3553814209 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 636790142 0 0) 0x7f09440b4300 con 0x7f09440d0630 2024-09-19T09:24:15.246 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.243+0000 7f0942ffd640 1 -- 172.21.15.18:0/3553814209 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09440b4570 con 0x7f09440afa90 2024-09-19T09:24:15.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.244+0000 7f0942ffd640 1 --2- 172.21.15.18:0/3553814209 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09440afa90 0x7f094406f290 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f09380097a0 tx=0x7f093802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6211752e48041622 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:15.247 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.244+0000 7f09427fc640 1 -- 172.21.15.18:0/3553814209 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0938037070 con 0x7f09440afa90 2024-09-19T09:24:15.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.244+0000 7f09427fc640 1 -- 172.21.15.18:0/3553814209 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0938032440 con 0x7f09440afa90 2024-09-19T09:24:15.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.244+0000 7f09427fc640 1 -- 172.21.15.18:0/3553814209 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093802ae60 con 0x7f09440afa90 2024-09-19T09:24:15.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.245+0000 7f0949e77640 1 -- 172.21.15.18:0/3553814209 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09440afa90 msgr2=0x7f094406f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:15.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.245+0000 7f0949e77640 1 --2- 172.21.15.18:0/3553814209 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09440afa90 0x7f094406f290 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f09380097a0 tx=0x7f093802a110 comp rx=0 tx=0).stop 2024-09-19T09:24:15.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.245+0000 7f0949e77640 1 -- 172.21.15.18:0/3553814209 shutdown_connections 2024-09-19T09:24:15.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.245+0000 7f0949e77640 1 --2- 172.21.15.18:0/3553814209 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09440afa90 0x7f094406f290 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:15.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.245+0000 7f0949e77640 1 -- 172.21.15.18:0/3553814209 >> 172.21.15.18:0/3553814209 conn(0x7f094406bc10 msgr2=0x7f094406c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:15.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.245+0000 7f0949e77640 1 -- 172.21.15.18:0/3553814209 shutdown_connections 2024-09-19T09:24:15.248 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.245+0000 7f0949e77640 1 -- 172.21.15.18:0/3553814209 wait complete. 2024-09-19T09:24:15.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.246+0000 7f0949e77640 1 Processor -- start 2024-09-19T09:24:15.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.246+0000 7f0949e77640 1 -- start start 2024-09-19T09:24:15.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.247+0000 7f0949e77640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09440afa90 0x7f0944073150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:15.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.247+0000 7f0949e77640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09440d0630 0x7f0944071760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:15.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.247+0000 7f0949e77640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f094415b760 0x7f09440ae840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:15.250 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.247+0000 7f0949e77640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f094415bcc0 con 0x7f09440d0630 2024-09-19T09:24:15.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.247+0000 7f0949e77640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f094415bb40 con 0x7f09440afa90 2024-09-19T09:24:15.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.247+0000 7f0949e77640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f094406dcc0 con 0x7f094415b760 2024-09-19T09:24:15.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.247+0000 7f0942ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09440d0630 0x7f0944071760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:15.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.247+0000 7f0942ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09440d0630 0x7f0944071760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:47592/0 (socket says 172.21.15.18:47592) 2024-09-19T09:24:15.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.247+0000 7f0942ffd640 1 -- 172.21.15.18:0/693738157 learned_addr learned my addr 172.21.15.18:0/693738157 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:15.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.247+0000 7f0942ffd640 1 -- 172.21.15.18:0/693738157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f094415b760 msgr2=0x7f09440ae840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:15.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.247+0000 7f0942ffd640 1 --2- 172.21.15.18:0/693738157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f094415b760 0x7f09440ae840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:15.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.247+0000 7f0942ffd640 1 -- 172.21.15.18:0/693738157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09440afa90 msgr2=0x7f0944073150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:15.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.247+0000 7f0942ffd640 1 --2- 172.21.15.18:0/693738157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09440afa90 0x7f0944073150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:15.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.247+0000 7f0942ffd640 1 -- 172.21.15.18:0/693738157 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09440720b0 con 0x7f09440d0630 2024-09-19T09:24:15.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.248+0000 7f0942ffd640 1 --2- 172.21.15.18:0/693738157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09440d0630 0x7f0944071760 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f093802a700 tx=0x7f09380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:15.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.248+0000 7f092bfff640 1 -- 172.21.15.18:0/693738157 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0938037040 con 0x7f09440d0630 2024-09-19T09:24:15.251 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.248+0000 7f092bfff640 1 -- 172.21.15.18:0/693738157 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0938042070 con 0x7f09440d0630 2024-09-19T09:24:15.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.248+0000 7f0949e77640 1 -- 172.21.15.18:0/693738157 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0944072390 con 0x7f09440d0630 2024-09-19T09:24:15.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.248+0000 7f092bfff640 1 -- 172.21.15.18:0/693738157 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0938030c70 con 0x7f09440d0630 2024-09-19T09:24:15.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.248+0000 7f0949e77640 1 -- 172.21.15.18:0/693738157 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0944072950 con 0x7f09440d0630 2024-09-19T09:24:15.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.249+0000 7f0949e77640 1 -- 172.21.15.18:0/693738157 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f094406f290 con 0x7f09440d0630 2024-09-19T09:24:15.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.250+0000 7f092bfff640 1 -- 172.21.15.18:0/693738157 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0938047460 con 0x7f09440d0630 2024-09-19T09:24:15.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.250+0000 7f092bfff640 1 --2- 172.21.15.18:0/693738157 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f093006c2b0 0x7f093006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:15.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.250+0000 7f092bfff640 1 -- 172.21.15.18:0/693738157 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(172..172 src has 1..172) ==== 5853+0+0 (secure 0 0 0) 0x7f09380ac220 con 0x7f09440d0630 2024-09-19T09:24:15.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.250+0000 7f092bfff640 1 -- 172.21.15.18:0/693738157 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=173}) -- 0x7f0930073fb0 con 0x7f09440d0630 2024-09-19T09:24:15.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.250+0000 7f09437fe640 1 --2- 172.21.15.18:0/693738157 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f093006c2b0 0x7f093006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:15.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.251+0000 7f09437fe640 1 --2- 172.21.15.18:0/693738157 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f093006c2b0 0x7f093006e770 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f0934000f60 tx=0x7f09340079b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:15.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.254+0000 7f092bfff640 1 -- 172.21.15.18:0/693738157 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f0938097e20 con 0x7f09440d0630 2024-09-19T09:24:15.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:15.470+0000 7f0949e77640 1 -- 172.21.15.18:0/693738157 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f0944150670 con 0x7f09440d0630 2024-09-19T09:24:16.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.127+0000 7f092bfff640 1 -- 172.21.15.18:0/693738157 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v76) ==== 104+0+0 (secure 0 0 0) 0x7f0938045360 con 0x7f09440d0630 2024-09-19T09:24:16.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.130+0000 7f0949e77640 1 -- 172.21.15.18:0/693738157 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f093006c2b0 msgr2=0x7f093006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:16.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.130+0000 7f0949e77640 1 --2- 172.21.15.18:0/693738157 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f093006c2b0 0x7f093006e770 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f0934000f60 tx=0x7f09340079b0 comp rx=0 tx=0).stop 2024-09-19T09:24:16.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.130+0000 7f0949e77640 1 -- 172.21.15.18:0/693738157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09440d0630 msgr2=0x7f0944071760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:16.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.130+0000 7f0949e77640 1 --2- 172.21.15.18:0/693738157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09440d0630 0x7f0944071760 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f093802a700 tx=0x7f09380046c0 comp rx=0 tx=0).stop 2024-09-19T09:24:16.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.130+0000 7f0949e77640 1 -- 172.21.15.18:0/693738157 shutdown_connections 2024-09-19T09:24:16.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.130+0000 7f0949e77640 1 --2- 172.21.15.18:0/693738157 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f093006c2b0 0x7f093006e770 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:16.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.130+0000 7f0949e77640 1 --2- 172.21.15.18:0/693738157 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f094415b760 0x7f09440ae840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:16.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.130+0000 7f0949e77640 1 --2- 172.21.15.18:0/693738157 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f09440d0630 0x7f0944071760 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:16.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.130+0000 7f0949e77640 1 --2- 172.21.15.18:0/693738157 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f09440afa90 0x7f0944073150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:16.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.130+0000 7f0949e77640 1 -- 172.21.15.18:0/693738157 >> 172.21.15.18:0/693738157 conn(0x7f094406bc10 msgr2=0x7f0944074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:16.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.130+0000 7f0949e77640 1 -- 172.21.15.18:0/693738157 shutdown_connections 2024-09-19T09:24:16.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.130+0000 7f0949e77640 1 -- 172.21.15.18:0/693738157 wait complete. 2024-09-19T09:24:16.146 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T09:24:16.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.300+0000 7f4de5ed2640 1 Processor -- start 2024-09-19T09:24:16.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.300+0000 7f4de5ed2640 1 -- start start 2024-09-19T09:24:16.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.300+0000 7f4de5ed2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4de00ced50 0x7f4de0072680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:16.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.300+0000 7f4de5ed2640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4de0144980 0x7f4de0072bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:16.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.300+0000 7f4de5ed2640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4de0160310 con 0x7f4de01445a0 2024-09-19T09:24:16.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.300+0000 7f4de5ed2640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4de00b4d20 con 0x7f4de0144980 2024-09-19T09:24:16.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.300+0000 7f4de5ed2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4de015fdd0 con 0x7f4de00ced50 2024-09-19T09:24:16.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.301+0000 7f4ddeffd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4de00ced50 0x7f4de0072680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:16.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.301+0000 7f4ddffff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4de0144980 0x7f4de0072bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:16.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.301+0000 7f4ddf7fe640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f4de01445a0 0x7f4de00cd380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:48832/0 (socket says 172.21.15.18:48832) 2024-09-19T09:24:16.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.301+0000 7f4ddeffd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4de00ced50 0x7f4de0072680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:59682/0 (socket says 172.21.15.18:59682) 2024-09-19T09:24:16.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.301+0000 7f4ddf7fe640 1 -- 172.21.15.18:0/3976583231 learned_addr learned my addr 172.21.15.18:0/3976583231 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:24:16.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.301+0000 7f4ddffff640 1 --2- 172.21.15.18:0/3976583231 >> v2:172.21.15.162:3300/0 conn(0x7f4de0144980 0x7f4de0072bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:41308/0 (socket says 172.21.15.18:41308) 2024-09-19T09:24:16.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.301+0000 7f4ddffff640 1 -- 172.21.15.18:0/3976583231 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4de00ced50 msgr2=0x7f4de0072680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:16.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.301+0000 7f4ddffff640 1 --2- 172.21.15.18:0/3976583231 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4de00ced50 0x7f4de0072680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:16.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.301+0000 7f4ddffff640 1 -- 172.21.15.18:0/3976583231 >> v1:172.21.15.162:6789/0 conn(0x7f4de01445a0 legacy=0x7f4de00cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:16.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.301+0000 7f4ddffff640 1 -- 172.21.15.18:0/3976583231 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de0160030 con 0x7f4de0144980 2024-09-19T09:24:16.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.301+0000 7f4dde7fc640 1 -- 172.21.15.18:0/3976583231 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3186778303 0 0) 0x7f4de0160310 con 0x7f4de01445a0 2024-09-19T09:24:16.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.301+0000 7f4ddeffd640 1 --2- 172.21.15.18:0/3976583231 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4de00ced50 0x7f4de0072680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:24:16.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.302+0000 7f4ddffff640 1 --2- 172.21.15.18:0/3976583231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4de0144980 0x7f4de0072bc0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8009dc0 tx=0x7f4dd802a560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ab4a226c7324853 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:16.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.302+0000 7f4dde7fc640 1 -- 172.21.15.18:0/3976583231 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8007740 con 0x7f4de0144980 2024-09-19T09:24:16.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.302+0000 7f4dde7fc640 1 -- 172.21.15.18:0/3976583231 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dd80078e0 con 0x7f4de0144980 2024-09-19T09:24:16.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.302+0000 7f4dde7fc640 1 -- 172.21.15.18:0/3976583231 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8007cb0 con 0x7f4de0144980 2024-09-19T09:24:16.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.303+0000 7f4de5ed2640 1 -- 172.21.15.18:0/3976583231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4de0144980 msgr2=0x7f4de0072bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:16.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.303+0000 7f4de5ed2640 1 --2- 172.21.15.18:0/3976583231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4de0144980 0x7f4de0072bc0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8009dc0 tx=0x7f4dd802a560 comp rx=0 tx=0).stop 2024-09-19T09:24:16.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.303+0000 7f4de5ed2640 1 -- 172.21.15.18:0/3976583231 shutdown_connections 2024-09-19T09:24:16.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.303+0000 7f4de5ed2640 1 --2- 172.21.15.18:0/3976583231 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4de00ced50 0x7f4de0072680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:16.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.303+0000 7f4de5ed2640 1 --2- 172.21.15.18:0/3976583231 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4de0144980 0x7f4de0072bc0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:16.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.303+0000 7f4de5ed2640 1 -- 172.21.15.18:0/3976583231 >> 172.21.15.18:0/3976583231 conn(0x7f4de00b26a0 msgr2=0x7f4de00b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:16.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.303+0000 7f4de5ed2640 1 -- 172.21.15.18:0/3976583231 shutdown_connections 2024-09-19T09:24:16.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.303+0000 7f4de5ed2640 1 -- 172.21.15.18:0/3976583231 wait complete. 2024-09-19T09:24:16.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.304+0000 7f4de5ed2640 1 Processor -- start 2024-09-19T09:24:16.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.304+0000 7f4de5ed2640 1 -- start start 2024-09-19T09:24:16.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.305+0000 7f4de5ed2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4de00ced50 0x7f4de013f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:16.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.305+0000 7f4de5ed2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4de01445a0 0x7f4de013f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:16.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.305+0000 7f4de5ed2640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4de0144980 0x7f4de00cf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:16.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.305+0000 7f4de5ed2640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4de00b5c20 con 0x7f4de00ced50 2024-09-19T09:24:16.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.305+0000 7f4de5ed2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4de00b5f00 con 0x7f4de01445a0 2024-09-19T09:24:16.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.305+0000 7f4de5ed2640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4de0144ec0 con 0x7f4de0144980 2024-09-19T09:24:16.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.305+0000 7f4ddf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4de00ced50 0x7f4de013f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:16.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.305+0000 7f4ddf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4de00ced50 0x7f4de013f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55958/0 (socket says 172.21.15.18:55958) 2024-09-19T09:24:16.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.305+0000 7f4ddf7fe640 1 -- 172.21.15.18:0/2637765509 learned_addr learned my addr 172.21.15.18:0/2637765509 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:16.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.306+0000 7f4ddeffd640 1 --2- 172.21.15.18:0/2637765509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4de01445a0 0x7f4de013f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:16.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.306+0000 7f4ddffff640 1 --2- 172.21.15.18:0/2637765509 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4de0144980 0x7f4de00cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:16.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.306+0000 7f4ddf7fe640 1 -- 172.21.15.18:0/2637765509 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4de0144980 msgr2=0x7f4de00cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:16.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.306+0000 7f4ddf7fe640 1 --2- 172.21.15.18:0/2637765509 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4de0144980 0x7f4de00cf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:16.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.306+0000 7f4ddf7fe640 1 -- 172.21.15.18:0/2637765509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4de01445a0 msgr2=0x7f4de013f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:16.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.306+0000 7f4ddf7fe640 1 --2- 172.21.15.18:0/2637765509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4de01445a0 0x7f4de013f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:16.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.306+0000 7f4ddf7fe640 1 -- 172.21.15.18:0/2637765509 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de01f48f0 con 0x7f4de00ced50 2024-09-19T09:24:16.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.306+0000 7f4ddeffd640 1 --2- 172.21.15.18:0/2637765509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4de01445a0 0x7f4de013f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:16.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.306+0000 7f4ddffff640 1 --2- 172.21.15.18:0/2637765509 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4de0144980 0x7f4de00cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:16.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.306+0000 7f4ddf7fe640 1 --2- 172.21.15.18:0/2637765509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4de00ced50 0x7f4de013f350 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f4dd000c500 tx=0x7f4dd000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:16.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.306+0000 7f4dc7fff640 1 -- 172.21.15.18:0/2637765509 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd0018070 con 0x7f4de00ced50 2024-09-19T09:24:16.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.306+0000 7f4dc7fff640 1 -- 172.21.15.18:0/2637765509 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dd0007580 con 0x7f4de00ced50 2024-09-19T09:24:16.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.306+0000 7f4de5ed2640 1 -- 172.21.15.18:0/2637765509 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4de01f4bd0 con 0x7f4de00ced50 2024-09-19T09:24:16.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.306+0000 7f4dc7fff640 1 -- 172.21.15.18:0/2637765509 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd0004a20 con 0x7f4de00ced50 2024-09-19T09:24:16.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.306+0000 7f4de5ed2640 1 -- 172.21.15.18:0/2637765509 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4de01f5190 con 0x7f4de00ced50 2024-09-19T09:24:16.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.307+0000 7f4de5ed2640 1 -- 172.21.15.18:0/2637765509 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4de0160200 con 0x7f4de00ced50 2024-09-19T09:24:16.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.308+0000 7f4dc7fff640 1 -- 172.21.15.18:0/2637765509 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4dd0004bc0 con 0x7f4de00ced50 2024-09-19T09:24:16.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.308+0000 7f4dc7fff640 1 --2- 172.21.15.18:0/2637765509 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4dcc06c2e0 0x7f4dcc06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:16.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.308+0000 7f4dc7fff640 1 -- 172.21.15.18:0/2637765509 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(172..172 src has 1..172) ==== 5853+0+0 (secure 0 0 0) 0x7f4dd008a750 con 0x7f4de00ced50 2024-09-19T09:24:16.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.308+0000 7f4dc7fff640 1 -- 172.21.15.18:0/2637765509 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=173}) -- 0x7f4dcc073fd0 con 0x7f4de00ced50 2024-09-19T09:24:16.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.308+0000 7f4ddeffd640 1 --2- 172.21.15.18:0/2637765509 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4dcc06c2e0 0x7f4dcc06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:16.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.309+0000 7f4ddeffd640 1 --2- 172.21.15.18:0/2637765509 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4dcc06c2e0 0x7f4dcc06e7a0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4de00cf150 tx=0x7f4dd4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:16.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.313+0000 7f4dc7fff640 1 -- 172.21.15.18:0/2637765509 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f4de0160200 con 0x7f4de00ced50 2024-09-19T09:24:16.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:16.487+0000 7f4de5ed2640 1 -- 172.21.15.18:0/2637765509 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4de015bc00 con 0x7f4de00ced50 2024-09-19T09:24:17.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.128+0000 7f4dc7fff640 1 -- 172.21.15.18:0/2637765509 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v173) ==== 181+0+0 (secure 0 0 0) 0x7f4dd0058e40 con 0x7f4de00ced50 2024-09-19T09:24:17.131 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' removed 2024-09-19T09:24:17.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.129+0000 7f4dc7fff640 1 -- 172.21.15.18:0/2637765509 <== mon.0 v2:172.21.15.18:3300/0 8 ==== osd_map(173..173 src has 1..173) ==== 296+0+0 (secure 0 0 0) 0x7f4dd0088d00 con 0x7f4de00ced50 2024-09-19T09:24:17.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.129+0000 7f4dc7fff640 1 -- 172.21.15.18:0/2637765509 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=174}) -- 0x7f4dcc072400 con 0x7f4de00ced50 2024-09-19T09:24:17.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.134+0000 7f4de5ed2640 1 -- 172.21.15.18:0/2637765509 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4dcc06c2e0 msgr2=0x7f4dcc06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:17.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.134+0000 7f4de5ed2640 1 --2- 172.21.15.18:0/2637765509 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4dcc06c2e0 0x7f4dcc06e7a0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f4de00cf150 tx=0x7f4dd4008040 comp rx=0 tx=0).stop 2024-09-19T09:24:17.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.134+0000 7f4de5ed2640 1 -- 172.21.15.18:0/2637765509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4de00ced50 msgr2=0x7f4de013f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:17.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.134+0000 7f4de5ed2640 1 --2- 172.21.15.18:0/2637765509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4de00ced50 0x7f4de013f350 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f4dd000c500 tx=0x7f4dd000c9c0 comp rx=0 tx=0).stop 2024-09-19T09:24:17.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.135+0000 7f4de5ed2640 1 -- 172.21.15.18:0/2637765509 shutdown_connections 2024-09-19T09:24:17.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.135+0000 7f4de5ed2640 1 --2- 172.21.15.18:0/2637765509 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4dcc06c2e0 0x7f4dcc06e7a0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:17.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.135+0000 7f4de5ed2640 1 --2- 172.21.15.18:0/2637765509 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4de0144980 0x7f4de00cf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:17.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.135+0000 7f4de5ed2640 1 --2- 172.21.15.18:0/2637765509 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4de01445a0 0x7f4de013f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:17.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.135+0000 7f4de5ed2640 1 --2- 172.21.15.18:0/2637765509 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4de00ced50 0x7f4de013f350 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:17.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.135+0000 7f4de5ed2640 1 -- 172.21.15.18:0/2637765509 >> 172.21.15.18:0/2637765509 conn(0x7f4de00b26a0 msgr2=0x7f4de01409f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:17.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.136+0000 7f4de5ed2640 1 -- 172.21.15.18:0/2637765509 shutdown_connections 2024-09-19T09:24:17.138 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.136+0000 7f4de5ed2640 1 -- 172.21.15.18:0/2637765509 wait complete. 2024-09-19T09:24:17.150 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T09:24:17.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.259+0000 7fbfbd103640 1 Processor -- start 2024-09-19T09:24:17.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.259+0000 7fbfbd103640 1 -- start start 2024-09-19T09:24:17.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.260+0000 7fbfbd103640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbfb81600d0 0x7fbfb80b0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:17.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.260+0000 7fbfbd103640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbfb80b0d80 0x7fbfb806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:17.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.260+0000 7fbfbd103640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfb806c560 con 0x7fbfb806c150 2024-09-19T09:24:17.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.260+0000 7fbfbd103640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fbfb806f670 con 0x7fbfb80b0d80 2024-09-19T09:24:17.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.260+0000 7fbfbd103640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fbfb81604b0 con 0x7fbfb81600d0 2024-09-19T09:24:17.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.260+0000 7fbfb659c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fbfb80b0d80 0x7fbfb806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:17.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.260+0000 7fbfb759e640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fbfb806c150 0x7fbfb8160740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54556/0 (socket says 172.21.15.18:54556) 2024-09-19T09:24:17.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.260+0000 7fbfb759e640 1 -- 172.21.15.18:0/3112521776 learned_addr learned my addr 172.21.15.18:0/3112521776 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:24:17.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.260+0000 7fbfb6d9d640 1 --2- 172.21.15.18:0/3112521776 >> v2:172.21.15.162:3300/0 conn(0x7fbfb81600d0 0x7fbfb80b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:17.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.260+0000 7fbfb659c640 1 -- 172.21.15.18:0/3112521776 >> v2:172.21.15.162:3300/0 conn(0x7fbfb81600d0 msgr2=0x7fbfb80b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:17.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.260+0000 7fbfb659c640 1 --2- 172.21.15.18:0/3112521776 >> v2:172.21.15.162:3300/0 conn(0x7fbfb81600d0 0x7fbfb80b0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:17.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.260+0000 7fbfb659c640 1 -- 172.21.15.18:0/3112521776 >> v1:172.21.15.18:6789/0 conn(0x7fbfb806c150 legacy=0x7fbfb8160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:17.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.260+0000 7fbfb5d9b640 1 -- 172.21.15.18:0/3112521776 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2652455112 0 0) 0x7fbfb0001110 con 0x7fbfb806c150 2024-09-19T09:24:17.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.260+0000 7fbfb659c640 1 -- 172.21.15.18:0/3112521776 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb806fe40 con 0x7fbfb80b0d80 2024-09-19T09:24:17.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.260+0000 7fbfb659c640 1 --2- 172.21.15.18:0/3112521776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfb80b0d80 0x7fbfb806bc10 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fbfb80d28f0 tx=0x7fbfa002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a5236fd8df99bd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:17.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.260+0000 7fbfb5d9b640 1 -- 172.21.15.18:0/3112521776 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0037070 con 0x7fbfb80b0d80 2024-09-19T09:24:17.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.260+0000 7fbfb5d9b640 1 -- 172.21.15.18:0/3112521776 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfa0032440 con 0x7fbfb80b0d80 2024-09-19T09:24:17.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.260+0000 7fbfb5d9b640 1 -- 172.21.15.18:0/3112521776 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0032810 con 0x7fbfb80b0d80 2024-09-19T09:24:17.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.261+0000 7fbfbd103640 1 -- 172.21.15.18:0/3112521776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfb80b0d80 msgr2=0x7fbfb806bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:17.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.261+0000 7fbfbd103640 1 --2- 172.21.15.18:0/3112521776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfb80b0d80 0x7fbfb806bc10 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fbfb80d28f0 tx=0x7fbfa002a1a0 comp rx=0 tx=0).stop 2024-09-19T09:24:17.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.261+0000 7fbfbd103640 1 -- 172.21.15.18:0/3112521776 shutdown_connections 2024-09-19T09:24:17.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.261+0000 7fbfbd103640 1 --2- 172.21.15.18:0/3112521776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfb80b0d80 0x7fbfb806bc10 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:17.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.261+0000 7fbfbd103640 1 --2- 172.21.15.18:0/3112521776 >> v2:172.21.15.162:3300/0 conn(0x7fbfb81600d0 0x7fbfb80b0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:17.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.261+0000 7fbfbd103640 1 -- 172.21.15.18:0/3112521776 >> 172.21.15.18:0/3112521776 conn(0x7fbfb806cd20 msgr2=0x7fbfb806d130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:17.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.261+0000 7fbfbd103640 1 -- 172.21.15.18:0/3112521776 shutdown_connections 2024-09-19T09:24:17.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.261+0000 7fbfbd103640 1 -- 172.21.15.18:0/3112521776 wait complete. 2024-09-19T09:24:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.262+0000 7fbfbd103640 1 Processor -- start 2024-09-19T09:24:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.262+0000 7fbfbd103640 1 -- start start 2024-09-19T09:24:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.263+0000 7fbfbd103640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfb806c150 0x7fbfb81f83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.263+0000 7fbfbd103640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfb80b0d80 0x7fbfb8148a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.263+0000 7fbfbd103640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfb81600d0 0x7fbfb814a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.263+0000 7fbfbd103640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb80d2130 con 0x7fbfb81600d0 2024-09-19T09:24:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.263+0000 7fbfbd103640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb80703e0 con 0x7fbfb80b0d80 2024-09-19T09:24:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.263+0000 7fbfbd103640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbfb80d2410 con 0x7fbfb806c150 2024-09-19T09:24:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.263+0000 7fbfb759e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfb81600d0 0x7fbfb814a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.263+0000 7fbfb759e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfb81600d0 0x7fbfb814a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55974/0 (socket says 172.21.15.18:55974) 2024-09-19T09:24:17.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.263+0000 7fbfb759e640 1 -- 172.21.15.18:0/2800000600 learned_addr learned my addr 172.21.15.18:0/2800000600 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:17.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.263+0000 7fbfb659c640 1 --2- 172.21.15.18:0/2800000600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfb80b0d80 0x7fbfb8148a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:17.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.263+0000 7fbfb6d9d640 1 --2- 172.21.15.18:0/2800000600 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfb806c150 0x7fbfb81f83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:17.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.264+0000 7fbfb759e640 1 -- 172.21.15.18:0/2800000600 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfb806c150 msgr2=0x7fbfb81f83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:17.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.264+0000 7fbfb759e640 1 --2- 172.21.15.18:0/2800000600 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfb806c150 0x7fbfb81f83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:17.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.264+0000 7fbfb759e640 1 -- 172.21.15.18:0/2800000600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfb80b0d80 msgr2=0x7fbfb8148a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:17.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.264+0000 7fbfb759e640 1 --2- 172.21.15.18:0/2800000600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfb80b0d80 0x7fbfb8148a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:17.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.264+0000 7fbfb759e640 1 -- 172.21.15.18:0/2800000600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb81f8910 con 0x7fbfb81600d0 2024-09-19T09:24:17.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.264+0000 7fbfb659c640 1 --2- 172.21.15.18:0/2800000600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfb80b0d80 0x7fbfb8148a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:17.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.264+0000 7fbfb759e640 1 --2- 172.21.15.18:0/2800000600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfb81600d0 0x7fbfb814a2f0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fbfb000c780 tx=0x7fbfb000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:17.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.264+0000 7fbfaf7fe640 1 -- 172.21.15.18:0/2800000600 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb0018070 con 0x7fbfb81600d0 2024-09-19T09:24:17.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.264+0000 7fbfbd103640 1 -- 172.21.15.18:0/2800000600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb8148fb0 con 0x7fbfb81600d0 2024-09-19T09:24:17.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.264+0000 7fbfaf7fe640 1 -- 172.21.15.18:0/2800000600 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfb00070d0 con 0x7fbfb81600d0 2024-09-19T09:24:17.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.264+0000 7fbfaf7fe640 1 -- 172.21.15.18:0/2800000600 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfb00074c0 con 0x7fbfb81600d0 2024-09-19T09:24:17.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.264+0000 7fbfbd103640 1 -- 172.21.15.18:0/2800000600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb80b6070 con 0x7fbfb81600d0 2024-09-19T09:24:17.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.265+0000 7fbfbd103640 1 -- 172.21.15.18:0/2800000600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfb80b1190 con 0x7fbfb81600d0 2024-09-19T09:24:17.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.265+0000 7fbfaf7fe640 1 -- 172.21.15.18:0/2800000600 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbfb00047e0 con 0x7fbfb81600d0 2024-09-19T09:24:17.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.266+0000 7fbfaf7fe640 1 --2- 172.21.15.18:0/2800000600 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbf9806c2b0 0x7fbf9806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:17.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.266+0000 7fbfaf7fe640 1 -- 172.21.15.18:0/2800000600 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(173..173 src has 1..173) ==== 5415+0+0 (secure 0 0 0) 0x7fbfb008a5b0 con 0x7fbfb81600d0 2024-09-19T09:24:17.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.266+0000 7fbfaf7fe640 1 -- 172.21.15.18:0/2800000600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=174}) -- 0x7fbf980731a0 con 0x7fbfb81600d0 2024-09-19T09:24:17.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.266+0000 7fbfb6d9d640 1 --2- 172.21.15.18:0/2800000600 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbf9806c2b0 0x7fbf9806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:17.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.267+0000 7fbfb6d9d640 1 --2- 172.21.15.18:0/2800000600 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbf9806c2b0 0x7fbf9806e770 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fbfa80073f0 tx=0x7fbfa800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:17.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.270+0000 7fbfaf7fe640 1 -- 172.21.15.18:0/2800000600 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fbfb806c560 con 0x7fbfb81600d0 2024-09-19T09:24:17.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:17.446+0000 7fbfbd103640 1 -- 172.21.15.18:0/2800000600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbfb8151ef0 con 0x7fbfb81600d0 2024-09-19T09:24:18.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.134+0000 7fbfaf7fe640 1 -- 172.21.15.18:0/2800000600 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v174) ==== 169+0+0 (secure 0 0 0) 0x7fbfb0058e50 con 0x7fbfb81600d0 2024-09-19T09:24:18.135 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' removed 2024-09-19T09:24:18.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.134+0000 7fbfaf7fe640 1 -- 172.21.15.18:0/2800000600 <== mon.0 v2:172.21.15.18:3300/0 8 ==== osd_map(174..174 src has 1..174) ==== 330+0+0 (secure 0 0 0) 0x7fbfb00beda0 con 0x7fbfb81600d0 2024-09-19T09:24:18.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.134+0000 7fbfaf7fe640 1 -- 172.21.15.18:0/2800000600 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=175}) -- 0x7fbf98071f30 con 0x7fbfb81600d0 2024-09-19T09:24:18.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.144+0000 7fbfbd103640 1 -- 172.21.15.18:0/2800000600 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbf9806c2b0 msgr2=0x7fbf9806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:18.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.144+0000 7fbfbd103640 1 --2- 172.21.15.18:0/2800000600 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbf9806c2b0 0x7fbf9806e770 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fbfa80073f0 tx=0x7fbfa800b040 comp rx=0 tx=0).stop 2024-09-19T09:24:18.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.144+0000 7fbfbd103640 1 -- 172.21.15.18:0/2800000600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfb81600d0 msgr2=0x7fbfb814a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:18.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.144+0000 7fbfbd103640 1 --2- 172.21.15.18:0/2800000600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfb81600d0 0x7fbfb814a2f0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fbfb000c780 tx=0x7fbfb000cc40 comp rx=0 tx=0).stop 2024-09-19T09:24:18.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.145+0000 7fbfbd103640 1 -- 172.21.15.18:0/2800000600 shutdown_connections 2024-09-19T09:24:18.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.145+0000 7fbfbd103640 1 --2- 172.21.15.18:0/2800000600 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbf9806c2b0 0x7fbf9806e770 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:18.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.145+0000 7fbfbd103640 1 --2- 172.21.15.18:0/2800000600 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbfb81600d0 0x7fbfb814a2f0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:18.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.145+0000 7fbfbd103640 1 --2- 172.21.15.18:0/2800000600 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbfb80b0d80 0x7fbfb8148a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:18.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.145+0000 7fbfbd103640 1 --2- 172.21.15.18:0/2800000600 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbfb806c150 0x7fbfb81f83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:18.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.145+0000 7fbfbd103640 1 -- 172.21.15.18:0/2800000600 >> 172.21.15.18:0/2800000600 conn(0x7fbfb806cd20 msgr2=0x7fbfb815c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:18.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.145+0000 7fbfbd103640 1 -- 172.21.15.18:0/2800000600 shutdown_connections 2024-09-19T09:24:18.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.146+0000 7fbfbd103640 1 -- 172.21.15.18:0/2800000600 wait complete. 2024-09-19T09:24:18.160 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-19T09:24:18.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.269+0000 7f950dbbd640 1 Processor -- start 2024-09-19T09:24:18.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.269+0000 7f950dbbd640 1 -- start start 2024-09-19T09:24:18.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.270+0000 7f950dbbd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f95080b0000 0x7f95080b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:18.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.270+0000 7f950dbbd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f95080ae840 0x7f9508073170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:18.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.270+0000 7f950dbbd640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f950806bff0 con 0x7f95080aecb0 2024-09-19T09:24:18.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.270+0000 7f950dbbd640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f950806c2d0 con 0x7f95080b0000 2024-09-19T09:24:18.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.270+0000 7f950dbbd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f950806ef40 con 0x7f95080ae840 2024-09-19T09:24:18.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.270+0000 7f95077fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f95080b0000 0x7f95080b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:18.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.270+0000 7f95077fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f95080b0000 0x7f95080b03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55988/0 (socket says 172.21.15.18:55988) 2024-09-19T09:24:18.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.270+0000 7f95077fe640 1 -- 172.21.15.18:0/3332776993 learned_addr learned my addr 172.21.15.18:0/3332776993 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:18.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.271+0000 7f95077fe640 1 -- 172.21.15.18:0/3332776993 >> v2:172.21.15.162:3300/0 conn(0x7f95080ae840 msgr2=0x7f9508073170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:18.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.271+0000 7f95077fe640 1 --2- 172.21.15.18:0/3332776993 >> v2:172.21.15.162:3300/0 conn(0x7f95080ae840 0x7f9508073170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:18.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.271+0000 7f95077fe640 1 -- 172.21.15.18:0/3332776993 >> v1:172.21.15.162:6789/0 conn(0x7f95080aecb0 legacy=0x7f950806f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:18.272 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.271+0000 7f95077fe640 1 -- 172.21.15.18:0/3332776993 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f950806f220 con 0x7f95080b0000 2024-09-19T09:24:18.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.271+0000 7f95077fe640 1 --2- 172.21.15.18:0/3332776993 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95080b0000 0x7f95080b03e0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f95080cdc00 tx=0x7f94f802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4818bd5200090041 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:18.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.272+0000 7f95067fc640 1 -- 172.21.15.18:0/3332776993 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f8037070 con 0x7f95080b0000 2024-09-19T09:24:18.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.272+0000 7f95067fc640 1 -- 172.21.15.18:0/3332776993 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f802ae20 con 0x7f95080b0000 2024-09-19T09:24:18.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.272+0000 7f95067fc640 1 -- 172.21.15.18:0/3332776993 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f8032660 con 0x7f95080b0000 2024-09-19T09:24:18.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.272+0000 7f950dbbd640 1 -- 172.21.15.18:0/3332776993 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95080b0000 msgr2=0x7f95080b03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:18.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.272+0000 7f950dbbd640 1 --2- 172.21.15.18:0/3332776993 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95080b0000 0x7f95080b03e0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f95080cdc00 tx=0x7f94f802a110 comp rx=0 tx=0).stop 2024-09-19T09:24:18.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.272+0000 7f950dbbd640 1 -- 172.21.15.18:0/3332776993 shutdown_connections 2024-09-19T09:24:18.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.272+0000 7f950dbbd640 1 --2- 172.21.15.18:0/3332776993 >> v2:172.21.15.162:3300/0 conn(0x7f95080ae840 0x7f9508073170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:18.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.272+0000 7f950dbbd640 1 --2- 172.21.15.18:0/3332776993 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95080b0000 0x7f95080b03e0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:18.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.272+0000 7f950dbbd640 1 -- 172.21.15.18:0/3332776993 >> 172.21.15.18:0/3332776993 conn(0x7f9508072680 msgr2=0x7f9508072a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:18.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.272+0000 7f950dbbd640 1 -- 172.21.15.18:0/3332776993 shutdown_connections 2024-09-19T09:24:18.274 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.272+0000 7f950dbbd640 1 -- 172.21.15.18:0/3332776993 wait complete. 2024-09-19T09:24:18.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.273+0000 7f950dbbd640 1 Processor -- start 2024-09-19T09:24:18.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.274+0000 7f950dbbd640 1 -- start start 2024-09-19T09:24:18.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.274+0000 7f950dbbd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95080ae840 0x7f95080b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:18.276 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.274+0000 7f950dbbd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95080aecb0 0x7f95080cfe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:18.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.274+0000 7f950dbbd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95080b0000 0x7f9508150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:18.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.274+0000 7f950dbbd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f950806bc10 con 0x7f95080ae840 2024-09-19T09:24:18.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.274+0000 7f950dbbd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f950806c5b0 con 0x7f95080aecb0 2024-09-19T09:24:18.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.274+0000 7f950dbbd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f950806bd90 con 0x7f95080b0000 2024-09-19T09:24:18.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.274+0000 7f95077fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95080ae840 0x7f95080b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:18.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.274+0000 7f95077fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95080ae840 0x7f95080b4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:55996/0 (socket says 172.21.15.18:55996) 2024-09-19T09:24:18.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.274+0000 7f95077fe640 1 -- 172.21.15.18:0/3387736442 learned_addr learned my addr 172.21.15.18:0/3387736442 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:18.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.274+0000 7f9506ffd640 1 --2- 172.21.15.18:0/3387736442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95080aecb0 0x7f95080cfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:18.277 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.274+0000 7f9507fff640 1 --2- 172.21.15.18:0/3387736442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95080b0000 0x7f9508150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:18.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.275+0000 7f95077fe640 1 -- 172.21.15.18:0/3387736442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95080b0000 msgr2=0x7f9508150040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:18.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.275+0000 7f95077fe640 1 --2- 172.21.15.18:0/3387736442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95080b0000 0x7f9508150040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:18.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.275+0000 7f95077fe640 1 -- 172.21.15.18:0/3387736442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95080aecb0 msgr2=0x7f95080cfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:18.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.275+0000 7f95077fe640 1 --2- 172.21.15.18:0/3387736442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95080aecb0 0x7f95080cfe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:18.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.275+0000 7f95077fe640 1 -- 172.21.15.18:0/3387736442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95080ce680 con 0x7f95080ae840 2024-09-19T09:24:18.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.275+0000 7f95077fe640 1 --2- 172.21.15.18:0/3387736442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95080ae840 0x7f95080b4f50 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f94f8000c00 tx=0x7f94f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:18.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.275+0000 7f94effff640 1 -- 172.21.15.18:0/3387736442 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f8042070 con 0x7f95080ae840 2024-09-19T09:24:18.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.275+0000 7f94effff640 1 -- 172.21.15.18:0/3387736442 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94f803e670 con 0x7f95080ae840 2024-09-19T09:24:18.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.275+0000 7f94effff640 1 -- 172.21.15.18:0/3387736442 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94f8037040 con 0x7f95080ae840 2024-09-19T09:24:18.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.275+0000 7f950dbbd640 1 -- 172.21.15.18:0/3387736442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95080ce960 con 0x7f95080ae840 2024-09-19T09:24:18.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.275+0000 7f950dbbd640 1 -- 172.21.15.18:0/3387736442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95080ce2a0 con 0x7f95080ae840 2024-09-19T09:24:18.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.276+0000 7f950dbbd640 1 -- 172.21.15.18:0/3387736442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95080cecf0 con 0x7f95080ae840 2024-09-19T09:24:18.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.277+0000 7f94effff640 1 -- 172.21.15.18:0/3387736442 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f94f8045070 con 0x7f95080ae840 2024-09-19T09:24:18.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.277+0000 7f94effff640 1 --2- 172.21.15.18:0/3387736442 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f94f406c2b0 0x7f94f406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:18.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.277+0000 7f94effff640 1 -- 172.21.15.18:0/3387736442 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 4943+0+0 (secure 0 0 0) 0x7f94f80ab850 con 0x7f95080ae840 2024-09-19T09:24:18.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.278+0000 7f9506ffd640 1 --2- 172.21.15.18:0/3387736442 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f94f406c2b0 0x7f94f406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:18.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.278+0000 7f9506ffd640 1 --2- 172.21.15.18:0/3387736442 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f94f406c2b0 0x7f94f406e770 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f9508155d60 tx=0x7f94fc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:18.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.282+0000 7f94effff640 1 -- 172.21.15.18:0/3387736442 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f94f807a350 con 0x7f95080ae840 2024-09-19T09:24:18.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.457+0000 7f950dbbd640 1 -- 172.21.15.18:0/3387736442 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f950815d1b0 con 0x7f95080ae840 2024-09-19T09:24:18.461 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.461+0000 7f94effff640 1 -- 172.21.15.18:0/3387736442 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7f94f802ae20 con 0x7f95080ae840 2024-09-19T09:24:18.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.463+0000 7f950dbbd640 1 -- 172.21.15.18:0/3387736442 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f94f406c2b0 msgr2=0x7f94f406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:18.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.463+0000 7f950dbbd640 1 --2- 172.21.15.18:0/3387736442 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f94f406c2b0 0x7f94f406e770 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f9508155d60 tx=0x7f94fc008040 comp rx=0 tx=0).stop 2024-09-19T09:24:18.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.463+0000 7f950dbbd640 1 -- 172.21.15.18:0/3387736442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95080ae840 msgr2=0x7f95080b4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:18.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.463+0000 7f950dbbd640 1 --2- 172.21.15.18:0/3387736442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95080ae840 0x7f95080b4f50 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f94f8000c00 tx=0x7f94f80046c0 comp rx=0 tx=0).stop 2024-09-19T09:24:18.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.463+0000 7f950dbbd640 1 -- 172.21.15.18:0/3387736442 shutdown_connections 2024-09-19T09:24:18.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.463+0000 7f950dbbd640 1 --2- 172.21.15.18:0/3387736442 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f94f406c2b0 0x7f94f406e770 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:18.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.463+0000 7f950dbbd640 1 --2- 172.21.15.18:0/3387736442 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f95080b0000 0x7f9508150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:18.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.463+0000 7f950dbbd640 1 --2- 172.21.15.18:0/3387736442 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f95080aecb0 0x7f95080cfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:18.464 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.463+0000 7f950dbbd640 1 --2- 172.21.15.18:0/3387736442 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f95080ae840 0x7f95080b4f50 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:18.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.463+0000 7f950dbbd640 1 -- 172.21.15.18:0/3387736442 >> 172.21.15.18:0/3387736442 conn(0x7f9508072680 msgr2=0x7f95080b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:18.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.463+0000 7f950dbbd640 1 -- 172.21.15.18:0/3387736442 shutdown_connections 2024-09-19T09:24:18.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.463+0000 7f950dbbd640 1 -- 172.21.15.18:0/3387736442 wait complete. 2024-09-19T09:24:18.474 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2024-09-19T09:24:18.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.576+0000 7f7405eaf640 1 Processor -- start 2024-09-19T09:24:18.577 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.576+0000 7f7405eaf640 1 -- start start 2024-09-19T09:24:18.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.577+0000 7f7405eaf640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f74000d57a0 0x7f74000d1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:18.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.577+0000 7f7405eaf640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74000d3880 con 0x7f740015ecc0 2024-09-19T09:24:18.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.577+0000 7f7405eaf640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74000d3b20 con 0x7f74000d1990 2024-09-19T09:24:18.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.577+0000 7f7405eaf640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f74000b42f0 con 0x7f74000d57a0 2024-09-19T09:24:18.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.577+0000 7f73feffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f74000d57a0 0x7f74000d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:18.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.577+0000 7f73ff7fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f740015ecc0 0x7f74000d3170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54572/0 (socket says 172.21.15.18:54572) 2024-09-19T09:24:18.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.577+0000 7f73ff7fe640 1 -- 172.21.15.18:0/3712109522 learned_addr learned my addr 172.21.15.18:0/3712109522 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:24:18.578 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.577+0000 7f73feffd640 1 -- 172.21.15.18:0/3712109522 >> v1:172.21.15.162:6789/0 conn(0x7f74000d1990 legacy=0x7f74000b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:18.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.577+0000 7f73feffd640 1 -- 172.21.15.18:0/3712109522 >> v1:172.21.15.18:6789/0 conn(0x7f740015ecc0 legacy=0x7f74000d3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:18.579 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.577+0000 7f73feffd640 1 -- 172.21.15.18:0/3712109522 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74000b45d0 con 0x7f74000d57a0 2024-09-19T09:24:18.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.578+0000 7f73feffd640 1 --2- 172.21.15.18:0/3712109522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74000d57a0 0x7f74000d1450 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f73f40097a0 tx=0x7f73f402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5260fff173387d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:18.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.578+0000 7f73fe7fc640 1 -- 172.21.15.18:0/3712109522 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f4037070 con 0x7f74000d57a0 2024-09-19T09:24:18.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.578+0000 7f73fe7fc640 1 -- 172.21.15.18:0/3712109522 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73f4032440 con 0x7f74000d57a0 2024-09-19T09:24:18.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.578+0000 7f73fe7fc640 1 -- 172.21.15.18:0/3712109522 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f4032810 con 0x7f74000d57a0 2024-09-19T09:24:18.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.578+0000 7f7405eaf640 1 -- 172.21.15.18:0/3712109522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74000d57a0 msgr2=0x7f74000d1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:18.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.578+0000 7f7405eaf640 1 --2- 172.21.15.18:0/3712109522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74000d57a0 0x7f74000d1450 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f73f40097a0 tx=0x7f73f402a230 comp rx=0 tx=0).stop 2024-09-19T09:24:18.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.579+0000 7f7405eaf640 1 -- 172.21.15.18:0/3712109522 shutdown_connections 2024-09-19T09:24:18.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.579+0000 7f7405eaf640 1 --2- 172.21.15.18:0/3712109522 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f74000d57a0 0x7f74000d1450 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:18.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.579+0000 7f7405eaf640 1 -- 172.21.15.18:0/3712109522 >> 172.21.15.18:0/3712109522 conn(0x7f74000d4bd0 msgr2=0x7f74000d4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:18.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.579+0000 7f7405eaf640 1 -- 172.21.15.18:0/3712109522 shutdown_connections 2024-09-19T09:24:18.580 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.579+0000 7f7405eaf640 1 -- 172.21.15.18:0/3712109522 wait complete. 2024-09-19T09:24:18.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.580+0000 7f7405eaf640 1 Processor -- start 2024-09-19T09:24:18.582 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.580+0000 7f7405eaf640 1 -- start start 2024-09-19T09:24:18.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.581+0000 7f7405eaf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74000d1990 0x7f74000b9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:18.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.581+0000 7f7405eaf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f74000d57a0 0x7f740015cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:18.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.581+0000 7f7405eaf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f740015ecc0 0x7f740015d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:18.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.581+0000 7f7405eaf640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f740015f0a0 con 0x7f740015ecc0 2024-09-19T09:24:18.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.581+0000 7f7405eaf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f74000b4b90 con 0x7f74000d1990 2024-09-19T09:24:18.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.581+0000 7f7405eaf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f740015f220 con 0x7f74000d57a0 2024-09-19T09:24:18.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.581+0000 7f73fffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f740015ecc0 0x7f740015d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:18.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.581+0000 7f73fffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f740015ecc0 0x7f740015d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56004/0 (socket says 172.21.15.18:56004) 2024-09-19T09:24:18.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.581+0000 7f73fffff640 1 -- 172.21.15.18:0/749940401 learned_addr learned my addr 172.21.15.18:0/749940401 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:18.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.581+0000 7f73ff7fe640 1 --2- 172.21.15.18:0/749940401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74000d1990 0x7f74000b9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:18.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.581+0000 7f73feffd640 1 --2- 172.21.15.18:0/749940401 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f74000d57a0 0x7f740015cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:18.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.581+0000 7f73fffff640 1 -- 172.21.15.18:0/749940401 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f74000d57a0 msgr2=0x7f740015cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:18.583 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.581+0000 7f73fffff640 1 --2- 172.21.15.18:0/749940401 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f74000d57a0 0x7f740015cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:18.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.581+0000 7f73fffff640 1 -- 172.21.15.18:0/749940401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74000d1990 msgr2=0x7f74000b9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:18.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.581+0000 7f73fffff640 1 --2- 172.21.15.18:0/749940401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74000d1990 0x7f74000b9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:18.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.581+0000 7f73fffff640 1 -- 172.21.15.18:0/749940401 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74000b7b30 con 0x7f740015ecc0 2024-09-19T09:24:18.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.581+0000 7f73fffff640 1 --2- 172.21.15.18:0/749940401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f740015ecc0 0x7f740015d240 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f73f800c7a0 tx=0x7f73f800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:18.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.581+0000 7f73e7fff640 1 -- 172.21.15.18:0/749940401 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f8003b70 con 0x7f740015ecc0 2024-09-19T09:24:18.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.581+0000 7f73e7fff640 1 -- 172.21.15.18:0/749940401 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73f8003d30 con 0x7f740015ecc0 2024-09-19T09:24:18.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.581+0000 7f7405eaf640 1 -- 172.21.15.18:0/749940401 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74000b7e10 con 0x7f740015ecc0 2024-09-19T09:24:18.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.581+0000 7f73e7fff640 1 -- 172.21.15.18:0/749940401 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f800aa90 con 0x7f740015ecc0 2024-09-19T09:24:18.584 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.582+0000 7f7405eaf640 1 -- 172.21.15.18:0/749940401 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74000b83d0 con 0x7f740015ecc0 2024-09-19T09:24:18.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.582+0000 7f7405eaf640 1 -- 172.21.15.18:0/749940401 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74000b87b0 con 0x7f740015ecc0 2024-09-19T09:24:18.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.583+0000 7f73e7fff640 1 -- 172.21.15.18:0/749940401 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f73f800ac30 con 0x7f740015ecc0 2024-09-19T09:24:18.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.583+0000 7f73e7fff640 1 --2- 172.21.15.18:0/749940401 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f73ec06c2b0 0x7f73ec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:18.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.584+0000 7f73e7fff640 1 -- 172.21.15.18:0/749940401 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 4943+0+0 (secure 0 0 0) 0x7f73f808bc70 con 0x7f740015ecc0 2024-09-19T09:24:18.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.584+0000 7f73ff7fe640 1 --2- 172.21.15.18:0/749940401 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f73ec06c2b0 0x7f73ec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:18.585 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.584+0000 7f73ff7fe640 1 --2- 172.21.15.18:0/749940401 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f73ec06c2b0 0x7f73ec06e770 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f73f0005880 tx=0x7f73f0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:18.588 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.588+0000 7f73e7fff640 1 -- 172.21.15.18:0/749940401 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f74000b87b0 con 0x7f740015ecc0 2024-09-19T09:24:18.836 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:18.835+0000 7f7405eaf640 1 -- 172.21.15.18:0/749940401 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) -- 0x7f74000d1450 con 0x7f740015ecc0 2024-09-19T09:24:19.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.136+0000 7f73e7fff640 1 -- 172.21.15.18:0/749940401 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v502) ==== 131+0+0 (secure 0 0 0) 0x7f73f8059360 con 0x7f740015ecc0 2024-09-19T09:24:19.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.138+0000 7f7405eaf640 1 -- 172.21.15.18:0/749940401 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f73ec06c2b0 msgr2=0x7f73ec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:19.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.138+0000 7f7405eaf640 1 --2- 172.21.15.18:0/749940401 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f73ec06c2b0 0x7f73ec06e770 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f73f0005880 tx=0x7f73f0009040 comp rx=0 tx=0).stop 2024-09-19T09:24:19.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.138+0000 7f7405eaf640 1 -- 172.21.15.18:0/749940401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f740015ecc0 msgr2=0x7f740015d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:19.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.138+0000 7f7405eaf640 1 --2- 172.21.15.18:0/749940401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f740015ecc0 0x7f740015d240 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f73f800c7a0 tx=0x7f73f800cc60 comp rx=0 tx=0).stop 2024-09-19T09:24:19.139 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.138+0000 7f7405eaf640 1 -- 172.21.15.18:0/749940401 shutdown_connections 2024-09-19T09:24:19.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.138+0000 7f7405eaf640 1 --2- 172.21.15.18:0/749940401 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f73ec06c2b0 0x7f73ec06e770 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.138+0000 7f7405eaf640 1 --2- 172.21.15.18:0/749940401 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f740015ecc0 0x7f740015d240 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.138+0000 7f7405eaf640 1 --2- 172.21.15.18:0/749940401 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f74000d57a0 0x7f740015cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.138+0000 7f7405eaf640 1 --2- 172.21.15.18:0/749940401 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74000d1990 0x7f74000b9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.138+0000 7f7405eaf640 1 -- 172.21.15.18:0/749940401 >> 172.21.15.18:0/749940401 conn(0x7f74000d4bd0 msgr2=0x7f74000b6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:19.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.138+0000 7f7405eaf640 1 -- 172.21.15.18:0/749940401 shutdown_connections 2024-09-19T09:24:19.140 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.138+0000 7f7405eaf640 1 -- 172.21.15.18:0/749940401 wait complete. 2024-09-19T09:24:19.151 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2024-09-19T09:24:19.152 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) 2024-09-19T09:24:19.152 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:24:19.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.254+0000 7fde111b7640 1 Processor -- start 2024-09-19T09:24:19.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.254+0000 7fde111b7640 1 -- start start 2024-09-19T09:24:19.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.255+0000 7fde111b7640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fde0c15eb00 0x7fde0c1630d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.255+0000 7fde111b7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde0c06d810 0x7fde0c0b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.255+0000 7fde111b7640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fde0c06ffd0 0x7fde0c0b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.255+0000 7fde111b7640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fde0c06e730 con 0x7fde0c15eb00 2024-09-19T09:24:19.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.255+0000 7fde111b7640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fde0c06ea10 con 0x7fde0c06ffd0 2024-09-19T09:24:19.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.255+0000 7fde111b7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fde0c1628d0 con 0x7fde0c06d810 2024-09-19T09:24:19.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.255+0000 7fde0ad9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fde0c15eb00 0x7fde0c1630d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.255+0000 7fde0ad9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fde0c15eb00 0x7fde0c1630d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56018/0 (socket says 172.21.15.18:56018) 2024-09-19T09:24:19.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.255+0000 7fde0ad9d640 1 -- 172.21.15.18:0/4209406013 learned_addr learned my addr 172.21.15.18:0/4209406013 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:19.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.255+0000 7fde0b59e640 1 --2- 172.21.15.18:0/4209406013 >> v2:172.21.15.162:3300/0 conn(0x7fde0c06ffd0 0x7fde0c0b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.255+0000 7fde0a59c640 1 --2- 172.21.15.18:0/4209406013 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde0c06d810 0x7fde0c0b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.255+0000 7fde0ad9d640 1 -- 172.21.15.18:0/4209406013 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde0c06d810 msgr2=0x7fde0c0b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:19.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.255+0000 7fde0ad9d640 1 --2- 172.21.15.18:0/4209406013 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde0c06d810 0x7fde0c0b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.255+0000 7fde0ad9d640 1 -- 172.21.15.18:0/4209406013 >> v2:172.21.15.162:3300/0 conn(0x7fde0c06ffd0 msgr2=0x7fde0c0b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:19.257 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.255+0000 7fde0ad9d640 1 --2- 172.21.15.18:0/4209406013 >> v2:172.21.15.162:3300/0 conn(0x7fde0c06ffd0 0x7fde0c0b0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.258 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.255+0000 7fde0ad9d640 1 -- 172.21.15.18:0/4209406013 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde0c162bb0 con 0x7fde0c15eb00 2024-09-19T09:24:19.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.256+0000 7fde0ad9d640 1 --2- 172.21.15.18:0/4209406013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde0c15eb00 0x7fde0c1630d0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fde0c06f830 tx=0x7fddfc02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d406660c915cc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:19.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.256+0000 7fde09d9b640 1 -- 172.21.15.18:0/4209406013 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddfc036070 con 0x7fde0c15eb00 2024-09-19T09:24:19.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.256+0000 7fde09d9b640 1 -- 172.21.15.18:0/4209406013 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddfc031600 con 0x7fde0c15eb00 2024-09-19T09:24:19.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.256+0000 7fde09d9b640 1 -- 172.21.15.18:0/4209406013 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddfc0319d0 con 0x7fde0c15eb00 2024-09-19T09:24:19.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.257+0000 7fde111b7640 1 -- 172.21.15.18:0/4209406013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde0c15eb00 msgr2=0x7fde0c1630d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:19.259 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.257+0000 7fde111b7640 1 --2- 172.21.15.18:0/4209406013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde0c15eb00 0x7fde0c1630d0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7fde0c06f830 tx=0x7fddfc02a610 comp rx=0 tx=0).stop 2024-09-19T09:24:19.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.257+0000 7fde111b7640 1 -- 172.21.15.18:0/4209406013 shutdown_connections 2024-09-19T09:24:19.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.257+0000 7fde111b7640 1 --2- 172.21.15.18:0/4209406013 >> v2:172.21.15.162:3300/0 conn(0x7fde0c06ffd0 0x7fde0c0b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.257+0000 7fde111b7640 1 --2- 172.21.15.18:0/4209406013 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde0c06d810 0x7fde0c0b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.257+0000 7fde111b7640 1 --2- 172.21.15.18:0/4209406013 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde0c15eb00 0x7fde0c1630d0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.257+0000 7fde111b7640 1 -- 172.21.15.18:0/4209406013 >> 172.21.15.18:0/4209406013 conn(0x7fde0c06cd20 msgr2=0x7fde0c06d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:19.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.257+0000 7fde111b7640 1 -- 172.21.15.18:0/4209406013 shutdown_connections 2024-09-19T09:24:19.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.257+0000 7fde111b7640 1 -- 172.21.15.18:0/4209406013 wait complete. 2024-09-19T09:24:19.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.258+0000 7fde111b7640 1 Processor -- start 2024-09-19T09:24:19.260 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.258+0000 7fde111b7640 1 -- start start 2024-09-19T09:24:19.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.259+0000 7fde111b7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde0c06d810 0x7fde0c158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.259+0000 7fde111b7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde0c06ffd0 0x7fde0c161f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.259+0000 7fde111b7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde0c15eb00 0x7fde0c160190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.259+0000 7fde111b7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fde0c0d15e0 con 0x7fde0c06d810 2024-09-19T09:24:19.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.259+0000 7fde111b7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fde0c0d1460 con 0x7fde0c15eb00 2024-09-19T09:24:19.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.259+0000 7fde111b7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fde0c0d1760 con 0x7fde0c06ffd0 2024-09-19T09:24:19.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.259+0000 7fde0ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde0c06d810 0x7fde0c158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.259+0000 7fde0ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde0c06d810 0x7fde0c158d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56026/0 (socket says 172.21.15.18:56026) 2024-09-19T09:24:19.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.259+0000 7fde0ad9d640 1 -- 172.21.15.18:0/2938821484 learned_addr learned my addr 172.21.15.18:0/2938821484 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:19.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.259+0000 7fde0a59c640 1 --2- 172.21.15.18:0/2938821484 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde0c06ffd0 0x7fde0c161f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.259+0000 7fde0b59e640 1 --2- 172.21.15.18:0/2938821484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde0c15eb00 0x7fde0c160190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.260+0000 7fde0ad9d640 1 -- 172.21.15.18:0/2938821484 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde0c06ffd0 msgr2=0x7fde0c161f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:19.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.260+0000 7fde0ad9d640 1 --2- 172.21.15.18:0/2938821484 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde0c06ffd0 0x7fde0c161f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.260+0000 7fde0ad9d640 1 -- 172.21.15.18:0/2938821484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde0c15eb00 msgr2=0x7fde0c160190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:19.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.260+0000 7fde0ad9d640 1 --2- 172.21.15.18:0/2938821484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde0c15eb00 0x7fde0c160190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.260+0000 7fde0ad9d640 1 -- 172.21.15.18:0/2938821484 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde0c15f0f0 con 0x7fde0c06d810 2024-09-19T09:24:19.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.260+0000 7fde0ad9d640 1 --2- 172.21.15.18:0/2938821484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde0c06d810 0x7fde0c158d10 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fddfc034040 tx=0x7fddfc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:19.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.260+0000 7fde037fe640 1 -- 172.21.15.18:0/2938821484 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddfc036050 con 0x7fde0c06d810 2024-09-19T09:24:19.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.260+0000 7fde037fe640 1 -- 172.21.15.18:0/2938821484 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddfc042070 con 0x7fde0c06d810 2024-09-19T09:24:19.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.260+0000 7fde111b7640 1 -- 172.21.15.18:0/2938821484 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde0c15f3d0 con 0x7fde0c06d810 2024-09-19T09:24:19.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.260+0000 7fde037fe640 1 -- 172.21.15.18:0/2938821484 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddfc009510 con 0x7fde0c06d810 2024-09-19T09:24:19.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.260+0000 7fde111b7640 1 -- 172.21.15.18:0/2938821484 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde0c15fc70 con 0x7fde0c06d810 2024-09-19T09:24:19.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.261+0000 7fde111b7640 1 -- 172.21.15.18:0/2938821484 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde0c15f7c0 con 0x7fde0c06d810 2024-09-19T09:24:19.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.261+0000 7fde037fe640 1 -- 172.21.15.18:0/2938821484 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fddfc007c30 con 0x7fde0c06d810 2024-09-19T09:24:19.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.262+0000 7fde037fe640 1 --2- 172.21.15.18:0/2938821484 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fddec06c2b0 0x7fddec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.262+0000 7fde037fe640 1 -- 172.21.15.18:0/2938821484 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 4943+0+0 (secure 0 0 0) 0x7fddfc0abed0 con 0x7fde0c06d810 2024-09-19T09:24:19.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.262+0000 7fde0a59c640 1 --2- 172.21.15.18:0/2938821484 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fddec06c2b0 0x7fddec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.263+0000 7fde0a59c640 1 --2- 172.21.15.18:0/2938821484 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fddec06c2b0 0x7fddec06e770 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fde0c15be50 tx=0x7fddf4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:19.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.266+0000 7fde037fe640 1 -- 172.21.15.18:0/2938821484 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fddfc07a2f0 con 0x7fde0c06d810 2024-09-19T09:24:19.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.443+0000 7fde111b7640 1 -- 172.21.15.18:0/2938821484 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fde0c1630d0 con 0x7fde0c06d810 2024-09-19T09:24:19.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.444+0000 7fde037fe640 1 -- 172.21.15.18:0/2938821484 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v174) ==== 74+0+13055 (secure 0 0 0) 0x7fddfc07e5f0 con 0x7fde0c06d810 2024-09-19T09:24:19.445 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:24:19.445 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":174,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:24:18.131067+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":165,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6835/2876222862":"2024-09-20T09:24:15.121996+0000","172.21.15.18:6833/2876222862":"2024-09-20T09:24:15.121996+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:24:19.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.446+0000 7fde111b7640 1 -- 172.21.15.18:0/2938821484 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fddec06c2b0 msgr2=0x7fddec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:19.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.446+0000 7fde111b7640 1 --2- 172.21.15.18:0/2938821484 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fddec06c2b0 0x7fddec06e770 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fde0c15be50 tx=0x7fddf4008040 comp rx=0 tx=0).stop 2024-09-19T09:24:19.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.446+0000 7fde111b7640 1 -- 172.21.15.18:0/2938821484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde0c06d810 msgr2=0x7fde0c158d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:19.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.446+0000 7fde111b7640 1 --2- 172.21.15.18:0/2938821484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde0c06d810 0x7fde0c158d10 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fddfc034040 tx=0x7fddfc004a40 comp rx=0 tx=0).stop 2024-09-19T09:24:19.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.446+0000 7fde111b7640 1 -- 172.21.15.18:0/2938821484 shutdown_connections 2024-09-19T09:24:19.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.446+0000 7fde111b7640 1 --2- 172.21.15.18:0/2938821484 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fddec06c2b0 0x7fddec06e770 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.446+0000 7fde111b7640 1 --2- 172.21.15.18:0/2938821484 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde0c15eb00 0x7fde0c160190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.446+0000 7fde111b7640 1 --2- 172.21.15.18:0/2938821484 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fde0c06ffd0 0x7fde0c161f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.446+0000 7fde111b7640 1 --2- 172.21.15.18:0/2938821484 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fde0c06d810 0x7fde0c158d10 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.446+0000 7fde111b7640 1 -- 172.21.15.18:0/2938821484 >> 172.21.15.18:0/2938821484 conn(0x7fde0c06cd20 msgr2=0x7fde0c0b2730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:19.447 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.446+0000 7fde111b7640 1 -- 172.21.15.18:0/2938821484 shutdown_connections 2024-09-19T09:24:19.448 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.446+0000 7fde111b7640 1 -- 172.21.15.18:0/2938821484 wait complete. 2024-09-19T09:24:19.458 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T09:13:17.564717+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '111', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T09:24:19.458 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T09:24:19.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.563+0000 7fe42f118640 1 Processor -- start 2024-09-19T09:24:19.564 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.563+0000 7fe42f118640 1 -- start start 2024-09-19T09:24:19.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.564+0000 7fe42f118640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe42815c670 0x7fe4280b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.564+0000 7fe42f118640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe42806deb0 0x7fe428160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.565 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.564+0000 7fe42f118640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4280b6a60 con 0x7fe42815f1a0 2024-09-19T09:24:19.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.564+0000 7fe42f118640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fe4280b6d40 con 0x7fe42806deb0 2024-09-19T09:24:19.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.564+0000 7fe42f118640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe4280b7020 con 0x7fe42815c670 2024-09-19T09:24:19.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.564+0000 7fe42d6b5640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe42806deb0 0x7fe428160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.564+0000 7fe42d6b5640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe42806deb0 0x7fe428160300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56030/0 (socket says 172.21.15.18:56030) 2024-09-19T09:24:19.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.564+0000 7fe42d6b5640 1 -- 172.21.15.18:0/3291581006 learned_addr learned my addr 172.21.15.18:0/3291581006 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:19.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.564+0000 7fe42ceb4640 1 --2- 172.21.15.18:0/3291581006 >> v2:172.21.15.162:3300/0 conn(0x7fe42815c670 0x7fe4280b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.564+0000 7fe42d6b5640 1 -- 172.21.15.18:0/3291581006 >> v2:172.21.15.162:3300/0 conn(0x7fe42815c670 msgr2=0x7fe4280b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:19.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.564+0000 7fe42d6b5640 1 --2- 172.21.15.18:0/3291581006 >> v2:172.21.15.162:3300/0 conn(0x7fe42815c670 0x7fe4280b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.564+0000 7fe42d6b5640 1 -- 172.21.15.18:0/3291581006 >> v1:172.21.15.162:6789/0 conn(0x7fe42815f1a0 legacy=0x7fe42806d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:19.566 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.564+0000 7fe42d6b5640 1 -- 172.21.15.18:0/3291581006 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4280b7300 con 0x7fe42806deb0 2024-09-19T09:24:19.567 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.565+0000 7fe42d6b5640 1 --2- 172.21.15.18:0/3291581006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe42806deb0 0x7fe428160300 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fe4280728c0 tx=0x7fe42002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4dcf623f9d6ecd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:19.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.565+0000 7fe4277fe640 1 -- 172.21.15.18:0/3291581006 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe420036070 con 0x7fe42806deb0 2024-09-19T09:24:19.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.565+0000 7fe4277fe640 1 -- 172.21.15.18:0/3291581006 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe420031600 con 0x7fe42806deb0 2024-09-19T09:24:19.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.565+0000 7fe4277fe640 1 -- 172.21.15.18:0/3291581006 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4200319d0 con 0x7fe42806deb0 2024-09-19T09:24:19.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.566+0000 7fe42f118640 1 -- 172.21.15.18:0/3291581006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe42806deb0 msgr2=0x7fe428160300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:19.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.566+0000 7fe42f118640 1 --2- 172.21.15.18:0/3291581006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe42806deb0 0x7fe428160300 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fe4280728c0 tx=0x7fe42002a6f0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.566+0000 7fe42f118640 1 -- 172.21.15.18:0/3291581006 shutdown_connections 2024-09-19T09:24:19.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.566+0000 7fe42f118640 1 --2- 172.21.15.18:0/3291581006 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe42806deb0 0x7fe428160300 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.566+0000 7fe42f118640 1 --2- 172.21.15.18:0/3291581006 >> v2:172.21.15.162:3300/0 conn(0x7fe42815c670 0x7fe4280b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.566+0000 7fe42f118640 1 -- 172.21.15.18:0/3291581006 >> 172.21.15.18:0/3291581006 conn(0x7fe42809b9d0 msgr2=0x7fe42809bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:19.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.566+0000 7fe42f118640 1 -- 172.21.15.18:0/3291581006 shutdown_connections 2024-09-19T09:24:19.568 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.566+0000 7fe42f118640 1 -- 172.21.15.18:0/3291581006 wait complete. 2024-09-19T09:24:19.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.567+0000 7fe42f118640 1 Processor -- start 2024-09-19T09:24:19.570 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.567+0000 7fe42f118640 1 -- start start 2024-09-19T09:24:19.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.568+0000 7fe42f118640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe42806deb0 0x7fe4281542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.568+0000 7fe42f118640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe42815c670 0x7fe428156d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.568+0000 7fe42f118640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe42815f1a0 0x7fe4280cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.568+0000 7fe42f118640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe4280b7b00 con 0x7fe42806deb0 2024-09-19T09:24:19.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.568+0000 7fe42f118640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe42809c560 con 0x7fe42815c670 2024-09-19T09:24:19.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.568+0000 7fe42f118640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe428155cc0 con 0x7fe42815f1a0 2024-09-19T09:24:19.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.568+0000 7fe42ceb4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe42806deb0 0x7fe4281542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.568+0000 7fe42ceb4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe42806deb0 0x7fe4281542e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56036/0 (socket says 172.21.15.18:56036) 2024-09-19T09:24:19.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.568+0000 7fe42ceb4640 1 -- 172.21.15.18:0/2701583951 learned_addr learned my addr 172.21.15.18:0/2701583951 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:19.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.568+0000 7fe427fff640 1 --2- 172.21.15.18:0/2701583951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe42815c670 0x7fe428156d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.568+0000 7fe42d6b5640 1 --2- 172.21.15.18:0/2701583951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe42815f1a0 0x7fe4280cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.571 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.569+0000 7fe42ceb4640 1 -- 172.21.15.18:0/2701583951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe42815f1a0 msgr2=0x7fe4280cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:19.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.569+0000 7fe42ceb4640 1 --2- 172.21.15.18:0/2701583951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe42815f1a0 0x7fe4280cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.569+0000 7fe42ceb4640 1 -- 172.21.15.18:0/2701583951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe42815c670 msgr2=0x7fe428156d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:19.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.569+0000 7fe42ceb4640 1 --2- 172.21.15.18:0/2701583951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe42815c670 0x7fe428156d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.569+0000 7fe42ceb4640 1 -- 172.21.15.18:0/2701583951 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe428155f60 con 0x7fe42806deb0 2024-09-19T09:24:19.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.569+0000 7fe42d6b5640 1 --2- 172.21.15.18:0/2701583951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe42815f1a0 0x7fe4280cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:19.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.569+0000 7fe42ceb4640 1 --2- 172.21.15.18:0/2701583951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe42806deb0 0x7fe4281542e0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fe41800d800 tx=0x7fe41800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:19.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.569+0000 7fe4257fa640 1 -- 172.21.15.18:0/2701583951 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41800b6c0 con 0x7fe42806deb0 2024-09-19T09:24:19.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.569+0000 7fe4257fa640 1 -- 172.21.15.18:0/2701583951 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe418019070 con 0x7fe42806deb0 2024-09-19T09:24:19.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.569+0000 7fe4257fa640 1 -- 172.21.15.18:0/2701583951 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe41800ba80 con 0x7fe42806deb0 2024-09-19T09:24:19.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.569+0000 7fe42f118640 1 -- 172.21.15.18:0/2701583951 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe428156240 con 0x7fe42806deb0 2024-09-19T09:24:19.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.569+0000 7fe42f118640 1 -- 172.21.15.18:0/2701583951 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe428154b10 con 0x7fe42806deb0 2024-09-19T09:24:19.572 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.570+0000 7fe42f118640 1 -- 172.21.15.18:0/2701583951 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe428068e30 con 0x7fe42806deb0 2024-09-19T09:24:19.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.570+0000 7fe4257fa640 1 -- 172.21.15.18:0/2701583951 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe41800bc20 con 0x7fe42806deb0 2024-09-19T09:24:19.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.571+0000 7fe4257fa640 1 --2- 172.21.15.18:0/2701583951 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe41406c2b0 0x7fe41406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.571+0000 7fe4257fa640 1 -- 172.21.15.18:0/2701583951 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 4943+0+0 (secure 0 0 0) 0x7fe41808b4d0 con 0x7fe42806deb0 2024-09-19T09:24:19.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.571+0000 7fe427fff640 1 --2- 172.21.15.18:0/2701583951 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe41406c2b0 0x7fe41406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.573 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.572+0000 7fe427fff640 1 --2- 172.21.15.18:0/2701583951 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe41406c2b0 0x7fe41406e770 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe428154820 tx=0x7fe41c009060 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:19.576 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.575+0000 7fe4257fa640 1 -- 172.21.15.18:0/2701583951 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe428068e30 con 0x7fe42806deb0 2024-09-19T09:24:19.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.748+0000 7fe42f118640 1 -- 172.21.15.18:0/2701583951 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe4280694f0 con 0x7fe42806deb0 2024-09-19T09:24:19.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.748+0000 7fe4257fa640 1 -- 172.21.15.18:0/2701583951 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v174) ==== 93+0+10 (secure 0 0 0) 0x7fe4280694f0 con 0x7fe42806deb0 2024-09-19T09:24:19.750 INFO:teuthology.orchestra.run.smithi018.stdout:pg_num: 1 2024-09-19T09:24:19.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.750+0000 7fe42f118640 1 -- 172.21.15.18:0/2701583951 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe41406c2b0 msgr2=0x7fe41406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:19.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.750+0000 7fe42f118640 1 --2- 172.21.15.18:0/2701583951 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe41406c2b0 0x7fe41406e770 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fe428154820 tx=0x7fe41c009060 comp rx=0 tx=0).stop 2024-09-19T09:24:19.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.750+0000 7fe42f118640 1 -- 172.21.15.18:0/2701583951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe42806deb0 msgr2=0x7fe4281542e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:19.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.750+0000 7fe42f118640 1 --2- 172.21.15.18:0/2701583951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe42806deb0 0x7fe4281542e0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fe41800d800 tx=0x7fe41800dcc0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.750+0000 7fe42f118640 1 -- 172.21.15.18:0/2701583951 shutdown_connections 2024-09-19T09:24:19.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.750+0000 7fe42f118640 1 --2- 172.21.15.18:0/2701583951 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe41406c2b0 0x7fe41406e770 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.750+0000 7fe42f118640 1 --2- 172.21.15.18:0/2701583951 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe42815f1a0 0x7fe4280cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.750+0000 7fe42f118640 1 --2- 172.21.15.18:0/2701583951 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe42815c670 0x7fe428156d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.750+0000 7fe42f118640 1 --2- 172.21.15.18:0/2701583951 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe42806deb0 0x7fe4281542e0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.750+0000 7fe42f118640 1 -- 172.21.15.18:0/2701583951 >> 172.21.15.18:0/2701583951 conn(0x7fe42809b9d0 msgr2=0x7fe428162010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:19.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.750+0000 7fe42f118640 1 -- 172.21.15.18:0/2701583951 shutdown_connections 2024-09-19T09:24:19.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.751+0000 7fe42f118640 1 -- 172.21.15.18:0/2701583951 wait complete. 2024-09-19T09:24:19.763 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2024-09-19T09:24:19.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.865+0000 7f12156ba640 1 Processor -- start 2024-09-19T09:24:19.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.865+0000 7f12156ba640 1 -- start start 2024-09-19T09:24:19.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.866+0000 7f12156ba640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f12100cfae0 0x7f12100b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.866+0000 7f12156ba640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f121006d730 0x7f12100cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.866+0000 7f12156ba640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12100cd1a0 con 0x7f121015ef80 2024-09-19T09:24:19.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.866+0000 7f12156ba640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f12100cd7d0 con 0x7f12100cfae0 2024-09-19T09:24:19.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.866+0000 7f12156ba640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f121006dc30 con 0x7f121006d730 2024-09-19T09:24:19.867 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.866+0000 7f120f7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f121006d730 0x7f12100cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.866+0000 7f120e7fc640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f12100cfae0 0x7f12100b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.866+0000 7f120f7fe640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f121006d730 0x7f12100cdc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:59756/0 (socket says 172.21.15.18:59756) 2024-09-19T09:24:19.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.866+0000 7f120e7fc640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f12100cfae0 0x7f12100b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:41418/0 (socket says 172.21.15.18:41418) 2024-09-19T09:24:19.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.866+0000 7f120f7fe640 1 -- 172.21.15.18:0/389905716 learned_addr learned my addr 172.21.15.18:0/389905716 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:19.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.867+0000 7f120e7fc640 1 -- 172.21.15.18:0/389905716 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f121006d730 msgr2=0x7f12100cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:19.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.867+0000 7f120e7fc640 1 --2- 172.21.15.18:0/389905716 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f121006d730 0x7f12100cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.867+0000 7f120e7fc640 1 -- 172.21.15.18:0/389905716 >> v1:172.21.15.162:6789/0 conn(0x7f121015ef80 legacy=0x7f12100cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:19.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.867+0000 7f120e7fc640 1 -- 172.21.15.18:0/389905716 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f121006df10 con 0x7f12100cfae0 2024-09-19T09:24:19.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.867+0000 7f120f7fe640 1 --2- 172.21.15.18:0/389905716 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f121006d730 0x7f12100cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:24:19.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.867+0000 7f120e7fc640 1 --2- 172.21.15.18:0/389905716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12100cfae0 0x7f12100b5220 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f11f80097a0 tx=0x7f11f802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be6d2f6e6ad811f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:19.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.868+0000 7f120dffb640 1 -- 172.21.15.18:0/389905716 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f8037070 con 0x7f12100cfae0 2024-09-19T09:24:19.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.868+0000 7f120dffb640 1 -- 172.21.15.18:0/389905716 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11f8032440 con 0x7f12100cfae0 2024-09-19T09:24:19.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.868+0000 7f120dffb640 1 -- 172.21.15.18:0/389905716 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11f8032810 con 0x7f12100cfae0 2024-09-19T09:24:19.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.868+0000 7f12156ba640 1 -- 172.21.15.18:0/389905716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12100cfae0 msgr2=0x7f12100b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:19.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.868+0000 7f12156ba640 1 --2- 172.21.15.18:0/389905716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12100cfae0 0x7f12100b5220 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f11f80097a0 tx=0x7f11f802a180 comp rx=0 tx=0).stop 2024-09-19T09:24:19.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.868+0000 7f12156ba640 1 -- 172.21.15.18:0/389905716 shutdown_connections 2024-09-19T09:24:19.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.868+0000 7f12156ba640 1 --2- 172.21.15.18:0/389905716 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f121006d730 0x7f12100cdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.868+0000 7f12156ba640 1 --2- 172.21.15.18:0/389905716 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f12100cfae0 0x7f12100b5220 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.868+0000 7f12156ba640 1 -- 172.21.15.18:0/389905716 >> 172.21.15.18:0/389905716 conn(0x7f12100b4700 msgr2=0x7f12100b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:19.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.868+0000 7f12156ba640 1 -- 172.21.15.18:0/389905716 shutdown_connections 2024-09-19T09:24:19.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.868+0000 7f12156ba640 1 -- 172.21.15.18:0/389905716 wait complete. 2024-09-19T09:24:19.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.869+0000 7f12156ba640 1 Processor -- start 2024-09-19T09:24:19.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.870+0000 7f12156ba640 1 -- start start 2024-09-19T09:24:19.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.870+0000 7f12156ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f121006d730 0x7f12101f4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.870+0000 7f12156ba640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12100cfae0 0x7f12100c6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.870+0000 7f12156ba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f121015ef80 0x7f12100c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.870+0000 7f12156ba640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f12100d0120 con 0x7f121015ef80 2024-09-19T09:24:19.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.870+0000 7f12156ba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f121015f360 con 0x7f121006d730 2024-09-19T09:24:19.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.870+0000 7f12156ba640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f12100ce1a0 con 0x7f12100cfae0 2024-09-19T09:24:19.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.870+0000 7f120f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f121015ef80 0x7f12100c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.870+0000 7f120f7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f121015ef80 0x7f12100c7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56048/0 (socket says 172.21.15.18:56048) 2024-09-19T09:24:19.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.870+0000 7f120f7fe640 1 -- 172.21.15.18:0/2360083147 learned_addr learned my addr 172.21.15.18:0/2360083147 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:19.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.871+0000 7f120e7fc640 1 --2- 172.21.15.18:0/2360083147 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12100cfae0 0x7f12100c6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.871+0000 7f120f7fe640 1 -- 172.21.15.18:0/2360083147 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12100cfae0 msgr2=0x7f12100c6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:19.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.871+0000 7f120f7fe640 1 --2- 172.21.15.18:0/2360083147 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12100cfae0 0x7f12100c6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.871+0000 7f120f7fe640 1 -- 172.21.15.18:0/2360083147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f121006d730 msgr2=0x7f12101f4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:19.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.871+0000 7f120f7fe640 1 --2- 172.21.15.18:0/2360083147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f121006d730 0x7f12101f4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:19.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.871+0000 7f120f7fe640 1 -- 172.21.15.18:0/2360083147 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12100c7b60 con 0x7f121015ef80 2024-09-19T09:24:19.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.871+0000 7f120e7fc640 1 --2- 172.21.15.18:0/2360083147 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12100cfae0 0x7f12100c6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:19.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.871+0000 7f120f7fe640 1 --2- 172.21.15.18:0/2360083147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f121015ef80 0x7f12100c7530 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f120800ef90 tx=0x7f120800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:19.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.871+0000 7f12077fe640 1 -- 172.21.15.18:0/2360083147 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f120800cb80 con 0x7f121015ef80 2024-09-19T09:24:19.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.871+0000 7f12077fe640 1 -- 172.21.15.18:0/2360083147 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f120800cd20 con 0x7f121015ef80 2024-09-19T09:24:19.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.871+0000 7f12077fe640 1 -- 172.21.15.18:0/2360083147 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1208003bd0 con 0x7f121015ef80 2024-09-19T09:24:19.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.871+0000 7f12156ba640 1 -- 172.21.15.18:0/2360083147 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12100c7e40 con 0x7f121015ef80 2024-09-19T09:24:19.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.871+0000 7f12156ba640 1 -- 172.21.15.18:0/2360083147 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12100c8400 con 0x7f121015ef80 2024-09-19T09:24:19.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.872+0000 7f12156ba640 1 -- 172.21.15.18:0/2360083147 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12100cdc60 con 0x7f121015ef80 2024-09-19T09:24:19.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.873+0000 7f12077fe640 1 -- 172.21.15.18:0/2360083147 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1208005d10 con 0x7f121015ef80 2024-09-19T09:24:19.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.873+0000 7f12077fe640 1 --2- 172.21.15.18:0/2360083147 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f11f006c2e0 0x7f11f006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:19.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.873+0000 7f12077fe640 1 -- 172.21.15.18:0/2360083147 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 4943+0+0 (secure 0 0 0) 0x7f120808b480 con 0x7f121015ef80 2024-09-19T09:24:19.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.874+0000 7f120effd640 1 --2- 172.21.15.18:0/2360083147 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f11f006c2e0 0x7f11f006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:19.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.874+0000 7f120effd640 1 --2- 172.21.15.18:0/2360083147 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f11f006c2e0 0x7f11f006e7a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1200000f60 tx=0x7f12000079d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:19.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:19.878+0000 7f12077fe640 1 -- 172.21.15.18:0/2360083147 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1208022020 con 0x7f121015ef80 2024-09-19T09:24:20.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.124+0000 7f12156ba640 1 -- 172.21.15.18:0/2360083147 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) -- 0x7f121015e730 con 0x7f121015ef80 2024-09-19T09:24:20.142 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.141+0000 7f12077fe640 1 -- 172.21.15.18:0/2360083147 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v503) ==== 138+0+0 (secure 0 0 0) 0x7f1208010040 con 0x7f121015ef80 2024-09-19T09:24:20.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.143+0000 7f12156ba640 1 -- 172.21.15.18:0/2360083147 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f11f006c2e0 msgr2=0x7f11f006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:20.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.143+0000 7f12156ba640 1 --2- 172.21.15.18:0/2360083147 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f11f006c2e0 0x7f11f006e7a0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f1200000f60 tx=0x7f12000079d0 comp rx=0 tx=0).stop 2024-09-19T09:24:20.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.143+0000 7f12156ba640 1 -- 172.21.15.18:0/2360083147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f121015ef80 msgr2=0x7f12100c7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:20.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.143+0000 7f12156ba640 1 --2- 172.21.15.18:0/2360083147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f121015ef80 0x7f12100c7530 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f120800ef90 tx=0x7f120800c490 comp rx=0 tx=0).stop 2024-09-19T09:24:20.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.143+0000 7f12156ba640 1 -- 172.21.15.18:0/2360083147 shutdown_connections 2024-09-19T09:24:20.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.143+0000 7f12156ba640 1 --2- 172.21.15.18:0/2360083147 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f11f006c2e0 0x7f11f006e7a0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:20.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.143+0000 7f12156ba640 1 --2- 172.21.15.18:0/2360083147 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f121015ef80 0x7f12100c7530 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:20.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.143+0000 7f12156ba640 1 --2- 172.21.15.18:0/2360083147 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f12100cfae0 0x7f12100c6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:20.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.143+0000 7f12156ba640 1 --2- 172.21.15.18:0/2360083147 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f121006d730 0x7f12101f4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:20.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.143+0000 7f12156ba640 1 -- 172.21.15.18:0/2360083147 >> 172.21.15.18:0/2360083147 conn(0x7f12100b4700 msgr2=0x7f12100b82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:20.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.143+0000 7f12156ba640 1 -- 172.21.15.18:0/2360083147 shutdown_connections 2024-09-19T09:24:20.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.143+0000 7f12156ba640 1 -- 172.21.15.18:0/2360083147 wait complete. 2024-09-19T09:24:20.155 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-19T09:24:20.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.260+0000 7fa264f6d640 1 Processor -- start 2024-09-19T09:24:20.261 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.260+0000 7fa264f6d640 1 -- start start 2024-09-19T09:24:20.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.261+0000 7fa264f6d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa2600d14e0 0x7fa2600d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:20.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.261+0000 7fa264f6d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa2600b47e0 0x7fa2600b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:20.262 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.261+0000 7fa264f6d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2600d3270 con 0x7fa26015ede0 2024-09-19T09:24:20.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.261+0000 7fa264f6d640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fa2600d1e60 con 0x7fa2600b47e0 2024-09-19T09:24:20.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.261+0000 7fa264f6d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa2600d34e0 con 0x7fa2600d14e0 2024-09-19T09:24:20.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.261+0000 7fa25ed9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa2600b47e0 0x7fa2600b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:20.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.261+0000 7fa25e59c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa26015ede0 0x7fa2600d5300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54588/0 (socket says 172.21.15.18:54588) 2024-09-19T09:24:20.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.261+0000 7fa25e59c640 1 -- 172.21.15.18:0/1724943236 learned_addr learned my addr 172.21.15.18:0/1724943236 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:24:20.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.262+0000 7fa25dd9b640 1 --2- 172.21.15.18:0/1724943236 >> v2:172.21.15.162:3300/0 conn(0x7fa2600d14e0 0x7fa2600d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:20.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.262+0000 7fa25ed9d640 1 -- 172.21.15.18:0/1724943236 >> v2:172.21.15.162:3300/0 conn(0x7fa2600d14e0 msgr2=0x7fa2600d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:20.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.262+0000 7fa25ed9d640 1 --2- 172.21.15.18:0/1724943236 >> v2:172.21.15.162:3300/0 conn(0x7fa2600d14e0 0x7fa2600d1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:20.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.262+0000 7fa25ed9d640 1 -- 172.21.15.18:0/1724943236 >> v1:172.21.15.18:6789/0 conn(0x7fa26015ede0 legacy=0x7fa2600d5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:20.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.262+0000 7fa25ed9d640 1 -- 172.21.15.18:0/1724943236 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2600d37c0 con 0x7fa2600b47e0 2024-09-19T09:24:20.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.262+0000 7fa25dd9b640 1 --2- 172.21.15.18:0/1724943236 >> v2:172.21.15.162:3300/0 conn(0x7fa2600d14e0 0x7fa2600d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:20.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.262+0000 7fa25ed9d640 1 --2- 172.21.15.18:0/1724943236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2600b47e0 0x7fa2600b4c70 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fa2600c84e0 tx=0x7fa25802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a3a2dabfa596ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:20.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.262+0000 7fa25d59a640 1 -- 172.21.15.18:0/1724943236 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa258037070 con 0x7fa2600b47e0 2024-09-19T09:24:20.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.263+0000 7fa25d59a640 1 -- 172.21.15.18:0/1724943236 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa258032440 con 0x7fa2600b47e0 2024-09-19T09:24:20.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.263+0000 7fa25d59a640 1 -- 172.21.15.18:0/1724943236 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa258032810 con 0x7fa2600b47e0 2024-09-19T09:24:20.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.263+0000 7fa264f6d640 1 -- 172.21.15.18:0/1724943236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2600b47e0 msgr2=0x7fa2600b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:20.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.263+0000 7fa264f6d640 1 --2- 172.21.15.18:0/1724943236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2600b47e0 0x7fa2600b4c70 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7fa2600c84e0 tx=0x7fa25802a230 comp rx=0 tx=0).stop 2024-09-19T09:24:20.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.263+0000 7fa264f6d640 1 -- 172.21.15.18:0/1724943236 shutdown_connections 2024-09-19T09:24:20.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.263+0000 7fa264f6d640 1 --2- 172.21.15.18:0/1724943236 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa2600b47e0 0x7fa2600b4c70 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:20.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.263+0000 7fa264f6d640 1 --2- 172.21.15.18:0/1724943236 >> v2:172.21.15.162:3300/0 conn(0x7fa2600d14e0 0x7fa2600d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:20.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.263+0000 7fa264f6d640 1 -- 172.21.15.18:0/1724943236 >> 172.21.15.18:0/1724943236 conn(0x7fa26009df30 msgr2=0x7fa2600d4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:20.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.263+0000 7fa264f6d640 1 -- 172.21.15.18:0/1724943236 shutdown_connections 2024-09-19T09:24:20.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.263+0000 7fa264f6d640 1 -- 172.21.15.18:0/1724943236 wait complete. 2024-09-19T09:24:20.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.265+0000 7fa264f6d640 1 Processor -- start 2024-09-19T09:24:20.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.265+0000 7fa264f6d640 1 -- start start 2024-09-19T09:24:20.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.265+0000 7fa264f6d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2600b47e0 0x7fa26015cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:20.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.265+0000 7fa264f6d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2600d14e0 0x7fa2600b7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:20.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.265+0000 7fa264f6d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa26015ede0 0x7fa2600b9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:20.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.265+0000 7fa264f6d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa2600d5a10 con 0x7fa26015ede0 2024-09-19T09:24:20.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.265+0000 7fa264f6d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa26015f1c0 con 0x7fa2600b47e0 2024-09-19T09:24:20.268 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.265+0000 7fa264f6d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa2600b4020 con 0x7fa2600d14e0 2024-09-19T09:24:20.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.265+0000 7fa25ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa26015ede0 0x7fa2600b9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:20.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.265+0000 7fa25ed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa26015ede0 0x7fa2600b9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56074/0 (socket says 172.21.15.18:56074) 2024-09-19T09:24:20.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.265+0000 7fa25ed9d640 1 -- 172.21.15.18:0/203393759 learned_addr learned my addr 172.21.15.18:0/203393759 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:20.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.266+0000 7fa25e59c640 1 --2- 172.21.15.18:0/203393759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2600b47e0 0x7fa26015cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:20.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.266+0000 7fa25dd9b640 1 --2- 172.21.15.18:0/203393759 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2600d14e0 0x7fa2600b7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:20.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.266+0000 7fa25ed9d640 1 -- 172.21.15.18:0/203393759 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2600d14e0 msgr2=0x7fa2600b7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:20.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.266+0000 7fa25ed9d640 1 --2- 172.21.15.18:0/203393759 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2600d14e0 0x7fa2600b7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:20.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.266+0000 7fa25ed9d640 1 -- 172.21.15.18:0/203393759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2600b47e0 msgr2=0x7fa26015cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:20.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.266+0000 7fa25ed9d640 1 --2- 172.21.15.18:0/203393759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2600b47e0 0x7fa26015cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:20.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.266+0000 7fa25ed9d640 1 -- 172.21.15.18:0/203393759 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2600b9430 con 0x7fa26015ede0 2024-09-19T09:24:20.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.266+0000 7fa25dd9b640 1 --2- 172.21.15.18:0/203393759 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2600d14e0 0x7fa2600b7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:20.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.266+0000 7fa25ed9d640 1 --2- 172.21.15.18:0/203393759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa26015ede0 0x7fa2600b9dc0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fa258035040 tx=0x7fa2580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:20.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.266+0000 7fa256ffd640 1 -- 172.21.15.18:0/203393759 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa258037040 con 0x7fa26015ede0 2024-09-19T09:24:20.269 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.266+0000 7fa256ffd640 1 -- 172.21.15.18:0/203393759 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa258042070 con 0x7fa26015ede0 2024-09-19T09:24:20.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.266+0000 7fa264f6d640 1 -- 172.21.15.18:0/203393759 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2600b8390 con 0x7fa26015ede0 2024-09-19T09:24:20.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.266+0000 7fa256ffd640 1 -- 172.21.15.18:0/203393759 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa258030b30 con 0x7fa26015ede0 2024-09-19T09:24:20.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.266+0000 7fa264f6d640 1 -- 172.21.15.18:0/203393759 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2600b8950 con 0x7fa26015ede0 2024-09-19T09:24:20.270 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.267+0000 7fa264f6d640 1 -- 172.21.15.18:0/203393759 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2600d1920 con 0x7fa26015ede0 2024-09-19T09:24:20.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.268+0000 7fa256ffd640 1 -- 172.21.15.18:0/203393759 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa258030cd0 con 0x7fa26015ede0 2024-09-19T09:24:20.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.268+0000 7fa256ffd640 1 --2- 172.21.15.18:0/203393759 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa24006c2b0 0x7fa24006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:20.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.268+0000 7fa256ffd640 1 -- 172.21.15.18:0/203393759 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 4943+0+0 (secure 0 0 0) 0x7fa2580abd40 con 0x7fa26015ede0 2024-09-19T09:24:20.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.268+0000 7fa25e59c640 1 --2- 172.21.15.18:0/203393759 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa24006c2b0 0x7fa24006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:20.271 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.269+0000 7fa25e59c640 1 --2- 172.21.15.18:0/203393759 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa24006c2b0 0x7fa24006e770 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fa2500012e0 tx=0x7fa250009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:20.273 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.273+0000 7fa256ffd640 1 -- 172.21.15.18:0/203393759 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa25807a7b0 con 0x7fa26015ede0 2024-09-19T09:24:20.452 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.451+0000 7fa264f6d640 1 -- 172.21.15.18:0/203393759 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fa2600d0b50 con 0x7fa26015ede0 2024-09-19T09:24:20.455 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.455+0000 7fa256ffd640 1 -- 172.21.15.18:0/203393759 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) ==== 122+0+0 (secure 0 0 0) 0x7fa25807a0b0 con 0x7fa26015ede0 2024-09-19T09:24:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.457+0000 7fa264f6d640 1 -- 172.21.15.18:0/203393759 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa24006c2b0 msgr2=0x7fa24006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.457+0000 7fa264f6d640 1 --2- 172.21.15.18:0/203393759 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa24006c2b0 0x7fa24006e770 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fa2500012e0 tx=0x7fa250009040 comp rx=0 tx=0).stop 2024-09-19T09:24:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.457+0000 7fa264f6d640 1 -- 172.21.15.18:0/203393759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa26015ede0 msgr2=0x7fa2600b9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.457+0000 7fa264f6d640 1 --2- 172.21.15.18:0/203393759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa26015ede0 0x7fa2600b9dc0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7fa258035040 tx=0x7fa2580046c0 comp rx=0 tx=0).stop 2024-09-19T09:24:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.457+0000 7fa264f6d640 1 -- 172.21.15.18:0/203393759 shutdown_connections 2024-09-19T09:24:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.457+0000 7fa264f6d640 1 --2- 172.21.15.18:0/203393759 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa24006c2b0 0x7fa24006e770 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.457+0000 7fa264f6d640 1 --2- 172.21.15.18:0/203393759 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa26015ede0 0x7fa2600b9dc0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.457+0000 7fa264f6d640 1 --2- 172.21.15.18:0/203393759 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa2600d14e0 0x7fa2600b7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.457+0000 7fa264f6d640 1 --2- 172.21.15.18:0/203393759 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa2600b47e0 0x7fa26015cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.457+0000 7fa264f6d640 1 -- 172.21.15.18:0/203393759 >> 172.21.15.18:0/203393759 conn(0x7fa26009df30 msgr2=0x7fa2600b63b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:20.458 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.457+0000 7fa264f6d640 1 -- 172.21.15.18:0/203393759 shutdown_connections 2024-09-19T09:24:20.459 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.457+0000 7fa264f6d640 1 -- 172.21.15.18:0/203393759 wait complete. 2024-09-19T09:24:20.469 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T09:24:20.469 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:24:20.513 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:24:20.567 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T09:24:20.567 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:24:20.567 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:24:20.583 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17075 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T09:24:20.583 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:24:20.583 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:24:20.601 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3252 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T09:24:20.601 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:24:20.601 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:24:20.640 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17075 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T09:24:20.640 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:24:20.640 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:24:20.660 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3252 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T09:24:20.660 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-19T09:24:20.660 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:24:20.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.782+0000 7fa78a9d8640 1 Processor -- start 2024-09-19T09:24:20.783 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.782+0000 7fa78a9d8640 1 -- start start 2024-09-19T09:24:20.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.783+0000 7fa78a9d8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa7840ce780 0x7fa78406f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:20.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.783+0000 7fa78a9d8640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa78406e3d0 con 0x7fa784145290 2024-09-19T09:24:20.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.783+0000 7fa78a9d8640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa78406e6b0 con 0x7fa784072f40 2024-09-19T09:24:20.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.783+0000 7fa78a9d8640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa78406efe0 con 0x7fa7840ce780 2024-09-19T09:24:20.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.783+0000 7fa783fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa784145290 0x7fa784072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54590/0 (socket says 172.21.15.18:54590) 2024-09-19T09:24:20.786 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.783+0000 7fa783fff640 1 -- 172.21.15.18:0/454575150 learned_addr learned my addr 172.21.15.18:0/454575150 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:24:20.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.783+0000 7fa788f75640 1 --2- 172.21.15.18:0/454575150 >> v2:172.21.15.162:3300/0 conn(0x7fa7840ce780 0x7fa78406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:20.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.784+0000 7fa782ffd640 1 -- 172.21.15.18:0/454575150 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 167319517 0 0) 0x7fa78406e3d0 con 0x7fa784145290 2024-09-19T09:24:20.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.784+0000 7fa782ffd640 1 -- 172.21.15.18:0/454575150 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa76c003520 con 0x7fa784145290 2024-09-19T09:24:20.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.784+0000 7fa782ffd640 1 -- 172.21.15.18:0/454575150 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3349550687 0 0) 0x7fa76c003520 con 0x7fa784145290 2024-09-19T09:24:20.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.784+0000 7fa782ffd640 1 -- 172.21.15.18:0/454575150 >> v2:172.21.15.162:3300/0 conn(0x7fa7840ce780 msgr2=0x7fa78406f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:20.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.784+0000 7fa782ffd640 1 --2- 172.21.15.18:0/454575150 >> v2:172.21.15.162:3300/0 conn(0x7fa7840ce780 0x7fa78406f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:20.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.784+0000 7fa782ffd640 1 -- 172.21.15.18:0/454575150 >> v1:172.21.15.162:6789/0 conn(0x7fa784072f40 legacy=0x7fa7840b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:20.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.784+0000 7fa782ffd640 1 -- 172.21.15.18:0/454575150 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78406e990 con 0x7fa784145290 2024-09-19T09:24:20.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.784+0000 7fa782ffd640 1 -- 172.21.15.18:0/454575150 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fa774001670 con 0x7fa784145290 2024-09-19T09:24:20.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.784+0000 7fa782ffd640 1 -- 172.21.15.18:0/454575150 >> v1:172.21.15.18:6789/0 conn(0x7fa784145290 legacy=0x7fa784072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:20.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.784+0000 7fa782ffd640 1 --2- 172.21.15.18:0/454575150 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa76c0039b0 0x7fa76c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:20.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.784+0000 7fa782ffd640 1 --2- 172.21.15.18:0/454575150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa76c004800 0x7fa76c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:20.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.784+0000 7fa782ffd640 1 --2- 172.21.15.18:0/454575150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa76c0051c0 0x7fa76c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:20.787 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.784+0000 7fa782ffd640 1 -- 172.21.15.18:0/454575150 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa78406efe0 con 0x7fa76c0051c0 2024-09-19T09:24:20.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.784+0000 7fa782ffd640 1 -- 172.21.15.18:0/454575150 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c00c060 con 0x7fa76c004800 2024-09-19T09:24:20.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.784+0000 7fa782ffd640 1 -- 172.21.15.18:0/454575150 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa76c00c260 con 0x7fa76c0039b0 2024-09-19T09:24:20.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.784+0000 7fa788f75640 1 --2- 172.21.15.18:0/454575150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa76c0051c0 0x7fa76c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:20.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.784+0000 7fa7837fe640 1 --2- 172.21.15.18:0/454575150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa76c004800 0x7fa76c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:20.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.784+0000 7fa783fff640 1 --2- 172.21.15.18:0/454575150 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa76c0039b0 0x7fa76c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:20.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.784+0000 7fa788f75640 1 -- 172.21.15.18:0/454575150 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa76c0039b0 msgr2=0x7fa76c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:20.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.784+0000 7fa788f75640 1 --2- 172.21.15.18:0/454575150 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa76c0039b0 0x7fa76c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:20.788 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.784+0000 7fa788f75640 1 -- 172.21.15.18:0/454575150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa76c004800 msgr2=0x7fa76c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:20.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.784+0000 7fa788f75640 1 --2- 172.21.15.18:0/454575150 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa76c004800 0x7fa76c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:20.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.784+0000 7fa788f75640 1 -- 172.21.15.18:0/454575150 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa76c003520 con 0x7fa76c0051c0 2024-09-19T09:24:20.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.785+0000 7fa788f75640 1 -- 172.21.15.18:0/454575150 reap_dead start 2024-09-19T09:24:20.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.785+0000 7fa788f75640 1 --2- 172.21.15.18:0/454575150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa76c0051c0 0x7fa76c00b9c0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fa77c009fc0 tx=0x7fa76c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1bf5413896cf8a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:20.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.785+0000 7fa782ffd640 1 -- 172.21.15.18:0/454575150 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c035020 con 0x7fa76c0051c0 2024-09-19T09:24:20.789 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.785+0000 7fa782ffd640 1 -- 172.21.15.18:0/454575150 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa77c003bd0 con 0x7fa76c0051c0 2024-09-19T09:24:20.790 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.785+0000 7fa782ffd640 1 -- 172.21.15.18:0/454575150 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c009c10 con 0x7fa76c0051c0 2024-09-19T09:24:20.792 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.786+0000 7fa78a9d8640 1 -- 172.21.15.18:0/454575150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa76c0051c0 msgr2=0x7fa76c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:20.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.786+0000 7fa78a9d8640 1 --2- 172.21.15.18:0/454575150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa76c0051c0 0x7fa76c00b9c0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7fa77c009fc0 tx=0x7fa76c005830 comp rx=0 tx=0).stop 2024-09-19T09:24:20.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.786+0000 7fa78a9d8640 1 -- 172.21.15.18:0/454575150 shutdown_connections 2024-09-19T09:24:20.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.786+0000 7fa78a9d8640 1 --2- 172.21.15.18:0/454575150 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa76c0051c0 0x7fa76c00b9c0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:20.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.786+0000 7fa78a9d8640 1 -- 172.21.15.18:0/454575150 >> 172.21.15.18:0/454575150 conn(0x7fa78406bc10 msgr2=0x7fa78406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:20.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.786+0000 7fa78a9d8640 1 -- 172.21.15.18:0/454575150 shutdown_connections 2024-09-19T09:24:20.793 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.786+0000 7fa78a9d8640 1 -- 172.21.15.18:0/454575150 wait complete. 2024-09-19T09:24:20.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.787+0000 7fa78a9d8640 1 Processor -- start 2024-09-19T09:24:20.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.787+0000 7fa78a9d8640 1 -- start start 2024-09-19T09:24:20.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.788+0000 7fa78a9d8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa76c0051c0 0x7fa78415b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:20.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.788+0000 7fa78a9d8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7841e74b0 0x7fa7841e7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:20.794 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.788+0000 7fa78a9d8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa784141500 0x7fa784141980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:20.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.788+0000 7fa78a9d8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa78406df80 con 0x7fa784141500 2024-09-19T09:24:20.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.788+0000 7fa78a9d8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa784145670 con 0x7fa7841e74b0 2024-09-19T09:24:20.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.788+0000 7fa78a9d8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa78406e100 con 0x7fa76c0051c0 2024-09-19T09:24:20.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.788+0000 7fa788f75640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa784141500 0x7fa784141980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:20.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.788+0000 7fa788f75640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa784141500 0x7fa784141980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56094/0 (socket says 172.21.15.18:56094) 2024-09-19T09:24:20.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.788+0000 7fa788f75640 1 -- 172.21.15.18:0/2456664660 learned_addr learned my addr 172.21.15.18:0/2456664660 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:20.795 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.788+0000 7fa783fff640 1 --2- 172.21.15.18:0/2456664660 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa76c0051c0 0x7fa78415b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:20.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.788+0000 7fa7837fe640 1 --2- 172.21.15.18:0/2456664660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7841e74b0 0x7fa7841e7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:20.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.788+0000 7fa788f75640 1 -- 172.21.15.18:0/2456664660 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa76c0051c0 msgr2=0x7fa78415b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:20.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.788+0000 7fa788f75640 1 --2- 172.21.15.18:0/2456664660 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa76c0051c0 0x7fa78415b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:20.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.788+0000 7fa788f75640 1 -- 172.21.15.18:0/2456664660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7841e74b0 msgr2=0x7fa7841e7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:20.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.788+0000 7fa788f75640 1 --2- 172.21.15.18:0/2456664660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7841e74b0 0x7fa7841e7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:20.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.789+0000 7fa788f75640 1 -- 172.21.15.18:0/2456664660 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7841422a0 con 0x7fa784141500 2024-09-19T09:24:20.796 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.789+0000 7fa788f75640 1 --2- 172.21.15.18:0/2456664660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa784141500 0x7fa784141980 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fa77c02af10 tx=0x7fa77c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:20.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.789+0000 7fa780ff9640 1 -- 172.21.15.18:0/2456664660 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c035030 con 0x7fa784141500 2024-09-19T09:24:20.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.789+0000 7fa780ff9640 1 -- 172.21.15.18:0/2456664660 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa77c043070 con 0x7fa784141500 2024-09-19T09:24:20.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.789+0000 7fa780ff9640 1 -- 172.21.15.18:0/2456664660 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c02d070 con 0x7fa784141500 2024-09-19T09:24:20.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.789+0000 7fa78a9d8640 1 -- 172.21.15.18:0/2456664660 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7841427e0 con 0x7fa784141500 2024-09-19T09:24:20.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.789+0000 7fa78a9d8640 1 -- 172.21.15.18:0/2456664660 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa784142da0 con 0x7fa784141500 2024-09-19T09:24:20.797 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.790+0000 7fa78a9d8640 1 -- 172.21.15.18:0/2456664660 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa784071510 con 0x7fa784141500 2024-09-19T09:24:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.791+0000 7fa780ff9640 1 -- 172.21.15.18:0/2456664660 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa77c005d10 con 0x7fa784141500 2024-09-19T09:24:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.791+0000 7fa780ff9640 1 --2- 172.21.15.18:0/2456664660 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa77006c2b0 0x7fa77006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.791+0000 7fa780ff9640 1 -- 172.21.15.18:0/2456664660 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 4943+0+0 (secure 0 0 0) 0x7fa77c0ab940 con 0x7fa784141500 2024-09-19T09:24:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.791+0000 7fa783fff640 1 --2- 172.21.15.18:0/2456664660 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa77006c2b0 0x7fa77006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:20.798 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.792+0000 7fa783fff640 1 --2- 172.21.15.18:0/2456664660 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa77006c2b0 0x7fa77006e770 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa7740011e0 tx=0x7fa774000ed0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:20.799 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:20.795+0000 7fa780ff9640 1 -- 172.21.15.18:0/2456664660 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa77c04c020 con 0x7fa784141500 2024-09-19T09:24:21.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.004+0000 7fa78a9d8640 1 -- 172.21.15.18:0/2456664660 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7840ce340 con 0x7fa784141500 2024-09-19T09:24:21.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.004+0000 7fa780ff9640 1 -- 172.21.15.18:0/2456664660 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+3914 (secure 0 0 0) 0x7fa77c079df0 con 0x7fa784141500 2024-09-19T09:24:21.005 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:24:21.005 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":76,"btime":"2024-09-19T09:24:16:123971+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6203,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1145590197","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6835","nonce":1145590197},{"type":"v1","addr":"172.21.15.162:6837","nonce":1145590197}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7033,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6836/200393908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":200393908},{"type":"v1","addr":"172.21.15.162:6836","nonce":200393908}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":69},{"gid":7542,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1236184741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1236184741},{"type":"v1","addr":"172.21.15.18:6834","nonce":1236184741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":68},{"gid":7770,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/2144302765","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":2144302765},{"type":"v1","addr":"172.21.15.18:6835","nonce":2144302765}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":76}],"filesystems":[]} 2024-09-19T09:24:21.006 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 76 2024-09-19T09:24:21.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.006+0000 7fa78a9d8640 1 -- 172.21.15.18:0/2456664660 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa77006c2b0 msgr2=0x7fa77006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:21.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.006+0000 7fa78a9d8640 1 --2- 172.21.15.18:0/2456664660 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa77006c2b0 0x7fa77006e770 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa7740011e0 tx=0x7fa774000ed0 comp rx=0 tx=0).stop 2024-09-19T09:24:21.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.006+0000 7fa78a9d8640 1 -- 172.21.15.18:0/2456664660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa784141500 msgr2=0x7fa784141980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:21.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.006+0000 7fa78a9d8640 1 --2- 172.21.15.18:0/2456664660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa784141500 0x7fa784141980 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fa77c02af10 tx=0x7fa77c009750 comp rx=0 tx=0).stop 2024-09-19T09:24:21.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.006+0000 7fa78a9d8640 1 -- 172.21.15.18:0/2456664660 shutdown_connections 2024-09-19T09:24:21.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.006+0000 7fa78a9d8640 1 --2- 172.21.15.18:0/2456664660 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa77006c2b0 0x7fa77006e770 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:21.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.006+0000 7fa78a9d8640 1 --2- 172.21.15.18:0/2456664660 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa784141500 0x7fa784141980 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:21.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.006+0000 7fa78a9d8640 1 --2- 172.21.15.18:0/2456664660 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7841e74b0 0x7fa7841e7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:21.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.006+0000 7fa78a9d8640 1 --2- 172.21.15.18:0/2456664660 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa76c0051c0 0x7fa78415b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:21.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.006+0000 7fa78a9d8640 1 -- 172.21.15.18:0/2456664660 >> 172.21.15.18:0/2456664660 conn(0x7fa78406bc10 msgr2=0x7fa784072830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:21.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.006+0000 7fa78a9d8640 1 -- 172.21.15.18:0/2456664660 shutdown_connections 2024-09-19T09:24:21.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.006+0000 7fa78a9d8640 1 -- 172.21.15.18:0/2456664660 wait complete. 2024-09-19T09:24:21.019 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-19T09:24:21.019 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-19T09:24:21.019 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T09:24:21.019 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:24:21.020 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-19T09:24:21.020 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-19T09:24:21.020 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T09:24:21.020 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:24:21.020 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-19T09:24:21.020 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-19T09:24:21.020 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T09:24:21.020 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:24:21.021 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-19T09:24:21.021 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-19T09:24:21.021 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T09:24:21.021 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:24:21.029 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T09:24:21.029 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-19T09:24:21.030 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T09:24:21.030 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-19T09:24:21.032 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T09:24:21.032 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-19T09:24:21.033 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T09:24:21.033 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-19T09:24:21.072 INFO:tasks.ceph.mds.a:Started 2024-09-19T09:24:21.072 DEBUG:teuthology.parallel:result is None 2024-09-19T09:24:21.073 INFO:tasks.ceph.mds.c:Started 2024-09-19T09:24:21.073 DEBUG:teuthology.parallel:result is None 2024-09-19T09:24:21.075 INFO:tasks.ceph.mds.d:Started 2024-09-19T09:24:21.075 DEBUG:teuthology.parallel:result is None 2024-09-19T09:24:21.075 INFO:tasks.ceph.mds.b:Started 2024-09-19T09:24:21.076 DEBUG:teuthology.parallel:result is None 2024-09-19T09:24:21.076 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-19T09:24:21.152 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-09-19T09:24:21.152 INFO:tasks.ceph.mds.c.smithi018.stdout:starting mds.c at 2024-09-19T09:24:21.157 INFO:tasks.ceph.mds.d.smithi162.stdout:starting mds.d at 2024-09-19T09:24:21.158 INFO:tasks.ceph.mds.b.smithi162.stdout:starting mds.b at 2024-09-19T09:24:21.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.184+0000 7f80694ba640 1 Processor -- start 2024-09-19T09:24:21.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.184+0000 7f80694ba640 1 -- start start 2024-09-19T09:24:21.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.185+0000 7f80694ba640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8064162270 0x7f80640d1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:21.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.185+0000 7f80694ba640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8064162650 0x7f80640d1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:21.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.185+0000 7f80694ba640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80640d3530 con 0x7f80640d5720 2024-09-19T09:24:21.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.185+0000 7f80694ba640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f80640b7a50 con 0x7f8064162270 2024-09-19T09:24:21.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.185+0000 7f80694ba640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f80640b7d30 con 0x7f8064162650 2024-09-19T09:24:21.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.185+0000 7f80627fc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8064162650 0x7f80640d1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:21.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.185+0000 7f8062ffd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8064162270 0x7f80640d1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:21.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.185+0000 7f80627fc640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8064162650 0x7f80640d1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3301/0 says I am v2:172.21.15.18:59854/0 (socket says 172.21.15.18:59854) 2024-09-19T09:24:21.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.185+0000 7f80627fc640 1 -- 172.21.15.18:0/2670827421 learned_addr learned my addr 172.21.15.18:0/2670827421 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:21.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.185+0000 7f80637fe640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f80640d5720 0x7f80640b81c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:48886/0 (socket says 172.21.15.18:48886) 2024-09-19T09:24:21.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.185+0000 7f80627fc640 1 -- 172.21.15.18:0/2670827421 >> v2:172.21.15.162:3300/0 conn(0x7f8064162270 msgr2=0x7f80640d1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:21.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.185+0000 7f80627fc640 1 --2- 172.21.15.18:0/2670827421 >> v2:172.21.15.162:3300/0 conn(0x7f8064162270 0x7f80640d1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:21.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.185+0000 7f80627fc640 1 -- 172.21.15.18:0/2670827421 >> v1:172.21.15.162:6789/0 conn(0x7f80640d5720 legacy=0x7f80640b81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:21.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.185+0000 7f8061ffb640 1 -- 172.21.15.18:0/2670827421 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3168932234 0 0) 0x7f80640d3530 con 0x7f80640d5720 2024-09-19T09:24:21.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.185+0000 7f80627fc640 1 -- 172.21.15.18:0/2670827421 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80640d3810 con 0x7f8064162650 2024-09-19T09:24:21.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.186+0000 7f80627fc640 1 --2- 172.21.15.18:0/2670827421 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8064162650 0x7f80640d1980 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f80640b7bd0 tx=0x7f805802a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a42262d50a9e62 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:21.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.186+0000 7f8061ffb640 1 -- 172.21.15.18:0/2670827421 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8058037070 con 0x7f8064162650 2024-09-19T09:24:21.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.186+0000 7f8061ffb640 1 -- 172.21.15.18:0/2670827421 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8058032440 con 0x7f8064162650 2024-09-19T09:24:21.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.186+0000 7f8061ffb640 1 -- 172.21.15.18:0/2670827421 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8058032850 con 0x7f8064162650 2024-09-19T09:24:21.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.187+0000 7f80694ba640 1 -- 172.21.15.18:0/2670827421 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8064162650 msgr2=0x7f80640d1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:21.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.187+0000 7f80694ba640 1 --2- 172.21.15.18:0/2670827421 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8064162650 0x7f80640d1980 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f80640b7bd0 tx=0x7f805802a290 comp rx=0 tx=0).stop 2024-09-19T09:24:21.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.187+0000 7f80694ba640 1 -- 172.21.15.18:0/2670827421 shutdown_connections 2024-09-19T09:24:21.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.187+0000 7f80694ba640 1 --2- 172.21.15.18:0/2670827421 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8064162650 0x7f80640d1980 secure :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f80640b7bd0 tx=0x7f805802a290 comp rx=0 tx=0).stop 2024-09-19T09:24:21.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.187+0000 7f80694ba640 1 --2- 172.21.15.18:0/2670827421 >> v2:172.21.15.162:3300/0 conn(0x7f8064162270 0x7f80640d1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:21.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.187+0000 7f80694ba640 1 -- 172.21.15.18:0/2670827421 >> 172.21.15.18:0/2670827421 conn(0x7f80640d4c00 msgr2=0x7f80640d5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:21.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.187+0000 7f80694ba640 1 -- 172.21.15.18:0/2670827421 shutdown_connections 2024-09-19T09:24:21.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.187+0000 7f80694ba640 1 -- 172.21.15.18:0/2670827421 wait complete. 2024-09-19T09:24:21.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.188+0000 7f80694ba640 1 Processor -- start 2024-09-19T09:24:21.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.188+0000 7f80694ba640 1 -- start start 2024-09-19T09:24:21.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.189+0000 7f80694ba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80640d5720 0x7f80640c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:21.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.189+0000 7f80694ba640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8064162270 0x7f80640c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:21.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.189+0000 7f80694ba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80641585a0 0x7f8064158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:21.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.189+0000 7f80694ba640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f80640d0820 con 0x7f80640d5720 2024-09-19T09:24:21.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.189+0000 7f80694ba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f80640d31e0 con 0x7f80641585a0 2024-09-19T09:24:21.192 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.189+0000 7f80694ba640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f80640d09a0 con 0x7f8064162270 2024-09-19T09:24:21.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.189+0000 7f8062ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80640d5720 0x7f80640c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:21.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.189+0000 7f8062ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80640d5720 0x7f80640c9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56134/0 (socket says 172.21.15.18:56134) 2024-09-19T09:24:21.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.189+0000 7f8062ffd640 1 -- 172.21.15.18:0/724660061 learned_addr learned my addr 172.21.15.18:0/724660061 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:21.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.189+0000 7f80627fc640 1 --2- 172.21.15.18:0/724660061 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8064162270 0x7f80640c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:21.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.189+0000 7f80637fe640 1 --2- 172.21.15.18:0/724660061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80641585a0 0x7f8064158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:21.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.189+0000 7f8062ffd640 1 -- 172.21.15.18:0/724660061 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8064162270 msgr2=0x7f80640c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:21.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.189+0000 7f8062ffd640 1 --2- 172.21.15.18:0/724660061 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8064162270 0x7f80640c9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:21.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.189+0000 7f8062ffd640 1 -- 172.21.15.18:0/724660061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80641585a0 msgr2=0x7f8064158a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:21.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.189+0000 7f8062ffd640 1 --2- 172.21.15.18:0/724660061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80641585a0 0x7f8064158a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:21.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.189+0000 7f8062ffd640 1 -- 172.21.15.18:0/724660061 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f806414a0a0 con 0x7f80640d5720 2024-09-19T09:24:21.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.190+0000 7f8062ffd640 1 --2- 172.21.15.18:0/724660061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80640d5720 0x7f80640c9930 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f805400e9b0 tx=0x7f805400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:21.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.190+0000 7f804b7fe640 1 -- 172.21.15.18:0/724660061 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8054017070 con 0x7f80640d5720 2024-09-19T09:24:21.193 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.190+0000 7f804b7fe640 1 -- 172.21.15.18:0/724660061 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f805400c9a0 con 0x7f80640d5720 2024-09-19T09:24:21.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.190+0000 7f804b7fe640 1 -- 172.21.15.18:0/724660061 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f805400cd90 con 0x7f80640d5720 2024-09-19T09:24:21.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.190+0000 7f80694ba640 1 -- 172.21.15.18:0/724660061 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f806414a380 con 0x7f80640d5720 2024-09-19T09:24:21.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.190+0000 7f80694ba640 1 -- 172.21.15.18:0/724660061 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f806415a570 con 0x7f80640d5720 2024-09-19T09:24:21.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.191+0000 7f80694ba640 1 -- 172.21.15.18:0/724660061 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80640d1440 con 0x7f80640d5720 2024-09-19T09:24:21.194 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.192+0000 7f804b7fe640 1 -- 172.21.15.18:0/724660061 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f805401a070 con 0x7f80640d5720 2024-09-19T09:24:21.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.192+0000 7f804b7fe640 1 --2- 172.21.15.18:0/724660061 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f805006c2e0 0x7f805006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:21.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.192+0000 7f804b7fe640 1 -- 172.21.15.18:0/724660061 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(174..174 src has 1..174) ==== 4943+0+0 (secure 0 0 0) 0x7f805408b550 con 0x7f80640d5720 2024-09-19T09:24:21.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.192+0000 7f80627fc640 1 --2- 172.21.15.18:0/724660061 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f805006c2e0 0x7f805006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:21.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.193+0000 7f80627fc640 1 --2- 172.21.15.18:0/724660061 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f805006c2e0 0x7f805006e7a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8058034000 tx=0x7f805802e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:21.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.196+0000 7f804b7fe640 1 -- 172.21.15.18:0/724660061 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8054059f20 con 0x7f80640d5720 2024-09-19T09:24:21.235 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-09-19T09:24:21.236 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-19T09:24:21.385 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:21.384+0000 7f80694ba640 1 -- 172.21.15.18:0/724660061 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f80640b8620 con 0x7f80640d5720 2024-09-19T09:24:22.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.157+0000 7f804b7fe640 1 -- 172.21.15.18:0/724660061 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v176) ==== 97+0+0 (secure 0 0 0) 0x7f8054059820 con 0x7f80640d5720 2024-09-19T09:24:22.158 INFO:teuthology.orchestra.run.smithi018.stderr: removed all blocklist entries 2024-09-19T09:24:22.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.160+0000 7f80694ba640 1 -- 172.21.15.18:0/724660061 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f805006c2e0 msgr2=0x7f805006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:22.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.160+0000 7f80694ba640 1 --2- 172.21.15.18:0/724660061 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f805006c2e0 0x7f805006e7a0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f8058034000 tx=0x7f805802e000 comp rx=0 tx=0).stop 2024-09-19T09:24:22.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.160+0000 7f80694ba640 1 -- 172.21.15.18:0/724660061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80640d5720 msgr2=0x7f80640c9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:22.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.160+0000 7f80694ba640 1 --2- 172.21.15.18:0/724660061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80640d5720 0x7f80640c9930 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f805400e9b0 tx=0x7f805400ee70 comp rx=0 tx=0).stop 2024-09-19T09:24:22.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.160+0000 7f80694ba640 1 -- 172.21.15.18:0/724660061 shutdown_connections 2024-09-19T09:24:22.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.160+0000 7f80694ba640 1 --2- 172.21.15.18:0/724660061 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f805006c2e0 0x7f805006e7a0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:22.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.160+0000 7f80694ba640 1 --2- 172.21.15.18:0/724660061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f80641585a0 0x7f8064158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:22.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.160+0000 7f80694ba640 1 --2- 172.21.15.18:0/724660061 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8064162270 0x7f80640c9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:22.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.160+0000 7f80694ba640 1 --2- 172.21.15.18:0/724660061 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f80640d5720 0x7f80640c9930 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:22.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.160+0000 7f80694ba640 1 -- 172.21.15.18:0/724660061 >> 172.21.15.18:0/724660061 conn(0x7f80640d4c00 msgr2=0x7f806406c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:22.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.160+0000 7f80694ba640 1 -- 172.21.15.18:0/724660061 shutdown_connections 2024-09-19T09:24:22.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.160+0000 7f80694ba640 1 -- 172.21.15.18:0/724660061 wait complete. 2024-09-19T09:24:22.176 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-19T09:24:22.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.284+0000 7fa4289a1640 1 Processor -- start 2024-09-19T09:24:22.285 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.284+0000 7fa4289a1640 1 -- start start 2024-09-19T09:24:22.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.285+0000 7fa4289a1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa424145290 0x7fa42406f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:22.286 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.285+0000 7fa4289a1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa424072f40 0x7fa4240b3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:22.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.285+0000 7fa4289a1640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa42406e3d0 con 0x7fa4240ce780 2024-09-19T09:24:22.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.285+0000 7fa4289a1640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fa42406efe0 con 0x7fa424145290 2024-09-19T09:24:22.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.285+0000 7fa4289a1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa42406e6b0 con 0x7fa424072f40 2024-09-19T09:24:22.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.285+0000 7fa42259c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa424145290 0x7fa42406f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:22.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.285+0000 7fa42259c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa424145290 0x7fa42406f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56142/0 (socket says 172.21.15.18:56142) 2024-09-19T09:24:22.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.285+0000 7fa42259c640 1 -- 172.21.15.18:0/1831579574 learned_addr learned my addr 172.21.15.18:0/1831579574 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:22.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.285+0000 7fa421d9b640 1 --1- 172.21.15.18:0/1831579574 >> v1:172.21.15.18:6789/0 conn(0x7fa4240ce780 0x7fa424072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:54618/0 (socket says 172.21.15.18:54618) 2024-09-19T09:24:22.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.285+0000 7fa422d9d640 1 --2- 172.21.15.18:0/1831579574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa424072f40 0x7fa4240b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:22.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.285+0000 7fa42259c640 1 -- 172.21.15.18:0/1831579574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa424072f40 msgr2=0x7fa4240b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:22.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.285+0000 7fa42259c640 1 --2- 172.21.15.18:0/1831579574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa424072f40 0x7fa4240b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:22.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.285+0000 7fa42259c640 1 -- 172.21.15.18:0/1831579574 >> v1:172.21.15.18:6789/0 conn(0x7fa4240ce780 legacy=0x7fa424072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:22.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.285+0000 7fa42259c640 1 -- 172.21.15.18:0/1831579574 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa42406e990 con 0x7fa424145290 2024-09-19T09:24:22.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.285+0000 7fa42159a640 1 -- 172.21.15.18:0/1831579574 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4093639609 0 0) 0x7fa42406e3d0 con 0x7fa4240ce780 2024-09-19T09:24:22.287 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.285+0000 7fa422d9d640 1 --2- 172.21.15.18:0/1831579574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa424072f40 0x7fa4240b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:22.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.286+0000 7fa42259c640 1 --2- 172.21.15.18:0/1831579574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa424145290 0x7fa42406f470 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fa40c009870 tx=0x7fa40c02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d092a9595737dfc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:22.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.286+0000 7fa42159a640 1 -- 172.21.15.18:0/1831579574 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40c037070 con 0x7fa424145290 2024-09-19T09:24:22.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.286+0000 7fa42159a640 1 -- 172.21.15.18:0/1831579574 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa40c032440 con 0x7fa424145290 2024-09-19T09:24:22.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.286+0000 7fa42159a640 1 -- 172.21.15.18:0/1831579574 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40c032810 con 0x7fa424145290 2024-09-19T09:24:22.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.287+0000 7fa4289a1640 1 -- 172.21.15.18:0/1831579574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa424145290 msgr2=0x7fa42406f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:22.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.287+0000 7fa4289a1640 1 --2- 172.21.15.18:0/1831579574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa424145290 0x7fa42406f470 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fa40c009870 tx=0x7fa40c02a250 comp rx=0 tx=0).stop 2024-09-19T09:24:22.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.287+0000 7fa4289a1640 1 -- 172.21.15.18:0/1831579574 shutdown_connections 2024-09-19T09:24:22.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.287+0000 7fa4289a1640 1 --2- 172.21.15.18:0/1831579574 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa424072f40 0x7fa4240b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:22.289 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.287+0000 7fa4289a1640 1 --2- 172.21.15.18:0/1831579574 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa424145290 0x7fa42406f470 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:22.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.287+0000 7fa4289a1640 1 -- 172.21.15.18:0/1831579574 >> 172.21.15.18:0/1831579574 conn(0x7fa42406bc10 msgr2=0x7fa42406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:22.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.287+0000 7fa4289a1640 1 -- 172.21.15.18:0/1831579574 shutdown_connections 2024-09-19T09:24:22.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.287+0000 7fa4289a1640 1 -- 172.21.15.18:0/1831579574 wait complete. 2024-09-19T09:24:22.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.288+0000 7fa4289a1640 1 Processor -- start 2024-09-19T09:24:22.290 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.288+0000 7fa4289a1640 1 -- start start 2024-09-19T09:24:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.289+0000 7fa4289a1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa424072f40 0x7fa42415b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.289+0000 7fa4289a1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4240ce780 0x7fa42413d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.289+0000 7fa4289a1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa424145290 0x7fa4240afc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.289+0000 7fa4289a1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa42406df80 con 0x7fa424072f40 2024-09-19T09:24:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.289+0000 7fa4289a1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa424145670 con 0x7fa4240ce780 2024-09-19T09:24:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.289+0000 7fa4289a1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa42406e100 con 0x7fa424145290 2024-09-19T09:24:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.289+0000 7fa42259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa424072f40 0x7fa42415b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.289+0000 7fa42259c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa424072f40 0x7fa42415b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56152/0 (socket says 172.21.15.18:56152) 2024-09-19T09:24:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.289+0000 7fa42259c640 1 -- 172.21.15.18:0/1774794654 learned_addr learned my addr 172.21.15.18:0/1774794654 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.289+0000 7fa42259c640 1 -- 172.21.15.18:0/1774794654 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa424145290 msgr2=0x7fa4240afc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.289+0000 7fa42259c640 1 --2- 172.21.15.18:0/1774794654 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa424145290 0x7fa4240afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:22.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.289+0000 7fa42259c640 1 -- 172.21.15.18:0/1774794654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4240ce780 msgr2=0x7fa42413d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:22.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.289+0000 7fa42259c640 1 --2- 172.21.15.18:0/1774794654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4240ce780 0x7fa42413d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:22.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.289+0000 7fa42259c640 1 -- 172.21.15.18:0/1774794654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa42413c1a0 con 0x7fa424072f40 2024-09-19T09:24:22.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.290+0000 7fa42259c640 1 --2- 172.21.15.18:0/1774794654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa424072f40 0x7fa42415b5e0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fa40c009870 tx=0x7fa40c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:22.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.290+0000 7fa41affd640 1 -- 172.21.15.18:0/1774794654 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40c037040 con 0x7fa424072f40 2024-09-19T09:24:22.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.290+0000 7fa41affd640 1 -- 172.21.15.18:0/1774794654 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa40c004250 con 0x7fa424072f40 2024-09-19T09:24:22.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.290+0000 7fa41affd640 1 -- 172.21.15.18:0/1774794654 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa40c03c730 con 0x7fa424072f40 2024-09-19T09:24:22.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.290+0000 7fa4289a1640 1 -- 172.21.15.18:0/1774794654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa42413c480 con 0x7fa424072f40 2024-09-19T09:24:22.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.290+0000 7fa4289a1640 1 -- 172.21.15.18:0/1774794654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa42413ca40 con 0x7fa424072f40 2024-09-19T09:24:22.293 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.291+0000 7fa4289a1640 1 -- 172.21.15.18:0/1774794654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa424071510 con 0x7fa424072f40 2024-09-19T09:24:22.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.291+0000 7fa41affd640 1 -- 172.21.15.18:0/1774794654 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa40c03a070 con 0x7fa424072f40 2024-09-19T09:24:22.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.292+0000 7fa41affd640 1 --2- 172.21.15.18:0/1774794654 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa40406c2b0 0x7fa40406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:22.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.292+0000 7fa41affd640 1 -- 172.21.15.18:0/1774794654 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 4857+0+0 (secure 0 0 0) 0x7fa40c0abc50 con 0x7fa424072f40 2024-09-19T09:24:22.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.292+0000 7fa421d9b640 1 --2- 172.21.15.18:0/1774794654 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa40406c2b0 0x7fa40406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:22.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.293+0000 7fa421d9b640 1 --2- 172.21.15.18:0/1774794654 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa40406c2b0 0x7fa40406e770 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fa414007fd0 tx=0x7fa414007900 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:22.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.296+0000 7fa41affd640 1 -- 172.21.15.18:0/1774794654 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa40c041020 con 0x7fa424072f40 2024-09-19T09:24:22.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.538+0000 7fa4289a1640 1 -- 172.21.15.18:0/1774794654 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fa4241437f0 con 0x7fa424072f40 2024-09-19T09:24:22.539 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.538+0000 7fa41affd640 1 -- 172.21.15.18:0/1774794654 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) ==== 80+0+5304 (secure 0 0 0) 0x7fa40c07a5e0 con 0x7fa424072f40 2024-09-19T09:24:22.540 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:24:22.540 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:24:22.540 INFO:teuthology.orchestra.run.smithi018.stdout: "auth_dump": [ 2024-09-19T09:24:22.540 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:22.540 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.a", 2024-09-19T09:24:22.540 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmDY7cHhAALxtxGq6eR3A2QXYp+nW0FA==", 2024-09-19T09:24:22.540 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:24:22.540 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:24:22.540 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:24:22.540 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:24:22.540 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:24:22.541 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:22.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:22.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:22.541 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.b", 2024-09-19T09:24:22.541 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tm9ILFKhAABEtgvzO5YBXqzYaeBZ0qZg==", 2024-09-19T09:24:22.541 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:24:22.541 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:24:22.541 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:24:22.541 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:24:22.541 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:24:22.541 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:22.541 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:22.541 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:22.542 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.c", 2024-09-19T09:24:22.542 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmwPkOJhAADt/0XVei2kl79pIw55wu1A==", 2024-09-19T09:24:22.542 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:24:22.542 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:24:22.542 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:24:22.542 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:24:22.542 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:24:22.542 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:22.542 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:22.542 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:22.542 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mds.d", 2024-09-19T09:24:22.542 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tm35XYMRAA/OSE5iv8M+TekEJVTARETw==", 2024-09-19T09:24:22.542 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:24:22.542 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:24:22.543 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:24:22.543 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:24:22.543 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:24:22.543 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:22.543 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:22.543 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:22.543 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.0", 2024-09-19T09:24:22.543 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmkUBiGhAATWtnqNPWyZJ+tnQcZOtT5A==", 2024-09-19T09:24:22.543 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:24:22.543 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:24:22.543 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:24:22.543 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:24:22.543 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:22.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:22.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:22.544 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.1", 2024-09-19T09:24:22.544 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmir5wIRAA9QumyCr8yLHtNj/YqQ1d0A==", 2024-09-19T09:24:22.544 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:24:22.544 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:24:22.544 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:24:22.544 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:24:22.544 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:22.544 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:22.544 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:22.544 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.2", 2024-09-19T09:24:22.544 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmfQJ6KBAAfTerKv1zCzFf6UfAVUikxA==", 2024-09-19T09:24:22.544 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:24:22.545 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:24:22.545 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:24:22.545 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:24:22.545 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:22.545 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:22.545 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:22.545 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.3", 2024-09-19T09:24:22.545 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAg6+tmSeSOLxAACqCpiIQO4cDyjXUmoGPKAQ==", 2024-09-19T09:24:22.545 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:24:22.545 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:24:22.545 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:24:22.545 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:24:22.545 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:22.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:22.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:22.546 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.4", 2024-09-19T09:24:22.546 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmrsoFAhAArI7cRPVe/jrnSdmyE8jCsQ==", 2024-09-19T09:24:22.546 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:24:22.546 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:24:22.546 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:24:22.546 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:24:22.546 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:22.546 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:22.546 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:22.546 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.5", 2024-09-19T09:24:22.546 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmudM3CRAAXF3uI58SNJE6qtYX2wNQeQ==", 2024-09-19T09:24:22.547 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:24:22.547 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:24:22.547 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:24:22.547 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:24:22.547 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:22.547 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:22.547 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:22.547 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.6", 2024-09-19T09:24:22.547 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmqEQmEBAAm4h/8p91HwX84pl/U80Q9Q==", 2024-09-19T09:24:22.547 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:24:22.547 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:24:22.547 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:24:22.547 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:24:22.547 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:22.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:22.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:22.548 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "osd.7", 2024-09-19T09:24:22.548 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAk6+tmhDs0FxAAxZvRVkBoWqsdmyifRZzgwg==", 2024-09-19T09:24:22.548 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:24:22.548 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow profile osd", 2024-09-19T09:24:22.548 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile osd", 2024-09-19T09:24:22.548 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:24:22.548 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:22.548 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:22.548 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:22.548 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.0", 2024-09-19T09:24:22.548 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmcbwDNhAAaG0+wu96Locwws+h0zeh8Q==", 2024-09-19T09:24:22.548 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:24:22.549 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:24:22.549 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow r", 2024-09-19T09:24:22.549 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-19T09:24:22.549 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:22.549 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:22.549 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:22.549 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.1", 2024-09-19T09:24:22.549 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAf6+tmb4FeAxAAU+nZN/Vb33HrU0yfXmU9gA==", 2024-09-19T09:24:22.549 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:24:22.549 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:24:22.549 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-19T09:24:22.549 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-19T09:24:22.549 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-19T09:24:22.550 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:22.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:22.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:22.550 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.2", 2024-09-19T09:24:22.550 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAf6+tmc34kABAAC5b4Kkm2dJvxxyXva6PT2g==", 2024-09-19T09:24:22.550 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:24:22.550 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:24:22.550 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-19T09:24:22.550 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-19T09:24:22.550 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-19T09:24:22.550 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:22.550 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:22.550 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:22.550 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.3", 2024-09-19T09:24:22.550 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAf6+tmx4vzCBAAZ7ZrdGI2s8LqT0MjjzOCjw==", 2024-09-19T09:24:22.551 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:24:22.551 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow", 2024-09-19T09:24:22.551 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow r", 2024-09-19T09:24:22.551 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow rw", 2024-09-19T09:24:22.551 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow rwx" 2024-09-19T09:24:22.551 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:22.551 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:22.551 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:22.551 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "client.admin", 2024-09-19T09:24:22.551 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmZaWgAhAAx7MUazt6rS+wa/ZMSGC97Q==", 2024-09-19T09:24:22.551 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:24:22.551 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-19T09:24:22.551 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": "allow *", 2024-09-19T09:24:22.551 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow *", 2024-09-19T09:24:22.552 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:24:22.552 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:22.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:22.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:22.552 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.x", 2024-09-19T09:24:22.552 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmwr6NGxAA3M5NZKkjc36L25teWJS7bQ==", 2024-09-19T09:24:22.552 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:24:22.552 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-19T09:24:22.552 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-09-19T09:24:22.552 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:24:22.552 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:22.552 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:22.552 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:22.553 INFO:teuthology.orchestra.run.smithi018.stdout: "entity": "mgr.y", 2024-09-19T09:24:22.553 INFO:teuthology.orchestra.run.smithi018.stdout: "key": "AQAe6+tmBWOWFxAAEYKCroBhMcqoIe6WzXnNCg==", 2024-09-19T09:24:22.553 INFO:teuthology.orchestra.run.smithi018.stdout: "caps": { 2024-09-19T09:24:22.553 INFO:teuthology.orchestra.run.smithi018.stdout: "mds": "allow *", 2024-09-19T09:24:22.553 INFO:teuthology.orchestra.run.smithi018.stdout: "mon": "allow profile mgr", 2024-09-19T09:24:22.553 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": "allow *" 2024-09-19T09:24:22.553 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:22.553 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:22.553 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:22.553 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:24:22.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.540+0000 7fa4289a1640 1 -- 172.21.15.18:0/1774794654 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa40406c2b0 msgr2=0x7fa40406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:22.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.540+0000 7fa4289a1640 1 --2- 172.21.15.18:0/1774794654 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa40406c2b0 0x7fa40406e770 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fa414007fd0 tx=0x7fa414007900 comp rx=0 tx=0).stop 2024-09-19T09:24:22.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.540+0000 7fa4289a1640 1 -- 172.21.15.18:0/1774794654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa424072f40 msgr2=0x7fa42415b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:22.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.540+0000 7fa4289a1640 1 --2- 172.21.15.18:0/1774794654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa424072f40 0x7fa42415b5e0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fa40c009870 tx=0x7fa40c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:24:22.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.540+0000 7fa4289a1640 1 -- 172.21.15.18:0/1774794654 shutdown_connections 2024-09-19T09:24:22.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.540+0000 7fa4289a1640 1 --2- 172.21.15.18:0/1774794654 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa40406c2b0 0x7fa40406e770 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:22.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.540+0000 7fa4289a1640 1 --2- 172.21.15.18:0/1774794654 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa424145290 0x7fa4240afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:22.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.540+0000 7fa4289a1640 1 --2- 172.21.15.18:0/1774794654 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4240ce780 0x7fa42413d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:22.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.540+0000 7fa4289a1640 1 --2- 172.21.15.18:0/1774794654 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa424072f40 0x7fa42415b5e0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:22.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.540+0000 7fa4289a1640 1 -- 172.21.15.18:0/1774794654 >> 172.21.15.18:0/1774794654 conn(0x7fa42406bc10 msgr2=0x7fa4240cf010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:22.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.540+0000 7fa4289a1640 1 -- 172.21.15.18:0/1774794654 shutdown_connections 2024-09-19T09:24:22.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.540+0000 7fa4289a1640 1 -- 172.21.15.18:0/1774794654 wait complete. 2024-09-19T09:24:22.556 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-19T09:24:22.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.657+0000 7fbe88237640 1 Processor -- start 2024-09-19T09:24:22.658 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.657+0000 7fbe88237640 1 -- start start 2024-09-19T09:24:22.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.658+0000 7fbe88237640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbe8015eb00 0x7fbe801630d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:22.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.658+0000 7fbe88237640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe8015fef0 0x7fbe800cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:22.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.658+0000 7fbe88237640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe8006e730 con 0x7fbe8006d810 2024-09-19T09:24:22.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.658+0000 7fbe88237640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fbe8006ea10 con 0x7fbe8015eb00 2024-09-19T09:24:22.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.658+0000 7fbe88237640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbe801628d0 con 0x7fbe8015fef0 2024-09-19T09:24:22.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.658+0000 7fbe867d4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe8015fef0 0x7fbe800cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:22.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.658+0000 7fbe857d2640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fbe8006d810 0x7fbe800b0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:48894/0 (socket says 172.21.15.18:48894) 2024-09-19T09:24:22.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.658+0000 7fbe857d2640 1 -- 172.21.15.18:0/63399831 learned_addr learned my addr 172.21.15.18:0/63399831 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:24:22.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.658+0000 7fbe85fd3640 1 --2- 172.21.15.18:0/63399831 >> v2:172.21.15.162:3300/0 conn(0x7fbe8015eb00 0x7fbe801630d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:22.660 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.659+0000 7fbe84fd1640 1 -- 172.21.15.18:0/63399831 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1352236918 0 0) 0x7fbe8006e730 con 0x7fbe8006d810 2024-09-19T09:24:22.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.659+0000 7fbe84fd1640 1 -- 172.21.15.18:0/63399831 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe68003520 con 0x7fbe8006d810 2024-09-19T09:24:22.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.659+0000 7fbe867d4640 1 -- 172.21.15.18:0/63399831 >> v2:172.21.15.162:3300/0 conn(0x7fbe8015eb00 msgr2=0x7fbe801630d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:22.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.659+0000 7fbe867d4640 1 --2- 172.21.15.18:0/63399831 >> v2:172.21.15.162:3300/0 conn(0x7fbe8015eb00 0x7fbe801630d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:22.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.659+0000 7fbe867d4640 1 -- 172.21.15.18:0/63399831 >> v1:172.21.15.162:6789/0 conn(0x7fbe8006d810 legacy=0x7fbe800b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:22.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.659+0000 7fbe867d4640 1 -- 172.21.15.18:0/63399831 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe80162bb0 con 0x7fbe8015fef0 2024-09-19T09:24:22.661 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.659+0000 7fbe85fd3640 1 --2- 172.21.15.18:0/63399831 >> v2:172.21.15.162:3300/0 conn(0x7fbe8015eb00 0x7fbe801630d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:24:22.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.659+0000 7fbe867d4640 1 --2- 172.21.15.18:0/63399831 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe8015fef0 0x7fbe800cf870 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbe780097a0 tx=0x7fbe7802a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8073ac6e52ae7119 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:22.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.660+0000 7fbe84fd1640 1 -- 172.21.15.18:0/63399831 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe78037070 con 0x7fbe8015fef0 2024-09-19T09:24:22.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.660+0000 7fbe84fd1640 1 -- 172.21.15.18:0/63399831 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe7802ae50 con 0x7fbe8015fef0 2024-09-19T09:24:22.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.660+0000 7fbe84fd1640 1 -- 172.21.15.18:0/63399831 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe78032660 con 0x7fbe8015fef0 2024-09-19T09:24:22.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.660+0000 7fbe88237640 1 -- 172.21.15.18:0/63399831 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe8015fef0 msgr2=0x7fbe800cf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:22.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.660+0000 7fbe88237640 1 --2- 172.21.15.18:0/63399831 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe8015fef0 0x7fbe800cf870 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbe780097a0 tx=0x7fbe7802a100 comp rx=0 tx=0).stop 2024-09-19T09:24:22.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.660+0000 7fbe88237640 1 -- 172.21.15.18:0/63399831 shutdown_connections 2024-09-19T09:24:22.665 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.660+0000 7fbe88237640 1 --2- 172.21.15.18:0/63399831 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe8015fef0 0x7fbe800cf870 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:22.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.660+0000 7fbe88237640 1 --2- 172.21.15.18:0/63399831 >> v2:172.21.15.162:3300/0 conn(0x7fbe8015eb00 0x7fbe801630d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:22.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.660+0000 7fbe88237640 1 -- 172.21.15.18:0/63399831 >> 172.21.15.18:0/63399831 conn(0x7fbe8006cd20 msgr2=0x7fbe8006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:22.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.660+0000 7fbe88237640 1 -- 172.21.15.18:0/63399831 shutdown_connections 2024-09-19T09:24:22.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.660+0000 7fbe88237640 1 -- 172.21.15.18:0/63399831 wait complete. 2024-09-19T09:24:22.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.661+0000 7fbe88237640 1 Processor -- start 2024-09-19T09:24:22.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.662+0000 7fbe88237640 1 -- start start 2024-09-19T09:24:22.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.662+0000 7fbe88237640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe8006d810 0x7fbe80154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:22.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.662+0000 7fbe88237640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe8015eb00 0x7fbe801553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:22.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.662+0000 7fbe88237640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe80158b70 0x7fbe801558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:22.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.662+0000 7fbe88237640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fbe800b1300 con 0x7fbe8015eb00 2024-09-19T09:24:22.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.662+0000 7fbe88237640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbe800b1180 con 0x7fbe80158b70 2024-09-19T09:24:22.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.662+0000 7fbe88237640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fbe8006ffd0 con 0x7fbe8006d810 2024-09-19T09:24:22.666 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.662+0000 7fbe857d2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe8015eb00 0x7fbe801553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:22.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.662+0000 7fbe857d2640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe8015eb00 0x7fbe801553b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56154/0 (socket says 172.21.15.18:56154) 2024-09-19T09:24:22.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.662+0000 7fbe857d2640 1 -- 172.21.15.18:0/2472593669 learned_addr learned my addr 172.21.15.18:0/2472593669 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:22.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.662+0000 7fbe85fd3640 1 --2- 172.21.15.18:0/2472593669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe8006d810 0x7fbe80154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:22.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.662+0000 7fbe867d4640 1 --2- 172.21.15.18:0/2472593669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe80158b70 0x7fbe801558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:22.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.663+0000 7fbe857d2640 1 -- 172.21.15.18:0/2472593669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe8006d810 msgr2=0x7fbe80154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:22.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.663+0000 7fbe857d2640 1 --2- 172.21.15.18:0/2472593669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe8006d810 0x7fbe80154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:22.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.663+0000 7fbe857d2640 1 -- 172.21.15.18:0/2472593669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe80158b70 msgr2=0x7fbe801558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:22.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.663+0000 7fbe857d2640 1 --2- 172.21.15.18:0/2472593669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe80158b70 0x7fbe801558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:22.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.663+0000 7fbe857d2640 1 -- 172.21.15.18:0/2472593669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe8015c290 con 0x7fbe8015eb00 2024-09-19T09:24:22.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.663+0000 7fbe857d2640 1 --2- 172.21.15.18:0/2472593669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe8015eb00 0x7fbe801553b0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400c500 tx=0x7fbe7400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:22.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.663+0000 7fbe7e7fc640 1 -- 172.21.15.18:0/2472593669 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe74017070 con 0x7fbe8015eb00 2024-09-19T09:24:22.667 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.663+0000 7fbe7e7fc640 1 -- 172.21.15.18:0/2472593669 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe74005ce0 con 0x7fbe8015eb00 2024-09-19T09:24:22.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.663+0000 7fbe88237640 1 -- 172.21.15.18:0/2472593669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe8015c570 con 0x7fbe8015eb00 2024-09-19T09:24:22.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.663+0000 7fbe7e7fc640 1 -- 172.21.15.18:0/2472593669 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe74007330 con 0x7fbe8015eb00 2024-09-19T09:24:22.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.663+0000 7fbe88237640 1 -- 172.21.15.18:0/2472593669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe8015cb30 con 0x7fbe8015eb00 2024-09-19T09:24:22.668 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.664+0000 7fbe88237640 1 -- 172.21.15.18:0/2472593669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe800d0c30 con 0x7fbe8015eb00 2024-09-19T09:24:22.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.665+0000 7fbe7e7fc640 1 -- 172.21.15.18:0/2472593669 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fbe7401a070 con 0x7fbe8015eb00 2024-09-19T09:24:22.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.665+0000 7fbe7e7fc640 1 --2- 172.21.15.18:0/2472593669 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbe6c06c2e0 0x7fbe6c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:22.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.665+0000 7fbe7e7fc640 1 -- 172.21.15.18:0/2472593669 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 4857+0+0 (secure 0 0 0) 0x7fbe7408a3f0 con 0x7fbe8015eb00 2024-09-19T09:24:22.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.666+0000 7fbe85fd3640 1 --2- 172.21.15.18:0/2472593669 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbe6c06c2e0 0x7fbe6c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:22.669 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.666+0000 7fbe85fd3640 1 --2- 172.21.15.18:0/2472593669 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbe6c06c2e0 0x7fbe6c06e7a0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fbe70009bd0 tx=0x7fbe7000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:22.670 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.670+0000 7fbe7e7fc640 1 -- 172.21.15.18:0/2472593669 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fbe800d0c30 con 0x7fbe8015eb00 2024-09-19T09:24:22.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.848+0000 7fbe88237640 1 -- 172.21.15.18:0/2472593669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fbe800d1460 con 0x7fbe8015eb00 2024-09-19T09:24:22.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.849+0000 7fbe7e7fc640 1 -- 172.21.15.18:0/2472593669 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v178) ==== 84+0+65 (secure 0 0 0) 0x7fbe740589b0 con 0x7fbe8015eb00 2024-09-19T09:24:22.850 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:24:22.850 INFO:teuthology.orchestra.run.smithi018.stdout:[ 2024-09-19T09:24:22.850 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:22.850 INFO:teuthology.orchestra.run.smithi018.stdout: "poolnum": 1, 2024-09-19T09:24:22.850 INFO:teuthology.orchestra.run.smithi018.stdout: "poolname": ".mgr" 2024-09-19T09:24:22.850 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:22.850 INFO:teuthology.orchestra.run.smithi018.stdout:] 2024-09-19T09:24:22.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.851+0000 7fbe88237640 1 -- 172.21.15.18:0/2472593669 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbe6c06c2e0 msgr2=0x7fbe6c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:22.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.851+0000 7fbe88237640 1 --2- 172.21.15.18:0/2472593669 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbe6c06c2e0 0x7fbe6c06e7a0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fbe70009bd0 tx=0x7fbe7000b040 comp rx=0 tx=0).stop 2024-09-19T09:24:22.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.851+0000 7fbe88237640 1 -- 172.21.15.18:0/2472593669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe8015eb00 msgr2=0x7fbe801553b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:22.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.851+0000 7fbe88237640 1 --2- 172.21.15.18:0/2472593669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe8015eb00 0x7fbe801553b0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400c500 tx=0x7fbe7400c9c0 comp rx=0 tx=0).stop 2024-09-19T09:24:22.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.851+0000 7fbe88237640 1 -- 172.21.15.18:0/2472593669 shutdown_connections 2024-09-19T09:24:22.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.851+0000 7fbe88237640 1 --2- 172.21.15.18:0/2472593669 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fbe6c06c2e0 0x7fbe6c06e7a0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:22.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.851+0000 7fbe88237640 1 --2- 172.21.15.18:0/2472593669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbe80158b70 0x7fbe801558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:22.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.851+0000 7fbe88237640 1 --2- 172.21.15.18:0/2472593669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fbe8015eb00 0x7fbe801553b0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:22.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.851+0000 7fbe88237640 1 --2- 172.21.15.18:0/2472593669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fbe8006d810 0x7fbe80154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:22.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.851+0000 7fbe88237640 1 -- 172.21.15.18:0/2472593669 >> 172.21.15.18:0/2472593669 conn(0x7fbe8006cd20 msgr2=0x7fbe800ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:22.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.851+0000 7fbe88237640 1 -- 172.21.15.18:0/2472593669 shutdown_connections 2024-09-19T09:24:22.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.851+0000 7fbe88237640 1 -- 172.21.15.18:0/2472593669 wait complete. 2024-09-19T09:24:22.862 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T09:24:22.863 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T09:24:22.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.969+0000 7f487b59e640 1 Processor -- start 2024-09-19T09:24:22.970 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.969+0000 7f487b59e640 1 -- start start 2024-09-19T09:24:22.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.970+0000 7f487b59e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f487c0d3760 0x7f487c0cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:22.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.970+0000 7f487b59e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f487c0cfd30 0x7f487c0b8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:22.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.970+0000 7f487b59e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f487c0d0520 con 0x7f487c15eb60 2024-09-19T09:24:22.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.970+0000 7f487b59e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f487c0d0800 con 0x7f487c0cfd30 2024-09-19T09:24:22.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.970+0000 7f487b59e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f487c0b7a60 con 0x7f487c0d3760 2024-09-19T09:24:22.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.970+0000 7f487ad9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f487c0cfd30 0x7f487c0b8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:22.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.970+0000 7f487ad9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f487c0cfd30 0x7f487c0b8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56160/0 (socket says 172.21.15.18:56160) 2024-09-19T09:24:22.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.970+0000 7f487ad9d640 1 -- 172.21.15.18:0/1019421587 learned_addr learned my addr 172.21.15.18:0/1019421587 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:22.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.970+0000 7f4879d9b640 1 --2- 172.21.15.18:0/1019421587 >> v2:172.21.15.162:3300/0 conn(0x7f487c0d3760 0x7f487c0cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:22.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.970+0000 7f487ad9d640 1 -- 172.21.15.18:0/1019421587 >> v2:172.21.15.162:3300/0 conn(0x7f487c0d3760 msgr2=0x7f487c0cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:22.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.970+0000 7f487ad9d640 1 --2- 172.21.15.18:0/1019421587 >> v2:172.21.15.162:3300/0 conn(0x7f487c0d3760 0x7f487c0cf7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:22.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.970+0000 7f487ad9d640 1 -- 172.21.15.18:0/1019421587 >> v1:172.21.15.162:6789/0 conn(0x7f487c15eb60 legacy=0x7f487c0d3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:22.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.970+0000 7f487ad9d640 1 -- 172.21.15.18:0/1019421587 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f487c0b7d40 con 0x7f487c0cfd30 2024-09-19T09:24:22.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.971+0000 7f487ad9d640 1 --2- 172.21.15.18:0/1019421587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f487c0cfd30 0x7f487c0b8260 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f487c0cbad0 tx=0x7f487402a780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aceb61876ef5463b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:22.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.971+0000 7f487959a640 1 -- 172.21.15.18:0/1019421587 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4874036070 con 0x7f487c0cfd30 2024-09-19T09:24:22.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.971+0000 7f487959a640 1 -- 172.21.15.18:0/1019421587 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4874031600 con 0x7f487c0cfd30 2024-09-19T09:24:22.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.971+0000 7f487959a640 1 -- 172.21.15.18:0/1019421587 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48740319d0 con 0x7f487c0cfd30 2024-09-19T09:24:22.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.972+0000 7f487b59e640 1 -- 172.21.15.18:0/1019421587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f487c0cfd30 msgr2=0x7f487c0b8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:22.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.972+0000 7f487b59e640 1 --2- 172.21.15.18:0/1019421587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f487c0cfd30 0x7f487c0b8260 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f487c0cbad0 tx=0x7f487402a780 comp rx=0 tx=0).stop 2024-09-19T09:24:22.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.972+0000 7f487b59e640 1 -- 172.21.15.18:0/1019421587 shutdown_connections 2024-09-19T09:24:22.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.972+0000 7f487b59e640 1 --2- 172.21.15.18:0/1019421587 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f487c0cfd30 0x7f487c0b8260 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:22.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.972+0000 7f487b59e640 1 --2- 172.21.15.18:0/1019421587 >> v2:172.21.15.162:3300/0 conn(0x7f487c0d3760 0x7f487c0cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:22.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.972+0000 7f487b59e640 1 -- 172.21.15.18:0/1019421587 >> 172.21.15.18:0/1019421587 conn(0x7f487c0d4a70 msgr2=0x7f487c0d4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:22.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.972+0000 7f487b59e640 1 -- 172.21.15.18:0/1019421587 shutdown_connections 2024-09-19T09:24:22.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.972+0000 7f487b59e640 1 -- 172.21.15.18:0/1019421587 wait complete. 2024-09-19T09:24:22.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.973+0000 7f487b59e640 1 Processor -- start 2024-09-19T09:24:22.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.973+0000 7f487b59e640 1 -- start start 2024-09-19T09:24:22.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.974+0000 7f487b59e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f487c0cfd30 0x7f487c0a1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:22.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.974+0000 7f487b59e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f487c0d3760 0x7f487c0a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:22.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.974+0000 7f487b59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f487c15eb60 0x7f487c150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:22.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.974+0000 7f487b59e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f487c15f0c0 con 0x7f487c15eb60 2024-09-19T09:24:22.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.974+0000 7f487b59e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f487c15ef40 con 0x7f487c0cfd30 2024-09-19T09:24:22.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.974+0000 7f487b59e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f487c0b87a0 con 0x7f487c0d3760 2024-09-19T09:24:22.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.974+0000 7f487ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f487c15eb60 0x7f487c150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:22.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.974+0000 7f487ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f487c15eb60 0x7f487c150a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56168/0 (socket says 172.21.15.18:56168) 2024-09-19T09:24:22.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.974+0000 7f487ad9d640 1 -- 172.21.15.18:0/877182309 learned_addr learned my addr 172.21.15.18:0/877182309 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:22.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.974+0000 7f4879d9b640 1 --2- 172.21.15.18:0/877182309 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f487c0d3760 0x7f487c0a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:22.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.974+0000 7f487ad9d640 1 -- 172.21.15.18:0/877182309 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f487c0d3760 msgr2=0x7f487c0a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:22.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.974+0000 7f487a59c640 1 --2- 172.21.15.18:0/877182309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f487c0cfd30 0x7f487c0a1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:22.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.974+0000 7f487ad9d640 1 --2- 172.21.15.18:0/877182309 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f487c0d3760 0x7f487c0a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:22.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.974+0000 7f487ad9d640 1 -- 172.21.15.18:0/877182309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f487c0cfd30 msgr2=0x7f487c0a1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:22.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.974+0000 7f487ad9d640 1 --2- 172.21.15.18:0/877182309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f487c0cfd30 0x7f487c0a1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:22.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.974+0000 7f487ad9d640 1 -- 172.21.15.18:0/877182309 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f487c14b5a0 con 0x7f487c15eb60 2024-09-19T09:24:22.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.974+0000 7f4879d9b640 1 --2- 172.21.15.18:0/877182309 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f487c0d3760 0x7f487c0a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:22.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.975+0000 7f487ad9d640 1 --2- 172.21.15.18:0/877182309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f487c15eb60 0x7f487c150a10 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f4874009f40 tx=0x7f4874004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:22.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.975+0000 7f486affd640 1 -- 172.21.15.18:0/877182309 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4874036050 con 0x7f487c15eb60 2024-09-19T09:24:22.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.975+0000 7f486affd640 1 -- 172.21.15.18:0/877182309 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4874042070 con 0x7f487c15eb60 2024-09-19T09:24:22.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.975+0000 7f486affd640 1 -- 172.21.15.18:0/877182309 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4874009510 con 0x7f487c15eb60 2024-09-19T09:24:22.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.975+0000 7f487b59e640 1 -- 172.21.15.18:0/877182309 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f487c14b880 con 0x7f487c15eb60 2024-09-19T09:24:22.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.975+0000 7f487b59e640 1 -- 172.21.15.18:0/877182309 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f487c14be40 con 0x7f487c15eb60 2024-09-19T09:24:22.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.976+0000 7f487b59e640 1 -- 172.21.15.18:0/877182309 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f487c1eb1d0 con 0x7f487c15eb60 2024-09-19T09:24:22.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.976+0000 7f486affd640 1 -- 172.21.15.18:0/877182309 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4874007c50 con 0x7f487c15eb60 2024-09-19T09:24:22.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.977+0000 7f486affd640 1 --2- 172.21.15.18:0/877182309 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f485c06c2b0 0x7f485c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:22.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.977+0000 7f486affd640 1 -- 172.21.15.18:0/877182309 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(178..178 src has 1..178) ==== 4857+0+0 (secure 0 0 0) 0x7f48740ac110 con 0x7f487c15eb60 2024-09-19T09:24:22.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.977+0000 7f487a59c640 1 --2- 172.21.15.18:0/877182309 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f485c06c2b0 0x7f485c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:22.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.978+0000 7f487a59c640 1 --2- 172.21.15.18:0/877182309 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f485c06c2b0 0x7f485c06e770 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f486c00a750 tx=0x7f486c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:22.983 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:22.981+0000 7f486affd640 1 -- 172.21.15.18:0/877182309 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f487c1eb1d0 con 0x7f487c15eb60 2024-09-19T09:24:23.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:23.158+0000 7f487b59e640 1 -- 172.21.15.18:0/877182309 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f487c0b8260 con 0x7f487c15eb60 2024-09-19T09:24:24.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.159+0000 7f486affd640 1 -- 172.21.15.18:0/877182309 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v179) ==== 138+0+0 (secure 0 0 0) 0x7f487407ac60 con 0x7f487c15eb60 2024-09-19T09:24:24.160 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' created 2024-09-19T09:24:24.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.164+0000 7f487b59e640 1 -- 172.21.15.18:0/877182309 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f485c06c2b0 msgr2=0x7f485c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:24.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.164+0000 7f487b59e640 1 --2- 172.21.15.18:0/877182309 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f485c06c2b0 0x7f485c06e770 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f486c00a750 tx=0x7f486c008040 comp rx=0 tx=0).stop 2024-09-19T09:24:24.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.164+0000 7f487b59e640 1 -- 172.21.15.18:0/877182309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f487c15eb60 msgr2=0x7f487c150a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:24.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.164+0000 7f487b59e640 1 --2- 172.21.15.18:0/877182309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f487c15eb60 0x7f487c150a10 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f4874009f40 tx=0x7f4874004a40 comp rx=0 tx=0).stop 2024-09-19T09:24:24.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.165+0000 7f487b59e640 1 -- 172.21.15.18:0/877182309 shutdown_connections 2024-09-19T09:24:24.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.165+0000 7f487b59e640 1 --2- 172.21.15.18:0/877182309 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f485c06c2b0 0x7f485c06e770 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.165+0000 7f487b59e640 1 --2- 172.21.15.18:0/877182309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f487c15eb60 0x7f487c150a10 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.165+0000 7f487b59e640 1 --2- 172.21.15.18:0/877182309 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f487c0d3760 0x7f487c0a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.165+0000 7f487b59e640 1 --2- 172.21.15.18:0/877182309 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f487c0cfd30 0x7f487c0a1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.165+0000 7f487b59e640 1 -- 172.21.15.18:0/877182309 >> 172.21.15.18:0/877182309 conn(0x7f487c0d4a70 msgr2=0x7f487c0cdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:24.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.165+0000 7f487b59e640 1 -- 172.21.15.18:0/877182309 shutdown_connections 2024-09-19T09:24:24.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.165+0000 7f487b59e640 1 -- 172.21.15.18:0/877182309 wait complete. 2024-09-19T09:24:24.181 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T09:24:24.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.296+0000 7f5d874d7640 1 Processor -- start 2024-09-19T09:24:24.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.296+0000 7f5d874d7640 1 -- start start 2024-09-19T09:24:24.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.297+0000 7f5d874d7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d8015c670 0x7f5d800b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:24.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.297+0000 7f5d874d7640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5d8006deb0 0x7f5d80160300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:24.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.297+0000 7f5d874d7640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d800b6a60 con 0x7f5d8015f1a0 2024-09-19T09:24:24.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.297+0000 7f5d874d7640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f5d8015f5e0 con 0x7f5d8006deb0 2024-09-19T09:24:24.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.297+0000 7f5d874d7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5d800b6d40 con 0x7f5d8015c670 2024-09-19T09:24:24.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.298+0000 7f5d85a74640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5d8006deb0 0x7f5d80160300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:24.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.298+0000 7f5d85273640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d8015c670 0x7f5d800b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:24.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.298+0000 7f5d85a74640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5d8006deb0 0x7f5d80160300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:41546/0 (socket says 172.21.15.18:41546) 2024-09-19T09:24:24.299 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.298+0000 7f5d85a74640 1 -- 172.21.15.18:0/3034200500 learned_addr learned my addr 172.21.15.18:0/3034200500 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:24.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.298+0000 7f5d84a72640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f5d8015f1a0 0x7f5d8006d7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:48910/0 (socket says 172.21.15.18:48910) 2024-09-19T09:24:24.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.298+0000 7f5d85a74640 1 -- 172.21.15.18:0/3034200500 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d8015c670 msgr2=0x7f5d800b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:24.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.298+0000 7f5d85a74640 1 --2- 172.21.15.18:0/3034200500 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d8015c670 0x7f5d800b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.298+0000 7f5d85a74640 1 -- 172.21.15.18:0/3034200500 >> v1:172.21.15.162:6789/0 conn(0x7f5d8015f1a0 legacy=0x7f5d8006d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:24.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.298+0000 7f5d85a74640 1 -- 172.21.15.18:0/3034200500 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d800b7020 con 0x7f5d8006deb0 2024-09-19T09:24:24.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.299+0000 7f5d85a74640 1 --2- 172.21.15.18:0/3034200500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d8006deb0 0x7f5d80160300 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5d78009e50 tx=0x7f5d7802a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=668d693481b7f81d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:24.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.299+0000 7f5d77fff640 1 -- 172.21.15.18:0/3034200500 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d78036070 con 0x7f5d8006deb0 2024-09-19T09:24:24.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.299+0000 7f5d77fff640 1 -- 172.21.15.18:0/3034200500 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d78031600 con 0x7f5d8006deb0 2024-09-19T09:24:24.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.299+0000 7f5d77fff640 1 -- 172.21.15.18:0/3034200500 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d780319d0 con 0x7f5d8006deb0 2024-09-19T09:24:24.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.300+0000 7f5d874d7640 1 -- 172.21.15.18:0/3034200500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d8006deb0 msgr2=0x7f5d80160300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:24.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.300+0000 7f5d874d7640 1 --2- 172.21.15.18:0/3034200500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d8006deb0 0x7f5d80160300 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5d78009e50 tx=0x7f5d7802a710 comp rx=0 tx=0).stop 2024-09-19T09:24:24.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.300+0000 7f5d874d7640 1 -- 172.21.15.18:0/3034200500 shutdown_connections 2024-09-19T09:24:24.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.300+0000 7f5d874d7640 1 --2- 172.21.15.18:0/3034200500 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d8006deb0 0x7f5d80160300 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.300+0000 7f5d874d7640 1 --2- 172.21.15.18:0/3034200500 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d8015c670 0x7f5d800b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.300+0000 7f5d874d7640 1 -- 172.21.15.18:0/3034200500 >> 172.21.15.18:0/3034200500 conn(0x7f5d8009b9d0 msgr2=0x7f5d8009bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:24.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.300+0000 7f5d874d7640 1 -- 172.21.15.18:0/3034200500 shutdown_connections 2024-09-19T09:24:24.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.300+0000 7f5d874d7640 1 -- 172.21.15.18:0/3034200500 wait complete. 2024-09-19T09:24:24.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.301+0000 7f5d874d7640 1 Processor -- start 2024-09-19T09:24:24.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.301+0000 7f5d874d7640 1 -- start start 2024-09-19T09:24:24.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.302+0000 7f5d874d7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d8006deb0 0x7f5d80159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:24.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.302+0000 7f5d874d7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d8015c670 0x7f5d801e8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:24.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.302+0000 7f5d874d7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d8015f1a0 0x7f5d80147010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:24.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.302+0000 7f5d874d7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8009c560 con 0x7f5d8015c670 2024-09-19T09:24:24.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.302+0000 7f5d874d7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5d800b75e0 con 0x7f5d8015f1a0 2024-09-19T09:24:24.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.302+0000 7f5d874d7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f5d800b7b00 con 0x7f5d8006deb0 2024-09-19T09:24:24.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.302+0000 7f5d84a72640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d8015c670 0x7f5d801e8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:24.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.302+0000 7f5d84a72640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d8015c670 0x7f5d801e8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:56178/0 (socket says 172.21.15.18:56178) 2024-09-19T09:24:24.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.302+0000 7f5d84a72640 1 -- 172.21.15.18:0/2400014120 learned_addr learned my addr 172.21.15.18:0/2400014120 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:24.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.302+0000 7f5d85273640 1 --2- 172.21.15.18:0/2400014120 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d8006deb0 0x7f5d80159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:24.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.302+0000 7f5d85a74640 1 --2- 172.21.15.18:0/2400014120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d8015f1a0 0x7f5d80147010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:24.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.302+0000 7f5d84a72640 1 -- 172.21.15.18:0/2400014120 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d8006deb0 msgr2=0x7f5d80159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:24.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.302+0000 7f5d84a72640 1 --2- 172.21.15.18:0/2400014120 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d8006deb0 0x7f5d80159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.302+0000 7f5d84a72640 1 -- 172.21.15.18:0/2400014120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d8015f1a0 msgr2=0x7f5d80147010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:24.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.302+0000 7f5d84a72640 1 --2- 172.21.15.18:0/2400014120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d8015f1a0 0x7f5d80147010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:24.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.302+0000 7f5d84a72640 1 -- 172.21.15.18:0/2400014120 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d801e90c0 con 0x7f5d8015c670 2024-09-19T09:24:24.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.303+0000 7f5d84a72640 1 --2- 172.21.15.18:0/2400014120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d8015c670 0x7f5d801e8600 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000c3f0 tx=0x7f5d7000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:24.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.303+0000 7f5d75ffb640 1 -- 172.21.15.18:0/2400014120 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d700074e0 con 0x7f5d8015c670 2024-09-19T09:24:24.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.303+0000 7f5d75ffb640 1 -- 172.21.15.18:0/2400014120 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d70007680 con 0x7f5d8015c670 2024-09-19T09:24:24.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.303+0000 7f5d75ffb640 1 -- 172.21.15.18:0/2400014120 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d70004a00 con 0x7f5d8015c670 2024-09-19T09:24:24.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.303+0000 7f5d874d7640 1 -- 172.21.15.18:0/2400014120 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d801e93a0 con 0x7f5d8015c670 2024-09-19T09:24:24.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.303+0000 7f5d874d7640 1 -- 172.21.15.18:0/2400014120 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d801e9960 con 0x7f5d8015c670 2024-09-19T09:24:24.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.304+0000 7f5d874d7640 1 -- 172.21.15.18:0/2400014120 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d8015ca50 con 0x7f5d8015c670 2024-09-19T09:24:24.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.304+0000 7f5d75ffb640 1 -- 172.21.15.18:0/2400014120 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f5d7001a020 con 0x7f5d8015c670 2024-09-19T09:24:24.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.305+0000 7f5d75ffb640 1 --2- 172.21.15.18:0/2400014120 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5d6406c2b0 0x7f5d6406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:24.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.305+0000 7f5d75ffb640 1 -- 172.21.15.18:0/2400014120 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(179..179 src has 1..179) ==== 5227+0+0 (secure 0 0 0) 0x7f5d7008a8c0 con 0x7f5d8015c670 2024-09-19T09:24:24.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.305+0000 7f5d85273640 1 --2- 172.21.15.18:0/2400014120 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5d6406c2b0 0x7f5d6406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:24.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.305+0000 7f5d85273640 1 --2- 172.21.15.18:0/2400014120 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5d6406c2b0 0x7f5d6406e770 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5d8006fdd0 tx=0x7f5d7c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:24.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.309+0000 7f5d75ffb640 1 -- 172.21.15.18:0/2400014120 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f5d70058bb0 con 0x7f5d8015c670 2024-09-19T09:24:24.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:24.486+0000 7f5d874d7640 1 -- 172.21.15.18:0/2400014120 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f5d8015ec70 con 0x7f5d8015c670 2024-09-19T09:24:25.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.161+0000 7f5d75ffb640 1 -- 172.21.15.18:0/2400014120 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v180) ==== 170+0+0 (secure 0 0 0) 0x7f5d7005ceb0 con 0x7f5d8015c670 2024-09-19T09:24:25.162 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' created 2024-09-19T09:24:25.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.166+0000 7f5d874d7640 1 -- 172.21.15.18:0/2400014120 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5d6406c2b0 msgr2=0x7f5d6406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:25.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.166+0000 7f5d874d7640 1 --2- 172.21.15.18:0/2400014120 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5d6406c2b0 0x7f5d6406e770 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5d8006fdd0 tx=0x7f5d7c009190 comp rx=0 tx=0).stop 2024-09-19T09:24:25.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.166+0000 7f5d874d7640 1 -- 172.21.15.18:0/2400014120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d8015c670 msgr2=0x7f5d801e8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:25.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.166+0000 7f5d874d7640 1 --2- 172.21.15.18:0/2400014120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d8015c670 0x7f5d801e8600 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000c3f0 tx=0x7f5d7000c8b0 comp rx=0 tx=0).stop 2024-09-19T09:24:25.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.166+0000 7f5d874d7640 1 -- 172.21.15.18:0/2400014120 shutdown_connections 2024-09-19T09:24:25.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.166+0000 7f5d874d7640 1 --2- 172.21.15.18:0/2400014120 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f5d6406c2b0 0x7f5d6406e770 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:25.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.166+0000 7f5d874d7640 1 --2- 172.21.15.18:0/2400014120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5d8015f1a0 0x7f5d80147010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:25.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.166+0000 7f5d874d7640 1 --2- 172.21.15.18:0/2400014120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5d8015c670 0x7f5d801e8600 secure :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f5d7000c3f0 tx=0x7f5d7000c8b0 comp rx=0 tx=0).stop 2024-09-19T09:24:25.171 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.166+0000 7f5d874d7640 1 --2- 172.21.15.18:0/2400014120 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5d8006deb0 0x7f5d80159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:25.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.166+0000 7f5d874d7640 1 -- 172.21.15.18:0/2400014120 >> 172.21.15.18:0/2400014120 conn(0x7f5d8009b9d0 msgr2=0x7f5d8015a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:25.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.167+0000 7f5d874d7640 1 -- 172.21.15.18:0/2400014120 shutdown_connections 2024-09-19T09:24:25.172 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.167+0000 7f5d874d7640 1 -- 172.21.15.18:0/2400014120 wait complete. 2024-09-19T09:24:25.188 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T09:24:25.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.296+0000 7fae7a4a4640 1 Processor -- start 2024-09-19T09:24:25.297 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.296+0000 7fae7a4a4640 1 -- start start 2024-09-19T09:24:25.300 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.297+0000 7fae7a4a4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae7415ede0 0x7fae740d5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:25.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.297+0000 7fae7a4a4640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae740d3270 con 0x7fae740d5840 2024-09-19T09:24:25.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.297+0000 7fae7a4a4640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae740d34e0 con 0x7fae740d1bf0 2024-09-19T09:24:25.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.297+0000 7fae7a4a4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fae740d37c0 con 0x7fae7415ede0 2024-09-19T09:24:25.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.297+0000 7fae737fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fae740d5840 0x7fae740d14e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44666/0 (socket says 172.21.15.18:44666) 2024-09-19T09:24:25.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.297+0000 7fae737fe640 1 -- 172.21.15.18:0/4066075413 learned_addr learned my addr 172.21.15.18:0/4066075413 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:24:25.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.297+0000 7fae72ffd640 1 -- 172.21.15.18:0/4066075413 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3223434877 0 0) 0x7fae740d3270 con 0x7fae740d5840 2024-09-19T09:24:25.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.297+0000 7fae72ffd640 1 -- 172.21.15.18:0/4066075413 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae5c003520 con 0x7fae740d5840 2024-09-19T09:24:25.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.297+0000 7fae72ffd640 1 -- 172.21.15.18:0/4066075413 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2221478986 0 0) 0x7fae5c003520 con 0x7fae740d5840 2024-09-19T09:24:25.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.297+0000 7fae72ffd640 1 -- 172.21.15.18:0/4066075413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae7415ede0 msgr2=0x7fae740d5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:25.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.297+0000 7fae72ffd640 1 --2- 172.21.15.18:0/4066075413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae7415ede0 0x7fae740d5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:25.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.297+0000 7fae72ffd640 1 -- 172.21.15.18:0/4066075413 >> v1:172.21.15.162:6789/0 conn(0x7fae740d1bf0 legacy=0x7fae740b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:25.301 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.297+0000 7fae72ffd640 1 -- 172.21.15.18:0/4066075413 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae740d3aa0 con 0x7fae740d5840 2024-09-19T09:24:25.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.297+0000 7fae72ffd640 1 -- 172.21.15.18:0/4066075413 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fae68001670 con 0x7fae740d5840 2024-09-19T09:24:25.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.297+0000 7fae72ffd640 1 -- 172.21.15.18:0/4066075413 >> v1:172.21.15.18:6789/0 conn(0x7fae740d5840 legacy=0x7fae740d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:25.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.297+0000 7fae72ffd640 1 --2- 172.21.15.18:0/4066075413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae5c0039e0 0x7fae5c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:25.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.297+0000 7fae72ffd640 1 --2- 172.21.15.18:0/4066075413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae7415ede0 0x7fae5c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:25.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.297+0000 7fae72ffd640 1 --2- 172.21.15.18:0/4066075413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae5c004db0 0x7fae5c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:25.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.297+0000 7fae72ffd640 1 -- 172.21.15.18:0/4066075413 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fae740d37c0 con 0x7fae5c004db0 2024-09-19T09:24:25.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.297+0000 7fae72ffd640 1 -- 172.21.15.18:0/4066075413 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fae5c00bc60 con 0x7fae5c0039e0 2024-09-19T09:24:25.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.297+0000 7fae72ffd640 1 -- 172.21.15.18:0/4066075413 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fae5c00be60 con 0x7fae7415ede0 2024-09-19T09:24:25.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.298+0000 7fae78a41640 1 --2- 172.21.15.18:0/4066075413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae5c004db0 0x7fae5c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:25.302 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.298+0000 7fae78a41640 1 -- 172.21.15.18:0/4066075413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae7415ede0 msgr2=0x7fae5c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:25.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.298+0000 7fae78a41640 1 --2- 172.21.15.18:0/4066075413 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae7415ede0 0x7fae5c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:25.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.298+0000 7fae78a41640 1 -- 172.21.15.18:0/4066075413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae5c0039e0 msgr2=0x7fae5c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:25.303 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.298+0000 7fae78a41640 1 --2- 172.21.15.18:0/4066075413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae5c0039e0 0x7fae5c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:25.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.298+0000 7fae78a41640 1 -- 172.21.15.18:0/4066075413 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae5c003520 con 0x7fae5c004db0 2024-09-19T09:24:25.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.299+0000 7fae78a41640 1 --2- 172.21.15.18:0/4066075413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae5c004db0 0x7fae5c005230 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fae6c001d20 tx=0x7fae5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32389baf7c345ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:25.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.299+0000 7fae72ffd640 1 -- 172.21.15.18:0/4066075413 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae6c001920 con 0x7fae5c004db0 2024-09-19T09:24:25.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.299+0000 7fae72ffd640 1 -- 172.21.15.18:0/4066075413 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae6c02e070 con 0x7fae5c004db0 2024-09-19T09:24:25.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.299+0000 7fae72ffd640 1 -- 172.21.15.18:0/4066075413 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae6c003990 con 0x7fae5c004db0 2024-09-19T09:24:25.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.299+0000 7fae7a4a4640 1 -- 172.21.15.18:0/4066075413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae5c004db0 msgr2=0x7fae5c005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:25.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.299+0000 7fae7a4a4640 1 --2- 172.21.15.18:0/4066075413 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae5c004db0 0x7fae5c005230 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fae6c001d20 tx=0x7fae5c005830 comp rx=0 tx=0).stop 2024-09-19T09:24:25.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.299+0000 7fae78a41640 1 -- 172.21.15.18:0/4066075413 reap_dead start 2024-09-19T09:24:25.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.299+0000 7fae7a4a4640 1 -- 172.21.15.18:0/4066075413 shutdown_connections 2024-09-19T09:24:25.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.299+0000 7fae7a4a4640 1 -- 172.21.15.18:0/4066075413 >> 172.21.15.18:0/4066075413 conn(0x7fae7409df30 msgr2=0x7fae740d4bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:25.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.299+0000 7fae7a4a4640 1 -- 172.21.15.18:0/4066075413 shutdown_connections 2024-09-19T09:24:25.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.299+0000 7fae7a4a4640 1 -- 172.21.15.18:0/4066075413 wait complete. 2024-09-19T09:24:25.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.300+0000 7fae7a4a4640 1 Processor -- start 2024-09-19T09:24:25.311 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.301+0000 7fae7a4a4640 1 -- start start 2024-09-19T09:24:25.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.301+0000 7fae7a4a4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae5c004db0 0x7fae74160410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:25.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.301+0000 7fae7a4a4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae74160950 0x7fae741f81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:25.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.301+0000 7fae7a4a4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae741f8730 0x7fae7415cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:25.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.301+0000 7fae7a4a4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fae740b41a0 con 0x7fae5c004db0 2024-09-19T09:24:25.312 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.301+0000 7fae7a4a4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fae740b4020 con 0x7fae74160950 2024-09-19T09:24:25.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.301+0000 7fae7a4a4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fae740d5300 con 0x7fae741f8730 2024-09-19T09:24:25.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.301+0000 7fae73fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae5c004db0 0x7fae74160410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:25.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.302+0000 7fae73fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae5c004db0 0x7fae74160410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52780/0 (socket says 172.21.15.18:52780) 2024-09-19T09:24:25.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.302+0000 7fae73fff640 1 -- 172.21.15.18:0/3144614462 learned_addr learned my addr 172.21.15.18:0/3144614462 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:25.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.302+0000 7fae73fff640 1 -- 172.21.15.18:0/3144614462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae741f8730 msgr2=0x7fae7415cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:25.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.302+0000 7fae737fe640 1 --2- 172.21.15.18:0/3144614462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae74160950 0x7fae741f81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:25.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.302+0000 7fae73fff640 1 --2- 172.21.15.18:0/3144614462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae741f8730 0x7fae7415cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:25.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.302+0000 7fae73fff640 1 -- 172.21.15.18:0/3144614462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae74160950 msgr2=0x7fae741f81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:25.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.302+0000 7fae73fff640 1 --2- 172.21.15.18:0/3144614462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae74160950 0x7fae741f81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:25.313 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.302+0000 7fae73fff640 1 -- 172.21.15.18:0/3144614462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae741f5490 con 0x7fae5c004db0 2024-09-19T09:24:25.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.302+0000 7fae73fff640 1 --2- 172.21.15.18:0/3144614462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae5c004db0 0x7fae74160410 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fae6400b400 tx=0x7fae6400b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:25.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.302+0000 7fae70ff9640 1 -- 172.21.15.18:0/3144614462 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae64015020 con 0x7fae5c004db0 2024-09-19T09:24:25.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.302+0000 7fae70ff9640 1 -- 172.21.15.18:0/3144614462 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae64011830 con 0x7fae5c004db0 2024-09-19T09:24:25.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.302+0000 7fae7a4a4640 1 -- 172.21.15.18:0/3144614462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae741f46d0 con 0x7fae5c004db0 2024-09-19T09:24:25.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.302+0000 7fae70ff9640 1 -- 172.21.15.18:0/3144614462 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae64011c20 con 0x7fae5c004db0 2024-09-19T09:24:25.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.302+0000 7fae7a4a4640 1 -- 172.21.15.18:0/3144614462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae741f4c90 con 0x7fae5c004db0 2024-09-19T09:24:25.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.303+0000 7fae7a4a4640 1 -- 172.21.15.18:0/3144614462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae740d14e0 con 0x7fae5c004db0 2024-09-19T09:24:25.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.304+0000 7fae70ff9640 1 -- 172.21.15.18:0/3144614462 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fae64018020 con 0x7fae5c004db0 2024-09-19T09:24:25.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.304+0000 7fae70ff9640 1 --2- 172.21.15.18:0/3144614462 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fae6006c2e0 0x7fae6006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:25.314 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.304+0000 7fae70ff9640 1 -- 172.21.15.18:0/3144614462 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(180..180 src has 1..180) ==== 5609+0+0 (secure 0 0 0) 0x7fae6408b200 con 0x7fae5c004db0 2024-09-19T09:24:25.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.305+0000 7fae737fe640 1 --2- 172.21.15.18:0/3144614462 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fae6006c2e0 0x7fae6006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:25.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.305+0000 7fae737fe640 1 --2- 172.21.15.18:0/3144614462 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fae6006c2e0 0x7fae6006e7a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fae68001eb0 tx=0x7fae68009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:25.315 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.309+0000 7fae70ff9640 1 -- 172.21.15.18:0/3144614462 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fae6401f020 con 0x7fae5c004db0 2024-09-19T09:24:25.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:25.524+0000 7fae7a4a4640 1 -- 172.21.15.18:0/3144614462 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fae740d0d80 con 0x7fae5c004db0 2024-09-19T09:24:26.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.187+0000 7fae70ff9640 1 -- 172.21.15.18:0/3144614462 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v79) ==== 174+0+0 (secure 0 0 0) 0x7fae640172c0 con 0x7fae5c004db0 2024-09-19T09:24:26.189 INFO:teuthology.orchestra.run.smithi018.stderr:new fs with metadata pool 22 and data pool 23 2024-09-19T09:24:26.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.200+0000 7fae7a4a4640 1 -- 172.21.15.18:0/3144614462 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fae6006c2e0 msgr2=0x7fae6006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:26.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.200+0000 7fae7a4a4640 1 --2- 172.21.15.18:0/3144614462 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fae6006c2e0 0x7fae6006e7a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fae68001eb0 tx=0x7fae68009040 comp rx=0 tx=0).stop 2024-09-19T09:24:26.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.200+0000 7fae7a4a4640 1 -- 172.21.15.18:0/3144614462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae5c004db0 msgr2=0x7fae74160410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:26.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.200+0000 7fae7a4a4640 1 --2- 172.21.15.18:0/3144614462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae5c004db0 0x7fae74160410 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7fae6400b400 tx=0x7fae6400b8c0 comp rx=0 tx=0).stop 2024-09-19T09:24:26.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.203+0000 7fae7a4a4640 1 -- 172.21.15.18:0/3144614462 shutdown_connections 2024-09-19T09:24:26.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.203+0000 7fae7a4a4640 1 --2- 172.21.15.18:0/3144614462 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fae6006c2e0 0x7fae6006e7a0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:26.204 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.203+0000 7fae7a4a4640 1 --2- 172.21.15.18:0/3144614462 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fae741f8730 0x7fae7415cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:26.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.203+0000 7fae7a4a4640 1 --2- 172.21.15.18:0/3144614462 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fae74160950 0x7fae741f81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:26.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.203+0000 7fae7a4a4640 1 --2- 172.21.15.18:0/3144614462 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fae5c004db0 0x7fae74160410 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:26.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.203+0000 7fae7a4a4640 1 -- 172.21.15.18:0/3144614462 >> 172.21.15.18:0/3144614462 conn(0x7fae7409df30 msgr2=0x7fae740d26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:26.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.204+0000 7fae7a4a4640 1 -- 172.21.15.18:0/3144614462 shutdown_connections 2024-09-19T09:24:26.205 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.204+0000 7fae7a4a4640 1 -- 172.21.15.18:0/3144614462 wait complete. 2024-09-19T09:24:26.218 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:24:26.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.323+0000 7f6398677640 1 Processor -- start 2024-09-19T09:24:26.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.324+0000 7f6398677640 1 -- start start 2024-09-19T09:24:26.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.324+0000 7f6398677640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f63900d3240 0x7f63900b8c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:26.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.324+0000 7f6398677640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63900b7a90 con 0x7f63900d1ab0 2024-09-19T09:24:26.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.324+0000 7f6398677640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63900d3740 con 0x7f639015ef50 2024-09-19T09:24:26.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.324+0000 7f6398677640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f63900d3a20 con 0x7f63900d3240 2024-09-19T09:24:26.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.325+0000 7f6396c14640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f63900d3240 0x7f63900b8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:26.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.325+0000 7f6396c14640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f63900d3240 0x7f63900b8c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52796/0 (socket says 172.21.15.18:52796) 2024-09-19T09:24:26.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.325+0000 7f6395c12640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f63900d1ab0 0x7f63900b8500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44682/0 (socket says 172.21.15.18:44682) 2024-09-19T09:24:26.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.325+0000 7f6396c14640 1 -- 172.21.15.18:0/72238493 learned_addr learned my addr 172.21.15.18:0/72238493 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:26.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.325+0000 7f6396c14640 1 -- 172.21.15.18:0/72238493 >> v1:172.21.15.162:6789/0 conn(0x7f639015ef50 legacy=0x7f63900d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:26.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.325+0000 7f6396c14640 1 -- 172.21.15.18:0/72238493 >> v1:172.21.15.18:6789/0 conn(0x7f63900d1ab0 legacy=0x7f63900b8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:26.326 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.325+0000 7f6396c14640 1 -- 172.21.15.18:0/72238493 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63900b7d00 con 0x7f63900d3240 2024-09-19T09:24:26.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.326+0000 7f6396c14640 1 --2- 172.21.15.18:0/72238493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63900d3240 0x7f63900b8c10 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f6388009e50 tx=0x7f638802a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18a59491dae40323 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:26.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.326+0000 7f6395411640 1 -- 172.21.15.18:0/72238493 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6388036070 con 0x7f63900d3240 2024-09-19T09:24:26.327 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.326+0000 7f6395411640 1 -- 172.21.15.18:0/72238493 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6388031600 con 0x7f63900d3240 2024-09-19T09:24:26.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.326+0000 7f6395411640 1 -- 172.21.15.18:0/72238493 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63880319d0 con 0x7f63900d3240 2024-09-19T09:24:26.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.326+0000 7f6398677640 1 -- 172.21.15.18:0/72238493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63900d3240 msgr2=0x7f63900b8c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:26.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.326+0000 7f6398677640 1 --2- 172.21.15.18:0/72238493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63900d3240 0x7f63900b8c10 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f6388009e50 tx=0x7f638802a6d0 comp rx=0 tx=0).stop 2024-09-19T09:24:26.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.326+0000 7f6398677640 1 -- 172.21.15.18:0/72238493 shutdown_connections 2024-09-19T09:24:26.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.326+0000 7f6398677640 1 --2- 172.21.15.18:0/72238493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63900d3240 0x7f63900b8c10 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:26.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.326+0000 7f6398677640 1 -- 172.21.15.18:0/72238493 >> 172.21.15.18:0/72238493 conn(0x7f63900d4c60 msgr2=0x7f63900d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:26.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.326+0000 7f6398677640 1 -- 172.21.15.18:0/72238493 shutdown_connections 2024-09-19T09:24:26.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.327+0000 7f6398677640 1 -- 172.21.15.18:0/72238493 wait complete. 2024-09-19T09:24:26.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.328+0000 7f6398677640 1 Processor -- start 2024-09-19T09:24:26.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.328+0000 7f6398677640 1 -- start start 2024-09-19T09:24:26.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.328+0000 7f6398677640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63900d1ab0 0x7f63900d09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:26.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.328+0000 7f6398677640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63900d3240 0x7f6390155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:26.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.328+0000 7f6398677640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f639015ef50 0x7f63901e5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:26.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.328+0000 7f6398677640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f63900d21a0 con 0x7f63900d1ab0 2024-09-19T09:24:26.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.328+0000 7f6398677640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f63900d2020 con 0x7f63900d3240 2024-09-19T09:24:26.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.328+0000 7f6398677640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f63900d5780 con 0x7f639015ef50 2024-09-19T09:24:26.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.329+0000 7f6396413640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63900d1ab0 0x7f63900d09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:26.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.329+0000 7f6396413640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63900d1ab0 0x7f63900d09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52810/0 (socket says 172.21.15.18:52810) 2024-09-19T09:24:26.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.329+0000 7f6396413640 1 -- 172.21.15.18:0/1474445389 learned_addr learned my addr 172.21.15.18:0/1474445389 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:26.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.329+0000 7f6396413640 1 -- 172.21.15.18:0/1474445389 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f639015ef50 msgr2=0x7f63901e5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:26.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.329+0000 7f6396413640 1 --2- 172.21.15.18:0/1474445389 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f639015ef50 0x7f63901e5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:26.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.329+0000 7f6396413640 1 -- 172.21.15.18:0/1474445389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63900d3240 msgr2=0x7f6390155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:26.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.329+0000 7f6395c12640 1 --2- 172.21.15.18:0/1474445389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63900d3240 0x7f6390155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:26.331 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.329+0000 7f6396413640 1 --2- 172.21.15.18:0/1474445389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63900d3240 0x7f6390155a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:26.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.329+0000 7f6396413640 1 -- 172.21.15.18:0/1474445389 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63900d0f20 con 0x7f63900d1ab0 2024-09-19T09:24:26.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.329+0000 7f6396413640 1 --2- 172.21.15.18:0/1474445389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63900d1ab0 0x7f63900d09e0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f638c00b3f0 tx=0x7f638c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:26.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.329+0000 7f6386ffd640 1 -- 172.21.15.18:0/1474445389 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638c015020 con 0x7f63900d1ab0 2024-09-19T09:24:26.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.329+0000 7f6386ffd640 1 -- 172.21.15.18:0/1474445389 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f638c011830 con 0x7f63900d1ab0 2024-09-19T09:24:26.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.329+0000 7f6398677640 1 -- 172.21.15.18:0/1474445389 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63900ca890 con 0x7f63900d1ab0 2024-09-19T09:24:26.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.329+0000 7f6386ffd640 1 -- 172.21.15.18:0/1474445389 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638c011c20 con 0x7f63900d1ab0 2024-09-19T09:24:26.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.329+0000 7f6398677640 1 -- 172.21.15.18:0/1474445389 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63900c8470 con 0x7f63900d1ab0 2024-09-19T09:24:26.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.330+0000 7f6398677640 1 -- 172.21.15.18:0/1474445389 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63900d13a0 con 0x7f63900d1ab0 2024-09-19T09:24:26.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.331+0000 7f6386ffd640 1 -- 172.21.15.18:0/1474445389 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f638c018020 con 0x7f63900d1ab0 2024-09-19T09:24:26.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.331+0000 7f6386ffd640 1 --2- 172.21.15.18:0/1474445389 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f637406c2b0 0x7f637406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:26.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.331+0000 7f6386ffd640 1 -- 172.21.15.18:0/1474445389 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(181..181 src has 1..181) ==== 5709+0+0 (secure 0 0 0) 0x7f638c08b070 con 0x7f63900d1ab0 2024-09-19T09:24:26.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.332+0000 7f6395c12640 1 --2- 172.21.15.18:0/1474445389 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f637406c2b0 0x7f637406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:26.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.332+0000 7f6395c12640 1 --2- 172.21.15.18:0/1474445389 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f637406c2b0 0x7f637406e770 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f63900d5260 tx=0x7f6380009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:26.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.336+0000 7f6386ffd640 1 -- 172.21.15.18:0/1474445389 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f638c01f030 con 0x7f63900d1ab0 2024-09-19T09:24:26.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.511+0000 7f6398677640 1 -- 172.21.15.18:0/1474445389 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f63900cb530 con 0x7f63900d1ab0 2024-09-19T09:24:26.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.512+0000 7f6386ffd640 1 -- 172.21.15.18:0/1474445389 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) ==== 74+0+16765 (secure 0 0 0) 0x7f638c0172c0 con 0x7f63900d1ab0 2024-09-19T09:24:26.513 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:24:26.513 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":181,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:24:25.525790+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:24:23.190145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-19T09:24:24.517971+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:24:26.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.514+0000 7f6398677640 1 -- 172.21.15.18:0/1474445389 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f637406c2b0 msgr2=0x7f637406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:26.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.514+0000 7f6398677640 1 --2- 172.21.15.18:0/1474445389 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f637406c2b0 0x7f637406e770 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f63900d5260 tx=0x7f6380009040 comp rx=0 tx=0).stop 2024-09-19T09:24:26.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.514+0000 7f6398677640 1 -- 172.21.15.18:0/1474445389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63900d1ab0 msgr2=0x7f63900d09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:26.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.514+0000 7f6398677640 1 --2- 172.21.15.18:0/1474445389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63900d1ab0 0x7f63900d09e0 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7f638c00b3f0 tx=0x7f638c00b8b0 comp rx=0 tx=0).stop 2024-09-19T09:24:26.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.514+0000 7f6398677640 1 -- 172.21.15.18:0/1474445389 shutdown_connections 2024-09-19T09:24:26.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.514+0000 7f6398677640 1 --2- 172.21.15.18:0/1474445389 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f637406c2b0 0x7f637406e770 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:26.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.514+0000 7f6398677640 1 --2- 172.21.15.18:0/1474445389 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f639015ef50 0x7f63901e5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:26.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.514+0000 7f6398677640 1 --2- 172.21.15.18:0/1474445389 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f63900d3240 0x7f6390155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:26.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.514+0000 7f6398677640 1 --2- 172.21.15.18:0/1474445389 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f63900d1ab0 0x7f63900d09e0 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:26.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.514+0000 7f6398677640 1 -- 172.21.15.18:0/1474445389 >> 172.21.15.18:0/1474445389 conn(0x7f63900d4c60 msgr2=0x7f63900cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:26.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.514+0000 7f6398677640 1 -- 172.21.15.18:0/1474445389 shutdown_connections 2024-09-19T09:24:26.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.514+0000 7f6398677640 1 -- 172.21.15.18:0/1474445389 wait complete. 2024-09-19T09:24:26.527 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:24:26.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.628+0000 7f36b9b18640 1 Processor -- start 2024-09-19T09:24:26.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.628+0000 7f36b9b18640 1 -- start start 2024-09-19T09:24:26.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.629+0000 7f36b9b18640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36b415ef80 0x7f36b40b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:26.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.629+0000 7f36b9b18640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36b40cd1a0 con 0x7f36b406d730 2024-09-19T09:24:26.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.629+0000 7f36b9b18640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36b406dc30 con 0x7f36b40cfae0 2024-09-19T09:24:26.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.629+0000 7f36b9b18640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f36b40cd7d0 con 0x7f36b415ef80 2024-09-19T09:24:26.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.629+0000 7f36b2ffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f36b406d730 0x7f36b40cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44692/0 (socket says 172.21.15.18:44692) 2024-09-19T09:24:26.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.629+0000 7f36b2ffd640 1 -- 172.21.15.18:0/972819362 learned_addr learned my addr 172.21.15.18:0/972819362 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:24:26.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.629+0000 7f36b37fe640 1 --2- 172.21.15.18:0/972819362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36b415ef80 0x7f36b40b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:26.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.630+0000 7f36b27fc640 1 -- 172.21.15.18:0/972819362 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2615350196 0 0) 0x7f36b40cd1a0 con 0x7f36b406d730 2024-09-19T09:24:26.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.630+0000 7f36b27fc640 1 -- 172.21.15.18:0/972819362 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f369c003520 con 0x7f36b406d730 2024-09-19T09:24:26.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.630+0000 7f36b27fc640 1 -- 172.21.15.18:0/972819362 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 776876812 0 0) 0x7f36b406dc30 con 0x7f36b40cfae0 2024-09-19T09:24:26.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.630+0000 7f36b27fc640 1 -- 172.21.15.18:0/972819362 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36b40cd1a0 con 0x7f36b40cfae0 2024-09-19T09:24:26.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.630+0000 7f36b27fc640 1 -- 172.21.15.18:0/972819362 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3802430829 0 0) 0x7f369c003520 con 0x7f36b406d730 2024-09-19T09:24:26.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.630+0000 7f36b27fc640 1 -- 172.21.15.18:0/972819362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36b415ef80 msgr2=0x7f36b40b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:26.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.630+0000 7f36b27fc640 1 --2- 172.21.15.18:0/972819362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36b415ef80 0x7f36b40b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:26.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.630+0000 7f36b27fc640 1 -- 172.21.15.18:0/972819362 >> v1:172.21.15.162:6789/0 conn(0x7f36b40cfae0 legacy=0x7f36b40cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:26.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.630+0000 7f36b27fc640 1 -- 172.21.15.18:0/972819362 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36b406df10 con 0x7f36b406d730 2024-09-19T09:24:26.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.630+0000 7f36b27fc640 1 -- 172.21.15.18:0/972819362 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f36a8001670 con 0x7f36b406d730 2024-09-19T09:24:26.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.630+0000 7f36b27fc640 1 -- 172.21.15.18:0/972819362 >> v1:172.21.15.18:6789/0 conn(0x7f36b406d730 legacy=0x7f36b40cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:26.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.630+0000 7f36b27fc640 1 --2- 172.21.15.18:0/972819362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f369c003b70 0x7f369c003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:26.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.630+0000 7f36b27fc640 1 --2- 172.21.15.18:0/972819362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36b415ef80 0x7f369c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:26.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.630+0000 7f36b27fc640 1 --2- 172.21.15.18:0/972819362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369c004d40 0x7f369c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:26.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.630+0000 7f36b27fc640 1 -- 172.21.15.18:0/972819362 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f36b40cd7d0 con 0x7f369c004d40 2024-09-19T09:24:26.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.630+0000 7f36b27fc640 1 -- 172.21.15.18:0/972819362 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f369c00ba70 con 0x7f369c003b70 2024-09-19T09:24:26.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.630+0000 7f36b27fc640 1 -- 172.21.15.18:0/972819362 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f369c00bc20 con 0x7f36b415ef80 2024-09-19T09:24:26.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.630+0000 7f36b37fe640 1 --2- 172.21.15.18:0/972819362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f369c003b70 0x7f369c003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:26.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.630+0000 7f36b3fff640 1 --2- 172.21.15.18:0/972819362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369c004d40 0x7f369c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:26.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.630+0000 7f36b2ffd640 1 --2- 172.21.15.18:0/972819362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36b415ef80 0x7f369c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:26.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.630+0000 7f36b3fff640 1 -- 172.21.15.18:0/972819362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36b415ef80 msgr2=0x7f369c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:26.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.630+0000 7f36b3fff640 1 --2- 172.21.15.18:0/972819362 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36b415ef80 0x7f369c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:26.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.630+0000 7f36b3fff640 1 -- 172.21.15.18:0/972819362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f369c003b70 msgr2=0x7f369c003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:26.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.630+0000 7f36b3fff640 1 --2- 172.21.15.18:0/972819362 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f369c003b70 0x7f369c003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:26.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.630+0000 7f36b3fff640 1 -- 172.21.15.18:0/972819362 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f369c003520 con 0x7f369c004d40 2024-09-19T09:24:26.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.631+0000 7f36b3fff640 1 --2- 172.21.15.18:0/972819362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369c004d40 0x7f369c0051c0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f36ac001fd0 tx=0x7f369c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64919daa15c7408b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:26.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.631+0000 7f36b27fc640 1 -- 172.21.15.18:0/972819362 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac001bf0 con 0x7f369c004d40 2024-09-19T09:24:26.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.631+0000 7f36b27fc640 1 -- 172.21.15.18:0/972819362 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36ac003b70 con 0x7f369c004d40 2024-09-19T09:24:26.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.631+0000 7f36b27fc640 1 -- 172.21.15.18:0/972819362 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36ac0050d0 con 0x7f369c004d40 2024-09-19T09:24:26.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.632+0000 7f36b9b18640 1 -- 172.21.15.18:0/972819362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369c004d40 msgr2=0x7f369c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:26.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.632+0000 7f36b9b18640 1 --2- 172.21.15.18:0/972819362 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f369c004d40 0x7f369c0051c0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f36ac001fd0 tx=0x7f369c005830 comp rx=0 tx=0).stop 2024-09-19T09:24:26.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.632+0000 7f36b3fff640 1 -- 172.21.15.18:0/972819362 reap_dead start 2024-09-19T09:24:26.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.632+0000 7f36b9b18640 1 -- 172.21.15.18:0/972819362 shutdown_connections 2024-09-19T09:24:26.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.632+0000 7f36b9b18640 1 -- 172.21.15.18:0/972819362 >> 172.21.15.18:0/972819362 conn(0x7f36b40b4700 msgr2=0x7f36b40b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:26.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.632+0000 7f36b9b18640 1 -- 172.21.15.18:0/972819362 shutdown_connections 2024-09-19T09:24:26.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.632+0000 7f36b9b18640 1 -- 172.21.15.18:0/972819362 wait complete. 2024-09-19T09:24:26.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.633+0000 7f36b9b18640 1 Processor -- start 2024-09-19T09:24:26.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.633+0000 7f36b9b18640 1 -- start start 2024-09-19T09:24:26.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.634+0000 7f36b9b18640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36b4155bd0 0x7f36b4159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:26.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.634+0000 7f36b9b18640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36b40b5a00 0x7f36b40cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:26.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.634+0000 7f36b9b18640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36b4155fb0 0x7f36b40cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:26.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.634+0000 7f36b9b18640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f36b40d0120 con 0x7f36b4155bd0 2024-09-19T09:24:26.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.634+0000 7f36b9b18640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f36b415f360 con 0x7f36b4155fb0 2024-09-19T09:24:26.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.634+0000 7f36b9b18640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f36b40b5220 con 0x7f36b40b5a00 2024-09-19T09:24:26.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.634+0000 7f36b37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36b4155bd0 0x7f36b4159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:26.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.634+0000 7f36b37fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36b4155bd0 0x7f36b4159770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52824/0 (socket says 172.21.15.18:52824) 2024-09-19T09:24:26.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.634+0000 7f36b37fe640 1 -- 172.21.15.18:0/2040895499 learned_addr learned my addr 172.21.15.18:0/2040895499 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:26.641 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.634+0000 7f36b3fff640 1 --2- 172.21.15.18:0/2040895499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36b4155fb0 0x7f36b40cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:26.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.634+0000 7f36b2ffd640 1 --2- 172.21.15.18:0/2040895499 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36b40b5a00 0x7f36b40cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:26.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.634+0000 7f36b37fe640 1 -- 172.21.15.18:0/2040895499 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36b40b5a00 msgr2=0x7f36b40cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:26.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.634+0000 7f36b37fe640 1 --2- 172.21.15.18:0/2040895499 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36b40b5a00 0x7f36b40cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:26.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.634+0000 7f36b37fe640 1 -- 172.21.15.18:0/2040895499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36b4155fb0 msgr2=0x7f36b40cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:26.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.634+0000 7f36b37fe640 1 --2- 172.21.15.18:0/2040895499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36b4155fb0 0x7f36b40cb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:26.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.634+0000 7f36b37fe640 1 -- 172.21.15.18:0/2040895499 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36b40b5f30 con 0x7f36b4155bd0 2024-09-19T09:24:26.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.634+0000 7f36b37fe640 1 --2- 172.21.15.18:0/2040895499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36b4155bd0 0x7f36b4159770 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f36a40119a0 tx=0x7f36a4011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:26.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.635+0000 7f369bfff640 1 -- 172.21.15.18:0/2040895499 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a400faf0 con 0x7f36b4155bd0 2024-09-19T09:24:26.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.635+0000 7f369bfff640 1 -- 172.21.15.18:0/2040895499 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36a400fc90 con 0x7f36b4155bd0 2024-09-19T09:24:26.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.635+0000 7f369bfff640 1 -- 172.21.15.18:0/2040895499 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36a4014440 con 0x7f36b4155bd0 2024-09-19T09:24:26.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.635+0000 7f36b9b18640 1 -- 172.21.15.18:0/2040895499 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36b40b6210 con 0x7f36b4155bd0 2024-09-19T09:24:26.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.635+0000 7f36b9b18640 1 -- 172.21.15.18:0/2040895499 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36b40b67d0 con 0x7f36b4155bd0 2024-09-19T09:24:26.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.636+0000 7f36b9b18640 1 -- 172.21.15.18:0/2040895499 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36b406dc30 con 0x7f36b4155bd0 2024-09-19T09:24:26.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.636+0000 7f369bfff640 1 -- 172.21.15.18:0/2040895499 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f36a4012040 con 0x7f36b4155bd0 2024-09-19T09:24:26.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.637+0000 7f369bfff640 1 --2- 172.21.15.18:0/2040895499 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f36a006c2b0 0x7f36a006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:26.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.637+0000 7f369bfff640 1 -- 172.21.15.18:0/2040895499 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(181..181 src has 1..181) ==== 5709+0+0 (secure 0 0 0) 0x7f36a408bba0 con 0x7f36b4155bd0 2024-09-19T09:24:26.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.637+0000 7f36b2ffd640 1 --2- 172.21.15.18:0/2040895499 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f36a006c2b0 0x7f36a006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:26.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.637+0000 7f36b2ffd640 1 --2- 172.21.15.18:0/2040895499 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f36a006c2b0 0x7f36a006e770 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f36a8001050 tx=0x7f36a8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:26.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.641+0000 7f369bfff640 1 -- 172.21.15.18:0/2040895499 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f36a4019030 con 0x7f36b4155bd0 2024-09-19T09:24:26.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.816+0000 7f36b9b18640 1 -- 172.21.15.18:0/2040895499 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f36b40b6e00 con 0x7f36b4155bd0 2024-09-19T09:24:26.818 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.817+0000 7f369bfff640 1 -- 172.21.15.18:0/2040895499 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v181) ==== 74+0+16765 (secure 0 0 0) 0x7f36a405a310 con 0x7f36b4155bd0 2024-09-19T09:24:26.819 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:24:26.819 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":181,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:24:25.525790+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:24:23.190145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-19T09:24:24.517971+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:24:26.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.819+0000 7f36b9b18640 1 -- 172.21.15.18:0/2040895499 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f36a006c2b0 msgr2=0x7f36a006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:26.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.819+0000 7f36b9b18640 1 --2- 172.21.15.18:0/2040895499 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f36a006c2b0 0x7f36a006e770 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f36a8001050 tx=0x7f36a8009040 comp rx=0 tx=0).stop 2024-09-19T09:24:26.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.819+0000 7f36b9b18640 1 -- 172.21.15.18:0/2040895499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36b4155bd0 msgr2=0x7f36b4159770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:26.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.819+0000 7f36b9b18640 1 --2- 172.21.15.18:0/2040895499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36b4155bd0 0x7f36b4159770 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f36a40119a0 tx=0x7f36a4011e60 comp rx=0 tx=0).stop 2024-09-19T09:24:26.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.819+0000 7f36b9b18640 1 -- 172.21.15.18:0/2040895499 shutdown_connections 2024-09-19T09:24:26.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.819+0000 7f36b9b18640 1 --2- 172.21.15.18:0/2040895499 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f36a006c2b0 0x7f36a006e770 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:26.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.819+0000 7f36b9b18640 1 --2- 172.21.15.18:0/2040895499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f36b4155fb0 0x7f36b40cb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:26.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.819+0000 7f36b9b18640 1 --2- 172.21.15.18:0/2040895499 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f36b40b5a00 0x7f36b40cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:26.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.819+0000 7f36b9b18640 1 --2- 172.21.15.18:0/2040895499 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f36b4155bd0 0x7f36b4159770 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:26.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.819+0000 7f36b9b18640 1 -- 172.21.15.18:0/2040895499 >> 172.21.15.18:0/2040895499 conn(0x7f36b40b4700 msgr2=0x7f36b406f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:26.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.820+0000 7f36b9b18640 1 -- 172.21.15.18:0/2040895499 shutdown_connections 2024-09-19T09:24:26.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.820+0000 7f36b9b18640 1 -- 172.21.15.18:0/2040895499 wait complete. 2024-09-19T09:24:26.832 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-19T09:24:26.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.937+0000 7f6d24bbd640 1 Processor -- start 2024-09-19T09:24:26.938 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.937+0000 7f6d24bbd640 1 -- start start 2024-09-19T09:24:26.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.938+0000 7f6d24bbd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6d2015b760 0x7f6d200afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:26.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.938+0000 7f6d24bbd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d200b4a90 0x7f6d2006f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:26.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.938+0000 7f6d24bbd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6d200d0630 0x7f6d200d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:26.939 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.938+0000 7f6d24bbd640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f6d200b4300 con 0x7f6d2015b760 2024-09-19T09:24:26.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.938+0000 7f6d24bbd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6d200d0fe0 con 0x7f6d200d0630 2024-09-19T09:24:26.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.938+0000 7f6d24bbd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6d2006d700 con 0x7f6d200b4a90 2024-09-19T09:24:26.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.938+0000 7f6d1e59c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6d2015b760 0x7f6d200afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:26.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.938+0000 7f6d1e59c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6d2015b760 0x7f6d200afa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52838/0 (socket says 172.21.15.18:52838) 2024-09-19T09:24:26.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.938+0000 7f6d1e59c640 1 -- 172.21.15.18:0/1911876487 learned_addr learned my addr 172.21.15.18:0/1911876487 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:26.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.938+0000 7f6d1ed9d640 1 --2- 172.21.15.18:0/1911876487 >> v2:172.21.15.162:3300/0 conn(0x7f6d200d0630 0x7f6d200d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:26.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.938+0000 7f6d1dd9b640 1 --2- 172.21.15.18:0/1911876487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d200b4a90 0x7f6d2006f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:26.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.938+0000 7f6d1e59c640 1 -- 172.21.15.18:0/1911876487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d200b4a90 msgr2=0x7f6d2006f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:26.940 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.938+0000 7f6d1e59c640 1 --2- 172.21.15.18:0/1911876487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d200b4a90 0x7f6d2006f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:26.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.938+0000 7f6d1e59c640 1 -- 172.21.15.18:0/1911876487 >> v2:172.21.15.162:3300/0 conn(0x7f6d200d0630 msgr2=0x7f6d200d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:26.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.938+0000 7f6d1e59c640 1 --2- 172.21.15.18:0/1911876487 >> v2:172.21.15.162:3300/0 conn(0x7f6d200d0630 0x7f6d200d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:26.941 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.938+0000 7f6d1e59c640 1 -- 172.21.15.18:0/1911876487 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d2006d9e0 con 0x7f6d2015b760 2024-09-19T09:24:26.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.939+0000 7f6d1e59c640 1 --2- 172.21.15.18:0/1911876487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d2015b760 0x7f6d200afa90 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f6d20071330 tx=0x7f6d1002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca15c4898e0d6c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:26.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.939+0000 7f6d1d59a640 1 -- 172.21.15.18:0/1911876487 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d10037070 con 0x7f6d2015b760 2024-09-19T09:24:26.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.939+0000 7f6d1d59a640 1 -- 172.21.15.18:0/1911876487 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d1002ae10 con 0x7f6d2015b760 2024-09-19T09:24:26.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.939+0000 7f6d1d59a640 1 -- 172.21.15.18:0/1911876487 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d10032660 con 0x7f6d2015b760 2024-09-19T09:24:26.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.940+0000 7f6d24bbd640 1 -- 172.21.15.18:0/1911876487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d2015b760 msgr2=0x7f6d200afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:26.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.940+0000 7f6d24bbd640 1 --2- 172.21.15.18:0/1911876487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d2015b760 0x7f6d200afa90 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f6d20071330 tx=0x7f6d1002a100 comp rx=0 tx=0).stop 2024-09-19T09:24:26.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.940+0000 7f6d24bbd640 1 -- 172.21.15.18:0/1911876487 shutdown_connections 2024-09-19T09:24:26.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.940+0000 7f6d24bbd640 1 --2- 172.21.15.18:0/1911876487 >> v2:172.21.15.162:3300/0 conn(0x7f6d200d0630 0x7f6d200d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:26.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.940+0000 7f6d24bbd640 1 --2- 172.21.15.18:0/1911876487 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d200b4a90 0x7f6d2006f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:26.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.940+0000 7f6d24bbd640 1 --2- 172.21.15.18:0/1911876487 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d2015b760 0x7f6d200afa90 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:26.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.940+0000 7f6d24bbd640 1 -- 172.21.15.18:0/1911876487 >> 172.21.15.18:0/1911876487 conn(0x7f6d2006bc10 msgr2=0x7f6d2006c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:26.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.940+0000 7f6d24bbd640 1 -- 172.21.15.18:0/1911876487 shutdown_connections 2024-09-19T09:24:26.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.940+0000 7f6d24bbd640 1 -- 172.21.15.18:0/1911876487 wait complete. 2024-09-19T09:24:26.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.941+0000 7f6d24bbd640 1 Processor -- start 2024-09-19T09:24:26.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.941+0000 7f6d24bbd640 1 -- start start 2024-09-19T09:24:26.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.942+0000 7f6d24bbd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d200b4a90 0x7f6d20151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:26.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.942+0000 7f6d24bbd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d200d0630 0x7f6d20153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:26.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.942+0000 7f6d24bbd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d2015b760 0x7f6d20153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:26.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.942+0000 7f6d24bbd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6d200b4f20 con 0x7f6d200b4a90 2024-09-19T09:24:26.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.942+0000 7f6d24bbd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6d2006f7d0 con 0x7f6d200d0630 2024-09-19T09:24:26.950 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.942+0000 7f6d24bbd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6d201541b0 con 0x7f6d2015b760 2024-09-19T09:24:26.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.942+0000 7f6d1e59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d200b4a90 0x7f6d20151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:26.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.942+0000 7f6d1e59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d200b4a90 0x7f6d20151a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52842/0 (socket says 172.21.15.18:52842) 2024-09-19T09:24:26.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.942+0000 7f6d1e59c640 1 -- 172.21.15.18:0/1481607583 learned_addr learned my addr 172.21.15.18:0/1481607583 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:26.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.942+0000 7f6d1dd9b640 1 --2- 172.21.15.18:0/1481607583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d200d0630 0x7f6d20153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:26.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.942+0000 7f6d1ed9d640 1 --2- 172.21.15.18:0/1481607583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d2015b760 0x7f6d20153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:26.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.942+0000 7f6d1e59c640 1 -- 172.21.15.18:0/1481607583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d2015b760 msgr2=0x7f6d20153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:26.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.942+0000 7f6d1e59c640 1 --2- 172.21.15.18:0/1481607583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d2015b760 0x7f6d20153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:26.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.942+0000 7f6d1e59c640 1 -- 172.21.15.18:0/1481607583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d200d0630 msgr2=0x7f6d20153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:26.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.942+0000 7f6d1e59c640 1 --2- 172.21.15.18:0/1481607583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d200d0630 0x7f6d20153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:26.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.942+0000 7f6d1e59c640 1 -- 172.21.15.18:0/1481607583 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d2014ca80 con 0x7f6d200b4a90 2024-09-19T09:24:26.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.943+0000 7f6d1e59c640 1 --2- 172.21.15.18:0/1481607583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d200b4a90 0x7f6d20151a30 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f6d10000c00 tx=0x7f6d100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:26.951 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.943+0000 7f6d0effd640 1 -- 172.21.15.18:0/1481607583 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d10041070 con 0x7f6d200b4a90 2024-09-19T09:24:26.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.943+0000 7f6d0effd640 1 -- 172.21.15.18:0/1481607583 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d1003c670 con 0x7f6d200b4a90 2024-09-19T09:24:26.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.943+0000 7f6d24bbd640 1 -- 172.21.15.18:0/1481607583 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d2014cd60 con 0x7f6d200b4a90 2024-09-19T09:24:26.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.943+0000 7f6d0effd640 1 -- 172.21.15.18:0/1481607583 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d10037040 con 0x7f6d200b4a90 2024-09-19T09:24:26.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.943+0000 7f6d24bbd640 1 -- 172.21.15.18:0/1481607583 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d20071470 con 0x7f6d200b4a90 2024-09-19T09:24:26.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.944+0000 7f6d24bbd640 1 -- 172.21.15.18:0/1481607583 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d2015bb40 con 0x7f6d200b4a90 2024-09-19T09:24:26.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.944+0000 7f6d0effd640 1 -- 172.21.15.18:0/1481607583 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6d10044070 con 0x7f6d200b4a90 2024-09-19T09:24:26.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.945+0000 7f6d0effd640 1 --2- 172.21.15.18:0/1481607583 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6d0006c2b0 0x7f6d0006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:26.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.945+0000 7f6d0effd640 1 -- 172.21.15.18:0/1481607583 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(181..181 src has 1..181) ==== 5709+0+0 (secure 0 0 0) 0x7f6d100abbd0 con 0x7f6d200b4a90 2024-09-19T09:24:26.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.945+0000 7f6d1dd9b640 1 --2- 172.21.15.18:0/1481607583 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6d0006c2b0 0x7f6d0006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:26.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.946+0000 7f6d1dd9b640 1 --2- 172.21.15.18:0/1481607583 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6d0006c2b0 0x7f6d0006e770 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f6d20166380 tx=0x7f6d14008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:26.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:26.949+0000 7f6d0effd640 1 -- 172.21.15.18:0/1481607583 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6d1007a4f0 con 0x7f6d200b4a90 2024-09-19T09:24:27.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.158+0000 7f6d24bbd640 1 -- 172.21.15.18:0/1481607583 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f6d200b5910 con 0x7f6d200b4a90 2024-09-19T09:24:27.275 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.274+0000 7f6d0effd640 1 -- 172.21.15.18:0/1481607583 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v81) ==== 118+0+0 (secure 0 0 0) 0x7f6d10079df0 con 0x7f6d200b4a90 2024-09-19T09:24:27.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.276+0000 7f6d24bbd640 1 -- 172.21.15.18:0/1481607583 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6d0006c2b0 msgr2=0x7f6d0006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:27.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.276+0000 7f6d24bbd640 1 --2- 172.21.15.18:0/1481607583 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6d0006c2b0 0x7f6d0006e770 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f6d20166380 tx=0x7f6d14008040 comp rx=0 tx=0).stop 2024-09-19T09:24:27.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.276+0000 7f6d24bbd640 1 -- 172.21.15.18:0/1481607583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d200b4a90 msgr2=0x7f6d20151a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:27.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.276+0000 7f6d24bbd640 1 --2- 172.21.15.18:0/1481607583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d200b4a90 0x7f6d20151a30 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f6d10000c00 tx=0x7f6d100046c0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.277+0000 7f6d24bbd640 1 -- 172.21.15.18:0/1481607583 shutdown_connections 2024-09-19T09:24:27.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.277+0000 7f6d24bbd640 1 --2- 172.21.15.18:0/1481607583 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6d0006c2b0 0x7f6d0006e770 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.277+0000 7f6d24bbd640 1 --2- 172.21.15.18:0/1481607583 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6d2015b760 0x7f6d20153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.277+0000 7f6d24bbd640 1 --2- 172.21.15.18:0/1481607583 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6d200d0630 0x7f6d20153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.277+0000 7f6d24bbd640 1 --2- 172.21.15.18:0/1481607583 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6d200b4a90 0x7f6d20151a30 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.278 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.277+0000 7f6d24bbd640 1 -- 172.21.15.18:0/1481607583 >> 172.21.15.18:0/1481607583 conn(0x7f6d2006bc10 msgr2=0x7f6d20159de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:27.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.277+0000 7f6d24bbd640 1 -- 172.21.15.18:0/1481607583 shutdown_connections 2024-09-19T09:24:27.279 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.277+0000 7f6d24bbd640 1 -- 172.21.15.18:0/1481607583 wait complete. 2024-09-19T09:24:27.289 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-19T09:24:27.289 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-19T09:24:27.394 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.393+0000 7fca6d79f640 1 Processor -- start 2024-09-19T09:24:27.395 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.393+0000 7fca6d79f640 1 -- start start 2024-09-19T09:24:27.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.394+0000 7fca6d79f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fca6806ee40 0x7fca6806f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:27.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.394+0000 7fca6d79f640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca680ae840 con 0x7fca6806bc10 2024-09-19T09:24:27.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.394+0000 7fca6d79f640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca680b6a40 con 0x7fca68163190 2024-09-19T09:24:27.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.394+0000 7fca6d79f640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fca680b6d20 con 0x7fca6806ee40 2024-09-19T09:24:27.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.394+0000 7fca677fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fca6806ee40 0x7fca6806f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:27.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.394+0000 7fca677fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fca6806ee40 0x7fca6806f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52852/0 (socket says 172.21.15.18:52852) 2024-09-19T09:24:27.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.394+0000 7fca677fe640 1 -- 172.21.15.18:0/3251541249 learned_addr learned my addr 172.21.15.18:0/3251541249 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:27.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.394+0000 7fca66ffd640 1 --1- 172.21.15.18:0/3251541249 >> v1:172.21.15.18:6789/0 conn(0x7fca6806bc10 0x7fca6806bff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44694/0 (socket says 172.21.15.18:44694) 2024-09-19T09:24:27.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.395+0000 7fca677fe640 1 -- 172.21.15.18:0/3251541249 >> v1:172.21.15.162:6789/0 conn(0x7fca68163190 legacy=0x7fca6806e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:27.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.395+0000 7fca677fe640 1 -- 172.21.15.18:0/3251541249 >> v1:172.21.15.18:6789/0 conn(0x7fca6806bc10 legacy=0x7fca6806bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:27.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.395+0000 7fca677fe640 1 -- 172.21.15.18:0/3251541249 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca680b4b50 con 0x7fca6806ee40 2024-09-19T09:24:27.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.395+0000 7fca677fe640 1 --2- 172.21.15.18:0/3251541249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca6806ee40 0x7fca6806f2b0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fca58009870 tx=0x7fca5802a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f71db10ba0315c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:27.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.396+0000 7fca65ffb640 1 -- 172.21.15.18:0/3251541249 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca58037070 con 0x7fca6806ee40 2024-09-19T09:24:27.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.396+0000 7fca65ffb640 1 -- 172.21.15.18:0/3251541249 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca58032440 con 0x7fca6806ee40 2024-09-19T09:24:27.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.396+0000 7fca65ffb640 1 -- 172.21.15.18:0/3251541249 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca58032810 con 0x7fca6806ee40 2024-09-19T09:24:27.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.396+0000 7fca6d79f640 1 -- 172.21.15.18:0/3251541249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca6806ee40 msgr2=0x7fca6806f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:27.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.396+0000 7fca6d79f640 1 --2- 172.21.15.18:0/3251541249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca6806ee40 0x7fca6806f2b0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fca58009870 tx=0x7fca5802a2a0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.396+0000 7fca6d79f640 1 -- 172.21.15.18:0/3251541249 shutdown_connections 2024-09-19T09:24:27.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.396+0000 7fca6d79f640 1 --2- 172.21.15.18:0/3251541249 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca6806ee40 0x7fca6806f2b0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.396+0000 7fca6d79f640 1 -- 172.21.15.18:0/3251541249 >> 172.21.15.18:0/3251541249 conn(0x7fca680d1970 msgr2=0x7fca680d1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:27.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.396+0000 7fca6d79f640 1 -- 172.21.15.18:0/3251541249 shutdown_connections 2024-09-19T09:24:27.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.396+0000 7fca6d79f640 1 -- 172.21.15.18:0/3251541249 wait complete. 2024-09-19T09:24:27.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.398+0000 7fca6d79f640 1 Processor -- start 2024-09-19T09:24:27.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.398+0000 7fca6d79f640 1 -- start start 2024-09-19T09:24:27.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.398+0000 7fca6d79f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca6806bc10 0x7fca681f7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:27.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.398+0000 7fca6d79f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca6806ee40 0x7fca681f4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:27.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.398+0000 7fca6d79f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca68163190 0x7fca68161b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:27.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.398+0000 7fca6d79f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fca681635d0 con 0x7fca6806ee40 2024-09-19T09:24:27.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.398+0000 7fca6d79f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fca6806f7f0 con 0x7fca6806bc10 2024-09-19T09:24:27.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.398+0000 7fca6d79f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fca680b5110 con 0x7fca68163190 2024-09-19T09:24:27.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.398+0000 7fca667fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca6806ee40 0x7fca681f4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:27.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.399+0000 7fca667fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca6806ee40 0x7fca681f4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52866/0 (socket says 172.21.15.18:52866) 2024-09-19T09:24:27.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.399+0000 7fca667fc640 1 -- 172.21.15.18:0/1700481728 learned_addr learned my addr 172.21.15.18:0/1700481728 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:27.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.399+0000 7fca677fe640 1 --2- 172.21.15.18:0/1700481728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca68163190 0x7fca68161b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:27.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.399+0000 7fca66ffd640 1 --2- 172.21.15.18:0/1700481728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca6806bc10 0x7fca681f7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:27.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.399+0000 7fca667fc640 1 -- 172.21.15.18:0/1700481728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca68163190 msgr2=0x7fca68161b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:27.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.399+0000 7fca667fc640 1 --2- 172.21.15.18:0/1700481728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca68163190 0x7fca68161b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.399+0000 7fca667fc640 1 -- 172.21.15.18:0/1700481728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca6806bc10 msgr2=0x7fca681f7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:27.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.399+0000 7fca667fc640 1 --2- 172.21.15.18:0/1700481728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca6806bc10 0x7fca681f7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:27.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.399+0000 7fca667fc640 1 -- 172.21.15.18:0/1700481728 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca6815f510 con 0x7fca6806ee40 2024-09-19T09:24:27.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.399+0000 7fca677fe640 1 --2- 172.21.15.18:0/1700481728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca68163190 0x7fca68161b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:27.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.399+0000 7fca667fc640 1 --2- 172.21.15.18:0/1700481728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca6806ee40 0x7fca681f4db0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fca5000b420 tx=0x7fca5000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:27.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.399+0000 7fca5f7fe640 1 -- 172.21.15.18:0/1700481728 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca50011830 con 0x7fca6806ee40 2024-09-19T09:24:27.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.399+0000 7fca5f7fe640 1 -- 172.21.15.18:0/1700481728 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca50016070 con 0x7fca6806ee40 2024-09-19T09:24:27.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.399+0000 7fca6d79f640 1 -- 172.21.15.18:0/1700481728 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca6815f7f0 con 0x7fca6806ee40 2024-09-19T09:24:27.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.399+0000 7fca5f7fe640 1 -- 172.21.15.18:0/1700481728 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca50011c10 con 0x7fca6806ee40 2024-09-19T09:24:27.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.399+0000 7fca6d79f640 1 -- 172.21.15.18:0/1700481728 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca6815dfa0 con 0x7fca6806ee40 2024-09-19T09:24:27.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.400+0000 7fca6d79f640 1 -- 172.21.15.18:0/1700481728 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca680b53e0 con 0x7fca6806ee40 2024-09-19T09:24:27.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.401+0000 7fca5f7fe640 1 -- 172.21.15.18:0/1700481728 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fca5001b460 con 0x7fca6806ee40 2024-09-19T09:24:27.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.401+0000 7fca5f7fe640 1 --2- 172.21.15.18:0/1700481728 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fca4806c2b0 0x7fca4806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:27.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.401+0000 7fca5f7fe640 1 -- 172.21.15.18:0/1700481728 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7fca5008aeb0 con 0x7fca6806ee40 2024-09-19T09:24:27.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.401+0000 7fca66ffd640 1 --2- 172.21.15.18:0/1700481728 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fca4806c2b0 0x7fca4806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:27.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.402+0000 7fca66ffd640 1 --2- 172.21.15.18:0/1700481728 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fca4806c2b0 0x7fca4806e770 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fca600012e0 tx=0x7fca60005b70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:27.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.405+0000 7fca5f7fe640 1 -- 172.21.15.18:0/1700481728 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fca680b53e0 con 0x7fca6806ee40 2024-09-19T09:24:27.619 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:27.618+0000 7fca6d79f640 1 -- 172.21.15.18:0/1700481728 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fca680b6660 con 0x7fca6806ee40 2024-09-19T09:24:27.955 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-09-19T09:24:27.955 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-19T09:24:28.159 INFO:tasks.ceph.mds.a.smithi018.stderr:2024-09-19T09:24:28.158+0000 7fcfdc109640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T09:24:28.280 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.279+0000 7fca5f7fe640 1 -- 172.21.15.18:0/1700481728 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v82) ==== 122+0+0 (secure 0 0 0) 0x7fca50020020 con 0x7fca6806ee40 2024-09-19T09:24:28.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.282+0000 7fca6d79f640 1 -- 172.21.15.18:0/1700481728 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fca4806c2b0 msgr2=0x7fca4806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:28.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.282+0000 7fca6d79f640 1 --2- 172.21.15.18:0/1700481728 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fca4806c2b0 0x7fca4806e770 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fca600012e0 tx=0x7fca60005b70 comp rx=0 tx=0).stop 2024-09-19T09:24:28.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.282+0000 7fca6d79f640 1 -- 172.21.15.18:0/1700481728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca6806ee40 msgr2=0x7fca681f4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:28.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.282+0000 7fca6d79f640 1 --2- 172.21.15.18:0/1700481728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca6806ee40 0x7fca681f4db0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fca5000b420 tx=0x7fca5000b8e0 comp rx=0 tx=0).stop 2024-09-19T09:24:28.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.282+0000 7fca6d79f640 1 -- 172.21.15.18:0/1700481728 shutdown_connections 2024-09-19T09:24:28.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.282+0000 7fca6d79f640 1 --2- 172.21.15.18:0/1700481728 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fca4806c2b0 0x7fca4806e770 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:28.283 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.282+0000 7fca6d79f640 1 --2- 172.21.15.18:0/1700481728 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fca68163190 0x7fca68161b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:28.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.282+0000 7fca6d79f640 1 --2- 172.21.15.18:0/1700481728 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fca6806ee40 0x7fca681f4db0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:28.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.282+0000 7fca6d79f640 1 --2- 172.21.15.18:0/1700481728 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fca6806bc10 0x7fca681f7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:28.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.282+0000 7fca6d79f640 1 -- 172.21.15.18:0/1700481728 >> 172.21.15.18:0/1700481728 conn(0x7fca680d1970 msgr2=0x7fca6806bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:28.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.282+0000 7fca6d79f640 1 -- 172.21.15.18:0/1700481728 shutdown_connections 2024-09-19T09:24:28.284 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.282+0000 7fca6d79f640 1 -- 172.21.15.18:0/1700481728 wait complete. 2024-09-19T09:24:28.297 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-19T09:24:28.297 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:24:28.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.404+0000 7f7fd681e640 1 Processor -- start 2024-09-19T09:24:28.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.404+0000 7f7fd681e640 1 -- start start 2024-09-19T09:24:28.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.405+0000 7f7fd681e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7fd015ef80 0x7f7fd00b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:28.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.405+0000 7f7fd681e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fd006d730 0x7f7fd00cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:28.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.405+0000 7f7fd681e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7fd00cf910 0x7f7fd00d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:28.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.405+0000 7f7fd681e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f7fd00cd7d0 con 0x7f7fd00cf910 2024-09-19T09:24:28.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.405+0000 7f7fd681e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f7fd00cd1a0 con 0x7f7fd015ef80 2024-09-19T09:24:28.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.405+0000 7f7fd681e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7fd006dc30 con 0x7f7fd006d730 2024-09-19T09:24:28.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.405+0000 7f7fd4dbb640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7fd00cf910 0x7f7fd00d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:28.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.405+0000 7f7fd4dbb640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7fd00cf910 0x7f7fd00d0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52880/0 (socket says 172.21.15.18:52880) 2024-09-19T09:24:28.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.405+0000 7f7fd4dbb640 1 -- 172.21.15.18:0/1083120099 learned_addr learned my addr 172.21.15.18:0/1083120099 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:28.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.405+0000 7f7fcf7fe640 1 --2- 172.21.15.18:0/1083120099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fd006d730 0x7f7fd00cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:28.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.405+0000 7f7fcffff640 1 --2- 172.21.15.18:0/1083120099 >> v2:172.21.15.162:3300/0 conn(0x7f7fd015ef80 0x7f7fd00b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:28.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.405+0000 7f7fd4dbb640 1 -- 172.21.15.18:0/1083120099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fd006d730 msgr2=0x7f7fd00cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:28.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.405+0000 7f7fd4dbb640 1 --2- 172.21.15.18:0/1083120099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fd006d730 0x7f7fd00cf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:28.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.405+0000 7f7fd4dbb640 1 -- 172.21.15.18:0/1083120099 >> v2:172.21.15.162:3300/0 conn(0x7f7fd015ef80 msgr2=0x7f7fd00b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:28.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.405+0000 7f7fd4dbb640 1 --2- 172.21.15.18:0/1083120099 >> v2:172.21.15.162:3300/0 conn(0x7f7fd015ef80 0x7f7fd00b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:28.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.405+0000 7f7fd4dbb640 1 -- 172.21.15.18:0/1083120099 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd006df10 con 0x7f7fd00cf910 2024-09-19T09:24:28.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.405+0000 7f7fcffff640 1 --2- 172.21.15.18:0/1083120099 >> v2:172.21.15.162:3300/0 conn(0x7f7fd015ef80 0x7f7fd00b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:28.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.405+0000 7f7fcf7fe640 1 --2- 172.21.15.18:0/1083120099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fd006d730 0x7f7fd00cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:28.416 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.406+0000 7f7fd4dbb640 1 --2- 172.21.15.18:0/1083120099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fd00cf910 0x7f7fd00d0ce0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f7fd006f6e0 tx=0x7f7fc802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2882dfd72e606600 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:28.417 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.406+0000 7f7fceffd640 1 -- 172.21.15.18:0/1083120099 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8036070 con 0x7f7fd00cf910 2024-09-19T09:24:28.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.406+0000 7f7fceffd640 1 -- 172.21.15.18:0/1083120099 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc8031600 con 0x7f7fd00cf910 2024-09-19T09:24:28.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.406+0000 7f7fceffd640 1 -- 172.21.15.18:0/1083120099 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc80319d0 con 0x7f7fd00cf910 2024-09-19T09:24:28.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.407+0000 7f7fd681e640 1 -- 172.21.15.18:0/1083120099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fd00cf910 msgr2=0x7f7fd00d0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:28.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.407+0000 7f7fd681e640 1 --2- 172.21.15.18:0/1083120099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fd00cf910 0x7f7fd00d0ce0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f7fd006f6e0 tx=0x7f7fc802a6a0 comp rx=0 tx=0).stop 2024-09-19T09:24:28.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.407+0000 7f7fd681e640 1 -- 172.21.15.18:0/1083120099 shutdown_connections 2024-09-19T09:24:28.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.407+0000 7f7fd681e640 1 --2- 172.21.15.18:0/1083120099 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fd00cf910 0x7f7fd00d0ce0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:28.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.407+0000 7f7fd681e640 1 --2- 172.21.15.18:0/1083120099 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fd006d730 0x7f7fd00cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:28.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.407+0000 7f7fd681e640 1 --2- 172.21.15.18:0/1083120099 >> v2:172.21.15.162:3300/0 conn(0x7f7fd015ef80 0x7f7fd00b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:28.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.407+0000 7f7fd681e640 1 -- 172.21.15.18:0/1083120099 >> 172.21.15.18:0/1083120099 conn(0x7f7fd00b4700 msgr2=0x7f7fd00b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:28.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.407+0000 7f7fd681e640 1 -- 172.21.15.18:0/1083120099 shutdown_connections 2024-09-19T09:24:28.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.407+0000 7f7fd681e640 1 -- 172.21.15.18:0/1083120099 wait complete. 2024-09-19T09:24:28.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.408+0000 7f7fd681e640 1 Processor -- start 2024-09-19T09:24:28.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.408+0000 7f7fd681e640 1 -- start start 2024-09-19T09:24:28.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.409+0000 7f7fd681e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fd006d730 0x7f7fd0154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:28.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.409+0000 7f7fd681e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fd00cf910 0x7f7fd00c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:28.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.409+0000 7f7fd681e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fd015ef80 0x7f7fd00c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:28.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.409+0000 7f7fd681e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd00d0120 con 0x7f7fd00cf910 2024-09-19T09:24:28.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.409+0000 7f7fd681e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd015f360 con 0x7f7fd006d730 2024-09-19T09:24:28.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.409+0000 7f7fd681e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7fd00d1220 con 0x7f7fd015ef80 2024-09-19T09:24:28.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.409+0000 7f7fcf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fd00cf910 0x7f7fd00c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:28.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.409+0000 7f7fcf7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fd00cf910 0x7f7fd00c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52890/0 (socket says 172.21.15.18:52890) 2024-09-19T09:24:28.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.409+0000 7f7fcf7fe640 1 -- 172.21.15.18:0/3966787458 learned_addr learned my addr 172.21.15.18:0/3966787458 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:28.421 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.409+0000 7f7fd4dbb640 1 --2- 172.21.15.18:0/3966787458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fd015ef80 0x7f7fd00c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:28.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.409+0000 7f7fcffff640 1 --2- 172.21.15.18:0/3966787458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fd006d730 0x7f7fd0154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:28.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.409+0000 7f7fcf7fe640 1 -- 172.21.15.18:0/3966787458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fd015ef80 msgr2=0x7f7fd00c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:28.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.409+0000 7f7fcf7fe640 1 --2- 172.21.15.18:0/3966787458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fd015ef80 0x7f7fd00c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:28.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.410+0000 7f7fcf7fe640 1 -- 172.21.15.18:0/3966787458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fd006d730 msgr2=0x7f7fd0154190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:28.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.410+0000 7f7fcf7fe640 1 --2- 172.21.15.18:0/3966787458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fd006d730 0x7f7fd0154190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:28.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.410+0000 7f7fcf7fe640 1 -- 172.21.15.18:0/3966787458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd00ca670 con 0x7f7fd00cf910 2024-09-19T09:24:28.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.410+0000 7f7fcf7fe640 1 --2- 172.21.15.18:0/3966787458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fd00cf910 0x7f7fd00c9c20 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400c7f0 tx=0x7f7fc400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:28.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.410+0000 7f7fccff9640 1 -- 172.21.15.18:0/3966787458 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4015070 con 0x7f7fd00cf910 2024-09-19T09:24:28.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.410+0000 7f7fccff9640 1 -- 172.21.15.18:0/3966787458 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc4007a30 con 0x7f7fd00cf910 2024-09-19T09:24:28.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.410+0000 7f7fd681e640 1 -- 172.21.15.18:0/3966787458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fd00ca950 con 0x7f7fd00cf910 2024-09-19T09:24:28.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.410+0000 7f7fccff9640 1 -- 172.21.15.18:0/3966787458 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4007e20 con 0x7f7fd00cf910 2024-09-19T09:24:28.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.410+0000 7f7fd681e640 1 -- 172.21.15.18:0/3966787458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fd00caf10 con 0x7f7fd00cf910 2024-09-19T09:24:28.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.411+0000 7f7fd681e640 1 -- 172.21.15.18:0/3966787458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fd00d0ce0 con 0x7f7fd00cf910 2024-09-19T09:24:28.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.411+0000 7f7fccff9640 1 -- 172.21.15.18:0/3966787458 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7fc4018070 con 0x7f7fd00cf910 2024-09-19T09:24:28.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.412+0000 7f7fccff9640 1 --2- 172.21.15.18:0/3966787458 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7fbc06c2b0 0x7f7fbc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:28.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.412+0000 7f7fccff9640 1 -- 172.21.15.18:0/3966787458 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f7fc408b420 con 0x7f7fd00cf910 2024-09-19T09:24:28.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.412+0000 7f7fcffff640 1 --2- 172.21.15.18:0/3966787458 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7fbc06c2b0 0x7f7fbc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:28.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.413+0000 7f7fcffff640 1 --2- 172.21.15.18:0/3966787458 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7fbc06c2b0 0x7f7fbc06e770 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00b8cc0 tx=0x7f7fc0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:28.424 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.416+0000 7f7fccff9640 1 -- 172.21.15.18:0/3966787458 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7fc4059b90 con 0x7f7fd00cf910 2024-09-19T09:24:28.626 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.625+0000 7f7fd681e640 1 -- 172.21.15.18:0/3966787458 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7fd00cff00 con 0x7f7fd00cf910 2024-09-19T09:24:28.627 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.626+0000 7f7fccff9640 1 -- 172.21.15.18:0/3966787458 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+5233 (secure 0 0 0) 0x7f7fc4059490 con 0x7f7fd00cf910 2024-09-19T09:24:28.627 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:24:28.627 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":82,"btime":"2024-09-19T09:24:28:275969+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1644566118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1644566118},{"type":"v1","addr":"172.21.15.162:6835","nonce":1644566118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3767901067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3767901067},{"type":"v1","addr":"172.21.15.162:6837","nonce":3767901067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7851,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1160903618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1160903618},{"type":"v1","addr":"172.21.15.18:6834","nonce":1160903618}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:24:25.526108+0000","modified":"2024-09-19T09:24:27.619787+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7854},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7854":{"gid":7854,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2545948137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2545948137},{"type":"v1","addr":"172.21.15.18:6835","nonce":2545948137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7854,"qdb_cluster":[7854]},"id":11}]} 2024-09-19T09:24:28.627 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 82 2024-09-19T09:24:28.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.628+0000 7f7fd681e640 1 -- 172.21.15.18:0/3966787458 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7fbc06c2b0 msgr2=0x7f7fbc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:28.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.628+0000 7f7fd681e640 1 --2- 172.21.15.18:0/3966787458 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7fbc06c2b0 0x7f7fbc06e770 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f7fd00b8cc0 tx=0x7f7fc0008040 comp rx=0 tx=0).stop 2024-09-19T09:24:28.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.628+0000 7f7fd681e640 1 -- 172.21.15.18:0/3966787458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fd00cf910 msgr2=0x7f7fd00c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:28.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.628+0000 7f7fd681e640 1 --2- 172.21.15.18:0/3966787458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fd00cf910 0x7f7fd00c9c20 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f7fc400c7f0 tx=0x7f7fc400ccb0 comp rx=0 tx=0).stop 2024-09-19T09:24:28.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.628+0000 7f7fd681e640 1 -- 172.21.15.18:0/3966787458 shutdown_connections 2024-09-19T09:24:28.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.628+0000 7f7fd681e640 1 --2- 172.21.15.18:0/3966787458 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7fbc06c2b0 0x7f7fbc06e770 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:28.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.628+0000 7f7fd681e640 1 --2- 172.21.15.18:0/3966787458 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7fd015ef80 0x7f7fd00c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:28.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.628+0000 7f7fd681e640 1 --2- 172.21.15.18:0/3966787458 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7fd00cf910 0x7f7fd00c9c20 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:28.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.628+0000 7f7fd681e640 1 --2- 172.21.15.18:0/3966787458 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7fd006d730 0x7f7fd0154190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:28.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.628+0000 7f7fd681e640 1 -- 172.21.15.18:0/3966787458 >> 172.21.15.18:0/3966787458 conn(0x7f7fd00b4700 msgr2=0x7f7fd00d3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:28.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.628+0000 7f7fd681e640 1 -- 172.21.15.18:0/3966787458 shutdown_connections 2024-09-19T09:24:28.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.628+0000 7f7fd681e640 1 -- 172.21.15.18:0/3966787458 wait complete. 2024-09-19T09:24:28.640 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:24:28.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.741+0000 7fda27311640 1 Processor -- start 2024-09-19T09:24:28.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.741+0000 7fda27311640 1 -- start start 2024-09-19T09:24:28.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.742+0000 7fda27311640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fda200b1180 0x7fda200cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:28.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.742+0000 7fda27311640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda2006e730 con 0x7fda2015fef0 2024-09-19T09:24:28.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.742+0000 7fda27311640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda2006ea10 con 0x7fda2015eb00 2024-09-19T09:24:28.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.742+0000 7fda27311640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fda201637e0 con 0x7fda200b1180 2024-09-19T09:24:28.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.742+0000 7fda248ac640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fda2015fef0 0x7fda200b0a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44710/0 (socket says 172.21.15.18:44710) 2024-09-19T09:24:28.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.742+0000 7fda248ac640 1 -- 172.21.15.18:0/302636166 learned_addr learned my addr 172.21.15.18:0/302636166 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:24:28.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.742+0000 7fda1ffff640 1 -- 172.21.15.18:0/302636166 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1211376622 0 0) 0x7fda2006e730 con 0x7fda2015fef0 2024-09-19T09:24:28.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.742+0000 7fda1ffff640 1 -- 172.21.15.18:0/302636166 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda08003520 con 0x7fda2015fef0 2024-09-19T09:24:28.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.742+0000 7fda258ae640 1 --2- 172.21.15.18:0/302636166 >> v2:172.21.15.162:3300/0 conn(0x7fda200b1180 0x7fda200cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:28.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.743+0000 7fda1ffff640 1 -- 172.21.15.18:0/302636166 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2351642407 0 0) 0x7fda08003520 con 0x7fda2015fef0 2024-09-19T09:24:28.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.743+0000 7fda1ffff640 1 -- 172.21.15.18:0/302636166 >> v2:172.21.15.162:3300/0 conn(0x7fda200b1180 msgr2=0x7fda200cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:28.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.743+0000 7fda1ffff640 1 --2- 172.21.15.18:0/302636166 >> v2:172.21.15.162:3300/0 conn(0x7fda200b1180 0x7fda200cf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:28.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.743+0000 7fda1ffff640 1 -- 172.21.15.18:0/302636166 >> v1:172.21.15.162:6789/0 conn(0x7fda2015eb00 legacy=0x7fda201630d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:28.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.743+0000 7fda1ffff640 1 -- 172.21.15.18:0/302636166 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda201628d0 con 0x7fda2015fef0 2024-09-19T09:24:28.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.743+0000 7fda1ffff640 1 -- 172.21.15.18:0/302636166 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fda14001670 con 0x7fda2015fef0 2024-09-19T09:24:28.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.743+0000 7fda258ae640 1 --2- 172.21.15.18:0/302636166 >> v2:172.21.15.162:3300/0 conn(0x7fda200b1180 0x7fda200cf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:28.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.743+0000 7fda1ffff640 1 -- 172.21.15.18:0/302636166 >> v1:172.21.15.18:6789/0 conn(0x7fda2015fef0 legacy=0x7fda200b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:28.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.743+0000 7fda1ffff640 1 --2- 172.21.15.18:0/302636166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda080039b0 0x7fda08003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:28.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.743+0000 7fda1ffff640 1 --2- 172.21.15.18:0/302636166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda08004800 0x7fda08004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:28.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.743+0000 7fda1ffff640 1 --2- 172.21.15.18:0/302636166 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda080052e0 0x7fda0800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:28.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.743+0000 7fda1ffff640 1 -- 172.21.15.18:0/302636166 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fda201637e0 con 0x7fda08004800 2024-09-19T09:24:28.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.743+0000 7fda1ffff640 1 -- 172.21.15.18:0/302636166 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fda0800c1b0 con 0x7fda080039b0 2024-09-19T09:24:28.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.743+0000 7fda1ffff640 1 -- 172.21.15.18:0/302636166 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fda0800c3b0 con 0x7fda080052e0 2024-09-19T09:24:28.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.743+0000 7fda248ac640 1 --2- 172.21.15.18:0/302636166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda08004800 0x7fda08004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:28.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.743+0000 7fda250ad640 1 --2- 172.21.15.18:0/302636166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda080039b0 0x7fda08003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:28.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.743+0000 7fda258ae640 1 --2- 172.21.15.18:0/302636166 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda080052e0 0x7fda0800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:28.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.743+0000 7fda248ac640 1 -- 172.21.15.18:0/302636166 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda080052e0 msgr2=0x7fda0800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:28.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.743+0000 7fda248ac640 1 --2- 172.21.15.18:0/302636166 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda080052e0 0x7fda0800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:28.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.743+0000 7fda248ac640 1 -- 172.21.15.18:0/302636166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda080039b0 msgr2=0x7fda08003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:28.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.743+0000 7fda248ac640 1 --2- 172.21.15.18:0/302636166 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda080039b0 0x7fda08003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:28.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.743+0000 7fda248ac640 1 -- 172.21.15.18:0/302636166 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda08003520 con 0x7fda08004800 2024-09-19T09:24:28.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.743+0000 7fda258ae640 1 -- 172.21.15.18:0/302636166 reap_dead start 2024-09-19T09:24:28.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.744+0000 7fda248ac640 1 --2- 172.21.15.18:0/302636166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda08004800 0x7fda08004c80 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fda1400c210 tx=0x7fda08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75602ebda5ba3beb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:28.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.744+0000 7fda1ffff640 1 -- 172.21.15.18:0/302636166 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda14007cf0 con 0x7fda08004800 2024-09-19T09:24:28.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.744+0000 7fda1ffff640 1 -- 172.21.15.18:0/302636166 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda14005af0 con 0x7fda08004800 2024-09-19T09:24:28.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.744+0000 7fda1ffff640 1 -- 172.21.15.18:0/302636166 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda14007070 con 0x7fda08004800 2024-09-19T09:24:28.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.745+0000 7fda27311640 1 -- 172.21.15.18:0/302636166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda08004800 msgr2=0x7fda08004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:28.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.745+0000 7fda27311640 1 --2- 172.21.15.18:0/302636166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda08004800 0x7fda08004c80 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fda1400c210 tx=0x7fda08005830 comp rx=0 tx=0).stop 2024-09-19T09:24:28.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.745+0000 7fda27311640 1 -- 172.21.15.18:0/302636166 shutdown_connections 2024-09-19T09:24:28.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.745+0000 7fda27311640 1 --2- 172.21.15.18:0/302636166 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda08004800 0x7fda08004c80 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:28.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.745+0000 7fda27311640 1 -- 172.21.15.18:0/302636166 >> 172.21.15.18:0/302636166 conn(0x7fda2006cd20 msgr2=0x7fda2006d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:28.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.745+0000 7fda27311640 1 -- 172.21.15.18:0/302636166 shutdown_connections 2024-09-19T09:24:28.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.745+0000 7fda27311640 1 -- 172.21.15.18:0/302636166 wait complete. 2024-09-19T09:24:28.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.746+0000 7fda27311640 1 Processor -- start 2024-09-19T09:24:28.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.746+0000 7fda27311640 1 -- start start 2024-09-19T09:24:28.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.747+0000 7fda27311640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda08004800 0x7fda2015a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:28.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.747+0000 7fda27311640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda20149460 0x7fda2015bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:28.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.747+0000 7fda27311640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda2015dcd0 0x7fda200af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:28.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.747+0000 7fda27311640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fda2006d990 con 0x7fda20149460 2024-09-19T09:24:28.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.747+0000 7fda27311640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fda2006d810 con 0x7fda2015dcd0 2024-09-19T09:24:28.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.747+0000 7fda27311640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fda2006ffd0 con 0x7fda08004800 2024-09-19T09:24:28.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.747+0000 7fda248ac640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda20149460 0x7fda2015bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:28.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.747+0000 7fda248ac640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda20149460 0x7fda2015bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52920/0 (socket says 172.21.15.18:52920) 2024-09-19T09:24:28.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.747+0000 7fda248ac640 1 -- 172.21.15.18:0/921404292 learned_addr learned my addr 172.21.15.18:0/921404292 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:28.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.747+0000 7fda250ad640 1 --2- 172.21.15.18:0/921404292 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda08004800 0x7fda2015a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:28.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.747+0000 7fda258ae640 1 --2- 172.21.15.18:0/921404292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda2015dcd0 0x7fda200af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:28.753 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.747+0000 7fda248ac640 1 -- 172.21.15.18:0/921404292 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda08004800 msgr2=0x7fda2015a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:28.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.747+0000 7fda248ac640 1 --2- 172.21.15.18:0/921404292 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda08004800 0x7fda2015a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:28.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.747+0000 7fda248ac640 1 -- 172.21.15.18:0/921404292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda2015dcd0 msgr2=0x7fda200af9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:28.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.747+0000 7fda248ac640 1 --2- 172.21.15.18:0/921404292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda2015dcd0 0x7fda200af9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:28.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.747+0000 7fda248ac640 1 -- 172.21.15.18:0/921404292 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda2015aba0 con 0x7fda20149460 2024-09-19T09:24:28.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.747+0000 7fda248ac640 1 --2- 172.21.15.18:0/921404292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda20149460 0x7fda2015bc40 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fda14001970 tx=0x7fda20162aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:28.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.747+0000 7fda1dffb640 1 -- 172.21.15.18:0/921404292 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda1403f020 con 0x7fda20149460 2024-09-19T09:24:28.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.747+0000 7fda1dffb640 1 -- 172.21.15.18:0/921404292 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda14001470 con 0x7fda20149460 2024-09-19T09:24:28.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.747+0000 7fda27311640 1 -- 172.21.15.18:0/921404292 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda2015ae80 con 0x7fda20149460 2024-09-19T09:24:28.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.747+0000 7fda1dffb640 1 -- 172.21.15.18:0/921404292 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda140049e0 con 0x7fda20149460 2024-09-19T09:24:28.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.748+0000 7fda27311640 1 -- 172.21.15.18:0/921404292 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda2015b440 con 0x7fda20149460 2024-09-19T09:24:28.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.749+0000 7fda27311640 1 -- 172.21.15.18:0/921404292 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda200d1460 con 0x7fda20149460 2024-09-19T09:24:28.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.749+0000 7fda1dffb640 1 -- 172.21.15.18:0/921404292 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fda14042020 con 0x7fda20149460 2024-09-19T09:24:28.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.749+0000 7fda1dffb640 1 --2- 172.21.15.18:0/921404292 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fda0c06c2e0 0x7fda0c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:28.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.750+0000 7fda1dffb640 1 -- 172.21.15.18:0/921404292 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7fda140aadb0 con 0x7fda20149460 2024-09-19T09:24:28.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.750+0000 7fda250ad640 1 --2- 172.21.15.18:0/921404292 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fda0c06c2e0 0x7fda0c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:28.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.750+0000 7fda250ad640 1 --2- 172.21.15.18:0/921404292 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fda0c06c2e0 0x7fda0c06e7a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fda18000c00 tx=0x7fda18009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:28.755 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.754+0000 7fda1dffb640 1 -- 172.21.15.18:0/921404292 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fda14078ec0 con 0x7fda20149460 2024-09-19T09:24:28.931 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.930+0000 7fda27311640 1 -- 172.21.15.18:0/921404292 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fda2006c8f0 con 0x7fda20149460 2024-09-19T09:24:28.932 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.932+0000 7fda1dffb640 1 -- 172.21.15.18:0/921404292 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v182) ==== 74+0+16752 (secure 0 0 0) 0x7fda1407d1c0 con 0x7fda20149460 2024-09-19T09:24:28.933 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:24:28.933 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":182,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:24:27.186460+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:24:23.190145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-19T09:24:24.517971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"182","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:24:28.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.933+0000 7fda27311640 1 -- 172.21.15.18:0/921404292 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fda0c06c2e0 msgr2=0x7fda0c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:28.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.933+0000 7fda27311640 1 --2- 172.21.15.18:0/921404292 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fda0c06c2e0 0x7fda0c06e7a0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fda18000c00 tx=0x7fda18009040 comp rx=0 tx=0).stop 2024-09-19T09:24:28.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.934+0000 7fda27311640 1 -- 172.21.15.18:0/921404292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda20149460 msgr2=0x7fda2015bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:28.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.934+0000 7fda27311640 1 --2- 172.21.15.18:0/921404292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda20149460 0x7fda2015bc40 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fda14001970 tx=0x7fda20162aa0 comp rx=0 tx=0).stop 2024-09-19T09:24:28.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.934+0000 7fda27311640 1 -- 172.21.15.18:0/921404292 shutdown_connections 2024-09-19T09:24:28.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.934+0000 7fda27311640 1 --2- 172.21.15.18:0/921404292 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fda0c06c2e0 0x7fda0c06e7a0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:28.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.934+0000 7fda27311640 1 --2- 172.21.15.18:0/921404292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda2015dcd0 0x7fda200af9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:28.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.934+0000 7fda27311640 1 --2- 172.21.15.18:0/921404292 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda20149460 0x7fda2015bc40 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:28.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.934+0000 7fda27311640 1 --2- 172.21.15.18:0/921404292 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda08004800 0x7fda2015a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:28.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.934+0000 7fda27311640 1 -- 172.21.15.18:0/921404292 >> 172.21.15.18:0/921404292 conn(0x7fda2006cd20 msgr2=0x7fda200b1560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:28.935 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.934+0000 7fda27311640 1 -- 172.21.15.18:0/921404292 shutdown_connections 2024-09-19T09:24:28.936 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:28.934+0000 7fda27311640 1 -- 172.21.15.18:0/921404292 wait complete. 2024-09-19T09:24:28.946 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T09:24:28.946 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:24:29.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.047+0000 7f3c9d22c640 1 Processor -- start 2024-09-19T09:24:29.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.047+0000 7f3c9d22c640 1 -- start start 2024-09-19T09:24:29.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.048+0000 7f3c9d22c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3c980d57a0 0x7f3c980d1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:29.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.048+0000 7f3c9d22c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c980d3880 con 0x7f3c9815ecc0 2024-09-19T09:24:29.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.048+0000 7f3c9d22c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c980d3b20 con 0x7f3c980d1990 2024-09-19T09:24:29.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.048+0000 7f3c9d22c640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f3c980b42f0 con 0x7f3c980d57a0 2024-09-19T09:24:29.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.048+0000 7f3c96d9d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3c9815ecc0 0x7f3c980d3170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44716/0 (socket says 172.21.15.18:44716) 2024-09-19T09:24:29.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.048+0000 7f3c96d9d640 1 -- 172.21.15.18:0/2849979972 learned_addr learned my addr 172.21.15.18:0/2849979972 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:24:29.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.048+0000 7f3c9659c640 1 --2- 172.21.15.18:0/2849979972 >> v2:172.21.15.18:3300/0 conn(0x7f3c980d57a0 0x7f3c980d1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:29.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.048+0000 7f3c9659c640 1 -- 172.21.15.18:0/2849979972 >> v1:172.21.15.162:6789/0 conn(0x7f3c980d1990 legacy=0x7f3c980b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:29.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.049+0000 7f3c9659c640 1 -- 172.21.15.18:0/2849979972 >> v1:172.21.15.18:6789/0 conn(0x7f3c9815ecc0 legacy=0x7f3c980d3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:29.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.049+0000 7f3c9659c640 1 -- 172.21.15.18:0/2849979972 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c980b45d0 con 0x7f3c980d57a0 2024-09-19T09:24:29.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.049+0000 7f3c9659c640 1 --2- 172.21.15.18:0/2849979972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c980d57a0 0x7f3c980d1450 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c0097a0 tx=0x7f3c8c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3aa33cea7b8fe62 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:29.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.049+0000 7f3c95d9b640 1 -- 172.21.15.18:0/2849979972 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c037070 con 0x7f3c980d57a0 2024-09-19T09:24:29.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.049+0000 7f3c95d9b640 1 -- 172.21.15.18:0/2849979972 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c8c032440 con 0x7f3c980d57a0 2024-09-19T09:24:29.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.049+0000 7f3c95d9b640 1 -- 172.21.15.18:0/2849979972 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c8c032810 con 0x7f3c980d57a0 2024-09-19T09:24:29.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.050+0000 7f3c9d22c640 1 -- 172.21.15.18:0/2849979972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c980d57a0 msgr2=0x7f3c980d1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:29.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.050+0000 7f3c9d22c640 1 --2- 172.21.15.18:0/2849979972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c980d57a0 0x7f3c980d1450 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c0097a0 tx=0x7f3c8c02a1e0 comp rx=0 tx=0).stop 2024-09-19T09:24:29.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.050+0000 7f3c9d22c640 1 -- 172.21.15.18:0/2849979972 shutdown_connections 2024-09-19T09:24:29.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.050+0000 7f3c9d22c640 1 --2- 172.21.15.18:0/2849979972 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c980d57a0 0x7f3c980d1450 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:29.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.050+0000 7f3c9d22c640 1 -- 172.21.15.18:0/2849979972 >> 172.21.15.18:0/2849979972 conn(0x7f3c980d4bd0 msgr2=0x7f3c980d4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:29.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.050+0000 7f3c9d22c640 1 -- 172.21.15.18:0/2849979972 shutdown_connections 2024-09-19T09:24:29.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.050+0000 7f3c9d22c640 1 -- 172.21.15.18:0/2849979972 wait complete. 2024-09-19T09:24:29.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.051+0000 7f3c9d22c640 1 Processor -- start 2024-09-19T09:24:29.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.052+0000 7f3c9d22c640 1 -- start start 2024-09-19T09:24:29.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.052+0000 7f3c9d22c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c980d1990 0x7f3c980cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:29.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.052+0000 7f3c9d22c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c980d57a0 0x7f3c9814b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:29.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.052+0000 7f3c9d22c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c9815ecc0 0x7f3c980ce270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:29.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.052+0000 7f3c9d22c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9815f0a0 con 0x7f3c980d1990 2024-09-19T09:24:29.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.052+0000 7f3c9d22c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3c980b4b90 con 0x7f3c9815ecc0 2024-09-19T09:24:29.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.052+0000 7f3c9d22c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3c9815f220 con 0x7f3c980d57a0 2024-09-19T09:24:29.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.052+0000 7f3c96d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c980d1990 0x7f3c980cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:29.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.052+0000 7f3c96d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c980d1990 0x7f3c980cd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52944/0 (socket says 172.21.15.18:52944) 2024-09-19T09:24:29.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.052+0000 7f3c96d9d640 1 -- 172.21.15.18:0/4134309560 learned_addr learned my addr 172.21.15.18:0/4134309560 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:29.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.053+0000 7f3c9759e640 1 --2- 172.21.15.18:0/4134309560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c9815ecc0 0x7f3c980ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:29.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.053+0000 7f3c9659c640 1 --2- 172.21.15.18:0/4134309560 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c980d57a0 0x7f3c9814b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:29.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.053+0000 7f3c96d9d640 1 -- 172.21.15.18:0/4134309560 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c980d57a0 msgr2=0x7f3c9814b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:29.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.053+0000 7f3c96d9d640 1 --2- 172.21.15.18:0/4134309560 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c980d57a0 0x7f3c9814b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:29.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.053+0000 7f3c96d9d640 1 -- 172.21.15.18:0/4134309560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c9815ecc0 msgr2=0x7f3c980ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:29.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.053+0000 7f3c96d9d640 1 --2- 172.21.15.18:0/4134309560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c9815ecc0 0x7f3c980ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:29.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.053+0000 7f3c96d9d640 1 -- 172.21.15.18:0/4134309560 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c9814b870 con 0x7f3c980d1990 2024-09-19T09:24:29.055 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.053+0000 7f3c96d9d640 1 --2- 172.21.15.18:0/4134309560 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c980d1990 0x7f3c980cd280 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f3c8800ca70 tx=0x7f3c8800cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:29.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.053+0000 7f3c7f7fe640 1 -- 172.21.15.18:0/4134309560 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c88017070 con 0x7f3c980d1990 2024-09-19T09:24:29.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.053+0000 7f3c7f7fe640 1 -- 172.21.15.18:0/4134309560 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c8800abd0 con 0x7f3c980d1990 2024-09-19T09:24:29.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.053+0000 7f3c9d22c640 1 -- 172.21.15.18:0/4134309560 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c980ce7b0 con 0x7f3c980d1990 2024-09-19T09:24:29.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.053+0000 7f3c7f7fe640 1 -- 172.21.15.18:0/4134309560 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c88012400 con 0x7f3c980d1990 2024-09-19T09:24:29.056 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.053+0000 7f3c9d22c640 1 -- 172.21.15.18:0/4134309560 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c98148ee0 con 0x7f3c980d1990 2024-09-19T09:24:29.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.054+0000 7f3c9d22c640 1 -- 172.21.15.18:0/4134309560 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c980d1450 con 0x7f3c980d1990 2024-09-19T09:24:29.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.055+0000 7f3c7f7fe640 1 -- 172.21.15.18:0/4134309560 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3c8801a070 con 0x7f3c980d1990 2024-09-19T09:24:29.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.055+0000 7f3c7f7fe640 1 --2- 172.21.15.18:0/4134309560 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3c8406c2e0 0x7f3c8406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:29.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.055+0000 7f3c7f7fe640 1 -- 172.21.15.18:0/4134309560 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f3c8808b150 con 0x7f3c980d1990 2024-09-19T09:24:29.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.055+0000 7f3c9659c640 1 --2- 172.21.15.18:0/4134309560 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3c8406c2e0 0x7f3c8406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:29.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.056+0000 7f3c9659c640 1 --2- 172.21.15.18:0/4134309560 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3c8406c2e0 0x7f3c8406e7a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c034000 tx=0x7f3c8c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:29.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.059+0000 7f3c7f7fe640 1 -- 172.21.15.18:0/4134309560 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3c880598c0 con 0x7f3c980d1990 2024-09-19T09:24:29.232 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.231+0000 7f3c9d22c640 1 -- 172.21.15.18:0/4134309560 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3c9808e3c0 con 0x7f3c8406c2e0 2024-09-19T09:24:29.238 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.237+0000 7f3c7f7fe640 1 -- 172.21.15.18:0/4134309560 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247919 (secure 0 0 0) 0x7f3c9808e3c0 con 0x7f3c8406c2e0 2024-09-19T09:24:29.241 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:24:29.243 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:24:29.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.240+0000 7f3c9d22c640 1 -- 172.21.15.18:0/4134309560 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3c8406c2e0 msgr2=0x7f3c8406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:29.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.240+0000 7f3c9d22c640 1 --2- 172.21.15.18:0/4134309560 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3c8406c2e0 0x7f3c8406e7a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c034000 tx=0x7f3c8c02e000 comp rx=0 tx=0).stop 2024-09-19T09:24:29.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.240+0000 7f3c9d22c640 1 -- 172.21.15.18:0/4134309560 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c980d1990 msgr2=0x7f3c980cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:29.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.240+0000 7f3c9d22c640 1 --2- 172.21.15.18:0/4134309560 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c980d1990 0x7f3c980cd280 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f3c8800ca70 tx=0x7f3c8800cf30 comp rx=0 tx=0).stop 2024-09-19T09:24:29.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.240+0000 7f3c9d22c640 1 -- 172.21.15.18:0/4134309560 shutdown_connections 2024-09-19T09:24:29.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.240+0000 7f3c9d22c640 1 --2- 172.21.15.18:0/4134309560 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3c8406c2e0 0x7f3c8406e7a0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:29.244 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.240+0000 7f3c9d22c640 1 --2- 172.21.15.18:0/4134309560 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c9815ecc0 0x7f3c980ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:29.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.240+0000 7f3c9d22c640 1 --2- 172.21.15.18:0/4134309560 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3c980d57a0 0x7f3c9814b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:29.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.240+0000 7f3c9d22c640 1 --2- 172.21.15.18:0/4134309560 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3c980d1990 0x7f3c980cd280 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:29.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.240+0000 7f3c9d22c640 1 -- 172.21.15.18:0/4134309560 >> 172.21.15.18:0/4134309560 conn(0x7f3c980d4bd0 msgr2=0x7f3c980b32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:29.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.240+0000 7f3c9d22c640 1 -- 172.21.15.18:0/4134309560 shutdown_connections 2024-09-19T09:24:29.245 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.240+0000 7f3c9d22c640 1 -- 172.21.15.18:0/4134309560 wait complete. 2024-09-19T09:24:29.254 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":509,"stamp":"2024-09-19T09:24:27.686303+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9053,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553446,"statfs":{"total":1600000000,"available":1590729274,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001011"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.194707+0000","last_change":"2024-09-19T09:24:26.194588+0000","last_active":"2024-09-19T09:24:26.194707+0000","last_peered":"2024-09-19T09:24:26.194707+0000","last_clean":"2024-09-19T09:24:26.194707+0000","last_became_active":"2024-09-19T09:24:26.194365+0000","last_became_peered":"2024-09-19T09:24:26.194365+0000","last_unstale":"2024-09-19T09:24:26.194707+0000","last_undegraded":"2024-09-19T09:24:26.194707+0000","last_fullsized":"2024-09-19T09:24:26.194707+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:19.331152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.193910+0000","last_change":"2024-09-19T09:24:26.193789+0000","last_active":"2024-09-19T09:24:26.193910+0000","last_peered":"2024-09-19T09:24:26.193910+0000","last_clean":"2024-09-19T09:24:26.193910+0000","last_became_active":"2024-09-19T09:24:26.193551+0000","last_became_peered":"2024-09-19T09:24:26.193551+0000","last_unstale":"2024-09-19T09:24:26.193910+0000","last_undegraded":"2024-09-19T09:24:26.193910+0000","last_fullsized":"2024-09-19T09:24:26.193910+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:04.943812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.196468+0000","last_change":"2024-09-19T09:24:26.196270+0000","last_active":"2024-09-19T09:24:26.196468+0000","last_peered":"2024-09-19T09:24:26.196468+0000","last_clean":"2024-09-19T09:24:26.196468+0000","last_became_active":"2024-09-19T09:24:26.192846+0000","last_became_peered":"2024-09-19T09:24:26.192846+0000","last_unstale":"2024-09-19T09:24:26.196468+0000","last_undegraded":"2024-09-19T09:24:26.196468+0000","last_fullsized":"2024-09-19T09:24:26.196468+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:51.541796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.189055+0000","last_change":"2024-09-19T09:24:26.185597+0000","last_active":"2024-09-19T09:24:26.189055+0000","last_peered":"2024-09-19T09:24:26.189055+0000","last_clean":"2024-09-19T09:24:26.189055+0000","last_became_active":"2024-09-19T09:24:26.184878+0000","last_became_peered":"2024-09-19T09:24:26.184878+0000","last_unstale":"2024-09-19T09:24:26.189055+0000","last_undegraded":"2024-09-19T09:24:26.189055+0000","last_fullsized":"2024-09-19T09:24:26.189055+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:44.571707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.197787+0000","last_change":"2024-09-19T09:24:26.197642+0000","last_active":"2024-09-19T09:24:26.197787+0000","last_peered":"2024-09-19T09:24:26.197787+0000","last_clean":"2024-09-19T09:24:26.197787+0000","last_became_active":"2024-09-19T09:24:26.197210+0000","last_became_peered":"2024-09-19T09:24:26.197210+0000","last_unstale":"2024-09-19T09:24:26.197787+0000","last_undegraded":"2024-09-19T09:24:26.197787+0000","last_fullsized":"2024-09-19T09:24:26.197787+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:57.821498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.194035+0000","last_change":"2024-09-19T09:24:26.193929+0000","last_active":"2024-09-19T09:24:26.194035+0000","last_peered":"2024-09-19T09:24:26.194035+0000","last_clean":"2024-09-19T09:24:26.194035+0000","last_became_active":"2024-09-19T09:24:26.193637+0000","last_became_peered":"2024-09-19T09:24:26.193637+0000","last_unstale":"2024-09-19T09:24:26.194035+0000","last_undegraded":"2024-09-19T09:24:26.194035+0000","last_fullsized":"2024-09-19T09:24:26.194035+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:15.731311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.194745+0000","last_change":"2024-09-19T09:24:26.194637+0000","last_active":"2024-09-19T09:24:26.194745+0000","last_peered":"2024-09-19T09:24:26.194745+0000","last_clean":"2024-09-19T09:24:26.194745+0000","last_became_active":"2024-09-19T09:24:26.194323+0000","last_became_peered":"2024-09-19T09:24:26.194323+0000","last_unstale":"2024-09-19T09:24:26.194745+0000","last_undegraded":"2024-09-19T09:24:26.194745+0000","last_fullsized":"2024-09-19T09:24:26.194745+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:09.385629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.191995+0000","last_change":"2024-09-19T09:24:26.191845+0000","last_active":"2024-09-19T09:24:26.191995+0000","last_peered":"2024-09-19T09:24:26.191995+0000","last_clean":"2024-09-19T09:24:26.191995+0000","last_became_active":"2024-09-19T09:24:26.191617+0000","last_became_peered":"2024-09-19T09:24:26.191617+0000","last_unstale":"2024-09-19T09:24:26.191995+0000","last_undegraded":"2024-09-19T09:24:26.191995+0000","last_fullsized":"2024-09-19T09:24:26.191995+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:34.375951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.194900+0000","last_change":"2024-09-19T09:24:26.194775+0000","last_active":"2024-09-19T09:24:26.194900+0000","last_peered":"2024-09-19T09:24:26.194900+0000","last_clean":"2024-09-19T09:24:26.194900+0000","last_became_active":"2024-09-19T09:24:26.194444+0000","last_became_peered":"2024-09-19T09:24:26.194444+0000","last_unstale":"2024-09-19T09:24:26.194900+0000","last_undegraded":"2024-09-19T09:24:26.194900+0000","last_fullsized":"2024-09-19T09:24:26.194900+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:37.797647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.190716+0000","last_change":"2024-09-19T09:24:26.190597+0000","last_active":"2024-09-19T09:24:26.190716+0000","last_peered":"2024-09-19T09:24:26.190716+0000","last_clean":"2024-09-19T09:24:26.190716+0000","last_became_active":"2024-09-19T09:24:26.190306+0000","last_became_peered":"2024-09-19T09:24:26.190306+0000","last_unstale":"2024-09-19T09:24:26.190716+0000","last_undegraded":"2024-09-19T09:24:26.190716+0000","last_fullsized":"2024-09-19T09:24:26.190716+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:40.243064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.189253+0000","last_change":"2024-09-19T09:24:26.189099+0000","last_active":"2024-09-19T09:24:26.189253+0000","last_peered":"2024-09-19T09:24:26.189253+0000","last_clean":"2024-09-19T09:24:26.189253+0000","last_became_active":"2024-09-19T09:24:26.188813+0000","last_became_peered":"2024-09-19T09:24:26.188813+0000","last_unstale":"2024-09-19T09:24:26.189253+0000","last_undegraded":"2024-09-19T09:24:26.189253+0000","last_fullsized":"2024-09-19T09:24:26.189253+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:11.484526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.189884+0000","last_change":"2024-09-19T09:24:26.189734+0000","last_active":"2024-09-19T09:24:26.189884+0000","last_peered":"2024-09-19T09:24:26.189884+0000","last_clean":"2024-09-19T09:24:26.189884+0000","last_became_active":"2024-09-19T09:24:26.188205+0000","last_became_peered":"2024-09-19T09:24:26.188205+0000","last_unstale":"2024-09-19T09:24:26.189884+0000","last_undegraded":"2024-09-19T09:24:26.189884+0000","last_fullsized":"2024-09-19T09:24:26.189884+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:05.312162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.185299+0000","last_change":"2024-09-19T09:24:26.185190+0000","last_active":"2024-09-19T09:24:26.185299+0000","last_peered":"2024-09-19T09:24:26.185299+0000","last_clean":"2024-09-19T09:24:26.185299+0000","last_became_active":"2024-09-19T09:24:26.184938+0000","last_became_peered":"2024-09-19T09:24:26.184938+0000","last_unstale":"2024-09-19T09:24:26.185299+0000","last_undegraded":"2024-09-19T09:24:26.185299+0000","last_fullsized":"2024-09-19T09:24:26.185299+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:28.841141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.193988+0000","last_change":"2024-09-19T09:24:26.193864+0000","last_active":"2024-09-19T09:24:26.193988+0000","last_peered":"2024-09-19T09:24:26.193988+0000","last_clean":"2024-09-19T09:24:26.193988+0000","last_became_active":"2024-09-19T09:24:26.193600+0000","last_became_peered":"2024-09-19T09:24:26.193600+0000","last_unstale":"2024-09-19T09:24:26.193988+0000","last_undegraded":"2024-09-19T09:24:26.193988+0000","last_fullsized":"2024-09-19T09:24:26.193988+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:51.593028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.198749+0000","last_change":"2024-09-19T09:24:26.198170+0000","last_active":"2024-09-19T09:24:26.198749+0000","last_peered":"2024-09-19T09:24:26.198749+0000","last_clean":"2024-09-19T09:24:26.198749+0000","last_became_active":"2024-09-19T09:24:26.197941+0000","last_became_peered":"2024-09-19T09:24:26.197941+0000","last_unstale":"2024-09-19T09:24:26.198749+0000","last_undegraded":"2024-09-19T09:24:26.198749+0000","last_fullsized":"2024-09-19T09:24:26.198749+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:24:19.032283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.193955+0000","last_change":"2024-09-19T09:24:26.193435+0000","last_active":"2024-09-19T09:24:26.193955+0000","last_peered":"2024-09-19T09:24:26.193955+0000","last_clean":"2024-09-19T09:24:26.193955+0000","last_became_active":"2024-09-19T09:24:26.193167+0000","last_became_peered":"2024-09-19T09:24:26.193167+0000","last_unstale":"2024-09-19T09:24:26.193955+0000","last_undegraded":"2024-09-19T09:24:26.193955+0000","last_fullsized":"2024-09-19T09:24:26.193955+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:44.419781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.193890+0000","last_change":"2024-09-19T09:24:26.193698+0000","last_active":"2024-09-19T09:24:26.193890+0000","last_peered":"2024-09-19T09:24:26.193890+0000","last_clean":"2024-09-19T09:24:26.193890+0000","last_became_active":"2024-09-19T09:24:26.193476+0000","last_became_peered":"2024-09-19T09:24:26.193476+0000","last_unstale":"2024-09-19T09:24:26.193890+0000","last_undegraded":"2024-09-19T09:24:26.193890+0000","last_fullsized":"2024-09-19T09:24:26.193890+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:10.731046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.189325+0000","last_change":"2024-09-19T09:24:26.188866+0000","last_active":"2024-09-19T09:24:26.189325+0000","last_peered":"2024-09-19T09:24:26.189325+0000","last_clean":"2024-09-19T09:24:26.189325+0000","last_became_active":"2024-09-19T09:24:26.188599+0000","last_became_peered":"2024-09-19T09:24:26.188599+0000","last_unstale":"2024-09-19T09:24:26.189325+0000","last_undegraded":"2024-09-19T09:24:26.189325+0000","last_fullsized":"2024-09-19T09:24:26.189325+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:06.709657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.193026+0000","last_change":"2024-09-19T09:24:26.189832+0000","last_active":"2024-09-19T09:24:26.193026+0000","last_peered":"2024-09-19T09:24:26.193026+0000","last_clean":"2024-09-19T09:24:26.193026+0000","last_became_active":"2024-09-19T09:24:26.189575+0000","last_became_peered":"2024-09-19T09:24:26.189575+0000","last_unstale":"2024-09-19T09:24:26.193026+0000","last_undegraded":"2024-09-19T09:24:26.193026+0000","last_fullsized":"2024-09-19T09:24:26.193026+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:47.890590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.189851+0000","last_change":"2024-09-19T09:24:26.189336+0000","last_active":"2024-09-19T09:24:26.189851+0000","last_peered":"2024-09-19T09:24:26.189851+0000","last_clean":"2024-09-19T09:24:26.189851+0000","last_became_active":"2024-09-19T09:24:26.189099+0000","last_became_peered":"2024-09-19T09:24:26.189099+0000","last_unstale":"2024-09-19T09:24:26.189851+0000","last_undegraded":"2024-09-19T09:24:26.189851+0000","last_fullsized":"2024-09-19T09:24:26.189851+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:49.105275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.197569+0000","last_change":"2024-09-19T09:24:26.197448+0000","last_active":"2024-09-19T09:24:26.197569+0000","last_peered":"2024-09-19T09:24:26.197569+0000","last_clean":"2024-09-19T09:24:26.197569+0000","last_became_active":"2024-09-19T09:24:26.197213+0000","last_became_peered":"2024-09-19T09:24:26.197213+0000","last_unstale":"2024-09-19T09:24:26.197569+0000","last_undegraded":"2024-09-19T09:24:26.197569+0000","last_fullsized":"2024-09-19T09:24:26.197569+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:13.812914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.187780+0000","last_change":"2024-09-19T09:24:26.187649+0000","last_active":"2024-09-19T09:24:26.187780+0000","last_peered":"2024-09-19T09:24:26.187780+0000","last_clean":"2024-09-19T09:24:26.187780+0000","last_became_active":"2024-09-19T09:24:26.187416+0000","last_became_peered":"2024-09-19T09:24:26.187416+0000","last_unstale":"2024-09-19T09:24:26.187780+0000","last_undegraded":"2024-09-19T09:24:26.187780+0000","last_fullsized":"2024-09-19T09:24:26.187780+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:11.935991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.188753+0000","last_change":"2024-09-19T09:24:26.188423+0000","last_active":"2024-09-19T09:24:26.188753+0000","last_peered":"2024-09-19T09:24:26.188753+0000","last_clean":"2024-09-19T09:24:26.188753+0000","last_became_active":"2024-09-19T09:24:26.187734+0000","last_became_peered":"2024-09-19T09:24:26.187734+0000","last_unstale":"2024-09-19T09:24:26.188753+0000","last_undegraded":"2024-09-19T09:24:26.188753+0000","last_fullsized":"2024-09-19T09:24:26.188753+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:11:26.564986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.199117+0000","last_change":"2024-09-19T09:24:26.198922+0000","last_active":"2024-09-19T09:24:26.199117+0000","last_peered":"2024-09-19T09:24:26.199117+0000","last_clean":"2024-09-19T09:24:26.199117+0000","last_became_active":"2024-09-19T09:24:26.198182+0000","last_became_peered":"2024-09-19T09:24:26.198182+0000","last_unstale":"2024-09-19T09:24:26.199117+0000","last_undegraded":"2024-09-19T09:24:26.199117+0000","last_fullsized":"2024-09-19T09:24:26.199117+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:20.363044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.192073+0000","last_change":"2024-09-19T09:24:26.191954+0000","last_active":"2024-09-19T09:24:26.192073+0000","last_peered":"2024-09-19T09:24:26.192073+0000","last_clean":"2024-09-19T09:24:26.192073+0000","last_became_active":"2024-09-19T09:24:26.191718+0000","last_became_peered":"2024-09-19T09:24:26.191718+0000","last_unstale":"2024-09-19T09:24:26.192073+0000","last_undegraded":"2024-09-19T09:24:26.192073+0000","last_fullsized":"2024-09-19T09:24:26.192073+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:38.873128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.190467+0000","last_change":"2024-09-19T09:24:26.190287+0000","last_active":"2024-09-19T09:24:26.190467+0000","last_peered":"2024-09-19T09:24:26.190467+0000","last_clean":"2024-09-19T09:24:26.190467+0000","last_became_active":"2024-09-19T09:24:26.190006+0000","last_became_peered":"2024-09-19T09:24:26.190006+0000","last_unstale":"2024-09-19T09:24:26.190467+0000","last_undegraded":"2024-09-19T09:24:26.190467+0000","last_fullsized":"2024-09-19T09:24:26.190467+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:45.517892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.195867+0000","last_change":"2024-09-19T09:24:26.195737+0000","last_active":"2024-09-19T09:24:26.195867+0000","last_peered":"2024-09-19T09:24:26.195867+0000","last_clean":"2024-09-19T09:24:26.195867+0000","last_became_active":"2024-09-19T09:24:26.195493+0000","last_became_peered":"2024-09-19T09:24:26.195493+0000","last_unstale":"2024-09-19T09:24:26.195867+0000","last_undegraded":"2024-09-19T09:24:26.195867+0000","last_fullsized":"2024-09-19T09:24:26.195867+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:48:09.520590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.193001+0000","last_change":"2024-09-19T09:24:26.190481+0000","last_active":"2024-09-19T09:24:26.193001+0000","last_peered":"2024-09-19T09:24:26.193001+0000","last_clean":"2024-09-19T09:24:26.193001+0000","last_became_active":"2024-09-19T09:24:26.190249+0000","last_became_peered":"2024-09-19T09:24:26.190249+0000","last_unstale":"2024-09-19T09:24:26.193001+0000","last_undegraded":"2024-09-19T09:24:26.193001+0000","last_fullsized":"2024-09-19T09:24:26.193001+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:32.320604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.192317+0000","last_change":"2024-09-19T09:24:26.192196+0000","last_active":"2024-09-19T09:24:26.192317+0000","last_peered":"2024-09-19T09:24:26.192317+0000","last_clean":"2024-09-19T09:24:26.192317+0000","last_became_active":"2024-09-19T09:24:26.191956+0000","last_became_peered":"2024-09-19T09:24:26.191956+0000","last_unstale":"2024-09-19T09:24:26.192317+0000","last_undegraded":"2024-09-19T09:24:26.192317+0000","last_fullsized":"2024-09-19T09:24:26.192317+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:23:25.813243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.198671+0000","last_change":"2024-09-19T09:24:26.197471+0000","last_active":"2024-09-19T09:24:26.198671+0000","last_peered":"2024-09-19T09:24:26.198671+0000","last_clean":"2024-09-19T09:24:26.198671+0000","last_became_active":"2024-09-19T09:24:26.195289+0000","last_became_peered":"2024-09-19T09:24:26.195289+0000","last_unstale":"2024-09-19T09:24:26.198671+0000","last_undegraded":"2024-09-19T09:24:26.198671+0000","last_fullsized":"2024-09-19T09:24:26.198671+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:02.553332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.191726+0000","last_change":"2024-09-19T09:24:26.191601+0000","last_active":"2024-09-19T09:24:26.191726+0000","last_peered":"2024-09-19T09:24:26.191726+0000","last_clean":"2024-09-19T09:24:26.191726+0000","last_became_active":"2024-09-19T09:24:26.191359+0000","last_became_peered":"2024-09-19T09:24:26.191359+0000","last_unstale":"2024-09-19T09:24:26.191726+0000","last_undegraded":"2024-09-19T09:24:26.191726+0000","last_fullsized":"2024-09-19T09:24:26.191726+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:07.403172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.192174+0000","last_change":"2024-09-19T09:24:26.191662+0000","last_active":"2024-09-19T09:24:26.192174+0000","last_peered":"2024-09-19T09:24:26.192174+0000","last_clean":"2024-09-19T09:24:26.192174+0000","last_became_active":"2024-09-19T09:24:26.190832+0000","last_became_peered":"2024-09-19T09:24:26.190832+0000","last_unstale":"2024-09-19T09:24:26.192174+0000","last_undegraded":"2024-09-19T09:24:26.192174+0000","last_fullsized":"2024-09-19T09:24:26.192174+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:29.561737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.189036+0000","last_change":"2024-09-19T09:24:26.185419+0000","last_active":"2024-09-19T09:24:26.189036+0000","last_peered":"2024-09-19T09:24:26.189036+0000","last_clean":"2024-09-19T09:24:26.189036+0000","last_became_active":"2024-09-19T09:24:26.184559+0000","last_became_peered":"2024-09-19T09:24:26.184559+0000","last_unstale":"2024-09-19T09:24:26.189036+0000","last_undegraded":"2024-09-19T09:24:26.189036+0000","last_fullsized":"2024-09-19T09:24:26.189036+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:13.085621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1f","version":"181'4","reported_seq":16,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.206321+0000","last_change":"2024-09-19T09:24:25.174202+0000","last_active":"2024-09-19T09:24:26.206321+0000","last_peered":"2024-09-19T09:24:26.206321+0000","last_clean":"2024-09-19T09:24:26.206321+0000","last_became_active":"2024-09-19T09:24:25.173691+0000","last_became_peered":"2024-09-19T09:24:25.173691+0000","last_unstale":"2024-09-19T09:24:26.206321+0000","last_undegraded":"2024-09-19T09:24:26.206321+0000","last_fullsized":"2024-09-19T09:24:26.206321+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:29.416788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.203309+0000","last_change":"2024-09-19T09:24:26.202924+0000","last_active":"2024-09-19T09:24:26.203309+0000","last_peered":"2024-09-19T09:24:26.203309+0000","last_clean":"2024-09-19T09:24:26.203309+0000","last_became_active":"2024-09-19T09:24:26.196758+0000","last_became_peered":"2024-09-19T09:24:26.196758+0000","last_unstale":"2024-09-19T09:24:26.203309+0000","last_undegraded":"2024-09-19T09:24:26.203309+0000","last_fullsized":"2024-09-19T09:24:26.203309+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:25:54.537140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1e","version":"181'1","reported_seq":13,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.204073+0000","last_change":"2024-09-19T09:24:25.177899+0000","last_active":"2024-09-19T09:24:26.204073+0000","last_peered":"2024-09-19T09:24:26.204073+0000","last_clean":"2024-09-19T09:24:26.204073+0000","last_became_active":"2024-09-19T09:24:25.177658+0000","last_became_peered":"2024-09-19T09:24:25.177658+0000","last_unstale":"2024-09-19T09:24:26.204073+0000","last_undegraded":"2024-09-19T09:24:26.204073+0000","last_fullsized":"2024-09-19T09:24:26.204073+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:46.518560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.187467+0000","last_change":"2024-09-19T09:24:26.187354+0000","last_active":"2024-09-19T09:24:26.187467+0000","last_peered":"2024-09-19T09:24:26.187467+0000","last_clean":"2024-09-19T09:24:26.187467+0000","last_became_active":"2024-09-19T09:24:26.187125+0000","last_became_peered":"2024-09-19T09:24:26.187125+0000","last_unstale":"2024-09-19T09:24:26.187467+0000","last_undegraded":"2024-09-19T09:24:26.187467+0000","last_fullsized":"2024-09-19T09:24:26.187467+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:34.558665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1d","version":"181'2","reported_seq":14,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.201290+0000","last_change":"2024-09-19T09:24:25.176960+0000","last_active":"2024-09-19T09:24:26.201290+0000","last_peered":"2024-09-19T09:24:26.201290+0000","last_clean":"2024-09-19T09:24:26.201290+0000","last_became_active":"2024-09-19T09:24:25.176706+0000","last_became_peered":"2024-09-19T09:24:25.176706+0000","last_unstale":"2024-09-19T09:24:26.201290+0000","last_undegraded":"2024-09-19T09:24:26.201290+0000","last_fullsized":"2024-09-19T09:24:26.201290+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:32.940868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.198730+0000","last_change":"2024-09-19T09:24:26.197671+0000","last_active":"2024-09-19T09:24:26.198730+0000","last_peered":"2024-09-19T09:24:26.198730+0000","last_clean":"2024-09-19T09:24:26.198730+0000","last_became_active":"2024-09-19T09:24:26.197223+0000","last_became_peered":"2024-09-19T09:24:26.197223+0000","last_unstale":"2024-09-19T09:24:26.198730+0000","last_undegraded":"2024-09-19T09:24:26.198730+0000","last_fullsized":"2024-09-19T09:24:26.198730+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:56:43.801097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1c","version":"181'2","reported_seq":14,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.199804+0000","last_change":"2024-09-19T09:24:25.174628+0000","last_active":"2024-09-19T09:24:26.199804+0000","last_peered":"2024-09-19T09:24:26.199804+0000","last_clean":"2024-09-19T09:24:26.199804+0000","last_became_active":"2024-09-19T09:24:25.174377+0000","last_became_peered":"2024-09-19T09:24:25.174377+0000","last_unstale":"2024-09-19T09:24:26.199804+0000","last_undegraded":"2024-09-19T09:24:26.199804+0000","last_fullsized":"2024-09-19T09:24:26.199804+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:54.702344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.188993+0000","last_change":"2024-09-19T09:24:26.182926+0000","last_active":"2024-09-19T09:24:26.188993+0000","last_peered":"2024-09-19T09:24:26.188993+0000","last_clean":"2024-09-19T09:24:26.188993+0000","last_became_active":"2024-09-19T09:24:26.182688+0000","last_became_peered":"2024-09-19T09:24:26.182688+0000","last_unstale":"2024-09-19T09:24:26.188993+0000","last_undegraded":"2024-09-19T09:24:26.188993+0000","last_fullsized":"2024-09-19T09:24:26.188993+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:36.481929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1b","version":"181'1","reported_seq":13,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.202154+0000","last_change":"2024-09-19T09:24:25.173160+0000","last_active":"2024-09-19T09:24:26.202154+0000","last_peered":"2024-09-19T09:24:26.202154+0000","last_clean":"2024-09-19T09:24:26.202154+0000","last_became_active":"2024-09-19T09:24:25.172886+0000","last_became_peered":"2024-09-19T09:24:25.172886+0000","last_unstale":"2024-09-19T09:24:26.202154+0000","last_undegraded":"2024-09-19T09:24:26.202154+0000","last_fullsized":"2024-09-19T09:24:26.202154+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:26.660384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.192374+0000","last_change":"2024-09-19T09:24:26.192264+0000","last_active":"2024-09-19T09:24:26.192374+0000","last_peered":"2024-09-19T09:24:26.192374+0000","last_clean":"2024-09-19T09:24:26.192374+0000","last_became_active":"2024-09-19T09:24:26.191143+0000","last_became_peered":"2024-09-19T09:24:26.191143+0000","last_unstale":"2024-09-19T09:24:26.192374+0000","last_undegraded":"2024-09-19T09:24:26.192374+0000","last_fullsized":"2024-09-19T09:24:26.192374+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:30.402024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1a","version":"181'1","reported_seq":13,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.203666+0000","last_change":"2024-09-19T09:24:25.175129+0000","last_active":"2024-09-19T09:24:26.203666+0000","last_peered":"2024-09-19T09:24:26.203666+0000","last_clean":"2024-09-19T09:24:26.203666+0000","last_became_active":"2024-09-19T09:24:25.174887+0000","last_became_peered":"2024-09-19T09:24:25.174887+0000","last_unstale":"2024-09-19T09:24:26.203666+0000","last_undegraded":"2024-09-19T09:24:26.203666+0000","last_fullsized":"2024-09-19T09:24:26.203666+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:53:27.819337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.186810+0000","last_change":"2024-09-19T09:24:26.185739+0000","last_active":"2024-09-19T09:24:26.186810+0000","last_peered":"2024-09-19T09:24:26.186810+0000","last_clean":"2024-09-19T09:24:26.186810+0000","last_became_active":"2024-09-19T09:24:26.185469+0000","last_became_peered":"2024-09-19T09:24:26.185469+0000","last_unstale":"2024-09-19T09:24:26.186810+0000","last_undegraded":"2024-09-19T09:24:26.186810+0000","last_fullsized":"2024-09-19T09:24:26.186810+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:43.941397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.184934+0000","last_change":"2024-09-19T09:24:25.171583+0000","last_active":"2024-09-19T09:24:26.184934+0000","last_peered":"2024-09-19T09:24:26.184934+0000","last_clean":"2024-09-19T09:24:26.184934+0000","last_became_active":"2024-09-19T09:24:25.171345+0000","last_became_peered":"2024-09-19T09:24:25.171345+0000","last_unstale":"2024-09-19T09:24:26.184934+0000","last_undegraded":"2024-09-19T09:24:26.184934+0000","last_fullsized":"2024-09-19T09:24:26.184934+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:18.143800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.189073+0000","last_change":"2024-09-19T09:24:26.185769+0000","last_active":"2024-09-19T09:24:26.189073+0000","last_peered":"2024-09-19T09:24:26.189073+0000","last_clean":"2024-09-19T09:24:26.189073+0000","last_became_active":"2024-09-19T09:24:26.185202+0000","last_became_peered":"2024-09-19T09:24:26.185202+0000","last_unstale":"2024-09-19T09:24:26.189073+0000","last_undegraded":"2024-09-19T09:24:26.189073+0000","last_fullsized":"2024-09-19T09:24:26.189073+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:46.459808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.180656+0000","last_change":"2024-09-19T09:24:25.173824+0000","last_active":"2024-09-19T09:24:26.180656+0000","last_peered":"2024-09-19T09:24:26.180656+0000","last_clean":"2024-09-19T09:24:26.180656+0000","last_became_active":"2024-09-19T09:24:25.172884+0000","last_became_peered":"2024-09-19T09:24:25.172884+0000","last_unstale":"2024-09-19T09:24:26.180656+0000","last_undegraded":"2024-09-19T09:24:26.180656+0000","last_fullsized":"2024-09-19T09:24:26.180656+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:04:31.866549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.188836+0000","last_change":"2024-09-19T09:24:26.188226+0000","last_active":"2024-09-19T09:24:26.188836+0000","last_peered":"2024-09-19T09:24:26.188836+0000","last_clean":"2024-09-19T09:24:26.188836+0000","last_became_active":"2024-09-19T09:24:26.188001+0000","last_became_peered":"2024-09-19T09:24:26.188001+0000","last_unstale":"2024-09-19T09:24:26.188836+0000","last_undegraded":"2024-09-19T09:24:26.188836+0000","last_fullsized":"2024-09-19T09:24:26.188836+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:50.840886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.186162+0000","last_change":"2024-09-19T09:24:25.176806+0000","last_active":"2024-09-19T09:24:26.186162+0000","last_peered":"2024-09-19T09:24:26.186162+0000","last_clean":"2024-09-19T09:24:26.186162+0000","last_became_active":"2024-09-19T09:24:25.176555+0000","last_became_peered":"2024-09-19T09:24:25.176555+0000","last_unstale":"2024-09-19T09:24:26.186162+0000","last_undegraded":"2024-09-19T09:24:26.186162+0000","last_fullsized":"2024-09-19T09:24:26.186162+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:14.016215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.186094+0000","last_change":"2024-09-19T09:24:26.185959+0000","last_active":"2024-09-19T09:24:26.186094+0000","last_peered":"2024-09-19T09:24:26.186094+0000","last_clean":"2024-09-19T09:24:26.186094+0000","last_became_active":"2024-09-19T09:24:26.185722+0000","last_became_peered":"2024-09-19T09:24:26.185722+0000","last_unstale":"2024-09-19T09:24:26.186094+0000","last_undegraded":"2024-09-19T09:24:26.186094+0000","last_fullsized":"2024-09-19T09:24:26.186094+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:37.768127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.15","version":"181'3","reported_seq":15,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.200451+0000","last_change":"2024-09-19T09:24:25.173616+0000","last_active":"2024-09-19T09:24:26.200451+0000","last_peered":"2024-09-19T09:24:26.200451+0000","last_clean":"2024-09-19T09:24:26.200451+0000","last_became_active":"2024-09-19T09:24:25.172815+0000","last_became_peered":"2024-09-19T09:24:25.172815+0000","last_unstale":"2024-09-19T09:24:26.200451+0000","last_undegraded":"2024-09-19T09:24:26.200451+0000","last_fullsized":"2024-09-19T09:24:26.200451+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:18.168213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.196177+0000","last_change":"2024-09-19T09:24:26.196051+0000","last_active":"2024-09-19T09:24:26.196177+0000","last_peered":"2024-09-19T09:24:26.196177+0000","last_clean":"2024-09-19T09:24:26.196177+0000","last_became_active":"2024-09-19T09:24:26.192523+0000","last_became_peered":"2024-09-19T09:24:26.192523+0000","last_unstale":"2024-09-19T09:24:26.196177+0000","last_undegraded":"2024-09-19T09:24:26.196177+0000","last_fullsized":"2024-09-19T09:24:26.196177+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:33.528058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.14","version":"181'6","reported_seq":18,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.206663+0000","last_change":"2024-09-19T09:24:25.171306+0000","last_active":"2024-09-19T09:24:26.206663+0000","last_peered":"2024-09-19T09:24:26.206663+0000","last_clean":"2024-09-19T09:24:26.206663+0000","last_became_active":"2024-09-19T09:24:25.170867+0000","last_became_peered":"2024-09-19T09:24:25.170867+0000","last_unstale":"2024-09-19T09:24:26.206663+0000","last_undegraded":"2024-09-19T09:24:26.206663+0000","last_fullsized":"2024-09-19T09:24:26.206663+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:07.502205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.189166+0000","last_change":"2024-09-19T09:24:26.189057+0000","last_active":"2024-09-19T09:24:26.189166+0000","last_peered":"2024-09-19T09:24:26.189166+0000","last_clean":"2024-09-19T09:24:26.189166+0000","last_became_active":"2024-09-19T09:24:26.188824+0000","last_became_peered":"2024-09-19T09:24:26.188824+0000","last_unstale":"2024-09-19T09:24:26.189166+0000","last_undegraded":"2024-09-19T09:24:26.189166+0000","last_fullsized":"2024-09-19T09:24:26.189166+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:43:50.273331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"181'2","reported_seq":14,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.199614+0000","last_change":"2024-09-19T09:24:25.173492+0000","last_active":"2024-09-19T09:24:26.199614+0000","last_peered":"2024-09-19T09:24:26.199614+0000","last_clean":"2024-09-19T09:24:26.199614+0000","last_became_active":"2024-09-19T09:24:25.173268+0000","last_became_peered":"2024-09-19T09:24:25.173268+0000","last_unstale":"2024-09-19T09:24:26.199614+0000","last_undegraded":"2024-09-19T09:24:26.199614+0000","last_fullsized":"2024-09-19T09:24:26.199614+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:28.002992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.190395+0000","last_change":"2024-09-19T09:24:26.189617+0000","last_active":"2024-09-19T09:24:26.190395+0000","last_peered":"2024-09-19T09:24:26.190395+0000","last_clean":"2024-09-19T09:24:26.190395+0000","last_became_active":"2024-09-19T09:24:26.189263+0000","last_became_peered":"2024-09-19T09:24:26.189263+0000","last_unstale":"2024-09-19T09:24:26.190395+0000","last_undegraded":"2024-09-19T09:24:26.190395+0000","last_fullsized":"2024-09-19T09:24:26.190395+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:33.370499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.184459+0000","last_change":"2024-09-19T09:24:25.172231+0000","last_active":"2024-09-19T09:24:26.184459+0000","last_peered":"2024-09-19T09:24:26.184459+0000","last_clean":"2024-09-19T09:24:26.184459+0000","last_became_active":"2024-09-19T09:24:25.171955+0000","last_became_peered":"2024-09-19T09:24:25.171955+0000","last_unstale":"2024-09-19T09:24:26.184459+0000","last_undegraded":"2024-09-19T09:24:26.184459+0000","last_fullsized":"2024-09-19T09:24:26.184459+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:57.340731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.190469+0000","last_change":"2024-09-19T09:24:26.190353+0000","last_active":"2024-09-19T09:24:26.190469+0000","last_peered":"2024-09-19T09:24:26.190469+0000","last_clean":"2024-09-19T09:24:26.190469+0000","last_became_active":"2024-09-19T09:24:26.190132+0000","last_became_peered":"2024-09-19T09:24:26.190132+0000","last_unstale":"2024-09-19T09:24:26.190469+0000","last_undegraded":"2024-09-19T09:24:26.190469+0000","last_fullsized":"2024-09-19T09:24:26.190469+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:58.274876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.184182+0000","last_change":"2024-09-19T09:24:25.176055+0000","last_active":"2024-09-19T09:24:26.184182+0000","last_peered":"2024-09-19T09:24:26.184182+0000","last_clean":"2024-09-19T09:24:26.184182+0000","last_became_active":"2024-09-19T09:24:25.175619+0000","last_became_peered":"2024-09-19T09:24:25.175619+0000","last_unstale":"2024-09-19T09:24:26.184182+0000","last_undegraded":"2024-09-19T09:24:26.184182+0000","last_fullsized":"2024-09-19T09:24:26.184182+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:13.151199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.198691+0000","last_change":"2024-09-19T09:24:26.197616+0000","last_active":"2024-09-19T09:24:26.198691+0000","last_peered":"2024-09-19T09:24:26.198691+0000","last_clean":"2024-09-19T09:24:26.198691+0000","last_became_active":"2024-09-19T09:24:26.197333+0000","last_became_peered":"2024-09-19T09:24:26.197333+0000","last_unstale":"2024-09-19T09:24:26.198691+0000","last_undegraded":"2024-09-19T09:24:26.198691+0000","last_fullsized":"2024-09-19T09:24:26.198691+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:42.044020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.10","version":"181'8","reported_seq":20,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.206138+0000","last_change":"2024-09-19T09:24:25.170674+0000","last_active":"2024-09-19T09:24:26.206138+0000","last_peered":"2024-09-19T09:24:26.206138+0000","last_clean":"2024-09-19T09:24:26.206138+0000","last_became_active":"2024-09-19T09:24:25.170428+0000","last_became_peered":"2024-09-19T09:24:25.170428+0000","last_unstale":"2024-09-19T09:24:26.206138+0000","last_undegraded":"2024-09-19T09:24:26.206138+0000","last_fullsized":"2024-09-19T09:24:26.206138+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:23.674916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.193083+0000","last_change":"2024-09-19T09:24:26.192260+0000","last_active":"2024-09-19T09:24:26.193083+0000","last_peered":"2024-09-19T09:24:26.193083+0000","last_clean":"2024-09-19T09:24:26.193083+0000","last_became_active":"2024-09-19T09:24:26.191551+0000","last_became_peered":"2024-09-19T09:24:26.191551+0000","last_unstale":"2024-09-19T09:24:26.193083+0000","last_undegraded":"2024-09-19T09:24:26.193083+0000","last_fullsized":"2024-09-19T09:24:26.193083+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:41:41.025606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.f","version":"181'1","reported_seq":13,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.205229+0000","last_change":"2024-09-19T09:24:25.171111+0000","last_active":"2024-09-19T09:24:26.205229+0000","last_peered":"2024-09-19T09:24:26.205229+0000","last_clean":"2024-09-19T09:24:26.205229+0000","last_became_active":"2024-09-19T09:24:25.170447+0000","last_became_peered":"2024-09-19T09:24:25.170447+0000","last_unstale":"2024-09-19T09:24:26.205229+0000","last_undegraded":"2024-09-19T09:24:26.205229+0000","last_fullsized":"2024-09-19T09:24:26.205229+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:57.870165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.191847+0000","last_change":"2024-09-19T09:24:26.191377+0000","last_active":"2024-09-19T09:24:26.191847+0000","last_peered":"2024-09-19T09:24:26.191847+0000","last_clean":"2024-09-19T09:24:26.191847+0000","last_became_active":"2024-09-19T09:24:26.190327+0000","last_became_peered":"2024-09-19T09:24:26.190327+0000","last_unstale":"2024-09-19T09:24:26.191847+0000","last_undegraded":"2024-09-19T09:24:26.191847+0000","last_fullsized":"2024-09-19T09:24:26.191847+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:28.755808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.e","version":"181'2","reported_seq":14,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.203255+0000","last_change":"2024-09-19T09:24:25.176663+0000","last_active":"2024-09-19T09:24:26.203255+0000","last_peered":"2024-09-19T09:24:26.203255+0000","last_clean":"2024-09-19T09:24:26.203255+0000","last_became_active":"2024-09-19T09:24:25.176385+0000","last_became_peered":"2024-09-19T09:24:25.176385+0000","last_unstale":"2024-09-19T09:24:26.203255+0000","last_undegraded":"2024-09-19T09:24:26.203255+0000","last_fullsized":"2024-09-19T09:24:26.203255+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:18:39.926914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.189016+0000","last_change":"2024-09-19T09:24:26.184717+0000","last_active":"2024-09-19T09:24:26.189016+0000","last_peered":"2024-09-19T09:24:26.189016+0000","last_clean":"2024-09-19T09:24:26.189016+0000","last_became_active":"2024-09-19T09:24:26.184473+0000","last_became_peered":"2024-09-19T09:24:26.184473+0000","last_unstale":"2024-09-19T09:24:26.189016+0000","last_undegraded":"2024-09-19T09:24:26.189016+0000","last_fullsized":"2024-09-19T09:24:26.189016+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:10:58.934178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.d","version":"181'1","reported_seq":13,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.204346+0000","last_change":"2024-09-19T09:24:25.178305+0000","last_active":"2024-09-19T09:24:26.204346+0000","last_peered":"2024-09-19T09:24:26.204346+0000","last_clean":"2024-09-19T09:24:26.204346+0000","last_became_active":"2024-09-19T09:24:25.178041+0000","last_became_peered":"2024-09-19T09:24:25.178041+0000","last_unstale":"2024-09-19T09:24:26.204346+0000","last_undegraded":"2024-09-19T09:24:26.204346+0000","last_fullsized":"2024-09-19T09:24:26.204346+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:23.565257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.186859+0000","last_change":"2024-09-19T09:24:26.186083+0000","last_active":"2024-09-19T09:24:26.186859+0000","last_peered":"2024-09-19T09:24:26.186859+0000","last_clean":"2024-09-19T09:24:26.186859+0000","last_became_active":"2024-09-19T09:24:26.185846+0000","last_became_peered":"2024-09-19T09:24:26.185846+0000","last_unstale":"2024-09-19T09:24:26.186859+0000","last_undegraded":"2024-09-19T09:24:26.186859+0000","last_fullsized":"2024-09-19T09:24:26.186859+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:26:47.958234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.183924+0000","last_change":"2024-09-19T09:24:25.168988+0000","last_active":"2024-09-19T09:24:26.183924+0000","last_peered":"2024-09-19T09:24:26.183924+0000","last_clean":"2024-09-19T09:24:26.183924+0000","last_became_active":"2024-09-19T09:24:25.168711+0000","last_became_peered":"2024-09-19T09:24:25.168711+0000","last_unstale":"2024-09-19T09:24:26.183924+0000","last_undegraded":"2024-09-19T09:24:26.183924+0000","last_fullsized":"2024-09-19T09:24:26.183924+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:32.223889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.194202+0000","last_change":"2024-09-19T09:24:26.194049+0000","last_active":"2024-09-19T09:24:26.194202+0000","last_peered":"2024-09-19T09:24:26.194202+0000","last_clean":"2024-09-19T09:24:26.194202+0000","last_became_active":"2024-09-19T09:24:26.193448+0000","last_became_peered":"2024-09-19T09:24:26.193448+0000","last_unstale":"2024-09-19T09:24:26.194202+0000","last_undegraded":"2024-09-19T09:24:26.194202+0000","last_fullsized":"2024-09-19T09:24:26.194202+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:49:05.429207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.b","version":"181'2","reported_seq":14,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.202374+0000","last_change":"2024-09-19T09:24:25.169964+0000","last_active":"2024-09-19T09:24:26.202374+0000","last_peered":"2024-09-19T09:24:26.202374+0000","last_clean":"2024-09-19T09:24:26.202374+0000","last_became_active":"2024-09-19T09:24:25.169600+0000","last_became_peered":"2024-09-19T09:24:25.169600+0000","last_unstale":"2024-09-19T09:24:26.202374+0000","last_undegraded":"2024-09-19T09:24:26.202374+0000","last_fullsized":"2024-09-19T09:24:26.202374+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:40.986827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.192189+0000","last_change":"2024-09-19T09:24:26.192030+0000","last_active":"2024-09-19T09:24:26.192189+0000","last_peered":"2024-09-19T09:24:26.192189+0000","last_clean":"2024-09-19T09:24:26.192189+0000","last_became_active":"2024-09-19T09:24:26.191824+0000","last_became_peered":"2024-09-19T09:24:26.191824+0000","last_unstale":"2024-09-19T09:24:26.192189+0000","last_undegraded":"2024-09-19T09:24:26.192189+0000","last_fullsized":"2024-09-19T09:24:26.192189+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:18.831810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.183094+0000","last_change":"2024-09-19T09:24:25.170877+0000","last_active":"2024-09-19T09:24:26.183094+0000","last_peered":"2024-09-19T09:24:26.183094+0000","last_clean":"2024-09-19T09:24:26.183094+0000","last_became_active":"2024-09-19T09:24:25.170626+0000","last_became_peered":"2024-09-19T09:24:25.170626+0000","last_unstale":"2024-09-19T09:24:26.183094+0000","last_undegraded":"2024-09-19T09:24:26.183094+0000","last_fullsized":"2024-09-19T09:24:26.183094+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:39.370540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.188000+0000","last_change":"2024-09-19T09:24:26.187275+0000","last_active":"2024-09-19T09:24:26.188000+0000","last_peered":"2024-09-19T09:24:26.188000+0000","last_clean":"2024-09-19T09:24:26.188000+0000","last_became_active":"2024-09-19T09:24:26.187035+0000","last_became_peered":"2024-09-19T09:24:26.187035+0000","last_unstale":"2024-09-19T09:24:26.188000+0000","last_undegraded":"2024-09-19T09:24:26.188000+0000","last_fullsized":"2024-09-19T09:24:26.188000+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:49.891088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.180421+0000","last_change":"2024-09-19T09:24:25.172994+0000","last_active":"2024-09-19T09:24:26.180421+0000","last_peered":"2024-09-19T09:24:26.180421+0000","last_clean":"2024-09-19T09:24:26.180421+0000","last_became_active":"2024-09-19T09:24:25.172736+0000","last_became_peered":"2024-09-19T09:24:25.172736+0000","last_unstale":"2024-09-19T09:24:26.180421+0000","last_undegraded":"2024-09-19T09:24:26.180421+0000","last_fullsized":"2024-09-19T09:24:26.180421+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:37:27.728600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.193066+0000","last_change":"2024-09-19T09:24:26.191782+0000","last_active":"2024-09-19T09:24:26.193066+0000","last_peered":"2024-09-19T09:24:26.193066+0000","last_clean":"2024-09-19T09:24:26.193066+0000","last_became_active":"2024-09-19T09:24:26.191234+0000","last_became_peered":"2024-09-19T09:24:26.191234+0000","last_unstale":"2024-09-19T09:24:26.193066+0000","last_undegraded":"2024-09-19T09:24:26.193066+0000","last_fullsized":"2024-09-19T09:24:26.193066+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:58.257267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.184193+0000","last_change":"2024-09-19T09:24:25.177016+0000","last_active":"2024-09-19T09:24:26.184193+0000","last_peered":"2024-09-19T09:24:26.184193+0000","last_clean":"2024-09-19T09:24:26.184193+0000","last_became_active":"2024-09-19T09:24:25.176659+0000","last_became_peered":"2024-09-19T09:24:25.176659+0000","last_unstale":"2024-09-19T09:24:26.184193+0000","last_undegraded":"2024-09-19T09:24:26.184193+0000","last_fullsized":"2024-09-19T09:24:26.184193+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:09.829274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.188771+0000","last_change":"2024-09-19T09:24:26.188646+0000","last_active":"2024-09-19T09:24:26.188771+0000","last_peered":"2024-09-19T09:24:26.188771+0000","last_clean":"2024-09-19T09:24:26.188771+0000","last_became_active":"2024-09-19T09:24:26.188209+0000","last_became_peered":"2024-09-19T09:24:26.188209+0000","last_unstale":"2024-09-19T09:24:26.188771+0000","last_undegraded":"2024-09-19T09:24:26.188771+0000","last_fullsized":"2024-09-19T09:24:26.188771+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:44.235752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.7","version":"181'2","reported_seq":14,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.200842+0000","last_change":"2024-09-19T09:24:25.175849+0000","last_active":"2024-09-19T09:24:26.200842+0000","last_peered":"2024-09-19T09:24:26.200842+0000","last_clean":"2024-09-19T09:24:26.200842+0000","last_became_active":"2024-09-19T09:24:25.175591+0000","last_became_peered":"2024-09-19T09:24:25.175591+0000","last_unstale":"2024-09-19T09:24:26.200842+0000","last_undegraded":"2024-09-19T09:24:26.200842+0000","last_fullsized":"2024-09-19T09:24:26.200842+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:20:21.969567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.190501+0000","last_change":"2024-09-19T09:24:26.189248+0000","last_active":"2024-09-19T09:24:26.190501+0000","last_peered":"2024-09-19T09:24:26.190501+0000","last_clean":"2024-09-19T09:24:26.190501+0000","last_became_active":"2024-09-19T09:24:26.188976+0000","last_became_peered":"2024-09-19T09:24:26.188976+0000","last_unstale":"2024-09-19T09:24:26.190501+0000","last_undegraded":"2024-09-19T09:24:26.190501+0000","last_fullsized":"2024-09-19T09:24:26.190501+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:35.337228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.183380+0000","last_change":"2024-09-19T09:24:25.175663+0000","last_active":"2024-09-19T09:24:26.183380+0000","last_peered":"2024-09-19T09:24:26.183380+0000","last_clean":"2024-09-19T09:24:26.183380+0000","last_became_active":"2024-09-19T09:24:25.175359+0000","last_became_peered":"2024-09-19T09:24:25.175359+0000","last_unstale":"2024-09-19T09:24:26.183380+0000","last_undegraded":"2024-09-19T09:24:26.183380+0000","last_fullsized":"2024-09-19T09:24:26.183380+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:21.443273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.189199+0000","last_change":"2024-09-19T09:24:26.187935+0000","last_active":"2024-09-19T09:24:26.189199+0000","last_peered":"2024-09-19T09:24:26.189199+0000","last_clean":"2024-09-19T09:24:26.189199+0000","last_became_active":"2024-09-19T09:24:26.187705+0000","last_became_peered":"2024-09-19T09:24:26.187705+0000","last_unstale":"2024-09-19T09:24:26.189199+0000","last_undegraded":"2024-09-19T09:24:26.189199+0000","last_fullsized":"2024-09-19T09:24:26.189199+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:22:43.922487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.185082+0000","last_change":"2024-09-19T09:24:25.170441+0000","last_active":"2024-09-19T09:24:26.185082+0000","last_peered":"2024-09-19T09:24:26.185082+0000","last_clean":"2024-09-19T09:24:26.185082+0000","last_became_active":"2024-09-19T09:24:25.170176+0000","last_became_peered":"2024-09-19T09:24:25.170176+0000","last_unstale":"2024-09-19T09:24:26.185082+0000","last_undegraded":"2024-09-19T09:24:26.185082+0000","last_fullsized":"2024-09-19T09:24:26.185082+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:19.465441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.191868+0000","last_change":"2024-09-19T09:24:26.191634+0000","last_active":"2024-09-19T09:24:26.191868+0000","last_peered":"2024-09-19T09:24:26.191868+0000","last_clean":"2024-09-19T09:24:26.191868+0000","last_became_active":"2024-09-19T09:24:26.191144+0000","last_became_peered":"2024-09-19T09:24:26.191144+0000","last_unstale":"2024-09-19T09:24:26.191868+0000","last_undegraded":"2024-09-19T09:24:26.191868+0000","last_fullsized":"2024-09-19T09:24:26.191868+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:26.389958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.180981+0000","last_change":"2024-09-19T09:24:25.170308+0000","last_active":"2024-09-19T09:24:26.180981+0000","last_peered":"2024-09-19T09:24:26.180981+0000","last_clean":"2024-09-19T09:24:26.180981+0000","last_became_active":"2024-09-19T09:24:25.170048+0000","last_became_peered":"2024-09-19T09:24:25.170048+0000","last_unstale":"2024-09-19T09:24:26.180981+0000","last_undegraded":"2024-09-19T09:24:26.180981+0000","last_fullsized":"2024-09-19T09:24:26.180981+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:20.121579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.192720+0000","last_change":"2024-09-19T09:24:26.192455+0000","last_active":"2024-09-19T09:24:26.192720+0000","last_peered":"2024-09-19T09:24:26.192720+0000","last_clean":"2024-09-19T09:24:26.192720+0000","last_became_active":"2024-09-19T09:24:26.191445+0000","last_became_peered":"2024-09-19T09:24:26.191445+0000","last_unstale":"2024-09-19T09:24:26.192720+0000","last_undegraded":"2024-09-19T09:24:26.192720+0000","last_fullsized":"2024-09-19T09:24:26.192720+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:14.630802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.185307+0000","last_change":"2024-09-19T09:24:25.170239+0000","last_active":"2024-09-19T09:24:26.185307+0000","last_peered":"2024-09-19T09:24:26.185307+0000","last_clean":"2024-09-19T09:24:26.185307+0000","last_became_active":"2024-09-19T09:24:25.169912+0000","last_became_peered":"2024-09-19T09:24:25.169912+0000","last_unstale":"2024-09-19T09:24:26.185307+0000","last_undegraded":"2024-09-19T09:24:26.185307+0000","last_fullsized":"2024-09-19T09:24:26.185307+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:52.056925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.188021+0000","last_change":"2024-09-19T09:24:26.187863+0000","last_active":"2024-09-19T09:24:26.188021+0000","last_peered":"2024-09-19T09:24:26.188021+0000","last_clean":"2024-09-19T09:24:26.188021+0000","last_became_active":"2024-09-19T09:24:26.187605+0000","last_became_peered":"2024-09-19T09:24:26.187605+0000","last_unstale":"2024-09-19T09:24:26.188021+0000","last_undegraded":"2024-09-19T09:24:26.188021+0000","last_fullsized":"2024-09-19T09:24:26.188021+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:40.653498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.184341+0000","last_change":"2024-09-19T09:24:25.178249+0000","last_active":"2024-09-19T09:24:26.184341+0000","last_peered":"2024-09-19T09:24:26.184341+0000","last_clean":"2024-09-19T09:24:26.184341+0000","last_became_active":"2024-09-19T09:24:25.177997+0000","last_became_peered":"2024-09-19T09:24:25.177997+0000","last_unstale":"2024-09-19T09:24:26.184341+0000","last_undegraded":"2024-09-19T09:24:26.184341+0000","last_fullsized":"2024-09-19T09:24:26.184341+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:40.860622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.194764+0000","last_change":"2024-09-19T09:24:26.194646+0000","last_active":"2024-09-19T09:24:26.194764+0000","last_peered":"2024-09-19T09:24:26.194764+0000","last_clean":"2024-09-19T09:24:26.194764+0000","last_became_active":"2024-09-19T09:24:26.194383+0000","last_became_peered":"2024-09-19T09:24:26.194383+0000","last_unstale":"2024-09-19T09:24:26.194764+0000","last_undegraded":"2024-09-19T09:24:26.194764+0000","last_fullsized":"2024-09-19T09:24:26.194764+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:15.278564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.185690+0000","last_change":"2024-09-19T09:24:25.173932+0000","last_active":"2024-09-19T09:24:26.185690+0000","last_peered":"2024-09-19T09:24:26.185690+0000","last_clean":"2024-09-19T09:24:26.185690+0000","last_became_active":"2024-09-19T09:24:25.173236+0000","last_became_peered":"2024-09-19T09:24:25.173236+0000","last_unstale":"2024-09-19T09:24:26.185690+0000","last_undegraded":"2024-09-19T09:24:26.185690+0000","last_fullsized":"2024-09-19T09:24:26.185690+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:23.460908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.189546+0000","last_change":"2024-09-19T09:24:26.189428+0000","last_active":"2024-09-19T09:24:26.189546+0000","last_peered":"2024-09-19T09:24:26.189546+0000","last_clean":"2024-09-19T09:24:26.189546+0000","last_became_active":"2024-09-19T09:24:26.189148+0000","last_became_peered":"2024-09-19T09:24:26.189148+0000","last_unstale":"2024-09-19T09:24:26.189546+0000","last_undegraded":"2024-09-19T09:24:26.189546+0000","last_fullsized":"2024-09-19T09:24:26.189546+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:06.004525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.185332+0000","last_change":"2024-09-19T09:24:25.169885+0000","last_active":"2024-09-19T09:24:26.185332+0000","last_peered":"2024-09-19T09:24:26.185332+0000","last_clean":"2024-09-19T09:24:26.185332+0000","last_became_active":"2024-09-19T09:24:25.169576+0000","last_became_peered":"2024-09-19T09:24:25.169576+0000","last_unstale":"2024-09-19T09:24:26.185332+0000","last_undegraded":"2024-09-19T09:24:26.185332+0000","last_fullsized":"2024-09-19T09:24:26.185332+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:07.526456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.193047+0000","last_change":"2024-09-19T09:24:26.191082+0000","last_active":"2024-09-19T09:24:26.193047+0000","last_peered":"2024-09-19T09:24:26.193047+0000","last_clean":"2024-09-19T09:24:26.193047+0000","last_became_active":"2024-09-19T09:24:26.190765+0000","last_became_peered":"2024-09-19T09:24:26.190765+0000","last_unstale":"2024-09-19T09:24:26.193047+0000","last_undegraded":"2024-09-19T09:24:26.193047+0000","last_fullsized":"2024-09-19T09:24:26.193047+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:58.477467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.183868+0000","last_change":"2024-09-19T09:24:25.174924+0000","last_active":"2024-09-19T09:24:26.183868+0000","last_peered":"2024-09-19T09:24:26.183868+0000","last_clean":"2024-09-19T09:24:26.183868+0000","last_became_active":"2024-09-19T09:24:25.174670+0000","last_became_peered":"2024-09-19T09:24:25.174670+0000","last_unstale":"2024-09-19T09:24:26.183868+0000","last_undegraded":"2024-09-19T09:24:26.183868+0000","last_fullsized":"2024-09-19T09:24:26.183868+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:57.347590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":484,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.189672+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:24:26.189672+0000","last_peered":"2024-09-19T09:24:26.189672+0000","last_clean":"2024-09-19T09:24:26.189672+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:24:26.189672+0000","last_undegraded":"2024-09-19T09:24:26.189672+0000","last_fullsized":"2024-09-19T09:24:26.189672+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:28.823470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574984,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":992,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194320,"statfs":{"total":200000000,"available":198983754,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574984,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":985,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194326,"statfs":{"total":200000000,"available":198990529,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574984,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1569,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193742,"statfs":{"total":200000000,"available":198392714,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574984,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":985,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194326,"statfs":{"total":200000000,"available":198990529,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574984,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":985,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194326,"statfs":{"total":200000000,"available":198990529,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574984,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":985,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194326,"statfs":{"total":200000000,"available":198990529,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574984,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1562,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193750,"statfs":{"total":200000000,"available":198400161,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574984,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":985,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194326,"statfs":{"total":200000000,"available":198990529,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:24:29.258 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:24:29.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.395+0000 7fa578518640 1 Processor -- start 2024-09-19T09:24:29.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.395+0000 7fa578518640 1 -- start start 2024-09-19T09:24:29.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.396+0000 7fa578518640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa5700cfae0 0x7fa5700b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:29.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.396+0000 7fa578518640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa57006d730 0x7fa5700cdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:29.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.396+0000 7fa578518640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5700cd1a0 con 0x7fa57015ef80 2024-09-19T09:24:29.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.396+0000 7fa578518640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa5700cd7d0 con 0x7fa5700cfae0 2024-09-19T09:24:29.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.396+0000 7fa578518640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa57006dc30 con 0x7fa57006d730 2024-09-19T09:24:29.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.396+0000 7fa5762b4640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa57015ef80 0x7fa5700cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44720/0 (socket says 172.21.15.18:44720) 2024-09-19T09:24:29.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.396+0000 7fa5762b4640 1 -- 172.21.15.18:0/1615413712 learned_addr learned my addr 172.21.15.18:0/1615413712 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:24:29.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.396+0000 7fa576ab5640 1 --2- 172.21.15.18:0/1615413712 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa57006d730 0x7fa5700cdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:29.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.396+0000 7fa5752b2640 1 -- 172.21.15.18:0/1615413712 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3172134638 0 0) 0x7fa5700cd1a0 con 0x7fa57015ef80 2024-09-19T09:24:29.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.396+0000 7fa575ab3640 1 --2- 172.21.15.18:0/1615413712 >> v2:172.21.15.162:3300/0 conn(0x7fa5700cfae0 0x7fa5700b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:29.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.397+0000 7fa5752b2640 1 -- 172.21.15.18:0/1615413712 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa55c003520 con 0x7fa57015ef80 2024-09-19T09:24:29.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.397+0000 7fa5752b2640 1 -- 172.21.15.18:0/1615413712 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1533669816 0 0) 0x7fa55c003520 con 0x7fa57015ef80 2024-09-19T09:24:29.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.397+0000 7fa5752b2640 1 -- 172.21.15.18:0/1615413712 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa57006d730 msgr2=0x7fa5700cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:29.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.397+0000 7fa5752b2640 1 --2- 172.21.15.18:0/1615413712 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa57006d730 0x7fa5700cdc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:29.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.397+0000 7fa5752b2640 1 -- 172.21.15.18:0/1615413712 >> v2:172.21.15.162:3300/0 conn(0x7fa5700cfae0 msgr2=0x7fa5700b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:29.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.397+0000 7fa5752b2640 1 --2- 172.21.15.18:0/1615413712 >> v2:172.21.15.162:3300/0 conn(0x7fa5700cfae0 0x7fa5700b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:29.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.397+0000 7fa5752b2640 1 -- 172.21.15.18:0/1615413712 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa57006df10 con 0x7fa57015ef80 2024-09-19T09:24:29.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.397+0000 7fa5752b2640 1 -- 172.21.15.18:0/1615413712 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fa56c001670 con 0x7fa57015ef80 2024-09-19T09:24:29.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.397+0000 7fa5752b2640 1 -- 172.21.15.18:0/1615413712 >> v1:172.21.15.18:6789/0 conn(0x7fa57015ef80 legacy=0x7fa5700cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:29.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.397+0000 7fa5752b2640 1 --2- 172.21.15.18:0/1615413712 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa57006d730 0x7fa55c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:29.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.397+0000 7fa5752b2640 1 --2- 172.21.15.18:0/1615413712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa55c003f30 0x7fa55c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:29.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.397+0000 7fa5752b2640 1 --2- 172.21.15.18:0/1615413712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa55c004d40 0x7fa55c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:29.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.397+0000 7fa5752b2640 1 -- 172.21.15.18:0/1615413712 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa5700cd7d0 con 0x7fa55c004d40 2024-09-19T09:24:29.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.397+0000 7fa5752b2640 1 -- 172.21.15.18:0/1615413712 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa57006dc30 con 0x7fa55c003f30 2024-09-19T09:24:29.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.397+0000 7fa5752b2640 1 -- 172.21.15.18:0/1615413712 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa55c00b9c0 con 0x7fa57006d730 2024-09-19T09:24:29.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.397+0000 7fa576ab5640 1 --2- 172.21.15.18:0/1615413712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa55c004d40 0x7fa55c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:29.400 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.397+0000 7fa5762b4640 1 --2- 172.21.15.18:0/1615413712 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa57006d730 0x7fa55c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:29.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.397+0000 7fa575ab3640 1 --2- 172.21.15.18:0/1615413712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa55c003f30 0x7fa55c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:29.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.397+0000 7fa576ab5640 1 -- 172.21.15.18:0/1615413712 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa57006d730 msgr2=0x7fa55c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:29.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.397+0000 7fa576ab5640 1 --2- 172.21.15.18:0/1615413712 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa57006d730 0x7fa55c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:29.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.397+0000 7fa576ab5640 1 -- 172.21.15.18:0/1615413712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa55c003f30 msgr2=0x7fa55c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:29.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.397+0000 7fa576ab5640 1 --2- 172.21.15.18:0/1615413712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa55c003f30 0x7fa55c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:29.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.397+0000 7fa576ab5640 1 -- 172.21.15.18:0/1615413712 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55c003520 con 0x7fa55c004d40 2024-09-19T09:24:29.401 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.397+0000 7fa575ab3640 1 --2- 172.21.15.18:0/1615413712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa55c003f30 0x7fa55c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:29.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.398+0000 7fa576ab5640 1 --2- 172.21.15.18:0/1615413712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa55c004d40 0x7fa55c0051c0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fa568009f90 tx=0x7fa55c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fad5fe1002e8e3e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:29.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.398+0000 7fa5752b2640 1 -- 172.21.15.18:0/1615413712 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa568009c10 con 0x7fa55c004d40 2024-09-19T09:24:29.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.398+0000 7fa5752b2640 1 -- 172.21.15.18:0/1615413712 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa568036070 con 0x7fa55c004d40 2024-09-19T09:24:29.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.398+0000 7fa5752b2640 1 -- 172.21.15.18:0/1615413712 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa568031670 con 0x7fa55c004d40 2024-09-19T09:24:29.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.399+0000 7fa578518640 1 -- 172.21.15.18:0/1615413712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa55c004d40 msgr2=0x7fa55c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:29.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.399+0000 7fa578518640 1 --2- 172.21.15.18:0/1615413712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa55c004d40 0x7fa55c0051c0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fa568009f90 tx=0x7fa55c005830 comp rx=0 tx=0).stop 2024-09-19T09:24:29.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.399+0000 7fa576ab5640 1 -- 172.21.15.18:0/1615413712 reap_dead start 2024-09-19T09:24:29.404 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.399+0000 7fa578518640 1 -- 172.21.15.18:0/1615413712 shutdown_connections 2024-09-19T09:24:29.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.399+0000 7fa578518640 1 -- 172.21.15.18:0/1615413712 >> 172.21.15.18:0/1615413712 conn(0x7fa5700b4700 msgr2=0x7fa5700b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:29.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.399+0000 7fa578518640 1 -- 172.21.15.18:0/1615413712 shutdown_connections 2024-09-19T09:24:29.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.399+0000 7fa578518640 1 -- 172.21.15.18:0/1615413712 wait complete. 2024-09-19T09:24:29.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.400+0000 7fa578518640 1 Processor -- start 2024-09-19T09:24:29.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.400+0000 7fa578518640 1 -- start start 2024-09-19T09:24:29.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.401+0000 7fa578518640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa55c004d40 0x7fa570158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:29.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.401+0000 7fa578518640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5700c6c00 0x7fa5700c7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:29.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.401+0000 7fa578518640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5701f4d30 0x7fa5701f51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:29.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.401+0000 7fa578518640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa5700d0120 con 0x7fa5701f4d30 2024-09-19T09:24:29.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.401+0000 7fa578518640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa57015f360 con 0x7fa55c004d40 2024-09-19T09:24:29.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.401+0000 7fa578518640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa5700cdc60 con 0x7fa5700c6c00 2024-09-19T09:24:29.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.401+0000 7fa576ab5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5701f4d30 0x7fa5701f51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:29.405 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.401+0000 7fa576ab5640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5701f4d30 0x7fa5701f51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52962/0 (socket says 172.21.15.18:52962) 2024-09-19T09:24:29.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.401+0000 7fa576ab5640 1 -- 172.21.15.18:0/96201596 learned_addr learned my addr 172.21.15.18:0/96201596 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:29.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.401+0000 7fa575ab3640 1 --2- 172.21.15.18:0/96201596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5700c6c00 0x7fa5700c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:29.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.401+0000 7fa5762b4640 1 --2- 172.21.15.18:0/96201596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa55c004d40 0x7fa570158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:29.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.401+0000 7fa576ab5640 1 -- 172.21.15.18:0/96201596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5700c6c00 msgr2=0x7fa5700c7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:29.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.401+0000 7fa576ab5640 1 --2- 172.21.15.18:0/96201596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5700c6c00 0x7fa5700c7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:29.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.401+0000 7fa576ab5640 1 -- 172.21.15.18:0/96201596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa55c004d40 msgr2=0x7fa570158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:29.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.401+0000 7fa576ab5640 1 --2- 172.21.15.18:0/96201596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa55c004d40 0x7fa570158020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:29.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.401+0000 7fa576ab5640 1 -- 172.21.15.18:0/96201596 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5701f56f0 con 0x7fa5701f4d30 2024-09-19T09:24:29.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.401+0000 7fa575ab3640 1 --2- 172.21.15.18:0/96201596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5700c6c00 0x7fa5700c7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:29.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.401+0000 7fa5762b4640 1 --2- 172.21.15.18:0/96201596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa55c004d40 0x7fa570158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:29.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.401+0000 7fa576ab5640 1 --2- 172.21.15.18:0/96201596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5701f4d30 0x7fa5701f51b0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fa568033040 tx=0x7fa568009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:29.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.402+0000 7fa566ffd640 1 -- 172.21.15.18:0/96201596 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa568009c10 con 0x7fa5701f4d30 2024-09-19T09:24:29.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.402+0000 7fa566ffd640 1 -- 172.21.15.18:0/96201596 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa568031dd0 con 0x7fa5701f4d30 2024-09-19T09:24:29.406 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.402+0000 7fa578518640 1 -- 172.21.15.18:0/96201596 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5700c77c0 con 0x7fa5701f4d30 2024-09-19T09:24:29.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.402+0000 7fa566ffd640 1 -- 172.21.15.18:0/96201596 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa568003bd0 con 0x7fa5701f4d30 2024-09-19T09:24:29.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.402+0000 7fa578518640 1 -- 172.21.15.18:0/96201596 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5700c7d80 con 0x7fa5701f4d30 2024-09-19T09:24:29.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.403+0000 7fa578518640 1 -- 172.21.15.18:0/96201596 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5700d1e00 con 0x7fa5701f4d30 2024-09-19T09:24:29.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.403+0000 7fa566ffd640 1 -- 172.21.15.18:0/96201596 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa568005d10 con 0x7fa5701f4d30 2024-09-19T09:24:29.407 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.404+0000 7fa566ffd640 1 --2- 172.21.15.18:0/96201596 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa55406c2e0 0x7fa55406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:29.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.404+0000 7fa566ffd640 1 -- 172.21.15.18:0/96201596 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7fa5680ac780 con 0x7fa5701f4d30 2024-09-19T09:24:29.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.404+0000 7fa5762b4640 1 --2- 172.21.15.18:0/96201596 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa55406c2e0 0x7fa55406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:29.408 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.404+0000 7fa5762b4640 1 --2- 172.21.15.18:0/96201596 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa55406c2e0 0x7fa55406e7a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fa56c007db0 tx=0x7fa56c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:29.409 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.408+0000 7fa566ffd640 1 -- 172.21.15.18:0/96201596 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa5700d1e00 con 0x7fa5701f4d30 2024-09-19T09:24:29.581 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.580+0000 7fa578518640 1 -- 172.21.15.18:0/96201596 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa5701f5bf0 con 0x7fa55406c2e0 2024-09-19T09:24:29.587 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.587+0000 7fa566ffd640 1 -- 172.21.15.18:0/96201596 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247919 (secure 0 0 0) 0x7fa56c007de0 con 0x7fa55406c2e0 2024-09-19T09:24:29.590 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:24:29.591 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:24:29.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.590+0000 7fa578518640 1 -- 172.21.15.18:0/96201596 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa55406c2e0 msgr2=0x7fa55406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:29.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.590+0000 7fa578518640 1 --2- 172.21.15.18:0/96201596 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa55406c2e0 0x7fa55406e7a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fa56c007db0 tx=0x7fa56c009040 comp rx=0 tx=0).stop 2024-09-19T09:24:29.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.590+0000 7fa578518640 1 -- 172.21.15.18:0/96201596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5701f4d30 msgr2=0x7fa5701f51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:29.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.590+0000 7fa578518640 1 --2- 172.21.15.18:0/96201596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5701f4d30 0x7fa5701f51b0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fa568033040 tx=0x7fa568009750 comp rx=0 tx=0).stop 2024-09-19T09:24:29.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.590+0000 7fa578518640 1 -- 172.21.15.18:0/96201596 shutdown_connections 2024-09-19T09:24:29.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.590+0000 7fa578518640 1 --2- 172.21.15.18:0/96201596 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa55406c2e0 0x7fa55406e7a0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:29.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.590+0000 7fa578518640 1 --2- 172.21.15.18:0/96201596 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa5701f4d30 0x7fa5701f51b0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:29.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.590+0000 7fa578518640 1 --2- 172.21.15.18:0/96201596 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa5700c6c00 0x7fa5700c7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:29.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.590+0000 7fa578518640 1 --2- 172.21.15.18:0/96201596 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa55c004d40 0x7fa570158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:29.593 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.590+0000 7fa578518640 1 -- 172.21.15.18:0/96201596 >> 172.21.15.18:0/96201596 conn(0x7fa5700b4700 msgr2=0x7fa57015bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:29.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.590+0000 7fa578518640 1 -- 172.21.15.18:0/96201596 shutdown_connections 2024-09-19T09:24:29.594 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.590+0000 7fa578518640 1 -- 172.21.15.18:0/96201596 wait complete. 2024-09-19T09:24:29.601 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":509,"stamp":"2024-09-19T09:24:27.686303+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9053,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553446,"statfs":{"total":1600000000,"available":1590729274,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001011"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.194707+0000","last_change":"2024-09-19T09:24:26.194588+0000","last_active":"2024-09-19T09:24:26.194707+0000","last_peered":"2024-09-19T09:24:26.194707+0000","last_clean":"2024-09-19T09:24:26.194707+0000","last_became_active":"2024-09-19T09:24:26.194365+0000","last_became_peered":"2024-09-19T09:24:26.194365+0000","last_unstale":"2024-09-19T09:24:26.194707+0000","last_undegraded":"2024-09-19T09:24:26.194707+0000","last_fullsized":"2024-09-19T09:24:26.194707+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:19.331152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.193910+0000","last_change":"2024-09-19T09:24:26.193789+0000","last_active":"2024-09-19T09:24:26.193910+0000","last_peered":"2024-09-19T09:24:26.193910+0000","last_clean":"2024-09-19T09:24:26.193910+0000","last_became_active":"2024-09-19T09:24:26.193551+0000","last_became_peered":"2024-09-19T09:24:26.193551+0000","last_unstale":"2024-09-19T09:24:26.193910+0000","last_undegraded":"2024-09-19T09:24:26.193910+0000","last_fullsized":"2024-09-19T09:24:26.193910+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:04.943812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.196468+0000","last_change":"2024-09-19T09:24:26.196270+0000","last_active":"2024-09-19T09:24:26.196468+0000","last_peered":"2024-09-19T09:24:26.196468+0000","last_clean":"2024-09-19T09:24:26.196468+0000","last_became_active":"2024-09-19T09:24:26.192846+0000","last_became_peered":"2024-09-19T09:24:26.192846+0000","last_unstale":"2024-09-19T09:24:26.196468+0000","last_undegraded":"2024-09-19T09:24:26.196468+0000","last_fullsized":"2024-09-19T09:24:26.196468+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:51.541796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.189055+0000","last_change":"2024-09-19T09:24:26.185597+0000","last_active":"2024-09-19T09:24:26.189055+0000","last_peered":"2024-09-19T09:24:26.189055+0000","last_clean":"2024-09-19T09:24:26.189055+0000","last_became_active":"2024-09-19T09:24:26.184878+0000","last_became_peered":"2024-09-19T09:24:26.184878+0000","last_unstale":"2024-09-19T09:24:26.189055+0000","last_undegraded":"2024-09-19T09:24:26.189055+0000","last_fullsized":"2024-09-19T09:24:26.189055+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:44.571707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.197787+0000","last_change":"2024-09-19T09:24:26.197642+0000","last_active":"2024-09-19T09:24:26.197787+0000","last_peered":"2024-09-19T09:24:26.197787+0000","last_clean":"2024-09-19T09:24:26.197787+0000","last_became_active":"2024-09-19T09:24:26.197210+0000","last_became_peered":"2024-09-19T09:24:26.197210+0000","last_unstale":"2024-09-19T09:24:26.197787+0000","last_undegraded":"2024-09-19T09:24:26.197787+0000","last_fullsized":"2024-09-19T09:24:26.197787+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:58:57.821498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.194035+0000","last_change":"2024-09-19T09:24:26.193929+0000","last_active":"2024-09-19T09:24:26.194035+0000","last_peered":"2024-09-19T09:24:26.194035+0000","last_clean":"2024-09-19T09:24:26.194035+0000","last_became_active":"2024-09-19T09:24:26.193637+0000","last_became_peered":"2024-09-19T09:24:26.193637+0000","last_unstale":"2024-09-19T09:24:26.194035+0000","last_undegraded":"2024-09-19T09:24:26.194035+0000","last_fullsized":"2024-09-19T09:24:26.194035+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:15.731311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.194745+0000","last_change":"2024-09-19T09:24:26.194637+0000","last_active":"2024-09-19T09:24:26.194745+0000","last_peered":"2024-09-19T09:24:26.194745+0000","last_clean":"2024-09-19T09:24:26.194745+0000","last_became_active":"2024-09-19T09:24:26.194323+0000","last_became_peered":"2024-09-19T09:24:26.194323+0000","last_unstale":"2024-09-19T09:24:26.194745+0000","last_undegraded":"2024-09-19T09:24:26.194745+0000","last_fullsized":"2024-09-19T09:24:26.194745+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:09.385629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.191995+0000","last_change":"2024-09-19T09:24:26.191845+0000","last_active":"2024-09-19T09:24:26.191995+0000","last_peered":"2024-09-19T09:24:26.191995+0000","last_clean":"2024-09-19T09:24:26.191995+0000","last_became_active":"2024-09-19T09:24:26.191617+0000","last_became_peered":"2024-09-19T09:24:26.191617+0000","last_unstale":"2024-09-19T09:24:26.191995+0000","last_undegraded":"2024-09-19T09:24:26.191995+0000","last_fullsized":"2024-09-19T09:24:26.191995+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:19:34.375951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.194900+0000","last_change":"2024-09-19T09:24:26.194775+0000","last_active":"2024-09-19T09:24:26.194900+0000","last_peered":"2024-09-19T09:24:26.194900+0000","last_clean":"2024-09-19T09:24:26.194900+0000","last_became_active":"2024-09-19T09:24:26.194444+0000","last_became_peered":"2024-09-19T09:24:26.194444+0000","last_unstale":"2024-09-19T09:24:26.194900+0000","last_undegraded":"2024-09-19T09:24:26.194900+0000","last_fullsized":"2024-09-19T09:24:26.194900+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:37.797647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.190716+0000","last_change":"2024-09-19T09:24:26.190597+0000","last_active":"2024-09-19T09:24:26.190716+0000","last_peered":"2024-09-19T09:24:26.190716+0000","last_clean":"2024-09-19T09:24:26.190716+0000","last_became_active":"2024-09-19T09:24:26.190306+0000","last_became_peered":"2024-09-19T09:24:26.190306+0000","last_unstale":"2024-09-19T09:24:26.190716+0000","last_undegraded":"2024-09-19T09:24:26.190716+0000","last_fullsized":"2024-09-19T09:24:26.190716+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:40.243064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.189253+0000","last_change":"2024-09-19T09:24:26.189099+0000","last_active":"2024-09-19T09:24:26.189253+0000","last_peered":"2024-09-19T09:24:26.189253+0000","last_clean":"2024-09-19T09:24:26.189253+0000","last_became_active":"2024-09-19T09:24:26.188813+0000","last_became_peered":"2024-09-19T09:24:26.188813+0000","last_unstale":"2024-09-19T09:24:26.189253+0000","last_undegraded":"2024-09-19T09:24:26.189253+0000","last_fullsized":"2024-09-19T09:24:26.189253+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:11.484526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.189884+0000","last_change":"2024-09-19T09:24:26.189734+0000","last_active":"2024-09-19T09:24:26.189884+0000","last_peered":"2024-09-19T09:24:26.189884+0000","last_clean":"2024-09-19T09:24:26.189884+0000","last_became_active":"2024-09-19T09:24:26.188205+0000","last_became_peered":"2024-09-19T09:24:26.188205+0000","last_unstale":"2024-09-19T09:24:26.189884+0000","last_undegraded":"2024-09-19T09:24:26.189884+0000","last_fullsized":"2024-09-19T09:24:26.189884+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:05.312162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.185299+0000","last_change":"2024-09-19T09:24:26.185190+0000","last_active":"2024-09-19T09:24:26.185299+0000","last_peered":"2024-09-19T09:24:26.185299+0000","last_clean":"2024-09-19T09:24:26.185299+0000","last_became_active":"2024-09-19T09:24:26.184938+0000","last_became_peered":"2024-09-19T09:24:26.184938+0000","last_unstale":"2024-09-19T09:24:26.185299+0000","last_undegraded":"2024-09-19T09:24:26.185299+0000","last_fullsized":"2024-09-19T09:24:26.185299+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:28.841141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.193988+0000","last_change":"2024-09-19T09:24:26.193864+0000","last_active":"2024-09-19T09:24:26.193988+0000","last_peered":"2024-09-19T09:24:26.193988+0000","last_clean":"2024-09-19T09:24:26.193988+0000","last_became_active":"2024-09-19T09:24:26.193600+0000","last_became_peered":"2024-09-19T09:24:26.193600+0000","last_unstale":"2024-09-19T09:24:26.193988+0000","last_undegraded":"2024-09-19T09:24:26.193988+0000","last_fullsized":"2024-09-19T09:24:26.193988+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:51.593028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.198749+0000","last_change":"2024-09-19T09:24:26.198170+0000","last_active":"2024-09-19T09:24:26.198749+0000","last_peered":"2024-09-19T09:24:26.198749+0000","last_clean":"2024-09-19T09:24:26.198749+0000","last_became_active":"2024-09-19T09:24:26.197941+0000","last_became_peered":"2024-09-19T09:24:26.197941+0000","last_unstale":"2024-09-19T09:24:26.198749+0000","last_undegraded":"2024-09-19T09:24:26.198749+0000","last_fullsized":"2024-09-19T09:24:26.198749+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:24:19.032283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.193955+0000","last_change":"2024-09-19T09:24:26.193435+0000","last_active":"2024-09-19T09:24:26.193955+0000","last_peered":"2024-09-19T09:24:26.193955+0000","last_clean":"2024-09-19T09:24:26.193955+0000","last_became_active":"2024-09-19T09:24:26.193167+0000","last_became_peered":"2024-09-19T09:24:26.193167+0000","last_unstale":"2024-09-19T09:24:26.193955+0000","last_undegraded":"2024-09-19T09:24:26.193955+0000","last_fullsized":"2024-09-19T09:24:26.193955+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:44.419781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.193890+0000","last_change":"2024-09-19T09:24:26.193698+0000","last_active":"2024-09-19T09:24:26.193890+0000","last_peered":"2024-09-19T09:24:26.193890+0000","last_clean":"2024-09-19T09:24:26.193890+0000","last_became_active":"2024-09-19T09:24:26.193476+0000","last_became_peered":"2024-09-19T09:24:26.193476+0000","last_unstale":"2024-09-19T09:24:26.193890+0000","last_undegraded":"2024-09-19T09:24:26.193890+0000","last_fullsized":"2024-09-19T09:24:26.193890+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:10.731046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.189325+0000","last_change":"2024-09-19T09:24:26.188866+0000","last_active":"2024-09-19T09:24:26.189325+0000","last_peered":"2024-09-19T09:24:26.189325+0000","last_clean":"2024-09-19T09:24:26.189325+0000","last_became_active":"2024-09-19T09:24:26.188599+0000","last_became_peered":"2024-09-19T09:24:26.188599+0000","last_unstale":"2024-09-19T09:24:26.189325+0000","last_undegraded":"2024-09-19T09:24:26.189325+0000","last_fullsized":"2024-09-19T09:24:26.189325+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:38:06.709657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.193026+0000","last_change":"2024-09-19T09:24:26.189832+0000","last_active":"2024-09-19T09:24:26.193026+0000","last_peered":"2024-09-19T09:24:26.193026+0000","last_clean":"2024-09-19T09:24:26.193026+0000","last_became_active":"2024-09-19T09:24:26.189575+0000","last_became_peered":"2024-09-19T09:24:26.189575+0000","last_unstale":"2024-09-19T09:24:26.193026+0000","last_undegraded":"2024-09-19T09:24:26.193026+0000","last_fullsized":"2024-09-19T09:24:26.193026+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:47.890590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.189851+0000","last_change":"2024-09-19T09:24:26.189336+0000","last_active":"2024-09-19T09:24:26.189851+0000","last_peered":"2024-09-19T09:24:26.189851+0000","last_clean":"2024-09-19T09:24:26.189851+0000","last_became_active":"2024-09-19T09:24:26.189099+0000","last_became_peered":"2024-09-19T09:24:26.189099+0000","last_unstale":"2024-09-19T09:24:26.189851+0000","last_undegraded":"2024-09-19T09:24:26.189851+0000","last_fullsized":"2024-09-19T09:24:26.189851+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:12:49.105275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.197569+0000","last_change":"2024-09-19T09:24:26.197448+0000","last_active":"2024-09-19T09:24:26.197569+0000","last_peered":"2024-09-19T09:24:26.197569+0000","last_clean":"2024-09-19T09:24:26.197569+0000","last_became_active":"2024-09-19T09:24:26.197213+0000","last_became_peered":"2024-09-19T09:24:26.197213+0000","last_unstale":"2024-09-19T09:24:26.197569+0000","last_undegraded":"2024-09-19T09:24:26.197569+0000","last_fullsized":"2024-09-19T09:24:26.197569+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:04:13.812914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.187780+0000","last_change":"2024-09-19T09:24:26.187649+0000","last_active":"2024-09-19T09:24:26.187780+0000","last_peered":"2024-09-19T09:24:26.187780+0000","last_clean":"2024-09-19T09:24:26.187780+0000","last_became_active":"2024-09-19T09:24:26.187416+0000","last_became_peered":"2024-09-19T09:24:26.187416+0000","last_unstale":"2024-09-19T09:24:26.187780+0000","last_undegraded":"2024-09-19T09:24:26.187780+0000","last_fullsized":"2024-09-19T09:24:26.187780+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:11.935991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.188753+0000","last_change":"2024-09-19T09:24:26.188423+0000","last_active":"2024-09-19T09:24:26.188753+0000","last_peered":"2024-09-19T09:24:26.188753+0000","last_clean":"2024-09-19T09:24:26.188753+0000","last_became_active":"2024-09-19T09:24:26.187734+0000","last_became_peered":"2024-09-19T09:24:26.187734+0000","last_unstale":"2024-09-19T09:24:26.188753+0000","last_undegraded":"2024-09-19T09:24:26.188753+0000","last_fullsized":"2024-09-19T09:24:26.188753+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:11:26.564986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.199117+0000","last_change":"2024-09-19T09:24:26.198922+0000","last_active":"2024-09-19T09:24:26.199117+0000","last_peered":"2024-09-19T09:24:26.199117+0000","last_clean":"2024-09-19T09:24:26.199117+0000","last_became_active":"2024-09-19T09:24:26.198182+0000","last_became_peered":"2024-09-19T09:24:26.198182+0000","last_unstale":"2024-09-19T09:24:26.199117+0000","last_undegraded":"2024-09-19T09:24:26.199117+0000","last_fullsized":"2024-09-19T09:24:26.199117+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:20.363044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.192073+0000","last_change":"2024-09-19T09:24:26.191954+0000","last_active":"2024-09-19T09:24:26.192073+0000","last_peered":"2024-09-19T09:24:26.192073+0000","last_clean":"2024-09-19T09:24:26.192073+0000","last_became_active":"2024-09-19T09:24:26.191718+0000","last_became_peered":"2024-09-19T09:24:26.191718+0000","last_unstale":"2024-09-19T09:24:26.192073+0000","last_undegraded":"2024-09-19T09:24:26.192073+0000","last_fullsized":"2024-09-19T09:24:26.192073+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:52:38.873128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.190467+0000","last_change":"2024-09-19T09:24:26.190287+0000","last_active":"2024-09-19T09:24:26.190467+0000","last_peered":"2024-09-19T09:24:26.190467+0000","last_clean":"2024-09-19T09:24:26.190467+0000","last_became_active":"2024-09-19T09:24:26.190006+0000","last_became_peered":"2024-09-19T09:24:26.190006+0000","last_unstale":"2024-09-19T09:24:26.190467+0000","last_undegraded":"2024-09-19T09:24:26.190467+0000","last_fullsized":"2024-09-19T09:24:26.190467+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:40:45.517892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.195867+0000","last_change":"2024-09-19T09:24:26.195737+0000","last_active":"2024-09-19T09:24:26.195867+0000","last_peered":"2024-09-19T09:24:26.195867+0000","last_clean":"2024-09-19T09:24:26.195867+0000","last_became_active":"2024-09-19T09:24:26.195493+0000","last_became_peered":"2024-09-19T09:24:26.195493+0000","last_unstale":"2024-09-19T09:24:26.195867+0000","last_undegraded":"2024-09-19T09:24:26.195867+0000","last_fullsized":"2024-09-19T09:24:26.195867+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:48:09.520590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.193001+0000","last_change":"2024-09-19T09:24:26.190481+0000","last_active":"2024-09-19T09:24:26.193001+0000","last_peered":"2024-09-19T09:24:26.193001+0000","last_clean":"2024-09-19T09:24:26.193001+0000","last_became_active":"2024-09-19T09:24:26.190249+0000","last_became_peered":"2024-09-19T09:24:26.190249+0000","last_unstale":"2024-09-19T09:24:26.193001+0000","last_undegraded":"2024-09-19T09:24:26.193001+0000","last_fullsized":"2024-09-19T09:24:26.193001+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:32.320604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.192317+0000","last_change":"2024-09-19T09:24:26.192196+0000","last_active":"2024-09-19T09:24:26.192317+0000","last_peered":"2024-09-19T09:24:26.192317+0000","last_clean":"2024-09-19T09:24:26.192317+0000","last_became_active":"2024-09-19T09:24:26.191956+0000","last_became_peered":"2024-09-19T09:24:26.191956+0000","last_unstale":"2024-09-19T09:24:26.192317+0000","last_undegraded":"2024-09-19T09:24:26.192317+0000","last_fullsized":"2024-09-19T09:24:26.192317+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:23:25.813243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.198671+0000","last_change":"2024-09-19T09:24:26.197471+0000","last_active":"2024-09-19T09:24:26.198671+0000","last_peered":"2024-09-19T09:24:26.198671+0000","last_clean":"2024-09-19T09:24:26.198671+0000","last_became_active":"2024-09-19T09:24:26.195289+0000","last_became_peered":"2024-09-19T09:24:26.195289+0000","last_unstale":"2024-09-19T09:24:26.198671+0000","last_undegraded":"2024-09-19T09:24:26.198671+0000","last_fullsized":"2024-09-19T09:24:26.198671+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:02.553332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.191726+0000","last_change":"2024-09-19T09:24:26.191601+0000","last_active":"2024-09-19T09:24:26.191726+0000","last_peered":"2024-09-19T09:24:26.191726+0000","last_clean":"2024-09-19T09:24:26.191726+0000","last_became_active":"2024-09-19T09:24:26.191359+0000","last_became_peered":"2024-09-19T09:24:26.191359+0000","last_unstale":"2024-09-19T09:24:26.191726+0000","last_undegraded":"2024-09-19T09:24:26.191726+0000","last_fullsized":"2024-09-19T09:24:26.191726+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:07.403172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.192174+0000","last_change":"2024-09-19T09:24:26.191662+0000","last_active":"2024-09-19T09:24:26.192174+0000","last_peered":"2024-09-19T09:24:26.192174+0000","last_clean":"2024-09-19T09:24:26.192174+0000","last_became_active":"2024-09-19T09:24:26.190832+0000","last_became_peered":"2024-09-19T09:24:26.190832+0000","last_unstale":"2024-09-19T09:24:26.192174+0000","last_undegraded":"2024-09-19T09:24:26.192174+0000","last_fullsized":"2024-09-19T09:24:26.192174+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:14:29.561737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.189036+0000","last_change":"2024-09-19T09:24:26.185419+0000","last_active":"2024-09-19T09:24:26.189036+0000","last_peered":"2024-09-19T09:24:26.189036+0000","last_clean":"2024-09-19T09:24:26.189036+0000","last_became_active":"2024-09-19T09:24:26.184559+0000","last_became_peered":"2024-09-19T09:24:26.184559+0000","last_unstale":"2024-09-19T09:24:26.189036+0000","last_undegraded":"2024-09-19T09:24:26.189036+0000","last_fullsized":"2024-09-19T09:24:26.189036+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:33:13.085621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1f","version":"181'4","reported_seq":16,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.206321+0000","last_change":"2024-09-19T09:24:25.174202+0000","last_active":"2024-09-19T09:24:26.206321+0000","last_peered":"2024-09-19T09:24:26.206321+0000","last_clean":"2024-09-19T09:24:26.206321+0000","last_became_active":"2024-09-19T09:24:25.173691+0000","last_became_peered":"2024-09-19T09:24:25.173691+0000","last_unstale":"2024-09-19T09:24:26.206321+0000","last_undegraded":"2024-09-19T09:24:26.206321+0000","last_fullsized":"2024-09-19T09:24:26.206321+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:29.416788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.203309+0000","last_change":"2024-09-19T09:24:26.202924+0000","last_active":"2024-09-19T09:24:26.203309+0000","last_peered":"2024-09-19T09:24:26.203309+0000","last_clean":"2024-09-19T09:24:26.203309+0000","last_became_active":"2024-09-19T09:24:26.196758+0000","last_became_peered":"2024-09-19T09:24:26.196758+0000","last_unstale":"2024-09-19T09:24:26.203309+0000","last_undegraded":"2024-09-19T09:24:26.203309+0000","last_fullsized":"2024-09-19T09:24:26.203309+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:25:54.537140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1e","version":"181'1","reported_seq":13,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.204073+0000","last_change":"2024-09-19T09:24:25.177899+0000","last_active":"2024-09-19T09:24:26.204073+0000","last_peered":"2024-09-19T09:24:26.204073+0000","last_clean":"2024-09-19T09:24:26.204073+0000","last_became_active":"2024-09-19T09:24:25.177658+0000","last_became_peered":"2024-09-19T09:24:25.177658+0000","last_unstale":"2024-09-19T09:24:26.204073+0000","last_undegraded":"2024-09-19T09:24:26.204073+0000","last_fullsized":"2024-09-19T09:24:26.204073+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:46.518560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.187467+0000","last_change":"2024-09-19T09:24:26.187354+0000","last_active":"2024-09-19T09:24:26.187467+0000","last_peered":"2024-09-19T09:24:26.187467+0000","last_clean":"2024-09-19T09:24:26.187467+0000","last_became_active":"2024-09-19T09:24:26.187125+0000","last_became_peered":"2024-09-19T09:24:26.187125+0000","last_unstale":"2024-09-19T09:24:26.187467+0000","last_undegraded":"2024-09-19T09:24:26.187467+0000","last_fullsized":"2024-09-19T09:24:26.187467+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:34.558665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1d","version":"181'2","reported_seq":14,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.201290+0000","last_change":"2024-09-19T09:24:25.176960+0000","last_active":"2024-09-19T09:24:26.201290+0000","last_peered":"2024-09-19T09:24:26.201290+0000","last_clean":"2024-09-19T09:24:26.201290+0000","last_became_active":"2024-09-19T09:24:25.176706+0000","last_became_peered":"2024-09-19T09:24:25.176706+0000","last_unstale":"2024-09-19T09:24:26.201290+0000","last_undegraded":"2024-09-19T09:24:26.201290+0000","last_fullsized":"2024-09-19T09:24:26.201290+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:32.940868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.198730+0000","last_change":"2024-09-19T09:24:26.197671+0000","last_active":"2024-09-19T09:24:26.198730+0000","last_peered":"2024-09-19T09:24:26.198730+0000","last_clean":"2024-09-19T09:24:26.198730+0000","last_became_active":"2024-09-19T09:24:26.197223+0000","last_became_peered":"2024-09-19T09:24:26.197223+0000","last_unstale":"2024-09-19T09:24:26.198730+0000","last_undegraded":"2024-09-19T09:24:26.198730+0000","last_fullsized":"2024-09-19T09:24:26.198730+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:56:43.801097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1c","version":"181'2","reported_seq":14,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.199804+0000","last_change":"2024-09-19T09:24:25.174628+0000","last_active":"2024-09-19T09:24:26.199804+0000","last_peered":"2024-09-19T09:24:26.199804+0000","last_clean":"2024-09-19T09:24:26.199804+0000","last_became_active":"2024-09-19T09:24:25.174377+0000","last_became_peered":"2024-09-19T09:24:25.174377+0000","last_unstale":"2024-09-19T09:24:26.199804+0000","last_undegraded":"2024-09-19T09:24:26.199804+0000","last_fullsized":"2024-09-19T09:24:26.199804+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:09:54.702344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.188993+0000","last_change":"2024-09-19T09:24:26.182926+0000","last_active":"2024-09-19T09:24:26.188993+0000","last_peered":"2024-09-19T09:24:26.188993+0000","last_clean":"2024-09-19T09:24:26.188993+0000","last_became_active":"2024-09-19T09:24:26.182688+0000","last_became_peered":"2024-09-19T09:24:26.182688+0000","last_unstale":"2024-09-19T09:24:26.188993+0000","last_undegraded":"2024-09-19T09:24:26.188993+0000","last_fullsized":"2024-09-19T09:24:26.188993+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:36.481929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1b","version":"181'1","reported_seq":13,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.202154+0000","last_change":"2024-09-19T09:24:25.173160+0000","last_active":"2024-09-19T09:24:26.202154+0000","last_peered":"2024-09-19T09:24:26.202154+0000","last_clean":"2024-09-19T09:24:26.202154+0000","last_became_active":"2024-09-19T09:24:25.172886+0000","last_became_peered":"2024-09-19T09:24:25.172886+0000","last_unstale":"2024-09-19T09:24:26.202154+0000","last_undegraded":"2024-09-19T09:24:26.202154+0000","last_fullsized":"2024-09-19T09:24:26.202154+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:43:26.660384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.192374+0000","last_change":"2024-09-19T09:24:26.192264+0000","last_active":"2024-09-19T09:24:26.192374+0000","last_peered":"2024-09-19T09:24:26.192374+0000","last_clean":"2024-09-19T09:24:26.192374+0000","last_became_active":"2024-09-19T09:24:26.191143+0000","last_became_peered":"2024-09-19T09:24:26.191143+0000","last_unstale":"2024-09-19T09:24:26.192374+0000","last_undegraded":"2024-09-19T09:24:26.192374+0000","last_fullsized":"2024-09-19T09:24:26.192374+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:30.402024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1a","version":"181'1","reported_seq":13,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.203666+0000","last_change":"2024-09-19T09:24:25.175129+0000","last_active":"2024-09-19T09:24:26.203666+0000","last_peered":"2024-09-19T09:24:26.203666+0000","last_clean":"2024-09-19T09:24:26.203666+0000","last_became_active":"2024-09-19T09:24:25.174887+0000","last_became_peered":"2024-09-19T09:24:25.174887+0000","last_unstale":"2024-09-19T09:24:26.203666+0000","last_undegraded":"2024-09-19T09:24:26.203666+0000","last_fullsized":"2024-09-19T09:24:26.203666+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:53:27.819337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.186810+0000","last_change":"2024-09-19T09:24:26.185739+0000","last_active":"2024-09-19T09:24:26.186810+0000","last_peered":"2024-09-19T09:24:26.186810+0000","last_clean":"2024-09-19T09:24:26.186810+0000","last_became_active":"2024-09-19T09:24:26.185469+0000","last_became_peered":"2024-09-19T09:24:26.185469+0000","last_unstale":"2024-09-19T09:24:26.186810+0000","last_undegraded":"2024-09-19T09:24:26.186810+0000","last_fullsized":"2024-09-19T09:24:26.186810+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:43.941397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.184934+0000","last_change":"2024-09-19T09:24:25.171583+0000","last_active":"2024-09-19T09:24:26.184934+0000","last_peered":"2024-09-19T09:24:26.184934+0000","last_clean":"2024-09-19T09:24:26.184934+0000","last_became_active":"2024-09-19T09:24:25.171345+0000","last_became_peered":"2024-09-19T09:24:25.171345+0000","last_unstale":"2024-09-19T09:24:26.184934+0000","last_undegraded":"2024-09-19T09:24:26.184934+0000","last_fullsized":"2024-09-19T09:24:26.184934+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:18.143800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.189073+0000","last_change":"2024-09-19T09:24:26.185769+0000","last_active":"2024-09-19T09:24:26.189073+0000","last_peered":"2024-09-19T09:24:26.189073+0000","last_clean":"2024-09-19T09:24:26.189073+0000","last_became_active":"2024-09-19T09:24:26.185202+0000","last_became_peered":"2024-09-19T09:24:26.185202+0000","last_unstale":"2024-09-19T09:24:26.189073+0000","last_undegraded":"2024-09-19T09:24:26.189073+0000","last_fullsized":"2024-09-19T09:24:26.189073+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:46.459808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.180656+0000","last_change":"2024-09-19T09:24:25.173824+0000","last_active":"2024-09-19T09:24:26.180656+0000","last_peered":"2024-09-19T09:24:26.180656+0000","last_clean":"2024-09-19T09:24:26.180656+0000","last_became_active":"2024-09-19T09:24:25.172884+0000","last_became_peered":"2024-09-19T09:24:25.172884+0000","last_unstale":"2024-09-19T09:24:26.180656+0000","last_undegraded":"2024-09-19T09:24:26.180656+0000","last_fullsized":"2024-09-19T09:24:26.180656+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:04:31.866549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.188836+0000","last_change":"2024-09-19T09:24:26.188226+0000","last_active":"2024-09-19T09:24:26.188836+0000","last_peered":"2024-09-19T09:24:26.188836+0000","last_clean":"2024-09-19T09:24:26.188836+0000","last_became_active":"2024-09-19T09:24:26.188001+0000","last_became_peered":"2024-09-19T09:24:26.188001+0000","last_unstale":"2024-09-19T09:24:26.188836+0000","last_undegraded":"2024-09-19T09:24:26.188836+0000","last_fullsized":"2024-09-19T09:24:26.188836+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:50.840886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.186162+0000","last_change":"2024-09-19T09:24:25.176806+0000","last_active":"2024-09-19T09:24:26.186162+0000","last_peered":"2024-09-19T09:24:26.186162+0000","last_clean":"2024-09-19T09:24:26.186162+0000","last_became_active":"2024-09-19T09:24:25.176555+0000","last_became_peered":"2024-09-19T09:24:25.176555+0000","last_unstale":"2024-09-19T09:24:26.186162+0000","last_undegraded":"2024-09-19T09:24:26.186162+0000","last_fullsized":"2024-09-19T09:24:26.186162+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:14.016215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.186094+0000","last_change":"2024-09-19T09:24:26.185959+0000","last_active":"2024-09-19T09:24:26.186094+0000","last_peered":"2024-09-19T09:24:26.186094+0000","last_clean":"2024-09-19T09:24:26.186094+0000","last_became_active":"2024-09-19T09:24:26.185722+0000","last_became_peered":"2024-09-19T09:24:26.185722+0000","last_unstale":"2024-09-19T09:24:26.186094+0000","last_undegraded":"2024-09-19T09:24:26.186094+0000","last_fullsized":"2024-09-19T09:24:26.186094+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:37.768127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.15","version":"181'3","reported_seq":15,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.200451+0000","last_change":"2024-09-19T09:24:25.173616+0000","last_active":"2024-09-19T09:24:26.200451+0000","last_peered":"2024-09-19T09:24:26.200451+0000","last_clean":"2024-09-19T09:24:26.200451+0000","last_became_active":"2024-09-19T09:24:25.172815+0000","last_became_peered":"2024-09-19T09:24:25.172815+0000","last_unstale":"2024-09-19T09:24:26.200451+0000","last_undegraded":"2024-09-19T09:24:26.200451+0000","last_fullsized":"2024-09-19T09:24:26.200451+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:18.168213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.196177+0000","last_change":"2024-09-19T09:24:26.196051+0000","last_active":"2024-09-19T09:24:26.196177+0000","last_peered":"2024-09-19T09:24:26.196177+0000","last_clean":"2024-09-19T09:24:26.196177+0000","last_became_active":"2024-09-19T09:24:26.192523+0000","last_became_peered":"2024-09-19T09:24:26.192523+0000","last_unstale":"2024-09-19T09:24:26.196177+0000","last_undegraded":"2024-09-19T09:24:26.196177+0000","last_fullsized":"2024-09-19T09:24:26.196177+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:33.528058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.14","version":"181'6","reported_seq":18,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.206663+0000","last_change":"2024-09-19T09:24:25.171306+0000","last_active":"2024-09-19T09:24:26.206663+0000","last_peered":"2024-09-19T09:24:26.206663+0000","last_clean":"2024-09-19T09:24:26.206663+0000","last_became_active":"2024-09-19T09:24:25.170867+0000","last_became_peered":"2024-09-19T09:24:25.170867+0000","last_unstale":"2024-09-19T09:24:26.206663+0000","last_undegraded":"2024-09-19T09:24:26.206663+0000","last_fullsized":"2024-09-19T09:24:26.206663+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:24:07.502205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.189166+0000","last_change":"2024-09-19T09:24:26.189057+0000","last_active":"2024-09-19T09:24:26.189166+0000","last_peered":"2024-09-19T09:24:26.189166+0000","last_clean":"2024-09-19T09:24:26.189166+0000","last_became_active":"2024-09-19T09:24:26.188824+0000","last_became_peered":"2024-09-19T09:24:26.188824+0000","last_unstale":"2024-09-19T09:24:26.189166+0000","last_undegraded":"2024-09-19T09:24:26.189166+0000","last_fullsized":"2024-09-19T09:24:26.189166+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:43:50.273331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"181'2","reported_seq":14,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.199614+0000","last_change":"2024-09-19T09:24:25.173492+0000","last_active":"2024-09-19T09:24:26.199614+0000","last_peered":"2024-09-19T09:24:26.199614+0000","last_clean":"2024-09-19T09:24:26.199614+0000","last_became_active":"2024-09-19T09:24:25.173268+0000","last_became_peered":"2024-09-19T09:24:25.173268+0000","last_unstale":"2024-09-19T09:24:26.199614+0000","last_undegraded":"2024-09-19T09:24:26.199614+0000","last_fullsized":"2024-09-19T09:24:26.199614+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:57:28.002992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.190395+0000","last_change":"2024-09-19T09:24:26.189617+0000","last_active":"2024-09-19T09:24:26.190395+0000","last_peered":"2024-09-19T09:24:26.190395+0000","last_clean":"2024-09-19T09:24:26.190395+0000","last_became_active":"2024-09-19T09:24:26.189263+0000","last_became_peered":"2024-09-19T09:24:26.189263+0000","last_unstale":"2024-09-19T09:24:26.190395+0000","last_undegraded":"2024-09-19T09:24:26.190395+0000","last_fullsized":"2024-09-19T09:24:26.190395+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:33.370499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.184459+0000","last_change":"2024-09-19T09:24:25.172231+0000","last_active":"2024-09-19T09:24:26.184459+0000","last_peered":"2024-09-19T09:24:26.184459+0000","last_clean":"2024-09-19T09:24:26.184459+0000","last_became_active":"2024-09-19T09:24:25.171955+0000","last_became_peered":"2024-09-19T09:24:25.171955+0000","last_unstale":"2024-09-19T09:24:26.184459+0000","last_undegraded":"2024-09-19T09:24:26.184459+0000","last_fullsized":"2024-09-19T09:24:26.184459+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:52:57.340731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.190469+0000","last_change":"2024-09-19T09:24:26.190353+0000","last_active":"2024-09-19T09:24:26.190469+0000","last_peered":"2024-09-19T09:24:26.190469+0000","last_clean":"2024-09-19T09:24:26.190469+0000","last_became_active":"2024-09-19T09:24:26.190132+0000","last_became_peered":"2024-09-19T09:24:26.190132+0000","last_unstale":"2024-09-19T09:24:26.190469+0000","last_undegraded":"2024-09-19T09:24:26.190469+0000","last_fullsized":"2024-09-19T09:24:26.190469+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:58.274876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.184182+0000","last_change":"2024-09-19T09:24:25.176055+0000","last_active":"2024-09-19T09:24:26.184182+0000","last_peered":"2024-09-19T09:24:26.184182+0000","last_clean":"2024-09-19T09:24:26.184182+0000","last_became_active":"2024-09-19T09:24:25.175619+0000","last_became_peered":"2024-09-19T09:24:25.175619+0000","last_unstale":"2024-09-19T09:24:26.184182+0000","last_undegraded":"2024-09-19T09:24:26.184182+0000","last_fullsized":"2024-09-19T09:24:26.184182+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:13.151199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.198691+0000","last_change":"2024-09-19T09:24:26.197616+0000","last_active":"2024-09-19T09:24:26.198691+0000","last_peered":"2024-09-19T09:24:26.198691+0000","last_clean":"2024-09-19T09:24:26.198691+0000","last_became_active":"2024-09-19T09:24:26.197333+0000","last_became_peered":"2024-09-19T09:24:26.197333+0000","last_unstale":"2024-09-19T09:24:26.198691+0000","last_undegraded":"2024-09-19T09:24:26.198691+0000","last_fullsized":"2024-09-19T09:24:26.198691+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:37:42.044020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.10","version":"181'8","reported_seq":20,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.206138+0000","last_change":"2024-09-19T09:24:25.170674+0000","last_active":"2024-09-19T09:24:26.206138+0000","last_peered":"2024-09-19T09:24:26.206138+0000","last_clean":"2024-09-19T09:24:26.206138+0000","last_became_active":"2024-09-19T09:24:25.170428+0000","last_became_peered":"2024-09-19T09:24:25.170428+0000","last_unstale":"2024-09-19T09:24:26.206138+0000","last_undegraded":"2024-09-19T09:24:26.206138+0000","last_fullsized":"2024-09-19T09:24:26.206138+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:59:23.674916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.193083+0000","last_change":"2024-09-19T09:24:26.192260+0000","last_active":"2024-09-19T09:24:26.193083+0000","last_peered":"2024-09-19T09:24:26.193083+0000","last_clean":"2024-09-19T09:24:26.193083+0000","last_became_active":"2024-09-19T09:24:26.191551+0000","last_became_peered":"2024-09-19T09:24:26.191551+0000","last_unstale":"2024-09-19T09:24:26.193083+0000","last_undegraded":"2024-09-19T09:24:26.193083+0000","last_fullsized":"2024-09-19T09:24:26.193083+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:41:41.025606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.f","version":"181'1","reported_seq":13,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.205229+0000","last_change":"2024-09-19T09:24:25.171111+0000","last_active":"2024-09-19T09:24:26.205229+0000","last_peered":"2024-09-19T09:24:26.205229+0000","last_clean":"2024-09-19T09:24:26.205229+0000","last_became_active":"2024-09-19T09:24:25.170447+0000","last_became_peered":"2024-09-19T09:24:25.170447+0000","last_unstale":"2024-09-19T09:24:26.205229+0000","last_undegraded":"2024-09-19T09:24:26.205229+0000","last_fullsized":"2024-09-19T09:24:26.205229+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:34:57.870165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.191847+0000","last_change":"2024-09-19T09:24:26.191377+0000","last_active":"2024-09-19T09:24:26.191847+0000","last_peered":"2024-09-19T09:24:26.191847+0000","last_clean":"2024-09-19T09:24:26.191847+0000","last_became_active":"2024-09-19T09:24:26.190327+0000","last_became_peered":"2024-09-19T09:24:26.190327+0000","last_unstale":"2024-09-19T09:24:26.191847+0000","last_undegraded":"2024-09-19T09:24:26.191847+0000","last_fullsized":"2024-09-19T09:24:26.191847+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:03:28.755808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.e","version":"181'2","reported_seq":14,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.203255+0000","last_change":"2024-09-19T09:24:25.176663+0000","last_active":"2024-09-19T09:24:26.203255+0000","last_peered":"2024-09-19T09:24:26.203255+0000","last_clean":"2024-09-19T09:24:26.203255+0000","last_became_active":"2024-09-19T09:24:25.176385+0000","last_became_peered":"2024-09-19T09:24:25.176385+0000","last_unstale":"2024-09-19T09:24:26.203255+0000","last_undegraded":"2024-09-19T09:24:26.203255+0000","last_fullsized":"2024-09-19T09:24:26.203255+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:18:39.926914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.189016+0000","last_change":"2024-09-19T09:24:26.184717+0000","last_active":"2024-09-19T09:24:26.189016+0000","last_peered":"2024-09-19T09:24:26.189016+0000","last_clean":"2024-09-19T09:24:26.189016+0000","last_became_active":"2024-09-19T09:24:26.184473+0000","last_became_peered":"2024-09-19T09:24:26.184473+0000","last_unstale":"2024-09-19T09:24:26.189016+0000","last_undegraded":"2024-09-19T09:24:26.189016+0000","last_fullsized":"2024-09-19T09:24:26.189016+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:10:58.934178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.d","version":"181'1","reported_seq":13,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.204346+0000","last_change":"2024-09-19T09:24:25.178305+0000","last_active":"2024-09-19T09:24:26.204346+0000","last_peered":"2024-09-19T09:24:26.204346+0000","last_clean":"2024-09-19T09:24:26.204346+0000","last_became_active":"2024-09-19T09:24:25.178041+0000","last_became_peered":"2024-09-19T09:24:25.178041+0000","last_unstale":"2024-09-19T09:24:26.204346+0000","last_undegraded":"2024-09-19T09:24:26.204346+0000","last_fullsized":"2024-09-19T09:24:26.204346+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:43:23.565257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.186859+0000","last_change":"2024-09-19T09:24:26.186083+0000","last_active":"2024-09-19T09:24:26.186859+0000","last_peered":"2024-09-19T09:24:26.186859+0000","last_clean":"2024-09-19T09:24:26.186859+0000","last_became_active":"2024-09-19T09:24:26.185846+0000","last_became_peered":"2024-09-19T09:24:26.185846+0000","last_unstale":"2024-09-19T09:24:26.186859+0000","last_undegraded":"2024-09-19T09:24:26.186859+0000","last_fullsized":"2024-09-19T09:24:26.186859+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:26:47.958234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.183924+0000","last_change":"2024-09-19T09:24:25.168988+0000","last_active":"2024-09-19T09:24:26.183924+0000","last_peered":"2024-09-19T09:24:26.183924+0000","last_clean":"2024-09-19T09:24:26.183924+0000","last_became_active":"2024-09-19T09:24:25.168711+0000","last_became_peered":"2024-09-19T09:24:25.168711+0000","last_unstale":"2024-09-19T09:24:26.183924+0000","last_undegraded":"2024-09-19T09:24:26.183924+0000","last_fullsized":"2024-09-19T09:24:26.183924+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:32.223889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.194202+0000","last_change":"2024-09-19T09:24:26.194049+0000","last_active":"2024-09-19T09:24:26.194202+0000","last_peered":"2024-09-19T09:24:26.194202+0000","last_clean":"2024-09-19T09:24:26.194202+0000","last_became_active":"2024-09-19T09:24:26.193448+0000","last_became_peered":"2024-09-19T09:24:26.193448+0000","last_unstale":"2024-09-19T09:24:26.194202+0000","last_undegraded":"2024-09-19T09:24:26.194202+0000","last_fullsized":"2024-09-19T09:24:26.194202+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:49:05.429207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.b","version":"181'2","reported_seq":14,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.202374+0000","last_change":"2024-09-19T09:24:25.169964+0000","last_active":"2024-09-19T09:24:26.202374+0000","last_peered":"2024-09-19T09:24:26.202374+0000","last_clean":"2024-09-19T09:24:26.202374+0000","last_became_active":"2024-09-19T09:24:25.169600+0000","last_became_peered":"2024-09-19T09:24:25.169600+0000","last_unstale":"2024-09-19T09:24:26.202374+0000","last_undegraded":"2024-09-19T09:24:26.202374+0000","last_fullsized":"2024-09-19T09:24:26.202374+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:40.986827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.192189+0000","last_change":"2024-09-19T09:24:26.192030+0000","last_active":"2024-09-19T09:24:26.192189+0000","last_peered":"2024-09-19T09:24:26.192189+0000","last_clean":"2024-09-19T09:24:26.192189+0000","last_became_active":"2024-09-19T09:24:26.191824+0000","last_became_peered":"2024-09-19T09:24:26.191824+0000","last_unstale":"2024-09-19T09:24:26.192189+0000","last_undegraded":"2024-09-19T09:24:26.192189+0000","last_fullsized":"2024-09-19T09:24:26.192189+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:18.831810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.183094+0000","last_change":"2024-09-19T09:24:25.170877+0000","last_active":"2024-09-19T09:24:26.183094+0000","last_peered":"2024-09-19T09:24:26.183094+0000","last_clean":"2024-09-19T09:24:26.183094+0000","last_became_active":"2024-09-19T09:24:25.170626+0000","last_became_peered":"2024-09-19T09:24:25.170626+0000","last_unstale":"2024-09-19T09:24:26.183094+0000","last_undegraded":"2024-09-19T09:24:26.183094+0000","last_fullsized":"2024-09-19T09:24:26.183094+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:39.370540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.188000+0000","last_change":"2024-09-19T09:24:26.187275+0000","last_active":"2024-09-19T09:24:26.188000+0000","last_peered":"2024-09-19T09:24:26.188000+0000","last_clean":"2024-09-19T09:24:26.188000+0000","last_became_active":"2024-09-19T09:24:26.187035+0000","last_became_peered":"2024-09-19T09:24:26.187035+0000","last_unstale":"2024-09-19T09:24:26.188000+0000","last_undegraded":"2024-09-19T09:24:26.188000+0000","last_fullsized":"2024-09-19T09:24:26.188000+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:07:49.891088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.180421+0000","last_change":"2024-09-19T09:24:25.172994+0000","last_active":"2024-09-19T09:24:26.180421+0000","last_peered":"2024-09-19T09:24:26.180421+0000","last_clean":"2024-09-19T09:24:26.180421+0000","last_became_active":"2024-09-19T09:24:25.172736+0000","last_became_peered":"2024-09-19T09:24:25.172736+0000","last_unstale":"2024-09-19T09:24:26.180421+0000","last_undegraded":"2024-09-19T09:24:26.180421+0000","last_fullsized":"2024-09-19T09:24:26.180421+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:37:27.728600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.193066+0000","last_change":"2024-09-19T09:24:26.191782+0000","last_active":"2024-09-19T09:24:26.193066+0000","last_peered":"2024-09-19T09:24:26.193066+0000","last_clean":"2024-09-19T09:24:26.193066+0000","last_became_active":"2024-09-19T09:24:26.191234+0000","last_became_peered":"2024-09-19T09:24:26.191234+0000","last_unstale":"2024-09-19T09:24:26.193066+0000","last_undegraded":"2024-09-19T09:24:26.193066+0000","last_fullsized":"2024-09-19T09:24:26.193066+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:28:58.257267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.184193+0000","last_change":"2024-09-19T09:24:25.177016+0000","last_active":"2024-09-19T09:24:26.184193+0000","last_peered":"2024-09-19T09:24:26.184193+0000","last_clean":"2024-09-19T09:24:26.184193+0000","last_became_active":"2024-09-19T09:24:25.176659+0000","last_became_peered":"2024-09-19T09:24:25.176659+0000","last_unstale":"2024-09-19T09:24:26.184193+0000","last_undegraded":"2024-09-19T09:24:26.184193+0000","last_fullsized":"2024-09-19T09:24:26.184193+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:09.829274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.188771+0000","last_change":"2024-09-19T09:24:26.188646+0000","last_active":"2024-09-19T09:24:26.188771+0000","last_peered":"2024-09-19T09:24:26.188771+0000","last_clean":"2024-09-19T09:24:26.188771+0000","last_became_active":"2024-09-19T09:24:26.188209+0000","last_became_peered":"2024-09-19T09:24:26.188209+0000","last_unstale":"2024-09-19T09:24:26.188771+0000","last_undegraded":"2024-09-19T09:24:26.188771+0000","last_fullsized":"2024-09-19T09:24:26.188771+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:23:44.235752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.7","version":"181'2","reported_seq":14,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.200842+0000","last_change":"2024-09-19T09:24:25.175849+0000","last_active":"2024-09-19T09:24:26.200842+0000","last_peered":"2024-09-19T09:24:26.200842+0000","last_clean":"2024-09-19T09:24:26.200842+0000","last_became_active":"2024-09-19T09:24:25.175591+0000","last_became_peered":"2024-09-19T09:24:25.175591+0000","last_unstale":"2024-09-19T09:24:26.200842+0000","last_undegraded":"2024-09-19T09:24:26.200842+0000","last_fullsized":"2024-09-19T09:24:26.200842+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:20:21.969567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.190501+0000","last_change":"2024-09-19T09:24:26.189248+0000","last_active":"2024-09-19T09:24:26.190501+0000","last_peered":"2024-09-19T09:24:26.190501+0000","last_clean":"2024-09-19T09:24:26.190501+0000","last_became_active":"2024-09-19T09:24:26.188976+0000","last_became_peered":"2024-09-19T09:24:26.188976+0000","last_unstale":"2024-09-19T09:24:26.190501+0000","last_undegraded":"2024-09-19T09:24:26.190501+0000","last_fullsized":"2024-09-19T09:24:26.190501+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:35.337228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.183380+0000","last_change":"2024-09-19T09:24:25.175663+0000","last_active":"2024-09-19T09:24:26.183380+0000","last_peered":"2024-09-19T09:24:26.183380+0000","last_clean":"2024-09-19T09:24:26.183380+0000","last_became_active":"2024-09-19T09:24:25.175359+0000","last_became_peered":"2024-09-19T09:24:25.175359+0000","last_unstale":"2024-09-19T09:24:26.183380+0000","last_undegraded":"2024-09-19T09:24:26.183380+0000","last_fullsized":"2024-09-19T09:24:26.183380+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:21.443273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.189199+0000","last_change":"2024-09-19T09:24:26.187935+0000","last_active":"2024-09-19T09:24:26.189199+0000","last_peered":"2024-09-19T09:24:26.189199+0000","last_clean":"2024-09-19T09:24:26.189199+0000","last_became_active":"2024-09-19T09:24:26.187705+0000","last_became_peered":"2024-09-19T09:24:26.187705+0000","last_unstale":"2024-09-19T09:24:26.189199+0000","last_undegraded":"2024-09-19T09:24:26.189199+0000","last_fullsized":"2024-09-19T09:24:26.189199+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:22:43.922487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.185082+0000","last_change":"2024-09-19T09:24:25.170441+0000","last_active":"2024-09-19T09:24:26.185082+0000","last_peered":"2024-09-19T09:24:26.185082+0000","last_clean":"2024-09-19T09:24:26.185082+0000","last_became_active":"2024-09-19T09:24:25.170176+0000","last_became_peered":"2024-09-19T09:24:25.170176+0000","last_unstale":"2024-09-19T09:24:26.185082+0000","last_undegraded":"2024-09-19T09:24:26.185082+0000","last_fullsized":"2024-09-19T09:24:26.185082+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:19.465441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.191868+0000","last_change":"2024-09-19T09:24:26.191634+0000","last_active":"2024-09-19T09:24:26.191868+0000","last_peered":"2024-09-19T09:24:26.191868+0000","last_clean":"2024-09-19T09:24:26.191868+0000","last_became_active":"2024-09-19T09:24:26.191144+0000","last_became_peered":"2024-09-19T09:24:26.191144+0000","last_unstale":"2024-09-19T09:24:26.191868+0000","last_undegraded":"2024-09-19T09:24:26.191868+0000","last_fullsized":"2024-09-19T09:24:26.191868+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:51:26.389958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.180981+0000","last_change":"2024-09-19T09:24:25.170308+0000","last_active":"2024-09-19T09:24:26.180981+0000","last_peered":"2024-09-19T09:24:26.180981+0000","last_clean":"2024-09-19T09:24:26.180981+0000","last_became_active":"2024-09-19T09:24:25.170048+0000","last_became_peered":"2024-09-19T09:24:25.170048+0000","last_unstale":"2024-09-19T09:24:26.180981+0000","last_undegraded":"2024-09-19T09:24:26.180981+0000","last_fullsized":"2024-09-19T09:24:26.180981+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:20.121579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.192720+0000","last_change":"2024-09-19T09:24:26.192455+0000","last_active":"2024-09-19T09:24:26.192720+0000","last_peered":"2024-09-19T09:24:26.192720+0000","last_clean":"2024-09-19T09:24:26.192720+0000","last_became_active":"2024-09-19T09:24:26.191445+0000","last_became_peered":"2024-09-19T09:24:26.191445+0000","last_unstale":"2024-09-19T09:24:26.192720+0000","last_undegraded":"2024-09-19T09:24:26.192720+0000","last_fullsized":"2024-09-19T09:24:26.192720+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:20:14.630802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.185307+0000","last_change":"2024-09-19T09:24:25.170239+0000","last_active":"2024-09-19T09:24:26.185307+0000","last_peered":"2024-09-19T09:24:26.185307+0000","last_clean":"2024-09-19T09:24:26.185307+0000","last_became_active":"2024-09-19T09:24:25.169912+0000","last_became_peered":"2024-09-19T09:24:25.169912+0000","last_unstale":"2024-09-19T09:24:26.185307+0000","last_undegraded":"2024-09-19T09:24:26.185307+0000","last_fullsized":"2024-09-19T09:24:26.185307+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:52.056925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.188021+0000","last_change":"2024-09-19T09:24:26.187863+0000","last_active":"2024-09-19T09:24:26.188021+0000","last_peered":"2024-09-19T09:24:26.188021+0000","last_clean":"2024-09-19T09:24:26.188021+0000","last_became_active":"2024-09-19T09:24:26.187605+0000","last_became_peered":"2024-09-19T09:24:26.187605+0000","last_unstale":"2024-09-19T09:24:26.188021+0000","last_undegraded":"2024-09-19T09:24:26.188021+0000","last_fullsized":"2024-09-19T09:24:26.188021+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:40.653498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.184341+0000","last_change":"2024-09-19T09:24:25.178249+0000","last_active":"2024-09-19T09:24:26.184341+0000","last_peered":"2024-09-19T09:24:26.184341+0000","last_clean":"2024-09-19T09:24:26.184341+0000","last_became_active":"2024-09-19T09:24:25.177997+0000","last_became_peered":"2024-09-19T09:24:25.177997+0000","last_unstale":"2024-09-19T09:24:26.184341+0000","last_undegraded":"2024-09-19T09:24:26.184341+0000","last_fullsized":"2024-09-19T09:24:26.184341+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:40.860622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.194764+0000","last_change":"2024-09-19T09:24:26.194646+0000","last_active":"2024-09-19T09:24:26.194764+0000","last_peered":"2024-09-19T09:24:26.194764+0000","last_clean":"2024-09-19T09:24:26.194764+0000","last_became_active":"2024-09-19T09:24:26.194383+0000","last_became_peered":"2024-09-19T09:24:26.194383+0000","last_unstale":"2024-09-19T09:24:26.194764+0000","last_undegraded":"2024-09-19T09:24:26.194764+0000","last_fullsized":"2024-09-19T09:24:26.194764+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:15.278564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.185690+0000","last_change":"2024-09-19T09:24:25.173932+0000","last_active":"2024-09-19T09:24:26.185690+0000","last_peered":"2024-09-19T09:24:26.185690+0000","last_clean":"2024-09-19T09:24:26.185690+0000","last_became_active":"2024-09-19T09:24:25.173236+0000","last_became_peered":"2024-09-19T09:24:25.173236+0000","last_unstale":"2024-09-19T09:24:26.185690+0000","last_undegraded":"2024-09-19T09:24:26.185690+0000","last_fullsized":"2024-09-19T09:24:26.185690+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:23.460908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.189546+0000","last_change":"2024-09-19T09:24:26.189428+0000","last_active":"2024-09-19T09:24:26.189546+0000","last_peered":"2024-09-19T09:24:26.189546+0000","last_clean":"2024-09-19T09:24:26.189546+0000","last_became_active":"2024-09-19T09:24:26.189148+0000","last_became_peered":"2024-09-19T09:24:26.189148+0000","last_unstale":"2024-09-19T09:24:26.189546+0000","last_undegraded":"2024-09-19T09:24:26.189546+0000","last_fullsized":"2024-09-19T09:24:26.189546+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:06.004525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.185332+0000","last_change":"2024-09-19T09:24:25.169885+0000","last_active":"2024-09-19T09:24:26.185332+0000","last_peered":"2024-09-19T09:24:26.185332+0000","last_clean":"2024-09-19T09:24:26.185332+0000","last_became_active":"2024-09-19T09:24:25.169576+0000","last_became_peered":"2024-09-19T09:24:25.169576+0000","last_unstale":"2024-09-19T09:24:26.185332+0000","last_undegraded":"2024-09-19T09:24:26.185332+0000","last_fullsized":"2024-09-19T09:24:26.185332+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:57:07.526456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":9,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.193047+0000","last_change":"2024-09-19T09:24:26.191082+0000","last_active":"2024-09-19T09:24:26.193047+0000","last_peered":"2024-09-19T09:24:26.193047+0000","last_clean":"2024-09-19T09:24:26.193047+0000","last_became_active":"2024-09-19T09:24:26.190765+0000","last_became_peered":"2024-09-19T09:24:26.190765+0000","last_unstale":"2024-09-19T09:24:26.193047+0000","last_undegraded":"2024-09-19T09:24:26.193047+0000","last_fullsized":"2024-09-19T09:24:26.193047+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":180,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:25.159939+0000","last_clean_scrub_stamp":"2024-09-19T09:24:25.159939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:58.477467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":12,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.183868+0000","last_change":"2024-09-19T09:24:25.174924+0000","last_active":"2024-09-19T09:24:26.183868+0000","last_peered":"2024-09-19T09:24:26.183868+0000","last_clean":"2024-09-19T09:24:26.183868+0000","last_became_active":"2024-09-19T09:24:25.174670+0000","last_became_peered":"2024-09-19T09:24:25.174670+0000","last_unstale":"2024-09-19T09:24:26.183868+0000","last_undegraded":"2024-09-19T09:24:26.183868+0000","last_fullsized":"2024-09-19T09:24:26.183868+0000","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":179,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:24:24.155093+0000","last_clean_scrub_stamp":"2024-09-19T09:24:24.155093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:31:57.347590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":484,"reported_epoch":181,"state":"active+clean","last_fresh":"2024-09-19T09:24:26.189672+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:24:26.189672+0000","last_peered":"2024-09-19T09:24:26.189672+0000","last_clean":"2024-09-19T09:24:26.189672+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:24:26.189672+0000","last_undegraded":"2024-09-19T09:24:26.189672+0000","last_fullsized":"2024-09-19T09:24:26.189672+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:28.823470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574984,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":992,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194320,"statfs":{"total":200000000,"available":198983754,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574984,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":985,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194326,"statfs":{"total":200000000,"available":198990529,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574984,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1569,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193742,"statfs":{"total":200000000,"available":198392714,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574984,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":985,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194326,"statfs":{"total":200000000,"available":198990529,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574984,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":985,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194326,"statfs":{"total":200000000,"available":198990529,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574984,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":985,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194326,"statfs":{"total":200000000,"available":198990529,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574984,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1562,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193750,"statfs":{"total":200000000,"available":198400161,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574984,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":985,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194326,"statfs":{"total":200000000,"available":198990529,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:24:29.605 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T09:24:29.605 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-19T09:24:29.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.751+0000 7f22ad7cf640 1 Processor -- start 2024-09-19T09:24:29.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.751+0000 7f22ad7cf640 1 -- start start 2024-09-19T09:24:29.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.752+0000 7f22ad7cf640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f22a8162850 0x7f22a8162c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:29.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.752+0000 7f22ad7cf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22a80d1660 0x7f22a8160650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:29.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.752+0000 7f22ad7cf640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22a8163170 con 0x7f22a80b5160 2024-09-19T09:24:29.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.752+0000 7f22ad7cf640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f22a80d1f00 con 0x7f22a8162850 2024-09-19T09:24:29.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.752+0000 7f22ad7cf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f22a806f860 con 0x7f22a80d1660 2024-09-19T09:24:29.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.752+0000 7f22a67fc640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f22a80b5160 0x7f22a8070620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44722/0 (socket says 172.21.15.18:44722) 2024-09-19T09:24:29.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.752+0000 7f22a67fc640 1 -- 172.21.15.18:0/1774678720 learned_addr learned my addr 172.21.15.18:0/1774678720 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:24:29.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.753+0000 7f22a77fe640 1 --2- 172.21.15.18:0/1774678720 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22a80d1660 0x7f22a8160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:29.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.753+0000 7f22a6ffd640 1 --2- 172.21.15.18:0/1774678720 >> v2:172.21.15.162:3300/0 conn(0x7f22a8162850 0x7f22a8162c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:29.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.753+0000 7f22a5ffb640 1 -- 172.21.15.18:0/1774678720 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 947928176 0 0) 0x7f22a8163170 con 0x7f22a80b5160 2024-09-19T09:24:29.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.753+0000 7f22a5ffb640 1 -- 172.21.15.18:0/1774678720 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2294003520 con 0x7f22a80b5160 2024-09-19T09:24:29.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.753+0000 7f22a5ffb640 1 -- 172.21.15.18:0/1774678720 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1709702894 0 0) 0x7f2294003520 con 0x7f22a80b5160 2024-09-19T09:24:29.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.753+0000 7f22a5ffb640 1 -- 172.21.15.18:0/1774678720 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22a80d1660 msgr2=0x7f22a8160650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:29.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.753+0000 7f22a5ffb640 1 --2- 172.21.15.18:0/1774678720 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22a80d1660 0x7f22a8160650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:29.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.753+0000 7f22a5ffb640 1 -- 172.21.15.18:0/1774678720 >> v2:172.21.15.162:3300/0 conn(0x7f22a8162850 msgr2=0x7f22a8162c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:29.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.753+0000 7f22a5ffb640 1 --2- 172.21.15.18:0/1774678720 >> v2:172.21.15.162:3300/0 conn(0x7f22a8162850 0x7f22a8162c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:29.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.753+0000 7f22a5ffb640 1 -- 172.21.15.18:0/1774678720 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a806fb40 con 0x7f22a80b5160 2024-09-19T09:24:29.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.753+0000 7f22a5ffb640 1 -- 172.21.15.18:0/1774678720 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f2290001670 con 0x7f22a80b5160 2024-09-19T09:24:29.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.753+0000 7f22a77fe640 1 --2- 172.21.15.18:0/1774678720 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22a80d1660 0x7f22a8160650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:24:29.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.753+0000 7f22a5ffb640 1 -- 172.21.15.18:0/1774678720 >> v1:172.21.15.18:6789/0 conn(0x7f22a80b5160 legacy=0x7f22a8070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:29.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.753+0000 7f22a5ffb640 1 --2- 172.21.15.18:0/1774678720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22940039b0 0x7f2294003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:29.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.753+0000 7f22a5ffb640 1 --2- 172.21.15.18:0/1774678720 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22a80d1660 0x7f2294004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:29.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.753+0000 7f22a5ffb640 1 --2- 172.21.15.18:0/1774678720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2294004d40 0x7f22940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:29.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.753+0000 7f22a5ffb640 1 -- 172.21.15.18:0/1774678720 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f22a80d1f00 con 0x7f22940039b0 2024-09-19T09:24:29.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.753+0000 7f22a5ffb640 1 -- 172.21.15.18:0/1774678720 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f22a806f860 con 0x7f2294004d40 2024-09-19T09:24:29.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.753+0000 7f22a5ffb640 1 -- 172.21.15.18:0/1774678720 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f229400b9c0 con 0x7f22a80d1660 2024-09-19T09:24:29.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.753+0000 7f22a6ffd640 1 --2- 172.21.15.18:0/1774678720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22940039b0 0x7f2294003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:29.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.753+0000 7f22a67fc640 1 --2- 172.21.15.18:0/1774678720 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22a80d1660 0x7f2294004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:29.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.753+0000 7f22a77fe640 1 --2- 172.21.15.18:0/1774678720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2294004d40 0x7f22940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:29.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.753+0000 7f22a6ffd640 1 -- 172.21.15.18:0/1774678720 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22a80d1660 msgr2=0x7f2294004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:29.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.753+0000 7f22a6ffd640 1 --2- 172.21.15.18:0/1774678720 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22a80d1660 0x7f2294004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:29.760 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.753+0000 7f22a6ffd640 1 -- 172.21.15.18:0/1774678720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2294004d40 msgr2=0x7f22940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:29.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.753+0000 7f22a6ffd640 1 --2- 172.21.15.18:0/1774678720 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2294004d40 0x7f22940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:29.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.753+0000 7f22a6ffd640 1 -- 172.21.15.18:0/1774678720 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2294003520 con 0x7f22940039b0 2024-09-19T09:24:29.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.754+0000 7f22a6ffd640 1 --2- 172.21.15.18:0/1774678720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22940039b0 0x7f2294003dd0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f22a0009fc0 tx=0x7f2294005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b512e4f502a254bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:29.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.754+0000 7f22a5ffb640 1 -- 172.21.15.18:0/1774678720 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a0009c10 con 0x7f22940039b0 2024-09-19T09:24:29.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.754+0000 7f22a5ffb640 1 -- 172.21.15.18:0/1774678720 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22a0036070 con 0x7f22940039b0 2024-09-19T09:24:29.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.754+0000 7f22a5ffb640 1 -- 172.21.15.18:0/1774678720 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22a002d070 con 0x7f22940039b0 2024-09-19T09:24:29.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.755+0000 7f22ad7cf640 1 -- 172.21.15.18:0/1774678720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22940039b0 msgr2=0x7f2294003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:29.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.755+0000 7f22ad7cf640 1 --2- 172.21.15.18:0/1774678720 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22940039b0 0x7f2294003dd0 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f22a0009fc0 tx=0x7f2294005830 comp rx=0 tx=0).stop 2024-09-19T09:24:29.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.755+0000 7f22a77fe640 1 -- 172.21.15.18:0/1774678720 reap_dead start 2024-09-19T09:24:29.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.755+0000 7f22ad7cf640 1 -- 172.21.15.18:0/1774678720 shutdown_connections 2024-09-19T09:24:29.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.755+0000 7f22ad7cf640 1 -- 172.21.15.18:0/1774678720 >> 172.21.15.18:0/1774678720 conn(0x7f22a80b4560 msgr2=0x7f22a80b4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:29.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.755+0000 7f22ad7cf640 1 -- 172.21.15.18:0/1774678720 shutdown_connections 2024-09-19T09:24:29.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.755+0000 7f22ad7cf640 1 -- 172.21.15.18:0/1774678720 wait complete. 2024-09-19T09:24:29.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.756+0000 7f22ad7cf640 1 Processor -- start 2024-09-19T09:24:29.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.756+0000 7f22ad7cf640 1 -- start start 2024-09-19T09:24:29.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.757+0000 7f22ad7cf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22940039b0 0x7f22a8153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:29.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.757+0000 7f22ad7cf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22a8154210 0x7f22a80d2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:29.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.757+0000 7f22ad7cf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22a80af840 0x7f22a80d2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:29.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.757+0000 7f22ad7cf640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f22a81601b0 con 0x7f22a80af840 2024-09-19T09:24:29.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.757+0000 7f22ad7cf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f22a8160030 con 0x7f22940039b0 2024-09-19T09:24:29.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.757+0000 7f22ad7cf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f22a80d1ad0 con 0x7f22a8154210 2024-09-19T09:24:29.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.757+0000 7f22a77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22a80af840 0x7f22a80d2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:29.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.757+0000 7f22a77fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22a80af840 0x7f22a80d2e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52982/0 (socket says 172.21.15.18:52982) 2024-09-19T09:24:29.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.757+0000 7f22a77fe640 1 -- 172.21.15.18:0/3761217102 learned_addr learned my addr 172.21.15.18:0/3761217102 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:29.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.757+0000 7f22a6ffd640 1 --2- 172.21.15.18:0/3761217102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22940039b0 0x7f22a8153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:29.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.757+0000 7f22a67fc640 1 --2- 172.21.15.18:0/3761217102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22a8154210 0x7f22a80d2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:29.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.757+0000 7f22a77fe640 1 -- 172.21.15.18:0/3761217102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22a8154210 msgr2=0x7f22a80d2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:29.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.757+0000 7f22a77fe640 1 --2- 172.21.15.18:0/3761217102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22a8154210 0x7f22a80d2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:29.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.757+0000 7f22a77fe640 1 -- 172.21.15.18:0/3761217102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22940039b0 msgr2=0x7f22a8153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:29.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.757+0000 7f22a77fe640 1 --2- 172.21.15.18:0/3761217102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22940039b0 0x7f22a8153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:29.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.757+0000 7f22a77fe640 1 -- 172.21.15.18:0/3761217102 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a80c68b0 con 0x7f22a80af840 2024-09-19T09:24:29.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.757+0000 7f22a6ffd640 1 --2- 172.21.15.18:0/3761217102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22940039b0 0x7f22a8153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:29.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.757+0000 7f22a77fe640 1 --2- 172.21.15.18:0/3761217102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22a80af840 0x7f22a80d2e60 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f22a80b2240 tx=0x7f2298011920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:29.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.758+0000 7f229f7fe640 1 -- 172.21.15.18:0/3761217102 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2298019020 con 0x7f22a80af840 2024-09-19T09:24:29.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.758+0000 7f229f7fe640 1 -- 172.21.15.18:0/3761217102 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2298004440 con 0x7f22a80af840 2024-09-19T09:24:29.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.758+0000 7f22ad7cf640 1 -- 172.21.15.18:0/3761217102 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22a80c6b90 con 0x7f22a80af840 2024-09-19T09:24:29.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.758+0000 7f229f7fe640 1 -- 172.21.15.18:0/3761217102 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2298003810 con 0x7f22a80af840 2024-09-19T09:24:29.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.758+0000 7f22ad7cf640 1 -- 172.21.15.18:0/3761217102 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22a80c6560 con 0x7f22a80af840 2024-09-19T09:24:29.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.759+0000 7f22ad7cf640 1 -- 172.21.15.18:0/3761217102 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22a8162c30 con 0x7f22a80af840 2024-09-19T09:24:29.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.759+0000 7f229f7fe640 1 -- 172.21.15.18:0/3761217102 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f229801c020 con 0x7f22a80af840 2024-09-19T09:24:29.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.760+0000 7f229f7fe640 1 --2- 172.21.15.18:0/3761217102 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f228806c2e0 0x7f228806e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:29.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.760+0000 7f229f7fe640 1 -- 172.21.15.18:0/3761217102 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f229808b980 con 0x7f22a80af840 2024-09-19T09:24:29.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.760+0000 7f22a6ffd640 1 --2- 172.21.15.18:0/3761217102 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f228806c2e0 0x7f228806e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:29.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.761+0000 7f22a6ffd640 1 --2- 172.21.15.18:0/3761217102 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f228806c2e0 0x7f228806e7a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f22a0035000 tx=0x7f22a002f000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:29.766 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:29.764+0000 7f229f7fe640 1 -- 172.21.15.18:0/3761217102 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2298023020 con 0x7f22a80af840 2024-09-19T09:24:30.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.004+0000 7f22ad7cf640 1 -- 172.21.15.18:0/3761217102 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f22a80d2290 con 0x7f22a80af840 2024-09-19T09:24:30.007 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.007+0000 7f229f7fe640 1 -- 172.21.15.18:0/3761217102 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) ==== 190+0+147 (secure 0 0 0) 0x7f229805a0e0 con 0x7f22a80af840 2024-09-19T09:24:30.008 INFO:teuthology.orchestra.run.smithi018.stdout:[client.0] 2024-09-19T09:24:30.008 INFO:teuthology.orchestra.run.smithi018.stdout: key = AQAe6+tmcbwDNhAAaG0+wu96Locwws+h0zeh8Q== 2024-09-19T09:24:30.008 INFO:teuthology.orchestra.run.smithi018.stdout: caps mds = "allow" 2024-09-19T09:24:30.008 INFO:teuthology.orchestra.run.smithi018.stdout: caps mon = "allow r" 2024-09-19T09:24:30.008 INFO:teuthology.orchestra.run.smithi018.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-19T09:24:30.008 INFO:teuthology.orchestra.run.smithi018.stderr:updated caps for client.0 2024-09-19T09:24:30.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.009+0000 7f22ad7cf640 1 -- 172.21.15.18:0/3761217102 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f228806c2e0 msgr2=0x7f228806e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:30.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.009+0000 7f22ad7cf640 1 --2- 172.21.15.18:0/3761217102 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f228806c2e0 0x7f228806e7a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f22a0035000 tx=0x7f22a002f000 comp rx=0 tx=0).stop 2024-09-19T09:24:30.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.009+0000 7f22ad7cf640 1 -- 172.21.15.18:0/3761217102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22a80af840 msgr2=0x7f22a80d2e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:30.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.009+0000 7f22ad7cf640 1 --2- 172.21.15.18:0/3761217102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22a80af840 0x7f22a80d2e60 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f22a80b2240 tx=0x7f2298011920 comp rx=0 tx=0).stop 2024-09-19T09:24:30.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.009+0000 7f22ad7cf640 1 -- 172.21.15.18:0/3761217102 shutdown_connections 2024-09-19T09:24:30.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.009+0000 7f22ad7cf640 1 --2- 172.21.15.18:0/3761217102 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f228806c2e0 0x7f228806e7a0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.009+0000 7f22ad7cf640 1 --2- 172.21.15.18:0/3761217102 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f22a80af840 0x7f22a80d2e60 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.009+0000 7f22ad7cf640 1 --2- 172.21.15.18:0/3761217102 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f22a8154210 0x7f22a80d2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.009+0000 7f22ad7cf640 1 --2- 172.21.15.18:0/3761217102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f22940039b0 0x7f22a8153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.009+0000 7f22ad7cf640 1 -- 172.21.15.18:0/3761217102 >> 172.21.15.18:0/3761217102 conn(0x7f22a80b4560 msgr2=0x7f22a80b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:30.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.009+0000 7f22ad7cf640 1 -- 172.21.15.18:0/3761217102 shutdown_connections 2024-09-19T09:24:30.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.009+0000 7f22ad7cf640 1 -- 172.21.15.18:0/3761217102 wait complete. 2024-09-19T09:24:30.021 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:24:30.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.122+0000 7faab22ac640 1 Processor -- start 2024-09-19T09:24:30.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.122+0000 7faab22ac640 1 -- start start 2024-09-19T09:24:30.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.123+0000 7faab22ac640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faaac06bc10 0x7faaac06bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:30.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.123+0000 7faab22ac640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7faaac145e80 0x7faaac15d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:30.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.123+0000 7faab22ac640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaac06c530 con 0x7faaac0d1500 2024-09-19T09:24:30.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.123+0000 7faab22ac640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7faaac0704e0 con 0x7faaac145e80 2024-09-19T09:24:30.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.123+0000 7faab22ac640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faaac06e550 con 0x7faaac06bc10 2024-09-19T09:24:30.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.123+0000 7faaab7fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7faaac145e80 0x7faaac15d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:30.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.123+0000 7faaabfff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faaac06bc10 0x7faaac06bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:30.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.124+0000 7faaab7fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7faaac145e80 0x7faaac15d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:41406/0 (socket says 172.21.15.18:41406) 2024-09-19T09:24:30.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.124+0000 7faaab7fe640 1 -- 172.21.15.18:0/3759859681 learned_addr learned my addr 172.21.15.18:0/3759859681 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:30.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.124+0000 7faab0849640 1 --1- 172.21.15.18:0/3759859681 >> v1:172.21.15.162:6789/0 conn(0x7faaac0d1500 0x7faaac0d0240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:59768/0 (socket says 172.21.15.18:59768) 2024-09-19T09:24:30.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.124+0000 7faaabfff640 1 -- 172.21.15.18:0/3759859681 >> v2:172.21.15.162:3300/0 conn(0x7faaac145e80 msgr2=0x7faaac15d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:30.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.124+0000 7faaabfff640 1 --2- 172.21.15.18:0/3759859681 >> v2:172.21.15.162:3300/0 conn(0x7faaac145e80 0x7faaac15d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.124+0000 7faaabfff640 1 -- 172.21.15.18:0/3759859681 >> v1:172.21.15.162:6789/0 conn(0x7faaac0d1500 legacy=0x7faaac0d0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:30.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.124+0000 7faaabfff640 1 -- 172.21.15.18:0/3759859681 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaac06e830 con 0x7faaac06bc10 2024-09-19T09:24:30.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.124+0000 7faaab7fe640 1 --2- 172.21.15.18:0/3759859681 >> v2:172.21.15.162:3300/0 conn(0x7faaac145e80 0x7faaac15d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:24:30.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.125+0000 7faaabfff640 1 --2- 172.21.15.18:0/3759859681 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faaac06bc10 0x7faaac06bff0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7faa9c0097a0 tx=0x7faa9c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4c1ccaecbc7fe5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:30.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.125+0000 7faaaaffd640 1 -- 172.21.15.18:0/3759859681 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c037070 con 0x7faaac06bc10 2024-09-19T09:24:30.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.125+0000 7faaaaffd640 1 -- 172.21.15.18:0/3759859681 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa9c02ae50 con 0x7faaac06bc10 2024-09-19T09:24:30.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.125+0000 7faaaaffd640 1 -- 172.21.15.18:0/3759859681 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c032660 con 0x7faaac06bc10 2024-09-19T09:24:30.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.125+0000 7faab22ac640 1 -- 172.21.15.18:0/3759859681 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faaac06bc10 msgr2=0x7faaac06bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:30.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.125+0000 7faab22ac640 1 --2- 172.21.15.18:0/3759859681 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faaac06bc10 0x7faaac06bff0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7faa9c0097a0 tx=0x7faa9c02a100 comp rx=0 tx=0).stop 2024-09-19T09:24:30.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.125+0000 7faab22ac640 1 -- 172.21.15.18:0/3759859681 shutdown_connections 2024-09-19T09:24:30.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.125+0000 7faab22ac640 1 --2- 172.21.15.18:0/3759859681 >> v2:172.21.15.162:3300/0 conn(0x7faaac145e80 0x7faaac15d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.125+0000 7faab22ac640 1 --2- 172.21.15.18:0/3759859681 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faaac06bc10 0x7faaac06bff0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.125+0000 7faab22ac640 1 -- 172.21.15.18:0/3759859681 >> 172.21.15.18:0/3759859681 conn(0x7faaac06cd20 msgr2=0x7faaac06d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:30.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.125+0000 7faab22ac640 1 -- 172.21.15.18:0/3759859681 shutdown_connections 2024-09-19T09:24:30.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.126+0000 7faab22ac640 1 -- 172.21.15.18:0/3759859681 wait complete. 2024-09-19T09:24:30.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.127+0000 7faab22ac640 1 Processor -- start 2024-09-19T09:24:30.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.127+0000 7faab22ac640 1 -- start start 2024-09-19T09:24:30.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.128+0000 7faab22ac640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faaac06bc10 0x7faaac0ac430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:30.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.128+0000 7faab22ac640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faaac0d1500 0x7faaac15f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:30.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.128+0000 7faab22ac640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faaac145e80 0x7faaac15f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:30.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.128+0000 7faab22ac640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7faaac0b0f80 con 0x7faaac06bc10 2024-09-19T09:24:30.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.128+0000 7faab22ac640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7faaac0d0950 con 0x7faaac0d1500 2024-09-19T09:24:30.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.128+0000 7faab22ac640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7faaac06feb0 con 0x7faaac145e80 2024-09-19T09:24:30.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.128+0000 7faaabfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faaac06bc10 0x7faaac0ac430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:30.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.128+0000 7faaabfff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faaac06bc10 0x7faaac0ac430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:52998/0 (socket says 172.21.15.18:52998) 2024-09-19T09:24:30.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.128+0000 7faaabfff640 1 -- 172.21.15.18:0/2917273445 learned_addr learned my addr 172.21.15.18:0/2917273445 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:30.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.128+0000 7faaab7fe640 1 --2- 172.21.15.18:0/2917273445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faaac0d1500 0x7faaac15f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:30.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.128+0000 7faab0849640 1 --2- 172.21.15.18:0/2917273445 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faaac145e80 0x7faaac15f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:30.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.128+0000 7faaabfff640 1 -- 172.21.15.18:0/2917273445 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faaac145e80 msgr2=0x7faaac15f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:30.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.128+0000 7faaabfff640 1 --2- 172.21.15.18:0/2917273445 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faaac145e80 0x7faaac15f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.128+0000 7faaabfff640 1 -- 172.21.15.18:0/2917273445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faaac0d1500 msgr2=0x7faaac15f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:30.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.128+0000 7faaabfff640 1 --2- 172.21.15.18:0/2917273445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faaac0d1500 0x7faaac15f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.128+0000 7faaabfff640 1 -- 172.21.15.18:0/2917273445 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaac0acda0 con 0x7faaac06bc10 2024-09-19T09:24:30.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.128+0000 7faaabfff640 1 --2- 172.21.15.18:0/2917273445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faaac06bc10 0x7faaac0ac430 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7faa9c000c00 tx=0x7faa9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:30.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.128+0000 7faaa8ff9640 1 -- 172.21.15.18:0/2917273445 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c042070 con 0x7faaac06bc10 2024-09-19T09:24:30.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.128+0000 7faaa8ff9640 1 -- 172.21.15.18:0/2917273445 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa9c03e460 con 0x7faaac06bc10 2024-09-19T09:24:30.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.128+0000 7faab22ac640 1 -- 172.21.15.18:0/2917273445 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaac0ad080 con 0x7faaac06bc10 2024-09-19T09:24:30.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.128+0000 7faaa8ff9640 1 -- 172.21.15.18:0/2917273445 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa9c037040 con 0x7faaac06bc10 2024-09-19T09:24:30.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.128+0000 7faab22ac640 1 -- 172.21.15.18:0/2917273445 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaac0ad640 con 0x7faaac06bc10 2024-09-19T09:24:30.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.129+0000 7faab22ac640 1 -- 172.21.15.18:0/2917273445 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaac06d880 con 0x7faaac06bc10 2024-09-19T09:24:30.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.130+0000 7faaa8ff9640 1 -- 172.21.15.18:0/2917273445 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7faa9c045070 con 0x7faaac06bc10 2024-09-19T09:24:30.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.130+0000 7faaa8ff9640 1 --2- 172.21.15.18:0/2917273445 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faa9806c2b0 0x7faa9806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:30.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.130+0000 7faaa8ff9640 1 -- 172.21.15.18:0/2917273445 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7faa9c0abd50 con 0x7faaac06bc10 2024-09-19T09:24:30.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.131+0000 7faaab7fe640 1 --2- 172.21.15.18:0/2917273445 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faa9806c2b0 0x7faa9806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:30.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.131+0000 7faaab7fe640 1 --2- 172.21.15.18:0/2917273445 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faa9806c2b0 0x7faa9806e770 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7faaac0b0b60 tx=0x7faaa0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:30.135 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.135+0000 7faaa8ff9640 1 -- 172.21.15.18:0/2917273445 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7faa9c07a5e0 con 0x7faaac06bc10 2024-09-19T09:24:30.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.350+0000 7faab22ac640 1 -- 172.21.15.18:0/2917273445 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faaac1601b0 con 0x7faaac06bc10 2024-09-19T09:24:30.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.351+0000 7faaa8ff9640 1 -- 172.21.15.18:0/2917273445 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+5233 (secure 0 0 0) 0x7faa9c079ee0 con 0x7faaac06bc10 2024-09-19T09:24:30.352 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:24:30.352 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":82,"btime":"2024-09-19T09:24:28:275969+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1644566118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1644566118},{"type":"v1","addr":"172.21.15.162:6835","nonce":1644566118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3767901067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3767901067},{"type":"v1","addr":"172.21.15.162:6837","nonce":3767901067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7851,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1160903618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1160903618},{"type":"v1","addr":"172.21.15.18:6834","nonce":1160903618}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:24:25.526108+0000","modified":"2024-09-19T09:24:27.619787+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7854},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7854":{"gid":7854,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2545948137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2545948137},{"type":"v1","addr":"172.21.15.18:6835","nonce":2545948137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7854,"qdb_cluster":[7854]},"id":11}]} 2024-09-19T09:24:30.352 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 82 2024-09-19T09:24:30.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.353+0000 7faab22ac640 1 -- 172.21.15.18:0/2917273445 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faa9806c2b0 msgr2=0x7faa9806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:30.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.353+0000 7faab22ac640 1 --2- 172.21.15.18:0/2917273445 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faa9806c2b0 0x7faa9806e770 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7faaac0b0b60 tx=0x7faaa0008040 comp rx=0 tx=0).stop 2024-09-19T09:24:30.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.353+0000 7faab22ac640 1 -- 172.21.15.18:0/2917273445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faaac06bc10 msgr2=0x7faaac0ac430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:30.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.353+0000 7faab22ac640 1 --2- 172.21.15.18:0/2917273445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faaac06bc10 0x7faaac0ac430 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7faa9c000c00 tx=0x7faa9c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.353+0000 7faab22ac640 1 -- 172.21.15.18:0/2917273445 shutdown_connections 2024-09-19T09:24:30.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.353+0000 7faab22ac640 1 --2- 172.21.15.18:0/2917273445 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7faa9806c2b0 0x7faa9806e770 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.353+0000 7faab22ac640 1 --2- 172.21.15.18:0/2917273445 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7faaac145e80 0x7faaac15f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.353+0000 7faab22ac640 1 --2- 172.21.15.18:0/2917273445 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7faaac0d1500 0x7faaac15f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.353+0000 7faab22ac640 1 --2- 172.21.15.18:0/2917273445 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7faaac06bc10 0x7faaac0ac430 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.354 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.353+0000 7faab22ac640 1 -- 172.21.15.18:0/2917273445 >> 172.21.15.18:0/2917273445 conn(0x7faaac06cd20 msgr2=0x7faaac0b2f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:30.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.353+0000 7faab22ac640 1 -- 172.21.15.18:0/2917273445 shutdown_connections 2024-09-19T09:24:30.355 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.353+0000 7faab22ac640 1 -- 172.21.15.18:0/2917273445 wait complete. 2024-09-19T09:24:30.767 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 82, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-19T09:24:25.526108+0000', 'modified': '2024-09-19T09:24:27.619787+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7854}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7854': {'gid': 7854, 'name': 'a', 'rank': 0, 'incarnation': 79, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.18:6835/2545948137', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.18:6832', 'nonce': 2545948137}, {'type': 'v1', 'addr': '172.21.15.18:6835', 'nonce': 2545948137}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7854, 'qdb_cluster': [7854]} 2024-09-19T09:24:30.767 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-19T09:24:30.768 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-19T09:24:30.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.873+0000 7fe790c45640 1 Processor -- start 2024-09-19T09:24:30.874 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.873+0000 7fe790c45640 1 -- start start 2024-09-19T09:24:30.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.874+0000 7fe790c45640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe78c06d730 0x7fe78c0b7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:30.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.874+0000 7fe790c45640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe78c0b6290 0x7fe78c06db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:30.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.874+0000 7fe790c45640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe78c06e050 con 0x7fe78c1627a0 2024-09-19T09:24:30.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.874+0000 7fe790c45640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fe78c0b66d0 con 0x7fe78c06d730 2024-09-19T09:24:30.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.874+0000 7fe790c45640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe78c0b7890 con 0x7fe78c0b6290 2024-09-19T09:24:30.875 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.874+0000 7fe78a59c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe78c06d730 0x7fe78c0b7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:30.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.874+0000 7fe78a59c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe78c06d730 0x7fe78c0b7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53012/0 (socket says 172.21.15.18:53012) 2024-09-19T09:24:30.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.874+0000 7fe78a59c640 1 -- 172.21.15.18:0/805842723 learned_addr learned my addr 172.21.15.18:0/805842723 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:30.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.874+0000 7fe783fff640 1 --2- 172.21.15.18:0/805842723 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe78c0b6290 0x7fe78c06db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:30.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.874+0000 7fe78a59c640 1 -- 172.21.15.18:0/805842723 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe78c0b6290 msgr2=0x7fe78c06db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:30.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.874+0000 7fe78a59c640 1 --2- 172.21.15.18:0/805842723 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe78c0b6290 0x7fe78c06db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.874+0000 7fe78a59c640 1 -- 172.21.15.18:0/805842723 >> v1:172.21.15.162:6789/0 conn(0x7fe78c1627a0 legacy=0x7fe78c162c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:30.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.874+0000 7fe78a59c640 1 -- 172.21.15.18:0/805842723 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe78c0b7b70 con 0x7fe78c06d730 2024-09-19T09:24:30.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.875+0000 7fe78a59c640 1 --2- 172.21.15.18:0/805842723 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe78c06d730 0x7fe78c0b7270 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fe77c009870 tx=0x7fe77c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ade885b1c1a33962 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:30.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.875+0000 7fe789d9b640 1 -- 172.21.15.18:0/805842723 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77c037070 con 0x7fe78c06d730 2024-09-19T09:24:30.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.875+0000 7fe789d9b640 1 -- 172.21.15.18:0/805842723 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe77c032440 con 0x7fe78c06d730 2024-09-19T09:24:30.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.875+0000 7fe789d9b640 1 -- 172.21.15.18:0/805842723 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77c032810 con 0x7fe78c06d730 2024-09-19T09:24:30.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.876+0000 7fe790c45640 1 -- 172.21.15.18:0/805842723 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe78c06d730 msgr2=0x7fe78c0b7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:30.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.876+0000 7fe790c45640 1 --2- 172.21.15.18:0/805842723 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe78c06d730 0x7fe78c0b7270 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fe77c009870 tx=0x7fe77c02a210 comp rx=0 tx=0).stop 2024-09-19T09:24:30.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.876+0000 7fe790c45640 1 -- 172.21.15.18:0/805842723 shutdown_connections 2024-09-19T09:24:30.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.876+0000 7fe790c45640 1 --2- 172.21.15.18:0/805842723 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe78c0b6290 0x7fe78c06db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.876+0000 7fe790c45640 1 --2- 172.21.15.18:0/805842723 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe78c06d730 0x7fe78c0b7270 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.876+0000 7fe790c45640 1 -- 172.21.15.18:0/805842723 >> 172.21.15.18:0/805842723 conn(0x7fe78c0b7e10 msgr2=0x7fe78c0b8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:30.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.876+0000 7fe790c45640 1 -- 172.21.15.18:0/805842723 shutdown_connections 2024-09-19T09:24:30.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.876+0000 7fe790c45640 1 -- 172.21.15.18:0/805842723 wait complete. 2024-09-19T09:24:30.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.877+0000 7fe790c45640 1 Processor -- start 2024-09-19T09:24:30.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.877+0000 7fe790c45640 1 -- start start 2024-09-19T09:24:30.880 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.878+0000 7fe790c45640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe78c06d730 0x7fe78c1f5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:30.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.878+0000 7fe790c45640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe78c0b6290 0x7fe78c160ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:30.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.878+0000 7fe790c45640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe78c1627a0 0x7fe78c157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:30.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.878+0000 7fe790c45640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe78c0cc2d0 con 0x7fe78c1627a0 2024-09-19T09:24:30.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.878+0000 7fe790c45640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe78c0cbff0 con 0x7fe78c06d730 2024-09-19T09:24:30.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.878+0000 7fe790c45640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe78c0b4310 con 0x7fe78c0b6290 2024-09-19T09:24:30.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.878+0000 7fe78ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe78c1627a0 0x7fe78c157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:30.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.878+0000 7fe78ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe78c1627a0 0x7fe78c157330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53022/0 (socket says 172.21.15.18:53022) 2024-09-19T09:24:30.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.878+0000 7fe78ad9d640 1 -- 172.21.15.18:0/3329651963 learned_addr learned my addr 172.21.15.18:0/3329651963 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:30.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.878+0000 7fe783fff640 1 --2- 172.21.15.18:0/3329651963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe78c0b6290 0x7fe78c160ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:30.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.878+0000 7fe78a59c640 1 --2- 172.21.15.18:0/3329651963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe78c06d730 0x7fe78c1f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:30.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.879+0000 7fe78ad9d640 1 -- 172.21.15.18:0/3329651963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe78c0b6290 msgr2=0x7fe78c160ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:30.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.879+0000 7fe78ad9d640 1 --2- 172.21.15.18:0/3329651963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe78c0b6290 0x7fe78c160ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.879+0000 7fe78ad9d640 1 -- 172.21.15.18:0/3329651963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe78c06d730 msgr2=0x7fe78c1f5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:30.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.879+0000 7fe78ad9d640 1 --2- 172.21.15.18:0/3329651963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe78c06d730 0x7fe78c1f5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.879+0000 7fe78ad9d640 1 -- 172.21.15.18:0/3329651963 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe78c09cbf0 con 0x7fe78c1627a0 2024-09-19T09:24:30.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.879+0000 7fe78ad9d640 1 --2- 172.21.15.18:0/3329651963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe78c1627a0 0x7fe78c157330 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fe78400c780 tx=0x7fe78400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:30.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.879+0000 7fe782ffd640 1 -- 172.21.15.18:0/3329651963 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe784004b60 con 0x7fe78c1627a0 2024-09-19T09:24:30.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.879+0000 7fe782ffd640 1 -- 172.21.15.18:0/3329651963 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe784004d00 con 0x7fe78c1627a0 2024-09-19T09:24:30.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.879+0000 7fe790c45640 1 -- 172.21.15.18:0/3329651963 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe78c09ced0 con 0x7fe78c1627a0 2024-09-19T09:24:30.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.879+0000 7fe782ffd640 1 -- 172.21.15.18:0/3329651963 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78400aa90 con 0x7fe78c1627a0 2024-09-19T09:24:30.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.879+0000 7fe790c45640 1 -- 172.21.15.18:0/3329651963 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe78c09d490 con 0x7fe78c1627a0 2024-09-19T09:24:30.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.880+0000 7fe782ffd640 1 -- 172.21.15.18:0/3329651963 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe78400ac30 con 0x7fe78c1627a0 2024-09-19T09:24:30.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.881+0000 7fe782ffd640 1 --2- 172.21.15.18:0/3329651963 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe76c06c2b0 0x7fe76c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:30.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.881+0000 7fe782ffd640 1 -- 172.21.15.18:0/3329651963 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7fe78408b570 con 0x7fe78c1627a0 2024-09-19T09:24:30.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.881+0000 7fe78a59c640 1 --2- 172.21.15.18:0/3329651963 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe76c06c2b0 0x7fe76c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:30.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.882+0000 7fe78a59c640 1 --2- 172.21.15.18:0/3329651963 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe76c06c2b0 0x7fe76c06e770 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe77c034000 tx=0x7fe77c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:30.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.882+0000 7fe7939d9740 1 Processor -- start 2024-09-19T09:24:30.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.882+0000 7fe7939d9740 1 -- start start 2024-09-19T09:24:30.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.883+0000 7fe7939d9740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a5415032c0 0x55a541548a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:30.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.883+0000 7fe7939d9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a541500a80 0x55a5415036a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:30.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.883+0000 7fe7939d9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a541504a50 0x55a5414fd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:30.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.883+0000 7fe7939d9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a541465520 con 0x55a541500a80 2024-09-19T09:24:30.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.883+0000 7fe7939d9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a54140d3e0 con 0x55a541504a50 2024-09-19T09:24:30.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.883+0000 7fe7939d9740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55a5414614e0 con 0x55a5415032c0 2024-09-19T09:24:30.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.883+0000 7fe783fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a541500a80 0x55a5415036a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:30.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.883+0000 7fe783fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a541500a80 0x55a5415036a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53028/0 (socket says 172.21.15.18:53028) 2024-09-19T09:24:30.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.883+0000 7fe783fff640 1 -- 172.21.15.18:0/2363568714 learned_addr learned my addr 172.21.15.18:0/2363568714 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:30.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.883+0000 7fe78a59c640 1 --2- 172.21.15.18:0/2363568714 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a5415032c0 0x55a541548a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:30.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.883+0000 7fe78ad9d640 1 --2- 172.21.15.18:0/2363568714 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a541504a50 0x55a5414fd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:30.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.883+0000 7fe783fff640 1 -- 172.21.15.18:0/2363568714 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a5415032c0 msgr2=0x55a541548a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:30.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.883+0000 7fe783fff640 1 --2- 172.21.15.18:0/2363568714 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a5415032c0 0x55a541548a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.883+0000 7fe783fff640 1 -- 172.21.15.18:0/2363568714 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a541504a50 msgr2=0x55a5414fd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:30.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.883+0000 7fe783fff640 1 --2- 172.21.15.18:0/2363568714 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a541504a50 0x55a5414fd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.883+0000 7fe783fff640 1 -- 172.21.15.18:0/2363568714 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5414282f0 con 0x55a541500a80 2024-09-19T09:24:30.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.883+0000 7fe78ad9d640 1 --2- 172.21.15.18:0/2363568714 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a541504a50 0x55a5414fd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:30.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.884+0000 7fe783fff640 1 --2- 172.21.15.18:0/2363568714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a541500a80 0x55a5415036a0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fe774007880 tx=0x7fe774007d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2a36411bf7950e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:30.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.884+0000 7fe76bfff640 1 -- 172.21.15.18:0/2363568714 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe774018020 con 0x55a541500a80 2024-09-19T09:24:30.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.884+0000 7fe76bfff640 1 -- 172.21.15.18:0/2363568714 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe774004300 con 0x55a541500a80 2024-09-19T09:24:30.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.884+0000 7fe76bfff640 1 -- 172.21.15.18:0/2363568714 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe774010a50 con 0x55a541500a80 2024-09-19T09:24:30.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.884+0000 7fe7939d9740 1 -- 172.21.15.18:0/2363568714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a541500a80 msgr2=0x55a5415036a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:30.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.884+0000 7fe7939d9740 1 --2- 172.21.15.18:0/2363568714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a541500a80 0x55a5415036a0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fe774007880 tx=0x7fe774007d40 comp rx=0 tx=0).stop 2024-09-19T09:24:30.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.885+0000 7fe7939d9740 1 -- 172.21.15.18:0/2363568714 shutdown_connections 2024-09-19T09:24:30.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.885+0000 7fe7939d9740 1 --2- 172.21.15.18:0/2363568714 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a541504a50 0x55a5414fd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.885+0000 7fe7939d9740 1 --2- 172.21.15.18:0/2363568714 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a541500a80 0x55a5415036a0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.885+0000 7fe7939d9740 1 --2- 172.21.15.18:0/2363568714 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a5415032c0 0x55a541548a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.885+0000 7fe7939d9740 1 -- 172.21.15.18:0/2363568714 >> 172.21.15.18:0/2363568714 conn(0x55a5414ffa80 msgr2=0x55a541547f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:30.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.885+0000 7fe7939d9740 1 -- 172.21.15.18:0/2363568714 shutdown_connections 2024-09-19T09:24:30.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.885+0000 7fe7939d9740 1 -- 172.21.15.18:0/2363568714 wait complete. 2024-09-19T09:24:30.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.885+0000 7fe7939d9740 1 -- start start 2024-09-19T09:24:30.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.885+0000 7fe7939d9740 1 Processor -- start 2024-09-19T09:24:30.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.886+0000 7fe7939d9740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a5415032c0 0x55a54151f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:30.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.886+0000 7fe7939d9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a541504a50 0x55a54152b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:30.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.886+0000 7fe7939d9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a54152d8f0 0x55a54152ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:30.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.886+0000 7fe7939d9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a5414fef20 con 0x55a54152d8f0 2024-09-19T09:24:30.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.886+0000 7fe7939d9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a5413ee450 con 0x55a541504a50 2024-09-19T09:24:30.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.886+0000 7fe7939d9740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55a541549290 con 0x55a5415032c0 2024-09-19T09:24:30.892 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.886+0000 7fe7939d9740 10 client.0 _ll_register_callbacks cb 0x55a541177ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:30.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.886+0000 7fe78ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a54152d8f0 0x55a54152ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:30.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.886+0000 7fe78ad9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a54152d8f0 0x55a54152ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53036/0 (socket says 172.21.15.18:53036) 2024-09-19T09:24:30.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.886+0000 7fe78ad9d640 1 -- 172.21.15.18:0/2045708576 learned_addr learned my addr 172.21.15.18:0/2045708576 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:30.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.886+0000 7fe78a59c640 1 --2- 172.21.15.18:0/2045708576 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a5415032c0 0x55a54151f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:30.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.886+0000 7fe783fff640 1 --2- 172.21.15.18:0/2045708576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a541504a50 0x55a54152b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:30.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.887+0000 7fe78ad9d640 1 -- 172.21.15.18:0/2045708576 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a5415032c0 msgr2=0x55a54151f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:30.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.887+0000 7fe78ad9d640 1 --2- 172.21.15.18:0/2045708576 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a5415032c0 0x55a54151f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.887+0000 7fe78ad9d640 1 -- 172.21.15.18:0/2045708576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a541504a50 msgr2=0x55a54152b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:30.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.887+0000 7fe78ad9d640 1 --2- 172.21.15.18:0/2045708576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a541504a50 0x55a54152b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.887+0000 7fe78ad9d640 1 -- 172.21.15.18:0/2045708576 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5411782d0 con 0x55a54152d8f0 2024-09-19T09:24:30.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.887+0000 7fe78ad9d640 1 --2- 172.21.15.18:0/2045708576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a54152d8f0 0x55a54152ba60 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fe784089b50 tx=0x7fe78405dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af212e0c9a2a75f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:30.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.887+0000 7fe7697fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:24:30.893 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.887+0000 7fe7697fa640 1 -- 172.21.15.18:0/2045708576 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe784061fc0 con 0x55a54152d8f0 2024-09-19T09:24:30.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.887+0000 7fe7697fa640 1 -- 172.21.15.18:0/2045708576 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7fe78405ebb0 con 0x55a54152d8f0 2024-09-19T09:24:30.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.887+0000 7fe7939d9740 1 -- 172.21.15.18:0/2045708576 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe774004300 con 0x55a54152d8f0 2024-09-19T09:24:30.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.887+0000 7fe7697fa640 1 -- 172.21.15.18:0/2045708576 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fe784057ae0 con 0x55a54152d8f0 2024-09-19T09:24:30.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.887+0000 7fe7939d9740 10 client.7974 fetch_fsmap learned FSMap version 82 2024-09-19T09:24:30.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.887+0000 7fe7939d9740 1 -- 172.21.15.18:0/2045708576 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=2+}) -- 0x55a5412426b0 con 0x55a54152d8f0 2024-09-19T09:24:30.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.887+0000 7fe7697fa640 1 -- 172.21.15.18:0/2045708576 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe774004300 con 0x55a54152d8f0 2024-09-19T09:24:30.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.887+0000 7fe7697fa640 1 -- 172.21.15.18:0/2045708576 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 82) ==== 3502+0+0 (secure 0 0 0) 0x7fe78408b0e0 con 0x55a54152d8f0 2024-09-19T09:24:30.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.887+0000 7fe7939d9740 10 client.7974 fetch_fsmap finished waiting for FSMap version 82 2024-09-19T09:24:30.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.887+0000 7fe7939d9740 10 client.7974 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T09:24:30.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.887+0000 7fe7939d9740 20 client.7974 populate_metadata read hostname 'smithi018' 2024-09-19T09:24:30.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.887+0000 7fe7939d9740 1 --2- 172.21.15.18:0/2045708576 >> [v2:172.21.15.18:6832/2545948137,v1:172.21.15.18:6835/2545948137] conn(0x55a5414fd3c0 0x55a5414fd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:30.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.887+0000 7fe7939d9740 4 client.7974 mds_command: new command op to 7854 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:24:30.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.887+0000 7fe7939d9740 1 -- 172.21.15.18:0/2045708576 --> [v2:172.21.15.18:6832/2545948137,v1:172.21.15.18:6835/2545948137] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a541472c50 con 0x55a5414fd3c0 2024-09-19T09:24:30.894 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.888+0000 7fe78a59c640 1 --2- 172.21.15.18:0/2045708576 >> [v2:172.21.15.18:6832/2545948137,v1:172.21.15.18:6835/2545948137] conn(0x55a5414fd3c0 0x55a5414fd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:30.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.888+0000 7fe7697fa640 10 client.7974 ms_handle_connect on v2:172.21.15.18:6832/2545948137 2024-09-19T09:24:30.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.888+0000 7fe78a59c640 1 --2- 172.21.15.18:0/2045708576 >> [v2:172.21.15.18:6832/2545948137,v1:172.21.15.18:6835/2545948137] conn(0x55a5414fd3c0 0x55a5414fd7a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed2727af96a5969 server_cookie=fad1b00b4db6993d in_seq=0 out_seq=0 2024-09-19T09:24:30.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.889+0000 7fe7697fa640 1 -- 172.21.15.18:0/2045708576 <== mds.0 v2:172.21.15.18:6832/2545948137 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a541472c50 con 0x55a5414fd3c0 2024-09-19T09:24:30.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.889+0000 7fe7697fa640 10 client.7974 handle_command_reply: tid=0 2024-09-19T09:24:30.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.889+0000 7fe7939d9740 1 client.7974 shutdown 2024-09-19T09:24:30.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.889+0000 7fe7939d9740 1 -- 172.21.15.18:0/2045708576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a54152d8f0 msgr2=0x55a54152ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:30.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.889+0000 7fe7939d9740 1 --2- 172.21.15.18:0/2045708576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a54152d8f0 0x55a54152ba60 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fe784089b50 tx=0x7fe78405dae0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.889+0000 7fe7939d9740 1 -- 172.21.15.18:0/2045708576 shutdown_connections 2024-09-19T09:24:30.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.889+0000 7fe7939d9740 1 --2- 172.21.15.18:0/2045708576 >> [v2:172.21.15.18:6832/2545948137,v1:172.21.15.18:6835/2545948137] conn(0x55a5414fd3c0 0x55a5414fd7a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.889+0000 7fe7939d9740 1 --2- 172.21.15.18:0/2045708576 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a54152d8f0 0x55a54152ba60 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.889+0000 7fe7939d9740 1 --2- 172.21.15.18:0/2045708576 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a541504a50 0x55a54152b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.889+0000 7fe7939d9740 1 --2- 172.21.15.18:0/2045708576 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a5415032c0 0x55a54151f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.889+0000 7fe7697fa640 0 client.7974 ms_handle_reset on v2:172.21.15.18:6832/2545948137 2024-09-19T09:24:30.895 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.889+0000 7fe7939d9740 1 -- 172.21.15.18:0/2045708576 >> 172.21.15.18:0/2045708576 conn(0x55a541500a80 msgr2=0x55a541545fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:30.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.889+0000 7fe7939d9740 1 -- 172.21.15.18:0/2045708576 shutdown_connections 2024-09-19T09:24:30.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.889+0000 7fe7939d9740 1 -- 172.21.15.18:0/2045708576 wait complete. 2024-09-19T09:24:30.896 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.889+0000 7fe7939d9740 20 client.7974 trim_cache size 0 max 16384 2024-09-19T09:24:30.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.907+0000 7fe7939d9740 1 Processor -- start 2024-09-19T09:24:30.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.907+0000 7fe7939d9740 1 -- start start 2024-09-19T09:24:30.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.908+0000 7fe7939d9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5415032c0 0x55a5415467b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:30.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.908+0000 7fe7939d9740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a541504a50 0x55a541547f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:30.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.908+0000 7fe7939d9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a54152d8f0 0x55a541548440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:30.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.908+0000 7fe7939d9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe78c09e650 con 0x55a5415032c0 2024-09-19T09:24:30.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.908+0000 7fe7939d9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe78c09d9b0 con 0x55a54152d8f0 2024-09-19T09:24:30.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.908+0000 7fe7939d9740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe78c09e000 con 0x55a541504a50 2024-09-19T09:24:30.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.908+0000 7fe78a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5415032c0 0x55a5415467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:30.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.908+0000 7fe78a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5415032c0 0x55a5415467b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53044/0 (socket says 172.21.15.18:53044) 2024-09-19T09:24:30.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.908+0000 7fe78a59c640 1 -- 172.21.15.18:0/2522030521 learned_addr learned my addr 172.21.15.18:0/2522030521 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:30.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.908+0000 7fe78a59c640 1 -- 172.21.15.18:0/2522030521 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a541504a50 msgr2=0x55a541547f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:30.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.908+0000 7fe78a59c640 1 --2- 172.21.15.18:0/2522030521 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a541504a50 0x55a541547f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.908+0000 7fe78a59c640 1 -- 172.21.15.18:0/2522030521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a54152d8f0 msgr2=0x55a541548440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:30.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.908+0000 7fe78a59c640 1 --2- 172.21.15.18:0/2522030521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a54152d8f0 0x55a541548440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.908+0000 7fe78a59c640 1 -- 172.21.15.18:0/2522030521 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5414fe220 con 0x55a5415032c0 2024-09-19T09:24:30.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.908+0000 7fe78a59c640 1 --2- 172.21.15.18:0/2522030521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5415032c0 0x55a5415467b0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fe77c009870 tx=0x7fe77c008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a5d5898c353ff0d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:30.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.909+0000 7fe76b7fe640 1 -- 172.21.15.18:0/2522030521 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77c037040 con 0x55a5415032c0 2024-09-19T09:24:30.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.909+0000 7fe76b7fe640 1 -- 172.21.15.18:0/2522030521 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe77c032c80 con 0x55a5415032c0 2024-09-19T09:24:30.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.909+0000 7fe76b7fe640 1 -- 172.21.15.18:0/2522030521 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77c053650 con 0x55a5415032c0 2024-09-19T09:24:30.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.909+0000 7fe7939d9740 1 -- 172.21.15.18:0/2522030521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5415032c0 msgr2=0x55a5415467b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:30.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.909+0000 7fe7939d9740 1 --2- 172.21.15.18:0/2522030521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5415032c0 0x55a5415467b0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7fe77c009870 tx=0x7fe77c008030 comp rx=0 tx=0).stop 2024-09-19T09:24:30.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.909+0000 7fe7939d9740 1 -- 172.21.15.18:0/2522030521 shutdown_connections 2024-09-19T09:24:30.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.909+0000 7fe7939d9740 1 --2- 172.21.15.18:0/2522030521 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a54152d8f0 0x55a541548440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.909+0000 7fe7939d9740 1 --2- 172.21.15.18:0/2522030521 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a541504a50 0x55a541547f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.909+0000 7fe7939d9740 1 --2- 172.21.15.18:0/2522030521 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5415032c0 0x55a5415467b0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.909+0000 7fe7939d9740 1 -- 172.21.15.18:0/2522030521 >> 172.21.15.18:0/2522030521 conn(0x55a541500a80 msgr2=0x55a54152c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:30.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.909+0000 7fe7939d9740 1 -- 172.21.15.18:0/2522030521 shutdown_connections 2024-09-19T09:24:30.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.909+0000 7fe7939d9740 1 -- 172.21.15.18:0/2522030521 wait complete. 2024-09-19T09:24:30.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.910+0000 7fe7939d9740 1 -- start start 2024-09-19T09:24:30.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.910+0000 7fe7939d9740 1 Processor -- start 2024-09-19T09:24:30.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.911+0000 7fe7939d9740 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5415032c0 0x55a5415c4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:30.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.911+0000 7fe7939d9740 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a541504a50 0x55a54156ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:30.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.911+0000 7fe7939d9740 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a54152d8f0 0x55a54156b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:30.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.911+0000 7fe7939d9740 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x55a54154ed90 con 0x55a5415032c0 2024-09-19T09:24:30.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.911+0000 7fe7939d9740 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55a5414fe440 con 0x55a541504a50 2024-09-19T09:24:30.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.911+0000 7fe7939d9740 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x55a54151f9c0 con 0x55a54152d8f0 2024-09-19T09:24:30.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.911+0000 7fe7939d9740 10 client.0 _ll_register_callbacks cb 0x7fe7840559c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:24:30.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.911+0000 7fe78a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5415032c0 0x55a5415c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:30.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.911+0000 7fe78a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5415032c0 0x55a5415c4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53052/0 (socket says 172.21.15.18:53052) 2024-09-19T09:24:30.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.911+0000 7fe78a59c640 1 -- 172.21.15.18:0/3924393230 learned_addr learned my addr 172.21.15.18:0/3924393230 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:30.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.911+0000 7fe783fff640 1 --2- 172.21.15.18:0/3924393230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a541504a50 0x55a54156ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:30.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.911+0000 7fe78ad9d640 1 --2- 172.21.15.18:0/3924393230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a54152d8f0 0x55a54156b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:30.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.911+0000 7fe78a59c640 1 -- 172.21.15.18:0/3924393230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a54152d8f0 msgr2=0x55a54156b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:30.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.911+0000 7fe78a59c640 1 --2- 172.21.15.18:0/3924393230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a54152d8f0 0x55a54156b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.911+0000 7fe78a59c640 1 -- 172.21.15.18:0/3924393230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a541504a50 msgr2=0x55a54156ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:30.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.911+0000 7fe78a59c640 1 --2- 172.21.15.18:0/3924393230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a541504a50 0x55a54156ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.911+0000 7fe78a59c640 1 -- 172.21.15.18:0/3924393230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a541502490 con 0x55a5415032c0 2024-09-19T09:24:30.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.911+0000 7fe78a59c640 1 --2- 172.21.15.18:0/3924393230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5415032c0 0x55a5415c4440 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fe77c035040 tx=0x7fe77c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d855e61afd97c333 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:30.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.911+0000 7fe7697fa640 10 client.0 ms_handle_connect on v2:172.21.15.18:3300/0 2024-09-19T09:24:30.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.911+0000 7fe7697fa640 1 -- 172.21.15.18:0/3924393230 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77c037070 con 0x55a5415032c0 2024-09-19T09:24:30.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.911+0000 7fe7697fa640 1 -- 172.21.15.18:0/3924393230 <== mon.0 v2:172.21.15.18:3300/0 2 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7fe77c004240 con 0x55a5415032c0 2024-09-19T09:24:30.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.911+0000 7fe7939d9740 1 -- 172.21.15.18:0/3924393230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe77c032c80 con 0x55a5415032c0 2024-09-19T09:24:30.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.912+0000 7fe7697fa640 1 -- 172.21.15.18:0/3924393230 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fe77c06a050 con 0x55a5415032c0 2024-09-19T09:24:30.917 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.912+0000 7fe7939d9740 10 client.7980 fetch_fsmap learned FSMap version 82 2024-09-19T09:24:30.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.912+0000 7fe7939d9740 1 -- 172.21.15.18:0/3924393230 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=2+}) -- 0x55a5415c7620 con 0x55a5415032c0 2024-09-19T09:24:30.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.912+0000 7fe7697fa640 1 -- 172.21.15.18:0/3924393230 <== mon.0 v2:172.21.15.18:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe77c032c80 con 0x55a5415032c0 2024-09-19T09:24:30.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.912+0000 7fe7697fa640 1 -- 172.21.15.18:0/3924393230 <== mon.0 v2:172.21.15.18:3300/0 5 ==== fsmap(e 82) ==== 3502+0+0 (secure 0 0 0) 0x7fe77c06d020 con 0x55a5415032c0 2024-09-19T09:24:30.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.912+0000 7fe7939d9740 10 client.7980 fetch_fsmap finished waiting for FSMap version 82 2024-09-19T09:24:30.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.912+0000 7fe7939d9740 10 client.7980 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-19T09:24:30.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.912+0000 7fe7939d9740 20 client.7980 populate_metadata read hostname 'smithi018' 2024-09-19T09:24:30.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.912+0000 7fe7939d9740 1 --2- 172.21.15.18:0/3924393230 >> [v2:172.21.15.18:6832/2545948137,v1:172.21.15.18:6835/2545948137] conn(0x55a54152b0e0 0x55a541521c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:30.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.912+0000 7fe7939d9740 4 client.7980 mds_command: new command op to 7854 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T09:24:30.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.912+0000 7fe7939d9740 1 -- 172.21.15.18:0/3924393230 --> [v2:172.21.15.18:6832/2545948137,v1:172.21.15.18:6835/2545948137] -- command(tid 0: {"prefix": "status"}) -- 0x55a54146cfa0 con 0x55a54152b0e0 2024-09-19T09:24:30.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.912+0000 7fe783fff640 1 --2- 172.21.15.18:0/3924393230 >> [v2:172.21.15.18:6832/2545948137,v1:172.21.15.18:6835/2545948137] conn(0x55a54152b0e0 0x55a541521c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:30.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.912+0000 7fe783fff640 1 --2- 172.21.15.18:0/3924393230 >> [v2:172.21.15.18:6832/2545948137,v1:172.21.15.18:6835/2545948137] conn(0x55a54152b0e0 0x55a541521c00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68e7105a902abd82 server_cookie=37b5d8f228958a0b in_seq=0 out_seq=0 2024-09-19T09:24:30.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.912+0000 7fe7697fa640 10 client.7980 ms_handle_connect on v2:172.21.15.18:6832/2545948137 2024-09-19T09:24:30.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.913+0000 7fe7697fa640 1 -- 172.21.15.18:0/3924393230 <== mds.0 v2:172.21.15.18:6832/2545948137 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55a54146cfa0 con 0x55a54152b0e0 2024-09-19T09:24:30.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.913+0000 7fe7697fa640 10 client.7980 handle_command_reply: tid=0 2024-09-19T09:24:30.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.913+0000 7fe7939d9740 1 client.7980 shutdown 2024-09-19T09:24:30.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.913+0000 7fe7939d9740 1 -- 172.21.15.18:0/3924393230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5415032c0 msgr2=0x55a5415c4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:30.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.913+0000 7fe7939d9740 1 --2- 172.21.15.18:0/3924393230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5415032c0 0x55a5415c4440 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7fe77c035040 tx=0x7fe77c004730 comp rx=0 tx=0).stop 2024-09-19T09:24:30.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.913+0000 7fe7939d9740 1 -- 172.21.15.18:0/3924393230 shutdown_connections 2024-09-19T09:24:30.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.913+0000 7fe7939d9740 1 --2- 172.21.15.18:0/3924393230 >> [v2:172.21.15.18:6832/2545948137,v1:172.21.15.18:6835/2545948137] conn(0x55a54152b0e0 0x55a541521c00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.913+0000 7fe7939d9740 1 --2- 172.21.15.18:0/3924393230 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x55a54152d8f0 0x55a54156b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.913+0000 7fe7939d9740 1 --2- 172.21.15.18:0/3924393230 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55a541504a50 0x55a54156ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.913+0000 7fe7697fa640 0 client.7980 ms_handle_reset on v2:172.21.15.18:6832/2545948137 2024-09-19T09:24:30.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.913+0000 7fe7939d9740 1 --2- 172.21.15.18:0/3924393230 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x55a5415032c0 0x55a5415c4440 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.913+0000 7fe7939d9740 1 -- 172.21.15.18:0/3924393230 >> 172.21.15.18:0/3924393230 conn(0x55a541500a80 msgr2=0x55a54151efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:30.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.913+0000 7fe7939d9740 1 -- 172.21.15.18:0/3924393230 shutdown_connections 2024-09-19T09:24:30.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.913+0000 7fe7939d9740 1 -- 172.21.15.18:0/3924393230 wait complete. 2024-09-19T09:24:30.919 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.913+0000 7fe7939d9740 20 client.7980 trim_cache size 0 max 16384 2024-09-19T09:24:30.920 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:24:30.920 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:24:30.920 INFO:teuthology.orchestra.run.smithi018.stdout: "whoami": 0, 2024-09-19T09:24:30.920 INFO:teuthology.orchestra.run.smithi018.stdout: "id": 7854, 2024-09-19T09:24:30.920 INFO:teuthology.orchestra.run.smithi018.stdout: "want_state": "up:active", 2024-09-19T09:24:30.920 INFO:teuthology.orchestra.run.smithi018.stdout: "state": "up:active", 2024-09-19T09:24:30.920 INFO:teuthology.orchestra.run.smithi018.stdout: "fs_name": "cephfs", 2024-09-19T09:24:30.920 INFO:teuthology.orchestra.run.smithi018.stdout: "rank_uptime": 4.7238602810000003, 2024-09-19T09:24:30.920 INFO:teuthology.orchestra.run.smithi018.stdout: "mdsmap_epoch": 82, 2024-09-19T09:24:30.920 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch": 182, 2024-09-19T09:24:30.920 INFO:teuthology.orchestra.run.smithi018.stdout: "osdmap_epoch_barrier": 182, 2024-09-19T09:24:30.920 INFO:teuthology.orchestra.run.smithi018.stdout: "uptime": 9.7598992560000006 2024-09-19T09:24:30.921 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:24:30.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.913+0000 7fe790c45640 1 -- 172.21.15.18:0/3329651963 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe76c06c2b0 msgr2=0x7fe76c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:30.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.913+0000 7fe790c45640 1 --2- 172.21.15.18:0/3329651963 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe76c06c2b0 0x7fe76c06e770 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fe77c034000 tx=0x7fe77c02e000 comp rx=0 tx=0).stop 2024-09-19T09:24:30.921 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.913+0000 7fe790c45640 1 -- 172.21.15.18:0/3329651963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe78c1627a0 msgr2=0x7fe78c157330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:30.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.913+0000 7fe790c45640 1 --2- 172.21.15.18:0/3329651963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe78c1627a0 0x7fe78c157330 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fe78400c780 tx=0x7fe78400cc40 comp rx=0 tx=0).stop 2024-09-19T09:24:30.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.913+0000 7fe790c45640 1 -- 172.21.15.18:0/3329651963 shutdown_connections 2024-09-19T09:24:30.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.913+0000 7fe790c45640 1 --2- 172.21.15.18:0/3329651963 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe76c06c2b0 0x7fe76c06e770 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.914+0000 7fe790c45640 1 --2- 172.21.15.18:0/3329651963 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe78c1627a0 0x7fe78c157330 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.914+0000 7fe790c45640 1 --2- 172.21.15.18:0/3329651963 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe78c0b6290 0x7fe78c160ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.914+0000 7fe790c45640 1 --2- 172.21.15.18:0/3329651963 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe78c06d730 0x7fe78c1f5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:30.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.914+0000 7fe790c45640 1 -- 172.21.15.18:0/3329651963 >> 172.21.15.18:0/3329651963 conn(0x7fe78c0b7e10 msgr2=0x7fe78c15e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:30.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.914+0000 7fe790c45640 1 -- 172.21.15.18:0/3329651963 shutdown_connections 2024-09-19T09:24:30.922 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:30.914+0000 7fe790c45640 1 -- 172.21.15.18:0/3329651963 wait complete. 2024-09-19T09:24:30.925 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T09:24:31.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.026+0000 7fe92088c640 1 Processor -- start 2024-09-19T09:24:31.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.026+0000 7fe92088c640 1 -- start start 2024-09-19T09:24:31.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.027+0000 7fe92088c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe91c0d1ab0 0x7fe91c0b8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:31.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.027+0000 7fe92088c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe91c0d3240 0x7fe91c0b8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:31.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.027+0000 7fe92088c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe91c0b7a90 con 0x7fe91c15ef50 2024-09-19T09:24:31.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.027+0000 7fe92088c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe91c0d3740 con 0x7fe91c0d1ab0 2024-09-19T09:24:31.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.027+0000 7fe92088c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe91c0d3a20 con 0x7fe91c0d3240 2024-09-19T09:24:31.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.027+0000 7fe91a59c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fe91c15ef50 0x7fe91c0d13a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44738/0 (socket says 172.21.15.18:44738) 2024-09-19T09:24:31.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.027+0000 7fe91a59c640 1 -- 172.21.15.18:0/2522562803 learned_addr learned my addr 172.21.15.18:0/2522562803 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:24:31.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.028+0000 7fe91959a640 1 -- 172.21.15.18:0/2522562803 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1223467581 0 0) 0x7fe91c0b7a90 con 0x7fe91c15ef50 2024-09-19T09:24:31.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.028+0000 7fe91959a640 1 -- 172.21.15.18:0/2522562803 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe908003520 con 0x7fe91c15ef50 2024-09-19T09:24:31.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.028+0000 7fe919d9b640 1 --2- 172.21.15.18:0/2522562803 >> v2:172.21.15.162:3300/0 conn(0x7fe91c0d1ab0 0x7fe91c0b8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:31.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.028+0000 7fe91ad9d640 1 --2- 172.21.15.18:0/2522562803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe91c0d3240 0x7fe91c0b8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:31.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.028+0000 7fe91959a640 1 -- 172.21.15.18:0/2522562803 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3170019333 0 0) 0x7fe908003520 con 0x7fe91c15ef50 2024-09-19T09:24:31.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.028+0000 7fe91959a640 1 -- 172.21.15.18:0/2522562803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe91c0d3240 msgr2=0x7fe91c0b8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:31.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.028+0000 7fe91959a640 1 --2- 172.21.15.18:0/2522562803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe91c0d3240 0x7fe91c0b8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:31.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.028+0000 7fe91959a640 1 -- 172.21.15.18:0/2522562803 >> v2:172.21.15.162:3300/0 conn(0x7fe91c0d1ab0 msgr2=0x7fe91c0b8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:31.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.028+0000 7fe91959a640 1 --2- 172.21.15.18:0/2522562803 >> v2:172.21.15.162:3300/0 conn(0x7fe91c0d1ab0 0x7fe91c0b8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:31.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.028+0000 7fe91959a640 1 -- 172.21.15.18:0/2522562803 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe91c0b7d00 con 0x7fe91c15ef50 2024-09-19T09:24:31.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.028+0000 7fe91959a640 1 -- 172.21.15.18:0/2522562803 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fe9140019f0 con 0x7fe91c15ef50 2024-09-19T09:24:31.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.028+0000 7fe91959a640 1 -- 172.21.15.18:0/2522562803 >> v1:172.21.15.18:6789/0 conn(0x7fe91c15ef50 legacy=0x7fe91c0d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:31.032 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.028+0000 7fe91959a640 1 --2- 172.21.15.18:0/2522562803 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9080039b0 0x7fe908003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:31.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.028+0000 7fe91959a640 1 --2- 172.21.15.18:0/2522562803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe91c0d3240 0x7fe908004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:31.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.028+0000 7fe91959a640 1 --2- 172.21.15.18:0/2522562803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe908004d40 0x7fe9080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:31.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.028+0000 7fe91959a640 1 -- 172.21.15.18:0/2522562803 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe91c0d3740 con 0x7fe9080039b0 2024-09-19T09:24:31.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.028+0000 7fe91959a640 1 -- 172.21.15.18:0/2522562803 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe91c0d3a20 con 0x7fe908004d40 2024-09-19T09:24:31.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.028+0000 7fe91959a640 1 -- 172.21.15.18:0/2522562803 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe90800b9c0 con 0x7fe91c0d3240 2024-09-19T09:24:31.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.028+0000 7fe91a59c640 1 --2- 172.21.15.18:0/2522562803 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9080039b0 0x7fe908003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:31.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.028+0000 7fe91ad9d640 1 --2- 172.21.15.18:0/2522562803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe908004d40 0x7fe9080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:31.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.028+0000 7fe919d9b640 1 --2- 172.21.15.18:0/2522562803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe91c0d3240 0x7fe908004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:31.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.029+0000 7fe91a59c640 1 -- 172.21.15.18:0/2522562803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe91c0d3240 msgr2=0x7fe908004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:31.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.029+0000 7fe91a59c640 1 --2- 172.21.15.18:0/2522562803 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe91c0d3240 0x7fe908004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:31.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.029+0000 7fe91a59c640 1 -- 172.21.15.18:0/2522562803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe908004d40 msgr2=0x7fe9080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:31.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.029+0000 7fe91a59c640 1 --2- 172.21.15.18:0/2522562803 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe908004d40 0x7fe9080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:31.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.029+0000 7fe91a59c640 1 -- 172.21.15.18:0/2522562803 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe908003520 con 0x7fe9080039b0 2024-09-19T09:24:31.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.029+0000 7fe91a59c640 1 --2- 172.21.15.18:0/2522562803 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9080039b0 0x7fe908003dd0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fe9140013d0 tx=0x7fe908005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9432dd74de094661 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:31.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.030+0000 7fe91959a640 1 -- 172.21.15.18:0/2522562803 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91400a4e0 con 0x7fe9080039b0 2024-09-19T09:24:31.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.030+0000 7fe91959a640 1 -- 172.21.15.18:0/2522562803 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe91402f070 con 0x7fe9080039b0 2024-09-19T09:24:31.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.030+0000 7fe91959a640 1 -- 172.21.15.18:0/2522562803 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91402bce0 con 0x7fe9080039b0 2024-09-19T09:24:31.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.030+0000 7fe92088c640 1 -- 172.21.15.18:0/2522562803 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9080039b0 msgr2=0x7fe908003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:31.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.030+0000 7fe92088c640 1 --2- 172.21.15.18:0/2522562803 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9080039b0 0x7fe908003dd0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fe9140013d0 tx=0x7fe908005830 comp rx=0 tx=0).stop 2024-09-19T09:24:31.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.030+0000 7fe91ad9d640 1 -- 172.21.15.18:0/2522562803 reap_dead start 2024-09-19T09:24:31.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.030+0000 7fe92088c640 1 -- 172.21.15.18:0/2522562803 shutdown_connections 2024-09-19T09:24:31.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.030+0000 7fe92088c640 1 -- 172.21.15.18:0/2522562803 >> 172.21.15.18:0/2522562803 conn(0x7fe91c0d4c60 msgr2=0x7fe91c0d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:31.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.030+0000 7fe92088c640 1 -- 172.21.15.18:0/2522562803 shutdown_connections 2024-09-19T09:24:31.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.030+0000 7fe92088c640 1 -- 172.21.15.18:0/2522562803 wait complete. 2024-09-19T09:24:31.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.032+0000 7fe92088c640 1 Processor -- start 2024-09-19T09:24:31.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.032+0000 7fe92088c640 1 -- start start 2024-09-19T09:24:31.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.032+0000 7fe92088c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9080039b0 0x7fe91c155fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:31.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.032+0000 7fe92088c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe91c15bb50 0x7fe91c0b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:31.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.032+0000 7fe92088c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe91c0cf730 0x7fe91c0cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:31.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.032+0000 7fe92088c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe91c0d21a0 con 0x7fe9080039b0 2024-09-19T09:24:31.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.032+0000 7fe92088c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe91c0d2020 con 0x7fe91c15bb50 2024-09-19T09:24:31.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.032+0000 7fe92088c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe91c0d5780 con 0x7fe91c0cf730 2024-09-19T09:24:31.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.033+0000 7fe91a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9080039b0 0x7fe91c155fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:31.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.033+0000 7fe91a59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9080039b0 0x7fe91c155fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53080/0 (socket says 172.21.15.18:53080) 2024-09-19T09:24:31.038 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.033+0000 7fe91a59c640 1 -- 172.21.15.18:0/539458982 learned_addr learned my addr 172.21.15.18:0/539458982 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:31.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.033+0000 7fe919d9b640 1 --2- 172.21.15.18:0/539458982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe91c15bb50 0x7fe91c0b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:31.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.033+0000 7fe91ad9d640 1 --2- 172.21.15.18:0/539458982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe91c0cf730 0x7fe91c0cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:31.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.033+0000 7fe91a59c640 1 -- 172.21.15.18:0/539458982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe91c0cf730 msgr2=0x7fe91c0cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:31.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.033+0000 7fe91a59c640 1 --2- 172.21.15.18:0/539458982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe91c0cf730 0x7fe91c0cfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:31.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.033+0000 7fe91a59c640 1 -- 172.21.15.18:0/539458982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe91c15bb50 msgr2=0x7fe91c0b2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:31.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.033+0000 7fe91a59c640 1 --2- 172.21.15.18:0/539458982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe91c15bb50 0x7fe91c0b2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:31.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.033+0000 7fe91a59c640 1 -- 172.21.15.18:0/539458982 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe91c0b3520 con 0x7fe9080039b0 2024-09-19T09:24:31.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.033+0000 7fe91a59c640 1 --2- 172.21.15.18:0/539458982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9080039b0 0x7fe91c155fe0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fe914001cf0 tx=0x7fe914001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:31.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.033+0000 7fe912ffd640 1 -- 172.21.15.18:0/539458982 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe91402ba80 con 0x7fe9080039b0 2024-09-19T09:24:31.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.033+0000 7fe912ffd640 1 -- 172.21.15.18:0/539458982 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe91402bc20 con 0x7fe9080039b0 2024-09-19T09:24:31.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.033+0000 7fe92088c640 1 -- 172.21.15.18:0/539458982 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe91c0cddb0 con 0x7fe9080039b0 2024-09-19T09:24:31.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.033+0000 7fe912ffd640 1 -- 172.21.15.18:0/539458982 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe914004e30 con 0x7fe9080039b0 2024-09-19T09:24:31.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.033+0000 7fe92088c640 1 -- 172.21.15.18:0/539458982 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe91c1f4c40 con 0x7fe9080039b0 2024-09-19T09:24:31.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.034+0000 7fe92088c640 1 -- 172.21.15.18:0/539458982 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe91c0d13a0 con 0x7fe9080039b0 2024-09-19T09:24:31.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.035+0000 7fe912ffd640 1 -- 172.21.15.18:0/539458982 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe914034470 con 0x7fe9080039b0 2024-09-19T09:24:31.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.035+0000 7fe912ffd640 1 --2- 172.21.15.18:0/539458982 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe8fc06c2a0 0x7fe8fc06e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:31.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.035+0000 7fe912ffd640 1 -- 172.21.15.18:0/539458982 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7fe9140abbd0 con 0x7fe9080039b0 2024-09-19T09:24:31.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.035+0000 7fe919d9b640 1 --2- 172.21.15.18:0/539458982 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe8fc06c2a0 0x7fe8fc06e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:31.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.036+0000 7fe919d9b640 1 --2- 172.21.15.18:0/539458982 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe8fc06c2a0 0x7fe8fc06e760 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe91c06d760 tx=0x7fe904008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:31.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.040+0000 7fe912ffd640 1 -- 172.21.15.18:0/539458982 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe91407a340 con 0x7fe9080039b0 2024-09-19T09:24:31.252 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.251+0000 7fe92088c640 1 -- 172.21.15.18:0/539458982 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe91c06d1d0 con 0x7fe9080039b0 2024-09-19T09:24:31.253 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.252+0000 7fe912ffd640 1 -- 172.21.15.18:0/539458982 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v82) ==== 53+0+73 (secure 0 0 0) 0x7fe914079c40 con 0x7fe9080039b0 2024-09-19T09:24:31.253 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T09:24:31.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.254+0000 7fe92088c640 1 -- 172.21.15.18:0/539458982 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe8fc06c2a0 msgr2=0x7fe8fc06e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:31.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.254+0000 7fe92088c640 1 --2- 172.21.15.18:0/539458982 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe8fc06c2a0 0x7fe8fc06e760 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fe91c06d760 tx=0x7fe904008040 comp rx=0 tx=0).stop 2024-09-19T09:24:31.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.254+0000 7fe92088c640 1 -- 172.21.15.18:0/539458982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9080039b0 msgr2=0x7fe91c155fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:31.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.254+0000 7fe92088c640 1 --2- 172.21.15.18:0/539458982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9080039b0 0x7fe91c155fe0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fe914001cf0 tx=0x7fe914001dc0 comp rx=0 tx=0).stop 2024-09-19T09:24:31.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.254+0000 7fe92088c640 1 -- 172.21.15.18:0/539458982 shutdown_connections 2024-09-19T09:24:31.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.254+0000 7fe92088c640 1 --2- 172.21.15.18:0/539458982 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe8fc06c2a0 0x7fe8fc06e760 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:31.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.254+0000 7fe92088c640 1 --2- 172.21.15.18:0/539458982 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe91c0cf730 0x7fe91c0cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:31.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.254+0000 7fe92088c640 1 --2- 172.21.15.18:0/539458982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe91c15bb50 0x7fe91c0b2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:31.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.254+0000 7fe92088c640 1 --2- 172.21.15.18:0/539458982 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe9080039b0 0x7fe91c155fe0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:31.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.254+0000 7fe92088c640 1 -- 172.21.15.18:0/539458982 >> 172.21.15.18:0/539458982 conn(0x7fe91c0d4c60 msgr2=0x7fe91c06d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:31.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.254+0000 7fe92088c640 1 -- 172.21.15.18:0/539458982 shutdown_connections 2024-09-19T09:24:31.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31.254+0000 7fe92088c640 1 -- 172.21.15.18:0/539458982 wait complete. 2024-09-19T09:24:31.266 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-19T09:24:31.266 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:24:31.266 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi018.front.sepia.ceph.com 2024-09-19T09:24:31.266 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T09:24:31.266 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T09:24:31.266 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-19T09:24:31.266 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-19T09:24:31.266 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:24:31.266 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:24:31.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:24:31.267 DEBUG:teuthology.orchestra.run.smithi018:> ip addr 2024-09-19T09:24:31.283 INFO:teuthology.orchestra.run.smithi018.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:24:31.283 INFO:teuthology.orchestra.run.smithi018.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:24:31.283 INFO:teuthology.orchestra.run.smithi018.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:24:31.283 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:24:31.283 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 ::1/128 scope host 2024-09-19T09:24:31.283 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:24:31.283 INFO:teuthology.orchestra.run.smithi018.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:24:31.283 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:98 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:24:31.283 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f0 2024-09-19T09:24:31.284 INFO:teuthology.orchestra.run.smithi018.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:24:31.284 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:6b:fd:99 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:24:31.284 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp7s0f1 2024-09-19T09:24:31.284 INFO:teuthology.orchestra.run.smithi018.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:24:31.284 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:62 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:24:31.284 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f0 2024-09-19T09:24:31.284 INFO:teuthology.orchestra.run.smithi018.stdout: inet 172.21.15.18/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T09:24:31.284 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft 42126sec preferred_lft 42126sec 2024-09-19T09:24:31.284 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::ec4:7aff:febd:1362/64 scope link 2024-09-19T09:24:31.284 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:24:31.284 INFO:teuthology.orchestra.run.smithi018.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:24:31.284 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 0c:c4:7a:bd:13:63 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:24:31.284 INFO:teuthology.orchestra.run.smithi018.stdout: altname enp1s0f1 2024-09-19T09:24:31.285 INFO:teuthology.orchestra.run.smithi018.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T09:24:31.285 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:44:1b:02:86:87 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:24:31.285 INFO:teuthology.orchestra.run.smithi018.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T09:24:31.285 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:24:31.285 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::a0ce:faff:feaa:13ec/64 scope link 2024-09-19T09:24:31.285 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:24:31.285 INFO:teuthology.orchestra.run.smithi018.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:24:31.285 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether 02:44:1b:02:86:87 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:24:31.285 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::44:1bff:fe02:8687/64 scope link 2024-09-19T09:24:31.285 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:24:31.285 INFO:teuthology.orchestra.run.smithi018.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:24:31.285 INFO:teuthology.orchestra.run.smithi018.stdout: link/ether e2:6d:c4:af:6a:8b brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T09:24:31.285 INFO:teuthology.orchestra.run.smithi018.stdout: inet6 fe80::e06d:c4ff:feaf:6a8b/64 scope link 2024-09-19T09:24:31.285 INFO:teuthology.orchestra.run.smithi018.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:24:31.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:24:31.286 DEBUG:teuthology.orchestra.run.smithi018:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:24:31.348 INFO:teuthology.orchestra.run.smithi018.stdout:1 2024-09-19T09:24:31.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:24:31.349 DEBUG:teuthology.orchestra.run.smithi018:> route 2024-09-19T09:24:31.406 INFO:teuthology.orchestra.run.smithi018.stdout:Kernel IP routing table 2024-09-19T09:24:31.406 INFO:teuthology.orchestra.run.smithi018.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:24:31.406 INFO:teuthology.orchestra.run.smithi018.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T09:24:31.407 INFO:teuthology.orchestra.run.smithi018.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T09:24:31.407 INFO:teuthology.orchestra.run.smithi018.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:24:31.407 DEBUG:teuthology.orchestra.run.smithi018:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:24:31.407 DEBUG:teuthology.orchestra.run.smithi018:> set -e 2024-09-19T09:24:31.407 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T09:24:31.407 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T09:24:31.407 DEBUG:teuthology.orchestra.run.smithi018:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T09:24:31.407 DEBUG:teuthology.orchestra.run.smithi018:> ') 2024-09-19T09:24:31.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:24:31.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:24:31.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:24:31.535 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-19T09:24:31.551 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-19T09:24:31.551 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T09:24:31.552 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:24:31.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:24:31.552 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link set brx.0 up 2024-09-19T09:24:31.618 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:24:31.618 DEBUG:teuthology.orchestra.run.smithi018:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T09:24:31.674 INFO:teuthology.orchestra.run.smithi018.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T09:24:31.674 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:24:31.674 DEBUG:teuthology.orchestra.run.smithi018:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:24:31.729 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-19T09:24:31.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:24:31.729 DEBUG:teuthology.orchestra.run.smithi018:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:24:31.815 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:24:31.815 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:24:31.815 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:24:31.824 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:24:31.824 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:24:31.824 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:24:31.824 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:24:31.824 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:24:31.829 INFO:teuthology.orchestra.run.smithi018.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-19T09:24:31.829 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-19T09:24:31.829 INFO:teuthology.orchestra.run.smithi018.stdout:invalid new device string format 2024-09-19T09:24:31.829 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:24:31.829 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:24:31.829 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: resolved to: "172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-19T09:24:31.829 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-19T09:24:31.829 INFO:teuthology.orchestra.run.smithi018.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fec66d7e-50e5-42ed-81de-ad141a2f0f4e" will pass to kernel 2024-09-19T09:24:31.830 INFO:teuthology.orchestra.run.smithi018.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-19T09:24:31.830 INFO:teuthology.orchestra.run.smithi018.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:24:31.830 INFO:teuthology.orchestra.run.smithi018.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:24:31.830 INFO:teuthology.orchestra.run.smithi018.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:24:31.830 INFO:teuthology.orchestra.run.smithi018.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:24:31.831 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:24:31.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:24:31.831 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T09:24:31.857 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:24:31.949 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:24:31.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:24:31.959 INFO:teuthology.orchestra.run.smithi018.stdout:client7369 2024-09-19T09:24:31.959 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:24:31.959 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:24:31.976 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-19T09:24:32.118 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.118+0000 7f3d898f8640 1 Processor -- start 2024-09-19T09:24:32.119 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.118+0000 7f3d898f8640 1 -- start start 2024-09-19T09:24:32.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.118+0000 7f3d898f8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d8406d730 0x7f3d840b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:32.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.118+0000 7f3d898f8640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d840cd1a0 con 0x7f3d8415ef80 2024-09-19T09:24:32.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.118+0000 7f3d898f8640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d8406dc30 con 0x7f3d840cfae0 2024-09-19T09:24:32.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.118+0000 7f3d898f8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3d840cd7d0 con 0x7f3d8406d730 2024-09-19T09:24:32.121 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.118+0000 7f3d82ffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3d8415ef80 0x7f3d840cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44744/0 (socket says 172.21.15.18:44744) 2024-09-19T09:24:32.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.119+0000 7f3d82ffd640 1 -- 172.21.15.18:0/3235054819 learned_addr learned my addr 172.21.15.18:0/3235054819 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:24:32.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.119+0000 7f3d81ffb640 1 -- 172.21.15.18:0/3235054819 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2401932121 0 0) 0x7f3d840cd1a0 con 0x7f3d8415ef80 2024-09-19T09:24:32.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.119+0000 7f3d837fe640 1 --2- 172.21.15.18:0/3235054819 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d8406d730 0x7f3d840b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:32.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.119+0000 7f3d81ffb640 1 -- 172.21.15.18:0/3235054819 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d70003520 con 0x7f3d8415ef80 2024-09-19T09:24:32.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.119+0000 7f3d81ffb640 1 -- 172.21.15.18:0/3235054819 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 411776640 0 0) 0x7f3d8406dc30 con 0x7f3d840cfae0 2024-09-19T09:24:32.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.119+0000 7f3d81ffb640 1 -- 172.21.15.18:0/3235054819 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d840cd1a0 con 0x7f3d840cfae0 2024-09-19T09:24:32.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.119+0000 7f3d81ffb640 1 -- 172.21.15.18:0/3235054819 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1474173054 0 0) 0x7f3d70003520 con 0x7f3d8415ef80 2024-09-19T09:24:32.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.119+0000 7f3d81ffb640 1 -- 172.21.15.18:0/3235054819 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d8406d730 msgr2=0x7f3d840b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:32.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.119+0000 7f3d81ffb640 1 --2- 172.21.15.18:0/3235054819 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d8406d730 0x7f3d840b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.119+0000 7f3d81ffb640 1 -- 172.21.15.18:0/3235054819 >> v1:172.21.15.162:6789/0 conn(0x7f3d840cfae0 legacy=0x7f3d840cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:32.122 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.119+0000 7f3d81ffb640 1 -- 172.21.15.18:0/3235054819 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d8406df10 con 0x7f3d8415ef80 2024-09-19T09:24:32.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.119+0000 7f3d81ffb640 1 -- 172.21.15.18:0/3235054819 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f3d74001970 con 0x7f3d8415ef80 2024-09-19T09:24:32.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.119+0000 7f3d81ffb640 1 -- 172.21.15.18:0/3235054819 >> v1:172.21.15.18:6789/0 conn(0x7f3d8415ef80 legacy=0x7f3d840cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:32.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.119+0000 7f3d81ffb640 1 --2- 172.21.15.18:0/3235054819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d70003b70 0x7f3d70003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:32.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.119+0000 7f3d81ffb640 1 --2- 172.21.15.18:0/3235054819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d70004800 0x7f3d70004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:32.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.119+0000 7f3d81ffb640 1 --2- 172.21.15.18:0/3235054819 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d8406d730 0x7f3d700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:32.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.119+0000 7f3d81ffb640 1 -- 172.21.15.18:0/3235054819 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3d840cd7d0 con 0x7f3d70003b70 2024-09-19T09:24:32.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.119+0000 7f3d81ffb640 1 -- 172.21.15.18:0/3235054819 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3d7000baa0 con 0x7f3d70004800 2024-09-19T09:24:32.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.119+0000 7f3d81ffb640 1 -- 172.21.15.18:0/3235054819 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3d7000bca0 con 0x7f3d8406d730 2024-09-19T09:24:32.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.119+0000 7f3d82ffd640 1 --2- 172.21.15.18:0/3235054819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d70003b70 0x7f3d70003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:32.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.119+0000 7f3d827fc640 1 --2- 172.21.15.18:0/3235054819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d70004800 0x7f3d70004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:32.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.119+0000 7f3d837fe640 1 --2- 172.21.15.18:0/3235054819 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d8406d730 0x7f3d700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:32.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.120+0000 7f3d82ffd640 1 -- 172.21.15.18:0/3235054819 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d8406d730 msgr2=0x7f3d700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:32.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.120+0000 7f3d82ffd640 1 --2- 172.21.15.18:0/3235054819 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d8406d730 0x7f3d700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.120+0000 7f3d82ffd640 1 -- 172.21.15.18:0/3235054819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d70004800 msgr2=0x7f3d70004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:32.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.120+0000 7f3d82ffd640 1 --2- 172.21.15.18:0/3235054819 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d70004800 0x7f3d70004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.120+0000 7f3d82ffd640 1 -- 172.21.15.18:0/3235054819 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d70003520 con 0x7f3d70003b70 2024-09-19T09:24:32.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.120+0000 7f3d82ffd640 1 --2- 172.21.15.18:0/3235054819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d70003b70 0x7f3d70003f70 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f3d7400a6f0 tx=0x7f3d70005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf933fa45a24339 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:32.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.120+0000 7f3d81ffb640 1 -- 172.21.15.18:0/3235054819 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7400a310 con 0x7f3d70003b70 2024-09-19T09:24:32.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.120+0000 7f3d81ffb640 1 -- 172.21.15.18:0/3235054819 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d7402f070 con 0x7f3d70003b70 2024-09-19T09:24:32.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.121+0000 7f3d81ffb640 1 -- 172.21.15.18:0/3235054819 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7402bc10 con 0x7f3d70003b70 2024-09-19T09:24:32.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.121+0000 7f3d898f8640 1 -- 172.21.15.18:0/3235054819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d70003b70 msgr2=0x7f3d70003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:32.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.121+0000 7f3d898f8640 1 --2- 172.21.15.18:0/3235054819 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d70003b70 0x7f3d70003f70 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f3d7400a6f0 tx=0x7f3d70005830 comp rx=0 tx=0).stop 2024-09-19T09:24:32.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.121+0000 7f3d837fe640 1 -- 172.21.15.18:0/3235054819 reap_dead start 2024-09-19T09:24:32.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.121+0000 7f3d898f8640 1 -- 172.21.15.18:0/3235054819 shutdown_connections 2024-09-19T09:24:32.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.121+0000 7f3d898f8640 1 -- 172.21.15.18:0/3235054819 >> 172.21.15.18:0/3235054819 conn(0x7f3d840b4700 msgr2=0x7f3d840b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:32.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.121+0000 7f3d898f8640 1 -- 172.21.15.18:0/3235054819 shutdown_connections 2024-09-19T09:24:32.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.121+0000 7f3d898f8640 1 -- 172.21.15.18:0/3235054819 wait complete. 2024-09-19T09:24:32.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.122+0000 7f3d898f8640 1 Processor -- start 2024-09-19T09:24:32.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.122+0000 7f3d898f8640 1 -- start start 2024-09-19T09:24:32.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.123+0000 7f3d898f8640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d70003b70 0x7f3d840c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:32.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.123+0000 7f3d898f8640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d8415d0a0 0x7f3d84153f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:32.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.123+0000 7f3d898f8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d841f4b90 0x7f3d841f5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:32.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.123+0000 7f3d898f8640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3d840d0120 con 0x7f3d70003b70 2024-09-19T09:24:32.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.123+0000 7f3d898f8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8415f360 con 0x7f3d841f4b90 2024-09-19T09:24:32.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.123+0000 7f3d898f8640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3d840b5220 con 0x7f3d8415d0a0 2024-09-19T09:24:32.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.123+0000 7f3d82ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d70003b70 0x7f3d840c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:32.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.123+0000 7f3d82ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d70003b70 0x7f3d840c7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53094/0 (socket says 172.21.15.18:53094) 2024-09-19T09:24:32.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.123+0000 7f3d82ffd640 1 -- 172.21.15.18:0/1980479693 learned_addr learned my addr 172.21.15.18:0/1980479693 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:32.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.123+0000 7f3d837fe640 1 --2- 172.21.15.18:0/1980479693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d841f4b90 0x7f3d841f5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:32.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.123+0000 7f3d827fc640 1 --2- 172.21.15.18:0/1980479693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d8415d0a0 0x7f3d84153f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:32.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.124+0000 7f3d82ffd640 1 -- 172.21.15.18:0/1980479693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d8415d0a0 msgr2=0x7f3d84153f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:32.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.124+0000 7f3d82ffd640 1 --2- 172.21.15.18:0/1980479693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d8415d0a0 0x7f3d84153f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.124+0000 7f3d82ffd640 1 -- 172.21.15.18:0/1980479693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d841f4b90 msgr2=0x7f3d841f5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:32.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.124+0000 7f3d82ffd640 1 --2- 172.21.15.18:0/1980479693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d841f4b90 0x7f3d841f5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.124+0000 7f3d82ffd640 1 -- 172.21.15.18:0/1980479693 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d840b6f10 con 0x7f3d70003b70 2024-09-19T09:24:32.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.124+0000 7f3d82ffd640 1 --2- 172.21.15.18:0/1980479693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d70003b70 0x7f3d840c7960 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f3d7402b3a0 tx=0x7f3d74001c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:32.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.124+0000 7f3d7bfff640 1 -- 172.21.15.18:0/1980479693 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7400a310 con 0x7f3d70003b70 2024-09-19T09:24:32.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.124+0000 7f3d7bfff640 1 -- 172.21.15.18:0/1980479693 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d74004b60 con 0x7f3d70003b70 2024-09-19T09:24:32.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.124+0000 7f3d898f8640 1 -- 172.21.15.18:0/1980479693 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d840b71f0 con 0x7f3d70003b70 2024-09-19T09:24:32.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.124+0000 7f3d7bfff640 1 -- 172.21.15.18:0/1980479693 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d74034470 con 0x7f3d70003b70 2024-09-19T09:24:32.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.124+0000 7f3d898f8640 1 -- 172.21.15.18:0/1980479693 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d840b77b0 con 0x7f3d70003b70 2024-09-19T09:24:32.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.125+0000 7f3d898f8640 1 -- 172.21.15.18:0/1980479693 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d8406dc30 con 0x7f3d70003b70 2024-09-19T09:24:32.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.125+0000 7f3d7bfff640 1 -- 172.21.15.18:0/1980479693 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3d74034610 con 0x7f3d70003b70 2024-09-19T09:24:32.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.126+0000 7f3d7bfff640 1 --2- 172.21.15.18:0/1980479693 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3d6406c2e0 0x7f3d6406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:32.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.126+0000 7f3d7bfff640 1 -- 172.21.15.18:0/1980479693 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f3d740ab880 con 0x7f3d70003b70 2024-09-19T09:24:32.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.126+0000 7f3d827fc640 1 --2- 172.21.15.18:0/1980479693 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3d6406c2e0 0x7f3d6406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:32.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.127+0000 7f3d827fc640 1 --2- 172.21.15.18:0/1980479693 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3d6406c2e0 0x7f3d6406e7a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3d840c9760 tx=0x7f3d6c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:32.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.130+0000 7f3d7bfff640 1 -- 172.21.15.18:0/1980479693 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3d7407a0b0 con 0x7f3d70003b70 2024-09-19T09:24:32.240 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:24:32.243 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:24:32.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.344+0000 7f3d898f8640 1 -- 172.21.15.18:0/1980479693 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3d840cff00 con 0x7f3d70003b70 2024-09-19T09:24:32.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.344+0000 7f3d7bfff640 1 -- 172.21.15.18:0/1980479693 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v82) ==== 53+0+73 (secure 0 0 0) 0x7f3d740799b0 con 0x7f3d70003b70 2024-09-19T09:24:32.345 INFO:teuthology.orchestra.run.smithi018.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T09:24:32.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.346+0000 7f3d898f8640 1 -- 172.21.15.18:0/1980479693 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3d6406c2e0 msgr2=0x7f3d6406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:32.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.346+0000 7f3d898f8640 1 --2- 172.21.15.18:0/1980479693 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3d6406c2e0 0x7f3d6406e7a0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3d840c9760 tx=0x7f3d6c009040 comp rx=0 tx=0).stop 2024-09-19T09:24:32.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.346+0000 7f3d898f8640 1 -- 172.21.15.18:0/1980479693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d70003b70 msgr2=0x7f3d840c7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:32.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.346+0000 7f3d898f8640 1 --2- 172.21.15.18:0/1980479693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d70003b70 0x7f3d840c7960 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f3d7402b3a0 tx=0x7f3d74001c70 comp rx=0 tx=0).stop 2024-09-19T09:24:32.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.346+0000 7f3d898f8640 1 -- 172.21.15.18:0/1980479693 shutdown_connections 2024-09-19T09:24:32.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.346+0000 7f3d898f8640 1 --2- 172.21.15.18:0/1980479693 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3d6406c2e0 0x7f3d6406e7a0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.346+0000 7f3d898f8640 1 --2- 172.21.15.18:0/1980479693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3d841f4b90 0x7f3d841f5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.346+0000 7f3d898f8640 1 --2- 172.21.15.18:0/1980479693 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3d8415d0a0 0x7f3d84153f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.346+0000 7f3d898f8640 1 --2- 172.21.15.18:0/1980479693 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3d70003b70 0x7f3d840c7960 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:32.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.346+0000 7f3d898f8640 1 -- 172.21.15.18:0/1980479693 >> 172.21.15.18:0/1980479693 conn(0x7f3d840b4700 msgr2=0x7f3d84161f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:32.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.346+0000 7f3d898f8640 1 -- 172.21.15.18:0/1980479693 shutdown_connections 2024-09-19T09:24:32.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:32.346+0000 7f3d898f8640 1 -- 172.21.15.18:0/1980479693 wait complete. 2024-09-19T09:24:32.358 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-19T09:24:32.358 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T09:24:32.358 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-09-19T09:24:32.358 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-19T09:24:32.358 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-19T09:24:32.358 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-19T09:24:32.358 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-19T09:24:32.358 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T09:24:32.358 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:24:32.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:24:32.359 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-09-19T09:24:32.376 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T09:24:32.377 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T09:24:32.377 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T09:24:32.377 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:24:32.377 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-09-19T09:24:32.377 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:24:32.377 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:24:32.377 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:24:32.377 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-09-19T09:24:32.377 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:24:32.377 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:24:32.378 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-09-19T09:24:32.378 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T09:24:32.378 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:24:32.378 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T09:24:32.378 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:24:32.378 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T09:24:32.378 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42136sec preferred_lft 42136sec 2024-09-19T09:24:32.378 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link noprefixroute 2024-09-19T09:24:32.378 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:24:32.378 INFO:teuthology.orchestra.run.smithi162.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-19T09:24:32.378 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 5e:4d:7e:1d:19:f9 brd ff:ff:ff:ff:ff:ff 2024-09-19T09:24:32.378 INFO:teuthology.orchestra.run.smithi162.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-19T09:24:32.379 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:24:32.379 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::5829:65ff:fe01:6bc7/64 scope link 2024-09-19T09:24:32.379 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:24:32.379 INFO:teuthology.orchestra.run.smithi162.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:24:32.379 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 86:86:3e:32:67:c5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T09:24:32.379 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::8486:3eff:fe32:67c5/64 scope link 2024-09-19T09:24:32.379 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:24:32.379 INFO:teuthology.orchestra.run.smithi162.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-19T09:24:32.379 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 5e:4d:7e:1d:19:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-19T09:24:32.379 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::5c4d:7eff:fe1d:19f9/64 scope link 2024-09-19T09:24:32.379 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-09-19T09:24:32.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:24:32.380 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T09:24:32.443 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-09-19T09:24:32.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:24:32.445 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-09-19T09:24:32.502 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-09-19T09:24:32.503 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T09:24:32.503 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T09:24:32.503 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T09:24:32.503 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T09:24:32.503 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T09:24:32.503 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-09-19T09:24:32.503 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T09:24:32.503 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T09:24:32.503 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T09:24:32.503 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-09-19T09:24:32.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:24:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T09:24:32.624 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:24:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:24:32.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:24:32.630 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-19T09:24:32.646 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-19T09:24:32.646 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-19T09:24:32.646 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:24:32.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:24:32.647 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2024-09-19T09:24:32.711 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:24:32.712 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-19T09:24:32.767 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-19T09:24:32.767 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T09:24:32.767 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-19T09:24:32.822 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-19T09:24:32.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:24:32.822 DEBUG:teuthology.orchestra.run.smithi162:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:24:32.905 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:24:32.905 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:24:32.905 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:24:32.914 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:24:32.914 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:24:32.914 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:24:32.914 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:24:32.915 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:24:32.918 INFO:teuthology.orchestra.run.smithi162.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-19T09:24:32.918 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-19T09:24:32.919 INFO:teuthology.orchestra.run.smithi162.stdout:invalid new device string format 2024-09-19T09:24:32.919 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:3300,172.21.15.162:3300,172.21.15.162:3301" 2024-09-19T09:24:32.919 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-19T09:24:32.919 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: resolved to: "172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790" 2024-09-19T09:24:32.919 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.18:6789,172.21.15.162:6789,172.21.15.162:6790:/ 2024-09-19T09:24:32.919 INFO:teuthology.orchestra.run.smithi162.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=fec66d7e-50e5-42ed-81de-ad141a2f0f4e" will pass to kernel 2024-09-19T09:24:32.919 INFO:teuthology.orchestra.run.smithi162.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-19T09:24:32.919 INFO:teuthology.orchestra.run.smithi162.stdout: You just mounted a file system that supports labels which does not 2024-09-19T09:24:32.919 INFO:teuthology.orchestra.run.smithi162.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T09:24:32.919 INFO:teuthology.orchestra.run.smithi162.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T09:24:32.920 INFO:teuthology.orchestra.run.smithi162.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T09:24:32.921 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T09:24:32.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:24:32.921 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-19T09:24:32.986 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T09:24:33.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:24:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T09:24:33.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-09-19T09:24:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T09:24:33.083 INFO:teuthology.orchestra.run.smithi162.stdout:client7378 2024-09-19T09:24:33.083 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:24:33.084 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:24:33.099 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:24:33.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.215+0000 7fab71de4640 1 Processor -- start 2024-09-19T09:24:33.216 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.215+0000 7fab71de4640 1 -- start start 2024-09-19T09:24:33.217 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.216+0000 7fab71de4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab6c146380 0x7fab6c15ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:33.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.216+0000 7fab71de4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fab6c06bc10 0x7fab6c06c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:33.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.216+0000 7fab71de4640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab6c146760 con 0x7fab6c0b42f0 2024-09-19T09:24:33.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.216+0000 7fab71de4640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fab6c06c5a0 con 0x7fab6c06bc10 2024-09-19T09:24:33.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.216+0000 7fab71de4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fab6c06e6c0 con 0x7fab6c146380 2024-09-19T09:24:33.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.216+0000 7fab6bfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fab6c06bc10 0x7fab6c06c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:33.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.216+0000 7fab6bfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fab6c06bc10 0x7fab6c06c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53102/0 (socket says 172.21.15.18:53102) 2024-09-19T09:24:33.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.216+0000 7fab6bfff640 1 -- 172.21.15.18:0/4097057267 learned_addr learned my addr 172.21.15.18:0/4097057267 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:33.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.216+0000 7fab6b7fe640 1 --2- 172.21.15.18:0/4097057267 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab6c146380 0x7fab6c15ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:33.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.216+0000 7fab6bfff640 1 -- 172.21.15.18:0/4097057267 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab6c146380 msgr2=0x7fab6c15ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:33.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.216+0000 7fab6bfff640 1 --2- 172.21.15.18:0/4097057267 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab6c146380 0x7fab6c15ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:33.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.216+0000 7fab6bfff640 1 -- 172.21.15.18:0/4097057267 >> v1:172.21.15.18:6789/0 conn(0x7fab6c0b42f0 legacy=0x7fab6c0d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:33.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.217+0000 7fab6a7fc640 1 -- 172.21.15.18:0/4097057267 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2941929994 0 0) 0x7fab6c146760 con 0x7fab6c0b42f0 2024-09-19T09:24:33.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.217+0000 7fab6bfff640 1 -- 172.21.15.18:0/4097057267 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab6c06e980 con 0x7fab6c06bc10 2024-09-19T09:24:33.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.217+0000 7fab6bfff640 1 --2- 172.21.15.18:0/4097057267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab6c06bc10 0x7fab6c06c060 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fab64009870 tx=0x7fab6402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ab3defc831b7098 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:33.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.217+0000 7fab6a7fc640 1 -- 172.21.15.18:0/4097057267 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab64037070 con 0x7fab6c06bc10 2024-09-19T09:24:33.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.217+0000 7fab6a7fc640 1 -- 172.21.15.18:0/4097057267 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab64032440 con 0x7fab6c06bc10 2024-09-19T09:24:33.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.217+0000 7fab6a7fc640 1 -- 172.21.15.18:0/4097057267 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab64032810 con 0x7fab6c06bc10 2024-09-19T09:24:33.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.218+0000 7fab71de4640 1 -- 172.21.15.18:0/4097057267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab6c06bc10 msgr2=0x7fab6c06c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:33.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.218+0000 7fab71de4640 1 --2- 172.21.15.18:0/4097057267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab6c06bc10 0x7fab6c06c060 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7fab64009870 tx=0x7fab6402a270 comp rx=0 tx=0).stop 2024-09-19T09:24:33.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.218+0000 7fab71de4640 1 -- 172.21.15.18:0/4097057267 shutdown_connections 2024-09-19T09:24:33.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.218+0000 7fab71de4640 1 --2- 172.21.15.18:0/4097057267 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab6c06bc10 0x7fab6c06c060 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:33.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.218+0000 7fab71de4640 1 --2- 172.21.15.18:0/4097057267 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab6c146380 0x7fab6c15ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:33.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.218+0000 7fab71de4640 1 -- 172.21.15.18:0/4097057267 >> 172.21.15.18:0/4097057267 conn(0x7fab6c0b3790 msgr2=0x7fab6c0b3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:33.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.218+0000 7fab71de4640 1 -- 172.21.15.18:0/4097057267 shutdown_connections 2024-09-19T09:24:33.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.218+0000 7fab71de4640 1 -- 172.21.15.18:0/4097057267 wait complete. 2024-09-19T09:24:33.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.219+0000 7fab71de4640 1 Processor -- start 2024-09-19T09:24:33.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.220+0000 7fab71de4640 1 -- start start 2024-09-19T09:24:33.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.220+0000 7fab71de4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab6c06bc10 0x7fab6c15b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:33.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.220+0000 7fab71de4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab6c0b42f0 0x7fab6c0aa430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:33.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.220+0000 7fab71de4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab6c146380 0x7fab6c0afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:33.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.220+0000 7fab71de4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fab6c06f220 con 0x7fab6c06bc10 2024-09-19T09:24:33.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.220+0000 7fab71de4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fab6c06ef40 con 0x7fab6c0b42f0 2024-09-19T09:24:33.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.220+0000 7fab71de4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fab6c0d16d0 con 0x7fab6c146380 2024-09-19T09:24:33.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.220+0000 7fab6b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab6c06bc10 0x7fab6c15b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:33.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.220+0000 7fab6b7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab6c06bc10 0x7fab6c15b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53118/0 (socket says 172.21.15.18:53118) 2024-09-19T09:24:33.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.221+0000 7fab6b7fe640 1 -- 172.21.15.18:0/2037870602 learned_addr learned my addr 172.21.15.18:0/2037870602 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:33.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.221+0000 7fab6affd640 1 --2- 172.21.15.18:0/2037870602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab6c0b42f0 0x7fab6c0aa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:33.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.221+0000 7fab6bfff640 1 --2- 172.21.15.18:0/2037870602 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab6c146380 0x7fab6c0afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:33.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.221+0000 7fab6b7fe640 1 -- 172.21.15.18:0/2037870602 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab6c146380 msgr2=0x7fab6c0afd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:33.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.221+0000 7fab6b7fe640 1 --2- 172.21.15.18:0/2037870602 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab6c146380 0x7fab6c0afd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:33.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.221+0000 7fab6b7fe640 1 -- 172.21.15.18:0/2037870602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab6c0b42f0 msgr2=0x7fab6c0aa430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:33.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.221+0000 7fab6b7fe640 1 --2- 172.21.15.18:0/2037870602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab6c0b42f0 0x7fab6c0aa430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:33.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.221+0000 7fab6b7fe640 1 -- 172.21.15.18:0/2037870602 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab6c0ab170 con 0x7fab6c06bc10 2024-09-19T09:24:33.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.221+0000 7fab6b7fe640 1 --2- 172.21.15.18:0/2037870602 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab6c06bc10 0x7fab6c15b900 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fab5c007e40 tx=0x7fab5c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:33.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.221+0000 7fab53fff640 1 -- 172.21.15.18:0/2037870602 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab5c014620 con 0x7fab6c06bc10 2024-09-19T09:24:33.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.221+0000 7fab53fff640 1 -- 172.21.15.18:0/2037870602 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab5c019070 con 0x7fab6c06bc10 2024-09-19T09:24:33.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.221+0000 7fab71de4640 1 -- 172.21.15.18:0/2037870602 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab6c0ab450 con 0x7fab6c06bc10 2024-09-19T09:24:33.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.221+0000 7fab53fff640 1 -- 172.21.15.18:0/2037870602 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab5c014a00 con 0x7fab6c06bc10 2024-09-19T09:24:33.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.221+0000 7fab71de4640 1 -- 172.21.15.18:0/2037870602 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab6c0aba10 con 0x7fab6c06bc10 2024-09-19T09:24:33.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.222+0000 7fab71de4640 1 -- 172.21.15.18:0/2037870602 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab6c06c060 con 0x7fab6c06bc10 2024-09-19T09:24:33.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.223+0000 7fab53fff640 1 -- 172.21.15.18:0/2037870602 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fab5c014ba0 con 0x7fab6c06bc10 2024-09-19T09:24:33.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.223+0000 7fab53fff640 1 --2- 172.21.15.18:0/2037870602 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fab5806c2b0 0x7fab5806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:33.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.223+0000 7fab53fff640 1 -- 172.21.15.18:0/2037870602 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7fab5c08bc10 con 0x7fab6c06bc10 2024-09-19T09:24:33.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.224+0000 7fab6affd640 1 --2- 172.21.15.18:0/2037870602 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fab5806c2b0 0x7fab5806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:33.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.224+0000 7fab6affd640 1 --2- 172.21.15.18:0/2037870602 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fab5806c2b0 0x7fab5806e770 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fab6c0af850 tx=0x7fab60009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:33.228 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.228+0000 7fab53fff640 1 -- 172.21.15.18:0/2037870602 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fab5c059d30 con 0x7fab6c06bc10 2024-09-19T09:24:33.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.438+0000 7fab71de4640 1 -- 172.21.15.18:0/2037870602 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab6c145190 con 0x7fab6c06bc10 2024-09-19T09:24:33.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.438+0000 7fab53fff640 1 -- 172.21.15.18:0/2037870602 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+5233 (secure 0 0 0) 0x7fab5c05e030 con 0x7fab6c06bc10 2024-09-19T09:24:33.440 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:24:33.440 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":82,"btime":"2024-09-19T09:24:28:275969+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1644566118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1644566118},{"type":"v1","addr":"172.21.15.162:6835","nonce":1644566118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3767901067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3767901067},{"type":"v1","addr":"172.21.15.162:6837","nonce":3767901067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7851,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1160903618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1160903618},{"type":"v1","addr":"172.21.15.18:6834","nonce":1160903618}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:24:25.526108+0000","modified":"2024-09-19T09:24:27.619787+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7854},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7854":{"gid":7854,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2545948137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2545948137},{"type":"v1","addr":"172.21.15.18:6835","nonce":2545948137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7854,"qdb_cluster":[7854]},"id":11}]} 2024-09-19T09:24:33.442 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 82 2024-09-19T09:24:33.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.440+0000 7fab71de4640 1 -- 172.21.15.18:0/2037870602 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fab5806c2b0 msgr2=0x7fab5806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:33.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.440+0000 7fab71de4640 1 --2- 172.21.15.18:0/2037870602 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fab5806c2b0 0x7fab5806e770 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fab6c0af850 tx=0x7fab60009040 comp rx=0 tx=0).stop 2024-09-19T09:24:33.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.440+0000 7fab71de4640 1 -- 172.21.15.18:0/2037870602 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab6c06bc10 msgr2=0x7fab6c15b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:33.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.440+0000 7fab71de4640 1 --2- 172.21.15.18:0/2037870602 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab6c06bc10 0x7fab6c15b900 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fab5c007e40 tx=0x7fab5c00e4b0 comp rx=0 tx=0).stop 2024-09-19T09:24:33.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.440+0000 7fab71de4640 1 -- 172.21.15.18:0/2037870602 shutdown_connections 2024-09-19T09:24:33.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.440+0000 7fab71de4640 1 --2- 172.21.15.18:0/2037870602 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fab5806c2b0 0x7fab5806e770 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:33.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.440+0000 7fab71de4640 1 --2- 172.21.15.18:0/2037870602 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fab6c146380 0x7fab6c0afd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:33.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.440+0000 7fab71de4640 1 --2- 172.21.15.18:0/2037870602 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fab6c0b42f0 0x7fab6c0aa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:33.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.440+0000 7fab71de4640 1 --2- 172.21.15.18:0/2037870602 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fab6c06bc10 0x7fab6c15b900 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:33.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.440+0000 7fab71de4640 1 -- 172.21.15.18:0/2037870602 >> 172.21.15.18:0/2037870602 conn(0x7fab6c0b3790 msgr2=0x7fab6c0b2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:33.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.440+0000 7fab71de4640 1 -- 172.21.15.18:0/2037870602 shutdown_connections 2024-09-19T09:24:33.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.440+0000 7fab71de4640 1 -- 172.21.15.18:0/2037870602 wait complete. 2024-09-19T09:24:33.453 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-19T09:24:33.574 INFO:teuthology.orchestra.run.smithi018.stdout:{"cluster_fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","whoami":0,"id":7854,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":7.3760926949999996,"mdsmap_epoch":82,"osdmap_epoch":182,"osdmap_epoch_barrier":182,"uptime":12.412133624000001} 2024-09-19T09:24:33.575 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", "fs_name": "cephfs", "id": 7854, "mdsmap_epoch": 82, "osdmap_epoch": 182, "osdmap_epoch_barrier": 182, "rank_uptime": 7.376092695, "state": "up:active", "uptime": 12.412133624, "want_state": "up:active", "whoami": 0 } 2024-09-19T09:24:33.575 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2024-09-19T09:24:33.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.681+0000 7f8cfe88d640 1 Processor -- start 2024-09-19T09:24:33.682 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.681+0000 7f8cfe88d640 1 -- start start 2024-09-19T09:24:33.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.682+0000 7f8cfe88d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8cf815ec90 0x7f8cf806be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:33.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.682+0000 7f8cfe88d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8cf80b2890 0x7f8cf80ae140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:33.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.682+0000 7f8cfe88d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cf806c800 con 0x7f8cf806c360 2024-09-19T09:24:33.683 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.682+0000 7f8cfe88d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8cf806d410 con 0x7f8cf80b2890 2024-09-19T09:24:33.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.682+0000 7f8cfe88d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8cf806cae0 con 0x7f8cf815ec90 2024-09-19T09:24:33.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.682+0000 7f8cf77fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f8cf806c360 0x7f8cf80b2180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44750/0 (socket says 172.21.15.18:44750) 2024-09-19T09:24:33.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.682+0000 7f8cf77fe640 1 -- 172.21.15.18:0/3554586885 learned_addr learned my addr 172.21.15.18:0/3554586885 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:24:33.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.682+0000 7f8cfce2a640 1 --2- 172.21.15.18:0/3554586885 >> v2:172.21.15.162:3300/0 conn(0x7f8cf80b2890 0x7f8cf80ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:33.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.682+0000 7f8cf6ffd640 1 -- 172.21.15.18:0/3554586885 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3372966531 0 0) 0x7f8cf806c800 con 0x7f8cf806c360 2024-09-19T09:24:33.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.682+0000 7f8cf7fff640 1 --2- 172.21.15.18:0/3554586885 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8cf815ec90 0x7f8cf806be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:33.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.682+0000 7f8cf6ffd640 1 -- 172.21.15.18:0/3554586885 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ce0003520 con 0x7f8cf806c360 2024-09-19T09:24:33.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.682+0000 7f8cfce2a640 1 -- 172.21.15.18:0/3554586885 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8cf815ec90 msgr2=0x7f8cf806be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:33.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.682+0000 7f8cfce2a640 1 --2- 172.21.15.18:0/3554586885 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8cf815ec90 0x7f8cf806be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:33.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.682+0000 7f8cfce2a640 1 -- 172.21.15.18:0/3554586885 >> v1:172.21.15.18:6789/0 conn(0x7f8cf806c360 legacy=0x7f8cf80b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:33.684 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.682+0000 7f8cf6ffd640 1 -- 172.21.15.18:0/3554586885 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4166046446 0 0) 0x7f8ce0003520 con 0x7f8cf806c360 2024-09-19T09:24:33.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.682+0000 7f8cfce2a640 1 -- 172.21.15.18:0/3554586885 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf806cdc0 con 0x7f8cf80b2890 2024-09-19T09:24:33.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.683+0000 7f8cfce2a640 1 --2- 172.21.15.18:0/3554586885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cf80b2890 0x7f8cf80ae140 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009d90 tx=0x7f8cf002a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67220b30bb92bf8d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:33.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.683+0000 7f8cf6ffd640 1 -- 172.21.15.18:0/3554586885 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cec001690 con 0x7f8cf80b2890 2024-09-19T09:24:33.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.684+0000 7f8cf6ffd640 1 -- 172.21.15.18:0/3554586885 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf0007540 con 0x7f8cf80b2890 2024-09-19T09:24:33.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.684+0000 7f8cf6ffd640 1 -- 172.21.15.18:0/3554586885 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0007910 con 0x7f8cf80b2890 2024-09-19T09:24:33.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.684+0000 7f8cfe88d640 1 -- 172.21.15.18:0/3554586885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cf80b2890 msgr2=0x7f8cf80ae140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:33.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.684+0000 7f8cfe88d640 1 --2- 172.21.15.18:0/3554586885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cf80b2890 0x7f8cf80ae140 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009d90 tx=0x7f8cf002a5f0 comp rx=0 tx=0).stop 2024-09-19T09:24:33.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.684+0000 7f8cfe88d640 1 -- 172.21.15.18:0/3554586885 shutdown_connections 2024-09-19T09:24:33.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.684+0000 7f8cfe88d640 1 --2- 172.21.15.18:0/3554586885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cf80b2890 0x7f8cf80ae140 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:33.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.684+0000 7f8cfe88d640 1 --2- 172.21.15.18:0/3554586885 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8cf815ec90 0x7f8cf806be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:33.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.684+0000 7f8cfe88d640 1 -- 172.21.15.18:0/3554586885 >> 172.21.15.18:0/3554586885 conn(0x7f8cf80b5fc0 msgr2=0x7f8cf80b6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:33.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.684+0000 7f8cfe88d640 1 -- 172.21.15.18:0/3554586885 shutdown_connections 2024-09-19T09:24:33.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.684+0000 7f8cfe88d640 1 -- 172.21.15.18:0/3554586885 wait complete. 2024-09-19T09:24:33.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.685+0000 7f8cfe88d640 1 Processor -- start 2024-09-19T09:24:33.687 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.685+0000 7f8cfe88d640 1 -- start start 2024-09-19T09:24:33.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.686+0000 7f8cfe88d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cf806c360 0x7f8cf81f7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:33.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.686+0000 7f8cfe88d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8cf80b2890 0x7f8cf8161b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:33.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.686+0000 7f8cfe88d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8cf815ec90 0x7f8cf8147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:33.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.686+0000 7f8cfe88d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf815f1f0 con 0x7f8cf815ec90 2024-09-19T09:24:33.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.686+0000 7f8cfe88d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8cf815f070 con 0x7f8cf806c360 2024-09-19T09:24:33.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.686+0000 7f8cfe88d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8cf80b2f80 con 0x7f8cf80b2890 2024-09-19T09:24:33.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.686+0000 7f8cfce2a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8cf815ec90 0x7f8cf8147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:33.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.686+0000 7f8cfce2a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8cf815ec90 0x7f8cf8147cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53120/0 (socket says 172.21.15.18:53120) 2024-09-19T09:24:33.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.686+0000 7f8cfce2a640 1 -- 172.21.15.18:0/2622995096 learned_addr learned my addr 172.21.15.18:0/2622995096 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:33.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.687+0000 7f8cf7fff640 1 --2- 172.21.15.18:0/2622995096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cf806c360 0x7f8cf81f7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:33.690 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.687+0000 7f8cf77fe640 1 --2- 172.21.15.18:0/2622995096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8cf80b2890 0x7f8cf8161b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:33.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.687+0000 7f8cfce2a640 1 -- 172.21.15.18:0/2622995096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8cf80b2890 msgr2=0x7f8cf8161b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:33.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.687+0000 7f8cfce2a640 1 --2- 172.21.15.18:0/2622995096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8cf80b2890 0x7f8cf8161b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:33.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.687+0000 7f8cfce2a640 1 -- 172.21.15.18:0/2622995096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cf806c360 msgr2=0x7f8cf81f7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:33.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.687+0000 7f8cfce2a640 1 --2- 172.21.15.18:0/2622995096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cf806c360 0x7f8cf81f7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:33.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.687+0000 7f8cfce2a640 1 -- 172.21.15.18:0/2622995096 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cf8157870 con 0x7f8cf815ec90 2024-09-19T09:24:33.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.687+0000 7f8cf7fff640 1 --2- 172.21.15.18:0/2622995096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cf806c360 0x7f8cf81f7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:33.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.687+0000 7f8cfce2a640 1 --2- 172.21.15.18:0/2622995096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8cf815ec90 0x7f8cf8147cf0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009d90 tx=0x7f8cf0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:33.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.687+0000 7f8cf4ff9640 1 -- 172.21.15.18:0/2622995096 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0040070 con 0x7f8cf815ec90 2024-09-19T09:24:33.691 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.687+0000 7f8cf4ff9640 1 -- 172.21.15.18:0/2622995096 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cf0031b40 con 0x7f8cf815ec90 2024-09-19T09:24:33.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.687+0000 7f8cfe88d640 1 -- 172.21.15.18:0/2622995096 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cf8157b50 con 0x7f8cf815ec90 2024-09-19T09:24:33.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.687+0000 7f8cf4ff9640 1 -- 172.21.15.18:0/2622995096 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cf0007e90 con 0x7f8cf815ec90 2024-09-19T09:24:33.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.687+0000 7f8cfe88d640 1 -- 172.21.15.18:0/2622995096 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cf8158110 con 0x7f8cf815ec90 2024-09-19T09:24:33.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.688+0000 7f8cfe88d640 1 -- 172.21.15.18:0/2622995096 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cf806be20 con 0x7f8cf815ec90 2024-09-19T09:24:33.692 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.689+0000 7f8cf4ff9640 1 -- 172.21.15.18:0/2622995096 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8cf0039040 con 0x7f8cf815ec90 2024-09-19T09:24:33.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.689+0000 7f8cf4ff9640 1 --2- 172.21.15.18:0/2622995096 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8ce406c2b0 0x7f8ce406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:33.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.690+0000 7f8cf4ff9640 1 -- 172.21.15.18:0/2622995096 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(182..182 src has 1..182) ==== 5709+0+0 (secure 0 0 0) 0x7f8cf00ac7a0 con 0x7f8cf815ec90 2024-09-19T09:24:33.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.690+0000 7f8cf7fff640 1 --2- 172.21.15.18:0/2622995096 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8ce406c2b0 0x7f8ce406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:33.693 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.690+0000 7f8cf7fff640 1 --2- 172.21.15.18:0/2622995096 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8ce406c2b0 0x7f8ce406e770 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8009ac0 tx=0x7f8ce8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:33.694 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.694+0000 7f8cf4ff9640 1 -- 172.21.15.18:0/2622995096 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8cf004b340 con 0x7f8cf815ec90 2024-09-19T09:24:33.871 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:33.870+0000 7f8cfe88d640 1 -- 172.21.15.18:0/2622995096 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) -- 0x7f8cf81582e0 con 0x7f8cf815ec90 2024-09-19T09:24:34.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.214+0000 7f8cf4ff9640 1 -- 172.21.15.18:0/2622995096 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v183) ==== 181+0+0 (secure 0 0 0) 0x7f8cf007af00 con 0x7f8cf815ec90 2024-09-19T09:24:34.215 INFO:teuthology.orchestra.run.smithi018.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2024-09-19T09:24:34.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.217+0000 7f8cfe88d640 1 -- 172.21.15.18:0/2622995096 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8ce406c2b0 msgr2=0x7f8ce406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:34.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.217+0000 7f8cfe88d640 1 --2- 172.21.15.18:0/2622995096 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8ce406c2b0 0x7f8ce406e770 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8009ac0 tx=0x7f8ce8008040 comp rx=0 tx=0).stop 2024-09-19T09:24:34.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.217+0000 7f8cfe88d640 1 -- 172.21.15.18:0/2622995096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8cf815ec90 msgr2=0x7f8cf8147cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:34.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.217+0000 7f8cfe88d640 1 --2- 172.21.15.18:0/2622995096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8cf815ec90 0x7f8cf8147cf0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009d90 tx=0x7f8cf0004a40 comp rx=0 tx=0).stop 2024-09-19T09:24:34.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.217+0000 7f8cfe88d640 1 -- 172.21.15.18:0/2622995096 shutdown_connections 2024-09-19T09:24:34.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.217+0000 7f8cfe88d640 1 --2- 172.21.15.18:0/2622995096 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8ce406c2b0 0x7f8ce406e770 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:34.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.217+0000 7f8cfe88d640 1 --2- 172.21.15.18:0/2622995096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8cf815ec90 0x7f8cf8147cf0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:34.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.217+0000 7f8cfe88d640 1 --2- 172.21.15.18:0/2622995096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8cf80b2890 0x7f8cf8161b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:34.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.217+0000 7f8cfe88d640 1 --2- 172.21.15.18:0/2622995096 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8cf806c360 0x7f8cf81f7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:34.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.217+0000 7f8cfe88d640 1 -- 172.21.15.18:0/2622995096 >> 172.21.15.18:0/2622995096 conn(0x7f8cf80b5fc0 msgr2=0x7f8cf815cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:34.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.217+0000 7f8cfe88d640 1 -- 172.21.15.18:0/2622995096 shutdown_connections 2024-09-19T09:24:34.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.217+0000 7f8cfe88d640 1 -- 172.21.15.18:0/2622995096 wait complete. 2024-09-19T09:24:34.230 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-19T09:24:34.345 INFO:teuthology.orchestra.run.smithi018.stdout:{"osd_mon_report_interval":"5"} 2024-09-19T09:24:34.345 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-19T09:24:34.346 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2024-09-19T09:24:34.346 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:24:34.346 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:24:34.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:24:34.362 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2024-09-19T09:24:34.491 INFO:teuthology.orchestra.run.smithi018.stderr:16+0 records in 2024-09-19T09:24:34.491 INFO:teuthology.orchestra.run.smithi018.stderr:16+0 records out 2024-09-19T09:24:34.491 INFO:teuthology.orchestra.run.smithi018.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.068382 s, 245 MB/s 2024-09-19T09:24:34.492 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:24:34.492 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:24:34.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:24:34.509 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2024-09-19T09:24:34.630 INFO:teuthology.orchestra.run.smithi018.stderr:17+0 records in 2024-09-19T09:24:34.630 INFO:teuthology.orchestra.run.smithi018.stderr:17+0 records out 2024-09-19T09:24:34.630 INFO:teuthology.orchestra.run.smithi018.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.0637368 s, 280 MB/s 2024-09-19T09:24:34.630 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2024-09-19T09:24:34.630 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-19T09:24:34.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.731+0000 7f89a8b11640 1 Processor -- start 2024-09-19T09:24:34.732 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.731+0000 7f89a8b11640 1 -- start start 2024-09-19T09:24:34.733 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.732+0000 7f89a8b11640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f89a415eea0 0x7f89a406bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:34.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.732+0000 7f89a8b11640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a40b67b0 0x7f89a406c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:34.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.732+0000 7f89a8b11640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a40b6db0 con 0x7f89a40ced00 2024-09-19T09:24:34.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.732+0000 7f89a8b11640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f89a40b7070 con 0x7f89a415eea0 2024-09-19T09:24:34.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.732+0000 7f89a8b11640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f89a40b1390 con 0x7f89a40b67b0 2024-09-19T09:24:34.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.732+0000 7f89a1d9b640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f89a40ced00 0x7f89a40b60a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:44764/0 (socket says 172.21.15.18:44764) 2024-09-19T09:24:34.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.732+0000 7f89a1d9b640 1 -- 172.21.15.18:0/1037337279 learned_addr learned my addr 172.21.15.18:0/1037337279 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:24:34.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.732+0000 7f89a259c640 1 --2- 172.21.15.18:0/1037337279 >> v2:172.21.15.162:3300/0 conn(0x7f89a415eea0 0x7f89a406bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:34.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.732+0000 7f89a2d9d640 1 --2- 172.21.15.18:0/1037337279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a40b67b0 0x7f89a406c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:34.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.732+0000 7f89a159a640 1 -- 172.21.15.18:0/1037337279 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2124346542 0 0) 0x7f89a40b6db0 con 0x7f89a40ced00 2024-09-19T09:24:34.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.733+0000 7f89a159a640 1 -- 172.21.15.18:0/1037337279 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f898c003520 con 0x7f89a40ced00 2024-09-19T09:24:34.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.733+0000 7f89a159a640 1 -- 172.21.15.18:0/1037337279 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1207858560 0 0) 0x7f898c003520 con 0x7f89a40ced00 2024-09-19T09:24:34.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.733+0000 7f89a2d9d640 1 -- 172.21.15.18:0/1037337279 >> v2:172.21.15.162:3300/0 conn(0x7f89a415eea0 msgr2=0x7f89a406bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:34.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.733+0000 7f89a2d9d640 1 --2- 172.21.15.18:0/1037337279 >> v2:172.21.15.162:3300/0 conn(0x7f89a415eea0 0x7f89a406bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:34.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.733+0000 7f89a2d9d640 1 -- 172.21.15.18:0/1037337279 >> v1:172.21.15.18:6789/0 conn(0x7f89a40ced00 legacy=0x7f89a40b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:34.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.733+0000 7f89a2d9d640 1 -- 172.21.15.18:0/1037337279 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a40b1670 con 0x7f89a40b67b0 2024-09-19T09:24:34.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.733+0000 7f89a259c640 1 --2- 172.21.15.18:0/1037337279 >> v2:172.21.15.162:3300/0 conn(0x7f89a415eea0 0x7f89a406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:24:34.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.734+0000 7f89a2d9d640 1 --2- 172.21.15.18:0/1037337279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a40b67b0 0x7f89a406c150 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f899c009d90 tx=0x7f899c02a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bc58df87ec287a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:34.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.734+0000 7f89a159a640 1 -- 172.21.15.18:0/1037337279 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8998001670 con 0x7f89a40b67b0 2024-09-19T09:24:34.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.734+0000 7f89a159a640 1 -- 172.21.15.18:0/1037337279 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f899c007540 con 0x7f89a40b67b0 2024-09-19T09:24:34.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.734+0000 7f89a159a640 1 -- 172.21.15.18:0/1037337279 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899c0078f0 con 0x7f89a40b67b0 2024-09-19T09:24:34.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.734+0000 7f89a8b11640 1 -- 172.21.15.18:0/1037337279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a40b67b0 msgr2=0x7f89a406c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:34.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.734+0000 7f89a8b11640 1 --2- 172.21.15.18:0/1037337279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a40b67b0 0x7f89a406c150 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f899c009d90 tx=0x7f899c02a5f0 comp rx=0 tx=0).stop 2024-09-19T09:24:34.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.734+0000 7f89a8b11640 1 -- 172.21.15.18:0/1037337279 shutdown_connections 2024-09-19T09:24:34.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.734+0000 7f89a8b11640 1 --2- 172.21.15.18:0/1037337279 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a40b67b0 0x7f89a406c150 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:34.736 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.734+0000 7f89a8b11640 1 --2- 172.21.15.18:0/1037337279 >> v2:172.21.15.162:3300/0 conn(0x7f89a415eea0 0x7f89a406bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:34.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.734+0000 7f89a8b11640 1 -- 172.21.15.18:0/1037337279 >> 172.21.15.18:0/1037337279 conn(0x7f89a40731b0 msgr2=0x7f89a40735c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:34.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.734+0000 7f89a8b11640 1 -- 172.21.15.18:0/1037337279 shutdown_connections 2024-09-19T09:24:34.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.734+0000 7f89a8b11640 1 -- 172.21.15.18:0/1037337279 wait complete. 2024-09-19T09:24:34.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.736+0000 7f89a8b11640 1 Processor -- start 2024-09-19T09:24:34.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.736+0000 7f89a8b11640 1 -- start start 2024-09-19T09:24:34.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.736+0000 7f89a8b11640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a40b67b0 0x7f89a4149550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:34.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.736+0000 7f89a8b11640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89a40ced00 0x7f89a415fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:34.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.736+0000 7f89a8b11640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89a415eea0 0x7f89a41588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:34.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.736+0000 7f89a8b11640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f89a40b1b90 con 0x7f89a415eea0 2024-09-19T09:24:34.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.736+0000 7f89a8b11640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f89a40b1040 con 0x7f89a40ced00 2024-09-19T09:24:34.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.736+0000 7f89a8b11640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f89a40b1d10 con 0x7f89a40b67b0 2024-09-19T09:24:34.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.737+0000 7f89a2d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89a415eea0 0x7f89a41588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:34.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.737+0000 7f89a2d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89a415eea0 0x7f89a41588c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:53124/0 (socket says 172.21.15.18:53124) 2024-09-19T09:24:34.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.737+0000 7f89a2d9d640 1 -- 172.21.15.18:0/2472533946 learned_addr learned my addr 172.21.15.18:0/2472533946 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:34.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.737+0000 7f89a259c640 1 --2- 172.21.15.18:0/2472533946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a40b67b0 0x7f89a4149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:34.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.737+0000 7f89a1d9b640 1 --2- 172.21.15.18:0/2472533946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89a40ced00 0x7f89a415fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:34.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.737+0000 7f89a2d9d640 1 -- 172.21.15.18:0/2472533946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a40b67b0 msgr2=0x7f89a4149550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:34.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.737+0000 7f89a2d9d640 1 --2- 172.21.15.18:0/2472533946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a40b67b0 0x7f89a4149550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:34.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.737+0000 7f89a2d9d640 1 -- 172.21.15.18:0/2472533946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89a40ced00 msgr2=0x7f89a415fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:34.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.737+0000 7f89a2d9d640 1 --2- 172.21.15.18:0/2472533946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89a40ced00 0x7f89a415fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:34.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.737+0000 7f89a2d9d640 1 -- 172.21.15.18:0/2472533946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a4149a90 con 0x7f89a415eea0 2024-09-19T09:24:34.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.737+0000 7f89a2d9d640 1 --2- 172.21.15.18:0/2472533946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89a415eea0 0x7f89a41588c0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f899c009eb0 tx=0x7f899c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:34.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.737+0000 7f8992ffd640 1 -- 172.21.15.18:0/2472533946 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899c040070 con 0x7f89a415eea0 2024-09-19T09:24:34.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.737+0000 7f8992ffd640 1 -- 172.21.15.18:0/2472533946 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f899c031c40 con 0x7f89a415eea0 2024-09-19T09:24:34.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.737+0000 7f8992ffd640 1 -- 172.21.15.18:0/2472533946 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f899c009450 con 0x7f89a415eea0 2024-09-19T09:24:34.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.737+0000 7f89a8b11640 1 -- 172.21.15.18:0/2472533946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89a4160da0 con 0x7f89a415eea0 2024-09-19T09:24:34.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.737+0000 7f89a8b11640 1 -- 172.21.15.18:0/2472533946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89a4161360 con 0x7f89a415eea0 2024-09-19T09:24:34.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.738+0000 7f89a8b11640 1 -- 172.21.15.18:0/2472533946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89a40b60a0 con 0x7f89a415eea0 2024-09-19T09:24:34.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.739+0000 7f8992ffd640 1 -- 172.21.15.18:0/2472533946 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f899c039040 con 0x7f89a415eea0 2024-09-19T09:24:34.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.739+0000 7f8992ffd640 1 --2- 172.21.15.18:0/2472533946 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f898406c2b0 0x7f898406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:34.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.739+0000 7f8992ffd640 1 -- 172.21.15.18:0/2472533946 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7f899c0ac750 con 0x7f89a415eea0 2024-09-19T09:24:34.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.739+0000 7f89a259c640 1 --2- 172.21.15.18:0/2472533946 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f898406c2b0 0x7f898406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:34.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.740+0000 7f89a259c640 1 --2- 172.21.15.18:0/2472533946 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f898406c2b0 0x7f898406e770 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8994009560 tx=0x7f8994009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:34.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.744+0000 7f8992ffd640 1 -- 172.21.15.18:0/2472533946 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f89a4149a90 con 0x7f89a415eea0 2024-09-19T09:24:34.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.923+0000 7f89a8b11640 1 -- 172.21.15.18:0/2472533946 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f89a406fa60 con 0x7f89a415eea0 2024-09-19T09:24:34.925 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.924+0000 7f8992ffd640 1 -- 172.21.15.18:0/2472533946 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v183) ==== 81+0+34290 (secure 0 0 0) 0x7f899c07a7d0 con 0x7f89a415eea0 2024-09-19T09:24:34.925 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:24:34.925 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:24:34.925 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 183, 2024-09-19T09:24:34.926 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:24:34.926 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-19T09:13:11.348786+0000", 2024-09-19T09:24:34.926 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-19T09:24:34.211416+0000", 2024-09-19T09:24:34.926 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-19T09:13:16.423937+0000", 2024-09-19T09:24:34.926 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-19T09:13:13.417141+0000", 2024-09-19T09:24:34.926 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-19T09:24:34.926 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-09-19T09:24:34.926 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-19T09:24:34.926 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-19T09:24:34.926 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-19T09:24:34.926 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-19T09:24:34.926 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-19T09:24:34.926 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:34.926 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-19T09:24:34.927 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.69999998807907104, 2024-09-19T09:24:34.927 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-19T09:24:34.927 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-19T09:24:34.927 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-19T09:24:34.927 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 23, 2024-09-19T09:24:34.927 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-19T09:24:34.927 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-19T09:24:34.927 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "jewel", 2024-09-19T09:24:34.927 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-19T09:24:34.927 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-19T09:24:34.927 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-19T09:24:34.927 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.927 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-19T09:24:34.928 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-19T09:24:34.928 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:13:17.564717+0000", 2024-09-19T09:24:34.928 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:24:34.928 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:24:34.928 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:24:34.928 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:24:34.928 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:24:34.928 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:24:34.928 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:24:34.928 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:24:34.928 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:24:34.928 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:24:34.928 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:24:34.929 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:24:34.929 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:24:34.929 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-19T09:24:34.929 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-19T09:24:34.929 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-19T09:24:34.929 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-19T09:24:34.929 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-19T09:24:34.929 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:24:34.929 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:24:34.929 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:24:34.929 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:24:34.929 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:24:34.929 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:24:34.929 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:24:34.930 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.930 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "111", 2024-09-19T09:24:34.930 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:24:34.930 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:24:34.930 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:24:34.930 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:24:34.930 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:24:34.930 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:24:34.930 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:24:34.930 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:24:34.930 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:24:34.930 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:24:34.930 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:24:34.930 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:24:34.931 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:24:34.931 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:24:34.931 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:24:34.931 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:24:34.931 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:24:34.931 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:24:34.931 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:24:34.931 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:24:34.931 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:24:34.931 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:24:34.931 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:24:34.931 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:24:34.931 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:24:34.931 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:24:34.932 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.932 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:24:34.932 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:24:34.932 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:24:34.932 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:24:34.932 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:24:34.932 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:24:34.932 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:24:34.932 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:24:34.932 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:24:34.932 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:24:34.932 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:24:34.932 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:24:34.933 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-19T09:24:34.933 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-19T09:24:34.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.933 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:24:34.933 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-19T09:24:34.933 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.933 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:24:34.933 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:24:34.933 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-19T09:24:34.933 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-19T09:24:34.933 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-19T09:24:34.933 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-19T09:24:34.933 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-19T09:24:34.933 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:24:34.934 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:24:34.934 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:24:34.934 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.934 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.934 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.934 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 22, 2024-09-19T09:24:34.934 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_metadata", 2024-09-19T09:24:34.934 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:24:23.190145+0000", 2024-09-19T09:24:34.934 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:24:34.934 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:24:34.934 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:24:34.934 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:24:34.934 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:24:34.934 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:24:34.935 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:24:34.935 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:24:34.935 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:24:34.935 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:24:34.935 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:24:34.935 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:24:34.935 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:24:34.935 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-19T09:24:34.935 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-19T09:24:34.935 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-19T09:24:34.935 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-19T09:24:34.935 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-19T09:24:34.935 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:24:34.936 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:24:34.936 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:24:34.936 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:24:34.936 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:24:34.936 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:24:34.936 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:24:34.936 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.936 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "181", 2024-09-19T09:24:34.936 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:24:34.936 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:24:34.936 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:24:34.936 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:24:34.936 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:24:34.937 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:24:34.937 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:24:34.937 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:24:34.937 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:24:34.937 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:24:34.937 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:24:34.937 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:24:34.937 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:24:34.937 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:24:34.937 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:24:34.937 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:24:34.937 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:24:34.937 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:24:34.937 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:24:34.938 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:24:34.938 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:24:34.938 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:24:34.938 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:24:34.938 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:24:34.938 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:24:34.938 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:24:34.938 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.938 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:24:34.938 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:24:34.938 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:24:34.938 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:24:34.938 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:24:34.938 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:24:34.939 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:24:34.939 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:24:34.939 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:24:34.939 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:24:34.939 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:24:34.939 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:24:34.939 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4, 2024-09-19T09:24:34.939 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 16, 2024-09-19T09:24:34.939 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_priority": 5 2024-09-19T09:24:34.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.940 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:24:34.940 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:24:34.940 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": "cephfs" 2024-09-19T09:24:34.940 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.940 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.940 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:24:34.940 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:24:34.940 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.5, 2024-09-19T09:24:34.940 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.5, 2024-09-19T09:24:34.940 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:24:34.940 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.5, 2024-09-19T09:24:34.940 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.5, 2024-09-19T09:24:34.940 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:24:34.941 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:24:34.941 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:24:34.941 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.941 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.941 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.941 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 23, 2024-09-19T09:24:34.941 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_data", 2024-09-19T09:24:34.941 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:24:24.517971+0000", 2024-09-19T09:24:34.941 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:24:34.941 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:24:34.941 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:24:34.941 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:24:34.941 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:24:34.941 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:24:34.942 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:24:34.942 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:24:34.942 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:24:34.942 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:24:34.942 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:24:34.942 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:24:34.942 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:24:34.942 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 64, 2024-09-19T09:24:34.942 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 64, 2024-09-19T09:24:34.942 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 64, 2024-09-19T09:24:34.942 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 64, 2024-09-19T09:24:34.942 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 64, 2024-09-19T09:24:34.942 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:24:34.942 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:24:34.943 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:24:34.943 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:24:34.943 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:24:34.943 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:24:34.943 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:24:34.943 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.943 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "183", 2024-09-19T09:24:34.943 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:24:34.943 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:24:34.943 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:24:34.943 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:24:34.943 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:24:34.943 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:24:34.944 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:24:34.944 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:24:34.944 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:24:34.944 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 33554432, 2024-09-19T09:24:34.944 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:24:34.944 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:24:34.944 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:24:34.944 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:24:34.944 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:24:34.944 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:24:34.944 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:24:34.944 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:24:34.944 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:24:34.945 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:24:34.945 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:24:34.945 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:24:34.945 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:24:34.945 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:24:34.945 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:24:34.945 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:24:34.945 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.945 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:24:34.945 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:24:34.945 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:24:34.945 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:24:34.945 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:24:34.945 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:24:34.946 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:24:34.946 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:24:34.946 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:24:34.946 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:24:34.946 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:24:34.946 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:24:34.946 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 64, 2024-09-19T09:24:34.946 INFO:teuthology.orchestra.run.smithi018.stdout: "target_size_ratio": 0.89999997615814209 2024-09-19T09:24:34.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.946 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:24:34.946 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:24:34.946 INFO:teuthology.orchestra.run.smithi018.stdout: "data": "cephfs" 2024-09-19T09:24:34.946 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.946 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.947 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:24:34.947 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:24:34.947 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.3799999952316284, 2024-09-19T09:24:34.947 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.3799999952316284, 2024-09-19T09:24:34.947 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:24:34.947 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-19T09:24:34.947 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-19T09:24:34.947 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:24:34.947 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:24:34.947 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:24:34.947 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.947 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.947 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:34.947 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-19T09:24:34.948 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.948 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:24:34.948 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:34.948 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:34.948 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:34.948 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:34.948 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:34.948 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:34.948 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:34.948 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:34.948 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:34.948 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:34.948 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:34.949 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:34.949 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.949 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.949 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-19T09:24:34.949 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:34.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.949 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.949 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.949 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-19T09:24:34.949 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:34.949 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.949 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.949 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.950 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:34.950 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.950 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.950 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-19T09:24:34.950 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:34.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.950 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.950 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.950 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-19T09:24:34.950 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:34.950 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.950 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.950 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.951 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:34.951 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.951 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.951 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-19T09:24:34.951 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:34.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.951 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.951 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.951 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-19T09:24:34.951 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:34.951 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.951 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.951 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.952 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:34.952 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.952 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.952 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-19T09:24:34.952 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:34.952 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.952 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.952 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.952 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-19T09:24:34.952 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:34.952 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.952 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.953 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/128722874", 2024-09-19T09:24:34.953 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/128722874", 2024-09-19T09:24:34.953 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/128722874", 2024-09-19T09:24:34.953 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/128722874", 2024-09-19T09:24:34.953 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:34.953 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:34.953 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:34.953 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.953 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.953 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.953 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:24:34.953 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:34.953 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:34.954 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:34.954 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:34.954 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:34.954 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:34.954 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:34.954 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:34.954 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:34.954 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:34.954 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:34.954 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:34.954 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.954 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.954 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.954 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-19T09:24:34.955 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:34.955 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.955 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.955 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.955 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-19T09:24:34.955 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:34.955 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.955 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.956 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:34.956 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.956 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.956 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-19T09:24:34.956 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:34.956 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.956 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.956 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.956 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-19T09:24:34.956 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:34.956 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.957 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.957 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:34.957 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.957 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.957 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-19T09:24:34.957 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:34.957 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.957 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.957 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.957 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-19T09:24:34.957 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:34.957 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.958 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.958 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:34.958 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.958 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.958 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-19T09:24:34.958 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:34.958 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.958 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.958 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.958 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-19T09:24:34.958 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:34.959 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.959 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.959 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/3672199638", 2024-09-19T09:24:34.959 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/3672199638", 2024-09-19T09:24:34.959 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/3672199638", 2024-09-19T09:24:34.959 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/3672199638", 2024-09-19T09:24:34.959 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:34.959 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:34.959 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:34.959 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.959 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.959 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.960 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:24:34.960 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:34.960 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:34.960 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:34.960 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:34.960 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:34.960 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:34.960 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:34.960 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:34.960 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:34.960 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:34.960 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:34.960 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:34.960 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.961 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.961 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.961 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T09:24:34.961 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:34.961 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.961 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.961 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.961 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T09:24:34.961 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:34.961 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.961 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.961 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.961 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:34.962 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.962 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.962 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-19T09:24:34.962 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:34.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.962 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.962 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.962 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-19T09:24:34.962 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:34.962 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.962 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.962 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.962 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:34.963 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.963 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.963 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-19T09:24:34.963 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:34.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.963 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.963 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.963 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-19T09:24:34.963 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:34.963 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.963 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.963 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.963 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:34.964 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.964 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.964 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-19T09:24:34.964 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:34.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.964 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.964 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.964 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-19T09:24:34.964 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:34.964 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.964 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.964 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.965 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3463367841", 2024-09-19T09:24:34.965 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3463367841", 2024-09-19T09:24:34.965 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3463367841", 2024-09-19T09:24:34.965 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3463367841", 2024-09-19T09:24:34.965 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:34.965 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:34.965 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:34.965 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.965 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.965 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.965 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:24:34.965 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:34.965 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:34.965 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:34.966 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:34.966 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:34.966 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:34.966 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:34.966 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:34.966 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:34.966 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:34.966 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:34.966 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:34.966 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.966 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.966 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.966 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-19T09:24:34.967 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:34.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.967 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.967 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-19T09:24:34.967 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:34.967 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.967 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.967 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.967 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:34.967 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.967 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.967 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.967 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-19T09:24:34.968 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:34.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.968 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.968 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-19T09:24:34.968 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:34.968 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.968 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.968 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.968 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:34.968 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.968 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.968 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.969 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-19T09:24:34.969 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:34.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.969 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.969 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-19T09:24:34.969 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:34.969 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.969 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.969 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.969 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:34.969 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.969 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.970 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.970 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-19T09:24:34.970 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:34.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.970 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.970 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.970 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-19T09:24:34.970 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:34.970 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.970 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.970 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.970 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/4163178582", 2024-09-19T09:24:34.970 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/4163178582", 2024-09-19T09:24:34.970 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/4163178582", 2024-09-19T09:24:34.971 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/4163178582", 2024-09-19T09:24:34.971 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:34.971 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:34.971 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:34.971 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.971 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.971 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.971 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:24:34.971 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:34.971 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:34.971 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:34.971 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:34.971 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:34.972 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:34.972 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:34.972 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:34.972 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:34.972 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:34.972 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:34.972 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:34.972 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.972 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.972 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.972 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6822", 2024-09-19T09:24:34.972 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:34.972 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.973 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.973 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6824", 2024-09-19T09:24:34.973 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:34.973 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.973 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.973 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.973 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:34.973 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.973 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.973 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.973 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6826", 2024-09-19T09:24:34.973 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:34.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.974 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.974 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6827", 2024-09-19T09:24:34.974 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:34.974 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.974 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.974 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.974 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:34.974 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.974 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.974 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.974 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6830", 2024-09-19T09:24:34.974 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:34.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.975 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.975 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6831", 2024-09-19T09:24:34.975 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:34.975 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.975 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.975 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.975 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:34.975 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.975 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.975 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.975 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6828", 2024-09-19T09:24:34.975 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:34.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.976 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.976 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.976 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6829", 2024-09-19T09:24:34.976 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:34.976 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.976 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.976 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.976 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6824/3538482215", 2024-09-19T09:24:34.976 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6827/3538482215", 2024-09-19T09:24:34.976 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6831/3538482215", 2024-09-19T09:24:34.976 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6829/3538482215", 2024-09-19T09:24:34.976 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:34.976 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:34.977 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:34.977 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.977 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.977 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.977 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:24:34.977 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:34.977 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:34.977 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:34.977 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:34.977 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:34.977 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:34.977 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:34.977 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:34.977 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:34.978 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:34.978 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:34.978 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:34.978 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.978 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.978 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6800", 2024-09-19T09:24:34.978 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:34.978 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.978 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.978 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.978 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6801", 2024-09-19T09:24:34.978 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:34.978 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.979 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.979 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:34.979 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.979 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.979 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6802", 2024-09-19T09:24:34.979 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:34.979 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.979 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.979 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.979 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6803", 2024-09-19T09:24:34.979 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:34.980 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.980 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.980 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:34.980 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.980 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.980 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6806", 2024-09-19T09:24:34.980 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:34.980 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.980 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.980 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.981 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6807", 2024-09-19T09:24:34.981 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:34.981 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.981 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.981 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:34.981 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.981 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.981 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6804", 2024-09-19T09:24:34.981 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:34.981 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.981 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.981 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.982 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6805", 2024-09-19T09:24:34.982 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:34.982 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.982 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.982 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6801/2408698413", 2024-09-19T09:24:34.982 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6803/2408698413", 2024-09-19T09:24:34.982 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6807/2408698413", 2024-09-19T09:24:34.982 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6805/2408698413", 2024-09-19T09:24:34.982 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:34.982 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:34.982 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:34.982 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.982 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.983 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.983 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:24:34.983 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:34.983 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:34.983 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:34.983 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:34.983 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:34.983 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:34.983 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:34.983 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:34.983 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:34.983 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:34.983 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:34.983 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:34.984 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.984 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.984 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6808", 2024-09-19T09:24:34.984 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:34.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.984 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.984 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.984 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6809", 2024-09-19T09:24:34.984 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:34.984 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.984 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.984 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.984 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:34.985 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.985 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.985 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6810", 2024-09-19T09:24:34.985 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:34.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.985 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.985 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.985 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6811", 2024-09-19T09:24:34.985 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:34.985 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.985 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.985 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.986 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:34.986 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.986 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.986 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6814", 2024-09-19T09:24:34.986 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:34.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.986 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.986 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.986 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6815", 2024-09-19T09:24:34.986 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:34.986 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.986 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.986 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.987 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:34.987 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.987 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.987 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6812", 2024-09-19T09:24:34.987 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:34.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.987 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.987 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.987 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6813", 2024-09-19T09:24:34.987 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:34.987 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.987 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.987 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.988 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6809/2596207948", 2024-09-19T09:24:34.988 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6811/2596207948", 2024-09-19T09:24:34.988 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6815/2596207948", 2024-09-19T09:24:34.988 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6813/2596207948", 2024-09-19T09:24:34.988 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:34.988 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:34.988 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:34.988 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.988 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.988 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.988 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:24:34.988 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:34.988 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:34.989 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:34.989 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:34.989 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:34.989 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:34.989 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:34.989 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:34.989 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:34.989 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:34.989 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:34.989 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:34.989 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.989 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.989 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.989 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6816", 2024-09-19T09:24:34.990 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:34.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.990 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.990 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6817", 2024-09-19T09:24:34.990 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:34.990 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.990 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.990 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.990 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:34.990 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.990 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.990 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.990 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6818", 2024-09-19T09:24:34.991 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:34.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.991 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.991 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6819", 2024-09-19T09:24:34.991 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:34.991 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.991 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.991 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.991 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:34.991 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.991 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.991 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.991 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6823", 2024-09-19T09:24:34.992 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:34.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.992 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.992 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6825", 2024-09-19T09:24:34.992 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:34.992 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.992 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.992 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.992 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:34.992 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:34.992 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.992 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:34.992 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6820", 2024-09-19T09:24:34.993 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:34.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.993 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.993 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:34.993 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6821", 2024-09-19T09:24:34.993 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:34.993 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.993 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.993 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.993 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6817/1334618296", 2024-09-19T09:24:34.993 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6819/1334618296", 2024-09-19T09:24:34.993 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6825/1334618296", 2024-09-19T09:24:34.993 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6821/1334618296", 2024-09-19T09:24:34.994 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:34.994 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:34.994 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:34.994 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:34.994 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:34.994 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:34.994 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-19T09:24:34.994 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.994 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:24:34.994 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:34.994 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:34.994 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:34.994 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:34.994 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:34.995 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.580838+0000", 2024-09-19T09:24:34.995 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:34.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.995 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:24:34.995 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:34.995 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:34.995 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:34.995 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:34.995 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:34.995 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.599990+0000", 2024-09-19T09:24:34.995 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:34.995 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.995 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.996 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:24:34.996 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:34.996 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:34.996 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:34.996 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:34.996 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:34.996 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.503722+0000", 2024-09-19T09:24:34.996 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:34.996 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.996 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.996 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:24:34.996 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:34.996 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:34.996 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:34.997 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:34.997 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:34.997 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.607846+0000", 2024-09-19T09:24:34.997 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:34.997 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.997 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.997 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:24:34.997 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:34.997 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:34.997 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:34.997 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:34.998 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:34.998 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.616858+0000", 2024-09-19T09:24:34.998 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:34.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.998 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.998 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:24:34.998 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:34.998 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:34.998 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:34.998 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:34.998 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:34.998 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.542726+0000", 2024-09-19T09:24:34.998 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:34.998 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.999 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:24:34.999 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:34.999 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:34.999 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:34.999 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:34.999 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:34.999 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.534178+0000", 2024-09-19T09:24:34.999 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:34.999 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:34.999 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:34.999 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:24:34.999 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:34.999 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:35.000 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:35.000 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:35.000 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:35.000 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.612105+0000", 2024-09-19T09:24:35.000 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:35.000 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:35.000 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:35.000 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-19T09:24:35.000 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-19T09:24:35.000 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-19T09:24:35.000 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-19T09:24:35.000 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-19T09:24:35.000 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-19T09:24:35.001 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-19T09:24:35.001 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-19T09:24:35.001 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-19T09:24:35.001 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-19T09:24:35.001 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-19T09:24:35.001 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-19T09:24:35.001 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-19T09:24:35.001 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-19T09:24:35.001 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:35.001 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:35.001 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-19T09:24:35.001 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-19T09:24:35.001 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-19T09:24:35.001 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-19T09:24:35.002 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-19T09:24:35.002 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-19T09:24:35.002 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-19T09:24:35.002 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-19T09:24:35.002 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-19T09:24:35.002 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-19T09:24:35.002 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-19T09:24:35.002 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:35.002 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:24:35.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.926+0000 7f89a8b11640 1 -- 172.21.15.18:0/2472533946 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f898406c2b0 msgr2=0x7f898406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:35.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.926+0000 7f89a8b11640 1 --2- 172.21.15.18:0/2472533946 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f898406c2b0 0x7f898406e770 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8994009560 tx=0x7f8994009190 comp rx=0 tx=0).stop 2024-09-19T09:24:35.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.926+0000 7f89a8b11640 1 -- 172.21.15.18:0/2472533946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89a415eea0 msgr2=0x7f89a41588c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:35.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.926+0000 7f89a8b11640 1 --2- 172.21.15.18:0/2472533946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89a415eea0 0x7f89a41588c0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f899c009eb0 tx=0x7f899c004a40 comp rx=0 tx=0).stop 2024-09-19T09:24:35.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.926+0000 7f89a8b11640 1 -- 172.21.15.18:0/2472533946 shutdown_connections 2024-09-19T09:24:35.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.926+0000 7f89a8b11640 1 --2- 172.21.15.18:0/2472533946 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f898406c2b0 0x7f898406e770 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:35.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.926+0000 7f89a8b11640 1 --2- 172.21.15.18:0/2472533946 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89a415eea0 0x7f89a41588c0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:35.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.926+0000 7f89a8b11640 1 --2- 172.21.15.18:0/2472533946 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89a40ced00 0x7f89a415fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:35.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.926+0000 7f89a8b11640 1 --2- 172.21.15.18:0/2472533946 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89a40b67b0 0x7f89a4149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:35.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.926+0000 7f89a8b11640 1 -- 172.21.15.18:0/2472533946 >> 172.21.15.18:0/2472533946 conn(0x7f89a40731b0 msgr2=0x7f89a40b2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:35.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.926+0000 7f89a8b11640 1 -- 172.21.15.18:0/2472533946 shutdown_connections 2024-09-19T09:24:35.004 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:34.926+0000 7f89a8b11640 1 -- 172.21.15.18:0/2472533946 wait complete. 2024-09-19T09:24:35.005 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-19T09:24:40.007 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-19T09:24:40.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.122+0000 7fcf851be640 1 Processor -- start 2024-09-19T09:24:40.123 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.122+0000 7fcf851be640 1 -- start start 2024-09-19T09:24:40.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.123+0000 7fcf851be640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcf8013fae0 0x7fcf8006f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:40.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.123+0000 7fcf851be640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf80142650 con 0x7fcf80160c50 2024-09-19T09:24:40.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.123+0000 7fcf851be640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf80142930 con 0x7fcf80142150 2024-09-19T09:24:40.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.123+0000 7fcf851be640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fcf800ce780 con 0x7fcf8013fae0 2024-09-19T09:24:40.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.123+0000 7fcf7f59e640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fcf80160c50 0x7fcf800cec10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:35774/0 (socket says 172.21.15.18:35774) 2024-09-19T09:24:40.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.123+0000 7fcf7f59e640 1 -- 172.21.15.18:0/1383972386 learned_addr learned my addr 172.21.15.18:0/1383972386 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:24:40.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.123+0000 7fcf7ed9d640 1 --2- 172.21.15.18:0/1383972386 >> v2:172.21.15.162:3300/0 conn(0x7fcf8013fae0 0x7fcf8006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:40.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.124+0000 7fcf7dd9b640 1 -- 172.21.15.18:0/1383972386 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4154466577 0 0) 0x7fcf80142650 con 0x7fcf80160c50 2024-09-19T09:24:40.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.124+0000 7fcf7dd9b640 1 -- 172.21.15.18:0/1383972386 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf6c003520 con 0x7fcf80160c50 2024-09-19T09:24:40.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.124+0000 7fcf7dd9b640 1 -- 172.21.15.18:0/1383972386 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2863368598 0 0) 0x7fcf80142930 con 0x7fcf80142150 2024-09-19T09:24:40.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.124+0000 7fcf7dd9b640 1 -- 172.21.15.18:0/1383972386 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf80142650 con 0x7fcf80142150 2024-09-19T09:24:40.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.124+0000 7fcf7ed9d640 1 -- 172.21.15.18:0/1383972386 >> v1:172.21.15.162:6789/0 conn(0x7fcf80142150 legacy=0x7fcf80160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:40.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.124+0000 7fcf7dd9b640 1 -- 172.21.15.18:0/1383972386 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1488410533 0 0) 0x7fcf6c003520 con 0x7fcf80160c50 2024-09-19T09:24:40.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.124+0000 7fcf7ed9d640 1 -- 172.21.15.18:0/1383972386 >> v1:172.21.15.18:6789/0 conn(0x7fcf80160c50 legacy=0x7fcf800cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:40.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.124+0000 7fcf7ed9d640 1 -- 172.21.15.18:0/1383972386 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf80142c10 con 0x7fcf8013fae0 2024-09-19T09:24:40.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.125+0000 7fcf7ed9d640 1 --2- 172.21.15.18:0/1383972386 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf8013fae0 0x7fcf8006f1b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fcf700097a0 tx=0x7fcf7002a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1b1eeef4ab717ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:40.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.125+0000 7fcf7dd9b640 1 -- 172.21.15.18:0/1383972386 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf70037070 con 0x7fcf8013fae0 2024-09-19T09:24:40.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.125+0000 7fcf7dd9b640 1 -- 172.21.15.18:0/1383972386 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf7002abc0 con 0x7fcf8013fae0 2024-09-19T09:24:40.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.125+0000 7fcf7dd9b640 1 -- 172.21.15.18:0/1383972386 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf780019f0 con 0x7fcf8013fae0 2024-09-19T09:24:40.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.125+0000 7fcf851be640 1 -- 172.21.15.18:0/1383972386 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf8013fae0 msgr2=0x7fcf8006f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:40.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.125+0000 7fcf851be640 1 --2- 172.21.15.18:0/1383972386 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf8013fae0 0x7fcf8006f1b0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fcf700097a0 tx=0x7fcf7002a130 comp rx=0 tx=0).stop 2024-09-19T09:24:40.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.125+0000 7fcf851be640 1 -- 172.21.15.18:0/1383972386 shutdown_connections 2024-09-19T09:24:40.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.125+0000 7fcf851be640 1 --2- 172.21.15.18:0/1383972386 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf8013fae0 0x7fcf8006f1b0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:40.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.125+0000 7fcf851be640 1 -- 172.21.15.18:0/1383972386 >> 172.21.15.18:0/1383972386 conn(0x7fcf8006bc10 msgr2=0x7fcf8006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:40.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.125+0000 7fcf851be640 1 -- 172.21.15.18:0/1383972386 shutdown_connections 2024-09-19T09:24:40.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.125+0000 7fcf851be640 1 -- 172.21.15.18:0/1383972386 wait complete. 2024-09-19T09:24:40.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.127+0000 7fcf851be640 1 Processor -- start 2024-09-19T09:24:40.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.127+0000 7fcf851be640 1 -- start start 2024-09-19T09:24:40.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.128+0000 7fcf851be640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf8013fae0 0x7fcf80072b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:40.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.128+0000 7fcf851be640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf80142150 0x7fcf8015a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:40.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.128+0000 7fcf851be640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf80160c50 0x7fcf801560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:40.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.128+0000 7fcf851be640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8006f870 con 0x7fcf80160c50 2024-09-19T09:24:40.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.128+0000 7fcf851be640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8006f6f0 con 0x7fcf8013fae0 2024-09-19T09:24:40.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.128+0000 7fcf851be640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcf800cf320 con 0x7fcf80142150 2024-09-19T09:24:40.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.128+0000 7fcf7f59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf80160c50 0x7fcf801560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:40.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.128+0000 7fcf7f59e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf80160c50 0x7fcf801560d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:51644/0 (socket says 172.21.15.18:51644) 2024-09-19T09:24:40.130 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.128+0000 7fcf7f59e640 1 -- 172.21.15.18:0/3041429398 learned_addr learned my addr 172.21.15.18:0/3041429398 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:40.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.128+0000 7fcf7e59c640 1 --2- 172.21.15.18:0/3041429398 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf80142150 0x7fcf8015a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:40.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.128+0000 7fcf7ed9d640 1 --2- 172.21.15.18:0/3041429398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf8013fae0 0x7fcf80072b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:40.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.128+0000 7fcf7f59e640 1 -- 172.21.15.18:0/3041429398 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf80142150 msgr2=0x7fcf8015a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:40.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.128+0000 7fcf7f59e640 1 --2- 172.21.15.18:0/3041429398 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf80142150 0x7fcf8015a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:40.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.128+0000 7fcf7f59e640 1 -- 172.21.15.18:0/3041429398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf8013fae0 msgr2=0x7fcf80072b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:40.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.128+0000 7fcf7f59e640 1 --2- 172.21.15.18:0/3041429398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf8013fae0 0x7fcf80072b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:40.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.128+0000 7fcf7f59e640 1 -- 172.21.15.18:0/3041429398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf8015b140 con 0x7fcf80160c50 2024-09-19T09:24:40.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.128+0000 7fcf7ed9d640 1 --2- 172.21.15.18:0/3041429398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf8013fae0 0x7fcf80072b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:40.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.128+0000 7fcf7f59e640 1 --2- 172.21.15.18:0/3041429398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf80160c50 0x7fcf801560d0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fcf7800cbf0 tx=0x7fcf7800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:40.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.129+0000 7fcf777fe640 1 -- 172.21.15.18:0/3041429398 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf78017070 con 0x7fcf80160c50 2024-09-19T09:24:40.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.129+0000 7fcf777fe640 1 -- 172.21.15.18:0/3041429398 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf7800ac60 con 0x7fcf80160c50 2024-09-19T09:24:40.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.129+0000 7fcf851be640 1 -- 172.21.15.18:0/3041429398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf8015b420 con 0x7fcf80160c50 2024-09-19T09:24:40.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.129+0000 7fcf777fe640 1 -- 172.21.15.18:0/3041429398 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf78012640 con 0x7fcf80160c50 2024-09-19T09:24:40.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.129+0000 7fcf851be640 1 -- 172.21.15.18:0/3041429398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf8015b9e0 con 0x7fcf80160c50 2024-09-19T09:24:40.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.130+0000 7fcf851be640 1 -- 172.21.15.18:0/3041429398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf8006f1b0 con 0x7fcf80160c50 2024-09-19T09:24:40.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.130+0000 7fcf777fe640 1 -- 172.21.15.18:0/3041429398 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcf7801a070 con 0x7fcf80160c50 2024-09-19T09:24:40.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.131+0000 7fcf777fe640 1 --2- 172.21.15.18:0/3041429398 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcf6006c2b0 0x7fcf6006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:40.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.131+0000 7fcf777fe640 1 -- 172.21.15.18:0/3041429398 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(183..183 src has 1..183) ==== 5709+0+0 (secure 0 0 0) 0x7fcf7808b260 con 0x7fcf80160c50 2024-09-19T09:24:40.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.131+0000 7fcf7ed9d640 1 --2- 172.21.15.18:0/3041429398 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcf6006c2b0 0x7fcf6006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:40.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.132+0000 7fcf7ed9d640 1 --2- 172.21.15.18:0/3041429398 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcf6006c2b0 0x7fcf6006e770 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fcf70034000 tx=0x7fcf7002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:40.136 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.135+0000 7fcf777fe640 1 -- 172.21.15.18:0/3041429398 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fcf78059a60 con 0x7fcf80160c50 2024-09-19T09:24:40.317 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.317+0000 7fcf851be640 1 -- 172.21.15.18:0/3041429398 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fcf80068fc0 con 0x7fcf80160c50 2024-09-19T09:24:40.319 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.318+0000 7fcf777fe640 1 -- 172.21.15.18:0/3041429398 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v183) ==== 81+0+34290 (secure 0 0 0) 0x7fcf78059360 con 0x7fcf80160c50 2024-09-19T09:24:40.319 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:24:40.320 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:24:40.320 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 183, 2024-09-19T09:24:40.320 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:24:40.320 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-19T09:13:11.348786+0000", 2024-09-19T09:24:40.320 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-19T09:24:34.211416+0000", 2024-09-19T09:24:40.320 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-19T09:13:16.423937+0000", 2024-09-19T09:24:40.320 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-19T09:13:13.417141+0000", 2024-09-19T09:24:40.320 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-19T09:24:40.320 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-09-19T09:24:40.320 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-19T09:24:40.320 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-19T09:24:40.320 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-19T09:24:40.321 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-19T09:24:40.321 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-19T09:24:40.321 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:40.321 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-19T09:24:40.321 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.69999998807907104, 2024-09-19T09:24:40.321 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-19T09:24:40.321 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-19T09:24:40.321 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-19T09:24:40.321 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 23, 2024-09-19T09:24:40.321 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-19T09:24:40.321 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-19T09:24:40.321 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "jewel", 2024-09-19T09:24:40.321 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-19T09:24:40.322 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-19T09:24:40.322 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-19T09:24:40.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.322 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-19T09:24:40.322 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-19T09:24:40.322 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:13:17.564717+0000", 2024-09-19T09:24:40.322 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:24:40.322 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:24:40.322 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:24:40.322 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:24:40.322 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:24:40.322 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:24:40.322 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:24:40.323 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:24:40.323 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:24:40.323 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:24:40.323 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:24:40.323 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:24:40.323 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:24:40.323 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-19T09:24:40.323 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-19T09:24:40.323 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-19T09:24:40.323 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-19T09:24:40.323 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-19T09:24:40.324 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:24:40.324 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:24:40.324 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:24:40.324 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:24:40.324 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:24:40.324 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:24:40.325 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:24:40.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.325 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "111", 2024-09-19T09:24:40.325 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:24:40.325 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:24:40.326 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:24:40.326 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:24:40.326 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:24:40.326 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:24:40.326 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:24:40.326 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:24:40.326 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:24:40.326 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:24:40.326 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:24:40.327 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:24:40.327 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:24:40.327 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:24:40.327 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:24:40.327 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:24:40.327 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:24:40.327 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:24:40.327 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:24:40.327 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:24:40.327 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:24:40.327 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:24:40.327 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:24:40.327 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:24:40.327 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:24:40.328 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:24:40.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.328 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:24:40.328 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:24:40.328 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:24:40.328 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:24:40.328 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:24:40.328 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:24:40.328 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:24:40.328 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:24:40.328 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:24:40.328 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:24:40.328 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:24:40.328 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:24:40.329 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-19T09:24:40.329 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-19T09:24:40.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.329 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:24:40.329 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-19T09:24:40.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.329 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:24:40.329 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:24:40.329 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-19T09:24:40.329 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-19T09:24:40.329 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-19T09:24:40.329 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-19T09:24:40.330 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-19T09:24:40.330 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:24:40.330 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:24:40.330 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:24:40.330 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.330 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 22, 2024-09-19T09:24:40.330 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_metadata", 2024-09-19T09:24:40.330 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:24:23.190145+0000", 2024-09-19T09:24:40.330 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:24:40.330 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:24:40.330 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:24:40.330 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:24:40.330 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:24:40.331 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:24:40.331 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:24:40.331 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:24:40.331 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:24:40.331 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:24:40.331 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:24:40.331 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:24:40.331 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:24:40.331 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-19T09:24:40.331 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-19T09:24:40.331 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-19T09:24:40.331 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-19T09:24:40.332 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-19T09:24:40.332 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:24:40.332 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:24:40.332 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:24:40.332 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:24:40.332 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:24:40.332 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:24:40.332 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:24:40.332 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.332 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "181", 2024-09-19T09:24:40.332 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:24:40.332 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:24:40.332 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:24:40.332 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:24:40.333 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:24:40.333 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:24:40.333 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:24:40.333 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:24:40.333 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:24:40.333 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:24:40.333 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:24:40.333 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:24:40.333 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:24:40.333 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:24:40.333 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:24:40.333 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:24:40.333 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:24:40.333 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:24:40.334 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:24:40.334 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:24:40.334 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:24:40.334 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:24:40.334 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:24:40.334 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:24:40.334 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:24:40.334 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:24:40.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.334 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:24:40.334 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:24:40.335 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:24:40.335 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:24:40.335 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:24:40.335 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:24:40.335 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:24:40.335 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:24:40.335 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:24:40.335 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:24:40.335 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:24:40.335 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:24:40.335 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4, 2024-09-19T09:24:40.335 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 16, 2024-09-19T09:24:40.336 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_priority": 5 2024-09-19T09:24:40.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.336 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:24:40.336 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:24:40.336 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": "cephfs" 2024-09-19T09:24:40.337 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.337 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:24:40.337 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:24:40.337 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.5, 2024-09-19T09:24:40.337 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.5, 2024-09-19T09:24:40.338 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:24:40.338 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.5, 2024-09-19T09:24:40.338 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.5, 2024-09-19T09:24:40.338 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:24:40.338 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:24:40.339 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:24:40.339 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.340 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 23, 2024-09-19T09:24:40.340 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_data", 2024-09-19T09:24:40.340 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:24:24.517971+0000", 2024-09-19T09:24:40.341 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:24:40.341 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:24:40.341 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:24:40.341 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:24:40.341 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:24:40.341 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:24:40.342 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:24:40.342 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:24:40.342 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:24:40.342 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:24:40.342 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:24:40.342 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:24:40.342 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:24:40.342 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 64, 2024-09-19T09:24:40.343 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 64, 2024-09-19T09:24:40.343 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 64, 2024-09-19T09:24:40.343 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 64, 2024-09-19T09:24:40.343 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 64, 2024-09-19T09:24:40.343 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:24:40.343 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:24:40.343 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:24:40.343 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:24:40.344 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:24:40.344 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:24:40.344 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:24:40.344 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.344 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "183", 2024-09-19T09:24:40.344 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:24:40.344 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:24:40.344 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:24:40.345 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:24:40.345 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:24:40.345 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:24:40.345 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:24:40.345 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:24:40.345 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:24:40.345 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 33554432, 2024-09-19T09:24:40.346 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:24:40.346 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:24:40.346 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:24:40.346 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:24:40.346 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:24:40.346 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:24:40.346 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:24:40.346 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:24:40.347 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:24:40.347 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:24:40.347 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:24:40.347 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:24:40.347 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:24:40.347 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:24:40.347 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:24:40.347 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:24:40.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.347 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:24:40.348 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:24:40.348 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:24:40.348 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:24:40.348 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:24:40.348 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:24:40.348 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:24:40.348 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:24:40.348 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:24:40.348 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:24:40.348 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:24:40.348 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:24:40.348 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 64, 2024-09-19T09:24:40.349 INFO:teuthology.orchestra.run.smithi018.stdout: "target_size_ratio": 0.89999997615814209 2024-09-19T09:24:40.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.349 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:24:40.349 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:24:40.349 INFO:teuthology.orchestra.run.smithi018.stdout: "data": "cephfs" 2024-09-19T09:24:40.349 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.349 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:24:40.349 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:24:40.349 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.3799999952316284, 2024-09-19T09:24:40.349 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.3799999952316284, 2024-09-19T09:24:40.349 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:24:40.349 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-19T09:24:40.350 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-19T09:24:40.350 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:24:40.350 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:24:40.350 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:24:40.350 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.350 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.350 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:40.350 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-19T09:24:40.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.350 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:24:40.350 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:40.350 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:40.350 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:40.351 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:40.351 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:40.351 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:40.351 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:40.351 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:40.351 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:40.351 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:40.351 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:40.351 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:40.351 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.351 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.351 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-19T09:24:40.352 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:40.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.352 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.352 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-19T09:24:40.352 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:40.352 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.352 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.352 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:40.352 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.352 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.353 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-19T09:24:40.353 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:40.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.353 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.353 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-19T09:24:40.353 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:40.353 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.353 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.353 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:40.353 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.353 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.354 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-19T09:24:40.354 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:40.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.354 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.354 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-19T09:24:40.354 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:40.354 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.354 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.354 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:40.354 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.354 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.355 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-19T09:24:40.355 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:40.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.355 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.355 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-19T09:24:40.355 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:40.355 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.355 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.355 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.355 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/128722874", 2024-09-19T09:24:40.355 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/128722874", 2024-09-19T09:24:40.355 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/128722874", 2024-09-19T09:24:40.356 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/128722874", 2024-09-19T09:24:40.356 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:40.356 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:40.356 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:40.356 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.356 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:24:40.356 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:40.356 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:40.356 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:40.356 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:40.356 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:40.356 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:40.357 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:40.357 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:40.357 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:40.357 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:40.357 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:40.357 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:40.357 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.357 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.357 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-19T09:24:40.357 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:40.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.358 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.358 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-19T09:24:40.358 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:40.358 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.358 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.358 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:40.358 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.358 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.358 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-19T09:24:40.358 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:40.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.359 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.359 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-19T09:24:40.359 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:40.359 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.359 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.359 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:40.359 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.359 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.359 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-19T09:24:40.360 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:40.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.360 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.360 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-19T09:24:40.360 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:40.360 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.360 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.360 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.360 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:40.360 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.360 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.360 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-19T09:24:40.361 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:40.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.361 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.361 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-19T09:24:40.361 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:40.361 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.361 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.361 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/3672199638", 2024-09-19T09:24:40.362 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/3672199638", 2024-09-19T09:24:40.362 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/3672199638", 2024-09-19T09:24:40.362 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/3672199638", 2024-09-19T09:24:40.362 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:40.362 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:40.362 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:40.362 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.362 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:24:40.362 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:40.362 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:40.362 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:40.362 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:40.363 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:40.363 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:40.363 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:40.363 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:40.363 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:40.363 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:40.363 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:40.363 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:40.363 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.363 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.363 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T09:24:40.363 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:40.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.364 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.364 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T09:24:40.364 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:40.364 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.364 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.364 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:40.364 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.365 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.365 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-19T09:24:40.365 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:40.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.365 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.365 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-19T09:24:40.365 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:40.365 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.366 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.366 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:40.366 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.366 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.367 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-19T09:24:40.367 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:40.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.367 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.367 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-19T09:24:40.367 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:40.367 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.367 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.368 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:40.368 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.368 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.368 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-19T09:24:40.369 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:40.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.369 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.369 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-19T09:24:40.369 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:40.369 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.369 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.369 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3463367841", 2024-09-19T09:24:40.369 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3463367841", 2024-09-19T09:24:40.369 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3463367841", 2024-09-19T09:24:40.369 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3463367841", 2024-09-19T09:24:40.370 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:40.370 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:40.370 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:40.370 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.370 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:24:40.370 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:40.370 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:40.370 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:40.370 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:40.370 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:40.370 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:40.370 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:40.371 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:40.371 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:40.371 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:40.371 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:40.371 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:40.371 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.371 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.371 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-19T09:24:40.371 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:40.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.372 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.372 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-19T09:24:40.372 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:40.372 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.372 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.372 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.372 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:40.372 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.372 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.372 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-19T09:24:40.373 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:40.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.373 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.373 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-19T09:24:40.373 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:40.373 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.373 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.373 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:40.373 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.373 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.373 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-19T09:24:40.374 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:40.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.374 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.374 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-19T09:24:40.374 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:40.374 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.374 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.374 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:40.375 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.375 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.375 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-19T09:24:40.375 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:40.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.375 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.375 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-19T09:24:40.376 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:40.376 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.376 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.376 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/4163178582", 2024-09-19T09:24:40.376 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/4163178582", 2024-09-19T09:24:40.376 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/4163178582", 2024-09-19T09:24:40.376 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/4163178582", 2024-09-19T09:24:40.376 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:40.376 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:40.376 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:40.376 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.377 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:24:40.377 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:40.377 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:40.377 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:40.377 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:40.377 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:40.377 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:40.377 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:40.378 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:40.378 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:40.378 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:40.378 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:40.378 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:40.378 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.378 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.378 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6822", 2024-09-19T09:24:40.378 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:40.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.378 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.379 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6824", 2024-09-19T09:24:40.379 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:40.379 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.379 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.379 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:40.379 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.379 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.379 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6826", 2024-09-19T09:24:40.379 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:40.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.379 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.380 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6827", 2024-09-19T09:24:40.380 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:40.380 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.380 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.380 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:40.380 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.380 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.380 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6830", 2024-09-19T09:24:40.380 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:40.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.381 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.381 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6831", 2024-09-19T09:24:40.381 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:40.381 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.381 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.381 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:40.381 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.381 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.381 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6828", 2024-09-19T09:24:40.381 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:40.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.382 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.382 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6829", 2024-09-19T09:24:40.382 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:40.382 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.382 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.382 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6824/3538482215", 2024-09-19T09:24:40.382 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6827/3538482215", 2024-09-19T09:24:40.382 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6831/3538482215", 2024-09-19T09:24:40.382 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6829/3538482215", 2024-09-19T09:24:40.382 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:40.382 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:40.383 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:40.383 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.383 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.383 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:24:40.383 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:40.383 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:40.383 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:40.383 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:40.383 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:40.383 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:40.383 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:40.383 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:40.383 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:40.384 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:40.384 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:40.384 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:40.384 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.384 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.384 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6800", 2024-09-19T09:24:40.384 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:40.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.384 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.384 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6801", 2024-09-19T09:24:40.384 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:40.384 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.385 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.385 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:40.385 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.385 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.385 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6802", 2024-09-19T09:24:40.385 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:40.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.386 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.386 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6803", 2024-09-19T09:24:40.386 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:40.386 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.386 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.387 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:40.387 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.387 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.387 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6806", 2024-09-19T09:24:40.387 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:40.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.388 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.388 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6807", 2024-09-19T09:24:40.388 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:40.388 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.389 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.389 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:40.389 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.389 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.390 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6804", 2024-09-19T09:24:40.390 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:40.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.390 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.390 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6805", 2024-09-19T09:24:40.391 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:40.391 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.391 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.391 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6801/2408698413", 2024-09-19T09:24:40.391 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6803/2408698413", 2024-09-19T09:24:40.392 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6807/2408698413", 2024-09-19T09:24:40.392 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6805/2408698413", 2024-09-19T09:24:40.392 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:40.392 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:40.392 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:40.392 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.393 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:24:40.393 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:40.393 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:40.393 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:40.394 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:40.394 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:40.394 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:40.394 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:40.394 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:40.394 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:40.395 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:40.395 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:40.395 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:40.395 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.395 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.396 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6808", 2024-09-19T09:24:40.396 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:40.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.396 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.396 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6809", 2024-09-19T09:24:40.397 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:40.397 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.397 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.397 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:40.397 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.398 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.398 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6810", 2024-09-19T09:24:40.398 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:40.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.399 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.399 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6811", 2024-09-19T09:24:40.399 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:40.399 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.399 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.400 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:40.400 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.400 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.400 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6814", 2024-09-19T09:24:40.401 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:40.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.401 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.405 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6815", 2024-09-19T09:24:40.405 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:40.405 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.405 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.406 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:40.406 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.406 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.406 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6812", 2024-09-19T09:24:40.406 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:40.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.407 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.407 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6813", 2024-09-19T09:24:40.407 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:40.407 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.408 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.408 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6809/2596207948", 2024-09-19T09:24:40.408 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6811/2596207948", 2024-09-19T09:24:40.408 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6815/2596207948", 2024-09-19T09:24:40.408 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6813/2596207948", 2024-09-19T09:24:40.409 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:40.409 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:40.409 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:40.409 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.410 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:24:40.410 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:40.410 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:40.410 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:40.410 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:40.410 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:40.411 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:40.411 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:40.411 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:40.411 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:40.411 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:40.411 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:40.411 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:40.411 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.412 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.412 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6816", 2024-09-19T09:24:40.412 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:40.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.412 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.412 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.412 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6817", 2024-09-19T09:24:40.412 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:40.412 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.412 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.412 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.412 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:40.413 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.413 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.413 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6818", 2024-09-19T09:24:40.413 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:40.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.413 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.413 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.413 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6819", 2024-09-19T09:24:40.413 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:40.413 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.413 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.413 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.413 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:40.414 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.414 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.414 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6823", 2024-09-19T09:24:40.414 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:40.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.414 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.414 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.414 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6825", 2024-09-19T09:24:40.414 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:40.414 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.414 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.414 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.414 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:40.415 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:40.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.415 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:40.415 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6820", 2024-09-19T09:24:40.415 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:40.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.415 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.415 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:40.415 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6821", 2024-09-19T09:24:40.415 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:40.415 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.415 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.415 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.415 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6817/1334618296", 2024-09-19T09:24:40.416 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6819/1334618296", 2024-09-19T09:24:40.416 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6825/1334618296", 2024-09-19T09:24:40.416 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6821/1334618296", 2024-09-19T09:24:40.416 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:40.416 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:40.416 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:40.416 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:40.416 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.416 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:40.416 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-19T09:24:40.416 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.416 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:24:40.416 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:40.417 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:40.417 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:40.417 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:40.417 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:40.417 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.580838+0000", 2024-09-19T09:24:40.417 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:40.417 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.417 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.417 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:24:40.417 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:40.417 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:40.417 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:40.417 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:40.417 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:40.417 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.599990+0000", 2024-09-19T09:24:40.418 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:40.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.418 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:24:40.418 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:40.418 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:40.418 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:40.418 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:40.418 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:40.418 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.503722+0000", 2024-09-19T09:24:40.418 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:40.418 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.418 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.419 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:24:40.419 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:40.419 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:40.419 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:40.419 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:40.419 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:40.419 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.607846+0000", 2024-09-19T09:24:40.419 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:40.419 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.419 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.419 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:24:40.419 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:40.419 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:40.419 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:40.420 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:40.420 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:40.420 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.616858+0000", 2024-09-19T09:24:40.420 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:40.420 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.420 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.420 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:24:40.420 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:40.420 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:40.420 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:40.420 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:40.420 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:40.420 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.542726+0000", 2024-09-19T09:24:40.421 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:40.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.421 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:24:40.421 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:40.421 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:40.421 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:40.421 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:40.421 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:40.421 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.534178+0000", 2024-09-19T09:24:40.421 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:40.421 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.421 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:40.421 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:24:40.421 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:40.422 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:40.422 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:40.422 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:40.422 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:40.422 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.612105+0000", 2024-09-19T09:24:40.422 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:40.422 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.422 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:40.422 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-19T09:24:40.422 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-19T09:24:40.422 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-19T09:24:40.422 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-19T09:24:40.422 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-19T09:24:40.422 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-19T09:24:40.423 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-19T09:24:40.423 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-19T09:24:40.423 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-19T09:24:40.423 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-19T09:24:40.423 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-19T09:24:40.423 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-19T09:24:40.423 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-19T09:24:40.423 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-19T09:24:40.423 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.423 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:40.423 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-19T09:24:40.423 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-19T09:24:40.423 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-19T09:24:40.424 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-19T09:24:40.424 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-19T09:24:40.424 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-19T09:24:40.424 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-19T09:24:40.424 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-19T09:24:40.424 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-19T09:24:40.424 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-19T09:24:40.424 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-19T09:24:40.424 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:40.424 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:24:40.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.320+0000 7fcf851be640 1 -- 172.21.15.18:0/3041429398 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcf6006c2b0 msgr2=0x7fcf6006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:40.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.320+0000 7fcf851be640 1 --2- 172.21.15.18:0/3041429398 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcf6006c2b0 0x7fcf6006e770 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fcf70034000 tx=0x7fcf7002e000 comp rx=0 tx=0).stop 2024-09-19T09:24:40.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.320+0000 7fcf851be640 1 -- 172.21.15.18:0/3041429398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf80160c50 msgr2=0x7fcf801560d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:40.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.320+0000 7fcf851be640 1 --2- 172.21.15.18:0/3041429398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf80160c50 0x7fcf801560d0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fcf7800cbf0 tx=0x7fcf7800a060 comp rx=0 tx=0).stop 2024-09-19T09:24:40.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.320+0000 7fcf851be640 1 -- 172.21.15.18:0/3041429398 shutdown_connections 2024-09-19T09:24:40.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.320+0000 7fcf851be640 1 --2- 172.21.15.18:0/3041429398 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcf6006c2b0 0x7fcf6006e770 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:40.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.320+0000 7fcf851be640 1 --2- 172.21.15.18:0/3041429398 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcf80160c50 0x7fcf801560d0 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:40.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.320+0000 7fcf851be640 1 --2- 172.21.15.18:0/3041429398 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcf80142150 0x7fcf8015a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:40.426 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.320+0000 7fcf851be640 1 --2- 172.21.15.18:0/3041429398 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf8013fae0 0x7fcf80072b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:40.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.320+0000 7fcf851be640 1 -- 172.21.15.18:0/3041429398 >> 172.21.15.18:0/3041429398 conn(0x7fcf8006bc10 msgr2=0x7fcf800b0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:40.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.320+0000 7fcf851be640 1 -- 172.21.15.18:0/3041429398 shutdown_connections 2024-09-19T09:24:40.427 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:40.320+0000 7fcf851be640 1 -- 172.21.15.18:0/3041429398 wait complete. 2024-09-19T09:24:40.427 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-19T09:24:45.428 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-19T09:24:45.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.544+0000 7f611260e640 1 Processor -- start 2024-09-19T09:24:45.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.544+0000 7f611260e640 1 -- start start 2024-09-19T09:24:45.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.545+0000 7f611260e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f610c160c50 0x7f610c167680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.545+0000 7f611260e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f610c142650 con 0x7f610c13fae0 2024-09-19T09:24:45.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.545+0000 7f611260e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f610c142930 con 0x7f610c142150 2024-09-19T09:24:45.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.545+0000 7f611260e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f610c0ce780 con 0x7f610c160c50 2024-09-19T09:24:45.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.545+0000 7f610bfff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f610c13fae0 0x7f610c06f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39238/0 (socket says 172.21.15.18:39238) 2024-09-19T09:24:45.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.545+0000 7f6110bab640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f610c160c50 0x7f610c167680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.545+0000 7f610bfff640 1 -- 172.21.15.18:0/3595208996 learned_addr learned my addr 172.21.15.18:0/3595208996 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:24:45.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.546+0000 7f6110bab640 1 -- 172.21.15.18:0/3595208996 >> v1:172.21.15.162:6789/0 conn(0x7f610c142150 legacy=0x7f610c160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:45.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.546+0000 7f6110bab640 1 -- 172.21.15.18:0/3595208996 >> v1:172.21.15.18:6789/0 conn(0x7f610c13fae0 legacy=0x7f610c06f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:45.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.546+0000 7f610b7fe640 1 -- 172.21.15.18:0/3595208996 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2432928980 0 0) 0x7f610c142650 con 0x7f610c13fae0 2024-09-19T09:24:45.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.546+0000 7f6110bab640 1 -- 172.21.15.18:0/3595208996 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f610c142c10 con 0x7f610c160c50 2024-09-19T09:24:45.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.546+0000 7f6110bab640 1 --2- 172.21.15.18:0/3595208996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f610c160c50 0x7f610c167680 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f6104009d90 tx=0x7f610402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569d23a272a9d3ea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:45.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.547+0000 7f610b7fe640 1 -- 172.21.15.18:0/3595208996 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6104007740 con 0x7f610c160c50 2024-09-19T09:24:45.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.547+0000 7f610b7fe640 1 -- 172.21.15.18:0/3595208996 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61040078e0 con 0x7f610c160c50 2024-09-19T09:24:45.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.547+0000 7f610b7fe640 1 -- 172.21.15.18:0/3595208996 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6104007cb0 con 0x7f610c160c50 2024-09-19T09:24:45.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.547+0000 7f611260e640 1 -- 172.21.15.18:0/3595208996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f610c160c50 msgr2=0x7f610c167680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:45.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.547+0000 7f611260e640 1 --2- 172.21.15.18:0/3595208996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f610c160c50 0x7f610c167680 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f6104009d90 tx=0x7f610402a660 comp rx=0 tx=0).stop 2024-09-19T09:24:45.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.547+0000 7f611260e640 1 -- 172.21.15.18:0/3595208996 shutdown_connections 2024-09-19T09:24:45.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.547+0000 7f611260e640 1 --2- 172.21.15.18:0/3595208996 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f610c160c50 0x7f610c167680 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.547+0000 7f611260e640 1 -- 172.21.15.18:0/3595208996 >> 172.21.15.18:0/3595208996 conn(0x7f610c06bc10 msgr2=0x7f610c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:45.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.547+0000 7f611260e640 1 -- 172.21.15.18:0/3595208996 shutdown_connections 2024-09-19T09:24:45.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.547+0000 7f611260e640 1 -- 172.21.15.18:0/3595208996 wait complete. 2024-09-19T09:24:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.548+0000 7f611260e640 1 Processor -- start 2024-09-19T09:24:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.549+0000 7f611260e640 1 -- start start 2024-09-19T09:24:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.549+0000 7f611260e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f610c13fae0 0x7f610c0b5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.549+0000 7f611260e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f610c142150 0x7f610c13e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.549+0000 7f611260e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f610c160c50 0x7f610c141370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.549+0000 7f611260e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f610c0cfda0 con 0x7f610c160c50 2024-09-19T09:24:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.549+0000 7f611260e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f610c0cfc20 con 0x7f610c13fae0 2024-09-19T09:24:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.549+0000 7f611260e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f610c0cff20 con 0x7f610c142150 2024-09-19T09:24:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.549+0000 7f6110bab640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f610c160c50 0x7f610c141370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.549+0000 7f6110bab640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f610c160c50 0x7f610c141370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48370/0 (socket says 172.21.15.18:48370) 2024-09-19T09:24:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.549+0000 7f6110bab640 1 -- 172.21.15.18:0/2405174890 learned_addr learned my addr 172.21.15.18:0/2405174890 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.550+0000 7f610bfff640 1 --2- 172.21.15.18:0/2405174890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f610c13fae0 0x7f610c0b5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.550+0000 7f6103fff640 1 --2- 172.21.15.18:0/2405174890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f610c142150 0x7f610c13e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.550+0000 7f6110bab640 1 -- 172.21.15.18:0/2405174890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f610c142150 msgr2=0x7f610c13e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:45.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.550+0000 7f6110bab640 1 --2- 172.21.15.18:0/2405174890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f610c142150 0x7f610c13e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.550+0000 7f6110bab640 1 -- 172.21.15.18:0/2405174890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f610c13fae0 msgr2=0x7f610c0b5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:45.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.550+0000 7f6110bab640 1 --2- 172.21.15.18:0/2405174890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f610c13fae0 0x7f610c0b5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.550+0000 7f6110bab640 1 -- 172.21.15.18:0/2405174890 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f610c13d440 con 0x7f610c160c50 2024-09-19T09:24:45.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.550+0000 7f6103fff640 1 --2- 172.21.15.18:0/2405174890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f610c142150 0x7f610c13e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:45.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.550+0000 7f6110bab640 1 --2- 172.21.15.18:0/2405174890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f610c160c50 0x7f610c141370 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f6104009d90 tx=0x7f6104004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:45.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.550+0000 7f61097fa640 1 -- 172.21.15.18:0/2405174890 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f610403f070 con 0x7f610c160c50 2024-09-19T09:24:45.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.550+0000 7f61097fa640 1 -- 172.21.15.18:0/2405174890 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6104031c90 con 0x7f610c160c50 2024-09-19T09:24:45.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.550+0000 7f61097fa640 1 -- 172.21.15.18:0/2405174890 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6104043630 con 0x7f610c160c50 2024-09-19T09:24:45.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.550+0000 7f611260e640 1 -- 172.21.15.18:0/2405174890 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f610c13d720 con 0x7f610c160c50 2024-09-19T09:24:45.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.550+0000 7f611260e640 1 -- 172.21.15.18:0/2405174890 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f610c13dce0 con 0x7f610c160c50 2024-09-19T09:24:45.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.551+0000 7f611260e640 1 -- 172.21.15.18:0/2405174890 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f610c160540 con 0x7f610c160c50 2024-09-19T09:24:45.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.552+0000 7f61097fa640 1 -- 172.21.15.18:0/2405174890 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f610403b410 con 0x7f610c160c50 2024-09-19T09:24:45.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.552+0000 7f61097fa640 1 --2- 172.21.15.18:0/2405174890 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f60ec06c2b0 0x7f60ec06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:45.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.552+0000 7f61097fa640 1 -- 172.21.15.18:0/2405174890 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 5709+0+0 (secure 0 0 0) 0x7f61040ac650 con 0x7f610c160c50 2024-09-19T09:24:45.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.552+0000 7f61097fa640 1 -- 172.21.15.18:0/2405174890 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=185}) -- 0x7f60ec073de0 con 0x7f610c160c50 2024-09-19T09:24:45.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.553+0000 7f610bfff640 1 --2- 172.21.15.18:0/2405174890 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f60ec06c2b0 0x7f60ec06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:45.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.553+0000 7f610bfff640 1 --2- 172.21.15.18:0/2405174890 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f60ec06c2b0 0x7f60ec06e770 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f60fc007f70 tx=0x7f60fc007f00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:45.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.557+0000 7f61097fa640 1 -- 172.21.15.18:0/2405174890 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f610407ade0 con 0x7f610c160c50 2024-09-19T09:24:45.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.737+0000 7f611260e640 1 -- 172.21.15.18:0/2405174890 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f610c06f190 con 0x7f610c160c50 2024-09-19T09:24:45.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.738+0000 7f61097fa640 1 -- 172.21.15.18:0/2405174890 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v184) ==== 81+0+34309 (secure 0 0 0) 0x7f610407a6e0 con 0x7f610c160c50 2024-09-19T09:24:45.740 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:24:45.740 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:24:45.740 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 184, 2024-09-19T09:24:45.740 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:24:45.740 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-19T09:13:11.348786+0000", 2024-09-19T09:24:45.740 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-19T09:24:41.275573+0000", 2024-09-19T09:24:45.740 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-19T09:13:16.423937+0000", 2024-09-19T09:24:45.740 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-19T09:13:13.417141+0000", 2024-09-19T09:24:45.740 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-19T09:24:45.740 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-09-19T09:24:45.740 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-19T09:24:45.740 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-19T09:24:45.741 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-19T09:24:45.741 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-19T09:24:45.741 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-19T09:24:45.741 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:45.741 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-19T09:24:45.741 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.69999998807907104, 2024-09-19T09:24:45.741 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-19T09:24:45.741 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-19T09:24:45.741 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-19T09:24:45.741 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 23, 2024-09-19T09:24:45.741 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-19T09:24:45.741 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-19T09:24:45.741 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "jewel", 2024-09-19T09:24:45.742 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-19T09:24:45.742 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-19T09:24:45.742 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-19T09:24:45.742 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.742 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-19T09:24:45.742 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-19T09:24:45.742 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:13:17.564717+0000", 2024-09-19T09:24:45.742 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:24:45.742 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:24:45.742 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:24:45.742 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:24:45.742 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:24:45.742 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:24:45.742 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:24:45.743 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:24:45.743 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:24:45.743 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:24:45.743 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:24:45.743 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:24:45.743 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:24:45.743 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-19T09:24:45.743 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-19T09:24:45.743 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-19T09:24:45.743 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-19T09:24:45.743 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-19T09:24:45.744 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:24:45.744 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:24:45.744 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:24:45.744 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:24:45.744 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:24:45.744 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:24:45.744 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:24:45.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.744 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "111", 2024-09-19T09:24:45.744 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:24:45.744 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:24:45.744 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:24:45.745 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:24:45.745 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:24:45.745 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:24:45.745 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:24:45.745 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:24:45.745 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:24:45.745 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:24:45.745 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:24:45.745 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:24:45.746 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:24:45.746 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:24:45.746 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:24:45.746 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:24:45.746 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:24:45.746 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:24:45.746 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:24:45.747 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:24:45.747 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:24:45.747 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:24:45.747 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:24:45.747 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:24:45.747 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:24:45.747 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:24:45.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.747 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:24:45.747 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:24:45.747 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:24:45.748 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:24:45.748 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:24:45.748 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:24:45.748 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:24:45.748 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:24:45.748 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:24:45.748 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:24:45.748 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:24:45.748 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:24:45.749 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-19T09:24:45.749 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-19T09:24:45.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.749 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:24:45.749 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-19T09:24:45.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.749 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:24:45.749 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:24:45.749 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-19T09:24:45.749 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-19T09:24:45.749 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-19T09:24:45.749 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-19T09:24:45.749 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-19T09:24:45.749 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:24:45.750 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:24:45.750 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:24:45.750 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.750 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.750 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 22, 2024-09-19T09:24:45.750 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_metadata", 2024-09-19T09:24:45.750 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:24:23.190145+0000", 2024-09-19T09:24:45.750 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:24:45.750 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:24:45.750 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:24:45.750 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:24:45.750 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:24:45.750 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:24:45.751 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:24:45.751 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:24:45.751 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:24:45.751 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:24:45.751 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:24:45.751 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:24:45.751 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:24:45.751 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-19T09:24:45.752 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-19T09:24:45.752 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-19T09:24:45.752 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-19T09:24:45.752 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-19T09:24:45.752 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:24:45.752 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:24:45.752 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:24:45.752 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:24:45.752 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:24:45.752 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:24:45.753 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:24:45.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.753 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "181", 2024-09-19T09:24:45.753 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:24:45.753 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:24:45.753 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:24:45.753 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:24:45.753 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:24:45.753 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:24:45.753 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:24:45.753 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:24:45.753 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:24:45.753 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:24:45.754 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:24:45.754 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:24:45.754 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:24:45.754 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:24:45.754 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:24:45.754 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:24:45.754 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:24:45.754 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:24:45.754 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:24:45.754 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:24:45.754 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:24:45.754 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:24:45.754 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:24:45.755 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:24:45.755 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:24:45.755 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:24:45.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.755 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:24:45.755 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:24:45.755 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:24:45.755 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:24:45.755 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:24:45.755 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:24:45.755 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:24:45.755 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:24:45.755 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:24:45.755 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:24:45.756 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:24:45.756 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:24:45.756 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4, 2024-09-19T09:24:45.756 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 16, 2024-09-19T09:24:45.756 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_priority": 5 2024-09-19T09:24:45.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.756 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:24:45.756 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:24:45.756 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": "cephfs" 2024-09-19T09:24:45.756 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.756 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.756 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:24:45.756 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:24:45.757 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.5, 2024-09-19T09:24:45.757 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.5, 2024-09-19T09:24:45.757 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:24:45.758 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.5, 2024-09-19T09:24:45.758 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.5, 2024-09-19T09:24:45.758 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:24:45.758 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:24:45.758 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:24:45.758 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.758 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.758 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.758 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 23, 2024-09-19T09:24:45.758 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_data", 2024-09-19T09:24:45.759 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:24:24.517971+0000", 2024-09-19T09:24:45.759 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1027, 2024-09-19T09:24:45.759 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-19T09:24:45.759 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:24:45.759 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:24:45.759 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:24:45.759 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:24:45.759 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:24:45.759 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:24:45.760 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:24:45.760 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:24:45.760 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:24:45.760 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:24:45.760 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:24:45.760 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 64, 2024-09-19T09:24:45.761 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 64, 2024-09-19T09:24:45.761 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 64, 2024-09-19T09:24:45.761 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 64, 2024-09-19T09:24:45.761 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 64, 2024-09-19T09:24:45.761 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:24:45.761 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:24:45.761 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:24:45.761 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:24:45.761 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:24:45.761 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:24:45.762 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:24:45.762 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.762 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "184", 2024-09-19T09:24:45.762 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:24:45.762 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:24:45.762 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:24:45.762 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:24:45.762 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:24:45.762 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:24:45.762 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:24:45.762 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:24:45.762 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:24:45.762 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 33554432, 2024-09-19T09:24:45.763 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:24:45.763 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:24:45.763 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:24:45.763 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:24:45.763 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:24:45.763 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:24:45.763 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:24:45.763 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:24:45.763 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:24:45.763 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:24:45.763 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:24:45.763 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:24:45.764 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:24:45.764 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:24:45.764 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:24:45.764 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:24:45.764 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.764 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:24:45.764 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:24:45.764 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:24:45.764 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:24:45.765 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:24:45.765 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:24:45.765 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:24:45.765 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:24:45.765 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:24:45.766 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:24:45.766 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:24:45.766 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:24:45.766 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 64, 2024-09-19T09:24:45.766 INFO:teuthology.orchestra.run.smithi018.stdout: "target_size_ratio": 0.89999997615814209 2024-09-19T09:24:45.766 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.766 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:24:45.766 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:24:45.766 INFO:teuthology.orchestra.run.smithi018.stdout: "data": "cephfs" 2024-09-19T09:24:45.767 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.767 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.767 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:24:45.767 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:24:45.767 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.3799999952316284, 2024-09-19T09:24:45.767 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.3799999952316284, 2024-09-19T09:24:45.767 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:24:45.767 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-19T09:24:45.767 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-19T09:24:45.767 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:24:45.768 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:24:45.768 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:24:45.768 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.768 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.768 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:45.768 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-19T09:24:45.768 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.768 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:24:45.768 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:45.768 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:45.768 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:45.768 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:45.768 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:45.769 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:45.769 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:45.769 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:45.769 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:45.769 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:45.769 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:45.769 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:45.769 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.769 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.769 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.769 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-19T09:24:45.769 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:45.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.770 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.770 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.770 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-19T09:24:45.770 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:45.770 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.770 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.770 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.770 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:45.770 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.770 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.771 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.771 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-19T09:24:45.771 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:45.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.771 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.771 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.771 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-19T09:24:45.771 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:45.771 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.771 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.771 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.771 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:45.771 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.772 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.772 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-19T09:24:45.772 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:45.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.772 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.772 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.772 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-19T09:24:45.772 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:45.772 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.772 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.772 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.772 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:45.773 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.773 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.773 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-19T09:24:45.773 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:45.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.773 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.773 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.773 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-19T09:24:45.773 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:45.773 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.773 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.773 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.773 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/128722874", 2024-09-19T09:24:45.774 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/128722874", 2024-09-19T09:24:45.774 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/128722874", 2024-09-19T09:24:45.774 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/128722874", 2024-09-19T09:24:45.774 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:45.774 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:45.774 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:45.774 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.774 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.774 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.774 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:24:45.775 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:45.775 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:45.775 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:45.775 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:45.775 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:45.775 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:45.775 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:45.775 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:45.775 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:45.775 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:45.775 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:45.775 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:45.775 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.776 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.776 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-19T09:24:45.776 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:45.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.776 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.776 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.776 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-19T09:24:45.776 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:45.776 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.776 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.776 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.776 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:45.776 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.777 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.777 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-19T09:24:45.777 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:45.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.777 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.777 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.777 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-19T09:24:45.777 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:45.777 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.777 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.777 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.777 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:45.777 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.778 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.778 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-19T09:24:45.778 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:45.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.778 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.778 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.778 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-19T09:24:45.778 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:45.778 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.778 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.778 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.778 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:45.778 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.779 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.779 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-19T09:24:45.779 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:45.779 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.779 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.779 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.779 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-19T09:24:45.779 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:45.779 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.780 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.780 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/3672199638", 2024-09-19T09:24:45.780 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/3672199638", 2024-09-19T09:24:45.780 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/3672199638", 2024-09-19T09:24:45.780 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/3672199638", 2024-09-19T09:24:45.780 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:45.780 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:45.780 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:45.780 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.780 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.780 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.780 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:24:45.780 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:45.781 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:45.781 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:45.781 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:45.781 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:45.781 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:45.781 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:45.781 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:45.781 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:45.781 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:45.781 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:45.781 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:45.781 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.781 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.781 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.782 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T09:24:45.782 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:45.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.782 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.782 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T09:24:45.782 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:45.782 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.782 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.782 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.782 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:45.782 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.782 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.783 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.783 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-19T09:24:45.783 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:45.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.783 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.783 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-19T09:24:45.783 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:45.783 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.783 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.783 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.783 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:45.783 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.783 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-19T09:24:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-19T09:24:45.784 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:45.785 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.785 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.785 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:45.785 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.785 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.785 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-19T09:24:45.785 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:45.785 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.785 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-19T09:24:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3463367841", 2024-09-19T09:24:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3463367841", 2024-09-19T09:24:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3463367841", 2024-09-19T09:24:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3463367841", 2024-09-19T09:24:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:45.786 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:24:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:45.787 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-19T09:24:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.788 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-19T09:24:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-19T09:24:45.789 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-19T09:24:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-19T09:24:45.790 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-19T09:24:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-19T09:24:45.791 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-19T09:24:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/4163178582", 2024-09-19T09:24:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/4163178582", 2024-09-19T09:24:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/4163178582", 2024-09-19T09:24:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/4163178582", 2024-09-19T09:24:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:45.792 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:24:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:45.793 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6822", 2024-09-19T09:24:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6824", 2024-09-19T09:24:45.794 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6826", 2024-09-19T09:24:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6827", 2024-09-19T09:24:45.795 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6830", 2024-09-19T09:24:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6831", 2024-09-19T09:24:45.796 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6828", 2024-09-19T09:24:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6829", 2024-09-19T09:24:45.797 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6824/3538482215", 2024-09-19T09:24:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6827/3538482215", 2024-09-19T09:24:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6831/3538482215", 2024-09-19T09:24:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6829/3538482215", 2024-09-19T09:24:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:45.798 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:24:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:45.799 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6800", 2024-09-19T09:24:45.800 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6801", 2024-09-19T09:24:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:45.801 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6802", 2024-09-19T09:24:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6803", 2024-09-19T09:24:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.802 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6806", 2024-09-19T09:24:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.803 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6807", 2024-09-19T09:24:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6804", 2024-09-19T09:24:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.804 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6805", 2024-09-19T09:24:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6801/2408698413", 2024-09-19T09:24:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6803/2408698413", 2024-09-19T09:24:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6807/2408698413", 2024-09-19T09:24:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6805/2408698413", 2024-09-19T09:24:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.805 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:24:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:45.806 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6808", 2024-09-19T09:24:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6809", 2024-09-19T09:24:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:45.807 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6810", 2024-09-19T09:24:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6811", 2024-09-19T09:24:45.808 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6814", 2024-09-19T09:24:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6815", 2024-09-19T09:24:45.809 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6812", 2024-09-19T09:24:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6813", 2024-09-19T09:24:45.810 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6809/2596207948", 2024-09-19T09:24:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6811/2596207948", 2024-09-19T09:24:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6815/2596207948", 2024-09-19T09:24:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6813/2596207948", 2024-09-19T09:24:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:45.811 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:24:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:45.812 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6816", 2024-09-19T09:24:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.813 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6817", 2024-09-19T09:24:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6818", 2024-09-19T09:24:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.814 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6819", 2024-09-19T09:24:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6823", 2024-09-19T09:24:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.815 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6825", 2024-09-19T09:24:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6820", 2024-09-19T09:24:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.816 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6821", 2024-09-19T09:24:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6817/1334618296", 2024-09-19T09:24:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6819/1334618296", 2024-09-19T09:24:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6825/1334618296", 2024-09-19T09:24:45.817 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6821/1334618296", 2024-09-19T09:24:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-19T09:24:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:24:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:45.818 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.580838+0000", 2024-09-19T09:24:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:24:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.599990+0000", 2024-09-19T09:24:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:45.819 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:24:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.503722+0000", 2024-09-19T09:24:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:24:45.820 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.607846+0000", 2024-09-19T09:24:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:24:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:45.821 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.616858+0000", 2024-09-19T09:24:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:24:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.542726+0000", 2024-09-19T09:24:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:45.822 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:24:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.534178+0000", 2024-09-19T09:24:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:45.823 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:24:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.612105+0000", 2024-09-19T09:24:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:45.824 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-19T09:24:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-19T09:24:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-19T09:24:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-19T09:24:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-19T09:24:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-19T09:24:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-19T09:24:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-19T09:24:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-19T09:24:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-19T09:24:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-19T09:24:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-19T09:24:45.825 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-19T09:24:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-19T09:24:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-19T09:24:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-19T09:24:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-19T09:24:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-19T09:24:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-19T09:24:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-19T09:24:45.826 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-19T09:24:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-19T09:24:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-19T09:24:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-19T09:24:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-19T09:24:45.827 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:45.827 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:24:45.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.740+0000 7f611260e640 1 -- 172.21.15.18:0/2405174890 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f60ec06c2b0 msgr2=0x7f60ec06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:45.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.740+0000 7f611260e640 1 --2- 172.21.15.18:0/2405174890 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f60ec06c2b0 0x7f60ec06e770 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f60fc007f70 tx=0x7f60fc007f00 comp rx=0 tx=0).stop 2024-09-19T09:24:45.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.740+0000 7f611260e640 1 -- 172.21.15.18:0/2405174890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f610c160c50 msgr2=0x7f610c141370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:45.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.740+0000 7f611260e640 1 --2- 172.21.15.18:0/2405174890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f610c160c50 0x7f610c141370 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f6104009d90 tx=0x7f6104004a40 comp rx=0 tx=0).stop 2024-09-19T09:24:45.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.740+0000 7f611260e640 1 -- 172.21.15.18:0/2405174890 shutdown_connections 2024-09-19T09:24:45.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.740+0000 7f611260e640 1 --2- 172.21.15.18:0/2405174890 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f60ec06c2b0 0x7f60ec06e770 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.740+0000 7f611260e640 1 --2- 172.21.15.18:0/2405174890 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f610c160c50 0x7f610c141370 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.740+0000 7f611260e640 1 --2- 172.21.15.18:0/2405174890 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f610c142150 0x7f610c13e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.740+0000 7f611260e640 1 --2- 172.21.15.18:0/2405174890 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f610c13fae0 0x7f610c0b5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:45.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.740+0000 7f611260e640 1 -- 172.21.15.18:0/2405174890 >> 172.21.15.18:0/2405174890 conn(0x7f610c06bc10 msgr2=0x7f610c0cf430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:45.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.740+0000 7f611260e640 1 -- 172.21.15.18:0/2405174890 shutdown_connections 2024-09-19T09:24:45.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:45.740+0000 7f611260e640 1 -- 172.21.15.18:0/2405174890 wait complete. 2024-09-19T09:24:45.830 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-09-19T09:24:45.831 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:24:45.831 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:24:45.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:24:45.848 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2024-09-19T09:24:46.044 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:24:46.045 INFO:teuthology.orchestra.run.smithi018.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2024-09-19T09:24:46.045 INFO:teuthology.orchestra.run.smithi018.stderr:50+0 records in 2024-09-19T09:24:46.045 INFO:teuthology.orchestra.run.smithi018.stderr:50+0 records out 2024-09-19T09:24:46.045 INFO:teuthology.orchestra.run.smithi018.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.136099 s, 385 MB/s 2024-09-19T09:24:46.046 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-19T09:24:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.147+0000 7fdb8ab11640 1 Processor -- start 2024-09-19T09:24:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.147+0000 7fdb8ab11640 1 -- start start 2024-09-19T09:24:46.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.148+0000 7fdb8ab11640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdb8415ef80 0x7fdb840b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.148+0000 7fdb8ab11640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb8406d730 0x7fdb840cf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.148+0000 7fdb8ab11640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdb840cf910 0x7fdb840d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.148+0000 7fdb8ab11640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fdb840cd7d0 con 0x7fdb840cf910 2024-09-19T09:24:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.148+0000 7fdb8ab11640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fdb840cd1a0 con 0x7fdb8415ef80 2024-09-19T09:24:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.148+0000 7fdb8ab11640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdb8406dc30 con 0x7fdb8406d730 2024-09-19T09:24:46.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.148+0000 7fdb890ae640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdb840cf910 0x7fdb840d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:46.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.148+0000 7fdb890ae640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fdb840cf910 0x7fdb840d0ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48382/0 (socket says 172.21.15.18:48382) 2024-09-19T09:24:46.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.148+0000 7fdb890ae640 1 -- 172.21.15.18:0/190157669 learned_addr learned my addr 172.21.15.18:0/190157669 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:46.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.148+0000 7fdb888ad640 1 --2- 172.21.15.18:0/190157669 >> v2:172.21.15.162:3300/0 conn(0x7fdb8415ef80 0x7fdb840b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:46.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.148+0000 7fdb83fff640 1 --2- 172.21.15.18:0/190157669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb8406d730 0x7fdb840cf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:46.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.148+0000 7fdb890ae640 1 -- 172.21.15.18:0/190157669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb8406d730 msgr2=0x7fdb840cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:46.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.148+0000 7fdb890ae640 1 --2- 172.21.15.18:0/190157669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb8406d730 0x7fdb840cf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.148+0000 7fdb890ae640 1 -- 172.21.15.18:0/190157669 >> v2:172.21.15.162:3300/0 conn(0x7fdb8415ef80 msgr2=0x7fdb840b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:46.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.148+0000 7fdb890ae640 1 --2- 172.21.15.18:0/190157669 >> v2:172.21.15.162:3300/0 conn(0x7fdb8415ef80 0x7fdb840b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.149+0000 7fdb890ae640 1 -- 172.21.15.18:0/190157669 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb8406df10 con 0x7fdb840cf910 2024-09-19T09:24:46.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.149+0000 7fdb83fff640 1 --2- 172.21.15.18:0/190157669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb8406d730 0x7fdb840cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:46.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.149+0000 7fdb888ad640 1 --2- 172.21.15.18:0/190157669 >> v2:172.21.15.162:3300/0 conn(0x7fdb8415ef80 0x7fdb840b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:46.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.149+0000 7fdb890ae640 1 --2- 172.21.15.18:0/190157669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb840cf910 0x7fdb840d0ce0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fdb8406f6e0 tx=0x7fdb7c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1875afeecb0c82d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:46.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.149+0000 7fdb837fe640 1 -- 172.21.15.18:0/190157669 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c036070 con 0x7fdb840cf910 2024-09-19T09:24:46.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.149+0000 7fdb837fe640 1 -- 172.21.15.18:0/190157669 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb7c031600 con 0x7fdb840cf910 2024-09-19T09:24:46.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.149+0000 7fdb837fe640 1 -- 172.21.15.18:0/190157669 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c0319d0 con 0x7fdb840cf910 2024-09-19T09:24:46.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.150+0000 7fdb8ab11640 1 -- 172.21.15.18:0/190157669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb840cf910 msgr2=0x7fdb840d0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:46.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.150+0000 7fdb8ab11640 1 --2- 172.21.15.18:0/190157669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb840cf910 0x7fdb840d0ce0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fdb8406f6e0 tx=0x7fdb7c02a6a0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.150+0000 7fdb8ab11640 1 -- 172.21.15.18:0/190157669 shutdown_connections 2024-09-19T09:24:46.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.150+0000 7fdb8ab11640 1 --2- 172.21.15.18:0/190157669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb840cf910 0x7fdb840d0ce0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.150+0000 7fdb8ab11640 1 --2- 172.21.15.18:0/190157669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb8406d730 0x7fdb840cf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.150+0000 7fdb8ab11640 1 --2- 172.21.15.18:0/190157669 >> v2:172.21.15.162:3300/0 conn(0x7fdb8415ef80 0x7fdb840b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.150+0000 7fdb8ab11640 1 -- 172.21.15.18:0/190157669 >> 172.21.15.18:0/190157669 conn(0x7fdb840b4700 msgr2=0x7fdb840b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:46.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.150+0000 7fdb8ab11640 1 -- 172.21.15.18:0/190157669 shutdown_connections 2024-09-19T09:24:46.164 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.150+0000 7fdb8ab11640 1 -- 172.21.15.18:0/190157669 wait complete. 2024-09-19T09:24:46.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.151+0000 7fdb8ab11640 1 Processor -- start 2024-09-19T09:24:46.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.151+0000 7fdb8ab11640 1 -- start start 2024-09-19T09:24:46.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.152+0000 7fdb8ab11640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb8406d730 0x7fdb840c6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:46.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.152+0000 7fdb8ab11640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb840cf910 0x7fdb841f5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:46.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.152+0000 7fdb8ab11640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb8415ef80 0x7fdb84153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:46.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.152+0000 7fdb8ab11640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fdb840d0120 con 0x7fdb8415ef80 2024-09-19T09:24:46.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.152+0000 7fdb8ab11640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdb8415f360 con 0x7fdb8406d730 2024-09-19T09:24:46.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.152+0000 7fdb8ab11640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fdb840d1220 con 0x7fdb840cf910 2024-09-19T09:24:46.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.152+0000 7fdb890ae640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb8415ef80 0x7fdb84153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:46.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.152+0000 7fdb890ae640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb8415ef80 0x7fdb84153080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48386/0 (socket says 172.21.15.18:48386) 2024-09-19T09:24:46.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.152+0000 7fdb890ae640 1 -- 172.21.15.18:0/2521418485 learned_addr learned my addr 172.21.15.18:0/2521418485 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:46.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.152+0000 7fdb888ad640 1 --2- 172.21.15.18:0/2521418485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb8406d730 0x7fdb840c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:46.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.152+0000 7fdb83fff640 1 --2- 172.21.15.18:0/2521418485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb840cf910 0x7fdb841f5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:46.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.153+0000 7fdb890ae640 1 -- 172.21.15.18:0/2521418485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb840cf910 msgr2=0x7fdb841f5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:46.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.153+0000 7fdb890ae640 1 --2- 172.21.15.18:0/2521418485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb840cf910 0x7fdb841f5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.153+0000 7fdb890ae640 1 -- 172.21.15.18:0/2521418485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb8406d730 msgr2=0x7fdb840c6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:46.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.153+0000 7fdb890ae640 1 --2- 172.21.15.18:0/2521418485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb8406d730 0x7fdb840c6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.153+0000 7fdb890ae640 1 -- 172.21.15.18:0/2521418485 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb841f5b70 con 0x7fdb8415ef80 2024-09-19T09:24:46.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.153+0000 7fdb890ae640 1 --2- 172.21.15.18:0/2521418485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb8415ef80 0x7fdb84153080 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c02ac90 tx=0x7fdb7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:46.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.153+0000 7fdb817fa640 1 -- 172.21.15.18:0/2521418485 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c03f020 con 0x7fdb8415ef80 2024-09-19T09:24:46.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.153+0000 7fdb817fa640 1 -- 172.21.15.18:0/2521418485 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb7c037040 con 0x7fdb8415ef80 2024-09-19T09:24:46.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.153+0000 7fdb8ab11640 1 -- 172.21.15.18:0/2521418485 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb841f60e0 con 0x7fdb8415ef80 2024-09-19T09:24:46.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.153+0000 7fdb817fa640 1 -- 172.21.15.18:0/2521418485 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c036070 con 0x7fdb8415ef80 2024-09-19T09:24:46.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.153+0000 7fdb8ab11640 1 -- 172.21.15.18:0/2521418485 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb841f66a0 con 0x7fdb8415ef80 2024-09-19T09:24:46.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.154+0000 7fdb8ab11640 1 -- 172.21.15.18:0/2521418485 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb840d0ce0 con 0x7fdb8415ef80 2024-09-19T09:24:46.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.154+0000 7fdb817fa640 1 -- 172.21.15.18:0/2521418485 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fdb7c042020 con 0x7fdb8415ef80 2024-09-19T09:24:46.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.155+0000 7fdb817fa640 1 --2- 172.21.15.18:0/2521418485 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdb7006c2b0 0x7fdb7006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:46.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.155+0000 7fdb817fa640 1 -- 172.21.15.18:0/2521418485 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 5709+0+0 (secure 0 0 0) 0x7fdb7c0aba50 con 0x7fdb8415ef80 2024-09-19T09:24:46.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.155+0000 7fdb817fa640 1 -- 172.21.15.18:0/2521418485 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=185}) -- 0x7fdb70073de0 con 0x7fdb8415ef80 2024-09-19T09:24:46.169 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.155+0000 7fdb888ad640 1 --2- 172.21.15.18:0/2521418485 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdb7006c2b0 0x7fdb7006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:46.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.156+0000 7fdb888ad640 1 --2- 172.21.15.18:0/2521418485 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdb7006c2b0 0x7fdb7006e770 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400aa40 tx=0x7fdb74008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:46.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.159+0000 7fdb817fa640 1 -- 172.21.15.18:0/2521418485 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fdb7c049030 con 0x7fdb8415ef80 2024-09-19T09:24:46.337 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.336+0000 7fdb8ab11640 1 -- 172.21.15.18:0/2521418485 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fdb840cff00 con 0x7fdb8415ef80 2024-09-19T09:24:46.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.338+0000 7fdb817fa640 1 -- 172.21.15.18:0/2521418485 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v184) ==== 81+0+34309 (secure 0 0 0) 0x7fdb841f5b70 con 0x7fdb8415ef80 2024-09-19T09:24:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:24:46.339 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:24:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 184, 2024-09-19T09:24:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:24:46.339 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-19T09:13:11.348786+0000", 2024-09-19T09:24:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-19T09:24:41.275573+0000", 2024-09-19T09:24:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-19T09:13:16.423937+0000", 2024-09-19T09:24:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-19T09:13:13.417141+0000", 2024-09-19T09:24:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-19T09:24:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-09-19T09:24:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-19T09:24:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-19T09:24:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-19T09:24:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-19T09:24:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-19T09:24:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-19T09:24:46.340 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.69999998807907104, 2024-09-19T09:24:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-19T09:24:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-19T09:24:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-19T09:24:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 23, 2024-09-19T09:24:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-19T09:24:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-19T09:24:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "jewel", 2024-09-19T09:24:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-19T09:24:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-19T09:24:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-19T09:24:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-19T09:24:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-19T09:24:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:13:17.564717+0000", 2024-09-19T09:24:46.341 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:24:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:24:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:24:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:24:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:24:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:24:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:24:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:24:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:24:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:24:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:24:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:24:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:24:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-19T09:24:46.342 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-19T09:24:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-19T09:24:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-19T09:24:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-19T09:24:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:24:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:24:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:24:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:24:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:24:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:24:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:24:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "111", 2024-09-19T09:24:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:24:46.343 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:24:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:24:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:24:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:24:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:24:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:24:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:24:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:24:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:24:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:24:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:24:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:24:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:24:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:24:46.344 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:24:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:24:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:24:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:24:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:24:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:24:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:24:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:24:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:24:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:24:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:24:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:24:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:24:46.345 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:24:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:24:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:24:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:24:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:24:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:24:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:24:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:24:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:24:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:24:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-19T09:24:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-19T09:24:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:24:46.346 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-19T09:24:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:24:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:24:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-19T09:24:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-19T09:24:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-19T09:24:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-19T09:24:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-19T09:24:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:24:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:24:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:24:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.347 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 22, 2024-09-19T09:24:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_metadata", 2024-09-19T09:24:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:24:23.190145+0000", 2024-09-19T09:24:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:24:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:24:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:24:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:24:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:24:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:24:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:24:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:24:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:24:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:24:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:24:46.348 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:24:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:24:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-19T09:24:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-19T09:24:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-19T09:24:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-19T09:24:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-19T09:24:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:24:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:24:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:24:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:24:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:24:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:24:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:24:46.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "181", 2024-09-19T09:24:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:24:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:24:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:24:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:24:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:24:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:24:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:24:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:24:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:24:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:24:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:24:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:24:46.350 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:24:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:24:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:24:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:24:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:24:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:24:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:24:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:24:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:24:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:24:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:24:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:24:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:24:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:24:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.351 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:24:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:24:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:24:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:24:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:24:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:24:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:24:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:24:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:24:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:24:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:24:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:24:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4, 2024-09-19T09:24:46.352 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 16, 2024-09-19T09:24:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_priority": 5 2024-09-19T09:24:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:24:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:24:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": "cephfs" 2024-09-19T09:24:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:24:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:24:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.5, 2024-09-19T09:24:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.5, 2024-09-19T09:24:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:24:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.5, 2024-09-19T09:24:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.5, 2024-09-19T09:24:46.353 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:24:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:24:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:24:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 23, 2024-09-19T09:24:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_data", 2024-09-19T09:24:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:24:24.517971+0000", 2024-09-19T09:24:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1027, 2024-09-19T09:24:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-19T09:24:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:24:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:24:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:24:46.354 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:24:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:24:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:24:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:24:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:24:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:24:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:24:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:24:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 64, 2024-09-19T09:24:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 64, 2024-09-19T09:24:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 64, 2024-09-19T09:24:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 64, 2024-09-19T09:24:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 64, 2024-09-19T09:24:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:24:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:24:46.355 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:24:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:24:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:24:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:24:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:24:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "184", 2024-09-19T09:24:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:24:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:24:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:24:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:24:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:24:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:24:46.356 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:24:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:24:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:24:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 33554432, 2024-09-19T09:24:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:24:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:24:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:24:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:24:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:24:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:24:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:24:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:24:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:24:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:24:46.357 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:24:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:24:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:24:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:24:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:24:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:24:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:24:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:24:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:24:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:24:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:24:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:24:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:24:46.358 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:24:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:24:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:24:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:24:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:24:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 64, 2024-09-19T09:24:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "target_size_ratio": 0.89999997615814209 2024-09-19T09:24:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:24:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:24:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "data": "cephfs" 2024-09-19T09:24:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:24:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:24:46.359 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.3799999952316284, 2024-09-19T09:24:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.3799999952316284, 2024-09-19T09:24:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:24:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-19T09:24:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-19T09:24:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:24:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:24:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:24:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-19T09:24:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:24:46.360 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.361 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-19T09:24:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-19T09:24:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.362 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-19T09:24:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-19T09:24:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.363 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-19T09:24:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-19T09:24:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.364 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-19T09:24:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-19T09:24:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/128722874", 2024-09-19T09:24:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/128722874", 2024-09-19T09:24:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/128722874", 2024-09-19T09:24:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/128722874", 2024-09-19T09:24:46.365 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:24:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:46.366 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-19T09:24:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-19T09:24:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:46.367 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-19T09:24:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-19T09:24:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:46.368 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-19T09:24:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-19T09:24:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:46.369 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-19T09:24:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-19T09:24:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:46.370 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/3672199638", 2024-09-19T09:24:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/3672199638", 2024-09-19T09:24:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/3672199638", 2024-09-19T09:24:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/3672199638", 2024-09-19T09:24:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:24:46.371 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.372 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T09:24:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T09:24:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.373 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-19T09:24:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-19T09:24:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.374 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-19T09:24:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-19T09:24:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.375 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-19T09:24:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-19T09:24:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3463367841", 2024-09-19T09:24:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3463367841", 2024-09-19T09:24:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3463367841", 2024-09-19T09:24:46.376 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3463367841", 2024-09-19T09:24:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:24:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:46.377 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-19T09:24:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-19T09:24:46.378 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-19T09:24:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-19T09:24:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:46.379 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-19T09:24:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-19T09:24:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:46.380 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-19T09:24:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-19T09:24:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:46.381 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/4163178582", 2024-09-19T09:24:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/4163178582", 2024-09-19T09:24:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/4163178582", 2024-09-19T09:24:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/4163178582", 2024-09-19T09:24:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:24:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:46.382 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.383 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6822", 2024-09-19T09:24:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6824", 2024-09-19T09:24:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.384 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6826", 2024-09-19T09:24:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6827", 2024-09-19T09:24:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6830", 2024-09-19T09:24:46.385 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6831", 2024-09-19T09:24:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6828", 2024-09-19T09:24:46.386 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6829", 2024-09-19T09:24:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6824/3538482215", 2024-09-19T09:24:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6827/3538482215", 2024-09-19T09:24:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6831/3538482215", 2024-09-19T09:24:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6829/3538482215", 2024-09-19T09:24:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:46.387 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:24:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:46.388 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6800", 2024-09-19T09:24:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6801", 2024-09-19T09:24:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.389 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6802", 2024-09-19T09:24:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6803", 2024-09-19T09:24:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:46.390 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6806", 2024-09-19T09:24:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6807", 2024-09-19T09:24:46.391 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6804", 2024-09-19T09:24:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6805", 2024-09-19T09:24:46.392 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6801/2408698413", 2024-09-19T09:24:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6803/2408698413", 2024-09-19T09:24:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6807/2408698413", 2024-09-19T09:24:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6805/2408698413", 2024-09-19T09:24:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.393 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:24:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.394 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6808", 2024-09-19T09:24:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6809", 2024-09-19T09:24:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.395 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6810", 2024-09-19T09:24:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6811", 2024-09-19T09:24:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.396 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6814", 2024-09-19T09:24:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6815", 2024-09-19T09:24:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.397 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6812", 2024-09-19T09:24:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6813", 2024-09-19T09:24:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6809/2596207948", 2024-09-19T09:24:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6811/2596207948", 2024-09-19T09:24:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6815/2596207948", 2024-09-19T09:24:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6813/2596207948", 2024-09-19T09:24:46.398 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:24:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:46.399 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6816", 2024-09-19T09:24:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:46.400 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6817", 2024-09-19T09:24:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6818", 2024-09-19T09:24:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:46.401 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6819", 2024-09-19T09:24:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6823", 2024-09-19T09:24:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.402 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6825", 2024-09-19T09:24:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6820", 2024-09-19T09:24:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.403 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6821", 2024-09-19T09:24:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6817/1334618296", 2024-09-19T09:24:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6819/1334618296", 2024-09-19T09:24:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6825/1334618296", 2024-09-19T09:24:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6821/1334618296", 2024-09-19T09:24:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:46.404 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-19T09:24:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:24:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.580838+0000", 2024-09-19T09:24:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.405 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:24:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.599990+0000", 2024-09-19T09:24:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:24:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:46.406 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.503722+0000", 2024-09-19T09:24:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:24:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.607846+0000", 2024-09-19T09:24:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:46.407 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:24:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.616858+0000", 2024-09-19T09:24:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:24:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:46.408 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.542726+0000", 2024-09-19T09:24:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:24:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:46.409 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.534178+0000", 2024-09-19T09:24:46.410 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:46.410 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.410 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:46.410 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:24:46.410 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:46.410 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:46.410 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:46.410 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:46.410 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:46.410 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.612105+0000", 2024-09-19T09:24:46.410 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:46.410 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.410 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:46.410 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-19T09:24:46.410 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-19T09:24:46.411 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-19T09:24:46.411 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-19T09:24:46.411 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-19T09:24:46.411 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-19T09:24:46.411 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-19T09:24:46.411 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-19T09:24:46.411 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-19T09:24:46.411 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-19T09:24:46.411 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-19T09:24:46.411 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-19T09:24:46.411 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-19T09:24:46.411 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-19T09:24:46.411 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.411 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:46.412 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-19T09:24:46.412 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-19T09:24:46.412 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-19T09:24:46.412 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-19T09:24:46.412 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-19T09:24:46.412 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-19T09:24:46.412 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-19T09:24:46.412 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-19T09:24:46.412 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-19T09:24:46.412 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-19T09:24:46.412 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-19T09:24:46.412 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:46.412 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:24:46.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.340+0000 7fdb8ab11640 1 -- 172.21.15.18:0/2521418485 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdb7006c2b0 msgr2=0x7fdb7006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:46.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.340+0000 7fdb8ab11640 1 --2- 172.21.15.18:0/2521418485 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdb7006c2b0 0x7fdb7006e770 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fdb7400aa40 tx=0x7fdb74008040 comp rx=0 tx=0).stop 2024-09-19T09:24:46.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.340+0000 7fdb8ab11640 1 -- 172.21.15.18:0/2521418485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb8415ef80 msgr2=0x7fdb84153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:46.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.340+0000 7fdb8ab11640 1 --2- 172.21.15.18:0/2521418485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb8415ef80 0x7fdb84153080 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c02ac90 tx=0x7fdb7c004a40 comp rx=0 tx=0).stop 2024-09-19T09:24:46.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.340+0000 7fdb8ab11640 1 -- 172.21.15.18:0/2521418485 shutdown_connections 2024-09-19T09:24:46.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.340+0000 7fdb8ab11640 1 --2- 172.21.15.18:0/2521418485 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fdb7006c2b0 0x7fdb7006e770 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.340+0000 7fdb8ab11640 1 --2- 172.21.15.18:0/2521418485 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fdb8415ef80 0x7fdb84153080 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.340+0000 7fdb8ab11640 1 --2- 172.21.15.18:0/2521418485 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fdb840cf910 0x7fdb841f5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.340+0000 7fdb8ab11640 1 --2- 172.21.15.18:0/2521418485 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdb8406d730 0x7fdb840c6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.340+0000 7fdb8ab11640 1 -- 172.21.15.18:0/2521418485 >> 172.21.15.18:0/2521418485 conn(0x7fdb840b4700 msgr2=0x7fdb840d2fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:46.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.340+0000 7fdb8ab11640 1 -- 172.21.15.18:0/2521418485 shutdown_connections 2024-09-19T09:24:46.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.340+0000 7fdb8ab11640 1 -- 172.21.15.18:0/2521418485 wait complete. 2024-09-19T09:24:46.415 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:24:46.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.517+0000 7f1a52703640 1 Processor -- start 2024-09-19T09:24:46.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.517+0000 7f1a52703640 1 -- start start 2024-09-19T09:24:46.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.517+0000 7f1a52703640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1a4c15ef50 0x7f1a4c0d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:46.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.517+0000 7f1a52703640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a4c0d3240 0x7f1a4c0d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:46.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.517+0000 7f1a52703640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a4c0b7a90 con 0x7f1a4c0d5780 2024-09-19T09:24:46.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.517+0000 7f1a52703640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f1a4c0d3740 con 0x7f1a4c15ef50 2024-09-19T09:24:46.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.517+0000 7f1a52703640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1a4c0d3a20 con 0x7f1a4c0d3240 2024-09-19T09:24:46.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.518+0000 7f1a4bfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1a4c15ef50 0x7f1a4c0d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:46.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.518+0000 7f1a4bfff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1a4c15ef50 0x7f1a4c0d13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48392/0 (socket says 172.21.15.18:48392) 2024-09-19T09:24:46.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.518+0000 7f1a4bfff640 1 -- 172.21.15.18:0/2633419536 learned_addr learned my addr 172.21.15.18:0/2633419536 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:46.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.518+0000 7f1a4bfff640 1 -- 172.21.15.18:0/2633419536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a4c0d3240 msgr2=0x7f1a4c0d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:46.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.518+0000 7f1a43fff640 1 --2- 172.21.15.18:0/2633419536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a4c0d3240 0x7f1a4c0d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:46.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.518+0000 7f1a4bfff640 1 --2- 172.21.15.18:0/2633419536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a4c0d3240 0x7f1a4c0d18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.518+0000 7f1a4bfff640 1 -- 172.21.15.18:0/2633419536 >> v1:172.21.15.162:6789/0 conn(0x7f1a4c0d5780 legacy=0x7f1a4c0cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:46.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.518+0000 7f1a4bfff640 1 -- 172.21.15.18:0/2633419536 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a4c0b7d00 con 0x7f1a4c15ef50 2024-09-19T09:24:46.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.519+0000 7f1a4bfff640 1 --2- 172.21.15.18:0/2633419536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a4c15ef50 0x7f1a4c0d13a0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c009870 tx=0x7f1a3c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b9e4270f7c172d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:46.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.519+0000 7f1a4b7fe640 1 -- 172.21.15.18:0/2633419536 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c037070 con 0x7f1a4c15ef50 2024-09-19T09:24:46.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.519+0000 7f1a4b7fe640 1 -- 172.21.15.18:0/2633419536 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a3c032440 con 0x7f1a4c15ef50 2024-09-19T09:24:46.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.519+0000 7f1a4b7fe640 1 -- 172.21.15.18:0/2633419536 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c032810 con 0x7f1a4c15ef50 2024-09-19T09:24:46.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.519+0000 7f1a52703640 1 -- 172.21.15.18:0/2633419536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a4c15ef50 msgr2=0x7f1a4c0d13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:46.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.519+0000 7f1a52703640 1 --2- 172.21.15.18:0/2633419536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a4c15ef50 0x7f1a4c0d13a0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c009870 tx=0x7f1a3c02a180 comp rx=0 tx=0).stop 2024-09-19T09:24:46.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.519+0000 7f1a52703640 1 -- 172.21.15.18:0/2633419536 shutdown_connections 2024-09-19T09:24:46.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.519+0000 7f1a52703640 1 --2- 172.21.15.18:0/2633419536 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a4c0d3240 0x7f1a4c0d18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.519+0000 7f1a52703640 1 --2- 172.21.15.18:0/2633419536 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a4c15ef50 0x7f1a4c0d13a0 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.519+0000 7f1a52703640 1 -- 172.21.15.18:0/2633419536 >> 172.21.15.18:0/2633419536 conn(0x7f1a4c0d4c60 msgr2=0x7f1a4c0d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:46.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.520+0000 7f1a52703640 1 -- 172.21.15.18:0/2633419536 shutdown_connections 2024-09-19T09:24:46.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.520+0000 7f1a52703640 1 -- 172.21.15.18:0/2633419536 wait complete. 2024-09-19T09:24:46.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.521+0000 7f1a52703640 1 Processor -- start 2024-09-19T09:24:46.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.521+0000 7f1a52703640 1 -- start start 2024-09-19T09:24:46.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.521+0000 7f1a52703640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a4c0d3240 0x7f1a4c1e5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:46.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.521+0000 7f1a52703640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a4c0d5780 0x7f1a4c15d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:46.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.521+0000 7f1a52703640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a4c15ef50 0x7f1a4c1e40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:46.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.521+0000 7f1a52703640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4c0d21a0 con 0x7f1a4c15ef50 2024-09-19T09:24:46.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.521+0000 7f1a52703640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4c0d2020 con 0x7f1a4c0d3240 2024-09-19T09:24:46.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.521+0000 7f1a52703640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f1a4c0b9510 con 0x7f1a4c0d5780 2024-09-19T09:24:46.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.522+0000 7f1a50ca0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a4c15ef50 0x7f1a4c1e40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:46.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.522+0000 7f1a50ca0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a4c15ef50 0x7f1a4c1e40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48400/0 (socket says 172.21.15.18:48400) 2024-09-19T09:24:46.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.522+0000 7f1a50ca0640 1 -- 172.21.15.18:0/3666095914 learned_addr learned my addr 172.21.15.18:0/3666095914 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:46.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.522+0000 7f1a43fff640 1 --2- 172.21.15.18:0/3666095914 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a4c0d5780 0x7f1a4c15d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:46.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.522+0000 7f1a4bfff640 1 --2- 172.21.15.18:0/3666095914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a4c0d3240 0x7f1a4c1e5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:46.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.522+0000 7f1a50ca0640 1 -- 172.21.15.18:0/3666095914 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a4c0d5780 msgr2=0x7f1a4c15d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:46.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.522+0000 7f1a50ca0640 1 --2- 172.21.15.18:0/3666095914 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a4c0d5780 0x7f1a4c15d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.522+0000 7f1a50ca0640 1 -- 172.21.15.18:0/3666095914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a4c0d3240 msgr2=0x7f1a4c1e5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:46.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.522+0000 7f1a50ca0640 1 --2- 172.21.15.18:0/3666095914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a4c0d3240 0x7f1a4c1e5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.522+0000 7f1a50ca0640 1 -- 172.21.15.18:0/3666095914 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a4c1e4c40 con 0x7f1a4c15ef50 2024-09-19T09:24:46.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.522+0000 7f1a50ca0640 1 --2- 172.21.15.18:0/3666095914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a4c15ef50 0x7f1a4c1e40d0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400c780 tx=0x7f1a4400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:46.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.522+0000 7f1a497fa640 1 -- 172.21.15.18:0/3666095914 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a44004b60 con 0x7f1a4c15ef50 2024-09-19T09:24:46.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.522+0000 7f1a497fa640 1 -- 172.21.15.18:0/3666095914 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a44004d00 con 0x7f1a4c15ef50 2024-09-19T09:24:46.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.522+0000 7f1a52703640 1 -- 172.21.15.18:0/3666095914 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a4c1e4f20 con 0x7f1a4c15ef50 2024-09-19T09:24:46.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.522+0000 7f1a497fa640 1 -- 172.21.15.18:0/3666095914 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4400aa90 con 0x7f1a4c15ef50 2024-09-19T09:24:46.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.522+0000 7f1a52703640 1 -- 172.21.15.18:0/3666095914 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a4c1e57c0 con 0x7f1a4c15ef50 2024-09-19T09:24:46.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.523+0000 7f1a52703640 1 -- 172.21.15.18:0/3666095914 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a4c1e50f0 con 0x7f1a4c15ef50 2024-09-19T09:24:46.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.524+0000 7f1a497fa640 1 -- 172.21.15.18:0/3666095914 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1a4400ac30 con 0x7f1a4c15ef50 2024-09-19T09:24:46.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.524+0000 7f1a497fa640 1 --2- 172.21.15.18:0/3666095914 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1a2c06c2b0 0x7f1a2c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:46.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.525+0000 7f1a497fa640 1 -- 172.21.15.18:0/3666095914 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 5709+0+0 (secure 0 0 0) 0x7f1a4408b5a0 con 0x7f1a4c15ef50 2024-09-19T09:24:46.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.525+0000 7f1a4bfff640 1 --2- 172.21.15.18:0/3666095914 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1a2c06c2b0 0x7f1a2c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:46.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.525+0000 7f1a497fa640 1 -- 172.21.15.18:0/3666095914 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=185}) -- 0x7f1a2c073de0 con 0x7f1a4c15ef50 2024-09-19T09:24:46.527 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.525+0000 7f1a4bfff640 1 --2- 172.21.15.18:0/3666095914 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1a2c06c2b0 0x7f1a2c06e770 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c034000 tx=0x7f1a3c02e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:46.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.529+0000 7f1a497fa640 1 -- 172.21.15.18:0/3666095914 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1a44020070 con 0x7f1a4c15ef50 2024-09-19T09:24:46.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.740+0000 7f1a52703640 1 -- 172.21.15.18:0/3666095914 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1a4c1e59c0 con 0x7f1a4c15ef50 2024-09-19T09:24:46.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.741+0000 7f1a497fa640 1 -- 172.21.15.18:0/3666095914 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+5233 (secure 0 0 0) 0x7f1a440596b0 con 0x7f1a4c15ef50 2024-09-19T09:24:46.742 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:24:46.742 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":82,"btime":"2024-09-19T09:24:28:275969+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1644566118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1644566118},{"type":"v1","addr":"172.21.15.162:6835","nonce":1644566118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3767901067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3767901067},{"type":"v1","addr":"172.21.15.162:6837","nonce":3767901067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7851,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1160903618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1160903618},{"type":"v1","addr":"172.21.15.18:6834","nonce":1160903618}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:24:25.526108+0000","modified":"2024-09-19T09:24:27.619787+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7854},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7854":{"gid":7854,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2545948137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2545948137},{"type":"v1","addr":"172.21.15.18:6835","nonce":2545948137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7854,"qdb_cluster":[7854]},"id":11}]} 2024-09-19T09:24:46.743 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 82 2024-09-19T09:24:46.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.743+0000 7f1a52703640 1 -- 172.21.15.18:0/3666095914 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1a2c06c2b0 msgr2=0x7f1a2c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:46.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.743+0000 7f1a52703640 1 --2- 172.21.15.18:0/3666095914 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1a2c06c2b0 0x7f1a2c06e770 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c034000 tx=0x7f1a3c02e000 comp rx=0 tx=0).stop 2024-09-19T09:24:46.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.743+0000 7f1a52703640 1 -- 172.21.15.18:0/3666095914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a4c15ef50 msgr2=0x7f1a4c1e40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:46.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.743+0000 7f1a52703640 1 --2- 172.21.15.18:0/3666095914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a4c15ef50 0x7f1a4c1e40d0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400c780 tx=0x7f1a4400cc40 comp rx=0 tx=0).stop 2024-09-19T09:24:46.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.743+0000 7f1a52703640 1 -- 172.21.15.18:0/3666095914 shutdown_connections 2024-09-19T09:24:46.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.743+0000 7f1a52703640 1 --2- 172.21.15.18:0/3666095914 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f1a2c06c2b0 0x7f1a2c06e770 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.743+0000 7f1a52703640 1 --2- 172.21.15.18:0/3666095914 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1a4c15ef50 0x7f1a4c1e40d0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.743+0000 7f1a52703640 1 --2- 172.21.15.18:0/3666095914 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1a4c0d5780 0x7f1a4c15d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.743+0000 7f1a52703640 1 --2- 172.21.15.18:0/3666095914 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a4c0d3240 0x7f1a4c1e5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:46.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.743+0000 7f1a52703640 1 -- 172.21.15.18:0/3666095914 >> 172.21.15.18:0/3666095914 conn(0x7f1a4c0d4c60 msgr2=0x7f1a4c06d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:46.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.743+0000 7f1a52703640 1 -- 172.21.15.18:0/3666095914 shutdown_connections 2024-09-19T09:24:46.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:46.743+0000 7f1a52703640 1 -- 172.21.15.18:0/3666095914 wait complete. 2024-09-19T09:24:46.755 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-19T09:24:46.876 INFO:teuthology.orchestra.run.smithi018.stdout:{"cluster_fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","whoami":0,"id":7854,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":20.677167542999999,"mdsmap_epoch":82,"osdmap_epoch":184,"osdmap_epoch_barrier":184,"uptime":25.713207835999999} 2024-09-19T09:24:46.877 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", "fs_name": "cephfs", "id": 7854, "mdsmap_epoch": 82, "osdmap_epoch": 184, "osdmap_epoch_barrier": 184, "rank_uptime": 20.677167543, "state": "up:active", "uptime": 25.713207836, "want_state": "up:active", "whoami": 0 } 2024-09-19T09:24:46.877 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-19T09:24:46.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:24:46.878 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2024-09-19T09:24:46.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:24:46.896 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2024-09-19T09:24:46.960 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-19T09:24:47.102 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.102+0000 7f51673b7640 1 Processor -- start 2024-09-19T09:24:47.103 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.102+0000 7f51673b7640 1 -- start start 2024-09-19T09:24:47.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.103+0000 7f51673b7640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f51600ce780 0x7f516006f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:47.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.103+0000 7f51673b7640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f516006e3d0 con 0x7f5160145290 2024-09-19T09:24:47.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.103+0000 7f51673b7640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f516006e6b0 con 0x7f5160072f40 2024-09-19T09:24:47.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.103+0000 7f51673b7640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f516006efe0 con 0x7f51600ce780 2024-09-19T09:24:47.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.103+0000 7f5165153640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f5160145290 0x7f5160072830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:39244/0 (socket says 172.21.15.18:39244) 2024-09-19T09:24:47.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.103+0000 7f5165153640 1 -- 172.21.15.18:0/1676013848 learned_addr learned my addr 172.21.15.18:0/1676013848 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:24:47.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.103+0000 7f5165954640 1 --2- 172.21.15.18:0/1676013848 >> v2:172.21.15.162:3300/0 conn(0x7f51600ce780 0x7f516006f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:47.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.103+0000 7f5157fff640 1 -- 172.21.15.18:0/1676013848 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3868179779 0 0) 0x7f516006e3d0 con 0x7f5160145290 2024-09-19T09:24:47.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.103+0000 7f5157fff640 1 -- 172.21.15.18:0/1676013848 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f514c003520 con 0x7f5160145290 2024-09-19T09:24:47.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.103+0000 7f5157fff640 1 -- 172.21.15.18:0/1676013848 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4008050785 0 0) 0x7f516006e6b0 con 0x7f5160072f40 2024-09-19T09:24:47.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.103+0000 7f5157fff640 1 -- 172.21.15.18:0/1676013848 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f516006e3d0 con 0x7f5160072f40 2024-09-19T09:24:47.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.103+0000 7f5165954640 1 -- 172.21.15.18:0/1676013848 >> v1:172.21.15.162:6789/0 conn(0x7f5160072f40 legacy=0x7f51600b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:47.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.103+0000 7f5165954640 1 -- 172.21.15.18:0/1676013848 >> v1:172.21.15.18:6789/0 conn(0x7f5160145290 legacy=0x7f5160072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:47.105 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.103+0000 7f5165954640 1 -- 172.21.15.18:0/1676013848 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f516006e990 con 0x7f51600ce780 2024-09-19T09:24:47.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.104+0000 7f5165954640 1 --2- 172.21.15.18:0/1676013848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51600ce780 0x7f516006f470 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5158009d90 tx=0x7f515802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd7a9c2dc362b38 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:47.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.104+0000 7f5157fff640 1 -- 172.21.15.18:0/1676013848 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5158007740 con 0x7f51600ce780 2024-09-19T09:24:47.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.104+0000 7f5157fff640 1 -- 172.21.15.18:0/1676013848 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51580078e0 con 0x7f51600ce780 2024-09-19T09:24:47.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.104+0000 7f5157fff640 1 -- 172.21.15.18:0/1676013848 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5158007cb0 con 0x7f51600ce780 2024-09-19T09:24:47.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.105+0000 7f51673b7640 1 -- 172.21.15.18:0/1676013848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51600ce780 msgr2=0x7f516006f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:47.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.105+0000 7f51673b7640 1 --2- 172.21.15.18:0/1676013848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51600ce780 0x7f516006f470 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5158009d90 tx=0x7f515802a6f0 comp rx=0 tx=0).stop 2024-09-19T09:24:47.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.105+0000 7f51673b7640 1 -- 172.21.15.18:0/1676013848 shutdown_connections 2024-09-19T09:24:47.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.105+0000 7f51673b7640 1 --2- 172.21.15.18:0/1676013848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51600ce780 0x7f516006f470 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:47.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.105+0000 7f51673b7640 1 -- 172.21.15.18:0/1676013848 >> 172.21.15.18:0/1676013848 conn(0x7f516006bc10 msgr2=0x7f516006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:47.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.105+0000 7f51673b7640 1 -- 172.21.15.18:0/1676013848 shutdown_connections 2024-09-19T09:24:47.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.105+0000 7f51673b7640 1 -- 172.21.15.18:0/1676013848 wait complete. 2024-09-19T09:24:47.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.106+0000 7f51673b7640 1 Processor -- start 2024-09-19T09:24:47.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.106+0000 7f51673b7640 1 -- start start 2024-09-19T09:24:47.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.107+0000 7f51673b7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5160072f40 0x7f51600c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:47.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.107+0000 7f51673b7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51600ce780 0x7f51601ed400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:47.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.107+0000 7f51673b7640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5160145290 0x7f51601ed940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:47.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.107+0000 7f51673b7640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f516006df80 con 0x7f5160072f40 2024-09-19T09:24:47.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.107+0000 7f51673b7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f5160145670 con 0x7f51600ce780 2024-09-19T09:24:47.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.107+0000 7f51673b7640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f516006e100 con 0x7f5160145290 2024-09-19T09:24:47.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.107+0000 7f5165153640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5160072f40 0x7f51600c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:47.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.107+0000 7f5165153640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5160072f40 0x7f51600c8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48404/0 (socket says 172.21.15.18:48404) 2024-09-19T09:24:47.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.107+0000 7f5165153640 1 -- 172.21.15.18:0/1443089120 learned_addr learned my addr 172.21.15.18:0/1443089120 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:47.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.107+0000 7f5165954640 1 --2- 172.21.15.18:0/1443089120 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5160145290 0x7f51601ed940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:47.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.107+0000 7f5164952640 1 --2- 172.21.15.18:0/1443089120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51600ce780 0x7f51601ed400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:47.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.107+0000 7f5165153640 1 -- 172.21.15.18:0/1443089120 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5160145290 msgr2=0x7f51601ed940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:47.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.107+0000 7f5165153640 1 --2- 172.21.15.18:0/1443089120 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5160145290 0x7f51601ed940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:47.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.107+0000 7f5165153640 1 -- 172.21.15.18:0/1443089120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51600ce780 msgr2=0x7f51601ed400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:47.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.107+0000 7f5165153640 1 --2- 172.21.15.18:0/1443089120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51600ce780 0x7f51601ed400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:47.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.107+0000 7f5165153640 1 -- 172.21.15.18:0/1443089120 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51600c67e0 con 0x7f5160072f40 2024-09-19T09:24:47.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.107+0000 7f5164952640 1 --2- 172.21.15.18:0/1443089120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51600ce780 0x7f51601ed400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:47.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.108+0000 7f5165153640 1 --2- 172.21.15.18:0/1443089120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5160072f40 0x7f51600c8500 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f515c00c500 tx=0x7f515c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:47.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.108+0000 7f5155ffb640 1 -- 172.21.15.18:0/1443089120 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f515c017070 con 0x7f5160072f40 2024-09-19T09:24:47.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.108+0000 7f5155ffb640 1 -- 172.21.15.18:0/1443089120 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f515c005ce0 con 0x7f5160072f40 2024-09-19T09:24:47.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.108+0000 7f5155ffb640 1 -- 172.21.15.18:0/1443089120 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f515c0072f0 con 0x7f5160072f40 2024-09-19T09:24:47.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.108+0000 7f51673b7640 1 -- 172.21.15.18:0/1443089120 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51600c6ac0 con 0x7f5160072f40 2024-09-19T09:24:47.110 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.108+0000 7f51673b7640 1 -- 172.21.15.18:0/1443089120 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51600c7080 con 0x7f5160072f40 2024-09-19T09:24:47.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.109+0000 7f51673b7640 1 -- 172.21.15.18:0/1443089120 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51600715a0 con 0x7f5160072f40 2024-09-19T09:24:47.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.109+0000 7f5155ffb640 1 -- 172.21.15.18:0/1443089120 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f515c01a070 con 0x7f5160072f40 2024-09-19T09:24:47.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.110+0000 7f5155ffb640 1 --2- 172.21.15.18:0/1443089120 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f514406c2b0 0x7f514406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:47.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.110+0000 7f5155ffb640 1 -- 172.21.15.18:0/1443089120 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 5709+0+0 (secure 0 0 0) 0x7f515c08a720 con 0x7f5160072f40 2024-09-19T09:24:47.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.110+0000 7f5155ffb640 1 -- 172.21.15.18:0/1443089120 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=185}) -- 0x7f5144073de0 con 0x7f5160072f40 2024-09-19T09:24:47.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.110+0000 7f5164952640 1 --2- 172.21.15.18:0/1443089120 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f514406c2b0 0x7f514406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:47.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.110+0000 7f5164952640 1 --2- 172.21.15.18:0/1443089120 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f514406c2b0 0x7f514406e770 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f516013dac0 tx=0x7f5150009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:47.115 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.114+0000 7f5155ffb640 1 -- 172.21.15.18:0/1443089120 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f515c0588d0 con 0x7f5160072f40 2024-09-19T09:24:47.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.290+0000 7f51673b7640 1 -- 172.21.15.18:0/1443089120 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7f516015e230 con 0x7f5160072f40 2024-09-19T09:24:47.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.291+0000 7f5155ffb640 1 -- 172.21.15.18:0/1443089120 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v184) ==== 81+0+34309 (secure 0 0 0) 0x7f515c05cbd0 con 0x7f5160072f40 2024-09-19T09:24:47.292 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:24:47.293 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:24:47.293 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 184, 2024-09-19T09:24:47.293 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:24:47.293 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-19T09:13:11.348786+0000", 2024-09-19T09:24:47.293 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-19T09:24:41.275573+0000", 2024-09-19T09:24:47.293 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-19T09:13:16.423937+0000", 2024-09-19T09:24:47.293 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-19T09:13:13.417141+0000", 2024-09-19T09:24:47.293 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-19T09:24:47.293 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-09-19T09:24:47.293 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-19T09:24:47.294 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-19T09:24:47.294 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-19T09:24:47.294 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-19T09:24:47.294 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-19T09:24:47.294 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:47.294 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-19T09:24:47.294 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.69999998807907104, 2024-09-19T09:24:47.294 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-19T09:24:47.294 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-19T09:24:47.294 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-19T09:24:47.294 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 23, 2024-09-19T09:24:47.294 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-19T09:24:47.294 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-19T09:24:47.294 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "jewel", 2024-09-19T09:24:47.295 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-19T09:24:47.295 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-19T09:24:47.295 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-19T09:24:47.295 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.295 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-19T09:24:47.295 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-19T09:24:47.295 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:13:17.564717+0000", 2024-09-19T09:24:47.295 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:24:47.295 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:24:47.295 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:24:47.295 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:24:47.295 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:24:47.295 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:24:47.296 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:24:47.296 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:24:47.296 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:24:47.296 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:24:47.296 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:24:47.296 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:24:47.296 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:24:47.296 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-19T09:24:47.296 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-19T09:24:47.296 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-19T09:24:47.296 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-19T09:24:47.296 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-19T09:24:47.296 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:24:47.296 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:24:47.297 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:24:47.297 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:24:47.297 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:24:47.297 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:24:47.297 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:24:47.297 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.297 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "111", 2024-09-19T09:24:47.297 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:24:47.297 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:24:47.297 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:24:47.297 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:24:47.297 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:24:47.297 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:24:47.297 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:24:47.298 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:24:47.298 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:24:47.298 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:24:47.298 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:24:47.298 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:24:47.298 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:24:47.298 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:24:47.298 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:24:47.298 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:24:47.298 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:24:47.298 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:24:47.298 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:24:47.299 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:24:47.299 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:24:47.299 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:24:47.299 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:24:47.299 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:24:47.299 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:24:47.299 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:24:47.299 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.299 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:24:47.299 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:24:47.299 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:24:47.299 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:24:47.299 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:24:47.299 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:24:47.300 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:24:47.300 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:24:47.300 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:24:47.300 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:24:47.300 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:24:47.300 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:24:47.300 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-19T09:24:47.300 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-19T09:24:47.300 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.300 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:24:47.300 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-19T09:24:47.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.301 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:24:47.301 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:24:47.301 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-19T09:24:47.301 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-19T09:24:47.301 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-19T09:24:47.301 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-19T09:24:47.301 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-19T09:24:47.301 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:24:47.301 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:24:47.301 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:24:47.301 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.301 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.302 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.302 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 22, 2024-09-19T09:24:47.302 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_metadata", 2024-09-19T09:24:47.302 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:24:23.190145+0000", 2024-09-19T09:24:47.302 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:24:47.302 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:24:47.302 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:24:47.302 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:24:47.302 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:24:47.302 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:24:47.302 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:24:47.302 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:24:47.302 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:24:47.303 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:24:47.303 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:24:47.303 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:24:47.303 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:24:47.303 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-19T09:24:47.303 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-19T09:24:47.303 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-19T09:24:47.303 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-19T09:24:47.303 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-19T09:24:47.303 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:24:47.303 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:24:47.303 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:24:47.303 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:24:47.304 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:24:47.304 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:24:47.304 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:24:47.304 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.304 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "181", 2024-09-19T09:24:47.304 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:24:47.304 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:24:47.304 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:24:47.304 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:24:47.304 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:24:47.304 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:24:47.304 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:24:47.304 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:24:47.305 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:24:47.305 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:24:47.305 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:24:47.305 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:24:47.305 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:24:47.305 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:24:47.305 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:24:47.305 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:24:47.305 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:24:47.305 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:24:47.305 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:24:47.305 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:24:47.305 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:24:47.305 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:24:47.305 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:24:47.306 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:24:47.306 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:24:47.306 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:24:47.306 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.306 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:24:47.306 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:24:47.306 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:24:47.306 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:24:47.306 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:24:47.306 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:24:47.306 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:24:47.306 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:24:47.306 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:24:47.306 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:24:47.307 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:24:47.307 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:24:47.307 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4, 2024-09-19T09:24:47.307 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 16, 2024-09-19T09:24:47.307 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_priority": 5 2024-09-19T09:24:47.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.307 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:24:47.307 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:24:47.307 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": "cephfs" 2024-09-19T09:24:47.307 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.307 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.307 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:24:47.307 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:24:47.307 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.5, 2024-09-19T09:24:47.308 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.5, 2024-09-19T09:24:47.308 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:24:47.308 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.5, 2024-09-19T09:24:47.308 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.5, 2024-09-19T09:24:47.308 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:24:47.308 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:24:47.308 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:24:47.308 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.308 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.308 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.308 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 23, 2024-09-19T09:24:47.308 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_data", 2024-09-19T09:24:47.308 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:24:24.517971+0000", 2024-09-19T09:24:47.309 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1027, 2024-09-19T09:24:47.309 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-19T09:24:47.309 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:24:47.309 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:24:47.309 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:24:47.309 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:24:47.309 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:24:47.309 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:24:47.309 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:24:47.309 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:24:47.309 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:24:47.309 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:24:47.309 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:24:47.309 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 64, 2024-09-19T09:24:47.309 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 64, 2024-09-19T09:24:47.310 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 64, 2024-09-19T09:24:47.310 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 64, 2024-09-19T09:24:47.310 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 64, 2024-09-19T09:24:47.310 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:24:47.310 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:24:47.310 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:24:47.310 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:24:47.310 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:24:47.310 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:24:47.310 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:24:47.310 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.310 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "184", 2024-09-19T09:24:47.310 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:24:47.311 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:24:47.311 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:24:47.311 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:24:47.311 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:24:47.311 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:24:47.311 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:24:47.311 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:24:47.311 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:24:47.311 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 33554432, 2024-09-19T09:24:47.311 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:24:47.311 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:24:47.311 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:24:47.311 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:24:47.311 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:24:47.311 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:24:47.312 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:24:47.312 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:24:47.312 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:24:47.312 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:24:47.312 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:24:47.312 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:24:47.312 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:24:47.312 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:24:47.312 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:24:47.312 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:24:47.312 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.312 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:24:47.312 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:24:47.313 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:24:47.313 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:24:47.313 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:24:47.313 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:24:47.313 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:24:47.313 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:24:47.313 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:24:47.313 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:24:47.313 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:24:47.313 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:24:47.313 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 64, 2024-09-19T09:24:47.313 INFO:teuthology.orchestra.run.smithi018.stdout: "target_size_ratio": 0.89999997615814209 2024-09-19T09:24:47.313 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.313 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:24:47.314 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:24:47.314 INFO:teuthology.orchestra.run.smithi018.stdout: "data": "cephfs" 2024-09-19T09:24:47.314 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.314 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.314 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:24:47.314 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:24:47.314 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.3799999952316284, 2024-09-19T09:24:47.314 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.3799999952316284, 2024-09-19T09:24:47.314 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:24:47.314 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-19T09:24:47.314 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-19T09:24:47.314 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:24:47.314 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:24:47.314 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:24:47.314 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.315 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.315 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:47.315 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-19T09:24:47.315 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.315 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:24:47.315 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:47.315 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:47.315 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:47.315 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:47.315 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:47.315 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:47.315 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:47.315 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:47.315 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:47.316 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:47.316 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:47.316 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:47.316 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.316 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.316 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-19T09:24:47.316 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:47.316 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.316 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.316 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.316 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-19T09:24:47.316 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:47.316 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.317 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.317 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:47.317 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.317 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.317 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-19T09:24:47.317 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:47.317 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.317 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.317 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.317 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-19T09:24:47.317 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:47.317 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.318 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.318 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:47.318 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.318 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.318 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-19T09:24:47.318 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:47.318 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.318 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.318 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.318 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-19T09:24:47.318 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:47.319 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.319 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.319 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:47.319 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.319 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.319 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-19T09:24:47.319 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:47.319 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.319 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.319 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.319 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-19T09:24:47.319 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:47.319 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.320 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.320 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/128722874", 2024-09-19T09:24:47.320 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/128722874", 2024-09-19T09:24:47.320 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/128722874", 2024-09-19T09:24:47.320 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/128722874", 2024-09-19T09:24:47.320 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:47.320 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:47.320 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:47.320 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.320 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.320 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.320 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:24:47.320 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:47.321 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:47.321 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:47.321 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:47.321 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:47.321 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:47.321 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:47.321 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:47.321 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:47.321 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:47.321 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:47.321 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:47.321 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.321 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.321 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.322 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-19T09:24:47.322 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:47.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.322 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.322 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-19T09:24:47.322 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:47.322 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.322 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.322 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.322 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:47.322 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.322 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.322 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.323 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-19T09:24:47.323 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:47.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.323 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.323 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-19T09:24:47.323 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:47.323 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.323 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.323 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.323 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:47.323 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.323 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.323 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.324 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-19T09:24:47.324 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:47.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.324 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.324 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-19T09:24:47.324 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:47.324 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.324 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.324 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.324 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:47.324 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.324 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.324 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.325 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-19T09:24:47.325 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:47.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.325 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.325 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.325 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-19T09:24:47.325 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:47.325 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.325 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.325 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.325 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/3672199638", 2024-09-19T09:24:47.325 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/3672199638", 2024-09-19T09:24:47.325 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/3672199638", 2024-09-19T09:24:47.325 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/3672199638", 2024-09-19T09:24:47.326 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:47.326 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:47.326 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:47.326 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.326 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.326 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.326 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:24:47.326 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:47.326 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:47.326 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:47.326 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:47.326 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:47.326 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:47.326 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:47.327 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:47.327 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:47.327 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:47.327 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:47.327 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:47.327 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.327 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.327 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T09:24:47.327 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:47.327 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.327 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.327 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.327 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T09:24:47.328 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:47.328 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.328 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.328 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:47.328 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.328 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.328 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-19T09:24:47.328 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:47.328 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.328 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.328 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.328 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-19T09:24:47.329 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:47.329 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.329 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.329 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:47.329 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.329 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.329 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-19T09:24:47.329 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:47.329 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.329 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.329 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.330 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-19T09:24:47.330 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:47.330 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.330 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.330 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:47.330 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.330 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.330 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-19T09:24:47.330 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:47.330 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.330 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.330 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.330 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-19T09:24:47.331 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:47.331 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.331 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.331 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3463367841", 2024-09-19T09:24:47.331 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3463367841", 2024-09-19T09:24:47.331 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3463367841", 2024-09-19T09:24:47.331 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3463367841", 2024-09-19T09:24:47.331 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:47.331 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:47.331 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:47.331 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.331 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.331 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.332 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:24:47.332 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:47.332 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:47.332 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:47.332 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:47.332 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:47.332 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:47.332 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:47.332 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:47.332 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:47.332 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:47.332 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:47.332 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:47.333 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.333 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.333 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-19T09:24:47.333 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:47.333 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.333 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.333 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.333 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-19T09:24:47.333 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:47.333 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.333 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.334 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:47.334 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.334 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.334 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-19T09:24:47.334 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:47.334 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.334 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.334 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.334 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-19T09:24:47.334 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:47.335 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.335 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.335 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:47.335 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.335 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.335 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-19T09:24:47.335 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:47.335 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.335 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.335 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.335 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-19T09:24:47.335 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:47.336 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.336 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.336 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:47.336 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.336 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.336 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-19T09:24:47.336 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:47.336 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.336 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.336 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.336 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-19T09:24:47.337 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:47.337 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.337 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.337 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.337 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/4163178582", 2024-09-19T09:24:47.337 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/4163178582", 2024-09-19T09:24:47.337 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/4163178582", 2024-09-19T09:24:47.337 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/4163178582", 2024-09-19T09:24:47.337 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:47.337 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:47.337 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:47.338 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.338 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.338 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.338 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:24:47.338 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:47.338 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:47.338 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:47.338 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:47.338 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:47.338 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:47.338 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:47.338 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:47.338 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:47.338 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:47.339 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:47.339 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:47.339 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.339 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.339 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6822", 2024-09-19T09:24:47.339 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:47.339 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.339 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.339 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.339 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6824", 2024-09-19T09:24:47.339 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:47.339 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.340 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.340 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:47.340 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.340 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.340 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6826", 2024-09-19T09:24:47.340 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:47.340 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.340 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.340 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.340 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6827", 2024-09-19T09:24:47.340 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:47.341 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.341 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.341 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:47.341 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.341 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.341 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6830", 2024-09-19T09:24:47.341 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:47.341 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.341 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.341 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.341 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6831", 2024-09-19T09:24:47.341 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:47.342 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.342 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.342 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:47.342 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.342 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.342 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6828", 2024-09-19T09:24:47.342 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:47.342 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.342 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.342 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.342 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6829", 2024-09-19T09:24:47.342 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:47.343 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.343 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.343 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6824/3538482215", 2024-09-19T09:24:47.343 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6827/3538482215", 2024-09-19T09:24:47.343 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6831/3538482215", 2024-09-19T09:24:47.343 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6829/3538482215", 2024-09-19T09:24:47.343 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:47.343 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:47.343 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:47.343 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.343 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.343 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.343 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:24:47.344 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:47.344 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:47.344 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:47.344 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:47.344 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:47.344 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:47.344 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:47.344 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:47.344 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:47.344 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:47.344 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:47.344 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:47.344 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.345 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.345 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6800", 2024-09-19T09:24:47.345 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:47.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.345 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.345 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.345 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6801", 2024-09-19T09:24:47.345 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:47.345 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.345 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.345 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.345 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:47.345 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.346 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.346 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6802", 2024-09-19T09:24:47.346 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:47.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.346 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.346 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.346 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6803", 2024-09-19T09:24:47.346 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:47.346 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.346 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.346 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.346 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:47.347 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.347 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.347 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6806", 2024-09-19T09:24:47.347 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:47.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.347 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.347 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.347 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6807", 2024-09-19T09:24:47.347 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:47.347 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.347 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.347 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.348 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:47.348 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.348 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.348 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6804", 2024-09-19T09:24:47.348 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:47.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.348 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.348 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.348 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6805", 2024-09-19T09:24:47.348 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:47.348 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.348 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.348 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.348 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6801/2408698413", 2024-09-19T09:24:47.349 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6803/2408698413", 2024-09-19T09:24:47.349 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6807/2408698413", 2024-09-19T09:24:47.349 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6805/2408698413", 2024-09-19T09:24:47.349 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:47.349 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:47.349 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:47.349 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.349 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.349 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.349 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:24:47.349 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:47.349 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:47.349 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:47.349 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:47.350 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:47.350 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:47.350 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:47.350 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:47.350 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:47.350 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:47.350 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:47.350 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:47.350 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.350 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.350 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.350 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6808", 2024-09-19T09:24:47.350 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:47.350 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.351 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.351 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6809", 2024-09-19T09:24:47.351 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:47.351 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.351 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.351 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:47.351 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.351 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.351 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6810", 2024-09-19T09:24:47.351 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:47.351 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.351 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.352 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.352 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6811", 2024-09-19T09:24:47.352 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:47.352 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.352 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.352 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:47.352 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.352 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.352 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6814", 2024-09-19T09:24:47.352 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:47.352 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.352 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.353 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.353 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6815", 2024-09-19T09:24:47.353 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:47.353 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.353 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.353 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:47.353 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.353 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.353 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6812", 2024-09-19T09:24:47.353 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:47.353 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.353 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.354 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.354 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6813", 2024-09-19T09:24:47.354 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:47.354 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.354 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.354 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6809/2596207948", 2024-09-19T09:24:47.354 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6811/2596207948", 2024-09-19T09:24:47.354 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6815/2596207948", 2024-09-19T09:24:47.354 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6813/2596207948", 2024-09-19T09:24:47.354 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:47.354 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:47.354 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:47.354 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.354 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.355 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.355 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:24:47.355 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:47.355 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:47.355 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:47.355 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:47.355 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:47.355 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:47.355 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:47.355 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:47.355 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:47.355 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:47.355 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:47.355 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:47.356 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.356 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.356 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6816", 2024-09-19T09:24:47.356 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:47.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.356 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.356 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.356 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6817", 2024-09-19T09:24:47.356 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:47.356 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.356 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.356 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.356 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:47.357 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.357 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.357 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6818", 2024-09-19T09:24:47.357 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:47.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.357 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.357 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.357 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6819", 2024-09-19T09:24:47.357 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:47.357 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.357 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.357 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.357 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:47.358 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.358 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.358 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6823", 2024-09-19T09:24:47.358 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:47.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.358 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.358 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.358 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6825", 2024-09-19T09:24:47.358 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:47.358 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.358 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.358 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.358 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:47.359 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:47.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.359 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:47.359 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6820", 2024-09-19T09:24:47.359 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:47.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.359 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.359 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:47.359 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6821", 2024-09-19T09:24:47.359 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:47.359 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.359 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.359 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.359 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6817/1334618296", 2024-09-19T09:24:47.360 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6819/1334618296", 2024-09-19T09:24:47.360 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6825/1334618296", 2024-09-19T09:24:47.360 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6821/1334618296", 2024-09-19T09:24:47.360 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:47.360 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:47.360 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:47.360 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:47.360 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.360 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:47.360 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-19T09:24:47.360 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.360 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:24:47.360 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:47.360 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:47.361 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:47.361 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:47.361 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:47.361 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.580838+0000", 2024-09-19T09:24:47.361 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:47.361 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.361 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.361 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:24:47.361 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:47.361 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:47.361 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:47.361 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:47.361 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:47.361 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.599990+0000", 2024-09-19T09:24:47.362 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:47.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.362 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:24:47.362 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:47.362 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:47.362 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:47.362 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:47.362 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:47.362 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.503722+0000", 2024-09-19T09:24:47.362 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:47.362 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.362 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.362 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:24:47.363 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:47.363 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:47.363 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:47.363 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:47.363 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:47.363 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.607846+0000", 2024-09-19T09:24:47.363 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:47.363 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.363 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.363 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:24:47.363 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:47.363 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:47.363 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:47.363 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:47.364 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:47.364 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.616858+0000", 2024-09-19T09:24:47.364 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:47.364 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.364 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.364 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:24:47.364 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:47.364 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:47.364 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:47.364 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:47.364 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:47.364 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.542726+0000", 2024-09-19T09:24:47.364 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:47.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.365 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:24:47.365 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:47.365 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:47.365 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:47.365 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:47.365 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:47.365 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.534178+0000", 2024-09-19T09:24:47.365 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:47.365 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.365 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:47.365 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:24:47.365 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:47.365 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:47.366 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:47.366 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:47.366 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:47.366 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.612105+0000", 2024-09-19T09:24:47.366 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:47.366 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.366 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:47.366 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-19T09:24:47.366 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-19T09:24:47.366 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-19T09:24:47.366 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-19T09:24:47.366 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-19T09:24:47.366 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-19T09:24:47.366 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-19T09:24:47.367 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-19T09:24:47.367 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-19T09:24:47.367 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-19T09:24:47.367 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-19T09:24:47.367 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-19T09:24:47.367 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-19T09:24:47.367 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-19T09:24:47.367 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.367 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:47.367 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-19T09:24:47.367 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-19T09:24:47.367 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-19T09:24:47.367 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-19T09:24:47.367 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-19T09:24:47.368 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-19T09:24:47.368 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-19T09:24:47.368 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-19T09:24:47.368 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-19T09:24:47.368 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-19T09:24:47.368 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-19T09:24:47.368 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:47.368 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:24:47.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.293+0000 7f51673b7640 1 -- 172.21.15.18:0/1443089120 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f514406c2b0 msgr2=0x7f514406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:47.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.293+0000 7f51673b7640 1 --2- 172.21.15.18:0/1443089120 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f514406c2b0 0x7f514406e770 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f516013dac0 tx=0x7f5150009040 comp rx=0 tx=0).stop 2024-09-19T09:24:47.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.293+0000 7f51673b7640 1 -- 172.21.15.18:0/1443089120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5160072f40 msgr2=0x7f51600c8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:47.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.293+0000 7f51673b7640 1 --2- 172.21.15.18:0/1443089120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5160072f40 0x7f51600c8500 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f515c00c500 tx=0x7f515c00c9c0 comp rx=0 tx=0).stop 2024-09-19T09:24:47.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.294+0000 7f51673b7640 1 -- 172.21.15.18:0/1443089120 shutdown_connections 2024-09-19T09:24:47.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.294+0000 7f51673b7640 1 --2- 172.21.15.18:0/1443089120 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f514406c2b0 0x7f514406e770 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:47.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.294+0000 7f51673b7640 1 --2- 172.21.15.18:0/1443089120 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f5160145290 0x7f51601ed940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:47.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.294+0000 7f51673b7640 1 --2- 172.21.15.18:0/1443089120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f51600ce780 0x7f51601ed400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:47.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.294+0000 7f51673b7640 1 --2- 172.21.15.18:0/1443089120 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f5160072f40 0x7f51600c8500 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:47.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.294+0000 7f51673b7640 1 -- 172.21.15.18:0/1443089120 >> 172.21.15.18:0/1443089120 conn(0x7f516006bc10 msgr2=0x7f5160072830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:47.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.294+0000 7f51673b7640 1 -- 172.21.15.18:0/1443089120 shutdown_connections 2024-09-19T09:24:47.370 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:47.294+0000 7f51673b7640 1 -- 172.21.15.18:0/1443089120 wait complete. 2024-09-19T09:24:47.371 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-19T09:24:52.372 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-19T09:24:52.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.486+0000 7fce020a6640 1 Processor -- start 2024-09-19T09:24:52.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.486+0000 7fce020a6640 1 -- start start 2024-09-19T09:24:52.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.487+0000 7fce020a6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcdfc13fae0 0x7fcdfc06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:52.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.487+0000 7fce020a6640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcdfc142150 0x7fcdfc160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:52.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.487+0000 7fce020a6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdfc142650 con 0x7fcdfc160a80 2024-09-19T09:24:52.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.487+0000 7fce020a6640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fcdfc0ce780 con 0x7fcdfc13fae0 2024-09-19T09:24:52.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.487+0000 7fce020a6640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fcdfc142930 con 0x7fcdfc142150 2024-09-19T09:24:52.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.487+0000 7fcdfb7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcdfc13fae0 0x7fcdfc06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:52.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.487+0000 7fcdfb7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fcdfc13fae0 0x7fcdfc06f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48418/0 (socket says 172.21.15.18:48418) 2024-09-19T09:24:52.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.487+0000 7fcdfb7fe640 1 -- 172.21.15.18:0/3700741046 learned_addr learned my addr 172.21.15.18:0/3700741046 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:52.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.487+0000 7fcdfaffd640 1 --2- 172.21.15.18:0/3700741046 >> v2:172.21.15.162:3300/0 conn(0x7fcdfc142150 0x7fcdfc160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:52.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.487+0000 7fcdfb7fe640 1 -- 172.21.15.18:0/3700741046 >> v2:172.21.15.162:3300/0 conn(0x7fcdfc142150 msgr2=0x7fcdfc160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:52.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.487+0000 7fcdfb7fe640 1 --2- 172.21.15.18:0/3700741046 >> v2:172.21.15.162:3300/0 conn(0x7fcdfc142150 0x7fcdfc160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:52.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.487+0000 7fcdfb7fe640 1 -- 172.21.15.18:0/3700741046 >> v1:172.21.15.162:6789/0 conn(0x7fcdfc160a80 legacy=0x7fcdfc15cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:52.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.487+0000 7fcdfb7fe640 1 -- 172.21.15.18:0/3700741046 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdfc142c10 con 0x7fcdfc13fae0 2024-09-19T09:24:52.489 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.487+0000 7fcdfaffd640 1 --2- 172.21.15.18:0/3700741046 >> v2:172.21.15.162:3300/0 conn(0x7fcdfc142150 0x7fcdfc160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:52.490 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.488+0000 7fcdfb7fe640 1 --2- 172.21.15.18:0/3700741046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc13fae0 0x7fcdfc06f1b0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc075560 tx=0x7fcdec02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f069ddb52b117e0f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:52.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.488+0000 7fcdfa7fc640 1 -- 172.21.15.18:0/3700741046 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdec037070 con 0x7fcdfc13fae0 2024-09-19T09:24:52.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.488+0000 7fcdfa7fc640 1 -- 172.21.15.18:0/3700741046 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdec032440 con 0x7fcdfc13fae0 2024-09-19T09:24:52.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.488+0000 7fcdfa7fc640 1 -- 172.21.15.18:0/3700741046 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdec032810 con 0x7fcdfc13fae0 2024-09-19T09:24:52.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.489+0000 7fce020a6640 1 -- 172.21.15.18:0/3700741046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc13fae0 msgr2=0x7fcdfc06f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:52.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.489+0000 7fce020a6640 1 --2- 172.21.15.18:0/3700741046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc13fae0 0x7fcdfc06f1b0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc075560 tx=0x7fcdec02a1a0 comp rx=0 tx=0).stop 2024-09-19T09:24:52.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.489+0000 7fce020a6640 1 -- 172.21.15.18:0/3700741046 shutdown_connections 2024-09-19T09:24:52.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.489+0000 7fce020a6640 1 --2- 172.21.15.18:0/3700741046 >> v2:172.21.15.162:3300/0 conn(0x7fcdfc142150 0x7fcdfc160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:52.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.489+0000 7fce020a6640 1 --2- 172.21.15.18:0/3700741046 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc13fae0 0x7fcdfc06f1b0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:52.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.489+0000 7fce020a6640 1 -- 172.21.15.18:0/3700741046 >> 172.21.15.18:0/3700741046 conn(0x7fcdfc06bc10 msgr2=0x7fcdfc06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:52.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.489+0000 7fce020a6640 1 -- 172.21.15.18:0/3700741046 shutdown_connections 2024-09-19T09:24:52.491 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.489+0000 7fce020a6640 1 -- 172.21.15.18:0/3700741046 wait complete. 2024-09-19T09:24:52.493 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.490+0000 7fce020a6640 1 Processor -- start 2024-09-19T09:24:52.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.490+0000 7fce020a6640 1 -- start start 2024-09-19T09:24:52.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.491+0000 7fce020a6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc13fae0 0x7fcdfc13ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:52.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.491+0000 7fce020a6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdfc142150 0x7fcdfc13e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:52.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.491+0000 7fce020a6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdfc160a80 0x7fcdfc072b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:52.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.491+0000 7fce020a6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcdfc06f870 con 0x7fcdfc13fae0 2024-09-19T09:24:52.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.491+0000 7fce020a6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcdfc06f6f0 con 0x7fcdfc142150 2024-09-19T09:24:52.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.491+0000 7fce020a6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcdfc0cfc20 con 0x7fcdfc160a80 2024-09-19T09:24:52.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.491+0000 7fcdfb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc13fae0 0x7fcdfc13ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:52.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.491+0000 7fcdfb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc13fae0 0x7fcdfc13ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:48434/0 (socket says 172.21.15.18:48434) 2024-09-19T09:24:52.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.491+0000 7fcdfb7fe640 1 -- 172.21.15.18:0/4146717184 learned_addr learned my addr 172.21.15.18:0/4146717184 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:52.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.491+0000 7fcdfaffd640 1 --2- 172.21.15.18:0/4146717184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdfc142150 0x7fcdfc13e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:52.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.492+0000 7fcdfbfff640 1 --2- 172.21.15.18:0/4146717184 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdfc160a80 0x7fcdfc072b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:52.494 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.492+0000 7fcdfb7fe640 1 -- 172.21.15.18:0/4146717184 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdfc160a80 msgr2=0x7fcdfc072b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:52.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.492+0000 7fcdfb7fe640 1 --2- 172.21.15.18:0/4146717184 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdfc160a80 0x7fcdfc072b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:52.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.492+0000 7fcdfb7fe640 1 -- 172.21.15.18:0/4146717184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdfc142150 msgr2=0x7fcdfc13e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:52.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.492+0000 7fcdfb7fe640 1 --2- 172.21.15.18:0/4146717184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdfc142150 0x7fcdfc13e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:52.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.492+0000 7fcdfb7fe640 1 -- 172.21.15.18:0/4146717184 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdfc13e8a0 con 0x7fcdfc13fae0 2024-09-19T09:24:52.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.492+0000 7fcdfaffd640 1 --2- 172.21.15.18:0/4146717184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdfc142150 0x7fcdfc13e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:52.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.492+0000 7fcdfb7fe640 1 --2- 172.21.15.18:0/4146717184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc13fae0 0x7fcdfc13ef80 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fcdec02a1e0 tx=0x7fcdec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:52.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.492+0000 7fcde3fff640 1 -- 172.21.15.18:0/4146717184 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdec037040 con 0x7fcdfc13fae0 2024-09-19T09:24:52.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.492+0000 7fcde3fff640 1 -- 172.21.15.18:0/4146717184 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdec042070 con 0x7fcdfc13fae0 2024-09-19T09:24:52.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.492+0000 7fce020a6640 1 -- 172.21.15.18:0/4146717184 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdfc143d90 con 0x7fcdfc13fae0 2024-09-19T09:24:52.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.492+0000 7fcde3fff640 1 -- 172.21.15.18:0/4146717184 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdec030bb0 con 0x7fcdfc13fae0 2024-09-19T09:24:52.495 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.492+0000 7fce020a6640 1 -- 172.21.15.18:0/4146717184 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdfc144350 con 0x7fcdfc13fae0 2024-09-19T09:24:52.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.493+0000 7fce020a6640 1 -- 172.21.15.18:0/4146717184 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdfc06f1b0 con 0x7fcdfc13fae0 2024-09-19T09:24:52.496 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.494+0000 7fcde3fff640 1 -- 172.21.15.18:0/4146717184 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcdec047460 con 0x7fcdfc13fae0 2024-09-19T09:24:52.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.494+0000 7fcde3fff640 1 --2- 172.21.15.18:0/4146717184 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcde806c2b0 0x7fcde806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:52.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.494+0000 7fcde3fff640 1 -- 172.21.15.18:0/4146717184 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(184..184 src has 1..184) ==== 5709+0+0 (secure 0 0 0) 0x7fcdec0ac0e0 con 0x7fcdfc13fae0 2024-09-19T09:24:52.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.494+0000 7fcde3fff640 1 -- 172.21.15.18:0/4146717184 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=185}) -- 0x7fcde8073de0 con 0x7fcdfc13fae0 2024-09-19T09:24:52.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.494+0000 7fcdfaffd640 1 --2- 172.21.15.18:0/4146717184 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcde806c2b0 0x7fcde806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:52.497 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.495+0000 7fcdfaffd640 1 --2- 172.21.15.18:0/4146717184 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcde806c2b0 0x7fcde806e770 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fcdf000aa30 tx=0x7fcdf0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:52.499 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.499+0000 7fcde3fff640 1 -- 172.21.15.18:0/4146717184 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fcdec045360 con 0x7fcdfc13fae0 2024-09-19T09:24:52.678 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.678+0000 7fce020a6640 1 -- 172.21.15.18:0/4146717184 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fcdfc143ad0 con 0x7fcdfc13fae0 2024-09-19T09:24:52.680 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.679+0000 7fcde3fff640 1 -- 172.21.15.18:0/4146717184 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v184) ==== 81+0+34309 (secure 0 0 0) 0x7fcdec07a850 con 0x7fcdfc13fae0 2024-09-19T09:24:52.680 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:24:52.680 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:24:52.680 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 184, 2024-09-19T09:24:52.681 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:24:52.681 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-19T09:13:11.348786+0000", 2024-09-19T09:24:52.681 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-19T09:24:41.275573+0000", 2024-09-19T09:24:52.681 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-19T09:13:16.423937+0000", 2024-09-19T09:24:52.681 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-19T09:13:13.417141+0000", 2024-09-19T09:24:52.681 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-19T09:24:52.681 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-09-19T09:24:52.681 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-19T09:24:52.681 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-19T09:24:52.681 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-19T09:24:52.681 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-19T09:24:52.681 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-19T09:24:52.681 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:52.682 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-19T09:24:52.682 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.69999998807907104, 2024-09-19T09:24:52.682 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-19T09:24:52.682 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-19T09:24:52.682 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-19T09:24:52.682 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 23, 2024-09-19T09:24:52.682 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-19T09:24:52.682 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-19T09:24:52.682 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "jewel", 2024-09-19T09:24:52.682 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-19T09:24:52.682 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-19T09:24:52.682 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-19T09:24:52.682 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.682 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-19T09:24:52.683 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-19T09:24:52.683 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:13:17.564717+0000", 2024-09-19T09:24:52.683 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:24:52.683 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:24:52.683 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:24:52.683 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:24:52.683 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:24:52.683 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:24:52.683 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:24:52.683 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:24:52.683 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:24:52.683 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:24:52.683 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:24:52.683 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:24:52.684 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:24:52.684 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-19T09:24:52.684 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-19T09:24:52.684 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-19T09:24:52.684 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-19T09:24:52.684 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-19T09:24:52.684 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:24:52.684 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:24:52.684 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:24:52.684 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:24:52.684 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:24:52.684 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:24:52.684 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:24:52.685 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.685 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "111", 2024-09-19T09:24:52.685 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:24:52.685 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:24:52.685 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:24:52.685 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:24:52.685 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:24:52.685 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:24:52.685 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:24:52.685 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:24:52.685 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:24:52.685 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:24:52.685 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:24:52.685 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:24:52.686 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:24:52.686 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:24:52.686 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:24:52.686 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:24:52.686 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:24:52.686 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:24:52.686 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:24:52.686 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:24:52.686 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:24:52.686 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:24:52.686 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:24:52.686 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:24:52.686 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:24:52.686 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:24:52.687 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.687 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:24:52.687 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:24:52.687 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:24:52.687 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:24:52.687 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:24:52.687 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:24:52.687 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:24:52.687 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:24:52.687 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:24:52.687 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:24:52.688 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:24:52.688 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:24:52.688 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-19T09:24:52.688 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-19T09:24:52.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.688 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:24:52.688 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-19T09:24:52.688 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.688 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:24:52.688 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:24:52.688 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-19T09:24:52.688 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-19T09:24:52.688 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-19T09:24:52.688 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-19T09:24:52.689 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-19T09:24:52.689 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:24:52.689 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:24:52.689 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:24:52.689 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.689 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.689 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.689 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 22, 2024-09-19T09:24:52.689 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_metadata", 2024-09-19T09:24:52.689 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:24:23.190145+0000", 2024-09-19T09:24:52.689 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:24:52.689 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:24:52.689 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:24:52.689 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:24:52.690 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:24:52.690 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:24:52.690 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:24:52.690 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:24:52.690 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:24:52.690 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:24:52.690 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:24:52.690 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:24:52.690 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:24:52.690 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-19T09:24:52.690 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-19T09:24:52.690 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-19T09:24:52.690 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-19T09:24:52.690 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-19T09:24:52.691 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:24:52.691 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:24:52.691 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:24:52.691 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:24:52.691 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:24:52.691 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:24:52.691 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:24:52.691 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.691 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "181", 2024-09-19T09:24:52.691 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:24:52.691 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:24:52.691 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:24:52.691 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:24:52.691 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:24:52.692 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:24:52.692 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:24:52.692 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:24:52.692 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:24:52.692 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:24:52.692 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:24:52.692 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:24:52.692 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:24:52.692 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:24:52.692 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:24:52.692 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:24:52.692 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:24:52.692 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:24:52.692 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:24:52.693 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:24:52.693 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:24:52.693 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:24:52.693 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:24:52.693 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:24:52.693 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:24:52.693 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:24:52.693 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.693 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:24:52.693 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:24:52.693 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:24:52.693 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:24:52.693 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:24:52.693 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:24:52.694 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:24:52.694 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:24:52.694 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:24:52.694 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:24:52.694 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:24:52.694 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:24:52.694 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4, 2024-09-19T09:24:52.694 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 16, 2024-09-19T09:24:52.694 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_priority": 5 2024-09-19T09:24:52.694 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.694 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:24:52.694 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:24:52.694 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": "cephfs" 2024-09-19T09:24:52.694 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.695 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:24:52.695 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:24:52.695 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.5, 2024-09-19T09:24:52.695 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.5, 2024-09-19T09:24:52.695 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:24:52.695 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.5, 2024-09-19T09:24:52.695 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.5, 2024-09-19T09:24:52.695 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:24:52.695 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:24:52.695 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:24:52.695 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.695 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.695 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.696 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 23, 2024-09-19T09:24:52.696 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_data", 2024-09-19T09:24:52.696 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:24:24.517971+0000", 2024-09-19T09:24:52.696 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1027, 2024-09-19T09:24:52.696 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-19T09:24:52.696 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:24:52.696 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:24:52.696 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:24:52.696 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:24:52.696 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:24:52.696 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:24:52.696 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:24:52.696 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:24:52.696 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:24:52.697 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:24:52.697 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:24:52.697 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 64, 2024-09-19T09:24:52.697 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 64, 2024-09-19T09:24:52.697 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 64, 2024-09-19T09:24:52.697 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 64, 2024-09-19T09:24:52.697 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 64, 2024-09-19T09:24:52.697 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:24:52.697 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:24:52.697 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:24:52.697 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:24:52.697 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:24:52.697 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:24:52.698 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:24:52.698 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.698 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "184", 2024-09-19T09:24:52.698 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:24:52.698 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:24:52.698 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:24:52.698 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:24:52.698 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:24:52.698 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:24:52.698 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:24:52.698 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:24:52.698 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:24:52.698 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 33554432, 2024-09-19T09:24:52.698 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:24:52.699 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:24:52.699 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:24:52.699 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:24:52.699 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:24:52.699 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:24:52.699 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:24:52.699 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:24:52.699 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:24:52.700 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:24:52.700 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:24:52.700 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:24:52.700 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:24:52.700 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:24:52.700 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:24:52.700 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:24:52.700 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.700 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:24:52.700 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:24:52.700 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:24:52.700 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:24:52.700 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:24:52.701 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:24:52.701 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:24:52.701 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:24:52.701 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:24:52.701 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:24:52.701 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:24:52.701 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:24:52.701 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 64, 2024-09-19T09:24:52.701 INFO:teuthology.orchestra.run.smithi018.stdout: "target_size_ratio": 0.89999997615814209 2024-09-19T09:24:52.701 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.701 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:24:52.701 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:24:52.701 INFO:teuthology.orchestra.run.smithi018.stdout: "data": "cephfs" 2024-09-19T09:24:52.701 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.702 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.702 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:24:52.702 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:24:52.702 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.3799999952316284, 2024-09-19T09:24:52.702 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.3799999952316284, 2024-09-19T09:24:52.702 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:24:52.702 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-19T09:24:52.702 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-19T09:24:52.702 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:24:52.702 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:24:52.702 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:24:52.702 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.702 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.702 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:52.703 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-19T09:24:52.703 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.703 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:24:52.703 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:52.703 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:52.703 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:52.703 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:52.703 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:52.703 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:52.703 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:52.703 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:52.703 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:52.703 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:52.703 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:52.704 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:52.704 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.704 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.704 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-19T09:24:52.704 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:52.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.704 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.704 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.704 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-19T09:24:52.704 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:52.704 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.704 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.704 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.705 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:52.705 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.705 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.705 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-19T09:24:52.705 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:52.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.705 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.705 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.705 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-19T09:24:52.705 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:52.705 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.705 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.705 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.706 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:52.706 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.706 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.706 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-19T09:24:52.706 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:52.706 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.706 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.706 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.706 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-19T09:24:52.706 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:52.706 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.707 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.707 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:52.707 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.707 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.707 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-19T09:24:52.707 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:52.707 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.707 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.707 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.707 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-19T09:24:52.707 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:52.707 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.708 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.708 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/128722874", 2024-09-19T09:24:52.708 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/128722874", 2024-09-19T09:24:52.708 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/128722874", 2024-09-19T09:24:52.708 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/128722874", 2024-09-19T09:24:52.708 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:52.708 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:52.708 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:52.708 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.708 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.708 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.708 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:24:52.709 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:52.709 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:52.709 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:52.709 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:52.709 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:52.709 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:52.709 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:52.709 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:52.709 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:52.709 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:52.709 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:52.709 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:52.709 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.709 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.709 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.710 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-19T09:24:52.710 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:52.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.710 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.710 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.710 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-19T09:24:52.710 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:52.710 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.710 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.710 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.710 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:52.710 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.710 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.710 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.711 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-19T09:24:52.711 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:52.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.711 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.711 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-19T09:24:52.711 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:52.711 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.711 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.711 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.711 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:52.711 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.711 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.711 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.712 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-19T09:24:52.712 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:52.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.712 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.712 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-19T09:24:52.712 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:52.712 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.712 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.712 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.712 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:52.712 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.712 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.713 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.713 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-19T09:24:52.713 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:52.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.713 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.713 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.713 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-19T09:24:52.713 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:52.713 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.713 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.713 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.713 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/3672199638", 2024-09-19T09:24:52.713 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/3672199638", 2024-09-19T09:24:52.713 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/3672199638", 2024-09-19T09:24:52.714 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/3672199638", 2024-09-19T09:24:52.714 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:52.714 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:52.714 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:52.714 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.714 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.714 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.714 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:24:52.714 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:52.714 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:52.714 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:52.714 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:52.714 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:52.714 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:52.715 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:52.715 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:52.715 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:52.715 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:52.715 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:52.715 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:52.715 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.715 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.715 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.715 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T09:24:52.715 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:52.715 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.715 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.715 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.716 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T09:24:52.716 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:52.716 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.716 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.716 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:52.716 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.716 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.716 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.716 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-19T09:24:52.716 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:52.716 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.716 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.717 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.717 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-19T09:24:52.717 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:52.717 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.717 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.717 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:52.717 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.717 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.717 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.717 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-19T09:24:52.717 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:52.717 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.718 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.718 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-19T09:24:52.718 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:52.718 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.718 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.718 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:52.718 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.718 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.718 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.718 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-19T09:24:52.718 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:52.718 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.719 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.719 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.719 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-19T09:24:52.719 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:52.719 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.719 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.719 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.719 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3463367841", 2024-09-19T09:24:52.719 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3463367841", 2024-09-19T09:24:52.719 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3463367841", 2024-09-19T09:24:52.719 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3463367841", 2024-09-19T09:24:52.719 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:52.719 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:52.720 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:52.720 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.720 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.720 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.720 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:24:52.720 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:52.720 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:52.720 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:52.720 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:52.720 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:52.720 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:52.720 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:52.720 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:52.720 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:52.721 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:52.721 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:52.721 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:52.721 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.721 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.721 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-19T09:24:52.721 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:52.721 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.721 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.721 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.721 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-19T09:24:52.721 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:52.721 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.722 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.722 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:52.722 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.722 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.722 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-19T09:24:52.722 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:52.722 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.722 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.722 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.722 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-19T09:24:52.722 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:52.722 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.723 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.723 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:52.723 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.723 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.723 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-19T09:24:52.723 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:52.723 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.723 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.723 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.723 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-19T09:24:52.723 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:52.723 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.723 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.724 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:52.724 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.724 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.724 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-19T09:24:52.724 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:52.724 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.724 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.725 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.725 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-19T09:24:52.725 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:52.725 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.725 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.725 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.725 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/4163178582", 2024-09-19T09:24:52.725 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/4163178582", 2024-09-19T09:24:52.725 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/4163178582", 2024-09-19T09:24:52.725 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/4163178582", 2024-09-19T09:24:52.725 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:52.725 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:52.725 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:52.726 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.726 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.726 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.726 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:24:52.726 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:52.726 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:52.726 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:52.726 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:52.726 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:52.726 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:52.726 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:52.727 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:52.727 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:52.727 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:52.727 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:52.727 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:52.727 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.727 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.727 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.727 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6822", 2024-09-19T09:24:52.727 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:52.727 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.727 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.727 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.727 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6824", 2024-09-19T09:24:52.728 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:52.728 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.728 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.728 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:52.728 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.728 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.728 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.728 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6826", 2024-09-19T09:24:52.728 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:52.728 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.728 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.729 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.729 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6827", 2024-09-19T09:24:52.729 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:52.729 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.729 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.729 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:52.729 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.729 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.729 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.729 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6830", 2024-09-19T09:24:52.729 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:52.729 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.729 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.730 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.730 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6831", 2024-09-19T09:24:52.730 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:52.730 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.730 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.730 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:52.730 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.730 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.730 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.730 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6828", 2024-09-19T09:24:52.730 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:52.730 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.730 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.731 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.731 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6829", 2024-09-19T09:24:52.731 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:52.731 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.731 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.731 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.731 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6824/3538482215", 2024-09-19T09:24:52.731 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6827/3538482215", 2024-09-19T09:24:52.731 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6831/3538482215", 2024-09-19T09:24:52.731 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6829/3538482215", 2024-09-19T09:24:52.731 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:52.731 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:52.731 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:52.731 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.732 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.732 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.732 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:24:52.732 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:52.732 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:52.732 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:52.732 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:52.732 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:52.732 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:52.732 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:52.732 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:52.732 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:52.732 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:52.732 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:52.733 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:52.733 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.733 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.733 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6800", 2024-09-19T09:24:52.733 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:52.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.733 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.733 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.733 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6801", 2024-09-19T09:24:52.733 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:52.733 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.733 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.733 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.734 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:52.734 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.734 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.734 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6802", 2024-09-19T09:24:52.734 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:52.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.734 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.734 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.734 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6803", 2024-09-19T09:24:52.734 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:52.734 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.734 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.734 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.735 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:52.735 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.735 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.735 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.735 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6806", 2024-09-19T09:24:52.735 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:52.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.735 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.735 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.735 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6807", 2024-09-19T09:24:52.735 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:52.735 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.735 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.735 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.736 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:52.736 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.736 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.736 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.736 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6804", 2024-09-19T09:24:52.736 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:52.736 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.736 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.736 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.736 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6805", 2024-09-19T09:24:52.736 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:52.736 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.736 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.737 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.737 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6801/2408698413", 2024-09-19T09:24:52.737 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6803/2408698413", 2024-09-19T09:24:52.737 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6807/2408698413", 2024-09-19T09:24:52.737 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6805/2408698413", 2024-09-19T09:24:52.737 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:52.737 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:52.737 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:52.737 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.737 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.737 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.737 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:24:52.737 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:52.737 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:52.738 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:52.738 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:52.738 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:52.738 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:52.738 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:52.738 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:52.738 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:52.738 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:52.738 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:52.738 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:52.738 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.738 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.738 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.738 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6808", 2024-09-19T09:24:52.739 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:52.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.739 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.739 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.739 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6809", 2024-09-19T09:24:52.739 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:52.739 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.739 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.739 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.739 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:52.739 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.739 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.739 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.739 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6810", 2024-09-19T09:24:52.739 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:52.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.740 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.740 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.740 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6811", 2024-09-19T09:24:52.740 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:52.740 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.740 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.740 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:52.740 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.740 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.740 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.740 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6814", 2024-09-19T09:24:52.740 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:52.740 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.741 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.741 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.741 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6815", 2024-09-19T09:24:52.741 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:52.741 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.741 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.741 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.741 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:52.741 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.741 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.741 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.741 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6812", 2024-09-19T09:24:52.741 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:52.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.742 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.742 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.742 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6813", 2024-09-19T09:24:52.742 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:52.742 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.742 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.742 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.742 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6809/2596207948", 2024-09-19T09:24:52.742 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6811/2596207948", 2024-09-19T09:24:52.742 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6815/2596207948", 2024-09-19T09:24:52.742 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6813/2596207948", 2024-09-19T09:24:52.742 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:52.742 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:52.742 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:52.743 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.743 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.743 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.743 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:24:52.743 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:52.743 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:52.743 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:52.743 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:52.743 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:52.743 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:52.743 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:52.743 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:52.743 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:52.743 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:52.743 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:52.744 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:52.744 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.744 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.744 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.744 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6816", 2024-09-19T09:24:52.744 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:52.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.744 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.744 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.744 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6817", 2024-09-19T09:24:52.744 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:52.744 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.744 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.744 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.745 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:52.745 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.745 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.745 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.745 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6818", 2024-09-19T09:24:52.745 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:52.745 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.745 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.745 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.745 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6819", 2024-09-19T09:24:52.745 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:52.745 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.745 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.746 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:52.746 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.746 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.746 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.746 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6823", 2024-09-19T09:24:52.746 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:52.746 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.746 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.746 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.746 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6825", 2024-09-19T09:24:52.746 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:52.746 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.746 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.747 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:52.747 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:52.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.747 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:52.747 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6820", 2024-09-19T09:24:52.747 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:52.747 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.747 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.747 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:52.747 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6821", 2024-09-19T09:24:52.747 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:52.747 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.747 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.748 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.748 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6817/1334618296", 2024-09-19T09:24:52.748 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6819/1334618296", 2024-09-19T09:24:52.748 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6825/1334618296", 2024-09-19T09:24:52.748 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6821/1334618296", 2024-09-19T09:24:52.748 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:52.748 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:52.748 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:52.748 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:52.748 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.748 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:52.748 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-19T09:24:52.748 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.749 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:24:52.749 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:52.749 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:52.749 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:52.749 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:52.749 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:52.749 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.580838+0000", 2024-09-19T09:24:52.749 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:52.749 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.749 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.749 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:24:52.749 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:52.749 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:52.749 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:52.750 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:52.750 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:52.750 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.599990+0000", 2024-09-19T09:24:52.750 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:52.750 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.750 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.750 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:24:52.750 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:52.750 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:52.750 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:52.750 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:52.750 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:52.750 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.503722+0000", 2024-09-19T09:24:52.750 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:52.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.751 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.751 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:24:52.751 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:52.751 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:52.751 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:52.751 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:52.751 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:52.751 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.607846+0000", 2024-09-19T09:24:52.751 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:52.751 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.751 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.751 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:24:52.752 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:52.752 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:52.752 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:52.752 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:52.752 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:52.752 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.616858+0000", 2024-09-19T09:24:52.752 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:52.752 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.752 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.752 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:24:52.752 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:52.752 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:52.752 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:52.752 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:52.753 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:52.753 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.542726+0000", 2024-09-19T09:24:52.753 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:52.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.753 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.753 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:24:52.753 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:52.753 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:52.753 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:52.753 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:52.753 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:52.753 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.534178+0000", 2024-09-19T09:24:52.753 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:52.753 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.754 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:52.754 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:24:52.754 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:52.754 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:52.754 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:52.754 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:52.754 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:52.754 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.612105+0000", 2024-09-19T09:24:52.754 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:52.754 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.754 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:52.754 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-19T09:24:52.754 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-19T09:24:52.754 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-19T09:24:52.755 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-19T09:24:52.755 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-19T09:24:52.755 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-19T09:24:52.755 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-19T09:24:52.755 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-19T09:24:52.755 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-19T09:24:52.755 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-19T09:24:52.755 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-19T09:24:52.755 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-19T09:24:52.755 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-19T09:24:52.755 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-19T09:24:52.755 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.755 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:52.755 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-19T09:24:52.755 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-19T09:24:52.756 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-19T09:24:52.756 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-19T09:24:52.756 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-19T09:24:52.756 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-19T09:24:52.756 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-19T09:24:52.756 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-19T09:24:52.756 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-19T09:24:52.756 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-19T09:24:52.756 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-19T09:24:52.756 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:52.756 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:24:52.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.681+0000 7fce020a6640 1 -- 172.21.15.18:0/4146717184 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcde806c2b0 msgr2=0x7fcde806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:52.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.681+0000 7fce020a6640 1 --2- 172.21.15.18:0/4146717184 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcde806c2b0 0x7fcde806e770 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fcdf000aa30 tx=0x7fcdf0008040 comp rx=0 tx=0).stop 2024-09-19T09:24:52.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.681+0000 7fce020a6640 1 -- 172.21.15.18:0/4146717184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc13fae0 msgr2=0x7fcdfc13ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:52.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.681+0000 7fce020a6640 1 --2- 172.21.15.18:0/4146717184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc13fae0 0x7fcdfc13ef80 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7fcdec02a1e0 tx=0x7fcdec0046c0 comp rx=0 tx=0).stop 2024-09-19T09:24:52.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.681+0000 7fce020a6640 1 -- 172.21.15.18:0/4146717184 shutdown_connections 2024-09-19T09:24:52.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.681+0000 7fce020a6640 1 --2- 172.21.15.18:0/4146717184 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcde806c2b0 0x7fcde806e770 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:52.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.681+0000 7fce020a6640 1 --2- 172.21.15.18:0/4146717184 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdfc160a80 0x7fcdfc072b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:52.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.681+0000 7fce020a6640 1 --2- 172.21.15.18:0/4146717184 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdfc142150 0x7fcdfc13e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:52.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.681+0000 7fce020a6640 1 --2- 172.21.15.18:0/4146717184 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdfc13fae0 0x7fcdfc13ef80 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:52.758 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.681+0000 7fce020a6640 1 -- 172.21.15.18:0/4146717184 >> 172.21.15.18:0/4146717184 conn(0x7fcdfc06bc10 msgr2=0x7fcdfc06d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:52.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.681+0000 7fce020a6640 1 -- 172.21.15.18:0/4146717184 shutdown_connections 2024-09-19T09:24:52.759 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:52.681+0000 7fce020a6640 1 -- 172.21.15.18:0/4146717184 wait complete. 2024-09-19T09:24:52.759 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-19T09:24:57.760 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-19T09:24:57.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.875+0000 7fe04732c640 1 Processor -- start 2024-09-19T09:24:57.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.875+0000 7fe04732c640 1 -- start start 2024-09-19T09:24:57.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.876+0000 7fe04732c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe04013fae0 0x7fe04006f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:57.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.876+0000 7fe04732c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe040142150 0x7fe040160540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:57.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.876+0000 7fe04732c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe040142650 con 0x7fe040160a80 2024-09-19T09:24:57.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.876+0000 7fe04732c640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fe0400ce780 con 0x7fe040142150 2024-09-19T09:24:57.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.876+0000 7fe04732c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe040142930 con 0x7fe04013fae0 2024-09-19T09:24:57.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.876+0000 7fe0448c7640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe040142150 0x7fe040160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:57.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.876+0000 7fe0448c7640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fe040142150 0x7fe040160540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40200/0 (socket says 172.21.15.18:40200) 2024-09-19T09:24:57.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.876+0000 7fe0448c7640 1 -- 172.21.15.18:0/870612668 learned_addr learned my addr 172.21.15.18:0/870612668 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:57.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.876+0000 7fe0458c9640 1 --1- 172.21.15.18:0/870612668 >> v1:172.21.15.18:6789/0 conn(0x7fe040160a80 0x7fe04015cf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55504/0 (socket says 172.21.15.18:55504) 2024-09-19T09:24:57.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.877+0000 7fe0450c8640 1 --2- 172.21.15.18:0/870612668 >> v2:172.21.15.162:3300/0 conn(0x7fe04013fae0 0x7fe04006f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:57.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.877+0000 7fe0448c7640 1 -- 172.21.15.18:0/870612668 >> v2:172.21.15.162:3300/0 conn(0x7fe04013fae0 msgr2=0x7fe04006f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:57.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.877+0000 7fe0448c7640 1 --2- 172.21.15.18:0/870612668 >> v2:172.21.15.162:3300/0 conn(0x7fe04013fae0 0x7fe04006f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:57.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.877+0000 7fe0448c7640 1 -- 172.21.15.18:0/870612668 >> v1:172.21.15.18:6789/0 conn(0x7fe040160a80 legacy=0x7fe04015cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:57.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.877+0000 7fe0448c7640 1 -- 172.21.15.18:0/870612668 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe040142c10 con 0x7fe040142150 2024-09-19T09:24:57.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.877+0000 7fe03ffff640 1 -- 172.21.15.18:0/870612668 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1224463529 0 0) 0x7fe040142650 con 0x7fe040160a80 2024-09-19T09:24:57.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.877+0000 7fe0450c8640 1 --2- 172.21.15.18:0/870612668 >> v2:172.21.15.162:3300/0 conn(0x7fe04013fae0 0x7fe04006f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:57.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.878+0000 7fe0448c7640 1 --2- 172.21.15.18:0/870612668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe040142150 0x7fe040160540 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fe040050590 tx=0x7fe03402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab0f3c1e3e2d7753 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:57.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.878+0000 7fe03ffff640 1 -- 172.21.15.18:0/870612668 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe034037070 con 0x7fe040142150 2024-09-19T09:24:57.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.878+0000 7fe03ffff640 1 -- 172.21.15.18:0/870612668 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe034032440 con 0x7fe040142150 2024-09-19T09:24:57.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.878+0000 7fe03ffff640 1 -- 172.21.15.18:0/870612668 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe034032810 con 0x7fe040142150 2024-09-19T09:24:57.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.878+0000 7fe04732c640 1 -- 172.21.15.18:0/870612668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe040142150 msgr2=0x7fe040160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:57.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.878+0000 7fe04732c640 1 --2- 172.21.15.18:0/870612668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe040142150 0x7fe040160540 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fe040050590 tx=0x7fe03402a1e0 comp rx=0 tx=0).stop 2024-09-19T09:24:57.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.878+0000 7fe04732c640 1 -- 172.21.15.18:0/870612668 shutdown_connections 2024-09-19T09:24:57.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.878+0000 7fe04732c640 1 --2- 172.21.15.18:0/870612668 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe040142150 0x7fe040160540 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:57.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.878+0000 7fe04732c640 1 --2- 172.21.15.18:0/870612668 >> v2:172.21.15.162:3300/0 conn(0x7fe04013fae0 0x7fe04006f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:57.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.878+0000 7fe04732c640 1 -- 172.21.15.18:0/870612668 >> 172.21.15.18:0/870612668 conn(0x7fe04006bc10 msgr2=0x7fe04006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:57.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.878+0000 7fe04732c640 1 -- 172.21.15.18:0/870612668 shutdown_connections 2024-09-19T09:24:57.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.878+0000 7fe04732c640 1 -- 172.21.15.18:0/870612668 wait complete. 2024-09-19T09:24:57.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.880+0000 7fe04732c640 1 Processor -- start 2024-09-19T09:24:57.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.880+0000 7fe04732c640 1 -- start start 2024-09-19T09:24:57.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.880+0000 7fe04732c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe04013fae0 0x7fe0401f6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:57.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.880+0000 7fe04732c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe040142150 0x7fe04013ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:57.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.880+0000 7fe04732c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe040160a80 0x7fe0400b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:57.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.880+0000 7fe04732c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fe04006f870 con 0x7fe040142150 2024-09-19T09:24:57.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.880+0000 7fe04732c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe04006f6f0 con 0x7fe040160a80 2024-09-19T09:24:57.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.880+0000 7fe04732c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fe0400cfc20 con 0x7fe04013fae0 2024-09-19T09:24:57.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.881+0000 7fe0448c7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe040142150 0x7fe04013ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:57.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.881+0000 7fe0448c7640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe040142150 0x7fe04013ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40210/0 (socket says 172.21.15.18:40210) 2024-09-19T09:24:57.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.881+0000 7fe0448c7640 1 -- 172.21.15.18:0/2147498372 learned_addr learned my addr 172.21.15.18:0/2147498372 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:57.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.881+0000 7fe0458c9640 1 --2- 172.21.15.18:0/2147498372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe040160a80 0x7fe0400b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:57.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.881+0000 7fe0448c7640 1 -- 172.21.15.18:0/2147498372 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe04013fae0 msgr2=0x7fe0401f6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:57.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.881+0000 7fe0450c8640 1 --2- 172.21.15.18:0/2147498372 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe04013fae0 0x7fe0401f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:57.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.881+0000 7fe0448c7640 1 --2- 172.21.15.18:0/2147498372 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe04013fae0 0x7fe0401f6100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:57.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.881+0000 7fe0448c7640 1 -- 172.21.15.18:0/2147498372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe040160a80 msgr2=0x7fe0400b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:57.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.881+0000 7fe0448c7640 1 --2- 172.21.15.18:0/2147498372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe040160a80 0x7fe0400b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:57.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.881+0000 7fe0448c7640 1 -- 172.21.15.18:0/2147498372 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe040158f00 con 0x7fe040142150 2024-09-19T09:24:57.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.881+0000 7fe0458c9640 1 --2- 172.21.15.18:0/2147498372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe040160a80 0x7fe0400b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:24:57.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.881+0000 7fe0448c7640 1 --2- 172.21.15.18:0/2147498372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe040142150 0x7fe04013ef00 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fe034000c00 tx=0x7fe0340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:57.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.881+0000 7fe03dffb640 1 -- 172.21.15.18:0/2147498372 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe034037040 con 0x7fe040142150 2024-09-19T09:24:57.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.881+0000 7fe03dffb640 1 -- 172.21.15.18:0/2147498372 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe034004230 con 0x7fe040142150 2024-09-19T09:24:57.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.881+0000 7fe04732c640 1 -- 172.21.15.18:0/2147498372 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe040146090 con 0x7fe040142150 2024-09-19T09:24:57.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.881+0000 7fe03dffb640 1 -- 172.21.15.18:0/2147498372 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe034003610 con 0x7fe040142150 2024-09-19T09:24:57.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.882+0000 7fe04732c640 1 -- 172.21.15.18:0/2147498372 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0401f2c80 con 0x7fe040142150 2024-09-19T09:24:57.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.883+0000 7fe04732c640 1 -- 172.21.15.18:0/2147498372 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe04006f1b0 con 0x7fe040142150 2024-09-19T09:24:57.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.883+0000 7fe03dffb640 1 -- 172.21.15.18:0/2147498372 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fe0340037b0 con 0x7fe040142150 2024-09-19T09:24:57.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.884+0000 7fe03dffb640 1 --2- 172.21.15.18:0/2147498372 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe02c06c2b0 0x7fe02c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:57.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.884+0000 7fe03dffb640 1 -- 172.21.15.18:0/2147498372 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5709+0+0 (secure 0 0 0) 0x7fe0340ac450 con 0x7fe040142150 2024-09-19T09:24:57.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.884+0000 7fe0450c8640 1 --2- 172.21.15.18:0/2147498372 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe02c06c2b0 0x7fe02c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:57.887 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.884+0000 7fe0450c8640 1 --2- 172.21.15.18:0/2147498372 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe02c06c2b0 0x7fe02c06e770 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe030008f80 tx=0x7fe0300084d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:57.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:57.888+0000 7fe03dffb640 1 -- 172.21.15.18:0/2147498372 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fe040146090 con 0x7fe040142150 2024-09-19T09:24:58.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.068+0000 7fe04732c640 1 -- 172.21.15.18:0/2147498372 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7fe04015eb50 con 0x7fe040142150 2024-09-19T09:24:58.070 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.069+0000 7fe03dffb640 1 -- 172.21.15.18:0/2147498372 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v185) ==== 81+0+34290 (secure 0 0 0) 0x7fe03407ab30 con 0x7fe040142150 2024-09-19T09:24:58.071 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:24:58.071 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:24:58.071 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 185, 2024-09-19T09:24:58.071 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:24:58.071 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-19T09:13:11.348786+0000", 2024-09-19T09:24:58.071 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-19T09:24:56.278624+0000", 2024-09-19T09:24:58.071 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-19T09:13:16.423937+0000", 2024-09-19T09:24:58.071 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-19T09:13:13.417141+0000", 2024-09-19T09:24:58.071 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-19T09:24:58.071 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-09-19T09:24:58.072 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-19T09:24:58.072 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-19T09:24:58.072 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-19T09:24:58.072 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-19T09:24:58.072 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-19T09:24:58.072 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:58.072 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-19T09:24:58.072 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.69999998807907104, 2024-09-19T09:24:58.072 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-19T09:24:58.072 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-19T09:24:58.072 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-19T09:24:58.072 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 23, 2024-09-19T09:24:58.073 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-19T09:24:58.073 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-19T09:24:58.073 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "jewel", 2024-09-19T09:24:58.073 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-19T09:24:58.073 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-19T09:24:58.073 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-19T09:24:58.073 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.073 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-19T09:24:58.073 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-19T09:24:58.073 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:13:17.564717+0000", 2024-09-19T09:24:58.073 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:24:58.073 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:24:58.073 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:24:58.073 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:24:58.074 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:24:58.074 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:24:58.074 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:24:58.074 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:24:58.074 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:24:58.074 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:24:58.074 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:24:58.074 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:24:58.074 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:24:58.074 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-19T09:24:58.074 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-19T09:24:58.074 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-19T09:24:58.074 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-19T09:24:58.074 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-19T09:24:58.075 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:24:58.075 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:24:58.075 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:24:58.075 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:24:58.075 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:24:58.075 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:24:58.075 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:24:58.075 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.075 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "111", 2024-09-19T09:24:58.075 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:24:58.075 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:24:58.075 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:24:58.075 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:24:58.075 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:24:58.076 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:24:58.076 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:24:58.076 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:24:58.076 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:24:58.076 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:24:58.076 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:24:58.076 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:24:58.076 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:24:58.076 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:24:58.076 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:24:58.076 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:24:58.076 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:24:58.076 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:24:58.077 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:24:58.077 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:24:58.077 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:24:58.077 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:24:58.077 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:24:58.077 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:24:58.077 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:24:58.077 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:24:58.077 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.077 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:24:58.077 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:24:58.077 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:24:58.077 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:24:58.077 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:24:58.078 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:24:58.078 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:24:58.078 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:24:58.078 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:24:58.078 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:24:58.078 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:24:58.078 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:24:58.078 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-19T09:24:58.078 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-19T09:24:58.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.078 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:24:58.078 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-19T09:24:58.078 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.078 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:24:58.079 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:24:58.079 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-19T09:24:58.079 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-19T09:24:58.079 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-19T09:24:58.079 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-19T09:24:58.079 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-19T09:24:58.079 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:24:58.079 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:24:58.079 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:24:58.079 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.079 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.079 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.079 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 22, 2024-09-19T09:24:58.080 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_metadata", 2024-09-19T09:24:58.080 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:24:23.190145+0000", 2024-09-19T09:24:58.080 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:24:58.080 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:24:58.080 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:24:58.080 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:24:58.080 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:24:58.080 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:24:58.080 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:24:58.080 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:24:58.080 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:24:58.080 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:24:58.080 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:24:58.080 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:24:58.081 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:24:58.081 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-19T09:24:58.081 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-19T09:24:58.081 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-19T09:24:58.081 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-19T09:24:58.081 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-19T09:24:58.081 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:24:58.081 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:24:58.081 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:24:58.081 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:24:58.081 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:24:58.081 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:24:58.081 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:24:58.082 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.082 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "181", 2024-09-19T09:24:58.082 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:24:58.082 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:24:58.082 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:24:58.082 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:24:58.082 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:24:58.082 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:24:58.082 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:24:58.082 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:24:58.082 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:24:58.082 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:24:58.082 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:24:58.083 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:24:58.083 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:24:58.083 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:24:58.083 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:24:58.083 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:24:58.083 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:24:58.083 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:24:58.083 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:24:58.083 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:24:58.083 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:24:58.083 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:24:58.083 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:24:58.083 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:24:58.083 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:24:58.083 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:24:58.084 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.084 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:24:58.084 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:24:58.084 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:24:58.084 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:24:58.084 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:24:58.084 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:24:58.084 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:24:58.084 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:24:58.084 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:24:58.084 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:24:58.084 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:24:58.084 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:24:58.085 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4, 2024-09-19T09:24:58.085 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 16, 2024-09-19T09:24:58.085 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_priority": 5 2024-09-19T09:24:58.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.085 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:24:58.085 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:24:58.085 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": "cephfs" 2024-09-19T09:24:58.085 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.085 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.085 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:24:58.085 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:24:58.085 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.5, 2024-09-19T09:24:58.085 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.5, 2024-09-19T09:24:58.086 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:24:58.086 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.5, 2024-09-19T09:24:58.086 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.5, 2024-09-19T09:24:58.086 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:24:58.086 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:24:58.086 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:24:58.086 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.086 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.086 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.086 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 23, 2024-09-19T09:24:58.086 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_data", 2024-09-19T09:24:58.086 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:24:24.517971+0000", 2024-09-19T09:24:58.086 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:24:58.086 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:24:58.086 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:24:58.087 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:24:58.087 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:24:58.087 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:24:58.087 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:24:58.087 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:24:58.087 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:24:58.087 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:24:58.087 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:24:58.087 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:24:58.087 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:24:58.087 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 64, 2024-09-19T09:24:58.087 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 64, 2024-09-19T09:24:58.087 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 64, 2024-09-19T09:24:58.087 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 64, 2024-09-19T09:24:58.088 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 64, 2024-09-19T09:24:58.088 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:24:58.088 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:24:58.088 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:24:58.088 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:24:58.088 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:24:58.088 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:24:58.088 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:24:58.088 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.088 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "185", 2024-09-19T09:24:58.088 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:24:58.088 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:24:58.089 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:24:58.089 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:24:58.089 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:24:58.089 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:24:58.089 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:24:58.089 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:24:58.089 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:24:58.089 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 33554432, 2024-09-19T09:24:58.089 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:24:58.089 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:24:58.089 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:24:58.089 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:24:58.089 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:24:58.090 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:24:58.090 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:24:58.090 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:24:58.090 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:24:58.090 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:24:58.090 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:24:58.090 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:24:58.090 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:24:58.090 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:24:58.090 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:24:58.090 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:24:58.090 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.090 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:24:58.090 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:24:58.091 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:24:58.091 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:24:58.091 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:24:58.091 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:24:58.091 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:24:58.091 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:24:58.091 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:24:58.091 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:24:58.091 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:24:58.091 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:24:58.091 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 64, 2024-09-19T09:24:58.091 INFO:teuthology.orchestra.run.smithi018.stdout: "target_size_ratio": 0.89999997615814209 2024-09-19T09:24:58.091 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.091 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:24:58.091 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:24:58.092 INFO:teuthology.orchestra.run.smithi018.stdout: "data": "cephfs" 2024-09-19T09:24:58.092 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.092 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.092 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:24:58.092 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:24:58.092 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.3799999952316284, 2024-09-19T09:24:58.092 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.3799999952316284, 2024-09-19T09:24:58.092 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:24:58.092 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-19T09:24:58.092 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-19T09:24:58.092 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:24:58.092 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:24:58.092 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:24:58.093 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.093 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.093 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:58.093 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-19T09:24:58.093 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.093 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:24:58.093 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:58.093 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:58.093 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:58.093 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:58.093 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:58.093 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:58.093 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:58.093 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:58.094 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:58.094 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:58.094 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:58.094 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:58.094 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.094 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.094 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-19T09:24:58.094 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:58.094 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.094 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.094 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.094 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-19T09:24:58.094 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:58.095 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.095 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.095 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:58.095 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.095 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.095 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-19T09:24:58.095 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:58.095 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.095 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.095 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.095 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-19T09:24:58.095 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:58.095 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.096 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.096 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:58.096 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.096 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.096 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-19T09:24:58.096 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:58.096 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.096 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.096 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.096 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-19T09:24:58.096 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:58.097 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.097 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.097 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:58.097 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.097 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.097 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-19T09:24:58.097 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:58.097 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.097 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.097 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.097 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-19T09:24:58.097 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:58.097 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.098 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.098 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/128722874", 2024-09-19T09:24:58.098 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/128722874", 2024-09-19T09:24:58.098 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/128722874", 2024-09-19T09:24:58.098 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/128722874", 2024-09-19T09:24:58.098 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:58.098 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:58.098 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:58.098 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.098 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.098 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.098 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:24:58.098 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:58.099 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:58.099 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:58.099 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:58.099 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:58.099 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:58.099 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:58.099 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:58.099 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:58.099 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:58.099 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:58.099 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:58.099 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.099 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.099 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.100 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-19T09:24:58.100 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:58.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.100 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.100 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-19T09:24:58.100 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:58.100 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.100 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.100 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.100 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:58.100 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.100 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.100 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.101 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-19T09:24:58.101 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:58.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.101 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.101 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-19T09:24:58.101 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:58.101 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.101 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.101 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.101 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:58.101 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.101 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.101 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.102 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-19T09:24:58.102 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:58.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.102 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.102 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-19T09:24:58.102 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:58.102 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.102 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.102 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.102 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:58.102 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.102 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.102 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.103 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-19T09:24:58.103 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:58.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.103 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.103 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.103 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-19T09:24:58.103 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:58.103 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.103 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.103 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.103 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/3672199638", 2024-09-19T09:24:58.103 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/3672199638", 2024-09-19T09:24:58.103 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/3672199638", 2024-09-19T09:24:58.103 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/3672199638", 2024-09-19T09:24:58.103 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:58.104 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:58.104 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:58.104 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.104 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.104 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.104 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:24:58.104 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:58.104 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:58.104 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:58.104 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:58.104 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:58.104 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:58.104 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:58.105 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:58.105 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:58.105 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:58.105 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:58.105 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:58.105 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.105 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.105 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T09:24:58.105 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:58.105 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.105 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.105 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.105 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T09:24:58.105 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:58.106 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.106 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.106 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:58.106 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.106 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.106 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-19T09:24:58.106 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:58.106 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.106 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.106 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.107 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-19T09:24:58.107 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:58.107 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.107 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.107 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:58.107 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.107 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.107 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-19T09:24:58.107 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:58.107 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.107 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.107 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.108 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-19T09:24:58.108 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:58.108 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.108 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.108 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:58.108 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.108 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.108 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-19T09:24:58.108 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:58.108 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.108 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.108 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.109 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-19T09:24:58.109 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:58.109 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.109 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.109 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3463367841", 2024-09-19T09:24:58.109 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3463367841", 2024-09-19T09:24:58.109 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3463367841", 2024-09-19T09:24:58.109 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3463367841", 2024-09-19T09:24:58.109 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:58.109 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:58.109 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:58.109 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.109 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.110 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.110 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:24:58.110 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:58.110 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:58.110 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:58.110 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:58.110 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:58.110 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:58.110 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:58.110 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:58.110 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:58.110 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:58.110 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:58.110 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:58.111 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.111 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.111 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-19T09:24:58.111 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:58.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.111 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.111 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.111 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-19T09:24:58.111 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:58.111 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.111 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.111 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.111 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:58.111 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.112 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.112 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-19T09:24:58.112 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:58.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.112 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.112 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.112 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-19T09:24:58.112 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:58.112 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.112 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.112 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.112 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:58.113 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.113 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.113 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-19T09:24:58.113 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:58.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.113 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.113 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.113 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-19T09:24:58.113 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:58.113 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.113 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.113 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.113 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:58.114 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.114 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.114 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-19T09:24:58.114 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:58.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.114 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.114 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.114 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-19T09:24:58.114 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:58.114 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.114 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.114 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.114 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/4163178582", 2024-09-19T09:24:58.114 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/4163178582", 2024-09-19T09:24:58.115 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/4163178582", 2024-09-19T09:24:58.115 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/4163178582", 2024-09-19T09:24:58.115 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:58.115 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:58.115 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:58.115 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.115 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.115 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.115 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:24:58.115 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:58.115 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:58.115 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:58.115 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:58.115 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:58.116 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:58.116 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:58.116 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:58.116 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:58.116 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:58.116 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:58.116 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:58.116 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.116 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.116 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6822", 2024-09-19T09:24:58.116 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:58.116 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.116 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.117 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.117 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6824", 2024-09-19T09:24:58.117 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:58.117 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.117 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.117 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:58.117 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.117 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.117 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6826", 2024-09-19T09:24:58.117 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:58.117 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.117 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.118 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.118 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6827", 2024-09-19T09:24:58.118 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:58.118 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.118 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.118 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.118 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:58.118 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.118 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.118 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.118 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6830", 2024-09-19T09:24:58.118 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6831", 2024-09-19T09:24:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6828", 2024-09-19T09:24:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:58.119 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.120 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.120 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.120 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6829", 2024-09-19T09:24:58.120 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:58.120 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.120 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.120 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.120 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6824/3538482215", 2024-09-19T09:24:58.121 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6827/3538482215", 2024-09-19T09:24:58.121 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6831/3538482215", 2024-09-19T09:24:58.121 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6829/3538482215", 2024-09-19T09:24:58.121 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:58.121 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:58.121 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:58.121 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.121 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.121 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.121 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:24:58.121 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:58.122 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:58.122 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:58.122 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:58.122 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:58.122 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:58.122 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:58.122 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:58.122 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:58.122 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:58.122 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:58.122 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:58.122 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.122 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.122 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.123 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6800", 2024-09-19T09:24:58.123 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:58.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.123 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.123 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6801", 2024-09-19T09:24:58.123 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:58.123 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.123 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.123 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.123 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:58.123 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.123 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.123 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.123 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6802", 2024-09-19T09:24:58.124 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:58.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.124 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.124 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6803", 2024-09-19T09:24:58.124 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:58.124 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.124 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.124 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.124 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:58.124 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.124 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.124 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.125 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6806", 2024-09-19T09:24:58.125 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:58.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.125 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.125 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6807", 2024-09-19T09:24:58.125 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:58.125 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.125 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.125 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.125 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:58.125 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.125 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.125 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.125 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6804", 2024-09-19T09:24:58.126 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:58.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.126 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.126 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.126 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6805", 2024-09-19T09:24:58.126 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:58.126 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.126 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.126 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.126 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6801/2408698413", 2024-09-19T09:24:58.126 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6803/2408698413", 2024-09-19T09:24:58.126 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6807/2408698413", 2024-09-19T09:24:58.126 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6805/2408698413", 2024-09-19T09:24:58.126 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:58.127 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:58.127 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:58.127 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.127 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.127 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.127 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:24:58.127 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:58.127 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:58.127 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:58.127 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:58.127 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:58.127 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:58.127 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:58.127 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:58.127 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:58.128 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:58.128 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:58.128 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:58.128 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.128 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.128 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6808", 2024-09-19T09:24:58.128 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:58.128 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.128 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.128 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.128 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6809", 2024-09-19T09:24:58.128 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:58.128 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.129 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.129 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:58.129 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.129 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.129 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6810", 2024-09-19T09:24:58.129 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:58.129 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.129 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.129 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.129 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6811", 2024-09-19T09:24:58.129 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:58.129 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.130 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.130 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:58.130 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.130 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.130 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6814", 2024-09-19T09:24:58.130 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:58.130 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.130 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.130 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.130 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6815", 2024-09-19T09:24:58.130 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:58.130 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.131 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.131 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:58.131 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.131 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.131 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6812", 2024-09-19T09:24:58.131 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:58.131 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.131 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.131 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.131 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6813", 2024-09-19T09:24:58.131 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:58.131 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.132 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.132 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6809/2596207948", 2024-09-19T09:24:58.132 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6811/2596207948", 2024-09-19T09:24:58.132 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6815/2596207948", 2024-09-19T09:24:58.132 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6813/2596207948", 2024-09-19T09:24:58.132 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:58.132 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:58.132 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:58.132 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.132 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.132 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.132 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:24:58.132 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.133 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6816", 2024-09-19T09:24:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6817", 2024-09-19T09:24:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.134 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6818", 2024-09-19T09:24:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6819", 2024-09-19T09:24:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.135 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6823", 2024-09-19T09:24:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6825", 2024-09-19T09:24:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.136 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6820", 2024-09-19T09:24:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6821", 2024-09-19T09:24:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6817/1334618296", 2024-09-19T09:24:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6819/1334618296", 2024-09-19T09:24:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6825/1334618296", 2024-09-19T09:24:58.137 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6821/1334618296", 2024-09-19T09:24:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-19T09:24:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:24:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:58.138 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.580838+0000", 2024-09-19T09:24:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:24:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.599990+0000", 2024-09-19T09:24:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.139 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:24:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.503722+0000", 2024-09-19T09:24:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:24:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:58.140 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.607846+0000", 2024-09-19T09:24:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:24:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:58.141 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.616858+0000", 2024-09-19T09:24:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:24:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:58.142 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.542726+0000", 2024-09-19T09:24:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:24:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.534178+0000", 2024-09-19T09:24:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.143 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:24:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.612105+0000", 2024-09-19T09:24:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-19T09:24:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-19T09:24:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-19T09:24:58.144 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-19T09:24:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-19T09:24:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-19T09:24:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-19T09:24:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-19T09:24:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-19T09:24:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-19T09:24:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-19T09:24:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-19T09:24:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-19T09:24:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-19T09:24:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-19T09:24:58.145 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-19T09:24:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-19T09:24:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-19T09:24:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-19T09:24:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-19T09:24:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-19T09:24:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-19T09:24:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-19T09:24:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-19T09:24:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-19T09:24:58.146 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.146 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:24:58.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.071+0000 7fe04732c640 1 -- 172.21.15.18:0/2147498372 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe02c06c2b0 msgr2=0x7fe02c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:58.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.071+0000 7fe04732c640 1 --2- 172.21.15.18:0/2147498372 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe02c06c2b0 0x7fe02c06e770 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fe030008f80 tx=0x7fe0300084d0 comp rx=0 tx=0).stop 2024-09-19T09:24:58.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.071+0000 7fe04732c640 1 -- 172.21.15.18:0/2147498372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe040142150 msgr2=0x7fe04013ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:58.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.071+0000 7fe04732c640 1 --2- 172.21.15.18:0/2147498372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe040142150 0x7fe04013ef00 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fe034000c00 tx=0x7fe0340046c0 comp rx=0 tx=0).stop 2024-09-19T09:24:58.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.072+0000 7fe04732c640 1 -- 172.21.15.18:0/2147498372 shutdown_connections 2024-09-19T09:24:58.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.072+0000 7fe04732c640 1 --2- 172.21.15.18:0/2147498372 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fe02c06c2b0 0x7fe02c06e770 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:58.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.072+0000 7fe04732c640 1 --2- 172.21.15.18:0/2147498372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe040160a80 0x7fe0400b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:58.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.072+0000 7fe04732c640 1 --2- 172.21.15.18:0/2147498372 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fe040142150 0x7fe04013ef00 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:58.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.072+0000 7fe04732c640 1 --2- 172.21.15.18:0/2147498372 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fe04013fae0 0x7fe0401f6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:58.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.072+0000 7fe04732c640 1 -- 172.21.15.18:0/2147498372 >> 172.21.15.18:0/2147498372 conn(0x7fe04006bc10 msgr2=0x7fe0400cde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:58.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.072+0000 7fe04732c640 1 -- 172.21.15.18:0/2147498372 shutdown_connections 2024-09-19T09:24:58.149 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.072+0000 7fe04732c640 1 -- 172.21.15.18:0/2147498372 wait complete. 2024-09-19T09:24:58.149 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-09-19T09:24:58.150 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-19T09:24:58.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.253+0000 7ff3916dd640 1 Processor -- start 2024-09-19T09:24:58.254 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.253+0000 7ff3916dd640 1 -- start start 2024-09-19T09:24:58.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.254+0000 7ff3916dd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff38c152210 0x7ff38c071e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:58.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.254+0000 7ff3916dd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff38c0723d0 0x7ff38c0cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:58.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.254+0000 7ff3916dd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff38c0cf550 0x7ff38c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:58.255 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.254+0000 7ff3916dd640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7ff38c0cf9c0 con 0x7ff38c152210 2024-09-19T09:24:58.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.254+0000 7ff3916dd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff38c15c4f0 con 0x7ff38c0723d0 2024-09-19T09:24:58.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.254+0000 7ff3916dd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff38c15b730 con 0x7ff38c0cf550 2024-09-19T09:24:58.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.254+0000 7ff38affd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff38c152210 0x7ff38c071e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:58.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.254+0000 7ff38affd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7ff38c152210 0x7ff38c071e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40218/0 (socket says 172.21.15.18:40218) 2024-09-19T09:24:58.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.254+0000 7ff38affd640 1 -- 172.21.15.18:0/3250210696 learned_addr learned my addr 172.21.15.18:0/3250210696 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:58.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.254+0000 7ff38a7fc640 1 --2- 172.21.15.18:0/3250210696 >> v2:172.21.15.162:3300/0 conn(0x7ff38c0723d0 0x7ff38c0cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:58.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.254+0000 7ff38b7fe640 1 --2- 172.21.15.18:0/3250210696 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff38c0cf550 0x7ff38c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:58.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.254+0000 7ff38affd640 1 -- 172.21.15.18:0/3250210696 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff38c0cf550 msgr2=0x7ff38c06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:58.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.254+0000 7ff38affd640 1 --2- 172.21.15.18:0/3250210696 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff38c0cf550 0x7ff38c06d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:58.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.254+0000 7ff38affd640 1 -- 172.21.15.18:0/3250210696 >> v2:172.21.15.162:3300/0 conn(0x7ff38c0723d0 msgr2=0x7ff38c0cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:58.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.254+0000 7ff38affd640 1 --2- 172.21.15.18:0/3250210696 >> v2:172.21.15.162:3300/0 conn(0x7ff38c0723d0 0x7ff38c0cf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:58.256 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.254+0000 7ff38affd640 1 -- 172.21.15.18:0/3250210696 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff38c15ba10 con 0x7ff38c152210 2024-09-19T09:24:58.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.255+0000 7ff38affd640 1 --2- 172.21.15.18:0/3250210696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff38c152210 0x7ff38c071e90 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7ff38c0712d0 tx=0x7ff37c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8388e9411687f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:58.263 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.255+0000 7ff389ffb640 1 -- 172.21.15.18:0/3250210696 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff37c037070 con 0x7ff38c152210 2024-09-19T09:24:58.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.255+0000 7ff389ffb640 1 -- 172.21.15.18:0/3250210696 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff37c032440 con 0x7ff38c152210 2024-09-19T09:24:58.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.255+0000 7ff389ffb640 1 -- 172.21.15.18:0/3250210696 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff37c032810 con 0x7ff38c152210 2024-09-19T09:24:58.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.256+0000 7ff3916dd640 1 -- 172.21.15.18:0/3250210696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff38c152210 msgr2=0x7ff38c071e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:58.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.256+0000 7ff3916dd640 1 --2- 172.21.15.18:0/3250210696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff38c152210 0x7ff38c071e90 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7ff38c0712d0 tx=0x7ff37c02a1e0 comp rx=0 tx=0).stop 2024-09-19T09:24:58.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.256+0000 7ff3916dd640 1 -- 172.21.15.18:0/3250210696 shutdown_connections 2024-09-19T09:24:58.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.256+0000 7ff3916dd640 1 --2- 172.21.15.18:0/3250210696 >> v2:172.21.15.162:3300/0 conn(0x7ff38c0723d0 0x7ff38c0cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:58.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.256+0000 7ff3916dd640 1 --2- 172.21.15.18:0/3250210696 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff38c0cf550 0x7ff38c06d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:58.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.256+0000 7ff3916dd640 1 --2- 172.21.15.18:0/3250210696 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff38c152210 0x7ff38c071e90 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:58.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.256+0000 7ff3916dd640 1 -- 172.21.15.18:0/3250210696 >> 172.21.15.18:0/3250210696 conn(0x7ff38c06bc10 msgr2=0x7ff38c06bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:58.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.256+0000 7ff3916dd640 1 -- 172.21.15.18:0/3250210696 shutdown_connections 2024-09-19T09:24:58.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.256+0000 7ff3916dd640 1 -- 172.21.15.18:0/3250210696 wait complete. 2024-09-19T09:24:58.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.257+0000 7ff3916dd640 1 Processor -- start 2024-09-19T09:24:58.264 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.257+0000 7ff3916dd640 1 -- start start 2024-09-19T09:24:58.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.258+0000 7ff3916dd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff38c0723d0 0x7ff38c140e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:58.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.258+0000 7ff3916dd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff38c0cf550 0x7ff38c164300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:58.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.258+0000 7ff3916dd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff38c152210 0x7ff38c164bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:58.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.258+0000 7ff3916dd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff38c06f380 con 0x7ff38c0723d0 2024-09-19T09:24:58.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.258+0000 7ff3916dd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff38c15bfd0 con 0x7ff38c0cf550 2024-09-19T09:24:58.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.258+0000 7ff3916dd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff38c0ce780 con 0x7ff38c152210 2024-09-19T09:24:58.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.258+0000 7ff38affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff38c0723d0 0x7ff38c140e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:58.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.258+0000 7ff38affd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff38c0723d0 0x7ff38c140e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40230/0 (socket says 172.21.15.18:40230) 2024-09-19T09:24:58.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.258+0000 7ff38affd640 1 -- 172.21.15.18:0/2427519614 learned_addr learned my addr 172.21.15.18:0/2427519614 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:58.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.258+0000 7ff38a7fc640 1 --2- 172.21.15.18:0/2427519614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff38c0cf550 0x7ff38c164300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:58.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.258+0000 7ff38b7fe640 1 --2- 172.21.15.18:0/2427519614 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff38c152210 0x7ff38c164bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:58.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.258+0000 7ff38affd640 1 -- 172.21.15.18:0/2427519614 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff38c152210 msgr2=0x7ff38c164bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:58.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.258+0000 7ff38affd640 1 --2- 172.21.15.18:0/2427519614 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff38c152210 0x7ff38c164bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:58.265 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.258+0000 7ff38affd640 1 -- 172.21.15.18:0/2427519614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff38c0cf550 msgr2=0x7ff38c164300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:58.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.258+0000 7ff38affd640 1 --2- 172.21.15.18:0/2427519614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff38c0cf550 0x7ff38c164300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:58.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.258+0000 7ff38affd640 1 -- 172.21.15.18:0/2427519614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff38c14f7a0 con 0x7ff38c0723d0 2024-09-19T09:24:58.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.258+0000 7ff38b7fe640 1 --2- 172.21.15.18:0/2427519614 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff38c152210 0x7ff38c164bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:58.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.258+0000 7ff38affd640 1 --2- 172.21.15.18:0/2427519614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff38c0723d0 0x7ff38c140e50 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7ff37c02a220 tx=0x7ff37c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:58.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.259+0000 7ff3737fe640 1 -- 172.21.15.18:0/2427519614 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff37c041020 con 0x7ff38c0723d0 2024-09-19T09:24:58.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.259+0000 7ff3737fe640 1 -- 172.21.15.18:0/2427519614 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff37c0306c0 con 0x7ff38c0723d0 2024-09-19T09:24:58.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.259+0000 7ff3737fe640 1 -- 172.21.15.18:0/2427519614 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff37c037040 con 0x7ff38c0723d0 2024-09-19T09:24:58.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.259+0000 7ff3916dd640 1 -- 172.21.15.18:0/2427519614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff38c14fa80 con 0x7ff38c0723d0 2024-09-19T09:24:58.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.259+0000 7ff3916dd640 1 -- 172.21.15.18:0/2427519614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff38c141f90 con 0x7ff38c0723d0 2024-09-19T09:24:58.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.260+0000 7ff3916dd640 1 -- 172.21.15.18:0/2427519614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff38c071e90 con 0x7ff38c0723d0 2024-09-19T09:24:58.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.260+0000 7ff3737fe640 1 -- 172.21.15.18:0/2427519614 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff37c044020 con 0x7ff38c0723d0 2024-09-19T09:24:58.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.261+0000 7ff3737fe640 1 --2- 172.21.15.18:0/2427519614 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff37806c2b0 0x7ff37806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:58.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.261+0000 7ff3737fe640 1 -- 172.21.15.18:0/2427519614 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5709+0+0 (secure 0 0 0) 0x7ff37c0abb60 con 0x7ff38c0723d0 2024-09-19T09:24:58.266 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.261+0000 7ff38a7fc640 1 --2- 172.21.15.18:0/2427519614 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff37806c2b0 0x7ff37806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:58.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.262+0000 7ff38a7fc640 1 --2- 172.21.15.18:0/2427519614 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff37806c2b0 0x7ff37806e770 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff38c1f82c0 tx=0x7ff380008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:58.267 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.265+0000 7ff3737fe640 1 -- 172.21.15.18:0/2427519614 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff37c04b030 con 0x7ff38c0723d0 2024-09-19T09:24:58.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.444+0000 7ff3916dd640 1 -- 172.21.15.18:0/2427519614 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) -- 0x7ff38c15d1b0 con 0x7ff38c0723d0 2024-09-19T09:24:58.446 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.445+0000 7ff3737fe640 1 -- 172.21.15.18:0/2427519614 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v185) ==== 81+0+34290 (secure 0 0 0) 0x7ff37c07a360 con 0x7ff38c0723d0 2024-09-19T09:24:58.446 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:24:58.446 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:24:58.446 INFO:teuthology.orchestra.run.smithi018.stdout: "epoch": 185, 2024-09-19T09:24:58.447 INFO:teuthology.orchestra.run.smithi018.stdout: "fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", 2024-09-19T09:24:58.447 INFO:teuthology.orchestra.run.smithi018.stdout: "created": "2024-09-19T09:13:11.348786+0000", 2024-09-19T09:24:58.447 INFO:teuthology.orchestra.run.smithi018.stdout: "modified": "2024-09-19T09:24:56.278624+0000", 2024-09-19T09:24:58.447 INFO:teuthology.orchestra.run.smithi018.stdout: "last_up_change": "2024-09-19T09:13:16.423937+0000", 2024-09-19T09:24:58.447 INFO:teuthology.orchestra.run.smithi018.stdout: "last_in_change": "2024-09-19T09:13:13.417141+0000", 2024-09-19T09:24:58.447 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-19T09:24:58.447 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_num": 5799936, 2024-09-19T09:24:58.447 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_set": [ 2024-09-19T09:24:58.447 INFO:teuthology.orchestra.run.smithi018.stdout: "pglog_hardlimit", 2024-09-19T09:24:58.447 INFO:teuthology.orchestra.run.smithi018.stdout: "purged_snapdirs", 2024-09-19T09:24:58.447 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_deletes", 2024-09-19T09:24:58.447 INFO:teuthology.orchestra.run.smithi018.stdout: "sortbitwise" 2024-09-19T09:24:58.447 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:58.447 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_version": 4, 2024-09-19T09:24:58.448 INFO:teuthology.orchestra.run.smithi018.stdout: "full_ratio": 0.69999998807907104, 2024-09-19T09:24:58.448 INFO:teuthology.orchestra.run.smithi018.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-19T09:24:58.448 INFO:teuthology.orchestra.run.smithi018.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-19T09:24:58.448 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_snapshot": "", 2024-09-19T09:24:58.448 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_max": 23, 2024-09-19T09:24:58.448 INFO:teuthology.orchestra.run.smithi018.stdout: "max_osd": 8, 2024-09-19T09:24:58.448 INFO:teuthology.orchestra.run.smithi018.stdout: "require_min_compat_client": "luminous", 2024-09-19T09:24:58.448 INFO:teuthology.orchestra.run.smithi018.stdout: "min_compat_client": "jewel", 2024-09-19T09:24:58.448 INFO:teuthology.orchestra.run.smithi018.stdout: "require_osd_release": "squid", 2024-09-19T09:24:58.448 INFO:teuthology.orchestra.run.smithi018.stdout: "allow_crimson": false, 2024-09-19T09:24:58.448 INFO:teuthology.orchestra.run.smithi018.stdout: "pools": [ 2024-09-19T09:24:58.448 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.448 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 1, 2024-09-19T09:24:58.449 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": ".mgr", 2024-09-19T09:24:58.449 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:13:17.564717+0000", 2024-09-19T09:24:58.449 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:24:58.449 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:24:58.449 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:24:58.449 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:24:58.449 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:24:58.449 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:24:58.449 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:24:58.449 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:24:58.449 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:24:58.449 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:24:58.449 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:24:58.449 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:24:58.450 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:24:58.450 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 1, 2024-09-19T09:24:58.450 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 1, 2024-09-19T09:24:58.450 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 1, 2024-09-19T09:24:58.450 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 1, 2024-09-19T09:24:58.450 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 1, 2024-09-19T09:24:58.450 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:24:58.450 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:24:58.450 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:24:58.450 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:24:58.450 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:24:58.450 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:24:58.450 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:24:58.450 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.450 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "111", 2024-09-19T09:24:58.451 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:24:58.451 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:24:58.451 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:24:58.451 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:24:58.451 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:24:58.451 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:24:58.451 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:24:58.451 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:24:58.451 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:24:58.451 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:24:58.451 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:24:58.451 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:24:58.451 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:24:58.451 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:24:58.452 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:24:58.452 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:24:58.452 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:24:58.452 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:24:58.452 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:24:58.452 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:24:58.452 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:24:58.452 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:24:58.452 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:24:58.452 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:24:58.452 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:24:58.452 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:24:58.452 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.452 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:24:58.453 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:24:58.453 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:24:58.453 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:24:58.453 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:24:58.453 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:24:58.453 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:24:58.453 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:24:58.453 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:24:58.453 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:24:58.453 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:24:58.453 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:24:58.453 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_max": 32, 2024-09-19T09:24:58.453 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 1 2024-09-19T09:24:58.453 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.454 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:24:58.454 INFO:teuthology.orchestra.run.smithi018.stdout: "mgr": {} 2024-09-19T09:24:58.454 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.454 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:24:58.454 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:24:58.454 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 8, 2024-09-19T09:24:58.454 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 8, 2024-09-19T09:24:58.454 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 0.25, 2024-09-19T09:24:58.454 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 2, 2024-09-19T09:24:58.454 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 2, 2024-09-19T09:24:58.454 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:24:58.454 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:24:58.454 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:24:58.454 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.455 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.455 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.455 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 22, 2024-09-19T09:24:58.455 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_metadata", 2024-09-19T09:24:58.455 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:24:23.190145+0000", 2024-09-19T09:24:58.455 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:24:58.455 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:24:58.455 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:24:58.455 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:24:58.455 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:24:58.455 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:24:58.455 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:24:58.455 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:24:58.455 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:24:58.456 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:24:58.456 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:24:58.456 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:24:58.456 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:24:58.456 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 32, 2024-09-19T09:24:58.456 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 32, 2024-09-19T09:24:58.456 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 32, 2024-09-19T09:24:58.456 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 32, 2024-09-19T09:24:58.456 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 32, 2024-09-19T09:24:58.456 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:24:58.456 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:24:58.456 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:24:58.456 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:24:58.456 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:24:58.457 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:24:58.457 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:24:58.457 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.457 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "181", 2024-09-19T09:24:58.457 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:24:58.457 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:24:58.457 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:24:58.457 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:24:58.457 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:24:58.457 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:24:58.457 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:24:58.457 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:24:58.457 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:24:58.457 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 0, 2024-09-19T09:24:58.458 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:24:58.458 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:24:58.458 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:24:58.458 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:24:58.458 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:24:58.458 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:24:58.458 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:24:58.458 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:24:58.458 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:24:58.458 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:24:58.459 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:24:58.459 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:24:58.459 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:24:58.459 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:24:58.459 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:24:58.459 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:24:58.459 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.459 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:24:58.459 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:24:58.459 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:24:58.459 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:24:58.459 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:24:58.459 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:24:58.459 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:24:58.460 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:24:58.460 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:24:58.460 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:24:58.460 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:24:58.460 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:24:58.460 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_bias": 4, 2024-09-19T09:24:58.460 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 16, 2024-09-19T09:24:58.460 INFO:teuthology.orchestra.run.smithi018.stdout: "recovery_priority": 5 2024-09-19T09:24:58.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.460 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:24:58.460 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:24:58.460 INFO:teuthology.orchestra.run.smithi018.stdout: "metadata": "cephfs" 2024-09-19T09:24:58.460 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.460 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.461 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:24:58.461 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:24:58.461 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.5, 2024-09-19T09:24:58.461 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.5, 2024-09-19T09:24:58.461 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:24:58.461 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.5, 2024-09-19T09:24:58.461 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.5, 2024-09-19T09:24:58.461 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:24:58.461 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:24:58.461 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:24:58.461 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.461 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.461 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.461 INFO:teuthology.orchestra.run.smithi018.stdout: "pool": 23, 2024-09-19T09:24:58.462 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_name": "cephfs_data", 2024-09-19T09:24:58.462 INFO:teuthology.orchestra.run.smithi018.stdout: "create_time": "2024-09-19T09:24:24.517971+0000", 2024-09-19T09:24:58.462 INFO:teuthology.orchestra.run.smithi018.stdout: "flags": 1, 2024-09-19T09:24:58.462 INFO:teuthology.orchestra.run.smithi018.stdout: "flags_names": "hashpspool", 2024-09-19T09:24:58.462 INFO:teuthology.orchestra.run.smithi018.stdout: "type": 1, 2024-09-19T09:24:58.462 INFO:teuthology.orchestra.run.smithi018.stdout: "size": 2, 2024-09-19T09:24:58.462 INFO:teuthology.orchestra.run.smithi018.stdout: "min_size": 1, 2024-09-19T09:24:58.462 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_rule": 0, 2024-09-19T09:24:58.462 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_count": 0, 2024-09-19T09:24:58.462 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_target": 0, 2024-09-19T09:24:58.462 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_barrier": 0, 2024-09-19T09:24:58.462 INFO:teuthology.orchestra.run.smithi018.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-19T09:24:58.462 INFO:teuthology.orchestra.run.smithi018.stdout: "is_stretch_pool": false, 2024-09-19T09:24:58.462 INFO:teuthology.orchestra.run.smithi018.stdout: "object_hash": 2, 2024-09-19T09:24:58.463 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_autoscale_mode": "off", 2024-09-19T09:24:58.463 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num": 64, 2024-09-19T09:24:58.463 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num": 64, 2024-09-19T09:24:58.463 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_placement_num_target": 64, 2024-09-19T09:24:58.463 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_target": 64, 2024-09-19T09:24:58.463 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_pending": 64, 2024-09-19T09:24:58.463 INFO:teuthology.orchestra.run.smithi018.stdout: "last_pg_merge_meta": { 2024-09-19T09:24:58.463 INFO:teuthology.orchestra.run.smithi018.stdout: "source_pgid": "0.0", 2024-09-19T09:24:58.463 INFO:teuthology.orchestra.run.smithi018.stdout: "ready_epoch": 0, 2024-09-19T09:24:58.463 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_started": 0, 2024-09-19T09:24:58.463 INFO:teuthology.orchestra.run.smithi018.stdout: "last_epoch_clean": 0, 2024-09-19T09:24:58.463 INFO:teuthology.orchestra.run.smithi018.stdout: "source_version": "0'0", 2024-09-19T09:24:58.463 INFO:teuthology.orchestra.run.smithi018.stdout: "target_version": "0'0" 2024-09-19T09:24:58.463 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.464 INFO:teuthology.orchestra.run.smithi018.stdout: "last_change": "185", 2024-09-19T09:24:58.464 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend": "0", 2024-09-19T09:24:58.464 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-19T09:24:58.464 INFO:teuthology.orchestra.run.smithi018.stdout: "last_force_op_resend_preluminous": "0", 2024-09-19T09:24:58.464 INFO:teuthology.orchestra.run.smithi018.stdout: "auid": 0, 2024-09-19T09:24:58.464 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_mode": "selfmanaged", 2024-09-19T09:24:58.464 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_seq": 0, 2024-09-19T09:24:58.464 INFO:teuthology.orchestra.run.smithi018.stdout: "snap_epoch": 0, 2024-09-19T09:24:58.464 INFO:teuthology.orchestra.run.smithi018.stdout: "pool_snaps": [], 2024-09-19T09:24:58.464 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps": "[]", 2024-09-19T09:24:58.464 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_bytes": 33554432, 2024-09-19T09:24:58.464 INFO:teuthology.orchestra.run.smithi018.stdout: "quota_max_objects": 0, 2024-09-19T09:24:58.464 INFO:teuthology.orchestra.run.smithi018.stdout: "tiers": [], 2024-09-19T09:24:58.465 INFO:teuthology.orchestra.run.smithi018.stdout: "tier_of": -1, 2024-09-19T09:24:58.465 INFO:teuthology.orchestra.run.smithi018.stdout: "read_tier": -1, 2024-09-19T09:24:58.465 INFO:teuthology.orchestra.run.smithi018.stdout: "write_tier": -1, 2024-09-19T09:24:58.465 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_mode": "none", 2024-09-19T09:24:58.465 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_bytes": 0, 2024-09-19T09:24:58.465 INFO:teuthology.orchestra.run.smithi018.stdout: "target_max_objects": 0, 2024-09-19T09:24:58.465 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-19T09:24:58.465 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-19T09:24:58.465 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-19T09:24:58.465 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_flush_age": 0, 2024-09-19T09:24:58.465 INFO:teuthology.orchestra.run.smithi018.stdout: "cache_min_evict_age": 0, 2024-09-19T09:24:58.465 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profile": "", 2024-09-19T09:24:58.465 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_params": { 2024-09-19T09:24:58.465 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "none" 2024-09-19T09:24:58.465 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.466 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_period": 0, 2024-09-19T09:24:58.466 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_count": 0, 2024-09-19T09:24:58.466 INFO:teuthology.orchestra.run.smithi018.stdout: "use_gmt_hitset": true, 2024-09-19T09:24:58.466 INFO:teuthology.orchestra.run.smithi018.stdout: "min_read_recency_for_promote": 0, 2024-09-19T09:24:58.466 INFO:teuthology.orchestra.run.smithi018.stdout: "min_write_recency_for_promote": 0, 2024-09-19T09:24:58.466 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_grade_decay_rate": 0, 2024-09-19T09:24:58.466 INFO:teuthology.orchestra.run.smithi018.stdout: "hit_set_search_last_n": 0, 2024-09-19T09:24:58.466 INFO:teuthology.orchestra.run.smithi018.stdout: "grade_table": [], 2024-09-19T09:24:58.466 INFO:teuthology.orchestra.run.smithi018.stdout: "stripe_width": 0, 2024-09-19T09:24:58.466 INFO:teuthology.orchestra.run.smithi018.stdout: "expected_num_objects": 0, 2024-09-19T09:24:58.466 INFO:teuthology.orchestra.run.smithi018.stdout: "fast_read": false, 2024-09-19T09:24:58.466 INFO:teuthology.orchestra.run.smithi018.stdout: "options": { 2024-09-19T09:24:58.466 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_num_min": 64, 2024-09-19T09:24:58.466 INFO:teuthology.orchestra.run.smithi018.stdout: "target_size_ratio": 0.89999997615814209 2024-09-19T09:24:58.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.467 INFO:teuthology.orchestra.run.smithi018.stdout: "application_metadata": { 2024-09-19T09:24:58.467 INFO:teuthology.orchestra.run.smithi018.stdout: "cephfs": { 2024-09-19T09:24:58.467 INFO:teuthology.orchestra.run.smithi018.stdout: "data": "cephfs" 2024-09-19T09:24:58.467 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.467 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.467 INFO:teuthology.orchestra.run.smithi018.stdout: "read_balance": { 2024-09-19T09:24:58.467 INFO:teuthology.orchestra.run.smithi018.stdout: "score_type": "Fair distribution", 2024-09-19T09:24:58.467 INFO:teuthology.orchestra.run.smithi018.stdout: "score_acting": 1.3799999952316284, 2024-09-19T09:24:58.467 INFO:teuthology.orchestra.run.smithi018.stdout: "score_stable": 1.3799999952316284, 2024-09-19T09:24:58.467 INFO:teuthology.orchestra.run.smithi018.stdout: "optimal_score": 1, 2024-09-19T09:24:58.467 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-19T09:24:58.467 INFO:teuthology.orchestra.run.smithi018.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-19T09:24:58.467 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity_weighted": 1, 2024-09-19T09:24:58.468 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity": 1, 2024-09-19T09:24:58.468 INFO:teuthology.orchestra.run.smithi018.stdout: "average_primary_affinity_weighted": 1 2024-09-19T09:24:58.468 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.468 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.468 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:58.468 INFO:teuthology.orchestra.run.smithi018.stdout: "osds": [ 2024-09-19T09:24:58.468 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.468 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:24:58.468 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:58.468 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:58.468 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:58.468 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:58.468 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:58.468 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:58.469 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:58.469 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:58.469 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:58.469 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:58.469 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:58.469 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:58.469 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.469 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.469 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.469 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6808", 2024-09-19T09:24:58.469 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:58.469 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.469 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.469 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.470 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6809", 2024-09-19T09:24:58.470 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:58.470 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.470 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.470 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:58.470 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.470 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.470 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.470 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6810", 2024-09-19T09:24:58.470 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:58.470 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.470 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.470 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.470 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6811", 2024-09-19T09:24:58.471 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:58.471 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.471 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.471 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:58.471 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.471 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.471 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6814", 2024-09-19T09:24:58.471 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:58.471 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.471 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.471 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.471 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6815", 2024-09-19T09:24:58.472 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:58.472 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.472 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.472 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:58.472 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.472 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.472 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6812", 2024-09-19T09:24:58.472 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:58.472 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.472 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.472 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.472 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6813", 2024-09-19T09:24:58.473 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 128722874 2024-09-19T09:24:58.473 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.473 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.473 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6809/128722874", 2024-09-19T09:24:58.473 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6811/128722874", 2024-09-19T09:24:58.473 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6815/128722874", 2024-09-19T09:24:58.473 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6813/128722874", 2024-09-19T09:24:58.473 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:58.473 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:58.473 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:58.473 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.473 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.473 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.474 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:24:58.474 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:58.474 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:58.474 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:58.474 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:58.474 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:58.474 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:58.474 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:58.474 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:58.474 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:58.474 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:58.474 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:58.474 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:58.474 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.475 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.475 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6816", 2024-09-19T09:24:58.475 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:58.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.475 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.475 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.475 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6817", 2024-09-19T09:24:58.475 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:58.475 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.475 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.475 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.475 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:58.475 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.476 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.476 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6818", 2024-09-19T09:24:58.476 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:58.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.476 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.476 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.476 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6819", 2024-09-19T09:24:58.476 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:58.476 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.476 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.476 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.476 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:58.476 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.477 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.477 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.477 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6822", 2024-09-19T09:24:58.477 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:58.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.477 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.477 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.477 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6823", 2024-09-19T09:24:58.477 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:58.477 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.477 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.477 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.477 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:58.478 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.478 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.478 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.478 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6820", 2024-09-19T09:24:58.478 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:58.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.478 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.478 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.478 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6821", 2024-09-19T09:24:58.478 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3672199638 2024-09-19T09:24:58.478 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.478 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.478 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.478 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6817/3672199638", 2024-09-19T09:24:58.478 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6819/3672199638", 2024-09-19T09:24:58.479 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6823/3672199638", 2024-09-19T09:24:58.479 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6821/3672199638", 2024-09-19T09:24:58.479 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:58.479 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:58.479 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:58.479 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.479 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.479 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.479 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:24:58.479 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:58.479 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:58.479 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:58.479 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:58.479 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:58.480 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:58.480 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:58.480 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:58.480 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:58.480 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:58.480 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:58.480 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:58.480 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.480 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.480 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6800", 2024-09-19T09:24:58.480 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:58.480 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.480 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.481 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.481 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6801", 2024-09-19T09:24:58.481 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:58.481 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.481 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.481 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:58.481 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.481 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.481 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6802", 2024-09-19T09:24:58.481 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:58.481 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.481 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.482 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.482 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6803", 2024-09-19T09:24:58.482 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:58.482 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.482 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.482 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:58.482 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.482 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.482 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6806", 2024-09-19T09:24:58.482 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:58.482 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.482 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.483 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.483 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6807", 2024-09-19T09:24:58.483 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:58.483 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.483 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.483 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:58.483 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.483 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.483 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6804", 2024-09-19T09:24:58.483 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:58.483 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.483 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.484 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.484 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6805", 2024-09-19T09:24:58.484 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3463367841 2024-09-19T09:24:58.484 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.484 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.484 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.484 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6801/3463367841", 2024-09-19T09:24:58.484 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6803/3463367841", 2024-09-19T09:24:58.484 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6807/3463367841", 2024-09-19T09:24:58.484 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6805/3463367841", 2024-09-19T09:24:58.485 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:58.485 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:58.485 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:58.485 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.485 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.485 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.485 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:24:58.485 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:58.485 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:58.485 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:58.485 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:58.485 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:58.485 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:58.485 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:58.486 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:58.486 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:58.486 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:58.486 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:58.486 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:58.486 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.486 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.486 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.486 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6824", 2024-09-19T09:24:58.486 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:58.486 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.486 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.486 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.486 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6825", 2024-09-19T09:24:58.487 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:58.487 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.487 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.487 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:58.487 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.487 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.487 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6826", 2024-09-19T09:24:58.487 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:58.487 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.487 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.487 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.487 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6827", 2024-09-19T09:24:58.487 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:58.488 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.488 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.488 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:58.488 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.488 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.488 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6830", 2024-09-19T09:24:58.488 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:58.488 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.488 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.488 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.488 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6831", 2024-09-19T09:24:58.488 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:58.489 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.489 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.489 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:58.489 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.489 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.489 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6828", 2024-09-19T09:24:58.489 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:58.489 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.489 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.489 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.489 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.18:6829", 2024-09-19T09:24:58.489 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 4163178582 2024-09-19T09:24:58.490 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.490 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.490 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.18:6825/4163178582", 2024-09-19T09:24:58.490 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.18:6827/4163178582", 2024-09-19T09:24:58.490 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.18:6831/4163178582", 2024-09-19T09:24:58.490 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.18:6829/4163178582", 2024-09-19T09:24:58.490 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:58.490 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:58.490 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:58.490 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.490 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.490 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.490 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:24:58.491 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:58.491 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:58.491 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:58.491 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:58.491 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:58.491 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:58.491 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:58.491 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:58.491 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:58.491 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:58.491 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:58.491 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:58.491 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.491 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.491 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.492 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6822", 2024-09-19T09:24:58.492 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:58.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.492 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.492 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.492 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6824", 2024-09-19T09:24:58.492 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:58.492 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.492 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.492 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.492 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:58.492 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.492 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.492 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.493 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6826", 2024-09-19T09:24:58.493 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:58.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.493 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.493 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.493 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6827", 2024-09-19T09:24:58.493 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:58.493 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.493 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.493 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.494 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:58.494 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.494 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.494 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6830", 2024-09-19T09:24:58.494 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:58.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.494 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.494 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.494 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6831", 2024-09-19T09:24:58.494 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:58.494 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.494 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.494 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.495 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:58.495 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.495 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.495 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.495 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6828", 2024-09-19T09:24:58.495 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:58.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.495 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.495 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.495 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6829", 2024-09-19T09:24:58.495 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 3538482215 2024-09-19T09:24:58.495 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.495 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.495 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.496 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6824/3538482215", 2024-09-19T09:24:58.496 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6827/3538482215", 2024-09-19T09:24:58.496 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6831/3538482215", 2024-09-19T09:24:58.496 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6829/3538482215", 2024-09-19T09:24:58.496 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:58.496 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:58.496 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:58.496 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.496 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.496 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.496 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:24:58.496 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:58.496 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:58.496 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:58.497 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:58.497 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:58.497 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:58.497 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:58.497 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:58.497 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:58.497 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:58.497 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:58.497 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:58.497 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.497 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.497 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.497 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6800", 2024-09-19T09:24:58.497 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:58.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.498 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.498 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6801", 2024-09-19T09:24:58.498 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:58.498 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.498 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.498 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.498 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:58.498 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.498 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.498 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.498 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6802", 2024-09-19T09:24:58.498 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:58.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.499 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.499 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.499 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6803", 2024-09-19T09:24:58.499 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:58.499 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.499 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.499 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.499 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:58.499 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.499 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.499 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.499 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6806", 2024-09-19T09:24:58.499 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:58.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.500 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.500 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.500 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6807", 2024-09-19T09:24:58.500 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:58.500 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.500 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.500 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.500 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:58.500 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.500 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.500 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.500 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6804", 2024-09-19T09:24:58.500 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:58.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.501 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.501 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.501 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6805", 2024-09-19T09:24:58.501 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2408698413 2024-09-19T09:24:58.501 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.501 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.501 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.501 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6801/2408698413", 2024-09-19T09:24:58.501 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6803/2408698413", 2024-09-19T09:24:58.501 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6807/2408698413", 2024-09-19T09:24:58.501 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6805/2408698413", 2024-09-19T09:24:58.501 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:58.501 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:58.502 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:58.502 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.502 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.502 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.502 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:24:58.502 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:58.502 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:58.502 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:58.503 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:58.503 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:58.503 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:58.504 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:58.504 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:58.504 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:58.504 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:58.504 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:58.504 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:58.504 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.504 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.504 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.504 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6808", 2024-09-19T09:24:58.504 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:58.504 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.504 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.505 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.505 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6809", 2024-09-19T09:24:58.505 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:58.505 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.505 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.505 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:58.505 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.505 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.505 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.505 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6810", 2024-09-19T09:24:58.505 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:58.505 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.505 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.506 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.506 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6811", 2024-09-19T09:24:58.506 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:58.506 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.506 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.506 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:58.506 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.506 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.506 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.506 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6814", 2024-09-19T09:24:58.506 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:58.506 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.506 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.506 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.507 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6815", 2024-09-19T09:24:58.507 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:58.507 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.507 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.507 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:58.507 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.507 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.507 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6812", 2024-09-19T09:24:58.507 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:58.507 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.507 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.507 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.508 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6813", 2024-09-19T09:24:58.508 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 2596207948 2024-09-19T09:24:58.508 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.508 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.508 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6809/2596207948", 2024-09-19T09:24:58.508 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6811/2596207948", 2024-09-19T09:24:58.508 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6815/2596207948", 2024-09-19T09:24:58.508 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6813/2596207948", 2024-09-19T09:24:58.508 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:58.508 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:58.508 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:58.508 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.508 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.509 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.509 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:24:58.509 INFO:teuthology.orchestra.run.smithi018.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-19T09:24:58.509 INFO:teuthology.orchestra.run.smithi018.stdout: "up": 1, 2024-09-19T09:24:58.509 INFO:teuthology.orchestra.run.smithi018.stdout: "in": 1, 2024-09-19T09:24:58.509 INFO:teuthology.orchestra.run.smithi018.stdout: "weight": 1, 2024-09-19T09:24:58.509 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_affinity": 1, 2024-09-19T09:24:58.509 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_begin": 0, 2024-09-19T09:24:58.509 INFO:teuthology.orchestra.run.smithi018.stdout: "last_clean_end": 0, 2024-09-19T09:24:58.509 INFO:teuthology.orchestra.run.smithi018.stdout: "up_from": 13, 2024-09-19T09:24:58.509 INFO:teuthology.orchestra.run.smithi018.stdout: "up_thru": 180, 2024-09-19T09:24:58.509 INFO:teuthology.orchestra.run.smithi018.stdout: "down_at": 0, 2024-09-19T09:24:58.509 INFO:teuthology.orchestra.run.smithi018.stdout: "lost_at": 0, 2024-09-19T09:24:58.509 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addrs": { 2024-09-19T09:24:58.510 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.510 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.510 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6816", 2024-09-19T09:24:58.510 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:58.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.510 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.510 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.510 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6817", 2024-09-19T09:24:58.510 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:58.510 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.510 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.510 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.510 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addrs": { 2024-09-19T09:24:58.511 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.511 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.511 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6818", 2024-09-19T09:24:58.511 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:58.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.511 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.511 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.511 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6819", 2024-09-19T09:24:58.511 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:58.511 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.511 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.511 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.511 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addrs": { 2024-09-19T09:24:58.512 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.512 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.512 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6823", 2024-09-19T09:24:58.512 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:58.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.512 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.512 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.512 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6825", 2024-09-19T09:24:58.512 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:58.512 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.512 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.512 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.512 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addrs": { 2024-09-19T09:24:58.513 INFO:teuthology.orchestra.run.smithi018.stdout: "addrvec": [ 2024-09-19T09:24:58.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.513 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v2", 2024-09-19T09:24:58.513 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6820", 2024-09-19T09:24:58.513 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:58.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.513 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.513 INFO:teuthology.orchestra.run.smithi018.stdout: "type": "v1", 2024-09-19T09:24:58.513 INFO:teuthology.orchestra.run.smithi018.stdout: "addr": "172.21.15.162:6821", 2024-09-19T09:24:58.513 INFO:teuthology.orchestra.run.smithi018.stdout: "nonce": 1334618296 2024-09-19T09:24:58.513 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.513 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.513 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.513 INFO:teuthology.orchestra.run.smithi018.stdout: "public_addr": "172.21.15.162:6817/1334618296", 2024-09-19T09:24:58.514 INFO:teuthology.orchestra.run.smithi018.stdout: "cluster_addr": "172.21.15.162:6819/1334618296", 2024-09-19T09:24:58.514 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_back_addr": "172.21.15.162:6825/1334618296", 2024-09-19T09:24:58.514 INFO:teuthology.orchestra.run.smithi018.stdout: "heartbeat_front_addr": "172.21.15.162:6821/1334618296", 2024-09-19T09:24:58.514 INFO:teuthology.orchestra.run.smithi018.stdout: "state": [ 2024-09-19T09:24:58.514 INFO:teuthology.orchestra.run.smithi018.stdout: "exists", 2024-09-19T09:24:58.514 INFO:teuthology.orchestra.run.smithi018.stdout: "up" 2024-09-19T09:24:58.514 INFO:teuthology.orchestra.run.smithi018.stdout: ] 2024-09-19T09:24:58.514 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.514 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:58.514 INFO:teuthology.orchestra.run.smithi018.stdout: "osd_xinfo": [ 2024-09-19T09:24:58.514 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.514 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 0, 2024-09-19T09:24:58.514 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:58.514 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:58.515 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:58.515 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:58.515 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:58.515 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.580838+0000", 2024-09-19T09:24:58.515 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:58.515 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.515 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.515 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 1, 2024-09-19T09:24:58.515 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:58.515 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:58.515 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:58.515 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:58.515 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:58.515 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.599990+0000", 2024-09-19T09:24:58.516 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:58.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.516 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.516 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 2, 2024-09-19T09:24:58.516 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:58.516 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:58.516 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:58.516 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:58.516 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:58.516 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.503722+0000", 2024-09-19T09:24:58.516 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:58.516 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.516 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.517 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 3, 2024-09-19T09:24:58.517 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:58.517 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:58.517 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:58.517 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:58.517 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:58.517 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.607846+0000", 2024-09-19T09:24:58.517 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:58.517 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.517 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.517 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 4, 2024-09-19T09:24:58.517 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:58.517 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:58.517 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:58.517 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:58.518 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:58.518 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.616858+0000", 2024-09-19T09:24:58.518 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:58.518 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.518 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.518 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 5, 2024-09-19T09:24:58.518 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:58.518 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:58.518 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:58.518 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:58.518 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:58.518 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.542726+0000", 2024-09-19T09:24:58.518 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:58.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.519 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 6, 2024-09-19T09:24:58.519 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:58.519 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:58.519 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:58.519 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:58.519 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:58.519 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.534178+0000", 2024-09-19T09:24:58.519 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:58.519 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.519 INFO:teuthology.orchestra.run.smithi018.stdout: { 2024-09-19T09:24:58.519 INFO:teuthology.orchestra.run.smithi018.stdout: "osd": 7, 2024-09-19T09:24:58.519 INFO:teuthology.orchestra.run.smithi018.stdout: "down_stamp": "0.000000", 2024-09-19T09:24:58.519 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_probability": 0, 2024-09-19T09:24:58.520 INFO:teuthology.orchestra.run.smithi018.stdout: "laggy_interval": 0, 2024-09-19T09:24:58.520 INFO:teuthology.orchestra.run.smithi018.stdout: "features": 4540701547738038271, 2024-09-19T09:24:58.520 INFO:teuthology.orchestra.run.smithi018.stdout: "old_weight": 0, 2024-09-19T09:24:58.520 INFO:teuthology.orchestra.run.smithi018.stdout: "last_purged_snaps_scrub": "2024-09-19T09:13:14.612105+0000", 2024-09-19T09:24:58.520 INFO:teuthology.orchestra.run.smithi018.stdout: "dead_epoch": 0 2024-09-19T09:24:58.520 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.520 INFO:teuthology.orchestra.run.smithi018.stdout: ], 2024-09-19T09:24:58.520 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap": [], 2024-09-19T09:24:58.520 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_items": [], 2024-09-19T09:24:58.520 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_upmap_primaries": [], 2024-09-19T09:24:58.520 INFO:teuthology.orchestra.run.smithi018.stdout: "pg_temp": [], 2024-09-19T09:24:58.520 INFO:teuthology.orchestra.run.smithi018.stdout: "primary_temp": [], 2024-09-19T09:24:58.520 INFO:teuthology.orchestra.run.smithi018.stdout: "blocklist": {}, 2024-09-19T09:24:58.521 INFO:teuthology.orchestra.run.smithi018.stdout: "range_blocklist": {}, 2024-09-19T09:24:58.521 INFO:teuthology.orchestra.run.smithi018.stdout: "erasure_code_profiles": { 2024-09-19T09:24:58.521 INFO:teuthology.orchestra.run.smithi018.stdout: "default": { 2024-09-19T09:24:58.521 INFO:teuthology.orchestra.run.smithi018.stdout: "crush-failure-domain": "osd", 2024-09-19T09:24:58.521 INFO:teuthology.orchestra.run.smithi018.stdout: "k": "2", 2024-09-19T09:24:58.521 INFO:teuthology.orchestra.run.smithi018.stdout: "m": "1", 2024-09-19T09:24:58.521 INFO:teuthology.orchestra.run.smithi018.stdout: "plugin": "jerasure", 2024-09-19T09:24:58.521 INFO:teuthology.orchestra.run.smithi018.stdout: "technique": "reed_sol_van" 2024-09-19T09:24:58.521 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.521 INFO:teuthology.orchestra.run.smithi018.stdout: }, 2024-09-19T09:24:58.521 INFO:teuthology.orchestra.run.smithi018.stdout: "removed_snaps_queue": [], 2024-09-19T09:24:58.521 INFO:teuthology.orchestra.run.smithi018.stdout: "new_removed_snaps": [], 2024-09-19T09:24:58.521 INFO:teuthology.orchestra.run.smithi018.stdout: "new_purged_snaps": [], 2024-09-19T09:24:58.521 INFO:teuthology.orchestra.run.smithi018.stdout: "crush_node_flags": {}, 2024-09-19T09:24:58.521 INFO:teuthology.orchestra.run.smithi018.stdout: "device_class_flags": {}, 2024-09-19T09:24:58.522 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode": { 2024-09-19T09:24:58.522 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_enabled": false, 2024-09-19T09:24:58.522 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_bucket_count": 0, 2024-09-19T09:24:58.522 INFO:teuthology.orchestra.run.smithi018.stdout: "degraded_stretch_mode": 0, 2024-09-19T09:24:58.522 INFO:teuthology.orchestra.run.smithi018.stdout: "recovering_stretch_mode": 0, 2024-09-19T09:24:58.522 INFO:teuthology.orchestra.run.smithi018.stdout: "stretch_mode_bucket": 0 2024-09-19T09:24:58.522 INFO:teuthology.orchestra.run.smithi018.stdout: } 2024-09-19T09:24:58.522 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:24:58.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.447+0000 7ff3916dd640 1 -- 172.21.15.18:0/2427519614 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff37806c2b0 msgr2=0x7ff37806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:58.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.447+0000 7ff3916dd640 1 --2- 172.21.15.18:0/2427519614 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff37806c2b0 0x7ff37806e770 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff38c1f82c0 tx=0x7ff380008040 comp rx=0 tx=0).stop 2024-09-19T09:24:58.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.447+0000 7ff3916dd640 1 -- 172.21.15.18:0/2427519614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff38c0723d0 msgr2=0x7ff38c140e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:58.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.447+0000 7ff3916dd640 1 --2- 172.21.15.18:0/2427519614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff38c0723d0 0x7ff38c140e50 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7ff37c02a220 tx=0x7ff37c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:24:58.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.447+0000 7ff3916dd640 1 -- 172.21.15.18:0/2427519614 shutdown_connections 2024-09-19T09:24:58.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.447+0000 7ff3916dd640 1 --2- 172.21.15.18:0/2427519614 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff37806c2b0 0x7ff37806e770 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:58.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.447+0000 7ff3916dd640 1 --2- 172.21.15.18:0/2427519614 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff38c152210 0x7ff38c164bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:58.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.447+0000 7ff3916dd640 1 --2- 172.21.15.18:0/2427519614 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff38c0cf550 0x7ff38c164300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:58.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.447+0000 7ff3916dd640 1 --2- 172.21.15.18:0/2427519614 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff38c0723d0 0x7ff38c140e50 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:58.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.447+0000 7ff3916dd640 1 -- 172.21.15.18:0/2427519614 >> 172.21.15.18:0/2427519614 conn(0x7ff38c06bc10 msgr2=0x7ff38c0715a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:58.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.447+0000 7ff3916dd640 1 -- 172.21.15.18:0/2427519614 shutdown_connections 2024-09-19T09:24:58.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.447+0000 7ff3916dd640 1 -- 172.21.15.18:0/2427519614 wait complete. 2024-09-19T09:24:58.525 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:24:58.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.627+0000 7fda30453640 1 Processor -- start 2024-09-19T09:24:58.628 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.627+0000 7fda30453640 1 -- start start 2024-09-19T09:24:58.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.628+0000 7fda30453640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fda280cfae0 0x7fda280b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:58.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.628+0000 7fda30453640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda280cd1a0 con 0x7fda2815ef80 2024-09-19T09:24:58.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.628+0000 7fda30453640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda2806dc30 con 0x7fda2806d730 2024-09-19T09:24:58.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.628+0000 7fda30453640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fda280cd7d0 con 0x7fda280cfae0 2024-09-19T09:24:58.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.628+0000 7fda2d9ee640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fda280cfae0 0x7fda280b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:58.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.628+0000 7fda2e1ef640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fda2815ef80 0x7fda280cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55512/0 (socket says 172.21.15.18:55512) 2024-09-19T09:24:58.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.628+0000 7fda2d9ee640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fda280cfae0 0x7fda280b5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40234/0 (socket says 172.21.15.18:40234) 2024-09-19T09:24:58.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.628+0000 7fda2e1ef640 1 -- 172.21.15.18:0/1585922493 learned_addr learned my addr 172.21.15.18:0/1585922493 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:24:58.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.628+0000 7fda2d9ee640 1 -- 172.21.15.18:0/1585922493 >> v1:172.21.15.162:6789/0 conn(0x7fda2806d730 legacy=0x7fda280cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:58.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.628+0000 7fda2d9ee640 1 -- 172.21.15.18:0/1585922493 >> v1:172.21.15.18:6789/0 conn(0x7fda2815ef80 legacy=0x7fda280cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:58.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.628+0000 7fda2d1ed640 1 -- 172.21.15.18:0/1585922493 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1636625792 0 0) 0x7fda280cd1a0 con 0x7fda2815ef80 2024-09-19T09:24:58.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.628+0000 7fda2d9ee640 1 -- 172.21.15.18:0/1585922493 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda2806df10 con 0x7fda280cfae0 2024-09-19T09:24:58.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.629+0000 7fda2d9ee640 1 --2- 172.21.15.18:0/1585922493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda280cfae0 0x7fda280b5220 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fda180097a0 tx=0x7fda1802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ba7673f483fece server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:58.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.629+0000 7fda2d1ed640 1 -- 172.21.15.18:0/1585922493 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda18037070 con 0x7fda280cfae0 2024-09-19T09:24:58.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.629+0000 7fda2d1ed640 1 -- 172.21.15.18:0/1585922493 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda18032440 con 0x7fda280cfae0 2024-09-19T09:24:58.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.629+0000 7fda2d1ed640 1 -- 172.21.15.18:0/1585922493 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda18032810 con 0x7fda280cfae0 2024-09-19T09:24:58.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.630+0000 7fda30453640 1 -- 172.21.15.18:0/1585922493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda280cfae0 msgr2=0x7fda280b5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:58.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.630+0000 7fda30453640 1 --2- 172.21.15.18:0/1585922493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda280cfae0 0x7fda280b5220 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fda180097a0 tx=0x7fda1802a230 comp rx=0 tx=0).stop 2024-09-19T09:24:58.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.630+0000 7fda30453640 1 -- 172.21.15.18:0/1585922493 shutdown_connections 2024-09-19T09:24:58.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.630+0000 7fda30453640 1 --2- 172.21.15.18:0/1585922493 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda280cfae0 0x7fda280b5220 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:58.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.630+0000 7fda30453640 1 -- 172.21.15.18:0/1585922493 >> 172.21.15.18:0/1585922493 conn(0x7fda280b4700 msgr2=0x7fda280b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:58.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.630+0000 7fda30453640 1 -- 172.21.15.18:0/1585922493 shutdown_connections 2024-09-19T09:24:58.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.630+0000 7fda30453640 1 -- 172.21.15.18:0/1585922493 wait complete. 2024-09-19T09:24:58.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.631+0000 7fda30453640 1 Processor -- start 2024-09-19T09:24:58.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.631+0000 7fda30453640 1 -- start start 2024-09-19T09:24:58.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.632+0000 7fda30453640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda2806d730 0x7fda281f4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:58.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.632+0000 7fda30453640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda280cfae0 0x7fda280cc280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:58.634 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.632+0000 7fda30453640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda2815ef80 0x7fda280cc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:58.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.632+0000 7fda30453640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fda280d0120 con 0x7fda2806d730 2024-09-19T09:24:58.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.632+0000 7fda30453640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fda2815f360 con 0x7fda280cfae0 2024-09-19T09:24:58.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.632+0000 7fda30453640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fda280ce370 con 0x7fda2815ef80 2024-09-19T09:24:58.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.632+0000 7fda2e1ef640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda2806d730 0x7fda281f4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:58.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.632+0000 7fda2e1ef640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda2806d730 0x7fda281f4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40240/0 (socket says 172.21.15.18:40240) 2024-09-19T09:24:58.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.632+0000 7fda2e1ef640 1 -- 172.21.15.18:0/601071675 learned_addr learned my addr 172.21.15.18:0/601071675 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:58.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.632+0000 7fda2e1ef640 1 -- 172.21.15.18:0/601071675 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda2815ef80 msgr2=0x7fda280cc7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:58.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.632+0000 7fda2e1ef640 1 --2- 172.21.15.18:0/601071675 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda2815ef80 0x7fda280cc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:58.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.632+0000 7fda2e1ef640 1 -- 172.21.15.18:0/601071675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda280cfae0 msgr2=0x7fda280cc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:58.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.632+0000 7fda2e1ef640 1 --2- 172.21.15.18:0/601071675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda280cfae0 0x7fda280cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:58.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.632+0000 7fda2e1ef640 1 -- 172.21.15.18:0/601071675 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda280c8d00 con 0x7fda2806d730 2024-09-19T09:24:58.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.632+0000 7fda2e1ef640 1 --2- 172.21.15.18:0/601071675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda2806d730 0x7fda281f4c10 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fda2400c3f0 tx=0x7fda2400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:58.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.633+0000 7fda1effd640 1 -- 172.21.15.18:0/601071675 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda240074e0 con 0x7fda2806d730 2024-09-19T09:24:58.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.633+0000 7fda1effd640 1 -- 172.21.15.18:0/601071675 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda240047e0 con 0x7fda2806d730 2024-09-19T09:24:58.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.633+0000 7fda30453640 1 -- 172.21.15.18:0/601071675 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda280c8fa0 con 0x7fda2806d730 2024-09-19T09:24:58.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.633+0000 7fda1effd640 1 -- 172.21.15.18:0/601071675 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda24004c50 con 0x7fda2806d730 2024-09-19T09:24:58.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.633+0000 7fda30453640 1 -- 172.21.15.18:0/601071675 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda2814fac0 con 0x7fda2806d730 2024-09-19T09:24:58.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.634+0000 7fda30453640 1 -- 172.21.15.18:0/601071675 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda280cff00 con 0x7fda2806d730 2024-09-19T09:24:58.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.634+0000 7fda1effd640 1 -- 172.21.15.18:0/601071675 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fda24011070 con 0x7fda2806d730 2024-09-19T09:24:58.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.635+0000 7fda1effd640 1 --2- 172.21.15.18:0/601071675 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fda0c06c2b0 0x7fda0c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:58.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.635+0000 7fda1effd640 1 -- 172.21.15.18:0/601071675 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5709+0+0 (secure 0 0 0) 0x7fda2408b020 con 0x7fda2806d730 2024-09-19T09:24:58.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.635+0000 7fda2d9ee640 1 --2- 172.21.15.18:0/601071675 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fda0c06c2b0 0x7fda0c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:58.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.636+0000 7fda2d9ee640 1 --2- 172.21.15.18:0/601071675 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fda0c06c2b0 0x7fda0c06e770 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fda18034000 tx=0x7fda1802c000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:58.640 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.639+0000 7fda1effd640 1 -- 172.21.15.18:0/601071675 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fda2401a2b0 con 0x7fda2806d730 2024-09-19T09:24:58.849 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.849+0000 7fda30453640 1 -- 172.21.15.18:0/601071675 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda280cd1a0 con 0x7fda2806d730 2024-09-19T09:24:58.850 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.849+0000 7fda1effd640 1 -- 172.21.15.18:0/601071675 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+5233 (secure 0 0 0) 0x7fda24059790 con 0x7fda2806d730 2024-09-19T09:24:58.850 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:24:58.850 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":82,"btime":"2024-09-19T09:24:28:275969+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1644566118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1644566118},{"type":"v1","addr":"172.21.15.162:6835","nonce":1644566118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3767901067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3767901067},{"type":"v1","addr":"172.21.15.162:6837","nonce":3767901067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7851,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1160903618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1160903618},{"type":"v1","addr":"172.21.15.18:6834","nonce":1160903618}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:24:25.526108+0000","modified":"2024-09-19T09:24:27.619787+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7854},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7854":{"gid":7854,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2545948137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2545948137},{"type":"v1","addr":"172.21.15.18:6835","nonce":2545948137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7854,"qdb_cluster":[7854]},"id":11}]} 2024-09-19T09:24:58.851 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 82 2024-09-19T09:24:58.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.851+0000 7fda30453640 1 -- 172.21.15.18:0/601071675 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fda0c06c2b0 msgr2=0x7fda0c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:58.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.851+0000 7fda30453640 1 --2- 172.21.15.18:0/601071675 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fda0c06c2b0 0x7fda0c06e770 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fda18034000 tx=0x7fda1802c000 comp rx=0 tx=0).stop 2024-09-19T09:24:58.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.851+0000 7fda30453640 1 -- 172.21.15.18:0/601071675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda2806d730 msgr2=0x7fda281f4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:58.852 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.851+0000 7fda30453640 1 --2- 172.21.15.18:0/601071675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda2806d730 0x7fda281f4c10 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fda2400c3f0 tx=0x7fda2400c8b0 comp rx=0 tx=0).stop 2024-09-19T09:24:58.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.851+0000 7fda30453640 1 -- 172.21.15.18:0/601071675 shutdown_connections 2024-09-19T09:24:58.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.851+0000 7fda30453640 1 --2- 172.21.15.18:0/601071675 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fda0c06c2b0 0x7fda0c06e770 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:58.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.851+0000 7fda30453640 1 --2- 172.21.15.18:0/601071675 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fda2815ef80 0x7fda280cc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:58.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.851+0000 7fda30453640 1 --2- 172.21.15.18:0/601071675 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fda280cfae0 0x7fda280cc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:58.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.851+0000 7fda30453640 1 --2- 172.21.15.18:0/601071675 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fda2806d730 0x7fda281f4c10 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:58.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.851+0000 7fda30453640 1 -- 172.21.15.18:0/601071675 >> 172.21.15.18:0/601071675 conn(0x7fda280b4700 msgr2=0x7fda280b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:58.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.851+0000 7fda30453640 1 -- 172.21.15.18:0/601071675 shutdown_connections 2024-09-19T09:24:58.853 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:58.851+0000 7fda30453640 1 -- 172.21.15.18:0/601071675 wait complete. 2024-09-19T09:24:58.864 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-19T09:24:58.985 INFO:teuthology.orchestra.run.smithi018.stdout:{"cluster_fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","whoami":0,"id":7854,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":32.785959982000001,"mdsmap_epoch":82,"osdmap_epoch":185,"osdmap_epoch_barrier":184,"uptime":37.822000297999999} 2024-09-19T09:24:58.985 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "fec66d7e-50e5-42ed-81de-ad141a2f0f4e", "fs_name": "cephfs", "id": 7854, "mdsmap_epoch": 82, "osdmap_epoch": 185, "osdmap_epoch_barrier": 184, "rank_uptime": 32.785959982, "state": "up:active", "uptime": 37.822000298, "want_state": "up:active", "whoami": 0 } 2024-09-19T09:24:58.986 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-19T09:24:58.986 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:24:58.986 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:24:59.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:24:59.003 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2024-09-19T09:24:59.240 INFO:teuthology.orchestra.run.smithi018.stderr:50+0 records in 2024-09-19T09:24:59.240 INFO:teuthology.orchestra.run.smithi018.stderr:50+0 records out 2024-09-19T09:24:59.240 INFO:teuthology.orchestra.run.smithi018.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.178393 s, 294 MB/s 2024-09-19T09:24:59.241 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-19T09:24:59.241 DEBUG:teuthology.orchestra.run.smithi018:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:24:59.290 DEBUG:teuthology.orchestra.run.smithi162:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-19T09:24:59.333 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-19T09:24:59.334 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:24:59.334 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:24:59.334 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:24:59.350 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:24:59.351 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:24:59.407 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T09:24:59.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.549+0000 7f23c605e640 1 Processor -- start 2024-09-19T09:24:59.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.549+0000 7f23c605e640 1 -- start start 2024-09-19T09:24:59.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.550+0000 7f23c605e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f23c00b7270 0x7f23c00b6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:59.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.550+0000 7f23c605e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23c00cc7f0 0x7f23c00ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:59.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.550+0000 7f23c605e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23c00b7890 con 0x7f23c006d730 2024-09-19T09:24:59.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.550+0000 7f23c605e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f23c00b7b70 con 0x7f23c00b7270 2024-09-19T09:24:59.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.550+0000 7f23c605e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f23c00cbd10 con 0x7f23c00cc7f0 2024-09-19T09:24:59.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.550+0000 7f23beffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f23c00b7270 0x7f23c00b6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:59.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.550+0000 7f23beffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f23c00b7270 0x7f23c00b6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40244/0 (socket says 172.21.15.18:40244) 2024-09-19T09:24:59.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.550+0000 7f23beffd640 1 -- 172.21.15.18:0/2845352688 learned_addr learned my addr 172.21.15.18:0/2845352688 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:59.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.550+0000 7f23bffff640 1 --2- 172.21.15.18:0/2845352688 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23c00cc7f0 0x7f23c00ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:59.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.550+0000 7f23beffd640 1 -- 172.21.15.18:0/2845352688 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23c00cc7f0 msgr2=0x7f23c00ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:24:59.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.550+0000 7f23beffd640 1 --2- 172.21.15.18:0/2845352688 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23c00cc7f0 0x7f23c00ccc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:59.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.550+0000 7f23beffd640 1 -- 172.21.15.18:0/2845352688 >> v1:172.21.15.162:6789/0 conn(0x7f23c006d730 legacy=0x7f23c006db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:59.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.550+0000 7f23beffd640 1 -- 172.21.15.18:0/2845352688 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c00cbff0 con 0x7f23c00b7270 2024-09-19T09:24:59.552 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.550+0000 7f23bffff640 1 --2- 172.21.15.18:0/2845352688 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23c00cc7f0 0x7f23c00ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:24:59.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.551+0000 7f23beffd640 1 --2- 172.21.15.18:0/2845352688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23c00b7270 0x7f23c00b6290 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f23b40098a0 tx=0x7f23b402a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8527bb5dd296367 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:59.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.551+0000 7f23be7fc640 1 -- 172.21.15.18:0/2845352688 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4037070 con 0x7f23c00b7270 2024-09-19T09:24:59.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.551+0000 7f23be7fc640 1 -- 172.21.15.18:0/2845352688 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b4032440 con 0x7f23c00b7270 2024-09-19T09:24:59.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.551+0000 7f23be7fc640 1 -- 172.21.15.18:0/2845352688 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b4032810 con 0x7f23c00b7270 2024-09-19T09:24:59.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.552+0000 7f23c605e640 1 -- 172.21.15.18:0/2845352688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23c00b7270 msgr2=0x7f23c00b6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:59.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.552+0000 7f23c605e640 1 --2- 172.21.15.18:0/2845352688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23c00b7270 0x7f23c00b6290 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f23b40098a0 tx=0x7f23b402a290 comp rx=0 tx=0).stop 2024-09-19T09:24:59.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.552+0000 7f23c605e640 1 -- 172.21.15.18:0/2845352688 shutdown_connections 2024-09-19T09:24:59.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.552+0000 7f23c605e640 1 --2- 172.21.15.18:0/2845352688 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23c00cc7f0 0x7f23c00ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:59.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.552+0000 7f23c605e640 1 --2- 172.21.15.18:0/2845352688 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23c00b7270 0x7f23c00b6290 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:59.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.552+0000 7f23c605e640 1 -- 172.21.15.18:0/2845352688 >> 172.21.15.18:0/2845352688 conn(0x7f23c00b7e10 msgr2=0x7f23c00b8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:59.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.552+0000 7f23c605e640 1 -- 172.21.15.18:0/2845352688 shutdown_connections 2024-09-19T09:24:59.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.552+0000 7f23c605e640 1 -- 172.21.15.18:0/2845352688 wait complete. 2024-09-19T09:24:59.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.553+0000 7f23c605e640 1 Processor -- start 2024-09-19T09:24:59.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.553+0000 7f23c605e640 1 -- start start 2024-09-19T09:24:59.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.554+0000 7f23c605e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23c006d730 0x7f23c0157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:59.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.554+0000 7f23c605e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23c00b7270 0x7f23c0160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:59.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.554+0000 7f23c605e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23c00cc7f0 0x7f23c015a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:59.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.554+0000 7f23c605e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f23c015efe0 con 0x7f23c00cc7f0 2024-09-19T09:24:59.557 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.554+0000 7f23c605e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f23c00b4310 con 0x7f23c006d730 2024-09-19T09:24:59.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.554+0000 7f23c605e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f23c00cd1c0 con 0x7f23c00b7270 2024-09-19T09:24:59.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.554+0000 7f23bffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23c00cc7f0 0x7f23c015a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:59.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.554+0000 7f23bffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23c00cc7f0 0x7f23c015a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40254/0 (socket says 172.21.15.18:40254) 2024-09-19T09:24:59.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.554+0000 7f23bffff640 1 -- 172.21.15.18:0/40137835 learned_addr learned my addr 172.21.15.18:0/40137835 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:24:59.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.554+0000 7f23beffd640 1 --2- 172.21.15.18:0/40137835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23c00b7270 0x7f23c0160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:59.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.554+0000 7f23bf7fe640 1 --2- 172.21.15.18:0/40137835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23c006d730 0x7f23c0157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:59.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.555+0000 7f23bffff640 1 -- 172.21.15.18:0/40137835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23c00b7270 msgr2=0x7f23c0160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:59.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.555+0000 7f23bffff640 1 --2- 172.21.15.18:0/40137835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23c00b7270 0x7f23c0160ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:59.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.555+0000 7f23bffff640 1 -- 172.21.15.18:0/40137835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23c006d730 msgr2=0x7f23c0157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:59.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.555+0000 7f23bffff640 1 --2- 172.21.15.18:0/40137835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23c006d730 0x7f23c0157ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:59.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.555+0000 7f23bffff640 1 -- 172.21.15.18:0/40137835 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23c0161420 con 0x7f23c00cc7f0 2024-09-19T09:24:59.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.555+0000 7f23bffff640 1 --2- 172.21.15.18:0/40137835 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23c00cc7f0 0x7f23c015a4c0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f23b8007df0 tx=0x7f23b800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:59.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.555+0000 7f23a7fff640 1 -- 172.21.15.18:0/40137835 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b801a070 con 0x7f23c00cc7f0 2024-09-19T09:24:59.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.555+0000 7f23a7fff640 1 -- 172.21.15.18:0/40137835 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23b8003990 con 0x7f23c00cc7f0 2024-09-19T09:24:59.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.555+0000 7f23a7fff640 1 -- 172.21.15.18:0/40137835 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23b8003d80 con 0x7f23c00cc7f0 2024-09-19T09:24:59.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.555+0000 7f23c605e640 1 -- 172.21.15.18:0/40137835 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23c01616c0 con 0x7f23c00cc7f0 2024-09-19T09:24:59.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.555+0000 7f23c605e640 1 -- 172.21.15.18:0/40137835 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23c0161c80 con 0x7f23c00cc7f0 2024-09-19T09:24:59.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.556+0000 7f23c605e640 1 -- 172.21.15.18:0/40137835 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23c0073970 con 0x7f23c00cc7f0 2024-09-19T09:24:59.559 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.556+0000 7f23a7fff640 1 -- 172.21.15.18:0/40137835 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f23b801d070 con 0x7f23c00cc7f0 2024-09-19T09:24:59.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.557+0000 7f23a7fff640 1 --2- 172.21.15.18:0/40137835 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f23ac06c2b0 0x7f23ac06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:24:59.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.557+0000 7f23a7fff640 1 -- 172.21.15.18:0/40137835 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5709+0+0 (secure 0 0 0) 0x7f23b808b580 con 0x7f23c00cc7f0 2024-09-19T09:24:59.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.557+0000 7f23bf7fe640 1 --2- 172.21.15.18:0/40137835 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f23ac06c2b0 0x7f23ac06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:24:59.560 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.558+0000 7f23bf7fe640 1 --2- 172.21.15.18:0/40137835 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f23ac06c2b0 0x7f23ac06e770 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f23b0001780 tx=0x7f23b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:24:59.562 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.561+0000 7f23a7fff640 1 -- 172.21.15.18:0/40137835 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f23b8010070 con 0x7f23c00cc7f0 2024-09-19T09:24:59.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.753+0000 7f23c605e640 1 -- 172.21.15.18:0/40137835 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f23c006dcb0 con 0x7f23c00cc7f0 2024-09-19T09:24:59.754 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.753+0000 7f23a7fff640 1 -- 172.21.15.18:0/40137835 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v185) ==== 80+0+0 (secure 0 0 0) 0x7f23b8059730 con 0x7f23c00cc7f0 2024-09-19T09:24:59.754 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-09-19T09:24:59.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.755+0000 7f23c605e640 1 -- 172.21.15.18:0/40137835 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f23ac06c2b0 msgr2=0x7f23ac06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:59.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.755+0000 7f23c605e640 1 --2- 172.21.15.18:0/40137835 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f23ac06c2b0 0x7f23ac06e770 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f23b0001780 tx=0x7f23b0009040 comp rx=0 tx=0).stop 2024-09-19T09:24:59.756 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.755+0000 7f23c605e640 1 -- 172.21.15.18:0/40137835 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23c00cc7f0 msgr2=0x7f23c015a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:24:59.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.755+0000 7f23c605e640 1 --2- 172.21.15.18:0/40137835 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23c00cc7f0 0x7f23c015a4c0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f23b8007df0 tx=0x7f23b800d4a0 comp rx=0 tx=0).stop 2024-09-19T09:24:59.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.755+0000 7f23c605e640 1 -- 172.21.15.18:0/40137835 shutdown_connections 2024-09-19T09:24:59.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.755+0000 7f23c605e640 1 --2- 172.21.15.18:0/40137835 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f23ac06c2b0 0x7f23ac06e770 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:59.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.755+0000 7f23c605e640 1 --2- 172.21.15.18:0/40137835 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f23c00cc7f0 0x7f23c015a4c0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:59.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.755+0000 7f23c605e640 1 --2- 172.21.15.18:0/40137835 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f23c00b7270 0x7f23c0160ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:59.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.755+0000 7f23c605e640 1 --2- 172.21.15.18:0/40137835 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f23c006d730 0x7f23c0157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:24:59.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.755+0000 7f23c605e640 1 -- 172.21.15.18:0/40137835 >> 172.21.15.18:0/40137835 conn(0x7f23c00b7e10 msgr2=0x7f23c0070520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:24:59.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.755+0000 7f23c605e640 1 -- 172.21.15.18:0/40137835 shutdown_connections 2024-09-19T09:24:59.757 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:24:59.755+0000 7f23c605e640 1 -- 172.21.15.18:0/40137835 wait complete. 2024-09-19T09:24:59.767 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T09:24:59.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:24:59.767 DEBUG:teuthology.orchestra.run.smithi018:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-19T09:24:59.816 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T09:24:59.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:24:59.817 DEBUG:teuthology.orchestra.run.smithi018:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T09:24:59.839 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:24:59.839 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:24:59.839 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:24:59.856 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:24:59.856 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:24:59.913 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-19T09:25:00.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.016+0000 7fee5c998640 1 Processor -- start 2024-09-19T09:25:00.017 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.016+0000 7fee5c998640 1 -- start start 2024-09-19T09:25:00.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.017+0000 7fee5c998640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee5815db60 0x7fee58071f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:00.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.017+0000 7fee5c998640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee58153e50 con 0x7fee5806e750 2024-09-19T09:25:00.022 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.017+0000 7fee5c998640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee58072ac0 con 0x7fee580724d0 2024-09-19T09:25:00.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.017+0000 7fee5c998640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fee5815df40 con 0x7fee5815db60 2024-09-19T09:25:00.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.017+0000 7fee56d9d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fee5806e750 0x7fee580ce8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55518/0 (socket says 172.21.15.18:55518) 2024-09-19T09:25:00.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.017+0000 7fee56d9d640 1 -- 172.21.15.18:0/1675926051 learned_addr learned my addr 172.21.15.18:0/1675926051 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:25:00.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.018+0000 7fee5559a640 1 -- 172.21.15.18:0/1675926051 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3399556929 0 0) 0x7fee58153e50 con 0x7fee5806e750 2024-09-19T09:25:00.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.018+0000 7fee5659c640 1 --2- 172.21.15.18:0/1675926051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee5815db60 0x7fee58071f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:00.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.018+0000 7fee5559a640 1 -- 172.21.15.18:0/1675926051 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fee44003520 con 0x7fee5806e750 2024-09-19T09:25:00.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.018+0000 7fee5559a640 1 -- 172.21.15.18:0/1675926051 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2182679435 0 0) 0x7fee44003520 con 0x7fee5806e750 2024-09-19T09:25:00.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.018+0000 7fee5559a640 1 -- 172.21.15.18:0/1675926051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee5815db60 msgr2=0x7fee58071f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:00.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.018+0000 7fee5559a640 1 --2- 172.21.15.18:0/1675926051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee5815db60 0x7fee58071f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:00.023 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.018+0000 7fee5559a640 1 -- 172.21.15.18:0/1675926051 >> v1:172.21.15.162:6789/0 conn(0x7fee580724d0 legacy=0x7fee5806e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:00.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.018+0000 7fee5559a640 1 -- 172.21.15.18:0/1675926051 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee58072da0 con 0x7fee5806e750 2024-09-19T09:25:00.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.018+0000 7fee5559a640 1 -- 172.21.15.18:0/1675926051 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fee50001670 con 0x7fee5806e750 2024-09-19T09:25:00.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.018+0000 7fee5559a640 1 -- 172.21.15.18:0/1675926051 >> v1:172.21.15.18:6789/0 conn(0x7fee5806e750 legacy=0x7fee580ce8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:00.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.018+0000 7fee5559a640 1 --2- 172.21.15.18:0/1675926051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee5815db60 0x7fee440039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:00.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.018+0000 7fee5559a640 1 --2- 172.21.15.18:0/1675926051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee44003fb0 0x7fee44004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:00.024 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.018+0000 7fee5559a640 1 --2- 172.21.15.18:0/1675926051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee44004d40 0x7fee440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:00.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.018+0000 7fee5559a640 1 -- 172.21.15.18:0/1675926051 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fee5815df40 con 0x7fee44003fb0 2024-09-19T09:25:00.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.018+0000 7fee5559a640 1 -- 172.21.15.18:0/1675926051 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fee4400bb00 con 0x7fee44004d40 2024-09-19T09:25:00.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.018+0000 7fee5559a640 1 -- 172.21.15.18:0/1675926051 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fee4400bd00 con 0x7fee5815db60 2024-09-19T09:25:00.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.018+0000 7fee55d9b640 1 --2- 172.21.15.18:0/1675926051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee44003fb0 0x7fee44004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:00.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.018+0000 7fee5659c640 1 --2- 172.21.15.18:0/1675926051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee5815db60 0x7fee440039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:00.025 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.018+0000 7fee56d9d640 1 --2- 172.21.15.18:0/1675926051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee44004d40 0x7fee440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:00.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.018+0000 7fee55d9b640 1 -- 172.21.15.18:0/1675926051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee5815db60 msgr2=0x7fee440039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:00.026 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.018+0000 7fee55d9b640 1 --2- 172.21.15.18:0/1675926051 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee5815db60 0x7fee440039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:00.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.018+0000 7fee55d9b640 1 -- 172.21.15.18:0/1675926051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee44004d40 msgr2=0x7fee440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.018+0000 7fee55d9b640 1 --2- 172.21.15.18:0/1675926051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee44004d40 0x7fee440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.018+0000 7fee55d9b640 1 -- 172.21.15.18:0/1675926051 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee44003520 con 0x7fee44003fb0 2024-09-19T09:25:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.019+0000 7fee55d9b640 1 --2- 172.21.15.18:0/1675926051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee44003fb0 0x7fee44004800 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fee40001750 tx=0x7fee44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c1b626763472ff7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.019+0000 7fee5559a640 1 -- 172.21.15.18:0/1675926051 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40001370 con 0x7fee44003fb0 2024-09-19T09:25:00.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.019+0000 7fee5559a640 1 -- 172.21.15.18:0/1675926051 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee400052d0 con 0x7fee44003fb0 2024-09-19T09:25:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.019+0000 7fee5559a640 1 -- 172.21.15.18:0/1675926051 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4002ab20 con 0x7fee44003fb0 2024-09-19T09:25:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.020+0000 7fee5c998640 1 -- 172.21.15.18:0/1675926051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee44003fb0 msgr2=0x7fee44004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.020+0000 7fee5c998640 1 --2- 172.21.15.18:0/1675926051 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee44003fb0 0x7fee44004800 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fee40001750 tx=0x7fee44005830 comp rx=0 tx=0).stop 2024-09-19T09:25:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.020+0000 7fee56d9d640 1 -- 172.21.15.18:0/1675926051 reap_dead start 2024-09-19T09:25:00.029 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.020+0000 7fee5c998640 1 -- 172.21.15.18:0/1675926051 shutdown_connections 2024-09-19T09:25:00.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.020+0000 7fee5c998640 1 -- 172.21.15.18:0/1675926051 >> 172.21.15.18:0/1675926051 conn(0x7fee580b2630 msgr2=0x7fee580b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:00.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.020+0000 7fee5c998640 1 -- 172.21.15.18:0/1675926051 shutdown_connections 2024-09-19T09:25:00.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.020+0000 7fee5c998640 1 -- 172.21.15.18:0/1675926051 wait complete. 2024-09-19T09:25:00.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.021+0000 7fee5c998640 1 Processor -- start 2024-09-19T09:25:00.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.021+0000 7fee5c998640 1 -- start start 2024-09-19T09:25:00.033 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.022+0000 7fee5c998640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee44003fb0 0x7fee58153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.022+0000 7fee5c998640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee580ae800 0x7fee580aec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.022+0000 7fee5c998640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee581e8530 0x7fee581e89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.022+0000 7fee5c998640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fee58073640 con 0x7fee580ae800 2024-09-19T09:25:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.022+0000 7fee5c998640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fee58073360 con 0x7fee581e8530 2024-09-19T09:25:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.022+0000 7fee5c998640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fee5815d1c0 con 0x7fee44003fb0 2024-09-19T09:25:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.022+0000 7fee55d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee580ae800 0x7fee580aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.022+0000 7fee55d9b640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee580ae800 0x7fee580aec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40276/0 (socket says 172.21.15.18:40276) 2024-09-19T09:25:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.022+0000 7fee55d9b640 1 -- 172.21.15.18:0/2640747865 learned_addr learned my addr 172.21.15.18:0/2640747865 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.022+0000 7fee5659c640 1 --2- 172.21.15.18:0/2640747865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee44003fb0 0x7fee58153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.022+0000 7fee56d9d640 1 --2- 172.21.15.18:0/2640747865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee581e8530 0x7fee581e89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.023+0000 7fee55d9b640 1 -- 172.21.15.18:0/2640747865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee44003fb0 msgr2=0x7fee58153090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.023+0000 7fee55d9b640 1 --2- 172.21.15.18:0/2640747865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee44003fb0 0x7fee58153090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:00.034 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.023+0000 7fee55d9b640 1 -- 172.21.15.18:0/2640747865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee581e8530 msgr2=0x7fee581e89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:00.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.023+0000 7fee55d9b640 1 --2- 172.21.15.18:0/2640747865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee581e8530 0x7fee581e89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:00.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.023+0000 7fee55d9b640 1 -- 172.21.15.18:0/2640747865 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee580af2a0 con 0x7fee580ae800 2024-09-19T09:25:00.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.023+0000 7fee55d9b640 1 --2- 172.21.15.18:0/2640747865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee580ae800 0x7fee580aec80 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fee40000c00 tx=0x7fee40001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:00.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.023+0000 7fee4effd640 1 -- 172.21.15.18:0/2640747865 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40042070 con 0x7fee580ae800 2024-09-19T09:25:00.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.023+0000 7fee4effd640 1 -- 172.21.15.18:0/2640747865 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee40005480 con 0x7fee580ae800 2024-09-19T09:25:00.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.023+0000 7fee5c998640 1 -- 172.21.15.18:0/2640747865 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee580af580 con 0x7fee580ae800 2024-09-19T09:25:00.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.023+0000 7fee4effd640 1 -- 172.21.15.18:0/2640747865 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40037040 con 0x7fee580ae800 2024-09-19T09:25:00.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.023+0000 7fee5c998640 1 -- 172.21.15.18:0/2640747865 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee580afb40 con 0x7fee580ae800 2024-09-19T09:25:00.035 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.024+0000 7fee5c998640 1 -- 172.21.15.18:0/2640747865 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee5815cfe0 con 0x7fee580ae800 2024-09-19T09:25:00.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.025+0000 7fee4effd640 1 -- 172.21.15.18:0/2640747865 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fee40045070 con 0x7fee580ae800 2024-09-19T09:25:00.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.025+0000 7fee4effd640 1 --2- 172.21.15.18:0/2640747865 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fee3806c2b0 0x7fee3806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:00.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.025+0000 7fee4effd640 1 -- 172.21.15.18:0/2640747865 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5709+0+0 (secure 0 0 0) 0x7fee400aabe0 con 0x7fee580ae800 2024-09-19T09:25:00.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.025+0000 7fee5659c640 1 --2- 172.21.15.18:0/2640747865 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fee3806c2b0 0x7fee3806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:00.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.026+0000 7fee5659c640 1 --2- 172.21.15.18:0/2640747865 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fee3806c2b0 0x7fee3806e770 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fee48014510 tx=0x7fee4800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:00.036 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.029+0000 7fee4effd640 1 -- 172.21.15.18:0/2640747865 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fee5815cfe0 con 0x7fee580ae800 2024-09-19T09:25:00.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.217+0000 7fee5c998640 1 -- 172.21.15.18:0/2640747865 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fee58071f90 con 0x7fee580ae800 2024-09-19T09:25:00.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.218+0000 7fee4effd640 1 -- 172.21.15.18:0/2640747865 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v185) ==== 80+0+0 (secure 0 0 0) 0x7fee40078c70 con 0x7fee580ae800 2024-09-19T09:25:00.219 INFO:teuthology.orchestra.run.smithi018.stderr:listed 0 entries 2024-09-19T09:25:00.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.220+0000 7fee5c998640 1 -- 172.21.15.18:0/2640747865 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fee3806c2b0 msgr2=0x7fee3806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:00.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.220+0000 7fee5c998640 1 --2- 172.21.15.18:0/2640747865 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fee3806c2b0 0x7fee3806e770 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fee48014510 tx=0x7fee4800b040 comp rx=0 tx=0).stop 2024-09-19T09:25:00.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.220+0000 7fee5c998640 1 -- 172.21.15.18:0/2640747865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee580ae800 msgr2=0x7fee580aec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:00.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.220+0000 7fee5c998640 1 --2- 172.21.15.18:0/2640747865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee580ae800 0x7fee580aec80 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fee40000c00 tx=0x7fee40001120 comp rx=0 tx=0).stop 2024-09-19T09:25:00.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.220+0000 7fee5c998640 1 -- 172.21.15.18:0/2640747865 shutdown_connections 2024-09-19T09:25:00.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.220+0000 7fee5c998640 1 --2- 172.21.15.18:0/2640747865 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fee3806c2b0 0x7fee3806e770 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:00.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.220+0000 7fee5c998640 1 --2- 172.21.15.18:0/2640747865 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fee581e8530 0x7fee581e89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:00.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.220+0000 7fee5c998640 1 --2- 172.21.15.18:0/2640747865 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fee580ae800 0x7fee580aec80 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:00.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.220+0000 7fee5c998640 1 --2- 172.21.15.18:0/2640747865 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fee44003fb0 0x7fee58153090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:00.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.220+0000 7fee5c998640 1 -- 172.21.15.18:0/2640747865 >> 172.21.15.18:0/2640747865 conn(0x7fee580b2630 msgr2=0x7fee580b2a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:00.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.220+0000 7fee5c998640 1 -- 172.21.15.18:0/2640747865 shutdown_connections 2024-09-19T09:25:00.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.220+0000 7fee5c998640 1 -- 172.21.15.18:0/2640747865 wait complete. 2024-09-19T09:25:00.232 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-19T09:25:00.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:25:00.233 DEBUG:teuthology.orchestra.run.smithi162:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-19T09:25:00.260 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-09-19T09:25:00.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:25:00.261 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-19T09:25:00.317 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:25:00.317 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:25:00.317 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:25:00.333 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17075 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T09:25:00.334 INFO:tasks.cephfs.mount:Terminating background process 2024-09-19T09:25:00.334 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:25:00.334 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:25:00.373 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3252 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T09:25:00.373 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:25:00.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.475+0000 7f81afef1640 1 Processor -- start 2024-09-19T09:25:00.476 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.475+0000 7f81afef1640 1 -- start start 2024-09-19T09:25:00.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.476+0000 7f81afef1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81a80d10a0 0x7f81a80d1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:00.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.476+0000 7f81afef1640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f81a80ce7b0 0x7f81a8067950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:00.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.476+0000 7f81afef1640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81a80cd710 con 0x7f81a815cd60 2024-09-19T09:25:00.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.476+0000 7f81afef1640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f81a80b1f20 con 0x7f81a80ce7b0 2024-09-19T09:25:00.479 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.476+0000 7f81afef1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f81a80cd9f0 con 0x7f81a80d10a0 2024-09-19T09:25:00.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.476+0000 7f81ad48c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f81a815cd60 0x7f81a80d1480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55532/0 (socket says 172.21.15.18:55532) 2024-09-19T09:25:00.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.476+0000 7f81ad48c640 1 -- 172.21.15.18:0/1205681113 learned_addr learned my addr 172.21.15.18:0/1205681113 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:25:00.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.476+0000 7f81acc8b640 1 -- 172.21.15.18:0/1205681113 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3990388476 0 0) 0x7f81a80cd710 con 0x7f81a815cd60 2024-09-19T09:25:00.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.476+0000 7f81ae48e640 1 --2- 172.21.15.18:0/1205681113 >> v2:172.21.15.162:3300/0 conn(0x7f81a80ce7b0 0x7f81a8067950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:00.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.476+0000 7f81adc8d640 1 --2- 172.21.15.18:0/1205681113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81a80d10a0 0x7f81a80d1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:00.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.476+0000 7f81acc8b640 1 -- 172.21.15.18:0/1205681113 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8194003520 con 0x7f81a815cd60 2024-09-19T09:25:00.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.476+0000 7f81acc8b640 1 -- 172.21.15.18:0/1205681113 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 693938337 0 0) 0x7f8194003520 con 0x7f81a815cd60 2024-09-19T09:25:00.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.476+0000 7f81acc8b640 1 -- 172.21.15.18:0/1205681113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81a80d10a0 msgr2=0x7f81a80d1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:00.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.476+0000 7f81acc8b640 1 --2- 172.21.15.18:0/1205681113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81a80d10a0 0x7f81a80d1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:00.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.476+0000 7f81acc8b640 1 -- 172.21.15.18:0/1205681113 >> v2:172.21.15.162:3300/0 conn(0x7f81a80ce7b0 msgr2=0x7f81a8067950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:00.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.476+0000 7f81acc8b640 1 --2- 172.21.15.18:0/1205681113 >> v2:172.21.15.162:3300/0 conn(0x7f81a80ce7b0 0x7f81a8067950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:00.480 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.476+0000 7f81acc8b640 1 -- 172.21.15.18:0/1205681113 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81a80cdcd0 con 0x7f81a815cd60 2024-09-19T09:25:00.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.476+0000 7f81acc8b640 1 -- 172.21.15.18:0/1205681113 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f8198001670 con 0x7f81a815cd60 2024-09-19T09:25:00.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.476+0000 7f81acc8b640 1 -- 172.21.15.18:0/1205681113 >> v1:172.21.15.18:6789/0 conn(0x7f81a815cd60 legacy=0x7f81a80d1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:00.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.476+0000 7f81acc8b640 1 --2- 172.21.15.18:0/1205681113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81940039b0 0x7f8194003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:00.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.476+0000 7f81acc8b640 1 --2- 172.21.15.18:0/1205681113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8194004800 0x7f8194004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:00.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.476+0000 7f81acc8b640 1 --2- 172.21.15.18:0/1205681113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81a80d10a0 0x7f81940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:00.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.476+0000 7f81acc8b640 1 -- 172.21.15.18:0/1205681113 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f81a80b1f20 con 0x7f8194004800 2024-09-19T09:25:00.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.477+0000 7f81acc8b640 1 -- 172.21.15.18:0/1205681113 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f81a80cd9f0 con 0x7f81940039b0 2024-09-19T09:25:00.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.477+0000 7f81acc8b640 1 -- 172.21.15.18:0/1205681113 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f819400b9c0 con 0x7f81a80d10a0 2024-09-19T09:25:00.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.477+0000 7f81ad48c640 1 --2- 172.21.15.18:0/1205681113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8194004800 0x7f8194004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:00.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.477+0000 7f81adc8d640 1 --2- 172.21.15.18:0/1205681113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81940039b0 0x7f8194003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:00.481 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.477+0000 7f81ae48e640 1 --2- 172.21.15.18:0/1205681113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81a80d10a0 0x7f81940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:00.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.477+0000 7f81adc8d640 1 -- 172.21.15.18:0/1205681113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81a80d10a0 msgr2=0x7f81940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:00.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.477+0000 7f81adc8d640 1 --2- 172.21.15.18:0/1205681113 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81a80d10a0 0x7f81940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:00.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.477+0000 7f81adc8d640 1 -- 172.21.15.18:0/1205681113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8194004800 msgr2=0x7f8194004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:00.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.477+0000 7f81adc8d640 1 --2- 172.21.15.18:0/1205681113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8194004800 0x7f8194004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:00.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.477+0000 7f81adc8d640 1 -- 172.21.15.18:0/1205681113 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8194003520 con 0x7f81940039b0 2024-09-19T09:25:00.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.477+0000 7f81ad48c640 1 --2- 172.21.15.18:0/1205681113 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8194004800 0x7f8194004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:25:00.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.478+0000 7f81adc8d640 1 --2- 172.21.15.18:0/1205681113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81940039b0 0x7f8194003dd0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f81a4009ac0 tx=0x7f8194005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29377e4ccfac5530 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:00.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.478+0000 7f81acc8b640 1 -- 172.21.15.18:0/1205681113 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a4036070 con 0x7f81940039b0 2024-09-19T09:25:00.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.478+0000 7f81acc8b640 1 -- 172.21.15.18:0/1205681113 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81a4031400 con 0x7f81940039b0 2024-09-19T09:25:00.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.478+0000 7f81acc8b640 1 -- 172.21.15.18:0/1205681113 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a4009690 con 0x7f81940039b0 2024-09-19T09:25:00.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.478+0000 7f81afef1640 1 -- 172.21.15.18:0/1205681113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81940039b0 msgr2=0x7f8194003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:00.482 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.478+0000 7f81afef1640 1 --2- 172.21.15.18:0/1205681113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81940039b0 0x7f8194003dd0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f81a4009ac0 tx=0x7f8194005830 comp rx=0 tx=0).stop 2024-09-19T09:25:00.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.478+0000 7f81ae48e640 1 -- 172.21.15.18:0/1205681113 reap_dead start 2024-09-19T09:25:00.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.478+0000 7f81afef1640 1 -- 172.21.15.18:0/1205681113 shutdown_connections 2024-09-19T09:25:00.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.478+0000 7f81afef1640 1 -- 172.21.15.18:0/1205681113 >> 172.21.15.18:0/1205681113 conn(0x7f81a80731b0 msgr2=0x7f81a80735c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:00.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.478+0000 7f81afef1640 1 -- 172.21.15.18:0/1205681113 shutdown_connections 2024-09-19T09:25:00.483 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.478+0000 7f81afef1640 1 -- 172.21.15.18:0/1205681113 wait complete. 2024-09-19T09:25:00.485 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.480+0000 7f81afef1640 1 Processor -- start 2024-09-19T09:25:00.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.480+0000 7f81afef1640 1 -- start start 2024-09-19T09:25:00.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.480+0000 7f81afef1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81940039b0 0x7f81a81f5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:00.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.480+0000 7f81afef1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81a81f2b80 0x7f81a815db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:00.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.480+0000 7f81afef1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81a815e090 0x7f81a80af730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:00.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.480+0000 7f81afef1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f81a8067e90 con 0x7f81a81f2b80 2024-09-19T09:25:00.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.480+0000 7f81afef1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f81a80ce290 con 0x7f81940039b0 2024-09-19T09:25:00.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.480+0000 7f81afef1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f81a80d1d20 con 0x7f81a815e090 2024-09-19T09:25:00.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.480+0000 7f81ad48c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81a81f2b80 0x7f81a815db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:00.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.481+0000 7f81adc8d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81940039b0 0x7f81a81f5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:00.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.481+0000 7f81ad48c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81a81f2b80 0x7f81a815db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40284/0 (socket says 172.21.15.18:40284) 2024-09-19T09:25:00.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.481+0000 7f81ad48c640 1 -- 172.21.15.18:0/589176651 learned_addr learned my addr 172.21.15.18:0/589176651 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:00.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.481+0000 7f81ae48e640 1 --2- 172.21.15.18:0/589176651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81a815e090 0x7f81a80af730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:00.486 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.481+0000 7f81ad48c640 1 -- 172.21.15.18:0/589176651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81a815e090 msgr2=0x7f81a80af730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:00.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.481+0000 7f81ad48c640 1 --2- 172.21.15.18:0/589176651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81a815e090 0x7f81a80af730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:00.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.481+0000 7f81ad48c640 1 -- 172.21.15.18:0/589176651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81940039b0 msgr2=0x7f81a81f5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:00.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.481+0000 7f81ad48c640 1 --2- 172.21.15.18:0/589176651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81940039b0 0x7f81a81f5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:00.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.481+0000 7f81ad48c640 1 -- 172.21.15.18:0/589176651 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81a8150f90 con 0x7f81a81f2b80 2024-09-19T09:25:00.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.481+0000 7f81ad48c640 1 --2- 172.21.15.18:0/589176651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81a81f2b80 0x7f81a815db50 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f8198007fd0 tx=0x7f8198007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:00.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.481+0000 7f819e7fc640 1 -- 172.21.15.18:0/589176651 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819800fb40 con 0x7f81a81f2b80 2024-09-19T09:25:00.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.481+0000 7f819e7fc640 1 -- 172.21.15.18:0/589176651 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8198018070 con 0x7f81a81f2b80 2024-09-19T09:25:00.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.481+0000 7f81afef1640 1 -- 172.21.15.18:0/589176651 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81a8151270 con 0x7f81a81f2b80 2024-09-19T09:25:00.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.481+0000 7f819e7fc640 1 -- 172.21.15.18:0/589176651 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81980133f0 con 0x7f81a81f2b80 2024-09-19T09:25:00.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.481+0000 7f81afef1640 1 -- 172.21.15.18:0/589176651 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81a8151830 con 0x7f81a81f2b80 2024-09-19T09:25:00.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.482+0000 7f81afef1640 1 -- 172.21.15.18:0/589176651 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81a8067950 con 0x7f81a81f2b80 2024-09-19T09:25:00.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.483+0000 7f819e7fc640 1 -- 172.21.15.18:0/589176651 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8198013590 con 0x7f81a81f2b80 2024-09-19T09:25:00.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.483+0000 7f819e7fc640 1 --2- 172.21.15.18:0/589176651 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f818c06c2b0 0x7f818c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:00.487 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.483+0000 7f819e7fc640 1 -- 172.21.15.18:0/589176651 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5709+0+0 (secure 0 0 0) 0x7f819808b500 con 0x7f81a81f2b80 2024-09-19T09:25:00.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.484+0000 7f81adc8d640 1 --2- 172.21.15.18:0/589176651 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f818c06c2b0 0x7f818c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:00.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.484+0000 7f81adc8d640 1 --2- 172.21.15.18:0/589176651 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f818c06c2b0 0x7f818c06e770 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f81a4033000 tx=0x7f81a4008030 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:00.488 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.488+0000 7f819e7fc640 1 -- 172.21.15.18:0/589176651 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f81980596b0 con 0x7f81a81f2b80 2024-09-19T09:25:00.703 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.702+0000 7f81afef1640 1 -- 172.21.15.18:0/589176651 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81a8160430 con 0x7f81a81f2b80 2024-09-19T09:25:00.704 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.703+0000 7f819e7fc640 1 -- 172.21.15.18:0/589176651 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+5233 (secure 0 0 0) 0x7f819805d9b0 con 0x7f81a81f2b80 2024-09-19T09:25:00.704 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:25:00.704 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":82,"btime":"2024-09-19T09:24:28:275969+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1644566118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1644566118},{"type":"v1","addr":"172.21.15.162:6835","nonce":1644566118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3767901067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3767901067},{"type":"v1","addr":"172.21.15.162:6837","nonce":3767901067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7851,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1160903618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1160903618},{"type":"v1","addr":"172.21.15.18:6834","nonce":1160903618}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:24:25.526108+0000","modified":"2024-09-19T09:24:27.619787+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7854},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7854":{"gid":7854,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2545948137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2545948137},{"type":"v1","addr":"172.21.15.18:6835","nonce":2545948137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7854,"qdb_cluster":[7854]},"id":11}]} 2024-09-19T09:25:00.704 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 82 2024-09-19T09:25:00.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.705+0000 7f81afef1640 1 -- 172.21.15.18:0/589176651 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f818c06c2b0 msgr2=0x7f818c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:00.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.705+0000 7f81afef1640 1 --2- 172.21.15.18:0/589176651 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f818c06c2b0 0x7f818c06e770 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f81a4033000 tx=0x7f81a4008030 comp rx=0 tx=0).stop 2024-09-19T09:25:00.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.705+0000 7f81afef1640 1 -- 172.21.15.18:0/589176651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81a81f2b80 msgr2=0x7f81a815db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:00.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.705+0000 7f81afef1640 1 --2- 172.21.15.18:0/589176651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81a81f2b80 0x7f81a815db50 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f8198007fd0 tx=0x7f8198007720 comp rx=0 tx=0).stop 2024-09-19T09:25:00.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.705+0000 7f81afef1640 1 -- 172.21.15.18:0/589176651 shutdown_connections 2024-09-19T09:25:00.706 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.705+0000 7f81afef1640 1 --2- 172.21.15.18:0/589176651 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f818c06c2b0 0x7f818c06e770 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:00.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.705+0000 7f81afef1640 1 --2- 172.21.15.18:0/589176651 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f81a815e090 0x7f81a80af730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:00.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.705+0000 7f81afef1640 1 --2- 172.21.15.18:0/589176651 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f81a81f2b80 0x7f81a815db50 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:00.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.705+0000 7f81afef1640 1 --2- 172.21.15.18:0/589176651 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81940039b0 0x7f81a81f5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:00.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.705+0000 7f81afef1640 1 -- 172.21.15.18:0/589176651 >> 172.21.15.18:0/589176651 conn(0x7f81a80731b0 msgr2=0x7f81a806f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:00.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.705+0000 7f81afef1640 1 -- 172.21.15.18:0/589176651 shutdown_connections 2024-09-19T09:25:00.707 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.705+0000 7f81afef1640 1 -- 172.21.15.18:0/589176651 wait complete. 2024-09-19T09:25:00.717 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:25:00.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.819+0000 7f9e80578640 1 Processor -- start 2024-09-19T09:25:00.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.819+0000 7f9e80578640 1 -- start start 2024-09-19T09:25:00.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.820+0000 7f9e80578640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e7815eb00 0x7f9e781630d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:00.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.820+0000 7f9e80578640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9e7806d810 0x7f9e780b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:00.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.820+0000 7f9e80578640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9e7806ffd0 0x7f9e780b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:00.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.820+0000 7f9e80578640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f9e7806e730 con 0x7f9e7806ffd0 2024-09-19T09:25:00.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.820+0000 7f9e80578640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9e7806ea10 con 0x7f9e7806d810 2024-09-19T09:25:00.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.820+0000 7f9e80578640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9e781628d0 con 0x7f9e7815eb00 2024-09-19T09:25:00.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.820+0000 7f9e7eb15640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9e7806ffd0 0x7f9e780b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:00.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.820+0000 7f9e7eb15640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f9e7806ffd0 0x7f9e780b0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40298/0 (socket says 172.21.15.18:40298) 2024-09-19T09:25:00.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.820+0000 7f9e7eb15640 1 -- 172.21.15.18:0/1649550367 learned_addr learned my addr 172.21.15.18:0/1649550367 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:00.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.820+0000 7f9e7db13640 1 --2- 172.21.15.18:0/1649550367 >> v2:172.21.15.162:3300/0 conn(0x7f9e7806d810 0x7f9e780b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:00.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.820+0000 7f9e7e314640 1 --2- 172.21.15.18:0/1649550367 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e7815eb00 0x7f9e781630d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:00.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.820+0000 7f9e7eb15640 1 -- 172.21.15.18:0/1649550367 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e7815eb00 msgr2=0x7f9e781630d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:00.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.820+0000 7f9e7eb15640 1 --2- 172.21.15.18:0/1649550367 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e7815eb00 0x7f9e781630d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:00.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.820+0000 7f9e7eb15640 1 -- 172.21.15.18:0/1649550367 >> v2:172.21.15.162:3300/0 conn(0x7f9e7806d810 msgr2=0x7f9e780b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:00.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.820+0000 7f9e7eb15640 1 --2- 172.21.15.18:0/1649550367 >> v2:172.21.15.162:3300/0 conn(0x7f9e7806d810 0x7f9e780b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:00.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.820+0000 7f9e7eb15640 1 -- 172.21.15.18:0/1649550367 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e78162bb0 con 0x7f9e7806ffd0 2024-09-19T09:25:00.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.820+0000 7f9e7db13640 1 --2- 172.21.15.18:0/1649550367 >> v2:172.21.15.162:3300/0 conn(0x7f9e7806d810 0x7f9e780b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:00.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.821+0000 7f9e7eb15640 1 --2- 172.21.15.18:0/1649550367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e7806ffd0 0x7f9e780b0fb0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f9e780743f0 tx=0x7f9e7002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491acac75783c41b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:00.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.821+0000 7f9e7d312640 1 -- 172.21.15.18:0/1649550367 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e70036070 con 0x7f9e7806ffd0 2024-09-19T09:25:00.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.821+0000 7f9e7d312640 1 -- 172.21.15.18:0/1649550367 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e70031600 con 0x7f9e7806ffd0 2024-09-19T09:25:00.824 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.821+0000 7f9e7d312640 1 -- 172.21.15.18:0/1649550367 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e700319d0 con 0x7f9e7806ffd0 2024-09-19T09:25:00.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.822+0000 7f9e80578640 1 -- 172.21.15.18:0/1649550367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e7806ffd0 msgr2=0x7f9e780b0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:00.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.822+0000 7f9e80578640 1 --2- 172.21.15.18:0/1649550367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e7806ffd0 0x7f9e780b0fb0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f9e780743f0 tx=0x7f9e7002a610 comp rx=0 tx=0).stop 2024-09-19T09:25:00.826 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.822+0000 7f9e80578640 1 -- 172.21.15.18:0/1649550367 shutdown_connections 2024-09-19T09:25:00.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.822+0000 7f9e80578640 1 --2- 172.21.15.18:0/1649550367 >> v2:172.21.15.162:3300/0 conn(0x7f9e7806d810 0x7f9e780b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:00.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.822+0000 7f9e80578640 1 --2- 172.21.15.18:0/1649550367 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e7806ffd0 0x7f9e780b0fb0 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:00.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.822+0000 7f9e80578640 1 --2- 172.21.15.18:0/1649550367 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e7815eb00 0x7f9e781630d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:00.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.822+0000 7f9e80578640 1 -- 172.21.15.18:0/1649550367 >> 172.21.15.18:0/1649550367 conn(0x7f9e7806cd20 msgr2=0x7f9e7806d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:00.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.822+0000 7f9e80578640 1 -- 172.21.15.18:0/1649550367 shutdown_connections 2024-09-19T09:25:00.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.822+0000 7f9e80578640 1 -- 172.21.15.18:0/1649550367 wait complete. 2024-09-19T09:25:00.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.823+0000 7f9e80578640 1 Processor -- start 2024-09-19T09:25:00.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.823+0000 7f9e80578640 1 -- start start 2024-09-19T09:25:00.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.824+0000 7f9e80578640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e7806d810 0x7f9e78158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:00.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.824+0000 7f9e80578640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e7806ffd0 0x7f9e78159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:00.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.824+0000 7f9e80578640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e7815eb00 0x7f9e78149e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:00.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.824+0000 7f9e80578640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f9e780d15e0 con 0x7f9e7815eb00 2024-09-19T09:25:00.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.824+0000 7f9e80578640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9e780d1460 con 0x7f9e7806d810 2024-09-19T09:25:00.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.824+0000 7f9e80578640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f9e780d1760 con 0x7f9e7806ffd0 2024-09-19T09:25:00.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.824+0000 7f9e7eb15640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e7815eb00 0x7f9e78149e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:00.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.824+0000 7f9e7eb15640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e7815eb00 0x7f9e78149e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40306/0 (socket says 172.21.15.18:40306) 2024-09-19T09:25:00.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.824+0000 7f9e7eb15640 1 -- 172.21.15.18:0/4247544603 learned_addr learned my addr 172.21.15.18:0/4247544603 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:00.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.824+0000 7f9e7e314640 1 --2- 172.21.15.18:0/4247544603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e7806d810 0x7f9e78158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:00.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.824+0000 7f9e7db13640 1 --2- 172.21.15.18:0/4247544603 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e7806ffd0 0x7f9e78159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:00.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.824+0000 7f9e7eb15640 1 -- 172.21.15.18:0/4247544603 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e7806ffd0 msgr2=0x7f9e78159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:00.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.824+0000 7f9e7eb15640 1 --2- 172.21.15.18:0/4247544603 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e7806ffd0 0x7f9e78159240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:00.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.824+0000 7f9e7eb15640 1 -- 172.21.15.18:0/4247544603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e7806d810 msgr2=0x7f9e78158d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:00.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.824+0000 7f9e7eb15640 1 --2- 172.21.15.18:0/4247544603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e7806d810 0x7f9e78158d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:00.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.824+0000 7f9e7eb15640 1 -- 172.21.15.18:0/4247544603 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e78147ab0 con 0x7f9e7815eb00 2024-09-19T09:25:00.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.825+0000 7f9e7eb15640 1 --2- 172.21.15.18:0/4247544603 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e7815eb00 0x7f9e78149e20 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f9e7002ac00 tx=0x7f9e70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:00.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.825+0000 7f9e6effd640 1 -- 172.21.15.18:0/4247544603 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e7003f020 con 0x7f9e7815eb00 2024-09-19T09:25:00.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.825+0000 7f9e6effd640 1 -- 172.21.15.18:0/4247544603 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e70037040 con 0x7f9e7815eb00 2024-09-19T09:25:00.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.825+0000 7f9e80578640 1 -- 172.21.15.18:0/4247544603 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e78159a60 con 0x7f9e7815eb00 2024-09-19T09:25:00.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.825+0000 7f9e6effd640 1 -- 172.21.15.18:0/4247544603 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e70036070 con 0x7f9e7815eb00 2024-09-19T09:25:00.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.825+0000 7f9e80578640 1 -- 172.21.15.18:0/4247544603 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e7815a020 con 0x7f9e7815eb00 2024-09-19T09:25:00.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.826+0000 7f9e80578640 1 -- 172.21.15.18:0/4247544603 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e781630d0 con 0x7f9e7815eb00 2024-09-19T09:25:00.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.826+0000 7f9e6effd640 1 -- 172.21.15.18:0/4247544603 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9e70042020 con 0x7f9e7815eb00 2024-09-19T09:25:00.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.827+0000 7f9e6effd640 1 --2- 172.21.15.18:0/4247544603 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9e5c06c2b0 0x7f9e5c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:00.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.827+0000 7f9e6effd640 1 -- 172.21.15.18:0/4247544603 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5709+0+0 (secure 0 0 0) 0x7f9e700ab730 con 0x7f9e7815eb00 2024-09-19T09:25:00.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.827+0000 7f9e7e314640 1 --2- 172.21.15.18:0/4247544603 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9e5c06c2b0 0x7f9e5c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:00.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.827+0000 7f9e7e314640 1 --2- 172.21.15.18:0/4247544603 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9e5c06c2b0 0x7f9e5c06e770 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f9e740079a0 tx=0x7f9e74008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:00.831 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:00.831+0000 7f9e6effd640 1 -- 172.21.15.18:0/4247544603 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f9e70049030 con 0x7f9e7815eb00 2024-09-19T09:25:01.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.042+0000 7f9e80578640 1 -- 172.21.15.18:0/4247544603 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e7806c8f0 con 0x7f9e7815eb00 2024-09-19T09:25:01.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.042+0000 7f9e6effd640 1 -- 172.21.15.18:0/4247544603 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+5233 (secure 0 0 0) 0x7f9e78147ab0 con 0x7f9e7815eb00 2024-09-19T09:25:01.043 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:25:01.043 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":82,"btime":"2024-09-19T09:24:28:275969+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1644566118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1644566118},{"type":"v1","addr":"172.21.15.162:6835","nonce":1644566118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3767901067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3767901067},{"type":"v1","addr":"172.21.15.162:6837","nonce":3767901067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7851,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1160903618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1160903618},{"type":"v1","addr":"172.21.15.18:6834","nonce":1160903618}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:24:25.526108+0000","modified":"2024-09-19T09:24:27.619787+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7854},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7854":{"gid":7854,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2545948137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2545948137},{"type":"v1","addr":"172.21.15.18:6835","nonce":2545948137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7854,"qdb_cluster":[7854]},"id":11}]} 2024-09-19T09:25:01.044 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 82 2024-09-19T09:25:01.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.044+0000 7f9e80578640 1 -- 172.21.15.18:0/4247544603 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9e5c06c2b0 msgr2=0x7f9e5c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:01.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.044+0000 7f9e80578640 1 --2- 172.21.15.18:0/4247544603 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9e5c06c2b0 0x7f9e5c06e770 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f9e740079a0 tx=0x7f9e74008040 comp rx=0 tx=0).stop 2024-09-19T09:25:01.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.044+0000 7f9e80578640 1 -- 172.21.15.18:0/4247544603 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e7815eb00 msgr2=0x7f9e78149e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:01.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.044+0000 7f9e80578640 1 --2- 172.21.15.18:0/4247544603 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e7815eb00 0x7f9e78149e20 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f9e7002ac00 tx=0x7f9e70004a40 comp rx=0 tx=0).stop 2024-09-19T09:25:01.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.044+0000 7f9e80578640 1 -- 172.21.15.18:0/4247544603 shutdown_connections 2024-09-19T09:25:01.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.044+0000 7f9e80578640 1 --2- 172.21.15.18:0/4247544603 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f9e5c06c2b0 0x7f9e5c06e770 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:01.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.044+0000 7f9e80578640 1 --2- 172.21.15.18:0/4247544603 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f9e7815eb00 0x7f9e78149e20 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:01.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.044+0000 7f9e80578640 1 --2- 172.21.15.18:0/4247544603 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f9e7806ffd0 0x7f9e78159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:01.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.044+0000 7f9e80578640 1 --2- 172.21.15.18:0/4247544603 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e7806d810 0x7f9e78158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:01.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.044+0000 7f9e80578640 1 -- 172.21.15.18:0/4247544603 >> 172.21.15.18:0/4247544603 conn(0x7f9e7806cd20 msgr2=0x7f9e78072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:01.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.044+0000 7f9e80578640 1 -- 172.21.15.18:0/4247544603 shutdown_connections 2024-09-19T09:25:01.046 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.044+0000 7f9e80578640 1 -- 172.21.15.18:0/4247544603 wait complete. 2024-09-19T09:25:01.056 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:25:01.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.157+0000 7f8939d68640 1 Processor -- start 2024-09-19T09:25:01.158 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.157+0000 7f8939d68640 1 -- start start 2024-09-19T09:25:01.159 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.158+0000 7f8939d68640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f89340d1c70 0x7f89340cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:01.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.158+0000 7f8939d68640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f89340b5b00 0x7f89340cff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:01.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.158+0000 7f8939d68640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89340d31b0 con 0x7f893415ed50 2024-09-19T09:25:01.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.158+0000 7f8939d68640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f89340d3490 con 0x7f89340b5b00 2024-09-19T09:25:01.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.158+0000 7f8939d68640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f89340d3770 con 0x7f89340d1c70 2024-09-19T09:25:01.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.158+0000 7f8933fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f89340b5b00 0x7f89340cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:01.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.158+0000 7f89337fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f893415ed50 0x7f89340d1560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55544/0 (socket says 172.21.15.18:55544) 2024-09-19T09:25:01.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.158+0000 7f89337fe640 1 -- 172.21.15.18:0/1670204716 learned_addr learned my addr 172.21.15.18:0/1670204716 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:25:01.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.159+0000 7f8932ffd640 1 --2- 172.21.15.18:0/1670204716 >> v2:172.21.15.162:3300/0 conn(0x7f89340d1c70 0x7f89340cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:01.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.159+0000 7f8933fff640 1 -- 172.21.15.18:0/1670204716 >> v2:172.21.15.162:3300/0 conn(0x7f89340d1c70 msgr2=0x7f89340cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:01.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.159+0000 7f8933fff640 1 --2- 172.21.15.18:0/1670204716 >> v2:172.21.15.162:3300/0 conn(0x7f89340d1c70 0x7f89340cf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:01.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.159+0000 7f8933fff640 1 -- 172.21.15.18:0/1670204716 >> v1:172.21.15.18:6789/0 conn(0x7f893415ed50 legacy=0x7f89340d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:01.160 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.159+0000 7f8933fff640 1 -- 172.21.15.18:0/1670204716 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89340d3a50 con 0x7f89340b5b00 2024-09-19T09:25:01.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.159+0000 7f89327fc640 1 -- 172.21.15.18:0/1670204716 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2278922218 0 0) 0x7f89340d31b0 con 0x7f893415ed50 2024-09-19T09:25:01.161 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.159+0000 7f8932ffd640 1 --2- 172.21.15.18:0/1670204716 >> v2:172.21.15.162:3300/0 conn(0x7f89340d1c70 0x7f89340cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:25:01.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.159+0000 7f8933fff640 1 --2- 172.21.15.18:0/1670204716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89340b5b00 0x7f89340cff00 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f89341628a0 tx=0x7f892c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b98c63727b8e39 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:01.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.159+0000 7f89327fc640 1 -- 172.21.15.18:0/1670204716 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892c007740 con 0x7f89340b5b00 2024-09-19T09:25:01.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.160+0000 7f89327fc640 1 -- 172.21.15.18:0/1670204716 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f892c0078e0 con 0x7f89340b5b00 2024-09-19T09:25:01.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.160+0000 7f89327fc640 1 -- 172.21.15.18:0/1670204716 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892c007cb0 con 0x7f89340b5b00 2024-09-19T09:25:01.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.160+0000 7f8939d68640 1 -- 172.21.15.18:0/1670204716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89340b5b00 msgr2=0x7f89340cff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:01.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.160+0000 7f8939d68640 1 --2- 172.21.15.18:0/1670204716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89340b5b00 0x7f89340cff00 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f89341628a0 tx=0x7f892c02a710 comp rx=0 tx=0).stop 2024-09-19T09:25:01.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.160+0000 7f8939d68640 1 -- 172.21.15.18:0/1670204716 shutdown_connections 2024-09-19T09:25:01.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.160+0000 7f8939d68640 1 --2- 172.21.15.18:0/1670204716 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f89340b5b00 0x7f89340cff00 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:01.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.160+0000 7f8939d68640 1 --2- 172.21.15.18:0/1670204716 >> v2:172.21.15.162:3300/0 conn(0x7f89340d1c70 0x7f89340cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:01.162 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.160+0000 7f8939d68640 1 -- 172.21.15.18:0/1670204716 >> 172.21.15.18:0/1670204716 conn(0x7f89340d4bd0 msgr2=0x7f89340d4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:01.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.160+0000 7f8939d68640 1 -- 172.21.15.18:0/1670204716 shutdown_connections 2024-09-19T09:25:01.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.160+0000 7f8939d68640 1 -- 172.21.15.18:0/1670204716 wait complete. 2024-09-19T09:25:01.163 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.161+0000 7f8939d68640 1 Processor -- start 2024-09-19T09:25:01.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.162+0000 7f8939d68640 1 -- start start 2024-09-19T09:25:01.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.162+0000 7f8939d68640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89340b5b00 0x7f89341f76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:01.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.162+0000 7f8939d68640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89340d1c70 0x7f89340ba2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:01.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.162+0000 7f8939d68640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f893415ed50 0x7f89340b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:01.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.162+0000 7f8939d68640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f893415f130 con 0x7f893415ed50 2024-09-19T09:25:01.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.162+0000 7f8939d68640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f89340d3d30 con 0x7f89340d1c70 2024-09-19T09:25:01.165 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.162+0000 7f8939d68640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f89340caae0 con 0x7f89340b5b00 2024-09-19T09:25:01.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.162+0000 7f8933fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f893415ed50 0x7f89340b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:01.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.162+0000 7f8933fff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f893415ed50 0x7f89340b5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40328/0 (socket says 172.21.15.18:40328) 2024-09-19T09:25:01.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.162+0000 7f8933fff640 1 -- 172.21.15.18:0/1593378712 learned_addr learned my addr 172.21.15.18:0/1593378712 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:01.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.163+0000 7f89337fe640 1 --2- 172.21.15.18:0/1593378712 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89340b5b00 0x7f89341f76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:01.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.163+0000 7f8932ffd640 1 --2- 172.21.15.18:0/1593378712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89340d1c70 0x7f89340ba2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:01.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.163+0000 7f8933fff640 1 -- 172.21.15.18:0/1593378712 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89340b5b00 msgr2=0x7f89341f76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:01.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.163+0000 7f8933fff640 1 --2- 172.21.15.18:0/1593378712 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89340b5b00 0x7f89341f76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:01.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.163+0000 7f8933fff640 1 -- 172.21.15.18:0/1593378712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89340d1c70 msgr2=0x7f89340ba2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:01.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.163+0000 7f8933fff640 1 --2- 172.21.15.18:0/1593378712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89340d1c70 0x7f89340ba2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:01.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.163+0000 7f8933fff640 1 -- 172.21.15.18:0/1593378712 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89340cadc0 con 0x7f893415ed50 2024-09-19T09:25:01.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.163+0000 7f89337fe640 1 --2- 172.21.15.18:0/1593378712 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89340b5b00 0x7f89341f76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:01.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.163+0000 7f8932ffd640 1 --2- 172.21.15.18:0/1593378712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89340d1c70 0x7f89340ba2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:25:01.166 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.163+0000 7f8933fff640 1 --2- 172.21.15.18:0/1593378712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f893415ed50 0x7f89340b5ee0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f892c02ad00 tx=0x7f892c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:01.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.163+0000 7f891bfff640 1 -- 172.21.15.18:0/1593378712 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892c040070 con 0x7f893415ed50 2024-09-19T09:25:01.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.163+0000 7f891bfff640 1 -- 172.21.15.18:0/1593378712 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f892c031c90 con 0x7f893415ed50 2024-09-19T09:25:01.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.163+0000 7f891bfff640 1 -- 172.21.15.18:0/1593378712 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892c045680 con 0x7f893415ed50 2024-09-19T09:25:01.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.163+0000 7f8939d68640 1 -- 172.21.15.18:0/1593378712 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89340cb0a0 con 0x7f893415ed50 2024-09-19T09:25:01.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.164+0000 7f8939d68640 1 -- 172.21.15.18:0/1593378712 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89340ca7f0 con 0x7f893415ed50 2024-09-19T09:25:01.167 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.164+0000 7f8939d68640 1 -- 172.21.15.18:0/1593378712 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89340d21e0 con 0x7f893415ed50 2024-09-19T09:25:01.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.165+0000 7f891bfff640 1 -- 172.21.15.18:0/1593378712 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f892c039040 con 0x7f893415ed50 2024-09-19T09:25:01.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.165+0000 7f891bfff640 1 --2- 172.21.15.18:0/1593378712 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f892006c2b0 0x7f892006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:01.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.166+0000 7f891bfff640 1 -- 172.21.15.18:0/1593378712 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5709+0+0 (secure 0 0 0) 0x7f892c0acbf0 con 0x7f893415ed50 2024-09-19T09:25:01.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.166+0000 7f89337fe640 1 --2- 172.21.15.18:0/1593378712 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f892006c2b0 0x7f892006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:01.168 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.166+0000 7f89337fe640 1 --2- 172.21.15.18:0/1593378712 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f892006c2b0 0x7f892006e770 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f8924000f60 tx=0x7f8924007ca0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:01.170 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.170+0000 7f891bfff640 1 -- 172.21.15.18:0/1593378712 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f892c04c030 con 0x7f893415ed50 2024-09-19T09:25:01.346 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.345+0000 7f8939d68640 1 -- 172.21.15.18:0/1593378712 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f893406d7d0 con 0x7f893415ed50 2024-09-19T09:25:01.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.346+0000 7f891bfff640 1 -- 172.21.15.18:0/1593378712 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v185) ==== 74+0+16759 (secure 0 0 0) 0x7f892c038350 con 0x7f893415ed50 2024-09-19T09:25:01.348 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:25:01.348 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":185,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:24:56.278624+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:24:23.190145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-19T09:24:24.517971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:25:01.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.348+0000 7f8939d68640 1 -- 172.21.15.18:0/1593378712 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f892006c2b0 msgr2=0x7f892006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:01.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.348+0000 7f8939d68640 1 --2- 172.21.15.18:0/1593378712 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f892006c2b0 0x7f892006e770 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f8924000f60 tx=0x7f8924007ca0 comp rx=0 tx=0).stop 2024-09-19T09:25:01.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.348+0000 7f8939d68640 1 -- 172.21.15.18:0/1593378712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f893415ed50 msgr2=0x7f89340b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:01.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.348+0000 7f8939d68640 1 --2- 172.21.15.18:0/1593378712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f893415ed50 0x7f89340b5ee0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f892c02ad00 tx=0x7f892c004a40 comp rx=0 tx=0).stop 2024-09-19T09:25:01.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.348+0000 7f8939d68640 1 -- 172.21.15.18:0/1593378712 shutdown_connections 2024-09-19T09:25:01.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.348+0000 7f8939d68640 1 --2- 172.21.15.18:0/1593378712 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f892006c2b0 0x7f892006e770 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:01.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.348+0000 7f8939d68640 1 --2- 172.21.15.18:0/1593378712 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f893415ed50 0x7f89340b5ee0 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:01.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.348+0000 7f8939d68640 1 --2- 172.21.15.18:0/1593378712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89340d1c70 0x7f89340ba2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:01.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.348+0000 7f8939d68640 1 --2- 172.21.15.18:0/1593378712 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f89340b5b00 0x7f89341f76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:01.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.348+0000 7f8939d68640 1 -- 172.21.15.18:0/1593378712 >> 172.21.15.18:0/1593378712 conn(0x7f89340d4bd0 msgr2=0x7f89340b6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:01.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.349+0000 7f8939d68640 1 -- 172.21.15.18:0/1593378712 shutdown_connections 2024-09-19T09:25:01.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.349+0000 7f8939d68640 1 -- 172.21.15.18:0/1593378712 wait complete. 2024-09-19T09:25:01.361 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T09:25:01.361 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:25:01.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.462+0000 7f4ea065c640 1 Processor -- start 2024-09-19T09:25:01.463 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.462+0000 7f4ea065c640 1 -- start start 2024-09-19T09:25:01.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.463+0000 7f4ea065c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4e980cf560 0x7f4e980cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:01.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.463+0000 7f4ea065c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4e980ce600 0x7f4e980b33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:01.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.463+0000 7f4ea065c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e980d0e10 con 0x7f4e980cfe80 2024-09-19T09:25:01.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.463+0000 7f4ea065c640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f4e980d0310 con 0x7f4e980ce600 2024-09-19T09:25:01.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.463+0000 7f4ea065c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4e980d0850 con 0x7f4e980cf560 2024-09-19T09:25:01.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.463+0000 7f4e9ebf9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4e980ce600 0x7f4e980b33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:01.465 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.463+0000 7f4e9ebf9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f4e980ce600 0x7f4e980b33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40338/0 (socket says 172.21.15.18:40338) 2024-09-19T09:25:01.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.463+0000 7f4e9ebf9640 1 -- 172.21.15.18:0/423442811 learned_addr learned my addr 172.21.15.18:0/423442811 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:01.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.463+0000 7f4e9e3f8640 1 --2- 172.21.15.18:0/423442811 >> v2:172.21.15.162:3300/0 conn(0x7f4e980cf560 0x7f4e980cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:01.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.463+0000 7f4e9ebf9640 1 -- 172.21.15.18:0/423442811 >> v2:172.21.15.162:3300/0 conn(0x7f4e980cf560 msgr2=0x7f4e980cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:01.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.463+0000 7f4e9ebf9640 1 --2- 172.21.15.18:0/423442811 >> v2:172.21.15.162:3300/0 conn(0x7f4e980cf560 0x7f4e980cf940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:01.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.463+0000 7f4e9ebf9640 1 -- 172.21.15.18:0/423442811 >> v1:172.21.15.162:6789/0 conn(0x7f4e980cfe80 legacy=0x7f4e980b2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:01.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.463+0000 7f4e9ebf9640 1 -- 172.21.15.18:0/423442811 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e980d0b30 con 0x7f4e980ce600 2024-09-19T09:25:01.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.463+0000 7f4e9e3f8640 1 --2- 172.21.15.18:0/423442811 >> v2:172.21.15.162:3300/0 conn(0x7f4e980cf560 0x7f4e980cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:25:01.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.464+0000 7f4e9ebf9640 1 --2- 172.21.15.18:0/423442811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e980ce600 0x7f4e980b33e0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f4e98073b90 tx=0x7f4e9002a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6c6c3280b55b0d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:01.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.464+0000 7f4e9d3f6640 1 -- 172.21.15.18:0/423442811 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e90036070 con 0x7f4e980ce600 2024-09-19T09:25:01.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.464+0000 7f4e9d3f6640 1 -- 172.21.15.18:0/423442811 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e90031600 con 0x7f4e980ce600 2024-09-19T09:25:01.466 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.464+0000 7f4e9d3f6640 1 -- 172.21.15.18:0/423442811 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e900319d0 con 0x7f4e980ce600 2024-09-19T09:25:01.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.465+0000 7f4ea065c640 1 -- 172.21.15.18:0/423442811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e980ce600 msgr2=0x7f4e980b33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:01.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.465+0000 7f4ea065c640 1 --2- 172.21.15.18:0/423442811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e980ce600 0x7f4e980b33e0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f4e98073b90 tx=0x7f4e9002a5d0 comp rx=0 tx=0).stop 2024-09-19T09:25:01.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.465+0000 7f4ea065c640 1 -- 172.21.15.18:0/423442811 shutdown_connections 2024-09-19T09:25:01.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.465+0000 7f4ea065c640 1 --2- 172.21.15.18:0/423442811 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e980ce600 0x7f4e980b33e0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:01.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.465+0000 7f4ea065c640 1 --2- 172.21.15.18:0/423442811 >> v2:172.21.15.162:3300/0 conn(0x7f4e980cf560 0x7f4e980cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:01.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.465+0000 7f4ea065c640 1 -- 172.21.15.18:0/423442811 >> 172.21.15.18:0/423442811 conn(0x7f4e980b4700 msgr2=0x7f4e980b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:01.469 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.465+0000 7f4ea065c640 1 -- 172.21.15.18:0/423442811 shutdown_connections 2024-09-19T09:25:01.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.465+0000 7f4ea065c640 1 -- 172.21.15.18:0/423442811 wait complete. 2024-09-19T09:25:01.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.466+0000 7f4ea065c640 1 Processor -- start 2024-09-19T09:25:01.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.466+0000 7f4ea065c640 1 -- start start 2024-09-19T09:25:01.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.467+0000 7f4ea065c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e980ce600 0x7f4e9815f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:01.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.467+0000 7f4ea065c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e980cf560 0x7f4e9815d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:01.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.467+0000 7f4ea065c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e980cfe80 0x7f4e9815d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:01.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.467+0000 7f4ea065c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f4e980b5420 con 0x7f4e980cfe80 2024-09-19T09:25:01.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.467+0000 7f4ea065c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4e980b27b0 con 0x7f4e980ce600 2024-09-19T09:25:01.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.467+0000 7f4ea065c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4e980b55a0 con 0x7f4e980cf560 2024-09-19T09:25:01.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.467+0000 7f4e9ebf9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e980cfe80 0x7f4e9815d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:01.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.467+0000 7f4e9ebf9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e980cfe80 0x7f4e9815d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40354/0 (socket says 172.21.15.18:40354) 2024-09-19T09:25:01.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.467+0000 7f4e9ebf9640 1 -- 172.21.15.18:0/1747958004 learned_addr learned my addr 172.21.15.18:0/1747958004 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:01.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.467+0000 7f4e9e3f8640 1 --2- 172.21.15.18:0/1747958004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e980ce600 0x7f4e9815f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:01.470 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.467+0000 7f4e9dbf7640 1 --2- 172.21.15.18:0/1747958004 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e980cf560 0x7f4e9815d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:01.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.467+0000 7f4e9ebf9640 1 -- 172.21.15.18:0/1747958004 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e980cf560 msgr2=0x7f4e9815d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:01.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.467+0000 7f4e9ebf9640 1 --2- 172.21.15.18:0/1747958004 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e980cf560 0x7f4e9815d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:01.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.467+0000 7f4e9ebf9640 1 -- 172.21.15.18:0/1747958004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e980ce600 msgr2=0x7f4e9815f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:01.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.467+0000 7f4e9ebf9640 1 --2- 172.21.15.18:0/1747958004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e980ce600 0x7f4e9815f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:01.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.467+0000 7f4e9ebf9640 1 -- 172.21.15.18:0/1747958004 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e9815fa20 con 0x7f4e980cfe80 2024-09-19T09:25:01.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.468+0000 7f4e9ebf9640 1 --2- 172.21.15.18:0/1747958004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e980cfe80 0x7f4e9815d7e0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f4e90034040 tx=0x7f4e90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:01.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.468+0000 7f4e8effd640 1 -- 172.21.15.18:0/1747958004 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e90036050 con 0x7f4e980cfe80 2024-09-19T09:25:01.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.468+0000 7f4e8effd640 1 -- 172.21.15.18:0/1747958004 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e90042070 con 0x7f4e980cfe80 2024-09-19T09:25:01.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.468+0000 7f4ea065c640 1 -- 172.21.15.18:0/1747958004 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e980c67b0 con 0x7f4e980cfe80 2024-09-19T09:25:01.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.468+0000 7f4e8effd640 1 -- 172.21.15.18:0/1747958004 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e90009510 con 0x7f4e980cfe80 2024-09-19T09:25:01.471 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.468+0000 7f4ea065c640 1 -- 172.21.15.18:0/1747958004 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e980c6d70 con 0x7f4e980cfe80 2024-09-19T09:25:01.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.469+0000 7f4ea065c640 1 -- 172.21.15.18:0/1747958004 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e9815d090 con 0x7f4e980cfe80 2024-09-19T09:25:01.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.469+0000 7f4e8effd640 1 -- 172.21.15.18:0/1747958004 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f4e90007bf0 con 0x7f4e980cfe80 2024-09-19T09:25:01.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.470+0000 7f4e8effd640 1 --2- 172.21.15.18:0/1747958004 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4e7c06c2b0 0x7f4e7c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:01.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.470+0000 7f4e8effd640 1 -- 172.21.15.18:0/1747958004 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5709+0+0 (secure 0 0 0) 0x7f4e900ac330 con 0x7f4e980cfe80 2024-09-19T09:25:01.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.470+0000 7f4e9e3f8640 1 --2- 172.21.15.18:0/1747958004 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4e7c06c2b0 0x7f4e7c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:01.472 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.470+0000 7f4e9e3f8640 1 --2- 172.21.15.18:0/1747958004 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4e7c06c2b0 0x7f4e7c06e770 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f4e98070e40 tx=0x7f4e94008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:01.475 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.474+0000 7f4e8effd640 1 -- 172.21.15.18:0/1747958004 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f4e9007ab30 con 0x7f4e980cfe80 2024-09-19T09:25:01.685 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.684+0000 7f4ea065c640 1 -- 172.21.15.18:0/1747958004 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e980b3f10 con 0x7f4e980cfe80 2024-09-19T09:25:01.686 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.685+0000 7f4e8effd640 1 -- 172.21.15.18:0/1747958004 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+5233 (secure 0 0 0) 0x7f4e9007a430 con 0x7f4e980cfe80 2024-09-19T09:25:01.686 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:25:01.686 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":82,"btime":"2024-09-19T09:24:28:275969+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1644566118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1644566118},{"type":"v1","addr":"172.21.15.162:6835","nonce":1644566118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3767901067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3767901067},{"type":"v1","addr":"172.21.15.162:6837","nonce":3767901067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7851,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1160903618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1160903618},{"type":"v1","addr":"172.21.15.18:6834","nonce":1160903618}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:24:25.526108+0000","modified":"2024-09-19T09:24:27.619787+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7854},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7854":{"gid":7854,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2545948137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2545948137},{"type":"v1","addr":"172.21.15.18:6835","nonce":2545948137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7854,"qdb_cluster":[7854]},"id":11}]} 2024-09-19T09:25:01.686 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 82 2024-09-19T09:25:01.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.687+0000 7f4ea065c640 1 -- 172.21.15.18:0/1747958004 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4e7c06c2b0 msgr2=0x7f4e7c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:01.688 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.687+0000 7f4ea065c640 1 --2- 172.21.15.18:0/1747958004 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4e7c06c2b0 0x7f4e7c06e770 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f4e98070e40 tx=0x7f4e94008040 comp rx=0 tx=0).stop 2024-09-19T09:25:01.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.687+0000 7f4ea065c640 1 -- 172.21.15.18:0/1747958004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e980cfe80 msgr2=0x7f4e9815d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:01.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.687+0000 7f4ea065c640 1 --2- 172.21.15.18:0/1747958004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e980cfe80 0x7f4e9815d7e0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f4e90034040 tx=0x7f4e90004a40 comp rx=0 tx=0).stop 2024-09-19T09:25:01.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.687+0000 7f4ea065c640 1 -- 172.21.15.18:0/1747958004 shutdown_connections 2024-09-19T09:25:01.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.687+0000 7f4ea065c640 1 --2- 172.21.15.18:0/1747958004 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f4e7c06c2b0 0x7f4e7c06e770 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:01.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.687+0000 7f4ea065c640 1 --2- 172.21.15.18:0/1747958004 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f4e980cfe80 0x7f4e9815d7e0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:01.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.687+0000 7f4ea065c640 1 --2- 172.21.15.18:0/1747958004 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f4e980cf560 0x7f4e9815d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:01.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.687+0000 7f4ea065c640 1 --2- 172.21.15.18:0/1747958004 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4e980ce600 0x7f4e9815f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:01.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.687+0000 7f4ea065c640 1 -- 172.21.15.18:0/1747958004 >> 172.21.15.18:0/1747958004 conn(0x7f4e980b4700 msgr2=0x7f4e980d2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:01.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.687+0000 7f4ea065c640 1 -- 172.21.15.18:0/1747958004 shutdown_connections 2024-09-19T09:25:01.689 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.687+0000 7f4ea065c640 1 -- 172.21.15.18:0/1747958004 wait complete. 2024-09-19T09:25:01.699 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:25:01.801 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.801+0000 7f190dff6640 1 Processor -- start 2024-09-19T09:25:01.802 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.801+0000 7f190dff6640 1 -- start start 2024-09-19T09:25:01.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.801+0000 7f190dff6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f190815ef50 0x7f19080d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:01.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.801+0000 7f190dff6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f19080b9510 0x7f19080d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:01.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.801+0000 7f190dff6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19080b7a90 con 0x7f19080d3240 2024-09-19T09:25:01.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.801+0000 7f190dff6640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f19080d3740 con 0x7f19080b9510 2024-09-19T09:25:01.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.801+0000 7f190dff6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f19080d3a20 con 0x7f190815ef50 2024-09-19T09:25:01.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.802+0000 7f1907fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f19080b9510 0x7f19080d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:01.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.802+0000 7f1907fff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f19080b9510 0x7f19080d18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40370/0 (socket says 172.21.15.18:40370) 2024-09-19T09:25:01.803 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.802+0000 7f1907fff640 1 -- 172.21.15.18:0/2928391075 learned_addr learned my addr 172.21.15.18:0/2928391075 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:01.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.802+0000 7f19077fe640 1 --2- 172.21.15.18:0/2928391075 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f190815ef50 0x7f19080d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:01.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.802+0000 7f1907fff640 1 -- 172.21.15.18:0/2928391075 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f190815ef50 msgr2=0x7f19080d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:01.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.802+0000 7f1907fff640 1 --2- 172.21.15.18:0/2928391075 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f190815ef50 0x7f19080d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:01.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.802+0000 7f1907fff640 1 -- 172.21.15.18:0/2928391075 >> v1:172.21.15.162:6789/0 conn(0x7f19080d3240 legacy=0x7f19080cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:01.804 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.802+0000 7f1907fff640 1 -- 172.21.15.18:0/2928391075 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19080b7d00 con 0x7f19080b9510 2024-09-19T09:25:01.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.803+0000 7f1907fff640 1 --2- 172.21.15.18:0/2928391075 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19080b9510 0x7f19080d18e0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f1900009870 tx=0x7f190002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b31ca1a36d213d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:01.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.803+0000 7f19067fc640 1 -- 172.21.15.18:0/2928391075 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1900037070 con 0x7f19080b9510 2024-09-19T09:25:01.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.803+0000 7f19067fc640 1 -- 172.21.15.18:0/2928391075 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1900032440 con 0x7f19080b9510 2024-09-19T09:25:01.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.803+0000 7f19067fc640 1 -- 172.21.15.18:0/2928391075 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1900032810 con 0x7f19080b9510 2024-09-19T09:25:01.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.803+0000 7f190dff6640 1 -- 172.21.15.18:0/2928391075 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19080b9510 msgr2=0x7f19080d18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:01.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.803+0000 7f190dff6640 1 --2- 172.21.15.18:0/2928391075 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19080b9510 0x7f19080d18e0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f1900009870 tx=0x7f190002a1c0 comp rx=0 tx=0).stop 2024-09-19T09:25:01.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.803+0000 7f190dff6640 1 -- 172.21.15.18:0/2928391075 shutdown_connections 2024-09-19T09:25:01.805 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.803+0000 7f190dff6640 1 --2- 172.21.15.18:0/2928391075 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19080b9510 0x7f19080d18e0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:01.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.803+0000 7f190dff6640 1 --2- 172.21.15.18:0/2928391075 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f190815ef50 0x7f19080d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:01.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.803+0000 7f190dff6640 1 -- 172.21.15.18:0/2928391075 >> 172.21.15.18:0/2928391075 conn(0x7f19080d4c60 msgr2=0x7f19080d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:01.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.804+0000 7f190dff6640 1 -- 172.21.15.18:0/2928391075 shutdown_connections 2024-09-19T09:25:01.806 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.804+0000 7f190dff6640 1 -- 172.21.15.18:0/2928391075 wait complete. 2024-09-19T09:25:01.807 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.805+0000 7f190dff6640 1 Processor -- start 2024-09-19T09:25:01.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.805+0000 7f190dff6640 1 -- start start 2024-09-19T09:25:01.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.806+0000 7f190dff6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19080b9510 0x7f19080cc530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:01.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.806+0000 7f190dff6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19080d3240 0x7f19080cca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:01.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.806+0000 7f190dff6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f190815ef50 0x7f1908157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:01.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.806+0000 7f190dff6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f19080d21a0 con 0x7f19080d3240 2024-09-19T09:25:01.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.806+0000 7f190dff6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f19080d2020 con 0x7f190815ef50 2024-09-19T09:25:01.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.806+0000 7f190dff6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f19080d5780 con 0x7f19080b9510 2024-09-19T09:25:01.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.806+0000 7f1906ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19080d3240 0x7f19080cca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:01.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.806+0000 7f1906ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19080d3240 0x7f19080cca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40376/0 (socket says 172.21.15.18:40376) 2024-09-19T09:25:01.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.806+0000 7f1906ffd640 1 -- 172.21.15.18:0/3063978504 learned_addr learned my addr 172.21.15.18:0/3063978504 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:01.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.806+0000 7f19077fe640 1 --2- 172.21.15.18:0/3063978504 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19080b9510 0x7f19080cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:01.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.806+0000 7f1907fff640 1 --2- 172.21.15.18:0/3063978504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f190815ef50 0x7f1908157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:01.808 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.806+0000 7f1906ffd640 1 -- 172.21.15.18:0/3063978504 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19080b9510 msgr2=0x7f19080cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:01.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.806+0000 7f1906ffd640 1 --2- 172.21.15.18:0/3063978504 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19080b9510 0x7f19080cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:01.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.806+0000 7f1906ffd640 1 -- 172.21.15.18:0/3063978504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f190815ef50 msgr2=0x7f1908157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:01.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.806+0000 7f1906ffd640 1 --2- 172.21.15.18:0/3063978504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f190815ef50 0x7f1908157e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:01.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.806+0000 7f1906ffd640 1 -- 172.21.15.18:0/3063978504 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19081565d0 con 0x7f19080d3240 2024-09-19T09:25:01.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.806+0000 7f1906ffd640 1 --2- 172.21.15.18:0/3063978504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19080d3240 0x7f19080cca70 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f18fc00c370 tx=0x7f18fc00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:01.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.806+0000 7f18effff640 1 -- 172.21.15.18:0/3063978504 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc0052d0 con 0x7f19080d3240 2024-09-19T09:25:01.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.806+0000 7f18effff640 1 -- 172.21.15.18:0/3063978504 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18fc005470 con 0x7f19080d3240 2024-09-19T09:25:01.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.806+0000 7f18effff640 1 -- 172.21.15.18:0/3063978504 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18fc007260 con 0x7f19080d3240 2024-09-19T09:25:01.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.806+0000 7f190dff6640 1 -- 172.21.15.18:0/3063978504 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19080cd1b0 con 0x7f19080d3240 2024-09-19T09:25:01.809 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.807+0000 7f190dff6640 1 -- 172.21.15.18:0/3063978504 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19080cd770 con 0x7f19080d3240 2024-09-19T09:25:01.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.807+0000 7f190dff6640 1 -- 172.21.15.18:0/3063978504 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19080d13a0 con 0x7f19080d3240 2024-09-19T09:25:01.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.808+0000 7f18effff640 1 -- 172.21.15.18:0/3063978504 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f18fc007400 con 0x7f19080d3240 2024-09-19T09:25:01.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.809+0000 7f18effff640 1 --2- 172.21.15.18:0/3063978504 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f18f406c2b0 0x7f18f406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:01.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.809+0000 7f18effff640 1 -- 172.21.15.18:0/3063978504 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5709+0+0 (secure 0 0 0) 0x7f18fc08a860 con 0x7f19080d3240 2024-09-19T09:25:01.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.809+0000 7f19077fe640 1 --2- 172.21.15.18:0/3063978504 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f18f406c2b0 0x7f18f406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:01.810 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.809+0000 7f19077fe640 1 --2- 172.21.15.18:0/3063978504 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f18f406c2b0 0x7f18f406e770 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f190815d370 tx=0x7f18f8009830 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:01.813 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:01.813+0000 7f18effff640 1 -- 172.21.15.18:0/3063978504 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f18fc058980 con 0x7f19080d3240 2024-09-19T09:25:02.027 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.027+0000 7f190dff6640 1 -- 172.21.15.18:0/3063978504 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19080d2a60 con 0x7f19080d3240 2024-09-19T09:25:02.028 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.027+0000 7f18effff640 1 -- 172.21.15.18:0/3063978504 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 82 v82) ==== 94+0+5233 (secure 0 0 0) 0x7f18fc08a070 con 0x7f19080d3240 2024-09-19T09:25:02.028 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:25:02.028 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":82,"btime":"2024-09-19T09:24:28:275969+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1644566118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1644566118},{"type":"v1","addr":"172.21.15.162:6835","nonce":1644566118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3767901067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3767901067},{"type":"v1","addr":"172.21.15.162:6837","nonce":3767901067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7851,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1160903618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1160903618},{"type":"v1","addr":"172.21.15.18:6834","nonce":1160903618}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77}],"filesystems":[{"mdsmap":{"epoch":82,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-19T09:24:25.526108+0000","modified":"2024-09-19T09:24:27.619787+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7854},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7854":{"gid":7854,"name":"a","rank":0,"incarnation":79,"state":"up:active","state_seq":3,"addr":"172.21.15.18:6835/2545948137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":2545948137},{"type":"v1","addr":"172.21.15.18:6835","nonce":2545948137}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7854,"qdb_cluster":[7854]},"id":11}]} 2024-09-19T09:25:02.029 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 82 2024-09-19T09:25:02.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.029+0000 7f190dff6640 1 -- 172.21.15.18:0/3063978504 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f18f406c2b0 msgr2=0x7f18f406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:02.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.029+0000 7f190dff6640 1 --2- 172.21.15.18:0/3063978504 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f18f406c2b0 0x7f18f406e770 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f190815d370 tx=0x7f18f8009830 comp rx=0 tx=0).stop 2024-09-19T09:25:02.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.029+0000 7f190dff6640 1 -- 172.21.15.18:0/3063978504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19080d3240 msgr2=0x7f19080cca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:02.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.029+0000 7f190dff6640 1 --2- 172.21.15.18:0/3063978504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19080d3240 0x7f19080cca70 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f18fc00c370 tx=0x7f18fc00c830 comp rx=0 tx=0).stop 2024-09-19T09:25:02.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.029+0000 7f190dff6640 1 -- 172.21.15.18:0/3063978504 shutdown_connections 2024-09-19T09:25:02.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.029+0000 7f190dff6640 1 --2- 172.21.15.18:0/3063978504 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f18f406c2b0 0x7f18f406e770 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.030 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.029+0000 7f190dff6640 1 --2- 172.21.15.18:0/3063978504 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f190815ef50 0x7f1908157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.029+0000 7f190dff6640 1 --2- 172.21.15.18:0/3063978504 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f19080d3240 0x7f19080cca70 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.029+0000 7f190dff6640 1 --2- 172.21.15.18:0/3063978504 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f19080b9510 0x7f19080cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.029+0000 7f190dff6640 1 -- 172.21.15.18:0/3063978504 >> 172.21.15.18:0/3063978504 conn(0x7f19080d4c60 msgr2=0x7f19080d15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:02.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.029+0000 7f190dff6640 1 -- 172.21.15.18:0/3063978504 shutdown_connections 2024-09-19T09:25:02.031 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.029+0000 7f190dff6640 1 -- 172.21.15.18:0/3063978504 wait complete. 2024-09-19T09:25:02.041 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:25:02.143 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.142+0000 7f141f2c9640 1 Processor -- start 2024-09-19T09:25:02.144 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.143+0000 7f141f2c9640 1 -- start start 2024-09-19T09:25:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.143+0000 7f141f2c9640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f141815ef50 0x7f14180d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.143+0000 7f141f2c9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14180d3240 0x7f14180d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.143+0000 7f141f2c9640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f14180d5780 0x7f14180cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.143+0000 7f141f2c9640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f14180b7a90 con 0x7f141815ef50 2024-09-19T09:25:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.143+0000 7f141f2c9640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f14180d3740 con 0x7f14180d5780 2024-09-19T09:25:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.143+0000 7f141f2c9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f14180d3a20 con 0x7f14180d3240 2024-09-19T09:25:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.143+0000 7f141d065640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f141815ef50 0x7f14180d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.143+0000 7f141d065640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f141815ef50 0x7f14180d13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40388/0 (socket says 172.21.15.18:40388) 2024-09-19T09:25:02.145 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.144+0000 7f141d065640 1 -- 172.21.15.18:0/1478751403 learned_addr learned my addr 172.21.15.18:0/1478751403 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:02.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.144+0000 7f141d866640 1 --2- 172.21.15.18:0/1478751403 >> v2:172.21.15.162:3300/0 conn(0x7f14180d5780 0x7f14180cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:02.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.144+0000 7f141c864640 1 --2- 172.21.15.18:0/1478751403 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14180d3240 0x7f14180d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:02.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.144+0000 7f141d065640 1 -- 172.21.15.18:0/1478751403 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14180d3240 msgr2=0x7f14180d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:02.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.144+0000 7f141d065640 1 --2- 172.21.15.18:0/1478751403 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14180d3240 0x7f14180d18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.144+0000 7f141d065640 1 -- 172.21.15.18:0/1478751403 >> v2:172.21.15.162:3300/0 conn(0x7f14180d5780 msgr2=0x7f14180cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:02.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.144+0000 7f141d065640 1 --2- 172.21.15.18:0/1478751403 >> v2:172.21.15.162:3300/0 conn(0x7f14180d5780 0x7f14180cf770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.146 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.144+0000 7f141d065640 1 -- 172.21.15.18:0/1478751403 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14180b7d00 con 0x7f141815ef50 2024-09-19T09:25:02.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.144+0000 7f141d065640 1 --2- 172.21.15.18:0/1478751403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f141815ef50 0x7f14180d13a0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f141808d790 tx=0x7f140802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e10a32c3c4f06ffb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:02.147 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.145+0000 7f1417fff640 1 -- 172.21.15.18:0/1478751403 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1408036070 con 0x7f141815ef50 2024-09-19T09:25:02.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.145+0000 7f1417fff640 1 -- 172.21.15.18:0/1478751403 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1408031600 con 0x7f141815ef50 2024-09-19T09:25:02.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.145+0000 7f1417fff640 1 -- 172.21.15.18:0/1478751403 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14080319d0 con 0x7f141815ef50 2024-09-19T09:25:02.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.145+0000 7f141f2c9640 1 -- 172.21.15.18:0/1478751403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f141815ef50 msgr2=0x7f14180d13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:02.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.145+0000 7f141f2c9640 1 --2- 172.21.15.18:0/1478751403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f141815ef50 0x7f14180d13a0 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f141808d790 tx=0x7f140802a610 comp rx=0 tx=0).stop 2024-09-19T09:25:02.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.145+0000 7f141f2c9640 1 -- 172.21.15.18:0/1478751403 shutdown_connections 2024-09-19T09:25:02.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.145+0000 7f141f2c9640 1 --2- 172.21.15.18:0/1478751403 >> v2:172.21.15.162:3300/0 conn(0x7f14180d5780 0x7f14180cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.145+0000 7f141f2c9640 1 --2- 172.21.15.18:0/1478751403 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14180d3240 0x7f14180d18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.145+0000 7f141f2c9640 1 --2- 172.21.15.18:0/1478751403 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f141815ef50 0x7f14180d13a0 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.145+0000 7f141f2c9640 1 -- 172.21.15.18:0/1478751403 >> 172.21.15.18:0/1478751403 conn(0x7f14180d4c60 msgr2=0x7f14180d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:02.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.145+0000 7f141f2c9640 1 -- 172.21.15.18:0/1478751403 shutdown_connections 2024-09-19T09:25:02.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.145+0000 7f141f2c9640 1 -- 172.21.15.18:0/1478751403 wait complete. 2024-09-19T09:25:02.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.147+0000 7f141f2c9640 1 Processor -- start 2024-09-19T09:25:02.148 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.147+0000 7f141f2c9640 1 -- start start 2024-09-19T09:25:02.150 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.147+0000 7f141f2c9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14180d3240 0x7f1418155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:02.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.147+0000 7f141f2c9640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14180d5780 0x7f14181e9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:02.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.147+0000 7f141f2c9640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f141815ef50 0x7f14181e6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:02.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.147+0000 7f141f2c9640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f14180d21a0 con 0x7f141815ef50 2024-09-19T09:25:02.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.147+0000 7f141f2c9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f14180d2020 con 0x7f14180d3240 2024-09-19T09:25:02.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.147+0000 7f141f2c9640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f14180cfcb0 con 0x7f14180d5780 2024-09-19T09:25:02.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.147+0000 7f141d866640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f141815ef50 0x7f14181e6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:02.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.148+0000 7f141d065640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14180d3240 0x7f1418155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:02.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.147+0000 7f141d866640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f141815ef50 0x7f14181e6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40392/0 (socket says 172.21.15.18:40392) 2024-09-19T09:25:02.151 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.148+0000 7f141d866640 1 -- 172.21.15.18:0/4243626529 learned_addr learned my addr 172.21.15.18:0/4243626529 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.148+0000 7f141c864640 1 --2- 172.21.15.18:0/4243626529 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14180d5780 0x7f14181e9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.148+0000 7f141d866640 1 -- 172.21.15.18:0/4243626529 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14180d5780 msgr2=0x7f14181e9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.148+0000 7f141d866640 1 --2- 172.21.15.18:0/4243626529 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14180d5780 0x7f14181e9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.148+0000 7f141d866640 1 -- 172.21.15.18:0/4243626529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14180d3240 msgr2=0x7f1418155ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.148+0000 7f141d866640 1 --2- 172.21.15.18:0/4243626529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14180d3240 0x7f1418155ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.148+0000 7f141d866640 1 -- 172.21.15.18:0/4243626529 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14181e7f40 con 0x7f141815ef50 2024-09-19T09:25:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.148+0000 7f141d866640 1 --2- 172.21.15.18:0/4243626529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f141815ef50 0x7f14181e6010 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f141000d800 tx=0x7f141000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.148+0000 7f1415ffb640 1 -- 172.21.15.18:0/4243626529 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141000b6c0 con 0x7f141815ef50 2024-09-19T09:25:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.148+0000 7f1415ffb640 1 -- 172.21.15.18:0/4243626529 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1410019070 con 0x7f141815ef50 2024-09-19T09:25:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.148+0000 7f141f2c9640 1 -- 172.21.15.18:0/4243626529 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14181e8220 con 0x7f141815ef50 2024-09-19T09:25:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.148+0000 7f1415ffb640 1 -- 172.21.15.18:0/4243626529 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141000bac0 con 0x7f141815ef50 2024-09-19T09:25:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.148+0000 7f141f2c9640 1 -- 172.21.15.18:0/4243626529 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14181e87e0 con 0x7f141815ef50 2024-09-19T09:25:02.152 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.149+0000 7f141f2c9640 1 -- 172.21.15.18:0/4243626529 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14180cf770 con 0x7f141815ef50 2024-09-19T09:25:02.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.150+0000 7f1415ffb640 1 -- 172.21.15.18:0/4243626529 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f141000bc60 con 0x7f141815ef50 2024-09-19T09:25:02.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.150+0000 7f1415ffb640 1 --2- 172.21.15.18:0/4243626529 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f140406c2b0 0x7f140406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:02.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.150+0000 7f1415ffb640 1 -- 172.21.15.18:0/4243626529 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5709+0+0 (secure 0 0 0) 0x7f141008b740 con 0x7f141815ef50 2024-09-19T09:25:02.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.151+0000 7f141d065640 1 --2- 172.21.15.18:0/4243626529 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f140406c2b0 0x7f140406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:02.153 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.151+0000 7f141d065640 1 --2- 172.21.15.18:0/4243626529 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f140406c2b0 0x7f140406e770 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1408033000 tx=0x7f1408009000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:02.155 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.155+0000 7f1415ffb640 1 -- 172.21.15.18:0/4243626529 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f1410059860 con 0x7f141815ef50 2024-09-19T09:25:02.311 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:25:02.314 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:25:02.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.334+0000 7f141f2c9640 1 -- 172.21.15.18:0/4243626529 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f14180b5e70 con 0x7f141815ef50 2024-09-19T09:25:02.336 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.335+0000 7f1415ffb640 1 -- 172.21.15.18:0/4243626529 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v185) ==== 74+0+16759 (secure 0 0 0) 0x7f141005db60 con 0x7f141815ef50 2024-09-19T09:25:02.336 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:25:02.336 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":185,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:24:56.278624+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-19T09:24:23.190145+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"181","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-19T09:24:24.517971+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:25:02.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.337+0000 7f141f2c9640 1 -- 172.21.15.18:0/4243626529 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f140406c2b0 msgr2=0x7f140406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:02.338 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.337+0000 7f141f2c9640 1 --2- 172.21.15.18:0/4243626529 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f140406c2b0 0x7f140406e770 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1408033000 tx=0x7f1408009000 comp rx=0 tx=0).stop 2024-09-19T09:25:02.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.337+0000 7f141f2c9640 1 -- 172.21.15.18:0/4243626529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f141815ef50 msgr2=0x7f14181e6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:02.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.337+0000 7f141f2c9640 1 --2- 172.21.15.18:0/4243626529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f141815ef50 0x7f14181e6010 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f141000d800 tx=0x7f141000dcc0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.337+0000 7f141f2c9640 1 -- 172.21.15.18:0/4243626529 shutdown_connections 2024-09-19T09:25:02.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.337+0000 7f141f2c9640 1 --2- 172.21.15.18:0/4243626529 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f140406c2b0 0x7f140406e770 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.337+0000 7f141f2c9640 1 --2- 172.21.15.18:0/4243626529 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f141815ef50 0x7f14181e6010 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.337+0000 7f141f2c9640 1 --2- 172.21.15.18:0/4243626529 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f14180d5780 0x7f14181e9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.337+0000 7f141f2c9640 1 --2- 172.21.15.18:0/4243626529 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f14180d3240 0x7f1418155ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.337+0000 7f141f2c9640 1 -- 172.21.15.18:0/4243626529 >> 172.21.15.18:0/4243626529 conn(0x7f14180d4c60 msgr2=0x7f14181580b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:02.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.337+0000 7f141f2c9640 1 -- 172.21.15.18:0/4243626529 shutdown_connections 2024-09-19T09:25:02.339 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.337+0000 7f141f2c9640 1 -- 172.21.15.18:0/4243626529 wait complete. 2024-09-19T09:25:02.350 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-19T09:25:02.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.511+0000 7f2c0619f640 1 Processor -- start 2024-09-19T09:25:02.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.511+0000 7f2c0619f640 1 -- start start 2024-09-19T09:25:02.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.512+0000 7f2c0619f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2c00163240 0x7f2c000d2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:02.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.512+0000 7f2c0619f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c000d2b40 0x7f2c000d3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:02.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.512+0000 7f2c0619f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2c000d3550 0x7f2c000d0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:02.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.512+0000 7f2c0619f640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f2c000b60c0 con 0x7f2c000d3550 2024-09-19T09:25:02.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.512+0000 7f2c0619f640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2c000d0aa0 con 0x7f2c00163240 2024-09-19T09:25:02.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.512+0000 7f2c0619f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2c000cfa00 con 0x7f2c000d2b40 2024-09-19T09:25:02.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.512+0000 7f2c0599e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2c000d3550 0x7f2c000d0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:02.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.512+0000 7f2c0599e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f2c000d3550 0x7f2c000d0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40408/0 (socket says 172.21.15.18:40408) 2024-09-19T09:25:02.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.512+0000 7f2c0599e640 1 -- 172.21.15.18:0/1688056096 learned_addr learned my addr 172.21.15.18:0/1688056096 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:02.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.512+0000 7f2c0519d640 1 --2- 172.21.15.18:0/1688056096 >> v2:172.21.15.162:3300/0 conn(0x7f2c00163240 0x7f2c000d2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:02.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.512+0000 7f2c0499c640 1 --2- 172.21.15.18:0/1688056096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c000d2b40 0x7f2c000d3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:02.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.512+0000 7f2c0599e640 1 -- 172.21.15.18:0/1688056096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c000d2b40 msgr2=0x7f2c000d3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:02.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.512+0000 7f2c0599e640 1 --2- 172.21.15.18:0/1688056096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c000d2b40 0x7f2c000d3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.512+0000 7f2c0599e640 1 -- 172.21.15.18:0/1688056096 >> v2:172.21.15.162:3300/0 conn(0x7f2c00163240 msgr2=0x7f2c000d2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:02.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.512+0000 7f2c0599e640 1 --2- 172.21.15.18:0/1688056096 >> v2:172.21.15.162:3300/0 conn(0x7f2c00163240 0x7f2c000d2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.512+0000 7f2c0599e640 1 -- 172.21.15.18:0/1688056096 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c000cfce0 con 0x7f2c000d3550 2024-09-19T09:25:02.514 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.512+0000 7f2c0499c640 1 --2- 172.21.15.18:0/1688056096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c000d2b40 0x7f2c000d3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:02.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.513+0000 7f2c0599e640 1 --2- 172.21.15.18:0/1688056096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c000d3550 0x7f2c000d0ed0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f2c0008db60 tx=0x7f2bf802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2459fe398f1b91b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:02.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.513+0000 7f2bf7fff640 1 -- 172.21.15.18:0/1688056096 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf8036070 con 0x7f2c000d3550 2024-09-19T09:25:02.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.513+0000 7f2bf7fff640 1 -- 172.21.15.18:0/1688056096 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bf8031600 con 0x7f2c000d3550 2024-09-19T09:25:02.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.513+0000 7f2bf7fff640 1 -- 172.21.15.18:0/1688056096 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf80319d0 con 0x7f2c000d3550 2024-09-19T09:25:02.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.514+0000 7f2c0619f640 1 -- 172.21.15.18:0/1688056096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c000d3550 msgr2=0x7f2c000d0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:02.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.514+0000 7f2c0619f640 1 --2- 172.21.15.18:0/1688056096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c000d3550 0x7f2c000d0ed0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f2c0008db60 tx=0x7f2bf802a6a0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.514+0000 7f2c0619f640 1 -- 172.21.15.18:0/1688056096 shutdown_connections 2024-09-19T09:25:02.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.514+0000 7f2c0619f640 1 --2- 172.21.15.18:0/1688056096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c000d3550 0x7f2c000d0ed0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.514+0000 7f2c0619f640 1 --2- 172.21.15.18:0/1688056096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c000d2b40 0x7f2c000d3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.514+0000 7f2c0619f640 1 --2- 172.21.15.18:0/1688056096 >> v2:172.21.15.162:3300/0 conn(0x7f2c00163240 0x7f2c000d2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.514+0000 7f2c0619f640 1 -- 172.21.15.18:0/1688056096 >> 172.21.15.18:0/1688056096 conn(0x7f2c0009dd70 msgr2=0x7f2c000d4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:02.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.514+0000 7f2c0619f640 1 -- 172.21.15.18:0/1688056096 shutdown_connections 2024-09-19T09:25:02.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.514+0000 7f2c0619f640 1 -- 172.21.15.18:0/1688056096 wait complete. 2024-09-19T09:25:02.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.515+0000 7f2c0619f640 1 Processor -- start 2024-09-19T09:25:02.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.515+0000 7f2c0619f640 1 -- start start 2024-09-19T09:25:02.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.516+0000 7f2c0619f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c000d2b40 0x7f2c000c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:02.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.516+0000 7f2c0619f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c000d3550 0x7f2c00159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:02.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.516+0000 7f2c0619f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c00163240 0x7f2c00158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:02.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.516+0000 7f2c0619f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f2c000d0580 con 0x7f2c000d3550 2024-09-19T09:25:02.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.516+0000 7f2c0619f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2c000d02a0 con 0x7f2c000d2b40 2024-09-19T09:25:02.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.516+0000 7f2c0619f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f2c000cf6f0 con 0x7f2c00163240 2024-09-19T09:25:02.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.516+0000 7f2c0499c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c000d3550 0x7f2c00159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:02.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.516+0000 7f2c0499c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c000d3550 0x7f2c00159ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40422/0 (socket says 172.21.15.18:40422) 2024-09-19T09:25:02.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.516+0000 7f2c0499c640 1 -- 172.21.15.18:0/2173538399 learned_addr learned my addr 172.21.15.18:0/2173538399 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:02.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.516+0000 7f2c0519d640 1 --2- 172.21.15.18:0/2173538399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c000d2b40 0x7f2c000c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:02.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.516+0000 7f2c0499c640 1 -- 172.21.15.18:0/2173538399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c00163240 msgr2=0x7f2c00158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:02.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.516+0000 7f2c0499c640 1 --2- 172.21.15.18:0/2173538399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c00163240 0x7f2c00158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.516+0000 7f2c0499c640 1 -- 172.21.15.18:0/2173538399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c000d2b40 msgr2=0x7f2c000c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:02.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.516+0000 7f2c0499c640 1 --2- 172.21.15.18:0/2173538399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c000d2b40 0x7f2c000c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.516+0000 7f2c0499c640 1 -- 172.21.15.18:0/2173538399 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c000ca320 con 0x7f2c000d3550 2024-09-19T09:25:02.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.516+0000 7f2c0519d640 1 --2- 172.21.15.18:0/2173538399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c000d2b40 0x7f2c000c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:25:02.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.516+0000 7f2c0499c640 1 --2- 172.21.15.18:0/2173538399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c000d3550 0x7f2c00159ad0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f2bf000e810 tx=0x7f2bf000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:02.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.517+0000 7f2bf5ffb640 1 -- 172.21.15.18:0/2173538399 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf0017070 con 0x7f2c000d3550 2024-09-19T09:25:02.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.517+0000 7f2bf5ffb640 1 -- 172.21.15.18:0/2173538399 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bf000c6d0 con 0x7f2c000d3550 2024-09-19T09:25:02.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.517+0000 7f2bf5ffb640 1 -- 172.21.15.18:0/2173538399 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf000f040 con 0x7f2c000d3550 2024-09-19T09:25:02.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.517+0000 7f2c0619f640 1 -- 172.21.15.18:0/2173538399 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c000ca600 con 0x7f2c000d3550 2024-09-19T09:25:02.520 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.517+0000 7f2c0619f640 1 -- 172.21.15.18:0/2173538399 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c000cabc0 con 0x7f2c000d3550 2024-09-19T09:25:02.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.518+0000 7f2c0619f640 1 -- 172.21.15.18:0/2173538399 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c000d2100 con 0x7f2c000d3550 2024-09-19T09:25:02.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.518+0000 7f2bf5ffb640 1 -- 172.21.15.18:0/2173538399 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f2bf001a070 con 0x7f2c000d3550 2024-09-19T09:25:02.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.519+0000 7f2bf5ffb640 1 --2- 172.21.15.18:0/2173538399 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2be406c2e0 0x7f2be406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:02.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.519+0000 7f2bf5ffb640 1 -- 172.21.15.18:0/2173538399 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(185..185 src has 1..185) ==== 5709+0+0 (secure 0 0 0) 0x7f2bf008b010 con 0x7f2c000d3550 2024-09-19T09:25:02.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.519+0000 7f2c0519d640 1 --2- 172.21.15.18:0/2173538399 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2be406c2e0 0x7f2be406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:02.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.520+0000 7f2c0519d640 1 --2- 172.21.15.18:0/2173538399 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2be406c2e0 0x7f2be406e7a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc009a20 tx=0x7f2bfc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:02.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.523+0000 7f2bf5ffb640 1 -- 172.21.15.18:0/2173538399 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f2bf00596e0 con 0x7f2c000d3550 2024-09-19T09:25:02.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.733+0000 7f2c0619f640 1 -- 172.21.15.18:0/2173538399 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f2c000c8200 con 0x7f2c000d3550 2024-09-19T09:25:02.734 INFO:tasks.ceph.mon.a.smithi018.stderr:2024-09-19T09:25:02.733+0000 7fca8a79c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:25:02.735 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.735+0000 7f2bf5ffb640 1 -- 172.21.15.18:0/2173538399 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v83) ==== 161+0+0 (secure 0 0 0) 0x7f2bf0058fe0 con 0x7f2c000d3550 2024-09-19T09:25:02.735 INFO:teuthology.orchestra.run.smithi018.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T09:25:02.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.737+0000 7f2c0619f640 1 -- 172.21.15.18:0/2173538399 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2be406c2e0 msgr2=0x7f2be406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:02.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.737+0000 7f2c0619f640 1 --2- 172.21.15.18:0/2173538399 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2be406c2e0 0x7f2be406e7a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc009a20 tx=0x7f2bfc008040 comp rx=0 tx=0).stop 2024-09-19T09:25:02.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.737+0000 7f2c0619f640 1 -- 172.21.15.18:0/2173538399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c000d3550 msgr2=0x7f2c00159ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:02.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.737+0000 7f2c0619f640 1 --2- 172.21.15.18:0/2173538399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c000d3550 0x7f2c00159ad0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f2bf000e810 tx=0x7f2bf000ecd0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.737+0000 7f2c0619f640 1 -- 172.21.15.18:0/2173538399 shutdown_connections 2024-09-19T09:25:02.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.737+0000 7f2c0619f640 1 --2- 172.21.15.18:0/2173538399 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f2be406c2e0 0x7f2be406e7a0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.737+0000 7f2c0619f640 1 --2- 172.21.15.18:0/2173538399 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f2c00163240 0x7f2c00158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.737+0000 7f2c0619f640 1 --2- 172.21.15.18:0/2173538399 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f2c000d3550 0x7f2c00159ad0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.737+0000 7f2c0619f640 1 --2- 172.21.15.18:0/2173538399 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2c000d2b40 0x7f2c000c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.737+0000 7f2c0619f640 1 -- 172.21.15.18:0/2173538399 >> 172.21.15.18:0/2173538399 conn(0x7f2c0009dd70 msgr2=0x7f2c0006d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:02.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.737+0000 7f2c0619f640 1 -- 172.21.15.18:0/2173538399 shutdown_connections 2024-09-19T09:25:02.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.737+0000 7f2c0619f640 1 -- 172.21.15.18:0/2173538399 wait complete. 2024-09-19T09:25:02.742 INFO:tasks.ceph.mds.a.smithi018.stderr: -9601> 2024-09-19T09:24:28.158+0000 7fcfdc109640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T09:25:02.752 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T09:25:02.777 INFO:tasks.ceph.mds.a.smithi018.stdout:starting mds.a at 2024-09-19T09:25:02.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.856+0000 7fa86ae50640 1 Processor -- start 2024-09-19T09:25:02.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.856+0000 7fa86ae50640 1 -- start start 2024-09-19T09:25:02.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.857+0000 7fa86ae50640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa86415c670 0x7fa8640b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:02.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.857+0000 7fa86ae50640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa86415f1a0 0x7fa86406d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:02.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.857+0000 7fa86ae50640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa86406dce0 0x7fa8641627e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:02.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.857+0000 7fa86ae50640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fa8640b6a60 con 0x7fa86406dce0 2024-09-19T09:25:02.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.857+0000 7fa86ae50640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa8640b6d40 con 0x7fa86415c670 2024-09-19T09:25:02.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.857+0000 7fa86ae50640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa8640b7020 con 0x7fa86415f1a0 2024-09-19T09:25:02.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.857+0000 7fa8693ed640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa86406dce0 0x7fa8641627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:02.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.857+0000 7fa8693ed640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fa86406dce0 0x7fa8641627e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40438/0 (socket says 172.21.15.18:40438) 2024-09-19T09:25:02.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.857+0000 7fa8693ed640 1 -- 172.21.15.18:0/2336089309 learned_addr learned my addr 172.21.15.18:0/2336089309 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:02.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.857+0000 7fa8693ed640 1 -- 172.21.15.18:0/2336089309 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa86415f1a0 msgr2=0x7fa86406d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:02.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.857+0000 7fa8693ed640 1 --2- 172.21.15.18:0/2336089309 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa86415f1a0 0x7fa86406d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.857+0000 7fa8693ed640 1 -- 172.21.15.18:0/2336089309 >> v2:172.21.15.162:3300/0 conn(0x7fa86415c670 msgr2=0x7fa8640b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:02.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.857+0000 7fa8693ed640 1 --2- 172.21.15.18:0/2336089309 >> v2:172.21.15.162:3300/0 conn(0x7fa86415c670 0x7fa8640b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.857+0000 7fa8693ed640 1 -- 172.21.15.18:0/2336089309 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8640b7300 con 0x7fa86406dce0 2024-09-19T09:25:02.860 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.858+0000 7fa8693ed640 1 --2- 172.21.15.18:0/2336089309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa86406dce0 0x7fa8641627e0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fa8640728c0 tx=0x7fa85c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197f754297d94887 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:02.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.858+0000 7fa8637fe640 1 -- 172.21.15.18:0/2336089309 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85c036070 con 0x7fa86406dce0 2024-09-19T09:25:02.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.858+0000 7fa8637fe640 1 -- 172.21.15.18:0/2336089309 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa85c031600 con 0x7fa86406dce0 2024-09-19T09:25:02.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.858+0000 7fa8637fe640 1 -- 172.21.15.18:0/2336089309 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa85c0319d0 con 0x7fa86406dce0 2024-09-19T09:25:02.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.859+0000 7fa86ae50640 1 -- 172.21.15.18:0/2336089309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa86406dce0 msgr2=0x7fa8641627e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:02.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.859+0000 7fa86ae50640 1 --2- 172.21.15.18:0/2336089309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa86406dce0 0x7fa8641627e0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fa8640728c0 tx=0x7fa85c02a6a0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.859+0000 7fa86ae50640 1 -- 172.21.15.18:0/2336089309 shutdown_connections 2024-09-19T09:25:02.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.859+0000 7fa86ae50640 1 --2- 172.21.15.18:0/2336089309 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa86406dce0 0x7fa8641627e0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.859+0000 7fa86ae50640 1 --2- 172.21.15.18:0/2336089309 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa86415f1a0 0x7fa86406d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.859+0000 7fa86ae50640 1 --2- 172.21.15.18:0/2336089309 >> v2:172.21.15.162:3300/0 conn(0x7fa86415c670 0x7fa8640b6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.859+0000 7fa86ae50640 1 -- 172.21.15.18:0/2336089309 >> 172.21.15.18:0/2336089309 conn(0x7fa86409b9d0 msgr2=0x7fa86409bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:02.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.859+0000 7fa86ae50640 1 -- 172.21.15.18:0/2336089309 shutdown_connections 2024-09-19T09:25:02.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.859+0000 7fa86ae50640 1 -- 172.21.15.18:0/2336089309 wait complete. 2024-09-19T09:25:02.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.860+0000 7fa86ae50640 1 Processor -- start 2024-09-19T09:25:02.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.860+0000 7fa86ae50640 1 -- start start 2024-09-19T09:25:02.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.861+0000 7fa86ae50640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa86406dce0 0x7fa8640ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:02.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.861+0000 7fa86ae50640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa86415c670 0x7fa86415e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:02.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.861+0000 7fa86ae50640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa86415f1a0 0x7fa86414a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:02.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.861+0000 7fa86ae50640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa8640b7b00 con 0x7fa86406dce0 2024-09-19T09:25:02.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.861+0000 7fa86ae50640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa86409c560 con 0x7fa86415f1a0 2024-09-19T09:25:02.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.861+0000 7fa86ae50640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa8640cd900 con 0x7fa86415c670 2024-09-19T09:25:02.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.861+0000 7fa868bec640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa86406dce0 0x7fa8640ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:02.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.861+0000 7fa868bec640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa86406dce0 0x7fa8640ce6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40440/0 (socket says 172.21.15.18:40440) 2024-09-19T09:25:02.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.861+0000 7fa868bec640 1 -- 172.21.15.18:0/3584660672 learned_addr learned my addr 172.21.15.18:0/3584660672 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:02.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.861+0000 7fa8693ed640 1 --2- 172.21.15.18:0/3584660672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa86415f1a0 0x7fa86414a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:02.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.861+0000 7fa863fff640 1 --2- 172.21.15.18:0/3584660672 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa86415c670 0x7fa86415e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:02.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.861+0000 7fa868bec640 1 -- 172.21.15.18:0/3584660672 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa86415c670 msgr2=0x7fa86415e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:02.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.861+0000 7fa868bec640 1 --2- 172.21.15.18:0/3584660672 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa86415c670 0x7fa86415e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.861+0000 7fa868bec640 1 -- 172.21.15.18:0/3584660672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa86415f1a0 msgr2=0x7fa86414a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:02.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.861+0000 7fa868bec640 1 --2- 172.21.15.18:0/3584660672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa86415f1a0 0x7fa86414a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:02.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.861+0000 7fa868bec640 1 -- 172.21.15.18:0/3584660672 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8640cdbe0 con 0x7fa86406dce0 2024-09-19T09:25:02.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.862+0000 7fa868bec640 1 --2- 172.21.15.18:0/3584660672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa86406dce0 0x7fa8640ce6c0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fa85800b4a0 tx=0x7fa85800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:02.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.862+0000 7fa8617fa640 1 -- 172.21.15.18:0/3584660672 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa858014070 con 0x7fa86406dce0 2024-09-19T09:25:02.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.862+0000 7fa8617fa640 1 -- 172.21.15.18:0/3584660672 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa858010610 con 0x7fa86406dce0 2024-09-19T09:25:02.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.862+0000 7fa86ae50640 1 -- 172.21.15.18:0/3584660672 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8640cdec0 con 0x7fa86406dce0 2024-09-19T09:25:02.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.862+0000 7fa8617fa640 1 -- 172.21.15.18:0/3584660672 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa858010a00 con 0x7fa86406dce0 2024-09-19T09:25:02.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.862+0000 7fa86ae50640 1 -- 172.21.15.18:0/3584660672 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8640cec00 con 0x7fa86406dce0 2024-09-19T09:25:02.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.863+0000 7fa86ae50640 1 -- 172.21.15.18:0/3584660672 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa86415ca50 con 0x7fa86406dce0 2024-09-19T09:25:02.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.863+0000 7fa8617fa640 1 -- 172.21.15.18:0/3584660672 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa858017070 con 0x7fa86406dce0 2024-09-19T09:25:02.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.864+0000 7fa8617fa640 1 --2- 172.21.15.18:0/3584660672 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa84806c2b0 0x7fa84806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:02.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.864+0000 7fa8617fa640 1 -- 172.21.15.18:0/3584660672 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(186..186 src has 1..186) ==== 5795+0+0 (secure 0 0 0) 0x7fa85808af10 con 0x7fa86406dce0 2024-09-19T09:25:02.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.864+0000 7fa863fff640 1 --2- 172.21.15.18:0/3584660672 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa84806c2b0 0x7fa84806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:02.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.864+0000 7fa863fff640 1 --2- 172.21.15.18:0/3584660672 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa84806c2b0 0x7fa84806e770 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa86415ee70 tx=0x7fa850008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:02.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:02.868+0000 7fa8617fa640 1 -- 172.21.15.18:0/3584660672 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fa858059620 con 0x7fa86406dce0 2024-09-19T09:25:03.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.082+0000 7fa86ae50640 1 -- 172.21.15.18:0/3584660672 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fa86415f8b0 con 0x7fa86406dce0 2024-09-19T09:25:03.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.736+0000 7fa8617fa640 1 -- 172.21.15.18:0/3584660672 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v84) ==== 104+0+0 (secure 0 0 0) 0x7fa858058f20 con 0x7fa86406dce0 2024-09-19T09:25:03.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.738+0000 7fa86ae50640 1 -- 172.21.15.18:0/3584660672 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa84806c2b0 msgr2=0x7fa84806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:03.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.739+0000 7fa86ae50640 1 --2- 172.21.15.18:0/3584660672 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa84806c2b0 0x7fa84806e770 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fa86415ee70 tx=0x7fa850008040 comp rx=0 tx=0).stop 2024-09-19T09:25:03.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.739+0000 7fa86ae50640 1 -- 172.21.15.18:0/3584660672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa86406dce0 msgr2=0x7fa8640ce6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:03.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.739+0000 7fa86ae50640 1 --2- 172.21.15.18:0/3584660672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa86406dce0 0x7fa8640ce6c0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fa85800b4a0 tx=0x7fa85800b960 comp rx=0 tx=0).stop 2024-09-19T09:25:03.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.739+0000 7fa86ae50640 1 -- 172.21.15.18:0/3584660672 shutdown_connections 2024-09-19T09:25:03.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.739+0000 7fa86ae50640 1 --2- 172.21.15.18:0/3584660672 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa84806c2b0 0x7fa84806e770 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:03.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.739+0000 7fa86ae50640 1 --2- 172.21.15.18:0/3584660672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa86415f1a0 0x7fa86414a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:03.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.739+0000 7fa86ae50640 1 --2- 172.21.15.18:0/3584660672 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa86415c670 0x7fa86415e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:03.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.739+0000 7fa86ae50640 1 --2- 172.21.15.18:0/3584660672 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa86406dce0 0x7fa8640ce6c0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:03.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.739+0000 7fa86ae50640 1 -- 172.21.15.18:0/3584660672 >> 172.21.15.18:0/3584660672 conn(0x7fa86409b9d0 msgr2=0x7fa8641607e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:03.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.739+0000 7fa86ae50640 1 -- 172.21.15.18:0/3584660672 shutdown_connections 2024-09-19T09:25:03.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.739+0000 7fa86ae50640 1 -- 172.21.15.18:0/3584660672 wait complete. 2024-09-19T09:25:03.754 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T09:25:03.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.905+0000 7f8c14d9f640 1 Processor -- start 2024-09-19T09:25:03.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.905+0000 7f8c14d9f640 1 -- start start 2024-09-19T09:25:03.908 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.905+0000 7f8c14d9f640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8c1015eb60 0x7f8c100d3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:03.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.905+0000 7f8c14d9f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f8c100d3590 0x7f8c100cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:03.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.905+0000 7f8c14d9f640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c100d0520 con 0x7f8c100cfd30 2024-09-19T09:25:03.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.905+0000 7f8c14d9f640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f8c100d3a00 con 0x7f8c1015eb60 2024-09-19T09:25:03.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.905+0000 7f8c14d9f640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f8c100d0800 con 0x7f8c100d3590 2024-09-19T09:25:03.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.906+0000 7f8c0f7fe640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8c1015eb60 0x7f8c100d3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:03.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.906+0000 7f8c0ffff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f8c100cfd30 0x7f8c100d1480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:55558/0 (socket says 172.21.15.18:55558) 2024-09-19T09:25:03.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.906+0000 7f8c0ffff640 1 -- 172.21.15.18:0/1591736215 learned_addr learned my addr 172.21.15.18:0/1591736215 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:25:03.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.906+0000 7f8c06ffd640 1 --2- 172.21.15.18:0/1591736215 >> v2:172.21.15.162:3300/0 conn(0x7f8c100d3590 0x7f8c100cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:03.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.906+0000 7f8c0f7fe640 1 -- 172.21.15.18:0/1591736215 >> v2:172.21.15.162:3300/0 conn(0x7f8c100d3590 msgr2=0x7f8c100cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:03.909 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.906+0000 7f8c0f7fe640 1 --2- 172.21.15.18:0/1591736215 >> v2:172.21.15.162:3300/0 conn(0x7f8c100d3590 0x7f8c100cf7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:03.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.906+0000 7f8c0f7fe640 1 -- 172.21.15.18:0/1591736215 >> v1:172.21.15.18:6789/0 conn(0x7f8c100cfd30 legacy=0x7f8c100d1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:03.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.906+0000 7f8c0f7fe640 1 -- 172.21.15.18:0/1591736215 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c100b7a60 con 0x7f8c1015eb60 2024-09-19T09:25:03.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.906+0000 7f8c0effd640 1 -- 172.21.15.18:0/1591736215 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1568873393 0 0) 0x7f8c100d0520 con 0x7f8c100cfd30 2024-09-19T09:25:03.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.907+0000 7f8c0f7fe640 1 --2- 172.21.15.18:0/1591736215 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c1015eb60 0x7f8c100d3050 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f8c100bab00 tx=0x7f8c0002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7500de3143f75c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:03.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.907+0000 7f8c0effd640 1 -- 172.21.15.18:0/1591736215 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c00037070 con 0x7f8c1015eb60 2024-09-19T09:25:03.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.907+0000 7f8c0effd640 1 -- 172.21.15.18:0/1591736215 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c00032440 con 0x7f8c1015eb60 2024-09-19T09:25:03.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.907+0000 7f8c0effd640 1 -- 172.21.15.18:0/1591736215 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c00032810 con 0x7f8c1015eb60 2024-09-19T09:25:03.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.907+0000 7f8c14d9f640 1 -- 172.21.15.18:0/1591736215 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c1015eb60 msgr2=0x7f8c100d3050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:03.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.907+0000 7f8c14d9f640 1 --2- 172.21.15.18:0/1591736215 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c1015eb60 0x7f8c100d3050 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f8c100bab00 tx=0x7f8c0002a230 comp rx=0 tx=0).stop 2024-09-19T09:25:03.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.907+0000 7f8c14d9f640 1 -- 172.21.15.18:0/1591736215 shutdown_connections 2024-09-19T09:25:03.910 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.907+0000 7f8c14d9f640 1 --2- 172.21.15.18:0/1591736215 >> v2:172.21.15.162:3300/0 conn(0x7f8c100d3590 0x7f8c100cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:03.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.907+0000 7f8c14d9f640 1 --2- 172.21.15.18:0/1591736215 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c1015eb60 0x7f8c100d3050 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:03.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.907+0000 7f8c14d9f640 1 -- 172.21.15.18:0/1591736215 >> 172.21.15.18:0/1591736215 conn(0x7f8c100d4a70 msgr2=0x7f8c100d4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:03.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.908+0000 7f8c14d9f640 1 -- 172.21.15.18:0/1591736215 shutdown_connections 2024-09-19T09:25:03.911 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.908+0000 7f8c14d9f640 1 -- 172.21.15.18:0/1591736215 wait complete. 2024-09-19T09:25:03.913 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.909+0000 7f8c14d9f640 1 Processor -- start 2024-09-19T09:25:03.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.909+0000 7f8c14d9f640 1 -- start start 2024-09-19T09:25:03.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.910+0000 7f8c14d9f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c100cfd30 0x7f8c100ba070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:03.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.910+0000 7f8c14d9f640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c100d3590 0x7f8c101f7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:03.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.910+0000 7f8c14d9f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c1015eb60 0x7f8c101f81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:03.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.910+0000 7f8c14d9f640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1015f0c0 con 0x7f8c1015eb60 2024-09-19T09:25:03.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.910+0000 7f8c14d9f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8c1015ef40 con 0x7f8c100cfd30 2024-09-19T09:25:03.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.910+0000 7f8c14d9f640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8c100d0180 con 0x7f8c100d3590 2024-09-19T09:25:03.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.910+0000 7f8c0ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c1015eb60 0x7f8c101f81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:03.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.910+0000 7f8c0ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c1015eb60 0x7f8c101f81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40456/0 (socket says 172.21.15.18:40456) 2024-09-19T09:25:03.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.910+0000 7f8c0ffff640 1 -- 172.21.15.18:0/13106467 learned_addr learned my addr 172.21.15.18:0/13106467 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:03.914 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.910+0000 7f8c0f7fe640 1 --2- 172.21.15.18:0/13106467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c100cfd30 0x7f8c100ba070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:03.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.910+0000 7f8c06ffd640 1 --2- 172.21.15.18:0/13106467 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c100d3590 0x7f8c101f7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:03.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.910+0000 7f8c0ffff640 1 -- 172.21.15.18:0/13106467 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c100d3590 msgr2=0x7f8c101f7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:03.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.910+0000 7f8c0ffff640 1 --2- 172.21.15.18:0/13106467 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c100d3590 0x7f8c101f7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:03.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.910+0000 7f8c0ffff640 1 -- 172.21.15.18:0/13106467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c100cfd30 msgr2=0x7f8c100ba070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:03.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.910+0000 7f8c0ffff640 1 --2- 172.21.15.18:0/13106467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c100cfd30 0x7f8c100ba070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:03.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.910+0000 7f8c0ffff640 1 -- 172.21.15.18:0/13106467 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c10159740 con 0x7f8c1015eb60 2024-09-19T09:25:03.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.910+0000 7f8c0ffff640 1 --2- 172.21.15.18:0/13106467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c1015eb60 0x7f8c101f81e0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f8c0800c7d0 tx=0x7f8c0800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:03.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.910+0000 7f8c0cff9640 1 -- 172.21.15.18:0/13106467 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c08018070 con 0x7f8c1015eb60 2024-09-19T09:25:03.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.910+0000 7f8c0cff9640 1 -- 172.21.15.18:0/13106467 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c0800a640 con 0x7f8c1015eb60 2024-09-19T09:25:03.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.910+0000 7f8c14d9f640 1 -- 172.21.15.18:0/13106467 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c101f8880 con 0x7f8c1015eb60 2024-09-19T09:25:03.915 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.911+0000 7f8c0cff9640 1 -- 172.21.15.18:0/13106467 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c0800aa70 con 0x7f8c1015eb60 2024-09-19T09:25:03.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.911+0000 7f8c14d9f640 1 -- 172.21.15.18:0/13106467 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c1009e7f0 con 0x7f8c1015eb60 2024-09-19T09:25:03.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.912+0000 7f8c14d9f640 1 -- 172.21.15.18:0/13106467 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c100cf7f0 con 0x7f8c1015eb60 2024-09-19T09:25:03.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.912+0000 7f8c0cff9640 1 -- 172.21.15.18:0/13106467 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f8c0801b070 con 0x7f8c1015eb60 2024-09-19T09:25:03.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.913+0000 7f8c0cff9640 1 --2- 172.21.15.18:0/13106467 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8bf006c2b0 0x7f8bf006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:03.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.913+0000 7f8c0cff9640 1 -- 172.21.15.18:0/13106467 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(186..186 src has 1..186) ==== 5795+0+0 (secure 0 0 0) 0x7f8c0808aae0 con 0x7f8c1015eb60 2024-09-19T09:25:03.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.913+0000 7f8c0f7fe640 1 --2- 172.21.15.18:0/13106467 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8bf006c2b0 0x7f8bf006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:03.916 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.913+0000 7f8c0f7fe640 1 --2- 172.21.15.18:0/13106467 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8bf006c2b0 0x7f8bf006e770 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8c00034000 tx=0x7f8c0002e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:03.918 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:03.917+0000 7f8c0cff9640 1 -- 172.21.15.18:0/13106467 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f8c080591f0 con 0x7f8c1015eb60 2024-09-19T09:25:04.097 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:04.096+0000 7f8c14d9f640 1 -- 172.21.15.18:0/13106467 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8c100b5940 con 0x7f8c1015eb60 2024-09-19T09:25:04.739 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:04.738+0000 7f8c0cff9640 1 -- 172.21.15.18:0/13106467 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v187) ==== 181+0+0 (secure 0 0 0) 0x7f8c08058af0 con 0x7f8c1015eb60 2024-09-19T09:25:04.904 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_metadata' removed 2024-09-19T09:25:04.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:04.740+0000 7f8c14d9f640 1 -- 172.21.15.18:0/13106467 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8bf006c2b0 msgr2=0x7f8bf006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:04.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:04.740+0000 7f8c14d9f640 1 --2- 172.21.15.18:0/13106467 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8bf006c2b0 0x7f8bf006e770 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f8c00034000 tx=0x7f8c0002e000 comp rx=0 tx=0).stop 2024-09-19T09:25:04.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:04.740+0000 7f8c14d9f640 1 -- 172.21.15.18:0/13106467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c1015eb60 msgr2=0x7f8c101f81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:04.906 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:04.740+0000 7f8c14d9f640 1 --2- 172.21.15.18:0/13106467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c1015eb60 0x7f8c101f81e0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f8c0800c7d0 tx=0x7f8c0800cc90 comp rx=0 tx=0).stop 2024-09-19T09:25:04.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:04.740+0000 7f8c14d9f640 1 -- 172.21.15.18:0/13106467 shutdown_connections 2024-09-19T09:25:04.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:04.740+0000 7f8c14d9f640 1 --2- 172.21.15.18:0/13106467 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f8bf006c2b0 0x7f8bf006e770 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:04.740+0000 7f8c14d9f640 1 --2- 172.21.15.18:0/13106467 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8c1015eb60 0x7f8c101f81e0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:04.740+0000 7f8c14d9f640 1 --2- 172.21.15.18:0/13106467 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8c100d3590 0x7f8c101f7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:04.740+0000 7f8c14d9f640 1 --2- 172.21.15.18:0/13106467 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8c100cfd30 0x7f8c100ba070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:04.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:04.740+0000 7f8c14d9f640 1 -- 172.21.15.18:0/13106467 >> 172.21.15.18:0/13106467 conn(0x7f8c100d4a70 msgr2=0x7f8c10074ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:04.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:04.741+0000 7f8c14d9f640 1 -- 172.21.15.18:0/13106467 shutdown_connections 2024-09-19T09:25:04.907 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:04.741+0000 7f8c14d9f640 1 -- 172.21.15.18:0/13106467 wait complete. 2024-09-19T09:25:04.907 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T09:25:05.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.035+0000 7f17f8552640 1 Processor -- start 2024-09-19T09:25:05.037 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.035+0000 7f17f8552640 1 -- start start 2024-09-19T09:25:05.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.036+0000 7f17f8552640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f17f015edb0 0x7f17f00d29e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:05.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.036+0000 7f17f8552640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f17f00d0370 0x7f17f00d3280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:05.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.036+0000 7f17f8552640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17f00d37c0 0x7f17f00d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:05.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.036+0000 7f17f8552640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f17f00b4400 con 0x7f17f00d0370 2024-09-19T09:25:05.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.036+0000 7f17f8552640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f17f00d0870 con 0x7f17f015edb0 2024-09-19T09:25:05.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.036+0000 7f17f8552640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f17f00d0b50 con 0x7f17f00d37c0 2024-09-19T09:25:05.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.037+0000 7f17f5aed640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f17f00d0370 0x7f17f00d3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:05.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.037+0000 7f17f5aed640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f17f00d0370 0x7f17f00d3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40472/0 (socket says 172.21.15.18:40472) 2024-09-19T09:25:05.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.037+0000 7f17f5aed640 1 -- 172.21.15.18:0/2784214411 learned_addr learned my addr 172.21.15.18:0/2784214411 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:05.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.037+0000 7f17f5aed640 1 -- 172.21.15.18:0/2784214411 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17f00d37c0 msgr2=0x7f17f00d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:05.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.037+0000 7f17f5aed640 1 --2- 172.21.15.18:0/2784214411 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17f00d37c0 0x7f17f00d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:05.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.037+0000 7f17f5aed640 1 -- 172.21.15.18:0/2784214411 >> v2:172.21.15.162:3300/0 conn(0x7f17f015edb0 msgr2=0x7f17f00d29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:05.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.037+0000 7f17f62ee640 1 --2- 172.21.15.18:0/2784214411 >> v2:172.21.15.162:3300/0 conn(0x7f17f015edb0 0x7f17f00d29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:05.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.037+0000 7f17f5aed640 1 --2- 172.21.15.18:0/2784214411 >> v2:172.21.15.162:3300/0 conn(0x7f17f015edb0 0x7f17f00d29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:05.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.037+0000 7f17f5aed640 1 -- 172.21.15.18:0/2784214411 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f00b4620 con 0x7f17f00d0370 2024-09-19T09:25:05.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.037+0000 7f17f62ee640 1 --2- 172.21.15.18:0/2784214411 >> v2:172.21.15.162:3300/0 conn(0x7f17f015edb0 0x7f17f00d29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:25:05.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.038+0000 7f17f5aed640 1 --2- 172.21.15.18:0/2784214411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17f00d0370 0x7f17f00d3280 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f17f008dd60 tx=0x7f17e402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41f79b10c6175b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:05.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.038+0000 7f17f52ec640 1 -- 172.21.15.18:0/2784214411 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e4037070 con 0x7f17f00d0370 2024-09-19T09:25:05.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.038+0000 7f17f52ec640 1 -- 172.21.15.18:0/2784214411 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17e4032440 con 0x7f17f00d0370 2024-09-19T09:25:05.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.038+0000 7f17f52ec640 1 -- 172.21.15.18:0/2784214411 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e4032810 con 0x7f17f00d0370 2024-09-19T09:25:05.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.038+0000 7f17f8552640 1 -- 172.21.15.18:0/2784214411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17f00d0370 msgr2=0x7f17f00d3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:05.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.038+0000 7f17f8552640 1 --2- 172.21.15.18:0/2784214411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17f00d0370 0x7f17f00d3280 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f17f008dd60 tx=0x7f17e402a1e0 comp rx=0 tx=0).stop 2024-09-19T09:25:05.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.038+0000 7f17f8552640 1 -- 172.21.15.18:0/2784214411 shutdown_connections 2024-09-19T09:25:05.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.038+0000 7f17f8552640 1 --2- 172.21.15.18:0/2784214411 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17f00d37c0 0x7f17f00d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:05.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.038+0000 7f17f8552640 1 --2- 172.21.15.18:0/2784214411 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17f00d0370 0x7f17f00d3280 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:05.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.038+0000 7f17f8552640 1 --2- 172.21.15.18:0/2784214411 >> v2:172.21.15.162:3300/0 conn(0x7f17f015edb0 0x7f17f00d29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:05.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.038+0000 7f17f8552640 1 -- 172.21.15.18:0/2784214411 >> 172.21.15.18:0/2784214411 conn(0x7f17f009df30 msgr2=0x7f17f00d4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:05.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.038+0000 7f17f8552640 1 -- 172.21.15.18:0/2784214411 shutdown_connections 2024-09-19T09:25:05.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.039+0000 7f17f8552640 1 -- 172.21.15.18:0/2784214411 wait complete. 2024-09-19T09:25:05.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.040+0000 7f17f8552640 1 Processor -- start 2024-09-19T09:25:05.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.040+0000 7f17f8552640 1 -- start start 2024-09-19T09:25:05.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.040+0000 7f17f8552640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17f00d0370 0x7f17f0152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:05.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.040+0000 7f17f8552640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17f00d37c0 0x7f17f00cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:05.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.040+0000 7f17f8552640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17f015edb0 0x7f17f00cc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:05.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.040+0000 7f17f8552640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f17f015f190 con 0x7f17f015edb0 2024-09-19T09:25:05.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.040+0000 7f17f8552640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f17f00b4be0 con 0x7f17f00d37c0 2024-09-19T09:25:05.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.040+0000 7f17f8552640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f17f00d2f20 con 0x7f17f00d0370 2024-09-19T09:25:05.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.041+0000 7f17f6aef640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17f015edb0 0x7f17f00cc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:05.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.041+0000 7f17f6aef640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17f015edb0 0x7f17f00cc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:40476/0 (socket says 172.21.15.18:40476) 2024-09-19T09:25:05.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.041+0000 7f17f6aef640 1 -- 172.21.15.18:0/1706116510 learned_addr learned my addr 172.21.15.18:0/1706116510 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:05.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.041+0000 7f17f62ee640 1 --2- 172.21.15.18:0/1706116510 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17f00d0370 0x7f17f0152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:05.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.041+0000 7f17f5aed640 1 --2- 172.21.15.18:0/1706116510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17f00d37c0 0x7f17f00cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:05.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.041+0000 7f17f6aef640 1 -- 172.21.15.18:0/1706116510 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17f00d0370 msgr2=0x7f17f0152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:05.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.041+0000 7f17f6aef640 1 --2- 172.21.15.18:0/1706116510 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17f00d0370 0x7f17f0152110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:05.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.041+0000 7f17f6aef640 1 -- 172.21.15.18:0/1706116510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17f00d37c0 msgr2=0x7f17f00cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:05.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.041+0000 7f17f6aef640 1 --2- 172.21.15.18:0/1706116510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17f00d37c0 0x7f17f00cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:05.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.041+0000 7f17f6aef640 1 -- 172.21.15.18:0/1706116510 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f015fd60 con 0x7f17f015edb0 2024-09-19T09:25:05.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.041+0000 7f17f6aef640 1 --2- 172.21.15.18:0/1706116510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17f015edb0 0x7f17f00cc2d0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f17e000b9a0 tx=0x7f17e000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:05.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.041+0000 7f17eeffd640 1 -- 172.21.15.18:0/1706116510 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e0019070 con 0x7f17f015edb0 2024-09-19T09:25:05.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.041+0000 7f17eeffd640 1 -- 172.21.15.18:0/1706116510 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17e000cbc0 con 0x7f17f015edb0 2024-09-19T09:25:05.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.041+0000 7f17eeffd640 1 -- 172.21.15.18:0/1706116510 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e0014440 con 0x7f17f015edb0 2024-09-19T09:25:05.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.041+0000 7f17f8552640 1 -- 172.21.15.18:0/1706116510 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f00ba280 con 0x7f17f015edb0 2024-09-19T09:25:05.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.041+0000 7f17f8552640 1 -- 172.21.15.18:0/1706116510 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f01f4880 con 0x7f17f015edb0 2024-09-19T09:25:05.053 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.042+0000 7f17f8552640 1 -- 172.21.15.18:0/1706116510 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17f00d3280 con 0x7f17f015edb0 2024-09-19T09:25:05.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.043+0000 7f17eeffd640 1 -- 172.21.15.18:0/1706116510 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f17e001c070 con 0x7f17f015edb0 2024-09-19T09:25:05.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.043+0000 7f17eeffd640 1 --2- 172.21.15.18:0/1706116510 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f17dc06c2b0 0x7f17dc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:05.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.043+0000 7f17eeffd640 1 -- 172.21.15.18:0/1706116510 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(187..187 src has 1..187) ==== 5357+0+0 (secure 0 0 0) 0x7f17e008af90 con 0x7f17f015edb0 2024-09-19T09:25:05.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.043+0000 7f17f62ee640 1 --2- 172.21.15.18:0/1706116510 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f17dc06c2b0 0x7f17dc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:05.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.044+0000 7f17f62ee640 1 --2- 172.21.15.18:0/1706116510 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f17dc06c2b0 0x7f17dc06e770 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f17e800a950 tx=0x7f17e8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:05.054 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.047+0000 7f17eeffd640 1 -- 172.21.15.18:0/1706116510 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f17e00598f0 con 0x7f17f015edb0 2024-09-19T09:25:05.223 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.222+0000 7f17f8552640 1 -- 172.21.15.18:0/1706116510 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f17f00b2640 con 0x7f17f015edb0 2024-09-19T09:25:05.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.739+0000 7f17eeffd640 1 -- 172.21.15.18:0/1706116510 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v188) ==== 169+0+0 (secure 0 0 0) 0x7f17e00591f0 con 0x7f17f015edb0 2024-09-19T09:25:05.741 INFO:teuthology.orchestra.run.smithi018.stderr:pool 'cephfs_data' removed 2024-09-19T09:25:05.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.742+0000 7f17f8552640 1 -- 172.21.15.18:0/1706116510 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f17dc06c2b0 msgr2=0x7f17dc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:05.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.742+0000 7f17f8552640 1 --2- 172.21.15.18:0/1706116510 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f17dc06c2b0 0x7f17dc06e770 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f17e800a950 tx=0x7f17e8008040 comp rx=0 tx=0).stop 2024-09-19T09:25:05.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.742+0000 7f17f8552640 1 -- 172.21.15.18:0/1706116510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17f015edb0 msgr2=0x7f17f00cc2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:05.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.742+0000 7f17f8552640 1 --2- 172.21.15.18:0/1706116510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17f015edb0 0x7f17f00cc2d0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f17e000b9a0 tx=0x7f17e000be60 comp rx=0 tx=0).stop 2024-09-19T09:25:05.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.742+0000 7f17f8552640 1 -- 172.21.15.18:0/1706116510 shutdown_connections 2024-09-19T09:25:05.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.742+0000 7f17f8552640 1 --2- 172.21.15.18:0/1706116510 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f17dc06c2b0 0x7f17dc06e770 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:05.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.742+0000 7f17f8552640 1 --2- 172.21.15.18:0/1706116510 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f17f015edb0 0x7f17f00cc2d0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:05.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.742+0000 7f17f8552640 1 --2- 172.21.15.18:0/1706116510 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f17f00d37c0 0x7f17f00cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:05.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.742+0000 7f17f8552640 1 --2- 172.21.15.18:0/1706116510 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f17f00d0370 0x7f17f0152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:05.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.742+0000 7f17f8552640 1 -- 172.21.15.18:0/1706116510 >> 172.21.15.18:0/1706116510 conn(0x7f17f009df30 msgr2=0x7f17f006dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:05.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.742+0000 7f17f8552640 1 -- 172.21.15.18:0/1706116510 shutdown_connections 2024-09-19T09:25:05.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.742+0000 7f17f8552640 1 -- 172.21.15.18:0/1706116510 wait complete. 2024-09-19T09:25:05.755 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-19T09:25:05.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.861+0000 7f3ff83f1640 1 Processor -- start 2024-09-19T09:25:05.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.861+0000 7f3ff83f1640 1 -- start start 2024-09-19T09:25:05.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.862+0000 7f3ff83f1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ff006deb0 0x7f3ff00b6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:05.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.862+0000 7f3ff83f1640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ff00b6a60 con 0x7f3ff015f1a0 2024-09-19T09:25:05.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.862+0000 7f3ff83f1640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ff00b6d40 con 0x7f3ff015c670 2024-09-19T09:25:05.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.862+0000 7f3ff83f1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3ff00b7020 con 0x7f3ff006deb0 2024-09-19T09:25:05.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.862+0000 7f3ff698e640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3ff015f1a0 0x7f3ff0160300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49616/0 (socket says 172.21.15.18:49616) 2024-09-19T09:25:05.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.862+0000 7f3ff698e640 1 -- 172.21.15.18:0/1887254491 learned_addr learned my addr 172.21.15.18:0/1887254491 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:25:05.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.862+0000 7f3ff518b640 1 -- 172.21.15.18:0/1887254491 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 737856151 0 0) 0x7f3ff00b6a60 con 0x7f3ff015f1a0 2024-09-19T09:25:05.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.862+0000 7f3ff518b640 1 -- 172.21.15.18:0/1887254491 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fdc003520 con 0x7f3ff015f1a0 2024-09-19T09:25:05.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.862+0000 7f3ff598c640 1 --2- 172.21.15.18:0/1887254491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ff006deb0 0x7f3ff00b6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:05.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.862+0000 7f3ff518b640 1 -- 172.21.15.18:0/1887254491 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 427277360 0 0) 0x7f3fdc003520 con 0x7f3ff015f1a0 2024-09-19T09:25:05.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.862+0000 7f3ff518b640 1 -- 172.21.15.18:0/1887254491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ff006deb0 msgr2=0x7f3ff00b6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:05.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.862+0000 7f3ff518b640 1 --2- 172.21.15.18:0/1887254491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ff006deb0 0x7f3ff00b6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:05.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.862+0000 7f3ff518b640 1 -- 172.21.15.18:0/1887254491 >> v1:172.21.15.162:6789/0 conn(0x7f3ff015c670 legacy=0x7f3ff006d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:05.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.862+0000 7f3ff518b640 1 -- 172.21.15.18:0/1887254491 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff00b7300 con 0x7f3ff015f1a0 2024-09-19T09:25:05.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.862+0000 7f3ff518b640 1 -- 172.21.15.18:0/1887254491 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f3fe80019f0 con 0x7f3ff015f1a0 2024-09-19T09:25:05.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.862+0000 7f3ff518b640 1 -- 172.21.15.18:0/1887254491 >> v1:172.21.15.18:6789/0 conn(0x7f3ff015f1a0 legacy=0x7f3ff0160300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:05.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.862+0000 7f3ff518b640 1 --2- 172.21.15.18:0/1887254491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ff006deb0 0x7f3fdc0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:05.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.862+0000 7f3ff518b640 1 --2- 172.21.15.18:0/1887254491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fdc004010 0x7f3fdc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:05.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.862+0000 7f3ff518b640 1 --2- 172.21.15.18:0/1887254491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fdc004d40 0x7f3fdc0051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:05.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.862+0000 7f3ff518b640 1 -- 172.21.15.18:0/1887254491 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff00b7020 con 0x7f3fdc004010 2024-09-19T09:25:05.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.862+0000 7f3ff518b640 1 -- 172.21.15.18:0/1887254491 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3fdc00bbb0 con 0x7f3fdc004d40 2024-09-19T09:25:05.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.862+0000 7f3ff518b640 1 -- 172.21.15.18:0/1887254491 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3fdc00bdb0 con 0x7f3ff006deb0 2024-09-19T09:25:05.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.863+0000 7f3ff598c640 1 --2- 172.21.15.18:0/1887254491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fdc004010 0x7f3fdc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:05.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.863+0000 7f3ff698e640 1 --2- 172.21.15.18:0/1887254491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fdc004d40 0x7f3fdc0051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:05.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.863+0000 7f3ff618d640 1 --2- 172.21.15.18:0/1887254491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ff006deb0 0x7f3fdc0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:05.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.863+0000 7f3ff598c640 1 -- 172.21.15.18:0/1887254491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ff006deb0 msgr2=0x7f3fdc0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:05.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.863+0000 7f3ff598c640 1 --2- 172.21.15.18:0/1887254491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ff006deb0 0x7f3fdc0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:05.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.863+0000 7f3ff598c640 1 -- 172.21.15.18:0/1887254491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fdc004d40 msgr2=0x7f3fdc0051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:05.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.863+0000 7f3ff598c640 1 --2- 172.21.15.18:0/1887254491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3fdc004d40 0x7f3fdc0051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:05.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.863+0000 7f3ff598c640 1 -- 172.21.15.18:0/1887254491 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fdc003520 con 0x7f3fdc004010 2024-09-19T09:25:05.866 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.863+0000 7f3ff618d640 1 --2- 172.21.15.18:0/1887254491 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3ff006deb0 0x7f3fdc0039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:05.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.866+0000 7f3ff598c640 1 --2- 172.21.15.18:0/1887254491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fdc004010 0x7f3fdc004800 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000ba30 tx=0x7f3fdc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2db92274f4dd1d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:05.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.866+0000 7f3ff518b640 1 -- 172.21.15.18:0/1887254491 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe0030070 con 0x7f3fdc004010 2024-09-19T09:25:05.868 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.866+0000 7f3ff518b640 1 -- 172.21.15.18:0/1887254491 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fe002ade0 con 0x7f3fdc004010 2024-09-19T09:25:05.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.866+0000 7f3ff518b640 1 -- 172.21.15.18:0/1887254491 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe0030070 con 0x7f3fdc004010 2024-09-19T09:25:05.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.868+0000 7f3ff83f1640 1 -- 172.21.15.18:0/1887254491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fdc004010 msgr2=0x7f3fdc004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:05.869 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.868+0000 7f3ff83f1640 1 --2- 172.21.15.18:0/1887254491 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3fdc004010 0x7f3fdc004800 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000ba30 tx=0x7f3fdc005830 comp rx=0 tx=0).stop 2024-09-19T09:25:05.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.868+0000 7f3ff698e640 1 -- 172.21.15.18:0/1887254491 reap_dead start 2024-09-19T09:25:05.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.869+0000 7f3ff83f1640 1 -- 172.21.15.18:0/1887254491 shutdown_connections 2024-09-19T09:25:05.870 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.869+0000 7f3ff83f1640 1 -- 172.21.15.18:0/1887254491 >> 172.21.15.18:0/1887254491 conn(0x7f3ff009b9d0 msgr2=0x7f3ff009bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:05.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.871+0000 7f3ff83f1640 1 -- 172.21.15.18:0/1887254491 shutdown_connections 2024-09-19T09:25:05.872 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.871+0000 7f3ff83f1640 1 -- 172.21.15.18:0/1887254491 wait complete. 2024-09-19T09:25:05.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.872+0000 7f3ff83f1640 1 Processor -- start 2024-09-19T09:25:05.873 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.873+0000 7f3ff83f1640 1 -- start start 2024-09-19T09:25:05.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.873+0000 7f3ff83f1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fdc004010 0x7f3ff0146480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:05.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.873+0000 7f3ff83f1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ff01549a0 0x7f3ff01585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:05.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.873+0000 7f3ff83f1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ff0158af0 0x7f3ff009dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:05.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.873+0000 7f3ff83f1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff00b7b00 con 0x7f3ff01549a0 2024-09-19T09:25:05.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.873+0000 7f3ff83f1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3ff009c560 con 0x7f3ff0158af0 2024-09-19T09:25:05.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.873+0000 7f3ff83f1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3ff0155800 con 0x7f3fdc004010 2024-09-19T09:25:05.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.873+0000 7f3ff598c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ff01549a0 0x7f3ff01585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:05.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.873+0000 7f3ff598c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ff01549a0 0x7f3ff01585b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39002/0 (socket says 172.21.15.18:39002) 2024-09-19T09:25:05.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.873+0000 7f3ff598c640 1 -- 172.21.15.18:0/911434786 learned_addr learned my addr 172.21.15.18:0/911434786 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:05.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.874+0000 7f3ff698e640 1 --2- 172.21.15.18:0/911434786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ff0158af0 0x7f3ff009dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:05.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.874+0000 7f3ff618d640 1 --2- 172.21.15.18:0/911434786 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fdc004010 0x7f3ff0146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:05.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.874+0000 7f3ff598c640 1 -- 172.21.15.18:0/911434786 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fdc004010 msgr2=0x7f3ff0146480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:05.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.874+0000 7f3ff598c640 1 --2- 172.21.15.18:0/911434786 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fdc004010 0x7f3ff0146480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:05.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.874+0000 7f3ff598c640 1 -- 172.21.15.18:0/911434786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ff0158af0 msgr2=0x7f3ff009dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:05.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.874+0000 7f3ff598c640 1 --2- 172.21.15.18:0/911434786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ff0158af0 0x7f3ff009dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:05.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.874+0000 7f3ff598c640 1 -- 172.21.15.18:0/911434786 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ff00a03a0 con 0x7f3ff01549a0 2024-09-19T09:25:05.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.874+0000 7f3ff698e640 1 --2- 172.21.15.18:0/911434786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ff0158af0 0x7f3ff009dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:05.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.874+0000 7f3ff598c640 1 --2- 172.21.15.18:0/911434786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ff01549a0 0x7f3ff01585b0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000bb20 tx=0x7f3fe00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:05.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.874+0000 7f3fe6ffd640 1 -- 172.21.15.18:0/911434786 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe0043020 con 0x7f3ff01549a0 2024-09-19T09:25:05.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.874+0000 7f3fe6ffd640 1 -- 172.21.15.18:0/911434786 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fe003f680 con 0x7f3ff01549a0 2024-09-19T09:25:05.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.874+0000 7f3fe6ffd640 1 -- 172.21.15.18:0/911434786 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe0030070 con 0x7f3ff01549a0 2024-09-19T09:25:05.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.874+0000 7f3ff83f1640 1 -- 172.21.15.18:0/911434786 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ff00a0680 con 0x7f3ff01549a0 2024-09-19T09:25:05.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.874+0000 7f3ff83f1640 1 -- 172.21.15.18:0/911434786 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ff0155d30 con 0x7f3ff01549a0 2024-09-19T09:25:05.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.875+0000 7f3ff83f1640 1 -- 172.21.15.18:0/911434786 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ff015ca50 con 0x7f3ff01549a0 2024-09-19T09:25:05.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.876+0000 7f3fe6ffd640 1 -- 172.21.15.18:0/911434786 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3fe0046020 con 0x7f3ff01549a0 2024-09-19T09:25:05.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.876+0000 7f3fe6ffd640 1 --2- 172.21.15.18:0/911434786 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3fd406c2b0 0x7f3fd406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:05.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.876+0000 7f3fe6ffd640 1 -- 172.21.15.18:0/911434786 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 4943+0+0 (secure 0 0 0) 0x7f3fe00abff0 con 0x7f3ff01549a0 2024-09-19T09:25:05.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.876+0000 7f3ff618d640 1 --2- 172.21.15.18:0/911434786 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3fd406c2b0 0x7f3fd406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:05.879 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.877+0000 7f3ff618d640 1 --2- 172.21.15.18:0/911434786 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3fd406c2b0 0x7f3fd406e770 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0153450 tx=0x7f3fec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:05.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:05.881+0000 7f3fe6ffd640 1 -- 172.21.15.18:0/911434786 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3fe004d020 con 0x7f3ff01549a0 2024-09-19T09:25:06.057 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.056+0000 7f3ff83f1640 1 -- 172.21.15.18:0/911434786 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f3ff0158ed0 con 0x7f3ff01549a0 2024-09-19T09:25:06.060 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.059+0000 7f3fe6ffd640 1 -- 172.21.15.18:0/911434786 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) ==== 104+0+0 (secure 0 0 0) 0x7f3fe007aa50 con 0x7f3ff01549a0 2024-09-19T09:25:06.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.061+0000 7f3ff83f1640 1 -- 172.21.15.18:0/911434786 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3fd406c2b0 msgr2=0x7f3fd406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:06.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.061+0000 7f3ff83f1640 1 --2- 172.21.15.18:0/911434786 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3fd406c2b0 0x7f3fd406e770 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0153450 tx=0x7f3fec009040 comp rx=0 tx=0).stop 2024-09-19T09:25:06.062 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.061+0000 7f3ff83f1640 1 -- 172.21.15.18:0/911434786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ff01549a0 msgr2=0x7f3ff01585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:06.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.061+0000 7f3ff83f1640 1 --2- 172.21.15.18:0/911434786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ff01549a0 0x7f3ff01585b0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000bb20 tx=0x7f3fe00046c0 comp rx=0 tx=0).stop 2024-09-19T09:25:06.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.061+0000 7f3ff83f1640 1 -- 172.21.15.18:0/911434786 shutdown_connections 2024-09-19T09:25:06.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.061+0000 7f3ff83f1640 1 --2- 172.21.15.18:0/911434786 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3fd406c2b0 0x7f3fd406e770 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:06.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.061+0000 7f3ff83f1640 1 --2- 172.21.15.18:0/911434786 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ff0158af0 0x7f3ff009dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:06.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.061+0000 7f3ff83f1640 1 --2- 172.21.15.18:0/911434786 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3ff01549a0 0x7f3ff01585b0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:06.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.061+0000 7f3ff83f1640 1 --2- 172.21.15.18:0/911434786 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3fdc004010 0x7f3ff0146480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:06.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.061+0000 7f3ff83f1640 1 -- 172.21.15.18:0/911434786 >> 172.21.15.18:0/911434786 conn(0x7f3ff009b9d0 msgr2=0x7f3ff015e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:06.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.061+0000 7f3ff83f1640 1 -- 172.21.15.18:0/911434786 shutdown_connections 2024-09-19T09:25:06.063 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.061+0000 7f3ff83f1640 1 -- 172.21.15.18:0/911434786 wait complete. 2024-09-19T09:25:06.073 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2024-09-19T09:25:06.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.174+0000 7fd5aec82640 1 Processor -- start 2024-09-19T09:25:06.175 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.174+0000 7fd5aec82640 1 -- start start 2024-09-19T09:25:06.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.175+0000 7fd5aec82640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd5a815fef0 0x7fd5a80b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:06.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.175+0000 7fd5aec82640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5a806d810 0x7fd5a80b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:06.179 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.175+0000 7fd5aec82640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5a806e730 con 0x7fd5a815eb00 2024-09-19T09:25:06.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.175+0000 7fd5aec82640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd5a81637e0 con 0x7fd5a815fef0 2024-09-19T09:25:06.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.175+0000 7fd5aec82640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd5a806ea10 con 0x7fd5a806d810 2024-09-19T09:25:06.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.175+0000 7fd5aca1e640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd5a815eb00 0x7fd5a81630d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49622/0 (socket says 172.21.15.18:49622) 2024-09-19T09:25:06.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.175+0000 7fd5aca1e640 1 -- 172.21.15.18:0/897174969 learned_addr learned my addr 172.21.15.18:0/897174969 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:25:06.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.175+0000 7fd5a77fe640 1 -- 172.21.15.18:0/897174969 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3923533410 0 0) 0x7fd5a806e730 con 0x7fd5a815eb00 2024-09-19T09:25:06.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.175+0000 7fd5a77fe640 1 -- 172.21.15.18:0/897174969 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd590003520 con 0x7fd5a815eb00 2024-09-19T09:25:06.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.175+0000 7fd5ad21f640 1 --2- 172.21.15.18:0/897174969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5a806d810 0x7fd5a80b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:06.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.175+0000 7fd5a7fff640 1 --2- 172.21.15.18:0/897174969 >> v2:172.21.15.162:3300/0 conn(0x7fd5a815fef0 0x7fd5a80b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:06.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.176+0000 7fd5a77fe640 1 -- 172.21.15.18:0/897174969 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 99406445 0 0) 0x7fd590003520 con 0x7fd5a815eb00 2024-09-19T09:25:06.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.176+0000 7fd5a77fe640 1 -- 172.21.15.18:0/897174969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5a806d810 msgr2=0x7fd5a80b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:06.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.176+0000 7fd5a77fe640 1 --2- 172.21.15.18:0/897174969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5a806d810 0x7fd5a80b0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:06.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.176+0000 7fd5a77fe640 1 -- 172.21.15.18:0/897174969 >> v2:172.21.15.162:3300/0 conn(0x7fd5a815fef0 msgr2=0x7fd5a80b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:06.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.176+0000 7fd5a77fe640 1 --2- 172.21.15.18:0/897174969 >> v2:172.21.15.162:3300/0 conn(0x7fd5a815fef0 0x7fd5a80b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:06.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.176+0000 7fd5a77fe640 1 -- 172.21.15.18:0/897174969 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a81628d0 con 0x7fd5a815eb00 2024-09-19T09:25:06.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.176+0000 7fd5a77fe640 1 -- 172.21.15.18:0/897174969 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fd5a00019f0 con 0x7fd5a815eb00 2024-09-19T09:25:06.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.176+0000 7fd5a77fe640 1 -- 172.21.15.18:0/897174969 >> v1:172.21.15.18:6789/0 conn(0x7fd5a815eb00 legacy=0x7fd5a81630d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:06.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.176+0000 7fd5a77fe640 1 --2- 172.21.15.18:0/897174969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5a806d810 0x7fd5900039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:06.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.176+0000 7fd5a77fe640 1 --2- 172.21.15.18:0/897174969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd590003f30 0x7fd590004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:06.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.176+0000 7fd5a77fe640 1 --2- 172.21.15.18:0/897174969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd590004d40 0x7fd5900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:06.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.176+0000 7fd5a77fe640 1 -- 172.21.15.18:0/897174969 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a81637e0 con 0x7fd590003f30 2024-09-19T09:25:06.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.176+0000 7fd5a77fe640 1 -- 172.21.15.18:0/897174969 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a806ea10 con 0x7fd590004d40 2024-09-19T09:25:06.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.176+0000 7fd5a77fe640 1 -- 172.21.15.18:0/897174969 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd59000ba10 con 0x7fd5a806d810 2024-09-19T09:25:06.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.176+0000 7fd5a7fff640 1 --2- 172.21.15.18:0/897174969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd590003f30 0x7fd590004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:06.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.176+0000 7fd5aca1e640 1 --2- 172.21.15.18:0/897174969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5a806d810 0x7fd5900039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:06.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.176+0000 7fd5ad21f640 1 --2- 172.21.15.18:0/897174969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd590004d40 0x7fd5900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:06.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.176+0000 7fd5a7fff640 1 -- 172.21.15.18:0/897174969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5a806d810 msgr2=0x7fd5900039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:06.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.176+0000 7fd5a7fff640 1 --2- 172.21.15.18:0/897174969 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5a806d810 0x7fd5900039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:06.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.176+0000 7fd5a7fff640 1 -- 172.21.15.18:0/897174969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd590004d40 msgr2=0x7fd5900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:06.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.176+0000 7fd5a7fff640 1 --2- 172.21.15.18:0/897174969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd590004d40 0x7fd5900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:06.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.176+0000 7fd5a7fff640 1 -- 172.21.15.18:0/897174969 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd590003520 con 0x7fd590003f30 2024-09-19T09:25:06.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.177+0000 7fd5a7fff640 1 --2- 172.21.15.18:0/897174969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd590003f30 0x7fd590004800 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fd59c009af0 tx=0x7fd590005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea4372523b1eb7d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:06.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.177+0000 7fd5a77fe640 1 -- 172.21.15.18:0/897174969 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59c036070 con 0x7fd590003f30 2024-09-19T09:25:06.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.177+0000 7fd5a77fe640 1 -- 172.21.15.18:0/897174969 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd59c031400 con 0x7fd590003f30 2024-09-19T09:25:06.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.177+0000 7fd5a77fe640 1 -- 172.21.15.18:0/897174969 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59c009690 con 0x7fd590003f30 2024-09-19T09:25:06.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.178+0000 7fd5aec82640 1 -- 172.21.15.18:0/897174969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd590003f30 msgr2=0x7fd590004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:06.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.178+0000 7fd5aec82640 1 --2- 172.21.15.18:0/897174969 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd590003f30 0x7fd590004800 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fd59c009af0 tx=0x7fd590005830 comp rx=0 tx=0).stop 2024-09-19T09:25:06.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.178+0000 7fd5ad21f640 1 -- 172.21.15.18:0/897174969 reap_dead start 2024-09-19T09:25:06.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.178+0000 7fd5aec82640 1 -- 172.21.15.18:0/897174969 shutdown_connections 2024-09-19T09:25:06.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.178+0000 7fd5aec82640 1 -- 172.21.15.18:0/897174969 >> 172.21.15.18:0/897174969 conn(0x7fd5a806cd20 msgr2=0x7fd5a806d100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:06.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.178+0000 7fd5aec82640 1 -- 172.21.15.18:0/897174969 shutdown_connections 2024-09-19T09:25:06.182 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.178+0000 7fd5aec82640 1 -- 172.21.15.18:0/897174969 wait complete. 2024-09-19T09:25:06.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.179+0000 7fd5aec82640 1 Processor -- start 2024-09-19T09:25:06.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.179+0000 7fd5aec82640 1 -- start start 2024-09-19T09:25:06.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.180+0000 7fd5aec82640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd590003f30 0x7fd5a815dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:06.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.180+0000 7fd5aec82640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5a80cafd0 0x7fd5a80cb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:06.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.180+0000 7fd5aec82640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5a81e96f0 0x7fd5a81e9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:06.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.180+0000 7fd5aec82640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a8070150 con 0x7fd5a81e96f0 2024-09-19T09:25:06.186 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.180+0000 7fd5aec82640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd5a806ffd0 con 0x7fd590003f30 2024-09-19T09:25:06.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.180+0000 7fd5aec82640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd5a80d1460 con 0x7fd5a80cafd0 2024-09-19T09:25:06.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.180+0000 7fd5ad21f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5a81e96f0 0x7fd5a81e9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:06.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.180+0000 7fd5ad21f640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5a81e96f0 0x7fd5a81e9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39022/0 (socket says 172.21.15.18:39022) 2024-09-19T09:25:06.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.180+0000 7fd5ad21f640 1 -- 172.21.15.18:0/1537847508 learned_addr learned my addr 172.21.15.18:0/1537847508 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:06.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.180+0000 7fd5aca1e640 1 --2- 172.21.15.18:0/1537847508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd590003f30 0x7fd5a815dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:06.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.180+0000 7fd5a7fff640 1 --2- 172.21.15.18:0/1537847508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5a80cafd0 0x7fd5a80cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:06.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.180+0000 7fd5ad21f640 1 -- 172.21.15.18:0/1537847508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5a80cafd0 msgr2=0x7fd5a80cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:06.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.180+0000 7fd5ad21f640 1 --2- 172.21.15.18:0/1537847508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5a80cafd0 0x7fd5a80cb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:06.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.180+0000 7fd5ad21f640 1 -- 172.21.15.18:0/1537847508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd590003f30 msgr2=0x7fd5a815dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:06.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.180+0000 7fd5ad21f640 1 --2- 172.21.15.18:0/1537847508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd590003f30 0x7fd5a815dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:06.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.180+0000 7fd5ad21f640 1 -- 172.21.15.18:0/1537847508 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5a815e130 con 0x7fd5a81e96f0 2024-09-19T09:25:06.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.180+0000 7fd5ad21f640 1 --2- 172.21.15.18:0/1537847508 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5a81e96f0 0x7fd5a81e9ba0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fd5a806fb10 tx=0x7fd598011cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:06.187 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.181+0000 7fd5a57fa640 1 -- 172.21.15.18:0/1537847508 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd598004240 con 0x7fd5a81e96f0 2024-09-19T09:25:06.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.181+0000 7fd5a57fa640 1 -- 172.21.15.18:0/1537847508 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd59801b070 con 0x7fd5a81e96f0 2024-09-19T09:25:06.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.181+0000 7fd5a57fa640 1 -- 172.21.15.18:0/1537847508 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59800f770 con 0x7fd5a81e96f0 2024-09-19T09:25:06.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.181+0000 7fd5aec82640 1 -- 172.21.15.18:0/1537847508 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5a81e8670 con 0x7fd5a81e96f0 2024-09-19T09:25:06.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.181+0000 7fd5aec82640 1 -- 172.21.15.18:0/1537847508 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5a81e8c10 con 0x7fd5a81e96f0 2024-09-19T09:25:06.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.182+0000 7fd5aec82640 1 -- 172.21.15.18:0/1537847508 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5a80694a0 con 0x7fd5a81e96f0 2024-09-19T09:25:06.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.182+0000 7fd5a57fa640 1 -- 172.21.15.18:0/1537847508 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd598012040 con 0x7fd5a81e96f0 2024-09-19T09:25:06.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.183+0000 7fd5a57fa640 1 --2- 172.21.15.18:0/1537847508 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd59406c2e0 0x7fd59406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:06.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.183+0000 7fd5a57fa640 1 -- 172.21.15.18:0/1537847508 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 4943+0+0 (secure 0 0 0) 0x7fd59808aec0 con 0x7fd5a81e96f0 2024-09-19T09:25:06.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.183+0000 7fd5aca1e640 1 --2- 172.21.15.18:0/1537847508 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd59406c2e0 0x7fd59406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:06.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.183+0000 7fd5aca1e640 1 --2- 172.21.15.18:0/1537847508 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd59406c2e0 0x7fd59406e7a0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0004d00 tx=0x7fd5a0006040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:06.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.187+0000 7fd5a57fa640 1 -- 172.21.15.18:0/1537847508 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd5a80694a0 con 0x7fd5a81e96f0 2024-09-19T09:25:06.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.436+0000 7fd5aec82640 1 -- 172.21.15.18:0/1537847508 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) -- 0x7fd5a806c8f0 con 0x7fd5a81e96f0 2024-09-19T09:25:06.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.741+0000 7fd5a57fa640 1 -- 172.21.15.18:0/1537847508 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v542) ==== 135+0+0 (secure 0 0 0) 0x7fd598059930 con 0x7fd5a81e96f0 2024-09-19T09:25:06.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.743+0000 7fd5aec82640 1 -- 172.21.15.18:0/1537847508 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd59406c2e0 msgr2=0x7fd59406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:06.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.743+0000 7fd5aec82640 1 --2- 172.21.15.18:0/1537847508 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd59406c2e0 0x7fd59406e7a0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0004d00 tx=0x7fd5a0006040 comp rx=0 tx=0).stop 2024-09-19T09:25:06.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.743+0000 7fd5aec82640 1 -- 172.21.15.18:0/1537847508 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5a81e96f0 msgr2=0x7fd5a81e9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:06.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.743+0000 7fd5aec82640 1 --2- 172.21.15.18:0/1537847508 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5a81e96f0 0x7fd5a81e9ba0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fd5a806fb10 tx=0x7fd598011cf0 comp rx=0 tx=0).stop 2024-09-19T09:25:06.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.743+0000 7fd5aec82640 1 -- 172.21.15.18:0/1537847508 shutdown_connections 2024-09-19T09:25:06.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.743+0000 7fd5aec82640 1 --2- 172.21.15.18:0/1537847508 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd59406c2e0 0x7fd59406e7a0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:06.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.743+0000 7fd5aec82640 1 --2- 172.21.15.18:0/1537847508 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd5a81e96f0 0x7fd5a81e9ba0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:06.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.743+0000 7fd5aec82640 1 --2- 172.21.15.18:0/1537847508 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd5a80cafd0 0x7fd5a80cb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:06.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.743+0000 7fd5aec82640 1 --2- 172.21.15.18:0/1537847508 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd590003f30 0x7fd5a815dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:06.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.743+0000 7fd5aec82640 1 -- 172.21.15.18:0/1537847508 >> 172.21.15.18:0/1537847508 conn(0x7fd5a806cd20 msgr2=0x7fd5a80b4a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:06.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.743+0000 7fd5aec82640 1 -- 172.21.15.18:0/1537847508 shutdown_connections 2024-09-19T09:25:06.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:06.743+0000 7fd5aec82640 1 -- 172.21.15.18:0/1537847508 wait complete. 2024-09-19T09:25:06.755 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2024-09-19T09:25:06.755 INFO:tasks.cephfs_test_runner: 2024-09-19T09:25:06.756 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-19T09:25:06.756 INFO:tasks.cephfs_test_runner:Ran 10 tests in 676.696s 2024-09-19T09:25:06.756 INFO:tasks.cephfs_test_runner: 2024-09-19T09:25:06.756 INFO:tasks.cephfs_test_runner:OK 2024-09-19T09:25:06.756 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-19T09:25:06.765 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-19T09:25:06.772 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-19T09:25:06.772 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:25:06.772 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:25:06.789 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17075 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T09:25:06.789 DEBUG:teuthology.orchestra.run.smithi018:> set -ex 2024-09-19T09:25:06.789 DEBUG:teuthology.orchestra.run.smithi018:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:25:06.846 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056795,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17075 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249348k,nr_inodes=812337,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498700k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-19T09:25:06.846 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:25:06.846 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:25:06.866 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3252 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T09:25:06.866 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-09-19T09:25:06.866 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:25:06.924 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=3252 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497464k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-19T09:25:06.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:25:06.924 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-19T09:25:06.941 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-19T09:25:06.941 INFO:teuthology.orchestra.run.smithi018.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T09:25:06.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:25:06.942 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-19T09:25:07.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:25:07.009 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:25:07.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:25:07.076 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link delete ceph-brx 2024-09-19T09:25:07.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:25:07.178 DEBUG:teuthology.orchestra.run.smithi018:> ip netns list 2024-09-19T09:25:07.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:25:07.194 DEBUG:teuthology.orchestra.run.smithi018:> sudo ip link delete ceph-brx 2024-09-19T09:25:07.262 INFO:teuthology.orchestra.run.smithi018.stderr:Cannot find device "ceph-brx" 2024-09-19T09:25:07.264 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:25:07.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:25:07.264 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-19T09:25:07.283 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-19T09:25:07.283 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-19T09:25:07.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:25:07.283 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-19T09:25:07.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:25:07.354 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-19T09:25:07.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:25:07.422 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2024-09-19T09:25:07.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:25:07.533 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-09-19T09:25:07.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:25:07.549 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2024-09-19T09:25:07.619 INFO:teuthology.orchestra.run.smithi162.stderr:Cannot find device "ceph-brx" 2024-09-19T09:25:07.621 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:25:07.621 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-19T09:25:07.632 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T09:25:07.632 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:25:07.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.736+0000 7f474c677640 1 Processor -- start 2024-09-19T09:25:07.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.736+0000 7f474c677640 1 -- start start 2024-09-19T09:25:07.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.737+0000 7f474c677640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f474413fae0 0x7f474406f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:07.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.737+0000 7f474c677640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4744142650 con 0x7f4744142150 2024-09-19T09:25:07.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.737+0000 7f474c677640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4744142930 con 0x7f4744160c50 2024-09-19T09:25:07.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.737+0000 7f474c677640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f47440ce780 con 0x7f474413fae0 2024-09-19T09:25:07.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.737+0000 7f4749c12640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f4744142150 0x7f4744160540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49626/0 (socket says 172.21.15.18:49626) 2024-09-19T09:25:07.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.737+0000 7f4749c12640 1 -- 172.21.15.18:0/403222027 learned_addr learned my addr 172.21.15.18:0/403222027 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:25:07.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.737+0000 7f4749411640 1 -- 172.21.15.18:0/403222027 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 732698952 0 0) 0x7f4744142650 con 0x7f4744142150 2024-09-19T09:25:07.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.737+0000 7f4749411640 1 -- 172.21.15.18:0/403222027 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f472c003520 con 0x7f4744142150 2024-09-19T09:25:07.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.737+0000 7f474a413640 1 --2- 172.21.15.18:0/403222027 >> v2:172.21.15.162:3300/0 conn(0x7f474413fae0 0x7f474406f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:07.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.738+0000 7f4749411640 1 -- 172.21.15.18:0/403222027 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1411475237 0 0) 0x7f472c003520 con 0x7f4744142150 2024-09-19T09:25:07.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.738+0000 7f4749411640 1 -- 172.21.15.18:0/403222027 >> v2:172.21.15.162:3300/0 conn(0x7f474413fae0 msgr2=0x7f474406f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:07.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.738+0000 7f4749411640 1 --2- 172.21.15.18:0/403222027 >> v2:172.21.15.162:3300/0 conn(0x7f474413fae0 0x7f474406f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:07.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.738+0000 7f4749411640 1 -- 172.21.15.18:0/403222027 >> v1:172.21.15.162:6789/0 conn(0x7f4744160c50 legacy=0x7f47440cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:07.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.738+0000 7f4749411640 1 -- 172.21.15.18:0/403222027 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4744142c10 con 0x7f4744142150 2024-09-19T09:25:07.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.738+0000 7f4749411640 1 -- 172.21.15.18:0/403222027 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f4738001670 con 0x7f4744142150 2024-09-19T09:25:07.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.738+0000 7f4749411640 1 -- 172.21.15.18:0/403222027 >> v1:172.21.15.18:6789/0 conn(0x7f4744142150 legacy=0x7f4744160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:07.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.738+0000 7f4749411640 1 --2- 172.21.15.18:0/403222027 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f472c0039b0 0x7f472c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:07.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.738+0000 7f4749411640 1 --2- 172.21.15.18:0/403222027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f472c004800 0x7f472c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:07.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.738+0000 7f4749411640 1 --2- 172.21.15.18:0/403222027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f472c0051c0 0x7f472c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:07.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.738+0000 7f4749411640 1 -- 172.21.15.18:0/403222027 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f472c00c130 con 0x7f472c004800 2024-09-19T09:25:07.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.738+0000 7f4749411640 1 -- 172.21.15.18:0/403222027 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f472c00c2e0 con 0x7f472c0051c0 2024-09-19T09:25:07.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.738+0000 7f4749411640 1 -- 172.21.15.18:0/403222027 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f472c00c4e0 con 0x7f472c0039b0 2024-09-19T09:25:07.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.738+0000 7f4749c12640 1 --2- 172.21.15.18:0/403222027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f472c004800 0x7f472c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:07.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.738+0000 7f474a413640 1 --2- 172.21.15.18:0/403222027 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f472c0039b0 0x7f472c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:07.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.738+0000 7f474ac14640 1 --2- 172.21.15.18:0/403222027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f472c0051c0 0x7f472c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:07.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.738+0000 7f4749c12640 1 -- 172.21.15.18:0/403222027 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f472c0039b0 msgr2=0x7f472c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:07.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.738+0000 7f4749c12640 1 --2- 172.21.15.18:0/403222027 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f472c0039b0 0x7f472c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:07.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.738+0000 7f4749c12640 1 -- 172.21.15.18:0/403222027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f472c0051c0 msgr2=0x7f472c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:07.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.738+0000 7f4749c12640 1 --2- 172.21.15.18:0/403222027 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f472c0051c0 0x7f472c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:07.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.738+0000 7f4749c12640 1 -- 172.21.15.18:0/403222027 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f472c003520 con 0x7f472c004800 2024-09-19T09:25:07.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.738+0000 7f474ac14640 1 -- 172.21.15.18:0/403222027 reap_dead start 2024-09-19T09:25:07.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.739+0000 7f4749c12640 1 --2- 172.21.15.18:0/403222027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f472c004800 0x7f472c004c80 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f473800c240 tx=0x7f472c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d894aaeeae7d598 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:07.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.739+0000 7f4749411640 1 -- 172.21.15.18:0/403222027 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4738007cf0 con 0x7f472c004800 2024-09-19T09:25:07.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.739+0000 7f4749411640 1 -- 172.21.15.18:0/403222027 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47380058d0 con 0x7f472c004800 2024-09-19T09:25:07.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.739+0000 7f4749411640 1 -- 172.21.15.18:0/403222027 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4738005d20 con 0x7f472c004800 2024-09-19T09:25:07.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.740+0000 7f474c677640 1 -- 172.21.15.18:0/403222027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f472c004800 msgr2=0x7f472c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:07.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.740+0000 7f474c677640 1 --2- 172.21.15.18:0/403222027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f472c004800 0x7f472c004c80 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f473800c240 tx=0x7f472c005830 comp rx=0 tx=0).stop 2024-09-19T09:25:07.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.740+0000 7f474c677640 1 -- 172.21.15.18:0/403222027 shutdown_connections 2024-09-19T09:25:07.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.740+0000 7f474c677640 1 --2- 172.21.15.18:0/403222027 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f472c004800 0x7f472c004c80 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:07.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.740+0000 7f474c677640 1 -- 172.21.15.18:0/403222027 >> 172.21.15.18:0/403222027 conn(0x7f474406bc10 msgr2=0x7f474406bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:07.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.740+0000 7f474c677640 1 -- 172.21.15.18:0/403222027 shutdown_connections 2024-09-19T09:25:07.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.740+0000 7f474c677640 1 -- 172.21.15.18:0/403222027 wait complete. 2024-09-19T09:25:07.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.741+0000 7f474c677640 1 Processor -- start 2024-09-19T09:25:07.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.741+0000 7f474c677640 1 -- start start 2024-09-19T09:25:07.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.742+0000 7f474c677640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f472c004800 0x7f47441e6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:07.746 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.742+0000 7f474c677640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f474413ed00 0x7f47440b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:07.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.742+0000 7f474c677640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f474415b990 0x7f474415be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:07.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.742+0000 7f474c677640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f47441606c0 con 0x7f474415b990 2024-09-19T09:25:07.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.742+0000 7f474c677640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4744160540 con 0x7f472c004800 2024-09-19T09:25:07.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.742+0000 7f474c677640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f4744160840 con 0x7f474413ed00 2024-09-19T09:25:07.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.742+0000 7f474ac14640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f474415b990 0x7f474415be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:07.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.742+0000 7f474ac14640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f474415b990 0x7f474415be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39042/0 (socket says 172.21.15.18:39042) 2024-09-19T09:25:07.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.742+0000 7f474ac14640 1 -- 172.21.15.18:0/2252699354 learned_addr learned my addr 172.21.15.18:0/2252699354 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:07.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.742+0000 7f4749c12640 1 --2- 172.21.15.18:0/2252699354 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f474413ed00 0x7f47440b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:07.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.742+0000 7f474a413640 1 --2- 172.21.15.18:0/2252699354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f472c004800 0x7f47441e6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:07.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.742+0000 7f474ac14640 1 -- 172.21.15.18:0/2252699354 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f474413ed00 msgr2=0x7f47440b54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:07.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.742+0000 7f474ac14640 1 --2- 172.21.15.18:0/2252699354 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f474413ed00 0x7f47440b54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:07.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.742+0000 7f474ac14640 1 -- 172.21.15.18:0/2252699354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f472c004800 msgr2=0x7f47441e6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:07.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.742+0000 7f474ac14640 1 --2- 172.21.15.18:0/2252699354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f472c004800 0x7f47441e6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:07.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.742+0000 7f474ac14640 1 -- 172.21.15.18:0/2252699354 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4744143d30 con 0x7f474415b990 2024-09-19T09:25:07.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.742+0000 7f474ac14640 1 --2- 172.21.15.18:0/2252699354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f474415b990 0x7f474415be10 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f4734007fd0 tx=0x7f473400e980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:07.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.743+0000 7f4742ffd640 1 -- 172.21.15.18:0/2252699354 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4734019070 con 0x7f474415b990 2024-09-19T09:25:07.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.743+0000 7f4742ffd640 1 -- 172.21.15.18:0/2252699354 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4734006d60 con 0x7f474415b990 2024-09-19T09:25:07.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.743+0000 7f474c677640 1 -- 172.21.15.18:0/2252699354 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47441e6940 con 0x7f474415b990 2024-09-19T09:25:07.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.743+0000 7f4742ffd640 1 -- 172.21.15.18:0/2252699354 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4734003b90 con 0x7f474415b990 2024-09-19T09:25:07.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.743+0000 7f474c677640 1 -- 172.21.15.18:0/2252699354 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47441e6f00 con 0x7f474415b990 2024-09-19T09:25:07.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.744+0000 7f474c677640 1 -- 172.21.15.18:0/2252699354 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f474415c350 con 0x7f474415b990 2024-09-19T09:25:07.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.745+0000 7f4742ffd640 1 -- 172.21.15.18:0/2252699354 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f473401c070 con 0x7f474415b990 2024-09-19T09:25:07.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.746+0000 7f4742ffd640 1 --2- 172.21.15.18:0/2252699354 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f473006c330 0x7f473006e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:07.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.746+0000 7f4742ffd640 1 -- 172.21.15.18:0/2252699354 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 4943+0+0 (secure 0 0 0) 0x7f473408a550 con 0x7f474415b990 2024-09-19T09:25:07.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.746+0000 7f474a413640 1 --2- 172.21.15.18:0/2252699354 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f473006c330 0x7f473006e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:07.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.746+0000 7f474a413640 1 --2- 172.21.15.18:0/2252699354 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f473006c330 0x7f473006e7f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f473c009b80 tx=0x7f473c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:07.752 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.751+0000 7f4742ffd640 1 -- 172.21.15.18:0/2252699354 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f4734058a50 con 0x7f474415b990 2024-09-19T09:25:07.923 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.922+0000 7f474c677640 1 -- 172.21.15.18:0/2252699354 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4744143f00 con 0x7f473006c330 2024-09-19T09:25:07.924 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.923+0000 7f4742ffd640 1 -- 172.21.15.18:0/2252699354 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12594 (secure 0 0 0) 0x7f4744143f00 con 0x7f473006c330 2024-09-19T09:25:07.924 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:25:07.925 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:25:07.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.925+0000 7f474c677640 1 -- 172.21.15.18:0/2252699354 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f473006c330 msgr2=0x7f473006e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:07.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.925+0000 7f474c677640 1 --2- 172.21.15.18:0/2252699354 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f473006c330 0x7f473006e7f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f473c009b80 tx=0x7f473c008040 comp rx=0 tx=0).stop 2024-09-19T09:25:07.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.925+0000 7f474c677640 1 -- 172.21.15.18:0/2252699354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f474415b990 msgr2=0x7f474415be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:07.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.925+0000 7f474c677640 1 --2- 172.21.15.18:0/2252699354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f474415b990 0x7f474415be10 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f4734007fd0 tx=0x7f473400e980 comp rx=0 tx=0).stop 2024-09-19T09:25:07.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.925+0000 7f474c677640 1 -- 172.21.15.18:0/2252699354 shutdown_connections 2024-09-19T09:25:07.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.925+0000 7f474c677640 1 --2- 172.21.15.18:0/2252699354 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f473006c330 0x7f473006e7f0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:07.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.925+0000 7f474c677640 1 --2- 172.21.15.18:0/2252699354 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f474415b990 0x7f474415be10 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:07.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.925+0000 7f474c677640 1 --2- 172.21.15.18:0/2252699354 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f474413ed00 0x7f47440b54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:07.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.925+0000 7f474c677640 1 --2- 172.21.15.18:0/2252699354 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f472c004800 0x7f47441e6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:07.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.925+0000 7f474c677640 1 -- 172.21.15.18:0/2252699354 >> 172.21.15.18:0/2252699354 conn(0x7f474406bc10 msgr2=0x7f47440b16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:07.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.926+0000 7f474c677640 1 -- 172.21.15.18:0/2252699354 shutdown_connections 2024-09-19T09:25:07.927 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:07.926+0000 7f474c677640 1 -- 172.21.15.18:0/2252699354 wait complete. 2024-09-19T09:25:07.937 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":535,"stamp":"2024-09-19T09:25:07.696536+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":124,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":52418,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1510081,"statfs":{"total":1600000000,"available":1546323007,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52491451,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-2,"num_read_kb":-2,"num_write":-132,"num_write_kb":-85088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001772"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":498,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-19T09:25:05.866698+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:25:05.866698+0000","last_peered":"2024-09-19T09:25:05.866698+0000","last_clean":"2024-09-19T09:25:05.866698+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:25:05.866698+0000","last_undegraded":"2024-09-19T09:25:05.866698+0000","last_fullsized":"2024-09-19T09:25:05.866698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:28.823470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574992,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":5124,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":190187,"statfs":{"total":200000000,"available":194752166,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574992,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1034,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194278,"statfs":{"total":200000000,"available":198940905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574992,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":22085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173227,"statfs":{"total":200000000,"available":177384582,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574992,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1034,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194278,"statfs":{"total":200000000,"available":198940905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1034,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194278,"statfs":{"total":200000000,"available":198940905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1034,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194278,"statfs":{"total":200000000,"available":198940905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574992,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1610,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193701,"statfs":{"total":200000000,"available":198350537,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574992,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19460,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175851,"statfs":{"total":200000000,"available":180072102,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:25:07.938 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:25:08.039 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.039+0000 7f305ad28640 1 Processor -- start 2024-09-19T09:25:08.040 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.039+0000 7f305ad28640 1 -- start start 2024-09-19T09:25:08.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.039+0000 7f305ad28640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f305415ef80 0x7f30540b5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:08.042 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.039+0000 7f305ad28640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30540cd1a0 con 0x7f305406d730 2024-09-19T09:25:08.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.039+0000 7f305ad28640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f305406dc30 con 0x7f30540cfae0 2024-09-19T09:25:08.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.040+0000 7f305ad28640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f30540cd7d0 con 0x7f305415ef80 2024-09-19T09:25:08.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.040+0000 7f3053fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f305406d730 0x7f30540cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49634/0 (socket says 172.21.15.18:49634) 2024-09-19T09:25:08.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.040+0000 7f3053fff640 1 -- 172.21.15.18:0/2422072034 learned_addr learned my addr 172.21.15.18:0/2422072034 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:25:08.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.040+0000 7f3058ac4640 1 --2- 172.21.15.18:0/2422072034 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f305415ef80 0x7f30540b5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:08.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.040+0000 7f30537fe640 1 -- 172.21.15.18:0/2422072034 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3181874883 0 0) 0x7f30540cd1a0 con 0x7f305406d730 2024-09-19T09:25:08.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.040+0000 7f30537fe640 1 -- 172.21.15.18:0/2422072034 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3044003520 con 0x7f305406d730 2024-09-19T09:25:08.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.040+0000 7f30537fe640 1 -- 172.21.15.18:0/2422072034 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1708143583 0 0) 0x7f305406dc30 con 0x7f30540cfae0 2024-09-19T09:25:08.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.040+0000 7f30537fe640 1 -- 172.21.15.18:0/2422072034 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30540cd1a0 con 0x7f30540cfae0 2024-09-19T09:25:08.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.040+0000 7f30537fe640 1 -- 172.21.15.18:0/2422072034 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2056324549 0 0) 0x7f3044003520 con 0x7f305406d730 2024-09-19T09:25:08.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.040+0000 7f30537fe640 1 -- 172.21.15.18:0/2422072034 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f305415ef80 msgr2=0x7f30540b5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:08.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.040+0000 7f30537fe640 1 --2- 172.21.15.18:0/2422072034 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f305415ef80 0x7f30540b5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.040+0000 7f30537fe640 1 -- 172.21.15.18:0/2422072034 >> v1:172.21.15.162:6789/0 conn(0x7f30540cfae0 legacy=0x7f30540cdc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:08.043 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.040+0000 7f30537fe640 1 -- 172.21.15.18:0/2422072034 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f305406df10 con 0x7f305406d730 2024-09-19T09:25:08.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.040+0000 7f30537fe640 1 -- 172.21.15.18:0/2422072034 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f30400015f0 con 0x7f305406d730 2024-09-19T09:25:08.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.040+0000 7f30537fe640 1 -- 172.21.15.18:0/2422072034 >> v1:172.21.15.18:6789/0 conn(0x7f305406d730 legacy=0x7f30540cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:08.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.040+0000 7f30537fe640 1 --2- 172.21.15.18:0/2422072034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3044003b70 0x7f3044003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:08.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.040+0000 7f30537fe640 1 --2- 172.21.15.18:0/2422072034 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f305415ef80 0x7f3044004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:08.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.040+0000 7f30537fe640 1 --2- 172.21.15.18:0/2422072034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3044004d40 0x7f30440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:08.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.040+0000 7f30537fe640 1 -- 172.21.15.18:0/2422072034 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f30540cd7d0 con 0x7f3044003b70 2024-09-19T09:25:08.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.040+0000 7f30537fe640 1 -- 172.21.15.18:0/2422072034 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f304400ba70 con 0x7f3044004d40 2024-09-19T09:25:08.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.040+0000 7f30537fe640 1 -- 172.21.15.18:0/2422072034 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f304400bc70 con 0x7f305415ef80 2024-09-19T09:25:08.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.040+0000 7f3058ac4640 1 --2- 172.21.15.18:0/2422072034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3044003b70 0x7f3044003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:08.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.041+0000 7f3053fff640 1 --2- 172.21.15.18:0/2422072034 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f305415ef80 0x7f3044004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:08.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.041+0000 7f30592c5640 1 --2- 172.21.15.18:0/2422072034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3044004d40 0x7f30440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:08.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.041+0000 7f3058ac4640 1 -- 172.21.15.18:0/2422072034 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f305415ef80 msgr2=0x7f3044004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:08.044 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.041+0000 7f3058ac4640 1 --2- 172.21.15.18:0/2422072034 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f305415ef80 0x7f3044004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.041+0000 7f3058ac4640 1 -- 172.21.15.18:0/2422072034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3044004d40 msgr2=0x7f30440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:08.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.041+0000 7f3058ac4640 1 --2- 172.21.15.18:0/2422072034 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3044004d40 0x7f30440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.041+0000 7f3058ac4640 1 -- 172.21.15.18:0/2422072034 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3044003520 con 0x7f3044003b70 2024-09-19T09:25:08.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.041+0000 7f3058ac4640 1 --2- 172.21.15.18:0/2422072034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3044003b70 0x7f3044003f70 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f3048009ac0 tx=0x7f3044005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695034c57c3205dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:08.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.042+0000 7f30537fe640 1 -- 172.21.15.18:0/2422072034 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3048036070 con 0x7f3044003b70 2024-09-19T09:25:08.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.042+0000 7f30537fe640 1 -- 172.21.15.18:0/2422072034 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3048031400 con 0x7f3044003b70 2024-09-19T09:25:08.045 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.042+0000 7f30537fe640 1 -- 172.21.15.18:0/2422072034 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3048009690 con 0x7f3044003b70 2024-09-19T09:25:08.047 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.042+0000 7f305ad28640 1 -- 172.21.15.18:0/2422072034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3044003b70 msgr2=0x7f3044003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:08.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.042+0000 7f305ad28640 1 --2- 172.21.15.18:0/2422072034 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3044003b70 0x7f3044003f70 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f3048009ac0 tx=0x7f3044005830 comp rx=0 tx=0).stop 2024-09-19T09:25:08.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.042+0000 7f30592c5640 1 -- 172.21.15.18:0/2422072034 reap_dead start 2024-09-19T09:25:08.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.042+0000 7f305ad28640 1 -- 172.21.15.18:0/2422072034 shutdown_connections 2024-09-19T09:25:08.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.042+0000 7f305ad28640 1 -- 172.21.15.18:0/2422072034 >> 172.21.15.18:0/2422072034 conn(0x7f30540b4700 msgr2=0x7f30540b4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:08.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.042+0000 7f305ad28640 1 -- 172.21.15.18:0/2422072034 shutdown_connections 2024-09-19T09:25:08.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.042+0000 7f305ad28640 1 -- 172.21.15.18:0/2422072034 wait complete. 2024-09-19T09:25:08.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.043+0000 7f305ad28640 1 Processor -- start 2024-09-19T09:25:08.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.044+0000 7f305ad28640 1 -- start start 2024-09-19T09:25:08.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.044+0000 7f305ad28640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3044003b70 0x7f3054157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:08.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.044+0000 7f305ad28640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30540cc4a0 0x7f30540700a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:08.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.044+0000 7f305ad28640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30540cc920 0x7f30540705e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:08.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.044+0000 7f305ad28640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f30540d0120 con 0x7f3044003b70 2024-09-19T09:25:08.048 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.044+0000 7f305ad28640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f305415f360 con 0x7f30540cc920 2024-09-19T09:25:08.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.044+0000 7f305ad28640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f30540b5220 con 0x7f30540cc4a0 2024-09-19T09:25:08.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.045+0000 7f3058ac4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3044003b70 0x7f3054157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:08.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.045+0000 7f3058ac4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3044003b70 0x7f3054157e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39064/0 (socket says 172.21.15.18:39064) 2024-09-19T09:25:08.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.045+0000 7f3058ac4640 1 -- 172.21.15.18:0/3799224760 learned_addr learned my addr 172.21.15.18:0/3799224760 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:08.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.045+0000 7f3053fff640 1 --2- 172.21.15.18:0/3799224760 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30540cc4a0 0x7f30540700a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:08.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.045+0000 7f30592c5640 1 --2- 172.21.15.18:0/3799224760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30540cc920 0x7f30540705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:08.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.045+0000 7f3058ac4640 1 -- 172.21.15.18:0/3799224760 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30540cc4a0 msgr2=0x7f30540700a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:08.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.045+0000 7f3058ac4640 1 --2- 172.21.15.18:0/3799224760 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30540cc4a0 0x7f30540700a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.045+0000 7f3058ac4640 1 -- 172.21.15.18:0/3799224760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30540cc920 msgr2=0x7f30540705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:08.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.045+0000 7f3058ac4640 1 --2- 172.21.15.18:0/3799224760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30540cc920 0x7f30540705e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.045+0000 7f3058ac4640 1 -- 172.21.15.18:0/3799224760 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30540b5aa0 con 0x7f3044003b70 2024-09-19T09:25:08.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.045+0000 7f3053fff640 1 --2- 172.21.15.18:0/3799224760 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30540cc4a0 0x7f30540700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:08.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.045+0000 7f30592c5640 1 --2- 172.21.15.18:0/3799224760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30540cc920 0x7f30540705e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:08.049 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.045+0000 7f3058ac4640 1 --2- 172.21.15.18:0/3799224760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3044003b70 0x7f3054157e10 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f3048009be0 tx=0x7f3048004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:08.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.045+0000 7f30517fa640 1 -- 172.21.15.18:0/3799224760 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3048040020 con 0x7f3044003b70 2024-09-19T09:25:08.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.045+0000 7f30517fa640 1 -- 172.21.15.18:0/3799224760 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3048003bc0 con 0x7f3044003b70 2024-09-19T09:25:08.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.045+0000 7f30517fa640 1 -- 172.21.15.18:0/3799224760 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3048036040 con 0x7f3044003b70 2024-09-19T09:25:08.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.045+0000 7f305ad28640 1 -- 172.21.15.18:0/3799224760 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30540b5d80 con 0x7f3044003b70 2024-09-19T09:25:08.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.045+0000 7f305ad28640 1 -- 172.21.15.18:0/3799224760 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30540b6340 con 0x7f3044003b70 2024-09-19T09:25:08.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.046+0000 7f305ad28640 1 -- 172.21.15.18:0/3799224760 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f305406dc30 con 0x7f3044003b70 2024-09-19T09:25:08.050 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.047+0000 7f30517fa640 1 -- 172.21.15.18:0/3799224760 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3048043020 con 0x7f3044003b70 2024-09-19T09:25:08.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.047+0000 7f30517fa640 1 --2- 172.21.15.18:0/3799224760 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f303806c2b0 0x7f303806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:08.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.047+0000 7f30517fa640 1 -- 172.21.15.18:0/3799224760 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 4943+0+0 (secure 0 0 0) 0x7f30480ab290 con 0x7f3044003b70 2024-09-19T09:25:08.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.047+0000 7f3053fff640 1 --2- 172.21.15.18:0/3799224760 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f303806c2b0 0x7f303806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:08.051 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.048+0000 7f3053fff640 1 --2- 172.21.15.18:0/3799224760 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f303806c2b0 0x7f303806e770 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f30540d1f70 tx=0x7f3040009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:08.052 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.052+0000 7f30517fa640 1 -- 172.21.15.18:0/3799224760 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f304804a070 con 0x7f3044003b70 2024-09-19T09:25:08.224 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.223+0000 7f305ad28640 1 -- 172.21.15.18:0/3799224760 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f30540cff00 con 0x7f303806c2b0 2024-09-19T09:25:08.225 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.224+0000 7f30517fa640 1 -- 172.21.15.18:0/3799224760 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12594 (secure 0 0 0) 0x7f30540cff00 con 0x7f303806c2b0 2024-09-19T09:25:08.225 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:25:08.229 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:25:08.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.226+0000 7f305ad28640 1 -- 172.21.15.18:0/3799224760 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f303806c2b0 msgr2=0x7f303806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:08.229 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.226+0000 7f305ad28640 1 --2- 172.21.15.18:0/3799224760 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f303806c2b0 0x7f303806e770 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f30540d1f70 tx=0x7f3040009040 comp rx=0 tx=0).stop 2024-09-19T09:25:08.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.226+0000 7f305ad28640 1 -- 172.21.15.18:0/3799224760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3044003b70 msgr2=0x7f3054157e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:08.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.226+0000 7f305ad28640 1 --2- 172.21.15.18:0/3799224760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3044003b70 0x7f3054157e10 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f3048009be0 tx=0x7f3048004730 comp rx=0 tx=0).stop 2024-09-19T09:25:08.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.226+0000 7f305ad28640 1 -- 172.21.15.18:0/3799224760 shutdown_connections 2024-09-19T09:25:08.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.226+0000 7f305ad28640 1 --2- 172.21.15.18:0/3799224760 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f303806c2b0 0x7f303806e770 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.226+0000 7f305ad28640 1 --2- 172.21.15.18:0/3799224760 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f30540cc920 0x7f30540705e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.226+0000 7f305ad28640 1 --2- 172.21.15.18:0/3799224760 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f30540cc4a0 0x7f30540700a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.226+0000 7f305ad28640 1 --2- 172.21.15.18:0/3799224760 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3044003b70 0x7f3054157e10 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.226+0000 7f305ad28640 1 -- 172.21.15.18:0/3799224760 >> 172.21.15.18:0/3799224760 conn(0x7f30540b4700 msgr2=0x7f30540d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:08.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.226+0000 7f305ad28640 1 -- 172.21.15.18:0/3799224760 shutdown_connections 2024-09-19T09:25:08.230 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.226+0000 7f305ad28640 1 -- 172.21.15.18:0/3799224760 wait complete. 2024-09-19T09:25:08.237 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":535,"stamp":"2024-09-19T09:25:07.696536+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":124,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":52418,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1510081,"statfs":{"total":1600000000,"available":1546323007,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52491451,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-2,"num_read_kb":-2,"num_write":-132,"num_write_kb":-85088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001772"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":498,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-19T09:25:05.866698+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:25:05.866698+0000","last_peered":"2024-09-19T09:25:05.866698+0000","last_clean":"2024-09-19T09:25:05.866698+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:25:05.866698+0000","last_undegraded":"2024-09-19T09:25:05.866698+0000","last_fullsized":"2024-09-19T09:25:05.866698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:28.823470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574992,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":5124,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":190187,"statfs":{"total":200000000,"available":194752166,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574992,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1034,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194278,"statfs":{"total":200000000,"available":198940905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574992,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":22085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173227,"statfs":{"total":200000000,"available":177384582,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574992,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1034,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194278,"statfs":{"total":200000000,"available":198940905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1034,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194278,"statfs":{"total":200000000,"available":198940905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1034,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194278,"statfs":{"total":200000000,"available":198940905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574992,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1610,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193701,"statfs":{"total":200000000,"available":198350537,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574992,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19460,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175851,"statfs":{"total":200000000,"available":180072102,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:25:08.238 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T09:25:08.238 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:25:08.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.339+0000 7f1516ee4640 1 Processor -- start 2024-09-19T09:25:08.340 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.339+0000 7f1516ee4640 1 -- start start 2024-09-19T09:25:08.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.340+0000 7f1516ee4640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1510145290 0x7f151006f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:08.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.340+0000 7f1516ee4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15100ce780 0x7f1510072830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:08.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.340+0000 7f1516ee4640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1510071510 0x7f1510072d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:08.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.340+0000 7f1516ee4640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f151006efe0 con 0x7f1510071510 2024-09-19T09:25:08.341 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.340+0000 7f1516ee4640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f151006e3d0 con 0x7f1510145290 2024-09-19T09:25:08.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.340+0000 7f1516ee4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f151006e6b0 con 0x7f15100ce780 2024-09-19T09:25:08.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.340+0000 7f1515481640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1510071510 0x7f1510072d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:08.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.340+0000 7f1515481640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f1510071510 0x7f1510072d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39074/0 (socket says 172.21.15.18:39074) 2024-09-19T09:25:08.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.340+0000 7f1515481640 1 -- 172.21.15.18:0/1971253711 learned_addr learned my addr 172.21.15.18:0/1971253711 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:08.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.340+0000 7f1514c80640 1 --2- 172.21.15.18:0/1971253711 >> v2:172.21.15.162:3300/0 conn(0x7f1510145290 0x7f151006f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:08.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.340+0000 7f150ffff640 1 --2- 172.21.15.18:0/1971253711 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15100ce780 0x7f1510072830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:08.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.340+0000 7f1515481640 1 -- 172.21.15.18:0/1971253711 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15100ce780 msgr2=0x7f1510072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:08.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.340+0000 7f1515481640 1 --2- 172.21.15.18:0/1971253711 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15100ce780 0x7f1510072830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.340+0000 7f1515481640 1 -- 172.21.15.18:0/1971253711 >> v2:172.21.15.162:3300/0 conn(0x7f1510145290 msgr2=0x7f151006f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:08.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.340+0000 7f1515481640 1 --2- 172.21.15.18:0/1971253711 >> v2:172.21.15.162:3300/0 conn(0x7f1510145290 0x7f151006f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.342 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.340+0000 7f1515481640 1 -- 172.21.15.18:0/1971253711 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f151006e990 con 0x7f1510071510 2024-09-19T09:25:08.343 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.341+0000 7f1515481640 1 --2- 172.21.15.18:0/1971253711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1510071510 0x7f1510072d70 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f1510075940 tx=0x7f14f802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40f305e3227d13d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:08.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.341+0000 7f150f7fe640 1 -- 172.21.15.18:0/1971253711 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f8037070 con 0x7f1510071510 2024-09-19T09:25:08.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.341+0000 7f150f7fe640 1 -- 172.21.15.18:0/1971253711 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f8032440 con 0x7f1510071510 2024-09-19T09:25:08.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.341+0000 7f150f7fe640 1 -- 172.21.15.18:0/1971253711 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f8032810 con 0x7f1510071510 2024-09-19T09:25:08.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.341+0000 7f1516ee4640 1 -- 172.21.15.18:0/1971253711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1510071510 msgr2=0x7f1510072d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:08.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.341+0000 7f1516ee4640 1 --2- 172.21.15.18:0/1971253711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1510071510 0x7f1510072d70 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f1510075940 tx=0x7f14f802a1e0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.341+0000 7f1516ee4640 1 -- 172.21.15.18:0/1971253711 shutdown_connections 2024-09-19T09:25:08.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.341+0000 7f1516ee4640 1 --2- 172.21.15.18:0/1971253711 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1510071510 0x7f1510072d70 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.341+0000 7f1516ee4640 1 --2- 172.21.15.18:0/1971253711 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f15100ce780 0x7f1510072830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.342+0000 7f1516ee4640 1 --2- 172.21.15.18:0/1971253711 >> v2:172.21.15.162:3300/0 conn(0x7f1510145290 0x7f151006f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.342+0000 7f1516ee4640 1 -- 172.21.15.18:0/1971253711 >> 172.21.15.18:0/1971253711 conn(0x7f151006bc10 msgr2=0x7f151006bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:08.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.342+0000 7f1516ee4640 1 -- 172.21.15.18:0/1971253711 shutdown_connections 2024-09-19T09:25:08.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.342+0000 7f1516ee4640 1 -- 172.21.15.18:0/1971253711 wait complete. 2024-09-19T09:25:08.344 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.343+0000 7f1516ee4640 1 Processor -- start 2024-09-19T09:25:08.345 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.343+0000 7f1516ee4640 1 -- start start 2024-09-19T09:25:08.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.344+0000 7f1516ee4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1510071510 0x7f151015b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:08.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.344+0000 7f1516ee4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15100ce780 0x7f1510143140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:08.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.344+0000 7f1516ee4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1510145290 0x7f15100acde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:08.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.344+0000 7f1516ee4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f151006df80 con 0x7f1510145290 2024-09-19T09:25:08.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.344+0000 7f1516ee4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1510145670 con 0x7f15100ce780 2024-09-19T09:25:08.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.344+0000 7f1516ee4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f151006e100 con 0x7f1510071510 2024-09-19T09:25:08.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.344+0000 7f1515481640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1510145290 0x7f15100acde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:08.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.344+0000 7f1515481640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1510145290 0x7f15100acde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39088/0 (socket says 172.21.15.18:39088) 2024-09-19T09:25:08.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.344+0000 7f1515481640 1 -- 172.21.15.18:0/1825007648 learned_addr learned my addr 172.21.15.18:0/1825007648 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:08.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.344+0000 7f1514c80640 1 --2- 172.21.15.18:0/1825007648 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1510071510 0x7f151015b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:08.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.344+0000 7f150ffff640 1 --2- 172.21.15.18:0/1825007648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15100ce780 0x7f1510143140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:08.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.344+0000 7f1515481640 1 -- 172.21.15.18:0/1825007648 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1510071510 msgr2=0x7f151015b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:08.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.344+0000 7f1515481640 1 --2- 172.21.15.18:0/1825007648 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1510071510 0x7f151015b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.344+0000 7f1515481640 1 -- 172.21.15.18:0/1825007648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15100ce780 msgr2=0x7f1510143140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:08.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.344+0000 7f1515481640 1 --2- 172.21.15.18:0/1825007648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15100ce780 0x7f1510143140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.344+0000 7f1515481640 1 -- 172.21.15.18:0/1825007648 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1510143b90 con 0x7f1510145290 2024-09-19T09:25:08.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.344+0000 7f1515481640 1 --2- 172.21.15.18:0/1825007648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1510145290 0x7f15100acde0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f14f80090b0 tx=0x7f14f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:08.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.345+0000 7f150d7fa640 1 -- 172.21.15.18:0/1825007648 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f8037040 con 0x7f1510145290 2024-09-19T09:25:08.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.345+0000 7f150d7fa640 1 -- 172.21.15.18:0/1825007648 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14f8042070 con 0x7f1510145290 2024-09-19T09:25:08.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.345+0000 7f1516ee4640 1 -- 172.21.15.18:0/1825007648 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1510143e70 con 0x7f1510145290 2024-09-19T09:25:08.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.345+0000 7f150d7fa640 1 -- 172.21.15.18:0/1825007648 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f8030920 con 0x7f1510145290 2024-09-19T09:25:08.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.345+0000 7f1516ee4640 1 -- 172.21.15.18:0/1825007648 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15100aa430 con 0x7f1510145290 2024-09-19T09:25:08.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.346+0000 7f1516ee4640 1 -- 172.21.15.18:0/1825007648 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f151006f470 con 0x7f1510145290 2024-09-19T09:25:08.348 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.346+0000 7f150d7fa640 1 -- 172.21.15.18:0/1825007648 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f14f8030ac0 con 0x7f1510145290 2024-09-19T09:25:08.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.347+0000 7f150d7fa640 1 --2- 172.21.15.18:0/1825007648 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f14f006c2b0 0x7f14f006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:08.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.347+0000 7f150d7fa640 1 -- 172.21.15.18:0/1825007648 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 4943+0+0 (secure 0 0 0) 0x7f14f80ab890 con 0x7f1510145290 2024-09-19T09:25:08.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.347+0000 7f1514c80640 1 --2- 172.21.15.18:0/1825007648 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f14f006c2b0 0x7f14f006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:08.349 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.347+0000 7f1514c80640 1 --2- 172.21.15.18:0/1825007648 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f14f006c2b0 0x7f14f006e770 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1508006fd0 tx=0x7f1508008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:08.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.351+0000 7f150d7fa640 1 -- 172.21.15.18:0/1825007648 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f14f8079cb0 con 0x7f1510145290 2024-09-19T09:25:08.525 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.524+0000 7f1516ee4640 1 -- 172.21.15.18:0/1825007648 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f151013ef90 con 0x7f14f006c2b0 2024-09-19T09:25:08.526 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.525+0000 7f150d7fa640 1 -- 172.21.15.18:0/1825007648 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12594 (secure 0 0 0) 0x7f151013ef90 con 0x7f14f006c2b0 2024-09-19T09:25:08.527 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:25:08.527 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:25:08.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.527+0000 7f1516ee4640 1 -- 172.21.15.18:0/1825007648 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f14f006c2b0 msgr2=0x7f14f006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:08.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.527+0000 7f1516ee4640 1 --2- 172.21.15.18:0/1825007648 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f14f006c2b0 0x7f14f006e770 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1508006fd0 tx=0x7f1508008040 comp rx=0 tx=0).stop 2024-09-19T09:25:08.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.527+0000 7f1516ee4640 1 -- 172.21.15.18:0/1825007648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1510145290 msgr2=0x7f15100acde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:08.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.527+0000 7f1516ee4640 1 --2- 172.21.15.18:0/1825007648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1510145290 0x7f15100acde0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f14f80090b0 tx=0x7f14f80046c0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.528+0000 7f1516ee4640 1 -- 172.21.15.18:0/1825007648 shutdown_connections 2024-09-19T09:25:08.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.528+0000 7f1516ee4640 1 --2- 172.21.15.18:0/1825007648 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f14f006c2b0 0x7f14f006e770 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.529 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.528+0000 7f1516ee4640 1 --2- 172.21.15.18:0/1825007648 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f1510145290 0x7f15100acde0 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.528+0000 7f1516ee4640 1 --2- 172.21.15.18:0/1825007648 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f15100ce780 0x7f1510143140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.528+0000 7f1516ee4640 1 --2- 172.21.15.18:0/1825007648 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f1510071510 0x7f151015b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.528+0000 7f1516ee4640 1 -- 172.21.15.18:0/1825007648 >> 172.21.15.18:0/1825007648 conn(0x7f151006bc10 msgr2=0x7f15100b14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:08.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.528+0000 7f1516ee4640 1 -- 172.21.15.18:0/1825007648 shutdown_connections 2024-09-19T09:25:08.530 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.528+0000 7f1516ee4640 1 -- 172.21.15.18:0/1825007648 wait complete. 2024-09-19T09:25:08.539 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":535,"stamp":"2024-09-19T09:25:07.696536+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":124,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":52418,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1510081,"statfs":{"total":1600000000,"available":1546323007,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52491451,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-2,"num_read_kb":-2,"num_write":-132,"num_write_kb":-85088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001772"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":498,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-19T09:25:05.866698+0000","last_change":"2024-09-19T09:13:19.454207+0000","last_active":"2024-09-19T09:25:05.866698+0000","last_peered":"2024-09-19T09:25:05.866698+0000","last_clean":"2024-09-19T09:25:05.866698+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:25:05.866698+0000","last_undegraded":"2024-09-19T09:25:05.866698+0000","last_fullsized":"2024-09-19T09:25:05.866698+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T09:13:18.444713+0000","last_clean_scrub_stamp":"2024-09-19T09:13:18.444713+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:28.823470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574992,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":5124,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":190187,"statfs":{"total":200000000,"available":194752166,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574992,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1034,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194278,"statfs":{"total":200000000,"available":198940905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574992,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":22085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173227,"statfs":{"total":200000000,"available":177384582,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574992,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1034,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194278,"statfs":{"total":200000000,"available":198940905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1034,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194278,"statfs":{"total":200000000,"available":198940905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574992,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1034,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194278,"statfs":{"total":200000000,"available":198940905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574992,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1610,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193701,"statfs":{"total":200000000,"available":198350537,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574992,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19460,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175851,"statfs":{"total":200000000,"available":180072102,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:25:08.540 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:25:08.642 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.641+0000 7f7b15874640 1 Processor -- start 2024-09-19T09:25:08.643 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.641+0000 7f7b15874640 1 -- start start 2024-09-19T09:25:08.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.642+0000 7f7b15874640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b100b5160 0x7f7b10070620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:08.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.642+0000 7f7b15874640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f7b100d1660 0x7f7b10160650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:08.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.642+0000 7f7b15874640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b100d1f00 con 0x7f7b10162850 2024-09-19T09:25:08.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.642+0000 7f7b15874640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f7b1006f860 con 0x7f7b100d1660 2024-09-19T09:25:08.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.642+0000 7f7b15874640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7b1006fb40 con 0x7f7b100b5160 2024-09-19T09:25:08.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.642+0000 7f7b0effd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f7b10162850 0x7f7b10162c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49636/0 (socket says 172.21.15.18:49636) 2024-09-19T09:25:08.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.642+0000 7f7b0effd640 1 -- 172.21.15.18:0/1122114866 learned_addr learned my addr 172.21.15.18:0/1122114866 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:25:08.644 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.642+0000 7f7b0f7fe640 1 --2- 172.21.15.18:0/1122114866 >> v2:172.21.15.18:3300/0 conn(0x7f7b100d1660 0x7f7b10160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:08.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.643+0000 7f7b0f7fe640 1 -- 172.21.15.18:0/1122114866 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b100b5160 msgr2=0x7f7b10070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:08.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.643+0000 7f7b0f7fe640 1 --2- 172.21.15.18:0/1122114866 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b100b5160 0x7f7b10070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.643+0000 7f7b0f7fe640 1 -- 172.21.15.18:0/1122114866 >> v1:172.21.15.18:6789/0 conn(0x7f7b10162850 legacy=0x7f7b10162c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:08.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.643+0000 7f7b0f7fe640 1 -- 172.21.15.18:0/1122114866 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1006fe20 con 0x7f7b100d1660 2024-09-19T09:25:08.645 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.643+0000 7f7b0dffb640 1 -- 172.21.15.18:0/1122114866 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 411614238 0 0) 0x7f7b100d1f00 con 0x7f7b10162850 2024-09-19T09:25:08.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.643+0000 7f7b0f7fe640 1 --2- 172.21.15.18:0/1122114866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b100d1660 0x7f7b10160650 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f7b080097a0 tx=0x7f7b0802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7948befac8c36a35 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:08.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.644+0000 7f7b0dffb640 1 -- 172.21.15.18:0/1122114866 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b08037070 con 0x7f7b100d1660 2024-09-19T09:25:08.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.644+0000 7f7b0dffb640 1 -- 172.21.15.18:0/1122114866 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b0802ae50 con 0x7f7b100d1660 2024-09-19T09:25:08.646 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.644+0000 7f7b0dffb640 1 -- 172.21.15.18:0/1122114866 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b08032660 con 0x7f7b100d1660 2024-09-19T09:25:08.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.644+0000 7f7b15874640 1 -- 172.21.15.18:0/1122114866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b100d1660 msgr2=0x7f7b10160650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:08.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.644+0000 7f7b15874640 1 --2- 172.21.15.18:0/1122114866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b100d1660 0x7f7b10160650 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f7b080097a0 tx=0x7f7b0802a100 comp rx=0 tx=0).stop 2024-09-19T09:25:08.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.644+0000 7f7b15874640 1 -- 172.21.15.18:0/1122114866 shutdown_connections 2024-09-19T09:25:08.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.644+0000 7f7b15874640 1 --2- 172.21.15.18:0/1122114866 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b100d1660 0x7f7b10160650 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.644+0000 7f7b15874640 1 --2- 172.21.15.18:0/1122114866 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b100b5160 0x7f7b10070620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.644+0000 7f7b15874640 1 -- 172.21.15.18:0/1122114866 >> 172.21.15.18:0/1122114866 conn(0x7f7b100b4560 msgr2=0x7f7b100b4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:08.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.644+0000 7f7b15874640 1 -- 172.21.15.18:0/1122114866 shutdown_connections 2024-09-19T09:25:08.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.644+0000 7f7b15874640 1 -- 172.21.15.18:0/1122114866 wait complete. 2024-09-19T09:25:08.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.645+0000 7f7b15874640 1 Processor -- start 2024-09-19T09:25:08.647 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.646+0000 7f7b15874640 1 -- start start 2024-09-19T09:25:08.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.646+0000 7f7b15874640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b100b5160 0x7f7b100b7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:08.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.646+0000 7f7b15874640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b100d1660 0x7f7b10153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:08.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.646+0000 7f7b15874640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b10162850 0x7f7b10154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:08.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.646+0000 7f7b15874640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f7b101601b0 con 0x7f7b100b5160 2024-09-19T09:25:08.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.646+0000 7f7b15874640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7b10160030 con 0x7f7b100d1660 2024-09-19T09:25:08.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.646+0000 7f7b15874640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f7b100d1af0 con 0x7f7b10162850 2024-09-19T09:25:08.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.646+0000 7f7b0effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b100b5160 0x7f7b100b7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:08.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.646+0000 7f7b0effd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b100b5160 0x7f7b100b7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39112/0 (socket says 172.21.15.18:39112) 2024-09-19T09:25:08.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.646+0000 7f7b0effd640 1 -- 172.21.15.18:0/486271669 learned_addr learned my addr 172.21.15.18:0/486271669 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:08.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.647+0000 7f7b0f7fe640 1 --2- 172.21.15.18:0/486271669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b10162850 0x7f7b10154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:08.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.647+0000 7f7b0e7fc640 1 --2- 172.21.15.18:0/486271669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b100d1660 0x7f7b10153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:08.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.647+0000 7f7b0effd640 1 -- 172.21.15.18:0/486271669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b10162850 msgr2=0x7f7b10154030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:08.650 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.647+0000 7f7b0effd640 1 --2- 172.21.15.18:0/486271669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b10162850 0x7f7b10154030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.647+0000 7f7b0effd640 1 -- 172.21.15.18:0/486271669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b100d1660 msgr2=0x7f7b10153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:08.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.647+0000 7f7b0effd640 1 --2- 172.21.15.18:0/486271669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b100d1660 0x7f7b10153af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.647+0000 7f7b0effd640 1 -- 172.21.15.18:0/486271669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b100b0b00 con 0x7f7b100b5160 2024-09-19T09:25:08.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.647+0000 7f7b0f7fe640 1 --2- 172.21.15.18:0/486271669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b10162850 0x7f7b10154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:08.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.647+0000 7f7b0e7fc640 1 --2- 172.21.15.18:0/486271669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b100d1660 0x7f7b10153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:08.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.647+0000 7f7b0effd640 1 --2- 172.21.15.18:0/486271669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b100b5160 0x7f7b100b7160 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000c7c0 tx=0x7f7b0000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:08.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.647+0000 7f7b07fff640 1 -- 172.21.15.18:0/486271669 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b00018070 con 0x7f7b100b5160 2024-09-19T09:25:08.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.647+0000 7f7b07fff640 1 -- 172.21.15.18:0/486271669 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b0000a640 con 0x7f7b100b5160 2024-09-19T09:25:08.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.647+0000 7f7b07fff640 1 -- 172.21.15.18:0/486271669 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0000aa30 con 0x7f7b100b5160 2024-09-19T09:25:08.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.647+0000 7f7b15874640 1 -- 172.21.15.18:0/486271669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b100b0de0 con 0x7f7b100b5160 2024-09-19T09:25:08.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.647+0000 7f7b15874640 1 -- 172.21.15.18:0/486271669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b100b13a0 con 0x7f7b100b5160 2024-09-19T09:25:08.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.648+0000 7f7b15874640 1 -- 172.21.15.18:0/486271669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b100d1f00 con 0x7f7b100b5160 2024-09-19T09:25:08.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.649+0000 7f7b07fff640 1 -- 172.21.15.18:0/486271669 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f7b0000abd0 con 0x7f7b100b5160 2024-09-19T09:25:08.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.649+0000 7f7b07fff640 1 --2- 172.21.15.18:0/486271669 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7af006c2b0 0x7f7af006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:08.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.649+0000 7f7b07fff640 1 -- 172.21.15.18:0/486271669 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 4943+0+0 (secure 0 0 0) 0x7f7b0008a870 con 0x7f7b100b5160 2024-09-19T09:25:08.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.650+0000 7f7b0e7fc640 1 --2- 172.21.15.18:0/486271669 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7af006c2b0 0x7f7af006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:08.653 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.650+0000 7f7b0e7fc640 1 --2- 172.21.15.18:0/486271669 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7af006c2b0 0x7f7af006e770 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7b100d1320 tx=0x7f7af8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:08.654 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.654+0000 7f7b07fff640 1 -- 172.21.15.18:0/486271669 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f7b00059240 con 0x7f7b100b5160 2024-09-19T09:25:08.833 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.833+0000 7f7b15874640 1 -- 172.21.15.18:0/486271669 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7b100686d0 con 0x7f7b100b5160 2024-09-19T09:25:08.834 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.833+0000 7f7b07fff640 1 -- 172.21.15.18:0/486271669 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) ==== 74+0+13055 (secure 0 0 0) 0x7f7b00058b40 con 0x7f7b100b5160 2024-09-19T09:25:08.834 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:25:08.835 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":188,"fsid":"fec66d7e-50e5-42ed-81de-ad141a2f0f4e","created":"2024-09-19T09:13:11.348786+0000","modified":"2024-09-19T09:25:05.738927+0000","last_up_change":"2024-09-19T09:13:16.423937+0000","last_in_change":"2024-09-19T09:13:13.417141+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T09:13:17.564717+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6808","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6809","nonce":128722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6810","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6811","nonce":128722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6814","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6815","nonce":128722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6812","nonce":128722874},{"type":"v1","addr":"172.21.15.18:6813","nonce":128722874}]},"public_addr":"172.21.15.18:6809/128722874","cluster_addr":"172.21.15.18:6811/128722874","heartbeat_back_addr":"172.21.15.18:6815/128722874","heartbeat_front_addr":"172.21.15.18:6813/128722874","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6816","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6817","nonce":3672199638}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6818","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6819","nonce":3672199638}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6822","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6823","nonce":3672199638}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6820","nonce":3672199638},{"type":"v1","addr":"172.21.15.18:6821","nonce":3672199638}]},"public_addr":"172.21.15.18:6817/3672199638","cluster_addr":"172.21.15.18:6819/3672199638","heartbeat_back_addr":"172.21.15.18:6823/3672199638","heartbeat_front_addr":"172.21.15.18:6821/3672199638","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6800","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6801","nonce":3463367841}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6802","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6803","nonce":3463367841}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6806","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6807","nonce":3463367841}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6804","nonce":3463367841},{"type":"v1","addr":"172.21.15.18:6805","nonce":3463367841}]},"public_addr":"172.21.15.18:6801/3463367841","cluster_addr":"172.21.15.18:6803/3463367841","heartbeat_back_addr":"172.21.15.18:6807/3463367841","heartbeat_front_addr":"172.21.15.18:6805/3463367841","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6824","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6825","nonce":4163178582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6826","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6827","nonce":4163178582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6830","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6831","nonce":4163178582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6828","nonce":4163178582},{"type":"v1","addr":"172.21.15.18:6829","nonce":4163178582}]},"public_addr":"172.21.15.18:6825/4163178582","cluster_addr":"172.21.15.18:6827/4163178582","heartbeat_back_addr":"172.21.15.18:6831/4163178582","heartbeat_front_addr":"172.21.15.18:6829/4163178582","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6824","nonce":3538482215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6827","nonce":3538482215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6831","nonce":3538482215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":3538482215},{"type":"v1","addr":"172.21.15.162:6829","nonce":3538482215}]},"public_addr":"172.21.15.162:6824/3538482215","cluster_addr":"172.21.15.162:6827/3538482215","heartbeat_back_addr":"172.21.15.162:6831/3538482215","heartbeat_front_addr":"172.21.15.162:6829/3538482215","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6801","nonce":2408698413}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6803","nonce":2408698413}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6807","nonce":2408698413}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":2408698413},{"type":"v1","addr":"172.21.15.162:6805","nonce":2408698413}]},"public_addr":"172.21.15.162:6801/2408698413","cluster_addr":"172.21.15.162:6803/2408698413","heartbeat_back_addr":"172.21.15.162:6807/2408698413","heartbeat_front_addr":"172.21.15.162:6805/2408698413","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6809","nonce":2596207948}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6811","nonce":2596207948}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6815","nonce":2596207948}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2596207948},{"type":"v1","addr":"172.21.15.162:6813","nonce":2596207948}]},"public_addr":"172.21.15.162:6809/2596207948","cluster_addr":"172.21.15.162:6811/2596207948","heartbeat_back_addr":"172.21.15.162:6815/2596207948","heartbeat_front_addr":"172.21.15.162:6813/2596207948","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6817","nonce":1334618296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6819","nonce":1334618296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6823","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6825","nonce":1334618296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":1334618296},{"type":"v1","addr":"172.21.15.162:6821","nonce":1334618296}]},"public_addr":"172.21.15.162:6817/1334618296","cluster_addr":"172.21.15.162:6819/1334618296","heartbeat_back_addr":"172.21.15.162:6825/1334618296","heartbeat_front_addr":"172.21.15.162:6821/1334618296","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.580838+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.599990+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.503722+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.607846+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.616858+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.542726+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.534178+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T09:13:14.612105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.18:6835/2545948137":"2024-09-20T09:25:02.734309+0000","172.21.15.18:6832/2545948137":"2024-09-20T09:25:02.734309+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:25:08.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.835+0000 7f7b15874640 1 -- 172.21.15.18:0/486271669 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7af006c2b0 msgr2=0x7f7af006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:08.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.835+0000 7f7b15874640 1 --2- 172.21.15.18:0/486271669 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7af006c2b0 0x7f7af006e770 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7b100d1320 tx=0x7f7af8008040 comp rx=0 tx=0).stop 2024-09-19T09:25:08.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.835+0000 7f7b15874640 1 -- 172.21.15.18:0/486271669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b100b5160 msgr2=0x7f7b100b7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:08.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.835+0000 7f7b15874640 1 --2- 172.21.15.18:0/486271669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b100b5160 0x7f7b100b7160 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f7b0000c7c0 tx=0x7f7b0000cc80 comp rx=0 tx=0).stop 2024-09-19T09:25:08.837 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.836+0000 7f7b15874640 1 -- 172.21.15.18:0/486271669 shutdown_connections 2024-09-19T09:25:08.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.836+0000 7f7b15874640 1 --2- 172.21.15.18:0/486271669 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f7af006c2b0 0x7f7af006e770 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.836+0000 7f7b15874640 1 --2- 172.21.15.18:0/486271669 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f7b10162850 0x7f7b10154030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.836+0000 7f7b15874640 1 --2- 172.21.15.18:0/486271669 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7b100d1660 0x7f7b10153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.836+0000 7f7b15874640 1 --2- 172.21.15.18:0/486271669 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f7b100b5160 0x7f7b100b7160 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:08.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.836+0000 7f7b15874640 1 -- 172.21.15.18:0/486271669 >> 172.21.15.18:0/486271669 conn(0x7f7b100b4560 msgr2=0x7f7b1006e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:08.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.836+0000 7f7b15874640 1 -- 172.21.15.18:0/486271669 shutdown_connections 2024-09-19T09:25:08.838 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:08.836+0000 7f7b15874640 1 -- 172.21.15.18:0/486271669 wait complete. 2024-09-19T09:25:09.849 INFO:tasks.ceph:Scrubbing osd.0 2024-09-19T09:25:09.849 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-19T09:25:09.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.967+0000 7f54c12a6640 1 Processor -- start 2024-09-19T09:25:09.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.967+0000 7f54c12a6640 1 -- start start 2024-09-19T09:25:09.972 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.968+0000 7f54c12a6640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f54bc15ee50 0x7f54bc163390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.968+0000 7f54c12a6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54bc15f230 0x7f54bc15f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.968+0000 7f54c12a6640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54bc1638d0 con 0x7f54bc0cf420 2024-09-19T09:25:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.968+0000 7f54c12a6640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f54bc0d2440 con 0x7f54bc15ee50 2024-09-19T09:25:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.968+0000 7f54c12a6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f54bc0700b0 con 0x7f54bc15f230 2024-09-19T09:25:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.968+0000 7f54b3fff640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f54bc0cf420 0x7f54bc0cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49646/0 (socket says 172.21.15.18:49646) 2024-09-19T09:25:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.968+0000 7f54b3fff640 1 -- 172.21.15.18:0/1469134881 learned_addr learned my addr 172.21.15.18:0/1469134881 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:25:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.968+0000 7f54baffd640 1 --2- 172.21.15.18:0/1469134881 >> v2:172.21.15.162:3300/0 conn(0x7f54bc15ee50 0x7f54bc163390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.968+0000 7f54bb7fe640 1 --2- 172.21.15.18:0/1469134881 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54bc15f230 0x7f54bc15f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.968+0000 7f54ba7fc640 1 -- 172.21.15.18:0/1469134881 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3466909474 0 0) 0x7f54a4001110 con 0x7f54bc0cf420 2024-09-19T09:25:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.968+0000 7f54ba7fc640 1 -- 172.21.15.18:0/1469134881 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54a8003520 con 0x7f54bc0cf420 2024-09-19T09:25:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.969+0000 7f54ba7fc640 1 -- 172.21.15.18:0/1469134881 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3013590737 0 0) 0x7f54a8003520 con 0x7f54bc0cf420 2024-09-19T09:25:09.973 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.969+0000 7f54ba7fc640 1 -- 172.21.15.18:0/1469134881 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54bc15f230 msgr2=0x7f54bc15f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:09.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.969+0000 7f54ba7fc640 1 --2- 172.21.15.18:0/1469134881 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54bc15f230 0x7f54bc15f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:09.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.969+0000 7f54ba7fc640 1 -- 172.21.15.18:0/1469134881 >> v2:172.21.15.162:3300/0 conn(0x7f54bc15ee50 msgr2=0x7f54bc163390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:09.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.969+0000 7f54ba7fc640 1 --2- 172.21.15.18:0/1469134881 >> v2:172.21.15.162:3300/0 conn(0x7f54bc15ee50 0x7f54bc163390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:09.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.969+0000 7f54ba7fc640 1 -- 172.21.15.18:0/1469134881 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54bc0d2160 con 0x7f54bc0cf420 2024-09-19T09:25:09.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.969+0000 7f54ba7fc640 1 -- 172.21.15.18:0/1469134881 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f54a4001840 con 0x7f54bc0cf420 2024-09-19T09:25:09.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.969+0000 7f54ba7fc640 1 -- 172.21.15.18:0/1469134881 >> v1:172.21.15.18:6789/0 conn(0x7f54bc0cf420 legacy=0x7f54bc0cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:09.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.969+0000 7f54ba7fc640 1 --2- 172.21.15.18:0/1469134881 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54a80039b0 0x7f54a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:09.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.969+0000 7f54ba7fc640 1 --2- 172.21.15.18:0/1469134881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54a8004800 0x7f54a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:09.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.969+0000 7f54ba7fc640 1 --2- 172.21.15.18:0/1469134881 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54bc15f230 0x7f54a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:09.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.969+0000 7f54ba7fc640 1 -- 172.21.15.18:0/1469134881 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc0d2440 con 0x7f54a8004800 2024-09-19T09:25:09.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.969+0000 7f54ba7fc640 1 -- 172.21.15.18:0/1469134881 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc0700b0 con 0x7f54a80039b0 2024-09-19T09:25:09.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.969+0000 7f54ba7fc640 1 -- 172.21.15.18:0/1469134881 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f54a800b9c0 con 0x7f54bc15f230 2024-09-19T09:25:09.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.969+0000 7f54b3fff640 1 --2- 172.21.15.18:0/1469134881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54a8004800 0x7f54a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:09.974 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.969+0000 7f54baffd640 1 --2- 172.21.15.18:0/1469134881 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54a80039b0 0x7f54a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:09.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.969+0000 7f54bb7fe640 1 --2- 172.21.15.18:0/1469134881 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54bc15f230 0x7f54a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:09.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.969+0000 7f54b3fff640 1 -- 172.21.15.18:0/1469134881 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54bc15f230 msgr2=0x7f54a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:09.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.969+0000 7f54b3fff640 1 --2- 172.21.15.18:0/1469134881 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54bc15f230 0x7f54a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:09.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.969+0000 7f54b3fff640 1 -- 172.21.15.18:0/1469134881 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54a80039b0 msgr2=0x7f54a8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:09.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.969+0000 7f54b3fff640 1 --2- 172.21.15.18:0/1469134881 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54a80039b0 0x7f54a8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:09.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.969+0000 7f54b3fff640 1 -- 172.21.15.18:0/1469134881 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54a8003520 con 0x7f54a8004800 2024-09-19T09:25:09.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.969+0000 7f54bb7fe640 1 --2- 172.21.15.18:0/1469134881 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54bc15f230 0x7f54a80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:09.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.970+0000 7f54b3fff640 1 --2- 172.21.15.18:0/1469134881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54a8004800 0x7f54a8004c80 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f54a400c3e0 tx=0x7f54a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d421d77ca4bf7d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:09.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.970+0000 7f54ba7fc640 1 -- 172.21.15.18:0/1469134881 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a4032020 con 0x7f54a8004800 2024-09-19T09:25:09.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.970+0000 7f54ba7fc640 1 -- 172.21.15.18:0/1469134881 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54a4005af0 con 0x7f54a8004800 2024-09-19T09:25:09.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.970+0000 7f54ba7fc640 1 -- 172.21.15.18:0/1469134881 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a400c0e0 con 0x7f54a8004800 2024-09-19T09:25:09.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.971+0000 7f54c12a6640 1 -- 172.21.15.18:0/1469134881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54a8004800 msgr2=0x7f54a8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:09.975 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.971+0000 7f54c12a6640 1 --2- 172.21.15.18:0/1469134881 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54a8004800 0x7f54a8004c80 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f54a400c3e0 tx=0x7f54a8005830 comp rx=0 tx=0).stop 2024-09-19T09:25:09.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.971+0000 7f54bb7fe640 1 -- 172.21.15.18:0/1469134881 reap_dead start 2024-09-19T09:25:09.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.971+0000 7f54c12a6640 1 -- 172.21.15.18:0/1469134881 shutdown_connections 2024-09-19T09:25:09.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.971+0000 7f54c12a6640 1 -- 172.21.15.18:0/1469134881 >> 172.21.15.18:0/1469134881 conn(0x7f54bc09b9d0 msgr2=0x7f54bc09bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:09.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.971+0000 7f54c12a6640 1 -- 172.21.15.18:0/1469134881 shutdown_connections 2024-09-19T09:25:09.976 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.971+0000 7f54c12a6640 1 -- 172.21.15.18:0/1469134881 wait complete. 2024-09-19T09:25:09.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.972+0000 7f54c12a6640 1 Processor -- start 2024-09-19T09:25:09.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.972+0000 7f54c12a6640 1 -- start start 2024-09-19T09:25:09.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.973+0000 7f54c12a6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54a8004800 0x7f54bc15b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:09.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.973+0000 7f54c12a6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54bc0b22d0 0x7f54bc158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:09.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.973+0000 7f54c12a6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54bc1f8860 0x7f54bc1f8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:09.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.973+0000 7f54c12a6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc0d0150 con 0x7f54bc1f8860 2024-09-19T09:25:09.979 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.973+0000 7f54c12a6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f54bc06fd40 con 0x7f54a8004800 2024-09-19T09:25:09.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.973+0000 7f54c12a6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f54bc0d1dc0 con 0x7f54bc0b22d0 2024-09-19T09:25:09.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.973+0000 7f54bb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54bc1f8860 0x7f54bc1f8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:09.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.973+0000 7f54bb7fe640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54bc1f8860 0x7f54bc1f8cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39120/0 (socket says 172.21.15.18:39120) 2024-09-19T09:25:09.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.973+0000 7f54bb7fe640 1 -- 172.21.15.18:0/1229079776 learned_addr learned my addr 172.21.15.18:0/1229079776 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:09.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.973+0000 7f54b3fff640 1 --2- 172.21.15.18:0/1229079776 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54bc0b22d0 0x7f54bc158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:09.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.973+0000 7f54baffd640 1 --2- 172.21.15.18:0/1229079776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54a8004800 0x7f54bc15b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:09.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.973+0000 7f54bb7fe640 1 -- 172.21.15.18:0/1229079776 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54bc0b22d0 msgr2=0x7f54bc158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:09.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.973+0000 7f54bb7fe640 1 --2- 172.21.15.18:0/1229079776 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f54bc0b22d0 0x7f54bc158c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:09.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.973+0000 7f54bb7fe640 1 -- 172.21.15.18:0/1229079776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54a8004800 msgr2=0x7f54bc15b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:09.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.973+0000 7f54bb7fe640 1 --2- 172.21.15.18:0/1229079776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f54a8004800 0x7f54bc15b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:09.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.973+0000 7f54bb7fe640 1 -- 172.21.15.18:0/1229079776 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54bc15c220 con 0x7f54bc1f8860 2024-09-19T09:25:09.980 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.973+0000 7f54bb7fe640 1 --2- 172.21.15.18:0/1229079776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54bc1f8860 0x7f54bc1f8cf0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0743a0 tx=0x7f54b4010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:09.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.974+0000 7f54b37fe640 1 -- 172.21.15.18:0/1229079776 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b401a030 con 0x7f54bc1f8860 2024-09-19T09:25:09.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.974+0000 7f54b37fe640 1 -- 172.21.15.18:0/1229079776 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54b4010e30 con 0x7f54bc1f8860 2024-09-19T09:25:09.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.974+0000 7f54b37fe640 1 -- 172.21.15.18:0/1229079776 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b4003bb0 con 0x7f54bc1f8860 2024-09-19T09:25:09.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.974+0000 7f54c12a6640 1 -- 172.21.15.18:0/1229079776 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54bc15c500 con 0x7f54bc1f8860 2024-09-19T09:25:09.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.974+0000 7f54c12a6640 1 -- 172.21.15.18:0/1229079776 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54bc0b3760 con 0x7f54bc1f8860 2024-09-19T09:25:09.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.974+0000 7f54c12a6640 1 -- 172.21.15.18:0/1229079776 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f54bc0b3b40 con 0x7f54bc1f8860 2024-09-19T09:25:09.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.975+0000 7f54b37fe640 1 -- 172.21.15.18:0/1229079776 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f54b401d070 con 0x7f54bc1f8860 2024-09-19T09:25:09.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.976+0000 7f54b37fe640 1 --2- 172.21.15.18:0/1229079776 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f549c06c2b0 0x7f549c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:09.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.976+0000 7f54b37fe640 1 -- 172.21.15.18:0/1229079776 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 4943+0+0 (secure 0 0 0) 0x7f54b408b5c0 con 0x7f54bc1f8860 2024-09-19T09:25:09.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.976+0000 7f54b37fe640 1 --2- 172.21.15.18:0/1229079776 >> [v2:172.21.15.18:6808/128722874,v1:172.21.15.18:6809/128722874] conn(0x7f549c072170 0x7f549c074590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:09.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.976+0000 7f54b37fe640 1 -- 172.21.15.18:0/1229079776 --> [v2:172.21.15.18:6808/128722874,v1:172.21.15.18:6809/128722874] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f549c074c40 con 0x7f549c072170 2024-09-19T09:25:09.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.976+0000 7f54b37fe640 1 -- 172.21.15.18:0/1229079776 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=188) ==== 24+0+0 (secure 0 0 0) 0x7f54b4092050 con 0x7f54bc1f8860 2024-09-19T09:25:09.981 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.976+0000 7f54baffd640 1 --2- 172.21.15.18:0/1229079776 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f549c06c2b0 0x7f549c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:09.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.976+0000 7f54b3fff640 1 --2- 172.21.15.18:0/1229079776 >> [v2:172.21.15.18:6808/128722874,v1:172.21.15.18:6809/128722874] conn(0x7f549c072170 0x7f549c074590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:09.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.976+0000 7f54b3fff640 1 --2- 172.21.15.18:0/1229079776 >> [v2:172.21.15.18:6808/128722874,v1:172.21.15.18:6809/128722874] conn(0x7f549c072170 0x7f549c074590 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:09.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.977+0000 7f54baffd640 1 --2- 172.21.15.18:0/1229079776 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f549c06c2b0 0x7f549c06e770 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f54ac009b40 tx=0x7f54ac009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:09.982 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.977+0000 7f54b37fe640 1 -- 172.21.15.18:0/1229079776 <== osd.0 v2:172.21.15.18:6808/128722874 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f549c074c40 con 0x7f549c072170 2024-09-19T09:25:09.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.988+0000 7f54c12a6640 1 -- 172.21.15.18:0/1229079776 --> [v2:172.21.15.18:6808/128722874,v1:172.21.15.18:6809/128722874] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f54bc1ea0e0 con 0x7f549c072170 2024-09-19T09:25:09.989 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.989+0000 7f54b37fe640 1 -- 172.21.15.18:0/1229079776 <== osd.0 v2:172.21.15.18:6808/128722874 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7f54bc1ea0e0 con 0x7f549c072170 2024-09-19T09:25:09.990 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:25:09.990 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-19T09:25:09.990 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:25:09.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.989+0000 7f54c12a6640 1 -- 172.21.15.18:0/1229079776 >> [v2:172.21.15.18:6808/128722874,v1:172.21.15.18:6809/128722874] conn(0x7f549c072170 msgr2=0x7f549c074590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:09.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.989+0000 7f54c12a6640 1 --2- 172.21.15.18:0/1229079776 >> [v2:172.21.15.18:6808/128722874,v1:172.21.15.18:6809/128722874] conn(0x7f549c072170 0x7f549c074590 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:09.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.989+0000 7f54c12a6640 1 -- 172.21.15.18:0/1229079776 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f549c06c2b0 msgr2=0x7f549c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:09.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.989+0000 7f54c12a6640 1 --2- 172.21.15.18:0/1229079776 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f549c06c2b0 0x7f549c06e770 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f54ac009b40 tx=0x7f54ac009190 comp rx=0 tx=0).stop 2024-09-19T09:25:09.991 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.989+0000 7f54c12a6640 1 -- 172.21.15.18:0/1229079776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54bc1f8860 msgr2=0x7f54bc1f8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:09.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.989+0000 7f54c12a6640 1 --2- 172.21.15.18:0/1229079776 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f54bc1f8860 0x7f54bc1f8cf0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f54bc0743a0 tx=0x7f54b4010590 comp rx=0 tx=0).stop 2024-09-19T09:25:09.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.989+0000 7f54bb7fe640 1 -- 172.21.15.18:0/1229079776 reap_dead start 2024-09-19T09:25:09.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.989+0000 7f54c12a6640 1 -- 172.21.15.18:0/1229079776 shutdown_connections 2024-09-19T09:25:09.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.989+0000 7f54c12a6640 1 -- 172.21.15.18:0/1229079776 >> 172.21.15.18:0/1229079776 conn(0x7f54bc09b9d0 msgr2=0x7f54bc09bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:09.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.989+0000 7f54c12a6640 1 -- 172.21.15.18:0/1229079776 shutdown_connections 2024-09-19T09:25:09.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:09.989+0000 7f54c12a6640 1 -- 172.21.15.18:0/1229079776 wait complete. 2024-09-19T09:25:10.001 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-19T09:25:10.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.103+0000 7f103d30c640 1 Processor -- start 2024-09-19T09:25:10.104 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.103+0000 7f103d30c640 1 -- start start 2024-09-19T09:25:10.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.104+0000 7f103d30c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f103806d730 0x7f10380b7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:10.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.104+0000 7f103d30c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10380b6290 0x7f103806db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:10.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.104+0000 7f103d30c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f103806e050 con 0x7f10381627a0 2024-09-19T09:25:10.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.104+0000 7f103d30c640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f10380b66d0 con 0x7f103806d730 2024-09-19T09:25:10.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.104+0000 7f103d30c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f10380b7890 con 0x7f10380b6290 2024-09-19T09:25:10.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.104+0000 7f1036ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f103806d730 0x7f10380b7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:10.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.104+0000 7f10377fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f10381627a0 0x7f1038162c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49662/0 (socket says 172.21.15.18:49662) 2024-09-19T09:25:10.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.104+0000 7f1036ffd640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f103806d730 0x7f10380b7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39126/0 (socket says 172.21.15.18:39126) 2024-09-19T09:25:10.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.104+0000 7f10377fe640 1 -- 172.21.15.18:0/3741486180 learned_addr learned my addr 172.21.15.18:0/3741486180 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:25:10.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.104+0000 7f10367fc640 1 --2- 172.21.15.18:0/3741486180 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10380b6290 0x7f103806db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:10.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.105+0000 7f1036ffd640 1 -- 172.21.15.18:0/3741486180 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10380b6290 msgr2=0x7f103806db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:10.106 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.105+0000 7f1036ffd640 1 --2- 172.21.15.18:0/3741486180 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10380b6290 0x7f103806db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.105+0000 7f1036ffd640 1 -- 172.21.15.18:0/3741486180 >> v1:172.21.15.18:6789/0 conn(0x7f10381627a0 legacy=0x7f1038162c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:10.107 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.105+0000 7f1036ffd640 1 -- 172.21.15.18:0/3741486180 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10380b7b70 con 0x7f103806d730 2024-09-19T09:25:10.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.105+0000 7f1036ffd640 1 --2- 172.21.15.18:0/3741486180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f103806d730 0x7f10380b7270 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f1028009d90 tx=0x7f102802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551320406109b202 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:10.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.105+0000 7f1035ffb640 1 -- 172.21.15.18:0/3741486180 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1028007740 con 0x7f103806d730 2024-09-19T09:25:10.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.105+0000 7f1035ffb640 1 -- 172.21.15.18:0/3741486180 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10280078e0 con 0x7f103806d730 2024-09-19T09:25:10.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.105+0000 7f1035ffb640 1 -- 172.21.15.18:0/3741486180 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1028007cb0 con 0x7f103806d730 2024-09-19T09:25:10.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.106+0000 7f103d30c640 1 -- 172.21.15.18:0/3741486180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f103806d730 msgr2=0x7f10380b7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:10.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.106+0000 7f103d30c640 1 --2- 172.21.15.18:0/3741486180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f103806d730 0x7f10380b7270 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f1028009d90 tx=0x7f102802a660 comp rx=0 tx=0).stop 2024-09-19T09:25:10.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.106+0000 7f103d30c640 1 -- 172.21.15.18:0/3741486180 shutdown_connections 2024-09-19T09:25:10.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.106+0000 7f103d30c640 1 --2- 172.21.15.18:0/3741486180 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10380b6290 0x7f103806db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.106+0000 7f103d30c640 1 --2- 172.21.15.18:0/3741486180 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f103806d730 0x7f10380b7270 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.106+0000 7f103d30c640 1 -- 172.21.15.18:0/3741486180 >> 172.21.15.18:0/3741486180 conn(0x7f10380b7e10 msgr2=0x7f10380b8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:10.108 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.106+0000 7f103d30c640 1 -- 172.21.15.18:0/3741486180 shutdown_connections 2024-09-19T09:25:10.109 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.106+0000 7f103d30c640 1 -- 172.21.15.18:0/3741486180 wait complete. 2024-09-19T09:25:10.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.107+0000 7f103d30c640 1 Processor -- start 2024-09-19T09:25:10.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.107+0000 7f103d30c640 1 -- start start 2024-09-19T09:25:10.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.108+0000 7f103d30c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f103806d730 0x7f1038157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:10.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.108+0000 7f103d30c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10380b6290 0x7f103815cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:10.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.108+0000 7f103d30c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10381627a0 0x7f103815cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:10.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.108+0000 7f103d30c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f10380cc2d0 con 0x7f103806d730 2024-09-19T09:25:10.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.108+0000 7f103d30c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f10380cbff0 con 0x7f10381627a0 2024-09-19T09:25:10.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.108+0000 7f103d30c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f10380b4310 con 0x7f10380b6290 2024-09-19T09:25:10.111 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.108+0000 7f1036ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f103806d730 0x7f1038157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:10.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.108+0000 7f1036ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f103806d730 0x7f1038157560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39128/0 (socket says 172.21.15.18:39128) 2024-09-19T09:25:10.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.108+0000 7f1036ffd640 1 -- 172.21.15.18:0/559093326 learned_addr learned my addr 172.21.15.18:0/559093326 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:10.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.108+0000 7f10367fc640 1 --2- 172.21.15.18:0/559093326 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10380b6290 0x7f103815cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:10.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.108+0000 7f10377fe640 1 --2- 172.21.15.18:0/559093326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10381627a0 0x7f103815cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:10.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.108+0000 7f1036ffd640 1 -- 172.21.15.18:0/559093326 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10380b6290 msgr2=0x7f103815cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:10.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.108+0000 7f1036ffd640 1 --2- 172.21.15.18:0/559093326 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10380b6290 0x7f103815cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.108+0000 7f1036ffd640 1 -- 172.21.15.18:0/559093326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10381627a0 msgr2=0x7f103815cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:10.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.108+0000 7f1036ffd640 1 --2- 172.21.15.18:0/559093326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10381627a0 0x7f103815cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.109+0000 7f1036ffd640 1 -- 172.21.15.18:0/559093326 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f103809cbd0 con 0x7f103806d730 2024-09-19T09:25:10.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.109+0000 7f10377fe640 1 --2- 172.21.15.18:0/559093326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10381627a0 0x7f103815cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:25:10.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.109+0000 7f1036ffd640 1 --2- 172.21.15.18:0/559093326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f103806d730 0x7f1038157560 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f1028009eb0 tx=0x7f1028004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:10.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.109+0000 7f102f7fe640 1 -- 172.21.15.18:0/559093326 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1028040070 con 0x7f103806d730 2024-09-19T09:25:10.112 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.109+0000 7f102f7fe640 1 -- 172.21.15.18:0/559093326 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1028031c40 con 0x7f103806d730 2024-09-19T09:25:10.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.109+0000 7f103d30c640 1 -- 172.21.15.18:0/559093326 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f103809ceb0 con 0x7f103806d730 2024-09-19T09:25:10.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.109+0000 7f102f7fe640 1 -- 172.21.15.18:0/559093326 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f102803c420 con 0x7f103806d730 2024-09-19T09:25:10.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.109+0000 7f103d30c640 1 -- 172.21.15.18:0/559093326 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f103809d470 con 0x7f103806d730 2024-09-19T09:25:10.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.110+0000 7f103d30c640 1 -- 172.21.15.18:0/559093326 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f103815efe0 con 0x7f103806d730 2024-09-19T09:25:10.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.110+0000 7f102f7fe640 1 -- 172.21.15.18:0/559093326 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f1028039040 con 0x7f103806d730 2024-09-19T09:25:10.113 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.111+0000 7f102f7fe640 1 --2- 172.21.15.18:0/559093326 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f101806c2b0 0x7f101806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:10.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.111+0000 7f102f7fe640 1 -- 172.21.15.18:0/559093326 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 4943+0+0 (secure 0 0 0) 0x7f10280ac6d0 con 0x7f103806d730 2024-09-19T09:25:10.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.111+0000 7f10367fc640 1 --2- 172.21.15.18:0/559093326 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f101806c2b0 0x7f101806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:10.114 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.111+0000 7f10367fc640 1 --2- 172.21.15.18:0/559093326 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f101806c2b0 0x7f101806e770 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1020006fd0 tx=0x7f1020008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:10.116 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.115+0000 7f102f7fe640 1 -- 172.21.15.18:0/559093326 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f102807b140 con 0x7f103806d730 2024-09-19T09:25:10.291 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.290+0000 7f103d30c640 1 -- 172.21.15.18:0/559093326 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f10380b3ff0 con 0x7f101806c2b0 2024-09-19T09:25:10.292 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.291+0000 7f102f7fe640 1 -- 172.21.15.18:0/559093326 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f10380b3ff0 con 0x7f101806c2b0 2024-09-19T09:25:10.292 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 0 to deep-scrub 2024-09-19T09:25:10.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.293+0000 7f103d30c640 1 -- 172.21.15.18:0/559093326 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f101806c2b0 msgr2=0x7f101806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:10.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.293+0000 7f103d30c640 1 --2- 172.21.15.18:0/559093326 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f101806c2b0 0x7f101806e770 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1020006fd0 tx=0x7f1020008040 comp rx=0 tx=0).stop 2024-09-19T09:25:10.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.293+0000 7f103d30c640 1 -- 172.21.15.18:0/559093326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f103806d730 msgr2=0x7f1038157560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:10.294 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.293+0000 7f103d30c640 1 --2- 172.21.15.18:0/559093326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f103806d730 0x7f1038157560 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7f1028009eb0 tx=0x7f1028004a40 comp rx=0 tx=0).stop 2024-09-19T09:25:10.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.293+0000 7f103d30c640 1 -- 172.21.15.18:0/559093326 shutdown_connections 2024-09-19T09:25:10.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.293+0000 7f103d30c640 1 --2- 172.21.15.18:0/559093326 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f101806c2b0 0x7f101806e770 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.293+0000 7f103d30c640 1 --2- 172.21.15.18:0/559093326 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f10381627a0 0x7f103815cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.293+0000 7f103d30c640 1 --2- 172.21.15.18:0/559093326 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f10380b6290 0x7f103815cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.293+0000 7f103d30c640 1 --2- 172.21.15.18:0/559093326 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f103806d730 0x7f1038157560 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.293+0000 7f103d30c640 1 -- 172.21.15.18:0/559093326 >> 172.21.15.18:0/559093326 conn(0x7f10380b7e10 msgr2=0x7f1038157f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:10.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.293+0000 7f103d30c640 1 -- 172.21.15.18:0/559093326 shutdown_connections 2024-09-19T09:25:10.295 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.293+0000 7f103d30c640 1 -- 172.21.15.18:0/559093326 wait complete. 2024-09-19T09:25:10.305 INFO:tasks.ceph:Scrubbing osd.1 2024-09-19T09:25:10.305 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-19T09:25:10.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.410+0000 7f6f24453640 1 Processor -- start 2024-09-19T09:25:10.411 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.410+0000 7f6f24453640 1 -- start start 2024-09-19T09:25:10.412 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.411+0000 7f6f24453640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f1c0cfa60 0x7f6f1c0b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:10.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.411+0000 7f6f24453640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f1c0b3bf0 con 0x7f6f1c162410 2024-09-19T09:25:10.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.411+0000 7f6f24453640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f1c06d8d0 con 0x7f6f1c0b5180 2024-09-19T09:25:10.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.411+0000 7f6f24453640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6f1c06df20 con 0x7f6f1c0cfa60 2024-09-19T09:25:10.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.411+0000 7f6f221ef640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6f1c162410 0x7f6f1c0cf350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49672/0 (socket says 172.21.15.18:49672) 2024-09-19T09:25:10.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.411+0000 7f6f221ef640 1 -- 172.21.15.18:0/3693756115 learned_addr learned my addr 172.21.15.18:0/3693756115 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:25:10.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.411+0000 7f6f219ee640 1 --2- 172.21.15.18:0/3693756115 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f1c0cfa60 0x7f6f1c0b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:10.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.411+0000 7f6f211ed640 1 -- 172.21.15.18:0/3693756115 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3680602530 0 0) 0x7f6f1c0b3bf0 con 0x7f6f1c162410 2024-09-19T09:25:10.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.411+0000 7f6f211ed640 1 -- 172.21.15.18:0/3693756115 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f08003520 con 0x7f6f1c162410 2024-09-19T09:25:10.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.412+0000 7f6f211ed640 1 -- 172.21.15.18:0/3693756115 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1310641872 0 0) 0x7f6f1c06d8d0 con 0x7f6f1c0b5180 2024-09-19T09:25:10.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.412+0000 7f6f211ed640 1 -- 172.21.15.18:0/3693756115 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f1c0b3bf0 con 0x7f6f1c0b5180 2024-09-19T09:25:10.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.412+0000 7f6f211ed640 1 -- 172.21.15.18:0/3693756115 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1181050939 0 0) 0x7f6f08003520 con 0x7f6f1c162410 2024-09-19T09:25:10.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.412+0000 7f6f219ee640 1 -- 172.21.15.18:0/3693756115 >> v1:172.21.15.162:6789/0 conn(0x7f6f1c0b5180 legacy=0x7f6f1c0d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:10.413 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.412+0000 7f6f219ee640 1 -- 172.21.15.18:0/3693756115 >> v1:172.21.15.18:6789/0 conn(0x7f6f1c162410 legacy=0x7f6f1c0cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:10.414 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.412+0000 7f6f219ee640 1 -- 172.21.15.18:0/3693756115 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f1c06dbb0 con 0x7f6f1c0cfa60 2024-09-19T09:25:10.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.412+0000 7f6f219ee640 1 --2- 172.21.15.18:0/3693756115 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f1c0cfa60 0x7f6f1c0b35e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6f100097d0 tx=0x7f6f1002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2c68f7e68d64cb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:10.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.413+0000 7f6f211ed640 1 -- 172.21.15.18:0/3693756115 <== mon.2 v2:172.21.15.162:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f10037070 con 0x7f6f1c0cfa60 2024-09-19T09:25:10.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.413+0000 7f6f211ed640 1 -- 172.21.15.18:0/3693756115 <== mon.2 v2:172.21.15.162:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f1002ac30 con 0x7f6f1c0cfa60 2024-09-19T09:25:10.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.413+0000 7f6f211ed640 1 -- 172.21.15.18:0/3693756115 <== mon.2 v2:172.21.15.162:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f18001670 con 0x7f6f1c0cfa60 2024-09-19T09:25:10.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.413+0000 7f6f24453640 1 -- 172.21.15.18:0/3693756115 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f1c0cfa60 msgr2=0x7f6f1c0b35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:10.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.413+0000 7f6f24453640 1 --2- 172.21.15.18:0/3693756115 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f1c0cfa60 0x7f6f1c0b35e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6f100097d0 tx=0x7f6f1002a1a0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.413+0000 7f6f24453640 1 -- 172.21.15.18:0/3693756115 shutdown_connections 2024-09-19T09:25:10.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.413+0000 7f6f24453640 1 --2- 172.21.15.18:0/3693756115 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f1c0cfa60 0x7f6f1c0b35e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.413+0000 7f6f24453640 1 -- 172.21.15.18:0/3693756115 >> 172.21.15.18:0/3693756115 conn(0x7f6f1c0b4660 msgr2=0x7f6f1c0b4a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:10.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.413+0000 7f6f24453640 1 -- 172.21.15.18:0/3693756115 shutdown_connections 2024-09-19T09:25:10.415 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.413+0000 7f6f24453640 1 -- 172.21.15.18:0/3693756115 wait complete. 2024-09-19T09:25:10.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.414+0000 7f6f24453640 1 Processor -- start 2024-09-19T09:25:10.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.414+0000 7f6f24453640 1 -- start start 2024-09-19T09:25:10.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.415+0000 7f6f24453640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f1c0b5180 0x7f6f1c15efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:10.418 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.415+0000 7f6f24453640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f1c0cfa60 0x7f6f1c0c8220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:10.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.415+0000 7f6f24453640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f1c162410 0x7f6f1c070840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:10.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.415+0000 7f6f24453640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c0d00e0 con 0x7f6f1c0cfa60 2024-09-19T09:25:10.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.415+0000 7f6f24453640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6f1c0cff60 con 0x7f6f1c0b5180 2024-09-19T09:25:10.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.415+0000 7f6f24453640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6f1c0d1400 con 0x7f6f1c162410 2024-09-19T09:25:10.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.415+0000 7f6f219ee640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f1c0cfa60 0x7f6f1c0c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:10.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.415+0000 7f6f219ee640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f1c0cfa60 0x7f6f1c0c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39138/0 (socket says 172.21.15.18:39138) 2024-09-19T09:25:10.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.415+0000 7f6f219ee640 1 -- 172.21.15.18:0/252615459 learned_addr learned my addr 172.21.15.18:0/252615459 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:10.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.415+0000 7f6f229f0640 1 --2- 172.21.15.18:0/252615459 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f1c162410 0x7f6f1c070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:10.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.416+0000 7f6f221ef640 1 --2- 172.21.15.18:0/252615459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f1c0b5180 0x7f6f1c15efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:10.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.416+0000 7f6f219ee640 1 -- 172.21.15.18:0/252615459 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f1c162410 msgr2=0x7f6f1c070840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:10.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.416+0000 7f6f219ee640 1 --2- 172.21.15.18:0/252615459 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6f1c162410 0x7f6f1c070840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.416+0000 7f6f219ee640 1 -- 172.21.15.18:0/252615459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f1c0b5180 msgr2=0x7f6f1c15efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:10.419 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.416+0000 7f6f219ee640 1 --2- 172.21.15.18:0/252615459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f1c0b5180 0x7f6f1c15efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.416+0000 7f6f219ee640 1 -- 172.21.15.18:0/252615459 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f1c0b6a50 con 0x7f6f1c0cfa60 2024-09-19T09:25:10.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.416+0000 7f6f221ef640 1 --2- 172.21.15.18:0/252615459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6f1c0b5180 0x7f6f1c15efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:10.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.416+0000 7f6f219ee640 1 --2- 172.21.15.18:0/252615459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f1c0cfa60 0x7f6f1c0c8220 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f6f10009720 tx=0x7f6f100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:10.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.416+0000 7f6f0effd640 1 -- 172.21.15.18:0/252615459 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f10041070 con 0x7f6f1c0cfa60 2024-09-19T09:25:10.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.416+0000 7f6f0effd640 1 -- 172.21.15.18:0/252615459 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f1003c660 con 0x7f6f1c0cfa60 2024-09-19T09:25:10.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.416+0000 7f6f24453640 1 -- 172.21.15.18:0/252615459 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f1c0b6d30 con 0x7f6f1c0cfa60 2024-09-19T09:25:10.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.416+0000 7f6f0effd640 1 -- 172.21.15.18:0/252615459 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f10037040 con 0x7f6f1c0cfa60 2024-09-19T09:25:10.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.416+0000 7f6f24453640 1 -- 172.21.15.18:0/252615459 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f1c0b72f0 con 0x7f6f1c0cfa60 2024-09-19T09:25:10.420 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.417+0000 7f6f24453640 1 -- 172.21.15.18:0/252615459 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6f1c0d0cf0 con 0x7f6f1c0cfa60 2024-09-19T09:25:10.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.418+0000 7f6f0effd640 1 -- 172.21.15.18:0/252615459 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6f10044070 con 0x7f6f1c0cfa60 2024-09-19T09:25:10.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.418+0000 7f6f0effd640 1 --2- 172.21.15.18:0/252615459 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6f0006c2b0 0x7f6f0006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:10.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.418+0000 7f6f0effd640 1 -- 172.21.15.18:0/252615459 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 4943+0+0 (secure 0 0 0) 0x7f6f100abd40 con 0x7f6f1c0cfa60 2024-09-19T09:25:10.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.418+0000 7f6f0effd640 1 --2- 172.21.15.18:0/252615459 >> [v2:172.21.15.18:6816/3672199638,v1:172.21.15.18:6817/3672199638] conn(0x7f6f00072170 0x7f6f00074590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:10.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.418+0000 7f6f0effd640 1 -- 172.21.15.18:0/252615459 --> [v2:172.21.15.18:6816/3672199638,v1:172.21.15.18:6817/3672199638] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f10044e50 con 0x7f6f00072170 2024-09-19T09:25:10.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.418+0000 7f6f0effd640 1 -- 172.21.15.18:0/252615459 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=188) ==== 24+0+0 (secure 0 0 0) 0x7f6f100ac1d0 con 0x7f6f1c0cfa60 2024-09-19T09:25:10.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.419+0000 7f6f221ef640 1 --2- 172.21.15.18:0/252615459 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6f0006c2b0 0x7f6f0006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:10.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.419+0000 7f6f229f0640 1 --2- 172.21.15.18:0/252615459 >> [v2:172.21.15.18:6816/3672199638,v1:172.21.15.18:6817/3672199638] conn(0x7f6f00072170 0x7f6f00074590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:10.422 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.419+0000 7f6f229f0640 1 --2- 172.21.15.18:0/252615459 >> [v2:172.21.15.18:6816/3672199638,v1:172.21.15.18:6817/3672199638] conn(0x7f6f00072170 0x7f6f00074590 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:10.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.419+0000 7f6f221ef640 1 --2- 172.21.15.18:0/252615459 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6f0006c2b0 0x7f6f0006e770 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f6f180011e0 tx=0x7f6f18009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:10.423 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.420+0000 7f6f0effd640 1 -- 172.21.15.18:0/252615459 <== osd.1 v2:172.21.15.18:6816/3672199638 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f6f10044e50 con 0x7f6f00072170 2024-09-19T09:25:10.431 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.431+0000 7f6f24453640 1 -- 172.21.15.18:0/252615459 --> [v2:172.21.15.18:6816/3672199638,v1:172.21.15.18:6817/3672199638] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6f1c0cf840 con 0x7f6f00072170 2024-09-19T09:25:10.432 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.431+0000 7f6f0effd640 1 -- 172.21.15.18:0/252615459 <== osd.1 v2:172.21.15.18:6816/3672199638 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7f6f1c0cf840 con 0x7f6f00072170 2024-09-19T09:25:10.432 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:25:10.432 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-19T09:25:10.432 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:25:10.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.431+0000 7f6f24453640 1 -- 172.21.15.18:0/252615459 >> [v2:172.21.15.18:6816/3672199638,v1:172.21.15.18:6817/3672199638] conn(0x7f6f00072170 msgr2=0x7f6f00074590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:10.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.431+0000 7f6f24453640 1 --2- 172.21.15.18:0/252615459 >> [v2:172.21.15.18:6816/3672199638,v1:172.21.15.18:6817/3672199638] conn(0x7f6f00072170 0x7f6f00074590 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.431+0000 7f6f24453640 1 -- 172.21.15.18:0/252615459 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6f0006c2b0 msgr2=0x7f6f0006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:10.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.431+0000 7f6f24453640 1 --2- 172.21.15.18:0/252615459 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6f0006c2b0 0x7f6f0006e770 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f6f180011e0 tx=0x7f6f18009040 comp rx=0 tx=0).stop 2024-09-19T09:25:10.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.431+0000 7f6f24453640 1 -- 172.21.15.18:0/252615459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f1c0cfa60 msgr2=0x7f6f1c0c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:10.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.431+0000 7f6f24453640 1 --2- 172.21.15.18:0/252615459 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6f1c0cfa60 0x7f6f1c0c8220 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f6f10009720 tx=0x7f6f100046c0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.431+0000 7f6f229f0640 1 -- 172.21.15.18:0/252615459 reap_dead start 2024-09-19T09:25:10.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.431+0000 7f6f24453640 1 -- 172.21.15.18:0/252615459 shutdown_connections 2024-09-19T09:25:10.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.431+0000 7f6f24453640 1 -- 172.21.15.18:0/252615459 >> 172.21.15.18:0/252615459 conn(0x7f6f1c0b4660 msgr2=0x7f6f1c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:10.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.431+0000 7f6f24453640 1 -- 172.21.15.18:0/252615459 shutdown_connections 2024-09-19T09:25:10.434 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.432+0000 7f6f24453640 1 -- 172.21.15.18:0/252615459 wait complete. 2024-09-19T09:25:10.442 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-19T09:25:10.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.545+0000 7fd624e4c640 1 Processor -- start 2024-09-19T09:25:10.546 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.545+0000 7fd624e4c640 1 -- start start 2024-09-19T09:25:10.547 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.546+0000 7fd624e4c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd6200d5790 0x7fd6200d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:10.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.546+0000 7fd624e4c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd6200d1630 0x7fd6200d1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:10.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.546+0000 7fd624e4c640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6200d3cc0 con 0x7fd62015eda0 2024-09-19T09:25:10.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.546+0000 7fd624e4c640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fd6200d5c00 con 0x7fd6200d1630 2024-09-19T09:25:10.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.546+0000 7fd624e4c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd6200d09c0 con 0x7fd6200d5790 2024-09-19T09:25:10.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.546+0000 7fd61ed9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd6200d1630 0x7fd6200d1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:10.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.546+0000 7fd61ed9d640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fd6200d1630 0x7fd6200d1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39146/0 (socket says 172.21.15.18:39146) 2024-09-19T09:25:10.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.546+0000 7fd61e59c640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fd62015eda0 0x7fd6200d35b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49684/0 (socket says 172.21.15.18:49684) 2024-09-19T09:25:10.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.546+0000 7fd61ed9d640 1 -- 172.21.15.18:0/3088582585 learned_addr learned my addr 172.21.15.18:0/3088582585 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:10.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.547+0000 7fd61dd9b640 1 --2- 172.21.15.18:0/3088582585 >> v2:172.21.15.162:3300/0 conn(0x7fd6200d5790 0x7fd6200d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:10.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.547+0000 7fd61ed9d640 1 -- 172.21.15.18:0/3088582585 >> v2:172.21.15.162:3300/0 conn(0x7fd6200d5790 msgr2=0x7fd6200d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:10.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.547+0000 7fd61ed9d640 1 --2- 172.21.15.18:0/3088582585 >> v2:172.21.15.162:3300/0 conn(0x7fd6200d5790 0x7fd6200d0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.548 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.547+0000 7fd61ed9d640 1 -- 172.21.15.18:0/3088582585 >> v1:172.21.15.18:6789/0 conn(0x7fd62015eda0 legacy=0x7fd6200d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:10.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.547+0000 7fd61ed9d640 1 -- 172.21.15.18:0/3088582585 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6200d0bf0 con 0x7fd6200d1630 2024-09-19T09:25:10.549 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.547+0000 7fd61d59a640 1 -- 172.21.15.18:0/3088582585 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4093069220 0 0) 0x7fd6200d3cc0 con 0x7fd62015eda0 2024-09-19T09:25:10.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.547+0000 7fd61ed9d640 1 --2- 172.21.15.18:0/3088582585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6200d1630 0x7fd6200d1ac0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fd6200b7870 tx=0x7fd61802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a4426a8f77d0b0a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:10.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.548+0000 7fd61d59a640 1 -- 172.21.15.18:0/3088582585 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd618037070 con 0x7fd6200d1630 2024-09-19T09:25:10.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.548+0000 7fd61d59a640 1 -- 172.21.15.18:0/3088582585 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd618032440 con 0x7fd6200d1630 2024-09-19T09:25:10.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.548+0000 7fd61d59a640 1 -- 172.21.15.18:0/3088582585 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd618032810 con 0x7fd6200d1630 2024-09-19T09:25:10.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.548+0000 7fd624e4c640 1 -- 172.21.15.18:0/3088582585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6200d1630 msgr2=0x7fd6200d1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:10.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.548+0000 7fd624e4c640 1 --2- 172.21.15.18:0/3088582585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6200d1630 0x7fd6200d1ac0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fd6200b7870 tx=0x7fd61802a270 comp rx=0 tx=0).stop 2024-09-19T09:25:10.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.548+0000 7fd624e4c640 1 -- 172.21.15.18:0/3088582585 shutdown_connections 2024-09-19T09:25:10.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.548+0000 7fd624e4c640 1 --2- 172.21.15.18:0/3088582585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6200d1630 0x7fd6200d1ac0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.548+0000 7fd624e4c640 1 --2- 172.21.15.18:0/3088582585 >> v2:172.21.15.162:3300/0 conn(0x7fd6200d5790 0x7fd6200d0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.548+0000 7fd624e4c640 1 -- 172.21.15.18:0/3088582585 >> 172.21.15.18:0/3088582585 conn(0x7fd62009df40 msgr2=0x7fd6200d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:10.550 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.548+0000 7fd624e4c640 1 -- 172.21.15.18:0/3088582585 shutdown_connections 2024-09-19T09:25:10.551 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.548+0000 7fd624e4c640 1 -- 172.21.15.18:0/3088582585 wait complete. 2024-09-19T09:25:10.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.550+0000 7fd624e4c640 1 Processor -- start 2024-09-19T09:25:10.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.550+0000 7fd624e4c640 1 -- start start 2024-09-19T09:25:10.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.550+0000 7fd624e4c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6200d1630 0x7fd6201602b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:10.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.550+0000 7fd624e4c640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6200d5790 0x7fd620159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:10.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.550+0000 7fd624e4c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd62015eda0 0x7fd6200cce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:10.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.550+0000 7fd624e4c640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fd6200d3120 con 0x7fd6200d1630 2024-09-19T09:25:10.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.550+0000 7fd624e4c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd6200d2880 con 0x7fd62015eda0 2024-09-19T09:25:10.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.550+0000 7fd624e4c640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fd6200d2db0 con 0x7fd6200d5790 2024-09-19T09:25:10.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.550+0000 7fd61e59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6200d1630 0x7fd6201602b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:10.553 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.550+0000 7fd61e59c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6200d1630 0x7fd6201602b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39148/0 (socket says 172.21.15.18:39148) 2024-09-19T09:25:10.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.550+0000 7fd61e59c640 1 -- 172.21.15.18:0/2571890276 learned_addr learned my addr 172.21.15.18:0/2571890276 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:10.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.551+0000 7fd61e59c640 1 -- 172.21.15.18:0/2571890276 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6200d5790 msgr2=0x7fd620159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:10.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.551+0000 7fd61ed9d640 1 --2- 172.21.15.18:0/2571890276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd62015eda0 0x7fd6200cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:10.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.551+0000 7fd61dd9b640 1 --2- 172.21.15.18:0/2571890276 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6200d5790 0x7fd620159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:10.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.551+0000 7fd61e59c640 1 --2- 172.21.15.18:0/2571890276 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6200d5790 0x7fd620159ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.551+0000 7fd61e59c640 1 -- 172.21.15.18:0/2571890276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd62015eda0 msgr2=0x7fd6200cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:10.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.551+0000 7fd61e59c640 1 --2- 172.21.15.18:0/2571890276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd62015eda0 0x7fd6200cce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.551+0000 7fd61e59c640 1 -- 172.21.15.18:0/2571890276 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd620160820 con 0x7fd6200d1630 2024-09-19T09:25:10.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.551+0000 7fd61ed9d640 1 --2- 172.21.15.18:0/2571890276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd62015eda0 0x7fd6200cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:25:10.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.551+0000 7fd61e59c640 1 --2- 172.21.15.18:0/2571890276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6200d1630 0x7fd6201602b0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fd61000c7c0 tx=0x7fd61000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:10.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.551+0000 7fd616ffd640 1 -- 172.21.15.18:0/2571890276 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd610018070 con 0x7fd6200d1630 2024-09-19T09:25:10.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.551+0000 7fd616ffd640 1 -- 172.21.15.18:0/2571890276 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd61000a5e0 con 0x7fd6200d1630 2024-09-19T09:25:10.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.551+0000 7fd624e4c640 1 -- 172.21.15.18:0/2571890276 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd620160a90 con 0x7fd6200d1630 2024-09-19T09:25:10.554 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.551+0000 7fd616ffd640 1 -- 172.21.15.18:0/2571890276 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd61000a9d0 con 0x7fd6200d1630 2024-09-19T09:25:10.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.551+0000 7fd624e4c640 1 -- 172.21.15.18:0/2571890276 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6200c89f0 con 0x7fd6200d1630 2024-09-19T09:25:10.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.552+0000 7fd624e4c640 1 -- 172.21.15.18:0/2571890276 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6200b5f50 con 0x7fd6200d1630 2024-09-19T09:25:10.555 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.553+0000 7fd616ffd640 1 -- 172.21.15.18:0/2571890276 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fd61001b070 con 0x7fd6200d1630 2024-09-19T09:25:10.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.553+0000 7fd616ffd640 1 --2- 172.21.15.18:0/2571890276 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd60006c2b0 0x7fd60006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:10.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.553+0000 7fd616ffd640 1 -- 172.21.15.18:0/2571890276 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 4943+0+0 (secure 0 0 0) 0x7fd61008a690 con 0x7fd6200d1630 2024-09-19T09:25:10.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.553+0000 7fd61dd9b640 1 --2- 172.21.15.18:0/2571890276 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd60006c2b0 0x7fd60006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:10.556 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.554+0000 7fd61dd9b640 1 --2- 172.21.15.18:0/2571890276 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd60006c2b0 0x7fd60006e770 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fd6200ca360 tx=0x7fd608008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:10.558 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.557+0000 7fd616ffd640 1 -- 172.21.15.18:0/2571890276 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fd610059190 con 0x7fd6200d1630 2024-09-19T09:25:10.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.733+0000 7fd624e4c640 1 -- 172.21.15.18:0/2571890276 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fd6200d2330 con 0x7fd60006c2b0 2024-09-19T09:25:10.734 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.733+0000 7fd616ffd640 1 -- 172.21.15.18:0/2571890276 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd6200d2330 con 0x7fd60006c2b0 2024-09-19T09:25:10.734 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 1 to deep-scrub 2024-09-19T09:25:10.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.736+0000 7fd624e4c640 1 -- 172.21.15.18:0/2571890276 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd60006c2b0 msgr2=0x7fd60006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:10.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.736+0000 7fd624e4c640 1 --2- 172.21.15.18:0/2571890276 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd60006c2b0 0x7fd60006e770 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fd6200ca360 tx=0x7fd608008040 comp rx=0 tx=0).stop 2024-09-19T09:25:10.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.736+0000 7fd624e4c640 1 -- 172.21.15.18:0/2571890276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6200d1630 msgr2=0x7fd6201602b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:10.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.736+0000 7fd624e4c640 1 --2- 172.21.15.18:0/2571890276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6200d1630 0x7fd6201602b0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fd61000c7c0 tx=0x7fd61000cc80 comp rx=0 tx=0).stop 2024-09-19T09:25:10.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.736+0000 7fd624e4c640 1 -- 172.21.15.18:0/2571890276 shutdown_connections 2024-09-19T09:25:10.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.736+0000 7fd624e4c640 1 --2- 172.21.15.18:0/2571890276 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fd60006c2b0 0x7fd60006e770 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.736+0000 7fd624e4c640 1 --2- 172.21.15.18:0/2571890276 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd62015eda0 0x7fd6200cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.736+0000 7fd624e4c640 1 --2- 172.21.15.18:0/2571890276 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fd6200d5790 0x7fd620159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.737 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.736+0000 7fd624e4c640 1 --2- 172.21.15.18:0/2571890276 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fd6200d1630 0x7fd6201602b0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.736+0000 7fd624e4c640 1 -- 172.21.15.18:0/2571890276 >> 172.21.15.18:0/2571890276 conn(0x7fd62009df40 msgr2=0x7fd6200b7ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:10.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.736+0000 7fd624e4c640 1 -- 172.21.15.18:0/2571890276 shutdown_connections 2024-09-19T09:25:10.738 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.736+0000 7fd624e4c640 1 -- 172.21.15.18:0/2571890276 wait complete. 2024-09-19T09:25:10.747 INFO:tasks.ceph:Scrubbing osd.2 2024-09-19T09:25:10.748 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-19T09:25:10.854 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.854+0000 7f8a1705e640 1 Processor -- start 2024-09-19T09:25:10.855 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.854+0000 7f8a1705e640 1 -- start start 2024-09-19T09:25:10.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.854+0000 7f8a1705e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8a10072d90 0x7f8a10166590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:10.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.854+0000 7f8a1705e640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a10160310 con 0x7f8a101445a0 2024-09-19T09:25:10.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.854+0000 7f8a1705e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a10160030 con 0x7f8a100ced50 2024-09-19T09:25:10.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.854+0000 7f8a1705e640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f8a100b4d20 con 0x7f8a10072d90 2024-09-19T09:25:10.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.855+0000 7f8a155fb640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8a10072d90 0x7f8a10166590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:10.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.855+0000 7f8a155fb640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f8a10072d90 0x7f8a10166590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39156/0 (socket says 172.21.15.18:39156) 2024-09-19T09:25:10.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.855+0000 7f8a14dfa640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f8a101445a0 0x7f8a100cd380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49696/0 (socket says 172.21.15.18:49696) 2024-09-19T09:25:10.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.855+0000 7f8a155fb640 1 -- 172.21.15.18:0/2031204705 learned_addr learned my addr 172.21.15.18:0/2031204705 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:10.856 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.855+0000 7f8a155fb640 1 -- 172.21.15.18:0/2031204705 >> v1:172.21.15.162:6789/0 conn(0x7f8a100ced50 legacy=0x7f8a10072680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:10.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.855+0000 7f8a155fb640 1 -- 172.21.15.18:0/2031204705 >> v1:172.21.15.18:6789/0 conn(0x7f8a101445a0 legacy=0x7f8a100cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:10.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.855+0000 7f8a155fb640 1 -- 172.21.15.18:0/2031204705 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a100b5940 con 0x7f8a10072d90 2024-09-19T09:25:10.857 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.855+0000 7f8a0f7fe640 1 -- 172.21.15.18:0/2031204705 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 908892944 0 0) 0x7f8a10160310 con 0x7f8a101445a0 2024-09-19T09:25:10.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.856+0000 7f8a155fb640 1 --2- 172.21.15.18:0/2031204705 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a10072d90 0x7f8a10166590 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f8a08009e50 tx=0x7f8a0802a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72a6a527eab0f369 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:10.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.856+0000 7f8a0f7fe640 1 -- 172.21.15.18:0/2031204705 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a08036070 con 0x7f8a10072d90 2024-09-19T09:25:10.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.856+0000 7f8a0f7fe640 1 -- 172.21.15.18:0/2031204705 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a08031600 con 0x7f8a10072d90 2024-09-19T09:25:10.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.856+0000 7f8a0f7fe640 1 -- 172.21.15.18:0/2031204705 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a080319d0 con 0x7f8a10072d90 2024-09-19T09:25:10.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.856+0000 7f8a1705e640 1 -- 172.21.15.18:0/2031204705 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a10072d90 msgr2=0x7f8a10166590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:10.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.856+0000 7f8a1705e640 1 --2- 172.21.15.18:0/2031204705 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a10072d90 0x7f8a10166590 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f8a08009e50 tx=0x7f8a0802a640 comp rx=0 tx=0).stop 2024-09-19T09:25:10.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.856+0000 7f8a1705e640 1 -- 172.21.15.18:0/2031204705 shutdown_connections 2024-09-19T09:25:10.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.856+0000 7f8a1705e640 1 --2- 172.21.15.18:0/2031204705 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a10072d90 0x7f8a10166590 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.858 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.856+0000 7f8a1705e640 1 -- 172.21.15.18:0/2031204705 >> 172.21.15.18:0/2031204705 conn(0x7f8a100b26a0 msgr2=0x7f8a100b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:10.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.856+0000 7f8a1705e640 1 -- 172.21.15.18:0/2031204705 shutdown_connections 2024-09-19T09:25:10.859 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.856+0000 7f8a1705e640 1 -- 172.21.15.18:0/2031204705 wait complete. 2024-09-19T09:25:10.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.858+0000 7f8a1705e640 1 Processor -- start 2024-09-19T09:25:10.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.858+0000 7f8a1705e640 1 -- start start 2024-09-19T09:25:10.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.858+0000 7f8a1705e640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a10072d90 0x7f8a10141b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:10.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.858+0000 7f8a1705e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a100ced50 0x7f8a1015a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:10.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.858+0000 7f8a1705e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a101445a0 0x7f8a100aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:10.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.858+0000 7f8a1705e640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f8a10144980 con 0x7f8a100ced50 2024-09-19T09:25:10.861 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.858+0000 7f8a1705e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8a100b5f00 con 0x7f8a101445a0 2024-09-19T09:25:10.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.858+0000 7f8a1705e640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f8a10144b00 con 0x7f8a10072d90 2024-09-19T09:25:10.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.859+0000 7f8a0ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a100ced50 0x7f8a1015a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:10.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.859+0000 7f8a0ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a100ced50 0x7f8a1015a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39166/0 (socket says 172.21.15.18:39166) 2024-09-19T09:25:10.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.859+0000 7f8a0ffff640 1 -- 172.21.15.18:0/593468195 learned_addr learned my addr 172.21.15.18:0/593468195 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:10.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.859+0000 7f8a155fb640 1 --2- 172.21.15.18:0/593468195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a101445a0 0x7f8a100aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:10.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.859+0000 7f8a14dfa640 1 --2- 172.21.15.18:0/593468195 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a10072d90 0x7f8a10141b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:10.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.859+0000 7f8a0ffff640 1 -- 172.21.15.18:0/593468195 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a10072d90 msgr2=0x7f8a10141b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:10.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.859+0000 7f8a0ffff640 1 --2- 172.21.15.18:0/593468195 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a10072d90 0x7f8a10141b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.859+0000 7f8a0ffff640 1 -- 172.21.15.18:0/593468195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a101445a0 msgr2=0x7f8a100aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:10.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.859+0000 7f8a0ffff640 1 --2- 172.21.15.18:0/593468195 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a101445a0 0x7f8a100aeb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.862 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.859+0000 7f8a0ffff640 1 -- 172.21.15.18:0/593468195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a100af530 con 0x7f8a100ced50 2024-09-19T09:25:10.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.859+0000 7f8a14dfa640 1 --2- 172.21.15.18:0/593468195 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f8a10072d90 0x7f8a10141b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:10.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.859+0000 7f8a0ffff640 1 --2- 172.21.15.18:0/593468195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a100ced50 0x7f8a1015a270 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00c410 tx=0x7f89fc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:10.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.859+0000 7f8a0d7fa640 1 -- 172.21.15.18:0/593468195 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89fc017070 con 0x7f8a100ced50 2024-09-19T09:25:10.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.859+0000 7f8a0d7fa640 1 -- 172.21.15.18:0/593468195 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89fc0035f0 con 0x7f8a100ced50 2024-09-19T09:25:10.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.859+0000 7f8a0d7fa640 1 -- 172.21.15.18:0/593468195 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89fc003a20 con 0x7f8a100ced50 2024-09-19T09:25:10.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.859+0000 7f8a1705e640 1 -- 172.21.15.18:0/593468195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a1015cf60 con 0x7f8a100ced50 2024-09-19T09:25:10.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.859+0000 7f8a1705e640 1 -- 172.21.15.18:0/593468195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a1015d520 con 0x7f8a100ced50 2024-09-19T09:25:10.863 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.860+0000 7f8a1705e640 1 -- 172.21.15.18:0/593468195 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8a10144f50 con 0x7f8a100ced50 2024-09-19T09:25:10.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.861+0000 7f8a0d7fa640 1 -- 172.21.15.18:0/593468195 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f89fc01a070 con 0x7f8a100ced50 2024-09-19T09:25:10.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.861+0000 7f8a0d7fa640 1 --2- 172.21.15.18:0/593468195 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f89f406c2b0 0x7f89f406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:10.864 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.861+0000 7f8a0d7fa640 1 -- 172.21.15.18:0/593468195 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 4943+0+0 (secure 0 0 0) 0x7f89fc08a560 con 0x7f8a100ced50 2024-09-19T09:25:10.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.861+0000 7f8a0d7fa640 1 --2- 172.21.15.18:0/593468195 >> [v2:172.21.15.18:6800/3463367841,v1:172.21.15.18:6801/3463367841] conn(0x7f89f4072170 0x7f89f4074590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:10.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.861+0000 7f8a0d7fa640 1 -- 172.21.15.18:0/593468195 --> [v2:172.21.15.18:6800/3463367841,v1:172.21.15.18:6801/3463367841] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f89f4074c40 con 0x7f89f4072170 2024-09-19T09:25:10.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.861+0000 7f8a0d7fa640 1 -- 172.21.15.18:0/593468195 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=188) ==== 24+0+0 (secure 0 0 0) 0x7f89fc091050 con 0x7f8a100ced50 2024-09-19T09:25:10.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.862+0000 7f8a14dfa640 1 --2- 172.21.15.18:0/593468195 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f89f406c2b0 0x7f89f406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:10.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.862+0000 7f8a155fb640 1 --2- 172.21.15.18:0/593468195 >> [v2:172.21.15.18:6800/3463367841,v1:172.21.15.18:6801/3463367841] conn(0x7f89f4072170 0x7f89f4074590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:10.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.862+0000 7f8a155fb640 1 --2- 172.21.15.18:0/593468195 >> [v2:172.21.15.18:6800/3463367841,v1:172.21.15.18:6801/3463367841] conn(0x7f89f4072170 0x7f89f4074590 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:10.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.862+0000 7f8a14dfa640 1 --2- 172.21.15.18:0/593468195 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f89f406c2b0 0x7f89f406e770 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8a04000f60 tx=0x7f8a04007ca0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:10.865 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.863+0000 7f8a0d7fa640 1 -- 172.21.15.18:0/593468195 <== osd.2 v2:172.21.15.18:6800/3463367841 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f89f4074c40 con 0x7f89f4072170 2024-09-19T09:25:10.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.875+0000 7f8a1705e640 1 -- 172.21.15.18:0/593468195 --> [v2:172.21.15.18:6800/3463367841,v1:172.21.15.18:6801/3463367841] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8a1015bc00 con 0x7f89f4072170 2024-09-19T09:25:10.876 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.875+0000 7f8a0d7fa640 1 -- 172.21.15.18:0/593468195 <== osd.2 v2:172.21.15.18:6800/3463367841 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7f8a1015bc00 con 0x7f89f4072170 2024-09-19T09:25:10.876 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:25:10.876 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-19T09:25:10.877 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:25:10.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.875+0000 7f8a1705e640 1 -- 172.21.15.18:0/593468195 >> [v2:172.21.15.18:6800/3463367841,v1:172.21.15.18:6801/3463367841] conn(0x7f89f4072170 msgr2=0x7f89f4074590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:10.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.875+0000 7f8a1705e640 1 --2- 172.21.15.18:0/593468195 >> [v2:172.21.15.18:6800/3463367841,v1:172.21.15.18:6801/3463367841] conn(0x7f89f4072170 0x7f89f4074590 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.875+0000 7f8a1705e640 1 -- 172.21.15.18:0/593468195 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f89f406c2b0 msgr2=0x7f89f406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:10.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.876+0000 7f8a1705e640 1 --2- 172.21.15.18:0/593468195 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f89f406c2b0 0x7f89f406e770 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8a04000f60 tx=0x7f8a04007ca0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.876+0000 7f8a1705e640 1 -- 172.21.15.18:0/593468195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a100ced50 msgr2=0x7f8a1015a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:10.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.876+0000 7f8a1705e640 1 --2- 172.21.15.18:0/593468195 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f8a100ced50 0x7f8a1015a270 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f89fc00c410 tx=0x7f89fc00c8d0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.876+0000 7f8a155fb640 1 -- 172.21.15.18:0/593468195 reap_dead start 2024-09-19T09:25:10.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.876+0000 7f8a1705e640 1 -- 172.21.15.18:0/593468195 shutdown_connections 2024-09-19T09:25:10.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.876+0000 7f8a1705e640 1 -- 172.21.15.18:0/593468195 >> 172.21.15.18:0/593468195 conn(0x7f8a100b26a0 msgr2=0x7f8a10071570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:10.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.876+0000 7f8a1705e640 1 -- 172.21.15.18:0/593468195 shutdown_connections 2024-09-19T09:25:10.878 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.876+0000 7f8a1705e640 1 -- 172.21.15.18:0/593468195 wait complete. 2024-09-19T09:25:10.887 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-19T09:25:10.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.989+0000 7f055150a640 1 Processor -- start 2024-09-19T09:25:10.990 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.989+0000 7f055150a640 1 -- start start 2024-09-19T09:25:10.992 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.989+0000 7f055150a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f054c06bc10 0x7f054c0b6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:10.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.989+0000 7f055150a640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f054c0b4b90 0x7f054c06bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:10.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.989+0000 7f055150a640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f054c06c530 con 0x7f054c162750 2024-09-19T09:25:10.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.989+0000 7f055150a640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f054c1600c0 con 0x7f054c0b4b90 2024-09-19T09:25:10.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.989+0000 7f055150a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f054c0d1920 con 0x7f054c06bc10 2024-09-19T09:25:10.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.990+0000 7f054a7fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f054c0b4b90 0x7f054c06bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:10.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.990+0000 7f054a7fc640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f054c0b4b90 0x7f054c06bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39170/0 (socket says 172.21.15.18:39170) 2024-09-19T09:25:10.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.990+0000 7f054a7fc640 1 -- 172.21.15.18:0/1176037973 learned_addr learned my addr 172.21.15.18:0/1176037973 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:10.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.990+0000 7f054affd640 1 --2- 172.21.15.18:0/1176037973 >> v2:172.21.15.162:3300/0 conn(0x7f054c06bc10 0x7f054c0b6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:10.993 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.990+0000 7f054a7fc640 1 -- 172.21.15.18:0/1176037973 >> v2:172.21.15.162:3300/0 conn(0x7f054c06bc10 msgr2=0x7f054c0b6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:10.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.990+0000 7f054a7fc640 1 --2- 172.21.15.18:0/1176037973 >> v2:172.21.15.162:3300/0 conn(0x7f054c06bc10 0x7f054c0b6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.990+0000 7f054a7fc640 1 -- 172.21.15.18:0/1176037973 >> v1:172.21.15.162:6789/0 conn(0x7f054c162750 legacy=0x7f054c162b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:10.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.990+0000 7f054a7fc640 1 -- 172.21.15.18:0/1176037973 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f054c15f300 con 0x7f054c0b4b90 2024-09-19T09:25:10.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.991+0000 7f054a7fc640 1 --2- 172.21.15.18:0/1176037973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f054c0b4b90 0x7f054c06bff0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f0540009870 tx=0x7f054002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=701bd8f4a8138f6a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:10.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.991+0000 7f0549ffb640 1 -- 172.21.15.18:0/1176037973 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0540037070 con 0x7f054c0b4b90 2024-09-19T09:25:10.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.991+0000 7f0549ffb640 1 -- 172.21.15.18:0/1176037973 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0540032440 con 0x7f054c0b4b90 2024-09-19T09:25:10.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.991+0000 7f0549ffb640 1 -- 172.21.15.18:0/1176037973 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0540032810 con 0x7f054c0b4b90 2024-09-19T09:25:10.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.991+0000 7f055150a640 1 -- 172.21.15.18:0/1176037973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f054c0b4b90 msgr2=0x7f054c06bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:10.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.991+0000 7f055150a640 1 --2- 172.21.15.18:0/1176037973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f054c0b4b90 0x7f054c06bff0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f0540009870 tx=0x7f054002a210 comp rx=0 tx=0).stop 2024-09-19T09:25:10.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.991+0000 7f055150a640 1 -- 172.21.15.18:0/1176037973 shutdown_connections 2024-09-19T09:25:10.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.991+0000 7f055150a640 1 --2- 172.21.15.18:0/1176037973 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f054c0b4b90 0x7f054c06bff0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.991+0000 7f055150a640 1 --2- 172.21.15.18:0/1176037973 >> v2:172.21.15.162:3300/0 conn(0x7f054c06bc10 0x7f054c0b6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.994 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.991+0000 7f055150a640 1 -- 172.21.15.18:0/1176037973 >> 172.21.15.18:0/1176037973 conn(0x7f054c0b3890 msgr2=0x7f054c0b3ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:10.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.992+0000 7f055150a640 1 -- 172.21.15.18:0/1176037973 shutdown_connections 2024-09-19T09:25:10.995 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.992+0000 7f055150a640 1 -- 172.21.15.18:0/1176037973 wait complete. 2024-09-19T09:25:10.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.993+0000 7f055150a640 1 Processor -- start 2024-09-19T09:25:10.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.993+0000 7f055150a640 1 -- start start 2024-09-19T09:25:10.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.994+0000 7f055150a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f054c06bc10 0x7f054c142f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:10.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.994+0000 7f055150a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f054c0b4b90 0x7f054c0c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:10.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.994+0000 7f055150a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f054c162750 0x7f054c146fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:10.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.994+0000 7f055150a640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f054c15fba0 con 0x7f054c0b4b90 2024-09-19T09:25:10.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.994+0000 7f055150a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f054c15f8c0 con 0x7f054c06bc10 2024-09-19T09:25:10.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.994+0000 7f055150a640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f054c0b5000 con 0x7f054c162750 2024-09-19T09:25:10.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.994+0000 7f054a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f054c0b4b90 0x7f054c0c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:10.997 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.994+0000 7f054a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f054c0b4b90 0x7f054c0c6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39184/0 (socket says 172.21.15.18:39184) 2024-09-19T09:25:10.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.994+0000 7f054a7fc640 1 -- 172.21.15.18:0/2031960981 learned_addr learned my addr 172.21.15.18:0/2031960981 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:10.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.994+0000 7f054affd640 1 --2- 172.21.15.18:0/2031960981 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f054c06bc10 0x7f054c142f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:10.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.994+0000 7f054b7fe640 1 --2- 172.21.15.18:0/2031960981 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f054c162750 0x7f054c146fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:10.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.994+0000 7f054a7fc640 1 -- 172.21.15.18:0/2031960981 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f054c162750 msgr2=0x7f054c146fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:10.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.994+0000 7f054a7fc640 1 --2- 172.21.15.18:0/2031960981 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f054c162750 0x7f054c146fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.994+0000 7f054a7fc640 1 -- 172.21.15.18:0/2031960981 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f054c06bc10 msgr2=0x7f054c142f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:10.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.994+0000 7f054a7fc640 1 --2- 172.21.15.18:0/2031960981 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f054c06bc10 0x7f054c142f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:10.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.994+0000 7f054a7fc640 1 -- 172.21.15.18:0/2031960981 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f054c0c7400 con 0x7f054c0b4b90 2024-09-19T09:25:10.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.994+0000 7f054a7fc640 1 --2- 172.21.15.18:0/2031960981 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f054c0b4b90 0x7f054c0c6b00 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f0540000c00 tx=0x7f05400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:10.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.994+0000 7f05337fe640 1 -- 172.21.15.18:0/2031960981 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0540037040 con 0x7f054c0b4b90 2024-09-19T09:25:10.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.994+0000 7f05337fe640 1 -- 172.21.15.18:0/2031960981 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0540042070 con 0x7f054c0b4b90 2024-09-19T09:25:10.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.994+0000 7f055150a640 1 -- 172.21.15.18:0/2031960981 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f054c0c76e0 con 0x7f054c0b4b90 2024-09-19T09:25:10.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.994+0000 7f05337fe640 1 -- 172.21.15.18:0/2031960981 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0540030880 con 0x7f054c0b4b90 2024-09-19T09:25:10.998 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.994+0000 7f055150a640 1 -- 172.21.15.18:0/2031960981 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f054c0c7ca0 con 0x7f054c0b4b90 2024-09-19T09:25:10.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.995+0000 7f055150a640 1 -- 172.21.15.18:0/2031960981 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f054c0b52e0 con 0x7f054c0b4b90 2024-09-19T09:25:10.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.996+0000 7f05337fe640 1 -- 172.21.15.18:0/2031960981 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f0540030a20 con 0x7f054c0b4b90 2024-09-19T09:25:10.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.997+0000 7f05337fe640 1 --2- 172.21.15.18:0/2031960981 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f053806c2b0 0x7f053806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:10.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.997+0000 7f05337fe640 1 -- 172.21.15.18:0/2031960981 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 4943+0+0 (secure 0 0 0) 0x7f05400ab890 con 0x7f054c0b4b90 2024-09-19T09:25:10.999 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.997+0000 7f054affd640 1 --2- 172.21.15.18:0/2031960981 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f053806c2b0 0x7f053806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.000 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:10.997+0000 7f054affd640 1 --2- 172.21.15.18:0/2031960981 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f053806c2b0 0x7f053806e770 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f054c0b57d0 tx=0x7f053c009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:11.002 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.001+0000 7f05337fe640 1 -- 172.21.15.18:0/2031960981 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f054007a390 con 0x7f054c0b4b90 2024-09-19T09:25:11.177 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.177+0000 7f055150a640 1 -- 172.21.15.18:0/2031960981 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f054c0c9880 con 0x7f053806c2b0 2024-09-19T09:25:11.178 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.177+0000 7f05337fe640 1 -- 172.21.15.18:0/2031960981 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f053c011a30 con 0x7f053806c2b0 2024-09-19T09:25:11.178 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 2 to deep-scrub 2024-09-19T09:25:11.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.179+0000 7f055150a640 1 -- 172.21.15.18:0/2031960981 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f053806c2b0 msgr2=0x7f053806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.179+0000 7f055150a640 1 --2- 172.21.15.18:0/2031960981 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f053806c2b0 0x7f053806e770 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f054c0b57d0 tx=0x7f053c009190 comp rx=0 tx=0).stop 2024-09-19T09:25:11.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.179+0000 7f055150a640 1 -- 172.21.15.18:0/2031960981 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f054c0b4b90 msgr2=0x7f054c0c6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.179+0000 7f055150a640 1 --2- 172.21.15.18:0/2031960981 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f054c0b4b90 0x7f054c0c6b00 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f0540000c00 tx=0x7f05400046c0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.179+0000 7f055150a640 1 -- 172.21.15.18:0/2031960981 shutdown_connections 2024-09-19T09:25:11.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.179+0000 7f055150a640 1 --2- 172.21.15.18:0/2031960981 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f053806c2b0 0x7f053806e770 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.179+0000 7f055150a640 1 --2- 172.21.15.18:0/2031960981 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f054c162750 0x7f054c146fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.180 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.179+0000 7f055150a640 1 --2- 172.21.15.18:0/2031960981 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f054c0b4b90 0x7f054c0c6b00 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.179+0000 7f055150a640 1 --2- 172.21.15.18:0/2031960981 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f054c06bc10 0x7f054c142f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.179+0000 7f055150a640 1 -- 172.21.15.18:0/2031960981 >> 172.21.15.18:0/2031960981 conn(0x7f054c0b3890 msgr2=0x7f054c1602a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:11.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.179+0000 7f055150a640 1 -- 172.21.15.18:0/2031960981 shutdown_connections 2024-09-19T09:25:11.181 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.179+0000 7f055150a640 1 -- 172.21.15.18:0/2031960981 wait complete. 2024-09-19T09:25:11.190 INFO:tasks.ceph:Scrubbing osd.3 2024-09-19T09:25:11.191 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-19T09:25:11.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.296+0000 7fc93f6f1640 1 Processor -- start 2024-09-19T09:25:11.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.296+0000 7fc93f6f1640 1 -- start start 2024-09-19T09:25:11.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.297+0000 7fc93f6f1640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc93806c320 0x7fc9380d2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.297+0000 7fc93f6f1640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc938070fc0 con 0x7fc93815ecf0 2024-09-19T09:25:11.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.297+0000 7fc93f6f1640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc93806f370 con 0x7fc93806ef50 2024-09-19T09:25:11.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.297+0000 7fc93f6f1640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7fc93815f0d0 con 0x7fc93806c320 2024-09-19T09:25:11.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.297+0000 7fc93dc8e640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7fc93806c320 0x7fc9380d2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.304 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.297+0000 7fc93d48d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fc93815ecf0 0x7fc9380b66a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49702/0 (socket says 172.21.15.18:49702) 2024-09-19T09:25:11.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.297+0000 7fc93d48d640 1 -- 172.21.15.18:0/21221031 learned_addr learned my addr 172.21.15.18:0/21221031 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:25:11.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.298+0000 7fc93dc8e640 1 -- 172.21.15.18:0/21221031 >> v1:172.21.15.162:6789/0 conn(0x7fc93806ef50 legacy=0x7fc93806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:11.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.298+0000 7fc93dc8e640 1 -- 172.21.15.18:0/21221031 >> v1:172.21.15.18:6789/0 conn(0x7fc93815ecf0 legacy=0x7fc9380b66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.298+0000 7fc93dc8e640 1 -- 172.21.15.18:0/21221031 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc938070ce0 con 0x7fc93806c320 2024-09-19T09:25:11.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.298+0000 7fc93dc8e640 1 --2- 172.21.15.18:0/21221031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc93806c320 0x7fc9380d2410 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fc934009d90 tx=0x7fc93402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b75e477e3fd92f59 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:11.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.299+0000 7fc92ffff640 1 -- 172.21.15.18:0/21221031 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc934007740 con 0x7fc93806c320 2024-09-19T09:25:11.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.299+0000 7fc92ffff640 1 -- 172.21.15.18:0/21221031 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9340078e0 con 0x7fc93806c320 2024-09-19T09:25:11.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.299+0000 7fc92ffff640 1 -- 172.21.15.18:0/21221031 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc934007cb0 con 0x7fc93806c320 2024-09-19T09:25:11.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.299+0000 7fc93f6f1640 1 -- 172.21.15.18:0/21221031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc93806c320 msgr2=0x7fc9380d2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.299+0000 7fc93f6f1640 1 --2- 172.21.15.18:0/21221031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc93806c320 0x7fc9380d2410 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fc934009d90 tx=0x7fc93402a6a0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.299+0000 7fc93f6f1640 1 -- 172.21.15.18:0/21221031 shutdown_connections 2024-09-19T09:25:11.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.299+0000 7fc93f6f1640 1 --2- 172.21.15.18:0/21221031 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc93806c320 0x7fc9380d2410 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.305 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.299+0000 7fc93f6f1640 1 -- 172.21.15.18:0/21221031 >> 172.21.15.18:0/21221031 conn(0x7fc9380d1920 msgr2=0x7fc9380d1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:11.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.299+0000 7fc93f6f1640 1 -- 172.21.15.18:0/21221031 shutdown_connections 2024-09-19T09:25:11.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.299+0000 7fc93f6f1640 1 -- 172.21.15.18:0/21221031 wait complete. 2024-09-19T09:25:11.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.300+0000 7fc93f6f1640 1 Processor -- start 2024-09-19T09:25:11.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.300+0000 7fc93f6f1640 1 -- start start 2024-09-19T09:25:11.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.301+0000 7fc93f6f1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc93806c320 0x7fc93814f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.301+0000 7fc93f6f1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc93806ef50 0x7fc938158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.301+0000 7fc93f6f1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc93815ecf0 0x7fc9381592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.301+0000 7fc93f6f1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fc938070940 con 0x7fc93815ecf0 2024-09-19T09:25:11.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.301+0000 7fc93f6f1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc93806e9c0 con 0x7fc93806c320 2024-09-19T09:25:11.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.301+0000 7fc93f6f1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fc938070ac0 con 0x7fc93806ef50 2024-09-19T09:25:11.306 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.301+0000 7fc93dc8e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc93815ecf0 0x7fc9381592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.301+0000 7fc93dc8e640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc93815ecf0 0x7fc9381592a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39192/0 (socket says 172.21.15.18:39192) 2024-09-19T09:25:11.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.301+0000 7fc93dc8e640 1 -- 172.21.15.18:0/307512366 learned_addr learned my addr 172.21.15.18:0/307512366 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:11.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.301+0000 7fc93cc8c640 1 --2- 172.21.15.18:0/307512366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc93806ef50 0x7fc938158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.301+0000 7fc93dc8e640 1 -- 172.21.15.18:0/307512366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc93806ef50 msgr2=0x7fc938158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.302+0000 7fc93dc8e640 1 --2- 172.21.15.18:0/307512366 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fc93806ef50 0x7fc938158d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.302+0000 7fc93d48d640 1 --2- 172.21.15.18:0/307512366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc93806c320 0x7fc93814f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.302+0000 7fc93dc8e640 1 -- 172.21.15.18:0/307512366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc93806c320 msgr2=0x7fc93814f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.302+0000 7fc93dc8e640 1 --2- 172.21.15.18:0/307512366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc93806c320 0x7fc93814f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.302+0000 7fc93dc8e640 1 -- 172.21.15.18:0/307512366 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9381615f0 con 0x7fc93815ecf0 2024-09-19T09:25:11.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.302+0000 7fc93d48d640 1 --2- 172.21.15.18:0/307512366 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc93806c320 0x7fc93814f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:25:11.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.302+0000 7fc93dc8e640 1 --2- 172.21.15.18:0/307512366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc93815ecf0 0x7fc9381592a0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fc934009eb0 tx=0x7fc934004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:11.307 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.302+0000 7fc92dffb640 1 -- 172.21.15.18:0/307512366 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc934040070 con 0x7fc93815ecf0 2024-09-19T09:25:11.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.302+0000 7fc92dffb640 1 -- 172.21.15.18:0/307512366 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc934031c90 con 0x7fc93815ecf0 2024-09-19T09:25:11.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.302+0000 7fc92dffb640 1 -- 172.21.15.18:0/307512366 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93403c640 con 0x7fc93815ecf0 2024-09-19T09:25:11.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.302+0000 7fc93f6f1640 1 -- 172.21.15.18:0/307512366 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9381618d0 con 0x7fc93815ecf0 2024-09-19T09:25:11.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.302+0000 7fc93f6f1640 1 -- 172.21.15.18:0/307512366 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc938161e90 con 0x7fc93815ecf0 2024-09-19T09:25:11.308 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.303+0000 7fc93f6f1640 1 -- 172.21.15.18:0/307512366 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc9380d2410 con 0x7fc93815ecf0 2024-09-19T09:25:11.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.304+0000 7fc92dffb640 1 -- 172.21.15.18:0/307512366 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fc934039040 con 0x7fc93815ecf0 2024-09-19T09:25:11.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.304+0000 7fc92dffb640 1 --2- 172.21.15.18:0/307512366 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc91c06c2e0 0x7fc91c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.304+0000 7fc92dffb640 1 -- 172.21.15.18:0/307512366 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 4943+0+0 (secure 0 0 0) 0x7fc9340ac6f0 con 0x7fc93815ecf0 2024-09-19T09:25:11.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.304+0000 7fc92dffb640 1 --2- 172.21.15.18:0/307512366 >> [v2:172.21.15.18:6824/4163178582,v1:172.21.15.18:6825/4163178582] conn(0x7fc91c0721a0 0x7fc91c0745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.304+0000 7fc92dffb640 1 -- 172.21.15.18:0/307512366 --> [v2:172.21.15.18:6824/4163178582,v1:172.21.15.18:6825/4163178582] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc9340091a0 con 0x7fc91c0721a0 2024-09-19T09:25:11.309 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.304+0000 7fc92dffb640 1 -- 172.21.15.18:0/307512366 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=188) ==== 24+0+0 (secure 0 0 0) 0x7fc9340b3050 con 0x7fc93815ecf0 2024-09-19T09:25:11.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.304+0000 7fc93d48d640 1 --2- 172.21.15.18:0/307512366 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc91c06c2e0 0x7fc91c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.305+0000 7fc93cc8c640 1 --2- 172.21.15.18:0/307512366 >> [v2:172.21.15.18:6824/4163178582,v1:172.21.15.18:6825/4163178582] conn(0x7fc91c0721a0 0x7fc91c0745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.305+0000 7fc93cc8c640 1 --2- 172.21.15.18:0/307512366 >> [v2:172.21.15.18:6824/4163178582,v1:172.21.15.18:6825/4163178582] conn(0x7fc91c0721a0 0x7fc91c0745c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:11.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.305+0000 7fc93d48d640 1 --2- 172.21.15.18:0/307512366 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc91c06c2e0 0x7fc91c06e7a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fc93815af50 tx=0x7fc930009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:11.310 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.305+0000 7fc92dffb640 1 -- 172.21.15.18:0/307512366 <== osd.3 v2:172.21.15.18:6824/4163178582 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7fc9340091a0 con 0x7fc91c0721a0 2024-09-19T09:25:11.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.317+0000 7fc93f6f1640 1 -- 172.21.15.18:0/307512366 --> [v2:172.21.15.18:6824/4163178582,v1:172.21.15.18:6825/4163178582] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc938073700 con 0x7fc91c0721a0 2024-09-19T09:25:11.318 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.317+0000 7fc92dffb640 1 -- 172.21.15.18:0/307512366 <== osd.3 v2:172.21.15.18:6824/4163178582 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7fc938073700 con 0x7fc91c0721a0 2024-09-19T09:25:11.318 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:25:11.319 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-19T09:25:11.319 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:25:11.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.317+0000 7fc93f6f1640 1 -- 172.21.15.18:0/307512366 >> [v2:172.21.15.18:6824/4163178582,v1:172.21.15.18:6825/4163178582] conn(0x7fc91c0721a0 msgr2=0x7fc91c0745c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.317+0000 7fc93f6f1640 1 --2- 172.21.15.18:0/307512366 >> [v2:172.21.15.18:6824/4163178582,v1:172.21.15.18:6825/4163178582] conn(0x7fc91c0721a0 0x7fc91c0745c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.318+0000 7fc93f6f1640 1 -- 172.21.15.18:0/307512366 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc91c06c2e0 msgr2=0x7fc91c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.318+0000 7fc93f6f1640 1 --2- 172.21.15.18:0/307512366 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fc91c06c2e0 0x7fc91c06e7a0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fc93815af50 tx=0x7fc930009040 comp rx=0 tx=0).stop 2024-09-19T09:25:11.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.318+0000 7fc93f6f1640 1 -- 172.21.15.18:0/307512366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc93815ecf0 msgr2=0x7fc9381592a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.318+0000 7fc93f6f1640 1 --2- 172.21.15.18:0/307512366 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fc93815ecf0 0x7fc9381592a0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7fc934009eb0 tx=0x7fc934004a40 comp rx=0 tx=0).stop 2024-09-19T09:25:11.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.318+0000 7fc93dc8e640 1 -- 172.21.15.18:0/307512366 reap_dead start 2024-09-19T09:25:11.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.318+0000 7fc93f6f1640 1 -- 172.21.15.18:0/307512366 shutdown_connections 2024-09-19T09:25:11.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.318+0000 7fc93f6f1640 1 -- 172.21.15.18:0/307512366 >> 172.21.15.18:0/307512366 conn(0x7fc9380d1920 msgr2=0x7fc93815c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:11.320 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.318+0000 7fc93f6f1640 1 -- 172.21.15.18:0/307512366 shutdown_connections 2024-09-19T09:25:11.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.318+0000 7fc93f6f1640 1 -- 172.21.15.18:0/307512366 wait complete. 2024-09-19T09:25:11.329 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-19T09:25:11.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.431+0000 7fcdcd5a1640 1 Processor -- start 2024-09-19T09:25:11.433 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.432+0000 7fcdcd5a1640 1 -- start start 2024-09-19T09:25:11.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.432+0000 7fcdcd5a1640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcdc815eda0 0x7fcdc80d5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.432+0000 7fcdcd5a1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdc80d0480 0x7fcdc80d35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.432+0000 7fcdcd5a1640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdc80d0bf0 con 0x7fcdc80d3af0 2024-09-19T09:25:11.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.432+0000 7fcdcd5a1640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fcdc80d2880 con 0x7fcdc815eda0 2024-09-19T09:25:11.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.432+0000 7fcdcd5a1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcdc80d3120 con 0x7fcdc80d0480 2024-09-19T09:25:11.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.432+0000 7fcdc77fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fcdc80d3af0 0x7fcdc80d1630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49714/0 (socket says 172.21.15.18:49714) 2024-09-19T09:25:11.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.432+0000 7fcdc77fe640 1 -- 172.21.15.18:0/4101965585 learned_addr learned my addr 172.21.15.18:0/4101965585 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:25:11.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.433+0000 7fcdc5ffb640 1 -- 172.21.15.18:0/4101965585 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1855769532 0 0) 0x7fcdc80d0bf0 con 0x7fcdc80d3af0 2024-09-19T09:25:11.436 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.433+0000 7fcdc6ffd640 1 --2- 172.21.15.18:0/4101965585 >> v2:172.21.15.162:3300/0 conn(0x7fcdc815eda0 0x7fcdc80d5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.433+0000 7fcdc67fc640 1 --2- 172.21.15.18:0/4101965585 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdc80d0480 0x7fcdc80d35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.433+0000 7fcdc5ffb640 1 -- 172.21.15.18:0/4101965585 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdb0003520 con 0x7fcdc80d3af0 2024-09-19T09:25:11.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.433+0000 7fcdc5ffb640 1 -- 172.21.15.18:0/4101965585 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2974986522 0 0) 0x7fcdb0003520 con 0x7fcdc80d3af0 2024-09-19T09:25:11.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.433+0000 7fcdc5ffb640 1 -- 172.21.15.18:0/4101965585 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdc80d0480 msgr2=0x7fcdc80d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:11.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.433+0000 7fcdc5ffb640 1 --2- 172.21.15.18:0/4101965585 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdc80d0480 0x7fcdc80d35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.433+0000 7fcdc5ffb640 1 -- 172.21.15.18:0/4101965585 >> v2:172.21.15.162:3300/0 conn(0x7fcdc815eda0 msgr2=0x7fcdc80d5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:11.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.433+0000 7fcdc5ffb640 1 --2- 172.21.15.18:0/4101965585 >> v2:172.21.15.162:3300/0 conn(0x7fcdc815eda0 0x7fcdc80d5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.433+0000 7fcdc5ffb640 1 -- 172.21.15.18:0/4101965585 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdc80d2ad0 con 0x7fcdc80d3af0 2024-09-19T09:25:11.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.433+0000 7fcdc5ffb640 1 -- 172.21.15.18:0/4101965585 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fcdc00019f0 con 0x7fcdc80d3af0 2024-09-19T09:25:11.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.433+0000 7fcdc5ffb640 1 -- 172.21.15.18:0/4101965585 >> v1:172.21.15.18:6789/0 conn(0x7fcdc80d3af0 legacy=0x7fcdc80d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.433+0000 7fcdc5ffb640 1 --2- 172.21.15.18:0/4101965585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdb00039b0 0x7fcdb0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.433+0000 7fcdc5ffb640 1 --2- 172.21.15.18:0/4101965585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdb0004800 0x7fcdb0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.433+0000 7fcdc5ffb640 1 --2- 172.21.15.18:0/4101965585 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdc80d0480 0x7fcdb00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.437 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.433+0000 7fcdc5ffb640 1 -- 172.21.15.18:0/4101965585 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc80d2880 con 0x7fcdb0004800 2024-09-19T09:25:11.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.433+0000 7fcdc5ffb640 1 -- 172.21.15.18:0/4101965585 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc80d3120 con 0x7fcdb00039b0 2024-09-19T09:25:11.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.433+0000 7fcdc5ffb640 1 -- 172.21.15.18:0/4101965585 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcdb000b9c0 con 0x7fcdc80d0480 2024-09-19T09:25:11.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.433+0000 7fcdc67fc640 1 --2- 172.21.15.18:0/4101965585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdb0004800 0x7fcdb0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.433+0000 7fcdc6ffd640 1 --2- 172.21.15.18:0/4101965585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdb00039b0 0x7fcdb0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.433+0000 7fcdc77fe640 1 --2- 172.21.15.18:0/4101965585 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdc80d0480 0x7fcdb00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.434+0000 7fcdc67fc640 1 -- 172.21.15.18:0/4101965585 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdc80d0480 msgr2=0x7fcdb00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:11.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.434+0000 7fcdc67fc640 1 --2- 172.21.15.18:0/4101965585 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdc80d0480 0x7fcdb00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.434+0000 7fcdc67fc640 1 -- 172.21.15.18:0/4101965585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdb00039b0 msgr2=0x7fcdb0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:11.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.434+0000 7fcdc67fc640 1 --2- 172.21.15.18:0/4101965585 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdb00039b0 0x7fcdb0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.434+0000 7fcdc67fc640 1 -- 172.21.15.18:0/4101965585 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdb0003520 con 0x7fcdb0004800 2024-09-19T09:25:11.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.434+0000 7fcdc67fc640 1 --2- 172.21.15.18:0/4101965585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdb0004800 0x7fcdb0004c80 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc009a90 tx=0x7fcdb0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbc8d67d0dd2c4f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:11.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.434+0000 7fcdc5ffb640 1 -- 172.21.15.18:0/4101965585 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc036070 con 0x7fcdb0004800 2024-09-19T09:25:11.438 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.434+0000 7fcdc5ffb640 1 -- 172.21.15.18:0/4101965585 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdbc031400 con 0x7fcdb0004800 2024-09-19T09:25:11.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.434+0000 7fcdc5ffb640 1 -- 172.21.15.18:0/4101965585 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc009690 con 0x7fcdb0004800 2024-09-19T09:25:11.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.435+0000 7fcdcd5a1640 1 -- 172.21.15.18:0/4101965585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdb0004800 msgr2=0x7fcdb0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.435+0000 7fcdcd5a1640 1 --2- 172.21.15.18:0/4101965585 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdb0004800 0x7fcdb0004c80 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc009a90 tx=0x7fcdb0005830 comp rx=0 tx=0).stop 2024-09-19T09:25:11.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.435+0000 7fcdc77fe640 1 -- 172.21.15.18:0/4101965585 reap_dead start 2024-09-19T09:25:11.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.435+0000 7fcdcd5a1640 1 -- 172.21.15.18:0/4101965585 shutdown_connections 2024-09-19T09:25:11.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.435+0000 7fcdcd5a1640 1 -- 172.21.15.18:0/4101965585 >> 172.21.15.18:0/4101965585 conn(0x7fcdc809df40 msgr2=0x7fcdc80d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:11.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.435+0000 7fcdcd5a1640 1 -- 172.21.15.18:0/4101965585 shutdown_connections 2024-09-19T09:25:11.439 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.435+0000 7fcdcd5a1640 1 -- 172.21.15.18:0/4101965585 wait complete. 2024-09-19T09:25:11.441 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.436+0000 7fcdcd5a1640 1 Processor -- start 2024-09-19T09:25:11.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.436+0000 7fcdcd5a1640 1 -- start start 2024-09-19T09:25:11.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.437+0000 7fcdcd5a1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdb0004800 0x7fcdc80ceaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.437+0000 7fcdcd5a1640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdc814c020 0x7fcdc80a0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.437+0000 7fcdcd5a1640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdc814c4a0 0x7fcdc80c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.437+0000 7fcdcd5a1640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc815f180 con 0x7fcdc814c020 2024-09-19T09:25:11.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.437+0000 7fcdcd5a1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc80d08c0 con 0x7fcdb0004800 2024-09-19T09:25:11.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.437+0000 7fcdcd5a1640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fcdc815f300 con 0x7fcdc814c4a0 2024-09-19T09:25:11.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.437+0000 7fcdc67fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdc814c020 0x7fcdc80a0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.437+0000 7fcdc67fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdc814c020 0x7fcdc80a0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39212/0 (socket says 172.21.15.18:39212) 2024-09-19T09:25:11.442 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.437+0000 7fcdc67fc640 1 -- 172.21.15.18:0/1760513531 learned_addr learned my addr 172.21.15.18:0/1760513531 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:11.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.438+0000 7fcdc77fe640 1 --2- 172.21.15.18:0/1760513531 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdc814c4a0 0x7fcdc80c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.438+0000 7fcdc67fc640 1 -- 172.21.15.18:0/1760513531 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdc814c4a0 msgr2=0x7fcdc80c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.438+0000 7fcdc67fc640 1 --2- 172.21.15.18:0/1760513531 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdc814c4a0 0x7fcdc80c7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.438+0000 7fcdc67fc640 1 -- 172.21.15.18:0/1760513531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdb0004800 msgr2=0x7fcdc80ceaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.438+0000 7fcdc6ffd640 1 --2- 172.21.15.18:0/1760513531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdb0004800 0x7fcdc80ceaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.438+0000 7fcdc67fc640 1 --2- 172.21.15.18:0/1760513531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdb0004800 0x7fcdc80ceaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.438+0000 7fcdc67fc640 1 -- 172.21.15.18:0/1760513531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdc814a0e0 con 0x7fcdc814c020 2024-09-19T09:25:11.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.438+0000 7fcdc67fc640 1 --2- 172.21.15.18:0/1760513531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdc814c020 0x7fcdc80a0200 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc034040 tx=0x7fcdbc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:11.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.438+0000 7fcdaf7fe640 1 -- 172.21.15.18:0/1760513531 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc040070 con 0x7fcdc814c020 2024-09-19T09:25:11.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.438+0000 7fcdaf7fe640 1 -- 172.21.15.18:0/1760513531 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdbc03b460 con 0x7fcdc814c020 2024-09-19T09:25:11.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.438+0000 7fcdaf7fe640 1 -- 172.21.15.18:0/1760513531 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc036040 con 0x7fcdc814c020 2024-09-19T09:25:11.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.438+0000 7fcdcd5a1640 1 -- 172.21.15.18:0/1760513531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdc814a3c0 con 0x7fcdc814c020 2024-09-19T09:25:11.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.438+0000 7fcdcd5a1640 1 -- 172.21.15.18:0/1760513531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdc814a980 con 0x7fcdc814c020 2024-09-19T09:25:11.443 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.439+0000 7fcdcd5a1640 1 -- 172.21.15.18:0/1760513531 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdc80d5790 con 0x7fcdc814c020 2024-09-19T09:25:11.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.440+0000 7fcdaf7fe640 1 -- 172.21.15.18:0/1760513531 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fcdbc043070 con 0x7fcdc814c020 2024-09-19T09:25:11.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.440+0000 7fcdaf7fe640 1 --2- 172.21.15.18:0/1760513531 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcdb406c2b0 0x7fcdb406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.440+0000 7fcdaf7fe640 1 -- 172.21.15.18:0/1760513531 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 4943+0+0 (secure 0 0 0) 0x7fcdbc0ab780 con 0x7fcdc814c020 2024-09-19T09:25:11.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.440+0000 7fcdc6ffd640 1 --2- 172.21.15.18:0/1760513531 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcdb406c2b0 0x7fcdb406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.444 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.441+0000 7fcdc6ffd640 1 --2- 172.21.15.18:0/1760513531 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcdb406c2b0 0x7fcdb406e770 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80cb8f0 tx=0x7fcdb8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:11.445 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.444+0000 7fcdaf7fe640 1 -- 172.21.15.18:0/1760513531 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7fcdbc079c30 con 0x7fcdc814c020 2024-09-19T09:25:11.620 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.619+0000 7fcdcd5a1640 1 -- 172.21.15.18:0/1760513531 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fcdc80d2330 con 0x7fcdb406c2b0 2024-09-19T09:25:11.621 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.620+0000 7fcdaf7fe640 1 -- 172.21.15.18:0/1760513531 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcdc80d2330 con 0x7fcdb406c2b0 2024-09-19T09:25:11.621 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 3 to deep-scrub 2024-09-19T09:25:11.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.622+0000 7fcdcd5a1640 1 -- 172.21.15.18:0/1760513531 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcdb406c2b0 msgr2=0x7fcdb406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.622+0000 7fcdcd5a1640 1 --2- 172.21.15.18:0/1760513531 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcdb406c2b0 0x7fcdb406e770 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fcdc80cb8f0 tx=0x7fcdb8008040 comp rx=0 tx=0).stop 2024-09-19T09:25:11.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.622+0000 7fcdcd5a1640 1 -- 172.21.15.18:0/1760513531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdc814c020 msgr2=0x7fcdc80a0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.622+0000 7fcdcd5a1640 1 --2- 172.21.15.18:0/1760513531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdc814c020 0x7fcdc80a0200 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc034040 tx=0x7fcdbc004730 comp rx=0 tx=0).stop 2024-09-19T09:25:11.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.622+0000 7fcdcd5a1640 1 -- 172.21.15.18:0/1760513531 shutdown_connections 2024-09-19T09:25:11.623 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.622+0000 7fcdcd5a1640 1 --2- 172.21.15.18:0/1760513531 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fcdb406c2b0 0x7fcdb406e770 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.622+0000 7fcdcd5a1640 1 --2- 172.21.15.18:0/1760513531 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fcdc814c4a0 0x7fcdc80c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.622+0000 7fcdcd5a1640 1 --2- 172.21.15.18:0/1760513531 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fcdc814c020 0x7fcdc80a0200 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.622+0000 7fcdcd5a1640 1 --2- 172.21.15.18:0/1760513531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcdb0004800 0x7fcdc80ceaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.622+0000 7fcdcd5a1640 1 -- 172.21.15.18:0/1760513531 >> 172.21.15.18:0/1760513531 conn(0x7fcdc809df40 msgr2=0x7fcdc80b91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:11.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.622+0000 7fcdcd5a1640 1 -- 172.21.15.18:0/1760513531 shutdown_connections 2024-09-19T09:25:11.624 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.622+0000 7fcdcd5a1640 1 -- 172.21.15.18:0/1760513531 wait complete. 2024-09-19T09:25:11.634 INFO:tasks.ceph:Scrubbing osd.4 2024-09-19T09:25:11.634 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-19T09:25:11.740 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.739+0000 7f38bac47640 1 Processor -- start 2024-09-19T09:25:11.741 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.739+0000 7f38bac47640 1 -- start start 2024-09-19T09:25:11.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.740+0000 7f38bac47640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f38b415edc0 0x7f38b40b1890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.740+0000 7f38bac47640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38b40b3c90 0x7f38b40d2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.740+0000 7f38bac47640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38b40d0310 con 0x7f38b40d3080 2024-09-19T09:25:11.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.740+0000 7f38bac47640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f38b40d05d0 con 0x7f38b415edc0 2024-09-19T09:25:11.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.740+0000 7f38bac47640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f38b40d08b0 con 0x7f38b40b3c90 2024-09-19T09:25:11.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.741+0000 7f38b89e3640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f38b415edc0 0x7f38b40b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.741+0000 7f38b3fff640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38b40b3c90 0x7f38b40d2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.742 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.741+0000 7f38b89e3640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f38b415edc0 0x7f38b40b1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.18:44206/0 (socket says 172.21.15.18:44206) 2024-09-19T09:25:11.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.741+0000 7f38b91e4640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f38b40d3080 0x7f38b40d1810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:40242/0 (socket says 172.21.15.18:40242) 2024-09-19T09:25:11.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.741+0000 7f38b89e3640 1 -- 172.21.15.18:0/4291241143 learned_addr learned my addr 172.21.15.18:0/4291241143 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:11.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.741+0000 7f38b89e3640 1 -- 172.21.15.18:0/4291241143 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38b40b3c90 msgr2=0x7f38b40d2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:11.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.741+0000 7f38b89e3640 1 --2- 172.21.15.18:0/4291241143 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38b40b3c90 0x7f38b40d2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.741+0000 7f38b89e3640 1 -- 172.21.15.18:0/4291241143 >> v1:172.21.15.162:6789/0 conn(0x7f38b40d3080 legacy=0x7f38b40d1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.743 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.741+0000 7f38b89e3640 1 -- 172.21.15.18:0/4291241143 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b40d0b90 con 0x7f38b415edc0 2024-09-19T09:25:11.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.742+0000 7f38b89e3640 1 --2- 172.21.15.18:0/4291241143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38b415edc0 0x7f38b40b1890 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f38a4009870 tx=0x7f38a402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37ce44c2aed065e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:11.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.742+0000 7f38b37fe640 1 -- 172.21.15.18:0/4291241143 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a4037070 con 0x7f38b415edc0 2024-09-19T09:25:11.744 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.742+0000 7f38b37fe640 1 -- 172.21.15.18:0/4291241143 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a4032440 con 0x7f38b415edc0 2024-09-19T09:25:11.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.742+0000 7f38b37fe640 1 -- 172.21.15.18:0/4291241143 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a4032810 con 0x7f38b415edc0 2024-09-19T09:25:11.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.742+0000 7f38bac47640 1 -- 172.21.15.18:0/4291241143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38b415edc0 msgr2=0x7f38b40b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.742+0000 7f38bac47640 1 --2- 172.21.15.18:0/4291241143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38b415edc0 0x7f38b40b1890 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f38a4009870 tx=0x7f38a402a270 comp rx=0 tx=0).stop 2024-09-19T09:25:11.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.742+0000 7f38bac47640 1 -- 172.21.15.18:0/4291241143 shutdown_connections 2024-09-19T09:25:11.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.743+0000 7f38bac47640 1 --2- 172.21.15.18:0/4291241143 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38b40b3c90 0x7f38b40d2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.743+0000 7f38bac47640 1 --2- 172.21.15.18:0/4291241143 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38b415edc0 0x7f38b40b1890 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.743+0000 7f38bac47640 1 -- 172.21.15.18:0/4291241143 >> 172.21.15.18:0/4291241143 conn(0x7f38b40d4c60 msgr2=0x7f38b40d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:11.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.743+0000 7f38bac47640 1 -- 172.21.15.18:0/4291241143 shutdown_connections 2024-09-19T09:25:11.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.743+0000 7f38bac47640 1 -- 172.21.15.18:0/4291241143 wait complete. 2024-09-19T09:25:11.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.744+0000 7f38bac47640 1 Processor -- start 2024-09-19T09:25:11.745 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.744+0000 7f38bac47640 1 -- start start 2024-09-19T09:25:11.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.745+0000 7f38bac47640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38b40b3c90 0x7f38b41501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.747 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.745+0000 7f38bac47640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38b40d3080 0x7f38b41607a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.745+0000 7f38bac47640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38b415edc0 0x7f38b40c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.745+0000 7f38bac47640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f38b40d34f0 con 0x7f38b40b3c90 2024-09-19T09:25:11.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.745+0000 7f38bac47640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f38b40d2d70 con 0x7f38b40d3080 2024-09-19T09:25:11.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.745+0000 7f38bac47640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f38b40d3670 con 0x7f38b415edc0 2024-09-19T09:25:11.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.745+0000 7f38b89e3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38b40b3c90 0x7f38b41501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.745+0000 7f38b89e3640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38b40b3c90 0x7f38b41501b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39220/0 (socket says 172.21.15.18:39220) 2024-09-19T09:25:11.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.745+0000 7f38b89e3640 1 -- 172.21.15.18:0/871521437 learned_addr learned my addr 172.21.15.18:0/871521437 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:11.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.745+0000 7f38b91e4640 1 --2- 172.21.15.18:0/871521437 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38b415edc0 0x7f38b40c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.745+0000 7f38b3fff640 1 --2- 172.21.15.18:0/871521437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38b40d3080 0x7f38b41607a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.745+0000 7f38b89e3640 1 -- 172.21.15.18:0/871521437 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38b415edc0 msgr2=0x7f38b40c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.745+0000 7f38b89e3640 1 --2- 172.21.15.18:0/871521437 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f38b415edc0 0x7f38b40c8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.748 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.745+0000 7f38b89e3640 1 -- 172.21.15.18:0/871521437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38b40d3080 msgr2=0x7f38b41607a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.745+0000 7f38b89e3640 1 --2- 172.21.15.18:0/871521437 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38b40d3080 0x7f38b41607a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.745+0000 7f38b89e3640 1 -- 172.21.15.18:0/871521437 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38b415f610 con 0x7f38b40b3c90 2024-09-19T09:25:11.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.745+0000 7f38b89e3640 1 --2- 172.21.15.18:0/871521437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38b40b3c90 0x7f38b41501b0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f38a4000c00 tx=0x7f38a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:11.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.745+0000 7f38b17fa640 1 -- 172.21.15.18:0/871521437 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a4037040 con 0x7f38b40b3c90 2024-09-19T09:25:11.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.745+0000 7f38b17fa640 1 -- 172.21.15.18:0/871521437 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a4042070 con 0x7f38b40b3c90 2024-09-19T09:25:11.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.745+0000 7f38bac47640 1 -- 172.21.15.18:0/871521437 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38b40b59c0 con 0x7f38b40b3c90 2024-09-19T09:25:11.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.746+0000 7f38b17fa640 1 -- 172.21.15.18:0/871521437 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a4030880 con 0x7f38b40b3c90 2024-09-19T09:25:11.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.746+0000 7f38bac47640 1 -- 172.21.15.18:0/871521437 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38b40b5f80 con 0x7f38b40b3c90 2024-09-19T09:25:11.749 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.746+0000 7f38bac47640 1 -- 172.21.15.18:0/871521437 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f38b4162520 con 0x7f38b40b3c90 2024-09-19T09:25:11.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.747+0000 7f38b17fa640 1 -- 172.21.15.18:0/871521437 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f38a4030a20 con 0x7f38b40b3c90 2024-09-19T09:25:11.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.748+0000 7f38b17fa640 1 --2- 172.21.15.18:0/871521437 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f38a006c2b0 0x7f38a006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.750 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.748+0000 7f38b17fa640 1 -- 172.21.15.18:0/871521437 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 4943+0+0 (secure 0 0 0) 0x7f38a40ab7c0 con 0x7f38b40b3c90 2024-09-19T09:25:11.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.748+0000 7f38b17fa640 1 --2- 172.21.15.18:0/871521437 >> [v2:172.21.15.162:6822/3538482215,v1:172.21.15.162:6824/3538482215] conn(0x7f38a0072170 0x7f38a0074590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.748+0000 7f38b17fa640 1 -- 172.21.15.18:0/871521437 --> [v2:172.21.15.162:6822/3538482215,v1:172.21.15.162:6824/3538482215] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f38a4048e50 con 0x7f38a0072170 2024-09-19T09:25:11.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.748+0000 7f38b17fa640 1 -- 172.21.15.18:0/871521437 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=188) ==== 24+0+0 (secure 0 0 0) 0x7f38a40b02c0 con 0x7f38b40b3c90 2024-09-19T09:25:11.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.748+0000 7f38b3fff640 1 --2- 172.21.15.18:0/871521437 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f38a006c2b0 0x7f38a006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.748+0000 7f38b91e4640 1 --2- 172.21.15.18:0/871521437 >> [v2:172.21.15.162:6822/3538482215,v1:172.21.15.162:6824/3538482215] conn(0x7f38a0072170 0x7f38a0074590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.748+0000 7f38b3fff640 1 --2- 172.21.15.18:0/871521437 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f38a006c2b0 0x7f38a006e770 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f38b4159090 tx=0x7f38a8009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:11.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.748+0000 7f38b91e4640 1 --2- 172.21.15.18:0/871521437 >> [v2:172.21.15.162:6822/3538482215,v1:172.21.15.162:6824/3538482215] conn(0x7f38a0072170 0x7f38a0074590 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:11.751 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.749+0000 7f38b17fa640 1 -- 172.21.15.18:0/871521437 <== osd.4 v2:172.21.15.162:6822/3538482215 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f38a4048e50 con 0x7f38a0072170 2024-09-19T09:25:11.761 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.761+0000 7f38bac47640 1 -- 172.21.15.18:0/871521437 --> [v2:172.21.15.162:6822/3538482215,v1:172.21.15.162:6824/3538482215] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f38b40d2830 con 0x7f38a0072170 2024-09-19T09:25:11.762 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.761+0000 7f38b17fa640 1 -- 172.21.15.18:0/871521437 <== osd.4 v2:172.21.15.162:6822/3538482215 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7f38b40d2830 con 0x7f38a0072170 2024-09-19T09:25:11.762 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:25:11.762 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-19T09:25:11.762 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:25:11.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.761+0000 7f38bac47640 1 -- 172.21.15.18:0/871521437 >> [v2:172.21.15.162:6822/3538482215,v1:172.21.15.162:6824/3538482215] conn(0x7f38a0072170 msgr2=0x7f38a0074590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.761+0000 7f38bac47640 1 --2- 172.21.15.18:0/871521437 >> [v2:172.21.15.162:6822/3538482215,v1:172.21.15.162:6824/3538482215] conn(0x7f38a0072170 0x7f38a0074590 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.761+0000 7f38bac47640 1 -- 172.21.15.18:0/871521437 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f38a006c2b0 msgr2=0x7f38a006e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.763 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.761+0000 7f38bac47640 1 --2- 172.21.15.18:0/871521437 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f38a006c2b0 0x7f38a006e770 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f38b4159090 tx=0x7f38a8009190 comp rx=0 tx=0).stop 2024-09-19T09:25:11.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.761+0000 7f38bac47640 1 -- 172.21.15.18:0/871521437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38b40b3c90 msgr2=0x7f38b41501b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.761+0000 7f38bac47640 1 --2- 172.21.15.18:0/871521437 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f38b40b3c90 0x7f38b41501b0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f38a4000c00 tx=0x7f38a40046c0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.761+0000 7f38b91e4640 1 -- 172.21.15.18:0/871521437 reap_dead start 2024-09-19T09:25:11.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.762+0000 7f38bac47640 1 -- 172.21.15.18:0/871521437 shutdown_connections 2024-09-19T09:25:11.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.762+0000 7f38bac47640 1 -- 172.21.15.18:0/871521437 >> 172.21.15.18:0/871521437 conn(0x7f38b40d4c60 msgr2=0x7f38b406d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:11.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.762+0000 7f38bac47640 1 -- 172.21.15.18:0/871521437 shutdown_connections 2024-09-19T09:25:11.764 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.762+0000 7f38bac47640 1 -- 172.21.15.18:0/871521437 wait complete. 2024-09-19T09:25:11.774 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-19T09:25:11.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.876+0000 7f31e6ca4640 1 Processor -- start 2024-09-19T09:25:11.877 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.876+0000 7f31e6ca4640 1 -- start start 2024-09-19T09:25:11.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.877+0000 7f31e6ca4640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f31e00d1d40 0x7f31e00d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.877+0000 7f31e6ca4640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31e00d3cc0 con 0x7f31e015eda0 2024-09-19T09:25:11.881 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.877+0000 7f31e6ca4640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31e00d0bf0 con 0x7f31e00d5790 2024-09-19T09:25:11.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.877+0000 7f31e6ca4640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f31e00d5c00 con 0x7f31e00d1d40 2024-09-19T09:25:11.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.877+0000 7f31e4a40640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f31e015eda0 0x7f31e00d35b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49718/0 (socket says 172.21.15.18:49718) 2024-09-19T09:25:11.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.877+0000 7f31e4a40640 1 -- 172.21.15.18:0/2383009780 learned_addr learned my addr 172.21.15.18:0/2383009780 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:25:11.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.878+0000 7f31df7fe640 1 -- 172.21.15.18:0/2383009780 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 483612693 0 0) 0x7f31e00d3cc0 con 0x7f31e015eda0 2024-09-19T09:25:11.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.878+0000 7f31df7fe640 1 -- 172.21.15.18:0/2383009780 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31c8003520 con 0x7f31e015eda0 2024-09-19T09:25:11.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.878+0000 7f31e5241640 1 --2- 172.21.15.18:0/2383009780 >> v2:172.21.15.162:3300/0 conn(0x7f31e00d1d40 0x7f31e00d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.878+0000 7f31df7fe640 1 -- 172.21.15.18:0/2383009780 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 913385585 0 0) 0x7f31c8003520 con 0x7f31e015eda0 2024-09-19T09:25:11.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.878+0000 7f31df7fe640 1 -- 172.21.15.18:0/2383009780 >> v2:172.21.15.162:3300/0 conn(0x7f31e00d1d40 msgr2=0x7f31e00d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:11.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.878+0000 7f31df7fe640 1 --2- 172.21.15.18:0/2383009780 >> v2:172.21.15.162:3300/0 conn(0x7f31e00d1d40 0x7f31e00d0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.882 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.878+0000 7f31df7fe640 1 -- 172.21.15.18:0/2383009780 >> v1:172.21.15.162:6789/0 conn(0x7f31e00d5790 legacy=0x7f31e00d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.878+0000 7f31df7fe640 1 -- 172.21.15.18:0/2383009780 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e00d2ad0 con 0x7f31e015eda0 2024-09-19T09:25:11.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.878+0000 7f31df7fe640 1 -- 172.21.15.18:0/2383009780 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f31d80019f0 con 0x7f31e015eda0 2024-09-19T09:25:11.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.878+0000 7f31df7fe640 1 -- 172.21.15.18:0/2383009780 >> v1:172.21.15.18:6789/0 conn(0x7f31e015eda0 legacy=0x7f31e00d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.878+0000 7f31df7fe640 1 --2- 172.21.15.18:0/2383009780 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31c80039b0 0x7f31c8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.878+0000 7f31df7fe640 1 --2- 172.21.15.18:0/2383009780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c8004800 0x7f31c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.878+0000 7f31df7fe640 1 --2- 172.21.15.18:0/2383009780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31c80051c0 0x7f31c800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.878+0000 7f31df7fe640 1 -- 172.21.15.18:0/2383009780 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f31c800c030 con 0x7f31c8004800 2024-09-19T09:25:11.883 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.878+0000 7f31df7fe640 1 -- 172.21.15.18:0/2383009780 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f31c800c1e0 con 0x7f31c80051c0 2024-09-19T09:25:11.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.878+0000 7f31df7fe640 1 -- 172.21.15.18:0/2383009780 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f31c800c3e0 con 0x7f31c80039b0 2024-09-19T09:25:11.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.878+0000 7f31dffff640 1 --2- 172.21.15.18:0/2383009780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c8004800 0x7f31c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.878+0000 7f31e4a40640 1 --2- 172.21.15.18:0/2383009780 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31c80039b0 0x7f31c8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.878+0000 7f31e5241640 1 --2- 172.21.15.18:0/2383009780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31c80051c0 0x7f31c800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.879+0000 7f31dffff640 1 -- 172.21.15.18:0/2383009780 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31c80039b0 msgr2=0x7f31c8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:11.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.879+0000 7f31dffff640 1 --2- 172.21.15.18:0/2383009780 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31c80039b0 0x7f31c8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.879+0000 7f31dffff640 1 -- 172.21.15.18:0/2383009780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31c80051c0 msgr2=0x7f31c800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:11.884 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.879+0000 7f31dffff640 1 --2- 172.21.15.18:0/2383009780 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31c80051c0 0x7f31c800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.879+0000 7f31dffff640 1 -- 172.21.15.18:0/2383009780 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c8003520 con 0x7f31c8004800 2024-09-19T09:25:11.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.879+0000 7f31e5241640 1 -- 172.21.15.18:0/2383009780 reap_dead start 2024-09-19T09:25:11.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.879+0000 7f31e4a40640 1 --2- 172.21.15.18:0/2383009780 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31c80039b0 0x7f31c8003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:11.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.879+0000 7f31dffff640 1 --2- 172.21.15.18:0/2383009780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c8004800 0x7f31c8004c80 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f31d4001750 tx=0x7f31c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeacf7f580e6146c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:11.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.879+0000 7f31df7fe640 1 -- 172.21.15.18:0/2383009780 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d4001370 con 0x7f31c8004800 2024-09-19T09:25:11.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.879+0000 7f31df7fe640 1 -- 172.21.15.18:0/2383009780 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31d40052d0 con 0x7f31c8004800 2024-09-19T09:25:11.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.879+0000 7f31df7fe640 1 -- 172.21.15.18:0/2383009780 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d402abc0 con 0x7f31c8004800 2024-09-19T09:25:11.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.880+0000 7f31e6ca4640 1 -- 172.21.15.18:0/2383009780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c8004800 msgr2=0x7f31c8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.880+0000 7f31e6ca4640 1 --2- 172.21.15.18:0/2383009780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c8004800 0x7f31c8004c80 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f31d4001750 tx=0x7f31c8005830 comp rx=0 tx=0).stop 2024-09-19T09:25:11.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.880+0000 7f31e6ca4640 1 -- 172.21.15.18:0/2383009780 shutdown_connections 2024-09-19T09:25:11.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.880+0000 7f31e6ca4640 1 --2- 172.21.15.18:0/2383009780 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c8004800 0x7f31c8004c80 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.885 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.880+0000 7f31e6ca4640 1 -- 172.21.15.18:0/2383009780 >> 172.21.15.18:0/2383009780 conn(0x7f31e009df40 msgr2=0x7f31e00d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:11.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.880+0000 7f31e6ca4640 1 -- 172.21.15.18:0/2383009780 shutdown_connections 2024-09-19T09:25:11.886 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.880+0000 7f31e6ca4640 1 -- 172.21.15.18:0/2383009780 wait complete. 2024-09-19T09:25:11.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.881+0000 7f31e6ca4640 1 Processor -- start 2024-09-19T09:25:11.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.881+0000 7f31e6ca4640 1 -- start start 2024-09-19T09:25:11.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.882+0000 7f31e6ca4640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c8004800 0x7f31e015d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.882+0000 7f31e6ca4640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31e0161b00 0x7f31e0161f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.882+0000 7f31e6ca4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31e0160e10 0x7f31e0161290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.882+0000 7f31e6ca4640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f31e00d3120 con 0x7f31c8004800 2024-09-19T09:25:11.888 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.882+0000 7f31e6ca4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f31e00d2880 con 0x7f31e0160e10 2024-09-19T09:25:11.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.882+0000 7f31e6ca4640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f31e015f180 con 0x7f31e0161b00 2024-09-19T09:25:11.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.882+0000 7f31e4a40640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c8004800 0x7f31e015d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.882+0000 7f31e4a40640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c8004800 0x7f31e015d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39238/0 (socket says 172.21.15.18:39238) 2024-09-19T09:25:11.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.882+0000 7f31e4a40640 1 -- 172.21.15.18:0/2886216486 learned_addr learned my addr 172.21.15.18:0/2886216486 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:11.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.882+0000 7f31dffff640 1 --2- 172.21.15.18:0/2886216486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31e0161b00 0x7f31e0161f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.882+0000 7f31e5241640 1 --2- 172.21.15.18:0/2886216486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31e0160e10 0x7f31e0161290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.883+0000 7f31e4a40640 1 -- 172.21.15.18:0/2886216486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31e0161b00 msgr2=0x7f31e0161f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.883+0000 7f31e4a40640 1 --2- 172.21.15.18:0/2886216486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31e0161b00 0x7f31e0161f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.883+0000 7f31e4a40640 1 -- 172.21.15.18:0/2886216486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31e0160e10 msgr2=0x7f31e0161290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:11.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.883+0000 7f31e4a40640 1 --2- 172.21.15.18:0/2886216486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31e0160e10 0x7f31e0161290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:11.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.883+0000 7f31e4a40640 1 -- 172.21.15.18:0/2886216486 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31e015fe90 con 0x7f31c8004800 2024-09-19T09:25:11.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.883+0000 7f31e4a40640 1 --2- 172.21.15.18:0/2886216486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c8004800 0x7f31e015d4f0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f31d8007a10 tx=0x7f31d800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:11.889 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.883+0000 7f31dd7fa640 1 -- 172.21.15.18:0/2886216486 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d800ee50 con 0x7f31c8004800 2024-09-19T09:25:11.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.883+0000 7f31dd7fa640 1 -- 172.21.15.18:0/2886216486 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31d8018070 con 0x7f31c8004800 2024-09-19T09:25:11.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.883+0000 7f31dd7fa640 1 -- 172.21.15.18:0/2886216486 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31d8013620 con 0x7f31c8004800 2024-09-19T09:25:11.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.883+0000 7f31e6ca4640 1 -- 172.21.15.18:0/2886216486 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31e0160130 con 0x7f31c8004800 2024-09-19T09:25:11.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.883+0000 7f31e6ca4640 1 -- 172.21.15.18:0/2886216486 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31e01606f0 con 0x7f31c8004800 2024-09-19T09:25:11.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.884+0000 7f31e6ca4640 1 -- 172.21.15.18:0/2886216486 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31e00d0480 con 0x7f31c8004800 2024-09-19T09:25:11.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.885+0000 7f31dd7fa640 1 -- 172.21.15.18:0/2886216486 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f31d80137c0 con 0x7f31c8004800 2024-09-19T09:25:11.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.885+0000 7f31dd7fa640 1 --2- 172.21.15.18:0/2886216486 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f31cc06c2b0 0x7f31cc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:11.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.885+0000 7f31dd7fa640 1 -- 172.21.15.18:0/2886216486 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 4943+0+0 (secure 0 0 0) 0x7f31d808b4e0 con 0x7f31c8004800 2024-09-19T09:25:11.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.885+0000 7f31dffff640 1 --2- 172.21.15.18:0/2886216486 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f31cc06c2b0 0x7f31cc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:11.890 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.886+0000 7f31dffff640 1 --2- 172.21.15.18:0/2886216486 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f31cc06c2b0 0x7f31cc06e770 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f31d4032000 tx=0x7f31d402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:11.891 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:11.889+0000 7f31dd7fa640 1 -- 172.21.15.18:0/2886216486 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f31d8059990 con 0x7f31c8004800 2024-09-19T09:25:12.064 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.064+0000 7f31e6ca4640 1 -- 172.21.15.18:0/2886216486 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f31e01624c0 con 0x7f31cc06c2b0 2024-09-19T09:25:12.065 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.064+0000 7f31dd7fa640 1 -- 172.21.15.18:0/2886216486 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f31e01624c0 con 0x7f31cc06c2b0 2024-09-19T09:25:12.065 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 4 to deep-scrub 2024-09-19T09:25:12.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.066+0000 7f31e6ca4640 1 -- 172.21.15.18:0/2886216486 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f31cc06c2b0 msgr2=0x7f31cc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.066+0000 7f31e6ca4640 1 --2- 172.21.15.18:0/2886216486 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f31cc06c2b0 0x7f31cc06e770 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f31d4032000 tx=0x7f31d402e000 comp rx=0 tx=0).stop 2024-09-19T09:25:12.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.066+0000 7f31e6ca4640 1 -- 172.21.15.18:0/2886216486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c8004800 msgr2=0x7f31e015d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.066+0000 7f31e6ca4640 1 --2- 172.21.15.18:0/2886216486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c8004800 0x7f31e015d4f0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f31d8007a10 tx=0x7f31d800e530 comp rx=0 tx=0).stop 2024-09-19T09:25:12.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.066+0000 7f31e6ca4640 1 -- 172.21.15.18:0/2886216486 shutdown_connections 2024-09-19T09:25:12.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.066+0000 7f31e6ca4640 1 --2- 172.21.15.18:0/2886216486 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f31cc06c2b0 0x7f31cc06e770 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.067+0000 7f31e6ca4640 1 --2- 172.21.15.18:0/2886216486 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f31e0160e10 0x7f31e0161290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.067+0000 7f31e6ca4640 1 --2- 172.21.15.18:0/2886216486 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f31e0161b00 0x7f31e0161f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.067+0000 7f31e6ca4640 1 --2- 172.21.15.18:0/2886216486 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f31c8004800 0x7f31e015d4f0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.068 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.067+0000 7f31e6ca4640 1 -- 172.21.15.18:0/2886216486 >> 172.21.15.18:0/2886216486 conn(0x7f31e009df40 msgr2=0x7f31e006c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:12.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.067+0000 7f31e6ca4640 1 -- 172.21.15.18:0/2886216486 shutdown_connections 2024-09-19T09:25:12.069 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.067+0000 7f31e6ca4640 1 -- 172.21.15.18:0/2886216486 wait complete. 2024-09-19T09:25:12.078 INFO:tasks.ceph:Scrubbing osd.5 2024-09-19T09:25:12.078 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-19T09:25:12.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.184+0000 7fa47988d640 1 Processor -- start 2024-09-19T09:25:12.185 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.184+0000 7fa47988d640 1 -- start start 2024-09-19T09:25:12.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.185+0000 7fa47988d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa4740ced50 0x7fa474072680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.185+0000 7fa47988d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa474160310 con 0x7fa4741445a0 2024-09-19T09:25:12.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.185+0000 7fa47988d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa474160030 con 0x7fa474144980 2024-09-19T09:25:12.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.185+0000 7fa47988d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa47415fdd0 con 0x7fa4740ced50 2024-09-19T09:25:12.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.185+0000 7fa472ffd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7fa4741445a0 0x7fa4740cd380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49734/0 (socket says 172.21.15.18:49734) 2024-09-19T09:25:12.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.185+0000 7fa472ffd640 1 -- 172.21.15.18:0/2128053053 learned_addr learned my addr 172.21.15.18:0/2128053053 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:25:12.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.185+0000 7fa46a7fc640 1 --2- 172.21.15.18:0/2128053053 >> v2:172.21.15.162:3300/0 conn(0x7fa4740ced50 0x7fa474072680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.185+0000 7fa4727fc640 1 -- 172.21.15.18:0/2128053053 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3596066896 0 0) 0x7fa474160310 con 0x7fa4741445a0 2024-09-19T09:25:12.188 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.185+0000 7fa4727fc640 1 -- 172.21.15.18:0/2128053053 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa460003520 con 0x7fa4741445a0 2024-09-19T09:25:12.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.186+0000 7fa4727fc640 1 -- 172.21.15.18:0/2128053053 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2409387814 0 0) 0x7fa460003520 con 0x7fa4741445a0 2024-09-19T09:25:12.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.186+0000 7fa4727fc640 1 -- 172.21.15.18:0/2128053053 >> v2:172.21.15.162:3300/0 conn(0x7fa4740ced50 msgr2=0x7fa474072680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:12.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.186+0000 7fa4727fc640 1 --2- 172.21.15.18:0/2128053053 >> v2:172.21.15.162:3300/0 conn(0x7fa4740ced50 0x7fa474072680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.186+0000 7fa4727fc640 1 -- 172.21.15.18:0/2128053053 >> v1:172.21.15.162:6789/0 conn(0x7fa474144980 legacy=0x7fa4740b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.186+0000 7fa4727fc640 1 -- 172.21.15.18:0/2128053053 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4740b5940 con 0x7fa4741445a0 2024-09-19T09:25:12.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.186+0000 7fa4727fc640 1 -- 172.21.15.18:0/2128053053 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7fa464001670 con 0x7fa4741445a0 2024-09-19T09:25:12.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.186+0000 7fa4727fc640 1 -- 172.21.15.18:0/2128053053 >> v1:172.21.15.18:6789/0 conn(0x7fa4741445a0 legacy=0x7fa4740cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.189 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.186+0000 7fa4727fc640 1 --2- 172.21.15.18:0/2128053053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4600039b0 0x7fa460003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.186+0000 7fa4727fc640 1 --2- 172.21.15.18:0/2128053053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa460004800 0x7fa460004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.186+0000 7fa4727fc640 1 --2- 172.21.15.18:0/2128053053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4600051c0 0x7fa46000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.186+0000 7fa4727fc640 1 -- 172.21.15.18:0/2128053053 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa47415fdd0 con 0x7fa4600039b0 2024-09-19T09:25:12.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.186+0000 7fa4727fc640 1 -- 172.21.15.18:0/2128053053 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa46000c110 con 0x7fa460004800 2024-09-19T09:25:12.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.186+0000 7fa4727fc640 1 -- 172.21.15.18:0/2128053053 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa46000c310 con 0x7fa4600051c0 2024-09-19T09:25:12.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.186+0000 7fa472ffd640 1 --2- 172.21.15.18:0/2128053053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4600039b0 0x7fa460003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.186+0000 7fa46a7fc640 1 --2- 172.21.15.18:0/2128053053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa460004800 0x7fa460004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.186+0000 7fa4737fe640 1 --2- 172.21.15.18:0/2128053053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4600051c0 0x7fa46000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.186+0000 7fa472ffd640 1 -- 172.21.15.18:0/2128053053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4600051c0 msgr2=0x7fa46000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:12.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.186+0000 7fa472ffd640 1 --2- 172.21.15.18:0/2128053053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4600051c0 0x7fa46000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.186+0000 7fa472ffd640 1 -- 172.21.15.18:0/2128053053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa460004800 msgr2=0x7fa460004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:12.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.186+0000 7fa472ffd640 1 --2- 172.21.15.18:0/2128053053 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa460004800 0x7fa460004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.190 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.186+0000 7fa472ffd640 1 -- 172.21.15.18:0/2128053053 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa460003520 con 0x7fa4600039b0 2024-09-19T09:25:12.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.186+0000 7fa4737fe640 1 --2- 172.21.15.18:0/2128053053 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa4600051c0 0x7fa46000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:12.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.186+0000 7fa4737fe640 1 -- 172.21.15.18:0/2128053053 reap_dead start 2024-09-19T09:25:12.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.187+0000 7fa472ffd640 1 --2- 172.21.15.18:0/2128053053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4600039b0 0x7fa460003d90 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fa46400c240 tx=0x7fa460005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa4e1e0333f99ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:12.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.187+0000 7fa4727fc640 1 -- 172.21.15.18:0/2128053053 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa46402e070 con 0x7fa4600039b0 2024-09-19T09:25:12.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.187+0000 7fa4727fc640 1 -- 172.21.15.18:0/2128053053 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa464005af0 con 0x7fa4600039b0 2024-09-19T09:25:12.191 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.187+0000 7fa4727fc640 1 -- 172.21.15.18:0/2128053053 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa464007d30 con 0x7fa4600039b0 2024-09-19T09:25:12.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.187+0000 7fa47988d640 1 -- 172.21.15.18:0/2128053053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4600039b0 msgr2=0x7fa460003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.195 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.187+0000 7fa47988d640 1 --2- 172.21.15.18:0/2128053053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4600039b0 0x7fa460003d90 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fa46400c240 tx=0x7fa460005830 comp rx=0 tx=0).stop 2024-09-19T09:25:12.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.188+0000 7fa47988d640 1 -- 172.21.15.18:0/2128053053 shutdown_connections 2024-09-19T09:25:12.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.188+0000 7fa47988d640 1 --2- 172.21.15.18:0/2128053053 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa4600039b0 0x7fa460003d90 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.188+0000 7fa47988d640 1 -- 172.21.15.18:0/2128053053 >> 172.21.15.18:0/2128053053 conn(0x7fa4740b26a0 msgr2=0x7fa4740b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:12.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.188+0000 7fa47988d640 1 -- 172.21.15.18:0/2128053053 shutdown_connections 2024-09-19T09:25:12.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.188+0000 7fa47988d640 1 -- 172.21.15.18:0/2128053053 wait complete. 2024-09-19T09:25:12.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.189+0000 7fa47988d640 1 Processor -- start 2024-09-19T09:25:12.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.189+0000 7fa47988d640 1 -- start start 2024-09-19T09:25:12.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.190+0000 7fa47988d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4600039b0 0x7fa4740ac2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.190+0000 7fa47988d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa47413d2a0 0x7fa47413eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.196 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.190+0000 7fa47988d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa47413f430 0x7fa4740715a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.190+0000 7fa47988d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7fa474145040 con 0x7fa47413d2a0 2024-09-19T09:25:12.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.190+0000 7fa47988d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa474144ec0 con 0x7fa4600039b0 2024-09-19T09:25:12.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.190+0000 7fa47988d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7fa4740cd380 con 0x7fa47413f430 2024-09-19T09:25:12.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.190+0000 7fa46a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa47413d2a0 0x7fa47413eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.190+0000 7fa46a7fc640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa47413d2a0 0x7fa47413eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39254/0 (socket says 172.21.15.18:39254) 2024-09-19T09:25:12.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.190+0000 7fa46a7fc640 1 -- 172.21.15.18:0/2537712814 learned_addr learned my addr 172.21.15.18:0/2537712814 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:12.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.190+0000 7fa472ffd640 1 --2- 172.21.15.18:0/2537712814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4600039b0 0x7fa4740ac2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.190+0000 7fa4737fe640 1 --2- 172.21.15.18:0/2537712814 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa47413f430 0x7fa4740715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.197 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.190+0000 7fa46a7fc640 1 -- 172.21.15.18:0/2537712814 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa47413f430 msgr2=0x7fa4740715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.190+0000 7fa46a7fc640 1 --2- 172.21.15.18:0/2537712814 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa47413f430 0x7fa4740715a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.190+0000 7fa46a7fc640 1 -- 172.21.15.18:0/2537712814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4600039b0 msgr2=0x7fa4740ac2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.190+0000 7fa46a7fc640 1 --2- 172.21.15.18:0/2537712814 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4600039b0 0x7fa4740ac2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.190+0000 7fa46a7fc640 1 -- 172.21.15.18:0/2537712814 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa47413d720 con 0x7fa47413d2a0 2024-09-19T09:25:12.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.190+0000 7fa4737fe640 1 --2- 172.21.15.18:0/2537712814 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7fa47413f430 0x7fa4740715a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:25:12.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.190+0000 7fa46a7fc640 1 --2- 172.21.15.18:0/2537712814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa47413d2a0 0x7fa47413eef0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fa45c011a20 tx=0x7fa45c011ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:12.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.190+0000 7fa470ff9640 1 -- 172.21.15.18:0/2537712814 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c00fb50 con 0x7fa47413d2a0 2024-09-19T09:25:12.198 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.190+0000 7fa470ff9640 1 -- 172.21.15.18:0/2537712814 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa45c00fcf0 con 0x7fa47413d2a0 2024-09-19T09:25:12.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.190+0000 7fa47988d640 1 -- 172.21.15.18:0/2537712814 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4740ab220 con 0x7fa47413d2a0 2024-09-19T09:25:12.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.191+0000 7fa470ff9640 1 -- 172.21.15.18:0/2537712814 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa45c014640 con 0x7fa47413d2a0 2024-09-19T09:25:12.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.191+0000 7fa47988d640 1 -- 172.21.15.18:0/2537712814 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4740ab7e0 con 0x7fa47413d2a0 2024-09-19T09:25:12.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.192+0000 7fa47988d640 1 -- 172.21.15.18:0/2537712814 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa4740cd710 con 0x7fa47413d2a0 2024-09-19T09:25:12.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.192+0000 7fa470ff9640 1 -- 172.21.15.18:0/2537712814 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7fa45c012040 con 0x7fa47413d2a0 2024-09-19T09:25:12.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.192+0000 7fa470ff9640 1 --2- 172.21.15.18:0/2537712814 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa45406c2b0 0x7fa45406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.193+0000 7fa470ff9640 1 -- 172.21.15.18:0/2537712814 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 4943+0+0 (secure 0 0 0) 0x7fa45c08b7c0 con 0x7fa47413d2a0 2024-09-19T09:25:12.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.193+0000 7fa472ffd640 1 --2- 172.21.15.18:0/2537712814 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa45406c2b0 0x7fa45406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.199 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.193+0000 7fa470ff9640 1 --2- 172.21.15.18:0/2537712814 >> [v2:172.21.15.162:6800/2408698413,v1:172.21.15.162:6801/2408698413] conn(0x7fa454072170 0x7fa454074590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.193+0000 7fa470ff9640 1 -- 172.21.15.18:0/2537712814 --> [v2:172.21.15.162:6800/2408698413,v1:172.21.15.162:6801/2408698413] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa454074c40 con 0x7fa454072170 2024-09-19T09:25:12.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.193+0000 7fa470ff9640 1 -- 172.21.15.18:0/2537712814 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=188) ==== 24+0+0 (secure 0 0 0) 0x7fa45c092050 con 0x7fa47413d2a0 2024-09-19T09:25:12.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.193+0000 7fa4737fe640 1 --2- 172.21.15.18:0/2537712814 >> [v2:172.21.15.162:6800/2408698413,v1:172.21.15.162:6801/2408698413] conn(0x7fa454072170 0x7fa454074590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.193+0000 7fa472ffd640 1 --2- 172.21.15.18:0/2537712814 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa45406c2b0 0x7fa45406e770 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fa464033000 tx=0x7fa46402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:12.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.193+0000 7fa4737fe640 1 --2- 172.21.15.18:0/2537712814 >> [v2:172.21.15.162:6800/2408698413,v1:172.21.15.162:6801/2408698413] conn(0x7fa454072170 0x7fa454074590 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:12.200 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.194+0000 7fa470ff9640 1 -- 172.21.15.18:0/2537712814 <== osd.5 v2:172.21.15.162:6800/2408698413 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7fa454074c40 con 0x7fa454072170 2024-09-19T09:25:12.206 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.205+0000 7fa47988d640 1 -- 172.21.15.18:0/2537712814 --> [v2:172.21.15.162:6800/2408698413,v1:172.21.15.162:6801/2408698413] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa4740ac080 con 0x7fa454072170 2024-09-19T09:25:12.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.206+0000 7fa470ff9640 1 -- 172.21.15.18:0/2537712814 <== osd.5 v2:172.21.15.162:6800/2408698413 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7fa4740ac080 con 0x7fa454072170 2024-09-19T09:25:12.207 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:25:12.208 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-19T09:25:12.208 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:25:12.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.206+0000 7fa47988d640 1 -- 172.21.15.18:0/2537712814 >> [v2:172.21.15.162:6800/2408698413,v1:172.21.15.162:6801/2408698413] conn(0x7fa454072170 msgr2=0x7fa454074590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.206+0000 7fa47988d640 1 --2- 172.21.15.18:0/2537712814 >> [v2:172.21.15.162:6800/2408698413,v1:172.21.15.162:6801/2408698413] conn(0x7fa454072170 0x7fa454074590 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.206+0000 7fa47988d640 1 -- 172.21.15.18:0/2537712814 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa45406c2b0 msgr2=0x7fa45406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.206+0000 7fa47988d640 1 --2- 172.21.15.18:0/2537712814 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7fa45406c2b0 0x7fa45406e770 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fa464033000 tx=0x7fa46402e000 comp rx=0 tx=0).stop 2024-09-19T09:25:12.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.206+0000 7fa47988d640 1 -- 172.21.15.18:0/2537712814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa47413d2a0 msgr2=0x7fa47413eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.206+0000 7fa47988d640 1 --2- 172.21.15.18:0/2537712814 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7fa47413d2a0 0x7fa47413eef0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fa45c011a20 tx=0x7fa45c011ee0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.206+0000 7fa4737fe640 1 -- 172.21.15.18:0/2537712814 reap_dead start 2024-09-19T09:25:12.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.207+0000 7fa47988d640 1 -- 172.21.15.18:0/2537712814 shutdown_connections 2024-09-19T09:25:12.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.207+0000 7fa47988d640 1 -- 172.21.15.18:0/2537712814 >> 172.21.15.18:0/2537712814 conn(0x7fa4740b26a0 msgr2=0x7fa4740b06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:12.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.207+0000 7fa47988d640 1 -- 172.21.15.18:0/2537712814 shutdown_connections 2024-09-19T09:25:12.209 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.207+0000 7fa47988d640 1 -- 172.21.15.18:0/2537712814 wait complete. 2024-09-19T09:25:12.218 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-19T09:25:12.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.320+0000 7f6c59d6d640 1 Processor -- start 2024-09-19T09:25:12.321 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.320+0000 7f6c59d6d640 1 -- start start 2024-09-19T09:25:12.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.320+0000 7f6c59d6d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6c540d5790 0x7f6c540d0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.320+0000 7f6c59d6d640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c540d3cc0 con 0x7f6c5415eda0 2024-09-19T09:25:12.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.320+0000 7f6c59d6d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c540d0bf0 con 0x7f6c540d1630 2024-09-19T09:25:12.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.320+0000 7f6c59d6d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6c540d5c00 con 0x7f6c540d5790 2024-09-19T09:25:12.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.321+0000 7f6c537fe640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f6c5415eda0 0x7f6c540d35b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49736/0 (socket says 172.21.15.18:49736) 2024-09-19T09:25:12.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.321+0000 7f6c537fe640 1 -- 172.21.15.18:0/3783397911 learned_addr learned my addr 172.21.15.18:0/3783397911 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:25:12.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.321+0000 7f6c52ffd640 1 --2- 172.21.15.18:0/3783397911 >> v2:172.21.15.162:3300/0 conn(0x7f6c540d5790 0x7f6c540d0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.324 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.321+0000 7f6c527fc640 1 -- 172.21.15.18:0/3783397911 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1965241268 0 0) 0x7f6c540d3cc0 con 0x7f6c5415eda0 2024-09-19T09:25:12.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.321+0000 7f6c527fc640 1 -- 172.21.15.18:0/3783397911 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c40003520 con 0x7f6c5415eda0 2024-09-19T09:25:12.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.321+0000 7f6c527fc640 1 -- 172.21.15.18:0/3783397911 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 117388219 0 0) 0x7f6c40003520 con 0x7f6c5415eda0 2024-09-19T09:25:12.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.321+0000 7f6c527fc640 1 -- 172.21.15.18:0/3783397911 >> v2:172.21.15.162:3300/0 conn(0x7f6c540d5790 msgr2=0x7f6c540d0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:12.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.321+0000 7f6c527fc640 1 --2- 172.21.15.18:0/3783397911 >> v2:172.21.15.162:3300/0 conn(0x7f6c540d5790 0x7f6c540d0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.321+0000 7f6c527fc640 1 -- 172.21.15.18:0/3783397911 >> v1:172.21.15.162:6789/0 conn(0x7f6c540d1630 legacy=0x7f6c540b7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.321+0000 7f6c527fc640 1 -- 172.21.15.18:0/3783397911 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c540d2ad0 con 0x7f6c5415eda0 2024-09-19T09:25:12.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.321+0000 7f6c527fc640 1 -- 172.21.15.18:0/3783397911 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f6c440019f0 con 0x7f6c5415eda0 2024-09-19T09:25:12.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.321+0000 7f6c527fc640 1 -- 172.21.15.18:0/3783397911 >> v1:172.21.15.18:6789/0 conn(0x7f6c5415eda0 legacy=0x7f6c540d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.321+0000 7f6c527fc640 1 --2- 172.21.15.18:0/3783397911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c400039b0 0x7f6c40003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.321+0000 7f6c527fc640 1 --2- 172.21.15.18:0/3783397911 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c40004800 0x7f6c40004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.325 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.321+0000 7f6c527fc640 1 --2- 172.21.15.18:0/3783397911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c400051c0 0x7f6c4000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.321+0000 7f6c527fc640 1 -- 172.21.15.18:0/3783397911 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4000c030 con 0x7f6c400039b0 2024-09-19T09:25:12.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.321+0000 7f6c527fc640 1 -- 172.21.15.18:0/3783397911 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6c4000c1e0 con 0x7f6c400051c0 2024-09-19T09:25:12.328 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.321+0000 7f6c527fc640 1 -- 172.21.15.18:0/3783397911 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6c4000c3e0 con 0x7f6c40004800 2024-09-19T09:25:12.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.321+0000 7f6c537fe640 1 --2- 172.21.15.18:0/3783397911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c400039b0 0x7f6c40003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.321+0000 7f6c52ffd640 1 --2- 172.21.15.18:0/3783397911 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c40004800 0x7f6c40004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.321+0000 7f6c53fff640 1 --2- 172.21.15.18:0/3783397911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c400051c0 0x7f6c4000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.322+0000 7f6c537fe640 1 -- 172.21.15.18:0/3783397911 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c40004800 msgr2=0x7f6c40004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:12.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.322+0000 7f6c537fe640 1 --2- 172.21.15.18:0/3783397911 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c40004800 0x7f6c40004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.322+0000 7f6c537fe640 1 -- 172.21.15.18:0/3783397911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c400051c0 msgr2=0x7f6c4000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:12.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.322+0000 7f6c537fe640 1 --2- 172.21.15.18:0/3783397911 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c400051c0 0x7f6c4000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.322+0000 7f6c53fff640 1 -- 172.21.15.18:0/3783397911 reap_dead start 2024-09-19T09:25:12.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.322+0000 7f6c537fe640 1 -- 172.21.15.18:0/3783397911 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c40003520 con 0x7f6c400039b0 2024-09-19T09:25:12.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.322+0000 7f6c537fe640 1 --2- 172.21.15.18:0/3783397911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c400039b0 0x7f6c40003dd0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f6c4400a840 tx=0x7f6c40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b40f3e93d9ac18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:12.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.322+0000 7f6c527fc640 1 -- 172.21.15.18:0/3783397911 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c4400a460 con 0x7f6c400039b0 2024-09-19T09:25:12.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.323+0000 7f6c527fc640 1 -- 172.21.15.18:0/3783397911 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c4402f070 con 0x7f6c400039b0 2024-09-19T09:25:12.329 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.323+0000 7f6c527fc640 1 -- 172.21.15.18:0/3783397911 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c4402bcf0 con 0x7f6c400039b0 2024-09-19T09:25:12.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.323+0000 7f6c59d6d640 1 -- 172.21.15.18:0/3783397911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c400039b0 msgr2=0x7f6c40003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.323+0000 7f6c59d6d640 1 --2- 172.21.15.18:0/3783397911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c400039b0 0x7f6c40003dd0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f6c4400a840 tx=0x7f6c40005830 comp rx=0 tx=0).stop 2024-09-19T09:25:12.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.323+0000 7f6c59d6d640 1 -- 172.21.15.18:0/3783397911 shutdown_connections 2024-09-19T09:25:12.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.323+0000 7f6c59d6d640 1 --2- 172.21.15.18:0/3783397911 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c400039b0 0x7f6c40003dd0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.323+0000 7f6c59d6d640 1 -- 172.21.15.18:0/3783397911 >> 172.21.15.18:0/3783397911 conn(0x7f6c5409df40 msgr2=0x7f6c540d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:12.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.323+0000 7f6c59d6d640 1 -- 172.21.15.18:0/3783397911 shutdown_connections 2024-09-19T09:25:12.330 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.323+0000 7f6c59d6d640 1 -- 172.21.15.18:0/3783397911 wait complete. 2024-09-19T09:25:12.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.324+0000 7f6c59d6d640 1 Processor -- start 2024-09-19T09:25:12.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.324+0000 7f6c59d6d640 1 -- start start 2024-09-19T09:25:12.332 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.325+0000 7f6c59d6d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c400039b0 0x7f6c540ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.325+0000 7f6c59d6d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c540cd860 0x7f6c540c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.325+0000 7f6c59d6d640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c540c9d30 0x7f6c54161340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.325+0000 7f6c59d6d640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6c540d3120 con 0x7f6c540cd860 2024-09-19T09:25:12.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.325+0000 7f6c59d6d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6c540d2880 con 0x7f6c400039b0 2024-09-19T09:25:12.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.325+0000 7f6c59d6d640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6c5415f180 con 0x7f6c540c9d30 2024-09-19T09:25:12.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.325+0000 7f6c52ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c540cd860 0x7f6c540c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.325+0000 7f6c52ffd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c540cd860 0x7f6c540c97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39270/0 (socket says 172.21.15.18:39270) 2024-09-19T09:25:12.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.325+0000 7f6c52ffd640 1 -- 172.21.15.18:0/3244309556 learned_addr learned my addr 172.21.15.18:0/3244309556 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:12.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.325+0000 7f6c537fe640 1 --2- 172.21.15.18:0/3244309556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c400039b0 0x7f6c540ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.325+0000 7f6c53fff640 1 --2- 172.21.15.18:0/3244309556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c540c9d30 0x7f6c54161340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.326+0000 7f6c52ffd640 1 -- 172.21.15.18:0/3244309556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c540c9d30 msgr2=0x7f6c54161340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.326+0000 7f6c52ffd640 1 --2- 172.21.15.18:0/3244309556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c540c9d30 0x7f6c54161340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.333 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.326+0000 7f6c52ffd640 1 -- 172.21.15.18:0/3244309556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c400039b0 msgr2=0x7f6c540ccc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.326+0000 7f6c52ffd640 1 --2- 172.21.15.18:0/3244309556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c400039b0 0x7f6c540ccc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.326+0000 7f6c52ffd640 1 -- 172.21.15.18:0/3244309556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c540b8960 con 0x7f6c540cd860 2024-09-19T09:25:12.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.326+0000 7f6c53fff640 1 --2- 172.21.15.18:0/3244309556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c540c9d30 0x7f6c54161340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:12.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.326+0000 7f6c52ffd640 1 --2- 172.21.15.18:0/3244309556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c540cd860 0x7f6c540c97f0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c0118f0 tx=0x7f6c3c011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:12.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.326+0000 7f6c4bfff640 1 -- 172.21.15.18:0/3244309556 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c019070 con 0x7f6c540cd860 2024-09-19T09:25:12.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.326+0000 7f6c4bfff640 1 -- 172.21.15.18:0/3244309556 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c3c004240 con 0x7f6c540cd860 2024-09-19T09:25:12.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.326+0000 7f6c4bfff640 1 -- 172.21.15.18:0/3244309556 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3c00f820 con 0x7f6c540cd860 2024-09-19T09:25:12.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.326+0000 7f6c59d6d640 1 -- 172.21.15.18:0/3244309556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c540cd640 con 0x7f6c540cd860 2024-09-19T09:25:12.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.326+0000 7f6c59d6d640 1 -- 172.21.15.18:0/3244309556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c54160860 con 0x7f6c540cd860 2024-09-19T09:25:12.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.327+0000 7f6c59d6d640 1 -- 172.21.15.18:0/3244309556 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c540d1ac0 con 0x7f6c540cd860 2024-09-19T09:25:12.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.328+0000 7f6c4bfff640 1 -- 172.21.15.18:0/3244309556 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6c3c01c070 con 0x7f6c540cd860 2024-09-19T09:25:12.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.328+0000 7f6c4bfff640 1 --2- 172.21.15.18:0/3244309556 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6c3406c2e0 0x7f6c3406e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.328+0000 7f6c4bfff640 1 -- 172.21.15.18:0/3244309556 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 4943+0+0 (secure 0 0 0) 0x7f6c3c08b3a0 con 0x7f6c540cd860 2024-09-19T09:25:12.334 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.328+0000 7f6c537fe640 1 --2- 172.21.15.18:0/3244309556 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6c3406c2e0 0x7f6c3406e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.329+0000 7f6c537fe640 1 --2- 172.21.15.18:0/3244309556 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6c3406c2e0 0x7f6c3406e7a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6c44033000 tx=0x7f6c44007000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:12.335 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.332+0000 7f6c4bfff640 1 -- 172.21.15.18:0/3244309556 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f6c3c0597c0 con 0x7f6c540cd860 2024-09-19T09:25:12.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.508+0000 7f6c59d6d640 1 -- 172.21.15.18:0/3244309556 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f6c540cc030 con 0x7f6c3406c2e0 2024-09-19T09:25:12.509 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.508+0000 7f6c4bfff640 1 -- 172.21.15.18:0/3244309556 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6c540cc030 con 0x7f6c3406c2e0 2024-09-19T09:25:12.509 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 5 to deep-scrub 2024-09-19T09:25:12.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.510+0000 7f6c59d6d640 1 -- 172.21.15.18:0/3244309556 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6c3406c2e0 msgr2=0x7f6c3406e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.511+0000 7f6c59d6d640 1 --2- 172.21.15.18:0/3244309556 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6c3406c2e0 0x7f6c3406e7a0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6c44033000 tx=0x7f6c44007000 comp rx=0 tx=0).stop 2024-09-19T09:25:12.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.511+0000 7f6c59d6d640 1 -- 172.21.15.18:0/3244309556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c540cd860 msgr2=0x7f6c540c97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.511+0000 7f6c59d6d640 1 --2- 172.21.15.18:0/3244309556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c540cd860 0x7f6c540c97f0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c0118f0 tx=0x7f6c3c011db0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.511+0000 7f6c59d6d640 1 -- 172.21.15.18:0/3244309556 shutdown_connections 2024-09-19T09:25:12.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.511+0000 7f6c59d6d640 1 --2- 172.21.15.18:0/3244309556 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6c3406c2e0 0x7f6c3406e7a0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.511+0000 7f6c59d6d640 1 --2- 172.21.15.18:0/3244309556 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c540c9d30 0x7f6c54161340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.512 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.511+0000 7f6c59d6d640 1 --2- 172.21.15.18:0/3244309556 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c540cd860 0x7f6c540c97f0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.511+0000 7f6c59d6d640 1 --2- 172.21.15.18:0/3244309556 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c400039b0 0x7f6c540ccc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.511+0000 7f6c59d6d640 1 -- 172.21.15.18:0/3244309556 >> 172.21.15.18:0/3244309556 conn(0x7f6c5409df40 msgr2=0x7f6c540b9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:12.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.511+0000 7f6c59d6d640 1 -- 172.21.15.18:0/3244309556 shutdown_connections 2024-09-19T09:25:12.513 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.511+0000 7f6c59d6d640 1 -- 172.21.15.18:0/3244309556 wait complete. 2024-09-19T09:25:12.523 INFO:tasks.ceph:Scrubbing osd.6 2024-09-19T09:25:12.523 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-19T09:25:12.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.628+0000 7f996f9d6640 1 Processor -- start 2024-09-19T09:25:12.629 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.628+0000 7f996f9d6640 1 -- start start 2024-09-19T09:25:12.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.629+0000 7f996f9d6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f996815ea50 0x7f99680708a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.629+0000 7f996f9d6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f996806bc10 0x7f996806c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.629+0000 7f996f9d6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f996815fe90 con 0x7f996806e5b0 2024-09-19T09:25:12.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.629+0000 7f996f9d6640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f996806c5c0 con 0x7f996815ea50 2024-09-19T09:25:12.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.629+0000 7f996f9d6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f996806eb70 con 0x7f996806bc10 2024-09-19T09:25:12.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.629+0000 7f996d772640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f996815ea50 0x7f99680708a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.629+0000 7f996d772640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f996815ea50 0x7f99680708a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39282/0 (socket says 172.21.15.18:39282) 2024-09-19T09:25:12.630 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.629+0000 7f996d772640 1 -- 172.21.15.18:0/924149876 learned_addr learned my addr 172.21.15.18:0/924149876 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:12.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.629+0000 7f996df73640 1 --2- 172.21.15.18:0/924149876 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f996806bc10 0x7f996806c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.629+0000 7f996d772640 1 -- 172.21.15.18:0/924149876 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f996806bc10 msgr2=0x7f996806c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:12.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.629+0000 7f996d772640 1 --2- 172.21.15.18:0/924149876 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f996806bc10 0x7f996806c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.629+0000 7f996d772640 1 -- 172.21.15.18:0/924149876 >> v1:172.21.15.162:6789/0 conn(0x7f996806e5b0 legacy=0x7f996815f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:12.631 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.629+0000 7f996d772640 1 -- 172.21.15.18:0/924149876 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f996806ee50 con 0x7f996815ea50 2024-09-19T09:25:12.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.630+0000 7f996d772640 1 --2- 172.21.15.18:0/924149876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f996815ea50 0x7f99680708a0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f9964009870 tx=0x7f996402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c018f2e84b8df61 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:12.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.630+0000 7f995ffff640 1 -- 172.21.15.18:0/924149876 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9964037070 con 0x7f996815ea50 2024-09-19T09:25:12.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.630+0000 7f995ffff640 1 -- 172.21.15.18:0/924149876 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9964032440 con 0x7f996815ea50 2024-09-19T09:25:12.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.630+0000 7f995ffff640 1 -- 172.21.15.18:0/924149876 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9964032810 con 0x7f996815ea50 2024-09-19T09:25:12.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.630+0000 7f996f9d6640 1 -- 172.21.15.18:0/924149876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f996815ea50 msgr2=0x7f99680708a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.630+0000 7f996f9d6640 1 --2- 172.21.15.18:0/924149876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f996815ea50 0x7f99680708a0 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f9964009870 tx=0x7f996402a210 comp rx=0 tx=0).stop 2024-09-19T09:25:12.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.631+0000 7f996f9d6640 1 -- 172.21.15.18:0/924149876 shutdown_connections 2024-09-19T09:25:12.632 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.631+0000 7f996f9d6640 1 --2- 172.21.15.18:0/924149876 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f996806bc10 0x7f996806c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.631+0000 7f996f9d6640 1 --2- 172.21.15.18:0/924149876 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f996815ea50 0x7f99680708a0 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.631+0000 7f996f9d6640 1 -- 172.21.15.18:0/924149876 >> 172.21.15.18:0/924149876 conn(0x7f99680b35d0 msgr2=0x7f99680b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:12.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.631+0000 7f996f9d6640 1 -- 172.21.15.18:0/924149876 shutdown_connections 2024-09-19T09:25:12.633 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.631+0000 7f996f9d6640 1 -- 172.21.15.18:0/924149876 wait complete. 2024-09-19T09:25:12.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.632+0000 7f996f9d6640 1 Processor -- start 2024-09-19T09:25:12.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.632+0000 7f996f9d6640 1 -- start start 2024-09-19T09:25:12.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.632+0000 7f996f9d6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f996806bc10 0x7f99680ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.633+0000 7f996f9d6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f996806e5b0 0x7f996815d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.633+0000 7f996f9d6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f996815ea50 0x7f99680cf300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.633+0000 7f996f9d6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f99680b12b0 con 0x7f996806bc10 2024-09-19T09:25:12.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.633+0000 7f996f9d6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f996815f260 con 0x7f996806e5b0 2024-09-19T09:25:12.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.633+0000 7f996f9d6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f996815ee30 con 0x7f996815ea50 2024-09-19T09:25:12.635 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.633+0000 7f996d772640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f996806bc10 0x7f99680ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.633+0000 7f996d772640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f996806bc10 0x7f99680ca240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39294/0 (socket says 172.21.15.18:39294) 2024-09-19T09:25:12.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.633+0000 7f996d772640 1 -- 172.21.15.18:0/2284163202 learned_addr learned my addr 172.21.15.18:0/2284163202 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:12.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.633+0000 7f996cf71640 1 --2- 172.21.15.18:0/2284163202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f996806e5b0 0x7f996815d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.633+0000 7f996df73640 1 --2- 172.21.15.18:0/2284163202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f996815ea50 0x7f99680cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.633+0000 7f996d772640 1 -- 172.21.15.18:0/2284163202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f996815ea50 msgr2=0x7f99680cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.633+0000 7f996d772640 1 --2- 172.21.15.18:0/2284163202 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f996815ea50 0x7f99680cf300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.633+0000 7f996d772640 1 -- 172.21.15.18:0/2284163202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f996806e5b0 msgr2=0x7f996815d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.633+0000 7f996d772640 1 --2- 172.21.15.18:0/2284163202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f996806e5b0 0x7f996815d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.636 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.633+0000 7f996d772640 1 -- 172.21.15.18:0/2284163202 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f996815da30 con 0x7f996806bc10 2024-09-19T09:25:12.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.633+0000 7f996d772640 1 --2- 172.21.15.18:0/2284163202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f996806bc10 0x7f99680ca240 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f9964009870 tx=0x7f99640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:12.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.633+0000 7f995dffb640 1 -- 172.21.15.18:0/2284163202 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9964037040 con 0x7f996806bc10 2024-09-19T09:25:12.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.633+0000 7f995dffb640 1 -- 172.21.15.18:0/2284163202 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9964042070 con 0x7f996806bc10 2024-09-19T09:25:12.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.633+0000 7f996f9d6640 1 -- 172.21.15.18:0/2284163202 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99680c7590 con 0x7f996806bc10 2024-09-19T09:25:12.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.633+0000 7f995dffb640 1 -- 172.21.15.18:0/2284163202 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9964030bb0 con 0x7f996806bc10 2024-09-19T09:25:12.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.634+0000 7f996f9d6640 1 -- 172.21.15.18:0/2284163202 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99680c7b50 con 0x7f996806bc10 2024-09-19T09:25:12.637 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.634+0000 7f996f9d6640 1 -- 172.21.15.18:0/2284163202 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f99680752a0 con 0x7f996806bc10 2024-09-19T09:25:12.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.635+0000 7f995dffb640 1 -- 172.21.15.18:0/2284163202 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f9964047460 con 0x7f996806bc10 2024-09-19T09:25:12.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.635+0000 7f995dffb640 1 --2- 172.21.15.18:0/2284163202 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f994c06c2e0 0x7f994c06e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.636+0000 7f995dffb640 1 -- 172.21.15.18:0/2284163202 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 4943+0+0 (secure 0 0 0) 0x7f99640abb90 con 0x7f996806bc10 2024-09-19T09:25:12.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.636+0000 7f995dffb640 1 --2- 172.21.15.18:0/2284163202 >> [v2:172.21.15.162:6808/2596207948,v1:172.21.15.162:6809/2596207948] conn(0x7f994c0721a0 0x7f994c0745c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.638 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.636+0000 7f995dffb640 1 -- 172.21.15.18:0/2284163202 --> [v2:172.21.15.162:6808/2596207948,v1:172.21.15.162:6809/2596207948] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9964001d30 con 0x7f994c0721a0 2024-09-19T09:25:12.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.636+0000 7f995dffb640 1 -- 172.21.15.18:0/2284163202 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=188) ==== 24+0+0 (secure 0 0 0) 0x7f99640ae290 con 0x7f996806bc10 2024-09-19T09:25:12.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.636+0000 7f996cf71640 1 --2- 172.21.15.18:0/2284163202 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f994c06c2e0 0x7f994c06e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.636+0000 7f996df73640 1 --2- 172.21.15.18:0/2284163202 >> [v2:172.21.15.162:6808/2596207948,v1:172.21.15.162:6809/2596207948] conn(0x7f994c0721a0 0x7f994c0745c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.636+0000 7f996cf71640 1 --2- 172.21.15.18:0/2284163202 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f994c06c2e0 0x7f994c06e7a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f99680b4150 tx=0x7f9958007e30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:12.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.636+0000 7f996df73640 1 --2- 172.21.15.18:0/2284163202 >> [v2:172.21.15.162:6808/2596207948,v1:172.21.15.162:6809/2596207948] conn(0x7f994c0721a0 0x7f994c0745c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:12.639 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.637+0000 7f995dffb640 1 -- 172.21.15.18:0/2284163202 <== osd.6 v2:172.21.15.162:6808/2596207948 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f9964001d30 con 0x7f994c0721a0 2024-09-19T09:25:12.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.648+0000 7f996f9d6640 1 -- 172.21.15.18:0/2284163202 --> [v2:172.21.15.162:6808/2596207948,v1:172.21.15.162:6809/2596207948] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f996806c080 con 0x7f994c0721a0 2024-09-19T09:25:12.649 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.649+0000 7f995dffb640 1 -- 172.21.15.18:0/2284163202 <== osd.6 v2:172.21.15.162:6808/2596207948 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7f996806c080 con 0x7f994c0721a0 2024-09-19T09:25:12.650 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:25:12.650 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-19T09:25:12.650 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:25:12.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.649+0000 7f996f9d6640 1 -- 172.21.15.18:0/2284163202 >> [v2:172.21.15.162:6808/2596207948,v1:172.21.15.162:6809/2596207948] conn(0x7f994c0721a0 msgr2=0x7f994c0745c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.649+0000 7f996f9d6640 1 --2- 172.21.15.18:0/2284163202 >> [v2:172.21.15.162:6808/2596207948,v1:172.21.15.162:6809/2596207948] conn(0x7f994c0721a0 0x7f994c0745c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.649+0000 7f996f9d6640 1 -- 172.21.15.18:0/2284163202 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f994c06c2e0 msgr2=0x7f994c06e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.649+0000 7f996f9d6640 1 --2- 172.21.15.18:0/2284163202 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f994c06c2e0 0x7f994c06e7a0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f99680b4150 tx=0x7f9958007e30 comp rx=0 tx=0).stop 2024-09-19T09:25:12.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.649+0000 7f996f9d6640 1 -- 172.21.15.18:0/2284163202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f996806bc10 msgr2=0x7f99680ca240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.649+0000 7f996f9d6640 1 --2- 172.21.15.18:0/2284163202 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f996806bc10 0x7f99680ca240 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f9964009870 tx=0x7f99640046c0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.649+0000 7f996df73640 1 -- 172.21.15.18:0/2284163202 reap_dead start 2024-09-19T09:25:12.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.649+0000 7f996f9d6640 1 -- 172.21.15.18:0/2284163202 shutdown_connections 2024-09-19T09:25:12.651 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.649+0000 7f996f9d6640 1 -- 172.21.15.18:0/2284163202 >> 172.21.15.18:0/2284163202 conn(0x7f99680b35d0 msgr2=0x7f99680d18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:12.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.649+0000 7f996f9d6640 1 -- 172.21.15.18:0/2284163202 shutdown_connections 2024-09-19T09:25:12.652 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.649+0000 7f996f9d6640 1 -- 172.21.15.18:0/2284163202 wait complete. 2024-09-19T09:25:12.661 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-19T09:25:12.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.764+0000 7f3e277d6640 1 Processor -- start 2024-09-19T09:25:12.765 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.764+0000 7f3e277d6640 1 -- start start 2024-09-19T09:25:12.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.765+0000 7f3e277d6640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3e2015eda0 0x7f3e200d5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.765+0000 7f3e277d6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e200d0480 0x7f3e200d35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.765+0000 7f3e277d6640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e200d0bf0 con 0x7f3e200d3af0 2024-09-19T09:25:12.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.765+0000 7f3e277d6640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f3e200d2880 con 0x7f3e2015eda0 2024-09-19T09:25:12.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.765+0000 7f3e277d6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3e200d3120 con 0x7f3e200d0480 2024-09-19T09:25:12.767 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.765+0000 7f3e25572640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f3e2015eda0 0x7f3e200d5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.765+0000 7f3e25d73640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f3e200d3af0 0x7f3e200d1630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49738/0 (socket says 172.21.15.18:49738) 2024-09-19T09:25:12.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.765+0000 7f3e25d73640 1 -- 172.21.15.18:0/310366096 learned_addr learned my addr 172.21.15.18:0/310366096 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:25:12.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.765+0000 7f3e24d71640 1 --2- 172.21.15.18:0/310366096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e200d0480 0x7f3e200d35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.765+0000 7f3e25572640 1 -- 172.21.15.18:0/310366096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e200d0480 msgr2=0x7f3e200d35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:12.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.765+0000 7f3e25572640 1 --2- 172.21.15.18:0/310366096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e200d0480 0x7f3e200d35b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.768 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.765+0000 7f3e25572640 1 -- 172.21.15.18:0/310366096 >> v1:172.21.15.18:6789/0 conn(0x7f3e200d3af0 legacy=0x7f3e200d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.765+0000 7f3e25572640 1 -- 172.21.15.18:0/310366096 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e200d2ad0 con 0x7f3e2015eda0 2024-09-19T09:25:12.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.766+0000 7f3e25572640 1 --2- 172.21.15.18:0/310366096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e2015eda0 0x7f3e200d5790 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0097a0 tx=0x7f3e1c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb787936d6dcfc63 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:12.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.766+0000 7f3e17fff640 1 -- 172.21.15.18:0/310366096 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c037070 con 0x7f3e2015eda0 2024-09-19T09:25:12.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.766+0000 7f3e17fff640 1 -- 172.21.15.18:0/310366096 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e1c032440 con 0x7f3e2015eda0 2024-09-19T09:25:12.769 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.766+0000 7f3e17fff640 1 -- 172.21.15.18:0/310366096 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c032810 con 0x7f3e2015eda0 2024-09-19T09:25:12.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.767+0000 7f3e277d6640 1 -- 172.21.15.18:0/310366096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e2015eda0 msgr2=0x7f3e200d5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.771 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.767+0000 7f3e277d6640 1 --2- 172.21.15.18:0/310366096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e2015eda0 0x7f3e200d5790 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0097a0 tx=0x7f3e1c02a180 comp rx=0 tx=0).stop 2024-09-19T09:25:12.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.767+0000 7f3e277d6640 1 -- 172.21.15.18:0/310366096 shutdown_connections 2024-09-19T09:25:12.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.767+0000 7f3e277d6640 1 --2- 172.21.15.18:0/310366096 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e200d0480 0x7f3e200d35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.767+0000 7f3e277d6640 1 --2- 172.21.15.18:0/310366096 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e2015eda0 0x7f3e200d5790 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.767+0000 7f3e277d6640 1 -- 172.21.15.18:0/310366096 >> 172.21.15.18:0/310366096 conn(0x7f3e2009df40 msgr2=0x7f3e200d4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:12.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.767+0000 7f3e277d6640 1 -- 172.21.15.18:0/310366096 shutdown_connections 2024-09-19T09:25:12.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.767+0000 7f3e277d6640 1 -- 172.21.15.18:0/310366096 wait complete. 2024-09-19T09:25:12.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.768+0000 7f3e277d6640 1 Processor -- start 2024-09-19T09:25:12.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.768+0000 7f3e277d6640 1 -- start start 2024-09-19T09:25:12.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.769+0000 7f3e277d6640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e200d0480 0x7f3e200c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.769+0000 7f3e277d6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e2015eda0 0x7f3e20157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.769+0000 7f3e277d6640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e200cb3a0 0x7f3e20157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.772 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.769+0000 7f3e277d6640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2015f180 con 0x7f3e200d0480 2024-09-19T09:25:12.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.769+0000 7f3e277d6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3e200d08c0 con 0x7f3e2015eda0 2024-09-19T09:25:12.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.769+0000 7f3e277d6640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f3e2015f300 con 0x7f3e200cb3a0 2024-09-19T09:25:12.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.769+0000 7f3e25572640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e200d0480 0x7f3e200c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.769+0000 7f3e25572640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e200d0480 0x7f3e200c9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39324/0 (socket says 172.21.15.18:39324) 2024-09-19T09:25:12.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.769+0000 7f3e25572640 1 -- 172.21.15.18:0/2504066255 learned_addr learned my addr 172.21.15.18:0/2504066255 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:12.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.769+0000 7f3e24d71640 1 --2- 172.21.15.18:0/2504066255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e2015eda0 0x7f3e20157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.769+0000 7f3e25d73640 1 --2- 172.21.15.18:0/2504066255 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e200cb3a0 0x7f3e20157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.769+0000 7f3e25572640 1 -- 172.21.15.18:0/2504066255 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e200cb3a0 msgr2=0x7f3e20157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.769+0000 7f3e25572640 1 --2- 172.21.15.18:0/2504066255 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e200cb3a0 0x7f3e20157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.769+0000 7f3e25572640 1 -- 172.21.15.18:0/2504066255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e2015eda0 msgr2=0x7f3e20157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.773 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.769+0000 7f3e25572640 1 --2- 172.21.15.18:0/2504066255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e2015eda0 0x7f3e20157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.769+0000 7f3e25572640 1 -- 172.21.15.18:0/2504066255 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e200ca050 con 0x7f3e200d0480 2024-09-19T09:25:12.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.769+0000 7f3e25572640 1 --2- 172.21.15.18:0/2504066255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e200d0480 0x7f3e200c9b10 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0097a0 tx=0x7f3e1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:12.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.770+0000 7f3e15ffb640 1 -- 172.21.15.18:0/2504066255 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c041070 con 0x7f3e200d0480 2024-09-19T09:25:12.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.770+0000 7f3e15ffb640 1 -- 172.21.15.18:0/2504066255 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e1c03c870 con 0x7f3e200d0480 2024-09-19T09:25:12.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.770+0000 7f3e277d6640 1 -- 172.21.15.18:0/2504066255 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e200ca300 con 0x7f3e200d0480 2024-09-19T09:25:12.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.770+0000 7f3e15ffb640 1 -- 172.21.15.18:0/2504066255 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c037040 con 0x7f3e200d0480 2024-09-19T09:25:12.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.770+0000 7f3e277d6640 1 -- 172.21.15.18:0/2504066255 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e200ca8c0 con 0x7f3e200d0480 2024-09-19T09:25:12.774 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.771+0000 7f3e277d6640 1 -- 172.21.15.18:0/2504066255 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e200d35b0 con 0x7f3e200d0480 2024-09-19T09:25:12.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.771+0000 7f3e15ffb640 1 -- 172.21.15.18:0/2504066255 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f3e1c044070 con 0x7f3e200d0480 2024-09-19T09:25:12.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.772+0000 7f3e15ffb640 1 --2- 172.21.15.18:0/2504066255 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3e0406c2b0 0x7f3e0406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:12.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.772+0000 7f3e15ffb640 1 -- 172.21.15.18:0/2504066255 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 4943+0+0 (secure 0 0 0) 0x7f3e1c0abbe0 con 0x7f3e200d0480 2024-09-19T09:25:12.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.772+0000 7f3e24d71640 1 --2- 172.21.15.18:0/2504066255 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3e0406c2b0 0x7f3e0406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:12.775 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.773+0000 7f3e24d71640 1 --2- 172.21.15.18:0/2504066255 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3e0406c2b0 0x7f3e0406e770 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f3e201f8180 tx=0x7f3e10009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:12.777 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.776+0000 7f3e15ffb640 1 -- 172.21.15.18:0/2504066255 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f3e1c07a1b0 con 0x7f3e200d0480 2024-09-19T09:25:12.952 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.951+0000 7f3e277d6640 1 -- 172.21.15.18:0/2504066255 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f3e2006cab0 con 0x7f3e0406c2b0 2024-09-19T09:25:12.953 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.952+0000 7f3e15ffb640 1 -- 172.21.15.18:0/2504066255 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3e2006cab0 con 0x7f3e0406c2b0 2024-09-19T09:25:12.953 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 6 to deep-scrub 2024-09-19T09:25:12.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.954+0000 7f3e277d6640 1 -- 172.21.15.18:0/2504066255 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3e0406c2b0 msgr2=0x7f3e0406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.954+0000 7f3e277d6640 1 --2- 172.21.15.18:0/2504066255 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3e0406c2b0 0x7f3e0406e770 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f3e201f8180 tx=0x7f3e10009190 comp rx=0 tx=0).stop 2024-09-19T09:25:12.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.954+0000 7f3e277d6640 1 -- 172.21.15.18:0/2504066255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e200d0480 msgr2=0x7f3e200c9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:12.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.954+0000 7f3e277d6640 1 --2- 172.21.15.18:0/2504066255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e200d0480 0x7f3e200c9b10 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0097a0 tx=0x7f3e1c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.954+0000 7f3e277d6640 1 -- 172.21.15.18:0/2504066255 shutdown_connections 2024-09-19T09:25:12.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.954+0000 7f3e277d6640 1 --2- 172.21.15.18:0/2504066255 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f3e0406c2b0 0x7f3e0406e770 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.954+0000 7f3e277d6640 1 --2- 172.21.15.18:0/2504066255 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f3e200cb3a0 0x7f3e20157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.954+0000 7f3e277d6640 1 --2- 172.21.15.18:0/2504066255 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3e2015eda0 0x7f3e20157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.954+0000 7f3e277d6640 1 --2- 172.21.15.18:0/2504066255 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f3e200d0480 0x7f3e200c9b10 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:12.955 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.954+0000 7f3e277d6640 1 -- 172.21.15.18:0/2504066255 >> 172.21.15.18:0/2504066255 conn(0x7f3e2009df40 msgr2=0x7f3e200b5c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:12.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.954+0000 7f3e277d6640 1 -- 172.21.15.18:0/2504066255 shutdown_connections 2024-09-19T09:25:12.956 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:12.954+0000 7f3e277d6640 1 -- 172.21.15.18:0/2504066255 wait complete. 2024-09-19T09:25:12.965 INFO:tasks.ceph:Scrubbing osd.7 2024-09-19T09:25:12.965 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-19T09:25:13.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.071+0000 7f6c2caba640 1 Processor -- start 2024-09-19T09:25:13.072 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.071+0000 7f6c2caba640 1 -- start start 2024-09-19T09:25:13.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.072+0000 7f6c2caba640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6c280ce460 0x7f6c280cfee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:13.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.072+0000 7f6c2caba640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6c280d0420 0x7f6c2806e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:13.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.072+0000 7f6c2caba640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c2815dfc0 con 0x7f6c2806eb20 2024-09-19T09:25:13.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.072+0000 7f6c2caba640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f6c2806ef70 con 0x7f6c280ce460 2024-09-19T09:25:13.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.072+0000 7f6c2caba640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6c2815d3b0 con 0x7f6c280d0420 2024-09-19T09:25:13.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.072+0000 7f6c2659c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6c280ce460 0x7f6c280cfee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:13.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.072+0000 7f6c2659c640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f6c280ce460 0x7f6c280cfee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39338/0 (socket says 172.21.15.18:39338) 2024-09-19T09:25:13.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.072+0000 7f6c2659c640 1 -- 172.21.15.18:0/3804244825 learned_addr learned my addr 172.21.15.18:0/3804244825 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:13.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.072+0000 7f6c26d9d640 1 --1- 172.21.15.18:0/3804244825 >> v1:172.21.15.18:6789/0 conn(0x7f6c2806eb20 0x7f6c281605c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49742/0 (socket says 172.21.15.18:49742) 2024-09-19T09:25:13.074 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.072+0000 7f6c25d9b640 1 --2- 172.21.15.18:0/3804244825 >> v2:172.21.15.162:3300/0 conn(0x7f6c280d0420 0x7f6c2806e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:13.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.072+0000 7f6c2659c640 1 -- 172.21.15.18:0/3804244825 >> v2:172.21.15.162:3300/0 conn(0x7f6c280d0420 msgr2=0x7f6c2806e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:13.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.072+0000 7f6c2659c640 1 --2- 172.21.15.18:0/3804244825 >> v2:172.21.15.162:3300/0 conn(0x7f6c280d0420 0x7f6c2806e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.072+0000 7f6c2659c640 1 -- 172.21.15.18:0/3804244825 >> v1:172.21.15.18:6789/0 conn(0x7f6c2806eb20 legacy=0x7f6c281605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:13.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.072+0000 7f6c2659c640 1 -- 172.21.15.18:0/3804244825 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c2815d690 con 0x7f6c280ce460 2024-09-19T09:25:13.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.072+0000 7f6c2559a640 1 -- 172.21.15.18:0/3804244825 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3058190056 0 0) 0x7f6c2815dfc0 con 0x7f6c2806eb20 2024-09-19T09:25:13.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.073+0000 7f6c2659c640 1 --2- 172.21.15.18:0/3804244825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c280ce460 0x7f6c280cfee0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f6c280b36e0 tx=0x7f6c1802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca241c1de8d6da82 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:13.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.073+0000 7f6c2559a640 1 -- 172.21.15.18:0/3804244825 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c18037070 con 0x7f6c280ce460 2024-09-19T09:25:13.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.073+0000 7f6c2559a640 1 -- 172.21.15.18:0/3804244825 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c18032440 con 0x7f6c280ce460 2024-09-19T09:25:13.075 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.073+0000 7f6c2559a640 1 -- 172.21.15.18:0/3804244825 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c18032810 con 0x7f6c280ce460 2024-09-19T09:25:13.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.074+0000 7f6c2caba640 1 -- 172.21.15.18:0/3804244825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c280ce460 msgr2=0x7f6c280cfee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:13.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.074+0000 7f6c2caba640 1 --2- 172.21.15.18:0/3804244825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c280ce460 0x7f6c280cfee0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f6c280b36e0 tx=0x7f6c1802a270 comp rx=0 tx=0).stop 2024-09-19T09:25:13.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.074+0000 7f6c2caba640 1 -- 172.21.15.18:0/3804244825 shutdown_connections 2024-09-19T09:25:13.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.074+0000 7f6c2caba640 1 --2- 172.21.15.18:0/3804244825 >> v2:172.21.15.162:3300/0 conn(0x7f6c280d0420 0x7f6c2806e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.076 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.074+0000 7f6c2caba640 1 --2- 172.21.15.18:0/3804244825 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c280ce460 0x7f6c280cfee0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.074+0000 7f6c2caba640 1 -- 172.21.15.18:0/3804244825 >> 172.21.15.18:0/3804244825 conn(0x7f6c280b26a0 msgr2=0x7f6c280b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:13.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.074+0000 7f6c2caba640 1 -- 172.21.15.18:0/3804244825 shutdown_connections 2024-09-19T09:25:13.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.074+0000 7f6c2caba640 1 -- 172.21.15.18:0/3804244825 wait complete. 2024-09-19T09:25:13.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.075+0000 7f6c2caba640 1 Processor -- start 2024-09-19T09:25:13.077 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.075+0000 7f6c2caba640 1 -- start start 2024-09-19T09:25:13.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.076+0000 7f6c2caba640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c2806eb20 0x7f6c2814c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:13.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.076+0000 7f6c2caba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c280ce460 0x7f6c281f64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:13.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.076+0000 7f6c2caba640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c280d0420 0x7f6c28151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:13.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.076+0000 7f6c2caba640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f6c280ce840 con 0x7f6c2806eb20 2024-09-19T09:25:13.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.076+0000 7f6c2caba640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2815dc50 con 0x7f6c280ce460 2024-09-19T09:25:13.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.076+0000 7f6c2caba640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f6c2815cfd0 con 0x7f6c280d0420 2024-09-19T09:25:13.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.076+0000 7f6c2659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c2806eb20 0x7f6c2814c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:13.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.076+0000 7f6c2659c640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c2806eb20 0x7f6c2814c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39350/0 (socket says 172.21.15.18:39350) 2024-09-19T09:25:13.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.076+0000 7f6c2659c640 1 -- 172.21.15.18:0/3420196813 learned_addr learned my addr 172.21.15.18:0/3420196813 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:13.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.076+0000 7f6c2659c640 1 -- 172.21.15.18:0/3420196813 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c280d0420 msgr2=0x7f6c28151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:13.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.076+0000 7f6c2659c640 1 --2- 172.21.15.18:0/3420196813 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f6c280d0420 0x7f6c28151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.079 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.076+0000 7f6c2659c640 1 -- 172.21.15.18:0/3420196813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c280ce460 msgr2=0x7f6c281f64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:13.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.076+0000 7f6c25d9b640 1 --2- 172.21.15.18:0/3420196813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c280ce460 0x7f6c281f64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:13.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.076+0000 7f6c2659c640 1 --2- 172.21.15.18:0/3420196813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c280ce460 0x7f6c281f64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.076+0000 7f6c2659c640 1 -- 172.21.15.18:0/3420196813 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c2814de10 con 0x7f6c2806eb20 2024-09-19T09:25:13.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.076+0000 7f6c25d9b640 1 --2- 172.21.15.18:0/3420196813 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c280ce460 0x7f6c281f64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:25:13.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.077+0000 7f6c2659c640 1 --2- 172.21.15.18:0/3420196813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c2806eb20 0x7f6c2814c3b0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f6c180090b0 tx=0x7f6c180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:13.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.077+0000 7f6c16ffd640 1 -- 172.21.15.18:0/3420196813 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c18037040 con 0x7f6c2806eb20 2024-09-19T09:25:13.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.077+0000 7f6c16ffd640 1 -- 172.21.15.18:0/3420196813 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c18004030 con 0x7f6c2806eb20 2024-09-19T09:25:13.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.077+0000 7f6c2caba640 1 -- 172.21.15.18:0/3420196813 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c2814e0d0 con 0x7f6c2806eb20 2024-09-19T09:25:13.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.077+0000 7f6c16ffd640 1 -- 172.21.15.18:0/3420196813 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c18004400 con 0x7f6c2806eb20 2024-09-19T09:25:13.080 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.077+0000 7f6c2caba640 1 -- 172.21.15.18:0/3420196813 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c2814e690 con 0x7f6c2806eb20 2024-09-19T09:25:13.081 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.078+0000 7f6c2caba640 1 -- 172.21.15.18:0/3420196813 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6c280cfee0 con 0x7f6c2806eb20 2024-09-19T09:25:13.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.078+0000 7f6c16ffd640 1 -- 172.21.15.18:0/3420196813 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f6c1803a070 con 0x7f6c2806eb20 2024-09-19T09:25:13.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.079+0000 7f6c16ffd640 1 --2- 172.21.15.18:0/3420196813 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6c0806c2b0 0x7f6c0806e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:13.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.079+0000 7f6c16ffd640 1 -- 172.21.15.18:0/3420196813 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 4943+0+0 (secure 0 0 0) 0x7f6c180ab6f0 con 0x7f6c2806eb20 2024-09-19T09:25:13.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.079+0000 7f6c16ffd640 1 --2- 172.21.15.18:0/3420196813 >> [v2:172.21.15.162:6816/1334618296,v1:172.21.15.162:6817/1334618296] conn(0x7f6c08072170 0x7f6c08074590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:13.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.079+0000 7f6c16ffd640 1 -- 172.21.15.18:0/3420196813 --> [v2:172.21.15.162:6816/1334618296,v1:172.21.15.162:6817/1334618296] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6c1802cea0 con 0x7f6c08072170 2024-09-19T09:25:13.082 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.079+0000 7f6c16ffd640 1 -- 172.21.15.18:0/3420196813 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_get_version_reply(handle=1 version=188) ==== 24+0+0 (secure 0 0 0) 0x7f6c180b2050 con 0x7f6c2806eb20 2024-09-19T09:25:13.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.079+0000 7f6c25d9b640 1 --2- 172.21.15.18:0/3420196813 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6c0806c2b0 0x7f6c0806e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:13.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.079+0000 7f6c26d9d640 1 --2- 172.21.15.18:0/3420196813 >> [v2:172.21.15.162:6816/1334618296,v1:172.21.15.162:6817/1334618296] conn(0x7f6c08072170 0x7f6c08074590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:13.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.080+0000 7f6c25d9b640 1 --2- 172.21.15.18:0/3420196813 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6c0806c2b0 0x7f6c0806e770 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f6c2815eb60 tx=0x7f6c1c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:13.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.080+0000 7f6c26d9d640 1 --2- 172.21.15.18:0/3420196813 >> [v2:172.21.15.162:6816/1334618296,v1:172.21.15.162:6817/1334618296] conn(0x7f6c08072170 0x7f6c08074590 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:13.083 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.080+0000 7f6c16ffd640 1 -- 172.21.15.18:0/3420196813 <== osd.7 v2:172.21.15.162:6816/1334618296 1 ==== command_reply(tid 1: 0 ) ==== 8+0+25033 (crc 0 0 0) 0x7f6c1802cea0 con 0x7f6c08072170 2024-09-19T09:25:13.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.092+0000 7f6c2caba640 1 -- 172.21.15.18:0/3420196813 --> [v2:172.21.15.162:6816/1334618296,v1:172.21.15.162:6817/1334618296] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6c280cdb60 con 0x7f6c08072170 2024-09-19T09:25:13.093 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.092+0000 7f6c16ffd640 1 -- 172.21.15.18:0/3420196813 <== osd.7 v2:172.21.15.162:6816/1334618296 2 ==== command_reply(tid 2: 0 ) ==== 8+0+565 (crc 0 0 0) 0x7f6c280cdb60 con 0x7f6c08072170 2024-09-19T09:25:13.094 INFO:teuthology.orchestra.run.smithi018.stdout:{ 2024-09-19T09:25:13.094 INFO:teuthology.orchestra.run.smithi018.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-19T09:25:13.094 INFO:teuthology.orchestra.run.smithi018.stdout:} 2024-09-19T09:25:13.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.093+0000 7f6c2caba640 1 -- 172.21.15.18:0/3420196813 >> [v2:172.21.15.162:6816/1334618296,v1:172.21.15.162:6817/1334618296] conn(0x7f6c08072170 msgr2=0x7f6c08074590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:13.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.093+0000 7f6c2caba640 1 --2- 172.21.15.18:0/3420196813 >> [v2:172.21.15.162:6816/1334618296,v1:172.21.15.162:6817/1334618296] conn(0x7f6c08072170 0x7f6c08074590 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.093+0000 7f6c2caba640 1 -- 172.21.15.18:0/3420196813 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6c0806c2b0 msgr2=0x7f6c0806e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:13.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.093+0000 7f6c2caba640 1 --2- 172.21.15.18:0/3420196813 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f6c0806c2b0 0x7f6c0806e770 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f6c2815eb60 tx=0x7f6c1c008040 comp rx=0 tx=0).stop 2024-09-19T09:25:13.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.093+0000 7f6c2caba640 1 -- 172.21.15.18:0/3420196813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c2806eb20 msgr2=0x7f6c2814c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:13.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.093+0000 7f6c2caba640 1 --2- 172.21.15.18:0/3420196813 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f6c2806eb20 0x7f6c2814c3b0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f6c180090b0 tx=0x7f6c180046c0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.093+0000 7f6c26d9d640 1 -- 172.21.15.18:0/3420196813 reap_dead start 2024-09-19T09:25:13.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.093+0000 7f6c2caba640 1 -- 172.21.15.18:0/3420196813 shutdown_connections 2024-09-19T09:25:13.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.093+0000 7f6c2caba640 1 -- 172.21.15.18:0/3420196813 >> 172.21.15.18:0/3420196813 conn(0x7f6c280b26a0 msgr2=0x7f6c2815f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:13.095 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.093+0000 7f6c2caba640 1 -- 172.21.15.18:0/3420196813 shutdown_connections 2024-09-19T09:25:13.096 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.093+0000 7f6c2caba640 1 -- 172.21.15.18:0/3420196813 wait complete. 2024-09-19T09:25:13.104 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-19T09:25:13.207 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.206+0000 7ff7c4aaf640 1 Processor -- start 2024-09-19T09:25:13.208 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.206+0000 7ff7c4aaf640 1 -- start start 2024-09-19T09:25:13.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.207+0000 7ff7c4aaf640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff7c015d1b0 0x7ff7c015d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:13.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.207+0000 7ff7c4aaf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7c00b1b80 0x7ff7c00d0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:13.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.207+0000 7ff7c4aaf640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7c00cd560 con 0x7ff7c00d0b60 2024-09-19T09:25:13.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.207+0000 7ff7c4aaf640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff7c015d000 con 0x7ff7c015d1b0 2024-09-19T09:25:13.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.207+0000 7ff7c4aaf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff7c00cdb70 con 0x7ff7c00b1b80 2024-09-19T09:25:13.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.207+0000 7ff7bed9d640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7ff7c00d0b60 0x7ff7c00ce000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49746/0 (socket says 172.21.15.18:49746) 2024-09-19T09:25:13.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.207+0000 7ff7bed9d640 1 -- 172.21.15.18:0/3582976922 learned_addr learned my addr 172.21.15.18:0/3582976922 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:25:13.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.208+0000 7ff7bdd9b640 1 --2- 172.21.15.18:0/3582976922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7c00b1b80 0x7ff7c00d0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:13.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.208+0000 7ff7be59c640 1 --2- 172.21.15.18:0/3582976922 >> v2:172.21.15.162:3300/0 conn(0x7ff7c015d1b0 0x7ff7c015d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:13.212 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.208+0000 7ff7bd59a640 1 -- 172.21.15.18:0/3582976922 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1925464495 0 0) 0x7ff7c00cd560 con 0x7ff7c00d0b60 2024-09-19T09:25:13.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.208+0000 7ff7bd59a640 1 -- 172.21.15.18:0/3582976922 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7a8003520 con 0x7ff7c00d0b60 2024-09-19T09:25:13.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.208+0000 7ff7bd59a640 1 -- 172.21.15.18:0/3582976922 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2067587869 0 0) 0x7ff7a8003520 con 0x7ff7c00d0b60 2024-09-19T09:25:13.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.208+0000 7ff7bd59a640 1 -- 172.21.15.18:0/3582976922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7c00b1b80 msgr2=0x7ff7c00d0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:13.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.208+0000 7ff7bd59a640 1 --2- 172.21.15.18:0/3582976922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7c00b1b80 0x7ff7c00d0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.208+0000 7ff7bd59a640 1 -- 172.21.15.18:0/3582976922 >> v2:172.21.15.162:3300/0 conn(0x7ff7c015d1b0 msgr2=0x7ff7c015d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:13.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.208+0000 7ff7bd59a640 1 --2- 172.21.15.18:0/3582976922 >> v2:172.21.15.162:3300/0 conn(0x7ff7c015d1b0 0x7ff7c015d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.208+0000 7ff7bd59a640 1 -- 172.21.15.18:0/3582976922 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c015dad0 con 0x7ff7c00d0b60 2024-09-19T09:25:13.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.208+0000 7ff7bd59a640 1 -- 172.21.15.18:0/3582976922 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7ff7b8001670 con 0x7ff7c00d0b60 2024-09-19T09:25:13.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.208+0000 7ff7bd59a640 1 -- 172.21.15.18:0/3582976922 >> v1:172.21.15.18:6789/0 conn(0x7ff7c00d0b60 legacy=0x7ff7c00ce000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:13.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.208+0000 7ff7bd59a640 1 --2- 172.21.15.18:0/3582976922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7a80039b0 0x7ff7a8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:13.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.208+0000 7ff7bd59a640 1 --2- 172.21.15.18:0/3582976922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7c00b1b80 0x7ff7a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:13.213 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.208+0000 7ff7bd59a640 1 --2- 172.21.15.18:0/3582976922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7a8004d40 0x7ff7a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:13.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.208+0000 7ff7bd59a640 1 -- 172.21.15.18:0/3582976922 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c015d000 con 0x7ff7a8004d40 2024-09-19T09:25:13.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.208+0000 7ff7bd59a640 1 -- 172.21.15.18:0/3582976922 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c00cdb70 con 0x7ff7a80039b0 2024-09-19T09:25:13.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.208+0000 7ff7bd59a640 1 -- 172.21.15.18:0/3582976922 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff7a800b9c0 con 0x7ff7c00b1b80 2024-09-19T09:25:13.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.208+0000 7ff7be59c640 1 --2- 172.21.15.18:0/3582976922 >> v2:172.21.15.162:3300/0 conn(0x7ff7c015d1b0 0x7ff7c015d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:25:13.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.208+0000 7ff7bed9d640 1 --2- 172.21.15.18:0/3582976922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7a8004d40 0x7ff7a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:13.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.208+0000 7ff7bdd9b640 1 --2- 172.21.15.18:0/3582976922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7c00b1b80 0x7ff7a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:13.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.208+0000 7ff7be59c640 1 --2- 172.21.15.18:0/3582976922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7a80039b0 0x7ff7a8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:13.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.209+0000 7ff7bed9d640 1 -- 172.21.15.18:0/3582976922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7c00b1b80 msgr2=0x7ff7a8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:13.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.209+0000 7ff7bed9d640 1 --2- 172.21.15.18:0/3582976922 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7c00b1b80 0x7ff7a8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.209+0000 7ff7bed9d640 1 -- 172.21.15.18:0/3582976922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7a80039b0 msgr2=0x7ff7a8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:13.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.209+0000 7ff7bed9d640 1 --2- 172.21.15.18:0/3582976922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7a80039b0 0x7ff7a8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.214 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.209+0000 7ff7bed9d640 1 -- 172.21.15.18:0/3582976922 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7a8003520 con 0x7ff7a8004d40 2024-09-19T09:25:13.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.209+0000 7ff7bed9d640 1 --2- 172.21.15.18:0/3582976922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7a8004d40 0x7ff7a80051c0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8001050 tx=0x7ff7a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dfe553fb1257974 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:13.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.209+0000 7ff7bd59a640 1 -- 172.21.15.18:0/3582976922 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b802e070 con 0x7ff7a8004d40 2024-09-19T09:25:13.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.210+0000 7ff7bd59a640 1 -- 172.21.15.18:0/3582976922 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b8005af0 con 0x7ff7a8004d40 2024-09-19T09:25:13.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.210+0000 7ff7bd59a640 1 -- 172.21.15.18:0/3582976922 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8007d70 con 0x7ff7a8004d40 2024-09-19T09:25:13.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.210+0000 7ff7c4aaf640 1 -- 172.21.15.18:0/3582976922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7a8004d40 msgr2=0x7ff7a80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:13.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.210+0000 7ff7c4aaf640 1 --2- 172.21.15.18:0/3582976922 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7a8004d40 0x7ff7a80051c0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8001050 tx=0x7ff7a8005830 comp rx=0 tx=0).stop 2024-09-19T09:25:13.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.210+0000 7ff7bed9d640 1 -- 172.21.15.18:0/3582976922 reap_dead start 2024-09-19T09:25:13.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.210+0000 7ff7c4aaf640 1 -- 172.21.15.18:0/3582976922 shutdown_connections 2024-09-19T09:25:13.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.210+0000 7ff7c4aaf640 1 -- 172.21.15.18:0/3582976922 >> 172.21.15.18:0/3582976922 conn(0x7ff7c00b4560 msgr2=0x7ff7c00b4970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:13.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.210+0000 7ff7c4aaf640 1 -- 172.21.15.18:0/3582976922 shutdown_connections 2024-09-19T09:25:13.215 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.210+0000 7ff7c4aaf640 1 -- 172.21.15.18:0/3582976922 wait complete. 2024-09-19T09:25:13.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.211+0000 7ff7c4aaf640 1 Processor -- start 2024-09-19T09:25:13.218 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.212+0000 7ff7c4aaf640 1 -- start start 2024-09-19T09:25:13.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.212+0000 7ff7c4aaf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7a8004d40 0x7ff7c0159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:13.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.212+0000 7ff7c4aaf640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7c015b700 0x7ff7c00b7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:13.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.212+0000 7ff7c4aaf640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7c015f2f0 0x7ff7c015f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:13.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.212+0000 7ff7c4aaf640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c00d0030 con 0x7ff7c015f2f0 2024-09-19T09:25:13.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.212+0000 7ff7c4aaf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff7c00cfd50 con 0x7ff7a8004d40 2024-09-19T09:25:13.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.212+0000 7ff7c4aaf640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff7c00cd800 con 0x7ff7c015b700 2024-09-19T09:25:13.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.212+0000 7ff7bed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7c015f2f0 0x7ff7c015f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:13.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.212+0000 7ff7bed9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7c015f2f0 0x7ff7c015f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39372/0 (socket says 172.21.15.18:39372) 2024-09-19T09:25:13.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.212+0000 7ff7bed9d640 1 -- 172.21.15.18:0/1021114052 learned_addr learned my addr 172.21.15.18:0/1021114052 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:13.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.213+0000 7ff7bdd9b640 1 --2- 172.21.15.18:0/1021114052 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7c015b700 0x7ff7c00b7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:13.219 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.213+0000 7ff7be59c640 1 --2- 172.21.15.18:0/1021114052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7a8004d40 0x7ff7c0159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:13.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.213+0000 7ff7bed9d640 1 -- 172.21.15.18:0/1021114052 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7c015b700 msgr2=0x7ff7c00b7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:13.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.213+0000 7ff7bed9d640 1 --2- 172.21.15.18:0/1021114052 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7c015b700 0x7ff7c00b7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.213+0000 7ff7bed9d640 1 -- 172.21.15.18:0/1021114052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7a8004d40 msgr2=0x7ff7c0159070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:13.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.213+0000 7ff7bed9d640 1 --2- 172.21.15.18:0/1021114052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7a8004d40 0x7ff7c0159070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.213+0000 7ff7bed9d640 1 -- 172.21.15.18:0/1021114052 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7c0159810 con 0x7ff7c015f2f0 2024-09-19T09:25:13.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.213+0000 7ff7be59c640 1 --2- 172.21.15.18:0/1021114052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7a8004d40 0x7ff7c0159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:25:13.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.213+0000 7ff7bdd9b640 1 --2- 172.21.15.18:0/1021114052 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7c015b700 0x7ff7c00b7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:25:13.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.213+0000 7ff7bed9d640 1 --2- 172.21.15.18:0/1021114052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7c015f2f0 0x7ff7c015f7a0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8034040 tx=0x7ff7b8000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:13.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.213+0000 7ff7aeffd640 1 -- 172.21.15.18:0/1021114052 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8007d50 con 0x7ff7c015f2f0 2024-09-19T09:25:13.220 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.213+0000 7ff7aeffd640 1 -- 172.21.15.18:0/1021114052 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7b8043070 con 0x7ff7c015f2f0 2024-09-19T09:25:13.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.213+0000 7ff7c4aaf640 1 -- 172.21.15.18:0/1021114052 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7c0159af0 con 0x7ff7c015f2f0 2024-09-19T09:25:13.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.213+0000 7ff7aeffd640 1 -- 172.21.15.18:0/1021114052 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8007070 con 0x7ff7c015f2f0 2024-09-19T09:25:13.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.213+0000 7ff7c4aaf640 1 -- 172.21.15.18:0/1021114052 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7c015a0b0 con 0x7ff7c015f2f0 2024-09-19T09:25:13.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.214+0000 7ff7c4aaf640 1 -- 172.21.15.18:0/1021114052 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7c00cf9e0 con 0x7ff7c015f2f0 2024-09-19T09:25:13.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.215+0000 7ff7aeffd640 1 -- 172.21.15.18:0/1021114052 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff7b8007210 con 0x7ff7c015f2f0 2024-09-19T09:25:13.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.215+0000 7ff7aeffd640 1 --2- 172.21.15.18:0/1021114052 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff7a006c2e0 0x7ff7a006e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:13.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.215+0000 7ff7aeffd640 1 -- 172.21.15.18:0/1021114052 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 4943+0+0 (secure 0 0 0) 0x7ff7b80ab5f0 con 0x7ff7c015f2f0 2024-09-19T09:25:13.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.216+0000 7ff7be59c640 1 --2- 172.21.15.18:0/1021114052 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff7a006c2e0 0x7ff7a006e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:13.221 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.216+0000 7ff7be59c640 1 --2- 172.21.15.18:0/1021114052 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff7a006c2e0 0x7ff7a006e7a0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0007560 tx=0x7ff7b000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:13.222 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.220+0000 7ff7aeffd640 1 -- 172.21.15.18:0/1021114052 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff7b807a060 con 0x7ff7c015f2f0 2024-09-19T09:25:13.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.395+0000 7ff7c4aaf640 1 -- 172.21.15.18:0/1021114052 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7ff7c00686d0 con 0x7ff7a006c2e0 2024-09-19T09:25:13.396 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.395+0000 7ff7aeffd640 1 -- 172.21.15.18:0/1021114052 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff7c00686d0 con 0x7ff7a006c2e0 2024-09-19T09:25:13.396 INFO:teuthology.orchestra.run.smithi018.stderr:instructed osd(s) 7 to deep-scrub 2024-09-19T09:25:13.398 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.397+0000 7ff7c4aaf640 1 -- 172.21.15.18:0/1021114052 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff7a006c2e0 msgr2=0x7ff7a006e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:13.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.397+0000 7ff7c4aaf640 1 --2- 172.21.15.18:0/1021114052 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff7a006c2e0 0x7ff7a006e7a0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7ff7b0007560 tx=0x7ff7b000b040 comp rx=0 tx=0).stop 2024-09-19T09:25:13.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.397+0000 7ff7c4aaf640 1 -- 172.21.15.18:0/1021114052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7c015f2f0 msgr2=0x7ff7c015f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:13.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.397+0000 7ff7c4aaf640 1 --2- 172.21.15.18:0/1021114052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7c015f2f0 0x7ff7c015f7a0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8034040 tx=0x7ff7b8000fe0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.397+0000 7ff7c4aaf640 1 -- 172.21.15.18:0/1021114052 shutdown_connections 2024-09-19T09:25:13.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.397+0000 7ff7c4aaf640 1 --2- 172.21.15.18:0/1021114052 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff7a006c2e0 0x7ff7a006e7a0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.397+0000 7ff7c4aaf640 1 --2- 172.21.15.18:0/1021114052 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff7c015f2f0 0x7ff7c015f7a0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.397+0000 7ff7c4aaf640 1 --2- 172.21.15.18:0/1021114052 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff7c015b700 0x7ff7c00b7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.397+0000 7ff7c4aaf640 1 --2- 172.21.15.18:0/1021114052 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff7a8004d40 0x7ff7c0159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.397+0000 7ff7c4aaf640 1 -- 172.21.15.18:0/1021114052 >> 172.21.15.18:0/1021114052 conn(0x7ff7c00b4560 msgr2=0x7ff7c00d2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:13.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.397+0000 7ff7c4aaf640 1 -- 172.21.15.18:0/1021114052 shutdown_connections 2024-09-19T09:25:13.399 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.397+0000 7ff7c4aaf640 1 -- 172.21.15.18:0/1021114052 wait complete. 2024-09-19T09:25:13.409 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T09:25:13.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.510+0000 7f69e90d0640 1 Processor -- start 2024-09-19T09:25:13.511 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.510+0000 7f69e90d0640 1 -- start start 2024-09-19T09:25:13.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.511+0000 7f69e90d0640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f69e415ef50 0x7f69e40d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:13.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.511+0000 7f69e90d0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69e40d3240 0x7f69e40d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:13.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.511+0000 7f69e90d0640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69e40b7a90 con 0x7f69e40d5780 2024-09-19T09:25:13.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.511+0000 7f69e90d0640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f69e40d3740 con 0x7f69e415ef50 2024-09-19T09:25:13.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.511+0000 7f69e90d0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f69e40d3a20 con 0x7f69e40d3240 2024-09-19T09:25:13.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.511+0000 7f69e359e640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f69e40d5780 0x7f69e40cf770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49758/0 (socket says 172.21.15.18:49758) 2024-09-19T09:25:13.515 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.511+0000 7f69e359e640 1 -- 172.21.15.18:0/2524203220 learned_addr learned my addr 172.21.15.18:0/2524203220 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:25:13.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.511+0000 7f69e2d9d640 1 --2- 172.21.15.18:0/2524203220 >> v2:172.21.15.162:3300/0 conn(0x7f69e415ef50 0x7f69e40d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:13.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.511+0000 7f69e259c640 1 --2- 172.21.15.18:0/2524203220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69e40d3240 0x7f69e40d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:13.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.511+0000 7f69e1d9b640 1 -- 172.21.15.18:0/2524203220 <== mon.0 v1:172.21.15.18:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2900872448 0 0) 0x7f69e40b7a90 con 0x7f69e40d5780 2024-09-19T09:25:13.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.512+0000 7f69e1d9b640 1 -- 172.21.15.18:0/2524203220 --> v1:172.21.15.18:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69d0003520 con 0x7f69e40d5780 2024-09-19T09:25:13.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.512+0000 7f69e1d9b640 1 -- 172.21.15.18:0/2524203220 <== mon.0 v1:172.21.15.18:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1316141590 0 0) 0x7f69d0003520 con 0x7f69e40d5780 2024-09-19T09:25:13.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.512+0000 7f69e1d9b640 1 -- 172.21.15.18:0/2524203220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69e40d3240 msgr2=0x7f69e40d18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:13.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.512+0000 7f69e1d9b640 1 --2- 172.21.15.18:0/2524203220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69e40d3240 0x7f69e40d18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.512+0000 7f69e1d9b640 1 -- 172.21.15.18:0/2524203220 >> v2:172.21.15.162:3300/0 conn(0x7f69e415ef50 msgr2=0x7f69e40d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:13.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.512+0000 7f69e1d9b640 1 --2- 172.21.15.18:0/2524203220 >> v2:172.21.15.162:3300/0 conn(0x7f69e415ef50 0x7f69e40d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.512+0000 7f69e1d9b640 1 -- 172.21.15.18:0/2524203220 --> v1:172.21.15.18:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e40b7d00 con 0x7f69e40d5780 2024-09-19T09:25:13.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.512+0000 7f69e1d9b640 1 -- 172.21.15.18:0/2524203220 <== mon.0 v1:172.21.15.18:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3527473046 0 0) 0x7f69d40019f0 con 0x7f69e40d5780 2024-09-19T09:25:13.516 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.512+0000 7f69e1d9b640 1 -- 172.21.15.18:0/2524203220 >> v1:172.21.15.18:6789/0 conn(0x7f69e40d5780 legacy=0x7f69e40cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:13.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.512+0000 7f69e1d9b640 1 --2- 172.21.15.18:0/2524203220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69d00039b0 0x7f69d0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:13.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.512+0000 7f69e1d9b640 1 --2- 172.21.15.18:0/2524203220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69d0004800 0x7f69d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:13.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.512+0000 7f69e1d9b640 1 --2- 172.21.15.18:0/2524203220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69e40d3240 0x7f69d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:13.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.512+0000 7f69e1d9b640 1 -- 172.21.15.18:0/2524203220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f69e40d3740 con 0x7f69d00039b0 2024-09-19T09:25:13.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.512+0000 7f69e1d9b640 1 -- 172.21.15.18:0/2524203220 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f69e40d3a20 con 0x7f69d0004800 2024-09-19T09:25:13.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.512+0000 7f69e1d9b640 1 -- 172.21.15.18:0/2524203220 --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f69d000b9c0 con 0x7f69e40d3240 2024-09-19T09:25:13.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.512+0000 7f69e2d9d640 1 --2- 172.21.15.18:0/2524203220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69d00039b0 0x7f69d0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:13.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.512+0000 7f69e259c640 1 --2- 172.21.15.18:0/2524203220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69d0004800 0x7f69d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:13.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.512+0000 7f69e359e640 1 --2- 172.21.15.18:0/2524203220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69e40d3240 0x7f69d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:13.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.512+0000 7f69e2d9d640 1 -- 172.21.15.18:0/2524203220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69e40d3240 msgr2=0x7f69d00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:13.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.512+0000 7f69e2d9d640 1 --2- 172.21.15.18:0/2524203220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69e40d3240 0x7f69d00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.517 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.512+0000 7f69e2d9d640 1 -- 172.21.15.18:0/2524203220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69d0004800 msgr2=0x7f69d0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:13.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.512+0000 7f69e2d9d640 1 --2- 172.21.15.18:0/2524203220 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69d0004800 0x7f69d0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.512+0000 7f69e2d9d640 1 -- 172.21.15.18:0/2524203220 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69d0003520 con 0x7f69d00039b0 2024-09-19T09:25:13.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.512+0000 7f69e359e640 1 --2- 172.21.15.18:0/2524203220 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69e40d3240 0x7f69d00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:13.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.513+0000 7f69e2d9d640 1 --2- 172.21.15.18:0/2524203220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69d00039b0 0x7f69d0003dd0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009af0 tx=0x7f69d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e4262bbd7b93cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:13.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.513+0000 7f69e1d9b640 1 -- 172.21.15.18:0/2524203220 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc036070 con 0x7f69d00039b0 2024-09-19T09:25:13.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.513+0000 7f69e1d9b640 1 -- 172.21.15.18:0/2524203220 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69dc031400 con 0x7f69d00039b0 2024-09-19T09:25:13.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.513+0000 7f69e1d9b640 1 -- 172.21.15.18:0/2524203220 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc009690 con 0x7f69d00039b0 2024-09-19T09:25:13.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.514+0000 7f69e90d0640 1 -- 172.21.15.18:0/2524203220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69d00039b0 msgr2=0x7f69d0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:13.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.514+0000 7f69e90d0640 1 --2- 172.21.15.18:0/2524203220 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69d00039b0 0x7f69d0003dd0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009af0 tx=0x7f69d0005830 comp rx=0 tx=0).stop 2024-09-19T09:25:13.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.514+0000 7f69e359e640 1 -- 172.21.15.18:0/2524203220 reap_dead start 2024-09-19T09:25:13.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.514+0000 7f69e90d0640 1 -- 172.21.15.18:0/2524203220 shutdown_connections 2024-09-19T09:25:13.518 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.514+0000 7f69e90d0640 1 -- 172.21.15.18:0/2524203220 >> 172.21.15.18:0/2524203220 conn(0x7f69e40d4c60 msgr2=0x7f69e40d5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:13.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.514+0000 7f69e90d0640 1 -- 172.21.15.18:0/2524203220 shutdown_connections 2024-09-19T09:25:13.519 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.514+0000 7f69e90d0640 1 -- 172.21.15.18:0/2524203220 wait complete. 2024-09-19T09:25:13.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.515+0000 7f69e90d0640 1 Processor -- start 2024-09-19T09:25:13.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.515+0000 7f69e90d0640 1 -- start start 2024-09-19T09:25:13.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.516+0000 7f69e90d0640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69d00039b0 0x7f69e414ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:13.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.516+0000 7f69e90d0640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69e40ca3e0 0x7f69e40ca840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:13.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.516+0000 7f69e90d0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69e414e220 0x7f69e414e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:13.521 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.516+0000 7f69e90d0640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f69e40d21a0 con 0x7f69d00039b0 2024-09-19T09:25:13.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.516+0000 7f69e90d0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f69e40d2020 con 0x7f69e414e220 2024-09-19T09:25:13.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.516+0000 7f69e90d0640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f69e40b9510 con 0x7f69e40ca3e0 2024-09-19T09:25:13.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.516+0000 7f69e2d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69d00039b0 0x7f69e414ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:13.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.516+0000 7f69e2d9d640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69d00039b0 0x7f69e414ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39382/0 (socket says 172.21.15.18:39382) 2024-09-19T09:25:13.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.516+0000 7f69e2d9d640 1 -- 172.21.15.18:0/1622135781 learned_addr learned my addr 172.21.15.18:0/1622135781 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:13.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.516+0000 7f69e2d9d640 1 -- 172.21.15.18:0/1622135781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69e40ca3e0 msgr2=0x7f69e40ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:13.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.516+0000 7f69e2d9d640 1 --2- 172.21.15.18:0/1622135781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69e40ca3e0 0x7f69e40ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.516+0000 7f69e2d9d640 1 -- 172.21.15.18:0/1622135781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69e414e220 msgr2=0x7f69e414e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:13.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.516+0000 7f69e359e640 1 --2- 172.21.15.18:0/1622135781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69e414e220 0x7f69e414e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:13.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.516+0000 7f69e2d9d640 1 --2- 172.21.15.18:0/1622135781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69e414e220 0x7f69e414e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.516+0000 7f69e2d9d640 1 -- 172.21.15.18:0/1622135781 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e40cb110 con 0x7f69d00039b0 2024-09-19T09:25:13.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.517+0000 7f69e2d9d640 1 --2- 172.21.15.18:0/1622135781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69d00039b0 0x7f69e414ff50 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009c10 tx=0x7f69dc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:13.522 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.517+0000 7f69db7fe640 1 -- 172.21.15.18:0/1622135781 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc041020 con 0x7f69d00039b0 2024-09-19T09:25:13.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.517+0000 7f69db7fe640 1 -- 172.21.15.18:0/1622135781 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69dc02ade0 con 0x7f69d00039b0 2024-09-19T09:25:13.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.517+0000 7f69e90d0640 1 -- 172.21.15.18:0/1622135781 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69e40cb3f0 con 0x7f69d00039b0 2024-09-19T09:25:13.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.517+0000 7f69db7fe640 1 -- 172.21.15.18:0/1622135781 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69dc036040 con 0x7f69d00039b0 2024-09-19T09:25:13.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.517+0000 7f69e90d0640 1 -- 172.21.15.18:0/1622135781 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69e40cad80 con 0x7f69d00039b0 2024-09-19T09:25:13.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.518+0000 7f69e90d0640 1 -- 172.21.15.18:0/1622135781 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69e4158770 con 0x7f69d00039b0 2024-09-19T09:25:13.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.518+0000 7f69db7fe640 1 -- 172.21.15.18:0/1622135781 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f69dc044020 con 0x7f69d00039b0 2024-09-19T09:25:13.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.519+0000 7f69db7fe640 1 --2- 172.21.15.18:0/1622135781 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f69c406c2b0 0x7f69c406e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:13.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.519+0000 7f69db7fe640 1 -- 172.21.15.18:0/1622135781 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 4943+0+0 (secure 0 0 0) 0x7f69dc0ab6d0 con 0x7f69d00039b0 2024-09-19T09:25:13.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.519+0000 7f69e259c640 1 --2- 172.21.15.18:0/1622135781 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f69c406c2b0 0x7f69c406e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:13.523 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.519+0000 7f69e259c640 1 --2- 172.21.15.18:0/1622135781 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f69c406c2b0 0x7f69c406e770 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f69e40ba280 tx=0x7f69cc0095d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:13.524 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.523+0000 7f69db7fe640 1 -- 172.21.15.18:0/1622135781 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f69e4158770 con 0x7f69d00039b0 2024-09-19T09:25:13.695 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.695+0000 7f69e90d0640 1 -- 172.21.15.18:0/1622135781 --> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f69e40d13a0 con 0x7f69c406c2b0 2024-09-19T09:25:13.696 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.696+0000 7f69db7fe640 1 -- 172.21.15.18:0/1622135781 <== mgr.4105 v2:172.21.15.162:6832/2027634341 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12592 (secure 0 0 0) 0x7f69e40d13a0 con 0x7f69c406c2b0 2024-09-19T09:25:13.697 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:25:13.697 INFO:teuthology.orchestra.run.smithi018.stderr:dumped all 2024-09-19T09:25:13.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.698+0000 7f69e90d0640 1 -- 172.21.15.18:0/1622135781 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f69c406c2b0 msgr2=0x7f69c406e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:13.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.698+0000 7f69e90d0640 1 --2- 172.21.15.18:0/1622135781 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f69c406c2b0 0x7f69c406e770 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f69e40ba280 tx=0x7f69cc0095d0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.698+0000 7f69e90d0640 1 -- 172.21.15.18:0/1622135781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69d00039b0 msgr2=0x7f69e414ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:13.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.698+0000 7f69e90d0640 1 --2- 172.21.15.18:0/1622135781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69d00039b0 0x7f69e414ff50 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009c10 tx=0x7f69dc004730 comp rx=0 tx=0).stop 2024-09-19T09:25:13.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.698+0000 7f69e90d0640 1 -- 172.21.15.18:0/1622135781 shutdown_connections 2024-09-19T09:25:13.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.698+0000 7f69e90d0640 1 --2- 172.21.15.18:0/1622135781 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f69c406c2b0 0x7f69c406e770 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.699 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.698+0000 7f69e90d0640 1 --2- 172.21.15.18:0/1622135781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f69e414e220 0x7f69e414e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.698+0000 7f69e90d0640 1 --2- 172.21.15.18:0/1622135781 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f69e40ca3e0 0x7f69e40ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.698+0000 7f69e90d0640 1 --2- 172.21.15.18:0/1622135781 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f69d00039b0 0x7f69e414ff50 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.698+0000 7f69e90d0640 1 -- 172.21.15.18:0/1622135781 >> 172.21.15.18:0/1622135781 conn(0x7f69e40d4c60 msgr2=0x7f69e406cc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:13.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.698+0000 7f69e90d0640 1 -- 172.21.15.18:0/1622135781 shutdown_connections 2024-09-19T09:25:13.700 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.698+0000 7f69e90d0640 1 -- 172.21.15.18:0/1622135781 wait complete. 2024-09-19T09:25:13.710 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":537,"stamp":"2024-09-19T09:25:11.697280+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9427,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553072,"statfs":{"total":1600000000,"available":1590346504,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52491451,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-2,"num_read_kb":-2,"num_write":-132,"num_write_kb":-85088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001728"},"pg_stats":[{"pgid":"1.0","version":"188'119","reported_seq":509,"reported_epoch":188,"state":"active+clean","last_fresh":"2024-09-19T09:25:10.874082+0000","last_change":"2024-09-19T09:25:10.874107+0000","last_active":"2024-09-19T09:25:10.874082+0000","last_peered":"2024-09-19T09:25:10.874082+0000","last_clean":"2024-09-19T09:25:10.874082+0000","last_became_active":"2024-09-19T09:13:19.454039+0000","last_became_peered":"2024-09-19T09:13:19.454039+0000","last_unstale":"2024-09-19T09:25:10.874082+0000","last_undegraded":"2024-09-19T09:25:10.874082+0000","last_fullsized":"2024-09-19T09:25:10.874082+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"188'119","last_scrub_stamp":"2024-09-19T09:25:10.874041+0000","last_deep_scrub":"188'119","last_deep_scrub_stamp":"2024-09-19T09:25:10.874041+0000","last_clean_scrub_stamp":"2024-09-19T09:25:10.874041+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:38.305858+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1034,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194278,"statfs":{"total":200000000,"available":198940905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1034,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194278,"statfs":{"total":200000000,"available":198940905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574993,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1610,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193701,"statfs":{"total":200000000,"available":198350537,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1034,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194278,"statfs":{"total":200000000,"available":198940905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1034,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194278,"statfs":{"total":200000000,"available":198940905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1034,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194278,"statfs":{"total":200000000,"available":198940905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574993,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1610,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193701,"statfs":{"total":200000000,"available":198350537,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1034,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194278,"statfs":{"total":200000000,"available":198940905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[]}} 2024-09-19T09:25:13.714 DEBUG:teuthology.orchestra.run.smithi018:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-19T09:25:13.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.816+0000 7f0816181640 1 Processor -- start 2024-09-19T09:25:13.817 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.816+0000 7f0816181640 1 -- start start 2024-09-19T09:25:13.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.816+0000 7f0816181640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f081006f7e0 0x7f081006fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:13.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.816+0000 7f0816181640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f08100afd30 0x7f081015f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:13.820 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.817+0000 7f0816181640 1 -- --> v1:172.21.15.18:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0810070100 con 0x7f08100af8d0 2024-09-19T09:25:13.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.817+0000 7f0816181640 1 -- --> v2:172.21.15.18:3300/0 -- mon_getmap magic: 0 -- 0x7f08100b6f20 con 0x7f08100afd30 2024-09-19T09:25:13.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.817+0000 7f0816181640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f081015fef0 con 0x7f081006f7e0 2024-09-19T09:25:13.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.817+0000 7f080ffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f08100afd30 0x7f081015f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:13.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.817+0000 7f080effd640 1 --1- >> v1:172.21.15.18:6789/0 conn(0x7f08100af8d0 0x7f08100b73b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.18:6789/0 says I am v1:172.21.15.18:49766/0 (socket says 172.21.15.18:49766) 2024-09-19T09:25:13.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.817+0000 7f080ffff640 1 --2- >> v2:172.21.15.18:3300/0 conn(0x7f08100afd30 0x7f081015f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39392/0 (socket says 172.21.15.18:39392) 2024-09-19T09:25:13.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.817+0000 7f080effd640 1 -- 172.21.15.18:0/3021519387 learned_addr learned my addr 172.21.15.18:0/3021519387 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:25:13.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.817+0000 7f080f7fe640 1 --2- 172.21.15.18:0/3021519387 >> v2:172.21.15.162:3300/0 conn(0x7f081006f7e0 0x7f081006fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:13.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.817+0000 7f080ffff640 1 -- 172.21.15.18:0/3021519387 >> v2:172.21.15.162:3300/0 conn(0x7f081006f7e0 msgr2=0x7f081006fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:13.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.817+0000 7f080ffff640 1 --2- 172.21.15.18:0/3021519387 >> v2:172.21.15.162:3300/0 conn(0x7f081006f7e0 0x7f081006fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.817+0000 7f080ffff640 1 -- 172.21.15.18:0/3021519387 >> v1:172.21.15.18:6789/0 conn(0x7f08100af8d0 legacy=0x7f08100b73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:13.821 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.817+0000 7f080ffff640 1 -- 172.21.15.18:0/3021519387 --> v2:172.21.15.18:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08100b68d0 con 0x7f08100afd30 2024-09-19T09:25:13.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.818+0000 7f080ffff640 1 --2- 172.21.15.18:0/3021519387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08100afd30 0x7f081015f170 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f0810069930 tx=0x7f080802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84571ce954fbe9a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:13.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.818+0000 7f080e7fc640 1 -- 172.21.15.18:0/3021519387 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0808007740 con 0x7f08100afd30 2024-09-19T09:25:13.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.818+0000 7f080e7fc640 1 -- 172.21.15.18:0/3021519387 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08080078e0 con 0x7f08100afd30 2024-09-19T09:25:13.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.818+0000 7f080e7fc640 1 -- 172.21.15.18:0/3021519387 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0808007cb0 con 0x7f08100afd30 2024-09-19T09:25:13.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.818+0000 7f0816181640 1 -- 172.21.15.18:0/3021519387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08100afd30 msgr2=0x7f081015f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:13.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.818+0000 7f0816181640 1 --2- 172.21.15.18:0/3021519387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08100afd30 0x7f081015f170 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f0810069930 tx=0x7f080802a680 comp rx=0 tx=0).stop 2024-09-19T09:25:13.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.818+0000 7f0816181640 1 -- 172.21.15.18:0/3021519387 shutdown_connections 2024-09-19T09:25:13.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.818+0000 7f0816181640 1 --2- 172.21.15.18:0/3021519387 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08100afd30 0x7f081015f170 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.818+0000 7f0816181640 1 --2- 172.21.15.18:0/3021519387 >> v2:172.21.15.162:3300/0 conn(0x7f081006f7e0 0x7f081006fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.818+0000 7f0816181640 1 -- 172.21.15.18:0/3021519387 >> 172.21.15.18:0/3021519387 conn(0x7f0810073c80 msgr2=0x7f081009b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:13.822 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.818+0000 7f0816181640 1 -- 172.21.15.18:0/3021519387 shutdown_connections 2024-09-19T09:25:13.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.819+0000 7f0816181640 1 -- 172.21.15.18:0/3021519387 wait complete. 2024-09-19T09:25:13.823 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.820+0000 7f0816181640 1 Processor -- start 2024-09-19T09:25:13.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.820+0000 7f0816181640 1 -- start start 2024-09-19T09:25:13.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.821+0000 7f0816181640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f081006f7e0 0x7f0810158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:13.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.821+0000 7f0816181640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08100af8d0 0x7f08100b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:13.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.821+0000 7f0816181640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08100afd30 0x7f081015b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:13.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.821+0000 7f0816181640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7f08101594a0 con 0x7f08100afd30 2024-09-19T09:25:13.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.821+0000 7f0816181640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f08100b65e0 con 0x7f081006f7e0 2024-09-19T09:25:13.827 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.821+0000 7f0816181640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7f0810159620 con 0x7f08100af8d0 2024-09-19T09:25:13.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.821+0000 7f080ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08100afd30 0x7f081015b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:13.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.821+0000 7f080ffff640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08100afd30 0x7f081015b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39404/0 (socket says 172.21.15.18:39404) 2024-09-19T09:25:13.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.821+0000 7f080ffff640 1 -- 172.21.15.18:0/2956271238 learned_addr learned my addr 172.21.15.18:0/2956271238 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:13.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.821+0000 7f080f7fe640 1 --2- 172.21.15.18:0/2956271238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f081006f7e0 0x7f0810158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:13.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.821+0000 7f080effd640 1 --2- 172.21.15.18:0/2956271238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08100af8d0 0x7f08100b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:13.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.821+0000 7f080ffff640 1 -- 172.21.15.18:0/2956271238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08100af8d0 msgr2=0x7f08100b38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:13.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.821+0000 7f080ffff640 1 --2- 172.21.15.18:0/2956271238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08100af8d0 0x7f08100b38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.821+0000 7f080ffff640 1 -- 172.21.15.18:0/2956271238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f081006f7e0 msgr2=0x7f0810158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:13.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.821+0000 7f080ffff640 1 --2- 172.21.15.18:0/2956271238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f081006f7e0 0x7f0810158650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:13.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.821+0000 7f080ffff640 1 -- 172.21.15.18:0/2956271238 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08100b5140 con 0x7f08100afd30 2024-09-19T09:25:13.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.821+0000 7f080f7fe640 1 --2- 172.21.15.18:0/2956271238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f081006f7e0 0x7f0810158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:13.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.821+0000 7f080effd640 1 --2- 172.21.15.18:0/2956271238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08100af8d0 0x7f08100b38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:13.828 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.821+0000 7f080ffff640 1 --2- 172.21.15.18:0/2956271238 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08100afd30 0x7f081015b680 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f080802ac70 tx=0x7f0808004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:13.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.821+0000 7f07f7fff640 1 -- 172.21.15.18:0/2956271238 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080803f070 con 0x7f08100afd30 2024-09-19T09:25:13.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.821+0000 7f07f7fff640 1 -- 172.21.15.18:0/2956271238 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0808031c60 con 0x7f08100afd30 2024-09-19T09:25:13.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.822+0000 7f0816181640 1 -- 172.21.15.18:0/2956271238 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08100b2820 con 0x7f08100afd30 2024-09-19T09:25:13.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.822+0000 7f07f7fff640 1 -- 172.21.15.18:0/2956271238 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0808043650 con 0x7f08100afd30 2024-09-19T09:25:13.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.822+0000 7f0816181640 1 -- 172.21.15.18:0/2956271238 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08100b2de0 con 0x7f08100afd30 2024-09-19T09:25:13.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.823+0000 7f0816181640 1 -- 172.21.15.18:0/2956271238 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f081006fbc0 con 0x7f08100afd30 2024-09-19T09:25:13.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.823+0000 7f07f7fff640 1 -- 172.21.15.18:0/2956271238 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7f080803b410 con 0x7f08100afd30 2024-09-19T09:25:13.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.824+0000 7f07f7fff640 1 --2- 172.21.15.18:0/2956271238 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f07fc06c2b0 0x7f07fc06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:13.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.824+0000 7f07f7fff640 1 -- 172.21.15.18:0/2956271238 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 4943+0+0 (secure 0 0 0) 0x7f08080ac6e0 con 0x7f08100afd30 2024-09-19T09:25:13.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.824+0000 7f080f7fe640 1 --2- 172.21.15.18:0/2956271238 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f07fc06c2b0 0x7f07fc06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:13.829 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.824+0000 7f080f7fe640 1 --2- 172.21.15.18:0/2956271238 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f07fc06c2b0 0x7f07fc06e770 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f0800006fd0 tx=0x7f0800008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:13.830 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:13.828+0000 7f07f7fff640 1 -- 172.21.15.18:0/2956271238 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7f080807b0b0 con 0x7f08100afd30 2024-09-19T09:25:14.005 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.004+0000 7f0816181640 1 -- 172.21.15.18:0/2956271238 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f08100b7e60 con 0x7f08100afd30 2024-09-19T09:25:14.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.007+0000 7f07f7fff640 1 -- 172.21.15.18:0/2956271238 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v22)=0 v22) ==== 123+0+0 (secure 0 0 0) 0x7f080807a9b0 con 0x7f08100afd30 2024-09-19T09:25:14.008 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.007+0000 7f07f7fff640 1 -- 172.21.15.18:0/2956271238 <== mon.0 v2:172.21.15.18:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f080807ed60 con 0x7f08100afd30 2024-09-19T09:25:14.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.009+0000 7f0816181640 1 -- 172.21.15.18:0/2956271238 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f07fc06c2b0 msgr2=0x7f07fc06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:14.010 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.009+0000 7f0816181640 1 --2- 172.21.15.18:0/2956271238 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f07fc06c2b0 0x7f07fc06e770 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f0800006fd0 tx=0x7f0800008040 comp rx=0 tx=0).stop 2024-09-19T09:25:14.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.009+0000 7f0816181640 1 -- 172.21.15.18:0/2956271238 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08100afd30 msgr2=0x7f081015b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:14.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.009+0000 7f0816181640 1 --2- 172.21.15.18:0/2956271238 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08100afd30 0x7f081015b680 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f080802ac70 tx=0x7f0808004a40 comp rx=0 tx=0).stop 2024-09-19T09:25:14.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.009+0000 7f0816181640 1 -- 172.21.15.18:0/2956271238 shutdown_connections 2024-09-19T09:25:14.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.009+0000 7f0816181640 1 --2- 172.21.15.18:0/2956271238 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7f07fc06c2b0 0x7f07fc06e770 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:14.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.009+0000 7f0816181640 1 --2- 172.21.15.18:0/2956271238 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7f08100afd30 0x7f081015b680 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:14.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.009+0000 7f0816181640 1 --2- 172.21.15.18:0/2956271238 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7f08100af8d0 0x7f08100b38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:14.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.009+0000 7f0816181640 1 --2- 172.21.15.18:0/2956271238 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f081006f7e0 0x7f0810158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:14.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.009+0000 7f0816181640 1 -- 172.21.15.18:0/2956271238 >> 172.21.15.18:0/2956271238 conn(0x7f0810073c80 msgr2=0x7f081009baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:14.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.009+0000 7f0816181640 1 -- 172.21.15.18:0/2956271238 shutdown_connections 2024-09-19T09:25:14.011 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.009+0000 7f0816181640 1 -- 172.21.15.18:0/2956271238 wait complete. 2024-09-19T09:25:14.021 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T09:25:14.021 DEBUG:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-19T09:25:14.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.123+0000 7ff5af3fd640 1 Processor -- start 2024-09-19T09:25:14.124 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.123+0000 7ff5af3fd640 1 -- start start 2024-09-19T09:25:14.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.124+0000 7ff5af3fd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff5a815ecc0 0x7ff5a80d3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:14.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.124+0000 7ff5af3fd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff5a80d1b60 0x7ff5a80b50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:14.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.124+0000 7ff5af3fd640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5a80d3b20 con 0x7ff5a80d57a0 2024-09-19T09:25:14.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.124+0000 7ff5af3fd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff5a80b42f0 con 0x7ff5a815ecc0 2024-09-19T09:25:14.125 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.124+0000 7ff5af3fd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff5a80b45d0 con 0x7ff5a80d1b60 2024-09-19T09:25:14.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.125+0000 7ff5ad99a640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff5a80d1b60 0x7ff5a80b50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:14.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.125+0000 7ff5ad199640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff5a815ecc0 0x7ff5a80d3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:14.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.125+0000 7ff5ac998640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7ff5a80d57a0 0x7ff5a80d1450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.18:40278/0 (socket says 172.21.15.18:40278) 2024-09-19T09:25:14.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.125+0000 7ff5ac998640 1 -- 172.21.15.18:0/2834694243 learned_addr learned my addr 172.21.15.18:0/2834694243 (peer_addr_for_me v1:172.21.15.18:0/0) 2024-09-19T09:25:14.126 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.125+0000 7ff5ad199640 1 -- 172.21.15.18:0/2834694243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff5a80d1b60 msgr2=0x7ff5a80b50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:25:14.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.125+0000 7ff5ad199640 1 --2- 172.21.15.18:0/2834694243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff5a80d1b60 0x7ff5a80b50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:14.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.125+0000 7ff5ad199640 1 -- 172.21.15.18:0/2834694243 >> v1:172.21.15.162:6789/0 conn(0x7ff5a80d57a0 legacy=0x7ff5a80d1450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:14.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.125+0000 7ff59ffff640 1 -- 172.21.15.18:0/2834694243 <== mon.1 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2406724444 0 0) 0x7ff5a80d3b20 con 0x7ff5a80d57a0 2024-09-19T09:25:14.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.125+0000 7ff5ad199640 1 -- 172.21.15.18:0/2834694243 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a80b48b0 con 0x7ff5a815ecc0 2024-09-19T09:25:14.127 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.125+0000 7ff5ad99a640 1 --2- 172.21.15.18:0/2834694243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff5a80d1b60 0x7ff5a80b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:25:14.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.126+0000 7ff5ad199640 1 --2- 172.21.15.18:0/2834694243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5a815ecc0 0x7ff5a80d3170 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff5a40097a0 tx=0x7ff5a402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2081bdb94997271e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:14.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.126+0000 7ff59ffff640 1 -- 172.21.15.18:0/2834694243 <== mon.1 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4037070 con 0x7ff5a815ecc0 2024-09-19T09:25:14.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.126+0000 7ff59ffff640 1 -- 172.21.15.18:0/2834694243 <== mon.1 v2:172.21.15.162:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff5a4032440 con 0x7ff5a815ecc0 2024-09-19T09:25:14.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.126+0000 7ff59ffff640 1 -- 172.21.15.18:0/2834694243 <== mon.1 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4032830 con 0x7ff5a815ecc0 2024-09-19T09:25:14.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.127+0000 7ff5af3fd640 1 -- 172.21.15.18:0/2834694243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5a815ecc0 msgr2=0x7ff5a80d3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:14.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.127+0000 7ff5af3fd640 1 --2- 172.21.15.18:0/2834694243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5a815ecc0 0x7ff5a80d3170 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff5a40097a0 tx=0x7ff5a402a180 comp rx=0 tx=0).stop 2024-09-19T09:25:14.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.127+0000 7ff5af3fd640 1 -- 172.21.15.18:0/2834694243 shutdown_connections 2024-09-19T09:25:14.128 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.127+0000 7ff5af3fd640 1 --2- 172.21.15.18:0/2834694243 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff5a80d1b60 0x7ff5a80b50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:14.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.127+0000 7ff5af3fd640 1 --2- 172.21.15.18:0/2834694243 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5a815ecc0 0x7ff5a80d3170 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:14.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.127+0000 7ff5af3fd640 1 -- 172.21.15.18:0/2834694243 >> 172.21.15.18:0/2834694243 conn(0x7ff5a80d4bd0 msgr2=0x7ff5a80d4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:14.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.127+0000 7ff5af3fd640 1 -- 172.21.15.18:0/2834694243 shutdown_connections 2024-09-19T09:25:14.129 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.127+0000 7ff5af3fd640 1 -- 172.21.15.18:0/2834694243 wait complete. 2024-09-19T09:25:14.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.128+0000 7ff5af3fd640 1 Processor -- start 2024-09-19T09:25:14.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.128+0000 7ff5af3fd640 1 -- start start 2024-09-19T09:25:14.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.129+0000 7ff5af3fd640 1 --2- >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff5a80d1b60 0x7ff5a80cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:14.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.129+0000 7ff5af3fd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5a80d57a0 0x7ff5a815b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:14.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.129+0000 7ff5af3fd640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5a815ecc0 0x7ff5a815a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:14.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.129+0000 7ff5af3fd640 1 -- --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a815f220 con 0x7ff5a815ecc0 2024-09-19T09:25:14.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.129+0000 7ff5af3fd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a815f0a0 con 0x7ff5a80d57a0 2024-09-19T09:25:14.131 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.129+0000 7ff5af3fd640 1 -- --> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] -- mon_getmap magic: 0 -- 0x7ff5a80d36b0 con 0x7ff5a80d1b60 2024-09-19T09:25:14.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.129+0000 7ff5ad99a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5a815ecc0 0x7ff5a815a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:14.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.129+0000 7ff5ad99a640 1 --2- >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5a815ecc0 0x7ff5a815a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.18:3300/0 says I am v2:172.21.15.18:39410/0 (socket says 172.21.15.18:39410) 2024-09-19T09:25:14.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.129+0000 7ff5ad99a640 1 -- 172.21.15.18:0/487509960 learned_addr learned my addr 172.21.15.18:0/487509960 (peer_addr_for_me v2:172.21.15.18:0/0) 2024-09-19T09:25:14.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.129+0000 7ff5ac998640 1 --2- 172.21.15.18:0/487509960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5a80d57a0 0x7ff5a815b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:14.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.129+0000 7ff5ad199640 1 --2- 172.21.15.18:0/487509960 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff5a80d1b60 0x7ff5a80cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:14.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.129+0000 7ff5ad99a640 1 -- 172.21.15.18:0/487509960 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff5a80d1b60 msgr2=0x7ff5a80cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:14.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.129+0000 7ff5ad99a640 1 --2- 172.21.15.18:0/487509960 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff5a80d1b60 0x7ff5a80cb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:14.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.129+0000 7ff5ad99a640 1 -- 172.21.15.18:0/487509960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5a80d57a0 msgr2=0x7ff5a815b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:14.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.129+0000 7ff5ad99a640 1 --2- 172.21.15.18:0/487509960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5a80d57a0 0x7ff5a815b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:14.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.129+0000 7ff5ad99a640 1 -- 172.21.15.18:0/487509960 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a80b7a00 con 0x7ff5a815ecc0 2024-09-19T09:25:14.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.129+0000 7ff5ac998640 1 --2- 172.21.15.18:0/487509960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5a80d57a0 0x7ff5a815b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:25:14.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.129+0000 7ff5ad99a640 1 --2- 172.21.15.18:0/487509960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5a815ecc0 0x7ff5a815a7e0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000efc0 tx=0x7ff5a0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:14.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.130+0000 7ff59dffb640 1 -- 172.21.15.18:0/487509960 <== mon.0 v2:172.21.15.18:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0018030 con 0x7ff5a815ecc0 2024-09-19T09:25:14.132 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.130+0000 7ff59dffb640 1 -- 172.21.15.18:0/487509960 <== mon.0 v2:172.21.15.18:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff5a000cde0 con 0x7ff5a815ecc0 2024-09-19T09:25:14.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.130+0000 7ff59dffb640 1 -- 172.21.15.18:0/487509960 <== mon.0 v2:172.21.15.18:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0003bd0 con 0x7ff5a815ecc0 2024-09-19T09:25:14.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.130+0000 7ff5af3fd640 1 -- 172.21.15.18:0/487509960 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5a806e360 con 0x7ff5a815ecc0 2024-09-19T09:25:14.133 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.130+0000 7ff5af3fd640 1 -- 172.21.15.18:0/487509960 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5a80cce20 con 0x7ff5a815ecc0 2024-09-19T09:25:14.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.131+0000 7ff5af3fd640 1 -- 172.21.15.18:0/487509960 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5a80d3170 con 0x7ff5a815ecc0 2024-09-19T09:25:14.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.131+0000 7ff59dffb640 1 -- 172.21.15.18:0/487509960 <== mon.0 v2:172.21.15.18:3300/0 4 ==== mgrmap(e 5) ==== 90846+0+0 (secure 0 0 0) 0x7ff5a0005d10 con 0x7ff5a815ecc0 2024-09-19T09:25:14.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.132+0000 7ff59dffb640 1 --2- 172.21.15.18:0/487509960 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff58c06c2b0 0x7ff58c06e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:25:14.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.132+0000 7ff59dffb640 1 -- 172.21.15.18:0/487509960 <== mon.0 v2:172.21.15.18:3300/0 5 ==== osd_map(188..188 src has 1..188) ==== 4943+0+0 (secure 0 0 0) 0x7ff5a008bc40 con 0x7ff5a815ecc0 2024-09-19T09:25:14.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.132+0000 7ff5ad199640 1 --2- 172.21.15.18:0/487509960 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff58c06c2b0 0x7ff58c06e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:25:14.134 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.133+0000 7ff5ad199640 1 --2- 172.21.15.18:0/487509960 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff58c06c2b0 0x7ff58c06e770 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4034000 tx=0x7ff5a402e000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:25:14.137 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.136+0000 7ff59dffb640 1 -- 172.21.15.18:0/487509960 <== mon.0 v2:172.21.15.18:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187789 (secure 0 0 0) 0x7ff5a0022070 con 0x7ff5a815ecc0 2024-09-19T09:25:14.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.346+0000 7ff5af3fd640 1 -- 172.21.15.18:0/487509960 --> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5a808e3c0 con 0x7ff5a815ecc0 2024-09-19T09:25:14.347 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.346+0000 7ff59dffb640 1 -- 172.21.15.18:0/487509960 <== mon.0 v2:172.21.15.18:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+3917 (secure 0 0 0) 0x7ff5a80b7a00 con 0x7ff5a815ecc0 2024-09-19T09:25:14.348 INFO:teuthology.orchestra.run.smithi018.stdout: 2024-09-19T09:25:14.348 INFO:teuthology.orchestra.run.smithi018.stdout:{"epoch":84,"btime":"2024-09-19T09:25:03:735883+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7273,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/1644566118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":1644566118},{"type":"v1","addr":"172.21.15.162:6835","nonce":1644566118}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7276,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/3767901067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":3767901067},{"type":"v1","addr":"172.21.15.162:6837","nonce":3767901067}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":78},{"gid":7851,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6834/1160903618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6833","nonce":1160903618},{"type":"v1","addr":"172.21.15.18:6834","nonce":1160903618}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":77},{"gid":8139,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.18:6835/1245412207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.18:6832","nonce":1245412207},{"type":"v1","addr":"172.21.15.18:6835","nonce":1245412207}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":84}],"filesystems":[]} 2024-09-19T09:25:14.348 INFO:teuthology.orchestra.run.smithi018.stderr:dumped fsmap epoch 84 2024-09-19T09:25:14.350 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.349+0000 7ff5af3fd640 1 -- 172.21.15.18:0/487509960 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff58c06c2b0 msgr2=0x7ff58c06e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:14.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.349+0000 7ff5af3fd640 1 --2- 172.21.15.18:0/487509960 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff58c06c2b0 0x7ff58c06e770 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4034000 tx=0x7ff5a402e000 comp rx=0 tx=0).stop 2024-09-19T09:25:14.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.349+0000 7ff5af3fd640 1 -- 172.21.15.18:0/487509960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5a815ecc0 msgr2=0x7ff5a815a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:25:14.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.349+0000 7ff5af3fd640 1 --2- 172.21.15.18:0/487509960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5a815ecc0 0x7ff5a815a7e0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000efc0 tx=0x7ff5a0009f90 comp rx=0 tx=0).stop 2024-09-19T09:25:14.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.349+0000 7ff5af3fd640 1 -- 172.21.15.18:0/487509960 shutdown_connections 2024-09-19T09:25:14.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.349+0000 7ff5af3fd640 1 --2- 172.21.15.18:0/487509960 >> [v2:172.21.15.162:6832/2027634341,v1:172.21.15.162:6833/2027634341] conn(0x7ff58c06c2b0 0x7ff58c06e770 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:14.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.349+0000 7ff5af3fd640 1 --2- 172.21.15.18:0/487509960 >> [v2:172.21.15.18:3300/0,v1:172.21.15.18:6789/0] conn(0x7ff5a815ecc0 0x7ff5a815a7e0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:14.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.349+0000 7ff5af3fd640 1 --2- 172.21.15.18:0/487509960 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff5a80d57a0 0x7ff5a815b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:14.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.349+0000 7ff5af3fd640 1 --2- 172.21.15.18:0/487509960 >> [v2:172.21.15.162:3301/0,v1:172.21.15.162:6790/0] conn(0x7ff5a80d1b60 0x7ff5a80cb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:25:14.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.349+0000 7ff5af3fd640 1 -- 172.21.15.18:0/487509960 >> 172.21.15.18:0/487509960 conn(0x7ff5a80d4bd0 msgr2=0x7ff5a81e60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:25:14.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.349+0000 7ff5af3fd640 1 -- 172.21.15.18:0/487509960 shutdown_connections 2024-09-19T09:25:14.351 INFO:teuthology.orchestra.run.smithi018.stderr:2024-09-19T09:25:14.349+0000 7ff5af3fd640 1 -- 172.21.15.18:0/487509960 wait complete. 2024-09-19T09:25:14.361 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-19T09:25:14.361 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-19T09:25:14.361 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-19T09:25:14.361 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:25:14.370 INFO:tasks.ceph.mds.a:Stopped 2024-09-19T09:25:14.370 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-19T09:25:14.370 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:25:14.418 INFO:tasks.ceph.mds.c:Stopped 2024-09-19T09:25:14.419 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-19T09:25:14.419 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:25:14.430 INFO:tasks.ceph.mds.b:Stopped 2024-09-19T09:25:14.430 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-19T09:25:14.431 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:25:14.483 INFO:tasks.ceph.mds.d:Stopped 2024-09-19T09:25:14.483 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-19T09:25:14.483 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-19T09:25:14.483 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:25:14.500 INFO:tasks.ceph.osd.0:Stopped 2024-09-19T09:25:14.501 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-19T09:25:14.501 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:25:14.558 INFO:tasks.ceph.osd.1:Stopped 2024-09-19T09:25:14.558 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-19T09:25:14.558 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:25:14.616 INFO:tasks.ceph.osd.2:Stopped 2024-09-19T09:25:14.616 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-19T09:25:14.616 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:25:14.674 INFO:tasks.ceph.osd.3:Stopped 2024-09-19T09:25:14.675 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-19T09:25:14.675 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:25:14.685 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-19T09:25:14.685 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-19T09:25:14.694 INFO:tasks.ceph.osd.4:Stopped 2024-09-19T09:25:14.695 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-19T09:25:14.695 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:25:14.756 INFO:tasks.ceph.osd.5:Stopped 2024-09-19T09:25:14.757 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-19T09:25:14.757 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:25:14.820 INFO:tasks.ceph.osd.6:Stopped 2024-09-19T09:25:14.821 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-19T09:25:14.821 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:25:14.881 INFO:tasks.ceph.osd.7:Stopped 2024-09-19T09:25:14.881 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-19T09:25:14.881 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-19T09:25:14.881 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:25:14.907 INFO:tasks.ceph.mgr.y:Stopped 2024-09-19T09:25:14.907 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-19T09:25:14.907 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:25:14.950 INFO:tasks.ceph.mgr.x:Stopped 2024-09-19T09:25:14.950 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-19T09:25:14.950 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-19T09:25:14.950 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:25:14.962 INFO:tasks.ceph.mon.a:Stopped 2024-09-19T09:25:14.962 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-19T09:25:14.962 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:25:15.001 INFO:tasks.ceph.mon.b:Stopped 2024-09-19T09:25:15.002 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-19T09:25:15.002 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T09:25:15.053 INFO:tasks.ceph.mon.c:Stopped 2024-09-19T09:25:15.054 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-19T09:25:15.054 DEBUG:teuthology.orchestra.run.smithi018:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2024-09-19T09:25:15.098 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T09:25:15.098 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-19T09:25:15.451 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T09:25:15.451 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-19T09:25:15.541 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T09:25:15.542 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-19T09:25:15.617 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T09:25:15.617 DEBUG:teuthology.orchestra.run.smithi018:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-19T09:25:15.665 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi162.front.sepia.ceph.com 2024-09-19T09:25:15.666 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-19T09:25:15.832 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi162.front.sepia.ceph.com 2024-09-19T09:25:15.832 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-19T09:25:15.902 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi162.front.sepia.ceph.com 2024-09-19T09:25:15.903 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-19T09:25:15.968 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi162.front.sepia.ceph.com 2024-09-19T09:25:15.968 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-19T09:25:16.018 INFO:tasks.ceph:Archiving mon data... 2024-09-19T09:25:16.019 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911897/data/mon.a.tgz 2024-09-19T09:25:16.019 DEBUG:teuthology.orchestra.run.smithi018:> mktemp 2024-09-19T09:25:16.038 INFO:teuthology.orchestra.run.smithi018.stdout:/tmp/tmp.XzkQfzdIQU 2024-09-19T09:25:16.038 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.XzkQfzdIQU 2024-09-19T09:25:16.205 DEBUG:teuthology.orchestra.run.smithi018:> sudo chmod 0666 /tmp/tmp.XzkQfzdIQU 2024-09-19T09:25:16.290 DEBUG:teuthology.orchestra.remote:smithi018:/tmp/tmp.XzkQfzdIQU is 445KB 2024-09-19T09:25:16.389 DEBUG:teuthology.orchestra.run.smithi018:> rm -fr /tmp/tmp.XzkQfzdIQU 2024-09-19T09:25:16.404 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911897/data/mon.b.tgz 2024-09-19T09:25:16.404 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-09-19T09:25:16.423 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.mgfjtyoqgv 2024-09-19T09:25:16.425 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.mgfjtyoqgv 2024-09-19T09:25:16.591 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.mgfjtyoqgv 2024-09-19T09:25:16.676 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.mgfjtyoqgv is 459KB 2024-09-19T09:25:16.774 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.mgfjtyoqgv 2024-09-19T09:25:16.789 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911897/data/mon.c.tgz 2024-09-19T09:25:16.789 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-09-19T09:25:16.847 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.tT7ao1Sy3E 2024-09-19T09:25:16.847 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.tT7ao1Sy3E 2024-09-19T09:25:16.996 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.tT7ao1Sy3E 2024-09-19T09:25:17.080 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.tT7ao1Sy3E is 459KB 2024-09-19T09:25:17.177 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.tT7ao1Sy3E 2024-09-19T09:25:17.191 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-19T09:25:17.192 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-19T09:25:17.194 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-19T09:25:17.281 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-19T09:25:17.311 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-19T09:25:17.311 INFO:tasks.ceph:Archiving crash dumps... 2024-09-19T09:25:17.313 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911897/remote/smithi018/crash 2024-09-19T09:25:17.314 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-19T09:25:17.351 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911897/remote/smithi162/crash 2024-09-19T09:25:17.352 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-19T09:25:17.376 INFO:tasks.ceph:Shutting down logrotate 2024-09-19T09:25:17.376 DEBUG:teuthology.orchestra.run.smithi018:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:25:17.397 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-19T09:25:17.465 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-19T09:25:17.493 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-19T09:25:17.518 INFO:tasks.ceph:Compressing logs... 2024-09-19T09:25:17.519 DEBUG:teuthology.orchestra.run.smithi018:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:25:17.536 DEBUG:teuthology.orchestra.run.smithi162:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:25:17.561 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-19T09:25:17.561 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61634.log 2024-09-19T09:25:17.615 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.36570.log 2024-09-19T09:25:17.615 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34448.log 2024-09-19T09:25:17.615 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.36570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.37058.log 2024-09-19T09:25:17.615 INFO:teuthology.orchestra.run.smithi162.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.36570.log.gz 2024-09-19T09:25:17.615 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.34448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31863.log 2024-09-19T09:25:17.615 INFO:teuthology.orchestra.run.smithi162.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34448.log.gz 2024-09-19T09:25:17.615 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.37058.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.37058.log.gz 2024-09-19T09:25:17.616 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-19T09:25:17.616 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.31863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.33954.log 2024-09-19T09:25:17.616 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.7.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.31863.log.gz 2024-09-19T09:25:17.616 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35493.log 2024-09-19T09:25:17.616 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.33954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.32962.log 2024-09-19T09:25:17.616 INFO:teuthology.orchestra.run.smithi162.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33954.log.gz 2024-09-19T09:25:17.616 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.35493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31947.log 2024-09-19T09:25:17.616 INFO:teuthology.orchestra.run.smithi162.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35493.log.gz 2024-09-19T09:25:17.616 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.32962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31903.log 2024-09-19T09:25:17.616 INFO:teuthology.orchestra.run.smithi162.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.32962.log.gz 2024-09-19T09:25:17.617 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.31947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.37557.log 2024-09-19T09:25:17.617 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.31903.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.31947.log.gz 2024-09-19T09:25:17.617 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-19T09:25:17.617 INFO:teuthology.orchestra.run.smithi162.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.31903.log.gz 2024-09-19T09:25:17.617 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.37557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.38632.log 2024-09-19T09:25:17.617 INFO:teuthology.orchestra.run.smithi162.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.37557.log.gz 2024-09-19T09:25:17.617 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.38113.log 2024-09-19T09:25:17.617 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.38632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32034.log 2024-09-19T09:25:17.617 INFO:teuthology.orchestra.run.smithi162.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.38632.log.gz 2024-09-19T09:25:17.617 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.38113.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.38113.log.gz 2024-09-19T09:25:17.617 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-19T09:25:17.617 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.32034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.38636.log 2024-09-19T09:25:17.618 INFO:teuthology.orchestra.run.smithi162.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32034.log.gz 2024-09-19T09:25:17.618 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-19T09:25:17.618 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31783.log 2024-09-19T09:25:17.618 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.38636.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.38636.log.gz 2024-09-19T09:25:17.618 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-19T09:25:17.618 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.31783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.32968.log 2024-09-19T09:25:17.618 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mon.c.log: gzip 87.1% -5 --verbose -- /var/log/ceph/ceph-client.admin.31994.log 2024-09-19T09:25:17.618 INFO:teuthology.orchestra.run.smithi162.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31783.log.gz 2024-09-19T09:25:17.618 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.32968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.37561.log 2024-09-19T09:25:17.618 INFO:teuthology.orchestra.run.smithi162.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.32968.log.gz 2024-09-19T09:25:17.618 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5/var/log/ceph/ceph-client.admin.31994.log: --verbose -- /var/log/ceph/ceph-client.1.33950.log 2024-09-19T09:25:17.618 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.37561.log: 89.2% 0.0% -- replaced with /var/log/ceph/ceph-client.1.37561.log.gz 2024-09-19T09:25:17.618 INFO:teuthology.orchestra.run.smithi162.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31994.log.gz 2024-09-19T09:25:17.619 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.38117.log 2024-09-19T09:25:17.619 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.1.33950.log: -- /var/log/ceph/ceph-osd.6.log 2024-09-19T09:25:17.619 INFO:teuthology.orchestra.run.smithi162.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.33950.log.gz 2024-09-19T09:25:17.619 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.38117.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.38117.log.gz 2024-09-19T09:25:17.619 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.36574.log 2024-09-19T09:25:17.619 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34960.log 2024-09-19T09:25:17.619 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.36574.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-19T09:25:17.619 INFO:teuthology.orchestra.run.smithi162.stderr: -- replaced with /var/log/ceph/ceph-client.1.36574.log.gz 2024-09-19T09:25:17.619 INFO:teuthology.orchestra.run.smithi162.stderr: 94.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-19T09:25:17.619 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31743.log 2024-09-19T09:25:17.619 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.34960.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34960.log.gz/var/log/ceph/ceph-osd.5.log: 2024-09-19T09:25:17.619 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.33367.log 2024-09-19T09:25:17.620 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-19T09:25:17.620 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.3.33367.log: /var/log/ceph/ceph-client.admin.31743.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.33367.log.gz 2024-09-19T09:25:17.620 INFO:teuthology.orchestra.run.smithi162.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.31743.log.gz 2024-09-19T09:25:17.620 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-19T09:25:17.620 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-19T09:25:17.623 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mds.d.log: 92.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-19T09:25:17.623 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.36007.log 2024-09-19T09:25:17.640 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34956.log 2024-09-19T09:25:17.640 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.36007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.36007.log.gz 2024-09-19T09:25:17.640 INFO:teuthology.orchestra.run.smithi162.stderr: 94.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-19T09:25:17.640 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-19T09:25:17.640 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.34956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34956.log.gz 2024-09-19T09:25:17.640 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.35497.log 2024-09-19T09:25:17.650 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.37054.log 2024-09-19T09:25:17.657 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.35497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.35497.log.gz 2024-09-19T09:25:17.671 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.33363.log 2024-09-19T09:25:17.671 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.37054.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.37054.log.gz 2024-09-19T09:25:17.684 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34444.log 2024-09-19T09:25:17.684 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.3.33363.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.33363.log.gz 2024-09-19T09:25:17.697 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31823.log 2024-09-19T09:25:17.697 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.34444.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34444.log.gz 2024-09-19T09:25:17.711 INFO:teuthology.orchestra.run.smithi162.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-19T09:25:17.711 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.36011.log 2024-09-19T09:25:17.711 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.31823.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.31823.log.gz 2024-09-19T09:25:17.712 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.1.36011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.36011.log.gz 2024-09-19T09:25:17.754 INFO:teuthology.orchestra.run.smithi162.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-19T09:25:17.834 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35451.log 2024-09-19T09:25:17.834 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.61634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34193.log 2024-09-19T09:25:17.834 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35451.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61634.log.gz 2024-09-19T09:25:17.834 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46876.log 2024-09-19T09:25:17.834 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35451.log.gz 2024-09-19T09:25:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41080.log 2024-09-19T09:25:17.835 INFO:teuthology.orchestra.run.smithi018.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34193.log.gz 2024-09-19T09:25:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.46876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43745.log 2024-09-19T09:25:17.835 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46876.log.gz 2024-09-19T09:25:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33995.log 2024-09-19T09:25:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42761.log 2024-09-19T09:25:17.835 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43745.log.gz 2024-09-19T09:25:17.835 INFO:teuthology.orchestra.run.smithi018.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.41080.log.gz 2024-09-19T09:25:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51102.log 2024-09-19T09:25:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51923.log 2024-09-19T09:25:17.835 INFO:teuthology.orchestra.run.smithi018.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33995.log.gz 2024-09-19T09:25:17.835 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42761.log: /var/log/ceph/ceph-client.admin.51102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36019.log 2024-09-19T09:25:17.835 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42761.log.gz 2024-09-19T09:25:17.836 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51102.log.gz 2024-09-19T09:25:17.836 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.51923.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51923.log.gz 2024-09-19T09:25:17.836 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41996.log 2024-09-19T09:25:17.836 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40572.log 2024-09-19T09:25:17.836 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41996.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36019.log.gz 2024-09-19T09:25:17.836 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40437.log 2024-09-19T09:25:17.836 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41996.log.gz 2024-09-19T09:25:17.836 INFO:teuthology.orchestra.run.smithi018.stderr:gzip/var/log/ceph/ceph-client.admin.40572.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36486.log 2024-09-19T09:25:17.836 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40437.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40572.log.gz 2024-09-19T09:25:17.836 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42616.log 2024-09-19T09:25:17.836 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40437.log.gz 2024-09-19T09:25:17.836 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61760.log 2024-09-19T09:25:17.836 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36486.log.gz 2024-09-19T09:25:17.837 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47996.log 2024-09-19T09:25:17.837 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.61760.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42616.log.gz 2024-09-19T09:25:17.837 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57097.log 2024-09-19T09:25:17.837 INFO:teuthology.orchestra.run.smithi018.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61760.log.gz 2024-09-19T09:25:17.837 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64375.log 2024-09-19T09:25:17.837 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47996.log.gz 2024-09-19T09:25:17.837 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.57097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47579.log 2024-09-19T09:25:17.837 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.64375.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57097.log.gz 2024-09-19T09:25:17.837 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56496.log 2024-09-19T09:25:17.837 INFO:teuthology.orchestra.run.smithi018.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.64375.log.gz 2024-09-19T09:25:17.837 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38578.log 2024-09-19T09:25:17.837 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47579.log.gz 2024-09-19T09:25:17.837 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.56496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32831.log 2024-09-19T09:25:17.838 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38578.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.56496.log.gz 2024-09-19T09:25:17.838 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53487.log 2024-09-19T09:25:17.838 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38578.log.gz 2024-09-19T09:25:17.838 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61024.log 2024-09-19T09:25:17.838 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32831.log.gz 2024-09-19T09:25:17.838 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60317.log 2024-09-19T09:25:17.838 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.61024.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53487.log.gz 2024-09-19T09:25:17.838 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55819.log 2024-09-19T09:25:17.838 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61024.log.gz 2024-09-19T09:25:17.838 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.60317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47537.log 2024-09-19T09:25:17.838 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.60317.log.gz 2024-09-19T09:25:17.838 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.55819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42364.log 2024-09-19T09:25:17.838 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47537.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55819.log.gz 2024-09-19T09:25:17.838 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46622.log 2024-09-19T09:25:17.839 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42364.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47537.log.gz 2024-09-19T09:25:17.839 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33437.log 2024-09-19T09:25:17.839 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42364.log.gz 2024-09-19T09:25:17.839 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32185.log 2024-09-19T09:25:17.839 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50761.log 2024-09-19T09:25:17.839 INFO:teuthology.orchestra.run.smithi018.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.46622.log.gz 2024-09-19T09:25:17.839 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33437.log.gz 2024-09-19T09:25:17.839 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59400.log 2024-09-19T09:25:17.839 INFO:teuthology.orchestra.run.smithi018.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.32185.log.gz 2024-09-19T09:25:17.839 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50677.log 2024-09-19T09:25:17.839 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50761.log.gz 2024-09-19T09:25:17.839 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.59400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42448.log 2024-09-19T09:25:17.839 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50677.log: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.59400.log.gz 2024-09-19T09:25:17.840 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37457.log 2024-09-19T09:25:17.840 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50677.log.gz 2024-09-19T09:25:17.840 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57903.log 2024-09-19T09:25:17.840 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42448.log.gz 2024-09-19T09:25:17.840 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48294.log 2024-09-19T09:25:17.840 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.57903.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37457.log.gz 2024-09-19T09:25:17.840 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59946.log 2024-09-19T09:25:17.840 INFO:teuthology.orchestra.run.smithi018.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57903.log.gz 2024-09-19T09:25:17.840 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34823.log 2024-09-19T09:25:17.840 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48294.log.gz 2024-09-19T09:25:17.840 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.59946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32701.log 2024-09-19T09:25:17.840 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34823.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.59946.log.gz 2024-09-19T09:25:17.841 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58291.log 2024-09-19T09:25:17.841 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64795.log 2024-09-19T09:25:17.841 INFO:teuthology.orchestra.run.smithi018.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.34823.log.gz 2024-09-19T09:25:17.841 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.58291.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32701.log.gz 2024-09-19T09:25:17.841 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58207.log 2024-09-19T09:25:17.841 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58291.log.gz 2024-09-19T09:25:17.841 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.64795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53709.log 2024-09-19T09:25:17.841 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.58207.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.64795.log.gz 2024-09-19T09:25:17.841 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64835.log 2024-09-19T09:25:17.841 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58207.log.gz 2024-09-19T09:25:17.841 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62979.log 2024-09-19T09:25:17.841 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.64835.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53709.log.gzgzip 2024-09-19T09:25:17.841 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.33353.log 2024-09-19T09:25:17.842 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.64835.log.gz 2024-09-19T09:25:17.842 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.62979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59358.log 2024-09-19T09:25:17.842 INFO:teuthology.orchestra.run.smithi018.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62979.log.gz 2024-09-19T09:25:17.842 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49141.log 2024-09-19T09:25:17.842 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.59358.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33353.log.gz 2024-09-19T09:25:17.842 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43573.log 2024-09-19T09:25:17.842 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59358.log.gz 2024-09-19T09:25:17.842 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.49141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33395.log 2024-09-19T09:25:17.842 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49141.log.gz 2024-09-19T09:25:17.842 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47327.log 2024-09-19T09:25:17.842 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8%/var/log/ceph/ceph-client.admin.33395.log: -- replaced with /var/log/ceph/ceph-client.admin.43573.log.gz 2024-09-19T09:25:17.842 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59610.log 2024-09-19T09:25:17.842 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33395.log.gz 2024-09-19T09:25:17.843 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44039.log 2024-09-19T09:25:17.843 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47327.log.gz 2024-09-19T09:25:17.843 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.59610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56748.log 2024-09-19T09:25:17.843 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40996.log 2024-09-19T09:25:17.843 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.56748.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44039.log.gz 2024-09-19T09:25:17.843 INFO:teuthology.orchestra.run.smithi018.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.59610.log.gz 2024-09-19T09:25:17.843 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62264.log 2024-09-19T09:25:17.843 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56748.log.gz 2024-09-19T09:25:17.843 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45218.log 2024-09-19T09:25:17.843 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40996.log.gz 2024-09-19T09:25:17.843 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.62264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64207.log 2024-09-19T09:25:17.843 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45218.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.62264.log.gz 2024-09-19T09:25:17.843 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47892.log 2024-09-19T09:25:17.844 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45218.log.gz 2024-09-19T09:25:17.844 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.64207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61718.log 2024-09-19T09:25:17.844 INFO:teuthology.orchestra.run.smithi018.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64207.log.gz 2024-09-19T09:25:17.844 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.47892.log: -- /var/log/ceph/ceph-client.admin.63636.log 2024-09-19T09:25:17.844 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.61718.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47892.log.gz 2024-09-19T09:25:17.844 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59168.log 2024-09-19T09:25:17.844 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61718.log.gz 2024-09-19T09:25:17.844 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.63636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48381.log 2024-09-19T09:25:17.844 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63636.log.gz 2024-09-19T09:25:17.844 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.59168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45961.log 2024-09-19T09:25:17.844 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48381.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59168.log.gz 2024-09-19T09:25:17.844 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54572.log 2024-09-19T09:25:17.844 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48381.log.gz 2024-09-19T09:25:17.845 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58646.log 2024-09-19T09:25:17.845 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45961.log.gz 2024-09-19T09:25:17.845 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.54572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48467.log 2024-09-19T09:25:17.845 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54572.log.gz 2024-09-19T09:25:17.845 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.58646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38200.log 2024-09-19T09:25:17.845 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58646.log.gz 2024-09-19T09:25:17.845 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47000.log 2024-09-19T09:25:17.845 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48467.log.gz 2024-09-19T09:25:17.845 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63997.log 2024-09-19T09:25:17.845 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47000.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38200.log.gz 2024-09-19T09:25:17.845 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53182.log 2024-09-19T09:25:17.845 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47000.log.gz 2024-09-19T09:25:17.845 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.63997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55199.log 2024-09-19T09:25:17.845 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.63997.log.gz 2024-09-19T09:25:17.846 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64627.log 2024-09-19T09:25:17.846 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.55199.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53182.log.gz 2024-09-19T09:25:17.846 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33996.log 2024-09-19T09:25:17.846 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55199.log.gz 2024-09-19T09:25:17.846 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.64627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41606.log 2024-09-19T09:25:17.846 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.64627.log.gz 2024-09-19T09:25:17.846 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61322.log 2024-09-19T09:25:17.846 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41606.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33996.log.gz 2024-09-19T09:25:17.846 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-19T09:25:17.846 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41606.log.gz 2024-09-19T09:25:17.846 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.61322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53890.log 2024-09-19T09:25:17.846 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.61322.log.gz 2024-09-19T09:25:17.846 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60627.log 2024-09-19T09:25:17.847 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33656.log 2024-09-19T09:25:17.847 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53890.log.gz 2024-09-19T09:25:17.847 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.60627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59028.log 2024-09-19T09:25:17.847 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60459.log 2024-09-19T09:25:17.847 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.60627.log.gz 2024-09-19T09:25:17.847 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33656.log: /var/log/ceph/ceph-client.admin.59028.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33656.log.gz 2024-09-19T09:25:17.847 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64543.log 2024-09-19T09:25:17.847 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50856.log 2024-09-19T09:25:17.847 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9%/var/log/ceph/ceph-client.admin.60459.log: -- replaced with /var/log/ceph/ceph-client.admin.59028.log.gz 2024-09-19T09:25:17.847 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.64543.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60459.log.gz 2024-09-19T09:25:17.847 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34739.log 2024-09-19T09:25:17.847 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.64543.log.gz 2024-09-19T09:25:17.847 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45532.log 2024-09-19T09:25:17.848 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50856.log: /var/log/ceph/ceph-client.admin.34739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32915.log 2024-09-19T09:25:17.848 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50856.log.gz 2024-09-19T09:25:17.848 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34739.log.gz 2024-09-19T09:25:17.848 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47850.log 2024-09-19T09:25:17.848 INFO:teuthology.orchestra.run.smithi018.stderr:gzip/var/log/ceph/ceph-client.admin.32915.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.58478.log 2024-09-19T09:25:17.848 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45532.log.gz 2024-09-19T09:25:17.848 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47850.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32915.log.gz 2024-09-19T09:25:17.848 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41416.log 2024-09-19T09:25:17.848 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47850.log.gz 2024-09-19T09:25:17.848 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36983.log 2024-09-19T09:25:17.848 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.58478.log: /var/log/ceph/ceph-client.admin.41416.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.58478.log.gz 2024-09-19T09:25:17.848 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46880.log 2024-09-19T09:25:17.848 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41416.log.gz 2024-09-19T09:25:17.849 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50719.log 2024-09-19T09:25:17.849 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36983.log: /var/log/ceph/ceph-client.0.46880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34529.log 2024-09-19T09:25:17.849 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46880.log.gz 2024-09-19T09:25:17.849 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36983.log.gz 2024-09-19T09:25:17.849 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44459.log 2024-09-19T09:25:17.849 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34529.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50719.log.gz 2024-09-19T09:25:17.849 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40702.log 2024-09-19T09:25:17.849 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34529.log.gz 2024-09-19T09:25:17.849 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31921.log 2024-09-19T09:25:17.849 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44459.log.gz 2024-09-19T09:25:17.849 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64081.log 2024-09-19T09:25:17.849 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40702.log.gz 2024-09-19T09:25:17.849 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53932.log 2024-09-19T09:25:17.850 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.31921.log: /var/log/ceph/ceph-client.admin.64081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36689.log 2024-09-19T09:25:17.850 INFO:teuthology.orchestra.run.smithi018.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.31921.log.gz 2024-09-19T09:25:17.850 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53932.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64081.log.gz 2024-09-19T09:25:17.850 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57663.log 2024-09-19T09:25:17.850 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53932.log.gz 2024-09-19T09:25:17.850 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54314.log 2024-09-19T09:25:17.850 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36689.log: /var/log/ceph/ceph-client.admin.57663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36396.log 2024-09-19T09:25:17.850 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36689.log.gz 2024-09-19T09:25:17.850 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.57663.log.gz 2024-09-19T09:25:17.850 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.54314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56132.log 2024-09-19T09:25:17.850 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55515.log 2024-09-19T09:25:17.850 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36396.log: /var/log/ceph/ceph-client.admin.56132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43871.log 2024-09-19T09:25:17.850 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36396.log.gz 2024-09-19T09:25:17.851 INFO:teuthology.orchestra.run.smithi018.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.54314.log.gz 2024-09-19T09:25:17.851 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56132.log.gz 2024-09-19T09:25:17.851 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.55515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43480.log 2024-09-19T09:25:17.851 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40265.log 2024-09-19T09:25:17.851 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55515.log.gz 2024-09-19T09:25:17.851 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46226.log 2024-09-19T09:25:17.851 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43480.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43871.log.gz 2024-09-19T09:25:17.851 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45627.log 2024-09-19T09:25:17.851 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43480.log.gz 2024-09-19T09:25:17.851 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40265.log.gz 2024-09-19T09:25:17.851 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44905.log 2024-09-19T09:25:17.851 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46226.log.gz 2024-09-19T09:25:17.851 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55283.log 2024-09-19T09:25:17.852 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45627.log: /var/log/ceph/ceph-client.admin.44905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59868.log 2024-09-19T09:25:17.852 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45627.log.gz 2024-09-19T09:25:17.852 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44905.log.gz 2024-09-19T09:25:17.852 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.55283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57477.log 2024-09-19T09:25:17.852 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57055.log 2024-09-19T09:25:17.852 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.59868.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55283.log.gz 2024-09-19T09:25:17.852 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.59868.log.gz 2024-09-19T09:25:17.852 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.57477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46436.log 2024-09-19T09:25:17.852 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.57477.log.gz 2024-09-19T09:25:17.852 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42038.log 2024-09-19T09:25:17.852 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.57055.log: /var/log/ceph/ceph-client.admin.46436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45917.log 2024-09-19T09:25:17.852 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57055.log.gz 2024-09-19T09:25:17.852 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46436.log.gz 2024-09-19T09:25:17.853 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48336.log 2024-09-19T09:25:17.853 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.42038.log.gz 2024-09-19T09:25:17.853 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.53839.log 2024-09-19T09:25:17.853 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45917.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45917.log.gz 2024-09-19T09:25:17.853 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46310.log 2024-09-19T09:25:17.853 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59676.log 2024-09-19T09:25:17.853 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53839.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48336.log.gz 2024-09-19T09:25:17.853 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46310.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53839.log.gz 2024-09-19T09:25:17.853 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59988.log 2024-09-19T09:25:17.853 INFO:teuthology.orchestra.run.smithi018.stderr:gzip 87.9% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.46310.log.gz -- 2024-09-19T09:25:17.853 INFO:teuthology.orchestra.run.smithi018.stderr: /var/log/ceph/ceph-client.admin.56216.log 2024-09-19T09:25:17.853 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.59676.log: /var/log/ceph/ceph-client.admin.59988.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.59676.log.gz 2024-09-19T09:25:17.853 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46352.log 2024-09-19T09:25:17.853 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59988.log.gz 2024-09-19T09:25:17.854 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50365.log 2024-09-19T09:25:17.854 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.56216.log: /var/log/ceph/ceph-client.admin.46352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53625.log 2024-09-19T09:25:17.854 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56216.log.gz 2024-09-19T09:25:17.854 INFO:teuthology.orchestra.run.smithi018.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46352.log.gz 2024-09-19T09:25:17.854 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63533.log 2024-09-19T09:25:17.856 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53625.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50365.log.gz 2024-09-19T09:25:17.856 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58688.log 2024-09-19T09:25:17.856 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53625.log.gz 2024-09-19T09:25:17.857 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.63533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32999.log 2024-09-19T09:25:17.857 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63533.log.gz 2024-09-19T09:25:17.857 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.58688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59864.log 2024-09-19T09:25:17.857 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32999.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58688.log.gz 2024-09-19T09:25:17.857 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64123.log 2024-09-19T09:25:17.857 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32999.log.gz 2024-09-19T09:25:17.857 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45115.log 2024-09-19T09:25:17.857 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.59864.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.59864.log.gz 2024-09-19T09:25:17.857 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51371.log 2024-09-19T09:25:17.857 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.64123.log: /var/log/ceph/ceph-client.admin.45115.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.64123.log.gz 2024-09-19T09:25:17.857 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57981.log 2024-09-19T09:25:17.857 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56799.log 2024-09-19T09:25:17.857 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45115.log.gz 2024-09-19T09:25:17.858 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51371.log: /var/log/ceph/ceph-client.admin.57981.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51371.log.gz 2024-09-19T09:25:17.858 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34961.log 2024-09-19T09:25:17.858 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57981.log.gz 2024-09-19T09:25:17.858 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54146.log 2024-09-19T09:25:17.858 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.56799.log: /var/log/ceph/ceph-client.admin.34961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41912.log 2024-09-19T09:25:17.858 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.56799.log.gz 2024-09-19T09:25:17.858 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34961.log.gz 2024-09-19T09:25:17.858 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.54146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33650.log 2024-09-19T09:25:17.858 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54146.log.gz/var/log/ceph/ceph-client.admin.41912.log: 2024-09-19T09:25:17.858 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47766.log 2024-09-19T09:25:17.858 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41912.log.gz 2024-09-19T09:25:17.858 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48677.log 2024-09-19T09:25:17.858 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33650.log: /var/log/ceph/ceph-client.admin.47766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39820.log 2024-09-19T09:25:17.859 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33650.log.gz 2024-09-19T09:25:17.859 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47766.log.gz 2024-09-19T09:25:17.859 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46054.log 2024-09-19T09:25:17.859 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33655.log 2024-09-19T09:25:17.859 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39820.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48677.log.gz 2024-09-19T09:25:17.859 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46054.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39820.log.gz 2024-09-19T09:25:17.859 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39447.log 2024-09-19T09:25:17.859 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46054.log.gz 2024-09-19T09:25:17.859 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55061.log 2024-09-19T09:25:17.859 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33655.log: /var/log/ceph/ceph-client.admin.39447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53055.log 2024-09-19T09:25:17.859 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33655.log.gz 2024-09-19T09:25:17.859 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.55061.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39447.log.gz 2024-09-19T09:25:17.859 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43661.log 2024-09-19T09:25:17.859 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55061.log.gz 2024-09-19T09:25:17.860 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55593.log 2024-09-19T09:25:17.860 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43661.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53055.log.gz 2024-09-19T09:25:17.860 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57601.log 2024-09-19T09:25:17.860 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43661.log.gz 2024-09-19T09:25:17.860 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.55593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55693.log 2024-09-19T09:25:17.860 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55593.log.gz 2024-09-19T09:25:17.860 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.57601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60375.log 2024-09-19T09:25:17.860 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.55693.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57601.log.gz 2024-09-19T09:25:17.860 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53266.log 2024-09-19T09:25:17.860 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.55693.log.gz 2024-09-19T09:25:17.860 INFO:teuthology.orchestra.run.smithi018.stderr:gzip/var/log/ceph/ceph-client.admin.60375.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33185.log 2024-09-19T09:25:17.860 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58562.log 2024-09-19T09:25:17.861 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60375.log.gz 2024-09-19T09:25:17.861 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33185.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53266.log.gz 2024-09-19T09:25:17.861 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56887.log 2024-09-19T09:25:17.861 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose 88.2% -- /var/log/ceph/ceph-client.admin.61592.log -- replaced with /var/log/ceph/ceph-client.admin.33185.log.gz 2024-09-19T09:25:17.861 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-19T09:25:17.861 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.58562.log: /var/log/ceph/ceph-client.admin.56887.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58562.log.gz 2024-09-19T09:25:17.861 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32957.log 2024-09-19T09:25:17.861 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54967.log 2024-09-19T09:25:17.861 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.61592.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56887.log.gz 2024-09-19T09:25:17.861 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32957.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.61592.log.gz 2024-09-19T09:25:17.861 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33990.log 2024-09-19T09:25:17.861 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32957.log.gz 2024-09-19T09:25:17.861 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33659.log 2024-09-19T09:25:17.862 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.54967.log: /var/log/ceph/ceph-client.admin.33990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34293.log 2024-09-19T09:25:17.862 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54967.log.gz 2024-09-19T09:25:17.862 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33659.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33990.log.gz 2024-09-19T09:25:17.862 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42306.log 2024-09-19T09:25:17.862 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33659.log.gz 2024-09-19T09:25:17.862 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56660.log 2024-09-19T09:25:17.862 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58349.log 2024-09-19T09:25:17.862 INFO:teuthology.orchestra.run.smithi018.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34293.log.gz 2024-09-19T09:25:17.862 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42306.log: /var/log/ceph/ceph-client.admin.56660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61928.log 2024-09-19T09:25:17.862 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42306.log.gz 2024-09-19T09:25:17.862 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56660.log.gz 2024-09-19T09:25:17.862 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44989.log 2024-09-19T09:25:17.862 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.58349.log: /var/log/ceph/ceph-client.admin.61928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39718.log 2024-09-19T09:25:17.863 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58349.log.gz 2024-09-19T09:25:17.863 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60940.log 2024-09-19T09:25:17.863 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44989.log.gz 2024-09-19T09:25:17.863 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39718.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.61928.log.gz 2024-09-19T09:25:17.863 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51497.log 2024-09-19T09:25:17.863 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39718.log.gz 2024-09-19T09:25:17.863 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55777.log 2024-09-19T09:25:17.863 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.60940.log: /var/log/ceph/ceph-client.admin.51497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63955.log 2024-09-19T09:25:17.863 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60940.log.gz 2024-09-19T09:25:17.863 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51497.log.gz 2024-09-19T09:25:17.863 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.55777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44947.log 2024-09-19T09:25:17.863 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40618.log 2024-09-19T09:25:17.863 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.63955.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55777.log.gz 2024-09-19T09:25:17.864 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60814.log 2024-09-19T09:25:17.864 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.63955.log.gz 2024-09-19T09:25:17.864 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44947.log.gz 2024-09-19T09:25:17.864 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64585.log 2024-09-19T09:25:17.864 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40618.log: /var/log/ceph/ceph-client.admin.60814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63473.log 2024-09-19T09:25:17.864 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40618.log.gz 2024-09-19T09:25:17.864 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60814.log.gz 2024-09-19T09:25:17.864 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.64585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33654.log 2024-09-19T09:25:17.864 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38620.log 2024-09-19T09:25:17.864 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.63473.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.64585.log.gz 2024-09-19T09:25:17.864 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33654.log: gzip -5 89.4% --verbose -- replaced with /var/log/ceph/ceph-client.admin.63473.log.gz -- 2024-09-19T09:25:17.864 INFO:teuthology.orchestra.run.smithi018.stderr: /var/log/ceph/ceph-client.admin.33979.log 2024-09-19T09:25:17.864 INFO:teuthology.orchestra.run.smithi018.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33654.log.gz 2024-09-19T09:25:17.865 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42406.log 2024-09-19T09:25:17.865 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38620.log: /var/log/ceph/ceph-client.admin.33979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53667.log 2024-09-19T09:25:17.865 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38620.log.gz 2024-09-19T09:25:17.865 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33979.log.gz 2024-09-19T09:25:17.865 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40870.log 2024-09-19T09:25:17.865 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53667.log: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60417.log 2024-09-19T09:25:17.865 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42406.log.gz 2024-09-19T09:25:17.865 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.53667.log.gz 2024-09-19T09:25:17.865 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40660.log 2024-09-19T09:25:17.865 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.60417.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40870.log.gz 2024-09-19T09:25:17.865 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37331.log 2024-09-19T09:25:17.865 INFO:teuthology.orchestra.run.smithi018.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.60417.log.gz 2024-09-19T09:25:17.865 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34289.log 2024-09-19T09:25:17.866 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40660.log.gz 2024-09-19T09:25:17.866 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50155.log 2024-09-19T09:25:17.866 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37331.log: /var/log/ceph/ceph-client.admin.34289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46012.log 2024-09-19T09:25:17.866 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37331.log.gz 2024-09-19T09:25:17.866 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34289.log.gz 2024-09-19T09:25:17.866 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42803.log 2024-09-19T09:25:17.866 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose 88.7% -- /var/log/ceph/ceph-client.admin.62324.log -- replaced with /var/log/ceph/ceph-client.admin.50155.log.gz 2024-09-19T09:25:17.866 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-19T09:25:17.866 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46012.log: /var/log/ceph/ceph-client.admin.42803.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46012.log.gz 2024-09-19T09:25:17.866 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51581.log 2024-09-19T09:25:17.866 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42803.log.gz 2024-09-19T09:25:17.866 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63347.log 2024-09-19T09:25:17.866 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.62324.log: /var/log/ceph/ceph-client.admin.51581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33661.log 2024-09-19T09:25:17.867 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62324.log.gz 2024-09-19T09:25:17.867 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.63347.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51581.log.gz 2024-09-19T09:25:17.867 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60543.log 2024-09-19T09:25:17.867 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38822.log 2024-09-19T09:25:17.867 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.63347.log.gz 2024-09-19T09:25:17.867 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33661.log: /var/log/ceph/ceph-client.admin.60543.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33661.log.gz 2024-09-19T09:25:17.867 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61504.log 2024-09-19T09:25:17.867 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.60543.log.gz 2024-09-19T09:25:17.867 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63762.log 2024-09-19T09:25:17.867 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38822.log: /var/log/ceph/ceph-client.admin.61504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45747.log 2024-09-19T09:25:17.867 INFO:teuthology.orchestra.run.smithi018.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38822.log.gz 2024-09-19T09:25:17.867 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61504.log.gz 2024-09-19T09:25:17.867 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.63762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54380.log 2024-09-19T09:25:17.868 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45747.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63762.log.gz 2024-09-19T09:25:17.868 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-19T09:25:17.868 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45747.log.gz 2024-09-19T09:25:17.868 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63305.log 2024-09-19T09:25:17.868 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.54380.log: /var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36941.log 2024-09-19T09:25:17.868 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54380.log.gz 2024-09-19T09:25:17.868 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.63305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32577.log 2024-09-19T09:25:17.868 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36941.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.63305.log.gz 2024-09-19T09:25:17.868 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55903.log 2024-09-19T09:25:17.868 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36941.log.gz 2024-09-19T09:25:17.868 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37415.log 2024-09-19T09:25:17.868 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.55903.log: /var/log/ceph/ceph-client.admin.43997.log 2024-09-19T09:25:17.868 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32577.log.gz 2024-09-19T09:25:17.869 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56006.log 2024-09-19T09:25:17.869 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55903.log.gz 2024-09-19T09:25:17.869 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46394.log 2024-09-19T09:25:17.869 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37415.log.gz 2024-09-19T09:25:17.869 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43997.log.gz 2024-09-19T09:25:17.869 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.56006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50575.log 2024-09-19T09:25:17.869 INFO:teuthology.orchestra.run.smithi018.stderr: 89.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-19T09:25:17.869 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64459.log 2024-09-19T09:25:17.869 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46394.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56006.log.gz 2024-09-19T09:25:17.869 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49223.log 2024-09-19T09:25:17.869 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46394.log.gz 2024-09-19T09:25:17.869 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50575.log.gz 2024-09-19T09:25:17.869 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.64459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56618.log 2024-09-19T09:25:17.870 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64459.log.gz 2024-09-19T09:25:17.870 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39760.log 2024-09-19T09:25:17.870 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49223.log: /var/log/ceph/ceph-client.admin.56618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50533.log 2024-09-19T09:25:17.870 INFO:teuthology.orchestra.run.smithi018.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49223.log.gz 2024-09-19T09:25:17.870 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56618.log.gz 2024-09-19T09:25:17.870 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34655.log 2024-09-19T09:25:17.870 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33227.log 2024-09-19T09:25:17.870 INFO:teuthology.orchestra.run.smithi018.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39760.log.gz 2024-09-19T09:25:17.870 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50533.log: /var/log/ceph/ceph-client.admin.34655.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50533.log.gz -5 2024-09-19T09:25:17.870 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.49765.log 2024-09-19T09:25:17.870 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34655.log.gz 2024-09-19T09:25:17.870 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43829.log 2024-09-19T09:25:17.870 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33227.log: /var/log/ceph/ceph-client.admin.49765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40008.log 2024-09-19T09:25:17.871 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33227.log.gz 2024-09-19T09:25:17.871 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43829.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.49765.log.gz 2024-09-19T09:25:17.871 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.52995.log 2024-09-19T09:25:17.871 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43829.log.gz 2024-09-19T09:25:17.871 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39573.log 2024-09-19T09:25:17.871 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33143.log 2024-09-19T09:25:17.871 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3%/var/log/ceph/ceph-client.admin.52995.log: -- replaced with /var/log/ceph/ceph-client.admin.40008.log.gz 2024-09-19T09:25:17.871 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39573.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52995.log.gz 2024-09-19T09:25:17.871 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64291.log 2024-09-19T09:25:17.871 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39573.log.gz 2024-09-19T09:25:17.871 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38032.log 2024-09-19T09:25:17.871 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33143.log: /var/log/ceph/ceph-client.admin.64291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56174.log 2024-09-19T09:25:17.871 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33143.log.gz 2024-09-19T09:25:17.871 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38032.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.64291.log.gz 2024-09-19T09:25:17.872 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39263.log 2024-09-19T09:25:17.872 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38032.log.gz 2024-09-19T09:25:17.872 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.56174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37081.log 2024-09-19T09:25:17.872 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56174.log.gz 2024-09-19T09:25:17.872 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35935.log 2024-09-19T09:25:17.872 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58944.log 2024-09-19T09:25:17.872 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37081.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39263.log.gz 2024-09-19T09:25:17.872 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35935.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37081.log.gz 2024-09-19T09:25:17.872 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62386.log 2024-09-19T09:25:17.872 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50113.log 2024-09-19T09:25:17.872 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35935.log.gz 2024-09-19T09:25:17.872 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.58944.log: /var/log/ceph/ceph-client.admin.62386.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58944.log.gz 2024-09-19T09:25:17.872 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61119.log 2024-09-19T09:25:17.873 INFO:teuthology.orchestra.run.smithi018.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62386.log.gz 2024-09-19T09:25:17.873 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45073.log 2024-09-19T09:25:17.873 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50113.log: /var/log/ceph/ceph-client.admin.61119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61886.log 2024-09-19T09:25:17.873 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50113.log.gz 2024-09-19T09:25:17.873 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61119.log.gz 2024-09-19T09:25:17.873 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64249.log 2024-09-19T09:25:17.873 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46958.log 2024-09-19T09:25:17.873 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.61886.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45073.log.gz 2024-09-19T09:25:17.873 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.64249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59073.log 2024-09-19T09:25:17.873 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61886.log.gz 2024-09-19T09:25:17.873 INFO:teuthology.orchestra.run.smithi018.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64249.log.gz 2024-09-19T09:25:17.873 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60730.log 2024-09-19T09:25:17.873 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46958.log: /var/log/ceph/ceph-client.admin.59073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56090.log 2024-09-19T09:25:17.873 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46958.log.gz 2024-09-19T09:25:17.874 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.60730.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59073.log.gz 2024-09-19T09:25:17.874 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54754.log 2024-09-19T09:25:17.874 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.60730.log.gz 2024-09-19T09:25:17.874 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.56090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57289.log 2024-09-19T09:25:17.874 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56090.log.gz 2024-09-19T09:25:17.874 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63389.log 2024-09-19T09:25:17.874 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.54754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37543.log 2024-09-19T09:25:17.874 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.57289.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54754.log.gz 2024-09-19T09:25:17.874 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.63389.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57289.log.gz 2024-09-19T09:25:17.874 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46580.log 2024-09-19T09:25:17.874 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63389.log.gz 2024-09-19T09:25:17.874 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48551.log 2024-09-19T09:25:17.874 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37543.log: /var/log/ceph/ceph-client.admin.46580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51455.log 2024-09-19T09:25:17.874 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37543.log.gz 2024-09-19T09:25:17.875 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33083.log 2024-09-19T09:25:17.875 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46580.log.gz 2024-09-19T09:25:17.875 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48551.log: /var/log/ceph/ceph-client.admin.51455.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48551.log.gz 2024-09-19T09:25:17.875 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58783.log 2024-09-19T09:25:17.875 INFO:teuthology.orchestra.run.smithi018.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.51455.log.gz 2024-09-19T09:25:17.875 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34291.log 2024-09-19T09:25:17.875 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33083.log: /var/log/ceph/ceph-client.admin.58783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33997.log 2024-09-19T09:25:17.875 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33083.log.gz 2024-09-19T09:25:17.875 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58783.log.gz 2024-09-19T09:25:17.875 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43033.log 2024-09-19T09:25:17.875 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51060.log 2024-09-19T09:25:17.875 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34291.log.gz 2024-09-19T09:25:17.875 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33997.log: /var/log/ceph/ceph-client.admin.43033.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33997.log.gz 2024-09-19T09:25:17.875 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55651.log 2024-09-19T09:25:17.876 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43033.log.gz 2024-09-19T09:25:17.876 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51283.log 2024-09-19T09:25:17.876 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51060.log: /var/log/ceph/ceph-client.admin.55651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43531.log 2024-09-19T09:25:17.876 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51060.log.gz 2024-09-19T09:25:17.876 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51283.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55651.log.gz 2024-09-19T09:25:17.876 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47191.log 2024-09-19T09:25:17.876 INFO:teuthology.orchestra.run.smithi018.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51283.log.gz 2024-09-19T09:25:17.876 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33479.log 2024-09-19T09:25:17.876 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37162.log 2024-09-19T09:25:17.876 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43531.log.gz 2024-09-19T09:25:17.876 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47191.log: /var/log/ceph/ceph-client.admin.33479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35977.log 2024-09-19T09:25:17.876 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47191.log.gz 2024-09-19T09:25:17.876 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33479.log.gz 2024-09-19T09:25:17.877 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51731.log 2024-09-19T09:25:17.877 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37162.log: /var/log/ceph/ceph-client.admin.35977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49530.log 2024-09-19T09:25:17.877 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37162.log.gz 2024-09-19T09:25:17.877 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51731.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35977.log.gz 2024-09-19T09:25:17.877 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39489.log 2024-09-19T09:25:17.877 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51731.log.gz 2024-09-19T09:25:17.877 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60239.log 2024-09-19T09:25:17.877 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37638.log 2024-09-19T09:25:17.877 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49530.log.gz 2024-09-19T09:25:17.877 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39489.log: /var/log/ceph/ceph-client.admin.60239.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39489.log.gz 2024-09-19T09:25:17.877 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41458.log 2024-09-19T09:25:17.877 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60239.log.gz 2024-09-19T09:25:17.877 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59568.log 2024-09-19T09:25:17.877 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37638.log: /var/log/ceph/ceph-client.admin.41458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58123.log 2024-09-19T09:25:17.878 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37638.log.gz 2024-09-19T09:25:17.878 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41458.log.gz 2024-09-19T09:25:17.878 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.59568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54020.log 2024-09-19T09:25:17.878 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59568.log.gz 2024-09-19T09:25:17.878 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.58123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63591.log 2024-09-19T09:25:17.878 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47808.log 2024-09-19T09:25:17.878 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58123.log.gz 2024-09-19T09:25:17.878 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.54020.log: /var/log/ceph/ceph-client.admin.63591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54882.log 2024-09-19T09:25:17.878 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54020.log.gz 2024-09-19T09:25:17.878 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63591.log.gz 2024-09-19T09:25:17.878 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41783.log 2024-09-19T09:25:17.878 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47808.log: /var/log/ceph/ceph-client.admin.54882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46268.log 2024-09-19T09:25:17.878 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47808.log.gz 2024-09-19T09:25:17.879 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41783.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54882.log.gz 2024-09-19T09:25:17.879 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52244.log 2024-09-19T09:25:17.879 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41783.log.gz 2024-09-19T09:25:17.879 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46478.log 2024-09-19T09:25:17.879 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42887.log 2024-09-19T09:25:17.879 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9%/var/log/ceph/ceph-client.admin.52244.log: -- replaced with /var/log/ceph/ceph-client.admin.46268.log.gz 2024-09-19T09:25:17.879 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46478.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30384.log 2024-09-19T09:25:17.879 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52244.log.gz 2024-09-19T09:25:17.879 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46478.log.gz 2024-09-19T09:25:17.879 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55861.log 2024-09-19T09:25:17.879 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42887.log: /var/log/ceph/ceph.tmp-client.admin.30384.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-19T09:25:17.879 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30384.log.gz 2024-09-19T09:25:17.879 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42887.log.gz 2024-09-19T09:25:17.880 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.55861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64501.log 2024-09-19T09:25:17.880 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55861.log.gz 2024-09-19T09:25:17.880 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42490.log 2024-09-19T09:25:17.880 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56576.log 2024-09-19T09:25:17.880 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.64501.log: /var/log/ceph/ceph-client.admin.42490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53974.log 2024-09-19T09:25:17.880 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.64501.log.gz 2024-09-19T09:25:17.880 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42490.log.gz 2024-09-19T09:25:17.880 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.56576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49572.log 2024-09-19T09:25:17.880 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54062.log 2024-09-19T09:25:17.880 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53974.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56576.log.gz 2024-09-19T09:25:17.880 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38961.log 2024-09-19T09:25:17.880 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53974.log.gz 2024-09-19T09:25:17.880 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49572.log.gz 2024-09-19T09:25:17.881 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.54062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48953.log 2024-09-19T09:25:17.881 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38961.log: 89.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35892.log 2024-09-19T09:25:17.881 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54062.log.gz 2024-09-19T09:25:17.881 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38961.log.gz 2024-09-19T09:25:17.881 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47369.log 2024-09-19T09:25:17.881 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.35892.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48953.log.gz 2024-09-19T09:25:17.881 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46142.log 2024-09-19T09:25:17.881 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35892.log.gz 2024-09-19T09:25:17.881 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43418.log 2024-09-19T09:25:17.881 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64877.log 2024-09-19T09:25:17.881 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46142.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47369.log.gz 2024-09-19T09:25:17.881 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52607.log 2024-09-19T09:25:17.881 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46142.log.gz 2024-09-19T09:25:17.882 INFO:teuthology.orchestra.run.smithi018.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43418.log.gz 2024-09-19T09:25:17.882 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.64877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54230.log 2024-09-19T09:25:17.882 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33269.log 2024-09-19T09:25:17.882 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52607.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64877.log.gz 2024-09-19T09:25:17.882 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.54230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44805.log 2024-09-19T09:25:17.882 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52607.log.gz 2024-09-19T09:25:17.882 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33269.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.54230.log.gz 2024-09-19T09:25:17.882 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.63678.log 2024-09-19T09:25:17.882 INFO:teuthology.orchestra.run.smithi018.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33269.log.gz 2024-09-19T09:25:17.882 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60856.log 2024-09-19T09:25:17.882 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52383.log 2024-09-19T09:25:17.882 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.63678.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44805.log.gz 2024-09-19T09:25:17.882 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.60856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64669.log 2024-09-19T09:25:17.883 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63678.log.gz 2024-09-19T09:25:17.883 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60856.log.gz 2024-09-19T09:25:17.883 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49145.log 2024-09-19T09:25:17.883 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.64669.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52383.log.gz 2024-09-19T09:25:17.883 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46688.log 2024-09-19T09:25:17.883 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.64669.log.gz 2024-09-19T09:25:17.883 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.49145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60687.log 2024-09-19T09:25:17.883 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.49145.log.gz 2024-09-19T09:25:17.883 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48091.log 2024-09-19T09:25:17.883 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46688.log: /var/log/ceph/ceph-client.admin.60687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43913.log 2024-09-19T09:25:17.883 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46688.log.gz 2024-09-19T09:25:17.883 INFO:teuthology.orchestra.run.smithi018.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60687.log.gz 2024-09-19T09:25:17.883 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51018.log 2024-09-19T09:25:17.884 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40828.log 2024-09-19T09:25:17.884 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43913.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48091.log.gz 2024-09-19T09:25:17.884 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51018.log: gzip -5 --verbose 88.3% -- /var/log/ceph/ceph-client.admin.48171.log -- replaced with /var/log/ceph/ceph-client.admin.43913.log.gz 2024-09-19T09:25:17.884 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-19T09:25:17.884 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40828.log: gzip -5 88.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.51018.log.gz /var/log/ceph/ceph-client.admin.57223.log 2024-09-19T09:25:17.884 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-19T09:25:17.884 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40828.log.gz 2024-09-19T09:25:17.884 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57139.log 2024-09-19T09:25:17.884 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49412.log 2024-09-19T09:25:17.884 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.57223.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48171.log.gz 2024-09-19T09:25:17.884 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.57139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55103.log 2024-09-19T09:25:17.884 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57139.log.gz 2024-09-19T09:25:17.884 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54188.log 2024-09-19T09:25:17.884 INFO:teuthology.orchestra.run.smithi018.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.57223.log.gz 2024-09-19T09:25:17.885 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64753.log 2024-09-19T09:25:17.885 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49412.log.gz 2024-09-19T09:25:17.885 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.55103.log: /var/log/ceph/ceph-client.admin.54188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36773.log 2024-09-19T09:25:17.885 INFO:teuthology.orchestra.run.smithi018.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55103.log.gz 2024-09-19T09:25:17.885 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.64753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39862.log 2024-09-19T09:25:17.885 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.54188.log.gz 2024-09-19T09:25:17.885 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36773.log: gzip -5 89.1% -- replaced with /var/log/ceph/ceph-client.admin.64753.log.gz 2024-09-19T09:25:17.885 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.61409.log 2024-09-19T09:25:17.885 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36773.log.gz 2024-09-19T09:25:17.885 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33041.log 2024-09-19T09:25:17.885 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39862.log.gz 2024-09-19T09:25:17.885 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.61409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41146.log 2024-09-19T09:25:17.885 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.35755.log 88.2% 2024-09-19T09:25:17.886 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61409.log.gz 2024-09-19T09:25:17.886 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33041.log.gz 2024-09-19T09:25:17.886 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41666.log 2024-09-19T09:25:17.886 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45260.log 2024-09-19T09:25:17.886 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9%/var/log/ceph/ceph-client.2.35755.log: -- replaced with /var/log/ceph/ceph-client.admin.41146.log.gz 2024-09-19T09:25:17.886 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.35755.log.gz 2024-09-19T09:25:17.886 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44381.log 2024-09-19T09:25:17.886 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45260.log: gzip 89.2% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.41666.log.gz -- 2024-09-19T09:25:17.886 INFO:teuthology.orchestra.run.smithi018.stderr: /var/log/ceph/ceph-client.admin.33311.log 2024-09-19T09:25:17.886 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45260.log.gz 2024-09-19T09:25:17.886 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40786.log/var/log/ceph/ceph-client.0.44381.log: 2024-09-19T09:25:17.886 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44381.log.gz 2024-09-19T09:25:17.886 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62514.log 2024-09-19T09:25:17.887 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33311.log: /var/log/ceph/ceph-client.admin.40786.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33311.log.gz 2024-09-19T09:25:17.887 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.62673.log 2024-09-19T09:25:17.887 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.62514.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40786.log.gz 2024-09-19T09:25:17.887 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35317.log 2024-09-19T09:25:17.887 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62514.log.gz 2024-09-19T09:25:17.887 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.62673.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-19T09:25:17.887 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51413.log 2024-09-19T09:25:17.887 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.35317.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.62673.log.gz 2024-09-19T09:25:17.887 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.35317.log.gz 2024-09-19T09:25:17.887 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50491.log 2024-09-19T09:25:17.887 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32787.log 2024-09-19T09:25:17.887 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50491.log: gzip 89.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.51413.log.gz --verbose 2024-09-19T09:25:17.888 INFO:teuthology.orchestra.run.smithi018.stderr: -- /var/log/ceph/ceph-client.admin.50407.log 2024-09-19T09:25:17.888 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59442.log 2024-09-19T09:25:17.888 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50491.log.gz 2024-09-19T09:25:17.888 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45470.log 2024-09-19T09:25:17.888 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32787.log.gz 2024-09-19T09:25:17.888 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50407.log: /var/log/ceph/ceph-client.admin.59442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37289.log 2024-09-19T09:25:17.888 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9%/var/log/ceph/ceph-client.admin.45470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60050.log 2024-09-19T09:25:17.888 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59442.log.gz 2024-09-19T09:25:17.888 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50407.log.gz 2024-09-19T09:25:17.888 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45470.log.gz 2024-09-19T09:25:17.888 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55241.log 2024-09-19T09:25:17.888 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37289.log.gz 2024-09-19T09:25:17.888 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.60050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33993.log 2024-09-19T09:25:17.889 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.55241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47637.log 2024-09-19T09:25:17.889 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.60050.log.gz 2024-09-19T09:25:17.889 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39531.log 2024-09-19T09:25:17.889 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55241.log.gz 2024-09-19T09:25:17.889 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48509.log 2024-09-19T09:25:17.889 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33993.log.gz 2024-09-19T09:25:17.889 INFO:teuthology.orchestra.run.smithi018.stderr:gzip 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47637.log.gz 2024-09-19T09:25:17.889 INFO:teuthology.orchestra.run.smithi018.stderr: -5/var/log/ceph/ceph-client.admin.39531.log: --verbose -- /var/log/ceph/ceph-client.admin.49807.log 2024-09-19T09:25:17.889 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48509.log: gzip -5 --verbose -- 89.1% /var/log/ceph/ceph-client.admin.51190.log 2024-09-19T09:25:17.889 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39531.log.gz 2024-09-19T09:25:17.889 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9%/var/log/ceph/ceph-client.admin.49807.log: -- replaced with /var/log/ceph/ceph-client.admin.48509.log.gz 2024-09-19T09:25:17.889 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32481.log 2024-09-19T09:25:17.889 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49807.log.gz 2024-09-19T09:25:17.889 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53795.log 2024-09-19T09:25:17.890 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32481.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51190.log.gz 2024-09-19T09:25:17.890 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37822.log 2024-09-19T09:25:17.890 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53795.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32481.log.gz 2024-09-19T09:25:17.890 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60501.log 2024-09-19T09:25:17.890 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53795.log.gz 2024-09-19T09:25:17.890 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47682.log 2024-09-19T09:25:17.890 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.60501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64333.log 2024-09-19T09:25:17.890 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37822.log.gz 2024-09-19T09:25:17.890 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54650.log 2024-09-19T09:25:17.890 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60501.log.gz 2024-09-19T09:25:17.890 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58081.log 2024-09-19T09:25:17.890 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47682.log.gz 2024-09-19T09:25:17.890 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.64333.log: /var/log/ceph/ceph-client.admin.54650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45167.log 2024-09-19T09:25:17.890 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.64333.log.gz 2024-09-19T09:25:17.891 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54650.log.gz 2024-09-19T09:25:17.891 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38074.log 2024-09-19T09:25:17.891 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.58081.log: /var/log/ceph/ceph-client.admin.45167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35312.log 2024-09-19T09:25:17.891 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38074.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45167.log.gzgzip 2024-09-19T09:25:17.891 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- 87.5% /var/log/ceph/ceph-client.admin.56971.log 2024-09-19T09:25:17.891 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58081.log.gz 2024-09-19T09:25:17.891 INFO:teuthology.orchestra.run.smithi018.stderr:gzip 88.5% -5 --verbose -- /var/log/ceph/ceph-client.admin.44081.log 2024-09-19T09:25:17.891 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.35312.log: -- replaced with /var/log/ceph/ceph-client.admin.38074.log.gz 2024-09-19T09:25:17.891 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.35312.log.gz 2024-09-19T09:25:17.891 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.56971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44123.log 2024-09-19T09:25:17.891 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56971.log.gz 2024-09-19T09:25:17.891 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50617.log 2024-09-19T09:25:17.891 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44123.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44081.log.gz 2024-09-19T09:25:17.891 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52869.log 2024-09-19T09:25:17.892 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52785.log 2024-09-19T09:25:17.892 INFO:teuthology.orchestra.run.smithi018.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.44123.log.gz 2024-09-19T09:25:17.892 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60772.log 2024-09-19T09:25:17.892 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50617.log.gz 2024-09-19T09:25:17.892 INFO:teuthology.orchestra.run.smithi018.stderr:gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52869.log.gz -5 2024-09-19T09:25:17.892 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47453.log 2024-09-19T09:25:17.892 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52785.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52785.log.gz 2024-09-19T09:25:17.892 INFO:teuthology.orchestra.run.smithi018.stderr: -5/var/log/ceph/ceph-client.admin.60772.log: --verbose -- /var/log/ceph/ceph-client.0.38500.log 2024-09-19T09:25:17.892 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47453.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.60772.log.gz 2024-09-19T09:25:17.892 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-19T09:25:17.892 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47453.log.gz 2024-09-19T09:25:17.892 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.38500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42228.log 2024-09-19T09:25:17.892 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.38500.log.gz 2024-09-19T09:25:17.893 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37680.log 2024-09-19T09:25:17.893 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49283.log 2024-09-19T09:25:17.893 INFO:teuthology.orchestra.run.smithi018.stderr:gzip/var/log/ceph/ceph-client.admin.37680.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.38308.log 2024-09-19T09:25:17.893 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42228.log.gz 2024-09-19T09:25:17.893 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37680.log.gz 2024-09-19T09:25:17.893 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49283.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49283.log.gz 2024-09-19T09:25:17.893 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38496.log 2024-09-19T09:25:17.893 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64711.log 2024-09-19T09:25:17.893 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9%/var/log/ceph/ceph-client.0.38496.log: -- replaced with /var/log/ceph/ceph-client.admin.38308.log.gz 2024-09-19T09:25:17.893 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.38496.log.gz 2024-09-19T09:25:17.893 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59526.log 2024-09-19T09:25:17.893 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60982.log 2024-09-19T09:25:17.893 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.64711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42532.log 2024-09-19T09:25:17.893 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.59526.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.64711.log.gz/var/log/ceph/ceph-client.admin.60982.log: 2024-09-19T09:25:17.894 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60982.log.gz 2024-09-19T09:25:17.894 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58165.log 2024-09-19T09:25:17.894 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59526.log.gz/var/log/ceph/ceph-client.admin.42532.log: 2024-09-19T09:25:17.894 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32743.log 2024-09-19T09:25:17.894 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42532.log.gz 2024-09-19T09:25:17.894 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.58165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47495.log 2024-09-19T09:25:17.894 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58165.log.gz 2024-09-19T09:25:17.894 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45031.log 2024-09-19T09:25:17.894 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32743.log: /var/log/ceph/ceph-client.admin.47495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53392.log 2024-09-19T09:25:17.894 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45031.log: 88.1% 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47495.log.gz 2024-09-19T09:25:17.894 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32743.log.gz 2024-09-19T09:25:17.894 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45031.log.gz 2024-09-19T09:25:17.894 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38780.log 2024-09-19T09:25:17.895 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.53392.log: -- /var/log/ceph/ceph-client.admin.36815.log 2024-09-19T09:25:17.895 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38864.log 2024-09-19T09:25:17.895 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53392.log.gz 2024-09-19T09:25:17.895 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38780.log.gz 2024-09-19T09:25:17.895 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36815.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36815.log.gz 2024-09-19T09:25:17.895 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57013.log 2024-09-19T09:25:17.895 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40103.log 2024-09-19T09:25:17.895 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3%/var/log/ceph/ceph-client.admin.57013.log: -- replaced with /var/log/ceph/ceph-client.admin.38864.log.gz 2024-09-19T09:25:17.895 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36647.log 2024-09-19T09:25:17.895 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.57013.log.gz 2024-09-19T09:25:17.895 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52827.log 2024-09-19T09:25:17.895 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40103.log: /var/log/ceph/ceph-client.admin.36647.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40103.log.gz 2024-09-19T09:25:17.895 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36647.log.gz 2024-09-19T09:25:17.895 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53098.log 2024-09-19T09:25:17.896 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52827.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-19T09:25:17.896 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7%/var/log/ceph/ceph-client.admin.53098.log: -- replaced with /var/log/ceph/ceph-client.admin.52827.log.gz 2024-09-19T09:25:17.896 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40223.log 2024-09-19T09:25:17.896 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53098.log.gz 2024-09-19T09:25:17.896 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37906.log 2024-09-19T09:25:17.896 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62715.log 2024-09-19T09:25:17.896 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40223.log: /var/log/ceph/ceph-client.admin.37906.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40223.log.gz 2024-09-19T09:25:17.896 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37906.log.gz 2024-09-19T09:25:17.896 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43289.log 2024-09-19T09:25:17.896 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41334.log 2024-09-19T09:25:17.896 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.62715.log: /var/log/ceph/ceph-client.admin.43289.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62715.log.gz 2024-09-19T09:25:17.896 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43289.log.gz 2024-09-19T09:25:17.896 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61844.log 2024-09-19T09:25:17.897 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63127.log 2024-09-19T09:25:17.897 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.41334.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.41334.log.gz 2024-09-19T09:25:17.897 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.61844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55961.log 2024-09-19T09:25:17.897 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61844.log.gz 2024-09-19T09:25:17.897 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.63127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54272.log 2024-09-19T09:25:17.897 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7%/var/log/ceph/ceph-client.admin.55961.log: -- replaced with /var/log/ceph/ceph-client.admin.63127.log.gz 2024-09-19T09:25:17.897 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55961.log.gz 2024-09-19T09:25:17.897 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61676.log 2024-09-19T09:25:17.897 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.54272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61199.log 2024-09-19T09:25:17.897 INFO:teuthology.orchestra.run.smithi018.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54272.log.gz 2024-09-19T09:25:17.897 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.61676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62895.log 2024-09-19T09:25:17.897 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.61199.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.61676.log.gz 2024-09-19T09:25:17.897 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61199.log.gz 2024-09-19T09:25:17.897 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41954.log 2024-09-19T09:25:17.898 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.62895.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-19T09:25:17.898 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.62895.log.gz 2024-09-19T09:25:17.898 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40393.log 2024-09-19T09:25:17.898 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41954.log.gz 2024-09-19T09:25:17.898 INFO:teuthology.orchestra.run.smithi018.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-19T09:25:17.898 INFO:teuthology.orchestra.run.smithi018.stderr: 86.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-19T09:25:17.898 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36857.log 2024-09-19T09:25:17.898 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37499.log 2024-09-19T09:25:17.898 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36857.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40393.log.gz 2024-09-19T09:25:17.898 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45428.log 2024-09-19T09:25:17.898 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36857.log.gz 2024-09-19T09:25:17.898 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44863.log 2024-09-19T09:25:17.898 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42574.log 2024-09-19T09:25:17.898 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45428.log: 88.9%/var/log/ceph/ceph-client.admin.44863.log: -- replaced with /var/log/ceph/ceph-client.admin.37499.log.gz 2024-09-19T09:25:17.899 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34571.log 2024-09-19T09:25:17.899 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44863.log.gz 2024-09-19T09:25:17.899 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45428.log.gz 2024-09-19T09:25:17.899 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61280.log 2024-09-19T09:25:17.899 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1%/var/log/ceph/ceph-client.admin.34571.log: -- replaced with /var/log/ceph/ceph-client.admin.42574.log.gz 2024-09-19T09:25:17.899 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55325.log 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34571.log.gz 2024-09-19T09:25:17.899 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-19T09:25:17.899 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.61280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37770.log 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61280.log.gz 2024-09-19T09:25:17.899 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-19T09:25:17.899 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.55325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63431.log 2024-09-19T09:25:17.899 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55325.log.gz 2024-09-19T09:25:17.899 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33989.log 2024-09-19T09:25:17.899 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37770.log.gz 2024-09-19T09:25:17.900 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52105.log 2024-09-19T09:25:17.900 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.63431.log: gzip -5 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63431.log.gz 2024-09-19T09:25:17.900 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33989.log: --verbose -- /var/log/ceph/ceph-client.admin.51623.log 2024-09-19T09:25:17.900 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33989.log.gz 2024-09-19T09:25:17.900 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34781.log 2024-09-19T09:25:17.900 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52105.log: /var/log/ceph/ceph-client.admin.51623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36145.log 2024-09-19T09:25:17.900 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34781.log: 88.3% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51623.log.gz 2024-09-19T09:25:17.900 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52105.log.gz 2024-09-19T09:25:17.900 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34781.log.gz 2024-09-19T09:25:17.900 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51665.log 2024-09-19T09:25:17.900 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39321.log 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36145.log.gz 2024-09-19T09:25:17.900 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-19T09:25:17.900 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54568.log 2024-09-19T09:25:17.900 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39321.log: 91.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56258.log 2024-09-19T09:25:17.901 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51665.log.gz 2024-09-19T09:25:17.901 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39321.log.gz 2024-09-19T09:25:17.901 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.54568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46184.log 2024-09-19T09:25:17.901 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.54568.log.gz 2024-09-19T09:25:17.901 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.56258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52001.log 2024-09-19T09:25:17.901 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45831.log 2024-09-19T09:25:17.901 INFO:teuthology.orchestra.run.smithi018.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56258.log.gz 2024-09-19T09:25:17.901 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32873.log 2024-09-19T09:25:17.901 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46184.log.gz 2024-09-19T09:25:17.901 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52001.log: /var/log/ceph/ceph-client.admin.45831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41038.log 2024-09-19T09:25:17.901 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52001.log.gz 2024-09-19T09:25:17.901 INFO:teuthology.orchestra.run.smithi018.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45831.log.gz 2024-09-19T09:25:17.901 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64039.log 2024-09-19T09:25:17.902 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32873.log.gz 2024-09-19T09:25:17.902 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52685.log 2024-09-19T09:25:17.902 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41038.log: /var/log/ceph/ceph-client.admin.64039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62186.log 2024-09-19T09:25:17.902 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52685.log: 89.1% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41038.log.gz 2024-09-19T09:25:17.902 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64039.log.gz 2024-09-19T09:25:17.902 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52953.log 2024-09-19T09:25:17.902 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52685.log.gz 2024-09-19T09:25:17.902 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.62186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54692.log 2024-09-19T09:25:17.902 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.62186.log.gz 2024-09-19T09:25:17.902 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61453.log 2024-09-19T09:25:17.902 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39633.log 2024-09-19T09:25:17.902 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.54692.log: 89.0% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54692.log.gz 2024-09-19T09:25:17.902 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.61453.log: -- replaced with /var/log/ceph/ceph-client.admin.52953.log.gz 2024-09-19T09:25:17.902 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- 88.4% -- replaced with /var/log/ceph/ceph-client.admin.61453.log.gz 2024-09-19T09:25:17.903 INFO:teuthology.orchestra.run.smithi018.stderr: /var/log/ceph/ceph-client.admin.47269.log 2024-09-19T09:25:17.903 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36318.log 2024-09-19T09:25:17.903 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39633.log.gz 2024-09-19T09:25:17.903 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53350.log 89.5% 2024-09-19T09:25:17.903 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47269.log.gz 2024-09-19T09:25:17.903 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38158.log 2024-09-19T09:25:17.903 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36318.log.gz 2024-09-19T09:25:17.903 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61994.log 2024-09-19T09:25:17.903 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.53350.log.gz 2024-09-19T09:25:17.903 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37587.log 2024-09-19T09:25:17.903 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38158.log: /var/log/ceph/ceph-client.admin.61994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44377.log 2024-09-19T09:25:17.903 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37587.log: 88.4% 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61994.log.gz 2024-09-19T09:25:17.903 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38158.log.gz 2024-09-19T09:25:17.903 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37587.log.gz 2024-09-19T09:25:17.904 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58520.log 2024-09-19T09:25:17.904 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.0.44377.log: /var/log/ceph/ceph-client.admin.61364.log 2024-09-19T09:25:17.904 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44377.log.gz 2024-09-19T09:25:17.904 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.58520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42080.log 2024-09-19T09:25:17.904 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58520.log.gz 2024-09-19T09:25:17.904 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.61364.log: gzip -5 --verbose -- 88.6% -- replaced with /var/log/ceph/ceph-client.admin.61364.log.gz 2024-09-19T09:25:17.904 INFO:teuthology.orchestra.run.smithi018.stderr: /var/log/ceph/ceph-client.admin.56704.log 2024-09-19T09:25:17.904 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61802.log 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42080.log.gz 2024-09-19T09:25:17.904 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-19T09:25:17.904 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.56704.log: gzip -5 --verbose -- 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56704.log.gz 2024-09-19T09:25:17.904 INFO:teuthology.orchestra.run.smithi018.stderr: /var/log/ceph/ceph-client.admin.55735.log 2024-09-19T09:25:17.904 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.61802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42719.log 2024-09-19T09:25:17.904 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.61802.log.gz 2024-09-19T09:25:17.905 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.55735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40954.log 2024-09-19T09:25:17.905 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55735.log.gz 2024-09-19T09:25:17.905 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50239.log 2024-09-19T09:25:17.905 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42719.log: /var/log/ceph/ceph-client.admin.40954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51919.log 2024-09-19T09:25:17.905 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42719.log.gz 2024-09-19T09:25:17.905 INFO:teuthology.orchestra.run.smithi018.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.40954.log.gz 2024-09-19T09:25:17.905 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50239.log: gzip -5 --verbose 89.4% -- replaced with /var/log/ceph/ceph-client.admin.50239.log.gz 2024-09-19T09:25:17.905 INFO:teuthology.orchestra.run.smithi018.stderr: -- /var/log/ceph/ceph-client.admin.44189.log 2024-09-19T09:25:17.905 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.51919.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51919.log.gz 2024-09-19T09:25:17.905 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58039.log 2024-09-19T09:25:17.905 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42971.log 88.0% 2024-09-19T09:25:17.905 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44189.log.gz 2024-09-19T09:25:17.905 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.58039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39676.log 2024-09-19T09:25:17.906 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58039.log.gz 2024-09-19T09:25:17.906 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53751.log 2024-09-19T09:25:17.906 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42971.log.gz 2024-09-19T09:25:17.906 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59270.log 2024-09-19T09:25:17.906 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39676.log: /var/log/ceph/ceph-client.admin.53751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33649.log 2024-09-19T09:25:17.906 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.59270.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39676.log.gz 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53751.log.gz 2024-09-19T09:25:17.906 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-19T09:25:17.906 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59270.log.gz 2024-09-19T09:25:17.906 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51325.log 2024-09-19T09:25:17.906 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64165.log 2024-09-19T09:25:17.906 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33649.log.gz 2024-09-19T09:25:17.906 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51146.log 2024-09-19T09:25:17.906 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51325.log.gz 2024-09-19T09:25:17.906 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46096.log 2024-09-19T09:25:17.907 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.64165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46538.log 2024-09-19T09:25:17.907 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51146.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.64165.log.gz 2024-09-19T09:25:17.907 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46096.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51146.log.gz 2024-09-19T09:25:17.907 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46096.log.gz 2024-09-19T09:25:17.907 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44727.log 2024-09-19T09:25:17.907 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.46538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40912.log 2024-09-19T09:25:17.907 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.44727.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46538.log.gz 2024-09-19T09:25:17.907 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39405.log 2024-09-19T09:25:17.907 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44727.log.gz 2024-09-19T09:25:17.907 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58249.log 2024-09-19T09:25:17.907 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52043.log 2024-09-19T09:25:17.907 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39405.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40912.log.gz 2024-09-19T09:25:17.907 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.58249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58986.log 2024-09-19T09:25:17.908 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39405.log.gz 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58249.log.gz 2024-09-19T09:25:17.908 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-19T09:25:17.908 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52043.log: gzip -5 --verbose -- 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52043.log.gz 2024-09-19T09:25:17.908 INFO:teuthology.orchestra.run.smithi018.stderr: /var/log/ceph/ceph-client.admin.47934.log 2024-09-19T09:25:17.908 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.58986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36563.log 2024-09-19T09:25:17.908 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.58986.log.gz 2024-09-19T09:25:17.908 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44501.log 2024-09-19T09:25:17.908 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47934.log.gz 2024-09-19T09:25:17.908 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34697.log 2024-09-19T09:25:17.908 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36563.log: /var/log/ceph/ceph-client.admin.44501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.35759.log 2024-09-19T09:25:17.908 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34697.log: 87.8% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44501.log.gz 2024-09-19T09:25:17.908 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36563.log.gz 2024-09-19T09:25:17.908 INFO:teuthology.orchestra.run.smithi018.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34697.log.gz 2024-09-19T09:25:17.908 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56395.log 2024-09-19T09:25:17.909 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40488.log 2024-09-19T09:25:17.909 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.2.35759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59316.log 2024-09-19T09:25:17.909 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.56395.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.35759.log.gz 2024-09-19T09:25:17.909 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56395.log.gz/var/log/ceph/ceph-client.admin.40488.log: 2024-09-19T09:25:17.909 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49849.log 2024-09-19T09:25:17.909 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39363.log 2024-09-19T09:25:17.909 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.59316.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40488.log.gz 2024-09-19T09:25:17.909 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49849.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59316.log.gz 2024-09-19T09:25:17.909 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34333.log 2024-09-19T09:25:17.909 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.49849.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.56300.log 2024-09-19T09:25:17.909 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-19T09:25:17.909 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39363.log: /var/log/ceph/ceph-client.admin.34333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55367.log 2024-09-19T09:25:17.909 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.56300.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34333.log.gz 2024-09-19T09:25:17.910 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39363.log.gz 2024-09-19T09:25:17.910 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56300.log.gz 2024-09-19T09:25:17.910 INFO:teuthology.orchestra.run.smithi018.stderr: --verbose -- /var/log/ceph/ceph-client.admin.40349.log 2024-09-19T09:25:17.910 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.55367.log: gzip -5 --verbose -- 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55367.log.gz 2024-09-19T09:25:17.910 INFO:teuthology.orchestra.run.smithi018.stderr: /var/log/ceph/ceph-client.admin.60898.log 2024-09-19T09:25:17.910 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47724.log 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40349.log.gz 2024-09-19T09:25:17.910 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-19T09:25:17.910 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.60898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60585.log 89.4% -- replaced with /var/log/ceph/ceph-client.admin.60898.log.gz 2024-09-19T09:25:17.910 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-19T09:25:17.910 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56841.log 2024-09-19T09:25:17.910 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47724.log.gz 2024-09-19T09:25:17.910 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.60585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38682.log 2024-09-19T09:25:17.910 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60585.log.gz 2024-09-19T09:25:17.910 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54104.log 2024-09-19T09:25:17.911 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.56841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57481.log 2024-09-19T09:25:17.911 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38682.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56841.log.gz 2024-09-19T09:25:17.911 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.54104.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38682.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50281.log 2024-09-19T09:25:17.911 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-19T09:25:17.911 INFO:teuthology.orchestra.run.smithi018.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.54104.log.gz 2024-09-19T09:25:17.911 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40744.log 2024-09-19T09:25:17.911 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.57481.log: 0.0%/var/log/ceph/ceph-client.admin.50281.log: -- replaced with /var/log/ceph/ceph-client.0.57481.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39185.log 2024-09-19T09:25:17.911 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% 2024-09-19T09:25:17.911 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40744.log: -- replaced with /var/log/ceph/ceph-client.admin.50281.log.gz 2024-09-19T09:25:17.911 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52286.log 2024-09-19T09:25:17.911 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40744.log.gz 2024-09-19T09:25:17.911 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50055.log 2024-09-19T09:25:17.911 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39185.log: gzip -5 --verbose/var/log/ceph/ceph-client.admin.52286.log: -- /var/log/ceph/ceph-client.admin.62598.log 2024-09-19T09:25:17.912 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39185.log.gz 2024-09-19T09:25:17.912 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.52286.log.gz/var/log/ceph/ceph-client.admin.50055.log: 2024-09-19T09:25:17.912 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48845.log 2024-09-19T09:25:17.912 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7%/var/log/ceph/ceph-client.admin.62598.log: -- replaced with /var/log/ceph/ceph-client.admin.50055.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36061.log 2024-09-19T09:25:17.912 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-19T09:25:17.912 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62598.log.gz 2024-09-19T09:25:17.912 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48845.log: gzip -5 --verbose 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48845.log.gz 2024-09-19T09:25:17.912 INFO:teuthology.orchestra.run.smithi018.stderr: -- /var/log/ceph/ceph-client.admin.48719.log 2024-09-19T09:25:17.912 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50197.log 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36061.log.gz 2024-09-19T09:25:17.912 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-19T09:25:17.912 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58863.log 2024-09-19T09:25:17.912 INFO:teuthology.orchestra.run.smithi018.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48719.log.gz 2024-09-19T09:25:17.912 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34290.log 2024-09-19T09:25:17.912 INFO:teuthology.orchestra.run.smithi018.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50197.log.gz 2024-09-19T09:25:17.913 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62937.log 2024-09-19T09:25:17.913 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.58863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37204.log 2024-09-19T09:25:17.913 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34290.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58863.log.gz 2024-09-19T09:25:17.913 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.62937.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34290.log.gz 2024-09-19T09:25:17.913 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52743.log 2024-09-19T09:25:17.913 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37204.log: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45789.log 2024-09-19T09:25:17.913 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62937.log.gz 2024-09-19T09:25:17.913 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52743.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37204.log.gz 2024-09-19T09:25:17.913 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63720.log 2024-09-19T09:25:17.913 INFO:teuthology.orchestra.run.smithi018.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.52743.log.gz 2024-09-19T09:25:17.913 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33994.log 2024-09-19T09:25:17.913 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45789.log: /var/log/ceph/ceph-client.admin.63720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43787.log 2024-09-19T09:25:17.913 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33994.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45789.log.gz 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63720.log.gz 2024-09-19T09:25:17.914 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-19T09:25:17.914 INFO:teuthology.orchestra.run.smithi018.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.33994.log.gz 2024-09-19T09:25:17.914 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57181.log 2024-09-19T09:25:17.914 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32432.log 2024-09-19T09:25:17.914 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43787.log.gz 2024-09-19T09:25:17.914 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.57181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45344.log 2024-09-19T09:25:17.914 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.57181.log.gz 2024-09-19T09:25:17.914 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32432.log: gzip -5 --verbose 89.0% -- /var/log/ceph/ceph-client.admin.51539.log 2024-09-19T09:25:17.914 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32432.log.gz 2024-09-19T09:25:17.914 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48887.log 2024-09-19T09:25:17.914 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45344.log.gzgzip 2024-09-19T09:25:17.914 INFO:teuthology.orchestra.run.smithi018.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.48425.log 2024-09-19T09:25:17.914 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36103.log 2024-09-19T09:25:17.915 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48887.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51539.log.gz/var/log/ceph/ceph-client.admin.48425.log: 2024-09-19T09:25:17.915 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48425.log.gz 2024-09-19T09:25:17.915 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45386.log 2024-09-19T09:25:17.915 INFO:teuthology.orchestra.run.smithi018.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.48887.log.gz 2024-09-19T09:25:17.915 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61550.log 2024-09-19T09:25:17.915 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45386.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36103.log.gz 2024-09-19T09:25:17.915 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56048.log 2024-09-19T09:25:17.915 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48635.log 2024-09-19T09:25:17.915 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45386.log.gz 2024-09-19T09:25:17.915 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.61550.log: /var/log/ceph/ceph-client.admin.56048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41741.log 2024-09-19T09:25:17.915 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48635.log: 89.5% 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61550.log.gz 2024-09-19T09:25:17.915 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56048.log.gz 2024-09-19T09:25:17.915 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48635.log.gz 2024-09-19T09:25:17.916 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53308.log 2024-09-19T09:25:17.916 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.41741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34292.log 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41741.log.gz 2024-09-19T09:25:17.916 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-19T09:25:17.916 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63205.log 2024-09-19T09:25:17.916 INFO:teuthology.orchestra.run.smithi018.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53308.log.gz 2024-09-19T09:25:17.916 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45873.log 88.5% 2024-09-19T09:25:17.916 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34292.log.gz 2024-09-19T09:25:17.916 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.63205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63263.log 2024-09-19T09:25:17.916 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63205.log.gz 2024-09-19T09:25:17.916 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50323.log 2024-09-19T09:25:17.916 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42845.log 2024-09-19T09:25:17.916 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2%/var/log/ceph/ceph-client.admin.63263.log: -- replaced with /var/log/ceph/ceph-client.admin.45873.log.gz 2024-09-19T09:25:17.916 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50323.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.63263.log.gz 2024-09-19T09:25:17.916 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50323.log.gz 2024-09-19T09:25:17.917 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37990.log 2024-09-19T09:25:17.917 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49681.log 2024-09-19T09:25:17.917 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.42845.log: /var/log/ceph/ceph-client.admin.37990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51241.log 2024-09-19T09:25:17.917 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49681.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42845.log.gz 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37990.log.gz 2024-09-19T09:25:17.917 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-19T09:25:17.917 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49681.log.gz 2024-09-19T09:25:17.917 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49723.log 2024-09-19T09:25:17.917 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.51241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45302.log 2024-09-19T09:25:17.917 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51241.log.gz 2024-09-19T09:25:17.917 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37723.log 2024-09-19T09:25:17.917 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49723.log.gz 2024-09-19T09:25:17.917 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.45302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38116.log 2024-09-19T09:25:17.918 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45302.log.gz 2024-09-19T09:25:17.918 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50449.log 2024-09-19T09:25:17.918 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37723.log: /var/log/ceph/ceph-client.admin.38116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58604.log 2024-09-19T09:25:17.918 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.50449.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37723.log.gz 2024-09-19T09:25:17.918 INFO:teuthology.orchestra.run.smithi018.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38116.log.gz 2024-09-19T09:25:17.918 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37246.log 2024-09-19T09:25:17.918 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50449.log.gz 2024-09-19T09:25:17.918 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.58604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49977.log 2024-09-19T09:25:17.918 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37246.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.58604.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48252.log 2024-09-19T09:25:17.918 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-19T09:25:17.918 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37246.log.gz 2024-09-19T09:25:17.918 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42929.log 2024-09-19T09:25:17.918 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49977.log: /var/log/ceph/ceph-client.admin.48252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37373.log 2024-09-19T09:25:17.918 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9%/var/log/ceph/ceph-client.admin.42929.log: -- replaced with /var/log/ceph/ceph-client.admin.49977.log.gz 88.7% 2024-09-19T09:25:17.919 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48252.log.gz 2024-09-19T09:25:17.919 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42929.log.gz 2024-09-19T09:25:17.919 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36731.log 2024-09-19T09:25:17.919 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58436.log 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37373.log.gz 2024-09-19T09:25:17.919 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-19T09:25:17.919 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48593.log 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36731.log.gz 2024-09-19T09:25:17.919 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-19T09:25:17.919 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.58436.log: gzip -5 --verbose -- 88.8% /var/log/ceph/ceph-client.admin.43373.log 2024-09-19T09:25:17.919 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58436.log.gz 2024-09-19T09:25:17.919 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50936.log 2024-09-19T09:25:17.919 INFO:teuthology.orchestra.run.smithi018.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48593.log.gz 2024-09-19T09:25:17.919 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52911.log 2024-09-19T09:25:17.919 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47411.log 2024-09-19T09:25:17.919 INFO:teuthology.orchestra.run.smithi018.stderr: 87.4%/var/log/ceph/ceph-client.admin.50936.log: -- replaced with /var/log/ceph/ceph-client.admin.43373.log.gz 2024-09-19T09:25:17.919 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52911.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50936.log.gz 2024-09-19T09:25:17.920 INFO:teuthology.orchestra.run.smithi018.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.52911.log.gz 2024-09-19T09:25:17.920 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38242.log 2024-09-19T09:25:17.920 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.47411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52202.log 2024-09-19T09:25:17.920 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.38242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42668.log 2024-09-19T09:25:17.920 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47411.log.gz 2024-09-19T09:25:17.920 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.52202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62811.log 2024-09-19T09:25:17.920 INFO:teuthology.orchestra.run.smithi018.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.38242.log.gz/var/log/ceph/ceph-client.admin.42668.log: 2024-09-19T09:25:17.920 INFO:teuthology.orchestra.run.smithi018.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52202.log.gz 2024-09-19T09:25:17.920 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59210.log 2024-09-19T09:25:17.920 INFO:teuthology.orchestra.run.smithi018.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.42668.log.gz 2024-09-19T09:25:17.920 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34332.log 2024-09-19T09:25:17.920 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.59210.log: /var/log/ceph/ceph-client.admin.62811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59484.log 2024-09-19T09:25:17.920 INFO:teuthology.orchestra.run.smithi018.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.59210.log.gz 2024-09-19T09:25:17.921 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62811.log.gz 2024-09-19T09:25:17.921 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62853.log 2024-09-19T09:25:17.921 INFO:teuthology.orchestra.run.smithi018.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34332.log.gz/var/log/ceph/ceph-client.admin.59484.log: 2024-09-19T09:25:17.921 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37948.log 2024-09-19T09:25:17.921 INFO:teuthology.orchestra.run.smithi018.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.59484.log.gz 2024-09-19T09:25:17.921 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.62853.log: gzip -5 --verbose -- 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62853.log.gz 2024-09-19T09:25:17.921 INFO:teuthology.orchestra.run.smithi018.stderr: /var/log/ceph/ceph-client.admin.40307.log 2024-09-19T09:25:17.921 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43703.log 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37948.log.gz 2024-09-19T09:25:17.921 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-19T09:25:17.921 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40307.log: gzip -5 --verbose -- 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40307.log.gz 2024-09-19T09:25:17.921 INFO:teuthology.orchestra.run.smithi018.stderr: /var/log/ceph/ceph-client.admin.53140.log 2024-09-19T09:25:17.921 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43128.log 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43703.log.gz 2024-09-19T09:25:17.921 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-19T09:25:17.922 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57559.log 2024-09-19T09:25:17.922 INFO:teuthology.orchestra.run.smithi018.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53140.log.gz 2024-09-19T09:25:17.922 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48761.log 2024-09-19T09:25:17.922 INFO:teuthology.orchestra.run.smithi018.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43128.log.gz 2024-09-19T09:25:17.922 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.57559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43331.log 2024-09-19T09:25:17.922 INFO:teuthology.orchestra.run.smithi018.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57559.log.gz 2024-09-19T09:25:17.922 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62556.log 89.0% 2024-09-19T09:25:17.922 INFO:teuthology.orchestra.run.smithi018.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48761.log.gz 2024-09-19T09:25:17.922 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39904.log 2024-09-19T09:25:17.922 INFO:teuthology.orchestra.run.smithi018.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43331.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-19T09:25:17.922 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-19T09:25:17.922 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.62556.log: /var/log/ceph/ceph-client.admin.39904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43615.log 2024-09-19T09:25:17.922 INFO:teuthology.orchestra.run.smithi018.stderr: 87.7%/var/log/ceph/ceph-osd.3.log: -- replaced with /var/log/ceph/ceph-client.admin.62556.log.gz 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39904.log.gz 2024-09-19T09:25:17.922 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-19T09:25:17.923 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43208.log 2024-09-19T09:25:17.923 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40530.log 2024-09-19T09:25:17.923 INFO:teuthology.orchestra.run.smithi018.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43615.log.gz 2024-09-19T09:25:17.923 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59117.log 2024-09-19T09:25:17.923 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.40530.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43208.log.gz 2024-09-19T09:25:17.923 INFO:teuthology.orchestra.run.smithi018.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40530.log.gz 2024-09-19T09:25:17.923 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41338.log 2024-09-19T09:25:17.923 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.59117.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-19T09:25:17.923 INFO:teuthology.orchestra.run.smithi018.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.59117.log.gz 2024-09-19T09:25:17.923 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.41338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48803.log 2024-09-19T09:25:17.923 INFO:teuthology.orchestra.run.smithi018.stderr: 0.0%/var/log/ceph/ceph-mds.c.log: -- replaced with /var/log/ceph/ceph-client.0.41338.log.gz 2024-09-19T09:25:17.923 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64417.log 2024-09-19T09:25:17.923 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.48803.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48803.log.gz 2024-09-19T09:25:17.924 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36605.log 2024-09-19T09:25:17.924 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.64417.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.64417.log.gz 2024-09-19T09:25:17.924 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58394.log 2024-09-19T09:25:17.924 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36605.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36605.log.gz 2024-09-19T09:25:17.924 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56929.log 2024-09-19T09:25:17.924 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.58394.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58394.log.gz 2024-09-19T09:25:17.924 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54924.log 2024-09-19T09:25:17.924 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.56929.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56929.log.gz 2024-09-19T09:25:17.924 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33660.log 2024-09-19T09:25:17.924 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.54924.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54924.log.gz 2024-09-19T09:25:17.924 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32659.log 2024-09-19T09:25:17.924 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.33660.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33660.log.gz 2024-09-19T09:25:17.924 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36207.log 2024-09-19T09:25:17.924 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.32659.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32659.log.gz 2024-09-19T09:25:17.925 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34613.log 2024-09-19T09:25:17.925 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36207.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36207.log.gz 2024-09-19T09:25:17.925 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39946.log 2024-09-19T09:25:17.925 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.34613.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34613.log.gz 2024-09-19T09:25:17.925 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53224.log 2024-09-19T09:25:17.925 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.39946.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39946.log.gz 2024-09-19T09:25:17.925 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37864.log 2024-09-19T09:25:17.925 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.53224.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53224.log.gz 2024-09-19T09:25:17.925 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43955.log 2024-09-19T09:25:17.925 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.37864.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37864.log.gz 2024-09-19T09:25:17.925 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49455.log 2024-09-19T09:25:17.925 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.43955.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43955.log.gz 2024-09-19T09:25:17.925 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36899.log 2024-09-19T09:25:17.925 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.49455.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49455.log.gz 2024-09-19T09:25:17.926 INFO:teuthology.orchestra.run.smithi018.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62182.log 2024-09-19T09:25:17.926 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.admin.36899.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36899.log.gz 2024-09-19T09:25:17.926 INFO:teuthology.orchestra.run.smithi018.stderr:/var/log/ceph/ceph-client.0.62182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.62182.log.gz 2024-09-19T09:25:17.993 INFO:teuthology.orchestra.run.smithi162.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-19T09:25:18.017 INFO:teuthology.orchestra.run.smithi162.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-19T09:25:18.048 INFO:teuthology.orchestra.run.smithi018.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-19T09:25:18.158 INFO:teuthology.orchestra.run.smithi018.stderr: 94.5% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-19T09:25:18.358 INFO:teuthology.orchestra.run.smithi018.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-19T09:25:18.372 INFO:teuthology.orchestra.run.smithi162.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-19T09:25:18.441 INFO:teuthology.orchestra.run.smithi162.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-19T09:25:18.484 INFO:teuthology.orchestra.run.smithi162.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-19T09:25:18.514 INFO:teuthology.orchestra.run.smithi018.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-19T09:25:18.550 INFO:teuthology.orchestra.run.smithi018.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-19T09:25:18.568 INFO:teuthology.orchestra.run.smithi162.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-19T09:25:18.570 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-09-19T09:25:18.570 INFO:teuthology.orchestra.run.smithi162.stderr:real 0m0.996s 2024-09-19T09:25:18.570 INFO:teuthology.orchestra.run.smithi162.stderr:user 0m4.426s 2024-09-19T09:25:18.570 INFO:teuthology.orchestra.run.smithi162.stderr:sys 0m0.184s 2024-09-19T09:25:18.647 INFO:teuthology.orchestra.run.smithi018.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-19T09:25:18.673 INFO:teuthology.orchestra.run.smithi018.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-19T09:25:18.674 INFO:teuthology.orchestra.run.smithi018.stderr: 2024-09-19T09:25:18.674 INFO:teuthology.orchestra.run.smithi018.stderr:real 0m1.122s 2024-09-19T09:25:18.674 INFO:teuthology.orchestra.run.smithi018.stderr:user 0m5.295s 2024-09-19T09:25:18.674 INFO:teuthology.orchestra.run.smithi018.stderr:sys 0m0.569s 2024-09-19T09:25:18.674 INFO:tasks.ceph:Archiving logs... 2024-09-19T09:25:18.674 DEBUG:teuthology.misc:Transferring archived files from smithi018:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911897/remote/smithi018/log 2024-09-19T09:25:18.675 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T09:25:19.690 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-19T09:25:19.690 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-19T09:25:19.785 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911897/remote/smithi162/log 2024-09-19T09:25:19.786 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T09:25:20.402 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T09:25:20.411 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T09:25:20.412 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T09:25:20.415 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T09:25:20.493 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T09:25:20.502 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T09:25:20.503 DEBUG:teuthology.orchestra.run.smithi018:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:25:20.508 DEBUG:teuthology.orchestra.run.smithi162:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:25:20.521 INFO:teuthology.orchestra.run.smithi018.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:25:20.525 INFO:teuthology.orchestra.run.smithi162.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:25:20.526 INFO:teuthology.orchestra.run.smithi018.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:25:20.526 INFO:teuthology.orchestra.run.smithi018.stdout:=============================================================================== 2024-09-19T09:25:20.526 INFO:teuthology.orchestra.run.smithi018.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 54 +1135us[+1135us] +/- 62ms 2024-09-19T09:25:20.526 INFO:teuthology.orchestra.run.smithi018.stdout:^* hv02.front.sepia.ceph.com 3 6 377 55 -2353us[-2373us] +/- 67ms 2024-09-19T09:25:20.526 INFO:teuthology.orchestra.run.smithi018.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 55 +1407us[+1407us] +/- 85ms 2024-09-19T09:25:20.526 INFO:teuthology.orchestra.run.smithi018.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:25:20.530 INFO:teuthology.orchestra.run.smithi162.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:25:20.530 INFO:teuthology.orchestra.run.smithi162.stdout:=============================================================================== 2024-09-19T09:25:20.530 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 55 +1129us[+1129us] +/- 62ms 2024-09-19T09:25:20.530 INFO:teuthology.orchestra.run.smithi162.stdout:^* hv02.front.sepia.ceph.com 3 6 377 56 -2350us[-2361us] +/- 67ms 2024-09-19T09:25:20.530 INFO:teuthology.orchestra.run.smithi162.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 55 +1411us[+1411us] +/- 85ms 2024-09-19T09:25:20.531 INFO:teuthology.orchestra.run.smithi162.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:25:20.531 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T09:25:20.540 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T09:25:20.541 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T09:25:20.549 DEBUG:teuthology.orchestra.run.smithi018:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T09:25:20.660 DEBUG:teuthology.orchestra.run.smithi162:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T09:25:20.734 DEBUG:teuthology.orchestra.run.smithi018:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:25:20.766 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:25:20.767 DEBUG:teuthology.orchestra.run.smithi162:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:25:20.798 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:25:20.798 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T09:25:20.808 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T09:25:20.817 INFO:teuthology.task.internal:Duration was 1068.935286 seconds 2024-09-19T09:25:20.817 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T09:25:20.826 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T09:25:20.826 DEBUG:teuthology.orchestra.run.smithi018:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T09:25:20.829 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T09:25:20.869 INFO:teuthology.orchestra.run.smithi018.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:25:20.880 INFO:teuthology.orchestra.run.smithi162.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:25:21.202 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T09:25:21.202 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi018.front.sepia.ceph.com 2024-09-19T09:25:21.202 DEBUG:teuthology.orchestra.run.smithi018:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T09:25:21.226 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi162.front.sepia.ceph.com 2024-09-19T09:25:21.226 DEBUG:teuthology.orchestra.run.smithi162:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T09:25:21.272 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T09:25:21.273 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T09:25:21.275 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T09:25:21.341 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T09:25:21.341 DEBUG:teuthology.orchestra.run.smithi018:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T09:25:21.344 DEBUG:teuthology.orchestra.run.smithi162:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T09:25:21.494 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T09:25:21.504 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T09:25:21.504 DEBUG:teuthology.orchestra.run.smithi018:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T09:25:21.530 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T09:25:21.555 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T09:25:21.565 DEBUG:teuthology.orchestra.run.smithi018:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:25:21.573 DEBUG:teuthology.orchestra.run.smithi162:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:25:21.595 INFO:teuthology.orchestra.run.smithi018.stdout:kernel.core_pattern = core 2024-09-19T09:25:21.619 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = core 2024-09-19T09:25:21.632 DEBUG:teuthology.orchestra.run.smithi018:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:25:21.665 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:25:21.665 DEBUG:teuthology.orchestra.run.smithi162:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:25:21.686 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:25:21.687 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T09:25:21.696 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T09:25:21.697 DEBUG:teuthology.misc:Transferring archived files from smithi018:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911897/remote/smithi018 2024-09-19T09:25:21.697 DEBUG:teuthology.orchestra.run.smithi018:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T09:25:21.744 DEBUG:teuthology.misc:Transferring archived files from smithi162:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911897/remote/smithi162 2024-09-19T09:25:21.744 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T09:25:21.777 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T09:25:21.777 DEBUG:teuthology.orchestra.run.smithi018:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T09:25:21.781 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T09:25:21.827 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T09:25:21.838 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T09:25:21.839 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T09:25:21.848 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T09:25:21.848 DEBUG:teuthology.orchestra.run.smithi018:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T09:25:21.850 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T09:25:21.863 INFO:teuthology.orchestra.run.smithi018.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 09:25 /home/ubuntu/cephtest 2024-09-19T09:25:21.882 INFO:teuthology.orchestra.run.smithi162.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 09:25 /home/ubuntu/cephtest 2024-09-19T09:25:21.883 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T09:25:21.894 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T09:25:21.915 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/mds-full} duration: 1068.9352858066559 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-19T09:25:21.915 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T09:25:22.005 INFO:teuthology.run:pass